2023-09-23T08:26:13.081 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-09-23T08:26:13.081 DEBUG:teuthology.run:Teuthology command: teuthology --name mchangir-2023-09-23_08:19:06-fs:workload-wip-vshankar-testing-20230824.045828-scrub-failure-testing-default-smithi --description fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-workunit/postgres}} --verbose --owner mchangir --archive /home/teuthworker/archive/mchangir-2023-09-23_08:19:06-fs:workload-wip-vshankar-testing-20230824.045828-scrub-failure-testing-default-smithi/7401665 -- /home/teuthworker/archive/mchangir-2023-09-23_08:19:06-fs:workload-wip-vshankar-testing-20230824.045828-scrub-failure-testing-default-smithi/7401665/orig.config.yaml 2023-09-23T08:26:13.151 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-23T08:26:13.243 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/mchangir-2023-09-23_08:19:06-fs:workload-wip-vshankar-testing-20230824.045828-scrub-failure-testing-default-smithi/7401665 branch: wip-vshankar-testing-20230824.045828-scrub-failure description: fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-workunit/postgres}} email: mchangir@redhat.com first_in_suite: false job_id: '7401665' kernel: flavor: default kdb: true sha1: fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: mchangir-2023-09-23_08:19:06-fs:workload-wip-vshankar-testing-20230824.045828-scrub-failure-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: wip-vshankar-testing-20230824.045828-scrub-failure ceph: cephfs: max_mds: 5 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug cephsqlite: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - slow metadata IO - SLOW_OPS - slow request sha1: db9a2d12746faa158579b8d032d53d472ae6b6b0 subvols: create: 2 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mntopts: - context=system_u:object_r:postgresql_db_t:s0 mount_subvol_num: 0 mountpoint: /tmp/cephfs check-counter: counters: mds: - mds.exported - mds.imported - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount install: ceph: flavor: default sha1: db9a2d12746faa158579b8d032d53d472ae6b6b0 kclient: client.0: mntopts: - context=system_u:object_r:postgresql_db_t:s0 mount_subvol_num: 1 mountpoint: /tmp/cephfs selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing-20230824.045828-scrub-failure sha1: db9a2d12746faa158579b8d032d53d472ae6b6b0 owner: mchangir priority: 25 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 3806 sha1: db9a2d12746faa158579b8d032d53d472ae6b6b0 sleep_before_teardown: 0 suite: fs:workload suite_branch: wip-vshankar-testing-20230824.045828-scrub-failure suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_db9a2d12746faa158579b8d032d53d472ae6b6b0/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: db9a2d12746faa158579b8d032d53d472ae6b6b0 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi082.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= smithi135.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= smithi161.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= tasks: - pexec: all: - sudo cp /etc/containers/registries.conf /etc/containers/registries.conf.backup - sudo dnf -y module reset container-tools - sudo dnf -y module install container-tools:rhel8 --allowerasing --nobest - sudo cp /etc/containers/registries.conf.backup /etc/containers/registries.conf - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - ceph-fuse: null - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - exec: mon.a: - ceph mgr module enable snap_schedule - ceph config set mgr mgr/snap_schedule/allow_m_granularity true - ceph config set mgr mgr/snap_schedule/dump_on_update true - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1M - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6M3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - exec: client.0: - sudo ls -l /tmp/cephfs/ && sudo df -h /tmp/cephfs/ - sudo mkdir -m 755 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres && sudo chown postgres:postgres /tmp/cephfs/postgres - sudo -u postgres -- mkdir -m 700 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres/data - sudo semanage fcontext -a -t postgresql_db_t "/tmp/cephfs/postgres(/.*)?" - sudo grep -i postgresql /etc/selinux/targeted/contexts/files/file_contexts.local - sudo restorecon -R -v /tmp/cephfs/postgres - sudo ls -lZaR /tmp/cephfs/postgres/ - sudo mkdir -p /etc/systemd/system/postgresql.service.d/ && printf '[Service]\nEnvironment=PGDATA=/tmp/cephfs/postgres/data\nEnvironment=PGLOG=/tmp/cephfs/postgres/pgstartup.log\n' | sudo tee /etc/systemd/system/postgresql.service.d/env.conf - sudo -u postgres -- postgresql-setup --initdb - sudo ls -lZaR /tmp/cephfs/postgres/ - sudo systemctl start postgresql - sudo -u postgres -- pgbench -s 500 -i - sudo -u postgres -- pgbench -c 100 -j 4 --progress=5 --time=900 - sudo systemctl stop postgresql - sudo ls -lZaR /tmp/cephfs/postgres/ teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-09-23_08:19:06 tube: smithi user: mchangir verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-09-23T08:26:13.243 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_db9a2d12746faa158579b8d032d53d472ae6b6b0/qa; will attempt to use it 2023-09-23T08:26:13.244 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_db9a2d12746faa158579b8d032d53d472ae6b6b0/qa/tasks 2023-09-23T08:26:13.244 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-09-23T08:26:13.246 INFO:teuthology.task.internal:Checking packages... 2023-09-23T08:26:13.271 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash 'db9a2d12746faa158579b8d032d53d472ae6b6b0' 2023-09-23T08:26:13.271 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-09-23T08:26:13.271 INFO:teuthology.packaging:ref: None 2023-09-23T08:26:13.271 INFO:teuthology.packaging:tag: None 2023-09-23T08:26:13.271 INFO:teuthology.packaging:branch: wip-vshankar-testing-20230824.045828-scrub-failure 2023-09-23T08:26:13.271 INFO:teuthology.packaging:sha1: db9a2d12746faa158579b8d032d53d472ae6b6b0 2023-09-23T08:26:13.272 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-vshankar-testing-20230824.045828-scrub-failure 2023-09-23T08:26:13.418 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-5661.gdb9a2d12 2023-09-23T08:26:13.418 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-09-23T08:26:13.425 INFO:teuthology.task.internal:no buildpackages task found 2023-09-23T08:26:13.425 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-09-23T08:26:13.450 INFO:teuthology.task.internal:Saving configuration 2023-09-23T08:26:13.473 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-09-23T08:26:13.479 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-23T08:26:13.505 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi082.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2023-09-23_08:19:06-fs:workload-wip-vshankar-testing-20230824.045828-scrub-failure-testing-default-smithi/7401665', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-23 08:20:58.944665', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-09-23T08:26:13.528 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi135.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2023-09-23_08:19:06-fs:workload-wip-vshankar-testing-20230824.045828-scrub-failure-testing-default-smithi/7401665', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-23 08:20:58.946358', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-09-23T08:26:13.551 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi161.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2023-09-23_08:19:06-fs:workload-wip-vshankar-testing-20230824.045828-scrub-failure-testing-default-smithi/7401665', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-23 08:20:58.947982', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-09-23T08:26:13.552 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-09-23T08:26:13.558 INFO:teuthology.task.internal:roles: ubuntu@smithi082.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2023-09-23T08:26:13.558 INFO:teuthology.task.internal:roles: ubuntu@smithi135.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2023-09-23T08:26:13.558 INFO:teuthology.task.internal:roles: ubuntu@smithi161.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2023-09-23T08:26:13.558 INFO:teuthology.run_tasks:Running task console_log... 2023-09-23T08:26:13.661 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f109b862af0>, signals=[15]) 2023-09-23T08:26:13.661 INFO:teuthology.run_tasks:Running task internal.connect... 2023-09-23T08:26:13.667 INFO:teuthology.task.internal:Opening connections... 2023-09-23T08:26:13.667 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi082.front.sepia.ceph.com 2023-09-23T08:26:13.669 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-23T08:26:13.736 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi135.front.sepia.ceph.com 2023-09-23T08:26:13.738 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-23T08:26:13.804 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi161.front.sepia.ceph.com 2023-09-23T08:26:13.804 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-23T08:26:13.870 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-09-23T08:26:13.877 DEBUG:teuthology.orchestra.run.smithi082:> uname -m 2023-09-23T08:26:13.898 INFO:teuthology.orchestra.run.smithi082.stdout:x86_64 2023-09-23T08:26:13.899 DEBUG:teuthology.orchestra.run.smithi082:> cat /etc/os-release 2023-09-23T08:26:13.958 INFO:teuthology.orchestra.run.smithi082.stdout:NAME="Red Hat Enterprise Linux" 2023-09-23T08:26:13.958 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION="8.6 (Ootpa)" 2023-09-23T08:26:13.958 INFO:teuthology.orchestra.run.smithi082.stdout:ID="rhel" 2023-09-23T08:26:13.958 INFO:teuthology.orchestra.run.smithi082.stdout:ID_LIKE="fedora" 2023-09-23T08:26:13.958 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION_ID="8.6" 2023-09-23T08:26:13.958 INFO:teuthology.orchestra.run.smithi082.stdout:PLATFORM_ID="platform:el8" 2023-09-23T08:26:13.958 INFO:teuthology.orchestra.run.smithi082.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-23T08:26:13.958 INFO:teuthology.orchestra.run.smithi082.stdout:ANSI_COLOR="0;31" 2023-09-23T08:26:13.959 INFO:teuthology.orchestra.run.smithi082.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-23T08:26:13.959 INFO:teuthology.orchestra.run.smithi082.stdout:HOME_URL="https://www.redhat.com/" 2023-09-23T08:26:13.959 INFO:teuthology.orchestra.run.smithi082.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-23T08:26:13.959 INFO:teuthology.orchestra.run.smithi082.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-23T08:26:13.959 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:26:13.959 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-23T08:26:13.959 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-23T08:26:13.959 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-23T08:26:13.959 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-23T08:26:13.960 INFO:teuthology.lock.ops:Updating smithi082.front.sepia.ceph.com on lock server 2023-09-23T08:26:13.982 DEBUG:teuthology.orchestra.run.smithi135:> uname -m 2023-09-23T08:26:14.003 INFO:teuthology.orchestra.run.smithi135.stdout:x86_64 2023-09-23T08:26:14.003 DEBUG:teuthology.orchestra.run.smithi135:> cat /etc/os-release 2023-09-23T08:26:14.061 INFO:teuthology.orchestra.run.smithi135.stdout:NAME="Red Hat Enterprise Linux" 2023-09-23T08:26:14.062 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION="8.6 (Ootpa)" 2023-09-23T08:26:14.062 INFO:teuthology.orchestra.run.smithi135.stdout:ID="rhel" 2023-09-23T08:26:14.062 INFO:teuthology.orchestra.run.smithi135.stdout:ID_LIKE="fedora" 2023-09-23T08:26:14.062 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION_ID="8.6" 2023-09-23T08:26:14.062 INFO:teuthology.orchestra.run.smithi135.stdout:PLATFORM_ID="platform:el8" 2023-09-23T08:26:14.062 INFO:teuthology.orchestra.run.smithi135.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-23T08:26:14.062 INFO:teuthology.orchestra.run.smithi135.stdout:ANSI_COLOR="0;31" 2023-09-23T08:26:14.062 INFO:teuthology.orchestra.run.smithi135.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-23T08:26:14.062 INFO:teuthology.orchestra.run.smithi135.stdout:HOME_URL="https://www.redhat.com/" 2023-09-23T08:26:14.062 INFO:teuthology.orchestra.run.smithi135.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-23T08:26:14.062 INFO:teuthology.orchestra.run.smithi135.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-23T08:26:14.063 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-09-23T08:26:14.063 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-23T08:26:14.063 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-23T08:26:14.063 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-23T08:26:14.063 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-23T08:26:14.063 INFO:teuthology.lock.ops:Updating smithi135.front.sepia.ceph.com on lock server 2023-09-23T08:26:14.083 DEBUG:teuthology.orchestra.run.smithi161:> uname -m 2023-09-23T08:26:14.103 INFO:teuthology.orchestra.run.smithi161.stdout:x86_64 2023-09-23T08:26:14.104 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release 2023-09-23T08:26:14.164 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="Red Hat Enterprise Linux" 2023-09-23T08:26:14.164 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="8.6 (Ootpa)" 2023-09-23T08:26:14.164 INFO:teuthology.orchestra.run.smithi161.stdout:ID="rhel" 2023-09-23T08:26:14.164 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="fedora" 2023-09-23T08:26:14.165 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="8.6" 2023-09-23T08:26:14.165 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el8" 2023-09-23T08:26:14.165 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-23T08:26:14.165 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31" 2023-09-23T08:26:14.165 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-23T08:26:14.165 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://www.redhat.com/" 2023-09-23T08:26:14.165 INFO:teuthology.orchestra.run.smithi161.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-23T08:26:14.165 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-23T08:26:14.165 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-09-23T08:26:14.166 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-23T08:26:14.166 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-23T08:26:14.166 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-23T08:26:14.166 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-23T08:26:14.166 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server 2023-09-23T08:26:14.191 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-09-23T08:26:14.201 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-09-23T08:26:14.207 INFO:teuthology.task.internal:Checking for old test directory... 2023-09-23T08:26:14.207 DEBUG:teuthology.orchestra.run.smithi082:> test '!' -e /home/ubuntu/cephtest 2023-09-23T08:26:14.210 DEBUG:teuthology.orchestra.run.smithi135:> test '!' -e /home/ubuntu/cephtest 2023-09-23T08:26:14.213 DEBUG:teuthology.orchestra.run.smithi161:> test '!' -e /home/ubuntu/cephtest 2023-09-23T08:26:14.232 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-09-23T08:26:14.237 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-09-23T08:26:14.238 DEBUG:teuthology.orchestra.run.smithi082:> test -z $(ls -A /var/lib/ceph) 2023-09-23T08:26:14.269 DEBUG:teuthology.orchestra.run.smithi135:> test -z $(ls -A /var/lib/ceph) 2023-09-23T08:26:14.273 DEBUG:teuthology.orchestra.run.smithi161:> test -z $(ls -A /var/lib/ceph) 2023-09-23T08:26:14.305 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-09-23T08:26:14.384 INFO:teuthology.run_tasks:Running task kernel... 2023-09-23T08:26:14.402 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': 'fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c'} 2023-09-23T08:26:14.402 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': True, 'sha1': 'fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c'}, 'mon.b': {'flavor': 'default', 'kdb': True, 'sha1': 'fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c'}, 'mon.c': {'flavor': 'default', 'kdb': True, 'sha1': 'fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c'}}, timeout 300 2023-09-23T08:26:14.403 DEBUG:teuthology.orchestra.run.smithi082:> test -f /run/.containerenv -o -f /.dockerenv 2023-09-23T08:26:14.403 DEBUG:teuthology.orchestra.run.smithi135:> test -f /run/.containerenv -o -f /.dockerenv 2023-09-23T08:26:14.404 DEBUG:teuthology.orchestra.run.smithi161:> test -f /run/.containerenv -o -f /.dockerenv 2023-09-23T08:26:14.422 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-23T08:26:14.423 DEBUG:teuthology.task.kernel:sha1 for mon.b is fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-09-23T08:26:14.423 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c"... 2023-09-23T08:26:14.423 DEBUG:teuthology.orchestra.run.smithi135:> uname -r 2023-09-23T08:26:14.424 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-23T08:26:14.424 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-23T08:26:14.425 DEBUG:teuthology.task.kernel:sha1 for mon.a is fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-09-23T08:26:14.425 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c"... 2023-09-23T08:26:14.425 DEBUG:teuthology.orchestra.run.smithi082:> uname -r 2023-09-23T08:26:14.425 DEBUG:teuthology.task.kernel:sha1 for mon.c is fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-09-23T08:26:14.426 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c"... 2023-09-23T08:26:14.426 DEBUG:teuthology.orchestra.run.smithi161:> uname -r 2023-09-23T08:26:14.483 INFO:teuthology.orchestra.run.smithi135.stdout:4.18.0-372.9.1.el8.x86_64 2023-09-23T08:26:14.483 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-372.9.1.el8.x86_64 vs fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-09-23T08:26:14.484 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-09-23T08:26:14.484 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-09-23T08:26:14.489 INFO:teuthology.orchestra.run.smithi082.stdout:4.18.0-372.9.1.el8.x86_64 2023-09-23T08:26:14.489 INFO:teuthology.orchestra.run.smithi161.stdout:4.18.0-372.9.1.el8.x86_64 2023-09-23T08:26:14.489 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-372.9.1.el8.x86_64 vs fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-09-23T08:26:14.490 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-09-23T08:26:14.490 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-09-23T08:26:14.491 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-372.9.1.el8.x86_64 vs fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-09-23T08:26:14.491 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-09-23T08:26:14.491 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-09-23T08:26:14.637 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum upgrade -y linux-firmware 2023-09-23T08:26:14.805 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum upgrade -y linux-firmware 2023-09-23T08:26:14.808 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum upgrade -y linux-firmware 2023-09-23T08:26:15.755 INFO:teuthology.orchestra.run.smithi135.stdout:Updating Subscription Management repositories. 2023-09-23T08:26:15.756 INFO:teuthology.orchestra.run.smithi135.stdout:Unable to read consumer identity 2023-09-23T08:26:15.944 INFO:teuthology.orchestra.run.smithi161.stdout:Updating Subscription Management repositories. 2023-09-23T08:26:15.944 INFO:teuthology.orchestra.run.smithi161.stdout:Unable to read consumer identity 2023-09-23T08:26:16.023 INFO:teuthology.orchestra.run.smithi082.stdout:Updating Subscription Management repositories. 2023-09-23T08:26:16.023 INFO:teuthology.orchestra.run.smithi082.stdout:Unable to read consumer identity 2023-09-23T08:26:17.326 INFO:teuthology.orchestra.run.smithi135.stdout:Copr repo for python3-asyncssh owned by ceph 11 kB/s | 3.5 kB 00:00 2023-09-23T08:26:17.440 INFO:teuthology.orchestra.run.smithi161.stdout:Copr repo for python3-asyncssh owned by ceph 15 kB/s | 3.5 kB 00:00 2023-09-23T08:26:17.560 INFO:teuthology.orchestra.run.smithi082.stdout:Copr repo for python3-asyncssh owned by ceph 13 kB/s | 3.5 kB 00:00 2023-09-23T08:26:18.994 INFO:teuthology.orchestra.run.smithi135.stdout:Extra Packages for Enterprise Linux 9.6 MB/s | 16 MB 00:01 2023-09-23T08:26:20.451 INFO:teuthology.orchestra.run.smithi082.stdout:Extra Packages for Enterprise Linux 5.5 MB/s | 16 MB 00:02 2023-09-23T08:26:20.524 INFO:teuthology.orchestra.run.smithi161.stdout:Extra Packages for Enterprise Linux 5.2 MB/s | 16 MB 00:03 2023-09-23T08:26:22.586 INFO:teuthology.orchestra.run.smithi135.stdout:lab-extras 414 kB/s | 24 kB 00:00 2023-09-23T08:26:23.348 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2023-09-23T08:26:23.349 INFO:teuthology.orchestra.run.smithi135.stdout:Nothing to do. 2023-09-23T08:26:23.349 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2023-09-23T08:26:23.475 INFO:teuthology.task.kernel:Downloading kernel fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c on mon.b... 2023-09-23T08:26:23.475 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-09-23T08:26:23.828 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/ 2023-09-23T08:26:23.829 DEBUG:teuthology.orchestra.run.smithi135:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.5.0_rc7_gfef64f93da2b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/ --input-file=- 2023-09-23T08:26:23.831 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi135.front.sepia.ceph.com to complete... 2023-09-23T08:26:23.943 INFO:teuthology.orchestra.run.smithi082.stdout:lab-extras 478 kB/s | 24 kB 00:00 2023-09-23T08:26:24.308 INFO:teuthology.orchestra.run.smithi161.stdout:lab-extras 85 kB/s | 24 kB 00:00 2023-09-23T08:26:24.695 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2023-09-23T08:26:24.696 INFO:teuthology.orchestra.run.smithi082.stdout:Nothing to do. 2023-09-23T08:26:24.696 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2023-09-23T08:26:24.835 INFO:teuthology.task.kernel:Downloading kernel fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c on mon.a... 2023-09-23T08:26:24.835 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-09-23T08:26:24.975 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/ 2023-09-23T08:26:24.975 DEBUG:teuthology.orchestra.run.smithi082:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.5.0_rc7_gfef64f93da2b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/ --input-file=- 2023-09-23T08:26:24.977 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi082.front.sepia.ceph.com to complete... 2023-09-23T08:26:25.039 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2023-09-23T08:26:25.040 INFO:teuthology.orchestra.run.smithi161.stdout:Nothing to do. 2023-09-23T08:26:25.040 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2023-09-23T08:26:25.151 INFO:teuthology.task.kernel:Downloading kernel fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c on mon.c... 2023-09-23T08:26:25.151 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-09-23T08:26:25.407 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/ 2023-09-23T08:26:25.407 DEBUG:teuthology.orchestra.run.smithi161:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.5.0_rc7_gfef64f93da2b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/ --input-file=- 2023-09-23T08:26:25.409 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi161.front.sepia.ceph.com to complete... 2023-09-23T08:26:51.757 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23 08:26:51 URL:https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/kernel-6.5.0_rc7_gfef64f93da2b-1.x86_64.rpm [380759012/380759012] -> "/tmp/kernel.x86_64.rpm" [1] 2023-09-23T08:26:51.757 INFO:teuthology.orchestra.run.smithi135.stderr:FINISHED --2023-09-23 08:26:51-- 2023-09-23T08:26:51.757 INFO:teuthology.orchestra.run.smithi135.stderr:Total wall clock time: 28s 2023-09-23T08:26:51.758 INFO:teuthology.orchestra.run.smithi135.stderr:Downloaded: 1 files, 363M in 28s (13.1 MB/s) 2023-09-23T08:26:51.759 INFO:teuthology.task.kernel:Installing kernel fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c on mon.b... 2023-09-23T08:26:51.760 DEBUG:teuthology.orchestra.run.smithi135:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-09-23T08:26:53.406 INFO:teuthology.orchestra.run.smithi135.stdout:Verifying... ######################################## 2023-09-23T08:26:53.805 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing... ######################################## 2023-09-23T08:26:53.956 INFO:teuthology.orchestra.run.smithi135.stdout:Updating / installing... 2023-09-23T08:26:57.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23 08:26:57 URL:https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/kernel-6.5.0_rc7_gfef64f93da2b-1.x86_64.rpm [380759012/380759012] -> "/tmp/kernel.x86_64.rpm" [1] 2023-09-23T08:26:57.489 INFO:teuthology.orchestra.run.smithi082.stderr:FINISHED --2023-09-23 08:26:57-- 2023-09-23T08:26:57.489 INFO:teuthology.orchestra.run.smithi082.stderr:Total wall clock time: 32s 2023-09-23T08:26:57.490 INFO:teuthology.orchestra.run.smithi082.stderr:Downloaded: 1 files, 363M in 32s (11.4 MB/s) 2023-09-23T08:26:57.508 INFO:teuthology.task.kernel:Installing kernel fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c on mon.a... 2023-09-23T08:26:57.508 DEBUG:teuthology.orchestra.run.smithi082:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-09-23T08:26:59.428 INFO:teuthology.orchestra.run.smithi082.stdout:Verifying... ######################################## 2023-09-23T08:26:59.481 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing... ######################################## 2023-09-23T08:26:59.563 INFO:teuthology.orchestra.run.smithi082.stdout:Updating / installing... 2023-09-23T08:27:07.441 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23 08:27:07 URL:https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/kernel-6.5.0_rc7_gfef64f93da2b-1.x86_64.rpm [380759012/380759012] -> "/tmp/kernel.x86_64.rpm" [1] 2023-09-23T08:27:07.441 INFO:teuthology.orchestra.run.smithi161.stderr:FINISHED --2023-09-23 08:27:07-- 2023-09-23T08:27:07.442 INFO:teuthology.orchestra.run.smithi161.stderr:Total wall clock time: 42s 2023-09-23T08:27:07.442 INFO:teuthology.orchestra.run.smithi161.stderr:Downloaded: 1 files, 363M in 41s (8.76 MB/s) 2023-09-23T08:27:07.443 INFO:teuthology.task.kernel:Installing kernel fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c on mon.c... 2023-09-23T08:27:07.443 DEBUG:teuthology.orchestra.run.smithi161:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-09-23T08:27:09.034 INFO:teuthology.orchestra.run.smithi161.stdout:Verifying... ######################################## 2023-09-23T08:27:09.100 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing... ######################################## 2023-09-23T08:27:09.190 INFO:teuthology.orchestra.run.smithi161.stdout:Updating / installing... 2023-09-23T08:27:32.123 INFO:teuthology.orchestra.run.smithi135.stdout:kernel-6.5.0_rc7_gfef64f93da2b-1 ######################################## 2023-09-23T08:27:37.447 INFO:teuthology.orchestra.run.smithi082.stdout:kernel-6.5.0_rc7_gfef64f93da2b-1 ######################################## 2023-09-23T08:27:47.336 INFO:teuthology.orchestra.run.smithi161.stdout:kernel-6.5.0_rc7_gfef64f93da2b-1 ######################################## 2023-09-23T08:27:58.551 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi135.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-09-23T08:27:58.552 DEBUG:teuthology.orchestra.run.smithi135:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-09-23T08:27:58.608 INFO:teuthology.orchestra.run.smithi135.stdout:/boot/System.map-6.5.0-rc7-gfef64f93da2b 2023-09-23T08:27:58.608 INFO:teuthology.orchestra.run.smithi135.stdout:/boot/config-6.5.0-rc7-gfef64f93da2b 2023-09-23T08:27:58.608 INFO:teuthology.orchestra.run.smithi135.stdout:/boot/vmlinuz-6.5.0-rc7-gfef64f93da2b 2023-09-23T08:27:58.608 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b 2023-09-23T08:27:58.609 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel 2023-09-23T08:27:58.609 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch 2023-09-23T08:27:58.609 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86 2023-09-23T08:27:58.609 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto 2023-09-23T08:27:58.609 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-09-23T08:27:58.609 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-09-23T08:27:58.609 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-09-23T08:27:58.609 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-09-23T08:27:58.609 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-09-23T08:27:58.609 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-09-23T08:27:58.609 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-09-23T08:27:58.609 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crc32c-intel.ko 2023-09-23T08:27:58.610 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-09-23T08:27:58.610 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-09-23T08:27:58.610 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-09-23T08:27:58.610 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-09-23T08:27:58.610 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-avx2.ko 2023-09-23T08:27:58.610 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-09-23T08:27:58.610 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-09-23T08:27:58.610 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-09-23T08:27:58.610 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-09-23T08:27:58.610 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-09-23T08:27:58.610 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-09-23T08:27:58.610 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-09-23T08:27:58.611 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel 2023-09-23T08:27:58.611 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu 2023-09-23T08:27:58.611 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu/mce 2023-09-23T08:27:58.611 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-09-23T08:27:58.611 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm 2023-09-23T08:27:58.611 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm-amd.ko 2023-09-23T08:27:58.611 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm-intel.ko 2023-09-23T08:27:58.611 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm.ko 2023-09-23T08:27:58.611 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto 2023-09-23T08:27:58.611 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/ansi_cprng.ko 2023-09-23T08:27:58.611 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/anubis.ko 2023-09-23T08:27:58.611 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/arc4.ko 2023-09-23T08:27:58.612 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx 2023-09-23T08:27:58.612 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_memcpy.ko 2023-09-23T08:27:58.612 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_pq.ko 2023-09-23T08:27:58.612 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_raid6_recov.ko 2023-09-23T08:27:58.612 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_tx.ko 2023-09-23T08:27:58.612 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_xor.ko 2023-09-23T08:27:58.612 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/raid6test.ko 2023-09-23T08:27:58.612 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/authenc.ko 2023-09-23T08:27:58.612 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/authencesn.ko 2023-09-23T08:27:58.612 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blake2b_generic.ko 2023-09-23T08:27:58.612 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blowfish_common.ko 2023-09-23T08:27:58.612 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blowfish_generic.ko 2023-09-23T08:27:58.613 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/camellia_generic.ko 2023-09-23T08:27:58.613 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast5_generic.ko 2023-09-23T08:27:58.613 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast6_generic.ko 2023-09-23T08:27:58.613 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast_common.ko 2023-09-23T08:27:58.613 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/ccm.ko 2023-09-23T08:27:58.613 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cmac.ko 2023-09-23T08:27:58.613 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crc32_generic.ko 2023-09-23T08:27:58.613 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crypto_engine.ko 2023-09-23T08:27:58.613 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crypto_user.ko 2023-09-23T08:27:58.613 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cts.ko 2023-09-23T08:27:58.613 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/des_generic.ko 2023-09-23T08:27:58.613 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/dh_generic.ko 2023-09-23T08:27:58.614 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/echainiv.ko 2023-09-23T08:27:58.614 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/essiv.ko 2023-09-23T08:27:58.614 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/fcrypt.ko 2023-09-23T08:27:58.614 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/khazad.ko 2023-09-23T08:27:58.614 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/lz4.ko 2023-09-23T08:27:58.614 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/lz4hc.ko 2023-09-23T08:27:58.614 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/md4.ko 2023-09-23T08:27:58.614 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/michael_mic.ko 2023-09-23T08:27:58.614 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/pcbc.ko 2023-09-23T08:27:58.614 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/pcrypt.ko 2023-09-23T08:27:58.614 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/rmd160.ko 2023-09-23T08:27:58.614 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/seed.ko 2023-09-23T08:27:58.615 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/serpent_generic.ko 2023-09-23T08:27:58.615 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/tcrypt.ko 2023-09-23T08:27:58.615 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/tea.ko 2023-09-23T08:27:58.615 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/twofish_common.ko 2023-09-23T08:27:58.615 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/twofish_generic.ko 2023-09-23T08:27:58.615 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/vmac.ko 2023-09-23T08:27:58.615 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/wp512.ko 2023-09-23T08:27:58.615 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xcbc.ko 2023-09-23T08:27:58.615 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xor.ko 2023-09-23T08:27:58.615 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xxhash_generic.ko 2023-09-23T08:27:58.615 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers 2023-09-23T08:27:58.616 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi 2023-09-23T08:27:58.616 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/acpi_ipmi.ko 2023-09-23T08:27:58.616 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/acpi_pad.ko 2023-09-23T08:27:58.616 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/custom_method.ko 2023-09-23T08:27:58.616 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/ec_sys.ko 2023-09-23T08:27:58.616 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/platform_profile.ko 2023-09-23T08:27:58.616 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/sbs.ko 2023-09-23T08:27:58.616 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/sbshc.ko 2023-09-23T08:27:58.616 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/video.ko 2023-09-23T08:27:58.616 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata 2023-09-23T08:27:58.616 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/acard-ahci.ko 2023-09-23T08:27:58.616 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/ahci_platform.ko 2023-09-23T08:27:58.616 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/ata_generic.ko 2023-09-23T08:27:58.617 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/libahci_platform.ko 2023-09-23T08:27:58.617 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_acpi.ko 2023-09-23T08:27:58.617 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ali.ko 2023-09-23T08:27:58.617 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_amd.ko 2023-09-23T08:27:58.617 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_artop.ko 2023-09-23T08:27:58.617 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_atiixp.ko 2023-09-23T08:27:58.617 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_atp867x.ko 2023-09-23T08:27:58.617 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cmd640.ko 2023-09-23T08:27:58.617 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cmd64x.ko 2023-09-23T08:27:58.617 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cypress.ko 2023-09-23T08:27:58.617 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_efar.ko 2023-09-23T08:27:58.618 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt366.ko 2023-09-23T08:27:58.618 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt37x.ko 2023-09-23T08:27:58.618 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt3x2n.ko 2023-09-23T08:27:58.618 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt3x3.ko 2023-09-23T08:27:58.618 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_it8213.ko 2023-09-23T08:27:58.618 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_it821x.ko 2023-09-23T08:27:58.618 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_jmicron.ko 2023-09-23T08:27:58.618 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_marvell.ko 2023-09-23T08:27:58.618 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_mpiix.ko 2023-09-23T08:27:58.618 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_netcell.ko 2023-09-23T08:27:58.618 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ninja32.ko 2023-09-23T08:27:58.618 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ns87410.ko 2023-09-23T08:27:58.619 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ns87415.ko 2023-09-23T08:27:58.619 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_oldpiix.ko 2023-09-23T08:27:58.619 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_opti.ko 2023-09-23T08:27:58.619 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_optidma.ko 2023-09-23T08:27:58.619 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pcmcia.ko 2023-09-23T08:27:58.619 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pdc2027x.ko 2023-09-23T08:27:58.619 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-09-23T08:27:58.619 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_piccolo.ko 2023-09-23T08:27:58.619 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_rdc.ko 2023-09-23T08:27:58.619 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sch.ko 2023-09-23T08:27:58.619 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_serverworks.ko 2023-09-23T08:27:58.619 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sil680.ko 2023-09-23T08:27:58.620 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sis.ko 2023-09-23T08:27:58.620 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sl82c105.ko 2023-09-23T08:27:58.620 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_triflex.ko 2023-09-23T08:27:58.620 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_via.ko 2023-09-23T08:27:58.620 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pdc_adma.ko 2023-09-23T08:27:58.620 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_inic162x.ko 2023-09-23T08:27:58.620 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_mv.ko 2023-09-23T08:27:58.620 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_nv.ko 2023-09-23T08:27:58.620 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_promise.ko 2023-09-23T08:27:58.620 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_qstor.ko 2023-09-23T08:27:58.620 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sil.ko 2023-09-23T08:27:58.620 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sil24.ko 2023-09-23T08:27:58.621 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sis.ko 2023-09-23T08:27:58.621 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_svw.ko 2023-09-23T08:27:58.621 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sx4.ko 2023-09-23T08:27:58.621 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_uli.ko 2023-09-23T08:27:58.621 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_via.ko 2023-09-23T08:27:58.621 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_vsc.ko 2023-09-23T08:27:58.621 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/auxdisplay 2023-09-23T08:27:58.621 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/auxdisplay/ks0108.ko 2023-09-23T08:27:58.621 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base 2023-09-23T08:27:58.621 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap 2023-09-23T08:27:58.621 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap/regmap-i2c.ko 2023-09-23T08:27:58.621 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap/regmap-mmio.ko 2023-09-23T08:27:58.622 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/bcma 2023-09-23T08:27:58.622 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/bcma/bcma.ko 2023-09-23T08:27:58.622 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block 2023-09-23T08:27:58.622 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/aoe 2023-09-23T08:27:58.622 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/aoe/aoe.ko 2023-09-23T08:27:58.622 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/brd.ko 2023-09-23T08:27:58.622 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/drbd 2023-09-23T08:27:58.622 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/drbd/drbd.ko 2023-09-23T08:27:58.622 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/floppy.ko 2023-09-23T08:27:58.622 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/loop.ko 2023-09-23T08:27:58.622 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/mtip32xx 2023-09-23T08:27:58.622 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-09-23T08:27:58.623 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/nbd.ko 2023-09-23T08:27:58.623 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/null_blk 2023-09-23T08:27:58.623 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/null_blk/null_blk.ko 2023-09-23T08:27:58.623 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/pktcdvd.ko 2023-09-23T08:27:58.623 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/rbd.ko 2023-09-23T08:27:58.623 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/virtio_blk.ko 2023-09-23T08:27:58.623 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkback 2023-09-23T08:27:58.623 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-09-23T08:27:58.623 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkfront.ko 2023-09-23T08:27:58.623 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/zram 2023-09-23T08:27:58.623 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/zram/zram.ko 2023-09-23T08:27:58.623 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char 2023-09-23T08:27:58.624 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hangcheck-timer.ko 2023-09-23T08:27:58.624 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random 2023-09-23T08:27:58.624 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/amd-rng.ko 2023-09-23T08:27:58.624 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/intel-rng.ko 2023-09-23T08:27:58.624 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-09-23T08:27:58.624 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/via-rng.ko 2023-09-23T08:27:58.624 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/virtio-rng.ko 2023-09-23T08:27:58.624 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi 2023-09-23T08:27:58.624 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-09-23T08:27:58.624 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-09-23T08:27:58.624 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-09-23T08:27:58.624 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_si.ko 2023-09-23T08:27:58.625 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-09-23T08:27:58.625 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-09-23T08:27:58.625 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/lp.ko 2023-09-23T08:27:58.625 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/mwave 2023-09-23T08:27:58.625 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/mwave/mwave.ko 2023-09-23T08:27:58.625 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ppdev.ko 2023-09-23T08:27:58.625 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tlclk.ko 2023-09-23T08:27:58.625 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm 2023-09-23T08:27:58.625 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm.ko 2023-09-23T08:27:58.625 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_atmel.ko 2023-09-23T08:27:58.625 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_infineon.ko 2023-09-23T08:27:58.625 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_nsc.ko 2023-09-23T08:27:58.626 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_tis.ko 2023-09-23T08:27:58.626 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-09-23T08:27:58.626 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/uv_mmtimer.ko 2023-09-23T08:27:58.626 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/virtio_console.ko 2023-09-23T08:27:58.626 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq 2023-09-23T08:27:58.626 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-09-23T08:27:58.626 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-09-23T08:27:58.626 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/p4-clockmod.ko 2023-09-23T08:27:58.626 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-09-23T08:27:58.626 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/powernow-k8.ko 2023-09-23T08:27:58.626 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/speedstep-lib.ko 2023-09-23T08:27:58.626 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto 2023-09-23T08:27:58.627 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp 2023-09-23T08:27:58.627 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-09-23T08:27:58.627 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp/ccp.ko 2023-09-23T08:27:58.627 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel 2023-09-23T08:27:58.627 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat 2023-09-23T08:27:58.627 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_common 2023-09-23T08:27:58.627 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-09-23T08:27:58.627 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-09-23T08:27:58.627 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-09-23T08:27:58.627 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/padlock-aes.ko 2023-09-23T08:27:58.627 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/padlock-sha.ko 2023-09-23T08:27:58.627 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/virtio 2023-09-23T08:27:58.628 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-09-23T08:27:58.628 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dca 2023-09-23T08:27:58.628 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dca/dca.ko 2023-09-23T08:27:58.628 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/devfreq 2023-09-23T08:27:58.628 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-09-23T08:27:58.628 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma 2023-09-23T08:27:58.628 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/dw 2023-09-23T08:27:58.628 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/dw/dw_dmac.ko 2023-09-23T08:27:58.628 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/ioat 2023-09-23T08:27:58.628 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/ioat/ioatdma.ko 2023-09-23T08:27:58.628 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac 2023-09-23T08:27:58.628 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/amd64_edac.ko 2023-09-23T08:27:58.629 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/e752x_edac.ko 2023-09-23T08:27:58.629 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/edac_mce_amd.ko 2023-09-23T08:27:58.629 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i3000_edac.ko 2023-09-23T08:27:58.629 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i3200_edac.ko 2023-09-23T08:27:58.629 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i5100_edac.ko 2023-09-23T08:27:58.629 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i5400_edac.ko 2023-09-23T08:27:58.629 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i7300_edac.ko 2023-09-23T08:27:58.629 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i7core_edac.ko 2023-09-23T08:27:58.629 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i82975x_edac.ko 2023-09-23T08:27:58.629 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/ie31200_edac.ko 2023-09-23T08:27:58.629 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/sb_edac.ko 2023-09-23T08:27:58.629 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/x38_edac.ko 2023-09-23T08:27:58.630 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware 2023-09-23T08:27:58.630 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/edd.ko 2023-09-23T08:27:58.630 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/iscsi_ibft.ko 2023-09-23T08:27:58.630 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio 2023-09-23T08:27:58.630 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-ich.ko 2023-09-23T08:27:58.630 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-viperboard.ko 2023-09-23T08:27:58.630 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid 2023-09-23T08:27:58.630 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-appleir.ko 2023-09-23T08:27:58.630 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-aureal.ko 2023-09-23T08:27:58.630 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-axff.ko 2023-09-23T08:27:58.630 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-dr.ko 2023-09-23T08:27:58.631 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-elecom.ko 2023-09-23T08:27:58.631 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-elo.ko 2023-09-23T08:27:58.631 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-emsff.ko 2023-09-23T08:27:58.631 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gaff.ko 2023-09-23T08:27:58.631 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gt683r.ko 2023-09-23T08:27:58.631 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gyration.ko 2023-09-23T08:27:58.631 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtek-kbd.ko 2023-09-23T08:27:58.631 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtek-mouse.ko 2023-09-23T08:27:58.631 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtekff.ko 2023-09-23T08:27:58.631 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-hyperv.ko 2023-09-23T08:27:58.631 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-icade.ko 2023-09-23T08:27:58.631 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-keytouch.ko 2023-09-23T08:27:58.632 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-kye.ko 2023-09-23T08:27:58.632 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-lcpower.ko 2023-09-23T08:27:58.632 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-led.ko 2023-09-23T08:27:58.632 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-lenovo.ko 2023-09-23T08:27:58.632 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-logitech-dj.ko 2023-09-23T08:27:58.632 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-09-23T08:27:58.632 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-multitouch.ko 2023-09-23T08:27:58.632 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-ortek.ko 2023-09-23T08:27:58.632 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-penmount.ko 2023-09-23T08:27:58.632 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-petalynx.ko 2023-09-23T08:27:58.632 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-picolcd.ko 2023-09-23T08:27:58.632 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-pl.ko 2023-09-23T08:27:58.633 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-plantronics.ko 2023-09-23T08:27:58.633 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-primax.ko 2023-09-23T08:27:58.633 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-rmi.ko 2023-09-23T08:27:58.633 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-arvo.ko 2023-09-23T08:27:58.633 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-common.ko 2023-09-23T08:27:58.633 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-isku.ko 2023-09-23T08:27:58.633 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-kone.ko 2023-09-23T08:27:58.633 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-09-23T08:27:58.633 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-konepure.ko 2023-09-23T08:27:58.633 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-09-23T08:27:58.633 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-lua.ko 2023-09-23T08:27:58.633 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-pyra.ko 2023-09-23T08:27:58.634 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-ryos.ko 2023-09-23T08:27:58.634 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-savu.ko 2023-09-23T08:27:58.634 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat.ko 2023-09-23T08:27:58.634 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-saitek.ko 2023-09-23T08:27:58.634 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-samsung.ko 2023-09-23T08:27:58.634 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sensor-hub.ko 2023-09-23T08:27:58.634 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sjoy.ko 2023-09-23T08:27:58.634 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sony.ko 2023-09-23T08:27:58.634 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-speedlink.ko 2023-09-23T08:27:58.634 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-steelseries.ko 2023-09-23T08:27:58.635 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sunplus.ko 2023-09-23T08:27:58.635 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-thrustmaster.ko 2023-09-23T08:27:58.635 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-tivo.ko 2023-09-23T08:27:58.635 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-tmff.ko 2023-09-23T08:27:58.635 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-topseed.ko 2023-09-23T08:27:58.635 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-twinhan.ko 2023-09-23T08:27:58.635 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-uclogic.ko 2023-09-23T08:27:58.635 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-waltop.ko 2023-09-23T08:27:58.635 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-wiimote.ko 2023-09-23T08:27:58.635 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-xinmo.ko 2023-09-23T08:27:58.635 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-zpff.ko 2023-09-23T08:27:58.636 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-zydacron.ko 2023-09-23T08:27:58.636 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/uhid.ko 2023-09-23T08:27:58.636 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/wacom.ko 2023-09-23T08:27:58.636 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv 2023-09-23T08:27:58.636 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_balloon.ko 2023-09-23T08:27:58.636 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_utils.ko 2023-09-23T08:27:58.636 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_vmbus.ko 2023-09-23T08:27:58.636 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon 2023-09-23T08:27:58.636 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/abituguru.ko 2023-09-23T08:27:58.636 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/abituguru3.ko 2023-09-23T08:27:58.637 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/acpi_power_meter.ko 2023-09-23T08:27:58.637 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ad7414.ko 2023-09-23T08:27:58.637 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ad7418.ko 2023-09-23T08:27:58.637 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adc128d818.ko 2023-09-23T08:27:58.637 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1025.ko 2023-09-23T08:27:58.637 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1026.ko 2023-09-23T08:27:58.637 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1029.ko 2023-09-23T08:27:58.637 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1031.ko 2023-09-23T08:27:58.637 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm9240.ko 2023-09-23T08:27:58.637 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ads7828.ko 2023-09-23T08:27:58.637 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7410.ko 2023-09-23T08:27:58.637 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7411.ko 2023-09-23T08:27:58.638 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7462.ko 2023-09-23T08:27:58.638 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7470.ko 2023-09-23T08:27:58.638 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7475.ko 2023-09-23T08:27:58.638 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7x10.ko 2023-09-23T08:27:58.638 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/amc6821.ko 2023-09-23T08:27:58.638 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/applesmc.ko 2023-09-23T08:27:58.638 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asb100.ko 2023-09-23T08:27:58.638 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asc7621.ko 2023-09-23T08:27:58.638 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asus_atk0110.ko 2023-09-23T08:27:58.638 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/atxp1.ko 2023-09-23T08:27:58.639 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/coretemp.ko 2023-09-23T08:27:58.639 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-09-23T08:27:58.639 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/dme1737.ko 2023-09-23T08:27:58.639 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ds1621.ko 2023-09-23T08:27:58.639 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ds620.ko 2023-09-23T08:27:58.639 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/emc1403.ko 2023-09-23T08:27:58.639 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/emc6w201.ko 2023-09-23T08:27:58.639 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f71805f.ko 2023-09-23T08:27:58.639 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f71882fg.ko 2023-09-23T08:27:58.639 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f75375s.ko 2023-09-23T08:27:58.639 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/fam15h_power.ko 2023-09-23T08:27:58.640 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/fschmd.ko 2023-09-23T08:27:58.640 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/g760a.ko 2023-09-23T08:27:58.640 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/g762.ko 2023-09-23T08:27:58.640 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/gl518sm.ko 2023-09-23T08:27:58.640 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/gl520sm.ko 2023-09-23T08:27:58.640 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/hwmon-vid.ko 2023-09-23T08:27:58.640 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/i5500_temp.ko 2023-09-23T08:27:58.640 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/i5k_amb.ko 2023-09-23T08:27:58.640 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ibmaem.ko 2023-09-23T08:27:58.640 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ibmpex.ko 2023-09-23T08:27:58.640 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ina209.ko 2023-09-23T08:27:58.640 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ina2xx.ko 2023-09-23T08:27:58.641 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/it87.ko 2023-09-23T08:27:58.641 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/k10temp.ko 2023-09-23T08:27:58.641 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/k8temp.ko 2023-09-23T08:27:58.641 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lineage-pem.ko 2023-09-23T08:27:58.641 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm63.ko 2023-09-23T08:27:58.641 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm73.ko 2023-09-23T08:27:58.641 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm75.ko 2023-09-23T08:27:58.641 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm77.ko 2023-09-23T08:27:58.641 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm78.ko 2023-09-23T08:27:58.641 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm80.ko 2023-09-23T08:27:58.642 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm83.ko 2023-09-23T08:27:58.642 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm85.ko 2023-09-23T08:27:58.642 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm87.ko 2023-09-23T08:27:58.642 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm90.ko 2023-09-23T08:27:58.642 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm92.ko 2023-09-23T08:27:58.642 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm93.ko 2023-09-23T08:27:58.642 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95234.ko 2023-09-23T08:27:58.642 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95241.ko 2023-09-23T08:27:58.642 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95245.ko 2023-09-23T08:27:58.642 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc2945.ko 2023-09-23T08:27:58.643 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4151.ko 2023-09-23T08:27:58.643 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4215.ko 2023-09-23T08:27:58.643 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4222.ko 2023-09-23T08:27:58.643 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4245.ko 2023-09-23T08:27:58.643 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4260.ko 2023-09-23T08:27:58.643 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4261.ko 2023-09-23T08:27:58.643 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max16065.ko 2023-09-23T08:27:58.643 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max1619.ko 2023-09-23T08:27:58.643 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max1668.ko 2023-09-23T08:27:58.643 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max197.ko 2023-09-23T08:27:58.643 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6639.ko 2023-09-23T08:27:58.644 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6650.ko 2023-09-23T08:27:58.644 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6697.ko 2023-09-23T08:27:58.644 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/mcp3021.ko 2023-09-23T08:27:58.644 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6683.ko 2023-09-23T08:27:58.644 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6775-core.ko 2023-09-23T08:27:58.644 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6775.ko 2023-09-23T08:27:58.644 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct7802.ko 2023-09-23T08:27:58.644 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pc87360.ko 2023-09-23T08:27:58.644 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pc87427.ko 2023-09-23T08:27:58.645 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pcf8591.ko 2023-09-23T08:27:58.645 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus 2023-09-23T08:27:58.645 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-09-23T08:27:58.645 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-09-23T08:27:58.645 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-09-23T08:27:58.645 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max16064.ko 2023-09-23T08:27:58.645 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max34440.ko 2023-09-23T08:27:58.645 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max8688.ko 2023-09-23T08:27:58.645 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-09-23T08:27:58.645 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-09-23T08:27:58.646 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-09-23T08:27:58.646 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-09-23T08:27:58.646 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-09-23T08:27:58.646 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-09-23T08:27:58.646 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/powr1220.ko 2023-09-23T08:27:58.646 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch5627.ko 2023-09-23T08:27:58.646 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch5636.ko 2023-09-23T08:27:58.646 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch56xx-common.ko 2023-09-23T08:27:58.646 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sht15.ko 2023-09-23T08:27:58.646 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sht21.ko 2023-09-23T08:27:58.647 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/shtc1.ko 2023-09-23T08:27:58.647 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sis5595.ko 2023-09-23T08:27:58.647 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47b397.ko 2023-09-23T08:27:58.647 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47m1.ko 2023-09-23T08:27:58.647 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47m192.ko 2023-09-23T08:27:58.647 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/thmc50.ko 2023-09-23T08:27:58.647 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp102.ko 2023-09-23T08:27:58.647 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp103.ko 2023-09-23T08:27:58.647 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp401.ko 2023-09-23T08:27:58.648 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp421.ko 2023-09-23T08:27:58.648 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/via-cputemp.ko 2023-09-23T08:27:58.648 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/via686a.ko 2023-09-23T08:27:58.648 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/vt1211.ko 2023-09-23T08:27:58.648 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/vt8231.ko 2023-09-23T08:27:58.648 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83627ehf.ko 2023-09-23T08:27:58.648 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83627hf.ko 2023-09-23T08:27:58.648 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83781d.ko 2023-09-23T08:27:58.648 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83791d.ko 2023-09-23T08:27:58.648 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83792d.ko 2023-09-23T08:27:58.648 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83793.ko 2023-09-23T08:27:58.648 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83795.ko 2023-09-23T08:27:58.649 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83l785ts.ko 2023-09-23T08:27:58.649 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83l786ng.ko 2023-09-23T08:27:58.649 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c 2023-09-23T08:27:58.649 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos 2023-09-23T08:27:58.649 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-09-23T08:27:58.649 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-09-23T08:27:58.649 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses 2023-09-23T08:27:58.649 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-09-23T08:27:58.649 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-09-23T08:27:58.649 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-09-23T08:27:58.649 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-09-23T08:27:58.649 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-09-23T08:27:58.650 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-09-23T08:27:58.650 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-09-23T08:27:58.650 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-09-23T08:27:58.650 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-i801.ko 2023-09-23T08:27:58.650 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-isch.ko 2023-09-23T08:27:58.650 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-09-23T08:27:58.650 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-09-23T08:27:58.650 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-09-23T08:27:58.650 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-parport.ko 2023-09-23T08:27:58.650 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-09-23T08:27:58.650 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-09-23T08:27:58.651 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-09-23T08:27:58.651 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-09-23T08:27:58.651 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-09-23T08:27:58.651 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-09-23T08:27:58.651 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-via.ko 2023-09-23T08:27:58.651 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-09-23T08:27:58.651 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-09-23T08:27:58.651 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-dev.ko 2023-09-23T08:27:58.651 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-mux.ko 2023-09-23T08:27:58.651 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-09-23T08:27:58.652 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-smbus.ko 2023-09-23T08:27:58.652 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-stub.ko 2023-09-23T08:27:58.652 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband 2023-09-23T08:27:58.652 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core 2023-09-23T08:27:58.652 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_cm.ko 2023-09-23T08:27:58.652 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_core.ko 2023-09-23T08:27:58.652 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_umad.ko 2023-09-23T08:27:58.652 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-09-23T08:27:58.652 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/iw_cm.ko 2023-09-23T08:27:58.653 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/rdma_cm.ko 2023-09-23T08:27:58.653 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-09-23T08:27:58.653 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw 2023-09-23T08:27:58.653 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/cxgb4 2023-09-23T08:27:58.653 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-09-23T08:27:58.653 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx4 2023-09-23T08:27:58.653 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-09-23T08:27:58.653 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx5 2023-09-23T08:27:58.653 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-09-23T08:27:58.653 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mthca 2023-09-23T08:27:58.653 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-09-23T08:27:58.654 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp 2023-09-23T08:27:58.654 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/ipoib 2023-09-23T08:27:58.654 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-09-23T08:27:58.654 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/iser 2023-09-23T08:27:58.654 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-09-23T08:27:58.654 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/isert 2023-09-23T08:27:58.654 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-09-23T08:27:58.654 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srp 2023-09-23T08:27:58.654 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-09-23T08:27:58.654 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srpt 2023-09-23T08:27:58.654 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-09-23T08:27:58.655 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input 2023-09-23T08:27:58.655 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport 2023-09-23T08:27:58.655 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-09-23T08:27:58.655 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/fm801-gp.ko 2023-09-23T08:27:58.655 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/gameport.ko 2023-09-23T08:27:58.655 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/lightning.ko 2023-09-23T08:27:58.655 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/ns558.ko 2023-09-23T08:27:58.655 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/joydev.ko 2023-09-23T08:27:58.655 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard 2023-09-23T08:27:58.655 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/gpio_keys.ko 2023-09-23T08:27:58.656 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse 2023-09-23T08:27:58.656 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/appletouch.ko 2023-09-23T08:27:58.656 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/bcm5974.ko 2023-09-23T08:27:58.656 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/cyapatp.ko 2023-09-23T08:27:58.656 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/elan_i2c.ko 2023-09-23T08:27:58.656 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/sermouse.ko 2023-09-23T08:27:58.656 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-09-23T08:27:58.656 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/synaptics_usb.ko 2023-09-23T08:27:58.656 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/vsxxxaa.ko 2023-09-23T08:27:58.656 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/rmi4 2023-09-23T08:27:58.657 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/rmi4/rmi_core.ko 2023-09-23T08:27:58.657 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio 2023-09-23T08:27:58.657 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/altera_ps2.ko 2023-09-23T08:27:58.657 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/arc_ps2.ko 2023-09-23T08:27:58.657 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-09-23T08:27:58.657 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/serio_raw.ko 2023-09-23T08:27:58.657 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/sparse-keymap.ko 2023-09-23T08:27:58.657 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu 2023-09-23T08:27:58.657 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu/amd 2023-09-23T08:27:58.658 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu/amd/iommu_v2.ko 2023-09-23T08:27:58.658 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds 2023-09-23T08:27:58.658 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-blinkm.ko 2023-09-23T08:27:58.658 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lm3530.ko 2023-09-23T08:27:58.658 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lp3944.ko 2023-09-23T08:27:58.658 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-ss4200.ko 2023-09-23T08:27:58.658 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger 2023-09-23T08:27:58.658 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-09-23T08:27:58.658 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-09-23T08:27:58.658 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-09-23T08:27:58.658 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-09-23T08:27:58.659 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-09-23T08:27:58.659 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-09-23T08:27:58.659 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-09-23T08:27:58.659 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-09-23T08:27:58.659 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md 2023-09-23T08:27:58.659 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/bcache 2023-09-23T08:27:58.659 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/bcache/bcache.ko 2023-09-23T08:27:58.659 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-bio-prison.ko 2023-09-23T08:27:58.659 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-cache-smq.ko 2023-09-23T08:27:58.659 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-cache.ko 2023-09-23T08:27:58.660 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-crypt.ko 2023-09-23T08:27:58.660 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-delay.ko 2023-09-23T08:27:58.660 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-flakey.ko 2023-09-23T08:27:58.660 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-log-userspace.ko 2023-09-23T08:27:58.660 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-multipath.ko 2023-09-23T08:27:58.660 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-queue-length.ko 2023-09-23T08:27:58.660 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-raid.ko 2023-09-23T08:27:58.660 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-round-robin.ko 2023-09-23T08:27:58.660 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-service-time.ko 2023-09-23T08:27:58.660 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-switch.ko 2023-09-23T08:27:58.660 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-thin-pool.ko 2023-09-23T08:27:58.660 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-verity.ko 2023-09-23T08:27:58.661 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/faulty.ko 2023-09-23T08:27:58.661 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/linear.ko 2023-09-23T08:27:58.661 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/multipath.ko 2023-09-23T08:27:58.661 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/persistent-data 2023-09-23T08:27:58.661 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-09-23T08:27:58.661 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid0.ko 2023-09-23T08:27:58.661 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid1.ko 2023-09-23T08:27:58.661 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid10.ko 2023-09-23T08:27:58.661 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid456.ko 2023-09-23T08:27:58.661 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message 2023-09-23T08:27:58.661 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion 2023-09-23T08:27:58.661 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptbase.ko 2023-09-23T08:27:58.662 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptctl.ko 2023-09-23T08:27:58.662 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptfc.ko 2023-09-23T08:27:58.662 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptlan.ko 2023-09-23T08:27:58.662 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptsas.ko 2023-09-23T08:27:58.662 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptscsih.ko 2023-09-23T08:27:58.662 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptspi.ko 2023-09-23T08:27:58.662 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd 2023-09-23T08:27:58.662 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lpc_ich.ko 2023-09-23T08:27:58.662 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lpc_sch.ko 2023-09-23T08:27:58.663 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/mfd-core.ko 2023-09-23T08:27:58.663 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/sm501.ko 2023-09-23T08:27:58.663 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/viperboard.ko 2023-09-23T08:27:58.663 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/vx855.ko 2023-09-23T08:27:58.663 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/wl1273-core.ko 2023-09-23T08:27:58.663 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc 2023-09-23T08:27:58.663 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/altera-stapl 2023-09-23T08:27:58.663 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-09-23T08:27:58.663 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/apds9802als.ko 2023-09-23T08:27:58.664 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/apds990x.ko 2023-09-23T08:27:58.664 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/bh1770glc.ko 2023-09-23T08:27:58.664 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/cb710 2023-09-23T08:27:58.664 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/cb710/cb710.ko 2023-09-23T08:27:58.664 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom 2023-09-23T08:27:58.664 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/at24.ko 2023-09-23T08:27:58.664 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/eeprom.ko 2023-09-23T08:27:58.664 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-09-23T08:27:58.664 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/max6875.ko 2023-09-23T08:27:58.665 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/enclosure.ko 2023-09-23T08:27:58.665 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/hpilo.ko 2023-09-23T08:27:58.665 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/isl29003.ko 2023-09-23T08:27:58.665 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/isl29020.ko 2023-09-23T08:27:58.665 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d 2023-09-23T08:27:58.665 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-09-23T08:27:58.665 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-09-23T08:27:58.665 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei 2023-09-23T08:27:58.666 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei-me.ko 2023-09-23T08:27:58.666 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei-txe.ko 2023-09-23T08:27:58.666 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei.ko 2023-09-23T08:27:58.666 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-gru 2023-09-23T08:27:58.666 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-gru/gru.ko 2023-09-23T08:27:58.666 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp 2023-09-23T08:27:58.666 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xp.ko 2023-09-23T08:27:58.666 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xpc.ko 2023-09-23T08:27:58.666 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-09-23T08:27:58.667 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tifm_7xx1.ko 2023-09-23T08:27:58.667 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tifm_core.ko 2023-09-23T08:27:58.667 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tsl2550.ko 2023-09-23T08:27:58.667 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_balloon.ko 2023-09-23T08:27:58.667 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_vmci 2023-09-23T08:27:58.667 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-09-23T08:27:58.667 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net 2023-09-23T08:27:58.667 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/bonding 2023-09-23T08:27:58.667 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/bonding/bonding.ko 2023-09-23T08:27:58.668 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa 2023-09-23T08:27:58.668 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/b53 2023-09-23T08:27:58.668 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/b53/b53_common.ko 2023-09-23T08:27:58.668 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/bcm-sf2.ko 2023-09-23T08:27:58.668 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6060.ko 2023-09-23T08:27:58.668 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6xxx 2023-09-23T08:27:58.668 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-09-23T08:27:58.668 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dummy.ko 2023-09-23T08:27:58.668 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/eql.ko 2023-09-23T08:27:58.669 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet 2023-09-23T08:27:58.669 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com 2023-09-23T08:27:58.669 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-09-23T08:27:58.669 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-09-23T08:27:58.669 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-09-23T08:27:58.669 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-09-23T08:27:58.669 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390 2023-09-23T08:27:58.669 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/8390.ko 2023-09-23T08:27:58.669 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-09-23T08:27:58.669 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-09-23T08:27:58.670 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-09-23T08:27:58.670 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/adaptec 2023-09-23T08:27:58.670 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-09-23T08:27:58.670 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/agere 2023-09-23T08:27:58.670 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/agere/et131x.ko 2023-09-23T08:27:58.670 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/alteon 2023-09-23T08:27:58.670 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-09-23T08:27:58.670 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/altera 2023-09-23T08:27:58.671 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-09-23T08:27:58.671 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd 2023-09-23T08:27:58.671 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-09-23T08:27:58.671 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-09-23T08:27:58.671 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-09-23T08:27:58.671 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros 2023-09-23T08:27:58.671 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/alx 2023-09-23T08:27:58.671 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-09-23T08:27:58.671 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1c 2023-09-23T08:27:58.671 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-09-23T08:27:58.672 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1e 2023-09-23T08:27:58.672 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-09-23T08:27:58.672 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx 2023-09-23T08:27:58.672 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-09-23T08:27:58.672 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-09-23T08:27:58.672 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom 2023-09-23T08:27:58.672 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-09-23T08:27:58.672 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-09-23T08:27:58.673 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-09-23T08:27:58.673 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-09-23T08:27:58.673 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-09-23T08:27:58.673 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/genet 2023-09-23T08:27:58.673 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-09-23T08:27:58.673 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-09-23T08:27:58.673 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade 2023-09-23T08:27:58.674 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade/bna 2023-09-23T08:27:58.674 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-09-23T08:27:58.674 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio 2023-09-23T08:27:58.674 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb 2023-09-23T08:27:58.674 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-09-23T08:27:58.674 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-09-23T08:27:58.674 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-09-23T08:27:58.674 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-09-23T08:27:58.674 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-09-23T08:27:58.675 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-09-23T08:27:58.675 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-09-23T08:27:58.675 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-09-23T08:27:58.675 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-09-23T08:27:58.675 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco 2023-09-23T08:27:58.675 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco/enic 2023-09-23T08:27:58.675 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-09-23T08:27:58.675 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec 2023-09-23T08:27:58.675 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip 2023-09-23T08:27:58.676 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-09-23T08:27:58.676 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-09-23T08:27:58.676 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-09-23T08:27:58.676 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-09-23T08:27:58.676 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-09-23T08:27:58.676 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-09-23T08:27:58.676 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink 2023-09-23T08:27:58.676 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-09-23T08:27:58.677 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-09-23T08:27:58.677 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dnet.ko 2023-09-23T08:27:58.677 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex 2023-09-23T08:27:58.677 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex/benet 2023-09-23T08:27:58.677 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-09-23T08:27:58.677 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ethoc.ko 2023-09-23T08:27:58.677 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/fealnx.ko 2023-09-23T08:27:58.677 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel 2023-09-23T08:27:58.677 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e100.ko 2023-09-23T08:27:58.678 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000 2023-09-23T08:27:58.678 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-09-23T08:27:58.678 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000e 2023-09-23T08:27:58.678 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-09-23T08:27:58.678 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/fm10k 2023-09-23T08:27:58.678 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-09-23T08:27:58.678 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/i40e 2023-09-23T08:27:58.678 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-09-23T08:27:58.678 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/iavf 2023-09-23T08:27:58.679 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-09-23T08:27:58.679 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igb 2023-09-23T08:27:58.679 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-09-23T08:27:58.679 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igbvf 2023-09-23T08:27:58.679 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-09-23T08:27:58.679 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbe 2023-09-23T08:27:58.679 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-09-23T08:27:58.679 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbevf 2023-09-23T08:27:58.679 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-09-23T08:27:58.680 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/jme.ko 2023-09-23T08:27:58.680 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell 2023-09-23T08:27:58.680 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-09-23T08:27:58.680 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/skge.ko 2023-09-23T08:27:58.680 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-09-23T08:27:58.680 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox 2023-09-23T08:27:58.680 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4 2023-09-23T08:27:58.680 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-09-23T08:27:58.681 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-09-23T08:27:58.681 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5 2023-09-23T08:27:58.681 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-09-23T08:27:58.681 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-09-23T08:27:58.681 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel 2023-09-23T08:27:58.681 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-09-23T08:27:58.681 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom 2023-09-23T08:27:58.681 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom/myri10ge 2023-09-23T08:27:58.681 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-09-23T08:27:58.682 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi 2023-09-23T08:27:58.682 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-09-23T08:27:58.682 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-09-23T08:27:58.682 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/neterion 2023-09-23T08:27:58.682 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-09-23T08:27:58.682 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/nvidia 2023-09-23T08:27:58.682 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-09-23T08:27:58.682 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines 2023-09-23T08:27:58.682 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-09-23T08:27:58.683 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-09-23T08:27:58.683 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic 2023-09-23T08:27:58.683 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/netxen 2023-09-23T08:27:58.683 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-09-23T08:27:58.683 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-09-23T08:27:58.683 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-09-23T08:27:58.683 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-09-23T08:27:58.683 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rdc 2023-09-23T08:27:58.683 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-09-23T08:27:58.683 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek 2023-09-23T08:27:58.684 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-09-23T08:27:58.684 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-09-23T08:27:58.684 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/atp.ko 2023-09-23T08:27:58.684 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-09-23T08:27:58.684 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rocker 2023-09-23T08:27:58.684 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-09-23T08:27:58.684 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sfc 2023-09-23T08:27:58.684 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-09-23T08:27:58.684 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/silan 2023-09-23T08:27:58.684 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-09-23T08:27:58.685 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis 2023-09-23T08:27:58.685 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis/sis190.ko 2023-09-23T08:27:58.685 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis/sis900.ko 2023-09-23T08:27:58.685 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc 2023-09-23T08:27:58.685 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-09-23T08:27:58.685 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-09-23T08:27:58.685 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-09-23T08:27:58.685 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-09-23T08:27:58.685 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro 2023-09-23T08:27:58.685 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac 2023-09-23T08:27:58.686 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-09-23T08:27:58.686 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-09-23T08:27:58.686 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun 2023-09-23T08:27:58.686 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/cassini.ko 2023-09-23T08:27:58.686 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/niu.ko 2023-09-23T08:27:58.686 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/sungem.ko 2023-09-23T08:27:58.686 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-09-23T08:27:58.686 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/tehuti 2023-09-23T08:27:58.686 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-09-23T08:27:58.686 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ti 2023-09-23T08:27:58.686 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ti/tlan.ko 2023-09-23T08:27:58.687 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via 2023-09-23T08:27:58.687 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-09-23T08:27:58.687 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-09-23T08:27:58.687 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet 2023-09-23T08:27:58.687 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-09-23T08:27:58.687 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-09-23T08:27:58.687 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/xircom 2023-09-23T08:27:58.687 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-09-23T08:27:58.687 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/geneve.ko 2023-09-23T08:27:58.687 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/hyperv 2023-09-23T08:27:58.687 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-09-23T08:27:58.687 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ieee802154 2023-09-23T08:27:58.688 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ieee802154/fakelb.ko 2023-09-23T08:27:58.688 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ifb.ko 2023-09-23T08:27:58.688 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ipvlan 2023-09-23T08:27:58.688 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ipvlan/ipvlan.ko 2023-09-23T08:27:58.688 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/macvlan.ko 2023-09-23T08:27:58.688 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/macvtap.ko 2023-09-23T08:27:58.688 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio 2023-09-23T08:27:58.688 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio.ko 2023-09-23T08:27:58.688 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-09-23T08:27:58.688 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-09-23T08:27:58.688 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-regmap.ko 2023-09-23T08:27:58.688 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mii.ko 2023-09-23T08:27:58.689 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/net_failover.ko 2023-09-23T08:27:58.689 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/netconsole.ko 2023-09-23T08:27:58.689 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/nlmon.ko 2023-09-23T08:27:58.689 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs 2023-09-23T08:27:58.689 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs/pcs-lynx.ko 2023-09-23T08:27:58.689 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-09-23T08:27:58.689 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy 2023-09-23T08:27:58.689 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/amd.ko 2023-09-23T08:27:58.689 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-09-23T08:27:58.689 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-09-23T08:27:58.689 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm7xxx.ko 2023-09-23T08:27:58.689 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm87xx.ko 2023-09-23T08:27:58.690 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/broadcom.ko 2023-09-23T08:27:58.690 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/cicada.ko 2023-09-23T08:27:58.690 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/davicom.ko 2023-09-23T08:27:58.690 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/dp83640.ko 2023-09-23T08:27:58.690 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/et1011c.ko 2023-09-23T08:27:58.690 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/icplus.ko 2023-09-23T08:27:58.690 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/lxt.ko 2023-09-23T08:27:58.690 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/marvell.ko 2023-09-23T08:27:58.690 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/micrel.ko 2023-09-23T08:27:58.690 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/national.ko 2023-09-23T08:27:58.690 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/phylink.ko 2023-09-23T08:27:58.691 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/qsemi.ko 2023-09-23T08:27:58.691 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/realtek.ko 2023-09-23T08:27:58.691 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/smsc.ko 2023-09-23T08:27:58.691 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/ste10Xp.ko 2023-09-23T08:27:58.691 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/vitesse.ko 2023-09-23T08:27:58.691 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp 2023-09-23T08:27:58.691 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/bsd_comp.ko 2023-09-23T08:27:58.691 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_async.ko 2023-09-23T08:27:58.691 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_deflate.ko 2023-09-23T08:27:58.691 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_generic.ko 2023-09-23T08:27:58.691 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_mppe.ko 2023-09-23T08:27:58.691 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_synctty.ko 2023-09-23T08:27:58.692 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pppoe.ko 2023-09-23T08:27:58.692 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pppox.ko 2023-09-23T08:27:58.692 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pptp.ko 2023-09-23T08:27:58.692 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip 2023-09-23T08:27:58.692 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip/slhc.ko 2023-09-23T08:27:58.692 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip/slip.ko 2023-09-23T08:27:58.692 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/sungem_phy.ko 2023-09-23T08:27:58.692 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/tap.ko 2023-09-23T08:27:58.692 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team 2023-09-23T08:27:58.692 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team.ko 2023-09-23T08:27:58.692 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_activebackup.ko 2023-09-23T08:27:58.692 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_broadcast.ko 2023-09-23T08:27:58.693 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-09-23T08:27:58.693 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_random.ko 2023-09-23T08:27:58.693 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-09-23T08:27:58.693 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/tun.ko 2023-09-23T08:27:58.693 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/veth.ko 2023-09-23T08:27:58.693 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/virtio_net.ko 2023-09-23T08:27:58.693 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vmxnet3 2023-09-23T08:27:58.693 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-09-23T08:27:58.693 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vxlan 2023-09-23T08:27:58.693 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vxlan/vxlan.ko 2023-09-23T08:27:58.693 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netback 2023-09-23T08:27:58.693 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netback/xen-netback.ko 2023-09-23T08:27:58.694 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netfront.ko 2023-09-23T08:27:58.694 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ntb 2023-09-23T08:27:58.694 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ntb/ntb.ko 2023-09-23T08:27:58.694 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme 2023-09-23T08:27:58.694 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host 2023-09-23T08:27:58.694 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host/nvme-core.ko 2023-09-23T08:27:58.694 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host/nvme.ko 2023-09-23T08:27:58.694 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport 2023-09-23T08:27:58.694 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport.ko 2023-09-23T08:27:58.694 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_cs.ko 2023-09-23T08:27:58.694 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_pc.ko 2023-09-23T08:27:58.694 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_serial.ko 2023-09-23T08:27:58.695 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci 2023-09-23T08:27:58.695 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug 2023-09-23T08:27:58.695 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-09-23T08:27:58.695 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/pcie 2023-09-23T08:27:58.695 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/pcie/aer_inject.ko 2023-09-23T08:27:58.695 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/xen-pcifront.ko 2023-09-23T08:27:58.695 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia 2023-09-23T08:27:58.695 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/i82092.ko 2023-09-23T08:27:58.695 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/pd6729.ko 2023-09-23T08:27:58.695 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/yenta_socket.ko 2023-09-23T08:27:58.695 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl 2023-09-23T08:27:58.695 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl/intel 2023-09-23T08:27:58.696 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-09-23T08:27:58.696 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform 2023-09-23T08:27:58.696 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86 2023-09-23T08:27:58.696 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/acer-wmi.ko 2023-09-23T08:27:58.696 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/acerhdf.ko 2023-09-23T08:27:58.696 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/apple-gmux.ko 2023-09-23T08:27:58.696 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-laptop.ko 2023-09-23T08:27:58.696 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-09-23T08:27:58.696 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-wmi.ko 2023-09-23T08:27:58.696 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/classmate-laptop.ko 2023-09-23T08:27:58.696 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-09-23T08:27:58.696 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-09-23T08:27:58.697 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-09-23T08:27:58.697 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-09-23T08:27:58.697 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/hdaps.ko 2023-09-23T08:27:58.697 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel 2023-09-23T08:27:58.697 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-09-23T08:27:58.697 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel_ips.ko 2023-09-23T08:27:58.697 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/msi-wmi.ko 2023-09-23T08:27:58.697 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/mxm-wmi.ko 2023-09-23T08:27:58.697 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-09-23T08:27:58.697 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/samsung-laptop.ko 2023-09-23T08:27:58.697 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/samsung-q10.ko 2023-09-23T08:27:58.697 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/topstar-laptop.ko 2023-09-23T08:27:58.698 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-09-23T08:27:58.698 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/toshiba_haps.ko 2023-09-23T08:27:58.698 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/wmi-bmof.ko 2023-09-23T08:27:58.698 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/wmi.ko 2023-09-23T08:27:58.698 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap 2023-09-23T08:27:58.698 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap/intel_rapl_common.ko 2023-09-23T08:27:58.698 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap/intel_rapl_msr.ko 2023-09-23T08:27:58.698 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps 2023-09-23T08:27:58.698 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients 2023-09-23T08:27:58.698 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps-gpio.ko 2023-09-23T08:27:58.698 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps-ldisc.ko 2023-09-23T08:27:58.698 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps_parport.ko 2023-09-23T08:27:58.699 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/pps_core.ko 2023-09-23T08:27:58.699 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp 2023-09-23T08:27:58.699 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp/ptp.ko 2023-09-23T08:27:58.699 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp/ptp_kvm.ko 2023-09-23T08:27:58.699 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc 2023-09-23T08:27:58.699 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-bq32k.ko 2023-09-23T08:27:58.699 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-bq4802.ko 2023-09-23T08:27:58.699 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1286.ko 2023-09-23T08:27:58.699 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1307.ko 2023-09-23T08:27:58.699 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1374.ko 2023-09-23T08:27:58.699 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1511.ko 2023-09-23T08:27:58.700 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1553.ko 2023-09-23T08:27:58.700 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1672.ko 2023-09-23T08:27:58.700 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1742.ko 2023-09-23T08:27:58.700 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds2404.ko 2023-09-23T08:27:58.700 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds3232.ko 2023-09-23T08:27:58.700 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-em3027.ko 2023-09-23T08:27:58.700 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-fm3130.ko 2023-09-23T08:27:58.700 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-isl12022.ko 2023-09-23T08:27:58.700 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-isl1208.ko 2023-09-23T08:27:58.700 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m41t80.ko 2023-09-23T08:27:58.700 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m48t35.ko 2023-09-23T08:27:58.701 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m48t59.ko 2023-09-23T08:27:58.701 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-max6900.ko 2023-09-23T08:27:58.701 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-msm6242.ko 2023-09-23T08:27:58.701 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf2127.ko 2023-09-23T08:27:58.701 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf85063.ko 2023-09-23T08:27:58.701 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8523.ko 2023-09-23T08:27:58.701 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8563.ko 2023-09-23T08:27:58.701 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8583.ko 2023-09-23T08:27:58.701 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rp5c01.ko 2023-09-23T08:27:58.702 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rs5c372.ko 2023-09-23T08:27:58.702 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-09-23T08:27:58.702 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rx8025.ko 2023-09-23T08:27:58.702 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rx8581.ko 2023-09-23T08:27:58.702 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-09-23T08:27:58.702 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-x1205.ko 2023-09-23T08:27:58.702 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi 2023-09-23T08:27:58.702 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-9xxx.ko 2023-09-23T08:27:58.702 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-sas.ko 2023-09-23T08:27:58.702 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-xxxx.ko 2023-09-23T08:27:58.702 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/BusLogic.ko 2023-09-23T08:27:58.703 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/a100u2w.ko 2023-09-23T08:27:58.703 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aacraid 2023-09-23T08:27:58.703 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aacraid/aacraid.ko 2023-09-23T08:27:58.703 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/advansys.ko 2023-09-23T08:27:58.703 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx 2023-09-23T08:27:58.703 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-09-23T08:27:58.703 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-09-23T08:27:58.703 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/am53c974.ko 2023-09-23T08:27:58.703 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/arcmsr 2023-09-23T08:27:58.703 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-09-23T08:27:58.703 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/atp870u.ko 2023-09-23T08:27:58.703 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/be2iscsi 2023-09-23T08:27:58.704 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-09-23T08:27:58.704 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bfa 2023-09-23T08:27:58.704 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bfa/bfa.ko 2023-09-23T08:27:58.704 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2fc 2023-09-23T08:27:58.704 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-09-23T08:27:58.704 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2i 2023-09-23T08:27:58.704 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-09-23T08:27:58.704 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ch.ko 2023-09-23T08:27:58.704 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/csiostor 2023-09-23T08:27:58.704 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/csiostor/csiostor.ko 2023-09-23T08:27:58.704 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi 2023-09-23T08:27:58.704 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb3i 2023-09-23T08:27:58.705 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-09-23T08:27:58.705 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb4i 2023-09-23T08:27:58.705 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-09-23T08:27:58.705 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-09-23T08:27:58.705 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/dc395x.ko 2023-09-23T08:27:58.705 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler 2023-09-23T08:27:58.705 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-09-23T08:27:58.705 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-09-23T08:27:58.705 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-09-23T08:27:58.705 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-09-23T08:27:58.706 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/dmx3191d.ko 2023-09-23T08:27:58.706 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esas2r 2023-09-23T08:27:58.706 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esas2r/esas2r.ko 2023-09-23T08:27:58.706 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esp_scsi.ko 2023-09-23T08:27:58.706 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe 2023-09-23T08:27:58.706 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe/fcoe.ko 2023-09-23T08:27:58.706 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-09-23T08:27:58.706 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fnic 2023-09-23T08:27:58.706 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fnic/fnic.ko 2023-09-23T08:27:58.706 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hpsa.ko 2023-09-23T08:27:58.707 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hptiop.ko 2023-09-23T08:27:58.707 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hv_storvsc.ko 2023-09-23T08:27:58.707 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/initio.ko 2023-09-23T08:27:58.707 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ipr.ko 2023-09-23T08:27:58.707 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ips.ko 2023-09-23T08:27:58.707 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/isci 2023-09-23T08:27:58.707 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/isci/isci.ko 2023-09-23T08:27:58.707 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-09-23T08:27:58.707 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/iscsi_tcp.ko 2023-09-23T08:27:58.707 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libfc 2023-09-23T08:27:58.707 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libfc/libfc.ko 2023-09-23T08:27:58.708 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libiscsi.ko 2023-09-23T08:27:58.708 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libiscsi_tcp.ko 2023-09-23T08:27:58.708 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libsas 2023-09-23T08:27:58.708 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libsas/libsas.ko 2023-09-23T08:27:58.708 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/lpfc 2023-09-23T08:27:58.708 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/lpfc/lpfc.ko 2023-09-23T08:27:58.708 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid 2023-09-23T08:27:58.708 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid.ko 2023-09-23T08:27:58.708 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-09-23T08:27:58.708 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-09-23T08:27:58.709 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-09-23T08:27:58.709 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mpt3sas 2023-09-23T08:27:58.709 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-09-23T08:27:58.709 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvsas 2023-09-23T08:27:58.709 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvsas/mvsas.ko 2023-09-23T08:27:58.709 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvumi.ko 2023-09-23T08:27:58.709 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pm8001 2023-09-23T08:27:58.710 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-09-23T08:27:58.710 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pmcraid.ko 2023-09-23T08:27:58.710 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla1280.ko 2023-09-23T08:27:58.710 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx 2023-09-23T08:27:58.710 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-09-23T08:27:58.710 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-09-23T08:27:58.710 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla4xxx 2023-09-23T08:27:58.710 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-09-23T08:27:58.711 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/raid_class.ko 2023-09-23T08:27:58.711 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_debug.ko 2023-09-23T08:27:58.711 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_fc.ko 2023-09-23T08:27:58.711 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-09-23T08:27:58.711 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_sas.ko 2023-09-23T08:27:58.711 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_spi.ko 2023-09-23T08:27:58.711 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_srp.ko 2023-09-23T08:27:58.711 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ses.ko 2023-09-23T08:27:58.711 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/st.ko 2023-09-23T08:27:58.712 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/stex.ko 2023-09-23T08:27:58.712 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/sym53c8xx_2 2023-09-23T08:27:58.712 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-09-23T08:27:58.712 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/virtio_scsi.ko 2023-09-23T08:27:58.712 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/vmw_pvscsi.ko 2023-09-23T08:27:58.712 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/wd719x.ko 2023-09-23T08:27:58.712 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ssb 2023-09-23T08:27:58.713 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ssb/ssb.ko 2023-09-23T08:27:58.713 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target 2023-09-23T08:27:58.713 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/iscsi 2023-09-23T08:27:58.713 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-09-23T08:27:58.713 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/loopback 2023-09-23T08:27:58.713 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/loopback/tcm_loop.ko 2023-09-23T08:27:58.713 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_file.ko 2023-09-23T08:27:58.713 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_iblock.ko 2023-09-23T08:27:58.713 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_mod.ko 2023-09-23T08:27:58.713 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_pscsi.ko 2023-09-23T08:27:58.713 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_user.ko 2023-09-23T08:27:58.714 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/tcm_fc 2023-09-23T08:27:58.714 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-09-23T08:27:58.714 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal 2023-09-23T08:27:58.714 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel 2023-09-23T08:27:58.714 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal 2023-09-23T08:27:58.714 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-09-23T08:27:58.717 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-09-23T08:27:58.717 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-09-23T08:27:58.717 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-09-23T08:27:58.717 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-09-23T08:27:58.718 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-09-23T08:27:58.718 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-09-23T08:27:58.718 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-09-23T08:27:58.718 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-09-23T08:27:58.718 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-09-23T08:27:58.718 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-09-23T08:27:58.718 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-09-23T08:27:58.718 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-09-23T08:27:58.718 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-09-23T08:27:58.718 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-09-23T08:27:58.718 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty 2023-09-23T08:27:58.719 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/ipwireless 2023-09-23T08:27:58.719 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-09-23T08:27:58.719 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/n_gsm.ko 2023-09-23T08:27:58.719 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/n_hdlc.ko 2023-09-23T08:27:58.719 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/nozomi.ko 2023-09-23T08:27:58.719 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial 2023-09-23T08:27:58.719 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/8250 2023-09-23T08:27:58.719 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-09-23T08:27:58.719 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/arc_uart.ko 2023-09-23T08:27:58.719 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/jsm 2023-09-23T08:27:58.719 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/jsm/jsm.ko 2023-09-23T08:27:58.719 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/synclink_gt.ko 2023-09-23T08:27:58.720 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs 2023-09-23T08:27:58.720 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/core 2023-09-23T08:27:58.720 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/core/ufshcd-core.ko 2023-09-23T08:27:58.720 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/host 2023-09-23T08:27:58.720 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-09-23T08:27:58.720 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio 2023-09-23T08:27:58.720 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio.ko 2023-09-23T08:27:58.720 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_aec.ko 2023-09-23T08:27:58.720 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_cif.ko 2023-09-23T08:27:58.720 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_pci_generic.ko 2023-09-23T08:27:58.720 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_sercos3.ko 2023-09-23T08:27:58.720 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb 2023-09-23T08:27:58.721 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class 2023-09-23T08:27:58.721 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/cdc-acm.ko 2023-09-23T08:27:58.721 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/cdc-wdm.ko 2023-09-23T08:27:58.721 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/usblp.ko 2023-09-23T08:27:58.721 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/usbtmc.ko 2023-09-23T08:27:58.721 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host 2023-09-23T08:27:58.721 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host/sl811-hcd.ko 2023-09-23T08:27:58.721 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image 2023-09-23T08:27:58.721 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image/mdc800.ko 2023-09-23T08:27:58.721 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image/microtek.ko 2023-09-23T08:27:58.721 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc 2023-09-23T08:27:58.722 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/adutux.ko 2023-09-23T08:27:58.722 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/appledisplay.ko 2023-09-23T08:27:58.722 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/emi26.ko 2023-09-23T08:27:58.722 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/emi62.ko 2023-09-23T08:27:58.722 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ezusb.ko 2023-09-23T08:27:58.722 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/idmouse.ko 2023-09-23T08:27:58.722 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/iowarrior.ko 2023-09-23T08:27:58.722 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/isight_firmware.ko 2023-09-23T08:27:58.722 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ldusb.ko 2023-09-23T08:27:58.722 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/legousbtower.ko 2023-09-23T08:27:58.722 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/sisusbvga 2023-09-23T08:27:58.723 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-09-23T08:27:58.723 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/trancevibrator.ko 2023-09-23T08:27:58.723 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usb3503.ko 2023-09-23T08:27:58.723 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usblcd.ko 2023-09-23T08:27:58.723 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usbsevseg.ko 2023-09-23T08:27:58.723 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/uss720.ko 2023-09-23T08:27:58.723 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/yurex.ko 2023-09-23T08:27:58.723 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy 2023-09-23T08:27:58.723 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy/phy-generic.ko 2023-09-23T08:27:58.723 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial 2023-09-23T08:27:58.723 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/aircable.ko 2023-09-23T08:27:58.723 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ark3116.ko 2023-09-23T08:27:58.724 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/belkin_sa.ko 2023-09-23T08:27:58.724 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ch341.ko 2023-09-23T08:27:58.724 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cp210x.ko 2023-09-23T08:27:58.724 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cyberjack.ko 2023-09-23T08:27:58.724 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cypress_m8.ko 2023-09-23T08:27:58.724 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/digi_acceleport.ko 2023-09-23T08:27:58.724 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/empeg.ko 2023-09-23T08:27:58.724 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ftdi_sio.ko 2023-09-23T08:27:58.724 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/garmin_gps.ko 2023-09-23T08:27:58.724 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/io_edgeport.ko 2023-09-23T08:27:58.724 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/io_ti.ko 2023-09-23T08:27:58.725 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ipaq.ko 2023-09-23T08:27:58.725 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ipw.ko 2023-09-23T08:27:58.725 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ir-usb.ko 2023-09-23T08:27:58.725 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-09-23T08:27:58.725 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/keyspan.ko 2023-09-23T08:27:58.725 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/keyspan_pda.ko 2023-09-23T08:27:58.725 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/kl5kusb105.ko 2023-09-23T08:27:58.725 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/kobil_sct.ko 2023-09-23T08:27:58.725 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mct_u232.ko 2023-09-23T08:27:58.725 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mos7720.ko 2023-09-23T08:27:58.725 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mos7840.ko 2023-09-23T08:27:58.725 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/navman.ko 2023-09-23T08:27:58.726 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/omninet.ko 2023-09-23T08:27:58.726 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/opticon.ko 2023-09-23T08:27:58.726 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/option.ko 2023-09-23T08:27:58.726 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/oti6858.ko 2023-09-23T08:27:58.726 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/pl2303.ko 2023-09-23T08:27:58.726 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/qcaux.ko 2023-09-23T08:27:58.726 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/qcserial.ko 2023-09-23T08:27:58.726 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/quatech2.ko 2023-09-23T08:27:58.726 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/safe_serial.ko 2023-09-23T08:27:58.727 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/sierra.ko 2023-09-23T08:27:58.727 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/spcp8x5.ko 2023-09-23T08:27:58.727 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ssu100.ko 2023-09-23T08:27:58.727 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/symbolserial.ko 2023-09-23T08:27:58.727 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-09-23T08:27:58.727 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-09-23T08:27:58.727 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb_debug.ko 2023-09-23T08:27:58.727 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb_wwan.ko 2023-09-23T08:27:58.728 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/visor.ko 2023-09-23T08:27:58.728 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/whiteheat.ko 2023-09-23T08:27:58.728 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/xsens_mt.ko 2023-09-23T08:27:58.728 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage 2023-09-23T08:27:58.728 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/uas.ko 2023-09-23T08:27:58.728 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-alauda.ko 2023-09-23T08:27:58.728 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-cypress.ko 2023-09-23T08:27:58.728 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-datafab.ko 2023-09-23T08:27:58.728 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-09-23T08:27:58.728 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-freecom.ko 2023-09-23T08:27:58.728 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-isd200.ko 2023-09-23T08:27:58.729 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-09-23T08:27:58.729 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-karma.ko 2023-09-23T08:27:58.729 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-onetouch.ko 2023-09-23T08:27:58.729 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-realtek.ko 2023-09-23T08:27:58.729 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-sddr09.ko 2023-09-23T08:27:58.729 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-sddr55.ko 2023-09-23T08:27:58.729 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-usbat.ko 2023-09-23T08:27:58.729 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/usb-storage.ko 2023-09-23T08:27:58.729 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip 2023-09-23T08:27:58.729 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/usbip-core.ko 2023-09-23T08:27:58.729 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/usbip-host.ko 2023-09-23T08:27:58.730 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-09-23T08:27:58.730 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio 2023-09-23T08:27:58.730 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci 2023-09-23T08:27:58.730 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-09-23T08:27:58.730 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci/vfio-pci.ko 2023-09-23T08:27:58.730 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/vfio.ko 2023-09-23T08:27:58.730 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-09-23T08:27:58.730 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost 2023-09-23T08:27:58.730 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost.ko 2023-09-23T08:27:58.730 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_iotlb.ko 2023-09-23T08:27:58.730 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_net.ko 2023-09-23T08:27:58.731 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_scsi.ko 2023-09-23T08:27:58.731 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video 2023-09-23T08:27:58.731 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight 2023-09-23T08:27:58.731 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/apple_bl.ko 2023-09-23T08:27:58.731 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/lcd.ko 2023-09-23T08:27:58.731 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/platform_lcd.ko 2023-09-23T08:27:58.731 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio 2023-09-23T08:27:58.731 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio.ko 2023-09-23T08:27:58.732 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_balloon.ko 2023-09-23T08:27:58.732 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_mmio.ko 2023-09-23T08:27:58.732 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci.ko 2023-09-23T08:27:58.732 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-09-23T08:27:58.732 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-09-23T08:27:58.732 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_ring.ko 2023-09-23T08:27:58.732 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1 2023-09-23T08:27:58.732 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters 2023-09-23T08:27:58.732 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/ds2482.ko 2023-09-23T08:27:58.732 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/ds2490.ko 2023-09-23T08:27:58.732 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves 2023-09-23T08:27:58.732 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-09-23T08:27:58.733 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-09-23T08:27:58.733 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-09-23T08:27:58.733 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-09-23T08:27:58.733 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-09-23T08:27:58.733 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-09-23T08:27:58.733 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-09-23T08:27:58.733 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-09-23T08:27:58.733 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-09-23T08:27:58.733 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_smem.ko 2023-09-23T08:27:58.733 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_therm.ko 2023-09-23T08:27:58.734 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/wire.ko 2023-09-23T08:27:58.734 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog 2023-09-23T08:27:58.734 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/alim1535_wdt.ko 2023-09-23T08:27:58.734 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/alim7101_wdt.ko 2023-09-23T08:27:58.734 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/f71808e_wdt.ko 2023-09-23T08:27:58.734 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/hpwdt.ko 2023-09-23T08:27:58.734 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/i6300esb.ko 2023-09-23T08:27:58.734 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-09-23T08:27:58.734 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/iTCO_wdt.ko 2023-09-23T08:27:58.734 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ib700wdt.ko 2023-09-23T08:27:58.734 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ibmasr.ko 2023-09-23T08:27:58.734 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-09-23T08:27:58.735 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/it8712f_wdt.ko 2023-09-23T08:27:58.735 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/it87_wdt.ko 2023-09-23T08:27:58.735 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/machzwd.ko 2023-09-23T08:27:58.735 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/nv_tco.ko 2023-09-23T08:27:58.735 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/pcwd_pci.ko 2023-09-23T08:27:58.735 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/pcwd_usb.ko 2023-09-23T08:27:58.735 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-09-23T08:27:58.735 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sch311x_wdt.ko 2023-09-23T08:27:58.735 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/softdog.ko 2023-09-23T08:27:58.735 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sp5100_tco.ko 2023-09-23T08:27:58.735 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/via_wdt.ko 2023-09-23T08:27:58.736 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-09-23T08:27:58.736 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83877f_wdt.ko 2023-09-23T08:27:58.736 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83977f_wdt.ko 2023-09-23T08:27:58.736 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/wdt_pci.ko 2023-09-23T08:27:58.736 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/xen_wdt.ko 2023-09-23T08:27:58.736 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen 2023-09-23T08:27:58.736 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-acpi-processor.ko 2023-09-23T08:27:58.736 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-evtchn.ko 2023-09-23T08:27:58.736 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-gntalloc.ko 2023-09-23T08:27:58.736 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-gntdev.ko 2023-09-23T08:27:58.736 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-pciback 2023-09-23T08:27:58.736 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-09-23T08:27:58.737 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-privcmd.ko 2023-09-23T08:27:58.737 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xenfs 2023-09-23T08:27:58.737 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xenfs/xenfs.ko 2023-09-23T08:27:58.737 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs 2023-09-23T08:27:58.737 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/9p 2023-09-23T08:27:58.737 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/9p/9p.ko 2023-09-23T08:27:58.737 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/affs 2023-09-23T08:27:58.737 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/affs/affs.ko 2023-09-23T08:27:58.737 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/befs 2023-09-23T08:27:58.737 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/befs/befs.ko 2023-09-23T08:27:58.737 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/binfmt_misc.ko 2023-09-23T08:27:58.738 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/btrfs 2023-09-23T08:27:58.738 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/btrfs/btrfs.ko 2023-09-23T08:27:58.738 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cachefiles 2023-09-23T08:27:58.738 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cachefiles/cachefiles.ko 2023-09-23T08:27:58.738 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ceph 2023-09-23T08:27:58.738 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ceph/ceph.ko 2023-09-23T08:27:58.738 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/coda 2023-09-23T08:27:58.738 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/coda/coda.ko 2023-09-23T08:27:58.738 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cramfs 2023-09-23T08:27:58.738 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cramfs/cramfs.ko 2023-09-23T08:27:58.738 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/dlm 2023-09-23T08:27:58.738 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/dlm/dlm.ko 2023-09-23T08:27:58.739 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ecryptfs 2023-09-23T08:27:58.739 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ecryptfs/ecryptfs.ko 2023-09-23T08:27:58.739 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/f2fs 2023-09-23T08:27:58.739 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/f2fs/f2fs.ko 2023-09-23T08:27:58.739 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat 2023-09-23T08:27:58.739 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/fat.ko 2023-09-23T08:27:58.739 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/msdos.ko 2023-09-23T08:27:58.739 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/vfat.ko 2023-09-23T08:27:58.739 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fscache 2023-09-23T08:27:58.739 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fscache/fscache.ko 2023-09-23T08:27:58.740 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse 2023-09-23T08:27:58.740 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse/cuse.ko 2023-09-23T08:27:58.740 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse/fuse.ko 2023-09-23T08:27:58.740 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/gfs2 2023-09-23T08:27:58.740 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/gfs2/gfs2.ko 2023-09-23T08:27:58.740 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfs 2023-09-23T08:27:58.740 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfs/hfs.ko 2023-09-23T08:27:58.740 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfsplus 2023-09-23T08:27:58.740 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfsplus/hfsplus.ko 2023-09-23T08:27:58.740 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/isofs 2023-09-23T08:27:58.740 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/isofs/isofs.ko 2023-09-23T08:27:58.740 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/jfs 2023-09-23T08:27:58.741 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/jfs/jfs.ko 2023-09-23T08:27:58.741 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/lockd 2023-09-23T08:27:58.741 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/lockd/lockd.ko 2023-09-23T08:27:58.741 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/minix 2023-09-23T08:27:58.741 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/minix/minix.ko 2023-09-23T08:27:58.741 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/netfs 2023-09-23T08:27:58.741 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/netfs/netfs.ko 2023-09-23T08:27:58.741 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs 2023-09-23T08:27:58.741 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/blocklayout 2023-09-23T08:27:58.741 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-09-23T08:27:58.741 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/filelayout 2023-09-23T08:27:58.742 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-09-23T08:27:58.742 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/flexfilelayout 2023-09-23T08:27:58.742 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-09-23T08:27:58.742 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfs.ko 2023-09-23T08:27:58.742 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfsv3.ko 2023-09-23T08:27:58.742 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfsv4.ko 2023-09-23T08:27:58.742 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common 2023-09-23T08:27:58.742 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common/grace.ko 2023-09-23T08:27:58.742 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common/nfs_acl.ko 2023-09-23T08:27:58.742 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfsd 2023-09-23T08:27:58.742 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfsd/nfsd.ko 2023-09-23T08:27:58.743 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nilfs2 2023-09-23T08:27:58.743 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nilfs2/nilfs2.ko 2023-09-23T08:27:58.743 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls 2023-09-23T08:27:58.743 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-celtic.ko 2023-09-23T08:27:58.743 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-centeuro.ko 2023-09-23T08:27:58.743 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-croatian.ko 2023-09-23T08:27:58.743 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-cyrillic.ko 2023-09-23T08:27:58.743 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-gaelic.ko 2023-09-23T08:27:58.743 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-greek.ko 2023-09-23T08:27:58.743 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-iceland.ko 2023-09-23T08:27:58.743 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-inuit.ko 2023-09-23T08:27:58.744 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-roman.ko 2023-09-23T08:27:58.744 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-romanian.ko 2023-09-23T08:27:58.744 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-turkish.ko 2023-09-23T08:27:58.744 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1250.ko 2023-09-23T08:27:58.744 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1251.ko 2023-09-23T08:27:58.744 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1255.ko 2023-09-23T08:27:58.744 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp737.ko 2023-09-23T08:27:58.744 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp775.ko 2023-09-23T08:27:58.745 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp850.ko 2023-09-23T08:27:58.745 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp852.ko 2023-09-23T08:27:58.745 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp855.ko 2023-09-23T08:27:58.745 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp857.ko 2023-09-23T08:27:58.745 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp860.ko 2023-09-23T08:27:58.745 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp861.ko 2023-09-23T08:27:58.745 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp862.ko 2023-09-23T08:27:58.746 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp863.ko 2023-09-23T08:27:58.746 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp864.ko 2023-09-23T08:27:58.746 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp865.ko 2023-09-23T08:27:58.746 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp866.ko 2023-09-23T08:27:58.746 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp869.ko 2023-09-23T08:27:58.746 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp874.ko 2023-09-23T08:27:58.746 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp932.ko 2023-09-23T08:27:58.746 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp936.ko 2023-09-23T08:27:58.746 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp949.ko 2023-09-23T08:27:58.747 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp950.ko 2023-09-23T08:27:58.747 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_euc-jp.ko 2023-09-23T08:27:58.747 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-1.ko 2023-09-23T08:27:58.747 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-13.ko 2023-09-23T08:27:58.747 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-14.ko 2023-09-23T08:27:58.747 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-15.ko 2023-09-23T08:27:58.747 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-2.ko 2023-09-23T08:27:58.747 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-3.ko 2023-09-23T08:27:58.747 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-4.ko 2023-09-23T08:27:58.748 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-5.ko 2023-09-23T08:27:58.748 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-6.ko 2023-09-23T08:27:58.748 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-7.ko 2023-09-23T08:27:58.748 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-9.ko 2023-09-23T08:27:58.748 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-r.ko 2023-09-23T08:27:58.748 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-ru.ko 2023-09-23T08:27:58.748 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-u.ko 2023-09-23T08:27:58.748 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_utf8.ko 2023-09-23T08:27:58.748 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2 2023-09-23T08:27:58.749 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/cluster 2023-09-23T08:27:58.749 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-09-23T08:27:58.749 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlm 2023-09-23T08:27:58.749 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-09-23T08:27:58.749 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlmfs 2023-09-23T08:27:58.749 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-09-23T08:27:58.749 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2.ko 2023-09-23T08:27:58.749 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-09-23T08:27:58.749 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-09-23T08:27:58.749 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-09-23T08:27:58.749 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/overlayfs 2023-09-23T08:27:58.750 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/overlayfs/overlay.ko 2023-09-23T08:27:58.750 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/pstore 2023-09-23T08:27:58.750 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/pstore/ramoops.ko 2023-09-23T08:27:58.750 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/reiserfs 2023-09-23T08:27:58.750 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/reiserfs/reiserfs.ko 2023-09-23T08:27:58.750 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/romfs 2023-09-23T08:27:58.750 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/romfs/romfs.ko 2023-09-23T08:27:58.750 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb 2023-09-23T08:27:58.750 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/client 2023-09-23T08:27:58.751 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/client/cifs.ko 2023-09-23T08:27:58.751 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common 2023-09-23T08:27:58.751 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common/cifs_arc4.ko 2023-09-23T08:27:58.751 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common/cifs_md4.ko 2023-09-23T08:27:58.751 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/squashfs 2023-09-23T08:27:58.751 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/squashfs/squashfs.ko 2023-09-23T08:27:58.751 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/sysv 2023-09-23T08:27:58.751 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/sysv/sysv.ko 2023-09-23T08:27:58.751 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/udf 2023-09-23T08:27:58.751 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/udf/udf.ko 2023-09-23T08:27:58.751 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ufs 2023-09-23T08:27:58.751 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ufs/ufs.ko 2023-09-23T08:27:58.752 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/xfs 2023-09-23T08:27:58.752 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/xfs/xfs.ko 2023-09-23T08:27:58.752 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel 2023-09-23T08:27:58.752 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/rcu 2023-09-23T08:27:58.752 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/rcu/rcutorture.ko 2023-09-23T08:27:58.752 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/torture.ko 2023-09-23T08:27:58.752 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/trace 2023-09-23T08:27:58.752 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-09-23T08:27:58.752 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib 2023-09-23T08:27:58.752 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/asn1_encoder.ko 2023-09-23T08:27:58.752 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crc-itu-t.ko 2023-09-23T08:27:58.752 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crc8.ko 2023-09-23T08:27:58.753 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto 2023-09-23T08:27:58.753 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto/libarc4.ko 2023-09-23T08:27:58.753 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto/libdes.ko 2023-09-23T08:27:58.753 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/libcrc32c.ko 2023-09-23T08:27:58.753 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lru_cache.ko 2023-09-23T08:27:58.753 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4 2023-09-23T08:27:58.753 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4/lz4_compress.ko 2023-09-23T08:27:58.753 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4/lz4hc_compress.ko 2023-09-23T08:27:58.753 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/math 2023-09-23T08:27:58.753 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/math/cordic.ko 2023-09-23T08:27:58.754 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/raid6 2023-09-23T08:27:58.754 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/raid6/raid6_pq.ko 2023-09-23T08:27:58.754 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/reed_solomon 2023-09-23T08:27:58.754 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/reed_solomon/reed_solomon.ko 2023-09-23T08:27:58.754 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_bm.ko 2023-09-23T08:27:58.754 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_fsm.ko 2023-09-23T08:27:58.754 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_kmp.ko 2023-09-23T08:27:58.754 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/zstd 2023-09-23T08:27:58.754 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/zstd/zstd_compress.ko 2023-09-23T08:27:58.754 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/mm 2023-09-23T08:27:58.754 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/mm/hwpoison-inject.ko 2023-09-23T08:27:58.754 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net 2023-09-23T08:27:58.755 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan 2023-09-23T08:27:58.755 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/6lowpan.ko 2023-09-23T08:27:58.755 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_dest.ko 2023-09-23T08:27:58.755 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_fragment.ko 2023-09-23T08:27:58.755 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_hop.ko 2023-09-23T08:27:58.755 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_ipv6.ko 2023-09-23T08:27:58.755 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_mobility.ko 2023-09-23T08:27:58.755 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_routing.ko 2023-09-23T08:27:58.755 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_udp.ko 2023-09-23T08:27:58.755 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802 2023-09-23T08:27:58.756 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/garp.ko 2023-09-23T08:27:58.756 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/mrp.ko 2023-09-23T08:27:58.756 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/p8022.ko 2023-09-23T08:27:58.756 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/psnap.ko 2023-09-23T08:27:58.756 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/stp.ko 2023-09-23T08:27:58.756 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/8021q 2023-09-23T08:27:58.756 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/8021q/8021q.ko 2023-09-23T08:27:58.756 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p 2023-09-23T08:27:58.756 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet.ko 2023-09-23T08:27:58.756 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_fd.ko 2023-09-23T08:27:58.756 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_rdma.ko 2023-09-23T08:27:58.756 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_virtio.ko 2023-09-23T08:27:58.757 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/batman-adv 2023-09-23T08:27:58.757 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/batman-adv/batman-adv.ko 2023-09-23T08:27:58.757 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge 2023-09-23T08:27:58.757 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/br_netfilter.ko 2023-09-23T08:27:58.757 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/bridge.ko 2023-09-23T08:27:58.757 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter 2023-09-23T08:27:58.757 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-09-23T08:27:58.757 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_among.ko 2023-09-23T08:27:58.757 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_arp.ko 2023-09-23T08:27:58.757 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-09-23T08:27:58.757 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-09-23T08:27:58.757 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_ip.ko 2023-09-23T08:27:58.758 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-09-23T08:27:58.758 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_limit.ko 2023-09-23T08:27:58.758 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_log.ko 2023-09-23T08:27:58.758 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_mark.ko 2023-09-23T08:27:58.758 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-09-23T08:27:58.758 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-09-23T08:27:58.758 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-09-23T08:27:58.758 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-09-23T08:27:58.758 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_snat.ko 2023-09-23T08:27:58.758 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_stp.ko 2023-09-23T08:27:58.758 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-09-23T08:27:58.758 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-09-23T08:27:58.759 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-09-23T08:27:58.759 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-09-23T08:27:58.759 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtables.ko 2023-09-23T08:27:58.759 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-09-23T08:27:58.759 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-09-23T08:27:58.759 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-09-23T08:27:58.759 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ceph 2023-09-23T08:27:58.759 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ceph/libceph.ko 2023-09-23T08:27:58.760 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core 2023-09-23T08:27:58.760 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core/failover.ko 2023-09-23T08:27:58.760 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core/pktgen.ko 2023-09-23T08:27:58.760 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp 2023-09-23T08:27:58.760 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp.ko 2023-09-23T08:27:58.760 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_diag.ko 2023-09-23T08:27:58.760 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_ipv4.ko 2023-09-23T08:27:58.760 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_ipv6.ko 2023-09-23T08:27:58.760 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dns_resolver 2023-09-23T08:27:58.760 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dns_resolver/dns_resolver.ko 2023-09-23T08:27:58.761 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa 2023-09-23T08:27:58.761 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/dsa_core.ko 2023-09-23T08:27:58.761 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_brcm.ko 2023-09-23T08:27:58.761 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_dsa.ko 2023-09-23T08:27:58.761 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_none.ko 2023-09-23T08:27:58.761 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_trailer.ko 2023-09-23T08:27:58.761 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154 2023-09-23T08:27:58.761 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/6lowpan 2023-09-23T08:27:58.762 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-09-23T08:27:58.762 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/ieee802154.ko 2023-09-23T08:27:58.762 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/ieee802154_socket.ko 2023-09-23T08:27:58.762 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4 2023-09-23T08:27:58.762 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ah4.ko 2023-09-23T08:27:58.762 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/esp4.ko 2023-09-23T08:27:58.762 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/fou.ko 2023-09-23T08:27:58.762 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/gre.ko 2023-09-23T08:27:58.762 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/inet_diag.ko 2023-09-23T08:27:58.762 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_gre.ko 2023-09-23T08:27:58.762 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_tunnel.ko 2023-09-23T08:27:58.763 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_vti.ko 2023-09-23T08:27:58.763 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ipcomp.ko 2023-09-23T08:27:58.763 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ipip.ko 2023-09-23T08:27:58.763 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter 2023-09-23T08:27:58.763 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arp_tables.ko 2023-09-23T08:27:58.763 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-09-23T08:27:58.763 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-09-23T08:27:58.763 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-09-23T08:27:58.763 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-09-23T08:27:58.763 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-09-23T08:27:58.764 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-09-23T08:27:58.764 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-09-23T08:27:58.764 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-09-23T08:27:58.764 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-09-23T08:27:58.764 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_security.ko 2023-09-23T08:27:58.764 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-09-23T08:27:58.764 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-09-23T08:27:58.764 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-09-23T08:27:58.764 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-09-23T08:27:58.764 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-09-23T08:27:58.764 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-09-23T08:27:58.764 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-09-23T08:27:58.765 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-09-23T08:27:58.765 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-09-23T08:27:58.765 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-09-23T08:27:58.765 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_bic.ko 2023-09-23T08:27:58.765 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_dctcp.ko 2023-09-23T08:27:58.765 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_diag.ko 2023-09-23T08:27:58.765 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_highspeed.ko 2023-09-23T08:27:58.765 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_htcp.ko 2023-09-23T08:27:58.765 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_hybla.ko 2023-09-23T08:27:58.766 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_illinois.ko 2023-09-23T08:27:58.766 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_lp.ko 2023-09-23T08:27:58.766 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_scalable.ko 2023-09-23T08:27:58.766 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_vegas.ko 2023-09-23T08:27:58.766 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_veno.ko 2023-09-23T08:27:58.766 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_westwood.ko 2023-09-23T08:27:58.766 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_yeah.ko 2023-09-23T08:27:58.766 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tunnel4.ko 2023-09-23T08:27:58.766 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/udp_diag.ko 2023-09-23T08:27:58.766 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/udp_tunnel.ko 2023-09-23T08:27:58.766 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/xfrm4_tunnel.ko 2023-09-23T08:27:58.766 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6 2023-09-23T08:27:58.767 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ah6.ko 2023-09-23T08:27:58.767 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/esp6.ko 2023-09-23T08:27:58.767 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/fou6.ko 2023-09-23T08:27:58.767 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_tunnel.ko 2023-09-23T08:27:58.767 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-09-23T08:27:58.767 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_vti.ko 2023-09-23T08:27:58.767 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ipcomp6.ko 2023-09-23T08:27:58.767 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter 2023-09-23T08:27:58.767 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-09-23T08:27:58.767 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-09-23T08:27:58.768 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-09-23T08:27:58.768 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-09-23T08:27:58.768 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-09-23T08:27:58.768 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-09-23T08:27:58.768 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-09-23T08:27:58.768 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-09-23T08:27:58.768 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-09-23T08:27:58.768 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-09-23T08:27:58.768 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-09-23T08:27:58.768 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-09-23T08:27:58.768 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-09-23T08:27:58.769 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-09-23T08:27:58.769 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-09-23T08:27:58.769 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-09-23T08:27:58.769 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-09-23T08:27:58.769 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-09-23T08:27:58.769 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-09-23T08:27:58.769 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-09-23T08:27:58.769 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-09-23T08:27:58.769 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-09-23T08:27:58.769 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-09-23T08:27:58.769 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-09-23T08:27:58.770 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/sit.ko 2023-09-23T08:27:58.770 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/tunnel6.ko 2023-09-23T08:27:58.770 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/xfrm6_tunnel.ko 2023-09-23T08:27:58.770 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/key 2023-09-23T08:27:58.770 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/key/af_key.ko 2023-09-23T08:27:58.770 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp 2023-09-23T08:27:58.770 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_core.ko 2023-09-23T08:27:58.770 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_debugfs.ko 2023-09-23T08:27:58.770 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_eth.ko 2023-09-23T08:27:58.771 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ip.ko 2023-09-23T08:27:58.771 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ip6.ko 2023-09-23T08:27:58.771 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_netlink.ko 2023-09-23T08:27:58.771 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ppp.ko 2023-09-23T08:27:58.771 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/llc 2023-09-23T08:27:58.771 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/llc/llc.ko 2023-09-23T08:27:58.771 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mac802154 2023-09-23T08:27:58.771 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mac802154/mac802154.ko 2023-09-23T08:27:58.771 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mpls 2023-09-23T08:27:58.772 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mpls/mpls_gso.ko 2023-09-23T08:27:58.772 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter 2023-09-23T08:27:58.772 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset 2023-09-23T08:27:58.772 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set.ko 2023-09-23T08:27:58.772 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-09-23T08:27:58.772 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-09-23T08:27:58.772 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-09-23T08:27:58.773 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-09-23T08:27:58.773 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-09-23T08:27:58.773 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-09-23T08:27:58.773 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-09-23T08:27:58.773 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-09-23T08:27:58.773 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-09-23T08:27:58.773 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-09-23T08:27:58.773 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-09-23T08:27:58.774 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-09-23T08:27:58.774 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-09-23T08:27:58.774 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-09-23T08:27:58.774 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-09-23T08:27:58.774 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs 2023-09-23T08:27:58.774 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs.ko 2023-09-23T08:27:58.774 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-09-23T08:27:58.774 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-09-23T08:27:58.774 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-09-23T08:27:58.774 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-09-23T08:27:58.775 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-09-23T08:27:58.775 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-09-23T08:27:58.775 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-09-23T08:27:58.775 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-09-23T08:27:58.775 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-09-23T08:27:58.775 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-09-23T08:27:58.775 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-09-23T08:27:58.775 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-09-23T08:27:58.775 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-09-23T08:27:58.775 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conncount.ko 2023-09-23T08:27:58.775 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack.ko 2023-09-23T08:27:58.776 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-09-23T08:27:58.776 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-09-23T08:27:58.776 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-09-23T08:27:58.776 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_h323.ko 2023-09-23T08:27:58.776 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_irc.ko 2023-09-23T08:27:58.776 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-09-23T08:27:58.776 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-09-23T08:27:58.776 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-09-23T08:27:58.776 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_sane.ko 2023-09-23T08:27:58.776 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_sip.ko 2023-09-23T08:27:58.777 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-09-23T08:27:58.777 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-09-23T08:27:58.777 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_dup_netdev.ko 2023-09-23T08:27:58.777 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_flow_table.ko 2023-09-23T08:27:58.777 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_flow_table_inet.ko 2023-09-23T08:27:58.777 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_log_syslog.ko 2023-09-23T08:27:58.777 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat.ko 2023-09-23T08:27:58.777 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_amanda.ko 2023-09-23T08:27:58.777 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_ftp.ko 2023-09-23T08:27:58.777 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_irc.ko 2023-09-23T08:27:58.778 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_sip.ko 2023-09-23T08:27:58.778 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_tftp.ko 2023-09-23T08:27:58.778 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_synproxy_core.ko 2023-09-23T08:27:58.778 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_tables.ko 2023-09-23T08:27:58.778 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink.ko 2023-09-23T08:27:58.778 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_acct.ko 2023-09-23T08:27:58.778 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_log.ko 2023-09-23T08:27:58.778 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_osf.ko 2023-09-23T08:27:58.778 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_queue.ko 2023-09-23T08:27:58.778 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_chain_nat.ko 2023-09-23T08:27:58.779 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_compat.ko 2023-09-23T08:27:58.779 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_ct.ko 2023-09-23T08:27:58.779 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_dup_netdev.ko 2023-09-23T08:27:58.779 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_fib.ko 2023-09-23T08:27:58.779 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_fwd_netdev.ko 2023-09-23T08:27:58.779 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_hash.ko 2023-09-23T08:27:58.779 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_limit.ko 2023-09-23T08:27:58.779 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_log.ko 2023-09-23T08:27:58.779 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_masq.ko 2023-09-23T08:27:58.779 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_nat.ko 2023-09-23T08:27:58.779 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_numgen.ko 2023-09-23T08:27:58.780 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_queue.ko 2023-09-23T08:27:58.780 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_quota.ko 2023-09-23T08:27:58.780 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_redir.ko 2023-09-23T08:27:58.780 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_reject.ko 2023-09-23T08:27:58.780 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_reject_inet.ko 2023-09-23T08:27:58.780 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_socket.ko 2023-09-23T08:27:58.780 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_tunnel.ko 2023-09-23T08:27:58.780 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_AUDIT.ko 2023-09-23T08:27:58.780 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CHECKSUM.ko 2023-09-23T08:27:58.780 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CLASSIFY.ko 2023-09-23T08:27:58.780 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-09-23T08:27:58.781 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CT.ko 2023-09-23T08:27:58.781 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_DSCP.ko 2023-09-23T08:27:58.781 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_HL.ko 2023-09-23T08:27:58.781 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_HMARK.ko 2023-09-23T08:27:58.781 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_IDLETIMER.ko 2023-09-23T08:27:58.781 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_LED.ko 2023-09-23T08:27:58.781 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_LOG.ko 2023-09-23T08:27:58.781 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_MASQUERADE.ko 2023-09-23T08:27:58.781 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NETMAP.ko 2023-09-23T08:27:58.781 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NFLOG.ko 2023-09-23T08:27:58.781 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NFQUEUE.ko 2023-09-23T08:27:58.782 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_RATEEST.ko 2023-09-23T08:27:58.782 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_REDIRECT.ko 2023-09-23T08:27:58.782 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_SECMARK.ko 2023-09-23T08:27:58.782 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TCPMSS.ko 2023-09-23T08:27:58.782 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-09-23T08:27:58.782 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TEE.ko 2023-09-23T08:27:58.782 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TPROXY.ko 2023-09-23T08:27:58.782 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TRACE.ko 2023-09-23T08:27:58.782 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_addrtype.ko 2023-09-23T08:27:58.782 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_bpf.ko 2023-09-23T08:27:58.782 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cgroup.ko 2023-09-23T08:27:58.783 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cluster.ko 2023-09-23T08:27:58.783 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_comment.ko 2023-09-23T08:27:58.783 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connbytes.ko 2023-09-23T08:27:58.783 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connlabel.ko 2023-09-23T08:27:58.783 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connlimit.ko 2023-09-23T08:27:58.783 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connmark.ko 2023-09-23T08:27:58.783 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_conntrack.ko 2023-09-23T08:27:58.783 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cpu.ko 2023-09-23T08:27:58.783 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_dccp.ko 2023-09-23T08:27:58.783 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_devgroup.ko 2023-09-23T08:27:58.783 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_dscp.ko 2023-09-23T08:27:58.783 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ecn.ko 2023-09-23T08:27:58.784 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_esp.ko 2023-09-23T08:27:58.784 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_hashlimit.ko 2023-09-23T08:27:58.784 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_helper.ko 2023-09-23T08:27:58.784 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_hl.ko 2023-09-23T08:27:58.784 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ipcomp.ko 2023-09-23T08:27:58.784 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_iprange.ko 2023-09-23T08:27:58.784 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ipvs.ko 2023-09-23T08:27:58.784 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_l2tp.ko 2023-09-23T08:27:58.784 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_length.ko 2023-09-23T08:27:58.784 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_limit.ko 2023-09-23T08:27:58.784 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_mac.ko 2023-09-23T08:27:58.784 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_mark.ko 2023-09-23T08:27:58.785 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_multiport.ko 2023-09-23T08:27:58.785 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_nat.ko 2023-09-23T08:27:58.785 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_nfacct.ko 2023-09-23T08:27:58.785 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_osf.ko 2023-09-23T08:27:58.785 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_owner.ko 2023-09-23T08:27:58.785 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_physdev.ko 2023-09-23T08:27:58.785 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_pkttype.ko 2023-09-23T08:27:58.785 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_policy.ko 2023-09-23T08:27:58.785 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_quota.ko 2023-09-23T08:27:58.785 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_rateest.ko 2023-09-23T08:27:58.785 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_realm.ko 2023-09-23T08:27:58.785 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_recent.ko 2023-09-23T08:27:58.785 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_sctp.ko 2023-09-23T08:27:58.786 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_set.ko 2023-09-23T08:27:58.786 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_socket.ko 2023-09-23T08:27:58.786 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_state.ko 2023-09-23T08:27:58.786 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_statistic.ko 2023-09-23T08:27:58.786 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_string.ko 2023-09-23T08:27:58.786 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_tcpmss.ko 2023-09-23T08:27:58.786 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_time.ko 2023-09-23T08:27:58.786 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_u32.ko 2023-09-23T08:27:58.786 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netlink 2023-09-23T08:27:58.786 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netlink/netlink_diag.ko 2023-09-23T08:27:58.786 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/nsh 2023-09-23T08:27:58.787 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/nsh/nsh.ko 2023-09-23T08:27:58.787 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch 2023-09-23T08:27:58.787 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/openvswitch.ko 2023-09-23T08:27:58.787 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-geneve.ko 2023-09-23T08:27:58.787 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-gre.ko 2023-09-23T08:27:58.787 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-vxlan.ko 2023-09-23T08:27:58.787 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/packet 2023-09-23T08:27:58.787 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/packet/af_packet_diag.ko 2023-09-23T08:27:58.787 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds 2023-09-23T08:27:58.787 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds.ko 2023-09-23T08:27:58.788 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds_rdma.ko 2023-09-23T08:27:58.788 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds_tcp.ko 2023-09-23T08:27:58.788 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched 2023-09-23T08:27:58.788 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_csum.ko 2023-09-23T08:27:58.788 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_gact.ko 2023-09-23T08:27:58.788 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_ipt.ko 2023-09-23T08:27:58.788 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_mirred.ko 2023-09-23T08:27:58.788 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_nat.ko 2023-09-23T08:27:58.788 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_pedit.ko 2023-09-23T08:27:58.788 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_police.ko 2023-09-23T08:27:58.789 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_simple.ko 2023-09-23T08:27:58.789 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_skbedit.ko 2023-09-23T08:27:58.789 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_vlan.ko 2023-09-23T08:27:58.789 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_basic.ko 2023-09-23T08:27:58.789 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_bpf.ko 2023-09-23T08:27:58.789 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_flow.ko 2023-09-23T08:27:58.789 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_fw.ko 2023-09-23T08:27:58.789 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_route.ko 2023-09-23T08:27:58.789 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_u32.ko 2023-09-23T08:27:58.789 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_cmp.ko 2023-09-23T08:27:58.790 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_ipset.ko 2023-09-23T08:27:58.790 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_meta.ko 2023-09-23T08:27:58.790 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_nbyte.ko 2023-09-23T08:27:58.790 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_text.ko 2023-09-23T08:27:58.790 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_u32.ko 2023-09-23T08:27:58.790 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_choke.ko 2023-09-23T08:27:58.790 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_codel.ko 2023-09-23T08:27:58.790 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_drr.ko 2023-09-23T08:27:58.790 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_fq.ko 2023-09-23T08:27:58.791 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_gred.ko 2023-09-23T08:27:58.791 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_hfsc.ko 2023-09-23T08:27:58.791 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_hhf.ko 2023-09-23T08:27:58.791 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_htb.ko 2023-09-23T08:27:58.791 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_ingress.ko 2023-09-23T08:27:58.791 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_mqprio.ko 2023-09-23T08:27:58.792 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_mqprio_lib.ko 2023-09-23T08:27:58.792 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_multiq.ko 2023-09-23T08:27:58.792 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_netem.ko 2023-09-23T08:27:58.792 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_pie.ko 2023-09-23T08:27:58.792 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_plug.ko 2023-09-23T08:27:58.792 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_prio.ko 2023-09-23T08:27:58.792 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_qfq.ko 2023-09-23T08:27:58.792 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_red.ko 2023-09-23T08:27:58.793 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_sfb.ko 2023-09-23T08:27:58.793 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_sfq.ko 2023-09-23T08:27:58.793 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_tbf.ko 2023-09-23T08:27:58.793 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_teql.ko 2023-09-23T08:27:58.793 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp 2023-09-23T08:27:58.793 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp/sctp.ko 2023-09-23T08:27:58.793 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp/sctp_diag.ko 2023-09-23T08:27:58.793 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc 2023-09-23T08:27:58.793 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss 2023-09-23T08:27:58.793 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-09-23T08:27:58.793 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-09-23T08:27:58.794 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/sunrpc.ko 2023-09-23T08:27:58.794 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/xprtrdma 2023-09-23T08:27:58.794 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-09-23T08:27:58.794 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc 2023-09-23T08:27:58.794 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc/diag.ko 2023-09-23T08:27:58.794 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc/tipc.ko 2023-09-23T08:27:58.794 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/unix 2023-09-23T08:27:58.794 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/unix/unix_diag.ko 2023-09-23T08:27:58.794 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock 2023-09-23T08:27:58.795 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-09-23T08:27:58.795 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-09-23T08:27:58.795 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock.ko 2023-09-23T08:27:58.795 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock_diag.ko 2023-09-23T08:27:58.795 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock_loopback.ko 2023-09-23T08:27:58.795 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm 2023-09-23T08:27:58.795 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm/xfrm_ipcomp.ko 2023-09-23T08:27:58.795 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security 2023-09-23T08:27:58.795 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys 2023-09-23T08:27:58.795 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/encrypted-keys 2023-09-23T08:27:58.795 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-09-23T08:27:58.796 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/trusted-keys 2023-09-23T08:27:58.796 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/trusted-keys/trusted.ko 2023-09-23T08:27:58.796 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt 2023-09-23T08:27:58.796 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt/lib 2023-09-23T08:27:58.796 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt/lib/irqbypass.ko 2023-09-23T08:27:58.796 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.alias 2023-09-23T08:27:58.796 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.alias.bin 2023-09-23T08:27:58.796 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin 2023-09-23T08:27:58.796 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin.bin 2023-09-23T08:27:58.796 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin.modinfo 2023-09-23T08:27:58.797 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.dep 2023-09-23T08:27:58.797 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.dep.bin 2023-09-23T08:27:58.797 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.devname 2023-09-23T08:27:58.797 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.order 2023-09-23T08:27:58.797 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.softdep 2023-09-23T08:27:58.797 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.symbols 2023-09-23T08:27:58.797 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.symbols.bin 2023-09-23T08:27:58.798 DEBUG:teuthology.task.kernel:get_image_version: 6.5.0-rc7-gfef64f93da2b 2023-09-23T08:27:58.798 DEBUG:teuthology.orchestra.run.smithi135:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-09-23T08:27:58.827 INFO:teuthology.orchestra.run.smithi135.stdout:postinstall scriptlet (using /bin/sh): 2023-09-23T08:27:58.827 INFO:teuthology.orchestra.run.smithi135.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b -a -r /boot/System.map-6.5.0-rc7-gfef64f93da2b ]; then 2023-09-23T08:27:58.827 INFO:teuthology.orchestra.run.smithi135.stdout:cp /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm 2023-09-23T08:27:58.827 INFO:teuthology.orchestra.run.smithi135.stdout:cp /boot/System.map-6.5.0-rc7-gfef64f93da2b /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-09-23T08:27:58.827 INFO:teuthology.orchestra.run.smithi135.stdout:rm -f /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b /boot/System.map-6.5.0-rc7-gfef64f93da2b 2023-09-23T08:27:58.827 INFO:teuthology.orchestra.run.smithi135.stdout:/sbin/installkernel 6.5.0-rc7-gfef64f93da2b /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-09-23T08:27:58.827 INFO:teuthology.orchestra.run.smithi135.stdout:rm -f /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-09-23T08:27:58.828 INFO:teuthology.orchestra.run.smithi135.stdout:fi 2023-09-23T08:27:58.828 INFO:teuthology.orchestra.run.smithi135.stdout:preuninstall scriptlet (using /bin/sh): 2023-09-23T08:27:58.828 INFO:teuthology.orchestra.run.smithi135.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-09-23T08:27:58.828 INFO:teuthology.orchestra.run.smithi135.stdout:new-kernel-pkg --remove 6.5.0-rc7-gfef64f93da2b --rminitrd --initrdfile=/boot/initramfs-6.5.0-rc7-gfef64f93da2b.img 2023-09-23T08:27:58.828 INFO:teuthology.orchestra.run.smithi135.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-09-23T08:27:58.828 INFO:teuthology.orchestra.run.smithi135.stdout:kernel-install remove 6.5.0-rc7-gfef64f93da2b 2023-09-23T08:27:58.828 INFO:teuthology.orchestra.run.smithi135.stdout:fi 2023-09-23T08:27:58.829 INFO:teuthology.orchestra.run.smithi135.stdout:postuninstall scriptlet (using /bin/sh): 2023-09-23T08:27:58.829 INFO:teuthology.orchestra.run.smithi135.stdout:if [ -x /sbin/update-bootloader ]; then 2023-09-23T08:27:58.829 INFO:teuthology.orchestra.run.smithi135.stdout:/sbin/update-bootloader --remove 6.5.0-rc7-gfef64f93da2b 2023-09-23T08:27:58.829 INFO:teuthology.orchestra.run.smithi135.stdout:fi 2023-09-23T08:27:58.830 DEBUG:teuthology.orchestra.run.smithi135:> sudo rpm -qi grub2-tools 2023-09-23T08:27:58.909 INFO:teuthology.orchestra.run.smithi135.stdout:Name : grub2-tools 2023-09-23T08:27:58.909 INFO:teuthology.orchestra.run.smithi135.stdout:Epoch : 1 2023-09-23T08:27:58.909 INFO:teuthology.orchestra.run.smithi135.stdout:Version : 2.02 2023-09-23T08:27:58.909 INFO:teuthology.orchestra.run.smithi135.stdout:Release : 123.el8 2023-09-23T08:27:58.909 INFO:teuthology.orchestra.run.smithi135.stdout:Architecture: x86_64 2023-09-23T08:27:58.909 INFO:teuthology.orchestra.run.smithi135.stdout:Install Date: Thu 14 Jul 2022 06:22:19 PM UTC 2023-09-23T08:27:58.909 INFO:teuthology.orchestra.run.smithi135.stdout:Group : System Environment/Base 2023-09-23T08:27:58.909 INFO:teuthology.orchestra.run.smithi135.stdout:Size : 9265450 2023-09-23T08:27:58.909 INFO:teuthology.orchestra.run.smithi135.stdout:License : GPLv3+ 2023-09-23T08:27:58.909 INFO:teuthology.orchestra.run.smithi135.stdout:Signature : RSA/SHA256, Thu 31 Mar 2022 07:24:35 PM UTC, Key ID 199e2f91fd431d51 2023-09-23T08:27:58.910 INFO:teuthology.orchestra.run.smithi135.stdout:Source RPM : grub2-2.02-123.el8.src.rpm 2023-09-23T08:27:58.910 INFO:teuthology.orchestra.run.smithi135.stdout:Build Date : Mon 28 Mar 2022 02:12:09 PM UTC 2023-09-23T08:27:58.910 INFO:teuthology.orchestra.run.smithi135.stdout:Build Host : x86-vm-09.build.eng.bos.redhat.com 2023-09-23T08:27:58.910 INFO:teuthology.orchestra.run.smithi135.stdout:Relocations : (not relocatable) 2023-09-23T08:27:58.910 INFO:teuthology.orchestra.run.smithi135.stdout:Packager : Red Hat, Inc. 2023-09-23T08:27:58.910 INFO:teuthology.orchestra.run.smithi135.stdout:Vendor : Red Hat, Inc. 2023-09-23T08:27:58.910 INFO:teuthology.orchestra.run.smithi135.stdout:URL : http://www.gnu.org/software/grub/ 2023-09-23T08:27:58.910 INFO:teuthology.orchestra.run.smithi135.stdout:Summary : Support tools for GRUB. 2023-09-23T08:27:58.910 INFO:teuthology.orchestra.run.smithi135.stdout:Description : 2023-09-23T08:27:58.911 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-09-23T08:27:58.911 INFO:teuthology.orchestra.run.smithi135.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-09-23T08:27:58.911 INFO:teuthology.orchestra.run.smithi135.stdout:customizable bootloader with modular architecture. It supports a rich 2023-09-23T08:27:58.911 INFO:teuthology.orchestra.run.smithi135.stdout:variety of kernel formats, file systems, computer architectures and 2023-09-23T08:27:58.911 INFO:teuthology.orchestra.run.smithi135.stdout:hardware devices. 2023-09-23T08:27:58.911 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-09-23T08:27:58.911 INFO:teuthology.orchestra.run.smithi135.stdout:This subpackage provides tools for support of all platforms. 2023-09-23T08:27:58.912 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-09-23T08:27:58.912 INFO:teuthology.task.kernel:Updating grub on smithi135 to boot 6.5.0-rc7-gfef64f93da2b 2023-09-23T08:27:58.912 DEBUG:teuthology.orchestra.run.smithi135:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-09-23T08:28:00.152 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi082.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-09-23T08:28:00.152 DEBUG:teuthology.orchestra.run.smithi082:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-09-23T08:28:00.221 INFO:teuthology.orchestra.run.smithi082.stdout:/boot/System.map-6.5.0-rc7-gfef64f93da2b 2023-09-23T08:28:00.221 INFO:teuthology.orchestra.run.smithi082.stdout:/boot/config-6.5.0-rc7-gfef64f93da2b 2023-09-23T08:28:00.221 INFO:teuthology.orchestra.run.smithi082.stdout:/boot/vmlinuz-6.5.0-rc7-gfef64f93da2b 2023-09-23T08:28:00.221 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b 2023-09-23T08:28:00.222 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel 2023-09-23T08:28:00.222 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch 2023-09-23T08:28:00.222 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86 2023-09-23T08:28:00.222 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto 2023-09-23T08:28:00.222 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-09-23T08:28:00.222 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-09-23T08:28:00.222 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-09-23T08:28:00.222 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-09-23T08:28:00.222 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-09-23T08:28:00.222 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-09-23T08:28:00.222 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-09-23T08:28:00.223 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crc32c-intel.ko 2023-09-23T08:28:00.223 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-09-23T08:28:00.223 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-09-23T08:28:00.223 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-09-23T08:28:00.223 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-09-23T08:28:00.223 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-avx2.ko 2023-09-23T08:28:00.223 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-09-23T08:28:00.223 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-09-23T08:28:00.223 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-09-23T08:28:00.223 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-09-23T08:28:00.223 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-09-23T08:28:00.223 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-09-23T08:28:00.224 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-09-23T08:28:00.224 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel 2023-09-23T08:28:00.224 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu 2023-09-23T08:28:00.224 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu/mce 2023-09-23T08:28:00.224 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-09-23T08:28:00.224 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm 2023-09-23T08:28:00.224 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm-amd.ko 2023-09-23T08:28:00.224 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm-intel.ko 2023-09-23T08:28:00.224 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm.ko 2023-09-23T08:28:00.224 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto 2023-09-23T08:28:00.224 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/ansi_cprng.ko 2023-09-23T08:28:00.224 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/anubis.ko 2023-09-23T08:28:00.225 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/arc4.ko 2023-09-23T08:28:00.225 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx 2023-09-23T08:28:00.225 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_memcpy.ko 2023-09-23T08:28:00.225 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_pq.ko 2023-09-23T08:28:00.225 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_raid6_recov.ko 2023-09-23T08:28:00.225 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_tx.ko 2023-09-23T08:28:00.225 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_xor.ko 2023-09-23T08:28:00.225 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/raid6test.ko 2023-09-23T08:28:00.225 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/authenc.ko 2023-09-23T08:28:00.225 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/authencesn.ko 2023-09-23T08:28:00.225 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blake2b_generic.ko 2023-09-23T08:28:00.225 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blowfish_common.ko 2023-09-23T08:28:00.226 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blowfish_generic.ko 2023-09-23T08:28:00.226 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/camellia_generic.ko 2023-09-23T08:28:00.226 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast5_generic.ko 2023-09-23T08:28:00.226 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast6_generic.ko 2023-09-23T08:28:00.226 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast_common.ko 2023-09-23T08:28:00.226 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/ccm.ko 2023-09-23T08:28:00.226 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cmac.ko 2023-09-23T08:28:00.226 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crc32_generic.ko 2023-09-23T08:28:00.226 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crypto_engine.ko 2023-09-23T08:28:00.226 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crypto_user.ko 2023-09-23T08:28:00.226 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cts.ko 2023-09-23T08:28:00.227 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/des_generic.ko 2023-09-23T08:28:00.227 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/dh_generic.ko 2023-09-23T08:28:00.227 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/echainiv.ko 2023-09-23T08:28:00.227 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/essiv.ko 2023-09-23T08:28:00.227 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/fcrypt.ko 2023-09-23T08:28:00.227 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/khazad.ko 2023-09-23T08:28:00.227 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/lz4.ko 2023-09-23T08:28:00.227 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/lz4hc.ko 2023-09-23T08:28:00.227 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/md4.ko 2023-09-23T08:28:00.227 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/michael_mic.ko 2023-09-23T08:28:00.227 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/pcbc.ko 2023-09-23T08:28:00.227 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/pcrypt.ko 2023-09-23T08:28:00.227 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/rmd160.ko 2023-09-23T08:28:00.228 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/seed.ko 2023-09-23T08:28:00.228 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/serpent_generic.ko 2023-09-23T08:28:00.228 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/tcrypt.ko 2023-09-23T08:28:00.228 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/tea.ko 2023-09-23T08:28:00.228 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/twofish_common.ko 2023-09-23T08:28:00.228 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/twofish_generic.ko 2023-09-23T08:28:00.228 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/vmac.ko 2023-09-23T08:28:00.228 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/wp512.ko 2023-09-23T08:28:00.228 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xcbc.ko 2023-09-23T08:28:00.228 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xor.ko 2023-09-23T08:28:00.228 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xxhash_generic.ko 2023-09-23T08:28:00.228 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers 2023-09-23T08:28:00.229 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi 2023-09-23T08:28:00.229 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/acpi_ipmi.ko 2023-09-23T08:28:00.229 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/acpi_pad.ko 2023-09-23T08:28:00.229 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/custom_method.ko 2023-09-23T08:28:00.229 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/ec_sys.ko 2023-09-23T08:28:00.229 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/platform_profile.ko 2023-09-23T08:28:00.229 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/sbs.ko 2023-09-23T08:28:00.229 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/sbshc.ko 2023-09-23T08:28:00.229 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/video.ko 2023-09-23T08:28:00.229 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata 2023-09-23T08:28:00.229 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/acard-ahci.ko 2023-09-23T08:28:00.229 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/ahci_platform.ko 2023-09-23T08:28:00.230 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/ata_generic.ko 2023-09-23T08:28:00.230 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/libahci_platform.ko 2023-09-23T08:28:00.230 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_acpi.ko 2023-09-23T08:28:00.230 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ali.ko 2023-09-23T08:28:00.230 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_amd.ko 2023-09-23T08:28:00.230 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_artop.ko 2023-09-23T08:28:00.230 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_atiixp.ko 2023-09-23T08:28:00.230 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_atp867x.ko 2023-09-23T08:28:00.230 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cmd640.ko 2023-09-23T08:28:00.230 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cmd64x.ko 2023-09-23T08:28:00.230 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cypress.ko 2023-09-23T08:28:00.230 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_efar.ko 2023-09-23T08:28:00.231 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt366.ko 2023-09-23T08:28:00.231 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt37x.ko 2023-09-23T08:28:00.231 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt3x2n.ko 2023-09-23T08:28:00.231 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt3x3.ko 2023-09-23T08:28:00.231 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_it8213.ko 2023-09-23T08:28:00.231 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_it821x.ko 2023-09-23T08:28:00.231 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_jmicron.ko 2023-09-23T08:28:00.231 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_marvell.ko 2023-09-23T08:28:00.231 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_mpiix.ko 2023-09-23T08:28:00.231 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_netcell.ko 2023-09-23T08:28:00.231 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ninja32.ko 2023-09-23T08:28:00.231 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ns87410.ko 2023-09-23T08:28:00.232 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ns87415.ko 2023-09-23T08:28:00.232 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_oldpiix.ko 2023-09-23T08:28:00.232 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_opti.ko 2023-09-23T08:28:00.232 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_optidma.ko 2023-09-23T08:28:00.232 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pcmcia.ko 2023-09-23T08:28:00.232 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pdc2027x.ko 2023-09-23T08:28:00.232 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-09-23T08:28:00.232 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_piccolo.ko 2023-09-23T08:28:00.232 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_rdc.ko 2023-09-23T08:28:00.232 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sch.ko 2023-09-23T08:28:00.232 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_serverworks.ko 2023-09-23T08:28:00.232 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sil680.ko 2023-09-23T08:28:00.233 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sis.ko 2023-09-23T08:28:00.233 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sl82c105.ko 2023-09-23T08:28:00.233 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_triflex.ko 2023-09-23T08:28:00.233 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_via.ko 2023-09-23T08:28:00.233 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pdc_adma.ko 2023-09-23T08:28:00.233 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_inic162x.ko 2023-09-23T08:28:00.233 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_mv.ko 2023-09-23T08:28:00.233 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_nv.ko 2023-09-23T08:28:00.233 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_promise.ko 2023-09-23T08:28:00.233 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_qstor.ko 2023-09-23T08:28:00.233 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sil.ko 2023-09-23T08:28:00.233 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sil24.ko 2023-09-23T08:28:00.234 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sis.ko 2023-09-23T08:28:00.234 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_svw.ko 2023-09-23T08:28:00.234 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sx4.ko 2023-09-23T08:28:00.234 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_uli.ko 2023-09-23T08:28:00.234 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_via.ko 2023-09-23T08:28:00.234 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_vsc.ko 2023-09-23T08:28:00.234 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/auxdisplay 2023-09-23T08:28:00.234 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/auxdisplay/ks0108.ko 2023-09-23T08:28:00.234 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base 2023-09-23T08:28:00.234 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap 2023-09-23T08:28:00.234 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap/regmap-i2c.ko 2023-09-23T08:28:00.234 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap/regmap-mmio.ko 2023-09-23T08:28:00.235 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/bcma 2023-09-23T08:28:00.235 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/bcma/bcma.ko 2023-09-23T08:28:00.235 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block 2023-09-23T08:28:00.235 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/aoe 2023-09-23T08:28:00.235 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/aoe/aoe.ko 2023-09-23T08:28:00.235 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/brd.ko 2023-09-23T08:28:00.235 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/drbd 2023-09-23T08:28:00.235 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/drbd/drbd.ko 2023-09-23T08:28:00.235 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/floppy.ko 2023-09-23T08:28:00.235 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/loop.ko 2023-09-23T08:28:00.235 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/mtip32xx 2023-09-23T08:28:00.236 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-09-23T08:28:00.236 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/nbd.ko 2023-09-23T08:28:00.236 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/null_blk 2023-09-23T08:28:00.236 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/null_blk/null_blk.ko 2023-09-23T08:28:00.236 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/pktcdvd.ko 2023-09-23T08:28:00.236 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/rbd.ko 2023-09-23T08:28:00.236 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/virtio_blk.ko 2023-09-23T08:28:00.236 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkback 2023-09-23T08:28:00.236 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-09-23T08:28:00.236 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkfront.ko 2023-09-23T08:28:00.236 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/zram 2023-09-23T08:28:00.236 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/zram/zram.ko 2023-09-23T08:28:00.236 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char 2023-09-23T08:28:00.237 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hangcheck-timer.ko 2023-09-23T08:28:00.237 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random 2023-09-23T08:28:00.237 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/amd-rng.ko 2023-09-23T08:28:00.237 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/intel-rng.ko 2023-09-23T08:28:00.237 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-09-23T08:28:00.237 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/via-rng.ko 2023-09-23T08:28:00.237 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/virtio-rng.ko 2023-09-23T08:28:00.237 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi 2023-09-23T08:28:00.237 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-09-23T08:28:00.237 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-09-23T08:28:00.237 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-09-23T08:28:00.237 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_si.ko 2023-09-23T08:28:00.238 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-09-23T08:28:00.238 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-09-23T08:28:00.238 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/lp.ko 2023-09-23T08:28:00.238 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/mwave 2023-09-23T08:28:00.238 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/mwave/mwave.ko 2023-09-23T08:28:00.238 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ppdev.ko 2023-09-23T08:28:00.238 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tlclk.ko 2023-09-23T08:28:00.238 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm 2023-09-23T08:28:00.238 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm.ko 2023-09-23T08:28:00.238 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_atmel.ko 2023-09-23T08:28:00.238 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_infineon.ko 2023-09-23T08:28:00.239 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_nsc.ko 2023-09-23T08:28:00.239 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_tis.ko 2023-09-23T08:28:00.239 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-09-23T08:28:00.239 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/uv_mmtimer.ko 2023-09-23T08:28:00.239 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/virtio_console.ko 2023-09-23T08:28:00.239 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq 2023-09-23T08:28:00.239 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-09-23T08:28:00.239 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-09-23T08:28:00.239 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/p4-clockmod.ko 2023-09-23T08:28:00.239 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-09-23T08:28:00.239 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/powernow-k8.ko 2023-09-23T08:28:00.239 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/speedstep-lib.ko 2023-09-23T08:28:00.240 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto 2023-09-23T08:28:00.240 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp 2023-09-23T08:28:00.240 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-09-23T08:28:00.240 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp/ccp.ko 2023-09-23T08:28:00.240 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel 2023-09-23T08:28:00.240 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat 2023-09-23T08:28:00.240 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_common 2023-09-23T08:28:00.240 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-09-23T08:28:00.240 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-09-23T08:28:00.240 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-09-23T08:28:00.240 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/padlock-aes.ko 2023-09-23T08:28:00.240 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/padlock-sha.ko 2023-09-23T08:28:00.240 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/virtio 2023-09-23T08:28:00.241 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-09-23T08:28:00.241 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dca 2023-09-23T08:28:00.241 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dca/dca.ko 2023-09-23T08:28:00.241 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/devfreq 2023-09-23T08:28:00.241 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-09-23T08:28:00.241 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma 2023-09-23T08:28:00.241 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/dw 2023-09-23T08:28:00.241 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/dw/dw_dmac.ko 2023-09-23T08:28:00.241 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/ioat 2023-09-23T08:28:00.241 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/ioat/ioatdma.ko 2023-09-23T08:28:00.241 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac 2023-09-23T08:28:00.241 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/amd64_edac.ko 2023-09-23T08:28:00.242 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/e752x_edac.ko 2023-09-23T08:28:00.242 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/edac_mce_amd.ko 2023-09-23T08:28:00.242 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i3000_edac.ko 2023-09-23T08:28:00.242 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i3200_edac.ko 2023-09-23T08:28:00.242 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i5100_edac.ko 2023-09-23T08:28:00.242 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i5400_edac.ko 2023-09-23T08:28:00.242 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i7300_edac.ko 2023-09-23T08:28:00.242 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i7core_edac.ko 2023-09-23T08:28:00.242 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i82975x_edac.ko 2023-09-23T08:28:00.242 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/ie31200_edac.ko 2023-09-23T08:28:00.242 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/sb_edac.ko 2023-09-23T08:28:00.242 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/x38_edac.ko 2023-09-23T08:28:00.243 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware 2023-09-23T08:28:00.243 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/edd.ko 2023-09-23T08:28:00.243 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/iscsi_ibft.ko 2023-09-23T08:28:00.243 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio 2023-09-23T08:28:00.243 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-ich.ko 2023-09-23T08:28:00.243 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-viperboard.ko 2023-09-23T08:28:00.243 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid 2023-09-23T08:28:00.243 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-appleir.ko 2023-09-23T08:28:00.243 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-aureal.ko 2023-09-23T08:28:00.243 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-axff.ko 2023-09-23T08:28:00.243 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-dr.ko 2023-09-23T08:28:00.243 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-elecom.ko 2023-09-23T08:28:00.244 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-elo.ko 2023-09-23T08:28:00.244 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-emsff.ko 2023-09-23T08:28:00.244 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gaff.ko 2023-09-23T08:28:00.244 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gt683r.ko 2023-09-23T08:28:00.244 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gyration.ko 2023-09-23T08:28:00.244 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtek-kbd.ko 2023-09-23T08:28:00.244 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtek-mouse.ko 2023-09-23T08:28:00.244 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtekff.ko 2023-09-23T08:28:00.244 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-hyperv.ko 2023-09-23T08:28:00.244 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-icade.ko 2023-09-23T08:28:00.244 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-keytouch.ko 2023-09-23T08:28:00.244 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-kye.ko 2023-09-23T08:28:00.244 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-lcpower.ko 2023-09-23T08:28:00.245 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-led.ko 2023-09-23T08:28:00.245 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-lenovo.ko 2023-09-23T08:28:00.245 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-logitech-dj.ko 2023-09-23T08:28:00.245 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-09-23T08:28:00.245 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-multitouch.ko 2023-09-23T08:28:00.245 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-ortek.ko 2023-09-23T08:28:00.245 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-penmount.ko 2023-09-23T08:28:00.245 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-petalynx.ko 2023-09-23T08:28:00.245 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-picolcd.ko 2023-09-23T08:28:00.245 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-pl.ko 2023-09-23T08:28:00.245 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-plantronics.ko 2023-09-23T08:28:00.245 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-primax.ko 2023-09-23T08:28:00.246 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-rmi.ko 2023-09-23T08:28:00.246 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-arvo.ko 2023-09-23T08:28:00.246 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-common.ko 2023-09-23T08:28:00.246 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-isku.ko 2023-09-23T08:28:00.246 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-kone.ko 2023-09-23T08:28:00.246 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-09-23T08:28:00.246 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-konepure.ko 2023-09-23T08:28:00.246 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-09-23T08:28:00.246 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-lua.ko 2023-09-23T08:28:00.246 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-pyra.ko 2023-09-23T08:28:00.246 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-ryos.ko 2023-09-23T08:28:00.247 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-savu.ko 2023-09-23T08:28:00.247 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat.ko 2023-09-23T08:28:00.247 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-saitek.ko 2023-09-23T08:28:00.247 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-samsung.ko 2023-09-23T08:28:00.247 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sensor-hub.ko 2023-09-23T08:28:00.247 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sjoy.ko 2023-09-23T08:28:00.247 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sony.ko 2023-09-23T08:28:00.247 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-speedlink.ko 2023-09-23T08:28:00.247 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-steelseries.ko 2023-09-23T08:28:00.247 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sunplus.ko 2023-09-23T08:28:00.247 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-thrustmaster.ko 2023-09-23T08:28:00.247 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-tivo.ko 2023-09-23T08:28:00.248 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-tmff.ko 2023-09-23T08:28:00.248 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-topseed.ko 2023-09-23T08:28:00.248 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-twinhan.ko 2023-09-23T08:28:00.248 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-uclogic.ko 2023-09-23T08:28:00.248 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-waltop.ko 2023-09-23T08:28:00.248 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-wiimote.ko 2023-09-23T08:28:00.248 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-xinmo.ko 2023-09-23T08:28:00.248 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-zpff.ko 2023-09-23T08:28:00.248 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-zydacron.ko 2023-09-23T08:28:00.248 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/uhid.ko 2023-09-23T08:28:00.248 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/wacom.ko 2023-09-23T08:28:00.248 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv 2023-09-23T08:28:00.249 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_balloon.ko 2023-09-23T08:28:00.249 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_utils.ko 2023-09-23T08:28:00.249 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_vmbus.ko 2023-09-23T08:28:00.249 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon 2023-09-23T08:28:00.249 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/abituguru.ko 2023-09-23T08:28:00.249 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/abituguru3.ko 2023-09-23T08:28:00.249 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/acpi_power_meter.ko 2023-09-23T08:28:00.249 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ad7414.ko 2023-09-23T08:28:00.249 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ad7418.ko 2023-09-23T08:28:00.249 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adc128d818.ko 2023-09-23T08:28:00.249 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1025.ko 2023-09-23T08:28:00.249 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1026.ko 2023-09-23T08:28:00.249 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1029.ko 2023-09-23T08:28:00.250 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1031.ko 2023-09-23T08:28:00.250 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm9240.ko 2023-09-23T08:28:00.250 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ads7828.ko 2023-09-23T08:28:00.250 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7410.ko 2023-09-23T08:28:00.250 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7411.ko 2023-09-23T08:28:00.250 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7462.ko 2023-09-23T08:28:00.250 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7470.ko 2023-09-23T08:28:00.250 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7475.ko 2023-09-23T08:28:00.250 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7x10.ko 2023-09-23T08:28:00.250 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/amc6821.ko 2023-09-23T08:28:00.250 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/applesmc.ko 2023-09-23T08:28:00.250 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asb100.ko 2023-09-23T08:28:00.251 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asc7621.ko 2023-09-23T08:28:00.251 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asus_atk0110.ko 2023-09-23T08:28:00.251 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/atxp1.ko 2023-09-23T08:28:00.251 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/coretemp.ko 2023-09-23T08:28:00.251 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-09-23T08:28:00.251 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/dme1737.ko 2023-09-23T08:28:00.251 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ds1621.ko 2023-09-23T08:28:00.251 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ds620.ko 2023-09-23T08:28:00.251 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/emc1403.ko 2023-09-23T08:28:00.251 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/emc6w201.ko 2023-09-23T08:28:00.251 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f71805f.ko 2023-09-23T08:28:00.251 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f71882fg.ko 2023-09-23T08:28:00.252 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f75375s.ko 2023-09-23T08:28:00.252 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/fam15h_power.ko 2023-09-23T08:28:00.252 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/fschmd.ko 2023-09-23T08:28:00.252 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/g760a.ko 2023-09-23T08:28:00.252 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/g762.ko 2023-09-23T08:28:00.252 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/gl518sm.ko 2023-09-23T08:28:00.252 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/gl520sm.ko 2023-09-23T08:28:00.252 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/hwmon-vid.ko 2023-09-23T08:28:00.252 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/i5500_temp.ko 2023-09-23T08:28:00.252 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/i5k_amb.ko 2023-09-23T08:28:00.252 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ibmaem.ko 2023-09-23T08:28:00.252 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ibmpex.ko 2023-09-23T08:28:00.253 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ina209.ko 2023-09-23T08:28:00.253 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ina2xx.ko 2023-09-23T08:28:00.253 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/it87.ko 2023-09-23T08:28:00.253 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/k10temp.ko 2023-09-23T08:28:00.253 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/k8temp.ko 2023-09-23T08:28:00.253 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lineage-pem.ko 2023-09-23T08:28:00.253 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm63.ko 2023-09-23T08:28:00.253 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm73.ko 2023-09-23T08:28:00.253 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm75.ko 2023-09-23T08:28:00.253 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm77.ko 2023-09-23T08:28:00.253 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm78.ko 2023-09-23T08:28:00.253 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm80.ko 2023-09-23T08:28:00.254 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm83.ko 2023-09-23T08:28:00.254 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm85.ko 2023-09-23T08:28:00.254 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm87.ko 2023-09-23T08:28:00.254 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm90.ko 2023-09-23T08:28:00.254 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm92.ko 2023-09-23T08:28:00.254 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm93.ko 2023-09-23T08:28:00.254 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95234.ko 2023-09-23T08:28:00.254 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95241.ko 2023-09-23T08:28:00.254 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95245.ko 2023-09-23T08:28:00.254 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc2945.ko 2023-09-23T08:28:00.254 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4151.ko 2023-09-23T08:28:00.254 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4215.ko 2023-09-23T08:28:00.255 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4222.ko 2023-09-23T08:28:00.255 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4245.ko 2023-09-23T08:28:00.255 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4260.ko 2023-09-23T08:28:00.255 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4261.ko 2023-09-23T08:28:00.255 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max16065.ko 2023-09-23T08:28:00.255 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max1619.ko 2023-09-23T08:28:00.255 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max1668.ko 2023-09-23T08:28:00.255 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max197.ko 2023-09-23T08:28:00.255 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6639.ko 2023-09-23T08:28:00.255 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6650.ko 2023-09-23T08:28:00.255 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6697.ko 2023-09-23T08:28:00.255 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/mcp3021.ko 2023-09-23T08:28:00.255 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6683.ko 2023-09-23T08:28:00.256 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6775-core.ko 2023-09-23T08:28:00.256 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6775.ko 2023-09-23T08:28:00.256 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct7802.ko 2023-09-23T08:28:00.256 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pc87360.ko 2023-09-23T08:28:00.256 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pc87427.ko 2023-09-23T08:28:00.256 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pcf8591.ko 2023-09-23T08:28:00.256 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus 2023-09-23T08:28:00.256 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-09-23T08:28:00.256 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-09-23T08:28:00.256 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-09-23T08:28:00.256 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max16064.ko 2023-09-23T08:28:00.256 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max34440.ko 2023-09-23T08:28:00.257 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max8688.ko 2023-09-23T08:28:00.257 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-09-23T08:28:00.257 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-09-23T08:28:00.257 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-09-23T08:28:00.257 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-09-23T08:28:00.257 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-09-23T08:28:00.257 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-09-23T08:28:00.257 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/powr1220.ko 2023-09-23T08:28:00.257 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch5627.ko 2023-09-23T08:28:00.257 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch5636.ko 2023-09-23T08:28:00.257 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch56xx-common.ko 2023-09-23T08:28:00.257 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sht15.ko 2023-09-23T08:28:00.258 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sht21.ko 2023-09-23T08:28:00.258 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/shtc1.ko 2023-09-23T08:28:00.258 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sis5595.ko 2023-09-23T08:28:00.258 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47b397.ko 2023-09-23T08:28:00.258 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47m1.ko 2023-09-23T08:28:00.258 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47m192.ko 2023-09-23T08:28:00.258 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/thmc50.ko 2023-09-23T08:28:00.258 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp102.ko 2023-09-23T08:28:00.258 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp103.ko 2023-09-23T08:28:00.258 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp401.ko 2023-09-23T08:28:00.258 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp421.ko 2023-09-23T08:28:00.258 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/via-cputemp.ko 2023-09-23T08:28:00.259 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/via686a.ko 2023-09-23T08:28:00.259 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/vt1211.ko 2023-09-23T08:28:00.259 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/vt8231.ko 2023-09-23T08:28:00.259 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83627ehf.ko 2023-09-23T08:28:00.259 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83627hf.ko 2023-09-23T08:28:00.259 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83781d.ko 2023-09-23T08:28:00.259 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83791d.ko 2023-09-23T08:28:00.259 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83792d.ko 2023-09-23T08:28:00.259 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83793.ko 2023-09-23T08:28:00.259 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83795.ko 2023-09-23T08:28:00.259 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83l785ts.ko 2023-09-23T08:28:00.259 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83l786ng.ko 2023-09-23T08:28:00.260 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c 2023-09-23T08:28:00.260 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos 2023-09-23T08:28:00.260 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-09-23T08:28:00.260 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-09-23T08:28:00.260 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses 2023-09-23T08:28:00.260 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-09-23T08:28:00.260 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-09-23T08:28:00.260 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-09-23T08:28:00.260 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-09-23T08:28:00.260 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-09-23T08:28:00.260 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-09-23T08:28:00.260 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-09-23T08:28:00.261 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-09-23T08:28:00.261 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-i801.ko 2023-09-23T08:28:00.261 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-isch.ko 2023-09-23T08:28:00.261 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-09-23T08:28:00.261 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-09-23T08:28:00.261 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-09-23T08:28:00.261 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-parport.ko 2023-09-23T08:28:00.261 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-09-23T08:28:00.261 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-09-23T08:28:00.261 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-09-23T08:28:00.261 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-09-23T08:28:00.261 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-09-23T08:28:00.261 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-09-23T08:28:00.262 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-via.ko 2023-09-23T08:28:00.262 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-09-23T08:28:00.262 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-09-23T08:28:00.262 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-dev.ko 2023-09-23T08:28:00.262 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-mux.ko 2023-09-23T08:28:00.262 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-09-23T08:28:00.262 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-smbus.ko 2023-09-23T08:28:00.262 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-stub.ko 2023-09-23T08:28:00.262 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband 2023-09-23T08:28:00.262 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core 2023-09-23T08:28:00.262 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_cm.ko 2023-09-23T08:28:00.262 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_core.ko 2023-09-23T08:28:00.263 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_umad.ko 2023-09-23T08:28:00.263 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-09-23T08:28:00.263 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/iw_cm.ko 2023-09-23T08:28:00.263 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/rdma_cm.ko 2023-09-23T08:28:00.263 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-09-23T08:28:00.263 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw 2023-09-23T08:28:00.263 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/cxgb4 2023-09-23T08:28:00.263 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-09-23T08:28:00.263 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx4 2023-09-23T08:28:00.263 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-09-23T08:28:00.263 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx5 2023-09-23T08:28:00.263 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-09-23T08:28:00.264 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mthca 2023-09-23T08:28:00.264 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-09-23T08:28:00.264 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp 2023-09-23T08:28:00.264 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/ipoib 2023-09-23T08:28:00.264 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-09-23T08:28:00.264 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/iser 2023-09-23T08:28:00.264 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-09-23T08:28:00.264 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/isert 2023-09-23T08:28:00.264 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-09-23T08:28:00.264 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srp 2023-09-23T08:28:00.264 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-09-23T08:28:00.264 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srpt 2023-09-23T08:28:00.265 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-09-23T08:28:00.265 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input 2023-09-23T08:28:00.265 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport 2023-09-23T08:28:00.265 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-09-23T08:28:00.265 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/fm801-gp.ko 2023-09-23T08:28:00.265 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/gameport.ko 2023-09-23T08:28:00.265 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/lightning.ko 2023-09-23T08:28:00.265 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/ns558.ko 2023-09-23T08:28:00.265 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/joydev.ko 2023-09-23T08:28:00.265 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard 2023-09-23T08:28:00.265 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/gpio_keys.ko 2023-09-23T08:28:00.265 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse 2023-09-23T08:28:00.265 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/appletouch.ko 2023-09-23T08:28:00.266 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/bcm5974.ko 2023-09-23T08:28:00.266 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/cyapatp.ko 2023-09-23T08:28:00.266 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/elan_i2c.ko 2023-09-23T08:28:00.266 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/sermouse.ko 2023-09-23T08:28:00.266 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-09-23T08:28:00.266 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/synaptics_usb.ko 2023-09-23T08:28:00.266 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/vsxxxaa.ko 2023-09-23T08:28:00.266 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/rmi4 2023-09-23T08:28:00.266 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/rmi4/rmi_core.ko 2023-09-23T08:28:00.266 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio 2023-09-23T08:28:00.266 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/altera_ps2.ko 2023-09-23T08:28:00.266 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/arc_ps2.ko 2023-09-23T08:28:00.267 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-09-23T08:28:00.267 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/serio_raw.ko 2023-09-23T08:28:00.267 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/sparse-keymap.ko 2023-09-23T08:28:00.267 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu 2023-09-23T08:28:00.267 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu/amd 2023-09-23T08:28:00.267 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu/amd/iommu_v2.ko 2023-09-23T08:28:00.267 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds 2023-09-23T08:28:00.267 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-blinkm.ko 2023-09-23T08:28:00.267 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lm3530.ko 2023-09-23T08:28:00.267 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lp3944.ko 2023-09-23T08:28:00.267 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-ss4200.ko 2023-09-23T08:28:00.267 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger 2023-09-23T08:28:00.268 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-09-23T08:28:00.268 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-09-23T08:28:00.268 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-09-23T08:28:00.268 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-09-23T08:28:00.268 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-09-23T08:28:00.268 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-09-23T08:28:00.268 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-09-23T08:28:00.268 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-09-23T08:28:00.268 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md 2023-09-23T08:28:00.268 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/bcache 2023-09-23T08:28:00.268 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/bcache/bcache.ko 2023-09-23T08:28:00.268 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-bio-prison.ko 2023-09-23T08:28:00.268 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-cache-smq.ko 2023-09-23T08:28:00.269 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-cache.ko 2023-09-23T08:28:00.269 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-crypt.ko 2023-09-23T08:28:00.269 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-delay.ko 2023-09-23T08:28:00.269 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-flakey.ko 2023-09-23T08:28:00.269 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-log-userspace.ko 2023-09-23T08:28:00.269 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-multipath.ko 2023-09-23T08:28:00.269 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-queue-length.ko 2023-09-23T08:28:00.269 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-raid.ko 2023-09-23T08:28:00.269 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-round-robin.ko 2023-09-23T08:28:00.269 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-service-time.ko 2023-09-23T08:28:00.269 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-switch.ko 2023-09-23T08:28:00.269 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-thin-pool.ko 2023-09-23T08:28:00.270 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-verity.ko 2023-09-23T08:28:00.270 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/faulty.ko 2023-09-23T08:28:00.270 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/linear.ko 2023-09-23T08:28:00.270 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/multipath.ko 2023-09-23T08:28:00.270 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/persistent-data 2023-09-23T08:28:00.270 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-09-23T08:28:00.270 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid0.ko 2023-09-23T08:28:00.270 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid1.ko 2023-09-23T08:28:00.270 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid10.ko 2023-09-23T08:28:00.270 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid456.ko 2023-09-23T08:28:00.270 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message 2023-09-23T08:28:00.270 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion 2023-09-23T08:28:00.271 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptbase.ko 2023-09-23T08:28:00.271 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptctl.ko 2023-09-23T08:28:00.271 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptfc.ko 2023-09-23T08:28:00.271 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptlan.ko 2023-09-23T08:28:00.271 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptsas.ko 2023-09-23T08:28:00.271 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptscsih.ko 2023-09-23T08:28:00.271 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptspi.ko 2023-09-23T08:28:00.271 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd 2023-09-23T08:28:00.271 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lpc_ich.ko 2023-09-23T08:28:00.271 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lpc_sch.ko 2023-09-23T08:28:00.271 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/mfd-core.ko 2023-09-23T08:28:00.271 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/sm501.ko 2023-09-23T08:28:00.272 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/viperboard.ko 2023-09-23T08:28:00.272 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/vx855.ko 2023-09-23T08:28:00.272 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/wl1273-core.ko 2023-09-23T08:28:00.272 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc 2023-09-23T08:28:00.272 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/altera-stapl 2023-09-23T08:28:00.272 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-09-23T08:28:00.272 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/apds9802als.ko 2023-09-23T08:28:00.272 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/apds990x.ko 2023-09-23T08:28:00.272 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/bh1770glc.ko 2023-09-23T08:28:00.272 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/cb710 2023-09-23T08:28:00.272 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/cb710/cb710.ko 2023-09-23T08:28:00.272 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom 2023-09-23T08:28:00.273 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/at24.ko 2023-09-23T08:28:00.273 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/eeprom.ko 2023-09-23T08:28:00.273 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-09-23T08:28:00.273 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/max6875.ko 2023-09-23T08:28:00.273 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/enclosure.ko 2023-09-23T08:28:00.273 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/hpilo.ko 2023-09-23T08:28:00.273 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/isl29003.ko 2023-09-23T08:28:00.273 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/isl29020.ko 2023-09-23T08:28:00.273 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d 2023-09-23T08:28:00.273 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-09-23T08:28:00.273 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-09-23T08:28:00.273 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei 2023-09-23T08:28:00.274 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei-me.ko 2023-09-23T08:28:00.274 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei-txe.ko 2023-09-23T08:28:00.274 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei.ko 2023-09-23T08:28:00.274 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-gru 2023-09-23T08:28:00.274 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-gru/gru.ko 2023-09-23T08:28:00.274 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp 2023-09-23T08:28:00.274 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xp.ko 2023-09-23T08:28:00.274 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xpc.ko 2023-09-23T08:28:00.274 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-09-23T08:28:00.274 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tifm_7xx1.ko 2023-09-23T08:28:00.274 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tifm_core.ko 2023-09-23T08:28:00.274 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tsl2550.ko 2023-09-23T08:28:00.275 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_balloon.ko 2023-09-23T08:28:00.275 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_vmci 2023-09-23T08:28:00.275 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-09-23T08:28:00.275 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net 2023-09-23T08:28:00.275 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/bonding 2023-09-23T08:28:00.275 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/bonding/bonding.ko 2023-09-23T08:28:00.275 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa 2023-09-23T08:28:00.275 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/b53 2023-09-23T08:28:00.275 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/b53/b53_common.ko 2023-09-23T08:28:00.275 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/bcm-sf2.ko 2023-09-23T08:28:00.275 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6060.ko 2023-09-23T08:28:00.275 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6xxx 2023-09-23T08:28:00.275 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-09-23T08:28:00.276 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dummy.ko 2023-09-23T08:28:00.276 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/eql.ko 2023-09-23T08:28:00.276 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet 2023-09-23T08:28:00.276 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com 2023-09-23T08:28:00.276 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-09-23T08:28:00.276 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-09-23T08:28:00.276 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-09-23T08:28:00.276 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-09-23T08:28:00.276 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390 2023-09-23T08:28:00.276 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/8390.ko 2023-09-23T08:28:00.276 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-09-23T08:28:00.276 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-09-23T08:28:00.277 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-09-23T08:28:00.277 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/adaptec 2023-09-23T08:28:00.277 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-09-23T08:28:00.277 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/agere 2023-09-23T08:28:00.277 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/agere/et131x.ko 2023-09-23T08:28:00.277 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/alteon 2023-09-23T08:28:00.277 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-09-23T08:28:00.277 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/altera 2023-09-23T08:28:00.277 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-09-23T08:28:00.277 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd 2023-09-23T08:28:00.277 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-09-23T08:28:00.277 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-09-23T08:28:00.278 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-09-23T08:28:00.278 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros 2023-09-23T08:28:00.278 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/alx 2023-09-23T08:28:00.278 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-09-23T08:28:00.278 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1c 2023-09-23T08:28:00.278 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-09-23T08:28:00.278 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1e 2023-09-23T08:28:00.278 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-09-23T08:28:00.278 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx 2023-09-23T08:28:00.278 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-09-23T08:28:00.278 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-09-23T08:28:00.278 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom 2023-09-23T08:28:00.279 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-09-23T08:28:00.279 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-09-23T08:28:00.279 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-09-23T08:28:00.279 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-09-23T08:28:00.279 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-09-23T08:28:00.279 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/genet 2023-09-23T08:28:00.279 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-09-23T08:28:00.279 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-09-23T08:28:00.279 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade 2023-09-23T08:28:00.279 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade/bna 2023-09-23T08:28:00.279 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-09-23T08:28:00.279 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio 2023-09-23T08:28:00.280 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb 2023-09-23T08:28:00.280 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-09-23T08:28:00.280 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-09-23T08:28:00.280 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-09-23T08:28:00.280 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-09-23T08:28:00.280 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-09-23T08:28:00.280 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-09-23T08:28:00.280 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-09-23T08:28:00.280 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-09-23T08:28:00.280 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-09-23T08:28:00.280 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco 2023-09-23T08:28:00.280 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco/enic 2023-09-23T08:28:00.281 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-09-23T08:28:00.281 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec 2023-09-23T08:28:00.281 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip 2023-09-23T08:28:00.281 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-09-23T08:28:00.281 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-09-23T08:28:00.281 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-09-23T08:28:00.281 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-09-23T08:28:00.281 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-09-23T08:28:00.281 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-09-23T08:28:00.281 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink 2023-09-23T08:28:00.281 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-09-23T08:28:00.281 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-09-23T08:28:00.281 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dnet.ko 2023-09-23T08:28:00.282 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex 2023-09-23T08:28:00.282 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex/benet 2023-09-23T08:28:00.282 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-09-23T08:28:00.282 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ethoc.ko 2023-09-23T08:28:00.282 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/fealnx.ko 2023-09-23T08:28:00.282 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel 2023-09-23T08:28:00.282 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e100.ko 2023-09-23T08:28:00.282 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000 2023-09-23T08:28:00.282 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-09-23T08:28:00.282 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000e 2023-09-23T08:28:00.282 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-09-23T08:28:00.282 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/fm10k 2023-09-23T08:28:00.283 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-09-23T08:28:00.283 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/i40e 2023-09-23T08:28:00.283 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-09-23T08:28:00.283 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/iavf 2023-09-23T08:28:00.283 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-09-23T08:28:00.283 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igb 2023-09-23T08:28:00.283 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-09-23T08:28:00.283 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igbvf 2023-09-23T08:28:00.283 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-09-23T08:28:00.283 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbe 2023-09-23T08:28:00.283 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-09-23T08:28:00.283 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbevf 2023-09-23T08:28:00.284 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-09-23T08:28:00.284 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/jme.ko 2023-09-23T08:28:00.284 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell 2023-09-23T08:28:00.284 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-09-23T08:28:00.284 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/skge.ko 2023-09-23T08:28:00.284 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-09-23T08:28:00.284 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox 2023-09-23T08:28:00.284 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4 2023-09-23T08:28:00.284 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-09-23T08:28:00.284 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-09-23T08:28:00.284 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5 2023-09-23T08:28:00.284 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-09-23T08:28:00.285 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-09-23T08:28:00.285 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel 2023-09-23T08:28:00.285 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-09-23T08:28:00.285 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom 2023-09-23T08:28:00.285 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom/myri10ge 2023-09-23T08:28:00.285 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-09-23T08:28:00.285 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi 2023-09-23T08:28:00.285 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-09-23T08:28:00.285 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-09-23T08:28:00.285 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/neterion 2023-09-23T08:28:00.285 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-09-23T08:28:00.285 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/nvidia 2023-09-23T08:28:00.285 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-09-23T08:28:00.286 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines 2023-09-23T08:28:00.286 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-09-23T08:28:00.286 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-09-23T08:28:00.286 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic 2023-09-23T08:28:00.286 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/netxen 2023-09-23T08:28:00.286 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-09-23T08:28:00.286 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-09-23T08:28:00.286 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-09-23T08:28:00.286 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-09-23T08:28:00.286 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rdc 2023-09-23T08:28:00.286 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-09-23T08:28:00.286 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek 2023-09-23T08:28:00.287 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-09-23T08:28:00.287 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-09-23T08:28:00.287 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/atp.ko 2023-09-23T08:28:00.287 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-09-23T08:28:00.287 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rocker 2023-09-23T08:28:00.287 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-09-23T08:28:00.287 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sfc 2023-09-23T08:28:00.287 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-09-23T08:28:00.287 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/silan 2023-09-23T08:28:00.287 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-09-23T08:28:00.287 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis 2023-09-23T08:28:00.287 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis/sis190.ko 2023-09-23T08:28:00.288 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis/sis900.ko 2023-09-23T08:28:00.288 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc 2023-09-23T08:28:00.288 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-09-23T08:28:00.288 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-09-23T08:28:00.288 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-09-23T08:28:00.288 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-09-23T08:28:00.288 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro 2023-09-23T08:28:00.288 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac 2023-09-23T08:28:00.288 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-09-23T08:28:00.288 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-09-23T08:28:00.288 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun 2023-09-23T08:28:00.288 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/cassini.ko 2023-09-23T08:28:00.289 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/niu.ko 2023-09-23T08:28:00.289 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/sungem.ko 2023-09-23T08:28:00.289 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-09-23T08:28:00.289 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/tehuti 2023-09-23T08:28:00.289 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-09-23T08:28:00.289 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ti 2023-09-23T08:28:00.289 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ti/tlan.ko 2023-09-23T08:28:00.289 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via 2023-09-23T08:28:00.289 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-09-23T08:28:00.289 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-09-23T08:28:00.289 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet 2023-09-23T08:28:00.289 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-09-23T08:28:00.289 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-09-23T08:28:00.290 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/xircom 2023-09-23T08:28:00.290 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-09-23T08:28:00.290 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/geneve.ko 2023-09-23T08:28:00.290 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/hyperv 2023-09-23T08:28:00.290 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-09-23T08:28:00.290 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ieee802154 2023-09-23T08:28:00.290 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ieee802154/fakelb.ko 2023-09-23T08:28:00.290 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ifb.ko 2023-09-23T08:28:00.290 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ipvlan 2023-09-23T08:28:00.290 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ipvlan/ipvlan.ko 2023-09-23T08:28:00.290 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/macvlan.ko 2023-09-23T08:28:00.290 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/macvtap.ko 2023-09-23T08:28:00.291 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio 2023-09-23T08:28:00.291 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio.ko 2023-09-23T08:28:00.291 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-09-23T08:28:00.291 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-09-23T08:28:00.291 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-regmap.ko 2023-09-23T08:28:00.291 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mii.ko 2023-09-23T08:28:00.291 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/net_failover.ko 2023-09-23T08:28:00.291 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/netconsole.ko 2023-09-23T08:28:00.291 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/nlmon.ko 2023-09-23T08:28:00.291 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs 2023-09-23T08:28:00.291 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs/pcs-lynx.ko 2023-09-23T08:28:00.291 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-09-23T08:28:00.292 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy 2023-09-23T08:28:00.292 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/amd.ko 2023-09-23T08:28:00.292 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-09-23T08:28:00.292 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-09-23T08:28:00.292 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm7xxx.ko 2023-09-23T08:28:00.292 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm87xx.ko 2023-09-23T08:28:00.292 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/broadcom.ko 2023-09-23T08:28:00.292 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/cicada.ko 2023-09-23T08:28:00.292 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/davicom.ko 2023-09-23T08:28:00.292 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/dp83640.ko 2023-09-23T08:28:00.292 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/et1011c.ko 2023-09-23T08:28:00.292 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/icplus.ko 2023-09-23T08:28:00.293 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/lxt.ko 2023-09-23T08:28:00.293 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/marvell.ko 2023-09-23T08:28:00.293 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/micrel.ko 2023-09-23T08:28:00.293 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/national.ko 2023-09-23T08:28:00.293 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/phylink.ko 2023-09-23T08:28:00.293 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/qsemi.ko 2023-09-23T08:28:00.293 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/realtek.ko 2023-09-23T08:28:00.293 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/smsc.ko 2023-09-23T08:28:00.293 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/ste10Xp.ko 2023-09-23T08:28:00.293 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/vitesse.ko 2023-09-23T08:28:00.293 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp 2023-09-23T08:28:00.293 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/bsd_comp.ko 2023-09-23T08:28:00.294 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_async.ko 2023-09-23T08:28:00.294 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_deflate.ko 2023-09-23T08:28:00.294 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_generic.ko 2023-09-23T08:28:00.294 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_mppe.ko 2023-09-23T08:28:00.294 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_synctty.ko 2023-09-23T08:28:00.294 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pppoe.ko 2023-09-23T08:28:00.294 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pppox.ko 2023-09-23T08:28:00.294 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pptp.ko 2023-09-23T08:28:00.294 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip 2023-09-23T08:28:00.294 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip/slhc.ko 2023-09-23T08:28:00.294 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip/slip.ko 2023-09-23T08:28:00.295 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/sungem_phy.ko 2023-09-23T08:28:00.295 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/tap.ko 2023-09-23T08:28:00.295 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team 2023-09-23T08:28:00.295 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team.ko 2023-09-23T08:28:00.295 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_activebackup.ko 2023-09-23T08:28:00.295 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_broadcast.ko 2023-09-23T08:28:00.295 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-09-23T08:28:00.295 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_random.ko 2023-09-23T08:28:00.295 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-09-23T08:28:00.295 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/tun.ko 2023-09-23T08:28:00.295 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/veth.ko 2023-09-23T08:28:00.295 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/virtio_net.ko 2023-09-23T08:28:00.295 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vmxnet3 2023-09-23T08:28:00.296 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-09-23T08:28:00.296 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vxlan 2023-09-23T08:28:00.296 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vxlan/vxlan.ko 2023-09-23T08:28:00.296 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netback 2023-09-23T08:28:00.296 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netback/xen-netback.ko 2023-09-23T08:28:00.296 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netfront.ko 2023-09-23T08:28:00.296 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ntb 2023-09-23T08:28:00.296 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ntb/ntb.ko 2023-09-23T08:28:00.296 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme 2023-09-23T08:28:00.296 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host 2023-09-23T08:28:00.296 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host/nvme-core.ko 2023-09-23T08:28:00.296 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host/nvme.ko 2023-09-23T08:28:00.297 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport 2023-09-23T08:28:00.297 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport.ko 2023-09-23T08:28:00.297 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_cs.ko 2023-09-23T08:28:00.297 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_pc.ko 2023-09-23T08:28:00.297 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_serial.ko 2023-09-23T08:28:00.297 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci 2023-09-23T08:28:00.297 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug 2023-09-23T08:28:00.297 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-09-23T08:28:00.297 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/pcie 2023-09-23T08:28:00.297 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/pcie/aer_inject.ko 2023-09-23T08:28:00.297 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/xen-pcifront.ko 2023-09-23T08:28:00.297 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia 2023-09-23T08:28:00.298 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/i82092.ko 2023-09-23T08:28:00.298 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/pd6729.ko 2023-09-23T08:28:00.298 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/yenta_socket.ko 2023-09-23T08:28:00.298 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl 2023-09-23T08:28:00.298 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl/intel 2023-09-23T08:28:00.298 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-09-23T08:28:00.298 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform 2023-09-23T08:28:00.298 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86 2023-09-23T08:28:00.298 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/acer-wmi.ko 2023-09-23T08:28:00.298 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/acerhdf.ko 2023-09-23T08:28:00.298 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/apple-gmux.ko 2023-09-23T08:28:00.298 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-laptop.ko 2023-09-23T08:28:00.299 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-09-23T08:28:00.299 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-wmi.ko 2023-09-23T08:28:00.299 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/classmate-laptop.ko 2023-09-23T08:28:00.299 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-09-23T08:28:00.299 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-09-23T08:28:00.299 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-09-23T08:28:00.299 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-09-23T08:28:00.299 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/hdaps.ko 2023-09-23T08:28:00.299 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel 2023-09-23T08:28:00.299 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-09-23T08:28:00.299 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel_ips.ko 2023-09-23T08:28:00.299 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/msi-wmi.ko 2023-09-23T08:28:00.300 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/mxm-wmi.ko 2023-09-23T08:28:00.300 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-09-23T08:28:00.300 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/samsung-laptop.ko 2023-09-23T08:28:00.300 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/samsung-q10.ko 2023-09-23T08:28:00.300 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/topstar-laptop.ko 2023-09-23T08:28:00.300 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-09-23T08:28:00.300 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/toshiba_haps.ko 2023-09-23T08:28:00.300 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/wmi-bmof.ko 2023-09-23T08:28:00.300 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/wmi.ko 2023-09-23T08:28:00.300 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap 2023-09-23T08:28:00.300 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap/intel_rapl_common.ko 2023-09-23T08:28:00.300 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap/intel_rapl_msr.ko 2023-09-23T08:28:00.300 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps 2023-09-23T08:28:00.301 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients 2023-09-23T08:28:00.301 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps-gpio.ko 2023-09-23T08:28:00.301 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps-ldisc.ko 2023-09-23T08:28:00.301 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps_parport.ko 2023-09-23T08:28:00.301 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/pps_core.ko 2023-09-23T08:28:00.301 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp 2023-09-23T08:28:00.301 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp/ptp.ko 2023-09-23T08:28:00.301 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp/ptp_kvm.ko 2023-09-23T08:28:00.301 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc 2023-09-23T08:28:00.301 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-bq32k.ko 2023-09-23T08:28:00.301 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-bq4802.ko 2023-09-23T08:28:00.301 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1286.ko 2023-09-23T08:28:00.302 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1307.ko 2023-09-23T08:28:00.302 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1374.ko 2023-09-23T08:28:00.302 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1511.ko 2023-09-23T08:28:00.302 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1553.ko 2023-09-23T08:28:00.302 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1672.ko 2023-09-23T08:28:00.302 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1742.ko 2023-09-23T08:28:00.302 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds2404.ko 2023-09-23T08:28:00.302 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds3232.ko 2023-09-23T08:28:00.302 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-em3027.ko 2023-09-23T08:28:00.302 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-fm3130.ko 2023-09-23T08:28:00.302 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-isl12022.ko 2023-09-23T08:28:00.303 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-isl1208.ko 2023-09-23T08:28:00.303 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m41t80.ko 2023-09-23T08:28:00.303 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m48t35.ko 2023-09-23T08:28:00.303 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m48t59.ko 2023-09-23T08:28:00.303 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-max6900.ko 2023-09-23T08:28:00.303 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-msm6242.ko 2023-09-23T08:28:00.303 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf2127.ko 2023-09-23T08:28:00.303 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf85063.ko 2023-09-23T08:28:00.303 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8523.ko 2023-09-23T08:28:00.303 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8563.ko 2023-09-23T08:28:00.303 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8583.ko 2023-09-23T08:28:00.303 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rp5c01.ko 2023-09-23T08:28:00.304 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rs5c372.ko 2023-09-23T08:28:00.304 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-09-23T08:28:00.304 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rx8025.ko 2023-09-23T08:28:00.304 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rx8581.ko 2023-09-23T08:28:00.304 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-09-23T08:28:00.304 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-x1205.ko 2023-09-23T08:28:00.304 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi 2023-09-23T08:28:00.304 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-9xxx.ko 2023-09-23T08:28:00.304 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-sas.ko 2023-09-23T08:28:00.304 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-xxxx.ko 2023-09-23T08:28:00.304 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/BusLogic.ko 2023-09-23T08:28:00.304 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/a100u2w.ko 2023-09-23T08:28:00.305 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aacraid 2023-09-23T08:28:00.305 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aacraid/aacraid.ko 2023-09-23T08:28:00.305 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/advansys.ko 2023-09-23T08:28:00.305 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx 2023-09-23T08:28:00.305 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-09-23T08:28:00.305 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-09-23T08:28:00.305 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/am53c974.ko 2023-09-23T08:28:00.305 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/arcmsr 2023-09-23T08:28:00.305 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-09-23T08:28:00.305 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/atp870u.ko 2023-09-23T08:28:00.305 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/be2iscsi 2023-09-23T08:28:00.305 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-09-23T08:28:00.305 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bfa 2023-09-23T08:28:00.306 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bfa/bfa.ko 2023-09-23T08:28:00.306 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2fc 2023-09-23T08:28:00.306 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-09-23T08:28:00.306 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2i 2023-09-23T08:28:00.306 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-09-23T08:28:00.306 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ch.ko 2023-09-23T08:28:00.306 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/csiostor 2023-09-23T08:28:00.306 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/csiostor/csiostor.ko 2023-09-23T08:28:00.306 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi 2023-09-23T08:28:00.306 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb3i 2023-09-23T08:28:00.306 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-09-23T08:28:00.307 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb4i 2023-09-23T08:28:00.307 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-09-23T08:28:00.307 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-09-23T08:28:00.307 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/dc395x.ko 2023-09-23T08:28:00.307 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler 2023-09-23T08:28:00.307 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-09-23T08:28:00.307 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-09-23T08:28:00.307 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-09-23T08:28:00.307 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-09-23T08:28:00.307 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/dmx3191d.ko 2023-09-23T08:28:00.307 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esas2r 2023-09-23T08:28:00.307 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esas2r/esas2r.ko 2023-09-23T08:28:00.308 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esp_scsi.ko 2023-09-23T08:28:00.308 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe 2023-09-23T08:28:00.308 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe/fcoe.ko 2023-09-23T08:28:00.308 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-09-23T08:28:00.308 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fnic 2023-09-23T08:28:00.308 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fnic/fnic.ko 2023-09-23T08:28:00.308 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hpsa.ko 2023-09-23T08:28:00.308 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hptiop.ko 2023-09-23T08:28:00.308 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hv_storvsc.ko 2023-09-23T08:28:00.308 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/initio.ko 2023-09-23T08:28:00.308 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ipr.ko 2023-09-23T08:28:00.308 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ips.ko 2023-09-23T08:28:00.309 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/isci 2023-09-23T08:28:00.309 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/isci/isci.ko 2023-09-23T08:28:00.309 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-09-23T08:28:00.309 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/iscsi_tcp.ko 2023-09-23T08:28:00.309 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libfc 2023-09-23T08:28:00.309 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libfc/libfc.ko 2023-09-23T08:28:00.309 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libiscsi.ko 2023-09-23T08:28:00.309 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libiscsi_tcp.ko 2023-09-23T08:28:00.309 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libsas 2023-09-23T08:28:00.309 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libsas/libsas.ko 2023-09-23T08:28:00.309 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/lpfc 2023-09-23T08:28:00.309 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/lpfc/lpfc.ko 2023-09-23T08:28:00.310 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid 2023-09-23T08:28:00.310 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid.ko 2023-09-23T08:28:00.310 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-09-23T08:28:00.310 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-09-23T08:28:00.310 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-09-23T08:28:00.310 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mpt3sas 2023-09-23T08:28:00.310 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-09-23T08:28:00.310 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvsas 2023-09-23T08:28:00.310 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvsas/mvsas.ko 2023-09-23T08:28:00.310 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvumi.ko 2023-09-23T08:28:00.310 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pm8001 2023-09-23T08:28:00.311 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-09-23T08:28:00.311 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pmcraid.ko 2023-09-23T08:28:00.311 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla1280.ko 2023-09-23T08:28:00.311 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx 2023-09-23T08:28:00.311 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-09-23T08:28:00.311 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-09-23T08:28:00.311 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla4xxx 2023-09-23T08:28:00.311 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-09-23T08:28:00.311 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/raid_class.ko 2023-09-23T08:28:00.311 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_debug.ko 2023-09-23T08:28:00.311 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_fc.ko 2023-09-23T08:28:00.311 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-09-23T08:28:00.311 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_sas.ko 2023-09-23T08:28:00.312 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_spi.ko 2023-09-23T08:28:00.312 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_srp.ko 2023-09-23T08:28:00.312 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ses.ko 2023-09-23T08:28:00.312 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/st.ko 2023-09-23T08:28:00.312 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/stex.ko 2023-09-23T08:28:00.312 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/sym53c8xx_2 2023-09-23T08:28:00.312 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-09-23T08:28:00.312 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/virtio_scsi.ko 2023-09-23T08:28:00.312 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/vmw_pvscsi.ko 2023-09-23T08:28:00.312 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/wd719x.ko 2023-09-23T08:28:00.312 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ssb 2023-09-23T08:28:00.312 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ssb/ssb.ko 2023-09-23T08:28:00.313 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target 2023-09-23T08:28:00.313 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/iscsi 2023-09-23T08:28:00.313 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-09-23T08:28:00.313 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/loopback 2023-09-23T08:28:00.313 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/loopback/tcm_loop.ko 2023-09-23T08:28:00.313 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_file.ko 2023-09-23T08:28:00.313 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_iblock.ko 2023-09-23T08:28:00.313 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_mod.ko 2023-09-23T08:28:00.313 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_pscsi.ko 2023-09-23T08:28:00.313 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_user.ko 2023-09-23T08:28:00.313 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/tcm_fc 2023-09-23T08:28:00.313 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-09-23T08:28:00.314 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal 2023-09-23T08:28:00.314 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel 2023-09-23T08:28:00.314 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal 2023-09-23T08:28:00.314 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-09-23T08:28:00.314 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-09-23T08:28:00.314 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-09-23T08:28:00.314 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-09-23T08:28:00.314 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-09-23T08:28:00.314 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-09-23T08:28:00.314 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-09-23T08:28:00.314 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-09-23T08:28:00.314 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-09-23T08:28:00.315 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-09-23T08:28:00.315 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-09-23T08:28:00.315 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-09-23T08:28:00.315 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-09-23T08:28:00.315 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-09-23T08:28:00.315 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-09-23T08:28:00.315 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty 2023-09-23T08:28:00.315 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/ipwireless 2023-09-23T08:28:00.315 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-09-23T08:28:00.315 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/n_gsm.ko 2023-09-23T08:28:00.315 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/n_hdlc.ko 2023-09-23T08:28:00.315 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/nozomi.ko 2023-09-23T08:28:00.316 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial 2023-09-23T08:28:00.316 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/8250 2023-09-23T08:28:00.316 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-09-23T08:28:00.316 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/arc_uart.ko 2023-09-23T08:28:00.316 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/jsm 2023-09-23T08:28:00.316 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/jsm/jsm.ko 2023-09-23T08:28:00.316 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/synclink_gt.ko 2023-09-23T08:28:00.316 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs 2023-09-23T08:28:00.316 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/core 2023-09-23T08:28:00.316 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/core/ufshcd-core.ko 2023-09-23T08:28:00.316 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/host 2023-09-23T08:28:00.316 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-09-23T08:28:00.317 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio 2023-09-23T08:28:00.317 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio.ko 2023-09-23T08:28:00.317 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_aec.ko 2023-09-23T08:28:00.317 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_cif.ko 2023-09-23T08:28:00.317 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_pci_generic.ko 2023-09-23T08:28:00.317 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_sercos3.ko 2023-09-23T08:28:00.317 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb 2023-09-23T08:28:00.317 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class 2023-09-23T08:28:00.317 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/cdc-acm.ko 2023-09-23T08:28:00.317 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/cdc-wdm.ko 2023-09-23T08:28:00.317 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/usblp.ko 2023-09-23T08:28:00.317 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/usbtmc.ko 2023-09-23T08:28:00.318 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host 2023-09-23T08:28:00.318 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host/sl811-hcd.ko 2023-09-23T08:28:00.318 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image 2023-09-23T08:28:00.318 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image/mdc800.ko 2023-09-23T08:28:00.318 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image/microtek.ko 2023-09-23T08:28:00.318 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc 2023-09-23T08:28:00.318 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/adutux.ko 2023-09-23T08:28:00.318 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/appledisplay.ko 2023-09-23T08:28:00.318 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/emi26.ko 2023-09-23T08:28:00.318 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/emi62.ko 2023-09-23T08:28:00.318 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ezusb.ko 2023-09-23T08:28:00.319 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/idmouse.ko 2023-09-23T08:28:00.319 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/iowarrior.ko 2023-09-23T08:28:00.319 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/isight_firmware.ko 2023-09-23T08:28:00.319 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ldusb.ko 2023-09-23T08:28:00.319 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/legousbtower.ko 2023-09-23T08:28:00.319 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/sisusbvga 2023-09-23T08:28:00.319 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-09-23T08:28:00.319 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/trancevibrator.ko 2023-09-23T08:28:00.319 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usb3503.ko 2023-09-23T08:28:00.319 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usblcd.ko 2023-09-23T08:28:00.319 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usbsevseg.ko 2023-09-23T08:28:00.319 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/uss720.ko 2023-09-23T08:28:00.320 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/yurex.ko 2023-09-23T08:28:00.320 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy 2023-09-23T08:28:00.320 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy/phy-generic.ko 2023-09-23T08:28:00.320 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial 2023-09-23T08:28:00.320 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/aircable.ko 2023-09-23T08:28:00.320 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ark3116.ko 2023-09-23T08:28:00.320 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/belkin_sa.ko 2023-09-23T08:28:00.320 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ch341.ko 2023-09-23T08:28:00.320 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cp210x.ko 2023-09-23T08:28:00.320 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cyberjack.ko 2023-09-23T08:28:00.320 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cypress_m8.ko 2023-09-23T08:28:00.320 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/digi_acceleport.ko 2023-09-23T08:28:00.320 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/empeg.ko 2023-09-23T08:28:00.321 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ftdi_sio.ko 2023-09-23T08:28:00.321 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/garmin_gps.ko 2023-09-23T08:28:00.321 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/io_edgeport.ko 2023-09-23T08:28:00.321 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/io_ti.ko 2023-09-23T08:28:00.321 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ipaq.ko 2023-09-23T08:28:00.321 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ipw.ko 2023-09-23T08:28:00.321 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ir-usb.ko 2023-09-23T08:28:00.321 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-09-23T08:28:00.321 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/keyspan.ko 2023-09-23T08:28:00.321 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/keyspan_pda.ko 2023-09-23T08:28:00.321 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/kl5kusb105.ko 2023-09-23T08:28:00.322 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/kobil_sct.ko 2023-09-23T08:28:00.322 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mct_u232.ko 2023-09-23T08:28:00.322 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mos7720.ko 2023-09-23T08:28:00.322 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mos7840.ko 2023-09-23T08:28:00.322 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/navman.ko 2023-09-23T08:28:00.322 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/omninet.ko 2023-09-23T08:28:00.322 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/opticon.ko 2023-09-23T08:28:00.322 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/option.ko 2023-09-23T08:28:00.322 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/oti6858.ko 2023-09-23T08:28:00.322 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/pl2303.ko 2023-09-23T08:28:00.322 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/qcaux.ko 2023-09-23T08:28:00.322 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/qcserial.ko 2023-09-23T08:28:00.323 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/quatech2.ko 2023-09-23T08:28:00.323 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/safe_serial.ko 2023-09-23T08:28:00.323 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/sierra.ko 2023-09-23T08:28:00.323 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/spcp8x5.ko 2023-09-23T08:28:00.323 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ssu100.ko 2023-09-23T08:28:00.323 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/symbolserial.ko 2023-09-23T08:28:00.323 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-09-23T08:28:00.323 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-09-23T08:28:00.323 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb_debug.ko 2023-09-23T08:28:00.323 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb_wwan.ko 2023-09-23T08:28:00.323 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/visor.ko 2023-09-23T08:28:00.323 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/whiteheat.ko 2023-09-23T08:28:00.323 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/xsens_mt.ko 2023-09-23T08:28:00.324 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage 2023-09-23T08:28:00.324 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/uas.ko 2023-09-23T08:28:00.324 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-alauda.ko 2023-09-23T08:28:00.324 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-cypress.ko 2023-09-23T08:28:00.324 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-datafab.ko 2023-09-23T08:28:00.324 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-09-23T08:28:00.324 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-freecom.ko 2023-09-23T08:28:00.324 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-isd200.ko 2023-09-23T08:28:00.324 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-09-23T08:28:00.324 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-karma.ko 2023-09-23T08:28:00.324 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-onetouch.ko 2023-09-23T08:28:00.324 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-realtek.ko 2023-09-23T08:28:00.325 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-sddr09.ko 2023-09-23T08:28:00.325 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-sddr55.ko 2023-09-23T08:28:00.325 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-usbat.ko 2023-09-23T08:28:00.325 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/usb-storage.ko 2023-09-23T08:28:00.325 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip 2023-09-23T08:28:00.325 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/usbip-core.ko 2023-09-23T08:28:00.325 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/usbip-host.ko 2023-09-23T08:28:00.325 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-09-23T08:28:00.325 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio 2023-09-23T08:28:00.325 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci 2023-09-23T08:28:00.325 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-09-23T08:28:00.325 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci/vfio-pci.ko 2023-09-23T08:28:00.326 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/vfio.ko 2023-09-23T08:28:00.326 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-09-23T08:28:00.326 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost 2023-09-23T08:28:00.326 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost.ko 2023-09-23T08:28:00.326 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_iotlb.ko 2023-09-23T08:28:00.326 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_net.ko 2023-09-23T08:28:00.326 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_scsi.ko 2023-09-23T08:28:00.326 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video 2023-09-23T08:28:00.326 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight 2023-09-23T08:28:00.326 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/apple_bl.ko 2023-09-23T08:28:00.326 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/lcd.ko 2023-09-23T08:28:00.326 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/platform_lcd.ko 2023-09-23T08:28:00.327 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio 2023-09-23T08:28:00.327 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio.ko 2023-09-23T08:28:00.327 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_balloon.ko 2023-09-23T08:28:00.327 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_mmio.ko 2023-09-23T08:28:00.327 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci.ko 2023-09-23T08:28:00.327 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-09-23T08:28:00.327 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-09-23T08:28:00.327 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_ring.ko 2023-09-23T08:28:00.327 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1 2023-09-23T08:28:00.327 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters 2023-09-23T08:28:00.327 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/ds2482.ko 2023-09-23T08:28:00.327 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/ds2490.ko 2023-09-23T08:28:00.328 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves 2023-09-23T08:28:00.328 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-09-23T08:28:00.328 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-09-23T08:28:00.328 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-09-23T08:28:00.328 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-09-23T08:28:00.328 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-09-23T08:28:00.328 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-09-23T08:28:00.328 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-09-23T08:28:00.328 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-09-23T08:28:00.328 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-09-23T08:28:00.328 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_smem.ko 2023-09-23T08:28:00.328 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_therm.ko 2023-09-23T08:28:00.329 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/wire.ko 2023-09-23T08:28:00.329 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog 2023-09-23T08:28:00.329 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/alim1535_wdt.ko 2023-09-23T08:28:00.329 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/alim7101_wdt.ko 2023-09-23T08:28:00.329 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/f71808e_wdt.ko 2023-09-23T08:28:00.329 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/hpwdt.ko 2023-09-23T08:28:00.329 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/i6300esb.ko 2023-09-23T08:28:00.329 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-09-23T08:28:00.329 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/iTCO_wdt.ko 2023-09-23T08:28:00.329 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ib700wdt.ko 2023-09-23T08:28:00.329 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ibmasr.ko 2023-09-23T08:28:00.329 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-09-23T08:28:00.329 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/it8712f_wdt.ko 2023-09-23T08:28:00.330 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/it87_wdt.ko 2023-09-23T08:28:00.330 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/machzwd.ko 2023-09-23T08:28:00.330 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/nv_tco.ko 2023-09-23T08:28:00.330 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/pcwd_pci.ko 2023-09-23T08:28:00.330 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/pcwd_usb.ko 2023-09-23T08:28:00.330 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-09-23T08:28:00.330 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sch311x_wdt.ko 2023-09-23T08:28:00.330 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/softdog.ko 2023-09-23T08:28:00.330 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sp5100_tco.ko 2023-09-23T08:28:00.330 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/via_wdt.ko 2023-09-23T08:28:00.330 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-09-23T08:28:00.331 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83877f_wdt.ko 2023-09-23T08:28:00.331 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83977f_wdt.ko 2023-09-23T08:28:00.331 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/wdt_pci.ko 2023-09-23T08:28:00.331 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/xen_wdt.ko 2023-09-23T08:28:00.331 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen 2023-09-23T08:28:00.331 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-acpi-processor.ko 2023-09-23T08:28:00.331 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-evtchn.ko 2023-09-23T08:28:00.331 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-gntalloc.ko 2023-09-23T08:28:00.331 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-gntdev.ko 2023-09-23T08:28:00.331 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-pciback 2023-09-23T08:28:00.331 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-09-23T08:28:00.331 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-privcmd.ko 2023-09-23T08:28:00.331 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xenfs 2023-09-23T08:28:00.332 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xenfs/xenfs.ko 2023-09-23T08:28:00.332 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs 2023-09-23T08:28:00.332 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/9p 2023-09-23T08:28:00.332 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/9p/9p.ko 2023-09-23T08:28:00.332 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/affs 2023-09-23T08:28:00.332 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/affs/affs.ko 2023-09-23T08:28:00.332 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/befs 2023-09-23T08:28:00.332 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/befs/befs.ko 2023-09-23T08:28:00.332 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/binfmt_misc.ko 2023-09-23T08:28:00.332 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/btrfs 2023-09-23T08:28:00.332 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/btrfs/btrfs.ko 2023-09-23T08:28:00.332 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cachefiles 2023-09-23T08:28:00.333 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cachefiles/cachefiles.ko 2023-09-23T08:28:00.333 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ceph 2023-09-23T08:28:00.333 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ceph/ceph.ko 2023-09-23T08:28:00.333 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/coda 2023-09-23T08:28:00.333 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/coda/coda.ko 2023-09-23T08:28:00.333 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cramfs 2023-09-23T08:28:00.333 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cramfs/cramfs.ko 2023-09-23T08:28:00.333 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/dlm 2023-09-23T08:28:00.333 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/dlm/dlm.ko 2023-09-23T08:28:00.333 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ecryptfs 2023-09-23T08:28:00.333 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ecryptfs/ecryptfs.ko 2023-09-23T08:28:00.333 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/f2fs 2023-09-23T08:28:00.334 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/f2fs/f2fs.ko 2023-09-23T08:28:00.334 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat 2023-09-23T08:28:00.334 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/fat.ko 2023-09-23T08:28:00.334 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/msdos.ko 2023-09-23T08:28:00.334 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/vfat.ko 2023-09-23T08:28:00.334 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fscache 2023-09-23T08:28:00.334 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fscache/fscache.ko 2023-09-23T08:28:00.334 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse 2023-09-23T08:28:00.334 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse/cuse.ko 2023-09-23T08:28:00.334 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse/fuse.ko 2023-09-23T08:28:00.334 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/gfs2 2023-09-23T08:28:00.335 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/gfs2/gfs2.ko 2023-09-23T08:28:00.335 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfs 2023-09-23T08:28:00.335 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfs/hfs.ko 2023-09-23T08:28:00.335 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfsplus 2023-09-23T08:28:00.335 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfsplus/hfsplus.ko 2023-09-23T08:28:00.335 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/isofs 2023-09-23T08:28:00.335 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/isofs/isofs.ko 2023-09-23T08:28:00.335 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/jfs 2023-09-23T08:28:00.335 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/jfs/jfs.ko 2023-09-23T08:28:00.335 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/lockd 2023-09-23T08:28:00.335 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/lockd/lockd.ko 2023-09-23T08:28:00.335 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/minix 2023-09-23T08:28:00.336 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/minix/minix.ko 2023-09-23T08:28:00.336 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/netfs 2023-09-23T08:28:00.336 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/netfs/netfs.ko 2023-09-23T08:28:00.336 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs 2023-09-23T08:28:00.336 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/blocklayout 2023-09-23T08:28:00.336 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-09-23T08:28:00.336 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/filelayout 2023-09-23T08:28:00.336 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-09-23T08:28:00.336 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/flexfilelayout 2023-09-23T08:28:00.336 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-09-23T08:28:00.336 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfs.ko 2023-09-23T08:28:00.336 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfsv3.ko 2023-09-23T08:28:00.337 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfsv4.ko 2023-09-23T08:28:00.337 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common 2023-09-23T08:28:00.337 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common/grace.ko 2023-09-23T08:28:00.337 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common/nfs_acl.ko 2023-09-23T08:28:00.337 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfsd 2023-09-23T08:28:00.337 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfsd/nfsd.ko 2023-09-23T08:28:00.337 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nilfs2 2023-09-23T08:28:00.337 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nilfs2/nilfs2.ko 2023-09-23T08:28:00.337 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls 2023-09-23T08:28:00.337 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-celtic.ko 2023-09-23T08:28:00.337 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-centeuro.ko 2023-09-23T08:28:00.337 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-croatian.ko 2023-09-23T08:28:00.337 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-cyrillic.ko 2023-09-23T08:28:00.338 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-gaelic.ko 2023-09-23T08:28:00.338 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-greek.ko 2023-09-23T08:28:00.338 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-iceland.ko 2023-09-23T08:28:00.338 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-inuit.ko 2023-09-23T08:28:00.338 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-roman.ko 2023-09-23T08:28:00.338 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-romanian.ko 2023-09-23T08:28:00.338 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-turkish.ko 2023-09-23T08:28:00.338 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1250.ko 2023-09-23T08:28:00.338 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1251.ko 2023-09-23T08:28:00.338 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1255.ko 2023-09-23T08:28:00.338 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp737.ko 2023-09-23T08:28:00.339 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp775.ko 2023-09-23T08:28:00.339 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp850.ko 2023-09-23T08:28:00.339 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp852.ko 2023-09-23T08:28:00.339 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp855.ko 2023-09-23T08:28:00.339 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp857.ko 2023-09-23T08:28:00.339 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp860.ko 2023-09-23T08:28:00.339 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp861.ko 2023-09-23T08:28:00.339 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp862.ko 2023-09-23T08:28:00.339 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp863.ko 2023-09-23T08:28:00.339 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp864.ko 2023-09-23T08:28:00.339 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp865.ko 2023-09-23T08:28:00.339 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp866.ko 2023-09-23T08:28:00.340 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp869.ko 2023-09-23T08:28:00.340 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp874.ko 2023-09-23T08:28:00.340 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp932.ko 2023-09-23T08:28:00.340 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp936.ko 2023-09-23T08:28:00.340 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp949.ko 2023-09-23T08:28:00.340 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp950.ko 2023-09-23T08:28:00.340 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_euc-jp.ko 2023-09-23T08:28:00.340 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-1.ko 2023-09-23T08:28:00.340 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-13.ko 2023-09-23T08:28:00.340 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-14.ko 2023-09-23T08:28:00.340 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-15.ko 2023-09-23T08:28:00.340 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-2.ko 2023-09-23T08:28:00.341 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-3.ko 2023-09-23T08:28:00.341 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-4.ko 2023-09-23T08:28:00.341 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-5.ko 2023-09-23T08:28:00.341 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-6.ko 2023-09-23T08:28:00.341 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-7.ko 2023-09-23T08:28:00.341 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-9.ko 2023-09-23T08:28:00.341 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-r.ko 2023-09-23T08:28:00.341 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-ru.ko 2023-09-23T08:28:00.341 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-u.ko 2023-09-23T08:28:00.341 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_utf8.ko 2023-09-23T08:28:00.341 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2 2023-09-23T08:28:00.341 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/cluster 2023-09-23T08:28:00.342 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-09-23T08:28:00.342 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlm 2023-09-23T08:28:00.342 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-09-23T08:28:00.342 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlmfs 2023-09-23T08:28:00.342 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-09-23T08:28:00.342 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2.ko 2023-09-23T08:28:00.342 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-09-23T08:28:00.342 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-09-23T08:28:00.342 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-09-23T08:28:00.342 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/overlayfs 2023-09-23T08:28:00.342 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/overlayfs/overlay.ko 2023-09-23T08:28:00.343 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/pstore 2023-09-23T08:28:00.343 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/pstore/ramoops.ko 2023-09-23T08:28:00.343 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/reiserfs 2023-09-23T08:28:00.343 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/reiserfs/reiserfs.ko 2023-09-23T08:28:00.343 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/romfs 2023-09-23T08:28:00.343 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/romfs/romfs.ko 2023-09-23T08:28:00.343 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb 2023-09-23T08:28:00.343 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/client 2023-09-23T08:28:00.343 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/client/cifs.ko 2023-09-23T08:28:00.343 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common 2023-09-23T08:28:00.343 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common/cifs_arc4.ko 2023-09-23T08:28:00.343 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common/cifs_md4.ko 2023-09-23T08:28:00.343 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/squashfs 2023-09-23T08:28:00.344 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/squashfs/squashfs.ko 2023-09-23T08:28:00.344 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/sysv 2023-09-23T08:28:00.344 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/sysv/sysv.ko 2023-09-23T08:28:00.344 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/udf 2023-09-23T08:28:00.344 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/udf/udf.ko 2023-09-23T08:28:00.344 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ufs 2023-09-23T08:28:00.344 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ufs/ufs.ko 2023-09-23T08:28:00.344 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/xfs 2023-09-23T08:28:00.344 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/xfs/xfs.ko 2023-09-23T08:28:00.344 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel 2023-09-23T08:28:00.344 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/rcu 2023-09-23T08:28:00.344 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/rcu/rcutorture.ko 2023-09-23T08:28:00.345 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/torture.ko 2023-09-23T08:28:00.345 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/trace 2023-09-23T08:28:00.345 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-09-23T08:28:00.345 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib 2023-09-23T08:28:00.345 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/asn1_encoder.ko 2023-09-23T08:28:00.345 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crc-itu-t.ko 2023-09-23T08:28:00.345 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crc8.ko 2023-09-23T08:28:00.345 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto 2023-09-23T08:28:00.345 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto/libarc4.ko 2023-09-23T08:28:00.345 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto/libdes.ko 2023-09-23T08:28:00.345 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/libcrc32c.ko 2023-09-23T08:28:00.345 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lru_cache.ko 2023-09-23T08:28:00.346 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4 2023-09-23T08:28:00.346 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4/lz4_compress.ko 2023-09-23T08:28:00.346 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4/lz4hc_compress.ko 2023-09-23T08:28:00.346 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/math 2023-09-23T08:28:00.346 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/math/cordic.ko 2023-09-23T08:28:00.346 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/raid6 2023-09-23T08:28:00.346 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/raid6/raid6_pq.ko 2023-09-23T08:28:00.346 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/reed_solomon 2023-09-23T08:28:00.346 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/reed_solomon/reed_solomon.ko 2023-09-23T08:28:00.346 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_bm.ko 2023-09-23T08:28:00.346 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_fsm.ko 2023-09-23T08:28:00.346 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_kmp.ko 2023-09-23T08:28:00.347 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/zstd 2023-09-23T08:28:00.347 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/zstd/zstd_compress.ko 2023-09-23T08:28:00.347 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/mm 2023-09-23T08:28:00.347 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/mm/hwpoison-inject.ko 2023-09-23T08:28:00.347 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net 2023-09-23T08:28:00.347 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan 2023-09-23T08:28:00.347 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/6lowpan.ko 2023-09-23T08:28:00.347 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_dest.ko 2023-09-23T08:28:00.347 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_fragment.ko 2023-09-23T08:28:00.347 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_hop.ko 2023-09-23T08:28:00.347 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_ipv6.ko 2023-09-23T08:28:00.347 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_mobility.ko 2023-09-23T08:28:00.347 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_routing.ko 2023-09-23T08:28:00.348 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_udp.ko 2023-09-23T08:28:00.348 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802 2023-09-23T08:28:00.348 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/garp.ko 2023-09-23T08:28:00.348 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/mrp.ko 2023-09-23T08:28:00.348 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/p8022.ko 2023-09-23T08:28:00.348 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/psnap.ko 2023-09-23T08:28:00.348 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/stp.ko 2023-09-23T08:28:00.348 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/8021q 2023-09-23T08:28:00.348 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/8021q/8021q.ko 2023-09-23T08:28:00.348 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p 2023-09-23T08:28:00.348 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet.ko 2023-09-23T08:28:00.348 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_fd.ko 2023-09-23T08:28:00.349 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_rdma.ko 2023-09-23T08:28:00.349 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_virtio.ko 2023-09-23T08:28:00.349 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/batman-adv 2023-09-23T08:28:00.349 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/batman-adv/batman-adv.ko 2023-09-23T08:28:00.349 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge 2023-09-23T08:28:00.349 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/br_netfilter.ko 2023-09-23T08:28:00.349 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/bridge.ko 2023-09-23T08:28:00.349 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter 2023-09-23T08:28:00.349 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-09-23T08:28:00.349 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_among.ko 2023-09-23T08:28:00.349 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_arp.ko 2023-09-23T08:28:00.349 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-09-23T08:28:00.350 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-09-23T08:28:00.350 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_ip.ko 2023-09-23T08:28:00.350 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-09-23T08:28:00.350 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_limit.ko 2023-09-23T08:28:00.350 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_log.ko 2023-09-23T08:28:00.350 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_mark.ko 2023-09-23T08:28:00.350 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-09-23T08:28:00.350 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-09-23T08:28:00.350 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-09-23T08:28:00.350 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-09-23T08:28:00.350 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_snat.ko 2023-09-23T08:28:00.350 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_stp.ko 2023-09-23T08:28:00.351 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-09-23T08:28:00.351 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-09-23T08:28:00.351 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-09-23T08:28:00.351 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-09-23T08:28:00.351 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtables.ko 2023-09-23T08:28:00.351 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-09-23T08:28:00.351 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-09-23T08:28:00.351 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-09-23T08:28:00.351 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ceph 2023-09-23T08:28:00.351 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ceph/libceph.ko 2023-09-23T08:28:00.351 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core 2023-09-23T08:28:00.351 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core/failover.ko 2023-09-23T08:28:00.351 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core/pktgen.ko 2023-09-23T08:28:00.352 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp 2023-09-23T08:28:00.352 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp.ko 2023-09-23T08:28:00.352 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_diag.ko 2023-09-23T08:28:00.352 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_ipv4.ko 2023-09-23T08:28:00.352 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_ipv6.ko 2023-09-23T08:28:00.352 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dns_resolver 2023-09-23T08:28:00.352 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dns_resolver/dns_resolver.ko 2023-09-23T08:28:00.352 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa 2023-09-23T08:28:00.352 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/dsa_core.ko 2023-09-23T08:28:00.352 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_brcm.ko 2023-09-23T08:28:00.352 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_dsa.ko 2023-09-23T08:28:00.353 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_none.ko 2023-09-23T08:28:00.353 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_trailer.ko 2023-09-23T08:28:00.353 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154 2023-09-23T08:28:00.353 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/6lowpan 2023-09-23T08:28:00.353 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-09-23T08:28:00.353 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/ieee802154.ko 2023-09-23T08:28:00.353 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/ieee802154_socket.ko 2023-09-23T08:28:00.353 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4 2023-09-23T08:28:00.353 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ah4.ko 2023-09-23T08:28:00.353 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/esp4.ko 2023-09-23T08:28:00.353 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/fou.ko 2023-09-23T08:28:00.353 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/gre.ko 2023-09-23T08:28:00.353 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/inet_diag.ko 2023-09-23T08:28:00.354 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_gre.ko 2023-09-23T08:28:00.354 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_tunnel.ko 2023-09-23T08:28:00.354 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_vti.ko 2023-09-23T08:28:00.354 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ipcomp.ko 2023-09-23T08:28:00.354 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ipip.ko 2023-09-23T08:28:00.354 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter 2023-09-23T08:28:00.354 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arp_tables.ko 2023-09-23T08:28:00.354 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-09-23T08:28:00.354 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-09-23T08:28:00.354 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-09-23T08:28:00.354 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-09-23T08:28:00.355 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-09-23T08:28:00.355 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-09-23T08:28:00.355 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-09-23T08:28:00.355 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-09-23T08:28:00.355 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-09-23T08:28:00.355 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_security.ko 2023-09-23T08:28:00.355 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-09-23T08:28:00.355 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-09-23T08:28:00.355 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-09-23T08:28:00.355 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-09-23T08:28:00.355 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-09-23T08:28:00.356 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-09-23T08:28:00.356 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-09-23T08:28:00.357 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-09-23T08:28:00.357 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-09-23T08:28:00.357 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-09-23T08:28:00.357 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_bic.ko 2023-09-23T08:28:00.357 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_dctcp.ko 2023-09-23T08:28:00.357 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_diag.ko 2023-09-23T08:28:00.358 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_highspeed.ko 2023-09-23T08:28:00.358 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_htcp.ko 2023-09-23T08:28:00.358 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_hybla.ko 2023-09-23T08:28:00.358 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_illinois.ko 2023-09-23T08:28:00.358 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_lp.ko 2023-09-23T08:28:00.358 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_scalable.ko 2023-09-23T08:28:00.358 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_vegas.ko 2023-09-23T08:28:00.358 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_veno.ko 2023-09-23T08:28:00.358 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_westwood.ko 2023-09-23T08:28:00.358 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_yeah.ko 2023-09-23T08:28:00.358 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tunnel4.ko 2023-09-23T08:28:00.358 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/udp_diag.ko 2023-09-23T08:28:00.359 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/udp_tunnel.ko 2023-09-23T08:28:00.359 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/xfrm4_tunnel.ko 2023-09-23T08:28:00.359 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6 2023-09-23T08:28:00.359 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ah6.ko 2023-09-23T08:28:00.359 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/esp6.ko 2023-09-23T08:28:00.359 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/fou6.ko 2023-09-23T08:28:00.359 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_tunnel.ko 2023-09-23T08:28:00.359 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-09-23T08:28:00.359 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_vti.ko 2023-09-23T08:28:00.359 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ipcomp6.ko 2023-09-23T08:28:00.359 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter 2023-09-23T08:28:00.360 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-09-23T08:28:00.360 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-09-23T08:28:00.360 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-09-23T08:28:00.360 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-09-23T08:28:00.360 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-09-23T08:28:00.360 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-09-23T08:28:00.360 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-09-23T08:28:00.360 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-09-23T08:28:00.360 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-09-23T08:28:00.360 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-09-23T08:28:00.360 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-09-23T08:28:00.360 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-09-23T08:28:00.361 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-09-23T08:28:00.361 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-09-23T08:28:00.361 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-09-23T08:28:00.361 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-09-23T08:28:00.361 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-09-23T08:28:00.361 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-09-23T08:28:00.361 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-09-23T08:28:00.361 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-09-23T08:28:00.361 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-09-23T08:28:00.361 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-09-23T08:28:00.361 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-09-23T08:28:00.362 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-09-23T08:28:00.362 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/sit.ko 2023-09-23T08:28:00.362 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/tunnel6.ko 2023-09-23T08:28:00.362 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/xfrm6_tunnel.ko 2023-09-23T08:28:00.362 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/key 2023-09-23T08:28:00.362 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/key/af_key.ko 2023-09-23T08:28:00.362 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp 2023-09-23T08:28:00.362 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_core.ko 2023-09-23T08:28:00.362 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_debugfs.ko 2023-09-23T08:28:00.362 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_eth.ko 2023-09-23T08:28:00.362 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ip.ko 2023-09-23T08:28:00.363 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ip6.ko 2023-09-23T08:28:00.363 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_netlink.ko 2023-09-23T08:28:00.363 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ppp.ko 2023-09-23T08:28:00.363 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/llc 2023-09-23T08:28:00.363 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/llc/llc.ko 2023-09-23T08:28:00.363 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mac802154 2023-09-23T08:28:00.363 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mac802154/mac802154.ko 2023-09-23T08:28:00.363 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mpls 2023-09-23T08:28:00.363 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mpls/mpls_gso.ko 2023-09-23T08:28:00.363 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter 2023-09-23T08:28:00.363 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset 2023-09-23T08:28:00.363 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set.ko 2023-09-23T08:28:00.364 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-09-23T08:28:00.364 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-09-23T08:28:00.364 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-09-23T08:28:00.364 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-09-23T08:28:00.364 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-09-23T08:28:00.364 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-09-23T08:28:00.364 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-09-23T08:28:00.364 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-09-23T08:28:00.364 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-09-23T08:28:00.364 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-09-23T08:28:00.364 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-09-23T08:28:00.364 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-09-23T08:28:00.365 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-09-23T08:28:00.365 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-09-23T08:28:00.365 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-09-23T08:28:00.365 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs 2023-09-23T08:28:00.365 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs.ko 2023-09-23T08:28:00.365 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-09-23T08:28:00.365 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-09-23T08:28:00.365 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-09-23T08:28:00.365 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-09-23T08:28:00.365 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-09-23T08:28:00.365 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-09-23T08:28:00.365 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-09-23T08:28:00.365 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-09-23T08:28:00.366 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-09-23T08:28:00.366 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-09-23T08:28:00.366 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-09-23T08:28:00.366 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-09-23T08:28:00.366 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-09-23T08:28:00.366 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conncount.ko 2023-09-23T08:28:00.366 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack.ko 2023-09-23T08:28:00.366 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-09-23T08:28:00.366 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-09-23T08:28:00.366 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-09-23T08:28:00.366 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_h323.ko 2023-09-23T08:28:00.367 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_irc.ko 2023-09-23T08:28:00.367 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-09-23T08:28:00.367 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-09-23T08:28:00.367 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-09-23T08:28:00.367 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_sane.ko 2023-09-23T08:28:00.367 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_sip.ko 2023-09-23T08:28:00.367 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-09-23T08:28:00.367 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-09-23T08:28:00.367 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_dup_netdev.ko 2023-09-23T08:28:00.367 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_flow_table.ko 2023-09-23T08:28:00.367 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_flow_table_inet.ko 2023-09-23T08:28:00.367 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_log_syslog.ko 2023-09-23T08:28:00.368 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat.ko 2023-09-23T08:28:00.368 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_amanda.ko 2023-09-23T08:28:00.368 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_ftp.ko 2023-09-23T08:28:00.368 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_irc.ko 2023-09-23T08:28:00.368 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_sip.ko 2023-09-23T08:28:00.368 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_tftp.ko 2023-09-23T08:28:00.368 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_synproxy_core.ko 2023-09-23T08:28:00.368 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_tables.ko 2023-09-23T08:28:00.368 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink.ko 2023-09-23T08:28:00.368 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_acct.ko 2023-09-23T08:28:00.368 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_log.ko 2023-09-23T08:28:00.368 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_osf.ko 2023-09-23T08:28:00.369 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_queue.ko 2023-09-23T08:28:00.369 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_chain_nat.ko 2023-09-23T08:28:00.369 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_compat.ko 2023-09-23T08:28:00.369 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_ct.ko 2023-09-23T08:28:00.369 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_dup_netdev.ko 2023-09-23T08:28:00.369 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_fib.ko 2023-09-23T08:28:00.369 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_fwd_netdev.ko 2023-09-23T08:28:00.369 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_hash.ko 2023-09-23T08:28:00.369 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_limit.ko 2023-09-23T08:28:00.369 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_log.ko 2023-09-23T08:28:00.369 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_masq.ko 2023-09-23T08:28:00.369 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_nat.ko 2023-09-23T08:28:00.370 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_numgen.ko 2023-09-23T08:28:00.370 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_queue.ko 2023-09-23T08:28:00.370 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_quota.ko 2023-09-23T08:28:00.370 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_redir.ko 2023-09-23T08:28:00.370 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_reject.ko 2023-09-23T08:28:00.370 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_reject_inet.ko 2023-09-23T08:28:00.370 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_socket.ko 2023-09-23T08:28:00.370 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_tunnel.ko 2023-09-23T08:28:00.370 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_AUDIT.ko 2023-09-23T08:28:00.370 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CHECKSUM.ko 2023-09-23T08:28:00.370 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CLASSIFY.ko 2023-09-23T08:28:00.371 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-09-23T08:28:00.371 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CT.ko 2023-09-23T08:28:00.371 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_DSCP.ko 2023-09-23T08:28:00.371 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_HL.ko 2023-09-23T08:28:00.371 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_HMARK.ko 2023-09-23T08:28:00.371 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_IDLETIMER.ko 2023-09-23T08:28:00.371 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_LED.ko 2023-09-23T08:28:00.371 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_LOG.ko 2023-09-23T08:28:00.371 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_MASQUERADE.ko 2023-09-23T08:28:00.371 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NETMAP.ko 2023-09-23T08:28:00.371 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NFLOG.ko 2023-09-23T08:28:00.371 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NFQUEUE.ko 2023-09-23T08:28:00.372 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_RATEEST.ko 2023-09-23T08:28:00.372 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_REDIRECT.ko 2023-09-23T08:28:00.372 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_SECMARK.ko 2023-09-23T08:28:00.372 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TCPMSS.ko 2023-09-23T08:28:00.372 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-09-23T08:28:00.372 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TEE.ko 2023-09-23T08:28:00.372 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TPROXY.ko 2023-09-23T08:28:00.372 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TRACE.ko 2023-09-23T08:28:00.372 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_addrtype.ko 2023-09-23T08:28:00.372 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_bpf.ko 2023-09-23T08:28:00.372 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cgroup.ko 2023-09-23T08:28:00.372 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cluster.ko 2023-09-23T08:28:00.373 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_comment.ko 2023-09-23T08:28:00.373 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connbytes.ko 2023-09-23T08:28:00.373 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connlabel.ko 2023-09-23T08:28:00.373 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connlimit.ko 2023-09-23T08:28:00.373 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connmark.ko 2023-09-23T08:28:00.373 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_conntrack.ko 2023-09-23T08:28:00.373 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cpu.ko 2023-09-23T08:28:00.373 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_dccp.ko 2023-09-23T08:28:00.373 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_devgroup.ko 2023-09-23T08:28:00.373 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_dscp.ko 2023-09-23T08:28:00.373 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ecn.ko 2023-09-23T08:28:00.373 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_esp.ko 2023-09-23T08:28:00.374 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_hashlimit.ko 2023-09-23T08:28:00.374 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_helper.ko 2023-09-23T08:28:00.374 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_hl.ko 2023-09-23T08:28:00.374 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ipcomp.ko 2023-09-23T08:28:00.374 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_iprange.ko 2023-09-23T08:28:00.374 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ipvs.ko 2023-09-23T08:28:00.374 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_l2tp.ko 2023-09-23T08:28:00.374 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_length.ko 2023-09-23T08:28:00.374 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_limit.ko 2023-09-23T08:28:00.374 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_mac.ko 2023-09-23T08:28:00.374 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_mark.ko 2023-09-23T08:28:00.374 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_multiport.ko 2023-09-23T08:28:00.375 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_nat.ko 2023-09-23T08:28:00.375 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_nfacct.ko 2023-09-23T08:28:00.375 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_osf.ko 2023-09-23T08:28:00.375 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_owner.ko 2023-09-23T08:28:00.375 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_physdev.ko 2023-09-23T08:28:00.375 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_pkttype.ko 2023-09-23T08:28:00.375 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_policy.ko 2023-09-23T08:28:00.375 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_quota.ko 2023-09-23T08:28:00.375 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_rateest.ko 2023-09-23T08:28:00.375 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_realm.ko 2023-09-23T08:28:00.375 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_recent.ko 2023-09-23T08:28:00.375 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_sctp.ko 2023-09-23T08:28:00.376 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_set.ko 2023-09-23T08:28:00.376 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_socket.ko 2023-09-23T08:28:00.376 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_state.ko 2023-09-23T08:28:00.376 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_statistic.ko 2023-09-23T08:28:00.376 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_string.ko 2023-09-23T08:28:00.376 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_tcpmss.ko 2023-09-23T08:28:00.376 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_time.ko 2023-09-23T08:28:00.376 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_u32.ko 2023-09-23T08:28:00.376 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netlink 2023-09-23T08:28:00.376 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netlink/netlink_diag.ko 2023-09-23T08:28:00.376 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/nsh 2023-09-23T08:28:00.376 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/nsh/nsh.ko 2023-09-23T08:28:00.377 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch 2023-09-23T08:28:00.377 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/openvswitch.ko 2023-09-23T08:28:00.377 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-geneve.ko 2023-09-23T08:28:00.377 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-gre.ko 2023-09-23T08:28:00.377 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-vxlan.ko 2023-09-23T08:28:00.377 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/packet 2023-09-23T08:28:00.377 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/packet/af_packet_diag.ko 2023-09-23T08:28:00.377 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds 2023-09-23T08:28:00.377 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds.ko 2023-09-23T08:28:00.377 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds_rdma.ko 2023-09-23T08:28:00.377 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds_tcp.ko 2023-09-23T08:28:00.377 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched 2023-09-23T08:28:00.378 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_csum.ko 2023-09-23T08:28:00.378 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_gact.ko 2023-09-23T08:28:00.378 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_ipt.ko 2023-09-23T08:28:00.378 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_mirred.ko 2023-09-23T08:28:00.378 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_nat.ko 2023-09-23T08:28:00.378 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_pedit.ko 2023-09-23T08:28:00.378 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_police.ko 2023-09-23T08:28:00.378 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_simple.ko 2023-09-23T08:28:00.378 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_skbedit.ko 2023-09-23T08:28:00.378 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_vlan.ko 2023-09-23T08:28:00.378 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_basic.ko 2023-09-23T08:28:00.378 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_bpf.ko 2023-09-23T08:28:00.379 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_flow.ko 2023-09-23T08:28:00.379 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_fw.ko 2023-09-23T08:28:00.379 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_route.ko 2023-09-23T08:28:00.379 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_u32.ko 2023-09-23T08:28:00.379 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_cmp.ko 2023-09-23T08:28:00.379 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_ipset.ko 2023-09-23T08:28:00.379 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_meta.ko 2023-09-23T08:28:00.379 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_nbyte.ko 2023-09-23T08:28:00.379 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_text.ko 2023-09-23T08:28:00.379 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_u32.ko 2023-09-23T08:28:00.379 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_choke.ko 2023-09-23T08:28:00.379 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_codel.ko 2023-09-23T08:28:00.380 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_drr.ko 2023-09-23T08:28:00.380 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_fq.ko 2023-09-23T08:28:00.380 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_gred.ko 2023-09-23T08:28:00.380 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_hfsc.ko 2023-09-23T08:28:00.380 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_hhf.ko 2023-09-23T08:28:00.380 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_htb.ko 2023-09-23T08:28:00.380 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_ingress.ko 2023-09-23T08:28:00.380 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_mqprio.ko 2023-09-23T08:28:00.380 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_mqprio_lib.ko 2023-09-23T08:28:00.380 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_multiq.ko 2023-09-23T08:28:00.380 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_netem.ko 2023-09-23T08:28:00.380 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_pie.ko 2023-09-23T08:28:00.381 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_plug.ko 2023-09-23T08:28:00.381 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_prio.ko 2023-09-23T08:28:00.381 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_qfq.ko 2023-09-23T08:28:00.381 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_red.ko 2023-09-23T08:28:00.381 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_sfb.ko 2023-09-23T08:28:00.381 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_sfq.ko 2023-09-23T08:28:00.381 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_tbf.ko 2023-09-23T08:28:00.381 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_teql.ko 2023-09-23T08:28:00.381 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp 2023-09-23T08:28:00.381 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp/sctp.ko 2023-09-23T08:28:00.381 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp/sctp_diag.ko 2023-09-23T08:28:00.381 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc 2023-09-23T08:28:00.382 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss 2023-09-23T08:28:00.382 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-09-23T08:28:00.382 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-09-23T08:28:00.382 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/sunrpc.ko 2023-09-23T08:28:00.382 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/xprtrdma 2023-09-23T08:28:00.382 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-09-23T08:28:00.382 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc 2023-09-23T08:28:00.382 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc/diag.ko 2023-09-23T08:28:00.382 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc/tipc.ko 2023-09-23T08:28:00.382 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/unix 2023-09-23T08:28:00.382 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/unix/unix_diag.ko 2023-09-23T08:28:00.382 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock 2023-09-23T08:28:00.383 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-09-23T08:28:00.383 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-09-23T08:28:00.383 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock.ko 2023-09-23T08:28:00.383 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock_diag.ko 2023-09-23T08:28:00.383 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock_loopback.ko 2023-09-23T08:28:00.383 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm 2023-09-23T08:28:00.383 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm/xfrm_ipcomp.ko 2023-09-23T08:28:00.383 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security 2023-09-23T08:28:00.383 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys 2023-09-23T08:28:00.383 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/encrypted-keys 2023-09-23T08:28:00.383 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-09-23T08:28:00.383 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/trusted-keys 2023-09-23T08:28:00.384 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/trusted-keys/trusted.ko 2023-09-23T08:28:00.384 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt 2023-09-23T08:28:00.384 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt/lib 2023-09-23T08:28:00.384 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt/lib/irqbypass.ko 2023-09-23T08:28:00.384 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.alias 2023-09-23T08:28:00.384 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.alias.bin 2023-09-23T08:28:00.384 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin 2023-09-23T08:28:00.384 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin.bin 2023-09-23T08:28:00.384 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin.modinfo 2023-09-23T08:28:00.384 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.dep 2023-09-23T08:28:00.384 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.dep.bin 2023-09-23T08:28:00.384 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.devname 2023-09-23T08:28:00.384 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.order 2023-09-23T08:28:00.385 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.softdep 2023-09-23T08:28:00.385 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.symbols 2023-09-23T08:28:00.385 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.symbols.bin 2023-09-23T08:28:00.385 DEBUG:teuthology.task.kernel:get_image_version: 6.5.0-rc7-gfef64f93da2b 2023-09-23T08:28:00.385 DEBUG:teuthology.orchestra.run.smithi082:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-09-23T08:28:00.412 INFO:teuthology.orchestra.run.smithi082.stdout:postinstall scriptlet (using /bin/sh): 2023-09-23T08:28:00.412 INFO:teuthology.orchestra.run.smithi082.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b -a -r /boot/System.map-6.5.0-rc7-gfef64f93da2b ]; then 2023-09-23T08:28:00.412 INFO:teuthology.orchestra.run.smithi082.stdout:cp /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm 2023-09-23T08:28:00.412 INFO:teuthology.orchestra.run.smithi082.stdout:cp /boot/System.map-6.5.0-rc7-gfef64f93da2b /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-09-23T08:28:00.412 INFO:teuthology.orchestra.run.smithi082.stdout:rm -f /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b /boot/System.map-6.5.0-rc7-gfef64f93da2b 2023-09-23T08:28:00.412 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/installkernel 6.5.0-rc7-gfef64f93da2b /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-09-23T08:28:00.412 INFO:teuthology.orchestra.run.smithi082.stdout:rm -f /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-09-23T08:28:00.412 INFO:teuthology.orchestra.run.smithi082.stdout:fi 2023-09-23T08:28:00.413 INFO:teuthology.orchestra.run.smithi082.stdout:preuninstall scriptlet (using /bin/sh): 2023-09-23T08:28:00.413 INFO:teuthology.orchestra.run.smithi082.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-09-23T08:28:00.413 INFO:teuthology.orchestra.run.smithi082.stdout:new-kernel-pkg --remove 6.5.0-rc7-gfef64f93da2b --rminitrd --initrdfile=/boot/initramfs-6.5.0-rc7-gfef64f93da2b.img 2023-09-23T08:28:00.413 INFO:teuthology.orchestra.run.smithi082.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-09-23T08:28:00.413 INFO:teuthology.orchestra.run.smithi082.stdout:kernel-install remove 6.5.0-rc7-gfef64f93da2b 2023-09-23T08:28:00.413 INFO:teuthology.orchestra.run.smithi082.stdout:fi 2023-09-23T08:28:00.413 INFO:teuthology.orchestra.run.smithi082.stdout:postuninstall scriptlet (using /bin/sh): 2023-09-23T08:28:00.413 INFO:teuthology.orchestra.run.smithi082.stdout:if [ -x /sbin/update-bootloader ]; then 2023-09-23T08:28:00.413 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/update-bootloader --remove 6.5.0-rc7-gfef64f93da2b 2023-09-23T08:28:00.413 INFO:teuthology.orchestra.run.smithi082.stdout:fi 2023-09-23T08:28:00.414 DEBUG:teuthology.orchestra.run.smithi082:> sudo rpm -qi grub2-tools 2023-09-23T08:28:00.491 INFO:teuthology.orchestra.run.smithi082.stdout:Name : grub2-tools 2023-09-23T08:28:00.491 INFO:teuthology.orchestra.run.smithi082.stdout:Epoch : 1 2023-09-23T08:28:00.491 INFO:teuthology.orchestra.run.smithi082.stdout:Version : 2.02 2023-09-23T08:28:00.491 INFO:teuthology.orchestra.run.smithi082.stdout:Release : 123.el8 2023-09-23T08:28:00.491 INFO:teuthology.orchestra.run.smithi082.stdout:Architecture: x86_64 2023-09-23T08:28:00.491 INFO:teuthology.orchestra.run.smithi082.stdout:Install Date: Thu 14 Jul 2022 06:22:19 PM UTC 2023-09-23T08:28:00.491 INFO:teuthology.orchestra.run.smithi082.stdout:Group : System Environment/Base 2023-09-23T08:28:00.492 INFO:teuthology.orchestra.run.smithi082.stdout:Size : 9265450 2023-09-23T08:28:00.492 INFO:teuthology.orchestra.run.smithi082.stdout:License : GPLv3+ 2023-09-23T08:28:00.492 INFO:teuthology.orchestra.run.smithi082.stdout:Signature : RSA/SHA256, Thu 31 Mar 2022 07:24:35 PM UTC, Key ID 199e2f91fd431d51 2023-09-23T08:28:00.492 INFO:teuthology.orchestra.run.smithi082.stdout:Source RPM : grub2-2.02-123.el8.src.rpm 2023-09-23T08:28:00.492 INFO:teuthology.orchestra.run.smithi082.stdout:Build Date : Mon 28 Mar 2022 02:12:09 PM UTC 2023-09-23T08:28:00.492 INFO:teuthology.orchestra.run.smithi082.stdout:Build Host : x86-vm-09.build.eng.bos.redhat.com 2023-09-23T08:28:00.492 INFO:teuthology.orchestra.run.smithi082.stdout:Relocations : (not relocatable) 2023-09-23T08:28:00.492 INFO:teuthology.orchestra.run.smithi082.stdout:Packager : Red Hat, Inc. 2023-09-23T08:28:00.492 INFO:teuthology.orchestra.run.smithi082.stdout:Vendor : Red Hat, Inc. 2023-09-23T08:28:00.492 INFO:teuthology.orchestra.run.smithi082.stdout:URL : http://www.gnu.org/software/grub/ 2023-09-23T08:28:00.492 INFO:teuthology.orchestra.run.smithi082.stdout:Summary : Support tools for GRUB. 2023-09-23T08:28:00.492 INFO:teuthology.orchestra.run.smithi082.stdout:Description : 2023-09-23T08:28:00.493 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:28:00.493 INFO:teuthology.orchestra.run.smithi082.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-09-23T08:28:00.493 INFO:teuthology.orchestra.run.smithi082.stdout:customizable bootloader with modular architecture. It supports a rich 2023-09-23T08:28:00.493 INFO:teuthology.orchestra.run.smithi082.stdout:variety of kernel formats, file systems, computer architectures and 2023-09-23T08:28:00.493 INFO:teuthology.orchestra.run.smithi082.stdout:hardware devices. 2023-09-23T08:28:00.493 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:28:00.493 INFO:teuthology.orchestra.run.smithi082.stdout:This subpackage provides tools for support of all platforms. 2023-09-23T08:28:00.494 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-09-23T08:28:00.494 INFO:teuthology.task.kernel:Updating grub on smithi082 to boot 6.5.0-rc7-gfef64f93da2b 2023-09-23T08:28:00.494 DEBUG:teuthology.orchestra.run.smithi082:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-09-23T08:28:01.459 INFO:teuthology.orchestra.run.smithi135.stderr:Generating grub configuration file ... 2023-09-23T08:28:03.713 INFO:teuthology.orchestra.run.smithi135.stderr:done 2023-09-23T08:28:03.715 DEBUG:teuthology.orchestra.run.smithi135:> mktemp 2023-09-23T08:28:03.740 INFO:teuthology.orchestra.run.smithi135.stdout:/tmp/tmp.Iod8Mnk5r4 2023-09-23T08:28:03.741 DEBUG:teuthology.orchestra.run.smithi135:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.Iod8Mnk5r4 2023-09-23T08:28:03.814 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 0666 /tmp/tmp.Iod8Mnk5r4 2023-09-23T08:28:03.961 DEBUG:teuthology.orchestra.remote:smithi135:/tmp/tmp.Iod8Mnk5r4 is 6KB 2023-09-23T08:28:04.008 DEBUG:teuthology.orchestra.run.smithi135:> rm -fr /tmp/tmp.Iod8Mnk5r4 2023-09-23T08:28:04.025 DEBUG:teuthology.orchestra.run.smithi135:> sudo /bin/ls /boot/loader/entries || true 2023-09-23T08:28:04.104 INFO:teuthology.orchestra.run.smithi135.stdout:5a84457b7b52416e95d47d02e2e4a60f-0-rescue.conf 2023-09-23T08:28:04.104 INFO:teuthology.orchestra.run.smithi135.stdout:5a84457b7b52416e95d47d02e2e4a60f-4.18.0-372.9.1.el8.x86_64.conf 2023-09-23T08:28:04.104 INFO:teuthology.orchestra.run.smithi135.stdout:5a84457b7b52416e95d47d02e2e4a60f-6.5.0-rc7-gfef64f93da2b.conf 2023-09-23T08:28:04.105 DEBUG:teuthology.orchestra.run.smithi135:> sudo grub2-set-default 5a84457b7b52416e95d47d02e2e4a60f-6.5.0-rc7-gfef64f93da2b 2023-09-23T08:28:04.280 DEBUG:teuthology.orchestra.run.smithi135:> sudo shutdown -r now 2023-09-23T08:28:05.572 INFO:teuthology.orchestra.run.smithi082.stderr:Generating grub configuration file ... 2023-09-23T08:28:07.814 INFO:teuthology.orchestra.run.smithi082.stderr:done 2023-09-23T08:28:07.818 DEBUG:teuthology.orchestra.run.smithi082:> mktemp 2023-09-23T08:28:07.834 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/tmp.V4atcv7SoU 2023-09-23T08:28:07.835 DEBUG:teuthology.orchestra.run.smithi082:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.V4atcv7SoU 2023-09-23T08:28:07.908 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 0666 /tmp/tmp.V4atcv7SoU 2023-09-23T08:28:08.076 DEBUG:teuthology.orchestra.remote:smithi082:/tmp/tmp.V4atcv7SoU is 6KB 2023-09-23T08:28:08.124 DEBUG:teuthology.orchestra.run.smithi082:> rm -fr /tmp/tmp.V4atcv7SoU 2023-09-23T08:28:08.142 DEBUG:teuthology.orchestra.run.smithi082:> sudo /bin/ls /boot/loader/entries || true 2023-09-23T08:28:08.205 INFO:teuthology.orchestra.run.smithi082.stdout:5a84457b7b52416e95d47d02e2e4a60f-0-rescue.conf 2023-09-23T08:28:08.205 INFO:teuthology.orchestra.run.smithi082.stdout:5a84457b7b52416e95d47d02e2e4a60f-4.18.0-372.9.1.el8.x86_64.conf 2023-09-23T08:28:08.205 INFO:teuthology.orchestra.run.smithi082.stdout:5a84457b7b52416e95d47d02e2e4a60f-6.5.0-rc7-gfef64f93da2b.conf 2023-09-23T08:28:08.206 DEBUG:teuthology.orchestra.run.smithi082:> sudo grub2-set-default 5a84457b7b52416e95d47d02e2e4a60f-6.5.0-rc7-gfef64f93da2b 2023-09-23T08:28:08.377 DEBUG:teuthology.orchestra.run.smithi082:> sudo shutdown -r now 2023-09-23T08:28:10.633 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi161.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-09-23T08:28:10.633 DEBUG:teuthology.orchestra.run.smithi161:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-09-23T08:28:10.691 INFO:teuthology.orchestra.run.smithi161.stdout:/boot/System.map-6.5.0-rc7-gfef64f93da2b 2023-09-23T08:28:10.691 INFO:teuthology.orchestra.run.smithi161.stdout:/boot/config-6.5.0-rc7-gfef64f93da2b 2023-09-23T08:28:10.692 INFO:teuthology.orchestra.run.smithi161.stdout:/boot/vmlinuz-6.5.0-rc7-gfef64f93da2b 2023-09-23T08:28:10.692 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b 2023-09-23T08:28:10.692 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel 2023-09-23T08:28:10.692 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch 2023-09-23T08:28:10.692 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86 2023-09-23T08:28:10.692 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto 2023-09-23T08:28:10.692 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-09-23T08:28:10.692 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-09-23T08:28:10.692 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-09-23T08:28:10.693 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-09-23T08:28:10.693 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-09-23T08:28:10.693 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-09-23T08:28:10.693 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-09-23T08:28:10.693 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crc32c-intel.ko 2023-09-23T08:28:10.693 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-09-23T08:28:10.693 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-09-23T08:28:10.693 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-09-23T08:28:10.693 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-09-23T08:28:10.693 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-avx2.ko 2023-09-23T08:28:10.694 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-09-23T08:28:10.694 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-09-23T08:28:10.694 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-09-23T08:28:10.694 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-09-23T08:28:10.694 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-09-23T08:28:10.694 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-09-23T08:28:10.694 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-09-23T08:28:10.694 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel 2023-09-23T08:28:10.694 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu 2023-09-23T08:28:10.694 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu/mce 2023-09-23T08:28:10.695 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-09-23T08:28:10.695 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm 2023-09-23T08:28:10.695 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm-amd.ko 2023-09-23T08:28:10.695 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm-intel.ko 2023-09-23T08:28:10.695 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm.ko 2023-09-23T08:28:10.695 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto 2023-09-23T08:28:10.695 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/ansi_cprng.ko 2023-09-23T08:28:10.695 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/anubis.ko 2023-09-23T08:28:10.695 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/arc4.ko 2023-09-23T08:28:10.695 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx 2023-09-23T08:28:10.696 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_memcpy.ko 2023-09-23T08:28:10.696 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_pq.ko 2023-09-23T08:28:10.696 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_raid6_recov.ko 2023-09-23T08:28:10.696 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_tx.ko 2023-09-23T08:28:10.696 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_xor.ko 2023-09-23T08:28:10.696 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/raid6test.ko 2023-09-23T08:28:10.696 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/authenc.ko 2023-09-23T08:28:10.696 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/authencesn.ko 2023-09-23T08:28:10.696 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blake2b_generic.ko 2023-09-23T08:28:10.696 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blowfish_common.ko 2023-09-23T08:28:10.697 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blowfish_generic.ko 2023-09-23T08:28:10.697 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/camellia_generic.ko 2023-09-23T08:28:10.697 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast5_generic.ko 2023-09-23T08:28:10.697 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast6_generic.ko 2023-09-23T08:28:10.697 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast_common.ko 2023-09-23T08:28:10.697 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/ccm.ko 2023-09-23T08:28:10.697 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cmac.ko 2023-09-23T08:28:10.697 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crc32_generic.ko 2023-09-23T08:28:10.697 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crypto_engine.ko 2023-09-23T08:28:10.697 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crypto_user.ko 2023-09-23T08:28:10.697 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cts.ko 2023-09-23T08:28:10.698 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/des_generic.ko 2023-09-23T08:28:10.698 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/dh_generic.ko 2023-09-23T08:28:10.698 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/echainiv.ko 2023-09-23T08:28:10.698 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/essiv.ko 2023-09-23T08:28:10.698 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/fcrypt.ko 2023-09-23T08:28:10.698 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/khazad.ko 2023-09-23T08:28:10.698 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/lz4.ko 2023-09-23T08:28:10.698 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/lz4hc.ko 2023-09-23T08:28:10.698 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/md4.ko 2023-09-23T08:28:10.699 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/michael_mic.ko 2023-09-23T08:28:10.699 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/pcbc.ko 2023-09-23T08:28:10.699 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/pcrypt.ko 2023-09-23T08:28:10.699 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/rmd160.ko 2023-09-23T08:28:10.699 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/seed.ko 2023-09-23T08:28:10.699 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/serpent_generic.ko 2023-09-23T08:28:10.699 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/tcrypt.ko 2023-09-23T08:28:10.699 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/tea.ko 2023-09-23T08:28:10.699 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/twofish_common.ko 2023-09-23T08:28:10.699 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/twofish_generic.ko 2023-09-23T08:28:10.699 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/vmac.ko 2023-09-23T08:28:10.700 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/wp512.ko 2023-09-23T08:28:10.700 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xcbc.ko 2023-09-23T08:28:10.700 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xor.ko 2023-09-23T08:28:10.700 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xxhash_generic.ko 2023-09-23T08:28:10.700 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers 2023-09-23T08:28:10.700 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi 2023-09-23T08:28:10.700 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/acpi_ipmi.ko 2023-09-23T08:28:10.700 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/acpi_pad.ko 2023-09-23T08:28:10.700 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/custom_method.ko 2023-09-23T08:28:10.700 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/ec_sys.ko 2023-09-23T08:28:10.700 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/platform_profile.ko 2023-09-23T08:28:10.700 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/sbs.ko 2023-09-23T08:28:10.701 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/sbshc.ko 2023-09-23T08:28:10.701 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/video.ko 2023-09-23T08:28:10.701 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata 2023-09-23T08:28:10.701 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/acard-ahci.ko 2023-09-23T08:28:10.701 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/ahci_platform.ko 2023-09-23T08:28:10.701 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/ata_generic.ko 2023-09-23T08:28:10.701 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/libahci_platform.ko 2023-09-23T08:28:10.701 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_acpi.ko 2023-09-23T08:28:10.701 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ali.ko 2023-09-23T08:28:10.701 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_amd.ko 2023-09-23T08:28:10.701 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_artop.ko 2023-09-23T08:28:10.701 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_atiixp.ko 2023-09-23T08:28:10.702 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_atp867x.ko 2023-09-23T08:28:10.702 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cmd640.ko 2023-09-23T08:28:10.702 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cmd64x.ko 2023-09-23T08:28:10.702 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cypress.ko 2023-09-23T08:28:10.702 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_efar.ko 2023-09-23T08:28:10.702 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt366.ko 2023-09-23T08:28:10.702 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt37x.ko 2023-09-23T08:28:10.702 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt3x2n.ko 2023-09-23T08:28:10.702 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt3x3.ko 2023-09-23T08:28:10.702 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_it8213.ko 2023-09-23T08:28:10.702 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_it821x.ko 2023-09-23T08:28:10.703 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_jmicron.ko 2023-09-23T08:28:10.703 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_marvell.ko 2023-09-23T08:28:10.703 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_mpiix.ko 2023-09-23T08:28:10.703 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_netcell.ko 2023-09-23T08:28:10.703 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ninja32.ko 2023-09-23T08:28:10.703 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ns87410.ko 2023-09-23T08:28:10.703 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ns87415.ko 2023-09-23T08:28:10.703 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_oldpiix.ko 2023-09-23T08:28:10.703 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_opti.ko 2023-09-23T08:28:10.703 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_optidma.ko 2023-09-23T08:28:10.703 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pcmcia.ko 2023-09-23T08:28:10.704 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pdc2027x.ko 2023-09-23T08:28:10.704 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-09-23T08:28:10.704 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_piccolo.ko 2023-09-23T08:28:10.704 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_rdc.ko 2023-09-23T08:28:10.704 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sch.ko 2023-09-23T08:28:10.704 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_serverworks.ko 2023-09-23T08:28:10.704 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sil680.ko 2023-09-23T08:28:10.704 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sis.ko 2023-09-23T08:28:10.704 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sl82c105.ko 2023-09-23T08:28:10.704 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_triflex.ko 2023-09-23T08:28:10.704 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_via.ko 2023-09-23T08:28:10.704 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pdc_adma.ko 2023-09-23T08:28:10.705 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_inic162x.ko 2023-09-23T08:28:10.705 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_mv.ko 2023-09-23T08:28:10.705 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_nv.ko 2023-09-23T08:28:10.705 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_promise.ko 2023-09-23T08:28:10.705 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_qstor.ko 2023-09-23T08:28:10.705 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sil.ko 2023-09-23T08:28:10.705 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sil24.ko 2023-09-23T08:28:10.705 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sis.ko 2023-09-23T08:28:10.705 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_svw.ko 2023-09-23T08:28:10.705 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sx4.ko 2023-09-23T08:28:10.705 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_uli.ko 2023-09-23T08:28:10.705 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_via.ko 2023-09-23T08:28:10.706 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_vsc.ko 2023-09-23T08:28:10.706 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/auxdisplay 2023-09-23T08:28:10.706 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/auxdisplay/ks0108.ko 2023-09-23T08:28:10.706 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base 2023-09-23T08:28:10.706 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap 2023-09-23T08:28:10.706 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap/regmap-i2c.ko 2023-09-23T08:28:10.706 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap/regmap-mmio.ko 2023-09-23T08:28:10.706 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/bcma 2023-09-23T08:28:10.706 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/bcma/bcma.ko 2023-09-23T08:28:10.706 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block 2023-09-23T08:28:10.706 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/aoe 2023-09-23T08:28:10.707 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/aoe/aoe.ko 2023-09-23T08:28:10.707 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/brd.ko 2023-09-23T08:28:10.707 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/drbd 2023-09-23T08:28:10.707 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/drbd/drbd.ko 2023-09-23T08:28:10.707 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/floppy.ko 2023-09-23T08:28:10.707 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/loop.ko 2023-09-23T08:28:10.707 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/mtip32xx 2023-09-23T08:28:10.707 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-09-23T08:28:10.707 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/nbd.ko 2023-09-23T08:28:10.707 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/null_blk 2023-09-23T08:28:10.707 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/null_blk/null_blk.ko 2023-09-23T08:28:10.707 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/pktcdvd.ko 2023-09-23T08:28:10.708 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/rbd.ko 2023-09-23T08:28:10.708 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/virtio_blk.ko 2023-09-23T08:28:10.708 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkback 2023-09-23T08:28:10.708 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-09-23T08:28:10.708 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkfront.ko 2023-09-23T08:28:10.708 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/zram 2023-09-23T08:28:10.708 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/zram/zram.ko 2023-09-23T08:28:10.708 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char 2023-09-23T08:28:10.708 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hangcheck-timer.ko 2023-09-23T08:28:10.708 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random 2023-09-23T08:28:10.708 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/amd-rng.ko 2023-09-23T08:28:10.708 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/intel-rng.ko 2023-09-23T08:28:10.709 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-09-23T08:28:10.709 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/via-rng.ko 2023-09-23T08:28:10.709 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/virtio-rng.ko 2023-09-23T08:28:10.709 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi 2023-09-23T08:28:10.709 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-09-23T08:28:10.709 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-09-23T08:28:10.709 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-09-23T08:28:10.709 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_si.ko 2023-09-23T08:28:10.709 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-09-23T08:28:10.709 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-09-23T08:28:10.709 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/lp.ko 2023-09-23T08:28:10.710 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/mwave 2023-09-23T08:28:10.710 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/mwave/mwave.ko 2023-09-23T08:28:10.710 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ppdev.ko 2023-09-23T08:28:10.710 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tlclk.ko 2023-09-23T08:28:10.710 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm 2023-09-23T08:28:10.710 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm.ko 2023-09-23T08:28:10.710 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_atmel.ko 2023-09-23T08:28:10.710 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_infineon.ko 2023-09-23T08:28:10.710 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_nsc.ko 2023-09-23T08:28:10.710 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_tis.ko 2023-09-23T08:28:10.710 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-09-23T08:28:10.711 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/uv_mmtimer.ko 2023-09-23T08:28:10.711 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/virtio_console.ko 2023-09-23T08:28:10.711 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq 2023-09-23T08:28:10.711 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-09-23T08:28:10.711 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-09-23T08:28:10.711 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/p4-clockmod.ko 2023-09-23T08:28:10.711 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-09-23T08:28:10.711 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/powernow-k8.ko 2023-09-23T08:28:10.711 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/speedstep-lib.ko 2023-09-23T08:28:10.711 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto 2023-09-23T08:28:10.712 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp 2023-09-23T08:28:10.712 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-09-23T08:28:10.712 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp/ccp.ko 2023-09-23T08:28:10.712 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel 2023-09-23T08:28:10.712 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat 2023-09-23T08:28:10.712 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_common 2023-09-23T08:28:10.712 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-09-23T08:28:10.712 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-09-23T08:28:10.712 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-09-23T08:28:10.712 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/padlock-aes.ko 2023-09-23T08:28:10.712 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/padlock-sha.ko 2023-09-23T08:28:10.713 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/virtio 2023-09-23T08:28:10.713 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-09-23T08:28:10.713 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dca 2023-09-23T08:28:10.713 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dca/dca.ko 2023-09-23T08:28:10.713 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/devfreq 2023-09-23T08:28:10.713 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-09-23T08:28:10.713 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma 2023-09-23T08:28:10.713 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/dw 2023-09-23T08:28:10.713 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/dw/dw_dmac.ko 2023-09-23T08:28:10.713 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/ioat 2023-09-23T08:28:10.713 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/ioat/ioatdma.ko 2023-09-23T08:28:10.714 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac 2023-09-23T08:28:10.714 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/amd64_edac.ko 2023-09-23T08:28:10.714 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/e752x_edac.ko 2023-09-23T08:28:10.714 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/edac_mce_amd.ko 2023-09-23T08:28:10.714 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i3000_edac.ko 2023-09-23T08:28:10.714 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i3200_edac.ko 2023-09-23T08:28:10.714 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i5100_edac.ko 2023-09-23T08:28:10.714 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i5400_edac.ko 2023-09-23T08:28:10.714 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i7300_edac.ko 2023-09-23T08:28:10.714 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i7core_edac.ko 2023-09-23T08:28:10.714 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i82975x_edac.ko 2023-09-23T08:28:10.715 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/ie31200_edac.ko 2023-09-23T08:28:10.715 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/sb_edac.ko 2023-09-23T08:28:10.715 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/x38_edac.ko 2023-09-23T08:28:10.715 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware 2023-09-23T08:28:10.715 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/edd.ko 2023-09-23T08:28:10.715 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/iscsi_ibft.ko 2023-09-23T08:28:10.715 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio 2023-09-23T08:28:10.715 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-ich.ko 2023-09-23T08:28:10.715 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-viperboard.ko 2023-09-23T08:28:10.715 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid 2023-09-23T08:28:10.715 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-appleir.ko 2023-09-23T08:28:10.716 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-aureal.ko 2023-09-23T08:28:10.716 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-axff.ko 2023-09-23T08:28:10.716 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-dr.ko 2023-09-23T08:28:10.716 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-elecom.ko 2023-09-23T08:28:10.716 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-elo.ko 2023-09-23T08:28:10.716 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-emsff.ko 2023-09-23T08:28:10.716 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gaff.ko 2023-09-23T08:28:10.716 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gt683r.ko 2023-09-23T08:28:10.716 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gyration.ko 2023-09-23T08:28:10.716 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtek-kbd.ko 2023-09-23T08:28:10.716 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtek-mouse.ko 2023-09-23T08:28:10.716 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtekff.ko 2023-09-23T08:28:10.717 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-hyperv.ko 2023-09-23T08:28:10.717 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-icade.ko 2023-09-23T08:28:10.717 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-keytouch.ko 2023-09-23T08:28:10.717 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-kye.ko 2023-09-23T08:28:10.717 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-lcpower.ko 2023-09-23T08:28:10.717 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-led.ko 2023-09-23T08:28:10.717 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-lenovo.ko 2023-09-23T08:28:10.717 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-logitech-dj.ko 2023-09-23T08:28:10.717 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-09-23T08:28:10.717 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-multitouch.ko 2023-09-23T08:28:10.717 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-ortek.ko 2023-09-23T08:28:10.717 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-penmount.ko 2023-09-23T08:28:10.718 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-petalynx.ko 2023-09-23T08:28:10.718 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-picolcd.ko 2023-09-23T08:28:10.718 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-pl.ko 2023-09-23T08:28:10.718 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-plantronics.ko 2023-09-23T08:28:10.718 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-primax.ko 2023-09-23T08:28:10.718 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-rmi.ko 2023-09-23T08:28:10.718 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-arvo.ko 2023-09-23T08:28:10.718 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-common.ko 2023-09-23T08:28:10.718 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-isku.ko 2023-09-23T08:28:10.718 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-kone.ko 2023-09-23T08:28:10.718 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-09-23T08:28:10.719 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-konepure.ko 2023-09-23T08:28:10.719 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-09-23T08:28:10.719 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-lua.ko 2023-09-23T08:28:10.719 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-pyra.ko 2023-09-23T08:28:10.719 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-ryos.ko 2023-09-23T08:28:10.719 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-savu.ko 2023-09-23T08:28:10.719 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat.ko 2023-09-23T08:28:10.719 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-saitek.ko 2023-09-23T08:28:10.719 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-samsung.ko 2023-09-23T08:28:10.719 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sensor-hub.ko 2023-09-23T08:28:10.719 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sjoy.ko 2023-09-23T08:28:10.719 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sony.ko 2023-09-23T08:28:10.720 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-speedlink.ko 2023-09-23T08:28:10.720 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-steelseries.ko 2023-09-23T08:28:10.720 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sunplus.ko 2023-09-23T08:28:10.720 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-thrustmaster.ko 2023-09-23T08:28:10.720 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-tivo.ko 2023-09-23T08:28:10.720 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-tmff.ko 2023-09-23T08:28:10.720 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-topseed.ko 2023-09-23T08:28:10.720 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-twinhan.ko 2023-09-23T08:28:10.720 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-uclogic.ko 2023-09-23T08:28:10.720 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-waltop.ko 2023-09-23T08:28:10.720 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-wiimote.ko 2023-09-23T08:28:10.720 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-xinmo.ko 2023-09-23T08:28:10.721 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-zpff.ko 2023-09-23T08:28:10.721 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-zydacron.ko 2023-09-23T08:28:10.721 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/uhid.ko 2023-09-23T08:28:10.721 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/wacom.ko 2023-09-23T08:28:10.721 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv 2023-09-23T08:28:10.721 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_balloon.ko 2023-09-23T08:28:10.721 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_utils.ko 2023-09-23T08:28:10.721 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_vmbus.ko 2023-09-23T08:28:10.721 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon 2023-09-23T08:28:10.721 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/abituguru.ko 2023-09-23T08:28:10.721 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/abituguru3.ko 2023-09-23T08:28:10.721 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/acpi_power_meter.ko 2023-09-23T08:28:10.722 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ad7414.ko 2023-09-23T08:28:10.722 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ad7418.ko 2023-09-23T08:28:10.722 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adc128d818.ko 2023-09-23T08:28:10.722 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1025.ko 2023-09-23T08:28:10.722 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1026.ko 2023-09-23T08:28:10.722 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1029.ko 2023-09-23T08:28:10.722 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1031.ko 2023-09-23T08:28:10.722 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm9240.ko 2023-09-23T08:28:10.722 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ads7828.ko 2023-09-23T08:28:10.722 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7410.ko 2023-09-23T08:28:10.723 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7411.ko 2023-09-23T08:28:10.723 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7462.ko 2023-09-23T08:28:10.723 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7470.ko 2023-09-23T08:28:10.723 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7475.ko 2023-09-23T08:28:10.723 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7x10.ko 2023-09-23T08:28:10.723 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/amc6821.ko 2023-09-23T08:28:10.723 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/applesmc.ko 2023-09-23T08:28:10.723 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asb100.ko 2023-09-23T08:28:10.723 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asc7621.ko 2023-09-23T08:28:10.723 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asus_atk0110.ko 2023-09-23T08:28:10.723 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/atxp1.ko 2023-09-23T08:28:10.723 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/coretemp.ko 2023-09-23T08:28:10.724 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-09-23T08:28:10.724 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/dme1737.ko 2023-09-23T08:28:10.724 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ds1621.ko 2023-09-23T08:28:10.724 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ds620.ko 2023-09-23T08:28:10.724 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/emc1403.ko 2023-09-23T08:28:10.724 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/emc6w201.ko 2023-09-23T08:28:10.724 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f71805f.ko 2023-09-23T08:28:10.724 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f71882fg.ko 2023-09-23T08:28:10.724 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f75375s.ko 2023-09-23T08:28:10.724 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/fam15h_power.ko 2023-09-23T08:28:10.724 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/fschmd.ko 2023-09-23T08:28:10.725 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/g760a.ko 2023-09-23T08:28:10.725 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/g762.ko 2023-09-23T08:28:10.725 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/gl518sm.ko 2023-09-23T08:28:10.725 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/gl520sm.ko 2023-09-23T08:28:10.725 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/hwmon-vid.ko 2023-09-23T08:28:10.725 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/i5500_temp.ko 2023-09-23T08:28:10.725 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/i5k_amb.ko 2023-09-23T08:28:10.725 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ibmaem.ko 2023-09-23T08:28:10.725 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ibmpex.ko 2023-09-23T08:28:10.725 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ina209.ko 2023-09-23T08:28:10.725 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ina2xx.ko 2023-09-23T08:28:10.725 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/it87.ko 2023-09-23T08:28:10.726 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/k10temp.ko 2023-09-23T08:28:10.726 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/k8temp.ko 2023-09-23T08:28:10.726 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lineage-pem.ko 2023-09-23T08:28:10.726 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm63.ko 2023-09-23T08:28:10.726 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm73.ko 2023-09-23T08:28:10.726 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm75.ko 2023-09-23T08:28:10.726 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm77.ko 2023-09-23T08:28:10.726 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm78.ko 2023-09-23T08:28:10.726 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm80.ko 2023-09-23T08:28:10.726 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm83.ko 2023-09-23T08:28:10.726 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm85.ko 2023-09-23T08:28:10.726 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm87.ko 2023-09-23T08:28:10.727 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm90.ko 2023-09-23T08:28:10.727 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm92.ko 2023-09-23T08:28:10.727 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm93.ko 2023-09-23T08:28:10.727 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95234.ko 2023-09-23T08:28:10.727 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95241.ko 2023-09-23T08:28:10.727 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95245.ko 2023-09-23T08:28:10.727 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc2945.ko 2023-09-23T08:28:10.727 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4151.ko 2023-09-23T08:28:10.727 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4215.ko 2023-09-23T08:28:10.727 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4222.ko 2023-09-23T08:28:10.727 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4245.ko 2023-09-23T08:28:10.727 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4260.ko 2023-09-23T08:28:10.728 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4261.ko 2023-09-23T08:28:10.728 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max16065.ko 2023-09-23T08:28:10.728 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max1619.ko 2023-09-23T08:28:10.728 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max1668.ko 2023-09-23T08:28:10.728 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max197.ko 2023-09-23T08:28:10.728 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6639.ko 2023-09-23T08:28:10.728 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6650.ko 2023-09-23T08:28:10.728 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6697.ko 2023-09-23T08:28:10.728 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/mcp3021.ko 2023-09-23T08:28:10.728 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6683.ko 2023-09-23T08:28:10.728 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6775-core.ko 2023-09-23T08:28:10.728 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6775.ko 2023-09-23T08:28:10.729 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct7802.ko 2023-09-23T08:28:10.729 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pc87360.ko 2023-09-23T08:28:10.729 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pc87427.ko 2023-09-23T08:28:10.729 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pcf8591.ko 2023-09-23T08:28:10.729 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus 2023-09-23T08:28:10.729 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-09-23T08:28:10.729 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-09-23T08:28:10.729 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-09-23T08:28:10.729 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max16064.ko 2023-09-23T08:28:10.729 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max34440.ko 2023-09-23T08:28:10.729 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max8688.ko 2023-09-23T08:28:10.730 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-09-23T08:28:10.730 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-09-23T08:28:10.730 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-09-23T08:28:10.730 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-09-23T08:28:10.730 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-09-23T08:28:10.730 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-09-23T08:28:10.730 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/powr1220.ko 2023-09-23T08:28:10.730 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch5627.ko 2023-09-23T08:28:10.730 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch5636.ko 2023-09-23T08:28:10.730 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch56xx-common.ko 2023-09-23T08:28:10.730 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sht15.ko 2023-09-23T08:28:10.731 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sht21.ko 2023-09-23T08:28:10.731 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/shtc1.ko 2023-09-23T08:28:10.731 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sis5595.ko 2023-09-23T08:28:10.731 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47b397.ko 2023-09-23T08:28:10.731 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47m1.ko 2023-09-23T08:28:10.731 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47m192.ko 2023-09-23T08:28:10.731 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/thmc50.ko 2023-09-23T08:28:10.731 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp102.ko 2023-09-23T08:28:10.731 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp103.ko 2023-09-23T08:28:10.731 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp401.ko 2023-09-23T08:28:10.731 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp421.ko 2023-09-23T08:28:10.731 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/via-cputemp.ko 2023-09-23T08:28:10.732 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/via686a.ko 2023-09-23T08:28:10.732 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/vt1211.ko 2023-09-23T08:28:10.732 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/vt8231.ko 2023-09-23T08:28:10.732 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83627ehf.ko 2023-09-23T08:28:10.732 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83627hf.ko 2023-09-23T08:28:10.732 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83781d.ko 2023-09-23T08:28:10.732 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83791d.ko 2023-09-23T08:28:10.732 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83792d.ko 2023-09-23T08:28:10.732 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83793.ko 2023-09-23T08:28:10.732 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83795.ko 2023-09-23T08:28:10.732 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83l785ts.ko 2023-09-23T08:28:10.733 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83l786ng.ko 2023-09-23T08:28:10.733 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c 2023-09-23T08:28:10.733 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos 2023-09-23T08:28:10.733 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-09-23T08:28:10.733 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-09-23T08:28:10.733 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses 2023-09-23T08:28:10.733 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-09-23T08:28:10.733 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-09-23T08:28:10.733 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-09-23T08:28:10.733 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-09-23T08:28:10.733 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-09-23T08:28:10.734 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-09-23T08:28:10.734 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-09-23T08:28:10.734 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-09-23T08:28:10.734 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-i801.ko 2023-09-23T08:28:10.734 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-isch.ko 2023-09-23T08:28:10.734 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-09-23T08:28:10.734 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-09-23T08:28:10.734 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-09-23T08:28:10.734 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-parport.ko 2023-09-23T08:28:10.734 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-09-23T08:28:10.734 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-09-23T08:28:10.735 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-09-23T08:28:10.735 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-09-23T08:28:10.735 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-09-23T08:28:10.735 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-09-23T08:28:10.735 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-via.ko 2023-09-23T08:28:10.735 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-09-23T08:28:10.735 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-09-23T08:28:10.735 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-dev.ko 2023-09-23T08:28:10.735 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-mux.ko 2023-09-23T08:28:10.735 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-09-23T08:28:10.735 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-smbus.ko 2023-09-23T08:28:10.735 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-stub.ko 2023-09-23T08:28:10.736 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband 2023-09-23T08:28:10.736 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core 2023-09-23T08:28:10.736 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_cm.ko 2023-09-23T08:28:10.736 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_core.ko 2023-09-23T08:28:10.736 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_umad.ko 2023-09-23T08:28:10.736 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-09-23T08:28:10.736 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/iw_cm.ko 2023-09-23T08:28:10.736 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/rdma_cm.ko 2023-09-23T08:28:10.736 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-09-23T08:28:10.736 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw 2023-09-23T08:28:10.736 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/cxgb4 2023-09-23T08:28:10.736 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-09-23T08:28:10.737 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx4 2023-09-23T08:28:10.737 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-09-23T08:28:10.737 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx5 2023-09-23T08:28:10.737 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-09-23T08:28:10.737 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mthca 2023-09-23T08:28:10.737 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-09-23T08:28:10.737 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp 2023-09-23T08:28:10.737 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/ipoib 2023-09-23T08:28:10.737 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-09-23T08:28:10.737 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/iser 2023-09-23T08:28:10.737 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-09-23T08:28:10.737 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/isert 2023-09-23T08:28:10.738 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-09-23T08:28:10.738 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srp 2023-09-23T08:28:10.738 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-09-23T08:28:10.738 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srpt 2023-09-23T08:28:10.738 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-09-23T08:28:10.738 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input 2023-09-23T08:28:10.738 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport 2023-09-23T08:28:10.738 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-09-23T08:28:10.738 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/fm801-gp.ko 2023-09-23T08:28:10.738 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/gameport.ko 2023-09-23T08:28:10.738 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/lightning.ko 2023-09-23T08:28:10.738 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/ns558.ko 2023-09-23T08:28:10.739 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/joydev.ko 2023-09-23T08:28:10.739 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard 2023-09-23T08:28:10.739 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/gpio_keys.ko 2023-09-23T08:28:10.739 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse 2023-09-23T08:28:10.739 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/appletouch.ko 2023-09-23T08:28:10.739 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/bcm5974.ko 2023-09-23T08:28:10.739 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/cyapatp.ko 2023-09-23T08:28:10.739 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/elan_i2c.ko 2023-09-23T08:28:10.739 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/sermouse.ko 2023-09-23T08:28:10.739 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-09-23T08:28:10.739 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/synaptics_usb.ko 2023-09-23T08:28:10.739 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/vsxxxaa.ko 2023-09-23T08:28:10.740 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/rmi4 2023-09-23T08:28:10.740 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/rmi4/rmi_core.ko 2023-09-23T08:28:10.740 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio 2023-09-23T08:28:10.740 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/altera_ps2.ko 2023-09-23T08:28:10.740 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/arc_ps2.ko 2023-09-23T08:28:10.740 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-09-23T08:28:10.740 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/serio_raw.ko 2023-09-23T08:28:10.740 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/sparse-keymap.ko 2023-09-23T08:28:10.740 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu 2023-09-23T08:28:10.740 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu/amd 2023-09-23T08:28:10.740 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu/amd/iommu_v2.ko 2023-09-23T08:28:10.741 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds 2023-09-23T08:28:10.741 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-blinkm.ko 2023-09-23T08:28:10.741 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lm3530.ko 2023-09-23T08:28:10.741 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lp3944.ko 2023-09-23T08:28:10.741 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-ss4200.ko 2023-09-23T08:28:10.741 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger 2023-09-23T08:28:10.741 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-09-23T08:28:10.741 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-09-23T08:28:10.741 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-09-23T08:28:10.741 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-09-23T08:28:10.741 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-09-23T08:28:10.741 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-09-23T08:28:10.742 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-09-23T08:28:10.742 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-09-23T08:28:10.742 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md 2023-09-23T08:28:10.742 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/bcache 2023-09-23T08:28:10.742 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/bcache/bcache.ko 2023-09-23T08:28:10.742 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-bio-prison.ko 2023-09-23T08:28:10.742 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-cache-smq.ko 2023-09-23T08:28:10.742 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-cache.ko 2023-09-23T08:28:10.742 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-crypt.ko 2023-09-23T08:28:10.742 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-delay.ko 2023-09-23T08:28:10.742 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-flakey.ko 2023-09-23T08:28:10.742 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-log-userspace.ko 2023-09-23T08:28:10.743 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-multipath.ko 2023-09-23T08:28:10.743 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-queue-length.ko 2023-09-23T08:28:10.743 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-raid.ko 2023-09-23T08:28:10.743 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-round-robin.ko 2023-09-23T08:28:10.743 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-service-time.ko 2023-09-23T08:28:10.743 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-switch.ko 2023-09-23T08:28:10.743 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-thin-pool.ko 2023-09-23T08:28:10.743 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-verity.ko 2023-09-23T08:28:10.743 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/faulty.ko 2023-09-23T08:28:10.743 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/linear.ko 2023-09-23T08:28:10.743 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/multipath.ko 2023-09-23T08:28:10.743 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/persistent-data 2023-09-23T08:28:10.744 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-09-23T08:28:10.744 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid0.ko 2023-09-23T08:28:10.744 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid1.ko 2023-09-23T08:28:10.744 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid10.ko 2023-09-23T08:28:10.744 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid456.ko 2023-09-23T08:28:10.744 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message 2023-09-23T08:28:10.744 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion 2023-09-23T08:28:10.744 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptbase.ko 2023-09-23T08:28:10.744 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptctl.ko 2023-09-23T08:28:10.744 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptfc.ko 2023-09-23T08:28:10.744 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptlan.ko 2023-09-23T08:28:10.744 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptsas.ko 2023-09-23T08:28:10.745 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptscsih.ko 2023-09-23T08:28:10.745 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptspi.ko 2023-09-23T08:28:10.745 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd 2023-09-23T08:28:10.745 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lpc_ich.ko 2023-09-23T08:28:10.745 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lpc_sch.ko 2023-09-23T08:28:10.745 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/mfd-core.ko 2023-09-23T08:28:10.745 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/sm501.ko 2023-09-23T08:28:10.745 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/viperboard.ko 2023-09-23T08:28:10.745 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/vx855.ko 2023-09-23T08:28:10.745 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/wl1273-core.ko 2023-09-23T08:28:10.745 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc 2023-09-23T08:28:10.745 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/altera-stapl 2023-09-23T08:28:10.746 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-09-23T08:28:10.746 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/apds9802als.ko 2023-09-23T08:28:10.746 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/apds990x.ko 2023-09-23T08:28:10.746 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/bh1770glc.ko 2023-09-23T08:28:10.746 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/cb710 2023-09-23T08:28:10.746 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/cb710/cb710.ko 2023-09-23T08:28:10.746 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom 2023-09-23T08:28:10.746 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/at24.ko 2023-09-23T08:28:10.746 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/eeprom.ko 2023-09-23T08:28:10.746 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-09-23T08:28:10.746 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/max6875.ko 2023-09-23T08:28:10.747 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/enclosure.ko 2023-09-23T08:28:10.747 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/hpilo.ko 2023-09-23T08:28:10.747 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/isl29003.ko 2023-09-23T08:28:10.747 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/isl29020.ko 2023-09-23T08:28:10.747 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d 2023-09-23T08:28:10.747 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-09-23T08:28:10.747 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-09-23T08:28:10.747 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei 2023-09-23T08:28:10.747 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei-me.ko 2023-09-23T08:28:10.747 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei-txe.ko 2023-09-23T08:28:10.747 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei.ko 2023-09-23T08:28:10.747 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-gru 2023-09-23T08:28:10.748 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-gru/gru.ko 2023-09-23T08:28:10.748 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp 2023-09-23T08:28:10.748 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xp.ko 2023-09-23T08:28:10.748 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xpc.ko 2023-09-23T08:28:10.748 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-09-23T08:28:10.748 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tifm_7xx1.ko 2023-09-23T08:28:10.748 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tifm_core.ko 2023-09-23T08:28:10.748 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tsl2550.ko 2023-09-23T08:28:10.748 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_balloon.ko 2023-09-23T08:28:10.748 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_vmci 2023-09-23T08:28:10.748 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-09-23T08:28:10.748 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net 2023-09-23T08:28:10.749 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/bonding 2023-09-23T08:28:10.749 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/bonding/bonding.ko 2023-09-23T08:28:10.749 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa 2023-09-23T08:28:10.749 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/b53 2023-09-23T08:28:10.749 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/b53/b53_common.ko 2023-09-23T08:28:10.749 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/bcm-sf2.ko 2023-09-23T08:28:10.749 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6060.ko 2023-09-23T08:28:10.749 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6xxx 2023-09-23T08:28:10.749 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-09-23T08:28:10.749 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dummy.ko 2023-09-23T08:28:10.749 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/eql.ko 2023-09-23T08:28:10.750 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet 2023-09-23T08:28:10.750 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com 2023-09-23T08:28:10.750 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-09-23T08:28:10.750 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-09-23T08:28:10.750 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-09-23T08:28:10.750 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-09-23T08:28:10.750 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390 2023-09-23T08:28:10.750 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/8390.ko 2023-09-23T08:28:10.750 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-09-23T08:28:10.750 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-09-23T08:28:10.750 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-09-23T08:28:10.750 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/adaptec 2023-09-23T08:28:10.751 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-09-23T08:28:10.751 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/agere 2023-09-23T08:28:10.751 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/agere/et131x.ko 2023-09-23T08:28:10.751 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/alteon 2023-09-23T08:28:10.751 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-09-23T08:28:10.751 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/altera 2023-09-23T08:28:10.751 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-09-23T08:28:10.751 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd 2023-09-23T08:28:10.751 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-09-23T08:28:10.751 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-09-23T08:28:10.751 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-09-23T08:28:10.751 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros 2023-09-23T08:28:10.752 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/alx 2023-09-23T08:28:10.752 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-09-23T08:28:10.752 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1c 2023-09-23T08:28:10.752 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-09-23T08:28:10.752 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1e 2023-09-23T08:28:10.752 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-09-23T08:28:10.752 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx 2023-09-23T08:28:10.752 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-09-23T08:28:10.752 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-09-23T08:28:10.752 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom 2023-09-23T08:28:10.752 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-09-23T08:28:10.753 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-09-23T08:28:10.753 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-09-23T08:28:10.753 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-09-23T08:28:10.753 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-09-23T08:28:10.753 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/genet 2023-09-23T08:28:10.753 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-09-23T08:28:10.753 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-09-23T08:28:10.753 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade 2023-09-23T08:28:10.753 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade/bna 2023-09-23T08:28:10.753 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-09-23T08:28:10.753 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio 2023-09-23T08:28:10.753 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb 2023-09-23T08:28:10.754 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-09-23T08:28:10.754 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-09-23T08:28:10.754 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-09-23T08:28:10.754 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-09-23T08:28:10.754 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-09-23T08:28:10.754 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-09-23T08:28:10.754 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-09-23T08:28:10.754 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-09-23T08:28:10.754 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-09-23T08:28:10.754 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco 2023-09-23T08:28:10.754 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco/enic 2023-09-23T08:28:10.755 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-09-23T08:28:10.755 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec 2023-09-23T08:28:10.755 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip 2023-09-23T08:28:10.755 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-09-23T08:28:10.755 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-09-23T08:28:10.755 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-09-23T08:28:10.755 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-09-23T08:28:10.755 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-09-23T08:28:10.755 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-09-23T08:28:10.755 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink 2023-09-23T08:28:10.755 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-09-23T08:28:10.755 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-09-23T08:28:10.756 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dnet.ko 2023-09-23T08:28:10.756 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex 2023-09-23T08:28:10.756 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex/benet 2023-09-23T08:28:10.756 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-09-23T08:28:10.756 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ethoc.ko 2023-09-23T08:28:10.756 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/fealnx.ko 2023-09-23T08:28:10.756 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel 2023-09-23T08:28:10.756 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e100.ko 2023-09-23T08:28:10.756 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000 2023-09-23T08:28:10.756 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-09-23T08:28:10.756 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000e 2023-09-23T08:28:10.756 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-09-23T08:28:10.757 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/fm10k 2023-09-23T08:28:10.757 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-09-23T08:28:10.757 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/i40e 2023-09-23T08:28:10.757 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-09-23T08:28:10.757 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/iavf 2023-09-23T08:28:10.757 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-09-23T08:28:10.757 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igb 2023-09-23T08:28:10.757 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-09-23T08:28:10.757 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igbvf 2023-09-23T08:28:10.757 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-09-23T08:28:10.757 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbe 2023-09-23T08:28:10.757 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-09-23T08:28:10.758 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbevf 2023-09-23T08:28:10.758 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-09-23T08:28:10.758 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/jme.ko 2023-09-23T08:28:10.758 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell 2023-09-23T08:28:10.758 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-09-23T08:28:10.758 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/skge.ko 2023-09-23T08:28:10.758 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-09-23T08:28:10.758 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox 2023-09-23T08:28:10.758 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4 2023-09-23T08:28:10.758 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-09-23T08:28:10.758 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-09-23T08:28:10.759 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5 2023-09-23T08:28:10.759 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-09-23T08:28:10.759 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-09-23T08:28:10.759 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel 2023-09-23T08:28:10.759 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-09-23T08:28:10.759 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom 2023-09-23T08:28:10.759 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom/myri10ge 2023-09-23T08:28:10.759 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-09-23T08:28:10.759 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi 2023-09-23T08:28:10.759 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-09-23T08:28:10.759 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-09-23T08:28:10.760 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/neterion 2023-09-23T08:28:10.760 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-09-23T08:28:10.760 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/nvidia 2023-09-23T08:28:10.760 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-09-23T08:28:10.760 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines 2023-09-23T08:28:10.760 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-09-23T08:28:10.760 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-09-23T08:28:10.760 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic 2023-09-23T08:28:10.760 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/netxen 2023-09-23T08:28:10.760 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-09-23T08:28:10.760 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-09-23T08:28:10.760 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-09-23T08:28:10.761 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-09-23T08:28:10.761 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rdc 2023-09-23T08:28:10.761 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-09-23T08:28:10.761 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek 2023-09-23T08:28:10.761 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-09-23T08:28:10.761 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-09-23T08:28:10.761 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/atp.ko 2023-09-23T08:28:10.761 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-09-23T08:28:10.761 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rocker 2023-09-23T08:28:10.761 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-09-23T08:28:10.761 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sfc 2023-09-23T08:28:10.761 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-09-23T08:28:10.762 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/silan 2023-09-23T08:28:10.762 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-09-23T08:28:10.762 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis 2023-09-23T08:28:10.762 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis/sis190.ko 2023-09-23T08:28:10.762 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis/sis900.ko 2023-09-23T08:28:10.762 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc 2023-09-23T08:28:10.762 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-09-23T08:28:10.762 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-09-23T08:28:10.762 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-09-23T08:28:10.762 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-09-23T08:28:10.762 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro 2023-09-23T08:28:10.763 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac 2023-09-23T08:28:10.763 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-09-23T08:28:10.763 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-09-23T08:28:10.763 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun 2023-09-23T08:28:10.763 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/cassini.ko 2023-09-23T08:28:10.763 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/niu.ko 2023-09-23T08:28:10.763 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/sungem.ko 2023-09-23T08:28:10.763 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-09-23T08:28:10.763 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/tehuti 2023-09-23T08:28:10.763 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-09-23T08:28:10.763 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ti 2023-09-23T08:28:10.763 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ti/tlan.ko 2023-09-23T08:28:10.764 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via 2023-09-23T08:28:10.764 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-09-23T08:28:10.764 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-09-23T08:28:10.764 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet 2023-09-23T08:28:10.764 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-09-23T08:28:10.764 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-09-23T08:28:10.764 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/xircom 2023-09-23T08:28:10.764 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-09-23T08:28:10.764 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/geneve.ko 2023-09-23T08:28:10.764 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/hyperv 2023-09-23T08:28:10.764 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-09-23T08:28:10.764 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ieee802154 2023-09-23T08:28:10.765 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ieee802154/fakelb.ko 2023-09-23T08:28:10.765 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ifb.ko 2023-09-23T08:28:10.765 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ipvlan 2023-09-23T08:28:10.765 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ipvlan/ipvlan.ko 2023-09-23T08:28:10.765 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/macvlan.ko 2023-09-23T08:28:10.765 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/macvtap.ko 2023-09-23T08:28:10.765 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio 2023-09-23T08:28:10.765 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio.ko 2023-09-23T08:28:10.765 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-09-23T08:28:10.765 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-09-23T08:28:10.765 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-regmap.ko 2023-09-23T08:28:10.765 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mii.ko 2023-09-23T08:28:10.766 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/net_failover.ko 2023-09-23T08:28:10.766 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/netconsole.ko 2023-09-23T08:28:10.766 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/nlmon.ko 2023-09-23T08:28:10.766 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs 2023-09-23T08:28:10.766 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs/pcs-lynx.ko 2023-09-23T08:28:10.766 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-09-23T08:28:10.766 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy 2023-09-23T08:28:10.766 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/amd.ko 2023-09-23T08:28:10.766 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-09-23T08:28:10.766 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-09-23T08:28:10.766 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm7xxx.ko 2023-09-23T08:28:10.766 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm87xx.ko 2023-09-23T08:28:10.767 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/broadcom.ko 2023-09-23T08:28:10.767 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/cicada.ko 2023-09-23T08:28:10.767 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/davicom.ko 2023-09-23T08:28:10.767 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/dp83640.ko 2023-09-23T08:28:10.767 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/et1011c.ko 2023-09-23T08:28:10.767 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/icplus.ko 2023-09-23T08:28:10.767 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/lxt.ko 2023-09-23T08:28:10.767 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/marvell.ko 2023-09-23T08:28:10.767 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/micrel.ko 2023-09-23T08:28:10.767 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/national.ko 2023-09-23T08:28:10.767 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/phylink.ko 2023-09-23T08:28:10.768 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/qsemi.ko 2023-09-23T08:28:10.768 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/realtek.ko 2023-09-23T08:28:10.768 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/smsc.ko 2023-09-23T08:28:10.768 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/ste10Xp.ko 2023-09-23T08:28:10.768 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/vitesse.ko 2023-09-23T08:28:10.768 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp 2023-09-23T08:28:10.768 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/bsd_comp.ko 2023-09-23T08:28:10.768 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_async.ko 2023-09-23T08:28:10.768 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_deflate.ko 2023-09-23T08:28:10.768 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_generic.ko 2023-09-23T08:28:10.768 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_mppe.ko 2023-09-23T08:28:10.768 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_synctty.ko 2023-09-23T08:28:10.769 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pppoe.ko 2023-09-23T08:28:10.769 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pppox.ko 2023-09-23T08:28:10.769 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pptp.ko 2023-09-23T08:28:10.769 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip 2023-09-23T08:28:10.769 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip/slhc.ko 2023-09-23T08:28:10.769 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip/slip.ko 2023-09-23T08:28:10.769 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/sungem_phy.ko 2023-09-23T08:28:10.769 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/tap.ko 2023-09-23T08:28:10.769 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team 2023-09-23T08:28:10.769 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team.ko 2023-09-23T08:28:10.769 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_activebackup.ko 2023-09-23T08:28:10.769 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_broadcast.ko 2023-09-23T08:28:10.770 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-09-23T08:28:10.770 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_random.ko 2023-09-23T08:28:10.770 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-09-23T08:28:10.770 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/tun.ko 2023-09-23T08:28:10.770 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/veth.ko 2023-09-23T08:28:10.770 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/virtio_net.ko 2023-09-23T08:28:10.770 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vmxnet3 2023-09-23T08:28:10.770 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-09-23T08:28:10.770 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vxlan 2023-09-23T08:28:10.770 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vxlan/vxlan.ko 2023-09-23T08:28:10.770 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netback 2023-09-23T08:28:10.770 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netback/xen-netback.ko 2023-09-23T08:28:10.771 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netfront.ko 2023-09-23T08:28:10.771 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ntb 2023-09-23T08:28:10.771 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ntb/ntb.ko 2023-09-23T08:28:10.771 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme 2023-09-23T08:28:10.771 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host 2023-09-23T08:28:10.771 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host/nvme-core.ko 2023-09-23T08:28:10.771 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host/nvme.ko 2023-09-23T08:28:10.771 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport 2023-09-23T08:28:10.771 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport.ko 2023-09-23T08:28:10.771 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_cs.ko 2023-09-23T08:28:10.771 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_pc.ko 2023-09-23T08:28:10.772 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_serial.ko 2023-09-23T08:28:10.772 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci 2023-09-23T08:28:10.772 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug 2023-09-23T08:28:10.772 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-09-23T08:28:10.772 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/pcie 2023-09-23T08:28:10.772 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/pcie/aer_inject.ko 2023-09-23T08:28:10.772 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/xen-pcifront.ko 2023-09-23T08:28:10.772 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia 2023-09-23T08:28:10.772 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/i82092.ko 2023-09-23T08:28:10.772 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/pd6729.ko 2023-09-23T08:28:10.772 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/yenta_socket.ko 2023-09-23T08:28:10.772 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl 2023-09-23T08:28:10.773 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl/intel 2023-09-23T08:28:10.773 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-09-23T08:28:10.773 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform 2023-09-23T08:28:10.773 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86 2023-09-23T08:28:10.773 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/acer-wmi.ko 2023-09-23T08:28:10.773 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/acerhdf.ko 2023-09-23T08:28:10.773 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/apple-gmux.ko 2023-09-23T08:28:10.773 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-laptop.ko 2023-09-23T08:28:10.773 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-09-23T08:28:10.773 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-wmi.ko 2023-09-23T08:28:10.773 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/classmate-laptop.ko 2023-09-23T08:28:10.774 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-09-23T08:28:10.774 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-09-23T08:28:10.774 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-09-23T08:28:10.774 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-09-23T08:28:10.774 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/hdaps.ko 2023-09-23T08:28:10.774 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel 2023-09-23T08:28:10.774 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-09-23T08:28:10.774 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel_ips.ko 2023-09-23T08:28:10.774 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/msi-wmi.ko 2023-09-23T08:28:10.774 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/mxm-wmi.ko 2023-09-23T08:28:10.774 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-09-23T08:28:10.775 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/samsung-laptop.ko 2023-09-23T08:28:10.775 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/samsung-q10.ko 2023-09-23T08:28:10.775 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/topstar-laptop.ko 2023-09-23T08:28:10.775 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-09-23T08:28:10.775 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/toshiba_haps.ko 2023-09-23T08:28:10.775 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/wmi-bmof.ko 2023-09-23T08:28:10.775 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/wmi.ko 2023-09-23T08:28:10.775 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap 2023-09-23T08:28:10.775 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap/intel_rapl_common.ko 2023-09-23T08:28:10.775 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap/intel_rapl_msr.ko 2023-09-23T08:28:10.775 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps 2023-09-23T08:28:10.775 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients 2023-09-23T08:28:10.776 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps-gpio.ko 2023-09-23T08:28:10.776 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps-ldisc.ko 2023-09-23T08:28:10.776 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps_parport.ko 2023-09-23T08:28:10.776 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/pps_core.ko 2023-09-23T08:28:10.776 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp 2023-09-23T08:28:10.776 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp/ptp.ko 2023-09-23T08:28:10.776 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp/ptp_kvm.ko 2023-09-23T08:28:10.776 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc 2023-09-23T08:28:10.776 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-bq32k.ko 2023-09-23T08:28:10.776 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-bq4802.ko 2023-09-23T08:28:10.776 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1286.ko 2023-09-23T08:28:10.777 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1307.ko 2023-09-23T08:28:10.777 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1374.ko 2023-09-23T08:28:10.777 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1511.ko 2023-09-23T08:28:10.777 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1553.ko 2023-09-23T08:28:10.777 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1672.ko 2023-09-23T08:28:10.777 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1742.ko 2023-09-23T08:28:10.777 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds2404.ko 2023-09-23T08:28:10.777 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds3232.ko 2023-09-23T08:28:10.777 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-em3027.ko 2023-09-23T08:28:10.777 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-fm3130.ko 2023-09-23T08:28:10.777 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-isl12022.ko 2023-09-23T08:28:10.778 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-isl1208.ko 2023-09-23T08:28:10.778 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m41t80.ko 2023-09-23T08:28:10.778 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m48t35.ko 2023-09-23T08:28:10.778 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m48t59.ko 2023-09-23T08:28:10.778 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-max6900.ko 2023-09-23T08:28:10.778 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-msm6242.ko 2023-09-23T08:28:10.778 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf2127.ko 2023-09-23T08:28:10.778 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf85063.ko 2023-09-23T08:28:10.778 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8523.ko 2023-09-23T08:28:10.778 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8563.ko 2023-09-23T08:28:10.778 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8583.ko 2023-09-23T08:28:10.779 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rp5c01.ko 2023-09-23T08:28:10.779 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rs5c372.ko 2023-09-23T08:28:10.779 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-09-23T08:28:10.779 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rx8025.ko 2023-09-23T08:28:10.779 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rx8581.ko 2023-09-23T08:28:10.779 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-09-23T08:28:10.779 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-x1205.ko 2023-09-23T08:28:10.779 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi 2023-09-23T08:28:10.779 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-9xxx.ko 2023-09-23T08:28:10.779 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-sas.ko 2023-09-23T08:28:10.779 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-xxxx.ko 2023-09-23T08:28:10.779 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/BusLogic.ko 2023-09-23T08:28:10.780 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/a100u2w.ko 2023-09-23T08:28:10.780 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aacraid 2023-09-23T08:28:10.780 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aacraid/aacraid.ko 2023-09-23T08:28:10.780 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/advansys.ko 2023-09-23T08:28:10.780 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx 2023-09-23T08:28:10.780 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-09-23T08:28:10.780 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-09-23T08:28:10.780 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/am53c974.ko 2023-09-23T08:28:10.780 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/arcmsr 2023-09-23T08:28:10.780 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-09-23T08:28:10.780 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/atp870u.ko 2023-09-23T08:28:10.780 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/be2iscsi 2023-09-23T08:28:10.781 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-09-23T08:28:10.781 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bfa 2023-09-23T08:28:10.781 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bfa/bfa.ko 2023-09-23T08:28:10.781 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2fc 2023-09-23T08:28:10.781 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-09-23T08:28:10.781 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2i 2023-09-23T08:28:10.781 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-09-23T08:28:10.781 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ch.ko 2023-09-23T08:28:10.781 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/csiostor 2023-09-23T08:28:10.781 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/csiostor/csiostor.ko 2023-09-23T08:28:10.781 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi 2023-09-23T08:28:10.781 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb3i 2023-09-23T08:28:10.782 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-09-23T08:28:10.782 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb4i 2023-09-23T08:28:10.782 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-09-23T08:28:10.782 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-09-23T08:28:10.782 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/dc395x.ko 2023-09-23T08:28:10.782 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler 2023-09-23T08:28:10.782 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-09-23T08:28:10.782 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-09-23T08:28:10.782 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-09-23T08:28:10.782 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-09-23T08:28:10.782 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/dmx3191d.ko 2023-09-23T08:28:10.783 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esas2r 2023-09-23T08:28:10.783 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esas2r/esas2r.ko 2023-09-23T08:28:10.783 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esp_scsi.ko 2023-09-23T08:28:10.783 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe 2023-09-23T08:28:10.783 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe/fcoe.ko 2023-09-23T08:28:10.783 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-09-23T08:28:10.783 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fnic 2023-09-23T08:28:10.783 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fnic/fnic.ko 2023-09-23T08:28:10.783 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hpsa.ko 2023-09-23T08:28:10.783 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hptiop.ko 2023-09-23T08:28:10.783 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hv_storvsc.ko 2023-09-23T08:28:10.784 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/initio.ko 2023-09-23T08:28:10.784 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ipr.ko 2023-09-23T08:28:10.784 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ips.ko 2023-09-23T08:28:10.784 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/isci 2023-09-23T08:28:10.784 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/isci/isci.ko 2023-09-23T08:28:10.784 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-09-23T08:28:10.784 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/iscsi_tcp.ko 2023-09-23T08:28:10.784 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libfc 2023-09-23T08:28:10.784 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libfc/libfc.ko 2023-09-23T08:28:10.784 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libiscsi.ko 2023-09-23T08:28:10.784 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libiscsi_tcp.ko 2023-09-23T08:28:10.784 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libsas 2023-09-23T08:28:10.785 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libsas/libsas.ko 2023-09-23T08:28:10.785 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/lpfc 2023-09-23T08:28:10.785 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/lpfc/lpfc.ko 2023-09-23T08:28:10.785 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid 2023-09-23T08:28:10.785 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid.ko 2023-09-23T08:28:10.785 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-09-23T08:28:10.785 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-09-23T08:28:10.785 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-09-23T08:28:10.785 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mpt3sas 2023-09-23T08:28:10.785 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-09-23T08:28:10.786 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvsas 2023-09-23T08:28:10.786 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvsas/mvsas.ko 2023-09-23T08:28:10.786 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvumi.ko 2023-09-23T08:28:10.786 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pm8001 2023-09-23T08:28:10.786 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-09-23T08:28:10.786 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pmcraid.ko 2023-09-23T08:28:10.786 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla1280.ko 2023-09-23T08:28:10.786 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx 2023-09-23T08:28:10.786 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-09-23T08:28:10.786 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-09-23T08:28:10.786 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla4xxx 2023-09-23T08:28:10.786 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-09-23T08:28:10.787 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/raid_class.ko 2023-09-23T08:28:10.787 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_debug.ko 2023-09-23T08:28:10.787 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_fc.ko 2023-09-23T08:28:10.787 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-09-23T08:28:10.787 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_sas.ko 2023-09-23T08:28:10.787 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_spi.ko 2023-09-23T08:28:10.787 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_srp.ko 2023-09-23T08:28:10.787 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ses.ko 2023-09-23T08:28:10.787 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/st.ko 2023-09-23T08:28:10.787 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/stex.ko 2023-09-23T08:28:10.787 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/sym53c8xx_2 2023-09-23T08:28:10.788 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-09-23T08:28:10.788 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/virtio_scsi.ko 2023-09-23T08:28:10.788 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/vmw_pvscsi.ko 2023-09-23T08:28:10.788 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/wd719x.ko 2023-09-23T08:28:10.788 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ssb 2023-09-23T08:28:10.788 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ssb/ssb.ko 2023-09-23T08:28:10.788 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target 2023-09-23T08:28:10.788 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/iscsi 2023-09-23T08:28:10.788 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-09-23T08:28:10.788 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/loopback 2023-09-23T08:28:10.788 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/loopback/tcm_loop.ko 2023-09-23T08:28:10.788 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_file.ko 2023-09-23T08:28:10.789 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_iblock.ko 2023-09-23T08:28:10.789 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_mod.ko 2023-09-23T08:28:10.789 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_pscsi.ko 2023-09-23T08:28:10.789 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_user.ko 2023-09-23T08:28:10.789 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/tcm_fc 2023-09-23T08:28:10.789 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-09-23T08:28:10.789 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal 2023-09-23T08:28:10.789 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel 2023-09-23T08:28:10.789 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal 2023-09-23T08:28:10.789 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-09-23T08:28:10.789 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-09-23T08:28:10.789 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-09-23T08:28:10.789 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-09-23T08:28:10.790 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-09-23T08:28:10.790 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-09-23T08:28:10.790 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-09-23T08:28:10.790 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-09-23T08:28:10.790 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-09-23T08:28:10.790 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-09-23T08:28:10.790 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-09-23T08:28:10.790 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-09-23T08:28:10.790 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-09-23T08:28:10.790 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-09-23T08:28:10.790 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-09-23T08:28:10.791 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty 2023-09-23T08:28:10.791 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/ipwireless 2023-09-23T08:28:10.791 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-09-23T08:28:10.791 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/n_gsm.ko 2023-09-23T08:28:10.791 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/n_hdlc.ko 2023-09-23T08:28:10.791 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/nozomi.ko 2023-09-23T08:28:10.791 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial 2023-09-23T08:28:10.791 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/8250 2023-09-23T08:28:10.791 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-09-23T08:28:10.791 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/arc_uart.ko 2023-09-23T08:28:10.791 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/jsm 2023-09-23T08:28:10.792 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/jsm/jsm.ko 2023-09-23T08:28:10.792 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/synclink_gt.ko 2023-09-23T08:28:10.792 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs 2023-09-23T08:28:10.792 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/core 2023-09-23T08:28:10.792 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/core/ufshcd-core.ko 2023-09-23T08:28:10.792 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/host 2023-09-23T08:28:10.792 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-09-23T08:28:10.792 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio 2023-09-23T08:28:10.792 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio.ko 2023-09-23T08:28:10.792 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_aec.ko 2023-09-23T08:28:10.792 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_cif.ko 2023-09-23T08:28:10.792 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_pci_generic.ko 2023-09-23T08:28:10.793 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_sercos3.ko 2023-09-23T08:28:10.793 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb 2023-09-23T08:28:10.793 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class 2023-09-23T08:28:10.793 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/cdc-acm.ko 2023-09-23T08:28:10.793 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/cdc-wdm.ko 2023-09-23T08:28:10.793 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/usblp.ko 2023-09-23T08:28:10.793 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/usbtmc.ko 2023-09-23T08:28:10.793 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host 2023-09-23T08:28:10.793 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host/sl811-hcd.ko 2023-09-23T08:28:10.793 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image 2023-09-23T08:28:10.793 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image/mdc800.ko 2023-09-23T08:28:10.794 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image/microtek.ko 2023-09-23T08:28:10.794 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc 2023-09-23T08:28:10.794 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/adutux.ko 2023-09-23T08:28:10.794 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/appledisplay.ko 2023-09-23T08:28:10.794 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/emi26.ko 2023-09-23T08:28:10.794 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/emi62.ko 2023-09-23T08:28:10.794 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ezusb.ko 2023-09-23T08:28:10.794 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/idmouse.ko 2023-09-23T08:28:10.794 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/iowarrior.ko 2023-09-23T08:28:10.794 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/isight_firmware.ko 2023-09-23T08:28:10.794 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ldusb.ko 2023-09-23T08:28:10.795 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/legousbtower.ko 2023-09-23T08:28:10.795 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/sisusbvga 2023-09-23T08:28:10.795 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-09-23T08:28:10.795 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/trancevibrator.ko 2023-09-23T08:28:10.795 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usb3503.ko 2023-09-23T08:28:10.795 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usblcd.ko 2023-09-23T08:28:10.795 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usbsevseg.ko 2023-09-23T08:28:10.795 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/uss720.ko 2023-09-23T08:28:10.795 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/yurex.ko 2023-09-23T08:28:10.795 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy 2023-09-23T08:28:10.795 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy/phy-generic.ko 2023-09-23T08:28:10.796 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial 2023-09-23T08:28:10.796 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/aircable.ko 2023-09-23T08:28:10.796 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ark3116.ko 2023-09-23T08:28:10.796 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/belkin_sa.ko 2023-09-23T08:28:10.796 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ch341.ko 2023-09-23T08:28:10.796 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cp210x.ko 2023-09-23T08:28:10.796 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cyberjack.ko 2023-09-23T08:28:10.796 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cypress_m8.ko 2023-09-23T08:28:10.797 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/digi_acceleport.ko 2023-09-23T08:28:10.797 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/empeg.ko 2023-09-23T08:28:10.797 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ftdi_sio.ko 2023-09-23T08:28:10.797 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/garmin_gps.ko 2023-09-23T08:28:10.797 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/io_edgeport.ko 2023-09-23T08:28:10.797 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/io_ti.ko 2023-09-23T08:28:10.797 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ipaq.ko 2023-09-23T08:28:10.797 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ipw.ko 2023-09-23T08:28:10.798 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ir-usb.ko 2023-09-23T08:28:10.798 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-09-23T08:28:10.798 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/keyspan.ko 2023-09-23T08:28:10.798 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/keyspan_pda.ko 2023-09-23T08:28:10.798 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/kl5kusb105.ko 2023-09-23T08:28:10.798 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/kobil_sct.ko 2023-09-23T08:28:10.798 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mct_u232.ko 2023-09-23T08:28:10.798 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mos7720.ko 2023-09-23T08:28:10.798 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mos7840.ko 2023-09-23T08:28:10.798 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/navman.ko 2023-09-23T08:28:10.798 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/omninet.ko 2023-09-23T08:28:10.798 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/opticon.ko 2023-09-23T08:28:10.799 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/option.ko 2023-09-23T08:28:10.799 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/oti6858.ko 2023-09-23T08:28:10.799 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/pl2303.ko 2023-09-23T08:28:10.799 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/qcaux.ko 2023-09-23T08:28:10.799 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/qcserial.ko 2023-09-23T08:28:10.799 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/quatech2.ko 2023-09-23T08:28:10.799 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/safe_serial.ko 2023-09-23T08:28:10.799 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/sierra.ko 2023-09-23T08:28:10.799 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/spcp8x5.ko 2023-09-23T08:28:10.799 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ssu100.ko 2023-09-23T08:28:10.799 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/symbolserial.ko 2023-09-23T08:28:10.800 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-09-23T08:28:10.800 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-09-23T08:28:10.800 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb_debug.ko 2023-09-23T08:28:10.800 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb_wwan.ko 2023-09-23T08:28:10.800 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/visor.ko 2023-09-23T08:28:10.800 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/whiteheat.ko 2023-09-23T08:28:10.800 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/xsens_mt.ko 2023-09-23T08:28:10.800 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage 2023-09-23T08:28:10.800 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/uas.ko 2023-09-23T08:28:10.800 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-alauda.ko 2023-09-23T08:28:10.800 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-cypress.ko 2023-09-23T08:28:10.801 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-datafab.ko 2023-09-23T08:28:10.801 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-09-23T08:28:10.801 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-freecom.ko 2023-09-23T08:28:10.801 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-isd200.ko 2023-09-23T08:28:10.801 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-09-23T08:28:10.801 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-karma.ko 2023-09-23T08:28:10.801 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-onetouch.ko 2023-09-23T08:28:10.801 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-realtek.ko 2023-09-23T08:28:10.801 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-sddr09.ko 2023-09-23T08:28:10.801 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-sddr55.ko 2023-09-23T08:28:10.802 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-usbat.ko 2023-09-23T08:28:10.802 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/usb-storage.ko 2023-09-23T08:28:10.802 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip 2023-09-23T08:28:10.802 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/usbip-core.ko 2023-09-23T08:28:10.802 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/usbip-host.ko 2023-09-23T08:28:10.802 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-09-23T08:28:10.802 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio 2023-09-23T08:28:10.802 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci 2023-09-23T08:28:10.802 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-09-23T08:28:10.802 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci/vfio-pci.ko 2023-09-23T08:28:10.802 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/vfio.ko 2023-09-23T08:28:10.802 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-09-23T08:28:10.803 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost 2023-09-23T08:28:10.803 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost.ko 2023-09-23T08:28:10.803 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_iotlb.ko 2023-09-23T08:28:10.803 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_net.ko 2023-09-23T08:28:10.803 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_scsi.ko 2023-09-23T08:28:10.803 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video 2023-09-23T08:28:10.803 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight 2023-09-23T08:28:10.803 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/apple_bl.ko 2023-09-23T08:28:10.803 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/lcd.ko 2023-09-23T08:28:10.803 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/platform_lcd.ko 2023-09-23T08:28:10.803 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio 2023-09-23T08:28:10.804 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio.ko 2023-09-23T08:28:10.804 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_balloon.ko 2023-09-23T08:28:10.804 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_mmio.ko 2023-09-23T08:28:10.804 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci.ko 2023-09-23T08:28:10.804 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-09-23T08:28:10.804 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-09-23T08:28:10.804 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_ring.ko 2023-09-23T08:28:10.804 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1 2023-09-23T08:28:10.804 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters 2023-09-23T08:28:10.804 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/ds2482.ko 2023-09-23T08:28:10.804 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/ds2490.ko 2023-09-23T08:28:10.805 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves 2023-09-23T08:28:10.805 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-09-23T08:28:10.805 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-09-23T08:28:10.805 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-09-23T08:28:10.805 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-09-23T08:28:10.805 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-09-23T08:28:10.805 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-09-23T08:28:10.805 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-09-23T08:28:10.805 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-09-23T08:28:10.805 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-09-23T08:28:10.805 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_smem.ko 2023-09-23T08:28:10.805 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_therm.ko 2023-09-23T08:28:10.806 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/wire.ko 2023-09-23T08:28:10.806 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog 2023-09-23T08:28:10.806 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/alim1535_wdt.ko 2023-09-23T08:28:10.806 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/alim7101_wdt.ko 2023-09-23T08:28:10.806 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/f71808e_wdt.ko 2023-09-23T08:28:10.806 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/hpwdt.ko 2023-09-23T08:28:10.806 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/i6300esb.ko 2023-09-23T08:28:10.806 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-09-23T08:28:10.806 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/iTCO_wdt.ko 2023-09-23T08:28:10.806 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ib700wdt.ko 2023-09-23T08:28:10.806 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ibmasr.ko 2023-09-23T08:28:10.807 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-09-23T08:28:10.807 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/it8712f_wdt.ko 2023-09-23T08:28:10.807 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/it87_wdt.ko 2023-09-23T08:28:10.807 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/machzwd.ko 2023-09-23T08:28:10.807 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/nv_tco.ko 2023-09-23T08:28:10.807 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/pcwd_pci.ko 2023-09-23T08:28:10.807 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/pcwd_usb.ko 2023-09-23T08:28:10.807 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-09-23T08:28:10.807 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sch311x_wdt.ko 2023-09-23T08:28:10.807 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/softdog.ko 2023-09-23T08:28:10.807 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sp5100_tco.ko 2023-09-23T08:28:10.807 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/via_wdt.ko 2023-09-23T08:28:10.808 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-09-23T08:28:10.808 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83877f_wdt.ko 2023-09-23T08:28:10.808 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83977f_wdt.ko 2023-09-23T08:28:10.808 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/wdt_pci.ko 2023-09-23T08:28:10.808 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/xen_wdt.ko 2023-09-23T08:28:10.808 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen 2023-09-23T08:28:10.808 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-acpi-processor.ko 2023-09-23T08:28:10.808 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-evtchn.ko 2023-09-23T08:28:10.808 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-gntalloc.ko 2023-09-23T08:28:10.808 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-gntdev.ko 2023-09-23T08:28:10.808 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-pciback 2023-09-23T08:28:10.809 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-09-23T08:28:10.809 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-privcmd.ko 2023-09-23T08:28:10.809 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xenfs 2023-09-23T08:28:10.809 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xenfs/xenfs.ko 2023-09-23T08:28:10.809 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs 2023-09-23T08:28:10.809 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/9p 2023-09-23T08:28:10.809 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/9p/9p.ko 2023-09-23T08:28:10.809 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/affs 2023-09-23T08:28:10.809 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/affs/affs.ko 2023-09-23T08:28:10.809 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/befs 2023-09-23T08:28:10.809 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/befs/befs.ko 2023-09-23T08:28:10.809 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/binfmt_misc.ko 2023-09-23T08:28:10.810 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/btrfs 2023-09-23T08:28:10.810 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/btrfs/btrfs.ko 2023-09-23T08:28:10.810 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cachefiles 2023-09-23T08:28:10.810 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cachefiles/cachefiles.ko 2023-09-23T08:28:10.810 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ceph 2023-09-23T08:28:10.810 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ceph/ceph.ko 2023-09-23T08:28:10.810 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/coda 2023-09-23T08:28:10.810 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/coda/coda.ko 2023-09-23T08:28:10.810 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cramfs 2023-09-23T08:28:10.810 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cramfs/cramfs.ko 2023-09-23T08:28:10.810 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/dlm 2023-09-23T08:28:10.811 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/dlm/dlm.ko 2023-09-23T08:28:10.811 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ecryptfs 2023-09-23T08:28:10.811 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ecryptfs/ecryptfs.ko 2023-09-23T08:28:10.811 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/f2fs 2023-09-23T08:28:10.811 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/f2fs/f2fs.ko 2023-09-23T08:28:10.811 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat 2023-09-23T08:28:10.811 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/fat.ko 2023-09-23T08:28:10.811 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/msdos.ko 2023-09-23T08:28:10.811 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/vfat.ko 2023-09-23T08:28:10.811 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fscache 2023-09-23T08:28:10.811 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fscache/fscache.ko 2023-09-23T08:28:10.812 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse 2023-09-23T08:28:10.812 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse/cuse.ko 2023-09-23T08:28:10.812 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse/fuse.ko 2023-09-23T08:28:10.812 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/gfs2 2023-09-23T08:28:10.812 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/gfs2/gfs2.ko 2023-09-23T08:28:10.812 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfs 2023-09-23T08:28:10.812 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfs/hfs.ko 2023-09-23T08:28:10.812 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfsplus 2023-09-23T08:28:10.812 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfsplus/hfsplus.ko 2023-09-23T08:28:10.812 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/isofs 2023-09-23T08:28:10.812 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/isofs/isofs.ko 2023-09-23T08:28:10.812 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/jfs 2023-09-23T08:28:10.813 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/jfs/jfs.ko 2023-09-23T08:28:10.813 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/lockd 2023-09-23T08:28:10.813 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/lockd/lockd.ko 2023-09-23T08:28:10.813 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/minix 2023-09-23T08:28:10.813 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/minix/minix.ko 2023-09-23T08:28:10.813 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/netfs 2023-09-23T08:28:10.813 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/netfs/netfs.ko 2023-09-23T08:28:10.813 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs 2023-09-23T08:28:10.813 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/blocklayout 2023-09-23T08:28:10.813 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-09-23T08:28:10.813 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/filelayout 2023-09-23T08:28:10.814 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-09-23T08:28:10.814 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/flexfilelayout 2023-09-23T08:28:10.814 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-09-23T08:28:10.814 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfs.ko 2023-09-23T08:28:10.814 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfsv3.ko 2023-09-23T08:28:10.814 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfsv4.ko 2023-09-23T08:28:10.814 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common 2023-09-23T08:28:10.814 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common/grace.ko 2023-09-23T08:28:10.814 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common/nfs_acl.ko 2023-09-23T08:28:10.814 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfsd 2023-09-23T08:28:10.814 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfsd/nfsd.ko 2023-09-23T08:28:10.815 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nilfs2 2023-09-23T08:28:10.815 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nilfs2/nilfs2.ko 2023-09-23T08:28:10.815 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls 2023-09-23T08:28:10.815 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-celtic.ko 2023-09-23T08:28:10.815 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-centeuro.ko 2023-09-23T08:28:10.815 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-croatian.ko 2023-09-23T08:28:10.815 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-cyrillic.ko 2023-09-23T08:28:10.815 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-gaelic.ko 2023-09-23T08:28:10.815 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-greek.ko 2023-09-23T08:28:10.815 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-iceland.ko 2023-09-23T08:28:10.815 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-inuit.ko 2023-09-23T08:28:10.815 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-roman.ko 2023-09-23T08:28:10.816 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-romanian.ko 2023-09-23T08:28:10.816 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-turkish.ko 2023-09-23T08:28:10.816 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1250.ko 2023-09-23T08:28:10.816 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1251.ko 2023-09-23T08:28:10.816 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1255.ko 2023-09-23T08:28:10.816 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp737.ko 2023-09-23T08:28:10.816 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp775.ko 2023-09-23T08:28:10.816 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp850.ko 2023-09-23T08:28:10.816 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp852.ko 2023-09-23T08:28:10.816 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp855.ko 2023-09-23T08:28:10.816 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp857.ko 2023-09-23T08:28:10.817 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp860.ko 2023-09-23T08:28:10.817 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp861.ko 2023-09-23T08:28:10.817 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp862.ko 2023-09-23T08:28:10.817 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp863.ko 2023-09-23T08:28:10.817 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp864.ko 2023-09-23T08:28:10.817 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp865.ko 2023-09-23T08:28:10.817 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp866.ko 2023-09-23T08:28:10.817 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp869.ko 2023-09-23T08:28:10.817 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp874.ko 2023-09-23T08:28:10.817 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp932.ko 2023-09-23T08:28:10.817 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp936.ko 2023-09-23T08:28:10.817 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp949.ko 2023-09-23T08:28:10.818 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp950.ko 2023-09-23T08:28:10.818 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_euc-jp.ko 2023-09-23T08:28:10.818 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-1.ko 2023-09-23T08:28:10.818 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-13.ko 2023-09-23T08:28:10.818 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-14.ko 2023-09-23T08:28:10.818 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-15.ko 2023-09-23T08:28:10.818 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-2.ko 2023-09-23T08:28:10.818 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-3.ko 2023-09-23T08:28:10.818 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-4.ko 2023-09-23T08:28:10.818 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-5.ko 2023-09-23T08:28:10.818 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-6.ko 2023-09-23T08:28:10.819 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-7.ko 2023-09-23T08:28:10.819 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-9.ko 2023-09-23T08:28:10.819 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-r.ko 2023-09-23T08:28:10.819 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-ru.ko 2023-09-23T08:28:10.819 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-u.ko 2023-09-23T08:28:10.819 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_utf8.ko 2023-09-23T08:28:10.819 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2 2023-09-23T08:28:10.819 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/cluster 2023-09-23T08:28:10.819 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-09-23T08:28:10.819 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlm 2023-09-23T08:28:10.819 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-09-23T08:28:10.819 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlmfs 2023-09-23T08:28:10.820 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-09-23T08:28:10.820 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2.ko 2023-09-23T08:28:10.820 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-09-23T08:28:10.820 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-09-23T08:28:10.820 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-09-23T08:28:10.820 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/overlayfs 2023-09-23T08:28:10.820 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/overlayfs/overlay.ko 2023-09-23T08:28:10.820 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/pstore 2023-09-23T08:28:10.820 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/pstore/ramoops.ko 2023-09-23T08:28:10.820 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/reiserfs 2023-09-23T08:28:10.820 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/reiserfs/reiserfs.ko 2023-09-23T08:28:10.821 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/romfs 2023-09-23T08:28:10.821 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/romfs/romfs.ko 2023-09-23T08:28:10.821 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb 2023-09-23T08:28:10.821 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/client 2023-09-23T08:28:10.821 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/client/cifs.ko 2023-09-23T08:28:10.821 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common 2023-09-23T08:28:10.821 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common/cifs_arc4.ko 2023-09-23T08:28:10.821 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common/cifs_md4.ko 2023-09-23T08:28:10.821 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/squashfs 2023-09-23T08:28:10.821 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/squashfs/squashfs.ko 2023-09-23T08:28:10.821 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/sysv 2023-09-23T08:28:10.821 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/sysv/sysv.ko 2023-09-23T08:28:10.822 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/udf 2023-09-23T08:28:10.822 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/udf/udf.ko 2023-09-23T08:28:10.822 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ufs 2023-09-23T08:28:10.822 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ufs/ufs.ko 2023-09-23T08:28:10.822 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/xfs 2023-09-23T08:28:10.822 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/xfs/xfs.ko 2023-09-23T08:28:10.822 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel 2023-09-23T08:28:10.822 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/rcu 2023-09-23T08:28:10.822 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/rcu/rcutorture.ko 2023-09-23T08:28:10.822 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/torture.ko 2023-09-23T08:28:10.822 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/trace 2023-09-23T08:28:10.823 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-09-23T08:28:10.823 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib 2023-09-23T08:28:10.823 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/asn1_encoder.ko 2023-09-23T08:28:10.823 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crc-itu-t.ko 2023-09-23T08:28:10.823 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crc8.ko 2023-09-23T08:28:10.823 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto 2023-09-23T08:28:10.823 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto/libarc4.ko 2023-09-23T08:28:10.823 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto/libdes.ko 2023-09-23T08:28:10.823 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/libcrc32c.ko 2023-09-23T08:28:10.823 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lru_cache.ko 2023-09-23T08:28:10.823 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4 2023-09-23T08:28:10.824 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4/lz4_compress.ko 2023-09-23T08:28:10.824 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4/lz4hc_compress.ko 2023-09-23T08:28:10.824 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/math 2023-09-23T08:28:10.824 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/math/cordic.ko 2023-09-23T08:28:10.824 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/raid6 2023-09-23T08:28:10.824 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/raid6/raid6_pq.ko 2023-09-23T08:28:10.824 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/reed_solomon 2023-09-23T08:28:10.824 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/reed_solomon/reed_solomon.ko 2023-09-23T08:28:10.824 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_bm.ko 2023-09-23T08:28:10.824 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_fsm.ko 2023-09-23T08:28:10.824 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_kmp.ko 2023-09-23T08:28:10.824 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/zstd 2023-09-23T08:28:10.825 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/zstd/zstd_compress.ko 2023-09-23T08:28:10.825 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/mm 2023-09-23T08:28:10.825 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/mm/hwpoison-inject.ko 2023-09-23T08:28:10.825 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net 2023-09-23T08:28:10.825 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan 2023-09-23T08:28:10.825 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/6lowpan.ko 2023-09-23T08:28:10.825 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_dest.ko 2023-09-23T08:28:10.825 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_fragment.ko 2023-09-23T08:28:10.825 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_hop.ko 2023-09-23T08:28:10.825 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_ipv6.ko 2023-09-23T08:28:10.825 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_mobility.ko 2023-09-23T08:28:10.826 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_routing.ko 2023-09-23T08:28:10.826 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_udp.ko 2023-09-23T08:28:10.826 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802 2023-09-23T08:28:10.826 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/garp.ko 2023-09-23T08:28:10.826 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/mrp.ko 2023-09-23T08:28:10.826 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/p8022.ko 2023-09-23T08:28:10.826 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/psnap.ko 2023-09-23T08:28:10.826 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/stp.ko 2023-09-23T08:28:10.826 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/8021q 2023-09-23T08:28:10.826 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/8021q/8021q.ko 2023-09-23T08:28:10.826 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p 2023-09-23T08:28:10.826 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet.ko 2023-09-23T08:28:10.827 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_fd.ko 2023-09-23T08:28:10.827 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_rdma.ko 2023-09-23T08:28:10.827 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_virtio.ko 2023-09-23T08:28:10.827 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/batman-adv 2023-09-23T08:28:10.827 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/batman-adv/batman-adv.ko 2023-09-23T08:28:10.827 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge 2023-09-23T08:28:10.827 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/br_netfilter.ko 2023-09-23T08:28:10.827 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/bridge.ko 2023-09-23T08:28:10.827 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter 2023-09-23T08:28:10.827 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-09-23T08:28:10.827 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_among.ko 2023-09-23T08:28:10.828 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_arp.ko 2023-09-23T08:28:10.828 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-09-23T08:28:10.828 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-09-23T08:28:10.828 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_ip.ko 2023-09-23T08:28:10.828 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-09-23T08:28:10.828 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_limit.ko 2023-09-23T08:28:10.828 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_log.ko 2023-09-23T08:28:10.828 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_mark.ko 2023-09-23T08:28:10.828 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-09-23T08:28:10.828 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-09-23T08:28:10.828 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-09-23T08:28:10.828 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-09-23T08:28:10.829 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_snat.ko 2023-09-23T08:28:10.829 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_stp.ko 2023-09-23T08:28:10.829 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-09-23T08:28:10.829 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-09-23T08:28:10.829 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-09-23T08:28:10.829 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-09-23T08:28:10.829 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtables.ko 2023-09-23T08:28:10.829 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-09-23T08:28:10.829 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-09-23T08:28:10.829 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-09-23T08:28:10.829 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ceph 2023-09-23T08:28:10.830 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ceph/libceph.ko 2023-09-23T08:28:10.830 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core 2023-09-23T08:28:10.830 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core/failover.ko 2023-09-23T08:28:10.830 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core/pktgen.ko 2023-09-23T08:28:10.830 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp 2023-09-23T08:28:10.830 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp.ko 2023-09-23T08:28:10.830 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_diag.ko 2023-09-23T08:28:10.830 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_ipv4.ko 2023-09-23T08:28:10.830 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_ipv6.ko 2023-09-23T08:28:10.830 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dns_resolver 2023-09-23T08:28:10.830 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dns_resolver/dns_resolver.ko 2023-09-23T08:28:10.830 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa 2023-09-23T08:28:10.831 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/dsa_core.ko 2023-09-23T08:28:10.831 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_brcm.ko 2023-09-23T08:28:10.831 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_dsa.ko 2023-09-23T08:28:10.831 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_none.ko 2023-09-23T08:28:10.831 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_trailer.ko 2023-09-23T08:28:10.831 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154 2023-09-23T08:28:10.831 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/6lowpan 2023-09-23T08:28:10.831 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-09-23T08:28:10.831 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/ieee802154.ko 2023-09-23T08:28:10.831 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/ieee802154_socket.ko 2023-09-23T08:28:10.831 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4 2023-09-23T08:28:10.832 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ah4.ko 2023-09-23T08:28:10.832 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/esp4.ko 2023-09-23T08:28:10.832 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/fou.ko 2023-09-23T08:28:10.832 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/gre.ko 2023-09-23T08:28:10.832 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/inet_diag.ko 2023-09-23T08:28:10.832 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_gre.ko 2023-09-23T08:28:10.832 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_tunnel.ko 2023-09-23T08:28:10.832 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_vti.ko 2023-09-23T08:28:10.832 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ipcomp.ko 2023-09-23T08:28:10.832 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ipip.ko 2023-09-23T08:28:10.832 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter 2023-09-23T08:28:10.832 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arp_tables.ko 2023-09-23T08:28:10.833 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-09-23T08:28:10.833 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-09-23T08:28:10.833 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-09-23T08:28:10.833 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-09-23T08:28:10.833 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-09-23T08:28:10.833 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-09-23T08:28:10.833 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-09-23T08:28:10.833 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-09-23T08:28:10.833 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-09-23T08:28:10.833 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_security.ko 2023-09-23T08:28:10.833 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-09-23T08:28:10.834 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-09-23T08:28:10.834 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-09-23T08:28:10.834 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-09-23T08:28:10.834 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-09-23T08:28:10.834 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-09-23T08:28:10.834 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-09-23T08:28:10.834 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-09-23T08:28:10.834 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-09-23T08:28:10.834 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-09-23T08:28:10.834 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_bic.ko 2023-09-23T08:28:10.834 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_dctcp.ko 2023-09-23T08:28:10.835 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_diag.ko 2023-09-23T08:28:10.835 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_highspeed.ko 2023-09-23T08:28:10.835 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_htcp.ko 2023-09-23T08:28:10.835 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_hybla.ko 2023-09-23T08:28:10.835 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_illinois.ko 2023-09-23T08:28:10.835 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_lp.ko 2023-09-23T08:28:10.835 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_scalable.ko 2023-09-23T08:28:10.835 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_vegas.ko 2023-09-23T08:28:10.835 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_veno.ko 2023-09-23T08:28:10.835 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_westwood.ko 2023-09-23T08:28:10.835 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_yeah.ko 2023-09-23T08:28:10.835 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tunnel4.ko 2023-09-23T08:28:10.836 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/udp_diag.ko 2023-09-23T08:28:10.836 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/udp_tunnel.ko 2023-09-23T08:28:10.836 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/xfrm4_tunnel.ko 2023-09-23T08:28:10.836 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6 2023-09-23T08:28:10.836 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ah6.ko 2023-09-23T08:28:10.836 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/esp6.ko 2023-09-23T08:28:10.836 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/fou6.ko 2023-09-23T08:28:10.836 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_tunnel.ko 2023-09-23T08:28:10.836 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-09-23T08:28:10.836 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_vti.ko 2023-09-23T08:28:10.836 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ipcomp6.ko 2023-09-23T08:28:10.837 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter 2023-09-23T08:28:10.837 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-09-23T08:28:10.837 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-09-23T08:28:10.837 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-09-23T08:28:10.837 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-09-23T08:28:10.837 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-09-23T08:28:10.837 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-09-23T08:28:10.837 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-09-23T08:28:10.837 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-09-23T08:28:10.837 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-09-23T08:28:10.837 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-09-23T08:28:10.837 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-09-23T08:28:10.838 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-09-23T08:28:10.838 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-09-23T08:28:10.838 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-09-23T08:28:10.838 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-09-23T08:28:10.838 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-09-23T08:28:10.838 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-09-23T08:28:10.838 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-09-23T08:28:10.838 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-09-23T08:28:10.838 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-09-23T08:28:10.838 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-09-23T08:28:10.838 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-09-23T08:28:10.839 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-09-23T08:28:10.839 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-09-23T08:28:10.839 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/sit.ko 2023-09-23T08:28:10.839 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/tunnel6.ko 2023-09-23T08:28:10.839 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/xfrm6_tunnel.ko 2023-09-23T08:28:10.839 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/key 2023-09-23T08:28:10.839 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/key/af_key.ko 2023-09-23T08:28:10.839 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp 2023-09-23T08:28:10.839 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_core.ko 2023-09-23T08:28:10.839 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_debugfs.ko 2023-09-23T08:28:10.839 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_eth.ko 2023-09-23T08:28:10.839 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ip.ko 2023-09-23T08:28:10.840 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ip6.ko 2023-09-23T08:28:10.840 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_netlink.ko 2023-09-23T08:28:10.840 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ppp.ko 2023-09-23T08:28:10.840 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/llc 2023-09-23T08:28:10.840 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/llc/llc.ko 2023-09-23T08:28:10.840 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mac802154 2023-09-23T08:28:10.840 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mac802154/mac802154.ko 2023-09-23T08:28:10.840 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mpls 2023-09-23T08:28:10.840 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mpls/mpls_gso.ko 2023-09-23T08:28:10.840 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter 2023-09-23T08:28:10.840 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset 2023-09-23T08:28:10.841 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set.ko 2023-09-23T08:28:10.841 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-09-23T08:28:10.841 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-09-23T08:28:10.841 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-09-23T08:28:10.841 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-09-23T08:28:10.841 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-09-23T08:28:10.841 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-09-23T08:28:10.846 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-09-23T08:28:10.846 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-09-23T08:28:10.847 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-09-23T08:28:10.847 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-09-23T08:28:10.847 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-09-23T08:28:10.847 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-09-23T08:28:10.847 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-09-23T08:28:10.847 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-09-23T08:28:10.847 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-09-23T08:28:10.847 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs 2023-09-23T08:28:10.847 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs.ko 2023-09-23T08:28:10.847 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-09-23T08:28:10.848 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-09-23T08:28:10.848 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-09-23T08:28:10.848 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-09-23T08:28:10.848 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-09-23T08:28:10.848 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-09-23T08:28:10.848 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-09-23T08:28:10.848 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-09-23T08:28:10.848 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-09-23T08:28:10.848 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-09-23T08:28:10.848 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-09-23T08:28:10.848 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-09-23T08:28:10.849 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-09-23T08:28:10.849 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conncount.ko 2023-09-23T08:28:10.849 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack.ko 2023-09-23T08:28:10.849 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-09-23T08:28:10.849 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-09-23T08:28:10.849 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-09-23T08:28:10.849 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_h323.ko 2023-09-23T08:28:10.849 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_irc.ko 2023-09-23T08:28:10.849 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-09-23T08:28:10.849 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-09-23T08:28:10.849 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-09-23T08:28:10.850 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_sane.ko 2023-09-23T08:28:10.850 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_sip.ko 2023-09-23T08:28:10.850 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-09-23T08:28:10.850 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-09-23T08:28:10.850 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_dup_netdev.ko 2023-09-23T08:28:10.850 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_flow_table.ko 2023-09-23T08:28:10.850 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_flow_table_inet.ko 2023-09-23T08:28:10.850 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_log_syslog.ko 2023-09-23T08:28:10.850 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat.ko 2023-09-23T08:28:10.850 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_amanda.ko 2023-09-23T08:28:10.850 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_ftp.ko 2023-09-23T08:28:10.850 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_irc.ko 2023-09-23T08:28:10.851 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_sip.ko 2023-09-23T08:28:10.851 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_tftp.ko 2023-09-23T08:28:10.851 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_synproxy_core.ko 2023-09-23T08:28:10.851 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_tables.ko 2023-09-23T08:28:10.851 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink.ko 2023-09-23T08:28:10.851 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_acct.ko 2023-09-23T08:28:10.851 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_log.ko 2023-09-23T08:28:10.851 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_osf.ko 2023-09-23T08:28:10.851 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_queue.ko 2023-09-23T08:28:10.851 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_chain_nat.ko 2023-09-23T08:28:10.851 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_compat.ko 2023-09-23T08:28:10.852 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_ct.ko 2023-09-23T08:28:10.852 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_dup_netdev.ko 2023-09-23T08:28:10.852 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_fib.ko 2023-09-23T08:28:10.852 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_fwd_netdev.ko 2023-09-23T08:28:10.852 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_hash.ko 2023-09-23T08:28:10.852 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_limit.ko 2023-09-23T08:28:10.852 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_log.ko 2023-09-23T08:28:10.852 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_masq.ko 2023-09-23T08:28:10.852 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_nat.ko 2023-09-23T08:28:10.852 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_numgen.ko 2023-09-23T08:28:10.852 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_queue.ko 2023-09-23T08:28:10.852 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_quota.ko 2023-09-23T08:28:10.853 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_redir.ko 2023-09-23T08:28:10.853 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_reject.ko 2023-09-23T08:28:10.853 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_reject_inet.ko 2023-09-23T08:28:10.853 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_socket.ko 2023-09-23T08:28:10.853 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_tunnel.ko 2023-09-23T08:28:10.853 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_AUDIT.ko 2023-09-23T08:28:10.853 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CHECKSUM.ko 2023-09-23T08:28:10.853 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CLASSIFY.ko 2023-09-23T08:28:10.853 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-09-23T08:28:10.853 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CT.ko 2023-09-23T08:28:10.853 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_DSCP.ko 2023-09-23T08:28:10.854 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_HL.ko 2023-09-23T08:28:10.854 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_HMARK.ko 2023-09-23T08:28:10.854 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_IDLETIMER.ko 2023-09-23T08:28:10.854 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_LED.ko 2023-09-23T08:28:10.854 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_LOG.ko 2023-09-23T08:28:10.854 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_MASQUERADE.ko 2023-09-23T08:28:10.854 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NETMAP.ko 2023-09-23T08:28:10.854 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NFLOG.ko 2023-09-23T08:28:10.854 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NFQUEUE.ko 2023-09-23T08:28:10.854 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_RATEEST.ko 2023-09-23T08:28:10.854 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_REDIRECT.ko 2023-09-23T08:28:10.855 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_SECMARK.ko 2023-09-23T08:28:10.855 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TCPMSS.ko 2023-09-23T08:28:10.855 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-09-23T08:28:10.855 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TEE.ko 2023-09-23T08:28:10.855 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TPROXY.ko 2023-09-23T08:28:10.855 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TRACE.ko 2023-09-23T08:28:10.855 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_addrtype.ko 2023-09-23T08:28:10.855 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_bpf.ko 2023-09-23T08:28:10.855 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cgroup.ko 2023-09-23T08:28:10.855 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cluster.ko 2023-09-23T08:28:10.855 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_comment.ko 2023-09-23T08:28:10.856 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connbytes.ko 2023-09-23T08:28:10.856 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connlabel.ko 2023-09-23T08:28:10.856 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connlimit.ko 2023-09-23T08:28:10.856 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connmark.ko 2023-09-23T08:28:10.856 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_conntrack.ko 2023-09-23T08:28:10.856 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cpu.ko 2023-09-23T08:28:10.856 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_dccp.ko 2023-09-23T08:28:10.856 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_devgroup.ko 2023-09-23T08:28:10.856 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_dscp.ko 2023-09-23T08:28:10.856 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ecn.ko 2023-09-23T08:28:10.856 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_esp.ko 2023-09-23T08:28:10.856 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_hashlimit.ko 2023-09-23T08:28:10.857 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_helper.ko 2023-09-23T08:28:10.857 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_hl.ko 2023-09-23T08:28:10.857 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ipcomp.ko 2023-09-23T08:28:10.857 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_iprange.ko 2023-09-23T08:28:10.857 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ipvs.ko 2023-09-23T08:28:10.857 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_l2tp.ko 2023-09-23T08:28:10.857 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_length.ko 2023-09-23T08:28:10.857 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_limit.ko 2023-09-23T08:28:10.857 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_mac.ko 2023-09-23T08:28:10.857 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_mark.ko 2023-09-23T08:28:10.858 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_multiport.ko 2023-09-23T08:28:10.858 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_nat.ko 2023-09-23T08:28:10.858 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_nfacct.ko 2023-09-23T08:28:10.858 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_osf.ko 2023-09-23T08:28:10.858 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_owner.ko 2023-09-23T08:28:10.858 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_physdev.ko 2023-09-23T08:28:10.858 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_pkttype.ko 2023-09-23T08:28:10.858 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_policy.ko 2023-09-23T08:28:10.858 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_quota.ko 2023-09-23T08:28:10.858 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_rateest.ko 2023-09-23T08:28:10.859 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_realm.ko 2023-09-23T08:28:10.859 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_recent.ko 2023-09-23T08:28:10.859 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_sctp.ko 2023-09-23T08:28:10.859 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_set.ko 2023-09-23T08:28:10.859 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_socket.ko 2023-09-23T08:28:10.859 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_state.ko 2023-09-23T08:28:10.859 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_statistic.ko 2023-09-23T08:28:10.859 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_string.ko 2023-09-23T08:28:10.859 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_tcpmss.ko 2023-09-23T08:28:10.859 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_time.ko 2023-09-23T08:28:10.859 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_u32.ko 2023-09-23T08:28:10.860 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netlink 2023-09-23T08:28:10.860 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netlink/netlink_diag.ko 2023-09-23T08:28:10.860 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/nsh 2023-09-23T08:28:10.860 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/nsh/nsh.ko 2023-09-23T08:28:10.860 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch 2023-09-23T08:28:10.860 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/openvswitch.ko 2023-09-23T08:28:10.860 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-geneve.ko 2023-09-23T08:28:10.860 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-gre.ko 2023-09-23T08:28:10.860 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-vxlan.ko 2023-09-23T08:28:10.860 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/packet 2023-09-23T08:28:10.860 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/packet/af_packet_diag.ko 2023-09-23T08:28:10.861 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds 2023-09-23T08:28:10.861 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds.ko 2023-09-23T08:28:10.861 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds_rdma.ko 2023-09-23T08:28:10.861 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds_tcp.ko 2023-09-23T08:28:10.861 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched 2023-09-23T08:28:10.861 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_csum.ko 2023-09-23T08:28:10.861 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_gact.ko 2023-09-23T08:28:10.861 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_ipt.ko 2023-09-23T08:28:10.861 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_mirred.ko 2023-09-23T08:28:10.861 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_nat.ko 2023-09-23T08:28:10.861 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_pedit.ko 2023-09-23T08:28:10.861 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_police.ko 2023-09-23T08:28:10.862 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_simple.ko 2023-09-23T08:28:10.862 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_skbedit.ko 2023-09-23T08:28:10.862 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_vlan.ko 2023-09-23T08:28:10.862 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_basic.ko 2023-09-23T08:28:10.862 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_bpf.ko 2023-09-23T08:28:10.862 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_flow.ko 2023-09-23T08:28:10.862 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_fw.ko 2023-09-23T08:28:10.862 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_route.ko 2023-09-23T08:28:10.862 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_u32.ko 2023-09-23T08:28:10.862 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_cmp.ko 2023-09-23T08:28:10.862 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_ipset.ko 2023-09-23T08:28:10.863 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_meta.ko 2023-09-23T08:28:10.863 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_nbyte.ko 2023-09-23T08:28:10.863 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_text.ko 2023-09-23T08:28:10.863 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_u32.ko 2023-09-23T08:28:10.863 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_choke.ko 2023-09-23T08:28:10.863 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_codel.ko 2023-09-23T08:28:10.863 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_drr.ko 2023-09-23T08:28:10.863 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_fq.ko 2023-09-23T08:28:10.863 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_gred.ko 2023-09-23T08:28:10.863 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_hfsc.ko 2023-09-23T08:28:10.863 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_hhf.ko 2023-09-23T08:28:10.863 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_htb.ko 2023-09-23T08:28:10.864 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_ingress.ko 2023-09-23T08:28:10.864 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_mqprio.ko 2023-09-23T08:28:10.864 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_mqprio_lib.ko 2023-09-23T08:28:10.864 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_multiq.ko 2023-09-23T08:28:10.864 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_netem.ko 2023-09-23T08:28:10.864 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_pie.ko 2023-09-23T08:28:10.864 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_plug.ko 2023-09-23T08:28:10.864 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_prio.ko 2023-09-23T08:28:10.864 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_qfq.ko 2023-09-23T08:28:10.864 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_red.ko 2023-09-23T08:28:10.864 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_sfb.ko 2023-09-23T08:28:10.865 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_sfq.ko 2023-09-23T08:28:10.865 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_tbf.ko 2023-09-23T08:28:10.865 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_teql.ko 2023-09-23T08:28:10.865 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp 2023-09-23T08:28:10.865 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp/sctp.ko 2023-09-23T08:28:10.865 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp/sctp_diag.ko 2023-09-23T08:28:10.865 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc 2023-09-23T08:28:10.865 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss 2023-09-23T08:28:10.865 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-09-23T08:28:10.865 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-09-23T08:28:10.865 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/sunrpc.ko 2023-09-23T08:28:10.865 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/xprtrdma 2023-09-23T08:28:10.866 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-09-23T08:28:10.866 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc 2023-09-23T08:28:10.866 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc/diag.ko 2023-09-23T08:28:10.866 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc/tipc.ko 2023-09-23T08:28:10.866 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/unix 2023-09-23T08:28:10.866 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/unix/unix_diag.ko 2023-09-23T08:28:10.866 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock 2023-09-23T08:28:10.866 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-09-23T08:28:10.866 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-09-23T08:28:10.867 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock.ko 2023-09-23T08:28:10.867 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock_diag.ko 2023-09-23T08:28:10.867 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock_loopback.ko 2023-09-23T08:28:10.867 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm 2023-09-23T08:28:10.867 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm/xfrm_ipcomp.ko 2023-09-23T08:28:10.867 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security 2023-09-23T08:28:10.867 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys 2023-09-23T08:28:10.867 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/encrypted-keys 2023-09-23T08:28:10.867 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-09-23T08:28:10.867 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/trusted-keys 2023-09-23T08:28:10.867 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/trusted-keys/trusted.ko 2023-09-23T08:28:10.867 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt 2023-09-23T08:28:10.868 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt/lib 2023-09-23T08:28:10.868 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt/lib/irqbypass.ko 2023-09-23T08:28:10.868 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.alias 2023-09-23T08:28:10.868 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.alias.bin 2023-09-23T08:28:10.868 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin 2023-09-23T08:28:10.868 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin.bin 2023-09-23T08:28:10.868 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin.modinfo 2023-09-23T08:28:10.868 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.dep 2023-09-23T08:28:10.868 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.dep.bin 2023-09-23T08:28:10.868 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.devname 2023-09-23T08:28:10.868 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.order 2023-09-23T08:28:10.869 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.softdep 2023-09-23T08:28:10.869 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.symbols 2023-09-23T08:28:10.869 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.symbols.bin 2023-09-23T08:28:10.869 DEBUG:teuthology.task.kernel:get_image_version: 6.5.0-rc7-gfef64f93da2b 2023-09-23T08:28:10.869 DEBUG:teuthology.orchestra.run.smithi161:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-09-23T08:28:10.895 INFO:teuthology.orchestra.run.smithi161.stdout:postinstall scriptlet (using /bin/sh): 2023-09-23T08:28:10.895 INFO:teuthology.orchestra.run.smithi161.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b -a -r /boot/System.map-6.5.0-rc7-gfef64f93da2b ]; then 2023-09-23T08:28:10.895 INFO:teuthology.orchestra.run.smithi161.stdout:cp /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm 2023-09-23T08:28:10.895 INFO:teuthology.orchestra.run.smithi161.stdout:cp /boot/System.map-6.5.0-rc7-gfef64f93da2b /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-09-23T08:28:10.895 INFO:teuthology.orchestra.run.smithi161.stdout:rm -f /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b /boot/System.map-6.5.0-rc7-gfef64f93da2b 2023-09-23T08:28:10.895 INFO:teuthology.orchestra.run.smithi161.stdout:/sbin/installkernel 6.5.0-rc7-gfef64f93da2b /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-09-23T08:28:10.896 INFO:teuthology.orchestra.run.smithi161.stdout:rm -f /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-09-23T08:28:10.896 INFO:teuthology.orchestra.run.smithi161.stdout:fi 2023-09-23T08:28:10.896 INFO:teuthology.orchestra.run.smithi161.stdout:preuninstall scriptlet (using /bin/sh): 2023-09-23T08:28:10.896 INFO:teuthology.orchestra.run.smithi161.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-09-23T08:28:10.896 INFO:teuthology.orchestra.run.smithi161.stdout:new-kernel-pkg --remove 6.5.0-rc7-gfef64f93da2b --rminitrd --initrdfile=/boot/initramfs-6.5.0-rc7-gfef64f93da2b.img 2023-09-23T08:28:10.896 INFO:teuthology.orchestra.run.smithi161.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-09-23T08:28:10.896 INFO:teuthology.orchestra.run.smithi161.stdout:kernel-install remove 6.5.0-rc7-gfef64f93da2b 2023-09-23T08:28:10.896 INFO:teuthology.orchestra.run.smithi161.stdout:fi 2023-09-23T08:28:10.896 INFO:teuthology.orchestra.run.smithi161.stdout:postuninstall scriptlet (using /bin/sh): 2023-09-23T08:28:10.896 INFO:teuthology.orchestra.run.smithi161.stdout:if [ -x /sbin/update-bootloader ]; then 2023-09-23T08:28:10.896 INFO:teuthology.orchestra.run.smithi161.stdout:/sbin/update-bootloader --remove 6.5.0-rc7-gfef64f93da2b 2023-09-23T08:28:10.896 INFO:teuthology.orchestra.run.smithi161.stdout:fi 2023-09-23T08:28:10.897 DEBUG:teuthology.orchestra.run.smithi161:> sudo rpm -qi grub2-tools 2023-09-23T08:28:10.975 INFO:teuthology.orchestra.run.smithi161.stdout:Name : grub2-tools 2023-09-23T08:28:10.976 INFO:teuthology.orchestra.run.smithi161.stdout:Epoch : 1 2023-09-23T08:28:10.976 INFO:teuthology.orchestra.run.smithi161.stdout:Version : 2.02 2023-09-23T08:28:10.976 INFO:teuthology.orchestra.run.smithi161.stdout:Release : 123.el8 2023-09-23T08:28:10.976 INFO:teuthology.orchestra.run.smithi161.stdout:Architecture: x86_64 2023-09-23T08:28:10.976 INFO:teuthology.orchestra.run.smithi161.stdout:Install Date: Thu 14 Jul 2022 06:22:19 PM UTC 2023-09-23T08:28:10.976 INFO:teuthology.orchestra.run.smithi161.stdout:Group : System Environment/Base 2023-09-23T08:28:10.976 INFO:teuthology.orchestra.run.smithi161.stdout:Size : 9265450 2023-09-23T08:28:10.976 INFO:teuthology.orchestra.run.smithi161.stdout:License : GPLv3+ 2023-09-23T08:28:10.976 INFO:teuthology.orchestra.run.smithi161.stdout:Signature : RSA/SHA256, Thu 31 Mar 2022 07:24:35 PM UTC, Key ID 199e2f91fd431d51 2023-09-23T08:28:10.977 INFO:teuthology.orchestra.run.smithi161.stdout:Source RPM : grub2-2.02-123.el8.src.rpm 2023-09-23T08:28:10.977 INFO:teuthology.orchestra.run.smithi161.stdout:Build Date : Mon 28 Mar 2022 02:12:09 PM UTC 2023-09-23T08:28:10.977 INFO:teuthology.orchestra.run.smithi161.stdout:Build Host : x86-vm-09.build.eng.bos.redhat.com 2023-09-23T08:28:10.977 INFO:teuthology.orchestra.run.smithi161.stdout:Relocations : (not relocatable) 2023-09-23T08:28:10.977 INFO:teuthology.orchestra.run.smithi161.stdout:Packager : Red Hat, Inc. 2023-09-23T08:28:10.977 INFO:teuthology.orchestra.run.smithi161.stdout:Vendor : Red Hat, Inc. 2023-09-23T08:28:10.977 INFO:teuthology.orchestra.run.smithi161.stdout:URL : http://www.gnu.org/software/grub/ 2023-09-23T08:28:10.977 INFO:teuthology.orchestra.run.smithi161.stdout:Summary : Support tools for GRUB. 2023-09-23T08:28:10.977 INFO:teuthology.orchestra.run.smithi161.stdout:Description : 2023-09-23T08:28:10.977 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-09-23T08:28:10.977 INFO:teuthology.orchestra.run.smithi161.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-09-23T08:28:10.977 INFO:teuthology.orchestra.run.smithi161.stdout:customizable bootloader with modular architecture. It supports a rich 2023-09-23T08:28:10.978 INFO:teuthology.orchestra.run.smithi161.stdout:variety of kernel formats, file systems, computer architectures and 2023-09-23T08:28:10.978 INFO:teuthology.orchestra.run.smithi161.stdout:hardware devices. 2023-09-23T08:28:10.978 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-09-23T08:28:10.978 INFO:teuthology.orchestra.run.smithi161.stdout:This subpackage provides tools for support of all platforms. 2023-09-23T08:28:10.979 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-09-23T08:28:10.979 INFO:teuthology.task.kernel:Updating grub on smithi161 to boot 6.5.0-rc7-gfef64f93da2b 2023-09-23T08:28:10.979 DEBUG:teuthology.orchestra.run.smithi161:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-09-23T08:28:16.151 INFO:teuthology.orchestra.run.smithi161.stderr:Generating grub configuration file ... 2023-09-23T08:28:18.403 INFO:teuthology.orchestra.run.smithi161.stderr:done 2023-09-23T08:28:18.405 DEBUG:teuthology.orchestra.run.smithi161:> mktemp 2023-09-23T08:28:18.423 INFO:teuthology.orchestra.run.smithi161.stdout:/tmp/tmp.5QBwQ16feF 2023-09-23T08:28:18.423 DEBUG:teuthology.orchestra.run.smithi161:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.5QBwQ16feF 2023-09-23T08:28:18.509 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 0666 /tmp/tmp.5QBwQ16feF 2023-09-23T08:28:18.618 DEBUG:teuthology.orchestra.remote:smithi161:/tmp/tmp.5QBwQ16feF is 6KB 2023-09-23T08:28:18.666 DEBUG:teuthology.orchestra.run.smithi161:> rm -fr /tmp/tmp.5QBwQ16feF 2023-09-23T08:28:18.682 DEBUG:teuthology.orchestra.run.smithi161:> sudo /bin/ls /boot/loader/entries || true 2023-09-23T08:28:18.747 INFO:teuthology.orchestra.run.smithi161.stdout:5a84457b7b52416e95d47d02e2e4a60f-0-rescue.conf 2023-09-23T08:28:18.747 INFO:teuthology.orchestra.run.smithi161.stdout:5a84457b7b52416e95d47d02e2e4a60f-4.18.0-372.9.1.el8.x86_64.conf 2023-09-23T08:28:18.747 INFO:teuthology.orchestra.run.smithi161.stdout:5a84457b7b52416e95d47d02e2e4a60f-6.5.0-rc7-gfef64f93da2b.conf 2023-09-23T08:28:18.749 DEBUG:teuthology.orchestra.run.smithi161:> sudo grub2-set-default 5a84457b7b52416e95d47d02e2e4a60f-6.5.0-rc7-gfef64f93da2b 2023-09-23T08:28:18.891 DEBUG:teuthology.orchestra.run.smithi161:> sudo shutdown -r now 2023-09-23T08:28:34.294 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-09-23T08:28:34.295 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2023-09-23T08:28:34.295 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-23T08:28:38.384 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-09-23T08:28:38.384 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2023-09-23T08:28:38.385 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-23T08:28:48.902 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2023-09-23T08:28:48.902 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2023-09-23T08:28:48.903 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-23T08:28:52.730 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.135 2023-09-23T08:28:56.826 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.82 2023-09-23T08:29:01.734 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2023-09-23T08:29:01.735 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-23T08:29:04.794 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.135 2023-09-23T08:29:05.828 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2023-09-23T08:29:05.829 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-23T08:29:07.326 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-09-23T08:29:08.890 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.82 2023-09-23T08:29:16.332 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2023-09-23T08:29:16.332 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-23T08:29:16.796 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2023-09-23T08:29:16.797 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-23T08:29:19.390 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-09-23T08:29:20.892 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2023-09-23T08:29:20.893 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-23T08:29:31.402 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2023-09-23T08:29:31.402 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-23T08:29:35.226 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.135 2023-09-23T08:29:49.818 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-09-23T08:29:50.227 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2023-09-23T08:29:50.228 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-23T08:29:50.805 DEBUG:teuthology.orchestra.run.smithi135:> true 2023-09-23T08:29:51.252 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi135.front.sepia.ceph.com' 2023-09-23T08:29:51.252 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.5.0-rc7-gfef64f93da2b"... 2023-09-23T08:29:51.253 DEBUG:teuthology.orchestra.run.smithi135:> uname -r 2023-09-23T08:29:51.294 INFO:teuthology.orchestra.run.smithi135.stdout:6.5.0-rc7-gfef64f93da2b 2023-09-23T08:29:51.294 DEBUG:teuthology.task.kernel:current kernel version is 6.5.0-rc7-gfef64f93da2b vs 6.5.0-rc7-gfef64f93da2b 2023-09-23T08:29:51.294 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-09-23T08:29:51.294 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-09-23T08:29:52.295 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-09-23T08:29:52.296 DEBUG:teuthology.orchestra.run.smithi135:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-09-23T08:29:52.501 INFO:teuthology.orchestra.run.smithi135.stdout:ttyS1 2023-09-23T08:29:52.533 DEBUG:teuthology.parallel:result is None 2023-09-23T08:29:52.747 DEBUG:teuthology.orchestra.run.smithi082:> true 2023-09-23T08:29:53.283 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi082.front.sepia.ceph.com' 2023-09-23T08:29:53.283 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.5.0-rc7-gfef64f93da2b"... 2023-09-23T08:29:53.283 DEBUG:teuthology.orchestra.run.smithi082:> uname -r 2023-09-23T08:29:53.324 INFO:teuthology.orchestra.run.smithi082.stdout:6.5.0-rc7-gfef64f93da2b 2023-09-23T08:29:53.324 DEBUG:teuthology.task.kernel:current kernel version is 6.5.0-rc7-gfef64f93da2b vs 6.5.0-rc7-gfef64f93da2b 2023-09-23T08:29:53.324 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-09-23T08:29:53.324 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-09-23T08:29:54.325 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-09-23T08:29:54.325 DEBUG:teuthology.orchestra.run.smithi082:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-09-23T08:29:54.481 INFO:teuthology.orchestra.run.smithi082.stdout:ttyS1 2023-09-23T08:29:54.505 DEBUG:teuthology.parallel:result is None 2023-09-23T08:30:04.819 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2023-09-23T08:30:04.820 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-23T08:30:05.172 DEBUG:teuthology.orchestra.run.smithi161:> true 2023-09-23T08:30:05.624 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi161.front.sepia.ceph.com' 2023-09-23T08:30:05.624 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "6.5.0-rc7-gfef64f93da2b"... 2023-09-23T08:30:05.624 DEBUG:teuthology.orchestra.run.smithi161:> uname -r 2023-09-23T08:30:05.667 INFO:teuthology.orchestra.run.smithi161.stdout:6.5.0-rc7-gfef64f93da2b 2023-09-23T08:30:05.667 DEBUG:teuthology.task.kernel:current kernel version is 6.5.0-rc7-gfef64f93da2b vs 6.5.0-rc7-gfef64f93da2b 2023-09-23T08:30:05.668 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-09-23T08:30:05.668 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-09-23T08:30:06.668 INFO:teuthology.task.kernel:Enabling kdb on mon.c... 2023-09-23T08:30:06.669 DEBUG:teuthology.orchestra.run.smithi161:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-09-23T08:30:06.814 INFO:teuthology.orchestra.run.smithi161.stdout:ttyS1 2023-09-23T08:30:06.836 DEBUG:teuthology.parallel:result is None 2023-09-23T08:30:06.836 INFO:teuthology.run_tasks:Running task internal.base... 2023-09-23T08:30:06.843 INFO:teuthology.task.internal:Creating test directory... 2023-09-23T08:30:06.843 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-09-23T08:30:06.848 DEBUG:teuthology.orchestra.run.smithi135:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-09-23T08:30:06.853 DEBUG:teuthology.orchestra.run.smithi161:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-09-23T08:30:06.896 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-09-23T08:30:06.902 INFO:teuthology.run_tasks:Running task internal.archive... 2023-09-23T08:30:06.909 INFO:teuthology.task.internal:Creating archive directory... 2023-09-23T08:30:06.909 DEBUG:teuthology.orchestra.run.smithi082:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-09-23T08:30:06.914 DEBUG:teuthology.orchestra.run.smithi135:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-09-23T08:30:06.918 DEBUG:teuthology.orchestra.run.smithi161:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-09-23T08:30:07.025 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-09-23T08:30:07.032 INFO:teuthology.task.internal:Enabling coredump saving... 2023-09-23T08:30:07.032 DEBUG:teuthology.orchestra.run.smithi082:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-09-23T08:30:07.037 DEBUG:teuthology.orchestra.run.smithi135:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-09-23T08:30:07.041 DEBUG:teuthology.orchestra.run.smithi161:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-09-23T08:30:07.114 INFO:teuthology.orchestra.run.smithi082.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-23T08:30:07.125 INFO:teuthology.orchestra.run.smithi135.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-23T08:30:07.142 INFO:teuthology.orchestra.run.smithi082.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-23T08:30:07.143 INFO:teuthology.orchestra.run.smithi161.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-23T08:30:07.153 INFO:teuthology.orchestra.run.smithi135.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-23T08:30:07.172 INFO:teuthology.orchestra.run.smithi161.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-23T08:30:07.175 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-09-23T08:30:07.181 INFO:teuthology.task.internal:Configuring sudo... 2023-09-23T08:30:07.182 DEBUG:teuthology.orchestra.run.smithi082:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-09-23T08:30:07.186 DEBUG:teuthology.orchestra.run.smithi135:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-09-23T08:30:07.190 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-09-23T08:30:07.263 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-09-23T08:30:07.272 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-09-23T08:30:07.273 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-09-23T08:30:07.278 DEBUG:teuthology.orchestra.run.smithi135:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-09-23T08:30:07.282 DEBUG:teuthology.orchestra.run.smithi161:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-09-23T08:30:07.335 DEBUG:teuthology.orchestra.run.smithi082:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-23T08:30:07.427 DEBUG:teuthology.orchestra.run.smithi082:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-23T08:30:07.515 DEBUG:teuthology.orchestra.run.smithi082:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-23T08:30:07.583 DEBUG:teuthology.orchestra.run.smithi082:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-23T08:30:07.650 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-09-23T08:30:07.650 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-09-23T08:30:07.718 DEBUG:teuthology.orchestra.run.smithi135:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-23T08:30:07.787 DEBUG:teuthology.orchestra.run.smithi135:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-23T08:30:07.861 DEBUG:teuthology.orchestra.run.smithi135:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-23T08:30:07.933 DEBUG:teuthology.orchestra.run.smithi135:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-23T08:30:08.015 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-09-23T08:30:08.015 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-09-23T08:30:08.082 DEBUG:teuthology.orchestra.run.smithi161:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-23T08:30:08.158 DEBUG:teuthology.orchestra.run.smithi161:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-23T08:30:08.260 DEBUG:teuthology.orchestra.run.smithi161:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-23T08:30:08.332 DEBUG:teuthology.orchestra.run.smithi161:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-23T08:30:08.413 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-09-23T08:30:08.414 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-09-23T08:30:08.481 DEBUG:teuthology.orchestra.run.smithi082:> sudo service rsyslog restart 2023-09-23T08:30:08.486 DEBUG:teuthology.orchestra.run.smithi135:> sudo service rsyslog restart 2023-09-23T08:30:08.490 DEBUG:teuthology.orchestra.run.smithi161:> sudo service rsyslog restart 2023-09-23T08:30:08.603 INFO:teuthology.orchestra.run.smithi135.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-09-23T08:30:08.608 INFO:teuthology.orchestra.run.smithi082.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-09-23T08:30:08.669 INFO:teuthology.orchestra.run.smithi161.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-09-23T08:30:09.078 INFO:teuthology.run_tasks:Running task internal.timer... 2023-09-23T08:30:09.087 INFO:teuthology.task.internal:Starting timer... 2023-09-23T08:30:09.087 INFO:teuthology.run_tasks:Running task pcp... 2023-09-23T08:30:09.104 INFO:teuthology.run_tasks:Running task selinux... 2023-09-23T08:30:09.113 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-09-23T08:30:09.113 DEBUG:teuthology.orchestra.run.smithi082:> sudo service auditd rotate 2023-09-23T08:30:09.234 INFO:teuthology.orchestra.run.smithi082.stdout:Rotating logs: 2023-09-23T08:30:09.238 DEBUG:teuthology.orchestra.run.smithi135:> sudo service auditd rotate 2023-09-23T08:30:09.359 INFO:teuthology.orchestra.run.smithi135.stdout:Rotating logs: 2023-09-23T08:30:09.362 DEBUG:teuthology.orchestra.run.smithi161:> sudo service auditd rotate 2023-09-23T08:30:09.508 INFO:teuthology.orchestra.run.smithi161.stdout:Rotating logs: 2023-09-23T08:30:09.512 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-09-23T08:30:09.512 DEBUG:teuthology.orchestra.run.smithi082:> /usr/sbin/getenforce 2023-09-23T08:30:09.559 INFO:teuthology.orchestra.run.smithi082.stdout:Permissive 2023-09-23T08:30:09.561 DEBUG:teuthology.orchestra.run.smithi135:> /usr/sbin/getenforce 2023-09-23T08:30:09.614 INFO:teuthology.orchestra.run.smithi135.stdout:Permissive 2023-09-23T08:30:09.615 DEBUG:teuthology.orchestra.run.smithi161:> /usr/sbin/getenforce 2023-09-23T08:30:09.665 INFO:teuthology.orchestra.run.smithi161.stdout:Permissive 2023-09-23T08:30:09.665 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi082.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi135.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi161.front.sepia.ceph.com': 'permissive'} 2023-09-23T08:30:09.666 DEBUG:teuthology.orchestra.run.smithi082:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-09-23T08:30:09.736 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-23T08:30:09.737 DEBUG:teuthology.orchestra.run.smithi135:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-09-23T08:30:09.807 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-23T08:30:09.808 DEBUG:teuthology.orchestra.run.smithi161:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-09-23T08:30:09.879 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-23T08:30:09.879 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-09-23T08:30:09.879 DEBUG:teuthology.orchestra.run.smithi082:> sudo /usr/sbin/setenforce permissive 2023-09-23T08:30:09.948 DEBUG:teuthology.orchestra.run.smithi135:> sudo /usr/sbin/setenforce permissive 2023-09-23T08:30:10.026 DEBUG:teuthology.orchestra.run.smithi161:> sudo /usr/sbin/setenforce permissive 2023-09-23T08:30:10.103 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-09-23T08:30:10.114 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-09-23T08:30:10.127 INFO:teuthology.repo_utils:Fetching main from origin 2023-09-23T08:30:10.443 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-09-23T08:30:10.547 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-09-23T08:30:10.548 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi082.front.sepia.ceph.com,smithi135.front.sepia.ceph.com,smithi161.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-09-23T08:42:19.046 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi082.front.sepia.ceph.com'), Remote(name='ubuntu@smithi135.front.sepia.ceph.com'), Remote(name='ubuntu@smithi161.front.sepia.ceph.com')] 2023-09-23T08:42:19.074 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2023-09-23T08:42:19.075 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-23T08:42:19.166 DEBUG:teuthology.orchestra.run.smithi082:> true 2023-09-23T08:42:19.282 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi082.front.sepia.ceph.com' 2023-09-23T08:42:19.282 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2023-09-23T08:42:19.283 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-23T08:42:19.371 DEBUG:teuthology.orchestra.run.smithi135:> true 2023-09-23T08:42:19.485 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi135.front.sepia.ceph.com' 2023-09-23T08:42:19.485 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2023-09-23T08:42:19.486 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-23T08:42:19.576 DEBUG:teuthology.orchestra.run.smithi161:> true 2023-09-23T08:42:19.698 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi161.front.sepia.ceph.com' 2023-09-23T08:42:19.699 INFO:teuthology.run_tasks:Running task clock... 2023-09-23T08:42:19.708 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-09-23T08:42:19.709 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-09-23T08:42:19.709 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-23T08:42:19.714 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-09-23T08:42:19.714 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-23T08:42:19.719 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-09-23T08:42:19.719 DEBUG:teuthology.orchestra.run.smithi161:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-23T08:42:19.788 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-09-23T08:42:19.789 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-09-23T08:42:19.813 INFO:teuthology.orchestra.run.smithi161.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-09-23T08:42:19.822 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-09-23T08:42:19.825 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-09-23T08:42:19.847 INFO:teuthology.orchestra.run.smithi161.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-09-23T08:42:19.916 INFO:teuthology.orchestra.run.smithi135.stderr:sudo: ntpd: command not found 2023-09-23T08:42:19.921 INFO:teuthology.orchestra.run.smithi082.stderr:sudo: ntpd: command not found 2023-09-23T08:42:19.936 INFO:teuthology.orchestra.run.smithi161.stderr:sudo: ntpd: command not found 2023-09-23T08:42:19.945 INFO:teuthology.orchestra.run.smithi135.stdout:506 Cannot talk to daemon 2023-09-23T08:42:19.950 INFO:teuthology.orchestra.run.smithi082.stdout:506 Cannot talk to daemon 2023-09-23T08:42:19.966 INFO:teuthology.orchestra.run.smithi161.stdout:506 Cannot talk to daemon 2023-09-23T08:42:19.979 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-09-23T08:42:19.984 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-09-23T08:42:20.001 INFO:teuthology.orchestra.run.smithi161.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-09-23T08:42:20.014 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-09-23T08:42:20.017 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-09-23T08:42:20.035 INFO:teuthology.orchestra.run.smithi161.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-09-23T08:42:20.106 INFO:teuthology.orchestra.run.smithi082.stderr:bash: ntpq: command not found 2023-09-23T08:42:20.107 INFO:teuthology.orchestra.run.smithi135.stderr:bash: ntpq: command not found 2023-09-23T08:42:20.112 INFO:teuthology.orchestra.run.smithi082.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-09-23T08:42:20.113 INFO:teuthology.orchestra.run.smithi082.stdout:=============================================================================== 2023-09-23T08:42:20.113 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-23T08:42:20.113 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-23T08:42:20.113 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-23T08:42:20.113 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-23T08:42:20.114 INFO:teuthology.orchestra.run.smithi135.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-09-23T08:42:20.114 INFO:teuthology.orchestra.run.smithi135.stdout:=============================================================================== 2023-09-23T08:42:20.114 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-23T08:42:20.114 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-23T08:42:20.114 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-23T08:42:20.114 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-23T08:42:20.125 INFO:teuthology.orchestra.run.smithi161.stderr:bash: ntpq: command not found 2023-09-23T08:42:20.132 INFO:teuthology.orchestra.run.smithi161.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-09-23T08:42:20.132 INFO:teuthology.orchestra.run.smithi161.stdout:=============================================================================== 2023-09-23T08:42:20.132 INFO:teuthology.orchestra.run.smithi161.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-23T08:42:20.132 INFO:teuthology.orchestra.run.smithi161.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-23T08:42:20.132 INFO:teuthology.orchestra.run.smithi161.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-23T08:42:20.132 INFO:teuthology.orchestra.run.smithi161.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-23T08:42:20.133 INFO:teuthology.run_tasks:Running task pexec... 2023-09-23T08:42:20.157 INFO:teuthology.task.pexec:Executing custom commands... 2023-09-23T08:42:20.158 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi082.front.sepia.ceph.com 2023-09-23T08:42:20.158 DEBUG:teuthology.orchestra.run.smithi082:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-09-23T08:42:20.159 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi135.front.sepia.ceph.com 2023-09-23T08:42:20.159 DEBUG:teuthology.orchestra.run.smithi135:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-09-23T08:42:20.159 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi161.front.sepia.ceph.com 2023-09-23T08:42:20.159 DEBUG:teuthology.orchestra.run.smithi161:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-09-23T08:42:20.638 INFO:teuthology.orchestra.run.smithi082.stdout:Updating Subscription Management repositories. 2023-09-23T08:42:20.639 INFO:teuthology.orchestra.run.smithi135.stdout:Updating Subscription Management repositories. 2023-09-23T08:42:20.649 INFO:teuthology.orchestra.run.smithi161.stdout:Updating Subscription Management repositories. 2023-09-23T08:42:21.641 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:01:50 ago on Sat 23 Sep 2023 08:40:31 AM UTC. 2023-09-23T08:42:21.643 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:01:50 ago on Sat 23 Sep 2023 08:40:31 AM UTC. 2023-09-23T08:42:21.671 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:01:49 ago on Sat 23 Sep 2023 08:40:32 AM UTC. 2023-09-23T08:42:23.408 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2023-09-23T08:42:23.409 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2023-09-23T08:42:23.409 INFO:teuthology.orchestra.run.smithi135.stdout: Package Architecture Version Repository Size 2023-09-23T08:42:23.409 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2023-09-23T08:42:23.409 INFO:teuthology.orchestra.run.smithi135.stdout:Resetting modules: 2023-09-23T08:42:23.409 INFO:teuthology.orchestra.run.smithi135.stdout: container-tools 2023-09-23T08:42:23.409 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-09-23T08:42:23.409 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2023-09-23T08:42:23.410 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2023-09-23T08:42:23.410 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-09-23T08:42:23.490 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2023-09-23T08:42:23.492 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2023-09-23T08:42:23.492 INFO:teuthology.orchestra.run.smithi082.stdout: Package Architecture Version Repository Size 2023-09-23T08:42:23.492 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2023-09-23T08:42:23.492 INFO:teuthology.orchestra.run.smithi082.stdout:Resetting modules: 2023-09-23T08:42:23.492 INFO:teuthology.orchestra.run.smithi082.stdout: container-tools 2023-09-23T08:42:23.492 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:42:23.492 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2023-09-23T08:42:23.492 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2023-09-23T08:42:23.492 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:42:23.550 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2023-09-23T08:42:23.551 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2023-09-23T08:42:23.551 INFO:teuthology.orchestra.run.smithi161.stdout: Package Architecture Version Repository Size 2023-09-23T08:42:23.551 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2023-09-23T08:42:23.552 INFO:teuthology.orchestra.run.smithi161.stdout:Resetting modules: 2023-09-23T08:42:23.552 INFO:teuthology.orchestra.run.smithi161.stdout: container-tools 2023-09-23T08:42:23.552 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-09-23T08:42:23.552 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction Summary 2023-09-23T08:42:23.552 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2023-09-23T08:42:23.552 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-09-23T08:42:24.634 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:01:53 ago on Sat 23 Sep 2023 08:40:31 AM UTC. 2023-09-23T08:42:24.719 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:01:53 ago on Sat 23 Sep 2023 08:40:31 AM UTC. 2023-09-23T08:42:24.788 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:01:52 ago on Sat 23 Sep 2023 08:40:32 AM UTC. 2023-09-23T08:42:27.421 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2023-09-23T08:42:27.862 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2023-09-23T08:42:27.910 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2023-09-23T08:42:28.020 INFO:teuthology.orchestra.run.smithi135.stdout:Updating Subscription Management repositories. 2023-09-23T08:42:28.442 INFO:teuthology.orchestra.run.smithi082.stdout:Updating Subscription Management repositories. 2023-09-23T08:42:28.508 INFO:teuthology.orchestra.run.smithi161.stdout:Updating Subscription Management repositories. 2023-09-23T08:42:28.970 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:01:57 ago on Sat 23 Sep 2023 08:40:31 AM UTC. 2023-09-23T08:42:29.363 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:01:57 ago on Sat 23 Sep 2023 08:40:31 AM UTC. 2023-09-23T08:42:29.438 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:01:56 ago on Sat 23 Sep 2023 08:40:32 AM UTC. 2023-09-23T08:42:30.752 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2023-09-23T08:42:30.851 INFO:teuthology.orchestra.run.smithi135.stdout:============================================================================================================ 2023-09-23T08:42:30.851 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repository Size 2023-09-23T08:42:30.851 INFO:teuthology.orchestra.run.smithi135.stdout:============================================================================================================ 2023-09-23T08:42:30.851 INFO:teuthology.orchestra.run.smithi135.stdout:Installing group/module packages: 2023-09-23T08:42:30.852 INFO:teuthology.orchestra.run.smithi135.stdout: buildah x86_64 1:1.26.2-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 8.0 M 2023-09-23T08:42:30.852 INFO:teuthology.orchestra.run.smithi135.stdout: cockpit-podman noarch 49.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 524 k 2023-09-23T08:42:30.852 INFO:teuthology.orchestra.run.smithi135.stdout: crun x86_64 1.5-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 213 k 2023-09-23T08:42:30.852 INFO:teuthology.orchestra.run.smithi135.stdout: python3-podman noarch 4.0.1-1.module+el8.6.0+16837+85b82211 rhel-8-for-x86_64-appstream-rpms 149 k 2023-09-23T08:42:30.852 INFO:teuthology.orchestra.run.smithi135.stdout: skopeo x86_64 2:1.9.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 7.0 M 2023-09-23T08:42:30.852 INFO:teuthology.orchestra.run.smithi135.stdout: toolbox x86_64 0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 2.2 M 2023-09-23T08:42:30.852 INFO:teuthology.orchestra.run.smithi135.stdout: udica noarch 0.2.6-4.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 49 k 2023-09-23T08:42:30.852 INFO:teuthology.orchestra.run.smithi135.stdout:Installing dependencies: 2023-09-23T08:42:30.852 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-09-23T08:42:30.852 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-09-23T08:42:30.852 INFO:teuthology.orchestra.run.smithi135.stdout: yajl x86_64 2.1.0-10.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-09-23T08:42:30.852 INFO:teuthology.orchestra.run.smithi135.stdout:Installing module profiles: 2023-09-23T08:42:30.853 INFO:teuthology.orchestra.run.smithi135.stdout: container-tools/common 2023-09-23T08:42:30.853 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-09-23T08:42:30.853 INFO:teuthology.orchestra.run.smithi135.stdout:Enabling module streams: 2023-09-23T08:42:30.853 INFO:teuthology.orchestra.run.smithi135.stdout: container-tools rhel8 2023-09-23T08:42:30.853 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-09-23T08:42:30.853 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2023-09-23T08:42:30.853 INFO:teuthology.orchestra.run.smithi135.stdout:============================================================================================================ 2023-09-23T08:42:30.853 INFO:teuthology.orchestra.run.smithi135.stdout:Install 10 Packages 2023-09-23T08:42:30.853 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-09-23T08:42:30.854 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 18 M 2023-09-23T08:42:30.854 INFO:teuthology.orchestra.run.smithi135.stdout:Installed size: 65 M 2023-09-23T08:42:30.854 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2023-09-23T08:42:31.128 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2023-09-23T08:42:31.176 INFO:teuthology.orchestra.run.smithi135.stdout:(1/10): python3-pyxdg-0.25-16.el8.noarch.rpm 292 kB/s | 94 kB 00:00 2023-09-23T08:42:31.201 INFO:teuthology.orchestra.run.smithi135.stdout:(2/10): python3-pytoml-0.1.14-5.git7dea353.el8. 71 kB/s | 25 kB 00:00 2023-09-23T08:42:31.226 INFO:teuthology.orchestra.run.smithi082.stdout:============================================================================================================ 2023-09-23T08:42:31.226 INFO:teuthology.orchestra.run.smithi082.stdout: Package Arch Version Repository Size 2023-09-23T08:42:31.226 INFO:teuthology.orchestra.run.smithi082.stdout:============================================================================================================ 2023-09-23T08:42:31.226 INFO:teuthology.orchestra.run.smithi082.stdout:Installing group/module packages: 2023-09-23T08:42:31.227 INFO:teuthology.orchestra.run.smithi082.stdout: buildah x86_64 1:1.26.2-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 8.0 M 2023-09-23T08:42:31.227 INFO:teuthology.orchestra.run.smithi082.stdout: cockpit-podman noarch 49.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 524 k 2023-09-23T08:42:31.227 INFO:teuthology.orchestra.run.smithi082.stdout: crun x86_64 1.5-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 213 k 2023-09-23T08:42:31.227 INFO:teuthology.orchestra.run.smithi082.stdout: python3-podman noarch 4.0.1-1.module+el8.6.0+16837+85b82211 rhel-8-for-x86_64-appstream-rpms 149 k 2023-09-23T08:42:31.227 INFO:teuthology.orchestra.run.smithi082.stdout: skopeo x86_64 2:1.9.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 7.0 M 2023-09-23T08:42:31.227 INFO:teuthology.orchestra.run.smithi082.stdout: toolbox x86_64 0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 2.2 M 2023-09-23T08:42:31.227 INFO:teuthology.orchestra.run.smithi082.stdout: udica noarch 0.2.6-4.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 49 k 2023-09-23T08:42:31.227 INFO:teuthology.orchestra.run.smithi082.stdout:Installing dependencies: 2023-09-23T08:42:31.227 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-09-23T08:42:31.227 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-09-23T08:42:31.227 INFO:teuthology.orchestra.run.smithi082.stdout: yajl x86_64 2.1.0-10.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-09-23T08:42:31.227 INFO:teuthology.orchestra.run.smithi082.stdout:Installing module profiles: 2023-09-23T08:42:31.228 INFO:teuthology.orchestra.run.smithi082.stdout: container-tools/common 2023-09-23T08:42:31.228 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:42:31.228 INFO:teuthology.orchestra.run.smithi082.stdout:Enabling module streams: 2023-09-23T08:42:31.228 INFO:teuthology.orchestra.run.smithi082.stdout: container-tools rhel8 2023-09-23T08:42:31.228 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:42:31.228 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2023-09-23T08:42:31.228 INFO:teuthology.orchestra.run.smithi082.stdout:============================================================================================================ 2023-09-23T08:42:31.228 INFO:teuthology.orchestra.run.smithi082.stdout:Install 10 Packages 2023-09-23T08:42:31.228 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:42:31.229 INFO:teuthology.orchestra.run.smithi135.stdout:(3/10): yajl-2.1.0-10.el8.x86_64.rpm 109 kB/s | 41 kB 00:00 2023-09-23T08:42:31.230 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 18 M 2023-09-23T08:42:31.230 INFO:teuthology.orchestra.run.smithi082.stdout:Installed size: 65 M 2023-09-23T08:42:31.230 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2023-09-23T08:42:31.238 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2023-09-23T08:42:31.252 INFO:teuthology.orchestra.run.smithi135.stdout:(4/10): udica-0.2.6-4.module+el8.6.0+16771+28df 650 kB/s | 49 kB 00:00 2023-09-23T08:42:31.286 INFO:teuthology.orchestra.run.smithi135.stdout:(5/10): cockpit-podman-49.1-1.module+el8.6.0+16 6.1 MB/s | 524 kB 00:00 2023-09-23T08:42:31.302 INFO:teuthology.orchestra.run.smithi082.stdout:(1/10): python3-pyxdg-0.25-16.el8.noarch.rpm 1.3 MB/s | 94 kB 00:00 2023-09-23T08:42:31.311 INFO:teuthology.orchestra.run.smithi135.stdout:(6/10): python3-podman-4.0.1-1.module+el8.6.0+1 2.5 MB/s | 149 kB 00:00 2023-09-23T08:42:31.327 INFO:teuthology.orchestra.run.smithi082.stdout:(2/10): python3-pytoml-0.1.14-5.git7dea353.el8. 253 kB/s | 25 kB 00:00 2023-09-23T08:42:31.338 INFO:teuthology.orchestra.run.smithi161.stdout:============================================================================================================ 2023-09-23T08:42:31.338 INFO:teuthology.orchestra.run.smithi161.stdout: Package Arch Version Repository Size 2023-09-23T08:42:31.338 INFO:teuthology.orchestra.run.smithi161.stdout:============================================================================================================ 2023-09-23T08:42:31.338 INFO:teuthology.orchestra.run.smithi161.stdout:Installing group/module packages: 2023-09-23T08:42:31.338 INFO:teuthology.orchestra.run.smithi161.stdout: buildah x86_64 1:1.26.2-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 8.0 M 2023-09-23T08:42:31.338 INFO:teuthology.orchestra.run.smithi161.stdout: cockpit-podman noarch 49.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 524 k 2023-09-23T08:42:31.338 INFO:teuthology.orchestra.run.smithi161.stdout: crun x86_64 1.5-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 213 k 2023-09-23T08:42:31.338 INFO:teuthology.orchestra.run.smithi161.stdout: python3-podman noarch 4.0.1-1.module+el8.6.0+16837+85b82211 rhel-8-for-x86_64-appstream-rpms 149 k 2023-09-23T08:42:31.338 INFO:teuthology.orchestra.run.smithi161.stdout: skopeo x86_64 2:1.9.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 7.0 M 2023-09-23T08:42:31.338 INFO:teuthology.orchestra.run.smithi161.stdout: toolbox x86_64 0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 2.2 M 2023-09-23T08:42:31.339 INFO:teuthology.orchestra.run.smithi161.stdout: udica noarch 0.2.6-4.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 49 k 2023-09-23T08:42:31.339 INFO:teuthology.orchestra.run.smithi161.stdout:Installing dependencies: 2023-09-23T08:42:31.339 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-09-23T08:42:31.339 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-09-23T08:42:31.339 INFO:teuthology.orchestra.run.smithi161.stdout: yajl x86_64 2.1.0-10.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-09-23T08:42:31.339 INFO:teuthology.orchestra.run.smithi161.stdout:Installing module profiles: 2023-09-23T08:42:31.339 INFO:teuthology.orchestra.run.smithi161.stdout: container-tools/common 2023-09-23T08:42:31.339 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-09-23T08:42:31.339 INFO:teuthology.orchestra.run.smithi161.stdout:Enabling module streams: 2023-09-23T08:42:31.339 INFO:teuthology.orchestra.run.smithi161.stdout: container-tools rhel8 2023-09-23T08:42:31.339 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-09-23T08:42:31.339 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction Summary 2023-09-23T08:42:31.339 INFO:teuthology.orchestra.run.smithi161.stdout:============================================================================================================ 2023-09-23T08:42:31.340 INFO:teuthology.orchestra.run.smithi161.stdout:Install 10 Packages 2023-09-23T08:42:31.340 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-09-23T08:42:31.340 INFO:teuthology.orchestra.run.smithi161.stdout:Total download size: 18 M 2023-09-23T08:42:31.340 INFO:teuthology.orchestra.run.smithi161.stdout:Installed size: 65 M 2023-09-23T08:42:31.340 INFO:teuthology.orchestra.run.smithi161.stdout:Downloading Packages: 2023-09-23T08:42:31.345 INFO:teuthology.orchestra.run.smithi135.stdout:(7/10): crun-1.5-1.module+el8.6.0+16771+28dfca7 3.6 MB/s | 213 kB 00:00 2023-09-23T08:42:31.353 INFO:teuthology.orchestra.run.smithi082.stdout:(3/10): yajl-2.1.0-10.el8.x86_64.rpm 331 kB/s | 41 kB 00:00 2023-09-23T08:42:31.378 INFO:teuthology.orchestra.run.smithi082.stdout:(4/10): udica-0.2.6-4.module+el8.6.0+16771+28df 653 kB/s | 49 kB 00:00 2023-09-23T08:42:31.412 INFO:teuthology.orchestra.run.smithi082.stdout:(5/10): cockpit-podman-49.1-1.module+el8.6.0+16 6.1 MB/s | 524 kB 00:00 2023-09-23T08:42:31.412 INFO:teuthology.orchestra.run.smithi161.stdout:(1/10): python3-pyxdg-0.25-16.el8.noarch.rpm 1.3 MB/s | 94 kB 00:00 2023-09-23T08:42:31.437 INFO:teuthology.orchestra.run.smithi161.stdout:(2/10): python3-pytoml-0.1.14-5.git7dea353.el8. 259 kB/s | 25 kB 00:00 2023-09-23T08:42:31.446 INFO:teuthology.orchestra.run.smithi082.stdout:(6/10): python3-podman-4.0.1-1.module+el8.6.0+1 2.2 MB/s | 149 kB 00:00 2023-09-23T08:42:31.462 INFO:teuthology.orchestra.run.smithi161.stdout:(3/10): yajl-2.1.0-10.el8.x86_64.rpm 336 kB/s | 41 kB 00:00 2023-09-23T08:42:31.479 INFO:teuthology.orchestra.run.smithi082.stdout:(7/10): crun-1.5-1.module+el8.6.0+16771+28dfca7 3.1 MB/s | 213 kB 00:00 2023-09-23T08:42:31.487 INFO:teuthology.orchestra.run.smithi135.stdout:(8/10): toolbox-0.0.99.3-0.6.module+el8.6.0+167 15 MB/s | 2.2 MB 00:00 2023-09-23T08:42:31.488 INFO:teuthology.orchestra.run.smithi161.stdout:(4/10): udica-0.2.6-4.module+el8.6.0+16771+28df 653 kB/s | 49 kB 00:00 2023-09-23T08:42:31.522 INFO:teuthology.orchestra.run.smithi161.stdout:(5/10): cockpit-podman-49.1-1.module+el8.6.0+16 6.1 MB/s | 524 kB 00:00 2023-09-23T08:42:31.547 INFO:teuthology.orchestra.run.smithi161.stdout:(6/10): python3-podman-4.0.1-1.module+el8.6.0+1 2.5 MB/s | 149 kB 00:00 2023-09-23T08:42:31.581 INFO:teuthology.orchestra.run.smithi161.stdout:(7/10): crun-1.5-1.module+el8.6.0+16771+28dfca7 3.5 MB/s | 213 kB 00:00 2023-09-23T08:42:31.604 INFO:teuthology.orchestra.run.smithi082.stdout:(8/10): toolbox-0.0.99.3-0.6.module+el8.6.0+167 18 MB/s | 2.2 MB 00:00 2023-09-23T08:42:31.613 INFO:teuthology.orchestra.run.smithi135.stdout:(9/10): skopeo-1.9.1-1.module+el8.6.0+16771+28d 23 MB/s | 7.0 MB 00:00 2023-09-23T08:42:31.705 INFO:teuthology.orchestra.run.smithi135.stdout:(10/10): buildah-1.26.2-1.module+el8.6.0+16771+ 17 MB/s | 8.0 MB 00:00 2023-09-23T08:42:31.705 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2023-09-23T08:42:31.706 INFO:teuthology.orchestra.run.smithi135.stdout:Total 21 MB/s | 18 MB 00:00 2023-09-23T08:42:31.713 INFO:teuthology.orchestra.run.smithi161.stdout:(8/10): toolbox-0.0.99.3-0.6.module+el8.6.0+167 17 MB/s | 2.2 MB 00:00 2023-09-23T08:42:31.780 INFO:teuthology.orchestra.run.smithi082.stdout:(9/10): skopeo-1.9.1-1.module+el8.6.0+16771+28d 21 MB/s | 7.0 MB 00:00 2023-09-23T08:42:31.873 INFO:teuthology.orchestra.run.smithi161.stdout:(9/10): skopeo-1.9.1-1.module+el8.6.0+16771+28d 22 MB/s | 7.0 MB 00:00 2023-09-23T08:42:31.880 INFO:teuthology.orchestra.run.smithi082.stdout:(10/10): buildah-1.26.2-1.module+el8.6.0+16771+ 15 MB/s | 8.0 MB 00:00 2023-09-23T08:42:31.880 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2023-09-23T08:42:31.880 INFO:teuthology.orchestra.run.smithi082.stdout:Total 28 MB/s | 18 MB 00:00 2023-09-23T08:42:31.965 INFO:teuthology.orchestra.run.smithi161.stdout:(10/10): buildah-1.26.2-1.module+el8.6.0+16771+ 16 MB/s | 8.0 MB 00:00 2023-09-23T08:42:31.965 INFO:teuthology.orchestra.run.smithi161.stdout:-------------------------------------------------------------------------------- 2023-09-23T08:42:31.966 INFO:teuthology.orchestra.run.smithi161.stdout:Total 29 MB/s | 18 MB 00:00 2023-09-23T08:42:32.039 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2023-09-23T08:42:32.062 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2023-09-23T08:42:32.062 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2023-09-23T08:42:32.211 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2023-09-23T08:42:32.234 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2023-09-23T08:42:32.234 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2023-09-23T08:42:32.299 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction check 2023-09-23T08:42:32.321 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction check succeeded. 2023-09-23T08:42:32.322 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction test 2023-09-23T08:42:32.600 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2023-09-23T08:42:32.604 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2023-09-23T08:42:32.775 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2023-09-23T08:42:32.779 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2023-09-23T08:42:32.852 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction test succeeded. 2023-09-23T08:42:32.857 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction 2023-09-23T08:42:33.162 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2023-09-23T08:42:33.341 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2023-09-23T08:42:33.371 INFO:teuthology.orchestra.run.smithi161.stdout: Preparing : 1/1 2023-09-23T08:42:33.391 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/10 2023-09-23T08:42:33.550 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/10 2023-09-23T08:42:33.550 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/10 2023-09-23T08:42:33.580 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : yajl-2.1.0-10.el8.x86_64 2/10 2023-09-23T08:42:33.732 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : yajl-2.1.0-10.el8.x86_64 2/10 2023-09-23T08:42:33.760 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : yajl-2.1.0-10.el8.x86_64 2/10 2023-09-23T08:42:33.832 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/10 2023-09-23T08:42:33.941 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/10 2023-09-23T08:42:33.987 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/10 2023-09-23T08:42:34.066 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 4/10 2023-09-23T08:42:34.189 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 4/10 2023-09-23T08:42:34.199 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 4/10 2023-09-23T08:42:34.458 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 5/10 2023-09-23T08:42:34.578 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 5/10 2023-09-23T08:42:34.588 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 5/10 2023-09-23T08:42:35.318 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 6/10 2023-09-23T08:42:35.425 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 6/10 2023-09-23T08:42:35.429 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 6/10 2023-09-23T08:42:36.256 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 7/10 2023-09-23T08:42:36.367 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 7/10 2023-09-23T08:42:36.378 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 7/10 2023-09-23T08:42:36.532 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 8/10 2023-09-23T08:42:36.633 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 8/10 2023-09-23T08:42:36.635 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 8/10 2023-09-23T08:42:36.752 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 9/10 2023-09-23T08:42:36.821 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 9/10 2023-09-23T08:42:36.840 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 9/10 2023-09-23T08:42:36.935 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-09-23T08:42:37.054 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-09-23T08:42:37.056 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-09-23T08:42:37.353 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-09-23T08:42:37.353 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 1/10 2023-09-23T08:42:37.353 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 2/10 2023-09-23T08:42:37.353 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/10 2023-09-23T08:42:37.353 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 4/10 2023-09-23T08:42:37.353 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 5/10 2023-09-23T08:42:37.353 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 6/10 2023-09-23T08:42:37.353 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 7/10 2023-09-23T08:42:37.353 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 8/10 2023-09-23T08:42:37.354 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 9/10 2023-09-23T08:42:37.443 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-09-23T08:42:37.443 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 1/10 2023-09-23T08:42:37.443 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 2/10 2023-09-23T08:42:37.443 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/10 2023-09-23T08:42:37.443 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 4/10 2023-09-23T08:42:37.443 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 5/10 2023-09-23T08:42:37.443 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 6/10 2023-09-23T08:42:37.443 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 7/10 2023-09-23T08:42:37.444 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 8/10 2023-09-23T08:42:37.444 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 9/10 2023-09-23T08:42:37.446 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-09-23T08:42:37.446 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 1/10 2023-09-23T08:42:37.446 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 2/10 2023-09-23T08:42:37.447 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/10 2023-09-23T08:42:37.447 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 4/10 2023-09-23T08:42:37.447 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 5/10 2023-09-23T08:42:37.447 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 6/10 2023-09-23T08:42:37.447 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 7/10 2023-09-23T08:42:37.447 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 8/10 2023-09-23T08:42:37.447 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 9/10 2023-09-23T08:42:38.869 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 10/10 2023-09-23T08:42:38.869 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:02:07 ago on Sat 23 Sep 2023 08:40:31 AM UTC. 2023-09-23T08:42:38.874 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 10/10 2023-09-23T08:42:38.874 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:02:07 ago on Sat 23 Sep 2023 08:40:31 AM UTC. 2023-09-23T08:42:38.977 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 10/10 2023-09-23T08:42:38.977 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:02:06 ago on Sat 23 Sep 2023 08:40:32 AM UTC. 2023-09-23T08:42:44.434 INFO:teuthology.orchestra.run.smithi082.stdout:Installed products updated. 2023-09-23T08:42:44.605 INFO:teuthology.orchestra.run.smithi161.stdout:Installed products updated. 2023-09-23T08:42:44.642 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:42:44.642 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2023-09-23T08:42:44.642 INFO:teuthology.orchestra.run.smithi082.stdout: buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x86_64 2023-09-23T08:42:44.642 INFO:teuthology.orchestra.run.smithi082.stdout: cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca77.noarch 2023-09-23T08:42:44.642 INFO:teuthology.orchestra.run.smithi082.stdout: crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 2023-09-23T08:42:44.642 INFO:teuthology.orchestra.run.smithi082.stdout: python3-podman-4.0.1-1.module+el8.6.0+16837+85b82211.noarch 2023-09-23T08:42:44.642 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-09-23T08:42:44.643 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-09-23T08:42:44.643 INFO:teuthology.orchestra.run.smithi082.stdout: skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86_64 2023-09-23T08:42:44.643 INFO:teuthology.orchestra.run.smithi082.stdout: toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77.x86_64 2023-09-23T08:42:44.643 INFO:teuthology.orchestra.run.smithi082.stdout: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 2023-09-23T08:42:44.643 INFO:teuthology.orchestra.run.smithi082.stdout: yajl-2.1.0-10.el8.x86_64 2023-09-23T08:42:44.643 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:42:44.643 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2023-09-23T08:42:44.801 INFO:teuthology.orchestra.run.smithi135.stdout:Installed products updated. 2023-09-23T08:42:44.825 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-09-23T08:42:44.825 INFO:teuthology.orchestra.run.smithi161.stdout:Installed: 2023-09-23T08:42:44.825 INFO:teuthology.orchestra.run.smithi161.stdout: buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x86_64 2023-09-23T08:42:44.825 INFO:teuthology.orchestra.run.smithi161.stdout: cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca77.noarch 2023-09-23T08:42:44.825 INFO:teuthology.orchestra.run.smithi161.stdout: crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 2023-09-23T08:42:44.825 INFO:teuthology.orchestra.run.smithi161.stdout: python3-podman-4.0.1-1.module+el8.6.0+16837+85b82211.noarch 2023-09-23T08:42:44.826 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-09-23T08:42:44.826 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-09-23T08:42:44.826 INFO:teuthology.orchestra.run.smithi161.stdout: skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86_64 2023-09-23T08:42:44.826 INFO:teuthology.orchestra.run.smithi161.stdout: toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77.x86_64 2023-09-23T08:42:44.826 INFO:teuthology.orchestra.run.smithi161.stdout: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 2023-09-23T08:42:44.826 INFO:teuthology.orchestra.run.smithi161.stdout: yajl-2.1.0-10.el8.x86_64 2023-09-23T08:42:44.826 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-09-23T08:42:44.826 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2023-09-23T08:42:44.856 DEBUG:teuthology.parallel:result is None 2023-09-23T08:42:45.028 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-09-23T08:42:45.029 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2023-09-23T08:42:45.029 INFO:teuthology.orchestra.run.smithi135.stdout: buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x86_64 2023-09-23T08:42:45.029 INFO:teuthology.orchestra.run.smithi135.stdout: cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca77.noarch 2023-09-23T08:42:45.029 INFO:teuthology.orchestra.run.smithi135.stdout: crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 2023-09-23T08:42:45.029 INFO:teuthology.orchestra.run.smithi135.stdout: python3-podman-4.0.1-1.module+el8.6.0+16837+85b82211.noarch 2023-09-23T08:42:45.029 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-09-23T08:42:45.029 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-09-23T08:42:45.029 INFO:teuthology.orchestra.run.smithi135.stdout: skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86_64 2023-09-23T08:42:45.029 INFO:teuthology.orchestra.run.smithi135.stdout: toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77.x86_64 2023-09-23T08:42:45.029 INFO:teuthology.orchestra.run.smithi135.stdout: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 2023-09-23T08:42:45.030 INFO:teuthology.orchestra.run.smithi135.stdout: yajl-2.1.0-10.el8.x86_64 2023-09-23T08:42:45.030 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-09-23T08:42:45.030 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2023-09-23T08:42:45.062 DEBUG:teuthology.parallel:result is None 2023-09-23T08:42:45.282 DEBUG:teuthology.parallel:result is None 2023-09-23T08:42:45.282 INFO:teuthology.run_tasks:Running task install... 2023-09-23T08:42:45.299 DEBUG:teuthology.task.install:project ceph 2023-09-23T08:42:45.299 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'db9a2d12746faa158579b8d032d53d472ae6b6b0'}} 2023-09-23T08:42:45.299 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'db9a2d12746faa158579b8d032d53d472ae6b6b0'} 2023-09-23T08:42:45.300 INFO:teuthology.task.install:Using flavor: default 2023-09-23T08:42:45.339 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-09-23T08:42:45.339 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-09-23T08:42:45.339 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'db9a2d12746faa158579b8d032d53d472ae6b6b0', 'tag': None, 'wait_for_package': False} 2023-09-23T08:42:45.340 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=db9a2d12746faa158579b8d032d53d472ae6b6b0 2023-09-23T08:42:45.341 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'db9a2d12746faa158579b8d032d53d472ae6b6b0', 'tag': None, 'wait_for_package': False} 2023-09-23T08:42:45.342 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=db9a2d12746faa158579b8d032d53d472ae6b6b0 2023-09-23T08:42:45.343 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'db9a2d12746faa158579b8d032d53d472ae6b6b0', 'tag': None, 'wait_for_package': False} 2023-09-23T08:42:45.343 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=db9a2d12746faa158579b8d032d53d472ae6b6b0 2023-09-23T08:42:45.487 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230824.045828-scrub-failure/db9a2d12746faa158579b8d032d53d472ae6b6b0/centos/8/flavors/default/ 2023-09-23T08:42:45.488 INFO:teuthology.task.install.rpm:Package version is 18.0.0-5661.gdb9a2d12 2023-09-23T08:42:45.501 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230824.045828-scrub-failure/db9a2d12746faa158579b8d032d53d472ae6b6b0/centos/8/flavors/default/ 2023-09-23T08:42:45.501 INFO:teuthology.task.install.rpm:Package version is 18.0.0-5661.gdb9a2d12 2023-09-23T08:42:45.556 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230824.045828-scrub-failure/db9a2d12746faa158579b8d032d53d472ae6b6b0/centos/8/flavors/default/ 2023-09-23T08:42:45.557 INFO:teuthology.task.install.rpm:Package version is 18.0.0-5661.gdb9a2d12 2023-09-23T08:42:45.618 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230824.045828-scrub-failure/db9a2d12746faa158579b8d032d53d472ae6b6b0/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230824.045828-scrub-failure/db9a2d12746faa158579b8d032d53d472ae6b6b0/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230824.045828-scrub-failure/db9a2d12746faa158579b8d032d53d472ae6b6b0/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-09-23T08:42:45.618 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-09-23T08:42:45.618 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-09-23T08:42:45.620 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230824.045828-scrub-failure/db9a2d12746faa158579b8d032d53d472ae6b6b0/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230824.045828-scrub-failure/db9a2d12746faa158579b8d032d53d472ae6b6b0/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230824.045828-scrub-failure/db9a2d12746faa158579b8d032d53d472ae6b6b0/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-09-23T08:42:45.621 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-09-23T08:42:45.621 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-09-23T08:42:45.690 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-09-23T08:42:45.690 DEBUG:teuthology.orchestra.run.smithi135:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/db9a2d12746faa158579b8d032d53d472ae6b6b0/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-09-23T08:42:45.692 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-09-23T08:42:45.692 DEBUG:teuthology.orchestra.run.smithi082:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/db9a2d12746faa158579b8d032d53d472ae6b6b0/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-09-23T08:42:45.724 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230824.045828-scrub-failure/db9a2d12746faa158579b8d032d53d472ae6b6b0/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230824.045828-scrub-failure/db9a2d12746faa158579b8d032d53d472ae6b6b0/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230824.045828-scrub-failure/db9a2d12746faa158579b8d032d53d472ae6b6b0/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-09-23T08:42:45.725 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-09-23T08:42:45.725 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-09-23T08:42:45.796 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-09-23T08:42:45.796 DEBUG:teuthology.orchestra.run.smithi161:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/db9a2d12746faa158579b8d032d53d472ae6b6b0/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-09-23T08:42:45.800 DEBUG:teuthology.orchestra.run.smithi135:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-09-23T08:42:45.803 DEBUG:teuthology.orchestra.run.smithi082:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-09-23T08:42:45.895 DEBUG:teuthology.orchestra.run.smithi135:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-09-23T08:42:45.897 DEBUG:teuthology.orchestra.run.smithi082:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-09-23T08:42:45.907 DEBUG:teuthology.orchestra.run.smithi161:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-09-23T08:42:45.963 INFO:teuthology.orchestra.run.smithi135.stdout:check_obsoletes = 1 2023-09-23T08:42:45.964 INFO:teuthology.orchestra.run.smithi082.stdout:check_obsoletes = 1 2023-09-23T08:42:45.966 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum clean all 2023-09-23T08:42:45.967 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum clean all 2023-09-23T08:42:46.003 DEBUG:teuthology.orchestra.run.smithi161:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-09-23T08:42:46.071 INFO:teuthology.orchestra.run.smithi161.stdout:check_obsoletes = 1 2023-09-23T08:42:46.075 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum clean all 2023-09-23T08:42:46.413 INFO:teuthology.orchestra.run.smithi082.stdout:Updating Subscription Management repositories. 2023-09-23T08:42:46.414 INFO:teuthology.orchestra.run.smithi135.stdout:Updating Subscription Management repositories. 2023-09-23T08:42:46.523 INFO:teuthology.orchestra.run.smithi161.stdout:Updating Subscription Management repositories. 2023-09-23T08:42:47.032 INFO:teuthology.orchestra.run.smithi135.stdout:44 files removed 2023-09-23T08:42:47.066 INFO:teuthology.orchestra.run.smithi082.stdout:44 files removed 2023-09-23T08:42:47.087 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-09-23T08:42:47.121 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-09-23T08:42:47.161 INFO:teuthology.orchestra.run.smithi161.stdout:44 files removed 2023-09-23T08:42:47.218 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-09-23T08:42:47.530 INFO:teuthology.orchestra.run.smithi135.stdout:Updating Subscription Management repositories. 2023-09-23T08:42:47.566 INFO:teuthology.orchestra.run.smithi082.stdout:Updating Subscription Management repositories. 2023-09-23T08:42:47.665 INFO:teuthology.orchestra.run.smithi161.stdout:Updating Subscription Management repositories. 2023-09-23T08:42:49.010 INFO:teuthology.orchestra.run.smithi135.stdout:ceph packages for x86_64 293 kB/s | 81 kB 00:00 2023-09-23T08:42:49.148 INFO:teuthology.orchestra.run.smithi082.stdout:ceph packages for x86_64 185 kB/s | 81 kB 00:00 2023-09-23T08:42:49.175 INFO:teuthology.orchestra.run.smithi161.stdout:ceph packages for x86_64 222 kB/s | 81 kB 00:00 2023-09-23T08:42:49.344 INFO:teuthology.orchestra.run.smithi135.stdout:ceph noarch packages 31 kB/s | 9.4 kB 00:00 2023-09-23T08:42:49.451 INFO:teuthology.orchestra.run.smithi161.stdout:ceph noarch packages 39 kB/s | 9.4 kB 00:00 2023-09-23T08:42:49.507 INFO:teuthology.orchestra.run.smithi082.stdout:ceph noarch packages 29 kB/s | 9.4 kB 00:00 2023-09-23T08:42:49.720 INFO:teuthology.orchestra.run.smithi135.stdout:ceph source packages 4.2 kB/s | 1.5 kB 00:00 2023-09-23T08:42:49.799 INFO:teuthology.orchestra.run.smithi082.stdout:ceph source packages 5.5 kB/s | 1.5 kB 00:00 2023-09-23T08:42:49.827 INFO:teuthology.orchestra.run.smithi161.stdout:ceph source packages 4.2 kB/s | 1.5 kB 00:00 2023-09-23T08:42:49.871 INFO:teuthology.orchestra.run.smithi135.stdout:Copr repo for python3-asyncssh owned by ceph 27 kB/s | 3.5 kB 00:00 2023-09-23T08:42:49.950 INFO:teuthology.orchestra.run.smithi082.stdout:Copr repo for python3-asyncssh owned by ceph 27 kB/s | 3.5 kB 00:00 2023-09-23T08:42:49.977 INFO:teuthology.orchestra.run.smithi161.stdout:Copr repo for python3-asyncssh owned by ceph 27 kB/s | 3.5 kB 00:00 2023-09-23T08:42:51.499 INFO:teuthology.orchestra.run.smithi135.stdout:Extra Packages for Enterprise Linux 9.9 MB/s | 16 MB 00:01 2023-09-23T08:42:51.550 INFO:teuthology.orchestra.run.smithi082.stdout:Extra Packages for Enterprise Linux 10 MB/s | 16 MB 00:01 2023-09-23T08:42:55.600 INFO:teuthology.orchestra.run.smithi082.stdout:lab-extras 469 kB/s | 24 kB 00:00 2023-09-23T08:42:55.622 INFO:teuthology.orchestra.run.smithi135.stdout:lab-extras 398 kB/s | 24 kB 00:00 2023-09-23T08:42:56.573 INFO:teuthology.orchestra.run.smithi161.stdout:Extra Packages for Enterprise Linux 2.4 MB/s | 16 MB 00:06 2023-09-23T08:42:56.644 INFO:teuthology.orchestra.run.smithi082.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 49 MB/s | 47 MB 00:00 2023-09-23T08:42:56.758 INFO:teuthology.orchestra.run.smithi135.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 50 MB/s | 53 MB 00:01 2023-09-23T08:43:00.745 INFO:teuthology.orchestra.run.smithi161.stdout:lab-extras 444 kB/s | 24 kB 00:00 2023-09-23T08:43:01.830 INFO:teuthology.orchestra.run.smithi161.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 47 MB/s | 47 MB 00:01 2023-09-23T08:43:05.403 INFO:teuthology.orchestra.run.smithi082.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 50 MB/s | 53 MB 00:01 2023-09-23T08:43:05.410 INFO:teuthology.orchestra.run.smithi135.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 47 MB/s | 47 MB 00:01 2023-09-23T08:43:10.456 INFO:teuthology.orchestra.run.smithi161.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 48 MB/s | 53 MB 00:01 2023-09-23T08:43:16.942 INFO:teuthology.orchestra.run.smithi082.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-09-23T08:43:16.943 INFO:teuthology.orchestra.run.smithi082.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-09-23T08:43:16.958 INFO:teuthology.orchestra.run.smithi082.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-09-23T08:43:16.959 INFO:teuthology.orchestra.run.smithi082.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-09-23T08:43:16.960 INFO:teuthology.orchestra.run.smithi082.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-09-23T08:43:16.961 INFO:teuthology.orchestra.run.smithi082.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-09-23T08:43:16.963 INFO:teuthology.orchestra.run.smithi082.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-09-23T08:43:16.966 INFO:teuthology.orchestra.run.smithi082.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-09-23T08:43:16.968 INFO:teuthology.orchestra.run.smithi082.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-09-23T08:43:17.069 INFO:teuthology.orchestra.run.smithi135.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-09-23T08:43:17.071 INFO:teuthology.orchestra.run.smithi135.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-09-23T08:43:17.086 INFO:teuthology.orchestra.run.smithi135.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-09-23T08:43:17.087 INFO:teuthology.orchestra.run.smithi135.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-09-23T08:43:17.088 INFO:teuthology.orchestra.run.smithi135.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-09-23T08:43:17.090 INFO:teuthology.orchestra.run.smithi135.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-09-23T08:43:17.092 INFO:teuthology.orchestra.run.smithi135.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-09-23T08:43:17.095 INFO:teuthology.orchestra.run.smithi135.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-09-23T08:43:17.097 INFO:teuthology.orchestra.run.smithi135.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-09-23T08:43:17.102 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2023-09-23T08:43:17.115 INFO:teuthology.orchestra.run.smithi082.stdout:=========================================================================================================================== 2023-09-23T08:43:17.115 INFO:teuthology.orchestra.run.smithi082.stdout: Package Arch Version Repository Size 2023-09-23T08:43:17.115 INFO:teuthology.orchestra.run.smithi082.stdout:=========================================================================================================================== 2023-09-23T08:43:17.115 INFO:teuthology.orchestra.run.smithi082.stdout:Installing: 2023-09-23T08:43:17.115 INFO:teuthology.orchestra.run.smithi082.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-09-23T08:43:17.115 INFO:teuthology.orchestra.run.smithi082.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-09-23T08:43:17.115 INFO:teuthology.orchestra.run.smithi082.stdout: ceph x86_64 2:18.0.0-5661.gdb9a2d12.el8 ceph 6.4 k 2023-09-23T08:43:17.116 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-base x86_64 2:18.0.0-5661.gdb9a2d12.el8 ceph 5.4 M 2023-09-23T08:43:17.116 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-fuse x86_64 2:18.0.0-5661.gdb9a2d12.el8 ceph 860 k 2023-09-23T08:43:17.116 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-5661.gdb9a2d12.el8 ceph 167 k 2023-09-23T08:43:17.116 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr x86_64 2:18.0.0-5661.gdb9a2d12.el8 ceph 1.6 M 2023-09-23T08:43:17.116 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-cephadm noarch 2:18.0.0-5661.gdb9a2d12.el8 ceph-noarch 132 k 2023-09-23T08:43:17.116 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-dashboard noarch 2:18.0.0-5661.gdb9a2d12.el8 ceph-noarch 1.7 M 2023-09-23T08:43:17.116 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-5661.gdb9a2d12.el8 ceph-noarch 7.4 M 2023-09-23T08:43:17.116 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-rook noarch 2:18.0.0-5661.gdb9a2d12.el8 ceph-noarch 47 k 2023-09-23T08:43:17.116 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-radosgw x86_64 2:18.0.0-5661.gdb9a2d12.el8 ceph 14 M 2023-09-23T08:43:17.116 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-test x86_64 2:18.0.0-5661.gdb9a2d12.el8 ceph 48 M 2023-09-23T08:43:17.116 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-volume noarch 2:18.0.0-5661.gdb9a2d12.el8 ceph-noarch 261 k 2023-09-23T08:43:17.116 INFO:teuthology.orchestra.run.smithi082.stdout: cephadm noarch 2:18.0.0-5661.gdb9a2d12.el8 ceph-noarch 171 k 2023-09-23T08:43:17.117 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-mirror x86_64 2:18.0.0-5661.gdb9a2d12.el8 ceph 260 k 2023-09-23T08:43:17.117 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-top noarch 2:18.0.0-5661.gdb9a2d12.el8 ceph-noarch 18 k 2023-09-23T08:43:17.117 INFO:teuthology.orchestra.run.smithi082.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-09-23T08:43:17.117 INFO:teuthology.orchestra.run.smithi082.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-09-23T08:43:17.117 INFO:teuthology.orchestra.run.smithi082.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-09-23T08:43:17.117 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs-devel x86_64 2:18.0.0-5661.gdb9a2d12.el8 ceph 31 k 2023-09-23T08:43:17.117 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs2 x86_64 2:18.0.0-5661.gdb9a2d12.el8 ceph 783 k 2023-09-23T08:43:17.117 INFO:teuthology.orchestra.run.smithi082.stdout: librados-devel x86_64 2:18.0.0-5661.gdb9a2d12.el8 ceph 139 k 2023-09-23T08:43:17.117 INFO:teuthology.orchestra.run.smithi082.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-09-23T08:43:17.117 INFO:teuthology.orchestra.run.smithi082.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-09-23T08:43:17.117 INFO:teuthology.orchestra.run.smithi082.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-09-23T08:43:17.117 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-09-23T08:43:17.118 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-09-23T08:43:17.118 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-09-23T08:43:17.118 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cephfs x86_64 2:18.0.0-5661.gdb9a2d12.el8 ceph 197 k 2023-09-23T08:43:17.118 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rados x86_64 2:18.0.0-5661.gdb9a2d12.el8 ceph 371 k 2023-09-23T08:43:17.118 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rbd x86_64 2:18.0.0-5661.gdb9a2d12.el8 ceph 364 k 2023-09-23T08:43:17.118 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rgw x86_64 2:18.0.0-5661.gdb9a2d12.el8 ceph 106 k 2023-09-23T08:43:17.118 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-fuse x86_64 2:18.0.0-5661.gdb9a2d12.el8 ceph 93 k 2023-09-23T08:43:17.118 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-mirror x86_64 2:18.0.0-5661.gdb9a2d12.el8 ceph 3.5 M 2023-09-23T08:43:17.118 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-nbd x86_64 2:18.0.0-5661.gdb9a2d12.el8 ceph 179 k 2023-09-23T08:43:17.118 INFO:teuthology.orchestra.run.smithi082.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-09-23T08:43:17.118 INFO:teuthology.orchestra.run.smithi082.stdout:Upgrading: 2023-09-23T08:43:17.119 INFO:teuthology.orchestra.run.smithi082.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-09-23T08:43:17.119 INFO:teuthology.orchestra.run.smithi082.stdout: librados2 x86_64 2:18.0.0-5661.gdb9a2d12.el8 ceph 3.7 M 2023-09-23T08:43:17.119 INFO:teuthology.orchestra.run.smithi082.stdout: librbd1 x86_64 2:18.0.0-5661.gdb9a2d12.el8 ceph 3.6 M 2023-09-23T08:43:17.119 INFO:teuthology.orchestra.run.smithi082.stdout:Installing dependencies: 2023-09-23T08:43:17.119 INFO:teuthology.orchestra.run.smithi082.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-09-23T08:43:17.119 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-common x86_64 2:18.0.0-5661.gdb9a2d12.el8 ceph 22 M 2023-09-23T08:43:17.119 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-grafana-dashboards noarch 2:18.0.0-5661.gdb9a2d12.el8 ceph-noarch 23 k 2023-09-23T08:43:17.119 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mds x86_64 2:18.0.0-5661.gdb9a2d12.el8 ceph 2.3 M 2023-09-23T08:43:17.119 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-modules-core noarch 2:18.0.0-5661.gdb9a2d12.el8 ceph-noarch 242 k 2023-09-23T08:43:17.119 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mon x86_64 2:18.0.0-5661.gdb9a2d12.el8 ceph 4.6 M 2023-09-23T08:43:17.119 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-osd x86_64 2:18.0.0-5661.gdb9a2d12.el8 ceph 18 M 2023-09-23T08:43:17.119 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-prometheus-alerts noarch 2:18.0.0-5661.gdb9a2d12.el8 ceph-noarch 15 k 2023-09-23T08:43:17.120 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-selinux x86_64 2:18.0.0-5661.gdb9a2d12.el8 ceph 24 k 2023-09-23T08:43:17.120 INFO:teuthology.orchestra.run.smithi082.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-09-23T08:43:17.120 INFO:teuthology.orchestra.run.smithi082.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-09-23T08:43:17.120 INFO:teuthology.orchestra.run.smithi082.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-09-23T08:43:17.120 INFO:teuthology.orchestra.run.smithi082.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-09-23T08:43:17.120 INFO:teuthology.orchestra.run.smithi082.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-09-23T08:43:17.120 INFO:teuthology.orchestra.run.smithi082.stdout: libcephsqlite x86_64 2:18.0.0-5661.gdb9a2d12.el8 ceph 139 k 2023-09-23T08:43:17.120 INFO:teuthology.orchestra.run.smithi082.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-09-23T08:43:17.120 INFO:teuthology.orchestra.run.smithi082.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-09-23T08:43:17.120 INFO:teuthology.orchestra.run.smithi082.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-09-23T08:43:17.120 INFO:teuthology.orchestra.run.smithi082.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-09-23T08:43:17.120 INFO:teuthology.orchestra.run.smithi082.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-09-23T08:43:17.121 INFO:teuthology.orchestra.run.smithi082.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-09-23T08:43:17.121 INFO:teuthology.orchestra.run.smithi082.stdout: libradosstriper1 x86_64 2:18.0.0-5661.gdb9a2d12.el8 ceph 472 k 2023-09-23T08:43:17.121 INFO:teuthology.orchestra.run.smithi082.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-09-23T08:43:17.121 INFO:teuthology.orchestra.run.smithi082.stdout: librgw2 x86_64 2:18.0.0-5661.gdb9a2d12.el8 ceph 6.8 M 2023-09-23T08:43:17.121 INFO:teuthology.orchestra.run.smithi082.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-09-23T08:43:17.121 INFO:teuthology.orchestra.run.smithi082.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-09-23T08:43:17.121 INFO:teuthology.orchestra.run.smithi082.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-09-23T08:43:17.121 INFO:teuthology.orchestra.run.smithi082.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-09-23T08:43:17.121 INFO:teuthology.orchestra.run.smithi082.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-09-23T08:43:17.121 INFO:teuthology.orchestra.run.smithi082.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-09-23T08:43:17.121 INFO:teuthology.orchestra.run.smithi082.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-09-23T08:43:17.122 INFO:teuthology.orchestra.run.smithi082.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-09-23T08:43:17.122 INFO:teuthology.orchestra.run.smithi082.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-09-23T08:43:17.122 INFO:teuthology.orchestra.run.smithi082.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-09-23T08:43:17.122 INFO:teuthology.orchestra.run.smithi082.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-09-23T08:43:17.122 INFO:teuthology.orchestra.run.smithi082.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-09-23T08:43:17.122 INFO:teuthology.orchestra.run.smithi082.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-09-23T08:43:17.122 INFO:teuthology.orchestra.run.smithi082.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-09-23T08:43:17.122 INFO:teuthology.orchestra.run.smithi082.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-09-23T08:43:17.122 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-09-23T08:43:17.122 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-argparse x86_64 2:18.0.0-5661.gdb9a2d12.el8 ceph 45 k 2023-09-23T08:43:17.122 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-common x86_64 2:18.0.0-5661.gdb9a2d12.el8 ceph 125 k 2023-09-23T08:43:17.122 INFO:teuthology.orchestra.run.smithi082.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-09-23T08:43:17.123 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-09-23T08:43:17.123 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-09-23T08:43:17.123 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-09-23T08:43:17.123 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-09-23T08:43:17.123 INFO:teuthology.orchestra.run.smithi082.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-09-23T08:43:17.123 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-09-23T08:43:17.123 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-09-23T08:43:17.123 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-09-23T08:43:17.123 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-09-23T08:43:17.123 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-09-23T08:43:17.123 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-09-23T08:43:17.123 INFO:teuthology.orchestra.run.smithi082.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-09-23T08:43:17.124 INFO:teuthology.orchestra.run.smithi082.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-09-23T08:43:17.124 INFO:teuthology.orchestra.run.smithi082.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-09-23T08:43:17.124 INFO:teuthology.orchestra.run.smithi082.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-09-23T08:43:17.124 INFO:teuthology.orchestra.run.smithi082.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-09-23T08:43:17.124 INFO:teuthology.orchestra.run.smithi082.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-09-23T08:43:17.124 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-09-23T08:43:17.124 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-09-23T08:43:17.124 INFO:teuthology.orchestra.run.smithi082.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-09-23T08:43:17.124 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-09-23T08:43:17.124 INFO:teuthology.orchestra.run.smithi082.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-09-23T08:43:17.124 INFO:teuthology.orchestra.run.smithi082.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-09-23T08:43:17.125 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-09-23T08:43:17.125 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-09-23T08:43:17.125 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-09-23T08:43:17.125 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-09-23T08:43:17.125 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-09-23T08:43:17.125 INFO:teuthology.orchestra.run.smithi082.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-09-23T08:43:17.125 INFO:teuthology.orchestra.run.smithi082.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-09-23T08:43:17.125 INFO:teuthology.orchestra.run.smithi082.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-09-23T08:43:17.125 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-09-23T08:43:17.125 INFO:teuthology.orchestra.run.smithi082.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-09-23T08:43:17.125 INFO:teuthology.orchestra.run.smithi082.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-09-23T08:43:17.125 INFO:teuthology.orchestra.run.smithi082.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-09-23T08:43:17.126 INFO:teuthology.orchestra.run.smithi082.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-09-23T08:43:17.126 INFO:teuthology.orchestra.run.smithi082.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-09-23T08:43:17.126 INFO:teuthology.orchestra.run.smithi082.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-09-23T08:43:17.126 INFO:teuthology.orchestra.run.smithi082.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-09-23T08:43:17.126 INFO:teuthology.orchestra.run.smithi082.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-09-23T08:43:17.126 INFO:teuthology.orchestra.run.smithi082.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-09-23T08:43:17.126 INFO:teuthology.orchestra.run.smithi082.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-09-23T08:43:17.126 INFO:teuthology.orchestra.run.smithi082.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-09-23T08:43:17.126 INFO:teuthology.orchestra.run.smithi082.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-09-23T08:43:17.126 INFO:teuthology.orchestra.run.smithi082.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-09-23T08:43:17.126 INFO:teuthology.orchestra.run.smithi082.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-09-23T08:43:17.127 INFO:teuthology.orchestra.run.smithi082.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-09-23T08:43:17.127 INFO:teuthology.orchestra.run.smithi082.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-09-23T08:43:17.127 INFO:teuthology.orchestra.run.smithi082.stdout:Enabling module streams: 2023-09-23T08:43:17.127 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql 10 2023-09-23T08:43:17.127 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:43:17.127 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2023-09-23T08:43:17.127 INFO:teuthology.orchestra.run.smithi082.stdout:=========================================================================================================================== 2023-09-23T08:43:17.127 INFO:teuthology.orchestra.run.smithi082.stdout:Install 128 Packages 2023-09-23T08:43:17.127 INFO:teuthology.orchestra.run.smithi082.stdout:Upgrade 3 Packages 2023-09-23T08:43:17.127 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:43:17.130 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 206 M 2023-09-23T08:43:17.130 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2023-09-23T08:43:17.237 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2023-09-23T08:43:17.249 INFO:teuthology.orchestra.run.smithi135.stdout:=========================================================================================================================== 2023-09-23T08:43:17.250 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repository Size 2023-09-23T08:43:17.250 INFO:teuthology.orchestra.run.smithi135.stdout:=========================================================================================================================== 2023-09-23T08:43:17.250 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2023-09-23T08:43:17.250 INFO:teuthology.orchestra.run.smithi135.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-09-23T08:43:17.250 INFO:teuthology.orchestra.run.smithi135.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-09-23T08:43:17.250 INFO:teuthology.orchestra.run.smithi135.stdout: ceph x86_64 2:18.0.0-5661.gdb9a2d12.el8 ceph 6.4 k 2023-09-23T08:43:17.250 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-base x86_64 2:18.0.0-5661.gdb9a2d12.el8 ceph 5.4 M 2023-09-23T08:43:17.250 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-fuse x86_64 2:18.0.0-5661.gdb9a2d12.el8 ceph 860 k 2023-09-23T08:43:17.250 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-5661.gdb9a2d12.el8 ceph 167 k 2023-09-23T08:43:17.251 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr x86_64 2:18.0.0-5661.gdb9a2d12.el8 ceph 1.6 M 2023-09-23T08:43:17.251 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-cephadm noarch 2:18.0.0-5661.gdb9a2d12.el8 ceph-noarch 132 k 2023-09-23T08:43:17.251 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-dashboard noarch 2:18.0.0-5661.gdb9a2d12.el8 ceph-noarch 1.7 M 2023-09-23T08:43:17.251 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-5661.gdb9a2d12.el8 ceph-noarch 7.4 M 2023-09-23T08:43:17.251 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-rook noarch 2:18.0.0-5661.gdb9a2d12.el8 ceph-noarch 47 k 2023-09-23T08:43:17.251 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-radosgw x86_64 2:18.0.0-5661.gdb9a2d12.el8 ceph 14 M 2023-09-23T08:43:17.252 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-test x86_64 2:18.0.0-5661.gdb9a2d12.el8 ceph 48 M 2023-09-23T08:43:17.252 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-volume noarch 2:18.0.0-5661.gdb9a2d12.el8 ceph-noarch 261 k 2023-09-23T08:43:17.252 INFO:teuthology.orchestra.run.smithi135.stdout: cephadm noarch 2:18.0.0-5661.gdb9a2d12.el8 ceph-noarch 171 k 2023-09-23T08:43:17.252 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-mirror x86_64 2:18.0.0-5661.gdb9a2d12.el8 ceph 260 k 2023-09-23T08:43:17.252 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-top noarch 2:18.0.0-5661.gdb9a2d12.el8 ceph-noarch 18 k 2023-09-23T08:43:17.252 INFO:teuthology.orchestra.run.smithi135.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-09-23T08:43:17.252 INFO:teuthology.orchestra.run.smithi135.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-09-23T08:43:17.253 INFO:teuthology.orchestra.run.smithi135.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-09-23T08:43:17.253 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs-devel x86_64 2:18.0.0-5661.gdb9a2d12.el8 ceph 31 k 2023-09-23T08:43:17.253 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs2 x86_64 2:18.0.0-5661.gdb9a2d12.el8 ceph 783 k 2023-09-23T08:43:17.253 INFO:teuthology.orchestra.run.smithi135.stdout: librados-devel x86_64 2:18.0.0-5661.gdb9a2d12.el8 ceph 139 k 2023-09-23T08:43:17.253 INFO:teuthology.orchestra.run.smithi135.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-09-23T08:43:17.253 INFO:teuthology.orchestra.run.smithi135.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-09-23T08:43:17.253 INFO:teuthology.orchestra.run.smithi135.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-09-23T08:43:17.253 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-09-23T08:43:17.254 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-09-23T08:43:17.254 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-09-23T08:43:17.254 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cephfs x86_64 2:18.0.0-5661.gdb9a2d12.el8 ceph 197 k 2023-09-23T08:43:17.254 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rados x86_64 2:18.0.0-5661.gdb9a2d12.el8 ceph 371 k 2023-09-23T08:43:17.254 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rbd x86_64 2:18.0.0-5661.gdb9a2d12.el8 ceph 364 k 2023-09-23T08:43:17.254 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rgw x86_64 2:18.0.0-5661.gdb9a2d12.el8 ceph 106 k 2023-09-23T08:43:17.255 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-fuse x86_64 2:18.0.0-5661.gdb9a2d12.el8 ceph 93 k 2023-09-23T08:43:17.255 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-mirror x86_64 2:18.0.0-5661.gdb9a2d12.el8 ceph 3.5 M 2023-09-23T08:43:17.255 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-nbd x86_64 2:18.0.0-5661.gdb9a2d12.el8 ceph 179 k 2023-09-23T08:43:17.255 INFO:teuthology.orchestra.run.smithi135.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-09-23T08:43:17.255 INFO:teuthology.orchestra.run.smithi135.stdout:Upgrading: 2023-09-23T08:43:17.256 INFO:teuthology.orchestra.run.smithi135.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-09-23T08:43:17.256 INFO:teuthology.orchestra.run.smithi135.stdout: librados2 x86_64 2:18.0.0-5661.gdb9a2d12.el8 ceph 3.7 M 2023-09-23T08:43:17.256 INFO:teuthology.orchestra.run.smithi135.stdout: librbd1 x86_64 2:18.0.0-5661.gdb9a2d12.el8 ceph 3.6 M 2023-09-23T08:43:17.256 INFO:teuthology.orchestra.run.smithi135.stdout:Installing dependencies: 2023-09-23T08:43:17.256 INFO:teuthology.orchestra.run.smithi135.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-09-23T08:43:17.256 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-common x86_64 2:18.0.0-5661.gdb9a2d12.el8 ceph 22 M 2023-09-23T08:43:17.256 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-grafana-dashboards noarch 2:18.0.0-5661.gdb9a2d12.el8 ceph-noarch 23 k 2023-09-23T08:43:17.256 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mds x86_64 2:18.0.0-5661.gdb9a2d12.el8 ceph 2.3 M 2023-09-23T08:43:17.257 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-modules-core noarch 2:18.0.0-5661.gdb9a2d12.el8 ceph-noarch 242 k 2023-09-23T08:43:17.257 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mon x86_64 2:18.0.0-5661.gdb9a2d12.el8 ceph 4.6 M 2023-09-23T08:43:17.257 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-osd x86_64 2:18.0.0-5661.gdb9a2d12.el8 ceph 18 M 2023-09-23T08:43:17.257 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-prometheus-alerts noarch 2:18.0.0-5661.gdb9a2d12.el8 ceph-noarch 15 k 2023-09-23T08:43:17.257 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-selinux x86_64 2:18.0.0-5661.gdb9a2d12.el8 ceph 24 k 2023-09-23T08:43:17.257 INFO:teuthology.orchestra.run.smithi135.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-09-23T08:43:17.257 INFO:teuthology.orchestra.run.smithi135.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-09-23T08:43:17.258 INFO:teuthology.orchestra.run.smithi135.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-09-23T08:43:17.258 INFO:teuthology.orchestra.run.smithi135.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-09-23T08:43:17.258 INFO:teuthology.orchestra.run.smithi135.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-09-23T08:43:17.258 INFO:teuthology.orchestra.run.smithi135.stdout: libcephsqlite x86_64 2:18.0.0-5661.gdb9a2d12.el8 ceph 139 k 2023-09-23T08:43:17.258 INFO:teuthology.orchestra.run.smithi135.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-09-23T08:43:17.258 INFO:teuthology.orchestra.run.smithi135.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-09-23T08:43:17.258 INFO:teuthology.orchestra.run.smithi135.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-09-23T08:43:17.259 INFO:teuthology.orchestra.run.smithi135.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-09-23T08:43:17.259 INFO:teuthology.orchestra.run.smithi135.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-09-23T08:43:17.259 INFO:teuthology.orchestra.run.smithi135.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-09-23T08:43:17.259 INFO:teuthology.orchestra.run.smithi135.stdout: libradosstriper1 x86_64 2:18.0.0-5661.gdb9a2d12.el8 ceph 472 k 2023-09-23T08:43:17.259 INFO:teuthology.orchestra.run.smithi135.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-09-23T08:43:17.259 INFO:teuthology.orchestra.run.smithi135.stdout: librgw2 x86_64 2:18.0.0-5661.gdb9a2d12.el8 ceph 6.8 M 2023-09-23T08:43:17.259 INFO:teuthology.orchestra.run.smithi135.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-09-23T08:43:17.259 INFO:teuthology.orchestra.run.smithi135.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-09-23T08:43:17.260 INFO:teuthology.orchestra.run.smithi135.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-09-23T08:43:17.260 INFO:teuthology.orchestra.run.smithi135.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-09-23T08:43:17.260 INFO:teuthology.orchestra.run.smithi135.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-09-23T08:43:17.260 INFO:teuthology.orchestra.run.smithi135.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-09-23T08:43:17.260 INFO:teuthology.orchestra.run.smithi135.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-09-23T08:43:17.260 INFO:teuthology.orchestra.run.smithi135.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-09-23T08:43:17.260 INFO:teuthology.orchestra.run.smithi135.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-09-23T08:43:17.260 INFO:teuthology.orchestra.run.smithi135.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-09-23T08:43:17.261 INFO:teuthology.orchestra.run.smithi135.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-09-23T08:43:17.261 INFO:teuthology.orchestra.run.smithi135.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-09-23T08:43:17.261 INFO:teuthology.orchestra.run.smithi135.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-09-23T08:43:17.261 INFO:teuthology.orchestra.run.smithi135.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-09-23T08:43:17.261 INFO:teuthology.orchestra.run.smithi135.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-09-23T08:43:17.261 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-09-23T08:43:17.261 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-argparse x86_64 2:18.0.0-5661.gdb9a2d12.el8 ceph 45 k 2023-09-23T08:43:17.262 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-common x86_64 2:18.0.0-5661.gdb9a2d12.el8 ceph 125 k 2023-09-23T08:43:17.262 INFO:teuthology.orchestra.run.smithi135.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-09-23T08:43:17.262 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-09-23T08:43:17.262 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-09-23T08:43:17.262 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-09-23T08:43:17.262 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-09-23T08:43:17.262 INFO:teuthology.orchestra.run.smithi135.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-09-23T08:43:17.262 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-09-23T08:43:17.263 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-09-23T08:43:17.263 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-09-23T08:43:17.263 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-09-23T08:43:17.263 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-09-23T08:43:17.263 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-09-23T08:43:17.263 INFO:teuthology.orchestra.run.smithi135.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-09-23T08:43:17.263 INFO:teuthology.orchestra.run.smithi135.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-09-23T08:43:17.263 INFO:teuthology.orchestra.run.smithi135.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-09-23T08:43:17.264 INFO:teuthology.orchestra.run.smithi135.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-09-23T08:43:17.264 INFO:teuthology.orchestra.run.smithi135.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-09-23T08:43:17.264 INFO:teuthology.orchestra.run.smithi135.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-09-23T08:43:17.264 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-09-23T08:43:17.264 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-09-23T08:43:17.264 INFO:teuthology.orchestra.run.smithi135.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-09-23T08:43:17.264 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-09-23T08:43:17.265 INFO:teuthology.orchestra.run.smithi135.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-09-23T08:43:17.265 INFO:teuthology.orchestra.run.smithi135.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-09-23T08:43:17.265 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-09-23T08:43:17.265 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-09-23T08:43:17.265 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-09-23T08:43:17.265 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-09-23T08:43:17.265 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-09-23T08:43:17.265 INFO:teuthology.orchestra.run.smithi135.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-09-23T08:43:17.266 INFO:teuthology.orchestra.run.smithi135.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-09-23T08:43:17.266 INFO:teuthology.orchestra.run.smithi135.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-09-23T08:43:17.266 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-09-23T08:43:17.266 INFO:teuthology.orchestra.run.smithi135.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-09-23T08:43:17.266 INFO:teuthology.orchestra.run.smithi135.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-09-23T08:43:17.266 INFO:teuthology.orchestra.run.smithi135.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-09-23T08:43:17.266 INFO:teuthology.orchestra.run.smithi135.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-09-23T08:43:17.267 INFO:teuthology.orchestra.run.smithi135.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-09-23T08:43:17.267 INFO:teuthology.orchestra.run.smithi135.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-09-23T08:43:17.267 INFO:teuthology.orchestra.run.smithi135.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-09-23T08:43:17.267 INFO:teuthology.orchestra.run.smithi135.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-09-23T08:43:17.267 INFO:teuthology.orchestra.run.smithi135.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-09-23T08:43:17.268 INFO:teuthology.orchestra.run.smithi135.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-09-23T08:43:17.268 INFO:teuthology.orchestra.run.smithi135.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-09-23T08:43:17.268 INFO:teuthology.orchestra.run.smithi135.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-09-23T08:43:17.268 INFO:teuthology.orchestra.run.smithi135.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-09-23T08:43:17.268 INFO:teuthology.orchestra.run.smithi135.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-09-23T08:43:17.268 INFO:teuthology.orchestra.run.smithi135.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-09-23T08:43:17.268 INFO:teuthology.orchestra.run.smithi135.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-09-23T08:43:17.268 INFO:teuthology.orchestra.run.smithi135.stdout:Enabling module streams: 2023-09-23T08:43:17.269 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql 10 2023-09-23T08:43:17.269 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-09-23T08:43:17.269 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2023-09-23T08:43:17.269 INFO:teuthology.orchestra.run.smithi135.stdout:=========================================================================================================================== 2023-09-23T08:43:17.269 INFO:teuthology.orchestra.run.smithi135.stdout:Install 128 Packages 2023-09-23T08:43:17.269 INFO:teuthology.orchestra.run.smithi135.stdout:Upgrade 3 Packages 2023-09-23T08:43:17.269 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-09-23T08:43:17.270 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 206 M 2023-09-23T08:43:17.270 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2023-09-23T08:43:17.461 INFO:teuthology.orchestra.run.smithi082.stdout:(1/131): ceph-18.0.0-5661.gdb9a2d12.el8.x86_64. 35 kB/s | 6.4 kB 00:00 2023-09-23T08:43:17.554 INFO:teuthology.orchestra.run.smithi135.stdout:(1/131): ceph-18.0.0-5661.gdb9a2d12.el8.x86_64. 29 kB/s | 6.4 kB 00:00 2023-09-23T08:43:18.311 INFO:teuthology.orchestra.run.smithi082.stdout:(2/131): ceph-base-18.0.0-5661.gdb9a2d12.el8.x8 5.2 MB/s | 5.4 MB 00:01 2023-09-23T08:43:18.352 INFO:teuthology.orchestra.run.smithi082.stdout:(3/131): ceph-fuse-18.0.0-5661.gdb9a2d12.el8.x8 965 kB/s | 860 kB 00:00 2023-09-23T08:43:18.403 INFO:teuthology.orchestra.run.smithi082.stdout:(4/131): ceph-immutable-object-cache-18.0.0-566 1.8 MB/s | 167 kB 00:00 2023-09-23T08:43:18.462 INFO:teuthology.orchestra.run.smithi135.stdout:(2/131): ceph-fuse-18.0.0-5661.gdb9a2d12.el8.x8 948 kB/s | 860 kB 00:00 2023-09-23T08:43:18.613 INFO:teuthology.orchestra.run.smithi135.stdout:(3/131): ceph-immutable-object-cache-18.0.0-566 1.1 MB/s | 167 kB 00:00 2023-09-23T08:43:18.778 INFO:teuthology.orchestra.run.smithi082.stdout:(5/131): ceph-common-18.0.0-5661.gdb9a2d12.el8. 15 MB/s | 22 MB 00:01 2023-09-23T08:43:18.828 INFO:teuthology.orchestra.run.smithi082.stdout:(6/131): ceph-mgr-18.0.0-5661.gdb9a2d12.el8.x86 3.7 MB/s | 1.6 MB 00:00 2023-09-23T08:43:19.212 INFO:teuthology.orchestra.run.smithi082.stdout:(7/131): ceph-mon-18.0.0-5661.gdb9a2d12.el8.x86 11 MB/s | 4.6 MB 00:00 2023-09-23T08:43:19.388 INFO:teuthology.orchestra.run.smithi135.stdout:(4/131): ceph-mds-18.0.0-5661.gdb9a2d12.el8.x86 3.0 MB/s | 2.3 MB 00:00 2023-09-23T08:43:19.904 INFO:teuthology.orchestra.run.smithi082.stdout:(8/131): ceph-mds-18.0.0-5661.gdb9a2d12.el8.x86 1.5 MB/s | 2.3 MB 00:01 2023-09-23T08:43:19.947 INFO:teuthology.orchestra.run.smithi135.stdout:(5/131): ceph-mgr-18.0.0-5661.gdb9a2d12.el8.x86 2.8 MB/s | 1.6 MB 00:00 2023-09-23T08:43:20.012 INFO:teuthology.orchestra.run.smithi082.stdout:(9/131): ceph-selinux-18.0.0-5661.gdb9a2d12.el8 225 kB/s | 24 kB 00:00 2023-09-23T08:43:20.421 INFO:teuthology.orchestra.run.smithi082.stdout:(10/131): ceph-radosgw-18.0.0-5661.gdb9a2d12.el 11 MB/s | 14 MB 00:01 2023-09-23T08:43:20.479 INFO:teuthology.orchestra.run.smithi082.stdout:(11/131): cephfs-mirror-18.0.0-5661.gdb9a2d12.e 4.4 MB/s | 260 kB 00:00 2023-09-23T08:43:20.538 INFO:teuthology.orchestra.run.smithi082.stdout:(12/131): libcephfs-devel-18.0.0-5661.gdb9a2d12 533 kB/s | 31 kB 00:00 2023-09-23T08:43:20.672 INFO:teuthology.orchestra.run.smithi082.stdout:(13/131): libcephfs2-18.0.0-5661.gdb9a2d12.el8. 5.7 MB/s | 783 kB 00:00 2023-09-23T08:43:20.738 INFO:teuthology.orchestra.run.smithi082.stdout:(14/131): libcephsqlite-18.0.0-5661.gdb9a2d12.e 2.0 MB/s | 139 kB 00:00 2023-09-23T08:43:20.805 INFO:teuthology.orchestra.run.smithi082.stdout:(15/131): librados-devel-18.0.0-5661.gdb9a2d12. 2.0 MB/s | 139 kB 00:00 2023-09-23T08:43:20.998 INFO:teuthology.orchestra.run.smithi082.stdout:(16/131): ceph-osd-18.0.0-5661.gdb9a2d12.el8.x8 8.2 MB/s | 18 MB 00:02 2023-09-23T08:43:21.030 INFO:teuthology.orchestra.run.smithi135.stdout:(6/131): ceph-mon-18.0.0-5661.gdb9a2d12.el8.x86 4.3 MB/s | 4.6 MB 00:01 2023-09-23T08:43:21.031 INFO:teuthology.orchestra.run.smithi082.stdout:(17/131): libradosstriper1-18.0.0-5661.gdb9a2d1 2.0 MB/s | 472 kB 00:00 2023-09-23T08:43:21.115 INFO:teuthology.orchestra.run.smithi082.stdout:(18/131): python3-ceph-argparse-18.0.0-5661.gdb 537 kB/s | 45 kB 00:00 2023-09-23T08:43:21.190 INFO:teuthology.orchestra.run.smithi082.stdout:(19/131): python3-ceph-common-18.0.0-5661.gdb9a 1.6 MB/s | 125 kB 00:00 2023-09-23T08:43:21.282 INFO:teuthology.orchestra.run.smithi082.stdout:(20/131): python3-cephfs-18.0.0-5661.gdb9a2d12. 2.1 MB/s | 197 kB 00:00 2023-09-23T08:43:21.374 INFO:teuthology.orchestra.run.smithi082.stdout:(21/131): python3-rados-18.0.0-5661.gdb9a2d12.e 3.9 MB/s | 371 kB 00:00 2023-09-23T08:43:21.474 INFO:teuthology.orchestra.run.smithi082.stdout:(22/131): python3-rbd-18.0.0-5661.gdb9a2d12.el8 3.6 MB/s | 364 kB 00:00 2023-09-23T08:43:21.558 INFO:teuthology.orchestra.run.smithi082.stdout:(23/131): python3-rgw-18.0.0-5661.gdb9a2d12.el8 1.3 MB/s | 106 kB 00:00 2023-09-23T08:43:21.642 INFO:teuthology.orchestra.run.smithi082.stdout:(24/131): rbd-fuse-18.0.0-5661.gdb9a2d12.el8.x8 1.1 MB/s | 93 kB 00:00 2023-09-23T08:43:22.025 INFO:teuthology.orchestra.run.smithi082.stdout:(25/131): librgw2-18.0.0-5661.gdb9a2d12.el8.x86 6.6 MB/s | 6.8 MB 00:01 2023-09-23T08:43:22.059 INFO:teuthology.orchestra.run.smithi161.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-09-23T08:43:22.060 INFO:teuthology.orchestra.run.smithi161.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-09-23T08:43:22.075 INFO:teuthology.orchestra.run.smithi161.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-09-23T08:43:22.076 INFO:teuthology.orchestra.run.smithi161.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-09-23T08:43:22.077 INFO:teuthology.orchestra.run.smithi161.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-09-23T08:43:22.079 INFO:teuthology.orchestra.run.smithi161.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-09-23T08:43:22.081 INFO:teuthology.orchestra.run.smithi161.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-09-23T08:43:22.084 INFO:teuthology.orchestra.run.smithi161.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-09-23T08:43:22.085 INFO:teuthology.orchestra.run.smithi161.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-09-23T08:43:22.117 INFO:teuthology.orchestra.run.smithi082.stdout:(26/131): rbd-mirror-18.0.0-5661.gdb9a2d12.el8. 7.4 MB/s | 3.5 MB 00:00 2023-09-23T08:43:22.142 INFO:teuthology.orchestra.run.smithi082.stdout:(27/131): rbd-nbd-18.0.0-5661.gdb9a2d12.el8.x86 1.5 MB/s | 179 kB 00:00 2023-09-23T08:43:22.176 INFO:teuthology.orchestra.run.smithi082.stdout:(28/131): ceph-grafana-dashboards-18.0.0-5661.g 396 kB/s | 23 kB 00:00 2023-09-23T08:43:22.189 INFO:teuthology.orchestra.run.smithi135.stdout:(7/131): ceph-common-18.0.0-5661.gdb9a2d12.el8. 4.6 MB/s | 22 MB 00:04 2023-09-23T08:43:22.201 INFO:teuthology.orchestra.run.smithi082.stdout:(29/131): ceph-mgr-cephadm-18.0.0-5661.gdb9a2d1 2.2 MB/s | 132 kB 00:00 2023-09-23T08:43:22.229 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2023-09-23T08:43:22.241 INFO:teuthology.orchestra.run.smithi161.stdout:=========================================================================================================================== 2023-09-23T08:43:22.241 INFO:teuthology.orchestra.run.smithi161.stdout: Package Arch Version Repository Size 2023-09-23T08:43:22.241 INFO:teuthology.orchestra.run.smithi161.stdout:=========================================================================================================================== 2023-09-23T08:43:22.241 INFO:teuthology.orchestra.run.smithi161.stdout:Installing: 2023-09-23T08:43:22.242 INFO:teuthology.orchestra.run.smithi161.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-09-23T08:43:22.242 INFO:teuthology.orchestra.run.smithi161.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-09-23T08:43:22.242 INFO:teuthology.orchestra.run.smithi161.stdout: ceph x86_64 2:18.0.0-5661.gdb9a2d12.el8 ceph 6.4 k 2023-09-23T08:43:22.242 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-base x86_64 2:18.0.0-5661.gdb9a2d12.el8 ceph 5.4 M 2023-09-23T08:43:22.242 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-fuse x86_64 2:18.0.0-5661.gdb9a2d12.el8 ceph 860 k 2023-09-23T08:43:22.242 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-5661.gdb9a2d12.el8 ceph 167 k 2023-09-23T08:43:22.242 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr x86_64 2:18.0.0-5661.gdb9a2d12.el8 ceph 1.6 M 2023-09-23T08:43:22.242 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-cephadm noarch 2:18.0.0-5661.gdb9a2d12.el8 ceph-noarch 132 k 2023-09-23T08:43:22.242 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-dashboard noarch 2:18.0.0-5661.gdb9a2d12.el8 ceph-noarch 1.7 M 2023-09-23T08:43:22.242 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-5661.gdb9a2d12.el8 ceph-noarch 7.4 M 2023-09-23T08:43:22.242 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-rook noarch 2:18.0.0-5661.gdb9a2d12.el8 ceph-noarch 47 k 2023-09-23T08:43:22.243 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-radosgw x86_64 2:18.0.0-5661.gdb9a2d12.el8 ceph 14 M 2023-09-23T08:43:22.243 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-test x86_64 2:18.0.0-5661.gdb9a2d12.el8 ceph 48 M 2023-09-23T08:43:22.243 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-volume noarch 2:18.0.0-5661.gdb9a2d12.el8 ceph-noarch 261 k 2023-09-23T08:43:22.243 INFO:teuthology.orchestra.run.smithi161.stdout: cephadm noarch 2:18.0.0-5661.gdb9a2d12.el8 ceph-noarch 171 k 2023-09-23T08:43:22.243 INFO:teuthology.orchestra.run.smithi161.stdout: cephfs-mirror x86_64 2:18.0.0-5661.gdb9a2d12.el8 ceph 260 k 2023-09-23T08:43:22.243 INFO:teuthology.orchestra.run.smithi161.stdout: cephfs-top noarch 2:18.0.0-5661.gdb9a2d12.el8 ceph-noarch 18 k 2023-09-23T08:43:22.243 INFO:teuthology.orchestra.run.smithi161.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-09-23T08:43:22.243 INFO:teuthology.orchestra.run.smithi161.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-09-23T08:43:22.243 INFO:teuthology.orchestra.run.smithi161.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-09-23T08:43:22.243 INFO:teuthology.orchestra.run.smithi161.stdout: libcephfs-devel x86_64 2:18.0.0-5661.gdb9a2d12.el8 ceph 31 k 2023-09-23T08:43:22.243 INFO:teuthology.orchestra.run.smithi161.stdout: libcephfs2 x86_64 2:18.0.0-5661.gdb9a2d12.el8 ceph 783 k 2023-09-23T08:43:22.244 INFO:teuthology.orchestra.run.smithi161.stdout: librados-devel x86_64 2:18.0.0-5661.gdb9a2d12.el8 ceph 139 k 2023-09-23T08:43:22.244 INFO:teuthology.orchestra.run.smithi161.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-09-23T08:43:22.244 INFO:teuthology.orchestra.run.smithi161.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-09-23T08:43:22.244 INFO:teuthology.orchestra.run.smithi161.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-09-23T08:43:22.244 INFO:teuthology.orchestra.run.smithi161.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-09-23T08:43:22.244 INFO:teuthology.orchestra.run.smithi161.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-09-23T08:43:22.244 INFO:teuthology.orchestra.run.smithi161.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-09-23T08:43:22.244 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cephfs x86_64 2:18.0.0-5661.gdb9a2d12.el8 ceph 197 k 2023-09-23T08:43:22.244 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rados x86_64 2:18.0.0-5661.gdb9a2d12.el8 ceph 371 k 2023-09-23T08:43:22.244 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rbd x86_64 2:18.0.0-5661.gdb9a2d12.el8 ceph 364 k 2023-09-23T08:43:22.244 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rgw x86_64 2:18.0.0-5661.gdb9a2d12.el8 ceph 106 k 2023-09-23T08:43:22.244 INFO:teuthology.orchestra.run.smithi161.stdout: rbd-fuse x86_64 2:18.0.0-5661.gdb9a2d12.el8 ceph 93 k 2023-09-23T08:43:22.245 INFO:teuthology.orchestra.run.smithi161.stdout: rbd-mirror x86_64 2:18.0.0-5661.gdb9a2d12.el8 ceph 3.5 M 2023-09-23T08:43:22.245 INFO:teuthology.orchestra.run.smithi161.stdout: rbd-nbd x86_64 2:18.0.0-5661.gdb9a2d12.el8 ceph 179 k 2023-09-23T08:43:22.245 INFO:teuthology.orchestra.run.smithi161.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-09-23T08:43:22.245 INFO:teuthology.orchestra.run.smithi161.stdout:Upgrading: 2023-09-23T08:43:22.245 INFO:teuthology.orchestra.run.smithi161.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-09-23T08:43:22.245 INFO:teuthology.orchestra.run.smithi161.stdout: librados2 x86_64 2:18.0.0-5661.gdb9a2d12.el8 ceph 3.7 M 2023-09-23T08:43:22.245 INFO:teuthology.orchestra.run.smithi161.stdout: librbd1 x86_64 2:18.0.0-5661.gdb9a2d12.el8 ceph 3.6 M 2023-09-23T08:43:22.245 INFO:teuthology.orchestra.run.smithi161.stdout:Installing dependencies: 2023-09-23T08:43:22.245 INFO:teuthology.orchestra.run.smithi161.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-09-23T08:43:22.245 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-common x86_64 2:18.0.0-5661.gdb9a2d12.el8 ceph 22 M 2023-09-23T08:43:22.245 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-grafana-dashboards noarch 2:18.0.0-5661.gdb9a2d12.el8 ceph-noarch 23 k 2023-09-23T08:43:22.245 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mds x86_64 2:18.0.0-5661.gdb9a2d12.el8 ceph 2.3 M 2023-09-23T08:43:22.246 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-modules-core noarch 2:18.0.0-5661.gdb9a2d12.el8 ceph-noarch 242 k 2023-09-23T08:43:22.246 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mon x86_64 2:18.0.0-5661.gdb9a2d12.el8 ceph 4.6 M 2023-09-23T08:43:22.246 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-osd x86_64 2:18.0.0-5661.gdb9a2d12.el8 ceph 18 M 2023-09-23T08:43:22.246 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-prometheus-alerts noarch 2:18.0.0-5661.gdb9a2d12.el8 ceph-noarch 15 k 2023-09-23T08:43:22.246 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-selinux x86_64 2:18.0.0-5661.gdb9a2d12.el8 ceph 24 k 2023-09-23T08:43:22.246 INFO:teuthology.orchestra.run.smithi161.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-09-23T08:43:22.246 INFO:teuthology.orchestra.run.smithi161.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-09-23T08:43:22.246 INFO:teuthology.orchestra.run.smithi161.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-09-23T08:43:22.246 INFO:teuthology.orchestra.run.smithi161.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-09-23T08:43:22.246 INFO:teuthology.orchestra.run.smithi161.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-09-23T08:43:22.246 INFO:teuthology.orchestra.run.smithi161.stdout: libcephsqlite x86_64 2:18.0.0-5661.gdb9a2d12.el8 ceph 139 k 2023-09-23T08:43:22.247 INFO:teuthology.orchestra.run.smithi161.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-09-23T08:43:22.247 INFO:teuthology.orchestra.run.smithi161.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-09-23T08:43:22.247 INFO:teuthology.orchestra.run.smithi161.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-09-23T08:43:22.247 INFO:teuthology.orchestra.run.smithi161.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-09-23T08:43:22.247 INFO:teuthology.orchestra.run.smithi161.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-09-23T08:43:22.247 INFO:teuthology.orchestra.run.smithi161.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-09-23T08:43:22.247 INFO:teuthology.orchestra.run.smithi161.stdout: libradosstriper1 x86_64 2:18.0.0-5661.gdb9a2d12.el8 ceph 472 k 2023-09-23T08:43:22.247 INFO:teuthology.orchestra.run.smithi161.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-09-23T08:43:22.247 INFO:teuthology.orchestra.run.smithi161.stdout: librgw2 x86_64 2:18.0.0-5661.gdb9a2d12.el8 ceph 6.8 M 2023-09-23T08:43:22.247 INFO:teuthology.orchestra.run.smithi161.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-09-23T08:43:22.247 INFO:teuthology.orchestra.run.smithi161.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-09-23T08:43:22.247 INFO:teuthology.orchestra.run.smithi161.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-09-23T08:43:22.248 INFO:teuthology.orchestra.run.smithi161.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-09-23T08:43:22.248 INFO:teuthology.orchestra.run.smithi161.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-09-23T08:43:22.248 INFO:teuthology.orchestra.run.smithi161.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-09-23T08:43:22.248 INFO:teuthology.orchestra.run.smithi161.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-09-23T08:43:22.248 INFO:teuthology.orchestra.run.smithi161.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-09-23T08:43:22.248 INFO:teuthology.orchestra.run.smithi161.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-09-23T08:43:22.248 INFO:teuthology.orchestra.run.smithi161.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-09-23T08:43:22.248 INFO:teuthology.orchestra.run.smithi161.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-09-23T08:43:22.248 INFO:teuthology.orchestra.run.smithi161.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-09-23T08:43:22.248 INFO:teuthology.orchestra.run.smithi161.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-09-23T08:43:22.248 INFO:teuthology.orchestra.run.smithi161.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-09-23T08:43:22.248 INFO:teuthology.orchestra.run.smithi161.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-09-23T08:43:22.249 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-09-23T08:43:22.249 INFO:teuthology.orchestra.run.smithi161.stdout: python3-ceph-argparse x86_64 2:18.0.0-5661.gdb9a2d12.el8 ceph 45 k 2023-09-23T08:43:22.249 INFO:teuthology.orchestra.run.smithi161.stdout: python3-ceph-common x86_64 2:18.0.0-5661.gdb9a2d12.el8 ceph 125 k 2023-09-23T08:43:22.249 INFO:teuthology.orchestra.run.smithi161.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-09-23T08:43:22.249 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-09-23T08:43:22.249 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-09-23T08:43:22.249 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-09-23T08:43:22.249 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-09-23T08:43:22.249 INFO:teuthology.orchestra.run.smithi161.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-09-23T08:43:22.249 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-09-23T08:43:22.249 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-09-23T08:43:22.250 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-09-23T08:43:22.250 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-09-23T08:43:22.250 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-09-23T08:43:22.250 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-09-23T08:43:22.250 INFO:teuthology.orchestra.run.smithi161.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-09-23T08:43:22.250 INFO:teuthology.orchestra.run.smithi161.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-09-23T08:43:22.250 INFO:teuthology.orchestra.run.smithi161.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-09-23T08:43:22.250 INFO:teuthology.orchestra.run.smithi161.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-09-23T08:43:22.250 INFO:teuthology.orchestra.run.smithi161.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-09-23T08:43:22.250 INFO:teuthology.orchestra.run.smithi161.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-09-23T08:43:22.250 INFO:teuthology.orchestra.run.smithi161.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-09-23T08:43:22.251 INFO:teuthology.orchestra.run.smithi161.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-09-23T08:43:22.251 INFO:teuthology.orchestra.run.smithi161.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-09-23T08:43:22.251 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-09-23T08:43:22.251 INFO:teuthology.orchestra.run.smithi161.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-09-23T08:43:22.251 INFO:teuthology.orchestra.run.smithi161.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-09-23T08:43:22.251 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-09-23T08:43:22.251 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-09-23T08:43:22.251 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-09-23T08:43:22.251 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-09-23T08:43:22.251 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-09-23T08:43:22.251 INFO:teuthology.orchestra.run.smithi161.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-09-23T08:43:22.251 INFO:teuthology.orchestra.run.smithi161.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-09-23T08:43:22.252 INFO:teuthology.orchestra.run.smithi161.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-09-23T08:43:22.252 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-09-23T08:43:22.252 INFO:teuthology.orchestra.run.smithi161.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-09-23T08:43:22.252 INFO:teuthology.orchestra.run.smithi161.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-09-23T08:43:22.252 INFO:teuthology.orchestra.run.smithi161.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-09-23T08:43:22.252 INFO:teuthology.orchestra.run.smithi161.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-09-23T08:43:22.252 INFO:teuthology.orchestra.run.smithi161.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-09-23T08:43:22.252 INFO:teuthology.orchestra.run.smithi161.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-09-23T08:43:22.252 INFO:teuthology.orchestra.run.smithi161.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-09-23T08:43:22.252 INFO:teuthology.orchestra.run.smithi161.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-09-23T08:43:22.252 INFO:teuthology.orchestra.run.smithi161.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-09-23T08:43:22.252 INFO:teuthology.orchestra.run.smithi161.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-09-23T08:43:22.253 INFO:teuthology.orchestra.run.smithi161.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-09-23T08:43:22.253 INFO:teuthology.orchestra.run.smithi161.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-09-23T08:43:22.253 INFO:teuthology.orchestra.run.smithi161.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-09-23T08:43:22.253 INFO:teuthology.orchestra.run.smithi161.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-09-23T08:43:22.253 INFO:teuthology.orchestra.run.smithi161.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-09-23T08:43:22.253 INFO:teuthology.orchestra.run.smithi161.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-09-23T08:43:22.253 INFO:teuthology.orchestra.run.smithi161.stdout:Enabling module streams: 2023-09-23T08:43:22.253 INFO:teuthology.orchestra.run.smithi161.stdout: postgresql 10 2023-09-23T08:43:22.253 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-09-23T08:43:22.253 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction Summary 2023-09-23T08:43:22.253 INFO:teuthology.orchestra.run.smithi161.stdout:=========================================================================================================================== 2023-09-23T08:43:22.253 INFO:teuthology.orchestra.run.smithi161.stdout:Install 128 Packages 2023-09-23T08:43:22.254 INFO:teuthology.orchestra.run.smithi161.stdout:Upgrade 3 Packages 2023-09-23T08:43:22.254 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-09-23T08:43:22.254 INFO:teuthology.orchestra.run.smithi161.stdout:Total download size: 206 M 2023-09-23T08:43:22.254 INFO:teuthology.orchestra.run.smithi161.stdout:Downloading Packages: 2023-09-23T08:43:22.306 INFO:teuthology.orchestra.run.smithi135.stdout:(8/131): ceph-base-18.0.0-5661.gdb9a2d12.el8.x8 1.1 MB/s | 5.4 MB 00:04 2023-09-23T08:43:22.368 INFO:teuthology.orchestra.run.smithi082.stdout:(30/131): ceph-mgr-dashboard-18.0.0-5661.gdb9a2 9.1 MB/s | 1.7 MB 00:00 2023-09-23T08:43:22.398 INFO:teuthology.orchestra.run.smithi135.stdout:(9/131): ceph-selinux-18.0.0-5661.gdb9a2d12.el8 266 kB/s | 24 kB 00:00 2023-09-23T08:43:22.444 INFO:teuthology.orchestra.run.smithi082.stdout:(31/131): ceph-mgr-modules-core-18.0.0-5661.gdb 3.2 MB/s | 242 kB 00:00 2023-09-23T08:43:22.519 INFO:teuthology.orchestra.run.smithi082.stdout:(32/131): ceph-mgr-rook-18.0.0-5661.gdb9a2d12.e 632 kB/s | 47 kB 00:00 2023-09-23T08:43:22.573 INFO:teuthology.orchestra.run.smithi161.stdout:(1/131): ceph-18.0.0-5661.gdb9a2d12.el8.x86_64. 26 kB/s | 6.4 kB 00:00 2023-09-23T08:43:22.586 INFO:teuthology.orchestra.run.smithi082.stdout:(33/131): ceph-prometheus-alerts-18.0.0-5661.gd 219 kB/s | 15 kB 00:00 2023-09-23T08:43:22.678 INFO:teuthology.orchestra.run.smithi082.stdout:(34/131): ceph-volume-18.0.0-5661.gdb9a2d12.el8 2.8 MB/s | 261 kB 00:00 2023-09-23T08:43:22.761 INFO:teuthology.orchestra.run.smithi082.stdout:(35/131): cephadm-18.0.0-5661.gdb9a2d12.el8.noa 2.0 MB/s | 171 kB 00:00 2023-09-23T08:43:22.837 INFO:teuthology.orchestra.run.smithi082.stdout:(36/131): cephfs-top-18.0.0-5661.gdb9a2d12.el8. 240 kB/s | 18 kB 00:00 2023-09-23T08:43:22.978 INFO:teuthology.orchestra.run.smithi082.stdout:(37/131): gperftools-libs-2.7-9.el8.x86_64.rpm 2.1 MB/s | 306 kB 00:00 2023-09-23T08:43:23.020 INFO:teuthology.orchestra.run.smithi082.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 1.4 MB/s | 59 kB 00:00 2023-09-23T08:43:23.096 INFO:teuthology.orchestra.run.smithi082.stdout:(39/131): libunwind-1.3.1-3.el8.x86_64.rpm 1.0 MB/s | 75 kB 00:00 2023-09-23T08:43:23.205 INFO:teuthology.orchestra.run.smithi082.stdout:(40/131): python3-asyncssh-2.7.0-2.el8.noarch.r 4.3 MB/s | 476 kB 00:00 2023-09-23T08:43:23.246 INFO:teuthology.orchestra.run.smithi082.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 1.0 MB/s | 44 kB 00:00 2023-09-23T08:43:23.288 INFO:teuthology.orchestra.run.smithi082.stdout:(42/131): python3-beautifulsoup4-4.6.3-2.el8.1. 4.4 MB/s | 185 kB 00:00 2023-09-23T08:43:23.330 INFO:teuthology.orchestra.run.smithi082.stdout:(43/131): python3-cachetools-3.1.1-4.el8.noarch 791 kB/s | 33 kB 00:00 2023-09-23T08:43:23.364 INFO:teuthology.orchestra.run.smithi082.stdout:(44/131): python3-certifi-2018.10.15-7.el8.noar 492 kB/s | 16 kB 00:00 2023-09-23T08:43:23.398 INFO:teuthology.orchestra.run.smithi161.stdout:(2/131): ceph-fuse-18.0.0-5661.gdb9a2d12.el8.x8 1.0 MB/s | 860 kB 00:00 2023-09-23T08:43:23.406 INFO:teuthology.orchestra.run.smithi082.stdout:(45/131): python3-cheroot-8.5.2-1.el8.noarch.rp 4.1 MB/s | 173 kB 00:00 2023-09-23T08:43:23.465 INFO:teuthology.orchestra.run.smithi082.stdout:(46/131): python3-cherrypy-18.4.0-1.el8.noarch. 6.5 MB/s | 384 kB 00:00 2023-09-23T08:43:23.515 INFO:teuthology.orchestra.run.smithi161.stdout:(3/131): ceph-immutable-object-cache-18.0.0-566 1.4 MB/s | 167 kB 00:00 2023-09-23T08:43:23.557 INFO:teuthology.orchestra.run.smithi082.stdout:(47/131): ceph-mgr-diskprediction-local-18.0.0- 5.5 MB/s | 7.4 MB 00:01 2023-09-23T08:43:23.582 INFO:teuthology.orchestra.run.smithi082.stdout:(48/131): python3-google-auth-1.1.1-10.el8.noar 695 kB/s | 81 kB 00:00 2023-09-23T08:43:23.598 INFO:teuthology.orchestra.run.smithi135.stdout:(10/131): ceph-radosgw-18.0.0-5661.gdb9a2d12.el 9.6 MB/s | 14 MB 00:01 2023-09-23T08:43:23.654 INFO:teuthology.orchestra.run.smithi082.stdout:(49/131): python3-jaraco-6.2-6.el8.noarch.rpm 115 kB/s | 11 kB 00:00 2023-09-23T08:43:23.682 INFO:teuthology.orchestra.run.smithi135.stdout:(11/131): cephfs-mirror-18.0.0-5661.gdb9a2d12.e 3.1 MB/s | 260 kB 00:00 2023-09-23T08:43:23.685 INFO:teuthology.orchestra.run.smithi082.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 175 kB/s | 18 kB 00:00 2023-09-23T08:43:23.757 INFO:teuthology.orchestra.run.smithi135.stdout:(12/131): libcephfs-devel-18.0.0-5661.gdb9a2d12 415 kB/s | 31 kB 00:00 2023-09-23T08:43:23.766 INFO:teuthology.orchestra.run.smithi082.stdout:(51/131): python3-kubernetes-11.0.0-6.el8.noarc 10 MB/s | 1.2 MB 00:00 2023-09-23T08:43:23.791 INFO:teuthology.orchestra.run.smithi082.stdout:(52/131): python3-logutils-0.3.5-11.el8.noarch. 451 kB/s | 49 kB 00:00 2023-09-23T08:43:23.823 INFO:teuthology.orchestra.run.smithi161.stdout:(4/131): ceph-base-18.0.0-5661.gdb9a2d12.el8.x8 3.6 MB/s | 5.4 MB 00:01 2023-09-23T08:43:23.833 INFO:teuthology.orchestra.run.smithi082.stdout:(53/131): python3-more-itertools-7.2.0-3.el8.no 881 kB/s | 59 kB 00:00 2023-09-23T08:43:23.840 INFO:teuthology.orchestra.run.smithi135.stdout:(13/131): libcephfs2-18.0.0-5661.gdb9a2d12.el8. 9.2 MB/s | 783 kB 00:00 2023-09-23T08:43:23.859 INFO:teuthology.orchestra.run.smithi082.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 898 kB/s | 60 kB 00:00 2023-09-23T08:43:23.884 INFO:teuthology.orchestra.run.smithi082.stdout:(55/131): python3-pecan-1.3.2-9.el8.noarch.rpm 5.5 MB/s | 283 kB 00:00 2023-09-23T08:43:23.910 INFO:teuthology.orchestra.run.smithi082.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 311 kB/s | 16 kB 00:00 2023-09-23T08:43:23.916 INFO:teuthology.orchestra.run.smithi135.stdout:(14/131): libcephsqlite-18.0.0-5661.gdb9a2d12.e 1.8 MB/s | 139 kB 00:00 2023-09-23T08:43:23.934 INFO:teuthology.orchestra.run.smithi082.stdout:(57/131): python3-repoze-lru-0.7-6.el8.noarch.r 672 kB/s | 34 kB 00:00 2023-09-23T08:43:23.977 INFO:teuthology.orchestra.run.smithi082.stdout:(58/131): python3-routes-2.4.1-12.el8.noarch.rp 2.9 MB/s | 196 kB 00:00 2023-09-23T08:43:23.999 INFO:teuthology.orchestra.run.smithi135.stdout:(15/131): librados-devel-18.0.0-5661.gdb9a2d12. 1.6 MB/s | 139 kB 00:00 2023-09-23T08:43:24.002 INFO:teuthology.orchestra.run.smithi082.stdout:(59/131): python3-rsa-4.9-2.el8.noarch.rpm 963 kB/s | 64 kB 00:00 2023-09-23T08:43:24.016 INFO:teuthology.orchestra.run.smithi161.stdout:(5/131): ceph-mgr-18.0.0-5661.gdb9a2d12.el8.x86 8.1 MB/s | 1.6 MB 00:00 2023-09-23T08:43:24.027 INFO:teuthology.orchestra.run.smithi082.stdout:(60/131): python3-simplegeneric-0.8.1-17.el8.no 374 kB/s | 19 kB 00:00 2023-09-23T08:43:24.052 INFO:teuthology.orchestra.run.smithi082.stdout:(61/131): python3-singledispatch-3.4.0.3-18.el8 478 kB/s | 24 kB 00:00 2023-09-23T08:43:24.078 INFO:teuthology.orchestra.run.smithi082.stdout:(62/131): python3-tempora-1.14.1-5.el8.noarch.r 585 kB/s | 29 kB 00:00 2023-09-23T08:43:24.091 INFO:teuthology.orchestra.run.smithi135.stdout:(16/131): libradosstriper1-18.0.0-5661.gdb9a2d1 5.0 MB/s | 472 kB 00:00 2023-09-23T08:43:24.103 INFO:teuthology.orchestra.run.smithi082.stdout:(63/131): python3-trustme-0.6.0-4.el8.noarch.rp 550 kB/s | 27 kB 00:00 2023-09-23T08:43:24.137 INFO:teuthology.orchestra.run.smithi082.stdout:(64/131): python3-waitress-1.4.3-1.el8.noarch.r 4.3 MB/s | 255 kB 00:00 2023-09-23T08:43:24.162 INFO:teuthology.orchestra.run.smithi082.stdout:(65/131): python3-webob-1.8.5-1.el8.1.noarch.rp 4.2 MB/s | 251 kB 00:00 2023-09-23T08:43:24.188 INFO:teuthology.orchestra.run.smithi082.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 1.2 MB/s | 61 kB 00:00 2023-09-23T08:43:24.246 INFO:teuthology.orchestra.run.smithi082.stdout:(67/131): python3-webtest-2.0.33-1.el8.noarch.r 1.0 MB/s | 85 kB 00:00 2023-09-23T08:43:24.271 INFO:teuthology.orchestra.run.smithi082.stdout:(68/131): python3-zc-lockfile-2.0-2.el8.noarch. 275 kB/s | 23 kB 00:00 2023-09-23T08:43:24.297 INFO:teuthology.orchestra.run.smithi082.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2023-09-23T08:43:24.358 INFO:teuthology.orchestra.run.smithi161.stdout:(6/131): ceph-mds-18.0.0-5661.gdb9a2d12.el8.x86 2.7 MB/s | 2.3 MB 00:00 2023-09-23T08:43:24.363 INFO:teuthology.orchestra.run.smithi082.stdout:(70/131): thrift-0.13.0-2.el8.x86_64.rpm 15 MB/s | 1.7 MB 00:00 2023-09-23T08:43:24.414 INFO:teuthology.orchestra.run.smithi082.stdout:(71/131): python3-pyasn1-modules-0.3.7-6.el8.no 2.1 MB/s | 110 kB 00:00 2023-09-23T08:43:24.447 INFO:teuthology.orchestra.run.smithi082.stdout:(72/131): python3-pytz-2017.2-9.el8.noarch.rpm 1.6 MB/s | 54 kB 00:00 2023-09-23T08:43:24.489 INFO:teuthology.orchestra.run.smithi082.stdout:(73/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 6.1 MB/s | 259 kB 00:00 2023-09-23T08:43:24.540 INFO:teuthology.orchestra.run.smithi082.stdout:(74/131): socat-1.7.4.1-1.el8.x86_64.rpm 6.3 MB/s | 323 kB 00:00 2023-09-23T08:43:24.582 INFO:teuthology.orchestra.run.smithi082.stdout:(75/131): python3-markupsafe-0.23-19.el8.x86_64 938 kB/s | 39 kB 00:00 2023-09-23T08:43:24.640 INFO:teuthology.orchestra.run.smithi082.stdout:(76/131): bison-3.0.4-10.el8.x86_64.rpm 12 MB/s | 688 kB 00:00 2023-09-23T08:43:24.692 INFO:teuthology.orchestra.run.smithi161.stdout:(7/131): ceph-mon-18.0.0-5661.gdb9a2d12.el8.x86 6.8 MB/s | 4.6 MB 00:00 2023-09-23T08:43:24.827 INFO:teuthology.orchestra.run.smithi082.stdout:(77/131): python3-jinja2-2.10.1-3.el8.noarch.rp 2.8 MB/s | 538 kB 00:00 2023-09-23T08:43:24.874 INFO:teuthology.orchestra.run.smithi082.stdout:(78/131): python3-mako-1.0.6-13.el8.noarch.rpm 3.3 MB/s | 157 kB 00:00 2023-09-23T08:43:24.875 INFO:teuthology.orchestra.run.smithi135.stdout:(17/131): librgw2-18.0.0-5661.gdb9a2d12.el8.x86 8.7 MB/s | 6.8 MB 00:00 2023-09-23T08:43:24.916 INFO:teuthology.orchestra.run.smithi082.stdout:(79/131): oniguruma-6.8.2-2.el8.x86_64.rpm 4.4 MB/s | 187 kB 00:00 2023-09-23T08:43:24.967 INFO:teuthology.orchestra.run.smithi082.stdout:(80/131): automake-1.16.1-7.el8.noarch.rpm 14 MB/s | 713 kB 00:00 2023-09-23T08:43:25.001 INFO:teuthology.orchestra.run.smithi135.stdout:(18/131): python3-ceph-argparse-18.0.0-5661.gdb 358 kB/s | 45 kB 00:00 2023-09-23T08:43:25.109 INFO:teuthology.orchestra.run.smithi082.stdout:(81/131): python3-scipy-1.0.0-21.module+el8.5.0 17 MB/s | 14 MB 00:00 2023-09-23T08:43:25.126 INFO:teuthology.orchestra.run.smithi135.stdout:(19/131): python3-ceph-common-18.0.0-5661.gdb9a 1.0 MB/s | 125 kB 00:00 2023-09-23T08:43:25.150 INFO:teuthology.orchestra.run.smithi082.stdout:(82/131): python3-jsonpatch-1.21-2.el8.noarch.r 647 kB/s | 27 kB 00:00 2023-09-23T08:43:25.192 INFO:teuthology.orchestra.run.smithi082.stdout:(83/131): flex-2.6.1-9.el8.x86_64.rpm 7.5 MB/s | 320 kB 00:00 2023-09-23T08:43:25.234 INFO:teuthology.orchestra.run.smithi082.stdout:(84/131): python3-prettytable-0.7.2-14.el8.noar 1.0 MB/s | 44 kB 00:00 2023-09-23T08:43:25.235 INFO:teuthology.orchestra.run.smithi135.stdout:(20/131): python3-cephfs-18.0.0-5661.gdb9a2d12. 1.8 MB/s | 197 kB 00:00 2023-09-23T08:43:25.326 INFO:teuthology.orchestra.run.smithi082.stdout:(85/131): python3-babel-2.5.1-7.el8.noarch.rpm 13 MB/s | 4.8 MB 00:00 2023-09-23T08:43:25.377 INFO:teuthology.orchestra.run.smithi135.stdout:(21/131): python3-rados-18.0.0-5661.gdb9a2d12.e 2.6 MB/s | 371 kB 00:00 2023-09-23T08:43:25.401 INFO:teuthology.orchestra.run.smithi082.stdout:(86/131): python3-werkzeug-0.12.2-4.el8.noarch. 6.0 MB/s | 457 kB 00:00 2023-09-23T08:43:25.443 INFO:teuthology.orchestra.run.smithi082.stdout:(87/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 5.3 MB/s | 225 kB 00:00 2023-09-23T08:43:25.510 INFO:teuthology.orchestra.run.smithi082.stdout:(88/131): python3-numpy-1.14.3-10.el8.x86_64.rp 14 MB/s | 3.7 MB 00:00 2023-09-23T08:43:25.537 INFO:teuthology.orchestra.run.smithi082.stdout:(89/131): uuid-1.6.2-43.el8.x86_64.rpm 696 kB/s | 64 kB 00:00 2023-09-23T08:43:25.561 INFO:teuthology.orchestra.run.smithi082.stdout:(90/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 2.5 MB/s | 126 kB 00:00 2023-09-23T08:43:25.586 INFO:teuthology.orchestra.run.smithi082.stdout:(91/131): python3-jsonpointer-1.10-11.el8.noarc 399 kB/s | 20 kB 00:00 2023-09-23T08:43:25.612 INFO:teuthology.orchestra.run.smithi082.stdout:(92/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 2.0 MB/s | 103 kB 00:00 2023-09-23T08:43:25.645 INFO:teuthology.orchestra.run.smithi082.stdout:(93/131): libtool-2.4.6-25.el8.x86_64.rpm 12 MB/s | 709 kB 00:00 2023-09-23T08:43:25.687 INFO:teuthology.orchestra.run.smithi082.stdout:(94/131): libpq-13.5-1.el8.x86_64.rpm 4.6 MB/s | 198 kB 00:00 2023-09-23T08:43:25.785 INFO:teuthology.orchestra.run.smithi135.stdout:(22/131): python3-rbd-18.0.0-5661.gdb9a2d12.el8 891 kB/s | 364 kB 00:00 2023-09-23T08:43:25.812 INFO:teuthology.orchestra.run.smithi082.stdout:(95/131): openblas-threads-0.3.15-3.el8.x86_64. 24 MB/s | 4.9 MB 00:00 2023-09-23T08:43:25.854 INFO:teuthology.orchestra.run.smithi082.stdout:(96/131): jq-1.6-3.el8.x86_64.rpm 4.8 MB/s | 202 kB 00:00 2023-09-23T08:43:25.902 INFO:teuthology.orchestra.run.smithi135.stdout:(23/131): python3-rgw-18.0.0-5661.gdb9a2d12.el8 917 kB/s | 106 kB 00:00 2023-09-23T08:43:25.950 INFO:teuthology.orchestra.run.smithi082.stdout:(97/131): openblas-0.3.15-3.el8.x86_64.rpm 18 MB/s | 4.7 MB 00:00 2023-09-23T08:43:25.988 INFO:teuthology.orchestra.run.smithi082.stdout:(98/131): librdkafka-0.11.4-3.el8.x86_64.rpm 2.6 MB/s | 354 kB 00:00 2023-09-23T08:43:26.003 INFO:teuthology.orchestra.run.smithi135.stdout:(24/131): rbd-fuse-18.0.0-5661.gdb9a2d12.el8.x8 929 kB/s | 93 kB 00:00 2023-09-23T08:43:26.047 INFO:teuthology.orchestra.run.smithi082.stdout:(99/131): postgresql-contrib-10.21-2.module+el8 14 MB/s | 808 kB 00:00 2023-09-23T08:43:26.123 INFO:teuthology.orchestra.run.smithi082.stdout:(100/131): postgresql-10.21-2.module+el8.6.0+15 20 MB/s | 1.5 MB 00:00 2023-09-23T08:43:26.125 INFO:teuthology.orchestra.run.smithi161.stdout:(8/131): ceph-radosgw-18.0.0-5661.gdb9a2d12.el8 9.5 MB/s | 14 MB 00:01 2023-09-23T08:43:26.200 INFO:teuthology.orchestra.run.smithi161.stdout:(9/131): ceph-selinux-18.0.0-5661.gdb9a2d12.el8 326 kB/s | 24 kB 00:00 2023-09-23T08:43:26.206 INFO:teuthology.orchestra.run.smithi082.stdout:(101/131): postgresql-server-10.21-2.module+el8 20 MB/s | 5.1 MB 00:00 2023-09-23T08:43:26.223 INFO:teuthology.orchestra.run.smithi082.stdout:(102/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 468 kB/s | 47 kB 00:00 2023-09-23T08:43:26.248 INFO:teuthology.orchestra.run.smithi082.stdout:(103/131): libselinux-devel-2.9-5.el8.x86_64.rp 4.7 MB/s | 200 kB 00:00 2023-09-23T08:43:26.265 INFO:teuthology.orchestra.run.smithi082.stdout:(104/131): python3-jwt-1.6.1-2.el8.noarch.rpm 1.0 MB/s | 43 kB 00:00 2023-09-23T08:43:26.291 INFO:teuthology.orchestra.run.smithi082.stdout:(105/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 5.1 MB/s | 220 kB 00:00 2023-09-23T08:43:26.307 INFO:teuthology.orchestra.run.smithi082.stdout:(106/131): keyutils-libs-devel-1.5.10-9.el8.x86 1.1 MB/s | 48 kB 00:00 2023-09-23T08:43:26.332 INFO:teuthology.orchestra.run.smithi082.stdout:(107/131): libsepol-devel-2.9-3.el8.x86_64.rpm 2.0 MB/s | 87 kB 00:00 2023-09-23T08:43:26.358 INFO:teuthology.orchestra.run.smithi082.stdout:(108/131): python3-requests-oauthlib-1.0.0-1.el 851 kB/s | 43 kB 00:00 2023-09-23T08:43:26.383 INFO:teuthology.orchestra.run.smithi082.stdout:(109/131): python3-pycparser-2.14-14.el8.noarch 2.1 MB/s | 109 kB 00:00 2023-09-23T08:43:26.408 INFO:teuthology.orchestra.run.smithi082.stdout:(110/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 4.5 MB/s | 229 kB 00:00 2023-09-23T08:43:26.442 INFO:teuthology.orchestra.run.smithi082.stdout:(111/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 9.4 MB/s | 560 kB 00:00 2023-09-23T08:43:26.467 INFO:teuthology.orchestra.run.smithi082.stdout:(112/131): libaio-devel-0.3.112-1.el8.x86_64.rp 319 kB/s | 19 kB 00:00 2023-09-23T08:43:26.493 INFO:teuthology.orchestra.run.smithi082.stdout:(113/131): python3-oauthlib-2.1.0-1.el8.noarch. 3.0 MB/s | 155 kB 00:00 2023-09-23T08:43:26.559 INFO:teuthology.orchestra.run.smithi082.stdout:(114/131): python3-cryptography-3.2.1-5.el8.x86 5.9 MB/s | 559 kB 00:00 2023-09-23T08:43:26.562 INFO:teuthology.orchestra.run.smithi135.stdout:(25/131): ceph-osd-18.0.0-5661.gdb9a2d12.el8.x8 3.2 MB/s | 18 MB 00:05 2023-09-23T08:43:26.585 INFO:teuthology.orchestra.run.smithi082.stdout:(115/131): libverto-devel-0.3.0-5.el8.x86_64.rp 195 kB/s | 18 kB 00:00 2023-09-23T08:43:26.627 INFO:teuthology.orchestra.run.smithi082.stdout:(116/131): pcre2-devel-10.32-2.el8.x86_64.rpm 8.8 MB/s | 605 kB 00:00 2023-09-23T08:43:26.652 INFO:teuthology.orchestra.run.smithi082.stdout:(117/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 3.5 MB/s | 238 kB 00:00 2023-09-23T08:43:26.696 INFO:teuthology.orchestra.run.smithi135.stdout:(26/131): rbd-mirror-18.0.0-5661.gdb9a2d12.el8. 5.1 MB/s | 3.5 MB 00:00 2023-09-23T08:43:26.702 INFO:teuthology.orchestra.run.smithi082.stdout:(118/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 1.4 MB/s | 72 kB 00:00 2023-09-23T08:43:26.744 INFO:teuthology.orchestra.run.smithi082.stdout:(119/131): fuse-2.9.7-15.el8.x86_64.rpm 1.9 MB/s | 83 kB 00:00 2023-09-23T08:43:26.754 INFO:teuthology.orchestra.run.smithi135.stdout:(27/131): rbd-nbd-18.0.0-5661.gdb9a2d12.el8.x86 933 kB/s | 179 kB 00:00 2023-09-23T08:43:26.779 INFO:teuthology.orchestra.run.smithi135.stdout:(28/131): ceph-grafana-dashboards-18.0.0-5661.g 277 kB/s | 23 kB 00:00 2023-09-23T08:43:26.794 INFO:teuthology.orchestra.run.smithi082.stdout:(120/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 14 MB/s | 2.3 MB 00:00 2023-09-23T08:43:26.820 INFO:teuthology.orchestra.run.smithi082.stdout:(121/131): elfutils-libelf-devel-0.186-1.el8.x8 797 kB/s | 60 kB 00:00 2023-09-23T08:43:26.845 INFO:teuthology.orchestra.run.smithi082.stdout:(122/131): libuuid-devel-2.32.1-35.el8.x86_64.r 1.9 MB/s | 98 kB 00:00 2023-09-23T08:43:26.863 INFO:teuthology.orchestra.run.smithi135.stdout:(29/131): ceph-mgr-cephadm-18.0.0-5661.gdb9a2d1 1.2 MB/s | 132 kB 00:00 2023-09-23T08:43:26.870 INFO:teuthology.orchestra.run.smithi082.stdout:(123/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 1.1 MB/s | 58 kB 00:00 2023-09-23T08:43:26.895 INFO:teuthology.orchestra.run.smithi082.stdout:(124/131): libcom_err-devel-1.45.6-4.el8.x86_64 771 kB/s | 39 kB 00:00 2023-09-23T08:43:26.929 INFO:teuthology.orchestra.run.smithi082.stdout:(125/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 11 MB/s | 644 kB 00:00 2023-09-23T08:43:26.954 INFO:teuthology.orchestra.run.smithi082.stdout:(126/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 2.9 MB/s | 171 kB 00:00 2023-09-23T08:43:26.979 INFO:teuthology.orchestra.run.smithi082.stdout:(127/131): NetworkManager-initscripts-updown-1. 2.7 MB/s | 138 kB 00:00 2023-09-23T08:43:27.101 INFO:teuthology.orchestra.run.smithi161.stdout:(10/131): ceph-osd-18.0.0-5661.gdb9a2d12.el8.x8 6.5 MB/s | 18 MB 00:02 2023-09-23T08:43:27.155 INFO:teuthology.orchestra.run.smithi135.stdout:(30/131): ceph-mgr-dashboard-18.0.0-5661.gdb9a2 4.7 MB/s | 1.7 MB 00:00 2023-09-23T08:43:27.192 INFO:teuthology.orchestra.run.smithi161.stdout:(11/131): cephfs-mirror-18.0.0-5661.gdb9a2d12.e 2.8 MB/s | 260 kB 00:00 2023-09-23T08:43:27.295 INFO:teuthology.orchestra.run.smithi135.stdout:(31/131): ceph-mgr-modules-core-18.0.0-5661.gdb 1.7 MB/s | 242 kB 00:00 2023-09-23T08:43:27.301 INFO:teuthology.orchestra.run.smithi161.stdout:(12/131): libcephfs-devel-18.0.0-5661.gdb9a2d12 287 kB/s | 31 kB 00:00 2023-09-23T08:43:27.398 INFO:teuthology.orchestra.run.smithi135.stdout:(32/131): ceph-mgr-rook-18.0.0-5661.gdb9a2d12.e 465 kB/s | 47 kB 00:00 2023-09-23T08:43:27.573 INFO:teuthology.orchestra.run.smithi135.stdout:(33/131): ceph-prometheus-alerts-18.0.0-5661.gd 83 kB/s | 15 kB 00:00 2023-09-23T08:43:27.643 INFO:teuthology.orchestra.run.smithi161.stdout:(13/131): libcephfs2-18.0.0-5661.gdb9a2d12.el8. 2.2 MB/s | 783 kB 00:00 2023-09-23T08:43:27.682 INFO:teuthology.orchestra.run.smithi135.stdout:(34/131): ceph-volume-18.0.0-5661.gdb9a2d12.el8 2.3 MB/s | 261 kB 00:00 2023-09-23T08:43:27.705 INFO:teuthology.orchestra.run.smithi082.stdout:(128/131): librbd1-18.0.0-5661.gdb9a2d12.el8.x8 5.0 MB/s | 3.6 MB 00:00 2023-09-23T08:43:27.710 INFO:teuthology.orchestra.run.smithi161.stdout:(14/131): libcephsqlite-18.0.0-5661.gdb9a2d12.e 2.0 MB/s | 139 kB 00:00 2023-09-23T08:43:27.789 INFO:teuthology.orchestra.run.smithi082.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 9.4 MB/s | 798 kB 00:00 2023-09-23T08:43:27.793 INFO:teuthology.orchestra.run.smithi161.stdout:(15/131): librados-devel-18.0.0-5661.gdb9a2d12. 1.6 MB/s | 139 kB 00:00 2023-09-23T08:43:27.847 INFO:teuthology.orchestra.run.smithi082.stdout:(130/131): librados2-18.0.0-5661.gdb9a2d12.el8. 4.1 MB/s | 3.7 MB 00:00 2023-09-23T08:43:27.949 INFO:teuthology.orchestra.run.smithi135.stdout:(35/131): cephadm-18.0.0-5661.gdb9a2d12.el8.noa 642 kB/s | 171 kB 00:00 2023-09-23T08:43:28.016 INFO:teuthology.orchestra.run.smithi135.stdout:(36/131): cephfs-top-18.0.0-5661.gdb9a2d12.el8. 269 kB/s | 18 kB 00:00 2023-09-23T08:43:28.044 INFO:teuthology.orchestra.run.smithi161.stdout:(16/131): ceph-common-18.0.0-5661.gdb9a2d12.el8 3.9 MB/s | 22 MB 00:05 2023-09-23T08:43:28.077 INFO:teuthology.orchestra.run.smithi161.stdout:(17/131): libradosstriper1-18.0.0-5661.gdb9a2d1 1.6 MB/s | 472 kB 00:00 2023-09-23T08:43:28.144 INFO:teuthology.orchestra.run.smithi161.stdout:(18/131): python3-ceph-argparse-18.0.0-5661.gdb 673 kB/s | 45 kB 00:00 2023-09-23T08:43:28.220 INFO:teuthology.orchestra.run.smithi161.stdout:(19/131): python3-ceph-common-18.0.0-5661.gdb9a 1.6 MB/s | 125 kB 00:00 2023-09-23T08:43:28.295 INFO:teuthology.orchestra.run.smithi161.stdout:(20/131): python3-cephfs-18.0.0-5661.gdb9a2d12. 2.6 MB/s | 197 kB 00:00 2023-09-23T08:43:28.387 INFO:teuthology.orchestra.run.smithi161.stdout:(21/131): python3-rados-18.0.0-5661.gdb9a2d12.e 4.0 MB/s | 371 kB 00:00 2023-09-23T08:43:28.462 INFO:teuthology.orchestra.run.smithi161.stdout:(22/131): python3-rbd-18.0.0-5661.gdb9a2d12.el8 4.8 MB/s | 364 kB 00:00 2023-09-23T08:43:28.483 INFO:teuthology.orchestra.run.smithi135.stdout:(37/131): gperftools-libs-2.7-9.el8.x86_64.rpm 656 kB/s | 306 kB 00:00 2023-09-23T08:43:28.529 INFO:teuthology.orchestra.run.smithi161.stdout:(23/131): python3-rgw-18.0.0-5661.gdb9a2d12.el8 1.6 MB/s | 106 kB 00:00 2023-09-23T08:43:28.584 INFO:teuthology.orchestra.run.smithi135.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 589 kB/s | 59 kB 00:00 2023-09-23T08:43:28.596 INFO:teuthology.orchestra.run.smithi161.stdout:(24/131): rbd-fuse-18.0.0-5661.gdb9a2d12.el8.x8 1.4 MB/s | 93 kB 00:00 2023-09-23T08:43:28.701 INFO:teuthology.orchestra.run.smithi135.stdout:(39/131): libunwind-1.3.1-3.el8.x86_64.rpm 645 kB/s | 75 kB 00:00 2023-09-23T08:43:28.884 INFO:teuthology.orchestra.run.smithi135.stdout:(40/131): python3-asyncssh-2.7.0-2.el8.noarch.r 2.5 MB/s | 476 kB 00:00 2023-09-23T08:43:28.985 INFO:teuthology.orchestra.run.smithi135.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 437 kB/s | 44 kB 00:00 2023-09-23T08:43:29.071 INFO:teuthology.orchestra.run.smithi161.stdout:(25/131): rbd-mirror-18.0.0-5661.gdb9a2d12.el8. 7.4 MB/s | 3.5 MB 00:00 2023-09-23T08:43:29.085 INFO:teuthology.orchestra.run.smithi135.stdout:(42/131): python3-beautifulsoup4-4.6.3-2.el8.1. 1.8 MB/s | 185 kB 00:00 2023-09-23T08:43:29.139 INFO:teuthology.orchestra.run.smithi161.stdout:(26/131): rbd-nbd-18.0.0-5661.gdb9a2d12.el8.x86 2.6 MB/s | 179 kB 00:00 2023-09-23T08:43:29.186 INFO:teuthology.orchestra.run.smithi135.stdout:(43/131): python3-cachetools-3.1.1-4.el8.noarch 330 kB/s | 33 kB 00:00 2023-09-23T08:43:29.214 INFO:teuthology.orchestra.run.smithi161.stdout:(27/131): ceph-grafana-dashboards-18.0.0-5661.g 309 kB/s | 23 kB 00:00 2023-09-23T08:43:29.278 INFO:teuthology.orchestra.run.smithi135.stdout:(44/131): python3-certifi-2018.10.15-7.el8.noar 178 kB/s | 16 kB 00:00 2023-09-23T08:43:29.281 INFO:teuthology.orchestra.run.smithi161.stdout:(28/131): ceph-mgr-cephadm-18.0.0-5661.gdb9a2d1 1.9 MB/s | 132 kB 00:00 2023-09-23T08:43:29.378 INFO:teuthology.orchestra.run.smithi135.stdout:(45/131): python3-cheroot-8.5.2-1.el8.noarch.rp 1.7 MB/s | 173 kB 00:00 2023-09-23T08:43:29.382 INFO:teuthology.orchestra.run.smithi161.stdout:(29/131): librgw2-18.0.0-5661.gdb9a2d12.el8.x86 5.1 MB/s | 6.8 MB 00:01 2023-09-23T08:43:29.470 INFO:teuthology.orchestra.run.smithi135.stdout:(46/131): ceph-mgr-diskprediction-local-18.0.0- 2.8 MB/s | 7.4 MB 00:02 2023-09-23T08:43:29.504 INFO:teuthology.orchestra.run.smithi135.stdout:(47/131): python3-cherrypy-18.4.0-1.el8.noarch. 3.0 MB/s | 384 kB 00:00 2023-09-23T08:43:29.565 INFO:teuthology.orchestra.run.smithi161.stdout:(30/131): ceph-mgr-dashboard-18.0.0-5661.gdb9a2 6.2 MB/s | 1.7 MB 00:00 2023-09-23T08:43:29.617 INFO:teuthology.orchestra.run.smithi135.stdout:(48/131): python3-jaraco-6.2-6.el8.noarch.rpm 98 kB/s | 11 kB 00:00 2023-09-23T08:43:29.640 INFO:teuthology.orchestra.run.smithi161.stdout:(31/131): ceph-mgr-modules-core-18.0.0-5661.gdb 3.1 MB/s | 242 kB 00:00 2023-09-23T08:43:29.713 INFO:teuthology.orchestra.run.smithi135.stdout:(49/131): python3-jaraco-functools-2.0-4.el8.no 184 kB/s | 18 kB 00:00 2023-09-23T08:43:29.715 INFO:teuthology.orchestra.run.smithi161.stdout:(32/131): ceph-mgr-rook-18.0.0-5661.gdb9a2d12.e 634 kB/s | 47 kB 00:00 2023-09-23T08:43:29.782 INFO:teuthology.orchestra.run.smithi161.stdout:(33/131): ceph-prometheus-alerts-18.0.0-5661.gd 218 kB/s | 15 kB 00:00 2023-09-23T08:43:29.813 INFO:teuthology.orchestra.run.smithi135.stdout:(50/131): python3-google-auth-1.1.1-10.el8.noar 237 kB/s | 81 kB 00:00 2023-09-23T08:43:29.866 INFO:teuthology.orchestra.run.smithi161.stdout:(34/131): ceph-volume-18.0.0-5661.gdb9a2d12.el8 3.1 MB/s | 261 kB 00:00 2023-09-23T08:43:29.922 INFO:teuthology.orchestra.run.smithi135.stdout:(51/131): python3-kubernetes-11.0.0-6.el8.noarc 5.6 MB/s | 1.2 MB 00:00 2023-09-23T08:43:29.947 INFO:teuthology.orchestra.run.smithi135.stdout:(52/131): python3-logutils-0.3.5-11.el8.noarch. 365 kB/s | 49 kB 00:00 2023-09-23T08:43:29.950 INFO:teuthology.orchestra.run.smithi161.stdout:(35/131): cephadm-18.0.0-5661.gdb9a2d12.el8.noa 2.0 MB/s | 171 kB 00:00 2023-09-23T08:43:30.017 INFO:teuthology.orchestra.run.smithi161.stdout:(36/131): cephfs-top-18.0.0-5661.gdb9a2d12.el8. 270 kB/s | 18 kB 00:00 2023-09-23T08:43:30.023 INFO:teuthology.orchestra.run.smithi135.stdout:(53/131): python3-more-itertools-7.2.0-3.el8.no 585 kB/s | 59 kB 00:00 2023-09-23T08:43:30.048 INFO:teuthology.orchestra.run.smithi135.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 601 kB/s | 60 kB 00:00 2023-09-23T08:43:30.132 INFO:teuthology.orchestra.run.smithi135.stdout:(55/131): python3-pecan-1.3.2-9.el8.noarch.rpm 2.6 MB/s | 283 kB 00:00 2023-09-23T08:43:30.157 INFO:teuthology.orchestra.run.smithi135.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 143 kB/s | 16 kB 00:00 2023-09-23T08:43:30.233 INFO:teuthology.orchestra.run.smithi135.stdout:(57/131): python3-repoze-lru-0.7-6.el8.noarch.r 335 kB/s | 34 kB 00:00 2023-09-23T08:43:30.284 INFO:teuthology.orchestra.run.smithi161.stdout:(37/131): gperftools-libs-2.7-9.el8.x86_64.rpm 1.1 MB/s | 306 kB 00:00 2023-09-23T08:43:30.333 INFO:teuthology.orchestra.run.smithi135.stdout:(58/131): python3-routes-2.4.1-12.el8.noarch.rp 1.1 MB/s | 196 kB 00:00 2023-09-23T08:43:30.342 INFO:teuthology.orchestra.run.smithi161.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 1.0 MB/s | 59 kB 00:00 2023-09-23T08:43:30.358 INFO:teuthology.orchestra.run.smithi135.stdout:(59/131): python3-rsa-4.9-2.el8.noarch.rpm 514 kB/s | 64 kB 00:00 2023-09-23T08:43:30.426 INFO:teuthology.orchestra.run.smithi161.stdout:(39/131): libunwind-1.3.1-3.el8.x86_64.rpm 903 kB/s | 75 kB 00:00 2023-09-23T08:43:30.459 INFO:teuthology.orchestra.run.smithi135.stdout:(60/131): python3-simplegeneric-0.8.1-17.el8.no 188 kB/s | 19 kB 00:00 2023-09-23T08:43:30.484 INFO:teuthology.orchestra.run.smithi135.stdout:(61/131): python3-singledispatch-3.4.0.3-18.el8 191 kB/s | 24 kB 00:00 2023-09-23T08:43:30.526 INFO:teuthology.orchestra.run.smithi161.stdout:(40/131): python3-asyncssh-2.7.0-2.el8.noarch.r 4.6 MB/s | 476 kB 00:00 2023-09-23T08:43:30.585 INFO:teuthology.orchestra.run.smithi161.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 751 kB/s | 44 kB 00:00 2023-09-23T08:43:30.593 INFO:teuthology.orchestra.run.smithi135.stdout:(62/131): python3-tempora-1.14.1-5.el8.noarch.r 219 kB/s | 29 kB 00:00 2023-09-23T08:43:30.618 INFO:teuthology.orchestra.run.smithi135.stdout:(63/131): python3-trustme-0.6.0-4.el8.noarch.rp 206 kB/s | 27 kB 00:00 2023-09-23T08:43:30.677 INFO:teuthology.orchestra.run.smithi161.stdout:(42/131): ceph-mgr-diskprediction-local-18.0.0- 5.7 MB/s | 7.4 MB 00:01 2023-09-23T08:43:30.694 INFO:teuthology.orchestra.run.smithi135.stdout:(64/131): python3-waitress-1.4.3-1.el8.noarch.r 2.5 MB/s | 255 kB 00:00 2023-09-23T08:43:30.702 INFO:teuthology.orchestra.run.smithi161.stdout:(43/131): python3-beautifulsoup4-4.6.3-2.el8.1. 1.5 MB/s | 185 kB 00:00 2023-09-23T08:43:30.719 INFO:teuthology.orchestra.run.smithi135.stdout:(65/131): python3-webob-1.8.5-1.el8.1.noarch.rp 2.4 MB/s | 251 kB 00:00 2023-09-23T08:43:30.761 INFO:teuthology.orchestra.run.smithi161.stdout:(44/131): python3-certifi-2018.10.15-7.el8.noar 279 kB/s | 16 kB 00:00 2023-09-23T08:43:30.794 INFO:teuthology.orchestra.run.smithi135.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 610 kB/s | 61 kB 00:00 2023-09-23T08:43:30.820 INFO:teuthology.orchestra.run.smithi161.stdout:(45/131): python3-cheroot-8.5.2-1.el8.noarch.rp 2.9 MB/s | 173 kB 00:00 2023-09-23T08:43:30.820 INFO:teuthology.orchestra.run.smithi135.stdout:(67/131): python3-webtest-2.0.33-1.el8.noarch.r 848 kB/s | 85 kB 00:00 2023-09-23T08:43:30.853 INFO:teuthology.orchestra.run.smithi161.stdout:(46/131): python3-cachetools-3.1.1-4.el8.noarch 188 kB/s | 33 kB 00:00 2023-09-23T08:43:30.895 INFO:teuthology.orchestra.run.smithi135.stdout:(68/131): python3-zc-lockfile-2.0-2.el8.noarch. 229 kB/s | 23 kB 00:00 2023-09-23T08:43:30.915 INFO:teuthology.orchestra.run.smithi161.stdout:(47/131): python3-cherrypy-18.4.0-1.el8.noarch. 4.0 MB/s | 384 kB 00:00 2023-09-23T08:43:30.920 INFO:teuthology.orchestra.run.smithi135.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2023-09-23T08:43:30.979 INFO:teuthology.orchestra.run.smithi135.stdout:(70/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 805 kB/s | 47 kB 00:00 2023-09-23T08:43:31.038 INFO:teuthology.orchestra.run.smithi135.stdout:(71/131): libselinux-devel-2.9-5.el8.x86_64.rpm 3.4 MB/s | 200 kB 00:00 2023-09-23T08:43:31.080 INFO:teuthology.orchestra.run.smithi135.stdout:(72/131): python3-jwt-1.6.1-2.el8.noarch.rpm 1.0 MB/s | 43 kB 00:00 2023-09-23T08:43:31.122 INFO:teuthology.orchestra.run.smithi135.stdout:(73/131): thrift-0.13.0-2.el8.x86_64.rpm 5.7 MB/s | 1.7 MB 00:00 2023-09-23T08:43:31.156 INFO:teuthology.orchestra.run.smithi135.stdout:(74/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 2.9 MB/s | 220 kB 00:00 2023-09-23T08:43:31.187 INFO:teuthology.orchestra.run.smithi161.stdout:(48/131): python3-google-auth-1.1.1-10.el8.noar 243 kB/s | 81 kB 00:00 2023-09-23T08:43:31.206 INFO:teuthology.orchestra.run.smithi135.stdout:(75/131): keyutils-libs-devel-1.5.10-9.el8.x86_ 577 kB/s | 48 kB 00:00 2023-09-23T08:43:31.212 INFO:teuthology.orchestra.run.smithi161.stdout:(49/131): python3-jaraco-6.2-6.el8.noarch.rpm 37 kB/s | 11 kB 00:00 2023-09-23T08:43:31.231 INFO:teuthology.orchestra.run.smithi135.stdout:(76/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.2 MB/s | 87 kB 00:00 2023-09-23T08:43:31.246 INFO:teuthology.orchestra.run.smithi161.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 301 kB/s | 18 kB 00:00 2023-09-23T08:43:31.257 INFO:teuthology.orchestra.run.smithi135.stdout:(77/131): python3-requests-oauthlib-1.0.0-1.el8 850 kB/s | 43 kB 00:00 2023-09-23T08:43:31.282 INFO:teuthology.orchestra.run.smithi135.stdout:(78/131): python3-pycparser-2.14-14.el8.noarch. 2.1 MB/s | 109 kB 00:00 2023-09-23T08:43:31.305 INFO:teuthology.orchestra.run.smithi161.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 839 kB/s | 49 kB 00:00 2023-09-23T08:43:31.307 INFO:teuthology.orchestra.run.smithi135.stdout:(79/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 4.5 MB/s | 229 kB 00:00 2023-09-23T08:43:31.341 INFO:teuthology.orchestra.run.smithi135.stdout:(80/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 9.3 MB/s | 560 kB 00:00 2023-09-23T08:43:31.366 INFO:teuthology.orchestra.run.smithi135.stdout:(81/131): libaio-devel-0.3.112-1.el8.x86_64.rpm 320 kB/s | 19 kB 00:00 2023-09-23T08:43:31.392 INFO:teuthology.orchestra.run.smithi135.stdout:(82/131): python3-oauthlib-2.1.0-1.el8.noarch.r 3.0 MB/s | 155 kB 00:00 2023-09-23T08:43:31.425 INFO:teuthology.orchestra.run.smithi135.stdout:(83/131): python3-cryptography-3.2.1-5.el8.x86_ 9.3 MB/s | 559 kB 00:00 2023-09-23T08:43:31.442 INFO:teuthology.orchestra.run.smithi135.stdout:(84/131): libverto-devel-0.3.0-5.el8.x86_64.rpm 357 kB/s | 18 kB 00:00 2023-09-23T08:43:31.501 INFO:teuthology.orchestra.run.smithi135.stdout:(85/131): pcre2-devel-10.32-2.el8.x86_64.rpm 7.9 MB/s | 605 kB 00:00 2023-09-23T08:43:31.543 INFO:teuthology.orchestra.run.smithi135.stdout:(86/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 2.3 MB/s | 238 kB 00:00 2023-09-23T08:43:31.585 INFO:teuthology.orchestra.run.smithi135.stdout:(87/131): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 1.7 MB/s | 72 kB 00:00 2023-09-23T08:43:31.627 INFO:teuthology.orchestra.run.smithi135.stdout:(88/131): fuse-2.9.7-15.el8.x86_64.rpm 1.9 MB/s | 83 kB 00:00 2023-09-23T08:43:31.677 INFO:teuthology.orchestra.run.smithi135.stdout:(89/131): openssl-devel-1.1.1k-7.el8_6.x86_64.r 13 MB/s | 2.3 MB 00:00 2023-09-23T08:43:31.711 INFO:teuthology.orchestra.run.smithi135.stdout:(90/131): elfutils-libelf-devel-0.186-1.el8.x86 716 kB/s | 60 kB 00:00 2023-09-23T08:43:31.737 INFO:teuthology.orchestra.run.smithi135.stdout:(91/131): libuuid-devel-2.32.1-35.el8.x86_64.rp 1.6 MB/s | 98 kB 00:00 2023-09-23T08:43:31.739 INFO:teuthology.orchestra.run.smithi161.stdout:(52/131): ceph-test-18.0.0-5661.gdb9a2d12.el8.x 8.7 MB/s | 48 MB 00:05 2023-09-23T08:43:31.762 INFO:teuthology.orchestra.run.smithi135.stdout:(92/131): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2023-09-23T08:43:31.763 INFO:teuthology.orchestra.run.smithi161.stdout:(53/131): python3-more-itertools-7.2.0-3.el8.no 128 kB/s | 59 kB 00:00 2023-09-23T08:43:31.787 INFO:teuthology.orchestra.run.smithi135.stdout:(93/131): libcom_err-devel-1.45.6-4.el8.x86_64. 768 kB/s | 39 kB 00:00 2023-09-23T08:43:31.805 INFO:teuthology.orchestra.run.smithi161.stdout:(54/131): python3-kubernetes-11.0.0-6.el8.noarc 2.0 MB/s | 1.2 MB 00:00 2023-09-23T08:43:31.830 INFO:teuthology.orchestra.run.smithi135.stdout:(94/131): libgfortran-8.5.0-10.1.el8_6.x86_64.r 9.4 MB/s | 644 kB 00:00 2023-09-23T08:43:31.855 INFO:teuthology.orchestra.run.smithi135.stdout:(95/131): libquadmath-8.5.0-10.1.el8_6.x86_64.r 2.5 MB/s | 171 kB 00:00 2023-09-23T08:43:31.856 INFO:teuthology.orchestra.run.smithi161.stdout:(55/131): python3-portend-2.6-1.el8.noarch.rpm 345 kB/s | 16 kB 00:00 2023-09-23T08:43:31.880 INFO:teuthology.orchestra.run.smithi135.stdout:(96/131): NetworkManager-initscripts-updown-1.3 2.7 MB/s | 138 kB 00:00 2023-09-23T08:43:31.881 INFO:teuthology.orchestra.run.smithi161.stdout:(56/131): python3-pecan-1.3.2-9.el8.noarch.rpm 2.4 MB/s | 283 kB 00:00 2023-09-23T08:43:31.931 INFO:teuthology.orchestra.run.smithi161.stdout:(57/131): python3-repoze-lru-0.7-6.el8.noarch.r 450 kB/s | 34 kB 00:00 2023-09-23T08:43:31.946 INFO:teuthology.orchestra.run.smithi135.stdout:(97/131): python3-pyasn1-modules-0.3.7-6.el8.no 1.7 MB/s | 110 kB 00:00 2023-09-23T08:43:31.957 INFO:teuthology.orchestra.run.smithi161.stdout:(58/131): python3-routes-2.4.1-12.el8.noarch.rp 2.5 MB/s | 196 kB 00:00 2023-09-23T08:43:31.989 INFO:teuthology.orchestra.run.smithi135.stdout:(98/131): python3-pytz-2017.2-9.el8.noarch.rpm 1.2 MB/s | 54 kB 00:00 2023-09-23T08:43:31.990 INFO:teuthology.orchestra.run.smithi161.stdout:(59/131): python3-rsa-4.9-2.el8.noarch.rpm 1.1 MB/s | 64 kB 00:00 2023-09-23T08:43:32.016 INFO:teuthology.orchestra.run.smithi161.stdout:(60/131): python3-simplegeneric-0.8.1-17.el8.no 320 kB/s | 19 kB 00:00 2023-09-23T08:43:32.031 INFO:teuthology.orchestra.run.smithi135.stdout:(99/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 6.1 MB/s | 259 kB 00:00 2023-09-23T08:43:32.041 INFO:teuthology.orchestra.run.smithi161.stdout:(61/131): python3-natsort-7.1.1-2.el8.noarch.rp 200 kB/s | 60 kB 00:00 2023-09-23T08:43:32.066 INFO:teuthology.orchestra.run.smithi161.stdout:(62/131): python3-singledispatch-3.4.0.3-18.el8 318 kB/s | 24 kB 00:00 2023-09-23T08:43:32.073 INFO:teuthology.orchestra.run.smithi135.stdout:(100/131): socat-1.7.4.1-1.el8.x86_64.rpm 7.6 MB/s | 323 kB 00:00 2023-09-23T08:43:32.092 INFO:teuthology.orchestra.run.smithi161.stdout:(63/131): python3-tempora-1.14.1-5.el8.noarch.r 388 kB/s | 29 kB 00:00 2023-09-23T08:43:32.107 INFO:teuthology.orchestra.run.smithi135.stdout:(101/131): python3-markupsafe-0.23-19.el8.x86_6 1.1 MB/s | 39 kB 00:00 2023-09-23T08:43:32.117 INFO:teuthology.orchestra.run.smithi161.stdout:(64/131): python3-trustme-0.6.0-4.el8.noarch.rp 365 kB/s | 27 kB 00:00 2023-09-23T08:43:32.150 INFO:teuthology.orchestra.run.smithi161.stdout:(65/131): python3-webob-1.8.5-1.el8.1.noarch.rp 4.2 MB/s | 251 kB 00:00 2023-09-23T08:43:32.157 INFO:teuthology.orchestra.run.smithi135.stdout:(102/131): bison-3.0.4-10.el8.x86_64.rpm 13 MB/s | 688 kB 00:00 2023-09-23T08:43:32.176 INFO:teuthology.orchestra.run.smithi161.stdout:(66/131): python3-waitress-1.4.3-1.el8.noarch.r 2.3 MB/s | 255 kB 00:00 2023-09-23T08:43:32.201 INFO:teuthology.orchestra.run.smithi161.stdout:(67/131): python3-websocket-client-0.56.0-5.el8 732 kB/s | 61 kB 00:00 2023-09-23T08:43:32.208 INFO:teuthology.orchestra.run.smithi135.stdout:(103/131): python3-jinja2-2.10.1-3.el8.noarch.r 11 MB/s | 538 kB 00:00 2023-09-23T08:43:32.226 INFO:teuthology.orchestra.run.smithi161.stdout:(68/131): python3-webtest-2.0.33-1.el8.noarch.r 1.1 MB/s | 85 kB 00:00 2023-09-23T08:43:32.250 INFO:teuthology.orchestra.run.smithi135.stdout:(104/131): python3-mako-1.0.6-13.el8.noarch.rpm 3.7 MB/s | 157 kB 00:00 2023-09-23T08:43:32.252 INFO:teuthology.orchestra.run.smithi161.stdout:(69/131): python3-zc-lockfile-2.0-2.el8.noarch. 303 kB/s | 23 kB 00:00 2023-09-23T08:43:32.277 INFO:teuthology.orchestra.run.smithi161.stdout:(70/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.4 MB/s | 70 kB 00:00 2023-09-23T08:43:32.292 INFO:teuthology.orchestra.run.smithi135.stdout:(105/131): oniguruma-6.8.2-2.el8.x86_64.rpm 4.4 MB/s | 187 kB 00:00 2023-09-23T08:43:32.344 INFO:teuthology.orchestra.run.smithi161.stdout:(71/131): python3-pyasn1-modules-0.3.7-6.el8.no 1.8 MB/s | 110 kB 00:00 2023-09-23T08:43:32.367 INFO:teuthology.orchestra.run.smithi135.stdout:(106/131): automake-1.16.1-7.el8.noarch.rpm 9.3 MB/s | 713 kB 00:00 2023-09-23T08:43:32.386 INFO:teuthology.orchestra.run.smithi161.stdout:(72/131): python3-pytz-2017.2-9.el8.noarch.rpm 1.3 MB/s | 54 kB 00:00 2023-09-23T08:43:32.453 INFO:teuthology.orchestra.run.smithi161.stdout:(73/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 3.8 MB/s | 259 kB 00:00 2023-09-23T08:43:32.503 INFO:teuthology.orchestra.run.smithi161.stdout:(74/131): socat-1.7.4.1-1.el8.x86_64.rpm 6.4 MB/s | 323 kB 00:00 2023-09-23T08:43:32.543 INFO:teuthology.orchestra.run.smithi135.stdout:(107/131): python3-scipy-1.0.0-21.module+el8.5. 20 MB/s | 14 MB 00:00 2023-09-23T08:43:32.545 INFO:teuthology.orchestra.run.smithi161.stdout:(75/131): thrift-0.13.0-2.el8.x86_64.rpm 5.1 MB/s | 1.7 MB 00:00 2023-09-23T08:43:32.570 INFO:teuthology.orchestra.run.smithi161.stdout:(76/131): python3-markupsafe-0.23-19.el8.x86_64 582 kB/s | 39 kB 00:00 2023-09-23T08:43:32.576 INFO:teuthology.orchestra.run.smithi135.stdout:(108/131): python3-jsonpatch-1.21-2.el8.noarch. 807 kB/s | 27 kB 00:00 2023-09-23T08:43:32.626 INFO:teuthology.orchestra.run.smithi135.stdout:(109/131): flex-2.6.1-9.el8.x86_64.rpm 6.3 MB/s | 320 kB 00:00 2023-09-23T08:43:32.629 INFO:teuthology.orchestra.run.smithi161.stdout:(77/131): python3-jinja2-2.10.1-3.el8.noarch.rp 9.9 MB/s | 538 kB 00:00 2023-09-23T08:43:32.660 INFO:teuthology.orchestra.run.smithi135.stdout:(110/131): python3-prettytable-0.7.2-14.el8.noa 1.3 MB/s | 44 kB 00:00 2023-09-23T08:43:32.662 INFO:teuthology.orchestra.run.smithi161.stdout:(78/131): bison-3.0.4-10.el8.x86_64.rpm 5.7 MB/s | 688 kB 00:00 2023-09-23T08:43:32.687 INFO:teuthology.orchestra.run.smithi161.stdout:(79/131): python3-mako-1.0.6-13.el8.noarch.rpm 2.6 MB/s | 157 kB 00:00 2023-09-23T08:43:32.721 INFO:teuthology.orchestra.run.smithi161.stdout:(80/131): oniguruma-6.8.2-2.el8.x86_64.rpm 3.1 MB/s | 187 kB 00:00 2023-09-23T08:43:32.727 INFO:teuthology.orchestra.run.smithi135.stdout:(111/131): python3-babel-2.5.1-7.el8.noarch.rpm 13 MB/s | 4.8 MB 00:00 2023-09-23T08:43:32.771 INFO:teuthology.orchestra.run.smithi161.stdout:(81/131): automake-1.16.1-7.el8.noarch.rpm 8.4 MB/s | 713 kB 00:00 2023-09-23T08:43:32.786 INFO:teuthology.orchestra.run.smithi135.stdout:(112/131): python3-werkzeug-0.12.2-4.el8.noarch 7.7 MB/s | 457 kB 00:00 2023-09-23T08:43:32.813 INFO:teuthology.orchestra.run.smithi161.stdout:(82/131): python3-jsonpatch-1.21-2.el8.noarch.r 639 kB/s | 27 kB 00:00 2023-09-23T08:43:32.828 INFO:teuthology.orchestra.run.smithi135.stdout:(113/131): python3-numpy-f2py-1.14.3-10.el8.x86 5.3 MB/s | 225 kB 00:00 2023-09-23T08:43:32.864 INFO:teuthology.orchestra.run.smithi161.stdout:(83/131): flex-2.6.1-9.el8.x86_64.rpm 6.3 MB/s | 320 kB 00:00 2023-09-23T08:43:32.906 INFO:teuthology.orchestra.run.smithi161.stdout:(84/131): python3-prettytable-0.7.2-14.el8.noar 1.0 MB/s | 44 kB 00:00 2023-09-23T08:43:32.987 INFO:teuthology.orchestra.run.smithi135.stdout:(114/131): python3-numpy-1.14.3-10.el8.x86_64.r 11 MB/s | 3.7 MB 00:00 2023-09-23T08:43:33.013 INFO:teuthology.orchestra.run.smithi135.stdout:(115/131): uuid-1.6.2-43.el8.x86_64.rpm 348 kB/s | 64 kB 00:00 2023-09-23T08:43:33.031 INFO:teuthology.orchestra.run.smithi161.stdout:(85/131): python3-babel-2.5.1-7.el8.noarch.rpm 15 MB/s | 4.8 MB 00:00 2023-09-23T08:43:33.038 INFO:teuthology.orchestra.run.smithi135.stdout:(116/131): python3-pyasn1-0.3.7-6.el8.noarch.rp 2.5 MB/s | 126 kB 00:00 2023-09-23T08:43:33.063 INFO:teuthology.orchestra.run.smithi135.stdout:(117/131): python3-jsonpointer-1.10-11.el8.noar 397 kB/s | 20 kB 00:00 2023-09-23T08:43:33.081 INFO:teuthology.orchestra.run.smithi161.stdout:(86/131): python3-werkzeug-0.12.2-4.el8.noarch. 9.0 MB/s | 457 kB 00:00 2023-09-23T08:43:33.088 INFO:teuthology.orchestra.run.smithi135.stdout:(118/131): python3-pyOpenSSL-19.0.0-1.el8.noarc 2.0 MB/s | 103 kB 00:00 2023-09-23T08:43:33.131 INFO:teuthology.orchestra.run.smithi135.stdout:(119/131): libtool-2.4.6-25.el8.x86_64.rpm 10 MB/s | 709 kB 00:00 2023-09-23T08:43:33.165 INFO:teuthology.orchestra.run.smithi161.stdout:(87/131): python3-numpy-1.14.3-10.el8.x86_64.rp 14 MB/s | 3.7 MB 00:00 2023-09-23T08:43:33.181 INFO:teuthology.orchestra.run.smithi135.stdout:(120/131): libpq-13.5-1.el8.x86_64.rpm 3.9 MB/s | 198 kB 00:00 2023-09-23T08:43:33.307 INFO:teuthology.orchestra.run.smithi135.stdout:(121/131): openblas-threads-0.3.15-3.el8.x86_64 22 MB/s | 4.9 MB 00:00 2023-09-23T08:43:33.307 INFO:teuthology.orchestra.run.smithi161.stdout:(88/131): python3-scipy-1.0.0-21.module+el8.5.0 13 MB/s | 14 MB 00:01 2023-09-23T08:43:33.332 INFO:teuthology.orchestra.run.smithi161.stdout:(89/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 898 kB/s | 225 kB 00:00 2023-09-23T08:43:33.357 INFO:teuthology.orchestra.run.smithi161.stdout:(90/131): uuid-1.6.2-43.el8.x86_64.rpm 333 kB/s | 64 kB 00:00 2023-09-23T08:43:33.365 INFO:teuthology.orchestra.run.smithi135.stdout:(122/131): jq-1.6-3.el8.x86_64.rpm 3.4 MB/s | 202 kB 00:00 2023-09-23T08:43:33.383 INFO:teuthology.orchestra.run.smithi161.stdout:(91/131): python3-jsonpointer-1.10-11.el8.noarc 399 kB/s | 20 kB 00:00 2023-09-23T08:43:33.408 INFO:teuthology.orchestra.run.smithi161.stdout:(92/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.2 MB/s | 126 kB 00:00 2023-09-23T08:43:33.457 INFO:teuthology.orchestra.run.smithi135.stdout:(123/131): openblas-0.3.15-3.el8.x86_64.rpm 17 MB/s | 4.7 MB 00:00 2023-09-23T08:43:33.467 INFO:teuthology.orchestra.run.smithi161.stdout:(93/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 950 kB/s | 103 kB 00:00 2023-09-23T08:43:33.499 INFO:teuthology.orchestra.run.smithi135.stdout:(124/131): librdkafka-0.11.4-3.el8.x86_64.rpm 2.6 MB/s | 354 kB 00:00 2023-09-23T08:43:33.509 INFO:teuthology.orchestra.run.smithi161.stdout:(94/131): libtool-2.4.6-25.el8.x86_64.rpm 5.5 MB/s | 709 kB 00:00 2023-09-23T08:43:33.534 INFO:teuthology.orchestra.run.smithi161.stdout:(95/131): libpq-13.5-1.el8.x86_64.rpm 2.9 MB/s | 198 kB 00:00 2023-09-23T08:43:33.566 INFO:teuthology.orchestra.run.smithi135.stdout:(125/131): postgresql-contrib-10.21-2.module+el 12 MB/s | 808 kB 00:00 2023-09-23T08:43:33.584 INFO:teuthology.orchestra.run.smithi161.stdout:(96/131): jq-1.6-3.el8.x86_64.rpm 4.0 MB/s | 202 kB 00:00 2023-09-23T08:43:33.635 INFO:teuthology.orchestra.run.smithi161.stdout:(97/131): librdkafka-0.11.4-3.el8.x86_64.rpm 6.9 MB/s | 354 kB 00:00 2023-09-23T08:43:33.641 INFO:teuthology.orchestra.run.smithi135.stdout:(126/131): postgresql-10.21-2.module+el8.6.0+15 20 MB/s | 1.5 MB 00:00 2023-09-23T08:43:33.725 INFO:teuthology.orchestra.run.smithi135.stdout:(127/131): postgresql-server-10.21-2.module+el8 19 MB/s | 5.1 MB 00:00 2023-09-23T08:43:33.760 INFO:teuthology.orchestra.run.smithi161.stdout:(98/131): openblas-threads-0.3.15-3.el8.x86_64. 14 MB/s | 4.9 MB 00:00 2023-09-23T08:43:33.843 INFO:teuthology.orchestra.run.smithi161.stdout:(99/131): openblas-0.3.15-3.el8.x86_64.rpm 14 MB/s | 4.7 MB 00:00 2023-09-23T08:43:33.885 INFO:teuthology.orchestra.run.smithi161.stdout:(100/131): postgresql-contrib-10.21-2.module+el 6.3 MB/s | 808 kB 00:00 2023-09-23T08:43:33.957 INFO:teuthology.orchestra.run.smithi161.stdout:(101/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 656 kB/s | 47 kB 00:00 2023-09-23T08:43:34.011 INFO:teuthology.orchestra.run.smithi161.stdout:(102/131): postgresql-10.21-2.module+el8.6.0+15 9.0 MB/s | 1.5 MB 00:00 2023-09-23T08:43:34.036 INFO:teuthology.orchestra.run.smithi161.stdout:(103/131): libselinux-devel-2.9-5.el8.x86_64.rp 2.5 MB/s | 200 kB 00:00 2023-09-23T08:43:34.061 INFO:teuthology.orchestra.run.smithi161.stdout:(104/131): python3-jwt-1.6.1-2.el8.noarch.rpm 847 kB/s | 43 kB 00:00 2023-09-23T08:43:34.095 INFO:teuthology.orchestra.run.smithi161.stdout:(105/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 3.7 MB/s | 220 kB 00:00 2023-09-23T08:43:34.120 INFO:teuthology.orchestra.run.smithi161.stdout:(106/131): keyutils-libs-devel-1.5.10-9.el8.x86 824 kB/s | 48 kB 00:00 2023-09-23T08:43:34.145 INFO:teuthology.orchestra.run.smithi161.stdout:(107/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2023-09-23T08:43:34.171 INFO:teuthology.orchestra.run.smithi161.stdout:(108/131): python3-requests-oauthlib-1.0.0-1.el 850 kB/s | 43 kB 00:00 2023-09-23T08:43:34.188 INFO:teuthology.orchestra.run.smithi161.stdout:(109/131): python3-pycparser-2.14-14.el8.noarch 2.5 MB/s | 109 kB 00:00 2023-09-23T08:43:34.221 INFO:teuthology.orchestra.run.smithi161.stdout:(110/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 4.5 MB/s | 229 kB 00:00 2023-09-23T08:43:34.288 INFO:teuthology.orchestra.run.smithi161.stdout:(111/131): postgresql-server-10.21-2.module+el8 7.8 MB/s | 5.1 MB 00:00 2023-09-23T08:43:34.313 INFO:teuthology.orchestra.run.smithi161.stdout:(112/131): libaio-devel-0.3.112-1.el8.x86_64.rp 203 kB/s | 19 kB 00:00 2023-09-23T08:43:34.326 INFO:teuthology.orchestra.run.smithi135.stdout:(128/131): librbd1-18.0.0-5661.gdb9a2d12.el8.x8 6.0 MB/s | 3.6 MB 00:00 2023-09-23T08:43:34.339 INFO:teuthology.orchestra.run.smithi161.stdout:(113/131): python3-oauthlib-2.1.0-1.el8.noarch. 3.0 MB/s | 155 kB 00:00 2023-09-23T08:43:34.372 INFO:teuthology.orchestra.run.smithi161.stdout:(114/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 3.0 MB/s | 560 kB 00:00 2023-09-23T08:43:34.376 INFO:teuthology.orchestra.run.smithi135.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 16 MB/s | 798 kB 00:00 2023-09-23T08:43:34.398 INFO:teuthology.orchestra.run.smithi161.stdout:(115/131): libverto-devel-0.3.0-5.el8.x86_64.rp 305 kB/s | 18 kB 00:00 2023-09-23T08:43:34.460 INFO:teuthology.orchestra.run.smithi161.stdout:(116/131): python3-cryptography-3.2.1-5.el8.x86 3.7 MB/s | 559 kB 00:00 2023-09-23T08:43:34.499 INFO:teuthology.orchestra.run.smithi161.stdout:(117/131): pcre2-devel-10.32-2.el8.x86_64.rpm 4.7 MB/s | 605 kB 00:00 2023-09-23T08:43:34.524 INFO:teuthology.orchestra.run.smithi161.stdout:(118/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 1.8 MB/s | 238 kB 00:00 2023-09-23T08:43:34.549 INFO:teuthology.orchestra.run.smithi161.stdout:(119/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 1.4 MB/s | 72 kB 00:00 2023-09-23T08:43:34.574 INFO:teuthology.orchestra.run.smithi161.stdout:(120/131): fuse-2.9.7-15.el8.x86_64.rpm 1.6 MB/s | 83 kB 00:00 2023-09-23T08:43:34.600 INFO:teuthology.orchestra.run.smithi161.stdout:(121/131): elfutils-libelf-devel-0.186-1.el8.x8 1.2 MB/s | 60 kB 00:00 2023-09-23T08:43:34.618 INFO:teuthology.orchestra.run.smithi135.stdout:(130/131): librados2-18.0.0-5661.gdb9a2d12.el8. 3.8 MB/s | 3.7 MB 00:00 2023-09-23T08:43:34.625 INFO:teuthology.orchestra.run.smithi161.stdout:(122/131): libuuid-devel-2.32.1-35.el8.x86_64.r 1.9 MB/s | 98 kB 00:00 2023-09-23T08:43:34.650 INFO:teuthology.orchestra.run.smithi161.stdout:(123/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 1.1 MB/s | 58 kB 00:00 2023-09-23T08:43:34.675 INFO:teuthology.orchestra.run.smithi161.stdout:(124/131): libcom_err-devel-1.45.6-4.el8.x86_64 773 kB/s | 39 kB 00:00 2023-09-23T08:43:34.734 INFO:teuthology.orchestra.run.smithi161.stdout:(125/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 7.5 MB/s | 644 kB 00:00 2023-09-23T08:43:34.759 INFO:teuthology.orchestra.run.smithi161.stdout:(126/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 2.0 MB/s | 171 kB 00:00 2023-09-23T08:43:34.793 INFO:teuthology.orchestra.run.smithi161.stdout:(127/131): NetworkManager-initscripts-updown-1. 2.3 MB/s | 138 kB 00:00 2023-09-23T08:43:34.851 INFO:teuthology.orchestra.run.smithi161.stdout:(128/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 5.9 MB/s | 2.3 MB 00:00 2023-09-23T08:43:34.910 INFO:teuthology.orchestra.run.smithi161.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 13 MB/s | 798 kB 00:00 2023-09-23T08:43:35.235 INFO:teuthology.orchestra.run.smithi161.stdout:(130/131): librbd1-18.0.0-5661.gdb9a2d12.el8.x8 8.2 MB/s | 3.6 MB 00:00 2023-09-23T08:43:35.377 INFO:teuthology.orchestra.run.smithi161.stdout:(131/131): librados2-18.0.0-5661.gdb9a2d12.el8. 6.0 MB/s | 3.7 MB 00:00 2023-09-23T08:43:35.381 INFO:teuthology.orchestra.run.smithi161.stdout:-------------------------------------------------------------------------------- 2023-09-23T08:43:35.381 INFO:teuthology.orchestra.run.smithi161.stdout:Total 16 MB/s | 206 MB 00:13 2023-09-23T08:43:37.037 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction check 2023-09-23T08:43:37.063 INFO:teuthology.orchestra.run.smithi082.stdout:(131/131): ceph-test-18.0.0-5661.gdb9a2d12.el8. 2.8 MB/s | 48 MB 00:17 2023-09-23T08:43:37.066 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2023-09-23T08:43:37.067 INFO:teuthology.orchestra.run.smithi082.stdout:Total 10 MB/s | 206 MB 00:19 2023-09-23T08:43:37.172 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction check succeeded. 2023-09-23T08:43:37.173 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction test 2023-09-23T08:43:38.610 INFO:teuthology.orchestra.run.smithi135.stdout:(131/131): ceph-test-18.0.0-5661.gdb9a2d12.el8. 3.0 MB/s | 48 MB 00:16 2023-09-23T08:43:38.614 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2023-09-23T08:43:38.614 INFO:teuthology.orchestra.run.smithi135.stdout:Total 9.7 MB/s | 206 MB 00:21 2023-09-23T08:43:38.706 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2023-09-23T08:43:38.747 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction test succeeded. 2023-09-23T08:43:38.752 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction 2023-09-23T08:43:38.839 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2023-09-23T08:43:38.839 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2023-09-23T08:43:40.258 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2023-09-23T08:43:40.392 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2023-09-23T08:43:40.392 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2023-09-23T08:43:40.406 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2023-09-23T08:43:40.410 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2023-09-23T08:43:41.886 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2023-09-23T08:43:41.890 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2023-09-23T08:43:44.071 INFO:teuthology.orchestra.run.smithi161.stdout: Preparing : 1/1 2023-09-23T08:43:44.279 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-09-23T08:43:44.448 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-09-23T08:43:44.666 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-09-23T08:43:44.839 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-09-23T08:43:44.985 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-09-23T08:43:45.231 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-09-23T08:43:45.335 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2023-09-23T08:43:45.564 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-09-23T08:43:45.699 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-09-23T08:43:45.724 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-09-23T08:43:45.922 INFO:teuthology.orchestra.run.smithi161.stdout: Upgrading : librados2-2:18.0.0-5661.gdb9a2d12.el8.x86_64 6/134 2023-09-23T08:43:45.925 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-09-23T08:43:46.109 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-09-23T08:43:46.236 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-09-23T08:43:46.382 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: librados2-2:18.0.0-5661.gdb9a2d12.el8.x86_64 6/134 2023-09-23T08:43:46.465 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-09-23T08:43:46.572 INFO:teuthology.orchestra.run.smithi161.stdout: Upgrading : librbd1-2:18.0.0-5661.gdb9a2d12.el8.x86_64 7/134 2023-09-23T08:43:46.737 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: librbd1-2:18.0.0-5661.gdb9a2d12.el8.x86_64 7/134 2023-09-23T08:43:46.930 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libcephfs2-2:18.0.0-5661.gdb9a2d12.el8.x86_64 8/134 2023-09-23T08:43:46.932 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-09-23T08:43:47.038 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: libcephfs2-2:18.0.0-5661.gdb9a2d12.el8.x86_64 8/134 2023-09-23T08:43:47.148 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : librados2-2:18.0.0-5661.gdb9a2d12.el8.x86_64 6/134 2023-09-23T08:43:47.232 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2023-09-23T08:43:47.262 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-rados-2:18.0.0-5661.gdb9a2d12.el8.x86_64 9/134 2023-09-23T08:43:47.426 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-09-23T08:43:47.512 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-09-23T08:43:47.609 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librados2-2:18.0.0-5661.gdb9a2d12.el8.x86_64 6/134 2023-09-23T08:43:47.654 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-09-23T08:43:47.752 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-09-23T08:43:47.781 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : librbd1-2:18.0.0-5661.gdb9a2d12.el8.x86_64 7/134 2023-09-23T08:43:47.878 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 3/134 2023-09-23T08:43:47.945 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librbd1-2:18.0.0-5661.gdb9a2d12.el8.x86_64 7/134 2023-09-23T08:43:47.992 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 3/134 2023-09-23T08:43:48.106 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libcephfs2-2:18.0.0-5661.gdb9a2d12.el8.x86_64 8/134 2023-09-23T08:43:48.141 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-09-23T08:43:48.214 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libcephfs2-2:18.0.0-5661.gdb9a2d12.el8.x86_64 8/134 2023-09-23T08:43:48.260 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-09-23T08:43:48.403 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rados-2:18.0.0-5661.gdb9a2d12.el8.x86_64 9/134 2023-09-23T08:43:48.418 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-09-23T08:43:48.571 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libcephsqlite-2:18.0.0-5661.gdb9a2d12.el8.x86_64 14/134 2023-09-23T08:43:48.656 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-09-23T08:43:48.716 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-09-23T08:43:48.726 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: libcephsqlite-2:18.0.0-5661.gdb9a2d12.el8.x86_64 14/134 2023-09-23T08:43:48.862 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-09-23T08:43:48.880 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libradosstriper1-2:18.0.0-5661.gdb9a2d12.el8.x86 15/134 2023-09-23T08:43:48.951 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : librados2-2:18.0.0-5661.gdb9a2d12.el8.x86_64 5/134 2023-09-23T08:43:48.964 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: libradosstriper1-2:18.0.0-5661.gdb9a2d12.el8.x86 15/134 2023-09-23T08:43:49.080 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-09-23T08:43:49.287 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-09-23T08:43:49.315 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-09-23T08:43:49.410 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librados2-2:18.0.0-5661.gdb9a2d12.el8.x86_64 5/134 2023-09-23T08:43:49.455 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-09-23T08:43:49.584 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-09-23T08:43:49.610 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : librbd1-2:18.0.0-5661.gdb9a2d12.el8.x86_64 6/134 2023-09-23T08:43:49.739 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libcephsqlite-2:18.0.0-5661.gdb9a2d12.el8.x86_64 14/134 2023-09-23T08:43:49.764 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librbd1-2:18.0.0-5661.gdb9a2d12.el8.x86_64 6/134 2023-09-23T08:43:49.870 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libcephsqlite-2:18.0.0-5661.gdb9a2d12.el8.x86_64 14/134 2023-09-23T08:43:49.951 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libcephfs2-2:18.0.0-5661.gdb9a2d12.el8.x86_64 7/134 2023-09-23T08:43:50.031 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libradosstriper1-2:18.0.0-5661.gdb9a2d12.el8.x86 15/134 2023-09-23T08:43:50.098 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libcephfs2-2:18.0.0-5661.gdb9a2d12.el8.x86_64 7/134 2023-09-23T08:43:50.139 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-09-23T08:43:50.155 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libradosstriper1-2:18.0.0-5661.gdb9a2d12.el8.x86 15/134 2023-09-23T08:43:50.265 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rados-2:18.0.0-5661.gdb9a2d12.el8.x86_64 8/134 2023-09-23T08:43:50.338 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-09-23T08:43:50.439 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/134 2023-09-23T08:43:50.522 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-09-23T08:43:50.688 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-09-23T08:43:50.734 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-09-23T08:43:50.872 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-09-23T08:43:51.003 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-09-23T08:43:51.015 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-09-23T08:43:51.237 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-09-23T08:43:51.439 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-09-23T08:43:51.553 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-09-23T08:43:51.690 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-09-23T08:43:51.739 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-09-23T08:43:51.826 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libcephsqlite-2:18.0.0-5661.gdb9a2d12.el8.x86_64 14/134 2023-09-23T08:43:51.980 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libcephsqlite-2:18.0.0-5661.gdb9a2d12.el8.x86_64 14/134 2023-09-23T08:43:52.078 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-09-23T08:43:52.126 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libradosstriper1-2:18.0.0-5661.gdb9a2d12.el8.x86 15/134 2023-09-23T08:43:52.298 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libradosstriper1-2:18.0.0-5661.gdb9a2d12.el8.x86 15/134 2023-09-23T08:43:52.396 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-09-23T08:43:52.419 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-09-23T08:43:52.541 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 16/134 2023-09-23T08:43:52.639 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-09-23T08:43:52.646 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-09-23T08:43:52.727 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 17/134 2023-09-23T08:43:52.903 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-09-23T08:43:52.952 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 18/134 2023-09-23T08:43:53.092 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-09-23T08:43:53.097 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-09-23T08:43:53.267 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-09-23T08:43:53.348 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-09-23T08:43:53.451 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-09-23T08:43:53.473 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-09-23T08:43:53.592 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-09-23T08:43:53.763 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-09-23T08:43:53.795 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-ceph-common-2:18.0.0-5661.gdb9a2d12.el8. 26/134 2023-09-23T08:43:53.942 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-ceph-argparse-2:18.0.0-5661.gdb9a2d12.el 27/134 2023-09-23T08:43:54.005 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-09-23T08:43:54.155 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-09-23T08:43:54.245 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-09-23T08:43:54.350 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-09-23T08:43:54.447 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-09-23T08:43:54.690 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-09-23T08:43:54.954 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-cephfs-2:18.0.0-5661.gdb9a2d12.el8.x86_6 28/134 2023-09-23T08:43:55.008 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-09-23T08:43:55.035 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-09-23T08:43:55.178 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-ceph-common-2:18.0.0-5661.gdb9a2d12.el8. 26/134 2023-09-23T08:43:55.250 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : openblas-0.3.15-3.el8.x86_64 22/134 2023-09-23T08:43:55.309 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-ceph-argparse-2:18.0.0-5661.gdb9a2d12.el 27/134 2023-09-23T08:43:55.325 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-09-23T08:43:55.594 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-09-23T08:43:55.896 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-09-23T08:43:56.078 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 22/134 2023-09-23T08:43:56.095 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-09-23T08:43:56.359 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cephfs-2:18.0.0-5661.gdb9a2d12.el8.x86_6 28/134 2023-09-23T08:43:56.383 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/134 2023-09-23T08:43:56.585 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 24/134 2023-09-23T08:43:56.743 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-09-23T08:43:56.888 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-09-23T08:43:56.994 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-09-23T08:43:57.066 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-ceph-common-2:18.0.0-5661.gdb9a2d12.el8. 26/134 2023-09-23T08:43:57.247 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-ceph-argparse-2:18.0.0-5661.gdb9a2d12.el 27/134 2023-09-23T08:43:57.300 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-09-23T08:43:57.486 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cephfs-2:18.0.0-5661.gdb9a2d12.el8.x86_6 28/134 2023-09-23T08:43:57.496 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-09-23T08:43:57.733 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-09-23T08:43:58.161 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-09-23T08:43:58.511 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-09-23T08:43:58.723 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-09-23T08:43:58.967 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-09-23T08:43:59.161 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-rbd-2:18.0.0-5661.gdb9a2d12.el8.x86_64 36/134 2023-09-23T08:43:59.391 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : librados-devel-2:18.0.0-5661.gdb9a2d12.el8.x86_6 37/134 2023-09-23T08:43:59.554 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-09-23T08:43:59.575 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-09-23T08:43:59.748 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-09-23T08:43:59.791 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-09-23T08:43:59.903 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-09-23T08:43:59.973 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-09-23T08:44:00.125 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-09-23T08:44:00.140 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-09-23T08:44:00.340 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-09-23T08:44:00.342 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-09-23T08:44:00.561 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rbd-2:18.0.0-5661.gdb9a2d12.el8.x86_64 36/134 2023-09-23T08:44:00.565 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-09-23T08:44:00.767 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librados-devel-2:18.0.0-5661.gdb9a2d12.el8.x86_6 37/134 2023-09-23T08:44:00.912 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-09-23T08:44:00.949 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 30/134 2023-09-23T08:44:00.949 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-09-23T08:44:01.114 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-09-23T08:44:01.260 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-09-23T08:44:01.296 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/134 2023-09-23T08:44:01.314 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-09-23T08:44:01.468 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-09-23T08:44:01.476 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-09-23T08:44:01.581 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/134 2023-09-23T08:44:01.705 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-09-23T08:44:01.727 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-09-23T08:44:01.842 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/134 2023-09-23T08:44:01.952 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-09-23T08:44:01.980 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-09-23T08:44:02.053 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-09-23T08:44:02.270 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-09-23T08:44:02.303 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-09-23T08:44:02.346 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-09-23T08:44:02.465 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rbd-2:18.0.0-5661.gdb9a2d12.el8.x86_64 36/134 2023-09-23T08:44:02.571 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-09-23T08:44:02.644 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-09-23T08:44:02.658 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librados-devel-2:18.0.0-5661.gdb9a2d12.el8.x86_6 37/134 2023-09-23T08:44:02.752 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-09-23T08:44:02.842 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 38/134 2023-09-23T08:44:02.867 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-09-23T08:44:02.988 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-09-23T08:44:03.003 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 39/134 2023-09-23T08:44:03.105 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-09-23T08:44:03.176 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-09-23T08:44:03.233 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : uuid-1.6.2-43.el8.x86_64 40/134 2023-09-23T08:44:03.325 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 40/134 2023-09-23T08:44:03.329 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-09-23T08:44:03.341 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-09-23T08:44:03.581 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 41/134 2023-09-23T08:44:03.669 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-09-23T08:44:03.677 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-09-23T08:44:03.805 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : automake-1.16.1-7.el8.noarch 42/134 2023-09-23T08:44:03.888 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-09-23T08:44:03.957 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 43/134 2023-09-23T08:44:03.964 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-09-23T08:44:04.062 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 43/134 2023-09-23T08:44:04.098 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-09-23T08:44:04.251 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-09-23T08:44:04.314 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-09-23T08:44:04.334 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : jq-1.6-3.el8.x86_64 44/134 2023-09-23T08:44:04.477 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-09-23T08:44:04.485 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-09-23T08:44:04.520 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 45/134 2023-09-23T08:44:04.667 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-09-23T08:44:04.678 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-09-23T08:44:04.733 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 46/134 2023-09-23T08:44:04.864 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-09-23T08:44:04.935 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 47/134 2023-09-23T08:44:05.000 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-09-23T08:44:05.052 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-09-23T08:44:05.140 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-09-23T08:44:05.177 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : fuse-2.9.7-15.el8.x86_64 48/134 2023-09-23T08:44:05.314 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-09-23T08:44:05.338 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 49/134 2023-09-23T08:44:05.396 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-09-23T08:44:05.544 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 50/134 2023-09-23T08:44:05.600 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-09-23T08:44:05.633 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-09-23T08:44:05.762 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 51/134 2023-09-23T08:44:05.777 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-09-23T08:44:05.844 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-09-23T08:44:05.877 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-09-23T08:44:06.028 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-09-23T08:44:06.118 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-09-23T08:44:06.198 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 52/134 2023-09-23T08:44:06.231 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-09-23T08:44:06.271 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-09-23T08:44:06.435 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-09-23T08:44:06.454 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-09-23T08:44:06.531 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-09-23T08:44:06.548 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 53/134 2023-09-23T08:44:06.676 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-09-23T08:44:06.776 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-09-23T08:44:06.789 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 54/134 2023-09-23T08:44:06.977 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-09-23T08:44:07.016 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-09-23T08:44:07.069 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 55/134 2023-09-23T08:44:07.177 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-09-23T08:44:07.227 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-09-23T08:44:07.268 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-09-23T08:44:07.317 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 56/134 2023-09-23T08:44:07.382 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-09-23T08:44:07.510 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-09-23T08:44:07.549 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-09-23T08:44:07.658 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 57/134 2023-09-23T08:44:07.671 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-09-23T08:44:07.802 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-09-23T08:44:07.846 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-09-23T08:44:07.884 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 58/134 2023-09-23T08:44:08.011 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-09-23T08:44:08.071 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-09-23T08:44:08.102 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 59/134 2023-09-23T08:44:08.227 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-09-23T08:44:08.317 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 60/134 2023-09-23T08:44:08.366 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-09-23T08:44:08.406 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-09-23T08:44:08.551 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-09-23T08:44:08.556 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 61/134 2023-09-23T08:44:08.636 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-09-23T08:44:08.721 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 62/134 2023-09-23T08:44:08.766 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-09-23T08:44:08.802 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-09-23T08:44:08.925 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-09-23T08:44:09.034 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-09-23T08:44:09.087 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 63/134 2023-09-23T08:44:09.110 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-09-23T08:44:09.260 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-09-23T08:44:09.329 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-09-23T08:44:09.510 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-09-23T08:44:09.527 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-09-23T08:44:09.680 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-09-23T08:44:09.753 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-09-23T08:44:09.794 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 64/134 2023-09-23T08:44:09.884 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-09-23T08:44:09.938 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-09-23T08:44:10.114 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/134 2023-09-23T08:44:10.118 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-09-23T08:44:10.222 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-09-23T08:44:10.359 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-09-23T08:44:10.376 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 66/134 2023-09-23T08:44:10.542 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-09-23T08:44:10.550 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-09-23T08:44:10.715 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-09-23T08:44:10.883 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-09-23T08:44:11.017 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-09-23T08:44:11.102 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-09-23T08:44:11.231 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-09-23T08:44:11.287 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-09-23T08:44:11.420 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-09-23T08:44:11.544 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-09-23T08:44:11.570 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-09-23T08:44:11.595 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-09-23T08:44:11.849 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-09-23T08:44:11.855 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-09-23T08:44:12.065 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-09-23T08:44:12.115 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-09-23T08:44:12.306 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-09-23T08:44:12.494 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-09-23T08:44:12.510 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-09-23T08:44:12.656 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-09-23T08:44:12.836 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-09-23T08:44:12.871 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-09-23T08:44:12.916 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-09-23T08:44:13.048 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-09-23T08:44:13.146 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-09-23T08:44:13.162 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-09-23T08:44:13.380 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-09-23T08:44:13.456 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-09-23T08:44:13.657 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-09-23T08:44:13.821 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-09-23T08:44:13.874 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-09-23T08:44:13.935 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-09-23T08:44:14.050 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-09-23T08:44:14.100 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-09-23T08:44:14.101 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : librgw2-2:18.0.0-5661.gdb9a2d12.el8.x86_64 92/134 2023-09-23T08:44:14.220 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: librgw2-2:18.0.0-5661.gdb9a2d12.el8.x86_64 92/134 2023-09-23T08:44:14.314 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-09-23T08:44:14.324 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-09-23T08:44:14.393 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-rgw-2:18.0.0-5661.gdb9a2d12.el8.x86_64 93/134 2023-09-23T08:44:15.180 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-09-23T08:44:15.367 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librgw2-2:18.0.0-5661.gdb9a2d12.el8.x86_64 92/134 2023-09-23T08:44:15.469 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librgw2-2:18.0.0-5661.gdb9a2d12.el8.x86_64 92/134 2023-09-23T08:44:15.649 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-09-23T08:44:15.684 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rgw-2:18.0.0-5661.gdb9a2d12.el8.x86_64 93/134 2023-09-23T08:44:15.934 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-09-23T08:44:16.228 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-09-23T08:44:16.647 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-09-23T08:44:16.981 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-09-23T08:44:17.206 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-09-23T08:44:18.106 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-09-23T08:44:18.280 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librgw2-2:18.0.0-5661.gdb9a2d12.el8.x86_64 92/134 2023-09-23T08:44:18.411 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librgw2-2:18.0.0-5661.gdb9a2d12.el8.x86_64 92/134 2023-09-23T08:44:18.597 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rgw-2:18.0.0-5661.gdb9a2d12.el8.x86_64 93/134 2023-09-23T08:44:19.344 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-common-2:18.0.0-5661.gdb9a2d12.el8.x86_64 94/134 2023-09-23T08:44:19.567 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-common-2:18.0.0-5661.gdb9a2d12.el8.x86_64 94/134 2023-09-23T08:44:20.274 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-common-2:18.0.0-5661.gdb9a2d12.el8.x86_64 94/134 2023-09-23T08:44:20.558 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-base-2:18.0.0-5661.gdb9a2d12.el8.x86_64 95/134 2023-09-23T08:44:20.561 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-common-2:18.0.0-5661.gdb9a2d12.el8.x86_64 94/134 2023-09-23T08:44:20.704 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-base-2:18.0.0-5661.gdb9a2d12.el8.x86_64 95/134 2023-09-23T08:44:20.783 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-common-2:18.0.0-5661.gdb9a2d12.el8.x86_64 94/134 2023-09-23T08:44:20.883 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-selinux-2:18.0.0-5661.gdb9a2d12.el8.x86_64 96/134 2023-09-23T08:44:21.969 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-common-2:18.0.0-5661.gdb9a2d12.el8.x86_64 94/134 2023-09-23T08:44:22.243 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-base-2:18.0.0-5661.gdb9a2d12.el8.x86_64 95/134 2023-09-23T08:44:22.386 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-base-2:18.0.0-5661.gdb9a2d12.el8.x86_64 95/134 2023-09-23T08:44:22.557 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-selinux-2:18.0.0-5661.gdb9a2d12.el8.x86_64 96/134 2023-09-23T08:44:23.661 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-common-2:18.0.0-5661.gdb9a2d12.el8.x86_64 94/134 2023-09-23T08:44:23.864 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-common-2:18.0.0-5661.gdb9a2d12.el8.x86_64 94/134 2023-09-23T08:44:24.545 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-common-2:18.0.0-5661.gdb9a2d12.el8.x86_64 94/134 2023-09-23T08:44:24.840 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-base-2:18.0.0-5661.gdb9a2d12.el8.x86_64 95/134 2023-09-23T08:44:25.003 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-base-2:18.0.0-5661.gdb9a2d12.el8.x86_64 95/134 2023-09-23T08:44:26.030 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-selinux-2:18.0.0-5661.gdb9a2d12.el8.x86_64 96/134 2023-09-23T08:44:41.294 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-selinux-2:18.0.0-5661.gdb9a2d12.el8.x86_64 96/134 2023-09-23T08:44:41.294 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /sys 2023-09-23T08:44:41.295 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /proc 2023-09-23T08:44:41.295 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /dev 2023-09-23T08:44:41.295 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /run 2023-09-23T08:44:41.295 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /mnt 2023-09-23T08:44:41.295 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /var/tmp 2023-09-23T08:44:41.295 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /home 2023-09-23T08:44:41.295 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /tmp 2023-09-23T08:44:41.295 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /dev 2023-09-23T08:44:41.295 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-09-23T08:44:41.714 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-volume-2:18.0.0-5661.gdb9a2d12.el8.noarch 97/134 2023-09-23T08:44:42.997 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-selinux-2:18.0.0-5661.gdb9a2d12.el8.x86_64 96/134 2023-09-23T08:44:42.997 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /sys 2023-09-23T08:44:42.997 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /proc 2023-09-23T08:44:42.997 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /dev 2023-09-23T08:44:42.998 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /run 2023-09-23T08:44:42.998 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /mnt 2023-09-23T08:44:42.998 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /var/tmp 2023-09-23T08:44:42.998 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /home 2023-09-23T08:44:42.998 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /tmp 2023-09-23T08:44:42.998 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /dev 2023-09-23T08:44:42.998 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:44:43.361 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-volume-2:18.0.0-5661.gdb9a2d12.el8.noarch 97/134 2023-09-23T08:44:43.462 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-volume-2:18.0.0-5661.gdb9a2d12.el8.noarch 97/134 2023-09-23T08:44:43.654 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-osd-2:18.0.0-5661.gdb9a2d12.el8.x86_64 98/134 2023-09-23T08:44:43.923 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-osd-2:18.0.0-5661.gdb9a2d12.el8.x86_64 98/134 2023-09-23T08:44:44.130 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mds-2:18.0.0-5661.gdb9a2d12.el8.x86_64 99/134 2023-09-23T08:44:44.657 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-mds-2:18.0.0-5661.gdb9a2d12.el8.x86_64 99/134 2023-09-23T08:44:44.855 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mon-2:18.0.0-5661.gdb9a2d12.el8.x86_64 100/134 2023-09-23T08:44:44.916 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-mon-2:18.0.0-5661.gdb9a2d12.el8.x86_64 100/134 2023-09-23T08:44:45.097 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-volume-2:18.0.0-5661.gdb9a2d12.el8.noarch 97/134 2023-09-23T08:44:45.313 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-osd-2:18.0.0-5661.gdb9a2d12.el8.x86_64 98/134 2023-09-23T08:44:45.582 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-osd-2:18.0.0-5661.gdb9a2d12.el8.x86_64 98/134 2023-09-23T08:44:45.769 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mds-2:18.0.0-5661.gdb9a2d12.el8.x86_64 99/134 2023-09-23T08:44:46.293 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mds-2:18.0.0-5661.gdb9a2d12.el8.x86_64 99/134 2023-09-23T08:44:46.392 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-selinux-2:18.0.0-5661.gdb9a2d12.el8.x86_64 96/134 2023-09-23T08:44:46.392 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /sys 2023-09-23T08:44:46.392 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /proc 2023-09-23T08:44:46.393 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /dev 2023-09-23T08:44:46.393 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /run 2023-09-23T08:44:46.393 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /mnt 2023-09-23T08:44:46.393 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /var/tmp 2023-09-23T08:44:46.393 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /home 2023-09-23T08:44:46.393 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /tmp 2023-09-23T08:44:46.393 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /dev 2023-09-23T08:44:46.393 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-09-23T08:44:46.510 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mon-2:18.0.0-5661.gdb9a2d12.el8.x86_64 100/134 2023-09-23T08:44:46.552 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mon-2:18.0.0-5661.gdb9a2d12.el8.x86_64 100/134 2023-09-23T08:44:46.793 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-volume-2:18.0.0-5661.gdb9a2d12.el8.noarch 97/134 2023-09-23T08:44:47.668 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: cephadm-2:18.0.0-5661.gdb9a2d12.el8.noarch 101/134 2023-09-23T08:44:47.857 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : cephadm-2:18.0.0-5661.gdb9a2d12.el8.noarch 101/134 2023-09-23T08:44:47.979 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-5661.gdb9a2d12.e 102/134 2023-09-23T08:44:48.211 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-5661.gdb9a2d12. 103/134 2023-09-23T08:44:48.396 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-5661.gdb9a2d12.el8.noa 104/134 2023-09-23T08:44:48.531 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-volume-2:18.0.0-5661.gdb9a2d12.el8.noarch 97/134 2023-09-23T08:44:48.668 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-5661.gdb9a2d12.el8.noa 104/134 2023-09-23T08:44:48.752 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-osd-2:18.0.0-5661.gdb9a2d12.el8.x86_64 98/134 2023-09-23T08:44:48.878 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-5661.gdb9a2d12.el8.n 105/134 2023-09-23T08:44:49.021 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-osd-2:18.0.0-5661.gdb9a2d12.el8.x86_64 98/134 2023-09-23T08:44:49.243 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mds-2:18.0.0-5661.gdb9a2d12.el8.x86_64 99/134 2023-09-23T08:44:49.264 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: cephadm-2:18.0.0-5661.gdb9a2d12.el8.noarch 101/134 2023-09-23T08:44:49.459 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : cephadm-2:18.0.0-5661.gdb9a2d12.el8.noarch 101/134 2023-09-23T08:44:49.573 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-5661.gdb9a2d12.e 102/134 2023-09-23T08:44:49.769 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mds-2:18.0.0-5661.gdb9a2d12.el8.x86_64 99/134 2023-09-23T08:44:49.827 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-5661.gdb9a2d12. 103/134 2023-09-23T08:44:49.990 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-5661.gdb9a2d12.el8.n 105/134 2023-09-23T08:44:50.026 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mon-2:18.0.0-5661.gdb9a2d12.el8.x86_64 100/134 2023-09-23T08:44:50.034 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-5661.gdb9a2d12.el8.noa 104/134 2023-09-23T08:44:50.068 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mon-2:18.0.0-5661.gdb9a2d12.el8.x86_64 100/134 2023-09-23T08:44:50.212 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-5661.gdb9 106/134 2023-09-23T08:44:50.321 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-5661.gdb9a2d12.el8.noa 104/134 2023-09-23T08:44:50.340 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-5661.gdb9 106/134 2023-09-23T08:44:50.520 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-5661.gdb9a2d12.el8.n 105/134 2023-09-23T08:44:50.697 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-5661.gdb9a2d12.el 107/134 2023-09-23T08:44:50.954 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mgr-2:18.0.0-5661.gdb9a2d12.el8.x86_64 108/134 2023-09-23T08:44:51.020 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-mgr-2:18.0.0-5661.gdb9a2d12.el8.x86_64 108/134 2023-09-23T08:44:51.228 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mgr-rook-2:18.0.0-5661.gdb9a2d12.el8.noarch 109/134 2023-09-23T08:44:51.257 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-5661.gdb9a2d12.el8.noarch 109/134 2023-09-23T08:44:51.620 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-5661.gdb9a2d12.el8.n 105/134 2023-09-23T08:44:51.808 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-5661.gdb9 106/134 2023-09-23T08:44:51.938 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-5661.gdb9 106/134 2023-09-23T08:44:52.319 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-5661.gdb9a2d12.el 107/134 2023-09-23T08:44:52.532 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-2:18.0.0-5661.gdb9a2d12.el8.x86_64 108/134 2023-09-23T08:44:52.597 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-2:18.0.0-5661.gdb9a2d12.el8.x86_64 108/134 2023-09-23T08:44:52.668 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-2:18.0.0-5661.gdb9a2d12.el8.x86_64 110/134 2023-09-23T08:44:52.800 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-rook-2:18.0.0-5661.gdb9a2d12.el8.noarch 109/134 2023-09-23T08:44:52.828 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-5661.gdb9a2d12.el8.noarch 109/134 2023-09-23T08:44:52.833 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: cephadm-2:18.0.0-5661.gdb9a2d12.el8.noarch 101/134 2023-09-23T08:44:52.897 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-radosgw-2:18.0.0-5661.gdb9a2d12.el8.x86_64 111/134 2023-09-23T08:44:52.959 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-5661.gdb9a2d12.el8.x86_64 111/134 2023-09-23T08:44:53.022 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : cephadm-2:18.0.0-5661.gdb9a2d12.el8.noarch 101/134 2023-09-23T08:44:53.137 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-5661.gdb9a2 112/134 2023-09-23T08:44:53.158 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-5661.gdb9a2d12.e 102/134 2023-09-23T08:44:53.216 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-5661.gdb9a2 112/134 2023-09-23T08:44:53.378 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : cephfs-mirror-2:18.0.0-5661.gdb9a2d12.el8.x86_64 113/134 2023-09-23T08:44:53.407 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-5661.gdb9a2d12. 103/134 2023-09-23T08:44:53.625 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-5661.gdb9a2d12.el8.noa 104/134 2023-09-23T08:44:53.806 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-5661.gdb9a2d12.el8.x86_64 113/134 2023-09-23T08:44:53.890 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-5661.gdb9a2d12.el8.noa 104/134 2023-09-23T08:44:53.970 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : rbd-mirror-2:18.0.0-5661.gdb9a2d12.el8.x86_64 114/134 2023-09-23T08:44:54.093 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-5661.gdb9a2d12.el8.n 105/134 2023-09-23T08:44:54.228 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-2:18.0.0-5661.gdb9a2d12.el8.x86_64 110/134 2023-09-23T08:44:54.478 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-radosgw-2:18.0.0-5661.gdb9a2d12.el8.x86_64 111/134 2023-09-23T08:44:54.540 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-5661.gdb9a2d12.el8.x86_64 111/134 2023-09-23T08:44:54.700 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-5661.gdb9a2 112/134 2023-09-23T08:44:54.779 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-5661.gdb9a2 112/134 2023-09-23T08:44:54.958 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : cephfs-mirror-2:18.0.0-5661.gdb9a2d12.el8.x86_64 113/134 2023-09-23T08:44:55.196 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-5661.gdb9a2d12.el8.n 105/134 2023-09-23T08:44:55.374 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-5661.gdb9a2d12.el8.x86_64 113/134 2023-09-23T08:44:55.408 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-5661.gdb9 106/134 2023-09-23T08:44:55.525 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : rbd-mirror-2:18.0.0-5661.gdb9a2d12.el8.x86_64 114/134 2023-09-23T08:44:55.536 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-5661.gdb9 106/134 2023-09-23T08:44:55.930 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-5661.gdb9a2d12.el 107/134 2023-09-23T08:44:56.190 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-2:18.0.0-5661.gdb9a2d12.el8.x86_64 108/134 2023-09-23T08:44:56.255 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-2:18.0.0-5661.gdb9a2d12.el8.x86_64 108/134 2023-09-23T08:44:56.458 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-rook-2:18.0.0-5661.gdb9a2d12.el8.noarch 109/134 2023-09-23T08:44:56.486 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-5661.gdb9a2d12.el8.noarch 109/134 2023-09-23T08:44:57.911 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-2:18.0.0-5661.gdb9a2d12.el8.x86_64 110/134 2023-09-23T08:44:58.136 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-radosgw-2:18.0.0-5661.gdb9a2d12.el8.x86_64 111/134 2023-09-23T08:44:58.198 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-5661.gdb9a2d12.el8.x86_64 111/134 2023-09-23T08:44:58.416 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-5661.gdb9a2 112/134 2023-09-23T08:44:58.492 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-5661.gdb9a2 112/134 2023-09-23T08:44:58.666 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : cephfs-mirror-2:18.0.0-5661.gdb9a2d12.el8.x86_64 113/134 2023-09-23T08:44:59.022 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: rbd-mirror-2:18.0.0-5661.gdb9a2d12.el8.x86_64 114/134 2023-09-23T08:44:59.083 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-5661.gdb9a2d12.el8.x86_64 113/134 2023-09-23T08:44:59.233 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : rbd-mirror-2:18.0.0-5661.gdb9a2d12.el8.x86_64 114/134 2023-09-23T08:44:59.390 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-test-2:18.0.0-5661.gdb9a2d12.el8.x86_64 115/134 2023-09-23T08:44:59.577 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-09-23T08:44:59.844 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-09-23T08:45:00.530 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: rbd-mirror-2:18.0.0-5661.gdb9a2d12.el8.x86_64 114/134 2023-09-23T08:45:00.835 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-test-2:18.0.0-5661.gdb9a2d12.el8.x86_64 115/134 2023-09-23T08:45:00.998 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-09-23T08:45:01.106 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-09-23T08:45:01.260 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-09-23T08:45:01.475 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-09-23T08:45:01.666 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-fuse-2:18.0.0-5661.gdb9a2d12.el8.x86_64 119/134 2023-09-23T08:45:01.890 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-09-23T08:45:02.057 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libcephfs-devel-2:18.0.0-5661.gdb9a2d12.el8.x86_ 121/134 2023-09-23T08:45:02.195 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-09-23T08:45:02.518 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-09-23T08:45:02.838 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-09-23T08:45:03.037 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-fuse-2:18.0.0-5661.gdb9a2d12.el8.x86_64 119/134 2023-09-23T08:45:03.261 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-09-23T08:45:03.461 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libcephfs-devel-2:18.0.0-5661.gdb9a2d12.el8.x86_ 121/134 2023-09-23T08:45:03.599 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-09-23T08:45:04.234 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: rbd-mirror-2:18.0.0-5661.gdb9a2d12.el8.x86_64 114/134 2023-09-23T08:45:05.513 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-test-2:18.0.0-5661.gdb9a2d12.el8.x86_64 115/134 2023-09-23T08:45:05.583 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-09-23T08:45:05.878 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-09-23T08:45:05.917 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-09-23T08:45:05.923 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 116/134 2023-09-23T08:45:06.138 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-fuse-2:18.0.0-5661.gdb9a2d12.el8.x86_64 117/134 2023-09-23T08:45:06.161 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : cephfs-top-2:18.0.0-5661.gdb9a2d12.el8.noarch 124/134 2023-09-23T08:45:06.377 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : rbd-fuse-2:18.0.0-5661.gdb9a2d12.el8.x86_64 125/134 2023-09-23T08:45:06.412 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 118/134 2023-09-23T08:45:06.590 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/134 2023-09-23T08:45:06.706 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : rbd-nbd-2:18.0.0-5661.gdb9a2d12.el8.x86_64 126/134 2023-09-23T08:45:06.845 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/134 2023-09-23T08:45:06.986 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-09-23T08:45:07.037 INFO:teuthology.orchestra.run.smithi161.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-09-23T08:45:07.112 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 120/134 2023-09-23T08:45:07.226 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-09-23T08:45:07.249 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-09-23T08:45:07.264 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-09-23T08:45:07.302 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-09-23T08:45:07.362 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libcephfs-devel-2:18.0.0-5661.gdb9a2d12.el8.x86_ 121/134 2023-09-23T08:45:07.484 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-09-23T08:45:07.524 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-09-23T08:45:07.531 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : cephfs-top-2:18.0.0-5661.gdb9a2d12.el8.noarch 124/134 2023-09-23T08:45:07.651 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-09-23T08:45:07.756 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-09-23T08:45:07.773 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : rbd-fuse-2:18.0.0-5661.gdb9a2d12.el8.x86_64 125/134 2023-09-23T08:45:08.001 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-09-23T08:45:08.029 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-09-23T08:45:08.029 INFO:teuthology.orchestra.run.smithi161.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-09-23T08:45:08.089 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : rbd-nbd-2:18.0.0-5661.gdb9a2d12.el8.x86_64 126/134 2023-09-23T08:45:08.249 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-09-23T08:45:08.249 INFO:teuthology.orchestra.run.smithi161.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-09-23T08:45:08.424 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-09-23T08:45:08.533 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-09-23T08:45:08.597 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-09-23T08:45:08.619 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-09-23T08:45:08.726 INFO:teuthology.orchestra.run.smithi161.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-09-23T08:45:08.826 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-09-23T08:45:08.985 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-09-23T08:45:08.985 INFO:teuthology.orchestra.run.smithi161.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-09-23T08:45:08.985 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-09-23T08:45:09.038 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-09-23T08:45:09.146 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-09-23T08:45:09.321 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-09-23T08:45:09.349 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-09-23T08:45:09.349 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-09-23T08:45:09.586 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-09-23T08:45:09.586 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-09-23T08:45:09.617 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-2:18.0.0-5661.gdb9a2d12.el8.x86_64 1/134 2023-09-23T08:45:09.617 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-base-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2/134 2023-09-23T08:45:09.617 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-common-2:18.0.0-5661.gdb9a2d12.el8.x86_64 3/134 2023-09-23T08:45:09.617 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-fuse-2:18.0.0-5661.gdb9a2d12.el8.x86_64 4/134 2023-09-23T08:45:09.617 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-5661.gdb9a2 5/134 2023-09-23T08:45:09.617 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mds-2:18.0.0-5661.gdb9a2d12.el8.x86_64 6/134 2023-09-23T08:45:09.617 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mgr-2:18.0.0-5661.gdb9a2d12.el8.x86_64 7/134 2023-09-23T08:45:09.618 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mon-2:18.0.0-5661.gdb9a2d12.el8.x86_64 8/134 2023-09-23T08:45:09.618 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-osd-2:18.0.0-5661.gdb9a2d12.el8.x86_64 9/134 2023-09-23T08:45:09.618 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-radosgw-2:18.0.0-5661.gdb9a2d12.el8.x86_64 10/134 2023-09-23T08:45:09.618 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-selinux-2:18.0.0-5661.gdb9a2d12.el8.x86_64 11/134 2023-09-23T08:45:09.618 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-test-2:18.0.0-5661.gdb9a2d12.el8.x86_64 12/134 2023-09-23T08:45:09.618 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : cephfs-mirror-2:18.0.0-5661.gdb9a2d12.el8.x86_64 13/134 2023-09-23T08:45:09.618 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libcephfs-devel-2:18.0.0-5661.gdb9a2d12.el8.x86_ 14/134 2023-09-23T08:45:09.618 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libcephfs2-2:18.0.0-5661.gdb9a2d12.el8.x86_64 15/134 2023-09-23T08:45:09.618 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libcephsqlite-2:18.0.0-5661.gdb9a2d12.el8.x86_64 16/134 2023-09-23T08:45:09.618 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librados-devel-2:18.0.0-5661.gdb9a2d12.el8.x86_6 17/134 2023-09-23T08:45:09.618 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libradosstriper1-2:18.0.0-5661.gdb9a2d12.el8.x86 18/134 2023-09-23T08:45:09.619 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librgw2-2:18.0.0-5661.gdb9a2d12.el8.x86_64 19/134 2023-09-23T08:45:09.619 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-ceph-argparse-2:18.0.0-5661.gdb9a2d12.el 20/134 2023-09-23T08:45:09.619 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-ceph-common-2:18.0.0-5661.gdb9a2d12.el8. 21/134 2023-09-23T08:45:09.619 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-cephfs-2:18.0.0-5661.gdb9a2d12.el8.x86_6 22/134 2023-09-23T08:45:09.619 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-rados-2:18.0.0-5661.gdb9a2d12.el8.x86_64 23/134 2023-09-23T08:45:09.619 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-rbd-2:18.0.0-5661.gdb9a2d12.el8.x86_64 24/134 2023-09-23T08:45:09.619 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-rgw-2:18.0.0-5661.gdb9a2d12.el8.x86_64 25/134 2023-09-23T08:45:09.628 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : rbd-fuse-2:18.0.0-5661.gdb9a2d12.el8.x86_64 26/134 2023-09-23T08:45:09.628 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : rbd-mirror-2:18.0.0-5661.gdb9a2d12.el8.x86_64 27/134 2023-09-23T08:45:09.628 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : rbd-nbd-2:18.0.0-5661.gdb9a2d12.el8.x86_64 28/134 2023-09-23T08:45:09.628 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-5661.gdb9a2d12. 29/134 2023-09-23T08:45:09.628 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-5661.gdb9a2d12.el8.noa 30/134 2023-09-23T08:45:09.628 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-5661.gdb9a2d12.el8.n 31/134 2023-09-23T08:45:09.628 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-5661.gdb9 32/134 2023-09-23T08:45:09.628 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-5661.gdb9a2d12.el 33/134 2023-09-23T08:45:09.629 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mgr-rook-2:18.0.0-5661.gdb9a2d12.el8.noarch 34/134 2023-09-23T08:45:09.629 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-5661.gdb9a2d12.e 35/134 2023-09-23T08:45:09.629 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-volume-2:18.0.0-5661.gdb9a2d12.el8.noarch 36/134 2023-09-23T08:45:09.629 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : cephadm-2:18.0.0-5661.gdb9a2d12.el8.noarch 37/134 2023-09-23T08:45:09.629 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : cephfs-top-2:18.0.0-5661.gdb9a2d12.el8.noarch 38/134 2023-09-23T08:45:09.629 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-09-23T08:45:09.629 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-09-23T08:45:09.629 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-09-23T08:45:09.629 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-09-23T08:45:09.629 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-09-23T08:45:09.629 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-09-23T08:45:09.630 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-09-23T08:45:09.630 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-09-23T08:45:09.630 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-09-23T08:45:09.630 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-09-23T08:45:09.630 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-09-23T08:45:09.630 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-09-23T08:45:09.630 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-09-23T08:45:09.630 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-09-23T08:45:09.630 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-09-23T08:45:09.630 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-09-23T08:45:09.630 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-09-23T08:45:09.630 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-09-23T08:45:09.631 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-09-23T08:45:09.631 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-09-23T08:45:09.631 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-09-23T08:45:09.631 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-09-23T08:45:09.631 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-09-23T08:45:09.631 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-09-23T08:45:09.631 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-09-23T08:45:09.631 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-09-23T08:45:09.631 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-09-23T08:45:09.631 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-09-23T08:45:09.631 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-09-23T08:45:09.631 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-09-23T08:45:09.632 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-09-23T08:45:09.632 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-09-23T08:45:09.632 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-09-23T08:45:09.632 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-09-23T08:45:09.632 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-09-23T08:45:09.632 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-09-23T08:45:09.632 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-09-23T08:45:09.632 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-09-23T08:45:09.632 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-09-23T08:45:09.632 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-09-23T08:45:09.632 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-09-23T08:45:09.632 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-09-23T08:45:09.633 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-09-23T08:45:09.633 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-09-23T08:45:09.633 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-09-23T08:45:09.633 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-09-23T08:45:09.633 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-09-23T08:45:09.633 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-09-23T08:45:09.633 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-09-23T08:45:09.633 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-09-23T08:45:09.633 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-09-23T08:45:09.633 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-09-23T08:45:09.633 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-09-23T08:45:09.633 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-09-23T08:45:09.634 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-09-23T08:45:09.634 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-09-23T08:45:09.634 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-09-23T08:45:09.634 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-09-23T08:45:09.634 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-09-23T08:45:09.634 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-09-23T08:45:09.634 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-09-23T08:45:09.634 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-09-23T08:45:09.634 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-09-23T08:45:09.634 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-09-23T08:45:09.634 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-09-23T08:45:09.634 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-09-23T08:45:09.635 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-09-23T08:45:09.635 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-09-23T08:45:09.635 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-09-23T08:45:09.635 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-09-23T08:45:09.635 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-09-23T08:45:09.635 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-09-23T08:45:09.635 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-09-23T08:45:09.635 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-09-23T08:45:09.635 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-09-23T08:45:09.635 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-09-23T08:45:09.635 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-09-23T08:45:09.635 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-09-23T08:45:09.636 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-09-23T08:45:09.636 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-09-23T08:45:09.636 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-09-23T08:45:09.636 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-09-23T08:45:09.636 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-09-23T08:45:09.636 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-09-23T08:45:09.636 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-09-23T08:45:09.636 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-09-23T08:45:09.636 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-09-23T08:45:09.636 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-09-23T08:45:09.636 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-09-23T08:45:09.636 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-09-23T08:45:09.637 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librados2-2:18.0.0-5661.gdb9a2d12.el8.x86_64 129/134 2023-09-23T08:45:09.637 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-09-23T08:45:09.637 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librbd1-2:18.0.0-5661.gdb9a2d12.el8.x86_64 131/134 2023-09-23T08:45:09.637 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-09-23T08:45:09.637 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-09-23T08:45:09.845 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-09-23T08:45:10.079 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-09-23T08:45:10.346 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-09-23T08:45:10.346 INFO:teuthology.orchestra.run.smithi082.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-09-23T08:45:10.346 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:45:10.856 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-09-23T08:45:10.955 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-2:18.0.0-5661.gdb9a2d12.el8.x86_64 1/134 2023-09-23T08:45:10.955 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-base-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2/134 2023-09-23T08:45:10.956 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-common-2:18.0.0-5661.gdb9a2d12.el8.x86_64 3/134 2023-09-23T08:45:10.956 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-fuse-2:18.0.0-5661.gdb9a2d12.el8.x86_64 4/134 2023-09-23T08:45:10.956 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-5661.gdb9a2 5/134 2023-09-23T08:45:10.956 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mds-2:18.0.0-5661.gdb9a2d12.el8.x86_64 6/134 2023-09-23T08:45:10.956 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-2:18.0.0-5661.gdb9a2d12.el8.x86_64 7/134 2023-09-23T08:45:10.956 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mon-2:18.0.0-5661.gdb9a2d12.el8.x86_64 8/134 2023-09-23T08:45:10.956 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-osd-2:18.0.0-5661.gdb9a2d12.el8.x86_64 9/134 2023-09-23T08:45:10.956 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-radosgw-2:18.0.0-5661.gdb9a2d12.el8.x86_64 10/134 2023-09-23T08:45:10.956 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-selinux-2:18.0.0-5661.gdb9a2d12.el8.x86_64 11/134 2023-09-23T08:45:10.956 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-test-2:18.0.0-5661.gdb9a2d12.el8.x86_64 12/134 2023-09-23T08:45:10.956 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : cephfs-mirror-2:18.0.0-5661.gdb9a2d12.el8.x86_64 13/134 2023-09-23T08:45:10.956 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libcephfs-devel-2:18.0.0-5661.gdb9a2d12.el8.x86_ 14/134 2023-09-23T08:45:10.957 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libcephfs2-2:18.0.0-5661.gdb9a2d12.el8.x86_64 15/134 2023-09-23T08:45:10.957 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libcephsqlite-2:18.0.0-5661.gdb9a2d12.el8.x86_64 16/134 2023-09-23T08:45:10.957 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librados-devel-2:18.0.0-5661.gdb9a2d12.el8.x86_6 17/134 2023-09-23T08:45:10.957 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libradosstriper1-2:18.0.0-5661.gdb9a2d12.el8.x86 18/134 2023-09-23T08:45:10.957 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librgw2-2:18.0.0-5661.gdb9a2d12.el8.x86_64 19/134 2023-09-23T08:45:10.957 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-ceph-argparse-2:18.0.0-5661.gdb9a2d12.el 20/134 2023-09-23T08:45:10.957 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-ceph-common-2:18.0.0-5661.gdb9a2d12.el8. 21/134 2023-09-23T08:45:10.957 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cephfs-2:18.0.0-5661.gdb9a2d12.el8.x86_6 22/134 2023-09-23T08:45:10.957 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rados-2:18.0.0-5661.gdb9a2d12.el8.x86_64 23/134 2023-09-23T08:45:10.957 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rbd-2:18.0.0-5661.gdb9a2d12.el8.x86_64 24/134 2023-09-23T08:45:10.957 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rgw-2:18.0.0-5661.gdb9a2d12.el8.x86_64 25/134 2023-09-23T08:45:10.967 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : rbd-fuse-2:18.0.0-5661.gdb9a2d12.el8.x86_64 26/134 2023-09-23T08:45:10.967 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : rbd-mirror-2:18.0.0-5661.gdb9a2d12.el8.x86_64 27/134 2023-09-23T08:45:10.967 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : rbd-nbd-2:18.0.0-5661.gdb9a2d12.el8.x86_64 28/134 2023-09-23T08:45:10.967 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-5661.gdb9a2d12. 29/134 2023-09-23T08:45:10.967 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-5661.gdb9a2d12.el8.noa 30/134 2023-09-23T08:45:10.967 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-5661.gdb9a2d12.el8.n 31/134 2023-09-23T08:45:10.967 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-5661.gdb9 32/134 2023-09-23T08:45:10.967 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-5661.gdb9a2d12.el 33/134 2023-09-23T08:45:10.967 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-rook-2:18.0.0-5661.gdb9a2d12.el8.noarch 34/134 2023-09-23T08:45:10.968 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-5661.gdb9a2d12.e 35/134 2023-09-23T08:45:10.968 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-volume-2:18.0.0-5661.gdb9a2d12.el8.noarch 36/134 2023-09-23T08:45:10.968 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : cephadm-2:18.0.0-5661.gdb9a2d12.el8.noarch 37/134 2023-09-23T08:45:10.968 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : cephfs-top-2:18.0.0-5661.gdb9a2d12.el8.noarch 38/134 2023-09-23T08:45:10.968 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-09-23T08:45:10.968 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-09-23T08:45:10.968 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-09-23T08:45:10.968 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-09-23T08:45:10.968 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-09-23T08:45:10.968 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-09-23T08:45:10.968 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-09-23T08:45:10.968 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-09-23T08:45:10.969 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-09-23T08:45:10.969 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-09-23T08:45:10.969 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-09-23T08:45:10.969 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-09-23T08:45:10.969 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-09-23T08:45:10.969 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-09-23T08:45:10.969 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-09-23T08:45:10.969 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-09-23T08:45:10.969 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-09-23T08:45:10.969 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-09-23T08:45:10.969 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-09-23T08:45:10.969 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-09-23T08:45:10.970 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-09-23T08:45:10.970 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-09-23T08:45:10.970 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-09-23T08:45:10.970 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-09-23T08:45:10.970 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-09-23T08:45:10.970 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-09-23T08:45:10.970 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-09-23T08:45:10.970 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-09-23T08:45:10.970 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-09-23T08:45:10.970 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-09-23T08:45:10.970 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-09-23T08:45:10.970 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-09-23T08:45:10.971 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-09-23T08:45:10.971 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-09-23T08:45:10.971 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-09-23T08:45:10.971 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-09-23T08:45:10.971 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-09-23T08:45:10.971 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-09-23T08:45:10.971 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-09-23T08:45:10.971 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-09-23T08:45:10.971 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-09-23T08:45:10.971 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-09-23T08:45:10.971 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-09-23T08:45:10.972 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-09-23T08:45:10.972 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-09-23T08:45:10.972 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-09-23T08:45:10.972 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-09-23T08:45:10.972 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-09-23T08:45:10.972 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-09-23T08:45:10.972 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-09-23T08:45:10.972 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-09-23T08:45:10.972 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-09-23T08:45:10.972 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-09-23T08:45:10.972 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-09-23T08:45:10.973 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-09-23T08:45:10.973 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-09-23T08:45:10.973 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-09-23T08:45:10.973 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-09-23T08:45:10.973 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-09-23T08:45:10.973 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-09-23T08:45:10.973 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-09-23T08:45:10.973 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-09-23T08:45:10.973 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-09-23T08:45:10.973 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-09-23T08:45:10.973 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-09-23T08:45:10.973 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-09-23T08:45:10.974 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-09-23T08:45:10.974 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-09-23T08:45:10.974 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-09-23T08:45:10.974 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-09-23T08:45:10.974 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-09-23T08:45:10.974 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-09-23T08:45:10.974 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-09-23T08:45:10.974 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-09-23T08:45:10.974 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-09-23T08:45:10.974 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-09-23T08:45:10.974 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-09-23T08:45:10.974 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-09-23T08:45:10.975 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-09-23T08:45:10.975 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-09-23T08:45:10.975 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-09-23T08:45:10.975 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-09-23T08:45:10.975 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-09-23T08:45:10.975 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-09-23T08:45:10.975 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-09-23T08:45:10.975 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-09-23T08:45:10.975 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-09-23T08:45:10.975 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-09-23T08:45:10.975 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-09-23T08:45:10.975 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-09-23T08:45:10.976 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librados2-2:18.0.0-5661.gdb9a2d12.el8.x86_64 129/134 2023-09-23T08:45:10.976 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-09-23T08:45:10.976 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librbd1-2:18.0.0-5661.gdb9a2d12.el8.x86_64 131/134 2023-09-23T08:45:10.976 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-09-23T08:45:10.976 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-09-23T08:45:11.131 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-09-23T08:45:11.170 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-09-23T08:45:11.407 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : cephfs-top-2:18.0.0-5661.gdb9a2d12.el8.noarch 124/134 2023-09-23T08:45:11.649 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : rbd-fuse-2:18.0.0-5661.gdb9a2d12.el8.x86_64 125/134 2023-09-23T08:45:12.014 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : rbd-nbd-2:18.0.0-5661.gdb9a2d12.el8.x86_64 126/134 2023-09-23T08:45:12.311 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-09-23T08:45:12.311 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:02:02 ago on Sat 23 Sep 2023 08:43:10 AM UTC. 2023-09-23T08:45:12.385 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-09-23T08:45:12.580 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : flex-2.6.1-9.el8.x86_64 128/134 2023-09-23T08:45:12.691 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 128/134 2023-09-23T08:45:12.922 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : bison-3.0.4-10.el8.x86_64 129/134 2023-09-23T08:45:12.950 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 129/134 2023-09-23T08:45:13.147 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-09-23T08:45:13.169 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-09-23T08:45:13.367 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/134 2023-09-23T08:45:13.368 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-09-23T08:45:13.587 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-09-23T08:45:13.587 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-09-23T08:45:13.705 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-09-23T08:45:13.705 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:02:08 ago on Sat 23 Sep 2023 08:43:05 AM UTC. 2023-09-23T08:45:13.879 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-09-23T08:45:14.105 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-09-23T08:45:14.374 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-09-23T08:45:14.374 INFO:teuthology.orchestra.run.smithi135.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-09-23T08:45:14.374 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-09-23T08:45:14.991 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-2:18.0.0-5661.gdb9a2d12.el8.x86_64 1/134 2023-09-23T08:45:14.991 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-base-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2/134 2023-09-23T08:45:14.991 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-common-2:18.0.0-5661.gdb9a2d12.el8.x86_64 3/134 2023-09-23T08:45:14.992 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-fuse-2:18.0.0-5661.gdb9a2d12.el8.x86_64 4/134 2023-09-23T08:45:14.992 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-5661.gdb9a2 5/134 2023-09-23T08:45:14.992 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mds-2:18.0.0-5661.gdb9a2d12.el8.x86_64 6/134 2023-09-23T08:45:14.992 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-2:18.0.0-5661.gdb9a2d12.el8.x86_64 7/134 2023-09-23T08:45:14.992 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mon-2:18.0.0-5661.gdb9a2d12.el8.x86_64 8/134 2023-09-23T08:45:14.992 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-osd-2:18.0.0-5661.gdb9a2d12.el8.x86_64 9/134 2023-09-23T08:45:14.992 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-radosgw-2:18.0.0-5661.gdb9a2d12.el8.x86_64 10/134 2023-09-23T08:45:14.992 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-selinux-2:18.0.0-5661.gdb9a2d12.el8.x86_64 11/134 2023-09-23T08:45:14.992 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-test-2:18.0.0-5661.gdb9a2d12.el8.x86_64 12/134 2023-09-23T08:45:14.992 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : cephfs-mirror-2:18.0.0-5661.gdb9a2d12.el8.x86_64 13/134 2023-09-23T08:45:14.992 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libcephfs-devel-2:18.0.0-5661.gdb9a2d12.el8.x86_ 14/134 2023-09-23T08:45:14.992 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libcephfs2-2:18.0.0-5661.gdb9a2d12.el8.x86_64 15/134 2023-09-23T08:45:14.993 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libcephsqlite-2:18.0.0-5661.gdb9a2d12.el8.x86_64 16/134 2023-09-23T08:45:14.993 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librados-devel-2:18.0.0-5661.gdb9a2d12.el8.x86_6 17/134 2023-09-23T08:45:14.993 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libradosstriper1-2:18.0.0-5661.gdb9a2d12.el8.x86 18/134 2023-09-23T08:45:14.993 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librgw2-2:18.0.0-5661.gdb9a2d12.el8.x86_64 19/134 2023-09-23T08:45:14.993 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-ceph-argparse-2:18.0.0-5661.gdb9a2d12.el 20/134 2023-09-23T08:45:14.993 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-ceph-common-2:18.0.0-5661.gdb9a2d12.el8. 21/134 2023-09-23T08:45:14.993 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cephfs-2:18.0.0-5661.gdb9a2d12.el8.x86_6 22/134 2023-09-23T08:45:14.993 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rados-2:18.0.0-5661.gdb9a2d12.el8.x86_64 23/134 2023-09-23T08:45:14.993 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rbd-2:18.0.0-5661.gdb9a2d12.el8.x86_64 24/134 2023-09-23T08:45:14.993 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rgw-2:18.0.0-5661.gdb9a2d12.el8.x86_64 25/134 2023-09-23T08:45:14.993 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : rbd-fuse-2:18.0.0-5661.gdb9a2d12.el8.x86_64 26/134 2023-09-23T08:45:14.994 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : rbd-mirror-2:18.0.0-5661.gdb9a2d12.el8.x86_64 27/134 2023-09-23T08:45:14.994 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : rbd-nbd-2:18.0.0-5661.gdb9a2d12.el8.x86_64 28/134 2023-09-23T08:45:14.994 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-5661.gdb9a2d12. 29/134 2023-09-23T08:45:14.994 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-5661.gdb9a2d12.el8.noa 30/134 2023-09-23T08:45:14.994 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-5661.gdb9a2d12.el8.n 31/134 2023-09-23T08:45:14.994 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-5661.gdb9 32/134 2023-09-23T08:45:14.994 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-5661.gdb9a2d12.el 33/134 2023-09-23T08:45:14.994 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-rook-2:18.0.0-5661.gdb9a2d12.el8.noarch 34/134 2023-09-23T08:45:14.994 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-5661.gdb9a2d12.e 35/134 2023-09-23T08:45:14.994 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-volume-2:18.0.0-5661.gdb9a2d12.el8.noarch 36/134 2023-09-23T08:45:14.995 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : cephadm-2:18.0.0-5661.gdb9a2d12.el8.noarch 37/134 2023-09-23T08:45:14.995 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : cephfs-top-2:18.0.0-5661.gdb9a2d12.el8.noarch 38/134 2023-09-23T08:45:14.995 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-09-23T08:45:14.995 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-09-23T08:45:14.995 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-09-23T08:45:14.995 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-09-23T08:45:14.995 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-09-23T08:45:14.995 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-09-23T08:45:14.995 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-09-23T08:45:14.995 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-09-23T08:45:14.995 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-09-23T08:45:14.996 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-09-23T08:45:14.996 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-09-23T08:45:14.996 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-09-23T08:45:14.996 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-09-23T08:45:14.996 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-09-23T08:45:14.996 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-09-23T08:45:14.996 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-09-23T08:45:14.996 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-09-23T08:45:14.996 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-09-23T08:45:14.996 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-09-23T08:45:14.996 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-09-23T08:45:14.996 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-09-23T08:45:14.997 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-09-23T08:45:14.997 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-09-23T08:45:14.997 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-09-23T08:45:14.997 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-09-23T08:45:14.997 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-09-23T08:45:14.997 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-09-23T08:45:14.997 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-09-23T08:45:14.997 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-09-23T08:45:14.997 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-09-23T08:45:14.997 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-09-23T08:45:14.997 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-09-23T08:45:14.998 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-09-23T08:45:14.998 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 72/134 2023-09-23T08:45:14.998 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 73/134 2023-09-23T08:45:14.998 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/134 2023-09-23T08:45:14.998 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/134 2023-09-23T08:45:14.998 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 76/134 2023-09-23T08:45:14.998 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 77/134 2023-09-23T08:45:14.998 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/134 2023-09-23T08:45:14.998 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 79/134 2023-09-23T08:45:14.998 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/134 2023-09-23T08:45:14.998 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 81/134 2023-09-23T08:45:14.998 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 82/134 2023-09-23T08:45:14.999 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 83/134 2023-09-23T08:45:14.999 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 84/134 2023-09-23T08:45:14.999 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 85/134 2023-09-23T08:45:14.999 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 86/134 2023-09-23T08:45:14.999 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 87/134 2023-09-23T08:45:14.999 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 88/134 2023-09-23T08:45:14.999 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 89/134 2023-09-23T08:45:14.999 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 90/134 2023-09-23T08:45:14.999 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 91/134 2023-09-23T08:45:14.999 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 92/134 2023-09-23T08:45:14.999 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 93/134 2023-09-23T08:45:14.999 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 94/134 2023-09-23T08:45:15.000 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 95/134 2023-09-23T08:45:15.000 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 96/134 2023-09-23T08:45:15.000 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 97/134 2023-09-23T08:45:15.000 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 98/134 2023-09-23T08:45:15.000 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 99/134 2023-09-23T08:45:15.000 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 100/134 2023-09-23T08:45:15.000 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 101/134 2023-09-23T08:45:15.000 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 102/134 2023-09-23T08:45:15.000 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 103/134 2023-09-23T08:45:15.000 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : bison-3.0.4-10.el8.x86_64 104/134 2023-09-23T08:45:15.000 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 105/134 2023-09-23T08:45:15.000 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 106/134 2023-09-23T08:45:15.001 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/134 2023-09-23T08:45:15.001 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : automake-1.16.1-7.el8.noarch 108/134 2023-09-23T08:45:15.001 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 109/134 2023-09-23T08:45:15.001 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 110/134 2023-09-23T08:45:15.001 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : flex-2.6.1-9.el8.x86_64 111/134 2023-09-23T08:45:15.001 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 112/134 2023-09-23T08:45:15.001 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 113/134 2023-09-23T08:45:15.001 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 114/134 2023-09-23T08:45:15.001 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 115/134 2023-09-23T08:45:15.001 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 116/134 2023-09-23T08:45:15.001 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 117/134 2023-09-23T08:45:15.001 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 118/134 2023-09-23T08:45:15.002 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 119/134 2023-09-23T08:45:15.002 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 120/134 2023-09-23T08:45:15.002 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 121/134 2023-09-23T08:45:15.002 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libpq-13.5-1.el8.x86_64 122/134 2023-09-23T08:45:15.002 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 123/134 2023-09-23T08:45:15.002 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : jq-1.6-3.el8.x86_64 124/134 2023-09-23T08:45:15.002 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 125/134 2023-09-23T08:45:15.002 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 126/134 2023-09-23T08:45:15.002 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 127/134 2023-09-23T08:45:15.002 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 128/134 2023-09-23T08:45:15.002 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librados2-2:18.0.0-5661.gdb9a2d12.el8.x86_64 129/134 2023-09-23T08:45:15.003 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-09-23T08:45:15.003 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librbd1-2:18.0.0-5661.gdb9a2d12.el8.x86_64 131/134 2023-09-23T08:45:15.003 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-09-23T08:45:15.003 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-09-23T08:45:15.245 INFO:teuthology.orchestra.run.smithi161.stdout:Installed products updated. 2023-09-23T08:45:15.486 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-09-23T08:45:15.486 INFO:teuthology.orchestra.run.smithi161.stdout:Upgraded: 2023-09-23T08:45:15.486 INFO:teuthology.orchestra.run.smithi161.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-09-23T08:45:15.486 INFO:teuthology.orchestra.run.smithi161.stdout: librados2-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2023-09-23T08:45:15.487 INFO:teuthology.orchestra.run.smithi161.stdout: librbd1-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2023-09-23T08:45:15.487 INFO:teuthology.orchestra.run.smithi161.stdout:Installed: 2023-09-23T08:45:15.487 INFO:teuthology.orchestra.run.smithi161.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-09-23T08:45:15.487 INFO:teuthology.orchestra.run.smithi161.stdout: automake-1.16.1-7.el8.noarch 2023-09-23T08:45:15.487 INFO:teuthology.orchestra.run.smithi161.stdout: bison-3.0.4-10.el8.x86_64 2023-09-23T08:45:15.488 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2023-09-23T08:45:15.488 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-base-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2023-09-23T08:45:15.488 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-common-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2023-09-23T08:45:15.488 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-fuse-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2023-09-23T08:45:15.488 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-grafana-dashboards-2:18.0.0-5661.gdb9a2d12.el8.noarch 2023-09-23T08:45:15.488 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-immutable-object-cache-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2023-09-23T08:45:15.489 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mds-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2023-09-23T08:45:15.489 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2023-09-23T08:45:15.489 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-cephadm-2:18.0.0-5661.gdb9a2d12.el8.noarch 2023-09-23T08:45:15.489 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-dashboard-2:18.0.0-5661.gdb9a2d12.el8.noarch 2023-09-23T08:45:15.489 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-diskprediction-local-2:18.0.0-5661.gdb9a2d12.el8.noarch 2023-09-23T08:45:15.489 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-modules-core-2:18.0.0-5661.gdb9a2d12.el8.noarch 2023-09-23T08:45:15.489 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-rook-2:18.0.0-5661.gdb9a2d12.el8.noarch 2023-09-23T08:45:15.490 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mon-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2023-09-23T08:45:15.490 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-osd-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2023-09-23T08:45:15.490 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-prometheus-alerts-2:18.0.0-5661.gdb9a2d12.el8.noarch 2023-09-23T08:45:15.490 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-radosgw-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2023-09-23T08:45:15.490 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-selinux-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2023-09-23T08:45:15.490 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-test-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2023-09-23T08:45:15.490 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-volume-2:18.0.0-5661.gdb9a2d12.el8.noarch 2023-09-23T08:45:15.491 INFO:teuthology.orchestra.run.smithi161.stdout: cephadm-2:18.0.0-5661.gdb9a2d12.el8.noarch 2023-09-23T08:45:15.491 INFO:teuthology.orchestra.run.smithi161.stdout: cephfs-mirror-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2023-09-23T08:45:15.491 INFO:teuthology.orchestra.run.smithi161.stdout: cephfs-top-2:18.0.0-5661.gdb9a2d12.el8.noarch 2023-09-23T08:45:15.491 INFO:teuthology.orchestra.run.smithi161.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-09-23T08:45:15.491 INFO:teuthology.orchestra.run.smithi161.stdout: flex-2.6.1-9.el8.x86_64 2023-09-23T08:45:15.491 INFO:teuthology.orchestra.run.smithi161.stdout: fuse-2.9.7-15.el8.x86_64 2023-09-23T08:45:15.491 INFO:teuthology.orchestra.run.smithi161.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-09-23T08:45:15.491 INFO:teuthology.orchestra.run.smithi161.stdout: jq-1.6-3.el8.x86_64 2023-09-23T08:45:15.492 INFO:teuthology.orchestra.run.smithi161.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-09-23T08:45:15.492 INFO:teuthology.orchestra.run.smithi161.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-09-23T08:45:15.492 INFO:teuthology.orchestra.run.smithi161.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-09-23T08:45:15.492 INFO:teuthology.orchestra.run.smithi161.stdout: libcephfs-devel-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2023-09-23T08:45:15.492 INFO:teuthology.orchestra.run.smithi161.stdout: libcephfs2-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2023-09-23T08:45:15.492 INFO:teuthology.orchestra.run.smithi161.stdout: libcephsqlite-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2023-09-23T08:45:15.493 INFO:teuthology.orchestra.run.smithi161.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-09-23T08:45:15.493 INFO:teuthology.orchestra.run.smithi161.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-09-23T08:45:15.493 INFO:teuthology.orchestra.run.smithi161.stdout: liboath-2.6.2-3.el8.x86_64 2023-09-23T08:45:15.493 INFO:teuthology.orchestra.run.smithi161.stdout: libpq-13.5-1.el8.x86_64 2023-09-23T08:45:15.493 INFO:teuthology.orchestra.run.smithi161.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-09-23T08:45:15.493 INFO:teuthology.orchestra.run.smithi161.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-09-23T08:45:15.493 INFO:teuthology.orchestra.run.smithi161.stdout: librados-devel-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2023-09-23T08:45:15.493 INFO:teuthology.orchestra.run.smithi161.stdout: libradosstriper1-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2023-09-23T08:45:15.493 INFO:teuthology.orchestra.run.smithi161.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-09-23T08:45:15.493 INFO:teuthology.orchestra.run.smithi161.stdout: librgw2-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2023-09-23T08:45:15.494 INFO:teuthology.orchestra.run.smithi161.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-09-23T08:45:15.494 INFO:teuthology.orchestra.run.smithi161.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-09-23T08:45:15.494 INFO:teuthology.orchestra.run.smithi161.stdout: libtool-2.4.6-25.el8.x86_64 2023-09-23T08:45:15.494 INFO:teuthology.orchestra.run.smithi161.stdout: libunwind-1.3.1-3.el8.x86_64 2023-09-23T08:45:15.494 INFO:teuthology.orchestra.run.smithi161.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-09-23T08:45:15.494 INFO:teuthology.orchestra.run.smithi161.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-09-23T08:45:15.494 INFO:teuthology.orchestra.run.smithi161.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-09-23T08:45:15.494 INFO:teuthology.orchestra.run.smithi161.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-09-23T08:45:15.494 INFO:teuthology.orchestra.run.smithi161.stdout: openblas-0.3.15-3.el8.x86_64 2023-09-23T08:45:15.494 INFO:teuthology.orchestra.run.smithi161.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-09-23T08:45:15.494 INFO:teuthology.orchestra.run.smithi161.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-09-23T08:45:15.495 INFO:teuthology.orchestra.run.smithi161.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-09-23T08:45:15.495 INFO:teuthology.orchestra.run.smithi161.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-09-23T08:45:15.495 INFO:teuthology.orchestra.run.smithi161.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-09-23T08:45:15.495 INFO:teuthology.orchestra.run.smithi161.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-09-23T08:45:15.495 INFO:teuthology.orchestra.run.smithi161.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-09-23T08:45:15.495 INFO:teuthology.orchestra.run.smithi161.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-09-23T08:45:15.495 INFO:teuthology.orchestra.run.smithi161.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-09-23T08:45:15.495 INFO:teuthology.orchestra.run.smithi161.stdout: python3-babel-2.5.1-7.el8.noarch 2023-09-23T08:45:15.495 INFO:teuthology.orchestra.run.smithi161.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-09-23T08:45:15.495 INFO:teuthology.orchestra.run.smithi161.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-09-23T08:45:15.495 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-09-23T08:45:15.496 INFO:teuthology.orchestra.run.smithi161.stdout: python3-ceph-argparse-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2023-09-23T08:45:15.496 INFO:teuthology.orchestra.run.smithi161.stdout: python3-ceph-common-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2023-09-23T08:45:15.496 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cephfs-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2023-09-23T08:45:15.496 INFO:teuthology.orchestra.run.smithi161.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-09-23T08:45:15.496 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-09-23T08:45:15.496 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-09-23T08:45:15.496 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-09-23T08:45:15.496 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-09-23T08:45:15.496 INFO:teuthology.orchestra.run.smithi161.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-09-23T08:45:15.496 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco-6.2-6.el8.noarch 2023-09-23T08:45:15.496 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-09-23T08:45:15.496 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-09-23T08:45:15.497 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-09-23T08:45:15.497 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-09-23T08:45:15.497 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-09-23T08:45:15.497 INFO:teuthology.orchestra.run.smithi161.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-09-23T08:45:15.497 INFO:teuthology.orchestra.run.smithi161.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-09-23T08:45:15.497 INFO:teuthology.orchestra.run.smithi161.stdout: python3-mako-1.0.6-13.el8.noarch 2023-09-23T08:45:15.497 INFO:teuthology.orchestra.run.smithi161.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-09-23T08:45:15.497 INFO:teuthology.orchestra.run.smithi161.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-09-23T08:45:15.497 INFO:teuthology.orchestra.run.smithi161.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-09-23T08:45:15.497 INFO:teuthology.orchestra.run.smithi161.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-09-23T08:45:15.497 INFO:teuthology.orchestra.run.smithi161.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-09-23T08:45:15.497 INFO:teuthology.orchestra.run.smithi161.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-09-23T08:45:15.498 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-09-23T08:45:15.498 INFO:teuthology.orchestra.run.smithi161.stdout: python3-portend-2.6-1.el8.noarch 2023-09-23T08:45:15.498 INFO:teuthology.orchestra.run.smithi161.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-09-23T08:45:15.498 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-09-23T08:45:15.498 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-09-23T08:45:15.498 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-09-23T08:45:15.498 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pycparser-2.14-14.el8.noarch 2023-09-23T08:45:15.498 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pytz-2017.2-9.el8.noarch 2023-09-23T08:45:15.498 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rados-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2023-09-23T08:45:15.498 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rbd-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2023-09-23T08:45:15.498 INFO:teuthology.orchestra.run.smithi161.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-09-23T08:45:15.498 INFO:teuthology.orchestra.run.smithi161.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-09-23T08:45:15.499 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rgw-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2023-09-23T08:45:15.499 INFO:teuthology.orchestra.run.smithi161.stdout: python3-routes-2.4.1-12.el8.noarch 2023-09-23T08:45:15.499 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rsa-4.9-2.el8.noarch 2023-09-23T08:45:15.499 INFO:teuthology.orchestra.run.smithi161.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-09-23T08:45:15.499 INFO:teuthology.orchestra.run.smithi161.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-09-23T08:45:15.499 INFO:teuthology.orchestra.run.smithi161.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-09-23T08:45:15.499 INFO:teuthology.orchestra.run.smithi161.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-09-23T08:45:15.499 INFO:teuthology.orchestra.run.smithi161.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-09-23T08:45:15.499 INFO:teuthology.orchestra.run.smithi161.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-09-23T08:45:15.499 INFO:teuthology.orchestra.run.smithi161.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-09-23T08:45:15.500 INFO:teuthology.orchestra.run.smithi161.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-09-23T08:45:15.500 INFO:teuthology.orchestra.run.smithi161.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-09-23T08:45:15.500 INFO:teuthology.orchestra.run.smithi161.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-09-23T08:45:15.500 INFO:teuthology.orchestra.run.smithi161.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-09-23T08:45:15.500 INFO:teuthology.orchestra.run.smithi161.stdout: rbd-fuse-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2023-09-23T08:45:15.500 INFO:teuthology.orchestra.run.smithi161.stdout: rbd-mirror-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2023-09-23T08:45:15.500 INFO:teuthology.orchestra.run.smithi161.stdout: rbd-nbd-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2023-09-23T08:45:15.500 INFO:teuthology.orchestra.run.smithi161.stdout: socat-1.7.4.1-1.el8.x86_64 2023-09-23T08:45:15.500 INFO:teuthology.orchestra.run.smithi161.stdout: thrift-0.13.0-2.el8.x86_64 2023-09-23T08:45:15.500 INFO:teuthology.orchestra.run.smithi161.stdout: uuid-1.6.2-43.el8.x86_64 2023-09-23T08:45:15.500 INFO:teuthology.orchestra.run.smithi161.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-09-23T08:45:15.501 INFO:teuthology.orchestra.run.smithi161.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-09-23T08:45:15.501 INFO:teuthology.orchestra.run.smithi161.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-09-23T08:45:15.501 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-09-23T08:45:15.501 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2023-09-23T08:45:15.799 DEBUG:teuthology.parallel:result is None 2023-09-23T08:45:16.333 INFO:teuthology.orchestra.run.smithi082.stdout:Installed products updated. 2023-09-23T08:45:16.576 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:45:16.577 INFO:teuthology.orchestra.run.smithi082.stdout:Upgraded: 2023-09-23T08:45:16.577 INFO:teuthology.orchestra.run.smithi082.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-09-23T08:45:16.577 INFO:teuthology.orchestra.run.smithi082.stdout: librados2-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2023-09-23T08:45:16.577 INFO:teuthology.orchestra.run.smithi082.stdout: librbd1-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2023-09-23T08:45:16.577 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2023-09-23T08:45:16.577 INFO:teuthology.orchestra.run.smithi082.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-09-23T08:45:16.577 INFO:teuthology.orchestra.run.smithi082.stdout: automake-1.16.1-7.el8.noarch 2023-09-23T08:45:16.577 INFO:teuthology.orchestra.run.smithi082.stdout: bison-3.0.4-10.el8.x86_64 2023-09-23T08:45:16.577 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2023-09-23T08:45:16.578 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-base-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2023-09-23T08:45:16.578 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-common-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2023-09-23T08:45:16.578 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-fuse-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2023-09-23T08:45:16.578 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-grafana-dashboards-2:18.0.0-5661.gdb9a2d12.el8.noarch 2023-09-23T08:45:16.578 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-immutable-object-cache-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2023-09-23T08:45:16.578 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mds-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2023-09-23T08:45:16.578 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2023-09-23T08:45:16.578 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-cephadm-2:18.0.0-5661.gdb9a2d12.el8.noarch 2023-09-23T08:45:16.578 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-dashboard-2:18.0.0-5661.gdb9a2d12.el8.noarch 2023-09-23T08:45:16.578 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-diskprediction-local-2:18.0.0-5661.gdb9a2d12.el8.noarch 2023-09-23T08:45:16.578 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-modules-core-2:18.0.0-5661.gdb9a2d12.el8.noarch 2023-09-23T08:45:16.579 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-rook-2:18.0.0-5661.gdb9a2d12.el8.noarch 2023-09-23T08:45:16.579 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mon-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2023-09-23T08:45:16.579 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-osd-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2023-09-23T08:45:16.579 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-prometheus-alerts-2:18.0.0-5661.gdb9a2d12.el8.noarch 2023-09-23T08:45:16.579 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-radosgw-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2023-09-23T08:45:16.579 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-selinux-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2023-09-23T08:45:16.579 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-test-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2023-09-23T08:45:16.579 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-volume-2:18.0.0-5661.gdb9a2d12.el8.noarch 2023-09-23T08:45:16.579 INFO:teuthology.orchestra.run.smithi082.stdout: cephadm-2:18.0.0-5661.gdb9a2d12.el8.noarch 2023-09-23T08:45:16.579 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-mirror-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2023-09-23T08:45:16.579 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-top-2:18.0.0-5661.gdb9a2d12.el8.noarch 2023-09-23T08:45:16.580 INFO:teuthology.orchestra.run.smithi082.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-09-23T08:45:16.580 INFO:teuthology.orchestra.run.smithi082.stdout: flex-2.6.1-9.el8.x86_64 2023-09-23T08:45:16.580 INFO:teuthology.orchestra.run.smithi082.stdout: fuse-2.9.7-15.el8.x86_64 2023-09-23T08:45:16.580 INFO:teuthology.orchestra.run.smithi082.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-09-23T08:45:16.580 INFO:teuthology.orchestra.run.smithi082.stdout: jq-1.6-3.el8.x86_64 2023-09-23T08:45:16.580 INFO:teuthology.orchestra.run.smithi082.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-09-23T08:45:16.580 INFO:teuthology.orchestra.run.smithi082.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-09-23T08:45:16.580 INFO:teuthology.orchestra.run.smithi082.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-09-23T08:45:16.580 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs-devel-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2023-09-23T08:45:16.580 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs2-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2023-09-23T08:45:16.580 INFO:teuthology.orchestra.run.smithi082.stdout: libcephsqlite-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2023-09-23T08:45:16.580 INFO:teuthology.orchestra.run.smithi082.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-09-23T08:45:16.581 INFO:teuthology.orchestra.run.smithi082.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-09-23T08:45:16.581 INFO:teuthology.orchestra.run.smithi082.stdout: liboath-2.6.2-3.el8.x86_64 2023-09-23T08:45:16.581 INFO:teuthology.orchestra.run.smithi082.stdout: libpq-13.5-1.el8.x86_64 2023-09-23T08:45:16.581 INFO:teuthology.orchestra.run.smithi082.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-09-23T08:45:16.581 INFO:teuthology.orchestra.run.smithi082.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-09-23T08:45:16.581 INFO:teuthology.orchestra.run.smithi082.stdout: librados-devel-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2023-09-23T08:45:16.581 INFO:teuthology.orchestra.run.smithi082.stdout: libradosstriper1-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2023-09-23T08:45:16.581 INFO:teuthology.orchestra.run.smithi082.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-09-23T08:45:16.581 INFO:teuthology.orchestra.run.smithi082.stdout: librgw2-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2023-09-23T08:45:16.581 INFO:teuthology.orchestra.run.smithi082.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-09-23T08:45:16.581 INFO:teuthology.orchestra.run.smithi082.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-09-23T08:45:16.582 INFO:teuthology.orchestra.run.smithi082.stdout: libtool-2.4.6-25.el8.x86_64 2023-09-23T08:45:16.582 INFO:teuthology.orchestra.run.smithi082.stdout: libunwind-1.3.1-3.el8.x86_64 2023-09-23T08:45:16.582 INFO:teuthology.orchestra.run.smithi082.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-09-23T08:45:16.582 INFO:teuthology.orchestra.run.smithi082.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-09-23T08:45:16.582 INFO:teuthology.orchestra.run.smithi082.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-09-23T08:45:16.582 INFO:teuthology.orchestra.run.smithi082.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-09-23T08:45:16.582 INFO:teuthology.orchestra.run.smithi082.stdout: openblas-0.3.15-3.el8.x86_64 2023-09-23T08:45:16.582 INFO:teuthology.orchestra.run.smithi082.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-09-23T08:45:16.582 INFO:teuthology.orchestra.run.smithi082.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-09-23T08:45:16.582 INFO:teuthology.orchestra.run.smithi082.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-09-23T08:45:16.582 INFO:teuthology.orchestra.run.smithi082.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-09-23T08:45:16.583 INFO:teuthology.orchestra.run.smithi082.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-09-23T08:45:16.583 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-09-23T08:45:16.583 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-09-23T08:45:16.583 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-09-23T08:45:16.583 INFO:teuthology.orchestra.run.smithi082.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-09-23T08:45:16.583 INFO:teuthology.orchestra.run.smithi082.stdout: python3-babel-2.5.1-7.el8.noarch 2023-09-23T08:45:16.583 INFO:teuthology.orchestra.run.smithi082.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-09-23T08:45:16.583 INFO:teuthology.orchestra.run.smithi082.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-09-23T08:45:16.583 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-09-23T08:45:16.583 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-argparse-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2023-09-23T08:45:16.583 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-common-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2023-09-23T08:45:16.584 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cephfs-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2023-09-23T08:45:16.584 INFO:teuthology.orchestra.run.smithi082.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-09-23T08:45:16.584 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-09-23T08:45:16.584 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-09-23T08:45:16.584 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-09-23T08:45:16.584 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-09-23T08:45:16.584 INFO:teuthology.orchestra.run.smithi082.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-09-23T08:45:16.584 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-6.2-6.el8.noarch 2023-09-23T08:45:16.584 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-09-23T08:45:16.584 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-09-23T08:45:16.585 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-09-23T08:45:16.585 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-09-23T08:45:16.585 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-09-23T08:45:16.585 INFO:teuthology.orchestra.run.smithi082.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-09-23T08:45:16.585 INFO:teuthology.orchestra.run.smithi082.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-09-23T08:45:16.585 INFO:teuthology.orchestra.run.smithi082.stdout: python3-mako-1.0.6-13.el8.noarch 2023-09-23T08:45:16.585 INFO:teuthology.orchestra.run.smithi082.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-09-23T08:45:16.585 INFO:teuthology.orchestra.run.smithi082.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-09-23T08:45:16.585 INFO:teuthology.orchestra.run.smithi082.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-09-23T08:45:16.585 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-09-23T08:45:16.585 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-09-23T08:45:16.586 INFO:teuthology.orchestra.run.smithi082.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-09-23T08:45:16.586 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-09-23T08:45:16.586 INFO:teuthology.orchestra.run.smithi082.stdout: python3-portend-2.6-1.el8.noarch 2023-09-23T08:45:16.586 INFO:teuthology.orchestra.run.smithi082.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-09-23T08:45:16.586 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-09-23T08:45:16.586 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-09-23T08:45:16.586 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-09-23T08:45:16.586 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pycparser-2.14-14.el8.noarch 2023-09-23T08:45:16.586 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pytz-2017.2-9.el8.noarch 2023-09-23T08:45:16.586 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rados-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2023-09-23T08:45:16.586 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rbd-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2023-09-23T08:45:16.587 INFO:teuthology.orchestra.run.smithi082.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-09-23T08:45:16.587 INFO:teuthology.orchestra.run.smithi082.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-09-23T08:45:16.587 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rgw-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2023-09-23T08:45:16.587 INFO:teuthology.orchestra.run.smithi082.stdout: python3-routes-2.4.1-12.el8.noarch 2023-09-23T08:45:16.587 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rsa-4.9-2.el8.noarch 2023-09-23T08:45:16.587 INFO:teuthology.orchestra.run.smithi082.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-09-23T08:45:16.587 INFO:teuthology.orchestra.run.smithi082.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-09-23T08:45:16.587 INFO:teuthology.orchestra.run.smithi082.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-09-23T08:45:16.587 INFO:teuthology.orchestra.run.smithi082.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-09-23T08:45:16.587 INFO:teuthology.orchestra.run.smithi082.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-09-23T08:45:16.587 INFO:teuthology.orchestra.run.smithi082.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-09-23T08:45:16.587 INFO:teuthology.orchestra.run.smithi082.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-09-23T08:45:16.588 INFO:teuthology.orchestra.run.smithi082.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-09-23T08:45:16.588 INFO:teuthology.orchestra.run.smithi082.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-09-23T08:45:16.588 INFO:teuthology.orchestra.run.smithi082.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-09-23T08:45:16.588 INFO:teuthology.orchestra.run.smithi082.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-09-23T08:45:16.588 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-fuse-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2023-09-23T08:45:16.588 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-mirror-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2023-09-23T08:45:16.588 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-nbd-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2023-09-23T08:45:16.588 INFO:teuthology.orchestra.run.smithi082.stdout: socat-1.7.4.1-1.el8.x86_64 2023-09-23T08:45:16.588 INFO:teuthology.orchestra.run.smithi082.stdout: thrift-0.13.0-2.el8.x86_64 2023-09-23T08:45:16.588 INFO:teuthology.orchestra.run.smithi082.stdout: uuid-1.6.2-43.el8.x86_64 2023-09-23T08:45:16.588 INFO:teuthology.orchestra.run.smithi082.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-09-23T08:45:16.588 INFO:teuthology.orchestra.run.smithi082.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-09-23T08:45:16.589 INFO:teuthology.orchestra.run.smithi082.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-09-23T08:45:16.589 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:45:16.589 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2023-09-23T08:45:17.589 DEBUG:teuthology.parallel:result is None 2023-09-23T08:45:17.747 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-09-23T08:45:17.747 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:02:13 ago on Sat 23 Sep 2023 08:43:04 AM UTC. 2023-09-23T08:45:20.417 INFO:teuthology.orchestra.run.smithi135.stdout:Installed products updated. 2023-09-23T08:45:20.654 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-09-23T08:45:20.654 INFO:teuthology.orchestra.run.smithi135.stdout:Upgraded: 2023-09-23T08:45:20.654 INFO:teuthology.orchestra.run.smithi135.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-09-23T08:45:20.655 INFO:teuthology.orchestra.run.smithi135.stdout: librados2-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2023-09-23T08:45:20.655 INFO:teuthology.orchestra.run.smithi135.stdout: librbd1-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2023-09-23T08:45:20.655 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2023-09-23T08:45:20.655 INFO:teuthology.orchestra.run.smithi135.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-09-23T08:45:20.655 INFO:teuthology.orchestra.run.smithi135.stdout: automake-1.16.1-7.el8.noarch 2023-09-23T08:45:20.655 INFO:teuthology.orchestra.run.smithi135.stdout: bison-3.0.4-10.el8.x86_64 2023-09-23T08:45:20.655 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2023-09-23T08:45:20.655 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-base-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2023-09-23T08:45:20.655 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-common-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2023-09-23T08:45:20.655 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-fuse-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2023-09-23T08:45:20.655 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-grafana-dashboards-2:18.0.0-5661.gdb9a2d12.el8.noarch 2023-09-23T08:45:20.656 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-immutable-object-cache-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2023-09-23T08:45:20.656 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mds-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2023-09-23T08:45:20.656 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2023-09-23T08:45:20.656 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-cephadm-2:18.0.0-5661.gdb9a2d12.el8.noarch 2023-09-23T08:45:20.656 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-dashboard-2:18.0.0-5661.gdb9a2d12.el8.noarch 2023-09-23T08:45:20.656 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-diskprediction-local-2:18.0.0-5661.gdb9a2d12.el8.noarch 2023-09-23T08:45:20.656 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-modules-core-2:18.0.0-5661.gdb9a2d12.el8.noarch 2023-09-23T08:45:20.656 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-rook-2:18.0.0-5661.gdb9a2d12.el8.noarch 2023-09-23T08:45:20.656 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mon-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2023-09-23T08:45:20.656 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-osd-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2023-09-23T08:45:20.656 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-prometheus-alerts-2:18.0.0-5661.gdb9a2d12.el8.noarch 2023-09-23T08:45:20.656 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-radosgw-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2023-09-23T08:45:20.657 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-selinux-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2023-09-23T08:45:20.657 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-test-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2023-09-23T08:45:20.657 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-volume-2:18.0.0-5661.gdb9a2d12.el8.noarch 2023-09-23T08:45:20.657 INFO:teuthology.orchestra.run.smithi135.stdout: cephadm-2:18.0.0-5661.gdb9a2d12.el8.noarch 2023-09-23T08:45:20.657 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-mirror-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2023-09-23T08:45:20.657 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-top-2:18.0.0-5661.gdb9a2d12.el8.noarch 2023-09-23T08:45:20.657 INFO:teuthology.orchestra.run.smithi135.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-09-23T08:45:20.657 INFO:teuthology.orchestra.run.smithi135.stdout: flex-2.6.1-9.el8.x86_64 2023-09-23T08:45:20.657 INFO:teuthology.orchestra.run.smithi135.stdout: fuse-2.9.7-15.el8.x86_64 2023-09-23T08:45:20.657 INFO:teuthology.orchestra.run.smithi135.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-09-23T08:45:20.657 INFO:teuthology.orchestra.run.smithi135.stdout: jq-1.6-3.el8.x86_64 2023-09-23T08:45:20.657 INFO:teuthology.orchestra.run.smithi135.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-09-23T08:45:20.658 INFO:teuthology.orchestra.run.smithi135.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-09-23T08:45:20.658 INFO:teuthology.orchestra.run.smithi135.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-09-23T08:45:20.658 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs-devel-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2023-09-23T08:45:20.658 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs2-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2023-09-23T08:45:20.658 INFO:teuthology.orchestra.run.smithi135.stdout: libcephsqlite-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2023-09-23T08:45:20.658 INFO:teuthology.orchestra.run.smithi135.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-09-23T08:45:20.658 INFO:teuthology.orchestra.run.smithi135.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-09-23T08:45:20.658 INFO:teuthology.orchestra.run.smithi135.stdout: liboath-2.6.2-3.el8.x86_64 2023-09-23T08:45:20.658 INFO:teuthology.orchestra.run.smithi135.stdout: libpq-13.5-1.el8.x86_64 2023-09-23T08:45:20.658 INFO:teuthology.orchestra.run.smithi135.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-09-23T08:45:20.658 INFO:teuthology.orchestra.run.smithi135.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-09-23T08:45:20.659 INFO:teuthology.orchestra.run.smithi135.stdout: librados-devel-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2023-09-23T08:45:20.659 INFO:teuthology.orchestra.run.smithi135.stdout: libradosstriper1-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2023-09-23T08:45:20.659 INFO:teuthology.orchestra.run.smithi135.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-09-23T08:45:20.659 INFO:teuthology.orchestra.run.smithi135.stdout: librgw2-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2023-09-23T08:45:20.659 INFO:teuthology.orchestra.run.smithi135.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-09-23T08:45:20.659 INFO:teuthology.orchestra.run.smithi135.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-09-23T08:45:20.659 INFO:teuthology.orchestra.run.smithi135.stdout: libtool-2.4.6-25.el8.x86_64 2023-09-23T08:45:20.659 INFO:teuthology.orchestra.run.smithi135.stdout: libunwind-1.3.1-3.el8.x86_64 2023-09-23T08:45:20.659 INFO:teuthology.orchestra.run.smithi135.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-09-23T08:45:20.659 INFO:teuthology.orchestra.run.smithi135.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-09-23T08:45:20.659 INFO:teuthology.orchestra.run.smithi135.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-09-23T08:45:20.659 INFO:teuthology.orchestra.run.smithi135.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-09-23T08:45:20.659 INFO:teuthology.orchestra.run.smithi135.stdout: openblas-0.3.15-3.el8.x86_64 2023-09-23T08:45:20.660 INFO:teuthology.orchestra.run.smithi135.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-09-23T08:45:20.660 INFO:teuthology.orchestra.run.smithi135.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-09-23T08:45:20.660 INFO:teuthology.orchestra.run.smithi135.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-09-23T08:45:20.660 INFO:teuthology.orchestra.run.smithi135.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-09-23T08:45:20.660 INFO:teuthology.orchestra.run.smithi135.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-09-23T08:45:20.660 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-09-23T08:45:20.660 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-09-23T08:45:20.660 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-09-23T08:45:20.660 INFO:teuthology.orchestra.run.smithi135.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-09-23T08:45:20.660 INFO:teuthology.orchestra.run.smithi135.stdout: python3-babel-2.5.1-7.el8.noarch 2023-09-23T08:45:20.660 INFO:teuthology.orchestra.run.smithi135.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-09-23T08:45:20.661 INFO:teuthology.orchestra.run.smithi135.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-09-23T08:45:20.661 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-09-23T08:45:20.661 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-argparse-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2023-09-23T08:45:20.661 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-common-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2023-09-23T08:45:20.661 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cephfs-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2023-09-23T08:45:20.661 INFO:teuthology.orchestra.run.smithi135.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-09-23T08:45:20.661 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-09-23T08:45:20.661 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-09-23T08:45:20.661 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-09-23T08:45:20.661 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-09-23T08:45:20.661 INFO:teuthology.orchestra.run.smithi135.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-09-23T08:45:20.661 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-6.2-6.el8.noarch 2023-09-23T08:45:20.661 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-09-23T08:45:20.662 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-09-23T08:45:20.662 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-09-23T08:45:20.662 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-09-23T08:45:20.662 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-09-23T08:45:20.662 INFO:teuthology.orchestra.run.smithi135.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-09-23T08:45:20.662 INFO:teuthology.orchestra.run.smithi135.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-09-23T08:45:20.662 INFO:teuthology.orchestra.run.smithi135.stdout: python3-mako-1.0.6-13.el8.noarch 2023-09-23T08:45:20.662 INFO:teuthology.orchestra.run.smithi135.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-09-23T08:45:20.662 INFO:teuthology.orchestra.run.smithi135.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-09-23T08:45:20.662 INFO:teuthology.orchestra.run.smithi135.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-09-23T08:45:20.662 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-09-23T08:45:20.662 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-09-23T08:45:20.663 INFO:teuthology.orchestra.run.smithi135.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-09-23T08:45:20.663 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-09-23T08:45:20.663 INFO:teuthology.orchestra.run.smithi135.stdout: python3-portend-2.6-1.el8.noarch 2023-09-23T08:45:20.663 INFO:teuthology.orchestra.run.smithi135.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-09-23T08:45:20.663 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-09-23T08:45:20.663 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-09-23T08:45:20.663 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-09-23T08:45:20.663 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pycparser-2.14-14.el8.noarch 2023-09-23T08:45:20.663 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pytz-2017.2-9.el8.noarch 2023-09-23T08:45:20.663 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rados-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2023-09-23T08:45:20.663 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rbd-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2023-09-23T08:45:20.663 INFO:teuthology.orchestra.run.smithi135.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-09-23T08:45:20.664 INFO:teuthology.orchestra.run.smithi135.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-09-23T08:45:20.664 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rgw-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2023-09-23T08:45:20.664 INFO:teuthology.orchestra.run.smithi135.stdout: python3-routes-2.4.1-12.el8.noarch 2023-09-23T08:45:20.664 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rsa-4.9-2.el8.noarch 2023-09-23T08:45:20.664 INFO:teuthology.orchestra.run.smithi135.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-09-23T08:45:20.664 INFO:teuthology.orchestra.run.smithi135.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-09-23T08:45:20.664 INFO:teuthology.orchestra.run.smithi135.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-09-23T08:45:20.664 INFO:teuthology.orchestra.run.smithi135.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-09-23T08:45:20.664 INFO:teuthology.orchestra.run.smithi135.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-09-23T08:45:20.664 INFO:teuthology.orchestra.run.smithi135.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-09-23T08:45:20.664 INFO:teuthology.orchestra.run.smithi135.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-09-23T08:45:20.664 INFO:teuthology.orchestra.run.smithi135.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-09-23T08:45:20.665 INFO:teuthology.orchestra.run.smithi135.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-09-23T08:45:20.665 INFO:teuthology.orchestra.run.smithi135.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-09-23T08:45:20.665 INFO:teuthology.orchestra.run.smithi135.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-09-23T08:45:20.665 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-fuse-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2023-09-23T08:45:20.665 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-mirror-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2023-09-23T08:45:20.665 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-nbd-2:18.0.0-5661.gdb9a2d12.el8.x86_64 2023-09-23T08:45:20.665 INFO:teuthology.orchestra.run.smithi135.stdout: socat-1.7.4.1-1.el8.x86_64 2023-09-23T08:45:20.665 INFO:teuthology.orchestra.run.smithi135.stdout: thrift-0.13.0-2.el8.x86_64 2023-09-23T08:45:20.665 INFO:teuthology.orchestra.run.smithi135.stdout: uuid-1.6.2-43.el8.x86_64 2023-09-23T08:45:20.665 INFO:teuthology.orchestra.run.smithi135.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-09-23T08:45:20.665 INFO:teuthology.orchestra.run.smithi135.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-09-23T08:45:20.666 INFO:teuthology.orchestra.run.smithi135.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-09-23T08:45:20.666 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-09-23T08:45:20.666 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2023-09-23T08:45:21.041 DEBUG:teuthology.parallel:result is None 2023-09-23T08:45:21.041 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=db9a2d12746faa158579b8d032d53d472ae6b6b0 2023-09-23T08:45:21.179 DEBUG:teuthology.orchestra.run.smithi082:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-09-23T08:45:21.239 INFO:teuthology.orchestra.run.smithi082.stdout:18.0.0-5661.gdb9a2d12.el8 2023-09-23T08:45:21.239 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-5661.gdb9a2d12.el8 2023-09-23T08:45:21.240 INFO:teuthology.task.install:The correct ceph version 18.0.0-5661.gdb9a2d12 is installed. 2023-09-23T08:45:21.240 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=db9a2d12746faa158579b8d032d53d472ae6b6b0 2023-09-23T08:45:21.374 DEBUG:teuthology.orchestra.run.smithi135:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-09-23T08:45:21.430 INFO:teuthology.orchestra.run.smithi135.stdout:18.0.0-5661.gdb9a2d12.el8 2023-09-23T08:45:21.431 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-5661.gdb9a2d12.el8 2023-09-23T08:45:21.431 INFO:teuthology.task.install:The correct ceph version 18.0.0-5661.gdb9a2d12 is installed. 2023-09-23T08:45:21.431 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=db9a2d12746faa158579b8d032d53d472ae6b6b0 2023-09-23T08:45:21.574 DEBUG:teuthology.orchestra.run.smithi161:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-09-23T08:45:21.634 INFO:teuthology.orchestra.run.smithi161.stdout:18.0.0-5661.gdb9a2d12.el8 2023-09-23T08:45:21.634 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-5661.gdb9a2d12.el8 2023-09-23T08:45:21.634 INFO:teuthology.task.install:The correct ceph version 18.0.0-5661.gdb9a2d12 is installed. 2023-09-23T08:45:21.634 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-09-23T08:45:21.635 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-09-23T08:45:21.635 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-09-23T08:45:21.730 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-09-23T08:45:21.730 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-09-23T08:45:21.821 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-09-23T08:45:21.821 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-09-23T08:45:21.917 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-09-23T08:45:21.917 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-09-23T08:45:21.917 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/usr/bin/daemon-helper 2023-09-23T08:45:21.986 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-09-23T08:45:22.093 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-09-23T08:45:22.093 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/usr/bin/daemon-helper 2023-09-23T08:45:22.160 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-09-23T08:45:22.266 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-09-23T08:45:22.267 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/usr/bin/daemon-helper 2023-09-23T08:45:22.337 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-09-23T08:45:22.445 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-09-23T08:45:22.446 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-09-23T08:45:22.446 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/usr/bin/adjust-ulimits 2023-09-23T08:45:22.520 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-09-23T08:45:22.628 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-09-23T08:45:22.629 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/usr/bin/adjust-ulimits 2023-09-23T08:45:22.698 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-09-23T08:45:22.810 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-09-23T08:45:22.810 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/usr/bin/adjust-ulimits 2023-09-23T08:45:22.879 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-09-23T08:45:22.988 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-09-23T08:45:22.988 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-09-23T08:45:22.988 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/usr/bin/stdin-killer 2023-09-23T08:45:23.057 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-09-23T08:45:23.163 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-09-23T08:45:23.163 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/usr/bin/stdin-killer 2023-09-23T08:45:23.235 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-09-23T08:45:23.344 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-09-23T08:45:23.344 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/usr/bin/stdin-killer 2023-09-23T08:45:23.412 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-09-23T08:45:23.520 INFO:teuthology.run_tasks:Running task cephadm... 2023-09-23T08:45:23.820 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug cephsqlite': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': 'db9a2d12746faa158579b8d032d53d472ae6b6b0', 'subvols': {'create': 2}} 2023-09-23T08:45:23.820 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 2023-09-23T08:45:23.821 INFO:tasks.cephadm:Cluster fsid is 8926e286-59ed-11ee-8db4-212e2dc638e7 2023-09-23T08:45:23.821 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2023-09-23T08:45:23.821 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.82', 'mon.b': '172.21.15.135', 'mon.c': '172.21.15.161'} 2023-09-23T08:45:23.821 INFO:tasks.cephadm:First mon is mon.a on smithi082 2023-09-23T08:45:23.821 INFO:tasks.cephadm:First mgr is x 2023-09-23T08:45:23.822 INFO:tasks.cephadm:Normalizing hostnames... 2023-09-23T08:45:23.822 DEBUG:teuthology.orchestra.run.smithi082:> sudo hostname $(hostname -s) 2023-09-23T08:45:23.892 DEBUG:teuthology.orchestra.run.smithi135:> sudo hostname $(hostname -s) 2023-09-23T08:45:23.964 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname $(hostname -s) 2023-09-23T08:45:24.035 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2023-09-23T08:45:24.035 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=db9a2d12746faa158579b8d032d53d472ae6b6b0 2023-09-23T08:45:24.271 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'db9a2d12746faa158579b8d032d53d472ae6b6b0', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic/72770/', 'root_build_cause': 'SCMTRIGGER', 'version': '18.0.0-5661-gdb9a2d12', 'node_name': '172.21.2.6+braggi06', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic', 'package_manager_version': '18.0.0-5661.gdb9a2d12'}, 'url': 'https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230824.045828-scrub-failure/db9a2d12746faa158579b8d032d53d472ae6b6b0/centos/8/flavors/default/', 'distro_codename': None, 'modified': '2023-09-23 07:50:57.499442', 'distro_version': '8', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-vshankar-testing-20230824.045828-scrub-failure', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/wip-vshankar-testing-20230824.045828-scrub-failure/db9a2d12746faa158579b8d032d53d472ae6b6b0/centos/8/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2023-09-23T08:45:24.408 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref wip-vshankar-testing-20230824.045828-scrub-failure, sha1 db9a2d12746faa158579b8d032d53d472ae6b6b0 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F8%2Fx86_64&flavor=default&sha1=db9a2d12746faa158579b8d032d53d472ae6b6b0 2023-09-23T08:45:24.408 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/wip-vshankar-testing-20230824.045828-scrub-failure/db9a2d12746faa158579b8d032d53d472ae6b6b0/centos/8/x86_64/flavors/default/cephadm 2023-09-23T08:45:24.408 DEBUG:teuthology.orchestra.run.smithi082:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-vshankar-testing-20230824.045828-scrub-failure/db9a2d12746faa158579b8d032d53d472ae6b6b0/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-09-23T08:45:25.145 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-rw-r--. 1 ubuntu ubuntu 705688 Sep 23 08:45 /home/ubuntu/cephtest/cephadm 2023-09-23T08:45:25.145 DEBUG:teuthology.orchestra.run.smithi135:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-vshankar-testing-20230824.045828-scrub-failure/db9a2d12746faa158579b8d032d53d472ae6b6b0/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-09-23T08:45:25.907 INFO:teuthology.orchestra.run.smithi135.stdout:-rw-rw-r--. 1 ubuntu ubuntu 705688 Sep 23 08:45 /home/ubuntu/cephtest/cephadm 2023-09-23T08:45:25.908 DEBUG:teuthology.orchestra.run.smithi161:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-vshankar-testing-20230824.045828-scrub-failure/db9a2d12746faa158579b8d032d53d472ae6b6b0/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-09-23T08:45:26.363 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-rw-r--. 1 ubuntu ubuntu 705688 Sep 23 08:45 /home/ubuntu/cephtest/cephadm 2023-09-23T08:45:26.364 DEBUG:teuthology.orchestra.run.smithi082:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-09-23T08:45:26.415 DEBUG:teuthology.orchestra.run.smithi135:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-09-23T08:45:26.467 DEBUG:teuthology.orchestra.run.smithi161:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-09-23T08:45:26.556 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 on all hosts... 2023-09-23T08:45:26.556 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 pull 2023-09-23T08:45:26.561 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 pull 2023-09-23T08:45:26.565 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 pull 2023-09-23T08:45:29.924 INFO:teuthology.orchestra.run.smithi161.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0... 2023-09-23T08:45:31.219 INFO:teuthology.orchestra.run.smithi082.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0... 2023-09-23T08:45:31.235 INFO:teuthology.orchestra.run.smithi135.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0... 2023-09-23T08:45:57.478 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2023-09-23T08:45:57.478 INFO:teuthology.orchestra.run.smithi161.stdout: "ceph_version": "ceph version 18.0.0-5661-gdb9a2d12 (db9a2d12746faa158579b8d032d53d472ae6b6b0) reef (dev)", 2023-09-23T08:45:57.478 INFO:teuthology.orchestra.run.smithi161.stdout: "image_id": "5cd91c8805304a266e477bd34d879fbc9c3572f47264685e8ee9274aaadbbd98", 2023-09-23T08:45:57.478 INFO:teuthology.orchestra.run.smithi161.stdout: "repo_digests": [ 2023-09-23T08:45:57.478 INFO:teuthology.orchestra.run.smithi161.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:35ef481f22d83bac9b95964ad666f9d51ee57050325925b5f7460be8df2eaff6" 2023-09-23T08:45:57.478 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2023-09-23T08:45:57.479 INFO:teuthology.orchestra.run.smithi161.stdout:} 2023-09-23T08:45:58.881 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T08:45:58.881 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_version": "ceph version 18.0.0-5661-gdb9a2d12 (db9a2d12746faa158579b8d032d53d472ae6b6b0) reef (dev)", 2023-09-23T08:45:58.882 INFO:teuthology.orchestra.run.smithi082.stdout: "image_id": "5cd91c8805304a266e477bd34d879fbc9c3572f47264685e8ee9274aaadbbd98", 2023-09-23T08:45:58.882 INFO:teuthology.orchestra.run.smithi082.stdout: "repo_digests": [ 2023-09-23T08:45:58.882 INFO:teuthology.orchestra.run.smithi082.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:35ef481f22d83bac9b95964ad666f9d51ee57050325925b5f7460be8df2eaff6" 2023-09-23T08:45:58.882 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2023-09-23T08:45:58.882 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T08:46:06.032 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2023-09-23T08:46:06.032 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_version": "ceph version 18.0.0-5661-gdb9a2d12 (db9a2d12746faa158579b8d032d53d472ae6b6b0) reef (dev)", 2023-09-23T08:46:06.032 INFO:teuthology.orchestra.run.smithi135.stdout: "image_id": "5cd91c8805304a266e477bd34d879fbc9c3572f47264685e8ee9274aaadbbd98", 2023-09-23T08:46:06.032 INFO:teuthology.orchestra.run.smithi135.stdout: "repo_digests": [ 2023-09-23T08:46:06.032 INFO:teuthology.orchestra.run.smithi135.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:35ef481f22d83bac9b95964ad666f9d51ee57050325925b5f7460be8df2eaff6" 2023-09-23T08:46:06.033 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2023-09-23T08:46:06.033 INFO:teuthology.orchestra.run.smithi135.stdout:} 2023-09-23T08:46:06.057 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /etc/ceph 2023-09-23T08:46:06.138 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /etc/ceph 2023-09-23T08:46:06.209 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /etc/ceph 2023-09-23T08:46:06.289 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 777 /etc/ceph 2023-09-23T08:46:06.360 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 777 /etc/ceph 2023-09-23T08:46:06.427 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 777 /etc/ceph 2023-09-23T08:46:06.499 INFO:tasks.cephadm:Writing seed config... 2023-09-23T08:46:06.505 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2023-09-23T08:46:06.505 INFO:tasks.cephadm: override: [client] debug client = 20 2023-09-23T08:46:06.505 INFO:tasks.cephadm: override: [client] debug ms = 1 2023-09-23T08:46:06.505 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2023-09-23T08:46:06.505 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2023-09-23T08:46:06.505 INFO:tasks.cephadm: override: [mds] debug mds = 20 2023-09-23T08:46:06.505 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2023-09-23T08:46:06.505 INFO:tasks.cephadm: override: [mds] debug ms = 1 2023-09-23T08:46:06.506 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2023-09-23T08:46:06.506 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2023-09-23T08:46:06.506 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2023-09-23T08:46:06.506 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2023-09-23T08:46:06.506 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2023-09-23T08:46:06.506 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2023-09-23T08:46:06.506 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2023-09-23T08:46:06.506 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2023-09-23T08:46:06.506 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2023-09-23T08:46:06.506 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2023-09-23T08:46:06.506 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2023-09-23T08:46:06.506 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2023-09-23T08:46:06.507 INFO:tasks.cephadm: override: [mgr] debug cephsqlite = 20 2023-09-23T08:46:06.507 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2023-09-23T08:46:06.507 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2023-09-23T08:46:06.507 INFO:tasks.cephadm: override: [mon] debug mon = 20 2023-09-23T08:46:06.507 INFO:tasks.cephadm: override: [mon] debug ms = 1 2023-09-23T08:46:06.507 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2023-09-23T08:46:06.507 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2023-09-23T08:46:06.507 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2023-09-23T08:46:06.507 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2023-09-23T08:46:06.507 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2023-09-23T08:46:06.507 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2023-09-23T08:46:06.507 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2023-09-23T08:46:06.508 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2023-09-23T08:46:06.508 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2023-09-23T08:46:06.508 INFO:tasks.cephadm: override: [osd] debug ms = 1 2023-09-23T08:46:06.508 INFO:tasks.cephadm: override: [osd] debug osd = 20 2023-09-23T08:46:06.508 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2023-09-23T08:46:06.508 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2023-09-23T08:46:06.508 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2023-09-23T08:46:06.508 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2023-09-23T08:46:06.508 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2023-09-23T08:46:06.508 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2023-09-23T08:46:06.508 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2023-09-23T08:46:06.508 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2023-09-23T08:46:06.509 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2023-09-23T08:46:06.509 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-09-23T08:46:06.509 DEBUG:teuthology.orchestra.run.smithi082:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2023-09-23T08:46:06.553 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 8926e286-59ed-11ee-8db4-212e2dc638e7 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug cephsqlite = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2023-09-23T08:46:06.553 DEBUG:teuthology.orchestra.run.smithi082:mon.a> sudo journalctl -f -n 0 -u ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@mon.a.service 2023-09-23T08:46:06.598 DEBUG:teuthology.orchestra.run.smithi082:mgr.x> sudo journalctl -f -n 0 -u ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@mgr.x.service 2023-09-23T08:46:06.643 INFO:tasks.cephadm:Bootstrapping... 2023-09-23T08:46:06.644 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 -v bootstrap --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.82 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2023-09-23T08:46:06.665 INFO:journalctl@ceph.mon.a.smithi082.stdout:-- Logs begin at Sat 2023-09-23 08:29:32 UTC. -- 2023-09-23T08:46:06.711 INFO:journalctl@ceph.mgr.x.smithi082.stdout:-- Logs begin at Sat 2023-09-23 08:29:32 UTC. -- 2023-09-23T08:46:06.865 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2023-09-23T08:46:06.865 INFO:teuthology.orchestra.run.smithi082.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0', '-v', 'bootstrap', '--fsid', '8926e286-59ed-11ee-8db4-212e2dc638e7', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.82', '--skip-admin-label'] 2023-09-23T08:46:07.039 INFO:teuthology.orchestra.run.smithi082.stdout:/bin/podman: stdout 4.1.1 2023-09-23T08:46:07.039 INFO:teuthology.orchestra.run.smithi082.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2023-09-23T08:46:07.039 INFO:teuthology.orchestra.run.smithi082.stdout:Verifying podman|docker is present... 2023-09-23T08:46:07.210 INFO:teuthology.orchestra.run.smithi082.stdout:/bin/podman: stdout 4.1.1 2023-09-23T08:46:07.210 INFO:teuthology.orchestra.run.smithi082.stdout:Verifying lvm2 is present... 2023-09-23T08:46:07.210 INFO:teuthology.orchestra.run.smithi082.stdout:Verifying time synchronization is in place... 2023-09-23T08:46:07.224 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-09-23T08:46:07.224 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-09-23T08:46:07.237 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-09-23T08:46:07.237 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout inactive 2023-09-23T08:46:07.250 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout enabled 2023-09-23T08:46:07.263 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout active 2023-09-23T08:46:07.263 INFO:teuthology.orchestra.run.smithi082.stdout:Unit chronyd.service is enabled and running 2023-09-23T08:46:07.263 INFO:teuthology.orchestra.run.smithi082.stdout:Repeating the final host check... 2023-09-23T08:46:07.432 INFO:teuthology.orchestra.run.smithi082.stdout:/bin/podman: stdout 4.1.1 2023-09-23T08:46:07.432 INFO:teuthology.orchestra.run.smithi082.stdout:podman (/bin/podman) version 4.1.1 is present 2023-09-23T08:46:07.432 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl is present 2023-09-23T08:46:07.432 INFO:teuthology.orchestra.run.smithi082.stdout:lvcreate is present 2023-09-23T08:46:07.445 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-09-23T08:46:07.445 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-09-23T08:46:07.457 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-09-23T08:46:07.457 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout inactive 2023-09-23T08:46:07.471 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout enabled 2023-09-23T08:46:07.483 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout active 2023-09-23T08:46:07.483 INFO:teuthology.orchestra.run.smithi082.stdout:Unit chronyd.service is enabled and running 2023-09-23T08:46:07.483 INFO:teuthology.orchestra.run.smithi082.stdout:Host looks OK 2023-09-23T08:46:07.483 INFO:teuthology.orchestra.run.smithi082.stdout:Cluster fsid: 8926e286-59ed-11ee-8db4-212e2dc638e7 2023-09-23T08:46:07.484 INFO:teuthology.orchestra.run.smithi082.stdout:Acquiring lock 139866663057896 on /run/cephadm/8926e286-59ed-11ee-8db4-212e2dc638e7.lock 2023-09-23T08:46:07.484 INFO:teuthology.orchestra.run.smithi082.stdout:Lock 139866663057896 acquired on /run/cephadm/8926e286-59ed-11ee-8db4-212e2dc638e7.lock 2023-09-23T08:46:07.484 INFO:teuthology.orchestra.run.smithi082.stdout:Verifying IP 172.21.15.82 port 3300 ... 2023-09-23T08:46:07.485 INFO:teuthology.orchestra.run.smithi082.stdout:Verifying IP 172.21.15.82 port 6789 ... 2023-09-23T08:46:07.485 INFO:teuthology.orchestra.run.smithi082.stdout:Base mon IP(s) is [172.21.15.82:3300, 172.21.15.82:6789], mon addrv is [v2:172.21.15.82:3300,v1:172.21.15.82:6789] 2023-09-23T08:46:07.492 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp metric 100 2023-09-23T08:46:07.493 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.82 metric 100 2023-09-23T08:46:07.499 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2023-09-23T08:46:07.499 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2023-09-23T08:46:07.499 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2023-09-23T08:46:07.505 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2023-09-23T08:46:07.506 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2023-09-23T08:46:07.506 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-09-23T08:46:07.506 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2023-09-23T08:46:07.506 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout inet6 fe80::4094:8a44:ea89:d02c/64 scope link noprefixroute 2023-09-23T08:46:07.506 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-09-23T08:46:07.507 INFO:teuthology.orchestra.run.smithi082.stdout:Mon IP `172.21.15.82` is in CIDR network `172.21.0.0/20` 2023-09-23T08:46:07.507 INFO:teuthology.orchestra.run.smithi082.stdout:Mon IP `172.21.15.82` is in CIDR network `172.21.0.0/20` 2023-09-23T08:46:07.507 INFO:teuthology.orchestra.run.smithi082.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2023-09-23T08:46:07.507 INFO:teuthology.orchestra.run.smithi082.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2023-09-23T08:46:07.509 INFO:teuthology.orchestra.run.smithi082.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0... 2023-09-23T08:46:07.982 INFO:teuthology.orchestra.run.smithi082.stdout:/bin/podman: stdout 5cd91c8805304a266e477bd34d879fbc9c3572f47264685e8ee9274aaadbbd98 2023-09-23T08:46:07.982 INFO:teuthology.orchestra.run.smithi082.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0... 2023-09-23T08:46:07.982 INFO:teuthology.orchestra.run.smithi082.stdout:/bin/podman: stderr Getting image source signatures 2023-09-23T08:46:07.982 INFO:teuthology.orchestra.run.smithi082.stdout:/bin/podman: stderr Copying blob sha256:ebbebde6b9c75130c0610c5fd4ea66503dcbfdb3b8491084eb76e94e7aa37e4e 2023-09-23T08:46:07.982 INFO:teuthology.orchestra.run.smithi082.stdout:/bin/podman: stderr Copying blob sha256:3f4fd5c3c800c6da9ef94691df203a05a5bbbf32c483d09d620ec06eef42ea2b 2023-09-23T08:46:07.982 INFO:teuthology.orchestra.run.smithi082.stdout:/bin/podman: stderr Copying config sha256:5cd91c8805304a266e477bd34d879fbc9c3572f47264685e8ee9274aaadbbd98 2023-09-23T08:46:07.982 INFO:teuthology.orchestra.run.smithi082.stdout:/bin/podman: stderr Writing manifest to image destination 2023-09-23T08:46:07.982 INFO:teuthology.orchestra.run.smithi082.stdout:/bin/podman: stderr Storing signatures 2023-09-23T08:46:08.959 INFO:teuthology.orchestra.run.smithi082.stdout:ceph: stdout ceph version 18.0.0-5661-gdb9a2d12 (db9a2d12746faa158579b8d032d53d472ae6b6b0) reef (dev) 2023-09-23T08:46:08.959 INFO:teuthology.orchestra.run.smithi082.stdout:Ceph version: ceph version 18.0.0-5661-gdb9a2d12 (db9a2d12746faa158579b8d032d53d472ae6b6b0) reef (dev) 2023-09-23T08:46:08.959 INFO:teuthology.orchestra.run.smithi082.stdout:Extracting ceph user uid/gid from container image... 2023-09-23T08:46:09.732 INFO:teuthology.orchestra.run.smithi082.stdout:stat: stdout 167 167 2023-09-23T08:46:09.732 INFO:teuthology.orchestra.run.smithi082.stdout:Creating initial keys... 2023-09-23T08:46:10.708 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph-authtool: stdout AQDSpQ5lwJzMCRAA2jq/Llk8cit1KNKLK4CbJQ== 2023-09-23T08:46:11.582 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph-authtool: stdout AQDTpQ5lrUjOCBAAumJ7VL0XHZNJS3gDNknEMA== 2023-09-23T08:46:12.457 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph-authtool: stdout AQDTpQ5l+jp0OxAA6dn4iT0Ze9hWIR2eQGoxQw== 2023-09-23T08:46:12.458 INFO:teuthology.orchestra.run.smithi082.stdout:Creating initial monmap... 2023-09-23T08:46:13.332 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2023-09-23T08:46:13.332 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = pacific 2023-09-23T08:46:13.332 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 8926e286-59ed-11ee-8db4-212e2dc638e7 2023-09-23T08:46:13.332 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-09-23T08:46:13.332 INFO:teuthology.orchestra.run.smithi082.stdout:monmaptool for a [v2:172.21.15.82:3300,v1:172.21.15.82:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2023-09-23T08:46:13.332 INFO:teuthology.orchestra.run.smithi082.stdout:setting min_mon_release = pacific 2023-09-23T08:46:13.333 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/monmaptool: set fsid to 8926e286-59ed-11ee-8db4-212e2dc638e7 2023-09-23T08:46:13.333 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-09-23T08:46:13.333 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:46:13.333 INFO:teuthology.orchestra.run.smithi082.stdout:Creating mon... 2023-09-23T08:46:14.611 INFO:teuthology.orchestra.run.smithi082.stdout:create mon.a on 2023-09-23T08:46:14.859 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stderr Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2023-09-23T08:46:15.057 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2023-09-23T08:46:15.325 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-8926e286-59ed-11ee-8db4-212e2dc638e7.target → /etc/systemd/system/ceph-8926e286-59ed-11ee-8db4-212e2dc638e7.target. 2023-09-23T08:46:15.325 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-8926e286-59ed-11ee-8db4-212e2dc638e7.target → /etc/systemd/system/ceph-8926e286-59ed-11ee-8db4-212e2dc638e7.target. 2023-09-23T08:46:15.658 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@mon.a 2023-09-23T08:46:15.658 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stderr Failed to reset failed state of unit ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@mon.a.service: Unit ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@mon.a.service not loaded. 2023-09-23T08:46:15.858 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-8926e286-59ed-11ee-8db4-212e2dc638e7.target.wants/ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@mon.a.service → /etc/systemd/system/ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@.service. 2023-09-23T08:46:16.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:15 smithi082 systemd[1]: Starting Ceph mon.a for 8926e286-59ed-11ee-8db4-212e2dc638e7... 2023-09-23T08:46:16.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:16 smithi082 podman[97143]: 2023-09-23T08:46:16.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:16 smithi082 bash[97143]: 2cd8900700f719d4b5f6b68534bc175852252436be649118a50481bd79f3f9fa 2023-09-23T08:46:16.656 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-09-23T08:46:16.656 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout disabled 2023-09-23T08:46:16.671 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-09-23T08:46:16.671 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout inactive 2023-09-23T08:46:16.671 INFO:teuthology.orchestra.run.smithi082.stdout:firewalld.service is not enabled 2023-09-23T08:46:16.672 INFO:teuthology.orchestra.run.smithi082.stdout:Not possible to enable service . firewalld.service is not available 2023-09-23T08:46:16.672 INFO:teuthology.orchestra.run.smithi082.stdout:Waiting for mon to start... 2023-09-23T08:46:16.672 INFO:teuthology.orchestra.run.smithi082.stdout:Waiting for mon... 2023-09-23T08:46:16.980 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:16 smithi082 ceph-mon[97183]: mkfs 8926e286-59ed-11ee-8db4-212e2dc638e7 2023-09-23T08:46:16.981 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:16 smithi082 systemd[1]: Started Ceph mon.a for 8926e286-59ed-11ee-8db4-212e2dc638e7. 2023-09-23T08:46:16.981 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:16 smithi082 ceph-mon[97183]: mon.a is new leader, mons a in quorum (ranks 0) 2023-09-23T08:46:17.757 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout cluster: 2023-09-23T08:46:17.758 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout id: 8926e286-59ed-11ee-8db4-212e2dc638e7 2023-09-23T08:46:17.758 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2023-09-23T08:46:17.758 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2023-09-23T08:46:17.758 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout services: 2023-09-23T08:46:17.758 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.689707s) 2023-09-23T08:46:17.758 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2023-09-23T08:46:17.758 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2023-09-23T08:46:17.758 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2023-09-23T08:46:17.758 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout data: 2023-09-23T08:46:17.759 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2023-09-23T08:46:17.759 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2023-09-23T08:46:17.759 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2023-09-23T08:46:17.759 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout pgs: 2023-09-23T08:46:17.759 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2023-09-23T08:46:17.759 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:17.233+0000 7fcd56bfd700 1 Processor -- start 2023-09-23T08:46:17.759 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:17.233+0000 7fcd56bfd700 1 -- start start 2023-09-23T08:46:17.759 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:17.234+0000 7fcd56bfd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd5007ad10 0x7fcd50079170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:46:17.759 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:17.234+0000 7fcd56bfd700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd50079740 con 0x7fcd5007ad10 2023-09-23T08:46:17.759 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:17.235+0000 7fcd54999700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd5007ad10 0x7fcd50079170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:46:17.760 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:17.235+0000 7fcd54999700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd5007ad10 0x7fcd50079170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59652/0 (socket says 172.21.15.82:59652) 2023-09-23T08:46:17.760 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:17.235+0000 7fcd54999700 1 -- 172.21.15.82:0/611599905 learned_addr learned my addr 172.21.15.82:0/611599905 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:46:17.760 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:17.235+0000 7fcd54999700 1 -- 172.21.15.82:0/611599905 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd50079880 con 0x7fcd5007ad10 2023-09-23T08:46:17.760 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:17.235+0000 7fcd54999700 1 --2- 172.21.15.82:0/611599905 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd5007ad10 0x7fcd50079170 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fcd440098a0 tx=0x7fcd44009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a01eba73824db152 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:46:17.760 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:17.236+0000 7fcd4f7fe700 1 -- 172.21.15.82:0/611599905 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcd44004160 con 0x7fcd5007ad10 2023-09-23T08:46:17.760 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:17.236+0000 7fcd4f7fe700 1 -- 172.21.15.82:0/611599905 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd440042c0 con 0x7fcd5007ad10 2023-09-23T08:46:17.760 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:17.236+0000 7fcd4f7fe700 1 -- 172.21.15.82:0/611599905 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcd440045a0 con 0x7fcd5007ad10 2023-09-23T08:46:17.760 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:17.236+0000 7fcd56bfd700 1 -- 172.21.15.82:0/611599905 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd5007ad10 msgr2=0x7fcd50079170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:46:17.760 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:17.236+0000 7fcd56bfd700 1 --2- 172.21.15.82:0/611599905 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd5007ad10 0x7fcd50079170 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fcd440098a0 tx=0x7fcd44009bb0 comp rx=0 tx=0).stop 2023-09-23T08:46:17.760 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:17.236+0000 7fcd56bfd700 1 -- 172.21.15.82:0/611599905 shutdown_connections 2023-09-23T08:46:17.760 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:17.236+0000 7fcd56bfd700 1 --2- 172.21.15.82:0/611599905 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd5007ad10 0x7fcd50079170 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:46:17.760 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:17.236+0000 7fcd56bfd700 1 -- 172.21.15.82:0/611599905 >> 172.21.15.82:0/611599905 conn(0x7fcd501016b0 msgr2=0x7fcd50103ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:46:17.761 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:17.236+0000 7fcd56bfd700 1 -- 172.21.15.82:0/611599905 shutdown_connections 2023-09-23T08:46:17.761 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:17.236+0000 7fcd56bfd700 1 -- 172.21.15.82:0/611599905 wait complete. 2023-09-23T08:46:17.761 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:17.237+0000 7fcd56bfd700 1 Processor -- start 2023-09-23T08:46:17.761 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:17.238+0000 7fcd56bfd700 1 -- start start 2023-09-23T08:46:17.761 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:17.238+0000 7fcd56bfd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd5007ad10 0x7fcd5019b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:46:17.761 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:17.238+0000 7fcd56bfd700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5019bcf0 con 0x7fcd5007ad10 2023-09-23T08:46:17.761 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:17.238+0000 7fcd54999700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd5007ad10 0x7fcd5019b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:46:17.761 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:17.238+0000 7fcd54999700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd5007ad10 0x7fcd5019b7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59660/0 (socket says 172.21.15.82:59660) 2023-09-23T08:46:17.761 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:17.238+0000 7fcd54999700 1 -- 172.21.15.82:0/3684917645 learned_addr learned my addr 172.21.15.82:0/3684917645 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:46:17.761 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:17.238+0000 7fcd54999700 1 -- 172.21.15.82:0/3684917645 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd44009550 con 0x7fcd5007ad10 2023-09-23T08:46:17.761 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:17.239+0000 7fcd54999700 1 --2- 172.21.15.82:0/3684917645 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd5007ad10 0x7fcd5019b7b0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fcd5007a1e0 tx=0x7fcd44004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:46:17.761 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:17.239+0000 7fcd4dffb700 1 -- 172.21.15.82:0/3684917645 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcd44011630 con 0x7fcd5007ad10 2023-09-23T08:46:17.762 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:17.239+0000 7fcd4dffb700 1 -- 172.21.15.82:0/3684917645 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd44011790 con 0x7fcd5007ad10 2023-09-23T08:46:17.762 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:17.239+0000 7fcd56bfd700 1 -- 172.21.15.82:0/3684917645 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd5019bef0 con 0x7fcd5007ad10 2023-09-23T08:46:17.762 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:17.239+0000 7fcd4dffb700 1 -- 172.21.15.82:0/3684917645 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcd44011a30 con 0x7fcd5007ad10 2023-09-23T08:46:17.762 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:17.239+0000 7fcd56bfd700 1 -- 172.21.15.82:0/3684917645 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd5019c310 con 0x7fcd5007ad10 2023-09-23T08:46:17.762 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:17.239+0000 7fcd4dffb700 1 -- 172.21.15.82:0/3684917645 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fcd44022070 con 0x7fcd5007ad10 2023-09-23T08:46:17.762 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:17.239+0000 7fcd4dffb700 1 -- 172.21.15.82:0/3684917645 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fcd4401c450 con 0x7fcd5007ad10 2023-09-23T08:46:17.762 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:17.240+0000 7fcd56bfd700 1 -- 172.21.15.82:0/3684917645 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd501956b0 con 0x7fcd5007ad10 2023-09-23T08:46:17.762 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:17.243+0000 7fcd4dffb700 1 -- 172.21.15.82:0/3684917645 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fcd4401b450 con 0x7fcd5007ad10 2023-09-23T08:46:17.762 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:17.315+0000 7fcd56bfd700 1 -- 172.21.15.82:0/3684917645 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7fcd50079bf0 con 0x7fcd5007ad10 2023-09-23T08:46:17.763 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:17.315+0000 7fcd4dffb700 1 -- 172.21.15.82:0/3684917645 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+317 (secure 0 0 0) 0x7fcd4401b5f0 con 0x7fcd5007ad10 2023-09-23T08:46:17.763 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:17.316+0000 7fcd56bfd700 1 -- 172.21.15.82:0/3684917645 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd5007ad10 msgr2=0x7fcd5019b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:46:17.763 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:17.316+0000 7fcd56bfd700 1 --2- 172.21.15.82:0/3684917645 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd5007ad10 0x7fcd5019b7b0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fcd5007a1e0 tx=0x7fcd44004750 comp rx=0 tx=0).stop 2023-09-23T08:46:17.763 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:17.316+0000 7fcd56bfd700 1 -- 172.21.15.82:0/3684917645 shutdown_connections 2023-09-23T08:46:17.763 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:17.316+0000 7fcd56bfd700 1 --2- 172.21.15.82:0/3684917645 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd5007ad10 0x7fcd5019b7b0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:46:17.763 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:17.316+0000 7fcd56bfd700 1 -- 172.21.15.82:0/3684917645 >> 172.21.15.82:0/3684917645 conn(0x7fcd501016b0 msgr2=0x7fcd50103060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:46:17.763 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:17.316+0000 7fcd56bfd700 1 -- 172.21.15.82:0/3684917645 shutdown_connections 2023-09-23T08:46:17.763 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:17.316+0000 7fcd56bfd700 1 -- 172.21.15.82:0/3684917645 wait complete. 2023-09-23T08:46:17.763 INFO:teuthology.orchestra.run.smithi082.stdout:mon is available 2023-09-23T08:46:17.763 INFO:teuthology.orchestra.run.smithi082.stdout:Assimilating anything we can from ceph.conf... 2023-09-23T08:46:18.058 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:17 smithi082 ceph-mon[97183]: mon.a is new leader, mons a in quorum (ranks 0) 2023-09-23T08:46:18.058 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:17 smithi082 ceph-mon[97183]: monmap e1: 1 mons at {a=[v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0]} removed_ranks: {} 2023-09-23T08:46:18.059 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:17 smithi082 ceph-mon[97183]: fsmap 2023-09-23T08:46:18.059 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:17 smithi082 ceph-mon[97183]: osdmap e1: 0 total, 0 up, 0 in 2023-09-23T08:46:18.059 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:17 smithi082 ceph-mon[97183]: mgrmap e1: no daemons active 2023-09-23T08:46:18.059 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:17 smithi082 ceph-mon[97183]: from='client.? 172.21.15.82:0/3684917645' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2023-09-23T08:46:18.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:18 smithi082 ceph-mon[97183]: from='client.? 172.21.15.82:0/3828596616' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-09-23T08:46:18.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:18 smithi082 ceph-mon[97183]: from='client.? 172.21.15.82:0/3828596616' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2023-09-23T08:46:18.944 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2023-09-23T08:46:18.944 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout [global] 2023-09-23T08:46:18.944 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout fsid = 8926e286-59ed-11ee-8db4-212e2dc638e7 2023-09-23T08:46:18.945 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.82:3300,v1:172.21.15.82:6789] 2023-09-23T08:46:18.945 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-09-23T08:46:18.945 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-09-23T08:46:18.945 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-09-23T08:46:18.945 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-09-23T08:46:18.945 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2023-09-23T08:46:18.945 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout [mgr] 2023-09-23T08:46:18.945 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-09-23T08:46:18.945 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2023-09-23T08:46:18.945 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout [osd] 2023-09-23T08:46:18.945 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2023-09-23T08:46:18.945 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2023-09-23T08:46:18.946 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2023-09-23T08:46:18.946 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-09-23T08:46:18.946 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-09-23T08:46:18.946 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:18.323+0000 7fa1f4b6c700 1 Processor -- start 2023-09-23T08:46:18.946 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:18.324+0000 7fa1f4b6c700 1 -- start start 2023-09-23T08:46:18.946 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:18.324+0000 7fa1f4b6c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1f01060d0 0x7fa1f01064f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:46:18.946 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:18.324+0000 7fa1f4b6c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f0106ac0 con 0x7fa1f01060d0 2023-09-23T08:46:18.946 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:18.324+0000 7fa1ee59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1f01060d0 0x7fa1f01064f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:46:18.947 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:18.324+0000 7fa1ee59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1f01060d0 0x7fa1f01064f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59664/0 (socket says 172.21.15.82:59664) 2023-09-23T08:46:18.947 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:18.324+0000 7fa1ee59c700 1 -- 172.21.15.82:0/1501419552 learned_addr learned my addr 172.21.15.82:0/1501419552 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:46:18.947 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:18.325+0000 7fa1ee59c700 1 -- 172.21.15.82:0/1501419552 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f01072d0 con 0x7fa1f01060d0 2023-09-23T08:46:18.947 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:18.325+0000 7fa1ee59c700 1 --2- 172.21.15.82:0/1501419552 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1f01060d0 0x7fa1f01064f0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fa1e00098a0 tx=0x7fa1e0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8c7452361fdf17d server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:46:18.947 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:18.325+0000 7fa1ed59a700 1 -- 172.21.15.82:0/1501419552 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa1e0004160 con 0x7fa1f01060d0 2023-09-23T08:46:18.947 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:18.325+0000 7fa1ed59a700 1 -- 172.21.15.82:0/1501419552 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1e00042c0 con 0x7fa1f01060d0 2023-09-23T08:46:18.948 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:18.325+0000 7fa1ed59a700 1 -- 172.21.15.82:0/1501419552 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa1e00045a0 con 0x7fa1f01060d0 2023-09-23T08:46:18.948 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:18.326+0000 7fa1f4b6c700 1 -- 172.21.15.82:0/1501419552 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1f01060d0 msgr2=0x7fa1f01064f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:46:18.948 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:18.326+0000 7fa1f4b6c700 1 --2- 172.21.15.82:0/1501419552 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1f01060d0 0x7fa1f01064f0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fa1e00098a0 tx=0x7fa1e0009bb0 comp rx=0 tx=0).stop 2023-09-23T08:46:18.948 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:18.326+0000 7fa1f4b6c700 1 -- 172.21.15.82:0/1501419552 shutdown_connections 2023-09-23T08:46:18.948 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:18.326+0000 7fa1f4b6c700 1 --2- 172.21.15.82:0/1501419552 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1f01060d0 0x7fa1f01064f0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:46:18.949 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:18.326+0000 7fa1f4b6c700 1 -- 172.21.15.82:0/1501419552 >> 172.21.15.82:0/1501419552 conn(0x7fa1f01016b0 msgr2=0x7fa1f0103ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:46:18.949 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:18.326+0000 7fa1f4b6c700 1 -- 172.21.15.82:0/1501419552 shutdown_connections 2023-09-23T08:46:18.949 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:18.326+0000 7fa1f4b6c700 1 -- 172.21.15.82:0/1501419552 wait complete. 2023-09-23T08:46:18.949 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:18.327+0000 7fa1f4b6c700 1 Processor -- start 2023-09-23T08:46:18.949 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:18.327+0000 7fa1f4b6c700 1 -- start start 2023-09-23T08:46:18.949 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:18.327+0000 7fa1f4b6c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1f01060d0 0x7fa1f007aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:46:18.949 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:18.327+0000 7fa1f4b6c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f007b020 con 0x7fa1f01060d0 2023-09-23T08:46:18.949 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:18.328+0000 7fa1ee59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1f01060d0 0x7fa1f007aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:46:18.950 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:18.328+0000 7fa1ee59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1f01060d0 0x7fa1f007aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59668/0 (socket says 172.21.15.82:59668) 2023-09-23T08:46:18.950 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:18.328+0000 7fa1ee59c700 1 -- 172.21.15.82:0/3828596616 learned_addr learned my addr 172.21.15.82:0/3828596616 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:46:18.950 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:18.328+0000 7fa1ee59c700 1 -- 172.21.15.82:0/3828596616 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1e0009550 con 0x7fa1f01060d0 2023-09-23T08:46:18.950 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:18.328+0000 7fa1ee59c700 1 --2- 172.21.15.82:0/3828596616 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1f01060d0 0x7fa1f007aae0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fa1e0004000 tx=0x7fa1e0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:46:18.950 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:18.328+0000 7fa1df7fe700 1 -- 172.21.15.82:0/3828596616 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa1e0011630 con 0x7fa1f01060d0 2023-09-23T08:46:18.950 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:18.328+0000 7fa1df7fe700 1 -- 172.21.15.82:0/3828596616 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1e0011790 con 0x7fa1f01060d0 2023-09-23T08:46:18.950 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:18.328+0000 7fa1f4b6c700 1 -- 172.21.15.82:0/3828596616 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1f0079130 con 0x7fa1f01060d0 2023-09-23T08:46:18.951 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:18.328+0000 7fa1df7fe700 1 -- 172.21.15.82:0/3828596616 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa1e0011a30 con 0x7fa1f01060d0 2023-09-23T08:46:18.951 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:18.329+0000 7fa1f4b6c700 1 -- 172.21.15.82:0/3828596616 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1f0079550 con 0x7fa1f01060d0 2023-09-23T08:46:18.951 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:18.329+0000 7fa1df7fe700 1 -- 172.21.15.82:0/3828596616 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fa1e0022070 con 0x7fa1f01060d0 2023-09-23T08:46:18.951 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:18.329+0000 7fa1df7fe700 1 -- 172.21.15.82:0/3828596616 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fa1e001c450 con 0x7fa1f01060d0 2023-09-23T08:46:18.951 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:18.330+0000 7fa1f4b6c700 1 -- 172.21.15.82:0/3828596616 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1f0079f60 con 0x7fa1f01060d0 2023-09-23T08:46:18.951 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:18.332+0000 7fa1df7fe700 1 -- 172.21.15.82:0/3828596616 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fa1e001b450 con 0x7fa1f01060d0 2023-09-23T08:46:18.952 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:18.401+0000 7fa1f4b6c700 1 -- 172.21.15.82:0/3828596616 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7fa1f0107640 con 0x7fa1f01060d0 2023-09-23T08:46:18.952 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:18.405+0000 7fa1df7fe700 1 -- 172.21.15.82:0/3828596616 <== mon.0 v2:172.21.15.82:3300/0 7 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fa1e001b5f0 con 0x7fa1f01060d0 2023-09-23T08:46:18.952 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:18.405+0000 7fa1df7fe700 1 -- 172.21.15.82:0/3828596616 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+429 (secure 0 0 0) 0x7fa1e0037580 con 0x7fa1f01060d0 2023-09-23T08:46:18.952 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:18.407+0000 7fa1f4b6c700 1 -- 172.21.15.82:0/3828596616 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1f01060d0 msgr2=0x7fa1f007aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:46:18.952 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:18.407+0000 7fa1f4b6c700 1 --2- 172.21.15.82:0/3828596616 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1f01060d0 0x7fa1f007aae0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fa1e0004000 tx=0x7fa1e0004750 comp rx=0 tx=0).stop 2023-09-23T08:46:18.952 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:18.407+0000 7fa1f4b6c700 1 -- 172.21.15.82:0/3828596616 shutdown_connections 2023-09-23T08:46:18.952 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:18.407+0000 7fa1f4b6c700 1 --2- 172.21.15.82:0/3828596616 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1f01060d0 0x7fa1f007aae0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:46:18.952 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:18.407+0000 7fa1f4b6c700 1 -- 172.21.15.82:0/3828596616 >> 172.21.15.82:0/3828596616 conn(0x7fa1f01016b0 msgr2=0x7fa1f018da90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:46:18.952 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:18.407+0000 7fa1f4b6c700 1 -- 172.21.15.82:0/3828596616 shutdown_connections 2023-09-23T08:46:18.952 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:18.407+0000 7fa1f4b6c700 1 -- 172.21.15.82:0/3828596616 wait complete. 2023-09-23T08:46:18.953 INFO:teuthology.orchestra.run.smithi082.stdout:Generating new minimal ceph.conf... 2023-09-23T08:46:23.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:22 smithi082 ceph-mon[97183]: from='client.? 172.21.15.82:0/520580720' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:46:28.643 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:22.204+0000 7f52a2c97700 1 Processor -- start 2023-09-23T08:46:28.643 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:22.204+0000 7f52a2c97700 1 -- start start 2023-09-23T08:46:28.643 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:22.205+0000 7f52a2c97700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f529c07ad10 0x7f529c079170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:46:28.643 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:22.205+0000 7f52a2c97700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f529c079740 con 0x7f529c07ad10 2023-09-23T08:46:28.643 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:22.206+0000 7f52a0a33700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f529c07ad10 0x7f529c079170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:46:28.643 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:22.206+0000 7f52a0a33700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f529c07ad10 0x7f529c079170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52266/0 (socket says 172.21.15.82:52266) 2023-09-23T08:46:28.643 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:22.206+0000 7f52a0a33700 1 -- 172.21.15.82:0/2546931480 learned_addr learned my addr 172.21.15.82:0/2546931480 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:46:28.643 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:22.206+0000 7f52a0a33700 1 -- 172.21.15.82:0/2546931480 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f529c079880 con 0x7f529c07ad10 2023-09-23T08:46:28.644 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:22.206+0000 7f52a0a33700 1 --2- 172.21.15.82:0/2546931480 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f529c07ad10 0x7f529c079170 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f52900098a0 tx=0x7f5290009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67dba1be6942ef58 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:46:28.647 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:22.206+0000 7f529b7fe700 1 -- 172.21.15.82:0/2546931480 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5290004160 con 0x7f529c07ad10 2023-09-23T08:46:28.647 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:22.206+0000 7f529b7fe700 1 -- 172.21.15.82:0/2546931480 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f52900042c0 con 0x7f529c07ad10 2023-09-23T08:46:28.647 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:22.206+0000 7f529b7fe700 1 -- 172.21.15.82:0/2546931480 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5290011940 con 0x7f529c07ad10 2023-09-23T08:46:28.647 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:22.207+0000 7f52a2c97700 1 -- 172.21.15.82:0/2546931480 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f529c07ad10 msgr2=0x7f529c079170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:46:28.647 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:22.207+0000 7f52a2c97700 1 --2- 172.21.15.82:0/2546931480 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f529c07ad10 0x7f529c079170 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f52900098a0 tx=0x7f5290009bb0 comp rx=0 tx=0).stop 2023-09-23T08:46:28.648 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:22.207+0000 7f52a2c97700 1 -- 172.21.15.82:0/2546931480 shutdown_connections 2023-09-23T08:46:28.648 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:22.207+0000 7f52a2c97700 1 --2- 172.21.15.82:0/2546931480 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f529c07ad10 0x7f529c079170 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:46:28.648 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:22.207+0000 7f52a2c97700 1 -- 172.21.15.82:0/2546931480 >> 172.21.15.82:0/2546931480 conn(0x7f529c1016b0 msgr2=0x7f529c103ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:46:28.648 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:22.207+0000 7f52a2c97700 1 -- 172.21.15.82:0/2546931480 shutdown_connections 2023-09-23T08:46:28.648 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:22.207+0000 7f52a2c97700 1 -- 172.21.15.82:0/2546931480 wait complete. 2023-09-23T08:46:28.648 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:22.208+0000 7f52a2c97700 1 Processor -- start 2023-09-23T08:46:28.648 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:22.208+0000 7f52a2c97700 1 -- start start 2023-09-23T08:46:28.648 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:22.208+0000 7f52a2c97700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f529c07ad10 0x7f529c19beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:46:28.648 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:22.208+0000 7f52a2c97700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f529c19c3f0 con 0x7f529c07ad10 2023-09-23T08:46:28.648 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:22.209+0000 7f52a0a33700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f529c07ad10 0x7f529c19beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:46:28.649 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:22.209+0000 7f52a0a33700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f529c07ad10 0x7f529c19beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52274/0 (socket says 172.21.15.82:52274) 2023-09-23T08:46:28.649 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:22.209+0000 7f52a0a33700 1 -- 172.21.15.82:0/520580720 learned_addr learned my addr 172.21.15.82:0/520580720 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:46:28.649 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:22.209+0000 7f52a0a33700 1 -- 172.21.15.82:0/520580720 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5290009550 con 0x7f529c07ad10 2023-09-23T08:46:28.649 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:22.209+0000 7f52a0a33700 1 --2- 172.21.15.82:0/520580720 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f529c07ad10 0x7f529c19beb0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f5290006af0 tx=0x7f5290011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:46:28.649 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:22.209+0000 7f5299ffb700 1 -- 172.21.15.82:0/520580720 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5290003bf0 con 0x7f529c07ad10 2023-09-23T08:46:28.649 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:22.209+0000 7f5299ffb700 1 -- 172.21.15.82:0/520580720 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f529001b8b0 con 0x7f529c07ad10 2023-09-23T08:46:28.649 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:22.209+0000 7f52a2c97700 1 -- 172.21.15.82:0/520580720 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f529c19c5f0 con 0x7f529c07ad10 2023-09-23T08:46:28.649 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:22.209+0000 7f5299ffb700 1 -- 172.21.15.82:0/520580720 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5290019880 con 0x7f529c07ad10 2023-09-23T08:46:28.649 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:22.210+0000 7f52a2c97700 1 -- 172.21.15.82:0/520580720 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f529c19ca10 con 0x7f529c07ad10 2023-09-23T08:46:28.649 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:22.210+0000 7f5299ffb700 1 -- 172.21.15.82:0/520580720 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f52900233f0 con 0x7f529c07ad10 2023-09-23T08:46:28.649 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:22.210+0000 7f5299ffb700 1 -- 172.21.15.82:0/520580720 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f529001a710 con 0x7f529c07ad10 2023-09-23T08:46:28.649 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:22.211+0000 7f52a2c97700 1 -- 172.21.15.82:0/520580720 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f529c061f50 con 0x7f529c07ad10 2023-09-23T08:46:28.650 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:22.213+0000 7f5299ffb700 1 -- 172.21.15.82:0/520580720 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f5290028060 con 0x7f529c07ad10 2023-09-23T08:46:28.650 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:22.284+0000 7f52a2c97700 1 -- 172.21.15.82:0/520580720 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f529c10c460 con 0x7f529c07ad10 2023-09-23T08:46:28.650 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:22.284+0000 7f5299ffb700 1 -- 172.21.15.82:0/520580720 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+175 (secure 0 0 0) 0x7f529001bd70 con 0x7f529c07ad10 2023-09-23T08:46:28.650 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:22.285+0000 7f52a2c97700 1 -- 172.21.15.82:0/520580720 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f529c07ad10 msgr2=0x7f529c19beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:46:28.650 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:22.285+0000 7f52a2c97700 1 --2- 172.21.15.82:0/520580720 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f529c07ad10 0x7f529c19beb0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f5290006af0 tx=0x7f5290011a30 comp rx=0 tx=0).stop 2023-09-23T08:46:28.650 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:22.285+0000 7f52a2c97700 1 -- 172.21.15.82:0/520580720 shutdown_connections 2023-09-23T08:46:28.650 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:22.285+0000 7f52a2c97700 1 --2- 172.21.15.82:0/520580720 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f529c07ad10 0x7f529c19beb0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:46:28.650 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:22.285+0000 7f52a2c97700 1 -- 172.21.15.82:0/520580720 >> 172.21.15.82:0/520580720 conn(0x7f529c1016b0 msgr2=0x7f529c102460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:46:28.650 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:22.285+0000 7f52a2c97700 1 -- 172.21.15.82:0/520580720 shutdown_connections 2023-09-23T08:46:28.650 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:22.286+0000 7f52a2c97700 1 -- 172.21.15.82:0/520580720 wait complete. 2023-09-23T08:46:28.651 INFO:teuthology.orchestra.run.smithi082.stdout:Restarting the monitor... 2023-09-23T08:46:29.114 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:28 smithi082 systemd[1]: Stopping Ceph mon.a for 8926e286-59ed-11ee-8db4-212e2dc638e7... 2023-09-23T08:46:29.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:29 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mon-a[97159]: 2023-09-23T08:46:29.110+0000 7f23d4109700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-09-23T08:46:29.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:29 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mon-a[97159]: 2023-09-23T08:46:29.110+0000 7f23d4109700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-09-23T08:46:29.744 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:29 smithi082 bash[97520]: ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mon-a 2023-09-23T08:46:30.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:29 smithi082 systemd[1]: ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@mon.a.service: Succeeded. 2023-09-23T08:46:30.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:29 smithi082 systemd[1]: Stopped Ceph mon.a for 8926e286-59ed-11ee-8db4-212e2dc638e7. 2023-09-23T08:46:30.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:29 smithi082 systemd[1]: Starting Ceph mon.a for 8926e286-59ed-11ee-8db4-212e2dc638e7... 2023-09-23T08:46:30.652 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 podman[97654]: 2023-09-23T08:46:30.652 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 bash[97654]: 2a0ccc5d8371b70dbec1da36c1cf55d2f08bd5754e15ffa4a230c8c6508e4f66 2023-09-23T08:46:30.652 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: set uid:gid to 167:167 (ceph:ceph) 2023-09-23T08:46:30.662 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: ceph version 18.0.0-5661-gdb9a2d12 (db9a2d12746faa158579b8d032d53d472ae6b6b0) reef (dev), process ceph-mon, pid 7 2023-09-23T08:46:30.666 INFO:teuthology.orchestra.run.smithi082.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2023-09-23T08:46:30.917 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: pidfile_write: ignore empty --pid-file 2023-09-23T08:46:30.918 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: load: jerasure load: lrc 2023-09-23T08:46:30.918 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: RocksDB version: 7.9.2 2023-09-23T08:46:30.918 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Git sha 0 2023-09-23T08:46:30.918 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Compile date 2023-09-23 06:34:51 2023-09-23T08:46:30.918 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: DB SUMMARY 2023-09-23T08:46:30.918 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: DB Session ID: 1LD26FZ0L715CSPZIY05 2023-09-23T08:46:30.918 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: CURRENT file: CURRENT 2023-09-23T08:46:30.918 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: IDENTITY file: IDENTITY 2023-09-23T08:46:30.918 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2023-09-23T08:46:30.919 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2023-09-23T08:46:30.919 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 100041 ; 2023-09-23T08:46:30.919 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.error_if_exists: 0 2023-09-23T08:46:30.919 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.create_if_missing: 0 2023-09-23T08:46:30.919 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.paranoid_checks: 1 2023-09-23T08:46:30.919 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.flush_verify_memtable_count: 1 2023-09-23T08:46:30.919 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-09-23T08:46:30.919 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-09-23T08:46:30.919 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.env: 0x5622c7309da0 2023-09-23T08:46:30.919 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.fs: PosixFileSystem 2023-09-23T08:46:30.919 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.info_log: 0x5622c9265440 2023-09-23T08:46:30.920 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.max_file_opening_threads: 16 2023-09-23T08:46:30.920 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.statistics: (nil) 2023-09-23T08:46:30.920 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.use_fsync: 0 2023-09-23T08:46:30.920 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.max_log_file_size: 0 2023-09-23T08:46:30.920 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-09-23T08:46:30.920 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.log_file_time_to_roll: 0 2023-09-23T08:46:30.920 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.keep_log_file_num: 1000 2023-09-23T08:46:30.920 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.recycle_log_file_num: 0 2023-09-23T08:46:30.920 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.allow_fallocate: 1 2023-09-23T08:46:30.920 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.allow_mmap_reads: 0 2023-09-23T08:46:30.920 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.allow_mmap_writes: 0 2023-09-23T08:46:30.920 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.use_direct_reads: 0 2023-09-23T08:46:30.921 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-09-23T08:46:30.921 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.create_missing_column_families: 0 2023-09-23T08:46:30.921 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.db_log_dir: 2023-09-23T08:46:30.921 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.wal_dir: 2023-09-23T08:46:30.921 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.table_cache_numshardbits: 6 2023-09-23T08:46:30.921 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.WAL_ttl_seconds: 0 2023-09-23T08:46:30.921 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.WAL_size_limit_MB: 0 2023-09-23T08:46:30.921 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-09-23T08:46:30.921 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-09-23T08:46:30.921 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.is_fd_close_on_exec: 1 2023-09-23T08:46:30.921 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.advise_random_on_open: 1 2023-09-23T08:46:30.921 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.db_write_buffer_size: 0 2023-09-23T08:46:30.922 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.write_buffer_manager: 0x5622c921f4a0 2023-09-23T08:46:30.922 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-09-23T08:46:30.922 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-09-23T08:46:30.922 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.use_adaptive_mutex: 0 2023-09-23T08:46:30.922 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.rate_limiter: (nil) 2023-09-23T08:46:30.922 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-09-23T08:46:30.922 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.wal_recovery_mode: 2 2023-09-23T08:46:30.922 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.enable_thread_tracking: 0 2023-09-23T08:46:30.922 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.enable_pipelined_write: 0 2023-09-23T08:46:30.922 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.unordered_write: 0 2023-09-23T08:46:30.922 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-09-23T08:46:30.922 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-09-23T08:46:30.923 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-09-23T08:46:30.923 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-09-23T08:46:30.923 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.row_cache: None 2023-09-23T08:46:30.923 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.wal_filter: None 2023-09-23T08:46:30.923 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-09-23T08:46:30.923 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.allow_ingest_behind: 0 2023-09-23T08:46:30.923 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.two_write_queues: 0 2023-09-23T08:46:30.923 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.manual_wal_flush: 0 2023-09-23T08:46:30.923 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.wal_compression: 0 2023-09-23T08:46:30.923 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.atomic_flush: 0 2023-09-23T08:46:30.923 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-09-23T08:46:30.923 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.persist_stats_to_disk: 0 2023-09-23T08:46:30.924 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.write_dbid_to_manifest: 0 2023-09-23T08:46:30.924 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.log_readahead_size: 0 2023-09-23T08:46:30.924 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-09-23T08:46:30.924 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.best_efforts_recovery: 0 2023-09-23T08:46:30.924 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-09-23T08:46:30.924 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-09-23T08:46:30.924 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.allow_data_in_errors: 0 2023-09-23T08:46:30.924 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.db_host_id: __hostname__ 2023-09-23T08:46:30.924 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.enforce_single_del_contracts: true 2023-09-23T08:46:30.924 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.max_background_jobs: 2 2023-09-23T08:46:30.924 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.max_background_compactions: -1 2023-09-23T08:46:30.924 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.max_subcompactions: 1 2023-09-23T08:46:30.925 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-09-23T08:46:30.925 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-09-23T08:46:30.925 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.delayed_write_rate : 16777216 2023-09-23T08:46:30.925 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.max_total_wal_size: 0 2023-09-23T08:46:30.925 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-09-23T08:46:30.925 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.stats_dump_period_sec: 600 2023-09-23T08:46:30.925 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.stats_persist_period_sec: 600 2023-09-23T08:46:30.925 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-09-23T08:46:30.925 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.max_open_files: -1 2023-09-23T08:46:30.925 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.bytes_per_sync: 0 2023-09-23T08:46:30.925 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.wal_bytes_per_sync: 0 2023-09-23T08:46:30.925 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.strict_bytes_per_sync: 0 2023-09-23T08:46:30.926 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.compaction_readahead_size: 0 2023-09-23T08:46:30.926 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.max_background_flushes: -1 2023-09-23T08:46:30.926 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Compression algorithms supported: 2023-09-23T08:46:30.926 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-09-23T08:46:30.926 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: kZSTD supported: 0 2023-09-23T08:46:30.926 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: kXpressCompression supported: 0 2023-09-23T08:46:30.926 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: kLZ4HCCompression supported: 1 2023-09-23T08:46:30.926 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: kZlibCompression supported: 1 2023-09-23T08:46:30.926 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: kSnappyCompression supported: 1 2023-09-23T08:46:30.926 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: kLZ4Compression supported: 1 2023-09-23T08:46:30.926 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: kBZip2Compression supported: 0 2023-09-23T08:46:30.926 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Fast CRC32 supported: Supported on x86 2023-09-23T08:46:30.927 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: DMutex implementation: pthread_mutex_t 2023-09-23T08:46:30.927 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-09-23T08:46:30.927 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-09-23T08:46:30.927 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-09-23T08:46:30.927 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.merge_operator: 2023-09-23T08:46:30.927 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.compaction_filter: None 2023-09-23T08:46:30.927 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.compaction_filter_factory: None 2023-09-23T08:46:30.927 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.sst_partitioner_factory: None 2023-09-23T08:46:30.927 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.memtable_factory: SkipListFactory 2023-09-23T08:46:30.927 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.table_factory: BlockBasedTable 2023-09-23T08:46:30.927 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5622c9265540) 2023-09-23T08:46:30.927 INFO:journalctl@ceph.mon.a.smithi082.stdout: cache_index_and_filter_blocks: 1 2023-09-23T08:46:30.928 INFO:journalctl@ceph.mon.a.smithi082.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-09-23T08:46:30.928 INFO:journalctl@ceph.mon.a.smithi082.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-09-23T08:46:30.928 INFO:journalctl@ceph.mon.a.smithi082.stdout: pin_top_level_index_and_filter: 1 2023-09-23T08:46:30.928 INFO:journalctl@ceph.mon.a.smithi082.stdout: index_type: 0 2023-09-23T08:46:30.928 INFO:journalctl@ceph.mon.a.smithi082.stdout: data_block_index_type: 0 2023-09-23T08:46:30.928 INFO:journalctl@ceph.mon.a.smithi082.stdout: index_shortening: 1 2023-09-23T08:46:30.928 INFO:journalctl@ceph.mon.a.smithi082.stdout: data_block_hash_table_util_ratio: 0.750000 2023-09-23T08:46:30.928 INFO:journalctl@ceph.mon.a.smithi082.stdout: checksum: 4 2023-09-23T08:46:30.928 INFO:journalctl@ceph.mon.a.smithi082.stdout: no_block_cache: 0 2023-09-23T08:46:30.928 INFO:journalctl@ceph.mon.a.smithi082.stdout: block_cache: 0x5622c92bd1f0 2023-09-23T08:46:30.928 INFO:journalctl@ceph.mon.a.smithi082.stdout: block_cache_name: BinnedLRUCache 2023-09-23T08:46:30.928 INFO:journalctl@ceph.mon.a.smithi082.stdout: block_cache_options: 2023-09-23T08:46:30.929 INFO:journalctl@ceph.mon.a.smithi082.stdout: capacity : 536870912 2023-09-23T08:46:30.929 INFO:journalctl@ceph.mon.a.smithi082.stdout: num_shard_bits : 4 2023-09-23T08:46:30.929 INFO:journalctl@ceph.mon.a.smithi082.stdout: strict_capacity_limit : 0 2023-09-23T08:46:30.929 INFO:journalctl@ceph.mon.a.smithi082.stdout: high_pri_pool_ratio: 0.000 2023-09-23T08:46:30.929 INFO:journalctl@ceph.mon.a.smithi082.stdout: block_cache_compressed: (nil) 2023-09-23T08:46:30.929 INFO:journalctl@ceph.mon.a.smithi082.stdout: persistent_cache: (nil) 2023-09-23T08:46:30.929 INFO:journalctl@ceph.mon.a.smithi082.stdout: block_size: 4096 2023-09-23T08:46:30.929 INFO:journalctl@ceph.mon.a.smithi082.stdout: block_size_deviation: 10 2023-09-23T08:46:30.929 INFO:journalctl@ceph.mon.a.smithi082.stdout: block_restart_interval: 16 2023-09-23T08:46:30.929 INFO:journalctl@ceph.mon.a.smithi082.stdout: index_block_restart_interval: 1 2023-09-23T08:46:30.929 INFO:journalctl@ceph.mon.a.smithi082.stdout: metadata_block_size: 4096 2023-09-23T08:46:30.930 INFO:journalctl@ceph.mon.a.smithi082.stdout: partition_filters: 0 2023-09-23T08:46:30.930 INFO:journalctl@ceph.mon.a.smithi082.stdout: use_delta_encoding: 1 2023-09-23T08:46:30.930 INFO:journalctl@ceph.mon.a.smithi082.stdout: filter_policy: bloomfilter 2023-09-23T08:46:30.930 INFO:journalctl@ceph.mon.a.smithi082.stdout: whole_key_filtering: 1 2023-09-23T08:46:30.930 INFO:journalctl@ceph.mon.a.smithi082.stdout: verify_compression: 0 2023-09-23T08:46:30.930 INFO:journalctl@ceph.mon.a.smithi082.stdout: read_amp_bytes_per_bit: 0 2023-09-23T08:46:30.930 INFO:journalctl@ceph.mon.a.smithi082.stdout: format_version: 5 2023-09-23T08:46:30.930 INFO:journalctl@ceph.mon.a.smithi082.stdout: enable_index_compression: 1 2023-09-23T08:46:30.930 INFO:journalctl@ceph.mon.a.smithi082.stdout: block_align: 0 2023-09-23T08:46:30.930 INFO:journalctl@ceph.mon.a.smithi082.stdout: max_auto_readahead_size: 262144 2023-09-23T08:46:30.930 INFO:journalctl@ceph.mon.a.smithi082.stdout: prepopulate_block_cache: 0 2023-09-23T08:46:30.930 INFO:journalctl@ceph.mon.a.smithi082.stdout: initial_auto_readahead_size: 8192 2023-09-23T08:46:30.931 INFO:journalctl@ceph.mon.a.smithi082.stdout: num_file_reads_for_auto_readahead: 2 2023-09-23T08:46:30.931 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.write_buffer_size: 33554432 2023-09-23T08:46:30.931 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.max_write_buffer_number: 2 2023-09-23T08:46:30.931 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.compression: NoCompression 2023-09-23T08:46:30.931 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.bottommost_compression: Disabled 2023-09-23T08:46:30.931 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.prefix_extractor: nullptr 2023-09-23T08:46:30.931 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-09-23T08:46:30.931 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.num_levels: 7 2023-09-23T08:46:30.931 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-09-23T08:46:30.931 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-09-23T08:46:30.931 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-09-23T08:46:30.931 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-09-23T08:46:30.932 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-09-23T08:46:30.932 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-09-23T08:46:30.932 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-09-23T08:46:30.932 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-09-23T08:46:30.932 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-09-23T08:46:30.932 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-09-23T08:46:30.932 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-09-23T08:46:30.932 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-09-23T08:46:30.932 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.compression_opts.window_bits: -14 2023-09-23T08:46:30.932 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.compression_opts.level: 32767 2023-09-23T08:46:30.932 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.compression_opts.strategy: 0 2023-09-23T08:46:30.932 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-09-23T08:46:30.933 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-09-23T08:46:30.933 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-09-23T08:46:30.933 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-09-23T08:46:30.933 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.compression_opts.enabled: false 2023-09-23T08:46:30.933 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-09-23T08:46:30.933 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-09-23T08:46:30.933 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-09-23T08:46:30.933 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-09-23T08:46:30.933 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.target_file_size_base: 67108864 2023-09-23T08:46:30.933 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.target_file_size_multiplier: 1 2023-09-23T08:46:30.933 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-09-23T08:46:30.933 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-09-23T08:46:30.934 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-09-23T08:46:30.934 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-09-23T08:46:30.934 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-09-23T08:46:30.934 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-09-23T08:46:30.934 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-09-23T08:46:30.934 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-09-23T08:46:30.934 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-09-23T08:46:30.934 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-09-23T08:46:30.934 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-09-23T08:46:30.934 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-09-23T08:46:30.934 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-09-23T08:46:30.935 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.arena_block_size: 1048576 2023-09-23T08:46:30.935 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-09-23T08:46:30.935 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-09-23T08:46:30.935 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.disable_auto_compactions: 0 2023-09-23T08:46:30.935 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-09-23T08:46:30.935 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-09-23T08:46:30.935 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-09-23T08:46:30.935 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-09-23T08:46:30.935 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-09-23T08:46:30.936 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-09-23T08:46:30.936 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-09-23T08:46:30.936 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-09-23T08:46:30.936 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-09-23T08:46:30.936 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-09-23T08:46:30.936 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.table_properties_collectors: 2023-09-23T08:46:30.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.inplace_update_support: 0 2023-09-23T08:46:30.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.inplace_update_num_locks: 10000 2023-09-23T08:46:30.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-09-23T08:46:30.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-09-23T08:46:30.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.memtable_huge_page_size: 0 2023-09-23T08:46:30.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.bloom_locality: 0 2023-09-23T08:46:30.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.max_successive_merges: 0 2023-09-23T08:46:30.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.optimize_filters_for_hits: 0 2023-09-23T08:46:30.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.paranoid_file_checks: 0 2023-09-23T08:46:30.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.force_consistency_checks: 1 2023-09-23T08:46:30.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.report_bg_io_stats: 0 2023-09-23T08:46:30.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.ttl: 2592000 2023-09-23T08:46:30.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.periodic_compaction_seconds: 0 2023-09-23T08:46:30.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-09-23T08:46:30.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-09-23T08:46:30.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.enable_blob_files: false 2023-09-23T08:46:30.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.min_blob_size: 0 2023-09-23T08:46:30.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.blob_file_size: 268435456 2023-09-23T08:46:30.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.blob_compression_type: NoCompression 2023-09-23T08:46:30.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.enable_blob_garbage_collection: false 2023-09-23T08:46:30.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-09-23T08:46:30.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-09-23T08:46:30.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-09-23T08:46:30.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.blob_file_starting_level: 0 2023-09-23T08:46:30.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-09-23T08:46:30.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2023-09-23T08:46:30.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2023-09-23T08:46:30.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: df8c50ba-5df1-49e9-9108-2464a23a38ca 2023-09-23T08:46:30.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: EVENT_LOG_v1 {"time_micros": 1695458790659310, "job": 1, "event": "recovery_started", "wal_files": [9]} 2023-09-23T08:46:30.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2023-09-23T08:46:30.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 systemd[1]: Started Ceph mon.a for 8926e286-59ed-11ee-8db4-212e2dc638e7. 2023-09-23T08:46:30.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: EVENT_LOG_v1 {"time_micros": 1695458790661954, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 94773, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 334, "table_properties": {"data_size": 92771, "index_size": 284, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13755, "raw_average_key_size": 49, "raw_value_size": 85265, "raw_average_value_size": 307, "num_data_blocks": 11, "num_entries": 277, "num_filter_entries": 277, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1695458790, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "df8c50ba-5df1-49e9-9108-2464a23a38ca", "db_session_id": "1LD26FZ0L715CSPZIY05", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2023-09-23T08:46:30.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: EVENT_LOG_v1 {"time_micros": 1695458790662135, "job": 1, "event": "recovery_finished"} 2023-09-23T08:46:30.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2023-09-23T08:46:30.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-09-23T08:46:30.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5622c935a000 2023-09-23T08:46:30.940 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: DB pointer 0x5622c9346000 2023-09-23T08:46:30.940 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-09-23T08:46:30.940 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-09-23T08:46:30.940 INFO:journalctl@ceph.mon.a.smithi082.stdout: ** DB Stats ** 2023-09-23T08:46:30.940 INFO:journalctl@ceph.mon.a.smithi082.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-09-23T08:46:30.940 INFO:journalctl@ceph.mon.a.smithi082.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-09-23T08:46:30.940 INFO:journalctl@ceph.mon.a.smithi082.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-09-23T08:46:30.940 INFO:journalctl@ceph.mon.a.smithi082.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-09-23T08:46:30.940 INFO:journalctl@ceph.mon.a.smithi082.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-09-23T08:46:30.940 INFO:journalctl@ceph.mon.a.smithi082.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-09-23T08:46:30.940 INFO:journalctl@ceph.mon.a.smithi082.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-09-23T08:46:30.941 INFO:journalctl@ceph.mon.a.smithi082.stdout: 2023-09-23T08:46:30.941 INFO:journalctl@ceph.mon.a.smithi082.stdout: ** Compaction Stats [default] ** 2023-09-23T08:46:30.941 INFO:journalctl@ceph.mon.a.smithi082.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-09-23T08:46:30.941 INFO:journalctl@ceph.mon.a.smithi082.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-09-23T08:46:30.941 INFO:journalctl@ceph.mon.a.smithi082.stdout: L0 2/0 94.39 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 45.1 0.00 0.00 1 0.002 0 0 0.0 0.0 2023-09-23T08:46:30.941 INFO:journalctl@ceph.mon.a.smithi082.stdout: Sum 2/0 94.39 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 45.1 0.00 0.00 1 0.002 0 0 0.0 0.0 2023-09-23T08:46:30.941 INFO:journalctl@ceph.mon.a.smithi082.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 45.1 0.00 0.00 1 0.002 0 0 0.0 0.0 2023-09-23T08:46:30.941 INFO:journalctl@ceph.mon.a.smithi082.stdout: 2023-09-23T08:46:30.941 INFO:journalctl@ceph.mon.a.smithi082.stdout: ** Compaction Stats [default] ** 2023-09-23T08:46:30.941 INFO:journalctl@ceph.mon.a.smithi082.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-09-23T08:46:30.941 INFO:journalctl@ceph.mon.a.smithi082.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-09-23T08:46:30.941 INFO:journalctl@ceph.mon.a.smithi082.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 45.1 0.00 0.00 1 0.002 0 0 0.0 0.0 2023-09-23T08:46:30.942 INFO:journalctl@ceph.mon.a.smithi082.stdout: 2023-09-23T08:46:30.942 INFO:journalctl@ceph.mon.a.smithi082.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-09-23T08:46:30.942 INFO:journalctl@ceph.mon.a.smithi082.stdout: 2023-09-23T08:46:30.942 INFO:journalctl@ceph.mon.a.smithi082.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-09-23T08:46:30.942 INFO:journalctl@ceph.mon.a.smithi082.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-09-23T08:46:30.942 INFO:journalctl@ceph.mon.a.smithi082.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-09-23T08:46:30.942 INFO:journalctl@ceph.mon.a.smithi082.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-09-23T08:46:30.942 INFO:journalctl@ceph.mon.a.smithi082.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-09-23T08:46:30.942 INFO:journalctl@ceph.mon.a.smithi082.stdout: AddFile(Keys): cumulative 0, interval 0 2023-09-23T08:46:30.942 INFO:journalctl@ceph.mon.a.smithi082.stdout: Cumulative compaction: 0.00 GB write, 11.73 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-09-23T08:46:30.942 INFO:journalctl@ceph.mon.a.smithi082.stdout: Interval compaction: 0.00 GB write, 11.73 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-09-23T08:46:30.943 INFO:journalctl@ceph.mon.a.smithi082.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-09-23T08:46:30.943 INFO:journalctl@ceph.mon.a.smithi082.stdout: Block cache BinnedLRUCache@0x5622c92bd1f0#7 capacity: 512.00 MB usage: 1.36 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.2e-05 secs_since: 0 2023-09-23T08:46:30.943 INFO:journalctl@ceph.mon.a.smithi082.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.89 KB,0.000169873%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2023-09-23T08:46:30.943 INFO:journalctl@ceph.mon.a.smithi082.stdout: 2023-09-23T08:46:30.943 INFO:journalctl@ceph.mon.a.smithi082.stdout: ** File Read Latency Histogram By Level [default] ** 2023-09-23T08:46:30.943 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: starting mon.a rank 0 at public addrs [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] at bind addrs [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 2023-09-23T08:46:30.943 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: mon.a@-1(???) e1 preinit fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 2023-09-23T08:46:30.943 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: mon.a@-1(???).mds e1 new map 2023-09-23T08:46:30.943 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: mon.a@-1(???).mds e1 print_map 2023-09-23T08:46:30.943 INFO:journalctl@ceph.mon.a.smithi082.stdout: e1 2023-09-23T08:46:30.943 INFO:journalctl@ceph.mon.a.smithi082.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-09-23T08:46:30.944 INFO:journalctl@ceph.mon.a.smithi082.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-09-23T08:46:30.944 INFO:journalctl@ceph.mon.a.smithi082.stdout: legacy client fscid: -1 2023-09-23T08:46:30.944 INFO:journalctl@ceph.mon.a.smithi082.stdout: 2023-09-23T08:46:30.944 INFO:journalctl@ceph.mon.a.smithi082.stdout: No filesystems configured 2023-09-23T08:46:30.944 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2023-09-23T08:46:30.944 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-09-23T08:46:30.944 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-09-23T08:46:30.944 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-09-23T08:46:30.944 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2023-09-23T08:46:30.944 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: mon.a is new leader, mons a in quorum (ranks 0) 2023-09-23T08:46:30.944 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: monmap e1: 1 mons at {a=[v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0]} removed_ranks: {} 2023-09-23T08:46:30.944 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: fsmap 2023-09-23T08:46:30.945 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: osdmap e1: 0 total, 0 up, 0 in 2023-09-23T08:46:30.945 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:30 smithi082 ceph-mon[97694]: mgrmap e1: no daemons active 2023-09-23T08:46:31.651 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:31.184+0000 7faef470f700 1 Processor -- start 2023-09-23T08:46:31.651 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:31.184+0000 7faef470f700 1 -- start start 2023-09-23T08:46:31.651 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:31.184+0000 7faef470f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faeec1060e0 0x7faeec106500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:46:31.651 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:31.184+0000 7faef470f700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeec106ad0 con 0x7faeec1060e0 2023-09-23T08:46:31.651 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:31.185+0000 7faef24ab700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faeec1060e0 0x7faeec106500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:46:31.651 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:31.185+0000 7faef24ab700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faeec1060e0 0x7faeec106500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52288/0 (socket says 172.21.15.82:52288) 2023-09-23T08:46:31.651 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:31.185+0000 7faef24ab700 1 -- 172.21.15.82:0/3818821743 learned_addr learned my addr 172.21.15.82:0/3818821743 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:46:31.651 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:31.185+0000 7faef24ab700 1 -- 172.21.15.82:0/3818821743 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeec1072e0 con 0x7faeec1060e0 2023-09-23T08:46:31.651 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:31.185+0000 7faef24ab700 1 --2- 172.21.15.82:0/3818821743 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faeec1060e0 0x7faeec106500 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7faee80098a0 tx=0x7faee8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd5a6b95c1344ee7 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:46:31.652 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:31.186+0000 7faef14a9700 1 -- 172.21.15.82:0/3818821743 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faee8004160 con 0x7faeec1060e0 2023-09-23T08:46:31.652 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:31.186+0000 7faef14a9700 1 -- 172.21.15.82:0/3818821743 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7faee80042c0 con 0x7faeec1060e0 2023-09-23T08:46:31.652 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:31.186+0000 7faef14a9700 1 -- 172.21.15.82:0/3818821743 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faee8011940 con 0x7faeec1060e0 2023-09-23T08:46:31.652 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:31.186+0000 7faef470f700 1 -- 172.21.15.82:0/3818821743 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faeec1060e0 msgr2=0x7faeec106500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:46:31.652 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:31.186+0000 7faef470f700 1 --2- 172.21.15.82:0/3818821743 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faeec1060e0 0x7faeec106500 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7faee80098a0 tx=0x7faee8009bb0 comp rx=0 tx=0).stop 2023-09-23T08:46:31.652 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:31.186+0000 7faef470f700 1 -- 172.21.15.82:0/3818821743 shutdown_connections 2023-09-23T08:46:31.652 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:31.186+0000 7faef470f700 1 --2- 172.21.15.82:0/3818821743 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faeec1060e0 0x7faeec106500 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:46:31.652 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:31.186+0000 7faef470f700 1 -- 172.21.15.82:0/3818821743 >> 172.21.15.82:0/3818821743 conn(0x7faeec1016a0 msgr2=0x7faeec103ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:46:31.652 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:31.186+0000 7faef470f700 1 -- 172.21.15.82:0/3818821743 shutdown_connections 2023-09-23T08:46:31.652 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:31.186+0000 7faef470f700 1 -- 172.21.15.82:0/3818821743 wait complete. 2023-09-23T08:46:31.652 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:31.188+0000 7faef470f700 1 Processor -- start 2023-09-23T08:46:31.653 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:31.188+0000 7faef470f700 1 -- start start 2023-09-23T08:46:31.653 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:31.188+0000 7faef470f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faeec1060e0 0x7faeec07aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:46:31.653 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:31.188+0000 7faef470f700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeec07b020 con 0x7faeec1060e0 2023-09-23T08:46:31.653 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:31.188+0000 7faef24ab700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faeec1060e0 0x7faeec07aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:46:31.653 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:31.188+0000 7faef24ab700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faeec1060e0 0x7faeec07aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52292/0 (socket says 172.21.15.82:52292) 2023-09-23T08:46:31.653 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:31.188+0000 7faef24ab700 1 -- 172.21.15.82:0/2080611345 learned_addr learned my addr 172.21.15.82:0/2080611345 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:46:31.653 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:31.189+0000 7faef24ab700 1 -- 172.21.15.82:0/2080611345 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faee8009550 con 0x7faeec1060e0 2023-09-23T08:46:31.653 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:31.189+0000 7faef24ab700 1 --2- 172.21.15.82:0/2080611345 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faeec1060e0 0x7faeec07aae0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7faee8000c00 tx=0x7faee8011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:46:31.653 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:31.189+0000 7faee37fe700 1 -- 172.21.15.82:0/2080611345 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faee80036a0 con 0x7faeec1060e0 2023-09-23T08:46:31.653 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:31.189+0000 7faee37fe700 1 -- 172.21.15.82:0/2080611345 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7faee8003c70 con 0x7faeec1060e0 2023-09-23T08:46:31.653 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:31.189+0000 7faee37fe700 1 -- 172.21.15.82:0/2080611345 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faee80193f0 con 0x7faeec1060e0 2023-09-23T08:46:31.653 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:31.189+0000 7faef470f700 1 -- 172.21.15.82:0/2080611345 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faeec079130 con 0x7faeec1060e0 2023-09-23T08:46:31.654 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:31.189+0000 7faef470f700 1 -- 172.21.15.82:0/2080611345 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faeec079550 con 0x7faeec1060e0 2023-09-23T08:46:31.654 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:31.190+0000 7faee37fe700 1 -- 172.21.15.82:0/2080611345 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7faee8019920 con 0x7faeec1060e0 2023-09-23T08:46:31.654 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:31.190+0000 7faee37fe700 1 -- 172.21.15.82:0/2080611345 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7faee8003800 con 0x7faeec1060e0 2023-09-23T08:46:31.654 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:31.190+0000 7faef470f700 1 -- 172.21.15.82:0/2080611345 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faeec061f50 con 0x7faeec1060e0 2023-09-23T08:46:31.654 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:31.193+0000 7faee37fe700 1 -- 172.21.15.82:0/2080611345 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7faee8029060 con 0x7faeec1060e0 2023-09-23T08:46:31.654 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:31.263+0000 7faef470f700 1 -- 172.21.15.82:0/2080611345 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7faeec10a510 con 0x7faeec1060e0 2023-09-23T08:46:31.654 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:31.266+0000 7faee37fe700 1 -- 172.21.15.82:0/2080611345 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7faee80330c0 con 0x7faeec1060e0 2023-09-23T08:46:31.654 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:31.267+0000 7faef470f700 1 -- 172.21.15.82:0/2080611345 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faeec1060e0 msgr2=0x7faeec07aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:46:31.654 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:31.267+0000 7faef470f700 1 --2- 172.21.15.82:0/2080611345 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faeec1060e0 0x7faeec07aae0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7faee8000c00 tx=0x7faee8011e70 comp rx=0 tx=0).stop 2023-09-23T08:46:31.654 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:31.267+0000 7faef470f700 1 -- 172.21.15.82:0/2080611345 shutdown_connections 2023-09-23T08:46:31.654 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:31.267+0000 7faef470f700 1 --2- 172.21.15.82:0/2080611345 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faeec1060e0 0x7faeec07aae0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:46:31.655 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:31.267+0000 7faef470f700 1 -- 172.21.15.82:0/2080611345 >> 172.21.15.82:0/2080611345 conn(0x7faeec1016a0 msgr2=0x7faeec102400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:46:31.655 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:31.267+0000 7faef470f700 1 -- 172.21.15.82:0/2080611345 shutdown_connections 2023-09-23T08:46:31.655 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:31.267+0000 7faef470f700 1 -- 172.21.15.82:0/2080611345 wait complete. 2023-09-23T08:46:31.655 INFO:teuthology.orchestra.run.smithi082.stdout:Wrote config to /etc/ceph/ceph.conf 2023-09-23T08:46:31.676 INFO:teuthology.orchestra.run.smithi082.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2023-09-23T08:46:31.676 INFO:teuthology.orchestra.run.smithi082.stdout:Creating mgr... 2023-09-23T08:46:31.676 INFO:teuthology.orchestra.run.smithi082.stdout:Verifying port 0.0.0.0:9283 ... 2023-09-23T08:46:31.677 INFO:teuthology.orchestra.run.smithi082.stdout:Verifying port 0.0.0.0:8765 ... 2023-09-23T08:46:32.057 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@mgr.x 2023-09-23T08:46:32.057 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stderr Failed to reset failed state of unit ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@mgr.x.service: Unit ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@mgr.x.service not loaded. 2023-09-23T08:46:32.258 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-8926e286-59ed-11ee-8db4-212e2dc638e7.target.wants/ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@mgr.x.service → /etc/systemd/system/ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@.service. 2023-09-23T08:46:32.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:32 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/2080611345' entity='client.admin' 2023-09-23T08:46:32.371 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:46:32 smithi082 systemd[1]: Starting Ceph mgr.x for 8926e286-59ed-11ee-8db4-212e2dc638e7... 2023-09-23T08:46:33.045 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:46:32 smithi082 podman[97924]: 2023-09-23T08:46:33.045 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:46:33 smithi082 bash[97924]: d3678f5583e02c7e2dc9cda2f4978b0282528317c480dbc0a717d855eb1f53c0 2023-09-23T08:46:33.069 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-09-23T08:46:33.069 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout disabled 2023-09-23T08:46:33.085 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-09-23T08:46:33.085 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout inactive 2023-09-23T08:46:33.085 INFO:teuthology.orchestra.run.smithi082.stdout:firewalld.service is not enabled 2023-09-23T08:46:33.085 INFO:teuthology.orchestra.run.smithi082.stdout:Not possible to enable service . firewalld.service is not available 2023-09-23T08:46:33.103 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-09-23T08:46:33.103 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout disabled 2023-09-23T08:46:33.119 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-09-23T08:46:33.119 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout inactive 2023-09-23T08:46:33.119 INFO:teuthology.orchestra.run.smithi082.stdout:firewalld.service is not enabled 2023-09-23T08:46:33.119 INFO:teuthology.orchestra.run.smithi082.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2023-09-23T08:46:33.119 INFO:teuthology.orchestra.run.smithi082.stdout:Waiting for mgr to start... 2023-09-23T08:46:33.120 INFO:teuthology.orchestra.run.smithi082.stdout:Waiting for mgr... 2023-09-23T08:46:33.313 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:46:33 smithi082 systemd[1]: Started Ceph mgr.x for 8926e286-59ed-11ee-8db4-212e2dc638e7. 2023-09-23T08:46:33.313 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:46:33 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:46:33.206+0000 7f47de86a200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-09-23T08:46:33.313 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:46:33 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:46:33.309+0000 7f47de86a200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-09-23T08:46:33.620 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:46:33 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:46:33.427+0000 7f47de86a200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-09-23T08:46:33.621 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:46:33 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:46:33.559+0000 7f47de86a200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-09-23T08:46:34.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:33 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/1672145021' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-09-23T08:46:34.121 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:46:33 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:46:33.789+0000 7f47de86a200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-09-23T08:46:34.303 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2023-09-23T08:46:34.306 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout { 2023-09-23T08:46:34.306 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "fsid": "8926e286-59ed-11ee-8db4-212e2dc638e7", 2023-09-23T08:46:34.306 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "health": { 2023-09-23T08:46:34.306 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-09-23T08:46:34.306 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-09-23T08:46:34.306 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-09-23T08:46:34.306 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2023-09-23T08:46:34.306 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-09-23T08:46:34.306 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-09-23T08:46:34.306 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 0 2023-09-23T08:46:34.307 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2023-09-23T08:46:34.307 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-09-23T08:46:34.307 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "a" 2023-09-23T08:46:34.307 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2023-09-23T08:46:34.307 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2023-09-23T08:46:34.307 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "monmap": { 2023-09-23T08:46:34.307 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-09-23T08:46:34.307 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-09-23T08:46:34.307 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-09-23T08:46:34.307 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2023-09-23T08:46:34.307 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-09-23T08:46:34.307 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-09-23T08:46:34.308 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-09-23T08:46:34.309 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-09-23T08:46:34.309 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-09-23T08:46:34.309 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-09-23T08:46:34.309 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-09-23T08:46:34.309 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-09-23T08:46:34.309 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2023-09-23T08:46:34.309 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-09-23T08:46:34.309 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-09-23T08:46:34.309 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-09-23T08:46:34.309 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-09-23T08:46:34.316 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-09-23T08:46:34.316 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-09-23T08:46:34.316 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-09-23T08:46:34.316 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-09-23T08:46:34.316 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-09-23T08:46:34.317 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2023-09-23T08:46:34.317 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-09-23T08:46:34.317 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-09-23T08:46:34.317 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-09-23T08:46:34.317 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-09-23T08:46:34.317 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2023-09-23T08:46:34.317 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-09-23T08:46:34.317 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "available": false, 2023-09-23T08:46:34.317 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-09-23T08:46:34.317 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "modules": [ 2023-09-23T08:46:34.317 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "iostat", 2023-09-23T08:46:34.317 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "nfs", 2023-09-23T08:46:34.318 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "restful" 2023-09-23T08:46:34.318 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2023-09-23T08:46:34.318 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "services": {} 2023-09-23T08:46:34.318 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2023-09-23T08:46:34.318 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-09-23T08:46:34.318 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-09-23T08:46:34.318 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "modified": "2023-09-23T08:46:16.628578+0000", 2023-09-23T08:46:34.318 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "services": {} 2023-09-23T08:46:34.318 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2023-09-23T08:46:34.318 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-09-23T08:46:34.318 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout } 2023-09-23T08:46:34.319 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:33.709+0000 7f77c1d25700 1 Processor -- start 2023-09-23T08:46:34.319 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:33.709+0000 7f77c1d25700 1 -- start start 2023-09-23T08:46:34.319 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:33.710+0000 7f77c1d25700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77bc1060d0 0x7f77bc1064f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:46:34.319 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:33.710+0000 7f77c1d25700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77bc106ac0 con 0x7f77bc1060d0 2023-09-23T08:46:34.319 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:33.710+0000 7f77bb7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77bc1060d0 0x7f77bc1064f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:46:34.319 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:33.710+0000 7f77bb7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77bc1060d0 0x7f77bc1064f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45122/0 (socket says 172.21.15.82:45122) 2023-09-23T08:46:34.319 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:33.710+0000 7f77bb7fe700 1 -- 172.21.15.82:0/1428425581 learned_addr learned my addr 172.21.15.82:0/1428425581 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:46:34.319 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:33.710+0000 7f77bb7fe700 1 -- 172.21.15.82:0/1428425581 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77bc1072d0 con 0x7f77bc1060d0 2023-09-23T08:46:34.319 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:33.711+0000 7f77bb7fe700 1 --2- 172.21.15.82:0/1428425581 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77bc1060d0 0x7f77bc1064f0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f77ac0098a0 tx=0x7f77ac009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=589819fdf145dee5 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:46:34.319 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:33.711+0000 7f77ba7fc700 1 -- 172.21.15.82:0/1428425581 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f77ac004160 con 0x7f77bc1060d0 2023-09-23T08:46:34.319 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:33.711+0000 7f77ba7fc700 1 -- 172.21.15.82:0/1428425581 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f77ac0042c0 con 0x7f77bc1060d0 2023-09-23T08:46:34.319 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:33.711+0000 7f77ba7fc700 1 -- 172.21.15.82:0/1428425581 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f77ac011940 con 0x7f77bc1060d0 2023-09-23T08:46:34.320 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:33.711+0000 7f77c1d25700 1 -- 172.21.15.82:0/1428425581 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77bc1060d0 msgr2=0x7f77bc1064f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:46:34.320 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:33.711+0000 7f77c1d25700 1 --2- 172.21.15.82:0/1428425581 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77bc1060d0 0x7f77bc1064f0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f77ac0098a0 tx=0x7f77ac009bb0 comp rx=0 tx=0).stop 2023-09-23T08:46:34.320 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:33.712+0000 7f77c1d25700 1 -- 172.21.15.82:0/1428425581 shutdown_connections 2023-09-23T08:46:34.320 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:33.712+0000 7f77c1d25700 1 --2- 172.21.15.82:0/1428425581 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77bc1060d0 0x7f77bc1064f0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:46:34.320 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:33.712+0000 7f77c1d25700 1 -- 172.21.15.82:0/1428425581 >> 172.21.15.82:0/1428425581 conn(0x7f77bc1016b0 msgr2=0x7f77bc103ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:46:34.320 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:33.712+0000 7f77c1d25700 1 -- 172.21.15.82:0/1428425581 shutdown_connections 2023-09-23T08:46:34.320 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:33.712+0000 7f77c1d25700 1 -- 172.21.15.82:0/1428425581 wait complete. 2023-09-23T08:46:34.320 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:33.713+0000 7f77c1d25700 1 Processor -- start 2023-09-23T08:46:34.320 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:33.713+0000 7f77c1d25700 1 -- start start 2023-09-23T08:46:34.320 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:33.713+0000 7f77c1d25700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77bc1060d0 0x7f77bc19bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:46:34.320 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:33.713+0000 7f77c1d25700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77bc19c420 con 0x7f77bc1060d0 2023-09-23T08:46:34.320 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:33.714+0000 7f77bb7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77bc1060d0 0x7f77bc19bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:46:34.321 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:33.714+0000 7f77bb7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77bc1060d0 0x7f77bc19bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45130/0 (socket says 172.21.15.82:45130) 2023-09-23T08:46:34.321 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:33.714+0000 7f77bb7fe700 1 -- 172.21.15.82:0/1672145021 learned_addr learned my addr 172.21.15.82:0/1672145021 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:46:34.321 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:33.714+0000 7f77bb7fe700 1 -- 172.21.15.82:0/1672145021 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77ac009550 con 0x7f77bc1060d0 2023-09-23T08:46:34.321 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:33.714+0000 7f77bb7fe700 1 --2- 172.21.15.82:0/1672145021 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77bc1060d0 0x7f77bc19bee0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f77ac000c00 tx=0x7f77ac011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:46:34.321 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:33.714+0000 7f77b8ff9700 1 -- 172.21.15.82:0/1672145021 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f77ac0036a0 con 0x7f77bc1060d0 2023-09-23T08:46:34.321 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:33.714+0000 7f77b8ff9700 1 -- 172.21.15.82:0/1672145021 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f77ac01b440 con 0x7f77bc1060d0 2023-09-23T08:46:34.321 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:33.714+0000 7f77c1d25700 1 -- 172.21.15.82:0/1672145021 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77bc19c620 con 0x7f77bc1060d0 2023-09-23T08:46:34.321 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:33.715+0000 7f77b8ff9700 1 -- 172.21.15.82:0/1672145021 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f77ac0193f0 con 0x7f77bc1060d0 2023-09-23T08:46:34.321 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:33.715+0000 7f77c1d25700 1 -- 172.21.15.82:0/1672145021 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77bc19ca40 con 0x7f77bc1060d0 2023-09-23T08:46:34.321 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:33.715+0000 7f77b8ff9700 1 -- 172.21.15.82:0/1672145021 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f77ac019930 con 0x7f77bc1060d0 2023-09-23T08:46:34.321 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:33.715+0000 7f77b8ff9700 1 -- 172.21.15.82:0/1672145021 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f77ac01a3d0 con 0x7f77bc1060d0 2023-09-23T08:46:34.322 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:33.716+0000 7f77c1d25700 1 -- 172.21.15.82:0/1672145021 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77bc061f50 con 0x7f77bc1060d0 2023-09-23T08:46:34.322 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:33.718+0000 7f77b8ff9700 1 -- 172.21.15.82:0/1672145021 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f77ac029060 con 0x7f77bc1060d0 2023-09-23T08:46:34.322 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:33.793+0000 7f77c1d25700 1 -- 172.21.15.82:0/1672145021 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f77bc19f660 con 0x7f77bc1060d0 2023-09-23T08:46:34.322 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:33.794+0000 7f77b8ff9700 1 -- 172.21.15.82:0/1672145021 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f77ac01f070 con 0x7f77bc1060d0 2023-09-23T08:46:34.322 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:33.795+0000 7f77c1d25700 1 -- 172.21.15.82:0/1672145021 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77bc1060d0 msgr2=0x7f77bc19bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:46:34.322 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:33.795+0000 7f77c1d25700 1 --2- 172.21.15.82:0/1672145021 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77bc1060d0 0x7f77bc19bee0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f77ac000c00 tx=0x7f77ac011e70 comp rx=0 tx=0).stop 2023-09-23T08:46:34.322 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:33.795+0000 7f77c1d25700 1 -- 172.21.15.82:0/1672145021 shutdown_connections 2023-09-23T08:46:34.322 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:33.795+0000 7f77c1d25700 1 --2- 172.21.15.82:0/1672145021 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77bc1060d0 0x7f77bc19bee0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:46:34.322 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:33.795+0000 7f77c1d25700 1 -- 172.21.15.82:0/1672145021 >> 172.21.15.82:0/1672145021 conn(0x7f77bc1016b0 msgr2=0x7f77bc102420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:46:34.322 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:33.795+0000 7f77c1d25700 1 -- 172.21.15.82:0/1672145021 shutdown_connections 2023-09-23T08:46:34.322 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:33.795+0000 7f77c1d25700 1 -- 172.21.15.82:0/1672145021 wait complete. 2023-09-23T08:46:34.322 INFO:teuthology.orchestra.run.smithi082.stdout:mgr not available, waiting (1/15)... 2023-09-23T08:46:34.566 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:46:34 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:46:34.276+0000 7f47de86a200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-09-23T08:46:34.567 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:46:34 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:46:34.449+0000 7f47de86a200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-09-23T08:46:34.567 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:46:34 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:46:34.563+0000 7f47de86a200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-09-23T08:46:34.870 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:46:34 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:46:34.685+0000 7f47de86a200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-09-23T08:46:35.620 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:46:35 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:46:35.220+0000 7f47de86a200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-09-23T08:46:36.370 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:46:36 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:46:36.090+0000 7f47de86a200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-09-23T08:46:36.371 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:46:36 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:46:36.194+0000 7f47de86a200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-09-23T08:46:37.315 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:37 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/3798979692' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-09-23T08:46:37.315 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:46:37 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:46:37.192+0000 7f47de86a200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-09-23T08:46:37.497 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2023-09-23T08:46:37.497 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout { 2023-09-23T08:46:37.497 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "fsid": "8926e286-59ed-11ee-8db4-212e2dc638e7", 2023-09-23T08:46:37.498 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "health": { 2023-09-23T08:46:37.498 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-09-23T08:46:37.498 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-09-23T08:46:37.498 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-09-23T08:46:37.498 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2023-09-23T08:46:37.498 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-09-23T08:46:37.498 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-09-23T08:46:37.498 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 0 2023-09-23T08:46:37.498 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2023-09-23T08:46:37.498 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-09-23T08:46:37.498 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "a" 2023-09-23T08:46:37.499 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2023-09-23T08:46:37.499 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2023-09-23T08:46:37.499 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "monmap": { 2023-09-23T08:46:37.499 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-09-23T08:46:37.499 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-09-23T08:46:37.499 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-09-23T08:46:37.499 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2023-09-23T08:46:37.499 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-09-23T08:46:37.499 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-09-23T08:46:37.499 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-09-23T08:46:37.499 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-09-23T08:46:37.499 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-09-23T08:46:37.506 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-09-23T08:46:37.506 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-09-23T08:46:37.506 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-09-23T08:46:37.506 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2023-09-23T08:46:37.506 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-09-23T08:46:37.506 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-09-23T08:46:37.506 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-09-23T08:46:37.506 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-09-23T08:46:37.507 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-09-23T08:46:37.507 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-09-23T08:46:37.507 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-09-23T08:46:37.507 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-09-23T08:46:37.507 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-09-23T08:46:37.507 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2023-09-23T08:46:37.507 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-09-23T08:46:37.507 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-09-23T08:46:37.507 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-09-23T08:46:37.507 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-09-23T08:46:37.507 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2023-09-23T08:46:37.507 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-09-23T08:46:37.508 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "available": false, 2023-09-23T08:46:37.508 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-09-23T08:46:37.508 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "modules": [ 2023-09-23T08:46:37.508 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "iostat", 2023-09-23T08:46:37.508 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "nfs", 2023-09-23T08:46:37.508 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "restful" 2023-09-23T08:46:37.508 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2023-09-23T08:46:37.508 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "services": {} 2023-09-23T08:46:37.508 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2023-09-23T08:46:37.508 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-09-23T08:46:37.508 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-09-23T08:46:37.508 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "modified": "2023-09-23T08:46:16.628578+0000", 2023-09-23T08:46:37.509 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "services": {} 2023-09-23T08:46:37.509 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2023-09-23T08:46:37.509 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-09-23T08:46:37.509 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout } 2023-09-23T08:46:37.509 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:36.887+0000 7f9d4395b700 1 Processor -- start 2023-09-23T08:46:37.509 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:36.887+0000 7f9d4395b700 1 -- start start 2023-09-23T08:46:37.509 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:36.887+0000 7f9d4395b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d3c07ad30 0x7f9d3c079190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:46:37.509 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:36.887+0000 7f9d4395b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d3c079760 con 0x7f9d3c07ad30 2023-09-23T08:46:37.509 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:36.888+0000 7f9d416f7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d3c07ad30 0x7f9d3c079190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:46:37.509 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:36.888+0000 7f9d416f7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d3c07ad30 0x7f9d3c079190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45144/0 (socket says 172.21.15.82:45144) 2023-09-23T08:46:37.509 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:36.888+0000 7f9d416f7700 1 -- 172.21.15.82:0/4193088622 learned_addr learned my addr 172.21.15.82:0/4193088622 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:46:37.509 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:36.888+0000 7f9d416f7700 1 -- 172.21.15.82:0/4193088622 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d3c0798a0 con 0x7f9d3c07ad30 2023-09-23T08:46:37.510 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:36.888+0000 7f9d416f7700 1 --2- 172.21.15.82:0/4193088622 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d3c07ad30 0x7f9d3c079190 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9d380098a0 tx=0x7f9d38009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=241a1e98cd3589e9 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:46:37.510 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:36.889+0000 7f9d33fff700 1 -- 172.21.15.82:0/4193088622 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9d38004160 con 0x7f9d3c07ad30 2023-09-23T08:46:37.510 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:36.889+0000 7f9d33fff700 1 -- 172.21.15.82:0/4193088622 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f9d380042c0 con 0x7f9d3c07ad30 2023-09-23T08:46:37.510 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:36.889+0000 7f9d33fff700 1 -- 172.21.15.82:0/4193088622 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9d38011940 con 0x7f9d3c07ad30 2023-09-23T08:46:37.510 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:36.889+0000 7f9d4395b700 1 -- 172.21.15.82:0/4193088622 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d3c07ad30 msgr2=0x7f9d3c079190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:46:37.510 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:36.889+0000 7f9d4395b700 1 --2- 172.21.15.82:0/4193088622 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d3c07ad30 0x7f9d3c079190 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9d380098a0 tx=0x7f9d38009bb0 comp rx=0 tx=0).stop 2023-09-23T08:46:37.510 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:36.890+0000 7f9d4395b700 1 -- 172.21.15.82:0/4193088622 shutdown_connections 2023-09-23T08:46:37.510 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:36.890+0000 7f9d4395b700 1 --2- 172.21.15.82:0/4193088622 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d3c07ad30 0x7f9d3c079190 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:46:37.510 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:36.890+0000 7f9d4395b700 1 -- 172.21.15.82:0/4193088622 >> 172.21.15.82:0/4193088622 conn(0x7f9d3c1016b0 msgr2=0x7f9d3c103ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:46:37.510 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:36.890+0000 7f9d4395b700 1 -- 172.21.15.82:0/4193088622 shutdown_connections 2023-09-23T08:46:37.510 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:36.890+0000 7f9d4395b700 1 -- 172.21.15.82:0/4193088622 wait complete. 2023-09-23T08:46:37.510 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:36.891+0000 7f9d4395b700 1 Processor -- start 2023-09-23T08:46:37.511 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:36.891+0000 7f9d4395b700 1 -- start start 2023-09-23T08:46:37.511 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:36.891+0000 7f9d4395b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d3c07ad30 0x7f9d3c19bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:46:37.511 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:36.891+0000 7f9d4395b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d3c19c430 con 0x7f9d3c07ad30 2023-09-23T08:46:37.511 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:36.891+0000 7f9d416f7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d3c07ad30 0x7f9d3c19bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:46:37.511 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:36.892+0000 7f9d416f7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d3c07ad30 0x7f9d3c19bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45148/0 (socket says 172.21.15.82:45148) 2023-09-23T08:46:37.511 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:36.892+0000 7f9d416f7700 1 -- 172.21.15.82:0/3798979692 learned_addr learned my addr 172.21.15.82:0/3798979692 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:46:37.511 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:36.892+0000 7f9d416f7700 1 -- 172.21.15.82:0/3798979692 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d38009550 con 0x7f9d3c07ad30 2023-09-23T08:46:37.511 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:36.892+0000 7f9d416f7700 1 --2- 172.21.15.82:0/3798979692 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d3c07ad30 0x7f9d3c19bef0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9d38000c00 tx=0x7f9d38011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:46:37.511 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:36.892+0000 7f9d327fc700 1 -- 172.21.15.82:0/3798979692 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9d380036a0 con 0x7f9d3c07ad30 2023-09-23T08:46:37.511 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:36.892+0000 7f9d4395b700 1 -- 172.21.15.82:0/3798979692 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d3c19c630 con 0x7f9d3c07ad30 2023-09-23T08:46:37.511 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:36.892+0000 7f9d327fc700 1 -- 172.21.15.82:0/3798979692 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f9d3801b440 con 0x7f9d3c07ad30 2023-09-23T08:46:37.512 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:36.892+0000 7f9d327fc700 1 -- 172.21.15.82:0/3798979692 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9d380193f0 con 0x7f9d3c07ad30 2023-09-23T08:46:37.512 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:36.893+0000 7f9d4395b700 1 -- 172.21.15.82:0/3798979692 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d3c19ca50 con 0x7f9d3c07ad30 2023-09-23T08:46:37.512 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:36.893+0000 7f9d327fc700 1 -- 172.21.15.82:0/3798979692 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f9d380198e0 con 0x7f9d3c07ad30 2023-09-23T08:46:37.512 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:36.893+0000 7f9d327fc700 1 -- 172.21.15.82:0/3798979692 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f9d3801a3d0 con 0x7f9d3c07ad30 2023-09-23T08:46:37.512 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:36.894+0000 7f9d4395b700 1 -- 172.21.15.82:0/3798979692 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d3c061f50 con 0x7f9d3c07ad30 2023-09-23T08:46:37.512 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:36.896+0000 7f9d327fc700 1 -- 172.21.15.82:0/3798979692 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f9d38029060 con 0x7f9d3c07ad30 2023-09-23T08:46:37.512 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:36.971+0000 7f9d4395b700 1 -- 172.21.15.82:0/3798979692 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f9d3c10c440 con 0x7f9d3c07ad30 2023-09-23T08:46:37.512 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:36.971+0000 7f9d327fc700 1 -- 172.21.15.82:0/3798979692 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f9d3801f070 con 0x7f9d3c07ad30 2023-09-23T08:46:37.512 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:36.972+0000 7f9d4395b700 1 -- 172.21.15.82:0/3798979692 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d3c07ad30 msgr2=0x7f9d3c19bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:46:37.512 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:36.972+0000 7f9d4395b700 1 --2- 172.21.15.82:0/3798979692 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d3c07ad30 0x7f9d3c19bef0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9d38000c00 tx=0x7f9d38011e70 comp rx=0 tx=0).stop 2023-09-23T08:46:37.512 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:36.973+0000 7f9d4395b700 1 -- 172.21.15.82:0/3798979692 shutdown_connections 2023-09-23T08:46:37.513 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:36.973+0000 7f9d4395b700 1 --2- 172.21.15.82:0/3798979692 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d3c07ad30 0x7f9d3c19bef0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:46:37.513 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:36.973+0000 7f9d4395b700 1 -- 172.21.15.82:0/3798979692 >> 172.21.15.82:0/3798979692 conn(0x7f9d3c1016b0 msgr2=0x7f9d3c102d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:46:37.513 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:36.973+0000 7f9d4395b700 1 -- 172.21.15.82:0/3798979692 shutdown_connections 2023-09-23T08:46:37.513 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:36.973+0000 7f9d4395b700 1 -- 172.21.15.82:0/3798979692 wait complete. 2023-09-23T08:46:37.513 INFO:teuthology.orchestra.run.smithi082.stdout:mgr not available, waiting (2/15)... 2023-09-23T08:46:37.620 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:46:37 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:46:37.311+0000 7f47de86a200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-09-23T08:46:37.621 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:46:37 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:46:37.540+0000 7f47de86a200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-09-23T08:46:38.170 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:46:37 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:46:37.896+0000 7f47de86a200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-09-23T08:46:38.620 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:46:38 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:46:38.167+0000 7f47de86a200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-09-23T08:46:38.621 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:46:38 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:46:38.358+0000 7f47de86a200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-09-23T08:46:39.121 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:46:38 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:46:38.693+0000 7f47de86a200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-09-23T08:46:39.870 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:46:39 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:46:39.616+0000 7f47de86a200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-09-23T08:46:39.871 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:46:39 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:46:39.799+0000 7f47de86a200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-09-23T08:46:40.325 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:40 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/1044145576' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-09-23T08:46:40.326 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:46:40 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:46:40.060+0000 7f47de86a200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-09-23T08:46:40.326 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:46:40 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:46:40.212+0000 7f47de86a200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-09-23T08:46:40.583 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2023-09-23T08:46:40.583 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout { 2023-09-23T08:46:40.583 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "fsid": "8926e286-59ed-11ee-8db4-212e2dc638e7", 2023-09-23T08:46:40.584 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "health": { 2023-09-23T08:46:40.584 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-09-23T08:46:40.584 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-09-23T08:46:40.584 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-09-23T08:46:40.584 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2023-09-23T08:46:40.584 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-09-23T08:46:40.584 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-09-23T08:46:40.584 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 0 2023-09-23T08:46:40.584 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2023-09-23T08:46:40.584 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-09-23T08:46:40.584 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "a" 2023-09-23T08:46:40.584 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2023-09-23T08:46:40.585 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2023-09-23T08:46:40.585 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "monmap": { 2023-09-23T08:46:40.585 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-09-23T08:46:40.585 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-09-23T08:46:40.585 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-09-23T08:46:40.585 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2023-09-23T08:46:40.585 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-09-23T08:46:40.585 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-09-23T08:46:40.585 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-09-23T08:46:40.585 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-09-23T08:46:40.585 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-09-23T08:46:40.593 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-09-23T08:46:40.593 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-09-23T08:46:40.593 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-09-23T08:46:40.593 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2023-09-23T08:46:40.593 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-09-23T08:46:40.593 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-09-23T08:46:40.593 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-09-23T08:46:40.593 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-09-23T08:46:40.593 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-09-23T08:46:40.593 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-09-23T08:46:40.594 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-09-23T08:46:40.594 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-09-23T08:46:40.594 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-09-23T08:46:40.594 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2023-09-23T08:46:40.594 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-09-23T08:46:40.594 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-09-23T08:46:40.594 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-09-23T08:46:40.594 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-09-23T08:46:40.594 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2023-09-23T08:46:40.594 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-09-23T08:46:40.594 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "available": false, 2023-09-23T08:46:40.595 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-09-23T08:46:40.595 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "modules": [ 2023-09-23T08:46:40.595 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "iostat", 2023-09-23T08:46:40.595 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "nfs", 2023-09-23T08:46:40.595 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "restful" 2023-09-23T08:46:40.595 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2023-09-23T08:46:40.595 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "services": {} 2023-09-23T08:46:40.595 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2023-09-23T08:46:40.595 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-09-23T08:46:40.595 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-09-23T08:46:40.595 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "modified": "2023-09-23T08:46:16.628578+0000", 2023-09-23T08:46:40.595 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "services": {} 2023-09-23T08:46:40.596 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2023-09-23T08:46:40.596 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-09-23T08:46:40.596 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout } 2023-09-23T08:46:40.596 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:40.071+0000 7f8c4cdb0700 1 Processor -- start 2023-09-23T08:46:40.596 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:40.071+0000 7f8c4cdb0700 1 -- start start 2023-09-23T08:46:40.596 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:40.071+0000 7f8c4cdb0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c4807ad10 0x7f8c48079170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:46:40.596 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:40.071+0000 7f8c4cdb0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c48079740 con 0x7f8c4807ad10 2023-09-23T08:46:40.596 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:40.072+0000 7f8c4659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c4807ad10 0x7f8c48079170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:46:40.596 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:40.072+0000 7f8c4659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c4807ad10 0x7f8c48079170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45164/0 (socket says 172.21.15.82:45164) 2023-09-23T08:46:40.596 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:40.072+0000 7f8c4659c700 1 -- 172.21.15.82:0/1469758740 learned_addr learned my addr 172.21.15.82:0/1469758740 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:46:40.596 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:40.072+0000 7f8c4659c700 1 -- 172.21.15.82:0/1469758740 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c48079880 con 0x7f8c4807ad10 2023-09-23T08:46:40.596 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:40.073+0000 7f8c4659c700 1 --2- 172.21.15.82:0/1469758740 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c4807ad10 0x7f8c48079170 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8c380098a0 tx=0x7f8c38009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a4d4127a2acaa32 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:46:40.597 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:40.073+0000 7f8c4559a700 1 -- 172.21.15.82:0/1469758740 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8c38004160 con 0x7f8c4807ad10 2023-09-23T08:46:40.597 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:40.073+0000 7f8c4559a700 1 -- 172.21.15.82:0/1469758740 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f8c380042c0 con 0x7f8c4807ad10 2023-09-23T08:46:40.597 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:40.073+0000 7f8c4559a700 1 -- 172.21.15.82:0/1469758740 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8c38011940 con 0x7f8c4807ad10 2023-09-23T08:46:40.597 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:40.073+0000 7f8c4cdb0700 1 -- 172.21.15.82:0/1469758740 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c4807ad10 msgr2=0x7f8c48079170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:46:40.597 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:40.073+0000 7f8c4cdb0700 1 --2- 172.21.15.82:0/1469758740 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c4807ad10 0x7f8c48079170 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8c380098a0 tx=0x7f8c38009bb0 comp rx=0 tx=0).stop 2023-09-23T08:46:40.597 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:40.074+0000 7f8c4cdb0700 1 -- 172.21.15.82:0/1469758740 shutdown_connections 2023-09-23T08:46:40.597 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:40.074+0000 7f8c4cdb0700 1 --2- 172.21.15.82:0/1469758740 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c4807ad10 0x7f8c48079170 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:46:40.597 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:40.074+0000 7f8c4cdb0700 1 -- 172.21.15.82:0/1469758740 >> 172.21.15.82:0/1469758740 conn(0x7f8c481016b0 msgr2=0x7f8c48103ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:46:40.597 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:40.074+0000 7f8c4cdb0700 1 -- 172.21.15.82:0/1469758740 shutdown_connections 2023-09-23T08:46:40.597 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:40.074+0000 7f8c4cdb0700 1 -- 172.21.15.82:0/1469758740 wait complete. 2023-09-23T08:46:40.597 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:40.075+0000 7f8c4cdb0700 1 Processor -- start 2023-09-23T08:46:40.597 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:40.075+0000 7f8c4cdb0700 1 -- start start 2023-09-23T08:46:40.598 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:40.076+0000 7f8c4cdb0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c4807ad10 0x7f8c4819beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:46:40.598 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:40.076+0000 7f8c4cdb0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c4819c3f0 con 0x7f8c4807ad10 2023-09-23T08:46:40.598 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:40.076+0000 7f8c4659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c4807ad10 0x7f8c4819beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:46:40.598 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:40.076+0000 7f8c4659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c4807ad10 0x7f8c4819beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45172/0 (socket says 172.21.15.82:45172) 2023-09-23T08:46:40.598 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:40.076+0000 7f8c4659c700 1 -- 172.21.15.82:0/1044145576 learned_addr learned my addr 172.21.15.82:0/1044145576 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:46:40.598 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:40.076+0000 7f8c4659c700 1 -- 172.21.15.82:0/1044145576 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c38009550 con 0x7f8c4807ad10 2023-09-23T08:46:40.598 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:40.077+0000 7f8c4659c700 1 --2- 172.21.15.82:0/1044145576 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c4807ad10 0x7f8c4819beb0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8c38011dc0 tx=0x7f8c38011ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:46:40.598 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:40.077+0000 7f8c377fe700 1 -- 172.21.15.82:0/1044145576 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8c380037d0 con 0x7f8c4807ad10 2023-09-23T08:46:40.598 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:40.077+0000 7f8c377fe700 1 -- 172.21.15.82:0/1044145576 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f8c3801b440 con 0x7f8c4807ad10 2023-09-23T08:46:40.598 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:40.077+0000 7f8c377fe700 1 -- 172.21.15.82:0/1044145576 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8c3801a560 con 0x7f8c4807ad10 2023-09-23T08:46:40.598 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:40.077+0000 7f8c4cdb0700 1 -- 172.21.15.82:0/1044145576 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c4819c5f0 con 0x7f8c4807ad10 2023-09-23T08:46:40.599 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:40.077+0000 7f8c4cdb0700 1 -- 172.21.15.82:0/1044145576 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c4819ca10 con 0x7f8c4807ad10 2023-09-23T08:46:40.599 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:40.077+0000 7f8c377fe700 1 -- 172.21.15.82:0/1044145576 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f8c3801aad0 con 0x7f8c4807ad10 2023-09-23T08:46:40.599 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:40.077+0000 7f8c377fe700 1 -- 172.21.15.82:0/1044145576 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f8c380193f0 con 0x7f8c4807ad10 2023-09-23T08:46:40.599 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:40.078+0000 7f8c4cdb0700 1 -- 172.21.15.82:0/1044145576 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c4810c460 con 0x7f8c4807ad10 2023-09-23T08:46:40.599 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:40.082+0000 7f8c377fe700 1 -- 172.21.15.82:0/1044145576 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f8c38029060 con 0x7f8c4807ad10 2023-09-23T08:46:40.599 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:40.157+0000 7f8c4cdb0700 1 -- 172.21.15.82:0/1044145576 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f8c4819f600 con 0x7f8c4807ad10 2023-09-23T08:46:40.599 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:40.158+0000 7f8c377fe700 1 -- 172.21.15.82:0/1044145576 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f8c3801f070 con 0x7f8c4807ad10 2023-09-23T08:46:40.599 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:40.159+0000 7f8c4cdb0700 1 -- 172.21.15.82:0/1044145576 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c4807ad10 msgr2=0x7f8c4819beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:46:40.599 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:40.159+0000 7f8c4cdb0700 1 --2- 172.21.15.82:0/1044145576 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c4807ad10 0x7f8c4819beb0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8c38011dc0 tx=0x7f8c38011ea0 comp rx=0 tx=0).stop 2023-09-23T08:46:40.599 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:40.159+0000 7f8c4cdb0700 1 -- 172.21.15.82:0/1044145576 shutdown_connections 2023-09-23T08:46:40.599 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:40.159+0000 7f8c4cdb0700 1 --2- 172.21.15.82:0/1044145576 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c4807ad10 0x7f8c4819beb0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:46:40.600 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:40.159+0000 7f8c4cdb0700 1 -- 172.21.15.82:0/1044145576 >> 172.21.15.82:0/1044145576 conn(0x7f8c481016b0 msgr2=0x7f8c48102460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:46:40.600 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:40.159+0000 7f8c4cdb0700 1 -- 172.21.15.82:0/1044145576 shutdown_connections 2023-09-23T08:46:40.600 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:40.159+0000 7f8c4cdb0700 1 -- 172.21.15.82:0/1044145576 wait complete. 2023-09-23T08:46:40.600 INFO:teuthology.orchestra.run.smithi082.stdout:mgr not available, waiting (3/15)... 2023-09-23T08:46:40.600 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:46:40 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:46:40.502+0000 7f47de86a200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-09-23T08:46:41.871 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:46:41 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:46:41.569+0000 7f47de86a200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-09-23T08:46:41.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:41 smithi082 ceph-mon[97694]: Activating manager daemon x 2023-09-23T08:46:41.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:41 smithi082 ceph-mon[97694]: mgrmap e2: x(active, starting, since 0.00422844s) 2023-09-23T08:46:41.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:41 smithi082 ceph-mon[97694]: from='mgr.14100 172.21.15.82:0/551985843' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-09-23T08:46:41.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:41 smithi082 ceph-mon[97694]: from='mgr.14100 172.21.15.82:0/551985843' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-09-23T08:46:41.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:41 smithi082 ceph-mon[97694]: from='mgr.14100 172.21.15.82:0/551985843' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-09-23T08:46:41.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:41 smithi082 ceph-mon[97694]: from='mgr.14100 172.21.15.82:0/551985843' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-09-23T08:46:41.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:41 smithi082 ceph-mon[97694]: from='mgr.14100 172.21.15.82:0/551985843' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-09-23T08:46:41.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:41 smithi082 ceph-mon[97694]: Manager daemon x is now available 2023-09-23T08:46:41.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:41 smithi082 ceph-mon[97694]: from='mgr.14100 172.21.15.82:0/551985843' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-09-23T08:46:41.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:41 smithi082 ceph-mon[97694]: from='mgr.14100 172.21.15.82:0/551985843' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-09-23T08:46:41.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:41 smithi082 ceph-mon[97694]: from='mgr.14100 172.21.15.82:0/551985843' entity='mgr.x' 2023-09-23T08:46:41.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:41 smithi082 ceph-mon[97694]: from='mgr.14100 172.21.15.82:0/551985843' entity='mgr.x' 2023-09-23T08:46:41.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:41 smithi082 ceph-mon[97694]: from='mgr.14100 172.21.15.82:0/551985843' entity='mgr.x' 2023-09-23T08:46:43.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:43 smithi082 ceph-mon[97694]: mgrmap e3: x(active, since 1.00883s) 2023-09-23T08:46:43.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:43 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/3359025427' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-09-23T08:46:43.874 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2023-09-23T08:46:43.874 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout { 2023-09-23T08:46:43.875 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "fsid": "8926e286-59ed-11ee-8db4-212e2dc638e7", 2023-09-23T08:46:43.875 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "health": { 2023-09-23T08:46:43.875 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-09-23T08:46:43.875 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-09-23T08:46:43.875 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-09-23T08:46:43.875 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2023-09-23T08:46:43.875 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-09-23T08:46:43.875 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-09-23T08:46:43.875 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 0 2023-09-23T08:46:43.875 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2023-09-23T08:46:43.875 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-09-23T08:46:43.875 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "a" 2023-09-23T08:46:43.876 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2023-09-23T08:46:43.876 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum_age": 12, 2023-09-23T08:46:43.876 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "monmap": { 2023-09-23T08:46:43.876 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-09-23T08:46:43.876 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-09-23T08:46:43.876 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-09-23T08:46:43.876 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2023-09-23T08:46:43.876 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-09-23T08:46:43.876 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-09-23T08:46:43.876 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-09-23T08:46:43.876 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-09-23T08:46:43.884 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-09-23T08:46:43.885 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-09-23T08:46:43.885 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-09-23T08:46:43.885 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-09-23T08:46:43.885 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2023-09-23T08:46:43.885 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-09-23T08:46:43.885 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-09-23T08:46:43.885 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-09-23T08:46:43.885 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-09-23T08:46:43.885 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-09-23T08:46:43.885 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-09-23T08:46:43.885 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-09-23T08:46:43.886 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-09-23T08:46:43.886 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-09-23T08:46:43.886 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2023-09-23T08:46:43.886 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-09-23T08:46:43.886 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-09-23T08:46:43.886 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-09-23T08:46:43.886 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-09-23T08:46:43.886 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2023-09-23T08:46:43.886 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-09-23T08:46:43.886 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "available": true, 2023-09-23T08:46:43.886 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-09-23T08:46:43.886 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "modules": [ 2023-09-23T08:46:43.886 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "iostat", 2023-09-23T08:46:43.887 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "nfs", 2023-09-23T08:46:43.887 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "restful" 2023-09-23T08:46:43.887 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2023-09-23T08:46:43.887 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "services": {} 2023-09-23T08:46:43.887 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2023-09-23T08:46:43.887 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-09-23T08:46:43.887 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-09-23T08:46:43.887 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "modified": "2023-09-23T08:46:16.628578+0000", 2023-09-23T08:46:43.887 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "services": {} 2023-09-23T08:46:43.887 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2023-09-23T08:46:43.887 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-09-23T08:46:43.887 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout } 2023-09-23T08:46:43.888 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:43.135+0000 7f9699194700 1 Processor -- start 2023-09-23T08:46:43.888 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:43.135+0000 7f9699194700 1 -- start start 2023-09-23T08:46:43.888 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:43.136+0000 7f9699194700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96941060d0 0x7f96941064f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:46:43.888 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:43.136+0000 7f9699194700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9694106ac0 con 0x7f96941060d0 2023-09-23T08:46:43.888 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:43.136+0000 7f9692d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96941060d0 0x7f96941064f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:46:43.888 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:43.136+0000 7f9692d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96941060d0 0x7f96941064f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:32880/0 (socket says 172.21.15.82:32880) 2023-09-23T08:46:43.888 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:43.136+0000 7f9692d9d700 1 -- 172.21.15.82:0/379809718 learned_addr learned my addr 172.21.15.82:0/379809718 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:46:43.888 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:43.136+0000 7f9692d9d700 1 -- 172.21.15.82:0/379809718 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96941072d0 con 0x7f96941060d0 2023-09-23T08:46:43.888 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:43.137+0000 7f9692d9d700 1 --2- 172.21.15.82:0/379809718 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96941060d0 0x7f96941064f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f96840098a0 tx=0x7f9684009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb6ae07a5dc66058 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:46:43.888 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:43.137+0000 7f9691d9b700 1 -- 172.21.15.82:0/379809718 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9684004160 con 0x7f96941060d0 2023-09-23T08:46:43.888 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:43.137+0000 7f9691d9b700 1 -- 172.21.15.82:0/379809718 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f96840042c0 con 0x7f96941060d0 2023-09-23T08:46:43.888 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:43.137+0000 7f9691d9b700 1 -- 172.21.15.82:0/379809718 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9684011940 con 0x7f96941060d0 2023-09-23T08:46:43.889 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:43.137+0000 7f9699194700 1 -- 172.21.15.82:0/379809718 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96941060d0 msgr2=0x7f96941064f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:46:43.889 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:43.137+0000 7f9699194700 1 --2- 172.21.15.82:0/379809718 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96941060d0 0x7f96941064f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f96840098a0 tx=0x7f9684009bb0 comp rx=0 tx=0).stop 2023-09-23T08:46:43.889 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:43.138+0000 7f9699194700 1 -- 172.21.15.82:0/379809718 shutdown_connections 2023-09-23T08:46:43.889 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:43.138+0000 7f9699194700 1 --2- 172.21.15.82:0/379809718 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96941060d0 0x7f96941064f0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:46:43.889 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:43.138+0000 7f9699194700 1 -- 172.21.15.82:0/379809718 >> 172.21.15.82:0/379809718 conn(0x7f96941016b0 msgr2=0x7f9694103ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:46:43.889 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:43.138+0000 7f9699194700 1 -- 172.21.15.82:0/379809718 shutdown_connections 2023-09-23T08:46:43.889 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:43.138+0000 7f9699194700 1 -- 172.21.15.82:0/379809718 wait complete. 2023-09-23T08:46:43.889 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:43.139+0000 7f9699194700 1 Processor -- start 2023-09-23T08:46:43.889 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:43.139+0000 7f9699194700 1 -- start start 2023-09-23T08:46:43.889 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:43.139+0000 7f9699194700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96941060d0 0x7f9694199d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:46:43.889 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:43.139+0000 7f9699194700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f969419a250 con 0x7f96941060d0 2023-09-23T08:46:43.889 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:43.139+0000 7f9692d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96941060d0 0x7f9694199d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:46:43.890 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:43.139+0000 7f9692d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96941060d0 0x7f9694199d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:32884/0 (socket says 172.21.15.82:32884) 2023-09-23T08:46:43.890 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:43.139+0000 7f9692d9d700 1 -- 172.21.15.82:0/3359025427 learned_addr learned my addr 172.21.15.82:0/3359025427 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:46:43.890 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:43.140+0000 7f9692d9d700 1 -- 172.21.15.82:0/3359025427 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9684009550 con 0x7f96941060d0 2023-09-23T08:46:43.890 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:43.140+0000 7f9692d9d700 1 --2- 172.21.15.82:0/3359025427 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96941060d0 0x7f9694199d10 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9684000c00 tx=0x7f9684011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:46:43.890 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:43.140+0000 7f967bfff700 1 -- 172.21.15.82:0/3359025427 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f96840036a0 con 0x7f96941060d0 2023-09-23T08:46:43.890 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:43.140+0000 7f967bfff700 1 -- 172.21.15.82:0/3359025427 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f968401b440 con 0x7f96941060d0 2023-09-23T08:46:43.890 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:43.140+0000 7f967bfff700 1 -- 172.21.15.82:0/3359025427 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f96840193f0 con 0x7f96941060d0 2023-09-23T08:46:43.890 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:43.140+0000 7f9699194700 1 -- 172.21.15.82:0/3359025427 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f969419a450 con 0x7f96941060d0 2023-09-23T08:46:43.890 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:43.140+0000 7f9699194700 1 -- 172.21.15.82:0/3359025427 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f969419a870 con 0x7f96941060d0 2023-09-23T08:46:43.890 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:43.141+0000 7f967bfff700 1 -- 172.21.15.82:0/3359025427 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 3) v1 ==== 45018+0+0 (secure 0 0 0) 0x7f968401b5b0 con 0x7f96941060d0 2023-09-23T08:46:43.890 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:43.141+0000 7f9699194700 1 -- 172.21.15.82:0/3359025427 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9694061f50 con 0x7f96941060d0 2023-09-23T08:46:43.891 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:43.142+0000 7f967bfff700 1 --2- 172.21.15.82:0/3359025427 >> [v2:172.21.15.82:6800/3761509623,v1:172.21.15.82:6801/3761509623] conn(0x7f967c037fe0 0x7f967c03a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:46:43.891 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:43.142+0000 7f967bfff700 1 -- 172.21.15.82:0/3359025427 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f968404bb60 con 0x7f96941060d0 2023-09-23T08:46:43.891 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:43.142+0000 7f969259c700 1 --2- 172.21.15.82:0/3359025427 >> [v2:172.21.15.82:6800/3761509623,v1:172.21.15.82:6801/3761509623] conn(0x7f967c037fe0 0x7f967c03a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:46:43.891 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:43.143+0000 7f969259c700 1 --2- 172.21.15.82:0/3359025427 >> [v2:172.21.15.82:6800/3761509623,v1:172.21.15.82:6801/3761509623] conn(0x7f967c037fe0 0x7f967c03a4a0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f9688006fd0 tx=0x7f9688006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:46:43.891 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:43.148+0000 7f967bfff700 1 -- 172.21.15.82:0/3359025427 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f9684022950 con 0x7f96941060d0 2023-09-23T08:46:43.891 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:43.417+0000 7f9699194700 1 -- 172.21.15.82:0/3359025427 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f969410a5a0 con 0x7f96941060d0 2023-09-23T08:46:43.891 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:43.418+0000 7f967bfff700 1 -- 172.21.15.82:0/3359025427 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f968401f070 con 0x7f96941060d0 2023-09-23T08:46:43.891 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:43.420+0000 7f9699194700 1 -- 172.21.15.82:0/3359025427 >> [v2:172.21.15.82:6800/3761509623,v1:172.21.15.82:6801/3761509623] conn(0x7f967c037fe0 msgr2=0x7f967c03a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:46:43.891 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:43.420+0000 7f9699194700 1 --2- 172.21.15.82:0/3359025427 >> [v2:172.21.15.82:6800/3761509623,v1:172.21.15.82:6801/3761509623] conn(0x7f967c037fe0 0x7f967c03a4a0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f9688006fd0 tx=0x7f9688006e40 comp rx=0 tx=0).stop 2023-09-23T08:46:43.891 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:43.420+0000 7f9699194700 1 -- 172.21.15.82:0/3359025427 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96941060d0 msgr2=0x7f9694199d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:46:43.891 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:43.420+0000 7f9699194700 1 --2- 172.21.15.82:0/3359025427 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96941060d0 0x7f9694199d10 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9684000c00 tx=0x7f9684011e70 comp rx=0 tx=0).stop 2023-09-23T08:46:43.891 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:43.420+0000 7f9699194700 1 -- 172.21.15.82:0/3359025427 shutdown_connections 2023-09-23T08:46:43.892 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:43.420+0000 7f9699194700 1 --2- 172.21.15.82:0/3359025427 >> [v2:172.21.15.82:6800/3761509623,v1:172.21.15.82:6801/3761509623] conn(0x7f967c037fe0 0x7f967c03a4a0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:46:43.892 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:43.420+0000 7f9699194700 1 --2- 172.21.15.82:0/3359025427 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96941060d0 0x7f9694199d10 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:46:43.892 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:43.420+0000 7f9699194700 1 -- 172.21.15.82:0/3359025427 >> 172.21.15.82:0/3359025427 conn(0x7f96941016b0 msgr2=0x7f9694102460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:46:43.892 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:43.420+0000 7f9699194700 1 -- 172.21.15.82:0/3359025427 shutdown_connections 2023-09-23T08:46:43.892 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:43.420+0000 7f9699194700 1 -- 172.21.15.82:0/3359025427 wait complete. 2023-09-23T08:46:43.892 INFO:teuthology.orchestra.run.smithi082.stdout:mgr is available 2023-09-23T08:46:44.841 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:44 smithi082 ceph-mon[97694]: mgrmap e4: x(active, since 2s) 2023-09-23T08:46:45.158 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2023-09-23T08:46:45.165 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout [global] 2023-09-23T08:46:45.165 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout fsid = 8926e286-59ed-11ee-8db4-212e2dc638e7 2023-09-23T08:46:45.165 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-09-23T08:46:45.165 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-09-23T08:46:45.165 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-09-23T08:46:45.165 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-09-23T08:46:45.165 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2023-09-23T08:46:45.165 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout [mgr] 2023-09-23T08:46:45.165 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-09-23T08:46:45.165 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2023-09-23T08:46:45.166 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout [osd] 2023-09-23T08:46:45.166 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2023-09-23T08:46:45.166 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2023-09-23T08:46:45.166 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2023-09-23T08:46:45.166 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-09-23T08:46:45.166 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-09-23T08:46:45.166 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:44.409+0000 7fda22929700 1 Processor -- start 2023-09-23T08:46:45.166 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:44.409+0000 7fda22929700 1 -- start start 2023-09-23T08:46:45.166 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:44.409+0000 7fda22929700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda1c1060d0 0x7fda1c1064f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:46:45.166 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:44.409+0000 7fda22929700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda1c106ac0 con 0x7fda1c1060d0 2023-09-23T08:46:45.166 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:44.410+0000 7fda1bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda1c1060d0 0x7fda1c1064f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:46:45.167 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:44.410+0000 7fda1bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda1c1060d0 0x7fda1c1064f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:32892/0 (socket says 172.21.15.82:32892) 2023-09-23T08:46:45.167 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:44.410+0000 7fda1bfff700 1 -- 172.21.15.82:0/1863043697 learned_addr learned my addr 172.21.15.82:0/1863043697 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:46:45.167 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:44.410+0000 7fda1bfff700 1 -- 172.21.15.82:0/1863043697 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda1c1072d0 con 0x7fda1c1060d0 2023-09-23T08:46:45.167 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:44.410+0000 7fda1bfff700 1 --2- 172.21.15.82:0/1863043697 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda1c1060d0 0x7fda1c1064f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fda0c0098a0 tx=0x7fda0c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbef516489d766a3 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:46:45.167 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:44.411+0000 7fda1affd700 1 -- 172.21.15.82:0/1863043697 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fda0c004160 con 0x7fda1c1060d0 2023-09-23T08:46:45.167 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:44.411+0000 7fda1affd700 1 -- 172.21.15.82:0/1863043697 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fda0c0042c0 con 0x7fda1c1060d0 2023-09-23T08:46:45.167 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:44.411+0000 7fda1affd700 1 -- 172.21.15.82:0/1863043697 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fda0c011940 con 0x7fda1c1060d0 2023-09-23T08:46:45.167 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:44.411+0000 7fda22929700 1 -- 172.21.15.82:0/1863043697 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda1c1060d0 msgr2=0x7fda1c1064f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:46:45.167 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:44.411+0000 7fda22929700 1 --2- 172.21.15.82:0/1863043697 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda1c1060d0 0x7fda1c1064f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fda0c0098a0 tx=0x7fda0c009bb0 comp rx=0 tx=0).stop 2023-09-23T08:46:45.167 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:44.411+0000 7fda22929700 1 -- 172.21.15.82:0/1863043697 shutdown_connections 2023-09-23T08:46:45.167 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:44.411+0000 7fda22929700 1 --2- 172.21.15.82:0/1863043697 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda1c1060d0 0x7fda1c1064f0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:46:45.167 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:44.411+0000 7fda22929700 1 -- 172.21.15.82:0/1863043697 >> 172.21.15.82:0/1863043697 conn(0x7fda1c1016b0 msgr2=0x7fda1c103ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:46:45.168 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:44.411+0000 7fda22929700 1 -- 172.21.15.82:0/1863043697 shutdown_connections 2023-09-23T08:46:45.168 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:44.411+0000 7fda22929700 1 -- 172.21.15.82:0/1863043697 wait complete. 2023-09-23T08:46:45.168 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:44.413+0000 7fda22929700 1 Processor -- start 2023-09-23T08:46:45.168 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:44.413+0000 7fda22929700 1 -- start start 2023-09-23T08:46:45.168 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:44.413+0000 7fda22929700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda1c1060d0 0x7fda1c19bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:46:45.168 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:44.413+0000 7fda22929700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda1c19c420 con 0x7fda1c1060d0 2023-09-23T08:46:45.168 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:44.414+0000 7fda1bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda1c1060d0 0x7fda1c19bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:46:45.168 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:44.414+0000 7fda1bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda1c1060d0 0x7fda1c19bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:32894/0 (socket says 172.21.15.82:32894) 2023-09-23T08:46:45.168 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:44.414+0000 7fda1bfff700 1 -- 172.21.15.82:0/1368668420 learned_addr learned my addr 172.21.15.82:0/1368668420 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:46:45.168 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:44.414+0000 7fda1bfff700 1 -- 172.21.15.82:0/1368668420 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda0c009550 con 0x7fda1c1060d0 2023-09-23T08:46:45.168 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:44.414+0000 7fda1bfff700 1 --2- 172.21.15.82:0/1368668420 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda1c1060d0 0x7fda1c19bee0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fda0c000c00 tx=0x7fda0c011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:46:45.168 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:44.414+0000 7fda197fa700 1 -- 172.21.15.82:0/1368668420 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fda0c0036a0 con 0x7fda1c1060d0 2023-09-23T08:46:45.169 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:44.415+0000 7fda197fa700 1 -- 172.21.15.82:0/1368668420 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fda0c01b440 con 0x7fda1c1060d0 2023-09-23T08:46:45.169 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:44.415+0000 7fda22929700 1 -- 172.21.15.82:0/1368668420 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda1c19c620 con 0x7fda1c1060d0 2023-09-23T08:46:45.169 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:44.415+0000 7fda197fa700 1 -- 172.21.15.82:0/1368668420 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fda0c0193f0 con 0x7fda1c1060d0 2023-09-23T08:46:45.169 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:44.415+0000 7fda22929700 1 -- 172.21.15.82:0/1368668420 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda1c19ca40 con 0x7fda1c1060d0 2023-09-23T08:46:45.169 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:44.416+0000 7fda197fa700 1 -- 172.21.15.82:0/1368668420 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 45124+0+0 (secure 0 0 0) 0x7fda0c01b5b0 con 0x7fda1c1060d0 2023-09-23T08:46:45.169 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:44.416+0000 7fda22929700 1 -- 172.21.15.82:0/1368668420 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda1c061f50 con 0x7fda1c1060d0 2023-09-23T08:46:45.169 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:44.416+0000 7fda197fa700 1 --2- 172.21.15.82:0/1368668420 >> [v2:172.21.15.82:6800/3761509623,v1:172.21.15.82:6801/3761509623] conn(0x7fda04038110 0x7fda0403a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:46:45.169 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:44.416+0000 7fda197fa700 1 -- 172.21.15.82:0/1368668420 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fda0c04bd70 con 0x7fda1c1060d0 2023-09-23T08:46:45.169 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:44.416+0000 7fda1b7fe700 1 --2- 172.21.15.82:0/1368668420 >> [v2:172.21.15.82:6800/3761509623,v1:172.21.15.82:6801/3761509623] conn(0x7fda04038110 0x7fda0403a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:46:45.169 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:44.417+0000 7fda1b7fe700 1 --2- 172.21.15.82:0/1368668420 >> [v2:172.21.15.82:6800/3761509623,v1:172.21.15.82:6801/3761509623] conn(0x7fda04038110 0x7fda0403a5d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fda10006fd0 tx=0x7fda10006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:46:45.169 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:44.421+0000 7fda197fa700 1 -- 172.21.15.82:0/1368668420 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7fda0c022950 con 0x7fda1c1060d0 2023-09-23T08:46:45.169 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:44.617+0000 7fda22929700 1 -- 172.21.15.82:0/1368668420 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7fda1c10a500 con 0x7fda1c1060d0 2023-09-23T08:46:45.170 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:44.618+0000 7fda197fa700 1 -- 172.21.15.82:0/1368668420 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7fda0c01f070 con 0x7fda1c1060d0 2023-09-23T08:46:45.170 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:44.621+0000 7fda22929700 1 -- 172.21.15.82:0/1368668420 >> [v2:172.21.15.82:6800/3761509623,v1:172.21.15.82:6801/3761509623] conn(0x7fda04038110 msgr2=0x7fda0403a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:46:45.170 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:44.621+0000 7fda22929700 1 --2- 172.21.15.82:0/1368668420 >> [v2:172.21.15.82:6800/3761509623,v1:172.21.15.82:6801/3761509623] conn(0x7fda04038110 0x7fda0403a5d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fda10006fd0 tx=0x7fda10006e40 comp rx=0 tx=0).stop 2023-09-23T08:46:45.170 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:44.621+0000 7fda22929700 1 -- 172.21.15.82:0/1368668420 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda1c1060d0 msgr2=0x7fda1c19bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:46:45.170 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:44.621+0000 7fda22929700 1 --2- 172.21.15.82:0/1368668420 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda1c1060d0 0x7fda1c19bee0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fda0c000c00 tx=0x7fda0c011e70 comp rx=0 tx=0).stop 2023-09-23T08:46:45.170 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:44.621+0000 7fda22929700 1 -- 172.21.15.82:0/1368668420 shutdown_connections 2023-09-23T08:46:45.170 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:44.621+0000 7fda22929700 1 --2- 172.21.15.82:0/1368668420 >> [v2:172.21.15.82:6800/3761509623,v1:172.21.15.82:6801/3761509623] conn(0x7fda04038110 0x7fda0403a5d0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:46:45.170 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:44.621+0000 7fda22929700 1 --2- 172.21.15.82:0/1368668420 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda1c1060d0 0x7fda1c19bee0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:46:45.170 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:44.621+0000 7fda22929700 1 -- 172.21.15.82:0/1368668420 >> 172.21.15.82:0/1368668420 conn(0x7fda1c1016b0 msgr2=0x7fda1c102420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:46:45.170 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:44.621+0000 7fda22929700 1 -- 172.21.15.82:0/1368668420 shutdown_connections 2023-09-23T08:46:45.170 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:44.621+0000 7fda22929700 1 -- 172.21.15.82:0/1368668420 wait complete. 2023-09-23T08:46:45.170 INFO:teuthology.orchestra.run.smithi082.stdout:Enabling cephadm module... 2023-09-23T08:46:45.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:45 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/1368668420' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-09-23T08:46:46.940 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:46 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/2302662600' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2023-09-23T08:46:46.940 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:46:46 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: ignoring --setuser ceph since I am not root 2023-09-23T08:46:46.940 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:46:46 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: ignoring --setgroup ceph since I am not root 2023-09-23T08:46:47.144 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:45.728+0000 7f5b09dda700 1 Processor -- start 2023-09-23T08:46:47.145 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:45.728+0000 7f5b09dda700 1 -- start start 2023-09-23T08:46:47.145 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:45.728+0000 7f5b09dda700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b0407ad30 0x7f5b04079190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:46:47.145 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:45.728+0000 7f5b09dda700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b04079760 con 0x7f5b0407ad30 2023-09-23T08:46:47.145 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:45.729+0000 7f5b037fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b0407ad30 0x7f5b04079190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:46:47.145 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:45.729+0000 7f5b037fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b0407ad30 0x7f5b04079190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:32908/0 (socket says 172.21.15.82:32908) 2023-09-23T08:46:47.145 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:45.729+0000 7f5b037fe700 1 -- 172.21.15.82:0/3901779887 learned_addr learned my addr 172.21.15.82:0/3901779887 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:46:47.145 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:45.729+0000 7f5b037fe700 1 -- 172.21.15.82:0/3901779887 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b040798a0 con 0x7f5b0407ad30 2023-09-23T08:46:47.145 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:45.729+0000 7f5b037fe700 1 --2- 172.21.15.82:0/3901779887 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b0407ad30 0x7f5b04079190 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5af40098a0 tx=0x7f5af4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e8c1c2a86ecd55 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:46:47.145 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:45.730+0000 7f5b027fc700 1 -- 172.21.15.82:0/3901779887 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5af4004160 con 0x7f5b0407ad30 2023-09-23T08:46:47.145 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:45.730+0000 7f5b027fc700 1 -- 172.21.15.82:0/3901779887 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f5af40042c0 con 0x7f5b0407ad30 2023-09-23T08:46:47.146 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:45.730+0000 7f5b027fc700 1 -- 172.21.15.82:0/3901779887 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5af4011940 con 0x7f5b0407ad30 2023-09-23T08:46:47.146 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:45.730+0000 7f5b09dda700 1 -- 172.21.15.82:0/3901779887 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b0407ad30 msgr2=0x7f5b04079190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:46:47.146 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:45.730+0000 7f5b09dda700 1 --2- 172.21.15.82:0/3901779887 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b0407ad30 0x7f5b04079190 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5af40098a0 tx=0x7f5af4009bb0 comp rx=0 tx=0).stop 2023-09-23T08:46:47.146 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:45.730+0000 7f5b09dda700 1 -- 172.21.15.82:0/3901779887 shutdown_connections 2023-09-23T08:46:47.146 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:45.730+0000 7f5b09dda700 1 --2- 172.21.15.82:0/3901779887 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b0407ad30 0x7f5b04079190 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:46:47.146 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:45.730+0000 7f5b09dda700 1 -- 172.21.15.82:0/3901779887 >> 172.21.15.82:0/3901779887 conn(0x7f5b041016a0 msgr2=0x7f5b04103ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:46:47.146 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:45.730+0000 7f5b09dda700 1 -- 172.21.15.82:0/3901779887 shutdown_connections 2023-09-23T08:46:47.146 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:45.731+0000 7f5b09dda700 1 -- 172.21.15.82:0/3901779887 wait complete. 2023-09-23T08:46:47.146 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:45.731+0000 7f5b09dda700 1 Processor -- start 2023-09-23T08:46:47.146 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:45.732+0000 7f5b09dda700 1 -- start start 2023-09-23T08:46:47.146 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:45.732+0000 7f5b09dda700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b0407ad30 0x7f5b0419bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:46:47.147 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:45.732+0000 7f5b09dda700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0419c420 con 0x7f5b0407ad30 2023-09-23T08:46:47.147 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:45.732+0000 7f5b037fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b0407ad30 0x7f5b0419bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:46:47.147 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:45.732+0000 7f5b037fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b0407ad30 0x7f5b0419bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:32914/0 (socket says 172.21.15.82:32914) 2023-09-23T08:46:47.147 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:45.732+0000 7f5b037fe700 1 -- 172.21.15.82:0/2302662600 learned_addr learned my addr 172.21.15.82:0/2302662600 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:46:47.147 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:45.732+0000 7f5b037fe700 1 -- 172.21.15.82:0/2302662600 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5af4009550 con 0x7f5b0407ad30 2023-09-23T08:46:47.147 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:45.733+0000 7f5b037fe700 1 --2- 172.21.15.82:0/2302662600 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b0407ad30 0x7f5b0419bee0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5af4000c00 tx=0x7f5af4011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:46:47.147 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:45.733+0000 7f5b00ff9700 1 -- 172.21.15.82:0/2302662600 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5af40036a0 con 0x7f5b0407ad30 2023-09-23T08:46:47.147 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:45.733+0000 7f5b00ff9700 1 -- 172.21.15.82:0/2302662600 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f5af4003c70 con 0x7f5b0407ad30 2023-09-23T08:46:47.147 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:45.733+0000 7f5b09dda700 1 -- 172.21.15.82:0/2302662600 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b0419c620 con 0x7f5b0407ad30 2023-09-23T08:46:47.147 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:45.733+0000 7f5b00ff9700 1 -- 172.21.15.82:0/2302662600 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5af40193f0 con 0x7f5b0407ad30 2023-09-23T08:46:47.147 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:45.733+0000 7f5b09dda700 1 -- 172.21.15.82:0/2302662600 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b0419ca40 con 0x7f5b0407ad30 2023-09-23T08:46:47.148 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:45.734+0000 7f5b00ff9700 1 -- 172.21.15.82:0/2302662600 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 45124+0+0 (secure 0 0 0) 0x7f5af4003800 con 0x7f5b0407ad30 2023-09-23T08:46:47.148 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:45.734+0000 7f5b09dda700 1 -- 172.21.15.82:0/2302662600 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b04061f50 con 0x7f5b0407ad30 2023-09-23T08:46:47.148 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:45.735+0000 7f5b00ff9700 1 --2- 172.21.15.82:0/2302662600 >> [v2:172.21.15.82:6800/3761509623,v1:172.21.15.82:6801/3761509623] conn(0x7f5aec038110 0x7f5aec03a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:46:47.148 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:45.735+0000 7f5b00ff9700 1 -- 172.21.15.82:0/2302662600 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f5af404bd30 con 0x7f5b0407ad30 2023-09-23T08:46:47.148 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:45.735+0000 7f5b02ffd700 1 --2- 172.21.15.82:0/2302662600 >> [v2:172.21.15.82:6800/3761509623,v1:172.21.15.82:6801/3761509623] conn(0x7f5aec038110 0x7f5aec03a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:46:47.148 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:45.735+0000 7f5b02ffd700 1 --2- 172.21.15.82:0/2302662600 >> [v2:172.21.15.82:6800/3761509623,v1:172.21.15.82:6801/3761509623] conn(0x7f5aec038110 0x7f5aec03a5d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5af8006fd0 tx=0x7f5af8006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:46:47.148 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:45.739+0000 7f5b00ff9700 1 -- 172.21.15.82:0/2302662600 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f5af401b440 con 0x7f5b0407ad30 2023-09-23T08:46:47.148 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:45.993+0000 7f5b09dda700 1 -- 172.21.15.82:0/2302662600 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7f5b0410c450 con 0x7f5b0407ad30 2023-09-23T08:46:47.148 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:46.678+0000 7f5b00ff9700 1 -- 172.21.15.82:0/2302662600 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 5) v1 ==== 45135+0+0 (secure 0 0 0) 0x7f5af400fda0 con 0x7f5b0407ad30 2023-09-23T08:46:47.148 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:46.680+0000 7f5b00ff9700 1 -- 172.21.15.82:0/2302662600 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7f5af404b750 con 0x7f5b0407ad30 2023-09-23T08:46:47.148 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:46.682+0000 7f5b09dda700 1 -- 172.21.15.82:0/2302662600 >> [v2:172.21.15.82:6800/3761509623,v1:172.21.15.82:6801/3761509623] conn(0x7f5aec038110 msgr2=0x7f5aec03a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:46:47.149 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:46.682+0000 7f5b09dda700 1 --2- 172.21.15.82:0/2302662600 >> [v2:172.21.15.82:6800/3761509623,v1:172.21.15.82:6801/3761509623] conn(0x7f5aec038110 0x7f5aec03a5d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5af8006fd0 tx=0x7f5af8006e40 comp rx=0 tx=0).stop 2023-09-23T08:46:47.149 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:46.682+0000 7f5b09dda700 1 -- 172.21.15.82:0/2302662600 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b0407ad30 msgr2=0x7f5b0419bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:46:47.149 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:46.682+0000 7f5b09dda700 1 --2- 172.21.15.82:0/2302662600 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b0407ad30 0x7f5b0419bee0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5af4000c00 tx=0x7f5af4011e70 comp rx=0 tx=0).stop 2023-09-23T08:46:47.149 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:46.682+0000 7f5b09dda700 1 -- 172.21.15.82:0/2302662600 shutdown_connections 2023-09-23T08:46:47.149 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:46.682+0000 7f5b09dda700 1 --2- 172.21.15.82:0/2302662600 >> [v2:172.21.15.82:6800/3761509623,v1:172.21.15.82:6801/3761509623] conn(0x7f5aec038110 0x7f5aec03a5d0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:46:47.149 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:46.682+0000 7f5b09dda700 1 --2- 172.21.15.82:0/2302662600 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b0407ad30 0x7f5b0419bee0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:46:47.149 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:46.682+0000 7f5b09dda700 1 -- 172.21.15.82:0/2302662600 >> 172.21.15.82:0/2302662600 conn(0x7f5b041016a0 msgr2=0x7f5b04102430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:46:47.149 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:46.682+0000 7f5b09dda700 1 -- 172.21.15.82:0/2302662600 shutdown_connections 2023-09-23T08:46:47.149 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:46.682+0000 7f5b09dda700 1 -- 172.21.15.82:0/2302662600 wait complete. 2023-09-23T08:46:47.292 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:46:46 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:46:46.937+0000 7f19fb317200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-09-23T08:46:47.293 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:46:47 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:46:47.042+0000 7f19fb317200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-09-23T08:46:47.293 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:46:47 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:46:47.163+0000 7f19fb317200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-09-23T08:46:47.621 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:46:47 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:46:47.289+0000 7f19fb317200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-09-23T08:46:47.621 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:46:47 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:46:47.531+0000 7f19fb317200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-09-23T08:46:48.012 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:47 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/2302662600' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2023-09-23T08:46:48.012 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:47 smithi082 ceph-mon[97694]: mgrmap e5: x(active, since 5s) 2023-09-23T08:46:48.306 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:46:48 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:46:48.012+0000 7f19fb317200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-09-23T08:46:48.306 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:46:48 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:46:48.184+0000 7f19fb317200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-09-23T08:46:48.306 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:46:48 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:46:48.303+0000 7f19fb317200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-09-23T08:46:48.620 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:46:48 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:46:48.430+0000 7f19fb317200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-09-23T08:46:48.828 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout { 2023-09-23T08:46:48.828 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 5, 2023-09-23T08:46:48.828 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "available": true, 2023-09-23T08:46:48.828 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "active_name": "x", 2023-09-23T08:46:48.829 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-09-23T08:46:48.829 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout } 2023-09-23T08:46:48.829 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:47.698+0000 7fcf2bc6c700 1 Processor -- start 2023-09-23T08:46:48.829 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:47.698+0000 7fcf2bc6c700 1 -- start start 2023-09-23T08:46:48.829 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:47.699+0000 7fcf2bc6c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf241060d0 0x7fcf241064f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:46:48.829 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:47.699+0000 7fcf2bc6c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf24106ac0 con 0x7fcf241060d0 2023-09-23T08:46:48.829 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:47.699+0000 7fcf29a08700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf241060d0 0x7fcf241064f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:46:48.829 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:47.699+0000 7fcf29a08700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf241060d0 0x7fcf241064f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:32948/0 (socket says 172.21.15.82:32948) 2023-09-23T08:46:48.829 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:47.699+0000 7fcf29a08700 1 -- 172.21.15.82:0/3155753270 learned_addr learned my addr 172.21.15.82:0/3155753270 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:46:48.829 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:47.699+0000 7fcf29a08700 1 -- 172.21.15.82:0/3155753270 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf241072d0 con 0x7fcf241060d0 2023-09-23T08:46:48.830 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:47.700+0000 7fcf29a08700 1 --2- 172.21.15.82:0/3155753270 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf241060d0 0x7fcf241064f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fcf200098a0 tx=0x7fcf20009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89a98b500d4e8de0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:46:48.830 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:47.700+0000 7fcf28a06700 1 -- 172.21.15.82:0/3155753270 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcf20004160 con 0x7fcf241060d0 2023-09-23T08:46:48.830 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:47.700+0000 7fcf28a06700 1 -- 172.21.15.82:0/3155753270 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fcf200042c0 con 0x7fcf241060d0 2023-09-23T08:46:48.830 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:47.700+0000 7fcf28a06700 1 -- 172.21.15.82:0/3155753270 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcf20011940 con 0x7fcf241060d0 2023-09-23T08:46:48.830 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:47.700+0000 7fcf2bc6c700 1 -- 172.21.15.82:0/3155753270 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf241060d0 msgr2=0x7fcf241064f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:46:48.830 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:47.700+0000 7fcf2bc6c700 1 --2- 172.21.15.82:0/3155753270 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf241060d0 0x7fcf241064f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fcf200098a0 tx=0x7fcf20009bb0 comp rx=0 tx=0).stop 2023-09-23T08:46:48.830 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:47.701+0000 7fcf2bc6c700 1 -- 172.21.15.82:0/3155753270 shutdown_connections 2023-09-23T08:46:48.830 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:47.701+0000 7fcf2bc6c700 1 --2- 172.21.15.82:0/3155753270 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf241060d0 0x7fcf241064f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:46:48.830 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:47.701+0000 7fcf2bc6c700 1 -- 172.21.15.82:0/3155753270 >> 172.21.15.82:0/3155753270 conn(0x7fcf241016b0 msgr2=0x7fcf24103ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:46:48.830 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:47.701+0000 7fcf2bc6c700 1 -- 172.21.15.82:0/3155753270 shutdown_connections 2023-09-23T08:46:48.831 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:47.701+0000 7fcf2bc6c700 1 -- 172.21.15.82:0/3155753270 wait complete. 2023-09-23T08:46:48.831 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:47.702+0000 7fcf2bc6c700 1 Processor -- start 2023-09-23T08:46:48.831 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:47.702+0000 7fcf2bc6c700 1 -- start start 2023-09-23T08:46:48.831 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:47.702+0000 7fcf2bc6c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf241060d0 0x7fcf24199d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:46:48.831 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:47.702+0000 7fcf2bc6c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2419a250 con 0x7fcf241060d0 2023-09-23T08:46:48.831 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:47.703+0000 7fcf29a08700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf241060d0 0x7fcf24199d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:46:48.831 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:47.703+0000 7fcf29a08700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf241060d0 0x7fcf24199d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:32960/0 (socket says 172.21.15.82:32960) 2023-09-23T08:46:48.831 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:47.703+0000 7fcf29a08700 1 -- 172.21.15.82:0/122712446 learned_addr learned my addr 172.21.15.82:0/122712446 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:46:48.831 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:47.703+0000 7fcf29a08700 1 -- 172.21.15.82:0/122712446 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf20009550 con 0x7fcf241060d0 2023-09-23T08:46:48.831 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:47.703+0000 7fcf29a08700 1 --2- 172.21.15.82:0/122712446 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf241060d0 0x7fcf24199d10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fcf20000c00 tx=0x7fcf20011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:46:48.832 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:47.703+0000 7fcf1affd700 1 -- 172.21.15.82:0/122712446 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcf200036a0 con 0x7fcf241060d0 2023-09-23T08:46:48.832 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:47.703+0000 7fcf1affd700 1 -- 172.21.15.82:0/122712446 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fcf2001b440 con 0x7fcf241060d0 2023-09-23T08:46:48.832 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:47.703+0000 7fcf1affd700 1 -- 172.21.15.82:0/122712446 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcf200193f0 con 0x7fcf241060d0 2023-09-23T08:46:48.832 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:47.703+0000 7fcf2bc6c700 1 -- 172.21.15.82:0/122712446 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf2419a450 con 0x7fcf241060d0 2023-09-23T08:46:48.832 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:47.704+0000 7fcf2bc6c700 1 -- 172.21.15.82:0/122712446 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf2419a870 con 0x7fcf241060d0 2023-09-23T08:46:48.832 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:47.705+0000 7fcf1affd700 1 -- 172.21.15.82:0/122712446 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 45135+0+0 (secure 0 0 0) 0x7fcf20003800 con 0x7fcf241060d0 2023-09-23T08:46:48.832 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:47.705+0000 7fcf2bc6c700 1 -- 172.21.15.82:0/122712446 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf24061f50 con 0x7fcf241060d0 2023-09-23T08:46:48.832 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:47.705+0000 7fcf1affd700 1 --2- 172.21.15.82:0/122712446 >> [v2:172.21.15.82:6800/3761509623,v1:172.21.15.82:6801/3761509623] conn(0x7fcf10038160 0x7fcf1003a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:46:48.832 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:47.705+0000 7fcf1affd700 1 -- 172.21.15.82:0/122712446 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fcf2004bde0 con 0x7fcf241060d0 2023-09-23T08:46:48.833 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:47.705+0000 7fcf29207700 1 -- 172.21.15.82:0/122712446 >> [v2:172.21.15.82:6800/3761509623,v1:172.21.15.82:6801/3761509623] conn(0x7fcf10038160 msgr2=0x7fcf1003a620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/3761509623 2023-09-23T08:46:48.833 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:47.705+0000 7fcf29207700 1 --2- 172.21.15.82:0/122712446 >> [v2:172.21.15.82:6800/3761509623,v1:172.21.15.82:6801/3761509623] conn(0x7fcf10038160 0x7fcf1003a620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-09-23T08:46:48.833 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:47.710+0000 7fcf1affd700 1 -- 172.21.15.82:0/122712446 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7fcf2001b5d0 con 0x7fcf241060d0 2023-09-23T08:46:48.833 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:47.906+0000 7fcf29207700 1 -- 172.21.15.82:0/122712446 >> [v2:172.21.15.82:6800/3761509623,v1:172.21.15.82:6801/3761509623] conn(0x7fcf10038160 msgr2=0x7fcf1003a620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/3761509623 2023-09-23T08:46:48.833 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:47.906+0000 7fcf29207700 1 --2- 172.21.15.82:0/122712446 >> [v2:172.21.15.82:6800/3761509623,v1:172.21.15.82:6801/3761509623] conn(0x7fcf10038160 0x7fcf1003a620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-09-23T08:46:48.833 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:47.985+0000 7fcf2bc6c700 1 -- 172.21.15.82:0/122712446 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7fcf2410a5a0 con 0x7fcf241060d0 2023-09-23T08:46:48.833 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:47.985+0000 7fcf1affd700 1 -- 172.21.15.82:0/122712446 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+88 (secure 0 0 0) 0x7fcf2001f020 con 0x7fcf241060d0 2023-09-23T08:46:48.833 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:47.988+0000 7fcf2bc6c700 1 -- 172.21.15.82:0/122712446 >> [v2:172.21.15.82:6800/3761509623,v1:172.21.15.82:6801/3761509623] conn(0x7fcf10038160 msgr2=0x7fcf1003a620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-23T08:46:48.833 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:47.988+0000 7fcf2bc6c700 1 --2- 172.21.15.82:0/122712446 >> [v2:172.21.15.82:6800/3761509623,v1:172.21.15.82:6801/3761509623] conn(0x7fcf10038160 0x7fcf1003a620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:46:48.833 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:47.988+0000 7fcf2bc6c700 1 -- 172.21.15.82:0/122712446 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf241060d0 msgr2=0x7fcf24199d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:46:48.834 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:47.988+0000 7fcf2bc6c700 1 --2- 172.21.15.82:0/122712446 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf241060d0 0x7fcf24199d10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fcf20000c00 tx=0x7fcf20011e70 comp rx=0 tx=0).stop 2023-09-23T08:46:48.834 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:47.988+0000 7fcf2bc6c700 1 -- 172.21.15.82:0/122712446 shutdown_connections 2023-09-23T08:46:48.834 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:47.988+0000 7fcf2bc6c700 1 --2- 172.21.15.82:0/122712446 >> [v2:172.21.15.82:6800/3761509623,v1:172.21.15.82:6801/3761509623] conn(0x7fcf10038160 0x7fcf1003a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:46:48.834 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:47.988+0000 7fcf2bc6c700 1 --2- 172.21.15.82:0/122712446 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf241060d0 0x7fcf24199d10 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:46:48.834 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:47.988+0000 7fcf2bc6c700 1 -- 172.21.15.82:0/122712446 >> 172.21.15.82:0/122712446 conn(0x7fcf241016b0 msgr2=0x7fcf24102460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:46:48.834 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:47.988+0000 7fcf2bc6c700 1 -- 172.21.15.82:0/122712446 shutdown_connections 2023-09-23T08:46:48.834 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:47.988+0000 7fcf2bc6c700 1 -- 172.21.15.82:0/122712446 wait complete. 2023-09-23T08:46:48.834 INFO:teuthology.orchestra.run.smithi082.stdout:Waiting for the mgr to restart... 2023-09-23T08:46:48.834 INFO:teuthology.orchestra.run.smithi082.stdout:Waiting for mgr epoch 5... 2023-09-23T08:46:48.997 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:48 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/122712446' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-09-23T08:46:49.370 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:46:48 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:46:48.994+0000 7f19fb317200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-09-23T08:46:50.120 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:46:49 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:46:49.854+0000 7f19fb317200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-09-23T08:46:50.121 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:46:49 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:46:49.958+0000 7f19fb317200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-09-23T08:46:51.240 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:46:50 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:46:50.898+0000 7f19fb317200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-09-23T08:46:51.240 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:46:51 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:46:51.015+0000 7f19fb317200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-09-23T08:46:51.240 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:46:51 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:46:51.237+0000 7f19fb317200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-09-23T08:46:51.867 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:46:51 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:46:51.593+0000 7f19fb317200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-09-23T08:46:52.120 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:46:51 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:46:51.864+0000 7f19fb317200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-09-23T08:46:52.121 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:46:52 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:46:52.058+0000 7f19fb317200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-09-23T08:46:52.871 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:46:52 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:46:52.396+0000 7f19fb317200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-09-23T08:46:53.620 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:46:53 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:46:53.304+0000 7f19fb317200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-09-23T08:46:53.621 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:46:53 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:46:53.476+0000 7f19fb317200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-09-23T08:46:54.121 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:46:53 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:46:53.718+0000 7f19fb317200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-09-23T08:46:54.121 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:46:53 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:46:53.860+0000 7f19fb317200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-09-23T08:46:54.621 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:46:54 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:46:54.131+0000 7f19fb317200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-09-23T08:46:55.621 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:46:55 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:46:55.184+0000 7f19fb317200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-09-23T08:46:55.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:55 smithi082 ceph-mon[97694]: Active manager daemon x restarted 2023-09-23T08:46:55.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:55 smithi082 ceph-mon[97694]: Activating manager daemon x 2023-09-23T08:46:55.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:55 smithi082 ceph-mon[97694]: osdmap e2: 0 total, 0 up, 0 in 2023-09-23T08:46:55.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:55 smithi082 ceph-mon[97694]: mgrmap e6: x(active, starting, since 0.00354572s) 2023-09-23T08:46:55.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:55 smithi082 ceph-mon[97694]: from='mgr.14120 172.21.15.82:0/2390432189' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-09-23T08:46:55.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:55 smithi082 ceph-mon[97694]: from='mgr.14120 172.21.15.82:0/2390432189' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-09-23T08:46:55.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:55 smithi082 ceph-mon[97694]: from='mgr.14120 172.21.15.82:0/2390432189' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-09-23T08:46:55.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:55 smithi082 ceph-mon[97694]: from='mgr.14120 172.21.15.82:0/2390432189' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-09-23T08:46:55.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:55 smithi082 ceph-mon[97694]: from='mgr.14120 172.21.15.82:0/2390432189' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-09-23T08:46:55.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:55 smithi082 ceph-mon[97694]: Manager daemon x is now available 2023-09-23T08:46:55.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:55 smithi082 ceph-mon[97694]: from='mgr.14120 172.21.15.82:0/2390432189' entity='mgr.x' 2023-09-23T08:46:55.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:55 smithi082 ceph-mon[97694]: from='mgr.14120 172.21.15.82:0/2390432189' entity='mgr.x' 2023-09-23T08:46:55.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:55 smithi082 ceph-mon[97694]: from='mgr.14120 172.21.15.82:0/2390432189' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:46:55.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:55 smithi082 ceph-mon[97694]: from='mgr.14120 172.21.15.82:0/2390432189' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:46:55.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:55 smithi082 ceph-mon[97694]: from='mgr.14120 172.21.15.82:0/2390432189' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:46:56.482 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:56 smithi082 ceph-mon[97694]: Found migration_current of "None". Setting to last migration. 2023-09-23T08:46:56.482 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:56 smithi082 ceph-mon[97694]: from='mgr.14120 172.21.15.82:0/2390432189' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-09-23T08:46:56.482 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:56 smithi082 ceph-mon[97694]: from='mgr.14120 172.21.15.82:0/2390432189' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-09-23T08:46:56.482 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:56 smithi082 ceph-mon[97694]: from='mgr.14120 172.21.15.82:0/2390432189' entity='mgr.x' 2023-09-23T08:46:56.483 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:56 smithi082 ceph-mon[97694]: from='mgr.14120 172.21.15.82:0/2390432189' entity='mgr.x' 2023-09-23T08:46:56.483 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:56 smithi082 ceph-mon[97694]: mgrmap e7: x(active, since 1.00679s) 2023-09-23T08:46:56.722 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout { 2023-09-23T08:46:56.722 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2023-09-23T08:46:56.722 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "initialized": true 2023-09-23T08:46:56.722 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout } 2023-09-23T08:46:56.722 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:49.379+0000 7f8bc7371700 1 Processor -- start 2023-09-23T08:46:56.722 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:49.379+0000 7f8bc7371700 1 -- start start 2023-09-23T08:46:56.723 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:49.379+0000 7f8bc7371700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8bc01060d0 0x7f8bc01064f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:46:56.723 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:49.379+0000 7f8bc7371700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc0106ac0 con 0x7f8bc01060d0 2023-09-23T08:46:56.723 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:49.380+0000 7f8bc510d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8bc01060d0 0x7f8bc01064f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:46:56.723 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:49.380+0000 7f8bc510d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8bc01060d0 0x7f8bc01064f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:32968/0 (socket says 172.21.15.82:32968) 2023-09-23T08:46:56.723 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:49.380+0000 7f8bc510d700 1 -- 172.21.15.82:0/711110608 learned_addr learned my addr 172.21.15.82:0/711110608 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:46:56.723 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:49.380+0000 7f8bc510d700 1 -- 172.21.15.82:0/711110608 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bc01072d0 con 0x7f8bc01060d0 2023-09-23T08:46:56.723 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:49.380+0000 7f8bc510d700 1 --2- 172.21.15.82:0/711110608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8bc01060d0 0x7f8bc01064f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc0098a0 tx=0x7f8bbc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33a47b7c98bd1fc2 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:46:56.723 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:49.381+0000 7f8bb7fff700 1 -- 172.21.15.82:0/711110608 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8bbc004160 con 0x7f8bc01060d0 2023-09-23T08:46:56.723 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:49.381+0000 7f8bb7fff700 1 -- 172.21.15.82:0/711110608 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f8bbc0042c0 con 0x7f8bc01060d0 2023-09-23T08:46:56.723 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:49.381+0000 7f8bb7fff700 1 -- 172.21.15.82:0/711110608 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8bbc011940 con 0x7f8bc01060d0 2023-09-23T08:46:56.724 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:49.381+0000 7f8bc7371700 1 -- 172.21.15.82:0/711110608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8bc01060d0 msgr2=0x7f8bc01064f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:46:56.724 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:49.381+0000 7f8bc7371700 1 --2- 172.21.15.82:0/711110608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8bc01060d0 0x7f8bc01064f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc0098a0 tx=0x7f8bbc009bb0 comp rx=0 tx=0).stop 2023-09-23T08:46:56.724 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:49.381+0000 7f8bc7371700 1 -- 172.21.15.82:0/711110608 shutdown_connections 2023-09-23T08:46:56.724 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:49.381+0000 7f8bc7371700 1 --2- 172.21.15.82:0/711110608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8bc01060d0 0x7f8bc01064f0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:46:56.724 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:49.381+0000 7f8bc7371700 1 -- 172.21.15.82:0/711110608 >> 172.21.15.82:0/711110608 conn(0x7f8bc01016b0 msgr2=0x7f8bc0103ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:46:56.724 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:49.382+0000 7f8bc7371700 1 -- 172.21.15.82:0/711110608 shutdown_connections 2023-09-23T08:46:56.724 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:49.382+0000 7f8bc7371700 1 -- 172.21.15.82:0/711110608 wait complete. 2023-09-23T08:46:56.724 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:49.382+0000 7f8bc7371700 1 Processor -- start 2023-09-23T08:46:56.724 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:49.383+0000 7f8bc7371700 1 -- start start 2023-09-23T08:46:56.725 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:49.383+0000 7f8bc7371700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8bc01060d0 0x7f8bc019bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:46:56.725 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:49.383+0000 7f8bc7371700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc019c430 con 0x7f8bc01060d0 2023-09-23T08:46:56.725 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:49.383+0000 7f8bc510d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8bc01060d0 0x7f8bc019bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:46:56.725 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:49.383+0000 7f8bc510d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8bc01060d0 0x7f8bc019bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:32984/0 (socket says 172.21.15.82:32984) 2023-09-23T08:46:56.725 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:49.383+0000 7f8bc510d700 1 -- 172.21.15.82:0/3211930020 learned_addr learned my addr 172.21.15.82:0/3211930020 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:46:56.725 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:49.383+0000 7f8bc510d700 1 -- 172.21.15.82:0/3211930020 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bbc009550 con 0x7f8bc01060d0 2023-09-23T08:46:56.725 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:49.384+0000 7f8bc510d700 1 --2- 172.21.15.82:0/3211930020 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8bc01060d0 0x7f8bc019bef0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc000c00 tx=0x7f8bbc011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:46:56.725 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:49.384+0000 7f8bb67fc700 1 -- 172.21.15.82:0/3211930020 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8bbc0036a0 con 0x7f8bc01060d0 2023-09-23T08:46:56.725 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:49.384+0000 7f8bb67fc700 1 -- 172.21.15.82:0/3211930020 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f8bbc01b440 con 0x7f8bc01060d0 2023-09-23T08:46:56.725 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:49.384+0000 7f8bb67fc700 1 -- 172.21.15.82:0/3211930020 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8bbc0193f0 con 0x7f8bc01060d0 2023-09-23T08:46:56.726 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:49.384+0000 7f8bc7371700 1 -- 172.21.15.82:0/3211930020 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bc019c630 con 0x7f8bc01060d0 2023-09-23T08:46:56.726 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:49.384+0000 7f8bc7371700 1 -- 172.21.15.82:0/3211930020 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bc019ca50 con 0x7f8bc01060d0 2023-09-23T08:46:56.726 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:49.385+0000 7f8bb67fc700 1 -- 172.21.15.82:0/3211930020 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 45135+0+0 (secure 0 0 0) 0x7f8bbc01b5b0 con 0x7f8bc01060d0 2023-09-23T08:46:56.726 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:49.386+0000 7f8bb67fc700 1 --2- 172.21.15.82:0/3211930020 >> [v2:172.21.15.82:6800/3761509623,v1:172.21.15.82:6801/3761509623] conn(0x7f8bac038160 0x7f8bac03a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:46:56.726 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:49.386+0000 7f8bb67fc700 1 -- 172.21.15.82:0/3211930020 --> [v2:172.21.15.82:6800/3761509623,v1:172.21.15.82:6801/3761509623] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8bac03ad30 con 0x7f8bac038160 2023-09-23T08:46:56.726 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:49.386+0000 7f8bb67fc700 1 -- 172.21.15.82:0/3211930020 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f8bbc04be10 con 0x7f8bc01060d0 2023-09-23T08:46:56.726 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:49.386+0000 7f8bc490c700 1 -- 172.21.15.82:0/3211930020 >> [v2:172.21.15.82:6800/3761509623,v1:172.21.15.82:6801/3761509623] conn(0x7f8bac038160 msgr2=0x7f8bac03a620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/3761509623 2023-09-23T08:46:56.726 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:49.386+0000 7f8bc490c700 1 --2- 172.21.15.82:0/3211930020 >> [v2:172.21.15.82:6800/3761509623,v1:172.21.15.82:6801/3761509623] conn(0x7f8bac038160 0x7f8bac03a620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-09-23T08:46:56.726 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:49.587+0000 7f8bc490c700 1 -- 172.21.15.82:0/3211930020 >> [v2:172.21.15.82:6800/3761509623,v1:172.21.15.82:6801/3761509623] conn(0x7f8bac038160 msgr2=0x7f8bac03a620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/3761509623 2023-09-23T08:46:56.726 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:49.587+0000 7f8bc490c700 1 --2- 172.21.15.82:0/3211930020 >> [v2:172.21.15.82:6800/3761509623,v1:172.21.15.82:6801/3761509623] conn(0x7f8bac038160 0x7f8bac03a620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-09-23T08:46:56.727 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:49.988+0000 7f8bc490c700 1 -- 172.21.15.82:0/3211930020 >> [v2:172.21.15.82:6800/3761509623,v1:172.21.15.82:6801/3761509623] conn(0x7f8bac038160 msgr2=0x7f8bac03a620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/3761509623 2023-09-23T08:46:56.727 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:49.988+0000 7f8bc490c700 1 --2- 172.21.15.82:0/3211930020 >> [v2:172.21.15.82:6800/3761509623,v1:172.21.15.82:6801/3761509623] conn(0x7f8bac038160 0x7f8bac03a620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-09-23T08:46:56.727 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:50.789+0000 7f8bc490c700 1 -- 172.21.15.82:0/3211930020 >> [v2:172.21.15.82:6800/3761509623,v1:172.21.15.82:6801/3761509623] conn(0x7f8bac038160 msgr2=0x7f8bac03a620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/3761509623 2023-09-23T08:46:56.727 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:50.789+0000 7f8bc490c700 1 --2- 172.21.15.82:0/3211930020 >> [v2:172.21.15.82:6800/3761509623,v1:172.21.15.82:6801/3761509623] conn(0x7f8bac038160 0x7f8bac03a620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-09-23T08:46:56.727 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:52.390+0000 7f8bc490c700 1 -- 172.21.15.82:0/3211930020 >> [v2:172.21.15.82:6800/3761509623,v1:172.21.15.82:6801/3761509623] conn(0x7f8bac038160 msgr2=0x7f8bac03a620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/3761509623 2023-09-23T08:46:56.727 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:52.390+0000 7f8bc490c700 1 --2- 172.21.15.82:0/3211930020 >> [v2:172.21.15.82:6800/3761509623,v1:172.21.15.82:6801/3761509623] conn(0x7f8bac038160 0x7f8bac03a620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-09-23T08:46:56.727 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:55.188+0000 7f8bb67fc700 1 -- 172.21.15.82:0/3211930020 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mgrmap(e 6) v1 ==== 44902+0+0 (secure 0 0 0) 0x7f8bbc019550 con 0x7f8bc01060d0 2023-09-23T08:46:56.727 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:55.188+0000 7f8bb67fc700 1 -- 172.21.15.82:0/3211930020 >> [v2:172.21.15.82:6800/3761509623,v1:172.21.15.82:6801/3761509623] conn(0x7f8bac038160 msgr2=0x7f8bac03a620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-23T08:46:56.727 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:55.188+0000 7f8bb67fc700 1 --2- 172.21.15.82:0/3211930020 >> [v2:172.21.15.82:6800/3761509623,v1:172.21.15.82:6801/3761509623] conn(0x7f8bac038160 0x7f8bac03a620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:46:56.728 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:56.190+0000 7f8bb67fc700 1 -- 172.21.15.82:0/3211930020 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 7) v1 ==== 45029+0+0 (secure 0 0 0) 0x7f8bbc022360 con 0x7f8bc01060d0 2023-09-23T08:46:56.728 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:56.191+0000 7f8bb67fc700 1 --2- 172.21.15.82:0/3211930020 >> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] conn(0x7f8bac03ba80 0x7f8bac03de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:46:56.728 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:56.191+0000 7f8bb67fc700 1 -- 172.21.15.82:0/3211930020 --> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8bac03ad30 con 0x7f8bac03ba80 2023-09-23T08:46:56.728 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:56.191+0000 7f8bc490c700 1 --2- 172.21.15.82:0/3211930020 >> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] conn(0x7f8bac03ba80 0x7f8bac03de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:46:56.728 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:56.192+0000 7f8bc490c700 1 --2- 172.21.15.82:0/3211930020 >> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] conn(0x7f8bac03ba80 0x7f8bac03de70 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f8bb0003a10 tx=0x7f8bb00092b0 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:46:56.728 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:56.193+0000 7f8bb67fc700 1 -- 172.21.15.82:0/3211930020 <== mgr.14120 v2:172.21.15.82:6800/2733521564 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6910 (secure 0 0 0) 0x7f8bac03ad30 con 0x7f8bac03ba80 2023-09-23T08:46:56.728 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:56.200+0000 7f8bc7371700 1 -- 172.21.15.82:0/3211930020 --> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f8bc019d230 con 0x7f8bac03ba80 2023-09-23T08:46:56.728 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:56.200+0000 7f8bb67fc700 1 -- 172.21.15.82:0/3211930020 <== mgr.14120 v2:172.21.15.82:6800/2733521564 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f8bc019d230 con 0x7f8bac03ba80 2023-09-23T08:46:56.729 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:56.200+0000 7f8bc7371700 1 -- 172.21.15.82:0/3211930020 >> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] conn(0x7f8bac03ba80 msgr2=0x7f8bac03de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:46:56.729 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:56.200+0000 7f8bc7371700 1 --2- 172.21.15.82:0/3211930020 >> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] conn(0x7f8bac03ba80 0x7f8bac03de70 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f8bb0003a10 tx=0x7f8bb00092b0 comp rx=0 tx=0).stop 2023-09-23T08:46:56.729 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:56.200+0000 7f8bc7371700 1 -- 172.21.15.82:0/3211930020 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8bc01060d0 msgr2=0x7f8bc019bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:46:56.729 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:56.200+0000 7f8bc7371700 1 --2- 172.21.15.82:0/3211930020 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8bc01060d0 0x7f8bc019bef0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc000c00 tx=0x7f8bbc011e70 comp rx=0 tx=0).stop 2023-09-23T08:46:56.729 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:56.200+0000 7f8bc7371700 1 -- 172.21.15.82:0/3211930020 shutdown_connections 2023-09-23T08:46:56.729 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:56.200+0000 7f8bc7371700 1 --2- 172.21.15.82:0/3211930020 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8bc01060d0 0x7f8bc019bef0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:46:56.729 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:56.200+0000 7f8bc7371700 1 --2- 172.21.15.82:0/3211930020 >> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] conn(0x7f8bac03ba80 0x7f8bac03de70 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:46:56.729 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:56.200+0000 7f8bc7371700 1 --2- 172.21.15.82:0/3211930020 >> [v2:172.21.15.82:6800/3761509623,v1:172.21.15.82:6801/3761509623] conn(0x7f8bac038160 0x7f8bac03a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:46:56.729 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:56.200+0000 7f8bc7371700 1 -- 172.21.15.82:0/3211930020 >> 172.21.15.82:0/3211930020 conn(0x7f8bc01016b0 msgr2=0x7f8bc0102460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:46:56.729 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:56.201+0000 7f8bc7371700 1 -- 172.21.15.82:0/3211930020 shutdown_connections 2023-09-23T08:46:56.730 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:56.201+0000 7f8bc7371700 1 -- 172.21.15.82:0/3211930020 wait complete. 2023-09-23T08:46:56.730 INFO:teuthology.orchestra.run.smithi082.stdout:mgr epoch 5 is available 2023-09-23T08:46:56.730 INFO:teuthology.orchestra.run.smithi082.stdout:Setting orchestrator backend to cephadm... 2023-09-23T08:46:57.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:57 smithi082 ceph-mon[97694]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-09-23T08:46:57.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:57 smithi082 ceph-mon[97694]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-09-23T08:46:57.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:57 smithi082 ceph-mon[97694]: [23/Sep/2023:08:46:56] ENGINE Bus STARTING 2023-09-23T08:46:57.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:57 smithi082 ceph-mon[97694]: [23/Sep/2023:08:46:56] ENGINE Serving on https://172.21.15.82:7150 2023-09-23T08:46:57.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:57 smithi082 ceph-mon[97694]: [23/Sep/2023:08:46:56] ENGINE Serving on http://172.21.15.82:8765 2023-09-23T08:46:57.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:57 smithi082 ceph-mon[97694]: [23/Sep/2023:08:46:56] ENGINE Bus STARTED 2023-09-23T08:46:57.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:57 smithi082 ceph-mon[97694]: from='mgr.14120 172.21.15.82:0/2390432189' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:46:57.998 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:57.269+0000 7f0d49f00700 1 Processor -- start 2023-09-23T08:46:57.998 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:57.269+0000 7f0d49f00700 1 -- start start 2023-09-23T08:46:57.998 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:57.270+0000 7f0d49f00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d441060e0 0x7f0d44106500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:46:57.998 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:57.270+0000 7f0d49f00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d44106ad0 con 0x7f0d441060e0 2023-09-23T08:46:57.998 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:57.270+0000 7f0d437fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d441060e0 0x7f0d44106500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:46:57.999 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:57.270+0000 7f0d437fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d441060e0 0x7f0d44106500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54208/0 (socket says 172.21.15.82:54208) 2023-09-23T08:46:57.999 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:57.270+0000 7f0d437fe700 1 -- 172.21.15.82:0/1859890766 learned_addr learned my addr 172.21.15.82:0/1859890766 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:46:57.999 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:57.270+0000 7f0d437fe700 1 -- 172.21.15.82:0/1859890766 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d441072e0 con 0x7f0d441060e0 2023-09-23T08:46:57.999 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:57.271+0000 7f0d437fe700 1 --2- 172.21.15.82:0/1859890766 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d441060e0 0x7f0d44106500 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0d340098a0 tx=0x7f0d34009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c79ccad4ef3ba94 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:46:57.999 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:57.271+0000 7f0d427fc700 1 -- 172.21.15.82:0/1859890766 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0d34004160 con 0x7f0d441060e0 2023-09-23T08:46:57.999 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:57.271+0000 7f0d427fc700 1 -- 172.21.15.82:0/1859890766 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f0d340042c0 con 0x7f0d441060e0 2023-09-23T08:46:57.999 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:57.271+0000 7f0d427fc700 1 -- 172.21.15.82:0/1859890766 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0d34011940 con 0x7f0d441060e0 2023-09-23T08:46:57.999 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:57.271+0000 7f0d49f00700 1 -- 172.21.15.82:0/1859890766 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d441060e0 msgr2=0x7f0d44106500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:46:57.999 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:57.271+0000 7f0d49f00700 1 --2- 172.21.15.82:0/1859890766 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d441060e0 0x7f0d44106500 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0d340098a0 tx=0x7f0d34009bb0 comp rx=0 tx=0).stop 2023-09-23T08:46:57.999 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:57.271+0000 7f0d49f00700 1 -- 172.21.15.82:0/1859890766 shutdown_connections 2023-09-23T08:46:57.999 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:57.271+0000 7f0d49f00700 1 --2- 172.21.15.82:0/1859890766 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d441060e0 0x7f0d44106500 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:46:58.000 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:57.271+0000 7f0d49f00700 1 -- 172.21.15.82:0/1859890766 >> 172.21.15.82:0/1859890766 conn(0x7f0d441016c0 msgr2=0x7f0d44103ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:46:58.000 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:57.272+0000 7f0d49f00700 1 -- 172.21.15.82:0/1859890766 shutdown_connections 2023-09-23T08:46:58.000 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:57.272+0000 7f0d49f00700 1 -- 172.21.15.82:0/1859890766 wait complete. 2023-09-23T08:46:58.000 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:57.272+0000 7f0d49f00700 1 Processor -- start 2023-09-23T08:46:58.000 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:57.273+0000 7f0d49f00700 1 -- start start 2023-09-23T08:46:58.000 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:57.273+0000 7f0d49f00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d441060e0 0x7f0d441a0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:46:58.000 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:57.273+0000 7f0d49f00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d441a0840 con 0x7f0d441060e0 2023-09-23T08:46:58.000 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:57.273+0000 7f0d437fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d441060e0 0x7f0d441a0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:46:58.000 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:57.273+0000 7f0d437fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d441060e0 0x7f0d441a0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54214/0 (socket says 172.21.15.82:54214) 2023-09-23T08:46:58.000 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:57.273+0000 7f0d437fe700 1 -- 172.21.15.82:0/1485890239 learned_addr learned my addr 172.21.15.82:0/1485890239 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:46:58.000 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:57.274+0000 7f0d437fe700 1 -- 172.21.15.82:0/1485890239 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d34009550 con 0x7f0d441060e0 2023-09-23T08:46:58.000 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:57.274+0000 7f0d437fe700 1 --2- 172.21.15.82:0/1485890239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d441060e0 0x7f0d441a0300 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0d34000c00 tx=0x7f0d34011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:46:58.001 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:57.274+0000 7f0d40ff9700 1 -- 172.21.15.82:0/1485890239 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0d340036a0 con 0x7f0d441060e0 2023-09-23T08:46:58.001 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:57.274+0000 7f0d49f00700 1 -- 172.21.15.82:0/1485890239 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d441a0a40 con 0x7f0d441060e0 2023-09-23T08:46:58.001 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:57.274+0000 7f0d40ff9700 1 -- 172.21.15.82:0/1485890239 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f0d34003c70 con 0x7f0d441060e0 2023-09-23T08:46:58.001 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:57.274+0000 7f0d40ff9700 1 -- 172.21.15.82:0/1485890239 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0d340193f0 con 0x7f0d441060e0 2023-09-23T08:46:58.001 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:57.274+0000 7f0d49f00700 1 -- 172.21.15.82:0/1485890239 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d441a0e60 con 0x7f0d441060e0 2023-09-23T08:46:58.001 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:57.275+0000 7f0d40ff9700 1 -- 172.21.15.82:0/1485890239 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 8) v1 ==== 45135+0+0 (secure 0 0 0) 0x7f0d3401b440 con 0x7f0d441060e0 2023-09-23T08:46:58.001 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:57.275+0000 7f0d49f00700 1 -- 172.21.15.82:0/1485890239 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d44061f50 con 0x7f0d441060e0 2023-09-23T08:46:58.001 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:57.276+0000 7f0d40ff9700 1 --2- 172.21.15.82:0/1485890239 >> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] conn(0x7f0d2c038110 0x7f0d2c03a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:46:58.001 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:57.276+0000 7f0d40ff9700 1 -- 172.21.15.82:0/1485890239 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f0d3404beb0 con 0x7f0d441060e0 2023-09-23T08:46:58.001 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:57.276+0000 7f0d42ffd700 1 --2- 172.21.15.82:0/1485890239 >> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] conn(0x7f0d2c038110 0x7f0d2c03a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:46:58.001 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:57.276+0000 7f0d42ffd700 1 --2- 172.21.15.82:0/1485890239 >> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] conn(0x7f0d2c038110 0x7f0d2c03a5d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0d38006fd0 tx=0x7f0d38006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:46:58.002 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:57.282+0000 7f0d40ff9700 1 -- 172.21.15.82:0/1485890239 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f0d34022950 con 0x7f0d441060e0 2023-09-23T08:46:58.002 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:57.495+0000 7f0d49f00700 1 -- 172.21.15.82:0/1485890239 --> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7f0d44102b20 con 0x7f0d2c038110 2023-09-23T08:46:58.002 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:57.501+0000 7f0d40ff9700 1 -- 172.21.15.82:0/1485890239 <== mgr.14120 v2:172.21.15.82:6800/2733521564 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f0d44102b20 con 0x7f0d2c038110 2023-09-23T08:46:58.002 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:57.504+0000 7f0d49f00700 1 -- 172.21.15.82:0/1485890239 >> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] conn(0x7f0d2c038110 msgr2=0x7f0d2c03a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:46:58.002 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:57.504+0000 7f0d49f00700 1 --2- 172.21.15.82:0/1485890239 >> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] conn(0x7f0d2c038110 0x7f0d2c03a5d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0d38006fd0 tx=0x7f0d38006e40 comp rx=0 tx=0).stop 2023-09-23T08:46:58.002 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:57.504+0000 7f0d49f00700 1 -- 172.21.15.82:0/1485890239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d441060e0 msgr2=0x7f0d441a0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:46:58.002 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:57.504+0000 7f0d49f00700 1 --2- 172.21.15.82:0/1485890239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d441060e0 0x7f0d441a0300 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0d34000c00 tx=0x7f0d34011e70 comp rx=0 tx=0).stop 2023-09-23T08:46:58.002 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:57.504+0000 7f0d49f00700 1 -- 172.21.15.82:0/1485890239 shutdown_connections 2023-09-23T08:46:58.002 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:57.504+0000 7f0d49f00700 1 --2- 172.21.15.82:0/1485890239 >> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] conn(0x7f0d2c038110 0x7f0d2c03a5d0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:46:58.002 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:57.504+0000 7f0d49f00700 1 --2- 172.21.15.82:0/1485890239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d441060e0 0x7f0d441a0300 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:46:58.002 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:57.504+0000 7f0d49f00700 1 -- 172.21.15.82:0/1485890239 >> 172.21.15.82:0/1485890239 conn(0x7f0d441016c0 msgr2=0x7f0d44102410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:46:58.002 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:57.504+0000 7f0d49f00700 1 -- 172.21.15.82:0/1485890239 shutdown_connections 2023-09-23T08:46:58.003 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:57.504+0000 7f0d49f00700 1 -- 172.21.15.82:0/1485890239 wait complete. 2023-09-23T08:46:58.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:58 smithi082 ceph-mon[97694]: mgrmap e8: x(active, since 2s) 2023-09-23T08:46:58.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:58 smithi082 ceph-mon[97694]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:46:58.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:58 smithi082 ceph-mon[97694]: from='mgr.14120 172.21.15.82:0/2390432189' entity='mgr.x' 2023-09-23T08:46:58.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:58 smithi082 ceph-mon[97694]: from='mgr.14120 172.21.15.82:0/2390432189' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:46:59.176 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout value unchanged 2023-09-23T08:46:59.176 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:58.540+0000 7fb5882de700 1 Processor -- start 2023-09-23T08:46:59.176 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:58.540+0000 7fb5882de700 1 -- start start 2023-09-23T08:46:59.176 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:58.540+0000 7fb5882de700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb58007ad10 0x7fb580079170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:46:59.176 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:58.540+0000 7fb5882de700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb580079740 con 0x7fb58007ad10 2023-09-23T08:46:59.176 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:58.541+0000 7fb58607a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb58007ad10 0x7fb580079170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:46:59.177 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:58.541+0000 7fb58607a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb58007ad10 0x7fb580079170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54222/0 (socket says 172.21.15.82:54222) 2023-09-23T08:46:59.177 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:58.541+0000 7fb58607a700 1 -- 172.21.15.82:0/4278644024 learned_addr learned my addr 172.21.15.82:0/4278644024 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:46:59.177 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:58.541+0000 7fb58607a700 1 -- 172.21.15.82:0/4278644024 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb580079880 con 0x7fb58007ad10 2023-09-23T08:46:59.177 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:58.541+0000 7fb58607a700 1 --2- 172.21.15.82:0/4278644024 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb58007ad10 0x7fb580079170 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb57c0098a0 tx=0x7fb57c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aab6f0b0760ea0d2 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:46:59.177 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:58.541+0000 7fb585078700 1 -- 172.21.15.82:0/4278644024 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb57c004160 con 0x7fb58007ad10 2023-09-23T08:46:59.177 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:58.542+0000 7fb585078700 1 -- 172.21.15.82:0/4278644024 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fb57c0042c0 con 0x7fb58007ad10 2023-09-23T08:46:59.177 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:58.542+0000 7fb585078700 1 -- 172.21.15.82:0/4278644024 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb57c011940 con 0x7fb58007ad10 2023-09-23T08:46:59.177 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:58.542+0000 7fb5882de700 1 -- 172.21.15.82:0/4278644024 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb58007ad10 msgr2=0x7fb580079170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:46:59.177 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:58.542+0000 7fb5882de700 1 --2- 172.21.15.82:0/4278644024 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb58007ad10 0x7fb580079170 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb57c0098a0 tx=0x7fb57c009bb0 comp rx=0 tx=0).stop 2023-09-23T08:46:59.177 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:58.542+0000 7fb5882de700 1 -- 172.21.15.82:0/4278644024 shutdown_connections 2023-09-23T08:46:59.177 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:58.542+0000 7fb5882de700 1 --2- 172.21.15.82:0/4278644024 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb58007ad10 0x7fb580079170 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:46:59.177 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:58.542+0000 7fb5882de700 1 -- 172.21.15.82:0/4278644024 >> 172.21.15.82:0/4278644024 conn(0x7fb5801016b0 msgr2=0x7fb580103ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:46:59.178 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:58.542+0000 7fb5882de700 1 -- 172.21.15.82:0/4278644024 shutdown_connections 2023-09-23T08:46:59.178 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:58.542+0000 7fb5882de700 1 -- 172.21.15.82:0/4278644024 wait complete. 2023-09-23T08:46:59.178 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:58.543+0000 7fb5882de700 1 Processor -- start 2023-09-23T08:46:59.178 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:58.544+0000 7fb5882de700 1 -- start start 2023-09-23T08:46:59.178 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:58.544+0000 7fb5882de700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb58007ad10 0x7fb58019beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:46:59.178 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:58.544+0000 7fb5882de700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb58019c3f0 con 0x7fb58007ad10 2023-09-23T08:46:59.178 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:58.544+0000 7fb58607a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb58007ad10 0x7fb58019beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:46:59.178 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:58.544+0000 7fb58607a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb58007ad10 0x7fb58019beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54228/0 (socket says 172.21.15.82:54228) 2023-09-23T08:46:59.178 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:58.544+0000 7fb58607a700 1 -- 172.21.15.82:0/2197168318 learned_addr learned my addr 172.21.15.82:0/2197168318 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:46:59.178 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:58.544+0000 7fb58607a700 1 -- 172.21.15.82:0/2197168318 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb57c009550 con 0x7fb58007ad10 2023-09-23T08:46:59.178 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:58.545+0000 7fb58607a700 1 --2- 172.21.15.82:0/2197168318 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb58007ad10 0x7fb58019beb0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb57c011dc0 tx=0x7fb57c011ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:46:59.179 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:58.545+0000 7fb5777fe700 1 -- 172.21.15.82:0/2197168318 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb57c0037d0 con 0x7fb58007ad10 2023-09-23T08:46:59.179 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:58.545+0000 7fb5777fe700 1 -- 172.21.15.82:0/2197168318 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fb57c01b440 con 0x7fb58007ad10 2023-09-23T08:46:59.179 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:58.545+0000 7fb5777fe700 1 -- 172.21.15.82:0/2197168318 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb57c01a560 con 0x7fb58007ad10 2023-09-23T08:46:59.179 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:58.545+0000 7fb5882de700 1 -- 172.21.15.82:0/2197168318 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb58019c5f0 con 0x7fb58007ad10 2023-09-23T08:46:59.179 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:58.545+0000 7fb5882de700 1 -- 172.21.15.82:0/2197168318 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb58019ca10 con 0x7fb58007ad10 2023-09-23T08:46:59.179 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:58.546+0000 7fb5882de700 1 -- 172.21.15.82:0/2197168318 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb580061f50 con 0x7fb58007ad10 2023-09-23T08:46:59.179 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:58.546+0000 7fb5777fe700 1 -- 172.21.15.82:0/2197168318 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 8) v1 ==== 45135+0+0 (secure 0 0 0) 0x7fb57c01b5b0 con 0x7fb58007ad10 2023-09-23T08:46:59.179 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:58.547+0000 7fb5777fe700 1 --2- 172.21.15.82:0/2197168318 >> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] conn(0x7fb56c038160 0x7fb56c03a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:46:59.179 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:58.547+0000 7fb5777fe700 1 -- 172.21.15.82:0/2197168318 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fb57c04bf10 con 0x7fb58007ad10 2023-09-23T08:46:59.179 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:58.547+0000 7fb585879700 1 --2- 172.21.15.82:0/2197168318 >> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] conn(0x7fb56c038160 0x7fb56c03a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:46:59.179 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:58.548+0000 7fb585879700 1 --2- 172.21.15.82:0/2197168318 >> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] conn(0x7fb56c038160 0x7fb56c03a620 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb570006fd0 tx=0x7fb570006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:46:59.180 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:58.552+0000 7fb5777fe700 1 -- 172.21.15.82:0/2197168318 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7fb57c023590 con 0x7fb58007ad10 2023-09-23T08:46:59.180 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:58.750+0000 7fb5882de700 1 -- 172.21.15.82:0/2197168318 --> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7fb580102b70 con 0x7fb56c038160 2023-09-23T08:46:59.180 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:58.751+0000 7fb5777fe700 1 -- 172.21.15.82:0/2197168318 <== mgr.14120 v2:172.21.15.82:6800/2733521564 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7fb580102b70 con 0x7fb56c038160 2023-09-23T08:46:59.180 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:58.753+0000 7fb5882de700 1 -- 172.21.15.82:0/2197168318 >> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] conn(0x7fb56c038160 msgr2=0x7fb56c03a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:46:59.180 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:58.753+0000 7fb5882de700 1 --2- 172.21.15.82:0/2197168318 >> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] conn(0x7fb56c038160 0x7fb56c03a620 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb570006fd0 tx=0x7fb570006e40 comp rx=0 tx=0).stop 2023-09-23T08:46:59.180 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:58.753+0000 7fb5882de700 1 -- 172.21.15.82:0/2197168318 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb58007ad10 msgr2=0x7fb58019beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:46:59.180 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:58.753+0000 7fb5882de700 1 --2- 172.21.15.82:0/2197168318 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb58007ad10 0x7fb58019beb0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb57c011dc0 tx=0x7fb57c011ea0 comp rx=0 tx=0).stop 2023-09-23T08:46:59.180 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:58.753+0000 7fb5882de700 1 -- 172.21.15.82:0/2197168318 shutdown_connections 2023-09-23T08:46:59.180 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:58.753+0000 7fb5882de700 1 --2- 172.21.15.82:0/2197168318 >> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] conn(0x7fb56c038160 0x7fb56c03a620 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:46:59.180 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:58.753+0000 7fb5882de700 1 --2- 172.21.15.82:0/2197168318 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb58007ad10 0x7fb58019beb0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:46:59.180 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:58.753+0000 7fb5882de700 1 -- 172.21.15.82:0/2197168318 >> 172.21.15.82:0/2197168318 conn(0x7fb5801016b0 msgr2=0x7fb580102460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:46:59.181 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:58.754+0000 7fb5882de700 1 -- 172.21.15.82:0/2197168318 shutdown_connections 2023-09-23T08:46:59.181 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:58.754+0000 7fb5882de700 1 -- 172.21.15.82:0/2197168318 wait complete. 2023-09-23T08:46:59.181 INFO:teuthology.orchestra.run.smithi082.stdout:Generating ssh key... 2023-09-23T08:46:59.458 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:46:59 smithi082 ceph-mon[97694]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:47:00.371 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:46:59 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: Generating public/private rsa key pair. 2023-09-23T08:47:00.371 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:46:59 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: Your identification has been saved in /tmp/tmpkubclwv1/key. 2023-09-23T08:47:00.371 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:46:59 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: Your public key has been saved in /tmp/tmpkubclwv1/key.pub. 2023-09-23T08:47:00.371 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:46:59 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: The key fingerprint is: 2023-09-23T08:47:00.371 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:46:59 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: SHA256:bB4VXVmuRn5VULi7DVrz1TczgSA+Pt76gLgW5SKSt4c ceph-8926e286-59ed-11ee-8db4-212e2dc638e7 2023-09-23T08:47:00.371 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:46:59 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: The key's randomart image is: 2023-09-23T08:47:00.371 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:46:59 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: +---[RSA 3072]----+ 2023-09-23T08:47:00.371 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:46:59 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: | .. .o*+| 2023-09-23T08:47:00.371 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:46:59 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: | . o. o..| 2023-09-23T08:47:00.372 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:46:59 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: | . o . o.o| 2023-09-23T08:47:00.372 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:46:59 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: | o + +.o.| 2023-09-23T08:47:00.372 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:46:59 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: | . o S . +.+| 2023-09-23T08:47:00.372 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:46:59 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: | o o o.+.+ .==+| 2023-09-23T08:47:00.372 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:46:59 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: | o +.o.o.o o **| 2023-09-23T08:47:00.372 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:46:59 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: | E o. .... . o| 2023-09-23T08:47:00.372 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:46:59 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: | o. .o. | 2023-09-23T08:47:00.372 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:46:59 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: +----[SHA256]-----+ 2023-09-23T08:47:00.456 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:59.705+0000 7facfad90700 1 Processor -- start 2023-09-23T08:47:00.456 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:59.706+0000 7facfad90700 1 -- start start 2023-09-23T08:47:00.457 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:59.706+0000 7facfad90700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7facf407acf0 0x7facf4079150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:47:00.457 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:59.706+0000 7facfad90700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facf4079720 con 0x7facf407acf0 2023-09-23T08:47:00.457 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:59.706+0000 7facf8b2c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7facf407acf0 0x7facf4079150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:47:00.457 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:59.706+0000 7facf8b2c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7facf407acf0 0x7facf4079150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54244/0 (socket says 172.21.15.82:54244) 2023-09-23T08:47:00.457 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:59.706+0000 7facf8b2c700 1 -- 172.21.15.82:0/1432790406 learned_addr learned my addr 172.21.15.82:0/1432790406 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:47:00.457 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:59.707+0000 7facf8b2c700 1 -- 172.21.15.82:0/1432790406 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facf4079860 con 0x7facf407acf0 2023-09-23T08:47:00.457 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:59.707+0000 7facf8b2c700 1 --2- 172.21.15.82:0/1432790406 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7facf407acf0 0x7facf4079150 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7face80098a0 tx=0x7face8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b48af014c906eb74 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:47:00.457 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:59.707+0000 7facf37fe700 1 -- 172.21.15.82:0/1432790406 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7face8004160 con 0x7facf407acf0 2023-09-23T08:47:00.457 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:59.707+0000 7facf37fe700 1 -- 172.21.15.82:0/1432790406 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7face80042c0 con 0x7facf407acf0 2023-09-23T08:47:00.457 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:59.707+0000 7facf37fe700 1 -- 172.21.15.82:0/1432790406 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7face8011940 con 0x7facf407acf0 2023-09-23T08:47:00.457 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:59.708+0000 7facfad90700 1 -- 172.21.15.82:0/1432790406 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7facf407acf0 msgr2=0x7facf4079150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:47:00.458 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:59.708+0000 7facfad90700 1 --2- 172.21.15.82:0/1432790406 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7facf407acf0 0x7facf4079150 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7face80098a0 tx=0x7face8009bb0 comp rx=0 tx=0).stop 2023-09-23T08:47:00.458 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:59.708+0000 7facfad90700 1 -- 172.21.15.82:0/1432790406 shutdown_connections 2023-09-23T08:47:00.458 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:59.708+0000 7facfad90700 1 --2- 172.21.15.82:0/1432790406 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7facf407acf0 0x7facf4079150 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:47:00.458 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:59.708+0000 7facfad90700 1 -- 172.21.15.82:0/1432790406 >> 172.21.15.82:0/1432790406 conn(0x7facf41016b0 msgr2=0x7facf4103ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:47:00.458 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:59.708+0000 7facfad90700 1 -- 172.21.15.82:0/1432790406 shutdown_connections 2023-09-23T08:47:00.458 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:59.708+0000 7facfad90700 1 -- 172.21.15.82:0/1432790406 wait complete. 2023-09-23T08:47:00.458 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:59.709+0000 7facfad90700 1 Processor -- start 2023-09-23T08:47:00.458 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:59.709+0000 7facfad90700 1 -- start start 2023-09-23T08:47:00.458 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:59.709+0000 7facfad90700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7facf407acf0 0x7facf419beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:47:00.458 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:59.709+0000 7facfad90700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facf419c3f0 con 0x7facf407acf0 2023-09-23T08:47:00.458 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:59.709+0000 7facf8b2c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7facf407acf0 0x7facf419beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:47:00.459 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:59.710+0000 7facf8b2c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7facf407acf0 0x7facf419beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54246/0 (socket says 172.21.15.82:54246) 2023-09-23T08:47:00.459 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:59.710+0000 7facf8b2c700 1 -- 172.21.15.82:0/1305620983 learned_addr learned my addr 172.21.15.82:0/1305620983 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:47:00.459 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:59.710+0000 7facf8b2c700 1 -- 172.21.15.82:0/1305620983 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7face8009550 con 0x7facf407acf0 2023-09-23T08:47:00.459 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:59.710+0000 7facf8b2c700 1 --2- 172.21.15.82:0/1305620983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7facf407acf0 0x7facf419beb0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7face8011dc0 tx=0x7face8011ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:47:00.459 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:59.710+0000 7facf1ffb700 1 -- 172.21.15.82:0/1305620983 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7face80037d0 con 0x7facf407acf0 2023-09-23T08:47:00.459 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:59.710+0000 7facf1ffb700 1 -- 172.21.15.82:0/1305620983 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7face801b440 con 0x7facf407acf0 2023-09-23T08:47:00.459 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:59.710+0000 7facfad90700 1 -- 172.21.15.82:0/1305620983 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facf419c5f0 con 0x7facf407acf0 2023-09-23T08:47:00.459 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:59.710+0000 7facf1ffb700 1 -- 172.21.15.82:0/1305620983 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7face801a560 con 0x7facf407acf0 2023-09-23T08:47:00.459 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:59.710+0000 7facfad90700 1 -- 172.21.15.82:0/1305620983 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facf419ca10 con 0x7facf407acf0 2023-09-23T08:47:00.459 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:59.711+0000 7facf1ffb700 1 -- 172.21.15.82:0/1305620983 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 8) v1 ==== 45135+0+0 (secure 0 0 0) 0x7face8003930 con 0x7facf407acf0 2023-09-23T08:47:00.459 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:59.712+0000 7facfad90700 1 -- 172.21.15.82:0/1305620983 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facf4061f50 con 0x7facf407acf0 2023-09-23T08:47:00.459 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:59.712+0000 7facf1ffb700 1 --2- 172.21.15.82:0/1305620983 >> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] conn(0x7face4038160 0x7face403a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:47:00.460 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:59.712+0000 7facf1ffb700 1 -- 172.21.15.82:0/1305620983 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7face804bf10 con 0x7facf407acf0 2023-09-23T08:47:00.460 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:59.712+0000 7facf3fff700 1 --2- 172.21.15.82:0/1305620983 >> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] conn(0x7face4038160 0x7face403a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:47:00.460 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:59.713+0000 7facf3fff700 1 --2- 172.21.15.82:0/1305620983 >> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] conn(0x7face4038160 0x7face403a620 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7face0006fd0 tx=0x7face0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:47:00.460 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:59.717+0000 7facf1ffb700 1 -- 172.21.15.82:0/1305620983 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7face801b920 con 0x7facf407acf0 2023-09-23T08:47:00.460 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:59.915+0000 7facfad90700 1 -- 172.21.15.82:0/1305620983 --> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7facf4102ba0 con 0x7face4038160 2023-09-23T08:47:00.460 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:46:59.999+0000 7facf1ffb700 1 -- 172.21.15.82:0/1305620983 <== mgr.14120 v2:172.21.15.82:6800/2733521564 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7facf4102ba0 con 0x7face4038160 2023-09-23T08:47:00.460 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:00.001+0000 7facfad90700 1 -- 172.21.15.82:0/1305620983 >> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] conn(0x7face4038160 msgr2=0x7face403a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:47:00.460 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:00.001+0000 7facfad90700 1 --2- 172.21.15.82:0/1305620983 >> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] conn(0x7face4038160 0x7face403a620 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7face0006fd0 tx=0x7face0006e40 comp rx=0 tx=0).stop 2023-09-23T08:47:00.460 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:00.001+0000 7facfad90700 1 -- 172.21.15.82:0/1305620983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7facf407acf0 msgr2=0x7facf419beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:47:00.460 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:00.001+0000 7facfad90700 1 --2- 172.21.15.82:0/1305620983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7facf407acf0 0x7facf419beb0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7face8011dc0 tx=0x7face8011ea0 comp rx=0 tx=0).stop 2023-09-23T08:47:00.460 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:00.001+0000 7facfad90700 1 -- 172.21.15.82:0/1305620983 shutdown_connections 2023-09-23T08:47:00.461 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:00.001+0000 7facfad90700 1 --2- 172.21.15.82:0/1305620983 >> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] conn(0x7face4038160 0x7face403a620 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:47:00.461 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:00.001+0000 7facfad90700 1 --2- 172.21.15.82:0/1305620983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7facf407acf0 0x7facf419beb0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:47:00.461 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:00.001+0000 7facfad90700 1 -- 172.21.15.82:0/1305620983 >> 172.21.15.82:0/1305620983 conn(0x7facf41016b0 msgr2=0x7facf4102490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:47:00.461 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:00.001+0000 7facfad90700 1 -- 172.21.15.82:0/1305620983 shutdown_connections 2023-09-23T08:47:00.461 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:00.001+0000 7facfad90700 1 -- 172.21.15.82:0/1305620983 wait complete. 2023-09-23T08:47:01.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:00 smithi082 ceph-mon[97694]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:47:01.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:00 smithi082 ceph-mon[97694]: Generating ssh key... 2023-09-23T08:47:01.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:00 smithi082 ceph-mon[97694]: from='mgr.14120 172.21.15.82:0/2390432189' entity='mgr.x' 2023-09-23T08:47:01.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:00 smithi082 ceph-mon[97694]: from='mgr.14120 172.21.15.82:0/2390432189' entity='mgr.x' 2023-09-23T08:47:01.737 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCzzW6iK/yrcs3Y9Npy5EskbsTisoajkpBBUEg6fPrHw2RLLdNMEWFdptxCwYufRZreH3VuYzzI6fjUp0QextMPeihmCrHLLp9XboQZ3UxIHNpwyOzs4s4CGQw5PdLU1QgyXBqvxSIaf69/XR+WD3Ehq6hM1iqb+KJJ9PKULFyOnORzfQIfoZwoJuLblqTTr53JADLSTxAjvynFnqTLnCIjaZNmLyI4MI6rz1Gcq0pyCu9X2KXGdOV1GecAQgQimfECU8A951fl5XcMSPMNjnTZk5B4Bjfl3halItWUBj0rV06Ze2TOd1lByrpvrmwa9+YtXhvYogUPCh6cfK1KSYzPd55vmvpFiN9P77hWN7+G0hTr1yl0QD3SsoJ3gDdOECB4AsmOZy+flkDk7D6H1afPwUGi/G9G+EzZbNQt7ZYMsPEOY3sKmXFD4yDWLBRTvZxVxE34G/fnSe0Th+a1yS0b1E1F+0tWc/cR8ewzQilkryINgjPR9hbLLrKV9daWvt8= ceph-8926e286-59ed-11ee-8db4-212e2dc638e7 2023-09-23T08:47:01.737 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:00.989+0000 7fe299101700 1 Processor -- start 2023-09-23T08:47:01.737 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:00.989+0000 7fe299101700 1 -- start start 2023-09-23T08:47:01.737 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:00.989+0000 7fe299101700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe29407ad50 0x7fe2940791b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:47:01.737 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:00.989+0000 7fe299101700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe294079780 con 0x7fe29407ad50 2023-09-23T08:47:01.737 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:00.990+0000 7fe292d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe29407ad50 0x7fe2940791b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:47:01.737 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:00.990+0000 7fe292d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe29407ad50 0x7fe2940791b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54248/0 (socket says 172.21.15.82:54248) 2023-09-23T08:47:01.737 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:00.990+0000 7fe292d9d700 1 -- 172.21.15.82:0/3953252078 learned_addr learned my addr 172.21.15.82:0/3953252078 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:47:01.737 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:00.990+0000 7fe292d9d700 1 -- 172.21.15.82:0/3953252078 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2940798c0 con 0x7fe29407ad50 2023-09-23T08:47:01.738 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:00.990+0000 7fe292d9d700 1 --2- 172.21.15.82:0/3953252078 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe29407ad50 0x7fe2940791b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe2840098a0 tx=0x7fe284009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d37f0f25277db920 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:47:01.738 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:00.990+0000 7fe291d9b700 1 -- 172.21.15.82:0/3953252078 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe284004160 con 0x7fe29407ad50 2023-09-23T08:47:01.738 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:00.991+0000 7fe291d9b700 1 -- 172.21.15.82:0/3953252078 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fe2840042c0 con 0x7fe29407ad50 2023-09-23T08:47:01.738 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:00.991+0000 7fe291d9b700 1 -- 172.21.15.82:0/3953252078 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe284011940 con 0x7fe29407ad50 2023-09-23T08:47:01.738 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:00.991+0000 7fe299101700 1 -- 172.21.15.82:0/3953252078 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe29407ad50 msgr2=0x7fe2940791b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:47:01.738 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:00.991+0000 7fe299101700 1 --2- 172.21.15.82:0/3953252078 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe29407ad50 0x7fe2940791b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe2840098a0 tx=0x7fe284009bb0 comp rx=0 tx=0).stop 2023-09-23T08:47:01.738 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:00.991+0000 7fe299101700 1 -- 172.21.15.82:0/3953252078 shutdown_connections 2023-09-23T08:47:01.738 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:00.991+0000 7fe299101700 1 --2- 172.21.15.82:0/3953252078 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe29407ad50 0x7fe2940791b0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:47:01.738 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:00.991+0000 7fe299101700 1 -- 172.21.15.82:0/3953252078 >> 172.21.15.82:0/3953252078 conn(0x7fe2941016b0 msgr2=0x7fe294103ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:47:01.738 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:00.991+0000 7fe299101700 1 -- 172.21.15.82:0/3953252078 shutdown_connections 2023-09-23T08:47:01.738 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:00.991+0000 7fe299101700 1 -- 172.21.15.82:0/3953252078 wait complete. 2023-09-23T08:47:01.739 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:00.992+0000 7fe299101700 1 Processor -- start 2023-09-23T08:47:01.739 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:00.992+0000 7fe299101700 1 -- start start 2023-09-23T08:47:01.739 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:00.993+0000 7fe299101700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe29407ad50 0x7fe29419bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:47:01.739 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:00.993+0000 7fe299101700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe29419c410 con 0x7fe29407ad50 2023-09-23T08:47:01.739 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:00.993+0000 7fe292d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe29407ad50 0x7fe29419bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:47:01.739 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:00.993+0000 7fe292d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe29407ad50 0x7fe29419bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54260/0 (socket says 172.21.15.82:54260) 2023-09-23T08:47:01.739 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:00.993+0000 7fe292d9d700 1 -- 172.21.15.82:0/1677817803 learned_addr learned my addr 172.21.15.82:0/1677817803 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:47:01.739 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:00.993+0000 7fe292d9d700 1 -- 172.21.15.82:0/1677817803 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe284009550 con 0x7fe29407ad50 2023-09-23T08:47:01.739 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:00.993+0000 7fe292d9d700 1 --2- 172.21.15.82:0/1677817803 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe29407ad50 0x7fe29419bed0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe284000c00 tx=0x7fe284011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:47:01.739 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:00.994+0000 7fe27bfff700 1 -- 172.21.15.82:0/1677817803 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe2840036a0 con 0x7fe29407ad50 2023-09-23T08:47:01.739 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:00.994+0000 7fe299101700 1 -- 172.21.15.82:0/1677817803 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe29419c610 con 0x7fe29407ad50 2023-09-23T08:47:01.740 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:00.994+0000 7fe27bfff700 1 -- 172.21.15.82:0/1677817803 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fe28401b440 con 0x7fe29407ad50 2023-09-23T08:47:01.740 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:00.994+0000 7fe27bfff700 1 -- 172.21.15.82:0/1677817803 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe2840193f0 con 0x7fe29407ad50 2023-09-23T08:47:01.740 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:00.994+0000 7fe299101700 1 -- 172.21.15.82:0/1677817803 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe29419ca30 con 0x7fe29407ad50 2023-09-23T08:47:01.740 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:00.995+0000 7fe299101700 1 -- 172.21.15.82:0/1677817803 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe294061f50 con 0x7fe29407ad50 2023-09-23T08:47:01.740 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:00.995+0000 7fe27bfff700 1 -- 172.21.15.82:0/1677817803 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 8) v1 ==== 45135+0+0 (secure 0 0 0) 0x7fe28401b5b0 con 0x7fe29407ad50 2023-09-23T08:47:01.740 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:00.996+0000 7fe27bfff700 1 --2- 172.21.15.82:0/1677817803 >> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] conn(0x7fe27c038110 0x7fe27c03a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:47:01.740 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:00.996+0000 7fe27bfff700 1 -- 172.21.15.82:0/1677817803 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fe28404bf20 con 0x7fe29407ad50 2023-09-23T08:47:01.740 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:00.996+0000 7fe29259c700 1 --2- 172.21.15.82:0/1677817803 >> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] conn(0x7fe27c038110 0x7fe27c03a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:47:01.740 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:00.996+0000 7fe29259c700 1 --2- 172.21.15.82:0/1677817803 >> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] conn(0x7fe27c038110 0x7fe27c03a5d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe288006fd0 tx=0x7fe288006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:47:01.740 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:01.002+0000 7fe27bfff700 1 -- 172.21.15.82:0/1677817803 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7fe284022950 con 0x7fe29407ad50 2023-09-23T08:47:01.740 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:01.202+0000 7fe299101700 1 -- 172.21.15.82:0/1677817803 --> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7fe294103960 con 0x7fe27c038110 2023-09-23T08:47:01.740 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:01.203+0000 7fe27bfff700 1 -- 172.21.15.82:0/1677817803 <== mgr.14120 v2:172.21.15.82:6800/2733521564 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7fe294103960 con 0x7fe27c038110 2023-09-23T08:47:01.741 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:01.205+0000 7fe299101700 1 -- 172.21.15.82:0/1677817803 >> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] conn(0x7fe27c038110 msgr2=0x7fe27c03a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:47:01.741 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:01.205+0000 7fe299101700 1 --2- 172.21.15.82:0/1677817803 >> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] conn(0x7fe27c038110 0x7fe27c03a5d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe288006fd0 tx=0x7fe288006e40 comp rx=0 tx=0).stop 2023-09-23T08:47:01.741 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:01.205+0000 7fe299101700 1 -- 172.21.15.82:0/1677817803 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe29407ad50 msgr2=0x7fe29419bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:47:01.741 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:01.205+0000 7fe299101700 1 --2- 172.21.15.82:0/1677817803 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe29407ad50 0x7fe29419bed0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe284000c00 tx=0x7fe284011e70 comp rx=0 tx=0).stop 2023-09-23T08:47:01.741 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:01.206+0000 7fe299101700 1 -- 172.21.15.82:0/1677817803 shutdown_connections 2023-09-23T08:47:01.741 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:01.206+0000 7fe299101700 1 --2- 172.21.15.82:0/1677817803 >> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] conn(0x7fe27c038110 0x7fe27c03a5d0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:47:01.741 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:01.206+0000 7fe299101700 1 --2- 172.21.15.82:0/1677817803 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe29407ad50 0x7fe29419bed0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:47:01.741 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:01.206+0000 7fe299101700 1 -- 172.21.15.82:0/1677817803 >> 172.21.15.82:0/1677817803 conn(0x7fe2941016b0 msgr2=0x7fe294102d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:47:01.741 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:01.206+0000 7fe299101700 1 -- 172.21.15.82:0/1677817803 shutdown_connections 2023-09-23T08:47:01.741 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:01.206+0000 7fe299101700 1 -- 172.21.15.82:0/1677817803 wait complete. 2023-09-23T08:47:01.741 INFO:teuthology.orchestra.run.smithi082.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2023-09-23T08:47:01.741 INFO:teuthology.orchestra.run.smithi082.stdout:Adding key to root@localhost authorized_keys... 2023-09-23T08:47:01.742 INFO:teuthology.orchestra.run.smithi082.stdout:Adding host smithi082... 2023-09-23T08:47:02.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:01 smithi082 ceph-mon[97694]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:47:03.172 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:02 smithi082 ceph-mon[97694]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi082", "addr": "172.21.15.82", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:47:04.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:03 smithi082 ceph-mon[97694]: Deploying cephadm binary to smithi082 2023-09-23T08:47:06.024 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout Added host 'smithi082' with addr '172.21.15.82' 2023-09-23T08:47:06.024 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:02.275+0000 7f103d27a700 1 Processor -- start 2023-09-23T08:47:06.024 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:02.275+0000 7f103d27a700 1 -- start start 2023-09-23T08:47:06.024 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:02.276+0000 7f103d27a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f103807ad30 0x7f1038079190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:47:06.025 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:02.276+0000 7f103d27a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1038079760 con 0x7f103807ad30 2023-09-23T08:47:06.025 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:02.276+0000 7f1036ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f103807ad30 0x7f1038079190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:47:06.025 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:02.276+0000 7f1036ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f103807ad30 0x7f1038079190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57988/0 (socket says 172.21.15.82:57988) 2023-09-23T08:47:06.025 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:02.276+0000 7f1036ffd700 1 -- 172.21.15.82:0/160845199 learned_addr learned my addr 172.21.15.82:0/160845199 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:47:06.025 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:02.276+0000 7f1036ffd700 1 -- 172.21.15.82:0/160845199 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10380798a0 con 0x7f103807ad30 2023-09-23T08:47:06.025 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:02.277+0000 7f1036ffd700 1 --2- 172.21.15.82:0/160845199 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f103807ad30 0x7f1038079190 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f10280098a0 tx=0x7f1028009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=805dd5259f341c8e server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:47:06.025 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:02.277+0000 7f1035ffb700 1 -- 172.21.15.82:0/160845199 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1028004160 con 0x7f103807ad30 2023-09-23T08:47:06.025 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:02.277+0000 7f1035ffb700 1 -- 172.21.15.82:0/160845199 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f10280042c0 con 0x7f103807ad30 2023-09-23T08:47:06.025 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:02.277+0000 7f1035ffb700 1 -- 172.21.15.82:0/160845199 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1028011940 con 0x7f103807ad30 2023-09-23T08:47:06.025 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:02.277+0000 7f103d27a700 1 -- 172.21.15.82:0/160845199 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f103807ad30 msgr2=0x7f1038079190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:47:06.026 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:02.277+0000 7f103d27a700 1 --2- 172.21.15.82:0/160845199 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f103807ad30 0x7f1038079190 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f10280098a0 tx=0x7f1028009bb0 comp rx=0 tx=0).stop 2023-09-23T08:47:06.026 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:02.278+0000 7f103d27a700 1 -- 172.21.15.82:0/160845199 shutdown_connections 2023-09-23T08:47:06.026 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:02.278+0000 7f103d27a700 1 --2- 172.21.15.82:0/160845199 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f103807ad30 0x7f1038079190 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:47:06.026 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:02.278+0000 7f103d27a700 1 -- 172.21.15.82:0/160845199 >> 172.21.15.82:0/160845199 conn(0x7f10381016a0 msgr2=0x7f1038103ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:47:06.026 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:02.278+0000 7f103d27a700 1 -- 172.21.15.82:0/160845199 shutdown_connections 2023-09-23T08:47:06.026 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:02.278+0000 7f103d27a700 1 -- 172.21.15.82:0/160845199 wait complete. 2023-09-23T08:47:06.026 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:02.279+0000 7f103d27a700 1 Processor -- start 2023-09-23T08:47:06.026 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:02.279+0000 7f103d27a700 1 -- start start 2023-09-23T08:47:06.026 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:02.279+0000 7f103d27a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f103807ad30 0x7f103819bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:47:06.026 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:02.279+0000 7f103d27a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f103819c420 con 0x7f103807ad30 2023-09-23T08:47:06.026 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:02.279+0000 7f1036ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f103807ad30 0x7f103819bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:47:06.027 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:02.279+0000 7f1036ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f103807ad30 0x7f103819bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57992/0 (socket says 172.21.15.82:57992) 2023-09-23T08:47:06.027 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:02.279+0000 7f1036ffd700 1 -- 172.21.15.82:0/1413912720 learned_addr learned my addr 172.21.15.82:0/1413912720 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:47:06.027 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:02.280+0000 7f1036ffd700 1 -- 172.21.15.82:0/1413912720 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1028009550 con 0x7f103807ad30 2023-09-23T08:47:06.027 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:02.280+0000 7f1036ffd700 1 --2- 172.21.15.82:0/1413912720 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f103807ad30 0x7f103819bee0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1028000c00 tx=0x7f1028011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:47:06.027 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:02.280+0000 7f101ffff700 1 -- 172.21.15.82:0/1413912720 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f10280036a0 con 0x7f103807ad30 2023-09-23T08:47:06.027 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:02.280+0000 7f101ffff700 1 -- 172.21.15.82:0/1413912720 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f1028003c70 con 0x7f103807ad30 2023-09-23T08:47:06.027 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:02.280+0000 7f103d27a700 1 -- 172.21.15.82:0/1413912720 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f103819c620 con 0x7f103807ad30 2023-09-23T08:47:06.027 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:02.280+0000 7f101ffff700 1 -- 172.21.15.82:0/1413912720 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f10280193f0 con 0x7f103807ad30 2023-09-23T08:47:06.027 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:02.280+0000 7f103d27a700 1 -- 172.21.15.82:0/1413912720 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f103819ca40 con 0x7f103807ad30 2023-09-23T08:47:06.027 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:02.281+0000 7f101ffff700 1 -- 172.21.15.82:0/1413912720 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 8) v1 ==== 45135+0+0 (secure 0 0 0) 0x7f102801b440 con 0x7f103807ad30 2023-09-23T08:47:06.027 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:02.281+0000 7f103d27a700 1 -- 172.21.15.82:0/1413912720 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f103810c450 con 0x7f103807ad30 2023-09-23T08:47:06.028 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:02.282+0000 7f101ffff700 1 --2- 172.21.15.82:0/1413912720 >> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] conn(0x7f1020038160 0x7f102003a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:47:06.028 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:02.282+0000 7f101ffff700 1 -- 172.21.15.82:0/1413912720 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f102804be20 con 0x7f103807ad30 2023-09-23T08:47:06.028 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:02.282+0000 7f10367fc700 1 --2- 172.21.15.82:0/1413912720 >> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] conn(0x7f1020038160 0x7f102003a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:47:06.028 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:02.282+0000 7f10367fc700 1 --2- 172.21.15.82:0/1413912720 >> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] conn(0x7f1020038160 0x7f102003a620 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f102c006fd0 tx=0x7f102c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:47:06.028 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:02.286+0000 7f101ffff700 1 -- 172.21.15.82:0/1413912720 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f1028022950 con 0x7f103807ad30 2023-09-23T08:47:06.028 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:02.489+0000 7f103d27a700 1 -- 172.21.15.82:0/1413912720 --> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi082", "addr": "172.21.15.82", "target": ["mon-mgr", ""]}) v1 -- 0x7f103819f480 con 0x7f1020038160 2023-09-23T08:47:06.028 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:05.622+0000 7f101ffff700 1 -- 172.21.15.82:0/1413912720 <== mgr.14120 v2:172.21.15.82:6800/2733521564 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7f103819f480 con 0x7f1020038160 2023-09-23T08:47:06.028 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:05.625+0000 7f103d27a700 1 -- 172.21.15.82:0/1413912720 >> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] conn(0x7f1020038160 msgr2=0x7f102003a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:47:06.028 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:05.625+0000 7f103d27a700 1 --2- 172.21.15.82:0/1413912720 >> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] conn(0x7f1020038160 0x7f102003a620 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f102c006fd0 tx=0x7f102c006e40 comp rx=0 tx=0).stop 2023-09-23T08:47:06.028 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:05.625+0000 7f103d27a700 1 -- 172.21.15.82:0/1413912720 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f103807ad30 msgr2=0x7f103819bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:47:06.028 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:05.625+0000 7f103d27a700 1 --2- 172.21.15.82:0/1413912720 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f103807ad30 0x7f103819bee0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1028000c00 tx=0x7f1028011e70 comp rx=0 tx=0).stop 2023-09-23T08:47:06.029 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:05.625+0000 7f103d27a700 1 -- 172.21.15.82:0/1413912720 shutdown_connections 2023-09-23T08:47:06.029 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:05.625+0000 7f103d27a700 1 --2- 172.21.15.82:0/1413912720 >> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] conn(0x7f1020038160 0x7f102003a620 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:47:06.029 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:05.625+0000 7f103d27a700 1 --2- 172.21.15.82:0/1413912720 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f103807ad30 0x7f103819bee0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:47:06.029 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:05.625+0000 7f103d27a700 1 -- 172.21.15.82:0/1413912720 >> 172.21.15.82:0/1413912720 conn(0x7f10381016a0 msgr2=0x7f1038102430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:47:06.029 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:05.626+0000 7f103d27a700 1 -- 172.21.15.82:0/1413912720 shutdown_connections 2023-09-23T08:47:06.029 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:05.626+0000 7f103d27a700 1 -- 172.21.15.82:0/1413912720 wait complete. 2023-09-23T08:47:06.029 INFO:teuthology.orchestra.run.smithi082.stdout:Deploying unmanaged mon service... 2023-09-23T08:47:06.883 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:06 smithi082 ceph-mon[97694]: from='mgr.14120 172.21.15.82:0/2390432189' entity='mgr.x' 2023-09-23T08:47:06.884 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:06 smithi082 ceph-mon[97694]: Added host smithi082 2023-09-23T08:47:06.884 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:06 smithi082 ceph-mon[97694]: from='mgr.14120 172.21.15.82:0/2390432189' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:47:07.431 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2023-09-23T08:47:07.431 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:06.613+0000 7f19fcc80700 1 Processor -- start 2023-09-23T08:47:07.431 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:06.614+0000 7f19fcc80700 1 -- start start 2023-09-23T08:47:07.431 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:06.614+0000 7f19fcc80700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19f807ad50 0x7f19f80791b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:47:07.431 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:06.614+0000 7f19fcc80700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19f8079780 con 0x7f19f807ad50 2023-09-23T08:47:07.431 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:06.615+0000 7f19f659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19f807ad50 0x7f19f80791b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:47:07.431 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:06.615+0000 7f19f659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19f807ad50 0x7f19f80791b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58002/0 (socket says 172.21.15.82:58002) 2023-09-23T08:47:07.432 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:06.615+0000 7f19f659c700 1 -- 172.21.15.82:0/1406003874 learned_addr learned my addr 172.21.15.82:0/1406003874 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:47:07.432 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:06.615+0000 7f19f659c700 1 -- 172.21.15.82:0/1406003874 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19f80798c0 con 0x7f19f807ad50 2023-09-23T08:47:07.432 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:06.615+0000 7f19f659c700 1 --2- 172.21.15.82:0/1406003874 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19f807ad50 0x7f19f80791b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f19e80098a0 tx=0x7f19e8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af6cf690f7ae3a0c server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:47:07.432 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:06.615+0000 7f19f559a700 1 -- 172.21.15.82:0/1406003874 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f19e8004160 con 0x7f19f807ad50 2023-09-23T08:47:07.432 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:06.615+0000 7f19f559a700 1 -- 172.21.15.82:0/1406003874 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f19e80042c0 con 0x7f19f807ad50 2023-09-23T08:47:07.432 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:06.615+0000 7f19f559a700 1 -- 172.21.15.82:0/1406003874 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f19e8011940 con 0x7f19f807ad50 2023-09-23T08:47:07.432 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:06.616+0000 7f19fcc80700 1 -- 172.21.15.82:0/1406003874 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19f807ad50 msgr2=0x7f19f80791b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:47:07.432 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:06.616+0000 7f19fcc80700 1 --2- 172.21.15.82:0/1406003874 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19f807ad50 0x7f19f80791b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f19e80098a0 tx=0x7f19e8009bb0 comp rx=0 tx=0).stop 2023-09-23T08:47:07.432 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:06.616+0000 7f19fcc80700 1 -- 172.21.15.82:0/1406003874 shutdown_connections 2023-09-23T08:47:07.432 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:06.616+0000 7f19fcc80700 1 --2- 172.21.15.82:0/1406003874 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19f807ad50 0x7f19f80791b0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:47:07.433 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:06.616+0000 7f19fcc80700 1 -- 172.21.15.82:0/1406003874 >> 172.21.15.82:0/1406003874 conn(0x7f19f81016a0 msgr2=0x7f19f8103ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:47:07.433 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:06.616+0000 7f19fcc80700 1 -- 172.21.15.82:0/1406003874 shutdown_connections 2023-09-23T08:47:07.433 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:06.616+0000 7f19fcc80700 1 -- 172.21.15.82:0/1406003874 wait complete. 2023-09-23T08:47:07.433 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:06.617+0000 7f19fcc80700 1 Processor -- start 2023-09-23T08:47:07.433 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:06.617+0000 7f19fcc80700 1 -- start start 2023-09-23T08:47:07.433 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:06.618+0000 7f19fcc80700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19f807ad50 0x7f19f819be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:47:07.433 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:06.618+0000 7f19fcc80700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19f819c3c0 con 0x7f19f807ad50 2023-09-23T08:47:07.433 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:06.618+0000 7f19f659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19f807ad50 0x7f19f819be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:47:07.433 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:06.618+0000 7f19f659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19f807ad50 0x7f19f819be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58008/0 (socket says 172.21.15.82:58008) 2023-09-23T08:47:07.434 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:06.618+0000 7f19f659c700 1 -- 172.21.15.82:0/4197082712 learned_addr learned my addr 172.21.15.82:0/4197082712 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:47:07.434 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:06.618+0000 7f19f659c700 1 -- 172.21.15.82:0/4197082712 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19e8009550 con 0x7f19f807ad50 2023-09-23T08:47:07.434 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:06.618+0000 7f19f659c700 1 --2- 172.21.15.82:0/4197082712 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19f807ad50 0x7f19f819be80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f19e8000c00 tx=0x7f19e8011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:47:07.434 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:06.619+0000 7f19e77fe700 1 -- 172.21.15.82:0/4197082712 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f19e80036a0 con 0x7f19f807ad50 2023-09-23T08:47:07.434 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:06.619+0000 7f19e77fe700 1 -- 172.21.15.82:0/4197082712 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f19e8003c70 con 0x7f19f807ad50 2023-09-23T08:47:07.434 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:06.619+0000 7f19fcc80700 1 -- 172.21.15.82:0/4197082712 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19f819c5c0 con 0x7f19f807ad50 2023-09-23T08:47:07.434 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:06.619+0000 7f19e77fe700 1 -- 172.21.15.82:0/4197082712 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f19e80193f0 con 0x7f19f807ad50 2023-09-23T08:47:07.434 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:06.619+0000 7f19fcc80700 1 -- 172.21.15.82:0/4197082712 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19f819c9e0 con 0x7f19f807ad50 2023-09-23T08:47:07.434 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:06.620+0000 7f19e77fe700 1 -- 172.21.15.82:0/4197082712 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 8) v1 ==== 45135+0+0 (secure 0 0 0) 0x7f19e801b440 con 0x7f19f807ad50 2023-09-23T08:47:07.434 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:06.620+0000 7f19fcc80700 1 -- 172.21.15.82:0/4197082712 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19f810c430 con 0x7f19f807ad50 2023-09-23T08:47:07.435 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:06.620+0000 7f19e77fe700 1 --2- 172.21.15.82:0/4197082712 >> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] conn(0x7f19e0038110 0x7f19e003a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:47:07.435 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:06.620+0000 7f19e77fe700 1 -- 172.21.15.82:0/4197082712 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f19e804beb0 con 0x7f19f807ad50 2023-09-23T08:47:07.435 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:06.621+0000 7f19f5d9b700 1 --2- 172.21.15.82:0/4197082712 >> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] conn(0x7f19e0038110 0x7f19e003a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:47:07.435 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:06.621+0000 7f19f5d9b700 1 --2- 172.21.15.82:0/4197082712 >> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] conn(0x7f19e0038110 0x7f19e003a5d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f19ec006fd0 tx=0x7f19ec006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:47:07.435 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:06.626+0000 7f19e77fe700 1 -- 172.21.15.82:0/4197082712 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f19e8022950 con 0x7f19f807ad50 2023-09-23T08:47:07.435 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:06.844+0000 7f19fcc80700 1 -- 172.21.15.82:0/4197082712 --> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f19f819f420 con 0x7f19e0038110 2023-09-23T08:47:07.435 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:06.849+0000 7f19e77fe700 1 -- 172.21.15.82:0/4197082712 <== mgr.14120 v2:172.21.15.82:6800/2733521564 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f19f819f420 con 0x7f19e0038110 2023-09-23T08:47:07.435 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:06.852+0000 7f19fcc80700 1 -- 172.21.15.82:0/4197082712 >> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] conn(0x7f19e0038110 msgr2=0x7f19e003a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:47:07.435 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:06.852+0000 7f19fcc80700 1 --2- 172.21.15.82:0/4197082712 >> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] conn(0x7f19e0038110 0x7f19e003a5d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f19ec006fd0 tx=0x7f19ec006e40 comp rx=0 tx=0).stop 2023-09-23T08:47:07.435 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:06.852+0000 7f19fcc80700 1 -- 172.21.15.82:0/4197082712 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19f807ad50 msgr2=0x7f19f819be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:47:07.436 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:06.853+0000 7f19fcc80700 1 --2- 172.21.15.82:0/4197082712 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19f807ad50 0x7f19f819be80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f19e8000c00 tx=0x7f19e8011e70 comp rx=0 tx=0).stop 2023-09-23T08:47:07.436 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:06.853+0000 7f19fcc80700 1 -- 172.21.15.82:0/4197082712 shutdown_connections 2023-09-23T08:47:07.436 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:06.853+0000 7f19fcc80700 1 --2- 172.21.15.82:0/4197082712 >> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] conn(0x7f19e0038110 0x7f19e003a5d0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:47:07.436 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:06.853+0000 7f19fcc80700 1 --2- 172.21.15.82:0/4197082712 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19f807ad50 0x7f19f819be80 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:47:07.436 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:06.853+0000 7f19fcc80700 1 -- 172.21.15.82:0/4197082712 >> 172.21.15.82:0/4197082712 conn(0x7f19f81016a0 msgr2=0x7f19f8102400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:47:07.436 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:06.853+0000 7f19fcc80700 1 -- 172.21.15.82:0/4197082712 shutdown_connections 2023-09-23T08:47:07.436 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:06.853+0000 7f19fcc80700 1 -- 172.21.15.82:0/4197082712 wait complete. 2023-09-23T08:47:07.436 INFO:teuthology.orchestra.run.smithi082.stdout:Deploying unmanaged mgr service... 2023-09-23T08:47:08.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:07 smithi082 ceph-mon[97694]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:47:08.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:07 smithi082 ceph-mon[97694]: Saving service mon spec with placement count:5 2023-09-23T08:47:08.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:07 smithi082 ceph-mon[97694]: from='mgr.14120 172.21.15.82:0/2390432189' entity='mgr.x' 2023-09-23T08:47:09.163 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2023-09-23T08:47:09.163 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:08.366+0000 7fc236eec700 1 Processor -- start 2023-09-23T08:47:09.163 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:08.366+0000 7fc236eec700 1 -- start start 2023-09-23T08:47:09.164 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:08.366+0000 7fc236eec700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc23007ad30 0x7fc230079190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:47:09.164 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:08.366+0000 7fc236eec700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc230079760 con 0x7fc23007ad30 2023-09-23T08:47:09.164 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:08.367+0000 7fc234c88700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc23007ad30 0x7fc230079190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:47:09.164 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:08.367+0000 7fc234c88700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc23007ad30 0x7fc230079190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58018/0 (socket says 172.21.15.82:58018) 2023-09-23T08:47:09.164 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:08.367+0000 7fc234c88700 1 -- 172.21.15.82:0/766486422 learned_addr learned my addr 172.21.15.82:0/766486422 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:47:09.164 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:08.367+0000 7fc234c88700 1 -- 172.21.15.82:0/766486422 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2300798a0 con 0x7fc23007ad30 2023-09-23T08:47:09.164 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:08.367+0000 7fc234c88700 1 --2- 172.21.15.82:0/766486422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc23007ad30 0x7fc230079190 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc2240098a0 tx=0x7fc224009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b4a170c2d3827e3 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:47:09.164 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:08.367+0000 7fc22f7fe700 1 -- 172.21.15.82:0/766486422 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc224004160 con 0x7fc23007ad30 2023-09-23T08:47:09.164 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:08.368+0000 7fc22f7fe700 1 -- 172.21.15.82:0/766486422 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fc2240042c0 con 0x7fc23007ad30 2023-09-23T08:47:09.164 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:08.368+0000 7fc22f7fe700 1 -- 172.21.15.82:0/766486422 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc224011940 con 0x7fc23007ad30 2023-09-23T08:47:09.165 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:08.368+0000 7fc236eec700 1 -- 172.21.15.82:0/766486422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc23007ad30 msgr2=0x7fc230079190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:47:09.165 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:08.368+0000 7fc236eec700 1 --2- 172.21.15.82:0/766486422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc23007ad30 0x7fc230079190 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc2240098a0 tx=0x7fc224009bb0 comp rx=0 tx=0).stop 2023-09-23T08:47:09.165 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:08.368+0000 7fc236eec700 1 -- 172.21.15.82:0/766486422 shutdown_connections 2023-09-23T08:47:09.165 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:08.368+0000 7fc236eec700 1 --2- 172.21.15.82:0/766486422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc23007ad30 0x7fc230079190 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:47:09.165 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:08.368+0000 7fc236eec700 1 -- 172.21.15.82:0/766486422 >> 172.21.15.82:0/766486422 conn(0x7fc2301016a0 msgr2=0x7fc230103ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:47:09.165 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:08.368+0000 7fc236eec700 1 -- 172.21.15.82:0/766486422 shutdown_connections 2023-09-23T08:47:09.165 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:08.368+0000 7fc236eec700 1 -- 172.21.15.82:0/766486422 wait complete. 2023-09-23T08:47:09.165 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:08.369+0000 7fc236eec700 1 Processor -- start 2023-09-23T08:47:09.165 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:08.369+0000 7fc236eec700 1 -- start start 2023-09-23T08:47:09.165 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:08.370+0000 7fc236eec700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc23007ad30 0x7fc23019bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:47:09.166 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:08.370+0000 7fc236eec700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc23019c420 con 0x7fc23007ad30 2023-09-23T08:47:09.166 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:08.370+0000 7fc234c88700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc23007ad30 0x7fc23019bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:47:09.166 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:08.370+0000 7fc234c88700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc23007ad30 0x7fc23019bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58022/0 (socket says 172.21.15.82:58022) 2023-09-23T08:47:09.166 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:08.370+0000 7fc234c88700 1 -- 172.21.15.82:0/65625000 learned_addr learned my addr 172.21.15.82:0/65625000 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:47:09.166 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:08.370+0000 7fc234c88700 1 -- 172.21.15.82:0/65625000 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc224009550 con 0x7fc23007ad30 2023-09-23T08:47:09.166 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:08.371+0000 7fc234c88700 1 --2- 172.21.15.82:0/65625000 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc23007ad30 0x7fc23019bee0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc224000c00 tx=0x7fc224011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:47:09.166 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:08.371+0000 7fc22dffb700 1 -- 172.21.15.82:0/65625000 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc2240036a0 con 0x7fc23007ad30 2023-09-23T08:47:09.166 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:08.371+0000 7fc236eec700 1 -- 172.21.15.82:0/65625000 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc23019c620 con 0x7fc23007ad30 2023-09-23T08:47:09.166 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:08.371+0000 7fc22dffb700 1 -- 172.21.15.82:0/65625000 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fc224003c70 con 0x7fc23007ad30 2023-09-23T08:47:09.166 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:08.371+0000 7fc22dffb700 1 -- 172.21.15.82:0/65625000 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc2240193f0 con 0x7fc23007ad30 2023-09-23T08:47:09.167 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:08.371+0000 7fc236eec700 1 -- 172.21.15.82:0/65625000 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc23019ca40 con 0x7fc23007ad30 2023-09-23T08:47:09.167 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:08.372+0000 7fc22dffb700 1 -- 172.21.15.82:0/65625000 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 8) v1 ==== 45135+0+0 (secure 0 0 0) 0x7fc224003800 con 0x7fc23007ad30 2023-09-23T08:47:09.167 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:08.372+0000 7fc236eec700 1 -- 172.21.15.82:0/65625000 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc230061f50 con 0x7fc23007ad30 2023-09-23T08:47:09.167 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:08.372+0000 7fc22dffb700 1 --2- 172.21.15.82:0/65625000 >> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] conn(0x7fc220038160 0x7fc22003a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:47:09.167 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:08.372+0000 7fc22dffb700 1 -- 172.21.15.82:0/65625000 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fc22404be40 con 0x7fc23007ad30 2023-09-23T08:47:09.167 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:08.373+0000 7fc22ffff700 1 --2- 172.21.15.82:0/65625000 >> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] conn(0x7fc220038160 0x7fc22003a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:47:09.167 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:08.373+0000 7fc22ffff700 1 --2- 172.21.15.82:0/65625000 >> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] conn(0x7fc220038160 0x7fc22003a620 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc21c006fd0 tx=0x7fc21c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:47:09.167 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:08.377+0000 7fc22dffb700 1 -- 172.21.15.82:0/65625000 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7fc22401b440 con 0x7fc23007ad30 2023-09-23T08:47:09.167 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:08.431+0000 7fc22dffb700 1 -- 172.21.15.82:0/65625000 <== mon.0 v2:172.21.15.82:3300/0 7 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc22401b440 con 0x7fc23007ad30 2023-09-23T08:47:09.167 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:08.619+0000 7fc236eec700 1 -- 172.21.15.82:0/65625000 --> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fc230102b40 con 0x7fc220038160 2023-09-23T08:47:09.167 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:08.626+0000 7fc22dffb700 1 -- 172.21.15.82:0/65625000 <== mgr.14120 v2:172.21.15.82:6800/2733521564 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fc230102b40 con 0x7fc220038160 2023-09-23T08:47:09.168 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:08.629+0000 7fc236eec700 1 -- 172.21.15.82:0/65625000 >> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] conn(0x7fc220038160 msgr2=0x7fc22003a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:47:09.168 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:08.629+0000 7fc236eec700 1 --2- 172.21.15.82:0/65625000 >> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] conn(0x7fc220038160 0x7fc22003a620 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc21c006fd0 tx=0x7fc21c006e40 comp rx=0 tx=0).stop 2023-09-23T08:47:09.168 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:08.629+0000 7fc236eec700 1 -- 172.21.15.82:0/65625000 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc23007ad30 msgr2=0x7fc23019bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:47:09.168 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:08.629+0000 7fc236eec700 1 --2- 172.21.15.82:0/65625000 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc23007ad30 0x7fc23019bee0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc224000c00 tx=0x7fc224011e70 comp rx=0 tx=0).stop 2023-09-23T08:47:09.168 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:08.629+0000 7fc236eec700 1 -- 172.21.15.82:0/65625000 shutdown_connections 2023-09-23T08:47:09.168 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:08.629+0000 7fc236eec700 1 --2- 172.21.15.82:0/65625000 >> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] conn(0x7fc220038160 0x7fc22003a620 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:47:09.168 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:08.629+0000 7fc236eec700 1 --2- 172.21.15.82:0/65625000 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc23007ad30 0x7fc23019bee0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:47:09.168 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:08.629+0000 7fc236eec700 1 -- 172.21.15.82:0/65625000 >> 172.21.15.82:0/65625000 conn(0x7fc2301016a0 msgr2=0x7fc230102430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:47:09.168 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:08.629+0000 7fc236eec700 1 -- 172.21.15.82:0/65625000 shutdown_connections 2023-09-23T08:47:09.168 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:08.629+0000 7fc236eec700 1 -- 172.21.15.82:0/65625000 wait complete. 2023-09-23T08:47:09.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:09 smithi082 ceph-mon[97694]: from='mgr.14120 172.21.15.82:0/2390432189' entity='mgr.x' 2023-09-23T08:47:09.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:09 smithi082 ceph-mon[97694]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:47:09.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:09 smithi082 ceph-mon[97694]: Saving service mgr spec with placement count:2 2023-09-23T08:47:09.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:09 smithi082 ceph-mon[97694]: from='mgr.14120 172.21.15.82:0/2390432189' entity='mgr.x' 2023-09-23T08:47:09.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:09 smithi082 ceph-mon[97694]: from='mgr.14120 172.21.15.82:0/2390432189' entity='mgr.x' 2023-09-23T08:47:10.456 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:09.750+0000 7fcc95764700 1 Processor -- start 2023-09-23T08:47:10.456 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:09.750+0000 7fcc95764700 1 -- start start 2023-09-23T08:47:10.456 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:09.750+0000 7fcc95764700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc901060d0 0x7fcc901064f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:47:10.456 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:09.750+0000 7fcc95764700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc90106ac0 con 0x7fcc901060d0 2023-09-23T08:47:10.456 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:09.750+0000 7fcc8effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc901060d0 0x7fcc901064f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:47:10.456 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:09.750+0000 7fcc8effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc901060d0 0x7fcc901064f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58038/0 (socket says 172.21.15.82:58038) 2023-09-23T08:47:10.456 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:09.750+0000 7fcc8effd700 1 -- 172.21.15.82:0/3425859862 learned_addr learned my addr 172.21.15.82:0/3425859862 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:47:10.456 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:09.751+0000 7fcc8effd700 1 -- 172.21.15.82:0/3425859862 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc901072d0 con 0x7fcc901060d0 2023-09-23T08:47:10.457 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:09.751+0000 7fcc8effd700 1 --2- 172.21.15.82:0/3425859862 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc901060d0 0x7fcc901064f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fcc800098a0 tx=0x7fcc80009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1b1e36144ca16ae server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:47:10.457 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:09.751+0000 7fcc8dffb700 1 -- 172.21.15.82:0/3425859862 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcc80004160 con 0x7fcc901060d0 2023-09-23T08:47:10.457 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:09.751+0000 7fcc8dffb700 1 -- 172.21.15.82:0/3425859862 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcc800042c0 con 0x7fcc901060d0 2023-09-23T08:47:10.457 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:09.751+0000 7fcc8dffb700 1 -- 172.21.15.82:0/3425859862 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcc800118e0 con 0x7fcc901060d0 2023-09-23T08:47:10.457 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:09.752+0000 7fcc95764700 1 -- 172.21.15.82:0/3425859862 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc901060d0 msgr2=0x7fcc901064f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:47:10.457 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:09.752+0000 7fcc95764700 1 --2- 172.21.15.82:0/3425859862 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc901060d0 0x7fcc901064f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fcc800098a0 tx=0x7fcc80009bb0 comp rx=0 tx=0).stop 2023-09-23T08:47:10.457 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:09.752+0000 7fcc95764700 1 -- 172.21.15.82:0/3425859862 shutdown_connections 2023-09-23T08:47:10.457 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:09.752+0000 7fcc95764700 1 --2- 172.21.15.82:0/3425859862 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc901060d0 0x7fcc901064f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:47:10.457 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:09.752+0000 7fcc95764700 1 -- 172.21.15.82:0/3425859862 >> 172.21.15.82:0/3425859862 conn(0x7fcc901016b0 msgr2=0x7fcc90103ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:47:10.457 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:09.752+0000 7fcc95764700 1 -- 172.21.15.82:0/3425859862 shutdown_connections 2023-09-23T08:47:10.457 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:09.752+0000 7fcc95764700 1 -- 172.21.15.82:0/3425859862 wait complete. 2023-09-23T08:47:10.458 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:09.753+0000 7fcc95764700 1 Processor -- start 2023-09-23T08:47:10.458 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:09.753+0000 7fcc95764700 1 -- start start 2023-09-23T08:47:10.458 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:09.753+0000 7fcc95764700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc901060d0 0x7fcc9019bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:47:10.458 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:09.753+0000 7fcc95764700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc9019c4f0 con 0x7fcc901060d0 2023-09-23T08:47:10.458 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:09.754+0000 7fcc8effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc901060d0 0x7fcc9019bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:47:10.458 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:09.754+0000 7fcc8effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc901060d0 0x7fcc9019bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58054/0 (socket says 172.21.15.82:58054) 2023-09-23T08:47:10.458 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:09.754+0000 7fcc8effd700 1 -- 172.21.15.82:0/1094966546 learned_addr learned my addr 172.21.15.82:0/1094966546 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:47:10.458 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:09.754+0000 7fcc8effd700 1 -- 172.21.15.82:0/1094966546 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc80009550 con 0x7fcc901060d0 2023-09-23T08:47:10.458 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:09.754+0000 7fcc8effd700 1 --2- 172.21.15.82:0/1094966546 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc901060d0 0x7fcc9019bfb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fcc80000c00 tx=0x7fcc800119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:47:10.458 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:09.754+0000 7fcc77fff700 1 -- 172.21.15.82:0/1094966546 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcc800036a0 con 0x7fcc901060d0 2023-09-23T08:47:10.458 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:09.755+0000 7fcc77fff700 1 -- 172.21.15.82:0/1094966546 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcc8001b440 con 0x7fcc901060d0 2023-09-23T08:47:10.458 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:09.755+0000 7fcc95764700 1 -- 172.21.15.82:0/1094966546 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc9019c6f0 con 0x7fcc901060d0 2023-09-23T08:47:10.459 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:09.755+0000 7fcc77fff700 1 -- 172.21.15.82:0/1094966546 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcc8001a3d0 con 0x7fcc901060d0 2023-09-23T08:47:10.459 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:09.755+0000 7fcc95764700 1 -- 172.21.15.82:0/1094966546 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc9019cb10 con 0x7fcc901060d0 2023-09-23T08:47:10.459 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:09.756+0000 7fcc77fff700 1 -- 172.21.15.82:0/1094966546 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 8) v1 ==== 45135+0+0 (secure 0 0 0) 0x7fcc80003800 con 0x7fcc901060d0 2023-09-23T08:47:10.459 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:09.756+0000 7fcc95764700 1 -- 172.21.15.82:0/1094966546 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc90061f50 con 0x7fcc901060d0 2023-09-23T08:47:10.459 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:09.756+0000 7fcc77fff700 1 --2- 172.21.15.82:0/1094966546 >> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] conn(0x7fcc78038160 0x7fcc7803a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:47:10.459 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:09.756+0000 7fcc77fff700 1 -- 172.21.15.82:0/1094966546 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fcc8004be30 con 0x7fcc901060d0 2023-09-23T08:47:10.459 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:09.757+0000 7fcc8e7fc700 1 --2- 172.21.15.82:0/1094966546 >> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] conn(0x7fcc78038160 0x7fcc7803a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:47:10.459 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:09.757+0000 7fcc8e7fc700 1 --2- 172.21.15.82:0/1094966546 >> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] conn(0x7fcc78038160 0x7fcc7803a620 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fcc84006fd0 tx=0x7fcc84006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:47:10.459 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:09.761+0000 7fcc77fff700 1 -- 172.21.15.82:0/1094966546 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7fcc80050070 con 0x7fcc901060d0 2023-09-23T08:47:10.459 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:09.967+0000 7fcc95764700 1 -- 172.21.15.82:0/1094966546 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7fcc9019f760 con 0x7fcc901060d0 2023-09-23T08:47:10.459 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:09.970+0000 7fcc77fff700 1 -- 172.21.15.82:0/1094966546 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7fcc8001f070 con 0x7fcc901060d0 2023-09-23T08:47:10.460 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:09.973+0000 7fcc95764700 1 -- 172.21.15.82:0/1094966546 >> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] conn(0x7fcc78038160 msgr2=0x7fcc7803a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:47:10.460 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:09.973+0000 7fcc95764700 1 --2- 172.21.15.82:0/1094966546 >> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] conn(0x7fcc78038160 0x7fcc7803a620 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fcc84006fd0 tx=0x7fcc84006e40 comp rx=0 tx=0).stop 2023-09-23T08:47:10.460 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:09.973+0000 7fcc95764700 1 -- 172.21.15.82:0/1094966546 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc901060d0 msgr2=0x7fcc9019bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:47:10.460 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:09.973+0000 7fcc95764700 1 --2- 172.21.15.82:0/1094966546 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc901060d0 0x7fcc9019bfb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fcc80000c00 tx=0x7fcc800119a0 comp rx=0 tx=0).stop 2023-09-23T08:47:10.460 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:09.973+0000 7fcc95764700 1 -- 172.21.15.82:0/1094966546 shutdown_connections 2023-09-23T08:47:10.460 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:09.973+0000 7fcc95764700 1 --2- 172.21.15.82:0/1094966546 >> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] conn(0x7fcc78038160 0x7fcc7803a620 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:47:10.460 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:09.973+0000 7fcc95764700 1 --2- 172.21.15.82:0/1094966546 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc901060d0 0x7fcc9019bfb0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:47:10.460 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:09.973+0000 7fcc95764700 1 -- 172.21.15.82:0/1094966546 >> 172.21.15.82:0/1094966546 conn(0x7fcc901016b0 msgr2=0x7fcc90102d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:47:10.460 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:09.974+0000 7fcc95764700 1 -- 172.21.15.82:0/1094966546 shutdown_connections 2023-09-23T08:47:10.460 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:09.974+0000 7fcc95764700 1 -- 172.21.15.82:0/1094966546 wait complete. 2023-09-23T08:47:11.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:10 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/1094966546' entity='client.admin' 2023-09-23T08:47:11.838 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:11.164+0000 7f1a7ad26700 1 Processor -- start 2023-09-23T08:47:11.838 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:11.165+0000 7f1a7ad26700 1 -- start start 2023-09-23T08:47:11.838 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:11.165+0000 7f1a7ad26700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a7407ad30 0x7f1a74079190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:47:11.838 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:11.165+0000 7f1a7ad26700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a74079760 con 0x7f1a7407ad30 2023-09-23T08:47:11.838 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:11.165+0000 7f1a78ac2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a7407ad30 0x7f1a74079190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:47:11.838 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:11.165+0000 7f1a78ac2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a7407ad30 0x7f1a74079190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58056/0 (socket says 172.21.15.82:58056) 2023-09-23T08:47:11.838 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:11.165+0000 7f1a78ac2700 1 -- 172.21.15.82:0/255939922 learned_addr learned my addr 172.21.15.82:0/255939922 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:47:11.838 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:11.166+0000 7f1a78ac2700 1 -- 172.21.15.82:0/255939922 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a740798a0 con 0x7f1a7407ad30 2023-09-23T08:47:11.839 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:11.166+0000 7f1a78ac2700 1 --2- 172.21.15.82:0/255939922 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a7407ad30 0x7f1a74079190 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1a680098a0 tx=0x7f1a68009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff367d42a7dd14b server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:47:11.839 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:11.166+0000 7f1a737fe700 1 -- 172.21.15.82:0/255939922 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1a68004160 con 0x7f1a7407ad30 2023-09-23T08:47:11.839 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:11.166+0000 7f1a737fe700 1 -- 172.21.15.82:0/255939922 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1a680042c0 con 0x7f1a7407ad30 2023-09-23T08:47:11.839 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:11.166+0000 7f1a737fe700 1 -- 172.21.15.82:0/255939922 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1a680118e0 con 0x7f1a7407ad30 2023-09-23T08:47:11.839 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:11.167+0000 7f1a7ad26700 1 -- 172.21.15.82:0/255939922 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a7407ad30 msgr2=0x7f1a74079190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:47:11.839 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:11.167+0000 7f1a7ad26700 1 --2- 172.21.15.82:0/255939922 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a7407ad30 0x7f1a74079190 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1a680098a0 tx=0x7f1a68009bb0 comp rx=0 tx=0).stop 2023-09-23T08:47:11.839 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:11.167+0000 7f1a7ad26700 1 -- 172.21.15.82:0/255939922 shutdown_connections 2023-09-23T08:47:11.839 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:11.167+0000 7f1a7ad26700 1 --2- 172.21.15.82:0/255939922 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a7407ad30 0x7f1a74079190 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:47:11.839 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:11.167+0000 7f1a7ad26700 1 -- 172.21.15.82:0/255939922 >> 172.21.15.82:0/255939922 conn(0x7f1a741016a0 msgr2=0x7f1a74103ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:47:11.839 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:11.167+0000 7f1a7ad26700 1 -- 172.21.15.82:0/255939922 shutdown_connections 2023-09-23T08:47:11.839 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:11.167+0000 7f1a7ad26700 1 -- 172.21.15.82:0/255939922 wait complete. 2023-09-23T08:47:11.840 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:11.168+0000 7f1a7ad26700 1 Processor -- start 2023-09-23T08:47:11.840 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:11.168+0000 7f1a7ad26700 1 -- start start 2023-09-23T08:47:11.840 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:11.169+0000 7f1a7ad26700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a7407ad30 0x7f1a7419bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:47:11.840 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:11.169+0000 7f1a7ad26700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a7419c4e0 con 0x7f1a7407ad30 2023-09-23T08:47:11.840 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:11.169+0000 7f1a78ac2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a7407ad30 0x7f1a7419bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:47:11.840 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:11.169+0000 7f1a78ac2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a7407ad30 0x7f1a7419bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58070/0 (socket says 172.21.15.82:58070) 2023-09-23T08:47:11.840 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:11.169+0000 7f1a78ac2700 1 -- 172.21.15.82:0/960687690 learned_addr learned my addr 172.21.15.82:0/960687690 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:47:11.840 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:11.169+0000 7f1a78ac2700 1 -- 172.21.15.82:0/960687690 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a68009550 con 0x7f1a7407ad30 2023-09-23T08:47:11.840 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:11.170+0000 7f1a78ac2700 1 --2- 172.21.15.82:0/960687690 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a7407ad30 0x7f1a7419bfa0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1a68003e30 tx=0x7f1a680119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:47:11.840 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:11.170+0000 7f1a71ffb700 1 -- 172.21.15.82:0/960687690 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1a680036a0 con 0x7f1a7407ad30 2023-09-23T08:47:11.840 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:11.170+0000 7f1a71ffb700 1 -- 172.21.15.82:0/960687690 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1a6801b440 con 0x7f1a7407ad30 2023-09-23T08:47:11.840 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:11.170+0000 7f1a7ad26700 1 -- 172.21.15.82:0/960687690 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a7419c6e0 con 0x7f1a7407ad30 2023-09-23T08:47:11.841 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:11.170+0000 7f1a71ffb700 1 -- 172.21.15.82:0/960687690 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1a68023400 con 0x7f1a7407ad30 2023-09-23T08:47:11.841 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:11.170+0000 7f1a7ad26700 1 -- 172.21.15.82:0/960687690 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a7419cb00 con 0x7f1a7407ad30 2023-09-23T08:47:11.841 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:11.171+0000 7f1a71ffb700 1 -- 172.21.15.82:0/960687690 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 8) v1 ==== 45135+0+0 (secure 0 0 0) 0x7f1a6801b5b0 con 0x7f1a7407ad30 2023-09-23T08:47:11.841 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:11.171+0000 7f1a7ad26700 1 -- 172.21.15.82:0/960687690 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a74061f50 con 0x7f1a7407ad30 2023-09-23T08:47:11.841 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:11.172+0000 7f1a71ffb700 1 --2- 172.21.15.82:0/960687690 >> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] conn(0x7f1a64038110 0x7f1a6403a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:47:11.841 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:11.172+0000 7f1a71ffb700 1 -- 172.21.15.82:0/960687690 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f1a6804beb0 con 0x7f1a7407ad30 2023-09-23T08:47:11.841 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:11.172+0000 7f1a73fff700 1 --2- 172.21.15.82:0/960687690 >> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] conn(0x7f1a64038110 0x7f1a6403a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:47:11.841 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:11.172+0000 7f1a73fff700 1 --2- 172.21.15.82:0/960687690 >> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] conn(0x7f1a64038110 0x7f1a6403a5d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1a60006fd0 tx=0x7f1a60006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:47:11.841 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:11.177+0000 7f1a71ffb700 1 -- 172.21.15.82:0/960687690 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f1a6800bc10 con 0x7f1a7407ad30 2023-09-23T08:47:11.841 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:11.382+0000 7f1a7ad26700 1 -- 172.21.15.82:0/960687690 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f1a7419f540 con 0x7f1a7407ad30 2023-09-23T08:47:11.841 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:11.389+0000 7f1a71ffb700 1 -- 172.21.15.82:0/960687690 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7f1a6800b3e0 con 0x7f1a7407ad30 2023-09-23T08:47:11.842 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:11.392+0000 7f1a7ad26700 1 -- 172.21.15.82:0/960687690 >> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] conn(0x7f1a64038110 msgr2=0x7f1a6403a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:47:11.842 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:11.392+0000 7f1a7ad26700 1 --2- 172.21.15.82:0/960687690 >> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] conn(0x7f1a64038110 0x7f1a6403a5d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1a60006fd0 tx=0x7f1a60006e40 comp rx=0 tx=0).stop 2023-09-23T08:47:11.842 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:11.392+0000 7f1a7ad26700 1 -- 172.21.15.82:0/960687690 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a7407ad30 msgr2=0x7f1a7419bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:47:11.842 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:11.392+0000 7f1a7ad26700 1 --2- 172.21.15.82:0/960687690 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a7407ad30 0x7f1a7419bfa0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1a68003e30 tx=0x7f1a680119a0 comp rx=0 tx=0).stop 2023-09-23T08:47:11.842 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:11.392+0000 7f1a7ad26700 1 -- 172.21.15.82:0/960687690 shutdown_connections 2023-09-23T08:47:11.842 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:11.392+0000 7f1a7ad26700 1 --2- 172.21.15.82:0/960687690 >> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] conn(0x7f1a64038110 0x7f1a6403a5d0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:47:11.842 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:11.392+0000 7f1a7ad26700 1 --2- 172.21.15.82:0/960687690 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a7407ad30 0x7f1a7419bfa0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:47:11.842 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:11.392+0000 7f1a7ad26700 1 -- 172.21.15.82:0/960687690 >> 172.21.15.82:0/960687690 conn(0x7f1a741016a0 msgr2=0x7f1a74102d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:47:11.842 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:11.392+0000 7f1a7ad26700 1 -- 172.21.15.82:0/960687690 shutdown_connections 2023-09-23T08:47:11.842 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:11.392+0000 7f1a7ad26700 1 -- 172.21.15.82:0/960687690 wait complete. 2023-09-23T08:47:11.842 INFO:teuthology.orchestra.run.smithi082.stdout:Enabling the dashboard module... 2023-09-23T08:47:12.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:12 smithi082 ceph-mon[97694]: from='mgr.14120 172.21.15.82:0/2390432189' entity='mgr.x' 2023-09-23T08:47:12.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:12 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/960687690' entity='client.admin' 2023-09-23T08:47:13.589 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:13 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/2750733931' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2023-09-23T08:47:13.590 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:13 smithi082 ceph-mon[97694]: from='mgr.14120 172.21.15.82:0/2390432189' entity='mgr.x' 2023-09-23T08:47:13.590 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:47:13 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: ignoring --setuser ceph since I am not root 2023-09-23T08:47:13.590 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:47:13 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: ignoring --setgroup ceph since I am not root 2023-09-23T08:47:13.818 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:12.398+0000 7fdfaa437700 1 Processor -- start 2023-09-23T08:47:13.819 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:12.398+0000 7fdfaa437700 1 -- start start 2023-09-23T08:47:13.819 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:12.398+0000 7fdfaa437700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfa41060e0 0x7fdfa4106500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:47:13.819 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:12.399+0000 7fdfaa437700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa4106ad0 con 0x7fdfa41060e0 2023-09-23T08:47:13.819 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:12.399+0000 7fdfa3fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfa41060e0 0x7fdfa4106500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:47:13.819 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:12.399+0000 7fdfa3fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfa41060e0 0x7fdfa4106500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57472/0 (socket says 172.21.15.82:57472) 2023-09-23T08:47:13.819 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:12.399+0000 7fdfa3fff700 1 -- 172.21.15.82:0/2262487359 learned_addr learned my addr 172.21.15.82:0/2262487359 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:47:13.819 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:12.400+0000 7fdfa3fff700 1 -- 172.21.15.82:0/2262487359 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfa41072e0 con 0x7fdfa41060e0 2023-09-23T08:47:13.819 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:12.400+0000 7fdfa3fff700 1 --2- 172.21.15.82:0/2262487359 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfa41060e0 0x7fdfa4106500 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fdf940098a0 tx=0x7fdf94009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d5009f88e3ec3b4 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:47:13.819 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:12.400+0000 7fdfa2ffd700 1 -- 172.21.15.82:0/2262487359 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdf94004160 con 0x7fdfa41060e0 2023-09-23T08:47:13.819 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:12.400+0000 7fdfa2ffd700 1 -- 172.21.15.82:0/2262487359 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdf940042c0 con 0x7fdfa41060e0 2023-09-23T08:47:13.823 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:12.400+0000 7fdfa2ffd700 1 -- 172.21.15.82:0/2262487359 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdf940118e0 con 0x7fdfa41060e0 2023-09-23T08:47:13.823 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:12.401+0000 7fdfaa437700 1 -- 172.21.15.82:0/2262487359 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfa41060e0 msgr2=0x7fdfa4106500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:47:13.823 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:12.401+0000 7fdfaa437700 1 --2- 172.21.15.82:0/2262487359 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfa41060e0 0x7fdfa4106500 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fdf940098a0 tx=0x7fdf94009bb0 comp rx=0 tx=0).stop 2023-09-23T08:47:13.823 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:12.401+0000 7fdfaa437700 1 -- 172.21.15.82:0/2262487359 shutdown_connections 2023-09-23T08:47:13.823 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:12.401+0000 7fdfaa437700 1 --2- 172.21.15.82:0/2262487359 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfa41060e0 0x7fdfa4106500 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:47:13.823 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:12.401+0000 7fdfaa437700 1 -- 172.21.15.82:0/2262487359 >> 172.21.15.82:0/2262487359 conn(0x7fdfa41016a0 msgr2=0x7fdfa4103ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:47:13.823 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:12.401+0000 7fdfaa437700 1 -- 172.21.15.82:0/2262487359 shutdown_connections 2023-09-23T08:47:13.823 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:12.401+0000 7fdfaa437700 1 -- 172.21.15.82:0/2262487359 wait complete. 2023-09-23T08:47:13.823 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:12.402+0000 7fdfaa437700 1 Processor -- start 2023-09-23T08:47:13.823 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:12.403+0000 7fdfaa437700 1 -- start start 2023-09-23T08:47:13.825 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:12.403+0000 7fdfaa437700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfa41060e0 0x7fdfa4199dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:47:13.825 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:12.403+0000 7fdfaa437700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa419a300 con 0x7fdfa41060e0 2023-09-23T08:47:13.825 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:12.403+0000 7fdfa3fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfa41060e0 0x7fdfa4199dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:47:13.825 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:12.403+0000 7fdfa3fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfa41060e0 0x7fdfa4199dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57488/0 (socket says 172.21.15.82:57488) 2023-09-23T08:47:13.825 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:12.403+0000 7fdfa3fff700 1 -- 172.21.15.82:0/2750733931 learned_addr learned my addr 172.21.15.82:0/2750733931 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:47:13.825 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:12.404+0000 7fdfa3fff700 1 -- 172.21.15.82:0/2750733931 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf94009550 con 0x7fdfa41060e0 2023-09-23T08:47:13.826 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:12.404+0000 7fdfa3fff700 1 --2- 172.21.15.82:0/2750733931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfa41060e0 0x7fdfa4199dc0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fdf94003e30 tx=0x7fdf940119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:47:13.826 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:12.404+0000 7fdfa17fa700 1 -- 172.21.15.82:0/2750733931 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdf940036a0 con 0x7fdfa41060e0 2023-09-23T08:47:13.826 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:12.404+0000 7fdfaa437700 1 -- 172.21.15.82:0/2750733931 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfa419a500 con 0x7fdfa41060e0 2023-09-23T08:47:13.826 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:12.404+0000 7fdfa17fa700 1 -- 172.21.15.82:0/2750733931 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdf9401b440 con 0x7fdfa41060e0 2023-09-23T08:47:13.826 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:12.404+0000 7fdfa17fa700 1 -- 172.21.15.82:0/2750733931 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdf94023400 con 0x7fdfa41060e0 2023-09-23T08:47:13.826 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:12.404+0000 7fdfaa437700 1 -- 172.21.15.82:0/2750733931 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfa419a920 con 0x7fdfa41060e0 2023-09-23T08:47:13.826 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:12.406+0000 7fdfa17fa700 1 -- 172.21.15.82:0/2750733931 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 8) v1 ==== 45135+0+0 (secure 0 0 0) 0x7fdf94003800 con 0x7fdfa41060e0 2023-09-23T08:47:13.826 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:12.406+0000 7fdfaa437700 1 -- 172.21.15.82:0/2750733931 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfa4061f50 con 0x7fdfa41060e0 2023-09-23T08:47:13.827 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:12.406+0000 7fdfa17fa700 1 --2- 172.21.15.82:0/2750733931 >> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] conn(0x7fdf8c038110 0x7fdf8c03a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:47:13.827 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:12.406+0000 7fdfa17fa700 1 -- 172.21.15.82:0/2750733931 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fdf9404bf70 con 0x7fdfa41060e0 2023-09-23T08:47:13.827 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:12.406+0000 7fdfa37fe700 1 --2- 172.21.15.82:0/2750733931 >> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] conn(0x7fdf8c038110 0x7fdf8c03a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:47:13.827 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:12.407+0000 7fdfa37fe700 1 --2- 172.21.15.82:0/2750733931 >> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] conn(0x7fdf8c038110 0x7fdf8c03a5d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fdf98006fd0 tx=0x7fdf98006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:47:13.827 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:12.411+0000 7fdfa17fa700 1 -- 172.21.15.82:0/2750733931 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7fdf9402b740 con 0x7fdfa41060e0 2023-09-23T08:47:13.827 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:12.687+0000 7fdfaa437700 1 -- 172.21.15.82:0/2750733931 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7fdfa419d5f0 con 0x7fdfa41060e0 2023-09-23T08:47:13.827 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:13.293+0000 7fdfa17fa700 1 -- 172.21.15.82:0/2750733931 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 9) v1 ==== 45148+0+0 (secure 0 0 0) 0x7fdf94003ab0 con 0x7fdfa41060e0 2023-09-23T08:47:13.827 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:13.294+0000 7fdfa17fa700 1 -- 172.21.15.82:0/2750733931 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7fdf9400e620 con 0x7fdfa41060e0 2023-09-23T08:47:13.827 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:13.297+0000 7fdfaa437700 1 -- 172.21.15.82:0/2750733931 >> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] conn(0x7fdf8c038110 msgr2=0x7fdf8c03a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:47:13.827 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:13.297+0000 7fdfaa437700 1 --2- 172.21.15.82:0/2750733931 >> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] conn(0x7fdf8c038110 0x7fdf8c03a5d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fdf98006fd0 tx=0x7fdf98006e40 comp rx=0 tx=0).stop 2023-09-23T08:47:13.827 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:13.297+0000 7fdfaa437700 1 -- 172.21.15.82:0/2750733931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfa41060e0 msgr2=0x7fdfa4199dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:47:13.827 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:13.297+0000 7fdfaa437700 1 --2- 172.21.15.82:0/2750733931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfa41060e0 0x7fdfa4199dc0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fdf94003e30 tx=0x7fdf940119a0 comp rx=0 tx=0).stop 2023-09-23T08:47:13.828 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:13.297+0000 7fdfaa437700 1 -- 172.21.15.82:0/2750733931 shutdown_connections 2023-09-23T08:47:13.828 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:13.297+0000 7fdfaa437700 1 --2- 172.21.15.82:0/2750733931 >> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] conn(0x7fdf8c038110 0x7fdf8c03a5d0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:47:13.828 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:13.297+0000 7fdfaa437700 1 --2- 172.21.15.82:0/2750733931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfa41060e0 0x7fdfa4199dc0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:47:13.828 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:13.297+0000 7fdfaa437700 1 -- 172.21.15.82:0/2750733931 >> 172.21.15.82:0/2750733931 conn(0x7fdfa41016a0 msgr2=0x7fdfa4102d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:47:13.828 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:13.297+0000 7fdfaa437700 1 -- 172.21.15.82:0/2750733931 shutdown_connections 2023-09-23T08:47:13.828 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:13.297+0000 7fdfaa437700 1 -- 172.21.15.82:0/2750733931 wait complete. 2023-09-23T08:47:13.871 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:47:13 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:47:13.585+0000 7f4826e1b200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-09-23T08:47:13.871 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:47:13 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:47:13.689+0000 7f4826e1b200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-09-23T08:47:13.871 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:47:13 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:47:13.809+0000 7f4826e1b200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-09-23T08:47:14.194 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:47:13 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:47:13.939+0000 7f4826e1b200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-09-23T08:47:14.194 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:47:14 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:47:14.181+0000 7f4826e1b200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-09-23T08:47:14.456 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:14 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/2750733931' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2023-09-23T08:47:14.456 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:14 smithi082 ceph-mon[97694]: mgrmap e9: x(active, since 18s) 2023-09-23T08:47:15.027 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:47:14 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:47:14.720+0000 7f4826e1b200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-09-23T08:47:15.028 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:47:14 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:47:14.902+0000 7f4826e1b200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-09-23T08:47:15.296 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:47:15 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:47:15.023+0000 7f4826e1b200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-09-23T08:47:15.296 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:47:15 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:47:15.151+0000 7f4826e1b200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-09-23T08:47:15.403 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout { 2023-09-23T08:47:15.403 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 9, 2023-09-23T08:47:15.403 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "available": true, 2023-09-23T08:47:15.403 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "active_name": "x", 2023-09-23T08:47:15.403 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-09-23T08:47:15.404 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout } 2023-09-23T08:47:15.404 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:14.416+0000 7fa838695700 1 Processor -- start 2023-09-23T08:47:15.404 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:14.416+0000 7fa838695700 1 -- start start 2023-09-23T08:47:15.404 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:14.416+0000 7fa838695700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8301060d0 0x7fa8301064f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:47:15.404 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:14.416+0000 7fa838695700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa830106ac0 con 0x7fa8301060d0 2023-09-23T08:47:15.404 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:14.417+0000 7fa836431700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8301060d0 0x7fa8301064f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:47:15.404 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:14.417+0000 7fa836431700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8301060d0 0x7fa8301064f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57524/0 (socket says 172.21.15.82:57524) 2023-09-23T08:47:15.404 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:14.417+0000 7fa836431700 1 -- 172.21.15.82:0/2555521881 learned_addr learned my addr 172.21.15.82:0/2555521881 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:47:15.404 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:14.418+0000 7fa836431700 1 -- 172.21.15.82:0/2555521881 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8301072d0 con 0x7fa8301060d0 2023-09-23T08:47:15.404 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:14.418+0000 7fa836431700 1 --2- 172.21.15.82:0/2555521881 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8301060d0 0x7fa8301064f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa82c0098a0 tx=0x7fa82c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae91c1190bf45c7b server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:47:15.404 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:14.419+0000 7fa83542f700 1 -- 172.21.15.82:0/2555521881 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa82c004160 con 0x7fa8301060d0 2023-09-23T08:47:15.404 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:14.419+0000 7fa83542f700 1 -- 172.21.15.82:0/2555521881 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa82c0042c0 con 0x7fa8301060d0 2023-09-23T08:47:15.405 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:14.419+0000 7fa83542f700 1 -- 172.21.15.82:0/2555521881 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa82c0118e0 con 0x7fa8301060d0 2023-09-23T08:47:15.405 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:14.420+0000 7fa838695700 1 -- 172.21.15.82:0/2555521881 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8301060d0 msgr2=0x7fa8301064f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:47:15.405 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:14.420+0000 7fa838695700 1 --2- 172.21.15.82:0/2555521881 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8301060d0 0x7fa8301064f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa82c0098a0 tx=0x7fa82c009bb0 comp rx=0 tx=0).stop 2023-09-23T08:47:15.405 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:14.420+0000 7fa838695700 1 -- 172.21.15.82:0/2555521881 shutdown_connections 2023-09-23T08:47:15.405 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:14.420+0000 7fa838695700 1 --2- 172.21.15.82:0/2555521881 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8301060d0 0x7fa8301064f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:47:15.405 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:14.420+0000 7fa838695700 1 -- 172.21.15.82:0/2555521881 >> 172.21.15.82:0/2555521881 conn(0x7fa8301016b0 msgr2=0x7fa830103ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:47:15.405 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:14.420+0000 7fa838695700 1 -- 172.21.15.82:0/2555521881 shutdown_connections 2023-09-23T08:47:15.405 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:14.420+0000 7fa838695700 1 -- 172.21.15.82:0/2555521881 wait complete. 2023-09-23T08:47:15.405 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:14.422+0000 7fa838695700 1 Processor -- start 2023-09-23T08:47:15.405 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:14.422+0000 7fa838695700 1 -- start start 2023-09-23T08:47:15.405 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:14.422+0000 7fa838695700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8301060d0 0x7fa83019bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:47:15.406 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:14.422+0000 7fa838695700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa83019c500 con 0x7fa8301060d0 2023-09-23T08:47:15.406 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:14.422+0000 7fa836431700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8301060d0 0x7fa83019bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:47:15.406 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:14.423+0000 7fa836431700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8301060d0 0x7fa83019bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57530/0 (socket says 172.21.15.82:57530) 2023-09-23T08:47:15.406 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:14.423+0000 7fa836431700 1 -- 172.21.15.82:0/482367323 learned_addr learned my addr 172.21.15.82:0/482367323 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:47:15.406 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:14.423+0000 7fa836431700 1 -- 172.21.15.82:0/482367323 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa82c009550 con 0x7fa8301060d0 2023-09-23T08:47:15.406 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:14.423+0000 7fa836431700 1 --2- 172.21.15.82:0/482367323 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8301060d0 0x7fa83019bfc0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa82c000c00 tx=0x7fa82c0119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:47:15.406 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:14.423+0000 7fa8277fe700 1 -- 172.21.15.82:0/482367323 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa82c0036a0 con 0x7fa8301060d0 2023-09-23T08:47:15.406 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:14.423+0000 7fa8277fe700 1 -- 172.21.15.82:0/482367323 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa82c01b440 con 0x7fa8301060d0 2023-09-23T08:47:15.406 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:14.423+0000 7fa838695700 1 -- 172.21.15.82:0/482367323 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa83019c700 con 0x7fa8301060d0 2023-09-23T08:47:15.406 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:14.423+0000 7fa8277fe700 1 -- 172.21.15.82:0/482367323 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa82c01a3d0 con 0x7fa8301060d0 2023-09-23T08:47:15.406 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:14.424+0000 7fa838695700 1 -- 172.21.15.82:0/482367323 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa83019cb20 con 0x7fa8301060d0 2023-09-23T08:47:15.406 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:14.425+0000 7fa8277fe700 1 -- 172.21.15.82:0/482367323 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 9) v1 ==== 45148+0+0 (secure 0 0 0) 0x7fa82c003800 con 0x7fa8301060d0 2023-09-23T08:47:15.407 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:14.425+0000 7fa838695700 1 -- 172.21.15.82:0/482367323 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa830195dd0 con 0x7fa8301060d0 2023-09-23T08:47:15.407 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:14.425+0000 7fa8277fe700 1 --2- 172.21.15.82:0/482367323 >> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] conn(0x7fa81c038160 0x7fa81c03a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:47:15.407 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:14.425+0000 7fa8277fe700 1 -- 172.21.15.82:0/482367323 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fa82c04be00 con 0x7fa8301060d0 2023-09-23T08:47:15.407 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:14.425+0000 7fa835c30700 1 -- 172.21.15.82:0/482367323 >> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] conn(0x7fa81c038160 msgr2=0x7fa81c03a620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/2733521564 2023-09-23T08:47:15.407 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:14.425+0000 7fa835c30700 1 --2- 172.21.15.82:0/482367323 >> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] conn(0x7fa81c038160 0x7fa81c03a620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-09-23T08:47:15.407 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:14.430+0000 7fa8277fe700 1 -- 172.21.15.82:0/482367323 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7fa82c023980 con 0x7fa8301060d0 2023-09-23T08:47:15.407 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:14.626+0000 7fa835c30700 1 -- 172.21.15.82:0/482367323 >> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] conn(0x7fa81c038160 msgr2=0x7fa81c03a620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/2733521564 2023-09-23T08:47:15.407 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:14.626+0000 7fa835c30700 1 --2- 172.21.15.82:0/482367323 >> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] conn(0x7fa81c038160 0x7fa81c03a620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-09-23T08:47:15.407 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:14.779+0000 7fa838695700 1 -- 172.21.15.82:0/482367323 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7fa830061fa0 con 0x7fa8301060d0 2023-09-23T08:47:15.407 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:14.780+0000 7fa8277fe700 1 -- 172.21.15.82:0/482367323 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+88 (secure 0 0 0) 0x7fa82c01f020 con 0x7fa8301060d0 2023-09-23T08:47:15.407 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:14.782+0000 7fa838695700 1 -- 172.21.15.82:0/482367323 >> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] conn(0x7fa81c038160 msgr2=0x7fa81c03a620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-23T08:47:15.408 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:14.782+0000 7fa838695700 1 --2- 172.21.15.82:0/482367323 >> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] conn(0x7fa81c038160 0x7fa81c03a620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:47:15.408 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:14.782+0000 7fa838695700 1 -- 172.21.15.82:0/482367323 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8301060d0 msgr2=0x7fa83019bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:47:15.408 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:14.782+0000 7fa838695700 1 --2- 172.21.15.82:0/482367323 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8301060d0 0x7fa83019bfc0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa82c000c00 tx=0x7fa82c0119a0 comp rx=0 tx=0).stop 2023-09-23T08:47:15.408 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:14.782+0000 7fa838695700 1 -- 172.21.15.82:0/482367323 shutdown_connections 2023-09-23T08:47:15.408 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:14.782+0000 7fa838695700 1 --2- 172.21.15.82:0/482367323 >> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] conn(0x7fa81c038160 0x7fa81c03a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:47:15.408 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:14.782+0000 7fa838695700 1 --2- 172.21.15.82:0/482367323 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8301060d0 0x7fa83019bfc0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:47:15.408 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:14.782+0000 7fa838695700 1 -- 172.21.15.82:0/482367323 >> 172.21.15.82:0/482367323 conn(0x7fa8301016b0 msgr2=0x7fa830109a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:47:15.408 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:14.782+0000 7fa838695700 1 -- 172.21.15.82:0/482367323 shutdown_connections 2023-09-23T08:47:15.408 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:14.782+0000 7fa838695700 1 -- 172.21.15.82:0/482367323 wait complete. 2023-09-23T08:47:15.408 INFO:teuthology.orchestra.run.smithi082.stdout:Waiting for the mgr to restart... 2023-09-23T08:47:15.408 INFO:teuthology.orchestra.run.smithi082.stdout:Waiting for mgr epoch 9... 2023-09-23T08:47:15.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:15 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/482367323' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-09-23T08:47:16.121 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:47:15 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:47:15.727+0000 7f4826e1b200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-09-23T08:47:16.870 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:47:16 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:47:16.580+0000 7f4826e1b200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-09-23T08:47:16.871 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:47:16 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:47:16.685+0000 7f4826e1b200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-09-23T08:47:17.973 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:47:17 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:47:17.627+0000 7f4826e1b200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-09-23T08:47:17.973 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:47:17 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:47:17.746+0000 7f4826e1b200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-09-23T08:47:18.330 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:47:17 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:47:17.969+0000 7f4826e1b200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-09-23T08:47:18.604 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:47:18 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:47:18.326+0000 7f4826e1b200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-09-23T08:47:18.871 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:47:18 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:47:18.600+0000 7f4826e1b200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-09-23T08:47:18.871 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:47:18 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:47:18.792+0000 7f4826e1b200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-09-23T08:47:19.621 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:47:19 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:47:19.136+0000 7f4826e1b200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-09-23T08:47:20.371 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:47:20 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:47:20.057+0000 7f4826e1b200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-09-23T08:47:20.371 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:47:20 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:47:20.231+0000 7f4826e1b200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-09-23T08:47:20.871 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:47:20 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:47:20.477+0000 7f4826e1b200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-09-23T08:47:20.871 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:47:20 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:47:20.621+0000 7f4826e1b200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-09-23T08:47:21.370 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:47:20 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:47:20.897+0000 7f4826e1b200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-09-23T08:47:22.371 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:47:21 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:47:21.955+0000 7f4826e1b200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-09-23T08:47:22.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:22 smithi082 ceph-mon[97694]: Active manager daemon x restarted 2023-09-23T08:47:22.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:22 smithi082 ceph-mon[97694]: Activating manager daemon x 2023-09-23T08:47:22.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:22 smithi082 ceph-mon[97694]: osdmap e3: 0 total, 0 up, 0 in 2023-09-23T08:47:22.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:22 smithi082 ceph-mon[97694]: mgrmap e10: x(active, starting, since 0.00406362s) 2023-09-23T08:47:22.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:22 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-09-23T08:47:22.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:22 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-09-23T08:47:22.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:22 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-09-23T08:47:22.372 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:22 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-09-23T08:47:22.372 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:22 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-09-23T08:47:22.372 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:22 smithi082 ceph-mon[97694]: Manager daemon x is now available 2023-09-23T08:47:22.372 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:22 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:47:22.372 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:22 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:47:23.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:23 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-09-23T08:47:23.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:23 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-09-23T08:47:23.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:23 smithi082 ceph-mon[97694]: mgrmap e11: x(active, since 1.00883s) 2023-09-23T08:47:23.411 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout { 2023-09-23T08:47:23.411 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2023-09-23T08:47:23.411 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "initialized": true 2023-09-23T08:47:23.411 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout } 2023-09-23T08:47:23.411 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:15.998+0000 7fa722ae3700 1 Processor -- start 2023-09-23T08:47:23.411 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:15.998+0000 7fa722ae3700 1 -- start start 2023-09-23T08:47:23.411 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:15.999+0000 7fa722ae3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa71c07ad30 0x7fa71c079190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:47:23.411 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:15.999+0000 7fa722ae3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa71c079760 con 0x7fa71c07ad30 2023-09-23T08:47:23.412 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:15.999+0000 7fa72087f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa71c07ad30 0x7fa71c079190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:47:23.412 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:15.999+0000 7fa72087f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa71c07ad30 0x7fa71c079190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57534/0 (socket says 172.21.15.82:57534) 2023-09-23T08:47:23.412 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:15.999+0000 7fa72087f700 1 -- 172.21.15.82:0/372011413 learned_addr learned my addr 172.21.15.82:0/372011413 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:47:23.412 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:15.999+0000 7fa72087f700 1 -- 172.21.15.82:0/372011413 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa71c0798a0 con 0x7fa71c07ad30 2023-09-23T08:47:23.412 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:16.000+0000 7fa72087f700 1 --2- 172.21.15.82:0/372011413 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa71c07ad30 0x7fa71c079190 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa7100098a0 tx=0x7fa710009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=469cee3a3745d9cb server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:47:23.412 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:16.000+0000 7fa71b7fe700 1 -- 172.21.15.82:0/372011413 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa710004160 con 0x7fa71c07ad30 2023-09-23T08:47:23.412 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:16.000+0000 7fa71b7fe700 1 -- 172.21.15.82:0/372011413 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa7100042c0 con 0x7fa71c07ad30 2023-09-23T08:47:23.412 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:16.000+0000 7fa71b7fe700 1 -- 172.21.15.82:0/372011413 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa7100118e0 con 0x7fa71c07ad30 2023-09-23T08:47:23.412 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:16.000+0000 7fa722ae3700 1 -- 172.21.15.82:0/372011413 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa71c07ad30 msgr2=0x7fa71c079190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:47:23.412 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:16.000+0000 7fa722ae3700 1 --2- 172.21.15.82:0/372011413 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa71c07ad30 0x7fa71c079190 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa7100098a0 tx=0x7fa710009bb0 comp rx=0 tx=0).stop 2023-09-23T08:47:23.412 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:16.001+0000 7fa722ae3700 1 -- 172.21.15.82:0/372011413 shutdown_connections 2023-09-23T08:47:23.412 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:16.001+0000 7fa722ae3700 1 --2- 172.21.15.82:0/372011413 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa71c07ad30 0x7fa71c079190 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:47:23.413 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:16.001+0000 7fa722ae3700 1 -- 172.21.15.82:0/372011413 >> 172.21.15.82:0/372011413 conn(0x7fa71c1016b0 msgr2=0x7fa71c103ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:47:23.413 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:16.001+0000 7fa722ae3700 1 -- 172.21.15.82:0/372011413 shutdown_connections 2023-09-23T08:47:23.413 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:16.001+0000 7fa722ae3700 1 -- 172.21.15.82:0/372011413 wait complete. 2023-09-23T08:47:23.413 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:16.002+0000 7fa722ae3700 1 Processor -- start 2023-09-23T08:47:23.413 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:16.002+0000 7fa722ae3700 1 -- start start 2023-09-23T08:47:23.413 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:16.002+0000 7fa722ae3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa71c07ad30 0x7fa71c19bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:47:23.413 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:16.002+0000 7fa722ae3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa71c19c500 con 0x7fa71c07ad30 2023-09-23T08:47:23.413 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:16.002+0000 7fa72087f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa71c07ad30 0x7fa71c19bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:47:23.413 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:16.002+0000 7fa72087f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa71c07ad30 0x7fa71c19bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57548/0 (socket says 172.21.15.82:57548) 2023-09-23T08:47:23.413 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:16.002+0000 7fa72087f700 1 -- 172.21.15.82:0/2247261419 learned_addr learned my addr 172.21.15.82:0/2247261419 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:47:23.413 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:16.003+0000 7fa72087f700 1 -- 172.21.15.82:0/2247261419 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa710009550 con 0x7fa71c07ad30 2023-09-23T08:47:23.414 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:16.003+0000 7fa72087f700 1 --2- 172.21.15.82:0/2247261419 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa71c07ad30 0x7fa71c19bfc0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa710000c00 tx=0x7fa7100119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:47:23.414 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:16.003+0000 7fa719ffb700 1 -- 172.21.15.82:0/2247261419 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa7100036a0 con 0x7fa71c07ad30 2023-09-23T08:47:23.414 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:16.003+0000 7fa719ffb700 1 -- 172.21.15.82:0/2247261419 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa71001b440 con 0x7fa71c07ad30 2023-09-23T08:47:23.414 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:16.003+0000 7fa719ffb700 1 -- 172.21.15.82:0/2247261419 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa71001a3d0 con 0x7fa71c07ad30 2023-09-23T08:47:23.414 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:16.003+0000 7fa722ae3700 1 -- 172.21.15.82:0/2247261419 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa71c19c700 con 0x7fa71c07ad30 2023-09-23T08:47:23.414 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:16.003+0000 7fa722ae3700 1 -- 172.21.15.82:0/2247261419 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa71c19cb20 con 0x7fa71c07ad30 2023-09-23T08:47:23.414 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:16.005+0000 7fa719ffb700 1 -- 172.21.15.82:0/2247261419 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 9) v1 ==== 45148+0+0 (secure 0 0 0) 0x7fa71001b5b0 con 0x7fa71c07ad30 2023-09-23T08:47:23.414 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:16.005+0000 7fa719ffb700 1 --2- 172.21.15.82:0/2247261419 >> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] conn(0x7fa70c0381b0 0x7fa70c03a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:47:23.414 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:16.005+0000 7fa719ffb700 1 -- 172.21.15.82:0/2247261419 --> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa70c03ad80 con 0x7fa70c0381b0 2023-09-23T08:47:23.414 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:16.005+0000 7fa719ffb700 1 -- 172.21.15.82:0/2247261419 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fa71004bec0 con 0x7fa71c07ad30 2023-09-23T08:47:23.414 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:16.005+0000 7fa71bfff700 1 -- 172.21.15.82:0/2247261419 >> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] conn(0x7fa70c0381b0 msgr2=0x7fa70c03a670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/2733521564 2023-09-23T08:47:23.415 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:16.005+0000 7fa71bfff700 1 --2- 172.21.15.82:0/2247261419 >> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] conn(0x7fa70c0381b0 0x7fa70c03a670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-09-23T08:47:23.415 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:16.206+0000 7fa71bfff700 1 -- 172.21.15.82:0/2247261419 >> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] conn(0x7fa70c0381b0 msgr2=0x7fa70c03a670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/2733521564 2023-09-23T08:47:23.415 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:16.206+0000 7fa71bfff700 1 --2- 172.21.15.82:0/2247261419 >> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] conn(0x7fa70c0381b0 0x7fa70c03a670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-09-23T08:47:23.415 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:16.607+0000 7fa71bfff700 1 -- 172.21.15.82:0/2247261419 >> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] conn(0x7fa70c0381b0 msgr2=0x7fa70c03a670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/2733521564 2023-09-23T08:47:23.415 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:16.607+0000 7fa71bfff700 1 --2- 172.21.15.82:0/2247261419 >> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] conn(0x7fa70c0381b0 0x7fa70c03a670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-09-23T08:47:23.415 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:17.408+0000 7fa71bfff700 1 -- 172.21.15.82:0/2247261419 >> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] conn(0x7fa70c0381b0 msgr2=0x7fa70c03a670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/2733521564 2023-09-23T08:47:23.415 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:17.408+0000 7fa71bfff700 1 --2- 172.21.15.82:0/2247261419 >> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] conn(0x7fa70c0381b0 0x7fa70c03a670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-09-23T08:47:23.415 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:19.010+0000 7fa71bfff700 1 -- 172.21.15.82:0/2247261419 >> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] conn(0x7fa70c0381b0 msgr2=0x7fa70c03a670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/2733521564 2023-09-23T08:47:23.415 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:19.010+0000 7fa71bfff700 1 --2- 172.21.15.82:0/2247261419 >> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] conn(0x7fa70c0381b0 0x7fa70c03a670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-09-23T08:47:23.415 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:21.959+0000 7fa719ffb700 1 -- 172.21.15.82:0/2247261419 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mgrmap(e 10) v1 ==== 44915+0+0 (secure 0 0 0) 0x7fa71001b930 con 0x7fa71c07ad30 2023-09-23T08:47:23.415 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:21.959+0000 7fa719ffb700 1 -- 172.21.15.82:0/2247261419 >> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] conn(0x7fa70c0381b0 msgr2=0x7fa70c03a670 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-23T08:47:23.415 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:21.959+0000 7fa719ffb700 1 --2- 172.21.15.82:0/2247261419 >> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] conn(0x7fa70c0381b0 0x7fa70c03a670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:47:23.416 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:22.962+0000 7fa719ffb700 1 -- 172.21.15.82:0/2247261419 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 11) v1 ==== 45042+0+0 (secure 0 0 0) 0x7fa71004db20 con 0x7fa71c07ad30 2023-09-23T08:47:23.416 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:22.962+0000 7fa719ffb700 1 --2- 172.21.15.82:0/2247261419 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fa70c03bc60 0x7fa70c03e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:47:23.416 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:22.962+0000 7fa719ffb700 1 -- 172.21.15.82:0/2247261419 --> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa70c03ad80 con 0x7fa70c03bc60 2023-09-23T08:47:23.416 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:22.964+0000 7fa71bfff700 1 --2- 172.21.15.82:0/2247261419 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fa70c03bc60 0x7fa70c03e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:47:23.416 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:22.964+0000 7fa71bfff700 1 --2- 172.21.15.82:0/2247261419 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fa70c03bc60 0x7fa70c03e050 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fa708003a10 tx=0x7fa708009270 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:47:23.416 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:22.966+0000 7fa719ffb700 1 -- 172.21.15.82:0/2247261419 <== mgr.14152 v2:172.21.15.82:6800/3698954311 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6910 (secure 0 0 0) 0x7fa70c03ad80 con 0x7fa70c03bc60 2023-09-23T08:47:23.416 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:22.972+0000 7fa722ae3700 1 -- 172.21.15.82:0/2247261419 --> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7fa71c19d300 con 0x7fa70c03bc60 2023-09-23T08:47:23.416 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:22.973+0000 7fa719ffb700 1 -- 172.21.15.82:0/2247261419 <== mgr.14152 v2:172.21.15.82:6800/3698954311 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7fa71c19d300 con 0x7fa70c03bc60 2023-09-23T08:47:23.416 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:22.973+0000 7fa722ae3700 1 -- 172.21.15.82:0/2247261419 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fa70c03bc60 msgr2=0x7fa70c03e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:47:23.416 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:22.973+0000 7fa722ae3700 1 --2- 172.21.15.82:0/2247261419 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fa70c03bc60 0x7fa70c03e050 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fa708003a10 tx=0x7fa708009270 comp rx=0 tx=0).stop 2023-09-23T08:47:23.416 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:22.973+0000 7fa722ae3700 1 -- 172.21.15.82:0/2247261419 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa71c07ad30 msgr2=0x7fa71c19bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:47:23.416 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:22.973+0000 7fa722ae3700 1 --2- 172.21.15.82:0/2247261419 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa71c07ad30 0x7fa71c19bfc0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa710000c00 tx=0x7fa7100119a0 comp rx=0 tx=0).stop 2023-09-23T08:47:23.416 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:22.973+0000 7fa722ae3700 1 -- 172.21.15.82:0/2247261419 shutdown_connections 2023-09-23T08:47:23.417 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:22.973+0000 7fa722ae3700 1 --2- 172.21.15.82:0/2247261419 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa71c07ad30 0x7fa71c19bfc0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:47:23.417 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:22.973+0000 7fa722ae3700 1 --2- 172.21.15.82:0/2247261419 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fa70c03bc60 0x7fa70c03e050 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:47:23.417 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:22.973+0000 7fa722ae3700 1 --2- 172.21.15.82:0/2247261419 >> [v2:172.21.15.82:6800/2733521564,v1:172.21.15.82:6801/2733521564] conn(0x7fa70c0381b0 0x7fa70c03a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:47:23.417 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:22.973+0000 7fa722ae3700 1 -- 172.21.15.82:0/2247261419 >> 172.21.15.82:0/2247261419 conn(0x7fa71c1016b0 msgr2=0x7fa71c102db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:47:23.417 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:22.973+0000 7fa722ae3700 1 -- 172.21.15.82:0/2247261419 shutdown_connections 2023-09-23T08:47:23.417 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:22.974+0000 7fa722ae3700 1 -- 172.21.15.82:0/2247261419 wait complete. 2023-09-23T08:47:23.417 INFO:teuthology.orchestra.run.smithi082.stdout:mgr epoch 9 is available 2023-09-23T08:47:23.417 INFO:teuthology.orchestra.run.smithi082.stdout:Generating a dashboard self-signed certificate... 2023-09-23T08:47:24.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:24 smithi082 ceph-mon[97694]: [23/Sep/2023:08:47:22] ENGINE Bus STARTING 2023-09-23T08:47:24.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:24 smithi082 ceph-mon[97694]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-09-23T08:47:24.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:24 smithi082 ceph-mon[97694]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-09-23T08:47:24.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:24 smithi082 ceph-mon[97694]: [23/Sep/2023:08:47:23] ENGINE Serving on http://172.21.15.82:8765 2023-09-23T08:47:24.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:24 smithi082 ceph-mon[97694]: [23/Sep/2023:08:47:23] ENGINE Serving on https://172.21.15.82:7150 2023-09-23T08:47:24.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:24 smithi082 ceph-mon[97694]: [23/Sep/2023:08:47:23] ENGINE Bus STARTED 2023-09-23T08:47:24.995 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2023-09-23T08:47:24.995 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:24.157+0000 7f2e0917d700 1 Processor -- start 2023-09-23T08:47:24.995 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:24.157+0000 7f2e0917d700 1 -- start start 2023-09-23T08:47:24.995 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:24.157+0000 7f2e0917d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e0407ad30 0x7f2e04079190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:47:24.995 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:24.157+0000 7f2e0917d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e04079760 con 0x7f2e0407ad30 2023-09-23T08:47:24.996 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:24.158+0000 7f2e02d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e0407ad30 0x7f2e04079190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:47:24.996 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:24.158+0000 7f2e02d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e0407ad30 0x7f2e04079190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33370/0 (socket says 172.21.15.82:33370) 2023-09-23T08:47:24.996 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:24.158+0000 7f2e02d9d700 1 -- 172.21.15.82:0/1444226370 learned_addr learned my addr 172.21.15.82:0/1444226370 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:47:24.996 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:24.158+0000 7f2e02d9d700 1 -- 172.21.15.82:0/1444226370 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e040798a0 con 0x7f2e0407ad30 2023-09-23T08:47:24.996 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:24.159+0000 7f2e02d9d700 1 --2- 172.21.15.82:0/1444226370 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e0407ad30 0x7f2e04079190 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2df40098a0 tx=0x7f2df4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=368ef6d36da24ee6 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:47:24.996 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:24.159+0000 7f2e01d9b700 1 -- 172.21.15.82:0/1444226370 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2df4004160 con 0x7f2e0407ad30 2023-09-23T08:47:24.996 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:24.159+0000 7f2e01d9b700 1 -- 172.21.15.82:0/1444226370 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2df40042c0 con 0x7f2e0407ad30 2023-09-23T08:47:24.996 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:24.159+0000 7f2e01d9b700 1 -- 172.21.15.82:0/1444226370 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2df40118e0 con 0x7f2e0407ad30 2023-09-23T08:47:24.996 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:24.159+0000 7f2e0917d700 1 -- 172.21.15.82:0/1444226370 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e0407ad30 msgr2=0x7f2e04079190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:47:24.996 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:24.159+0000 7f2e0917d700 1 --2- 172.21.15.82:0/1444226370 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e0407ad30 0x7f2e04079190 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2df40098a0 tx=0x7f2df4009bb0 comp rx=0 tx=0).stop 2023-09-23T08:47:24.996 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:24.160+0000 7f2e0917d700 1 -- 172.21.15.82:0/1444226370 shutdown_connections 2023-09-23T08:47:24.996 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:24.160+0000 7f2e0917d700 1 --2- 172.21.15.82:0/1444226370 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e0407ad30 0x7f2e04079190 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:47:24.997 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:24.160+0000 7f2e0917d700 1 -- 172.21.15.82:0/1444226370 >> 172.21.15.82:0/1444226370 conn(0x7f2e041016b0 msgr2=0x7f2e04103ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:47:24.997 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:24.160+0000 7f2e0917d700 1 -- 172.21.15.82:0/1444226370 shutdown_connections 2023-09-23T08:47:24.997 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:24.160+0000 7f2e0917d700 1 -- 172.21.15.82:0/1444226370 wait complete. 2023-09-23T08:47:24.997 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:24.161+0000 7f2e0917d700 1 Processor -- start 2023-09-23T08:47:24.997 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:24.161+0000 7f2e0917d700 1 -- start start 2023-09-23T08:47:24.997 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:24.161+0000 7f2e0917d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e0407ad30 0x7f2e0419bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:47:24.997 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:24.161+0000 7f2e0917d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0419c500 con 0x7f2e0407ad30 2023-09-23T08:47:24.997 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:24.161+0000 7f2e02d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e0407ad30 0x7f2e0419bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:47:24.997 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:24.161+0000 7f2e02d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e0407ad30 0x7f2e0419bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33384/0 (socket says 172.21.15.82:33384) 2023-09-23T08:47:24.997 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:24.162+0000 7f2e02d9d700 1 -- 172.21.15.82:0/2871563635 learned_addr learned my addr 172.21.15.82:0/2871563635 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:47:24.997 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:24.162+0000 7f2e02d9d700 1 -- 172.21.15.82:0/2871563635 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2df4009550 con 0x7f2e0407ad30 2023-09-23T08:47:24.998 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:24.162+0000 7f2e02d9d700 1 --2- 172.21.15.82:0/2871563635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e0407ad30 0x7f2e0419bfc0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2df4006af0 tx=0x7f2df4011e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:47:24.998 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:24.162+0000 7f2debfff700 1 -- 172.21.15.82:0/2871563635 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2df40037d0 con 0x7f2e0407ad30 2023-09-23T08:47:24.998 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:24.162+0000 7f2debfff700 1 -- 172.21.15.82:0/2871563635 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2df401b440 con 0x7f2e0407ad30 2023-09-23T08:47:24.998 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:24.162+0000 7f2debfff700 1 -- 172.21.15.82:0/2871563635 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2df4019560 con 0x7f2e0407ad30 2023-09-23T08:47:24.998 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:24.162+0000 7f2e0917d700 1 -- 172.21.15.82:0/2871563635 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e0419c700 con 0x7f2e0407ad30 2023-09-23T08:47:24.998 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:24.162+0000 7f2e0917d700 1 -- 172.21.15.82:0/2871563635 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e0419cb20 con 0x7f2e0407ad30 2023-09-23T08:47:24.998 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:24.163+0000 7f2e0917d700 1 -- 172.21.15.82:0/2871563635 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e04061f50 con 0x7f2e0407ad30 2023-09-23T08:47:24.998 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:24.163+0000 7f2debfff700 1 -- 172.21.15.82:0/2871563635 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 12) v1 ==== 45148+0+0 (secure 0 0 0) 0x7f2df4003930 con 0x7f2e0407ad30 2023-09-23T08:47:24.998 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:24.164+0000 7f2debfff700 1 --2- 172.21.15.82:0/2871563635 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f2dec038160 0x7f2dec03a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:47:24.998 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:24.164+0000 7f2debfff700 1 -- 172.21.15.82:0/2871563635 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f2df404bf60 con 0x7f2e0407ad30 2023-09-23T08:47:24.998 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:24.164+0000 7f2e0259c700 1 --2- 172.21.15.82:0/2871563635 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f2dec038160 0x7f2dec03a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:47:24.999 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:24.165+0000 7f2e0259c700 1 --2- 172.21.15.82:0/2871563635 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f2dec038160 0x7f2dec03a620 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2df8006fd0 tx=0x7f2df8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:47:24.999 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:24.169+0000 7f2debfff700 1 -- 172.21.15.82:0/2871563635 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f2df402bb00 con 0x7f2e0407ad30 2023-09-23T08:47:24.999 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:24.401+0000 7f2e0917d700 1 -- 172.21.15.82:0/2871563635 --> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7f2e041039d0 con 0x7f2dec038160 2023-09-23T08:47:24.999 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:24.544+0000 7f2debfff700 1 -- 172.21.15.82:0/2871563635 <== mgr.14152 v2:172.21.15.82:6800/3698954311 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7f2e041039d0 con 0x7f2dec038160 2023-09-23T08:47:24.999 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:24.547+0000 7f2e0917d700 1 -- 172.21.15.82:0/2871563635 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f2dec038160 msgr2=0x7f2dec03a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:47:24.999 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:24.547+0000 7f2e0917d700 1 --2- 172.21.15.82:0/2871563635 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f2dec038160 0x7f2dec03a620 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2df8006fd0 tx=0x7f2df8006e40 comp rx=0 tx=0).stop 2023-09-23T08:47:24.999 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:24.547+0000 7f2e0917d700 1 -- 172.21.15.82:0/2871563635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e0407ad30 msgr2=0x7f2e0419bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:47:24.999 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:24.547+0000 7f2e0917d700 1 --2- 172.21.15.82:0/2871563635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e0407ad30 0x7f2e0419bfc0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2df4006af0 tx=0x7f2df4011e80 comp rx=0 tx=0).stop 2023-09-23T08:47:24.999 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:24.547+0000 7f2e0917d700 1 -- 172.21.15.82:0/2871563635 shutdown_connections 2023-09-23T08:47:24.999 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:24.547+0000 7f2e0917d700 1 --2- 172.21.15.82:0/2871563635 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f2dec038160 0x7f2dec03a620 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:47:24.999 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:24.547+0000 7f2e0917d700 1 --2- 172.21.15.82:0/2871563635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e0407ad30 0x7f2e0419bfc0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:47:24.999 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:24.547+0000 7f2e0917d700 1 -- 172.21.15.82:0/2871563635 >> 172.21.15.82:0/2871563635 conn(0x7f2e041016b0 msgr2=0x7f2e04102db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:47:25.000 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:24.547+0000 7f2e0917d700 1 -- 172.21.15.82:0/2871563635 shutdown_connections 2023-09-23T08:47:25.000 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:24.547+0000 7f2e0917d700 1 -- 172.21.15.82:0/2871563635 wait complete. 2023-09-23T08:47:25.000 INFO:teuthology.orchestra.run.smithi082.stdout:Creating initial admin user... 2023-09-23T08:47:25.306 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:25 smithi082 ceph-mon[97694]: mgrmap e12: x(active, since 2s) 2023-09-23T08:47:25.306 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:25 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:47:25.307 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:25 smithi082 ceph-mon[97694]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:47:25.307 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:25 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:47:25.307 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:25 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:47:26.580 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$HtK2FbK8pZfM.Z4lEToNoenju8UtCfWLRlOhSJRL0zeuRUAEvrwwe", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1695458846, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2023-09-23T08:47:26.580 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:25.591+0000 7fad17372700 1 Processor -- start 2023-09-23T08:47:26.580 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:25.592+0000 7fad17372700 1 -- start start 2023-09-23T08:47:26.580 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:25.592+0000 7fad17372700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad10104fe0 0x7fad10105400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:47:26.580 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:25.592+0000 7fad17372700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad101059d0 con 0x7fad10104fe0 2023-09-23T08:47:26.580 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:25.592+0000 7fad1510e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad10104fe0 0x7fad10105400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:47:26.581 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:25.592+0000 7fad1510e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad10104fe0 0x7fad10105400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33392/0 (socket says 172.21.15.82:33392) 2023-09-23T08:47:26.581 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:25.592+0000 7fad1510e700 1 -- 172.21.15.82:0/4181630127 learned_addr learned my addr 172.21.15.82:0/4181630127 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:47:26.581 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:25.593+0000 7fad1510e700 1 -- 172.21.15.82:0/4181630127 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad101061e0 con 0x7fad10104fe0 2023-09-23T08:47:26.581 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:25.593+0000 7fad1510e700 1 --2- 172.21.15.82:0/4181630127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad10104fe0 0x7fad10105400 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fad0c00bb40 tx=0x7fad0c00be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbf19c8116f0a1f9 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:47:26.581 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:25.593+0000 7fad07fff700 1 -- 172.21.15.82:0/4181630127 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fad0c00dbe0 con 0x7fad10104fe0 2023-09-23T08:47:26.581 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:25.593+0000 7fad07fff700 1 -- 172.21.15.82:0/4181630127 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fad0c0044c0 con 0x7fad10104fe0 2023-09-23T08:47:26.581 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:25.593+0000 7fad07fff700 1 -- 172.21.15.82:0/4181630127 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fad0c003d50 con 0x7fad10104fe0 2023-09-23T08:47:26.581 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:25.594+0000 7fad17372700 1 -- 172.21.15.82:0/4181630127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad10104fe0 msgr2=0x7fad10105400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:47:26.581 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:25.594+0000 7fad17372700 1 --2- 172.21.15.82:0/4181630127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad10104fe0 0x7fad10105400 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fad0c00bb40 tx=0x7fad0c00be50 comp rx=0 tx=0).stop 2023-09-23T08:47:26.581 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:25.594+0000 7fad17372700 1 -- 172.21.15.82:0/4181630127 shutdown_connections 2023-09-23T08:47:26.582 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:25.594+0000 7fad17372700 1 --2- 172.21.15.82:0/4181630127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad10104fe0 0x7fad10105400 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:47:26.582 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:25.594+0000 7fad17372700 1 -- 172.21.15.82:0/4181630127 >> 172.21.15.82:0/4181630127 conn(0x7fad101005a0 msgr2=0x7fad101029c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:47:26.582 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:25.594+0000 7fad17372700 1 -- 172.21.15.82:0/4181630127 shutdown_connections 2023-09-23T08:47:26.582 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:25.594+0000 7fad17372700 1 -- 172.21.15.82:0/4181630127 wait complete. 2023-09-23T08:47:26.582 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:25.596+0000 7fad17372700 1 Processor -- start 2023-09-23T08:47:26.582 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:25.596+0000 7fad17372700 1 -- start start 2023-09-23T08:47:26.582 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:25.596+0000 7fad17372700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad10104fe0 0x7fad1019bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:47:26.582 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:25.596+0000 7fad17372700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad1019c4d0 con 0x7fad10104fe0 2023-09-23T08:47:26.582 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:25.597+0000 7fad1510e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad10104fe0 0x7fad1019bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:47:26.582 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:25.597+0000 7fad1510e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad10104fe0 0x7fad1019bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33396/0 (socket says 172.21.15.82:33396) 2023-09-23T08:47:26.582 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:25.597+0000 7fad1510e700 1 -- 172.21.15.82:0/216110240 learned_addr learned my addr 172.21.15.82:0/216110240 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:47:26.583 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:25.597+0000 7fad1510e700 1 -- 172.21.15.82:0/216110240 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad0c00b7f0 con 0x7fad10104fe0 2023-09-23T08:47:26.583 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:25.597+0000 7fad1510e700 1 --2- 172.21.15.82:0/216110240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad10104fe0 0x7fad1019bf90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fad0c00dce0 tx=0x7fad0c00ddc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:47:26.583 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:25.597+0000 7fad067fc700 1 -- 172.21.15.82:0/216110240 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fad0c010680 con 0x7fad10104fe0 2023-09-23T08:47:26.583 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:25.598+0000 7fad17372700 1 -- 172.21.15.82:0/216110240 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad1019c6d0 con 0x7fad10104fe0 2023-09-23T08:47:26.583 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:25.597+0000 7fad067fc700 1 -- 172.21.15.82:0/216110240 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fad0c010c70 con 0x7fad10104fe0 2023-09-23T08:47:26.583 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:25.598+0000 7fad067fc700 1 -- 172.21.15.82:0/216110240 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fad0c021b70 con 0x7fad10104fe0 2023-09-23T08:47:26.583 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:25.598+0000 7fad17372700 1 -- 172.21.15.82:0/216110240 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad1019ca90 con 0x7fad10104fe0 2023-09-23T08:47:26.583 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:25.599+0000 7fad067fc700 1 -- 172.21.15.82:0/216110240 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 12) v1 ==== 45148+0+0 (secure 0 0 0) 0x7fad0c0193f0 con 0x7fad10104fe0 2023-09-23T08:47:26.583 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:25.599+0000 7fad17372700 1 -- 172.21.15.82:0/216110240 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad10195c80 con 0x7fad10104fe0 2023-09-23T08:47:26.583 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:25.599+0000 7fad067fc700 1 --2- 172.21.15.82:0/216110240 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7facfc038190 0x7facfc03a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:47:26.583 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:25.599+0000 7fad067fc700 1 -- 172.21.15.82:0/216110240 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fad0c04c5e0 con 0x7fad10104fe0 2023-09-23T08:47:26.584 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:25.600+0000 7fad1490d700 1 --2- 172.21.15.82:0/216110240 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7facfc038190 0x7facfc03a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:47:26.584 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:25.600+0000 7fad1490d700 1 --2- 172.21.15.82:0/216110240 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7facfc038190 0x7facfc03a650 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fad00006fd0 tx=0x7fad00006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:47:26.584 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:25.608+0000 7fad067fc700 1 -- 172.21.15.82:0/216110240 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7fad0c00e770 con 0x7fad10104fe0 2023-09-23T08:47:26.584 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:25.834+0000 7fad17372700 1 -- 172.21.15.82:0/216110240 --> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fad100741c0 con 0x7facfc038190 2023-09-23T08:47:26.584 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:26.064+0000 7fad067fc700 1 -- 172.21.15.82:0/216110240 <== mgr.14152 v2:172.21.15.82:6800/3698954311 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7fad100741c0 con 0x7facfc038190 2023-09-23T08:47:26.584 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:26.067+0000 7fad17372700 1 -- 172.21.15.82:0/216110240 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7facfc038190 msgr2=0x7facfc03a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:47:26.584 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:26.067+0000 7fad17372700 1 --2- 172.21.15.82:0/216110240 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7facfc038190 0x7facfc03a650 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fad00006fd0 tx=0x7fad00006e40 comp rx=0 tx=0).stop 2023-09-23T08:47:26.584 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:26.067+0000 7fad17372700 1 -- 172.21.15.82:0/216110240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad10104fe0 msgr2=0x7fad1019bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:47:26.584 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:26.067+0000 7fad17372700 1 --2- 172.21.15.82:0/216110240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad10104fe0 0x7fad1019bf90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fad0c00dce0 tx=0x7fad0c00ddc0 comp rx=0 tx=0).stop 2023-09-23T08:47:26.584 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:26.067+0000 7fad17372700 1 -- 172.21.15.82:0/216110240 shutdown_connections 2023-09-23T08:47:26.584 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:26.067+0000 7fad17372700 1 --2- 172.21.15.82:0/216110240 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7facfc038190 0x7facfc03a650 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:47:26.585 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:26.067+0000 7fad17372700 1 --2- 172.21.15.82:0/216110240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad10104fe0 0x7fad1019bf90 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:47:26.585 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:26.067+0000 7fad17372700 1 -- 172.21.15.82:0/216110240 >> 172.21.15.82:0/216110240 conn(0x7fad101005a0 msgr2=0x7fad10192dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:47:26.585 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:26.067+0000 7fad17372700 1 -- 172.21.15.82:0/216110240 shutdown_connections 2023-09-23T08:47:26.585 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:26.067+0000 7fad17372700 1 -- 172.21.15.82:0/216110240 wait complete. 2023-09-23T08:47:26.585 INFO:teuthology.orchestra.run.smithi082.stdout:Fetching dashboard port number... 2023-09-23T08:47:26.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:26 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:47:26.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:26 smithi082 ceph-mon[97694]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:47:26.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:26 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:47:27.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:27 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/845810846' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2023-09-23T08:47:28.006 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 8443 2023-09-23T08:47:28.011 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:27.225+0000 7f3674503700 1 Processor -- start 2023-09-23T08:47:28.011 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:27.225+0000 7f3674503700 1 -- start start 2023-09-23T08:47:28.011 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:27.225+0000 7f3674503700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f366c1060e0 0x7f366c106500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:47:28.011 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:27.225+0000 7f3674503700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f366c106ad0 con 0x7f366c1060e0 2023-09-23T08:47:28.011 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:27.226+0000 7f367229f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f366c1060e0 0x7f366c106500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:47:28.011 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:27.226+0000 7f367229f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f366c1060e0 0x7f366c106500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33410/0 (socket says 172.21.15.82:33410) 2023-09-23T08:47:28.011 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:27.226+0000 7f367229f700 1 -- 172.21.15.82:0/2119901656 learned_addr learned my addr 172.21.15.82:0/2119901656 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:47:28.012 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:27.226+0000 7f367229f700 1 -- 172.21.15.82:0/2119901656 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f366c1072e0 con 0x7f366c1060e0 2023-09-23T08:47:28.012 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:27.227+0000 7f367229f700 1 --2- 172.21.15.82:0/2119901656 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f366c1060e0 0x7f366c106500 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f36680098a0 tx=0x7f3668009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99101bff7cfe3ee7 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:47:28.012 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:27.227+0000 7f367129d700 1 -- 172.21.15.82:0/2119901656 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3668004160 con 0x7f366c1060e0 2023-09-23T08:47:28.012 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:27.227+0000 7f367129d700 1 -- 172.21.15.82:0/2119901656 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f36680042c0 con 0x7f366c1060e0 2023-09-23T08:47:28.012 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:27.227+0000 7f367129d700 1 -- 172.21.15.82:0/2119901656 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f36680118e0 con 0x7f366c1060e0 2023-09-23T08:47:28.012 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:27.228+0000 7f3674503700 1 -- 172.21.15.82:0/2119901656 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f366c1060e0 msgr2=0x7f366c106500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:47:28.012 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:27.228+0000 7f3674503700 1 --2- 172.21.15.82:0/2119901656 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f366c1060e0 0x7f366c106500 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f36680098a0 tx=0x7f3668009bb0 comp rx=0 tx=0).stop 2023-09-23T08:47:28.012 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:27.228+0000 7f3674503700 1 -- 172.21.15.82:0/2119901656 shutdown_connections 2023-09-23T08:47:28.012 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:27.228+0000 7f3674503700 1 --2- 172.21.15.82:0/2119901656 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f366c1060e0 0x7f366c106500 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:47:28.012 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:27.228+0000 7f3674503700 1 -- 172.21.15.82:0/2119901656 >> 172.21.15.82:0/2119901656 conn(0x7f366c1016a0 msgr2=0x7f366c103ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:47:28.012 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:27.228+0000 7f3674503700 1 -- 172.21.15.82:0/2119901656 shutdown_connections 2023-09-23T08:47:28.013 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:27.228+0000 7f3674503700 1 -- 172.21.15.82:0/2119901656 wait complete. 2023-09-23T08:47:28.013 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:27.229+0000 7f3674503700 1 Processor -- start 2023-09-23T08:47:28.013 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:27.230+0000 7f3674503700 1 -- start start 2023-09-23T08:47:28.013 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:27.230+0000 7f3674503700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f366c1060e0 0x7f366c19bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:47:28.013 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:27.230+0000 7f3674503700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f366c19c520 con 0x7f366c1060e0 2023-09-23T08:47:28.013 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:27.230+0000 7f367229f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f366c1060e0 0x7f366c19bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:47:28.013 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:27.230+0000 7f367229f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f366c1060e0 0x7f366c19bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33418/0 (socket says 172.21.15.82:33418) 2023-09-23T08:47:28.013 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:27.230+0000 7f367229f700 1 -- 172.21.15.82:0/845810846 learned_addr learned my addr 172.21.15.82:0/845810846 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:47:28.013 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:27.231+0000 7f367229f700 1 -- 172.21.15.82:0/845810846 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3668009550 con 0x7f366c1060e0 2023-09-23T08:47:28.013 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:27.231+0000 7f367229f700 1 --2- 172.21.15.82:0/845810846 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f366c1060e0 0x7f366c19bfe0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3668006af0 tx=0x7f3668011ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:47:28.013 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:27.231+0000 7f36637fe700 1 -- 172.21.15.82:0/845810846 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f36680037d0 con 0x7f366c1060e0 2023-09-23T08:47:28.014 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:27.231+0000 7f36637fe700 1 -- 172.21.15.82:0/845810846 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f366801b440 con 0x7f366c1060e0 2023-09-23T08:47:28.014 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:27.231+0000 7f36637fe700 1 -- 172.21.15.82:0/845810846 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3668023400 con 0x7f366c1060e0 2023-09-23T08:47:28.014 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:27.231+0000 7f3674503700 1 -- 172.21.15.82:0/845810846 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f366c19c720 con 0x7f366c1060e0 2023-09-23T08:47:28.014 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:27.232+0000 7f3674503700 1 -- 172.21.15.82:0/845810846 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f366c19cb40 con 0x7f366c1060e0 2023-09-23T08:47:28.014 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:27.233+0000 7f3674503700 1 -- 172.21.15.82:0/845810846 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f366c061f50 con 0x7f366c1060e0 2023-09-23T08:47:28.014 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:27.233+0000 7f36637fe700 1 -- 172.21.15.82:0/845810846 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 12) v1 ==== 45148+0+0 (secure 0 0 0) 0x7f366801b5b0 con 0x7f366c1060e0 2023-09-23T08:47:28.014 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:27.233+0000 7f36637fe700 1 --2- 172.21.15.82:0/845810846 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f3658038160 0x7f365803a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:47:28.014 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:27.233+0000 7f36637fe700 1 -- 172.21.15.82:0/845810846 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f366804c0e0 con 0x7f366c1060e0 2023-09-23T08:47:28.014 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:27.234+0000 7f3671a9e700 1 --2- 172.21.15.82:0/845810846 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f3658038160 0x7f365803a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:47:28.014 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:27.234+0000 7f3671a9e700 1 --2- 172.21.15.82:0/845810846 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f3658038160 0x7f365803a620 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f365c006fd0 tx=0x7f365c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:47:28.014 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:27.239+0000 7f36637fe700 1 -- 172.21.15.82:0/845810846 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f366801b8d0 con 0x7f366c1060e0 2023-09-23T08:47:28.015 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:27.463+0000 7f3674503700 1 -- 172.21.15.82:0/845810846 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f366c10a510 con 0x7f366c1060e0 2023-09-23T08:47:28.015 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:27.464+0000 7f36637fe700 1 -- 172.21.15.82:0/845810846 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f366800b3e0 con 0x7f366c1060e0 2023-09-23T08:47:28.015 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:27.466+0000 7f3674503700 1 -- 172.21.15.82:0/845810846 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f3658038160 msgr2=0x7f365803a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:47:28.015 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:27.466+0000 7f3674503700 1 --2- 172.21.15.82:0/845810846 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f3658038160 0x7f365803a620 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f365c006fd0 tx=0x7f365c006e40 comp rx=0 tx=0).stop 2023-09-23T08:47:28.015 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:27.466+0000 7f3674503700 1 -- 172.21.15.82:0/845810846 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f366c1060e0 msgr2=0x7f366c19bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:47:28.015 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:27.466+0000 7f3674503700 1 --2- 172.21.15.82:0/845810846 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f366c1060e0 0x7f366c19bfe0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3668006af0 tx=0x7f3668011ed0 comp rx=0 tx=0).stop 2023-09-23T08:47:28.015 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:27.466+0000 7f3674503700 1 -- 172.21.15.82:0/845810846 shutdown_connections 2023-09-23T08:47:28.015 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:27.466+0000 7f3674503700 1 --2- 172.21.15.82:0/845810846 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f3658038160 0x7f365803a620 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:47:28.015 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:27.466+0000 7f3674503700 1 --2- 172.21.15.82:0/845810846 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f366c1060e0 0x7f366c19bfe0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:47:28.015 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:27.466+0000 7f3674503700 1 -- 172.21.15.82:0/845810846 >> 172.21.15.82:0/845810846 conn(0x7f366c1016a0 msgr2=0x7f366c102d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:47:28.015 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:27.467+0000 7f3674503700 1 -- 172.21.15.82:0/845810846 shutdown_connections 2023-09-23T08:47:28.016 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:27.467+0000 7f3674503700 1 -- 172.21.15.82:0/845810846 wait complete. 2023-09-23T08:47:28.027 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-09-23T08:47:28.027 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout disabled 2023-09-23T08:47:28.044 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-09-23T08:47:28.044 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout inactive 2023-09-23T08:47:28.044 INFO:teuthology.orchestra.run.smithi082.stdout:firewalld.service is not enabled 2023-09-23T08:47:28.044 INFO:teuthology.orchestra.run.smithi082.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2023-09-23T08:47:28.046 INFO:teuthology.orchestra.run.smithi082.stdout:Ceph Dashboard is now available at: 2023-09-23T08:47:28.046 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:47:28.046 INFO:teuthology.orchestra.run.smithi082.stdout: URL: https://smithi082.front.sepia.ceph.com:8443/ 2023-09-23T08:47:28.047 INFO:teuthology.orchestra.run.smithi082.stdout: User: admin 2023-09-23T08:47:28.047 INFO:teuthology.orchestra.run.smithi082.stdout: Password: zbr95rq18y 2023-09-23T08:47:28.047 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:47:28.047 INFO:teuthology.orchestra.run.smithi082.stdout:Saving cluster configuration to /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/config directory 2023-09-23T08:47:28.047 INFO:teuthology.orchestra.run.smithi082.stdout:Enabling autotune for osd_memory_target 2023-09-23T08:47:29.487 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:28.752+0000 7ff263cd6700 1 Processor -- start 2023-09-23T08:47:29.488 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:28.752+0000 7ff263cd6700 1 -- start start 2023-09-23T08:47:29.488 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:28.752+0000 7ff263cd6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff25c07ad10 0x7ff25c079170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:47:29.488 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:28.752+0000 7ff263cd6700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff25c079740 con 0x7ff25c07ad10 2023-09-23T08:47:29.488 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:28.752+0000 7ff261a72700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff25c07ad10 0x7ff25c079170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:47:29.488 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:28.753+0000 7ff261a72700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff25c07ad10 0x7ff25c079170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33430/0 (socket says 172.21.15.82:33430) 2023-09-23T08:47:29.488 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:28.753+0000 7ff261a72700 1 -- 172.21.15.82:0/2956391065 learned_addr learned my addr 172.21.15.82:0/2956391065 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:47:29.488 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:28.753+0000 7ff261a72700 1 -- 172.21.15.82:0/2956391065 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff25c079880 con 0x7ff25c07ad10 2023-09-23T08:47:29.488 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:28.753+0000 7ff261a72700 1 --2- 172.21.15.82:0/2956391065 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff25c07ad10 0x7ff25c079170 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff2580098a0 tx=0x7ff258009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=915e1e2baea75bba server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:47:29.488 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:28.753+0000 7ff260a70700 1 -- 172.21.15.82:0/2956391065 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff258004160 con 0x7ff25c07ad10 2023-09-23T08:47:29.489 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:28.753+0000 7ff260a70700 1 -- 172.21.15.82:0/2956391065 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff2580042c0 con 0x7ff25c07ad10 2023-09-23T08:47:29.489 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:28.753+0000 7ff260a70700 1 -- 172.21.15.82:0/2956391065 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff2580118e0 con 0x7ff25c07ad10 2023-09-23T08:47:29.489 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:28.754+0000 7ff263cd6700 1 -- 172.21.15.82:0/2956391065 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff25c07ad10 msgr2=0x7ff25c079170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:47:29.489 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:28.754+0000 7ff263cd6700 1 --2- 172.21.15.82:0/2956391065 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff25c07ad10 0x7ff25c079170 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff2580098a0 tx=0x7ff258009bb0 comp rx=0 tx=0).stop 2023-09-23T08:47:29.489 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:28.754+0000 7ff263cd6700 1 -- 172.21.15.82:0/2956391065 shutdown_connections 2023-09-23T08:47:29.489 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:28.754+0000 7ff263cd6700 1 --2- 172.21.15.82:0/2956391065 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff25c07ad10 0x7ff25c079170 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:47:29.489 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:28.754+0000 7ff263cd6700 1 -- 172.21.15.82:0/2956391065 >> 172.21.15.82:0/2956391065 conn(0x7ff25c1016a0 msgr2=0x7ff25c103ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:47:29.489 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:28.754+0000 7ff263cd6700 1 -- 172.21.15.82:0/2956391065 shutdown_connections 2023-09-23T08:47:29.489 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:28.754+0000 7ff263cd6700 1 -- 172.21.15.82:0/2956391065 wait complete. 2023-09-23T08:47:29.489 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:28.755+0000 7ff263cd6700 1 Processor -- start 2023-09-23T08:47:29.489 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:28.755+0000 7ff263cd6700 1 -- start start 2023-09-23T08:47:29.489 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:28.756+0000 7ff263cd6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff25c07ad10 0x7ff25c19bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:47:29.490 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:28.756+0000 7ff263cd6700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff25c19c480 con 0x7ff25c07ad10 2023-09-23T08:47:29.490 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:28.756+0000 7ff261a72700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff25c07ad10 0x7ff25c19bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:47:29.490 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:28.756+0000 7ff261a72700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff25c07ad10 0x7ff25c19bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33442/0 (socket says 172.21.15.82:33442) 2023-09-23T08:47:29.490 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:28.756+0000 7ff261a72700 1 -- 172.21.15.82:0/245150862 learned_addr learned my addr 172.21.15.82:0/245150862 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:47:29.490 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:28.756+0000 7ff261a72700 1 -- 172.21.15.82:0/245150862 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff258009550 con 0x7ff25c07ad10 2023-09-23T08:47:29.490 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:28.756+0000 7ff261a72700 1 --2- 172.21.15.82:0/245150862 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff25c07ad10 0x7ff25c19bf40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff258003e30 tx=0x7ff2580119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:47:29.490 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:28.757+0000 7ff252ffd700 1 -- 172.21.15.82:0/245150862 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff2580036a0 con 0x7ff25c07ad10 2023-09-23T08:47:29.490 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:28.757+0000 7ff263cd6700 1 -- 172.21.15.82:0/245150862 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff25c19c680 con 0x7ff25c07ad10 2023-09-23T08:47:29.490 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:28.757+0000 7ff252ffd700 1 -- 172.21.15.82:0/245150862 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff25801b440 con 0x7ff25c07ad10 2023-09-23T08:47:29.490 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:28.757+0000 7ff252ffd700 1 -- 172.21.15.82:0/245150862 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff258023400 con 0x7ff25c07ad10 2023-09-23T08:47:29.490 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:28.757+0000 7ff263cd6700 1 -- 172.21.15.82:0/245150862 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff25c19caa0 con 0x7ff25c07ad10 2023-09-23T08:47:29.491 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:28.758+0000 7ff252ffd700 1 -- 172.21.15.82:0/245150862 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) v1 ==== 45191+0+0 (secure 0 0 0) 0x7ff25801b5b0 con 0x7ff25c07ad10 2023-09-23T08:47:29.491 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:28.758+0000 7ff263cd6700 1 -- 172.21.15.82:0/245150862 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff25c061f50 con 0x7ff25c07ad10 2023-09-23T08:47:29.491 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:28.758+0000 7ff252ffd700 1 --2- 172.21.15.82:0/245150862 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7ff248038200 0x7ff24803a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:47:29.491 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:28.758+0000 7ff252ffd700 1 -- 172.21.15.82:0/245150862 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7ff25804c1b0 con 0x7ff25c07ad10 2023-09-23T08:47:29.491 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:28.759+0000 7ff261271700 1 --2- 172.21.15.82:0/245150862 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7ff248038200 0x7ff24803a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:47:29.491 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:28.759+0000 7ff261271700 1 --2- 172.21.15.82:0/245150862 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7ff248038200 0x7ff24803a6c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff24c006fd0 tx=0x7ff24c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:47:29.491 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:28.763+0000 7ff252ffd700 1 -- 172.21.15.82:0/245150862 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7ff258019840 con 0x7ff25c07ad10 2023-09-23T08:47:29.491 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:28.963+0000 7ff263cd6700 1 -- 172.21.15.82:0/245150862 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7ff25c19f4e0 con 0x7ff25c07ad10 2023-09-23T08:47:29.491 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:28.963+0000 7ff252ffd700 1 -- 172.21.15.82:0/245150862 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7ff258019840 con 0x7ff25c07ad10 2023-09-23T08:47:29.491 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:28.965+0000 7ff263cd6700 1 -- 172.21.15.82:0/245150862 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7ff248038200 msgr2=0x7ff24803a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:47:29.491 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:28.965+0000 7ff263cd6700 1 --2- 172.21.15.82:0/245150862 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7ff248038200 0x7ff24803a6c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff24c006fd0 tx=0x7ff24c006e40 comp rx=0 tx=0).stop 2023-09-23T08:47:29.492 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:28.965+0000 7ff263cd6700 1 -- 172.21.15.82:0/245150862 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff25c07ad10 msgr2=0x7ff25c19bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:47:29.492 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:28.965+0000 7ff263cd6700 1 --2- 172.21.15.82:0/245150862 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff25c07ad10 0x7ff25c19bf40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff258003e30 tx=0x7ff2580119a0 comp rx=0 tx=0).stop 2023-09-23T08:47:29.492 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:28.965+0000 7ff263cd6700 1 -- 172.21.15.82:0/245150862 shutdown_connections 2023-09-23T08:47:29.492 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:28.965+0000 7ff263cd6700 1 --2- 172.21.15.82:0/245150862 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7ff248038200 0x7ff24803a6c0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:47:29.492 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:28.965+0000 7ff263cd6700 1 --2- 172.21.15.82:0/245150862 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff25c07ad10 0x7ff25c19bf40 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:47:29.492 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:28.966+0000 7ff263cd6700 1 -- 172.21.15.82:0/245150862 >> 172.21.15.82:0/245150862 conn(0x7ff25c1016a0 msgr2=0x7ff25c102470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:47:29.492 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:28.966+0000 7ff263cd6700 1 -- 172.21.15.82:0/245150862 shutdown_connections 2023-09-23T08:47:29.492 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:28.966+0000 7ff263cd6700 1 -- 172.21.15.82:0/245150862 wait complete. 2023-09-23T08:47:29.754 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:29 smithi082 ceph-mon[97694]: mgrmap e13: x(active, since 6s) 2023-09-23T08:47:30.766 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:30.018+0000 7f454c699700 1 Processor -- start 2023-09-23T08:47:30.766 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:30.018+0000 7f454c699700 1 -- start start 2023-09-23T08:47:30.766 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:30.019+0000 7f454c699700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f454407ad10 0x7f4544079170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:47:30.766 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:30.019+0000 7f454c699700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4544079740 con 0x7f454407ad10 2023-09-23T08:47:30.766 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:30.019+0000 7f454a435700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f454407ad10 0x7f4544079170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:47:30.766 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:30.019+0000 7f454a435700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f454407ad10 0x7f4544079170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33448/0 (socket says 172.21.15.82:33448) 2023-09-23T08:47:30.766 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:30.019+0000 7f454a435700 1 -- 172.21.15.82:0/3868336346 learned_addr learned my addr 172.21.15.82:0/3868336346 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:47:30.767 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:30.019+0000 7f454a435700 1 -- 172.21.15.82:0/3868336346 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4544079880 con 0x7f454407ad10 2023-09-23T08:47:30.767 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:30.020+0000 7f454a435700 1 --2- 172.21.15.82:0/3868336346 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f454407ad10 0x7f4544079170 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f45400098a0 tx=0x7f4540009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e21072d9c38a3964 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:47:30.767 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:30.020+0000 7f4549433700 1 -- 172.21.15.82:0/3868336346 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4540004160 con 0x7f454407ad10 2023-09-23T08:47:30.767 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:30.020+0000 7f4549433700 1 -- 172.21.15.82:0/3868336346 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f45400042c0 con 0x7f454407ad10 2023-09-23T08:47:30.767 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:30.020+0000 7f4549433700 1 -- 172.21.15.82:0/3868336346 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f45400118e0 con 0x7f454407ad10 2023-09-23T08:47:30.767 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:30.020+0000 7f454c699700 1 -- 172.21.15.82:0/3868336346 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f454407ad10 msgr2=0x7f4544079170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:47:30.767 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:30.020+0000 7f454c699700 1 --2- 172.21.15.82:0/3868336346 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f454407ad10 0x7f4544079170 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f45400098a0 tx=0x7f4540009bb0 comp rx=0 tx=0).stop 2023-09-23T08:47:30.767 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:30.021+0000 7f454c699700 1 -- 172.21.15.82:0/3868336346 shutdown_connections 2023-09-23T08:47:30.767 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:30.021+0000 7f454c699700 1 --2- 172.21.15.82:0/3868336346 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f454407ad10 0x7f4544079170 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:47:30.767 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:30.021+0000 7f454c699700 1 -- 172.21.15.82:0/3868336346 >> 172.21.15.82:0/3868336346 conn(0x7f45441016a0 msgr2=0x7f4544103ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:47:30.768 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:30.021+0000 7f454c699700 1 -- 172.21.15.82:0/3868336346 shutdown_connections 2023-09-23T08:47:30.768 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:30.021+0000 7f454c699700 1 -- 172.21.15.82:0/3868336346 wait complete. 2023-09-23T08:47:30.768 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:30.022+0000 7f454c699700 1 Processor -- start 2023-09-23T08:47:30.768 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:30.022+0000 7f454c699700 1 -- start start 2023-09-23T08:47:30.768 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:30.022+0000 7f454c699700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f454407ad10 0x7f454419bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:47:30.768 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:30.022+0000 7f454c699700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f454419c480 con 0x7f454407ad10 2023-09-23T08:47:30.768 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:30.022+0000 7f454a435700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f454407ad10 0x7f454419bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:47:30.768 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:30.022+0000 7f454a435700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f454407ad10 0x7f454419bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33460/0 (socket says 172.21.15.82:33460) 2023-09-23T08:47:30.768 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:30.022+0000 7f454a435700 1 -- 172.21.15.82:0/2218876652 learned_addr learned my addr 172.21.15.82:0/2218876652 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:47:30.768 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:30.023+0000 7f454a435700 1 -- 172.21.15.82:0/2218876652 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4540009550 con 0x7f454407ad10 2023-09-23T08:47:30.768 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:30.023+0000 7f454a435700 1 --2- 172.21.15.82:0/2218876652 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f454407ad10 0x7f454419bf40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4540003e30 tx=0x7f45400119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:47:30.769 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:30.023+0000 7f453b7fe700 1 -- 172.21.15.82:0/2218876652 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f45400036a0 con 0x7f454407ad10 2023-09-23T08:47:30.769 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:30.023+0000 7f454c699700 1 -- 172.21.15.82:0/2218876652 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f454419c680 con 0x7f454407ad10 2023-09-23T08:47:30.769 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:30.023+0000 7f453b7fe700 1 -- 172.21.15.82:0/2218876652 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f454001b440 con 0x7f454407ad10 2023-09-23T08:47:30.769 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:30.023+0000 7f453b7fe700 1 -- 172.21.15.82:0/2218876652 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4540023400 con 0x7f454407ad10 2023-09-23T08:47:30.769 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:30.023+0000 7f454c699700 1 -- 172.21.15.82:0/2218876652 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f454419caa0 con 0x7f454407ad10 2023-09-23T08:47:30.769 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:30.024+0000 7f453b7fe700 1 -- 172.21.15.82:0/2218876652 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) v1 ==== 45191+0+0 (secure 0 0 0) 0x7f454001b5b0 con 0x7f454407ad10 2023-09-23T08:47:30.769 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:30.024+0000 7f454c699700 1 -- 172.21.15.82:0/2218876652 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4544061f50 con 0x7f454407ad10 2023-09-23T08:47:30.769 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:30.025+0000 7f453b7fe700 1 --2- 172.21.15.82:0/2218876652 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f4530038200 0x7f453003a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:47:30.769 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:30.025+0000 7f453b7fe700 1 -- 172.21.15.82:0/2218876652 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f454004c1b0 con 0x7f454407ad10 2023-09-23T08:47:30.769 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:30.025+0000 7f4549c34700 1 --2- 172.21.15.82:0/2218876652 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f4530038200 0x7f453003a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:47:30.769 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:30.026+0000 7f4549c34700 1 --2- 172.21.15.82:0/2218876652 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f4530038200 0x7f453003a6c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4534006fd0 tx=0x7f4534006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:47:30.770 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:30.030+0000 7f453b7fe700 1 -- 172.21.15.82:0/2218876652 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f4540019840 con 0x7f454407ad10 2023-09-23T08:47:30.770 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:30.336+0000 7f454c699700 1 -- 172.21.15.82:0/2218876652 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7f454419f4e0 con 0x7f454407ad10 2023-09-23T08:47:30.770 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:30.338+0000 7f453b7fe700 1 -- 172.21.15.82:0/2218876652 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) v1 ==== 153+0+0 (secure 0 0 0) 0x7f4540019840 con 0x7f454407ad10 2023-09-23T08:47:30.770 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:30.341+0000 7f454c699700 1 -- 172.21.15.82:0/2218876652 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f4530038200 msgr2=0x7f453003a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:47:30.770 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:30.341+0000 7f454c699700 1 --2- 172.21.15.82:0/2218876652 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f4530038200 0x7f453003a6c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4534006fd0 tx=0x7f4534006e40 comp rx=0 tx=0).stop 2023-09-23T08:47:30.770 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:30.341+0000 7f454c699700 1 -- 172.21.15.82:0/2218876652 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f454407ad10 msgr2=0x7f454419bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:47:30.770 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:30.341+0000 7f454c699700 1 --2- 172.21.15.82:0/2218876652 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f454407ad10 0x7f454419bf40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4540003e30 tx=0x7f45400119a0 comp rx=0 tx=0).stop 2023-09-23T08:47:30.770 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:30.341+0000 7f454c699700 1 -- 172.21.15.82:0/2218876652 shutdown_connections 2023-09-23T08:47:30.770 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:30.341+0000 7f454c699700 1 --2- 172.21.15.82:0/2218876652 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f4530038200 0x7f453003a6c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:47:30.770 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:30.341+0000 7f454c699700 1 --2- 172.21.15.82:0/2218876652 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f454407ad10 0x7f454419bf40 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:47:30.770 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:30.341+0000 7f454c699700 1 -- 172.21.15.82:0/2218876652 >> 172.21.15.82:0/2218876652 conn(0x7f45441016a0 msgr2=0x7f4544102470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:47:30.771 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:30.341+0000 7f454c699700 1 -- 172.21.15.82:0/2218876652 shutdown_connections 2023-09-23T08:47:30.771 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2023-09-23T08:47:30.341+0000 7f454c699700 1 -- 172.21.15.82:0/2218876652 wait complete. 2023-09-23T08:47:30.771 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2023-09-23T08:47:30.771 INFO:teuthology.orchestra.run.smithi082.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2023-09-23T08:47:30.771 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:47:30.771 INFO:teuthology.orchestra.run.smithi082.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2023-09-23T08:47:30.771 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:47:30.771 INFO:teuthology.orchestra.run.smithi082.stdout:Or, if you are only running a single cluster on this host: 2023-09-23T08:47:30.771 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:47:30.771 INFO:teuthology.orchestra.run.smithi082.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2023-09-23T08:47:30.771 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:47:30.771 INFO:teuthology.orchestra.run.smithi082.stdout:Please consider enabling telemetry to help improve Ceph: 2023-09-23T08:47:30.771 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:47:30.772 INFO:teuthology.orchestra.run.smithi082.stdout: ceph telemetry on 2023-09-23T08:47:30.772 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:47:30.772 INFO:teuthology.orchestra.run.smithi082.stdout:For more information see: 2023-09-23T08:47:30.772 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:47:30.772 INFO:teuthology.orchestra.run.smithi082.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2023-09-23T08:47:30.772 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:47:30.772 INFO:teuthology.orchestra.run.smithi082.stdout:Bootstrap complete. 2023-09-23T08:47:30.824 INFO:tasks.cephadm:Fetching config... 2023-09-23T08:47:30.825 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-09-23T08:47:30.825 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2023-09-23T08:47:30.867 INFO:tasks.cephadm:Fetching client.admin keyring... 2023-09-23T08:47:30.868 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-09-23T08:47:30.868 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2023-09-23T08:47:30.956 INFO:tasks.cephadm:Fetching mon keyring... 2023-09-23T08:47:30.956 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-09-23T08:47:30.956 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.a/keyring of=/dev/stdout 2023-09-23T08:47:31.066 INFO:tasks.cephadm:Fetching pub ssh key... 2023-09-23T08:47:31.066 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-09-23T08:47:31.066 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2023-09-23T08:47:31.150 INFO:tasks.cephadm:Installing pub ssh key for root users... 2023-09-23T08:47:31.150 DEBUG:teuthology.orchestra.run.smithi082:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCzzW6iK/yrcs3Y9Npy5EskbsTisoajkpBBUEg6fPrHw2RLLdNMEWFdptxCwYufRZreH3VuYzzI6fjUp0QextMPeihmCrHLLp9XboQZ3UxIHNpwyOzs4s4CGQw5PdLU1QgyXBqvxSIaf69/XR+WD3Ehq6hM1iqb+KJJ9PKULFyOnORzfQIfoZwoJuLblqTTr53JADLSTxAjvynFnqTLnCIjaZNmLyI4MI6rz1Gcq0pyCu9X2KXGdOV1GecAQgQimfECU8A951fl5XcMSPMNjnTZk5B4Bjfl3halItWUBj0rV06Ze2TOd1lByrpvrmwa9+YtXhvYogUPCh6cfK1KSYzPd55vmvpFiN9P77hWN7+G0hTr1yl0QD3SsoJ3gDdOECB4AsmOZy+flkDk7D6H1afPwUGi/G9G+EzZbNQt7ZYMsPEOY3sKmXFD4yDWLBRTvZxVxE34G/fnSe0Th+a1yS0b1E1F+0tWc/cR8ewzQilkryINgjPR9hbLLrKV9daWvt8= ceph-8926e286-59ed-11ee-8db4-212e2dc638e7' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-09-23T08:47:31.290 INFO:teuthology.orchestra.run.smithi082.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCzzW6iK/yrcs3Y9Npy5EskbsTisoajkpBBUEg6fPrHw2RLLdNMEWFdptxCwYufRZreH3VuYzzI6fjUp0QextMPeihmCrHLLp9XboQZ3UxIHNpwyOzs4s4CGQw5PdLU1QgyXBqvxSIaf69/XR+WD3Ehq6hM1iqb+KJJ9PKULFyOnORzfQIfoZwoJuLblqTTr53JADLSTxAjvynFnqTLnCIjaZNmLyI4MI6rz1Gcq0pyCu9X2KXGdOV1GecAQgQimfECU8A951fl5XcMSPMNjnTZk5B4Bjfl3halItWUBj0rV06Ze2TOd1lByrpvrmwa9+YtXhvYogUPCh6cfK1KSYzPd55vmvpFiN9P77hWN7+G0hTr1yl0QD3SsoJ3gDdOECB4AsmOZy+flkDk7D6H1afPwUGi/G9G+EzZbNQt7ZYMsPEOY3sKmXFD4yDWLBRTvZxVxE34G/fnSe0Th+a1yS0b1E1F+0tWc/cR8ewzQilkryINgjPR9hbLLrKV9daWvt8= ceph-8926e286-59ed-11ee-8db4-212e2dc638e7 2023-09-23T08:47:31.323 DEBUG:teuthology.orchestra.run.smithi135:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCzzW6iK/yrcs3Y9Npy5EskbsTisoajkpBBUEg6fPrHw2RLLdNMEWFdptxCwYufRZreH3VuYzzI6fjUp0QextMPeihmCrHLLp9XboQZ3UxIHNpwyOzs4s4CGQw5PdLU1QgyXBqvxSIaf69/XR+WD3Ehq6hM1iqb+KJJ9PKULFyOnORzfQIfoZwoJuLblqTTr53JADLSTxAjvynFnqTLnCIjaZNmLyI4MI6rz1Gcq0pyCu9X2KXGdOV1GecAQgQimfECU8A951fl5XcMSPMNjnTZk5B4Bjfl3halItWUBj0rV06Ze2TOd1lByrpvrmwa9+YtXhvYogUPCh6cfK1KSYzPd55vmvpFiN9P77hWN7+G0hTr1yl0QD3SsoJ3gDdOECB4AsmOZy+flkDk7D6H1afPwUGi/G9G+EzZbNQt7ZYMsPEOY3sKmXFD4yDWLBRTvZxVxE34G/fnSe0Th+a1yS0b1E1F+0tWc/cR8ewzQilkryINgjPR9hbLLrKV9daWvt8= ceph-8926e286-59ed-11ee-8db4-212e2dc638e7' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-09-23T08:47:31.429 INFO:teuthology.orchestra.run.smithi135.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCzzW6iK/yrcs3Y9Npy5EskbsTisoajkpBBUEg6fPrHw2RLLdNMEWFdptxCwYufRZreH3VuYzzI6fjUp0QextMPeihmCrHLLp9XboQZ3UxIHNpwyOzs4s4CGQw5PdLU1QgyXBqvxSIaf69/XR+WD3Ehq6hM1iqb+KJJ9PKULFyOnORzfQIfoZwoJuLblqTTr53JADLSTxAjvynFnqTLnCIjaZNmLyI4MI6rz1Gcq0pyCu9X2KXGdOV1GecAQgQimfECU8A951fl5XcMSPMNjnTZk5B4Bjfl3halItWUBj0rV06Ze2TOd1lByrpvrmwa9+YtXhvYogUPCh6cfK1KSYzPd55vmvpFiN9P77hWN7+G0hTr1yl0QD3SsoJ3gDdOECB4AsmOZy+flkDk7D6H1afPwUGi/G9G+EzZbNQt7ZYMsPEOY3sKmXFD4yDWLBRTvZxVxE34G/fnSe0Th+a1yS0b1E1F+0tWc/cR8ewzQilkryINgjPR9hbLLrKV9daWvt8= ceph-8926e286-59ed-11ee-8db4-212e2dc638e7 2023-09-23T08:47:31.459 DEBUG:teuthology.orchestra.run.smithi161:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCzzW6iK/yrcs3Y9Npy5EskbsTisoajkpBBUEg6fPrHw2RLLdNMEWFdptxCwYufRZreH3VuYzzI6fjUp0QextMPeihmCrHLLp9XboQZ3UxIHNpwyOzs4s4CGQw5PdLU1QgyXBqvxSIaf69/XR+WD3Ehq6hM1iqb+KJJ9PKULFyOnORzfQIfoZwoJuLblqTTr53JADLSTxAjvynFnqTLnCIjaZNmLyI4MI6rz1Gcq0pyCu9X2KXGdOV1GecAQgQimfECU8A951fl5XcMSPMNjnTZk5B4Bjfl3halItWUBj0rV06Ze2TOd1lByrpvrmwa9+YtXhvYogUPCh6cfK1KSYzPd55vmvpFiN9P77hWN7+G0hTr1yl0QD3SsoJ3gDdOECB4AsmOZy+flkDk7D6H1afPwUGi/G9G+EzZbNQt7ZYMsPEOY3sKmXFD4yDWLBRTvZxVxE34G/fnSe0Th+a1yS0b1E1F+0tWc/cR8ewzQilkryINgjPR9hbLLrKV9daWvt8= ceph-8926e286-59ed-11ee-8db4-212e2dc638e7' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-09-23T08:47:31.564 INFO:teuthology.orchestra.run.smithi161.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCzzW6iK/yrcs3Y9Npy5EskbsTisoajkpBBUEg6fPrHw2RLLdNMEWFdptxCwYufRZreH3VuYzzI6fjUp0QextMPeihmCrHLLp9XboQZ3UxIHNpwyOzs4s4CGQw5PdLU1QgyXBqvxSIaf69/XR+WD3Ehq6hM1iqb+KJJ9PKULFyOnORzfQIfoZwoJuLblqTTr53JADLSTxAjvynFnqTLnCIjaZNmLyI4MI6rz1Gcq0pyCu9X2KXGdOV1GecAQgQimfECU8A951fl5XcMSPMNjnTZk5B4Bjfl3halItWUBj0rV06Ze2TOd1lByrpvrmwa9+YtXhvYogUPCh6cfK1KSYzPd55vmvpFiN9P77hWN7+G0hTr1yl0QD3SsoJ3gDdOECB4AsmOZy+flkDk7D6H1afPwUGi/G9G+EzZbNQt7ZYMsPEOY3sKmXFD4yDWLBRTvZxVxE34G/fnSe0Th+a1yS0b1E1F+0tWc/cR8ewzQilkryINgjPR9hbLLrKV9daWvt8= ceph-8926e286-59ed-11ee-8db4-212e2dc638e7 2023-09-23T08:47:31.595 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2023-09-23T08:47:31.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:31 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/2218876652' entity='client.admin' 2023-09-23T08:47:32.629 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.a/config 2023-09-23T08:47:34.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:34.940+0000 7f3a56499700 1 -- 172.21.15.82:0/2469678462 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a50100430 msgr2=0x7f3a50100850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:47:34.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:34.940+0000 7f3a56499700 1 --2- 172.21.15.82:0/2469678462 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a50100430 0x7f3a50100850 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3a40009910 tx=0x7f3a40009c20 comp rx=0 tx=0).stop 2023-09-23T08:47:34.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:34.940+0000 7f3a56499700 1 -- 172.21.15.82:0/2469678462 shutdown_connections 2023-09-23T08:47:34.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:34.940+0000 7f3a56499700 1 --2- 172.21.15.82:0/2469678462 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a50100430 0x7f3a50100850 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:47:34.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:34.940+0000 7f3a56499700 1 -- 172.21.15.82:0/2469678462 >> 172.21.15.82:0/2469678462 conn(0x7f3a500fb9b0 msgr2=0x7f3a500fde10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:47:34.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:34.940+0000 7f3a56499700 1 -- 172.21.15.82:0/2469678462 shutdown_connections 2023-09-23T08:47:34.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:34.940+0000 7f3a56499700 1 -- 172.21.15.82:0/2469678462 wait complete. 2023-09-23T08:47:34.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:34.941+0000 7f3a56499700 1 Processor -- start 2023-09-23T08:47:34.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:34.941+0000 7f3a56499700 1 -- start start 2023-09-23T08:47:34.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:34.942+0000 7f3a56499700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a50100430 0x7f3a50195440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:47:34.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:34.942+0000 7f3a56499700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a50195980 con 0x7f3a50100430 2023-09-23T08:47:34.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:34.942+0000 7f3a4ffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a50100430 0x7f3a50195440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:47:34.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:34.942+0000 7f3a4ffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a50100430 0x7f3a50195440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43462/0 (socket says 172.21.15.82:43462) 2023-09-23T08:47:34.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:34.942+0000 7f3a4ffff700 1 -- 172.21.15.82:0/3620626475 learned_addr learned my addr 172.21.15.82:0/3620626475 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:47:34.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:34.942+0000 7f3a4ffff700 1 -- 172.21.15.82:0/3620626475 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a400095f0 con 0x7f3a50100430 2023-09-23T08:47:34.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:34.942+0000 7f3a4ffff700 1 --2- 172.21.15.82:0/3620626475 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a50100430 0x7f3a50195440 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3a40005950 tx=0x7f3a40005810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:47:34.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:34.943+0000 7f3a4d7fa700 1 -- 172.21.15.82:0/3620626475 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3a4000ba90 con 0x7f3a50100430 2023-09-23T08:47:34.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:34.943+0000 7f3a4d7fa700 1 -- 172.21.15.82:0/3620626475 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3a4000bbf0 con 0x7f3a50100430 2023-09-23T08:47:34.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:34.943+0000 7f3a56499700 1 -- 172.21.15.82:0/3620626475 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a50195b80 con 0x7f3a50100430 2023-09-23T08:47:34.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:34.943+0000 7f3a4d7fa700 1 -- 172.21.15.82:0/3620626475 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3a40017440 con 0x7f3a50100430 2023-09-23T08:47:34.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:34.943+0000 7f3a56499700 1 -- 172.21.15.82:0/3620626475 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a50196020 con 0x7f3a50100430 2023-09-23T08:47:34.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:34.944+0000 7f3a4d7fa700 1 -- 172.21.15.82:0/3620626475 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) v1 ==== 45191+0+0 (secure 0 0 0) 0x7f3a4000f460 con 0x7f3a50100430 2023-09-23T08:47:34.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:34.944+0000 7f3a56499700 1 -- 172.21.15.82:0/3620626475 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a5018edf0 con 0x7f3a50100430 2023-09-23T08:47:34.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:34.944+0000 7f3a4d7fa700 1 --2- 172.21.15.82:0/3620626475 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f3a38038200 0x7f3a3803a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:47:34.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:34.944+0000 7f3a4d7fa700 1 -- 172.21.15.82:0/3620626475 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f3a4004c3d0 con 0x7f3a50100430 2023-09-23T08:47:34.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:34.945+0000 7f3a4f7fe700 1 --2- 172.21.15.82:0/3620626475 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f3a38038200 0x7f3a3803a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:47:34.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:34.945+0000 7f3a4f7fe700 1 --2- 172.21.15.82:0/3620626475 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f3a38038200 0x7f3a3803a6c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3a44006fd0 tx=0x7f3a44006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:47:34.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:34.949+0000 7f3a4d7fa700 1 -- 172.21.15.82:0/3620626475 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f3a4002ad30 con 0x7f3a50100430 2023-09-23T08:47:35.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:35.147+0000 7f3a56499700 1 -- 172.21.15.82:0/3620626475 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7f3a50106030 con 0x7f3a50100430 2023-09-23T08:47:35.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:35.153+0000 7f3a4d7fa700 1 -- 172.21.15.82:0/3620626475 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7f3a50106030 con 0x7f3a50100430 2023-09-23T08:47:35.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:35.155+0000 7f3a56499700 1 -- 172.21.15.82:0/3620626475 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f3a38038200 msgr2=0x7f3a3803a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:47:35.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:35.155+0000 7f3a56499700 1 --2- 172.21.15.82:0/3620626475 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f3a38038200 0x7f3a3803a6c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3a44006fd0 tx=0x7f3a44006e40 comp rx=0 tx=0).stop 2023-09-23T08:47:35.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:35.155+0000 7f3a56499700 1 -- 172.21.15.82:0/3620626475 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a50100430 msgr2=0x7f3a50195440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:47:35.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:35.155+0000 7f3a56499700 1 --2- 172.21.15.82:0/3620626475 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a50100430 0x7f3a50195440 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3a40005950 tx=0x7f3a40005810 comp rx=0 tx=0).stop 2023-09-23T08:47:35.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:35.156+0000 7f3a56499700 1 -- 172.21.15.82:0/3620626475 shutdown_connections 2023-09-23T08:47:35.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:35.156+0000 7f3a56499700 1 --2- 172.21.15.82:0/3620626475 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f3a38038200 0x7f3a3803a6c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:47:35.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:35.156+0000 7f3a56499700 1 --2- 172.21.15.82:0/3620626475 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a50100430 0x7f3a50195440 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:47:35.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:35.156+0000 7f3a56499700 1 -- 172.21.15.82:0/3620626475 >> 172.21.15.82:0/3620626475 conn(0x7f3a500fb9b0 msgr2=0x7f3a500fc860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:47:35.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:35.156+0000 7f3a56499700 1 -- 172.21.15.82:0/3620626475 shutdown_connections 2023-09-23T08:47:35.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:35.156+0000 7f3a56499700 1 -- 172.21.15.82:0/3620626475 wait complete. 2023-09-23T08:47:35.608 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2023-09-23T08:47:35.608 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- ceph orch client-keyring set client.admin '*' --mode 0755 2023-09-23T08:47:35.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:35 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:47:35.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:35 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:47:35.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:35 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi082", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:47:35.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:35 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:47:35.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:35 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:47:35.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:35 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:47:35.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:35 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/3620626475' entity='client.admin' 2023-09-23T08:47:35.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:35 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:47:35.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:35 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:47:36.368 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.a/config 2023-09-23T08:47:37.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:37.964+0000 7f4643435700 1 -- 172.21.15.82:0/860022050 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f463c074950 msgr2=0x7f463c072db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:47:37.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:37.964+0000 7f4643435700 1 --2- 172.21.15.82:0/860022050 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f463c074950 0x7f463c072db0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4638009910 tx=0x7f4638009c20 comp rx=0 tx=0).stop 2023-09-23T08:47:37.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:37.964+0000 7f4643435700 1 -- 172.21.15.82:0/860022050 shutdown_connections 2023-09-23T08:47:37.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:37.964+0000 7f4643435700 1 --2- 172.21.15.82:0/860022050 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f463c074950 0x7f463c072db0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:47:37.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:37.964+0000 7f4643435700 1 -- 172.21.15.82:0/860022050 >> 172.21.15.82:0/860022050 conn(0x7f463c0fb9b0 msgr2=0x7f463c0fde10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:47:37.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:37.964+0000 7f4643435700 1 -- 172.21.15.82:0/860022050 shutdown_connections 2023-09-23T08:47:37.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:37.964+0000 7f4643435700 1 -- 172.21.15.82:0/860022050 wait complete. 2023-09-23T08:47:37.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:37.966+0000 7f4643435700 1 Processor -- start 2023-09-23T08:47:37.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:37.966+0000 7f4643435700 1 -- start start 2023-09-23T08:47:37.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:37.966+0000 7f4643435700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f463c074950 0x7f463c197680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:47:37.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:37.966+0000 7f4643435700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f463c197bc0 con 0x7f463c074950 2023-09-23T08:47:37.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:37.967+0000 7f46411d1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f463c074950 0x7f463c197680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:47:37.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:37.967+0000 7f46411d1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f463c074950 0x7f463c197680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43484/0 (socket says 172.21.15.82:43484) 2023-09-23T08:47:37.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:37.967+0000 7f46411d1700 1 -- 172.21.15.82:0/1350831111 learned_addr learned my addr 172.21.15.82:0/1350831111 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:47:37.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:37.967+0000 7f46411d1700 1 -- 172.21.15.82:0/1350831111 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46380095f0 con 0x7f463c074950 2023-09-23T08:47:37.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:37.967+0000 7f46411d1700 1 --2- 172.21.15.82:0/1350831111 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f463c074950 0x7f463c197680 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4638005950 tx=0x7f4638005810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:47:37.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:37.967+0000 7f46327fc700 1 -- 172.21.15.82:0/1350831111 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f463800ba90 con 0x7f463c074950 2023-09-23T08:47:37.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:37.968+0000 7f4643435700 1 -- 172.21.15.82:0/1350831111 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f463c197dc0 con 0x7f463c074950 2023-09-23T08:47:37.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:37.968+0000 7f46327fc700 1 -- 172.21.15.82:0/1350831111 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f463800bbf0 con 0x7f463c074950 2023-09-23T08:47:37.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:37.968+0000 7f46327fc700 1 -- 172.21.15.82:0/1350831111 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4638017440 con 0x7f463c074950 2023-09-23T08:47:37.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:37.968+0000 7f4643435700 1 -- 172.21.15.82:0/1350831111 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f463c198260 con 0x7f463c074950 2023-09-23T08:47:37.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:37.969+0000 7f46327fc700 1 -- 172.21.15.82:0/1350831111 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) v1 ==== 45191+0+0 (secure 0 0 0) 0x7f46380176b0 con 0x7f463c074950 2023-09-23T08:47:37.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:37.969+0000 7f4643435700 1 -- 172.21.15.82:0/1350831111 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f463c191000 con 0x7f463c074950 2023-09-23T08:47:37.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:37.969+0000 7f46327fc700 1 --2- 172.21.15.82:0/1350831111 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f4628038200 0x7f462803a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:47:37.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:37.969+0000 7f46327fc700 1 -- 172.21.15.82:0/1350831111 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f463804c340 con 0x7f463c074950 2023-09-23T08:47:37.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:37.969+0000 7f46409d0700 1 --2- 172.21.15.82:0/1350831111 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f4628038200 0x7f462803a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:47:37.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:37.970+0000 7f46409d0700 1 --2- 172.21.15.82:0/1350831111 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f4628038200 0x7f462803a6c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f462c006fd0 tx=0x7f462c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:47:37.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:37.974+0000 7f46327fc700 1 -- 172.21.15.82:0/1350831111 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f4638015db0 con 0x7f463c074950 2023-09-23T08:47:38.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:38.177+0000 7f4643435700 1 -- 172.21.15.82:0/1350831111 --> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7f463c02cd20 con 0x7f4628038200 2023-09-23T08:47:38.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:38.181+0000 7f46327fc700 1 -- 172.21.15.82:0/1350831111 <== mgr.14152 v2:172.21.15.82:6800/3698954311 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f463c02cd20 con 0x7f4628038200 2023-09-23T08:47:38.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:38.183+0000 7f4643435700 1 -- 172.21.15.82:0/1350831111 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f4628038200 msgr2=0x7f462803a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:47:38.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:38.183+0000 7f4643435700 1 --2- 172.21.15.82:0/1350831111 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f4628038200 0x7f462803a6c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f462c006fd0 tx=0x7f462c006e40 comp rx=0 tx=0).stop 2023-09-23T08:47:38.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:38.183+0000 7f4643435700 1 -- 172.21.15.82:0/1350831111 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f463c074950 msgr2=0x7f463c197680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:47:38.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:38.183+0000 7f4643435700 1 --2- 172.21.15.82:0/1350831111 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f463c074950 0x7f463c197680 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4638005950 tx=0x7f4638005810 comp rx=0 tx=0).stop 2023-09-23T08:47:38.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:38.183+0000 7f4643435700 1 -- 172.21.15.82:0/1350831111 shutdown_connections 2023-09-23T08:47:38.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:38.183+0000 7f4643435700 1 --2- 172.21.15.82:0/1350831111 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f4628038200 0x7f462803a6c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:47:38.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:38.183+0000 7f4643435700 1 --2- 172.21.15.82:0/1350831111 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f463c074950 0x7f463c197680 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:47:38.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:38.183+0000 7f4643435700 1 -- 172.21.15.82:0/1350831111 >> 172.21.15.82:0/1350831111 conn(0x7f463c0fb9b0 msgr2=0x7f463c0fc860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:47:38.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:38.183+0000 7f4643435700 1 -- 172.21.15.82:0/1350831111 shutdown_connections 2023-09-23T08:47:38.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:38.183+0000 7f4643435700 1 -- 172.21.15.82:0/1350831111 wait complete. 2023-09-23T08:47:38.744 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi135 2023-09-23T08:47:38.744 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-09-23T08:47:38.744 DEBUG:teuthology.orchestra.run.smithi135:> dd of=/etc/ceph/ceph.conf 2023-09-23T08:47:38.791 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-09-23T08:47:38.791 DEBUG:teuthology.orchestra.run.smithi135:> dd of=/etc/ceph/ceph.client.admin.keyring 2023-09-23T08:47:38.876 INFO:tasks.cephadm:Adding host smithi135 to orchestrator... 2023-09-23T08:47:38.876 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- ceph orch host add smithi135 2023-09-23T08:47:39.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:39 smithi082 ceph-mon[97694]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:47:39.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:39 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:47:39.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:39 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:47:39.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:39 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:47:39.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:39 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:47:39.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:39 smithi082 ceph-mon[97694]: Updating smithi082:/etc/ceph/ceph.conf 2023-09-23T08:47:39.633 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.a/config 2023-09-23T08:47:40.540 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:40 smithi082 ceph-mon[97694]: Updating smithi082:/var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/config/ceph.conf 2023-09-23T08:47:40.540 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:40 smithi082 ceph-mon[97694]: Updating smithi082:/etc/ceph/ceph.client.admin.keyring 2023-09-23T08:47:41.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:41.202+0000 7fc483dee700 1 -- 172.21.15.82:0/2594753782 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc47c072d50 msgr2=0x7fc47c073130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:47:41.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:41.202+0000 7fc483dee700 1 --2- 172.21.15.82:0/2594753782 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc47c072d50 0x7fc47c073130 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc478009910 tx=0x7fc478009c20 comp rx=0 tx=0).stop 2023-09-23T08:47:41.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:41.202+0000 7fc483dee700 1 -- 172.21.15.82:0/2594753782 shutdown_connections 2023-09-23T08:47:41.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:41.202+0000 7fc483dee700 1 --2- 172.21.15.82:0/2594753782 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc47c072d50 0x7fc47c073130 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:47:41.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:41.202+0000 7fc483dee700 1 -- 172.21.15.82:0/2594753782 >> 172.21.15.82:0/2594753782 conn(0x7fc47c0fbee0 msgr2=0x7fc47c0fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:47:41.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:41.203+0000 7fc483dee700 1 -- 172.21.15.82:0/2594753782 shutdown_connections 2023-09-23T08:47:41.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:41.203+0000 7fc483dee700 1 -- 172.21.15.82:0/2594753782 wait complete. 2023-09-23T08:47:41.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:41.204+0000 7fc483dee700 1 Processor -- start 2023-09-23T08:47:41.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:41.204+0000 7fc483dee700 1 -- start start 2023-09-23T08:47:41.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:41.204+0000 7fc483dee700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc47c072d50 0x7fc47c19d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:47:41.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:41.204+0000 7fc483dee700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc47c19dde0 con 0x7fc47c072d50 2023-09-23T08:47:41.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:41.204+0000 7fc481b8a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc47c072d50 0x7fc47c19d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:47:41.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:41.204+0000 7fc481b8a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc47c072d50 0x7fc47c19d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43512/0 (socket says 172.21.15.82:43512) 2023-09-23T08:47:41.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:41.204+0000 7fc481b8a700 1 -- 172.21.15.82:0/4147347288 learned_addr learned my addr 172.21.15.82:0/4147347288 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:47:41.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:41.205+0000 7fc481b8a700 1 -- 172.21.15.82:0/4147347288 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4780095f0 con 0x7fc47c072d50 2023-09-23T08:47:41.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:41.205+0000 7fc481b8a700 1 --2- 172.21.15.82:0/4147347288 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc47c072d50 0x7fc47c19d8a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc478006010 tx=0x7fc478004f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:47:41.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:41.205+0000 7fc472ffd700 1 -- 172.21.15.82:0/4147347288 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc47801d070 con 0x7fc47c072d50 2023-09-23T08:47:41.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:41.205+0000 7fc472ffd700 1 -- 172.21.15.82:0/4147347288 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc47800bdf0 con 0x7fc47c072d50 2023-09-23T08:47:41.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:41.205+0000 7fc472ffd700 1 -- 172.21.15.82:0/4147347288 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc478022d80 con 0x7fc47c072d50 2023-09-23T08:47:41.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:41.205+0000 7fc483dee700 1 -- 172.21.15.82:0/4147347288 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc47c19dfe0 con 0x7fc47c072d50 2023-09-23T08:47:41.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:41.205+0000 7fc483dee700 1 -- 172.21.15.82:0/4147347288 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc47c197890 con 0x7fc47c072d50 2023-09-23T08:47:41.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:41.206+0000 7fc472ffd700 1 -- 172.21.15.82:0/4147347288 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) v1 ==== 45191+0+0 (secure 0 0 0) 0x7fc478022570 con 0x7fc47c072d50 2023-09-23T08:47:41.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:41.206+0000 7fc483dee700 1 -- 172.21.15.82:0/4147347288 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc47c19e400 con 0x7fc47c072d50 2023-09-23T08:47:41.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:41.207+0000 7fc472ffd700 1 --2- 172.21.15.82:0/4147347288 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fc468038200 0x7fc46803a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:47:41.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:41.207+0000 7fc472ffd700 1 -- 172.21.15.82:0/4147347288 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fc47804c110 con 0x7fc47c072d50 2023-09-23T08:47:41.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:41.207+0000 7fc481389700 1 --2- 172.21.15.82:0/4147347288 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fc468038200 0x7fc46803a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:47:41.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:41.207+0000 7fc481389700 1 --2- 172.21.15.82:0/4147347288 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fc468038200 0x7fc46803a6c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc46c006fd0 tx=0x7fc46c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:47:41.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:41.212+0000 7fc472ffd700 1 -- 172.21.15.82:0/4147347288 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7fc47802bba0 con 0x7fc47c072d50 2023-09-23T08:47:41.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:41.413+0000 7fc483dee700 1 -- 172.21.15.82:0/4147347288 --> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi135", "target": ["mon-mgr", ""]}) v1 -- 0x7fc47c10c7d0 con 0x7fc468038200 2023-09-23T08:47:41.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:41 smithi082 ceph-mon[97694]: Updating smithi082:/var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/config/ceph.client.admin.keyring 2023-09-23T08:47:41.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:41 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:47:41.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:41 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:47:41.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:41 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:47:42.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:42 smithi082 ceph-mon[97694]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi135", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:47:43.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:43 smithi082 ceph-mon[97694]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:47:43.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:43 smithi082 ceph-mon[97694]: Deploying cephadm binary to smithi135 2023-09-23T08:47:44.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:44.578+0000 7fc472ffd700 1 -- 172.21.15.82:0/4147347288 <== mgr.14152 v2:172.21.15.82:6800/3698954311 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fc47c10c7d0 con 0x7fc468038200 2023-09-23T08:47:44.582 INFO:teuthology.orchestra.run.smithi082.stdout:Added host 'smithi135' with addr '172.21.15.135' 2023-09-23T08:47:44.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:44.580+0000 7fc483dee700 1 -- 172.21.15.82:0/4147347288 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fc468038200 msgr2=0x7fc46803a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:47:44.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:44.580+0000 7fc483dee700 1 --2- 172.21.15.82:0/4147347288 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fc468038200 0x7fc46803a6c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc46c006fd0 tx=0x7fc46c006e40 comp rx=0 tx=0).stop 2023-09-23T08:47:44.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:44.580+0000 7fc483dee700 1 -- 172.21.15.82:0/4147347288 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc47c072d50 msgr2=0x7fc47c19d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:47:44.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:44.580+0000 7fc483dee700 1 --2- 172.21.15.82:0/4147347288 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc47c072d50 0x7fc47c19d8a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc478006010 tx=0x7fc478004f40 comp rx=0 tx=0).stop 2023-09-23T08:47:44.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:44.581+0000 7fc483dee700 1 -- 172.21.15.82:0/4147347288 shutdown_connections 2023-09-23T08:47:44.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:44.581+0000 7fc483dee700 1 --2- 172.21.15.82:0/4147347288 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fc468038200 0x7fc46803a6c0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:47:44.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:44.581+0000 7fc483dee700 1 --2- 172.21.15.82:0/4147347288 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc47c072d50 0x7fc47c19d8a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:47:44.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:44.581+0000 7fc483dee700 1 -- 172.21.15.82:0/4147347288 >> 172.21.15.82:0/4147347288 conn(0x7fc47c0fbee0 msgr2=0x7fc47c106f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:47:44.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:44.581+0000 7fc483dee700 1 -- 172.21.15.82:0/4147347288 shutdown_connections 2023-09-23T08:47:44.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:44.581+0000 7fc483dee700 1 -- 172.21.15.82:0/4147347288 wait complete. 2023-09-23T08:47:45.018 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- ceph orch host ls --format=json 2023-09-23T08:47:45.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:45 smithi082 ceph-mon[97694]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:47:45.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:45 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:47:45.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:45 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:47:45.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:45 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:47:45.740 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.a/config 2023-09-23T08:47:46.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:46 smithi082 ceph-mon[97694]: Added host smithi135 2023-09-23T08:47:46.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:46 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:47:47.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:47.359+0000 7faddc810700 1 -- 172.21.15.82:0/3064707028 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fadd8108670 msgr2=0x7fadd8108a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:47:47.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:47.359+0000 7faddc810700 1 --2- 172.21.15.82:0/3064707028 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fadd8108670 0x7fadd8108a50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fadc8009910 tx=0x7fadc8009c20 comp rx=0 tx=0).stop 2023-09-23T08:47:47.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:47.359+0000 7faddc810700 1 -- 172.21.15.82:0/3064707028 shutdown_connections 2023-09-23T08:47:47.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:47.359+0000 7faddc810700 1 --2- 172.21.15.82:0/3064707028 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fadd8108670 0x7fadd8108a50 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:47:47.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:47.359+0000 7faddc810700 1 -- 172.21.15.82:0/3064707028 >> 172.21.15.82:0/3064707028 conn(0x7fadd80fe0b0 msgr2=0x7fadd81004d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:47:47.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:47.359+0000 7faddc810700 1 -- 172.21.15.82:0/3064707028 shutdown_connections 2023-09-23T08:47:47.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:47.360+0000 7faddc810700 1 -- 172.21.15.82:0/3064707028 wait complete. 2023-09-23T08:47:47.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:47.361+0000 7faddc810700 1 Processor -- start 2023-09-23T08:47:47.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:47.361+0000 7faddc810700 1 -- start start 2023-09-23T08:47:47.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:47.361+0000 7faddc810700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fadd8108670 0x7fadd819d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:47:47.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:47.361+0000 7faddc810700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd819dbb0 con 0x7fadd8108670 2023-09-23T08:47:47.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:47.361+0000 7fadd659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fadd8108670 0x7fadd819d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:47:47.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:47.361+0000 7fadd659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fadd8108670 0x7fadd819d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60954/0 (socket says 172.21.15.82:60954) 2023-09-23T08:47:47.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:47.361+0000 7fadd659c700 1 -- 172.21.15.82:0/2176827240 learned_addr learned my addr 172.21.15.82:0/2176827240 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:47:47.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:47.362+0000 7fadd659c700 1 -- 172.21.15.82:0/2176827240 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadc80095f0 con 0x7fadd8108670 2023-09-23T08:47:47.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:47.362+0000 7fadd659c700 1 --2- 172.21.15.82:0/2176827240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fadd8108670 0x7fadd819d670 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fadc8006010 tx=0x7fadc8004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:47:47.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:47.362+0000 7fadc77fe700 1 -- 172.21.15.82:0/2176827240 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fadc801d070 con 0x7fadd8108670 2023-09-23T08:47:47.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:47.362+0000 7fadc77fe700 1 -- 172.21.15.82:0/2176827240 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fadc800bdf0 con 0x7fadd8108670 2023-09-23T08:47:47.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:47.362+0000 7faddc810700 1 -- 172.21.15.82:0/2176827240 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadd819ddb0 con 0x7fadd8108670 2023-09-23T08:47:47.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:47.362+0000 7fadc77fe700 1 -- 172.21.15.82:0/2176827240 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fadc8022d80 con 0x7fadd8108670 2023-09-23T08:47:47.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:47.362+0000 7faddc810700 1 -- 172.21.15.82:0/2176827240 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadd81976f0 con 0x7fadd8108670 2023-09-23T08:47:47.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:47.363+0000 7fadc77fe700 1 -- 172.21.15.82:0/2176827240 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) v1 ==== 45191+0+0 (secure 0 0 0) 0x7fadc8022570 con 0x7fadd8108670 2023-09-23T08:47:47.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:47.363+0000 7faddc810700 1 -- 172.21.15.82:0/2176827240 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadd8061f50 con 0x7fadd8108670 2023-09-23T08:47:47.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:47.364+0000 7fadc77fe700 1 --2- 172.21.15.82:0/2176827240 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fadc0038200 0x7fadc003a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:47:47.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:47.364+0000 7fadc77fe700 1 -- 172.21.15.82:0/2176827240 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fadc804c310 con 0x7fadd8108670 2023-09-23T08:47:47.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:47.364+0000 7fadd5d9b700 1 --2- 172.21.15.82:0/2176827240 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fadc0038200 0x7fadc003a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:47:47.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:47.365+0000 7fadd5d9b700 1 --2- 172.21.15.82:0/2176827240 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fadc0038200 0x7fadc003a6c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fadcc006fd0 tx=0x7fadcc006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:47:47.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:47.369+0000 7fadc77fe700 1 -- 172.21.15.82:0/2176827240 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7fadc802b590 con 0x7fadd8108670 2023-09-23T08:47:47.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:47.574+0000 7faddc810700 1 -- 172.21.15.82:0/2176827240 --> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fadd810c790 con 0x7fadc0038200 2023-09-23T08:47:47.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:47.575+0000 7fadc77fe700 1 -- 172.21.15.82:0/2176827240 <== mgr.14152 v2:172.21.15.82:6800/3698954311 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+160 (secure 0 0 0) 0x7fadd810c790 con 0x7fadc0038200 2023-09-23T08:47:47.578 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:47:47.578 INFO:teuthology.orchestra.run.smithi082.stdout:[{"addr": "172.21.15.82", "hostname": "smithi082", "labels": [], "status": ""}, {"addr": "172.21.15.135", "hostname": "smithi135", "labels": [], "status": ""}] 2023-09-23T08:47:47.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:47.577+0000 7faddc810700 1 -- 172.21.15.82:0/2176827240 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fadc0038200 msgr2=0x7fadc003a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:47:47.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:47.577+0000 7faddc810700 1 --2- 172.21.15.82:0/2176827240 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fadc0038200 0x7fadc003a6c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fadcc006fd0 tx=0x7fadcc006e40 comp rx=0 tx=0).stop 2023-09-23T08:47:47.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:47.577+0000 7faddc810700 1 -- 172.21.15.82:0/2176827240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fadd8108670 msgr2=0x7fadd819d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:47:47.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:47.577+0000 7faddc810700 1 --2- 172.21.15.82:0/2176827240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fadd8108670 0x7fadd819d670 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fadc8006010 tx=0x7fadc8004ff0 comp rx=0 tx=0).stop 2023-09-23T08:47:47.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:47.578+0000 7faddc810700 1 -- 172.21.15.82:0/2176827240 shutdown_connections 2023-09-23T08:47:47.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:47.578+0000 7faddc810700 1 --2- 172.21.15.82:0/2176827240 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fadc0038200 0x7fadc003a6c0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:47:47.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:47.578+0000 7faddc810700 1 --2- 172.21.15.82:0/2176827240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fadd8108670 0x7fadd819d670 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:47:47.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:47.578+0000 7faddc810700 1 -- 172.21.15.82:0/2176827240 >> 172.21.15.82:0/2176827240 conn(0x7fadd80fe0b0 msgr2=0x7fadd81000a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:47:47.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:47.578+0000 7faddc810700 1 -- 172.21.15.82:0/2176827240 shutdown_connections 2023-09-23T08:47:47.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:47.578+0000 7faddc810700 1 -- 172.21.15.82:0/2176827240 wait complete. 2023-09-23T08:47:47.602 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:47 smithi082 ceph-mon[97694]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:47:48.112 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi161 2023-09-23T08:47:48.113 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-09-23T08:47:48.113 DEBUG:teuthology.orchestra.run.smithi161:> dd of=/etc/ceph/ceph.conf 2023-09-23T08:47:48.161 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-09-23T08:47:48.161 DEBUG:teuthology.orchestra.run.smithi161:> dd of=/etc/ceph/ceph.client.admin.keyring 2023-09-23T08:47:48.246 INFO:tasks.cephadm:Adding host smithi161 to orchestrator... 2023-09-23T08:47:48.246 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- ceph orch host add smithi161 2023-09-23T08:47:48.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:48 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:47:48.966 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.a/config 2023-09-23T08:47:49.543 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:49 smithi082 ceph-mon[97694]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-09-23T08:47:49.543 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:49 smithi082 ceph-mon[97694]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:47:50.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:50.467+0000 7f6e299b3700 1 -- 172.21.15.82:0/525306570 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e24100610 msgr2=0x7f6e241009f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:47:50.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:50.467+0000 7f6e299b3700 1 --2- 172.21.15.82:0/525306570 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e24100610 0x7f6e241009f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6e14009910 tx=0x7f6e14009c20 comp rx=0 tx=0).stop 2023-09-23T08:47:50.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:50.468+0000 7f6e299b3700 1 -- 172.21.15.82:0/525306570 shutdown_connections 2023-09-23T08:47:50.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:50.468+0000 7f6e299b3700 1 --2- 172.21.15.82:0/525306570 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e24100610 0x7f6e241009f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:47:50.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:50.468+0000 7f6e299b3700 1 -- 172.21.15.82:0/525306570 >> 172.21.15.82:0/525306570 conn(0x7f6e240fbee0 msgr2=0x7f6e240fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:47:50.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:50.468+0000 7f6e299b3700 1 -- 172.21.15.82:0/525306570 shutdown_connections 2023-09-23T08:47:50.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:50.468+0000 7f6e299b3700 1 -- 172.21.15.82:0/525306570 wait complete. 2023-09-23T08:47:50.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:50.469+0000 7f6e299b3700 1 Processor -- start 2023-09-23T08:47:50.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:50.469+0000 7f6e299b3700 1 -- start start 2023-09-23T08:47:50.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:50.469+0000 7f6e299b3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e24100610 0x7f6e24072c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:47:50.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:50.469+0000 7f6e299b3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e24074940 con 0x7f6e24100610 2023-09-23T08:47:50.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:50.469+0000 7f6e22ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e24100610 0x7f6e24072c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:47:50.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:50.469+0000 7f6e22ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e24100610 0x7f6e24072c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60978/0 (socket says 172.21.15.82:60978) 2023-09-23T08:47:50.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:50.469+0000 7f6e22ffd700 1 -- 172.21.15.82:0/3312248390 learned_addr learned my addr 172.21.15.82:0/3312248390 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:47:50.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:50.470+0000 7f6e22ffd700 1 -- 172.21.15.82:0/3312248390 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e140095f0 con 0x7f6e24100610 2023-09-23T08:47:50.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:50.470+0000 7f6e22ffd700 1 --2- 172.21.15.82:0/3312248390 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e24100610 0x7f6e24072c20 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6e14006010 tx=0x7f6e14004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:47:50.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:50.470+0000 7f6e289b1700 1 -- 172.21.15.82:0/3312248390 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6e1401d070 con 0x7f6e24100610 2023-09-23T08:47:50.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:50.470+0000 7f6e289b1700 1 -- 172.21.15.82:0/3312248390 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6e1400bdf0 con 0x7f6e24100610 2023-09-23T08:47:50.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:50.470+0000 7f6e299b3700 1 -- 172.21.15.82:0/3312248390 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e24074b40 con 0x7f6e24100610 2023-09-23T08:47:50.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:50.470+0000 7f6e289b1700 1 -- 172.21.15.82:0/3312248390 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6e14022d80 con 0x7f6e24100610 2023-09-23T08:47:50.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:50.470+0000 7f6e299b3700 1 -- 172.21.15.82:0/3312248390 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e24073330 con 0x7f6e24100610 2023-09-23T08:47:50.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:50.471+0000 7f6e289b1700 1 -- 172.21.15.82:0/3312248390 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) v1 ==== 45191+0+0 (secure 0 0 0) 0x7f6e14022570 con 0x7f6e24100610 2023-09-23T08:47:50.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:50.471+0000 7f6e299b3700 1 -- 172.21.15.82:0/3312248390 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e24108920 con 0x7f6e24100610 2023-09-23T08:47:50.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:50.472+0000 7f6e289b1700 1 --2- 172.21.15.82:0/3312248390 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f6e0c0381b0 0x7f6e0c03a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:47:50.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:50.472+0000 7f6e289b1700 1 -- 172.21.15.82:0/3312248390 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f6e1404c160 con 0x7f6e24100610 2023-09-23T08:47:50.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:50.472+0000 7f6e227fc700 1 --2- 172.21.15.82:0/3312248390 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f6e0c0381b0 0x7f6e0c03a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:47:50.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:50.473+0000 7f6e227fc700 1 --2- 172.21.15.82:0/3312248390 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f6e0c0381b0 0x7f6e0c03a670 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6e18006fd0 tx=0x7f6e18006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:47:50.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:50.477+0000 7f6e289b1700 1 -- 172.21.15.82:0/3312248390 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f6e1402bba0 con 0x7f6e24100610 2023-09-23T08:47:50.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:50.700+0000 7f6e299b3700 1 -- 172.21.15.82:0/3312248390 --> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi161", "target": ["mon-mgr", ""]}) v1 -- 0x7f6e24074300 con 0x7f6e0c0381b0 2023-09-23T08:47:51.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:51 smithi082 ceph-mon[97694]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:47:51.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:51 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:47:51.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:51 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:47:51.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:51 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:47:51.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:51 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:47:51.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:51 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi135", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:47:51.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:51 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:47:51.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:51 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:47:52.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:52 smithi082 ceph-mon[97694]: Updating smithi135:/etc/ceph/ceph.conf 2023-09-23T08:47:52.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:52 smithi082 ceph-mon[97694]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi161", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:47:52.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:52 smithi082 ceph-mon[97694]: Updating smithi135:/var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/config/ceph.conf 2023-09-23T08:47:53.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:53 smithi082 ceph-mon[97694]: Deploying cephadm binary to smithi161 2023-09-23T08:47:53.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:53 smithi082 ceph-mon[97694]: Updating smithi135:/etc/ceph/ceph.client.admin.keyring 2023-09-23T08:47:53.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:53 smithi082 ceph-mon[97694]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:47:53.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:53 smithi082 ceph-mon[97694]: Updating smithi135:/var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/config/ceph.client.admin.keyring 2023-09-23T08:47:53.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:53 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:47:53.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:53 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:47:53.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:53 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:47:53.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:53.868+0000 7f6e289b1700 1 -- 172.21.15.82:0/3312248390 <== mgr.14152 v2:172.21.15.82:6800/3698954311 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f6e24074300 con 0x7f6e0c0381b0 2023-09-23T08:47:53.872 INFO:teuthology.orchestra.run.smithi082.stdout:Added host 'smithi161' with addr '172.21.15.161' 2023-09-23T08:47:53.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:53.870+0000 7f6e299b3700 1 -- 172.21.15.82:0/3312248390 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f6e0c0381b0 msgr2=0x7f6e0c03a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:47:53.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:53.870+0000 7f6e299b3700 1 --2- 172.21.15.82:0/3312248390 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f6e0c0381b0 0x7f6e0c03a670 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6e18006fd0 tx=0x7f6e18006e40 comp rx=0 tx=0).stop 2023-09-23T08:47:53.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:53.870+0000 7f6e299b3700 1 -- 172.21.15.82:0/3312248390 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e24100610 msgr2=0x7f6e24072c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:47:53.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:53.870+0000 7f6e299b3700 1 --2- 172.21.15.82:0/3312248390 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e24100610 0x7f6e24072c20 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6e14006010 tx=0x7f6e14004ff0 comp rx=0 tx=0).stop 2023-09-23T08:47:53.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:53.870+0000 7f6e299b3700 1 -- 172.21.15.82:0/3312248390 shutdown_connections 2023-09-23T08:47:53.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:53.870+0000 7f6e299b3700 1 --2- 172.21.15.82:0/3312248390 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f6e0c0381b0 0x7f6e0c03a670 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:47:53.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:53.870+0000 7f6e299b3700 1 --2- 172.21.15.82:0/3312248390 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e24100610 0x7f6e24072c20 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:47:53.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:53.870+0000 7f6e299b3700 1 -- 172.21.15.82:0/3312248390 >> 172.21.15.82:0/3312248390 conn(0x7f6e240fbee0 msgr2=0x7f6e241048e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:47:53.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:53.871+0000 7f6e299b3700 1 -- 172.21.15.82:0/3312248390 shutdown_connections 2023-09-23T08:47:53.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:53.871+0000 7f6e299b3700 1 -- 172.21.15.82:0/3312248390 wait complete. 2023-09-23T08:47:54.345 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- ceph orch host ls --format=json 2023-09-23T08:47:55.064 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.a/config 2023-09-23T08:47:55.338 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:54 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:47:55.339 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:54 smithi082 ceph-mon[97694]: Added host smithi161 2023-09-23T08:47:55.339 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:54 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:47:55.339 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:54 smithi082 ceph-mon[97694]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:47:55.339 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:54 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:47:56.353 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:56 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:47:56.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:56.615+0000 7f05899ef700 1 -- 172.21.15.82:0/3697855245 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0584100610 msgr2=0x7f05841009f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:47:56.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:56.615+0000 7f05899ef700 1 --2- 172.21.15.82:0/3697855245 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0584100610 0x7f05841009f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0574009910 tx=0x7f0574009c20 comp rx=0 tx=0).stop 2023-09-23T08:47:56.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:56.615+0000 7f05899ef700 1 -- 172.21.15.82:0/3697855245 shutdown_connections 2023-09-23T08:47:56.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:56.615+0000 7f05899ef700 1 --2- 172.21.15.82:0/3697855245 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0584100610 0x7f05841009f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:47:56.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:56.615+0000 7f05899ef700 1 -- 172.21.15.82:0/3697855245 >> 172.21.15.82:0/3697855245 conn(0x7f05840fbee0 msgr2=0x7f05840fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:47:56.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:56.615+0000 7f05899ef700 1 -- 172.21.15.82:0/3697855245 shutdown_connections 2023-09-23T08:47:56.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:56.615+0000 7f05899ef700 1 -- 172.21.15.82:0/3697855245 wait complete. 2023-09-23T08:47:56.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:56.616+0000 7f05899ef700 1 Processor -- start 2023-09-23T08:47:56.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:56.616+0000 7f05899ef700 1 -- start start 2023-09-23T08:47:56.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:56.617+0000 7f05899ef700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0584100610 0x7f058419d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:47:56.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:56.617+0000 7f05899ef700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f058419dcc0 con 0x7f0584100610 2023-09-23T08:47:56.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:56.617+0000 7f0582ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0584100610 0x7f058419d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:47:56.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:56.617+0000 7f0582ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0584100610 0x7f058419d780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59196/0 (socket says 172.21.15.82:59196) 2023-09-23T08:47:56.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:56.617+0000 7f0582ffd700 1 -- 172.21.15.82:0/1206891329 learned_addr learned my addr 172.21.15.82:0/1206891329 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:47:56.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:56.617+0000 7f0582ffd700 1 -- 172.21.15.82:0/1206891329 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05740095f0 con 0x7f0584100610 2023-09-23T08:47:56.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:56.617+0000 7f0582ffd700 1 --2- 172.21.15.82:0/1206891329 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0584100610 0x7f058419d780 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0574004f40 tx=0x7f0574005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:47:56.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:56.618+0000 7f05889ed700 1 -- 172.21.15.82:0/1206891329 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f057401d070 con 0x7f0584100610 2023-09-23T08:47:56.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:56.618+0000 7f05889ed700 1 -- 172.21.15.82:0/1206891329 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f05740044b0 con 0x7f0584100610 2023-09-23T08:47:56.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:56.618+0000 7f05889ed700 1 -- 172.21.15.82:0/1206891329 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0574003860 con 0x7f0584100610 2023-09-23T08:47:56.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:56.618+0000 7f05899ef700 1 -- 172.21.15.82:0/1206891329 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f058419dec0 con 0x7f0584100610 2023-09-23T08:47:56.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:56.618+0000 7f05899ef700 1 -- 172.21.15.82:0/1206891329 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f058419e280 con 0x7f0584100610 2023-09-23T08:47:56.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:56.619+0000 7f05899ef700 1 -- 172.21.15.82:0/1206891329 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0584061f50 con 0x7f0584100610 2023-09-23T08:47:56.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:56.619+0000 7f05889ed700 1 -- 172.21.15.82:0/1206891329 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) v1 ==== 45191+0+0 (secure 0 0 0) 0x7f057400b960 con 0x7f0584100610 2023-09-23T08:47:56.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:56.620+0000 7f05889ed700 1 --2- 172.21.15.82:0/1206891329 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f056c038200 0x7f056c03a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:47:56.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:56.620+0000 7f05889ed700 1 -- 172.21.15.82:0/1206891329 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f057404bf10 con 0x7f0584100610 2023-09-23T08:47:56.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:56.620+0000 7f05827fc700 1 --2- 172.21.15.82:0/1206891329 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f056c038200 0x7f056c03a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:47:56.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:56.620+0000 7f05827fc700 1 --2- 172.21.15.82:0/1206891329 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f056c038200 0x7f056c03a6c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0578006fd0 tx=0x7f0578006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:47:56.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:56.625+0000 7f05889ed700 1 -- 172.21.15.82:0/1206891329 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f057402a540 con 0x7f0584100610 2023-09-23T08:47:56.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:56.832+0000 7f05899ef700 1 -- 172.21.15.82:0/1206891329 --> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f058410a850 con 0x7f056c038200 2023-09-23T08:47:56.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:56.833+0000 7f05889ed700 1 -- 172.21.15.82:0/1206891329 <== mgr.14152 v2:172.21.15.82:6800/3698954311 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+240 (secure 0 0 0) 0x7f058410a850 con 0x7f056c038200 2023-09-23T08:47:56.836 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:47:56.836 INFO:teuthology.orchestra.run.smithi082.stdout:[{"addr": "172.21.15.82", "hostname": "smithi082", "labels": [], "status": ""}, {"addr": "172.21.15.135", "hostname": "smithi135", "labels": [], "status": ""}, {"addr": "172.21.15.161", "hostname": "smithi161", "labels": [], "status": ""}] 2023-09-23T08:47:56.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:56.836+0000 7f05899ef700 1 -- 172.21.15.82:0/1206891329 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f056c038200 msgr2=0x7f056c03a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:47:56.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:56.836+0000 7f05899ef700 1 --2- 172.21.15.82:0/1206891329 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f056c038200 0x7f056c03a6c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0578006fd0 tx=0x7f0578006e40 comp rx=0 tx=0).stop 2023-09-23T08:47:56.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:56.836+0000 7f05899ef700 1 -- 172.21.15.82:0/1206891329 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0584100610 msgr2=0x7f058419d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:47:56.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:56.836+0000 7f05899ef700 1 --2- 172.21.15.82:0/1206891329 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0584100610 0x7f058419d780 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0574004f40 tx=0x7f0574005020 comp rx=0 tx=0).stop 2023-09-23T08:47:56.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:56.836+0000 7f05899ef700 1 -- 172.21.15.82:0/1206891329 shutdown_connections 2023-09-23T08:47:56.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:56.836+0000 7f05899ef700 1 --2- 172.21.15.82:0/1206891329 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f056c038200 0x7f056c03a6c0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:47:56.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:56.836+0000 7f05899ef700 1 --2- 172.21.15.82:0/1206891329 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0584100610 0x7f058419d780 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:47:56.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:56.836+0000 7f05899ef700 1 -- 172.21.15.82:0/1206891329 >> 172.21.15.82:0/1206891329 conn(0x7f05840fbee0 msgr2=0x7f0584103ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:47:56.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:56.836+0000 7f05899ef700 1 -- 172.21.15.82:0/1206891329 shutdown_connections 2023-09-23T08:47:56.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:56.836+0000 7f05899ef700 1 -- 172.21.15.82:0/1206891329 wait complete. 2023-09-23T08:47:57.237 INFO:tasks.cephadm:Setting crush tunables to default 2023-09-23T08:47:57.237 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- ceph osd crush tunables default 2023-09-23T08:47:57.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:57 smithi082 ceph-mon[97694]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:47:57.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:57 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:47:57.957 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.a/config 2023-09-23T08:47:58.574 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:58 smithi082 ceph-mon[97694]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-09-23T08:47:59.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:59.472+0000 7f391bc5e700 1 -- 172.21.15.82:0/1511612952 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3914100610 msgr2=0x7f39141009f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:47:59.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:59.472+0000 7f391bc5e700 1 --2- 172.21.15.82:0/1511612952 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3914100610 0x7f39141009f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3910009910 tx=0x7f3910009c20 comp rx=0 tx=0).stop 2023-09-23T08:47:59.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:59.472+0000 7f391bc5e700 1 -- 172.21.15.82:0/1511612952 shutdown_connections 2023-09-23T08:47:59.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:59.472+0000 7f391bc5e700 1 --2- 172.21.15.82:0/1511612952 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3914100610 0x7f39141009f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:47:59.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:59.472+0000 7f391bc5e700 1 -- 172.21.15.82:0/1511612952 >> 172.21.15.82:0/1511612952 conn(0x7f39140fbee0 msgr2=0x7f39140fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:47:59.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:59.472+0000 7f391bc5e700 1 -- 172.21.15.82:0/1511612952 shutdown_connections 2023-09-23T08:47:59.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:59.472+0000 7f391bc5e700 1 -- 172.21.15.82:0/1511612952 wait complete. 2023-09-23T08:47:59.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:59.474+0000 7f391bc5e700 1 Processor -- start 2023-09-23T08:47:59.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:59.474+0000 7f391bc5e700 1 -- start start 2023-09-23T08:47:59.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:59.475+0000 7f391bc5e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3914100610 0x7f391419d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:47:59.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:59.475+0000 7f391bc5e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f391419dcd0 con 0x7f3914100610 2023-09-23T08:47:59.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:59.475+0000 7f39199fa700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3914100610 0x7f391419d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:47:59.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:59.475+0000 7f39199fa700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3914100610 0x7f391419d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59212/0 (socket says 172.21.15.82:59212) 2023-09-23T08:47:59.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:59.475+0000 7f39199fa700 1 -- 172.21.15.82:0/635795742 learned_addr learned my addr 172.21.15.82:0/635795742 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:47:59.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:59.475+0000 7f39199fa700 1 -- 172.21.15.82:0/635795742 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39100095f0 con 0x7f3914100610 2023-09-23T08:47:59.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:59.475+0000 7f39199fa700 1 --2- 172.21.15.82:0/635795742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3914100610 0x7f391419d790 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3910006010 tx=0x7f3910004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:47:59.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:59.476+0000 7f390affd700 1 -- 172.21.15.82:0/635795742 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f391001d070 con 0x7f3914100610 2023-09-23T08:47:59.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:59.476+0000 7f390affd700 1 -- 172.21.15.82:0/635795742 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f391000bdf0 con 0x7f3914100610 2023-09-23T08:47:59.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:59.476+0000 7f391bc5e700 1 -- 172.21.15.82:0/635795742 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f391419ded0 con 0x7f3914100610 2023-09-23T08:47:59.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:59.476+0000 7f390affd700 1 -- 172.21.15.82:0/635795742 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3910022d80 con 0x7f3914100610 2023-09-23T08:47:59.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:59.476+0000 7f391bc5e700 1 -- 172.21.15.82:0/635795742 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f391419e2f0 con 0x7f3914100610 2023-09-23T08:47:59.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:59.477+0000 7f390affd700 1 -- 172.21.15.82:0/635795742 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) v1 ==== 45191+0+0 (secure 0 0 0) 0x7f391000b960 con 0x7f3914100610 2023-09-23T08:47:59.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:59.477+0000 7f391bc5e700 1 -- 172.21.15.82:0/635795742 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3914061f50 con 0x7f3914100610 2023-09-23T08:47:59.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:59.477+0000 7f390affd700 1 --2- 172.21.15.82:0/635795742 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f3900038200 0x7f390003a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:47:59.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:59.477+0000 7f390affd700 1 -- 172.21.15.82:0/635795742 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f391004c160 con 0x7f3914100610 2023-09-23T08:47:59.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:59.478+0000 7f39191f9700 1 --2- 172.21.15.82:0/635795742 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f3900038200 0x7f390003a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:47:59.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:59.478+0000 7f39191f9700 1 --2- 172.21.15.82:0/635795742 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f3900038200 0x7f390003a6c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3904006fd0 tx=0x7f3904006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:47:59.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:59.482+0000 7f390affd700 1 -- 172.21.15.82:0/635795742 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f391002b590 con 0x7f3914100610 2023-09-23T08:47:59.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:47:59 smithi082 ceph-mon[97694]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:47:59.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:47:59.688+0000 7f391bc5e700 1 -- 172.21.15.82:0/635795742 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f3914198d20 con 0x7f3914100610 2023-09-23T08:48:00.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:00.293+0000 7f390affd700 1 -- 172.21.15.82:0/635795742 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7f3914198d20 con 0x7f3914100610 2023-09-23T08:48:00.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:00.296+0000 7f391bc5e700 1 -- 172.21.15.82:0/635795742 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f3900038200 msgr2=0x7f390003a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:48:00.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:00.296+0000 7f391bc5e700 1 --2- 172.21.15.82:0/635795742 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f3900038200 0x7f390003a6c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3904006fd0 tx=0x7f3904006e40 comp rx=0 tx=0).stop 2023-09-23T08:48:00.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:00.296+0000 7f391bc5e700 1 -- 172.21.15.82:0/635795742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3914100610 msgr2=0x7f391419d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:48:00.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:00.296+0000 7f391bc5e700 1 --2- 172.21.15.82:0/635795742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3914100610 0x7f391419d790 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3910006010 tx=0x7f3910004ff0 comp rx=0 tx=0).stop 2023-09-23T08:48:00.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:00.296+0000 7f391bc5e700 1 -- 172.21.15.82:0/635795742 shutdown_connections 2023-09-23T08:48:00.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:00.296+0000 7f391bc5e700 1 --2- 172.21.15.82:0/635795742 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f3900038200 0x7f390003a6c0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:48:00.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:00.296+0000 7f391bc5e700 1 --2- 172.21.15.82:0/635795742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3914100610 0x7f391419d790 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:48:00.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:00.296+0000 7f391bc5e700 1 -- 172.21.15.82:0/635795742 >> 172.21.15.82:0/635795742 conn(0x7f39140fbee0 msgr2=0x7f3914103ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:48:00.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:00.296+0000 7f391bc5e700 1 -- 172.21.15.82:0/635795742 shutdown_connections 2023-09-23T08:48:00.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:00.296+0000 7f391bc5e700 1 -- 172.21.15.82:0/635795742 wait complete. 2023-09-23T08:48:00.300 INFO:teuthology.orchestra.run.smithi082.stderr:adjusted tunables profile to default 2023-09-23T08:48:00.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:00 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/635795742' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-09-23T08:48:00.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:00 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:00.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:00 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:00.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:00 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:00.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:00 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:00.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:00 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi161", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:48:00.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:00 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:48:00.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:00 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:48:00.735 INFO:tasks.cephadm:Adding mon.a on smithi082 2023-09-23T08:48:00.735 INFO:tasks.cephadm:Adding mon.b on smithi135 2023-09-23T08:48:00.735 INFO:tasks.cephadm:Adding mon.c on smithi161 2023-09-23T08:48:00.736 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- ceph orch apply mon '3;smithi082:172.21.15.82=a;smithi135:172.21.15.135=b;smithi161:172.21.15.161=c' 2023-09-23T08:48:01.480 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/config/ceph.conf 2023-09-23T08:48:01.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:01 smithi082 ceph-mon[97694]: Updating smithi161:/etc/ceph/ceph.conf 2023-09-23T08:48:01.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:01 smithi082 ceph-mon[97694]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:01.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:01 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/635795742' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-09-23T08:48:01.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:01 smithi082 ceph-mon[97694]: osdmap e4: 0 total, 0 up, 0 in 2023-09-23T08:48:01.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:01 smithi082 ceph-mon[97694]: Updating smithi161:/var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/config/ceph.conf 2023-09-23T08:48:02.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:02 smithi082 ceph-mon[97694]: Updating smithi161:/etc/ceph/ceph.client.admin.keyring 2023-09-23T08:48:02.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:02 smithi082 ceph-mon[97694]: Updating smithi161:/var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/config/ceph.client.admin.keyring 2023-09-23T08:48:02.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:02 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:02.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:02 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:02.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:02 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:02.968 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:02.964+0000 7f65d6f59700 1 -- 172.21.15.161:0/2389448066 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65d0106440 msgr2=0x7f65d0106820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:48:02.968 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:02.964+0000 7f65d6f59700 1 --2- 172.21.15.161:0/2389448066 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65d0106440 0x7f65d0106820 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f65c4009910 tx=0x7f65c4009c20 comp rx=0 tx=0).stop 2023-09-23T08:48:02.968 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:02.964+0000 7f65d6f59700 1 -- 172.21.15.161:0/2389448066 shutdown_connections 2023-09-23T08:48:02.968 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:02.964+0000 7f65d6f59700 1 --2- 172.21.15.161:0/2389448066 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65d0106440 0x7f65d0106820 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:48:02.969 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:02.964+0000 7f65d6f59700 1 -- 172.21.15.161:0/2389448066 >> 172.21.15.161:0/2389448066 conn(0x7f65d0074e20 msgr2=0x7f65d0075230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:48:02.969 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:02.964+0000 7f65d6f59700 1 -- 172.21.15.161:0/2389448066 shutdown_connections 2023-09-23T08:48:02.969 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:02.964+0000 7f65d6f59700 1 -- 172.21.15.161:0/2389448066 wait complete. 2023-09-23T08:48:02.969 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:02.965+0000 7f65d6f59700 1 Processor -- start 2023-09-23T08:48:02.969 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:02.965+0000 7f65d6f59700 1 -- start start 2023-09-23T08:48:02.971 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:02.966+0000 7f65d6f59700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65d0106440 0x7f65d019d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:48:02.971 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:02.966+0000 7f65d6f59700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65d019dbf0 con 0x7f65d0106440 2023-09-23T08:48:02.971 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:02.966+0000 7f65d4cf5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65d0106440 0x7f65d019d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:48:02.971 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:02.966+0000 7f65d4cf5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65d0106440 0x7f65d019d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.161:37470/0 (socket says 172.21.15.161:37470) 2023-09-23T08:48:02.971 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:02.966+0000 7f65d4cf5700 1 -- 172.21.15.161:0/3101286773 learned_addr learned my addr 172.21.15.161:0/3101286773 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-09-23T08:48:02.972 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:02.966+0000 7f65d4cf5700 1 -- 172.21.15.161:0/3101286773 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65c40095f0 con 0x7f65d0106440 2023-09-23T08:48:02.972 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:02.967+0000 7f65d4cf5700 1 --2- 172.21.15.161:0/3101286773 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65d0106440 0x7f65d019d6b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f65c4006010 tx=0x7f65c4004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:48:02.972 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:02.967+0000 7f65cdffb700 1 -- 172.21.15.161:0/3101286773 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f65c401d070 con 0x7f65d0106440 2023-09-23T08:48:02.972 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:02.967+0000 7f65d6f59700 1 -- 172.21.15.161:0/3101286773 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65d019de50 con 0x7f65d0106440 2023-09-23T08:48:02.972 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:02.967+0000 7f65cdffb700 1 -- 172.21.15.161:0/3101286773 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f65c400bdf0 con 0x7f65d0106440 2023-09-23T08:48:02.972 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:02.967+0000 7f65cdffb700 1 -- 172.21.15.161:0/3101286773 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f65c4022d80 con 0x7f65d0106440 2023-09-23T08:48:02.972 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:02.967+0000 7f65d6f59700 1 -- 172.21.15.161:0/3101286773 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65d019e2d0 con 0x7f65d0106440 2023-09-23T08:48:02.972 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:02.968+0000 7f65d6f59700 1 -- 172.21.15.161:0/3101286773 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65d0061f50 con 0x7f65d0106440 2023-09-23T08:48:02.972 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:02.968+0000 7f65cdffb700 1 -- 172.21.15.161:0/3101286773 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) v1 ==== 45191+0+0 (secure 0 0 0) 0x7f65c4022570 con 0x7f65d0106440 2023-09-23T08:48:02.973 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:02.969+0000 7f65cdffb700 1 --2- 172.21.15.161:0/3101286773 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f65c00381b0 0x7f65c003a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:48:02.973 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:02.969+0000 7f65cdffb700 1 -- 172.21.15.161:0/3101286773 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f65c404c2a0 con 0x7f65d0106440 2023-09-23T08:48:02.973 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:02.969+0000 7f65cffff700 1 --2- 172.21.15.161:0/3101286773 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f65c00381b0 0x7f65c003a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:48:02.973 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:02.970+0000 7f65cffff700 1 --2- 172.21.15.161:0/3101286773 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f65c00381b0 0x7f65c003a670 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f65bc006fd0 tx=0x7f65bc006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:48:02.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:02.975+0000 7f65cdffb700 1 -- 172.21.15.161:0/3101286773 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f65c402bba0 con 0x7f65d0106440 2023-09-23T08:48:03.198 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:03.194+0000 7f65d6f59700 1 -- 172.21.15.161:0/3101286773 --> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi082:172.21.15.82=a;smithi135:172.21.15.135=b;smithi161:172.21.15.161=c", "target": ["mon-mgr", ""]}) v1 -- 0x7f65d00fe620 con 0x7f65c00381b0 2023-09-23T08:48:03.204 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:03.202+0000 7f65cdffb700 1 -- 172.21.15.161:0/3101286773 <== mgr.14152 v2:172.21.15.82:6800/3698954311 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f65d00fe620 con 0x7f65c00381b0 2023-09-23T08:48:03.205 INFO:teuthology.orchestra.run.smithi161.stdout:Scheduled mon update... 2023-09-23T08:48:03.207 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:03.204+0000 7f65d6f59700 1 -- 172.21.15.161:0/3101286773 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f65c00381b0 msgr2=0x7f65c003a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:48:03.207 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:03.204+0000 7f65d6f59700 1 --2- 172.21.15.161:0/3101286773 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f65c00381b0 0x7f65c003a670 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f65bc006fd0 tx=0x7f65bc006e40 comp rx=0 tx=0).stop 2023-09-23T08:48:03.207 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:03.204+0000 7f65d6f59700 1 -- 172.21.15.161:0/3101286773 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65d0106440 msgr2=0x7f65d019d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:48:03.207 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:03.204+0000 7f65d6f59700 1 --2- 172.21.15.161:0/3101286773 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65d0106440 0x7f65d019d6b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f65c4006010 tx=0x7f65c4004ff0 comp rx=0 tx=0).stop 2023-09-23T08:48:03.207 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:03.204+0000 7f65d6f59700 1 -- 172.21.15.161:0/3101286773 shutdown_connections 2023-09-23T08:48:03.207 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:03.204+0000 7f65d6f59700 1 --2- 172.21.15.161:0/3101286773 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f65c00381b0 0x7f65c003a670 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:48:03.207 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:03.204+0000 7f65d6f59700 1 --2- 172.21.15.161:0/3101286773 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65d0106440 0x7f65d019d6b0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:48:03.207 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:03.204+0000 7f65d6f59700 1 -- 172.21.15.161:0/3101286773 >> 172.21.15.161:0/3101286773 conn(0x7f65d0074e20 msgr2=0x7f65d00fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:48:03.208 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:03.204+0000 7f65d6f59700 1 -- 172.21.15.161:0/3101286773 shutdown_connections 2023-09-23T08:48:03.208 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:03.204+0000 7f65d6f59700 1 -- 172.21.15.161:0/3101286773 wait complete. 2023-09-23T08:48:03.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:03 smithi082 ceph-mon[97694]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:03.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:03 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:03.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:03 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:48:03.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:03 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:48:03.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:03 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:48:03.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:03 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:03.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:03 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-09-23T08:48:03.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:03 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:48:03.764 DEBUG:teuthology.orchestra.run.smithi135:mon.b> sudo journalctl -f -n 0 -u ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@mon.b.service 2023-09-23T08:48:03.769 DEBUG:teuthology.orchestra.run.smithi161:mon.c> sudo journalctl -f -n 0 -u ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@mon.c.service 2023-09-23T08:48:03.773 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-09-23T08:48:03.773 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- ceph mon dump -f json 2023-09-23T08:48:03.847 INFO:journalctl@ceph.mon.b.smithi135.stdout:-- Logs begin at Sat 2023-09-23 08:29:30 UTC. -- 2023-09-23T08:48:03.848 INFO:journalctl@ceph.mon.c.smithi161.stdout:-- Logs begin at Sat 2023-09-23 08:29:48 UTC. -- 2023-09-23T08:48:04.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:04 smithi082 ceph-mon[97694]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi082:172.21.15.82=a;smithi135:172.21.15.135=b;smithi161:172.21.15.161=c", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:48:04.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:04 smithi082 ceph-mon[97694]: Saving service mon spec with placement smithi082:172.21.15.82=a;smithi135:172.21.15.135=b;smithi161:172.21.15.161=c;count:3 2023-09-23T08:48:04.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:04 smithi082 ceph-mon[97694]: Deploying daemon mon.c on smithi161 2023-09-23T08:48:04.811 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/config/ceph.conf 2023-09-23T08:48:05.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:05 smithi082 ceph-mon[97694]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:07.003 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:06.999+0000 7f77f495d700 1 -- 172.21.15.161:0/2872007845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77f0072cc0 msgr2=0x7f77f00730a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:48:07.003 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:06.999+0000 7f77f495d700 1 --2- 172.21.15.161:0/2872007845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77f0072cc0 0x7f77f00730a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f77e0009910 tx=0x7f77e0009c20 comp rx=0 tx=0).stop 2023-09-23T08:48:07.003 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:06.999+0000 7f77f495d700 1 -- 172.21.15.161:0/2872007845 shutdown_connections 2023-09-23T08:48:07.004 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:06.999+0000 7f77f495d700 1 --2- 172.21.15.161:0/2872007845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77f0072cc0 0x7f77f00730a0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:48:07.004 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:06.999+0000 7f77f495d700 1 -- 172.21.15.161:0/2872007845 >> 172.21.15.161:0/2872007845 conn(0x7f77f00fbee0 msgr2=0x7f77f00fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:48:07.004 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:06.999+0000 7f77f495d700 1 -- 172.21.15.161:0/2872007845 shutdown_connections 2023-09-23T08:48:07.004 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:06.999+0000 7f77f495d700 1 -- 172.21.15.161:0/2872007845 wait complete. 2023-09-23T08:48:07.004 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:07.000+0000 7f77f495d700 1 Processor -- start 2023-09-23T08:48:07.004 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:07.000+0000 7f77f495d700 1 -- start start 2023-09-23T08:48:07.005 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:07.001+0000 7f77f495d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77f0072cc0 0x7f77f019be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:48:07.005 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:07.001+0000 7f77f495d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f019c380 con 0x7f77f0072cc0 2023-09-23T08:48:07.005 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:07.001+0000 7f77ee59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77f0072cc0 0x7f77f019be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:48:07.005 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:07.001+0000 7f77ee59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77f0072cc0 0x7f77f019be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.161:37482/0 (socket says 172.21.15.161:37482) 2023-09-23T08:48:07.005 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:07.001+0000 7f77ee59c700 1 -- 172.21.15.161:0/2196973429 learned_addr learned my addr 172.21.15.161:0/2196973429 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-09-23T08:48:07.006 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:07.002+0000 7f77ee59c700 1 -- 172.21.15.161:0/2196973429 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77e00095f0 con 0x7f77f0072cc0 2023-09-23T08:48:07.006 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:07.002+0000 7f77ee59c700 1 --2- 172.21.15.161:0/2196973429 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77f0072cc0 0x7f77f019be40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f77e0006010 tx=0x7f77e0004f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:48:07.006 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:07.002+0000 7f77df7fe700 1 -- 172.21.15.161:0/2196973429 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f77e001d070 con 0x7f77f0072cc0 2023-09-23T08:48:07.006 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:07.002+0000 7f77f495d700 1 -- 172.21.15.161:0/2196973429 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77f019c5e0 con 0x7f77f0072cc0 2023-09-23T08:48:07.006 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:07.002+0000 7f77df7fe700 1 -- 172.21.15.161:0/2196973429 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f77e000bdf0 con 0x7f77f0072cc0 2023-09-23T08:48:07.006 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:07.002+0000 7f77df7fe700 1 -- 172.21.15.161:0/2196973429 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f77e0022d80 con 0x7f77f0072cc0 2023-09-23T08:48:07.006 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:07.002+0000 7f77f495d700 1 -- 172.21.15.161:0/2196973429 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77f019ca60 con 0x7f77f0072cc0 2023-09-23T08:48:07.007 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:07.004+0000 7f77f495d700 1 -- 172.21.15.161:0/2196973429 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77f0061f50 con 0x7f77f0072cc0 2023-09-23T08:48:07.007 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:07.004+0000 7f77df7fe700 1 -- 172.21.15.161:0/2196973429 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) v1 ==== 45191+0+0 (secure 0 0 0) 0x7f77e0022570 con 0x7f77f0072cc0 2023-09-23T08:48:07.007 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:07.004+0000 7f77df7fe700 1 --2- 172.21.15.161:0/2196973429 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f77d8038200 0x7f77d803a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:48:07.007 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:07.004+0000 7f77df7fe700 1 -- 172.21.15.161:0/2196973429 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f77e004c110 con 0x7f77f0072cc0 2023-09-23T08:48:07.008 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:07.004+0000 7f77edd9b700 1 --2- 172.21.15.161:0/2196973429 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f77d8038200 0x7f77d803a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:48:07.008 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:07.005+0000 7f77edd9b700 1 --2- 172.21.15.161:0/2196973429 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f77d8038200 0x7f77d803a6c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f77e4006fd0 tx=0x7f77e4006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:48:07.012 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:07.010+0000 7f77df7fe700 1 -- 172.21.15.161:0/2196973429 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f77e002bb60 con 0x7f77f0072cc0 2023-09-23T08:48:07.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:06 smithi082 ceph-mon[97694]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:07.336 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:07.333+0000 7f77f495d700 1 -- 172.21.15.161:0/2196973429 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f77f019d1a0 con 0x7f77f0072cc0 2023-09-23T08:48:07.336 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:07.333+0000 7f77df7fe700 1 -- 172.21.15.161:0/2196973429 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+736 (secure 0 0 0) 0x7f77e0027020 con 0x7f77f0072cc0 2023-09-23T08:48:07.336 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-09-23T08:48:07.337 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":1,"fsid":"8926e286-59ed-11ee-8db4-212e2dc638e7","modified":"2023-09-23T08:46:12.893931Z","created":"2023-09-23T08:46:12.893931Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:3300","nonce":0},{"type":"v1","addr":"172.21.15.82:6789","nonce":0}]},"addr":"172.21.15.82:6789/0","public_addr":"172.21.15.82:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-09-23T08:48:07.339 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:07.336+0000 7f77f495d700 1 -- 172.21.15.161:0/2196973429 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f77d8038200 msgr2=0x7f77d803a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:48:07.339 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:07.336+0000 7f77f495d700 1 --2- 172.21.15.161:0/2196973429 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f77d8038200 0x7f77d803a6c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f77e4006fd0 tx=0x7f77e4006e40 comp rx=0 tx=0).stop 2023-09-23T08:48:07.339 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:07.336+0000 7f77f495d700 1 -- 172.21.15.161:0/2196973429 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77f0072cc0 msgr2=0x7f77f019be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:48:07.339 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:07.336+0000 7f77f495d700 1 --2- 172.21.15.161:0/2196973429 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77f0072cc0 0x7f77f019be40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f77e0006010 tx=0x7f77e0004f40 comp rx=0 tx=0).stop 2023-09-23T08:48:07.339 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:07.336+0000 7f77f495d700 1 -- 172.21.15.161:0/2196973429 shutdown_connections 2023-09-23T08:48:07.339 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:07.336+0000 7f77f495d700 1 --2- 172.21.15.161:0/2196973429 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f77d8038200 0x7f77d803a6c0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:48:07.339 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:07.336+0000 7f77f495d700 1 --2- 172.21.15.161:0/2196973429 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77f0072cc0 0x7f77f019be40 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:48:07.339 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:07.336+0000 7f77f495d700 1 -- 172.21.15.161:0/2196973429 >> 172.21.15.161:0/2196973429 conn(0x7f77f00fbee0 msgr2=0x7f77f00fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:48:07.339 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:07.336+0000 7f77f495d700 1 -- 172.21.15.161:0/2196973429 shutdown_connections 2023-09-23T08:48:07.340 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:07.336+0000 7f77f495d700 1 -- 172.21.15.161:0/2196973429 wait complete. 2023-09-23T08:48:07.340 INFO:teuthology.orchestra.run.smithi161.stderr:dumped monmap epoch 1 2023-09-23T08:48:08.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:07 smithi082 ceph-mon[97694]: from='client.? 172.21.15.161:0/2196973429' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-09-23T08:48:08.379 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:08 smithi161 ceph-mon[99580]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2023-09-23T08:48:08.379 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:08 smithi161 ceph-mon[99580]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-09-23T08:48:08.379 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:08 smithi161 ceph-mon[99580]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-09-23T08:48:08.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:08 smithi161 ceph-mon[99580]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-09-23T08:48:08.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:08 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:08.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:08 smithi161 ceph-mon[99580]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-09-23T08:48:08.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:08 smithi161 ceph-mon[99580]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:08.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:08 smithi161 ceph-mon[99580]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:08.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:08 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:08.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:08 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:08.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:08 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:08.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:08 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:08.650 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:08 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi135", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:48:08.650 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:08 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:48:08.650 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:08 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:48:08.650 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:08 smithi161 ceph-mon[99580]: Updating smithi135:/etc/ceph/ceph.conf 2023-09-23T08:48:08.650 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:08 smithi161 ceph-mon[99580]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi161", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:48:08.650 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:08 smithi161 ceph-mon[99580]: Updating smithi135:/var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/config/ceph.conf 2023-09-23T08:48:08.650 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:08 smithi161 ceph-mon[99580]: Deploying cephadm binary to smithi161 2023-09-23T08:48:08.650 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:08 smithi161 ceph-mon[99580]: Updating smithi135:/etc/ceph/ceph.client.admin.keyring 2023-09-23T08:48:08.650 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:08 smithi161 ceph-mon[99580]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:08.650 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:08 smithi161 ceph-mon[99580]: Updating smithi135:/var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/config/ceph.client.admin.keyring 2023-09-23T08:48:08.650 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:08 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:08.650 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:08 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:08.651 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:08 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:08.651 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:08 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:08.651 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:08 smithi161 ceph-mon[99580]: Added host smithi161 2023-09-23T08:48:08.651 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:08 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:48:08.651 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:08 smithi161 ceph-mon[99580]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:08.651 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:08 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:08.651 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:08 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:08.651 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:08 smithi161 ceph-mon[99580]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:08.651 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:08 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:08.651 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:08 smithi161 ceph-mon[99580]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-09-23T08:48:08.651 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:08 smithi161 ceph-mon[99580]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:08.651 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:08 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/635795742' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-09-23T08:48:08.652 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:08 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:08.652 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:08 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:08.652 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:08 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:08.652 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:08 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:08.652 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:08 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi161", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:48:08.652 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:08 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:48:08.652 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:08 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:48:08.652 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:08 smithi161 ceph-mon[99580]: Updating smithi161:/etc/ceph/ceph.conf 2023-09-23T08:48:08.652 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:08 smithi161 ceph-mon[99580]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:08.652 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:08 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/635795742' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-09-23T08:48:08.652 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:08 smithi161 ceph-mon[99580]: osdmap e4: 0 total, 0 up, 0 in 2023-09-23T08:48:08.652 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:08 smithi161 ceph-mon[99580]: Updating smithi161:/var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/config/ceph.conf 2023-09-23T08:48:08.653 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:08 smithi161 ceph-mon[99580]: Updating smithi161:/etc/ceph/ceph.client.admin.keyring 2023-09-23T08:48:08.653 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:08 smithi161 ceph-mon[99580]: Updating smithi161:/var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/config/ceph.client.admin.keyring 2023-09-23T08:48:08.653 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:08 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:08.653 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:08 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:08.653 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:08 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:08.653 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:08 smithi161 ceph-mon[99580]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:08.653 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:08 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:08.653 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:08 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:48:08.653 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:08 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:48:08.653 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:08 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:48:08.653 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:08 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:08.653 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:08 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-09-23T08:48:08.654 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:08 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:48:08.654 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:08 smithi161 ceph-mon[99580]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi082:172.21.15.82=a;smithi135:172.21.15.135=b;smithi161:172.21.15.161=c", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:48:08.654 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:08 smithi161 ceph-mon[99580]: Saving service mon spec with placement smithi082:172.21.15.82=a;smithi135:172.21.15.135=b;smithi161:172.21.15.161=c;count:3 2023-09-23T08:48:08.654 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:08 smithi161 ceph-mon[99580]: Deploying daemon mon.c on smithi161 2023-09-23T08:48:08.654 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:08 smithi161 ceph-mon[99580]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:08.654 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:08 smithi161 ceph-mon[99580]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:08.654 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:08 smithi161 ceph-mon[99580]: from='client.? 172.21.15.161:0/2196973429' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-09-23T08:48:08.654 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:08 smithi161 ceph-mon[99580]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2023-09-23T08:48:08.654 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:08 smithi161 ceph-mon[99580]: mon.c@-1(synchronizing) e1 handle_conf_change mon_allow_pool_delete 2023-09-23T08:48:08.654 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:08 smithi161 ceph-mon[99580]: expand_channel_meta expand map: {default=false} 2023-09-23T08:48:08.655 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:08 smithi161 ceph-mon[99580]: expand_channel_meta from 'false' to 'false' 2023-09-23T08:48:08.655 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:08 smithi161 ceph-mon[99580]: expand_channel_meta expanded map: {default=false} 2023-09-23T08:48:08.655 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:08 smithi161 ceph-mon[99580]: expand_channel_meta expand map: {default=info} 2023-09-23T08:48:08.655 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:08 smithi161 ceph-mon[99580]: expand_channel_meta from 'info' to 'info' 2023-09-23T08:48:08.655 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:08 smithi161 ceph-mon[99580]: expand_channel_meta expanded map: {default=info} 2023-09-23T08:48:08.655 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:08 smithi161 ceph-mon[99580]: expand_channel_meta expand map: {default=daemon} 2023-09-23T08:48:08.655 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:08 smithi161 ceph-mon[99580]: expand_channel_meta from 'daemon' to 'daemon' 2023-09-23T08:48:08.655 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:08 smithi161 ceph-mon[99580]: expand_channel_meta expanded map: {default=daemon} 2023-09-23T08:48:08.655 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:08 smithi161 ceph-mon[99580]: expand_channel_meta expand map: {default=debug} 2023-09-23T08:48:08.655 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:08 smithi161 ceph-mon[99580]: expand_channel_meta from 'debug' to 'debug' 2023-09-23T08:48:08.655 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:08 smithi161 ceph-mon[99580]: expand_channel_meta expanded map: {default=debug} 2023-09-23T08:48:08.656 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:08 smithi161 systemd[1]: Started Ceph mon.c for 8926e286-59ed-11ee-8db4-212e2dc638e7. 2023-09-23T08:48:08.792 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-09-23T08:48:08.792 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- ceph mon dump -f json 2023-09-23T08:48:09.512 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.c/config 2023-09-23T08:48:13.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:13 smithi082 ceph-mon[97694]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:13.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:13 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-09-23T08:48:13.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:13 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-23T08:48:13.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:13 smithi082 ceph-mon[97694]: mon.a calling monitor election 2023-09-23T08:48:13.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:13 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-23T08:48:13.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:13 smithi082 ceph-mon[97694]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:13.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:13 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-23T08:48:13.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:13 smithi082 ceph-mon[97694]: mon.c calling monitor election 2023-09-23T08:48:13.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:13 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-23T08:48:13.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:13 smithi082 ceph-mon[97694]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:13.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:13 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-23T08:48:13.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:13 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-23T08:48:13.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:13 smithi082 ceph-mon[97694]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-09-23T08:48:13.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:13 smithi082 ceph-mon[97694]: monmap e2: 2 mons at {a=[v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0],c=[v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0]} removed_ranks: {} 2023-09-23T08:48:13.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:13 smithi082 ceph-mon[97694]: fsmap 2023-09-23T08:48:13.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:13 smithi082 ceph-mon[97694]: osdmap e4: 0 total, 0 up, 0 in 2023-09-23T08:48:13.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:13 smithi082 ceph-mon[97694]: mgrmap e13: x(active, since 51s) 2023-09-23T08:48:13.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:13 smithi082 ceph-mon[97694]: overall HEALTH_OK 2023-09-23T08:48:13.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:13 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:13.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:13 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:13.873 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:13 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:13.873 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:13 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-09-23T08:48:13.873 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:13 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:48:13.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:13 smithi161 ceph-mon[99580]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:13.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:13 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-09-23T08:48:13.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:13 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-23T08:48:13.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:13 smithi161 ceph-mon[99580]: mon.a calling monitor election 2023-09-23T08:48:13.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:13 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-23T08:48:13.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:13 smithi161 ceph-mon[99580]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:13.900 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:13 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-23T08:48:13.900 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:13 smithi161 ceph-mon[99580]: mon.c calling monitor election 2023-09-23T08:48:13.900 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:13 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-23T08:48:13.900 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:13 smithi161 ceph-mon[99580]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:13.900 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:13 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-23T08:48:13.901 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:13 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-23T08:48:13.901 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:13 smithi161 ceph-mon[99580]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-09-23T08:48:13.901 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:13 smithi161 ceph-mon[99580]: monmap e2: 2 mons at {a=[v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0],c=[v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0]} removed_ranks: {} 2023-09-23T08:48:13.901 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:13 smithi161 ceph-mon[99580]: fsmap 2023-09-23T08:48:13.901 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:13 smithi161 ceph-mon[99580]: osdmap e4: 0 total, 0 up, 0 in 2023-09-23T08:48:13.901 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:13 smithi161 ceph-mon[99580]: mgrmap e13: x(active, since 51s) 2023-09-23T08:48:13.902 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:13 smithi161 ceph-mon[99580]: overall HEALTH_OK 2023-09-23T08:48:13.902 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:13 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:13.902 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:13 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:13.902 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:13 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:13.902 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:13 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-09-23T08:48:13.902 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:13 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:48:14.046 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:14.043+0000 7f9f32990700 1 -- 172.21.15.161:0/1168941260 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f140035c0 msgr2=0x7f9f14005a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:48:14.046 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:14.043+0000 7f9f32990700 1 --2- 172.21.15.161:0/1168941260 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f140035c0 0x7f9f14005a30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c1003f0 tx=0x7f9f1c00feb0 comp rx=0 tx=0).stop 2023-09-23T08:48:14.046 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:14.043+0000 7f9f32990700 1 -- 172.21.15.161:0/1168941260 shutdown_connections 2023-09-23T08:48:14.046 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:14.043+0000 7f9f32990700 1 --2- 172.21.15.161:0/1168941260 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f140035c0 0x7f9f14005a30 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:48:14.046 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:14.043+0000 7f9f32990700 1 -- 172.21.15.161:0/1168941260 >> 172.21.15.161:0/1168941260 conn(0x7f9f2c0fbf90 msgr2=0x7f9f2c0fe3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:48:14.046 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:14.043+0000 7f9f32990700 1 -- 172.21.15.161:0/1168941260 shutdown_connections 2023-09-23T08:48:14.047 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:14.043+0000 7f9f32990700 1 -- 172.21.15.161:0/1168941260 wait complete. 2023-09-23T08:48:14.047 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:14.044+0000 7f9f32990700 1 Processor -- start 2023-09-23T08:48:14.047 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:14.045+0000 7f9f32990700 1 -- start start 2023-09-23T08:48:14.048 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:14.045+0000 7f9f32990700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9f140035c0 0x7f9f2c19b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:48:14.048 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:14.045+0000 7f9f32990700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f2c19bb00 0x7f9f2c195640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:48:14.048 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:14.045+0000 7f9f32990700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f2c19c040 con 0x7f9f2c19bb00 2023-09-23T08:48:14.048 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:14.045+0000 7f9f32990700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f2c19c1b0 con 0x7f9f140035c0 2023-09-23T08:48:14.049 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:14.046+0000 7f9f2b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f2c19bb00 0x7f9f2c195640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:48:14.049 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:14.046+0000 7f9f2b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f2c19bb00 0x7f9f2c195640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.161:41266/0 (socket says 172.21.15.161:41266) 2023-09-23T08:48:14.049 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:14.046+0000 7f9f2b7fe700 1 -- 172.21.15.161:0/263178722 learned_addr learned my addr 172.21.15.161:0/263178722 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-09-23T08:48:14.049 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:14.046+0000 7f9f2bfff700 1 --2- 172.21.15.161:0/263178722 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9f140035c0 0x7f9f2c19b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:48:14.049 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:14.046+0000 7f9f2bfff700 1 -- 172.21.15.161:0/263178722 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9f140035c0 msgr2=0x7f9f2c19b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2023-09-23T08:48:14.049 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:14.046+0000 7f9f2bfff700 1 -- 172.21.15.161:0/263178722 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9f140035c0 msgr2=0x7f9f2c19b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-09-23T08:48:14.049 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:14.046+0000 7f9f2bfff700 1 --2- 172.21.15.161:0/263178722 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9f140035c0 0x7f9f2c19b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-09-23T08:48:14.050 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:14.046+0000 7f9f2bfff700 1 --2- 172.21.15.161:0/263178722 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9f140035c0 0x7f9f2c19b5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-09-23T08:48:14.050 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:14.046+0000 7f9f2b7fe700 1 -- 172.21.15.161:0/263178722 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9f140035c0 msgr2=0x7f9f2c19b5c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-23T08:48:14.050 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:14.046+0000 7f9f2b7fe700 1 --2- 172.21.15.161:0/263178722 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9f140035c0 0x7f9f2c19b5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:48:14.050 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:14.046+0000 7f9f2b7fe700 1 -- 172.21.15.161:0/263178722 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f1c00f900 con 0x7f9f2c19bb00 2023-09-23T08:48:14.051 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:14.047+0000 7f9f2b7fe700 1 --2- 172.21.15.161:0/263178722 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f2c19bb00 0x7f9f2c195640 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9f2000b730 tx=0x7f9f2000baf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:48:14.051 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:14.047+0000 7f9f297fa700 1 -- 172.21.15.161:0/263178722 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7f9f200041d0 con 0x7f9f2c19bb00 2023-09-23T08:48:14.051 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:14.047+0000 7f9f297fa700 1 -- 172.21.15.161:0/263178722 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9f20004330 con 0x7f9f2c19bb00 2023-09-23T08:48:14.051 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:14.047+0000 7f9f297fa700 1 -- 172.21.15.161:0/263178722 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7f9f200119c0 con 0x7f9f2c19bb00 2023-09-23T08:48:14.051 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:14.047+0000 7f9f32990700 1 -- 172.21.15.161:0/263178722 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f2c195c40 con 0x7f9f2c19bb00 2023-09-23T08:48:14.051 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:14.047+0000 7f9f32990700 1 -- 172.21.15.161:0/263178722 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f2c196210 con 0x7f9f2c19bb00 2023-09-23T08:48:14.052 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:14.048+0000 7f9f297fa700 1 -- 172.21.15.161:0/263178722 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) v1 ==== 45191+0+0 (secure 0 0 0) 0x7f9f200036a0 con 0x7f9f2c19bb00 2023-09-23T08:48:14.052 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:14.049+0000 7f9f32990700 1 -- 172.21.15.161:0/263178722 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f2c061f50 con 0x7f9f2c19bb00 2023-09-23T08:48:14.052 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:14.049+0000 7f9f297fa700 1 --2- 172.21.15.161:0/263178722 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f9f18037ff0 0x7f9f1803a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:48:14.052 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:14.049+0000 7f9f297fa700 1 -- 172.21.15.161:0/263178722 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f9f2004a670 con 0x7f9f2c19bb00 2023-09-23T08:48:14.052 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:14.049+0000 7f9f2bfff700 1 --2- 172.21.15.161:0/263178722 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f9f18037ff0 0x7f9f1803a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:48:14.053 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:14.050+0000 7f9f2bfff700 1 --2- 172.21.15.161:0/263178722 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f9f18037ff0 0x7f9f1803a4b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c00f8d0 tx=0x7f9f1c005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:48:14.057 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:14.055+0000 7f9f297fa700 1 -- 172.21.15.161:0/263178722 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f9f20021760 con 0x7f9f2c19bb00 2023-09-23T08:48:14.336 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:14.333+0000 7f9f32990700 1 -- 172.21.15.161:0/263178722 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f9f2c196b50 con 0x7f9f2c19bb00 2023-09-23T08:48:14.337 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:14.334+0000 7f9f297fa700 1 -- 172.21.15.161:0/263178722 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1006 (secure 0 0 0) 0x7f9f20018e80 con 0x7f9f2c19bb00 2023-09-23T08:48:14.337 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-09-23T08:48:14.337 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":2,"fsid":"8926e286-59ed-11ee-8db4-212e2dc638e7","modified":"2023-09-23T08:48:08.386546Z","created":"2023-09-23T08:46:12.893931Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:3300","nonce":0},{"type":"v1","addr":"172.21.15.82:6789","nonce":0}]},"addr":"172.21.15.82:6789/0","public_addr":"172.21.15.82:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:3300","nonce":0},{"type":"v1","addr":"172.21.15.161:6789","nonce":0}]},"addr":"172.21.15.161:6789/0","public_addr":"172.21.15.161:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2023-09-23T08:48:14.340 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:14.336+0000 7f9f32990700 1 -- 172.21.15.161:0/263178722 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f9f18037ff0 msgr2=0x7f9f1803a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:48:14.340 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:14.336+0000 7f9f32990700 1 --2- 172.21.15.161:0/263178722 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f9f18037ff0 0x7f9f1803a4b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c00f8d0 tx=0x7f9f1c005960 comp rx=0 tx=0).stop 2023-09-23T08:48:14.340 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:14.336+0000 7f9f32990700 1 -- 172.21.15.161:0/263178722 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f2c19bb00 msgr2=0x7f9f2c195640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:48:14.340 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:14.336+0000 7f9f32990700 1 --2- 172.21.15.161:0/263178722 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f2c19bb00 0x7f9f2c195640 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9f2000b730 tx=0x7f9f2000baf0 comp rx=0 tx=0).stop 2023-09-23T08:48:14.340 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:14.336+0000 7f9f32990700 1 -- 172.21.15.161:0/263178722 shutdown_connections 2023-09-23T08:48:14.340 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:14.337+0000 7f9f32990700 1 --2- 172.21.15.161:0/263178722 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f9f18037ff0 0x7f9f1803a4b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:48:14.340 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:14.337+0000 7f9f32990700 1 --2- 172.21.15.161:0/263178722 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9f140035c0 0x7f9f2c19b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:48:14.340 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:14.337+0000 7f9f32990700 1 --2- 172.21.15.161:0/263178722 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f2c19bb00 0x7f9f2c195640 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:48:14.340 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:14.337+0000 7f9f32990700 1 -- 172.21.15.161:0/263178722 >> 172.21.15.161:0/263178722 conn(0x7f9f2c0fbf90 msgr2=0x7f9f2c18e420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:48:14.340 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:14.337+0000 7f9f32990700 1 -- 172.21.15.161:0/263178722 shutdown_connections 2023-09-23T08:48:14.341 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:14.337+0000 7f9f32990700 1 -- 172.21.15.161:0/263178722 wait complete. 2023-09-23T08:48:14.341 INFO:teuthology.orchestra.run.smithi161.stderr:dumped monmap epoch 2 2023-09-23T08:48:14.653 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:14 smithi161 ceph-mon[99580]: Deploying daemon mon.b on smithi135 2023-09-23T08:48:14.653 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:14 smithi161 ceph-mon[99580]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:14.653 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:14 smithi161 ceph-mon[99580]: from='client.? 172.21.15.161:0/263178722' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-09-23T08:48:14.653 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:14 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-23T08:48:14.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:14 smithi082 ceph-mon[97694]: Deploying daemon mon.b on smithi135 2023-09-23T08:48:14.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:14 smithi082 ceph-mon[97694]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:14.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:14 smithi082 ceph-mon[97694]: from='client.? 172.21.15.161:0/263178722' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-09-23T08:48:14.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:14 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-23T08:48:15.796 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-09-23T08:48:15.797 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- ceph mon dump -f json 2023-09-23T08:48:16.516 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.c/config 2023-09-23T08:48:17.068 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:16 smithi161 ceph-mon[99580]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:17.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:16 smithi082 ceph-mon[97694]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:17.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 systemd[1]: Starting Ceph mon.b for 8926e286-59ed-11ee-8db4-212e2dc638e7... 2023-09-23T08:48:17.873 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 podman[99165]: 2023-09-23T08:48:17.874 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 bash[99165]: 61f6e41826408feebfc267ecebd5ac84a1cfcebc8c1bf7952cc121cf42572b99 2023-09-23T08:48:17.874 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: set uid:gid to 167:167 (ceph:ceph) 2023-09-23T08:48:17.874 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: ceph version 18.0.0-5661-gdb9a2d12 (db9a2d12746faa158579b8d032d53d472ae6b6b0) reef (dev), process ceph-mon, pid 7 2023-09-23T08:48:17.874 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: pidfile_write: ignore empty --pid-file 2023-09-23T08:48:17.874 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: load: jerasure load: lrc 2023-09-23T08:48:17.874 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: RocksDB version: 7.9.2 2023-09-23T08:48:17.874 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Git sha 0 2023-09-23T08:48:17.874 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Compile date 2023-09-23 06:34:51 2023-09-23T08:48:17.874 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: DB SUMMARY 2023-09-23T08:48:17.874 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: DB Session ID: WAUGCWPL5FATVTPTCB50 2023-09-23T08:48:17.874 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: CURRENT file: CURRENT 2023-09-23T08:48:17.875 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: IDENTITY file: IDENTITY 2023-09-23T08:48:17.875 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2023-09-23T08:48:17.875 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2023-09-23T08:48:17.875 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2023-09-23T08:48:17.875 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.error_if_exists: 0 2023-09-23T08:48:17.875 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.create_if_missing: 0 2023-09-23T08:48:17.875 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.paranoid_checks: 1 2023-09-23T08:48:17.875 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.flush_verify_memtable_count: 1 2023-09-23T08:48:17.875 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-09-23T08:48:17.875 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-09-23T08:48:17.876 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.env: 0x55e42ff75da0 2023-09-23T08:48:17.876 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.fs: PosixFileSystem 2023-09-23T08:48:17.876 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.info_log: 0x55e431273440 2023-09-23T08:48:17.876 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.max_file_opening_threads: 16 2023-09-23T08:48:17.876 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.statistics: (nil) 2023-09-23T08:48:17.876 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.use_fsync: 0 2023-09-23T08:48:17.876 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.max_log_file_size: 0 2023-09-23T08:48:17.876 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-09-23T08:48:17.876 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.log_file_time_to_roll: 0 2023-09-23T08:48:17.876 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.keep_log_file_num: 1000 2023-09-23T08:48:17.876 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.recycle_log_file_num: 0 2023-09-23T08:48:17.876 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.allow_fallocate: 1 2023-09-23T08:48:17.877 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.allow_mmap_reads: 0 2023-09-23T08:48:17.877 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.allow_mmap_writes: 0 2023-09-23T08:48:17.877 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.use_direct_reads: 0 2023-09-23T08:48:17.877 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-09-23T08:48:17.877 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.create_missing_column_families: 0 2023-09-23T08:48:17.877 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.db_log_dir: 2023-09-23T08:48:17.877 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.wal_dir: 2023-09-23T08:48:17.877 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.table_cache_numshardbits: 6 2023-09-23T08:48:18.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.WAL_ttl_seconds: 0 2023-09-23T08:48:18.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.WAL_size_limit_MB: 0 2023-09-23T08:48:18.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-09-23T08:48:18.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-09-23T08:48:18.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.is_fd_close_on_exec: 1 2023-09-23T08:48:18.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.advise_random_on_open: 1 2023-09-23T08:48:18.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.db_write_buffer_size: 0 2023-09-23T08:48:18.314 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.write_buffer_manager: 0x55e43122d4a0 2023-09-23T08:48:18.314 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-09-23T08:48:18.314 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-09-23T08:48:18.314 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.use_adaptive_mutex: 0 2023-09-23T08:48:18.314 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.rate_limiter: (nil) 2023-09-23T08:48:18.314 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-09-23T08:48:18.314 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.wal_recovery_mode: 2 2023-09-23T08:48:18.314 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.enable_thread_tracking: 0 2023-09-23T08:48:18.314 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.enable_pipelined_write: 0 2023-09-23T08:48:18.315 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.unordered_write: 0 2023-09-23T08:48:18.315 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-09-23T08:48:18.315 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-09-23T08:48:18.315 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-09-23T08:48:18.315 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-09-23T08:48:18.315 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.row_cache: None 2023-09-23T08:48:18.315 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.wal_filter: None 2023-09-23T08:48:18.315 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-09-23T08:48:18.315 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.allow_ingest_behind: 0 2023-09-23T08:48:18.315 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.two_write_queues: 0 2023-09-23T08:48:18.316 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.manual_wal_flush: 0 2023-09-23T08:48:18.316 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.wal_compression: 0 2023-09-23T08:48:18.316 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.atomic_flush: 0 2023-09-23T08:48:18.316 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-09-23T08:48:18.316 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.persist_stats_to_disk: 0 2023-09-23T08:48:18.316 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.write_dbid_to_manifest: 0 2023-09-23T08:48:18.316 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.log_readahead_size: 0 2023-09-23T08:48:18.316 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-09-23T08:48:18.316 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.best_efforts_recovery: 0 2023-09-23T08:48:18.317 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-09-23T08:48:18.317 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-09-23T08:48:18.317 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.allow_data_in_errors: 0 2023-09-23T08:48:18.317 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.db_host_id: __hostname__ 2023-09-23T08:48:18.318 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.enforce_single_del_contracts: true 2023-09-23T08:48:18.319 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.max_background_jobs: 2 2023-09-23T08:48:18.319 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.max_background_compactions: -1 2023-09-23T08:48:18.319 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.max_subcompactions: 1 2023-09-23T08:48:18.319 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-09-23T08:48:18.319 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-09-23T08:48:18.319 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.delayed_write_rate : 16777216 2023-09-23T08:48:18.319 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.max_total_wal_size: 0 2023-09-23T08:48:18.319 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-09-23T08:48:18.319 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.stats_dump_period_sec: 600 2023-09-23T08:48:18.319 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.stats_persist_period_sec: 600 2023-09-23T08:48:18.320 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-09-23T08:48:18.320 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.max_open_files: -1 2023-09-23T08:48:18.320 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.bytes_per_sync: 0 2023-09-23T08:48:18.320 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.wal_bytes_per_sync: 0 2023-09-23T08:48:18.321 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.strict_bytes_per_sync: 0 2023-09-23T08:48:18.321 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.compaction_readahead_size: 0 2023-09-23T08:48:18.321 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.max_background_flushes: -1 2023-09-23T08:48:18.321 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Compression algorithms supported: 2023-09-23T08:48:18.322 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-09-23T08:48:18.322 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: kZSTD supported: 0 2023-09-23T08:48:18.322 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: kXpressCompression supported: 0 2023-09-23T08:48:18.322 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: kLZ4HCCompression supported: 1 2023-09-23T08:48:18.322 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: kZlibCompression supported: 1 2023-09-23T08:48:18.322 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: kSnappyCompression supported: 1 2023-09-23T08:48:18.322 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: kLZ4Compression supported: 1 2023-09-23T08:48:18.322 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: kBZip2Compression supported: 0 2023-09-23T08:48:18.323 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Fast CRC32 supported: Supported on x86 2023-09-23T08:48:18.323 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: DMutex implementation: pthread_mutex_t 2023-09-23T08:48:18.323 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2023-09-23T08:48:18.323 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-09-23T08:48:18.323 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-09-23T08:48:18.323 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.merge_operator: 2023-09-23T08:48:18.323 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.compaction_filter: None 2023-09-23T08:48:18.323 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.compaction_filter_factory: None 2023-09-23T08:48:18.324 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.sst_partitioner_factory: None 2023-09-23T08:48:18.324 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.memtable_factory: SkipListFactory 2023-09-23T08:48:18.324 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.table_factory: BlockBasedTable 2023-09-23T08:48:18.324 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55e431273540) 2023-09-23T08:48:18.324 INFO:journalctl@ceph.mon.b.smithi135.stdout: cache_index_and_filter_blocks: 1 2023-09-23T08:48:18.324 INFO:journalctl@ceph.mon.b.smithi135.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-09-23T08:48:18.324 INFO:journalctl@ceph.mon.b.smithi135.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-09-23T08:48:18.324 INFO:journalctl@ceph.mon.b.smithi135.stdout: pin_top_level_index_and_filter: 1 2023-09-23T08:48:18.324 INFO:journalctl@ceph.mon.b.smithi135.stdout: index_type: 0 2023-09-23T08:48:18.324 INFO:journalctl@ceph.mon.b.smithi135.stdout: data_block_index_type: 0 2023-09-23T08:48:18.325 INFO:journalctl@ceph.mon.b.smithi135.stdout: index_shortening: 1 2023-09-23T08:48:18.325 INFO:journalctl@ceph.mon.b.smithi135.stdout: data_block_hash_table_util_ratio: 0.750000 2023-09-23T08:48:18.325 INFO:journalctl@ceph.mon.b.smithi135.stdout: checksum: 4 2023-09-23T08:48:18.325 INFO:journalctl@ceph.mon.b.smithi135.stdout: no_block_cache: 0 2023-09-23T08:48:18.325 INFO:journalctl@ceph.mon.b.smithi135.stdout: block_cache: 0x55e4312cb1f0 2023-09-23T08:48:18.325 INFO:journalctl@ceph.mon.b.smithi135.stdout: block_cache_name: BinnedLRUCache 2023-09-23T08:48:18.325 INFO:journalctl@ceph.mon.b.smithi135.stdout: block_cache_options: 2023-09-23T08:48:18.325 INFO:journalctl@ceph.mon.b.smithi135.stdout: capacity : 536870912 2023-09-23T08:48:18.325 INFO:journalctl@ceph.mon.b.smithi135.stdout: num_shard_bits : 4 2023-09-23T08:48:18.325 INFO:journalctl@ceph.mon.b.smithi135.stdout: strict_capacity_limit : 0 2023-09-23T08:48:18.325 INFO:journalctl@ceph.mon.b.smithi135.stdout: high_pri_pool_ratio: 0.000 2023-09-23T08:48:18.326 INFO:journalctl@ceph.mon.b.smithi135.stdout: block_cache_compressed: (nil) 2023-09-23T08:48:18.326 INFO:journalctl@ceph.mon.b.smithi135.stdout: persistent_cache: (nil) 2023-09-23T08:48:18.326 INFO:journalctl@ceph.mon.b.smithi135.stdout: block_size: 4096 2023-09-23T08:48:18.326 INFO:journalctl@ceph.mon.b.smithi135.stdout: block_size_deviation: 10 2023-09-23T08:48:18.326 INFO:journalctl@ceph.mon.b.smithi135.stdout: block_restart_interval: 16 2023-09-23T08:48:18.326 INFO:journalctl@ceph.mon.b.smithi135.stdout: index_block_restart_interval: 1 2023-09-23T08:48:18.326 INFO:journalctl@ceph.mon.b.smithi135.stdout: metadata_block_size: 4096 2023-09-23T08:48:18.326 INFO:journalctl@ceph.mon.b.smithi135.stdout: partition_filters: 0 2023-09-23T08:48:18.326 INFO:journalctl@ceph.mon.b.smithi135.stdout: use_delta_encoding: 1 2023-09-23T08:48:18.326 INFO:journalctl@ceph.mon.b.smithi135.stdout: filter_policy: bloomfilter 2023-09-23T08:48:18.327 INFO:journalctl@ceph.mon.b.smithi135.stdout: whole_key_filtering: 1 2023-09-23T08:48:18.327 INFO:journalctl@ceph.mon.b.smithi135.stdout: verify_compression: 0 2023-09-23T08:48:18.327 INFO:journalctl@ceph.mon.b.smithi135.stdout: read_amp_bytes_per_bit: 0 2023-09-23T08:48:18.327 INFO:journalctl@ceph.mon.b.smithi135.stdout: format_version: 5 2023-09-23T08:48:18.327 INFO:journalctl@ceph.mon.b.smithi135.stdout: enable_index_compression: 1 2023-09-23T08:48:18.327 INFO:journalctl@ceph.mon.b.smithi135.stdout: block_align: 0 2023-09-23T08:48:18.327 INFO:journalctl@ceph.mon.b.smithi135.stdout: max_auto_readahead_size: 262144 2023-09-23T08:48:18.327 INFO:journalctl@ceph.mon.b.smithi135.stdout: prepopulate_block_cache: 0 2023-09-23T08:48:18.327 INFO:journalctl@ceph.mon.b.smithi135.stdout: initial_auto_readahead_size: 8192 2023-09-23T08:48:18.327 INFO:journalctl@ceph.mon.b.smithi135.stdout: num_file_reads_for_auto_readahead: 2 2023-09-23T08:48:18.327 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.write_buffer_size: 33554432 2023-09-23T08:48:18.327 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.max_write_buffer_number: 2 2023-09-23T08:48:18.328 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.compression: NoCompression 2023-09-23T08:48:18.328 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.bottommost_compression: Disabled 2023-09-23T08:48:18.328 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.prefix_extractor: nullptr 2023-09-23T08:48:18.328 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-09-23T08:48:18.328 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.num_levels: 7 2023-09-23T08:48:18.328 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-09-23T08:48:18.328 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-09-23T08:48:18.328 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-09-23T08:48:18.328 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-09-23T08:48:18.328 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-09-23T08:48:18.328 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-09-23T08:48:18.329 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-09-23T08:48:18.329 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-09-23T08:48:18.329 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-09-23T08:48:18.329 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-09-23T08:48:18.329 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-09-23T08:48:18.329 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-09-23T08:48:18.329 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.compression_opts.window_bits: -14 2023-09-23T08:48:18.329 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.compression_opts.level: 32767 2023-09-23T08:48:18.329 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.compression_opts.strategy: 0 2023-09-23T08:48:18.329 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-09-23T08:48:18.329 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-09-23T08:48:18.329 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-09-23T08:48:18.330 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-09-23T08:48:18.330 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.compression_opts.enabled: false 2023-09-23T08:48:18.330 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-09-23T08:48:18.330 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-09-23T08:48:18.330 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-09-23T08:48:18.330 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-09-23T08:48:18.330 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.target_file_size_base: 67108864 2023-09-23T08:48:18.330 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.target_file_size_multiplier: 1 2023-09-23T08:48:18.330 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-09-23T08:48:18.330 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-09-23T08:48:18.331 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-09-23T08:48:18.331 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-09-23T08:48:18.331 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-09-23T08:48:18.331 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-09-23T08:48:18.331 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-09-23T08:48:18.331 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-09-23T08:48:18.331 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-09-23T08:48:18.331 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-09-23T08:48:18.331 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-09-23T08:48:18.331 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-09-23T08:48:18.331 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-09-23T08:48:18.332 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.arena_block_size: 1048576 2023-09-23T08:48:18.332 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-09-23T08:48:18.332 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-09-23T08:48:18.332 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.disable_auto_compactions: 0 2023-09-23T08:48:18.332 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-09-23T08:48:18.332 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-09-23T08:48:18.332 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-09-23T08:48:18.332 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-09-23T08:48:18.332 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-09-23T08:48:18.333 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-09-23T08:48:18.333 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-09-23T08:48:18.333 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-09-23T08:48:18.333 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-09-23T08:48:18.333 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-09-23T08:48:18.333 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.table_properties_collectors: 2023-09-23T08:48:18.333 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.inplace_update_support: 0 2023-09-23T08:48:18.333 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.inplace_update_num_locks: 10000 2023-09-23T08:48:18.333 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-09-23T08:48:18.333 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-09-23T08:48:18.334 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.memtable_huge_page_size: 0 2023-09-23T08:48:18.334 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.bloom_locality: 0 2023-09-23T08:48:18.334 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.max_successive_merges: 0 2023-09-23T08:48:18.334 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.optimize_filters_for_hits: 0 2023-09-23T08:48:18.334 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.paranoid_file_checks: 0 2023-09-23T08:48:18.334 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.force_consistency_checks: 1 2023-09-23T08:48:18.334 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.report_bg_io_stats: 0 2023-09-23T08:48:18.334 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.ttl: 2592000 2023-09-23T08:48:18.334 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.periodic_compaction_seconds: 0 2023-09-23T08:48:18.335 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-09-23T08:48:18.335 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-09-23T08:48:18.335 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.enable_blob_files: false 2023-09-23T08:48:18.335 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.min_blob_size: 0 2023-09-23T08:48:18.335 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.blob_file_size: 268435456 2023-09-23T08:48:18.335 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.blob_compression_type: NoCompression 2023-09-23T08:48:18.335 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.enable_blob_garbage_collection: false 2023-09-23T08:48:18.335 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-09-23T08:48:18.335 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-09-23T08:48:18.335 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-09-23T08:48:18.336 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.blob_file_starting_level: 0 2023-09-23T08:48:18.336 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-09-23T08:48:18.336 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-09-23T08:48:18.336 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2023-09-23T08:48:18.336 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: e33d52a7-65b8-4d55-ae28-618c2dbffb2e 2023-09-23T08:48:18.336 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: EVENT_LOG_v1 {"time_micros": 1695458897873367, "job": 1, "event": "recovery_started", "wal_files": [4]} 2023-09-23T08:48:18.336 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2023-09-23T08:48:18.336 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: EVENT_LOG_v1 {"time_micros": 1695458897874821, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1747, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1695458897, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "e33d52a7-65b8-4d55-ae28-618c2dbffb2e", "db_session_id": "WAUGCWPL5FATVTPTCB50", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2023-09-23T08:48:18.336 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: EVENT_LOG_v1 {"time_micros": 1695458897875100, "job": 1, "event": "recovery_finished"} 2023-09-23T08:48:18.336 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2023-09-23T08:48:18.337 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-09-23T08:48:18.337 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55e431368000 2023-09-23T08:48:18.337 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: DB pointer 0x55e431354000 2023-09-23T08:48:18.337 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-09-23T08:48:18.337 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-09-23T08:48:18.337 INFO:journalctl@ceph.mon.b.smithi135.stdout: ** DB Stats ** 2023-09-23T08:48:18.337 INFO:journalctl@ceph.mon.b.smithi135.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-09-23T08:48:18.337 INFO:journalctl@ceph.mon.b.smithi135.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-09-23T08:48:18.337 INFO:journalctl@ceph.mon.b.smithi135.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-09-23T08:48:18.338 INFO:journalctl@ceph.mon.b.smithi135.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-09-23T08:48:18.338 INFO:journalctl@ceph.mon.b.smithi135.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-09-23T08:48:18.338 INFO:journalctl@ceph.mon.b.smithi135.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-09-23T08:48:18.338 INFO:journalctl@ceph.mon.b.smithi135.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-09-23T08:48:18.338 INFO:journalctl@ceph.mon.b.smithi135.stdout: 2023-09-23T08:48:18.338 INFO:journalctl@ceph.mon.b.smithi135.stdout: ** Compaction Stats [default] ** 2023-09-23T08:48:18.338 INFO:journalctl@ceph.mon.b.smithi135.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-09-23T08:48:18.338 INFO:journalctl@ceph.mon.b.smithi135.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-09-23T08:48:18.338 INFO:journalctl@ceph.mon.b.smithi135.stdout: L0 1/0 1.71 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-09-23T08:48:18.338 INFO:journalctl@ceph.mon.b.smithi135.stdout: Sum 1/0 1.71 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-09-23T08:48:18.339 INFO:journalctl@ceph.mon.b.smithi135.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-09-23T08:48:18.339 INFO:journalctl@ceph.mon.b.smithi135.stdout: 2023-09-23T08:48:18.339 INFO:journalctl@ceph.mon.b.smithi135.stdout: ** Compaction Stats [default] ** 2023-09-23T08:48:18.339 INFO:journalctl@ceph.mon.b.smithi135.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-09-23T08:48:18.339 INFO:journalctl@ceph.mon.b.smithi135.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-09-23T08:48:18.339 INFO:journalctl@ceph.mon.b.smithi135.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-09-23T08:48:18.339 INFO:journalctl@ceph.mon.b.smithi135.stdout: 2023-09-23T08:48:18.339 INFO:journalctl@ceph.mon.b.smithi135.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-09-23T08:48:18.339 INFO:journalctl@ceph.mon.b.smithi135.stdout: 2023-09-23T08:48:18.340 INFO:journalctl@ceph.mon.b.smithi135.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-09-23T08:48:18.340 INFO:journalctl@ceph.mon.b.smithi135.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-09-23T08:48:18.340 INFO:journalctl@ceph.mon.b.smithi135.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-09-23T08:48:18.340 INFO:journalctl@ceph.mon.b.smithi135.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-09-23T08:48:18.340 INFO:journalctl@ceph.mon.b.smithi135.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-09-23T08:48:18.340 INFO:journalctl@ceph.mon.b.smithi135.stdout: AddFile(Keys): cumulative 0, interval 0 2023-09-23T08:48:18.340 INFO:journalctl@ceph.mon.b.smithi135.stdout: Cumulative compaction: 0.00 GB write, 0.20 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-09-23T08:48:18.340 INFO:journalctl@ceph.mon.b.smithi135.stdout: Interval compaction: 0.00 GB write, 0.20 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-09-23T08:48:18.340 INFO:journalctl@ceph.mon.b.smithi135.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-09-23T08:48:18.340 INFO:journalctl@ceph.mon.b.smithi135.stdout: Block cache BinnedLRUCache@0x55e4312cb1f0#7 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.3e-05 secs_since: 0 2023-09-23T08:48:18.341 INFO:journalctl@ceph.mon.b.smithi135.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2023-09-23T08:48:18.341 INFO:journalctl@ceph.mon.b.smithi135.stdout: 2023-09-23T08:48:18.341 INFO:journalctl@ceph.mon.b.smithi135.stdout: ** File Read Latency Histogram By Level [default] ** 2023-09-23T08:48:18.341 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: mon.b does not exist in monmap, will attempt to join an existing cluster 2023-09-23T08:48:18.341 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: using public_addr v2:172.21.15.135:0/0 -> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2023-09-23T08:48:18.341 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: starting mon.b rank -1 at public addrs [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] at bind addrs [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 2023-09-23T08:48:18.341 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: mon.b@-1(???) e0 preinit fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 2023-09-23T08:48:18.341 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: mon.b@-1(synchronizing).mds e1 new map 2023-09-23T08:48:18.341 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: mon.b@-1(synchronizing).mds e1 print_map 2023-09-23T08:48:18.341 INFO:journalctl@ceph.mon.b.smithi135.stdout: e1 2023-09-23T08:48:18.341 INFO:journalctl@ceph.mon.b.smithi135.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-09-23T08:48:18.341 INFO:journalctl@ceph.mon.b.smithi135.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-09-23T08:48:18.342 INFO:journalctl@ceph.mon.b.smithi135.stdout: legacy client fscid: -1 2023-09-23T08:48:18.342 INFO:journalctl@ceph.mon.b.smithi135.stdout: 2023-09-23T08:48:18.342 INFO:journalctl@ceph.mon.b.smithi135.stdout: No filesystems configured 2023-09-23T08:48:18.342 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2023-09-23T08:48:18.342 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2023-09-23T08:48:18.342 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2023-09-23T08:48:18.342 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2023-09-23T08:48:18.342 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2023-09-23T08:48:18.342 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2023-09-23T08:48:18.342 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 systemd[1]: Started Ceph mon.b for 8926e286-59ed-11ee-8db4-212e2dc638e7. 2023-09-23T08:48:18.342 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2023-09-23T08:48:18.343 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-09-23T08:48:18.343 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-09-23T08:48:18.343 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-09-23T08:48:18.343 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:18.343 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-09-23T08:48:18.343 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:18.343 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:18.343 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:18.343 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:18.343 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:18.343 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:18.344 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi135", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:48:18.344 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:48:18.344 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:48:18.344 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: Updating smithi135:/etc/ceph/ceph.conf 2023-09-23T08:48:18.344 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi161", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:48:18.344 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: Updating smithi135:/var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/config/ceph.conf 2023-09-23T08:48:18.344 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: Deploying cephadm binary to smithi161 2023-09-23T08:48:18.344 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: Updating smithi135:/etc/ceph/ceph.client.admin.keyring 2023-09-23T08:48:18.344 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:18.344 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: Updating smithi135:/var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/config/ceph.client.admin.keyring 2023-09-23T08:48:18.344 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:18.344 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:18.345 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:18.345 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:18.345 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: Added host smithi161 2023-09-23T08:48:18.345 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:48:18.345 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:18.345 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:18.345 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:18.345 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:18.345 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:18.345 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-09-23T08:48:18.345 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:18.346 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/635795742' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-09-23T08:48:18.346 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:18.346 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:18.346 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:18.346 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:18.346 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi161", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:48:18.346 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:48:18.346 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:48:18.346 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: Updating smithi161:/etc/ceph/ceph.conf 2023-09-23T08:48:18.346 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:18.346 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/635795742' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-09-23T08:48:18.346 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: osdmap e4: 0 total, 0 up, 0 in 2023-09-23T08:48:18.347 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: Updating smithi161:/var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/config/ceph.conf 2023-09-23T08:48:18.347 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: Updating smithi161:/etc/ceph/ceph.client.admin.keyring 2023-09-23T08:48:18.347 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: Updating smithi161:/var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/config/ceph.client.admin.keyring 2023-09-23T08:48:18.347 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:18.347 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:18.347 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:18.347 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:18.347 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:18.347 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:48:18.347 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:48:18.347 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:48:18.348 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:18.348 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-09-23T08:48:18.348 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:48:18.348 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi082:172.21.15.82=a;smithi135:172.21.15.135=b;smithi161:172.21.15.161=c", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:48:18.348 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: Saving service mon spec with placement smithi082:172.21.15.82=a;smithi135:172.21.15.135=b;smithi161:172.21.15.161=c;count:3 2023-09-23T08:48:18.348 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: Deploying daemon mon.c on smithi161 2023-09-23T08:48:18.348 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:18.348 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:18.348 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: from='client.? 172.21.15.161:0/2196973429' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-09-23T08:48:18.348 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:18.348 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-09-23T08:48:18.349 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-23T08:48:18.349 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: mon.a calling monitor election 2023-09-23T08:48:18.349 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-23T08:48:18.349 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:18.349 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-23T08:48:18.349 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: mon.c calling monitor election 2023-09-23T08:48:18.349 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-23T08:48:18.349 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:18.349 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-23T08:48:18.349 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-23T08:48:18.350 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-09-23T08:48:18.350 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: monmap e2: 2 mons at {a=[v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0],c=[v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0]} removed_ranks: {} 2023-09-23T08:48:18.350 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: fsmap 2023-09-23T08:48:18.350 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: osdmap e4: 0 total, 0 up, 0 in 2023-09-23T08:48:18.350 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: mgrmap e13: x(active, since 51s) 2023-09-23T08:48:18.350 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: overall HEALTH_OK 2023-09-23T08:48:18.350 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:18.350 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:18.350 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:18.351 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-09-23T08:48:18.351 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:48:18.351 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: Deploying daemon mon.b on smithi135 2023-09-23T08:48:18.351 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:18.351 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: from='client.? 172.21.15.161:0/263178722' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-09-23T08:48:18.351 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-23T08:48:18.351 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:18.351 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2023-09-23T08:48:18.351 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: mon.b@-1(synchronizing) e2 handle_conf_change mon_allow_pool_delete 2023-09-23T08:48:18.352 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: expand_channel_meta expand map: {default=false} 2023-09-23T08:48:18.352 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: expand_channel_meta from 'false' to 'false' 2023-09-23T08:48:18.352 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: expand_channel_meta expanded map: {default=false} 2023-09-23T08:48:18.352 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: expand_channel_meta expand map: {default=info} 2023-09-23T08:48:18.352 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: expand_channel_meta from 'info' to 'info' 2023-09-23T08:48:18.352 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: expand_channel_meta expanded map: {default=info} 2023-09-23T08:48:18.352 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: expand_channel_meta expand map: {default=daemon} 2023-09-23T08:48:18.352 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: expand_channel_meta from 'daemon' to 'daemon' 2023-09-23T08:48:18.352 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: expand_channel_meta expanded map: {default=daemon} 2023-09-23T08:48:18.352 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: expand_channel_meta expand map: {default=debug} 2023-09-23T08:48:18.353 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: expand_channel_meta from 'debug' to 'debug' 2023-09-23T08:48:18.353 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:17 smithi135 ceph-mon[99205]: expand_channel_meta expanded map: {default=debug} 2023-09-23T08:48:23.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:22 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-09-23T08:48:23.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:22 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-23T08:48:23.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:22 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-23T08:48:23.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:22 smithi082 ceph-mon[97694]: mon.a calling monitor election 2023-09-23T08:48:23.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:22 smithi082 ceph-mon[97694]: mon.c calling monitor election 2023-09-23T08:48:23.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:22 smithi082 ceph-mon[97694]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:23.372 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:22 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-23T08:48:23.372 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:22 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-23T08:48:23.372 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:22 smithi082 ceph-mon[97694]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:23.372 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:22 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-23T08:48:23.372 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:22 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-23T08:48:23.372 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:22 smithi082 ceph-mon[97694]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:23.372 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:22 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-23T08:48:23.372 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:22 smithi082 ceph-mon[97694]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-09-23T08:48:23.372 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:22 smithi082 ceph-mon[97694]: monmap e3: 3 mons at {a=[v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0],b=[v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0],c=[v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0]} removed_ranks: {} 2023-09-23T08:48:23.372 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:22 smithi082 ceph-mon[97694]: fsmap 2023-09-23T08:48:23.372 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:22 smithi082 ceph-mon[97694]: osdmap e4: 0 total, 0 up, 0 in 2023-09-23T08:48:23.373 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:22 smithi082 ceph-mon[97694]: mgrmap e13: x(active, since 60s) 2023-09-23T08:48:23.373 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:22 smithi082 ceph-mon[97694]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2023-09-23T08:48:23.373 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:22 smithi082 ceph-mon[97694]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2023-09-23T08:48:23.373 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:22 smithi082 ceph-mon[97694]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2023-09-23T08:48:23.373 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:22 smithi082 ceph-mon[97694]: mon.b (rank 2) addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] is down (out of quorum) 2023-09-23T08:48:23.373 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:22 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:23.373 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:22 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:23.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:22 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-09-23T08:48:23.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:22 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-23T08:48:23.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:22 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-23T08:48:23.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:22 smithi161 ceph-mon[99580]: mon.a calling monitor election 2023-09-23T08:48:23.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:22 smithi161 ceph-mon[99580]: mon.c calling monitor election 2023-09-23T08:48:23.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:22 smithi161 ceph-mon[99580]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:23.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:22 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-23T08:48:23.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:22 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-23T08:48:23.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:22 smithi161 ceph-mon[99580]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:23.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:22 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-23T08:48:23.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:22 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-23T08:48:23.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:22 smithi161 ceph-mon[99580]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:23.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:22 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-23T08:48:23.400 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:22 smithi161 ceph-mon[99580]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-09-23T08:48:23.400 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:22 smithi161 ceph-mon[99580]: monmap e3: 3 mons at {a=[v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0],b=[v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0],c=[v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0]} removed_ranks: {} 2023-09-23T08:48:23.400 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:22 smithi161 ceph-mon[99580]: fsmap 2023-09-23T08:48:23.400 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:22 smithi161 ceph-mon[99580]: osdmap e4: 0 total, 0 up, 0 in 2023-09-23T08:48:23.400 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:22 smithi161 ceph-mon[99580]: mgrmap e13: x(active, since 60s) 2023-09-23T08:48:23.400 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:22 smithi161 ceph-mon[99580]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2023-09-23T08:48:23.400 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:22 smithi161 ceph-mon[99580]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2023-09-23T08:48:23.400 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:22 smithi161 ceph-mon[99580]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2023-09-23T08:48:23.400 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:22 smithi161 ceph-mon[99580]: mon.b (rank 2) addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] is down (out of quorum) 2023-09-23T08:48:23.400 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:22 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:23.400 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:22 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:24.015 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:24.012+0000 7fe708468700 1 -- 172.21.15.161:0/3859491692 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6ec006210 msgr2=0x7fe6ec0086a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:48:24.016 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:24.012+0000 7fe708468700 1 --2- 172.21.15.161:0/3859491692 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6ec006210 0x7fe6ec0086a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe700073d80 tx=0x7fe6fc00fe90 comp rx=0 tx=0).stop 2023-09-23T08:48:24.016 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:24.012+0000 7fe708468700 1 -- 172.21.15.161:0/3859491692 shutdown_connections 2023-09-23T08:48:24.016 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:24.012+0000 7fe708468700 1 --2- 172.21.15.161:0/3859491692 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6ec006210 0x7fe6ec0086a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:48:24.016 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:24.012+0000 7fe708468700 1 -- 172.21.15.161:0/3859491692 >> 172.21.15.161:0/3859491692 conn(0x7fe7000fbf90 msgr2=0x7fe7000fe3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:48:24.016 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:24.012+0000 7fe708468700 1 -- 172.21.15.161:0/3859491692 shutdown_connections 2023-09-23T08:48:24.016 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:24.012+0000 7fe708468700 1 -- 172.21.15.161:0/3859491692 wait complete. 2023-09-23T08:48:24.017 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:24.013+0000 7fe708468700 1 Processor -- start 2023-09-23T08:48:24.018 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:24.013+0000 7fe708468700 1 -- start start 2023-09-23T08:48:24.018 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:24.014+0000 7fe708468700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6ec006210 0x7fe700197d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:48:24.018 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:24.014+0000 7fe708468700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe700198250 0x7fe70019c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:48:24.018 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:24.014+0000 7fe708468700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe70019cc00 0x7fe70019d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:48:24.018 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:24.014+0000 7fe708468700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe700198940 con 0x7fe700198250 2023-09-23T08:48:24.018 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:24.014+0000 7fe708468700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7001a4970 con 0x7fe6ec006210 2023-09-23T08:48:24.018 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:24.014+0000 7fe708468700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7001a4ab0 con 0x7fe70019cc00 2023-09-23T08:48:24.018 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:24.014+0000 7fe706a05700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe70019cc00 0x7fe70019d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:48:24.018 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:24.014+0000 7fe706a05700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe70019cc00 0x7fe70019d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:51094/0 (socket says 172.21.15.161:51094) 2023-09-23T08:48:24.018 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:24.014+0000 7fe706a05700 1 -- 172.21.15.161:0/3050055253 learned_addr learned my addr 172.21.15.161:0/3050055253 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-09-23T08:48:24.019 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:24.014+0000 7fe705a03700 1 --2- 172.21.15.161:0/3050055253 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe700198250 0x7fe70019c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:48:24.019 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:24.014+0000 7fe706204700 1 --2- 172.21.15.161:0/3050055253 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6ec006210 0x7fe700197d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:48:24.019 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:24.015+0000 7fe706204700 1 -- 172.21.15.161:0/3050055253 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6ec006210 msgr2=0x7fe700197d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2023-09-23T08:48:24.019 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:24.015+0000 7fe706204700 1 -- 172.21.15.161:0/3050055253 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6ec006210 msgr2=0x7fe700197d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-09-23T08:48:24.019 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:24.015+0000 7fe706204700 1 --2- 172.21.15.161:0/3050055253 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6ec006210 0x7fe700197d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-09-23T08:48:24.019 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:24.015+0000 7fe706204700 1 --2- 172.21.15.161:0/3050055253 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6ec006210 0x7fe700197d10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-09-23T08:48:24.019 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:24.015+0000 7fe706a05700 1 -- 172.21.15.161:0/3050055253 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6ec006210 msgr2=0x7fe700197d10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-23T08:48:24.019 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:24.015+0000 7fe706a05700 1 --2- 172.21.15.161:0/3050055253 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6ec006210 0x7fe700197d10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:48:24.019 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:24.015+0000 7fe706a05700 1 -- 172.21.15.161:0/3050055253 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe700198250 msgr2=0x7fe70019c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:48:24.019 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:24.015+0000 7fe706a05700 1 --2- 172.21.15.161:0/3050055253 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe700198250 0x7fe70019c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:48:24.019 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:24.015+0000 7fe706a05700 1 -- 172.21.15.161:0/3050055253 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6fc00f8e0 con 0x7fe70019cc00 2023-09-23T08:48:24.019 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:24.015+0000 7fe706a05700 1 --2- 172.21.15.161:0/3050055253 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe70019cc00 0x7fe70019d0b0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fe6f800ba50 tx=0x7fe6f800bd60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:48:24.020 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:24.015+0000 7fe6f77fe700 1 -- 172.21.15.161:0/3050055253 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f800c9b0 con 0x7fe70019cc00 2023-09-23T08:48:24.020 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:24.015+0000 7fe6f77fe700 1 -- 172.21.15.161:0/3050055253 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe6f8014440 con 0x7fe70019cc00 2023-09-23T08:48:24.020 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:24.015+0000 7fe708468700 1 -- 172.21.15.161:0/3050055253 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7001a4d90 con 0x7fe70019cc00 2023-09-23T08:48:24.020 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:24.015+0000 7fe6f77fe700 1 -- 172.21.15.161:0/3050055253 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f80075b0 con 0x7fe70019cc00 2023-09-23T08:48:24.020 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:24.015+0000 7fe708468700 1 -- 172.21.15.161:0/3050055253 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7001a5230 con 0x7fe70019cc00 2023-09-23T08:48:24.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:24.017+0000 7fe708468700 1 -- 172.21.15.161:0/3050055253 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe700192150 con 0x7fe70019cc00 2023-09-23T08:48:24.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:24.017+0000 7fe6f77fe700 1 -- 172.21.15.161:0/3050055253 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 13) v1 ==== 45191+0+0 (secure 0 0 0) 0x7fe6f800cb10 con 0x7fe70019cc00 2023-09-23T08:48:24.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:24.018+0000 7fe6f77fe700 1 --2- 172.21.15.161:0/3050055253 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fe6e4038680 0x7fe6e403ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:48:24.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:24.018+0000 7fe6f77fe700 1 -- 172.21.15.161:0/3050055253 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fe6f80538a0 con 0x7fe70019cc00 2023-09-23T08:48:24.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:24.019+0000 7fe706204700 1 --2- 172.21.15.161:0/3050055253 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fe6e4038680 0x7fe6e403ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:48:24.022 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:24.019+0000 7fe706204700 1 --2- 172.21.15.161:0/3050055253 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fe6e4038680 0x7fe6e403ab40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc00f550 tx=0x7fe6fc00f4a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:48:24.031 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:24.029+0000 7fe6f77fe700 1 -- 172.21.15.161:0/3050055253 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7fe6f8012b30 con 0x7fe70019cc00 2023-09-23T08:48:24.322 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:24.319+0000 7fe708468700 1 -- 172.21.15.161:0/3050055253 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fe700061f50 con 0x7fe70019cc00 2023-09-23T08:48:24.322 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:24.319+0000 7fe6f77fe700 1 -- 172.21.15.161:0/3050055253 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) v1 ==== 95+0+1274 (secure 0 0 0) 0x7fe6f8019020 con 0x7fe70019cc00 2023-09-23T08:48:24.323 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-09-23T08:48:24.323 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":3,"fsid":"8926e286-59ed-11ee-8db4-212e2dc638e7","modified":"2023-09-23T08:48:17.924196Z","created":"2023-09-23T08:46:12.893931Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:3300","nonce":0},{"type":"v1","addr":"172.21.15.82:6789","nonce":0}]},"addr":"172.21.15.82:6789/0","public_addr":"172.21.15.82:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:3300","nonce":0},{"type":"v1","addr":"172.21.15.161:6789","nonce":0}]},"addr":"172.21.15.161:6789/0","public_addr":"172.21.15.161:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2023-09-23T08:48:24.325 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:24.322+0000 7fe708468700 1 -- 172.21.15.161:0/3050055253 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fe6e4038680 msgr2=0x7fe6e403ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:48:24.325 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:24.322+0000 7fe708468700 1 --2- 172.21.15.161:0/3050055253 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fe6e4038680 0x7fe6e403ab40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc00f550 tx=0x7fe6fc00f4a0 comp rx=0 tx=0).stop 2023-09-23T08:48:24.325 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:24.322+0000 7fe708468700 1 -- 172.21.15.161:0/3050055253 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe70019cc00 msgr2=0x7fe70019d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:48:24.325 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:24.322+0000 7fe708468700 1 --2- 172.21.15.161:0/3050055253 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe70019cc00 0x7fe70019d0b0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fe6f800ba50 tx=0x7fe6f800bd60 comp rx=0 tx=0).stop 2023-09-23T08:48:24.325 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:24.322+0000 7fe708468700 1 -- 172.21.15.161:0/3050055253 shutdown_connections 2023-09-23T08:48:24.325 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:24.322+0000 7fe708468700 1 --2- 172.21.15.161:0/3050055253 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fe6e4038680 0x7fe6e403ab40 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:48:24.326 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:24.322+0000 7fe708468700 1 --2- 172.21.15.161:0/3050055253 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe70019cc00 0x7fe70019d0b0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:48:24.326 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:24.322+0000 7fe708468700 1 --2- 172.21.15.161:0/3050055253 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6ec006210 0x7fe700197d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:48:24.326 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:24.322+0000 7fe708468700 1 --2- 172.21.15.161:0/3050055253 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe700198250 0x7fe70019c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:48:24.326 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:24.322+0000 7fe708468700 1 -- 172.21.15.161:0/3050055253 >> 172.21.15.161:0/3050055253 conn(0x7fe7000fbf90 msgr2=0x7fe700104900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:48:24.326 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:24.322+0000 7fe708468700 1 -- 172.21.15.161:0/3050055253 shutdown_connections 2023-09-23T08:48:24.326 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:24.322+0000 7fe708468700 1 -- 172.21.15.161:0/3050055253 wait complete. 2023-09-23T08:48:24.326 INFO:teuthology.orchestra.run.smithi161.stderr:dumped monmap epoch 3 2023-09-23T08:48:24.347 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:23 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:24.347 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:23 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:24.347 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:23 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:48:24.348 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:23 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-23T08:48:24.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:23 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:24.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:23 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:24.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:23 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:48:24.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:23 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-23T08:48:24.802 INFO:tasks.cephadm:Generating final ceph.conf file... 2023-09-23T08:48:24.864 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- ceph config generate-minimal-conf 2023-09-23T08:48:25.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:24 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-09-23T08:48:25.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:24 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-23T08:48:25.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:24 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-23T08:48:25.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:24 smithi135 ceph-mon[99205]: mon.a calling monitor election 2023-09-23T08:48:25.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:24 smithi135 ceph-mon[99205]: mon.c calling monitor election 2023-09-23T08:48:25.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:24 smithi135 ceph-mon[99205]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:25.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:24 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-23T08:48:25.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:24 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-23T08:48:25.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:24 smithi135 ceph-mon[99205]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:25.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:24 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-23T08:48:25.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:24 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-23T08:48:25.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:24 smithi135 ceph-mon[99205]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:25.314 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:24 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-23T08:48:25.314 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:24 smithi135 ceph-mon[99205]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-09-23T08:48:25.314 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:24 smithi135 ceph-mon[99205]: monmap e3: 3 mons at {a=[v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0],b=[v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0],c=[v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0]} removed_ranks: {} 2023-09-23T08:48:25.314 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:24 smithi135 ceph-mon[99205]: fsmap 2023-09-23T08:48:25.314 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:24 smithi135 ceph-mon[99205]: osdmap e4: 0 total, 0 up, 0 in 2023-09-23T08:48:25.314 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:24 smithi135 ceph-mon[99205]: mgrmap e13: x(active, since 60s) 2023-09-23T08:48:25.314 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:24 smithi135 ceph-mon[99205]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2023-09-23T08:48:25.314 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:24 smithi135 ceph-mon[99205]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2023-09-23T08:48:25.314 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:24 smithi135 ceph-mon[99205]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2023-09-23T08:48:25.315 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:24 smithi135 ceph-mon[99205]: mon.b (rank 2) addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] is down (out of quorum) 2023-09-23T08:48:25.315 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:24 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:25.315 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:24 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:25.315 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:24 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:25.315 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:24 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:25.315 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:24 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:48:25.315 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:24 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-23T08:48:25.612 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.a/config 2023-09-23T08:48:25.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:25 smithi082 ceph-mon[97694]: mon.b calling monitor election 2023-09-23T08:48:25.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:25 smithi082 ceph-mon[97694]: mon.b calling monitor election 2023-09-23T08:48:25.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:25 smithi082 ceph-mon[97694]: mon.c calling monitor election 2023-09-23T08:48:25.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:25 smithi082 ceph-mon[97694]: mon.a calling monitor election 2023-09-23T08:48:25.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:25 smithi082 ceph-mon[97694]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-09-23T08:48:25.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:25 smithi082 ceph-mon[97694]: monmap e3: 3 mons at {a=[v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0],b=[v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0],c=[v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0]} removed_ranks: {} 2023-09-23T08:48:25.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:25 smithi082 ceph-mon[97694]: fsmap 2023-09-23T08:48:25.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:25 smithi082 ceph-mon[97694]: osdmap e4: 0 total, 0 up, 0 in 2023-09-23T08:48:25.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:25 smithi082 ceph-mon[97694]: mgrmap e13: x(active, since 62s) 2023-09-23T08:48:25.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:25 smithi082 ceph-mon[97694]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2023-09-23T08:48:25.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:25 smithi082 ceph-mon[97694]: Cluster is now healthy 2023-09-23T08:48:25.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:25 smithi082 ceph-mon[97694]: overall HEALTH_OK 2023-09-23T08:48:25.623 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:25 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:25.623 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:25 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:25.623 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:25 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:25.623 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:25 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:25.623 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:25 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:48:25.623 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:25 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:48:25.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:25 smithi161 ceph-mon[99580]: mon.b calling monitor election 2023-09-23T08:48:25.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:25 smithi161 ceph-mon[99580]: mon.b calling monitor election 2023-09-23T08:48:25.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:25 smithi161 ceph-mon[99580]: mon.c calling monitor election 2023-09-23T08:48:25.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:25 smithi161 ceph-mon[99580]: mon.a calling monitor election 2023-09-23T08:48:25.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:25 smithi161 ceph-mon[99580]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-09-23T08:48:25.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:25 smithi161 ceph-mon[99580]: monmap e3: 3 mons at {a=[v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0],b=[v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0],c=[v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0]} removed_ranks: {} 2023-09-23T08:48:25.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:25 smithi161 ceph-mon[99580]: fsmap 2023-09-23T08:48:25.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:25 smithi161 ceph-mon[99580]: osdmap e4: 0 total, 0 up, 0 in 2023-09-23T08:48:25.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:25 smithi161 ceph-mon[99580]: mgrmap e13: x(active, since 62s) 2023-09-23T08:48:25.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:25 smithi161 ceph-mon[99580]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2023-09-23T08:48:25.650 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:25 smithi161 ceph-mon[99580]: Cluster is now healthy 2023-09-23T08:48:25.650 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:25 smithi161 ceph-mon[99580]: overall HEALTH_OK 2023-09-23T08:48:25.650 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:25 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:25.650 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:25 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:25.650 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:25 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:25.650 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:25 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:25.650 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:25 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:48:25.650 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:25 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:48:25.814 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:25 smithi135 ceph-mon[99205]: mon.b calling monitor election 2023-09-23T08:48:25.814 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:25 smithi135 ceph-mon[99205]: mon.b calling monitor election 2023-09-23T08:48:25.814 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:25 smithi135 ceph-mon[99205]: mon.c calling monitor election 2023-09-23T08:48:25.814 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:25 smithi135 ceph-mon[99205]: mon.a calling monitor election 2023-09-23T08:48:25.815 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:25 smithi135 ceph-mon[99205]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-09-23T08:48:25.815 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:25 smithi135 ceph-mon[99205]: monmap e3: 3 mons at {a=[v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0],b=[v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0],c=[v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0]} removed_ranks: {} 2023-09-23T08:48:25.815 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:25 smithi135 ceph-mon[99205]: fsmap 2023-09-23T08:48:25.815 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:25 smithi135 ceph-mon[99205]: osdmap e4: 0 total, 0 up, 0 in 2023-09-23T08:48:25.815 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:25 smithi135 ceph-mon[99205]: mgrmap e13: x(active, since 62s) 2023-09-23T08:48:25.816 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:25 smithi135 ceph-mon[99205]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2023-09-23T08:48:25.816 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:25 smithi135 ceph-mon[99205]: Cluster is now healthy 2023-09-23T08:48:25.816 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:25 smithi135 ceph-mon[99205]: overall HEALTH_OK 2023-09-23T08:48:25.816 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:25 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:25.816 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:25 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:25.817 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:25 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:25.817 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:25 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:25.817 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:25 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:48:25.817 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:25 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:48:26.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:26 smithi082 ceph-mon[97694]: Updating smithi082:/etc/ceph/ceph.conf 2023-09-23T08:48:26.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:26 smithi082 ceph-mon[97694]: Updating smithi135:/etc/ceph/ceph.conf 2023-09-23T08:48:26.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:26 smithi082 ceph-mon[97694]: Updating smithi161:/etc/ceph/ceph.conf 2023-09-23T08:48:26.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:26 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-23T08:48:26.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:26 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:26.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:26 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:26.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:26 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:26.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:26 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:26.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:26 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:26.623 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:26 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:26.623 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:26 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:26.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:26 smithi161 ceph-mon[99580]: Updating smithi082:/etc/ceph/ceph.conf 2023-09-23T08:48:26.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:26 smithi161 ceph-mon[99580]: Updating smithi135:/etc/ceph/ceph.conf 2023-09-23T08:48:26.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:26 smithi161 ceph-mon[99580]: Updating smithi161:/etc/ceph/ceph.conf 2023-09-23T08:48:26.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:26 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-23T08:48:26.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:26 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:26.650 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:26 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:26.650 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:26 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:26.650 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:26 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:26.650 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:26 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:26.650 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:26 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:26.650 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:26 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:26.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:26 smithi135 ceph-mon[99205]: Updating smithi082:/etc/ceph/ceph.conf 2023-09-23T08:48:26.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:26 smithi135 ceph-mon[99205]: Updating smithi135:/etc/ceph/ceph.conf 2023-09-23T08:48:26.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:26 smithi135 ceph-mon[99205]: Updating smithi161:/etc/ceph/ceph.conf 2023-09-23T08:48:26.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:26 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-23T08:48:26.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:26 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:26.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:26 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:26.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:26 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:26.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:26 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:26.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:26 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:26.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:26 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:26.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:26 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:27.120 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:48:26 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:48:26.925+0000 7f47e0535700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-09-23T08:48:27.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:27.445+0000 7f8ee14bd700 1 -- 172.21.15.82:0/699883007 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8edc100610 msgr2=0x7f8edc1009f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:48:27.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:27.445+0000 7f8ee14bd700 1 --2- 172.21.15.82:0/699883007 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8edc100610 0x7f8edc1009f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc009910 tx=0x7f8ecc009c20 comp rx=0 tx=0).stop 2023-09-23T08:48:27.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:27.445+0000 7f8ee14bd700 1 -- 172.21.15.82:0/699883007 shutdown_connections 2023-09-23T08:48:27.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:27.445+0000 7f8ee14bd700 1 --2- 172.21.15.82:0/699883007 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8edc100610 0x7f8edc1009f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:48:27.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:27.445+0000 7f8ee14bd700 1 -- 172.21.15.82:0/699883007 >> 172.21.15.82:0/699883007 conn(0x7f8edc0fbee0 msgr2=0x7f8edc0fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:48:27.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:27.445+0000 7f8ee14bd700 1 -- 172.21.15.82:0/699883007 shutdown_connections 2023-09-23T08:48:27.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:27.445+0000 7f8ee14bd700 1 -- 172.21.15.82:0/699883007 wait complete. 2023-09-23T08:48:27.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:27.446+0000 7f8ee14bd700 1 Processor -- start 2023-09-23T08:48:27.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:27.447+0000 7f8ee14bd700 1 -- start start 2023-09-23T08:48:27.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:27.447+0000 7f8ee14bd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8edc100610 0x7f8edc19b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:48:27.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:27.447+0000 7f8ee14bd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8edc19bd10 0x7f8edc195850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:48:27.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:27.447+0000 7f8ee14bd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8edc195d90 0x7f8edc196240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:48:27.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:27.447+0000 7f8ee14bd700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8edc19c370 con 0x7f8edc195d90 2023-09-23T08:48:27.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:27.447+0000 7f8ee14bd700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8edc1a25f0 con 0x7f8edc100610 2023-09-23T08:48:27.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:27.447+0000 7f8ee14bd700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8edc1a2780 con 0x7f8edc19bd10 2023-09-23T08:48:27.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:27.447+0000 7f8edb7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8edc195d90 0x7f8edc196240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:48:27.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:27.447+0000 7f8edb7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8edc195d90 0x7f8edc196240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39866/0 (socket says 172.21.15.82:39866) 2023-09-23T08:48:27.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:27.447+0000 7f8edb7fe700 1 -- 172.21.15.82:0/2534448411 learned_addr learned my addr 172.21.15.82:0/2534448411 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:48:27.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:27.448+0000 7f8edaffd700 1 --2- 172.21.15.82:0/2534448411 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8edc100610 0x7f8edc19b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:48:27.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:27.448+0000 7f8eda7fc700 1 --2- 172.21.15.82:0/2534448411 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8edc19bd10 0x7f8edc195850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:48:27.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:27.448+0000 7f8edb7fe700 1 -- 172.21.15.82:0/2534448411 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8edc19bd10 msgr2=0x7f8edc195850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:48:27.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:27.448+0000 7f8edb7fe700 1 --2- 172.21.15.82:0/2534448411 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8edc19bd10 0x7f8edc195850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:48:27.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:27.448+0000 7f8edb7fe700 1 -- 172.21.15.82:0/2534448411 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8edc100610 msgr2=0x7f8edc19b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:48:27.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:27.448+0000 7f8edb7fe700 1 --2- 172.21.15.82:0/2534448411 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8edc100610 0x7f8edc19b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:48:27.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:27.448+0000 7f8edb7fe700 1 -- 172.21.15.82:0/2534448411 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ecc0095f0 con 0x7f8edc195d90 2023-09-23T08:48:27.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:27.448+0000 7f8eda7fc700 1 --2- 172.21.15.82:0/2534448411 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8edc19bd10 0x7f8edc195850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T08:48:27.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:27.448+0000 7f8edb7fe700 1 --2- 172.21.15.82:0/2534448411 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8edc195d90 0x7f8edc196240 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8ed400ba50 tx=0x7f8ed400be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:48:27.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:27.448+0000 7f8ec3fff700 1 -- 172.21.15.82:0/2534448411 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed400cab0 con 0x7f8edc195d90 2023-09-23T08:48:27.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:27.448+0000 7f8ec3fff700 1 -- 172.21.15.82:0/2534448411 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8ed400cc10 con 0x7f8edc195d90 2023-09-23T08:48:27.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:27.448+0000 7f8ec3fff700 1 -- 172.21.15.82:0/2534448411 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed40075b0 con 0x7f8edc195d90 2023-09-23T08:48:27.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:27.448+0000 7f8ee14bd700 1 -- 172.21.15.82:0/2534448411 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8edc1a2a60 con 0x7f8edc195d90 2023-09-23T08:48:27.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:27.448+0000 7f8ee14bd700 1 -- 172.21.15.82:0/2534448411 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8edc1a2f10 con 0x7f8edc195d90 2023-09-23T08:48:27.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:27.449+0000 7f8ec3fff700 1 -- 172.21.15.82:0/2534448411 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) v1 ==== 45191+0+0 (secure 0 0 0) 0x7f8ed4014440 con 0x7f8edc195d90 2023-09-23T08:48:27.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:27.449+0000 7f8ee14bd700 1 -- 172.21.15.82:0/2534448411 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8edc061f50 con 0x7f8edc195d90 2023-09-23T08:48:27.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:27.450+0000 7f8ec3fff700 1 --2- 172.21.15.82:0/2534448411 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f8ec4038680 0x7f8ec403ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:48:27.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:27.450+0000 7f8ec3fff700 1 -- 172.21.15.82:0/2534448411 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f8ed404a4a0 con 0x7f8edc195d90 2023-09-23T08:48:27.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:27.450+0000 7f8edaffd700 1 --2- 172.21.15.82:0/2534448411 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f8ec4038680 0x7f8ec403ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:48:27.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:27.451+0000 7f8edaffd700 1 --2- 172.21.15.82:0/2534448411 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f8ec4038680 0x7f8ec403ab40 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc006010 tx=0x7f8ecc00b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:48:27.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:27.455+0000 7f8ec3fff700 1 -- 172.21.15.82:0/2534448411 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f8ed40146f0 con 0x7f8edc195d90 2023-09-23T08:48:27.546 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:27 smithi082 ceph-mon[97694]: Updating smithi135:/var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/config/ceph.conf 2023-09-23T08:48:27.546 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:27 smithi082 ceph-mon[97694]: Updating smithi082:/var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/config/ceph.conf 2023-09-23T08:48:27.546 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:27 smithi082 ceph-mon[97694]: Updating smithi161:/var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/config/ceph.conf 2023-09-23T08:48:27.547 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:27 smithi082 ceph-mon[97694]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:27.547 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:27 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:27.547 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:27 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:27.547 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:27 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:27.547 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:27 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:27.547 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:27 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-09-23T08:48:27.547 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:27 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-09-23T08:48:27.547 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:27 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:48:27.547 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:27 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:27.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:27 smithi161 ceph-mon[99580]: Updating smithi135:/var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/config/ceph.conf 2023-09-23T08:48:27.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:27 smithi161 ceph-mon[99580]: Updating smithi082:/var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/config/ceph.conf 2023-09-23T08:48:27.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:27 smithi161 ceph-mon[99580]: Updating smithi161:/var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/config/ceph.conf 2023-09-23T08:48:27.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:27 smithi161 ceph-mon[99580]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:27.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:27 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:27.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:27 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:27.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:27 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:27.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:27 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:27.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:27 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-09-23T08:48:27.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:27 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-09-23T08:48:27.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:27 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:48:27.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:27 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:27.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:27.666+0000 7f8ee14bd700 1 -- 172.21.15.82:0/2534448411 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f8edc196d60 con 0x7f8edc195d90 2023-09-23T08:48:27.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:27.666+0000 7f8ec3fff700 1 -- 172.21.15.82:0/2534448411 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) v1 ==== 76+0+275 (secure 0 0 0) 0x7f8ed4018170 con 0x7f8edc195d90 2023-09-23T08:48:27.670 INFO:teuthology.orchestra.run.smithi082.stdout:# minimal ceph.conf for 8926e286-59ed-11ee-8db4-212e2dc638e7 2023-09-23T08:48:27.670 INFO:teuthology.orchestra.run.smithi082.stdout:[global] 2023-09-23T08:48:27.670 INFO:teuthology.orchestra.run.smithi082.stdout: fsid = 8926e286-59ed-11ee-8db4-212e2dc638e7 2023-09-23T08:48:27.670 INFO:teuthology.orchestra.run.smithi082.stdout: mon_host = [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] 2023-09-23T08:48:27.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:27.669+0000 7f8ee14bd700 1 -- 172.21.15.82:0/2534448411 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f8ec4038680 msgr2=0x7f8ec403ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:48:27.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:27.669+0000 7f8ee14bd700 1 --2- 172.21.15.82:0/2534448411 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f8ec4038680 0x7f8ec403ab40 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc006010 tx=0x7f8ecc00b540 comp rx=0 tx=0).stop 2023-09-23T08:48:27.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:27.669+0000 7f8ee14bd700 1 -- 172.21.15.82:0/2534448411 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8edc195d90 msgr2=0x7f8edc196240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:48:27.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:27.669+0000 7f8ee14bd700 1 --2- 172.21.15.82:0/2534448411 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8edc195d90 0x7f8edc196240 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8ed400ba50 tx=0x7f8ed400be10 comp rx=0 tx=0).stop 2023-09-23T08:48:27.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:27.669+0000 7f8ee14bd700 1 -- 172.21.15.82:0/2534448411 shutdown_connections 2023-09-23T08:48:27.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:27.669+0000 7f8ee14bd700 1 --2- 172.21.15.82:0/2534448411 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f8ec4038680 0x7f8ec403ab40 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:48:27.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:27.669+0000 7f8ee14bd700 1 --2- 172.21.15.82:0/2534448411 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8edc195d90 0x7f8edc196240 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:48:27.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:27.669+0000 7f8ee14bd700 1 --2- 172.21.15.82:0/2534448411 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8edc100610 0x7f8edc19b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:48:27.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:27.669+0000 7f8ee14bd700 1 --2- 172.21.15.82:0/2534448411 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8edc19bd10 0x7f8edc195850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:48:27.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:27.669+0000 7f8ee14bd700 1 -- 172.21.15.82:0/2534448411 >> 172.21.15.82:0/2534448411 conn(0x7f8edc0fbee0 msgr2=0x7f8edc106170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:48:27.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:27.669+0000 7f8ee14bd700 1 -- 172.21.15.82:0/2534448411 shutdown_connections 2023-09-23T08:48:27.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:27.669+0000 7f8ee14bd700 1 -- 172.21.15.82:0/2534448411 wait complete. 2023-09-23T08:48:27.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:27 smithi135 ceph-mon[99205]: Updating smithi135:/var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/config/ceph.conf 2023-09-23T08:48:27.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:27 smithi135 ceph-mon[99205]: Updating smithi082:/var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/config/ceph.conf 2023-09-23T08:48:27.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:27 smithi135 ceph-mon[99205]: Updating smithi161:/var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/config/ceph.conf 2023-09-23T08:48:27.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:27 smithi135 ceph-mon[99205]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:27.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:27 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:27.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:27 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:27.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:27 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:27.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:27 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:27.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:27 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-09-23T08:48:27.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:27 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-09-23T08:48:27.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:27 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:48:27.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:27 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:28.300 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2023-09-23T08:48:28.300 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-09-23T08:48:28.300 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/ceph/ceph.conf 2023-09-23T08:48:28.374 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-09-23T08:48:28.374 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-09-23T08:48:28.443 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:28 smithi082 ceph-mon[97694]: Reconfiguring mon.a (unknown last config time)... 2023-09-23T08:48:28.443 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:28 smithi082 ceph-mon[97694]: Reconfiguring daemon mon.a on smithi082 2023-09-23T08:48:28.443 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:28 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/2534448411' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:48:28.483 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-09-23T08:48:28.483 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/ceph/ceph.conf 2023-09-23T08:48:28.562 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-09-23T08:48:28.562 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-09-23T08:48:28.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:28 smithi161 ceph-mon[99580]: Reconfiguring mon.a (unknown last config time)... 2023-09-23T08:48:28.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:28 smithi161 ceph-mon[99580]: Reconfiguring daemon mon.a on smithi082 2023-09-23T08:48:28.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:28 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/2534448411' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:48:28.666 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:28 smithi135 ceph-mon[99205]: Reconfiguring mon.a (unknown last config time)... 2023-09-23T08:48:28.666 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:28 smithi135 ceph-mon[99205]: Reconfiguring daemon mon.a on smithi082 2023-09-23T08:48:28.666 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:28 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/2534448411' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:48:28.675 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-09-23T08:48:28.675 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/etc/ceph/ceph.conf 2023-09-23T08:48:28.754 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-09-23T08:48:28.755 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-09-23T08:48:28.866 INFO:tasks.cephadm:Adding mgr.x on smithi082 2023-09-23T08:48:28.866 INFO:tasks.cephadm:Adding mgr.y on smithi135 2023-09-23T08:48:28.867 INFO:tasks.cephadm:Adding mgr.z on smithi161 2023-09-23T08:48:28.867 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- ceph orch apply mgr '3;smithi082=x;smithi135=y;smithi161=z' 2023-09-23T08:48:29.617 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.c/config 2023-09-23T08:48:29.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:29 smithi082 ceph-mon[97694]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:29.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:29 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:29.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:29 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:29.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:29 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-09-23T08:48:29.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:29 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-09-23T08:48:29.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:29 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:48:29.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:29 smithi161 ceph-mon[99580]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:29.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:29 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:29.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:29 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:29.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:29 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-09-23T08:48:29.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:29 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-09-23T08:48:29.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:29 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:48:29.689 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:29 smithi135 ceph-mon[99205]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:29.690 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:29 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:29.690 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:29 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:29.690 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:29 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-09-23T08:48:29.690 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:29 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-09-23T08:48:29.690 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:29 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:48:30.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:30 smithi161 ceph-mon[99580]: Reconfiguring mon.b (monmap changed)... 2023-09-23T08:48:30.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:30 smithi161 ceph-mon[99580]: Reconfiguring daemon mon.b on smithi135 2023-09-23T08:48:30.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:30 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:30.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:30 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:30.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:30 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-09-23T08:48:30.650 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:30 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-09-23T08:48:30.650 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:30 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:48:30.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:30 smithi135 ceph-mon[99205]: Reconfiguring mon.b (monmap changed)... 2023-09-23T08:48:30.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:30 smithi135 ceph-mon[99205]: Reconfiguring daemon mon.b on smithi135 2023-09-23T08:48:30.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:30 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:30.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:30 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:30.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:30 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-09-23T08:48:30.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:30 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-09-23T08:48:30.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:30 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:48:30.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:30 smithi082 ceph-mon[97694]: Reconfiguring mon.b (monmap changed)... 2023-09-23T08:48:30.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:30 smithi082 ceph-mon[97694]: Reconfiguring daemon mon.b on smithi135 2023-09-23T08:48:30.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:30 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:30.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:30 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:30.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:30 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-09-23T08:48:30.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:30 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-09-23T08:48:30.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:30 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:48:31.095 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:31.092+0000 7f8cf190d700 1 -- 172.21.15.161:0/3406054067 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cec100550 msgr2=0x7f8cec100970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:48:31.095 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:31.092+0000 7f8cf190d700 1 --2- 172.21.15.161:0/3406054067 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cec100550 0x7f8cec100970 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc009910 tx=0x7f8cdc009c20 comp rx=0 tx=0).stop 2023-09-23T08:48:31.096 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:31.092+0000 7f8cf190d700 1 -- 172.21.15.161:0/3406054067 shutdown_connections 2023-09-23T08:48:31.096 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:31.092+0000 7f8cf190d700 1 --2- 172.21.15.161:0/3406054067 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cec100550 0x7f8cec100970 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:48:31.096 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:31.092+0000 7f8cf190d700 1 -- 172.21.15.161:0/3406054067 >> 172.21.15.161:0/3406054067 conn(0x7f8cec0fbaf0 msgr2=0x7f8cec0fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:48:31.096 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:31.092+0000 7f8cf190d700 1 -- 172.21.15.161:0/3406054067 shutdown_connections 2023-09-23T08:48:31.096 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:31.092+0000 7f8cf190d700 1 -- 172.21.15.161:0/3406054067 wait complete. 2023-09-23T08:48:31.097 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:31.093+0000 7f8cf190d700 1 Processor -- start 2023-09-23T08:48:31.097 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:31.094+0000 7f8cf190d700 1 -- start start 2023-09-23T08:48:31.097 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:31.094+0000 7f8cf190d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cec100550 0x7f8cec197990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:48:31.097 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:31.094+0000 7f8cf190d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cec197ed0 0x7f8cec19cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:48:31.097 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:31.094+0000 7f8cf190d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8cec198350 0x7f8cec19f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:48:31.097 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:31.094+0000 7f8cf190d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cec19fc70 con 0x7f8cec197ed0 2023-09-23T08:48:31.097 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:31.094+0000 7f8cf190d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cec19fde0 con 0x7f8cec100550 2023-09-23T08:48:31.097 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:31.094+0000 7f8cf190d700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cec19ffa0 con 0x7f8cec198350 2023-09-23T08:48:31.099 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:31.094+0000 7f8ceaffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cec100550 0x7f8cec197990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:48:31.099 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:31.095+0000 7f8ceaffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cec100550 0x7f8cec197990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.161:53806/0 (socket says 172.21.15.161:53806) 2023-09-23T08:48:31.099 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:31.095+0000 7f8ceaffd700 1 -- 172.21.15.161:0/4062252915 learned_addr learned my addr 172.21.15.161:0/4062252915 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-09-23T08:48:31.099 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:31.095+0000 7f8cea7fc700 1 --2- 172.21.15.161:0/4062252915 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cec197ed0 0x7f8cec19cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:48:31.099 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:31.095+0000 7f8ceb7fe700 1 --2- 172.21.15.161:0/4062252915 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8cec198350 0x7f8cec19f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:48:31.099 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:31.095+0000 7f8ceaffd700 1 -- 172.21.15.161:0/4062252915 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8cec198350 msgr2=0x7f8cec19f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:48:31.099 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:31.095+0000 7f8ceaffd700 1 --2- 172.21.15.161:0/4062252915 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8cec198350 0x7f8cec19f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:48:31.099 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:31.095+0000 7f8ceaffd700 1 -- 172.21.15.161:0/4062252915 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cec197ed0 msgr2=0x7f8cec19cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:48:31.100 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:31.095+0000 7f8ceaffd700 1 --2- 172.21.15.161:0/4062252915 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cec197ed0 0x7f8cec19cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:48:31.100 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:31.095+0000 7f8ceaffd700 1 -- 172.21.15.161:0/4062252915 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cdc0095f0 con 0x7f8cec100550 2023-09-23T08:48:31.100 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:31.095+0000 7f8ceb7fe700 1 --2- 172.21.15.161:0/4062252915 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8cec198350 0x7f8cec19f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T08:48:31.100 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:31.095+0000 7f8ceaffd700 1 --2- 172.21.15.161:0/4062252915 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cec100550 0x7f8cec197990 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc006010 tx=0x7f8cdc00bcf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:48:31.100 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:31.096+0000 7f8cf090b700 1 -- 172.21.15.161:0/4062252915 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cdc01d070 con 0x7f8cec100550 2023-09-23T08:48:31.100 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:31.096+0000 7f8cf190d700 1 -- 172.21.15.161:0/4062252915 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cec1a0220 con 0x7f8cec100550 2023-09-23T08:48:31.100 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:31.096+0000 7f8cf190d700 1 -- 172.21.15.161:0/4062252915 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cec1a0790 con 0x7f8cec100550 2023-09-23T08:48:31.100 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:31.096+0000 7f8cf090b700 1 -- 172.21.15.161:0/4062252915 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8cdc00bea0 con 0x7f8cec100550 2023-09-23T08:48:31.100 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:31.096+0000 7f8cf090b700 1 -- 172.21.15.161:0/4062252915 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cdc022be0 con 0x7f8cec100550 2023-09-23T08:48:31.101 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:31.097+0000 7f8cf090b700 1 -- 172.21.15.161:0/4062252915 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 13) v1 ==== 45191+0+0 (secure 0 0 0) 0x7f8cdc022d40 con 0x7f8cec100550 2023-09-23T08:48:31.101 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:31.097+0000 7f8cd27fc700 1 -- 172.21.15.161:0/4062252915 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cec106150 con 0x7f8cec100550 2023-09-23T08:48:31.101 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:31.097+0000 7f8cf090b700 1 --2- 172.21.15.161:0/4062252915 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f8cd4038680 0x7f8cd403ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:48:31.101 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:31.098+0000 7f8cf090b700 1 -- 172.21.15.161:0/4062252915 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f8cdc04bf10 con 0x7f8cec100550 2023-09-23T08:48:31.101 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:31.098+0000 7f8cea7fc700 1 --2- 172.21.15.161:0/4062252915 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f8cd4038680 0x7f8cd403ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:48:31.102 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:31.099+0000 7f8cea7fc700 1 --2- 172.21.15.161:0/4062252915 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f8cd4038680 0x7f8cd403ab40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8ce0009ad0 tx=0x7f8ce0009210 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:48:31.106 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:31.103+0000 7f8cf090b700 1 -- 172.21.15.161:0/4062252915 <== mon.2 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f8cdc0217e0 con 0x7f8cec100550 2023-09-23T08:48:31.332 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:31.330+0000 7f8cd27fc700 1 -- 172.21.15.161:0/4062252915 --> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi082=x;smithi135=y;smithi161=z", "target": ["mon-mgr", ""]}) v1 -- 0x7f8cec106370 con 0x7f8cd4038680 2023-09-23T08:48:31.340 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:31.337+0000 7f8cf090b700 1 -- 172.21.15.161:0/4062252915 <== mgr.14152 v2:172.21.15.82:6800/3698954311 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f8cec106370 con 0x7f8cd4038680 2023-09-23T08:48:31.340 INFO:teuthology.orchestra.run.smithi161.stdout:Scheduled mgr update... 2023-09-23T08:48:31.343 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:31.340+0000 7f8cd27fc700 1 -- 172.21.15.161:0/4062252915 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f8cd4038680 msgr2=0x7f8cd403ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:48:31.343 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:31.340+0000 7f8cd27fc700 1 --2- 172.21.15.161:0/4062252915 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f8cd4038680 0x7f8cd403ab40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8ce0009ad0 tx=0x7f8ce0009210 comp rx=0 tx=0).stop 2023-09-23T08:48:31.343 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:31.340+0000 7f8cd27fc700 1 -- 172.21.15.161:0/4062252915 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cec100550 msgr2=0x7f8cec197990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:48:31.343 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:31.340+0000 7f8cd27fc700 1 --2- 172.21.15.161:0/4062252915 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cec100550 0x7f8cec197990 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc006010 tx=0x7f8cdc00bcf0 comp rx=0 tx=0).stop 2023-09-23T08:48:31.343 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:31.340+0000 7f8cd27fc700 1 -- 172.21.15.161:0/4062252915 shutdown_connections 2023-09-23T08:48:31.344 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:31.340+0000 7f8cd27fc700 1 --2- 172.21.15.161:0/4062252915 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f8cd4038680 0x7f8cd403ab40 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:48:31.344 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:31.340+0000 7f8cd27fc700 1 --2- 172.21.15.161:0/4062252915 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8cec198350 0x7f8cec19f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:48:31.344 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:31.340+0000 7f8cd27fc700 1 --2- 172.21.15.161:0/4062252915 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cec100550 0x7f8cec197990 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:48:31.344 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:31.340+0000 7f8cd27fc700 1 --2- 172.21.15.161:0/4062252915 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cec197ed0 0x7f8cec19cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:48:31.344 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:31.340+0000 7f8cd27fc700 1 -- 172.21.15.161:0/4062252915 >> 172.21.15.161:0/4062252915 conn(0x7f8cec0fbaf0 msgr2=0x7f8cec0fc8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:48:31.344 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:31.340+0000 7f8cd27fc700 1 -- 172.21.15.161:0/4062252915 shutdown_connections 2023-09-23T08:48:31.344 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:48:31.340+0000 7f8cd27fc700 1 -- 172.21.15.161:0/4062252915 wait complete. 2023-09-23T08:48:31.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:31 smithi161 ceph-mon[99580]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:31.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:31 smithi161 ceph-mon[99580]: Reconfiguring mon.c (monmap changed)... 2023-09-23T08:48:31.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:31 smithi161 ceph-mon[99580]: Reconfiguring daemon mon.c on smithi161 2023-09-23T08:48:31.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:31 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:31.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:31 smithi135 ceph-mon[99205]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:31.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:31 smithi135 ceph-mon[99205]: Reconfiguring mon.c (monmap changed)... 2023-09-23T08:48:31.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:31 smithi135 ceph-mon[99205]: Reconfiguring daemon mon.c on smithi161 2023-09-23T08:48:31.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:31 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:31.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:31 smithi082 ceph-mon[97694]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:31.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:31 smithi082 ceph-mon[97694]: Reconfiguring mon.c (monmap changed)... 2023-09-23T08:48:31.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:31 smithi082 ceph-mon[97694]: Reconfiguring daemon mon.c on smithi161 2023-09-23T08:48:31.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:31 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:32.098 DEBUG:teuthology.orchestra.run.smithi135:mgr.y> sudo journalctl -f -n 0 -u ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@mgr.y.service 2023-09-23T08:48:32.104 DEBUG:teuthology.orchestra.run.smithi161:mgr.z> sudo journalctl -f -n 0 -u ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@mgr.z.service 2023-09-23T08:48:32.108 INFO:tasks.cephadm:Deploying OSDs... 2023-09-23T08:48:32.108 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-09-23T08:48:32.108 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/scratch_devs of=/dev/stdout 2023-09-23T08:48:32.155 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-09-23T08:48:32.155 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_1 2023-09-23T08:48:32.178 INFO:journalctl@ceph.mgr.z.smithi161.stdout:-- Logs begin at Sat 2023-09-23 08:29:48 UTC. -- 2023-09-23T08:48:32.180 INFO:journalctl@ceph.mgr.y.smithi135.stdout:-- Logs begin at Sat 2023-09-23 08:29:30 UTC. -- 2023-09-23T08:48:32.239 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-09-23T08:48:32.239 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-23T08:48:32.239 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 5h/5d Inode: 452 Links: 1 2023-09-23T08:48:32.239 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-23T08:48:32.240 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2023-09-23T08:48:32.240 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2023-09-23 08:47:33.852612754 +0000 2023-09-23T08:48:32.240 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2023-09-23 08:41:37.094102089 +0000 2023-09-23T08:48:32.240 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2023-09-23 08:41:37.094102089 +0000 2023-09-23T08:48:32.240 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: 2023-09-23 08:41:37.066102621 +0000 2023-09-23T08:48:32.240 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-09-23T08:48:32.345 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2023-09-23T08:48:32.346 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2023-09-23T08:48:32.346 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000326309 s, 1.6 MB/s 2023-09-23T08:48:32.348 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-09-23T08:48:32.396 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_2 2023-09-23T08:48:32.441 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-09-23T08:48:32.441 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-23T08:48:32.441 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 5h/5d Inode: 458 Links: 1 2023-09-23T08:48:32.441 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-23T08:48:32.441 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2023-09-23T08:48:32.441 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2023-09-23 08:47:33.852612754 +0000 2023-09-23T08:48:32.441 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2023-09-23 08:41:37.906086670 +0000 2023-09-23T08:48:32.441 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2023-09-23 08:41:37.906086670 +0000 2023-09-23T08:48:32.441 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: 2023-09-23 08:41:37.879087183 +0000 2023-09-23T08:48:32.442 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-09-23T08:48:32.547 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2023-09-23T08:48:32.547 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2023-09-23T08:48:32.547 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000303355 s, 1.7 MB/s 2023-09-23T08:48:32.549 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-09-23T08:48:32.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:32 smithi135 ceph-mon[99205]: from='client.24104 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi082=x;smithi135=y;smithi161=z", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:48:32.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:32 smithi135 ceph-mon[99205]: Saving service mgr spec with placement smithi082=x;smithi135=y;smithi161=z;count:3 2023-09-23T08:48:32.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:32 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:32.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:32 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:32.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:32 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:48:32.594 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_3 2023-09-23T08:48:32.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:32 smithi082 ceph-mon[97694]: from='client.24104 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi082=x;smithi135=y;smithi161=z", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:48:32.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:32 smithi082 ceph-mon[97694]: Saving service mgr spec with placement smithi082=x;smithi135=y;smithi161=z;count:3 2023-09-23T08:48:32.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:32 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:32.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:32 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:32.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:32 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:48:32.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:32 smithi161 ceph-mon[99580]: from='client.24104 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi082=x;smithi135=y;smithi161=z", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:48:32.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:32 smithi161 ceph-mon[99580]: Saving service mgr spec with placement smithi082=x;smithi135=y;smithi161=z;count:3 2023-09-23T08:48:32.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:32 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:32.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:32 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:32.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:32 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:48:32.665 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-09-23T08:48:32.666 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-23T08:48:32.666 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 5h/5d Inode: 464 Links: 1 2023-09-23T08:48:32.666 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-23T08:48:32.667 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2023-09-23T08:48:32.667 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2023-09-23 08:47:33.852612754 +0000 2023-09-23T08:48:32.667 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2023-09-23 08:41:38.737070890 +0000 2023-09-23T08:48:32.668 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2023-09-23 08:41:38.737070890 +0000 2023-09-23T08:48:32.668 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: 2023-09-23 08:41:38.709071422 +0000 2023-09-23T08:48:32.668 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-09-23T08:48:32.772 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2023-09-23T08:48:32.772 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2023-09-23T08:48:32.772 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000309911 s, 1.7 MB/s 2023-09-23T08:48:32.775 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-09-23T08:48:32.821 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_4 2023-09-23T08:48:32.906 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-09-23T08:48:32.906 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-23T08:48:32.906 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 5h/5d Inode: 470 Links: 1 2023-09-23T08:48:32.906 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-23T08:48:32.906 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2023-09-23T08:48:32.906 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2023-09-23 08:47:33.852612754 +0000 2023-09-23T08:48:32.906 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2023-09-23 08:41:39.571055053 +0000 2023-09-23T08:48:32.906 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2023-09-23 08:41:39.571055053 +0000 2023-09-23T08:48:32.906 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: 2023-09-23 08:41:39.545055547 +0000 2023-09-23T08:48:32.907 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-09-23T08:48:33.011 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2023-09-23T08:48:33.011 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2023-09-23T08:48:33.011 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000302018 s, 1.7 MB/s 2023-09-23T08:48:33.014 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-09-23T08:48:33.059 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-09-23T08:48:33.059 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/scratch_devs of=/dev/stdout 2023-09-23T08:48:33.107 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-09-23T08:48:33.107 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_1 2023-09-23T08:48:33.193 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-09-23T08:48:33.194 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-23T08:48:33.194 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 5h/5d Inode: 452 Links: 1 2023-09-23T08:48:33.194 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-23T08:48:33.195 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2023-09-23T08:48:33.195 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2023-09-23 08:48:17.014076565 +0000 2023-09-23T08:48:33.195 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2023-09-23 08:41:38.569262995 +0000 2023-09-23T08:48:33.195 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2023-09-23 08:41:38.569262995 +0000 2023-09-23T08:48:33.196 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: 2023-09-23 08:41:38.540263590 +0000 2023-09-23T08:48:33.196 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-09-23T08:48:33.301 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2023-09-23T08:48:33.301 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2023-09-23T08:48:33.301 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.000316825 s, 1.6 MB/s 2023-09-23T08:48:33.303 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-09-23T08:48:33.349 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_2 2023-09-23T08:48:33.434 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-09-23T08:48:33.434 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-23T08:48:33.434 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 5h/5d Inode: 458 Links: 1 2023-09-23T08:48:33.434 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-23T08:48:33.434 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2023-09-23T08:48:33.434 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2023-09-23 08:48:17.014076565 +0000 2023-09-23T08:48:33.434 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2023-09-23 08:41:39.379246377 +0000 2023-09-23T08:48:33.435 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2023-09-23 08:41:39.379246377 +0000 2023-09-23T08:48:33.435 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: 2023-09-23 08:41:39.354246890 +0000 2023-09-23T08:48:33.435 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-09-23T08:48:33.542 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2023-09-23T08:48:33.542 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2023-09-23T08:48:33.542 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.000357593 s, 1.4 MB/s 2023-09-23T08:48:33.544 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-09-23T08:48:33.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:33 smithi135 ceph-mon[99205]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:33.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:33 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:48:33.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:33 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:48:33.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:33 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:33.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:33 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-09-23T08:48:33.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:33 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-09-23T08:48:33.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:33 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-09-23T08:48:33.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:33 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:48:33.590 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_3 2023-09-23T08:48:33.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:33 smithi161 ceph-mon[99580]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:33.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:33 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:48:33.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:33 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:48:33.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:33 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:33.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:33 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-09-23T08:48:33.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:33 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-09-23T08:48:33.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:33 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-09-23T08:48:33.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:33 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:48:33.675 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-09-23T08:48:33.675 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-23T08:48:33.675 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 5h/5d Inode: 464 Links: 1 2023-09-23T08:48:33.675 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-23T08:48:33.675 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2023-09-23T08:48:33.676 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2023-09-23 08:48:17.015076545 +0000 2023-09-23T08:48:33.676 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2023-09-23 08:41:40.207229389 +0000 2023-09-23T08:48:33.676 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2023-09-23 08:41:40.207229389 +0000 2023-09-23T08:48:33.676 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: 2023-09-23 08:41:40.182229902 +0000 2023-09-23T08:48:33.676 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-09-23T08:48:33.780 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2023-09-23T08:48:33.780 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2023-09-23T08:48:33.780 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.000276294 s, 1.9 MB/s 2023-09-23T08:48:33.783 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-09-23T08:48:33.827 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_4 2023-09-23T08:48:33.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:33 smithi082 ceph-mon[97694]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:33.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:33 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:48:33.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:33 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:48:33.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:33 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:33.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:33 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-09-23T08:48:33.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:33 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-09-23T08:48:33.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:33 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-09-23T08:48:33.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:33 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:48:33.911 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-09-23T08:48:33.911 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-23T08:48:33.911 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 5h/5d Inode: 470 Links: 1 2023-09-23T08:48:33.911 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-23T08:48:33.911 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2023-09-23T08:48:33.911 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2023-09-23 08:48:17.015076545 +0000 2023-09-23T08:48:33.911 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2023-09-23 08:41:41.048212135 +0000 2023-09-23T08:48:33.911 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2023-09-23 08:41:41.048212135 +0000 2023-09-23T08:48:33.911 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: 2023-09-23 08:41:41.023212648 +0000 2023-09-23T08:48:33.912 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-09-23T08:48:34.015 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2023-09-23T08:48:34.015 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2023-09-23T08:48:34.015 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.000278591 s, 1.8 MB/s 2023-09-23T08:48:34.018 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-09-23T08:48:34.063 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-09-23T08:48:34.063 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/scratch_devs of=/dev/stdout 2023-09-23T08:48:34.110 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-09-23T08:48:34.110 DEBUG:teuthology.orchestra.run.smithi161:> stat /dev/vg_nvme/lv_1 2023-09-23T08:48:34.195 INFO:teuthology.orchestra.run.smithi161.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-09-23T08:48:34.195 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-23T08:48:34.195 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 5h/5d Inode: 452 Links: 1 2023-09-23T08:48:34.195 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-23T08:48:34.195 INFO:teuthology.orchestra.run.smithi161.stdout:Context: system_u:object_r:device_t:s0 2023-09-23T08:48:34.196 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 2023-09-23 08:48:07.511626423 +0000 2023-09-23T08:48:34.196 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2023-09-23 08:41:38.651231349 +0000 2023-09-23T08:48:34.196 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2023-09-23 08:41:38.651231349 +0000 2023-09-23T08:48:34.196 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: 2023-09-23 08:41:38.621231964 +0000 2023-09-23T08:48:34.196 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-09-23T08:48:34.302 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records in 2023-09-23T08:48:34.303 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records out 2023-09-23T08:48:34.303 INFO:teuthology.orchestra.run.smithi161.stderr:512 bytes copied, 0.000292456 s, 1.8 MB/s 2023-09-23T08:48:34.305 DEBUG:teuthology.orchestra.run.smithi161:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-09-23T08:48:34.350 DEBUG:teuthology.orchestra.run.smithi161:> stat /dev/vg_nvme/lv_2 2023-09-23T08:48:34.434 INFO:teuthology.orchestra.run.smithi161.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-09-23T08:48:34.565 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-23T08:48:34.565 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 5h/5d Inode: 458 Links: 1 2023-09-23T08:48:34.565 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-23T08:48:34.565 INFO:teuthology.orchestra.run.smithi161.stdout:Context: system_u:object_r:device_t:s0 2023-09-23T08:48:34.565 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 2023-09-23 08:48:07.511626423 +0000 2023-09-23T08:48:34.566 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2023-09-23 08:41:39.468214597 +0000 2023-09-23T08:48:34.566 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2023-09-23 08:41:39.468214597 +0000 2023-09-23T08:48:34.566 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: 2023-09-23 08:41:39.442215130 +0000 2023-09-23T08:48:34.566 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-09-23T08:48:34.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:34 smithi161 ceph-mon[99580]: Deploying daemon mgr.z on smithi161 2023-09-23T08:48:34.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:34 smithi135 ceph-mon[99205]: Deploying daemon mgr.z on smithi161 2023-09-23T08:48:34.816 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records in 2023-09-23T08:48:34.816 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records out 2023-09-23T08:48:34.816 INFO:teuthology.orchestra.run.smithi161.stderr:512 bytes copied, 0.000309603 s, 1.7 MB/s 2023-09-23T08:48:34.819 DEBUG:teuthology.orchestra.run.smithi161:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-09-23T08:48:34.864 DEBUG:teuthology.orchestra.run.smithi161:> stat /dev/vg_nvme/lv_3 2023-09-23T08:48:34.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:34 smithi082 ceph-mon[97694]: Deploying daemon mgr.z on smithi161 2023-09-23T08:48:34.955 INFO:teuthology.orchestra.run.smithi161.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-09-23T08:48:34.957 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-23T08:48:34.957 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 5h/5d Inode: 464 Links: 1 2023-09-23T08:48:34.957 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-23T08:48:34.958 INFO:teuthology.orchestra.run.smithi161.stdout:Context: system_u:object_r:device_t:s0 2023-09-23T08:48:34.958 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 2023-09-23 08:48:34.681064622 +0000 2023-09-23T08:48:34.958 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2023-09-23 08:41:40.286197825 +0000 2023-09-23T08:48:34.958 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2023-09-23 08:41:40.286197825 +0000 2023-09-23T08:48:34.958 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: 2023-09-23 08:41:40.260198358 +0000 2023-09-23T08:48:34.963 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-09-23T08:48:35.139 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records in 2023-09-23T08:48:35.140 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records out 2023-09-23T08:48:35.140 INFO:teuthology.orchestra.run.smithi161.stderr:512 bytes copied, 0.000388733 s, 1.3 MB/s 2023-09-23T08:48:35.142 DEBUG:teuthology.orchestra.run.smithi161:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-09-23T08:48:35.188 DEBUG:teuthology.orchestra.run.smithi161:> stat /dev/vg_nvme/lv_4 2023-09-23T08:48:35.235 INFO:teuthology.orchestra.run.smithi161.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-09-23T08:48:35.235 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-23T08:48:35.235 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 5h/5d Inode: 470 Links: 1 2023-09-23T08:48:35.235 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-23T08:48:35.235 INFO:teuthology.orchestra.run.smithi161.stdout:Context: system_u:object_r:device_t:s0 2023-09-23T08:48:35.235 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 2023-09-23 08:48:35.011057798 +0000 2023-09-23T08:48:35.236 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2023-09-23 08:41:41.111180909 +0000 2023-09-23T08:48:35.236 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2023-09-23 08:41:41.111180909 +0000 2023-09-23T08:48:35.236 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: 2023-09-23 08:41:41.084181463 +0000 2023-09-23T08:48:35.236 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-09-23T08:48:35.308 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records in 2023-09-23T08:48:35.308 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records out 2023-09-23T08:48:35.308 INFO:teuthology.orchestra.run.smithi161.stderr:512 bytes copied, 0.000306445 s, 1.7 MB/s 2023-09-23T08:48:35.310 DEBUG:teuthology.orchestra.run.smithi161:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-09-23T08:48:35.360 INFO:tasks.cephadm:Deploying osd.0 on smithi082 with /dev/vg_nvme/lv_4... 2023-09-23T08:48:35.382 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-09-23T08:48:35.396 INFO:journalctl@ceph.mgr.z.smithi161.stdout:Sep 23 08:48:35 smithi161 systemd[1]: Starting Ceph mgr.z for 8926e286-59ed-11ee-8db4-212e2dc638e7... 2023-09-23T08:48:35.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:35 smithi161 ceph-mon[99580]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:35.649 INFO:journalctl@ceph.mgr.z.smithi161.stdout:Sep 23 08:48:35 smithi161 podman[101691]: 2023-09-23T08:48:35.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:35 smithi135 ceph-mon[99205]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:35.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:35 smithi082 ceph-mon[97694]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:36.106 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.a/config 2023-09-23T08:48:36.135 INFO:journalctl@ceph.mgr.z.smithi161.stdout:Sep 23 08:48:35 smithi161 bash[101691]: af08f631700b3586d7132151982b542ecf0e386a10e21e94e63ccd4e6eb65ee9 2023-09-23T08:48:36.135 INFO:journalctl@ceph.mgr.z.smithi161.stdout:Sep 23 08:48:35 smithi161 ceph-mgr[101732]: -- 172.21.15.161:0/705299364 <== mon.1 v2:172.21.15.161:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55db12d811e0 con 0x55db12d56c00 2023-09-23T08:48:36.135 INFO:journalctl@ceph.mgr.z.smithi161.stdout:Sep 23 08:48:35 smithi161 systemd[1]: Started Ceph mgr.z for 8926e286-59ed-11ee-8db4-212e2dc638e7. 2023-09-23T08:48:36.135 INFO:journalctl@ceph.mgr.z.smithi161.stdout:Sep 23 08:48:36 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-z[101707]: 2023-09-23T08:48:36.021+0000 7f79f7b23200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-09-23T08:48:36.398 INFO:journalctl@ceph.mgr.z.smithi161.stdout:Sep 23 08:48:36 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-z[101707]: 2023-09-23T08:48:36.132+0000 7f79f7b23200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-09-23T08:48:36.399 INFO:journalctl@ceph.mgr.z.smithi161.stdout:Sep 23 08:48:36 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-z[101707]: 2023-09-23T08:48:36.252+0000 7f79f7b23200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-09-23T08:48:36.399 INFO:journalctl@ceph.mgr.z.smithi161.stdout:Sep 23 08:48:36 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-z[101707]: 2023-09-23T08:48:36.372+0000 7f79f7b23200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-09-23T08:48:36.898 INFO:journalctl@ceph.mgr.z.smithi161.stdout:Sep 23 08:48:36 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-z[101707]: 2023-09-23T08:48:36.594+0000 7f79f7b23200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-09-23T08:48:37.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:37 smithi135 ceph-mon[99205]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:37.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:37 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:37.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:37 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:37.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:37 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:37.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:37 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-09-23T08:48:37.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:37 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-09-23T08:48:37.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:37 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-09-23T08:48:37.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:37 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:48:37.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:37 smithi135 ceph-mon[99205]: Deploying daemon mgr.y on smithi135 2023-09-23T08:48:37.341 INFO:journalctl@ceph.mgr.z.smithi161.stdout:Sep 23 08:48:37 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-z[101707]: 2023-09-23T08:48:37.060+0000 7f79f7b23200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-09-23T08:48:37.341 INFO:journalctl@ceph.mgr.z.smithi161.stdout:Sep 23 08:48:37 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-z[101707]: 2023-09-23T08:48:37.223+0000 7f79f7b23200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-09-23T08:48:37.341 INFO:journalctl@ceph.mgr.z.smithi161.stdout:Sep 23 08:48:37 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-z[101707]: 2023-09-23T08:48:37.338+0000 7f79f7b23200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-09-23T08:48:37.341 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:37 smithi161 ceph-mon[99580]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:37.341 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:37 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:37.342 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:37 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:37.342 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:37 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:37.342 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:37 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-09-23T08:48:37.342 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:37 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-09-23T08:48:37.342 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:37 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-09-23T08:48:37.342 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:37 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:48:37.342 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:37 smithi161 ceph-mon[99580]: Deploying daemon mgr.y on smithi135 2023-09-23T08:48:37.349 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:37 smithi082 ceph-mon[97694]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:37.349 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:37 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:37.349 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:37 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:37.349 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:37 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:37.349 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:37 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-09-23T08:48:37.349 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:37 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-09-23T08:48:37.350 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:37 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-09-23T08:48:37.350 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:37 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:48:37.350 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:37 smithi082 ceph-mon[97694]: Deploying daemon mgr.y on smithi135 2023-09-23T08:48:37.648 INFO:journalctl@ceph.mgr.z.smithi161.stdout:Sep 23 08:48:37 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-z[101707]: 2023-09-23T08:48:37.462+0000 7f79f7b23200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-09-23T08:48:38.038 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-09-23T08:48:38.039 INFO:teuthology.orchestra.run.smithi082.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-09-23T08:48:38.039 INFO:teuthology.orchestra.run.smithi082.stderr: stderr: 10+0 records in 2023-09-23T08:48:38.039 INFO:teuthology.orchestra.run.smithi082.stderr:10+0 records out 2023-09-23T08:48:38.039 INFO:teuthology.orchestra.run.smithi082.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0300052 s, 349 MB/s 2023-09-23T08:48:38.039 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping successful for: 2023-09-23T08:48:38.312 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Sep 23 08:48:38 smithi135 systemd[1]: Starting Ceph mgr.y for 8926e286-59ed-11ee-8db4-212e2dc638e7... 2023-09-23T08:48:38.398 INFO:journalctl@ceph.mgr.z.smithi161.stdout:Sep 23 08:48:38 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-z[101707]: 2023-09-23T08:48:38.001+0000 7f79f7b23200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-09-23T08:48:38.581 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- ceph orch daemon add osd smithi082:vg_nvme/lv_4 2023-09-23T08:48:39.015 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Sep 23 08:48:38 smithi135 podman[100647]: 2023-09-23T08:48:39.015 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Sep 23 08:48:38 smithi135 bash[100647]: a517b52f1b3875b2abee725afec04f39b44d36d4e512bcaac1e86a83c174452c 2023-09-23T08:48:39.015 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Sep 23 08:48:38 smithi135 ceph-mgr[100687]: -- 172.21.15.135:0/2310917828 <== mon.2 v2:172.21.15.135:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x556105dbb1e0 con 0x556105d90c00 2023-09-23T08:48:39.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:39 smithi161 ceph-mon[99580]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:39.148 INFO:journalctl@ceph.mgr.z.smithi161.stdout:Sep 23 08:48:38 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-z[101707]: 2023-09-23T08:48:38.884+0000 7f79f7b23200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-09-23T08:48:39.149 INFO:journalctl@ceph.mgr.z.smithi161.stdout:Sep 23 08:48:38 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-z[101707]: 2023-09-23T08:48:38.990+0000 7f79f7b23200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-09-23T08:48:39.253 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Sep 23 08:48:39 smithi135 systemd[1]: Started Ceph mgr.y for 8926e286-59ed-11ee-8db4-212e2dc638e7. 2023-09-23T08:48:39.253 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Sep 23 08:48:39 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-y[100663]: 2023-09-23T08:48:39.146+0000 7f4910707200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-09-23T08:48:39.254 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:39 smithi135 ceph-mon[99205]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:39.299 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.a/config 2023-09-23T08:48:39.312 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Sep 23 08:48:39 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-y[100663]: 2023-09-23T08:48:39.249+0000 7f4910707200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-09-23T08:48:39.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:39 smithi082 ceph-mon[97694]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:39.562 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Sep 23 08:48:39 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-y[100663]: 2023-09-23T08:48:39.367+0000 7f4910707200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-09-23T08:48:39.562 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Sep 23 08:48:39 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-y[100663]: 2023-09-23T08:48:39.486+0000 7f4910707200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-09-23T08:48:40.062 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Sep 23 08:48:39 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-y[100663]: 2023-09-23T08:48:39.718+0000 7f4910707200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-09-23T08:48:40.216 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:40 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:40.216 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:40 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:40.216 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:40 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:40.216 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:40 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:40.216 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:40 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:48:40.362 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:40 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:40.362 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:40 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:40.362 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:40 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:40.362 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:40 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:40.363 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:40 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:48:40.363 INFO:journalctl@ceph.mgr.z.smithi161.stdout:Sep 23 08:48:39 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-z[101707]: 2023-09-23T08:48:39.993+0000 7f79f7b23200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-09-23T08:48:40.363 INFO:journalctl@ceph.mgr.z.smithi161.stdout:Sep 23 08:48:40 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-z[101707]: 2023-09-23T08:48:40.125+0000 7f79f7b23200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-09-23T08:48:40.363 INFO:journalctl@ceph.mgr.z.smithi161.stdout:Sep 23 08:48:40 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-z[101707]: 2023-09-23T08:48:40.358+0000 7f79f7b23200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-09-23T08:48:40.384 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Sep 23 08:48:40 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-y[100663]: 2023-09-23T08:48:40.201+0000 7f4910707200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-09-23T08:48:40.385 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:40 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:40.385 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:40 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:40.385 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:40 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:40.385 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:40 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:40.385 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:40 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:48:40.641 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Sep 23 08:48:40 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-y[100663]: 2023-09-23T08:48:40.380+0000 7f4910707200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-09-23T08:48:40.641 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Sep 23 08:48:40 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-y[100663]: 2023-09-23T08:48:40.504+0000 7f4910707200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-09-23T08:48:40.641 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Sep 23 08:48:40 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-y[100663]: 2023-09-23T08:48:40.637+0000 7f4910707200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-09-23T08:48:40.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:40.925+0000 7f5f695ae700 1 -- 172.21.15.82:0/1945151738 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f64101bb0 msgr2=0x7f5f64102010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:48:40.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:40.925+0000 7f5f695ae700 1 --2- 172.21.15.82:0/1945151738 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f64101bb0 0x7f5f64102010 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5f580099c0 tx=0x7f5f58009cd0 comp rx=0 tx=0).stop 2023-09-23T08:48:40.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:40.925+0000 7f5f695ae700 1 -- 172.21.15.82:0/1945151738 shutdown_connections 2023-09-23T08:48:40.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:40.925+0000 7f5f695ae700 1 --2- 172.21.15.82:0/1945151738 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f64102550 0x7f5f64108e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:48:40.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:40.925+0000 7f5f695ae700 1 --2- 172.21.15.82:0/1945151738 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5f641009b0 0x7f5f64100dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:48:40.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:40.925+0000 7f5f695ae700 1 --2- 172.21.15.82:0/1945151738 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f64101bb0 0x7f5f64102010 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:48:40.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:40.925+0000 7f5f695ae700 1 -- 172.21.15.82:0/1945151738 >> 172.21.15.82:0/1945151738 conn(0x7f5f640fbf10 msgr2=0x7f5f640fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:48:40.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:40.925+0000 7f5f695ae700 1 -- 172.21.15.82:0/1945151738 shutdown_connections 2023-09-23T08:48:40.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:40.925+0000 7f5f695ae700 1 -- 172.21.15.82:0/1945151738 wait complete. 2023-09-23T08:48:40.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:40.927+0000 7f5f695ae700 1 Processor -- start 2023-09-23T08:48:40.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:40.927+0000 7f5f695ae700 1 -- start start 2023-09-23T08:48:40.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:40.927+0000 7f5f695ae700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5f641009b0 0x7f5f64198770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:48:40.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:40.927+0000 7f5f695ae700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f64101bb0 0x7f5f64198cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:48:40.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:40.928+0000 7f5f695ae700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f64102550 0x7f5f6419fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:48:40.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:40.928+0000 7f5f695ae700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f641a0300 con 0x7f5f64101bb0 2023-09-23T08:48:40.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:40.928+0000 7f5f695ae700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f641a0440 con 0x7f5f64102550 2023-09-23T08:48:40.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:40.928+0000 7f5f695ae700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f641a05d0 con 0x7f5f641009b0 2023-09-23T08:48:40.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:40.928+0000 7f5f627fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f64101bb0 0x7f5f64198cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:48:40.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:40.928+0000 7f5f62ffd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5f641009b0 0x7f5f64198770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:48:40.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:40.928+0000 7f5f627fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f64101bb0 0x7f5f64198cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58856/0 (socket says 172.21.15.82:58856) 2023-09-23T08:48:40.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:40.928+0000 7f5f627fc700 1 -- 172.21.15.82:0/426293154 learned_addr learned my addr 172.21.15.82:0/426293154 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:48:40.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:40.928+0000 7f5f62ffd700 1 --2- 172.21.15.82:0/426293154 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5f641009b0 0x7f5f64198770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:41236/0 (socket says 172.21.15.82:41236) 2023-09-23T08:48:40.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:40.928+0000 7f5f637fe700 1 --2- 172.21.15.82:0/426293154 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f64102550 0x7f5f6419fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:48:40.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:40.928+0000 7f5f62ffd700 1 -- 172.21.15.82:0/426293154 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f64102550 msgr2=0x7f5f6419fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:48:40.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:40.928+0000 7f5f62ffd700 1 --2- 172.21.15.82:0/426293154 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f64102550 0x7f5f6419fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:48:40.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:40.928+0000 7f5f62ffd700 1 -- 172.21.15.82:0/426293154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f64101bb0 msgr2=0x7f5f64198cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:48:40.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:40.928+0000 7f5f62ffd700 1 --2- 172.21.15.82:0/426293154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f64101bb0 0x7f5f64198cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:48:40.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:40.928+0000 7f5f62ffd700 1 -- 172.21.15.82:0/426293154 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f580095f0 con 0x7f5f641009b0 2023-09-23T08:48:40.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:40.928+0000 7f5f627fc700 1 --2- 172.21.15.82:0/426293154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f64101bb0 0x7f5f64198cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T08:48:40.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:40.928+0000 7f5f62ffd700 1 --2- 172.21.15.82:0/426293154 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5f641009b0 0x7f5f64198770 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5f5400e9f0 tx=0x7f5f5400ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:48:40.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:40.929+0000 7f5f4bfff700 1 -- 172.21.15.82:0/426293154 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f54004220 con 0x7f5f641009b0 2023-09-23T08:48:40.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:40.929+0000 7f5f695ae700 1 -- 172.21.15.82:0/426293154 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f641a08b0 con 0x7f5f641009b0 2023-09-23T08:48:40.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:40.929+0000 7f5f4bfff700 1 -- 172.21.15.82:0/426293154 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5f54004380 con 0x7f5f641009b0 2023-09-23T08:48:40.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:40.929+0000 7f5f4bfff700 1 -- 172.21.15.82:0/426293154 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f54003b40 con 0x7f5f641009b0 2023-09-23T08:48:40.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:40.929+0000 7f5f695ae700 1 -- 172.21.15.82:0/426293154 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f641a0db0 con 0x7f5f641009b0 2023-09-23T08:48:40.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:40.930+0000 7f5f695ae700 1 -- 172.21.15.82:0/426293154 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f64192ea0 con 0x7f5f641009b0 2023-09-23T08:48:40.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:40.930+0000 7f5f4bfff700 1 -- 172.21.15.82:0/426293154 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 13) v1 ==== 45191+0+0 (secure 0 0 0) 0x7f5f54003ca0 con 0x7f5f641009b0 2023-09-23T08:48:40.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:40.930+0000 7f5f4bfff700 1 --2- 172.21.15.82:0/426293154 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f5f4c0383e0 0x7f5f4c03a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:48:40.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:40.930+0000 7f5f4bfff700 1 -- 172.21.15.82:0/426293154 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f5f54014070 con 0x7f5f641009b0 2023-09-23T08:48:40.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:40.931+0000 7f5f627fc700 1 --2- 172.21.15.82:0/426293154 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f5f4c0383e0 0x7f5f4c03a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:48:40.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:40.931+0000 7f5f627fc700 1 --2- 172.21.15.82:0/426293154 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f5f4c0383e0 0x7f5f4c03a8a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5f580095c0 tx=0x7f5f58009530 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:48:40.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:40.936+0000 7f5f4bfff700 1 -- 172.21.15.82:0/426293154 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f5f540044f0 con 0x7f5f641009b0 2023-09-23T08:48:41.037 INFO:journalctl@ceph.mgr.z.smithi161.stdout:Sep 23 08:48:40 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-z[101707]: 2023-09-23T08:48:40.738+0000 7f79f7b23200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-09-23T08:48:41.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:41.146+0000 7f5f695ae700 1 -- 172.21.15.82:0/426293154 --> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f5f6402cf20 con 0x7f5f4c0383e0 2023-09-23T08:48:41.398 INFO:journalctl@ceph.mgr.z.smithi161.stdout:Sep 23 08:48:41 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-z[101707]: 2023-09-23T08:48:41.033+0000 7f79f7b23200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-09-23T08:48:41.398 INFO:journalctl@ceph.mgr.z.smithi161.stdout:Sep 23 08:48:41 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-z[101707]: 2023-09-23T08:48:41.244+0000 7f79f7b23200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-09-23T08:48:41.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:41 smithi161 ceph-mon[99580]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:41.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:41 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-23T08:48:41.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:41 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-23T08:48:41.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:41 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:48:41.562 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Sep 23 08:48:41 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-y[100663]: 2023-09-23T08:48:41.215+0000 7f4910707200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-09-23T08:48:41.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:41 smithi135 ceph-mon[99205]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:41.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:41 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-23T08:48:41.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:41 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-23T08:48:41.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:41 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:48:41.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:41 smithi082 ceph-mon[97694]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:41.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:41 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-23T08:48:41.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:41 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-23T08:48:41.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:41 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:48:41.898 INFO:journalctl@ceph.mgr.z.smithi161.stdout:Sep 23 08:48:41 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-z[101707]: 2023-09-23T08:48:41.596+0000 7f79f7b23200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-09-23T08:48:42.444 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Sep 23 08:48:42 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-y[100663]: 2023-09-23T08:48:42.121+0000 7f4910707200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-09-23T08:48:42.444 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Sep 23 08:48:42 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-y[100663]: 2023-09-23T08:48:42.227+0000 7f4910707200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-09-23T08:48:42.530 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:42 smithi082 ceph-mon[97694]: from='client.24121 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:48:42.531 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:42 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:42.531 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:42 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:42.531 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:42 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:42.531 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:42 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:42.531 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:42 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:48:42.531 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:42 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:48:42.531 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:42 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:42.531 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:42 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-09-23T08:48:42.531 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:42 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-09-23T08:48:42.531 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:42 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:48:42.531 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:42 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:42.708 INFO:journalctl@ceph.mgr.z.smithi161.stdout:Sep 23 08:48:42 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-z[101707]: 2023-09-23T08:48:42.532+0000 7f79f7b23200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-09-23T08:48:42.709 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:42 smithi161 ceph-mon[99580]: from='client.24121 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:48:42.709 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:42 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:42.709 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:42 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:42.709 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:42 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:42.709 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:42 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:42.709 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:42 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:48:42.709 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:42 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:48:42.709 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:42 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:42.709 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:42 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-09-23T08:48:42.710 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:42 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-09-23T08:48:42.710 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:42 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:48:42.710 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:42 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:42.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:42 smithi135 ceph-mon[99205]: from='client.24121 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:48:42.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:42 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:42.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:42 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:42.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:42 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:42.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:42 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:42.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:42 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:48:42.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:42 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:48:42.814 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:42 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:42.814 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:42 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-09-23T08:48:42.814 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:42 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-09-23T08:48:42.814 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:42 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:48:42.814 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:42 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:43.099 INFO:journalctl@ceph.mgr.z.smithi161.stdout:Sep 23 08:48:42 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-z[101707]: 2023-09-23T08:48:42.705+0000 7f79f7b23200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-09-23T08:48:43.099 INFO:journalctl@ceph.mgr.z.smithi161.stdout:Sep 23 08:48:42 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-z[101707]: 2023-09-23T08:48:42.951+0000 7f79f7b23200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-09-23T08:48:43.374 INFO:journalctl@ceph.mgr.z.smithi161.stdout:Sep 23 08:48:43 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-z[101707]: 2023-09-23T08:48:43.096+0000 7f79f7b23200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-09-23T08:48:43.444 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Sep 23 08:48:43 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-y[100663]: 2023-09-23T08:48:43.173+0000 7f4910707200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-09-23T08:48:43.444 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Sep 23 08:48:43 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-y[100663]: 2023-09-23T08:48:43.290+0000 7f4910707200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-09-23T08:48:43.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:43 smithi161 ceph-mon[99580]: Reconfiguring mgr.x (unknown last config time)... 2023-09-23T08:48:43.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:43 smithi161 ceph-mon[99580]: Reconfiguring daemon mgr.x on smithi082 2023-09-23T08:48:43.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:43 smithi161 ceph-mon[99580]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:43.649 INFO:journalctl@ceph.mgr.z.smithi161.stdout:Sep 23 08:48:43 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-z[101707]: 2023-09-23T08:48:43.371+0000 7f79f7b23200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-09-23T08:48:43.812 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Sep 23 08:48:43 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-y[100663]: 2023-09-23T08:48:43.512+0000 7f4910707200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-09-23T08:48:43.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:43 smithi135 ceph-mon[99205]: Reconfiguring mgr.x (unknown last config time)... 2023-09-23T08:48:43.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:43 smithi135 ceph-mon[99205]: Reconfiguring daemon mgr.x on smithi082 2023-09-23T08:48:43.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:43 smithi135 ceph-mon[99205]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:43.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:43 smithi082 ceph-mon[97694]: Reconfiguring mgr.x (unknown last config time)... 2023-09-23T08:48:43.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:43 smithi082 ceph-mon[97694]: Reconfiguring daemon mgr.x on smithi082 2023-09-23T08:48:43.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:43 smithi082 ceph-mon[97694]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:44.161 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Sep 23 08:48:43 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-y[100663]: 2023-09-23T08:48:43.882+0000 7f4910707200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-09-23T08:48:44.562 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Sep 23 08:48:44 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-y[100663]: 2023-09-23T08:48:44.158+0000 7f4910707200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-09-23T08:48:44.562 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Sep 23 08:48:44 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-y[100663]: 2023-09-23T08:48:44.353+0000 7f4910707200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-09-23T08:48:44.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:44.688+0000 7f5f4bfff700 1 -- 172.21.15.82:0/426293154 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mgrmap(e 14) v1 ==== 89903+0+0 (secure 0 0 0) 0x7f5f540217b0 con 0x7f5f641009b0 2023-09-23T08:48:44.898 INFO:journalctl@ceph.mgr.z.smithi161.stdout:Sep 23 08:48:44 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-z[101707]: 2023-09-23T08:48:44.447+0000 7f79f7b23200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-09-23T08:48:44.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:44 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:44.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:44 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:44.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:44 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:48:44.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:44 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:48:44.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:44 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:48:44.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:44 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:44.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:44 smithi161 ceph-mon[99580]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:44.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:44 smithi161 ceph-mon[99580]: Standby manager daemon z started 2023-09-23T08:48:44.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:44 smithi161 ceph-mon[99580]: from='mgr.? 172.21.15.161:0/3581919788' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-09-23T08:48:44.900 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:44 smithi161 ceph-mon[99580]: from='mgr.? 172.21.15.161:0/3581919788' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-09-23T08:48:44.900 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:44 smithi161 ceph-mon[99580]: from='mgr.? 172.21.15.161:0/3581919788' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-09-23T08:48:44.900 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:44 smithi161 ceph-mon[99580]: from='mgr.? 172.21.15.161:0/3581919788' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-09-23T08:48:45.062 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Sep 23 08:48:44 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-y[100663]: 2023-09-23T08:48:44.694+0000 7f4910707200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-09-23T08:48:45.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:44 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:45.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:44 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:45.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:44 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:48:45.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:44 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:48:45.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:44 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:48:45.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:44 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:45.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:44 smithi135 ceph-mon[99205]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:45.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:44 smithi135 ceph-mon[99205]: Standby manager daemon z started 2023-09-23T08:48:45.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:44 smithi135 ceph-mon[99205]: from='mgr.? 172.21.15.161:0/3581919788' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-09-23T08:48:45.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:44 smithi135 ceph-mon[99205]: from='mgr.? 172.21.15.161:0/3581919788' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-09-23T08:48:45.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:44 smithi135 ceph-mon[99205]: from='mgr.? 172.21.15.161:0/3581919788' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-09-23T08:48:45.064 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:44 smithi135 ceph-mon[99205]: from='mgr.? 172.21.15.161:0/3581919788' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-09-23T08:48:45.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:44 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:45.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:44 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:45.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:44 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:48:45.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:44 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:48:45.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:44 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:48:45.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:44 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:48:45.122 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:44 smithi082 ceph-mon[97694]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:45.122 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:44 smithi082 ceph-mon[97694]: Standby manager daemon z started 2023-09-23T08:48:45.122 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:44 smithi082 ceph-mon[97694]: from='mgr.? 172.21.15.161:0/3581919788' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-09-23T08:48:45.122 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:44 smithi082 ceph-mon[97694]: from='mgr.? 172.21.15.161:0/3581919788' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-09-23T08:48:45.122 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:44 smithi082 ceph-mon[97694]: from='mgr.? 172.21.15.161:0/3581919788' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-09-23T08:48:45.122 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:44 smithi082 ceph-mon[97694]: from='mgr.? 172.21.15.161:0/3581919788' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-09-23T08:48:46.036 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Sep 23 08:48:45 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-y[100663]: 2023-09-23T08:48:45.612+0000 7f4910707200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-09-23T08:48:46.036 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Sep 23 08:48:45 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-y[100663]: 2023-09-23T08:48:45.787+0000 7f4910707200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-09-23T08:48:46.037 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:45 smithi135 ceph-mon[99205]: mgrmap e14: x(active, since 82s), standbys: z 2023-09-23T08:48:46.037 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:45 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-09-23T08:48:46.037 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:45 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/4237822962' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7384c1ff-8c71-4feb-8cef-ba45c2a1708a"}]: dispatch 2023-09-23T08:48:46.037 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:45 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/4237822962' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7384c1ff-8c71-4feb-8cef-ba45c2a1708a"}]': finished 2023-09-23T08:48:46.037 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:45 smithi135 ceph-mon[99205]: osdmap e5: 1 total, 0 up, 1 in 2023-09-23T08:48:46.037 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:45 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-09-23T08:48:46.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:45 smithi082 ceph-mon[97694]: mgrmap e14: x(active, since 82s), standbys: z 2023-09-23T08:48:46.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:45 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-09-23T08:48:46.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:45 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/4237822962' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7384c1ff-8c71-4feb-8cef-ba45c2a1708a"}]: dispatch 2023-09-23T08:48:46.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:45 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/4237822962' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7384c1ff-8c71-4feb-8cef-ba45c2a1708a"}]': finished 2023-09-23T08:48:46.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:45 smithi082 ceph-mon[97694]: osdmap e5: 1 total, 0 up, 1 in 2023-09-23T08:48:46.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:45 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-09-23T08:48:46.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:45 smithi161 ceph-mon[99580]: mgrmap e14: x(active, since 82s), standbys: z 2023-09-23T08:48:46.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:45 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-09-23T08:48:46.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:45 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/4237822962' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7384c1ff-8c71-4feb-8cef-ba45c2a1708a"}]: dispatch 2023-09-23T08:48:46.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:45 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/4237822962' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7384c1ff-8c71-4feb-8cef-ba45c2a1708a"}]': finished 2023-09-23T08:48:46.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:45 smithi161 ceph-mon[99580]: osdmap e5: 1 total, 0 up, 1 in 2023-09-23T08:48:46.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:45 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-09-23T08:48:46.312 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Sep 23 08:48:46 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-y[100663]: 2023-09-23T08:48:46.033+0000 7f4910707200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-09-23T08:48:46.312 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Sep 23 08:48:46 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-y[100663]: 2023-09-23T08:48:46.176+0000 7f4910707200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-09-23T08:48:46.704 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Sep 23 08:48:46 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-y[100663]: 2023-09-23T08:48:46.449+0000 7f4910707200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-09-23T08:48:47.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:46 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/2864984032' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-23T08:48:47.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:46 smithi135 ceph-mon[99205]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:47.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:46 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/2864984032' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-23T08:48:47.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:46 smithi082 ceph-mon[97694]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:47.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:46 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/2864984032' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-23T08:48:47.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:46 smithi161 ceph-mon[99580]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:47.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:48:47.715+0000 7f5f4bfff700 1 -- 172.21.15.82:0/426293154 <== mon.1 v2:172.21.15.161:3300/0 8 ==== mgrmap(e 15) v1 ==== 134615+0+0 (secure 0 0 0) 0x7f5f54018ab0 con 0x7f5f641009b0 2023-09-23T08:48:47.815 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Sep 23 08:48:47 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-y[100663]: 2023-09-23T08:48:47.515+0000 7f4910707200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-09-23T08:48:47.817 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:47 smithi135 ceph-mon[99205]: Standby manager daemon y started 2023-09-23T08:48:47.817 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:47 smithi135 ceph-mon[99205]: from='mgr.? 172.21.15.135:0/3084072482' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-09-23T08:48:47.817 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:47 smithi135 ceph-mon[99205]: from='mgr.? 172.21.15.135:0/3084072482' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-09-23T08:48:47.817 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:47 smithi135 ceph-mon[99205]: from='mgr.? 172.21.15.135:0/3084072482' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-09-23T08:48:47.818 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:47 smithi135 ceph-mon[99205]: from='mgr.? 172.21.15.135:0/3084072482' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-09-23T08:48:48.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:47 smithi082 ceph-mon[97694]: Standby manager daemon y started 2023-09-23T08:48:48.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:47 smithi082 ceph-mon[97694]: from='mgr.? 172.21.15.135:0/3084072482' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-09-23T08:48:48.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:47 smithi082 ceph-mon[97694]: from='mgr.? 172.21.15.135:0/3084072482' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-09-23T08:48:48.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:47 smithi082 ceph-mon[97694]: from='mgr.? 172.21.15.135:0/3084072482' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-09-23T08:48:48.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:47 smithi082 ceph-mon[97694]: from='mgr.? 172.21.15.135:0/3084072482' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-09-23T08:48:48.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:47 smithi161 ceph-mon[99580]: Standby manager daemon y started 2023-09-23T08:48:48.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:47 smithi161 ceph-mon[99580]: from='mgr.? 172.21.15.135:0/3084072482' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-09-23T08:48:48.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:47 smithi161 ceph-mon[99580]: from='mgr.? 172.21.15.135:0/3084072482' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-09-23T08:48:48.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:47 smithi161 ceph-mon[99580]: from='mgr.? 172.21.15.135:0/3084072482' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-09-23T08:48:48.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:47 smithi161 ceph-mon[99580]: from='mgr.? 172.21.15.135:0/3084072482' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-09-23T08:48:49.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:48 smithi135 ceph-mon[99205]: mgrmap e15: x(active, since 85s), standbys: z, y 2023-09-23T08:48:49.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:48 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-09-23T08:48:49.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:48 smithi135 ceph-mon[99205]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:49.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:48 smithi082 ceph-mon[97694]: mgrmap e15: x(active, since 85s), standbys: z, y 2023-09-23T08:48:49.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:48 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-09-23T08:48:49.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:48 smithi082 ceph-mon[97694]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:49.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:48 smithi161 ceph-mon[99580]: mgrmap e15: x(active, since 85s), standbys: z, y 2023-09-23T08:48:49.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:48 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-09-23T08:48:49.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:48 smithi161 ceph-mon[99580]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:51.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:51 smithi135 ceph-mon[99205]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:51.367 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:51 smithi082 ceph-mon[97694]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:51.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:51 smithi161 ceph-mon[99580]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:53.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:53 smithi135 ceph-mon[99205]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:53.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:53 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-09-23T08:48:53.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:53 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:48:53.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:53 smithi082 ceph-mon[97694]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:53.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:53 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-09-23T08:48:53.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:53 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:48:53.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:53 smithi161 ceph-mon[99580]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:53.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:53 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-09-23T08:48:53.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:53 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:48:54.255 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:54 smithi082 ceph-mon[97694]: Deploying daemon osd.0 on smithi082 2023-09-23T08:48:54.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:54 smithi135 ceph-mon[99205]: Deploying daemon osd.0 on smithi082 2023-09-23T08:48:54.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:54 smithi161 ceph-mon[99580]: Deploying daemon osd.0 on smithi082 2023-09-23T08:48:55.308 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:55 smithi082 ceph-mon[97694]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:55.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:55 smithi135 ceph-mon[99205]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:55.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:55 smithi161 ceph-mon[99580]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:57.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:56 smithi135 ceph-mon[99205]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:57.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:56 smithi082 ceph-mon[97694]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:57.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:56 smithi161 ceph-mon[99580]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:59.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:48:59 smithi135 ceph-mon[99205]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:59.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:48:59 smithi082 ceph-mon[97694]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:48:59.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:48:59 smithi161 ceph-mon[99580]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:49:00.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:00 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:49:00.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:00 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:49:00.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:00 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:49:00.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:00 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:49:00.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:00 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:49:00.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:00 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:49:00.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:00 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:49:00.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:00 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:49:00.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:00 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:49:01.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:01 smithi082 ceph-mon[97694]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:49:01.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:01 smithi161 ceph-mon[99580]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:49:01.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:01 smithi135 ceph-mon[99205]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:49:02.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:49:02.457+0000 7f5f4bfff700 1 -- 172.21.15.82:0/426293154 <== mgr.14152 v2:172.21.15.82:6800/3698954311 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f5f6402cf20 con 0x7f5f4c0383e0 2023-09-23T08:49:02.461 INFO:teuthology.orchestra.run.smithi082.stdout:Created osd(s) 0 on host 'smithi082' 2023-09-23T08:49:02.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:49:02.460+0000 7f5f695ae700 1 -- 172.21.15.82:0/426293154 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f5f4c0383e0 msgr2=0x7f5f4c03a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:49:02.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:49:02.460+0000 7f5f695ae700 1 --2- 172.21.15.82:0/426293154 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f5f4c0383e0 0x7f5f4c03a8a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5f580095c0 tx=0x7f5f58009530 comp rx=0 tx=0).stop 2023-09-23T08:49:02.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:49:02.460+0000 7f5f695ae700 1 -- 172.21.15.82:0/426293154 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5f641009b0 msgr2=0x7f5f64198770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:49:02.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:49:02.460+0000 7f5f695ae700 1 --2- 172.21.15.82:0/426293154 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5f641009b0 0x7f5f64198770 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5f5400e9f0 tx=0x7f5f5400ed00 comp rx=0 tx=0).stop 2023-09-23T08:49:02.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:49:02.460+0000 7f5f695ae700 1 -- 172.21.15.82:0/426293154 shutdown_connections 2023-09-23T08:49:02.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:49:02.460+0000 7f5f695ae700 1 --2- 172.21.15.82:0/426293154 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f5f4c0383e0 0x7f5f4c03a8a0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:49:02.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:49:02.460+0000 7f5f695ae700 1 --2- 172.21.15.82:0/426293154 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f64102550 0x7f5f6419fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:49:02.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:49:02.460+0000 7f5f695ae700 1 --2- 172.21.15.82:0/426293154 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5f641009b0 0x7f5f64198770 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:49:02.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:49:02.460+0000 7f5f695ae700 1 --2- 172.21.15.82:0/426293154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f64101bb0 0x7f5f64198cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:49:02.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:49:02.460+0000 7f5f695ae700 1 -- 172.21.15.82:0/426293154 >> 172.21.15.82:0/426293154 conn(0x7f5f640fbf10 msgr2=0x7f5f64107580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:49:02.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:49:02.460+0000 7f5f695ae700 1 -- 172.21.15.82:0/426293154 shutdown_connections 2023-09-23T08:49:02.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:49:02.460+0000 7f5f695ae700 1 -- 172.21.15.82:0/426293154 wait complete. 2023-09-23T08:49:02.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:02 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:49:02.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:02 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:49:02.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:02 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:49:02.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:02 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:49:02.722 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:02 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:49:02.722 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:02 smithi082 ceph-mon[97694]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:49:02.722 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:02 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:49:02.722 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:02 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:49:02.722 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:02 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:49:02.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:02 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:49:02.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:02 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:49:02.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:02 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:49:02.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:02 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:49:02.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:02 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:49:02.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:02 smithi161 ceph-mon[99580]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:49:02.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:02 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:49:02.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:02 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:49:02.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:02 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:49:03.039 DEBUG:teuthology.orchestra.run.smithi082:osd.0> sudo journalctl -f -n 0 -u ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@osd.0.service 2023-09-23T08:49:03.043 INFO:tasks.cephadm:Deploying osd.1 on smithi135 with /dev/vg_nvme/lv_4... 2023-09-23T08:49:03.044 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-09-23T08:49:03.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:02 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:49:03.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:02 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:49:03.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:02 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:49:03.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:02 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:49:03.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:02 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:49:03.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:02 smithi135 ceph-mon[99205]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:49:03.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:02 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:49:03.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:02 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:49:03.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:02 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:49:03.118 INFO:journalctl@ceph.osd.0.smithi082.stdout:-- Logs begin at Sat 2023-09-23 08:29:32 UTC. -- 2023-09-23T08:49:03.766 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.b/config 2023-09-23T08:49:03.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:03 smithi082 ceph-mon[97694]: from='osd.0 [v2:172.21.15.82:6802/892441948,v1:172.21.15.82:6803/892441948]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-09-23T08:49:03.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:03 smithi161 ceph-mon[99580]: from='osd.0 [v2:172.21.15.82:6802/892441948,v1:172.21.15.82:6803/892441948]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-09-23T08:49:04.042 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:03 smithi135 ceph-mon[99205]: from='osd.0 [v2:172.21.15.82:6802/892441948,v1:172.21.15.82:6803/892441948]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-09-23T08:49:04.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:04 smithi082 ceph-mon[97694]: from='osd.0 [v2:172.21.15.82:6802/892441948,v1:172.21.15.82:6803/892441948]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-09-23T08:49:04.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:04 smithi082 ceph-mon[97694]: osdmap e6: 1 total, 0 up, 1 in 2023-09-23T08:49:04.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:04 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-09-23T08:49:04.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:04 smithi082 ceph-mon[97694]: from='osd.0 [v2:172.21.15.82:6802/892441948,v1:172.21.15.82:6803/892441948]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2023-09-23T08:49:04.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:04 smithi082 ceph-mon[97694]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:49:04.872 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 23 08:49:04 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-0[110806]: 2023-09-23T08:49:04.623+0000 7fea6eac4700 -1 osd.0 0 waiting for initial osdmap 2023-09-23T08:49:04.872 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 23 08:49:04 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-0[110806]: 2023-09-23T08:49:04.630+0000 7fea690b6700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-23T08:49:04.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:04 smithi161 ceph-mon[99580]: from='osd.0 [v2:172.21.15.82:6802/892441948,v1:172.21.15.82:6803/892441948]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-09-23T08:49:04.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:04 smithi161 ceph-mon[99580]: osdmap e6: 1 total, 0 up, 1 in 2023-09-23T08:49:04.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:04 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-09-23T08:49:04.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:04 smithi161 ceph-mon[99580]: from='osd.0 [v2:172.21.15.82:6802/892441948,v1:172.21.15.82:6803/892441948]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2023-09-23T08:49:04.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:04 smithi161 ceph-mon[99580]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:49:05.022 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:04 smithi135 ceph-mon[99205]: from='osd.0 [v2:172.21.15.82:6802/892441948,v1:172.21.15.82:6803/892441948]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-09-23T08:49:05.022 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:04 smithi135 ceph-mon[99205]: osdmap e6: 1 total, 0 up, 1 in 2023-09-23T08:49:05.022 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:04 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-09-23T08:49:05.022 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:04 smithi135 ceph-mon[99205]: from='osd.0 [v2:172.21.15.82:6802/892441948,v1:172.21.15.82:6803/892441948]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2023-09-23T08:49:05.022 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:04 smithi135 ceph-mon[99205]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:49:05.742 INFO:teuthology.orchestra.run.smithi135.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-09-23T08:49:05.742 INFO:teuthology.orchestra.run.smithi135.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-09-23T08:49:05.742 INFO:teuthology.orchestra.run.smithi135.stderr: stderr: 10+0 records in 2023-09-23T08:49:05.742 INFO:teuthology.orchestra.run.smithi135.stderr:10+0 records out 2023-09-23T08:49:05.743 INFO:teuthology.orchestra.run.smithi135.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0465782 s, 225 MB/s 2023-09-23T08:49:05.743 INFO:teuthology.orchestra.run.smithi135.stderr:--> Zapping successful for: 2023-09-23T08:49:05.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:05 smithi161 ceph-mon[99580]: from='osd.0 [v2:172.21.15.82:6802/892441948,v1:172.21.15.82:6803/892441948]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2023-09-23T08:49:05.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:05 smithi161 ceph-mon[99580]: osdmap e7: 1 total, 0 up, 1 in 2023-09-23T08:49:05.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:05 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-09-23T08:49:05.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:05 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-09-23T08:49:05.908 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:05 smithi135 ceph-mon[99205]: from='osd.0 [v2:172.21.15.82:6802/892441948,v1:172.21.15.82:6803/892441948]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2023-09-23T08:49:05.909 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:05 smithi135 ceph-mon[99205]: osdmap e7: 1 total, 0 up, 1 in 2023-09-23T08:49:05.909 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:05 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-09-23T08:49:05.909 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:05 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-09-23T08:49:06.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:05 smithi082 ceph-mon[97694]: from='osd.0 [v2:172.21.15.82:6802/892441948,v1:172.21.15.82:6803/892441948]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2023-09-23T08:49:06.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:05 smithi082 ceph-mon[97694]: osdmap e7: 1 total, 0 up, 1 in 2023-09-23T08:49:06.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:05 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-09-23T08:49:06.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:05 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-09-23T08:49:06.240 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- ceph orch daemon add osd smithi135:vg_nvme/lv_4 2023-09-23T08:49:06.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:06 smithi161 ceph-mon[99580]: purged_snaps scrub starts 2023-09-23T08:49:06.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:06 smithi161 ceph-mon[99580]: purged_snaps scrub ok 2023-09-23T08:49:06.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:06 smithi161 ceph-mon[99580]: osd.0 [v2:172.21.15.82:6802/892441948,v1:172.21.15.82:6803/892441948] boot 2023-09-23T08:49:06.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:06 smithi161 ceph-mon[99580]: osdmap e8: 1 total, 1 up, 1 in 2023-09-23T08:49:06.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:06 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-09-23T08:49:06.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:06 smithi161 ceph-mon[99580]: Detected new or changed devices on smithi082 2023-09-23T08:49:06.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:06 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:49:06.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:06 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:49:06.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:06 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:49:06.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:06 smithi161 ceph-mon[99580]: Adjusting osd_memory_target on smithi082 to 17267M 2023-09-23T08:49:06.900 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:06 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:49:06.900 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:06 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:49:06.900 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:06 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:49:06.900 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:06 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:49:06.900 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:06 smithi161 ceph-mon[99580]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:49:06.995 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.b/config 2023-09-23T08:49:07.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:06 smithi135 ceph-mon[99205]: purged_snaps scrub starts 2023-09-23T08:49:07.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:06 smithi135 ceph-mon[99205]: purged_snaps scrub ok 2023-09-23T08:49:07.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:06 smithi135 ceph-mon[99205]: osd.0 [v2:172.21.15.82:6802/892441948,v1:172.21.15.82:6803/892441948] boot 2023-09-23T08:49:07.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:06 smithi135 ceph-mon[99205]: osdmap e8: 1 total, 1 up, 1 in 2023-09-23T08:49:07.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:06 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-09-23T08:49:07.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:06 smithi135 ceph-mon[99205]: Detected new or changed devices on smithi082 2023-09-23T08:49:07.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:06 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:49:07.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:06 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:49:07.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:06 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:49:07.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:06 smithi135 ceph-mon[99205]: Adjusting osd_memory_target on smithi082 to 17267M 2023-09-23T08:49:07.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:06 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:49:07.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:06 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:49:07.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:06 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:49:07.064 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:06 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:49:07.064 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:06 smithi135 ceph-mon[99205]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:49:07.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:06 smithi082 ceph-mon[97694]: purged_snaps scrub starts 2023-09-23T08:49:07.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:06 smithi082 ceph-mon[97694]: purged_snaps scrub ok 2023-09-23T08:49:07.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:06 smithi082 ceph-mon[97694]: osd.0 [v2:172.21.15.82:6802/892441948,v1:172.21.15.82:6803/892441948] boot 2023-09-23T08:49:07.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:06 smithi082 ceph-mon[97694]: osdmap e8: 1 total, 1 up, 1 in 2023-09-23T08:49:07.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:06 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-09-23T08:49:07.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:06 smithi082 ceph-mon[97694]: Detected new or changed devices on smithi082 2023-09-23T08:49:07.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:06 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:49:07.122 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:06 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:49:07.122 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:06 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:49:07.122 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:06 smithi082 ceph-mon[97694]: Adjusting osd_memory_target on smithi082 to 17267M 2023-09-23T08:49:07.122 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:06 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:49:07.122 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:06 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:49:07.122 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:06 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:49:07.122 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:06 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:49:07.122 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:06 smithi082 ceph-mon[97694]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-23T08:49:07.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:07 smithi135 ceph-mon[99205]: osdmap e9: 1 total, 1 up, 1 in 2023-09-23T08:49:08.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:07 smithi082 ceph-mon[97694]: osdmap e9: 1 total, 1 up, 1 in 2023-09-23T08:49:08.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:07 smithi161 ceph-mon[99580]: osdmap e9: 1 total, 1 up, 1 in 2023-09-23T08:49:08.519 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:49:08.516+0000 7fa6da5fc700 1 -- 172.21.15.135:0/2064867825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6d4101bb0 msgr2=0x7fa6d4102010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:49:08.519 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:49:08.516+0000 7fa6da5fc700 1 --2- 172.21.15.135:0/2064867825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6d4101bb0 0x7fa6d4102010 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa6c80099c0 tx=0x7fa6c8009cd0 comp rx=0 tx=0).stop 2023-09-23T08:49:08.520 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:49:08.516+0000 7fa6da5fc700 1 -- 172.21.15.135:0/2064867825 shutdown_connections 2023-09-23T08:49:08.520 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:49:08.516+0000 7fa6da5fc700 1 --2- 172.21.15.135:0/2064867825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa6d4102550 0x7fa6d4108e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:49:08.520 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:49:08.516+0000 7fa6da5fc700 1 --2- 172.21.15.135:0/2064867825 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa6d41009b0 0x7fa6d4100dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:49:08.520 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:49:08.516+0000 7fa6da5fc700 1 --2- 172.21.15.135:0/2064867825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6d4101bb0 0x7fa6d4102010 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:49:08.520 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:49:08.516+0000 7fa6da5fc700 1 -- 172.21.15.135:0/2064867825 >> 172.21.15.135:0/2064867825 conn(0x7fa6d40fbf10 msgr2=0x7fa6d40fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:49:08.520 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:49:08.516+0000 7fa6da5fc700 1 -- 172.21.15.135:0/2064867825 shutdown_connections 2023-09-23T08:49:08.520 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:49:08.516+0000 7fa6da5fc700 1 -- 172.21.15.135:0/2064867825 wait complete. 2023-09-23T08:49:08.522 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:49:08.517+0000 7fa6da5fc700 1 Processor -- start 2023-09-23T08:49:08.522 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:49:08.518+0000 7fa6da5fc700 1 -- start start 2023-09-23T08:49:08.522 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:49:08.518+0000 7fa6da5fc700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa6d41009b0 0x7fa6d40746c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:49:08.522 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:49:08.518+0000 7fa6da5fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6d4101bb0 0x7fa6d4072d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:49:08.522 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:49:08.518+0000 7fa6da5fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa6d4102550 0x7fa6d4073250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:49:08.522 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:49:08.518+0000 7fa6da5fc700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d40739d0 con 0x7fa6d4102550 2023-09-23T08:49:08.522 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:49:08.518+0000 7fa6da5fc700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d4073b40 con 0x7fa6d4101bb0 2023-09-23T08:49:08.522 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:49:08.518+0000 7fa6da5fc700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d41a0680 con 0x7fa6d41009b0 2023-09-23T08:49:08.523 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:49:08.518+0000 7fa6d3fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa6d41009b0 0x7fa6d40746c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:49:08.523 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:49:08.518+0000 7fa6d3fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa6d41009b0 0x7fa6d40746c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.135:33506/0 (socket says 172.21.15.135:33506) 2023-09-23T08:49:08.523 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:49:08.518+0000 7fa6d3fff700 1 -- 172.21.15.135:0/4053641549 learned_addr learned my addr 172.21.15.135:0/4053641549 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-09-23T08:49:08.523 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:49:08.518+0000 7fa6d8b99700 1 --2- 172.21.15.135:0/4053641549 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa6d4102550 0x7fa6d4073250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:49:08.523 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:49:08.519+0000 7fa6d37fe700 1 --2- 172.21.15.135:0/4053641549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6d4101bb0 0x7fa6d4072d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:49:08.523 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:49:08.519+0000 7fa6d3fff700 1 -- 172.21.15.135:0/4053641549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6d4101bb0 msgr2=0x7fa6d4072d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:49:08.523 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:49:08.519+0000 7fa6d3fff700 1 --2- 172.21.15.135:0/4053641549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6d4101bb0 0x7fa6d4072d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:49:08.523 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:49:08.519+0000 7fa6d3fff700 1 -- 172.21.15.135:0/4053641549 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa6d4102550 msgr2=0x7fa6d4073250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:49:08.523 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:49:08.519+0000 7fa6d3fff700 1 --2- 172.21.15.135:0/4053641549 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa6d4102550 0x7fa6d4073250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:49:08.523 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:49:08.519+0000 7fa6d3fff700 1 -- 172.21.15.135:0/4053641549 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6c80095f0 con 0x7fa6d41009b0 2023-09-23T08:49:08.524 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:49:08.519+0000 7fa6d37fe700 1 --2- 172.21.15.135:0/4053641549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6d4101bb0 0x7fa6d4072d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T08:49:08.524 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:49:08.519+0000 7fa6d3fff700 1 --2- 172.21.15.135:0/4053641549 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa6d41009b0 0x7fa6d40746c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa6c400d980 tx=0x7fa6c400dc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:49:08.524 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:49:08.519+0000 7fa6d17fa700 1 -- 172.21.15.135:0/4053641549 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c4004020 con 0x7fa6d41009b0 2023-09-23T08:49:08.524 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:49:08.519+0000 7fa6d17fa700 1 -- 172.21.15.135:0/4053641549 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa6c4009730 con 0x7fa6d41009b0 2023-09-23T08:49:08.524 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:49:08.519+0000 7fa6da5fc700 1 -- 172.21.15.135:0/4053641549 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6d41a0960 con 0x7fa6d41009b0 2023-09-23T08:49:08.524 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:49:08.519+0000 7fa6d17fa700 1 -- 172.21.15.135:0/4053641549 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c4003a00 con 0x7fa6d41009b0 2023-09-23T08:49:08.524 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:49:08.520+0000 7fa6da5fc700 1 -- 172.21.15.135:0/4053641549 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6d41a0eb0 con 0x7fa6d41009b0 2023-09-23T08:49:08.524 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:49:08.521+0000 7fa6da5fc700 1 -- 172.21.15.135:0/4053641549 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6d41080e0 con 0x7fa6d41009b0 2023-09-23T08:49:08.525 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:49:08.523+0000 7fa6d17fa700 1 -- 172.21.15.135:0/4053641549 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 15) v1 ==== 134615+0+0 (secure 0 0 0) 0x7fa6c40098a0 con 0x7fa6d41009b0 2023-09-23T08:49:08.526 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:49:08.524+0000 7fa6d17fa700 1 --2- 172.21.15.135:0/4053641549 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fa6bc09ff40 0x7fa6bc0a2400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:49:08.526 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:49:08.524+0000 7fa6d17fa700 1 -- 172.21.15.135:0/4053641549 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1767+0+0 (secure 0 0 0) 0x7fa6c40c9420 con 0x7fa6d41009b0 2023-09-23T08:49:08.527 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:49:08.525+0000 7fa6d37fe700 1 --2- 172.21.15.135:0/4053641549 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fa6bc09ff40 0x7fa6bc0a2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:49:08.527 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:49:08.525+0000 7fa6d37fe700 1 --2- 172.21.15.135:0/4053641549 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fa6bc09ff40 0x7fa6bc0a2400 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa6c800c010 tx=0x7fa6c8005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:49:08.529 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:49:08.527+0000 7fa6d17fa700 1 -- 172.21.15.135:0/4053641549 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7fa6c4094c00 con 0x7fa6d41009b0 2023-09-23T08:49:08.735 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:49:08.732+0000 7fa6da5fc700 1 -- 172.21.15.135:0/4053641549 --> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fa6d402ce20 con 0x7fa6bc09ff40 2023-09-23T08:49:09.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:08 smithi135 ceph-mon[99205]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-23T08:49:09.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:08 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-23T08:49:09.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:08 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-23T08:49:09.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:08 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:49:09.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:08 smithi082 ceph-mon[97694]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-23T08:49:09.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:08 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-23T08:49:09.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:08 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-23T08:49:09.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:08 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:49:09.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:08 smithi161 ceph-mon[99580]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-23T08:49:09.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:08 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-23T08:49:09.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:08 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-23T08:49:09.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:08 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:49:10.058 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:09 smithi135 ceph-mon[99205]: from='client.24142 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:49:10.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:09 smithi082 ceph-mon[97694]: from='client.24142 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:49:10.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:09 smithi161 ceph-mon[99580]: from='client.24142 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:49:11.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:10 smithi135 ceph-mon[99205]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-23T08:49:11.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:10 smithi082 ceph-mon[97694]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-23T08:49:11.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:10 smithi161 ceph-mon[99580]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-23T08:49:12.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:11 smithi135 ceph-mon[99205]: from='client.? 172.21.15.135:0/2498767783' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ca62333e-15db-4556-a9ed-8820f9268766"}]: dispatch 2023-09-23T08:49:12.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:11 smithi135 ceph-mon[99205]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ca62333e-15db-4556-a9ed-8820f9268766"}]: dispatch 2023-09-23T08:49:12.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:11 smithi135 ceph-mon[99205]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ca62333e-15db-4556-a9ed-8820f9268766"}]': finished 2023-09-23T08:49:12.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:11 smithi135 ceph-mon[99205]: osdmap e10: 2 total, 1 up, 2 in 2023-09-23T08:49:12.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:11 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-09-23T08:49:12.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:11 smithi082 ceph-mon[97694]: from='client.? 172.21.15.135:0/2498767783' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ca62333e-15db-4556-a9ed-8820f9268766"}]: dispatch 2023-09-23T08:49:12.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:11 smithi082 ceph-mon[97694]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ca62333e-15db-4556-a9ed-8820f9268766"}]: dispatch 2023-09-23T08:49:12.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:11 smithi082 ceph-mon[97694]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ca62333e-15db-4556-a9ed-8820f9268766"}]': finished 2023-09-23T08:49:12.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:11 smithi082 ceph-mon[97694]: osdmap e10: 2 total, 1 up, 2 in 2023-09-23T08:49:12.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:11 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-09-23T08:49:12.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:11 smithi161 ceph-mon[99580]: from='client.? 172.21.15.135:0/2498767783' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ca62333e-15db-4556-a9ed-8820f9268766"}]: dispatch 2023-09-23T08:49:12.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:11 smithi161 ceph-mon[99580]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ca62333e-15db-4556-a9ed-8820f9268766"}]: dispatch 2023-09-23T08:49:12.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:11 smithi161 ceph-mon[99580]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ca62333e-15db-4556-a9ed-8820f9268766"}]': finished 2023-09-23T08:49:12.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:11 smithi161 ceph-mon[99580]: osdmap e10: 2 total, 1 up, 2 in 2023-09-23T08:49:12.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:11 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-09-23T08:49:13.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:12 smithi082 ceph-mon[97694]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-23T08:49:13.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:12 smithi082 ceph-mon[97694]: from='client.? 172.21.15.135:0/3406428401' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-23T08:49:13.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:12 smithi161 ceph-mon[99580]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-23T08:49:13.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:12 smithi161 ceph-mon[99580]: from='client.? 172.21.15.135:0/3406428401' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-23T08:49:13.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:12 smithi135 ceph-mon[99205]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-23T08:49:13.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:12 smithi135 ceph-mon[99205]: from='client.? 172.21.15.135:0/3406428401' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-23T08:49:15.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:15 smithi135 ceph-mon[99205]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-23T08:49:15.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:15 smithi082 ceph-mon[97694]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-23T08:49:15.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:15 smithi161 ceph-mon[99580]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-23T08:49:17.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:16 smithi135 ceph-mon[99205]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-23T08:49:17.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:16 smithi082 ceph-mon[97694]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-23T08:49:17.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:16 smithi161 ceph-mon[99580]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-23T08:49:19.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:19 smithi135 ceph-mon[99205]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-23T08:49:19.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:19 smithi082 ceph-mon[97694]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-23T08:49:19.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:19 smithi161 ceph-mon[99580]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-23T08:49:20.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:20 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-09-23T08:49:20.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:20 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:49:20.385 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:20 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-09-23T08:49:20.385 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:20 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:49:20.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:20 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-09-23T08:49:20.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:20 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:49:21.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:21 smithi135 ceph-mon[99205]: Deploying daemon osd.1 on smithi135 2023-09-23T08:49:21.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:21 smithi135 ceph-mon[99205]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-23T08:49:21.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:21 smithi082 ceph-mon[97694]: Deploying daemon osd.1 on smithi135 2023-09-23T08:49:21.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:21 smithi082 ceph-mon[97694]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-23T08:49:21.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:21 smithi161 ceph-mon[99580]: Deploying daemon osd.1 on smithi135 2023-09-23T08:49:21.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:21 smithi161 ceph-mon[99580]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-23T08:49:23.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:23 smithi135 ceph-mon[99205]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-23T08:49:23.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:23 smithi082 ceph-mon[97694]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-23T08:49:23.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:23 smithi161 ceph-mon[99580]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-23T08:49:25.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:25 smithi135 ceph-mon[99205]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-23T08:49:25.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:25 smithi082 ceph-mon[97694]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-23T08:49:25.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:25 smithi161 ceph-mon[99580]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-23T08:49:27.009 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:26 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:49:27.010 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:26 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:49:27.010 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:26 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:49:27.010 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:26 smithi135 ceph-mon[99205]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-23T08:49:27.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:26 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:49:27.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:26 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:49:27.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:26 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:49:27.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:26 smithi082 ceph-mon[97694]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-23T08:49:27.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:26 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:49:27.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:26 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:49:27.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:26 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:49:27.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:26 smithi161 ceph-mon[99580]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-23T08:49:29.161 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:49:29.158+0000 7fa6d17fa700 1 -- 172.21.15.135:0/4053641549 <== mgr.14152 v2:172.21.15.82:6800/3698954311 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fa6d402ce20 con 0x7fa6bc09ff40 2023-09-23T08:49:29.161 INFO:teuthology.orchestra.run.smithi135.stdout:Created osd(s) 1 on host 'smithi135' 2023-09-23T08:49:29.163 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:49:29.159+0000 7fa6da5fc700 1 -- 172.21.15.135:0/4053641549 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fa6bc09ff40 msgr2=0x7fa6bc0a2400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:49:29.163 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:49:29.159+0000 7fa6da5fc700 1 --2- 172.21.15.135:0/4053641549 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fa6bc09ff40 0x7fa6bc0a2400 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa6c800c010 tx=0x7fa6c8005fb0 comp rx=0 tx=0).stop 2023-09-23T08:49:29.163 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:49:29.160+0000 7fa6da5fc700 1 -- 172.21.15.135:0/4053641549 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa6d41009b0 msgr2=0x7fa6d40746c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:49:29.163 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:49:29.160+0000 7fa6da5fc700 1 --2- 172.21.15.135:0/4053641549 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa6d41009b0 0x7fa6d40746c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa6c400d980 tx=0x7fa6c400dc90 comp rx=0 tx=0).stop 2023-09-23T08:49:29.164 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:49:29.160+0000 7fa6da5fc700 1 -- 172.21.15.135:0/4053641549 shutdown_connections 2023-09-23T08:49:29.164 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:49:29.160+0000 7fa6da5fc700 1 --2- 172.21.15.135:0/4053641549 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fa6bc09ff40 0x7fa6bc0a2400 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:49:29.164 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:49:29.160+0000 7fa6da5fc700 1 --2- 172.21.15.135:0/4053641549 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa6d4102550 0x7fa6d4073250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:49:29.164 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:49:29.160+0000 7fa6da5fc700 1 --2- 172.21.15.135:0/4053641549 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa6d41009b0 0x7fa6d40746c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:49:29.164 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:49:29.160+0000 7fa6da5fc700 1 --2- 172.21.15.135:0/4053641549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6d4101bb0 0x7fa6d4072d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:49:29.164 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:49:29.160+0000 7fa6da5fc700 1 -- 172.21.15.135:0/4053641549 >> 172.21.15.135:0/4053641549 conn(0x7fa6d40fbf10 msgr2=0x7fa6d4105220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:49:29.164 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:49:29.160+0000 7fa6da5fc700 1 -- 172.21.15.135:0/4053641549 shutdown_connections 2023-09-23T08:49:29.164 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:49:29.160+0000 7fa6da5fc700 1 -- 172.21.15.135:0/4053641549 wait complete. 2023-09-23T08:49:29.639 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:29 smithi135 ceph-mon[99205]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-23T08:49:29.639 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:29 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:49:29.639 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:29 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:49:29.639 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:29 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:49:29.640 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:29 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:49:29.640 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:29 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:49:29.640 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:29 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:49:29.640 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:29 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:49:29.640 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:29 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:49:29.720 DEBUG:teuthology.orchestra.run.smithi135:osd.1> sudo journalctl -f -n 0 -u ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@osd.1.service 2023-09-23T08:49:29.725 INFO:tasks.cephadm:Deploying osd.2 on smithi161 with /dev/vg_nvme/lv_4... 2023-09-23T08:49:29.725 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-09-23T08:49:29.795 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:29 smithi161 ceph-mon[99580]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-23T08:49:29.795 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:29 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:49:29.795 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:29 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:49:29.795 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:29 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:49:29.795 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:29 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:49:29.795 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:29 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:49:29.795 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:29 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:49:29.795 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:29 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:49:29.796 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:29 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:49:29.801 INFO:journalctl@ceph.osd.1.smithi135.stdout:-- Logs begin at Sat 2023-09-23 08:29:30 UTC. -- 2023-09-23T08:49:29.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:29 smithi082 ceph-mon[97694]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-23T08:49:29.973 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:29 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:49:29.973 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:29 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:49:29.973 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:29 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:49:29.973 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:29 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:49:29.973 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:29 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:49:29.973 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:29 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:49:29.973 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:29 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:49:29.974 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:29 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:49:30.455 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.c/config 2023-09-23T08:49:30.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:30 smithi135 ceph-mon[99205]: from='osd.1 [v2:172.21.15.135:6800/3224546922,v1:172.21.15.135:6801/3224546922]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-09-23T08:49:30.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:30 smithi135 ceph-mon[99205]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-09-23T08:49:30.722 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:30 smithi161 ceph-mon[99580]: from='osd.1 [v2:172.21.15.135:6800/3224546922,v1:172.21.15.135:6801/3224546922]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-09-23T08:49:30.722 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:30 smithi161 ceph-mon[99580]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-09-23T08:49:30.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:30 smithi082 ceph-mon[97694]: from='osd.1 [v2:172.21.15.135:6800/3224546922,v1:172.21.15.135:6801/3224546922]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-09-23T08:49:30.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:30 smithi082 ceph-mon[97694]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-09-23T08:49:31.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:31 smithi135 ceph-mon[99205]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-23T08:49:31.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:31 smithi135 ceph-mon[99205]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-09-23T08:49:31.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:31 smithi135 ceph-mon[99205]: osdmap e11: 2 total, 1 up, 2 in 2023-09-23T08:49:31.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:31 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-09-23T08:49:31.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:31 smithi135 ceph-mon[99205]: from='osd.1 [v2:172.21.15.135:6800/3224546922,v1:172.21.15.135:6801/3224546922]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2023-09-23T08:49:31.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:31 smithi135 ceph-mon[99205]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2023-09-23T08:49:31.563 INFO:journalctl@ceph.osd.1.smithi135.stdout:Sep 23 08:49:31 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-1[104312]: 2023-09-23T08:49:31.423+0000 7f103377f700 -1 osd.1 0 waiting for initial osdmap 2023-09-23T08:49:31.564 INFO:journalctl@ceph.osd.1.smithi135.stdout:Sep 23 08:49:31 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-1[104312]: 2023-09-23T08:49:31.428+0000 7f102a56a700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-23T08:49:31.595 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:31 smithi161 ceph-mon[99580]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-23T08:49:31.595 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:31 smithi161 ceph-mon[99580]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-09-23T08:49:31.595 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:31 smithi161 ceph-mon[99580]: osdmap e11: 2 total, 1 up, 2 in 2023-09-23T08:49:31.595 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:31 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-09-23T08:49:31.595 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:31 smithi161 ceph-mon[99580]: from='osd.1 [v2:172.21.15.135:6800/3224546922,v1:172.21.15.135:6801/3224546922]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2023-09-23T08:49:31.595 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:31 smithi161 ceph-mon[99580]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2023-09-23T08:49:31.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:31 smithi082 ceph-mon[97694]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-23T08:49:31.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:31 smithi082 ceph-mon[97694]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-09-23T08:49:31.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:31 smithi082 ceph-mon[97694]: osdmap e11: 2 total, 1 up, 2 in 2023-09-23T08:49:31.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:31 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-09-23T08:49:31.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:31 smithi082 ceph-mon[97694]: from='osd.1 [v2:172.21.15.135:6800/3224546922,v1:172.21.15.135:6801/3224546922]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2023-09-23T08:49:31.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:31 smithi082 ceph-mon[97694]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2023-09-23T08:49:32.292 INFO:teuthology.orchestra.run.smithi161.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-09-23T08:49:32.292 INFO:teuthology.orchestra.run.smithi161.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-09-23T08:49:32.292 INFO:teuthology.orchestra.run.smithi161.stderr: stderr: 10+0 records in 2023-09-23T08:49:32.292 INFO:teuthology.orchestra.run.smithi161.stderr:10+0 records out 2023-09-23T08:49:32.292 INFO:teuthology.orchestra.run.smithi161.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0294851 s, 356 MB/s 2023-09-23T08:49:32.292 INFO:teuthology.orchestra.run.smithi161.stderr:--> Zapping successful for: 2023-09-23T08:49:32.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:32 smithi161 ceph-mon[99580]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2023-09-23T08:49:32.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:32 smithi161 ceph-mon[99580]: osdmap e12: 2 total, 1 up, 2 in 2023-09-23T08:49:32.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:32 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-09-23T08:49:32.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:32 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-09-23T08:49:32.771 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:32 smithi135 ceph-mon[99205]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2023-09-23T08:49:32.771 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:32 smithi135 ceph-mon[99205]: osdmap e12: 2 total, 1 up, 2 in 2023-09-23T08:49:32.771 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:32 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-09-23T08:49:32.772 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:32 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-09-23T08:49:32.834 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- ceph orch daemon add osd smithi161:vg_nvme/lv_4 2023-09-23T08:49:32.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:32 smithi082 ceph-mon[97694]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2023-09-23T08:49:32.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:32 smithi082 ceph-mon[97694]: osdmap e12: 2 total, 1 up, 2 in 2023-09-23T08:49:32.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:32 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-09-23T08:49:32.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:32 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-09-23T08:49:33.554 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.c/config 2023-09-23T08:49:33.787 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:33 smithi161 ceph-mon[99580]: purged_snaps scrub starts 2023-09-23T08:49:33.787 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:33 smithi161 ceph-mon[99580]: purged_snaps scrub ok 2023-09-23T08:49:33.788 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:33 smithi161 ceph-mon[99580]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-23T08:49:33.788 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:33 smithi161 ceph-mon[99580]: osd.1 [v2:172.21.15.135:6800/3224546922,v1:172.21.15.135:6801/3224546922] boot 2023-09-23T08:49:33.788 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:33 smithi161 ceph-mon[99580]: osdmap e13: 2 total, 2 up, 2 in 2023-09-23T08:49:33.788 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:33 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-09-23T08:49:33.788 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:33 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:49:33.788 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:33 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:49:33.788 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:33 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:49:33.788 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:33 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:49:33.788 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:33 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:49:33.788 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:33 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:49:33.788 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:33 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:49:33.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:33 smithi135 ceph-mon[99205]: purged_snaps scrub starts 2023-09-23T08:49:33.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:33 smithi135 ceph-mon[99205]: purged_snaps scrub ok 2023-09-23T08:49:33.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:33 smithi135 ceph-mon[99205]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-23T08:49:33.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:33 smithi135 ceph-mon[99205]: osd.1 [v2:172.21.15.135:6800/3224546922,v1:172.21.15.135:6801/3224546922] boot 2023-09-23T08:49:33.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:33 smithi135 ceph-mon[99205]: osdmap e13: 2 total, 2 up, 2 in 2023-09-23T08:49:33.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:33 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-09-23T08:49:33.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:33 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:49:33.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:33 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:49:33.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:33 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:49:33.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:33 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:49:33.814 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:33 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:49:33.814 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:33 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:49:33.814 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:33 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:49:33.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:33 smithi082 ceph-mon[97694]: purged_snaps scrub starts 2023-09-23T08:49:33.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:33 smithi082 ceph-mon[97694]: purged_snaps scrub ok 2023-09-23T08:49:33.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:33 smithi082 ceph-mon[97694]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-23T08:49:33.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:33 smithi082 ceph-mon[97694]: osd.1 [v2:172.21.15.135:6800/3224546922,v1:172.21.15.135:6801/3224546922] boot 2023-09-23T08:49:33.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:33 smithi082 ceph-mon[97694]: osdmap e13: 2 total, 2 up, 2 in 2023-09-23T08:49:33.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:33 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-09-23T08:49:33.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:33 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:49:33.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:33 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:49:33.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:33 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:49:33.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:33 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:49:33.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:33 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:49:33.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:33 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:49:33.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:33 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:49:34.728 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:34 smithi161 ceph-mon[99580]: Detected new or changed devices on smithi135 2023-09-23T08:49:34.728 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:34 smithi161 ceph-mon[99580]: Adjusting osd_memory_target on smithi135 to 17267M 2023-09-23T08:49:34.728 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:34 smithi161 ceph-mon[99580]: osdmap e14: 2 total, 2 up, 2 in 2023-09-23T08:49:34.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:34 smithi135 ceph-mon[99205]: Detected new or changed devices on smithi135 2023-09-23T08:49:34.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:34 smithi135 ceph-mon[99205]: Adjusting osd_memory_target on smithi135 to 17267M 2023-09-23T08:49:34.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:34 smithi135 ceph-mon[99205]: osdmap e14: 2 total, 2 up, 2 in 2023-09-23T08:49:34.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:34 smithi082 ceph-mon[97694]: Detected new or changed devices on smithi135 2023-09-23T08:49:34.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:34 smithi082 ceph-mon[97694]: Adjusting osd_memory_target on smithi135 to 17267M 2023-09-23T08:49:34.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:34 smithi082 ceph-mon[97694]: osdmap e14: 2 total, 2 up, 2 in 2023-09-23T08:49:34.945 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:49:34.941+0000 7f2854d91700 1 -- 172.21.15.161:0/3967082562 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2850073380 msgr2=0x7f2850073800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:49:34.945 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:49:34.941+0000 7f2854d91700 1 --2- 172.21.15.161:0/3967082562 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2850073380 0x7f2850073800 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2844009990 tx=0x7f2844009ca0 comp rx=0 tx=0).stop 2023-09-23T08:49:34.945 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:49:34.941+0000 7f2854d91700 1 -- 172.21.15.161:0/3967082562 shutdown_connections 2023-09-23T08:49:34.945 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:49:34.941+0000 7f2854d91700 1 --2- 172.21.15.161:0/3967082562 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f285010cf90 0x7f285010f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:49:34.945 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:49:34.941+0000 7f2854d91700 1 --2- 172.21.15.161:0/3967082562 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2850074950 0x7f2850072db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:49:34.945 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:49:34.941+0000 7f2854d91700 1 --2- 172.21.15.161:0/3967082562 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2850073380 0x7f2850073800 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:49:34.945 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:49:34.941+0000 7f2854d91700 1 -- 172.21.15.161:0/3967082562 >> 172.21.15.161:0/3967082562 conn(0x7f28500fbf10 msgr2=0x7f28500fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:49:34.945 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:49:34.941+0000 7f2854d91700 1 -- 172.21.15.161:0/3967082562 shutdown_connections 2023-09-23T08:49:34.945 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:49:34.941+0000 7f2854d91700 1 -- 172.21.15.161:0/3967082562 wait complete. 2023-09-23T08:49:34.947 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:49:34.942+0000 7f2854d91700 1 Processor -- start 2023-09-23T08:49:34.947 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:49:34.943+0000 7f2854d91700 1 -- start start 2023-09-23T08:49:34.947 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:49:34.943+0000 7f2854d91700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2850073380 0x7f285019cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:49:34.947 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:49:34.943+0000 7f2854d91700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2850074950 0x7f285019d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:49:34.948 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:49:34.943+0000 7f2854d91700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f285010cf90 0x7f28501a4170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:49:34.948 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:49:34.943+0000 7f2854d91700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28501a4740 con 0x7f2850074950 2023-09-23T08:49:34.948 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:49:34.943+0000 7f2854d91700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28501a4880 con 0x7f285010cf90 2023-09-23T08:49:34.948 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:49:34.943+0000 7f2854d91700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28501a4a10 con 0x7f2850073380 2023-09-23T08:49:34.948 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:49:34.943+0000 7f284e59c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2850073380 0x7f285019cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:49:34.948 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:49:34.943+0000 7f284e59c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2850073380 0x7f285019cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:41482/0 (socket says 172.21.15.161:41482) 2023-09-23T08:49:34.948 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:49:34.943+0000 7f284e59c700 1 -- 172.21.15.161:0/3757073484 learned_addr learned my addr 172.21.15.161:0/3757073484 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-09-23T08:49:34.948 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:49:34.943+0000 7f284dd9b700 1 --2- 172.21.15.161:0/3757073484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2850074950 0x7f285019d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:49:34.948 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:49:34.943+0000 7f284ed9d700 1 --2- 172.21.15.161:0/3757073484 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f285010cf90 0x7f28501a4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:49:34.948 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:49:34.944+0000 7f284e59c700 1 -- 172.21.15.161:0/3757073484 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f285010cf90 msgr2=0x7f28501a4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:49:34.948 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:49:34.944+0000 7f284e59c700 1 --2- 172.21.15.161:0/3757073484 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f285010cf90 0x7f28501a4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:49:34.949 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:49:34.944+0000 7f284e59c700 1 -- 172.21.15.161:0/3757073484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2850074950 msgr2=0x7f285019d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:49:34.949 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:49:34.944+0000 7f284e59c700 1 --2- 172.21.15.161:0/3757073484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2850074950 0x7f285019d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:49:34.949 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:49:34.944+0000 7f284e59c700 1 -- 172.21.15.161:0/3757073484 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28440095f0 con 0x7f2850073380 2023-09-23T08:49:34.949 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:49:34.944+0000 7f284e59c700 1 --2- 172.21.15.161:0/3757073484 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2850073380 0x7f285019cbb0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f284000ca10 tx=0x7f284000cd20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:49:34.949 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:49:34.944+0000 7f283f7fe700 1 -- 172.21.15.161:0/3757073484 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2840007a60 con 0x7f2850073380 2023-09-23T08:49:34.949 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:49:34.944+0000 7f283f7fe700 1 -- 172.21.15.161:0/3757073484 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2840007bc0 con 0x7f2850073380 2023-09-23T08:49:34.949 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:49:34.944+0000 7f2854d91700 1 -- 172.21.15.161:0/3757073484 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28501a4cf0 con 0x7f2850073380 2023-09-23T08:49:34.949 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:49:34.944+0000 7f283f7fe700 1 -- 172.21.15.161:0/3757073484 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2840018400 con 0x7f2850073380 2023-09-23T08:49:34.949 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:49:34.944+0000 7f2854d91700 1 -- 172.21.15.161:0/3757073484 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28501a51a0 con 0x7f2850073380 2023-09-23T08:49:34.950 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:49:34.945+0000 7f2854d91700 1 -- 172.21.15.161:0/3757073484 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2850102ae0 con 0x7f2850073380 2023-09-23T08:49:34.950 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:49:34.948+0000 7f283f7fe700 1 -- 172.21.15.161:0/3757073484 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 15) v1 ==== 134615+0+0 (secure 0 0 0) 0x7f284000f450 con 0x7f2850073380 2023-09-23T08:49:34.951 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:49:34.949+0000 7f283f7fe700 1 --2- 172.21.15.161:0/3757073484 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f283809fec0 0x7f28380a2380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:49:34.952 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:49:34.949+0000 7f283f7fe700 1 -- 172.21.15.161:0/3757073484 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2309+0+0 (secure 0 0 0) 0x7f28400c9c60 con 0x7f2850073380 2023-09-23T08:49:34.952 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:49:34.949+0000 7f284dd9b700 1 --2- 172.21.15.161:0/3757073484 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f283809fec0 0x7f28380a2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:49:34.953 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:49:34.950+0000 7f284dd9b700 1 --2- 172.21.15.161:0/3757073484 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f283809fec0 0x7f28380a2380 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2844000c00 tx=0x7f284400b560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:49:34.954 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:49:34.952+0000 7f283f7fe700 1 -- 172.21.15.161:0/3757073484 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f2840095230 con 0x7f2850073380 2023-09-23T08:49:35.161 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:49:35.158+0000 7f2854d91700 1 -- 172.21.15.161:0/3757073484 --> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi161:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f285002cf90 con 0x7f283809fec0 2023-09-23T08:49:35.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:35 smithi135 ceph-mon[99205]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-23T08:49:35.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:35 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-23T08:49:35.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:35 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-23T08:49:35.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:35 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:49:35.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:35 smithi082 ceph-mon[97694]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-23T08:49:35.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:35 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-23T08:49:35.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:35 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-23T08:49:35.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:35 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:49:35.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:35 smithi161 ceph-mon[99580]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-23T08:49:35.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:35 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-23T08:49:35.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:35 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-23T08:49:35.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:35 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:49:36.497 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:36 smithi161 ceph-mon[99580]: from='client.24166 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi161:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:49:36.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:36 smithi135 ceph-mon[99205]: from='client.24166 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi161:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:49:36.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:36 smithi082 ceph-mon[97694]: from='client.24166 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi161:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:49:37.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:37 smithi135 ceph-mon[99205]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-23T08:49:37.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:37 smithi082 ceph-mon[97694]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-23T08:49:37.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:37 smithi161 ceph-mon[99580]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-23T08:49:38.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:38 smithi135 ceph-mon[99205]: from='client.? 172.21.15.161:0/2265799771' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ac23eb38-216a-44f0-b316-a509b23745f6"}]: dispatch 2023-09-23T08:49:38.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:38 smithi135 ceph-mon[99205]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ac23eb38-216a-44f0-b316-a509b23745f6"}]: dispatch 2023-09-23T08:49:38.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:38 smithi135 ceph-mon[99205]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ac23eb38-216a-44f0-b316-a509b23745f6"}]': finished 2023-09-23T08:49:38.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:38 smithi135 ceph-mon[99205]: osdmap e15: 3 total, 2 up, 3 in 2023-09-23T08:49:38.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:38 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-09-23T08:49:38.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:38 smithi082 ceph-mon[97694]: from='client.? 172.21.15.161:0/2265799771' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ac23eb38-216a-44f0-b316-a509b23745f6"}]: dispatch 2023-09-23T08:49:38.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:38 smithi082 ceph-mon[97694]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ac23eb38-216a-44f0-b316-a509b23745f6"}]: dispatch 2023-09-23T08:49:38.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:38 smithi082 ceph-mon[97694]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ac23eb38-216a-44f0-b316-a509b23745f6"}]': finished 2023-09-23T08:49:38.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:38 smithi082 ceph-mon[97694]: osdmap e15: 3 total, 2 up, 3 in 2023-09-23T08:49:38.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:38 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-09-23T08:49:38.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:38 smithi161 ceph-mon[99580]: from='client.? 172.21.15.161:0/2265799771' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ac23eb38-216a-44f0-b316-a509b23745f6"}]: dispatch 2023-09-23T08:49:38.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:38 smithi161 ceph-mon[99580]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ac23eb38-216a-44f0-b316-a509b23745f6"}]: dispatch 2023-09-23T08:49:38.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:38 smithi161 ceph-mon[99580]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ac23eb38-216a-44f0-b316-a509b23745f6"}]': finished 2023-09-23T08:49:38.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:38 smithi161 ceph-mon[99580]: osdmap e15: 3 total, 2 up, 3 in 2023-09-23T08:49:38.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:38 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-09-23T08:49:39.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:39 smithi135 ceph-mon[99205]: pgmap v72: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-23T08:49:39.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:39 smithi135 ceph-mon[99205]: from='client.? 172.21.15.161:0/3737195253' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-23T08:49:39.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:39 smithi082 ceph-mon[97694]: pgmap v72: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-23T08:49:39.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:39 smithi082 ceph-mon[97694]: from='client.? 172.21.15.161:0/3737195253' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-23T08:49:39.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:39 smithi161 ceph-mon[99580]: pgmap v72: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-23T08:49:39.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:39 smithi161 ceph-mon[99580]: from='client.? 172.21.15.161:0/3737195253' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-23T08:49:41.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:41 smithi135 ceph-mon[99205]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-23T08:49:41.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:41 smithi082 ceph-mon[97694]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-23T08:49:41.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:41 smithi161 ceph-mon[99580]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-23T08:49:42.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:42 smithi161 ceph-mon[99580]: pgmap v75: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-23T08:49:42.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:42 smithi135 ceph-mon[99205]: pgmap v75: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-23T08:49:42.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:42 smithi082 ceph-mon[97694]: pgmap v75: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-23T08:49:45.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:45 smithi135 ceph-mon[99205]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-23T08:49:45.346 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:45 smithi161 ceph-mon[99580]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-23T08:49:45.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:45 smithi082 ceph-mon[97694]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-23T08:49:46.830 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:46 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-09-23T08:49:46.830 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:46 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:49:46.830 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:46 smithi161 ceph-mon[99580]: Deploying daemon osd.2 on smithi161 2023-09-23T08:49:46.830 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:46 smithi161 ceph-mon[99580]: pgmap v77: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-23T08:49:47.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:46 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-09-23T08:49:47.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:46 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:49:47.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:46 smithi135 ceph-mon[99205]: Deploying daemon osd.2 on smithi161 2023-09-23T08:49:47.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:46 smithi135 ceph-mon[99205]: pgmap v77: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-23T08:49:47.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:46 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-09-23T08:49:47.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:46 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:49:47.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:46 smithi082 ceph-mon[97694]: Deploying daemon osd.2 on smithi161 2023-09-23T08:49:47.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:46 smithi082 ceph-mon[97694]: pgmap v77: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-23T08:49:49.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:49 smithi135 ceph-mon[99205]: pgmap v78: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-23T08:49:49.322 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:49 smithi161 ceph-mon[99580]: pgmap v78: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-23T08:49:49.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:49 smithi082 ceph-mon[97694]: pgmap v78: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-23T08:49:51.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:51 smithi135 ceph-mon[99205]: pgmap v79: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-23T08:49:51.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:51 smithi082 ceph-mon[97694]: pgmap v79: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-23T08:49:51.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:51 smithi161 ceph-mon[99580]: pgmap v79: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-23T08:49:53.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:52 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:49:53.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:52 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:49:53.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:52 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:49:53.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:52 smithi135 ceph-mon[99205]: pgmap v80: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-23T08:49:53.092 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:52 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:49:53.092 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:52 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:49:53.092 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:52 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:49:53.092 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:52 smithi161 ceph-mon[99580]: pgmap v80: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-23T08:49:53.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:52 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:49:53.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:52 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:49:53.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:52 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:49:53.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:52 smithi082 ceph-mon[97694]: pgmap v80: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-23T08:49:55.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:54 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:49:55.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:54 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:49:55.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:54 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:49:55.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:54 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:49:55.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:54 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:49:55.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:54 smithi161 ceph-mon[99580]: pgmap v81: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-23T08:49:55.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:54 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:49:55.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:54 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:49:55.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:54 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:49:55.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:54 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:49:55.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:54 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:49:55.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:54 smithi135 ceph-mon[99205]: pgmap v81: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-23T08:49:55.374 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:54 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:49:55.374 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:54 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:49:55.374 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:54 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:49:55.374 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:54 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:49:55.374 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:54 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:49:55.374 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:54 smithi082 ceph-mon[97694]: pgmap v81: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-23T08:49:55.389 INFO:teuthology.orchestra.run.smithi161.stdout:Created osd(s) 2 on host 'smithi161' 2023-09-23T08:49:55.389 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:49:55.385+0000 7f283f7fe700 1 -- 172.21.15.161:0/3757073484 <== mgr.14152 v2:172.21.15.82:6800/3698954311 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f285002cf90 con 0x7f283809fec0 2023-09-23T08:49:55.391 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:49:55.388+0000 7f2854d91700 1 -- 172.21.15.161:0/3757073484 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f283809fec0 msgr2=0x7f28380a2380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:49:55.391 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:49:55.388+0000 7f2854d91700 1 --2- 172.21.15.161:0/3757073484 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f283809fec0 0x7f28380a2380 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2844000c00 tx=0x7f284400b560 comp rx=0 tx=0).stop 2023-09-23T08:49:55.391 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:49:55.388+0000 7f2854d91700 1 -- 172.21.15.161:0/3757073484 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2850073380 msgr2=0x7f285019cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:49:55.391 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:49:55.388+0000 7f2854d91700 1 --2- 172.21.15.161:0/3757073484 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2850073380 0x7f285019cbb0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f284000ca10 tx=0x7f284000cd20 comp rx=0 tx=0).stop 2023-09-23T08:49:55.392 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:49:55.388+0000 7f2854d91700 1 -- 172.21.15.161:0/3757073484 shutdown_connections 2023-09-23T08:49:55.392 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:49:55.388+0000 7f2854d91700 1 --2- 172.21.15.161:0/3757073484 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f283809fec0 0x7f28380a2380 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:49:55.392 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:49:55.388+0000 7f2854d91700 1 --2- 172.21.15.161:0/3757073484 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f285010cf90 0x7f28501a4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:49:55.392 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:49:55.388+0000 7f2854d91700 1 --2- 172.21.15.161:0/3757073484 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2850073380 0x7f285019cbb0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:49:55.392 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:49:55.388+0000 7f2854d91700 1 --2- 172.21.15.161:0/3757073484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2850074950 0x7f285019d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:49:55.392 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:49:55.388+0000 7f2854d91700 1 -- 172.21.15.161:0/3757073484 >> 172.21.15.161:0/3757073484 conn(0x7f28500fbf10 msgr2=0x7f28500fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:49:55.392 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:49:55.388+0000 7f2854d91700 1 -- 172.21.15.161:0/3757073484 shutdown_connections 2023-09-23T08:49:55.392 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:49:55.388+0000 7f2854d91700 1 -- 172.21.15.161:0/3757073484 wait complete. 2023-09-23T08:49:55.874 DEBUG:teuthology.orchestra.run.smithi161:osd.2> sudo journalctl -f -n 0 -u ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@osd.2.service 2023-09-23T08:49:55.878 INFO:tasks.cephadm:Deploying osd.3 on smithi082 with /dev/vg_nvme/lv_3... 2023-09-23T08:49:55.878 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-09-23T08:49:55.957 INFO:journalctl@ceph.osd.2.smithi161.stdout:-- Logs begin at Sat 2023-09-23 08:29:48 UTC. -- 2023-09-23T08:49:56.607 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.a/config 2023-09-23T08:49:56.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:56 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:49:56.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:56 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:49:56.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:56 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:49:56.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:56 smithi082 ceph-mon[97694]: from='osd.2 [v2:172.21.15.161:6800/2358373459,v1:172.21.15.161:6801/2358373459]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-09-23T08:49:56.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:56 smithi082 ceph-mon[97694]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-09-23T08:49:56.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:56 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:49:56.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:56 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:49:56.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:56 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:49:56.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:56 smithi161 ceph-mon[99580]: from='osd.2 [v2:172.21.15.161:6800/2358373459,v1:172.21.15.161:6801/2358373459]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-09-23T08:49:56.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:56 smithi161 ceph-mon[99580]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-09-23T08:49:56.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:56 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:49:56.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:56 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:49:56.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:56 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:49:56.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:56 smithi135 ceph-mon[99205]: from='osd.2 [v2:172.21.15.161:6800/2358373459,v1:172.21.15.161:6801/2358373459]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-09-23T08:49:56.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:56 smithi135 ceph-mon[99205]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-09-23T08:49:57.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:57 smithi082 ceph-mon[97694]: pgmap v82: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-23T08:49:57.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:57 smithi082 ceph-mon[97694]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-09-23T08:49:57.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:57 smithi082 ceph-mon[97694]: osdmap e16: 3 total, 2 up, 3 in 2023-09-23T08:49:57.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:57 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-09-23T08:49:57.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:57 smithi082 ceph-mon[97694]: from='osd.2 [v2:172.21.15.161:6800/2358373459,v1:172.21.15.161:6801/2358373459]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2023-09-23T08:49:57.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:57 smithi082 ceph-mon[97694]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2023-09-23T08:49:57.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:57 smithi161 ceph-mon[99580]: pgmap v82: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-23T08:49:57.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:57 smithi161 ceph-mon[99580]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-09-23T08:49:57.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:57 smithi161 ceph-mon[99580]: osdmap e16: 3 total, 2 up, 3 in 2023-09-23T08:49:57.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:57 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-09-23T08:49:57.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:57 smithi161 ceph-mon[99580]: from='osd.2 [v2:172.21.15.161:6800/2358373459,v1:172.21.15.161:6801/2358373459]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2023-09-23T08:49:57.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:57 smithi161 ceph-mon[99580]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2023-09-23T08:49:57.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:57 smithi135 ceph-mon[99205]: pgmap v82: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-23T08:49:57.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:57 smithi135 ceph-mon[99205]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-09-23T08:49:57.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:57 smithi135 ceph-mon[99205]: osdmap e16: 3 total, 2 up, 3 in 2023-09-23T08:49:57.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:57 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-09-23T08:49:57.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:57 smithi135 ceph-mon[99205]: from='osd.2 [v2:172.21.15.161:6800/2358373459,v1:172.21.15.161:6801/2358373459]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2023-09-23T08:49:57.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:57 smithi135 ceph-mon[99205]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2023-09-23T08:49:58.148 INFO:journalctl@ceph.osd.2.smithi161.stdout:Sep 23 08:49:57 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-2[105440]: 2023-09-23T08:49:57.728+0000 7f1a52735700 -1 osd.2 0 waiting for initial osdmap 2023-09-23T08:49:58.148 INFO:journalctl@ceph.osd.2.smithi161.stdout:Sep 23 08:49:57 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-2[105440]: 2023-09-23T08:49:57.735+0000 7f1a4ed2b700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-23T08:49:58.455 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-09-23T08:49:58.455 INFO:teuthology.orchestra.run.smithi082.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-09-23T08:49:58.455 INFO:teuthology.orchestra.run.smithi082.stderr: stderr: 10+0 records in 2023-09-23T08:49:58.456 INFO:teuthology.orchestra.run.smithi082.stderr:10+0 records out 2023-09-23T08:49:58.456 INFO:teuthology.orchestra.run.smithi082.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0296663 s, 353 MB/s 2023-09-23T08:49:58.456 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping successful for: 2023-09-23T08:49:58.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:58 smithi082 ceph-mon[97694]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]': finished 2023-09-23T08:49:58.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:58 smithi082 ceph-mon[97694]: osdmap e17: 3 total, 2 up, 3 in 2023-09-23T08:49:58.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:58 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-09-23T08:49:58.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:58 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-09-23T08:49:58.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:58 smithi082 ceph-mon[97694]: pgmap v85: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-23T08:49:58.876 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- ceph orch daemon add osd smithi082:vg_nvme/lv_3 2023-09-23T08:49:59.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:58 smithi135 ceph-mon[99205]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]': finished 2023-09-23T08:49:59.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:58 smithi135 ceph-mon[99205]: osdmap e17: 3 total, 2 up, 3 in 2023-09-23T08:49:59.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:58 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-09-23T08:49:59.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:58 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-09-23T08:49:59.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:58 smithi135 ceph-mon[99205]: pgmap v85: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-23T08:49:59.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:58 smithi161 ceph-mon[99580]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]': finished 2023-09-23T08:49:59.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:58 smithi161 ceph-mon[99580]: osdmap e17: 3 total, 2 up, 3 in 2023-09-23T08:49:59.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:58 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-09-23T08:49:59.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:58 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-09-23T08:49:59.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:58 smithi161 ceph-mon[99580]: pgmap v85: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-23T08:49:59.601 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.a/config 2023-09-23T08:49:59.995 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:59 smithi082 ceph-mon[97694]: purged_snaps scrub starts 2023-09-23T08:49:59.995 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:59 smithi082 ceph-mon[97694]: purged_snaps scrub ok 2023-09-23T08:49:59.995 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:59 smithi082 ceph-mon[97694]: osd.2 [v2:172.21.15.161:6800/2358373459,v1:172.21.15.161:6801/2358373459] boot 2023-09-23T08:49:59.995 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:59 smithi082 ceph-mon[97694]: osdmap e18: 3 total, 3 up, 3 in 2023-09-23T08:49:59.995 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:59 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-09-23T08:49:59.995 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:59 smithi082 ceph-mon[97694]: Detected new or changed devices on smithi161 2023-09-23T08:49:59.996 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:59 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:49:59.996 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:59 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:49:59.996 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:59 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:49:59.996 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:59 smithi082 ceph-mon[97694]: Adjusting osd_memory_target on smithi161 to 17267M 2023-09-23T08:49:59.996 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:59 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:49:59.996 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:59 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:49:59.996 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:59 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:49:59.996 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:49:59 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:50:00.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:59 smithi135 ceph-mon[99205]: purged_snaps scrub starts 2023-09-23T08:50:00.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:59 smithi135 ceph-mon[99205]: purged_snaps scrub ok 2023-09-23T08:50:00.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:59 smithi135 ceph-mon[99205]: osd.2 [v2:172.21.15.161:6800/2358373459,v1:172.21.15.161:6801/2358373459] boot 2023-09-23T08:50:00.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:59 smithi135 ceph-mon[99205]: osdmap e18: 3 total, 3 up, 3 in 2023-09-23T08:50:00.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:59 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-09-23T08:50:00.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:59 smithi135 ceph-mon[99205]: Detected new or changed devices on smithi161 2023-09-23T08:50:00.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:59 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:50:00.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:59 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:50:00.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:59 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:50:00.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:59 smithi135 ceph-mon[99205]: Adjusting osd_memory_target on smithi161 to 17267M 2023-09-23T08:50:00.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:59 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:50:00.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:59 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:50:00.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:59 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:50:00.064 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:49:59 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:50:00.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:59 smithi161 ceph-mon[99580]: purged_snaps scrub starts 2023-09-23T08:50:00.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:59 smithi161 ceph-mon[99580]: purged_snaps scrub ok 2023-09-23T08:50:00.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:59 smithi161 ceph-mon[99580]: osd.2 [v2:172.21.15.161:6800/2358373459,v1:172.21.15.161:6801/2358373459] boot 2023-09-23T08:50:00.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:59 smithi161 ceph-mon[99580]: osdmap e18: 3 total, 3 up, 3 in 2023-09-23T08:50:00.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:59 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-09-23T08:50:00.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:59 smithi161 ceph-mon[99580]: Detected new or changed devices on smithi161 2023-09-23T08:50:00.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:59 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:50:00.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:59 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:50:00.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:59 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:50:00.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:59 smithi161 ceph-mon[99580]: Adjusting osd_memory_target on smithi161 to 17267M 2023-09-23T08:50:00.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:59 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:50:00.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:59 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:50:00.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:59 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:50:00.150 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:49:59 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:50:01.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:50:01.037+0000 7f8b2ae21700 1 -- 172.21.15.82:0/4200831459 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b24073380 msgr2=0x7f8b24073800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:50:01.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:50:01.037+0000 7f8b2ae21700 1 --2- 172.21.15.82:0/4200831459 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b24073380 0x7f8b24073800 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8b10009990 tx=0x7f8b10009ca0 comp rx=0 tx=0).stop 2023-09-23T08:50:01.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:50:01.037+0000 7f8b2ae21700 1 -- 172.21.15.82:0/4200831459 shutdown_connections 2023-09-23T08:50:01.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:50:01.037+0000 7f8b2ae21700 1 --2- 172.21.15.82:0/4200831459 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b24108880 0x7f8b2410ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:50:01.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:50:01.037+0000 7f8b2ae21700 1 --2- 172.21.15.82:0/4200831459 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b24074950 0x7f8b24072db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:50:01.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:50:01.037+0000 7f8b2ae21700 1 --2- 172.21.15.82:0/4200831459 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b24073380 0x7f8b24073800 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:50:01.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:50:01.037+0000 7f8b2ae21700 1 -- 172.21.15.82:0/4200831459 >> 172.21.15.82:0/4200831459 conn(0x7f8b240fbf10 msgr2=0x7f8b240fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:50:01.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:50:01.037+0000 7f8b2ae21700 1 -- 172.21.15.82:0/4200831459 shutdown_connections 2023-09-23T08:50:01.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:50:01.037+0000 7f8b2ae21700 1 -- 172.21.15.82:0/4200831459 wait complete. 2023-09-23T08:50:01.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:50:01.039+0000 7f8b2ae21700 1 Processor -- start 2023-09-23T08:50:01.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:50:01.039+0000 7f8b2ae21700 1 -- start start 2023-09-23T08:50:01.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:50:01.039+0000 7f8b2ae21700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b24073380 0x7f8b24198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:50:01.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:50:01.039+0000 7f8b2ae21700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b24074950 0x7f8b24198d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:50:01.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:50:01.039+0000 7f8b2ae21700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b24108880 0x7f8b2419fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:50:01.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:50:01.039+0000 7f8b2ae21700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b241a03b0 con 0x7f8b24108880 2023-09-23T08:50:01.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:50:01.039+0000 7f8b2ae21700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b241a04f0 con 0x7f8b24073380 2023-09-23T08:50:01.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:50:01.039+0000 7f8b2ae21700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b241a0680 con 0x7f8b24074950 2023-09-23T08:50:01.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:50:01.040+0000 7f8b28bbd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b24073380 0x7f8b24198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:50:01.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:50:01.040+0000 7f8b293be700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b24108880 0x7f8b2419fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:50:01.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:50:01.040+0000 7f8b28bbd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b24073380 0x7f8b24198820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:39866/0 (socket says 172.21.15.82:39866) 2023-09-23T08:50:01.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:50:01.040+0000 7f8b28bbd700 1 -- 172.21.15.82:0/2093885384 learned_addr learned my addr 172.21.15.82:0/2093885384 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:50:01.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:50:01.040+0000 7f8b23fff700 1 --2- 172.21.15.82:0/2093885384 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b24074950 0x7f8b24198d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:50:01.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:50:01.040+0000 7f8b293be700 1 -- 172.21.15.82:0/2093885384 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b24074950 msgr2=0x7f8b24198d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:50:01.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:50:01.040+0000 7f8b293be700 1 --2- 172.21.15.82:0/2093885384 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b24074950 0x7f8b24198d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:50:01.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:50:01.040+0000 7f8b293be700 1 -- 172.21.15.82:0/2093885384 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b24073380 msgr2=0x7f8b24198820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:50:01.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:50:01.040+0000 7f8b293be700 1 --2- 172.21.15.82:0/2093885384 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b24073380 0x7f8b24198820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:50:01.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:50:01.040+0000 7f8b293be700 1 -- 172.21.15.82:0/2093885384 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b100095f0 con 0x7f8b24108880 2023-09-23T08:50:01.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:50:01.040+0000 7f8b28bbd700 1 --2- 172.21.15.82:0/2093885384 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b24073380 0x7f8b24198820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T08:50:01.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:50:01.040+0000 7f8b293be700 1 --2- 172.21.15.82:0/2093885384 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b24108880 0x7f8b2419fde0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c007f40 tx=0x7f8b1c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:50:01.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:50:01.041+0000 7f8b21ffb700 1 -- 172.21.15.82:0/2093885384 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1c004db0 con 0x7f8b24108880 2023-09-23T08:50:01.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:50:01.041+0000 7f8b21ffb700 1 -- 172.21.15.82:0/2093885384 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8b1c00f040 con 0x7f8b24108880 2023-09-23T08:50:01.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:50:01.041+0000 7f8b21ffb700 1 -- 172.21.15.82:0/2093885384 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1c005850 con 0x7f8b24108880 2023-09-23T08:50:01.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:50:01.041+0000 7f8b2ae21700 1 -- 172.21.15.82:0/2093885384 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b241a0960 con 0x7f8b24108880 2023-09-23T08:50:01.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:50:01.041+0000 7f8b2ae21700 1 -- 172.21.15.82:0/2093885384 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b241a0e10 con 0x7f8b24108880 2023-09-23T08:50:01.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:50:01.042+0000 7f8b2ae21700 1 -- 172.21.15.82:0/2093885384 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b24106f30 con 0x7f8b24108880 2023-09-23T08:50:01.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:50:01.044+0000 7f8b21ffb700 1 -- 172.21.15.82:0/2093885384 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 15) v1 ==== 134615+0+0 (secure 0 0 0) 0x7f8b1c00db20 con 0x7f8b24108880 2023-09-23T08:50:01.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:50:01.046+0000 7f8b21ffb700 1 --2- 172.21.15.82:0/2093885384 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f8b1409ff40 0x7f8b140a2400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:50:01.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:50:01.047+0000 7f8b21ffb700 1 -- 172.21.15.82:0/2093885384 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3226+0+0 (secure 0 0 0) 0x7f8b1c0c9dc0 con 0x7f8b24108880 2023-09-23T08:50:01.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:50:01.047+0000 7f8b28bbd700 1 --2- 172.21.15.82:0/2093885384 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f8b1409ff40 0x7f8b140a2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:50:01.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:50:01.047+0000 7f8b28bbd700 1 --2- 172.21.15.82:0/2093885384 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f8b1409ff40 0x7f8b140a2400 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8b18005950 tx=0x7f8b18009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:50:01.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:50:01.049+0000 7f8b21ffb700 1 -- 172.21.15.82:0/2093885384 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f8b1c094f70 con 0x7f8b24108880 2023-09-23T08:50:01.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:00 smithi135 ceph-mon[99205]: osdmap e19: 3 total, 3 up, 3 in 2023-09-23T08:50:01.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:00 smithi135 ceph-mon[99205]: pgmap v88: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-09-23T08:50:01.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:00 smithi135 ceph-mon[99205]: overall HEALTH_OK 2023-09-23T08:50:01.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:00 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-09-23T08:50:01.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:00 smithi082 ceph-mon[97694]: osdmap e19: 3 total, 3 up, 3 in 2023-09-23T08:50:01.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:00 smithi082 ceph-mon[97694]: pgmap v88: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-09-23T08:50:01.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:00 smithi082 ceph-mon[97694]: overall HEALTH_OK 2023-09-23T08:50:01.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:00 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-09-23T08:50:01.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:00 smithi161 ceph-mon[99580]: osdmap e19: 3 total, 3 up, 3 in 2023-09-23T08:50:01.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:00 smithi161 ceph-mon[99580]: pgmap v88: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-09-23T08:50:01.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:00 smithi161 ceph-mon[99580]: overall HEALTH_OK 2023-09-23T08:50:01.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:00 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-09-23T08:50:01.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:50:01.255+0000 7f8b2ae21700 1 -- 172.21.15.82:0/2093885384 --> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f8b2402cea0 con 0x7f8b1409ff40 2023-09-23T08:50:02.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:01 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-09-23T08:50:02.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:01 smithi135 ceph-mon[99205]: osdmap e20: 3 total, 3 up, 3 in 2023-09-23T08:50:02.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:01 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-09-23T08:50:02.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:01 smithi135 ceph-mon[99205]: from='client.14292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:50:02.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:01 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-23T08:50:02.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:01 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-23T08:50:02.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:01 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:50:02.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:01 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-09-23T08:50:02.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:01 smithi082 ceph-mon[97694]: osdmap e20: 3 total, 3 up, 3 in 2023-09-23T08:50:02.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:01 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-09-23T08:50:02.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:01 smithi082 ceph-mon[97694]: from='client.14292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:50:02.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:01 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-23T08:50:02.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:01 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-23T08:50:02.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:01 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:50:02.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:01 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-09-23T08:50:02.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:01 smithi161 ceph-mon[99580]: osdmap e20: 3 total, 3 up, 3 in 2023-09-23T08:50:02.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:01 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-09-23T08:50:02.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:01 smithi161 ceph-mon[99580]: from='client.14292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:50:02.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:01 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-23T08:50:02.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:01 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-23T08:50:02.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:01 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:50:02.621 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 23 08:50:02 smithi082 sudo[113958]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-09-23T08:50:02.621 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 23 08:50:02 smithi082 sudo[113958]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-09-23T08:50:02.621 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 23 08:50:02 smithi082 sudo[113958]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-09-23T08:50:02.621 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 23 08:50:02 smithi082 sudo[113958]: pam_unix(sudo:session): session closed for user root 2023-09-23T08:50:02.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:50:02.808+0000 7f8b21ffb700 1 -- 172.21.15.82:0/2093885384 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 16) v1 ==== 134671+0+0 (secure 0 0 0) 0x7f8b1c095340 con 0x7f8b24108880 2023-09-23T08:50:02.874 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:02 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-09-23T08:50:02.875 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:02 smithi082 ceph-mon[97694]: osdmap e21: 3 total, 3 up, 3 in 2023-09-23T08:50:02.875 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:02 smithi082 ceph-mon[97694]: pgmap v91: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-09-23T08:50:03.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:02 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-09-23T08:50:03.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:02 smithi135 ceph-mon[99205]: osdmap e21: 3 total, 3 up, 3 in 2023-09-23T08:50:03.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:02 smithi135 ceph-mon[99205]: pgmap v91: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-09-23T08:50:03.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:02 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-09-23T08:50:03.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:02 smithi161 ceph-mon[99580]: osdmap e21: 3 total, 3 up, 3 in 2023-09-23T08:50:03.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:02 smithi161 ceph-mon[99580]: pgmap v91: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-09-23T08:50:03.283 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 23 08:50:03 smithi082 sudo[113990]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-09-23T08:50:03.283 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 23 08:50:03 smithi082 sudo[113990]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-09-23T08:50:03.283 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 23 08:50:03 smithi082 sudo[113990]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-09-23T08:50:03.284 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 23 08:50:03 smithi082 sudo[113990]: pam_unix(sudo:session): session closed for user root 2023-09-23T08:50:03.806 INFO:journalctl@ceph.osd.1.smithi135.stdout:Sep 23 08:50:03 smithi135 sudo[106529]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-09-23T08:50:03.806 INFO:journalctl@ceph.osd.1.smithi135.stdout:Sep 23 08:50:03 smithi135 sudo[106529]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-09-23T08:50:03.806 INFO:journalctl@ceph.osd.1.smithi135.stdout:Sep 23 08:50:03 smithi135 sudo[106529]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-09-23T08:50:03.806 INFO:journalctl@ceph.osd.1.smithi135.stdout:Sep 23 08:50:03 smithi135 sudo[106529]: pam_unix(sudo:session): session closed for user root 2023-09-23T08:50:04.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:03 smithi135 ceph-mon[99205]: mgrmap e16: x(active, since 2m), standbys: z, y 2023-09-23T08:50:04.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:03 smithi135 ceph-mon[99205]: osdmap e22: 3 total, 3 up, 3 in 2023-09-23T08:50:04.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:03 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:50:04.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:03 smithi082 ceph-mon[97694]: mgrmap e16: x(active, since 2m), standbys: z, y 2023-09-23T08:50:04.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:03 smithi082 ceph-mon[97694]: osdmap e22: 3 total, 3 up, 3 in 2023-09-23T08:50:04.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:03 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:50:04.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:03 smithi161 ceph-mon[99580]: mgrmap e16: x(active, since 2m), standbys: z, y 2023-09-23T08:50:04.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:03 smithi161 ceph-mon[99580]: osdmap e22: 3 total, 3 up, 3 in 2023-09-23T08:50:04.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:03 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:50:04.562 INFO:journalctl@ceph.osd.1.smithi135.stdout:Sep 23 08:50:04 smithi135 sudo[106532]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-09-23T08:50:04.562 INFO:journalctl@ceph.osd.1.smithi135.stdout:Sep 23 08:50:04 smithi135 sudo[106532]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-09-23T08:50:04.563 INFO:journalctl@ceph.osd.1.smithi135.stdout:Sep 23 08:50:04 smithi135 sudo[106532]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-09-23T08:50:04.563 INFO:journalctl@ceph.osd.1.smithi135.stdout:Sep 23 08:50:04 smithi135 sudo[106532]: pam_unix(sudo:session): session closed for user root 2023-09-23T08:50:04.898 INFO:journalctl@ceph.osd.2.smithi161.stdout:Sep 23 08:50:04 smithi161 sudo[107680]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-09-23T08:50:04.898 INFO:journalctl@ceph.osd.2.smithi161.stdout:Sep 23 08:50:04 smithi161 sudo[107680]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-09-23T08:50:04.898 INFO:journalctl@ceph.osd.2.smithi161.stdout:Sep 23 08:50:04 smithi161 sudo[107680]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-09-23T08:50:04.899 INFO:journalctl@ceph.osd.2.smithi161.stdout:Sep 23 08:50:04 smithi161 sudo[107680]: pam_unix(sudo:session): session closed for user root 2023-09-23T08:50:05.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:05 smithi082 ceph-mon[97694]: pgmap v93: 1 pgs: 1 active+clean; 449 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-09-23T08:50:05.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:05 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:50:05.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:05 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/1288083071' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "701c96b0-30fb-46ce-917d-e02d3814dc3c"}]: dispatch 2023-09-23T08:50:05.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:05 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/1288083071' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "701c96b0-30fb-46ce-917d-e02d3814dc3c"}]': finished 2023-09-23T08:50:05.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:05 smithi082 ceph-mon[97694]: osdmap e23: 4 total, 3 up, 4 in 2023-09-23T08:50:05.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:05 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-09-23T08:50:05.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:05 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/1785547494' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-23T08:50:05.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:05 smithi161 ceph-mon[99580]: pgmap v93: 1 pgs: 1 active+clean; 449 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-09-23T08:50:05.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:05 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:50:05.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:05 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/1288083071' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "701c96b0-30fb-46ce-917d-e02d3814dc3c"}]: dispatch 2023-09-23T08:50:05.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:05 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/1288083071' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "701c96b0-30fb-46ce-917d-e02d3814dc3c"}]': finished 2023-09-23T08:50:05.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:05 smithi161 ceph-mon[99580]: osdmap e23: 4 total, 3 up, 4 in 2023-09-23T08:50:05.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:05 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-09-23T08:50:05.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:05 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/1785547494' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-23T08:50:05.399 INFO:journalctl@ceph.osd.2.smithi161.stdout:Sep 23 08:50:05 smithi161 sudo[107683]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-09-23T08:50:05.399 INFO:journalctl@ceph.osd.2.smithi161.stdout:Sep 23 08:50:05 smithi161 sudo[107683]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-09-23T08:50:05.399 INFO:journalctl@ceph.osd.2.smithi161.stdout:Sep 23 08:50:05 smithi161 sudo[107683]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-09-23T08:50:05.399 INFO:journalctl@ceph.osd.2.smithi161.stdout:Sep 23 08:50:05 smithi161 sudo[107683]: pam_unix(sudo:session): session closed for user root 2023-09-23T08:50:05.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:05 smithi135 ceph-mon[99205]: pgmap v93: 1 pgs: 1 active+clean; 449 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-09-23T08:50:05.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:05 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:50:05.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:05 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/1288083071' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "701c96b0-30fb-46ce-917d-e02d3814dc3c"}]: dispatch 2023-09-23T08:50:05.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:05 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/1288083071' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "701c96b0-30fb-46ce-917d-e02d3814dc3c"}]': finished 2023-09-23T08:50:05.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:05 smithi135 ceph-mon[99205]: osdmap e23: 4 total, 3 up, 4 in 2023-09-23T08:50:05.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:05 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-09-23T08:50:05.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:05 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/1785547494' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-23T08:50:06.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:05 smithi082 sudo[114162]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-09-23T08:50:06.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:05 smithi082 sudo[114162]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-09-23T08:50:06.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:05 smithi082 sudo[114162]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-09-23T08:50:06.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:05 smithi082 sudo[114162]: pam_unix(sudo:session): session closed for user root 2023-09-23T08:50:06.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:06 smithi082 sudo[114542]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-09-23T08:50:06.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:06 smithi082 sudo[114542]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-09-23T08:50:06.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:06 smithi082 sudo[114542]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-09-23T08:50:06.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:06 smithi082 sudo[114542]: pam_unix(sudo:session): session closed for user root 2023-09-23T08:50:07.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:06 smithi161 sudo[107686]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-09-23T08:50:07.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:06 smithi161 sudo[107686]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-09-23T08:50:07.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:06 smithi161 sudo[107686]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-09-23T08:50:07.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:06 smithi161 sudo[107686]: pam_unix(sudo:session): session closed for user root 2023-09-23T08:50:07.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:07 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:50:07.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:07 smithi082 ceph-mon[97694]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-09-23T08:50:07.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:07 smithi161 sudo[107689]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-09-23T08:50:07.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:07 smithi161 sudo[107689]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-09-23T08:50:07.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:07 smithi161 sudo[107689]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-09-23T08:50:07.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:07 smithi161 sudo[107689]: pam_unix(sudo:session): session closed for user root 2023-09-23T08:50:07.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:07 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:50:07.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:07 smithi161 ceph-mon[99580]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-09-23T08:50:07.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:07 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:50:07.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:07 smithi135 ceph-mon[99205]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-09-23T08:50:08.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:07 smithi135 sudo[106535]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-09-23T08:50:08.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:07 smithi135 sudo[106535]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-09-23T08:50:08.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:07 smithi135 sudo[106535]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-09-23T08:50:08.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:07 smithi135 sudo[106535]: pam_unix(sudo:session): session closed for user root 2023-09-23T08:50:08.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:08 smithi082 ceph-mon[97694]: pgmap v95: 1 pgs: 1 active+clean; 449 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-09-23T08:50:08.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:08 smithi082 ceph-mon[97694]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-09-23T08:50:08.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:08 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-09-23T08:50:08.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:08 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-23T08:50:08.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:08 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-23T08:50:08.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:08 smithi082 ceph-mon[97694]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-09-23T08:50:08.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:08 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-09-23T08:50:08.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:08 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-23T08:50:08.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:08 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-23T08:50:08.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:08 smithi082 ceph-mon[97694]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-09-23T08:50:08.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:08 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-09-23T08:50:08.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:08 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-23T08:50:08.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:08 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-23T08:50:08.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:08 smithi161 ceph-mon[99580]: pgmap v95: 1 pgs: 1 active+clean; 449 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-09-23T08:50:08.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:08 smithi161 ceph-mon[99580]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-09-23T08:50:08.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:08 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-09-23T08:50:08.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:08 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-23T08:50:08.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:08 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-23T08:50:08.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:08 smithi161 ceph-mon[99580]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-09-23T08:50:08.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:08 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-09-23T08:50:08.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:08 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-23T08:50:08.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:08 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-23T08:50:08.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:08 smithi161 ceph-mon[99580]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-09-23T08:50:08.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:08 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-09-23T08:50:08.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:08 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-23T08:50:08.650 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:08 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-23T08:50:08.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:08 smithi135 sudo[106538]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-09-23T08:50:08.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:08 smithi135 sudo[106538]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-09-23T08:50:08.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:08 smithi135 sudo[106538]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-09-23T08:50:08.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:08 smithi135 sudo[106538]: pam_unix(sudo:session): session closed for user root 2023-09-23T08:50:08.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:08 smithi135 ceph-mon[99205]: pgmap v95: 1 pgs: 1 active+clean; 449 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-09-23T08:50:08.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:08 smithi135 ceph-mon[99205]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-09-23T08:50:08.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:08 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-09-23T08:50:08.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:08 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-23T08:50:08.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:08 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-23T08:50:08.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:08 smithi135 ceph-mon[99205]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-09-23T08:50:08.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:08 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-09-23T08:50:08.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:08 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-23T08:50:08.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:08 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-23T08:50:08.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:08 smithi135 ceph-mon[99205]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-09-23T08:50:08.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:08 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-09-23T08:50:08.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:08 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-23T08:50:08.814 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:08 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-23T08:50:09.623 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:09 smithi082 ceph-mon[97694]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-09-23T08:50:09.623 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:09 smithi082 ceph-mon[97694]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 302 KiB/s wr, 19 op/s 2023-09-23T08:50:09.623 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:09 smithi082 ceph-mon[97694]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-09-23T08:50:09.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:09 smithi161 ceph-mon[99580]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-09-23T08:50:09.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:09 smithi161 ceph-mon[99580]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 302 KiB/s wr, 19 op/s 2023-09-23T08:50:09.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:09 smithi161 ceph-mon[99580]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-09-23T08:50:09.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:09 smithi135 ceph-mon[99205]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-09-23T08:50:09.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:09 smithi135 ceph-mon[99205]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 302 KiB/s wr, 19 op/s 2023-09-23T08:50:09.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:09 smithi135 ceph-mon[99205]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-09-23T08:50:11.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:11 smithi082 ceph-mon[97694]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 218 KiB/s wr, 14 op/s 2023-09-23T08:50:11.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:11 smithi161 ceph-mon[99580]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 218 KiB/s wr, 14 op/s 2023-09-23T08:50:11.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:11 smithi135 ceph-mon[99205]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 218 KiB/s wr, 14 op/s 2023-09-23T08:50:12.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:12 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-09-23T08:50:12.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:12 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:50:12.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:12 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-09-23T08:50:12.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:12 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:50:12.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:12 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-09-23T08:50:12.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:12 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:50:13.415 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:13 smithi082 ceph-mon[97694]: Deploying daemon osd.3 on smithi082 2023-09-23T08:50:13.416 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:13 smithi082 ceph-mon[97694]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 170 KiB/s wr, 10 op/s 2023-09-23T08:50:13.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:13 smithi161 ceph-mon[99580]: Deploying daemon osd.3 on smithi082 2023-09-23T08:50:13.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:13 smithi161 ceph-mon[99580]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 170 KiB/s wr, 10 op/s 2023-09-23T08:50:13.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:13 smithi135 ceph-mon[99205]: Deploying daemon osd.3 on smithi082 2023-09-23T08:50:13.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:13 smithi135 ceph-mon[99205]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 170 KiB/s wr, 10 op/s 2023-09-23T08:50:15.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:15 smithi135 ceph-mon[99205]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 4.0 KiB/s rd, 183 KiB/s wr, 12 op/s 2023-09-23T08:50:15.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:15 smithi082 ceph-mon[97694]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 4.0 KiB/s rd, 183 KiB/s wr, 12 op/s 2023-09-23T08:50:15.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:15 smithi161 ceph-mon[99580]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 4.0 KiB/s rd, 183 KiB/s wr, 12 op/s 2023-09-23T08:50:17.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:17 smithi161 ceph-mon[99580]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 155 KiB/s wr, 10 op/s 2023-09-23T08:50:17.706 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:17 smithi082 ceph-mon[97694]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 155 KiB/s wr, 10 op/s 2023-09-23T08:50:17.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:17 smithi135 ceph-mon[99205]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 155 KiB/s wr, 10 op/s 2023-09-23T08:50:19.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:19 smithi135 ceph-mon[99205]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 152 KiB/s wr, 10 op/s 2023-09-23T08:50:19.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:19 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:50:19.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:19 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:50:19.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:19 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:50:19.354 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:19 smithi082 ceph-mon[97694]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 152 KiB/s wr, 10 op/s 2023-09-23T08:50:19.354 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:19 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:50:19.354 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:19 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:50:19.355 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:19 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:50:19.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:19 smithi161 ceph-mon[99580]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 152 KiB/s wr, 10 op/s 2023-09-23T08:50:19.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:19 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:50:19.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:19 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:50:19.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:19 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:50:21.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:21 smithi082 ceph-mon[97694]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2023-09-23T08:50:21.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:21 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:50:21.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:21 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:50:21.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:21 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:50:21.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:21 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:50:21.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:21 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:50:21.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:50:21.227+0000 7f8b21ffb700 1 -- 172.21.15.82:0/2093885384 <== mgr.14152 v2:172.21.15.82:6800/3698954311 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f8b2402cea0 con 0x7f8b1409ff40 2023-09-23T08:50:21.231 INFO:teuthology.orchestra.run.smithi082.stdout:Created osd(s) 3 on host 'smithi082' 2023-09-23T08:50:21.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:50:21.231+0000 7f8b2ae21700 1 -- 172.21.15.82:0/2093885384 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f8b1409ff40 msgr2=0x7f8b140a2400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:50:21.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:50:21.231+0000 7f8b2ae21700 1 --2- 172.21.15.82:0/2093885384 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f8b1409ff40 0x7f8b140a2400 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8b18005950 tx=0x7f8b18009260 comp rx=0 tx=0).stop 2023-09-23T08:50:21.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:50:21.231+0000 7f8b2ae21700 1 -- 172.21.15.82:0/2093885384 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b24108880 msgr2=0x7f8b2419fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:50:21.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:50:21.231+0000 7f8b2ae21700 1 --2- 172.21.15.82:0/2093885384 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b24108880 0x7f8b2419fde0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c007f40 tx=0x7f8b1c00d3b0 comp rx=0 tx=0).stop 2023-09-23T08:50:21.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:50:21.232+0000 7f8b2ae21700 1 -- 172.21.15.82:0/2093885384 shutdown_connections 2023-09-23T08:50:21.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:50:21.232+0000 7f8b2ae21700 1 --2- 172.21.15.82:0/2093885384 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f8b1409ff40 0x7f8b140a2400 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:50:21.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:50:21.232+0000 7f8b2ae21700 1 --2- 172.21.15.82:0/2093885384 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b24108880 0x7f8b2419fde0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:50:21.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:50:21.232+0000 7f8b2ae21700 1 --2- 172.21.15.82:0/2093885384 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b24073380 0x7f8b24198820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:50:21.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:50:21.232+0000 7f8b2ae21700 1 --2- 172.21.15.82:0/2093885384 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b24074950 0x7f8b24198d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:50:21.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:50:21.232+0000 7f8b2ae21700 1 -- 172.21.15.82:0/2093885384 >> 172.21.15.82:0/2093885384 conn(0x7f8b240fbf10 msgr2=0x7f8b240fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:50:21.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:50:21.232+0000 7f8b2ae21700 1 -- 172.21.15.82:0/2093885384 shutdown_connections 2023-09-23T08:50:21.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:50:21.232+0000 7f8b2ae21700 1 -- 172.21.15.82:0/2093885384 wait complete. 2023-09-23T08:50:21.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:21 smithi135 ceph-mon[99205]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2023-09-23T08:50:21.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:21 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:50:21.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:21 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:50:21.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:21 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:50:21.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:21 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:50:21.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:21 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:50:21.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:21 smithi161 ceph-mon[99580]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2023-09-23T08:50:21.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:21 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:50:21.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:21 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:50:21.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:21 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:50:21.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:21 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:50:21.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:21 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:50:21.737 DEBUG:teuthology.orchestra.run.smithi082:osd.3> sudo journalctl -f -n 0 -u ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@osd.3.service 2023-09-23T08:50:21.741 INFO:tasks.cephadm:Deploying osd.4 on smithi135 with /dev/vg_nvme/lv_3... 2023-09-23T08:50:21.741 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-09-23T08:50:21.818 INFO:journalctl@ceph.osd.3.smithi082.stdout:-- Logs begin at Sat 2023-09-23 08:29:32 UTC. -- 2023-09-23T08:50:22.305 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:22 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:50:22.306 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:22 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:50:22.306 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:22 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:50:22.306 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:22 smithi082 ceph-mon[97694]: from='osd.3 [v2:172.21.15.82:6810/1081464528,v1:172.21.15.82:6811/1081464528]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-09-23T08:50:22.306 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:22 smithi082 ceph-mon[97694]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-09-23T08:50:22.306 INFO:journalctl@ceph.osd.3.smithi082.stdout:Sep 23 08:50:22 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-3[116365]: 2023-09-23T08:50:22.018+0000 7f46e1338640 -1 osd.3 0 log_to_monitors true 2023-09-23T08:50:22.464 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.b/config 2023-09-23T08:50:22.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:22 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:50:22.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:22 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:50:22.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:22 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:50:22.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:22 smithi135 ceph-mon[99205]: from='osd.3 [v2:172.21.15.82:6810/1081464528,v1:172.21.15.82:6811/1081464528]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-09-23T08:50:22.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:22 smithi135 ceph-mon[99205]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-09-23T08:50:22.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:22 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:50:22.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:22 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:50:22.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:22 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:50:22.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:22 smithi161 ceph-mon[99580]: from='osd.3 [v2:172.21.15.82:6810/1081464528,v1:172.21.15.82:6811/1081464528]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-09-23T08:50:22.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:22 smithi161 ceph-mon[99580]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-09-23T08:50:23.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:23 smithi135 ceph-mon[99205]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2023-09-23T08:50:23.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:23 smithi135 ceph-mon[99205]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-09-23T08:50:23.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:23 smithi135 ceph-mon[99205]: osdmap e24: 4 total, 3 up, 4 in 2023-09-23T08:50:23.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:23 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-09-23T08:50:23.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:23 smithi135 ceph-mon[99205]: from='osd.3 [v2:172.21.15.82:6810/1081464528,v1:172.21.15.82:6811/1081464528]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2023-09-23T08:50:23.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:23 smithi135 ceph-mon[99205]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2023-09-23T08:50:23.621 INFO:journalctl@ceph.osd.3.smithi082.stdout:Sep 23 08:50:23 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-3[116365]: 2023-09-23T08:50:23.345+0000 7f46d61af700 -1 osd.3 0 waiting for initial osdmap 2023-09-23T08:50:23.621 INFO:journalctl@ceph.osd.3.smithi082.stdout:Sep 23 08:50:23 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-3[116365]: 2023-09-23T08:50:23.351+0000 7f46d07a1700 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-23T08:50:23.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:23 smithi082 ceph-mon[97694]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2023-09-23T08:50:23.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:23 smithi082 ceph-mon[97694]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-09-23T08:50:23.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:23 smithi082 ceph-mon[97694]: osdmap e24: 4 total, 3 up, 4 in 2023-09-23T08:50:23.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:23 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-09-23T08:50:23.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:23 smithi082 ceph-mon[97694]: from='osd.3 [v2:172.21.15.82:6810/1081464528,v1:172.21.15.82:6811/1081464528]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2023-09-23T08:50:23.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:23 smithi082 ceph-mon[97694]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2023-09-23T08:50:23.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:23 smithi161 ceph-mon[99580]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2023-09-23T08:50:23.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:23 smithi161 ceph-mon[99580]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-09-23T08:50:23.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:23 smithi161 ceph-mon[99580]: osdmap e24: 4 total, 3 up, 4 in 2023-09-23T08:50:23.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:23 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-09-23T08:50:23.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:23 smithi161 ceph-mon[99580]: from='osd.3 [v2:172.21.15.82:6810/1081464528,v1:172.21.15.82:6811/1081464528]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2023-09-23T08:50:23.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:23 smithi161 ceph-mon[99580]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2023-09-23T08:50:24.423 INFO:teuthology.orchestra.run.smithi135.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-09-23T08:50:24.423 INFO:teuthology.orchestra.run.smithi135.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-09-23T08:50:24.424 INFO:teuthology.orchestra.run.smithi135.stderr: stderr: 10+0 records in 2023-09-23T08:50:24.424 INFO:teuthology.orchestra.run.smithi135.stderr:10+0 records out 2023-09-23T08:50:24.424 INFO:teuthology.orchestra.run.smithi135.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0417337 s, 251 MB/s 2023-09-23T08:50:24.424 INFO:teuthology.orchestra.run.smithi135.stderr: stderr: 2023-09-23T08:50:24.424 INFO:teuthology.orchestra.run.smithi135.stderr:--> Zapping successful for: 2023-09-23T08:50:24.606 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:24 smithi135 ceph-mon[99205]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2023-09-23T08:50:24.606 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:24 smithi135 ceph-mon[99205]: osdmap e25: 4 total, 3 up, 4 in 2023-09-23T08:50:24.606 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:24 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-09-23T08:50:24.607 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:24 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-09-23T08:50:24.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:24 smithi082 ceph-mon[97694]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2023-09-23T08:50:24.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:24 smithi082 ceph-mon[97694]: osdmap e25: 4 total, 3 up, 4 in 2023-09-23T08:50:24.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:24 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-09-23T08:50:24.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:24 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-09-23T08:50:24.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:24 smithi161 ceph-mon[99580]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2023-09-23T08:50:24.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:24 smithi161 ceph-mon[99580]: osdmap e25: 4 total, 3 up, 4 in 2023-09-23T08:50:24.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:24 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-09-23T08:50:24.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:24 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-09-23T08:50:24.941 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- ceph orch daemon add osd smithi135:vg_nvme/lv_3 2023-09-23T08:50:25.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:25 smithi082 ceph-mon[97694]: purged_snaps scrub starts 2023-09-23T08:50:25.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:25 smithi082 ceph-mon[97694]: purged_snaps scrub ok 2023-09-23T08:50:25.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:25 smithi082 ceph-mon[97694]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2023-09-23T08:50:25.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:25 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-09-23T08:50:25.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:25 smithi082 ceph-mon[97694]: osd.3 [v2:172.21.15.82:6810/1081464528,v1:172.21.15.82:6811/1081464528] boot 2023-09-23T08:50:25.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:25 smithi082 ceph-mon[97694]: osdmap e26: 4 total, 4 up, 4 in 2023-09-23T08:50:25.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:25 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-09-23T08:50:25.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:25 smithi082 ceph-mon[97694]: Detected new or changed devices on smithi082 2023-09-23T08:50:25.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:25 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:50:25.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:25 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:50:25.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:25 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:50:25.623 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:25 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:50:25.623 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:25 smithi082 ceph-mon[97694]: Adjusting osd_memory_target on smithi082 to 8633M 2023-09-23T08:50:25.623 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:25 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:50:25.623 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:25 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:50:25.623 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:25 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:50:25.623 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:25 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:50:25.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:25 smithi161 ceph-mon[99580]: purged_snaps scrub starts 2023-09-23T08:50:25.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:25 smithi161 ceph-mon[99580]: purged_snaps scrub ok 2023-09-23T08:50:25.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:25 smithi161 ceph-mon[99580]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2023-09-23T08:50:25.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:25 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-09-23T08:50:25.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:25 smithi161 ceph-mon[99580]: osd.3 [v2:172.21.15.82:6810/1081464528,v1:172.21.15.82:6811/1081464528] boot 2023-09-23T08:50:25.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:25 smithi161 ceph-mon[99580]: osdmap e26: 4 total, 4 up, 4 in 2023-09-23T08:50:25.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:25 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-09-23T08:50:25.650 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:25 smithi161 ceph-mon[99580]: Detected new or changed devices on smithi082 2023-09-23T08:50:25.650 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:25 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:50:25.650 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:25 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:50:25.650 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:25 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:50:25.650 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:25 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:50:25.650 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:25 smithi161 ceph-mon[99580]: Adjusting osd_memory_target on smithi082 to 8633M 2023-09-23T08:50:25.650 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:25 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:50:25.650 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:25 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:50:25.650 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:25 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:50:25.650 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:25 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:50:25.677 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.b/config 2023-09-23T08:50:25.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:25 smithi135 ceph-mon[99205]: purged_snaps scrub starts 2023-09-23T08:50:25.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:25 smithi135 ceph-mon[99205]: purged_snaps scrub ok 2023-09-23T08:50:25.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:25 smithi135 ceph-mon[99205]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2023-09-23T08:50:25.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:25 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-09-23T08:50:25.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:25 smithi135 ceph-mon[99205]: osd.3 [v2:172.21.15.82:6810/1081464528,v1:172.21.15.82:6811/1081464528] boot 2023-09-23T08:50:25.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:25 smithi135 ceph-mon[99205]: osdmap e26: 4 total, 4 up, 4 in 2023-09-23T08:50:25.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:25 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-09-23T08:50:25.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:25 smithi135 ceph-mon[99205]: Detected new or changed devices on smithi082 2023-09-23T08:50:25.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:25 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:50:25.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:25 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:50:25.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:25 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:50:25.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:25 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:50:25.814 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:25 smithi135 ceph-mon[99205]: Adjusting osd_memory_target on smithi082 to 8633M 2023-09-23T08:50:25.814 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:25 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:50:25.814 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:25 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:50:25.814 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:25 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:50:25.814 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:25 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:50:26.535 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:26 smithi135 ceph-mon[99205]: osdmap e27: 4 total, 4 up, 4 in 2023-09-23T08:50:26.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:26 smithi082 ceph-mon[97694]: osdmap e27: 4 total, 4 up, 4 in 2023-09-23T08:50:26.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:26 smithi161 ceph-mon[99580]: osdmap e27: 4 total, 4 up, 4 in 2023-09-23T08:50:27.185 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:50:27.182+0000 7f91dd387700 1 -- 172.21.15.135:0/687874317 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91d8102550 msgr2=0x7f91d8108e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:50:27.185 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:50:27.182+0000 7f91dd387700 1 --2- 172.21.15.135:0/687874317 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91d8102550 0x7f91d8108e00 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f91d000b0d0 tx=0x7f91d000b3e0 comp rx=0 tx=0).stop 2023-09-23T08:50:27.185 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:50:27.182+0000 7f91dd387700 1 -- 172.21.15.135:0/687874317 shutdown_connections 2023-09-23T08:50:27.185 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:50:27.182+0000 7f91dd387700 1 --2- 172.21.15.135:0/687874317 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91d8102550 0x7f91d8108e00 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:50:27.185 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:50:27.182+0000 7f91dd387700 1 --2- 172.21.15.135:0/687874317 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91d81009b0 0x7f91d8100dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:50:27.185 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:50:27.182+0000 7f91dd387700 1 --2- 172.21.15.135:0/687874317 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f91d8101bb0 0x7f91d8102010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:50:27.186 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:50:27.182+0000 7f91dd387700 1 -- 172.21.15.135:0/687874317 >> 172.21.15.135:0/687874317 conn(0x7f91d80fbf10 msgr2=0x7f91d80fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:50:27.186 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:50:27.182+0000 7f91dd387700 1 -- 172.21.15.135:0/687874317 shutdown_connections 2023-09-23T08:50:27.186 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:50:27.182+0000 7f91dd387700 1 -- 172.21.15.135:0/687874317 wait complete. 2023-09-23T08:50:27.187 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:50:27.183+0000 7f91dd387700 1 Processor -- start 2023-09-23T08:50:27.188 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:50:27.183+0000 7f91dd387700 1 -- start start 2023-09-23T08:50:27.188 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:50:27.184+0000 7f91dd387700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f91d81009b0 0x7f91d80746c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:50:27.188 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:50:27.184+0000 7f91dd387700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91d8101bb0 0x7f91d8072d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:50:27.188 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:50:27.184+0000 7f91dd387700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91d8102550 0x7f91d8073250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:50:27.188 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:50:27.184+0000 7f91dd387700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91d80739d0 con 0x7f91d8101bb0 2023-09-23T08:50:27.188 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:50:27.184+0000 7f91dd387700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91d8073b40 con 0x7f91d8102550 2023-09-23T08:50:27.188 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:50:27.184+0000 7f91dd387700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91d81a0720 con 0x7f91d81009b0 2023-09-23T08:50:27.188 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:50:27.184+0000 7f91d77fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91d8102550 0x7f91d8073250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:50:27.188 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:50:27.184+0000 7f91d6ffd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f91d81009b0 0x7f91d80746c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:50:27.189 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:50:27.184+0000 7f91d77fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91d8102550 0x7f91d8073250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:52152/0 (socket says 172.21.15.135:52152) 2023-09-23T08:50:27.189 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:50:27.184+0000 7f91d77fe700 1 -- 172.21.15.135:0/1416603611 learned_addr learned my addr 172.21.15.135:0/1416603611 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-09-23T08:50:27.189 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:50:27.184+0000 7f91d67fc700 1 --2- 172.21.15.135:0/1416603611 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91d8101bb0 0x7f91d8072d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:50:27.189 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:50:27.184+0000 7f91d77fe700 1 -- 172.21.15.135:0/1416603611 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f91d81009b0 msgr2=0x7f91d80746c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:50:27.189 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:50:27.184+0000 7f91d77fe700 1 --2- 172.21.15.135:0/1416603611 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f91d81009b0 0x7f91d80746c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:50:27.189 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:50:27.184+0000 7f91d77fe700 1 -- 172.21.15.135:0/1416603611 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91d8101bb0 msgr2=0x7f91d8072d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:50:27.189 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:50:27.184+0000 7f91d77fe700 1 --2- 172.21.15.135:0/1416603611 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91d8101bb0 0x7f91d8072d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:50:27.189 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:50:27.184+0000 7f91d77fe700 1 -- 172.21.15.135:0/1416603611 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91d0009d00 con 0x7f91d8102550 2023-09-23T08:50:27.189 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:50:27.185+0000 7f91d77fe700 1 --2- 172.21.15.135:0/1416603611 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91d8102550 0x7f91d8073250 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f91d000d010 tx=0x7f91d00094c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:50:27.189 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:50:27.185+0000 7f91bffff700 1 -- 172.21.15.135:0/1416603611 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d000e040 con 0x7f91d8102550 2023-09-23T08:50:27.189 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:50:27.185+0000 7f91bffff700 1 -- 172.21.15.135:0/1416603611 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f91d0003e10 con 0x7f91d8102550 2023-09-23T08:50:27.189 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:50:27.185+0000 7f91bffff700 1 -- 172.21.15.135:0/1416603611 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d0012a30 con 0x7f91d8102550 2023-09-23T08:50:27.190 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:50:27.185+0000 7f91dd387700 1 -- 172.21.15.135:0/1416603611 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91d81a09a0 con 0x7f91d8102550 2023-09-23T08:50:27.190 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:50:27.185+0000 7f91dd387700 1 -- 172.21.15.135:0/1416603611 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91d81a0db0 con 0x7f91d8102550 2023-09-23T08:50:27.190 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:50:27.186+0000 7f91dd387700 1 -- 172.21.15.135:0/1416603611 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91d8107fd0 con 0x7f91d8102550 2023-09-23T08:50:27.190 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:50:27.188+0000 7f91bffff700 1 -- 172.21.15.135:0/1416603611 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) v1 ==== 134671+0+0 (secure 0 0 0) 0x7f91d0012b90 con 0x7f91d8102550 2023-09-23T08:50:27.192 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:50:27.190+0000 7f91bffff700 1 --2- 172.21.15.135:0/1416603611 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f91c009ffd0 0x7f91c00a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:50:27.192 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:50:27.190+0000 7f91bffff700 1 -- 172.21.15.135:0/1416603611 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 3698+0+0 (secure 0 0 0) 0x7f91d00cb6e0 con 0x7f91d8102550 2023-09-23T08:50:27.193 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:50:27.191+0000 7f91d6ffd700 1 --2- 172.21.15.135:0/1416603611 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f91c009ffd0 0x7f91c00a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:50:27.193 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:50:27.191+0000 7f91d6ffd700 1 --2- 172.21.15.135:0/1416603611 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f91c009ffd0 0x7f91c00a2490 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f91d8101a10 tx=0x7f91c800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:50:27.197 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:50:27.195+0000 7f91bffff700 1 -- 172.21.15.135:0/1416603611 <== mon.2 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f91d0096660 con 0x7f91d8102550 2023-09-23T08:50:27.404 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:50:27.401+0000 7f91dd387700 1 -- 172.21.15.135:0/1416603611 --> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f91d802cdf0 con 0x7f91c009ffd0 2023-09-23T08:50:27.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:27 smithi161 ceph-mon[99580]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-09-23T08:50:27.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:27 smithi161 ceph-mon[99580]: osdmap e28: 4 total, 4 up, 4 in 2023-09-23T08:50:27.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:27 smithi135 ceph-mon[99205]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-09-23T08:50:27.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:27 smithi135 ceph-mon[99205]: osdmap e28: 4 total, 4 up, 4 in 2023-09-23T08:50:27.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:27 smithi082 ceph-mon[97694]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-09-23T08:50:27.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:27 smithi082 ceph-mon[97694]: osdmap e28: 4 total, 4 up, 4 in 2023-09-23T08:50:28.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:28 smithi161 ceph-mon[99580]: osdmap e29: 4 total, 4 up, 4 in 2023-09-23T08:50:28.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:28 smithi161 ceph-mon[99580]: from='client.24224 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:50:28.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:28 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-23T08:50:28.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:28 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-23T08:50:28.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:28 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:50:28.771 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:28 smithi135 ceph-mon[99205]: osdmap e29: 4 total, 4 up, 4 in 2023-09-23T08:50:28.771 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:28 smithi135 ceph-mon[99205]: from='client.24224 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:50:28.771 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:28 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-23T08:50:28.771 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:28 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-23T08:50:28.771 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:28 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:50:28.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:28 smithi082 ceph-mon[97694]: osdmap e29: 4 total, 4 up, 4 in 2023-09-23T08:50:28.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:28 smithi082 ceph-mon[97694]: from='client.24224 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:50:28.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:28 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-23T08:50:28.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:28 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-23T08:50:28.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:28 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:50:29.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:29 smithi161 ceph-mon[99580]: pgmap v112: 1 pgs: 1 peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-09-23T08:50:29.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:29 smithi161 ceph-mon[99580]: osdmap e30: 4 total, 4 up, 4 in 2023-09-23T08:50:29.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:29 smithi135 ceph-mon[99205]: pgmap v112: 1 pgs: 1 peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-09-23T08:50:29.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:29 smithi135 ceph-mon[99205]: osdmap e30: 4 total, 4 up, 4 in 2023-09-23T08:50:29.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:29 smithi082 ceph-mon[97694]: pgmap v112: 1 pgs: 1 peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-09-23T08:50:29.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:29 smithi082 ceph-mon[97694]: osdmap e30: 4 total, 4 up, 4 in 2023-09-23T08:50:31.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:31 smithi135 ceph-mon[99205]: pgmap v114: 1 pgs: 1 peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 124 KiB/s, 0 objects/s recovering 2023-09-23T08:50:31.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:31 smithi135 ceph-mon[99205]: from='client.? 172.21.15.135:0/1804750284' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c618d2a2-3616-41b2-943c-7a4616538e13"}]: dispatch 2023-09-23T08:50:31.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:31 smithi135 ceph-mon[99205]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c618d2a2-3616-41b2-943c-7a4616538e13"}]: dispatch 2023-09-23T08:50:31.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:31 smithi135 ceph-mon[99205]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c618d2a2-3616-41b2-943c-7a4616538e13"}]': finished 2023-09-23T08:50:31.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:31 smithi135 ceph-mon[99205]: osdmap e31: 5 total, 4 up, 5 in 2023-09-23T08:50:31.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:31 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-09-23T08:50:31.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:31 smithi135 ceph-mon[99205]: from='client.? 172.21.15.135:0/3919136580' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-23T08:50:31.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:31 smithi082 ceph-mon[97694]: pgmap v114: 1 pgs: 1 peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 124 KiB/s, 0 objects/s recovering 2023-09-23T08:50:31.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:31 smithi082 ceph-mon[97694]: from='client.? 172.21.15.135:0/1804750284' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c618d2a2-3616-41b2-943c-7a4616538e13"}]: dispatch 2023-09-23T08:50:31.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:31 smithi082 ceph-mon[97694]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c618d2a2-3616-41b2-943c-7a4616538e13"}]: dispatch 2023-09-23T08:50:31.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:31 smithi082 ceph-mon[97694]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c618d2a2-3616-41b2-943c-7a4616538e13"}]': finished 2023-09-23T08:50:31.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:31 smithi082 ceph-mon[97694]: osdmap e31: 5 total, 4 up, 5 in 2023-09-23T08:50:31.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:31 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-09-23T08:50:31.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:31 smithi082 ceph-mon[97694]: from='client.? 172.21.15.135:0/3919136580' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-23T08:50:31.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:31 smithi161 ceph-mon[99580]: pgmap v114: 1 pgs: 1 peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 124 KiB/s, 0 objects/s recovering 2023-09-23T08:50:31.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:31 smithi161 ceph-mon[99580]: from='client.? 172.21.15.135:0/1804750284' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c618d2a2-3616-41b2-943c-7a4616538e13"}]: dispatch 2023-09-23T08:50:31.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:31 smithi161 ceph-mon[99580]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c618d2a2-3616-41b2-943c-7a4616538e13"}]: dispatch 2023-09-23T08:50:31.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:31 smithi161 ceph-mon[99580]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c618d2a2-3616-41b2-943c-7a4616538e13"}]': finished 2023-09-23T08:50:31.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:31 smithi161 ceph-mon[99580]: osdmap e31: 5 total, 4 up, 5 in 2023-09-23T08:50:31.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:31 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-09-23T08:50:31.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:31 smithi161 ceph-mon[99580]: from='client.? 172.21.15.135:0/3919136580' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-23T08:50:33.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:33 smithi135 ceph-mon[99205]: pgmap v116: 1 pgs: 1 peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 102 KiB/s, 0 objects/s recovering 2023-09-23T08:50:33.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:33 smithi082 ceph-mon[97694]: pgmap v116: 1 pgs: 1 peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 102 KiB/s, 0 objects/s recovering 2023-09-23T08:50:33.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:33 smithi161 ceph-mon[99580]: pgmap v116: 1 pgs: 1 peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 102 KiB/s, 0 objects/s recovering 2023-09-23T08:50:35.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:35 smithi135 ceph-mon[99205]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 87 KiB/s, 0 objects/s recovering 2023-09-23T08:50:35.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:35 smithi082 ceph-mon[97694]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 87 KiB/s, 0 objects/s recovering 2023-09-23T08:50:35.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:35 smithi161 ceph-mon[99580]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 87 KiB/s, 0 objects/s recovering 2023-09-23T08:50:37.685 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:37 smithi135 ceph-mon[99205]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-09-23T08:50:37.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:37 smithi082 ceph-mon[97694]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-09-23T08:50:37.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:37 smithi161 ceph-mon[99580]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-09-23T08:50:38.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:38 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-09-23T08:50:38.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:38 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:50:38.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:38 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-09-23T08:50:38.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:38 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:50:38.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:38 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-09-23T08:50:38.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:38 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:50:39.600 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:39 smithi135 ceph-mon[99205]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-09-23T08:50:39.600 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:39 smithi135 ceph-mon[99205]: Deploying daemon osd.4 on smithi135 2023-09-23T08:50:39.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:39 smithi082 ceph-mon[97694]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-09-23T08:50:39.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:39 smithi082 ceph-mon[97694]: Deploying daemon osd.4 on smithi135 2023-09-23T08:50:39.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:39 smithi161 ceph-mon[99580]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-09-23T08:50:39.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:39 smithi161 ceph-mon[99580]: Deploying daemon osd.4 on smithi135 2023-09-23T08:50:41.660 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:41 smithi135 ceph-mon[99205]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-09-23T08:50:41.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:41 smithi082 ceph-mon[97694]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-09-23T08:50:41.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:41 smithi161 ceph-mon[99580]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-09-23T08:50:43.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:43 smithi135 ceph-mon[99205]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-09-23T08:50:43.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:43 smithi082 ceph-mon[97694]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-09-23T08:50:43.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:43 smithi161 ceph-mon[99580]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-09-23T08:50:45.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:45 smithi082 ceph-mon[97694]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-09-23T08:50:45.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:45 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:50:45.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:45 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:50:45.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:45 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:50:45.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:45 smithi161 ceph-mon[99580]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-09-23T08:50:45.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:45 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:50:45.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:45 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:50:45.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:45 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:50:45.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:45 smithi135 ceph-mon[99205]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-09-23T08:50:45.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:45 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:50:45.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:45 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:50:45.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:45 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:50:47.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:47 smithi082 ceph-mon[97694]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-09-23T08:50:47.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:47 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:50:47.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:47 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:50:47.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:47 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:50:47.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:47 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:50:47.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:47 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:50:47.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:47 smithi161 ceph-mon[99580]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-09-23T08:50:47.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:47 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:50:47.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:47 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:50:47.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:47 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:50:47.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:47 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:50:47.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:47 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:50:47.745 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:47 smithi135 ceph-mon[99205]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-09-23T08:50:47.745 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:47 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:50:47.745 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:47 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:50:47.745 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:47 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:50:47.745 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:47 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:50:47.745 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:47 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:50:47.780 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:50:47.776+0000 7f91bffff700 1 -- 172.21.15.135:0/1416603611 <== mgr.14152 v2:172.21.15.82:6800/3698954311 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f91d802cdf0 con 0x7f91c009ffd0 2023-09-23T08:50:47.780 INFO:teuthology.orchestra.run.smithi135.stdout:Created osd(s) 4 on host 'smithi135' 2023-09-23T08:50:47.782 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:50:47.778+0000 7f91dd387700 1 -- 172.21.15.135:0/1416603611 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f91c009ffd0 msgr2=0x7f91c00a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:50:47.782 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:50:47.778+0000 7f91dd387700 1 --2- 172.21.15.135:0/1416603611 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f91c009ffd0 0x7f91c00a2490 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f91d8101a10 tx=0x7f91c800b410 comp rx=0 tx=0).stop 2023-09-23T08:50:47.782 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:50:47.778+0000 7f91dd387700 1 -- 172.21.15.135:0/1416603611 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91d8102550 msgr2=0x7f91d8073250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:50:47.782 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:50:47.778+0000 7f91dd387700 1 --2- 172.21.15.135:0/1416603611 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91d8102550 0x7f91d8073250 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f91d000d010 tx=0x7f91d00094c0 comp rx=0 tx=0).stop 2023-09-23T08:50:47.782 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:50:47.779+0000 7f91dd387700 1 -- 172.21.15.135:0/1416603611 shutdown_connections 2023-09-23T08:50:47.783 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:50:47.779+0000 7f91dd387700 1 --2- 172.21.15.135:0/1416603611 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f91c009ffd0 0x7f91c00a2490 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:50:47.783 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:50:47.779+0000 7f91dd387700 1 --2- 172.21.15.135:0/1416603611 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91d8102550 0x7f91d8073250 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:50:47.783 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:50:47.779+0000 7f91dd387700 1 --2- 172.21.15.135:0/1416603611 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f91d81009b0 0x7f91d80746c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:50:47.783 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:50:47.779+0000 7f91dd387700 1 --2- 172.21.15.135:0/1416603611 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91d8101bb0 0x7f91d8072d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:50:47.783 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:50:47.779+0000 7f91dd387700 1 -- 172.21.15.135:0/1416603611 >> 172.21.15.135:0/1416603611 conn(0x7f91d80fbf10 msgr2=0x7f91d8105110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:50:47.783 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:50:47.779+0000 7f91dd387700 1 -- 172.21.15.135:0/1416603611 shutdown_connections 2023-09-23T08:50:47.783 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:50:47.779+0000 7f91dd387700 1 -- 172.21.15.135:0/1416603611 wait complete. 2023-09-23T08:50:48.192 DEBUG:teuthology.orchestra.run.smithi135:osd.4> sudo journalctl -f -n 0 -u ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@osd.4.service 2023-09-23T08:50:48.197 INFO:tasks.cephadm:Deploying osd.5 on smithi161 with /dev/vg_nvme/lv_3... 2023-09-23T08:50:48.197 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-09-23T08:50:48.268 INFO:journalctl@ceph.osd.4.smithi135.stdout:-- Logs begin at Sat 2023-09-23 08:29:30 UTC. -- 2023-09-23T08:50:48.562 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 23 08:50:48 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-4[109735]: 2023-09-23T08:50:48.365+0000 7f818ccd0640 -1 osd.4 0 log_to_monitors true 2023-09-23T08:50:48.947 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.c/config 2023-09-23T08:50:49.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:48 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:50:49.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:48 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:50:49.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:48 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:50:49.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:48 smithi135 ceph-mon[99205]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-09-23T08:50:49.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:48 smithi135 ceph-mon[99205]: from='osd.4 [v2:172.21.15.135:6808/2346495509,v1:172.21.15.135:6809/2346495509]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-09-23T08:50:49.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:48 smithi135 ceph-mon[99205]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-09-23T08:50:49.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:48 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:50:49.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:48 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:50:49.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:48 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:50:49.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:48 smithi082 ceph-mon[97694]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-09-23T08:50:49.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:48 smithi082 ceph-mon[97694]: from='osd.4 [v2:172.21.15.135:6808/2346495509,v1:172.21.15.135:6809/2346495509]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-09-23T08:50:49.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:48 smithi082 ceph-mon[97694]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-09-23T08:50:49.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:48 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:50:49.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:48 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:50:49.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:48 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:50:49.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:48 smithi161 ceph-mon[99580]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-09-23T08:50:49.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:48 smithi161 ceph-mon[99580]: from='osd.4 [v2:172.21.15.135:6808/2346495509,v1:172.21.15.135:6809/2346495509]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-09-23T08:50:49.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:48 smithi161 ceph-mon[99580]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-09-23T08:50:49.818 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:49 smithi161 ceph-mon[99580]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-09-23T08:50:49.818 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:49 smithi161 ceph-mon[99580]: osdmap e32: 5 total, 4 up, 5 in 2023-09-23T08:50:49.818 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:49 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-09-23T08:50:49.818 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:49 smithi161 ceph-mon[99580]: from='osd.4 [v2:172.21.15.135:6808/2346495509,v1:172.21.15.135:6809/2346495509]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2023-09-23T08:50:49.818 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:49 smithi161 ceph-mon[99580]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2023-09-23T08:50:49.937 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:49 smithi135 ceph-mon[99205]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-09-23T08:50:49.937 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:49 smithi135 ceph-mon[99205]: osdmap e32: 5 total, 4 up, 5 in 2023-09-23T08:50:49.937 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:49 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-09-23T08:50:49.937 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:49 smithi135 ceph-mon[99205]: from='osd.4 [v2:172.21.15.135:6808/2346495509,v1:172.21.15.135:6809/2346495509]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2023-09-23T08:50:49.938 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:49 smithi135 ceph-mon[99205]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2023-09-23T08:50:49.938 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 23 08:50:49 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-4[109735]: 2023-09-23T08:50:49.783+0000 7f8181b47700 -1 osd.4 0 waiting for initial osdmap 2023-09-23T08:50:49.938 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 23 08:50:49 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-4[109735]: 2023-09-23T08:50:49.790+0000 7f817d93c700 -1 osd.4 33 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-23T08:50:50.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:49 smithi082 ceph-mon[97694]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-09-23T08:50:50.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:49 smithi082 ceph-mon[97694]: osdmap e32: 5 total, 4 up, 5 in 2023-09-23T08:50:50.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:49 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-09-23T08:50:50.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:49 smithi082 ceph-mon[97694]: from='osd.4 [v2:172.21.15.135:6808/2346495509,v1:172.21.15.135:6809/2346495509]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2023-09-23T08:50:50.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:49 smithi082 ceph-mon[97694]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2023-09-23T08:50:50.944 INFO:teuthology.orchestra.run.smithi161.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-09-23T08:50:50.945 INFO:teuthology.orchestra.run.smithi161.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-09-23T08:50:50.945 INFO:teuthology.orchestra.run.smithi161.stderr: stderr: 10+0 records in 2023-09-23T08:50:50.945 INFO:teuthology.orchestra.run.smithi161.stderr:10+0 records out 2023-09-23T08:50:50.945 INFO:teuthology.orchestra.run.smithi161.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.041053 s, 255 MB/s 2023-09-23T08:50:50.945 INFO:teuthology.orchestra.run.smithi161.stderr: stderr: 2023-09-23T08:50:50.945 INFO:teuthology.orchestra.run.smithi161.stderr:--> Zapping successful for: 2023-09-23T08:50:51.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:50 smithi135 ceph-mon[99205]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2023-09-23T08:50:51.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:50 smithi135 ceph-mon[99205]: osdmap e33: 5 total, 4 up, 5 in 2023-09-23T08:50:51.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:50 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-09-23T08:50:51.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:50 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-09-23T08:50:51.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:50 smithi135 ceph-mon[99205]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-09-23T08:50:51.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:50 smithi082 ceph-mon[97694]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2023-09-23T08:50:51.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:50 smithi082 ceph-mon[97694]: osdmap e33: 5 total, 4 up, 5 in 2023-09-23T08:50:51.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:50 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-09-23T08:50:51.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:50 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-09-23T08:50:51.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:50 smithi082 ceph-mon[97694]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-09-23T08:50:51.122 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:50 smithi161 ceph-mon[99580]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2023-09-23T08:50:51.122 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:50 smithi161 ceph-mon[99580]: osdmap e33: 5 total, 4 up, 5 in 2023-09-23T08:50:51.122 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:50 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-09-23T08:50:51.122 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:50 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-09-23T08:50:51.122 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:50 smithi161 ceph-mon[99580]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-09-23T08:50:51.419 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- ceph orch daemon add osd smithi161:vg_nvme/lv_3 2023-09-23T08:50:52.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:51 smithi135 ceph-mon[99205]: purged_snaps scrub starts 2023-09-23T08:50:52.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:51 smithi135 ceph-mon[99205]: purged_snaps scrub ok 2023-09-23T08:50:52.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:51 smithi135 ceph-mon[99205]: osd.4 [v2:172.21.15.135:6808/2346495509,v1:172.21.15.135:6809/2346495509] boot 2023-09-23T08:50:52.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:51 smithi135 ceph-mon[99205]: osdmap e34: 5 total, 5 up, 5 in 2023-09-23T08:50:52.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:51 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-09-23T08:50:52.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:51 smithi135 ceph-mon[99205]: Detected new or changed devices on smithi135 2023-09-23T08:50:52.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:51 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:50:52.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:51 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:50:52.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:51 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:50:52.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:51 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:50:52.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:51 smithi135 ceph-mon[99205]: Adjusting osd_memory_target on smithi135 to 8633M 2023-09-23T08:50:52.064 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:51 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:50:52.064 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:51 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:50:52.064 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:51 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:50:52.064 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:51 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:50:52.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:51 smithi082 ceph-mon[97694]: purged_snaps scrub starts 2023-09-23T08:50:52.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:51 smithi082 ceph-mon[97694]: purged_snaps scrub ok 2023-09-23T08:50:52.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:51 smithi082 ceph-mon[97694]: osd.4 [v2:172.21.15.135:6808/2346495509,v1:172.21.15.135:6809/2346495509] boot 2023-09-23T08:50:52.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:51 smithi082 ceph-mon[97694]: osdmap e34: 5 total, 5 up, 5 in 2023-09-23T08:50:52.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:51 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-09-23T08:50:52.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:51 smithi082 ceph-mon[97694]: Detected new or changed devices on smithi135 2023-09-23T08:50:52.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:51 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:50:52.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:51 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:50:52.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:51 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:50:52.122 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:51 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:50:52.122 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:51 smithi082 ceph-mon[97694]: Adjusting osd_memory_target on smithi135 to 8633M 2023-09-23T08:50:52.122 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:51 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:50:52.122 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:51 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:50:52.122 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:51 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:50:52.122 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:51 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:50:52.141 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.c/config 2023-09-23T08:50:52.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:51 smithi161 ceph-mon[99580]: purged_snaps scrub starts 2023-09-23T08:50:52.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:51 smithi161 ceph-mon[99580]: purged_snaps scrub ok 2023-09-23T08:50:52.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:51 smithi161 ceph-mon[99580]: osd.4 [v2:172.21.15.135:6808/2346495509,v1:172.21.15.135:6809/2346495509] boot 2023-09-23T08:50:52.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:51 smithi161 ceph-mon[99580]: osdmap e34: 5 total, 5 up, 5 in 2023-09-23T08:50:52.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:51 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-09-23T08:50:52.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:51 smithi161 ceph-mon[99580]: Detected new or changed devices on smithi135 2023-09-23T08:50:52.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:51 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:50:52.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:51 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:50:52.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:51 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:50:52.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:51 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:50:52.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:51 smithi161 ceph-mon[99580]: Adjusting osd_memory_target on smithi135 to 8633M 2023-09-23T08:50:52.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:51 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:50:52.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:51 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:50:52.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:51 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:50:52.150 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:51 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:50:53.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:53 smithi082 ceph-mon[97694]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-09-23T08:50:53.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:53 smithi082 ceph-mon[97694]: osdmap e35: 5 total, 5 up, 5 in 2023-09-23T08:50:53.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:53 smithi161 ceph-mon[99580]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-09-23T08:50:53.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:53 smithi161 ceph-mon[99580]: osdmap e35: 5 total, 5 up, 5 in 2023-09-23T08:50:53.656 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:50:53.653+0000 7f838bd7b700 1 -- 172.21.15.161:0/1033158796 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8384102550 msgr2=0x7f8384108e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:50:53.656 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:50:53.653+0000 7f838bd7b700 1 --2- 172.21.15.161:0/1033158796 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8384102550 0x7f8384108e00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f837c00b0a0 tx=0x7f837c00b3b0 comp rx=0 tx=0).stop 2023-09-23T08:50:53.656 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:50:53.653+0000 7f838bd7b700 1 -- 172.21.15.161:0/1033158796 shutdown_connections 2023-09-23T08:50:53.656 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:50:53.653+0000 7f838bd7b700 1 --2- 172.21.15.161:0/1033158796 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8384102550 0x7f8384108e00 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:50:53.657 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:50:53.653+0000 7f838bd7b700 1 --2- 172.21.15.161:0/1033158796 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83841009b0 0x7f8384100dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:50:53.657 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:50:53.653+0000 7f838bd7b700 1 --2- 172.21.15.161:0/1033158796 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8384101bb0 0x7f8384102010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:50:53.657 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:50:53.653+0000 7f838bd7b700 1 -- 172.21.15.161:0/1033158796 >> 172.21.15.161:0/1033158796 conn(0x7f83840fbf10 msgr2=0x7f83840fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:50:53.657 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:50:53.653+0000 7f838bd7b700 1 -- 172.21.15.161:0/1033158796 shutdown_connections 2023-09-23T08:50:53.657 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:50:53.653+0000 7f838bd7b700 1 -- 172.21.15.161:0/1033158796 wait complete. 2023-09-23T08:50:53.659 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:50:53.654+0000 7f838bd7b700 1 Processor -- start 2023-09-23T08:50:53.659 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:50:53.655+0000 7f838bd7b700 1 -- start start 2023-09-23T08:50:53.659 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:50:53.655+0000 7f838bd7b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83841009b0 0x7f83841987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:50:53.659 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:50:53.655+0000 7f838bd7b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8384101bb0 0x7f8384198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:50:53.659 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:50:53.655+0000 7f838bd7b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8384102550 0x7f838419fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:50:53.659 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:50:53.655+0000 7f838bd7b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83841a0370 con 0x7f8384101bb0 2023-09-23T08:50:53.660 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:50:53.655+0000 7f838bd7b700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83841a04b0 con 0x7f83841009b0 2023-09-23T08:50:53.660 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:50:53.655+0000 7f838bd7b700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83841a0640 con 0x7f8384102550 2023-09-23T08:50:53.660 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:50:53.655+0000 7f838a318700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8384102550 0x7f838419fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:50:53.660 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:50:53.655+0000 7f838a318700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8384102550 0x7f838419fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:48964/0 (socket says 172.21.15.161:48964) 2023-09-23T08:50:53.660 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:50:53.655+0000 7f838a318700 1 -- 172.21.15.161:0/1424633445 learned_addr learned my addr 172.21.15.161:0/1424633445 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-09-23T08:50:53.660 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:50:53.655+0000 7f8389b17700 1 --2- 172.21.15.161:0/1424633445 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83841009b0 0x7f83841987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:50:53.660 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:50:53.655+0000 7f8389316700 1 --2- 172.21.15.161:0/1424633445 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8384101bb0 0x7f8384198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:50:53.660 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:50:53.656+0000 7f838a318700 1 -- 172.21.15.161:0/1424633445 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83841009b0 msgr2=0x7f83841987e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:50:53.660 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:50:53.656+0000 7f838a318700 1 --2- 172.21.15.161:0/1424633445 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83841009b0 0x7f83841987e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:50:53.660 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:50:53.656+0000 7f838a318700 1 -- 172.21.15.161:0/1424633445 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8384101bb0 msgr2=0x7f8384198d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:50:53.660 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:50:53.656+0000 7f838a318700 1 --2- 172.21.15.161:0/1424633445 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8384101bb0 0x7f8384198d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:50:53.661 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:50:53.656+0000 7f838a318700 1 -- 172.21.15.161:0/1424633445 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f837c009d00 con 0x7f8384102550 2023-09-23T08:50:53.661 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:50:53.656+0000 7f8389316700 1 --2- 172.21.15.161:0/1424633445 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8384101bb0 0x7f8384198d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T08:50:53.661 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:50:53.656+0000 7f838a318700 1 --2- 172.21.15.161:0/1424633445 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8384102550 0x7f838419fda0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f837c0079f0 tx=0x7f837c00bd60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:50:53.661 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:50:53.656+0000 7f837affd700 1 -- 172.21.15.161:0/1424633445 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837c00e040 con 0x7f8384102550 2023-09-23T08:50:53.661 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:50:53.656+0000 7f837affd700 1 -- 172.21.15.161:0/1424633445 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f837c004e60 con 0x7f8384102550 2023-09-23T08:50:53.661 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:50:53.656+0000 7f837affd700 1 -- 172.21.15.161:0/1424633445 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837c0052a0 con 0x7f8384102550 2023-09-23T08:50:53.661 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:50:53.656+0000 7f838bd7b700 1 -- 172.21.15.161:0/1424633445 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83841a08c0 con 0x7f8384102550 2023-09-23T08:50:53.661 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:50:53.656+0000 7f838bd7b700 1 -- 172.21.15.161:0/1424633445 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83841a0ce0 con 0x7f8384102550 2023-09-23T08:50:53.661 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:50:53.657+0000 7f838bd7b700 1 -- 172.21.15.161:0/1424633445 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f838410c020 con 0x7f8384102550 2023-09-23T08:50:53.662 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:50:53.659+0000 7f837affd700 1 -- 172.21.15.161:0/1424633445 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 16) v1 ==== 134671+0+0 (secure 0 0 0) 0x7f837c01d470 con 0x7f8384102550 2023-09-23T08:50:53.663 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:50:53.660+0000 7f837affd700 1 --2- 172.21.15.161:0/1424633445 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f837009ffd0 0x7f83700a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:50:53.663 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:50:53.661+0000 7f837affd700 1 -- 172.21.15.161:0/1424633445 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4101+0+0 (secure 0 0 0) 0x7f837c0cbb60 con 0x7f8384102550 2023-09-23T08:50:53.664 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:50:53.661+0000 7f8389b17700 1 --2- 172.21.15.161:0/1424633445 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f837009ffd0 0x7f83700a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:50:53.664 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:50:53.662+0000 7f8389b17700 1 --2- 172.21.15.161:0/1424633445 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f837009ffd0 0x7f83700a2490 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8384101a10 tx=0x7f8380009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:50:53.666 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:50:53.664+0000 7f837affd700 1 -- 172.21.15.161:0/1424633445 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f837c096a70 con 0x7f8384102550 2023-09-23T08:50:53.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:53 smithi135 ceph-mon[99205]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-09-23T08:50:53.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:53 smithi135 ceph-mon[99205]: osdmap e35: 5 total, 5 up, 5 in 2023-09-23T08:50:53.874 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:50:53.871+0000 7f838bd7b700 1 -- 172.21.15.161:0/1424633445 --> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi161:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f83841084f0 con 0x7f837009ffd0 2023-09-23T08:50:54.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:54 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-23T08:50:54.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:54 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-23T08:50:54.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:54 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:50:54.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:54 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-23T08:50:54.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:54 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-23T08:50:54.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:54 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:50:54.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:54 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-23T08:50:54.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:54 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-23T08:50:54.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:54 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:50:55.609 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:55 smithi161 ceph-mon[99580]: from='client.24250 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi161:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:50:55.609 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:55 smithi161 ceph-mon[99580]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-09-23T08:50:55.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:55 smithi082 ceph-mon[97694]: from='client.24250 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi161:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:50:55.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:55 smithi082 ceph-mon[97694]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-09-23T08:50:55.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:55 smithi135 ceph-mon[99205]: from='client.24250 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi161:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:50:55.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:55 smithi135 ceph-mon[99205]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-09-23T08:50:57.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:57 smithi082 ceph-mon[97694]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-09-23T08:50:57.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:57 smithi082 ceph-mon[97694]: from='client.? 172.21.15.161:0/4229494385' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8e1dda3d-6927-495d-b20d-78b03bb75d5e"}]: dispatch 2023-09-23T08:50:57.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:57 smithi082 ceph-mon[97694]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8e1dda3d-6927-495d-b20d-78b03bb75d5e"}]: dispatch 2023-09-23T08:50:57.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:57 smithi082 ceph-mon[97694]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8e1dda3d-6927-495d-b20d-78b03bb75d5e"}]': finished 2023-09-23T08:50:57.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:57 smithi082 ceph-mon[97694]: osdmap e36: 6 total, 5 up, 6 in 2023-09-23T08:50:57.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:57 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-09-23T08:50:57.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:57 smithi161 ceph-mon[99580]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-09-23T08:50:57.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:57 smithi161 ceph-mon[99580]: from='client.? 172.21.15.161:0/4229494385' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8e1dda3d-6927-495d-b20d-78b03bb75d5e"}]: dispatch 2023-09-23T08:50:57.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:57 smithi161 ceph-mon[99580]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8e1dda3d-6927-495d-b20d-78b03bb75d5e"}]: dispatch 2023-09-23T08:50:57.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:57 smithi161 ceph-mon[99580]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8e1dda3d-6927-495d-b20d-78b03bb75d5e"}]': finished 2023-09-23T08:50:57.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:57 smithi161 ceph-mon[99580]: osdmap e36: 6 total, 5 up, 6 in 2023-09-23T08:50:57.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:57 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-09-23T08:50:57.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:57 smithi135 ceph-mon[99205]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-09-23T08:50:57.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:57 smithi135 ceph-mon[99205]: from='client.? 172.21.15.161:0/4229494385' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8e1dda3d-6927-495d-b20d-78b03bb75d5e"}]: dispatch 2023-09-23T08:50:57.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:57 smithi135 ceph-mon[99205]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8e1dda3d-6927-495d-b20d-78b03bb75d5e"}]: dispatch 2023-09-23T08:50:57.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:57 smithi135 ceph-mon[99205]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8e1dda3d-6927-495d-b20d-78b03bb75d5e"}]': finished 2023-09-23T08:50:57.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:57 smithi135 ceph-mon[99205]: osdmap e36: 6 total, 5 up, 6 in 2023-09-23T08:50:57.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:57 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-09-23T08:50:58.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:58 smithi082 ceph-mon[97694]: from='client.? 172.21.15.161:0/655784045' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-23T08:50:58.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:58 smithi161 ceph-mon[99580]: from='client.? 172.21.15.161:0/655784045' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-23T08:50:58.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:58 smithi135 ceph-mon[99205]: from='client.? 172.21.15.161:0/655784045' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-23T08:50:59.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:50:59 smithi161 ceph-mon[99580]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-09-23T08:50:59.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:50:59 smithi135 ceph-mon[99205]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-09-23T08:50:59.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:50:59 smithi082 ceph-mon[97694]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-09-23T08:51:01.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:01 smithi161 ceph-mon[99580]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-09-23T08:51:01.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:01 smithi135 ceph-mon[99205]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-09-23T08:51:01.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:01 smithi082 ceph-mon[97694]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-09-23T08:51:03.564 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:03 smithi161 ceph-mon[99580]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-09-23T08:51:03.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:03 smithi135 ceph-mon[99205]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-09-23T08:51:03.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:03 smithi082 ceph-mon[97694]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-09-23T08:51:05.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:05 smithi161 ceph-mon[99580]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-09-23T08:51:05.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:05 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-09-23T08:51:05.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:05 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:51:05.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:05 smithi135 ceph-mon[99205]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-09-23T08:51:05.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:05 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-09-23T08:51:05.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:05 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:51:05.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:05 smithi082 ceph-mon[97694]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-09-23T08:51:05.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:05 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-09-23T08:51:05.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:05 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:51:06.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:06 smithi161 ceph-mon[99580]: Deploying daemon osd.5 on smithi161 2023-09-23T08:51:06.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:06 smithi135 ceph-mon[99205]: Deploying daemon osd.5 on smithi161 2023-09-23T08:51:06.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:06 smithi082 ceph-mon[97694]: Deploying daemon osd.5 on smithi161 2023-09-23T08:51:07.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:07 smithi161 ceph-mon[99580]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-09-23T08:51:07.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:07 smithi135 ceph-mon[99205]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-09-23T08:51:07.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:07 smithi082 ceph-mon[97694]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-09-23T08:51:09.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:09 smithi161 ceph-mon[99580]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-09-23T08:51:09.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:09 smithi135 ceph-mon[99205]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-09-23T08:51:09.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:09 smithi082 ceph-mon[97694]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-09-23T08:51:11.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:11 smithi161 ceph-mon[99580]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-09-23T08:51:11.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:11 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:51:11.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:11 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:51:11.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:11 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:51:11.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:11 smithi135 ceph-mon[99205]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-09-23T08:51:11.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:11 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:51:11.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:11 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:51:11.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:11 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:51:11.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:11 smithi082 ceph-mon[97694]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-09-23T08:51:11.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:11 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:51:11.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:11 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:51:11.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:11 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:51:13.682 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:13 smithi161 ceph-mon[99580]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-09-23T08:51:13.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:13 smithi135 ceph-mon[99205]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-09-23T08:51:13.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:13 smithi082 ceph-mon[97694]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-09-23T08:51:14.248 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:51:14.244+0000 7f837affd700 1 -- 172.21.15.161:0/1424633445 <== mgr.14152 v2:172.21.15.82:6800/3698954311 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f83841084f0 con 0x7f837009ffd0 2023-09-23T08:51:14.248 INFO:teuthology.orchestra.run.smithi161.stdout:Created osd(s) 5 on host 'smithi161' 2023-09-23T08:51:14.250 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:51:14.247+0000 7f838bd7b700 1 -- 172.21.15.161:0/1424633445 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f837009ffd0 msgr2=0x7f83700a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:51:14.250 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:51:14.247+0000 7f838bd7b700 1 --2- 172.21.15.161:0/1424633445 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f837009ffd0 0x7f83700a2490 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8384101a10 tx=0x7f8380009260 comp rx=0 tx=0).stop 2023-09-23T08:51:14.250 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:51:14.247+0000 7f838bd7b700 1 -- 172.21.15.161:0/1424633445 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8384102550 msgr2=0x7f838419fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:51:14.251 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:51:14.247+0000 7f838bd7b700 1 --2- 172.21.15.161:0/1424633445 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8384102550 0x7f838419fda0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f837c0079f0 tx=0x7f837c00bd60 comp rx=0 tx=0).stop 2023-09-23T08:51:14.251 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:51:14.247+0000 7f838bd7b700 1 -- 172.21.15.161:0/1424633445 shutdown_connections 2023-09-23T08:51:14.251 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:51:14.247+0000 7f838bd7b700 1 --2- 172.21.15.161:0/1424633445 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f837009ffd0 0x7f83700a2490 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:51:14.251 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:51:14.247+0000 7f838bd7b700 1 --2- 172.21.15.161:0/1424633445 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8384102550 0x7f838419fda0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:51:14.251 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:51:14.247+0000 7f838bd7b700 1 --2- 172.21.15.161:0/1424633445 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83841009b0 0x7f83841987e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:51:14.251 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:51:14.247+0000 7f838bd7b700 1 --2- 172.21.15.161:0/1424633445 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8384101bb0 0x7f8384198d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:51:14.251 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:51:14.247+0000 7f838bd7b700 1 -- 172.21.15.161:0/1424633445 >> 172.21.15.161:0/1424633445 conn(0x7f83840fbf10 msgr2=0x7f83840fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:51:14.251 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:51:14.248+0000 7f838bd7b700 1 -- 172.21.15.161:0/1424633445 shutdown_connections 2023-09-23T08:51:14.251 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:51:14.248+0000 7f838bd7b700 1 -- 172.21.15.161:0/1424633445 wait complete. 2023-09-23T08:51:14.767 DEBUG:teuthology.orchestra.run.smithi161:osd.5> sudo journalctl -f -n 0 -u ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@osd.5.service 2023-09-23T08:51:14.773 INFO:tasks.cephadm:Deploying osd.6 on smithi082 with /dev/vg_nvme/lv_2... 2023-09-23T08:51:14.773 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-09-23T08:51:14.856 INFO:journalctl@ceph.osd.5.smithi161.stdout:-- Logs begin at Sat 2023-09-23 08:29:48 UTC. -- 2023-09-23T08:51:15.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:14 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:51:15.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:14 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:51:15.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:14 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:51:15.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:14 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:51:15.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:14 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:51:15.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:14 smithi135 ceph-mon[99205]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-09-23T08:51:15.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:14 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:51:15.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:14 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:51:15.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:14 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:51:15.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:14 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:51:15.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:14 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:51:15.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:14 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:51:15.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:14 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:51:15.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:14 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:51:15.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:14 smithi082 ceph-mon[97694]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-09-23T08:51:15.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:14 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:51:15.122 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:14 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:51:15.122 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:14 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:51:15.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:14 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:51:15.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:14 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:51:15.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:14 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:51:15.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:14 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:51:15.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:14 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:51:15.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:14 smithi161 ceph-mon[99580]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-09-23T08:51:15.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:14 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:51:15.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:14 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:51:15.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:14 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:51:15.524 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.a/config 2023-09-23T08:51:16.014 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:15 smithi161 ceph-mon[99580]: from='osd.5 [v2:172.21.15.161:6808/1252638628,v1:172.21.15.161:6809/1252638628]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-09-23T08:51:16.014 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:15 smithi161 ceph-mon[99580]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-09-23T08:51:16.046 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:15 smithi082 ceph-mon[97694]: from='osd.5 [v2:172.21.15.161:6808/1252638628,v1:172.21.15.161:6809/1252638628]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-09-23T08:51:16.046 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:15 smithi082 ceph-mon[97694]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-09-23T08:51:16.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:15 smithi135 ceph-mon[99205]: from='osd.5 [v2:172.21.15.161:6808/1252638628,v1:172.21.15.161:6809/1252638628]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-09-23T08:51:16.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:15 smithi135 ceph-mon[99205]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-09-23T08:51:17.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:16 smithi135 ceph-mon[99205]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-09-23T08:51:17.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:16 smithi135 ceph-mon[99205]: osdmap e37: 6 total, 5 up, 6 in 2023-09-23T08:51:17.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:16 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-09-23T08:51:17.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:16 smithi135 ceph-mon[99205]: from='osd.5 [v2:172.21.15.161:6808/1252638628,v1:172.21.15.161:6809/1252638628]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2023-09-23T08:51:17.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:16 smithi135 ceph-mon[99205]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2023-09-23T08:51:17.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:16 smithi135 ceph-mon[99205]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-09-23T08:51:17.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:16 smithi082 ceph-mon[97694]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-09-23T08:51:17.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:16 smithi082 ceph-mon[97694]: osdmap e37: 6 total, 5 up, 6 in 2023-09-23T08:51:17.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:16 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-09-23T08:51:17.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:16 smithi082 ceph-mon[97694]: from='osd.5 [v2:172.21.15.161:6808/1252638628,v1:172.21.15.161:6809/1252638628]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2023-09-23T08:51:17.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:16 smithi082 ceph-mon[97694]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2023-09-23T08:51:17.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:16 smithi082 ceph-mon[97694]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-09-23T08:51:17.137 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 23 08:51:16 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-5[110963]: 2023-09-23T08:51:16.709+0000 7f122acc8700 -1 osd.5 0 waiting for initial osdmap 2023-09-23T08:51:17.137 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 23 08:51:16 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-5[110963]: 2023-09-23T08:51:16.723+0000 7f12232b6700 -1 osd.5 38 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-23T08:51:17.137 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:16 smithi161 ceph-mon[99580]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-09-23T08:51:17.137 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:16 smithi161 ceph-mon[99580]: osdmap e37: 6 total, 5 up, 6 in 2023-09-23T08:51:17.137 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:16 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-09-23T08:51:17.137 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:16 smithi161 ceph-mon[99580]: from='osd.5 [v2:172.21.15.161:6808/1252638628,v1:172.21.15.161:6809/1252638628]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2023-09-23T08:51:17.137 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:16 smithi161 ceph-mon[99580]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2023-09-23T08:51:17.138 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:16 smithi161 ceph-mon[99580]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-09-23T08:51:17.372 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-09-23T08:51:17.372 INFO:teuthology.orchestra.run.smithi082.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-09-23T08:51:17.372 INFO:teuthology.orchestra.run.smithi082.stderr: stderr: 10+0 records in 2023-09-23T08:51:17.372 INFO:teuthology.orchestra.run.smithi082.stderr:10+0 records out 2023-09-23T08:51:17.372 INFO:teuthology.orchestra.run.smithi082.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0296655 s, 353 MB/s 2023-09-23T08:51:17.372 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping successful for: 2023-09-23T08:51:17.801 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- ceph orch daemon add osd smithi082:vg_nvme/lv_2 2023-09-23T08:51:18.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:17 smithi135 ceph-mon[99205]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]': finished 2023-09-23T08:51:18.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:17 smithi135 ceph-mon[99205]: osdmap e38: 6 total, 5 up, 6 in 2023-09-23T08:51:18.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:17 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-09-23T08:51:18.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:17 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-09-23T08:51:18.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:17 smithi082 ceph-mon[97694]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]': finished 2023-09-23T08:51:18.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:17 smithi082 ceph-mon[97694]: osdmap e38: 6 total, 5 up, 6 in 2023-09-23T08:51:18.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:17 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-09-23T08:51:18.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:17 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-09-23T08:51:18.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:17 smithi161 ceph-mon[99580]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]': finished 2023-09-23T08:51:18.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:17 smithi161 ceph-mon[99580]: osdmap e38: 6 total, 5 up, 6 in 2023-09-23T08:51:18.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:17 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-09-23T08:51:18.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:17 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-09-23T08:51:18.529 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.a/config 2023-09-23T08:51:19.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:18 smithi135 ceph-mon[99205]: purged_snaps scrub starts 2023-09-23T08:51:19.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:18 smithi135 ceph-mon[99205]: purged_snaps scrub ok 2023-09-23T08:51:19.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:18 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-09-23T08:51:19.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:18 smithi135 ceph-mon[99205]: osd.5 [v2:172.21.15.161:6808/1252638628,v1:172.21.15.161:6809/1252638628] boot 2023-09-23T08:51:19.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:18 smithi135 ceph-mon[99205]: osdmap e39: 6 total, 6 up, 6 in 2023-09-23T08:51:19.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:18 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-09-23T08:51:19.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:18 smithi135 ceph-mon[99205]: Detected new or changed devices on smithi161 2023-09-23T08:51:19.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:18 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:51:19.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:18 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:51:19.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:18 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:51:19.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:18 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:51:19.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:18 smithi135 ceph-mon[99205]: Adjusting osd_memory_target on smithi161 to 8633M 2023-09-23T08:51:19.064 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:18 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:51:19.064 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:18 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:51:19.064 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:18 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:51:19.064 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:18 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:51:19.064 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:18 smithi135 ceph-mon[99205]: pgmap v147: 1 pgs: 1 peering; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-09-23T08:51:19.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:18 smithi082 ceph-mon[97694]: purged_snaps scrub starts 2023-09-23T08:51:19.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:18 smithi082 ceph-mon[97694]: purged_snaps scrub ok 2023-09-23T08:51:19.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:18 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-09-23T08:51:19.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:18 smithi082 ceph-mon[97694]: osd.5 [v2:172.21.15.161:6808/1252638628,v1:172.21.15.161:6809/1252638628] boot 2023-09-23T08:51:19.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:18 smithi082 ceph-mon[97694]: osdmap e39: 6 total, 6 up, 6 in 2023-09-23T08:51:19.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:18 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-09-23T08:51:19.122 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:18 smithi082 ceph-mon[97694]: Detected new or changed devices on smithi161 2023-09-23T08:51:19.122 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:18 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:51:19.122 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:18 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:51:19.122 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:18 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:51:19.122 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:18 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:51:19.122 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:18 smithi082 ceph-mon[97694]: Adjusting osd_memory_target on smithi161 to 8633M 2023-09-23T08:51:19.122 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:18 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:51:19.122 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:18 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:51:19.122 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:18 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:51:19.122 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:18 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:51:19.122 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:18 smithi082 ceph-mon[97694]: pgmap v147: 1 pgs: 1 peering; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-09-23T08:51:19.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:18 smithi161 ceph-mon[99580]: purged_snaps scrub starts 2023-09-23T08:51:19.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:18 smithi161 ceph-mon[99580]: purged_snaps scrub ok 2023-09-23T08:51:19.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:18 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-09-23T08:51:19.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:18 smithi161 ceph-mon[99580]: osd.5 [v2:172.21.15.161:6808/1252638628,v1:172.21.15.161:6809/1252638628] boot 2023-09-23T08:51:19.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:18 smithi161 ceph-mon[99580]: osdmap e39: 6 total, 6 up, 6 in 2023-09-23T08:51:19.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:18 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-09-23T08:51:19.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:18 smithi161 ceph-mon[99580]: Detected new or changed devices on smithi161 2023-09-23T08:51:19.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:18 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:51:19.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:18 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:51:19.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:18 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:51:19.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:18 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:51:19.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:18 smithi161 ceph-mon[99580]: Adjusting osd_memory_target on smithi161 to 8633M 2023-09-23T08:51:19.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:18 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:51:19.150 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:18 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:51:19.150 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:18 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:51:19.150 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:18 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:51:19.150 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:18 smithi161 ceph-mon[99580]: pgmap v147: 1 pgs: 1 peering; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-09-23T08:51:20.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:51:20.020+0000 7f08b2f2e700 1 -- 172.21.15.82:0/3746110097 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08ac1009b0 msgr2=0x7f08ac100dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:51:20.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:51:20.020+0000 7f08b2f2e700 1 --2- 172.21.15.82:0/3746110097 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08ac1009b0 0x7f08ac100dd0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f08a00099c0 tx=0x7f08a0009cd0 comp rx=0 tx=0).stop 2023-09-23T08:51:20.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:51:20.020+0000 7f08b2f2e700 1 -- 172.21.15.82:0/3746110097 shutdown_connections 2023-09-23T08:51:20.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:51:20.020+0000 7f08b2f2e700 1 --2- 172.21.15.82:0/3746110097 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08ac102550 0x7f08ac108e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:51:20.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:51:20.020+0000 7f08b2f2e700 1 --2- 172.21.15.82:0/3746110097 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08ac1009b0 0x7f08ac100dd0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:51:20.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:51:20.020+0000 7f08b2f2e700 1 --2- 172.21.15.82:0/3746110097 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08ac101bb0 0x7f08ac102010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:51:20.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:51:20.020+0000 7f08b2f2e700 1 -- 172.21.15.82:0/3746110097 >> 172.21.15.82:0/3746110097 conn(0x7f08ac0fbf10 msgr2=0x7f08ac0fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:51:20.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:51:20.021+0000 7f08b2f2e700 1 -- 172.21.15.82:0/3746110097 shutdown_connections 2023-09-23T08:51:20.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:51:20.021+0000 7f08b2f2e700 1 -- 172.21.15.82:0/3746110097 wait complete. 2023-09-23T08:51:20.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:51:20.022+0000 7f08b2f2e700 1 Processor -- start 2023-09-23T08:51:20.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:51:20.022+0000 7f08b2f2e700 1 -- start start 2023-09-23T08:51:20.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:51:20.022+0000 7f08b2f2e700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08ac1009b0 0x7f08ac198790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:51:20.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:51:20.022+0000 7f08b2f2e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08ac101bb0 0x7f08ac198cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:51:20.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:51:20.022+0000 7f08b2f2e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08ac102550 0x7f08ac19fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:51:20.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:51:20.022+0000 7f08b2f2e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08ac1a0320 con 0x7f08ac102550 2023-09-23T08:51:20.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:51:20.022+0000 7f08b2f2e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08ac1a0460 con 0x7f08ac101bb0 2023-09-23T08:51:20.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:51:20.022+0000 7f08b2f2e700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08ac1a05f0 con 0x7f08ac1009b0 2023-09-23T08:51:20.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:51:20.022+0000 7f08b14cb700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08ac102550 0x7f08ac19fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:51:20.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:51:20.022+0000 7f08b14cb700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08ac102550 0x7f08ac19fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40220/0 (socket says 172.21.15.82:40220) 2023-09-23T08:51:20.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:51:20.022+0000 7f08b14cb700 1 -- 172.21.15.82:0/3194752036 learned_addr learned my addr 172.21.15.82:0/3194752036 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:51:20.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:51:20.022+0000 7f08abfff700 1 --2- 172.21.15.82:0/3194752036 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08ac101bb0 0x7f08ac198cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:51:20.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:51:20.023+0000 7f08b0cca700 1 --2- 172.21.15.82:0/3194752036 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08ac1009b0 0x7f08ac198790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:51:20.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:51:20.023+0000 7f08b14cb700 1 -- 172.21.15.82:0/3194752036 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08ac1009b0 msgr2=0x7f08ac198790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:51:20.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:51:20.023+0000 7f08b14cb700 1 --2- 172.21.15.82:0/3194752036 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08ac1009b0 0x7f08ac198790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:51:20.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:51:20.023+0000 7f08b14cb700 1 -- 172.21.15.82:0/3194752036 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08ac101bb0 msgr2=0x7f08ac198cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:51:20.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:51:20.023+0000 7f08b14cb700 1 --2- 172.21.15.82:0/3194752036 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08ac101bb0 0x7f08ac198cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:51:20.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:51:20.023+0000 7f08b14cb700 1 -- 172.21.15.82:0/3194752036 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08a00095f0 con 0x7f08ac102550 2023-09-23T08:51:20.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:51:20.023+0000 7f08b14cb700 1 --2- 172.21.15.82:0/3194752036 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08ac102550 0x7f08ac19fd50 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f08a4007da0 tx=0x7f08a400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:51:20.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:51:20.023+0000 7f08a9ffb700 1 -- 172.21.15.82:0/3194752036 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a400ad00 con 0x7f08ac102550 2023-09-23T08:51:20.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:51:20.023+0000 7f08a9ffb700 1 -- 172.21.15.82:0/3194752036 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f08a400ae60 con 0x7f08ac102550 2023-09-23T08:51:20.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:51:20.023+0000 7f08b2f2e700 1 -- 172.21.15.82:0/3194752036 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08ac1a08d0 con 0x7f08ac102550 2023-09-23T08:51:20.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:51:20.023+0000 7f08a9ffb700 1 -- 172.21.15.82:0/3194752036 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a40115e0 con 0x7f08ac102550 2023-09-23T08:51:20.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:51:20.023+0000 7f08b2f2e700 1 -- 172.21.15.82:0/3194752036 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08ac1a0dd0 con 0x7f08ac102550 2023-09-23T08:51:20.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:51:20.025+0000 7f08b2f2e700 1 -- 172.21.15.82:0/3194752036 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08ac192ea0 con 0x7f08ac102550 2023-09-23T08:51:20.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:51:20.027+0000 7f08a9ffb700 1 -- 172.21.15.82:0/3194752036 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 134671+0+0 (secure 0 0 0) 0x7f08a4012420 con 0x7f08ac102550 2023-09-23T08:51:20.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:51:20.028+0000 7f08a9ffb700 1 --2- 172.21.15.82:0/3194752036 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f089c09ffd0 0x7f089c0a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:51:20.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:51:20.028+0000 7f08a9ffb700 1 -- 172.21.15.82:0/3194752036 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4562+0+0 (secure 0 0 0) 0x7f08a40caa20 con 0x7f08ac102550 2023-09-23T08:51:20.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:51:20.028+0000 7f08b0cca700 1 --2- 172.21.15.82:0/3194752036 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f089c09ffd0 0x7f089c0a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:51:20.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:51:20.029+0000 7f08b0cca700 1 --2- 172.21.15.82:0/3194752036 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f089c09ffd0 0x7f089c0a2490 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f08a0006010 tx=0x7f08a000bfb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:51:20.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:51:20.031+0000 7f08a9ffb700 1 -- 172.21.15.82:0/3194752036 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f08a40955b0 con 0x7f08ac102550 2023-09-23T08:51:20.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:19 smithi135 ceph-mon[99205]: osdmap e40: 6 total, 6 up, 6 in 2023-09-23T08:51:20.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:19 smithi082 ceph-mon[97694]: osdmap e40: 6 total, 6 up, 6 in 2023-09-23T08:51:20.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:19 smithi161 ceph-mon[99580]: osdmap e40: 6 total, 6 up, 6 in 2023-09-23T08:51:20.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:51:20.238+0000 7f08b2f2e700 1 -- 172.21.15.82:0/3194752036 --> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f08ac02cdf0 con 0x7f089c09ffd0 2023-09-23T08:51:21.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:20 smithi135 ceph-mon[99205]: osdmap e41: 6 total, 6 up, 6 in 2023-09-23T08:51:21.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:20 smithi135 ceph-mon[99205]: pgmap v150: 1 pgs: 1 peering; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-09-23T08:51:21.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:20 smithi135 ceph-mon[99205]: from='client.14364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:51:21.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:20 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-23T08:51:21.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:20 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-23T08:51:21.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:20 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:51:21.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:20 smithi082 ceph-mon[97694]: osdmap e41: 6 total, 6 up, 6 in 2023-09-23T08:51:21.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:20 smithi082 ceph-mon[97694]: pgmap v150: 1 pgs: 1 peering; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-09-23T08:51:21.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:20 smithi082 ceph-mon[97694]: from='client.14364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:51:21.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:20 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-23T08:51:21.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:20 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-23T08:51:21.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:20 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:51:21.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:20 smithi161 ceph-mon[99580]: osdmap e41: 6 total, 6 up, 6 in 2023-09-23T08:51:21.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:20 smithi161 ceph-mon[99580]: pgmap v150: 1 pgs: 1 peering; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-09-23T08:51:21.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:20 smithi161 ceph-mon[99580]: from='client.14364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:51:21.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:20 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-23T08:51:21.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:20 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-23T08:51:21.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:20 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:51:21.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:21 smithi082 ceph-mon[97694]: osdmap e42: 6 total, 6 up, 6 in 2023-09-23T08:51:22.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:21 smithi135 ceph-mon[99205]: osdmap e42: 6 total, 6 up, 6 in 2023-09-23T08:51:22.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:21 smithi161 ceph-mon[99580]: osdmap e42: 6 total, 6 up, 6 in 2023-09-23T08:51:23.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:22 smithi135 ceph-mon[99205]: osdmap e43: 6 total, 6 up, 6 in 2023-09-23T08:51:23.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:22 smithi135 ceph-mon[99205]: pgmap v153: 1 pgs: 1 peering; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-09-23T08:51:23.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:22 smithi082 ceph-mon[97694]: osdmap e43: 6 total, 6 up, 6 in 2023-09-23T08:51:23.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:22 smithi082 ceph-mon[97694]: pgmap v153: 1 pgs: 1 peering; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-09-23T08:51:23.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:22 smithi161 ceph-mon[99580]: osdmap e43: 6 total, 6 up, 6 in 2023-09-23T08:51:23.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:22 smithi161 ceph-mon[99580]: pgmap v153: 1 pgs: 1 peering; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-09-23T08:51:24.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:23 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/1283325001' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "50b31960-6bc4-44e1-8116-3106bf161e56"}]: dispatch 2023-09-23T08:51:24.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:23 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/1283325001' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "50b31960-6bc4-44e1-8116-3106bf161e56"}]': finished 2023-09-23T08:51:24.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:23 smithi135 ceph-mon[99205]: osdmap e44: 7 total, 6 up, 7 in 2023-09-23T08:51:24.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:23 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-09-23T08:51:24.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:23 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/1283325001' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "50b31960-6bc4-44e1-8116-3106bf161e56"}]: dispatch 2023-09-23T08:51:24.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:23 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/1283325001' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "50b31960-6bc4-44e1-8116-3106bf161e56"}]': finished 2023-09-23T08:51:24.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:23 smithi082 ceph-mon[97694]: osdmap e44: 7 total, 6 up, 7 in 2023-09-23T08:51:24.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:23 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-09-23T08:51:24.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:23 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/1283325001' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "50b31960-6bc4-44e1-8116-3106bf161e56"}]: dispatch 2023-09-23T08:51:24.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:23 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/1283325001' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "50b31960-6bc4-44e1-8116-3106bf161e56"}]': finished 2023-09-23T08:51:24.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:23 smithi161 ceph-mon[99580]: osdmap e44: 7 total, 6 up, 7 in 2023-09-23T08:51:24.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:23 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-09-23T08:51:25.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:24 smithi135 ceph-mon[99205]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 135 KiB/s, 0 objects/s recovering 2023-09-23T08:51:25.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:24 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/1158801112' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-23T08:51:25.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:24 smithi082 ceph-mon[97694]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 135 KiB/s, 0 objects/s recovering 2023-09-23T08:51:25.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:24 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/1158801112' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-23T08:51:25.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:24 smithi161 ceph-mon[99580]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 135 KiB/s, 0 objects/s recovering 2023-09-23T08:51:25.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:24 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/1158801112' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-23T08:51:27.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:27 smithi082 ceph-mon[97694]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-09-23T08:51:27.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:27 smithi161 ceph-mon[99580]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-09-23T08:51:27.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:27 smithi135 ceph-mon[99205]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-09-23T08:51:29.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:29 smithi082 ceph-mon[97694]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 79 KiB/s, 0 objects/s recovering 2023-09-23T08:51:29.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:29 smithi161 ceph-mon[99580]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 79 KiB/s, 0 objects/s recovering 2023-09-23T08:51:29.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:29 smithi135 ceph-mon[99205]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 79 KiB/s, 0 objects/s recovering 2023-09-23T08:51:31.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:31 smithi082 ceph-mon[97694]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 70 KiB/s, 0 objects/s recovering 2023-09-23T08:51:31.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:31 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-09-23T08:51:31.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:31 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:51:31.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:31 smithi161 ceph-mon[99580]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 70 KiB/s, 0 objects/s recovering 2023-09-23T08:51:31.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:31 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-09-23T08:51:31.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:31 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:51:31.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:31 smithi135 ceph-mon[99205]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 70 KiB/s, 0 objects/s recovering 2023-09-23T08:51:31.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:31 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-09-23T08:51:31.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:31 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:51:32.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:32 smithi082 ceph-mon[97694]: Deploying daemon osd.6 on smithi082 2023-09-23T08:51:32.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:32 smithi161 ceph-mon[99580]: Deploying daemon osd.6 on smithi082 2023-09-23T08:51:32.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:32 smithi135 ceph-mon[99205]: Deploying daemon osd.6 on smithi082 2023-09-23T08:51:33.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:33 smithi082 ceph-mon[97694]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-09-23T08:51:33.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:33 smithi161 ceph-mon[99580]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-09-23T08:51:33.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:33 smithi135 ceph-mon[99205]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-09-23T08:51:35.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:35 smithi082 ceph-mon[97694]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-09-23T08:51:35.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:35 smithi161 ceph-mon[99580]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-09-23T08:51:35.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:35 smithi135 ceph-mon[99205]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-09-23T08:51:37.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:37 smithi082 ceph-mon[97694]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-09-23T08:51:37.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:37 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:51:37.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:37 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:51:37.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:37 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:51:37.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:37 smithi161 ceph-mon[99580]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-09-23T08:51:37.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:37 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:51:37.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:37 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:51:37.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:37 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:51:37.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:37 smithi135 ceph-mon[99205]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-09-23T08:51:37.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:37 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:51:37.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:37 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:51:37.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:37 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:51:39.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:39 smithi082 ceph-mon[97694]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-09-23T08:51:39.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:39 smithi161 ceph-mon[99580]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-09-23T08:51:39.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:39 smithi135 ceph-mon[99205]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-09-23T08:51:40.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:51:40.252+0000 7f08a9ffb700 1 -- 172.21.15.82:0/3194752036 <== mgr.14152 v2:172.21.15.82:6800/3698954311 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f08ac02cdf0 con 0x7f089c09ffd0 2023-09-23T08:51:40.257 INFO:teuthology.orchestra.run.smithi082.stdout:Created osd(s) 6 on host 'smithi082' 2023-09-23T08:51:40.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:51:40.255+0000 7f08b2f2e700 1 -- 172.21.15.82:0/3194752036 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f089c09ffd0 msgr2=0x7f089c0a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:51:40.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:51:40.255+0000 7f08b2f2e700 1 --2- 172.21.15.82:0/3194752036 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f089c09ffd0 0x7f089c0a2490 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f08a0006010 tx=0x7f08a000bfb0 comp rx=0 tx=0).stop 2023-09-23T08:51:40.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:51:40.255+0000 7f08b2f2e700 1 -- 172.21.15.82:0/3194752036 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08ac102550 msgr2=0x7f08ac19fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:51:40.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:51:40.255+0000 7f08b2f2e700 1 --2- 172.21.15.82:0/3194752036 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08ac102550 0x7f08ac19fd50 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f08a4007da0 tx=0x7f08a400a340 comp rx=0 tx=0).stop 2023-09-23T08:51:40.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:51:40.255+0000 7f08b2f2e700 1 -- 172.21.15.82:0/3194752036 shutdown_connections 2023-09-23T08:51:40.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:51:40.255+0000 7f08b2f2e700 1 --2- 172.21.15.82:0/3194752036 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f089c09ffd0 0x7f089c0a2490 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:51:40.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:51:40.255+0000 7f08b2f2e700 1 --2- 172.21.15.82:0/3194752036 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08ac102550 0x7f08ac19fd50 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:51:40.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:51:40.255+0000 7f08b2f2e700 1 --2- 172.21.15.82:0/3194752036 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08ac1009b0 0x7f08ac198790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:51:40.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:51:40.255+0000 7f08b2f2e700 1 --2- 172.21.15.82:0/3194752036 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08ac101bb0 0x7f08ac198cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:51:40.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:51:40.255+0000 7f08b2f2e700 1 -- 172.21.15.82:0/3194752036 >> 172.21.15.82:0/3194752036 conn(0x7f08ac0fbf10 msgr2=0x7f08ac107510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:51:40.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:51:40.255+0000 7f08b2f2e700 1 -- 172.21.15.82:0/3194752036 shutdown_connections 2023-09-23T08:51:40.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:51:40.255+0000 7f08b2f2e700 1 -- 172.21.15.82:0/3194752036 wait complete. 2023-09-23T08:51:40.666 DEBUG:teuthology.orchestra.run.smithi082:osd.6> sudo journalctl -f -n 0 -u ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@osd.6.service 2023-09-23T08:51:40.671 INFO:tasks.cephadm:Deploying osd.7 on smithi135 with /dev/vg_nvme/lv_2... 2023-09-23T08:51:40.671 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-09-23T08:51:40.743 INFO:journalctl@ceph.osd.6.smithi082.stdout:-- Logs begin at Sat 2023-09-23 08:29:32 UTC. -- 2023-09-23T08:51:41.370 INFO:journalctl@ceph.osd.6.smithi082.stdout:Sep 23 08:51:40 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-6[121893]: 2023-09-23T08:51:40.948+0000 7fa83f889640 -1 osd.6 0 log_to_monitors true 2023-09-23T08:51:41.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:41 smithi082 ceph-mon[97694]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-09-23T08:51:41.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:41 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:51:41.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:41 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:51:41.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:41 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:51:41.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:41 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:51:41.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:41 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:51:41.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:41 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:51:41.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:41 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:51:41.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:41 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:51:41.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:41 smithi082 ceph-mon[97694]: from='osd.6 [v2:172.21.15.82:6818/1052038408,v1:172.21.15.82:6819/1052038408]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-09-23T08:51:41.402 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.b/config 2023-09-23T08:51:41.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:41 smithi135 ceph-mon[99205]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-09-23T08:51:41.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:41 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:51:41.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:41 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:51:41.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:41 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:51:41.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:41 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:51:41.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:41 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:51:41.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:41 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:51:41.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:41 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:51:41.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:41 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:51:41.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:41 smithi135 ceph-mon[99205]: from='osd.6 [v2:172.21.15.82:6818/1052038408,v1:172.21.15.82:6819/1052038408]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-09-23T08:51:41.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:41 smithi161 ceph-mon[99580]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-09-23T08:51:41.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:41 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:51:41.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:41 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:51:41.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:41 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:51:41.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:41 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:51:41.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:41 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:51:41.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:41 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:51:41.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:41 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:51:41.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:41 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:51:41.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:41 smithi161 ceph-mon[99580]: from='osd.6 [v2:172.21.15.82:6818/1052038408,v1:172.21.15.82:6819/1052038408]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-09-23T08:51:42.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:42 smithi135 ceph-mon[99205]: from='osd.6 [v2:172.21.15.82:6818/1052038408,v1:172.21.15.82:6819/1052038408]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-09-23T08:51:42.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:42 smithi135 ceph-mon[99205]: osdmap e45: 7 total, 6 up, 7 in 2023-09-23T08:51:42.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:42 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-09-23T08:51:42.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:42 smithi135 ceph-mon[99205]: from='osd.6 [v2:172.21.15.82:6818/1052038408,v1:172.21.15.82:6819/1052038408]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2023-09-23T08:51:42.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:42 smithi161 ceph-mon[99580]: from='osd.6 [v2:172.21.15.82:6818/1052038408,v1:172.21.15.82:6819/1052038408]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-09-23T08:51:42.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:42 smithi161 ceph-mon[99580]: osdmap e45: 7 total, 6 up, 7 in 2023-09-23T08:51:42.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:42 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-09-23T08:51:42.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:42 smithi161 ceph-mon[99580]: from='osd.6 [v2:172.21.15.82:6818/1052038408,v1:172.21.15.82:6819/1052038408]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2023-09-23T08:51:42.649 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:42 smithi082 ceph-mon[97694]: from='osd.6 [v2:172.21.15.82:6818/1052038408,v1:172.21.15.82:6819/1052038408]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-09-23T08:51:42.649 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:42 smithi082 ceph-mon[97694]: osdmap e45: 7 total, 6 up, 7 in 2023-09-23T08:51:42.650 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:42 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-09-23T08:51:42.650 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:42 smithi082 ceph-mon[97694]: from='osd.6 [v2:172.21.15.82:6818/1052038408,v1:172.21.15.82:6819/1052038408]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2023-09-23T08:51:42.650 INFO:journalctl@ceph.osd.6.smithi082.stdout:Sep 23 08:51:42 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-6[121893]: 2023-09-23T08:51:42.388+0000 7fa834700700 -1 osd.6 0 waiting for initial osdmap 2023-09-23T08:51:42.650 INFO:journalctl@ceph.osd.6.smithi082.stdout:Sep 23 08:51:42 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-6[121893]: 2023-09-23T08:51:42.406+0000 7fa8304f5700 -1 osd.6 46 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-23T08:51:43.353 INFO:teuthology.orchestra.run.smithi135.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-09-23T08:51:43.354 INFO:teuthology.orchestra.run.smithi135.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-09-23T08:51:43.354 INFO:teuthology.orchestra.run.smithi135.stderr: stderr: 10+0 records in 2023-09-23T08:51:43.354 INFO:teuthology.orchestra.run.smithi135.stderr:10+0 records out 2023-09-23T08:51:43.354 INFO:teuthology.orchestra.run.smithi135.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0456702 s, 230 MB/s 2023-09-23T08:51:43.354 INFO:teuthology.orchestra.run.smithi135.stderr:--> Zapping successful for: 2023-09-23T08:51:43.786 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:43 smithi082 ceph-mon[97694]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-09-23T08:51:43.786 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:43 smithi082 ceph-mon[97694]: from='osd.6 [v2:172.21.15.82:6818/1052038408,v1:172.21.15.82:6819/1052038408]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2023-09-23T08:51:43.786 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:43 smithi082 ceph-mon[97694]: osdmap e46: 7 total, 6 up, 7 in 2023-09-23T08:51:43.786 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:43 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-09-23T08:51:43.786 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:43 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-09-23T08:51:43.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:43 smithi135 ceph-mon[99205]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-09-23T08:51:43.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:43 smithi135 ceph-mon[99205]: from='osd.6 [v2:172.21.15.82:6818/1052038408,v1:172.21.15.82:6819/1052038408]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2023-09-23T08:51:43.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:43 smithi135 ceph-mon[99205]: osdmap e46: 7 total, 6 up, 7 in 2023-09-23T08:51:43.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:43 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-09-23T08:51:43.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:43 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-09-23T08:51:43.881 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- ceph orch daemon add osd smithi135:vg_nvme/lv_2 2023-09-23T08:51:43.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:43 smithi161 ceph-mon[99580]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-09-23T08:51:43.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:43 smithi161 ceph-mon[99580]: from='osd.6 [v2:172.21.15.82:6818/1052038408,v1:172.21.15.82:6819/1052038408]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2023-09-23T08:51:43.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:43 smithi161 ceph-mon[99580]: osdmap e46: 7 total, 6 up, 7 in 2023-09-23T08:51:43.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:43 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-09-23T08:51:43.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:43 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-09-23T08:51:44.602 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.b/config 2023-09-23T08:51:44.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:44 smithi135 ceph-mon[99205]: purged_snaps scrub starts 2023-09-23T08:51:44.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:44 smithi135 ceph-mon[99205]: purged_snaps scrub ok 2023-09-23T08:51:44.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:44 smithi135 ceph-mon[99205]: osd.6 [v2:172.21.15.82:6818/1052038408,v1:172.21.15.82:6819/1052038408] boot 2023-09-23T08:51:44.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:44 smithi135 ceph-mon[99205]: osdmap e47: 7 total, 7 up, 7 in 2023-09-23T08:51:44.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:44 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-09-23T08:51:44.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:44 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:51:44.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:44 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:51:44.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:44 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:51:44.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:44 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:51:44.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:44 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:51:44.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:44 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:51:44.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:44 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:51:44.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:44 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:51:44.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:44 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:51:44.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:44 smithi082 ceph-mon[97694]: purged_snaps scrub starts 2023-09-23T08:51:44.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:44 smithi082 ceph-mon[97694]: purged_snaps scrub ok 2023-09-23T08:51:44.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:44 smithi082 ceph-mon[97694]: osd.6 [v2:172.21.15.82:6818/1052038408,v1:172.21.15.82:6819/1052038408] boot 2023-09-23T08:51:44.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:44 smithi082 ceph-mon[97694]: osdmap e47: 7 total, 7 up, 7 in 2023-09-23T08:51:44.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:44 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-09-23T08:51:44.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:44 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:51:44.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:44 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:51:44.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:44 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:51:44.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:44 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:51:44.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:44 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:51:44.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:44 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:51:44.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:44 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:51:44.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:44 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:51:44.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:44 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:51:44.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:44 smithi161 ceph-mon[99580]: purged_snaps scrub starts 2023-09-23T08:51:44.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:44 smithi161 ceph-mon[99580]: purged_snaps scrub ok 2023-09-23T08:51:44.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:44 smithi161 ceph-mon[99580]: osd.6 [v2:172.21.15.82:6818/1052038408,v1:172.21.15.82:6819/1052038408] boot 2023-09-23T08:51:44.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:44 smithi161 ceph-mon[99580]: osdmap e47: 7 total, 7 up, 7 in 2023-09-23T08:51:44.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:44 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-09-23T08:51:44.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:44 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:51:44.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:44 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:51:44.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:44 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:51:44.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:44 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:51:44.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:44 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:51:44.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:44 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:51:44.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:44 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:51:44.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:44 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:51:44.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:44 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:51:45.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:45 smithi135 ceph-mon[99205]: Detected new or changed devices on smithi082 2023-09-23T08:51:45.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:45 smithi135 ceph-mon[99205]: Adjusting osd_memory_target on smithi082 to 5755M 2023-09-23T08:51:45.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:45 smithi135 ceph-mon[99205]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-09-23T08:51:45.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:45 smithi135 ceph-mon[99205]: osdmap e48: 7 total, 7 up, 7 in 2023-09-23T08:51:45.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:45 smithi082 ceph-mon[97694]: Detected new or changed devices on smithi082 2023-09-23T08:51:45.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:45 smithi082 ceph-mon[97694]: Adjusting osd_memory_target on smithi082 to 5755M 2023-09-23T08:51:45.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:45 smithi082 ceph-mon[97694]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-09-23T08:51:45.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:45 smithi082 ceph-mon[97694]: osdmap e48: 7 total, 7 up, 7 in 2023-09-23T08:51:45.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:45 smithi161 ceph-mon[99580]: Detected new or changed devices on smithi082 2023-09-23T08:51:45.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:45 smithi161 ceph-mon[99580]: Adjusting osd_memory_target on smithi082 to 5755M 2023-09-23T08:51:45.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:45 smithi161 ceph-mon[99580]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-09-23T08:51:45.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:45 smithi161 ceph-mon[99580]: osdmap e48: 7 total, 7 up, 7 in 2023-09-23T08:51:46.096 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:51:46.092+0000 7f0e423c5700 1 -- 172.21.15.135:0/572363034 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e3c1009b0 msgr2=0x7f0e3c100dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:51:46.096 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:51:46.092+0000 7f0e423c5700 1 --2- 172.21.15.135:0/572363034 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e3c1009b0 0x7f0e3c100dd0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c0099c0 tx=0x7f0e2c009cd0 comp rx=0 tx=0).stop 2023-09-23T08:51:46.096 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:51:46.092+0000 7f0e423c5700 1 -- 172.21.15.135:0/572363034 shutdown_connections 2023-09-23T08:51:46.096 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:51:46.092+0000 7f0e423c5700 1 --2- 172.21.15.135:0/572363034 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0e3c102550 0x7f0e3c108e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:51:46.096 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:51:46.092+0000 7f0e423c5700 1 --2- 172.21.15.135:0/572363034 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e3c1009b0 0x7f0e3c100dd0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:51:46.096 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:51:46.092+0000 7f0e423c5700 1 --2- 172.21.15.135:0/572363034 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0e3c101bb0 0x7f0e3c102010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:51:46.096 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:51:46.092+0000 7f0e423c5700 1 -- 172.21.15.135:0/572363034 >> 172.21.15.135:0/572363034 conn(0x7f0e3c0fbf10 msgr2=0x7f0e3c0fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:51:46.096 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:51:46.092+0000 7f0e423c5700 1 -- 172.21.15.135:0/572363034 shutdown_connections 2023-09-23T08:51:46.096 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:51:46.092+0000 7f0e423c5700 1 -- 172.21.15.135:0/572363034 wait complete. 2023-09-23T08:51:46.099 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:51:46.093+0000 7f0e423c5700 1 Processor -- start 2023-09-23T08:51:46.099 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:51:46.093+0000 7f0e423c5700 1 -- start start 2023-09-23T08:51:46.099 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:51:46.094+0000 7f0e423c5700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0e3c1009b0 0x7f0e3c1987d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:51:46.099 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:51:46.094+0000 7f0e423c5700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e3c101bb0 0x7f0e3c198d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:51:46.099 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:51:46.094+0000 7f0e423c5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0e3c102550 0x7f0e3c19fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:51:46.099 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:51:46.094+0000 7f0e423c5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3c1a0360 con 0x7f0e3c102550 2023-09-23T08:51:46.099 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:51:46.094+0000 7f0e423c5700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3c1a04a0 con 0x7f0e3c101bb0 2023-09-23T08:51:46.099 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:51:46.094+0000 7f0e423c5700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3c1a0630 con 0x7f0e3c1009b0 2023-09-23T08:51:46.099 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:51:46.094+0000 7f0e3b7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e3c101bb0 0x7f0e3c198d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:51:46.100 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:51:46.094+0000 7f0e3b7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e3c101bb0 0x7f0e3c198d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40594/0 (socket says 172.21.15.135:40594) 2023-09-23T08:51:46.100 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:51:46.094+0000 7f0e3b7fe700 1 -- 172.21.15.135:0/200478573 learned_addr learned my addr 172.21.15.135:0/200478573 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-09-23T08:51:46.100 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:51:46.094+0000 7f0e3bfff700 1 --2- 172.21.15.135:0/200478573 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0e3c1009b0 0x7f0e3c1987d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:51:46.100 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:51:46.094+0000 7f0e40962700 1 --2- 172.21.15.135:0/200478573 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0e3c102550 0x7f0e3c19fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:51:46.100 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:51:46.094+0000 7f0e3b7fe700 1 -- 172.21.15.135:0/200478573 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0e3c1009b0 msgr2=0x7f0e3c1987d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:51:46.100 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:51:46.094+0000 7f0e3b7fe700 1 --2- 172.21.15.135:0/200478573 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0e3c1009b0 0x7f0e3c1987d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:51:46.100 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:51:46.094+0000 7f0e3b7fe700 1 -- 172.21.15.135:0/200478573 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0e3c102550 msgr2=0x7f0e3c19fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:51:46.100 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:51:46.094+0000 7f0e3b7fe700 1 --2- 172.21.15.135:0/200478573 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0e3c102550 0x7f0e3c19fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:51:46.100 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:51:46.094+0000 7f0e3b7fe700 1 -- 172.21.15.135:0/200478573 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e2c0095f0 con 0x7f0e3c101bb0 2023-09-23T08:51:46.100 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:51:46.094+0000 7f0e40962700 1 --2- 172.21.15.135:0/200478573 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0e3c102550 0x7f0e3c19fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T08:51:46.101 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:51:46.095+0000 7f0e3b7fe700 1 --2- 172.21.15.135:0/200478573 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e3c101bb0 0x7f0e3c198d10 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f0e3000d950 tx=0x7f0e3000dc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:51:46.101 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:51:46.095+0000 7f0e397fa700 1 -- 172.21.15.135:0/200478573 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e30009940 con 0x7f0e3c101bb0 2023-09-23T08:51:46.101 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:51:46.095+0000 7f0e397fa700 1 -- 172.21.15.135:0/200478573 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0e30010460 con 0x7f0e3c101bb0 2023-09-23T08:51:46.101 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:51:46.095+0000 7f0e423c5700 1 -- 172.21.15.135:0/200478573 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e3c1a0910 con 0x7f0e3c101bb0 2023-09-23T08:51:46.101 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:51:46.095+0000 7f0e397fa700 1 -- 172.21.15.135:0/200478573 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3000f620 con 0x7f0e3c101bb0 2023-09-23T08:51:46.101 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:51:46.095+0000 7f0e423c5700 1 -- 172.21.15.135:0/200478573 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e3c1a0e10 con 0x7f0e3c101bb0 2023-09-23T08:51:46.102 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:51:46.096+0000 7f0e423c5700 1 -- 172.21.15.135:0/200478573 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e3c192e50 con 0x7f0e3c101bb0 2023-09-23T08:51:46.102 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:51:46.098+0000 7f0e397fa700 1 -- 172.21.15.135:0/200478573 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) v1 ==== 134671+0+0 (secure 0 0 0) 0x7f0e300105d0 con 0x7f0e3c101bb0 2023-09-23T08:51:46.103 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:51:46.099+0000 7f0e397fa700 1 --2- 172.21.15.135:0/200478573 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f0e2409ff50 0x7f0e240a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:51:46.103 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:51:46.100+0000 7f0e397fa700 1 -- 172.21.15.135:0/200478573 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 4965+0+0 (secure 0 0 0) 0x7f0e300ca3f0 con 0x7f0e3c101bb0 2023-09-23T08:51:46.103 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:51:46.100+0000 7f0e3bfff700 1 --2- 172.21.15.135:0/200478573 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f0e2409ff50 0x7f0e240a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:51:46.104 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:51:46.101+0000 7f0e3bfff700 1 --2- 172.21.15.135:0/200478573 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f0e2409ff50 0x7f0e240a2410 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c009990 tx=0x7f0e2c00b9b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:51:46.105 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:51:46.102+0000 7f0e397fa700 1 -- 172.21.15.135:0/200478573 <== mon.2 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f0e30094df0 con 0x7f0e3c101bb0 2023-09-23T08:51:46.308 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:51:46.305+0000 7f0e423c5700 1 -- 172.21.15.135:0/200478573 --> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f0e3c02ce50 con 0x7f0e2409ff50 2023-09-23T08:51:46.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:46 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-23T08:51:46.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:46 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-23T08:51:46.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:46 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:51:46.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:46 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-23T08:51:46.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:46 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-23T08:51:46.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:46 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:51:46.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:46 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-23T08:51:46.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:46 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-23T08:51:46.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:46 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:51:47.677 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:47 smithi135 ceph-mon[99205]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-09-23T08:51:47.677 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:47 smithi135 ceph-mon[99205]: from='client.24287 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:51:47.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:47 smithi082 ceph-mon[97694]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-09-23T08:51:47.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:47 smithi082 ceph-mon[97694]: from='client.24287 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:51:47.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:47 smithi161 ceph-mon[99580]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-09-23T08:51:47.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:47 smithi161 ceph-mon[99580]: from='client.24287 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:51:49.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:49 smithi135 ceph-mon[99205]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-09-23T08:51:49.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:49 smithi135 ceph-mon[99205]: from='client.? 172.21.15.135:0/1703999514' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "425ca0ee-57f7-4b27-90fb-d86bb5db5480"}]: dispatch 2023-09-23T08:51:49.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:49 smithi135 ceph-mon[99205]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "425ca0ee-57f7-4b27-90fb-d86bb5db5480"}]: dispatch 2023-09-23T08:51:49.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:49 smithi135 ceph-mon[99205]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "425ca0ee-57f7-4b27-90fb-d86bb5db5480"}]': finished 2023-09-23T08:51:49.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:49 smithi135 ceph-mon[99205]: osdmap e49: 8 total, 7 up, 8 in 2023-09-23T08:51:49.814 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:49 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-09-23T08:51:49.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:49 smithi082 ceph-mon[97694]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-09-23T08:51:49.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:49 smithi082 ceph-mon[97694]: from='client.? 172.21.15.135:0/1703999514' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "425ca0ee-57f7-4b27-90fb-d86bb5db5480"}]: dispatch 2023-09-23T08:51:49.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:49 smithi082 ceph-mon[97694]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "425ca0ee-57f7-4b27-90fb-d86bb5db5480"}]: dispatch 2023-09-23T08:51:49.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:49 smithi082 ceph-mon[97694]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "425ca0ee-57f7-4b27-90fb-d86bb5db5480"}]': finished 2023-09-23T08:51:49.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:49 smithi082 ceph-mon[97694]: osdmap e49: 8 total, 7 up, 8 in 2023-09-23T08:51:49.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:49 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-09-23T08:51:49.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:49 smithi161 ceph-mon[99580]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-09-23T08:51:49.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:49 smithi161 ceph-mon[99580]: from='client.? 172.21.15.135:0/1703999514' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "425ca0ee-57f7-4b27-90fb-d86bb5db5480"}]: dispatch 2023-09-23T08:51:49.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:49 smithi161 ceph-mon[99580]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "425ca0ee-57f7-4b27-90fb-d86bb5db5480"}]: dispatch 2023-09-23T08:51:49.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:49 smithi161 ceph-mon[99580]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "425ca0ee-57f7-4b27-90fb-d86bb5db5480"}]': finished 2023-09-23T08:51:49.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:49 smithi161 ceph-mon[99580]: osdmap e49: 8 total, 7 up, 8 in 2023-09-23T08:51:49.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:49 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-09-23T08:51:50.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:50 smithi135 ceph-mon[99205]: from='client.? 172.21.15.135:0/1516321111' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-23T08:51:50.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:50 smithi082 ceph-mon[97694]: from='client.? 172.21.15.135:0/1516321111' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-23T08:51:50.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:50 smithi161 ceph-mon[99580]: from='client.? 172.21.15.135:0/1516321111' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-23T08:51:51.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:51 smithi135 ceph-mon[99205]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-09-23T08:51:51.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:51 smithi082 ceph-mon[97694]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-09-23T08:51:51.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:51 smithi161 ceph-mon[99580]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-09-23T08:51:53.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:53 smithi135 ceph-mon[99205]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-09-23T08:51:53.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:53 smithi082 ceph-mon[97694]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-09-23T08:51:53.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:53 smithi161 ceph-mon[99580]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-09-23T08:51:55.697 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:55 smithi135 ceph-mon[99205]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-09-23T08:51:55.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:55 smithi082 ceph-mon[97694]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-09-23T08:51:55.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:55 smithi161 ceph-mon[99580]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-09-23T08:51:57.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:57 smithi135 ceph-mon[99205]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-09-23T08:51:57.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:57 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-09-23T08:51:57.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:57 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:51:57.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:57 smithi082 ceph-mon[97694]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-09-23T08:51:57.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:57 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-09-23T08:51:57.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:57 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:51:57.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:57 smithi161 ceph-mon[99580]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-09-23T08:51:57.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:57 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-09-23T08:51:57.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:57 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:51:58.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:58 smithi135 ceph-mon[99205]: Deploying daemon osd.7 on smithi135 2023-09-23T08:51:58.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:58 smithi082 ceph-mon[97694]: Deploying daemon osd.7 on smithi135 2023-09-23T08:51:58.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:58 smithi161 ceph-mon[99580]: Deploying daemon osd.7 on smithi135 2023-09-23T08:51:59.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:51:59 smithi135 ceph-mon[99205]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-09-23T08:51:59.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:51:59 smithi082 ceph-mon[97694]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-09-23T08:51:59.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:51:59 smithi161 ceph-mon[99580]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-09-23T08:52:00.750 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:00 smithi135 ceph-mon[99205]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-09-23T08:52:00.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:00 smithi082 ceph-mon[97694]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-09-23T08:52:00.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:00 smithi161 ceph-mon[99580]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-09-23T08:52:03.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:03 smithi135 ceph-mon[99205]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-09-23T08:52:03.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:03 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:52:03.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:03 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:52:03.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:03 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:52:03.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:03 smithi082 ceph-mon[97694]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-09-23T08:52:03.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:03 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:52:03.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:03 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:52:03.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:03 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:52:03.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:03 smithi161 ceph-mon[99580]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-09-23T08:52:03.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:03 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:52:03.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:03 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:52:03.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:03 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:52:05.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:05 smithi135 ceph-mon[99205]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-09-23T08:52:05.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:05 smithi082 ceph-mon[97694]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-09-23T08:52:05.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:05 smithi161 ceph-mon[99580]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-09-23T08:52:06.784 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:52:06.781+0000 7f0e397fa700 1 -- 172.21.15.135:0/200478573 <== mgr.14152 v2:172.21.15.82:6800/3698954311 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f0e3c02ce50 con 0x7f0e2409ff50 2023-09-23T08:52:06.785 INFO:teuthology.orchestra.run.smithi135.stdout:Created osd(s) 7 on host 'smithi135' 2023-09-23T08:52:06.786 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:52:06.784+0000 7f0e423c5700 1 -- 172.21.15.135:0/200478573 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f0e2409ff50 msgr2=0x7f0e240a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:52:06.786 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:52:06.784+0000 7f0e423c5700 1 --2- 172.21.15.135:0/200478573 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f0e2409ff50 0x7f0e240a2410 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c009990 tx=0x7f0e2c00b9b0 comp rx=0 tx=0).stop 2023-09-23T08:52:06.787 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:52:06.784+0000 7f0e423c5700 1 -- 172.21.15.135:0/200478573 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e3c101bb0 msgr2=0x7f0e3c198d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:52:06.787 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:52:06.784+0000 7f0e423c5700 1 --2- 172.21.15.135:0/200478573 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e3c101bb0 0x7f0e3c198d10 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f0e3000d950 tx=0x7f0e3000dc60 comp rx=0 tx=0).stop 2023-09-23T08:52:06.787 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:52:06.784+0000 7f0e423c5700 1 -- 172.21.15.135:0/200478573 shutdown_connections 2023-09-23T08:52:06.787 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:52:06.784+0000 7f0e423c5700 1 --2- 172.21.15.135:0/200478573 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f0e2409ff50 0x7f0e240a2410 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:52:06.787 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:52:06.784+0000 7f0e423c5700 1 --2- 172.21.15.135:0/200478573 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0e3c102550 0x7f0e3c19fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:52:06.787 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:52:06.784+0000 7f0e423c5700 1 --2- 172.21.15.135:0/200478573 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0e3c1009b0 0x7f0e3c1987d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:52:06.787 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:52:06.784+0000 7f0e423c5700 1 --2- 172.21.15.135:0/200478573 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e3c101bb0 0x7f0e3c198d10 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:52:06.787 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:52:06.784+0000 7f0e423c5700 1 -- 172.21.15.135:0/200478573 >> 172.21.15.135:0/200478573 conn(0x7f0e3c0fbf10 msgr2=0x7f0e3c107600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:52:06.787 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:52:06.784+0000 7f0e423c5700 1 -- 172.21.15.135:0/200478573 shutdown_connections 2023-09-23T08:52:06.787 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:52:06.784+0000 7f0e423c5700 1 -- 172.21.15.135:0/200478573 wait complete. 2023-09-23T08:52:07.249 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:07 smithi135 ceph-mon[99205]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-09-23T08:52:07.249 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:07 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:52:07.249 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:07 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:52:07.250 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:07 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:52:07.250 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:07 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:52:07.250 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:07 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:52:07.250 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:07 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:52:07.250 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:07 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:52:07.250 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:07 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:52:07.331 DEBUG:teuthology.orchestra.run.smithi135:osd.7> sudo journalctl -f -n 0 -u ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@osd.7.service 2023-09-23T08:52:07.335 INFO:tasks.cephadm:Deploying osd.8 on smithi161 with /dev/vg_nvme/lv_2... 2023-09-23T08:52:07.336 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-09-23T08:52:07.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:07 smithi082 ceph-mon[97694]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-09-23T08:52:07.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:07 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:52:07.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:07 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:52:07.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:07 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:52:07.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:07 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:52:07.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:07 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:52:07.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:07 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:52:07.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:07 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:52:07.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:07 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:52:07.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:07 smithi161 ceph-mon[99580]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-09-23T08:52:07.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:07 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:52:07.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:07 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:52:07.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:07 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:52:07.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:07 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:52:07.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:07 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:52:07.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:07 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:52:07.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:07 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:52:07.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:07 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:52:07.410 INFO:journalctl@ceph.osd.7.smithi135.stdout:-- Logs begin at Sat 2023-09-23 08:29:30 UTC. -- 2023-09-23T08:52:08.068 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.c/config 2023-09-23T08:52:08.231 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:08 smithi135 ceph-mon[99205]: from='osd.7 [v2:172.21.15.135:6816/3683951498,v1:172.21.15.135:6817/3683951498]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-09-23T08:52:08.231 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:08 smithi135 ceph-mon[99205]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-09-23T08:52:08.334 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:08 smithi161 ceph-mon[99580]: from='osd.7 [v2:172.21.15.135:6816/3683951498,v1:172.21.15.135:6817/3683951498]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-09-23T08:52:08.335 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:08 smithi161 ceph-mon[99580]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-09-23T08:52:08.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:08 smithi082 ceph-mon[97694]: from='osd.7 [v2:172.21.15.135:6816/3683951498,v1:172.21.15.135:6817/3683951498]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-09-23T08:52:08.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:08 smithi082 ceph-mon[97694]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-09-23T08:52:09.308 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:09 smithi161 ceph-mon[99580]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-09-23T08:52:09.308 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:09 smithi161 ceph-mon[99580]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-09-23T08:52:09.309 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:09 smithi161 ceph-mon[99580]: osdmap e50: 8 total, 7 up, 8 in 2023-09-23T08:52:09.309 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:09 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-09-23T08:52:09.309 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:09 smithi161 ceph-mon[99580]: from='osd.7 [v2:172.21.15.135:6816/3683951498,v1:172.21.15.135:6817/3683951498]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2023-09-23T08:52:09.309 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:09 smithi161 ceph-mon[99580]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2023-09-23T08:52:09.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:09 smithi135 ceph-mon[99205]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-09-23T08:52:09.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:09 smithi135 ceph-mon[99205]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-09-23T08:52:09.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:09 smithi135 ceph-mon[99205]: osdmap e50: 8 total, 7 up, 8 in 2023-09-23T08:52:09.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:09 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-09-23T08:52:09.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:09 smithi135 ceph-mon[99205]: from='osd.7 [v2:172.21.15.135:6816/3683951498,v1:172.21.15.135:6817/3683951498]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2023-09-23T08:52:09.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:09 smithi135 ceph-mon[99205]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2023-09-23T08:52:09.313 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 23 08:52:09 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-7[115264]: 2023-09-23T08:52:09.049+0000 7ff66cc0c700 -1 osd.7 0 waiting for initial osdmap 2023-09-23T08:52:09.313 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 23 08:52:09 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-7[115264]: 2023-09-23T08:52:09.069+0000 7ff6679ff700 -1 osd.7 51 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-23T08:52:09.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:09 smithi082 ceph-mon[97694]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-09-23T08:52:09.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:09 smithi082 ceph-mon[97694]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-09-23T08:52:09.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:09 smithi082 ceph-mon[97694]: osdmap e50: 8 total, 7 up, 8 in 2023-09-23T08:52:09.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:09 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-09-23T08:52:09.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:09 smithi082 ceph-mon[97694]: from='osd.7 [v2:172.21.15.135:6816/3683951498,v1:172.21.15.135:6817/3683951498]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2023-09-23T08:52:09.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:09 smithi082 ceph-mon[97694]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2023-09-23T08:52:09.996 INFO:teuthology.orchestra.run.smithi161.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-09-23T08:52:09.996 INFO:teuthology.orchestra.run.smithi161.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-09-23T08:52:09.996 INFO:teuthology.orchestra.run.smithi161.stderr: stderr: 10+0 records in 2023-09-23T08:52:09.996 INFO:teuthology.orchestra.run.smithi161.stderr:10+0 records out 2023-09-23T08:52:09.996 INFO:teuthology.orchestra.run.smithi161.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0296798 s, 353 MB/s 2023-09-23T08:52:09.996 INFO:teuthology.orchestra.run.smithi161.stderr:--> Zapping successful for: 2023-09-23T08:52:10.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:10 smithi135 ceph-mon[99205]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2023-09-23T08:52:10.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:10 smithi135 ceph-mon[99205]: osdmap e51: 8 total, 7 up, 8 in 2023-09-23T08:52:10.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:10 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-09-23T08:52:10.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:10 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-09-23T08:52:10.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:10 smithi135 ceph-mon[99205]: osd.7 [v2:172.21.15.135:6816/3683951498,v1:172.21.15.135:6817/3683951498] boot 2023-09-23T08:52:10.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:10 smithi135 ceph-mon[99205]: osdmap e52: 8 total, 8 up, 8 in 2023-09-23T08:52:10.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:10 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-09-23T08:52:10.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:10 smithi082 ceph-mon[97694]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2023-09-23T08:52:10.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:10 smithi082 ceph-mon[97694]: osdmap e51: 8 total, 7 up, 8 in 2023-09-23T08:52:10.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:10 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-09-23T08:52:10.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:10 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-09-23T08:52:10.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:10 smithi082 ceph-mon[97694]: osd.7 [v2:172.21.15.135:6816/3683951498,v1:172.21.15.135:6817/3683951498] boot 2023-09-23T08:52:10.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:10 smithi082 ceph-mon[97694]: osdmap e52: 8 total, 8 up, 8 in 2023-09-23T08:52:10.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:10 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-09-23T08:52:10.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:10 smithi161 ceph-mon[99580]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2023-09-23T08:52:10.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:10 smithi161 ceph-mon[99580]: osdmap e51: 8 total, 7 up, 8 in 2023-09-23T08:52:10.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:10 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-09-23T08:52:10.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:10 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-09-23T08:52:10.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:10 smithi161 ceph-mon[99580]: osd.7 [v2:172.21.15.135:6816/3683951498,v1:172.21.15.135:6817/3683951498] boot 2023-09-23T08:52:10.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:10 smithi161 ceph-mon[99580]: osdmap e52: 8 total, 8 up, 8 in 2023-09-23T08:52:10.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:10 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-09-23T08:52:10.550 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- ceph orch daemon add osd smithi161:vg_nvme/lv_2 2023-09-23T08:52:11.274 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.c/config 2023-09-23T08:52:11.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:11 smithi135 ceph-mon[99205]: purged_snaps scrub starts 2023-09-23T08:52:11.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:11 smithi135 ceph-mon[99205]: purged_snaps scrub ok 2023-09-23T08:52:11.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:11 smithi135 ceph-mon[99205]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-09-23T08:52:11.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:11 smithi135 ceph-mon[99205]: Detected new or changed devices on smithi135 2023-09-23T08:52:11.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:11 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:52:11.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:11 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:52:11.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:11 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:52:11.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:11 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:52:11.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:11 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:52:11.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:11 smithi135 ceph-mon[99205]: Adjusting osd_memory_target on smithi135 to 5755M 2023-09-23T08:52:11.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:11 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:52:11.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:11 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:52:11.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:11 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:52:11.564 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:11 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:52:11.564 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:11 smithi135 ceph-mon[99205]: osdmap e53: 8 total, 8 up, 8 in 2023-09-23T08:52:11.575 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:11 smithi161 ceph-mon[99580]: purged_snaps scrub starts 2023-09-23T08:52:11.575 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:11 smithi161 ceph-mon[99580]: purged_snaps scrub ok 2023-09-23T08:52:11.576 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:11 smithi161 ceph-mon[99580]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-09-23T08:52:11.576 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:11 smithi161 ceph-mon[99580]: Detected new or changed devices on smithi135 2023-09-23T08:52:11.576 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:11 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:52:11.576 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:11 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:52:11.576 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:11 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:52:11.576 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:11 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:52:11.576 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:11 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:52:11.576 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:11 smithi161 ceph-mon[99580]: Adjusting osd_memory_target on smithi135 to 5755M 2023-09-23T08:52:11.576 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:11 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:52:11.576 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:11 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:52:11.576 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:11 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:52:11.577 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:11 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:52:11.577 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:11 smithi161 ceph-mon[99580]: osdmap e53: 8 total, 8 up, 8 in 2023-09-23T08:52:11.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:11 smithi082 ceph-mon[97694]: purged_snaps scrub starts 2023-09-23T08:52:11.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:11 smithi082 ceph-mon[97694]: purged_snaps scrub ok 2023-09-23T08:52:11.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:11 smithi082 ceph-mon[97694]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-09-23T08:52:11.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:11 smithi082 ceph-mon[97694]: Detected new or changed devices on smithi135 2023-09-23T08:52:11.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:11 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:52:11.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:11 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:52:11.623 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:11 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:52:11.623 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:11 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:52:11.623 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:11 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:52:11.623 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:11 smithi082 ceph-mon[97694]: Adjusting osd_memory_target on smithi135 to 5755M 2023-09-23T08:52:11.623 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:11 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:52:11.623 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:11 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:52:11.623 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:11 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:52:11.623 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:11 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:52:11.623 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:11 smithi082 ceph-mon[97694]: osdmap e53: 8 total, 8 up, 8 in 2023-09-23T08:52:12.778 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:52:12.775+0000 7f826fda8700 1 -- 172.21.15.161:0/3463765292 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8268102550 msgr2=0x7f8268108e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:52:12.778 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:52:12.775+0000 7f826fda8700 1 --2- 172.21.15.161:0/3463765292 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8268102550 0x7f8268108e00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f826000b0a0 tx=0x7f826000b3b0 comp rx=0 tx=0).stop 2023-09-23T08:52:12.779 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:52:12.775+0000 7f826fda8700 1 -- 172.21.15.161:0/3463765292 shutdown_connections 2023-09-23T08:52:12.779 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:52:12.775+0000 7f826fda8700 1 --2- 172.21.15.161:0/3463765292 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8268102550 0x7f8268108e00 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:52:12.779 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:52:12.775+0000 7f826fda8700 1 --2- 172.21.15.161:0/3463765292 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f82681009b0 0x7f8268100dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:52:12.779 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:52:12.775+0000 7f826fda8700 1 --2- 172.21.15.161:0/3463765292 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8268101bb0 0x7f8268102010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:52:12.779 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:52:12.775+0000 7f826fda8700 1 -- 172.21.15.161:0/3463765292 >> 172.21.15.161:0/3463765292 conn(0x7f82680fbf10 msgr2=0x7f82680fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:52:12.779 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:52:12.775+0000 7f826fda8700 1 -- 172.21.15.161:0/3463765292 shutdown_connections 2023-09-23T08:52:12.779 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:52:12.775+0000 7f826fda8700 1 -- 172.21.15.161:0/3463765292 wait complete. 2023-09-23T08:52:12.781 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:52:12.776+0000 7f826fda8700 1 Processor -- start 2023-09-23T08:52:12.781 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:52:12.776+0000 7f826fda8700 1 -- start start 2023-09-23T08:52:12.781 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:52:12.777+0000 7f826fda8700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f82681009b0 0x7f82680746c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:52:12.781 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:52:12.777+0000 7f826fda8700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8268101bb0 0x7f8268072d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:52:12.782 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:52:12.777+0000 7f826fda8700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8268102550 0x7f8268073250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:52:12.782 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:52:12.777+0000 7f826fda8700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82680739d0 con 0x7f8268102550 2023-09-23T08:52:12.782 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:52:12.777+0000 7f826fda8700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8268073b40 con 0x7f8268101bb0 2023-09-23T08:52:12.782 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:52:12.777+0000 7f826fda8700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82681a0790 con 0x7f82681009b0 2023-09-23T08:52:12.782 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:52:12.777+0000 7f826db44700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f82681009b0 0x7f82680746c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:52:12.782 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:52:12.777+0000 7f826db44700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f82681009b0 0x7f82680746c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60212/0 (socket says 172.21.15.161:60212) 2023-09-23T08:52:12.782 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:52:12.777+0000 7f826db44700 1 -- 172.21.15.161:0/4205680732 learned_addr learned my addr 172.21.15.161:0/4205680732 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-09-23T08:52:12.782 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:52:12.777+0000 7f826d343700 1 --2- 172.21.15.161:0/4205680732 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8268101bb0 0x7f8268072d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:52:12.782 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:52:12.777+0000 7f826e345700 1 --2- 172.21.15.161:0/4205680732 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8268102550 0x7f8268073250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:52:12.783 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:52:12.777+0000 7f826db44700 1 -- 172.21.15.161:0/4205680732 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8268101bb0 msgr2=0x7f8268072d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:52:12.783 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:52:12.777+0000 7f826db44700 1 --2- 172.21.15.161:0/4205680732 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8268101bb0 0x7f8268072d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:52:12.783 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:52:12.777+0000 7f826db44700 1 -- 172.21.15.161:0/4205680732 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8268102550 msgr2=0x7f8268073250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:52:12.783 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:52:12.777+0000 7f826db44700 1 --2- 172.21.15.161:0/4205680732 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8268102550 0x7f8268073250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:52:12.783 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:52:12.777+0000 7f826db44700 1 -- 172.21.15.161:0/4205680732 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8260009d00 con 0x7f82681009b0 2023-09-23T08:52:12.783 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:52:12.777+0000 7f826d343700 1 --2- 172.21.15.161:0/4205680732 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8268101bb0 0x7f8268072d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T08:52:12.783 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:52:12.777+0000 7f826e345700 1 --2- 172.21.15.161:0/4205680732 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8268102550 0x7f8268073250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T08:52:12.783 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:52:12.778+0000 7f826db44700 1 --2- 172.21.15.161:0/4205680732 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f82681009b0 0x7f82680746c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f826400d980 tx=0x7f826400dd40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:52:12.783 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:52:12.778+0000 7f825effd700 1 -- 172.21.15.161:0/4205680732 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f826400de60 con 0x7f82681009b0 2023-09-23T08:52:12.783 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:52:12.778+0000 7f825effd700 1 -- 172.21.15.161:0/4205680732 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f82640044b0 con 0x7f82681009b0 2023-09-23T08:52:12.784 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:52:12.778+0000 7f826fda8700 1 -- 172.21.15.161:0/4205680732 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82681a0a70 con 0x7f82681009b0 2023-09-23T08:52:12.784 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:52:12.778+0000 7f825effd700 1 -- 172.21.15.161:0/4205680732 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8264003b40 con 0x7f82681009b0 2023-09-23T08:52:12.784 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:52:12.778+0000 7f826fda8700 1 -- 172.21.15.161:0/4205680732 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82681a0fc0 con 0x7f82681009b0 2023-09-23T08:52:12.784 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:52:12.779+0000 7f826fda8700 1 -- 172.21.15.161:0/4205680732 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f826810c0e0 con 0x7f82681009b0 2023-09-23T08:52:12.784 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:52:12.781+0000 7f825effd700 1 -- 172.21.15.161:0/4205680732 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 16) v1 ==== 134671+0+0 (secure 0 0 0) 0x7f8264004870 con 0x7f82681009b0 2023-09-23T08:52:12.785 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:52:12.782+0000 7f825effd700 1 --2- 172.21.15.161:0/4205680732 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f825409ffd0 0x7f82540a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:52:12.785 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:52:12.783+0000 7f825effd700 1 -- 172.21.15.161:0/4205680732 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5426+0+0 (secure 0 0 0) 0x7f82640ca790 con 0x7f82681009b0 2023-09-23T08:52:12.786 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:52:12.783+0000 7f826d343700 1 --2- 172.21.15.161:0/4205680732 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f825409ffd0 0x7f82540a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:52:12.786 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:52:12.784+0000 7f826d343700 1 --2- 172.21.15.161:0/4205680732 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f825409ffd0 0x7f82540a2490 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8258005fd0 tx=0x7f8258005ee0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:52:12.788 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:52:12.785+0000 7f825effd700 1 -- 172.21.15.161:0/4205680732 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f8264095040 con 0x7f82681009b0 2023-09-23T08:52:12.994 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:52:12.991+0000 7f826fda8700 1 -- 172.21.15.161:0/4205680732 --> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi161:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f8268060d60 con 0x7f825409ffd0 2023-09-23T08:52:13.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:13 smithi135 ceph-mon[99205]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-09-23T08:52:13.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:13 smithi135 ceph-mon[99205]: osdmap e54: 8 total, 8 up, 8 in 2023-09-23T08:52:13.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:13 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-23T08:52:13.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:13 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-23T08:52:13.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:13 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:52:13.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:13 smithi082 ceph-mon[97694]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-09-23T08:52:13.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:13 smithi082 ceph-mon[97694]: osdmap e54: 8 total, 8 up, 8 in 2023-09-23T08:52:13.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:13 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-23T08:52:13.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:13 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-23T08:52:13.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:13 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:52:13.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:13 smithi161 ceph-mon[99580]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-09-23T08:52:13.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:13 smithi161 ceph-mon[99580]: osdmap e54: 8 total, 8 up, 8 in 2023-09-23T08:52:13.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:13 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-23T08:52:13.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:13 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-23T08:52:13.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:13 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:52:14.306 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:14 smithi161 ceph-mon[99580]: from='client.24322 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi161:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:52:14.306 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:14 smithi161 ceph-mon[99580]: osdmap e55: 8 total, 8 up, 8 in 2023-09-23T08:52:14.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:14 smithi082 ceph-mon[97694]: from='client.24322 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi161:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:52:14.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:14 smithi082 ceph-mon[97694]: osdmap e55: 8 total, 8 up, 8 in 2023-09-23T08:52:14.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:14 smithi135 ceph-mon[99205]: from='client.24322 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi161:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:52:14.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:14 smithi135 ceph-mon[99205]: osdmap e55: 8 total, 8 up, 8 in 2023-09-23T08:52:15.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:15 smithi082 ceph-mon[97694]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-09-23T08:52:15.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:15 smithi082 ceph-mon[97694]: osdmap e56: 8 total, 8 up, 8 in 2023-09-23T08:52:15.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:15 smithi161 ceph-mon[99580]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-09-23T08:52:15.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:15 smithi161 ceph-mon[99580]: osdmap e56: 8 total, 8 up, 8 in 2023-09-23T08:52:15.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:15 smithi135 ceph-mon[99205]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-09-23T08:52:15.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:15 smithi135 ceph-mon[99205]: osdmap e56: 8 total, 8 up, 8 in 2023-09-23T08:52:16.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:16 smithi082 ceph-mon[97694]: from='client.? 172.21.15.161:0/1970056970' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1115c837-bef6-4bad-9974-4d913198511b"}]: dispatch 2023-09-23T08:52:16.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:16 smithi082 ceph-mon[97694]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1115c837-bef6-4bad-9974-4d913198511b"}]: dispatch 2023-09-23T08:52:16.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:16 smithi082 ceph-mon[97694]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1115c837-bef6-4bad-9974-4d913198511b"}]': finished 2023-09-23T08:52:16.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:16 smithi082 ceph-mon[97694]: osdmap e57: 9 total, 8 up, 9 in 2023-09-23T08:52:16.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:16 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-09-23T08:52:16.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:16 smithi161 ceph-mon[99580]: from='client.? 172.21.15.161:0/1970056970' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1115c837-bef6-4bad-9974-4d913198511b"}]: dispatch 2023-09-23T08:52:16.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:16 smithi161 ceph-mon[99580]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1115c837-bef6-4bad-9974-4d913198511b"}]: dispatch 2023-09-23T08:52:16.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:16 smithi161 ceph-mon[99580]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1115c837-bef6-4bad-9974-4d913198511b"}]': finished 2023-09-23T08:52:16.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:16 smithi161 ceph-mon[99580]: osdmap e57: 9 total, 8 up, 9 in 2023-09-23T08:52:16.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:16 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-09-23T08:52:16.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:16 smithi135 ceph-mon[99205]: from='client.? 172.21.15.161:0/1970056970' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1115c837-bef6-4bad-9974-4d913198511b"}]: dispatch 2023-09-23T08:52:16.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:16 smithi135 ceph-mon[99205]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1115c837-bef6-4bad-9974-4d913198511b"}]: dispatch 2023-09-23T08:52:16.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:16 smithi135 ceph-mon[99205]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1115c837-bef6-4bad-9974-4d913198511b"}]': finished 2023-09-23T08:52:16.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:16 smithi135 ceph-mon[99205]: osdmap e57: 9 total, 8 up, 9 in 2023-09-23T08:52:16.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:16 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-09-23T08:52:17.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:17 smithi082 ceph-mon[97694]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-09-23T08:52:17.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:17 smithi082 ceph-mon[97694]: from='client.? 172.21.15.161:0/3741346553' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-23T08:52:17.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:17 smithi161 ceph-mon[99580]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-09-23T08:52:17.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:17 smithi161 ceph-mon[99580]: from='client.? 172.21.15.161:0/3741346553' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-23T08:52:17.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:17 smithi135 ceph-mon[99205]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-09-23T08:52:17.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:17 smithi135 ceph-mon[99205]: from='client.? 172.21.15.161:0/3741346553' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-23T08:52:19.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:19 smithi082 ceph-mon[97694]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-09-23T08:52:19.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:19 smithi161 ceph-mon[99580]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-09-23T08:52:19.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:19 smithi135 ceph-mon[99205]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-09-23T08:52:21.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:21 smithi161 ceph-mon[99580]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-09-23T08:52:21.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:21 smithi135 ceph-mon[99205]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-09-23T08:52:21.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:21 smithi082 ceph-mon[97694]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-09-23T08:52:23.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:23 smithi161 ceph-mon[99580]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-09-23T08:52:23.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:23 smithi135 ceph-mon[99205]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-09-23T08:52:23.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:23 smithi082 ceph-mon[97694]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-09-23T08:52:24.641 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:24 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-09-23T08:52:24.642 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:24 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:52:24.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:24 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-09-23T08:52:24.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:24 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:52:24.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:24 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-09-23T08:52:24.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:24 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:52:25.628 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:25 smithi161 ceph-mon[99580]: Deploying daemon osd.8 on smithi161 2023-09-23T08:52:25.628 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:25 smithi161 ceph-mon[99580]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-09-23T08:52:25.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:25 smithi135 ceph-mon[99205]: Deploying daemon osd.8 on smithi161 2023-09-23T08:52:25.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:25 smithi135 ceph-mon[99205]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-09-23T08:52:25.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:25 smithi082 ceph-mon[97694]: Deploying daemon osd.8 on smithi161 2023-09-23T08:52:25.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:25 smithi082 ceph-mon[97694]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-09-23T08:52:27.417 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:27 smithi161 ceph-mon[99580]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-09-23T08:52:27.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:27 smithi135 ceph-mon[99205]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-09-23T08:52:27.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:27 smithi082 ceph-mon[97694]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-09-23T08:52:29.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:29 smithi161 ceph-mon[99580]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-09-23T08:52:29.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:29 smithi135 ceph-mon[99205]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-09-23T08:52:29.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:29 smithi082 ceph-mon[97694]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-09-23T08:52:31.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:30 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:52:31.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:30 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:52:31.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:30 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:52:31.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:30 smithi161 ceph-mon[99580]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-09-23T08:52:31.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:30 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:52:31.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:30 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:52:31.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:30 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:52:31.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:30 smithi135 ceph-mon[99205]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-09-23T08:52:31.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:30 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:52:31.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:30 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:52:31.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:30 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:52:31.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:30 smithi082 ceph-mon[97694]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-09-23T08:52:33.167 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:52:33.164+0000 7f825effd700 1 -- 172.21.15.161:0/4205680732 <== mgr.14152 v2:172.21.15.82:6800/3698954311 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f8268060d60 con 0x7f825409ffd0 2023-09-23T08:52:33.167 INFO:teuthology.orchestra.run.smithi161.stdout:Created osd(s) 8 on host 'smithi161' 2023-09-23T08:52:33.170 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:52:33.167+0000 7f826fda8700 1 -- 172.21.15.161:0/4205680732 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f825409ffd0 msgr2=0x7f82540a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:52:33.170 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:52:33.167+0000 7f826fda8700 1 --2- 172.21.15.161:0/4205680732 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f825409ffd0 0x7f82540a2490 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8258005fd0 tx=0x7f8258005ee0 comp rx=0 tx=0).stop 2023-09-23T08:52:33.171 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:52:33.167+0000 7f826fda8700 1 -- 172.21.15.161:0/4205680732 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f82681009b0 msgr2=0x7f82680746c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:52:33.171 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:52:33.167+0000 7f826fda8700 1 --2- 172.21.15.161:0/4205680732 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f82681009b0 0x7f82680746c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f826400d980 tx=0x7f826400dd40 comp rx=0 tx=0).stop 2023-09-23T08:52:33.171 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:52:33.167+0000 7f826fda8700 1 -- 172.21.15.161:0/4205680732 shutdown_connections 2023-09-23T08:52:33.171 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:52:33.167+0000 7f826fda8700 1 --2- 172.21.15.161:0/4205680732 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f825409ffd0 0x7f82540a2490 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:52:33.171 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:52:33.167+0000 7f826fda8700 1 --2- 172.21.15.161:0/4205680732 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8268102550 0x7f8268073250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:52:33.171 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:52:33.168+0000 7f826fda8700 1 --2- 172.21.15.161:0/4205680732 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f82681009b0 0x7f82680746c0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:52:33.171 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:52:33.168+0000 7f826fda8700 1 --2- 172.21.15.161:0/4205680732 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8268101bb0 0x7f8268072d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:52:33.171 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:52:33.168+0000 7f826fda8700 1 -- 172.21.15.161:0/4205680732 >> 172.21.15.161:0/4205680732 conn(0x7f82680fbf10 msgr2=0x7f82680fe210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:52:33.171 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:52:33.168+0000 7f826fda8700 1 -- 172.21.15.161:0/4205680732 shutdown_connections 2023-09-23T08:52:33.171 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:52:33.168+0000 7f826fda8700 1 -- 172.21.15.161:0/4205680732 wait complete. 2023-09-23T08:52:33.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:33 smithi161 ceph-mon[99580]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-09-23T08:52:33.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:33 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:52:33.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:33 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:52:33.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:33 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:52:33.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:33 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:52:33.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:33 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:52:33.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:33 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:52:33.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:33 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:52:33.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:33 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:52:33.694 DEBUG:teuthology.orchestra.run.smithi161:osd.8> sudo journalctl -f -n 0 -u ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@osd.8.service 2023-09-23T08:52:33.700 INFO:tasks.cephadm:Deploying osd.9 on smithi082 with /dev/vg_nvme/lv_1... 2023-09-23T08:52:33.701 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-09-23T08:52:33.770 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:33 smithi082 ceph-mon[97694]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-09-23T08:52:33.770 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:33 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:52:33.770 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:33 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:52:33.770 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:33 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:52:33.771 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:33 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:52:33.771 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:33 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:52:33.771 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:33 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:52:33.771 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:33 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:52:33.771 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:33 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:52:33.777 INFO:journalctl@ceph.osd.8.smithi161.stdout:-- Logs begin at Sat 2023-09-23 08:29:48 UTC. -- 2023-09-23T08:52:33.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:33 smithi135 ceph-mon[99205]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-09-23T08:52:33.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:33 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:52:33.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:33 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:52:33.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:33 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:52:33.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:33 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:52:33.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:33 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:52:33.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:33 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:52:33.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:33 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:52:33.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:33 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:52:34.149 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 08:52:33 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T08:52:33.835+0000 7f4805a17640 -1 osd.8 0 log_to_monitors true 2023-09-23T08:52:34.431 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.a/config 2023-09-23T08:52:34.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:34 smithi161 ceph-mon[99580]: from='osd.8 [v2:172.21.15.161:6816/948521536,v1:172.21.15.161:6817/948521536]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-09-23T08:52:34.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:34 smithi161 ceph-mon[99580]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-09-23T08:52:34.682 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:34 smithi082 ceph-mon[97694]: from='osd.8 [v2:172.21.15.161:6816/948521536,v1:172.21.15.161:6817/948521536]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-09-23T08:52:34.682 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:34 smithi082 ceph-mon[97694]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-09-23T08:52:34.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:34 smithi135 ceph-mon[99205]: from='osd.8 [v2:172.21.15.161:6816/948521536,v1:172.21.15.161:6817/948521536]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-09-23T08:52:34.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:34 smithi135 ceph-mon[99205]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-09-23T08:52:35.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:35 smithi082 ceph-mon[97694]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-09-23T08:52:35.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:35 smithi082 ceph-mon[97694]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-09-23T08:52:35.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:35 smithi082 ceph-mon[97694]: osdmap e58: 9 total, 8 up, 9 in 2023-09-23T08:52:35.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:35 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-09-23T08:52:35.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:35 smithi082 ceph-mon[97694]: from='osd.8 [v2:172.21.15.161:6816/948521536,v1:172.21.15.161:6817/948521536]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2023-09-23T08:52:35.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:35 smithi082 ceph-mon[97694]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2023-09-23T08:52:35.648 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 08:52:35 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T08:52:35.390+0000 7f47fa88e700 -1 osd.8 0 waiting for initial osdmap 2023-09-23T08:52:35.648 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 08:52:35 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T08:52:35.403+0000 7f47f4e80700 -1 osd.8 59 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-23T08:52:35.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:35 smithi161 ceph-mon[99580]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-09-23T08:52:35.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:35 smithi161 ceph-mon[99580]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-09-23T08:52:35.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:35 smithi161 ceph-mon[99580]: osdmap e58: 9 total, 8 up, 9 in 2023-09-23T08:52:35.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:35 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-09-23T08:52:35.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:35 smithi161 ceph-mon[99580]: from='osd.8 [v2:172.21.15.161:6816/948521536,v1:172.21.15.161:6817/948521536]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2023-09-23T08:52:35.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:35 smithi161 ceph-mon[99580]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2023-09-23T08:52:35.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:35 smithi135 ceph-mon[99205]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-09-23T08:52:35.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:35 smithi135 ceph-mon[99205]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-09-23T08:52:35.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:35 smithi135 ceph-mon[99205]: osdmap e58: 9 total, 8 up, 9 in 2023-09-23T08:52:35.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:35 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-09-23T08:52:35.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:35 smithi135 ceph-mon[99205]: from='osd.8 [v2:172.21.15.161:6816/948521536,v1:172.21.15.161:6817/948521536]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2023-09-23T08:52:35.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:35 smithi135 ceph-mon[99205]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2023-09-23T08:52:36.429 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-09-23T08:52:36.429 INFO:teuthology.orchestra.run.smithi082.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-09-23T08:52:36.429 INFO:teuthology.orchestra.run.smithi082.stderr: stderr: 10+0 records in 2023-09-23T08:52:36.429 INFO:teuthology.orchestra.run.smithi082.stderr:10+0 records out 2023-09-23T08:52:36.429 INFO:teuthology.orchestra.run.smithi082.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0524974 s, 200 MB/s 2023-09-23T08:52:36.430 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping successful for: 2023-09-23T08:52:36.642 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:36 smithi161 ceph-mon[99580]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]': finished 2023-09-23T08:52:36.643 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:36 smithi161 ceph-mon[99580]: osdmap e59: 9 total, 8 up, 9 in 2023-09-23T08:52:36.643 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:36 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-09-23T08:52:36.643 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:36 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-09-23T08:52:36.643 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:36 smithi161 ceph-mon[99580]: osd.8 [v2:172.21.15.161:6816/948521536,v1:172.21.15.161:6817/948521536] boot 2023-09-23T08:52:36.643 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:36 smithi161 ceph-mon[99580]: osdmap e60: 9 total, 9 up, 9 in 2023-09-23T08:52:36.643 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:36 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-09-23T08:52:36.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:36 smithi135 ceph-mon[99205]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]': finished 2023-09-23T08:52:36.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:36 smithi135 ceph-mon[99205]: osdmap e59: 9 total, 8 up, 9 in 2023-09-23T08:52:36.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:36 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-09-23T08:52:36.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:36 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-09-23T08:52:36.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:36 smithi135 ceph-mon[99205]: osd.8 [v2:172.21.15.161:6816/948521536,v1:172.21.15.161:6817/948521536] boot 2023-09-23T08:52:36.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:36 smithi135 ceph-mon[99205]: osdmap e60: 9 total, 9 up, 9 in 2023-09-23T08:52:36.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:36 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-09-23T08:52:36.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:36 smithi082 ceph-mon[97694]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]': finished 2023-09-23T08:52:36.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:36 smithi082 ceph-mon[97694]: osdmap e59: 9 total, 8 up, 9 in 2023-09-23T08:52:36.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:36 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-09-23T08:52:36.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:36 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-09-23T08:52:36.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:36 smithi082 ceph-mon[97694]: osd.8 [v2:172.21.15.161:6816/948521536,v1:172.21.15.161:6817/948521536] boot 2023-09-23T08:52:36.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:36 smithi082 ceph-mon[97694]: osdmap e60: 9 total, 9 up, 9 in 2023-09-23T08:52:36.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:36 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-09-23T08:52:36.910 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- ceph orch daemon add osd smithi082:vg_nvme/lv_1 2023-09-23T08:52:37.632 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.a/config 2023-09-23T08:52:37.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:37 smithi135 ceph-mon[99205]: purged_snaps scrub starts 2023-09-23T08:52:37.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:37 smithi135 ceph-mon[99205]: purged_snaps scrub ok 2023-09-23T08:52:37.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:37 smithi135 ceph-mon[99205]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-09-23T08:52:37.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:37 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:52:37.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:37 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:52:37.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:37 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:52:37.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:37 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:52:37.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:37 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:52:37.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:37 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:52:37.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:37 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:52:37.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:37 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:52:37.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:37 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:52:37.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:37 smithi135 ceph-mon[99205]: osdmap e61: 9 total, 9 up, 9 in 2023-09-23T08:52:37.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:37 smithi082 ceph-mon[97694]: purged_snaps scrub starts 2023-09-23T08:52:37.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:37 smithi082 ceph-mon[97694]: purged_snaps scrub ok 2023-09-23T08:52:37.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:37 smithi082 ceph-mon[97694]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-09-23T08:52:37.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:37 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:52:37.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:37 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:52:37.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:37 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:52:37.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:37 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:52:37.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:37 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:52:37.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:37 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:52:37.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:37 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:52:37.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:37 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:52:37.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:37 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:52:37.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:37 smithi082 ceph-mon[97694]: osdmap e61: 9 total, 9 up, 9 in 2023-09-23T08:52:37.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:37 smithi161 ceph-mon[99580]: purged_snaps scrub starts 2023-09-23T08:52:37.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:37 smithi161 ceph-mon[99580]: purged_snaps scrub ok 2023-09-23T08:52:37.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:37 smithi161 ceph-mon[99580]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-09-23T08:52:37.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:37 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:52:37.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:37 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:52:37.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:37 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:52:37.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:37 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:52:37.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:37 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:52:37.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:37 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:52:37.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:37 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:52:37.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:37 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:52:37.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:37 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:52:37.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:37 smithi161 ceph-mon[99580]: osdmap e61: 9 total, 9 up, 9 in 2023-09-23T08:52:38.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:38 smithi082 ceph-mon[97694]: Detected new or changed devices on smithi161 2023-09-23T08:52:38.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:38 smithi082 ceph-mon[97694]: Adjusting osd_memory_target on smithi161 to 5755M 2023-09-23T08:52:38.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:38 smithi082 ceph-mon[97694]: osdmap e62: 9 total, 9 up, 9 in 2023-09-23T08:52:38.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:38 smithi135 ceph-mon[99205]: Detected new or changed devices on smithi161 2023-09-23T08:52:38.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:38 smithi135 ceph-mon[99205]: Adjusting osd_memory_target on smithi161 to 5755M 2023-09-23T08:52:38.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:38 smithi135 ceph-mon[99205]: osdmap e62: 9 total, 9 up, 9 in 2023-09-23T08:52:38.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:38 smithi161 ceph-mon[99580]: Detected new or changed devices on smithi161 2023-09-23T08:52:38.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:38 smithi161 ceph-mon[99580]: Adjusting osd_memory_target on smithi161 to 5755M 2023-09-23T08:52:38.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:38 smithi161 ceph-mon[99580]: osdmap e62: 9 total, 9 up, 9 in 2023-09-23T08:52:39.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:52:39.112+0000 7fad808ad700 1 -- 172.21.15.82:0/2704905857 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad7c1009b0 msgr2=0x7fad7c100dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:52:39.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:52:39.112+0000 7fad808ad700 1 --2- 172.21.15.82:0/2704905857 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad7c1009b0 0x7fad7c100dd0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fad6c0099c0 tx=0x7fad6c009cd0 comp rx=0 tx=0).stop 2023-09-23T08:52:39.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:52:39.112+0000 7fad808ad700 1 -- 172.21.15.82:0/2704905857 shutdown_connections 2023-09-23T08:52:39.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:52:39.112+0000 7fad808ad700 1 --2- 172.21.15.82:0/2704905857 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad7c102550 0x7fad7c108e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:52:39.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:52:39.112+0000 7fad808ad700 1 --2- 172.21.15.82:0/2704905857 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad7c1009b0 0x7fad7c100dd0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:52:39.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:52:39.112+0000 7fad808ad700 1 --2- 172.21.15.82:0/2704905857 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad7c101bb0 0x7fad7c102010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:52:39.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:52:39.112+0000 7fad808ad700 1 -- 172.21.15.82:0/2704905857 >> 172.21.15.82:0/2704905857 conn(0x7fad7c0fbf10 msgr2=0x7fad7c0fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:52:39.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:52:39.112+0000 7fad808ad700 1 -- 172.21.15.82:0/2704905857 shutdown_connections 2023-09-23T08:52:39.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:52:39.112+0000 7fad808ad700 1 -- 172.21.15.82:0/2704905857 wait complete. 2023-09-23T08:52:39.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:52:39.113+0000 7fad808ad700 1 Processor -- start 2023-09-23T08:52:39.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:52:39.114+0000 7fad808ad700 1 -- start start 2023-09-23T08:52:39.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:52:39.114+0000 7fad808ad700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad7c1009b0 0x7fad7c1965a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:52:39.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:52:39.114+0000 7fad808ad700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad7c101bb0 0x7fad7c196ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:52:39.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:52:39.114+0000 7fad808ad700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad7c102550 0x7fad7c19db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:52:39.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:52:39.114+0000 7fad808ad700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad7c19e130 con 0x7fad7c101bb0 2023-09-23T08:52:39.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:52:39.114+0000 7fad808ad700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad7c19e270 con 0x7fad7c102550 2023-09-23T08:52:39.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:52:39.114+0000 7fad808ad700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad7c19e400 con 0x7fad7c1009b0 2023-09-23T08:52:39.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:52:39.114+0000 7fad79d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad7c101bb0 0x7fad7c196ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:52:39.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:52:39.114+0000 7fad79d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad7c101bb0 0x7fad7c196ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38036/0 (socket says 172.21.15.82:38036) 2023-09-23T08:52:39.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:52:39.114+0000 7fad79d9b700 1 -- 172.21.15.82:0/2941215624 learned_addr learned my addr 172.21.15.82:0/2941215624 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:52:39.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:52:39.114+0000 7fad7a59c700 1 --2- 172.21.15.82:0/2941215624 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad7c1009b0 0x7fad7c1965a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:52:39.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:52:39.114+0000 7fad7ad9d700 1 --2- 172.21.15.82:0/2941215624 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad7c102550 0x7fad7c19db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:52:39.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:52:39.114+0000 7fad79d9b700 1 -- 172.21.15.82:0/2941215624 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad7c1009b0 msgr2=0x7fad7c1965a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:52:39.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:52:39.115+0000 7fad79d9b700 1 --2- 172.21.15.82:0/2941215624 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad7c1009b0 0x7fad7c1965a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:52:39.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:52:39.115+0000 7fad79d9b700 1 -- 172.21.15.82:0/2941215624 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad7c102550 msgr2=0x7fad7c19db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:52:39.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:52:39.115+0000 7fad79d9b700 1 --2- 172.21.15.82:0/2941215624 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad7c102550 0x7fad7c19db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:52:39.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:52:39.115+0000 7fad79d9b700 1 -- 172.21.15.82:0/2941215624 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad6c0095f0 con 0x7fad7c101bb0 2023-09-23T08:52:39.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:52:39.115+0000 7fad7ad9d700 1 --2- 172.21.15.82:0/2941215624 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad7c102550 0x7fad7c19db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T08:52:39.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:52:39.115+0000 7fad79d9b700 1 --2- 172.21.15.82:0/2941215624 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad7c101bb0 0x7fad7c196ae0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fad7000d9b0 tx=0x7fad7000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:52:39.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:52:39.115+0000 7fad6b7fe700 1 -- 172.21.15.82:0/2941215624 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad70004220 con 0x7fad7c101bb0 2023-09-23T08:52:39.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:52:39.115+0000 7fad808ad700 1 -- 172.21.15.82:0/2941215624 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad7c19e6e0 con 0x7fad7c101bb0 2023-09-23T08:52:39.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:52:39.115+0000 7fad6b7fe700 1 -- 172.21.15.82:0/2941215624 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fad70007640 con 0x7fad7c101bb0 2023-09-23T08:52:39.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:52:39.115+0000 7fad6b7fe700 1 -- 172.21.15.82:0/2941215624 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad70005620 con 0x7fad7c101bb0 2023-09-23T08:52:39.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:52:39.115+0000 7fad808ad700 1 -- 172.21.15.82:0/2941215624 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad7c19ebe0 con 0x7fad7c101bb0 2023-09-23T08:52:39.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:52:39.116+0000 7fad808ad700 1 -- 172.21.15.82:0/2941215624 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad7c108080 con 0x7fad7c101bb0 2023-09-23T08:52:39.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:52:39.118+0000 7fad6b7fe700 1 -- 172.21.15.82:0/2941215624 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 134671+0+0 (secure 0 0 0) 0x7fad70004750 con 0x7fad7c101bb0 2023-09-23T08:52:39.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:52:39.120+0000 7fad6b7fe700 1 --2- 172.21.15.82:0/2941215624 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fad6409ff50 0x7fad640a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:52:39.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:52:39.120+0000 7fad6b7fe700 1 -- 172.21.15.82:0/2941215624 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5858+0+0 (secure 0 0 0) 0x7fad700ca7b0 con 0x7fad7c101bb0 2023-09-23T08:52:39.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:52:39.120+0000 7fad7a59c700 1 --2- 172.21.15.82:0/2941215624 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fad6409ff50 0x7fad640a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:52:39.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:52:39.120+0000 7fad7a59c700 1 --2- 172.21.15.82:0/2941215624 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fad6409ff50 0x7fad640a2410 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fad6c006010 tx=0x7fad6c005e80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:52:39.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:52:39.123+0000 7fad6b7fe700 1 -- 172.21.15.82:0/2941215624 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7fad70094e30 con 0x7fad7c101bb0 2023-09-23T08:52:39.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:52:39.330+0000 7fad808ad700 1 -- 172.21.15.82:0/2941215624 --> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7fad7c02ce10 con 0x7fad6409ff50 2023-09-23T08:52:39.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:39 smithi135 ceph-mon[99205]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail 2023-09-23T08:52:39.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:39 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-23T08:52:39.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:39 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-23T08:52:39.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:39 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:52:39.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:39 smithi135 ceph-mon[99205]: osdmap e63: 9 total, 9 up, 9 in 2023-09-23T08:52:39.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:39 smithi082 ceph-mon[97694]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail 2023-09-23T08:52:39.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:39 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-23T08:52:39.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:39 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-23T08:52:39.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:39 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:52:39.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:39 smithi082 ceph-mon[97694]: osdmap e63: 9 total, 9 up, 9 in 2023-09-23T08:52:39.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:39 smithi161 ceph-mon[99580]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail 2023-09-23T08:52:39.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:39 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-23T08:52:39.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:39 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-23T08:52:39.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:39 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:52:39.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:39 smithi161 ceph-mon[99580]: osdmap e63: 9 total, 9 up, 9 in 2023-09-23T08:52:40.659 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:40 smithi082 ceph-mon[97694]: from='client.14436 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:52:40.660 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:40 smithi082 ceph-mon[97694]: osdmap e64: 9 total, 9 up, 9 in 2023-09-23T08:52:40.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:40 smithi135 ceph-mon[99205]: from='client.14436 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:52:40.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:40 smithi135 ceph-mon[99205]: osdmap e64: 9 total, 9 up, 9 in 2023-09-23T08:52:40.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:40 smithi161 ceph-mon[99580]: from='client.14436 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:52:40.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:40 smithi161 ceph-mon[99580]: osdmap e64: 9 total, 9 up, 9 in 2023-09-23T08:52:41.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:41 smithi135 ceph-mon[99205]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail 2023-09-23T08:52:41.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:41 smithi082 ceph-mon[97694]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail 2023-09-23T08:52:41.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:41 smithi161 ceph-mon[99580]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail 2023-09-23T08:52:42.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:42 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/3953131977' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c52ec819-4bc6-402f-9cd8-62539e519e6d"}]: dispatch 2023-09-23T08:52:42.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:42 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/3953131977' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c52ec819-4bc6-402f-9cd8-62539e519e6d"}]': finished 2023-09-23T08:52:42.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:42 smithi135 ceph-mon[99205]: osdmap e65: 10 total, 9 up, 10 in 2023-09-23T08:52:42.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:42 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-09-23T08:52:42.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:42 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/3953131977' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c52ec819-4bc6-402f-9cd8-62539e519e6d"}]: dispatch 2023-09-23T08:52:42.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:42 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/3953131977' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c52ec819-4bc6-402f-9cd8-62539e519e6d"}]': finished 2023-09-23T08:52:42.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:42 smithi082 ceph-mon[97694]: osdmap e65: 10 total, 9 up, 10 in 2023-09-23T08:52:42.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:42 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-09-23T08:52:42.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:42 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/3953131977' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c52ec819-4bc6-402f-9cd8-62539e519e6d"}]: dispatch 2023-09-23T08:52:42.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:42 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/3953131977' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c52ec819-4bc6-402f-9cd8-62539e519e6d"}]': finished 2023-09-23T08:52:42.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:42 smithi161 ceph-mon[99580]: osdmap e65: 10 total, 9 up, 10 in 2023-09-23T08:52:42.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:42 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-09-23T08:52:43.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:43 smithi135 ceph-mon[99205]: pgmap v214: 1 pgs: 1 peering; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 124 KiB/s, 0 objects/s recovering 2023-09-23T08:52:43.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:43 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/947876750' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-23T08:52:43.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:43 smithi082 ceph-mon[97694]: pgmap v214: 1 pgs: 1 peering; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 124 KiB/s, 0 objects/s recovering 2023-09-23T08:52:43.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:43 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/947876750' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-23T08:52:43.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:43 smithi161 ceph-mon[99580]: pgmap v214: 1 pgs: 1 peering; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 124 KiB/s, 0 objects/s recovering 2023-09-23T08:52:43.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:43 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/947876750' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-23T08:52:45.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:45 smithi135 ceph-mon[99205]: pgmap v216: 1 pgs: 1 peering; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 102 KiB/s, 0 objects/s recovering 2023-09-23T08:52:45.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:45 smithi082 ceph-mon[97694]: pgmap v216: 1 pgs: 1 peering; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 102 KiB/s, 0 objects/s recovering 2023-09-23T08:52:45.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:45 smithi161 ceph-mon[99580]: pgmap v216: 1 pgs: 1 peering; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 102 KiB/s, 0 objects/s recovering 2023-09-23T08:52:47.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:47 smithi135 ceph-mon[99205]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 87 KiB/s, 0 objects/s recovering 2023-09-23T08:52:47.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:47 smithi082 ceph-mon[97694]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 87 KiB/s, 0 objects/s recovering 2023-09-23T08:52:47.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:47 smithi161 ceph-mon[99580]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 87 KiB/s, 0 objects/s recovering 2023-09-23T08:52:49.775 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:49 smithi082 ceph-mon[97694]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-09-23T08:52:49.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:49 smithi135 ceph-mon[99205]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-09-23T08:52:49.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:49 smithi161 ceph-mon[99580]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-09-23T08:52:50.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:50 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-09-23T08:52:50.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:50 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:52:50.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:50 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-09-23T08:52:50.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:50 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:52:50.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:50 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-09-23T08:52:50.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:50 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:52:51.563 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:51 smithi082 ceph-mon[97694]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-09-23T08:52:51.564 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:51 smithi082 ceph-mon[97694]: Deploying daemon osd.9 on smithi082 2023-09-23T08:52:51.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:51 smithi135 ceph-mon[99205]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-09-23T08:52:51.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:51 smithi135 ceph-mon[99205]: Deploying daemon osd.9 on smithi082 2023-09-23T08:52:51.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:51 smithi161 ceph-mon[99580]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-09-23T08:52:51.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:51 smithi161 ceph-mon[99580]: Deploying daemon osd.9 on smithi082 2023-09-23T08:52:53.772 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:53 smithi082 ceph-mon[97694]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-09-23T08:52:53.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:53 smithi135 ceph-mon[99205]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-09-23T08:52:53.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:53 smithi161 ceph-mon[99580]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-09-23T08:52:55.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:55 smithi135 ceph-mon[99205]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-09-23T08:52:55.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:55 smithi082 ceph-mon[97694]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-09-23T08:52:55.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:55 smithi161 ceph-mon[99580]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-09-23T08:52:57.600 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:57 smithi082 ceph-mon[97694]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-09-23T08:52:57.600 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:57 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:52:57.600 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:57 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:52:57.600 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:57 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:52:57.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:57 smithi161 ceph-mon[99580]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-09-23T08:52:57.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:57 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:52:57.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:57 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:52:57.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:57 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:52:57.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:57 smithi135 ceph-mon[99205]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-09-23T08:52:57.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:57 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:52:57.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:57 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:52:57.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:57 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:52:59.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:52:59 smithi082 ceph-mon[97694]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-09-23T08:52:59.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:52:59 smithi161 ceph-mon[99580]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-09-23T08:52:59.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:52:59.802+0000 7fad6b7fe700 1 -- 172.21.15.82:0/2941215624 <== mgr.14152 v2:172.21.15.82:6800/3698954311 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fad7c02ce10 con 0x7fad6409ff50 2023-09-23T08:52:59.806 INFO:teuthology.orchestra.run.smithi082.stdout:Created osd(s) 9 on host 'smithi082' 2023-09-23T08:52:59.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:52:59.805+0000 7fad808ad700 1 -- 172.21.15.82:0/2941215624 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fad6409ff50 msgr2=0x7fad640a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:52:59.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:52:59.805+0000 7fad808ad700 1 --2- 172.21.15.82:0/2941215624 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fad6409ff50 0x7fad640a2410 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fad6c006010 tx=0x7fad6c005e80 comp rx=0 tx=0).stop 2023-09-23T08:52:59.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:52:59.805+0000 7fad808ad700 1 -- 172.21.15.82:0/2941215624 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad7c101bb0 msgr2=0x7fad7c196ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:52:59.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:52:59.805+0000 7fad808ad700 1 --2- 172.21.15.82:0/2941215624 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad7c101bb0 0x7fad7c196ae0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fad7000d9b0 tx=0x7fad7000dcc0 comp rx=0 tx=0).stop 2023-09-23T08:52:59.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:52:59.805+0000 7fad808ad700 1 -- 172.21.15.82:0/2941215624 shutdown_connections 2023-09-23T08:52:59.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:52:59.805+0000 7fad808ad700 1 --2- 172.21.15.82:0/2941215624 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fad6409ff50 0x7fad640a2410 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:52:59.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:52:59.805+0000 7fad808ad700 1 --2- 172.21.15.82:0/2941215624 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad7c102550 0x7fad7c19db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:52:59.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:52:59.805+0000 7fad808ad700 1 --2- 172.21.15.82:0/2941215624 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad7c1009b0 0x7fad7c1965a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:52:59.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:52:59.805+0000 7fad808ad700 1 --2- 172.21.15.82:0/2941215624 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad7c101bb0 0x7fad7c196ae0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:52:59.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:52:59.805+0000 7fad808ad700 1 -- 172.21.15.82:0/2941215624 >> 172.21.15.82:0/2941215624 conn(0x7fad7c0fbf10 msgr2=0x7fad7c1051c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:52:59.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:52:59.805+0000 7fad808ad700 1 -- 172.21.15.82:0/2941215624 shutdown_connections 2023-09-23T08:52:59.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:52:59.805+0000 7fad808ad700 1 -- 172.21.15.82:0/2941215624 wait complete. 2023-09-23T08:52:59.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:52:59 smithi135 ceph-mon[99205]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-09-23T08:53:00.358 DEBUG:teuthology.orchestra.run.smithi082:osd.9> sudo journalctl -f -n 0 -u ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@osd.9.service 2023-09-23T08:53:00.363 INFO:tasks.cephadm:Deploying osd.10 on smithi135 with /dev/vg_nvme/lv_1... 2023-09-23T08:53:00.363 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-09-23T08:53:00.438 INFO:journalctl@ceph.osd.9.smithi082.stdout:-- Logs begin at Sat 2023-09-23 08:29:32 UTC. -- 2023-09-23T08:53:00.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:00 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:00.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:00 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:00.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:00 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:53:00.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:00 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:53:00.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:00 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:00.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:00 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:00.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:00 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:00.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:00 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:53:00.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:00 smithi082 ceph-mon[97694]: from='osd.9 [v2:172.21.15.82:6826/1438762840,v1:172.21.15.82:6827/1438762840]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-09-23T08:53:00.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:00 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:00.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:00 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:00.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:00 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:53:00.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:00 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:53:00.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:00 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:00.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:00 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:00.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:00 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:00.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:00 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:53:00.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:00 smithi161 ceph-mon[99580]: from='osd.9 [v2:172.21.15.82:6826/1438762840,v1:172.21.15.82:6827/1438762840]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-09-23T08:53:00.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:00 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:00.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:00 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:00.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:00 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:53:00.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:00 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:53:00.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:00 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:00.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:00 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:00.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:00 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:00.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:00 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:53:00.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:00 smithi135 ceph-mon[99205]: from='osd.9 [v2:172.21.15.82:6826/1438762840,v1:172.21.15.82:6827/1438762840]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-09-23T08:53:01.095 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.b/config 2023-09-23T08:53:01.523 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:01 smithi082 ceph-mon[97694]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-09-23T08:53:01.523 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:01 smithi082 ceph-mon[97694]: from='osd.9 [v2:172.21.15.82:6826/1438762840,v1:172.21.15.82:6827/1438762840]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-09-23T08:53:01.524 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:01 smithi082 ceph-mon[97694]: osdmap e66: 10 total, 9 up, 10 in 2023-09-23T08:53:01.524 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:01 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-09-23T08:53:01.524 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:01 smithi082 ceph-mon[97694]: from='osd.9 [v2:172.21.15.82:6826/1438762840,v1:172.21.15.82:6827/1438762840]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2023-09-23T08:53:01.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:01 smithi161 ceph-mon[99580]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-09-23T08:53:01.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:01 smithi161 ceph-mon[99580]: from='osd.9 [v2:172.21.15.82:6826/1438762840,v1:172.21.15.82:6827/1438762840]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-09-23T08:53:01.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:01 smithi161 ceph-mon[99580]: osdmap e66: 10 total, 9 up, 10 in 2023-09-23T08:53:01.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:01 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-09-23T08:53:01.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:01 smithi161 ceph-mon[99580]: from='osd.9 [v2:172.21.15.82:6826/1438762840,v1:172.21.15.82:6827/1438762840]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2023-09-23T08:53:01.674 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:01 smithi135 ceph-mon[99205]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-09-23T08:53:01.674 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:01 smithi135 ceph-mon[99205]: from='osd.9 [v2:172.21.15.82:6826/1438762840,v1:172.21.15.82:6827/1438762840]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-09-23T08:53:01.674 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:01 smithi135 ceph-mon[99205]: osdmap e66: 10 total, 9 up, 10 in 2023-09-23T08:53:01.675 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:01 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-09-23T08:53:01.675 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:01 smithi135 ceph-mon[99205]: from='osd.9 [v2:172.21.15.82:6826/1438762840,v1:172.21.15.82:6827/1438762840]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2023-09-23T08:53:02.121 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 08:53:01 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T08:53:01.809+0000 7f5acdec4700 -1 osd.9 0 waiting for initial osdmap 2023-09-23T08:53:02.121 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 08:53:01 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T08:53:01.827+0000 7f5ac6cb3700 -1 osd.9 67 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-23T08:53:03.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:02 smithi135 ceph-mon[99205]: from='osd.9 [v2:172.21.15.82:6826/1438762840,v1:172.21.15.82:6827/1438762840]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2023-09-23T08:53:03.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:02 smithi135 ceph-mon[99205]: osdmap e67: 10 total, 9 up, 10 in 2023-09-23T08:53:03.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:02 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-09-23T08:53:03.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:02 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-09-23T08:53:03.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:02 smithi135 ceph-mon[99205]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-09-23T08:53:03.091 INFO:teuthology.orchestra.run.smithi135.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-09-23T08:53:03.091 INFO:teuthology.orchestra.run.smithi135.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-09-23T08:53:03.091 INFO:teuthology.orchestra.run.smithi135.stderr: stderr: 10+0 records in 2023-09-23T08:53:03.091 INFO:teuthology.orchestra.run.smithi135.stderr:10+0 records out 2023-09-23T08:53:03.091 INFO:teuthology.orchestra.run.smithi135.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0482998 s, 217 MB/s 2023-09-23T08:53:03.091 INFO:teuthology.orchestra.run.smithi135.stderr:--> Zapping successful for: 2023-09-23T08:53:03.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:02 smithi082 ceph-mon[97694]: from='osd.9 [v2:172.21.15.82:6826/1438762840,v1:172.21.15.82:6827/1438762840]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2023-09-23T08:53:03.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:02 smithi082 ceph-mon[97694]: osdmap e67: 10 total, 9 up, 10 in 2023-09-23T08:53:03.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:02 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-09-23T08:53:03.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:02 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-09-23T08:53:03.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:02 smithi082 ceph-mon[97694]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-09-23T08:53:03.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:02 smithi161 ceph-mon[99580]: from='osd.9 [v2:172.21.15.82:6826/1438762840,v1:172.21.15.82:6827/1438762840]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2023-09-23T08:53:03.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:02 smithi161 ceph-mon[99580]: osdmap e67: 10 total, 9 up, 10 in 2023-09-23T08:53:03.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:02 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-09-23T08:53:03.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:02 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-09-23T08:53:03.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:02 smithi161 ceph-mon[99580]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-09-23T08:53:03.669 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- ceph orch daemon add osd smithi135:vg_nvme/lv_1 2023-09-23T08:53:04.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:03 smithi135 ceph-mon[99205]: purged_snaps scrub starts 2023-09-23T08:53:04.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:03 smithi135 ceph-mon[99205]: purged_snaps scrub ok 2023-09-23T08:53:04.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:03 smithi135 ceph-mon[99205]: osd.9 [v2:172.21.15.82:6826/1438762840,v1:172.21.15.82:6827/1438762840] boot 2023-09-23T08:53:04.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:03 smithi135 ceph-mon[99205]: osdmap e68: 10 total, 10 up, 10 in 2023-09-23T08:53:04.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:03 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-09-23T08:53:04.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:03 smithi135 ceph-mon[99205]: Detected new or changed devices on smithi082 2023-09-23T08:53:04.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:03 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:04.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:03 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:04.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:03 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:53:04.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:03 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:53:04.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:03 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:53:04.064 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:03 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:53:04.064 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:03 smithi135 ceph-mon[99205]: Adjusting osd_memory_target on smithi082 to 4316M 2023-09-23T08:53:04.064 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:03 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:04.064 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:03 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:53:04.064 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:03 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:53:04.064 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:03 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:04.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:03 smithi082 ceph-mon[97694]: purged_snaps scrub starts 2023-09-23T08:53:04.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:03 smithi082 ceph-mon[97694]: purged_snaps scrub ok 2023-09-23T08:53:04.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:03 smithi082 ceph-mon[97694]: osd.9 [v2:172.21.15.82:6826/1438762840,v1:172.21.15.82:6827/1438762840] boot 2023-09-23T08:53:04.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:03 smithi082 ceph-mon[97694]: osdmap e68: 10 total, 10 up, 10 in 2023-09-23T08:53:04.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:03 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-09-23T08:53:04.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:03 smithi082 ceph-mon[97694]: Detected new or changed devices on smithi082 2023-09-23T08:53:04.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:03 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:04.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:03 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:04.122 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:03 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:53:04.122 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:03 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:53:04.122 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:03 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:53:04.122 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:03 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:53:04.122 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:03 smithi082 ceph-mon[97694]: Adjusting osd_memory_target on smithi082 to 4316M 2023-09-23T08:53:04.122 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:03 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:04.122 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:03 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:53:04.122 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:03 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:53:04.122 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:03 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:04.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:03 smithi161 ceph-mon[99580]: purged_snaps scrub starts 2023-09-23T08:53:04.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:03 smithi161 ceph-mon[99580]: purged_snaps scrub ok 2023-09-23T08:53:04.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:03 smithi161 ceph-mon[99580]: osd.9 [v2:172.21.15.82:6826/1438762840,v1:172.21.15.82:6827/1438762840] boot 2023-09-23T08:53:04.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:03 smithi161 ceph-mon[99580]: osdmap e68: 10 total, 10 up, 10 in 2023-09-23T08:53:04.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:03 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-09-23T08:53:04.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:03 smithi161 ceph-mon[99580]: Detected new or changed devices on smithi082 2023-09-23T08:53:04.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:03 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:04.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:03 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:04.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:03 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:53:04.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:03 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:53:04.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:03 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:53:04.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:03 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:53:04.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:03 smithi161 ceph-mon[99580]: Adjusting osd_memory_target on smithi082 to 4316M 2023-09-23T08:53:04.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:03 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:04.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:03 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:53:04.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:03 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:53:04.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:03 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:04.389 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.b/config 2023-09-23T08:53:05.195 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:05 smithi135 ceph-mon[99205]: osdmap e69: 10 total, 10 up, 10 in 2023-09-23T08:53:05.195 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:05 smithi135 ceph-mon[99205]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-09-23T08:53:05.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:05 smithi082 ceph-mon[97694]: osdmap e69: 10 total, 10 up, 10 in 2023-09-23T08:53:05.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:05 smithi082 ceph-mon[97694]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-09-23T08:53:05.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:05 smithi161 ceph-mon[99580]: osdmap e69: 10 total, 10 up, 10 in 2023-09-23T08:53:05.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:05 smithi161 ceph-mon[99580]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-09-23T08:53:05.779 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:53:05.776+0000 7f5b172b5700 1 -- 172.21.15.135:0/1727567804 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b10101bb0 msgr2=0x7f5b10102010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:53:05.779 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:53:05.776+0000 7f5b172b5700 1 --2- 172.21.15.135:0/1727567804 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b10101bb0 0x7f5b10102010 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5b000099c0 tx=0x7f5b00009cd0 comp rx=0 tx=0).stop 2023-09-23T08:53:05.779 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:53:05.776+0000 7f5b172b5700 1 -- 172.21.15.135:0/1727567804 shutdown_connections 2023-09-23T08:53:05.780 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:53:05.776+0000 7f5b172b5700 1 --2- 172.21.15.135:0/1727567804 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b10102550 0x7f5b10108e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:53:05.780 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:53:05.776+0000 7f5b172b5700 1 --2- 172.21.15.135:0/1727567804 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b101009b0 0x7f5b10100dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:53:05.780 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:53:05.776+0000 7f5b172b5700 1 --2- 172.21.15.135:0/1727567804 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b10101bb0 0x7f5b10102010 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:53:05.780 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:53:05.776+0000 7f5b172b5700 1 -- 172.21.15.135:0/1727567804 >> 172.21.15.135:0/1727567804 conn(0x7f5b100fbf10 msgr2=0x7f5b100fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:53:05.780 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:53:05.776+0000 7f5b172b5700 1 -- 172.21.15.135:0/1727567804 shutdown_connections 2023-09-23T08:53:05.780 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:53:05.776+0000 7f5b172b5700 1 -- 172.21.15.135:0/1727567804 wait complete. 2023-09-23T08:53:05.780 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:53:05.777+0000 7f5b172b5700 1 Processor -- start 2023-09-23T08:53:05.782 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:53:05.777+0000 7f5b172b5700 1 -- start start 2023-09-23T08:53:05.782 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:53:05.778+0000 7f5b172b5700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b101009b0 0x7f5b101987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:53:05.782 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:53:05.778+0000 7f5b172b5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b10101bb0 0x7f5b10198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:53:05.782 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:53:05.778+0000 7f5b172b5700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b10102550 0x7f5b1019fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:53:05.782 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:53:05.778+0000 7f5b172b5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b101a0370 con 0x7f5b10101bb0 2023-09-23T08:53:05.782 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:53:05.778+0000 7f5b172b5700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b101a04b0 con 0x7f5b101009b0 2023-09-23T08:53:05.783 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:53:05.778+0000 7f5b172b5700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b101a0640 con 0x7f5b10102550 2023-09-23T08:53:05.783 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:53:05.778+0000 7f5b15051700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b101009b0 0x7f5b101987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:53:05.783 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:53:05.778+0000 7f5b15051700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b101009b0 0x7f5b101987e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:38386/0 (socket says 172.21.15.135:38386) 2023-09-23T08:53:05.783 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:53:05.778+0000 7f5b15051700 1 -- 172.21.15.135:0/1907760160 learned_addr learned my addr 172.21.15.135:0/1907760160 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-09-23T08:53:05.783 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:53:05.778+0000 7f5b14850700 1 --2- 172.21.15.135:0/1907760160 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b10101bb0 0x7f5b10198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:53:05.783 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:53:05.778+0000 7f5b15852700 1 --2- 172.21.15.135:0/1907760160 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b10102550 0x7f5b1019fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:53:05.783 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:53:05.778+0000 7f5b15051700 1 -- 172.21.15.135:0/1907760160 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b10102550 msgr2=0x7f5b1019fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:53:05.783 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:53:05.778+0000 7f5b15051700 1 --2- 172.21.15.135:0/1907760160 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b10102550 0x7f5b1019fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:53:05.783 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:53:05.778+0000 7f5b15051700 1 -- 172.21.15.135:0/1907760160 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b10101bb0 msgr2=0x7f5b10198d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:53:05.784 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:53:05.779+0000 7f5b15051700 1 --2- 172.21.15.135:0/1907760160 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b10101bb0 0x7f5b10198d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:53:05.784 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:53:05.779+0000 7f5b15051700 1 -- 172.21.15.135:0/1907760160 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b000095f0 con 0x7f5b101009b0 2023-09-23T08:53:05.784 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:53:05.779+0000 7f5b15051700 1 --2- 172.21.15.135:0/1907760160 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b101009b0 0x7f5b101987e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c00d980 tx=0x7f5b0c00dc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:53:05.784 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:53:05.779+0000 7f5b067fc700 1 -- 172.21.15.135:0/1907760160 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c004020 con 0x7f5b101009b0 2023-09-23T08:53:05.784 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:53:05.779+0000 7f5b067fc700 1 -- 172.21.15.135:0/1907760160 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5b0c009730 con 0x7f5b101009b0 2023-09-23T08:53:05.784 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:53:05.779+0000 7f5b067fc700 1 -- 172.21.15.135:0/1907760160 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c003aa0 con 0x7f5b101009b0 2023-09-23T08:53:05.784 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:53:05.779+0000 7f5b172b5700 1 -- 172.21.15.135:0/1907760160 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b101a0920 con 0x7f5b101009b0 2023-09-23T08:53:05.784 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:53:05.779+0000 7f5b172b5700 1 -- 172.21.15.135:0/1907760160 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b101a0e20 con 0x7f5b101009b0 2023-09-23T08:53:05.785 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:53:05.780+0000 7f5b172b5700 1 -- 172.21.15.135:0/1907760160 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b10192ea0 con 0x7f5b101009b0 2023-09-23T08:53:05.785 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:53:05.782+0000 7f5b067fc700 1 -- 172.21.15.135:0/1907760160 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) v1 ==== 134671+0+0 (secure 0 0 0) 0x7f5b0c0098a0 con 0x7f5b101009b0 2023-09-23T08:53:05.786 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:53:05.784+0000 7f5b067fc700 1 --2- 172.21.15.135:0/1907760160 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f5afc09ffd0 0x7f5afc0a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:53:05.786 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:53:05.784+0000 7f5b067fc700 1 -- 172.21.15.135:0/1907760160 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6261+0+0 (secure 0 0 0) 0x7f5b0c0caa60 con 0x7f5b101009b0 2023-09-23T08:53:05.786 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:53:05.784+0000 7f5b14850700 1 --2- 172.21.15.135:0/1907760160 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f5afc09ffd0 0x7f5afc0a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:53:05.787 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:53:05.785+0000 7f5b14850700 1 --2- 172.21.15.135:0/1907760160 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f5afc09ffd0 0x7f5afc0a2490 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5b00006010 tx=0x7f5b00009f10 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:53:05.788 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:53:05.786+0000 7f5b067fc700 1 -- 172.21.15.135:0/1907760160 <== mon.2 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f5b0c094fd0 con 0x7f5b101009b0 2023-09-23T08:53:05.993 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:53:05.991+0000 7f5b172b5700 1 -- 172.21.15.135:0/1907760160 --> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f5b1002ceb0 con 0x7f5afc09ffd0 2023-09-23T08:53:06.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:06 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-23T08:53:06.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:06 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-23T08:53:06.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:06 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:53:06.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:06 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-23T08:53:06.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:06 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-23T08:53:06.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:06 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:53:06.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:06 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-23T08:53:06.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:06 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-23T08:53:06.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:06 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:53:07.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:07 smithi135 ceph-mon[99205]: from='client.24362 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:53:07.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:07 smithi135 ceph-mon[99205]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-09-23T08:53:07.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:07 smithi161 ceph-mon[99580]: from='client.24362 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:53:07.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:07 smithi161 ceph-mon[99580]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-09-23T08:53:07.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:07 smithi082 ceph-mon[97694]: from='client.24362 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:53:07.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:07 smithi082 ceph-mon[97694]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-09-23T08:53:09.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:09 smithi161 ceph-mon[99580]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-09-23T08:53:09.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:09 smithi161 ceph-mon[99580]: from='client.? 172.21.15.135:0/56023289' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1b16c795-1b91-4d46-ae5d-21b8332c1077"}]: dispatch 2023-09-23T08:53:09.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:09 smithi161 ceph-mon[99580]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1b16c795-1b91-4d46-ae5d-21b8332c1077"}]: dispatch 2023-09-23T08:53:09.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:09 smithi161 ceph-mon[99580]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1b16c795-1b91-4d46-ae5d-21b8332c1077"}]': finished 2023-09-23T08:53:09.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:09 smithi161 ceph-mon[99580]: osdmap e70: 11 total, 10 up, 11 in 2023-09-23T08:53:09.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:09 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-09-23T08:53:09.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:09 smithi135 ceph-mon[99205]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-09-23T08:53:09.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:09 smithi135 ceph-mon[99205]: from='client.? 172.21.15.135:0/56023289' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1b16c795-1b91-4d46-ae5d-21b8332c1077"}]: dispatch 2023-09-23T08:53:09.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:09 smithi135 ceph-mon[99205]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1b16c795-1b91-4d46-ae5d-21b8332c1077"}]: dispatch 2023-09-23T08:53:09.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:09 smithi135 ceph-mon[99205]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1b16c795-1b91-4d46-ae5d-21b8332c1077"}]': finished 2023-09-23T08:53:09.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:09 smithi135 ceph-mon[99205]: osdmap e70: 11 total, 10 up, 11 in 2023-09-23T08:53:09.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:09 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-09-23T08:53:09.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:09 smithi082 ceph-mon[97694]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-09-23T08:53:09.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:09 smithi082 ceph-mon[97694]: from='client.? 172.21.15.135:0/56023289' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1b16c795-1b91-4d46-ae5d-21b8332c1077"}]: dispatch 2023-09-23T08:53:09.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:09 smithi082 ceph-mon[97694]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1b16c795-1b91-4d46-ae5d-21b8332c1077"}]: dispatch 2023-09-23T08:53:09.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:09 smithi082 ceph-mon[97694]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1b16c795-1b91-4d46-ae5d-21b8332c1077"}]': finished 2023-09-23T08:53:09.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:09 smithi082 ceph-mon[97694]: osdmap e70: 11 total, 10 up, 11 in 2023-09-23T08:53:09.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:09 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-09-23T08:53:10.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:10 smithi161 ceph-mon[99580]: from='client.? 172.21.15.135:0/1378569148' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-23T08:53:10.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:10 smithi135 ceph-mon[99205]: from='client.? 172.21.15.135:0/1378569148' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-23T08:53:10.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:10 smithi082 ceph-mon[97694]: from='client.? 172.21.15.135:0/1378569148' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-23T08:53:11.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:11 smithi161 ceph-mon[99580]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-09-23T08:53:11.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:11 smithi135 ceph-mon[99205]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-09-23T08:53:11.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:11 smithi082 ceph-mon[97694]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-09-23T08:53:13.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:13 smithi161 ceph-mon[99580]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-09-23T08:53:13.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:13 smithi135 ceph-mon[99205]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-09-23T08:53:13.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:13 smithi082 ceph-mon[97694]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-09-23T08:53:15.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:15 smithi135 ceph-mon[99205]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-09-23T08:53:15.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:15 smithi082 ceph-mon[97694]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-09-23T08:53:15.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:15 smithi161 ceph-mon[99580]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-09-23T08:53:17.719 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:17 smithi135 ceph-mon[99205]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-09-23T08:53:17.719 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:17 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-09-23T08:53:17.719 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:17 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:53:17.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:17 smithi082 ceph-mon[97694]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-09-23T08:53:17.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:17 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-09-23T08:53:17.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:17 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:53:17.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:17 smithi161 ceph-mon[99580]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-09-23T08:53:17.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:17 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-09-23T08:53:17.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:17 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:53:18.685 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:18 smithi135 ceph-mon[99205]: Deploying daemon osd.10 on smithi135 2023-09-23T08:53:18.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:18 smithi082 ceph-mon[97694]: Deploying daemon osd.10 on smithi135 2023-09-23T08:53:18.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:18 smithi161 ceph-mon[99580]: Deploying daemon osd.10 on smithi135 2023-09-23T08:53:19.597 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:19 smithi135 ceph-mon[99205]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-09-23T08:53:19.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:19 smithi082 ceph-mon[97694]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-09-23T08:53:19.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:19 smithi161 ceph-mon[99580]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-09-23T08:53:21.706 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:21 smithi135 ceph-mon[99205]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-09-23T08:53:21.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:21 smithi082 ceph-mon[97694]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-09-23T08:53:21.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:21 smithi161 ceph-mon[99580]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-09-23T08:53:23.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:23 smithi135 ceph-mon[99205]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-09-23T08:53:23.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:23 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:23.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:23 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:23.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:23 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:53:23.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:23 smithi082 ceph-mon[97694]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-09-23T08:53:23.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:23 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:23.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:23 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:23.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:23 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:53:23.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:23 smithi161 ceph-mon[99580]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-09-23T08:53:23.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:23 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:23.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:23 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:23.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:23 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:53:25.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:25 smithi135 ceph-mon[99205]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-09-23T08:53:25.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:25 smithi082 ceph-mon[97694]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-09-23T08:53:25.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:25 smithi161 ceph-mon[99580]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-09-23T08:53:26.568 INFO:teuthology.orchestra.run.smithi135.stdout:Created osd(s) 10 on host 'smithi135' 2023-09-23T08:53:26.568 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:53:26.564+0000 7f5b067fc700 1 -- 172.21.15.135:0/1907760160 <== mgr.14152 v2:172.21.15.82:6800/3698954311 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7f5b1002ceb0 con 0x7f5afc09ffd0 2023-09-23T08:53:26.569 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:53:26.566+0000 7f5b172b5700 1 -- 172.21.15.135:0/1907760160 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f5afc09ffd0 msgr2=0x7f5afc0a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:53:26.570 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:53:26.566+0000 7f5b172b5700 1 --2- 172.21.15.135:0/1907760160 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f5afc09ffd0 0x7f5afc0a2490 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5b00006010 tx=0x7f5b00009f10 comp rx=0 tx=0).stop 2023-09-23T08:53:26.570 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:53:26.566+0000 7f5b172b5700 1 -- 172.21.15.135:0/1907760160 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b101009b0 msgr2=0x7f5b101987e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:53:26.570 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:53:26.566+0000 7f5b172b5700 1 --2- 172.21.15.135:0/1907760160 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b101009b0 0x7f5b101987e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c00d980 tx=0x7f5b0c00dc90 comp rx=0 tx=0).stop 2023-09-23T08:53:26.570 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:53:26.566+0000 7f5b172b5700 1 -- 172.21.15.135:0/1907760160 shutdown_connections 2023-09-23T08:53:26.570 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:53:26.566+0000 7f5b172b5700 1 --2- 172.21.15.135:0/1907760160 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f5afc09ffd0 0x7f5afc0a2490 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:53:26.570 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:53:26.566+0000 7f5b172b5700 1 --2- 172.21.15.135:0/1907760160 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b10102550 0x7f5b1019fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:53:26.570 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:53:26.566+0000 7f5b172b5700 1 --2- 172.21.15.135:0/1907760160 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b101009b0 0x7f5b101987e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:53:26.570 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:53:26.566+0000 7f5b172b5700 1 --2- 172.21.15.135:0/1907760160 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b10101bb0 0x7f5b10198d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:53:26.570 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:53:26.566+0000 7f5b172b5700 1 -- 172.21.15.135:0/1907760160 >> 172.21.15.135:0/1907760160 conn(0x7f5b100fbf10 msgr2=0x7f5b10107580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:53:26.571 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:53:26.566+0000 7f5b172b5700 1 -- 172.21.15.135:0/1907760160 shutdown_connections 2023-09-23T08:53:26.571 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-23T08:53:26.566+0000 7f5b172b5700 1 -- 172.21.15.135:0/1907760160 wait complete. 2023-09-23T08:53:27.015 DEBUG:teuthology.orchestra.run.smithi135:osd.10> sudo journalctl -f -n 0 -u ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@osd.10.service 2023-09-23T08:53:27.020 INFO:tasks.cephadm:Deploying osd.11 on smithi161 with /dev/vg_nvme/lv_1... 2023-09-23T08:53:27.020 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-09-23T08:53:27.093 INFO:journalctl@ceph.osd.10.smithi135.stdout:-- Logs begin at Sat 2023-09-23 08:29:30 UTC. -- 2023-09-23T08:53:27.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:27 smithi135 ceph-mon[99205]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-09-23T08:53:27.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:27 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:27.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:27 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:27.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:27 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:53:27.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:27 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:53:27.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:27 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:27.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:27 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:27.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:27 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:53:27.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:27 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:27.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:27 smithi135 ceph-mon[99205]: from='osd.10 [v2:172.21.15.135:6824/2853697851,v1:172.21.15.135:6825/2853697851]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-09-23T08:53:27.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:27 smithi135 ceph-mon[99205]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-09-23T08:53:27.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:27 smithi161 ceph-mon[99580]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-09-23T08:53:27.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:27 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:27.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:27 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:27.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:27 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:53:27.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:27 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:53:27.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:27 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:27.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:27 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:27.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:27 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:53:27.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:27 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:27.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:27 smithi161 ceph-mon[99580]: from='osd.10 [v2:172.21.15.135:6824/2853697851,v1:172.21.15.135:6825/2853697851]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-09-23T08:53:27.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:27 smithi161 ceph-mon[99580]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-09-23T08:53:27.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:27 smithi082 ceph-mon[97694]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-09-23T08:53:27.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:27 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:27.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:27 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:27.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:27 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:53:27.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:27 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:53:27.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:27 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:27.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:27 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:27.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:27 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:53:27.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:27 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:27.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:27 smithi082 ceph-mon[97694]: from='osd.10 [v2:172.21.15.135:6824/2853697851,v1:172.21.15.135:6825/2853697851]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-09-23T08:53:27.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:27 smithi082 ceph-mon[97694]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-09-23T08:53:27.754 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.c/config 2023-09-23T08:53:28.741 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:28 smithi161 ceph-mon[99580]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-09-23T08:53:28.741 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:28 smithi161 ceph-mon[99580]: osdmap e71: 11 total, 10 up, 11 in 2023-09-23T08:53:28.741 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:28 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-09-23T08:53:28.741 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:28 smithi161 ceph-mon[99580]: from='osd.10 [v2:172.21.15.135:6824/2853697851,v1:172.21.15.135:6825/2853697851]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2023-09-23T08:53:28.741 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:28 smithi161 ceph-mon[99580]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2023-09-23T08:53:28.741 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:28 smithi161 ceph-mon[99580]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-09-23T08:53:28.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:28 smithi135 ceph-mon[99205]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-09-23T08:53:28.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:28 smithi135 ceph-mon[99205]: osdmap e71: 11 total, 10 up, 11 in 2023-09-23T08:53:28.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:28 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-09-23T08:53:28.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:28 smithi135 ceph-mon[99205]: from='osd.10 [v2:172.21.15.135:6824/2853697851,v1:172.21.15.135:6825/2853697851]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2023-09-23T08:53:28.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:28 smithi135 ceph-mon[99205]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2023-09-23T08:53:28.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:28 smithi135 ceph-mon[99205]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-09-23T08:53:28.813 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 08:53:28 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T08:53:28.568+0000 7fa14b566700 -1 osd.10 0 waiting for initial osdmap 2023-09-23T08:53:28.813 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 08:53:28 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T08:53:28.586+0000 7fa145b58700 -1 osd.10 72 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-23T08:53:28.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:28 smithi082 ceph-mon[97694]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-09-23T08:53:28.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:28 smithi082 ceph-mon[97694]: osdmap e71: 11 total, 10 up, 11 in 2023-09-23T08:53:28.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:28 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-09-23T08:53:28.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:28 smithi082 ceph-mon[97694]: from='osd.10 [v2:172.21.15.135:6824/2853697851,v1:172.21.15.135:6825/2853697851]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2023-09-23T08:53:28.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:28 smithi082 ceph-mon[97694]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2023-09-23T08:53:28.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:28 smithi082 ceph-mon[97694]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-09-23T08:53:29.797 INFO:teuthology.orchestra.run.smithi161.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-09-23T08:53:29.798 INFO:teuthology.orchestra.run.smithi161.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-09-23T08:53:29.798 INFO:teuthology.orchestra.run.smithi161.stderr: stderr: 10+0 records in 2023-09-23T08:53:29.798 INFO:teuthology.orchestra.run.smithi161.stderr:10+0 records out 2023-09-23T08:53:29.798 INFO:teuthology.orchestra.run.smithi161.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0312609 s, 335 MB/s 2023-09-23T08:53:29.798 INFO:teuthology.orchestra.run.smithi161.stderr:--> Zapping successful for: 2023-09-23T08:53:29.837 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:29 smithi161 ceph-mon[99580]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2023-09-23T08:53:29.837 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:29 smithi161 ceph-mon[99580]: osdmap e72: 11 total, 10 up, 11 in 2023-09-23T08:53:29.837 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:29 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-09-23T08:53:29.837 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:29 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-09-23T08:53:29.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:29 smithi082 ceph-mon[97694]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2023-09-23T08:53:29.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:29 smithi082 ceph-mon[97694]: osdmap e72: 11 total, 10 up, 11 in 2023-09-23T08:53:29.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:29 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-09-23T08:53:29.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:29 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-09-23T08:53:30.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:29 smithi135 ceph-mon[99205]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2023-09-23T08:53:30.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:29 smithi135 ceph-mon[99205]: osdmap e72: 11 total, 10 up, 11 in 2023-09-23T08:53:30.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:29 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-09-23T08:53:30.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:29 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-09-23T08:53:30.328 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- ceph orch daemon add osd smithi161:vg_nvme/lv_1 2023-09-23T08:53:30.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:30 smithi082 ceph-mon[97694]: purged_snaps scrub starts 2023-09-23T08:53:30.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:30 smithi082 ceph-mon[97694]: purged_snaps scrub ok 2023-09-23T08:53:30.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:30 smithi082 ceph-mon[97694]: osd.10 [v2:172.21.15.135:6824/2853697851,v1:172.21.15.135:6825/2853697851] boot 2023-09-23T08:53:30.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:30 smithi082 ceph-mon[97694]: osdmap e73: 11 total, 11 up, 11 in 2023-09-23T08:53:30.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:30 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-09-23T08:53:30.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:30 smithi082 ceph-mon[97694]: Detected new or changed devices on smithi135 2023-09-23T08:53:30.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:30 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:30.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:30 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:30.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:30 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:53:30.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:30 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:53:30.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:30 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:53:30.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:30 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:53:30.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:30 smithi082 ceph-mon[97694]: Adjusting osd_memory_target on smithi135 to 4316M 2023-09-23T08:53:30.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:30 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:30.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:30 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:53:30.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:30 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:53:30.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:30 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:30.873 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:30 smithi082 ceph-mon[97694]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-09-23T08:53:30.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:30 smithi161 ceph-mon[99580]: purged_snaps scrub starts 2023-09-23T08:53:30.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:30 smithi161 ceph-mon[99580]: purged_snaps scrub ok 2023-09-23T08:53:30.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:30 smithi161 ceph-mon[99580]: osd.10 [v2:172.21.15.135:6824/2853697851,v1:172.21.15.135:6825/2853697851] boot 2023-09-23T08:53:30.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:30 smithi161 ceph-mon[99580]: osdmap e73: 11 total, 11 up, 11 in 2023-09-23T08:53:30.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:30 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-09-23T08:53:30.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:30 smithi161 ceph-mon[99580]: Detected new or changed devices on smithi135 2023-09-23T08:53:30.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:30 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:30.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:30 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:30.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:30 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:53:30.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:30 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:53:30.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:30 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:53:30.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:30 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:53:30.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:30 smithi161 ceph-mon[99580]: Adjusting osd_memory_target on smithi135 to 4316M 2023-09-23T08:53:30.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:30 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:30.900 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:30 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:53:30.900 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:30 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:53:30.900 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:30 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:30.900 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:30 smithi161 ceph-mon[99580]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-09-23T08:53:31.051 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.c/config 2023-09-23T08:53:31.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:30 smithi135 ceph-mon[99205]: purged_snaps scrub starts 2023-09-23T08:53:31.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:30 smithi135 ceph-mon[99205]: purged_snaps scrub ok 2023-09-23T08:53:31.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:30 smithi135 ceph-mon[99205]: osd.10 [v2:172.21.15.135:6824/2853697851,v1:172.21.15.135:6825/2853697851] boot 2023-09-23T08:53:31.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:30 smithi135 ceph-mon[99205]: osdmap e73: 11 total, 11 up, 11 in 2023-09-23T08:53:31.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:30 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-09-23T08:53:31.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:30 smithi135 ceph-mon[99205]: Detected new or changed devices on smithi135 2023-09-23T08:53:31.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:30 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:31.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:30 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:31.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:30 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:53:31.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:30 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:53:31.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:30 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:53:31.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:30 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:53:31.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:30 smithi135 ceph-mon[99205]: Adjusting osd_memory_target on smithi135 to 4316M 2023-09-23T08:53:31.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:30 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:31.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:30 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:53:31.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:30 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:53:31.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:30 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:31.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:30 smithi135 ceph-mon[99205]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-09-23T08:53:31.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:31 smithi082 ceph-mon[97694]: osdmap e74: 11 total, 11 up, 11 in 2023-09-23T08:53:31.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:31 smithi161 ceph-mon[99580]: osdmap e74: 11 total, 11 up, 11 in 2023-09-23T08:53:32.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:31 smithi135 ceph-mon[99205]: osdmap e74: 11 total, 11 up, 11 in 2023-09-23T08:53:32.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:53:32.546+0000 7fe4d2b67700 1 -- 172.21.15.161:0/2992642642 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe4cc1009b0 msgr2=0x7fe4cc100dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:53:32.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:53:32.546+0000 7fe4d2b67700 1 --2- 172.21.15.161:0/2992642642 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe4cc1009b0 0x7fe4cc100dd0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe4c0009990 tx=0x7fe4c0009ca0 comp rx=0 tx=0).stop 2023-09-23T08:53:32.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:53:32.546+0000 7fe4d2b67700 1 -- 172.21.15.161:0/2992642642 shutdown_connections 2023-09-23T08:53:32.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:53:32.546+0000 7fe4d2b67700 1 --2- 172.21.15.161:0/2992642642 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4cc102550 0x7fe4cc108e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:53:32.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:53:32.546+0000 7fe4d2b67700 1 --2- 172.21.15.161:0/2992642642 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe4cc1009b0 0x7fe4cc100dd0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:53:32.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:53:32.546+0000 7fe4d2b67700 1 --2- 172.21.15.161:0/2992642642 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4cc101bb0 0x7fe4cc102010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:53:32.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:53:32.546+0000 7fe4d2b67700 1 -- 172.21.15.161:0/2992642642 >> 172.21.15.161:0/2992642642 conn(0x7fe4cc0fbf10 msgr2=0x7fe4cc0fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:53:32.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:53:32.546+0000 7fe4d2b67700 1 -- 172.21.15.161:0/2992642642 shutdown_connections 2023-09-23T08:53:32.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:53:32.546+0000 7fe4d2b67700 1 -- 172.21.15.161:0/2992642642 wait complete. 2023-09-23T08:53:32.552 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:53:32.548+0000 7fe4d2b67700 1 Processor -- start 2023-09-23T08:53:32.552 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:53:32.548+0000 7fe4d2b67700 1 -- start start 2023-09-23T08:53:32.552 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:53:32.548+0000 7fe4d2b67700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4cc1009b0 0x7fe4cc198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:53:32.552 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:53:32.548+0000 7fe4d2b67700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe4cc101bb0 0x7fe4cc198d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:53:32.553 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:53:32.548+0000 7fe4d2b67700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4cc102550 0x7fe4cc19fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:53:32.553 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:53:32.548+0000 7fe4d2b67700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4cc1a03b0 con 0x7fe4cc1009b0 2023-09-23T08:53:32.553 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:53:32.548+0000 7fe4d2b67700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4cc1a04f0 con 0x7fe4cc102550 2023-09-23T08:53:32.553 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:53:32.548+0000 7fe4d2b67700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4cc1a0680 con 0x7fe4cc101bb0 2023-09-23T08:53:32.553 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:53:32.548+0000 7fe4cbfff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe4cc101bb0 0x7fe4cc198d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:53:32.553 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:53:32.548+0000 7fe4cbfff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe4cc101bb0 0x7fe4cc198d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:45966/0 (socket says 172.21.15.161:45966) 2023-09-23T08:53:32.553 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:53:32.548+0000 7fe4cbfff700 1 -- 172.21.15.161:0/3603827389 learned_addr learned my addr 172.21.15.161:0/3603827389 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-09-23T08:53:32.553 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:53:32.549+0000 7fe4d1104700 1 --2- 172.21.15.161:0/3603827389 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4cc102550 0x7fe4cc19fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:53:32.553 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:53:32.549+0000 7fe4d0903700 1 --2- 172.21.15.161:0/3603827389 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4cc1009b0 0x7fe4cc198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:53:32.553 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:53:32.549+0000 7fe4cbfff700 1 -- 172.21.15.161:0/3603827389 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4cc102550 msgr2=0x7fe4cc19fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:53:32.554 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:53:32.549+0000 7fe4cbfff700 1 --2- 172.21.15.161:0/3603827389 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4cc102550 0x7fe4cc19fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:53:32.554 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:53:32.549+0000 7fe4cbfff700 1 -- 172.21.15.161:0/3603827389 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4cc1009b0 msgr2=0x7fe4cc198820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:53:32.554 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:53:32.549+0000 7fe4cbfff700 1 --2- 172.21.15.161:0/3603827389 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4cc1009b0 0x7fe4cc198820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:53:32.554 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:53:32.549+0000 7fe4cbfff700 1 -- 172.21.15.161:0/3603827389 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4c4009c40 con 0x7fe4cc101bb0 2023-09-23T08:53:32.554 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:53:32.549+0000 7fe4cbfff700 1 --2- 172.21.15.161:0/3603827389 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe4cc101bb0 0x7fe4cc198d60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe4b800e9f0 tx=0x7fe4b800ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:53:32.554 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:53:32.549+0000 7fe4c9ffb700 1 -- 172.21.15.161:0/3603827389 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b80097b0 con 0x7fe4cc101bb0 2023-09-23T08:53:32.554 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:53:32.549+0000 7fe4c9ffb700 1 -- 172.21.15.161:0/3603827389 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe4b800ee80 con 0x7fe4cc101bb0 2023-09-23T08:53:32.554 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:53:32.549+0000 7fe4d2b67700 1 -- 172.21.15.161:0/3603827389 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4c00095f0 con 0x7fe4cc101bb0 2023-09-23T08:53:32.554 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:53:32.549+0000 7fe4c9ffb700 1 -- 172.21.15.161:0/3603827389 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b80054a0 con 0x7fe4cc101bb0 2023-09-23T08:53:32.554 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:53:32.549+0000 7fe4d2b67700 1 -- 172.21.15.161:0/3603827389 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4cc1a0cd0 con 0x7fe4cc101bb0 2023-09-23T08:53:32.555 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:53:32.550+0000 7fe4d2b67700 1 -- 172.21.15.161:0/3603827389 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4cc192ec0 con 0x7fe4cc101bb0 2023-09-23T08:53:32.555 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:53:32.553+0000 7fe4c9ffb700 1 -- 172.21.15.161:0/3603827389 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 16) v1 ==== 134671+0+0 (secure 0 0 0) 0x7fe4b8005600 con 0x7fe4cc101bb0 2023-09-23T08:53:32.556 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:53:32.554+0000 7fe4c9ffb700 1 --2- 172.21.15.161:0/3603827389 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fe4bc09ffd0 0x7fe4bc0a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:53:32.556 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:53:32.554+0000 7fe4c9ffb700 1 -- 172.21.15.161:0/3603827389 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6723+0+0 (secure 0 0 0) 0x7fe4b8014070 con 0x7fe4cc101bb0 2023-09-23T08:53:32.557 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:53:32.554+0000 7fe4d0903700 1 --2- 172.21.15.161:0/3603827389 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fe4bc09ffd0 0x7fe4bc0a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:53:32.557 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:53:32.555+0000 7fe4d0903700 1 --2- 172.21.15.161:0/3603827389 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fe4bc09ffd0 0x7fe4bc0a2490 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe4c000b2e0 tx=0x7fe4c0005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:53:32.559 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:53:32.556+0000 7fe4c9ffb700 1 -- 172.21.15.161:0/3603827389 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7fe4b8095340 con 0x7fe4cc101bb0 2023-09-23T08:53:32.768 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:53:32.765+0000 7fe4d2b67700 1 -- 172.21.15.161:0/3603827389 --> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi161:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7fe4cc02cda0 con 0x7fe4bc09ffd0 2023-09-23T08:53:32.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:32 smithi082 ceph-mon[97694]: osdmap e75: 11 total, 11 up, 11 in 2023-09-23T08:53:32.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:32 smithi082 ceph-mon[97694]: pgmap v250: 1 pgs: 1 remapped+peering; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-09-23T08:53:32.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:32 smithi161 ceph-mon[99580]: osdmap e75: 11 total, 11 up, 11 in 2023-09-23T08:53:32.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:32 smithi161 ceph-mon[99580]: pgmap v250: 1 pgs: 1 remapped+peering; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-09-23T08:53:33.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:32 smithi135 ceph-mon[99205]: osdmap e75: 11 total, 11 up, 11 in 2023-09-23T08:53:33.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:32 smithi135 ceph-mon[99205]: pgmap v250: 1 pgs: 1 remapped+peering; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-09-23T08:53:33.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:33 smithi082 ceph-mon[97694]: osdmap e76: 11 total, 11 up, 11 in 2023-09-23T08:53:33.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:33 smithi082 ceph-mon[97694]: from='client.24394 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi161:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:53:33.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:33 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-23T08:53:33.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:33 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-23T08:53:33.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:33 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:53:33.883 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:33 smithi161 ceph-mon[99580]: osdmap e76: 11 total, 11 up, 11 in 2023-09-23T08:53:33.883 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:33 smithi161 ceph-mon[99580]: from='client.24394 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi161:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:53:33.884 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:33 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-23T08:53:33.884 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:33 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-23T08:53:33.884 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:33 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:53:34.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:33 smithi135 ceph-mon[99205]: osdmap e76: 11 total, 11 up, 11 in 2023-09-23T08:53:34.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:33 smithi135 ceph-mon[99205]: from='client.24394 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi161:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:53:34.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:33 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-23T08:53:34.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:33 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-23T08:53:34.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:33 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:53:34.819 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:34 smithi161 ceph-mon[99580]: osdmap e77: 11 total, 11 up, 11 in 2023-09-23T08:53:34.819 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:34 smithi161 ceph-mon[99580]: pgmap v253: 1 pgs: 1 remapped+peering; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-09-23T08:53:34.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:34 smithi082 ceph-mon[97694]: osdmap e77: 11 total, 11 up, 11 in 2023-09-23T08:53:34.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:34 smithi082 ceph-mon[97694]: pgmap v253: 1 pgs: 1 remapped+peering; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-09-23T08:53:35.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:34 smithi135 ceph-mon[99205]: osdmap e77: 11 total, 11 up, 11 in 2023-09-23T08:53:35.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:34 smithi135 ceph-mon[99205]: pgmap v253: 1 pgs: 1 remapped+peering; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-09-23T08:53:36.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:35 smithi082 ceph-mon[97694]: from='client.? 172.21.15.161:0/3075559532' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2551e602-4fe1-41cb-9b7d-c8b31fdd1487"}]: dispatch 2023-09-23T08:53:36.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:35 smithi082 ceph-mon[97694]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2551e602-4fe1-41cb-9b7d-c8b31fdd1487"}]: dispatch 2023-09-23T08:53:36.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:35 smithi082 ceph-mon[97694]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2551e602-4fe1-41cb-9b7d-c8b31fdd1487"}]': finished 2023-09-23T08:53:36.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:35 smithi082 ceph-mon[97694]: osdmap e78: 12 total, 11 up, 12 in 2023-09-23T08:53:36.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:35 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-09-23T08:53:36.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:35 smithi161 ceph-mon[99580]: from='client.? 172.21.15.161:0/3075559532' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2551e602-4fe1-41cb-9b7d-c8b31fdd1487"}]: dispatch 2023-09-23T08:53:36.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:35 smithi161 ceph-mon[99580]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2551e602-4fe1-41cb-9b7d-c8b31fdd1487"}]: dispatch 2023-09-23T08:53:36.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:35 smithi161 ceph-mon[99580]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2551e602-4fe1-41cb-9b7d-c8b31fdd1487"}]': finished 2023-09-23T08:53:36.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:35 smithi161 ceph-mon[99580]: osdmap e78: 12 total, 11 up, 12 in 2023-09-23T08:53:36.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:35 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-09-23T08:53:36.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:35 smithi135 ceph-mon[99205]: from='client.? 172.21.15.161:0/3075559532' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2551e602-4fe1-41cb-9b7d-c8b31fdd1487"}]: dispatch 2023-09-23T08:53:36.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:35 smithi135 ceph-mon[99205]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2551e602-4fe1-41cb-9b7d-c8b31fdd1487"}]: dispatch 2023-09-23T08:53:36.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:35 smithi135 ceph-mon[99205]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2551e602-4fe1-41cb-9b7d-c8b31fdd1487"}]': finished 2023-09-23T08:53:36.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:35 smithi135 ceph-mon[99205]: osdmap e78: 12 total, 11 up, 12 in 2023-09-23T08:53:36.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:35 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-09-23T08:53:37.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:37 smithi161 ceph-mon[99580]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 983 GiB / 983 GiB avail; 130 KiB/s, 0 objects/s recovering 2023-09-23T08:53:37.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:37 smithi161 ceph-mon[99580]: from='client.? 172.21.15.161:0/1842015523' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-23T08:53:37.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:37 smithi135 ceph-mon[99205]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 983 GiB / 983 GiB avail; 130 KiB/s, 0 objects/s recovering 2023-09-23T08:53:37.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:37 smithi135 ceph-mon[99205]: from='client.? 172.21.15.161:0/1842015523' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-23T08:53:37.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:37 smithi082 ceph-mon[97694]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 983 GiB / 983 GiB avail; 130 KiB/s, 0 objects/s recovering 2023-09-23T08:53:37.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:37 smithi082 ceph-mon[97694]: from='client.? 172.21.15.161:0/1842015523' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-23T08:53:39.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:39 smithi161 ceph-mon[99580]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-09-23T08:53:39.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:39 smithi135 ceph-mon[99205]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-09-23T08:53:39.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:39 smithi082 ceph-mon[97694]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-09-23T08:53:41.646 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:41 smithi161 ceph-mon[99580]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 983 GiB / 983 GiB avail; 77 KiB/s, 0 objects/s recovering 2023-09-23T08:53:41.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:41 smithi135 ceph-mon[99205]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 983 GiB / 983 GiB avail; 77 KiB/s, 0 objects/s recovering 2023-09-23T08:53:41.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:41 smithi082 ceph-mon[97694]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 983 GiB / 983 GiB avail; 77 KiB/s, 0 objects/s recovering 2023-09-23T08:53:43.550 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:43 smithi161 ceph-mon[99580]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 983 GiB / 983 GiB avail; 68 KiB/s, 0 objects/s recovering 2023-09-23T08:53:43.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:43 smithi135 ceph-mon[99205]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 983 GiB / 983 GiB avail; 68 KiB/s, 0 objects/s recovering 2023-09-23T08:53:43.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:43 smithi082 ceph-mon[97694]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 983 GiB / 983 GiB avail; 68 KiB/s, 0 objects/s recovering 2023-09-23T08:53:44.723 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:44 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-09-23T08:53:44.724 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:44 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:53:44.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:44 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-09-23T08:53:44.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:44 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:53:44.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:44 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-09-23T08:53:44.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:44 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:53:45.683 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:45 smithi161 ceph-mon[99580]: Deploying daemon osd.11 on smithi161 2023-09-23T08:53:45.683 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:45 smithi161 ceph-mon[99580]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-09-23T08:53:45.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:45 smithi135 ceph-mon[99205]: Deploying daemon osd.11 on smithi161 2023-09-23T08:53:45.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:45 smithi135 ceph-mon[99205]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-09-23T08:53:45.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:45 smithi082 ceph-mon[97694]: Deploying daemon osd.11 on smithi161 2023-09-23T08:53:45.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:45 smithi082 ceph-mon[97694]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-09-23T08:53:47.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:47 smithi135 ceph-mon[99205]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 983 GiB / 983 GiB avail 2023-09-23T08:53:47.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:47 smithi082 ceph-mon[97694]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 983 GiB / 983 GiB avail 2023-09-23T08:53:47.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:47 smithi161 ceph-mon[99580]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 983 GiB / 983 GiB avail 2023-09-23T08:53:49.680 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:49 smithi161 ceph-mon[99580]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 983 GiB / 983 GiB avail 2023-09-23T08:53:49.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:49 smithi135 ceph-mon[99205]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 983 GiB / 983 GiB avail 2023-09-23T08:53:49.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:49 smithi082 ceph-mon[97694]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 983 GiB / 983 GiB avail 2023-09-23T08:53:51.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:50 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:51.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:50 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:51.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:50 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:53:51.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:50 smithi161 ceph-mon[99580]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 983 GiB / 983 GiB avail 2023-09-23T08:53:51.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:50 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:51.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:50 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:51.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:50 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:53:51.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:50 smithi135 ceph-mon[99205]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 983 GiB / 983 GiB avail 2023-09-23T08:53:51.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:50 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:51.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:50 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:51.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:50 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:53:51.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:50 smithi082 ceph-mon[97694]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 983 GiB / 983 GiB avail 2023-09-23T08:53:53.144 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:53:53.141+0000 7fe4c9ffb700 1 -- 172.21.15.161:0/3603827389 <== mgr.14152 v2:172.21.15.82:6800/3698954311 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7fe4cc02cda0 con 0x7fe4bc09ffd0 2023-09-23T08:53:53.144 INFO:teuthology.orchestra.run.smithi161.stdout:Created osd(s) 11 on host 'smithi161' 2023-09-23T08:53:53.146 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:53:53.143+0000 7fe4d2b67700 1 -- 172.21.15.161:0/3603827389 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fe4bc09ffd0 msgr2=0x7fe4bc0a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:53:53.146 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:53:53.143+0000 7fe4d2b67700 1 --2- 172.21.15.161:0/3603827389 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fe4bc09ffd0 0x7fe4bc0a2490 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe4c000b2e0 tx=0x7fe4c0005fd0 comp rx=0 tx=0).stop 2023-09-23T08:53:53.146 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:53:53.143+0000 7fe4d2b67700 1 -- 172.21.15.161:0/3603827389 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe4cc101bb0 msgr2=0x7fe4cc198d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:53:53.146 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:53:53.143+0000 7fe4d2b67700 1 --2- 172.21.15.161:0/3603827389 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe4cc101bb0 0x7fe4cc198d60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe4b800e9f0 tx=0x7fe4b800ed00 comp rx=0 tx=0).stop 2023-09-23T08:53:53.146 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:53:53.143+0000 7fe4d2b67700 1 -- 172.21.15.161:0/3603827389 shutdown_connections 2023-09-23T08:53:53.147 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:53:53.143+0000 7fe4d2b67700 1 --2- 172.21.15.161:0/3603827389 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fe4bc09ffd0 0x7fe4bc0a2490 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:53:53.147 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:53:53.143+0000 7fe4d2b67700 1 --2- 172.21.15.161:0/3603827389 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4cc102550 0x7fe4cc19fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:53:53.147 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:53:53.143+0000 7fe4d2b67700 1 --2- 172.21.15.161:0/3603827389 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4cc1009b0 0x7fe4cc198820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:53:53.147 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:53:53.143+0000 7fe4d2b67700 1 --2- 172.21.15.161:0/3603827389 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe4cc101bb0 0x7fe4cc198d60 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:53:53.147 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:53:53.143+0000 7fe4d2b67700 1 -- 172.21.15.161:0/3603827389 >> 172.21.15.161:0/3603827389 conn(0x7fe4cc0fbf10 msgr2=0x7fe4cc1075d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:53:53.147 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:53:53.143+0000 7fe4d2b67700 1 -- 172.21.15.161:0/3603827389 shutdown_connections 2023-09-23T08:53:53.147 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:53:53.143+0000 7fe4d2b67700 1 -- 172.21.15.161:0/3603827389 wait complete. 2023-09-23T08:53:53.581 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:53 smithi161 ceph-mon[99580]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 983 GiB / 983 GiB avail 2023-09-23T08:53:53.581 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:53 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:53.582 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:53 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:53.680 DEBUG:teuthology.orchestra.run.smithi161:osd.11> sudo journalctl -f -n 0 -u ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@osd.11.service 2023-09-23T08:53:53.684 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2023-09-23T08:53:53.685 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- ceph osd stat -f json 2023-09-23T08:53:53.754 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:53 smithi082 ceph-mon[97694]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 983 GiB / 983 GiB avail 2023-09-23T08:53:53.754 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:53 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:53.754 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:53 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:53.756 INFO:journalctl@ceph.osd.11.smithi161.stdout:-- Logs begin at Sat 2023-09-23 08:29:48 UTC. -- 2023-09-23T08:53:53.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:53 smithi135 ceph-mon[99205]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 983 GiB / 983 GiB avail 2023-09-23T08:53:53.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:53 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:53.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:53 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:54.148 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 08:53:53 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T08:53:53.892+0000 7f3d7fa99640 -1 osd.11 0 log_to_monitors true 2023-09-23T08:53:54.414 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.a/config 2023-09-23T08:53:54.765 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:54 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:54.765 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:54 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:54.765 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:54 smithi161 ceph-mon[99580]: from='osd.11 [v2:172.21.15.161:6824/1459332081,v1:172.21.15.161:6825/1459332081]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-09-23T08:53:54.766 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:54 smithi161 ceph-mon[99580]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-09-23T08:53:54.766 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:54 smithi161 ceph-mon[99580]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 983 GiB / 983 GiB avail 2023-09-23T08:53:54.766 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:54 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:54.767 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:54 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:54.767 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:54 smithi082 ceph-mon[97694]: from='osd.11 [v2:172.21.15.161:6824/1459332081,v1:172.21.15.161:6825/1459332081]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-09-23T08:53:54.767 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:54 smithi082 ceph-mon[97694]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-09-23T08:53:54.767 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:54 smithi082 ceph-mon[97694]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 983 GiB / 983 GiB avail 2023-09-23T08:53:54.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:54 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:54.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:54 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:54.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:54 smithi135 ceph-mon[99205]: from='osd.11 [v2:172.21.15.161:6824/1459332081,v1:172.21.15.161:6825/1459332081]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-09-23T08:53:54.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:54 smithi135 ceph-mon[99205]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-09-23T08:53:54.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:54 smithi135 ceph-mon[99205]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 983 GiB / 983 GiB avail 2023-09-23T08:53:55.548 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 08:53:55 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T08:53:55.527+0000 7f3d74910700 -1 osd.11 0 waiting for initial osdmap 2023-09-23T08:53:55.549 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:55 smithi161 ceph-mon[99580]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-09-23T08:53:55.549 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:55 smithi161 ceph-mon[99580]: osdmap e79: 12 total, 11 up, 12 in 2023-09-23T08:53:55.549 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:55 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-09-23T08:53:55.549 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:55 smithi161 ceph-mon[99580]: from='osd.11 [v2:172.21.15.161:6824/1459332081,v1:172.21.15.161:6825/1459332081]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2023-09-23T08:53:55.549 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:55 smithi161 ceph-mon[99580]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2023-09-23T08:53:55.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:55.792+0000 7fa63fb7a700 1 -- 172.21.15.82:0/791681870 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa6381009b0 msgr2=0x7fa638100dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:53:55.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:55.792+0000 7fa63fb7a700 1 --2- 172.21.15.82:0/791681870 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa6381009b0 0x7fa638100dd0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa6340099c0 tx=0x7fa634009cd0 comp rx=0 tx=0).stop 2023-09-23T08:53:55.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:55.792+0000 7fa63fb7a700 1 -- 172.21.15.82:0/791681870 shutdown_connections 2023-09-23T08:53:55.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:55.792+0000 7fa63fb7a700 1 --2- 172.21.15.82:0/791681870 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa638102550 0x7fa638108e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:53:55.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:55.792+0000 7fa63fb7a700 1 --2- 172.21.15.82:0/791681870 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa6381009b0 0x7fa638100dd0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:53:55.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:55.792+0000 7fa63fb7a700 1 --2- 172.21.15.82:0/791681870 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa638101bb0 0x7fa638102010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:53:55.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:55.792+0000 7fa63fb7a700 1 -- 172.21.15.82:0/791681870 >> 172.21.15.82:0/791681870 conn(0x7fa6380fbf10 msgr2=0x7fa6380fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:53:55.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:55.792+0000 7fa63fb7a700 1 -- 172.21.15.82:0/791681870 shutdown_connections 2023-09-23T08:53:55.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:55.793+0000 7fa63fb7a700 1 -- 172.21.15.82:0/791681870 wait complete. 2023-09-23T08:53:55.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:55.794+0000 7fa63fb7a700 1 Processor -- start 2023-09-23T08:53:55.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:55.794+0000 7fa63fb7a700 1 -- start start 2023-09-23T08:53:55.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:55.794+0000 7fa63fb7a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6381009b0 0x7fa6381964f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:53:55.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:55.794+0000 7fa63fb7a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa638101bb0 0x7fa638196a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:53:55.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:55.794+0000 7fa63fb7a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa638102550 0x7fa63819dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:53:55.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:55.794+0000 7fa63fb7a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa63819e080 con 0x7fa638102550 2023-09-23T08:53:55.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:55.794+0000 7fa63fb7a700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa63819e1c0 con 0x7fa6381009b0 2023-09-23T08:53:55.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:55.794+0000 7fa63fb7a700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa63819e350 con 0x7fa638101bb0 2023-09-23T08:53:55.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:55.794+0000 7fa63e117700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa638102550 0x7fa63819dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:53:55.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:55.794+0000 7fa63d916700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6381009b0 0x7fa6381964f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:53:55.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:55.794+0000 7fa63d115700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa638101bb0 0x7fa638196a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:53:55.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:55.794+0000 7fa63e117700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa638102550 0x7fa63819dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56354/0 (socket says 172.21.15.82:56354) 2023-09-23T08:53:55.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:55.794+0000 7fa63e117700 1 -- 172.21.15.82:0/1484065996 learned_addr learned my addr 172.21.15.82:0/1484065996 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:53:55.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:55.795+0000 7fa63e117700 1 -- 172.21.15.82:0/1484065996 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa638101bb0 msgr2=0x7fa638196a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:53:55.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:55.795+0000 7fa63e117700 1 --2- 172.21.15.82:0/1484065996 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa638101bb0 0x7fa638196a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:53:55.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:55.795+0000 7fa63e117700 1 -- 172.21.15.82:0/1484065996 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6381009b0 msgr2=0x7fa6381964f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:53:55.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:55.795+0000 7fa63e117700 1 --2- 172.21.15.82:0/1484065996 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6381009b0 0x7fa6381964f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:53:55.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:55.795+0000 7fa63e117700 1 -- 172.21.15.82:0/1484065996 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6340095f0 con 0x7fa638102550 2023-09-23T08:53:55.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:55.795+0000 7fa63e117700 1 --2- 172.21.15.82:0/1484065996 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa638102550 0x7fa63819dab0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa630007da0 tx=0x7fa63000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:53:55.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:55.795+0000 7fa62effd700 1 -- 172.21.15.82:0/1484065996 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa63000ac50 con 0x7fa638102550 2023-09-23T08:53:55.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:55.795+0000 7fa62effd700 1 -- 172.21.15.82:0/1484065996 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa63000adb0 con 0x7fa638102550 2023-09-23T08:53:55.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:55.795+0000 7fa63fb7a700 1 -- 172.21.15.82:0/1484065996 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa63819e630 con 0x7fa638102550 2023-09-23T08:53:55.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:55.795+0000 7fa62effd700 1 -- 172.21.15.82:0/1484065996 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6300115e0 con 0x7fa638102550 2023-09-23T08:53:55.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:55.795+0000 7fa63fb7a700 1 -- 172.21.15.82:0/1484065996 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa63819eae0 con 0x7fa638102550 2023-09-23T08:53:55.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:55.796+0000 7fa63fb7a700 1 -- 172.21.15.82:0/1484065996 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa638107f70 con 0x7fa638102550 2023-09-23T08:53:55.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:55.798+0000 7fa62effd700 1 -- 172.21.15.82:0/1484065996 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 134671+0+0 (secure 0 0 0) 0x7fa630012420 con 0x7fa638102550 2023-09-23T08:53:55.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:55.799+0000 7fa62effd700 1 --2- 172.21.15.82:0/1484065996 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fa62409ff50 0x7fa6240a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:53:55.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:55.800+0000 7fa62effd700 1 -- 172.21.15.82:0/1484065996 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6847+0+0 (secure 0 0 0) 0x7fa6300caf60 con 0x7fa638102550 2023-09-23T08:53:55.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:55.800+0000 7fa63d916700 1 --2- 172.21.15.82:0/1484065996 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fa62409ff50 0x7fa6240a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:53:55.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:55.800+0000 7fa63d916700 1 --2- 172.21.15.82:0/1484065996 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fa62409ff50 0x7fa6240a2410 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa634000c00 tx=0x7fa634009f10 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:53:55.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:55.804+0000 7fa62effd700 1 -- 172.21.15.82:0/1484065996 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7fa630095210 con 0x7fa638102550 2023-09-23T08:53:55.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:55 smithi135 ceph-mon[99205]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-09-23T08:53:55.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:55 smithi135 ceph-mon[99205]: osdmap e79: 12 total, 11 up, 12 in 2023-09-23T08:53:55.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:55 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-09-23T08:53:55.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:55 smithi135 ceph-mon[99205]: from='osd.11 [v2:172.21.15.161:6824/1459332081,v1:172.21.15.161:6825/1459332081]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2023-09-23T08:53:55.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:55 smithi135 ceph-mon[99205]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2023-09-23T08:53:55.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:55 smithi082 ceph-mon[97694]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-09-23T08:53:55.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:55 smithi082 ceph-mon[97694]: osdmap e79: 12 total, 11 up, 12 in 2023-09-23T08:53:55.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:55 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-09-23T08:53:55.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:55 smithi082 ceph-mon[97694]: from='osd.11 [v2:172.21.15.161:6824/1459332081,v1:172.21.15.161:6825/1459332081]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2023-09-23T08:53:55.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:55 smithi082 ceph-mon[97694]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2023-09-23T08:53:55.898 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 08:53:55 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T08:53:55.545+0000 7f3d6cefe700 -1 osd.11 80 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-23T08:53:56.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:56.005+0000 7fa63fb7a700 1 -- 172.21.15.82:0/1484065996 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7fa63810c2d0 con 0x7fa638102550 2023-09-23T08:53:56.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:56.006+0000 7fa62effd700 1 -- 172.21.15.82:0/1484065996 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v80) v1 ==== 74+0+133 (secure 0 0 0) 0x7fa630098830 con 0x7fa638102550 2023-09-23T08:53:56.009 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:53:56.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:56.008+0000 7fa63fb7a700 1 -- 172.21.15.82:0/1484065996 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fa62409ff50 msgr2=0x7fa6240a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:53:56.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:56.008+0000 7fa63fb7a700 1 --2- 172.21.15.82:0/1484065996 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fa62409ff50 0x7fa6240a2410 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa634000c00 tx=0x7fa634009f10 comp rx=0 tx=0).stop 2023-09-23T08:53:56.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:56.008+0000 7fa63fb7a700 1 -- 172.21.15.82:0/1484065996 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa638102550 msgr2=0x7fa63819dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:53:56.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:56.008+0000 7fa63fb7a700 1 --2- 172.21.15.82:0/1484065996 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa638102550 0x7fa63819dab0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa630007da0 tx=0x7fa63000a340 comp rx=0 tx=0).stop 2023-09-23T08:53:56.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:56.008+0000 7fa63fb7a700 1 -- 172.21.15.82:0/1484065996 shutdown_connections 2023-09-23T08:53:56.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:56.008+0000 7fa63fb7a700 1 --2- 172.21.15.82:0/1484065996 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fa62409ff50 0x7fa6240a2410 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:53:56.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:56.008+0000 7fa63fb7a700 1 --2- 172.21.15.82:0/1484065996 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa638102550 0x7fa63819dab0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:53:56.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:56.008+0000 7fa63fb7a700 1 --2- 172.21.15.82:0/1484065996 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6381009b0 0x7fa6381964f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:53:56.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:56.008+0000 7fa63fb7a700 1 --2- 172.21.15.82:0/1484065996 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa638101bb0 0x7fa638196a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:53:56.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:56.008+0000 7fa63fb7a700 1 -- 172.21.15.82:0/1484065996 >> 172.21.15.82:0/1484065996 conn(0x7fa6380fbf10 msgr2=0x7fa6381050b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:53:56.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:56.008+0000 7fa63fb7a700 1 -- 172.21.15.82:0/1484065996 shutdown_connections 2023-09-23T08:53:56.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:56.008+0000 7fa63fb7a700 1 -- 172.21.15.82:0/1484065996 wait complete. 2023-09-23T08:53:56.489 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":80,"num_osds":12,"num_up_osds":11,"osd_up_since":1695459209,"num_in_osds":12,"osd_in_since":1695459215,"num_remapped_pgs":0} 2023-09-23T08:53:56.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:56 smithi161 ceph-mon[99580]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]': finished 2023-09-23T08:53:56.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:56 smithi161 ceph-mon[99580]: osdmap e80: 12 total, 11 up, 12 in 2023-09-23T08:53:56.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:56 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-09-23T08:53:56.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:56 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-09-23T08:53:56.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:56 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/1484065996' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-09-23T08:53:56.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:56 smithi161 ceph-mon[99580]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 983 GiB / 983 GiB avail 2023-09-23T08:53:56.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:56 smithi135 ceph-mon[99205]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]': finished 2023-09-23T08:53:56.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:56 smithi135 ceph-mon[99205]: osdmap e80: 12 total, 11 up, 12 in 2023-09-23T08:53:56.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:56 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-09-23T08:53:56.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:56 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-09-23T08:53:56.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:56 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/1484065996' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-09-23T08:53:56.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:56 smithi135 ceph-mon[99205]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 983 GiB / 983 GiB avail 2023-09-23T08:53:56.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:56 smithi082 ceph-mon[97694]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]': finished 2023-09-23T08:53:56.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:56 smithi082 ceph-mon[97694]: osdmap e80: 12 total, 11 up, 12 in 2023-09-23T08:53:56.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:56 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-09-23T08:53:56.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:56 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-09-23T08:53:56.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:56 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/1484065996' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-09-23T08:53:56.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:56 smithi082 ceph-mon[97694]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 983 GiB / 983 GiB avail 2023-09-23T08:53:57.491 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- ceph osd stat -f json 2023-09-23T08:53:57.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:57 smithi135 ceph-mon[99205]: purged_snaps scrub starts 2023-09-23T08:53:57.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:57 smithi135 ceph-mon[99205]: purged_snaps scrub ok 2023-09-23T08:53:57.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:57 smithi135 ceph-mon[99205]: osd.11 [v2:172.21.15.161:6824/1459332081,v1:172.21.15.161:6825/1459332081] boot 2023-09-23T08:53:57.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:57 smithi135 ceph-mon[99205]: osdmap e81: 12 total, 12 up, 12 in 2023-09-23T08:53:57.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:57 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-09-23T08:53:57.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:57 smithi135 ceph-mon[99205]: Detected new or changed devices on smithi161 2023-09-23T08:53:57.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:57 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:57.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:57 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:57.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:57 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:53:57.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:57 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:53:57.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:57 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:53:57.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:57 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:53:57.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:57 smithi135 ceph-mon[99205]: Adjusting osd_memory_target on smithi161 to 4316M 2023-09-23T08:53:57.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:57 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:57.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:57 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:53:57.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:57 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:53:57.814 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:57 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:57.814 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:57 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:53:57.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:57 smithi082 ceph-mon[97694]: purged_snaps scrub starts 2023-09-23T08:53:57.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:57 smithi082 ceph-mon[97694]: purged_snaps scrub ok 2023-09-23T08:53:57.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:57 smithi082 ceph-mon[97694]: osd.11 [v2:172.21.15.161:6824/1459332081,v1:172.21.15.161:6825/1459332081] boot 2023-09-23T08:53:57.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:57 smithi082 ceph-mon[97694]: osdmap e81: 12 total, 12 up, 12 in 2023-09-23T08:53:57.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:57 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-09-23T08:53:57.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:57 smithi082 ceph-mon[97694]: Detected new or changed devices on smithi161 2023-09-23T08:53:57.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:57 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:57.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:57 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:57.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:57 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:53:57.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:57 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:53:57.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:57 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:53:57.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:57 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:53:57.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:57 smithi082 ceph-mon[97694]: Adjusting osd_memory_target on smithi161 to 4316M 2023-09-23T08:53:57.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:57 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:57.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:57 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:53:57.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:57 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:53:57.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:57 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:57.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:57 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:53:57.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:57 smithi161 ceph-mon[99580]: purged_snaps scrub starts 2023-09-23T08:53:57.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:57 smithi161 ceph-mon[99580]: purged_snaps scrub ok 2023-09-23T08:53:57.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:57 smithi161 ceph-mon[99580]: osd.11 [v2:172.21.15.161:6824/1459332081,v1:172.21.15.161:6825/1459332081] boot 2023-09-23T08:53:57.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:57 smithi161 ceph-mon[99580]: osdmap e81: 12 total, 12 up, 12 in 2023-09-23T08:53:57.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:57 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-09-23T08:53:57.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:57 smithi161 ceph-mon[99580]: Detected new or changed devices on smithi161 2023-09-23T08:53:57.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:57 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:57.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:57 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:57.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:57 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:53:57.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:57 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:53:57.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:57 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:53:57.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:57 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:53:57.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:57 smithi161 ceph-mon[99580]: Adjusting osd_memory_target on smithi161 to 4316M 2023-09-23T08:53:57.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:57 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:57.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:57 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:53:57.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:57 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:53:57.900 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:57 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:57.900 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:57 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:53:58.221 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.a/config 2023-09-23T08:53:59.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:58 smithi082 ceph-mon[97694]: osdmap e82: 12 total, 12 up, 12 in 2023-09-23T08:53:59.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:58 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:53:59.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:58 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:53:59.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:58 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:59.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:53:58 smithi082 ceph-mon[97694]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:53:59.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:58 smithi161 ceph-mon[99580]: osdmap e82: 12 total, 12 up, 12 in 2023-09-23T08:53:59.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:58 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:53:59.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:58 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:53:59.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:58 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:59.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:53:58 smithi161 ceph-mon[99580]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:53:59.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:58 smithi135 ceph-mon[99205]: osdmap e82: 12 total, 12 up, 12 in 2023-09-23T08:53:59.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:58 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:53:59.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:58 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:53:59.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:58 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:53:59.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:53:58 smithi135 ceph-mon[99205]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:53:59.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:59.691+0000 7f9b52b26700 1 -- 172.21.15.82:0/1161659553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b4c102550 msgr2=0x7f9b4c108e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:53:59.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:59.691+0000 7f9b52b26700 1 --2- 172.21.15.82:0/1161659553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b4c102550 0x7f9b4c108e00 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9b4400b0d0 tx=0x7f9b4400b3e0 comp rx=0 tx=0).stop 2023-09-23T08:53:59.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:59.691+0000 7f9b52b26700 1 -- 172.21.15.82:0/1161659553 shutdown_connections 2023-09-23T08:53:59.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:59.691+0000 7f9b52b26700 1 --2- 172.21.15.82:0/1161659553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b4c102550 0x7f9b4c108e00 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:53:59.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:59.691+0000 7f9b52b26700 1 --2- 172.21.15.82:0/1161659553 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b4c1009b0 0x7f9b4c100dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:53:59.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:59.691+0000 7f9b52b26700 1 --2- 172.21.15.82:0/1161659553 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b4c101bb0 0x7f9b4c102010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:53:59.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:59.691+0000 7f9b52b26700 1 -- 172.21.15.82:0/1161659553 >> 172.21.15.82:0/1161659553 conn(0x7f9b4c0fbf10 msgr2=0x7f9b4c0fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:53:59.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:59.691+0000 7f9b52b26700 1 -- 172.21.15.82:0/1161659553 shutdown_connections 2023-09-23T08:53:59.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:59.691+0000 7f9b52b26700 1 -- 172.21.15.82:0/1161659553 wait complete. 2023-09-23T08:53:59.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:59.692+0000 7f9b52b26700 1 Processor -- start 2023-09-23T08:53:59.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:59.692+0000 7f9b52b26700 1 -- start start 2023-09-23T08:53:59.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:59.693+0000 7f9b52b26700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b4c1009b0 0x7f9b4c1966b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:53:59.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:59.693+0000 7f9b52b26700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b4c101bb0 0x7f9b4c196bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:53:59.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:59.693+0000 7f9b52b26700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b4c102550 0x7f9b4c19dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:53:59.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:59.693+0000 7f9b52b26700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b4c19e240 con 0x7f9b4c102550 2023-09-23T08:53:59.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:59.693+0000 7f9b52b26700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b4c19e380 con 0x7f9b4c101bb0 2023-09-23T08:53:59.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:59.693+0000 7f9b52b26700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b4c19e510 con 0x7f9b4c1009b0 2023-09-23T08:53:59.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:59.693+0000 7f9b508c2700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b4c1009b0 0x7f9b4c1966b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:53:59.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:59.693+0000 7f9b510c3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b4c102550 0x7f9b4c19dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:53:59.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:59.693+0000 7f9b508c2700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b4c1009b0 0x7f9b4c1966b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:54654/0 (socket says 172.21.15.82:54654) 2023-09-23T08:53:59.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:59.693+0000 7f9b508c2700 1 -- 172.21.15.82:0/530490251 learned_addr learned my addr 172.21.15.82:0/530490251 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:53:59.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:59.693+0000 7f9b510c3700 1 -- 172.21.15.82:0/530490251 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b4c1009b0 msgr2=0x7f9b4c1966b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:53:59.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:59.693+0000 7f9b510c3700 1 --2- 172.21.15.82:0/530490251 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b4c1009b0 0x7f9b4c1966b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:53:59.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:59.693+0000 7f9b4bfff700 1 --2- 172.21.15.82:0/530490251 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b4c101bb0 0x7f9b4c196bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:53:59.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:59.693+0000 7f9b510c3700 1 -- 172.21.15.82:0/530490251 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b4c101bb0 msgr2=0x7f9b4c196bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:53:59.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:59.693+0000 7f9b510c3700 1 --2- 172.21.15.82:0/530490251 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b4c101bb0 0x7f9b4c196bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:53:59.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:59.693+0000 7f9b510c3700 1 -- 172.21.15.82:0/530490251 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b44009d00 con 0x7f9b4c102550 2023-09-23T08:53:59.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:59.693+0000 7f9b4bfff700 1 --2- 172.21.15.82:0/530490251 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b4c101bb0 0x7f9b4c196bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T08:53:59.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:59.694+0000 7f9b510c3700 1 --2- 172.21.15.82:0/530490251 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b4c102550 0x7f9b4c19dc70 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9b44009fd0 tx=0x7f9b44009440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:53:59.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:59.694+0000 7f9b49ffb700 1 -- 172.21.15.82:0/530490251 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4400e040 con 0x7f9b4c102550 2023-09-23T08:53:59.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:59.694+0000 7f9b49ffb700 1 -- 172.21.15.82:0/530490251 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9b44012d90 con 0x7f9b4c102550 2023-09-23T08:53:59.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:59.694+0000 7f9b49ffb700 1 -- 172.21.15.82:0/530490251 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4401de70 con 0x7f9b4c102550 2023-09-23T08:53:59.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:59.694+0000 7f9b52b26700 1 -- 172.21.15.82:0/530490251 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b4c19e790 con 0x7f9b4c102550 2023-09-23T08:53:59.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:59.694+0000 7f9b52b26700 1 -- 172.21.15.82:0/530490251 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b4c19ec00 con 0x7f9b4c102550 2023-09-23T08:53:59.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:59.695+0000 7f9b52b26700 1 -- 172.21.15.82:0/530490251 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b4c107fb0 con 0x7f9b4c102550 2023-09-23T08:53:59.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:59.697+0000 7f9b49ffb700 1 -- 172.21.15.82:0/530490251 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 134671+0+0 (secure 0 0 0) 0x7f9b4401d480 con 0x7f9b4c102550 2023-09-23T08:53:59.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:59.698+0000 7f9b49ffb700 1 --2- 172.21.15.82:0/530490251 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f9b3c09ffd0 0x7f9b3c0a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:53:59.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:59.698+0000 7f9b49ffb700 1 -- 172.21.15.82:0/530490251 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f9b440ccb20 con 0x7f9b4c102550 2023-09-23T08:53:59.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:59.698+0000 7f9b508c2700 1 --2- 172.21.15.82:0/530490251 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f9b3c09ffd0 0x7f9b3c0a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:53:59.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:59.699+0000 7f9b508c2700 1 --2- 172.21.15.82:0/530490251 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f9b3c09ffd0 0x7f9b3c0a2490 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9b4000bd70 tx=0x7f9b4000b4a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:53:59.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:59.702+0000 7f9b49ffb700 1 -- 172.21.15.82:0/530490251 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f9b44096d40 con 0x7f9b4c102550 2023-09-23T08:53:59.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:59.902+0000 7f9b52b26700 1 -- 172.21.15.82:0/530490251 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f9b4c10c0c0 con 0x7f9b4c102550 2023-09-23T08:53:59.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:59.903+0000 7f9b49ffb700 1 -- 172.21.15.82:0/530490251 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v82) v1 ==== 74+0+133 (secure 0 0 0) 0x7f9b4409a360 con 0x7f9b4c102550 2023-09-23T08:53:59.906 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:53:59.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:59.905+0000 7f9b52b26700 1 -- 172.21.15.82:0/530490251 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f9b3c09ffd0 msgr2=0x7f9b3c0a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:53:59.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:59.905+0000 7f9b52b26700 1 --2- 172.21.15.82:0/530490251 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f9b3c09ffd0 0x7f9b3c0a2490 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9b4000bd70 tx=0x7f9b4000b4a0 comp rx=0 tx=0).stop 2023-09-23T08:53:59.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:59.905+0000 7f9b52b26700 1 -- 172.21.15.82:0/530490251 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b4c102550 msgr2=0x7f9b4c19dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:53:59.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:59.905+0000 7f9b52b26700 1 --2- 172.21.15.82:0/530490251 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b4c102550 0x7f9b4c19dc70 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9b44009fd0 tx=0x7f9b44009440 comp rx=0 tx=0).stop 2023-09-23T08:53:59.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:59.905+0000 7f9b52b26700 1 -- 172.21.15.82:0/530490251 shutdown_connections 2023-09-23T08:53:59.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:59.905+0000 7f9b52b26700 1 --2- 172.21.15.82:0/530490251 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f9b3c09ffd0 0x7f9b3c0a2490 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:53:59.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:59.905+0000 7f9b52b26700 1 --2- 172.21.15.82:0/530490251 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b4c102550 0x7f9b4c19dc70 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:53:59.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:59.905+0000 7f9b52b26700 1 --2- 172.21.15.82:0/530490251 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b4c1009b0 0x7f9b4c1966b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:53:59.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:59.905+0000 7f9b52b26700 1 --2- 172.21.15.82:0/530490251 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b4c101bb0 0x7f9b4c196bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:53:59.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:59.905+0000 7f9b52b26700 1 -- 172.21.15.82:0/530490251 >> 172.21.15.82:0/530490251 conn(0x7f9b4c0fbf10 msgr2=0x7f9b4c1050f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:53:59.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:59.905+0000 7f9b52b26700 1 -- 172.21.15.82:0/530490251 shutdown_connections 2023-09-23T08:53:59.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:53:59.905+0000 7f9b52b26700 1 -- 172.21.15.82:0/530490251 wait complete. 2023-09-23T08:54:00.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:00 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/530490251' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-09-23T08:54:00.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:00 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/530490251' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-09-23T08:54:00.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:00 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/530490251' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-09-23T08:54:00.400 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":82,"num_osds":12,"num_up_osds":12,"osd_up_since":1695459236,"num_in_osds":12,"osd_in_since":1695459215,"num_remapped_pgs":0} 2023-09-23T08:54:00.400 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- ceph osd dump --format=json 2023-09-23T08:54:01.121 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.a/config 2023-09-23T08:54:01.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:01 smithi135 ceph-mon[99205]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:54:01.364 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:01 smithi082 ceph-mon[97694]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:54:01.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:01 smithi161 ceph-mon[99580]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:54:02.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:02.500+0000 7ffa005d3700 1 -- 172.21.15.82:0/3322439860 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9f8101300 msgr2=0x7ff9f810d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:02.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:02.500+0000 7ffa005d3700 1 --2- 172.21.15.82:0/3322439860 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9f8101300 0x7ff9f810d810 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff9f000b0a0 tx=0x7ff9f000b3b0 comp rx=0 tx=0).stop 2023-09-23T08:54:02.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:02.500+0000 7ffa005d3700 1 -- 172.21.15.82:0/3322439860 shutdown_connections 2023-09-23T08:54:02.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:02.500+0000 7ffa005d3700 1 --2- 172.21.15.82:0/3322439860 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9f8101300 0x7ff9f810d810 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:02.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:02.500+0000 7ffa005d3700 1 --2- 172.21.15.82:0/3322439860 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff9f8106940 0x7ff9f8106d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:02.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:02.500+0000 7ffa005d3700 1 --2- 172.21.15.82:0/3322439860 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9f8100940 0x7ff9f8100dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:02.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:02.500+0000 7ffa005d3700 1 -- 172.21.15.82:0/3322439860 >> 172.21.15.82:0/3322439860 conn(0x7ff9f80fc410 msgr2=0x7ff9f80fe830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:54:02.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:02.500+0000 7ffa005d3700 1 -- 172.21.15.82:0/3322439860 shutdown_connections 2023-09-23T08:54:02.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:02.500+0000 7ffa005d3700 1 -- 172.21.15.82:0/3322439860 wait complete. 2023-09-23T08:54:02.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:02.501+0000 7ffa005d3700 1 Processor -- start 2023-09-23T08:54:02.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:02.502+0000 7ffa005d3700 1 -- start start 2023-09-23T08:54:02.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:02.502+0000 7ffa005d3700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff9f8100940 0x7ff9f819ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:02.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:02.502+0000 7ffa005d3700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9f8101300 0x7ff9f819ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:02.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:02.502+0000 7ffa005d3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9f8106940 0x7ff9f8198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:02.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:02.502+0000 7ffa005d3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f8199100 con 0x7ff9f8106940 2023-09-23T08:54:02.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:02.502+0000 7ffa005d3700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f8199270 con 0x7ff9f8101300 2023-09-23T08:54:02.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:02.502+0000 7ffa005d3700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f8199430 con 0x7ff9f8100940 2023-09-23T08:54:02.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:02.502+0000 7ff9feb70700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9f8106940 0x7ff9f8198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:02.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:02.502+0000 7ff9feb70700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9f8106940 0x7ff9f8198a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38992/0 (socket says 172.21.15.82:38992) 2023-09-23T08:54:02.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:02.502+0000 7ff9feb70700 1 -- 172.21.15.82:0/757206810 learned_addr learned my addr 172.21.15.82:0/757206810 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:54:02.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:02.503+0000 7ff9fdb6e700 1 --2- 172.21.15.82:0/757206810 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9f8101300 0x7ff9f819ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:02.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:02.503+0000 7ff9fe36f700 1 --2- 172.21.15.82:0/757206810 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff9f8100940 0x7ff9f819ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:02.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:02.503+0000 7ff9feb70700 1 -- 172.21.15.82:0/757206810 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff9f8100940 msgr2=0x7ff9f819ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:02.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:02.503+0000 7ff9feb70700 1 --2- 172.21.15.82:0/757206810 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff9f8100940 0x7ff9f819ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:02.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:02.503+0000 7ff9feb70700 1 -- 172.21.15.82:0/757206810 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9f8101300 msgr2=0x7ff9f819ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:02.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:02.503+0000 7ff9feb70700 1 --2- 172.21.15.82:0/757206810 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9f8101300 0x7ff9f819ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:02.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:02.503+0000 7ff9feb70700 1 -- 172.21.15.82:0/757206810 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9f0009d00 con 0x7ff9f8106940 2023-09-23T08:54:02.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:02.503+0000 7ff9fdb6e700 1 --2- 172.21.15.82:0/757206810 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9f8101300 0x7ff9f819ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T08:54:02.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:02.503+0000 7ff9feb70700 1 --2- 172.21.15.82:0/757206810 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9f8106940 0x7ff9f8198a90 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff9f0009fd0 tx=0x7ff9f0004d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:54:02.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:02.503+0000 7ff9ef7fe700 1 -- 172.21.15.82:0/757206810 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f000e040 con 0x7ff9f8106940 2023-09-23T08:54:02.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:02.503+0000 7ff9ef7fe700 1 -- 172.21.15.82:0/757206810 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff9f001baf0 con 0x7ff9f8106940 2023-09-23T08:54:02.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:02.503+0000 7ffa005d3700 1 -- 172.21.15.82:0/757206810 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9f81996b0 con 0x7ff9f8106940 2023-09-23T08:54:02.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:02.503+0000 7ff9ef7fe700 1 -- 172.21.15.82:0/757206810 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f0005730 con 0x7ff9f8106940 2023-09-23T08:54:02.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:02.503+0000 7ffa005d3700 1 -- 172.21.15.82:0/757206810 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9f81a5a00 con 0x7ff9f8106940 2023-09-23T08:54:02.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:02.505+0000 7ffa005d3700 1 -- 172.21.15.82:0/757206810 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9f804e620 con 0x7ff9f8106940 2023-09-23T08:54:02.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:02.506+0000 7ff9ef7fe700 1 -- 172.21.15.82:0/757206810 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 134671+0+0 (secure 0 0 0) 0x7ff9f0005890 con 0x7ff9f8106940 2023-09-23T08:54:02.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:02.508+0000 7ff9ef7fe700 1 --2- 172.21.15.82:0/757206810 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7ff9e409ffd0 0x7ff9e40a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:02.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:02.509+0000 7ff9ef7fe700 1 -- 172.21.15.82:0/757206810 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7ff9f00cc830 con 0x7ff9f8106940 2023-09-23T08:54:02.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:02.509+0000 7ff9fe36f700 1 --2- 172.21.15.82:0/757206810 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7ff9e409ffd0 0x7ff9e40a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:02.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:02.509+0000 7ff9fe36f700 1 --2- 172.21.15.82:0/757206810 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7ff9e409ffd0 0x7ff9e40a2490 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff9f4005950 tx=0x7ff9f40058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:54:02.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:02.513+0000 7ff9ef7fe700 1 -- 172.21.15.82:0/757206810 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7ff9f0096a50 con 0x7ff9f8106940 2023-09-23T08:54:02.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:02.713+0000 7ffa005d3700 1 -- 172.21.15.82:0/757206810 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff9f8110870 con 0x7ff9f8106940 2023-09-23T08:54:02.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:02.714+0000 7ff9ef7fe700 1 -- 172.21.15.82:0/757206810 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+18435 (secure 0 0 0) 0x7ff9f009a070 con 0x7ff9f8106940 2023-09-23T08:54:02.717 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:54:02.717 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":82,"fsid":"8926e286-59ed-11ee-8db4-212e2dc638e7","created":"2023-09-23T08:46:16.628057+0000","modified":"2023-09-23T08:53:57.858331+0000","last_up_change":"2023-09-23T08:53:56.524694+0000","last_in_change":"2023-09-23T08:53:35.779183+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-23T08:50:00.571063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7384c1ff-8c71-4feb-8cef-ba45c2a1708a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":892441948},{"type":"v1","addr":"172.21.15.82:6803","nonce":892441948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":892441948},{"type":"v1","addr":"172.21.15.82:6805","nonce":892441948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":892441948},{"type":"v1","addr":"172.21.15.82:6809","nonce":892441948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":892441948},{"type":"v1","addr":"172.21.15.82:6807","nonce":892441948}]},"public_addr":"172.21.15.82:6803/892441948","cluster_addr":"172.21.15.82:6805/892441948","heartbeat_back_addr":"172.21.15.82:6809/892441948","heartbeat_front_addr":"172.21.15.82:6807/892441948","state":["exists","up"]},{"osd":1,"uuid":"ca62333e-15db-4556-a9ed-8820f9268766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3224546922},{"type":"v1","addr":"172.21.15.135:6801","nonce":3224546922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3224546922},{"type":"v1","addr":"172.21.15.135:6803","nonce":3224546922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3224546922},{"type":"v1","addr":"172.21.15.135:6807","nonce":3224546922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3224546922},{"type":"v1","addr":"172.21.15.135:6805","nonce":3224546922}]},"public_addr":"172.21.15.135:6801/3224546922","cluster_addr":"172.21.15.135:6803/3224546922","heartbeat_back_addr":"172.21.15.135:6807/3224546922","heartbeat_front_addr":"172.21.15.135:6805/3224546922","state":["exists","up"]},{"osd":2,"uuid":"ac23eb38-216a-44f0-b316-a509b23745f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2358373459},{"type":"v1","addr":"172.21.15.161:6801","nonce":2358373459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2358373459},{"type":"v1","addr":"172.21.15.161:6803","nonce":2358373459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2358373459},{"type":"v1","addr":"172.21.15.161:6807","nonce":2358373459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2358373459},{"type":"v1","addr":"172.21.15.161:6805","nonce":2358373459}]},"public_addr":"172.21.15.161:6801/2358373459","cluster_addr":"172.21.15.161:6803/2358373459","heartbeat_back_addr":"172.21.15.161:6807/2358373459","heartbeat_front_addr":"172.21.15.161:6805/2358373459","state":["exists","up"]},{"osd":3,"uuid":"701c96b0-30fb-46ce-917d-e02d3814dc3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":1081464528},{"type":"v1","addr":"172.21.15.82:6811","nonce":1081464528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1081464528},{"type":"v1","addr":"172.21.15.82:6813","nonce":1081464528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1081464528},{"type":"v1","addr":"172.21.15.82:6817","nonce":1081464528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":1081464528},{"type":"v1","addr":"172.21.15.82:6815","nonce":1081464528}]},"public_addr":"172.21.15.82:6811/1081464528","cluster_addr":"172.21.15.82:6813/1081464528","heartbeat_back_addr":"172.21.15.82:6817/1081464528","heartbeat_front_addr":"172.21.15.82:6815/1081464528","state":["exists","up"]},{"osd":4,"uuid":"c618d2a2-3616-41b2-943c-7a4616538e13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2346495509},{"type":"v1","addr":"172.21.15.135:6809","nonce":2346495509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2346495509},{"type":"v1","addr":"172.21.15.135:6811","nonce":2346495509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2346495509},{"type":"v1","addr":"172.21.15.135:6815","nonce":2346495509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2346495509},{"type":"v1","addr":"172.21.15.135:6813","nonce":2346495509}]},"public_addr":"172.21.15.135:6809/2346495509","cluster_addr":"172.21.15.135:6811/2346495509","heartbeat_back_addr":"172.21.15.135:6815/2346495509","heartbeat_front_addr":"172.21.15.135:6813/2346495509","state":["exists","up"]},{"osd":5,"uuid":"8e1dda3d-6927-495d-b20d-78b03bb75d5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1252638628},{"type":"v1","addr":"172.21.15.161:6809","nonce":1252638628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1252638628},{"type":"v1","addr":"172.21.15.161:6811","nonce":1252638628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1252638628},{"type":"v1","addr":"172.21.15.161:6815","nonce":1252638628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1252638628},{"type":"v1","addr":"172.21.15.161:6813","nonce":1252638628}]},"public_addr":"172.21.15.161:6809/1252638628","cluster_addr":"172.21.15.161:6811/1252638628","heartbeat_back_addr":"172.21.15.161:6815/1252638628","heartbeat_front_addr":"172.21.15.161:6813/1252638628","state":["exists","up"]},{"osd":6,"uuid":"50b31960-6bc4-44e1-8116-3106bf161e56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1052038408},{"type":"v1","addr":"172.21.15.82:6819","nonce":1052038408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1052038408},{"type":"v1","addr":"172.21.15.82:6821","nonce":1052038408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":1052038408},{"type":"v1","addr":"172.21.15.82:6825","nonce":1052038408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1052038408},{"type":"v1","addr":"172.21.15.82:6823","nonce":1052038408}]},"public_addr":"172.21.15.82:6819/1052038408","cluster_addr":"172.21.15.82:6821/1052038408","heartbeat_back_addr":"172.21.15.82:6825/1052038408","heartbeat_front_addr":"172.21.15.82:6823/1052038408","state":["exists","up"]},{"osd":7,"uuid":"425ca0ee-57f7-4b27-90fb-d86bb5db5480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3683951498},{"type":"v1","addr":"172.21.15.135:6817","nonce":3683951498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":3683951498},{"type":"v1","addr":"172.21.15.135:6819","nonce":3683951498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":3683951498},{"type":"v1","addr":"172.21.15.135:6823","nonce":3683951498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":3683951498},{"type":"v1","addr":"172.21.15.135:6821","nonce":3683951498}]},"public_addr":"172.21.15.135:6817/3683951498","cluster_addr":"172.21.15.135:6819/3683951498","heartbeat_back_addr":"172.21.15.135:6823/3683951498","heartbeat_front_addr":"172.21.15.135:6821/3683951498","state":["exists","up"]},{"osd":8,"uuid":"1115c837-bef6-4bad-9974-4d913198511b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":948521536},{"type":"v1","addr":"172.21.15.161:6817","nonce":948521536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":948521536},{"type":"v1","addr":"172.21.15.161:6819","nonce":948521536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":948521536},{"type":"v1","addr":"172.21.15.161:6823","nonce":948521536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":948521536},{"type":"v1","addr":"172.21.15.161:6821","nonce":948521536}]},"public_addr":"172.21.15.161:6817/948521536","cluster_addr":"172.21.15.161:6819/948521536","heartbeat_back_addr":"172.21.15.161:6823/948521536","heartbeat_front_addr":"172.21.15.161:6821/948521536","state":["exists","up"]},{"osd":9,"uuid":"c52ec819-4bc6-402f-9cd8-62539e519e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":1438762840},{"type":"v1","addr":"172.21.15.82:6827","nonce":1438762840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":1438762840},{"type":"v1","addr":"172.21.15.82:6829","nonce":1438762840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1438762840},{"type":"v1","addr":"172.21.15.82:6833","nonce":1438762840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1438762840},{"type":"v1","addr":"172.21.15.82:6831","nonce":1438762840}]},"public_addr":"172.21.15.82:6827/1438762840","cluster_addr":"172.21.15.82:6829/1438762840","heartbeat_back_addr":"172.21.15.82:6833/1438762840","heartbeat_front_addr":"172.21.15.82:6831/1438762840","state":["exists","up"]},{"osd":10,"uuid":"1b16c795-1b91-4d46-ae5d-21b8332c1077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2853697851},{"type":"v1","addr":"172.21.15.135:6825","nonce":2853697851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2853697851},{"type":"v1","addr":"172.21.15.135:6827","nonce":2853697851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2853697851},{"type":"v1","addr":"172.21.15.135:6831","nonce":2853697851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2853697851},{"type":"v1","addr":"172.21.15.135:6829","nonce":2853697851}]},"public_addr":"172.21.15.135:6825/2853697851","cluster_addr":"172.21.15.135:6827/2853697851","heartbeat_back_addr":"172.21.15.135:6831/2853697851","heartbeat_front_addr":"172.21.15.135:6829/2853697851","state":["exists","up"]},{"osd":11,"uuid":"2551e602-4fe1-41cb-9b7d-c8b31fdd1487","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":1459332081},{"type":"v1","addr":"172.21.15.161:6825","nonce":1459332081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":1459332081},{"type":"v1","addr":"172.21.15.161:6827","nonce":1459332081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":1459332081},{"type":"v1","addr":"172.21.15.161:6831","nonce":1459332081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":1459332081},{"type":"v1","addr":"172.21.15.161:6829","nonce":1459332081}]},"public_addr":"172.21.15.161:6825/1459332081","cluster_addr":"172.21.15.161:6827/1459332081","heartbeat_back_addr":"172.21.15.161:6831/1459332081","heartbeat_front_addr":"172.21.15.161:6829/1459332081","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:49:04.007679+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:49:30.702365+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:49:56.785248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:50:22.988516+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:50:49.347055+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:51:15.830145+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:51:41.986377+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:52:08.218893+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:52:34.847450+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:53:01.317134+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:53:27.981691+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:53:54.849245+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/4204712132":"2023-09-24T08:47:21.957866+0000","172.21.15.82:6801/2733521564":"2023-09-24T08:47:21.957866+0000","172.21.15.82:6800/2733521564":"2023-09-24T08:47:21.957866+0000","172.21.15.82:0/3964794665":"2023-09-24T08:47:21.957866+0000","172.21.15.82:0/3535372205":"2023-09-24T08:46:55.187024+0000","172.21.15.82:0/285559684":"2023-09-24T08:46:55.187024+0000","172.21.15.82:0/1335891896":"2023-09-24T08:46:55.187024+0000","172.21.15.82:6801/3761509623":"2023-09-24T08:46:55.187024+0000","172.21.15.82:6800/3761509623":"2023-09-24T08:46:55.187024+0000","172.21.15.82:0/3775317005":"2023-09-24T08:47:21.957866+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-23T08:54:02.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:02.717+0000 7ffa005d3700 1 -- 172.21.15.82:0/757206810 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7ff9e409ffd0 msgr2=0x7ff9e40a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:02.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:02.717+0000 7ffa005d3700 1 --2- 172.21.15.82:0/757206810 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7ff9e409ffd0 0x7ff9e40a2490 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff9f4005950 tx=0x7ff9f40058e0 comp rx=0 tx=0).stop 2023-09-23T08:54:02.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:02.717+0000 7ffa005d3700 1 -- 172.21.15.82:0/757206810 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9f8106940 msgr2=0x7ff9f8198a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:02.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:02.717+0000 7ffa005d3700 1 --2- 172.21.15.82:0/757206810 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9f8106940 0x7ff9f8198a90 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff9f0009fd0 tx=0x7ff9f0004d30 comp rx=0 tx=0).stop 2023-09-23T08:54:02.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:02.717+0000 7ffa005d3700 1 -- 172.21.15.82:0/757206810 shutdown_connections 2023-09-23T08:54:02.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:02.717+0000 7ffa005d3700 1 --2- 172.21.15.82:0/757206810 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7ff9e409ffd0 0x7ff9e40a2490 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:02.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:02.717+0000 7ffa005d3700 1 --2- 172.21.15.82:0/757206810 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9f8106940 0x7ff9f8198a90 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:02.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:02.717+0000 7ffa005d3700 1 --2- 172.21.15.82:0/757206810 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff9f8100940 0x7ff9f819ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:02.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:02.717+0000 7ffa005d3700 1 --2- 172.21.15.82:0/757206810 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9f8101300 0x7ff9f819ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:02.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:02.717+0000 7ffa005d3700 1 -- 172.21.15.82:0/757206810 >> 172.21.15.82:0/757206810 conn(0x7ff9f80fc410 msgr2=0x7ff9f810bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:54:02.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:02.717+0000 7ffa005d3700 1 -- 172.21.15.82:0/757206810 shutdown_connections 2023-09-23T08:54:02.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:02.717+0000 7ffa005d3700 1 -- 172.21.15.82:0/757206810 wait complete. 2023-09-23T08:54:03.199 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-23T08:50:00.571063+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-23T08:54:03.199 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- ceph osd pool get .mgr pg_num 2023-09-23T08:54:03.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:03 smithi082 ceph-mon[97694]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:54:03.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:03 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/757206810' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-23T08:54:03.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:03 smithi161 ceph-mon[99580]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:54:03.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:03 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/757206810' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-23T08:54:03.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:03 smithi135 ceph-mon[99205]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:54:03.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:03 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/757206810' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-23T08:54:03.919 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.a/config 2023-09-23T08:54:05.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:05.319+0000 7f71f1509700 1 -- 172.21.15.82:0/4242966170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71ec101300 msgr2=0x7f71ec10d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:05.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:05.319+0000 7f71f1509700 1 --2- 172.21.15.82:0/4242966170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71ec101300 0x7f71ec10d810 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f71e400b0a0 tx=0x7f71e400b3b0 comp rx=0 tx=0).stop 2023-09-23T08:54:05.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:05.319+0000 7f71f1509700 1 -- 172.21.15.82:0/4242966170 shutdown_connections 2023-09-23T08:54:05.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:05.319+0000 7f71f1509700 1 --2- 172.21.15.82:0/4242966170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71ec101300 0x7f71ec10d810 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:05.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:05.319+0000 7f71f1509700 1 --2- 172.21.15.82:0/4242966170 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71ec106940 0x7f71ec106d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:05.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:05.319+0000 7f71f1509700 1 --2- 172.21.15.82:0/4242966170 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f71ec100940 0x7f71ec100dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:05.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:05.319+0000 7f71f1509700 1 -- 172.21.15.82:0/4242966170 >> 172.21.15.82:0/4242966170 conn(0x7f71ec0fc410 msgr2=0x7f71ec0fe830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:54:05.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:05.319+0000 7f71f1509700 1 -- 172.21.15.82:0/4242966170 shutdown_connections 2023-09-23T08:54:05.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:05.319+0000 7f71f1509700 1 -- 172.21.15.82:0/4242966170 wait complete. 2023-09-23T08:54:05.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:05.320+0000 7f71f1509700 1 Processor -- start 2023-09-23T08:54:05.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:05.320+0000 7f71f1509700 1 -- start start 2023-09-23T08:54:05.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:05.321+0000 7f71f1509700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71ec100940 0x7f71ec19e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:05.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:05.321+0000 7f71f1509700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71ec101300 0x7f71ec19ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:05.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:05.321+0000 7f71f1509700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f71ec106940 0x7f71ec198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:05.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:05.321+0000 7f71f1509700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71ec199000 con 0x7f71ec100940 2023-09-23T08:54:05.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:05.321+0000 7f71f1509700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71ec199170 con 0x7f71ec101300 2023-09-23T08:54:05.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:05.321+0000 7f71f1509700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71ec199330 con 0x7f71ec106940 2023-09-23T08:54:05.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:05.321+0000 7f71eaffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71ec100940 0x7f71ec19e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:05.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:05.321+0000 7f71eaffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71ec100940 0x7f71ec19e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39006/0 (socket says 172.21.15.82:39006) 2023-09-23T08:54:05.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:05.321+0000 7f71eaffd700 1 -- 172.21.15.82:0/3985280767 learned_addr learned my addr 172.21.15.82:0/3985280767 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:54:05.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:05.321+0000 7f71ea7fc700 1 --2- 172.21.15.82:0/3985280767 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71ec101300 0x7f71ec19ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:05.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:05.321+0000 7f71eb7fe700 1 --2- 172.21.15.82:0/3985280767 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f71ec106940 0x7f71ec198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:05.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:05.322+0000 7f71eaffd700 1 -- 172.21.15.82:0/3985280767 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f71ec106940 msgr2=0x7f71ec198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:05.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:05.322+0000 7f71eaffd700 1 --2- 172.21.15.82:0/3985280767 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f71ec106940 0x7f71ec198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:05.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:05.322+0000 7f71eaffd700 1 -- 172.21.15.82:0/3985280767 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71ec101300 msgr2=0x7f71ec19ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:05.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:05.322+0000 7f71eaffd700 1 --2- 172.21.15.82:0/3985280767 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71ec101300 0x7f71ec19ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:05.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:05.322+0000 7f71eaffd700 1 -- 172.21.15.82:0/3985280767 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71e4009d00 con 0x7f71ec100940 2023-09-23T08:54:05.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:05.322+0000 7f71eaffd700 1 --2- 172.21.15.82:0/3985280767 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71ec100940 0x7f71ec19e910 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f71dc00c9b0 tx=0x7f71dc00ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:54:05.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:05.322+0000 7f71d3fff700 1 -- 172.21.15.82:0/3985280767 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71dc007b00 con 0x7f71ec100940 2023-09-23T08:54:05.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:05.322+0000 7f71d3fff700 1 -- 172.21.15.82:0/3985280767 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f71dc00ce50 con 0x7f71ec100940 2023-09-23T08:54:05.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:05.322+0000 7f71f1509700 1 -- 172.21.15.82:0/3985280767 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71ec199610 con 0x7f71ec100940 2023-09-23T08:54:05.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:05.322+0000 7f71d3fff700 1 -- 172.21.15.82:0/3985280767 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71dc018420 con 0x7f71ec100940 2023-09-23T08:54:05.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:05.322+0000 7f71f1509700 1 -- 172.21.15.82:0/3985280767 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71ec1a5900 con 0x7f71ec100940 2023-09-23T08:54:05.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:05.323+0000 7f71f1509700 1 -- 172.21.15.82:0/3985280767 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71ec04e620 con 0x7f71ec100940 2023-09-23T08:54:05.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:05.326+0000 7f71d3fff700 1 -- 172.21.15.82:0/3985280767 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 134671+0+0 (secure 0 0 0) 0x7f71dc00f450 con 0x7f71ec100940 2023-09-23T08:54:05.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:05.328+0000 7f71d3fff700 1 --2- 172.21.15.82:0/3985280767 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f71d409ff50 0x7f71d40a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:05.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:05.328+0000 7f71d3fff700 1 -- 172.21.15.82:0/3985280767 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f71dc0caff0 con 0x7f71ec100940 2023-09-23T08:54:05.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:05.328+0000 7f71ea7fc700 1 --2- 172.21.15.82:0/3985280767 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f71d409ff50 0x7f71d40a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:05.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:05.329+0000 7f71ea7fc700 1 --2- 172.21.15.82:0/3985280767 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f71d409ff50 0x7f71d40a2410 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f71ec105d90 tx=0x7f71e000a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:54:05.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:05.330+0000 7f71d3fff700 1 -- 172.21.15.82:0/3985280767 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f71dc095230 con 0x7f71ec100940 2023-09-23T08:54:05.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:05.533+0000 7f71f1509700 1 -- 172.21.15.82:0/3985280767 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f71ec199ea0 con 0x7f71ec100940 2023-09-23T08:54:05.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:05.533+0000 7f71d3fff700 1 -- 172.21.15.82:0/3985280767 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) v1 ==== 93+0+10 (secure 0 0 0) 0x7f71dc00f700 con 0x7f71ec100940 2023-09-23T08:54:05.536 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-09-23T08:54:05.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:05.536+0000 7f71f1509700 1 -- 172.21.15.82:0/3985280767 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f71d409ff50 msgr2=0x7f71d40a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:05.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:05.536+0000 7f71f1509700 1 --2- 172.21.15.82:0/3985280767 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f71d409ff50 0x7f71d40a2410 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f71ec105d90 tx=0x7f71e000a380 comp rx=0 tx=0).stop 2023-09-23T08:54:05.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:05.536+0000 7f71f1509700 1 -- 172.21.15.82:0/3985280767 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71ec100940 msgr2=0x7f71ec19e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:05.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:05.536+0000 7f71f1509700 1 --2- 172.21.15.82:0/3985280767 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71ec100940 0x7f71ec19e910 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f71dc00c9b0 tx=0x7f71dc00ccc0 comp rx=0 tx=0).stop 2023-09-23T08:54:05.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:05.536+0000 7f71f1509700 1 -- 172.21.15.82:0/3985280767 shutdown_connections 2023-09-23T08:54:05.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:05.536+0000 7f71f1509700 1 --2- 172.21.15.82:0/3985280767 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f71d409ff50 0x7f71d40a2410 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:05.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:05.536+0000 7f71f1509700 1 --2- 172.21.15.82:0/3985280767 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f71ec106940 0x7f71ec198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:05.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:05.536+0000 7f71f1509700 1 --2- 172.21.15.82:0/3985280767 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71ec100940 0x7f71ec19e910 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:05.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:05.536+0000 7f71f1509700 1 --2- 172.21.15.82:0/3985280767 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71ec101300 0x7f71ec19ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:05.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:05.536+0000 7f71f1509700 1 -- 172.21.15.82:0/3985280767 >> 172.21.15.82:0/3985280767 conn(0x7f71ec0fc410 msgr2=0x7f71ec10be90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:54:05.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:05.536+0000 7f71f1509700 1 -- 172.21.15.82:0/3985280767 shutdown_connections 2023-09-23T08:54:05.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:05.536+0000 7f71f1509700 1 -- 172.21.15.82:0/3985280767 wait complete. 2023-09-23T08:54:05.673 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:05 smithi082 ceph-mon[97694]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:54:05.814 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:05 smithi135 ceph-mon[99205]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:54:05.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:05 smithi161 ceph-mon[99580]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:54:05.990 INFO:tasks.cephadm:Adding mds.a on smithi082 2023-09-23T08:54:05.990 INFO:tasks.cephadm:Adding mds.d on smithi082 2023-09-23T08:54:05.990 INFO:tasks.cephadm:Adding mds.g on smithi082 2023-09-23T08:54:05.990 INFO:tasks.cephadm:Adding mds.j on smithi082 2023-09-23T08:54:05.990 INFO:tasks.cephadm:Adding mds.b on smithi135 2023-09-23T08:54:05.991 INFO:tasks.cephadm:Adding mds.e on smithi135 2023-09-23T08:54:05.991 INFO:tasks.cephadm:Adding mds.h on smithi135 2023-09-23T08:54:05.991 INFO:tasks.cephadm:Adding mds.k on smithi135 2023-09-23T08:54:05.991 INFO:tasks.cephadm:Adding mds.c on smithi161 2023-09-23T08:54:05.991 INFO:tasks.cephadm:Adding mds.f on smithi161 2023-09-23T08:54:05.991 INFO:tasks.cephadm:Adding mds.i on smithi161 2023-09-23T08:54:05.991 INFO:tasks.cephadm:Adding mds.l on smithi161 2023-09-23T08:54:05.991 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- ceph orch apply mds all '12;smithi082=a;smithi082=d;smithi082=g;smithi082=j;smithi135=b;smithi135=e;smithi135=h;smithi135=k;smithi161=c;smithi161=f;smithi161=i;smithi161=l' 2023-09-23T08:54:06.726 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.c/config 2023-09-23T08:54:06.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:06 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/3985280767' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-23T08:54:06.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:06 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/3985280767' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-23T08:54:06.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:06 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/3985280767' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-23T08:54:07.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:07 smithi161 ceph-mon[99580]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:54:07.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:07 smithi135 ceph-mon[99205]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:54:07.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:07 smithi082 ceph-mon[97694]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:54:08.358 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:54:08.355+0000 7f001ae6c700 1 -- 172.21.15.161:0/533086366 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00141009b0 msgr2=0x7f0014100dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:08.358 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:54:08.355+0000 7f001ae6c700 1 --2- 172.21.15.161:0/533086366 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00141009b0 0x7f0014100dd0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0008009990 tx=0x7f0008009ca0 comp rx=0 tx=0).stop 2023-09-23T08:54:08.359 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:54:08.355+0000 7f001ae6c700 1 -- 172.21.15.161:0/533086366 shutdown_connections 2023-09-23T08:54:08.359 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:54:08.355+0000 7f001ae6c700 1 --2- 172.21.15.161:0/533086366 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0014102550 0x7f0014108e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:08.359 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:54:08.355+0000 7f001ae6c700 1 --2- 172.21.15.161:0/533086366 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00141009b0 0x7f0014100dd0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:08.359 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:54:08.355+0000 7f001ae6c700 1 --2- 172.21.15.161:0/533086366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0014101bb0 0x7f0014102010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:08.359 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:54:08.355+0000 7f001ae6c700 1 -- 172.21.15.161:0/533086366 >> 172.21.15.161:0/533086366 conn(0x7f00140fbf10 msgr2=0x7f00140fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:54:08.359 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:54:08.355+0000 7f001ae6c700 1 -- 172.21.15.161:0/533086366 shutdown_connections 2023-09-23T08:54:08.359 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:54:08.355+0000 7f001ae6c700 1 -- 172.21.15.161:0/533086366 wait complete. 2023-09-23T08:54:08.361 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:54:08.356+0000 7f001ae6c700 1 Processor -- start 2023-09-23T08:54:08.361 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:54:08.357+0000 7f001ae6c700 1 -- start start 2023-09-23T08:54:08.361 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:54:08.357+0000 7f001ae6c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00141009b0 0x7f0014198810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:08.361 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:54:08.357+0000 7f001ae6c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0014101bb0 0x7f0014198d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:08.361 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:54:08.357+0000 7f001ae6c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0014102550 0x7f001419fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:08.361 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:54:08.357+0000 7f001ae6c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00141a03a0 con 0x7f0014102550 2023-09-23T08:54:08.362 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:54:08.357+0000 7f001ae6c700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00141a04e0 con 0x7f00141009b0 2023-09-23T08:54:08.362 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:54:08.357+0000 7f001ae6c700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00141a0670 con 0x7f0014101bb0 2023-09-23T08:54:08.362 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:54:08.357+0000 7f0013fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0014101bb0 0x7f0014198d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:08.362 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:54:08.357+0000 7f0013fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0014101bb0 0x7f0014198d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:54928/0 (socket says 172.21.15.161:54928) 2023-09-23T08:54:08.362 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:54:08.357+0000 7f0013fff700 1 -- 172.21.15.161:0/155463734 learned_addr learned my addr 172.21.15.161:0/155463734 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-09-23T08:54:08.362 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:54:08.357+0000 7f0018c08700 1 --2- 172.21.15.161:0/155463734 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00141009b0 0x7f0014198810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:08.362 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:54:08.358+0000 7f0019409700 1 --2- 172.21.15.161:0/155463734 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0014102550 0x7f001419fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:08.363 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:54:08.358+0000 7f0013fff700 1 -- 172.21.15.161:0/155463734 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00141009b0 msgr2=0x7f0014198810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:08.363 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:54:08.358+0000 7f0013fff700 1 --2- 172.21.15.161:0/155463734 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00141009b0 0x7f0014198810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:08.363 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:54:08.358+0000 7f0013fff700 1 -- 172.21.15.161:0/155463734 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0014102550 msgr2=0x7f001419fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:08.363 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:54:08.358+0000 7f0013fff700 1 --2- 172.21.15.161:0/155463734 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0014102550 0x7f001419fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:08.363 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:54:08.358+0000 7f0013fff700 1 -- 172.21.15.161:0/155463734 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00080095f0 con 0x7f0014101bb0 2023-09-23T08:54:08.363 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:54:08.358+0000 7f0019409700 1 --2- 172.21.15.161:0/155463734 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0014102550 0x7f001419fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T08:54:08.363 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:54:08.358+0000 7f0013fff700 1 --2- 172.21.15.161:0/155463734 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0014101bb0 0x7f0014198d50 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f000000e9d0 tx=0x7f000000ece0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:54:08.363 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:54:08.358+0000 7f0011ffb700 1 -- 172.21.15.161:0/155463734 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0000009790 con 0x7f0014101bb0 2023-09-23T08:54:08.363 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:54:08.358+0000 7f0011ffb700 1 -- 172.21.15.161:0/155463734 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f000000cbd0 con 0x7f0014101bb0 2023-09-23T08:54:08.363 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:54:08.358+0000 7f0011ffb700 1 -- 172.21.15.161:0/155463734 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0000018680 con 0x7f0014101bb0 2023-09-23T08:54:08.363 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:54:08.358+0000 7f001ae6c700 1 -- 172.21.15.161:0/155463734 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00141a0950 con 0x7f0014101bb0 2023-09-23T08:54:08.364 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:54:08.358+0000 7f001ae6c700 1 -- 172.21.15.161:0/155463734 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00141a0e00 con 0x7f0014101bb0 2023-09-23T08:54:08.364 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:54:08.359+0000 7f001ae6c700 1 -- 172.21.15.161:0/155463734 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f001410c0b0 con 0x7f0014101bb0 2023-09-23T08:54:08.364 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:54:08.361+0000 7f0011ffb700 1 -- 172.21.15.161:0/155463734 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 16) v1 ==== 134671+0+0 (secure 0 0 0) 0x7f000000cd40 con 0x7f0014101bb0 2023-09-23T08:54:08.365 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:54:08.362+0000 7f0011ffb700 1 --2- 172.21.15.161:0/155463734 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f000409ffd0 0x7f00040a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:08.365 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:54:08.363+0000 7f0011ffb700 1 -- 172.21.15.161:0/155463734 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f0000014070 con 0x7f0014101bb0 2023-09-23T08:54:08.366 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:54:08.363+0000 7f0018c08700 1 --2- 172.21.15.161:0/155463734 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f000409ffd0 0x7f00040a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:08.366 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:54:08.364+0000 7f0018c08700 1 --2- 172.21.15.161:0/155463734 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f000409ffd0 0x7f00040a2490 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f000800b2e0 tx=0x7f0008005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:54:08.370 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:54:08.367+0000 7f0011ffb700 1 -- 172.21.15.161:0/155463734 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f0000051e00 con 0x7f0014101bb0 2023-09-23T08:54:08.578 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:54:08.575+0000 7f001ae6c700 1 -- 172.21.15.161:0/155463734 --> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi082=a;smithi082=d;smithi082=g;smithi082=j;smithi135=b;smithi135=e;smithi135=h;smithi135=k;smithi161=c;smithi161=f;smithi161=i;smithi161=l", "target": ["mon-mgr", ""]}) v1 -- 0x7f0014108700 con 0x7f000409ffd0 2023-09-23T08:54:08.589 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:54:08.586+0000 7f0011ffb700 1 -- 172.21.15.161:0/155463734 <== mgr.14152 v2:172.21.15.82:6800/3698954311 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7f0014108700 con 0x7f000409ffd0 2023-09-23T08:54:08.589 INFO:teuthology.orchestra.run.smithi161.stdout:Scheduled mds.all update... 2023-09-23T08:54:08.591 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:54:08.588+0000 7f001ae6c700 1 -- 172.21.15.161:0/155463734 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f000409ffd0 msgr2=0x7f00040a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:08.592 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:54:08.588+0000 7f001ae6c700 1 --2- 172.21.15.161:0/155463734 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f000409ffd0 0x7f00040a2490 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f000800b2e0 tx=0x7f0008005fb0 comp rx=0 tx=0).stop 2023-09-23T08:54:08.592 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:54:08.588+0000 7f001ae6c700 1 -- 172.21.15.161:0/155463734 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0014101bb0 msgr2=0x7f0014198d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:08.592 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:54:08.588+0000 7f001ae6c700 1 --2- 172.21.15.161:0/155463734 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0014101bb0 0x7f0014198d50 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f000000e9d0 tx=0x7f000000ece0 comp rx=0 tx=0).stop 2023-09-23T08:54:08.592 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:54:08.589+0000 7f001ae6c700 1 -- 172.21.15.161:0/155463734 shutdown_connections 2023-09-23T08:54:08.592 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:54:08.589+0000 7f001ae6c700 1 --2- 172.21.15.161:0/155463734 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f000409ffd0 0x7f00040a2490 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:08.592 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:54:08.589+0000 7f001ae6c700 1 --2- 172.21.15.161:0/155463734 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0014102550 0x7f001419fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:08.592 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:54:08.589+0000 7f001ae6c700 1 --2- 172.21.15.161:0/155463734 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00141009b0 0x7f0014198810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:08.592 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:54:08.589+0000 7f001ae6c700 1 --2- 172.21.15.161:0/155463734 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0014101bb0 0x7f0014198d50 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:08.592 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:54:08.589+0000 7f001ae6c700 1 -- 172.21.15.161:0/155463734 >> 172.21.15.161:0/155463734 conn(0x7f00140fbf10 msgr2=0x7f00140fe2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:54:08.592 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:54:08.589+0000 7f001ae6c700 1 -- 172.21.15.161:0/155463734 shutdown_connections 2023-09-23T08:54:08.592 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-23T08:54:08.589+0000 7f001ae6c700 1 -- 172.21.15.161:0/155463734 wait complete. 2023-09-23T08:54:09.011 DEBUG:teuthology.orchestra.run.smithi082:mds.a> sudo journalctl -f -n 0 -u ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@mds.a.service 2023-09-23T08:54:09.017 DEBUG:teuthology.orchestra.run.smithi082:mds.d> sudo journalctl -f -n 0 -u ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@mds.d.service 2023-09-23T08:54:09.061 DEBUG:teuthology.orchestra.run.smithi082:mds.g> sudo journalctl -f -n 0 -u ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@mds.g.service 2023-09-23T08:54:09.097 INFO:journalctl@ceph.mds.a.smithi082.stdout:-- Logs begin at Sat 2023-09-23 08:29:32 UTC. -- 2023-09-23T08:54:09.101 DEBUG:teuthology.orchestra.run.smithi082:mds.j> sudo journalctl -f -n 0 -u ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@mds.j.service 2023-09-23T08:54:09.133 INFO:journalctl@ceph.mds.d.smithi082.stdout:-- Logs begin at Sat 2023-09-23 08:29:32 UTC. -- 2023-09-23T08:54:09.136 DEBUG:teuthology.orchestra.run.smithi135:mds.b> sudo journalctl -f -n 0 -u ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@mds.b.service 2023-09-23T08:54:09.141 DEBUG:teuthology.orchestra.run.smithi135:mds.e> sudo journalctl -f -n 0 -u ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@mds.e.service 2023-09-23T08:54:09.171 INFO:journalctl@ceph.mds.g.smithi082.stdout:-- Logs begin at Sat 2023-09-23 08:29:32 UTC. -- 2023-09-23T08:54:09.187 DEBUG:teuthology.orchestra.run.smithi135:mds.h> sudo journalctl -f -n 0 -u ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@mds.h.service 2023-09-23T08:54:09.204 INFO:journalctl@ceph.mds.j.smithi082.stdout:-- Logs begin at Sat 2023-09-23 08:29:32 UTC. -- 2023-09-23T08:54:09.221 INFO:journalctl@ceph.mds.b.smithi135.stdout:-- Logs begin at Sat 2023-09-23 08:29:30 UTC. -- 2023-09-23T08:54:09.223 DEBUG:teuthology.orchestra.run.smithi135:mds.k> sudo journalctl -f -n 0 -u ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@mds.k.service 2023-09-23T08:54:09.258 INFO:journalctl@ceph.mds.e.smithi135.stdout:-- Logs begin at Sat 2023-09-23 08:29:30 UTC. -- 2023-09-23T08:54:09.262 DEBUG:teuthology.orchestra.run.smithi161:mds.c> sudo journalctl -f -n 0 -u ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@mds.c.service 2023-09-23T08:54:09.266 DEBUG:teuthology.orchestra.run.smithi161:mds.f> sudo journalctl -f -n 0 -u ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@mds.f.service 2023-09-23T08:54:09.294 INFO:journalctl@ceph.mds.h.smithi135.stdout:-- Logs begin at Sat 2023-09-23 08:29:30 UTC. -- 2023-09-23T08:54:09.314 DEBUG:teuthology.orchestra.run.smithi161:mds.i> sudo journalctl -f -n 0 -u ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@mds.i.service 2023-09-23T08:54:09.328 INFO:journalctl@ceph.mds.k.smithi135.stdout:-- Logs begin at Sat 2023-09-23 08:29:30 UTC. -- 2023-09-23T08:54:09.343 INFO:journalctl@ceph.mds.c.smithi161.stdout:-- Logs begin at Sat 2023-09-23 08:29:48 UTC. -- 2023-09-23T08:54:09.347 DEBUG:teuthology.orchestra.run.smithi161:mds.l> sudo journalctl -f -n 0 -u ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@mds.l.service 2023-09-23T08:54:09.387 INFO:journalctl@ceph.mds.f.smithi161.stdout:-- Logs begin at Sat 2023-09-23 08:29:48 UTC. -- 2023-09-23T08:54:09.390 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2023-09-23T08:54:09.391 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-23T08:54:09.421 INFO:journalctl@ceph.mds.i.smithi161.stdout:-- Logs begin at Sat 2023-09-23 08:29:48 UTC. -- 2023-09-23T08:54:09.459 INFO:journalctl@ceph.mds.l.smithi161.stdout:-- Logs begin at Sat 2023-09-23 08:29:48 UTC. -- 2023-09-23T08:54:09.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:09 smithi135 ceph-mon[99205]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:54:09.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:09 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:09.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:09 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:54:09.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:09 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:54:09.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:09 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:54:09.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:09 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:09.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:09 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-23T08:54:09.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:09 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-23T08:54:09.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:09 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:54:09.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:09.607+0000 7ff92f7ff700 1 -- 172.21.15.82:0/3522694207 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff928101b20 msgr2=0x7ff928101f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:09.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:09.607+0000 7ff92f7ff700 1 --2- 172.21.15.82:0/3522694207 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff928101b20 0x7ff928101f80 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff9180099c0 tx=0x7ff918009cd0 comp rx=0 tx=0).stop 2023-09-23T08:54:09.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:09.607+0000 7ff92f7ff700 1 -- 172.21.15.82:0/3522694207 shutdown_connections 2023-09-23T08:54:09.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:09.607+0000 7ff92f7ff700 1 --2- 172.21.15.82:0/3522694207 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9281024c0 0x7ff928108d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:09.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:09.607+0000 7ff92f7ff700 1 --2- 172.21.15.82:0/3522694207 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff928100930 0x7ff928100d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:09.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:09.607+0000 7ff92f7ff700 1 --2- 172.21.15.82:0/3522694207 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff928101b20 0x7ff928101f80 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:09.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:09.607+0000 7ff92f7ff700 1 -- 172.21.15.82:0/3522694207 >> 172.21.15.82:0/3522694207 conn(0x7ff9280fbe60 msgr2=0x7ff9280fe2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:54:09.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:09.607+0000 7ff92f7ff700 1 -- 172.21.15.82:0/3522694207 shutdown_connections 2023-09-23T08:54:09.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:09.607+0000 7ff92f7ff700 1 -- 172.21.15.82:0/3522694207 wait complete. 2023-09-23T08:54:09.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:09.608+0000 7ff92f7ff700 1 Processor -- start 2023-09-23T08:54:09.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:09.608+0000 7ff92f7ff700 1 -- start start 2023-09-23T08:54:09.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:09.608+0000 7ff92f7ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff928100930 0x7ff9280746d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:09.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:09.608+0000 7ff92f7ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff928101b20 0x7ff928072d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:09.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:09.608+0000 7ff92f7ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff9281024c0 0x7ff928073250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:09.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:09.609+0000 7ff92f7ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9280739f0 con 0x7ff928101b20 2023-09-23T08:54:09.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:09.609+0000 7ff92f7ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff928073b60 con 0x7ff928100930 2023-09-23T08:54:09.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:09.609+0000 7ff92f7ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9281a0530 con 0x7ff9281024c0 2023-09-23T08:54:09.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:09.609+0000 7ff92cd9a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff928101b20 0x7ff928072d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:09.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:09.609+0000 7ff92cd9a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff928101b20 0x7ff928072d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39030/0 (socket says 172.21.15.82:39030) 2023-09-23T08:54:09.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:09.609+0000 7ff92cd9a700 1 -- 172.21.15.82:0/1675409278 learned_addr learned my addr 172.21.15.82:0/1675409278 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:54:09.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:09.609+0000 7ff92dd9c700 1 --2- 172.21.15.82:0/1675409278 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff9281024c0 0x7ff928073250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:09.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:09.609+0000 7ff92d59b700 1 --2- 172.21.15.82:0/1675409278 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff928100930 0x7ff9280746d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:09.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:09.609+0000 7ff92cd9a700 1 -- 172.21.15.82:0/1675409278 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff9281024c0 msgr2=0x7ff928073250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:09.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:09.609+0000 7ff92cd9a700 1 --2- 172.21.15.82:0/1675409278 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff9281024c0 0x7ff928073250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:09.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:09.609+0000 7ff92cd9a700 1 -- 172.21.15.82:0/1675409278 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff928100930 msgr2=0x7ff9280746d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:09.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:09.609+0000 7ff92cd9a700 1 --2- 172.21.15.82:0/1675409278 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff928100930 0x7ff9280746d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:09.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:09.609+0000 7ff92cd9a700 1 -- 172.21.15.82:0/1675409278 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9180095f0 con 0x7ff928101b20 2023-09-23T08:54:09.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:09.609+0000 7ff92dd9c700 1 --2- 172.21.15.82:0/1675409278 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff9281024c0 0x7ff928073250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T08:54:09.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:09.609+0000 7ff92cd9a700 1 --2- 172.21.15.82:0/1675409278 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff928101b20 0x7ff928072d10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff918000c00 tx=0x7ff91800fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:54:09.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:09.610+0000 7ff91e7fc700 1 -- 172.21.15.82:0/1675409278 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff91801d070 con 0x7ff928101b20 2023-09-23T08:54:09.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:09.610+0000 7ff92f7ff700 1 -- 172.21.15.82:0/1675409278 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9281a07b0 con 0x7ff928101b20 2023-09-23T08:54:09.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:09.610+0000 7ff91e7fc700 1 -- 172.21.15.82:0/1675409278 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff9180054e0 con 0x7ff928101b20 2023-09-23T08:54:09.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:09.610+0000 7ff91e7fc700 1 -- 172.21.15.82:0/1675409278 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff918004c90 con 0x7ff928101b20 2023-09-23T08:54:09.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:09.610+0000 7ff92f7ff700 1 -- 172.21.15.82:0/1675409278 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9281a0be0 con 0x7ff928101b20 2023-09-23T08:54:09.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:09.611+0000 7ff92f7ff700 1 -- 172.21.15.82:0/1675409278 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff928107ed0 con 0x7ff928101b20 2023-09-23T08:54:09.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:09.613+0000 7ff91e7fc700 1 -- 172.21.15.82:0/1675409278 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 134671+0+0 (secure 0 0 0) 0x7ff918005050 con 0x7ff928101b20 2023-09-23T08:54:09.616 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:09 smithi161 ceph-mon[99580]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:54:09.616 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:09 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:09.617 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:09 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:54:09.617 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:09 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:54:09.617 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:09 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:54:09.617 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:09 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:09.617 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:09 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-23T08:54:09.617 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:09 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-23T08:54:09.617 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:09 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:54:09.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:09.614+0000 7ff91e7fc700 1 --2- 172.21.15.82:0/1675409278 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7ff91409ffa0 0x7ff9140a2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:09.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:09.614+0000 7ff91e7fc700 1 -- 172.21.15.82:0/1675409278 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7ff9180cbe50 con 0x7ff928101b20 2023-09-23T08:54:09.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:09.614+0000 7ff92d59b700 1 --2- 172.21.15.82:0/1675409278 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7ff91409ffa0 0x7ff9140a2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:09.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:09.615+0000 7ff92d59b700 1 --2- 172.21.15.82:0/1675409278 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7ff91409ffa0 0x7ff9140a2460 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff928101980 tx=0x7ff924009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:54:09.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:09.618+0000 7ff91e7fc700 1 -- 172.21.15.82:0/1675409278 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7ff918096190 con 0x7ff928101b20 2023-09-23T08:54:09.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:09.817+0000 7ff92f7ff700 1 -- 172.21.15.82:0/1675409278 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff92810c040 con 0x7ff928101b20 2023-09-23T08:54:09.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:09.818+0000 7ff91e7fc700 1 -- 172.21.15.82:0/1675409278 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+18435 (secure 0 0 0) 0x7ff9180cb090 con 0x7ff928101b20 2023-09-23T08:54:09.821 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:54:09.821 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":82,"fsid":"8926e286-59ed-11ee-8db4-212e2dc638e7","created":"2023-09-23T08:46:16.628057+0000","modified":"2023-09-23T08:53:57.858331+0000","last_up_change":"2023-09-23T08:53:56.524694+0000","last_in_change":"2023-09-23T08:53:35.779183+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-23T08:50:00.571063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7384c1ff-8c71-4feb-8cef-ba45c2a1708a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":892441948},{"type":"v1","addr":"172.21.15.82:6803","nonce":892441948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":892441948},{"type":"v1","addr":"172.21.15.82:6805","nonce":892441948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":892441948},{"type":"v1","addr":"172.21.15.82:6809","nonce":892441948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":892441948},{"type":"v1","addr":"172.21.15.82:6807","nonce":892441948}]},"public_addr":"172.21.15.82:6803/892441948","cluster_addr":"172.21.15.82:6805/892441948","heartbeat_back_addr":"172.21.15.82:6809/892441948","heartbeat_front_addr":"172.21.15.82:6807/892441948","state":["exists","up"]},{"osd":1,"uuid":"ca62333e-15db-4556-a9ed-8820f9268766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3224546922},{"type":"v1","addr":"172.21.15.135:6801","nonce":3224546922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3224546922},{"type":"v1","addr":"172.21.15.135:6803","nonce":3224546922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3224546922},{"type":"v1","addr":"172.21.15.135:6807","nonce":3224546922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3224546922},{"type":"v1","addr":"172.21.15.135:6805","nonce":3224546922}]},"public_addr":"172.21.15.135:6801/3224546922","cluster_addr":"172.21.15.135:6803/3224546922","heartbeat_back_addr":"172.21.15.135:6807/3224546922","heartbeat_front_addr":"172.21.15.135:6805/3224546922","state":["exists","up"]},{"osd":2,"uuid":"ac23eb38-216a-44f0-b316-a509b23745f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2358373459},{"type":"v1","addr":"172.21.15.161:6801","nonce":2358373459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2358373459},{"type":"v1","addr":"172.21.15.161:6803","nonce":2358373459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2358373459},{"type":"v1","addr":"172.21.15.161:6807","nonce":2358373459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2358373459},{"type":"v1","addr":"172.21.15.161:6805","nonce":2358373459}]},"public_addr":"172.21.15.161:6801/2358373459","cluster_addr":"172.21.15.161:6803/2358373459","heartbeat_back_addr":"172.21.15.161:6807/2358373459","heartbeat_front_addr":"172.21.15.161:6805/2358373459","state":["exists","up"]},{"osd":3,"uuid":"701c96b0-30fb-46ce-917d-e02d3814dc3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":1081464528},{"type":"v1","addr":"172.21.15.82:6811","nonce":1081464528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1081464528},{"type":"v1","addr":"172.21.15.82:6813","nonce":1081464528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1081464528},{"type":"v1","addr":"172.21.15.82:6817","nonce":1081464528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":1081464528},{"type":"v1","addr":"172.21.15.82:6815","nonce":1081464528}]},"public_addr":"172.21.15.82:6811/1081464528","cluster_addr":"172.21.15.82:6813/1081464528","heartbeat_back_addr":"172.21.15.82:6817/1081464528","heartbeat_front_addr":"172.21.15.82:6815/1081464528","state":["exists","up"]},{"osd":4,"uuid":"c618d2a2-3616-41b2-943c-7a4616538e13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2346495509},{"type":"v1","addr":"172.21.15.135:6809","nonce":2346495509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2346495509},{"type":"v1","addr":"172.21.15.135:6811","nonce":2346495509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2346495509},{"type":"v1","addr":"172.21.15.135:6815","nonce":2346495509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2346495509},{"type":"v1","addr":"172.21.15.135:6813","nonce":2346495509}]},"public_addr":"172.21.15.135:6809/2346495509","cluster_addr":"172.21.15.135:6811/2346495509","heartbeat_back_addr":"172.21.15.135:6815/2346495509","heartbeat_front_addr":"172.21.15.135:6813/2346495509","state":["exists","up"]},{"osd":5,"uuid":"8e1dda3d-6927-495d-b20d-78b03bb75d5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1252638628},{"type":"v1","addr":"172.21.15.161:6809","nonce":1252638628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1252638628},{"type":"v1","addr":"172.21.15.161:6811","nonce":1252638628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1252638628},{"type":"v1","addr":"172.21.15.161:6815","nonce":1252638628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1252638628},{"type":"v1","addr":"172.21.15.161:6813","nonce":1252638628}]},"public_addr":"172.21.15.161:6809/1252638628","cluster_addr":"172.21.15.161:6811/1252638628","heartbeat_back_addr":"172.21.15.161:6815/1252638628","heartbeat_front_addr":"172.21.15.161:6813/1252638628","state":["exists","up"]},{"osd":6,"uuid":"50b31960-6bc4-44e1-8116-3106bf161e56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1052038408},{"type":"v1","addr":"172.21.15.82:6819","nonce":1052038408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1052038408},{"type":"v1","addr":"172.21.15.82:6821","nonce":1052038408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":1052038408},{"type":"v1","addr":"172.21.15.82:6825","nonce":1052038408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1052038408},{"type":"v1","addr":"172.21.15.82:6823","nonce":1052038408}]},"public_addr":"172.21.15.82:6819/1052038408","cluster_addr":"172.21.15.82:6821/1052038408","heartbeat_back_addr":"172.21.15.82:6825/1052038408","heartbeat_front_addr":"172.21.15.82:6823/1052038408","state":["exists","up"]},{"osd":7,"uuid":"425ca0ee-57f7-4b27-90fb-d86bb5db5480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3683951498},{"type":"v1","addr":"172.21.15.135:6817","nonce":3683951498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":3683951498},{"type":"v1","addr":"172.21.15.135:6819","nonce":3683951498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":3683951498},{"type":"v1","addr":"172.21.15.135:6823","nonce":3683951498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":3683951498},{"type":"v1","addr":"172.21.15.135:6821","nonce":3683951498}]},"public_addr":"172.21.15.135:6817/3683951498","cluster_addr":"172.21.15.135:6819/3683951498","heartbeat_back_addr":"172.21.15.135:6823/3683951498","heartbeat_front_addr":"172.21.15.135:6821/3683951498","state":["exists","up"]},{"osd":8,"uuid":"1115c837-bef6-4bad-9974-4d913198511b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":948521536},{"type":"v1","addr":"172.21.15.161:6817","nonce":948521536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":948521536},{"type":"v1","addr":"172.21.15.161:6819","nonce":948521536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":948521536},{"type":"v1","addr":"172.21.15.161:6823","nonce":948521536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":948521536},{"type":"v1","addr":"172.21.15.161:6821","nonce":948521536}]},"public_addr":"172.21.15.161:6817/948521536","cluster_addr":"172.21.15.161:6819/948521536","heartbeat_back_addr":"172.21.15.161:6823/948521536","heartbeat_front_addr":"172.21.15.161:6821/948521536","state":["exists","up"]},{"osd":9,"uuid":"c52ec819-4bc6-402f-9cd8-62539e519e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":1438762840},{"type":"v1","addr":"172.21.15.82:6827","nonce":1438762840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":1438762840},{"type":"v1","addr":"172.21.15.82:6829","nonce":1438762840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1438762840},{"type":"v1","addr":"172.21.15.82:6833","nonce":1438762840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1438762840},{"type":"v1","addr":"172.21.15.82:6831","nonce":1438762840}]},"public_addr":"172.21.15.82:6827/1438762840","cluster_addr":"172.21.15.82:6829/1438762840","heartbeat_back_addr":"172.21.15.82:6833/1438762840","heartbeat_front_addr":"172.21.15.82:6831/1438762840","state":["exists","up"]},{"osd":10,"uuid":"1b16c795-1b91-4d46-ae5d-21b8332c1077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2853697851},{"type":"v1","addr":"172.21.15.135:6825","nonce":2853697851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2853697851},{"type":"v1","addr":"172.21.15.135:6827","nonce":2853697851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2853697851},{"type":"v1","addr":"172.21.15.135:6831","nonce":2853697851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2853697851},{"type":"v1","addr":"172.21.15.135:6829","nonce":2853697851}]},"public_addr":"172.21.15.135:6825/2853697851","cluster_addr":"172.21.15.135:6827/2853697851","heartbeat_back_addr":"172.21.15.135:6831/2853697851","heartbeat_front_addr":"172.21.15.135:6829/2853697851","state":["exists","up"]},{"osd":11,"uuid":"2551e602-4fe1-41cb-9b7d-c8b31fdd1487","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":1459332081},{"type":"v1","addr":"172.21.15.161:6825","nonce":1459332081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":1459332081},{"type":"v1","addr":"172.21.15.161:6827","nonce":1459332081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":1459332081},{"type":"v1","addr":"172.21.15.161:6831","nonce":1459332081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":1459332081},{"type":"v1","addr":"172.21.15.161:6829","nonce":1459332081}]},"public_addr":"172.21.15.161:6825/1459332081","cluster_addr":"172.21.15.161:6827/1459332081","heartbeat_back_addr":"172.21.15.161:6831/1459332081","heartbeat_front_addr":"172.21.15.161:6829/1459332081","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:49:04.007679+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:49:30.702365+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:49:56.785248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:50:22.988516+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:50:49.347055+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:51:15.830145+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:51:41.986377+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:52:08.218893+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:52:34.847450+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:53:01.317134+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:53:27.981691+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:53:54.849245+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/4204712132":"2023-09-24T08:47:21.957866+0000","172.21.15.82:6801/2733521564":"2023-09-24T08:47:21.957866+0000","172.21.15.82:6800/2733521564":"2023-09-24T08:47:21.957866+0000","172.21.15.82:0/3964794665":"2023-09-24T08:47:21.957866+0000","172.21.15.82:0/3535372205":"2023-09-24T08:46:55.187024+0000","172.21.15.82:0/285559684":"2023-09-24T08:46:55.187024+0000","172.21.15.82:0/1335891896":"2023-09-24T08:46:55.187024+0000","172.21.15.82:6801/3761509623":"2023-09-24T08:46:55.187024+0000","172.21.15.82:6800/3761509623":"2023-09-24T08:46:55.187024+0000","172.21.15.82:0/3775317005":"2023-09-24T08:47:21.957866+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-23T08:54:09.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:09.820+0000 7ff92f7ff700 1 -- 172.21.15.82:0/1675409278 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7ff91409ffa0 msgr2=0x7ff9140a2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:09.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:09.820+0000 7ff92f7ff700 1 --2- 172.21.15.82:0/1675409278 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7ff91409ffa0 0x7ff9140a2460 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff928101980 tx=0x7ff924009260 comp rx=0 tx=0).stop 2023-09-23T08:54:09.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:09.820+0000 7ff92f7ff700 1 -- 172.21.15.82:0/1675409278 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff928101b20 msgr2=0x7ff928072d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:09.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:09.820+0000 7ff92f7ff700 1 --2- 172.21.15.82:0/1675409278 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff928101b20 0x7ff928072d10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff918000c00 tx=0x7ff91800fab0 comp rx=0 tx=0).stop 2023-09-23T08:54:09.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:09.820+0000 7ff92f7ff700 1 -- 172.21.15.82:0/1675409278 shutdown_connections 2023-09-23T08:54:09.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:09.820+0000 7ff92f7ff700 1 --2- 172.21.15.82:0/1675409278 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7ff91409ffa0 0x7ff9140a2460 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:09.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:09.820+0000 7ff92f7ff700 1 --2- 172.21.15.82:0/1675409278 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff9281024c0 0x7ff928073250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:09.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:09.820+0000 7ff92f7ff700 1 --2- 172.21.15.82:0/1675409278 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff928100930 0x7ff9280746d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:09.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:09.820+0000 7ff92f7ff700 1 --2- 172.21.15.82:0/1675409278 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff928101b20 0x7ff928072d10 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:09.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:09.820+0000 7ff92f7ff700 1 -- 172.21.15.82:0/1675409278 >> 172.21.15.82:0/1675409278 conn(0x7ff9280fbe60 msgr2=0x7ff928105010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:54:09.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:09.821+0000 7ff92f7ff700 1 -- 172.21.15.82:0/1675409278 shutdown_connections 2023-09-23T08:54:09.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:09.821+0000 7ff92f7ff700 1 -- 172.21.15.82:0/1675409278 wait complete. 2023-09-23T08:54:09.840 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:09 smithi082 ceph-mon[97694]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:54:09.840 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:09 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:09.840 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:09 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:54:09.841 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:09 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:54:09.841 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:09 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:54:09.841 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:09 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:09.841 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:09 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-23T08:54:09.841 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:09 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-23T08:54:09.841 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:09 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:54:09.843 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-23T08:50:00.571063+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-23T08:54:09.843 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-23T08:54:10.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.042+0000 7f707d7ff700 1 -- 172.21.15.82:0/725886988 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f70781024c0 msgr2=0x7f7078108d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:10.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.042+0000 7f707d7ff700 1 --2- 172.21.15.82:0/725886988 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f70781024c0 0x7f7078108d70 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7070009f90 tx=0x7f707000b330 comp rx=0 tx=0).stop 2023-09-23T08:54:10.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.042+0000 7f707d7ff700 1 -- 172.21.15.82:0/725886988 shutdown_connections 2023-09-23T08:54:10.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.042+0000 7f707d7ff700 1 --2- 172.21.15.82:0/725886988 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f70781024c0 0x7f7078108d70 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:10.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.042+0000 7f707d7ff700 1 --2- 172.21.15.82:0/725886988 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7078100930 0x7f7078100d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:10.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.042+0000 7f707d7ff700 1 --2- 172.21.15.82:0/725886988 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7078101b20 0x7f7078101f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:10.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.042+0000 7f707d7ff700 1 -- 172.21.15.82:0/725886988 >> 172.21.15.82:0/725886988 conn(0x7f70780fbea0 msgr2=0x7f70780fe2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:54:10.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.042+0000 7f707d7ff700 1 -- 172.21.15.82:0/725886988 shutdown_connections 2023-09-23T08:54:10.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.042+0000 7f707d7ff700 1 -- 172.21.15.82:0/725886988 wait complete. 2023-09-23T08:54:10.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.043+0000 7f707d7ff700 1 Processor -- start 2023-09-23T08:54:10.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.043+0000 7f707d7ff700 1 -- start start 2023-09-23T08:54:10.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.043+0000 7f707d7ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7078100930 0x7f70780746d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:10.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.043+0000 7f707d7ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7078101b20 0x7f7078072d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:10.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.043+0000 7f707d7ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70781024c0 0x7f7078073250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:10.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.044+0000 7f707d7ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70780739f0 con 0x7f70781024c0 2023-09-23T08:54:10.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.044+0000 7f707d7ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7078073b60 con 0x7f7078101b20 2023-09-23T08:54:10.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.044+0000 7f707d7ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70781a0680 con 0x7f7078100930 2023-09-23T08:54:10.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.044+0000 7f70777fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70781024c0 0x7f7078073250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:10.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.044+0000 7f7076ffd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7078100930 0x7f70780746d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:10.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.044+0000 7f7076ffd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7078100930 0x7f70780746d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:43536/0 (socket says 172.21.15.82:43536) 2023-09-23T08:54:10.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.044+0000 7f7076ffd700 1 -- 172.21.15.82:0/4152613986 learned_addr learned my addr 172.21.15.82:0/4152613986 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:54:10.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.044+0000 7f706ffff700 1 --2- 172.21.15.82:0/4152613986 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7078101b20 0x7f7078072d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:10.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.044+0000 7f7076ffd700 1 -- 172.21.15.82:0/4152613986 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7078101b20 msgr2=0x7f7078072d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:10.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.044+0000 7f7076ffd700 1 --2- 172.21.15.82:0/4152613986 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7078101b20 0x7f7078072d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:10.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.044+0000 7f7076ffd700 1 -- 172.21.15.82:0/4152613986 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70781024c0 msgr2=0x7f7078073250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:10.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.044+0000 7f7076ffd700 1 --2- 172.21.15.82:0/4152613986 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70781024c0 0x7f7078073250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:10.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.044+0000 7f7076ffd700 1 -- 172.21.15.82:0/4152613986 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7070009c40 con 0x7f7078100930 2023-09-23T08:54:10.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.044+0000 7f70777fe700 1 --2- 172.21.15.82:0/4152613986 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70781024c0 0x7f7078073250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T08:54:10.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.044+0000 7f7076ffd700 1 --2- 172.21.15.82:0/4152613986 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7078100930 0x7f70780746d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f706800e970 tx=0x7f706800ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:54:10.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.045+0000 7f7074ff9700 1 -- 172.21.15.82:0/4152613986 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7068009790 con 0x7f7078100930 2023-09-23T08:54:10.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.045+0000 7f7074ff9700 1 -- 172.21.15.82:0/4152613986 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f706800c7c0 con 0x7f7078100930 2023-09-23T08:54:10.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.045+0000 7f707d7ff700 1 -- 172.21.15.82:0/4152613986 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70781a0960 con 0x7f7078100930 2023-09-23T08:54:10.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.045+0000 7f7074ff9700 1 -- 172.21.15.82:0/4152613986 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7068003b40 con 0x7f7078100930 2023-09-23T08:54:10.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.045+0000 7f707d7ff700 1 -- 172.21.15.82:0/4152613986 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70781a0e70 con 0x7f7078100930 2023-09-23T08:54:10.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.046+0000 7f707d7ff700 1 -- 172.21.15.82:0/4152613986 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7078107ef0 con 0x7f7078100930 2023-09-23T08:54:10.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.048+0000 7f7074ff9700 1 -- 172.21.15.82:0/4152613986 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 16) v1 ==== 134671+0+0 (secure 0 0 0) 0x7f706800c930 con 0x7f7078100930 2023-09-23T08:54:10.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.049+0000 7f7074ff9700 1 --2- 172.21.15.82:0/4152613986 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f706409ff50 0x7f70640a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:10.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.049+0000 7f7074ff9700 1 -- 172.21.15.82:0/4152613986 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f7068014070 con 0x7f7078100930 2023-09-23T08:54:10.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.049+0000 7f706ffff700 1 --2- 172.21.15.82:0/4152613986 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f706409ff50 0x7f70640a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:10.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.050+0000 7f706ffff700 1 --2- 172.21.15.82:0/4152613986 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f706409ff50 0x7f70640a2410 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7060005fd0 tx=0x7f7060009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:54:10.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.051+0000 7f7074ff9700 1 -- 172.21.15.82:0/4152613986 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f7068095290 con 0x7f7078100930 2023-09-23T08:54:10.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.254+0000 7f707d7ff700 1 -- 172.21.15.82:0/4152613986 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f707810c2b0 con 0x7f7078100930 2023-09-23T08:54:10.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.254+0000 7f7074ff9700 1 -- 172.21.15.82:0/4152613986 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) v1 ==== 93+0+10 (secure 0 0 0) 0x7f707810c2b0 con 0x7f7078100930 2023-09-23T08:54:10.257 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-09-23T08:54:10.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.257+0000 7f707d7ff700 1 -- 172.21.15.82:0/4152613986 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f706409ff50 msgr2=0x7f70640a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:10.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.257+0000 7f707d7ff700 1 --2- 172.21.15.82:0/4152613986 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f706409ff50 0x7f70640a2410 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7060005fd0 tx=0x7f7060009310 comp rx=0 tx=0).stop 2023-09-23T08:54:10.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.257+0000 7f707d7ff700 1 -- 172.21.15.82:0/4152613986 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7078100930 msgr2=0x7f70780746d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:10.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.257+0000 7f707d7ff700 1 --2- 172.21.15.82:0/4152613986 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7078100930 0x7f70780746d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f706800e970 tx=0x7f706800ec80 comp rx=0 tx=0).stop 2023-09-23T08:54:10.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.257+0000 7f707d7ff700 1 -- 172.21.15.82:0/4152613986 shutdown_connections 2023-09-23T08:54:10.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.257+0000 7f707d7ff700 1 --2- 172.21.15.82:0/4152613986 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f706409ff50 0x7f70640a2410 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:10.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.257+0000 7f707d7ff700 1 --2- 172.21.15.82:0/4152613986 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70781024c0 0x7f7078073250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:10.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.257+0000 7f707d7ff700 1 --2- 172.21.15.82:0/4152613986 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7078100930 0x7f70780746d0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:10.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.257+0000 7f707d7ff700 1 --2- 172.21.15.82:0/4152613986 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7078101b20 0x7f7078072d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:10.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.257+0000 7f707d7ff700 1 -- 172.21.15.82:0/4152613986 >> 172.21.15.82:0/4152613986 conn(0x7f70780fbea0 msgr2=0x7f7078105030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:54:10.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.257+0000 7f707d7ff700 1 -- 172.21.15.82:0/4152613986 shutdown_connections 2023-09-23T08:54:10.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.257+0000 7f707d7ff700 1 -- 172.21.15.82:0/4152613986 wait complete. 2023-09-23T08:54:10.279 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-23T08:54:10.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.474+0000 7f3ee9dff700 1 -- 172.21.15.82:0/3814261019 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ee4074960 msgr2=0x7f3ee4072db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:10.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.474+0000 7f3ee9dff700 1 --2- 172.21.15.82:0/3814261019 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ee4074960 0x7f3ee4072db0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3ed4009990 tx=0x7f3ed4009ca0 comp rx=0 tx=0).stop 2023-09-23T08:54:10.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.474+0000 7f3ee9dff700 1 -- 172.21.15.82:0/3814261019 shutdown_connections 2023-09-23T08:54:10.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.474+0000 7f3ee9dff700 1 --2- 172.21.15.82:0/3814261019 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ee41087f0 0x7f3ee410ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:10.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.474+0000 7f3ee9dff700 1 --2- 172.21.15.82:0/3814261019 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ee4074960 0x7f3ee4072db0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:10.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.474+0000 7f3ee9dff700 1 --2- 172.21.15.82:0/3814261019 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ee4073380 0x7f3ee4073800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:10.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.474+0000 7f3ee9dff700 1 -- 172.21.15.82:0/3814261019 >> 172.21.15.82:0/3814261019 conn(0x7f3ee40fbe60 msgr2=0x7f3ee40fe2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:54:10.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.474+0000 7f3ee9dff700 1 -- 172.21.15.82:0/3814261019 shutdown_connections 2023-09-23T08:54:10.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.474+0000 7f3ee9dff700 1 -- 172.21.15.82:0/3814261019 wait complete. 2023-09-23T08:54:10.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.475+0000 7f3ee9dff700 1 Processor -- start 2023-09-23T08:54:10.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.475+0000 7f3ee9dff700 1 -- start start 2023-09-23T08:54:10.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.475+0000 7f3ee9dff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ee4073380 0x7f3ee4198750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:10.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.475+0000 7f3ee9dff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ee4074960 0x7f3ee4198c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:10.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.475+0000 7f3ee9dff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ee41087f0 0x7f3ee419fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:10.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.475+0000 7f3ee9dff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee41a02d0 con 0x7f3ee4074960 2023-09-23T08:54:10.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.475+0000 7f3ee9dff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee41a0410 con 0x7f3ee4073380 2023-09-23T08:54:10.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.475+0000 7f3ee9dff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee41a05a0 con 0x7f3ee41087f0 2023-09-23T08:54:10.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.475+0000 7f3edbfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ee4074960 0x7f3ee4198c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:10.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.475+0000 7f3edbfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ee4074960 0x7f3ee4198c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39066/0 (socket says 172.21.15.82:39066) 2023-09-23T08:54:10.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.475+0000 7f3edbfff700 1 -- 172.21.15.82:0/4049707943 learned_addr learned my addr 172.21.15.82:0/4049707943 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:54:10.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.476+0000 7f3ee37fe700 1 --2- 172.21.15.82:0/4049707943 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ee4073380 0x7f3ee4198750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:10.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.476+0000 7f3ee3fff700 1 --2- 172.21.15.82:0/4049707943 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ee41087f0 0x7f3ee419fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:10.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.476+0000 7f3edbfff700 1 -- 172.21.15.82:0/4049707943 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ee41087f0 msgr2=0x7f3ee419fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:10.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.476+0000 7f3edbfff700 1 --2- 172.21.15.82:0/4049707943 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ee41087f0 0x7f3ee419fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:10.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.476+0000 7f3edbfff700 1 -- 172.21.15.82:0/4049707943 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ee4073380 msgr2=0x7f3ee4198750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:10.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.476+0000 7f3edbfff700 1 --2- 172.21.15.82:0/4049707943 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ee4073380 0x7f3ee4198750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:10.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.476+0000 7f3edbfff700 1 -- 172.21.15.82:0/4049707943 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ed40095f0 con 0x7f3ee4074960 2023-09-23T08:54:10.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.476+0000 7f3edbfff700 1 --2- 172.21.15.82:0/4049707943 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ee4074960 0x7f3ee4198c90 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc00e970 tx=0x7f3ecc00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:54:10.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.476+0000 7f3ee17fa700 1 -- 172.21.15.82:0/4049707943 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ecc009790 con 0x7f3ee4074960 2023-09-23T08:54:10.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.476+0000 7f3ee9dff700 1 -- 172.21.15.82:0/4049707943 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ee41a0880 con 0x7f3ee4074960 2023-09-23T08:54:10.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.476+0000 7f3ee17fa700 1 -- 172.21.15.82:0/4049707943 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3ecc00c7e0 con 0x7f3ee4074960 2023-09-23T08:54:10.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.476+0000 7f3ee17fa700 1 -- 172.21.15.82:0/4049707943 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ecc003bd0 con 0x7f3ee4074960 2023-09-23T08:54:10.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.476+0000 7f3ee9dff700 1 -- 172.21.15.82:0/4049707943 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ee41a0d90 con 0x7f3ee4074960 2023-09-23T08:54:10.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.477+0000 7f3ee9dff700 1 -- 172.21.15.82:0/4049707943 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ee4106ea0 con 0x7f3ee4074960 2023-09-23T08:54:10.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.479+0000 7f3ee17fa700 1 -- 172.21.15.82:0/4049707943 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 134671+0+0 (secure 0 0 0) 0x7f3ecc00c950 con 0x7f3ee4074960 2023-09-23T08:54:10.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.481+0000 7f3ee17fa700 1 --2- 172.21.15.82:0/4049707943 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f3ed009ffa0 0x7f3ed00a2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:10.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.481+0000 7f3ee17fa700 1 -- 172.21.15.82:0/4049707943 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f3ecc014070 con 0x7f3ee4074960 2023-09-23T08:54:10.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.481+0000 7f3ee37fe700 1 --2- 172.21.15.82:0/4049707943 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f3ed009ffa0 0x7f3ed00a2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:10.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.482+0000 7f3ee37fe700 1 --2- 172.21.15.82:0/4049707943 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f3ed009ffa0 0x7f3ed00a2460 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3ed4006010 tx=0x7f3ed400b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:54:10.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.483+0000 7f3ee17fa700 1 -- 172.21.15.82:0/4049707943 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f3ecc0952f0 con 0x7f3ee4074960 2023-09-23T08:54:10.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:10 smithi082 ceph-mon[97694]: from='client.24439 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi082=a;smithi082=d;smithi082=g;smithi082=j;smithi135=b;smithi135=e;smithi135=h;smithi135=k;smithi161=c;smithi161=f;smithi161=i;smithi161=l", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:54:10.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:10 smithi082 ceph-mon[97694]: Saving service mds.all spec with placement smithi082=a;smithi082=d;smithi082=g;smithi082=j;smithi135=b;smithi135=e;smithi135=h;smithi135=k;smithi161=c;smithi161=f;smithi161=i;smithi161=l;count:12 2023-09-23T08:54:10.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:10 smithi082 ceph-mon[97694]: Deploying daemon mds.l on smithi161 2023-09-23T08:54:10.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:10 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/1675409278' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-23T08:54:10.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:10 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/4152613986' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-23T08:54:10.631 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:10 smithi161 ceph-mon[99580]: from='client.24439 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi082=a;smithi082=d;smithi082=g;smithi082=j;smithi135=b;smithi135=e;smithi135=h;smithi135=k;smithi161=c;smithi161=f;smithi161=i;smithi161=l", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:54:10.632 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:10 smithi161 ceph-mon[99580]: Saving service mds.all spec with placement smithi082=a;smithi082=d;smithi082=g;smithi082=j;smithi135=b;smithi135=e;smithi135=h;smithi135=k;smithi161=c;smithi161=f;smithi161=i;smithi161=l;count:12 2023-09-23T08:54:10.632 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:10 smithi161 ceph-mon[99580]: Deploying daemon mds.l on smithi161 2023-09-23T08:54:10.632 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:10 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/1675409278' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-23T08:54:10.632 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:10 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/4152613986' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-23T08:54:10.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.730+0000 7f3ee9dff700 1 -- 172.21.15.82:0/4049707943 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3ee410e220 con 0x7f3ee4074960 2023-09-23T08:54:10.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.731+0000 7f3ee17fa700 1 -- 172.21.15.82:0/4049707943 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+535 (secure 0 0 0) 0x7f3ecc098910 con 0x7f3ee4074960 2023-09-23T08:54:10.733 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:54:10.734 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2023-09-23T08:54:10.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.733+0000 7f3ee9dff700 1 -- 172.21.15.82:0/4049707943 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f3ed009ffa0 msgr2=0x7f3ed00a2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:10.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.733+0000 7f3ee9dff700 1 --2- 172.21.15.82:0/4049707943 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f3ed009ffa0 0x7f3ed00a2460 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3ed4006010 tx=0x7f3ed400b260 comp rx=0 tx=0).stop 2023-09-23T08:54:10.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.733+0000 7f3ee9dff700 1 -- 172.21.15.82:0/4049707943 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ee4074960 msgr2=0x7f3ee4198c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:10.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.733+0000 7f3ee9dff700 1 --2- 172.21.15.82:0/4049707943 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ee4074960 0x7f3ee4198c90 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc00e970 tx=0x7f3ecc00ec80 comp rx=0 tx=0).stop 2023-09-23T08:54:10.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.733+0000 7f3ee9dff700 1 -- 172.21.15.82:0/4049707943 shutdown_connections 2023-09-23T08:54:10.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.733+0000 7f3ee9dff700 1 --2- 172.21.15.82:0/4049707943 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f3ed009ffa0 0x7f3ed00a2460 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:10.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.733+0000 7f3ee9dff700 1 --2- 172.21.15.82:0/4049707943 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ee41087f0 0x7f3ee419fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:10.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.733+0000 7f3ee9dff700 1 --2- 172.21.15.82:0/4049707943 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ee4073380 0x7f3ee4198750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:10.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.733+0000 7f3ee9dff700 1 --2- 172.21.15.82:0/4049707943 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ee4074960 0x7f3ee4198c90 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:10.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.733+0000 7f3ee9dff700 1 -- 172.21.15.82:0/4049707943 >> 172.21.15.82:0/4049707943 conn(0x7f3ee40fbe60 msgr2=0x7f3ee40fe250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:54:10.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.733+0000 7f3ee9dff700 1 -- 172.21.15.82:0/4049707943 shutdown_connections 2023-09-23T08:54:10.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:10.734+0000 7f3ee9dff700 1 -- 172.21.15.82:0/4049707943 wait complete. 2023-09-23T08:54:10.737 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 1 2023-09-23T08:54:10.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:10 smithi135 ceph-mon[99205]: from='client.24439 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi082=a;smithi082=d;smithi082=g;smithi082=j;smithi135=b;smithi135=e;smithi135=h;smithi135=k;smithi161=c;smithi161=f;smithi161=i;smithi161=l", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:54:10.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:10 smithi135 ceph-mon[99205]: Saving service mds.all spec with placement smithi082=a;smithi082=d;smithi082=g;smithi082=j;smithi135=b;smithi135=e;smithi135=h;smithi135=k;smithi161=c;smithi161=f;smithi161=i;smithi161=l;count:12 2023-09-23T08:54:10.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:10 smithi135 ceph-mon[99205]: Deploying daemon mds.l on smithi161 2023-09-23T08:54:10.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:10 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/1675409278' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-23T08:54:10.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:10 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/4152613986' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-23T08:54:10.887 INFO:journalctl@ceph.mds.l.smithi161.stdout:Sep 23 08:54:10 smithi161 systemd[1]: Starting Ceph mds.l for 8926e286-59ed-11ee-8db4-212e2dc638e7... 2023-09-23T08:54:11.594 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:11 smithi161 ceph-mon[99580]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:54:11.594 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:11 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/4049707943' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T08:54:11.595 INFO:journalctl@ceph.mds.l.smithi161.stdout:Sep 23 08:54:11 smithi161 podman[124864]: 2023-09-23T08:54:11.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:11 smithi135 ceph-mon[99205]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:54:11.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:11 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/4049707943' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T08:54:11.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:11 smithi082 ceph-mon[97694]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:54:11.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:11 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/4049707943' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T08:54:11.898 INFO:journalctl@ceph.mds.l.smithi161.stdout:Sep 23 08:54:11 smithi161 bash[124864]: f1dea9e1b3ec96e90410e426492bc02400152f024c18640e45b4c07b44dd343f 2023-09-23T08:54:11.898 INFO:journalctl@ceph.mds.l.smithi161.stdout:Sep 23 08:54:11 smithi161 ceph-mds[124905]: -- 172.21.15.161:0/4047450703 <== mon.1 v2:172.21.15.161:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5564a2ccd1e0 con 0x5564a2ca3000 2023-09-23T08:54:11.898 INFO:journalctl@ceph.mds.l.smithi161.stdout:Sep 23 08:54:11 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mds-l[124880]: starting mds.l at 2023-09-23T08:54:11.898 INFO:journalctl@ceph.mds.l.smithi161.stdout:Sep 23 08:54:11 smithi161 systemd[1]: Started Ceph mds.l for 8926e286-59ed-11ee-8db4-212e2dc638e7. 2023-09-23T08:54:12.755 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-23T08:54:12.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:12 smithi082 ceph-mon[97694]: mds.? [v2:172.21.15.161:6832/471569125,v1:172.21.15.161:6833/471569125] up:boot 2023-09-23T08:54:12.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:12 smithi082 ceph-mon[97694]: fsmap 1 up:standby 2023-09-23T08:54:12.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:12 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-09-23T08:54:12.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:12 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:12.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:12 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:12.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:12 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:12.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:12 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-23T08:54:12.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:12 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-23T08:54:12.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:12 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:54:12.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:12 smithi082 ceph-mon[97694]: Deploying daemon mds.k on smithi135 2023-09-23T08:54:12.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:12 smithi082 ceph-mon[97694]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:54:12.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:12 smithi161 ceph-mon[99580]: mds.? [v2:172.21.15.161:6832/471569125,v1:172.21.15.161:6833/471569125] up:boot 2023-09-23T08:54:12.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:12 smithi161 ceph-mon[99580]: fsmap 1 up:standby 2023-09-23T08:54:12.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:12 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-09-23T08:54:12.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:12 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:12.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:12 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:12.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:12 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:12.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:12 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-23T08:54:12.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:12 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-23T08:54:12.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:12 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:54:12.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:12 smithi161 ceph-mon[99580]: Deploying daemon mds.k on smithi135 2023-09-23T08:54:12.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:12 smithi161 ceph-mon[99580]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:54:12.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:12.960+0000 7fdc809ff700 1 -- 172.21.15.82:0/3530323246 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc7c100930 msgr2=0x7fdc7c100d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:12.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:12.960+0000 7fdc809ff700 1 --2- 172.21.15.82:0/3530323246 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc7c100930 0x7fdc7c100d50 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c0099c0 tx=0x7fdc6c009cd0 comp rx=0 tx=0).stop 2023-09-23T08:54:12.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:12.960+0000 7fdc809ff700 1 -- 172.21.15.82:0/3530323246 shutdown_connections 2023-09-23T08:54:12.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:12.960+0000 7fdc809ff700 1 --2- 172.21.15.82:0/3530323246 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc7c1024c0 0x7fdc7c108d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:12.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:12.960+0000 7fdc809ff700 1 --2- 172.21.15.82:0/3530323246 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc7c100930 0x7fdc7c100d50 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:12.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:12.960+0000 7fdc809ff700 1 --2- 172.21.15.82:0/3530323246 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdc7c101b20 0x7fdc7c101f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:12.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:12.960+0000 7fdc809ff700 1 -- 172.21.15.82:0/3530323246 >> 172.21.15.82:0/3530323246 conn(0x7fdc7c0fbe60 msgr2=0x7fdc7c0fe2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:54:12.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:12.960+0000 7fdc809ff700 1 -- 172.21.15.82:0/3530323246 shutdown_connections 2023-09-23T08:54:12.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:12.960+0000 7fdc809ff700 1 -- 172.21.15.82:0/3530323246 wait complete. 2023-09-23T08:54:12.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:12.961+0000 7fdc809ff700 1 Processor -- start 2023-09-23T08:54:12.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:12.961+0000 7fdc809ff700 1 -- start start 2023-09-23T08:54:12.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:12.961+0000 7fdc809ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc7c100930 0x7fdc7c0746d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:12.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:12.962+0000 7fdc809ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdc7c101b20 0x7fdc7c072d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:12.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:12.962+0000 7fdc809ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc7c1024c0 0x7fdc7c073250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:12.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:12.962+0000 7fdc809ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc7c0739f0 con 0x7fdc7c1024c0 2023-09-23T08:54:12.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:12.962+0000 7fdc809ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc7c073b60 con 0x7fdc7c100930 2023-09-23T08:54:12.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:12.962+0000 7fdc809ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc7c1a0590 con 0x7fdc7c101b20 2023-09-23T08:54:12.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:12.962+0000 7fdc7ad9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc7c1024c0 0x7fdc7c073250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:12.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:12.962+0000 7fdc7ad9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc7c1024c0 0x7fdc7c073250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33410/0 (socket says 172.21.15.82:33410) 2023-09-23T08:54:12.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:12.962+0000 7fdc7ad9d700 1 -- 172.21.15.82:0/1554830267 learned_addr learned my addr 172.21.15.82:0/1554830267 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:54:12.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:12.962+0000 7fdc7a59c700 1 --2- 172.21.15.82:0/1554830267 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc7c100930 0x7fdc7c0746d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:12.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:12.962+0000 7fdc79d9b700 1 --2- 172.21.15.82:0/1554830267 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdc7c101b20 0x7fdc7c072d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:12.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:12.962+0000 7fdc7ad9d700 1 -- 172.21.15.82:0/1554830267 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdc7c101b20 msgr2=0x7fdc7c072d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:12.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:12.962+0000 7fdc7ad9d700 1 --2- 172.21.15.82:0/1554830267 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdc7c101b20 0x7fdc7c072d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:12.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:12.962+0000 7fdc7ad9d700 1 -- 172.21.15.82:0/1554830267 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc7c100930 msgr2=0x7fdc7c0746d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:12.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:12.962+0000 7fdc7ad9d700 1 --2- 172.21.15.82:0/1554830267 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc7c100930 0x7fdc7c0746d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:12.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:12.962+0000 7fdc7ad9d700 1 -- 172.21.15.82:0/1554830267 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc6c0095f0 con 0x7fdc7c1024c0 2023-09-23T08:54:12.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:12.962+0000 7fdc7ad9d700 1 --2- 172.21.15.82:0/1554830267 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc7c1024c0 0x7fdc7c073250 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fdc7400ef30 tx=0x7fdc7400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:54:12.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:12.963+0000 7fdc6b7fe700 1 -- 172.21.15.82:0/1554830267 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc74018070 con 0x7fdc7c1024c0 2023-09-23T08:54:12.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:12.963+0000 7fdc6b7fe700 1 -- 172.21.15.82:0/1554830267 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdc7400f040 con 0x7fdc7c1024c0 2023-09-23T08:54:12.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:12.963+0000 7fdc6b7fe700 1 -- 172.21.15.82:0/1554830267 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc7400cc70 con 0x7fdc7c1024c0 2023-09-23T08:54:12.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:12.963+0000 7fdc809ff700 1 -- 172.21.15.82:0/1554830267 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc7c1a0810 con 0x7fdc7c1024c0 2023-09-23T08:54:12.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:12.963+0000 7fdc809ff700 1 -- 172.21.15.82:0/1554830267 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc7c1a0cd0 con 0x7fdc7c1024c0 2023-09-23T08:54:12.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:12.964+0000 7fdc809ff700 1 -- 172.21.15.82:0/1554830267 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc7c107f40 con 0x7fdc7c1024c0 2023-09-23T08:54:12.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:12.966+0000 7fdc6b7fe700 1 -- 172.21.15.82:0/1554830267 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 134671+0+0 (secure 0 0 0) 0x7fdc74007500 con 0x7fdc7c1024c0 2023-09-23T08:54:12.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:12.967+0000 7fdc6b7fe700 1 --2- 172.21.15.82:0/1554830267 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fdc640a0020 0x7fdc640a24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:12.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:12.967+0000 7fdc6b7fe700 1 -- 172.21.15.82:0/1554830267 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fdc740ca9a0 con 0x7fdc7c1024c0 2023-09-23T08:54:12.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:12.967+0000 7fdc7a59c700 1 --2- 172.21.15.82:0/1554830267 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fdc640a0020 0x7fdc640a24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:12.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:12.968+0000 7fdc7a59c700 1 --2- 172.21.15.82:0/1554830267 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fdc640a0020 0x7fdc640a24e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c000c00 tx=0x7fdc6c0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:54:12.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:12.971+0000 7fdc6b7fe700 1 -- 172.21.15.82:0/1554830267 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7fdc74094bc0 con 0x7fdc7c1024c0 2023-09-23T08:54:12.979 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:12 smithi135 ceph-mon[99205]: mds.? [v2:172.21.15.161:6832/471569125,v1:172.21.15.161:6833/471569125] up:boot 2023-09-23T08:54:12.979 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:12 smithi135 ceph-mon[99205]: fsmap 1 up:standby 2023-09-23T08:54:12.979 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:12 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-09-23T08:54:12.979 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:12 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:12.980 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:12 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:12.980 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:12 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:12.980 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:12 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-23T08:54:12.980 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:12 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-23T08:54:12.980 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:12 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:54:12.980 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:12 smithi135 ceph-mon[99205]: Deploying daemon mds.k on smithi135 2023-09-23T08:54:12.980 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:12 smithi135 ceph-mon[99205]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:54:13.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:13.214+0000 7fdc809ff700 1 -- 172.21.15.82:0/1554830267 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdc7c10c040 con 0x7fdc7c1024c0 2023-09-23T08:54:13.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:13.214+0000 7fdc6b7fe700 1 -- 172.21.15.82:0/1554830267 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1325 (secure 0 0 0) 0x7fdc740981e0 con 0x7fdc7c1024c0 2023-09-23T08:54:13.217 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:54:13.217 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24463,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6833/471569125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":471569125},{"type":"v1","addr":"172.21.15.161:6833","nonce":471569125}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-09-23T08:54:13.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:13.217+0000 7fdc809ff700 1 -- 172.21.15.82:0/1554830267 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fdc640a0020 msgr2=0x7fdc640a24e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:13.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:13.217+0000 7fdc809ff700 1 --2- 172.21.15.82:0/1554830267 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fdc640a0020 0x7fdc640a24e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c000c00 tx=0x7fdc6c0058e0 comp rx=0 tx=0).stop 2023-09-23T08:54:13.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:13.217+0000 7fdc809ff700 1 -- 172.21.15.82:0/1554830267 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc7c1024c0 msgr2=0x7fdc7c073250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:13.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:13.217+0000 7fdc809ff700 1 --2- 172.21.15.82:0/1554830267 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc7c1024c0 0x7fdc7c073250 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fdc7400ef30 tx=0x7fdc7400c3a0 comp rx=0 tx=0).stop 2023-09-23T08:54:13.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:13.217+0000 7fdc809ff700 1 -- 172.21.15.82:0/1554830267 shutdown_connections 2023-09-23T08:54:13.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:13.217+0000 7fdc809ff700 1 --2- 172.21.15.82:0/1554830267 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fdc640a0020 0x7fdc640a24e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:13.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:13.217+0000 7fdc809ff700 1 --2- 172.21.15.82:0/1554830267 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc7c1024c0 0x7fdc7c073250 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:13.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:13.217+0000 7fdc809ff700 1 --2- 172.21.15.82:0/1554830267 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc7c100930 0x7fdc7c0746d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:13.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:13.217+0000 7fdc809ff700 1 --2- 172.21.15.82:0/1554830267 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdc7c101b20 0x7fdc7c072d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:13.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:13.217+0000 7fdc809ff700 1 -- 172.21.15.82:0/1554830267 >> 172.21.15.82:0/1554830267 conn(0x7fdc7c0fbe60 msgr2=0x7fdc7c105080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:54:13.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:13.217+0000 7fdc809ff700 1 -- 172.21.15.82:0/1554830267 shutdown_connections 2023-09-23T08:54:13.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:13.217+0000 7fdc809ff700 1 -- 172.21.15.82:0/1554830267 wait complete. 2023-09-23T08:54:13.221 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 2 2023-09-23T08:54:14.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:13 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/1554830267' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T08:54:14.063 INFO:journalctl@ceph.mds.k.smithi135.stdout:Sep 23 08:54:13 smithi135 systemd[1]: Starting Ceph mds.k for 8926e286-59ed-11ee-8db4-212e2dc638e7... 2023-09-23T08:54:14.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:13 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/1554830267' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T08:54:14.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:13 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/1554830267' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T08:54:14.627 INFO:journalctl@ceph.mds.k.smithi135.stdout:Sep 23 08:54:14 smithi135 podman[123636]: 2023-09-23T08:54:14.627 INFO:journalctl@ceph.mds.k.smithi135.stdout:Sep 23 08:54:14 smithi135 bash[123636]: 3e02f088cb9a42a69b4e3523b1ebe445267c96f6a872f6db05943727764ad367 2023-09-23T08:54:14.627 INFO:journalctl@ceph.mds.k.smithi135.stdout:Sep 23 08:54:14 smithi135 ceph-mds[123676]: -- 172.21.15.135:0/2443911389 <== mon.2 v2:172.21.15.135:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55d3e27db1e0 con 0x55d3e27b1000 2023-09-23T08:54:14.627 INFO:journalctl@ceph.mds.k.smithi135.stdout:Sep 23 08:54:14 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mds-k[123652]: starting mds.k at 2023-09-23T08:54:15.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:14 smithi135 ceph-mon[99205]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:54:15.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:14 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:15.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:14 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:15.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:14 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:15.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:14 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-23T08:54:15.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:14 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-23T08:54:15.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:14 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:54:15.063 INFO:journalctl@ceph.mds.k.smithi135.stdout:Sep 23 08:54:14 smithi135 systemd[1]: Started Ceph mds.k for 8926e286-59ed-11ee-8db4-212e2dc638e7. 2023-09-23T08:54:15.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:14 smithi082 ceph-mon[97694]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:54:15.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:14 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:15.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:14 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:15.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:14 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:15.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:14 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-23T08:54:15.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:14 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-23T08:54:15.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:14 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:54:15.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:14 smithi161 ceph-mon[99580]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:54:15.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:14 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:15.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:14 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:15.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:14 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:15.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:14 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-23T08:54:15.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:14 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-23T08:54:15.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:14 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:54:15.239 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-23T08:54:15.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:15.454+0000 7f53575ff700 1 -- 172.21.15.82:0/3829157521 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53501024c0 msgr2=0x7f5350108d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:15.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:15.454+0000 7f53575ff700 1 --2- 172.21.15.82:0/3829157521 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53501024c0 0x7f5350108d70 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f534800b0d0 tx=0x7f534800b3e0 comp rx=0 tx=0).stop 2023-09-23T08:54:15.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:15.454+0000 7f53575ff700 1 -- 172.21.15.82:0/3829157521 shutdown_connections 2023-09-23T08:54:15.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:15.454+0000 7f53575ff700 1 --2- 172.21.15.82:0/3829157521 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53501024c0 0x7f5350108d70 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:15.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:15.454+0000 7f53575ff700 1 --2- 172.21.15.82:0/3829157521 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5350100930 0x7f5350100d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:15.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:15.454+0000 7f53575ff700 1 --2- 172.21.15.82:0/3829157521 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5350101b20 0x7f5350101f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:15.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:15.454+0000 7f53575ff700 1 -- 172.21.15.82:0/3829157521 >> 172.21.15.82:0/3829157521 conn(0x7f53500fbe60 msgr2=0x7f53500fe2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:54:15.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:15.454+0000 7f53575ff700 1 -- 172.21.15.82:0/3829157521 shutdown_connections 2023-09-23T08:54:15.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:15.454+0000 7f53575ff700 1 -- 172.21.15.82:0/3829157521 wait complete. 2023-09-23T08:54:15.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:15.455+0000 7f53575ff700 1 Processor -- start 2023-09-23T08:54:15.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:15.455+0000 7f53575ff700 1 -- start start 2023-09-23T08:54:15.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:15.456+0000 7f53575ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5350100930 0x7f5350196600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:15.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:15.456+0000 7f53575ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5350101b20 0x7f5350196b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:15.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:15.456+0000 7f53575ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53501024c0 0x7f535019dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:15.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:15.456+0000 7f53575ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f535019e180 con 0x7f5350100930 2023-09-23T08:54:15.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:15.456+0000 7f53575ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f535019e2c0 con 0x7f53501024c0 2023-09-23T08:54:15.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:15.456+0000 7f53575ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f535019e450 con 0x7f5350101b20 2023-09-23T08:54:15.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:15.456+0000 7f535539b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5350100930 0x7f5350196600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:15.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:15.456+0000 7f535539b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5350100930 0x7f5350196600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33432/0 (socket says 172.21.15.82:33432) 2023-09-23T08:54:15.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:15.456+0000 7f535539b700 1 -- 172.21.15.82:0/266124223 learned_addr learned my addr 172.21.15.82:0/266124223 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:54:15.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:15.456+0000 7f5354b9a700 1 --2- 172.21.15.82:0/266124223 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5350101b20 0x7f5350196b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:15.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:15.456+0000 7f535539b700 1 -- 172.21.15.82:0/266124223 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5350101b20 msgr2=0x7f5350196b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:15.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:15.456+0000 7f535539b700 1 --2- 172.21.15.82:0/266124223 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5350101b20 0x7f5350196b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:15.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:15.456+0000 7f5355b9c700 1 --2- 172.21.15.82:0/266124223 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53501024c0 0x7f535019dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:15.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:15.456+0000 7f535539b700 1 -- 172.21.15.82:0/266124223 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53501024c0 msgr2=0x7f535019dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:15.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:15.456+0000 7f535539b700 1 --2- 172.21.15.82:0/266124223 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53501024c0 0x7f535019dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:15.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:15.456+0000 7f535539b700 1 -- 172.21.15.82:0/266124223 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5348009d00 con 0x7f5350100930 2023-09-23T08:54:15.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:15.456+0000 7f535539b700 1 --2- 172.21.15.82:0/266124223 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5350100930 0x7f5350196600 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f534c00d980 tx=0x7f534c00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:54:15.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:15.457+0000 7f53467fc700 1 -- 172.21.15.82:0/266124223 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534c00de60 con 0x7f5350100930 2023-09-23T08:54:15.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:15.457+0000 7f53575ff700 1 -- 172.21.15.82:0/266124223 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f535019e730 con 0x7f5350100930 2023-09-23T08:54:15.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:15.457+0000 7f53467fc700 1 -- 172.21.15.82:0/266124223 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f534c0044b0 con 0x7f5350100930 2023-09-23T08:54:15.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:15.457+0000 7f53467fc700 1 -- 172.21.15.82:0/266124223 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534c003b40 con 0x7f5350100930 2023-09-23T08:54:15.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:15.457+0000 7f53575ff700 1 -- 172.21.15.82:0/266124223 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f535019ec40 con 0x7f5350100930 2023-09-23T08:54:15.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:15.458+0000 7f53575ff700 1 -- 172.21.15.82:0/266124223 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f535010c050 con 0x7f5350100930 2023-09-23T08:54:15.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:15.460+0000 7f53467fc700 1 -- 172.21.15.82:0/266124223 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 134671+0+0 (secure 0 0 0) 0x7f534c003ca0 con 0x7f5350100930 2023-09-23T08:54:15.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:15.463+0000 7f53467fc700 1 --2- 172.21.15.82:0/266124223 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f533c0a0020 0x7f533c0a24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:15.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:15.463+0000 7f53467fc700 1 -- 172.21.15.82:0/266124223 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f534c0cab30 con 0x7f5350100930 2023-09-23T08:54:15.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:15.463+0000 7f5354b9a700 1 --2- 172.21.15.82:0/266124223 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f533c0a0020 0x7f533c0a24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:15.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:15.464+0000 7f5354b9a700 1 --2- 172.21.15.82:0/266124223 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f533c0a0020 0x7f533c0a24e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5340005fd0 tx=0x7f5340005f60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:54:15.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:15.467+0000 7f53467fc700 1 -- 172.21.15.82:0/266124223 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f534c094cc0 con 0x7f5350100930 2023-09-23T08:54:15.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:15.732+0000 7f53575ff700 1 -- 172.21.15.82:0/266124223 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f535010c2b0 con 0x7f5350100930 2023-09-23T08:54:15.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:15.733+0000 7f53467fc700 1 -- 172.21.15.82:0/266124223 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2116 (secure 0 0 0) 0x7f534c009940 con 0x7f5350100930 2023-09-23T08:54:15.736 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:54:15.736 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/503886037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":503886037},{"type":"v1","addr":"172.21.15.135:6833","nonce":503886037}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24463,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6833/471569125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":471569125},{"type":"v1","addr":"172.21.15.161:6833","nonce":471569125}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-09-23T08:54:15.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:15.735+0000 7f53575ff700 1 -- 172.21.15.82:0/266124223 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f533c0a0020 msgr2=0x7f533c0a24e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:15.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:15.735+0000 7f53575ff700 1 --2- 172.21.15.82:0/266124223 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f533c0a0020 0x7f533c0a24e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5340005fd0 tx=0x7f5340005f60 comp rx=0 tx=0).stop 2023-09-23T08:54:15.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:15.735+0000 7f53575ff700 1 -- 172.21.15.82:0/266124223 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5350100930 msgr2=0x7f5350196600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:15.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:15.735+0000 7f53575ff700 1 --2- 172.21.15.82:0/266124223 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5350100930 0x7f5350196600 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f534c00d980 tx=0x7f534c00dd40 comp rx=0 tx=0).stop 2023-09-23T08:54:15.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:15.736+0000 7f53575ff700 1 -- 172.21.15.82:0/266124223 shutdown_connections 2023-09-23T08:54:15.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:15.736+0000 7f53575ff700 1 --2- 172.21.15.82:0/266124223 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f533c0a0020 0x7f533c0a24e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:15.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:15.736+0000 7f53575ff700 1 --2- 172.21.15.82:0/266124223 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53501024c0 0x7f535019dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:15.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:15.736+0000 7f53575ff700 1 --2- 172.21.15.82:0/266124223 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5350100930 0x7f5350196600 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:15.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:15.736+0000 7f53575ff700 1 --2- 172.21.15.82:0/266124223 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5350101b20 0x7f5350196b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:15.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:15.736+0000 7f53575ff700 1 -- 172.21.15.82:0/266124223 >> 172.21.15.82:0/266124223 conn(0x7f53500fbe60 msgr2=0x7f53500fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:54:15.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:15.736+0000 7f53575ff700 1 -- 172.21.15.82:0/266124223 shutdown_connections 2023-09-23T08:54:15.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:15.736+0000 7f53575ff700 1 -- 172.21.15.82:0/266124223 wait complete. 2023-09-23T08:54:15.741 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 3 2023-09-23T08:54:15.963 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:15 smithi082 ceph-mon[97694]: Deploying daemon mds.j on smithi082 2023-09-23T08:54:15.963 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:15 smithi082 ceph-mon[97694]: mds.? [v2:172.21.15.135:6832/503886037,v1:172.21.15.135:6833/503886037] up:boot 2023-09-23T08:54:15.963 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:15 smithi082 ceph-mon[97694]: fsmap 2 up:standby 2023-09-23T08:54:15.964 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:15 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-09-23T08:54:15.964 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:15 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/266124223' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T08:54:16.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:15 smithi135 ceph-mon[99205]: Deploying daemon mds.j on smithi082 2023-09-23T08:54:16.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:15 smithi135 ceph-mon[99205]: mds.? [v2:172.21.15.135:6832/503886037,v1:172.21.15.135:6833/503886037] up:boot 2023-09-23T08:54:16.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:15 smithi135 ceph-mon[99205]: fsmap 2 up:standby 2023-09-23T08:54:16.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:15 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-09-23T08:54:16.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:15 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/266124223' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T08:54:16.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:15 smithi161 ceph-mon[99580]: Deploying daemon mds.j on smithi082 2023-09-23T08:54:16.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:15 smithi161 ceph-mon[99580]: mds.? [v2:172.21.15.135:6832/503886037,v1:172.21.15.135:6833/503886037] up:boot 2023-09-23T08:54:16.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:15 smithi161 ceph-mon[99580]: fsmap 2 up:standby 2023-09-23T08:54:16.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:15 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-09-23T08:54:16.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:15 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/266124223' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T08:54:16.837 INFO:journalctl@ceph.mds.j.smithi082.stdout:Sep 23 08:54:16 smithi082 systemd[1]: Starting Ceph mds.j for 8926e286-59ed-11ee-8db4-212e2dc638e7... 2023-09-23T08:54:17.591 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:17 smithi082 ceph-mon[97694]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:54:17.591 INFO:journalctl@ceph.mds.j.smithi082.stdout:Sep 23 08:54:17 smithi082 podman[131396]: 2023-09-23T08:54:17.591 INFO:journalctl@ceph.mds.j.smithi082.stdout:Sep 23 08:54:17 smithi082 ceph-mds[131436]: -- 172.21.15.82:0/2094858912 <== mon.0 v2:172.21.15.82:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x559984f8f1e0 con 0x559984f64800 2023-09-23T08:54:17.591 INFO:journalctl@ceph.mds.j.smithi082.stdout:Sep 23 08:54:17 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mds-j[131412]: starting mds.j at 2023-09-23T08:54:17.592 INFO:journalctl@ceph.mds.j.smithi082.stdout:Sep 23 08:54:17 smithi082 bash[131396]: 272e3bf193788ea1b9665ec0de5108d114da432562481c4216335befb41977c0 2023-09-23T08:54:17.761 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-23T08:54:17.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:17 smithi135 ceph-mon[99205]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:54:17.870 INFO:journalctl@ceph.mds.j.smithi082.stdout:Sep 23 08:54:17 smithi082 systemd[1]: Started Ceph mds.j for 8926e286-59ed-11ee-8db4-212e2dc638e7. 2023-09-23T08:54:17.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:17 smithi161 ceph-mon[99580]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:54:17.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:17.965+0000 7fb6e47ff700 1 -- 172.21.15.82:0/1498024086 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6dc073380 msgr2=0x7fb6dc073800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:17.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:17.965+0000 7fb6e47ff700 1 --2- 172.21.15.82:0/1498024086 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6dc073380 0x7fb6dc073800 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc009990 tx=0x7fb6cc009ca0 comp rx=0 tx=0).stop 2023-09-23T08:54:17.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:17.966+0000 7fb6e47ff700 1 -- 172.21.15.82:0/1498024086 shutdown_connections 2023-09-23T08:54:17.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:17.966+0000 7fb6e47ff700 1 --2- 172.21.15.82:0/1498024086 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb6dc1087f0 0x7fb6dc10ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:17.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:17.966+0000 7fb6e47ff700 1 --2- 172.21.15.82:0/1498024086 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb6dc074960 0x7fb6dc072db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:17.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:17.966+0000 7fb6e47ff700 1 --2- 172.21.15.82:0/1498024086 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6dc073380 0x7fb6dc073800 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:17.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:17.966+0000 7fb6e47ff700 1 -- 172.21.15.82:0/1498024086 >> 172.21.15.82:0/1498024086 conn(0x7fb6dc0fbe60 msgr2=0x7fb6dc0fe2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:54:17.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:17.966+0000 7fb6e47ff700 1 -- 172.21.15.82:0/1498024086 shutdown_connections 2023-09-23T08:54:17.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:17.966+0000 7fb6e47ff700 1 -- 172.21.15.82:0/1498024086 wait complete. 2023-09-23T08:54:17.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:17.967+0000 7fb6e47ff700 1 Processor -- start 2023-09-23T08:54:17.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:17.967+0000 7fb6e47ff700 1 -- start start 2023-09-23T08:54:17.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:17.968+0000 7fb6e47ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6dc073380 0x7fb6dc198750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:17.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:17.968+0000 7fb6e47ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb6dc074960 0x7fb6dc198c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:17.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:17.968+0000 7fb6e47ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb6dc1087f0 0x7fb6dc19fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:17.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:17.968+0000 7fb6e47ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6dc1a02d0 con 0x7fb6dc073380 2023-09-23T08:54:17.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:17.968+0000 7fb6e47ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6dc1a0410 con 0x7fb6dc1087f0 2023-09-23T08:54:17.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:17.968+0000 7fb6e47ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6dc1a05a0 con 0x7fb6dc074960 2023-09-23T08:54:17.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:17.968+0000 7fb6e259b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6dc073380 0x7fb6dc198750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:17.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:17.968+0000 7fb6e259b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6dc073380 0x7fb6dc198750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33474/0 (socket says 172.21.15.82:33474) 2023-09-23T08:54:17.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:17.968+0000 7fb6e259b700 1 -- 172.21.15.82:0/3488196850 learned_addr learned my addr 172.21.15.82:0/3488196850 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:54:17.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:17.968+0000 7fb6e1d9a700 1 --2- 172.21.15.82:0/3488196850 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb6dc074960 0x7fb6dc198c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:17.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:17.968+0000 7fb6e2d9c700 1 --2- 172.21.15.82:0/3488196850 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb6dc1087f0 0x7fb6dc19fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:17.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:17.969+0000 7fb6e259b700 1 -- 172.21.15.82:0/3488196850 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb6dc074960 msgr2=0x7fb6dc198c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:17.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:17.969+0000 7fb6e259b700 1 --2- 172.21.15.82:0/3488196850 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb6dc074960 0x7fb6dc198c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:17.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:17.969+0000 7fb6e259b700 1 -- 172.21.15.82:0/3488196850 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb6dc1087f0 msgr2=0x7fb6dc19fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:17.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:17.969+0000 7fb6e259b700 1 --2- 172.21.15.82:0/3488196850 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb6dc1087f0 0x7fb6dc19fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:17.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:17.969+0000 7fb6e259b700 1 -- 172.21.15.82:0/3488196850 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6cc0095f0 con 0x7fb6dc073380 2023-09-23T08:54:17.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:17.969+0000 7fb6e259b700 1 --2- 172.21.15.82:0/3488196850 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6dc073380 0x7fb6dc198750 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb6d800e9a0 tx=0x7fb6d800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:54:17.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:17.969+0000 7fb6d37fe700 1 -- 172.21.15.82:0/3488196850 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6d8009790 con 0x7fb6dc073380 2023-09-23T08:54:17.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:17.969+0000 7fb6e47ff700 1 -- 172.21.15.82:0/3488196850 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6dc1a0880 con 0x7fb6dc073380 2023-09-23T08:54:17.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:17.969+0000 7fb6d37fe700 1 -- 172.21.15.82:0/3488196850 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb6d800cbd0 con 0x7fb6dc073380 2023-09-23T08:54:17.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:17.969+0000 7fb6d37fe700 1 -- 172.21.15.82:0/3488196850 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6d8018680 con 0x7fb6dc073380 2023-09-23T08:54:17.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:17.969+0000 7fb6e47ff700 1 -- 172.21.15.82:0/3488196850 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6dc1a0d90 con 0x7fb6dc073380 2023-09-23T08:54:17.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:17.970+0000 7fb6e47ff700 1 -- 172.21.15.82:0/3488196850 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6dc106ea0 con 0x7fb6dc073380 2023-09-23T08:54:17.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:17.973+0000 7fb6d37fe700 1 -- 172.21.15.82:0/3488196850 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 134671+0+0 (secure 0 0 0) 0x7fb6d800cd40 con 0x7fb6dc073380 2023-09-23T08:54:17.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:17.974+0000 7fb6d37fe700 1 --2- 172.21.15.82:0/3488196850 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fb6c809ffa0 0x7fb6c80a2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:17.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:17.974+0000 7fb6d37fe700 1 -- 172.21.15.82:0/3488196850 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fb6d8014070 con 0x7fb6dc073380 2023-09-23T08:54:17.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:17.974+0000 7fb6e1d9a700 1 --2- 172.21.15.82:0/3488196850 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fb6c809ffa0 0x7fb6c80a2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:17.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:17.975+0000 7fb6e1d9a700 1 --2- 172.21.15.82:0/3488196850 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fb6c809ffa0 0x7fb6c80a2460 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc0098e0 tx=0x7fb6cc00b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:54:17.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:17.977+0000 7fb6d37fe700 1 -- 172.21.15.82:0/3488196850 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7fb6d8095610 con 0x7fb6dc073380 2023-09-23T08:54:18.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:18.239+0000 7fb6e47ff700 1 -- 172.21.15.82:0/3488196850 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb6dc10e220 con 0x7fb6dc073380 2023-09-23T08:54:18.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:18.239+0000 7fb6d37fe700 1 -- 172.21.15.82:0/3488196850 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2116 (secure 0 0 0) 0x7fb6d8098c30 con 0x7fb6dc073380 2023-09-23T08:54:18.243 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:54:18.243 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/503886037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":503886037},{"type":"v1","addr":"172.21.15.135:6833","nonce":503886037}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24463,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6833/471569125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":471569125},{"type":"v1","addr":"172.21.15.161:6833","nonce":471569125}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-09-23T08:54:18.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:18.243+0000 7fb6e47ff700 1 -- 172.21.15.82:0/3488196850 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fb6c809ffa0 msgr2=0x7fb6c80a2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:18.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:18.243+0000 7fb6e47ff700 1 --2- 172.21.15.82:0/3488196850 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fb6c809ffa0 0x7fb6c80a2460 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc0098e0 tx=0x7fb6cc00b260 comp rx=0 tx=0).stop 2023-09-23T08:54:18.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:18.243+0000 7fb6e47ff700 1 -- 172.21.15.82:0/3488196850 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6dc073380 msgr2=0x7fb6dc198750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:18.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:18.243+0000 7fb6e47ff700 1 --2- 172.21.15.82:0/3488196850 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6dc073380 0x7fb6dc198750 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb6d800e9a0 tx=0x7fb6d800ecb0 comp rx=0 tx=0).stop 2023-09-23T08:54:18.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:18.243+0000 7fb6e47ff700 1 -- 172.21.15.82:0/3488196850 shutdown_connections 2023-09-23T08:54:18.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:18.243+0000 7fb6e47ff700 1 --2- 172.21.15.82:0/3488196850 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fb6c809ffa0 0x7fb6c80a2460 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:18.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:18.243+0000 7fb6e47ff700 1 --2- 172.21.15.82:0/3488196850 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb6dc1087f0 0x7fb6dc19fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:18.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:18.243+0000 7fb6e47ff700 1 --2- 172.21.15.82:0/3488196850 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6dc073380 0x7fb6dc198750 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:18.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:18.243+0000 7fb6e47ff700 1 --2- 172.21.15.82:0/3488196850 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb6dc074960 0x7fb6dc198c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:18.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:18.243+0000 7fb6e47ff700 1 -- 172.21.15.82:0/3488196850 >> 172.21.15.82:0/3488196850 conn(0x7fb6dc0fbe60 msgr2=0x7fb6dc0fe250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:54:18.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:18.243+0000 7fb6e47ff700 1 -- 172.21.15.82:0/3488196850 shutdown_connections 2023-09-23T08:54:18.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:18.243+0000 7fb6e47ff700 1 -- 172.21.15.82:0/3488196850 wait complete. 2023-09-23T08:54:18.249 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 3 2023-09-23T08:54:18.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:18 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:18.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:18 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:18.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:18 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:18.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:18 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-23T08:54:18.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:18 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-23T08:54:18.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:18 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:54:18.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:18 smithi082 ceph-mon[97694]: Deploying daemon mds.d on smithi082 2023-09-23T08:54:18.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:18 smithi082 ceph-mon[97694]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:54:18.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:18 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/3488196850' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T08:54:18.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:18 smithi082 ceph-mon[97694]: mds.? [v2:172.21.15.82:6834/1237857359,v1:172.21.15.82:6835/1237857359] up:boot 2023-09-23T08:54:18.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:18 smithi082 ceph-mon[97694]: fsmap 3 up:standby 2023-09-23T08:54:18.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:18 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-09-23T08:54:19.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:18 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:19.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:18 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:19.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:18 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:19.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:18 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-23T08:54:19.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:18 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-23T08:54:19.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:18 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:54:19.064 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:18 smithi135 ceph-mon[99205]: Deploying daemon mds.d on smithi082 2023-09-23T08:54:19.064 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:18 smithi135 ceph-mon[99205]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:54:19.064 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:18 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/3488196850' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T08:54:19.064 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:18 smithi135 ceph-mon[99205]: mds.? [v2:172.21.15.82:6834/1237857359,v1:172.21.15.82:6835/1237857359] up:boot 2023-09-23T08:54:19.064 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:18 smithi135 ceph-mon[99205]: fsmap 3 up:standby 2023-09-23T08:54:19.065 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:18 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-09-23T08:54:19.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:18 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:19.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:18 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:19.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:18 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:19.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:18 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-23T08:54:19.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:18 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-23T08:54:19.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:18 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:54:19.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:18 smithi161 ceph-mon[99580]: Deploying daemon mds.d on smithi082 2023-09-23T08:54:19.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:18 smithi161 ceph-mon[99580]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:54:19.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:18 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/3488196850' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T08:54:19.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:18 smithi161 ceph-mon[99580]: mds.? [v2:172.21.15.82:6834/1237857359,v1:172.21.15.82:6835/1237857359] up:boot 2023-09-23T08:54:19.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:18 smithi161 ceph-mon[99580]: fsmap 3 up:standby 2023-09-23T08:54:19.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:18 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-09-23T08:54:19.906 INFO:journalctl@ceph.mds.d.smithi082.stdout:Sep 23 08:54:19 smithi082 systemd[1]: Starting Ceph mds.d for 8926e286-59ed-11ee-8db4-212e2dc638e7... 2023-09-23T08:54:20.275 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-23T08:54:20.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:20.481+0000 7f297fbff700 1 -- 172.21.15.82:0/1612225109 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29781024c0 msgr2=0x7f2978108d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:20.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:20.481+0000 7f297fbff700 1 --2- 172.21.15.82:0/1612225109 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29781024c0 0x7f2978108d70 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f297000b0d0 tx=0x7f297000b3e0 comp rx=0 tx=0).stop 2023-09-23T08:54:20.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:20.481+0000 7f297fbff700 1 -- 172.21.15.82:0/1612225109 shutdown_connections 2023-09-23T08:54:20.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:20.481+0000 7f297fbff700 1 --2- 172.21.15.82:0/1612225109 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29781024c0 0x7f2978108d70 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:20.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:20.481+0000 7f297fbff700 1 --2- 172.21.15.82:0/1612225109 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2978100930 0x7f2978100d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:20.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:20.481+0000 7f297fbff700 1 --2- 172.21.15.82:0/1612225109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2978101b20 0x7f2978101f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:20.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:20.481+0000 7f297fbff700 1 -- 172.21.15.82:0/1612225109 >> 172.21.15.82:0/1612225109 conn(0x7f29780fbe60 msgr2=0x7f29780fe2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:54:20.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:20.481+0000 7f297fbff700 1 -- 172.21.15.82:0/1612225109 shutdown_connections 2023-09-23T08:54:20.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:20.481+0000 7f297fbff700 1 -- 172.21.15.82:0/1612225109 wait complete. 2023-09-23T08:54:20.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:20.482+0000 7f297fbff700 1 Processor -- start 2023-09-23T08:54:20.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:20.482+0000 7f297fbff700 1 -- start start 2023-09-23T08:54:20.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:20.482+0000 7f297fbff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2978100930 0x7f29780746d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:20.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:20.482+0000 7f297fbff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2978101b20 0x7f2978072d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:20.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:20.482+0000 7f297fbff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29781024c0 0x7f2978073250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:20.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:20.482+0000 7f297fbff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29780739f0 con 0x7f29781024c0 2023-09-23T08:54:20.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:20.482+0000 7f297fbff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2978073b60 con 0x7f2978101b20 2023-09-23T08:54:20.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:20.482+0000 7f297fbff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29781a0640 con 0x7f2978100930 2023-09-23T08:54:20.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:20.483+0000 7f297e19c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29781024c0 0x7f2978073250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:20.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:20.483+0000 7f297e19c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29781024c0 0x7f2978073250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33490/0 (socket says 172.21.15.82:33490) 2023-09-23T08:54:20.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:20.483+0000 7f297e19c700 1 -- 172.21.15.82:0/292959011 learned_addr learned my addr 172.21.15.82:0/292959011 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:54:20.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:20.483+0000 7f297d99b700 1 --2- 172.21.15.82:0/292959011 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2978100930 0x7f29780746d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:20.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:20.483+0000 7f297d19a700 1 --2- 172.21.15.82:0/292959011 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2978101b20 0x7f2978072d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:20.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:20.483+0000 7f297e19c700 1 -- 172.21.15.82:0/292959011 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2978100930 msgr2=0x7f29780746d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:20.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:20.483+0000 7f297e19c700 1 --2- 172.21.15.82:0/292959011 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2978100930 0x7f29780746d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:20.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:20.483+0000 7f297e19c700 1 -- 172.21.15.82:0/292959011 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2978101b20 msgr2=0x7f2978072d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:20.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:20.483+0000 7f297e19c700 1 --2- 172.21.15.82:0/292959011 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2978101b20 0x7f2978072d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:20.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:20.483+0000 7f297e19c700 1 -- 172.21.15.82:0/292959011 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2970009d00 con 0x7f29781024c0 2023-09-23T08:54:20.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:20.483+0000 7f297d99b700 1 --2- 172.21.15.82:0/292959011 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2978100930 0x7f29780746d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T08:54:20.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:20.483+0000 7f297d19a700 1 --2- 172.21.15.82:0/292959011 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2978101b20 0x7f2978072d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T08:54:20.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:20.483+0000 7f297e19c700 1 --2- 172.21.15.82:0/292959011 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29781024c0 0x7f2978073250 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2970007870 tx=0x7f2970005ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:54:20.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:20.484+0000 7f296effd700 1 -- 172.21.15.82:0/292959011 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f297000e040 con 0x7f29781024c0 2023-09-23T08:54:20.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:20.484+0000 7f296effd700 1 -- 172.21.15.82:0/292959011 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f297000be60 con 0x7f29781024c0 2023-09-23T08:54:20.490 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:20.484+0000 7f296effd700 1 -- 172.21.15.82:0/292959011 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f297001b6c0 con 0x7f29781024c0 2023-09-23T08:54:20.490 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:20.484+0000 7f297fbff700 1 -- 172.21.15.82:0/292959011 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29781a08c0 con 0x7f29781024c0 2023-09-23T08:54:20.490 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:20.484+0000 7f297fbff700 1 -- 172.21.15.82:0/292959011 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29781a0c90 con 0x7f29781024c0 2023-09-23T08:54:20.490 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:20.485+0000 7f297fbff700 1 -- 172.21.15.82:0/292959011 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f297810bfb0 con 0x7f29781024c0 2023-09-23T08:54:20.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:20.488+0000 7f296effd700 1 -- 172.21.15.82:0/292959011 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 134671+0+0 (secure 0 0 0) 0x7f2970005090 con 0x7f29781024c0 2023-09-23T08:54:20.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:20.490+0000 7f296effd700 1 --2- 172.21.15.82:0/292959011 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f29640a0020 0x7f29640a24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:20.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:20.490+0000 7f296effd700 1 -- 172.21.15.82:0/292959011 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f29700cc710 con 0x7f29781024c0 2023-09-23T08:54:20.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:20.490+0000 7f297d99b700 1 --2- 172.21.15.82:0/292959011 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f29640a0020 0x7f29640a24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:20.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:20.491+0000 7f297d99b700 1 --2- 172.21.15.82:0/292959011 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f29640a0020 0x7f29640a24e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2978101980 tx=0x7f2974009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:54:20.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:20.492+0000 7f296effd700 1 -- 172.21.15.82:0/292959011 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f2970096930 con 0x7f29781024c0 2023-09-23T08:54:20.620 INFO:journalctl@ceph.mds.d.smithi082.stdout:Sep 23 08:54:20 smithi082 podman[131786]: 2023-09-23T08:54:20.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:20.751+0000 7f297fbff700 1 -- 172.21.15.82:0/292959011 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2978107830 con 0x7f29781024c0 2023-09-23T08:54:20.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:20.752+0000 7f296effd700 1 -- 172.21.15.82:0/292959011 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) v1 ==== 93+0+2907 (secure 0 0 0) 0x7f2970099f50 con 0x7f29781024c0 2023-09-23T08:54:20.755 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:54:20.756 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/1237857359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1237857359},{"type":"v1","addr":"172.21.15.82:6835","nonce":1237857359}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/503886037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":503886037},{"type":"v1","addr":"172.21.15.135:6833","nonce":503886037}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24463,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6833/471569125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":471569125},{"type":"v1","addr":"172.21.15.161:6833","nonce":471569125}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-09-23T08:54:20.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:20.754+0000 7f297fbff700 1 -- 172.21.15.82:0/292959011 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f29640a0020 msgr2=0x7f29640a24e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:20.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:20.754+0000 7f297fbff700 1 --2- 172.21.15.82:0/292959011 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f29640a0020 0x7f29640a24e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2978101980 tx=0x7f2974009260 comp rx=0 tx=0).stop 2023-09-23T08:54:20.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:20.754+0000 7f297fbff700 1 -- 172.21.15.82:0/292959011 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29781024c0 msgr2=0x7f2978073250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:20.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:20.754+0000 7f297fbff700 1 --2- 172.21.15.82:0/292959011 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29781024c0 0x7f2978073250 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2970007870 tx=0x7f2970005ad0 comp rx=0 tx=0).stop 2023-09-23T08:54:20.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:20.754+0000 7f297fbff700 1 -- 172.21.15.82:0/292959011 shutdown_connections 2023-09-23T08:54:20.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:20.754+0000 7f297fbff700 1 --2- 172.21.15.82:0/292959011 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f29640a0020 0x7f29640a24e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:20.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:20.754+0000 7f297fbff700 1 --2- 172.21.15.82:0/292959011 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29781024c0 0x7f2978073250 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:20.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:20.754+0000 7f297fbff700 1 --2- 172.21.15.82:0/292959011 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2978100930 0x7f29780746d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:20.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:20.754+0000 7f297fbff700 1 --2- 172.21.15.82:0/292959011 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2978101b20 0x7f2978072d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:20.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:20.754+0000 7f297fbff700 1 -- 172.21.15.82:0/292959011 >> 172.21.15.82:0/292959011 conn(0x7f29780fbe60 msgr2=0x7f29780fe120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:54:20.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:20.754+0000 7f297fbff700 1 -- 172.21.15.82:0/292959011 shutdown_connections 2023-09-23T08:54:20.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:20.754+0000 7f297fbff700 1 -- 172.21.15.82:0/292959011 wait complete. 2023-09-23T08:54:20.759 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 4 2023-09-23T08:54:21.104 INFO:journalctl@ceph.mds.d.smithi082.stdout:Sep 23 08:54:20 smithi082 bash[131786]: 2684fe8c931af6fa8a9029b917f6f53e6d7938a8b42aaee861f46e97f9b278db 2023-09-23T08:54:21.104 INFO:journalctl@ceph.mds.d.smithi082.stdout:Sep 23 08:54:20 smithi082 ceph-mds[131869]: -- 172.21.15.82:0/45196719 <== mon.0 v2:172.21.15.82:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55cc05e671e0 con 0x55cc05e3c800 2023-09-23T08:54:21.104 INFO:journalctl@ceph.mds.d.smithi082.stdout:Sep 23 08:54:20 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mds-d[131845]: starting mds.d at 2023-09-23T08:54:21.104 INFO:journalctl@ceph.mds.d.smithi082.stdout:Sep 23 08:54:20 smithi082 systemd[1]: Started Ceph mds.d for 8926e286-59ed-11ee-8db4-212e2dc638e7. 2023-09-23T08:54:21.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:21 smithi082 ceph-mon[97694]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:54:21.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:21 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/292959011' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T08:54:21.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:21 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:21.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:21 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:21.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:21 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:21.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:21 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-23T08:54:21.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:21 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-23T08:54:21.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:21 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:54:21.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:21 smithi161 ceph-mon[99580]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:54:21.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:21 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/292959011' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T08:54:21.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:21 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:21.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:21 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:21.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:21 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:21.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:21 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-23T08:54:21.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:21 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-23T08:54:21.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:21 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:54:21.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:21 smithi135 ceph-mon[99205]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:54:21.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:21 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/292959011' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T08:54:21.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:21 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:21.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:21 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:21.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:21 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:21.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:21 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-23T08:54:21.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:21 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-23T08:54:21.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:21 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:54:22.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:22 smithi135 ceph-mon[99205]: Deploying daemon mds.e on smithi135 2023-09-23T08:54:22.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:22 smithi135 ceph-mon[99205]: mds.? [v2:172.21.15.82:6836/1335102362,v1:172.21.15.82:6837/1335102362] up:boot 2023-09-23T08:54:22.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:22 smithi135 ceph-mon[99205]: fsmap 4 up:standby 2023-09-23T08:54:22.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:22 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-09-23T08:54:22.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:22 smithi082 ceph-mon[97694]: Deploying daemon mds.e on smithi135 2023-09-23T08:54:22.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:22 smithi082 ceph-mon[97694]: mds.? [v2:172.21.15.82:6836/1335102362,v1:172.21.15.82:6837/1335102362] up:boot 2023-09-23T08:54:22.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:22 smithi082 ceph-mon[97694]: fsmap 4 up:standby 2023-09-23T08:54:22.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:22 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-09-23T08:54:22.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:22 smithi161 ceph-mon[99580]: Deploying daemon mds.e on smithi135 2023-09-23T08:54:22.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:22 smithi161 ceph-mon[99580]: mds.? [v2:172.21.15.82:6836/1335102362,v1:172.21.15.82:6837/1335102362] up:boot 2023-09-23T08:54:22.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:22 smithi161 ceph-mon[99580]: fsmap 4 up:standby 2023-09-23T08:54:22.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:22 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-09-23T08:54:22.779 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-23T08:54:22.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:22.986+0000 7ff339dff700 1 -- 172.21.15.82:0/2475220714 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff334101b20 msgr2=0x7ff334101f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:22.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:22.986+0000 7ff339dff700 1 --2- 172.21.15.82:0/2475220714 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff334101b20 0x7ff334101f80 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff3280099c0 tx=0x7ff328009cd0 comp rx=0 tx=0).stop 2023-09-23T08:54:22.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:22.986+0000 7ff339dff700 1 -- 172.21.15.82:0/2475220714 shutdown_connections 2023-09-23T08:54:22.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:22.986+0000 7ff339dff700 1 --2- 172.21.15.82:0/2475220714 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3341024c0 0x7ff334108d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:22.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:22.986+0000 7ff339dff700 1 --2- 172.21.15.82:0/2475220714 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff334100930 0x7ff334100d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:22.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:22.986+0000 7ff339dff700 1 --2- 172.21.15.82:0/2475220714 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff334101b20 0x7ff334101f80 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:22.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:22.986+0000 7ff339dff700 1 -- 172.21.15.82:0/2475220714 >> 172.21.15.82:0/2475220714 conn(0x7ff3340fbe60 msgr2=0x7ff3340fe2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:54:22.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:22.986+0000 7ff339dff700 1 -- 172.21.15.82:0/2475220714 shutdown_connections 2023-09-23T08:54:22.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:22.986+0000 7ff339dff700 1 -- 172.21.15.82:0/2475220714 wait complete. 2023-09-23T08:54:22.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:22.987+0000 7ff339dff700 1 Processor -- start 2023-09-23T08:54:22.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:22.987+0000 7ff339dff700 1 -- start start 2023-09-23T08:54:22.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:22.987+0000 7ff339dff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff334100930 0x7ff3341986d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:22.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:22.987+0000 7ff339dff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff334101b20 0x7ff334198c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:22.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:22.987+0000 7ff339dff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3341024c0 0x7ff33419fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:22.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:22.987+0000 7ff339dff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3341a0250 con 0x7ff334101b20 2023-09-23T08:54:22.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:22.987+0000 7ff339dff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3341a0390 con 0x7ff3341024c0 2023-09-23T08:54:22.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:22.987+0000 7ff339dff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3341a0520 con 0x7ff334100930 2023-09-23T08:54:22.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:22.987+0000 7ff332ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff334101b20 0x7ff334198c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:22.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:22.987+0000 7ff332ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff334101b20 0x7ff334198c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45174/0 (socket says 172.21.15.82:45174) 2023-09-23T08:54:22.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:22.987+0000 7ff332ffd700 1 -- 172.21.15.82:0/2230218303 learned_addr learned my addr 172.21.15.82:0/2230218303 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:54:22.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:22.988+0000 7ff333fff700 1 --2- 172.21.15.82:0/2230218303 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3341024c0 0x7ff33419fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:22.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:22.988+0000 7ff332ffd700 1 -- 172.21.15.82:0/2230218303 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff334100930 msgr2=0x7ff3341986d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:22.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:22.988+0000 7ff332ffd700 1 --2- 172.21.15.82:0/2230218303 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff334100930 0x7ff3341986d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:22.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:22.988+0000 7ff332ffd700 1 -- 172.21.15.82:0/2230218303 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3341024c0 msgr2=0x7ff33419fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:22.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:22.988+0000 7ff332ffd700 1 --2- 172.21.15.82:0/2230218303 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3341024c0 0x7ff33419fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:22.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:22.988+0000 7ff332ffd700 1 -- 172.21.15.82:0/2230218303 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3280095f0 con 0x7ff334101b20 2023-09-23T08:54:22.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:22.988+0000 7ff332ffd700 1 --2- 172.21.15.82:0/2230218303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff334101b20 0x7ff334198c10 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff328009fd0 tx=0x7ff32800fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:54:22.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:22.988+0000 7ff330ff9700 1 -- 172.21.15.82:0/2230218303 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff32801d070 con 0x7ff334101b20 2023-09-23T08:54:22.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:22.988+0000 7ff339dff700 1 -- 172.21.15.82:0/2230218303 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3341a07a0 con 0x7ff334101b20 2023-09-23T08:54:22.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:22.988+0000 7ff330ff9700 1 -- 172.21.15.82:0/2230218303 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff3280059a0 con 0x7ff334101b20 2023-09-23T08:54:22.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:22.988+0000 7ff330ff9700 1 -- 172.21.15.82:0/2230218303 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3280173f0 con 0x7ff334101b20 2023-09-23T08:54:22.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:22.989+0000 7ff339dff700 1 -- 172.21.15.82:0/2230218303 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3341a0c50 con 0x7ff334101b20 2023-09-23T08:54:22.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:22.990+0000 7ff339dff700 1 -- 172.21.15.82:0/2230218303 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff33410bff0 con 0x7ff334101b20 2023-09-23T08:54:22.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:22.991+0000 7ff330ff9700 1 -- 172.21.15.82:0/2230218303 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 134671+0+0 (secure 0 0 0) 0x7ff328022470 con 0x7ff334101b20 2023-09-23T08:54:22.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:22.993+0000 7ff330ff9700 1 --2- 172.21.15.82:0/2230218303 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7ff31c09ffa0 0x7ff31c0a2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:22.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:22.993+0000 7ff330ff9700 1 -- 172.21.15.82:0/2230218303 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7ff3280cc220 con 0x7ff334101b20 2023-09-23T08:54:22.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:22.993+0000 7ff3337fe700 1 --2- 172.21.15.82:0/2230218303 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7ff31c09ffa0 0x7ff31c0a2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:22.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:22.994+0000 7ff3337fe700 1 --2- 172.21.15.82:0/2230218303 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7ff31c09ffa0 0x7ff31c0a2460 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff334101980 tx=0x7ff324009470 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:54:23.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:22.997+0000 7ff330ff9700 1 -- 172.21.15.82:0/2230218303 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7ff328096560 con 0x7ff334101b20 2023-09-23T08:54:23.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:23.240+0000 7ff339dff700 1 -- 172.21.15.82:0/2230218303 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff33410c1e0 con 0x7ff334101b20 2023-09-23T08:54:23.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:23.240+0000 7ff330ff9700 1 -- 172.21.15.82:0/2230218303 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+3698 (secure 0 0 0) 0x7ff328099b80 con 0x7ff334101b20 2023-09-23T08:54:23.243 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:54:23.243 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":5,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/1237857359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1237857359},{"type":"v1","addr":"172.21.15.82:6835","nonce":1237857359}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/1335102362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":1335102362},{"type":"v1","addr":"172.21.15.82:6837","nonce":1335102362}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/503886037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":503886037},{"type":"v1","addr":"172.21.15.135:6833","nonce":503886037}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24463,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6833/471569125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":471569125},{"type":"v1","addr":"172.21.15.161:6833","nonce":471569125}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-09-23T08:54:23.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:23.243+0000 7ff339dff700 1 -- 172.21.15.82:0/2230218303 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7ff31c09ffa0 msgr2=0x7ff31c0a2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:23.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:23.243+0000 7ff339dff700 1 --2- 172.21.15.82:0/2230218303 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7ff31c09ffa0 0x7ff31c0a2460 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff334101980 tx=0x7ff324009470 comp rx=0 tx=0).stop 2023-09-23T08:54:23.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:23.243+0000 7ff339dff700 1 -- 172.21.15.82:0/2230218303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff334101b20 msgr2=0x7ff334198c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:23.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:23.243+0000 7ff339dff700 1 --2- 172.21.15.82:0/2230218303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff334101b20 0x7ff334198c10 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff328009fd0 tx=0x7ff32800fa00 comp rx=0 tx=0).stop 2023-09-23T08:54:23.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:23.243+0000 7ff339dff700 1 -- 172.21.15.82:0/2230218303 shutdown_connections 2023-09-23T08:54:23.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:23.243+0000 7ff339dff700 1 --2- 172.21.15.82:0/2230218303 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7ff31c09ffa0 0x7ff31c0a2460 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:23.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:23.243+0000 7ff339dff700 1 --2- 172.21.15.82:0/2230218303 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3341024c0 0x7ff33419fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:23.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:23.243+0000 7ff339dff700 1 --2- 172.21.15.82:0/2230218303 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff334100930 0x7ff3341986d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:23.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:23.243+0000 7ff339dff700 1 --2- 172.21.15.82:0/2230218303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff334101b20 0x7ff334198c10 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:23.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:23.243+0000 7ff339dff700 1 -- 172.21.15.82:0/2230218303 >> 172.21.15.82:0/2230218303 conn(0x7ff3340fbe60 msgr2=0x7ff3340fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:54:23.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:23.243+0000 7ff339dff700 1 -- 172.21.15.82:0/2230218303 shutdown_connections 2023-09-23T08:54:23.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:23.243+0000 7ff339dff700 1 -- 172.21.15.82:0/2230218303 wait complete. 2023-09-23T08:54:23.247 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 5 2023-09-23T08:54:23.402 INFO:journalctl@ceph.mds.e.smithi135.stdout:Sep 23 08:54:23 smithi135 systemd[1]: Starting Ceph mds.e for 8926e286-59ed-11ee-8db4-212e2dc638e7... 2023-09-23T08:54:23.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:23 smithi082 ceph-mon[97694]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:54:23.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:23 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/2230218303' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T08:54:23.719 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:23 smithi135 ceph-mon[99205]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:54:23.720 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:23 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/2230218303' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T08:54:23.720 INFO:journalctl@ceph.mds.e.smithi135.stdout:Sep 23 08:54:23 smithi135 podman[123985]: 2023-09-23T08:54:23.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:23 smithi161 ceph-mon[99580]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:54:23.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:23 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/2230218303' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T08:54:24.062 INFO:journalctl@ceph.mds.e.smithi135.stdout:Sep 23 08:54:23 smithi135 bash[123985]: f4482dd3e3d96dd657f4f74c3de38ef70fb38d35360aa836f17b13ff30f2c5c4 2023-09-23T08:54:24.062 INFO:journalctl@ceph.mds.e.smithi135.stdout:Sep 23 08:54:23 smithi135 ceph-mds[124026]: -- 172.21.15.135:0/1215653453 <== mon.2 v2:172.21.15.135:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x559a575371e0 con 0x559a5750d000 2023-09-23T08:54:24.063 INFO:journalctl@ceph.mds.e.smithi135.stdout:Sep 23 08:54:23 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mds-e[124002]: starting mds.e at 2023-09-23T08:54:24.063 INFO:journalctl@ceph.mds.e.smithi135.stdout:Sep 23 08:54:23 smithi135 systemd[1]: Started Ceph mds.e for 8926e286-59ed-11ee-8db4-212e2dc638e7. 2023-09-23T08:54:25.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:24 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:25.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:24 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:25.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:24 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:25.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:24 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-23T08:54:25.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:24 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-23T08:54:25.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:24 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:54:25.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:24 smithi161 ceph-mon[99580]: Deploying daemon mds.f on smithi161 2023-09-23T08:54:25.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:24 smithi161 ceph-mon[99580]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:54:25.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:24 smithi161 ceph-mon[99580]: mds.? [v2:172.21.15.135:6834/3645331700,v1:172.21.15.135:6835/3645331700] up:boot 2023-09-23T08:54:25.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:24 smithi161 ceph-mon[99580]: fsmap 5 up:standby 2023-09-23T08:54:25.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:24 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-09-23T08:54:25.265 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-23T08:54:25.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:24 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:25.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:24 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:25.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:24 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:25.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:24 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-23T08:54:25.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:24 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-23T08:54:25.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:24 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:54:25.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:24 smithi135 ceph-mon[99205]: Deploying daemon mds.f on smithi161 2023-09-23T08:54:25.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:24 smithi135 ceph-mon[99205]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:54:25.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:24 smithi135 ceph-mon[99205]: mds.? [v2:172.21.15.135:6834/3645331700,v1:172.21.15.135:6835/3645331700] up:boot 2023-09-23T08:54:25.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:24 smithi135 ceph-mon[99205]: fsmap 5 up:standby 2023-09-23T08:54:25.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:24 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-09-23T08:54:25.332 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:24 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:25.332 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:24 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:25.332 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:24 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:25.332 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:24 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-23T08:54:25.332 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:24 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-23T08:54:25.332 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:24 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:54:25.333 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:24 smithi082 ceph-mon[97694]: Deploying daemon mds.f on smithi161 2023-09-23T08:54:25.333 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:24 smithi082 ceph-mon[97694]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:54:25.333 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:24 smithi082 ceph-mon[97694]: mds.? [v2:172.21.15.135:6834/3645331700,v1:172.21.15.135:6835/3645331700] up:boot 2023-09-23T08:54:25.333 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:24 smithi082 ceph-mon[97694]: fsmap 5 up:standby 2023-09-23T08:54:25.333 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:24 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-09-23T08:54:25.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:25.470+0000 7f83f69ff700 1 -- 172.21.15.82:0/3266043977 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83f01024d0 msgr2=0x7f83f0108d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:25.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:25.470+0000 7f83f69ff700 1 --2- 172.21.15.82:0/3266043977 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83f01024d0 0x7f83f0108d80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f83e800b0d0 tx=0x7f83e800b3e0 comp rx=0 tx=0).stop 2023-09-23T08:54:25.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:25.471+0000 7f83f69ff700 1 -- 172.21.15.82:0/3266043977 shutdown_connections 2023-09-23T08:54:25.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:25.471+0000 7f83f69ff700 1 --2- 172.21.15.82:0/3266043977 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83f01024d0 0x7f83f0108d80 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:25.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:25.471+0000 7f83f69ff700 1 --2- 172.21.15.82:0/3266043977 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83f0100940 0x7f83f0100d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:25.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:25.471+0000 7f83f69ff700 1 --2- 172.21.15.82:0/3266043977 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83f0101b30 0x7f83f0101f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:25.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:25.471+0000 7f83f69ff700 1 -- 172.21.15.82:0/3266043977 >> 172.21.15.82:0/3266043977 conn(0x7f83f00fbe90 msgr2=0x7f83f00fe2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:54:25.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:25.471+0000 7f83f69ff700 1 -- 172.21.15.82:0/3266043977 shutdown_connections 2023-09-23T08:54:25.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:25.471+0000 7f83f69ff700 1 -- 172.21.15.82:0/3266043977 wait complete. 2023-09-23T08:54:25.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:25.472+0000 7f83f69ff700 1 Processor -- start 2023-09-23T08:54:25.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:25.472+0000 7f83f69ff700 1 -- start start 2023-09-23T08:54:25.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:25.472+0000 7f83f69ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83f0100940 0x7f83f0196550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:25.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:25.472+0000 7f83f69ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83f0101b30 0x7f83f0196a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:25.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:25.472+0000 7f83f69ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83f01024d0 0x7f83f019db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:25.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:25.472+0000 7f83f69ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83f019e0d0 con 0x7f83f0100940 2023-09-23T08:54:25.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:25.472+0000 7f83f69ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83f019e210 con 0x7f83f0101b30 2023-09-23T08:54:25.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:25.472+0000 7f83f69ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83f019e3a0 con 0x7f83f01024d0 2023-09-23T08:54:25.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:25.472+0000 7f83effff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83f0100940 0x7f83f0196550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:25.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:25.472+0000 7f83effff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83f0100940 0x7f83f0196550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45190/0 (socket says 172.21.15.82:45190) 2023-09-23T08:54:25.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:25.472+0000 7f83effff700 1 -- 172.21.15.82:0/3220661763 learned_addr learned my addr 172.21.15.82:0/3220661763 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:54:25.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:25.473+0000 7f83f4f9c700 1 --2- 172.21.15.82:0/3220661763 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83f01024d0 0x7f83f019db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:25.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:25.473+0000 7f83ef7fe700 1 --2- 172.21.15.82:0/3220661763 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83f0101b30 0x7f83f0196a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:25.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:25.473+0000 7f83effff700 1 -- 172.21.15.82:0/3220661763 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83f01024d0 msgr2=0x7f83f019db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:25.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:25.473+0000 7f83effff700 1 --2- 172.21.15.82:0/3220661763 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83f01024d0 0x7f83f019db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:25.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:25.473+0000 7f83effff700 1 -- 172.21.15.82:0/3220661763 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83f0101b30 msgr2=0x7f83f0196a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:25.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:25.473+0000 7f83effff700 1 --2- 172.21.15.82:0/3220661763 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83f0101b30 0x7f83f0196a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:25.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:25.473+0000 7f83effff700 1 -- 172.21.15.82:0/3220661763 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83e8009d00 con 0x7f83f0100940 2023-09-23T08:54:25.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:25.473+0000 7f83f4f9c700 1 --2- 172.21.15.82:0/3220661763 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83f01024d0 0x7f83f019db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T08:54:25.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:25.473+0000 7f83effff700 1 --2- 172.21.15.82:0/3220661763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83f0100940 0x7f83f0196550 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f83e000d980 tx=0x7f83e000dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:54:25.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:25.473+0000 7f83ed7fa700 1 -- 172.21.15.82:0/3220661763 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e000de60 con 0x7f83f0100940 2023-09-23T08:54:25.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:25.473+0000 7f83ed7fa700 1 -- 172.21.15.82:0/3220661763 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f83e00044b0 con 0x7f83f0100940 2023-09-23T08:54:25.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:25.473+0000 7f83f69ff700 1 -- 172.21.15.82:0/3220661763 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83f019e680 con 0x7f83f0100940 2023-09-23T08:54:25.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:25.473+0000 7f83ed7fa700 1 -- 172.21.15.82:0/3220661763 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e0003b40 con 0x7f83f0100940 2023-09-23T08:54:25.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:25.473+0000 7f83f69ff700 1 -- 172.21.15.82:0/3220661763 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83f019ebe0 con 0x7f83f0100940 2023-09-23T08:54:25.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:25.474+0000 7f83f69ff700 1 -- 172.21.15.82:0/3220661763 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83f010c010 con 0x7f83f0100940 2023-09-23T08:54:25.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:25.476+0000 7f83ed7fa700 1 -- 172.21.15.82:0/3220661763 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 134671+0+0 (secure 0 0 0) 0x7f83e0004870 con 0x7f83f0100940 2023-09-23T08:54:25.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:25.477+0000 7f83ed7fa700 1 --2- 172.21.15.82:0/3220661763 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f83d80a0020 0x7f83d80a24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:25.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:25.477+0000 7f83ed7fa700 1 -- 172.21.15.82:0/3220661763 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f83e00cae30 con 0x7f83f0100940 2023-09-23T08:54:25.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:25.478+0000 7f83ef7fe700 1 --2- 172.21.15.82:0/3220661763 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f83d80a0020 0x7f83d80a24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:25.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:25.478+0000 7f83ef7fe700 1 --2- 172.21.15.82:0/3220661763 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f83d80a0020 0x7f83d80a24e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f83e4005ea0 tx=0x7f83e4005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:54:25.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:25.479+0000 7f83ed7fa700 1 -- 172.21.15.82:0/3220661763 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f83e0095040 con 0x7f83f0100940 2023-09-23T08:54:25.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:25.723+0000 7f83f69ff700 1 -- 172.21.15.82:0/3220661763 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f83f0107750 con 0x7f83f0100940 2023-09-23T08:54:25.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:25.724+0000 7f83ed7fa700 1 -- 172.21.15.82:0/3220661763 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4492 (secure 0 0 0) 0x7f83e0098660 con 0x7f83f0100940 2023-09-23T08:54:25.726 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:54:25.727 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":6,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/1237857359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1237857359},{"type":"v1","addr":"172.21.15.82:6835","nonce":1237857359}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/1335102362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":1335102362},{"type":"v1","addr":"172.21.15.82:6837","nonce":1335102362}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14598,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/3645331700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3645331700},{"type":"v1","addr":"172.21.15.135:6835","nonce":3645331700}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/503886037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":503886037},{"type":"v1","addr":"172.21.15.135:6833","nonce":503886037}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24463,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6833/471569125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":471569125},{"type":"v1","addr":"172.21.15.161:6833","nonce":471569125}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-09-23T08:54:25.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:25.726+0000 7f83f69ff700 1 -- 172.21.15.82:0/3220661763 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f83d80a0020 msgr2=0x7f83d80a24e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:25.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:25.726+0000 7f83f69ff700 1 --2- 172.21.15.82:0/3220661763 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f83d80a0020 0x7f83d80a24e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f83e4005ea0 tx=0x7f83e4005e30 comp rx=0 tx=0).stop 2023-09-23T08:54:25.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:25.726+0000 7f83f69ff700 1 -- 172.21.15.82:0/3220661763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83f0100940 msgr2=0x7f83f0196550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:25.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:25.726+0000 7f83f69ff700 1 --2- 172.21.15.82:0/3220661763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83f0100940 0x7f83f0196550 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f83e000d980 tx=0x7f83e000dd40 comp rx=0 tx=0).stop 2023-09-23T08:54:25.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:25.727+0000 7f83f69ff700 1 -- 172.21.15.82:0/3220661763 shutdown_connections 2023-09-23T08:54:25.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:25.727+0000 7f83f69ff700 1 --2- 172.21.15.82:0/3220661763 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f83d80a0020 0x7f83d80a24e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:25.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:25.727+0000 7f83f69ff700 1 --2- 172.21.15.82:0/3220661763 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83f01024d0 0x7f83f019db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:25.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:25.727+0000 7f83f69ff700 1 --2- 172.21.15.82:0/3220661763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83f0100940 0x7f83f0196550 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:25.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:25.727+0000 7f83f69ff700 1 --2- 172.21.15.82:0/3220661763 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83f0101b30 0x7f83f0196a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:25.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:25.727+0000 7f83f69ff700 1 -- 172.21.15.82:0/3220661763 >> 172.21.15.82:0/3220661763 conn(0x7f83f00fbe90 msgr2=0x7f83f00fe020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:54:25.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:25.727+0000 7f83f69ff700 1 -- 172.21.15.82:0/3220661763 shutdown_connections 2023-09-23T08:54:25.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:25.727+0000 7f83f69ff700 1 -- 172.21.15.82:0/3220661763 wait complete. 2023-09-23T08:54:25.731 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 6 2023-09-23T08:54:26.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:25 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/3220661763' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T08:54:26.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:25 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/3220661763' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T08:54:26.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:25 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/3220661763' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T08:54:26.399 INFO:journalctl@ceph.mds.f.smithi161.stdout:Sep 23 08:54:26 smithi161 systemd[1]: Starting Ceph mds.f for 8926e286-59ed-11ee-8db4-212e2dc638e7... 2023-09-23T08:54:26.899 INFO:journalctl@ceph.mds.f.smithi161.stdout:Sep 23 08:54:26 smithi161 podman[125214]: 2023-09-23T08:54:27.398 INFO:journalctl@ceph.mds.f.smithi161.stdout:Sep 23 08:54:26 smithi161 bash[125214]: 34b6d82d1f2e9306db64ea675a44baaf399461b1ed87c177ea79163fa825b404 2023-09-23T08:54:27.398 INFO:journalctl@ceph.mds.f.smithi161.stdout:Sep 23 08:54:26 smithi161 ceph-mds[125254]: -- 172.21.15.161:0/3393246428 <== mon.1 v2:172.21.15.161:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55bf03dff1e0 con 0x55bf03dd5000 2023-09-23T08:54:27.399 INFO:journalctl@ceph.mds.f.smithi161.stdout:Sep 23 08:54:26 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mds-f[125230]: starting mds.f at 2023-09-23T08:54:27.399 INFO:journalctl@ceph.mds.f.smithi161.stdout:Sep 23 08:54:26 smithi161 systemd[1]: Started Ceph mds.f for 8926e286-59ed-11ee-8db4-212e2dc638e7. 2023-09-23T08:54:27.749 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-23T08:54:27.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:27 smithi135 ceph-mon[99205]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:54:27.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:27 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:27.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:27 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:27.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:27 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:27.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:27 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-23T08:54:27.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:27 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-23T08:54:27.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:27 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:54:27.816 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:27 smithi082 ceph-mon[97694]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:54:27.816 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:27 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:27.816 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:27 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:27.816 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:27 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:27.816 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:27 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-23T08:54:27.816 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:27 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-23T08:54:27.816 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:27 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:54:27.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:27 smithi161 ceph-mon[99580]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:54:27.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:27 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:27.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:27 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:27.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:27 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:27.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:27 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-23T08:54:27.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:27 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-23T08:54:27.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:27 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:54:27.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:27.954+0000 7f11575ff700 1 -- 172.21.15.82:0/1986570917 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1150101b20 msgr2=0x7f1150101f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:27.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:27.954+0000 7f11575ff700 1 --2- 172.21.15.82:0/1986570917 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1150101b20 0x7f1150101f80 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f11400099c0 tx=0x7f1140009cd0 comp rx=0 tx=0).stop 2023-09-23T08:54:27.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:27.954+0000 7f11575ff700 1 -- 172.21.15.82:0/1986570917 shutdown_connections 2023-09-23T08:54:27.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:27.954+0000 7f11575ff700 1 --2- 172.21.15.82:0/1986570917 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11501024c0 0x7f1150108d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:27.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:27.954+0000 7f11575ff700 1 --2- 172.21.15.82:0/1986570917 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1150100930 0x7f1150100d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:27.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:27.954+0000 7f11575ff700 1 --2- 172.21.15.82:0/1986570917 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1150101b20 0x7f1150101f80 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:27.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:27.954+0000 7f11575ff700 1 -- 172.21.15.82:0/1986570917 >> 172.21.15.82:0/1986570917 conn(0x7f11500fbe60 msgr2=0x7f11500fe2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:54:27.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:27.954+0000 7f11575ff700 1 -- 172.21.15.82:0/1986570917 shutdown_connections 2023-09-23T08:54:27.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:27.954+0000 7f11575ff700 1 -- 172.21.15.82:0/1986570917 wait complete. 2023-09-23T08:54:27.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:27.955+0000 7f11575ff700 1 Processor -- start 2023-09-23T08:54:27.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:27.955+0000 7f11575ff700 1 -- start start 2023-09-23T08:54:27.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:27.955+0000 7f11575ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1150100930 0x7f11500746d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:27.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:27.955+0000 7f11575ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1150101b20 0x7f1150072d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:27.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:27.955+0000 7f11575ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11501024c0 0x7f1150073250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:27.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:27.955+0000 7f11575ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11500739f0 con 0x7f1150100930 2023-09-23T08:54:27.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:27.955+0000 7f11575ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1150073b60 con 0x7f11501024c0 2023-09-23T08:54:27.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:27.955+0000 7f11575ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11501a0610 con 0x7f1150101b20 2023-09-23T08:54:27.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:27.956+0000 7f115539b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1150100930 0x7f11500746d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:27.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:27.956+0000 7f115539b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1150100930 0x7f11500746d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45196/0 (socket says 172.21.15.82:45196) 2023-09-23T08:54:27.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:27.956+0000 7f115539b700 1 -- 172.21.15.82:0/578608714 learned_addr learned my addr 172.21.15.82:0/578608714 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:54:27.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:27.956+0000 7f1154b9a700 1 --2- 172.21.15.82:0/578608714 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1150101b20 0x7f1150072d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:27.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:27.956+0000 7f115539b700 1 -- 172.21.15.82:0/578608714 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1150101b20 msgr2=0x7f1150072d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:27.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:27.956+0000 7f115539b700 1 --2- 172.21.15.82:0/578608714 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1150101b20 0x7f1150072d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:27.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:27.956+0000 7f115539b700 1 -- 172.21.15.82:0/578608714 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11501024c0 msgr2=0x7f1150073250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:27.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:27.956+0000 7f115539b700 1 --2- 172.21.15.82:0/578608714 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11501024c0 0x7f1150073250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:27.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:27.956+0000 7f115539b700 1 -- 172.21.15.82:0/578608714 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11400095f0 con 0x7f1150100930 2023-09-23T08:54:27.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:27.956+0000 7f115539b700 1 --2- 172.21.15.82:0/578608714 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1150100930 0x7f11500746d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f114c00e970 tx=0x7f114c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:54:27.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:27.957+0000 7f11467fc700 1 -- 172.21.15.82:0/578608714 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f114c009790 con 0x7f1150100930 2023-09-23T08:54:27.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:27.957+0000 7f11467fc700 1 -- 172.21.15.82:0/578608714 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f114c00eec0 con 0x7f1150100930 2023-09-23T08:54:27.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:27.957+0000 7f11575ff700 1 -- 172.21.15.82:0/578608714 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11501a08f0 con 0x7f1150100930 2023-09-23T08:54:27.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:27.957+0000 7f11467fc700 1 -- 172.21.15.82:0/578608714 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f114c003c10 con 0x7f1150100930 2023-09-23T08:54:27.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:27.957+0000 7f11575ff700 1 -- 172.21.15.82:0/578608714 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11501a0e50 con 0x7f1150100930 2023-09-23T08:54:27.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:27.958+0000 7f11575ff700 1 -- 172.21.15.82:0/578608714 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1150107fc0 con 0x7f1150100930 2023-09-23T08:54:27.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:27.959+0000 7f11467fc700 1 -- 172.21.15.82:0/578608714 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 134671+0+0 (secure 0 0 0) 0x7f114c003db0 con 0x7f1150100930 2023-09-23T08:54:27.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:27.961+0000 7f11467fc700 1 --2- 172.21.15.82:0/578608714 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f113c0a0020 0x7f113c0a24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:27.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:27.961+0000 7f11467fc700 1 -- 172.21.15.82:0/578608714 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f114c014070 con 0x7f1150100930 2023-09-23T08:54:27.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:27.961+0000 7f1154b9a700 1 --2- 172.21.15.82:0/578608714 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f113c0a0020 0x7f113c0a24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:27.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:27.962+0000 7f1154b9a700 1 --2- 172.21.15.82:0/578608714 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f113c0a0020 0x7f113c0a24e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1140000c00 tx=0x7f1140005a90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:54:27.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:27.965+0000 7f11467fc700 1 -- 172.21.15.82:0/578608714 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f114c0951d0 con 0x7f1150100930 2023-09-23T08:54:28.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:28.208+0000 7f11575ff700 1 -- 172.21.15.82:0/578608714 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f115002cc90 con 0x7f1150100930 2023-09-23T08:54:28.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:28.208+0000 7f11467fc700 1 -- 172.21.15.82:0/578608714 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+5286 (secure 0 0 0) 0x7f114c0987f0 con 0x7f1150100930 2023-09-23T08:54:28.211 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:54:28.211 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":7,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/1237857359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1237857359},{"type":"v1","addr":"172.21.15.82:6835","nonce":1237857359}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/1335102362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":1335102362},{"type":"v1","addr":"172.21.15.82:6837","nonce":1335102362}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14598,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/3645331700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3645331700},{"type":"v1","addr":"172.21.15.135:6835","nonce":3645331700}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/503886037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":503886037},{"type":"v1","addr":"172.21.15.135:6833","nonce":503886037}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24463,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6833/471569125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":471569125},{"type":"v1","addr":"172.21.15.161:6833","nonce":471569125}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24514,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/2237964162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":2237964162},{"type":"v1","addr":"172.21.15.161:6835","nonce":2237964162}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7}],"filesystems":[]} 2023-09-23T08:54:28.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:28.211+0000 7f11575ff700 1 -- 172.21.15.82:0/578608714 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f113c0a0020 msgr2=0x7f113c0a24e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:28.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:28.211+0000 7f11575ff700 1 --2- 172.21.15.82:0/578608714 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f113c0a0020 0x7f113c0a24e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1140000c00 tx=0x7f1140005a90 comp rx=0 tx=0).stop 2023-09-23T08:54:28.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:28.211+0000 7f11575ff700 1 -- 172.21.15.82:0/578608714 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1150100930 msgr2=0x7f11500746d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:28.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:28.211+0000 7f11575ff700 1 --2- 172.21.15.82:0/578608714 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1150100930 0x7f11500746d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f114c00e970 tx=0x7f114c00ec80 comp rx=0 tx=0).stop 2023-09-23T08:54:28.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:28.211+0000 7f11575ff700 1 -- 172.21.15.82:0/578608714 shutdown_connections 2023-09-23T08:54:28.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:28.211+0000 7f11575ff700 1 --2- 172.21.15.82:0/578608714 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f113c0a0020 0x7f113c0a24e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:28.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:28.211+0000 7f11575ff700 1 --2- 172.21.15.82:0/578608714 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11501024c0 0x7f1150073250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:28.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:28.211+0000 7f11575ff700 1 --2- 172.21.15.82:0/578608714 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1150100930 0x7f11500746d0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:28.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:28.211+0000 7f11575ff700 1 --2- 172.21.15.82:0/578608714 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1150101b20 0x7f1150072d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:28.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:28.211+0000 7f11575ff700 1 -- 172.21.15.82:0/578608714 >> 172.21.15.82:0/578608714 conn(0x7f11500fbe60 msgr2=0x7f1150105100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:54:28.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:28.211+0000 7f11575ff700 1 -- 172.21.15.82:0/578608714 shutdown_connections 2023-09-23T08:54:28.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:28.211+0000 7f11575ff700 1 -- 172.21.15.82:0/578608714 wait complete. 2023-09-23T08:54:28.215 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 7 2023-09-23T08:54:28.593 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:28 smithi161 ceph-mon[99580]: Deploying daemon mds.c on smithi161 2023-09-23T08:54:28.594 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:28 smithi161 ceph-mon[99580]: mds.? [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] up:boot 2023-09-23T08:54:28.594 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:28 smithi161 ceph-mon[99580]: fsmap 6 up:standby 2023-09-23T08:54:28.594 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:28 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-09-23T08:54:28.594 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:28 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/578608714' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T08:54:28.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:28 smithi082 ceph-mon[97694]: Deploying daemon mds.c on smithi161 2023-09-23T08:54:28.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:28 smithi082 ceph-mon[97694]: mds.? [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] up:boot 2023-09-23T08:54:28.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:28 smithi082 ceph-mon[97694]: fsmap 6 up:standby 2023-09-23T08:54:28.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:28 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-09-23T08:54:28.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:28 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/578608714' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T08:54:28.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:28 smithi135 ceph-mon[99205]: Deploying daemon mds.c on smithi161 2023-09-23T08:54:28.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:28 smithi135 ceph-mon[99205]: mds.? [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] up:boot 2023-09-23T08:54:28.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:28 smithi135 ceph-mon[99205]: fsmap 6 up:standby 2023-09-23T08:54:28.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:28 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-09-23T08:54:28.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:28 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/578608714' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T08:54:29.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:29 smithi161 ceph-mon[99580]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:54:29.648 INFO:journalctl@ceph.mds.c.smithi161.stdout:Sep 23 08:54:29 smithi161 systemd[1]: Starting Ceph mds.c for 8926e286-59ed-11ee-8db4-212e2dc638e7... 2023-09-23T08:54:29.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:29 smithi135 ceph-mon[99205]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:54:29.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:29 smithi082 ceph-mon[97694]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:54:30.043 INFO:journalctl@ceph.mds.c.smithi161.stdout:Sep 23 08:54:29 smithi161 podman[125556]: 2023-09-23T08:54:30.044 INFO:journalctl@ceph.mds.c.smithi161.stdout:Sep 23 08:54:30 smithi161 bash[125556]: e872c9bc382715af73d03ba713c628a85c40642833171a6c3b5481c93ebae44f 2023-09-23T08:54:30.044 INFO:journalctl@ceph.mds.c.smithi161.stdout:Sep 23 08:54:30 smithi161 ceph-mds[125596]: -- 172.21.15.161:0/3598299777 <== mon.1 v2:172.21.15.161:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x560c148151e0 con 0x560c147eb000 2023-09-23T08:54:30.044 INFO:journalctl@ceph.mds.c.smithi161.stdout:Sep 23 08:54:30 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mds-c[125572]: starting mds.c at 2023-09-23T08:54:30.232 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-23T08:54:30.398 INFO:journalctl@ceph.mds.c.smithi161.stdout:Sep 23 08:54:30 smithi161 systemd[1]: Started Ceph mds.c for 8926e286-59ed-11ee-8db4-212e2dc638e7. 2023-09-23T08:54:30.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:30.440+0000 7f0214dff700 1 -- 172.21.15.82:0/1316235782 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02101024c0 msgr2=0x7f0210108d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:30.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:30.440+0000 7f0214dff700 1 --2- 172.21.15.82:0/1316235782 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02101024c0 0x7f0210108d70 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f020800b0d0 tx=0x7f020800b3e0 comp rx=0 tx=0).stop 2023-09-23T08:54:30.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:30.440+0000 7f0214dff700 1 -- 172.21.15.82:0/1316235782 shutdown_connections 2023-09-23T08:54:30.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:30.440+0000 7f0214dff700 1 --2- 172.21.15.82:0/1316235782 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02101024c0 0x7f0210108d70 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:30.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:30.440+0000 7f0214dff700 1 --2- 172.21.15.82:0/1316235782 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0210100930 0x7f0210100d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:30.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:30.440+0000 7f0214dff700 1 --2- 172.21.15.82:0/1316235782 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0210101b20 0x7f0210101f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:30.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:30.440+0000 7f0214dff700 1 -- 172.21.15.82:0/1316235782 >> 172.21.15.82:0/1316235782 conn(0x7f02100fbe60 msgr2=0x7f02100fe2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:54:30.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:30.440+0000 7f0214dff700 1 -- 172.21.15.82:0/1316235782 shutdown_connections 2023-09-23T08:54:30.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:30.440+0000 7f0214dff700 1 -- 172.21.15.82:0/1316235782 wait complete. 2023-09-23T08:54:30.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:30.441+0000 7f0214dff700 1 Processor -- start 2023-09-23T08:54:30.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:30.441+0000 7f0214dff700 1 -- start start 2023-09-23T08:54:30.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:30.441+0000 7f0214dff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0210100930 0x7f02101987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:30.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:30.441+0000 7f0214dff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0210101b20 0x7f0210198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:30.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:30.441+0000 7f0214dff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f02101024c0 0x7f021019fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:30.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:30.441+0000 7f0214dff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02101a0360 con 0x7f0210101b20 2023-09-23T08:54:30.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:30.441+0000 7f0214dff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02101a04a0 con 0x7f0210100930 2023-09-23T08:54:30.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:30.441+0000 7f0214dff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02101a0630 con 0x7f02101024c0 2023-09-23T08:54:30.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:30.442+0000 7f020dd9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0210101b20 0x7f0210198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:30.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:30.442+0000 7f020e59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0210100930 0x7f02101987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:30.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:30.442+0000 7f020e59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0210100930 0x7f02101987e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:56510/0 (socket says 172.21.15.82:56510) 2023-09-23T08:54:30.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:30.442+0000 7f020dd9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0210101b20 0x7f0210198d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45216/0 (socket says 172.21.15.82:45216) 2023-09-23T08:54:30.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:30.442+0000 7f020e59c700 1 -- 172.21.15.82:0/3455536530 learned_addr learned my addr 172.21.15.82:0/3455536530 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:54:30.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:30.442+0000 7f020ed9d700 1 --2- 172.21.15.82:0/3455536530 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f02101024c0 0x7f021019fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:30.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:30.442+0000 7f020dd9b700 1 -- 172.21.15.82:0/3455536530 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f02101024c0 msgr2=0x7f021019fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:30.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:30.442+0000 7f020dd9b700 1 --2- 172.21.15.82:0/3455536530 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f02101024c0 0x7f021019fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:30.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:30.442+0000 7f020dd9b700 1 -- 172.21.15.82:0/3455536530 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0210100930 msgr2=0x7f02101987e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:30.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:30.442+0000 7f020dd9b700 1 --2- 172.21.15.82:0/3455536530 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0210100930 0x7f02101987e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:30.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:30.442+0000 7f020dd9b700 1 -- 172.21.15.82:0/3455536530 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0208009d00 con 0x7f0210101b20 2023-09-23T08:54:30.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:30.442+0000 7f020e59c700 1 --2- 172.21.15.82:0/3455536530 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0210100930 0x7f02101987e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T08:54:30.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:30.442+0000 7f020dd9b700 1 --2- 172.21.15.82:0/3455536530 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0210101b20 0x7f0210198d20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f020400e9f0 tx=0x7f020400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:54:30.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:30.442+0000 7f01ff7fe700 1 -- 172.21.15.82:0/3455536530 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f020400eee0 con 0x7f0210101b20 2023-09-23T08:54:30.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:30.442+0000 7f01ff7fe700 1 -- 172.21.15.82:0/3455536530 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f020400cbd0 con 0x7f0210101b20 2023-09-23T08:54:30.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:30.442+0000 7f01ff7fe700 1 -- 172.21.15.82:0/3455536530 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0204018680 con 0x7f0210101b20 2023-09-23T08:54:30.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:30.443+0000 7f0214dff700 1 -- 172.21.15.82:0/3455536530 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02101a0910 con 0x7f0210101b20 2023-09-23T08:54:30.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:30.443+0000 7f0214dff700 1 -- 172.21.15.82:0/3455536530 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02101a0dd0 con 0x7f0210101b20 2023-09-23T08:54:30.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:30.443+0000 7f0214dff700 1 -- 172.21.15.82:0/3455536530 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f021010bfb0 con 0x7f0210101b20 2023-09-23T08:54:30.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:30.445+0000 7f01ff7fe700 1 -- 172.21.15.82:0/3455536530 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 134671+0+0 (secure 0 0 0) 0x7f020400cd40 con 0x7f0210101b20 2023-09-23T08:54:30.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:30.447+0000 7f01ff7fe700 1 --2- 172.21.15.82:0/3455536530 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f01f809ffa0 0x7f01f80a2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:30.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:30.447+0000 7f01ff7fe700 1 -- 172.21.15.82:0/3455536530 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f0204014070 con 0x7f0210101b20 2023-09-23T08:54:30.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:30.447+0000 7f020e59c700 1 --2- 172.21.15.82:0/3455536530 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f01f809ffa0 0x7f01f80a2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:30.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:30.448+0000 7f020e59c700 1 --2- 172.21.15.82:0/3455536530 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f01f809ffa0 0x7f01f80a2460 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0200007fd0 tx=0x7f0200007480 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:54:30.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:30.451+0000 7f01ff7fe700 1 -- 172.21.15.82:0/3455536530 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f0204051e00 con 0x7f0210101b20 2023-09-23T08:54:30.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:30.691+0000 7f0214dff700 1 -- 172.21.15.82:0/3455536530 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f021010c220 con 0x7f0210101b20 2023-09-23T08:54:30.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:30.692+0000 7f01ff7fe700 1 -- 172.21.15.82:0/3455536530 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+6074 (secure 0 0 0) 0x7f02040950f0 con 0x7f0210101b20 2023-09-23T08:54:30.695 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:54:30.695 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":8,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/1237857359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1237857359},{"type":"v1","addr":"172.21.15.82:6835","nonce":1237857359}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/1335102362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":1335102362},{"type":"v1","addr":"172.21.15.82:6837","nonce":1335102362}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14598,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/3645331700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3645331700},{"type":"v1","addr":"172.21.15.135:6835","nonce":3645331700}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/503886037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":503886037},{"type":"v1","addr":"172.21.15.135:6833","nonce":503886037}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24463,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6833/471569125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":471569125},{"type":"v1","addr":"172.21.15.161:6833","nonce":471569125}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24514,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/2237964162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":2237964162},{"type":"v1","addr":"172.21.15.161:6835","nonce":2237964162}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24526,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/43639843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":43639843},{"type":"v1","addr":"172.21.15.161:6837","nonce":43639843}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8}],"filesystems":[]} 2023-09-23T08:54:30.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:30.694+0000 7f0214dff700 1 -- 172.21.15.82:0/3455536530 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f01f809ffa0 msgr2=0x7f01f80a2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:30.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:30.694+0000 7f0214dff700 1 --2- 172.21.15.82:0/3455536530 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f01f809ffa0 0x7f01f80a2460 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0200007fd0 tx=0x7f0200007480 comp rx=0 tx=0).stop 2023-09-23T08:54:30.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:30.694+0000 7f0214dff700 1 -- 172.21.15.82:0/3455536530 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0210101b20 msgr2=0x7f0210198d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:30.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:30.694+0000 7f0214dff700 1 --2- 172.21.15.82:0/3455536530 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0210101b20 0x7f0210198d20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f020400e9f0 tx=0x7f020400ed00 comp rx=0 tx=0).stop 2023-09-23T08:54:30.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:30.695+0000 7f0214dff700 1 -- 172.21.15.82:0/3455536530 shutdown_connections 2023-09-23T08:54:30.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:30.695+0000 7f0214dff700 1 --2- 172.21.15.82:0/3455536530 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f01f809ffa0 0x7f01f80a2460 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:30.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:30.695+0000 7f0214dff700 1 --2- 172.21.15.82:0/3455536530 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f02101024c0 0x7f021019fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:30.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:30.695+0000 7f0214dff700 1 --2- 172.21.15.82:0/3455536530 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0210100930 0x7f02101987e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:30.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:30.695+0000 7f0214dff700 1 --2- 172.21.15.82:0/3455536530 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0210101b20 0x7f0210198d20 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:30.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:30.695+0000 7f0214dff700 1 -- 172.21.15.82:0/3455536530 >> 172.21.15.82:0/3455536530 conn(0x7f02100fbe60 msgr2=0x7f02100fe120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:54:30.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:30.695+0000 7f0214dff700 1 -- 172.21.15.82:0/3455536530 shutdown_connections 2023-09-23T08:54:30.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:30.695+0000 7f0214dff700 1 -- 172.21.15.82:0/3455536530 wait complete. 2023-09-23T08:54:30.699 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 8 2023-09-23T08:54:31.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:31 smithi082 ceph-mon[97694]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:54:31.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:31 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:31.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:31 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:31.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:31 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:31.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:31 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-23T08:54:31.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:31 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-23T08:54:31.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:31 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:54:31.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:31 smithi082 ceph-mon[97694]: Deploying daemon mds.h on smithi135 2023-09-23T08:54:31.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:31 smithi082 ceph-mon[97694]: mds.? [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] up:boot 2023-09-23T08:54:31.372 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:31 smithi082 ceph-mon[97694]: fsmap 7 up:standby 2023-09-23T08:54:31.372 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:31 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-09-23T08:54:31.372 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:31 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/3455536530' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T08:54:31.385 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:31 smithi135 ceph-mon[99205]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:54:31.385 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:31 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:31.385 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:31 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:31.385 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:31 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:31.385 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:31 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-23T08:54:31.385 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:31 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-23T08:54:31.385 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:31 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:54:31.385 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:31 smithi135 ceph-mon[99205]: Deploying daemon mds.h on smithi135 2023-09-23T08:54:31.385 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:31 smithi135 ceph-mon[99205]: mds.? [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] up:boot 2023-09-23T08:54:31.386 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:31 smithi135 ceph-mon[99205]: fsmap 7 up:standby 2023-09-23T08:54:31.386 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:31 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-09-23T08:54:31.386 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:31 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/3455536530' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T08:54:31.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:31 smithi161 ceph-mon[99580]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:54:31.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:31 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:31.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:31 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:31.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:31 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:31.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:31 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-23T08:54:31.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:31 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-23T08:54:31.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:31 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:54:31.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:31 smithi161 ceph-mon[99580]: Deploying daemon mds.h on smithi135 2023-09-23T08:54:31.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:31 smithi161 ceph-mon[99580]: mds.? [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] up:boot 2023-09-23T08:54:31.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:31 smithi161 ceph-mon[99580]: fsmap 7 up:standby 2023-09-23T08:54:31.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:31 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-09-23T08:54:31.400 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:31 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/3455536530' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T08:54:32.413 INFO:journalctl@ceph.mds.h.smithi135.stdout:Sep 23 08:54:32 smithi135 systemd[1]: Starting Ceph mds.h for 8926e286-59ed-11ee-8db4-212e2dc638e7... 2023-09-23T08:54:32.717 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-23T08:54:32.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:32.919+0000 7fd6f8dff700 1 -- 172.21.15.82:0/1019518838 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6f41024c0 msgr2=0x7fd6f4108d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:32.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:32.919+0000 7fd6f8dff700 1 --2- 172.21.15.82:0/1019518838 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6f41024c0 0x7fd6f4108d70 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec00b0d0 tx=0x7fd6ec00b3e0 comp rx=0 tx=0).stop 2023-09-23T08:54:32.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:32.919+0000 7fd6f8dff700 1 -- 172.21.15.82:0/1019518838 shutdown_connections 2023-09-23T08:54:32.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:32.919+0000 7fd6f8dff700 1 --2- 172.21.15.82:0/1019518838 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6f41024c0 0x7fd6f4108d70 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:32.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:32.920+0000 7fd6f8dff700 1 --2- 172.21.15.82:0/1019518838 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd6f4100930 0x7fd6f4100d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:32.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:32.920+0000 7fd6f8dff700 1 --2- 172.21.15.82:0/1019518838 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6f4101b20 0x7fd6f4101f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:32.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:32.920+0000 7fd6f8dff700 1 -- 172.21.15.82:0/1019518838 >> 172.21.15.82:0/1019518838 conn(0x7fd6f40fbe60 msgr2=0x7fd6f40fe2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:54:32.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:32.920+0000 7fd6f8dff700 1 -- 172.21.15.82:0/1019518838 shutdown_connections 2023-09-23T08:54:32.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:32.920+0000 7fd6f8dff700 1 -- 172.21.15.82:0/1019518838 wait complete. 2023-09-23T08:54:32.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:32.921+0000 7fd6f8dff700 1 Processor -- start 2023-09-23T08:54:32.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:32.921+0000 7fd6f8dff700 1 -- start start 2023-09-23T08:54:32.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:32.921+0000 7fd6f8dff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd6f4100930 0x7fd6f41987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:32.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:32.921+0000 7fd6f8dff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6f4101b20 0x7fd6f4198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:32.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:32.921+0000 7fd6f8dff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6f41024c0 0x7fd6f419fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:32.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:32.921+0000 7fd6f8dff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f41a0360 con 0x7fd6f41024c0 2023-09-23T08:54:32.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:32.921+0000 7fd6f8dff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f41a04a0 con 0x7fd6f4100930 2023-09-23T08:54:32.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:32.921+0000 7fd6f8dff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f41a0630 con 0x7fd6f4101b20 2023-09-23T08:54:32.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:32.921+0000 7fd6f2d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6f41024c0 0x7fd6f419fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:32.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:32.921+0000 7fd6f2d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6f41024c0 0x7fd6f419fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51904/0 (socket says 172.21.15.82:51904) 2023-09-23T08:54:32.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:32.921+0000 7fd6f2d9d700 1 -- 172.21.15.82:0/2728266287 learned_addr learned my addr 172.21.15.82:0/2728266287 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:54:32.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:32.921+0000 7fd6f259c700 1 --2- 172.21.15.82:0/2728266287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd6f4100930 0x7fd6f41987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:32.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:32.922+0000 7fd6f1d9b700 1 --2- 172.21.15.82:0/2728266287 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6f4101b20 0x7fd6f4198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:32.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:32.922+0000 7fd6f2d9d700 1 -- 172.21.15.82:0/2728266287 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6f4101b20 msgr2=0x7fd6f4198d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:32.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:32.922+0000 7fd6f2d9d700 1 --2- 172.21.15.82:0/2728266287 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6f4101b20 0x7fd6f4198d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:32.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:32.922+0000 7fd6f2d9d700 1 -- 172.21.15.82:0/2728266287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd6f4100930 msgr2=0x7fd6f41987e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:32.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:32.922+0000 7fd6f2d9d700 1 --2- 172.21.15.82:0/2728266287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd6f4100930 0x7fd6f41987e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:32.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:32.922+0000 7fd6f2d9d700 1 -- 172.21.15.82:0/2728266287 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6ec009d00 con 0x7fd6f41024c0 2023-09-23T08:54:32.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:32.922+0000 7fd6f2d9d700 1 --2- 172.21.15.82:0/2728266287 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6f41024c0 0x7fd6f419fd90 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec009440 tx=0x7fd6ec009470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:54:32.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:32.922+0000 7fd6e37fe700 1 -- 172.21.15.82:0/2728266287 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6ec00e040 con 0x7fd6f41024c0 2023-09-23T08:54:32.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:32.922+0000 7fd6e37fe700 1 -- 172.21.15.82:0/2728266287 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd6ec012e10 con 0x7fd6f41024c0 2023-09-23T08:54:32.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:32.922+0000 7fd6f8dff700 1 -- 172.21.15.82:0/2728266287 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6f41a08b0 con 0x7fd6f41024c0 2023-09-23T08:54:32.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:32.922+0000 7fd6e37fe700 1 -- 172.21.15.82:0/2728266287 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6ec01b450 con 0x7fd6f41024c0 2023-09-23T08:54:32.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:32.922+0000 7fd6f8dff700 1 -- 172.21.15.82:0/2728266287 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6f41a0d80 con 0x7fd6f41024c0 2023-09-23T08:54:32.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:32.923+0000 7fd6f8dff700 1 -- 172.21.15.82:0/2728266287 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6f410c050 con 0x7fd6f41024c0 2023-09-23T08:54:32.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:32.925+0000 7fd6e37fe700 1 -- 172.21.15.82:0/2728266287 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 134671+0+0 (secure 0 0 0) 0x7fd6ec012980 con 0x7fd6f41024c0 2023-09-23T08:54:32.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:32.926+0000 7fd6e37fe700 1 --2- 172.21.15.82:0/2728266287 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fd6dc0a0020 0x7fd6dc0a24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:32.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:32.926+0000 7fd6e37fe700 1 -- 172.21.15.82:0/2728266287 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fd6ec0ccc10 con 0x7fd6f41024c0 2023-09-23T08:54:32.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:32.927+0000 7fd6f259c700 1 --2- 172.21.15.82:0/2728266287 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fd6dc0a0020 0x7fd6dc0a24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:32.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:32.927+0000 7fd6f259c700 1 --2- 172.21.15.82:0/2728266287 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fd6dc0a0020 0x7fd6dc0a24e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd6f4101980 tx=0x7fd6e400a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:54:32.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:32.930+0000 7fd6e37fe700 1 -- 172.21.15.82:0/2728266287 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7fd6ec096e30 con 0x7fd6f41024c0 2023-09-23T08:54:33.166 INFO:journalctl@ceph.mds.h.smithi135.stdout:Sep 23 08:54:32 smithi135 podman[124330]: 2023-09-23T08:54:33.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:33.174+0000 7fd6f8dff700 1 -- 172.21.15.82:0/2728266287 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd6f410c270 con 0x7fd6f41024c0 2023-09-23T08:54:33.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:33.174+0000 7fd6e37fe700 1 -- 172.21.15.82:0/2728266287 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+6074 (secure 0 0 0) 0x7fd6ec09a450 con 0x7fd6f41024c0 2023-09-23T08:54:33.177 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:54:33.177 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":8,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/1237857359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1237857359},{"type":"v1","addr":"172.21.15.82:6835","nonce":1237857359}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/1335102362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":1335102362},{"type":"v1","addr":"172.21.15.82:6837","nonce":1335102362}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14598,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/3645331700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3645331700},{"type":"v1","addr":"172.21.15.135:6835","nonce":3645331700}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/503886037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":503886037},{"type":"v1","addr":"172.21.15.135:6833","nonce":503886037}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24463,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6833/471569125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":471569125},{"type":"v1","addr":"172.21.15.161:6833","nonce":471569125}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24514,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/2237964162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":2237964162},{"type":"v1","addr":"172.21.15.161:6835","nonce":2237964162}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24526,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/43639843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":43639843},{"type":"v1","addr":"172.21.15.161:6837","nonce":43639843}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8}],"filesystems":[]} 2023-09-23T08:54:33.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:33.177+0000 7fd6f8dff700 1 -- 172.21.15.82:0/2728266287 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fd6dc0a0020 msgr2=0x7fd6dc0a24e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:33.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:33.177+0000 7fd6f8dff700 1 --2- 172.21.15.82:0/2728266287 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fd6dc0a0020 0x7fd6dc0a24e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd6f4101980 tx=0x7fd6e400a380 comp rx=0 tx=0).stop 2023-09-23T08:54:33.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:33.177+0000 7fd6f8dff700 1 -- 172.21.15.82:0/2728266287 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6f41024c0 msgr2=0x7fd6f419fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:33.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:33.177+0000 7fd6f8dff700 1 --2- 172.21.15.82:0/2728266287 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6f41024c0 0x7fd6f419fd90 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec009440 tx=0x7fd6ec009470 comp rx=0 tx=0).stop 2023-09-23T08:54:33.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:33.177+0000 7fd6f8dff700 1 -- 172.21.15.82:0/2728266287 shutdown_connections 2023-09-23T08:54:33.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:33.177+0000 7fd6f8dff700 1 --2- 172.21.15.82:0/2728266287 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fd6dc0a0020 0x7fd6dc0a24e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:33.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:33.177+0000 7fd6f8dff700 1 --2- 172.21.15.82:0/2728266287 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6f41024c0 0x7fd6f419fd90 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:33.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:33.177+0000 7fd6f8dff700 1 --2- 172.21.15.82:0/2728266287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd6f4100930 0x7fd6f41987e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:33.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:33.177+0000 7fd6f8dff700 1 --2- 172.21.15.82:0/2728266287 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6f4101b20 0x7fd6f4198d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:33.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:33.177+0000 7fd6f8dff700 1 -- 172.21.15.82:0/2728266287 >> 172.21.15.82:0/2728266287 conn(0x7fd6f40fbe60 msgr2=0x7fd6f41073c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:54:33.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:33.177+0000 7fd6f8dff700 1 -- 172.21.15.82:0/2728266287 shutdown_connections 2023-09-23T08:54:33.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:33.177+0000 7fd6f8dff700 1 -- 172.21.15.82:0/2728266287 wait complete. 2023-09-23T08:54:33.181 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 8 2023-09-23T08:54:33.562 INFO:journalctl@ceph.mds.h.smithi135.stdout:Sep 23 08:54:33 smithi135 bash[124330]: 9b7e5b51ac7e08a95896cea9965614f91d633bc5d15bd95c78a0287b29f2eb1e 2023-09-23T08:54:33.562 INFO:journalctl@ceph.mds.h.smithi135.stdout:Sep 23 08:54:33 smithi135 ceph-mds[124370]: -- 172.21.15.135:0/284027539 <== mon.1 v2:172.21.15.161:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5606cfea71e0 con 0x5606cfe7c800 2023-09-23T08:54:33.562 INFO:journalctl@ceph.mds.h.smithi135.stdout:Sep 23 08:54:33 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mds-h[124346]: starting mds.h at 2023-09-23T08:54:33.562 INFO:journalctl@ceph.mds.h.smithi135.stdout:Sep 23 08:54:33 smithi135 systemd[1]: Started Ceph mds.h for 8926e286-59ed-11ee-8db4-212e2dc638e7. 2023-09-23T08:54:33.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:33 smithi135 ceph-mon[99205]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:54:33.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:33 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/2728266287' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T08:54:33.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:33 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:33.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:33 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:33.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:33 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:33.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:33 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-23T08:54:33.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:33 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-23T08:54:33.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:33 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:54:33.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:33 smithi082 ceph-mon[97694]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:54:33.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:33 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/2728266287' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T08:54:33.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:33 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:33.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:33 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:33.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:33 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:33.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:33 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-23T08:54:33.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:33 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-23T08:54:33.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:33 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:54:33.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:33 smithi161 ceph-mon[99580]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:54:33.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:33 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/2728266287' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T08:54:33.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:33 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:33.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:33 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:33.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:33 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:33.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:33 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-23T08:54:33.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:33 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-23T08:54:33.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:33 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:54:34.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:34 smithi161 ceph-mon[99580]: Deploying daemon mds.i on smithi161 2023-09-23T08:54:34.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:34 smithi161 ceph-mon[99580]: mds.? [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] up:boot 2023-09-23T08:54:34.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:34 smithi161 ceph-mon[99580]: fsmap 8 up:standby 2023-09-23T08:54:34.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:34 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-09-23T08:54:34.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:34 smithi135 ceph-mon[99205]: Deploying daemon mds.i on smithi161 2023-09-23T08:54:34.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:34 smithi135 ceph-mon[99205]: mds.? [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] up:boot 2023-09-23T08:54:34.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:34 smithi135 ceph-mon[99205]: fsmap 8 up:standby 2023-09-23T08:54:34.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:34 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-09-23T08:54:34.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:34 smithi082 ceph-mon[97694]: Deploying daemon mds.i on smithi161 2023-09-23T08:54:34.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:34 smithi082 ceph-mon[97694]: mds.? [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] up:boot 2023-09-23T08:54:34.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:34 smithi082 ceph-mon[97694]: fsmap 8 up:standby 2023-09-23T08:54:34.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:34 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-09-23T08:54:35.199 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-23T08:54:35.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:35.404+0000 7f6ceb3ff700 1 -- 172.21.15.82:0/50176732 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ce41024d0 msgr2=0x7f6ce4108d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:35.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:35.404+0000 7f6ceb3ff700 1 --2- 172.21.15.82:0/50176732 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ce41024d0 0x7f6ce4108d80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc00b0d0 tx=0x7f6cdc00b3e0 comp rx=0 tx=0).stop 2023-09-23T08:54:35.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:35.404+0000 7f6ceb3ff700 1 -- 172.21.15.82:0/50176732 shutdown_connections 2023-09-23T08:54:35.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:35.404+0000 7f6ceb3ff700 1 --2- 172.21.15.82:0/50176732 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ce41024d0 0x7f6ce4108d80 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:35.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:35.404+0000 7f6ceb3ff700 1 --2- 172.21.15.82:0/50176732 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ce4100940 0x7f6ce4100d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:35.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:35.404+0000 7f6ceb3ff700 1 --2- 172.21.15.82:0/50176732 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ce4101b30 0x7f6ce4101f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:35.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:35.404+0000 7f6ceb3ff700 1 -- 172.21.15.82:0/50176732 >> 172.21.15.82:0/50176732 conn(0x7f6ce40fbe90 msgr2=0x7f6ce40fe2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:54:35.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:35.404+0000 7f6ceb3ff700 1 -- 172.21.15.82:0/50176732 shutdown_connections 2023-09-23T08:54:35.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:35.404+0000 7f6ceb3ff700 1 -- 172.21.15.82:0/50176732 wait complete. 2023-09-23T08:54:35.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:35.405+0000 7f6ceb3ff700 1 Processor -- start 2023-09-23T08:54:35.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:35.405+0000 7f6ceb3ff700 1 -- start start 2023-09-23T08:54:35.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:35.405+0000 7f6ceb3ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ce4100940 0x7f6ce41987d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:35.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:35.405+0000 7f6ceb3ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ce4101b30 0x7f6ce4198d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:35.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:35.405+0000 7f6ceb3ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ce41024d0 0x7f6ce419fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:35.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:35.405+0000 7f6ceb3ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce41a0350 con 0x7f6ce4100940 2023-09-23T08:54:35.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:35.405+0000 7f6ceb3ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce41a0490 con 0x7f6ce4101b30 2023-09-23T08:54:35.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:35.405+0000 7f6ceb3ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce41a0620 con 0x7f6ce41024d0 2023-09-23T08:54:35.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:35.406+0000 7f6ce919b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ce4100940 0x7f6ce41987d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:35.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:35.406+0000 7f6ce919b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ce4100940 0x7f6ce41987d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51934/0 (socket says 172.21.15.82:51934) 2023-09-23T08:54:35.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:35.406+0000 7f6ce919b700 1 -- 172.21.15.82:0/463688758 learned_addr learned my addr 172.21.15.82:0/463688758 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:54:35.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:35.406+0000 7f6ce999c700 1 --2- 172.21.15.82:0/463688758 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ce41024d0 0x7f6ce419fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:35.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:35.406+0000 7f6ce899a700 1 --2- 172.21.15.82:0/463688758 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ce4101b30 0x7f6ce4198d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:35.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:35.406+0000 7f6ce919b700 1 -- 172.21.15.82:0/463688758 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ce41024d0 msgr2=0x7f6ce419fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:35.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:35.406+0000 7f6ce919b700 1 --2- 172.21.15.82:0/463688758 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ce41024d0 0x7f6ce419fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:35.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:35.406+0000 7f6ce919b700 1 -- 172.21.15.82:0/463688758 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ce4101b30 msgr2=0x7f6ce4198d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:35.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:35.406+0000 7f6ce919b700 1 --2- 172.21.15.82:0/463688758 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ce4101b30 0x7f6ce4198d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:35.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:35.406+0000 7f6ce919b700 1 -- 172.21.15.82:0/463688758 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cdc009d00 con 0x7f6ce4100940 2023-09-23T08:54:35.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:35.406+0000 7f6ce919b700 1 --2- 172.21.15.82:0/463688758 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ce4100940 0x7f6ce41987d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6ce000e970 tx=0x7f6ce000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:54:35.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:35.407+0000 7f6cda7fc700 1 -- 172.21.15.82:0/463688758 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce0009790 con 0x7f6ce4100940 2023-09-23T08:54:35.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:35.407+0000 7f6cda7fc700 1 -- 172.21.15.82:0/463688758 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6ce000eec0 con 0x7f6ce4100940 2023-09-23T08:54:35.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:35.407+0000 7f6ceb3ff700 1 -- 172.21.15.82:0/463688758 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ce41a0900 con 0x7f6ce4100940 2023-09-23T08:54:35.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:35.407+0000 7f6cda7fc700 1 -- 172.21.15.82:0/463688758 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce0003c10 con 0x7f6ce4100940 2023-09-23T08:54:35.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:35.407+0000 7f6ceb3ff700 1 -- 172.21.15.82:0/463688758 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ce41a0e60 con 0x7f6ce4100940 2023-09-23T08:54:35.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:35.408+0000 7f6ceb3ff700 1 -- 172.21.15.82:0/463688758 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ce410c010 con 0x7f6ce4100940 2023-09-23T08:54:35.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:35.410+0000 7f6cda7fc700 1 -- 172.21.15.82:0/463688758 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 134671+0+0 (secure 0 0 0) 0x7f6ce0003db0 con 0x7f6ce4100940 2023-09-23T08:54:35.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:35.411+0000 7f6cda7fc700 1 --2- 172.21.15.82:0/463688758 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f6cd00a0020 0x7f6cd00a24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:35.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:35.411+0000 7f6cda7fc700 1 -- 172.21.15.82:0/463688758 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f6ce0014070 con 0x7f6ce4100940 2023-09-23T08:54:35.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:35.411+0000 7f6ce899a700 1 --2- 172.21.15.82:0/463688758 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f6cd00a0020 0x7f6cd00a24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:35.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:35.412+0000 7f6ce899a700 1 --2- 172.21.15.82:0/463688758 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f6cd00a0020 0x7f6cd00a24e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6cd4009af0 tx=0x7f6cd40094f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:54:35.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:35.415+0000 7f6cda7fc700 1 -- 172.21.15.82:0/463688758 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f6ce00951d0 con 0x7f6ce4100940 2023-09-23T08:54:35.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:35 smithi082 ceph-mon[97694]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:54:35.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:35.661+0000 7f6ceb3ff700 1 -- 172.21.15.82:0/463688758 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6ce410c250 con 0x7f6ce4100940 2023-09-23T08:54:35.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:35.661+0000 7f6cda7fc700 1 -- 172.21.15.82:0/463688758 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+6868 (secure 0 0 0) 0x7f6ce00987f0 con 0x7f6ce4100940 2023-09-23T08:54:35.664 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:54:35.664 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":9,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/1237857359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1237857359},{"type":"v1","addr":"172.21.15.82:6835","nonce":1237857359}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/1335102362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":1335102362},{"type":"v1","addr":"172.21.15.82:6837","nonce":1335102362}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14598,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/3645331700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3645331700},{"type":"v1","addr":"172.21.15.135:6835","nonce":3645331700}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/503886037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":503886037},{"type":"v1","addr":"172.21.15.135:6833","nonce":503886037}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24463,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6833/471569125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":471569125},{"type":"v1","addr":"172.21.15.161:6833","nonce":471569125}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24514,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/2237964162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":2237964162},{"type":"v1","addr":"172.21.15.161:6835","nonce":2237964162}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24515,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2655304858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2655304858},{"type":"v1","addr":"172.21.15.135:6837","nonce":2655304858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24526,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/43639843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":43639843},{"type":"v1","addr":"172.21.15.161:6837","nonce":43639843}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8}],"filesystems":[]} 2023-09-23T08:54:35.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:35.664+0000 7f6ceb3ff700 1 -- 172.21.15.82:0/463688758 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f6cd00a0020 msgr2=0x7f6cd00a24e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:35.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:35.664+0000 7f6ceb3ff700 1 --2- 172.21.15.82:0/463688758 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f6cd00a0020 0x7f6cd00a24e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6cd4009af0 tx=0x7f6cd40094f0 comp rx=0 tx=0).stop 2023-09-23T08:54:35.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:35.664+0000 7f6ceb3ff700 1 -- 172.21.15.82:0/463688758 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ce4100940 msgr2=0x7f6ce41987d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:35.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:35.664+0000 7f6ceb3ff700 1 --2- 172.21.15.82:0/463688758 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ce4100940 0x7f6ce41987d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6ce000e970 tx=0x7f6ce000ec80 comp rx=0 tx=0).stop 2023-09-23T08:54:35.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:35.664+0000 7f6ceb3ff700 1 -- 172.21.15.82:0/463688758 shutdown_connections 2023-09-23T08:54:35.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:35.664+0000 7f6ceb3ff700 1 --2- 172.21.15.82:0/463688758 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f6cd00a0020 0x7f6cd00a24e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:35.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:35.664+0000 7f6ceb3ff700 1 --2- 172.21.15.82:0/463688758 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ce41024d0 0x7f6ce419fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:35.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:35.664+0000 7f6ceb3ff700 1 --2- 172.21.15.82:0/463688758 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ce4100940 0x7f6ce41987d0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:35.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:35.664+0000 7f6ceb3ff700 1 --2- 172.21.15.82:0/463688758 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ce4101b30 0x7f6ce4198d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:35.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:35.664+0000 7f6ceb3ff700 1 -- 172.21.15.82:0/463688758 >> 172.21.15.82:0/463688758 conn(0x7f6ce40fbe90 msgr2=0x7f6ce40fe060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:54:35.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:35.664+0000 7f6ceb3ff700 1 -- 172.21.15.82:0/463688758 shutdown_connections 2023-09-23T08:54:35.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:35.664+0000 7f6ceb3ff700 1 -- 172.21.15.82:0/463688758 wait complete. 2023-09-23T08:54:35.668 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 9 2023-09-23T08:54:35.693 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:35 smithi161 ceph-mon[99580]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:54:35.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:35 smithi135 ceph-mon[99205]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:54:36.149 INFO:journalctl@ceph.mds.i.smithi161.stdout:Sep 23 08:54:35 smithi161 systemd[1]: Starting Ceph mds.i for 8926e286-59ed-11ee-8db4-212e2dc638e7... 2023-09-23T08:54:36.458 INFO:journalctl@ceph.mds.i.smithi161.stdout:Sep 23 08:54:36 smithi161 podman[125902]: 2023-09-23T08:54:36.458 INFO:journalctl@ceph.mds.i.smithi161.stdout:Sep 23 08:54:36 smithi161 bash[125902]: aaff3dd557154a9a25b9bf31944e5c15b1279cf7e4dd1e05646d7266bb83c05b 2023-09-23T08:54:36.459 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:36 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/463688758' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T08:54:36.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:36 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/463688758' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T08:54:36.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:36 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/463688758' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T08:54:36.898 INFO:journalctl@ceph.mds.i.smithi161.stdout:Sep 23 08:54:36 smithi161 ceph-mds[125942]: -- 172.21.15.161:0/2274869266 <== mon.1 v2:172.21.15.161:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5602c2fb71e0 con 0x5602c2f8c800 2023-09-23T08:54:36.898 INFO:journalctl@ceph.mds.i.smithi161.stdout:Sep 23 08:54:36 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mds-i[125918]: starting mds.i at 2023-09-23T08:54:36.898 INFO:journalctl@ceph.mds.i.smithi161.stdout:Sep 23 08:54:36 smithi161 systemd[1]: Started Ceph mds.i for 8926e286-59ed-11ee-8db4-212e2dc638e7. 2023-09-23T08:54:37.685 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-23T08:54:37.694 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:37 smithi082 ceph-mon[97694]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:54:37.694 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:37 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:37.695 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:37 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:37.695 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:37 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:37.695 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:37 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-23T08:54:37.695 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:37 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-23T08:54:37.695 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:37 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:54:37.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:37 smithi135 ceph-mon[99205]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:54:37.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:37 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:37.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:37 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:37.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:37 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:37.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:37 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-23T08:54:37.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:37 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-23T08:54:37.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:37 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:54:37.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:37 smithi161 ceph-mon[99580]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:54:37.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:37 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:37.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:37 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:37.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:37 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:37.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:37 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-23T08:54:37.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:37 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-23T08:54:37.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:37 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:54:37.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:37.904+0000 7f5d203ff700 1 -- 172.21.15.82:0/1166621500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d18101b50 msgr2=0x7f5d18101fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:37.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:37.904+0000 7f5d203ff700 1 --2- 172.21.15.82:0/1166621500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d18101b50 0x7f5d18101fb0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5d080099c0 tx=0x7f5d08009cd0 comp rx=0 tx=0).stop 2023-09-23T08:54:37.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:37.904+0000 7f5d203ff700 1 -- 172.21.15.82:0/1166621500 shutdown_connections 2023-09-23T08:54:37.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:37.904+0000 7f5d203ff700 1 --2- 172.21.15.82:0/1166621500 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5d181024f0 0x7f5d18108da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:37.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:37.904+0000 7f5d203ff700 1 --2- 172.21.15.82:0/1166621500 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d18100960 0x7f5d18100d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:37.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:37.904+0000 7f5d203ff700 1 --2- 172.21.15.82:0/1166621500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d18101b50 0x7f5d18101fb0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:37.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:37.904+0000 7f5d203ff700 1 -- 172.21.15.82:0/1166621500 >> 172.21.15.82:0/1166621500 conn(0x7f5d180fbed0 msgr2=0x7f5d180fe310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:54:37.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:37.904+0000 7f5d203ff700 1 -- 172.21.15.82:0/1166621500 shutdown_connections 2023-09-23T08:54:37.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:37.904+0000 7f5d203ff700 1 -- 172.21.15.82:0/1166621500 wait complete. 2023-09-23T08:54:37.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:37.906+0000 7f5d203ff700 1 Processor -- start 2023-09-23T08:54:37.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:37.906+0000 7f5d203ff700 1 -- start start 2023-09-23T08:54:37.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:37.906+0000 7f5d203ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d18100960 0x7f5d18196480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:37.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:37.906+0000 7f5d203ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5d18101b50 0x7f5d181969c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:37.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:37.906+0000 7f5d203ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d181024f0 0x7f5d1819da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:37.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:37.906+0000 7f5d203ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d1819e000 con 0x7f5d18100960 2023-09-23T08:54:37.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:37.906+0000 7f5d203ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d1819e140 con 0x7f5d181024f0 2023-09-23T08:54:37.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:37.906+0000 7f5d203ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d1819e2d0 con 0x7f5d18101b50 2023-09-23T08:54:37.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:37.906+0000 7f5d1e19b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d18100960 0x7f5d18196480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:37.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:37.907+0000 7f5d1e19b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d18100960 0x7f5d18196480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51950/0 (socket says 172.21.15.82:51950) 2023-09-23T08:54:37.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:37.907+0000 7f5d1e19b700 1 -- 172.21.15.82:0/3503721871 learned_addr learned my addr 172.21.15.82:0/3503721871 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:54:37.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:37.907+0000 7f5d1e99c700 1 --2- 172.21.15.82:0/3503721871 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d181024f0 0x7f5d1819da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:37.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:37.907+0000 7f5d1e19b700 1 -- 172.21.15.82:0/3503721871 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5d18101b50 msgr2=0x7f5d181969c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:37.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:37.907+0000 7f5d1d99a700 1 --2- 172.21.15.82:0/3503721871 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5d18101b50 0x7f5d181969c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:37.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:37.907+0000 7f5d1e19b700 1 --2- 172.21.15.82:0/3503721871 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5d18101b50 0x7f5d181969c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:37.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:37.907+0000 7f5d1e19b700 1 -- 172.21.15.82:0/3503721871 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d181024f0 msgr2=0x7f5d1819da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:37.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:37.907+0000 7f5d1e19b700 1 --2- 172.21.15.82:0/3503721871 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d181024f0 0x7f5d1819da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:37.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:37.907+0000 7f5d1e19b700 1 -- 172.21.15.82:0/3503721871 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d080095f0 con 0x7f5d18100960 2023-09-23T08:54:37.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:37.907+0000 7f5d1d99a700 1 --2- 172.21.15.82:0/3503721871 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5d18101b50 0x7f5d181969c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T08:54:37.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:37.907+0000 7f5d1e19b700 1 --2- 172.21.15.82:0/3503721871 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d18100960 0x7f5d18196480 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5d1400d980 tx=0x7f5d1400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:54:37.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:37.907+0000 7f5d0f7fe700 1 -- 172.21.15.82:0/3503721871 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d14004020 con 0x7f5d18100960 2023-09-23T08:54:37.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:37.908+0000 7f5d0f7fe700 1 -- 172.21.15.82:0/3503721871 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5d14009730 con 0x7f5d18100960 2023-09-23T08:54:37.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:37.908+0000 7f5d203ff700 1 -- 172.21.15.82:0/3503721871 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d1819e5b0 con 0x7f5d18100960 2023-09-23T08:54:37.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:37.908+0000 7f5d0f7fe700 1 -- 172.21.15.82:0/3503721871 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d14003a00 con 0x7f5d18100960 2023-09-23T08:54:37.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:37.908+0000 7f5d203ff700 1 -- 172.21.15.82:0/3503721871 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d1819eac0 con 0x7f5d18100960 2023-09-23T08:54:37.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:37.909+0000 7f5d203ff700 1 -- 172.21.15.82:0/3503721871 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d1810c070 con 0x7f5d18100960 2023-09-23T08:54:37.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:37.911+0000 7f5d0f7fe700 1 -- 172.21.15.82:0/3503721871 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 134671+0+0 (secure 0 0 0) 0x7f5d140098a0 con 0x7f5d18100960 2023-09-23T08:54:37.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:37.913+0000 7f5d0f7fe700 1 --2- 172.21.15.82:0/3503721871 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f5d0409ffa0 0x7f5d040a2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:37.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:37.913+0000 7f5d0f7fe700 1 -- 172.21.15.82:0/3503721871 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f5d140caac0 con 0x7f5d18100960 2023-09-23T08:54:37.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:37.913+0000 7f5d1d99a700 1 --2- 172.21.15.82:0/3503721871 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f5d0409ffa0 0x7f5d040a2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:37.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:37.914+0000 7f5d1d99a700 1 --2- 172.21.15.82:0/3503721871 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f5d0409ffa0 0x7f5d040a2460 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5d08006010 tx=0x7f5d08000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:54:37.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:37.917+0000 7f5d0f7fe700 1 -- 172.21.15.82:0/3503721871 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f5d140cce60 con 0x7f5d18100960 2023-09-23T08:54:38.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:38.172+0000 7f5d203ff700 1 -- 172.21.15.82:0/3503721871 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5d18107810 con 0x7f5d18100960 2023-09-23T08:54:38.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:38.173+0000 7f5d0f7fe700 1 -- 172.21.15.82:0/3503721871 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+7661 (secure 0 0 0) 0x7f5d14094c90 con 0x7f5d18100960 2023-09-23T08:54:38.176 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:54:38.176 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/1237857359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1237857359},{"type":"v1","addr":"172.21.15.82:6835","nonce":1237857359}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/1335102362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":1335102362},{"type":"v1","addr":"172.21.15.82:6837","nonce":1335102362}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14598,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/3645331700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3645331700},{"type":"v1","addr":"172.21.15.135:6835","nonce":3645331700}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/503886037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":503886037},{"type":"v1","addr":"172.21.15.135:6833","nonce":503886037}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24463,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6833/471569125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":471569125},{"type":"v1","addr":"172.21.15.161:6833","nonce":471569125}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24514,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/2237964162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":2237964162},{"type":"v1","addr":"172.21.15.161:6835","nonce":2237964162}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24515,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2655304858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2655304858},{"type":"v1","addr":"172.21.15.135:6837","nonce":2655304858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24526,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/43639843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":43639843},{"type":"v1","addr":"172.21.15.161:6837","nonce":43639843}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24550,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6839/758982817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6838","nonce":758982817},{"type":"v1","addr":"172.21.15.161:6839","nonce":758982817}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[]} 2023-09-23T08:54:38.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:38.175+0000 7f5d203ff700 1 -- 172.21.15.82:0/3503721871 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f5d0409ffa0 msgr2=0x7f5d040a2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:38.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:38.175+0000 7f5d203ff700 1 --2- 172.21.15.82:0/3503721871 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f5d0409ffa0 0x7f5d040a2460 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5d08006010 tx=0x7f5d08000bc0 comp rx=0 tx=0).stop 2023-09-23T08:54:38.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:38.175+0000 7f5d203ff700 1 -- 172.21.15.82:0/3503721871 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d18100960 msgr2=0x7f5d18196480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:38.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:38.175+0000 7f5d203ff700 1 --2- 172.21.15.82:0/3503721871 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d18100960 0x7f5d18196480 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5d1400d980 tx=0x7f5d1400dc90 comp rx=0 tx=0).stop 2023-09-23T08:54:38.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:38.175+0000 7f5d203ff700 1 -- 172.21.15.82:0/3503721871 shutdown_connections 2023-09-23T08:54:38.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:38.175+0000 7f5d203ff700 1 --2- 172.21.15.82:0/3503721871 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f5d0409ffa0 0x7f5d040a2460 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:38.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:38.175+0000 7f5d203ff700 1 --2- 172.21.15.82:0/3503721871 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d181024f0 0x7f5d1819da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:38.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:38.175+0000 7f5d203ff700 1 --2- 172.21.15.82:0/3503721871 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d18100960 0x7f5d18196480 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:38.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:38.175+0000 7f5d203ff700 1 --2- 172.21.15.82:0/3503721871 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5d18101b50 0x7f5d181969c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:38.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:38.175+0000 7f5d203ff700 1 -- 172.21.15.82:0/3503721871 >> 172.21.15.82:0/3503721871 conn(0x7f5d180fbed0 msgr2=0x7f5d180fe0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:54:38.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:38.176+0000 7f5d203ff700 1 -- 172.21.15.82:0/3503721871 shutdown_connections 2023-09-23T08:54:38.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:38.176+0000 7f5d203ff700 1 -- 172.21.15.82:0/3503721871 wait complete. 2023-09-23T08:54:38.179 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 10 2023-09-23T08:54:38.767 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:38 smithi082 ceph-mon[97694]: Deploying daemon mds.g on smithi082 2023-09-23T08:54:38.768 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:38 smithi082 ceph-mon[97694]: mds.? [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] up:boot 2023-09-23T08:54:38.768 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:38 smithi082 ceph-mon[97694]: fsmap 9 up:standby 2023-09-23T08:54:38.768 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:38 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-09-23T08:54:38.768 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:38 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/3503721871' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T08:54:38.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:38 smithi135 ceph-mon[99205]: Deploying daemon mds.g on smithi082 2023-09-23T08:54:38.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:38 smithi135 ceph-mon[99205]: mds.? [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] up:boot 2023-09-23T08:54:38.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:38 smithi135 ceph-mon[99205]: fsmap 9 up:standby 2023-09-23T08:54:38.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:38 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-09-23T08:54:38.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:38 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/3503721871' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T08:54:38.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:38 smithi161 ceph-mon[99580]: Deploying daemon mds.g on smithi082 2023-09-23T08:54:38.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:38 smithi161 ceph-mon[99580]: mds.? [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] up:boot 2023-09-23T08:54:38.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:38 smithi161 ceph-mon[99580]: fsmap 9 up:standby 2023-09-23T08:54:38.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:38 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-09-23T08:54:38.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:38 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/3503721871' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T08:54:39.120 INFO:journalctl@ceph.mds.g.smithi082.stdout:Sep 23 08:54:38 smithi082 systemd[1]: Starting Ceph mds.g for 8926e286-59ed-11ee-8db4-212e2dc638e7... 2023-09-23T08:54:39.506 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:39 smithi082 ceph-mon[97694]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:54:39.506 INFO:journalctl@ceph.mds.g.smithi082.stdout:Sep 23 08:54:39 smithi082 podman[132488]: 2023-09-23T08:54:39.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:39 smithi135 ceph-mon[99205]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:54:39.870 INFO:journalctl@ceph.mds.g.smithi082.stdout:Sep 23 08:54:39 smithi082 ceph-mds[132528]: -- 172.21.15.82:0/1075025969 <== mon.0 v2:172.21.15.82:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55c52f35f1e0 con 0x55c52f335000 2023-09-23T08:54:39.870 INFO:journalctl@ceph.mds.g.smithi082.stdout:Sep 23 08:54:39 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mds-g[132504]: starting mds.g at 2023-09-23T08:54:39.871 INFO:journalctl@ceph.mds.g.smithi082.stdout:Sep 23 08:54:39 smithi082 bash[132488]: 1f6a848f10ef347fa2dd67491e7c00d0ddbe001b68952850bfd60c6851d7b8f5 2023-09-23T08:54:39.871 INFO:journalctl@ceph.mds.g.smithi082.stdout:Sep 23 08:54:39 smithi082 systemd[1]: Started Ceph mds.g for 8926e286-59ed-11ee-8db4-212e2dc638e7. 2023-09-23T08:54:39.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:39 smithi161 ceph-mon[99580]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:54:40.198 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-23T08:54:40.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:40.417+0000 7fbe2a9ff700 1 -- 172.21.15.82:0/2722415672 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe24101b20 msgr2=0x7fbe24101f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:40.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:40.417+0000 7fbe2a9ff700 1 --2- 172.21.15.82:0/2722415672 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe24101b20 0x7fbe24101f80 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c0099c0 tx=0x7fbe0c009cd0 comp rx=0 tx=0).stop 2023-09-23T08:54:40.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:40.417+0000 7fbe2a9ff700 1 -- 172.21.15.82:0/2722415672 shutdown_connections 2023-09-23T08:54:40.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:40.417+0000 7fbe2a9ff700 1 --2- 172.21.15.82:0/2722415672 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbe241024c0 0x7fbe24108d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:40.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:40.417+0000 7fbe2a9ff700 1 --2- 172.21.15.82:0/2722415672 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe24100930 0x7fbe24100d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:40.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:40.417+0000 7fbe2a9ff700 1 --2- 172.21.15.82:0/2722415672 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe24101b20 0x7fbe24101f80 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:40.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:40.417+0000 7fbe2a9ff700 1 -- 172.21.15.82:0/2722415672 >> 172.21.15.82:0/2722415672 conn(0x7fbe240fbe60 msgr2=0x7fbe240fe2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:54:40.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:40.417+0000 7fbe2a9ff700 1 -- 172.21.15.82:0/2722415672 shutdown_connections 2023-09-23T08:54:40.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:40.417+0000 7fbe2a9ff700 1 -- 172.21.15.82:0/2722415672 wait complete. 2023-09-23T08:54:40.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:40.418+0000 7fbe2a9ff700 1 Processor -- start 2023-09-23T08:54:40.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:40.418+0000 7fbe2a9ff700 1 -- start start 2023-09-23T08:54:40.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:40.418+0000 7fbe2a9ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe24100930 0x7fbe24196430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:40.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:40.418+0000 7fbe2a9ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe24101b20 0x7fbe24196970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:40.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:40.418+0000 7fbe2a9ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbe241024c0 0x7fbe2419d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:40.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:40.418+0000 7fbe2a9ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe2419dfb0 con 0x7fbe24100930 2023-09-23T08:54:40.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:40.418+0000 7fbe2a9ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe2419e0f0 con 0x7fbe24101b20 2023-09-23T08:54:40.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:40.418+0000 7fbe2a9ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe2419e280 con 0x7fbe241024c0 2023-09-23T08:54:40.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:40.418+0000 7fbe23fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe24100930 0x7fbe24196430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:40.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:40.419+0000 7fbe23fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe24100930 0x7fbe24196430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52002/0 (socket says 172.21.15.82:52002) 2023-09-23T08:54:40.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:40.419+0000 7fbe23fff700 1 -- 172.21.15.82:0/3653150252 learned_addr learned my addr 172.21.15.82:0/3653150252 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:54:40.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:40.419+0000 7fbe1bfff700 1 --2- 172.21.15.82:0/3653150252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe24101b20 0x7fbe24196970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:40.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:40.419+0000 7fbe28f9c700 1 --2- 172.21.15.82:0/3653150252 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbe241024c0 0x7fbe2419d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:40.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:40.419+0000 7fbe23fff700 1 -- 172.21.15.82:0/3653150252 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbe241024c0 msgr2=0x7fbe2419d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:40.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:40.419+0000 7fbe23fff700 1 --2- 172.21.15.82:0/3653150252 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbe241024c0 0x7fbe2419d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:40.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:40.419+0000 7fbe23fff700 1 -- 172.21.15.82:0/3653150252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe24101b20 msgr2=0x7fbe24196970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:40.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:40.419+0000 7fbe23fff700 1 --2- 172.21.15.82:0/3653150252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe24101b20 0x7fbe24196970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:40.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:40.419+0000 7fbe23fff700 1 -- 172.21.15.82:0/3653150252 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe0c0095f0 con 0x7fbe24100930 2023-09-23T08:54:40.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:40.419+0000 7fbe1bfff700 1 --2- 172.21.15.82:0/3653150252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe24101b20 0x7fbe24196970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T08:54:40.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:40.419+0000 7fbe28f9c700 1 --2- 172.21.15.82:0/3653150252 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbe241024c0 0x7fbe2419d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T08:54:40.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:40.419+0000 7fbe23fff700 1 --2- 172.21.15.82:0/3653150252 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe24100930 0x7fbe24196430 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fbe1400c990 tx=0x7fbe1400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:54:40.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:40.419+0000 7fbe21ffb700 1 -- 172.21.15.82:0/3653150252 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe14007b00 con 0x7fbe24100930 2023-09-23T08:54:40.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:40.419+0000 7fbe21ffb700 1 -- 172.21.15.82:0/3653150252 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbe14007c60 con 0x7fbe24100930 2023-09-23T08:54:40.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:40.419+0000 7fbe2a9ff700 1 -- 172.21.15.82:0/3653150252 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe2419e560 con 0x7fbe24100930 2023-09-23T08:54:40.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:40.419+0000 7fbe21ffb700 1 -- 172.21.15.82:0/3653150252 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe14018660 con 0x7fbe24100930 2023-09-23T08:54:40.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:40.420+0000 7fbe2a9ff700 1 -- 172.21.15.82:0/3653150252 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe2419eac0 con 0x7fbe24100930 2023-09-23T08:54:40.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:40.421+0000 7fbe2a9ff700 1 -- 172.21.15.82:0/3653150252 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe2410bff0 con 0x7fbe24100930 2023-09-23T08:54:40.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:40.423+0000 7fbe21ffb700 1 -- 172.21.15.82:0/3653150252 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 134671+0+0 (secure 0 0 0) 0x7fbe1400f450 con 0x7fbe24100930 2023-09-23T08:54:40.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:40.424+0000 7fbe21ffb700 1 --2- 172.21.15.82:0/3653150252 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fbe100a0020 0x7fbe100a24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:40.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:40.424+0000 7fbe21ffb700 1 -- 172.21.15.82:0/3653150252 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fbe140cae00 con 0x7fbe24100930 2023-09-23T08:54:40.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:40.424+0000 7fbe1bfff700 1 --2- 172.21.15.82:0/3653150252 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fbe100a0020 0x7fbe100a24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:40.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:40.425+0000 7fbe1bfff700 1 --2- 172.21.15.82:0/3653150252 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fbe100a0020 0x7fbe100a24e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c00c010 tx=0x7fbe0c005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:54:40.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:40.428+0000 7fbe21ffb700 1 -- 172.21.15.82:0/3653150252 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7fbe14094f90 con 0x7fbe24100930 2023-09-23T08:54:40.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:40.706+0000 7fbe2a9ff700 1 -- 172.21.15.82:0/3653150252 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbe241077c0 con 0x7fbe24100930 2023-09-23T08:54:40.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:40.707+0000 7fbe21ffb700 1 -- 172.21.15.82:0/3653150252 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+8450 (secure 0 0 0) 0x7fbe140985b0 con 0x7fbe24100930 2023-09-23T08:54:40.710 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:54:40.710 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/1237857359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1237857359},{"type":"v1","addr":"172.21.15.82:6835","nonce":1237857359}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/1335102362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":1335102362},{"type":"v1","addr":"172.21.15.82:6837","nonce":1335102362}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14598,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/3645331700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3645331700},{"type":"v1","addr":"172.21.15.135:6835","nonce":3645331700}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":14658,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6839/205725278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":205725278},{"type":"v1","addr":"172.21.15.82:6839","nonce":205725278}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/503886037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":503886037},{"type":"v1","addr":"172.21.15.135:6833","nonce":503886037}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24463,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6833/471569125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":471569125},{"type":"v1","addr":"172.21.15.161:6833","nonce":471569125}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24514,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/2237964162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":2237964162},{"type":"v1","addr":"172.21.15.161:6835","nonce":2237964162}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24515,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2655304858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2655304858},{"type":"v1","addr":"172.21.15.135:6837","nonce":2655304858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24526,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/43639843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":43639843},{"type":"v1","addr":"172.21.15.161:6837","nonce":43639843}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24550,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6839/758982817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6838","nonce":758982817},{"type":"v1","addr":"172.21.15.161:6839","nonce":758982817}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[]} 2023-09-23T08:54:40.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:40.710+0000 7fbe2a9ff700 1 -- 172.21.15.82:0/3653150252 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fbe100a0020 msgr2=0x7fbe100a24e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:40.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:40.710+0000 7fbe2a9ff700 1 --2- 172.21.15.82:0/3653150252 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fbe100a0020 0x7fbe100a24e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c00c010 tx=0x7fbe0c005fd0 comp rx=0 tx=0).stop 2023-09-23T08:54:40.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:40.710+0000 7fbe2a9ff700 1 -- 172.21.15.82:0/3653150252 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe24100930 msgr2=0x7fbe24196430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:40.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:40.710+0000 7fbe2a9ff700 1 --2- 172.21.15.82:0/3653150252 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe24100930 0x7fbe24196430 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fbe1400c990 tx=0x7fbe1400cd50 comp rx=0 tx=0).stop 2023-09-23T08:54:40.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:40.710+0000 7fbe2a9ff700 1 -- 172.21.15.82:0/3653150252 shutdown_connections 2023-09-23T08:54:40.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:40.710+0000 7fbe2a9ff700 1 --2- 172.21.15.82:0/3653150252 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fbe100a0020 0x7fbe100a24e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:40.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:40.710+0000 7fbe2a9ff700 1 --2- 172.21.15.82:0/3653150252 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbe241024c0 0x7fbe2419d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:40.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:40.710+0000 7fbe2a9ff700 1 --2- 172.21.15.82:0/3653150252 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe24100930 0x7fbe24196430 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:40.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:40.710+0000 7fbe2a9ff700 1 --2- 172.21.15.82:0/3653150252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe24101b20 0x7fbe24196970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:40.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:40.710+0000 7fbe2a9ff700 1 -- 172.21.15.82:0/3653150252 >> 172.21.15.82:0/3653150252 conn(0x7fbe240fbe60 msgr2=0x7fbe240fe050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:54:40.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:40.710+0000 7fbe2a9ff700 1 -- 172.21.15.82:0/3653150252 shutdown_connections 2023-09-23T08:54:40.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:40.710+0000 7fbe2a9ff700 1 -- 172.21.15.82:0/3653150252 wait complete. 2023-09-23T08:54:40.714 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 11 2023-09-23T08:54:40.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:40 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:40.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:40 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:40.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:40 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:40.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:40 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-23T08:54:40.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:40 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-23T08:54:40.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:40 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:54:40.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:40 smithi082 ceph-mon[97694]: Deploying daemon mds.a on smithi082 2023-09-23T08:54:40.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:40 smithi082 ceph-mon[97694]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:54:40.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:40 smithi082 ceph-mon[97694]: mds.? [v2:172.21.15.82:6838/205725278,v1:172.21.15.82:6839/205725278] up:boot 2023-09-23T08:54:40.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:40 smithi082 ceph-mon[97694]: fsmap 10 up:standby 2023-09-23T08:54:40.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:40 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-09-23T08:54:40.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:40 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:40.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:40 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:40.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:40 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:40.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:40 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-23T08:54:40.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:40 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-23T08:54:40.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:40 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:54:40.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:40 smithi161 ceph-mon[99580]: Deploying daemon mds.a on smithi082 2023-09-23T08:54:40.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:40 smithi161 ceph-mon[99580]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:54:40.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:40 smithi161 ceph-mon[99580]: mds.? [v2:172.21.15.82:6838/205725278,v1:172.21.15.82:6839/205725278] up:boot 2023-09-23T08:54:40.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:40 smithi161 ceph-mon[99580]: fsmap 10 up:standby 2023-09-23T08:54:40.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:40 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-09-23T08:54:41.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:40 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:41.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:40 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:41.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:40 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:41.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:40 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-23T08:54:41.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:40 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-23T08:54:41.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:40 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:54:41.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:40 smithi135 ceph-mon[99205]: Deploying daemon mds.a on smithi082 2023-09-23T08:54:41.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:40 smithi135 ceph-mon[99205]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:54:41.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:40 smithi135 ceph-mon[99205]: mds.? [v2:172.21.15.82:6838/205725278,v1:172.21.15.82:6839/205725278] up:boot 2023-09-23T08:54:41.064 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:40 smithi135 ceph-mon[99205]: fsmap 10 up:standby 2023-09-23T08:54:41.064 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:40 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-09-23T08:54:41.982 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:41 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/3653150252' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T08:54:42.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:41 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/3653150252' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T08:54:42.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:41 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/3653150252' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T08:54:42.370 INFO:journalctl@ceph.mds.a.smithi082.stdout:Sep 23 08:54:41 smithi082 systemd[1]: Starting Ceph mds.a for 8926e286-59ed-11ee-8db4-212e2dc638e7... 2023-09-23T08:54:42.706 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:42 smithi082 ceph-mon[97694]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:54:42.706 INFO:journalctl@ceph.mds.a.smithi082.stdout:Sep 23 08:54:42 smithi082 podman[132879]: 2023-09-23T08:54:42.737 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-23T08:54:42.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:42.949+0000 7f0466fff700 1 -- 172.21.15.82:0/2481212229 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0460100930 msgr2=0x7f0460100d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:42.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:42.949+0000 7f0466fff700 1 --2- 172.21.15.82:0/2481212229 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0460100930 0x7f0460100d50 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f04540099c0 tx=0x7f0454009cd0 comp rx=0 tx=0).stop 2023-09-23T08:54:42.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:42.949+0000 7f0466fff700 1 -- 172.21.15.82:0/2481212229 shutdown_connections 2023-09-23T08:54:42.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:42.949+0000 7f0466fff700 1 --2- 172.21.15.82:0/2481212229 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04601024c0 0x7f0460108d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:42.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:42.949+0000 7f0466fff700 1 --2- 172.21.15.82:0/2481212229 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0460100930 0x7f0460100d50 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:42.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:42.949+0000 7f0466fff700 1 --2- 172.21.15.82:0/2481212229 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0460101b20 0x7f0460101f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:42.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:42.949+0000 7f0466fff700 1 -- 172.21.15.82:0/2481212229 >> 172.21.15.82:0/2481212229 conn(0x7f04600fbe60 msgr2=0x7f04600fe2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:54:42.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:42.949+0000 7f0466fff700 1 -- 172.21.15.82:0/2481212229 shutdown_connections 2023-09-23T08:54:42.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:42.949+0000 7f0466fff700 1 -- 172.21.15.82:0/2481212229 wait complete. 2023-09-23T08:54:42.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:42.950+0000 7f0466fff700 1 Processor -- start 2023-09-23T08:54:42.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:42.950+0000 7f0466fff700 1 -- start start 2023-09-23T08:54:42.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:42.950+0000 7f0466fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0460100930 0x7f0460198750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:42.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:42.951+0000 7f0466fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0460101b20 0x7f0460198c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:42.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:42.951+0000 7f0466fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f04601024c0 0x7f046019fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:42.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:42.951+0000 7f0466fff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04601a02d0 con 0x7f04601024c0 2023-09-23T08:54:42.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:42.951+0000 7f0466fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04601a0410 con 0x7f0460101b20 2023-09-23T08:54:42.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:42.951+0000 7f0466fff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04601a05a0 con 0x7f0460100930 2023-09-23T08:54:42.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:42.951+0000 7f046559c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f04601024c0 0x7f046019fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:42.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:42.951+0000 7f046559c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f04601024c0 0x7f046019fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52236/0 (socket says 172.21.15.82:52236) 2023-09-23T08:54:42.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:42.951+0000 7f046559c700 1 -- 172.21.15.82:0/2468161063 learned_addr learned my addr 172.21.15.82:0/2468161063 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:54:42.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:42.951+0000 7f045ffff700 1 --2- 172.21.15.82:0/2468161063 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0460101b20 0x7f0460198c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:42.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:42.951+0000 7f0464d9b700 1 --2- 172.21.15.82:0/2468161063 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0460100930 0x7f0460198750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:42.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:42.951+0000 7f046559c700 1 -- 172.21.15.82:0/2468161063 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0460100930 msgr2=0x7f0460198750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:42.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:42.951+0000 7f046559c700 1 --2- 172.21.15.82:0/2468161063 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0460100930 0x7f0460198750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:42.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:42.951+0000 7f046559c700 1 -- 172.21.15.82:0/2468161063 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0460101b20 msgr2=0x7f0460198c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:42.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:42.951+0000 7f046559c700 1 --2- 172.21.15.82:0/2468161063 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0460101b20 0x7f0460198c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:42.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:42.951+0000 7f046559c700 1 -- 172.21.15.82:0/2468161063 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04540095f0 con 0x7f04601024c0 2023-09-23T08:54:42.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:42.951+0000 7f0464d9b700 1 --2- 172.21.15.82:0/2468161063 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0460100930 0x7f0460198750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T08:54:42.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:42.952+0000 7f046559c700 1 --2- 172.21.15.82:0/2468161063 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f04601024c0 0x7f046019fd00 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f045800ef30 tx=0x7f045800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:54:42.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:42.952+0000 7f045dffb700 1 -- 172.21.15.82:0/2468161063 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0458018070 con 0x7f04601024c0 2023-09-23T08:54:42.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:42.952+0000 7f045dffb700 1 -- 172.21.15.82:0/2468161063 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f045800f040 con 0x7f04601024c0 2023-09-23T08:54:42.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:42.952+0000 7f0466fff700 1 -- 172.21.15.82:0/2468161063 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04601a0820 con 0x7f04601024c0 2023-09-23T08:54:42.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:42.952+0000 7f045dffb700 1 -- 172.21.15.82:0/2468161063 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f045800cc70 con 0x7f04601024c0 2023-09-23T08:54:42.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:42.952+0000 7f0466fff700 1 -- 172.21.15.82:0/2468161063 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04601a0d30 con 0x7f04601024c0 2023-09-23T08:54:42.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:42.953+0000 7f0466fff700 1 -- 172.21.15.82:0/2468161063 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f046010c040 con 0x7f04601024c0 2023-09-23T08:54:42.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:42.955+0000 7f045dffb700 1 -- 172.21.15.82:0/2468161063 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 134671+0+0 (secure 0 0 0) 0x7f0458007500 con 0x7f04601024c0 2023-09-23T08:54:42.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:42.956+0000 7f045dffb700 1 --2- 172.21.15.82:0/2468161063 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f04500a0020 0x7f04500a24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:42.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:42.956+0000 7f045dffb700 1 -- 172.21.15.82:0/2468161063 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f04580ca9a0 con 0x7f04601024c0 2023-09-23T08:54:42.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:42.956+0000 7f0464d9b700 1 --2- 172.21.15.82:0/2468161063 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f04500a0020 0x7f04500a24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:42.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:42.957+0000 7f0464d9b700 1 --2- 172.21.15.82:0/2468161063 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f04500a0020 0x7f04500a24e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0454009990 tx=0x7f045401a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:54:42.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:42.961+0000 7f045dffb700 1 -- 172.21.15.82:0/2468161063 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f0458094bc0 con 0x7f04601024c0 2023-09-23T08:54:43.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:42 smithi135 ceph-mon[99205]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:54:43.121 INFO:journalctl@ceph.mds.a.smithi082.stdout:Sep 23 08:54:42 smithi082 bash[132879]: d4a368dd8c1b90accfb1e6d32225d6d947a31c188c7069d08c429b200cd1d6dc 2023-09-23T08:54:43.121 INFO:journalctl@ceph.mds.a.smithi082.stdout:Sep 23 08:54:42 smithi082 ceph-mds[132927]: -- 172.21.15.82:0/716294691 <== mon.0 v2:172.21.15.82:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56010b24d1e0 con 0x56010b222800 2023-09-23T08:54:43.121 INFO:journalctl@ceph.mds.a.smithi082.stdout:Sep 23 08:54:42 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mds-a[132903]: starting mds.a at 2023-09-23T08:54:43.121 INFO:journalctl@ceph.mds.a.smithi082.stdout:Sep 23 08:54:42 smithi082 systemd[1]: Started Ceph mds.a for 8926e286-59ed-11ee-8db4-212e2dc638e7. 2023-09-23T08:54:43.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:42 smithi161 ceph-mon[99580]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:54:43.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:43.202+0000 7f0466fff700 1 -- 172.21.15.82:0/2468161063 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f046010c230 con 0x7f04601024c0 2023-09-23T08:54:43.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:43.202+0000 7f045dffb700 1 -- 172.21.15.82:0/2468161063 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+8450 (secure 0 0 0) 0x7f04580981e0 con 0x7f04601024c0 2023-09-23T08:54:43.205 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:54:43.205 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/1237857359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1237857359},{"type":"v1","addr":"172.21.15.82:6835","nonce":1237857359}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/1335102362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":1335102362},{"type":"v1","addr":"172.21.15.82:6837","nonce":1335102362}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14598,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/3645331700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3645331700},{"type":"v1","addr":"172.21.15.135:6835","nonce":3645331700}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":14658,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6839/205725278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":205725278},{"type":"v1","addr":"172.21.15.82:6839","nonce":205725278}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/503886037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":503886037},{"type":"v1","addr":"172.21.15.135:6833","nonce":503886037}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24463,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6833/471569125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":471569125},{"type":"v1","addr":"172.21.15.161:6833","nonce":471569125}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24514,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/2237964162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":2237964162},{"type":"v1","addr":"172.21.15.161:6835","nonce":2237964162}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24515,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2655304858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2655304858},{"type":"v1","addr":"172.21.15.135:6837","nonce":2655304858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24526,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/43639843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":43639843},{"type":"v1","addr":"172.21.15.161:6837","nonce":43639843}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24550,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6839/758982817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6838","nonce":758982817},{"type":"v1","addr":"172.21.15.161:6839","nonce":758982817}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[]} 2023-09-23T08:54:43.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:43.205+0000 7f0466fff700 1 -- 172.21.15.82:0/2468161063 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f04500a0020 msgr2=0x7f04500a24e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:43.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:43.205+0000 7f0466fff700 1 --2- 172.21.15.82:0/2468161063 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f04500a0020 0x7f04500a24e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0454009990 tx=0x7f045401a040 comp rx=0 tx=0).stop 2023-09-23T08:54:43.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:43.205+0000 7f0466fff700 1 -- 172.21.15.82:0/2468161063 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f04601024c0 msgr2=0x7f046019fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:43.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:43.205+0000 7f0466fff700 1 --2- 172.21.15.82:0/2468161063 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f04601024c0 0x7f046019fd00 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f045800ef30 tx=0x7f045800c3a0 comp rx=0 tx=0).stop 2023-09-23T08:54:43.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:43.205+0000 7f0466fff700 1 -- 172.21.15.82:0/2468161063 shutdown_connections 2023-09-23T08:54:43.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:43.205+0000 7f0466fff700 1 --2- 172.21.15.82:0/2468161063 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f04500a0020 0x7f04500a24e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:43.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:43.205+0000 7f0466fff700 1 --2- 172.21.15.82:0/2468161063 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f04601024c0 0x7f046019fd00 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:43.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:43.205+0000 7f0466fff700 1 --2- 172.21.15.82:0/2468161063 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0460100930 0x7f0460198750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:43.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:43.205+0000 7f0466fff700 1 --2- 172.21.15.82:0/2468161063 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0460101b20 0x7f0460198c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:43.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:43.205+0000 7f0466fff700 1 -- 172.21.15.82:0/2468161063 >> 172.21.15.82:0/2468161063 conn(0x7f04600fbe60 msgr2=0x7f04600fe120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:54:43.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:43.205+0000 7f0466fff700 1 -- 172.21.15.82:0/2468161063 shutdown_connections 2023-09-23T08:54:43.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:43.205+0000 7f0466fff700 1 -- 172.21.15.82:0/2468161063 wait complete. 2023-09-23T08:54:43.210 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 11 2023-09-23T08:54:44.048 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:43 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:44.048 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:43 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:44.048 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:43 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:44.048 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:43 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-23T08:54:44.049 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:43 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-23T08:54:44.049 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:43 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:54:44.049 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:43 smithi135 ceph-mon[99205]: Deploying daemon mds.b on smithi135 2023-09-23T08:54:44.049 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:43 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/2468161063' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T08:54:44.049 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:43 smithi135 ceph-mon[99205]: mds.? [v2:172.21.15.82:6840/2659297867,v1:172.21.15.82:6841/2659297867] up:boot 2023-09-23T08:54:44.049 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:43 smithi135 ceph-mon[99205]: fsmap 11 up:standby 2023-09-23T08:54:44.049 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:43 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-09-23T08:54:44.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:43 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:44.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:43 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:44.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:43 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:44.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:43 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-23T08:54:44.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:43 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-23T08:54:44.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:43 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:54:44.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:43 smithi082 ceph-mon[97694]: Deploying daemon mds.b on smithi135 2023-09-23T08:54:44.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:43 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/2468161063' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T08:54:44.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:43 smithi082 ceph-mon[97694]: mds.? [v2:172.21.15.82:6840/2659297867,v1:172.21.15.82:6841/2659297867] up:boot 2023-09-23T08:54:44.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:43 smithi082 ceph-mon[97694]: fsmap 11 up:standby 2023-09-23T08:54:44.122 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:43 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-09-23T08:54:44.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:43 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:44.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:43 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:44.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:43 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:44.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:43 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-23T08:54:44.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:43 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-23T08:54:44.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:43 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:54:44.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:43 smithi161 ceph-mon[99580]: Deploying daemon mds.b on smithi135 2023-09-23T08:54:44.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:43 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/2468161063' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T08:54:44.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:43 smithi161 ceph-mon[99580]: mds.? [v2:172.21.15.82:6840/2659297867,v1:172.21.15.82:6841/2659297867] up:boot 2023-09-23T08:54:44.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:43 smithi161 ceph-mon[99580]: fsmap 11 up:standby 2023-09-23T08:54:44.150 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:43 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-09-23T08:54:45.041 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:44 smithi135 ceph-mon[99205]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:54:45.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:44 smithi082 ceph-mon[97694]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:54:45.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:44 smithi161 ceph-mon[99580]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:54:45.228 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-23T08:54:45.312 INFO:journalctl@ceph.mds.b.smithi135.stdout:Sep 23 08:54:45 smithi135 systemd[1]: Starting Ceph mds.b for 8926e286-59ed-11ee-8db4-212e2dc638e7... 2023-09-23T08:54:45.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:45.434+0000 7fcbfafff700 1 -- 172.21.15.82:0/2081264167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbf4101b20 msgr2=0x7fcbf4101f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:45.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:45.434+0000 7fcbfafff700 1 --2- 172.21.15.82:0/2081264167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbf4101b20 0x7fcbf4101f80 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fcbe00099c0 tx=0x7fcbe0009cd0 comp rx=0 tx=0).stop 2023-09-23T08:54:45.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:45.434+0000 7fcbfafff700 1 -- 172.21.15.82:0/2081264167 shutdown_connections 2023-09-23T08:54:45.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:45.434+0000 7fcbfafff700 1 --2- 172.21.15.82:0/2081264167 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcbf41024c0 0x7fcbf4108d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:45.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:45.434+0000 7fcbfafff700 1 --2- 172.21.15.82:0/2081264167 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcbf4100930 0x7fcbf4100d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:45.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:45.434+0000 7fcbfafff700 1 --2- 172.21.15.82:0/2081264167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbf4101b20 0x7fcbf4101f80 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:45.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:45.434+0000 7fcbfafff700 1 -- 172.21.15.82:0/2081264167 >> 172.21.15.82:0/2081264167 conn(0x7fcbf40fbe60 msgr2=0x7fcbf40fe2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:54:45.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:45.435+0000 7fcbfafff700 1 -- 172.21.15.82:0/2081264167 shutdown_connections 2023-09-23T08:54:45.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:45.435+0000 7fcbfafff700 1 -- 172.21.15.82:0/2081264167 wait complete. 2023-09-23T08:54:45.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:45.435+0000 7fcbfafff700 1 Processor -- start 2023-09-23T08:54:45.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:45.436+0000 7fcbfafff700 1 -- start start 2023-09-23T08:54:45.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:45.436+0000 7fcbfafff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcbf4100930 0x7fcbf4196520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:45.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:45.436+0000 7fcbfafff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcbf4101b20 0x7fcbf4196a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:45.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:45.436+0000 7fcbfafff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbf41024c0 0x7fcbf419dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:45.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:45.436+0000 7fcbfafff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf419e0a0 con 0x7fcbf41024c0 2023-09-23T08:54:45.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:45.436+0000 7fcbfafff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf419e1e0 con 0x7fcbf4100930 2023-09-23T08:54:45.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:45.436+0000 7fcbfafff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf419e370 con 0x7fcbf4101b20 2023-09-23T08:54:45.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:45.436+0000 7fcbf959c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbf41024c0 0x7fcbf419dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:45.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:45.436+0000 7fcbf959c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbf41024c0 0x7fcbf419dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52254/0 (socket says 172.21.15.82:52254) 2023-09-23T08:54:45.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:45.436+0000 7fcbf959c700 1 -- 172.21.15.82:0/359389770 learned_addr learned my addr 172.21.15.82:0/359389770 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:54:45.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:45.436+0000 7fcbf3fff700 1 --2- 172.21.15.82:0/359389770 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcbf4101b20 0x7fcbf4196a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:45.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:45.436+0000 7fcbf8d9b700 1 --2- 172.21.15.82:0/359389770 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcbf4100930 0x7fcbf4196520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:45.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:45.437+0000 7fcbf959c700 1 -- 172.21.15.82:0/359389770 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcbf4101b20 msgr2=0x7fcbf4196a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:45.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:45.437+0000 7fcbf959c700 1 --2- 172.21.15.82:0/359389770 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcbf4101b20 0x7fcbf4196a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:45.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:45.437+0000 7fcbf959c700 1 -- 172.21.15.82:0/359389770 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcbf4100930 msgr2=0x7fcbf4196520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:45.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:45.437+0000 7fcbf959c700 1 --2- 172.21.15.82:0/359389770 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcbf4100930 0x7fcbf4196520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:45.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:45.437+0000 7fcbf959c700 1 -- 172.21.15.82:0/359389770 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbe00095f0 con 0x7fcbf41024c0 2023-09-23T08:54:45.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:45.437+0000 7fcbf8d9b700 1 --2- 172.21.15.82:0/359389770 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcbf4100930 0x7fcbf4196520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T08:54:45.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:45.437+0000 7fcbf959c700 1 --2- 172.21.15.82:0/359389770 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbf41024c0 0x7fcbf419dad0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fcbec007ee0 tx=0x7fcbec00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:54:45.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:45.437+0000 7fcbf1ffb700 1 -- 172.21.15.82:0/359389770 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbec00ddd0 con 0x7fcbf41024c0 2023-09-23T08:54:45.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:45.437+0000 7fcbfafff700 1 -- 172.21.15.82:0/359389770 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbf419e650 con 0x7fcbf41024c0 2023-09-23T08:54:45.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:45.437+0000 7fcbf1ffb700 1 -- 172.21.15.82:0/359389770 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcbec00f040 con 0x7fcbf41024c0 2023-09-23T08:54:45.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:45.437+0000 7fcbf1ffb700 1 -- 172.21.15.82:0/359389770 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbec004870 con 0x7fcbf41024c0 2023-09-23T08:54:45.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:45.437+0000 7fcbfafff700 1 -- 172.21.15.82:0/359389770 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbf419eb60 con 0x7fcbf41024c0 2023-09-23T08:54:45.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:45.438+0000 7fcbfafff700 1 -- 172.21.15.82:0/359389770 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbf410c040 con 0x7fcbf41024c0 2023-09-23T08:54:45.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:45.440+0000 7fcbf1ffb700 1 -- 172.21.15.82:0/359389770 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 134671+0+0 (secure 0 0 0) 0x7fcbec003a00 con 0x7fcbf41024c0 2023-09-23T08:54:45.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:45.441+0000 7fcbf1ffb700 1 --2- 172.21.15.82:0/359389770 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fcbe409ffa0 0x7fcbe40a2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:45.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:45.441+0000 7fcbf1ffb700 1 -- 172.21.15.82:0/359389770 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fcbec0ca7d0 con 0x7fcbf41024c0 2023-09-23T08:54:45.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:45.441+0000 7fcbf8d9b700 1 --2- 172.21.15.82:0/359389770 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fcbe409ffa0 0x7fcbe40a2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:45.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:45.442+0000 7fcbf8d9b700 1 --2- 172.21.15.82:0/359389770 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fcbe409ffa0 0x7fcbe40a2460 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fcbf4101980 tx=0x7fcbe8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:54:45.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:45.445+0000 7fcbf1ffb700 1 -- 172.21.15.82:0/359389770 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7fcbec094960 con 0x7fcbf41024c0 2023-09-23T08:54:45.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:45.688+0000 7fcbfafff700 1 -- 172.21.15.82:0/359389770 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcbf410c200 con 0x7fcbf41024c0 2023-09-23T08:54:45.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:45.689+0000 7fcbf1ffb700 1 -- 172.21.15.82:0/359389770 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+9242 (secure 0 0 0) 0x7fcbec097f80 con 0x7fcbf41024c0 2023-09-23T08:54:45.691 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:54:45.691 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/1237857359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1237857359},{"type":"v1","addr":"172.21.15.82:6835","nonce":1237857359}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/1335102362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":1335102362},{"type":"v1","addr":"172.21.15.82:6837","nonce":1335102362}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14598,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/3645331700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3645331700},{"type":"v1","addr":"172.21.15.135:6835","nonce":3645331700}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":14658,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6839/205725278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":205725278},{"type":"v1","addr":"172.21.15.82:6839","nonce":205725278}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14670,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6841/2659297867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":2659297867},{"type":"v1","addr":"172.21.15.82:6841","nonce":2659297867}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/503886037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":503886037},{"type":"v1","addr":"172.21.15.135:6833","nonce":503886037}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24463,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6833/471569125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":471569125},{"type":"v1","addr":"172.21.15.161:6833","nonce":471569125}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24514,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/2237964162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":2237964162},{"type":"v1","addr":"172.21.15.161:6835","nonce":2237964162}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24515,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2655304858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2655304858},{"type":"v1","addr":"172.21.15.135:6837","nonce":2655304858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24526,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/43639843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":43639843},{"type":"v1","addr":"172.21.15.161:6837","nonce":43639843}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24550,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6839/758982817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6838","nonce":758982817},{"type":"v1","addr":"172.21.15.161:6839","nonce":758982817}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[]} 2023-09-23T08:54:45.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:45.691+0000 7fcbfafff700 1 -- 172.21.15.82:0/359389770 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fcbe409ffa0 msgr2=0x7fcbe40a2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:45.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:45.691+0000 7fcbfafff700 1 --2- 172.21.15.82:0/359389770 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fcbe409ffa0 0x7fcbe40a2460 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fcbf4101980 tx=0x7fcbe8009260 comp rx=0 tx=0).stop 2023-09-23T08:54:45.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:45.691+0000 7fcbfafff700 1 -- 172.21.15.82:0/359389770 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbf41024c0 msgr2=0x7fcbf419dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:45.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:45.691+0000 7fcbfafff700 1 --2- 172.21.15.82:0/359389770 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbf41024c0 0x7fcbf419dad0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fcbec007ee0 tx=0x7fcbec00d3b0 comp rx=0 tx=0).stop 2023-09-23T08:54:45.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:45.691+0000 7fcbfafff700 1 -- 172.21.15.82:0/359389770 shutdown_connections 2023-09-23T08:54:45.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:45.691+0000 7fcbfafff700 1 --2- 172.21.15.82:0/359389770 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fcbe409ffa0 0x7fcbe40a2460 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:45.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:45.691+0000 7fcbfafff700 1 --2- 172.21.15.82:0/359389770 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbf41024c0 0x7fcbf419dad0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:45.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:45.691+0000 7fcbfafff700 1 --2- 172.21.15.82:0/359389770 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcbf4100930 0x7fcbf4196520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:45.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:45.691+0000 7fcbfafff700 1 --2- 172.21.15.82:0/359389770 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcbf4101b20 0x7fcbf4196a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:45.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:45.691+0000 7fcbfafff700 1 -- 172.21.15.82:0/359389770 >> 172.21.15.82:0/359389770 conn(0x7fcbf40fbe60 msgr2=0x7fcbf40fe120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:54:45.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:45.691+0000 7fcbfafff700 1 -- 172.21.15.82:0/359389770 shutdown_connections 2023-09-23T08:54:45.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:45.691+0000 7fcbfafff700 1 -- 172.21.15.82:0/359389770 wait complete. 2023-09-23T08:54:45.695 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 12 2023-09-23T08:54:45.812 INFO:journalctl@ceph.mds.b.smithi135.stdout:Sep 23 08:54:45 smithi135 podman[124679]: 2023-09-23T08:54:46.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:45 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/359389770' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T08:54:46.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:45 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/359389770' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T08:54:46.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:45 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/359389770' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T08:54:46.313 INFO:journalctl@ceph.mds.b.smithi135.stdout:Sep 23 08:54:45 smithi135 bash[124679]: e5d4d1cf949e68be6adc4ab6be1f3bb82a5a6f7f79adb4a846e091c67a00883f 2023-09-23T08:54:46.313 INFO:journalctl@ceph.mds.b.smithi135.stdout:Sep 23 08:54:45 smithi135 ceph-mds[124719]: -- 172.21.15.135:0/2578835346 <== mon.2 v2:172.21.15.135:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55932b99d1e0 con 0x55932b973000 2023-09-23T08:54:46.313 INFO:journalctl@ceph.mds.b.smithi135.stdout:Sep 23 08:54:45 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mds-b[124695]: starting mds.b at 2023-09-23T08:54:46.313 INFO:journalctl@ceph.mds.b.smithi135.stdout:Sep 23 08:54:45 smithi135 systemd[1]: Started Ceph mds.b for 8926e286-59ed-11ee-8db4-212e2dc638e7. 2023-09-23T08:54:47.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:46 smithi082 ceph-mon[97694]: mds.? [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] up:boot 2023-09-23T08:54:47.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:46 smithi082 ceph-mon[97694]: fsmap 12 up:standby 2023-09-23T08:54:47.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:46 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-09-23T08:54:47.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:46 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:47.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:46 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:47.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:46 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:47.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:46 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:47.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:46 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:47.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:46 smithi082 ceph-mon[97694]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:54:47.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:46 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:54:47.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:46 smithi161 ceph-mon[99580]: mds.? [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] up:boot 2023-09-23T08:54:47.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:46 smithi161 ceph-mon[99580]: fsmap 12 up:standby 2023-09-23T08:54:47.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:46 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-09-23T08:54:47.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:46 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:47.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:46 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:47.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:46 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:47.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:46 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:47.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:46 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:47.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:46 smithi161 ceph-mon[99580]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:54:47.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:46 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:54:47.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:46 smithi135 ceph-mon[99205]: mds.? [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] up:boot 2023-09-23T08:54:47.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:46 smithi135 ceph-mon[99205]: fsmap 12 up:standby 2023-09-23T08:54:47.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:46 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-09-23T08:54:47.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:46 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:47.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:46 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:47.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:46 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:47.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:46 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:47.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:46 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:47.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:46 smithi135 ceph-mon[99205]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:54:47.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:46 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:54:47.714 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-23T08:54:47.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:47.918+0000 7fc6379ff700 1 -- 172.21.15.82:0/897242413 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc630074900 msgr2=0x7fc630072d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:47.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:47.918+0000 7fc6379ff700 1 --2- 172.21.15.82:0/897242413 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc630074900 0x7fc630072d50 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc62c009990 tx=0x7fc62c009ca0 comp rx=0 tx=0).stop 2023-09-23T08:54:47.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:47.919+0000 7fc6379ff700 1 -- 172.21.15.82:0/897242413 shutdown_connections 2023-09-23T08:54:47.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:47.919+0000 7fc6379ff700 1 --2- 172.21.15.82:0/897242413 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc630108800 0x7fc63010ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:47.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:47.919+0000 7fc6379ff700 1 --2- 172.21.15.82:0/897242413 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc630074900 0x7fc630072d50 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:47.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:47.919+0000 7fc6379ff700 1 --2- 172.21.15.82:0/897242413 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc630073320 0x7fc6300737a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:47.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:47.919+0000 7fc6379ff700 1 -- 172.21.15.82:0/897242413 >> 172.21.15.82:0/897242413 conn(0x7fc6300fbe60 msgr2=0x7fc6300fe2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:54:47.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:47.919+0000 7fc6379ff700 1 -- 172.21.15.82:0/897242413 shutdown_connections 2023-09-23T08:54:47.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:47.919+0000 7fc6379ff700 1 -- 172.21.15.82:0/897242413 wait complete. 2023-09-23T08:54:47.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:47.920+0000 7fc6379ff700 1 Processor -- start 2023-09-23T08:54:47.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:47.920+0000 7fc6379ff700 1 -- start start 2023-09-23T08:54:47.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:47.920+0000 7fc6379ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc630073320 0x7fc6301987c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:47.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:47.920+0000 7fc6379ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc630074900 0x7fc630198d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:47.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:47.920+0000 7fc6379ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc630108800 0x7fc63019fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:47.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:47.920+0000 7fc6379ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6301a0340 con 0x7fc630108800 2023-09-23T08:54:47.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:47.920+0000 7fc6379ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6301a0480 con 0x7fc630073320 2023-09-23T08:54:47.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:47.920+0000 7fc6379ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6301a0610 con 0x7fc630074900 2023-09-23T08:54:47.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:47.920+0000 7fc634f9a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc630074900 0x7fc630198d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:47.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:47.921+0000 7fc63579b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc630073320 0x7fc6301987c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:47.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:47.921+0000 7fc634f9a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc630074900 0x7fc630198d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:39948/0 (socket says 172.21.15.82:39948) 2023-09-23T08:54:47.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:47.921+0000 7fc634f9a700 1 -- 172.21.15.82:0/1683385504 learned_addr learned my addr 172.21.15.82:0/1683385504 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:54:47.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:47.921+0000 7fc635f9c700 1 --2- 172.21.15.82:0/1683385504 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc630108800 0x7fc63019fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:47.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:47.921+0000 7fc634f9a700 1 -- 172.21.15.82:0/1683385504 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc630073320 msgr2=0x7fc6301987c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:47.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:47.921+0000 7fc634f9a700 1 --2- 172.21.15.82:0/1683385504 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc630073320 0x7fc6301987c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:47.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:47.921+0000 7fc634f9a700 1 -- 172.21.15.82:0/1683385504 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc630108800 msgr2=0x7fc63019fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:47.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:47.921+0000 7fc634f9a700 1 --2- 172.21.15.82:0/1683385504 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc630108800 0x7fc63019fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:47.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:47.921+0000 7fc634f9a700 1 -- 172.21.15.82:0/1683385504 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc62c0095f0 con 0x7fc630074900 2023-09-23T08:54:47.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:47.921+0000 7fc634f9a700 1 --2- 172.21.15.82:0/1683385504 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc630074900 0x7fc630198d00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc62000b530 tx=0x7fc62000b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:54:47.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:47.921+0000 7fc6267fc700 1 -- 172.21.15.82:0/1683385504 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc620011830 con 0x7fc630074900 2023-09-23T08:54:47.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:47.922+0000 7fc6267fc700 1 -- 172.21.15.82:0/1683385504 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc620011e20 con 0x7fc630074900 2023-09-23T08:54:47.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:47.922+0000 7fc6379ff700 1 -- 172.21.15.82:0/1683385504 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6301a08f0 con 0x7fc630074900 2023-09-23T08:54:47.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:47.922+0000 7fc6267fc700 1 -- 172.21.15.82:0/1683385504 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc620010db0 con 0x7fc630074900 2023-09-23T08:54:47.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:47.922+0000 7fc6379ff700 1 -- 172.21.15.82:0/1683385504 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6301a0e80 con 0x7fc630074900 2023-09-23T08:54:47.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:47.923+0000 7fc6379ff700 1 -- 172.21.15.82:0/1683385504 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc630106f00 con 0x7fc630074900 2023-09-23T08:54:47.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:47.925+0000 7fc6267fc700 1 -- 172.21.15.82:0/1683385504 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 16) v1 ==== 134671+0+0 (secure 0 0 0) 0x7fc620011990 con 0x7fc630074900 2023-09-23T08:54:47.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:47.926+0000 7fc6267fc700 1 --2- 172.21.15.82:0/1683385504 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fc61c09ffa0 0x7fc61c0a2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:47.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:47.926+0000 7fc6267fc700 1 -- 172.21.15.82:0/1683385504 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fc6200cafe0 con 0x7fc630074900 2023-09-23T08:54:47.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:47.926+0000 7fc63579b700 1 --2- 172.21.15.82:0/1683385504 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fc61c09ffa0 0x7fc61c0a2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:47.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:47.927+0000 7fc63579b700 1 --2- 172.21.15.82:0/1683385504 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fc61c09ffa0 0x7fc61c0a2460 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fc62c006010 tx=0x7fc62c00b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:54:47.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:47.929+0000 7fc6267fc700 1 -- 172.21.15.82:0/1683385504 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7fc6200951b0 con 0x7fc630074900 2023-09-23T08:54:48.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.192+0000 7fc6379ff700 1 -- 172.21.15.82:0/1683385504 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc63010e290 con 0x7fc630074900 2023-09-23T08:54:48.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.193+0000 7fc6267fc700 1 -- 172.21.15.82:0/1683385504 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+10037 (secure 0 0 0) 0x7fc6200b6e60 con 0x7fc630074900 2023-09-23T08:54:48.196 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:54:48.196 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/1237857359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1237857359},{"type":"v1","addr":"172.21.15.82:6835","nonce":1237857359}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/1335102362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":1335102362},{"type":"v1","addr":"172.21.15.82:6837","nonce":1335102362}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14598,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/3645331700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3645331700},{"type":"v1","addr":"172.21.15.135:6835","nonce":3645331700}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":14658,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6839/205725278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":205725278},{"type":"v1","addr":"172.21.15.82:6839","nonce":205725278}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14670,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6841/2659297867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":2659297867},{"type":"v1","addr":"172.21.15.82:6841","nonce":2659297867}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/503886037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":503886037},{"type":"v1","addr":"172.21.15.135:6833","nonce":503886037}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24463,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6833/471569125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":471569125},{"type":"v1","addr":"172.21.15.161:6833","nonce":471569125}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24514,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/2237964162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":2237964162},{"type":"v1","addr":"172.21.15.161:6835","nonce":2237964162}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24515,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2655304858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2655304858},{"type":"v1","addr":"172.21.15.135:6837","nonce":2655304858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24526,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/43639843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":43639843},{"type":"v1","addr":"172.21.15.161:6837","nonce":43639843}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24550,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6839/758982817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6838","nonce":758982817},{"type":"v1","addr":"172.21.15.161:6839","nonce":758982817}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":24557,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6839/2508669274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2508669274},{"type":"v1","addr":"172.21.15.135:6839","nonce":2508669274}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[]} 2023-09-23T08:54:48.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.196+0000 7fc6379ff700 1 -- 172.21.15.82:0/1683385504 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fc61c09ffa0 msgr2=0x7fc61c0a2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:48.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.196+0000 7fc6379ff700 1 --2- 172.21.15.82:0/1683385504 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fc61c09ffa0 0x7fc61c0a2460 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fc62c006010 tx=0x7fc62c00b260 comp rx=0 tx=0).stop 2023-09-23T08:54:48.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.196+0000 7fc6379ff700 1 -- 172.21.15.82:0/1683385504 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc630074900 msgr2=0x7fc630198d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:48.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.196+0000 7fc6379ff700 1 --2- 172.21.15.82:0/1683385504 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc630074900 0x7fc630198d00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc62000b530 tx=0x7fc62000b840 comp rx=0 tx=0).stop 2023-09-23T08:54:48.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.196+0000 7fc6379ff700 1 -- 172.21.15.82:0/1683385504 shutdown_connections 2023-09-23T08:54:48.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.196+0000 7fc6379ff700 1 --2- 172.21.15.82:0/1683385504 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fc61c09ffa0 0x7fc61c0a2460 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:48.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.196+0000 7fc6379ff700 1 --2- 172.21.15.82:0/1683385504 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc630108800 0x7fc63019fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:48.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.196+0000 7fc6379ff700 1 --2- 172.21.15.82:0/1683385504 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc630073320 0x7fc6301987c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:48.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.196+0000 7fc6379ff700 1 --2- 172.21.15.82:0/1683385504 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc630074900 0x7fc630198d00 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:48.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.196+0000 7fc6379ff700 1 -- 172.21.15.82:0/1683385504 >> 172.21.15.82:0/1683385504 conn(0x7fc6300fbe60 msgr2=0x7fc6300fe250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:54:48.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.196+0000 7fc6379ff700 1 -- 172.21.15.82:0/1683385504 shutdown_connections 2023-09-23T08:54:48.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.196+0000 7fc6379ff700 1 -- 172.21.15.82:0/1683385504 wait complete. 2023-09-23T08:54:48.200 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 13 2023-09-23T08:54:48.218 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-23T08:54:48.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:48 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:48.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:48 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:48.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:48 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:48.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.420+0000 7fabc45ff700 1 -- 172.21.15.82:0/927885607 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabbc1024b0 msgr2=0x7fabbc108d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:48.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.420+0000 7fabc45ff700 1 --2- 172.21.15.82:0/927885607 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabbc1024b0 0x7fabbc108d60 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fabb400b0d0 tx=0x7fabb400b3e0 comp rx=0 tx=0).stop 2023-09-23T08:54:48.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.420+0000 7fabc45ff700 1 -- 172.21.15.82:0/927885607 shutdown_connections 2023-09-23T08:54:48.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.420+0000 7fabc45ff700 1 --2- 172.21.15.82:0/927885607 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabbc1024b0 0x7fabbc108d60 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:48.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.420+0000 7fabc45ff700 1 --2- 172.21.15.82:0/927885607 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fabbc100920 0x7fabbc100d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:48.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.420+0000 7fabc45ff700 1 --2- 172.21.15.82:0/927885607 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fabbc101b10 0x7fabbc101f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:48.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.420+0000 7fabc45ff700 1 -- 172.21.15.82:0/927885607 >> 172.21.15.82:0/927885607 conn(0x7fabbc0fbe50 msgr2=0x7fabbc0fe2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:54:48.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.420+0000 7fabc45ff700 1 -- 172.21.15.82:0/927885607 shutdown_connections 2023-09-23T08:54:48.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.420+0000 7fabc45ff700 1 -- 172.21.15.82:0/927885607 wait complete. 2023-09-23T08:54:48.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.421+0000 7fabc45ff700 1 Processor -- start 2023-09-23T08:54:48.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.421+0000 7fabc45ff700 1 -- start start 2023-09-23T08:54:48.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.422+0000 7fabc45ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fabbc100920 0x7fabbc1987d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:48.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.422+0000 7fabc45ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fabbc101b10 0x7fabbc198d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:48.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.422+0000 7fabc45ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabbc1024b0 0x7fabbc19fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:48.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.422+0000 7fabc45ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabbc1a0350 con 0x7fabbc1024b0 2023-09-23T08:54:48.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.422+0000 7fabc45ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabbc1a0490 con 0x7fabbc100920 2023-09-23T08:54:48.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.422+0000 7fabc45ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabbc1a0620 con 0x7fabbc101b10 2023-09-23T08:54:48.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.422+0000 7fabc2b9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabbc1024b0 0x7fabbc19fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:48.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.422+0000 7fabc239b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fabbc100920 0x7fabbc1987d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:48.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.422+0000 7fabc1b9a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fabbc101b10 0x7fabbc198d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:48.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.422+0000 7fabc2b9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabbc1024b0 0x7fabbc19fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52282/0 (socket says 172.21.15.82:52282) 2023-09-23T08:54:48.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.422+0000 7fabc239b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fabbc100920 0x7fabbc1987d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:47120/0 (socket says 172.21.15.82:47120) 2023-09-23T08:54:48.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.422+0000 7fabc2b9c700 1 -- 172.21.15.82:0/985468375 learned_addr learned my addr 172.21.15.82:0/985468375 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:54:48.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.422+0000 7fabc2b9c700 1 -- 172.21.15.82:0/985468375 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fabbc101b10 msgr2=0x7fabbc198d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:48.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.422+0000 7fabc2b9c700 1 --2- 172.21.15.82:0/985468375 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fabbc101b10 0x7fabbc198d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:48.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.422+0000 7fabc2b9c700 1 -- 172.21.15.82:0/985468375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fabbc100920 msgr2=0x7fabbc1987d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:48.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.422+0000 7fabc2b9c700 1 --2- 172.21.15.82:0/985468375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fabbc100920 0x7fabbc1987d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:48.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.422+0000 7fabc2b9c700 1 -- 172.21.15.82:0/985468375 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabb4009d00 con 0x7fabbc1024b0 2023-09-23T08:54:48.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.422+0000 7fabc239b700 1 --2- 172.21.15.82:0/985468375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fabbc100920 0x7fabbc1987d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T08:54:48.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.423+0000 7fabc2b9c700 1 --2- 172.21.15.82:0/985468375 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabbc1024b0 0x7fabbc19fd80 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fabb4007870 tx=0x7fabb40078a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:54:48.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.423+0000 7fabb37fe700 1 -- 172.21.15.82:0/985468375 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb400e040 con 0x7fabbc1024b0 2023-09-23T08:54:48.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.423+0000 7fabc45ff700 1 -- 172.21.15.82:0/985468375 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabbc1a08a0 con 0x7fabbc1024b0 2023-09-23T08:54:48.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.423+0000 7fabb37fe700 1 -- 172.21.15.82:0/985468375 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fabb4003e90 con 0x7fabbc1024b0 2023-09-23T08:54:48.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.423+0000 7fabb37fe700 1 -- 172.21.15.82:0/985468375 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb401b6c0 con 0x7fabbc1024b0 2023-09-23T08:54:48.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.423+0000 7fabc45ff700 1 -- 172.21.15.82:0/985468375 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabbc1a0d20 con 0x7fabbc1024b0 2023-09-23T08:54:48.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.424+0000 7fabc45ff700 1 -- 172.21.15.82:0/985468375 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabbc192d90 con 0x7fabbc1024b0 2023-09-23T08:54:48.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.426+0000 7fabb37fe700 1 -- 172.21.15.82:0/985468375 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 134671+0+0 (secure 0 0 0) 0x7fabb4003a00 con 0x7fabbc1024b0 2023-09-23T08:54:48.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.428+0000 7fabb37fe700 1 --2- 172.21.15.82:0/985468375 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7faba809ffa0 0x7faba80a2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:48.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.428+0000 7fabb37fe700 1 -- 172.21.15.82:0/985468375 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fabb40cc620 con 0x7fabbc1024b0 2023-09-23T08:54:48.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.428+0000 7fabc239b700 1 --2- 172.21.15.82:0/985468375 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7faba809ffa0 0x7faba80a2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:48.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.428+0000 7fabc239b700 1 --2- 172.21.15.82:0/985468375 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7faba809ffa0 0x7faba80a2460 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fabbc101970 tx=0x7fabb8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:54:48.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.433+0000 7fabb37fe700 1 -- 172.21.15.82:0/985468375 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7fabb4096840 con 0x7fabbc1024b0 2023-09-23T08:54:48.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.664+0000 7fabc45ff700 1 -- 172.21.15.82:0/985468375 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fabbc10c090 con 0x7fabbc1024b0 2023-09-23T08:54:48.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.665+0000 7fabb37fe700 1 -- 172.21.15.82:0/985468375 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+18435 (secure 0 0 0) 0x7fabb4099e60 con 0x7fabbc1024b0 2023-09-23T08:54:48.668 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:54:48.669 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":82,"fsid":"8926e286-59ed-11ee-8db4-212e2dc638e7","created":"2023-09-23T08:46:16.628057+0000","modified":"2023-09-23T08:53:57.858331+0000","last_up_change":"2023-09-23T08:53:56.524694+0000","last_in_change":"2023-09-23T08:53:35.779183+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-23T08:50:00.571063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7384c1ff-8c71-4feb-8cef-ba45c2a1708a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":892441948},{"type":"v1","addr":"172.21.15.82:6803","nonce":892441948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":892441948},{"type":"v1","addr":"172.21.15.82:6805","nonce":892441948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":892441948},{"type":"v1","addr":"172.21.15.82:6809","nonce":892441948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":892441948},{"type":"v1","addr":"172.21.15.82:6807","nonce":892441948}]},"public_addr":"172.21.15.82:6803/892441948","cluster_addr":"172.21.15.82:6805/892441948","heartbeat_back_addr":"172.21.15.82:6809/892441948","heartbeat_front_addr":"172.21.15.82:6807/892441948","state":["exists","up"]},{"osd":1,"uuid":"ca62333e-15db-4556-a9ed-8820f9268766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3224546922},{"type":"v1","addr":"172.21.15.135:6801","nonce":3224546922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3224546922},{"type":"v1","addr":"172.21.15.135:6803","nonce":3224546922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3224546922},{"type":"v1","addr":"172.21.15.135:6807","nonce":3224546922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3224546922},{"type":"v1","addr":"172.21.15.135:6805","nonce":3224546922}]},"public_addr":"172.21.15.135:6801/3224546922","cluster_addr":"172.21.15.135:6803/3224546922","heartbeat_back_addr":"172.21.15.135:6807/3224546922","heartbeat_front_addr":"172.21.15.135:6805/3224546922","state":["exists","up"]},{"osd":2,"uuid":"ac23eb38-216a-44f0-b316-a509b23745f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2358373459},{"type":"v1","addr":"172.21.15.161:6801","nonce":2358373459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2358373459},{"type":"v1","addr":"172.21.15.161:6803","nonce":2358373459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2358373459},{"type":"v1","addr":"172.21.15.161:6807","nonce":2358373459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2358373459},{"type":"v1","addr":"172.21.15.161:6805","nonce":2358373459}]},"public_addr":"172.21.15.161:6801/2358373459","cluster_addr":"172.21.15.161:6803/2358373459","heartbeat_back_addr":"172.21.15.161:6807/2358373459","heartbeat_front_addr":"172.21.15.161:6805/2358373459","state":["exists","up"]},{"osd":3,"uuid":"701c96b0-30fb-46ce-917d-e02d3814dc3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":1081464528},{"type":"v1","addr":"172.21.15.82:6811","nonce":1081464528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1081464528},{"type":"v1","addr":"172.21.15.82:6813","nonce":1081464528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1081464528},{"type":"v1","addr":"172.21.15.82:6817","nonce":1081464528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":1081464528},{"type":"v1","addr":"172.21.15.82:6815","nonce":1081464528}]},"public_addr":"172.21.15.82:6811/1081464528","cluster_addr":"172.21.15.82:6813/1081464528","heartbeat_back_addr":"172.21.15.82:6817/1081464528","heartbeat_front_addr":"172.21.15.82:6815/1081464528","state":["exists","up"]},{"osd":4,"uuid":"c618d2a2-3616-41b2-943c-7a4616538e13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2346495509},{"type":"v1","addr":"172.21.15.135:6809","nonce":2346495509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2346495509},{"type":"v1","addr":"172.21.15.135:6811","nonce":2346495509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2346495509},{"type":"v1","addr":"172.21.15.135:6815","nonce":2346495509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2346495509},{"type":"v1","addr":"172.21.15.135:6813","nonce":2346495509}]},"public_addr":"172.21.15.135:6809/2346495509","cluster_addr":"172.21.15.135:6811/2346495509","heartbeat_back_addr":"172.21.15.135:6815/2346495509","heartbeat_front_addr":"172.21.15.135:6813/2346495509","state":["exists","up"]},{"osd":5,"uuid":"8e1dda3d-6927-495d-b20d-78b03bb75d5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1252638628},{"type":"v1","addr":"172.21.15.161:6809","nonce":1252638628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1252638628},{"type":"v1","addr":"172.21.15.161:6811","nonce":1252638628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1252638628},{"type":"v1","addr":"172.21.15.161:6815","nonce":1252638628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1252638628},{"type":"v1","addr":"172.21.15.161:6813","nonce":1252638628}]},"public_addr":"172.21.15.161:6809/1252638628","cluster_addr":"172.21.15.161:6811/1252638628","heartbeat_back_addr":"172.21.15.161:6815/1252638628","heartbeat_front_addr":"172.21.15.161:6813/1252638628","state":["exists","up"]},{"osd":6,"uuid":"50b31960-6bc4-44e1-8116-3106bf161e56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1052038408},{"type":"v1","addr":"172.21.15.82:6819","nonce":1052038408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1052038408},{"type":"v1","addr":"172.21.15.82:6821","nonce":1052038408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":1052038408},{"type":"v1","addr":"172.21.15.82:6825","nonce":1052038408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1052038408},{"type":"v1","addr":"172.21.15.82:6823","nonce":1052038408}]},"public_addr":"172.21.15.82:6819/1052038408","cluster_addr":"172.21.15.82:6821/1052038408","heartbeat_back_addr":"172.21.15.82:6825/1052038408","heartbeat_front_addr":"172.21.15.82:6823/1052038408","state":["exists","up"]},{"osd":7,"uuid":"425ca0ee-57f7-4b27-90fb-d86bb5db5480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3683951498},{"type":"v1","addr":"172.21.15.135:6817","nonce":3683951498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":3683951498},{"type":"v1","addr":"172.21.15.135:6819","nonce":3683951498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":3683951498},{"type":"v1","addr":"172.21.15.135:6823","nonce":3683951498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":3683951498},{"type":"v1","addr":"172.21.15.135:6821","nonce":3683951498}]},"public_addr":"172.21.15.135:6817/3683951498","cluster_addr":"172.21.15.135:6819/3683951498","heartbeat_back_addr":"172.21.15.135:6823/3683951498","heartbeat_front_addr":"172.21.15.135:6821/3683951498","state":["exists","up"]},{"osd":8,"uuid":"1115c837-bef6-4bad-9974-4d913198511b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":948521536},{"type":"v1","addr":"172.21.15.161:6817","nonce":948521536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":948521536},{"type":"v1","addr":"172.21.15.161:6819","nonce":948521536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":948521536},{"type":"v1","addr":"172.21.15.161:6823","nonce":948521536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":948521536},{"type":"v1","addr":"172.21.15.161:6821","nonce":948521536}]},"public_addr":"172.21.15.161:6817/948521536","cluster_addr":"172.21.15.161:6819/948521536","heartbeat_back_addr":"172.21.15.161:6823/948521536","heartbeat_front_addr":"172.21.15.161:6821/948521536","state":["exists","up"]},{"osd":9,"uuid":"c52ec819-4bc6-402f-9cd8-62539e519e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":1438762840},{"type":"v1","addr":"172.21.15.82:6827","nonce":1438762840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":1438762840},{"type":"v1","addr":"172.21.15.82:6829","nonce":1438762840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1438762840},{"type":"v1","addr":"172.21.15.82:6833","nonce":1438762840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1438762840},{"type":"v1","addr":"172.21.15.82:6831","nonce":1438762840}]},"public_addr":"172.21.15.82:6827/1438762840","cluster_addr":"172.21.15.82:6829/1438762840","heartbeat_back_addr":"172.21.15.82:6833/1438762840","heartbeat_front_addr":"172.21.15.82:6831/1438762840","state":["exists","up"]},{"osd":10,"uuid":"1b16c795-1b91-4d46-ae5d-21b8332c1077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2853697851},{"type":"v1","addr":"172.21.15.135:6825","nonce":2853697851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2853697851},{"type":"v1","addr":"172.21.15.135:6827","nonce":2853697851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2853697851},{"type":"v1","addr":"172.21.15.135:6831","nonce":2853697851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2853697851},{"type":"v1","addr":"172.21.15.135:6829","nonce":2853697851}]},"public_addr":"172.21.15.135:6825/2853697851","cluster_addr":"172.21.15.135:6827/2853697851","heartbeat_back_addr":"172.21.15.135:6831/2853697851","heartbeat_front_addr":"172.21.15.135:6829/2853697851","state":["exists","up"]},{"osd":11,"uuid":"2551e602-4fe1-41cb-9b7d-c8b31fdd1487","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":1459332081},{"type":"v1","addr":"172.21.15.161:6825","nonce":1459332081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":1459332081},{"type":"v1","addr":"172.21.15.161:6827","nonce":1459332081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":1459332081},{"type":"v1","addr":"172.21.15.161:6831","nonce":1459332081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":1459332081},{"type":"v1","addr":"172.21.15.161:6829","nonce":1459332081}]},"public_addr":"172.21.15.161:6825/1459332081","cluster_addr":"172.21.15.161:6827/1459332081","heartbeat_back_addr":"172.21.15.161:6831/1459332081","heartbeat_front_addr":"172.21.15.161:6829/1459332081","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:49:04.007679+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:49:30.702365+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:49:56.785248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:50:22.988516+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:50:49.347055+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:51:15.830145+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:51:41.986377+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:52:08.218893+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:52:34.847450+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:53:01.317134+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:53:27.981691+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:53:54.849245+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/4204712132":"2023-09-24T08:47:21.957866+0000","172.21.15.82:6801/2733521564":"2023-09-24T08:47:21.957866+0000","172.21.15.82:6800/2733521564":"2023-09-24T08:47:21.957866+0000","172.21.15.82:0/3964794665":"2023-09-24T08:47:21.957866+0000","172.21.15.82:0/3535372205":"2023-09-24T08:46:55.187024+0000","172.21.15.82:0/285559684":"2023-09-24T08:46:55.187024+0000","172.21.15.82:0/1335891896":"2023-09-24T08:46:55.187024+0000","172.21.15.82:6801/3761509623":"2023-09-24T08:46:55.187024+0000","172.21.15.82:6800/3761509623":"2023-09-24T08:46:55.187024+0000","172.21.15.82:0/3775317005":"2023-09-24T08:47:21.957866+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-23T08:54:48.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.668+0000 7fabc45ff700 1 -- 172.21.15.82:0/985468375 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7faba809ffa0 msgr2=0x7faba80a2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:48.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.668+0000 7fabc45ff700 1 --2- 172.21.15.82:0/985468375 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7faba809ffa0 0x7faba80a2460 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fabbc101970 tx=0x7fabb8009260 comp rx=0 tx=0).stop 2023-09-23T08:54:48.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.668+0000 7fabc45ff700 1 -- 172.21.15.82:0/985468375 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabbc1024b0 msgr2=0x7fabbc19fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:48.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.668+0000 7fabc45ff700 1 --2- 172.21.15.82:0/985468375 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabbc1024b0 0x7fabbc19fd80 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fabb4007870 tx=0x7fabb40078a0 comp rx=0 tx=0).stop 2023-09-23T08:54:48.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.668+0000 7fabc45ff700 1 -- 172.21.15.82:0/985468375 shutdown_connections 2023-09-23T08:54:48.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.668+0000 7fabc45ff700 1 --2- 172.21.15.82:0/985468375 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7faba809ffa0 0x7faba80a2460 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:48.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.668+0000 7fabc45ff700 1 --2- 172.21.15.82:0/985468375 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabbc1024b0 0x7fabbc19fd80 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:48.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.668+0000 7fabc45ff700 1 --2- 172.21.15.82:0/985468375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fabbc100920 0x7fabbc1987d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:48.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.668+0000 7fabc45ff700 1 --2- 172.21.15.82:0/985468375 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fabbc101b10 0x7fabbc198d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:48.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.668+0000 7fabc45ff700 1 -- 172.21.15.82:0/985468375 >> 172.21.15.82:0/985468375 conn(0x7fabbc0fbe50 msgr2=0x7fabbc107450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:54:48.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.668+0000 7fabc45ff700 1 -- 172.21.15.82:0/985468375 shutdown_connections 2023-09-23T08:54:48.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.668+0000 7fabc45ff700 1 -- 172.21.15.82:0/985468375 wait complete. 2023-09-23T08:54:48.691 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-23T08:50:00.571063+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-23T08:54:48.691 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-23T08:54:48.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.898+0000 7f6fe13ff700 1 -- 172.21.15.82:0/1890219983 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6fdc074960 msgr2=0x7f6fdc072db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:48.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.898+0000 7f6fe13ff700 1 --2- 172.21.15.82:0/1890219983 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6fdc074960 0x7f6fdc072db0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc009990 tx=0x7f6fcc009ca0 comp rx=0 tx=0).stop 2023-09-23T08:54:48.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.899+0000 7f6fe13ff700 1 -- 172.21.15.82:0/1890219983 shutdown_connections 2023-09-23T08:54:48.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.899+0000 7f6fe13ff700 1 --2- 172.21.15.82:0/1890219983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6fdc10cf00 0x7f6fdc10f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:48.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.899+0000 7f6fe13ff700 1 --2- 172.21.15.82:0/1890219983 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6fdc074960 0x7f6fdc072db0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:48.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.899+0000 7f6fe13ff700 1 --2- 172.21.15.82:0/1890219983 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6fdc073380 0x7f6fdc073800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:48.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.899+0000 7f6fe13ff700 1 -- 172.21.15.82:0/1890219983 >> 172.21.15.82:0/1890219983 conn(0x7f6fdc0fbea0 msgr2=0x7f6fdc0fe2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:54:48.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.899+0000 7f6fe13ff700 1 -- 172.21.15.82:0/1890219983 shutdown_connections 2023-09-23T08:54:48.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.899+0000 7f6fe13ff700 1 -- 172.21.15.82:0/1890219983 wait complete. 2023-09-23T08:54:48.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.900+0000 7f6fe13ff700 1 Processor -- start 2023-09-23T08:54:48.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.900+0000 7f6fe13ff700 1 -- start start 2023-09-23T08:54:48.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.900+0000 7f6fe13ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6fdc073380 0x7f6fdc19cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:48.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.900+0000 7f6fe13ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6fdc074960 0x7f6fdc19d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:48.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.900+0000 7f6fe13ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6fdc10cf00 0x7f6fdc1a4130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:48.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.900+0000 7f6fe13ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fdc1a4700 con 0x7f6fdc074960 2023-09-23T08:54:48.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.900+0000 7f6fe13ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fdc1a4840 con 0x7f6fdc10cf00 2023-09-23T08:54:48.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.900+0000 7f6fe13ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fdc1a49d0 con 0x7f6fdc073380 2023-09-23T08:54:48.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.901+0000 7f6fda7fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6fdc074960 0x7f6fdc19d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:48.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.901+0000 7f6fdaffd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6fdc073380 0x7f6fdc19cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:48.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.901+0000 7f6fdaffd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6fdc073380 0x7f6fdc19cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:39990/0 (socket says 172.21.15.82:39990) 2023-09-23T08:54:48.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.901+0000 7f6fdaffd700 1 -- 172.21.15.82:0/969236773 learned_addr learned my addr 172.21.15.82:0/969236773 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:54:48.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.901+0000 7f6fdb7fe700 1 --2- 172.21.15.82:0/969236773 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6fdc10cf00 0x7f6fdc1a4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:48.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.901+0000 7f6fdaffd700 1 -- 172.21.15.82:0/969236773 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6fdc10cf00 msgr2=0x7f6fdc1a4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:48.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.901+0000 7f6fdaffd700 1 --2- 172.21.15.82:0/969236773 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6fdc10cf00 0x7f6fdc1a4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:48.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.901+0000 7f6fdaffd700 1 -- 172.21.15.82:0/969236773 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6fdc074960 msgr2=0x7f6fdc19d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:48.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.901+0000 7f6fdaffd700 1 --2- 172.21.15.82:0/969236773 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6fdc074960 0x7f6fdc19d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:48.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.901+0000 7f6fdaffd700 1 -- 172.21.15.82:0/969236773 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fcc0095f0 con 0x7f6fdc073380 2023-09-23T08:54:48.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.901+0000 7f6fda7fc700 1 --2- 172.21.15.82:0/969236773 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6fdc074960 0x7f6fdc19d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T08:54:48.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.901+0000 7f6fdb7fe700 1 --2- 172.21.15.82:0/969236773 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6fdc10cf00 0x7f6fdc1a4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T08:54:48.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.901+0000 7f6fdaffd700 1 --2- 172.21.15.82:0/969236773 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6fdc073380 0x7f6fdc19cb80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc0098e0 tx=0x7f6fcc004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:54:48.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.902+0000 7f6fc3fff700 1 -- 172.21.15.82:0/969236773 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fcc01d070 con 0x7f6fdc073380 2023-09-23T08:54:48.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.902+0000 7f6fe13ff700 1 -- 172.21.15.82:0/969236773 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fdc1a4c50 con 0x7f6fdc073380 2023-09-23T08:54:48.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.902+0000 7f6fc3fff700 1 -- 172.21.15.82:0/969236773 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6fcc00bdb0 con 0x7f6fdc073380 2023-09-23T08:54:48.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.902+0000 7f6fc3fff700 1 -- 172.21.15.82:0/969236773 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fcc022d20 con 0x7f6fdc073380 2023-09-23T08:54:48.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.902+0000 7f6fe13ff700 1 -- 172.21.15.82:0/969236773 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fdc1a50d0 con 0x7f6fdc073380 2023-09-23T08:54:48.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.903+0000 7f6fe13ff700 1 -- 172.21.15.82:0/969236773 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fdc102a50 con 0x7f6fdc073380 2023-09-23T08:54:48.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.905+0000 7f6fc3fff700 1 -- 172.21.15.82:0/969236773 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 16) v1 ==== 134671+0+0 (secure 0 0 0) 0x7f6fcc00b920 con 0x7f6fdc073380 2023-09-23T08:54:48.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.906+0000 7f6fc3fff700 1 --2- 172.21.15.82:0/969236773 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f6fc409ff50 0x7f6fc40a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:48.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.906+0000 7f6fc3fff700 1 -- 172.21.15.82:0/969236773 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f6fcc0cc8f0 con 0x7f6fdc073380 2023-09-23T08:54:48.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.907+0000 7f6fda7fc700 1 --2- 172.21.15.82:0/969236773 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f6fc409ff50 0x7f6fc40a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:48.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.907+0000 7f6fda7fc700 1 --2- 172.21.15.82:0/969236773 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f6fc409ff50 0x7f6fc40a2410 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc074680 tx=0x7f6fd0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:54:48.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:48.909+0000 7f6fc3fff700 1 -- 172.21.15.82:0/969236773 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f6fcc096b10 con 0x7f6fdc073380 2023-09-23T08:54:49.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.142+0000 7f6fe13ff700 1 -- 172.21.15.82:0/969236773 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6fdc112890 con 0x7f6fdc073380 2023-09-23T08:54:49.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.143+0000 7f6fc3fff700 1 -- 172.21.15.82:0/969236773 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6fcc09a130 con 0x7f6fdc073380 2023-09-23T08:54:49.146 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-09-23T08:54:49.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.146+0000 7f6fe13ff700 1 -- 172.21.15.82:0/969236773 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f6fc409ff50 msgr2=0x7f6fc40a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:49.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.146+0000 7f6fe13ff700 1 --2- 172.21.15.82:0/969236773 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f6fc409ff50 0x7f6fc40a2410 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc074680 tx=0x7f6fd0009260 comp rx=0 tx=0).stop 2023-09-23T08:54:49.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.146+0000 7f6fe13ff700 1 -- 172.21.15.82:0/969236773 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6fdc073380 msgr2=0x7f6fdc19cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:49.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.146+0000 7f6fe13ff700 1 --2- 172.21.15.82:0/969236773 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6fdc073380 0x7f6fdc19cb80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc0098e0 tx=0x7f6fcc004730 comp rx=0 tx=0).stop 2023-09-23T08:54:49.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.146+0000 7f6fe13ff700 1 -- 172.21.15.82:0/969236773 shutdown_connections 2023-09-23T08:54:49.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.146+0000 7f6fe13ff700 1 --2- 172.21.15.82:0/969236773 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f6fc409ff50 0x7f6fc40a2410 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:49.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.146+0000 7f6fe13ff700 1 --2- 172.21.15.82:0/969236773 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6fdc10cf00 0x7f6fdc1a4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:49.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.146+0000 7f6fe13ff700 1 --2- 172.21.15.82:0/969236773 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6fdc073380 0x7f6fdc19cb80 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:49.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.146+0000 7f6fe13ff700 1 --2- 172.21.15.82:0/969236773 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6fdc074960 0x7f6fdc19d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:49.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.146+0000 7f6fe13ff700 1 -- 172.21.15.82:0/969236773 >> 172.21.15.82:0/969236773 conn(0x7f6fdc0fbea0 msgr2=0x7f6fdc0fe290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:54:49.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.146+0000 7f6fe13ff700 1 -- 172.21.15.82:0/969236773 shutdown_connections 2023-09-23T08:54:49.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.146+0000 7f6fe13ff700 1 -- 172.21.15.82:0/969236773 wait complete. 2023-09-23T08:54:49.169 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-09-23T08:54:49.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:49 smithi135 ceph-mon[99205]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:54:49.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:49 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/1683385504' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T08:54:49.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:49 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/985468375' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-23T08:54:49.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:49 smithi082 ceph-mon[97694]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:54:49.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:49 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/1683385504' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T08:54:49.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:49 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/985468375' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-23T08:54:49.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.374+0000 7f1c071ff700 1 -- 172.21.15.82:0/1267879464 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c00100930 msgr2=0x7f1c00100d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:49.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.374+0000 7f1c071ff700 1 --2- 172.21.15.82:0/1267879464 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c00100930 0x7f1c00100d50 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1bf400b0d0 tx=0x7f1bf400b3e0 comp rx=0 tx=0).stop 2023-09-23T08:54:49.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.374+0000 7f1c071ff700 1 -- 172.21.15.82:0/1267879464 shutdown_connections 2023-09-23T08:54:49.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.374+0000 7f1c071ff700 1 --2- 172.21.15.82:0/1267879464 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1c001024c0 0x7f1c00108d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:49.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.374+0000 7f1c071ff700 1 --2- 172.21.15.82:0/1267879464 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c00100930 0x7f1c00100d50 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:49.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.374+0000 7f1c071ff700 1 --2- 172.21.15.82:0/1267879464 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c00101b20 0x7f1c00101f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:49.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.374+0000 7f1c071ff700 1 -- 172.21.15.82:0/1267879464 >> 172.21.15.82:0/1267879464 conn(0x7f1c000fbe60 msgr2=0x7f1c000fe2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:54:49.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.374+0000 7f1c071ff700 1 -- 172.21.15.82:0/1267879464 shutdown_connections 2023-09-23T08:54:49.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.374+0000 7f1c071ff700 1 -- 172.21.15.82:0/1267879464 wait complete. 2023-09-23T08:54:49.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.375+0000 7f1c071ff700 1 Processor -- start 2023-09-23T08:54:49.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.375+0000 7f1c071ff700 1 -- start start 2023-09-23T08:54:49.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.375+0000 7f1c071ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c00100930 0x7f1c00198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:49.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.375+0000 7f1c071ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1c00101b20 0x7f1c00198ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:49.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.375+0000 7f1c071ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c001024c0 0x7f1c0019ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:49.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.375+0000 7f1c071ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c001a0500 con 0x7f1c001024c0 2023-09-23T08:54:49.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.375+0000 7f1c071ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c001a0640 con 0x7f1c00100930 2023-09-23T08:54:49.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.375+0000 7f1c071ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c001a07d0 con 0x7f1c00101b20 2023-09-23T08:54:49.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.376+0000 7f1c0579c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c001024c0 0x7f1c0019ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:49.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.376+0000 7f1bfffff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1c00101b20 0x7f1c00198ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:49.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.376+0000 7f1bfffff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1c00101b20 0x7f1c00198ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:40016/0 (socket says 172.21.15.82:40016) 2023-09-23T08:54:49.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.376+0000 7f1bfffff700 1 -- 172.21.15.82:0/2361669666 learned_addr learned my addr 172.21.15.82:0/2361669666 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:54:49.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.376+0000 7f1c0579c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c001024c0 0x7f1c0019ff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52328/0 (socket says 172.21.15.82:52328) 2023-09-23T08:54:49.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.376+0000 7f1c04f9b700 1 --2- 172.21.15.82:0/2361669666 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c00100930 0x7f1c00198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:49.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.376+0000 7f1bfffff700 1 -- 172.21.15.82:0/2361669666 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c00100930 msgr2=0x7f1c00198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:49.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.376+0000 7f1bfffff700 1 --2- 172.21.15.82:0/2361669666 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c00100930 0x7f1c00198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:49.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.376+0000 7f1bfffff700 1 -- 172.21.15.82:0/2361669666 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c001024c0 msgr2=0x7f1c0019ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:49.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.376+0000 7f1bfffff700 1 --2- 172.21.15.82:0/2361669666 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c001024c0 0x7f1c0019ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:49.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.376+0000 7f1bfffff700 1 -- 172.21.15.82:0/2361669666 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bf4009d00 con 0x7f1c00101b20 2023-09-23T08:54:49.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.377+0000 7f1bfffff700 1 --2- 172.21.15.82:0/2361669666 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1c00101b20 0x7f1c00198ec0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1bec00b530 tx=0x7f1bec00b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:54:49.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.378+0000 7f1bfdffb700 1 -- 172.21.15.82:0/2361669666 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bec011830 con 0x7f1c00101b20 2023-09-23T08:54:49.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.378+0000 7f1bfdffb700 1 -- 172.21.15.82:0/2361669666 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1bec011e20 con 0x7f1c00101b20 2023-09-23T08:54:49.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.378+0000 7f1bfdffb700 1 -- 172.21.15.82:0/2361669666 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bec010d40 con 0x7f1c00101b20 2023-09-23T08:54:49.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.378+0000 7f1c071ff700 1 -- 172.21.15.82:0/2361669666 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c001a0ab0 con 0x7f1c00101b20 2023-09-23T08:54:49.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.378+0000 7f1c071ff700 1 -- 172.21.15.82:0/2361669666 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c001a0ff0 con 0x7f1c00101b20 2023-09-23T08:54:49.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.379+0000 7f1c071ff700 1 -- 172.21.15.82:0/2361669666 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c00192eb0 con 0x7f1c00101b20 2023-09-23T08:54:49.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.382+0000 7f1bfdffb700 1 -- 172.21.15.82:0/2361669666 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 16) v1 ==== 134671+0+0 (secure 0 0 0) 0x7f1bec011990 con 0x7f1c00101b20 2023-09-23T08:54:49.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.384+0000 7f1bfdffb700 1 --2- 172.21.15.82:0/2361669666 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f1bf00a0020 0x7f1bf00a24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:49.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.384+0000 7f1bfdffb700 1 -- 172.21.15.82:0/2361669666 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f1bec0caf90 con 0x7f1c00101b20 2023-09-23T08:54:49.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.384+0000 7f1c04f9b700 1 --2- 172.21.15.82:0/2361669666 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f1bf00a0020 0x7f1bf00a24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:49.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.384+0000 7f1c04f9b700 1 --2- 172.21.15.82:0/2361669666 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f1bf00a0020 0x7f1bf00a24e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1bf4009fd0 tx=0x7f1bf400b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:54:49.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.385+0000 7f1bfdffb700 1 -- 172.21.15.82:0/2361669666 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f1bec095120 con 0x7f1c00101b20 2023-09-23T08:54:49.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:49 smithi161 ceph-mon[99580]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:54:49.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:49 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/1683385504' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T08:54:49.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:49 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/985468375' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-23T08:54:49.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.600+0000 7f1c071ff700 1 -- 172.21.15.82:0/2361669666 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f1c0010c2d0 con 0x7f1c00101b20 2023-09-23T08:54:49.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.600+0000 7f1bfdffb700 1 -- 172.21.15.82:0/2361669666 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v82) v1 ==== 84+0+65 (secure 0 0 0) 0x7f1bec098740 con 0x7f1c00101b20 2023-09-23T08:54:49.603 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:54:49.603 INFO:teuthology.orchestra.run.smithi082.stdout:[ 2023-09-23T08:54:49.603 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T08:54:49.604 INFO:teuthology.orchestra.run.smithi082.stdout: "poolnum": 1, 2023-09-23T08:54:49.604 INFO:teuthology.orchestra.run.smithi082.stdout: "poolname": ".mgr" 2023-09-23T08:54:49.604 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T08:54:49.604 INFO:teuthology.orchestra.run.smithi082.stdout:] 2023-09-23T08:54:49.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.603+0000 7f1c071ff700 1 -- 172.21.15.82:0/2361669666 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f1bf00a0020 msgr2=0x7f1bf00a24e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:49.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.603+0000 7f1c071ff700 1 --2- 172.21.15.82:0/2361669666 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f1bf00a0020 0x7f1bf00a24e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1bf4009fd0 tx=0x7f1bf400b040 comp rx=0 tx=0).stop 2023-09-23T08:54:49.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.603+0000 7f1c071ff700 1 -- 172.21.15.82:0/2361669666 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1c00101b20 msgr2=0x7f1c00198ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:49.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.603+0000 7f1c071ff700 1 --2- 172.21.15.82:0/2361669666 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1c00101b20 0x7f1c00198ec0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1bec00b530 tx=0x7f1bec00b840 comp rx=0 tx=0).stop 2023-09-23T08:54:49.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.603+0000 7f1c071ff700 1 -- 172.21.15.82:0/2361669666 shutdown_connections 2023-09-23T08:54:49.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.603+0000 7f1c071ff700 1 --2- 172.21.15.82:0/2361669666 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f1bf00a0020 0x7f1bf00a24e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:49.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.603+0000 7f1c071ff700 1 --2- 172.21.15.82:0/2361669666 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c001024c0 0x7f1c0019ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:49.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.603+0000 7f1c071ff700 1 --2- 172.21.15.82:0/2361669666 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c00100930 0x7f1c00198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:49.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.603+0000 7f1c071ff700 1 --2- 172.21.15.82:0/2361669666 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1c00101b20 0x7f1c00198ec0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:49.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.603+0000 7f1c071ff700 1 -- 172.21.15.82:0/2361669666 >> 172.21.15.82:0/2361669666 conn(0x7f1c000fbe60 msgr2=0x7f1c001074f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:54:49.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.603+0000 7f1c071ff700 1 -- 172.21.15.82:0/2361669666 shutdown_connections 2023-09-23T08:54:49.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.603+0000 7f1c071ff700 1 -- 172.21.15.82:0/2361669666 wait complete. 2023-09-23T08:54:49.624 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-09-23T08:54:49.625 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-09-23T08:54:49.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.834+0000 7f0f36fff700 1 -- 172.21.15.82:0/2534316988 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f30101b20 msgr2=0x7f0f30101f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:49.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.834+0000 7f0f36fff700 1 --2- 172.21.15.82:0/2534316988 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f30101b20 0x7f0f30101f80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c0099c0 tx=0x7f0f1c009cd0 comp rx=0 tx=0).stop 2023-09-23T08:54:49.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.834+0000 7f0f36fff700 1 -- 172.21.15.82:0/2534316988 shutdown_connections 2023-09-23T08:54:49.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.834+0000 7f0f36fff700 1 --2- 172.21.15.82:0/2534316988 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f301024c0 0x7f0f30108d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:49.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.834+0000 7f0f36fff700 1 --2- 172.21.15.82:0/2534316988 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f30100930 0x7f0f30100d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:49.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.834+0000 7f0f36fff700 1 --2- 172.21.15.82:0/2534316988 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f30101b20 0x7f0f30101f80 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:49.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.834+0000 7f0f36fff700 1 -- 172.21.15.82:0/2534316988 >> 172.21.15.82:0/2534316988 conn(0x7f0f300fbea0 msgr2=0x7f0f300fe2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:54:49.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.834+0000 7f0f36fff700 1 -- 172.21.15.82:0/2534316988 shutdown_connections 2023-09-23T08:54:49.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.834+0000 7f0f36fff700 1 -- 172.21.15.82:0/2534316988 wait complete. 2023-09-23T08:54:49.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.835+0000 7f0f36fff700 1 Processor -- start 2023-09-23T08:54:49.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.836+0000 7f0f36fff700 1 -- start start 2023-09-23T08:54:49.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.836+0000 7f0f36fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f30100930 0x7f0f300746d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:49.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.836+0000 7f0f36fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f30101b20 0x7f0f30072d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:49.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.836+0000 7f0f36fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f301024c0 0x7f0f30073250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:49.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.836+0000 7f0f36fff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f300739f0 con 0x7f0f30100930 2023-09-23T08:54:49.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.836+0000 7f0f36fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f30073b60 con 0x7f0f301024c0 2023-09-23T08:54:49.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.836+0000 7f0f36fff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f301a05c0 con 0x7f0f30101b20 2023-09-23T08:54:49.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.836+0000 7f0f34d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f30100930 0x7f0f300746d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:49.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.836+0000 7f0f34d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f30100930 0x7f0f300746d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52346/0 (socket says 172.21.15.82:52346) 2023-09-23T08:54:49.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.836+0000 7f0f34d9b700 1 -- 172.21.15.82:0/3663677844 learned_addr learned my addr 172.21.15.82:0/3663677844 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:54:49.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.836+0000 7f0f2ffff700 1 --2- 172.21.15.82:0/3663677844 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f30101b20 0x7f0f30072d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:49.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.837+0000 7f0f34d9b700 1 -- 172.21.15.82:0/3663677844 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f30101b20 msgr2=0x7f0f30072d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:49.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.837+0000 7f0f34d9b700 1 --2- 172.21.15.82:0/3663677844 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f30101b20 0x7f0f30072d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:49.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.837+0000 7f0f3559c700 1 --2- 172.21.15.82:0/3663677844 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f301024c0 0x7f0f30073250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:49.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.837+0000 7f0f34d9b700 1 -- 172.21.15.82:0/3663677844 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f301024c0 msgr2=0x7f0f30073250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:49.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.837+0000 7f0f34d9b700 1 --2- 172.21.15.82:0/3663677844 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f301024c0 0x7f0f30073250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:49.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.837+0000 7f0f34d9b700 1 -- 172.21.15.82:0/3663677844 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f1c0095f0 con 0x7f0f30100930 2023-09-23T08:54:49.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.837+0000 7f0f3559c700 1 --2- 172.21.15.82:0/3663677844 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f301024c0 0x7f0f30073250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T08:54:49.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.837+0000 7f0f34d9b700 1 --2- 172.21.15.82:0/3663677844 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f30100930 0x7f0f300746d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0f2400e970 tx=0x7f0f2400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:54:49.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.837+0000 7f0f2dffb700 1 -- 172.21.15.82:0/3663677844 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f24009790 con 0x7f0f30100930 2023-09-23T08:54:49.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.837+0000 7f0f36fff700 1 -- 172.21.15.82:0/3663677844 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f301a08a0 con 0x7f0f30100930 2023-09-23T08:54:49.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.837+0000 7f0f2dffb700 1 -- 172.21.15.82:0/3663677844 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0f2400eec0 con 0x7f0f30100930 2023-09-23T08:54:49.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.837+0000 7f0f2dffb700 1 -- 172.21.15.82:0/3663677844 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f24003c10 con 0x7f0f30100930 2023-09-23T08:54:49.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.837+0000 7f0f36fff700 1 -- 172.21.15.82:0/3663677844 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f301a0db0 con 0x7f0f30100930 2023-09-23T08:54:49.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.838+0000 7f0f36fff700 1 -- 172.21.15.82:0/3663677844 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f3010c040 con 0x7f0f30100930 2023-09-23T08:54:49.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.840+0000 7f0f2dffb700 1 -- 172.21.15.82:0/3663677844 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 134671+0+0 (secure 0 0 0) 0x7f0f24003db0 con 0x7f0f30100930 2023-09-23T08:54:49.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.841+0000 7f0f2dffb700 1 --2- 172.21.15.82:0/3663677844 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f0f2009ff50 0x7f0f200a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:49.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.842+0000 7f0f2dffb700 1 -- 172.21.15.82:0/3663677844 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f0f24014070 con 0x7f0f30100930 2023-09-23T08:54:49.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.842+0000 7f0f2ffff700 1 --2- 172.21.15.82:0/3663677844 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f0f2009ff50 0x7f0f200a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:49.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.842+0000 7f0f2ffff700 1 --2- 172.21.15.82:0/3663677844 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f0f2009ff50 0x7f0f200a2410 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c006010 tx=0x7f0f1c00bfd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:54:49.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:49.845+0000 7f0f2dffb700 1 -- 172.21.15.82:0/3663677844 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f0f24095230 con 0x7f0f30100930 2023-09-23T08:54:50.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:50.074+0000 7f0f36fff700 1 -- 172.21.15.82:0/3663677844 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f0f301a0fd0 con 0x7f0f30100930 2023-09-23T08:54:50.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:50 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/969236773' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-23T08:54:50.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:50 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/2361669666' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-09-23T08:54:50.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:50 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:50.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:50 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:50.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:50 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:50.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:50 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:50.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:50 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:50.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:50 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:50.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:50 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:54:50.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:50 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:54:50.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:50 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:50.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:50 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/969236773' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-23T08:54:50.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:50 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/2361669666' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-09-23T08:54:50.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:50 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:50.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:50 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:50.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:50 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:50.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:50 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:50.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:50 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:50.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:50 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:50.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:50 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:54:50.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:50 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:54:50.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:50 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:50.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:50 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/969236773' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-23T08:54:50.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:50 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/2361669666' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-09-23T08:54:50.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:50 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:50.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:50 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:50.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:50 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:50.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:50 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:50.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:50 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:50.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:50 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:50.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:50 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:54:50.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:50 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:54:50.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:50 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:51.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:51.066+0000 7f0f2dffb700 1 -- 172.21.15.82:0/3663677844 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v83) v1 ==== 138+0+0 (secure 0 0 0) 0x7f0f24098850 con 0x7f0f30100930 2023-09-23T08:54:51.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:51.070+0000 7f0f36fff700 1 -- 172.21.15.82:0/3663677844 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f0f2009ff50 msgr2=0x7f0f200a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:51.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:51.070+0000 7f0f36fff700 1 --2- 172.21.15.82:0/3663677844 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f0f2009ff50 0x7f0f200a2410 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c006010 tx=0x7f0f1c00bfd0 comp rx=0 tx=0).stop 2023-09-23T08:54:51.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:51.070+0000 7f0f36fff700 1 -- 172.21.15.82:0/3663677844 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f30100930 msgr2=0x7f0f300746d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:51.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:51.070+0000 7f0f36fff700 1 --2- 172.21.15.82:0/3663677844 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f30100930 0x7f0f300746d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0f2400e970 tx=0x7f0f2400ec80 comp rx=0 tx=0).stop 2023-09-23T08:54:51.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:51.070+0000 7f0f36fff700 1 -- 172.21.15.82:0/3663677844 shutdown_connections 2023-09-23T08:54:51.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:51.070+0000 7f0f36fff700 1 --2- 172.21.15.82:0/3663677844 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f0f2009ff50 0x7f0f200a2410 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:51.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:51.070+0000 7f0f36fff700 1 --2- 172.21.15.82:0/3663677844 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f301024c0 0x7f0f30073250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:51.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:51.070+0000 7f0f36fff700 1 --2- 172.21.15.82:0/3663677844 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f30100930 0x7f0f300746d0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:51.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:51.070+0000 7f0f36fff700 1 --2- 172.21.15.82:0/3663677844 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f30101b20 0x7f0f30072d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:51.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:51.070+0000 7f0f36fff700 1 -- 172.21.15.82:0/3663677844 >> 172.21.15.82:0/3663677844 conn(0x7f0f300fbea0 msgr2=0x7f0f300fe1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:54:51.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:51.071+0000 7f0f36fff700 1 -- 172.21.15.82:0/3663677844 shutdown_connections 2023-09-23T08:54:51.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:51.071+0000 7f0f36fff700 1 -- 172.21.15.82:0/3663677844 wait complete. 2023-09-23T08:54:51.075 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_metadata' created 2023-09-23T08:54:51.093 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-09-23T08:54:51.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:51 smithi135 ceph-mon[99205]: pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:54:51.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:51 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/3663677844' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-09-23T08:54:51.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:51 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:54:51.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:51.320+0000 7fed421ff700 1 -- 172.21.15.82:0/4270111188 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed3c1024a0 msgr2=0x7fed3c108d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:51.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:51.320+0000 7fed421ff700 1 --2- 172.21.15.82:0/4270111188 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed3c1024a0 0x7fed3c108d50 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fed3400b0d0 tx=0x7fed3400b3e0 comp rx=0 tx=0).stop 2023-09-23T08:54:51.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:51.320+0000 7fed421ff700 1 -- 172.21.15.82:0/4270111188 shutdown_connections 2023-09-23T08:54:51.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:51.320+0000 7fed421ff700 1 --2- 172.21.15.82:0/4270111188 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed3c1024a0 0x7fed3c108d50 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:51.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:51.320+0000 7fed421ff700 1 --2- 172.21.15.82:0/4270111188 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed3c100910 0x7fed3c100d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:51.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:51.320+0000 7fed421ff700 1 --2- 172.21.15.82:0/4270111188 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed3c101b00 0x7fed3c101f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:51.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:51.320+0000 7fed421ff700 1 -- 172.21.15.82:0/4270111188 >> 172.21.15.82:0/4270111188 conn(0x7fed3c0fbe60 msgr2=0x7fed3c0fe2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:54:51.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:51.320+0000 7fed421ff700 1 -- 172.21.15.82:0/4270111188 shutdown_connections 2023-09-23T08:54:51.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:51.320+0000 7fed421ff700 1 -- 172.21.15.82:0/4270111188 wait complete. 2023-09-23T08:54:51.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:51.321+0000 7fed421ff700 1 Processor -- start 2023-09-23T08:54:51.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:51.321+0000 7fed421ff700 1 -- start start 2023-09-23T08:54:51.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:51.322+0000 7fed421ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed3c100910 0x7fed3c0746d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:51.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:51.322+0000 7fed421ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed3c101b00 0x7fed3c072d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:51.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:51.322+0000 7fed421ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed3c1024a0 0x7fed3c073250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:51.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:51.322+0000 7fed421ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed3c0739f0 con 0x7fed3c101b00 2023-09-23T08:54:51.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:51.322+0000 7fed421ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed3c073b60 con 0x7fed3c100910 2023-09-23T08:54:51.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:51.322+0000 7fed421ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed3c1a0670 con 0x7fed3c1024a0 2023-09-23T08:54:51.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:51.322+0000 7fed33fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed3c101b00 0x7fed3c072d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:51.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:51.322+0000 7fed33fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed3c101b00 0x7fed3c072d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52374/0 (socket says 172.21.15.82:52374) 2023-09-23T08:54:51.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:51.322+0000 7fed33fff700 1 -- 172.21.15.82:0/4187791188 learned_addr learned my addr 172.21.15.82:0/4187791188 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:54:51.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:51.322+0000 7fed3b7fe700 1 --2- 172.21.15.82:0/4187791188 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed3c100910 0x7fed3c0746d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:51.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:51.322+0000 7fed3bfff700 1 --2- 172.21.15.82:0/4187791188 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed3c1024a0 0x7fed3c073250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:51.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:51.322+0000 7fed3b7fe700 1 -- 172.21.15.82:0/4187791188 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed3c1024a0 msgr2=0x7fed3c073250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:51.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:51.322+0000 7fed3b7fe700 1 --2- 172.21.15.82:0/4187791188 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed3c1024a0 0x7fed3c073250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:51.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:51.322+0000 7fed3b7fe700 1 -- 172.21.15.82:0/4187791188 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed3c101b00 msgr2=0x7fed3c072d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:51.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:51.322+0000 7fed3b7fe700 1 --2- 172.21.15.82:0/4187791188 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed3c101b00 0x7fed3c072d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:51.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:51.322+0000 7fed3b7fe700 1 -- 172.21.15.82:0/4187791188 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed34009d00 con 0x7fed3c100910 2023-09-23T08:54:51.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:51.322+0000 7fed33fff700 1 --2- 172.21.15.82:0/4187791188 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed3c101b00 0x7fed3c072d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T08:54:51.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:51.323+0000 7fed3b7fe700 1 --2- 172.21.15.82:0/4187791188 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed3c100910 0x7fed3c0746d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fed2c00e9c0 tx=0x7fed2c00ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:54:51.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:51.323+0000 7fed397fa700 1 -- 172.21.15.82:0/4187791188 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed2c004220 con 0x7fed3c100910 2023-09-23T08:54:51.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:51.323+0000 7fed397fa700 1 -- 172.21.15.82:0/4187791188 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fed2c004380 con 0x7fed3c100910 2023-09-23T08:54:51.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:51.323+0000 7fed421ff700 1 -- 172.21.15.82:0/4187791188 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed3c1a0950 con 0x7fed3c100910 2023-09-23T08:54:51.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:51.323+0000 7fed397fa700 1 -- 172.21.15.82:0/4187791188 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed2c003b40 con 0x7fed3c100910 2023-09-23T08:54:51.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:51.323+0000 7fed421ff700 1 -- 172.21.15.82:0/4187791188 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed3c1a0e60 con 0x7fed3c100910 2023-09-23T08:54:51.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:51.324+0000 7fed421ff700 1 -- 172.21.15.82:0/4187791188 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed3c107ef0 con 0x7fed3c100910 2023-09-23T08:54:51.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:51.326+0000 7fed397fa700 1 -- 172.21.15.82:0/4187791188 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) v1 ==== 134671+0+0 (secure 0 0 0) 0x7fed2c003ca0 con 0x7fed3c100910 2023-09-23T08:54:51.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:51.327+0000 7fed397fa700 1 --2- 172.21.15.82:0/4187791188 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fed2809ff50 0x7fed280a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:51.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:51.327+0000 7fed397fa700 1 -- 172.21.15.82:0/4187791188 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7497+0+0 (secure 0 0 0) 0x7fed2c014070 con 0x7fed3c100910 2023-09-23T08:54:51.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:51.328+0000 7fed33fff700 1 --2- 172.21.15.82:0/4187791188 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fed2809ff50 0x7fed280a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:51.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:51.328+0000 7fed33fff700 1 --2- 172.21.15.82:0/4187791188 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fed2809ff50 0x7fed280a2410 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fed24011550 tx=0x7fed24009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:54:51.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:51.330+0000 7fed397fa700 1 -- 172.21.15.82:0/4187791188 <== mon.2 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7fed2c095370 con 0x7fed3c100910 2023-09-23T08:54:51.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:51 smithi082 ceph-mon[97694]: pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:54:51.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:51 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/3663677844' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-09-23T08:54:51.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:51 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:54:51.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:51 smithi161 ceph-mon[99580]: pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:54:51.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:51 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/3663677844' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-09-23T08:54:51.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:51 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:54:51.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:51.540+0000 7fed421ff700 1 -- 172.21.15.82:0/4187791188 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fed3c10bf90 con 0x7fed3c100910 2023-09-23T08:54:52.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:52.068+0000 7fed397fa700 1 -- 172.21.15.82:0/4187791188 <== mon.2 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v84) v1 ==== 170+0+0 (secure 0 0 0) 0x7fed2c098990 con 0x7fed3c100910 2023-09-23T08:54:52.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:52.082+0000 7fed421ff700 1 -- 172.21.15.82:0/4187791188 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fed2809ff50 msgr2=0x7fed280a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:52.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:52.082+0000 7fed421ff700 1 --2- 172.21.15.82:0/4187791188 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fed2809ff50 0x7fed280a2410 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fed24011550 tx=0x7fed24009260 comp rx=0 tx=0).stop 2023-09-23T08:54:52.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:52.082+0000 7fed421ff700 1 -- 172.21.15.82:0/4187791188 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed3c100910 msgr2=0x7fed3c0746d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:52.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:52.082+0000 7fed421ff700 1 --2- 172.21.15.82:0/4187791188 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed3c100910 0x7fed3c0746d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fed2c00e9c0 tx=0x7fed2c00ecd0 comp rx=0 tx=0).stop 2023-09-23T08:54:52.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:52.087+0000 7fed421ff700 1 -- 172.21.15.82:0/4187791188 shutdown_connections 2023-09-23T08:54:52.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:52.087+0000 7fed421ff700 1 --2- 172.21.15.82:0/4187791188 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fed2809ff50 0x7fed280a2410 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:52.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:52.087+0000 7fed421ff700 1 --2- 172.21.15.82:0/4187791188 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed3c1024a0 0x7fed3c073250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:52.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:52.087+0000 7fed421ff700 1 --2- 172.21.15.82:0/4187791188 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed3c100910 0x7fed3c0746d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:52.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:52.087+0000 7fed421ff700 1 --2- 172.21.15.82:0/4187791188 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed3c101b00 0x7fed3c072d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:52.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:52.087+0000 7fed421ff700 1 -- 172.21.15.82:0/4187791188 >> 172.21.15.82:0/4187791188 conn(0x7fed3c0fbe60 msgr2=0x7fed3c105030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:54:52.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:52.089+0000 7fed421ff700 1 -- 172.21.15.82:0/4187791188 shutdown_connections 2023-09-23T08:54:52.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:52.089+0000 7fed421ff700 1 -- 172.21.15.82:0/4187791188 wait complete. 2023-09-23T08:54:52.093 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_data' created 2023-09-23T08:54:52.113 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-09-23T08:54:52.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:52.327+0000 7fab48fff700 1 -- 172.21.15.82:0/1015423206 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fab44103d90 msgr2=0x7fab441041f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:52.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:52.327+0000 7fab48fff700 1 --2- 172.21.15.82:0/1015423206 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fab44103d90 0x7fab441041f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fab2c0099c0 tx=0x7fab2c009cd0 comp rx=0 tx=0).stop 2023-09-23T08:54:52.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:52.328+0000 7fab48fff700 1 -- 172.21.15.82:0/1015423206 shutdown_connections 2023-09-23T08:54:52.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:52.328+0000 7fab48fff700 1 --2- 172.21.15.82:0/1015423206 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab44104730 0x7fab4410afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:52.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:52.328+0000 7fab48fff700 1 --2- 172.21.15.82:0/1015423206 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fab44102ba0 0x7fab44102fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:52.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:52.328+0000 7fab48fff700 1 --2- 172.21.15.82:0/1015423206 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fab44103d90 0x7fab441041f0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:52.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:52.328+0000 7fab48fff700 1 -- 172.21.15.82:0/1015423206 >> 172.21.15.82:0/1015423206 conn(0x7fab440fe130 msgr2=0x7fab44100550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:54:52.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:52.328+0000 7fab48fff700 1 -- 172.21.15.82:0/1015423206 shutdown_connections 2023-09-23T08:54:52.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:52.328+0000 7fab48fff700 1 -- 172.21.15.82:0/1015423206 wait complete. 2023-09-23T08:54:52.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:52.329+0000 7fab48fff700 1 Processor -- start 2023-09-23T08:54:52.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:52.329+0000 7fab48fff700 1 -- start start 2023-09-23T08:54:52.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:52.330+0000 7fab48fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fab44102ba0 0x7fab44198740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:52.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:52.330+0000 7fab48fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab44103d90 0x7fab44198c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:52.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:52.330+0000 7fab48fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fab44104730 0x7fab4419fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:52.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:52.330+0000 7fab48fff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab441a02c0 con 0x7fab44102ba0 2023-09-23T08:54:52.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:52.330+0000 7fab48fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab441a0400 con 0x7fab44104730 2023-09-23T08:54:52.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:52.330+0000 7fab48fff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab441a0590 con 0x7fab44103d90 2023-09-23T08:54:52.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:52.330+0000 7fab4259c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fab44102ba0 0x7fab44198740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:52.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:52.330+0000 7fab4259c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fab44102ba0 0x7fab44198740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:32964/0 (socket says 172.21.15.82:32964) 2023-09-23T08:54:52.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:52.330+0000 7fab4259c700 1 -- 172.21.15.82:0/1747816918 learned_addr learned my addr 172.21.15.82:0/1747816918 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:54:52.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:52.330+0000 7fab42d9d700 1 --2- 172.21.15.82:0/1747816918 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fab44104730 0x7fab4419fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:52.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:52.330+0000 7fab3bfff700 1 --2- 172.21.15.82:0/1747816918 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab44103d90 0x7fab44198c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:52.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:52.331+0000 7fab4259c700 1 -- 172.21.15.82:0/1747816918 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab44103d90 msgr2=0x7fab44198c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:52.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:52.331+0000 7fab4259c700 1 --2- 172.21.15.82:0/1747816918 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab44103d90 0x7fab44198c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:52.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:52.331+0000 7fab4259c700 1 -- 172.21.15.82:0/1747816918 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fab44104730 msgr2=0x7fab4419fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:52.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:52.331+0000 7fab4259c700 1 --2- 172.21.15.82:0/1747816918 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fab44104730 0x7fab4419fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:52.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:52.331+0000 7fab4259c700 1 -- 172.21.15.82:0/1747816918 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab2c0095f0 con 0x7fab44102ba0 2023-09-23T08:54:52.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:52.331+0000 7fab4259c700 1 --2- 172.21.15.82:0/1747816918 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fab44102ba0 0x7fab44198740 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fab3400d980 tx=0x7fab3400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:54:52.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:52.331+0000 7fab3b7fe700 1 -- 172.21.15.82:0/1747816918 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab3400b950 con 0x7fab44102ba0 2023-09-23T08:54:52.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:52.331+0000 7fab48fff700 1 -- 172.21.15.82:0/1747816918 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab441a0870 con 0x7fab44102ba0 2023-09-23T08:54:52.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:52.331+0000 7fab3b7fe700 1 -- 172.21.15.82:0/1747816918 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fab34007620 con 0x7fab44102ba0 2023-09-23T08:54:52.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:52.331+0000 7fab3b7fe700 1 -- 172.21.15.82:0/1747816918 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab3400f3c0 con 0x7fab44102ba0 2023-09-23T08:54:52.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:52.331+0000 7fab48fff700 1 -- 172.21.15.82:0/1747816918 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab441a0dd0 con 0x7fab44102ba0 2023-09-23T08:54:52.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:52.333+0000 7fab48fff700 1 -- 172.21.15.82:0/1747816918 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab4410e1f0 con 0x7fab44102ba0 2023-09-23T08:54:52.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:52.335+0000 7fab3b7fe700 1 -- 172.21.15.82:0/1747816918 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 134671+0+0 (secure 0 0 0) 0x7fab3400bab0 con 0x7fab44102ba0 2023-09-23T08:54:52.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:52.336+0000 7fab3b7fe700 1 --2- 172.21.15.82:0/1747816918 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fab3009ff50 0x7fab300a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:52.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:52.336+0000 7fab3b7fe700 1 -- 172.21.15.82:0/1747816918 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7879+0+0 (secure 0 0 0) 0x7fab340cb830 con 0x7fab44102ba0 2023-09-23T08:54:52.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:52.337+0000 7fab3bfff700 1 --2- 172.21.15.82:0/1747816918 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fab3009ff50 0x7fab300a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:52.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:52.338+0000 7fab3bfff700 1 --2- 172.21.15.82:0/1747816918 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fab3009ff50 0x7fab300a2410 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fab2c00b580 tx=0x7fab2c01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:54:52.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:52.340+0000 7fab3b7fe700 1 -- 172.21.15.82:0/1747816918 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7fab340956d0 con 0x7fab44102ba0 2023-09-23T08:54:52.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:52 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/3663677844' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-09-23T08:54:52.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:52 smithi082 ceph-mon[97694]: osdmap e83: 12 total, 12 up, 12 in 2023-09-23T08:54:52.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:52 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/4187791188' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-09-23T08:54:52.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:52 smithi082 ceph-mon[97694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-09-23T08:54:52.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:52 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/3663677844' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-09-23T08:54:52.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:52 smithi161 ceph-mon[99580]: osdmap e83: 12 total, 12 up, 12 in 2023-09-23T08:54:52.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:52 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/4187791188' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-09-23T08:54:52.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:52 smithi161 ceph-mon[99580]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-09-23T08:54:52.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:52 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/3663677844' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-09-23T08:54:52.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:52 smithi135 ceph-mon[99205]: osdmap e83: 12 total, 12 up, 12 in 2023-09-23T08:54:52.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:52 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/4187791188' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-09-23T08:54:52.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:52 smithi135 ceph-mon[99205]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-09-23T08:54:52.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:52.598+0000 7fab48fff700 1 -- 172.21.15.82:0/1747816918 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fab44109b80 con 0x7fab44102ba0 2023-09-23T08:54:53.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:53 smithi082 ceph-mon[97694]: pgmap v298: 33 pgs: 9 creating+peering, 1 active+clean, 23 unknown; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:54:53.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:53 smithi082 ceph-mon[97694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-09-23T08:54:53.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:53 smithi082 ceph-mon[97694]: osdmap e84: 12 total, 12 up, 12 in 2023-09-23T08:54:53.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:53 smithi082 ceph-mon[97694]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-09-23T08:54:53.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:53 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/1747816918' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-09-23T08:54:53.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:53 smithi082 ceph-mon[97694]: daemon mds.b assigned to filesystem cephfs as rank 0 2023-09-23T08:54:53.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:53 smithi161 ceph-mon[99580]: pgmap v298: 33 pgs: 9 creating+peering, 1 active+clean, 23 unknown; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:54:53.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:53 smithi161 ceph-mon[99580]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-09-23T08:54:53.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:53 smithi161 ceph-mon[99580]: osdmap e84: 12 total, 12 up, 12 in 2023-09-23T08:54:53.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:53 smithi161 ceph-mon[99580]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-09-23T08:54:53.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:53 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/1747816918' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-09-23T08:54:53.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:53 smithi161 ceph-mon[99580]: daemon mds.b assigned to filesystem cephfs as rank 0 2023-09-23T08:54:53.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:53.410+0000 7fab3b7fe700 1 -- 172.21.15.82:0/1747816918 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7fab34098cf0 con 0x7fab44102ba0 2023-09-23T08:54:53.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:53.413+0000 7fab48fff700 1 -- 172.21.15.82:0/1747816918 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fab3009ff50 msgr2=0x7fab300a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:53.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:53.413+0000 7fab48fff700 1 --2- 172.21.15.82:0/1747816918 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fab3009ff50 0x7fab300a2410 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fab2c00b580 tx=0x7fab2c01a040 comp rx=0 tx=0).stop 2023-09-23T08:54:53.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:53.413+0000 7fab48fff700 1 -- 172.21.15.82:0/1747816918 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fab44102ba0 msgr2=0x7fab44198740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:53.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:53.413+0000 7fab48fff700 1 --2- 172.21.15.82:0/1747816918 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fab44102ba0 0x7fab44198740 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fab3400d980 tx=0x7fab3400dc90 comp rx=0 tx=0).stop 2023-09-23T08:54:53.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:53.413+0000 7fab48fff700 1 -- 172.21.15.82:0/1747816918 shutdown_connections 2023-09-23T08:54:53.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:53.413+0000 7fab48fff700 1 --2- 172.21.15.82:0/1747816918 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fab3009ff50 0x7fab300a2410 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:53.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:53.413+0000 7fab48fff700 1 --2- 172.21.15.82:0/1747816918 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fab44104730 0x7fab4419fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:53.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:53.413+0000 7fab48fff700 1 --2- 172.21.15.82:0/1747816918 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fab44102ba0 0x7fab44198740 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:53.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:53.413+0000 7fab48fff700 1 --2- 172.21.15.82:0/1747816918 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab44103d90 0x7fab44198c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:53.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:53.413+0000 7fab48fff700 1 -- 172.21.15.82:0/1747816918 >> 172.21.15.82:0/1747816918 conn(0x7fab440fe130 msgr2=0x7fab44100480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:54:53.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:53.413+0000 7fab48fff700 1 -- 172.21.15.82:0/1747816918 shutdown_connections 2023-09-23T08:54:53.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:53.413+0000 7fab48fff700 1 -- 172.21.15.82:0/1747816918 wait complete. 2023-09-23T08:54:53.419 INFO:teuthology.orchestra.run.smithi082.stderr:new fs with metadata pool 2 and data pool 3 2023-09-23T08:54:53.437 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-23T08:54:53.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:53 smithi135 ceph-mon[99205]: pgmap v298: 33 pgs: 9 creating+peering, 1 active+clean, 23 unknown; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:54:53.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:53 smithi135 ceph-mon[99205]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-09-23T08:54:53.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:53 smithi135 ceph-mon[99205]: osdmap e84: 12 total, 12 up, 12 in 2023-09-23T08:54:53.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:53 smithi135 ceph-mon[99205]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-09-23T08:54:53.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:53 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/1747816918' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-09-23T08:54:53.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:53 smithi135 ceph-mon[99205]: daemon mds.b assigned to filesystem cephfs as rank 0 2023-09-23T08:54:53.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:53.646+0000 7fe265fff700 1 -- 172.21.15.82:0/3465873153 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe260100930 msgr2=0x7fe260100d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:53.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:53.646+0000 7fe265fff700 1 --2- 172.21.15.82:0/3465873153 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe260100930 0x7fe260100d50 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe2500099c0 tx=0x7fe250009cd0 comp rx=0 tx=0).stop 2023-09-23T08:54:53.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:53.646+0000 7fe265fff700 1 -- 172.21.15.82:0/3465873153 shutdown_connections 2023-09-23T08:54:53.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:53.646+0000 7fe265fff700 1 --2- 172.21.15.82:0/3465873153 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe2601024c0 0x7fe260108d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:53.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:53.646+0000 7fe265fff700 1 --2- 172.21.15.82:0/3465873153 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe260100930 0x7fe260100d50 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:53.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:53.646+0000 7fe265fff700 1 --2- 172.21.15.82:0/3465873153 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe260101b20 0x7fe260101f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:53.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:53.646+0000 7fe265fff700 1 -- 172.21.15.82:0/3465873153 >> 172.21.15.82:0/3465873153 conn(0x7fe2600fbe60 msgr2=0x7fe2600fe2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:54:53.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:53.646+0000 7fe265fff700 1 -- 172.21.15.82:0/3465873153 shutdown_connections 2023-09-23T08:54:53.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:53.647+0000 7fe265fff700 1 -- 172.21.15.82:0/3465873153 wait complete. 2023-09-23T08:54:53.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:53.647+0000 7fe265fff700 1 Processor -- start 2023-09-23T08:54:53.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:53.648+0000 7fe265fff700 1 -- start start 2023-09-23T08:54:53.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:53.648+0000 7fe265fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe260100930 0x7fe260198790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:53.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:53.648+0000 7fe265fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe260101b20 0x7fe260198cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:53.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:53.648+0000 7fe265fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2601024c0 0x7fe26019fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:53.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:53.648+0000 7fe265fff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2601a0310 con 0x7fe2601024c0 2023-09-23T08:54:53.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:53.648+0000 7fe265fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2601a0450 con 0x7fe260100930 2023-09-23T08:54:53.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:53.648+0000 7fe265fff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2601a05e0 con 0x7fe260101b20 2023-09-23T08:54:53.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:53.648+0000 7fe25ffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2601024c0 0x7fe26019fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:53.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:53.648+0000 7fe25ffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2601024c0 0x7fe26019fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:32974/0 (socket says 172.21.15.82:32974) 2023-09-23T08:54:53.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:53.648+0000 7fe25ffff700 1 -- 172.21.15.82:0/2561657506 learned_addr learned my addr 172.21.15.82:0/2561657506 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:54:53.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:53.648+0000 7fe25effd700 1 --2- 172.21.15.82:0/2561657506 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe260101b20 0x7fe260198cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:53.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:53.648+0000 7fe25f7fe700 1 --2- 172.21.15.82:0/2561657506 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe260100930 0x7fe260198790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:53.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:53.649+0000 7fe25effd700 1 -- 172.21.15.82:0/2561657506 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe260100930 msgr2=0x7fe260198790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:53.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:53.649+0000 7fe25effd700 1 --2- 172.21.15.82:0/2561657506 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe260100930 0x7fe260198790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:53.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:53.649+0000 7fe25effd700 1 -- 172.21.15.82:0/2561657506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2601024c0 msgr2=0x7fe26019fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:53.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:53.649+0000 7fe25effd700 1 --2- 172.21.15.82:0/2561657506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2601024c0 0x7fe26019fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:53.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:53.649+0000 7fe25effd700 1 -- 172.21.15.82:0/2561657506 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2500095f0 con 0x7fe260101b20 2023-09-23T08:54:53.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:53.649+0000 7fe25f7fe700 1 --2- 172.21.15.82:0/2561657506 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe260100930 0x7fe260198790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T08:54:53.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:53.649+0000 7fe25ffff700 1 --2- 172.21.15.82:0/2561657506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2601024c0 0x7fe26019fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T08:54:53.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:53.649+0000 7fe25effd700 1 --2- 172.21.15.82:0/2561657506 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe260101b20 0x7fe260198cd0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe25400e9f0 tx=0x7fe25400ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:54:53.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:53.649+0000 7fe25cff9700 1 -- 172.21.15.82:0/2561657506 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe25400c9c0 con 0x7fe260101b20 2023-09-23T08:54:53.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:53.649+0000 7fe265fff700 1 -- 172.21.15.82:0/2561657506 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2601a08c0 con 0x7fe260101b20 2023-09-23T08:54:53.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:53.649+0000 7fe25cff9700 1 -- 172.21.15.82:0/2561657506 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe254010430 con 0x7fe260101b20 2023-09-23T08:54:53.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:53.649+0000 7fe25cff9700 1 -- 172.21.15.82:0/2561657506 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe254018680 con 0x7fe260101b20 2023-09-23T08:54:53.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:53.649+0000 7fe265fff700 1 -- 172.21.15.82:0/2561657506 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2601a0dd0 con 0x7fe260101b20 2023-09-23T08:54:53.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:53.650+0000 7fe265fff700 1 -- 172.21.15.82:0/2561657506 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe260192e30 con 0x7fe260101b20 2023-09-23T08:54:53.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:53.652+0000 7fe25cff9700 1 -- 172.21.15.82:0/2561657506 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 16) v1 ==== 134671+0+0 (secure 0 0 0) 0x7fe2540105a0 con 0x7fe260101b20 2023-09-23T08:54:53.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:53.654+0000 7fe25cff9700 1 --2- 172.21.15.82:0/2561657506 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fe24809ffa0 0x7fe2480a2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:53.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:53.654+0000 7fe25cff9700 1 -- 172.21.15.82:0/2561657506 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fe254014070 con 0x7fe260101b20 2023-09-23T08:54:53.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:53.654+0000 7fe25f7fe700 1 --2- 172.21.15.82:0/2561657506 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fe24809ffa0 0x7fe2480a2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:53.657 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:53.655+0000 7fe25f7fe700 1 --2- 172.21.15.82:0/2561657506 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fe24809ffa0 0x7fe2480a2460 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe250000c00 tx=0x7fe25000bda0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:54:53.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:53.658+0000 7fe25cff9700 1 -- 172.21.15.82:0/2561657506 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7fe254051e00 con 0x7fe260101b20 2023-09-23T08:54:53.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:53.869+0000 7fe265fff700 1 -- 172.21.15.82:0/2561657506 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe26010c040 con 0x7fe260101b20 2023-09-23T08:54:53.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:53.871+0000 7fe25cff9700 1 -- 172.21.15.82:0/2561657506 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+22145 (secure 0 0 0) 0x7fe2540950d0 con 0x7fe260101b20 2023-09-23T08:54:53.874 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:54:53.874 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":85,"fsid":"8926e286-59ed-11ee-8db4-212e2dc638e7","created":"2023-09-23T08:46:16.628057+0000","modified":"2023-09-23T08:54:52.599993+0000","last_up_change":"2023-09-23T08:53:56.524694+0000","last_in_change":"2023-09-23T08:53:35.779183+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-23T08:50:00.571063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-23T08:54:50.558630+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-23T08:54:52.055291+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7384c1ff-8c71-4feb-8cef-ba45c2a1708a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":892441948},{"type":"v1","addr":"172.21.15.82:6803","nonce":892441948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":892441948},{"type":"v1","addr":"172.21.15.82:6805","nonce":892441948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":892441948},{"type":"v1","addr":"172.21.15.82:6809","nonce":892441948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":892441948},{"type":"v1","addr":"172.21.15.82:6807","nonce":892441948}]},"public_addr":"172.21.15.82:6803/892441948","cluster_addr":"172.21.15.82:6805/892441948","heartbeat_back_addr":"172.21.15.82:6809/892441948","heartbeat_front_addr":"172.21.15.82:6807/892441948","state":["exists","up"]},{"osd":1,"uuid":"ca62333e-15db-4556-a9ed-8820f9268766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3224546922},{"type":"v1","addr":"172.21.15.135:6801","nonce":3224546922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3224546922},{"type":"v1","addr":"172.21.15.135:6803","nonce":3224546922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3224546922},{"type":"v1","addr":"172.21.15.135:6807","nonce":3224546922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3224546922},{"type":"v1","addr":"172.21.15.135:6805","nonce":3224546922}]},"public_addr":"172.21.15.135:6801/3224546922","cluster_addr":"172.21.15.135:6803/3224546922","heartbeat_back_addr":"172.21.15.135:6807/3224546922","heartbeat_front_addr":"172.21.15.135:6805/3224546922","state":["exists","up"]},{"osd":2,"uuid":"ac23eb38-216a-44f0-b316-a509b23745f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2358373459},{"type":"v1","addr":"172.21.15.161:6801","nonce":2358373459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2358373459},{"type":"v1","addr":"172.21.15.161:6803","nonce":2358373459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2358373459},{"type":"v1","addr":"172.21.15.161:6807","nonce":2358373459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2358373459},{"type":"v1","addr":"172.21.15.161:6805","nonce":2358373459}]},"public_addr":"172.21.15.161:6801/2358373459","cluster_addr":"172.21.15.161:6803/2358373459","heartbeat_back_addr":"172.21.15.161:6807/2358373459","heartbeat_front_addr":"172.21.15.161:6805/2358373459","state":["exists","up"]},{"osd":3,"uuid":"701c96b0-30fb-46ce-917d-e02d3814dc3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":1081464528},{"type":"v1","addr":"172.21.15.82:6811","nonce":1081464528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1081464528},{"type":"v1","addr":"172.21.15.82:6813","nonce":1081464528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1081464528},{"type":"v1","addr":"172.21.15.82:6817","nonce":1081464528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":1081464528},{"type":"v1","addr":"172.21.15.82:6815","nonce":1081464528}]},"public_addr":"172.21.15.82:6811/1081464528","cluster_addr":"172.21.15.82:6813/1081464528","heartbeat_back_addr":"172.21.15.82:6817/1081464528","heartbeat_front_addr":"172.21.15.82:6815/1081464528","state":["exists","up"]},{"osd":4,"uuid":"c618d2a2-3616-41b2-943c-7a4616538e13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2346495509},{"type":"v1","addr":"172.21.15.135:6809","nonce":2346495509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2346495509},{"type":"v1","addr":"172.21.15.135:6811","nonce":2346495509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2346495509},{"type":"v1","addr":"172.21.15.135:6815","nonce":2346495509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2346495509},{"type":"v1","addr":"172.21.15.135:6813","nonce":2346495509}]},"public_addr":"172.21.15.135:6809/2346495509","cluster_addr":"172.21.15.135:6811/2346495509","heartbeat_back_addr":"172.21.15.135:6815/2346495509","heartbeat_front_addr":"172.21.15.135:6813/2346495509","state":["exists","up"]},{"osd":5,"uuid":"8e1dda3d-6927-495d-b20d-78b03bb75d5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1252638628},{"type":"v1","addr":"172.21.15.161:6809","nonce":1252638628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1252638628},{"type":"v1","addr":"172.21.15.161:6811","nonce":1252638628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1252638628},{"type":"v1","addr":"172.21.15.161:6815","nonce":1252638628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1252638628},{"type":"v1","addr":"172.21.15.161:6813","nonce":1252638628}]},"public_addr":"172.21.15.161:6809/1252638628","cluster_addr":"172.21.15.161:6811/1252638628","heartbeat_back_addr":"172.21.15.161:6815/1252638628","heartbeat_front_addr":"172.21.15.161:6813/1252638628","state":["exists","up"]},{"osd":6,"uuid":"50b31960-6bc4-44e1-8116-3106bf161e56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1052038408},{"type":"v1","addr":"172.21.15.82:6819","nonce":1052038408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1052038408},{"type":"v1","addr":"172.21.15.82:6821","nonce":1052038408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":1052038408},{"type":"v1","addr":"172.21.15.82:6825","nonce":1052038408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1052038408},{"type":"v1","addr":"172.21.15.82:6823","nonce":1052038408}]},"public_addr":"172.21.15.82:6819/1052038408","cluster_addr":"172.21.15.82:6821/1052038408","heartbeat_back_addr":"172.21.15.82:6825/1052038408","heartbeat_front_addr":"172.21.15.82:6823/1052038408","state":["exists","up"]},{"osd":7,"uuid":"425ca0ee-57f7-4b27-90fb-d86bb5db5480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3683951498},{"type":"v1","addr":"172.21.15.135:6817","nonce":3683951498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":3683951498},{"type":"v1","addr":"172.21.15.135:6819","nonce":3683951498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":3683951498},{"type":"v1","addr":"172.21.15.135:6823","nonce":3683951498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":3683951498},{"type":"v1","addr":"172.21.15.135:6821","nonce":3683951498}]},"public_addr":"172.21.15.135:6817/3683951498","cluster_addr":"172.21.15.135:6819/3683951498","heartbeat_back_addr":"172.21.15.135:6823/3683951498","heartbeat_front_addr":"172.21.15.135:6821/3683951498","state":["exists","up"]},{"osd":8,"uuid":"1115c837-bef6-4bad-9974-4d913198511b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":948521536},{"type":"v1","addr":"172.21.15.161:6817","nonce":948521536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":948521536},{"type":"v1","addr":"172.21.15.161:6819","nonce":948521536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":948521536},{"type":"v1","addr":"172.21.15.161:6823","nonce":948521536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":948521536},{"type":"v1","addr":"172.21.15.161:6821","nonce":948521536}]},"public_addr":"172.21.15.161:6817/948521536","cluster_addr":"172.21.15.161:6819/948521536","heartbeat_back_addr":"172.21.15.161:6823/948521536","heartbeat_front_addr":"172.21.15.161:6821/948521536","state":["exists","up"]},{"osd":9,"uuid":"c52ec819-4bc6-402f-9cd8-62539e519e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":1438762840},{"type":"v1","addr":"172.21.15.82:6827","nonce":1438762840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":1438762840},{"type":"v1","addr":"172.21.15.82:6829","nonce":1438762840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1438762840},{"type":"v1","addr":"172.21.15.82:6833","nonce":1438762840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1438762840},{"type":"v1","addr":"172.21.15.82:6831","nonce":1438762840}]},"public_addr":"172.21.15.82:6827/1438762840","cluster_addr":"172.21.15.82:6829/1438762840","heartbeat_back_addr":"172.21.15.82:6833/1438762840","heartbeat_front_addr":"172.21.15.82:6831/1438762840","state":["exists","up"]},{"osd":10,"uuid":"1b16c795-1b91-4d46-ae5d-21b8332c1077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2853697851},{"type":"v1","addr":"172.21.15.135:6825","nonce":2853697851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2853697851},{"type":"v1","addr":"172.21.15.135:6827","nonce":2853697851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2853697851},{"type":"v1","addr":"172.21.15.135:6831","nonce":2853697851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2853697851},{"type":"v1","addr":"172.21.15.135:6829","nonce":2853697851}]},"public_addr":"172.21.15.135:6825/2853697851","cluster_addr":"172.21.15.135:6827/2853697851","heartbeat_back_addr":"172.21.15.135:6831/2853697851","heartbeat_front_addr":"172.21.15.135:6829/2853697851","state":["exists","up"]},{"osd":11,"uuid":"2551e602-4fe1-41cb-9b7d-c8b31fdd1487","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":1459332081},{"type":"v1","addr":"172.21.15.161:6825","nonce":1459332081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":1459332081},{"type":"v1","addr":"172.21.15.161:6827","nonce":1459332081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":1459332081},{"type":"v1","addr":"172.21.15.161:6831","nonce":1459332081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":1459332081},{"type":"v1","addr":"172.21.15.161:6829","nonce":1459332081}]},"public_addr":"172.21.15.161:6825/1459332081","cluster_addr":"172.21.15.161:6827/1459332081","heartbeat_back_addr":"172.21.15.161:6831/1459332081","heartbeat_front_addr":"172.21.15.161:6829/1459332081","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:49:04.007679+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:49:30.702365+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:49:56.785248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:50:22.988516+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:50:49.347055+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:51:15.830145+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:51:41.986377+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:52:08.218893+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:52:34.847450+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:53:01.317134+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:53:27.981691+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:53:54.849245+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/4204712132":"2023-09-24T08:47:21.957866+0000","172.21.15.82:6801/2733521564":"2023-09-24T08:47:21.957866+0000","172.21.15.82:6800/2733521564":"2023-09-24T08:47:21.957866+0000","172.21.15.82:0/3964794665":"2023-09-24T08:47:21.957866+0000","172.21.15.82:0/3535372205":"2023-09-24T08:46:55.187024+0000","172.21.15.82:0/285559684":"2023-09-24T08:46:55.187024+0000","172.21.15.82:0/1335891896":"2023-09-24T08:46:55.187024+0000","172.21.15.82:6801/3761509623":"2023-09-24T08:46:55.187024+0000","172.21.15.82:6800/3761509623":"2023-09-24T08:46:55.187024+0000","172.21.15.82:0/3775317005":"2023-09-24T08:47:21.957866+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-23T08:54:53.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:53.874+0000 7fe265fff700 1 -- 172.21.15.82:0/2561657506 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fe24809ffa0 msgr2=0x7fe2480a2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:53.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:53.874+0000 7fe265fff700 1 --2- 172.21.15.82:0/2561657506 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fe24809ffa0 0x7fe2480a2460 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe250000c00 tx=0x7fe25000bda0 comp rx=0 tx=0).stop 2023-09-23T08:54:53.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:53.874+0000 7fe265fff700 1 -- 172.21.15.82:0/2561657506 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe260101b20 msgr2=0x7fe260198cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:53.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:53.874+0000 7fe265fff700 1 --2- 172.21.15.82:0/2561657506 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe260101b20 0x7fe260198cd0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe25400e9f0 tx=0x7fe25400ed00 comp rx=0 tx=0).stop 2023-09-23T08:54:53.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:53.874+0000 7fe265fff700 1 -- 172.21.15.82:0/2561657506 shutdown_connections 2023-09-23T08:54:53.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:53.874+0000 7fe265fff700 1 --2- 172.21.15.82:0/2561657506 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fe24809ffa0 0x7fe2480a2460 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:53.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:53.874+0000 7fe265fff700 1 --2- 172.21.15.82:0/2561657506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2601024c0 0x7fe26019fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:53.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:53.874+0000 7fe265fff700 1 --2- 172.21.15.82:0/2561657506 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe260100930 0x7fe260198790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:53.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:53.874+0000 7fe265fff700 1 --2- 172.21.15.82:0/2561657506 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe260101b20 0x7fe260198cd0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:53.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:53.874+0000 7fe265fff700 1 -- 172.21.15.82:0/2561657506 >> 172.21.15.82:0/2561657506 conn(0x7fe2600fbe60 msgr2=0x7fe260107480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:54:53.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:53.874+0000 7fe265fff700 1 -- 172.21.15.82:0/2561657506 shutdown_connections 2023-09-23T08:54:53.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:53.874+0000 7fe265fff700 1 -- 172.21.15.82:0/2561657506 wait complete. 2023-09-23T08:54:53.900 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-23T08:54:54.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.108+0000 7efe545ff700 1 -- 172.21.15.82:0/3998533970 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe4c100930 msgr2=0x7efe4c100d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:54.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.108+0000 7efe545ff700 1 --2- 172.21.15.82:0/3998533970 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe4c100930 0x7efe4c100d50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7efe480099c0 tx=0x7efe48009cd0 comp rx=0 tx=0).stop 2023-09-23T08:54:54.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.108+0000 7efe545ff700 1 -- 172.21.15.82:0/3998533970 shutdown_connections 2023-09-23T08:54:54.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.108+0000 7efe545ff700 1 --2- 172.21.15.82:0/3998533970 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe4c1024c0 0x7efe4c108d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:54.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.108+0000 7efe545ff700 1 --2- 172.21.15.82:0/3998533970 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe4c100930 0x7efe4c100d50 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:54.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.108+0000 7efe545ff700 1 --2- 172.21.15.82:0/3998533970 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efe4c101b20 0x7efe4c101f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:54.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.108+0000 7efe545ff700 1 -- 172.21.15.82:0/3998533970 >> 172.21.15.82:0/3998533970 conn(0x7efe4c0fbe60 msgr2=0x7efe4c0fe2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:54:54.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.108+0000 7efe545ff700 1 -- 172.21.15.82:0/3998533970 shutdown_connections 2023-09-23T08:54:54.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.108+0000 7efe545ff700 1 -- 172.21.15.82:0/3998533970 wait complete. 2023-09-23T08:54:54.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.109+0000 7efe545ff700 1 Processor -- start 2023-09-23T08:54:54.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.110+0000 7efe545ff700 1 -- start start 2023-09-23T08:54:54.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.110+0000 7efe545ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe4c100930 0x7efe4c196530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:54.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.110+0000 7efe545ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efe4c101b20 0x7efe4c196a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:54.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.110+0000 7efe545ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe4c1024c0 0x7efe4c19dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:54.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.110+0000 7efe545ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe4c19e0b0 con 0x7efe4c100930 2023-09-23T08:54:54.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.110+0000 7efe545ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe4c19e1f0 con 0x7efe4c1024c0 2023-09-23T08:54:54.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.110+0000 7efe545ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe4c19e380 con 0x7efe4c101b20 2023-09-23T08:54:54.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.110+0000 7efe5239b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe4c100930 0x7efe4c196530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:54.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.110+0000 7efe5239b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe4c100930 0x7efe4c196530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33000/0 (socket says 172.21.15.82:33000) 2023-09-23T08:54:54.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.110+0000 7efe5239b700 1 -- 172.21.15.82:0/3623264562 learned_addr learned my addr 172.21.15.82:0/3623264562 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:54:54.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.110+0000 7efe51b9a700 1 --2- 172.21.15.82:0/3623264562 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efe4c101b20 0x7efe4c196a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:54.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.110+0000 7efe52b9c700 1 --2- 172.21.15.82:0/3623264562 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe4c1024c0 0x7efe4c19dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:54.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.111+0000 7efe5239b700 1 -- 172.21.15.82:0/3623264562 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efe4c101b20 msgr2=0x7efe4c196a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:54.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.111+0000 7efe5239b700 1 --2- 172.21.15.82:0/3623264562 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efe4c101b20 0x7efe4c196a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:54.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.111+0000 7efe5239b700 1 -- 172.21.15.82:0/3623264562 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe4c1024c0 msgr2=0x7efe4c19dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:54.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.111+0000 7efe5239b700 1 --2- 172.21.15.82:0/3623264562 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe4c1024c0 0x7efe4c19dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:54.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.111+0000 7efe5239b700 1 -- 172.21.15.82:0/3623264562 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe3c009520 con 0x7efe4c100930 2023-09-23T08:54:54.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.111+0000 7efe5239b700 1 --2- 172.21.15.82:0/3623264562 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe4c100930 0x7efe4c196530 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7efe48000c00 tx=0x7efe4800fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:54:54.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.111+0000 7efe437fe700 1 -- 172.21.15.82:0/3623264562 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe4801d070 con 0x7efe4c100930 2023-09-23T08:54:54.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.111+0000 7efe437fe700 1 -- 172.21.15.82:0/3623264562 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efe4800bcf0 con 0x7efe4c100930 2023-09-23T08:54:54.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.111+0000 7efe437fe700 1 -- 172.21.15.82:0/3623264562 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe48004b30 con 0x7efe4c100930 2023-09-23T08:54:54.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.111+0000 7efe545ff700 1 -- 172.21.15.82:0/3623264562 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe480095f0 con 0x7efe4c100930 2023-09-23T08:54:54.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.111+0000 7efe545ff700 1 -- 172.21.15.82:0/3623264562 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe4c19e890 con 0x7efe4c100930 2023-09-23T08:54:54.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.113+0000 7efe545ff700 1 -- 172.21.15.82:0/3623264562 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe4c10c040 con 0x7efe4c100930 2023-09-23T08:54:54.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.114+0000 7efe437fe700 1 -- 172.21.15.82:0/3623264562 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 134671+0+0 (secure 0 0 0) 0x7efe48004c90 con 0x7efe4c100930 2023-09-23T08:54:54.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.116+0000 7efe437fe700 1 --2- 172.21.15.82:0/3623264562 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7efe380a0020 0x7efe380a24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:54.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.116+0000 7efe437fe700 1 -- 172.21.15.82:0/3623264562 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7efe480cbe50 con 0x7efe4c100930 2023-09-23T08:54:54.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.116+0000 7efe51b9a700 1 --2- 172.21.15.82:0/3623264562 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7efe380a0020 0x7efe380a24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:54.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.116+0000 7efe51b9a700 1 --2- 172.21.15.82:0/3623264562 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7efe380a0020 0x7efe380a24e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7efe3c009df0 tx=0x7efe3c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:54:54.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.119+0000 7efe437fe700 1 -- 172.21.15.82:0/3623264562 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7efe48095d20 con 0x7efe4c100930 2023-09-23T08:54:54.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.343+0000 7efe545ff700 1 -- 172.21.15.82:0/3623264562 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efe4c10c280 con 0x7efe4c100930 2023-09-23T08:54:54.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.345+0000 7efe437fe700 1 -- 172.21.15.82:0/3623264562 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+22132 (secure 0 0 0) 0x7efe48099340 con 0x7efe4c100930 2023-09-23T08:54:54.348 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:54:54.348 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":86,"fsid":"8926e286-59ed-11ee-8db4-212e2dc638e7","created":"2023-09-23T08:46:16.628057+0000","modified":"2023-09-23T08:54:54.081503+0000","last_up_change":"2023-09-23T08:53:56.524694+0000","last_in_change":"2023-09-23T08:53:35.779183+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-23T08:50:00.571063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-23T08:54:50.558630+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-23T08:54:52.055291+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7384c1ff-8c71-4feb-8cef-ba45c2a1708a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":892441948},{"type":"v1","addr":"172.21.15.82:6803","nonce":892441948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":892441948},{"type":"v1","addr":"172.21.15.82:6805","nonce":892441948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":892441948},{"type":"v1","addr":"172.21.15.82:6809","nonce":892441948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":892441948},{"type":"v1","addr":"172.21.15.82:6807","nonce":892441948}]},"public_addr":"172.21.15.82:6803/892441948","cluster_addr":"172.21.15.82:6805/892441948","heartbeat_back_addr":"172.21.15.82:6809/892441948","heartbeat_front_addr":"172.21.15.82:6807/892441948","state":["exists","up"]},{"osd":1,"uuid":"ca62333e-15db-4556-a9ed-8820f9268766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3224546922},{"type":"v1","addr":"172.21.15.135:6801","nonce":3224546922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3224546922},{"type":"v1","addr":"172.21.15.135:6803","nonce":3224546922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3224546922},{"type":"v1","addr":"172.21.15.135:6807","nonce":3224546922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3224546922},{"type":"v1","addr":"172.21.15.135:6805","nonce":3224546922}]},"public_addr":"172.21.15.135:6801/3224546922","cluster_addr":"172.21.15.135:6803/3224546922","heartbeat_back_addr":"172.21.15.135:6807/3224546922","heartbeat_front_addr":"172.21.15.135:6805/3224546922","state":["exists","up"]},{"osd":2,"uuid":"ac23eb38-216a-44f0-b316-a509b23745f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2358373459},{"type":"v1","addr":"172.21.15.161:6801","nonce":2358373459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2358373459},{"type":"v1","addr":"172.21.15.161:6803","nonce":2358373459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2358373459},{"type":"v1","addr":"172.21.15.161:6807","nonce":2358373459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2358373459},{"type":"v1","addr":"172.21.15.161:6805","nonce":2358373459}]},"public_addr":"172.21.15.161:6801/2358373459","cluster_addr":"172.21.15.161:6803/2358373459","heartbeat_back_addr":"172.21.15.161:6807/2358373459","heartbeat_front_addr":"172.21.15.161:6805/2358373459","state":["exists","up"]},{"osd":3,"uuid":"701c96b0-30fb-46ce-917d-e02d3814dc3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":1081464528},{"type":"v1","addr":"172.21.15.82:6811","nonce":1081464528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1081464528},{"type":"v1","addr":"172.21.15.82:6813","nonce":1081464528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1081464528},{"type":"v1","addr":"172.21.15.82:6817","nonce":1081464528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":1081464528},{"type":"v1","addr":"172.21.15.82:6815","nonce":1081464528}]},"public_addr":"172.21.15.82:6811/1081464528","cluster_addr":"172.21.15.82:6813/1081464528","heartbeat_back_addr":"172.21.15.82:6817/1081464528","heartbeat_front_addr":"172.21.15.82:6815/1081464528","state":["exists","up"]},{"osd":4,"uuid":"c618d2a2-3616-41b2-943c-7a4616538e13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2346495509},{"type":"v1","addr":"172.21.15.135:6809","nonce":2346495509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2346495509},{"type":"v1","addr":"172.21.15.135:6811","nonce":2346495509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2346495509},{"type":"v1","addr":"172.21.15.135:6815","nonce":2346495509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2346495509},{"type":"v1","addr":"172.21.15.135:6813","nonce":2346495509}]},"public_addr":"172.21.15.135:6809/2346495509","cluster_addr":"172.21.15.135:6811/2346495509","heartbeat_back_addr":"172.21.15.135:6815/2346495509","heartbeat_front_addr":"172.21.15.135:6813/2346495509","state":["exists","up"]},{"osd":5,"uuid":"8e1dda3d-6927-495d-b20d-78b03bb75d5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1252638628},{"type":"v1","addr":"172.21.15.161:6809","nonce":1252638628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1252638628},{"type":"v1","addr":"172.21.15.161:6811","nonce":1252638628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1252638628},{"type":"v1","addr":"172.21.15.161:6815","nonce":1252638628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1252638628},{"type":"v1","addr":"172.21.15.161:6813","nonce":1252638628}]},"public_addr":"172.21.15.161:6809/1252638628","cluster_addr":"172.21.15.161:6811/1252638628","heartbeat_back_addr":"172.21.15.161:6815/1252638628","heartbeat_front_addr":"172.21.15.161:6813/1252638628","state":["exists","up"]},{"osd":6,"uuid":"50b31960-6bc4-44e1-8116-3106bf161e56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1052038408},{"type":"v1","addr":"172.21.15.82:6819","nonce":1052038408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1052038408},{"type":"v1","addr":"172.21.15.82:6821","nonce":1052038408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":1052038408},{"type":"v1","addr":"172.21.15.82:6825","nonce":1052038408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1052038408},{"type":"v1","addr":"172.21.15.82:6823","nonce":1052038408}]},"public_addr":"172.21.15.82:6819/1052038408","cluster_addr":"172.21.15.82:6821/1052038408","heartbeat_back_addr":"172.21.15.82:6825/1052038408","heartbeat_front_addr":"172.21.15.82:6823/1052038408","state":["exists","up"]},{"osd":7,"uuid":"425ca0ee-57f7-4b27-90fb-d86bb5db5480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3683951498},{"type":"v1","addr":"172.21.15.135:6817","nonce":3683951498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":3683951498},{"type":"v1","addr":"172.21.15.135:6819","nonce":3683951498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":3683951498},{"type":"v1","addr":"172.21.15.135:6823","nonce":3683951498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":3683951498},{"type":"v1","addr":"172.21.15.135:6821","nonce":3683951498}]},"public_addr":"172.21.15.135:6817/3683951498","cluster_addr":"172.21.15.135:6819/3683951498","heartbeat_back_addr":"172.21.15.135:6823/3683951498","heartbeat_front_addr":"172.21.15.135:6821/3683951498","state":["exists","up"]},{"osd":8,"uuid":"1115c837-bef6-4bad-9974-4d913198511b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":948521536},{"type":"v1","addr":"172.21.15.161:6817","nonce":948521536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":948521536},{"type":"v1","addr":"172.21.15.161:6819","nonce":948521536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":948521536},{"type":"v1","addr":"172.21.15.161:6823","nonce":948521536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":948521536},{"type":"v1","addr":"172.21.15.161:6821","nonce":948521536}]},"public_addr":"172.21.15.161:6817/948521536","cluster_addr":"172.21.15.161:6819/948521536","heartbeat_back_addr":"172.21.15.161:6823/948521536","heartbeat_front_addr":"172.21.15.161:6821/948521536","state":["exists","up"]},{"osd":9,"uuid":"c52ec819-4bc6-402f-9cd8-62539e519e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":1438762840},{"type":"v1","addr":"172.21.15.82:6827","nonce":1438762840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":1438762840},{"type":"v1","addr":"172.21.15.82:6829","nonce":1438762840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1438762840},{"type":"v1","addr":"172.21.15.82:6833","nonce":1438762840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1438762840},{"type":"v1","addr":"172.21.15.82:6831","nonce":1438762840}]},"public_addr":"172.21.15.82:6827/1438762840","cluster_addr":"172.21.15.82:6829/1438762840","heartbeat_back_addr":"172.21.15.82:6833/1438762840","heartbeat_front_addr":"172.21.15.82:6831/1438762840","state":["exists","up"]},{"osd":10,"uuid":"1b16c795-1b91-4d46-ae5d-21b8332c1077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2853697851},{"type":"v1","addr":"172.21.15.135:6825","nonce":2853697851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2853697851},{"type":"v1","addr":"172.21.15.135:6827","nonce":2853697851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2853697851},{"type":"v1","addr":"172.21.15.135:6831","nonce":2853697851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2853697851},{"type":"v1","addr":"172.21.15.135:6829","nonce":2853697851}]},"public_addr":"172.21.15.135:6825/2853697851","cluster_addr":"172.21.15.135:6827/2853697851","heartbeat_back_addr":"172.21.15.135:6831/2853697851","heartbeat_front_addr":"172.21.15.135:6829/2853697851","state":["exists","up"]},{"osd":11,"uuid":"2551e602-4fe1-41cb-9b7d-c8b31fdd1487","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":1459332081},{"type":"v1","addr":"172.21.15.161:6825","nonce":1459332081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":1459332081},{"type":"v1","addr":"172.21.15.161:6827","nonce":1459332081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":1459332081},{"type":"v1","addr":"172.21.15.161:6831","nonce":1459332081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":1459332081},{"type":"v1","addr":"172.21.15.161:6829","nonce":1459332081}]},"public_addr":"172.21.15.161:6825/1459332081","cluster_addr":"172.21.15.161:6827/1459332081","heartbeat_back_addr":"172.21.15.161:6831/1459332081","heartbeat_front_addr":"172.21.15.161:6829/1459332081","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:49:04.007679+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:49:30.702365+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:49:56.785248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:50:22.988516+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:50:49.347055+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:51:15.830145+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:51:41.986377+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:52:08.218893+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:52:34.847450+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:53:01.317134+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:53:27.981691+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:53:54.849245+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/4204712132":"2023-09-24T08:47:21.957866+0000","172.21.15.82:6801/2733521564":"2023-09-24T08:47:21.957866+0000","172.21.15.82:6800/2733521564":"2023-09-24T08:47:21.957866+0000","172.21.15.82:0/3964794665":"2023-09-24T08:47:21.957866+0000","172.21.15.82:0/3535372205":"2023-09-24T08:46:55.187024+0000","172.21.15.82:0/285559684":"2023-09-24T08:46:55.187024+0000","172.21.15.82:0/1335891896":"2023-09-24T08:46:55.187024+0000","172.21.15.82:6801/3761509623":"2023-09-24T08:46:55.187024+0000","172.21.15.82:6800/3761509623":"2023-09-24T08:46:55.187024+0000","172.21.15.82:0/3775317005":"2023-09-24T08:47:21.957866+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-23T08:54:54.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.347+0000 7efe545ff700 1 -- 172.21.15.82:0/3623264562 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7efe380a0020 msgr2=0x7efe380a24e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:54.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.347+0000 7efe545ff700 1 --2- 172.21.15.82:0/3623264562 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7efe380a0020 0x7efe380a24e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7efe3c009df0 tx=0x7efe3c009260 comp rx=0 tx=0).stop 2023-09-23T08:54:54.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.347+0000 7efe545ff700 1 -- 172.21.15.82:0/3623264562 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe4c100930 msgr2=0x7efe4c196530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:54.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.347+0000 7efe545ff700 1 --2- 172.21.15.82:0/3623264562 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe4c100930 0x7efe4c196530 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7efe48000c00 tx=0x7efe4800fa00 comp rx=0 tx=0).stop 2023-09-23T08:54:54.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.347+0000 7efe545ff700 1 -- 172.21.15.82:0/3623264562 shutdown_connections 2023-09-23T08:54:54.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.347+0000 7efe545ff700 1 --2- 172.21.15.82:0/3623264562 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7efe380a0020 0x7efe380a24e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:54.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.347+0000 7efe545ff700 1 --2- 172.21.15.82:0/3623264562 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe4c1024c0 0x7efe4c19dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:54.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.347+0000 7efe545ff700 1 --2- 172.21.15.82:0/3623264562 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe4c100930 0x7efe4c196530 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:54.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.347+0000 7efe545ff700 1 --2- 172.21.15.82:0/3623264562 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efe4c101b20 0x7efe4c196a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:54.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.347+0000 7efe545ff700 1 -- 172.21.15.82:0/3623264562 >> 172.21.15.82:0/3623264562 conn(0x7efe4c0fbe60 msgr2=0x7efe4c0fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:54:54.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.348+0000 7efe545ff700 1 -- 172.21.15.82:0/3623264562 shutdown_connections 2023-09-23T08:54:54.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.348+0000 7efe545ff700 1 -- 172.21.15.82:0/3623264562 wait complete. 2023-09-23T08:54:54.367 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:54 smithi082 ceph-mon[97694]: osdmap e85: 12 total, 12 up, 12 in 2023-09-23T08:54:54.367 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:54 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/1747816918' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-09-23T08:54:54.367 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:54 smithi082 ceph-mon[97694]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2023-09-23T08:54:54.367 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:54 smithi082 ceph-mon[97694]: daemon mds.b is now active in filesystem cephfs as rank 0 2023-09-23T08:54:54.367 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:54 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/2561657506' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-23T08:54:54.369 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-09-23T08:54:54.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:54 smithi161 ceph-mon[99580]: osdmap e85: 12 total, 12 up, 12 in 2023-09-23T08:54:54.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:54 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/1747816918' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-09-23T08:54:54.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:54 smithi161 ceph-mon[99580]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2023-09-23T08:54:54.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:54 smithi161 ceph-mon[99580]: daemon mds.b is now active in filesystem cephfs as rank 0 2023-09-23T08:54:54.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:54 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/2561657506' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-23T08:54:54.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:54 smithi135 ceph-mon[99205]: osdmap e85: 12 total, 12 up, 12 in 2023-09-23T08:54:54.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:54 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/1747816918' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-09-23T08:54:54.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:54 smithi135 ceph-mon[99205]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2023-09-23T08:54:54.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:54 smithi135 ceph-mon[99205]: daemon mds.b is now active in filesystem cephfs as rank 0 2023-09-23T08:54:54.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:54 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/2561657506' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-23T08:54:54.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.587+0000 7f2b22bff700 1 -- 172.21.15.82:0/852722598 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b1c1024c0 msgr2=0x7f2b1c108d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:54.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.587+0000 7f2b22bff700 1 --2- 172.21.15.82:0/852722598 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b1c1024c0 0x7f2b1c108d70 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2b1400b0d0 tx=0x7f2b1400b3e0 comp rx=0 tx=0).stop 2023-09-23T08:54:54.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.587+0000 7f2b22bff700 1 -- 172.21.15.82:0/852722598 shutdown_connections 2023-09-23T08:54:54.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.587+0000 7f2b22bff700 1 --2- 172.21.15.82:0/852722598 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b1c1024c0 0x7f2b1c108d70 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:54.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.587+0000 7f2b22bff700 1 --2- 172.21.15.82:0/852722598 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b1c100930 0x7f2b1c100d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:54.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.587+0000 7f2b22bff700 1 --2- 172.21.15.82:0/852722598 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b1c101b20 0x7f2b1c101f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:54.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.587+0000 7f2b22bff700 1 -- 172.21.15.82:0/852722598 >> 172.21.15.82:0/852722598 conn(0x7f2b1c0fbea0 msgr2=0x7f2b1c0fe2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:54:54.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.587+0000 7f2b22bff700 1 -- 172.21.15.82:0/852722598 shutdown_connections 2023-09-23T08:54:54.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.587+0000 7f2b22bff700 1 -- 172.21.15.82:0/852722598 wait complete. 2023-09-23T08:54:54.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.588+0000 7f2b22bff700 1 Processor -- start 2023-09-23T08:54:54.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.588+0000 7f2b22bff700 1 -- start start 2023-09-23T08:54:54.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.588+0000 7f2b22bff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b1c100930 0x7f2b1c198850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:54.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.588+0000 7f2b22bff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b1c101b20 0x7f2b1c198d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:54.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.588+0000 7f2b22bff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b1c1024c0 0x7f2b1c19fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:54.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.588+0000 7f2b22bff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b1c1a03d0 con 0x7f2b1c100930 2023-09-23T08:54:54.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.588+0000 7f2b22bff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b1c1a0510 con 0x7f2b1c1024c0 2023-09-23T08:54:54.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.588+0000 7f2b22bff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b1c1a06a0 con 0x7f2b1c101b20 2023-09-23T08:54:54.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.589+0000 7f2b2099b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b1c100930 0x7f2b1c198850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:54.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.589+0000 7f2b2119c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b1c1024c0 0x7f2b1c19fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:54.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.589+0000 7f2b2119c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b1c1024c0 0x7f2b1c19fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:39054/0 (socket says 172.21.15.82:39054) 2023-09-23T08:54:54.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.589+0000 7f2b2099b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b1c100930 0x7f2b1c198850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33018/0 (socket says 172.21.15.82:33018) 2023-09-23T08:54:54.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.589+0000 7f2b2119c700 1 -- 172.21.15.82:0/3397118573 learned_addr learned my addr 172.21.15.82:0/3397118573 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:54:54.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.589+0000 7f2b1bfff700 1 --2- 172.21.15.82:0/3397118573 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b1c101b20 0x7f2b1c198d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:54.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.589+0000 7f2b2099b700 1 -- 172.21.15.82:0/3397118573 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b1c101b20 msgr2=0x7f2b1c198d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:54.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.589+0000 7f2b2099b700 1 --2- 172.21.15.82:0/3397118573 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b1c101b20 0x7f2b1c198d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:54.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.589+0000 7f2b2099b700 1 -- 172.21.15.82:0/3397118573 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b1c1024c0 msgr2=0x7f2b1c19fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:54.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.589+0000 7f2b2099b700 1 --2- 172.21.15.82:0/3397118573 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b1c1024c0 0x7f2b1c19fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:54.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.589+0000 7f2b2099b700 1 -- 172.21.15.82:0/3397118573 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b14009d00 con 0x7f2b1c100930 2023-09-23T08:54:54.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.589+0000 7f2b2119c700 1 --2- 172.21.15.82:0/3397118573 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b1c1024c0 0x7f2b1c19fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T08:54:54.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.589+0000 7f2b2099b700 1 --2- 172.21.15.82:0/3397118573 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b1c100930 0x7f2b1c198850 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2b1000d740 tx=0x7f2b1000da50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:54:54.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.589+0000 7f2b19ffb700 1 -- 172.21.15.82:0/3397118573 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b10004220 con 0x7f2b1c100930 2023-09-23T08:54:54.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.590+0000 7f2b19ffb700 1 -- 172.21.15.82:0/3397118573 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2b10004380 con 0x7f2b1c100930 2023-09-23T08:54:54.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.590+0000 7f2b22bff700 1 -- 172.21.15.82:0/3397118573 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b1c1a0980 con 0x7f2b1c100930 2023-09-23T08:54:54.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.590+0000 7f2b19ffb700 1 -- 172.21.15.82:0/3397118573 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b10003bc0 con 0x7f2b1c100930 2023-09-23T08:54:54.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.590+0000 7f2b22bff700 1 -- 172.21.15.82:0/3397118573 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b1c1a0ee0 con 0x7f2b1c100930 2023-09-23T08:54:54.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.591+0000 7f2b22bff700 1 -- 172.21.15.82:0/3397118573 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b1c192e40 con 0x7f2b1c100930 2023-09-23T08:54:54.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.593+0000 7f2b19ffb700 1 -- 172.21.15.82:0/3397118573 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 134671+0+0 (secure 0 0 0) 0x7f2b10003d20 con 0x7f2b1c100930 2023-09-23T08:54:54.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.594+0000 7f2b19ffb700 1 --2- 172.21.15.82:0/3397118573 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f2b0c09ffd0 0x7f2b0c0a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:54.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.594+0000 7f2b19ffb700 1 -- 172.21.15.82:0/3397118573 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f2b100cadb0 con 0x7f2b1c100930 2023-09-23T08:54:54.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.594+0000 7f2b1bfff700 1 --2- 172.21.15.82:0/3397118573 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f2b0c09ffd0 0x7f2b0c0a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:54.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.595+0000 7f2b1bfff700 1 --2- 172.21.15.82:0/3397118573 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f2b0c09ffd0 0x7f2b0c0a2490 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2b08005950 tx=0x7f2b0800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:54:54.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.598+0000 7f2b19ffb700 1 -- 172.21.15.82:0/3397118573 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f2b100cf070 con 0x7f2b1c100930 2023-09-23T08:54:54.858 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:54.856+0000 7f2b22bff700 1 -- 172.21.15.82:0/3397118573 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f2b1c10c050 con 0x7f2b1c100930 2023-09-23T08:54:55.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:55 smithi082 ceph-mon[97694]: pgmap v301: 97 pgs: 24 creating+peering, 22 active+clean, 51 unknown; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 1 op/s 2023-09-23T08:54:55.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:55 smithi082 ceph-mon[97694]: osdmap e86: 12 total, 12 up, 12 in 2023-09-23T08:54:55.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:55 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:55.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:55 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:55.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:55 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:55.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:55 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:55.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:55 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:55.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:55 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:55.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:55 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/3623264562' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-23T08:54:55.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:55 smithi082 ceph-mon[97694]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2023-09-23T08:54:55.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:55 smithi082 ceph-mon[97694]: Cluster is now healthy 2023-09-23T08:54:55.372 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:55 smithi082 ceph-mon[97694]: mds.? [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] up:active 2023-09-23T08:54:55.372 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:55 smithi082 ceph-mon[97694]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-09-23T08:54:55.372 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:55 smithi082 ceph-mon[97694]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-09-23T08:54:55.372 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:55 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/3397118573' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-09-23T08:54:55.372 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:55 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:54:55.372 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:55 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:54:55.372 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:55 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:55.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:55 smithi161 ceph-mon[99580]: pgmap v301: 97 pgs: 24 creating+peering, 22 active+clean, 51 unknown; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 1 op/s 2023-09-23T08:54:55.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:55 smithi161 ceph-mon[99580]: osdmap e86: 12 total, 12 up, 12 in 2023-09-23T08:54:55.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:55 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:55.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:55 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:55.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:55 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:55.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:55 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:55.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:55 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:55.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:55 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:55.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:55 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/3623264562' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-23T08:54:55.400 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:55 smithi161 ceph-mon[99580]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2023-09-23T08:54:55.400 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:55 smithi161 ceph-mon[99580]: Cluster is now healthy 2023-09-23T08:54:55.400 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:55 smithi161 ceph-mon[99580]: mds.? [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] up:active 2023-09-23T08:54:55.400 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:55 smithi161 ceph-mon[99580]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-09-23T08:54:55.400 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:55 smithi161 ceph-mon[99580]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-09-23T08:54:55.400 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:55 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/3397118573' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-09-23T08:54:55.400 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:55 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:54:55.400 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:55 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:54:55.400 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:55 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:55.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:55.423+0000 7f2b19ffb700 1 -- 172.21.15.82:0/3397118573 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) v1 ==== 118+0+0 (secure 0 0 0) 0x7f2b1001f0b0 con 0x7f2b1c100930 2023-09-23T08:54:55.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:55.426+0000 7f2b22bff700 1 -- 172.21.15.82:0/3397118573 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f2b0c09ffd0 msgr2=0x7f2b0c0a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:55.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:55.426+0000 7f2b22bff700 1 --2- 172.21.15.82:0/3397118573 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f2b0c09ffd0 0x7f2b0c0a2490 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2b08005950 tx=0x7f2b0800b410 comp rx=0 tx=0).stop 2023-09-23T08:54:55.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:55.426+0000 7f2b22bff700 1 -- 172.21.15.82:0/3397118573 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b1c100930 msgr2=0x7f2b1c198850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:55.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:55.426+0000 7f2b22bff700 1 --2- 172.21.15.82:0/3397118573 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b1c100930 0x7f2b1c198850 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2b1000d740 tx=0x7f2b1000da50 comp rx=0 tx=0).stop 2023-09-23T08:54:55.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:55.426+0000 7f2b22bff700 1 -- 172.21.15.82:0/3397118573 shutdown_connections 2023-09-23T08:54:55.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:55.426+0000 7f2b22bff700 1 --2- 172.21.15.82:0/3397118573 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f2b0c09ffd0 0x7f2b0c0a2490 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:55.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:55.426+0000 7f2b22bff700 1 --2- 172.21.15.82:0/3397118573 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b1c1024c0 0x7f2b1c19fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:55.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:55.426+0000 7f2b22bff700 1 --2- 172.21.15.82:0/3397118573 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b1c100930 0x7f2b1c198850 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:55.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:55.426+0000 7f2b22bff700 1 --2- 172.21.15.82:0/3397118573 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b1c101b20 0x7f2b1c198d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:55.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:55.426+0000 7f2b22bff700 1 -- 172.21.15.82:0/3397118573 >> 172.21.15.82:0/3397118573 conn(0x7f2b1c0fbea0 msgr2=0x7f2b1c107410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:54:55.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:55.426+0000 7f2b22bff700 1 -- 172.21.15.82:0/3397118573 shutdown_connections 2023-09-23T08:54:55.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:55.426+0000 7f2b22bff700 1 -- 172.21.15.82:0/3397118573 wait complete. 2023-09-23T08:54:55.447 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2}} 2023-09-23T08:54:55.448 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 5 2023-09-23T08:54:55.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:55 smithi135 ceph-mon[99205]: pgmap v301: 97 pgs: 24 creating+peering, 22 active+clean, 51 unknown; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 1 op/s 2023-09-23T08:54:55.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:55 smithi135 ceph-mon[99205]: osdmap e86: 12 total, 12 up, 12 in 2023-09-23T08:54:55.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:55 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:55.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:55 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:55.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:55 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:55.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:55 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:55.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:55 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:55.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:55 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:55.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:55 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/3623264562' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-23T08:54:55.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:55 smithi135 ceph-mon[99205]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2023-09-23T08:54:55.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:55 smithi135 ceph-mon[99205]: Cluster is now healthy 2023-09-23T08:54:55.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:55 smithi135 ceph-mon[99205]: mds.? [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] up:active 2023-09-23T08:54:55.564 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:55 smithi135 ceph-mon[99205]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-09-23T08:54:55.564 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:55 smithi135 ceph-mon[99205]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-09-23T08:54:55.564 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:55 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/3397118573' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-09-23T08:54:55.564 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:55 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:54:55.564 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:55 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:54:55.564 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:55 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:54:55.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:55.648+0000 7fe503dff700 1 -- 172.21.15.82:0/2983038350 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4fc101b20 msgr2=0x7fe4fc101f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:55.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:55.648+0000 7fe503dff700 1 --2- 172.21.15.82:0/2983038350 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4fc101b20 0x7fe4fc101f80 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe4ec0099c0 tx=0x7fe4ec009cd0 comp rx=0 tx=0).stop 2023-09-23T08:54:55.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:55.648+0000 7fe503dff700 1 -- 172.21.15.82:0/2983038350 shutdown_connections 2023-09-23T08:54:55.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:55.648+0000 7fe503dff700 1 --2- 172.21.15.82:0/2983038350 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe4fc1024c0 0x7fe4fc108d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:55.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:55.648+0000 7fe503dff700 1 --2- 172.21.15.82:0/2983038350 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4fc100930 0x7fe4fc100d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:55.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:55.648+0000 7fe503dff700 1 --2- 172.21.15.82:0/2983038350 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4fc101b20 0x7fe4fc101f80 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:55.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:55.648+0000 7fe503dff700 1 -- 172.21.15.82:0/2983038350 >> 172.21.15.82:0/2983038350 conn(0x7fe4fc0fbea0 msgr2=0x7fe4fc0fe2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:54:55.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:55.648+0000 7fe503dff700 1 -- 172.21.15.82:0/2983038350 shutdown_connections 2023-09-23T08:54:55.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:55.648+0000 7fe503dff700 1 -- 172.21.15.82:0/2983038350 wait complete. 2023-09-23T08:54:55.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:55.649+0000 7fe503dff700 1 Processor -- start 2023-09-23T08:54:55.657 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:55.649+0000 7fe503dff700 1 -- start start 2023-09-23T08:54:55.657 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:55.650+0000 7fe503dff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4fc100930 0x7fe4fc198770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:55.657 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:55.650+0000 7fe503dff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe4fc101b20 0x7fe4fc198cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:55.657 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:55.650+0000 7fe503dff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4fc1024c0 0x7fe4fc19fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:55.657 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:55.650+0000 7fe503dff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4fc1a02f0 con 0x7fe4fc1024c0 2023-09-23T08:54:55.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:55.650+0000 7fe503dff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4fc1a0430 con 0x7fe4fc100930 2023-09-23T08:54:55.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:55.650+0000 7fe503dff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4fc1a05c0 con 0x7fe4fc101b20 2023-09-23T08:54:55.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:55.650+0000 7fe50239c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4fc1024c0 0x7fe4fc19fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:55.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:55.650+0000 7fe50239c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4fc1024c0 0x7fe4fc19fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33032/0 (socket says 172.21.15.82:33032) 2023-09-23T08:54:55.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:55.650+0000 7fe50239c700 1 -- 172.21.15.82:0/606992785 learned_addr learned my addr 172.21.15.82:0/606992785 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:54:55.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:55.650+0000 7fe501b9b700 1 --2- 172.21.15.82:0/606992785 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4fc100930 0x7fe4fc198770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:55.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:55.650+0000 7fe50139a700 1 --2- 172.21.15.82:0/606992785 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe4fc101b20 0x7fe4fc198cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:55.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:55.650+0000 7fe50239c700 1 -- 172.21.15.82:0/606992785 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe4fc101b20 msgr2=0x7fe4fc198cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:55.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:55.650+0000 7fe50239c700 1 --2- 172.21.15.82:0/606992785 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe4fc101b20 0x7fe4fc198cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:55.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:55.650+0000 7fe50239c700 1 -- 172.21.15.82:0/606992785 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4fc100930 msgr2=0x7fe4fc198770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:55.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:55.650+0000 7fe50239c700 1 --2- 172.21.15.82:0/606992785 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4fc100930 0x7fe4fc198770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:55.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:55.650+0000 7fe50239c700 1 -- 172.21.15.82:0/606992785 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4ec0095f0 con 0x7fe4fc1024c0 2023-09-23T08:54:55.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:55.650+0000 7fe50239c700 1 --2- 172.21.15.82:0/606992785 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4fc1024c0 0x7fe4fc19fd20 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe4f400ef30 tx=0x7fe4f400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:54:55.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:55.651+0000 7fe4f2ffd700 1 -- 172.21.15.82:0/606992785 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f4018070 con 0x7fe4fc1024c0 2023-09-23T08:54:55.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:55.651+0000 7fe503dff700 1 -- 172.21.15.82:0/606992785 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4fc1a0840 con 0x7fe4fc1024c0 2023-09-23T08:54:55.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:55.651+0000 7fe4f2ffd700 1 -- 172.21.15.82:0/606992785 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe4f400f040 con 0x7fe4fc1024c0 2023-09-23T08:54:55.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:55.651+0000 7fe4f2ffd700 1 -- 172.21.15.82:0/606992785 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f400cc70 con 0x7fe4fc1024c0 2023-09-23T08:54:55.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:55.651+0000 7fe503dff700 1 -- 172.21.15.82:0/606992785 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4fc1a0d50 con 0x7fe4fc1024c0 2023-09-23T08:54:55.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:55.652+0000 7fe503dff700 1 -- 172.21.15.82:0/606992785 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4fc10c040 con 0x7fe4fc1024c0 2023-09-23T08:54:55.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:55.654+0000 7fe4f2ffd700 1 -- 172.21.15.82:0/606992785 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 134671+0+0 (secure 0 0 0) 0x7fe4f4007500 con 0x7fe4fc1024c0 2023-09-23T08:54:55.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:55.655+0000 7fe4f2ffd700 1 --2- 172.21.15.82:0/606992785 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fe4e809ff50 0x7fe4e80a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:55.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:55.655+0000 7fe4f2ffd700 1 -- 172.21.15.82:0/606992785 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fe4f40cad40 con 0x7fe4fc1024c0 2023-09-23T08:54:55.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:55.655+0000 7fe501b9b700 1 --2- 172.21.15.82:0/606992785 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fe4e809ff50 0x7fe4e80a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:55.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:55.656+0000 7fe501b9b700 1 --2- 172.21.15.82:0/606992785 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fe4e809ff50 0x7fe4e80a2410 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc101980 tx=0x7fe4f8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:54:55.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:55.659+0000 7fe4f2ffd700 1 -- 172.21.15.82:0/606992785 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7fe4f4094c10 con 0x7fe4fc1024c0 2023-09-23T08:54:55.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:55.905+0000 7fe503dff700 1 -- 172.21.15.82:0/606992785 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) v1 -- 0x7fe4fc1a0f70 con 0x7fe4fc1024c0 2023-09-23T08:54:56.312 INFO:journalctl@ceph.mds.b.smithi135.stdout:Sep 23 08:54:55 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mds-b[124695]: 2023-09-23T08:54:55.835+0000 7f61e42b8700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-09-23T08:54:56.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:56.408+0000 7fe4f2ffd700 1 -- 172.21.15.82:0/606992785 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v18) v1 ==== 105+0+0 (secure 0 0 0) 0x7fe4f4098230 con 0x7fe4fc1024c0 2023-09-23T08:54:56.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:56.411+0000 7fe503dff700 1 -- 172.21.15.82:0/606992785 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fe4e809ff50 msgr2=0x7fe4e80a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:56.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:56.411+0000 7fe503dff700 1 --2- 172.21.15.82:0/606992785 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fe4e809ff50 0x7fe4e80a2410 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc101980 tx=0x7fe4f8009260 comp rx=0 tx=0).stop 2023-09-23T08:54:56.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:56.411+0000 7fe503dff700 1 -- 172.21.15.82:0/606992785 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4fc1024c0 msgr2=0x7fe4fc19fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:56.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:56.411+0000 7fe503dff700 1 --2- 172.21.15.82:0/606992785 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4fc1024c0 0x7fe4fc19fd20 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe4f400ef30 tx=0x7fe4f400c3a0 comp rx=0 tx=0).stop 2023-09-23T08:54:56.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:56.411+0000 7fe503dff700 1 -- 172.21.15.82:0/606992785 shutdown_connections 2023-09-23T08:54:56.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:56.411+0000 7fe503dff700 1 --2- 172.21.15.82:0/606992785 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fe4e809ff50 0x7fe4e80a2410 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:56.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:56.411+0000 7fe503dff700 1 --2- 172.21.15.82:0/606992785 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4fc1024c0 0x7fe4fc19fd20 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:56.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:56.411+0000 7fe503dff700 1 --2- 172.21.15.82:0/606992785 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4fc100930 0x7fe4fc198770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:56.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:56.411+0000 7fe503dff700 1 --2- 172.21.15.82:0/606992785 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe4fc101b20 0x7fe4fc198cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:56.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:56.411+0000 7fe503dff700 1 -- 172.21.15.82:0/606992785 >> 172.21.15.82:0/606992785 conn(0x7fe4fc0fbea0 msgr2=0x7fe4fc0fe170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:54:56.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:56.411+0000 7fe503dff700 1 -- 172.21.15.82:0/606992785 shutdown_connections 2023-09-23T08:54:56.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:56.411+0000 7fe503dff700 1 -- 172.21.15.82:0/606992785 wait complete. 2023-09-23T08:54:56.437 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay true 2023-09-23T08:54:56.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:56.635+0000 7f82ff9ff700 1 -- 172.21.15.82:0/1070548091 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f82f8101b20 msgr2=0x7f82f8101f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:56.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:56.635+0000 7f82ff9ff700 1 --2- 172.21.15.82:0/1070548091 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f82f8101b20 0x7f82f8101f80 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f82e80099c0 tx=0x7f82e8009cd0 comp rx=0 tx=0).stop 2023-09-23T08:54:56.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:56.636+0000 7f82ff9ff700 1 -- 172.21.15.82:0/1070548091 shutdown_connections 2023-09-23T08:54:56.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:56.636+0000 7f82ff9ff700 1 --2- 172.21.15.82:0/1070548091 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f82f81024c0 0x7f82f8108d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:56.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:56.636+0000 7f82ff9ff700 1 --2- 172.21.15.82:0/1070548091 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82f8100930 0x7f82f8100d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:56.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:56.636+0000 7f82ff9ff700 1 --2- 172.21.15.82:0/1070548091 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f82f8101b20 0x7f82f8101f80 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:56.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:56.636+0000 7f82ff9ff700 1 -- 172.21.15.82:0/1070548091 >> 172.21.15.82:0/1070548091 conn(0x7f82f80fbea0 msgr2=0x7f82f80fe2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:54:56.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:56.636+0000 7f82ff9ff700 1 -- 172.21.15.82:0/1070548091 shutdown_connections 2023-09-23T08:54:56.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:56.636+0000 7f82ff9ff700 1 -- 172.21.15.82:0/1070548091 wait complete. 2023-09-23T08:54:56.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:56.637+0000 7f82ff9ff700 1 Processor -- start 2023-09-23T08:54:56.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:56.637+0000 7f82ff9ff700 1 -- start start 2023-09-23T08:54:56.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:56.637+0000 7f82ff9ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f82f8100930 0x7f82f80746d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:56.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:56.637+0000 7f82ff9ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82f8101b20 0x7f82f8072d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:56.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:56.637+0000 7f82ff9ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f82f81024c0 0x7f82f8073250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:56.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:56.637+0000 7f82ff9ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82f80739f0 con 0x7f82f8100930 2023-09-23T08:54:56.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:56.637+0000 7f82ff9ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82f8073b60 con 0x7f82f8101b20 2023-09-23T08:54:56.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:56.637+0000 7f82ff9ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82f81a0670 con 0x7f82f81024c0 2023-09-23T08:54:56.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:56.637+0000 7f82fd79b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f82f8100930 0x7f82f80746d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:56.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:56.637+0000 7f82fd79b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f82f8100930 0x7f82f80746d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33060/0 (socket says 172.21.15.82:33060) 2023-09-23T08:54:56.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:56.637+0000 7f82fd79b700 1 -- 172.21.15.82:0/1437266850 learned_addr learned my addr 172.21.15.82:0/1437266850 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:54:56.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:56.637+0000 7f82fcf9a700 1 --2- 172.21.15.82:0/1437266850 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82f8101b20 0x7f82f8072d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:56.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:56.638+0000 7f82fdf9c700 1 --2- 172.21.15.82:0/1437266850 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f82f81024c0 0x7f82f8073250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:56.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:56.638+0000 7f82fd79b700 1 -- 172.21.15.82:0/1437266850 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f82f81024c0 msgr2=0x7f82f8073250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:56.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:56.638+0000 7f82fd79b700 1 --2- 172.21.15.82:0/1437266850 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f82f81024c0 0x7f82f8073250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:56.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:56.638+0000 7f82fd79b700 1 -- 172.21.15.82:0/1437266850 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82f8101b20 msgr2=0x7f82f8072d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:56.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:56.638+0000 7f82fd79b700 1 --2- 172.21.15.82:0/1437266850 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82f8101b20 0x7f82f8072d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:56.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:56.638+0000 7f82fd79b700 1 -- 172.21.15.82:0/1437266850 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82e80095f0 con 0x7f82f8100930 2023-09-23T08:54:56.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:56.638+0000 7f82fd79b700 1 --2- 172.21.15.82:0/1437266850 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f82f8100930 0x7f82f80746d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f82f400b500 tx=0x7f82f400b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:54:56.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:56.638+0000 7f82ee7fc700 1 -- 172.21.15.82:0/1437266850 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f4011830 con 0x7f82f8100930 2023-09-23T08:54:56.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:56.638+0000 7f82ee7fc700 1 -- 172.21.15.82:0/1437266850 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f82f4011e20 con 0x7f82f8100930 2023-09-23T08:54:56.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:56.638+0000 7f82ff9ff700 1 -- 172.21.15.82:0/1437266850 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82f81a0950 con 0x7f82f8100930 2023-09-23T08:54:56.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:56.638+0000 7f82ee7fc700 1 -- 172.21.15.82:0/1437266850 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f4010dd0 con 0x7f82f8100930 2023-09-23T08:54:56.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:56.638+0000 7f82ff9ff700 1 -- 172.21.15.82:0/1437266850 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82f81a0eb0 con 0x7f82f8100930 2023-09-23T08:54:56.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:56.639+0000 7f82ff9ff700 1 -- 172.21.15.82:0/1437266850 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82f810c0e0 con 0x7f82f8100930 2023-09-23T08:54:56.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:56.641+0000 7f82ee7fc700 1 -- 172.21.15.82:0/1437266850 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 134671+0+0 (secure 0 0 0) 0x7f82f4011990 con 0x7f82f8100930 2023-09-23T08:54:56.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:56.643+0000 7f82ee7fc700 1 --2- 172.21.15.82:0/1437266850 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f82e40a0050 0x7f82e40a2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:56.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:56.643+0000 7f82ee7fc700 1 -- 172.21.15.82:0/1437266850 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f82f40cac00 con 0x7f82f8100930 2023-09-23T08:54:56.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:56.643+0000 7f82fcf9a700 1 --2- 172.21.15.82:0/1437266850 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f82e40a0050 0x7f82e40a2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:56.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:56.643+0000 7f82fcf9a700 1 --2- 172.21.15.82:0/1437266850 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f82e40a0050 0x7f82e40a2510 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f82e8009f50 tx=0x7f82e8005e80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:54:56.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:56.647+0000 7f82ee7fc700 1 -- 172.21.15.82:0/1437266850 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f82f4094a40 con 0x7f82f8100930 2023-09-23T08:54:56.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:56 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/3397118573' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-09-23T08:54:56.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:56 smithi135 ceph-mon[99205]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-09-23T08:54:56.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:56 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/606992785' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2023-09-23T08:54:56.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:56 smithi135 ceph-mon[99205]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-09-23T08:54:56.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:56 smithi135 ceph-mon[99205]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-09-23T08:54:56.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:56 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/606992785' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2023-09-23T08:54:56.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:56 smithi135 ceph-mon[99205]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2023-09-23T08:54:56.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:56 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/3397118573' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-09-23T08:54:56.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:56 smithi082 ceph-mon[97694]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-09-23T08:54:56.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:56 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/606992785' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2023-09-23T08:54:56.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:56 smithi082 ceph-mon[97694]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-09-23T08:54:56.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:56 smithi082 ceph-mon[97694]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-09-23T08:54:56.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:56 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/606992785' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2023-09-23T08:54:56.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:56 smithi082 ceph-mon[97694]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2023-09-23T08:54:56.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:56.892+0000 7f82ff9ff700 1 -- 172.21.15.82:0/1437266850 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7f82f810c2a0 con 0x7f82f8100930 2023-09-23T08:54:56.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:56 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/3397118573' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-09-23T08:54:56.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:56 smithi161 ceph-mon[99580]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-09-23T08:54:56.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:56 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/606992785' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2023-09-23T08:54:56.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:56 smithi161 ceph-mon[99580]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-09-23T08:54:56.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:56 smithi161 ceph-mon[99580]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-09-23T08:54:56.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:56 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/606992785' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2023-09-23T08:54:56.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:56 smithi161 ceph-mon[99580]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2023-09-23T08:54:57.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:57.427+0000 7f82ee7fc700 1 -- 172.21.15.82:0/1437266850 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v19) v1 ==== 121+0+0 (secure 0 0 0) 0x7f82f4098060 con 0x7f82f8100930 2023-09-23T08:54:57.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:57.429+0000 7f82ff9ff700 1 -- 172.21.15.82:0/1437266850 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f82e40a0050 msgr2=0x7f82e40a2510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:57.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:57.429+0000 7f82ff9ff700 1 --2- 172.21.15.82:0/1437266850 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f82e40a0050 0x7f82e40a2510 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f82e8009f50 tx=0x7f82e8005e80 comp rx=0 tx=0).stop 2023-09-23T08:54:57.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:57.429+0000 7f82ff9ff700 1 -- 172.21.15.82:0/1437266850 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f82f8100930 msgr2=0x7f82f80746d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:57.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:57.429+0000 7f82ff9ff700 1 --2- 172.21.15.82:0/1437266850 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f82f8100930 0x7f82f80746d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f82f400b500 tx=0x7f82f400b8c0 comp rx=0 tx=0).stop 2023-09-23T08:54:57.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:57.430+0000 7f82ff9ff700 1 -- 172.21.15.82:0/1437266850 shutdown_connections 2023-09-23T08:54:57.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:57.430+0000 7f82ff9ff700 1 --2- 172.21.15.82:0/1437266850 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f82e40a0050 0x7f82e40a2510 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:57.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:57.430+0000 7f82ff9ff700 1 --2- 172.21.15.82:0/1437266850 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f82f81024c0 0x7f82f8073250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:57.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:57.430+0000 7f82ff9ff700 1 --2- 172.21.15.82:0/1437266850 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f82f8100930 0x7f82f80746d0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:57.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:57.430+0000 7f82ff9ff700 1 --2- 172.21.15.82:0/1437266850 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82f8101b20 0x7f82f8072d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:57.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:57.430+0000 7f82ff9ff700 1 -- 172.21.15.82:0/1437266850 >> 172.21.15.82:0/1437266850 conn(0x7f82f80fbea0 msgr2=0x7f82f80fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:54:57.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:57.430+0000 7f82ff9ff700 1 -- 172.21.15.82:0/1437266850 shutdown_connections 2023-09-23T08:54:57.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:57.430+0000 7f82ff9ff700 1 -- 172.21.15.82:0/1437266850 wait complete. 2023-09-23T08:54:57.457 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2023-09-23T08:54:57.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:57.657+0000 7fe2443ff700 1 -- 172.21.15.82:0/3279196900 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe23c100930 msgr2=0x7fe23c100d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:57.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:57.657+0000 7fe2443ff700 1 --2- 172.21.15.82:0/3279196900 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe23c100930 0x7fe23c100d50 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe2380099c0 tx=0x7fe238009cd0 comp rx=0 tx=0).stop 2023-09-23T08:54:57.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:57.657+0000 7fe2443ff700 1 -- 172.21.15.82:0/3279196900 shutdown_connections 2023-09-23T08:54:57.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:57.657+0000 7fe2443ff700 1 --2- 172.21.15.82:0/3279196900 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe23c1024c0 0x7fe23c108d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:57.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:57.657+0000 7fe2443ff700 1 --2- 172.21.15.82:0/3279196900 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe23c100930 0x7fe23c100d50 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:57.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:57.657+0000 7fe2443ff700 1 --2- 172.21.15.82:0/3279196900 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe23c101b20 0x7fe23c101f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:57.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:57.657+0000 7fe2443ff700 1 -- 172.21.15.82:0/3279196900 >> 172.21.15.82:0/3279196900 conn(0x7fe23c0fbea0 msgr2=0x7fe23c0fe2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:54:57.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:57.657+0000 7fe2443ff700 1 -- 172.21.15.82:0/3279196900 shutdown_connections 2023-09-23T08:54:57.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:57.657+0000 7fe2443ff700 1 -- 172.21.15.82:0/3279196900 wait complete. 2023-09-23T08:54:57.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:57.658+0000 7fe2443ff700 1 Processor -- start 2023-09-23T08:54:57.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:57.658+0000 7fe2443ff700 1 -- start start 2023-09-23T08:54:57.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:57.658+0000 7fe2443ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe23c100930 0x7fe23c198690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:57.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:57.658+0000 7fe2443ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe23c101b20 0x7fe23c198bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:57.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:57.658+0000 7fe2443ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe23c1024c0 0x7fe23c19fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:57.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:57.658+0000 7fe2443ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe23c1a0210 con 0x7fe23c1024c0 2023-09-23T08:54:57.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:57.658+0000 7fe2443ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe23c1a0350 con 0x7fe23c101b20 2023-09-23T08:54:57.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:57.658+0000 7fe2443ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe23c1a04e0 con 0x7fe23c100930 2023-09-23T08:54:57.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:57.659+0000 7fe24299c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe23c1024c0 0x7fe23c19fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:57.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:57.659+0000 7fe24299c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe23c1024c0 0x7fe23c19fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33090/0 (socket says 172.21.15.82:33090) 2023-09-23T08:54:57.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:57.659+0000 7fe24299c700 1 -- 172.21.15.82:0/1260529195 learned_addr learned my addr 172.21.15.82:0/1260529195 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:54:57.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:57.659+0000 7fe24219b700 1 --2- 172.21.15.82:0/1260529195 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe23c100930 0x7fe23c198690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:57.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:57.659+0000 7fe24199a700 1 --2- 172.21.15.82:0/1260529195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe23c101b20 0x7fe23c198bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:57.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:57.659+0000 7fe24299c700 1 -- 172.21.15.82:0/1260529195 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe23c100930 msgr2=0x7fe23c198690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:57.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:57.659+0000 7fe24299c700 1 --2- 172.21.15.82:0/1260529195 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe23c100930 0x7fe23c198690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:57.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:57.659+0000 7fe24299c700 1 -- 172.21.15.82:0/1260529195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe23c101b20 msgr2=0x7fe23c198bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:57.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:57.659+0000 7fe24299c700 1 --2- 172.21.15.82:0/1260529195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe23c101b20 0x7fe23c198bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:57.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:57.659+0000 7fe24299c700 1 -- 172.21.15.82:0/1260529195 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2380095f0 con 0x7fe23c1024c0 2023-09-23T08:54:57.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:57.659+0000 7fe24199a700 1 --2- 172.21.15.82:0/1260529195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe23c101b20 0x7fe23c198bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T08:54:57.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:57.659+0000 7fe24299c700 1 --2- 172.21.15.82:0/1260529195 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe23c1024c0 0x7fe23c19fc40 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe234007d70 tx=0x7fe23400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:54:57.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:57.659+0000 7fe2337fe700 1 -- 172.21.15.82:0/1260529195 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe23400ad40 con 0x7fe23c1024c0 2023-09-23T08:54:57.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:57.660+0000 7fe2443ff700 1 -- 172.21.15.82:0/1260529195 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe23c1a07c0 con 0x7fe23c1024c0 2023-09-23T08:54:57.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:57.660+0000 7fe2337fe700 1 -- 172.21.15.82:0/1260529195 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe2340128b0 con 0x7fe23c1024c0 2023-09-23T08:54:57.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:57.660+0000 7fe2337fe700 1 -- 172.21.15.82:0/1260529195 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2340115a0 con 0x7fe23c1024c0 2023-09-23T08:54:57.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:57.660+0000 7fe2443ff700 1 -- 172.21.15.82:0/1260529195 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe23c1a0cd0 con 0x7fe23c1024c0 2023-09-23T08:54:57.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:57.661+0000 7fe2443ff700 1 -- 172.21.15.82:0/1260529195 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe23c10c040 con 0x7fe23c1024c0 2023-09-23T08:54:57.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:57.663+0000 7fe2337fe700 1 -- 172.21.15.82:0/1260529195 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 134671+0+0 (secure 0 0 0) 0x7fe234012a20 con 0x7fe23c1024c0 2023-09-23T08:54:57.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:57.664+0000 7fe2337fe700 1 --2- 172.21.15.82:0/1260529195 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fe22809ff50 0x7fe2280a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:57.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:57.664+0000 7fe2337fe700 1 -- 172.21.15.82:0/1260529195 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fe2340cb820 con 0x7fe23c1024c0 2023-09-23T08:54:57.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:57.664+0000 7fe24219b700 1 --2- 172.21.15.82:0/1260529195 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fe22809ff50 0x7fe2280a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:57.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:57.665+0000 7fe24219b700 1 --2- 172.21.15.82:0/1260529195 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fe22809ff50 0x7fe2280a2410 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe238006010 tx=0x7fe238005bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:54:57.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:57.666+0000 7fe2337fe700 1 -- 172.21.15.82:0/1260529195 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7fe234095660 con 0x7fe23c1024c0 2023-09-23T08:54:57.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:57 smithi135 ceph-mon[99205]: pgmap v303: 97 pgs: 24 creating+peering, 59 active+clean, 14 unknown; 578 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 3 op/s 2023-09-23T08:54:57.999 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:57 smithi135 ceph-mon[99205]: daemon mds.i is now active in filesystem cephfs as rank 1 2023-09-23T08:54:57.999 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:57 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/1437266850' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-09-23T08:54:58.000 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:57 smithi161 ceph-mon[99580]: pgmap v303: 97 pgs: 24 creating+peering, 59 active+clean, 14 unknown; 578 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 3 op/s 2023-09-23T08:54:58.000 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:57 smithi161 ceph-mon[99580]: daemon mds.i is now active in filesystem cephfs as rank 1 2023-09-23T08:54:58.000 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:57 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/1437266850' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-09-23T08:54:58.000 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:57 smithi082 ceph-mon[97694]: pgmap v303: 97 pgs: 24 creating+peering, 59 active+clean, 14 unknown; 578 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 3 op/s 2023-09-23T08:54:58.000 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:57 smithi082 ceph-mon[97694]: daemon mds.i is now active in filesystem cephfs as rank 1 2023-09-23T08:54:58.000 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:57 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/1437266850' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-09-23T08:54:58.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:57.916+0000 7fe2443ff700 1 -- 172.21.15.82:0/1260529195 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7fe23c10c200 con 0x7fe23c1024c0 2023-09-23T08:54:58.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:58.444+0000 7fe2337fe700 1 -- 172.21.15.82:0/1260529195 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v21) v1 ==== 115+0+0 (secure 0 0 0) 0x7fe234098c80 con 0x7fe23c1024c0 2023-09-23T08:54:58.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:58.447+0000 7fe2443ff700 1 -- 172.21.15.82:0/1260529195 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fe22809ff50 msgr2=0x7fe2280a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:58.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:58.447+0000 7fe2443ff700 1 --2- 172.21.15.82:0/1260529195 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fe22809ff50 0x7fe2280a2410 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe238006010 tx=0x7fe238005bc0 comp rx=0 tx=0).stop 2023-09-23T08:54:58.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:58.447+0000 7fe2443ff700 1 -- 172.21.15.82:0/1260529195 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe23c1024c0 msgr2=0x7fe23c19fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:58.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:58.447+0000 7fe2443ff700 1 --2- 172.21.15.82:0/1260529195 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe23c1024c0 0x7fe23c19fc40 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe234007d70 tx=0x7fe23400a340 comp rx=0 tx=0).stop 2023-09-23T08:54:58.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:58.447+0000 7fe2443ff700 1 -- 172.21.15.82:0/1260529195 shutdown_connections 2023-09-23T08:54:58.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:58.447+0000 7fe2443ff700 1 --2- 172.21.15.82:0/1260529195 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fe22809ff50 0x7fe2280a2410 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:58.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:58.447+0000 7fe2443ff700 1 --2- 172.21.15.82:0/1260529195 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe23c1024c0 0x7fe23c19fc40 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:58.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:58.447+0000 7fe2443ff700 1 --2- 172.21.15.82:0/1260529195 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe23c100930 0x7fe23c198690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:58.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:58.447+0000 7fe2443ff700 1 --2- 172.21.15.82:0/1260529195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe23c101b20 0x7fe23c198bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:58.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:58.447+0000 7fe2443ff700 1 -- 172.21.15.82:0/1260529195 >> 172.21.15.82:0/1260529195 conn(0x7fe23c0fbea0 msgr2=0x7fe23c0fe080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:54:58.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:58.448+0000 7fe2443ff700 1 -- 172.21.15.82:0/1260529195 shutdown_connections 2023-09-23T08:54:58.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:58.448+0000 7fe2443ff700 1 -- 172.21.15.82:0/1260529195 wait complete. 2023-09-23T08:54:58.474 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2} subvols for filesystem 'cephfs' 2023-09-23T08:54:58.474 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_0 '' 2023-09-23T08:54:58.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:58.674+0000 7f1de03ff700 1 -- 172.21.15.82:0/4246308786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1dd8101b00 msgr2=0x7f1dd8101f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:58.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:58.674+0000 7f1de03ff700 1 --2- 172.21.15.82:0/4246308786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1dd8101b00 0x7f1dd8101f60 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1dc80099c0 tx=0x7f1dc8009cd0 comp rx=0 tx=0).stop 2023-09-23T08:54:58.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:58.674+0000 7f1de03ff700 1 -- 172.21.15.82:0/4246308786 shutdown_connections 2023-09-23T08:54:58.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:58.674+0000 7f1de03ff700 1 --2- 172.21.15.82:0/4246308786 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1dd81024a0 0x7f1dd8108d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:58.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:58.674+0000 7f1de03ff700 1 --2- 172.21.15.82:0/4246308786 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1dd8100910 0x7f1dd8100d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:58.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:58.674+0000 7f1de03ff700 1 --2- 172.21.15.82:0/4246308786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1dd8101b00 0x7f1dd8101f60 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:58.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:58.674+0000 7f1de03ff700 1 -- 172.21.15.82:0/4246308786 >> 172.21.15.82:0/4246308786 conn(0x7f1dd80fbe60 msgr2=0x7f1dd80fe2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:54:58.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:58.674+0000 7f1de03ff700 1 -- 172.21.15.82:0/4246308786 shutdown_connections 2023-09-23T08:54:58.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:58.674+0000 7f1de03ff700 1 -- 172.21.15.82:0/4246308786 wait complete. 2023-09-23T08:54:58.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:58.675+0000 7f1de03ff700 1 Processor -- start 2023-09-23T08:54:58.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:58.675+0000 7f1de03ff700 1 -- start start 2023-09-23T08:54:58.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:58.676+0000 7f1de03ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1dd8100910 0x7f1dd8198760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:58.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:58.676+0000 7f1de03ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1dd8101b00 0x7f1dd8198ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:58.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:58.676+0000 7f1de03ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1dd81024a0 0x7f1dd819fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:58.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:58.676+0000 7f1de03ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd81a02e0 con 0x7f1dd81024a0 2023-09-23T08:54:58.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:58.676+0000 7f1de03ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd81a0420 con 0x7f1dd8100910 2023-09-23T08:54:58.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:58.676+0000 7f1de03ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd81a05b0 con 0x7f1dd8101b00 2023-09-23T08:54:58.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:58.676+0000 7f1dde99c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1dd81024a0 0x7f1dd819fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:58.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:58.676+0000 7f1dde19b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1dd8100910 0x7f1dd8198760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:58.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:58.676+0000 7f1dde19b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1dd8100910 0x7f1dd8198760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:39112/0 (socket says 172.21.15.82:39112) 2023-09-23T08:54:58.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:58.676+0000 7f1dde99c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1dd81024a0 0x7f1dd819fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33106/0 (socket says 172.21.15.82:33106) 2023-09-23T08:54:58.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:58.676+0000 7f1dde19b700 1 -- 172.21.15.82:0/254078316 learned_addr learned my addr 172.21.15.82:0/254078316 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:54:58.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:58.676+0000 7f1ddd99a700 1 --2- 172.21.15.82:0/254078316 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1dd8101b00 0x7f1dd8198ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:58.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:58.676+0000 7f1dde99c700 1 -- 172.21.15.82:0/254078316 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1dd8101b00 msgr2=0x7f1dd8198ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:58.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:58.676+0000 7f1dde99c700 1 --2- 172.21.15.82:0/254078316 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1dd8101b00 0x7f1dd8198ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:58.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:58.676+0000 7f1dde99c700 1 -- 172.21.15.82:0/254078316 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1dd8100910 msgr2=0x7f1dd8198760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:58.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:58.676+0000 7f1dde99c700 1 --2- 172.21.15.82:0/254078316 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1dd8100910 0x7f1dd8198760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:58.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:58.676+0000 7f1dde99c700 1 -- 172.21.15.82:0/254078316 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dc80095f0 con 0x7f1dd81024a0 2023-09-23T08:54:58.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:58.676+0000 7f1dde19b700 1 --2- 172.21.15.82:0/254078316 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1dd8100910 0x7f1dd8198760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T08:54:58.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:58.677+0000 7f1dde99c700 1 --2- 172.21.15.82:0/254078316 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1dd81024a0 0x7f1dd819fd10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1dd000efc0 tx=0x7f1dd000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:54:58.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:58.677+0000 7f1dcf7fe700 1 -- 172.21.15.82:0/254078316 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd0018070 con 0x7f1dd81024a0 2023-09-23T08:54:58.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:58.677+0000 7f1dcf7fe700 1 -- 172.21.15.82:0/254078316 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1dd000f040 con 0x7f1dd81024a0 2023-09-23T08:54:58.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:58.677+0000 7f1de03ff700 1 -- 172.21.15.82:0/254078316 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dd81a0830 con 0x7f1dd81024a0 2023-09-23T08:54:58.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:58.677+0000 7f1dcf7fe700 1 -- 172.21.15.82:0/254078316 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd000cba0 con 0x7f1dd81024a0 2023-09-23T08:54:58.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:58.677+0000 7f1de03ff700 1 -- 172.21.15.82:0/254078316 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dd81a0cf0 con 0x7f1dd81024a0 2023-09-23T08:54:58.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:58.678+0000 7f1de03ff700 1 -- 172.21.15.82:0/254078316 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dd810c020 con 0x7f1dd81024a0 2023-09-23T08:54:58.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:58.680+0000 7f1dcf7fe700 1 -- 172.21.15.82:0/254078316 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 134671+0+0 (secure 0 0 0) 0x7f1dd0003a00 con 0x7f1dd81024a0 2023-09-23T08:54:58.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:58.681+0000 7f1dcf7fe700 1 --2- 172.21.15.82:0/254078316 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f1dc409ff50 0x7f1dc40a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:58.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:58.681+0000 7f1dcf7fe700 1 -- 172.21.15.82:0/254078316 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f1dd00cac90 con 0x7f1dd81024a0 2023-09-23T08:54:58.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:58.682+0000 7f1dde19b700 1 --2- 172.21.15.82:0/254078316 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f1dc409ff50 0x7f1dc40a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:58.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:58.682+0000 7f1dde19b700 1 --2- 172.21.15.82:0/254078316 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f1dc409ff50 0x7f1dc40a2410 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1dd4005950 tx=0x7f1dd4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:54:58.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:58.685+0000 7f1dcf7fe700 1 -- 172.21.15.82:0/254078316 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f1dd0094b60 con 0x7f1dd81024a0 2023-09-23T08:54:58.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:58 smithi135 ceph-mon[99205]: mds.? [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] up:active 2023-09-23T08:54:58.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:58 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/1437266850' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-09-23T08:54:58.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:58 smithi135 ceph-mon[99205]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2023-09-23T08:54:58.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:58 smithi135 ceph-mon[99205]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2023-09-23T08:54:58.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:58 smithi135 ceph-mon[99205]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2023-09-23T08:54:58.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:58 smithi135 ceph-mon[99205]: daemon mds.c is now active in filesystem cephfs as rank 2 2023-09-23T08:54:58.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:58 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/1260529195' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-09-23T08:54:58.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:58 smithi082 ceph-mon[97694]: mds.? [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] up:active 2023-09-23T08:54:58.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:58 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/1437266850' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-09-23T08:54:58.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:58 smithi082 ceph-mon[97694]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2023-09-23T08:54:58.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:58 smithi082 ceph-mon[97694]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2023-09-23T08:54:58.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:58 smithi082 ceph-mon[97694]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2023-09-23T08:54:58.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:58 smithi082 ceph-mon[97694]: daemon mds.c is now active in filesystem cephfs as rank 2 2023-09-23T08:54:58.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:58 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/1260529195' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-09-23T08:54:58.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:58 smithi161 ceph-mon[99580]: mds.? [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] up:active 2023-09-23T08:54:58.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:58 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/1437266850' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-09-23T08:54:58.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:58 smithi161 ceph-mon[99580]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2023-09-23T08:54:58.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:58 smithi161 ceph-mon[99580]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2023-09-23T08:54:58.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:58 smithi161 ceph-mon[99580]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2023-09-23T08:54:58.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:58 smithi161 ceph-mon[99580]: daemon mds.c is now active in filesystem cephfs as rank 2 2023-09-23T08:54:58.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:58 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/1260529195' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-09-23T08:54:58.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:58.915+0000 7f1de03ff700 1 -- 172.21.15.82:0/254078316 --> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}) v1 -- 0x7f1dd81084f0 con 0x7f1dc409ff50 2023-09-23T08:54:58.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:58.964+0000 7f1dcf7fe700 1 -- 172.21.15.82:0/254078316 <== mgr.14152 v2:172.21.15.82:6800/3698954311 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f1dd81084f0 con 0x7f1dc409ff50 2023-09-23T08:54:58.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:58.967+0000 7f1de03ff700 1 -- 172.21.15.82:0/254078316 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f1dc409ff50 msgr2=0x7f1dc40a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:58.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:58.967+0000 7f1de03ff700 1 --2- 172.21.15.82:0/254078316 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f1dc409ff50 0x7f1dc40a2410 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1dd4005950 tx=0x7f1dd4009260 comp rx=0 tx=0).stop 2023-09-23T08:54:58.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:58.967+0000 7f1de03ff700 1 -- 172.21.15.82:0/254078316 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1dd81024a0 msgr2=0x7f1dd819fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:58.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:58.967+0000 7f1de03ff700 1 --2- 172.21.15.82:0/254078316 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1dd81024a0 0x7f1dd819fd10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1dd000efc0 tx=0x7f1dd000c3a0 comp rx=0 tx=0).stop 2023-09-23T08:54:58.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:58.967+0000 7f1de03ff700 1 -- 172.21.15.82:0/254078316 shutdown_connections 2023-09-23T08:54:58.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:58.967+0000 7f1de03ff700 1 --2- 172.21.15.82:0/254078316 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f1dc409ff50 0x7f1dc40a2410 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:58.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:58.967+0000 7f1de03ff700 1 --2- 172.21.15.82:0/254078316 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1dd81024a0 0x7f1dd819fd10 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:58.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:58.967+0000 7f1de03ff700 1 --2- 172.21.15.82:0/254078316 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1dd8100910 0x7f1dd8198760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:58.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:58.967+0000 7f1de03ff700 1 --2- 172.21.15.82:0/254078316 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1dd8101b00 0x7f1dd8198ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:58.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:58.967+0000 7f1de03ff700 1 -- 172.21.15.82:0/254078316 >> 172.21.15.82:0/254078316 conn(0x7f1dd80fbe60 msgr2=0x7f1dd80fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:54:58.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:58.967+0000 7f1de03ff700 1 -- 172.21.15.82:0/254078316 shutdown_connections 2023-09-23T08:54:58.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:58.967+0000 7f1de03ff700 1 -- 172.21.15.82:0/254078316 wait complete. 2023-09-23T08:54:58.989 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv_0 2023-09-23T08:54:59.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.185+0000 7f5b239ff700 1 -- 172.21.15.82:0/3628453593 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b1c100930 msgr2=0x7f5b1c100d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:59.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.185+0000 7f5b239ff700 1 --2- 172.21.15.82:0/3628453593 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b1c100930 0x7f5b1c100d50 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5b180099c0 tx=0x7f5b18009cd0 comp rx=0 tx=0).stop 2023-09-23T08:54:59.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.185+0000 7f5b239ff700 1 -- 172.21.15.82:0/3628453593 shutdown_connections 2023-09-23T08:54:59.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.185+0000 7f5b239ff700 1 --2- 172.21.15.82:0/3628453593 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b1c1024c0 0x7f5b1c108d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:59.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.185+0000 7f5b239ff700 1 --2- 172.21.15.82:0/3628453593 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b1c100930 0x7f5b1c100d50 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:59.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.185+0000 7f5b239ff700 1 --2- 172.21.15.82:0/3628453593 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b1c101b20 0x7f5b1c101f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:59.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.185+0000 7f5b239ff700 1 -- 172.21.15.82:0/3628453593 >> 172.21.15.82:0/3628453593 conn(0x7f5b1c0fbea0 msgr2=0x7f5b1c0fe2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:54:59.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.185+0000 7f5b239ff700 1 -- 172.21.15.82:0/3628453593 shutdown_connections 2023-09-23T08:54:59.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.185+0000 7f5b239ff700 1 -- 172.21.15.82:0/3628453593 wait complete. 2023-09-23T08:54:59.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.187+0000 7f5b239ff700 1 Processor -- start 2023-09-23T08:54:59.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.187+0000 7f5b239ff700 1 -- start start 2023-09-23T08:54:59.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.187+0000 7f5b239ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b1c100930 0x7f5b1c196620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:59.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.187+0000 7f5b239ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b1c101b20 0x7f5b1c196b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:59.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.187+0000 7f5b239ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b1c1024c0 0x7f5b1c19dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:59.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.187+0000 7f5b239ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1c19e1a0 con 0x7f5b1c101b20 2023-09-23T08:54:59.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.188+0000 7f5b239ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1c19e2e0 con 0x7f5b1c100930 2023-09-23T08:54:59.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.188+0000 7f5b239ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1c19e470 con 0x7f5b1c1024c0 2023-09-23T08:54:59.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.188+0000 7f5b20f9a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b1c101b20 0x7f5b1c196b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:59.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.188+0000 7f5b20f9a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b1c101b20 0x7f5b1c196b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33130/0 (socket says 172.21.15.82:33130) 2023-09-23T08:54:59.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.188+0000 7f5b20f9a700 1 -- 172.21.15.82:0/2022231655 learned_addr learned my addr 172.21.15.82:0/2022231655 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:54:59.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.188+0000 7f5b2179b700 1 --2- 172.21.15.82:0/2022231655 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b1c100930 0x7f5b1c196620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:59.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.188+0000 7f5b21f9c700 1 --2- 172.21.15.82:0/2022231655 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b1c1024c0 0x7f5b1c19dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:59.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.188+0000 7f5b20f9a700 1 -- 172.21.15.82:0/2022231655 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b1c1024c0 msgr2=0x7f5b1c19dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:59.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.188+0000 7f5b20f9a700 1 --2- 172.21.15.82:0/2022231655 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b1c1024c0 0x7f5b1c19dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:59.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.188+0000 7f5b20f9a700 1 -- 172.21.15.82:0/2022231655 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b1c100930 msgr2=0x7f5b1c196620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:59.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.188+0000 7f5b20f9a700 1 --2- 172.21.15.82:0/2022231655 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b1c100930 0x7f5b1c196620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:59.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.188+0000 7f5b20f9a700 1 -- 172.21.15.82:0/2022231655 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b180095f0 con 0x7f5b1c101b20 2023-09-23T08:54:59.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.188+0000 7f5b20f9a700 1 --2- 172.21.15.82:0/2022231655 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b1c101b20 0x7f5b1c196b60 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c00d950 tx=0x7f5b0c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:54:59.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.189+0000 7f5b127fc700 1 -- 172.21.15.82:0/2022231655 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c009940 con 0x7f5b1c101b20 2023-09-23T08:54:59.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.189+0000 7f5b239ff700 1 -- 172.21.15.82:0/2022231655 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b1c19e750 con 0x7f5b1c101b20 2023-09-23T08:54:59.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.189+0000 7f5b127fc700 1 -- 172.21.15.82:0/2022231655 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5b0c010460 con 0x7f5b1c101b20 2023-09-23T08:54:59.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.189+0000 7f5b127fc700 1 -- 172.21.15.82:0/2022231655 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c00f620 con 0x7f5b1c101b20 2023-09-23T08:54:59.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.189+0000 7f5b239ff700 1 -- 172.21.15.82:0/2022231655 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b1c19ecb0 con 0x7f5b1c101b20 2023-09-23T08:54:59.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.190+0000 7f5b239ff700 1 -- 172.21.15.82:0/2022231655 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b1c10c0c0 con 0x7f5b1c101b20 2023-09-23T08:54:59.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.192+0000 7f5b127fc700 1 -- 172.21.15.82:0/2022231655 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 134671+0+0 (secure 0 0 0) 0x7f5b0c0105d0 con 0x7f5b1c101b20 2023-09-23T08:54:59.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.194+0000 7f5b127fc700 1 --2- 172.21.15.82:0/2022231655 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f5b0809ff50 0x7f5b080a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:59.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.194+0000 7f5b127fc700 1 -- 172.21.15.82:0/2022231655 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f5b0c0cafa0 con 0x7f5b1c101b20 2023-09-23T08:54:59.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.194+0000 7f5b2179b700 1 --2- 172.21.15.82:0/2022231655 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f5b0809ff50 0x7f5b080a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:59.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.195+0000 7f5b2179b700 1 --2- 172.21.15.82:0/2022231655 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f5b0809ff50 0x7f5b080a2410 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f5b18006010 tx=0x7f5b1800ba10 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:54:59.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.196+0000 7f5b127fc700 1 -- 172.21.15.82:0/2022231655 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f5b0c094de0 con 0x7f5b1c101b20 2023-09-23T08:54:59.370 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:54:58 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:54:58.921+0000 7f4789a52700 -1 client.0 error registering admin socket command: (17) File exists 2023-09-23T08:54:59.371 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:54:58 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:54:58.921+0000 7f4789a52700 -1 client.0 error registering admin socket command: (17) File exists 2023-09-23T08:54:59.371 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:54:58 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:54:58.921+0000 7f4789a52700 -1 client.0 error registering admin socket command: (17) File exists 2023-09-23T08:54:59.371 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:54:58 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:54:58.921+0000 7f4789a52700 -1 client.0 error registering admin socket command: (17) File exists 2023-09-23T08:54:59.371 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:54:58 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:54:58.921+0000 7f4789a52700 -1 client.0 error registering admin socket command: (17) File exists 2023-09-23T08:54:59.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.430+0000 7f5b239ff700 1 -- 172.21.15.82:0/2022231655 --> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) v1 -- 0x7f5b1c19eed0 con 0x7f5b0809ff50 2023-09-23T08:54:59.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.434+0000 7f5b127fc700 1 -- 172.21.15.82:0/2022231655 <== mgr.14152 v2:172.21.15.82:6800/3698954311 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+60 (secure 0 0 0) 0x7f5b1c19eed0 con 0x7f5b0809ff50 2023-09-23T08:54:59.438 INFO:teuthology.orchestra.run.smithi082.stdout:/volumes/_nogroup/sv_0/4a4aa33e-0419-4bf8-bddc-904368245988 2023-09-23T08:54:59.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.437+0000 7f5b239ff700 1 -- 172.21.15.82:0/2022231655 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f5b0809ff50 msgr2=0x7f5b080a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:59.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.437+0000 7f5b239ff700 1 --2- 172.21.15.82:0/2022231655 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f5b0809ff50 0x7f5b080a2410 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f5b18006010 tx=0x7f5b1800ba10 comp rx=0 tx=0).stop 2023-09-23T08:54:59.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.437+0000 7f5b239ff700 1 -- 172.21.15.82:0/2022231655 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b1c101b20 msgr2=0x7f5b1c196b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:59.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.437+0000 7f5b239ff700 1 --2- 172.21.15.82:0/2022231655 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b1c101b20 0x7f5b1c196b60 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c00d950 tx=0x7f5b0c00dc60 comp rx=0 tx=0).stop 2023-09-23T08:54:59.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.437+0000 7f5b239ff700 1 -- 172.21.15.82:0/2022231655 shutdown_connections 2023-09-23T08:54:59.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.437+0000 7f5b239ff700 1 --2- 172.21.15.82:0/2022231655 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f5b0809ff50 0x7f5b080a2410 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:59.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.437+0000 7f5b239ff700 1 --2- 172.21.15.82:0/2022231655 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b1c1024c0 0x7f5b1c19dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:59.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.437+0000 7f5b239ff700 1 --2- 172.21.15.82:0/2022231655 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b1c100930 0x7f5b1c196620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:59.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.437+0000 7f5b239ff700 1 --2- 172.21.15.82:0/2022231655 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b1c101b20 0x7f5b1c196b60 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:59.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.437+0000 7f5b239ff700 1 -- 172.21.15.82:0/2022231655 >> 172.21.15.82:0/2022231655 conn(0x7f5b1c0fbea0 msgr2=0x7f5b1c0fe1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:54:59.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.437+0000 7f5b239ff700 1 -- 172.21.15.82:0/2022231655 shutdown_connections 2023-09-23T08:54:59.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.437+0000 7f5b239ff700 1 -- 172.21.15.82:0/2022231655 wait complete. 2023-09-23T08:54:59.460 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_1 '' 2023-09-23T08:54:59.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.661+0000 7f067b1ff700 1 -- 172.21.15.82:0/1894750541 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0674100930 msgr2=0x7f0674100d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:59.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.661+0000 7f067b1ff700 1 --2- 172.21.15.82:0/1894750541 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0674100930 0x7f0674100d50 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f06680099c0 tx=0x7f0668009cd0 comp rx=0 tx=0).stop 2023-09-23T08:54:59.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.661+0000 7f067b1ff700 1 -- 172.21.15.82:0/1894750541 shutdown_connections 2023-09-23T08:54:59.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.661+0000 7f067b1ff700 1 --2- 172.21.15.82:0/1894750541 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f06741024c0 0x7f0674108d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:59.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.661+0000 7f067b1ff700 1 --2- 172.21.15.82:0/1894750541 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0674100930 0x7f0674100d50 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:59.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.661+0000 7f067b1ff700 1 --2- 172.21.15.82:0/1894750541 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0674101b20 0x7f0674101f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:59.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.661+0000 7f067b1ff700 1 -- 172.21.15.82:0/1894750541 >> 172.21.15.82:0/1894750541 conn(0x7f06740fbea0 msgr2=0x7f06740fe2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:54:59.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.661+0000 7f067b1ff700 1 -- 172.21.15.82:0/1894750541 shutdown_connections 2023-09-23T08:54:59.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.661+0000 7f067b1ff700 1 -- 172.21.15.82:0/1894750541 wait complete. 2023-09-23T08:54:59.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.662+0000 7f067b1ff700 1 Processor -- start 2023-09-23T08:54:59.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.662+0000 7f067b1ff700 1 -- start start 2023-09-23T08:54:59.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.663+0000 7f067b1ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0674100930 0x7f0674198890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:59.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.663+0000 7f067b1ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0674101b20 0x7f0674198dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:59.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.663+0000 7f067b1ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06741024c0 0x7f067419fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:59.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.663+0000 7f067b1ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06741a0410 con 0x7f0674100930 2023-09-23T08:54:59.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.663+0000 7f067b1ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06741a0550 con 0x7f06741024c0 2023-09-23T08:54:59.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.663+0000 7f067b1ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06741a06e0 con 0x7f0674101b20 2023-09-23T08:54:59.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.663+0000 7f0678f9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0674100930 0x7f0674198890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:59.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.663+0000 7f0678f9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0674100930 0x7f0674198890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33148/0 (socket says 172.21.15.82:33148) 2023-09-23T08:54:59.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.663+0000 7f0678f9b700 1 -- 172.21.15.82:0/3077438572 learned_addr learned my addr 172.21.15.82:0/3077438572 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:54:59.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.663+0000 7f0673fff700 1 --2- 172.21.15.82:0/3077438572 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0674101b20 0x7f0674198dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:59.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.663+0000 7f0678f9b700 1 -- 172.21.15.82:0/3077438572 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0674101b20 msgr2=0x7f0674198dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:59.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.663+0000 7f0678f9b700 1 --2- 172.21.15.82:0/3077438572 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0674101b20 0x7f0674198dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:59.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.663+0000 7f0678f9b700 1 -- 172.21.15.82:0/3077438572 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06741024c0 msgr2=0x7f067419fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:59.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.663+0000 7f0678f9b700 1 --2- 172.21.15.82:0/3077438572 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06741024c0 0x7f067419fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:59.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.663+0000 7f0678f9b700 1 -- 172.21.15.82:0/3077438572 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06680095f0 con 0x7f0674100930 2023-09-23T08:54:59.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.663+0000 7f0673fff700 1 --2- 172.21.15.82:0/3077438572 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0674101b20 0x7f0674198dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T08:54:59.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.663+0000 7f0678f9b700 1 --2- 172.21.15.82:0/3077438572 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0674100930 0x7f0674198890 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f06680098e0 tx=0x7f0668009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:54:59.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.664+0000 7f0671ffb700 1 -- 172.21.15.82:0/3077438572 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f066801d070 con 0x7f0674100930 2023-09-23T08:54:59.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.664+0000 7f0671ffb700 1 -- 172.21.15.82:0/3077438572 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0668004100 con 0x7f0674100930 2023-09-23T08:54:59.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.664+0000 7f067b1ff700 1 -- 172.21.15.82:0/3077438572 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06741a0960 con 0x7f0674100930 2023-09-23T08:54:59.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.664+0000 7f0671ffb700 1 -- 172.21.15.82:0/3077438572 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0668005270 con 0x7f0674100930 2023-09-23T08:54:59.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.664+0000 7f067b1ff700 1 -- 172.21.15.82:0/3077438572 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06741a0d80 con 0x7f0674100930 2023-09-23T08:54:59.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.665+0000 7f067b1ff700 1 -- 172.21.15.82:0/3077438572 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0674192eb0 con 0x7f0674100930 2023-09-23T08:54:59.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.668+0000 7f0671ffb700 1 -- 172.21.15.82:0/3077438572 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 134671+0+0 (secure 0 0 0) 0x7f06680049a0 con 0x7f0674100930 2023-09-23T08:54:59.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.669+0000 7f0671ffb700 1 --2- 172.21.15.82:0/3077438572 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f066409ffd0 0x7f06640a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:54:59.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.669+0000 7f0671ffb700 1 -- 172.21.15.82:0/3077438572 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f06680cc0f0 con 0x7f0674100930 2023-09-23T08:54:59.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.669+0000 7f0673fff700 1 --2- 172.21.15.82:0/3077438572 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f066409ffd0 0x7f06640a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:54:59.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.670+0000 7f0673fff700 1 --2- 172.21.15.82:0/3077438572 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f066409ffd0 0x7f06640a2490 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0660005950 tx=0x7f06600058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:54:59.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.671+0000 7f0671ffb700 1 -- 172.21.15.82:0/3077438572 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f0668095fc0 con 0x7f0674100930 2023-09-23T08:54:59.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:59 smithi135 ceph-mon[99205]: pgmap v304: 97 pgs: 97 active+clean; 579 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s wr, 10 op/s 2023-09-23T08:54:59.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:59 smithi135 ceph-mon[99205]: mds.? [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] up:active 2023-09-23T08:54:59.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:59 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/1260529195' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-09-23T08:54:59.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:59 smithi135 ceph-mon[99205]: daemon mds.h assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2023-09-23T08:54:59.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:59 smithi135 ceph-mon[99205]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2023-09-23T08:54:59.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:59 smithi135 ceph-mon[99205]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=h=up:creating} 8 up:standby 2023-09-23T08:54:59.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:54:59 smithi135 ceph-mon[99205]: daemon mds.h is now active in filesystem cephfs as rank 3 2023-09-23T08:54:59.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:59 smithi082 ceph-mon[97694]: pgmap v304: 97 pgs: 97 active+clean; 579 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s wr, 10 op/s 2023-09-23T08:54:59.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:59 smithi082 ceph-mon[97694]: mds.? [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] up:active 2023-09-23T08:54:59.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:59 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/1260529195' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-09-23T08:54:59.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:59 smithi082 ceph-mon[97694]: daemon mds.h assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2023-09-23T08:54:59.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:59 smithi082 ceph-mon[97694]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2023-09-23T08:54:59.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:59 smithi082 ceph-mon[97694]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=h=up:creating} 8 up:standby 2023-09-23T08:54:59.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:54:59 smithi082 ceph-mon[97694]: daemon mds.h is now active in filesystem cephfs as rank 3 2023-09-23T08:54:59.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:59 smithi161 ceph-mon[99580]: pgmap v304: 97 pgs: 97 active+clean; 579 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s wr, 10 op/s 2023-09-23T08:54:59.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:59 smithi161 ceph-mon[99580]: mds.? [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] up:active 2023-09-23T08:54:59.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:59 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/1260529195' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-09-23T08:54:59.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:59 smithi161 ceph-mon[99580]: daemon mds.h assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2023-09-23T08:54:59.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:59 smithi161 ceph-mon[99580]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2023-09-23T08:54:59.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:59 smithi161 ceph-mon[99580]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=h=up:creating} 8 up:standby 2023-09-23T08:54:59.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:54:59 smithi161 ceph-mon[99580]: daemon mds.h is now active in filesystem cephfs as rank 3 2023-09-23T08:54:59.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.904+0000 7f067b1ff700 1 -- 172.21.15.82:0/3077438572 --> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}) v1 -- 0x7f067402cee0 con 0x7f066409ffd0 2023-09-23T08:54:59.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.930+0000 7f0671ffb700 1 -- 172.21.15.82:0/3077438572 <== mgr.14152 v2:172.21.15.82:6800/3698954311 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f067402cee0 con 0x7f066409ffd0 2023-09-23T08:54:59.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.933+0000 7f067b1ff700 1 -- 172.21.15.82:0/3077438572 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f066409ffd0 msgr2=0x7f06640a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:59.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.933+0000 7f067b1ff700 1 --2- 172.21.15.82:0/3077438572 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f066409ffd0 0x7f06640a2490 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0660005950 tx=0x7f06600058e0 comp rx=0 tx=0).stop 2023-09-23T08:54:59.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.933+0000 7f067b1ff700 1 -- 172.21.15.82:0/3077438572 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0674100930 msgr2=0x7f0674198890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:54:59.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.933+0000 7f067b1ff700 1 --2- 172.21.15.82:0/3077438572 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0674100930 0x7f0674198890 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f06680098e0 tx=0x7f0668009580 comp rx=0 tx=0).stop 2023-09-23T08:54:59.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.933+0000 7f067b1ff700 1 -- 172.21.15.82:0/3077438572 shutdown_connections 2023-09-23T08:54:59.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.933+0000 7f067b1ff700 1 --2- 172.21.15.82:0/3077438572 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f066409ffd0 0x7f06640a2490 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:59.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.933+0000 7f067b1ff700 1 --2- 172.21.15.82:0/3077438572 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06741024c0 0x7f067419fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:59.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.933+0000 7f067b1ff700 1 --2- 172.21.15.82:0/3077438572 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0674100930 0x7f0674198890 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:59.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.933+0000 7f067b1ff700 1 --2- 172.21.15.82:0/3077438572 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0674101b20 0x7f0674198dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:54:59.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.933+0000 7f067b1ff700 1 -- 172.21.15.82:0/3077438572 >> 172.21.15.82:0/3077438572 conn(0x7f06740fbea0 msgr2=0x7f06741074f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:54:59.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.933+0000 7f067b1ff700 1 -- 172.21.15.82:0/3077438572 shutdown_connections 2023-09-23T08:54:59.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:54:59.933+0000 7f067b1ff700 1 -- 172.21.15.82:0/3077438572 wait complete. 2023-09-23T08:54:59.954 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv_1 2023-09-23T08:55:00.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.157+0000 7f01d8dff700 1 -- 172.21.15.82:0/1134434548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01d41087d0 msgr2=0x7f01d410ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:00.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.157+0000 7f01d8dff700 1 --2- 172.21.15.82:0/1134434548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01d41087d0 0x7f01d410ac60 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f01cc00b0a0 tx=0x7f01cc00b3b0 comp rx=0 tx=0).stop 2023-09-23T08:55:00.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.157+0000 7f01d8dff700 1 -- 172.21.15.82:0/1134434548 shutdown_connections 2023-09-23T08:55:00.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.157+0000 7f01d8dff700 1 --2- 172.21.15.82:0/1134434548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01d41087d0 0x7f01d410ac60 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:00.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.157+0000 7f01d8dff700 1 --2- 172.21.15.82:0/1134434548 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f01d4074960 0x7f01d4072db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:00.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.157+0000 7f01d8dff700 1 --2- 172.21.15.82:0/1134434548 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f01d4073380 0x7f01d4073800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:00.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.157+0000 7f01d8dff700 1 -- 172.21.15.82:0/1134434548 >> 172.21.15.82:0/1134434548 conn(0x7f01d40fbe60 msgr2=0x7f01d40fe2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:00.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.157+0000 7f01d8dff700 1 -- 172.21.15.82:0/1134434548 shutdown_connections 2023-09-23T08:55:00.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.157+0000 7f01d8dff700 1 -- 172.21.15.82:0/1134434548 wait complete. 2023-09-23T08:55:00.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.158+0000 7f01d8dff700 1 Processor -- start 2023-09-23T08:55:00.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.158+0000 7f01d8dff700 1 -- start start 2023-09-23T08:55:00.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.159+0000 7f01d8dff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f01d4073380 0x7f01d4198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:00.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.159+0000 7f01d8dff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f01d4074960 0x7f01d4198dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:00.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.159+0000 7f01d8dff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01d41087d0 0x7f01d419fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:00.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.159+0000 7f01d8dff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d41a0400 con 0x7f01d41087d0 2023-09-23T08:55:00.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.159+0000 7f01d8dff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d41a0540 con 0x7f01d4074960 2023-09-23T08:55:00.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.159+0000 7f01d8dff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d41a06d0 con 0x7f01d4073380 2023-09-23T08:55:00.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.159+0000 7f01d2d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01d41087d0 0x7f01d419fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:00.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.159+0000 7f01d2d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01d41087d0 0x7f01d419fe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33174/0 (socket says 172.21.15.82:33174) 2023-09-23T08:55:00.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.159+0000 7f01d2d9d700 1 -- 172.21.15.82:0/2732650219 learned_addr learned my addr 172.21.15.82:0/2732650219 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:55:00.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.159+0000 7f01d259c700 1 --2- 172.21.15.82:0/2732650219 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f01d4073380 0x7f01d4198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:00.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.159+0000 7f01d1d9b700 1 --2- 172.21.15.82:0/2732650219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f01d4074960 0x7f01d4198dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:00.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.159+0000 7f01d2d9d700 1 -- 172.21.15.82:0/2732650219 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f01d4073380 msgr2=0x7f01d4198880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:00.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.159+0000 7f01d2d9d700 1 --2- 172.21.15.82:0/2732650219 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f01d4073380 0x7f01d4198880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:00.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.159+0000 7f01d2d9d700 1 -- 172.21.15.82:0/2732650219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f01d4074960 msgr2=0x7f01d4198dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:00.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.159+0000 7f01d2d9d700 1 --2- 172.21.15.82:0/2732650219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f01d4074960 0x7f01d4198dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:00.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.159+0000 7f01d2d9d700 1 -- 172.21.15.82:0/2732650219 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01cc009d00 con 0x7f01d41087d0 2023-09-23T08:55:00.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.159+0000 7f01d1d9b700 1 --2- 172.21.15.82:0/2732650219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f01d4074960 0x7f01d4198dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T08:55:00.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.160+0000 7f01d2d9d700 1 --2- 172.21.15.82:0/2732650219 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01d41087d0 0x7f01d419fe30 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f01cc00b070 tx=0x7f01cc004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:00.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.160+0000 7f01c37fe700 1 -- 172.21.15.82:0/2732650219 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01cc00e040 con 0x7f01d41087d0 2023-09-23T08:55:00.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.160+0000 7f01c37fe700 1 -- 172.21.15.82:0/2732650219 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f01cc003e90 con 0x7f01d41087d0 2023-09-23T08:55:00.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.160+0000 7f01c37fe700 1 -- 172.21.15.82:0/2732650219 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01cc004020 con 0x7f01d41087d0 2023-09-23T08:55:00.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.160+0000 7f01d8dff700 1 -- 172.21.15.82:0/2732650219 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01d41a0950 con 0x7f01d41087d0 2023-09-23T08:55:00.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.160+0000 7f01d8dff700 1 -- 172.21.15.82:0/2732650219 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01d41a0dd0 con 0x7f01d41087d0 2023-09-23T08:55:00.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.161+0000 7f01d8dff700 1 -- 172.21.15.82:0/2732650219 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01d4106e80 con 0x7f01d41087d0 2023-09-23T08:55:00.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.163+0000 7f01c37fe700 1 -- 172.21.15.82:0/2732650219 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 134671+0+0 (secure 0 0 0) 0x7f01cc01b660 con 0x7f01d41087d0 2023-09-23T08:55:00.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.164+0000 7f01c37fe700 1 --2- 172.21.15.82:0/2732650219 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f01bc09ffd0 0x7f01bc0a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:00.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.165+0000 7f01c37fe700 1 -- 172.21.15.82:0/2732650219 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f01cc0cc740 con 0x7f01d41087d0 2023-09-23T08:55:00.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.165+0000 7f01d259c700 1 --2- 172.21.15.82:0/2732650219 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f01bc09ffd0 0x7f01bc0a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:00.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.165+0000 7f01d259c700 1 --2- 172.21.15.82:0/2732650219 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f01bc09ffd0 0x7f01bc0a2490 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f01c4005950 tx=0x7f01c400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:00.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.168+0000 7f01c37fe700 1 -- 172.21.15.82:0/2732650219 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f01cc096610 con 0x7f01d41087d0 2023-09-23T08:55:00.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.401+0000 7f01d8dff700 1 -- 172.21.15.82:0/2732650219 --> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f01d402ce10 con 0x7f01bc09ffd0 2023-09-23T08:55:00.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.406+0000 7f01c37fe700 1 -- 172.21.15.82:0/2732650219 <== mgr.14152 v2:172.21.15.82:6800/3698954311 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+60 (secure 0 0 0) 0x7f01d402ce10 con 0x7f01bc09ffd0 2023-09-23T08:55:00.408 INFO:teuthology.orchestra.run.smithi082.stdout:/volumes/_nogroup/sv_1/9bfd85cc-dcf7-4125-b9d9-04b0e24a0a5d 2023-09-23T08:55:00.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.408+0000 7f01d8dff700 1 -- 172.21.15.82:0/2732650219 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f01bc09ffd0 msgr2=0x7f01bc0a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:00.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.408+0000 7f01d8dff700 1 --2- 172.21.15.82:0/2732650219 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f01bc09ffd0 0x7f01bc0a2490 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f01c4005950 tx=0x7f01c400b410 comp rx=0 tx=0).stop 2023-09-23T08:55:00.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.408+0000 7f01d8dff700 1 -- 172.21.15.82:0/2732650219 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01d41087d0 msgr2=0x7f01d419fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:00.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.408+0000 7f01d8dff700 1 --2- 172.21.15.82:0/2732650219 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01d41087d0 0x7f01d419fe30 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f01cc00b070 tx=0x7f01cc004c80 comp rx=0 tx=0).stop 2023-09-23T08:55:00.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.408+0000 7f01d8dff700 1 -- 172.21.15.82:0/2732650219 shutdown_connections 2023-09-23T08:55:00.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.408+0000 7f01d8dff700 1 --2- 172.21.15.82:0/2732650219 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f01bc09ffd0 0x7f01bc0a2490 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:00.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.408+0000 7f01d8dff700 1 --2- 172.21.15.82:0/2732650219 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01d41087d0 0x7f01d419fe30 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:00.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.408+0000 7f01d8dff700 1 --2- 172.21.15.82:0/2732650219 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f01d4073380 0x7f01d4198880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:00.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.408+0000 7f01d8dff700 1 --2- 172.21.15.82:0/2732650219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f01d4074960 0x7f01d4198dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:00.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.408+0000 7f01d8dff700 1 -- 172.21.15.82:0/2732650219 >> 172.21.15.82:0/2732650219 conn(0x7f01d40fbe60 msgr2=0x7f01d40fe250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:00.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.408+0000 7f01d8dff700 1 -- 172.21.15.82:0/2732650219 shutdown_connections 2023-09-23T08:55:00.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.408+0000 7f01d8dff700 1 -- 172.21.15.82:0/2732650219 wait complete. 2023-09-23T08:55:00.430 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-23T08:55:00.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.634+0000 7f6bd6fff700 1 -- 172.21.15.82:0/3104981698 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6bd0101b20 msgr2=0x7f6bd0101f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:00.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.634+0000 7f6bd6fff700 1 --2- 172.21.15.82:0/3104981698 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6bd0101b20 0x7f6bd0101f80 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc0099c0 tx=0x7f6bbc009cd0 comp rx=0 tx=0).stop 2023-09-23T08:55:00.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.634+0000 7f6bd6fff700 1 -- 172.21.15.82:0/3104981698 shutdown_connections 2023-09-23T08:55:00.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.634+0000 7f6bd6fff700 1 --2- 172.21.15.82:0/3104981698 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6bd01024c0 0x7f6bd0108d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:00.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.634+0000 7f6bd6fff700 1 --2- 172.21.15.82:0/3104981698 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6bd0100930 0x7f6bd0100d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:00.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.634+0000 7f6bd6fff700 1 --2- 172.21.15.82:0/3104981698 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6bd0101b20 0x7f6bd0101f80 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:00.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.634+0000 7f6bd6fff700 1 -- 172.21.15.82:0/3104981698 >> 172.21.15.82:0/3104981698 conn(0x7f6bd00fbe60 msgr2=0x7f6bd00fe2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:00.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.634+0000 7f6bd6fff700 1 -- 172.21.15.82:0/3104981698 shutdown_connections 2023-09-23T08:55:00.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.634+0000 7f6bd6fff700 1 -- 172.21.15.82:0/3104981698 wait complete. 2023-09-23T08:55:00.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.635+0000 7f6bd6fff700 1 Processor -- start 2023-09-23T08:55:00.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.635+0000 7f6bd6fff700 1 -- start start 2023-09-23T08:55:00.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.635+0000 7f6bd6fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6bd0100930 0x7f6bd01986d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:00.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.635+0000 7f6bd6fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6bd0101b20 0x7f6bd0198c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:00.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.635+0000 7f6bd6fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6bd01024c0 0x7f6bd019fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:00.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.635+0000 7f6bd6fff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd01a0250 con 0x7f6bd0101b20 2023-09-23T08:55:00.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.635+0000 7f6bd6fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd01a0390 con 0x7f6bd0100930 2023-09-23T08:55:00.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.635+0000 7f6bd6fff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd01a0520 con 0x7f6bd01024c0 2023-09-23T08:55:00.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.635+0000 7f6bcffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6bd0101b20 0x7f6bd0198c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:00.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.636+0000 7f6bcffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6bd0101b20 0x7f6bd0198c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33186/0 (socket says 172.21.15.82:33186) 2023-09-23T08:55:00.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.636+0000 7f6bcffff700 1 -- 172.21.15.82:0/32884017 learned_addr learned my addr 172.21.15.82:0/32884017 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:55:00.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.636+0000 7f6bd4d9b700 1 --2- 172.21.15.82:0/32884017 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6bd0100930 0x7f6bd01986d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:00.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.636+0000 7f6bd559c700 1 --2- 172.21.15.82:0/32884017 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6bd01024c0 0x7f6bd019fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:00.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.636+0000 7f6bcffff700 1 -- 172.21.15.82:0/32884017 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6bd01024c0 msgr2=0x7f6bd019fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:00.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.636+0000 7f6bcffff700 1 --2- 172.21.15.82:0/32884017 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6bd01024c0 0x7f6bd019fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:00.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.636+0000 7f6bcffff700 1 -- 172.21.15.82:0/32884017 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6bd0100930 msgr2=0x7f6bd01986d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:00.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.636+0000 7f6bcffff700 1 --2- 172.21.15.82:0/32884017 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6bd0100930 0x7f6bd01986d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:00.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.636+0000 7f6bcffff700 1 -- 172.21.15.82:0/32884017 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bbc0095f0 con 0x7f6bd0101b20 2023-09-23T08:55:00.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.636+0000 7f6bcffff700 1 --2- 172.21.15.82:0/32884017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6bd0101b20 0x7f6bd0198c10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc005910 tx=0x7f6bbc00fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:00.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.636+0000 7f6bcdffb700 1 -- 172.21.15.82:0/32884017 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bbc01d070 con 0x7f6bd0101b20 2023-09-23T08:55:00.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.636+0000 7f6bcdffb700 1 -- 172.21.15.82:0/32884017 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6bbc00bd10 con 0x7f6bd0101b20 2023-09-23T08:55:00.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.636+0000 7f6bd6fff700 1 -- 172.21.15.82:0/32884017 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bd01a07a0 con 0x7f6bd0101b20 2023-09-23T08:55:00.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.636+0000 7f6bcdffb700 1 -- 172.21.15.82:0/32884017 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bbc004ba0 con 0x7f6bd0101b20 2023-09-23T08:55:00.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.637+0000 7f6bd6fff700 1 -- 172.21.15.82:0/32884017 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bd01a0bc0 con 0x7f6bd0101b20 2023-09-23T08:55:00.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.637+0000 7f6bd6fff700 1 -- 172.21.15.82:0/32884017 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bd0192de0 con 0x7f6bd0101b20 2023-09-23T08:55:00.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.639+0000 7f6bcdffb700 1 -- 172.21.15.82:0/32884017 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) v1 ==== 134722+0+0 (secure 0 0 0) 0x7f6bbc005050 con 0x7f6bd0101b20 2023-09-23T08:55:00.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.641+0000 7f6bcdffb700 1 --2- 172.21.15.82:0/32884017 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f6bc00a0020 0x7f6bc00a24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:00.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.641+0000 7f6bcdffb700 1 -- 172.21.15.82:0/32884017 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f6bbc0cc290 con 0x7f6bd0101b20 2023-09-23T08:55:00.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.641+0000 7f6bd4d9b700 1 --2- 172.21.15.82:0/32884017 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f6bc00a0020 0x7f6bc00a24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:00.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.641+0000 7f6bd4d9b700 1 --2- 172.21.15.82:0/32884017 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f6bc00a0020 0x7f6bc00a24e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6bd0101980 tx=0x7f6bc4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:00.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.645+0000 7f6bcdffb700 1 -- 172.21.15.82:0/32884017 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f6bbc096000 con 0x7f6bd0101b20 2023-09-23T08:55:00.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:00 smithi135 ceph-mon[99205]: from='client.14772 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:55:00.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:00 smithi135 ceph-mon[99205]: from='client.14784 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:55:00.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:00 smithi135 ceph-mon[99205]: mds.? [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] up:active 2023-09-23T08:55:00.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:00 smithi135 ceph-mon[99205]: daemon mds.f assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2023-09-23T08:55:00.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:00 smithi135 ceph-mon[99205]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-09-23T08:55:00.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:00 smithi135 ceph-mon[99205]: Cluster is now healthy 2023-09-23T08:55:00.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:00 smithi135 ceph-mon[99205]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=h=up:active} 8 up:standby 2023-09-23T08:55:00.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:00 smithi135 ceph-mon[99205]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2023-09-23T08:55:00.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:00 smithi135 ceph-mon[99205]: daemon mds.f is now active in filesystem cephfs as rank 4 2023-09-23T08:55:00.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:00 smithi082 ceph-mon[97694]: from='client.14772 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:55:00.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:00 smithi082 ceph-mon[97694]: from='client.14784 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:55:00.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:00 smithi082 ceph-mon[97694]: mds.? [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] up:active 2023-09-23T08:55:00.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:00 smithi082 ceph-mon[97694]: daemon mds.f assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2023-09-23T08:55:00.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:00 smithi082 ceph-mon[97694]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-09-23T08:55:00.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:00 smithi082 ceph-mon[97694]: Cluster is now healthy 2023-09-23T08:55:00.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:00 smithi082 ceph-mon[97694]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=h=up:active} 8 up:standby 2023-09-23T08:55:00.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:00 smithi082 ceph-mon[97694]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2023-09-23T08:55:00.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:00 smithi082 ceph-mon[97694]: daemon mds.f is now active in filesystem cephfs as rank 4 2023-09-23T08:55:00.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.888+0000 7f6bd6fff700 1 -- 172.21.15.82:0/32884017 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6bd010bff0 con 0x7f6bd0101b20 2023-09-23T08:55:00.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.888+0000 7f6bcdffb700 1 -- 172.21.15.82:0/32884017 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+11323 (secure 0 0 0) 0x7f6bbc099620 con 0x7f6bd0101b20 2023-09-23T08:55:00.891 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:55:00.891 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/1237857359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1237857359},{"type":"v1","addr":"172.21.15.82:6835","nonce":1237857359}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/1335102362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":1335102362},{"type":"v1","addr":"172.21.15.82:6837","nonce":1335102362}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-23T08:54:52.600479+0000","modified":"2023-09-23T08:55:00.481507+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24557,"mds_1":24550,"mds_2":24526,"mds_3":24515,"mds_4":24514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/3645331700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3645331700},{"type":"v1","addr":"172.21.15.135:6835","nonce":3645331700}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14658":{"gid":14658,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6839/205725278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":205725278},{"type":"v1","addr":"172.21.15.82:6839","nonce":205725278}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14670":{"gid":14670,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6841/2659297867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":2659297867},{"type":"v1","addr":"172.21.15.82:6841","nonce":2659297867}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24461":{"gid":24461,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/503886037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":503886037},{"type":"v1","addr":"172.21.15.135:6833","nonce":503886037}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24463":{"gid":24463,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.161:6833/471569125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":471569125},{"type":"v1","addr":"172.21.15.161:6833","nonce":471569125}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24514":{"gid":24514,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":10,"addr":"172.21.15.161:6835/2237964162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":2237964162},{"type":"v1","addr":"172.21.15.161:6835","nonce":2237964162}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24515":{"gid":24515,"name":"h","rank":3,"incarnation":22,"state":"up:active","state_seq":8,"addr":"172.21.15.135:6837/2655304858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2655304858},{"type":"v1","addr":"172.21.15.135:6837","nonce":2655304858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24526":{"gid":24526,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.161:6837/43639843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":43639843},{"type":"v1","addr":"172.21.15.161:6837","nonce":43639843}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24550":{"gid":24550,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.161:6839/758982817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6838","nonce":758982817},{"type":"v1","addr":"172.21.15.161:6839","nonce":758982817}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24557":{"gid":24557,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6839/2508669274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2508669274},{"type":"v1","addr":"172.21.15.135:6839","nonce":2508669274}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-23T08:55:00.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.891+0000 7f6bd6fff700 1 -- 172.21.15.82:0/32884017 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f6bc00a0020 msgr2=0x7f6bc00a24e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:00.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.891+0000 7f6bd6fff700 1 --2- 172.21.15.82:0/32884017 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f6bc00a0020 0x7f6bc00a24e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6bd0101980 tx=0x7f6bc4009260 comp rx=0 tx=0).stop 2023-09-23T08:55:00.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.891+0000 7f6bd6fff700 1 -- 172.21.15.82:0/32884017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6bd0101b20 msgr2=0x7f6bd0198c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:00.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.891+0000 7f6bd6fff700 1 --2- 172.21.15.82:0/32884017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6bd0101b20 0x7f6bd0198c10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc005910 tx=0x7f6bbc00fa00 comp rx=0 tx=0).stop 2023-09-23T08:55:00.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.891+0000 7f6bd6fff700 1 -- 172.21.15.82:0/32884017 shutdown_connections 2023-09-23T08:55:00.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.891+0000 7f6bd6fff700 1 --2- 172.21.15.82:0/32884017 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f6bc00a0020 0x7f6bc00a24e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:00.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.891+0000 7f6bd6fff700 1 --2- 172.21.15.82:0/32884017 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6bd01024c0 0x7f6bd019fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:00.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.891+0000 7f6bd6fff700 1 --2- 172.21.15.82:0/32884017 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6bd0100930 0x7f6bd01986d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:00.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.891+0000 7f6bd6fff700 1 --2- 172.21.15.82:0/32884017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6bd0101b20 0x7f6bd0198c10 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:00.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.891+0000 7f6bd6fff700 1 -- 172.21.15.82:0/32884017 >> 172.21.15.82:0/32884017 conn(0x7f6bd00fbe60 msgr2=0x7f6bd0107460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:00.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.891+0000 7f6bd6fff700 1 -- 172.21.15.82:0/32884017 shutdown_connections 2023-09-23T08:55:00.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:00.891+0000 7f6bd6fff700 1 -- 172.21.15.82:0/32884017 wait complete. 2023-09-23T08:55:00.895 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 26 2023-09-23T08:55:00.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:00 smithi161 ceph-mon[99580]: from='client.14772 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:55:00.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:00 smithi161 ceph-mon[99580]: from='client.14784 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:55:00.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:00 smithi161 ceph-mon[99580]: mds.? [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] up:active 2023-09-23T08:55:00.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:00 smithi161 ceph-mon[99580]: daemon mds.f assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2023-09-23T08:55:00.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:00 smithi161 ceph-mon[99580]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-09-23T08:55:00.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:00 smithi161 ceph-mon[99580]: Cluster is now healthy 2023-09-23T08:55:00.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:00 smithi161 ceph-mon[99580]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=h=up:active} 8 up:standby 2023-09-23T08:55:00.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:00 smithi161 ceph-mon[99580]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2023-09-23T08:55:00.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:00 smithi161 ceph-mon[99580]: daemon mds.f is now active in filesystem cephfs as rank 4 2023-09-23T08:55:00.912 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-23T08:55:01.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.112+0000 7f27a31ff700 1 -- 172.21.15.82:0/1351293897 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f279c100920 msgr2=0x7f279c100d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:01.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.112+0000 7f27a31ff700 1 --2- 172.21.15.82:0/1351293897 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f279c100920 0x7f279c100d40 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f27900099c0 tx=0x7f2790009cd0 comp rx=0 tx=0).stop 2023-09-23T08:55:01.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.112+0000 7f27a31ff700 1 -- 172.21.15.82:0/1351293897 shutdown_connections 2023-09-23T08:55:01.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.112+0000 7f27a31ff700 1 --2- 172.21.15.82:0/1351293897 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f279c1024b0 0x7f279c108d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:01.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.112+0000 7f27a31ff700 1 --2- 172.21.15.82:0/1351293897 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f279c100920 0x7f279c100d40 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:01.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.112+0000 7f27a31ff700 1 --2- 172.21.15.82:0/1351293897 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f279c101b10 0x7f279c101f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:01.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.112+0000 7f27a31ff700 1 -- 172.21.15.82:0/1351293897 >> 172.21.15.82:0/1351293897 conn(0x7f279c0fbe50 msgr2=0x7f279c0fe2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:01.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.112+0000 7f27a31ff700 1 -- 172.21.15.82:0/1351293897 shutdown_connections 2023-09-23T08:55:01.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.112+0000 7f27a31ff700 1 -- 172.21.15.82:0/1351293897 wait complete. 2023-09-23T08:55:01.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.113+0000 7f27a31ff700 1 Processor -- start 2023-09-23T08:55:01.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.113+0000 7f27a31ff700 1 -- start start 2023-09-23T08:55:01.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.114+0000 7f27a31ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f279c100920 0x7f279c0746d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:01.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.114+0000 7f27a31ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f279c101b10 0x7f279c072d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:01.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.114+0000 7f27a31ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f279c1024b0 0x7f279c073250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:01.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.114+0000 7f27a31ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f279c0739f0 con 0x7f279c1024b0 2023-09-23T08:55:01.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.114+0000 7f27a31ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f279c073b60 con 0x7f279c101b10 2023-09-23T08:55:01.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.114+0000 7f27a31ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f279c1a05c0 con 0x7f279c100920 2023-09-23T08:55:01.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.114+0000 7f27a179c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f279c1024b0 0x7f279c073250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:01.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.114+0000 7f27a0f9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f279c100920 0x7f279c0746d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:01.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.114+0000 7f27a179c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f279c1024b0 0x7f279c073250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33198/0 (socket says 172.21.15.82:33198) 2023-09-23T08:55:01.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.114+0000 7f27a179c700 1 -- 172.21.15.82:0/2386302092 learned_addr learned my addr 172.21.15.82:0/2386302092 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:55:01.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.114+0000 7f279bfff700 1 --2- 172.21.15.82:0/2386302092 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f279c101b10 0x7f279c072d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:01.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.114+0000 7f27a179c700 1 -- 172.21.15.82:0/2386302092 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f279c100920 msgr2=0x7f279c0746d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:01.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.114+0000 7f27a179c700 1 --2- 172.21.15.82:0/2386302092 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f279c100920 0x7f279c0746d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:01.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.114+0000 7f27a179c700 1 -- 172.21.15.82:0/2386302092 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f279c101b10 msgr2=0x7f279c072d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:01.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.114+0000 7f27a179c700 1 --2- 172.21.15.82:0/2386302092 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f279c101b10 0x7f279c072d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:01.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.114+0000 7f27a179c700 1 -- 172.21.15.82:0/2386302092 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27900095f0 con 0x7f279c1024b0 2023-09-23T08:55:01.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.114+0000 7f27a179c700 1 --2- 172.21.15.82:0/2386302092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f279c1024b0 0x7f279c073250 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2794007ee0 tx=0x7f279400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:01.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.115+0000 7f2799ffb700 1 -- 172.21.15.82:0/2386302092 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2794017070 con 0x7f279c1024b0 2023-09-23T08:55:01.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.115+0000 7f2799ffb700 1 -- 172.21.15.82:0/2386302092 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f279400f040 con 0x7f279c1024b0 2023-09-23T08:55:01.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.115+0000 7f27a31ff700 1 -- 172.21.15.82:0/2386302092 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f279c1a08a0 con 0x7f279c1024b0 2023-09-23T08:55:01.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.115+0000 7f2799ffb700 1 -- 172.21.15.82:0/2386302092 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2794005710 con 0x7f279c1024b0 2023-09-23T08:55:01.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.115+0000 7f27a31ff700 1 -- 172.21.15.82:0/2386302092 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f279c1a0d60 con 0x7f279c1024b0 2023-09-23T08:55:01.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.116+0000 7f27a31ff700 1 -- 172.21.15.82:0/2386302092 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f279c10c030 con 0x7f279c1024b0 2023-09-23T08:55:01.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.118+0000 7f2799ffb700 1 -- 172.21.15.82:0/2386302092 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) v1 ==== 134722+0+0 (secure 0 0 0) 0x7f2794005870 con 0x7f279c1024b0 2023-09-23T08:55:01.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.119+0000 7f2799ffb700 1 --2- 172.21.15.82:0/2386302092 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f278c0a0020 0x7f278c0a24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:01.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.119+0000 7f2799ffb700 1 -- 172.21.15.82:0/2386302092 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f27940caa20 con 0x7f279c1024b0 2023-09-23T08:55:01.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.119+0000 7f27a0f9b700 1 --2- 172.21.15.82:0/2386302092 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f278c0a0020 0x7f278c0a24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:01.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.120+0000 7f27a0f9b700 1 --2- 172.21.15.82:0/2386302092 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f278c0a0020 0x7f278c0a24e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2790000c00 tx=0x7f27900058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:01.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.123+0000 7f2799ffb700 1 -- 172.21.15.82:0/2386302092 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f2794094800 con 0x7f279c1024b0 2023-09-23T08:55:01.312 INFO:journalctl@ceph.mds.b.smithi135.stdout:Sep 23 08:55:00 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mds-b[124695]: 2023-09-23T08:55:00.836+0000 7f61e42b8700 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2023-09-23T08:55:01.312 INFO:journalctl@ceph.mds.b.smithi135.stdout:Sep 23 08:55:00 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mds-b[124695]: 2023-09-23T08:55:00.836+0000 7f61e42b8700 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2023-09-23T08:55:01.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.324+0000 7f27a31ff700 1 -- 172.21.15.82:0/2386302092 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f279c1078c0 con 0x7f279c1024b0 2023-09-23T08:55:01.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.326+0000 7f2799ffb700 1 -- 172.21.15.82:0/2386302092 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+22132 (secure 0 0 0) 0x7f2794097e20 con 0x7f279c1024b0 2023-09-23T08:55:01.329 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:55:01.329 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":86,"fsid":"8926e286-59ed-11ee-8db4-212e2dc638e7","created":"2023-09-23T08:46:16.628057+0000","modified":"2023-09-23T08:54:54.081503+0000","last_up_change":"2023-09-23T08:53:56.524694+0000","last_in_change":"2023-09-23T08:53:35.779183+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-23T08:50:00.571063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-23T08:54:50.558630+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-23T08:54:52.055291+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7384c1ff-8c71-4feb-8cef-ba45c2a1708a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":892441948},{"type":"v1","addr":"172.21.15.82:6803","nonce":892441948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":892441948},{"type":"v1","addr":"172.21.15.82:6805","nonce":892441948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":892441948},{"type":"v1","addr":"172.21.15.82:6809","nonce":892441948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":892441948},{"type":"v1","addr":"172.21.15.82:6807","nonce":892441948}]},"public_addr":"172.21.15.82:6803/892441948","cluster_addr":"172.21.15.82:6805/892441948","heartbeat_back_addr":"172.21.15.82:6809/892441948","heartbeat_front_addr":"172.21.15.82:6807/892441948","state":["exists","up"]},{"osd":1,"uuid":"ca62333e-15db-4556-a9ed-8820f9268766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3224546922},{"type":"v1","addr":"172.21.15.135:6801","nonce":3224546922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3224546922},{"type":"v1","addr":"172.21.15.135:6803","nonce":3224546922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3224546922},{"type":"v1","addr":"172.21.15.135:6807","nonce":3224546922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3224546922},{"type":"v1","addr":"172.21.15.135:6805","nonce":3224546922}]},"public_addr":"172.21.15.135:6801/3224546922","cluster_addr":"172.21.15.135:6803/3224546922","heartbeat_back_addr":"172.21.15.135:6807/3224546922","heartbeat_front_addr":"172.21.15.135:6805/3224546922","state":["exists","up"]},{"osd":2,"uuid":"ac23eb38-216a-44f0-b316-a509b23745f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2358373459},{"type":"v1","addr":"172.21.15.161:6801","nonce":2358373459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2358373459},{"type":"v1","addr":"172.21.15.161:6803","nonce":2358373459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2358373459},{"type":"v1","addr":"172.21.15.161:6807","nonce":2358373459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2358373459},{"type":"v1","addr":"172.21.15.161:6805","nonce":2358373459}]},"public_addr":"172.21.15.161:6801/2358373459","cluster_addr":"172.21.15.161:6803/2358373459","heartbeat_back_addr":"172.21.15.161:6807/2358373459","heartbeat_front_addr":"172.21.15.161:6805/2358373459","state":["exists","up"]},{"osd":3,"uuid":"701c96b0-30fb-46ce-917d-e02d3814dc3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":1081464528},{"type":"v1","addr":"172.21.15.82:6811","nonce":1081464528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1081464528},{"type":"v1","addr":"172.21.15.82:6813","nonce":1081464528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1081464528},{"type":"v1","addr":"172.21.15.82:6817","nonce":1081464528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":1081464528},{"type":"v1","addr":"172.21.15.82:6815","nonce":1081464528}]},"public_addr":"172.21.15.82:6811/1081464528","cluster_addr":"172.21.15.82:6813/1081464528","heartbeat_back_addr":"172.21.15.82:6817/1081464528","heartbeat_front_addr":"172.21.15.82:6815/1081464528","state":["exists","up"]},{"osd":4,"uuid":"c618d2a2-3616-41b2-943c-7a4616538e13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2346495509},{"type":"v1","addr":"172.21.15.135:6809","nonce":2346495509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2346495509},{"type":"v1","addr":"172.21.15.135:6811","nonce":2346495509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2346495509},{"type":"v1","addr":"172.21.15.135:6815","nonce":2346495509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2346495509},{"type":"v1","addr":"172.21.15.135:6813","nonce":2346495509}]},"public_addr":"172.21.15.135:6809/2346495509","cluster_addr":"172.21.15.135:6811/2346495509","heartbeat_back_addr":"172.21.15.135:6815/2346495509","heartbeat_front_addr":"172.21.15.135:6813/2346495509","state":["exists","up"]},{"osd":5,"uuid":"8e1dda3d-6927-495d-b20d-78b03bb75d5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1252638628},{"type":"v1","addr":"172.21.15.161:6809","nonce":1252638628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1252638628},{"type":"v1","addr":"172.21.15.161:6811","nonce":1252638628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1252638628},{"type":"v1","addr":"172.21.15.161:6815","nonce":1252638628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1252638628},{"type":"v1","addr":"172.21.15.161:6813","nonce":1252638628}]},"public_addr":"172.21.15.161:6809/1252638628","cluster_addr":"172.21.15.161:6811/1252638628","heartbeat_back_addr":"172.21.15.161:6815/1252638628","heartbeat_front_addr":"172.21.15.161:6813/1252638628","state":["exists","up"]},{"osd":6,"uuid":"50b31960-6bc4-44e1-8116-3106bf161e56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1052038408},{"type":"v1","addr":"172.21.15.82:6819","nonce":1052038408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1052038408},{"type":"v1","addr":"172.21.15.82:6821","nonce":1052038408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":1052038408},{"type":"v1","addr":"172.21.15.82:6825","nonce":1052038408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1052038408},{"type":"v1","addr":"172.21.15.82:6823","nonce":1052038408}]},"public_addr":"172.21.15.82:6819/1052038408","cluster_addr":"172.21.15.82:6821/1052038408","heartbeat_back_addr":"172.21.15.82:6825/1052038408","heartbeat_front_addr":"172.21.15.82:6823/1052038408","state":["exists","up"]},{"osd":7,"uuid":"425ca0ee-57f7-4b27-90fb-d86bb5db5480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3683951498},{"type":"v1","addr":"172.21.15.135:6817","nonce":3683951498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":3683951498},{"type":"v1","addr":"172.21.15.135:6819","nonce":3683951498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":3683951498},{"type":"v1","addr":"172.21.15.135:6823","nonce":3683951498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":3683951498},{"type":"v1","addr":"172.21.15.135:6821","nonce":3683951498}]},"public_addr":"172.21.15.135:6817/3683951498","cluster_addr":"172.21.15.135:6819/3683951498","heartbeat_back_addr":"172.21.15.135:6823/3683951498","heartbeat_front_addr":"172.21.15.135:6821/3683951498","state":["exists","up"]},{"osd":8,"uuid":"1115c837-bef6-4bad-9974-4d913198511b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":948521536},{"type":"v1","addr":"172.21.15.161:6817","nonce":948521536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":948521536},{"type":"v1","addr":"172.21.15.161:6819","nonce":948521536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":948521536},{"type":"v1","addr":"172.21.15.161:6823","nonce":948521536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":948521536},{"type":"v1","addr":"172.21.15.161:6821","nonce":948521536}]},"public_addr":"172.21.15.161:6817/948521536","cluster_addr":"172.21.15.161:6819/948521536","heartbeat_back_addr":"172.21.15.161:6823/948521536","heartbeat_front_addr":"172.21.15.161:6821/948521536","state":["exists","up"]},{"osd":9,"uuid":"c52ec819-4bc6-402f-9cd8-62539e519e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":1438762840},{"type":"v1","addr":"172.21.15.82:6827","nonce":1438762840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":1438762840},{"type":"v1","addr":"172.21.15.82:6829","nonce":1438762840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1438762840},{"type":"v1","addr":"172.21.15.82:6833","nonce":1438762840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1438762840},{"type":"v1","addr":"172.21.15.82:6831","nonce":1438762840}]},"public_addr":"172.21.15.82:6827/1438762840","cluster_addr":"172.21.15.82:6829/1438762840","heartbeat_back_addr":"172.21.15.82:6833/1438762840","heartbeat_front_addr":"172.21.15.82:6831/1438762840","state":["exists","up"]},{"osd":10,"uuid":"1b16c795-1b91-4d46-ae5d-21b8332c1077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2853697851},{"type":"v1","addr":"172.21.15.135:6825","nonce":2853697851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2853697851},{"type":"v1","addr":"172.21.15.135:6827","nonce":2853697851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2853697851},{"type":"v1","addr":"172.21.15.135:6831","nonce":2853697851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2853697851},{"type":"v1","addr":"172.21.15.135:6829","nonce":2853697851}]},"public_addr":"172.21.15.135:6825/2853697851","cluster_addr":"172.21.15.135:6827/2853697851","heartbeat_back_addr":"172.21.15.135:6831/2853697851","heartbeat_front_addr":"172.21.15.135:6829/2853697851","state":["exists","up"]},{"osd":11,"uuid":"2551e602-4fe1-41cb-9b7d-c8b31fdd1487","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":1459332081},{"type":"v1","addr":"172.21.15.161:6825","nonce":1459332081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":1459332081},{"type":"v1","addr":"172.21.15.161:6827","nonce":1459332081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":1459332081},{"type":"v1","addr":"172.21.15.161:6831","nonce":1459332081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":1459332081},{"type":"v1","addr":"172.21.15.161:6829","nonce":1459332081}]},"public_addr":"172.21.15.161:6825/1459332081","cluster_addr":"172.21.15.161:6827/1459332081","heartbeat_back_addr":"172.21.15.161:6831/1459332081","heartbeat_front_addr":"172.21.15.161:6829/1459332081","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:49:04.007679+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:49:30.702365+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:49:56.785248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:50:22.988516+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:50:49.347055+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:51:15.830145+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:51:41.986377+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:52:08.218893+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:52:34.847450+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:53:01.317134+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:53:27.981691+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:53:54.849245+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/4204712132":"2023-09-24T08:47:21.957866+0000","172.21.15.82:6801/2733521564":"2023-09-24T08:47:21.957866+0000","172.21.15.82:6800/2733521564":"2023-09-24T08:47:21.957866+0000","172.21.15.82:0/3964794665":"2023-09-24T08:47:21.957866+0000","172.21.15.82:0/3535372205":"2023-09-24T08:46:55.187024+0000","172.21.15.82:0/285559684":"2023-09-24T08:46:55.187024+0000","172.21.15.82:0/1335891896":"2023-09-24T08:46:55.187024+0000","172.21.15.82:6801/3761509623":"2023-09-24T08:46:55.187024+0000","172.21.15.82:6800/3761509623":"2023-09-24T08:46:55.187024+0000","172.21.15.82:0/3775317005":"2023-09-24T08:47:21.957866+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-23T08:55:01.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.328+0000 7f27a31ff700 1 -- 172.21.15.82:0/2386302092 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f278c0a0020 msgr2=0x7f278c0a24e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:01.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.328+0000 7f27a31ff700 1 --2- 172.21.15.82:0/2386302092 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f278c0a0020 0x7f278c0a24e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2790000c00 tx=0x7f27900058e0 comp rx=0 tx=0).stop 2023-09-23T08:55:01.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.328+0000 7f27a31ff700 1 -- 172.21.15.82:0/2386302092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f279c1024b0 msgr2=0x7f279c073250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:01.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.328+0000 7f27a31ff700 1 --2- 172.21.15.82:0/2386302092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f279c1024b0 0x7f279c073250 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2794007ee0 tx=0x7f279400d3b0 comp rx=0 tx=0).stop 2023-09-23T08:55:01.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.328+0000 7f27a31ff700 1 -- 172.21.15.82:0/2386302092 shutdown_connections 2023-09-23T08:55:01.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.328+0000 7f27a31ff700 1 --2- 172.21.15.82:0/2386302092 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f278c0a0020 0x7f278c0a24e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:01.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.328+0000 7f27a31ff700 1 --2- 172.21.15.82:0/2386302092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f279c1024b0 0x7f279c073250 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:01.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.328+0000 7f27a31ff700 1 --2- 172.21.15.82:0/2386302092 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f279c100920 0x7f279c0746d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:01.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.328+0000 7f27a31ff700 1 --2- 172.21.15.82:0/2386302092 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f279c101b10 0x7f279c072d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:01.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.328+0000 7f27a31ff700 1 -- 172.21.15.82:0/2386302092 >> 172.21.15.82:0/2386302092 conn(0x7f279c0fbe50 msgr2=0x7f279c0fe190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:01.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.329+0000 7f27a31ff700 1 -- 172.21.15.82:0/2386302092 shutdown_connections 2023-09-23T08:55:01.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.329+0000 7f27a31ff700 1 -- 172.21.15.82:0/2386302092 wait complete. 2023-09-23T08:55:01.350 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-09-23T08:55:01.350 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-23T08:55:01.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.549+0000 7fa9aa3ff700 1 -- 172.21.15.82:0/3147805455 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9a4101b10 msgr2=0x7fa9a4101f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:01.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.549+0000 7fa9aa3ff700 1 --2- 172.21.15.82:0/3147805455 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9a4101b10 0x7fa9a4101f70 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa9980099c0 tx=0x7fa998009cd0 comp rx=0 tx=0).stop 2023-09-23T08:55:01.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.549+0000 7fa9aa3ff700 1 -- 172.21.15.82:0/3147805455 shutdown_connections 2023-09-23T08:55:01.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.549+0000 7fa9aa3ff700 1 --2- 172.21.15.82:0/3147805455 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa9a41024b0 0x7fa9a4108d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:01.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.549+0000 7fa9aa3ff700 1 --2- 172.21.15.82:0/3147805455 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9a4100920 0x7fa9a4100d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:01.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.549+0000 7fa9aa3ff700 1 --2- 172.21.15.82:0/3147805455 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9a4101b10 0x7fa9a4101f70 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:01.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.549+0000 7fa9aa3ff700 1 -- 172.21.15.82:0/3147805455 >> 172.21.15.82:0/3147805455 conn(0x7fa9a40fbe50 msgr2=0x7fa9a40fe2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:01.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.549+0000 7fa9aa3ff700 1 -- 172.21.15.82:0/3147805455 shutdown_connections 2023-09-23T08:55:01.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.549+0000 7fa9aa3ff700 1 -- 172.21.15.82:0/3147805455 wait complete. 2023-09-23T08:55:01.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.550+0000 7fa9aa3ff700 1 Processor -- start 2023-09-23T08:55:01.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.550+0000 7fa9aa3ff700 1 -- start start 2023-09-23T08:55:01.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.550+0000 7fa9aa3ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9a4100920 0x7fa9a41987c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:01.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.550+0000 7fa9aa3ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa9a4101b10 0x7fa9a4198d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:01.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.551+0000 7fa9aa3ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9a41024b0 0x7fa9a419fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:01.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.551+0000 7fa9aa3ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a41a0340 con 0x7fa9a41024b0 2023-09-23T08:55:01.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.551+0000 7fa9aa3ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a41a0480 con 0x7fa9a4100920 2023-09-23T08:55:01.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.551+0000 7fa9aa3ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a41a0610 con 0x7fa9a4101b10 2023-09-23T08:55:01.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.551+0000 7fa9a899c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9a41024b0 0x7fa9a419fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:01.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.551+0000 7fa9a899c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9a41024b0 0x7fa9a419fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33218/0 (socket says 172.21.15.82:33218) 2023-09-23T08:55:01.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.551+0000 7fa9a899c700 1 -- 172.21.15.82:0/3218919584 learned_addr learned my addr 172.21.15.82:0/3218919584 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:55:01.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.551+0000 7fa9a3fff700 1 --2- 172.21.15.82:0/3218919584 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9a4100920 0x7fa9a41987c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:01.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.551+0000 7fa9a37fe700 1 --2- 172.21.15.82:0/3218919584 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa9a4101b10 0x7fa9a4198d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:01.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.551+0000 7fa9a899c700 1 -- 172.21.15.82:0/3218919584 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa9a4101b10 msgr2=0x7fa9a4198d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:01.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.551+0000 7fa9a899c700 1 --2- 172.21.15.82:0/3218919584 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa9a4101b10 0x7fa9a4198d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:01.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.551+0000 7fa9a899c700 1 -- 172.21.15.82:0/3218919584 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9a4100920 msgr2=0x7fa9a41987c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:01.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.551+0000 7fa9a899c700 1 --2- 172.21.15.82:0/3218919584 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9a4100920 0x7fa9a41987c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:01.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.551+0000 7fa9a899c700 1 -- 172.21.15.82:0/3218919584 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9980095f0 con 0x7fa9a41024b0 2023-09-23T08:55:01.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.551+0000 7fa9a37fe700 1 --2- 172.21.15.82:0/3218919584 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa9a4101b10 0x7fa9a4198d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T08:55:01.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.551+0000 7fa9a899c700 1 --2- 172.21.15.82:0/3218919584 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9a41024b0 0x7fa9a419fd70 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa99c00b970 tx=0x7fa99c00bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:01.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.552+0000 7fa9a17fa700 1 -- 172.21.15.82:0/3218919584 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa99c00c9b0 con 0x7fa9a41024b0 2023-09-23T08:55:01.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.552+0000 7fa9a17fa700 1 -- 172.21.15.82:0/3218919584 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa99c014440 con 0x7fa9a41024b0 2023-09-23T08:55:01.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.552+0000 7fa9a17fa700 1 -- 172.21.15.82:0/3218919584 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa99c0075d0 con 0x7fa9a41024b0 2023-09-23T08:55:01.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.552+0000 7fa9aa3ff700 1 -- 172.21.15.82:0/3218919584 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9a41a08f0 con 0x7fa9a41024b0 2023-09-23T08:55:01.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.552+0000 7fa9aa3ff700 1 -- 172.21.15.82:0/3218919584 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9a41a0db0 con 0x7fa9a41024b0 2023-09-23T08:55:01.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.553+0000 7fa9aa3ff700 1 -- 172.21.15.82:0/3218919584 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9a410c0b0 con 0x7fa9a41024b0 2023-09-23T08:55:01.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.554+0000 7fa9a17fa700 1 -- 172.21.15.82:0/3218919584 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) v1 ==== 134722+0+0 (secure 0 0 0) 0x7fa99c0145b0 con 0x7fa9a41024b0 2023-09-23T08:55:01.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.556+0000 7fa9a17fa700 1 --2- 172.21.15.82:0/3218919584 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fa98c0a00a0 0x7fa98c0a2560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:01.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.556+0000 7fa9a17fa700 1 -- 172.21.15.82:0/3218919584 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fa99c006e40 con 0x7fa9a41024b0 2023-09-23T08:55:01.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.556+0000 7fa9a3fff700 1 --2- 172.21.15.82:0/3218919584 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fa98c0a00a0 0x7fa98c0a2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:01.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.557+0000 7fa9a3fff700 1 --2- 172.21.15.82:0/3218919584 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fa98c0a00a0 0x7fa98c0a2560 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa9a4101970 tx=0x7fa994009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:01.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.560+0000 7fa9a17fa700 1 -- 172.21.15.82:0/3218919584 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7fa99c094850 con 0x7fa9a41024b0 2023-09-23T08:55:01.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:01 smithi082 ceph-mon[97694]: from='client.14790 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:55:01.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:01 smithi082 ceph-mon[97694]: pgmap v305: 97 pgs: 97 active+clean; 582 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s wr, 11 op/s 2023-09-23T08:55:01.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:01 smithi082 ceph-mon[97694]: from='client.14796 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:55:01.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:01 smithi082 ceph-mon[97694]: mds.? [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] up:active 2023-09-23T08:55:01.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:01 smithi082 ceph-mon[97694]: fsmap cephfs:5 7 up:standby 5 up:active 2023-09-23T08:55:01.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:01 smithi082 ceph-mon[97694]: mgrmap e17: x(active, since 7m), standbys: z, y 2023-09-23T08:55:01.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:01 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T08:55:01.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:01 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/32884017' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T08:55:01.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:01 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/2386302092' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-23T08:55:01.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.755+0000 7fa9aa3ff700 1 -- 172.21.15.82:0/3218919584 --> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa9a41084a0 con 0x7fa98c0a00a0 2023-09-23T08:55:01.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.768+0000 7fa9a17fa700 1 -- 172.21.15.82:0/3218919584 <== mgr.14152 v2:172.21.15.82:6800/3698954311 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+338794 (secure 0 0 0) 0x7fa9a41084a0 con 0x7fa98c0a00a0 2023-09-23T08:55:01.775 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:55:01.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.772+0000 7fa9aa3ff700 1 -- 172.21.15.82:0/3218919584 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fa98c0a00a0 msgr2=0x7fa98c0a2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:01.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.772+0000 7fa9aa3ff700 1 --2- 172.21.15.82:0/3218919584 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fa98c0a00a0 0x7fa98c0a2560 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa9a4101970 tx=0x7fa994009260 comp rx=0 tx=0).stop 2023-09-23T08:55:01.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.772+0000 7fa9aa3ff700 1 -- 172.21.15.82:0/3218919584 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9a41024b0 msgr2=0x7fa9a419fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:01.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.772+0000 7fa9aa3ff700 1 --2- 172.21.15.82:0/3218919584 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9a41024b0 0x7fa9a419fd70 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa99c00b970 tx=0x7fa99c00bd30 comp rx=0 tx=0).stop 2023-09-23T08:55:01.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.772+0000 7fa9aa3ff700 1 -- 172.21.15.82:0/3218919584 shutdown_connections 2023-09-23T08:55:01.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.772+0000 7fa9aa3ff700 1 --2- 172.21.15.82:0/3218919584 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fa98c0a00a0 0x7fa98c0a2560 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:01.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.772+0000 7fa9aa3ff700 1 --2- 172.21.15.82:0/3218919584 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9a41024b0 0x7fa9a419fd70 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:01.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.772+0000 7fa9aa3ff700 1 --2- 172.21.15.82:0/3218919584 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9a4100920 0x7fa9a41987c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:01.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.772+0000 7fa9aa3ff700 1 --2- 172.21.15.82:0/3218919584 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa9a4101b10 0x7fa9a4198d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:01.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.772+0000 7fa9aa3ff700 1 -- 172.21.15.82:0/3218919584 >> 172.21.15.82:0/3218919584 conn(0x7fa9a40fbe50 msgr2=0x7fa9a40fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:01.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.773+0000 7fa9aa3ff700 1 -- 172.21.15.82:0/3218919584 shutdown_connections 2023-09-23T08:55:01.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:01.773+0000 7fa9aa3ff700 1 -- 172.21.15.82:0/3218919584 wait complete. 2023-09-23T08:55:01.780 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-09-23T08:55:01.794 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":305,"stamp":"2023-09-23T08:55:00.051996+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595948,"num_objects":47,"num_object_clones":0,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":273,"num_write_kb":2973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":220,"ondisk_log_size":220,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":261,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":336888,"kb_used_data":12644,"kb_used_omap":20,"kb_used_meta":324075,"kb_avail":1124604936,"statfs":{"total":1151940427776,"available":1151595454464,"internally_reserved":0,"allocated":12947456,"data_stored":7058445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21372,"internal_metadata":331852932},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5580,"num_objects":45,"num_object_clones":0,"num_object_copies":135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":92,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.990987"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.093472+0000","last_change":"2023-09-23T08:54:53.110235+0000","last_active":"2023-09-23T08:54:54.093472+0000","last_peered":"2023-09-23T08:54:54.093472+0000","last_clean":"2023-09-23T08:54:54.093472+0000","last_became_active":"2023-09-23T08:54:53.109445+0000","last_became_peered":"2023-09-23T08:54:53.109445+0000","last_unstale":"2023-09-23T08:54:54.093472+0000","last_undegraded":"2023-09-23T08:54:54.093472+0000","last_fullsized":"2023-09-23T08:54:54.093472+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T14:44:43.255301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:55.569643+0000","last_change":"2023-09-23T08:54:53.105948+0000","last_active":"2023-09-23T08:54:55.569643+0000","last_peered":"2023-09-23T08:54:55.569643+0000","last_clean":"2023-09-23T08:54:55.569643+0000","last_became_active":"2023-09-23T08:54:53.105627+0000","last_became_peered":"2023-09-23T08:54:53.105627+0000","last_unstale":"2023-09-23T08:54:55.569643+0000","last_undegraded":"2023-09-23T08:54:55.569643+0000","last_fullsized":"2023-09-23T08:54:55.569643+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:11:15.600872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:55.569498+0000","last_change":"2023-09-23T08:54:53.099318+0000","last_active":"2023-09-23T08:54:55.569498+0000","last_peered":"2023-09-23T08:54:55.569498+0000","last_clean":"2023-09-23T08:54:55.569498+0000","last_became_active":"2023-09-23T08:54:53.099002+0000","last_became_peered":"2023-09-23T08:54:53.099002+0000","last_unstale":"2023-09-23T08:54:55.569498+0000","last_undegraded":"2023-09-23T08:54:55.569498+0000","last_fullsized":"2023-09-23T08:54:55.569498+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:43:19.901761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:56.196551+0000","last_change":"2023-09-23T08:54:53.114757+0000","last_active":"2023-09-23T08:54:56.196551+0000","last_peered":"2023-09-23T08:54:56.196551+0000","last_clean":"2023-09-23T08:54:56.196551+0000","last_became_active":"2023-09-23T08:54:53.113979+0000","last_became_peered":"2023-09-23T08:54:53.113979+0000","last_unstale":"2023-09-23T08:54:56.196551+0000","last_undegraded":"2023-09-23T08:54:56.196551+0000","last_fullsized":"2023-09-23T08:54:56.196551+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T11:35:40.666245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.868655+0000","last_change":"2023-09-23T08:54:53.102122+0000","last_active":"2023-09-23T08:54:54.868655+0000","last_peered":"2023-09-23T08:54:54.868655+0000","last_clean":"2023-09-23T08:54:54.868655+0000","last_became_active":"2023-09-23T08:54:53.101781+0000","last_became_peered":"2023-09-23T08:54:53.101781+0000","last_unstale":"2023-09-23T08:54:54.868655+0000","last_undegraded":"2023-09-23T08:54:54.868655+0000","last_fullsized":"2023-09-23T08:54:54.868655+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T10:14:51.789807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-23T08:54:53.104938+0000","last_change":"2023-09-23T08:54:53.103617+0000","last_active":"2023-09-23T08:54:53.104938+0000","last_peered":"2023-09-23T08:54:53.104938+0000","last_clean":"2023-09-23T08:54:53.104938+0000","last_became_active":"2023-09-23T08:54:53.103259+0000","last_became_peered":"2023-09-23T08:54:53.103259+0000","last_unstale":"2023-09-23T08:54:53.104938+0000","last_undegraded":"2023-09-23T08:54:53.104938+0000","last_fullsized":"2023-09-23T08:54:53.104938+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T12:50:36.273647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.685305+0000","last_change":"2023-09-23T08:54:53.110512+0000","last_active":"2023-09-23T08:54:54.685305+0000","last_peered":"2023-09-23T08:54:54.685305+0000","last_clean":"2023-09-23T08:54:54.685305+0000","last_became_active":"2023-09-23T08:54:53.110166+0000","last_became_peered":"2023-09-23T08:54:53.110166+0000","last_unstale":"2023-09-23T08:54:54.685305+0000","last_undegraded":"2023-09-23T08:54:54.685305+0000","last_fullsized":"2023-09-23T08:54:54.685305+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T08:56:47.152914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.094237+0000","last_change":"2023-09-23T08:54:53.111373+0000","last_active":"2023-09-23T08:54:54.094237+0000","last_peered":"2023-09-23T08:54:54.094237+0000","last_clean":"2023-09-23T08:54:54.094237+0000","last_became_active":"2023-09-23T08:54:53.111045+0000","last_became_peered":"2023-09-23T08:54:53.111045+0000","last_unstale":"2023-09-23T08:54:54.094237+0000","last_undegraded":"2023-09-23T08:54:54.094237+0000","last_fullsized":"2023-09-23T08:54:54.094237+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T11:39:40.682666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.392385+0000","last_change":"2023-09-23T08:54:53.100219+0000","last_active":"2023-09-23T08:54:54.392385+0000","last_peered":"2023-09-23T08:54:54.392385+0000","last_clean":"2023-09-23T08:54:54.392385+0000","last_became_active":"2023-09-23T08:54:53.099925+0000","last_became_peered":"2023-09-23T08:54:53.099925+0000","last_unstale":"2023-09-23T08:54:54.392385+0000","last_undegraded":"2023-09-23T08:54:54.392385+0000","last_fullsized":"2023-09-23T08:54:54.392385+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T13:23:40.035670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-23T08:54:53.112223+0000","last_change":"2023-09-23T08:54:53.110272+0000","last_active":"2023-09-23T08:54:53.112223+0000","last_peered":"2023-09-23T08:54:53.112223+0000","last_clean":"2023-09-23T08:54:53.112223+0000","last_became_active":"2023-09-23T08:54:53.109958+0000","last_became_peered":"2023-09-23T08:54:53.109958+0000","last_unstale":"2023-09-23T08:54:53.112223+0000","last_undegraded":"2023-09-23T08:54:53.112223+0000","last_fullsized":"2023-09-23T08:54:53.112223+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T10:28:12.973452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.685674+0000","last_change":"2023-09-23T08:54:53.108175+0000","last_active":"2023-09-23T08:54:54.685674+0000","last_peered":"2023-09-23T08:54:54.685674+0000","last_clean":"2023-09-23T08:54:54.685674+0000","last_became_active":"2023-09-23T08:54:53.107889+0000","last_became_peered":"2023-09-23T08:54:53.107889+0000","last_unstale":"2023-09-23T08:54:54.685674+0000","last_undegraded":"2023-09-23T08:54:54.685674+0000","last_fullsized":"2023-09-23T08:54:54.685674+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T14:31:52.490823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:56.196534+0000","last_change":"2023-09-23T08:54:53.114564+0000","last_active":"2023-09-23T08:54:56.196534+0000","last_peered":"2023-09-23T08:54:56.196534+0000","last_clean":"2023-09-23T08:54:56.196534+0000","last_became_active":"2023-09-23T08:54:53.113937+0000","last_became_peered":"2023-09-23T08:54:53.113937+0000","last_unstale":"2023-09-23T08:54:56.196534+0000","last_undegraded":"2023-09-23T08:54:56.196534+0000","last_fullsized":"2023-09-23T08:54:56.196534+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T13:16:36.107633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.093676+0000","last_change":"2023-09-23T08:54:53.108544+0000","last_active":"2023-09-23T08:54:54.093676+0000","last_peered":"2023-09-23T08:54:54.093676+0000","last_clean":"2023-09-23T08:54:54.093676+0000","last_became_active":"2023-09-23T08:54:53.108226+0000","last_became_peered":"2023-09-23T08:54:53.108226+0000","last_unstale":"2023-09-23T08:54:54.093676+0000","last_undegraded":"2023-09-23T08:54:54.093676+0000","last_fullsized":"2023-09-23T08:54:54.093676+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T20:28:57.708297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:55.569335+0000","last_change":"2023-09-23T08:54:53.106250+0000","last_active":"2023-09-23T08:54:55.569335+0000","last_peered":"2023-09-23T08:54:55.569335+0000","last_clean":"2023-09-23T08:54:55.569335+0000","last_became_active":"2023-09-23T08:54:53.105912+0000","last_became_peered":"2023-09-23T08:54:53.105912+0000","last_unstale":"2023-09-23T08:54:55.569335+0000","last_undegraded":"2023-09-23T08:54:55.569335+0000","last_fullsized":"2023-09-23T08:54:55.569335+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T18:08:21.546185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:55.569272+0000","last_change":"2023-09-23T08:54:53.101435+0000","last_active":"2023-09-23T08:54:55.569272+0000","last_peered":"2023-09-23T08:54:55.569272+0000","last_clean":"2023-09-23T08:54:55.569272+0000","last_became_active":"2023-09-23T08:54:53.101144+0000","last_became_peered":"2023-09-23T08:54:53.101144+0000","last_unstale":"2023-09-23T08:54:55.569272+0000","last_undegraded":"2023-09-23T08:54:55.569272+0000","last_fullsized":"2023-09-23T08:54:55.569272+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:19:57.007982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.391919+0000","last_change":"2023-09-23T08:54:53.098507+0000","last_active":"2023-09-23T08:54:54.391919+0000","last_peered":"2023-09-23T08:54:54.391919+0000","last_clean":"2023-09-23T08:54:54.391919+0000","last_became_active":"2023-09-23T08:54:53.098153+0000","last_became_peered":"2023-09-23T08:54:53.098153+0000","last_unstale":"2023-09-23T08:54:54.391919+0000","last_undegraded":"2023-09-23T08:54:54.391919+0000","last_fullsized":"2023-09-23T08:54:54.391919+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:46:02.294933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.093511+0000","last_change":"2023-09-23T08:54:53.110427+0000","last_active":"2023-09-23T08:54:54.093511+0000","last_peered":"2023-09-23T08:54:54.093511+0000","last_clean":"2023-09-23T08:54:54.093511+0000","last_became_active":"2023-09-23T08:54:53.109868+0000","last_became_peered":"2023-09-23T08:54:53.109868+0000","last_unstale":"2023-09-23T08:54:54.093511+0000","last_undegraded":"2023-09-23T08:54:54.093511+0000","last_fullsized":"2023-09-23T08:54:54.093511+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T14:12:29.441770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:55.823256+0000","last_change":"2023-09-23T08:54:53.107613+0000","last_active":"2023-09-23T08:54:55.823256+0000","last_peered":"2023-09-23T08:54:55.823256+0000","last_clean":"2023-09-23T08:54:55.823256+0000","last_became_active":"2023-09-23T08:54:53.107230+0000","last_became_peered":"2023-09-23T08:54:53.107230+0000","last_unstale":"2023-09-23T08:54:55.823256+0000","last_undegraded":"2023-09-23T08:54:55.823256+0000","last_fullsized":"2023-09-23T08:54:55.823256+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T20:22:51.441504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:56.197192+0000","last_change":"2023-09-23T08:54:53.102530+0000","last_active":"2023-09-23T08:54:56.197192+0000","last_peered":"2023-09-23T08:54:56.197192+0000","last_clean":"2023-09-23T08:54:56.197192+0000","last_became_active":"2023-09-23T08:54:53.102004+0000","last_became_peered":"2023-09-23T08:54:53.102004+0000","last_unstale":"2023-09-23T08:54:56.197192+0000","last_undegraded":"2023-09-23T08:54:56.197192+0000","last_fullsized":"2023-09-23T08:54:56.197192+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T20:45:59.122109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"86'9","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:57.445754+0000","last_change":"2023-09-23T08:54:52.082566+0000","last_active":"2023-09-23T08:54:57.445754+0000","last_peered":"2023-09-23T08:54:57.445754+0000","last_clean":"2023-09-23T08:54:57.445754+0000","last_became_active":"2023-09-23T08:54:52.082226+0000","last_became_peered":"2023-09-23T08:54:52.082226+0000","last_unstale":"2023-09-23T08:54:57.445754+0000","last_undegraded":"2023-09-23T08:54:57.445754+0000","last_fullsized":"2023-09-23T08:54:57.445754+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:33:39.581222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.094617+0000","last_change":"2023-09-23T08:54:53.109844+0000","last_active":"2023-09-23T08:54:54.094617+0000","last_peered":"2023-09-23T08:54:54.094617+0000","last_clean":"2023-09-23T08:54:54.094617+0000","last_became_active":"2023-09-23T08:54:53.109456+0000","last_became_peered":"2023-09-23T08:54:53.109456+0000","last_unstale":"2023-09-23T08:54:54.094617+0000","last_undegraded":"2023-09-23T08:54:54.094617+0000","last_fullsized":"2023-09-23T08:54:54.094617+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T11:09:27.072285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"85'1","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.094905+0000","last_change":"2023-09-23T08:54:52.090023+0000","last_active":"2023-09-23T08:54:54.094905+0000","last_peered":"2023-09-23T08:54:54.094905+0000","last_clean":"2023-09-23T08:54:54.094905+0000","last_became_active":"2023-09-23T08:54:52.089587+0000","last_became_peered":"2023-09-23T08:54:52.089587+0000","last_unstale":"2023-09-23T08:54:54.094905+0000","last_undegraded":"2023-09-23T08:54:54.094905+0000","last_fullsized":"2023-09-23T08:54:54.094905+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T20:06:57.397730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:55.569648+0000","last_change":"2023-09-23T08:54:53.098662+0000","last_active":"2023-09-23T08:54:55.569648+0000","last_peered":"2023-09-23T08:54:55.569648+0000","last_clean":"2023-09-23T08:54:55.569648+0000","last_became_active":"2023-09-23T08:54:53.098288+0000","last_became_peered":"2023-09-23T08:54:53.098288+0000","last_unstale":"2023-09-23T08:54:55.569648+0000","last_undegraded":"2023-09-23T08:54:55.569648+0000","last_fullsized":"2023-09-23T08:54:55.569648+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T10:35:55.990676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"85'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.869048+0000","last_change":"2023-09-23T08:54:52.083109+0000","last_active":"2023-09-23T08:54:54.869048+0000","last_peered":"2023-09-23T08:54:54.869048+0000","last_clean":"2023-09-23T08:54:54.869048+0000","last_became_active":"2023-09-23T08:54:52.082479+0000","last_became_peered":"2023-09-23T08:54:52.082479+0000","last_unstale":"2023-09-23T08:54:54.869048+0000","last_undegraded":"2023-09-23T08:54:54.869048+0000","last_fullsized":"2023-09-23T08:54:54.869048+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T18:32:18.729897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.392018+0000","last_change":"2023-09-23T08:54:53.105112+0000","last_active":"2023-09-23T08:54:54.392018+0000","last_peered":"2023-09-23T08:54:54.392018+0000","last_clean":"2023-09-23T08:54:54.392018+0000","last_became_active":"2023-09-23T08:54:53.104639+0000","last_became_peered":"2023-09-23T08:54:53.104639+0000","last_unstale":"2023-09-23T08:54:54.392018+0000","last_undegraded":"2023-09-23T08:54:54.392018+0000","last_fullsized":"2023-09-23T08:54:54.392018+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T20:31:14.872469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"85'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.868752+0000","last_change":"2023-09-23T08:54:52.082798+0000","last_active":"2023-09-23T08:54:54.868752+0000","last_peered":"2023-09-23T08:54:54.868752+0000","last_clean":"2023-09-23T08:54:54.868752+0000","last_became_active":"2023-09-23T08:54:52.082455+0000","last_became_peered":"2023-09-23T08:54:52.082455+0000","last_unstale":"2023-09-23T08:54:54.868752+0000","last_undegraded":"2023-09-23T08:54:54.868752+0000","last_fullsized":"2023-09-23T08:54:54.868752+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T11:37:06.016954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:56.196906+0000","last_change":"2023-09-23T08:54:53.105012+0000","last_active":"2023-09-23T08:54:56.196906+0000","last_peered":"2023-09-23T08:54:56.196906+0000","last_clean":"2023-09-23T08:54:56.196906+0000","last_became_active":"2023-09-23T08:54:53.104670+0000","last_became_peered":"2023-09-23T08:54:53.104670+0000","last_unstale":"2023-09-23T08:54:56.196906+0000","last_undegraded":"2023-09-23T08:54:56.196906+0000","last_fullsized":"2023-09-23T08:54:56.196906+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T09:16:46.448441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"86'5","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:56.421574+0000","last_change":"2023-09-23T08:54:52.085771+0000","last_active":"2023-09-23T08:54:56.421574+0000","last_peered":"2023-09-23T08:54:56.421574+0000","last_clean":"2023-09-23T08:54:56.421574+0000","last_became_active":"2023-09-23T08:54:52.085424+0000","last_became_peered":"2023-09-23T08:54:52.085424+0000","last_unstale":"2023-09-23T08:54:56.421574+0000","last_undegraded":"2023-09-23T08:54:56.421574+0000","last_fullsized":"2023-09-23T08:54:56.421574+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T09:59:26.327934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.868752+0000","last_change":"2023-09-23T08:54:53.109830+0000","last_active":"2023-09-23T08:54:54.868752+0000","last_peered":"2023-09-23T08:54:54.868752+0000","last_clean":"2023-09-23T08:54:54.868752+0000","last_became_active":"2023-09-23T08:54:53.109532+0000","last_became_peered":"2023-09-23T08:54:53.109532+0000","last_unstale":"2023-09-23T08:54:54.868752+0000","last_undegraded":"2023-09-23T08:54:54.868752+0000","last_fullsized":"2023-09-23T08:54:54.868752+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T12:44:22.033915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"85'1","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-23T08:54:53.421123+0000","last_change":"2023-09-23T08:54:52.075998+0000","last_active":"2023-09-23T08:54:53.421123+0000","last_peered":"2023-09-23T08:54:53.421123+0000","last_clean":"2023-09-23T08:54:53.421123+0000","last_became_active":"2023-09-23T08:54:52.075701+0000","last_became_peered":"2023-09-23T08:54:52.075701+0000","last_unstale":"2023-09-23T08:54:53.421123+0000","last_undegraded":"2023-09-23T08:54:53.421123+0000","last_fullsized":"2023-09-23T08:54:53.421123+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T12:25:42.198583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:56.197219+0000","last_change":"2023-09-23T08:54:53.106654+0000","last_active":"2023-09-23T08:54:56.197219+0000","last_peered":"2023-09-23T08:54:56.197219+0000","last_clean":"2023-09-23T08:54:56.197219+0000","last_became_active":"2023-09-23T08:54:53.106348+0000","last_became_peered":"2023-09-23T08:54:53.106348+0000","last_unstale":"2023-09-23T08:54:56.197219+0000","last_undegraded":"2023-09-23T08:54:56.197219+0000","last_fullsized":"2023-09-23T08:54:56.197219+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:37:54.806517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"86'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:57.445194+0000","last_change":"2023-09-23T08:54:52.073666+0000","last_active":"2023-09-23T08:54:57.445194+0000","last_peered":"2023-09-23T08:54:57.445194+0000","last_clean":"2023-09-23T08:54:57.445194+0000","last_became_active":"2023-09-23T08:54:52.073248+0000","last_became_peered":"2023-09-23T08:54:52.073248+0000","last_unstale":"2023-09-23T08:54:57.445194+0000","last_undegraded":"2023-09-23T08:54:57.445194+0000","last_fullsized":"2023-09-23T08:54:57.445194+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:24:23.561390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.094172+0000","last_change":"2023-09-23T08:54:53.109621+0000","last_active":"2023-09-23T08:54:54.094172+0000","last_peered":"2023-09-23T08:54:54.094172+0000","last_clean":"2023-09-23T08:54:54.094172+0000","last_became_active":"2023-09-23T08:54:53.109304+0000","last_became_peered":"2023-09-23T08:54:53.109304+0000","last_unstale":"2023-09-23T08:54:54.094172+0000","last_undegraded":"2023-09-23T08:54:54.094172+0000","last_fullsized":"2023-09-23T08:54:54.094172+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T09:40:00.616277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"86'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:56.420897+0000","last_change":"2023-09-23T08:54:52.081580+0000","last_active":"2023-09-23T08:54:56.420897+0000","last_peered":"2023-09-23T08:54:56.420897+0000","last_clean":"2023-09-23T08:54:56.420897+0000","last_became_active":"2023-09-23T08:54:52.081151+0000","last_became_peered":"2023-09-23T08:54:52.081151+0000","last_unstale":"2023-09-23T08:54:56.420897+0000","last_undegraded":"2023-09-23T08:54:56.420897+0000","last_fullsized":"2023-09-23T08:54:56.420897+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T10:06:12.914323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:55.823125+0000","last_change":"2023-09-23T08:54:53.108334+0000","last_active":"2023-09-23T08:54:55.823125+0000","last_peered":"2023-09-23T08:54:55.823125+0000","last_clean":"2023-09-23T08:54:55.823125+0000","last_became_active":"2023-09-23T08:54:53.108038+0000","last_became_peered":"2023-09-23T08:54:53.108038+0000","last_unstale":"2023-09-23T08:54:55.823125+0000","last_undegraded":"2023-09-23T08:54:55.823125+0000","last_fullsized":"2023-09-23T08:54:55.823125+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:27:47.906273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-23T08:54:53.093704+0000","last_change":"2023-09-23T08:54:52.084025+0000","last_active":"2023-09-23T08:54:53.093704+0000","last_peered":"2023-09-23T08:54:53.093704+0000","last_clean":"2023-09-23T08:54:53.093704+0000","last_became_active":"2023-09-23T08:54:52.083625+0000","last_became_peered":"2023-09-23T08:54:52.083625+0000","last_unstale":"2023-09-23T08:54:53.093704+0000","last_undegraded":"2023-09-23T08:54:53.093704+0000","last_fullsized":"2023-09-23T08:54:53.093704+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T20:38:51.705533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.392373+0000","last_change":"2023-09-23T08:54:53.106602+0000","last_active":"2023-09-23T08:54:54.392373+0000","last_peered":"2023-09-23T08:54:54.392373+0000","last_clean":"2023-09-23T08:54:54.392373+0000","last_became_active":"2023-09-23T08:54:53.105501+0000","last_became_peered":"2023-09-23T08:54:53.105501+0000","last_unstale":"2023-09-23T08:54:54.392373+0000","last_undegraded":"2023-09-23T08:54:54.392373+0000","last_fullsized":"2023-09-23T08:54:54.392373+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T20:10:34.997922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.685650+0000","last_change":"2023-09-23T08:54:52.079197+0000","last_active":"2023-09-23T08:54:54.685650+0000","last_peered":"2023-09-23T08:54:54.685650+0000","last_clean":"2023-09-23T08:54:54.685650+0000","last_became_active":"2023-09-23T08:54:52.078748+0000","last_became_peered":"2023-09-23T08:54:52.078748+0000","last_unstale":"2023-09-23T08:54:54.685650+0000","last_undegraded":"2023-09-23T08:54:54.685650+0000","last_fullsized":"2023-09-23T08:54:54.685650+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:39:11.995069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:55.569653+0000","last_change":"2023-09-23T08:54:53.105831+0000","last_active":"2023-09-23T08:54:55.569653+0000","last_peered":"2023-09-23T08:54:55.569653+0000","last_clean":"2023-09-23T08:54:55.569653+0000","last_became_active":"2023-09-23T08:54:53.105511+0000","last_became_peered":"2023-09-23T08:54:53.105511+0000","last_unstale":"2023-09-23T08:54:55.569653+0000","last_undegraded":"2023-09-23T08:54:55.569653+0000","last_fullsized":"2023-09-23T08:54:55.569653+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T18:11:31.880639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"86'5","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:56.420110+0000","last_change":"2023-09-23T08:54:52.089312+0000","last_active":"2023-09-23T08:54:56.420110+0000","last_peered":"2023-09-23T08:54:56.420110+0000","last_clean":"2023-09-23T08:54:56.420110+0000","last_became_active":"2023-09-23T08:54:52.088762+0000","last_became_peered":"2023-09-23T08:54:52.088762+0000","last_unstale":"2023-09-23T08:54:56.420110+0000","last_undegraded":"2023-09-23T08:54:56.420110+0000","last_fullsized":"2023-09-23T08:54:56.420110+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T13:11:23.132983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.392270+0000","last_change":"2023-09-23T08:54:53.106972+0000","last_active":"2023-09-23T08:54:54.392270+0000","last_peered":"2023-09-23T08:54:54.392270+0000","last_clean":"2023-09-23T08:54:54.392270+0000","last_became_active":"2023-09-23T08:54:53.105175+0000","last_became_peered":"2023-09-23T08:54:53.105175+0000","last_unstale":"2023-09-23T08:54:54.392270+0000","last_undegraded":"2023-09-23T08:54:54.392270+0000","last_fullsized":"2023-09-23T08:54:54.392270+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:04:19.976958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"85'6","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-23T08:54:53.422616+0000","last_change":"2023-09-23T08:54:52.077758+0000","last_active":"2023-09-23T08:54:53.422616+0000","last_peered":"2023-09-23T08:54:53.422616+0000","last_clean":"2023-09-23T08:54:53.422616+0000","last_became_active":"2023-09-23T08:54:52.077461+0000","last_became_peered":"2023-09-23T08:54:52.077461+0000","last_unstale":"2023-09-23T08:54:53.422616+0000","last_undegraded":"2023-09-23T08:54:53.422616+0000","last_fullsized":"2023-09-23T08:54:53.422616+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T20:02:07.086289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.868906+0000","last_change":"2023-09-23T08:54:53.102967+0000","last_active":"2023-09-23T08:54:54.868906+0000","last_peered":"2023-09-23T08:54:54.868906+0000","last_clean":"2023-09-23T08:54:54.868906+0000","last_became_active":"2023-09-23T08:54:53.102608+0000","last_became_peered":"2023-09-23T08:54:53.102608+0000","last_unstale":"2023-09-23T08:54:54.868906+0000","last_undegraded":"2023-09-23T08:54:54.868906+0000","last_fullsized":"2023-09-23T08:54:54.868906+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:22:54.217099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:57.443899+0000","last_change":"2023-09-23T08:54:52.083885+0000","last_active":"2023-09-23T08:54:57.443899+0000","last_peered":"2023-09-23T08:54:57.443899+0000","last_clean":"2023-09-23T08:54:57.443899+0000","last_became_active":"2023-09-23T08:54:52.083530+0000","last_became_peered":"2023-09-23T08:54:52.083530+0000","last_unstale":"2023-09-23T08:54:57.443899+0000","last_undegraded":"2023-09-23T08:54:57.443899+0000","last_fullsized":"2023-09-23T08:54:57.443899+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T14:10:03.782909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.093435+0000","last_change":"2023-09-23T08:54:53.102429+0000","last_active":"2023-09-23T08:54:54.093435+0000","last_peered":"2023-09-23T08:54:54.093435+0000","last_clean":"2023-09-23T08:54:54.093435+0000","last_became_active":"2023-09-23T08:54:53.102139+0000","last_became_peered":"2023-09-23T08:54:53.102139+0000","last_unstale":"2023-09-23T08:54:54.093435+0000","last_undegraded":"2023-09-23T08:54:54.093435+0000","last_fullsized":"2023-09-23T08:54:54.093435+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T12:27:03.746727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"86'4","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:56.421306+0000","last_change":"2023-09-23T08:54:52.083380+0000","last_active":"2023-09-23T08:54:56.421306+0000","last_peered":"2023-09-23T08:54:56.421306+0000","last_clean":"2023-09-23T08:54:56.421306+0000","last_became_active":"2023-09-23T08:54:52.083094+0000","last_became_peered":"2023-09-23T08:54:52.083094+0000","last_unstale":"2023-09-23T08:54:56.421306+0000","last_undegraded":"2023-09-23T08:54:56.421306+0000","last_fullsized":"2023-09-23T08:54:56.421306+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T18:00:32.435850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.685742+0000","last_change":"2023-09-23T08:54:53.107671+0000","last_active":"2023-09-23T08:54:54.685742+0000","last_peered":"2023-09-23T08:54:54.685742+0000","last_clean":"2023-09-23T08:54:54.685742+0000","last_became_active":"2023-09-23T08:54:53.107372+0000","last_became_peered":"2023-09-23T08:54:53.107372+0000","last_unstale":"2023-09-23T08:54:54.685742+0000","last_undegraded":"2023-09-23T08:54:54.685742+0000","last_fullsized":"2023-09-23T08:54:54.685742+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T14:29:45.711969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:56.196161+0000","last_change":"2023-09-23T08:54:52.080556+0000","last_active":"2023-09-23T08:54:56.196161+0000","last_peered":"2023-09-23T08:54:56.196161+0000","last_clean":"2023-09-23T08:54:56.196161+0000","last_became_active":"2023-09-23T08:54:52.080220+0000","last_became_peered":"2023-09-23T08:54:52.080220+0000","last_unstale":"2023-09-23T08:54:56.196161+0000","last_undegraded":"2023-09-23T08:54:56.196161+0000","last_fullsized":"2023-09-23T08:54:56.196161+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T14:17:35.705342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.685295+0000","last_change":"2023-09-23T08:54:53.107044+0000","last_active":"2023-09-23T08:54:54.685295+0000","last_peered":"2023-09-23T08:54:54.685295+0000","last_clean":"2023-09-23T08:54:54.685295+0000","last_became_active":"2023-09-23T08:54:53.106715+0000","last_became_peered":"2023-09-23T08:54:53.106715+0000","last_unstale":"2023-09-23T08:54:54.685295+0000","last_undegraded":"2023-09-23T08:54:54.685295+0000","last_fullsized":"2023-09-23T08:54:54.685295+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:52:15.415770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"85'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.868502+0000","last_change":"2023-09-23T08:54:52.078052+0000","last_active":"2023-09-23T08:54:54.868502+0000","last_peered":"2023-09-23T08:54:54.868502+0000","last_clean":"2023-09-23T08:54:54.868502+0000","last_became_active":"2023-09-23T08:54:52.077678+0000","last_became_peered":"2023-09-23T08:54:52.077678+0000","last_unstale":"2023-09-23T08:54:54.868502+0000","last_undegraded":"2023-09-23T08:54:54.868502+0000","last_fullsized":"2023-09-23T08:54:54.868502+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T13:15:02.677497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:56.196899+0000","last_change":"2023-09-23T08:54:53.107673+0000","last_active":"2023-09-23T08:54:56.196899+0000","last_peered":"2023-09-23T08:54:56.196899+0000","last_clean":"2023-09-23T08:54:56.196899+0000","last_became_active":"2023-09-23T08:54:53.107373+0000","last_became_peered":"2023-09-23T08:54:53.107373+0000","last_unstale":"2023-09-23T08:54:56.196899+0000","last_undegraded":"2023-09-23T08:54:56.196899+0000","last_fullsized":"2023-09-23T08:54:56.196899+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T14:21:29.297945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"85'1","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.868944+0000","last_change":"2023-09-23T08:54:52.085460+0000","last_active":"2023-09-23T08:54:54.868944+0000","last_peered":"2023-09-23T08:54:54.868944+0000","last_clean":"2023-09-23T08:54:54.868944+0000","last_became_active":"2023-09-23T08:54:52.085186+0000","last_became_peered":"2023-09-23T08:54:52.085186+0000","last_unstale":"2023-09-23T08:54:54.868944+0000","last_undegraded":"2023-09-23T08:54:54.868944+0000","last_fullsized":"2023-09-23T08:54:54.868944+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T12:46:28.431132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.093439+0000","last_change":"2023-09-23T08:54:53.103630+0000","last_active":"2023-09-23T08:54:54.093439+0000","last_peered":"2023-09-23T08:54:54.093439+0000","last_clean":"2023-09-23T08:54:54.093439+0000","last_became_active":"2023-09-23T08:54:53.103270+0000","last_became_peered":"2023-09-23T08:54:53.103270+0000","last_unstale":"2023-09-23T08:54:54.093439+0000","last_undegraded":"2023-09-23T08:54:54.093439+0000","last_fullsized":"2023-09-23T08:54:54.093439+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T11:41:57.582849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:55.823177+0000","last_change":"2023-09-23T08:54:52.089279+0000","last_active":"2023-09-23T08:54:55.823177+0000","last_peered":"2023-09-23T08:54:55.823177+0000","last_clean":"2023-09-23T08:54:55.823177+0000","last_became_active":"2023-09-23T08:54:52.088861+0000","last_became_peered":"2023-09-23T08:54:52.088861+0000","last_unstale":"2023-09-23T08:54:55.823177+0000","last_undegraded":"2023-09-23T08:54:55.823177+0000","last_fullsized":"2023-09-23T08:54:55.823177+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T10:00:39.132387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-23T08:54:53.109463+0000","last_change":"2023-09-23T08:54:53.105653+0000","last_active":"2023-09-23T08:54:53.109463+0000","last_peered":"2023-09-23T08:54:53.109463+0000","last_clean":"2023-09-23T08:54:53.109463+0000","last_became_active":"2023-09-23T08:54:53.105309+0000","last_became_peered":"2023-09-23T08:54:53.105309+0000","last_unstale":"2023-09-23T08:54:53.109463+0000","last_undegraded":"2023-09-23T08:54:53.109463+0000","last_fullsized":"2023-09-23T08:54:53.109463+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T20:50:21.572446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.685356+0000","last_change":"2023-09-23T08:54:52.080521+0000","last_active":"2023-09-23T08:54:54.685356+0000","last_peered":"2023-09-23T08:54:54.685356+0000","last_clean":"2023-09-23T08:54:54.685356+0000","last_became_active":"2023-09-23T08:54:52.080164+0000","last_became_peered":"2023-09-23T08:54:52.080164+0000","last_unstale":"2023-09-23T08:54:54.685356+0000","last_undegraded":"2023-09-23T08:54:54.685356+0000","last_fullsized":"2023-09-23T08:54:54.685356+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T12:44:56.909319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-23T08:54:53.111086+0000","last_change":"2023-09-23T08:54:53.107516+0000","last_active":"2023-09-23T08:54:53.111086+0000","last_peered":"2023-09-23T08:54:53.111086+0000","last_clean":"2023-09-23T08:54:53.111086+0000","last_became_active":"2023-09-23T08:54:53.106785+0000","last_became_peered":"2023-09-23T08:54:53.106785+0000","last_unstale":"2023-09-23T08:54:53.111086+0000","last_undegraded":"2023-09-23T08:54:53.111086+0000","last_fullsized":"2023-09-23T08:54:53.111086+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:32:36.314244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:56.196433+0000","last_change":"2023-09-23T08:54:53.110406+0000","last_active":"2023-09-23T08:54:56.196433+0000","last_peered":"2023-09-23T08:54:56.196433+0000","last_clean":"2023-09-23T08:54:56.196433+0000","last_became_active":"2023-09-23T08:54:53.107758+0000","last_became_peered":"2023-09-23T08:54:53.107758+0000","last_unstale":"2023-09-23T08:54:56.196433+0000","last_undegraded":"2023-09-23T08:54:56.196433+0000","last_fullsized":"2023-09-23T08:54:56.196433+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:40:55.079186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'4","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:57.445549+0000","last_change":"2023-09-23T08:54:52.081384+0000","last_active":"2023-09-23T08:54:57.445549+0000","last_peered":"2023-09-23T08:54:57.445549+0000","last_clean":"2023-09-23T08:54:57.445549+0000","last_became_active":"2023-09-23T08:54:52.081082+0000","last_became_peered":"2023-09-23T08:54:52.081082+0000","last_unstale":"2023-09-23T08:54:57.445549+0000","last_undegraded":"2023-09-23T08:54:57.445549+0000","last_fullsized":"2023-09-23T08:54:57.445549+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:39:54.713880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.094508+0000","last_change":"2023-09-23T08:54:53.109011+0000","last_active":"2023-09-23T08:54:54.094508+0000","last_peered":"2023-09-23T08:54:54.094508+0000","last_clean":"2023-09-23T08:54:54.094508+0000","last_became_active":"2023-09-23T08:54:53.108520+0000","last_became_peered":"2023-09-23T08:54:53.108520+0000","last_unstale":"2023-09-23T08:54:54.094508+0000","last_undegraded":"2023-09-23T08:54:54.094508+0000","last_fullsized":"2023-09-23T08:54:54.094508+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T10:48:12.245624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"86'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:56.419487+0000","last_change":"2023-09-23T08:54:52.078525+0000","last_active":"2023-09-23T08:54:56.419487+0000","last_peered":"2023-09-23T08:54:56.419487+0000","last_clean":"2023-09-23T08:54:56.419487+0000","last_became_active":"2023-09-23T08:54:52.078177+0000","last_became_peered":"2023-09-23T08:54:52.078177+0000","last_unstale":"2023-09-23T08:54:56.419487+0000","last_undegraded":"2023-09-23T08:54:56.419487+0000","last_fullsized":"2023-09-23T08:54:56.419487+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T14:48:34.659834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":348,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.685333+0000","last_change":"2023-09-23T08:53:33.610965+0000","last_active":"2023-09-23T08:54:54.685333+0000","last_peered":"2023-09-23T08:54:54.685333+0000","last_clean":"2023-09-23T08:54:54.685333+0000","last_became_active":"2023-09-23T08:53:33.610529+0000","last_became_peered":"2023-09-23T08:53:33.610529+0000","last_unstale":"2023-09-23T08:54:54.685333+0000","last_undegraded":"2023-09-23T08:54:54.685333+0000","last_fullsized":"2023-09-23T08:54:54.685333+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:50:00.779071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:50:00.779071+0000","last_clean_scrub_stamp":"2023-09-23T08:50:00.779071+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T11:54:40.139279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.093168+0000","last_change":"2023-09-23T08:54:53.099970+0000","last_active":"2023-09-23T08:54:54.093168+0000","last_peered":"2023-09-23T08:54:54.093168+0000","last_clean":"2023-09-23T08:54:54.093168+0000","last_became_active":"2023-09-23T08:54:53.099630+0000","last_became_peered":"2023-09-23T08:54:53.099630+0000","last_unstale":"2023-09-23T08:54:54.093168+0000","last_undegraded":"2023-09-23T08:54:54.093168+0000","last_fullsized":"2023-09-23T08:54:54.093168+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T10:54:38.993617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.685677+0000","last_change":"2023-09-23T08:54:52.083083+0000","last_active":"2023-09-23T08:54:54.685677+0000","last_peered":"2023-09-23T08:54:54.685677+0000","last_clean":"2023-09-23T08:54:54.685677+0000","last_became_active":"2023-09-23T08:54:52.082704+0000","last_became_peered":"2023-09-23T08:54:52.082704+0000","last_unstale":"2023-09-23T08:54:54.685677+0000","last_undegraded":"2023-09-23T08:54:54.685677+0000","last_fullsized":"2023-09-23T08:54:54.685677+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:17:05.649810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.868915+0000","last_change":"2023-09-23T08:54:52.080482+0000","last_active":"2023-09-23T08:54:54.868915+0000","last_peered":"2023-09-23T08:54:54.868915+0000","last_clean":"2023-09-23T08:54:54.868915+0000","last_became_active":"2023-09-23T08:54:52.079756+0000","last_became_peered":"2023-09-23T08:54:52.079756+0000","last_unstale":"2023-09-23T08:54:54.868915+0000","last_undegraded":"2023-09-23T08:54:54.868915+0000","last_fullsized":"2023-09-23T08:54:54.868915+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T09:03:05.737800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.093479+0000","last_change":"2023-09-23T08:54:53.092828+0000","last_active":"2023-09-23T08:54:54.093479+0000","last_peered":"2023-09-23T08:54:54.093479+0000","last_clean":"2023-09-23T08:54:54.093479+0000","last_became_active":"2023-09-23T08:54:53.092486+0000","last_became_peered":"2023-09-23T08:54:53.092486+0000","last_unstale":"2023-09-23T08:54:54.093479+0000","last_undegraded":"2023-09-23T08:54:54.093479+0000","last_fullsized":"2023-09-23T08:54:54.093479+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:13:51.960156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"86'3","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:57.445567+0000","last_change":"2023-09-23T08:54:52.081801+0000","last_active":"2023-09-23T08:54:57.445567+0000","last_peered":"2023-09-23T08:54:57.445567+0000","last_clean":"2023-09-23T08:54:57.445567+0000","last_became_active":"2023-09-23T08:54:52.081449+0000","last_became_peered":"2023-09-23T08:54:52.081449+0000","last_unstale":"2023-09-23T08:54:57.445567+0000","last_undegraded":"2023-09-23T08:54:57.445567+0000","last_fullsized":"2023-09-23T08:54:57.445567+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T18:47:12.813500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.094760+0000","last_change":"2023-09-23T08:54:53.101037+0000","last_active":"2023-09-23T08:54:54.094760+0000","last_peered":"2023-09-23T08:54:54.094760+0000","last_clean":"2023-09-23T08:54:54.094760+0000","last_became_active":"2023-09-23T08:54:53.100673+0000","last_became_peered":"2023-09-23T08:54:53.100673+0000","last_unstale":"2023-09-23T08:54:54.094760+0000","last_undegraded":"2023-09-23T08:54:54.094760+0000","last_fullsized":"2023-09-23T08:54:54.094760+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T10:37:30.873142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"86'4","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:56.419496+0000","last_change":"2023-09-23T08:54:52.077785+0000","last_active":"2023-09-23T08:54:56.419496+0000","last_peered":"2023-09-23T08:54:56.419496+0000","last_clean":"2023-09-23T08:54:56.419496+0000","last_became_active":"2023-09-23T08:54:52.077306+0000","last_became_peered":"2023-09-23T08:54:52.077306+0000","last_unstale":"2023-09-23T08:54:56.419496+0000","last_undegraded":"2023-09-23T08:54:56.419496+0000","last_fullsized":"2023-09-23T08:54:56.419496+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T13:15:21.302985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:55.569509+0000","last_change":"2023-09-23T08:54:53.106534+0000","last_active":"2023-09-23T08:54:55.569509+0000","last_peered":"2023-09-23T08:54:55.569509+0000","last_clean":"2023-09-23T08:54:55.569509+0000","last_became_active":"2023-09-23T08:54:53.105928+0000","last_became_peered":"2023-09-23T08:54:53.105928+0000","last_unstale":"2023-09-23T08:54:55.569509+0000","last_undegraded":"2023-09-23T08:54:55.569509+0000","last_fullsized":"2023-09-23T08:54:55.569509+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:46:35.565053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:56.421115+0000","last_change":"2023-09-23T08:54:52.081122+0000","last_active":"2023-09-23T08:54:56.421115+0000","last_peered":"2023-09-23T08:54:56.421115+0000","last_clean":"2023-09-23T08:54:56.421115+0000","last_became_active":"2023-09-23T08:54:52.080825+0000","last_became_peered":"2023-09-23T08:54:52.080825+0000","last_unstale":"2023-09-23T08:54:56.421115+0000","last_undegraded":"2023-09-23T08:54:56.421115+0000","last_fullsized":"2023-09-23T08:54:56.421115+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T09:32:12.256672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.868774+0000","last_change":"2023-09-23T08:54:53.106050+0000","last_active":"2023-09-23T08:54:54.868774+0000","last_peered":"2023-09-23T08:54:54.868774+0000","last_clean":"2023-09-23T08:54:54.868774+0000","last_became_active":"2023-09-23T08:54:53.105729+0000","last_became_peered":"2023-09-23T08:54:53.105729+0000","last_unstale":"2023-09-23T08:54:54.868774+0000","last_undegraded":"2023-09-23T08:54:54.868774+0000","last_fullsized":"2023-09-23T08:54:54.868774+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:11:10.758171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.094883+0000","last_change":"2023-09-23T08:54:52.086019+0000","last_active":"2023-09-23T08:54:54.094883+0000","last_peered":"2023-09-23T08:54:54.094883+0000","last_clean":"2023-09-23T08:54:54.094883+0000","last_became_active":"2023-09-23T08:54:52.085688+0000","last_became_peered":"2023-09-23T08:54:52.085688+0000","last_unstale":"2023-09-23T08:54:54.094883+0000","last_undegraded":"2023-09-23T08:54:54.094883+0000","last_fullsized":"2023-09-23T08:54:54.094883+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T11:10:16.280442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.093146+0000","last_change":"2023-09-23T08:54:53.099533+0000","last_active":"2023-09-23T08:54:54.093146+0000","last_peered":"2023-09-23T08:54:54.093146+0000","last_clean":"2023-09-23T08:54:54.093146+0000","last_became_active":"2023-09-23T08:54:53.099192+0000","last_became_peered":"2023-09-23T08:54:53.099192+0000","last_unstale":"2023-09-23T08:54:54.093146+0000","last_undegraded":"2023-09-23T08:54:54.093146+0000","last_fullsized":"2023-09-23T08:54:54.093146+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T11:23:50.174786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"86'1","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:56.196761+0000","last_change":"2023-09-23T08:54:52.086258+0000","last_active":"2023-09-23T08:54:56.196761+0000","last_peered":"2023-09-23T08:54:56.196761+0000","last_clean":"2023-09-23T08:54:56.196761+0000","last_became_active":"2023-09-23T08:54:52.085935+0000","last_became_peered":"2023-09-23T08:54:52.085935+0000","last_unstale":"2023-09-23T08:54:56.196761+0000","last_undegraded":"2023-09-23T08:54:56.196761+0000","last_fullsized":"2023-09-23T08:54:56.196761+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T18:34:46.098198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.094580+0000","last_change":"2023-09-23T08:54:53.105176+0000","last_active":"2023-09-23T08:54:54.094580+0000","last_peered":"2023-09-23T08:54:54.094580+0000","last_clean":"2023-09-23T08:54:54.094580+0000","last_became_active":"2023-09-23T08:54:53.104794+0000","last_became_peered":"2023-09-23T08:54:53.104794+0000","last_unstale":"2023-09-23T08:54:54.094580+0000","last_undegraded":"2023-09-23T08:54:54.094580+0000","last_fullsized":"2023-09-23T08:54:54.094580+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T12:29:26.317509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"85'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.868703+0000","last_change":"2023-09-23T08:54:52.078596+0000","last_active":"2023-09-23T08:54:54.868703+0000","last_peered":"2023-09-23T08:54:54.868703+0000","last_clean":"2023-09-23T08:54:54.868703+0000","last_became_active":"2023-09-23T08:54:52.078310+0000","last_became_peered":"2023-09-23T08:54:52.078310+0000","last_unstale":"2023-09-23T08:54:54.868703+0000","last_undegraded":"2023-09-23T08:54:54.868703+0000","last_fullsized":"2023-09-23T08:54:54.868703+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T08:55:44.970687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.685498+0000","last_change":"2023-09-23T08:54:53.106368+0000","last_active":"2023-09-23T08:54:54.685498+0000","last_peered":"2023-09-23T08:54:54.685498+0000","last_clean":"2023-09-23T08:54:54.685498+0000","last_became_active":"2023-09-23T08:54:53.105977+0000","last_became_peered":"2023-09-23T08:54:53.105977+0000","last_unstale":"2023-09-23T08:54:54.685498+0000","last_undegraded":"2023-09-23T08:54:54.685498+0000","last_fullsized":"2023-09-23T08:54:54.685498+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T14:38:34.430707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'5","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:58.464156+0000","last_change":"2023-09-23T08:54:52.089221+0000","last_active":"2023-09-23T08:54:58.464156+0000","last_peered":"2023-09-23T08:54:58.464156+0000","last_clean":"2023-09-23T08:54:58.464156+0000","last_became_active":"2023-09-23T08:54:52.088824+0000","last_became_peered":"2023-09-23T08:54:52.088824+0000","last_unstale":"2023-09-23T08:54:58.464156+0000","last_undegraded":"2023-09-23T08:54:58.464156+0000","last_fullsized":"2023-09-23T08:54:58.464156+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T20:24:40.305323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.685805+0000","last_change":"2023-09-23T08:54:53.107600+0000","last_active":"2023-09-23T08:54:54.685805+0000","last_peered":"2023-09-23T08:54:54.685805+0000","last_clean":"2023-09-23T08:54:54.685805+0000","last_became_active":"2023-09-23T08:54:53.105637+0000","last_became_peered":"2023-09-23T08:54:53.105637+0000","last_unstale":"2023-09-23T08:54:54.685805+0000","last_undegraded":"2023-09-23T08:54:54.685805+0000","last_fullsized":"2023-09-23T08:54:54.685805+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:18:17.690310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"86'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:56.196776+0000","last_change":"2023-09-23T08:54:52.081912+0000","last_active":"2023-09-23T08:54:56.196776+0000","last_peered":"2023-09-23T08:54:56.196776+0000","last_clean":"2023-09-23T08:54:56.196776+0000","last_became_active":"2023-09-23T08:54:52.081668+0000","last_became_peered":"2023-09-23T08:54:52.081668+0000","last_unstale":"2023-09-23T08:54:56.196776+0000","last_undegraded":"2023-09-23T08:54:56.196776+0000","last_fullsized":"2023-09-23T08:54:56.196776+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:30:20.267787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.685499+0000","last_change":"2023-09-23T08:54:53.106975+0000","last_active":"2023-09-23T08:54:54.685499+0000","last_peered":"2023-09-23T08:54:54.685499+0000","last_clean":"2023-09-23T08:54:54.685499+0000","last_became_active":"2023-09-23T08:54:53.106537+0000","last_became_peered":"2023-09-23T08:54:53.106537+0000","last_unstale":"2023-09-23T08:54:54.685499+0000","last_undegraded":"2023-09-23T08:54:54.685499+0000","last_fullsized":"2023-09-23T08:54:54.685499+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T13:42:55.831232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"86'3","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.406067+0000","last_change":"2023-09-23T08:54:52.081636+0000","last_active":"2023-09-23T08:54:54.406067+0000","last_peered":"2023-09-23T08:54:54.406067+0000","last_clean":"2023-09-23T08:54:54.406067+0000","last_became_active":"2023-09-23T08:54:52.081224+0000","last_became_peered":"2023-09-23T08:54:52.081224+0000","last_unstale":"2023-09-23T08:54:54.406067+0000","last_undegraded":"2023-09-23T08:54:54.406067+0000","last_fullsized":"2023-09-23T08:54:54.406067+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:48:26.708260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.685764+0000","last_change":"2023-09-23T08:54:53.109625+0000","last_active":"2023-09-23T08:54:54.685764+0000","last_peered":"2023-09-23T08:54:54.685764+0000","last_clean":"2023-09-23T08:54:54.685764+0000","last_became_active":"2023-09-23T08:54:53.109323+0000","last_became_peered":"2023-09-23T08:54:53.109323+0000","last_unstale":"2023-09-23T08:54:54.685764+0000","last_undegraded":"2023-09-23T08:54:54.685764+0000","last_fullsized":"2023-09-23T08:54:54.685764+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T08:54:59.569228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.093253+0000","last_change":"2023-09-23T08:54:53.100071+0000","last_active":"2023-09-23T08:54:54.093253+0000","last_peered":"2023-09-23T08:54:54.093253+0000","last_clean":"2023-09-23T08:54:54.093253+0000","last_became_active":"2023-09-23T08:54:53.099757+0000","last_became_peered":"2023-09-23T08:54:53.099757+0000","last_unstale":"2023-09-23T08:54:54.093253+0000","last_undegraded":"2023-09-23T08:54:54.093253+0000","last_fullsized":"2023-09-23T08:54:54.093253+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T11:26:58.182356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:56.196912+0000","last_change":"2023-09-23T08:54:53.101001+0000","last_active":"2023-09-23T08:54:56.196912+0000","last_peered":"2023-09-23T08:54:56.196912+0000","last_clean":"2023-09-23T08:54:56.196912+0000","last_became_active":"2023-09-23T08:54:53.100315+0000","last_became_peered":"2023-09-23T08:54:53.100315+0000","last_unstale":"2023-09-23T08:54:56.196912+0000","last_undegraded":"2023-09-23T08:54:56.196912+0000","last_fullsized":"2023-09-23T08:54:56.196912+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:00:47.052364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:56.196563+0000","last_change":"2023-09-23T08:54:53.102855+0000","last_active":"2023-09-23T08:54:56.196563+0000","last_peered":"2023-09-23T08:54:56.196563+0000","last_clean":"2023-09-23T08:54:56.196563+0000","last_became_active":"2023-09-23T08:54:53.102495+0000","last_became_peered":"2023-09-23T08:54:53.102495+0000","last_unstale":"2023-09-23T08:54:56.196563+0000","last_undegraded":"2023-09-23T08:54:56.196563+0000","last_fullsized":"2023-09-23T08:54:56.196563+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:48:11.977110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:55.569641+0000","last_change":"2023-09-23T08:54:53.102063+0000","last_active":"2023-09-23T08:54:55.569641+0000","last_peered":"2023-09-23T08:54:55.569641+0000","last_clean":"2023-09-23T08:54:55.569641+0000","last_became_active":"2023-09-23T08:54:53.101734+0000","last_became_peered":"2023-09-23T08:54:53.101734+0000","last_unstale":"2023-09-23T08:54:55.569641+0000","last_undegraded":"2023-09-23T08:54:55.569641+0000","last_fullsized":"2023-09-23T08:54:55.569641+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T18:45:53.768289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.093622+0000","last_change":"2023-09-23T08:54:53.110291+0000","last_active":"2023-09-23T08:54:54.093622+0000","last_peered":"2023-09-23T08:54:54.093622+0000","last_clean":"2023-09-23T08:54:54.093622+0000","last_became_active":"2023-09-23T08:54:53.109962+0000","last_became_peered":"2023-09-23T08:54:53.109962+0000","last_unstale":"2023-09-23T08:54:54.093622+0000","last_undegraded":"2023-09-23T08:54:54.093622+0000","last_fullsized":"2023-09-23T08:54:54.093622+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T18:30:15.264146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.093341+0000","last_change":"2023-09-23T08:54:53.104278+0000","last_active":"2023-09-23T08:54:54.093341+0000","last_peered":"2023-09-23T08:54:54.093341+0000","last_clean":"2023-09-23T08:54:54.093341+0000","last_became_active":"2023-09-23T08:54:53.103765+0000","last_became_peered":"2023-09-23T08:54:53.103765+0000","last_unstale":"2023-09-23T08:54:54.093341+0000","last_undegraded":"2023-09-23T08:54:54.093341+0000","last_fullsized":"2023-09-23T08:54:54.093341+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T14:55:54.833030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:56.197162+0000","last_change":"2023-09-23T08:54:53.104861+0000","last_active":"2023-09-23T08:54:56.197162+0000","last_peered":"2023-09-23T08:54:56.197162+0000","last_clean":"2023-09-23T08:54:56.197162+0000","last_became_active":"2023-09-23T08:54:53.104554+0000","last_became_peered":"2023-09-23T08:54:53.104554+0000","last_unstale":"2023-09-23T08:54:56.197162+0000","last_undegraded":"2023-09-23T08:54:56.197162+0000","last_fullsized":"2023-09-23T08:54:56.197162+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T09:09:00.027796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.094897+0000","last_change":"2023-09-23T08:54:53.106859+0000","last_active":"2023-09-23T08:54:54.094897+0000","last_peered":"2023-09-23T08:54:54.094897+0000","last_clean":"2023-09-23T08:54:54.094897+0000","last_became_active":"2023-09-23T08:54:53.106494+0000","last_became_peered":"2023-09-23T08:54:53.106494+0000","last_unstale":"2023-09-23T08:54:54.094897+0000","last_undegraded":"2023-09-23T08:54:54.094897+0000","last_fullsized":"2023-09-23T08:54:54.094897+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T09:26:45.689810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:56.196309+0000","last_change":"2023-09-23T08:54:53.101591+0000","last_active":"2023-09-23T08:54:56.196309+0000","last_peered":"2023-09-23T08:54:56.196309+0000","last_clean":"2023-09-23T08:54:56.196309+0000","last_became_active":"2023-09-23T08:54:53.101237+0000","last_became_peered":"2023-09-23T08:54:53.101237+0000","last_unstale":"2023-09-23T08:54:56.196309+0000","last_undegraded":"2023-09-23T08:54:56.196309+0000","last_fullsized":"2023-09-23T08:54:56.196309+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:39:46.335069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.094264+0000","last_change":"2023-09-23T08:54:53.103373+0000","last_active":"2023-09-23T08:54:54.094264+0000","last_peered":"2023-09-23T08:54:54.094264+0000","last_clean":"2023-09-23T08:54:54.094264+0000","last_became_active":"2023-09-23T08:54:53.102948+0000","last_became_peered":"2023-09-23T08:54:53.102948+0000","last_unstale":"2023-09-23T08:54:54.094264+0000","last_undegraded":"2023-09-23T08:54:54.094264+0000","last_fullsized":"2023-09-23T08:54:54.094264+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:35:07.251630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.392117+0000","last_change":"2023-09-23T08:54:53.100488+0000","last_active":"2023-09-23T08:54:54.392117+0000","last_peered":"2023-09-23T08:54:54.392117+0000","last_clean":"2023-09-23T08:54:54.392117+0000","last_became_active":"2023-09-23T08:54:53.100182+0000","last_became_peered":"2023-09-23T08:54:53.100182+0000","last_unstale":"2023-09-23T08:54:54.392117+0000","last_undegraded":"2023-09-23T08:54:54.392117+0000","last_fullsized":"2023-09-23T08:54:54.392117+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:05:08.498272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.093576+0000","last_change":"2023-09-23T08:54:53.097571+0000","last_active":"2023-09-23T08:54:54.093576+0000","last_peered":"2023-09-23T08:54:54.093576+0000","last_clean":"2023-09-23T08:54:54.093576+0000","last_became_active":"2023-09-23T08:54:53.097278+0000","last_became_peered":"2023-09-23T08:54:53.097278+0000","last_unstale":"2023-09-23T08:54:54.093576+0000","last_undegraded":"2023-09-23T08:54:54.093576+0000","last_fullsized":"2023-09-23T08:54:54.093576+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:20:31.523731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.093294+0000","last_change":"2023-09-23T08:54:53.113543+0000","last_active":"2023-09-23T08:54:54.093294+0000","last_peered":"2023-09-23T08:54:54.093294+0000","last_clean":"2023-09-23T08:54:54.093294+0000","last_became_active":"2023-09-23T08:54:53.113287+0000","last_became_peered":"2023-09-23T08:54:53.113287+0000","last_unstale":"2023-09-23T08:54:54.093294+0000","last_undegraded":"2023-09-23T08:54:54.093294+0000","last_fullsized":"2023-09-23T08:54:54.093294+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T12:52:12.034242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":5580,"num_objects":45,"num_object_clones":0,"num_object_copies":135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":92,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":192512,"data_stored":12758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892350991,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":921600,"data_stored":441360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:54:56 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.69399999999999995}]},{"osd":1,"last update":"Sat Sep 23 08:54:56 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":1.0740000000000001},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":1.0600000000000001}]},{"osd":2,"last update":"Sat Sep 23 08:54:56 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.81899999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":4,"last update":"Sat Sep 23 08:54:56 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.673,"5min":1.673,"15min":1.673},"last":1.099}]},{"osd":5,"last update":"Sat Sep 23 08:54:56 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.65300000000000002}]},{"osd":6,"last update":"Sat Sep 23 08:54:56 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.871}]},{"osd":7,"last update":"Sat Sep 23 08:54:56 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.997},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.74,"5min":1.74,"15min":1.74},"last":1.008}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]},{"osd":9,"last update":"Sat Sep 23 08:54:56 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":1.0389999999999999},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.89900000000000002}]},{"osd":10,"last update":"Sat Sep 23 08:54:56 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":2.3410000000000002,"5min":2.3410000000000002,"15min":2.3410000000000002},"last":1.196},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":1.149}]}]},{"osd":10,"up_from":73,"seq":313532612628,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28516,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716636,"statfs":{"total":95995035648,"available":95965835264,"internally_reserved":0,"allocated":1527808,"data_stored":1024964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":1,"last update":"Sat Sep 23 08:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":0.88200000000000001}]},{"osd":2,"last update":"Sat Sep 23 08:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.52200000000000002}]},{"osd":3,"last update":"Sat Sep 23 08:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.442},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.55800000000000005}]},{"osd":4,"last update":"Sat Sep 23 08:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":0.501}]},{"osd":5,"last update":"Sat Sep 23 08:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":0.745},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.333,"5min":1.333,"15min":1.333},"last":0.80000000000000004}]},{"osd":6,"last update":"Sat Sep 23 08:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.81200000000000006}]},{"osd":7,"last update":"Sat Sep 23 08:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.52500000000000002}]},{"osd":8,"last update":"Sat Sep 23 08:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.72199999999999998},{"interface":"front","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":0.54300000000000004}]},{"osd":9,"last update":"Sat Sep 23 08:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.78800000000000003},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.587,"5min":1.587,"15min":1.587},"last":0.82499999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]}]},{"osd":9,"up_from":68,"seq":292057776152,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":942080,"data_stored":442178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:54:05 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.46700000000000003}]},{"osd":1,"last update":"Sat Sep 23 08:54:05 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.375}]},{"osd":2,"last update":"Sat Sep 23 08:54:05 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.71999999999999997}]},{"osd":3,"last update":"Sat Sep 23 08:54:05 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.432}]},{"osd":4,"last update":"Sat Sep 23 08:54:05 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.53200000000000003}]},{"osd":5,"last update":"Sat Sep 23 08:54:05 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.625},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.70699999999999996}]},{"osd":6,"last update":"Sat Sep 23 08:54:05 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.68700000000000006}]},{"osd":7,"last update":"Sat Sep 23 08:54:05 2023","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.238,"15min":1.238},"min":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":7.0759999999999996,"5min":7.0759999999999996,"15min":7.0759999999999996},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.64400000000000002}]},{"osd":8,"last update":"Sat Sep 23 08:54:05 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.746},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.79000000000000004}]},{"osd":10,"last update":"Sat Sep 23 08:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.67500000000000004}]}]},{"osd":8,"up_from":60,"seq":257698037789,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":929792,"data_stored":441964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:54:41 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.67700000000000005,"15min":0.68500000000000005},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.85999999999999999,"5min":1.004,"15min":1.004},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.68500000000000005,"15min":0.69299999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.85799999999999998,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.69199999999999995}]},{"osd":1,"last update":"Sat Sep 23 08:54:41 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.79400000000000004,"15min":0.80400000000000005},"min":{"1min":0.46999999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0509999999999999,"5min":1.115,"15min":1.115},"last":1.032},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.73499999999999999,"15min":0.73899999999999999},"min":{"1min":0.52000000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.94199999999999995,"5min":0.998,"15min":0.998},"last":0.998}]},{"osd":2,"last update":"Sat Sep 23 08:54:41 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.59199999999999997,"15min":0.59999999999999998},"min":{"1min":0.373,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58599999999999997,"15min":0.58399999999999996},"min":{"1min":0.39600000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.57599999999999996}]},{"osd":3,"last update":"Sat Sep 23 08:54:41 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.76600000000000001,"15min":0.78800000000000003},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.78700000000000003,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.82399999999999995,"15min":0.83199999999999996},"min":{"1min":0.58099999999999996,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.95199999999999996,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.96099999999999997}]},{"osd":4,"last update":"Sat Sep 23 08:54:41 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.78800000000000003,"15min":0.80000000000000004},"min":{"1min":0.48599999999999999,"5min":0.439,"15min":0.439},"max":{"1min":0.90400000000000003,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":1.016},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.97099999999999997,"15min":1.0029999999999999},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.1060000000000001,"5min":3.7530000000000001,"15min":3.7530000000000001},"last":0.92500000000000004}]},{"osd":5,"last update":"Sat Sep 23 08:54:41 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.69999999999999996,"15min":0.71099999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.79100000000000004,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.75800000000000001,"15min":0.77300000000000002},"min":{"1min":0.434,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.872,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.55300000000000005}]},{"osd":6,"last update":"Sat Sep 23 08:54:41 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.89600000000000002,"15min":0.90700000000000003},"min":{"1min":0.53500000000000003,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0129999999999999,"5min":1.23,"15min":1.23},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.86099999999999999,"15min":0.875},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.91200000000000003,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.88400000000000001}]},{"osd":7,"last update":"Sat Sep 23 08:54:41 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.871,"15min":0.879},"min":{"1min":0.63800000000000001,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":0.98199999999999998,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.91300000000000003,"15min":0.92800000000000005},"min":{"1min":0.70099999999999996,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.98999999999999999,"5min":1.679,"15min":1.679},"last":0.82999999999999996}]},{"osd":9,"last update":"Sat Sep 23 08:54:05 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.78500000000000003}]},{"osd":10,"last update":"Sat Sep 23 08:54:32 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.97599999999999998},{"interface":"front","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":1.109}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0449999999999999}]}]},{"osd":7,"up_from":52,"seq":223338299427,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28484,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716668,"statfs":{"total":95995035648,"available":95965868032,"internally_reserved":0,"allocated":1499136,"data_stored":1023136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:54:15 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.627,"15min":0.621},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.59799999999999998,"15min":0.58599999999999997},"min":{"1min":0.48399999999999999,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.53800000000000003}]},{"osd":1,"last update":"Sat Sep 23 08:54:15 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.505,"15min":0.50800000000000001},"min":{"1min":0.32800000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.71399999999999997,"5min":0.754,"15min":0.754},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.55000000000000004}]},{"osd":2,"last update":"Sat Sep 23 08:54:15 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.73999999999999999,"15min":0.745},"min":{"1min":0.54900000000000004,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.84199999999999997,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.95599999999999996},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.72599999999999998,"15min":0.72999999999999998},"min":{"1min":0.46899999999999997,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.93899999999999995,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.79500000000000004}]},{"osd":3,"last update":"Sat Sep 23 08:54:15 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.67200000000000004,"15min":0.66400000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.72899999999999998,"15min":0.73099999999999998},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.0760000000000001,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.629}]},{"osd":4,"last update":"Sat Sep 23 08:54:15 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.70399999999999996,"15min":0.71299999999999997},"min":{"1min":0.36899999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.92100000000000004,"5min":1.04,"15min":1.04},"last":0.497},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.69099999999999995,"15min":0.69899999999999995},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.92100000000000004,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.39300000000000002}]},{"osd":5,"last update":"Sat Sep 23 08:54:15 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.80400000000000005,"15min":0.80800000000000005},"min":{"1min":0.57699999999999996,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.96799999999999997,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.79900000000000004,"15min":0.80900000000000005},"min":{"1min":0.48799999999999999,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.86399999999999999}]},{"osd":6,"last update":"Sat Sep 23 08:54:15 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.82699999999999996,"15min":0.83099999999999996},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.052,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.82499999999999996,"15min":0.82899999999999996},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":0.995,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.83999999999999997}]},{"osd":8,"last update":"Sat Sep 23 08:54:38 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.82599999999999996,"15min":0.81499999999999995},"min":{"1min":0.65900000000000003,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.0780000000000001,"5min":1.085,"15min":1.085},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.61099999999999999,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.1000000000000001,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.88800000000000001}]},{"osd":9,"last update":"Sat Sep 23 08:54:04 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.58299999999999996}]},{"osd":10,"last update":"Sat Sep 23 08:54:33 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.77200000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94099999999999995}]}]},{"osd":6,"up_from":47,"seq":201863462954,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":929792,"data_stored":441472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:54:46 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.44700000000000001,"15min":0.433},"min":{"1min":0.33400000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.501,"5min":0.48099999999999998,"15min":0.46700000000000003},"min":{"1min":0.34100000000000003,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.69899999999999995,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":1.0129999999999999}]},{"osd":1,"last update":"Sat Sep 23 08:54:46 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.66100000000000003,"15min":0.628},"min":{"1min":0.46000000000000002,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.97899999999999998,"5min":1.071,"15min":1.071},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.752,"5min":0.69099999999999995,"15min":0.66300000000000003},"min":{"1min":0.56899999999999995,"5min":0.498,"15min":0.498},"max":{"1min":1.024,"5min":1.026,"15min":1.026},"last":0.53400000000000003}]},{"osd":2,"last update":"Sat Sep 23 08:54:46 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.67600000000000005,"15min":0.66200000000000003},"min":{"1min":0.49099999999999999,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.93799999999999994,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":1.1859999999999999},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71399999999999997,"15min":0.69299999999999995},"min":{"1min":0.5,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.98599999999999999,"5min":1.143,"15min":1.143},"last":0.66500000000000004}]},{"osd":3,"last update":"Sat Sep 23 08:54:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.59599999999999997,"15min":0.58199999999999996},"min":{"1min":0.378,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.61199999999999999,"15min":0.59999999999999998},"min":{"1min":0.41099999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.83199999999999996,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.55700000000000005}]},{"osd":4,"last update":"Sat Sep 23 08:54:46 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.71999999999999997,"15min":0.71799999999999997},"min":{"1min":0.48699999999999999,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.999,"5min":1.151,"15min":1.151},"last":1.212},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.75700000000000001,"15min":0.73299999999999998},"min":{"1min":0.57099999999999995,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0489999999999999,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.85199999999999998}]},{"osd":5,"last update":"Sat Sep 23 08:54:46 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.749,"15min":0.72499999999999998},"min":{"1min":0.50800000000000001,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.038,"5min":1.099,"15min":1.099},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.76400000000000001,"15min":0.76000000000000001},"min":{"1min":0.53900000000000003,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.99199999999999999,"5min":1.165,"15min":1.165},"last":1.129}]},{"osd":7,"last update":"Sat Sep 23 08:54:15 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.77900000000000003,"15min":0.749},"min":{"1min":0.67300000000000004,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.81599999999999995,"15min":0.78900000000000003},"min":{"1min":0.68300000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.71899999999999997}]},{"osd":8,"last update":"Sat Sep 23 08:54:44 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.89100000000000001,"15min":0.89900000000000002},"min":{"1min":0.60099999999999998,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.105,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.87,"5min":0.88200000000000001,"15min":0.88400000000000001},"min":{"1min":0.51800000000000002,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.145,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.85899999999999999}]},{"osd":9,"last update":"Sat Sep 23 08:54:03 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":0.68300000000000005}]},{"osd":10,"last update":"Sat Sep 23 08:54:30 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.80100000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574914,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":929792,"data_stored":442699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:54:43 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.57899999999999996,"15min":0.55500000000000005},"min":{"1min":0.41999999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.60599999999999998,"15min":0.58699999999999997},"min":{"1min":0.39700000000000002,"5min":0.314,"15min":0.314},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.59499999999999997}]},{"osd":2,"last update":"Sat Sep 23 08:54:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.70499999999999996,"15min":0.69899999999999995},"min":{"1min":0.47299999999999998,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.69299999999999995,"15min":0.68700000000000006},"min":{"1min":0.45700000000000002,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.90400000000000003,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.77900000000000003}]},{"osd":3,"last update":"Sat Sep 23 08:54:38 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.67000000000000004,"15min":0.65100000000000002},"min":{"1min":0.495,"5min":0.436,"15min":0.436},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.65700000000000003,"15min":0.63900000000000001},"min":{"1min":0.53600000000000003,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.63700000000000001}]},{"osd":4,"last update":"Sat Sep 23 08:54:54 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.51000000000000001,"15min":0.48199999999999998},"min":{"1min":0.38600000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.92100000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.54500000000000004,"15min":0.51500000000000001},"min":{"1min":0.35599999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.51300000000000001}]},{"osd":5,"last update":"Sat Sep 23 08:54:27 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.73999999999999999,"15min":0.72799999999999998},"min":{"1min":0.56200000000000006,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.71099999999999997,"15min":0.70199999999999996},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.91700000000000004,"5min":1.01,"15min":1.01},"last":0.86799999999999999}]},{"osd":6,"last update":"Sat Sep 23 08:54:45 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71999999999999997,"15min":0.72399999999999998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.69699999999999995,"15min":0.69199999999999995},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.70399999999999996}]},{"osd":7,"last update":"Sat Sep 23 08:54:15 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.68100000000000005,"15min":0.68899999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.752,"5min":0.76700000000000002,"15min":0.76900000000000002},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.012,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.76200000000000001}]},{"osd":8,"last update":"Sat Sep 23 08:54:38 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.76300000000000001,"15min":0.745},"min":{"1min":0.58799999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":2.8010000000000002,"5min":2.8010000000000002,"15min":2.8010000000000002},"last":0.748},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.77000000000000002,"15min":0.76200000000000001},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.94599999999999995}]},{"osd":9,"last update":"Sat Sep 23 08:54:06 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.98299999999999998},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.79900000000000004}]},{"osd":10,"last update":"Sat Sep 23 08:54:30 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":1.0169999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738440,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":921600,"data_stored":441177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 23 08:54:42 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61399999999999999,"15min":0.58999999999999997},"min":{"1min":0.41099999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.80800000000000005,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72399999999999998,"15min":0.64300000000000002},"min":{"1min":0.47999999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.95899999999999996,"5min":5.7450000000000001,"15min":5.7450000000000001},"last":0.81299999999999994}]},{"osd":2,"last update":"Sat Sep 23 08:54:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.64000000000000001,"15min":0.64200000000000002},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.92700000000000005,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.63200000000000001,"15min":0.63500000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.872,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.61699999999999999}]},{"osd":3,"last update":"Sat Sep 23 08:53:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.47199999999999998,"15min":0.45600000000000002},"min":{"1min":0.377,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.54700000000000004,"15min":0.52500000000000002},"min":{"1min":0.40500000000000003,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.45700000000000002}]},{"osd":4,"last update":"Sat Sep 23 08:54:55 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.69399999999999995,"15min":0.64000000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.98899999999999999,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.72099999999999997,"15min":0.66400000000000003},"min":{"1min":0.44800000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.88400000000000001,"5min":5.6710000000000003,"15min":5.6710000000000003},"last":0.60299999999999998}]},{"osd":5,"last update":"Sat Sep 23 08:54:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69499999999999995,"15min":0.68899999999999995},"min":{"1min":0.48199999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.93500000000000005,"5min":0.996,"15min":0.996},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70599999999999996,"15min":0.69699999999999995},"min":{"1min":0.46000000000000002,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.113,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.83599999999999997}]},{"osd":6,"last update":"Sat Sep 23 08:54:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.69399999999999995,"15min":0.69499999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.73599999999999999,"15min":0.73499999999999999},"min":{"1min":0.47999999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.93899999999999995,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.79400000000000004}]},{"osd":7,"last update":"Sat Sep 23 08:54:14 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.77300000000000002,"15min":0.77900000000000003},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.0489999999999999,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.875,"5min":0.84599999999999997,"15min":0.84099999999999997},"min":{"1min":0.63500000000000001,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.81799999999999995}]},{"osd":8,"last update":"Sat Sep 23 08:54:36 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.83799999999999997,"15min":0.85099999999999998},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":0.98499999999999999,"5min":1.147,"15min":1.147},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.80500000000000005,"15min":0.81799999999999995},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.0840000000000001,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.74099999999999999}]},{"osd":9,"last update":"Sat Sep 23 08:54:06 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.51900000000000002}]},{"osd":10,"last update":"Sat Sep 23 08:54:30 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.88500000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]}]},{"osd":2,"up_from":18,"seq":77309411389,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":958464,"data_stored":444322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:54:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.627,"15min":0.61899999999999999},"min":{"1min":0.42299999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.94899999999999995,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.624,"15min":0.625},"min":{"1min":0.47299999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.92300000000000004,"5min":1.196,"15min":1.196},"last":0.62}]},{"osd":1,"last update":"Sat Sep 23 08:54:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.66100000000000003,"15min":0.67200000000000004},"min":{"1min":0.42199999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.97399999999999998,"5min":1.177,"15min":1.177},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.67400000000000004,"15min":0.66900000000000004},"min":{"1min":0.437,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.98999999999999999,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.97099999999999997}]},{"osd":3,"last update":"Sat Sep 23 08:54:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.72999999999999998,"15min":0.72199999999999998},"min":{"1min":0.54700000000000004,"5min":0.438,"15min":0.438},"max":{"1min":0.92900000000000005,"5min":1.083,"15min":1.083},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.68999999999999995,"15min":0.68400000000000005},"min":{"1min":0.45400000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.91000000000000003,"5min":1.054,"15min":1.054},"last":0.67900000000000005}]},{"osd":4,"last update":"Sat Sep 23 08:53:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.64100000000000001,"15min":0.63300000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.91100000000000003,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":1.036},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.66000000000000003,"15min":0.64500000000000002},"min":{"1min":0.55600000000000005,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.91400000000000003}]},{"osd":5,"last update":"Sat Sep 23 08:54:25 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.56499999999999995,"15min":0.54800000000000004},"min":{"1min":0.41699999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.54800000000000004,"15min":0.52900000000000003},"min":{"1min":0.39500000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.93700000000000006,"5min":1.085,"15min":1.085},"last":0.65200000000000002}]},{"osd":6,"last update":"Sat Sep 23 08:54:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.752,"15min":0.73199999999999998},"min":{"1min":0.57099999999999995,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.96899999999999997,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.70699999999999996,"15min":0.69299999999999995},"min":{"1min":0.46899999999999997,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.95899999999999996,"5min":1.115,"15min":1.115},"last":0.85399999999999998}]},{"osd":7,"last update":"Sat Sep 23 08:54:12 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.75,"15min":0.75},"min":{"1min":0.61399999999999999,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.93999999999999995,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.81699999999999995,"15min":0.81999999999999995},"min":{"1min":0.56299999999999994,"5min":0.501,"15min":0.501},"max":{"1min":1.006,"5min":1.129,"15min":1.129},"last":0.82199999999999995}]},{"osd":8,"last update":"Sat Sep 23 08:54:38 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73499999999999999,"15min":0.73599999999999999},"min":{"1min":0.47999999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.95099999999999996,"5min":1.085,"15min":1.085},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.82699999999999996}]},{"osd":9,"last update":"Sat Sep 23 08:54:06 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":1.004}]},{"osd":10,"last update":"Sat Sep 23 08:54:30 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":1.077},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":1.0880000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0589999999999999}]}]},{"osd":3,"up_from":26,"seq":111669149751,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":440860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.42499999999999999,"15min":0.39100000000000001},"min":{"1min":0.314,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.58399999999999996,"5min":0.745,"15min":0.745},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.44900000000000001,"15min":0.41599999999999998},"min":{"1min":0.38900000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.45900000000000002}]},{"osd":1,"last update":"Sat Sep 23 08:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.67600000000000005,"15min":0.61499999999999999},"min":{"1min":0.63700000000000001,"5min":0.434,"15min":0.434},"max":{"1min":0.98399999999999999,"5min":1.099,"15min":1.099},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.65800000000000003,"15min":0.625},"min":{"1min":0.51500000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.86899999999999999,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.69499999999999995}]},{"osd":2,"last update":"Sat Sep 23 08:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.67500000000000004,"15min":0.64600000000000002},"min":{"1min":0.46899999999999997,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.88900000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.755,"5min":0.69799999999999995,"15min":0.66000000000000003},"min":{"1min":0.56299999999999994,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.95899999999999996,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.81799999999999995}]},{"osd":4,"last update":"Sat Sep 23 08:54:00 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.67900000000000005,"15min":0.65400000000000003},"min":{"1min":0.65400000000000003,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.68400000000000005,"15min":0.65200000000000002},"min":{"1min":0.59299999999999997,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.76100000000000001}]},{"osd":5,"last update":"Sat Sep 23 08:54:25 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.78400000000000003,"15min":0.77000000000000002},"min":{"1min":0.65400000000000003,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.016,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78100000000000003,"15min":0.76800000000000002},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":0.997,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.86799999999999999}]},{"osd":6,"last update":"Sat Sep 23 08:54:50 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.63500000000000001,"15min":0.64500000000000002},"min":{"1min":0.45900000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.746,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.5},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68600000000000005,"15min":0.66600000000000004},"min":{"1min":0.435,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.03,"5min":1.054,"15min":1.054},"last":0.59499999999999997}]},{"osd":7,"last update":"Sat Sep 23 08:54:13 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.81399999999999995,"15min":0.81599999999999995},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.83399999999999996,"15min":0.83899999999999997},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.80500000000000005}]},{"osd":8,"last update":"Sat Sep 23 08:54:43 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.89200000000000002,"15min":0.90300000000000002},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.0660000000000001,"5min":1.093,"15min":1.093},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.86699999999999999,"15min":0.87},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.66000000000000003}]},{"osd":9,"last update":"Sat Sep 23 08:54:03 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.745}]},{"osd":10,"last update":"Sat Sep 23 08:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.72299999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84799999999999998}]}]},{"osd":4,"up_from":34,"seq":146028888116,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":925696,"data_stored":441382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:53:55 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.628,"15min":0.624},"min":{"1min":0.45300000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.86199999999999999,"5min":1.042,"15min":1.042},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.622,"5min":0.60699999999999998,"15min":0.60899999999999999},"min":{"1min":0.434,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.93300000000000005,"5min":1.008,"15min":1.008},"last":0.38300000000000001}]},{"osd":1,"last update":"Sat Sep 23 08:53:55 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.437,"15min":0.439},"min":{"1min":0.307,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.434},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.46999999999999997,"15min":0.46700000000000003},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.57099999999999995}]},{"osd":2,"last update":"Sat Sep 23 08:53:55 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.68300000000000005,"15min":0.66300000000000003},"min":{"1min":0.504,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.95699999999999996,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.64600000000000002,"15min":0.64900000000000002},"min":{"1min":0.47299999999999998,"5min":0.38,"15min":0.38},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.64300000000000002}]},{"osd":3,"last update":"Sat Sep 23 08:53:55 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.64500000000000002,"15min":0.63600000000000001},"min":{"1min":0.496,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.72099999999999997,"15min":0.70699999999999996},"min":{"1min":0.55600000000000005,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.0569999999999999,"5min":1.238,"15min":1.238},"last":0.53500000000000003}]},{"osd":5,"last update":"Sat Sep 23 08:54:22 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.65800000000000003,"15min":0.627},"min":{"1min":0.47399999999999998,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.69799999999999995,"15min":0.65600000000000003},"min":{"1min":0.60199999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.502}]},{"osd":6,"last update":"Sat Sep 23 08:54:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":0.80100000000000005,"15min":0.72799999999999998},"min":{"1min":0.57499999999999996,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":7.1829999999999998,"5min":7.1829999999999998,"15min":7.1829999999999998},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70299999999999996,"15min":0.69499999999999995},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.80000000000000004}]},{"osd":7,"last update":"Sat Sep 23 08:54:14 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.64300000000000002,"15min":0.63900000000000001},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.746,"5min":0.70299999999999996,"15min":0.69599999999999995},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.78500000000000003}]},{"osd":8,"last update":"Sat Sep 23 08:54:42 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.77700000000000002,"15min":0.77300000000000002},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.042,"5min":1.087,"15min":1.087},"last":0.755},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.78700000000000003,"15min":0.77900000000000003},"min":{"1min":0.67500000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.626}]},{"osd":9,"last update":"Sat Sep 23 08:54:04 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.69799999999999995}]},{"osd":10,"last update":"Sat Sep 23 08:54:32 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.60799999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]}]},{"osd":5,"up_from":39,"seq":167503724591,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28524,"kb_used_data":1504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716628,"statfs":{"total":95995035648,"available":95965827072,"internally_reserved":0,"allocated":1540096,"data_stored":1032931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:54:27 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.625,"15min":0.61899999999999999},"min":{"1min":0.43099999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.89000000000000001,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.64800000000000002,"15min":0.65100000000000002},"min":{"1min":0.45500000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.89300000000000002}]},{"osd":1,"last update":"Sat Sep 23 08:54:27 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.65200000000000002,"15min":0.63800000000000001},"min":{"1min":0.45100000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.753,"5min":0.65600000000000003,"15min":0.629},"min":{"1min":0.55100000000000005,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.53800000000000003}]},{"osd":2,"last update":"Sat Sep 23 08:54:27 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.53800000000000003,"15min":0.52400000000000002},"min":{"1min":0.378,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.62},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.53600000000000003,"15min":0.51800000000000002},"min":{"1min":0.379,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.51200000000000001}]},{"osd":3,"last update":"Sat Sep 23 08:54:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.67000000000000004,"15min":0.67200000000000004},"min":{"1min":0.55200000000000005,"5min":0.435,"15min":0.435},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.68899999999999995,"15min":0.69199999999999995},"min":{"1min":0.50800000000000001,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.85199999999999998,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.56499999999999995}]},{"osd":4,"last update":"Sat Sep 23 08:54:27 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.69999999999999996,"15min":0.68300000000000005},"min":{"1min":0.45100000000000001,"5min":0.44,"15min":0.44},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.70599999999999996,"15min":0.68600000000000005},"min":{"1min":0.46899999999999997,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.63900000000000001}]},{"osd":6,"last update":"Sat Sep 23 08:54:47 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.747,"15min":0.72899999999999998},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.95699999999999996,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.753,"5min":0.752,"15min":0.73899999999999999},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.67600000000000005}]},{"osd":7,"last update":"Sat Sep 23 08:54:10 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.76300000000000001,"15min":0.749},"min":{"1min":0.66700000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.79200000000000004,"15min":0.78300000000000003},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.71699999999999997}]},{"osd":8,"last update":"Sat Sep 23 08:54:37 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.77700000000000002,"15min":0.78000000000000003},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.77500000000000002,"15min":0.77600000000000002},"min":{"1min":0.53100000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.77100000000000002}]},{"osd":9,"last update":"Sat Sep 23 08:54:04 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.7969999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.95,"5min":1.95,"15min":1.95},"last":0.80400000000000005}]},{"osd":10,"last update":"Sat Sep 23 08:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.748}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-23T08:55:01.805 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-23T08:55:01.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:01 smithi135 ceph-mon[99205]: from='client.14790 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:55:01.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:01 smithi135 ceph-mon[99205]: pgmap v305: 97 pgs: 97 active+clean; 582 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s wr, 11 op/s 2023-09-23T08:55:01.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:01 smithi135 ceph-mon[99205]: from='client.14796 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:55:01.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:01 smithi135 ceph-mon[99205]: mds.? [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] up:active 2023-09-23T08:55:01.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:01 smithi135 ceph-mon[99205]: fsmap cephfs:5 7 up:standby 5 up:active 2023-09-23T08:55:01.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:01 smithi135 ceph-mon[99205]: mgrmap e17: x(active, since 7m), standbys: z, y 2023-09-23T08:55:01.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:01 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T08:55:01.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:01 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/32884017' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T08:55:01.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:01 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/2386302092' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-23T08:55:01.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:01 smithi161 ceph-mon[99580]: from='client.14790 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:55:01.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:01 smithi161 ceph-mon[99580]: pgmap v305: 97 pgs: 97 active+clean; 582 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s wr, 11 op/s 2023-09-23T08:55:01.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:01 smithi161 ceph-mon[99580]: from='client.14796 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:55:01.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:01 smithi161 ceph-mon[99580]: mds.? [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] up:active 2023-09-23T08:55:01.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:01 smithi161 ceph-mon[99580]: fsmap cephfs:5 7 up:standby 5 up:active 2023-09-23T08:55:01.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:01 smithi161 ceph-mon[99580]: mgrmap e17: x(active, since 7m), standbys: z, y 2023-09-23T08:55:01.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:01 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T08:55:01.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:01 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/32884017' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T08:55:01.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:01 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/2386302092' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-23T08:55:02.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:02.029+0000 7fe0d11ff700 1 -- 172.21.15.82:0/2122809732 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0cc1024c0 msgr2=0x7fe0cc108d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:02.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:02.029+0000 7fe0d11ff700 1 --2- 172.21.15.82:0/2122809732 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0cc1024c0 0x7fe0cc108d70 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe0c400b0d0 tx=0x7fe0c400b3e0 comp rx=0 tx=0).stop 2023-09-23T08:55:02.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:02.029+0000 7fe0d11ff700 1 -- 172.21.15.82:0/2122809732 shutdown_connections 2023-09-23T08:55:02.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:02.029+0000 7fe0d11ff700 1 --2- 172.21.15.82:0/2122809732 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0cc1024c0 0x7fe0cc108d70 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:02.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:02.029+0000 7fe0d11ff700 1 --2- 172.21.15.82:0/2122809732 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe0cc100930 0x7fe0cc100d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:02.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:02.029+0000 7fe0d11ff700 1 --2- 172.21.15.82:0/2122809732 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe0cc101b20 0x7fe0cc101f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:02.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:02.029+0000 7fe0d11ff700 1 -- 172.21.15.82:0/2122809732 >> 172.21.15.82:0/2122809732 conn(0x7fe0cc0fbe60 msgr2=0x7fe0cc0fe2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:02.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:02.029+0000 7fe0d11ff700 1 -- 172.21.15.82:0/2122809732 shutdown_connections 2023-09-23T08:55:02.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:02.029+0000 7fe0d11ff700 1 -- 172.21.15.82:0/2122809732 wait complete. 2023-09-23T08:55:02.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:02.030+0000 7fe0d11ff700 1 Processor -- start 2023-09-23T08:55:02.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:02.031+0000 7fe0d11ff700 1 -- start start 2023-09-23T08:55:02.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:02.031+0000 7fe0d11ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0cc100930 0x7fe0cc196540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:02.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:02.031+0000 7fe0d11ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe0cc101b20 0x7fe0cc196a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:02.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:02.031+0000 7fe0d11ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe0cc1024c0 0x7fe0cc19daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:02.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:02.031+0000 7fe0d11ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0cc19e0c0 con 0x7fe0cc100930 2023-09-23T08:55:02.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:02.031+0000 7fe0d11ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0cc19e200 con 0x7fe0cc101b20 2023-09-23T08:55:02.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:02.031+0000 7fe0d11ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0cc19e390 con 0x7fe0cc1024c0 2023-09-23T08:55:02.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:02.031+0000 7fe0cad9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0cc100930 0x7fe0cc196540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:02.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:02.031+0000 7fe0cad9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0cc100930 0x7fe0cc196540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44074/0 (socket says 172.21.15.82:44074) 2023-09-23T08:55:02.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:02.031+0000 7fe0cad9d700 1 -- 172.21.15.82:0/2517993950 learned_addr learned my addr 172.21.15.82:0/2517993950 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:55:02.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:02.031+0000 7fe0ca59c700 1 --2- 172.21.15.82:0/2517993950 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe0cc101b20 0x7fe0cc196a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:02.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:02.032+0000 7fe0cb59e700 1 --2- 172.21.15.82:0/2517993950 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe0cc1024c0 0x7fe0cc19daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:02.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:02.032+0000 7fe0cad9d700 1 -- 172.21.15.82:0/2517993950 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe0cc1024c0 msgr2=0x7fe0cc19daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:02.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:02.032+0000 7fe0cad9d700 1 --2- 172.21.15.82:0/2517993950 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe0cc1024c0 0x7fe0cc19daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:02.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:02.032+0000 7fe0cad9d700 1 -- 172.21.15.82:0/2517993950 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe0cc101b20 msgr2=0x7fe0cc196a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:02.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:02.032+0000 7fe0cad9d700 1 --2- 172.21.15.82:0/2517993950 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe0cc101b20 0x7fe0cc196a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:02.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:02.032+0000 7fe0cad9d700 1 -- 172.21.15.82:0/2517993950 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0c4009d00 con 0x7fe0cc100930 2023-09-23T08:55:02.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:02.032+0000 7fe0cb59e700 1 --2- 172.21.15.82:0/2517993950 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe0cc1024c0 0x7fe0cc19daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T08:55:02.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:02.032+0000 7fe0cad9d700 1 --2- 172.21.15.82:0/2517993950 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0cc100930 0x7fe0cc196540 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc00d980 tx=0x7fe0bc00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:02.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:02.032+0000 7fe0b3fff700 1 -- 172.21.15.82:0/2517993950 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0bc00bb60 con 0x7fe0cc100930 2023-09-23T08:55:02.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:02.032+0000 7fe0b3fff700 1 -- 172.21.15.82:0/2517993950 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe0bc007620 con 0x7fe0cc100930 2023-09-23T08:55:02.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:02.032+0000 7fe0b3fff700 1 -- 172.21.15.82:0/2517993950 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0bc00f3c0 con 0x7fe0cc100930 2023-09-23T08:55:02.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:02.032+0000 7fe0d11ff700 1 -- 172.21.15.82:0/2517993950 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0cc19e670 con 0x7fe0cc100930 2023-09-23T08:55:02.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:02.032+0000 7fe0d11ff700 1 -- 172.21.15.82:0/2517993950 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0cc19eb30 con 0x7fe0cc100930 2023-09-23T08:55:02.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:02.033+0000 7fe0d11ff700 1 -- 172.21.15.82:0/2517993950 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0cc10c000 con 0x7fe0cc100930 2023-09-23T08:55:02.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:02.035+0000 7fe0b3fff700 1 -- 172.21.15.82:0/2517993950 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) v1 ==== 134722+0+0 (secure 0 0 0) 0x7fe0bc010460 con 0x7fe0cc100930 2023-09-23T08:55:02.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:02.036+0000 7fe0b3fff700 1 --2- 172.21.15.82:0/2517993950 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fe0b40a00a0 0x7fe0b40a2560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:02.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:02.036+0000 7fe0b3fff700 1 -- 172.21.15.82:0/2517993950 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fe0bc0cb590 con 0x7fe0cc100930 2023-09-23T08:55:02.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:02.037+0000 7fe0ca59c700 1 --2- 172.21.15.82:0/2517993950 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fe0b40a00a0 0x7fe0b40a2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:02.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:02.037+0000 7fe0ca59c700 1 --2- 172.21.15.82:0/2517993950 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fe0b40a00a0 0x7fe0b40a2560 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe0c000dad0 tx=0x7fe0c000d4b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:02.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:02.040+0000 7fe0b3fff700 1 -- 172.21.15.82:0/2517993950 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7fe0bc095270 con 0x7fe0cc100930 2023-09-23T08:55:02.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:02.238+0000 7fe0d11ff700 1 -- 172.21.15.82:0/2517993950 --> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe0cc060d60 con 0x7fe0b40a00a0 2023-09-23T08:55:02.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:02.249+0000 7fe0b3fff700 1 -- 172.21.15.82:0/2517993950 <== mgr.14152 v2:172.21.15.82:6800/3698954311 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+339347 (secure 0 0 0) 0x7fe0cc060d60 con 0x7fe0b40a00a0 2023-09-23T08:55:02.255 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:55:02.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:02.253+0000 7fe0d11ff700 1 -- 172.21.15.82:0/2517993950 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fe0b40a00a0 msgr2=0x7fe0b40a2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:02.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:02.253+0000 7fe0d11ff700 1 --2- 172.21.15.82:0/2517993950 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fe0b40a00a0 0x7fe0b40a2560 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe0c000dad0 tx=0x7fe0c000d4b0 comp rx=0 tx=0).stop 2023-09-23T08:55:02.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:02.253+0000 7fe0d11ff700 1 -- 172.21.15.82:0/2517993950 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0cc100930 msgr2=0x7fe0cc196540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:02.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:02.253+0000 7fe0d11ff700 1 --2- 172.21.15.82:0/2517993950 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0cc100930 0x7fe0cc196540 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc00d980 tx=0x7fe0bc00dd40 comp rx=0 tx=0).stop 2023-09-23T08:55:02.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:02.253+0000 7fe0d11ff700 1 -- 172.21.15.82:0/2517993950 shutdown_connections 2023-09-23T08:55:02.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:02.253+0000 7fe0d11ff700 1 --2- 172.21.15.82:0/2517993950 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fe0b40a00a0 0x7fe0b40a2560 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:02.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:02.253+0000 7fe0d11ff700 1 --2- 172.21.15.82:0/2517993950 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe0cc1024c0 0x7fe0cc19daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:02.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:02.253+0000 7fe0d11ff700 1 --2- 172.21.15.82:0/2517993950 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0cc100930 0x7fe0cc196540 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:02.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:02.253+0000 7fe0d11ff700 1 --2- 172.21.15.82:0/2517993950 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe0cc101b20 0x7fe0cc196a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:02.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:02.253+0000 7fe0d11ff700 1 -- 172.21.15.82:0/2517993950 >> 172.21.15.82:0/2517993950 conn(0x7fe0cc0fbe60 msgr2=0x7fe0cc0fe090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:02.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:02.253+0000 7fe0d11ff700 1 -- 172.21.15.82:0/2517993950 shutdown_connections 2023-09-23T08:55:02.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:02.253+0000 7fe0d11ff700 1 -- 172.21.15.82:0/2517993950 wait complete. 2023-09-23T08:55:02.259 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-09-23T08:55:02.275 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":306,"stamp":"2023-09-23T08:55:02.052580+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":633599,"num_objects":90,"num_object_clones":0,"num_object_copies":270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":90,"num_whiteouts":0,"num_read":160,"num_read_kb":174,"num_write":376,"num_write_kb":3030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":56,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":308,"ondisk_log_size":308,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":337064,"kb_used_data":12856,"kb_used_omap":20,"kb_used_meta":324075,"kb_avail":1124604760,"statfs":{"total":1151940427776,"available":1151595274240,"internally_reserved":0,"allocated":13164544,"data_stored":7119476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21372,"internal_metadata":331852932},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":43231,"num_objects":88,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":24,"num_read_kb":55,"num_write":195,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":56,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.970776"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.093472+0000","last_change":"2023-09-23T08:54:53.110235+0000","last_active":"2023-09-23T08:54:54.093472+0000","last_peered":"2023-09-23T08:54:54.093472+0000","last_clean":"2023-09-23T08:54:54.093472+0000","last_became_active":"2023-09-23T08:54:53.109445+0000","last_became_peered":"2023-09-23T08:54:53.109445+0000","last_unstale":"2023-09-23T08:54:54.093472+0000","last_undegraded":"2023-09-23T08:54:54.093472+0000","last_fullsized":"2023-09-23T08:54:54.093472+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T14:44:43.255301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:55.569643+0000","last_change":"2023-09-23T08:54:53.105948+0000","last_active":"2023-09-23T08:54:55.569643+0000","last_peered":"2023-09-23T08:54:55.569643+0000","last_clean":"2023-09-23T08:54:55.569643+0000","last_became_active":"2023-09-23T08:54:53.105627+0000","last_became_peered":"2023-09-23T08:54:53.105627+0000","last_unstale":"2023-09-23T08:54:55.569643+0000","last_undegraded":"2023-09-23T08:54:55.569643+0000","last_fullsized":"2023-09-23T08:54:55.569643+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:11:15.600872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:55.569498+0000","last_change":"2023-09-23T08:54:53.099318+0000","last_active":"2023-09-23T08:54:55.569498+0000","last_peered":"2023-09-23T08:54:55.569498+0000","last_clean":"2023-09-23T08:54:55.569498+0000","last_became_active":"2023-09-23T08:54:53.099002+0000","last_became_peered":"2023-09-23T08:54:53.099002+0000","last_unstale":"2023-09-23T08:54:55.569498+0000","last_undegraded":"2023-09-23T08:54:55.569498+0000","last_fullsized":"2023-09-23T08:54:55.569498+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:43:19.901761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:56.196551+0000","last_change":"2023-09-23T08:54:53.114757+0000","last_active":"2023-09-23T08:54:56.196551+0000","last_peered":"2023-09-23T08:54:56.196551+0000","last_clean":"2023-09-23T08:54:56.196551+0000","last_became_active":"2023-09-23T08:54:53.113979+0000","last_became_peered":"2023-09-23T08:54:53.113979+0000","last_unstale":"2023-09-23T08:54:56.196551+0000","last_undegraded":"2023-09-23T08:54:56.196551+0000","last_fullsized":"2023-09-23T08:54:56.196551+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T11:35:40.666245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.868655+0000","last_change":"2023-09-23T08:54:53.102122+0000","last_active":"2023-09-23T08:54:54.868655+0000","last_peered":"2023-09-23T08:54:54.868655+0000","last_clean":"2023-09-23T08:54:54.868655+0000","last_became_active":"2023-09-23T08:54:53.101781+0000","last_became_peered":"2023-09-23T08:54:53.101781+0000","last_unstale":"2023-09-23T08:54:54.868655+0000","last_undegraded":"2023-09-23T08:54:54.868655+0000","last_fullsized":"2023-09-23T08:54:54.868655+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T10:14:51.789807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:55.736630+0000","last_change":"2023-09-23T08:54:53.103617+0000","last_active":"2023-09-23T08:54:55.736630+0000","last_peered":"2023-09-23T08:54:55.736630+0000","last_clean":"2023-09-23T08:54:55.736630+0000","last_became_active":"2023-09-23T08:54:53.103259+0000","last_became_peered":"2023-09-23T08:54:53.103259+0000","last_unstale":"2023-09-23T08:54:55.736630+0000","last_undegraded":"2023-09-23T08:54:55.736630+0000","last_fullsized":"2023-09-23T08:54:55.736630+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T13:22:21.299505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.685305+0000","last_change":"2023-09-23T08:54:53.110512+0000","last_active":"2023-09-23T08:54:54.685305+0000","last_peered":"2023-09-23T08:54:54.685305+0000","last_clean":"2023-09-23T08:54:54.685305+0000","last_became_active":"2023-09-23T08:54:53.110166+0000","last_became_peered":"2023-09-23T08:54:53.110166+0000","last_unstale":"2023-09-23T08:54:54.685305+0000","last_undegraded":"2023-09-23T08:54:54.685305+0000","last_fullsized":"2023-09-23T08:54:54.685305+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T08:56:47.152914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.094237+0000","last_change":"2023-09-23T08:54:53.111373+0000","last_active":"2023-09-23T08:54:54.094237+0000","last_peered":"2023-09-23T08:54:54.094237+0000","last_clean":"2023-09-23T08:54:54.094237+0000","last_became_active":"2023-09-23T08:54:53.111045+0000","last_became_peered":"2023-09-23T08:54:53.111045+0000","last_unstale":"2023-09-23T08:54:54.094237+0000","last_undegraded":"2023-09-23T08:54:54.094237+0000","last_fullsized":"2023-09-23T08:54:54.094237+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T11:39:40.682666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.392385+0000","last_change":"2023-09-23T08:54:53.100219+0000","last_active":"2023-09-23T08:54:54.392385+0000","last_peered":"2023-09-23T08:54:54.392385+0000","last_clean":"2023-09-23T08:54:54.392385+0000","last_became_active":"2023-09-23T08:54:53.099925+0000","last_became_peered":"2023-09-23T08:54:53.099925+0000","last_unstale":"2023-09-23T08:54:54.392385+0000","last_undegraded":"2023-09-23T08:54:54.392385+0000","last_fullsized":"2023-09-23T08:54:54.392385+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T13:23:40.035670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:55.736792+0000","last_change":"2023-09-23T08:54:53.110272+0000","last_active":"2023-09-23T08:54:55.736792+0000","last_peered":"2023-09-23T08:54:55.736792+0000","last_clean":"2023-09-23T08:54:55.736792+0000","last_became_active":"2023-09-23T08:54:53.109958+0000","last_became_peered":"2023-09-23T08:54:53.109958+0000","last_unstale":"2023-09-23T08:54:55.736792+0000","last_undegraded":"2023-09-23T08:54:55.736792+0000","last_fullsized":"2023-09-23T08:54:55.736792+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T14:18:06.758629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.685674+0000","last_change":"2023-09-23T08:54:53.108175+0000","last_active":"2023-09-23T08:54:54.685674+0000","last_peered":"2023-09-23T08:54:54.685674+0000","last_clean":"2023-09-23T08:54:54.685674+0000","last_became_active":"2023-09-23T08:54:53.107889+0000","last_became_peered":"2023-09-23T08:54:53.107889+0000","last_unstale":"2023-09-23T08:54:54.685674+0000","last_undegraded":"2023-09-23T08:54:54.685674+0000","last_fullsized":"2023-09-23T08:54:54.685674+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T14:31:52.490823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:56.196534+0000","last_change":"2023-09-23T08:54:53.114564+0000","last_active":"2023-09-23T08:54:56.196534+0000","last_peered":"2023-09-23T08:54:56.196534+0000","last_clean":"2023-09-23T08:54:56.196534+0000","last_became_active":"2023-09-23T08:54:53.113937+0000","last_became_peered":"2023-09-23T08:54:53.113937+0000","last_unstale":"2023-09-23T08:54:56.196534+0000","last_undegraded":"2023-09-23T08:54:56.196534+0000","last_fullsized":"2023-09-23T08:54:56.196534+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T13:16:36.107633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.093676+0000","last_change":"2023-09-23T08:54:53.108544+0000","last_active":"2023-09-23T08:54:54.093676+0000","last_peered":"2023-09-23T08:54:54.093676+0000","last_clean":"2023-09-23T08:54:54.093676+0000","last_became_active":"2023-09-23T08:54:53.108226+0000","last_became_peered":"2023-09-23T08:54:53.108226+0000","last_unstale":"2023-09-23T08:54:54.093676+0000","last_undegraded":"2023-09-23T08:54:54.093676+0000","last_fullsized":"2023-09-23T08:54:54.093676+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T20:28:57.708297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:55.569335+0000","last_change":"2023-09-23T08:54:53.106250+0000","last_active":"2023-09-23T08:54:55.569335+0000","last_peered":"2023-09-23T08:54:55.569335+0000","last_clean":"2023-09-23T08:54:55.569335+0000","last_became_active":"2023-09-23T08:54:53.105912+0000","last_became_peered":"2023-09-23T08:54:53.105912+0000","last_unstale":"2023-09-23T08:54:55.569335+0000","last_undegraded":"2023-09-23T08:54:55.569335+0000","last_fullsized":"2023-09-23T08:54:55.569335+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T18:08:21.546185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:55.569272+0000","last_change":"2023-09-23T08:54:53.101435+0000","last_active":"2023-09-23T08:54:55.569272+0000","last_peered":"2023-09-23T08:54:55.569272+0000","last_clean":"2023-09-23T08:54:55.569272+0000","last_became_active":"2023-09-23T08:54:53.101144+0000","last_became_peered":"2023-09-23T08:54:53.101144+0000","last_unstale":"2023-09-23T08:54:55.569272+0000","last_undegraded":"2023-09-23T08:54:55.569272+0000","last_fullsized":"2023-09-23T08:54:55.569272+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:19:57.007982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.391919+0000","last_change":"2023-09-23T08:54:53.098507+0000","last_active":"2023-09-23T08:54:54.391919+0000","last_peered":"2023-09-23T08:54:54.391919+0000","last_clean":"2023-09-23T08:54:54.391919+0000","last_became_active":"2023-09-23T08:54:53.098153+0000","last_became_peered":"2023-09-23T08:54:53.098153+0000","last_unstale":"2023-09-23T08:54:54.391919+0000","last_undegraded":"2023-09-23T08:54:54.391919+0000","last_fullsized":"2023-09-23T08:54:54.391919+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:46:02.294933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.093511+0000","last_change":"2023-09-23T08:54:53.110427+0000","last_active":"2023-09-23T08:54:54.093511+0000","last_peered":"2023-09-23T08:54:54.093511+0000","last_clean":"2023-09-23T08:54:54.093511+0000","last_became_active":"2023-09-23T08:54:53.109868+0000","last_became_peered":"2023-09-23T08:54:53.109868+0000","last_unstale":"2023-09-23T08:54:54.093511+0000","last_undegraded":"2023-09-23T08:54:54.093511+0000","last_fullsized":"2023-09-23T08:54:54.093511+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T14:12:29.441770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:55.823256+0000","last_change":"2023-09-23T08:54:53.107613+0000","last_active":"2023-09-23T08:54:55.823256+0000","last_peered":"2023-09-23T08:54:55.823256+0000","last_clean":"2023-09-23T08:54:55.823256+0000","last_became_active":"2023-09-23T08:54:53.107230+0000","last_became_peered":"2023-09-23T08:54:53.107230+0000","last_unstale":"2023-09-23T08:54:55.823256+0000","last_undegraded":"2023-09-23T08:54:55.823256+0000","last_fullsized":"2023-09-23T08:54:55.823256+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T20:22:51.441504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:56.197192+0000","last_change":"2023-09-23T08:54:53.102530+0000","last_active":"2023-09-23T08:54:56.197192+0000","last_peered":"2023-09-23T08:54:56.197192+0000","last_clean":"2023-09-23T08:54:56.197192+0000","last_became_active":"2023-09-23T08:54:53.102004+0000","last_became_peered":"2023-09-23T08:54:53.102004+0000","last_unstale":"2023-09-23T08:54:56.197192+0000","last_undegraded":"2023-09-23T08:54:56.197192+0000","last_fullsized":"2023-09-23T08:54:56.197192+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T20:45:59.122109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"86'9","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:57.445754+0000","last_change":"2023-09-23T08:54:52.082566+0000","last_active":"2023-09-23T08:54:57.445754+0000","last_peered":"2023-09-23T08:54:57.445754+0000","last_clean":"2023-09-23T08:54:57.445754+0000","last_became_active":"2023-09-23T08:54:52.082226+0000","last_became_peered":"2023-09-23T08:54:52.082226+0000","last_unstale":"2023-09-23T08:54:57.445754+0000","last_undegraded":"2023-09-23T08:54:57.445754+0000","last_fullsized":"2023-09-23T08:54:57.445754+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:33:39.581222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.094617+0000","last_change":"2023-09-23T08:54:53.109844+0000","last_active":"2023-09-23T08:54:54.094617+0000","last_peered":"2023-09-23T08:54:54.094617+0000","last_clean":"2023-09-23T08:54:54.094617+0000","last_became_active":"2023-09-23T08:54:53.109456+0000","last_became_peered":"2023-09-23T08:54:53.109456+0000","last_unstale":"2023-09-23T08:54:54.094617+0000","last_undegraded":"2023-09-23T08:54:54.094617+0000","last_fullsized":"2023-09-23T08:54:54.094617+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T11:09:27.072285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:55.366323+0000","last_change":"2023-09-23T08:54:52.090023+0000","last_active":"2023-09-23T08:54:55.366323+0000","last_peered":"2023-09-23T08:54:55.366323+0000","last_clean":"2023-09-23T08:54:55.366323+0000","last_became_active":"2023-09-23T08:54:52.089587+0000","last_became_peered":"2023-09-23T08:54:52.089587+0000","last_unstale":"2023-09-23T08:54:55.366323+0000","last_undegraded":"2023-09-23T08:54:55.366323+0000","last_fullsized":"2023-09-23T08:54:55.366323+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T20:06:57.397730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:55.569648+0000","last_change":"2023-09-23T08:54:53.098662+0000","last_active":"2023-09-23T08:54:55.569648+0000","last_peered":"2023-09-23T08:54:55.569648+0000","last_clean":"2023-09-23T08:54:55.569648+0000","last_became_active":"2023-09-23T08:54:53.098288+0000","last_became_peered":"2023-09-23T08:54:53.098288+0000","last_unstale":"2023-09-23T08:54:55.569648+0000","last_undegraded":"2023-09-23T08:54:55.569648+0000","last_fullsized":"2023-09-23T08:54:55.569648+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T10:35:55.990676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"86'11","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:59.471579+0000","last_change":"2023-09-23T08:54:52.083109+0000","last_active":"2023-09-23T08:54:59.471579+0000","last_peered":"2023-09-23T08:54:59.471579+0000","last_clean":"2023-09-23T08:54:59.471579+0000","last_became_active":"2023-09-23T08:54:52.082479+0000","last_became_peered":"2023-09-23T08:54:52.082479+0000","last_unstale":"2023-09-23T08:54:59.471579+0000","last_undegraded":"2023-09-23T08:54:59.471579+0000","last_fullsized":"2023-09-23T08:54:59.471579+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T18:32:18.729897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":15,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.392018+0000","last_change":"2023-09-23T08:54:53.105112+0000","last_active":"2023-09-23T08:54:54.392018+0000","last_peered":"2023-09-23T08:54:54.392018+0000","last_clean":"2023-09-23T08:54:54.392018+0000","last_became_active":"2023-09-23T08:54:53.104639+0000","last_became_peered":"2023-09-23T08:54:53.104639+0000","last_unstale":"2023-09-23T08:54:54.392018+0000","last_undegraded":"2023-09-23T08:54:54.392018+0000","last_fullsized":"2023-09-23T08:54:54.392018+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T20:31:14.872469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"86'5","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:59.471830+0000","last_change":"2023-09-23T08:54:52.082798+0000","last_active":"2023-09-23T08:54:59.471830+0000","last_peered":"2023-09-23T08:54:59.471830+0000","last_clean":"2023-09-23T08:54:59.471830+0000","last_became_active":"2023-09-23T08:54:52.082455+0000","last_became_peered":"2023-09-23T08:54:52.082455+0000","last_unstale":"2023-09-23T08:54:59.471830+0000","last_undegraded":"2023-09-23T08:54:59.471830+0000","last_fullsized":"2023-09-23T08:54:59.471830+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T11:37:06.016954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:56.196906+0000","last_change":"2023-09-23T08:54:53.105012+0000","last_active":"2023-09-23T08:54:56.196906+0000","last_peered":"2023-09-23T08:54:56.196906+0000","last_clean":"2023-09-23T08:54:56.196906+0000","last_became_active":"2023-09-23T08:54:53.104670+0000","last_became_peered":"2023-09-23T08:54:53.104670+0000","last_unstale":"2023-09-23T08:54:56.196906+0000","last_undegraded":"2023-09-23T08:54:56.196906+0000","last_fullsized":"2023-09-23T08:54:56.196906+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T09:16:46.448441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"86'5","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:56.421574+0000","last_change":"2023-09-23T08:54:52.085771+0000","last_active":"2023-09-23T08:54:56.421574+0000","last_peered":"2023-09-23T08:54:56.421574+0000","last_clean":"2023-09-23T08:54:56.421574+0000","last_became_active":"2023-09-23T08:54:52.085424+0000","last_became_peered":"2023-09-23T08:54:52.085424+0000","last_unstale":"2023-09-23T08:54:56.421574+0000","last_undegraded":"2023-09-23T08:54:56.421574+0000","last_fullsized":"2023-09-23T08:54:56.421574+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T09:59:26.327934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.868752+0000","last_change":"2023-09-23T08:54:53.109830+0000","last_active":"2023-09-23T08:54:54.868752+0000","last_peered":"2023-09-23T08:54:54.868752+0000","last_clean":"2023-09-23T08:54:54.868752+0000","last_became_active":"2023-09-23T08:54:53.109532+0000","last_became_peered":"2023-09-23T08:54:53.109532+0000","last_unstale":"2023-09-23T08:54:54.868752+0000","last_undegraded":"2023-09-23T08:54:54.868752+0000","last_fullsized":"2023-09-23T08:54:54.868752+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T12:44:22.033915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:58.465437+0000","last_change":"2023-09-23T08:54:52.075998+0000","last_active":"2023-09-23T08:54:58.465437+0000","last_peered":"2023-09-23T08:54:58.465437+0000","last_clean":"2023-09-23T08:54:58.465437+0000","last_became_active":"2023-09-23T08:54:52.075701+0000","last_became_peered":"2023-09-23T08:54:52.075701+0000","last_unstale":"2023-09-23T08:54:58.465437+0000","last_undegraded":"2023-09-23T08:54:58.465437+0000","last_fullsized":"2023-09-23T08:54:58.465437+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T20:33:50.450196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:56.197219+0000","last_change":"2023-09-23T08:54:53.106654+0000","last_active":"2023-09-23T08:54:56.197219+0000","last_peered":"2023-09-23T08:54:56.197219+0000","last_clean":"2023-09-23T08:54:56.197219+0000","last_became_active":"2023-09-23T08:54:53.106348+0000","last_became_peered":"2023-09-23T08:54:53.106348+0000","last_unstale":"2023-09-23T08:54:56.197219+0000","last_undegraded":"2023-09-23T08:54:56.197219+0000","last_fullsized":"2023-09-23T08:54:56.197219+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:37:54.806517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"86'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:57.445194+0000","last_change":"2023-09-23T08:54:52.073666+0000","last_active":"2023-09-23T08:54:57.445194+0000","last_peered":"2023-09-23T08:54:57.445194+0000","last_clean":"2023-09-23T08:54:57.445194+0000","last_became_active":"2023-09-23T08:54:52.073248+0000","last_became_peered":"2023-09-23T08:54:52.073248+0000","last_unstale":"2023-09-23T08:54:57.445194+0000","last_undegraded":"2023-09-23T08:54:57.445194+0000","last_fullsized":"2023-09-23T08:54:57.445194+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:24:23.561390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.094172+0000","last_change":"2023-09-23T08:54:53.109621+0000","last_active":"2023-09-23T08:54:54.094172+0000","last_peered":"2023-09-23T08:54:54.094172+0000","last_clean":"2023-09-23T08:54:54.094172+0000","last_became_active":"2023-09-23T08:54:53.109304+0000","last_became_peered":"2023-09-23T08:54:53.109304+0000","last_unstale":"2023-09-23T08:54:54.094172+0000","last_undegraded":"2023-09-23T08:54:54.094172+0000","last_fullsized":"2023-09-23T08:54:54.094172+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T09:40:00.616277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"86'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:56.420897+0000","last_change":"2023-09-23T08:54:52.081580+0000","last_active":"2023-09-23T08:54:56.420897+0000","last_peered":"2023-09-23T08:54:56.420897+0000","last_clean":"2023-09-23T08:54:56.420897+0000","last_became_active":"2023-09-23T08:54:52.081151+0000","last_became_peered":"2023-09-23T08:54:52.081151+0000","last_unstale":"2023-09-23T08:54:56.420897+0000","last_undegraded":"2023-09-23T08:54:56.420897+0000","last_fullsized":"2023-09-23T08:54:56.420897+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T10:06:12.914323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:55.823125+0000","last_change":"2023-09-23T08:54:53.108334+0000","last_active":"2023-09-23T08:54:55.823125+0000","last_peered":"2023-09-23T08:54:55.823125+0000","last_clean":"2023-09-23T08:54:55.823125+0000","last_became_active":"2023-09-23T08:54:53.108038+0000","last_became_peered":"2023-09-23T08:54:53.108038+0000","last_unstale":"2023-09-23T08:54:55.823125+0000","last_undegraded":"2023-09-23T08:54:55.823125+0000","last_fullsized":"2023-09-23T08:54:55.823125+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:27:47.906273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"86'4","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:55:00.492689+0000","last_change":"2023-09-23T08:54:52.084025+0000","last_active":"2023-09-23T08:55:00.492689+0000","last_peered":"2023-09-23T08:55:00.492689+0000","last_clean":"2023-09-23T08:55:00.492689+0000","last_became_active":"2023-09-23T08:54:52.083625+0000","last_became_peered":"2023-09-23T08:54:52.083625+0000","last_unstale":"2023-09-23T08:55:00.492689+0000","last_undegraded":"2023-09-23T08:55:00.492689+0000","last_fullsized":"2023-09-23T08:55:00.492689+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T14:04:36.422725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.392373+0000","last_change":"2023-09-23T08:54:53.106602+0000","last_active":"2023-09-23T08:54:54.392373+0000","last_peered":"2023-09-23T08:54:54.392373+0000","last_clean":"2023-09-23T08:54:54.392373+0000","last_became_active":"2023-09-23T08:54:53.105501+0000","last_became_peered":"2023-09-23T08:54:53.105501+0000","last_unstale":"2023-09-23T08:54:54.392373+0000","last_undegraded":"2023-09-23T08:54:54.392373+0000","last_fullsized":"2023-09-23T08:54:54.392373+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T20:10:34.997922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"86'4","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:59.470165+0000","last_change":"2023-09-23T08:54:52.079197+0000","last_active":"2023-09-23T08:54:59.470165+0000","last_peered":"2023-09-23T08:54:59.470165+0000","last_clean":"2023-09-23T08:54:59.470165+0000","last_became_active":"2023-09-23T08:54:52.078748+0000","last_became_peered":"2023-09-23T08:54:52.078748+0000","last_unstale":"2023-09-23T08:54:59.470165+0000","last_undegraded":"2023-09-23T08:54:59.470165+0000","last_fullsized":"2023-09-23T08:54:59.470165+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:39:11.995069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:55.569653+0000","last_change":"2023-09-23T08:54:53.105831+0000","last_active":"2023-09-23T08:54:55.569653+0000","last_peered":"2023-09-23T08:54:55.569653+0000","last_clean":"2023-09-23T08:54:55.569653+0000","last_became_active":"2023-09-23T08:54:53.105511+0000","last_became_peered":"2023-09-23T08:54:53.105511+0000","last_unstale":"2023-09-23T08:54:55.569653+0000","last_undegraded":"2023-09-23T08:54:55.569653+0000","last_fullsized":"2023-09-23T08:54:55.569653+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T18:11:31.880639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"86'5","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:56.420110+0000","last_change":"2023-09-23T08:54:52.089312+0000","last_active":"2023-09-23T08:54:56.420110+0000","last_peered":"2023-09-23T08:54:56.420110+0000","last_clean":"2023-09-23T08:54:56.420110+0000","last_became_active":"2023-09-23T08:54:52.088762+0000","last_became_peered":"2023-09-23T08:54:52.088762+0000","last_unstale":"2023-09-23T08:54:56.420110+0000","last_undegraded":"2023-09-23T08:54:56.420110+0000","last_fullsized":"2023-09-23T08:54:56.420110+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T13:11:23.132983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.392270+0000","last_change":"2023-09-23T08:54:53.106972+0000","last_active":"2023-09-23T08:54:54.392270+0000","last_peered":"2023-09-23T08:54:54.392270+0000","last_clean":"2023-09-23T08:54:54.392270+0000","last_became_active":"2023-09-23T08:54:53.105175+0000","last_became_peered":"2023-09-23T08:54:53.105175+0000","last_unstale":"2023-09-23T08:54:54.392270+0000","last_undegraded":"2023-09-23T08:54:54.392270+0000","last_fullsized":"2023-09-23T08:54:54.392270+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:04:19.976958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"86'20","reported_seq":38,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:55:00.494504+0000","last_change":"2023-09-23T08:54:52.077758+0000","last_active":"2023-09-23T08:55:00.494504+0000","last_peered":"2023-09-23T08:55:00.494504+0000","last_clean":"2023-09-23T08:55:00.494504+0000","last_became_active":"2023-09-23T08:54:52.077461+0000","last_became_peered":"2023-09-23T08:54:52.077461+0000","last_unstale":"2023-09-23T08:55:00.494504+0000","last_undegraded":"2023-09-23T08:55:00.494504+0000","last_fullsized":"2023-09-23T08:55:00.494504+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:03:26.460788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36285,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":37,"num_write":22,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.868906+0000","last_change":"2023-09-23T08:54:53.102967+0000","last_active":"2023-09-23T08:54:54.868906+0000","last_peered":"2023-09-23T08:54:54.868906+0000","last_clean":"2023-09-23T08:54:54.868906+0000","last_became_active":"2023-09-23T08:54:53.102608+0000","last_became_peered":"2023-09-23T08:54:53.102608+0000","last_unstale":"2023-09-23T08:54:54.868906+0000","last_undegraded":"2023-09-23T08:54:54.868906+0000","last_fullsized":"2023-09-23T08:54:54.868906+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:22:54.217099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:57.443899+0000","last_change":"2023-09-23T08:54:52.083885+0000","last_active":"2023-09-23T08:54:57.443899+0000","last_peered":"2023-09-23T08:54:57.443899+0000","last_clean":"2023-09-23T08:54:57.443899+0000","last_became_active":"2023-09-23T08:54:52.083530+0000","last_became_peered":"2023-09-23T08:54:52.083530+0000","last_unstale":"2023-09-23T08:54:57.443899+0000","last_undegraded":"2023-09-23T08:54:57.443899+0000","last_fullsized":"2023-09-23T08:54:57.443899+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T14:10:03.782909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.093435+0000","last_change":"2023-09-23T08:54:53.102429+0000","last_active":"2023-09-23T08:54:54.093435+0000","last_peered":"2023-09-23T08:54:54.093435+0000","last_clean":"2023-09-23T08:54:54.093435+0000","last_became_active":"2023-09-23T08:54:53.102139+0000","last_became_peered":"2023-09-23T08:54:53.102139+0000","last_unstale":"2023-09-23T08:54:54.093435+0000","last_undegraded":"2023-09-23T08:54:54.093435+0000","last_fullsized":"2023-09-23T08:54:54.093435+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T12:27:03.746727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"86'4","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:56.421306+0000","last_change":"2023-09-23T08:54:52.083380+0000","last_active":"2023-09-23T08:54:56.421306+0000","last_peered":"2023-09-23T08:54:56.421306+0000","last_clean":"2023-09-23T08:54:56.421306+0000","last_became_active":"2023-09-23T08:54:52.083094+0000","last_became_peered":"2023-09-23T08:54:52.083094+0000","last_unstale":"2023-09-23T08:54:56.421306+0000","last_undegraded":"2023-09-23T08:54:56.421306+0000","last_fullsized":"2023-09-23T08:54:56.421306+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T18:00:32.435850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.685742+0000","last_change":"2023-09-23T08:54:53.107671+0000","last_active":"2023-09-23T08:54:54.685742+0000","last_peered":"2023-09-23T08:54:54.685742+0000","last_clean":"2023-09-23T08:54:54.685742+0000","last_became_active":"2023-09-23T08:54:53.107372+0000","last_became_peered":"2023-09-23T08:54:53.107372+0000","last_unstale":"2023-09-23T08:54:54.685742+0000","last_undegraded":"2023-09-23T08:54:54.685742+0000","last_fullsized":"2023-09-23T08:54:54.685742+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T14:29:45.711969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'6","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:55:00.495683+0000","last_change":"2023-09-23T08:54:52.080556+0000","last_active":"2023-09-23T08:55:00.495683+0000","last_peered":"2023-09-23T08:55:00.495683+0000","last_clean":"2023-09-23T08:55:00.495683+0000","last_became_active":"2023-09-23T08:54:52.080220+0000","last_became_peered":"2023-09-23T08:54:52.080220+0000","last_unstale":"2023-09-23T08:55:00.495683+0000","last_undegraded":"2023-09-23T08:55:00.495683+0000","last_fullsized":"2023-09-23T08:55:00.495683+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T14:17:35.705342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":978,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.685295+0000","last_change":"2023-09-23T08:54:53.107044+0000","last_active":"2023-09-23T08:54:54.685295+0000","last_peered":"2023-09-23T08:54:54.685295+0000","last_clean":"2023-09-23T08:54:54.685295+0000","last_became_active":"2023-09-23T08:54:53.106715+0000","last_became_peered":"2023-09-23T08:54:53.106715+0000","last_unstale":"2023-09-23T08:54:54.685295+0000","last_undegraded":"2023-09-23T08:54:54.685295+0000","last_fullsized":"2023-09-23T08:54:54.685295+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:52:15.415770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"86'17","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:59.470275+0000","last_change":"2023-09-23T08:54:52.078052+0000","last_active":"2023-09-23T08:54:59.470275+0000","last_peered":"2023-09-23T08:54:59.470275+0000","last_clean":"2023-09-23T08:54:59.470275+0000","last_became_active":"2023-09-23T08:54:52.077678+0000","last_became_peered":"2023-09-23T08:54:52.077678+0000","last_unstale":"2023-09-23T08:54:59.470275+0000","last_undegraded":"2023-09-23T08:54:59.470275+0000","last_fullsized":"2023-09-23T08:54:59.470275+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T13:15:02.677497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:56.196899+0000","last_change":"2023-09-23T08:54:53.107673+0000","last_active":"2023-09-23T08:54:56.196899+0000","last_peered":"2023-09-23T08:54:56.196899+0000","last_clean":"2023-09-23T08:54:56.196899+0000","last_became_active":"2023-09-23T08:54:53.107373+0000","last_became_peered":"2023-09-23T08:54:53.107373+0000","last_unstale":"2023-09-23T08:54:56.196899+0000","last_undegraded":"2023-09-23T08:54:56.196899+0000","last_fullsized":"2023-09-23T08:54:56.196899+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T14:21:29.297945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"86'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:55:00.033673+0000","last_change":"2023-09-23T08:54:52.085460+0000","last_active":"2023-09-23T08:55:00.033673+0000","last_peered":"2023-09-23T08:55:00.033673+0000","last_clean":"2023-09-23T08:55:00.033673+0000","last_became_active":"2023-09-23T08:54:52.085186+0000","last_became_peered":"2023-09-23T08:54:52.085186+0000","last_unstale":"2023-09-23T08:55:00.033673+0000","last_undegraded":"2023-09-23T08:55:00.033673+0000","last_fullsized":"2023-09-23T08:55:00.033673+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T12:46:28.431132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.093439+0000","last_change":"2023-09-23T08:54:53.103630+0000","last_active":"2023-09-23T08:54:54.093439+0000","last_peered":"2023-09-23T08:54:54.093439+0000","last_clean":"2023-09-23T08:54:54.093439+0000","last_became_active":"2023-09-23T08:54:53.103270+0000","last_became_peered":"2023-09-23T08:54:53.103270+0000","last_unstale":"2023-09-23T08:54:54.093439+0000","last_undegraded":"2023-09-23T08:54:54.093439+0000","last_fullsized":"2023-09-23T08:54:54.093439+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T11:41:57.582849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:55.823177+0000","last_change":"2023-09-23T08:54:52.089279+0000","last_active":"2023-09-23T08:54:55.823177+0000","last_peered":"2023-09-23T08:54:55.823177+0000","last_clean":"2023-09-23T08:54:55.823177+0000","last_became_active":"2023-09-23T08:54:52.088861+0000","last_became_peered":"2023-09-23T08:54:52.088861+0000","last_unstale":"2023-09-23T08:54:55.823177+0000","last_undegraded":"2023-09-23T08:54:55.823177+0000","last_fullsized":"2023-09-23T08:54:55.823177+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T10:00:39.132387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"86'1","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:55.736719+0000","last_change":"2023-09-23T08:54:53.105653+0000","last_active":"2023-09-23T08:54:55.736719+0000","last_peered":"2023-09-23T08:54:55.736719+0000","last_clean":"2023-09-23T08:54:55.736719+0000","last_became_active":"2023-09-23T08:54:53.105309+0000","last_became_peered":"2023-09-23T08:54:53.105309+0000","last_unstale":"2023-09-23T08:54:55.736719+0000","last_undegraded":"2023-09-23T08:54:55.736719+0000","last_fullsized":"2023-09-23T08:54:55.736719+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:58:53.000667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"86'5","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:59.470756+0000","last_change":"2023-09-23T08:54:52.080521+0000","last_active":"2023-09-23T08:54:59.470756+0000","last_peered":"2023-09-23T08:54:59.470756+0000","last_clean":"2023-09-23T08:54:59.470756+0000","last_became_active":"2023-09-23T08:54:52.080164+0000","last_became_peered":"2023-09-23T08:54:52.080164+0000","last_unstale":"2023-09-23T08:54:59.470756+0000","last_undegraded":"2023-09-23T08:54:59.470756+0000","last_fullsized":"2023-09-23T08:54:59.470756+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T12:44:56.909319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:55.736491+0000","last_change":"2023-09-23T08:54:53.107516+0000","last_active":"2023-09-23T08:54:55.736491+0000","last_peered":"2023-09-23T08:54:55.736491+0000","last_clean":"2023-09-23T08:54:55.736491+0000","last_became_active":"2023-09-23T08:54:53.106785+0000","last_became_peered":"2023-09-23T08:54:53.106785+0000","last_unstale":"2023-09-23T08:54:55.736491+0000","last_undegraded":"2023-09-23T08:54:55.736491+0000","last_fullsized":"2023-09-23T08:54:55.736491+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T12:26:04.040614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:56.196433+0000","last_change":"2023-09-23T08:54:53.110406+0000","last_active":"2023-09-23T08:54:56.196433+0000","last_peered":"2023-09-23T08:54:56.196433+0000","last_clean":"2023-09-23T08:54:56.196433+0000","last_became_active":"2023-09-23T08:54:53.107758+0000","last_became_peered":"2023-09-23T08:54:53.107758+0000","last_unstale":"2023-09-23T08:54:56.196433+0000","last_undegraded":"2023-09-23T08:54:56.196433+0000","last_fullsized":"2023-09-23T08:54:56.196433+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:40:55.079186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'4","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:57.445549+0000","last_change":"2023-09-23T08:54:52.081384+0000","last_active":"2023-09-23T08:54:57.445549+0000","last_peered":"2023-09-23T08:54:57.445549+0000","last_clean":"2023-09-23T08:54:57.445549+0000","last_became_active":"2023-09-23T08:54:52.081082+0000","last_became_peered":"2023-09-23T08:54:52.081082+0000","last_unstale":"2023-09-23T08:54:57.445549+0000","last_undegraded":"2023-09-23T08:54:57.445549+0000","last_fullsized":"2023-09-23T08:54:57.445549+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:39:54.713880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.094508+0000","last_change":"2023-09-23T08:54:53.109011+0000","last_active":"2023-09-23T08:54:54.094508+0000","last_peered":"2023-09-23T08:54:54.094508+0000","last_clean":"2023-09-23T08:54:54.094508+0000","last_became_active":"2023-09-23T08:54:53.108520+0000","last_became_peered":"2023-09-23T08:54:53.108520+0000","last_unstale":"2023-09-23T08:54:54.094508+0000","last_undegraded":"2023-09-23T08:54:54.094508+0000","last_fullsized":"2023-09-23T08:54:54.094508+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T10:48:12.245624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"86'6","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:55:00.491008+0000","last_change":"2023-09-23T08:54:52.078525+0000","last_active":"2023-09-23T08:55:00.491008+0000","last_peered":"2023-09-23T08:55:00.491008+0000","last_clean":"2023-09-23T08:55:00.491008+0000","last_became_active":"2023-09-23T08:54:52.078177+0000","last_became_peered":"2023-09-23T08:54:52.078177+0000","last_unstale":"2023-09-23T08:55:00.491008+0000","last_undegraded":"2023-09-23T08:55:00.491008+0000","last_fullsized":"2023-09-23T08:55:00.491008+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T14:48:34.659834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":348,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.685333+0000","last_change":"2023-09-23T08:53:33.610965+0000","last_active":"2023-09-23T08:54:54.685333+0000","last_peered":"2023-09-23T08:54:54.685333+0000","last_clean":"2023-09-23T08:54:54.685333+0000","last_became_active":"2023-09-23T08:53:33.610529+0000","last_became_peered":"2023-09-23T08:53:33.610529+0000","last_unstale":"2023-09-23T08:54:54.685333+0000","last_undegraded":"2023-09-23T08:54:54.685333+0000","last_fullsized":"2023-09-23T08:54:54.685333+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:50:00.779071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:50:00.779071+0000","last_clean_scrub_stamp":"2023-09-23T08:50:00.779071+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T11:54:40.139279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.093168+0000","last_change":"2023-09-23T08:54:53.099970+0000","last_active":"2023-09-23T08:54:54.093168+0000","last_peered":"2023-09-23T08:54:54.093168+0000","last_clean":"2023-09-23T08:54:54.093168+0000","last_became_active":"2023-09-23T08:54:53.099630+0000","last_became_peered":"2023-09-23T08:54:53.099630+0000","last_unstale":"2023-09-23T08:54:54.093168+0000","last_undegraded":"2023-09-23T08:54:54.093168+0000","last_fullsized":"2023-09-23T08:54:54.093168+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T10:54:38.993617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"86'4","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:57.444779+0000","last_change":"2023-09-23T08:54:52.083083+0000","last_active":"2023-09-23T08:54:57.444779+0000","last_peered":"2023-09-23T08:54:57.444779+0000","last_clean":"2023-09-23T08:54:57.444779+0000","last_became_active":"2023-09-23T08:54:52.082704+0000","last_became_peered":"2023-09-23T08:54:52.082704+0000","last_unstale":"2023-09-23T08:54:57.444779+0000","last_undegraded":"2023-09-23T08:54:57.444779+0000","last_fullsized":"2023-09-23T08:54:57.444779+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:17:05.649810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"86'4","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:59.470505+0000","last_change":"2023-09-23T08:54:52.080482+0000","last_active":"2023-09-23T08:54:59.470505+0000","last_peered":"2023-09-23T08:54:59.470505+0000","last_clean":"2023-09-23T08:54:59.470505+0000","last_became_active":"2023-09-23T08:54:52.079756+0000","last_became_peered":"2023-09-23T08:54:52.079756+0000","last_unstale":"2023-09-23T08:54:59.470505+0000","last_undegraded":"2023-09-23T08:54:59.470505+0000","last_fullsized":"2023-09-23T08:54:59.470505+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T09:03:05.737800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.093479+0000","last_change":"2023-09-23T08:54:53.092828+0000","last_active":"2023-09-23T08:54:54.093479+0000","last_peered":"2023-09-23T08:54:54.093479+0000","last_clean":"2023-09-23T08:54:54.093479+0000","last_became_active":"2023-09-23T08:54:53.092486+0000","last_became_peered":"2023-09-23T08:54:53.092486+0000","last_unstale":"2023-09-23T08:54:54.093479+0000","last_undegraded":"2023-09-23T08:54:54.093479+0000","last_fullsized":"2023-09-23T08:54:54.093479+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:13:51.960156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"86'3","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:57.445567+0000","last_change":"2023-09-23T08:54:52.081801+0000","last_active":"2023-09-23T08:54:57.445567+0000","last_peered":"2023-09-23T08:54:57.445567+0000","last_clean":"2023-09-23T08:54:57.445567+0000","last_became_active":"2023-09-23T08:54:52.081449+0000","last_became_peered":"2023-09-23T08:54:52.081449+0000","last_unstale":"2023-09-23T08:54:57.445567+0000","last_undegraded":"2023-09-23T08:54:57.445567+0000","last_fullsized":"2023-09-23T08:54:57.445567+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T18:47:12.813500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.094760+0000","last_change":"2023-09-23T08:54:53.101037+0000","last_active":"2023-09-23T08:54:54.094760+0000","last_peered":"2023-09-23T08:54:54.094760+0000","last_clean":"2023-09-23T08:54:54.094760+0000","last_became_active":"2023-09-23T08:54:53.100673+0000","last_became_peered":"2023-09-23T08:54:53.100673+0000","last_unstale":"2023-09-23T08:54:54.094760+0000","last_undegraded":"2023-09-23T08:54:54.094760+0000","last_fullsized":"2023-09-23T08:54:54.094760+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T10:37:30.873142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"86'7","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:59.470776+0000","last_change":"2023-09-23T08:54:52.077785+0000","last_active":"2023-09-23T08:54:59.470776+0000","last_peered":"2023-09-23T08:54:59.470776+0000","last_clean":"2023-09-23T08:54:59.470776+0000","last_became_active":"2023-09-23T08:54:52.077306+0000","last_became_peered":"2023-09-23T08:54:52.077306+0000","last_unstale":"2023-09-23T08:54:59.470776+0000","last_undegraded":"2023-09-23T08:54:59.470776+0000","last_fullsized":"2023-09-23T08:54:59.470776+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T13:15:21.302985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:55.569509+0000","last_change":"2023-09-23T08:54:53.106534+0000","last_active":"2023-09-23T08:54:55.569509+0000","last_peered":"2023-09-23T08:54:55.569509+0000","last_clean":"2023-09-23T08:54:55.569509+0000","last_became_active":"2023-09-23T08:54:53.105928+0000","last_became_peered":"2023-09-23T08:54:53.105928+0000","last_unstale":"2023-09-23T08:54:55.569509+0000","last_undegraded":"2023-09-23T08:54:55.569509+0000","last_fullsized":"2023-09-23T08:54:55.569509+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:46:35.565053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:56.421115+0000","last_change":"2023-09-23T08:54:52.081122+0000","last_active":"2023-09-23T08:54:56.421115+0000","last_peered":"2023-09-23T08:54:56.421115+0000","last_clean":"2023-09-23T08:54:56.421115+0000","last_became_active":"2023-09-23T08:54:52.080825+0000","last_became_peered":"2023-09-23T08:54:52.080825+0000","last_unstale":"2023-09-23T08:54:56.421115+0000","last_undegraded":"2023-09-23T08:54:56.421115+0000","last_fullsized":"2023-09-23T08:54:56.421115+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T09:32:12.256672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.868774+0000","last_change":"2023-09-23T08:54:53.106050+0000","last_active":"2023-09-23T08:54:54.868774+0000","last_peered":"2023-09-23T08:54:54.868774+0000","last_clean":"2023-09-23T08:54:54.868774+0000","last_became_active":"2023-09-23T08:54:53.105729+0000","last_became_peered":"2023-09-23T08:54:53.105729+0000","last_unstale":"2023-09-23T08:54:54.868774+0000","last_undegraded":"2023-09-23T08:54:54.868774+0000","last_fullsized":"2023-09-23T08:54:54.868774+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:11:10.758171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:59.468498+0000","last_change":"2023-09-23T08:54:52.086019+0000","last_active":"2023-09-23T08:54:59.468498+0000","last_peered":"2023-09-23T08:54:59.468498+0000","last_clean":"2023-09-23T08:54:59.468498+0000","last_became_active":"2023-09-23T08:54:52.085688+0000","last_became_peered":"2023-09-23T08:54:52.085688+0000","last_unstale":"2023-09-23T08:54:59.468498+0000","last_undegraded":"2023-09-23T08:54:59.468498+0000","last_fullsized":"2023-09-23T08:54:59.468498+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T11:10:16.280442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.093146+0000","last_change":"2023-09-23T08:54:53.099533+0000","last_active":"2023-09-23T08:54:54.093146+0000","last_peered":"2023-09-23T08:54:54.093146+0000","last_clean":"2023-09-23T08:54:54.093146+0000","last_became_active":"2023-09-23T08:54:53.099192+0000","last_became_peered":"2023-09-23T08:54:53.099192+0000","last_unstale":"2023-09-23T08:54:54.093146+0000","last_undegraded":"2023-09-23T08:54:54.093146+0000","last_fullsized":"2023-09-23T08:54:54.093146+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T11:23:50.174786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"86'1","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:56.196761+0000","last_change":"2023-09-23T08:54:52.086258+0000","last_active":"2023-09-23T08:54:56.196761+0000","last_peered":"2023-09-23T08:54:56.196761+0000","last_clean":"2023-09-23T08:54:56.196761+0000","last_became_active":"2023-09-23T08:54:52.085935+0000","last_became_peered":"2023-09-23T08:54:52.085935+0000","last_unstale":"2023-09-23T08:54:56.196761+0000","last_undegraded":"2023-09-23T08:54:56.196761+0000","last_fullsized":"2023-09-23T08:54:56.196761+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T18:34:46.098198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.094580+0000","last_change":"2023-09-23T08:54:53.105176+0000","last_active":"2023-09-23T08:54:54.094580+0000","last_peered":"2023-09-23T08:54:54.094580+0000","last_clean":"2023-09-23T08:54:54.094580+0000","last_became_active":"2023-09-23T08:54:53.104794+0000","last_became_peered":"2023-09-23T08:54:53.104794+0000","last_unstale":"2023-09-23T08:54:54.094580+0000","last_undegraded":"2023-09-23T08:54:54.094580+0000","last_fullsized":"2023-09-23T08:54:54.094580+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T12:29:26.317509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:56.420186+0000","last_change":"2023-09-23T08:54:52.078596+0000","last_active":"2023-09-23T08:54:56.420186+0000","last_peered":"2023-09-23T08:54:56.420186+0000","last_clean":"2023-09-23T08:54:56.420186+0000","last_became_active":"2023-09-23T08:54:52.078310+0000","last_became_peered":"2023-09-23T08:54:52.078310+0000","last_unstale":"2023-09-23T08:54:56.420186+0000","last_undegraded":"2023-09-23T08:54:56.420186+0000","last_fullsized":"2023-09-23T08:54:56.420186+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T08:55:44.970687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.685498+0000","last_change":"2023-09-23T08:54:53.106368+0000","last_active":"2023-09-23T08:54:54.685498+0000","last_peered":"2023-09-23T08:54:54.685498+0000","last_clean":"2023-09-23T08:54:54.685498+0000","last_became_active":"2023-09-23T08:54:53.105977+0000","last_became_peered":"2023-09-23T08:54:53.105977+0000","last_unstale":"2023-09-23T08:54:54.685498+0000","last_undegraded":"2023-09-23T08:54:54.685498+0000","last_fullsized":"2023-09-23T08:54:54.685498+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T14:38:34.430707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'5","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:58.464156+0000","last_change":"2023-09-23T08:54:52.089221+0000","last_active":"2023-09-23T08:54:58.464156+0000","last_peered":"2023-09-23T08:54:58.464156+0000","last_clean":"2023-09-23T08:54:58.464156+0000","last_became_active":"2023-09-23T08:54:52.088824+0000","last_became_peered":"2023-09-23T08:54:52.088824+0000","last_unstale":"2023-09-23T08:54:58.464156+0000","last_undegraded":"2023-09-23T08:54:58.464156+0000","last_fullsized":"2023-09-23T08:54:58.464156+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T20:24:40.305323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.685805+0000","last_change":"2023-09-23T08:54:53.107600+0000","last_active":"2023-09-23T08:54:54.685805+0000","last_peered":"2023-09-23T08:54:54.685805+0000","last_clean":"2023-09-23T08:54:54.685805+0000","last_became_active":"2023-09-23T08:54:53.105637+0000","last_became_peered":"2023-09-23T08:54:53.105637+0000","last_unstale":"2023-09-23T08:54:54.685805+0000","last_undegraded":"2023-09-23T08:54:54.685805+0000","last_fullsized":"2023-09-23T08:54:54.685805+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:18:17.690310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"86'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:56.196776+0000","last_change":"2023-09-23T08:54:52.081912+0000","last_active":"2023-09-23T08:54:56.196776+0000","last_peered":"2023-09-23T08:54:56.196776+0000","last_clean":"2023-09-23T08:54:56.196776+0000","last_became_active":"2023-09-23T08:54:52.081668+0000","last_became_peered":"2023-09-23T08:54:52.081668+0000","last_unstale":"2023-09-23T08:54:56.196776+0000","last_undegraded":"2023-09-23T08:54:56.196776+0000","last_fullsized":"2023-09-23T08:54:56.196776+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:30:20.267787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"86'1","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:55.067750+0000","last_change":"2023-09-23T08:54:53.106975+0000","last_active":"2023-09-23T08:54:55.067750+0000","last_peered":"2023-09-23T08:54:55.067750+0000","last_clean":"2023-09-23T08:54:55.067750+0000","last_became_active":"2023-09-23T08:54:53.106537+0000","last_became_peered":"2023-09-23T08:54:53.106537+0000","last_unstale":"2023-09-23T08:54:55.067750+0000","last_undegraded":"2023-09-23T08:54:55.067750+0000","last_fullsized":"2023-09-23T08:54:55.067750+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T13:42:55.831232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"86'3","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.406067+0000","last_change":"2023-09-23T08:54:52.081636+0000","last_active":"2023-09-23T08:54:54.406067+0000","last_peered":"2023-09-23T08:54:54.406067+0000","last_clean":"2023-09-23T08:54:54.406067+0000","last_became_active":"2023-09-23T08:54:52.081224+0000","last_became_peered":"2023-09-23T08:54:52.081224+0000","last_unstale":"2023-09-23T08:54:54.406067+0000","last_undegraded":"2023-09-23T08:54:54.406067+0000","last_fullsized":"2023-09-23T08:54:54.406067+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:48:26.708260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.685764+0000","last_change":"2023-09-23T08:54:53.109625+0000","last_active":"2023-09-23T08:54:54.685764+0000","last_peered":"2023-09-23T08:54:54.685764+0000","last_clean":"2023-09-23T08:54:54.685764+0000","last_became_active":"2023-09-23T08:54:53.109323+0000","last_became_peered":"2023-09-23T08:54:53.109323+0000","last_unstale":"2023-09-23T08:54:54.685764+0000","last_undegraded":"2023-09-23T08:54:54.685764+0000","last_fullsized":"2023-09-23T08:54:54.685764+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T08:54:59.569228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.093253+0000","last_change":"2023-09-23T08:54:53.100071+0000","last_active":"2023-09-23T08:54:54.093253+0000","last_peered":"2023-09-23T08:54:54.093253+0000","last_clean":"2023-09-23T08:54:54.093253+0000","last_became_active":"2023-09-23T08:54:53.099757+0000","last_became_peered":"2023-09-23T08:54:53.099757+0000","last_unstale":"2023-09-23T08:54:54.093253+0000","last_undegraded":"2023-09-23T08:54:54.093253+0000","last_fullsized":"2023-09-23T08:54:54.093253+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T11:26:58.182356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:56.196912+0000","last_change":"2023-09-23T08:54:53.101001+0000","last_active":"2023-09-23T08:54:56.196912+0000","last_peered":"2023-09-23T08:54:56.196912+0000","last_clean":"2023-09-23T08:54:56.196912+0000","last_became_active":"2023-09-23T08:54:53.100315+0000","last_became_peered":"2023-09-23T08:54:53.100315+0000","last_unstale":"2023-09-23T08:54:56.196912+0000","last_undegraded":"2023-09-23T08:54:56.196912+0000","last_fullsized":"2023-09-23T08:54:56.196912+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:00:47.052364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:56.196563+0000","last_change":"2023-09-23T08:54:53.102855+0000","last_active":"2023-09-23T08:54:56.196563+0000","last_peered":"2023-09-23T08:54:56.196563+0000","last_clean":"2023-09-23T08:54:56.196563+0000","last_became_active":"2023-09-23T08:54:53.102495+0000","last_became_peered":"2023-09-23T08:54:53.102495+0000","last_unstale":"2023-09-23T08:54:56.196563+0000","last_undegraded":"2023-09-23T08:54:56.196563+0000","last_fullsized":"2023-09-23T08:54:56.196563+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:48:11.977110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:55.569641+0000","last_change":"2023-09-23T08:54:53.102063+0000","last_active":"2023-09-23T08:54:55.569641+0000","last_peered":"2023-09-23T08:54:55.569641+0000","last_clean":"2023-09-23T08:54:55.569641+0000","last_became_active":"2023-09-23T08:54:53.101734+0000","last_became_peered":"2023-09-23T08:54:53.101734+0000","last_unstale":"2023-09-23T08:54:55.569641+0000","last_undegraded":"2023-09-23T08:54:55.569641+0000","last_fullsized":"2023-09-23T08:54:55.569641+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T18:45:53.768289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.093622+0000","last_change":"2023-09-23T08:54:53.110291+0000","last_active":"2023-09-23T08:54:54.093622+0000","last_peered":"2023-09-23T08:54:54.093622+0000","last_clean":"2023-09-23T08:54:54.093622+0000","last_became_active":"2023-09-23T08:54:53.109962+0000","last_became_peered":"2023-09-23T08:54:53.109962+0000","last_unstale":"2023-09-23T08:54:54.093622+0000","last_undegraded":"2023-09-23T08:54:54.093622+0000","last_fullsized":"2023-09-23T08:54:54.093622+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T18:30:15.264146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.093341+0000","last_change":"2023-09-23T08:54:53.104278+0000","last_active":"2023-09-23T08:54:54.093341+0000","last_peered":"2023-09-23T08:54:54.093341+0000","last_clean":"2023-09-23T08:54:54.093341+0000","last_became_active":"2023-09-23T08:54:53.103765+0000","last_became_peered":"2023-09-23T08:54:53.103765+0000","last_unstale":"2023-09-23T08:54:54.093341+0000","last_undegraded":"2023-09-23T08:54:54.093341+0000","last_fullsized":"2023-09-23T08:54:54.093341+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T14:55:54.833030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:56.197162+0000","last_change":"2023-09-23T08:54:53.104861+0000","last_active":"2023-09-23T08:54:56.197162+0000","last_peered":"2023-09-23T08:54:56.197162+0000","last_clean":"2023-09-23T08:54:56.197162+0000","last_became_active":"2023-09-23T08:54:53.104554+0000","last_became_peered":"2023-09-23T08:54:53.104554+0000","last_unstale":"2023-09-23T08:54:56.197162+0000","last_undegraded":"2023-09-23T08:54:56.197162+0000","last_fullsized":"2023-09-23T08:54:56.197162+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T09:09:00.027796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.094897+0000","last_change":"2023-09-23T08:54:53.106859+0000","last_active":"2023-09-23T08:54:54.094897+0000","last_peered":"2023-09-23T08:54:54.094897+0000","last_clean":"2023-09-23T08:54:54.094897+0000","last_became_active":"2023-09-23T08:54:53.106494+0000","last_became_peered":"2023-09-23T08:54:53.106494+0000","last_unstale":"2023-09-23T08:54:54.094897+0000","last_undegraded":"2023-09-23T08:54:54.094897+0000","last_fullsized":"2023-09-23T08:54:54.094897+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T09:26:45.689810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:56.196309+0000","last_change":"2023-09-23T08:54:53.101591+0000","last_active":"2023-09-23T08:54:56.196309+0000","last_peered":"2023-09-23T08:54:56.196309+0000","last_clean":"2023-09-23T08:54:56.196309+0000","last_became_active":"2023-09-23T08:54:53.101237+0000","last_became_peered":"2023-09-23T08:54:53.101237+0000","last_unstale":"2023-09-23T08:54:56.196309+0000","last_undegraded":"2023-09-23T08:54:56.196309+0000","last_fullsized":"2023-09-23T08:54:56.196309+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:39:46.335069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.094264+0000","last_change":"2023-09-23T08:54:53.103373+0000","last_active":"2023-09-23T08:54:54.094264+0000","last_peered":"2023-09-23T08:54:54.094264+0000","last_clean":"2023-09-23T08:54:54.094264+0000","last_became_active":"2023-09-23T08:54:53.102948+0000","last_became_peered":"2023-09-23T08:54:53.102948+0000","last_unstale":"2023-09-23T08:54:54.094264+0000","last_undegraded":"2023-09-23T08:54:54.094264+0000","last_fullsized":"2023-09-23T08:54:54.094264+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:35:07.251630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.392117+0000","last_change":"2023-09-23T08:54:53.100488+0000","last_active":"2023-09-23T08:54:54.392117+0000","last_peered":"2023-09-23T08:54:54.392117+0000","last_clean":"2023-09-23T08:54:54.392117+0000","last_became_active":"2023-09-23T08:54:53.100182+0000","last_became_peered":"2023-09-23T08:54:53.100182+0000","last_unstale":"2023-09-23T08:54:54.392117+0000","last_undegraded":"2023-09-23T08:54:54.392117+0000","last_fullsized":"2023-09-23T08:54:54.392117+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:05:08.498272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.093576+0000","last_change":"2023-09-23T08:54:53.097571+0000","last_active":"2023-09-23T08:54:54.093576+0000","last_peered":"2023-09-23T08:54:54.093576+0000","last_clean":"2023-09-23T08:54:54.093576+0000","last_became_active":"2023-09-23T08:54:53.097278+0000","last_became_peered":"2023-09-23T08:54:53.097278+0000","last_unstale":"2023-09-23T08:54:54.093576+0000","last_undegraded":"2023-09-23T08:54:54.093576+0000","last_fullsized":"2023-09-23T08:54:54.093576+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:20:31.523731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:54:54.093294+0000","last_change":"2023-09-23T08:54:53.113543+0000","last_active":"2023-09-23T08:54:54.093294+0000","last_peered":"2023-09-23T08:54:54.093294+0000","last_clean":"2023-09-23T08:54:54.093294+0000","last_became_active":"2023-09-23T08:54:53.113287+0000","last_became_peered":"2023-09-23T08:54:53.113287+0000","last_unstale":"2023-09-23T08:54:54.093294+0000","last_undegraded":"2023-09-23T08:54:54.093294+0000","last_fullsized":"2023-09-23T08:54:54.093294+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T12:52:12.034242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":42985,"num_objects":86,"num_object_clones":0,"num_object_copies":258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":24,"num_read_kb":55,"num_write":193,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":56,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":56477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":169,"ondisk_log_size":169,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892350991,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":921600,"data_stored":441360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:54:56 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.69399999999999995}]},{"osd":1,"last update":"Sat Sep 23 08:54:56 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":1.0740000000000001},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":1.0600000000000001}]},{"osd":2,"last update":"Sat Sep 23 08:54:56 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.81899999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":4,"last update":"Sat Sep 23 08:54:56 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.673,"5min":1.673,"15min":1.673},"last":1.099}]},{"osd":5,"last update":"Sat Sep 23 08:54:56 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.65300000000000002}]},{"osd":6,"last update":"Sat Sep 23 08:54:56 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.871}]},{"osd":7,"last update":"Sat Sep 23 08:54:56 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.997},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.74,"5min":1.74,"15min":1.74},"last":1.008}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]},{"osd":9,"last update":"Sat Sep 23 08:54:56 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":1.0389999999999999},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.89900000000000002}]},{"osd":10,"last update":"Sat Sep 23 08:54:56 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":2.3410000000000002,"5min":2.3410000000000002,"15min":2.3410000000000002},"last":1.196},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":1.149}]}]},{"osd":10,"up_from":73,"seq":313532612629,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28588,"kb_used_data":1572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716564,"statfs":{"total":95995035648,"available":95965761536,"internally_reserved":0,"allocated":1609728,"data_stored":1070262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":1,"last update":"Sat Sep 23 08:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":0.379}]},{"osd":2,"last update":"Sat Sep 23 08:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.83299999999999996}]},{"osd":3,"last update":"Sat Sep 23 08:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.56999999999999995}]},{"osd":4,"last update":"Sat Sep 23 08:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":0.503}]},{"osd":5,"last update":"Sat Sep 23 08:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":0.871},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.333,"5min":1.333,"15min":1.333},"last":0.85599999999999998}]},{"osd":6,"last update":"Sat Sep 23 08:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.70699999999999996}]},{"osd":7,"last update":"Sat Sep 23 08:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.52500000000000002}]},{"osd":8,"last update":"Sat Sep 23 08:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.75900000000000001},{"interface":"front","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":0.81699999999999995}]},{"osd":9,"last update":"Sat Sep 23 08:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.78700000000000003},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.587,"5min":1.587,"15min":1.587},"last":0.68000000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]}]},{"osd":9,"up_from":68,"seq":292057776152,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":942080,"data_stored":442178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:54:05 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.46700000000000003}]},{"osd":1,"last update":"Sat Sep 23 08:54:05 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.375}]},{"osd":2,"last update":"Sat Sep 23 08:54:05 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.71999999999999997}]},{"osd":3,"last update":"Sat Sep 23 08:54:05 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.432}]},{"osd":4,"last update":"Sat Sep 23 08:54:05 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.53200000000000003}]},{"osd":5,"last update":"Sat Sep 23 08:54:05 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.625},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.70699999999999996}]},{"osd":6,"last update":"Sat Sep 23 08:54:05 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.68700000000000006}]},{"osd":7,"last update":"Sat Sep 23 08:54:05 2023","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.238,"15min":1.238},"min":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":7.0759999999999996,"5min":7.0759999999999996,"15min":7.0759999999999996},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.64400000000000002}]},{"osd":8,"last update":"Sat Sep 23 08:54:05 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.746},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.79000000000000004}]},{"osd":10,"last update":"Sat Sep 23 08:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.67500000000000004}]}]},{"osd":8,"up_from":60,"seq":257698037790,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":954368,"data_stored":442860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:54:41 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.67700000000000005,"15min":0.68500000000000005},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.85999999999999999,"5min":1.004,"15min":1.004},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.68500000000000005,"15min":0.69299999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.85799999999999998,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.63700000000000001}]},{"osd":1,"last update":"Sat Sep 23 08:54:41 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.79400000000000004,"15min":0.80400000000000005},"min":{"1min":0.46999999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0509999999999999,"5min":1.115,"15min":1.115},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.73499999999999999,"15min":0.73899999999999999},"min":{"1min":0.52000000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.94199999999999995,"5min":0.998,"15min":0.998},"last":0.876}]},{"osd":2,"last update":"Sat Sep 23 08:54:41 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.59199999999999997,"15min":0.59999999999999998},"min":{"1min":0.373,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58599999999999997,"15min":0.58399999999999996},"min":{"1min":0.39600000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.52100000000000002}]},{"osd":3,"last update":"Sat Sep 23 08:54:41 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.76600000000000001,"15min":0.78800000000000003},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.78700000000000003,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.82399999999999995,"15min":0.83199999999999996},"min":{"1min":0.58099999999999996,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.95199999999999996,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.97299999999999998}]},{"osd":4,"last update":"Sat Sep 23 08:54:41 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.78800000000000003,"15min":0.80000000000000004},"min":{"1min":0.48599999999999999,"5min":0.439,"15min":0.439},"max":{"1min":0.90400000000000003,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.97099999999999997,"15min":1.0029999999999999},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.1060000000000001,"5min":3.7530000000000001,"15min":3.7530000000000001},"last":0.85499999999999998}]},{"osd":5,"last update":"Sat Sep 23 08:54:41 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.69999999999999996,"15min":0.71099999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.79100000000000004,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.75800000000000001,"15min":0.77300000000000002},"min":{"1min":0.434,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.872,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.89300000000000002}]},{"osd":6,"last update":"Sat Sep 23 08:54:41 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.89600000000000002,"15min":0.90700000000000003},"min":{"1min":0.53500000000000003,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0129999999999999,"5min":1.23,"15min":1.23},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.86099999999999999,"15min":0.875},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.91200000000000003,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.78500000000000003}]},{"osd":7,"last update":"Sat Sep 23 08:54:41 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.871,"15min":0.879},"min":{"1min":0.63800000000000001,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":0.98199999999999998,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.91300000000000003,"15min":0.92800000000000005},"min":{"1min":0.70099999999999996,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.98999999999999999,"5min":1.679,"15min":1.679},"last":0.83399999999999996}]},{"osd":9,"last update":"Sat Sep 23 08:54:05 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.95399999999999996}]},{"osd":10,"last update":"Sat Sep 23 08:54:32 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":1.024},{"interface":"front","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":1.0129999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98899999999999999}]}]},{"osd":7,"up_from":52,"seq":223338299428,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28512,"kb_used_data":1496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716640,"statfs":{"total":95995035648,"available":95965839360,"internally_reserved":0,"allocated":1531904,"data_stored":1034368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:54:15 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.627,"15min":0.621},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.59799999999999998,"15min":0.58599999999999997},"min":{"1min":0.48399999999999999,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.53800000000000003}]},{"osd":1,"last update":"Sat Sep 23 08:54:15 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.505,"15min":0.50800000000000001},"min":{"1min":0.32800000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.71399999999999997,"5min":0.754,"15min":0.754},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.443}]},{"osd":2,"last update":"Sat Sep 23 08:54:15 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.73999999999999999,"15min":0.745},"min":{"1min":0.54900000000000004,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.84199999999999997,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.72599999999999998,"15min":0.72999999999999998},"min":{"1min":0.46899999999999997,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.93899999999999995,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.89200000000000002}]},{"osd":3,"last update":"Sat Sep 23 08:54:15 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.67200000000000004,"15min":0.66400000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.72899999999999998,"15min":0.73099999999999998},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.0760000000000001,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.61699999999999999}]},{"osd":4,"last update":"Sat Sep 23 08:54:15 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.70399999999999996,"15min":0.71299999999999997},"min":{"1min":0.36899999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.92100000000000004,"5min":1.04,"15min":1.04},"last":0.878},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.69099999999999995,"15min":0.69899999999999995},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.92100000000000004,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.58099999999999996}]},{"osd":5,"last update":"Sat Sep 23 08:54:15 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.80400000000000005,"15min":0.80800000000000005},"min":{"1min":0.57699999999999996,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.96799999999999997,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.79900000000000004,"15min":0.80900000000000005},"min":{"1min":0.48799999999999999,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.85499999999999998}]},{"osd":6,"last update":"Sat Sep 23 08:54:15 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.82699999999999996,"15min":0.83099999999999996},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.052,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.82499999999999996,"15min":0.82899999999999996},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":0.995,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.53200000000000003}]},{"osd":8,"last update":"Sat Sep 23 08:54:38 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.82599999999999996,"15min":0.81499999999999995},"min":{"1min":0.65900000000000003,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.0780000000000001,"5min":1.085,"15min":1.085},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.61099999999999999,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.1000000000000001,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.80800000000000005}]},{"osd":9,"last update":"Sat Sep 23 08:54:04 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.48099999999999998}]},{"osd":10,"last update":"Sat Sep 23 08:54:33 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.82899999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93100000000000005}]}]},{"osd":6,"up_from":47,"seq":201863462954,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":929792,"data_stored":441472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:54:46 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.44700000000000001,"15min":0.433},"min":{"1min":0.33400000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.501,"5min":0.48099999999999998,"15min":0.46700000000000003},"min":{"1min":0.34100000000000003,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.69899999999999995,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":1.0129999999999999}]},{"osd":1,"last update":"Sat Sep 23 08:54:46 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.66100000000000003,"15min":0.628},"min":{"1min":0.46000000000000002,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.97899999999999998,"5min":1.071,"15min":1.071},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.752,"5min":0.69099999999999995,"15min":0.66300000000000003},"min":{"1min":0.56899999999999995,"5min":0.498,"15min":0.498},"max":{"1min":1.024,"5min":1.026,"15min":1.026},"last":0.53400000000000003}]},{"osd":2,"last update":"Sat Sep 23 08:54:46 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.67600000000000005,"15min":0.66200000000000003},"min":{"1min":0.49099999999999999,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.93799999999999994,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":1.1859999999999999},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71399999999999997,"15min":0.69299999999999995},"min":{"1min":0.5,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.98599999999999999,"5min":1.143,"15min":1.143},"last":0.66500000000000004}]},{"osd":3,"last update":"Sat Sep 23 08:54:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.59599999999999997,"15min":0.58199999999999996},"min":{"1min":0.378,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.61199999999999999,"15min":0.59999999999999998},"min":{"1min":0.41099999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.83199999999999996,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.55700000000000005}]},{"osd":4,"last update":"Sat Sep 23 08:54:46 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.71999999999999997,"15min":0.71799999999999997},"min":{"1min":0.48699999999999999,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.999,"5min":1.151,"15min":1.151},"last":1.212},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.75700000000000001,"15min":0.73299999999999998},"min":{"1min":0.57099999999999995,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0489999999999999,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.85199999999999998}]},{"osd":5,"last update":"Sat Sep 23 08:54:46 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.749,"15min":0.72499999999999998},"min":{"1min":0.50800000000000001,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.038,"5min":1.099,"15min":1.099},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.76400000000000001,"15min":0.76000000000000001},"min":{"1min":0.53900000000000003,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.99199999999999999,"5min":1.165,"15min":1.165},"last":1.129}]},{"osd":7,"last update":"Sat Sep 23 08:54:15 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.77900000000000003,"15min":0.749},"min":{"1min":0.67300000000000004,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.81599999999999995,"15min":0.78900000000000003},"min":{"1min":0.68300000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.71899999999999997}]},{"osd":8,"last update":"Sat Sep 23 08:54:44 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.89100000000000001,"15min":0.89900000000000002},"min":{"1min":0.60099999999999998,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.105,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.87,"5min":0.88200000000000001,"15min":0.88400000000000001},"min":{"1min":0.51800000000000002,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.145,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.85899999999999999}]},{"osd":9,"last update":"Sat Sep 23 08:54:03 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":0.68300000000000005}]},{"osd":10,"last update":"Sat Sep 23 08:54:30 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.80100000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574914,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":929792,"data_stored":442699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:54:43 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.57899999999999996,"15min":0.55500000000000005},"min":{"1min":0.41999999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.60599999999999998,"15min":0.58699999999999997},"min":{"1min":0.39700000000000002,"5min":0.314,"15min":0.314},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.59499999999999997}]},{"osd":2,"last update":"Sat Sep 23 08:54:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.70499999999999996,"15min":0.69899999999999995},"min":{"1min":0.47299999999999998,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.69299999999999995,"15min":0.68700000000000006},"min":{"1min":0.45700000000000002,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.90400000000000003,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.77900000000000003}]},{"osd":3,"last update":"Sat Sep 23 08:54:38 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.67000000000000004,"15min":0.65100000000000002},"min":{"1min":0.495,"5min":0.436,"15min":0.436},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.65700000000000003,"15min":0.63900000000000001},"min":{"1min":0.53600000000000003,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.63700000000000001}]},{"osd":4,"last update":"Sat Sep 23 08:54:54 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.51000000000000001,"15min":0.48199999999999998},"min":{"1min":0.38600000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.92100000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.54500000000000004,"15min":0.51500000000000001},"min":{"1min":0.35599999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.51300000000000001}]},{"osd":5,"last update":"Sat Sep 23 08:54:27 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.73999999999999999,"15min":0.72799999999999998},"min":{"1min":0.56200000000000006,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.71099999999999997,"15min":0.70199999999999996},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.91700000000000004,"5min":1.01,"15min":1.01},"last":0.86799999999999999}]},{"osd":6,"last update":"Sat Sep 23 08:54:45 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71999999999999997,"15min":0.72399999999999998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.69699999999999995,"15min":0.69199999999999995},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.70399999999999996}]},{"osd":7,"last update":"Sat Sep 23 08:54:15 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.68100000000000005,"15min":0.68899999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.752,"5min":0.76700000000000002,"15min":0.76900000000000002},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.012,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.76200000000000001}]},{"osd":8,"last update":"Sat Sep 23 08:54:38 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.76300000000000001,"15min":0.745},"min":{"1min":0.58799999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":2.8010000000000002,"5min":2.8010000000000002,"15min":2.8010000000000002},"last":0.748},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.77000000000000002,"15min":0.76200000000000001},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.94599999999999995}]},{"osd":9,"last update":"Sat Sep 23 08:54:06 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.98299999999999998},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.79900000000000004}]},{"osd":10,"last update":"Sat Sep 23 08:54:30 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":1.0169999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738441,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":958464,"data_stored":443265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 23 08:54:42 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61399999999999999,"15min":0.58999999999999997},"min":{"1min":0.41099999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.80800000000000005,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.625},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72399999999999998,"15min":0.64300000000000002},"min":{"1min":0.47999999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.95899999999999996,"5min":5.7450000000000001,"15min":5.7450000000000001},"last":0.67100000000000004}]},{"osd":2,"last update":"Sat Sep 23 08:54:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.64000000000000001,"15min":0.64200000000000002},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.92700000000000005,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.63200000000000001,"15min":0.63500000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.872,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.72199999999999998}]},{"osd":3,"last update":"Sat Sep 23 08:53:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.47199999999999998,"15min":0.45600000000000002},"min":{"1min":0.377,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.54700000000000004,"15min":0.52500000000000002},"min":{"1min":0.40500000000000003,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.44}]},{"osd":4,"last update":"Sat Sep 23 08:54:55 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.69399999999999995,"15min":0.64000000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.98899999999999999,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.72099999999999997,"15min":0.66400000000000003},"min":{"1min":0.44800000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.88400000000000001,"5min":5.6710000000000003,"15min":5.6710000000000003},"last":0.70099999999999996}]},{"osd":5,"last update":"Sat Sep 23 08:54:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69499999999999995,"15min":0.68899999999999995},"min":{"1min":0.48199999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.93500000000000005,"5min":0.996,"15min":0.996},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70599999999999996,"15min":0.69699999999999995},"min":{"1min":0.46000000000000002,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.113,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.59799999999999998}]},{"osd":6,"last update":"Sat Sep 23 08:54:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.69399999999999995,"15min":0.69499999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.73599999999999999,"15min":0.73499999999999999},"min":{"1min":0.47999999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.93899999999999995,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.57199999999999995}]},{"osd":7,"last update":"Sat Sep 23 08:54:14 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.77300000000000002,"15min":0.77900000000000003},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.0489999999999999,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.875,"5min":0.84599999999999997,"15min":0.84099999999999997},"min":{"1min":0.63500000000000001,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.81799999999999995}]},{"osd":8,"last update":"Sat Sep 23 08:54:36 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.83799999999999997,"15min":0.85099999999999998},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":0.98499999999999999,"5min":1.147,"15min":1.147},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.80500000000000005,"15min":0.81799999999999995},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.0840000000000001,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.77600000000000002}]},{"osd":9,"last update":"Sat Sep 23 08:54:06 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.75700000000000001}]},{"osd":10,"last update":"Sat Sep 23 08:54:30 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.88}]},{"osd":11,"last update":"Sat Sep 23 08:54:59 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.879,"5min":0.879,"15min":0.879},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.83499999999999996}]}]},{"osd":2,"up_from":18,"seq":77309411389,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":958464,"data_stored":444322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:54:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.627,"15min":0.61899999999999999},"min":{"1min":0.42299999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.94899999999999995,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.624,"15min":0.625},"min":{"1min":0.47299999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.92300000000000004,"5min":1.196,"15min":1.196},"last":0.62}]},{"osd":1,"last update":"Sat Sep 23 08:54:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.66100000000000003,"15min":0.67200000000000004},"min":{"1min":0.42199999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.97399999999999998,"5min":1.177,"15min":1.177},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.67400000000000004,"15min":0.66900000000000004},"min":{"1min":0.437,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.98999999999999999,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.97099999999999997}]},{"osd":3,"last update":"Sat Sep 23 08:54:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.72999999999999998,"15min":0.72199999999999998},"min":{"1min":0.54700000000000004,"5min":0.438,"15min":0.438},"max":{"1min":0.92900000000000005,"5min":1.083,"15min":1.083},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.68999999999999995,"15min":0.68400000000000005},"min":{"1min":0.45400000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.91000000000000003,"5min":1.054,"15min":1.054},"last":0.67900000000000005}]},{"osd":4,"last update":"Sat Sep 23 08:53:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.64100000000000001,"15min":0.63300000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.91100000000000003,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":1.036},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.66000000000000003,"15min":0.64500000000000002},"min":{"1min":0.55600000000000005,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.91400000000000003}]},{"osd":5,"last update":"Sat Sep 23 08:54:25 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.56499999999999995,"15min":0.54800000000000004},"min":{"1min":0.41699999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.54800000000000004,"15min":0.52900000000000003},"min":{"1min":0.39500000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.93700000000000006,"5min":1.085,"15min":1.085},"last":0.65200000000000002}]},{"osd":6,"last update":"Sat Sep 23 08:54:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.752,"15min":0.73199999999999998},"min":{"1min":0.57099999999999995,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.96899999999999997,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.70699999999999996,"15min":0.69299999999999995},"min":{"1min":0.46899999999999997,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.95899999999999996,"5min":1.115,"15min":1.115},"last":0.85399999999999998}]},{"osd":7,"last update":"Sat Sep 23 08:54:12 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.75,"15min":0.75},"min":{"1min":0.61399999999999999,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.93999999999999995,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.81699999999999995,"15min":0.81999999999999995},"min":{"1min":0.56299999999999994,"5min":0.501,"15min":0.501},"max":{"1min":1.006,"5min":1.129,"15min":1.129},"last":0.82199999999999995}]},{"osd":8,"last update":"Sat Sep 23 08:54:38 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73499999999999999,"15min":0.73599999999999999},"min":{"1min":0.47999999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.95099999999999996,"5min":1.085,"15min":1.085},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.82699999999999996}]},{"osd":9,"last update":"Sat Sep 23 08:54:06 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":1.004}]},{"osd":10,"last update":"Sat Sep 23 08:54:30 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":1.077},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":1.0880000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0589999999999999}]}]},{"osd":3,"up_from":26,"seq":111669149752,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":946176,"data_stored":441309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.42499999999999999,"15min":0.39100000000000001},"min":{"1min":0.314,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.58399999999999996,"5min":0.745,"15min":0.745},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.44900000000000001,"15min":0.41599999999999998},"min":{"1min":0.38900000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.61899999999999999}]},{"osd":1,"last update":"Sat Sep 23 08:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.67600000000000005,"15min":0.61499999999999999},"min":{"1min":0.63700000000000001,"5min":0.434,"15min":0.434},"max":{"1min":0.98399999999999999,"5min":1.099,"15min":1.099},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.65800000000000003,"15min":0.625},"min":{"1min":0.51500000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.86899999999999999,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.72999999999999998}]},{"osd":2,"last update":"Sat Sep 23 08:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.67500000000000004,"15min":0.64600000000000002},"min":{"1min":0.46899999999999997,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.88900000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.755,"5min":0.69799999999999995,"15min":0.66000000000000003},"min":{"1min":0.56299999999999994,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.95899999999999996,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.92400000000000004}]},{"osd":4,"last update":"Sat Sep 23 08:54:00 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.67900000000000005,"15min":0.65400000000000003},"min":{"1min":0.65400000000000003,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.68400000000000005,"15min":0.65200000000000002},"min":{"1min":0.59299999999999997,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.71499999999999997}]},{"osd":5,"last update":"Sat Sep 23 08:54:25 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.78400000000000003,"15min":0.77000000000000002},"min":{"1min":0.65400000000000003,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.016,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":1.012},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78100000000000003,"15min":0.76800000000000002},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":0.997,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.88300000000000001}]},{"osd":6,"last update":"Sat Sep 23 08:54:50 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.63500000000000001,"15min":0.64500000000000002},"min":{"1min":0.45900000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.746,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68600000000000005,"15min":0.66600000000000004},"min":{"1min":0.435,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.03,"5min":1.054,"15min":1.054},"last":0.83999999999999997}]},{"osd":7,"last update":"Sat Sep 23 08:54:13 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.81399999999999995,"15min":0.81599999999999995},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.83399999999999996,"15min":0.83899999999999997},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.75}]},{"osd":8,"last update":"Sat Sep 23 08:54:43 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.89200000000000002,"15min":0.90300000000000002},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.0660000000000001,"5min":1.093,"15min":1.093},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.86699999999999999,"15min":0.87},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.66000000000000003}]},{"osd":9,"last update":"Sat Sep 23 08:54:03 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.89200000000000002}]},{"osd":10,"last update":"Sat Sep 23 08:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.99099999999999999},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.96799999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0469999999999999}]}]},{"osd":4,"up_from":34,"seq":146028888117,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":942080,"data_stored":442450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:53:55 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.628,"15min":0.624},"min":{"1min":0.45300000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.86199999999999999,"5min":1.042,"15min":1.042},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.622,"5min":0.60699999999999998,"15min":0.60899999999999999},"min":{"1min":0.434,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.93300000000000005,"5min":1.008,"15min":1.008},"last":0.38300000000000001}]},{"osd":1,"last update":"Sat Sep 23 08:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.44600000000000001,"15min":0.442},"min":{"1min":0.36099999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.48099999999999998,"15min":0.47099999999999997},"min":{"1min":0.375,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.40100000000000002}]},{"osd":2,"last update":"Sat Sep 23 08:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.69799999999999995,"15min":0.66800000000000004},"min":{"1min":0.46000000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.65800000000000003,"15min":0.65300000000000002},"min":{"1min":0.47699999999999998,"5min":0.38,"15min":0.38},"max":{"1min":0.94999999999999996,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.47699999999999998}]},{"osd":3,"last update":"Sat Sep 23 08:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64700000000000002,"15min":0.63700000000000001},"min":{"1min":0.45700000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.89600000000000002,"5min":1.014,"15min":1.014},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.72499999999999998,"15min":0.70899999999999996},"min":{"1min":0.53300000000000003,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.99099999999999999,"5min":1.238,"15min":1.238},"last":0.72399999999999998}]},{"osd":5,"last update":"Sat Sep 23 08:54:22 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.65800000000000003,"15min":0.627},"min":{"1min":0.47399999999999998,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.69799999999999995,"15min":0.65600000000000003},"min":{"1min":0.60199999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.63400000000000001}]},{"osd":6,"last update":"Sat Sep 23 08:54:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":0.80100000000000005,"15min":0.72799999999999998},"min":{"1min":0.57499999999999996,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":7.1829999999999998,"5min":7.1829999999999998,"15min":7.1829999999999998},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70299999999999996,"15min":0.69499999999999995},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.77000000000000002}]},{"osd":7,"last update":"Sat Sep 23 08:54:14 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.64300000000000002,"15min":0.63900000000000001},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.746,"5min":0.70299999999999996,"15min":0.69599999999999995},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.92600000000000005}]},{"osd":8,"last update":"Sat Sep 23 08:54:42 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.77700000000000002,"15min":0.77300000000000002},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.042,"5min":1.087,"15min":1.087},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.78700000000000003,"15min":0.77900000000000003},"min":{"1min":0.67500000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.747}]},{"osd":9,"last update":"Sat Sep 23 08:54:04 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.81200000000000006}]},{"osd":10,"last update":"Sat Sep 23 08:54:32 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.85699999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]}]},{"osd":5,"up_from":39,"seq":167503724591,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28524,"kb_used_data":1504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716628,"statfs":{"total":95995035648,"available":95965827072,"internally_reserved":0,"allocated":1540096,"data_stored":1032931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:54:27 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.625,"15min":0.61899999999999999},"min":{"1min":0.43099999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.89000000000000001,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.64800000000000002,"15min":0.65100000000000002},"min":{"1min":0.45500000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.89300000000000002}]},{"osd":1,"last update":"Sat Sep 23 08:54:27 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.65200000000000002,"15min":0.63800000000000001},"min":{"1min":0.45100000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.753,"5min":0.65600000000000003,"15min":0.629},"min":{"1min":0.55100000000000005,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.53800000000000003}]},{"osd":2,"last update":"Sat Sep 23 08:54:27 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.53800000000000003,"15min":0.52400000000000002},"min":{"1min":0.378,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.62},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.53600000000000003,"15min":0.51800000000000002},"min":{"1min":0.379,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.51200000000000001}]},{"osd":3,"last update":"Sat Sep 23 08:54:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.67000000000000004,"15min":0.67200000000000004},"min":{"1min":0.55200000000000005,"5min":0.435,"15min":0.435},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.68899999999999995,"15min":0.69199999999999995},"min":{"1min":0.50800000000000001,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.85199999999999998,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.56499999999999995}]},{"osd":4,"last update":"Sat Sep 23 08:54:27 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.69999999999999996,"15min":0.68300000000000005},"min":{"1min":0.45100000000000001,"5min":0.44,"15min":0.44},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.70599999999999996,"15min":0.68600000000000005},"min":{"1min":0.46899999999999997,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.63900000000000001}]},{"osd":6,"last update":"Sat Sep 23 08:54:47 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.747,"15min":0.72899999999999998},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.95699999999999996,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.753,"5min":0.752,"15min":0.73899999999999999},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.67600000000000005}]},{"osd":7,"last update":"Sat Sep 23 08:54:10 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.76300000000000001,"15min":0.749},"min":{"1min":0.66700000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.79200000000000004,"15min":0.78300000000000003},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.71699999999999997}]},{"osd":8,"last update":"Sat Sep 23 08:54:37 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.77700000000000002,"15min":0.78000000000000003},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.77500000000000002,"15min":0.77600000000000002},"min":{"1min":0.53100000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.77100000000000002}]},{"osd":9,"last update":"Sat Sep 23 08:54:04 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.7969999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.95,"5min":1.95,"15min":1.95},"last":0.80400000000000005}]},{"osd":10,"last update":"Sat Sep 23 08:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.748}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":38411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-23T08:55:02.284 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-09-23T08:55:02.284 INFO:tasks.cephadm:Setting up client nodes... 2023-09-23T08:55:02.285 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2023-09-23T08:55:03.035 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.a/config 2023-09-23T08:55:03.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:03 smithi082 ceph-mon[97694]: from='client.14814 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-09-23T08:55:03.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:03 smithi082 ceph-mon[97694]: pgmap v306: 97 pgs: 97 active+clean; 619 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 10 KiB/s wr, 24 op/s 2023-09-23T08:55:03.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:03 smithi082 ceph-mon[97694]: from='client.14820 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-09-23T08:55:03.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:03 smithi135 ceph-mon[99205]: from='client.14814 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-09-23T08:55:03.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:03 smithi135 ceph-mon[99205]: pgmap v306: 97 pgs: 97 active+clean; 619 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 10 KiB/s wr, 24 op/s 2023-09-23T08:55:03.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:03 smithi135 ceph-mon[99205]: from='client.14820 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-09-23T08:55:03.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:03 smithi161 ceph-mon[99580]: from='client.14814 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-09-23T08:55:03.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:03 smithi161 ceph-mon[99580]: pgmap v306: 97 pgs: 97 active+clean; 619 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 10 KiB/s wr, 24 op/s 2023-09-23T08:55:03.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:03 smithi161 ceph-mon[99580]: from='client.14820 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-09-23T08:55:04.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:04.561+0000 7f64f1ddd700 1 -- 172.21.15.82:0/2382716435 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64ec1009e0 msgr2=0x7f64ec100e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:04.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:04.561+0000 7f64f1ddd700 1 --2- 172.21.15.82:0/2382716435 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64ec1009e0 0x7f64ec100e00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f64dc0099c0 tx=0x7f64dc009cd0 comp rx=0 tx=0).stop 2023-09-23T08:55:04.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:04.561+0000 7f64f1ddd700 1 -- 172.21.15.82:0/2382716435 shutdown_connections 2023-09-23T08:55:04.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:04.561+0000 7f64f1ddd700 1 --2- 172.21.15.82:0/2382716435 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f64ec102580 0x7f64ec108e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:04.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:04.562+0000 7f64f1ddd700 1 --2- 172.21.15.82:0/2382716435 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64ec1009e0 0x7f64ec100e00 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:04.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:04.562+0000 7f64f1ddd700 1 --2- 172.21.15.82:0/2382716435 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64ec101be0 0x7f64ec102040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:04.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:04.562+0000 7f64f1ddd700 1 -- 172.21.15.82:0/2382716435 >> 172.21.15.82:0/2382716435 conn(0x7f64ec0fbfa0 msgr2=0x7f64ec0fe3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:04.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:04.562+0000 7f64f1ddd700 1 -- 172.21.15.82:0/2382716435 shutdown_connections 2023-09-23T08:55:04.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:04.562+0000 7f64f1ddd700 1 -- 172.21.15.82:0/2382716435 wait complete. 2023-09-23T08:55:04.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:04.563+0000 7f64f1ddd700 1 Processor -- start 2023-09-23T08:55:04.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:04.563+0000 7f64f1ddd700 1 -- start start 2023-09-23T08:55:04.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:04.564+0000 7f64f1ddd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64ec1009e0 0x7f64ec1965c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:04.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:04.564+0000 7f64f1ddd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f64ec101be0 0x7f64ec196b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:04.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:04.564+0000 7f64f1ddd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64ec102580 0x7f64ec19db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:04.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:04.564+0000 7f64f1ddd700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64ec19e150 con 0x7f64ec1009e0 2023-09-23T08:55:04.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:04.564+0000 7f64f1ddd700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64ec19e290 con 0x7f64ec102580 2023-09-23T08:55:04.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:04.564+0000 7f64f1ddd700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64ec19e420 con 0x7f64ec101be0 2023-09-23T08:55:04.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:04.564+0000 7f64eb7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64ec1009e0 0x7f64ec1965c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:04.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:04.564+0000 7f64eb7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64ec1009e0 0x7f64ec1965c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44090/0 (socket says 172.21.15.82:44090) 2023-09-23T08:55:04.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:04.564+0000 7f64eb7fe700 1 -- 172.21.15.82:0/121043568 learned_addr learned my addr 172.21.15.82:0/121043568 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:55:04.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:04.564+0000 7f64eaffd700 1 --2- 172.21.15.82:0/121043568 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f64ec101be0 0x7f64ec196b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:04.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:04.564+0000 7f64ebfff700 1 --2- 172.21.15.82:0/121043568 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64ec102580 0x7f64ec19db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:04.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:04.565+0000 7f64eb7fe700 1 -- 172.21.15.82:0/121043568 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f64ec101be0 msgr2=0x7f64ec196b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:04.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:04.565+0000 7f64eb7fe700 1 --2- 172.21.15.82:0/121043568 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f64ec101be0 0x7f64ec196b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:04.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:04.565+0000 7f64eb7fe700 1 -- 172.21.15.82:0/121043568 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64ec102580 msgr2=0x7f64ec19db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:04.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:04.565+0000 7f64eb7fe700 1 --2- 172.21.15.82:0/121043568 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64ec102580 0x7f64ec19db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:04.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:04.565+0000 7f64eb7fe700 1 -- 172.21.15.82:0/121043568 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64dc0095f0 con 0x7f64ec1009e0 2023-09-23T08:55:04.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:04.565+0000 7f64eaffd700 1 --2- 172.21.15.82:0/121043568 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f64ec101be0 0x7f64ec196b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T08:55:04.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:04.565+0000 7f64ebfff700 1 --2- 172.21.15.82:0/121043568 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64ec102580 0x7f64ec19db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T08:55:04.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:04.565+0000 7f64eb7fe700 1 --2- 172.21.15.82:0/121043568 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64ec1009e0 0x7f64ec1965c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f64dc00b580 tx=0x7f64dc003b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:04.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:04.565+0000 7f64e8ff9700 1 -- 172.21.15.82:0/121043568 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64dc01d070 con 0x7f64ec1009e0 2023-09-23T08:55:04.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:04.565+0000 7f64e8ff9700 1 -- 172.21.15.82:0/121043568 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f64dc00bda0 con 0x7f64ec1009e0 2023-09-23T08:55:04.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:04.565+0000 7f64f1ddd700 1 -- 172.21.15.82:0/121043568 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64ec19e6a0 con 0x7f64ec1009e0 2023-09-23T08:55:04.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:04.565+0000 7f64e8ff9700 1 -- 172.21.15.82:0/121043568 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64dc022e20 con 0x7f64ec1009e0 2023-09-23T08:55:04.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:04.565+0000 7f64f1ddd700 1 -- 172.21.15.82:0/121043568 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64ec19eab0 con 0x7f64ec1009e0 2023-09-23T08:55:04.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:04.566+0000 7f64f1ddd700 1 -- 172.21.15.82:0/121043568 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64ec10c090 con 0x7f64ec1009e0 2023-09-23T08:55:04.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:04.568+0000 7f64e8ff9700 1 -- 172.21.15.82:0/121043568 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) v1 ==== 134722+0+0 (secure 0 0 0) 0x7f64dc003ee0 con 0x7f64ec1009e0 2023-09-23T08:55:04.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:04.569+0000 7f64e8ff9700 1 --2- 172.21.15.82:0/121043568 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f64d409ffe0 0x7f64d40a24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:04.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:04.570+0000 7f64e8ff9700 1 -- 172.21.15.82:0/121043568 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f64dc0cc6f0 con 0x7f64ec1009e0 2023-09-23T08:55:04.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:04.570+0000 7f64eaffd700 1 --2- 172.21.15.82:0/121043568 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f64d409ffe0 0x7f64d40a24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:04.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:04.570+0000 7f64eaffd700 1 --2- 172.21.15.82:0/121043568 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f64d409ffe0 0x7f64d40a24a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f64e0005fd0 tx=0x7f64e0005ee0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:04.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:04.573+0000 7f64e8ff9700 1 -- 172.21.15.82:0/121043568 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f64dc096460 con 0x7f64ec1009e0 2023-09-23T08:55:04.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:04.851+0000 7f64f1ddd700 1 -- 172.21.15.82:0/121043568 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f64ec107a00 con 0x7f64ec1009e0 2023-09-23T08:55:04.859 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:04.856+0000 7f64e8ff9700 1 -- 172.21.15.82:0/121043568 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) v1 ==== 170+0+59 (secure 0 0 0) 0x7f64dc027050 con 0x7f64ec1009e0 2023-09-23T08:55:04.859 INFO:teuthology.orchestra.run.smithi082.stdout:[client.0] 2023-09-23T08:55:04.859 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQDopw5l1hLbMhAAmeHjrz9lrlIYfqt8Ki9MkA== 2023-09-23T08:55:04.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:04.859+0000 7f64f1ddd700 1 -- 172.21.15.82:0/121043568 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f64d409ffe0 msgr2=0x7f64d40a24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:04.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:04.859+0000 7f64f1ddd700 1 --2- 172.21.15.82:0/121043568 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f64d409ffe0 0x7f64d40a24a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f64e0005fd0 tx=0x7f64e0005ee0 comp rx=0 tx=0).stop 2023-09-23T08:55:04.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:04.859+0000 7f64f1ddd700 1 -- 172.21.15.82:0/121043568 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64ec1009e0 msgr2=0x7f64ec1965c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:04.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:04.859+0000 7f64f1ddd700 1 --2- 172.21.15.82:0/121043568 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64ec1009e0 0x7f64ec1965c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f64dc00b580 tx=0x7f64dc003b00 comp rx=0 tx=0).stop 2023-09-23T08:55:04.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:04.859+0000 7f64f1ddd700 1 -- 172.21.15.82:0/121043568 shutdown_connections 2023-09-23T08:55:04.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:04.859+0000 7f64f1ddd700 1 --2- 172.21.15.82:0/121043568 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f64d409ffe0 0x7f64d40a24a0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:04.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:04.859+0000 7f64f1ddd700 1 --2- 172.21.15.82:0/121043568 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64ec102580 0x7f64ec19db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:04.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:04.859+0000 7f64f1ddd700 1 --2- 172.21.15.82:0/121043568 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64ec1009e0 0x7f64ec1965c0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:04.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:04.859+0000 7f64f1ddd700 1 --2- 172.21.15.82:0/121043568 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f64ec101be0 0x7f64ec196b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:04.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:04.859+0000 7f64f1ddd700 1 -- 172.21.15.82:0/121043568 >> 172.21.15.82:0/121043568 conn(0x7f64ec0fbfa0 msgr2=0x7f64ec0fe340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:04.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:04.859+0000 7f64f1ddd700 1 -- 172.21.15.82:0/121043568 shutdown_connections 2023-09-23T08:55:04.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:04.859+0000 7f64f1ddd700 1 -- 172.21.15.82:0/121043568 wait complete. 2023-09-23T08:55:05.307 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-09-23T08:55:05.308 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2023-09-23T08:55:05.308 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-09-23T08:55:05.407 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-09-23T08:55:05.408 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2023-09-23T08:55:05.408 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- ceph mgr dump --format=json 2023-09-23T08:55:05.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:05 smithi082 ceph-mon[97694]: pgmap v307: 97 pgs: 97 active+clean; 619 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 8.6 KiB/s wr, 25 op/s 2023-09-23T08:55:05.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:05 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/121043568' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-09-23T08:55:05.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:05 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/121043568' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-09-23T08:55:05.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:05 smithi135 ceph-mon[99205]: pgmap v307: 97 pgs: 97 active+clean; 619 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 8.6 KiB/s wr, 25 op/s 2023-09-23T08:55:05.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:05 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/121043568' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-09-23T08:55:05.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:05 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/121043568' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-09-23T08:55:05.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:05 smithi161 ceph-mon[99580]: pgmap v307: 97 pgs: 97 active+clean; 619 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 8.6 KiB/s wr, 25 op/s 2023-09-23T08:55:05.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:05 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/121043568' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-09-23T08:55:05.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:05 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/121043568' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-09-23T08:55:06.169 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.a/config 2023-09-23T08:55:07.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:07.625+0000 7fa7f743c700 1 -- 172.21.15.82:0/1675878070 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7f0106940 msgr2=0x7fa7f0106d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:07.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:07.625+0000 7fa7f743c700 1 --2- 172.21.15.82:0/1675878070 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7f0106940 0x7fa7f0106d20 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec009990 tx=0x7fa7ec009ca0 comp rx=0 tx=0).stop 2023-09-23T08:55:07.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:07.626+0000 7fa7f743c700 1 -- 172.21.15.82:0/1675878070 shutdown_connections 2023-09-23T08:55:07.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:07.626+0000 7fa7f743c700 1 --2- 172.21.15.82:0/1675878070 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa7f0101300 0x7fa7f010d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:07.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:07.626+0000 7fa7f743c700 1 --2- 172.21.15.82:0/1675878070 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7f0106940 0x7fa7f0106d20 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:07.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:07.626+0000 7fa7f743c700 1 --2- 172.21.15.82:0/1675878070 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7f0100940 0x7fa7f0100dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:07.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:07.626+0000 7fa7f743c700 1 -- 172.21.15.82:0/1675878070 >> 172.21.15.82:0/1675878070 conn(0x7fa7f00fc410 msgr2=0x7fa7f00fe830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:07.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:07.626+0000 7fa7f743c700 1 -- 172.21.15.82:0/1675878070 shutdown_connections 2023-09-23T08:55:07.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:07.626+0000 7fa7f743c700 1 -- 172.21.15.82:0/1675878070 wait complete. 2023-09-23T08:55:07.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:07.627+0000 7fa7f743c700 1 Processor -- start 2023-09-23T08:55:07.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:07.627+0000 7fa7f743c700 1 -- start start 2023-09-23T08:55:07.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:07.627+0000 7fa7f743c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7f0100940 0x7fa7f019c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:07.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:07.627+0000 7fa7f743c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa7f0101300 0x7fa7f019cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:07.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:07.627+0000 7fa7f743c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7f0106940 0x7fa7f0196780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:07.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:07.627+0000 7fa7f743c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f0196df0 con 0x7fa7f0106940 2023-09-23T08:55:07.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:07.627+0000 7fa7f743c700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f0196f60 con 0x7fa7f0100940 2023-09-23T08:55:07.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:07.627+0000 7fa7f743c700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f0197120 con 0x7fa7f0101300 2023-09-23T08:55:07.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:07.628+0000 7fa7f59d9700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7f0106940 0x7fa7f0196780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:07.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:07.628+0000 7fa7f51d8700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7f0100940 0x7fa7f019c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:07.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:07.628+0000 7fa7f59d9700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7f0106940 0x7fa7f0196780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44114/0 (socket says 172.21.15.82:44114) 2023-09-23T08:55:07.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:07.628+0000 7fa7f59d9700 1 -- 172.21.15.82:0/1616417809 learned_addr learned my addr 172.21.15.82:0/1616417809 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:55:07.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:07.628+0000 7fa7f49d7700 1 --2- 172.21.15.82:0/1616417809 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa7f0101300 0x7fa7f019cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:07.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:07.628+0000 7fa7f51d8700 1 -- 172.21.15.82:0/1616417809 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa7f0101300 msgr2=0x7fa7f019cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:07.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:07.628+0000 7fa7f51d8700 1 --2- 172.21.15.82:0/1616417809 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa7f0101300 0x7fa7f019cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:07.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:07.628+0000 7fa7f51d8700 1 -- 172.21.15.82:0/1616417809 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7f0106940 msgr2=0x7fa7f0196780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:07.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:07.628+0000 7fa7f51d8700 1 --2- 172.21.15.82:0/1616417809 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7f0106940 0x7fa7f0196780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:07.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:07.628+0000 7fa7f51d8700 1 -- 172.21.15.82:0/1616417809 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7ec0095f0 con 0x7fa7f0100940 2023-09-23T08:55:07.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:07.628+0000 7fa7f59d9700 1 --2- 172.21.15.82:0/1616417809 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7f0106940 0x7fa7f0196780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T08:55:07.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:07.628+0000 7fa7f51d8700 1 --2- 172.21.15.82:0/1616417809 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7f0100940 0x7fa7f019c700 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec0098e0 tx=0x7fa7ec009580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:07.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:07.629+0000 7fa7e67fc700 1 -- 172.21.15.82:0/1616417809 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7ec01d070 con 0x7fa7f0100940 2023-09-23T08:55:07.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:07.629+0000 7fa7f743c700 1 -- 172.21.15.82:0/1616417809 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7f01973a0 con 0x7fa7f0100940 2023-09-23T08:55:07.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:07.629+0000 7fa7e67fc700 1 -- 172.21.15.82:0/1616417809 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa7ec003f80 con 0x7fa7f0100940 2023-09-23T08:55:07.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:07.629+0000 7fa7e67fc700 1 -- 172.21.15.82:0/1616417809 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7ec022ac0 con 0x7fa7f0100940 2023-09-23T08:55:07.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:07.629+0000 7fa7f743c700 1 -- 172.21.15.82:0/1616417809 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7f0072d20 con 0x7fa7f0100940 2023-09-23T08:55:07.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:07.630+0000 7fa7f743c700 1 -- 172.21.15.82:0/1616417809 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7f004e620 con 0x7fa7f0100940 2023-09-23T08:55:07.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:07.632+0000 7fa7e67fc700 1 -- 172.21.15.82:0/1616417809 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) v1 ==== 134722+0+0 (secure 0 0 0) 0x7fa7ec003af0 con 0x7fa7f0100940 2023-09-23T08:55:07.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:07.633+0000 7fa7e67fc700 1 --2- 172.21.15.82:0/1616417809 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fa7dc0a0060 0x7fa7dc0a2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:07.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:07.633+0000 7fa7e67fc700 1 -- 172.21.15.82:0/1616417809 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fa7ec0cd0e0 con 0x7fa7f0100940 2023-09-23T08:55:07.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:07.633+0000 7fa7f49d7700 1 --2- 172.21.15.82:0/1616417809 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fa7dc0a0060 0x7fa7dc0a2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:07.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:07.634+0000 7fa7f49d7700 1 --2- 172.21.15.82:0/1616417809 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fa7dc0a0060 0x7fa7dc0a2520 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa7e0005ea0 tx=0x7fa7e0005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:07.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:07.636+0000 7fa7e67fc700 1 -- 172.21.15.82:0/1616417809 <== mon.2 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7fa7ec096e50 con 0x7fa7f0100940 2023-09-23T08:55:07.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:07 smithi135 ceph-mon[99205]: pgmap v308: 97 pgs: 97 active+clean; 624 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 8.2 KiB/s wr, 24 op/s 2023-09-23T08:55:07.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:07 smithi082 ceph-mon[97694]: pgmap v308: 97 pgs: 97 active+clean; 624 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 8.2 KiB/s wr, 24 op/s 2023-09-23T08:55:07.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:07.888+0000 7fa7f743c700 1 -- 172.21.15.82:0/1616417809 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fa7f0197c90 con 0x7fa7f0100940 2023-09-23T08:55:07.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:07.894+0000 7fa7e67fc700 1 -- 172.21.15.82:0/1616417809 <== mon.2 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) v1 ==== 74+0+258100 (secure 0 0 0) 0x7fa7ec09a470 con 0x7fa7f0100940 2023-09-23T08:55:07.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:07 smithi161 ceph-mon[99580]: pgmap v308: 97 pgs: 97 active+clean; 624 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 8.2 KiB/s wr, 24 op/s 2023-09-23T08:55:07.902 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:55:07.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:07.898+0000 7fa7f743c700 1 -- 172.21.15.82:0/1616417809 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fa7dc0a0060 msgr2=0x7fa7dc0a2520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:07.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:07.898+0000 7fa7f743c700 1 --2- 172.21.15.82:0/1616417809 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fa7dc0a0060 0x7fa7dc0a2520 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa7e0005ea0 tx=0x7fa7e0005e30 comp rx=0 tx=0).stop 2023-09-23T08:55:07.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:07.899+0000 7fa7f743c700 1 -- 172.21.15.82:0/1616417809 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7f0100940 msgr2=0x7fa7f019c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:07.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:07.899+0000 7fa7f743c700 1 --2- 172.21.15.82:0/1616417809 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7f0100940 0x7fa7f019c700 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec0098e0 tx=0x7fa7ec009580 comp rx=0 tx=0).stop 2023-09-23T08:55:07.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:07.899+0000 7fa7f743c700 1 -- 172.21.15.82:0/1616417809 shutdown_connections 2023-09-23T08:55:07.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:07.899+0000 7fa7f743c700 1 --2- 172.21.15.82:0/1616417809 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fa7dc0a0060 0x7fa7dc0a2520 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:07.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:07.899+0000 7fa7f743c700 1 --2- 172.21.15.82:0/1616417809 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7f0106940 0x7fa7f0196780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:07.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:07.899+0000 7fa7f743c700 1 --2- 172.21.15.82:0/1616417809 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7f0100940 0x7fa7f019c700 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:07.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:07.899+0000 7fa7f743c700 1 --2- 172.21.15.82:0/1616417809 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa7f0101300 0x7fa7f019cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:07.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:07.899+0000 7fa7f743c700 1 -- 172.21.15.82:0/1616417809 >> 172.21.15.82:0/1616417809 conn(0x7fa7f00fc410 msgr2=0x7fa7f0104450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:07.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:07.899+0000 7fa7f743c700 1 -- 172.21.15.82:0/1616417809 shutdown_connections 2023-09-23T08:55:07.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:07.899+0000 7fa7f743c700 1 -- 172.21.15.82:0/1616417809 wait complete. 2023-09-23T08:55:08.445 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":17,"active_gid":14152,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":3698954311},{"type":"v1","addr":"172.21.15.82:6801","nonce":3698954311}]},"active_addr":"172.21.15.82:6801/3698954311","active_change":"2023-09-23T08:47:21.957988+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":24109,"name":"z","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.2","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24113,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.2","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.2","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.82:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.82:0","nonce":2391800294}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.82:0","nonce":1232294461}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.82:0","nonce":3074646956}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.82:0","nonce":1769657494}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.82:0","nonce":287531996}]}]} 2023-09-23T08:55:08.452 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2023-09-23T08:55:08.452 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2023-09-23T08:55:08.452 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- ceph osd dump --format=json 2023-09-23T08:55:08.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:08 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/1616417809' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-09-23T08:55:08.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:08 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/1616417809' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-09-23T08:55:08.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:08 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/1616417809' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-09-23T08:55:09.175 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.a/config 2023-09-23T08:55:09.777 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:09 smithi082 ceph-mon[97694]: pgmap v309: 97 pgs: 97 active+clean; 624 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 8.0 KiB/s wr, 24 op/s 2023-09-23T08:55:09.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:09 smithi135 ceph-mon[99205]: pgmap v309: 97 pgs: 97 active+clean; 624 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 8.0 KiB/s wr, 24 op/s 2023-09-23T08:55:09.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:09 smithi161 ceph-mon[99580]: pgmap v309: 97 pgs: 97 active+clean; 624 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 8.0 KiB/s wr, 24 op/s 2023-09-23T08:55:10.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:10.697+0000 7fcee5f24700 1 -- 172.21.15.82:0/4280449587 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcee0106940 msgr2=0x7fcee0106d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:10.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:10.697+0000 7fcee5f24700 1 --2- 172.21.15.82:0/4280449587 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcee0106940 0x7fcee0106d20 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fced0009990 tx=0x7fced0009ca0 comp rx=0 tx=0).stop 2023-09-23T08:55:10.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:10.698+0000 7fcee5f24700 1 -- 172.21.15.82:0/4280449587 shutdown_connections 2023-09-23T08:55:10.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:10.698+0000 7fcee5f24700 1 --2- 172.21.15.82:0/4280449587 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcee0101300 0x7fcee010d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:10.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:10.698+0000 7fcee5f24700 1 --2- 172.21.15.82:0/4280449587 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcee0106940 0x7fcee0106d20 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:10.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:10.698+0000 7fcee5f24700 1 --2- 172.21.15.82:0/4280449587 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcee0100940 0x7fcee0100dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:10.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:10.698+0000 7fcee5f24700 1 -- 172.21.15.82:0/4280449587 >> 172.21.15.82:0/4280449587 conn(0x7fcee00fc410 msgr2=0x7fcee00fe830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:10.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:10.698+0000 7fcee5f24700 1 -- 172.21.15.82:0/4280449587 shutdown_connections 2023-09-23T08:55:10.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:10.698+0000 7fcee5f24700 1 -- 172.21.15.82:0/4280449587 wait complete. 2023-09-23T08:55:10.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:10.699+0000 7fcee5f24700 1 Processor -- start 2023-09-23T08:55:10.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:10.699+0000 7fcee5f24700 1 -- start start 2023-09-23T08:55:10.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:10.699+0000 7fcee5f24700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcee0100940 0x7fcee0072c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:10.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:10.699+0000 7fcee5f24700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcee0101300 0x7fcee0073160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:10.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:10.699+0000 7fcee5f24700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcee0106940 0x7fcee00736e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:10.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:10.699+0000 7fcee5f24700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcee01a4f50 con 0x7fcee0106940 2023-09-23T08:55:10.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:10.699+0000 7fcee5f24700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcee01a50c0 con 0x7fcee0100940 2023-09-23T08:55:10.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:10.699+0000 7fcee5f24700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcee01a5280 con 0x7fcee0101300 2023-09-23T08:55:10.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:10.699+0000 7fcedffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcee0106940 0x7fcee00736e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:10.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:10.699+0000 7fced77fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcee0100940 0x7fcee0072c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:10.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:10.699+0000 7fcedffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcee0106940 0x7fcee00736e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44132/0 (socket says 172.21.15.82:44132) 2023-09-23T08:55:10.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:10.699+0000 7fcedffff700 1 -- 172.21.15.82:0/601057777 learned_addr learned my addr 172.21.15.82:0/601057777 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:55:10.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:10.699+0000 7fced77fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcee0100940 0x7fcee0072c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:53772/0 (socket says 172.21.15.82:53772) 2023-09-23T08:55:10.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:10.700+0000 7fcedf7fe700 1 --2- 172.21.15.82:0/601057777 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcee0101300 0x7fcee0073160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:10.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:10.700+0000 7fcedffff700 1 -- 172.21.15.82:0/601057777 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcee0101300 msgr2=0x7fcee0073160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:10.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:10.700+0000 7fcedffff700 1 --2- 172.21.15.82:0/601057777 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcee0101300 0x7fcee0073160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:10.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:10.700+0000 7fcedffff700 1 -- 172.21.15.82:0/601057777 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcee0100940 msgr2=0x7fcee0072c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:10.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:10.700+0000 7fcedffff700 1 --2- 172.21.15.82:0/601057777 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcee0100940 0x7fcee0072c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:10.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:10.700+0000 7fcedffff700 1 -- 172.21.15.82:0/601057777 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fced00095f0 con 0x7fcee0106940 2023-09-23T08:55:10.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:10.700+0000 7fced77fe700 1 --2- 172.21.15.82:0/601057777 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcee0100940 0x7fcee0072c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T08:55:10.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:10.700+0000 7fcedffff700 1 --2- 172.21.15.82:0/601057777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcee0106940 0x7fcee00736e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fced800b970 tx=0x7fced800bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:10.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:10.700+0000 7fcedd7fa700 1 -- 172.21.15.82:0/601057777 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced800d860 con 0x7fcee0106940 2023-09-23T08:55:10.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:10.700+0000 7fcee5f24700 1 -- 172.21.15.82:0/601057777 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcee01a5560 con 0x7fcee0106940 2023-09-23T08:55:10.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:10.700+0000 7fcedd7fa700 1 -- 172.21.15.82:0/601057777 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fced800de50 con 0x7fcee0106940 2023-09-23T08:55:10.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:10.700+0000 7fcedd7fa700 1 -- 172.21.15.82:0/601057777 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced8017400 con 0x7fcee0106940 2023-09-23T08:55:10.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:10.701+0000 7fcee5f24700 1 -- 172.21.15.82:0/601057777 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcee01a5a60 con 0x7fcee0106940 2023-09-23T08:55:10.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:10.702+0000 7fcee5f24700 1 -- 172.21.15.82:0/601057777 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcee0108f40 con 0x7fcee0106940 2023-09-23T08:55:10.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:10.703+0000 7fcedd7fa700 1 -- 172.21.15.82:0/601057777 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) v1 ==== 134722+0+0 (secure 0 0 0) 0x7fced800d9c0 con 0x7fcee0106940 2023-09-23T08:55:10.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:10.705+0000 7fcedd7fa700 1 --2- 172.21.15.82:0/601057777 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fcecc0a0060 0x7fcecc0a2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:10.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:10.705+0000 7fcedd7fa700 1 -- 172.21.15.82:0/601057777 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fced8006e40 con 0x7fcee0106940 2023-09-23T08:55:10.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:10.705+0000 7fced77fe700 1 --2- 172.21.15.82:0/601057777 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fcecc0a0060 0x7fcecc0a2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:10.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:10.706+0000 7fced77fe700 1 --2- 172.21.15.82:0/601057777 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fcecc0a0060 0x7fcecc0a2520 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fced000b5c0 tx=0x7fced0005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:10.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:10.709+0000 7fcedd7fa700 1 -- 172.21.15.82:0/601057777 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7fced8094c10 con 0x7fcee0106940 2023-09-23T08:55:10.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:10.909+0000 7fcee5f24700 1 -- 172.21.15.82:0/601057777 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcee004e620 con 0x7fcee0106940 2023-09-23T08:55:10.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:10.911+0000 7fcedd7fa700 1 -- 172.21.15.82:0/601057777 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+22132 (secure 0 0 0) 0x7fced8098230 con 0x7fcee0106940 2023-09-23T08:55:10.915 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:55:10.915 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":86,"fsid":"8926e286-59ed-11ee-8db4-212e2dc638e7","created":"2023-09-23T08:46:16.628057+0000","modified":"2023-09-23T08:54:54.081503+0000","last_up_change":"2023-09-23T08:53:56.524694+0000","last_in_change":"2023-09-23T08:53:35.779183+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-23T08:50:00.571063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-23T08:54:50.558630+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-23T08:54:52.055291+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7384c1ff-8c71-4feb-8cef-ba45c2a1708a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":892441948},{"type":"v1","addr":"172.21.15.82:6803","nonce":892441948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":892441948},{"type":"v1","addr":"172.21.15.82:6805","nonce":892441948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":892441948},{"type":"v1","addr":"172.21.15.82:6809","nonce":892441948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":892441948},{"type":"v1","addr":"172.21.15.82:6807","nonce":892441948}]},"public_addr":"172.21.15.82:6803/892441948","cluster_addr":"172.21.15.82:6805/892441948","heartbeat_back_addr":"172.21.15.82:6809/892441948","heartbeat_front_addr":"172.21.15.82:6807/892441948","state":["exists","up"]},{"osd":1,"uuid":"ca62333e-15db-4556-a9ed-8820f9268766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3224546922},{"type":"v1","addr":"172.21.15.135:6801","nonce":3224546922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3224546922},{"type":"v1","addr":"172.21.15.135:6803","nonce":3224546922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3224546922},{"type":"v1","addr":"172.21.15.135:6807","nonce":3224546922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3224546922},{"type":"v1","addr":"172.21.15.135:6805","nonce":3224546922}]},"public_addr":"172.21.15.135:6801/3224546922","cluster_addr":"172.21.15.135:6803/3224546922","heartbeat_back_addr":"172.21.15.135:6807/3224546922","heartbeat_front_addr":"172.21.15.135:6805/3224546922","state":["exists","up"]},{"osd":2,"uuid":"ac23eb38-216a-44f0-b316-a509b23745f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2358373459},{"type":"v1","addr":"172.21.15.161:6801","nonce":2358373459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2358373459},{"type":"v1","addr":"172.21.15.161:6803","nonce":2358373459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2358373459},{"type":"v1","addr":"172.21.15.161:6807","nonce":2358373459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2358373459},{"type":"v1","addr":"172.21.15.161:6805","nonce":2358373459}]},"public_addr":"172.21.15.161:6801/2358373459","cluster_addr":"172.21.15.161:6803/2358373459","heartbeat_back_addr":"172.21.15.161:6807/2358373459","heartbeat_front_addr":"172.21.15.161:6805/2358373459","state":["exists","up"]},{"osd":3,"uuid":"701c96b0-30fb-46ce-917d-e02d3814dc3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":1081464528},{"type":"v1","addr":"172.21.15.82:6811","nonce":1081464528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1081464528},{"type":"v1","addr":"172.21.15.82:6813","nonce":1081464528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1081464528},{"type":"v1","addr":"172.21.15.82:6817","nonce":1081464528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":1081464528},{"type":"v1","addr":"172.21.15.82:6815","nonce":1081464528}]},"public_addr":"172.21.15.82:6811/1081464528","cluster_addr":"172.21.15.82:6813/1081464528","heartbeat_back_addr":"172.21.15.82:6817/1081464528","heartbeat_front_addr":"172.21.15.82:6815/1081464528","state":["exists","up"]},{"osd":4,"uuid":"c618d2a2-3616-41b2-943c-7a4616538e13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2346495509},{"type":"v1","addr":"172.21.15.135:6809","nonce":2346495509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2346495509},{"type":"v1","addr":"172.21.15.135:6811","nonce":2346495509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2346495509},{"type":"v1","addr":"172.21.15.135:6815","nonce":2346495509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2346495509},{"type":"v1","addr":"172.21.15.135:6813","nonce":2346495509}]},"public_addr":"172.21.15.135:6809/2346495509","cluster_addr":"172.21.15.135:6811/2346495509","heartbeat_back_addr":"172.21.15.135:6815/2346495509","heartbeat_front_addr":"172.21.15.135:6813/2346495509","state":["exists","up"]},{"osd":5,"uuid":"8e1dda3d-6927-495d-b20d-78b03bb75d5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1252638628},{"type":"v1","addr":"172.21.15.161:6809","nonce":1252638628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1252638628},{"type":"v1","addr":"172.21.15.161:6811","nonce":1252638628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1252638628},{"type":"v1","addr":"172.21.15.161:6815","nonce":1252638628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1252638628},{"type":"v1","addr":"172.21.15.161:6813","nonce":1252638628}]},"public_addr":"172.21.15.161:6809/1252638628","cluster_addr":"172.21.15.161:6811/1252638628","heartbeat_back_addr":"172.21.15.161:6815/1252638628","heartbeat_front_addr":"172.21.15.161:6813/1252638628","state":["exists","up"]},{"osd":6,"uuid":"50b31960-6bc4-44e1-8116-3106bf161e56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1052038408},{"type":"v1","addr":"172.21.15.82:6819","nonce":1052038408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1052038408},{"type":"v1","addr":"172.21.15.82:6821","nonce":1052038408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":1052038408},{"type":"v1","addr":"172.21.15.82:6825","nonce":1052038408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1052038408},{"type":"v1","addr":"172.21.15.82:6823","nonce":1052038408}]},"public_addr":"172.21.15.82:6819/1052038408","cluster_addr":"172.21.15.82:6821/1052038408","heartbeat_back_addr":"172.21.15.82:6825/1052038408","heartbeat_front_addr":"172.21.15.82:6823/1052038408","state":["exists","up"]},{"osd":7,"uuid":"425ca0ee-57f7-4b27-90fb-d86bb5db5480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3683951498},{"type":"v1","addr":"172.21.15.135:6817","nonce":3683951498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":3683951498},{"type":"v1","addr":"172.21.15.135:6819","nonce":3683951498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":3683951498},{"type":"v1","addr":"172.21.15.135:6823","nonce":3683951498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":3683951498},{"type":"v1","addr":"172.21.15.135:6821","nonce":3683951498}]},"public_addr":"172.21.15.135:6817/3683951498","cluster_addr":"172.21.15.135:6819/3683951498","heartbeat_back_addr":"172.21.15.135:6823/3683951498","heartbeat_front_addr":"172.21.15.135:6821/3683951498","state":["exists","up"]},{"osd":8,"uuid":"1115c837-bef6-4bad-9974-4d913198511b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":948521536},{"type":"v1","addr":"172.21.15.161:6817","nonce":948521536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":948521536},{"type":"v1","addr":"172.21.15.161:6819","nonce":948521536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":948521536},{"type":"v1","addr":"172.21.15.161:6823","nonce":948521536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":948521536},{"type":"v1","addr":"172.21.15.161:6821","nonce":948521536}]},"public_addr":"172.21.15.161:6817/948521536","cluster_addr":"172.21.15.161:6819/948521536","heartbeat_back_addr":"172.21.15.161:6823/948521536","heartbeat_front_addr":"172.21.15.161:6821/948521536","state":["exists","up"]},{"osd":9,"uuid":"c52ec819-4bc6-402f-9cd8-62539e519e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":1438762840},{"type":"v1","addr":"172.21.15.82:6827","nonce":1438762840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":1438762840},{"type":"v1","addr":"172.21.15.82:6829","nonce":1438762840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1438762840},{"type":"v1","addr":"172.21.15.82:6833","nonce":1438762840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1438762840},{"type":"v1","addr":"172.21.15.82:6831","nonce":1438762840}]},"public_addr":"172.21.15.82:6827/1438762840","cluster_addr":"172.21.15.82:6829/1438762840","heartbeat_back_addr":"172.21.15.82:6833/1438762840","heartbeat_front_addr":"172.21.15.82:6831/1438762840","state":["exists","up"]},{"osd":10,"uuid":"1b16c795-1b91-4d46-ae5d-21b8332c1077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2853697851},{"type":"v1","addr":"172.21.15.135:6825","nonce":2853697851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2853697851},{"type":"v1","addr":"172.21.15.135:6827","nonce":2853697851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2853697851},{"type":"v1","addr":"172.21.15.135:6831","nonce":2853697851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2853697851},{"type":"v1","addr":"172.21.15.135:6829","nonce":2853697851}]},"public_addr":"172.21.15.135:6825/2853697851","cluster_addr":"172.21.15.135:6827/2853697851","heartbeat_back_addr":"172.21.15.135:6831/2853697851","heartbeat_front_addr":"172.21.15.135:6829/2853697851","state":["exists","up"]},{"osd":11,"uuid":"2551e602-4fe1-41cb-9b7d-c8b31fdd1487","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":1459332081},{"type":"v1","addr":"172.21.15.161:6825","nonce":1459332081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":1459332081},{"type":"v1","addr":"172.21.15.161:6827","nonce":1459332081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":1459332081},{"type":"v1","addr":"172.21.15.161:6831","nonce":1459332081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":1459332081},{"type":"v1","addr":"172.21.15.161:6829","nonce":1459332081}]},"public_addr":"172.21.15.161:6825/1459332081","cluster_addr":"172.21.15.161:6827/1459332081","heartbeat_back_addr":"172.21.15.161:6831/1459332081","heartbeat_front_addr":"172.21.15.161:6829/1459332081","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:49:04.007679+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:49:30.702365+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:49:56.785248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:50:22.988516+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:50:49.347055+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:51:15.830145+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:51:41.986377+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:52:08.218893+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:52:34.847450+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:53:01.317134+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:53:27.981691+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:53:54.849245+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/4204712132":"2023-09-24T08:47:21.957866+0000","172.21.15.82:6801/2733521564":"2023-09-24T08:47:21.957866+0000","172.21.15.82:6800/2733521564":"2023-09-24T08:47:21.957866+0000","172.21.15.82:0/3964794665":"2023-09-24T08:47:21.957866+0000","172.21.15.82:0/3535372205":"2023-09-24T08:46:55.187024+0000","172.21.15.82:0/285559684":"2023-09-24T08:46:55.187024+0000","172.21.15.82:0/1335891896":"2023-09-24T08:46:55.187024+0000","172.21.15.82:6801/3761509623":"2023-09-24T08:46:55.187024+0000","172.21.15.82:6800/3761509623":"2023-09-24T08:46:55.187024+0000","172.21.15.82:0/3775317005":"2023-09-24T08:47:21.957866+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-23T08:55:10.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:10.913+0000 7fcee5f24700 1 -- 172.21.15.82:0/601057777 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fcecc0a0060 msgr2=0x7fcecc0a2520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:10.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:10.913+0000 7fcee5f24700 1 --2- 172.21.15.82:0/601057777 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fcecc0a0060 0x7fcecc0a2520 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fced000b5c0 tx=0x7fced0005fb0 comp rx=0 tx=0).stop 2023-09-23T08:55:10.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:10.913+0000 7fcee5f24700 1 -- 172.21.15.82:0/601057777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcee0106940 msgr2=0x7fcee00736e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:10.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:10.913+0000 7fcee5f24700 1 --2- 172.21.15.82:0/601057777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcee0106940 0x7fcee00736e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fced800b970 tx=0x7fced800bc80 comp rx=0 tx=0).stop 2023-09-23T08:55:10.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:10.913+0000 7fcee5f24700 1 -- 172.21.15.82:0/601057777 shutdown_connections 2023-09-23T08:55:10.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:10.913+0000 7fcee5f24700 1 --2- 172.21.15.82:0/601057777 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fcecc0a0060 0x7fcecc0a2520 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:10.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:10.913+0000 7fcee5f24700 1 --2- 172.21.15.82:0/601057777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcee0106940 0x7fcee00736e0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:10.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:10.913+0000 7fcee5f24700 1 --2- 172.21.15.82:0/601057777 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcee0100940 0x7fcee0072c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:10.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:10.913+0000 7fcee5f24700 1 --2- 172.21.15.82:0/601057777 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcee0101300 0x7fcee0073160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:10.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:10.913+0000 7fcee5f24700 1 -- 172.21.15.82:0/601057777 >> 172.21.15.82:0/601057777 conn(0x7fcee00fc410 msgr2=0x7fcee00fcc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:10.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:10.913+0000 7fcee5f24700 1 -- 172.21.15.82:0/601057777 shutdown_connections 2023-09-23T08:55:10.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:10.913+0000 7fcee5f24700 1 -- 172.21.15.82:0/601057777 wait complete. 2023-09-23T08:55:11.459 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2023-09-23T08:55:11.460 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- ceph osd dump --format=json 2023-09-23T08:55:11.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:11 smithi135 ceph-mon[99205]: pgmap v310: 97 pgs: 97 active+clean; 624 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 7.3 KiB/s wr, 22 op/s 2023-09-23T08:55:11.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:11 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/601057777' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-23T08:55:11.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:11 smithi082 ceph-mon[97694]: pgmap v310: 97 pgs: 97 active+clean; 624 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 7.3 KiB/s wr, 22 op/s 2023-09-23T08:55:11.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:11 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/601057777' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-23T08:55:11.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:11 smithi161 ceph-mon[99580]: pgmap v310: 97 pgs: 97 active+clean; 624 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 7.3 KiB/s wr, 22 op/s 2023-09-23T08:55:11.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:11 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/601057777' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-23T08:55:12.182 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.a/config 2023-09-23T08:55:13.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:13.731+0000 7fe93c7e2700 1 -- 172.21.15.82:0/387371800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe934106940 msgr2=0x7fe934106d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:13.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:13.731+0000 7fe93c7e2700 1 --2- 172.21.15.82:0/387371800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe934106940 0x7fe934106d20 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe930009990 tx=0x7fe930009ca0 comp rx=0 tx=0).stop 2023-09-23T08:55:13.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:13.731+0000 7fe93c7e2700 1 -- 172.21.15.82:0/387371800 shutdown_connections 2023-09-23T08:55:13.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:13.731+0000 7fe93c7e2700 1 --2- 172.21.15.82:0/387371800 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe934101300 0x7fe93410d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:13.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:13.731+0000 7fe93c7e2700 1 --2- 172.21.15.82:0/387371800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe934106940 0x7fe934106d20 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:13.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:13.731+0000 7fe93c7e2700 1 --2- 172.21.15.82:0/387371800 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe934100940 0x7fe934100dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:13.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:13.731+0000 7fe93c7e2700 1 -- 172.21.15.82:0/387371800 >> 172.21.15.82:0/387371800 conn(0x7fe9340fc410 msgr2=0x7fe9340fe830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:13.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:13.731+0000 7fe93c7e2700 1 -- 172.21.15.82:0/387371800 shutdown_connections 2023-09-23T08:55:13.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:13.731+0000 7fe93c7e2700 1 -- 172.21.15.82:0/387371800 wait complete. 2023-09-23T08:55:13.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:13.733+0000 7fe93c7e2700 1 Processor -- start 2023-09-23T08:55:13.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:13.733+0000 7fe93c7e2700 1 -- start start 2023-09-23T08:55:13.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:13.734+0000 7fe93c7e2700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe934100940 0x7fe93419ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:13.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:13.734+0000 7fe93c7e2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe934101300 0x7fe93419ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:13.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:13.734+0000 7fe93c7e2700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe934106940 0x7fe934198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:13.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:13.734+0000 7fe93c7e2700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9341991c0 con 0x7fe934101300 2023-09-23T08:55:13.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:13.734+0000 7fe93c7e2700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe934199330 con 0x7fe934100940 2023-09-23T08:55:13.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:13.734+0000 7fe93c7e2700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9341994f0 con 0x7fe934106940 2023-09-23T08:55:13.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:13.734+0000 7fe939d7d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe934101300 0x7fe93419ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:13.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:13.734+0000 7fe939d7d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe934101300 0x7fe93419ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56600/0 (socket says 172.21.15.82:56600) 2023-09-23T08:55:13.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:13.734+0000 7fe939d7d700 1 -- 172.21.15.82:0/4231065414 learned_addr learned my addr 172.21.15.82:0/4231065414 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:55:13.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:13.734+0000 7fe93ad7f700 1 --2- 172.21.15.82:0/4231065414 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe934106940 0x7fe934198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:13.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:13.734+0000 7fe93a57e700 1 --2- 172.21.15.82:0/4231065414 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe934100940 0x7fe93419ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:13.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:13.734+0000 7fe939d7d700 1 -- 172.21.15.82:0/4231065414 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe934106940 msgr2=0x7fe934198a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:13.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:13.734+0000 7fe939d7d700 1 --2- 172.21.15.82:0/4231065414 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe934106940 0x7fe934198a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:13.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:13.734+0000 7fe939d7d700 1 -- 172.21.15.82:0/4231065414 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe934100940 msgr2=0x7fe93419ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:13.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:13.734+0000 7fe939d7d700 1 --2- 172.21.15.82:0/4231065414 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe934100940 0x7fe93419ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:13.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:13.734+0000 7fe939d7d700 1 -- 172.21.15.82:0/4231065414 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9300095f0 con 0x7fe934101300 2023-09-23T08:55:13.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:13.734+0000 7fe93ad7f700 1 --2- 172.21.15.82:0/4231065414 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe934106940 0x7fe934198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T08:55:13.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:13.734+0000 7fe93a57e700 1 --2- 172.21.15.82:0/4231065414 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe934100940 0x7fe93419ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T08:55:13.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:13.734+0000 7fe939d7d700 1 --2- 172.21.15.82:0/4231065414 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe934101300 0x7fe93419ef60 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe92400d950 tx=0x7fe92400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:13.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:13.734+0000 7fe92b7fe700 1 -- 172.21.15.82:0/4231065414 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe924009b40 con 0x7fe934101300 2023-09-23T08:55:13.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:13.734+0000 7fe92b7fe700 1 -- 172.21.15.82:0/4231065414 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe924009ca0 con 0x7fe934101300 2023-09-23T08:55:13.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:13.734+0000 7fe92b7fe700 1 -- 172.21.15.82:0/4231065414 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe92400f620 con 0x7fe934101300 2023-09-23T08:55:13.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:13.734+0000 7fe93c7e2700 1 -- 172.21.15.82:0/4231065414 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9341997d0 con 0x7fe934101300 2023-09-23T08:55:13.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:13.734+0000 7fe93c7e2700 1 -- 172.21.15.82:0/4231065414 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9341a59a0 con 0x7fe934101300 2023-09-23T08:55:13.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:13.736+0000 7fe93c7e2700 1 -- 172.21.15.82:0/4231065414 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe93404e620 con 0x7fe934101300 2023-09-23T08:55:13.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:13.737+0000 7fe92b7fe700 1 -- 172.21.15.82:0/4231065414 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) v1 ==== 134722+0+0 (secure 0 0 0) 0x7fe924010460 con 0x7fe934101300 2023-09-23T08:55:13.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:13.739+0000 7fe92b7fe700 1 --2- 172.21.15.82:0/4231065414 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fe9200a0060 0x7fe9200a2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:13.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:13.740+0000 7fe92b7fe700 1 -- 172.21.15.82:0/4231065414 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fe9240cb630 con 0x7fe934101300 2023-09-23T08:55:13.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:13.740+0000 7fe93a57e700 1 --2- 172.21.15.82:0/4231065414 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fe9200a0060 0x7fe9200a2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:13.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:13.740+0000 7fe93a57e700 1 --2- 172.21.15.82:0/4231065414 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fe9200a0060 0x7fe9200a2520 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe93000b5c0 tx=0x7fe930005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:13.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:13.743+0000 7fe92b7fe700 1 -- 172.21.15.82:0/4231065414 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7fe924095310 con 0x7fe934101300 2023-09-23T08:55:13.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:13 smithi135 ceph-mon[99205]: pgmap v311: 97 pgs: 97 active+clean; 634 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.2 KiB/s wr, 22 op/s 2023-09-23T08:55:13.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:13 smithi082 ceph-mon[97694]: pgmap v311: 97 pgs: 97 active+clean; 634 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.2 KiB/s wr, 22 op/s 2023-09-23T08:55:13.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:13 smithi161 ceph-mon[99580]: pgmap v311: 97 pgs: 97 active+clean; 634 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.2 KiB/s wr, 22 op/s 2023-09-23T08:55:13.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:13.944+0000 7fe93c7e2700 1 -- 172.21.15.82:0/4231065414 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe934110a80 con 0x7fe934101300 2023-09-23T08:55:13.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:13.946+0000 7fe92b7fe700 1 -- 172.21.15.82:0/4231065414 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+22132 (secure 0 0 0) 0x7fe924098930 con 0x7fe934101300 2023-09-23T08:55:13.949 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:55:13.949 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":86,"fsid":"8926e286-59ed-11ee-8db4-212e2dc638e7","created":"2023-09-23T08:46:16.628057+0000","modified":"2023-09-23T08:54:54.081503+0000","last_up_change":"2023-09-23T08:53:56.524694+0000","last_in_change":"2023-09-23T08:53:35.779183+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-23T08:50:00.571063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-23T08:54:50.558630+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-23T08:54:52.055291+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7384c1ff-8c71-4feb-8cef-ba45c2a1708a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":892441948},{"type":"v1","addr":"172.21.15.82:6803","nonce":892441948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":892441948},{"type":"v1","addr":"172.21.15.82:6805","nonce":892441948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":892441948},{"type":"v1","addr":"172.21.15.82:6809","nonce":892441948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":892441948},{"type":"v1","addr":"172.21.15.82:6807","nonce":892441948}]},"public_addr":"172.21.15.82:6803/892441948","cluster_addr":"172.21.15.82:6805/892441948","heartbeat_back_addr":"172.21.15.82:6809/892441948","heartbeat_front_addr":"172.21.15.82:6807/892441948","state":["exists","up"]},{"osd":1,"uuid":"ca62333e-15db-4556-a9ed-8820f9268766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3224546922},{"type":"v1","addr":"172.21.15.135:6801","nonce":3224546922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3224546922},{"type":"v1","addr":"172.21.15.135:6803","nonce":3224546922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3224546922},{"type":"v1","addr":"172.21.15.135:6807","nonce":3224546922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3224546922},{"type":"v1","addr":"172.21.15.135:6805","nonce":3224546922}]},"public_addr":"172.21.15.135:6801/3224546922","cluster_addr":"172.21.15.135:6803/3224546922","heartbeat_back_addr":"172.21.15.135:6807/3224546922","heartbeat_front_addr":"172.21.15.135:6805/3224546922","state":["exists","up"]},{"osd":2,"uuid":"ac23eb38-216a-44f0-b316-a509b23745f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2358373459},{"type":"v1","addr":"172.21.15.161:6801","nonce":2358373459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2358373459},{"type":"v1","addr":"172.21.15.161:6803","nonce":2358373459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2358373459},{"type":"v1","addr":"172.21.15.161:6807","nonce":2358373459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2358373459},{"type":"v1","addr":"172.21.15.161:6805","nonce":2358373459}]},"public_addr":"172.21.15.161:6801/2358373459","cluster_addr":"172.21.15.161:6803/2358373459","heartbeat_back_addr":"172.21.15.161:6807/2358373459","heartbeat_front_addr":"172.21.15.161:6805/2358373459","state":["exists","up"]},{"osd":3,"uuid":"701c96b0-30fb-46ce-917d-e02d3814dc3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":1081464528},{"type":"v1","addr":"172.21.15.82:6811","nonce":1081464528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1081464528},{"type":"v1","addr":"172.21.15.82:6813","nonce":1081464528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1081464528},{"type":"v1","addr":"172.21.15.82:6817","nonce":1081464528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":1081464528},{"type":"v1","addr":"172.21.15.82:6815","nonce":1081464528}]},"public_addr":"172.21.15.82:6811/1081464528","cluster_addr":"172.21.15.82:6813/1081464528","heartbeat_back_addr":"172.21.15.82:6817/1081464528","heartbeat_front_addr":"172.21.15.82:6815/1081464528","state":["exists","up"]},{"osd":4,"uuid":"c618d2a2-3616-41b2-943c-7a4616538e13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2346495509},{"type":"v1","addr":"172.21.15.135:6809","nonce":2346495509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2346495509},{"type":"v1","addr":"172.21.15.135:6811","nonce":2346495509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2346495509},{"type":"v1","addr":"172.21.15.135:6815","nonce":2346495509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2346495509},{"type":"v1","addr":"172.21.15.135:6813","nonce":2346495509}]},"public_addr":"172.21.15.135:6809/2346495509","cluster_addr":"172.21.15.135:6811/2346495509","heartbeat_back_addr":"172.21.15.135:6815/2346495509","heartbeat_front_addr":"172.21.15.135:6813/2346495509","state":["exists","up"]},{"osd":5,"uuid":"8e1dda3d-6927-495d-b20d-78b03bb75d5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1252638628},{"type":"v1","addr":"172.21.15.161:6809","nonce":1252638628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1252638628},{"type":"v1","addr":"172.21.15.161:6811","nonce":1252638628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1252638628},{"type":"v1","addr":"172.21.15.161:6815","nonce":1252638628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1252638628},{"type":"v1","addr":"172.21.15.161:6813","nonce":1252638628}]},"public_addr":"172.21.15.161:6809/1252638628","cluster_addr":"172.21.15.161:6811/1252638628","heartbeat_back_addr":"172.21.15.161:6815/1252638628","heartbeat_front_addr":"172.21.15.161:6813/1252638628","state":["exists","up"]},{"osd":6,"uuid":"50b31960-6bc4-44e1-8116-3106bf161e56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1052038408},{"type":"v1","addr":"172.21.15.82:6819","nonce":1052038408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1052038408},{"type":"v1","addr":"172.21.15.82:6821","nonce":1052038408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":1052038408},{"type":"v1","addr":"172.21.15.82:6825","nonce":1052038408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1052038408},{"type":"v1","addr":"172.21.15.82:6823","nonce":1052038408}]},"public_addr":"172.21.15.82:6819/1052038408","cluster_addr":"172.21.15.82:6821/1052038408","heartbeat_back_addr":"172.21.15.82:6825/1052038408","heartbeat_front_addr":"172.21.15.82:6823/1052038408","state":["exists","up"]},{"osd":7,"uuid":"425ca0ee-57f7-4b27-90fb-d86bb5db5480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3683951498},{"type":"v1","addr":"172.21.15.135:6817","nonce":3683951498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":3683951498},{"type":"v1","addr":"172.21.15.135:6819","nonce":3683951498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":3683951498},{"type":"v1","addr":"172.21.15.135:6823","nonce":3683951498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":3683951498},{"type":"v1","addr":"172.21.15.135:6821","nonce":3683951498}]},"public_addr":"172.21.15.135:6817/3683951498","cluster_addr":"172.21.15.135:6819/3683951498","heartbeat_back_addr":"172.21.15.135:6823/3683951498","heartbeat_front_addr":"172.21.15.135:6821/3683951498","state":["exists","up"]},{"osd":8,"uuid":"1115c837-bef6-4bad-9974-4d913198511b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":948521536},{"type":"v1","addr":"172.21.15.161:6817","nonce":948521536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":948521536},{"type":"v1","addr":"172.21.15.161:6819","nonce":948521536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":948521536},{"type":"v1","addr":"172.21.15.161:6823","nonce":948521536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":948521536},{"type":"v1","addr":"172.21.15.161:6821","nonce":948521536}]},"public_addr":"172.21.15.161:6817/948521536","cluster_addr":"172.21.15.161:6819/948521536","heartbeat_back_addr":"172.21.15.161:6823/948521536","heartbeat_front_addr":"172.21.15.161:6821/948521536","state":["exists","up"]},{"osd":9,"uuid":"c52ec819-4bc6-402f-9cd8-62539e519e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":1438762840},{"type":"v1","addr":"172.21.15.82:6827","nonce":1438762840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":1438762840},{"type":"v1","addr":"172.21.15.82:6829","nonce":1438762840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1438762840},{"type":"v1","addr":"172.21.15.82:6833","nonce":1438762840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1438762840},{"type":"v1","addr":"172.21.15.82:6831","nonce":1438762840}]},"public_addr":"172.21.15.82:6827/1438762840","cluster_addr":"172.21.15.82:6829/1438762840","heartbeat_back_addr":"172.21.15.82:6833/1438762840","heartbeat_front_addr":"172.21.15.82:6831/1438762840","state":["exists","up"]},{"osd":10,"uuid":"1b16c795-1b91-4d46-ae5d-21b8332c1077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2853697851},{"type":"v1","addr":"172.21.15.135:6825","nonce":2853697851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2853697851},{"type":"v1","addr":"172.21.15.135:6827","nonce":2853697851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2853697851},{"type":"v1","addr":"172.21.15.135:6831","nonce":2853697851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2853697851},{"type":"v1","addr":"172.21.15.135:6829","nonce":2853697851}]},"public_addr":"172.21.15.135:6825/2853697851","cluster_addr":"172.21.15.135:6827/2853697851","heartbeat_back_addr":"172.21.15.135:6831/2853697851","heartbeat_front_addr":"172.21.15.135:6829/2853697851","state":["exists","up"]},{"osd":11,"uuid":"2551e602-4fe1-41cb-9b7d-c8b31fdd1487","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":1459332081},{"type":"v1","addr":"172.21.15.161:6825","nonce":1459332081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":1459332081},{"type":"v1","addr":"172.21.15.161:6827","nonce":1459332081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":1459332081},{"type":"v1","addr":"172.21.15.161:6831","nonce":1459332081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":1459332081},{"type":"v1","addr":"172.21.15.161:6829","nonce":1459332081}]},"public_addr":"172.21.15.161:6825/1459332081","cluster_addr":"172.21.15.161:6827/1459332081","heartbeat_back_addr":"172.21.15.161:6831/1459332081","heartbeat_front_addr":"172.21.15.161:6829/1459332081","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:49:04.007679+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:49:30.702365+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:49:56.785248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:50:22.988516+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:50:49.347055+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:51:15.830145+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:51:41.986377+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:52:08.218893+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:52:34.847450+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:53:01.317134+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:53:27.981691+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:53:54.849245+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/4204712132":"2023-09-24T08:47:21.957866+0000","172.21.15.82:6801/2733521564":"2023-09-24T08:47:21.957866+0000","172.21.15.82:6800/2733521564":"2023-09-24T08:47:21.957866+0000","172.21.15.82:0/3964794665":"2023-09-24T08:47:21.957866+0000","172.21.15.82:0/3535372205":"2023-09-24T08:46:55.187024+0000","172.21.15.82:0/285559684":"2023-09-24T08:46:55.187024+0000","172.21.15.82:0/1335891896":"2023-09-24T08:46:55.187024+0000","172.21.15.82:6801/3761509623":"2023-09-24T08:46:55.187024+0000","172.21.15.82:6800/3761509623":"2023-09-24T08:46:55.187024+0000","172.21.15.82:0/3775317005":"2023-09-24T08:47:21.957866+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-23T08:55:13.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:13.948+0000 7fe93c7e2700 1 -- 172.21.15.82:0/4231065414 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fe9200a0060 msgr2=0x7fe9200a2520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:13.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:13.948+0000 7fe93c7e2700 1 --2- 172.21.15.82:0/4231065414 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fe9200a0060 0x7fe9200a2520 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe93000b5c0 tx=0x7fe930005fb0 comp rx=0 tx=0).stop 2023-09-23T08:55:13.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:13.948+0000 7fe93c7e2700 1 -- 172.21.15.82:0/4231065414 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe934101300 msgr2=0x7fe93419ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:13.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:13.948+0000 7fe93c7e2700 1 --2- 172.21.15.82:0/4231065414 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe934101300 0x7fe93419ef60 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe92400d950 tx=0x7fe92400dd10 comp rx=0 tx=0).stop 2023-09-23T08:55:13.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:13.948+0000 7fe93c7e2700 1 -- 172.21.15.82:0/4231065414 shutdown_connections 2023-09-23T08:55:13.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:13.948+0000 7fe93c7e2700 1 --2- 172.21.15.82:0/4231065414 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fe9200a0060 0x7fe9200a2520 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:13.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:13.948+0000 7fe93c7e2700 1 --2- 172.21.15.82:0/4231065414 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe934106940 0x7fe934198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:13.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:13.948+0000 7fe93c7e2700 1 --2- 172.21.15.82:0/4231065414 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe934100940 0x7fe93419ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:13.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:13.948+0000 7fe93c7e2700 1 --2- 172.21.15.82:0/4231065414 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe934101300 0x7fe93419ef60 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:13.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:13.948+0000 7fe93c7e2700 1 -- 172.21.15.82:0/4231065414 >> 172.21.15.82:0/4231065414 conn(0x7fe9340fc410 msgr2=0x7fe93410bcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:13.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:13.948+0000 7fe93c7e2700 1 -- 172.21.15.82:0/4231065414 shutdown_connections 2023-09-23T08:55:13.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:13.948+0000 7fe93c7e2700 1 -- 172.21.15.82:0/4231065414 wait complete. 2023-09-23T08:55:14.461 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- ceph tell osd.0 flush_pg_stats 2023-09-23T08:55:14.461 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- ceph tell osd.1 flush_pg_stats 2023-09-23T08:55:14.462 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- ceph tell osd.2 flush_pg_stats 2023-09-23T08:55:14.462 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- ceph tell osd.3 flush_pg_stats 2023-09-23T08:55:14.462 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- ceph tell osd.4 flush_pg_stats 2023-09-23T08:55:14.463 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- ceph tell osd.5 flush_pg_stats 2023-09-23T08:55:14.463 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- ceph tell osd.6 flush_pg_stats 2023-09-23T08:55:14.463 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- ceph tell osd.7 flush_pg_stats 2023-09-23T08:55:14.464 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- ceph tell osd.8 flush_pg_stats 2023-09-23T08:55:14.464 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- ceph tell osd.9 flush_pg_stats 2023-09-23T08:55:14.465 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- ceph tell osd.10 flush_pg_stats 2023-09-23T08:55:14.465 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- ceph tell osd.11 flush_pg_stats 2023-09-23T08:55:14.667 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:14 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/4231065414' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-23T08:55:14.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:14 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/4231065414' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-23T08:55:14.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:14 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/4231065414' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-23T08:55:15.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:15 smithi135 ceph-mon[99205]: pgmap v312: 97 pgs: 97 active+clean; 634 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 2.5 KiB/s wr, 13 op/s 2023-09-23T08:55:15.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:15 smithi082 ceph-mon[97694]: pgmap v312: 97 pgs: 97 active+clean; 634 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 2.5 KiB/s wr, 13 op/s 2023-09-23T08:55:15.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:15 smithi161 ceph-mon[99580]: pgmap v312: 97 pgs: 97 active+clean; 634 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 2.5 KiB/s wr, 13 op/s 2023-09-23T08:55:16.122 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.a/config 2023-09-23T08:55:16.349 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.a/config 2023-09-23T08:55:16.511 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.a/config 2023-09-23T08:55:16.549 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.a/config 2023-09-23T08:55:16.924 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.a/config 2023-09-23T08:55:17.098 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.a/config 2023-09-23T08:55:17.482 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.a/config 2023-09-23T08:55:17.743 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:17 smithi082 ceph-mon[97694]: pgmap v313: 97 pgs: 97 active+clean; 636 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 2.5 KiB/s wr, 12 op/s 2023-09-23T08:55:17.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:17 smithi135 ceph-mon[99205]: pgmap v313: 97 pgs: 97 active+clean; 636 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 2.5 KiB/s wr, 12 op/s 2023-09-23T08:55:17.842 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.a/config 2023-09-23T08:55:17.847 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.a/config 2023-09-23T08:55:17.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:17 smithi161 ceph-mon[99580]: pgmap v313: 97 pgs: 97 active+clean; 636 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 2.5 KiB/s wr, 12 op/s 2023-09-23T08:55:17.988 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.a/config 2023-09-23T08:55:18.417 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.a/config 2023-09-23T08:55:18.816 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:18 smithi082 ceph-mon[97694]: pgmap v314: 97 pgs: 97 active+clean; 636 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2023-09-23T08:55:18.895 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.a/config 2023-09-23T08:55:18.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:18 smithi161 ceph-mon[99580]: pgmap v314: 97 pgs: 97 active+clean; 636 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2023-09-23T08:55:19.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:18 smithi135 ceph-mon[99205]: pgmap v314: 97 pgs: 97 active+clean; 636 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2023-09-23T08:55:21.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:21 smithi082 ceph-mon[97694]: pgmap v315: 97 pgs: 97 active+clean; 636 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2023-09-23T08:55:21.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.068+0000 7f11226ee700 1 -- 172.21.15.82:0/1908029175 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f111c100940 msgr2=0x7f111c100dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:21.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.068+0000 7f11226ee700 1 --2- 172.21.15.82:0/1908029175 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f111c100940 0x7f111c100dc0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f1110009990 tx=0x7f1110009ca0 comp rx=0 tx=0).stop 2023-09-23T08:55:21.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.068+0000 7f11226ee700 1 -- 172.21.15.82:0/1908029175 shutdown_connections 2023-09-23T08:55:21.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.068+0000 7f11226ee700 1 --2- 172.21.15.82:0/1908029175 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f111c101300 0x7f111c10d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:21.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.068+0000 7f11226ee700 1 --2- 172.21.15.82:0/1908029175 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f111c106940 0x7f111c106d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:21.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.068+0000 7f11226ee700 1 --2- 172.21.15.82:0/1908029175 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f111c100940 0x7f111c100dc0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:21.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.068+0000 7f11226ee700 1 -- 172.21.15.82:0/1908029175 >> 172.21.15.82:0/1908029175 conn(0x7f111c0fc410 msgr2=0x7f111c0fe830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:21.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.068+0000 7f11226ee700 1 -- 172.21.15.82:0/1908029175 shutdown_connections 2023-09-23T08:55:21.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.068+0000 7f11226ee700 1 -- 172.21.15.82:0/1908029175 wait complete. 2023-09-23T08:55:21.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.070+0000 7f11226ee700 1 Processor -- start 2023-09-23T08:55:21.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.070+0000 7f11226ee700 1 -- start start 2023-09-23T08:55:21.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.071+0000 7f11226ee700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f111c100940 0x7f111c19c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:21.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.071+0000 7f11226ee700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f111c101300 0x7f111c19cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:21.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.071+0000 7f11226ee700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f111c106940 0x7f111c196860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:21.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.071+0000 7f11226ee700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f111c196ed0 con 0x7f111c101300 2023-09-23T08:55:21.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.071+0000 7f11226ee700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f111c197040 con 0x7f111c106940 2023-09-23T08:55:21.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.071+0000 7f11226ee700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f111c197200 con 0x7f111c100940 2023-09-23T08:55:21.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.071+0000 7f111b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f111c101300 0x7f111c19cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:21.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.071+0000 7f111b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f111c101300 0x7f111c19cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56630/0 (socket says 172.21.15.82:56630) 2023-09-23T08:55:21.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.071+0000 7f111b7fe700 1 -- 172.21.15.82:0/61620985 learned_addr learned my addr 172.21.15.82:0/61620985 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:55:21.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.071+0000 7f111bfff700 1 --2- 172.21.15.82:0/61620985 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f111c100940 0x7f111c19c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:21.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.071+0000 7f1120c8b700 1 --2- 172.21.15.82:0/61620985 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f111c106940 0x7f111c196860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:21.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.071+0000 7f111b7fe700 1 -- 172.21.15.82:0/61620985 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f111c100940 msgr2=0x7f111c19c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:21.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.071+0000 7f111b7fe700 1 --2- 172.21.15.82:0/61620985 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f111c100940 0x7f111c19c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:21.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.071+0000 7f111b7fe700 1 -- 172.21.15.82:0/61620985 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f111c106940 msgr2=0x7f111c196860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:21.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.071+0000 7f111b7fe700 1 --2- 172.21.15.82:0/61620985 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f111c106940 0x7f111c196860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:21.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.071+0000 7f111b7fe700 1 -- 172.21.15.82:0/61620985 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11100095f0 con 0x7f111c101300 2023-09-23T08:55:21.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.071+0000 7f1120c8b700 1 --2- 172.21.15.82:0/61620985 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f111c106940 0x7f111c196860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T08:55:21.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.072+0000 7f111b7fe700 1 --2- 172.21.15.82:0/61620985 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f111c101300 0x7f111c19cd20 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1110005910 tx=0x7f1110009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:21.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.072+0000 7f11197fa700 1 -- 172.21.15.82:0/61620985 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f111001d070 con 0x7f111c101300 2023-09-23T08:55:21.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.072+0000 7f11197fa700 1 -- 172.21.15.82:0/61620985 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1110003ec0 con 0x7f111c101300 2023-09-23T08:55:21.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.072+0000 7f11226ee700 1 -- 172.21.15.82:0/61620985 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f111c197480 con 0x7f111c101300 2023-09-23T08:55:21.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.072+0000 7f11197fa700 1 -- 172.21.15.82:0/61620985 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f111000fb50 con 0x7f111c101300 2023-09-23T08:55:21.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.072+0000 7f11226ee700 1 -- 172.21.15.82:0/61620985 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f111c1a37d0 con 0x7f111c101300 2023-09-23T08:55:21.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.073+0000 7f11226ee700 1 -- 172.21.15.82:0/61620985 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f111c04e620 con 0x7f111c101300 2023-09-23T08:55:21.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.075+0000 7f11197fa700 1 -- 172.21.15.82:0/61620985 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) v1 ==== 134722+0+0 (secure 0 0 0) 0x7f1110004030 con 0x7f111c101300 2023-09-23T08:55:21.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.077+0000 7f11197fa700 1 --2- 172.21.15.82:0/61620985 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f110409ffe0 0x7f11040a24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:21.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.077+0000 7f11197fa700 1 -- 172.21.15.82:0/61620985 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f11100cc820 con 0x7f111c101300 2023-09-23T08:55:21.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.077+0000 7f111bfff700 1 --2- 172.21.15.82:0/61620985 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f110409ffe0 0x7f11040a24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:21.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.077+0000 7f11197fa700 1 --2- 172.21.15.82:0/61620985 >> [v2:172.21.15.135:6808/2346495509,v1:172.21.15.135:6809/2346495509] conn(0x7f11040a97c0 0x7f11040abbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:21.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.077+0000 7f11197fa700 1 -- 172.21.15.82:0/61620985 --> [v2:172.21.15.135:6808/2346495509,v1:172.21.15.135:6809/2346495509] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f11040ac290 con 0x7f11040a97c0 2023-09-23T08:55:21.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.077+0000 7f11197fa700 1 -- 172.21.15.82:0/61620985 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7f11100ccb90 con 0x7f111c101300 2023-09-23T08:55:21.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.078+0000 7f111bfff700 1 --2- 172.21.15.82:0/61620985 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f110409ffe0 0x7f11040a24a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f110c009a10 tx=0x7f110c009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:21.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.078+0000 7f1120c8b700 1 --2- 172.21.15.82:0/61620985 >> [v2:172.21.15.135:6808/2346495509,v1:172.21.15.135:6809/2346495509] conn(0x7f11040a97c0 0x7f11040abbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:21.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.078+0000 7f1120c8b700 1 --2- 172.21.15.82:0/61620985 >> [v2:172.21.15.135:6808/2346495509,v1:172.21.15.135:6809/2346495509] conn(0x7f11040a97c0 0x7f11040abbe0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:21.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.079+0000 7f11197fa700 1 -- 172.21.15.82:0/61620985 <== osd.4 v2:172.21.15.135:6808/2346495509 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f11040ac290 con 0x7f11040a97c0 2023-09-23T08:55:21.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.096+0000 7f11226ee700 1 -- 172.21.15.82:0/61620985 --> [v2:172.21.15.135:6808/2346495509,v1:172.21.15.135:6809/2346495509] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f111c110b30 con 0x7f11040a97c0 2023-09-23T08:55:21.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.097+0000 7f11197fa700 1 -- 172.21.15.82:0/61620985 <== osd.4 v2:172.21.15.135:6808/2346495509 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f11140099e0 con 0x7f11040a97c0 2023-09-23T08:55:21.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.097+0000 7f11226ee700 1 -- 172.21.15.82:0/61620985 >> [v2:172.21.15.135:6808/2346495509,v1:172.21.15.135:6809/2346495509] conn(0x7f11040a97c0 msgr2=0x7f11040abbe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:21.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.097+0000 7f11226ee700 1 --2- 172.21.15.82:0/61620985 >> [v2:172.21.15.135:6808/2346495509,v1:172.21.15.135:6809/2346495509] conn(0x7f11040a97c0 0x7f11040abbe0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:21.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.097+0000 7f11226ee700 1 -- 172.21.15.82:0/61620985 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f110409ffe0 msgr2=0x7f11040a24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:21.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.097+0000 7f11226ee700 1 --2- 172.21.15.82:0/61620985 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f110409ffe0 0x7f11040a24a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f110c009a10 tx=0x7f110c009190 comp rx=0 tx=0).stop 2023-09-23T08:55:21.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.097+0000 7f11226ee700 1 -- 172.21.15.82:0/61620985 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f111c101300 msgr2=0x7f111c19cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:21.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.097+0000 7f11226ee700 1 --2- 172.21.15.82:0/61620985 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f111c101300 0x7f111c19cd20 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1110005910 tx=0x7f1110009580 comp rx=0 tx=0).stop 2023-09-23T08:55:21.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.097+0000 7f1120c8b700 1 -- 172.21.15.82:0/61620985 reap_dead start 2023-09-23T08:55:21.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.097+0000 7f11226ee700 1 -- 172.21.15.82:0/61620985 shutdown_connections 2023-09-23T08:55:21.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.097+0000 7f11226ee700 1 -- 172.21.15.82:0/61620985 >> 172.21.15.82:0/61620985 conn(0x7f111c0fc410 msgr2=0x7f111c104450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:21.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.097+0000 7f11226ee700 1 -- 172.21.15.82:0/61620985 shutdown_connections 2023-09-23T08:55:21.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.097+0000 7f11226ee700 1 -- 172.21.15.82:0/61620985 wait complete. 2023-09-23T08:55:21.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:21 smithi161 ceph-mon[99580]: pgmap v315: 97 pgs: 97 active+clean; 636 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2023-09-23T08:55:21.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:21 smithi135 ceph-mon[99205]: pgmap v315: 97 pgs: 97 active+clean; 636 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2023-09-23T08:55:21.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.493+0000 7f09041dc700 1 -- 172.21.15.82:0/276880090 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08fc101300 msgr2=0x7f08fc10d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:21.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.493+0000 7f09041dc700 1 --2- 172.21.15.82:0/276880090 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08fc101300 0x7f08fc10d810 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f08f400b0a0 tx=0x7f08f400b3b0 comp rx=0 tx=0).stop 2023-09-23T08:55:21.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.493+0000 7f09041dc700 1 -- 172.21.15.82:0/276880090 shutdown_connections 2023-09-23T08:55:21.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.493+0000 7f09041dc700 1 --2- 172.21.15.82:0/276880090 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08fc101300 0x7f08fc10d810 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:21.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.493+0000 7f09041dc700 1 --2- 172.21.15.82:0/276880090 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08fc106940 0x7f08fc106d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:21.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.493+0000 7f09041dc700 1 --2- 172.21.15.82:0/276880090 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08fc100940 0x7f08fc100dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:21.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.493+0000 7f09041dc700 1 -- 172.21.15.82:0/276880090 >> 172.21.15.82:0/276880090 conn(0x7f08fc0fc410 msgr2=0x7f08fc0fe830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:21.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.494+0000 7f09041dc700 1 -- 172.21.15.82:0/276880090 shutdown_connections 2023-09-23T08:55:21.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.494+0000 7f09041dc700 1 -- 172.21.15.82:0/276880090 wait complete. 2023-09-23T08:55:21.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.495+0000 7f09041dc700 1 Processor -- start 2023-09-23T08:55:21.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.496+0000 7f09041dc700 1 -- start start 2023-09-23T08:55:21.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.496+0000 7f09041dc700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08fc100940 0x7f08fc072c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:21.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.496+0000 7f09041dc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08fc101300 0x7f08fc073160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:21.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.496+0000 7f09041dc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08fc106940 0x7f08fc0736e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:21.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.496+0000 7f09041dc700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08fc1a4ec0 con 0x7f08fc101300 2023-09-23T08:55:21.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.496+0000 7f09041dc700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08fc1a5030 con 0x7f08fc106940 2023-09-23T08:55:21.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.496+0000 7f09041dc700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08fc1a51f0 con 0x7f08fc100940 2023-09-23T08:55:21.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.497+0000 7f0901777700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08fc101300 0x7f08fc073160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:21.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.497+0000 7f0901777700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08fc101300 0x7f08fc073160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56636/0 (socket says 172.21.15.82:56636) 2023-09-23T08:55:21.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.497+0000 7f0901777700 1 -- 172.21.15.82:0/1822843495 learned_addr learned my addr 172.21.15.82:0/1822843495 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:55:21.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.497+0000 7f0902779700 1 --2- 172.21.15.82:0/1822843495 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08fc106940 0x7f08fc0736e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:21.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.497+0000 7f0901f78700 1 --2- 172.21.15.82:0/1822843495 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08fc100940 0x7f08fc072c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:21.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.497+0000 7f0901777700 1 -- 172.21.15.82:0/1822843495 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08fc100940 msgr2=0x7f08fc072c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:21.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.497+0000 7f0901777700 1 --2- 172.21.15.82:0/1822843495 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08fc100940 0x7f08fc072c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:21.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.497+0000 7f0901777700 1 -- 172.21.15.82:0/1822843495 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08fc106940 msgr2=0x7f08fc0736e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:21.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.497+0000 7f0901777700 1 --2- 172.21.15.82:0/1822843495 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08fc106940 0x7f08fc0736e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:21.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.497+0000 7f0901777700 1 -- 172.21.15.82:0/1822843495 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f4009d00 con 0x7f08fc101300 2023-09-23T08:55:21.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.497+0000 7f0901777700 1 --2- 172.21.15.82:0/1822843495 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08fc101300 0x7f08fc073160 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f08ec00e9a0 tx=0x7f08ec00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:21.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.498+0000 7f08f2ffd700 1 -- 172.21.15.82:0/1822843495 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08ec009790 con 0x7f08fc101300 2023-09-23T08:55:21.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.498+0000 7f09041dc700 1 -- 172.21.15.82:0/1822843495 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08fc1a54d0 con 0x7f08fc101300 2023-09-23T08:55:21.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.498+0000 7f08f2ffd700 1 -- 172.21.15.82:0/1822843495 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f08ec010430 con 0x7f08fc101300 2023-09-23T08:55:21.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.498+0000 7f08f2ffd700 1 -- 172.21.15.82:0/1822843495 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08ec00cea0 con 0x7f08fc101300 2023-09-23T08:55:21.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.498+0000 7f09041dc700 1 -- 172.21.15.82:0/1822843495 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08fc1a5a20 con 0x7f08fc101300 2023-09-23T08:55:21.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.499+0000 7f09041dc700 1 -- 172.21.15.82:0/1822843495 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f08fc04e620 con 0x7f08fc101300 2023-09-23T08:55:21.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.502+0000 7f08f2ffd700 1 -- 172.21.15.82:0/1822843495 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) v1 ==== 134722+0+0 (secure 0 0 0) 0x7f08ec0105a0 con 0x7f08fc101300 2023-09-23T08:55:21.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.503+0000 7f08f2ffd700 1 --2- 172.21.15.82:0/1822843495 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f08e80a0060 0x7f08e80a2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:21.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.503+0000 7f08f2ffd700 1 -- 172.21.15.82:0/1822843495 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f08ec014070 con 0x7f08fc101300 2023-09-23T08:55:21.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.503+0000 7f0901f78700 1 --2- 172.21.15.82:0/1822843495 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f08e80a0060 0x7f08e80a2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:21.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.504+0000 7f08f2ffd700 1 --2- 172.21.15.82:0/1822843495 >> [v2:172.21.15.161:6800/2358373459,v1:172.21.15.161:6801/2358373459] conn(0x7f08e80a9840 0x7f08e80abc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:21.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.504+0000 7f08f2ffd700 1 -- 172.21.15.82:0/1822843495 --> [v2:172.21.15.161:6800/2358373459,v1:172.21.15.161:6801/2358373459] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f08e80ac310 con 0x7f08e80a9840 2023-09-23T08:55:21.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.504+0000 7f08f2ffd700 1 -- 172.21.15.82:0/1822843495 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7f08ec0cbae0 con 0x7f08fc101300 2023-09-23T08:55:21.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.504+0000 7f0901f78700 1 --2- 172.21.15.82:0/1822843495 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f08e80a0060 0x7f08e80a2520 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f08f8009be0 tx=0x7f08f8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:21.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.504+0000 7f0902779700 1 --2- 172.21.15.82:0/1822843495 >> [v2:172.21.15.161:6800/2358373459,v1:172.21.15.161:6801/2358373459] conn(0x7f08e80a9840 0x7f08e80abc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:21.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.505+0000 7f0902779700 1 --2- 172.21.15.82:0/1822843495 >> [v2:172.21.15.161:6800/2358373459,v1:172.21.15.161:6801/2358373459] conn(0x7f08e80a9840 0x7f08e80abc60 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:21.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.506+0000 7f08f2ffd700 1 -- 172.21.15.82:0/1822843495 <== osd.2 v2:172.21.15.161:6800/2358373459 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f08e80ac310 con 0x7f08e80a9840 2023-09-23T08:55:21.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.523+0000 7f09041dc700 1 -- 172.21.15.82:0/1822843495 --> [v2:172.21.15.161:6800/2358373459,v1:172.21.15.161:6801/2358373459] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f08fc110ae0 con 0x7f08e80a9840 2023-09-23T08:55:21.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.524+0000 7f08f2ffd700 1 -- 172.21.15.82:0/1822843495 <== osd.2 v2:172.21.15.161:6800/2358373459 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f08f4009b80 con 0x7f08e80a9840 2023-09-23T08:55:21.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.524+0000 7f09041dc700 1 -- 172.21.15.82:0/1822843495 >> [v2:172.21.15.161:6800/2358373459,v1:172.21.15.161:6801/2358373459] conn(0x7f08e80a9840 msgr2=0x7f08e80abc60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:21.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.524+0000 7f09041dc700 1 --2- 172.21.15.82:0/1822843495 >> [v2:172.21.15.161:6800/2358373459,v1:172.21.15.161:6801/2358373459] conn(0x7f08e80a9840 0x7f08e80abc60 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:21.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.524+0000 7f09041dc700 1 -- 172.21.15.82:0/1822843495 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f08e80a0060 msgr2=0x7f08e80a2520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:21.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.524+0000 7f09041dc700 1 --2- 172.21.15.82:0/1822843495 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f08e80a0060 0x7f08e80a2520 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f08f8009be0 tx=0x7f08f8009260 comp rx=0 tx=0).stop 2023-09-23T08:55:21.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.525+0000 7f09041dc700 1 -- 172.21.15.82:0/1822843495 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08fc101300 msgr2=0x7f08fc073160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:21.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.525+0000 7f09041dc700 1 --2- 172.21.15.82:0/1822843495 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08fc101300 0x7f08fc073160 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f08ec00e9a0 tx=0x7f08ec00ecb0 comp rx=0 tx=0).stop 2023-09-23T08:55:21.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.525+0000 7f0902779700 1 -- 172.21.15.82:0/1822843495 reap_dead start 2023-09-23T08:55:21.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.525+0000 7f09041dc700 1 -- 172.21.15.82:0/1822843495 shutdown_connections 2023-09-23T08:55:21.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.525+0000 7f09041dc700 1 -- 172.21.15.82:0/1822843495 >> 172.21.15.82:0/1822843495 conn(0x7f08fc0fc410 msgr2=0x7f08fc0fc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:21.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.525+0000 7f09041dc700 1 -- 172.21.15.82:0/1822843495 shutdown_connections 2023-09-23T08:55:21.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:21.525+0000 7f09041dc700 1 -- 172.21.15.82:0/1822843495 wait complete. 2023-09-23T08:55:22.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:22.124+0000 7fa03b7ad700 1 -- 172.21.15.82:0/2794141226 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa034100940 msgr2=0x7fa034100dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:22.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:22.124+0000 7fa03b7ad700 1 --2- 172.21.15.82:0/2794141226 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa034100940 0x7fa034100dc0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fa024009990 tx=0x7fa024009ca0 comp rx=0 tx=0).stop 2023-09-23T08:55:22.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:22.124+0000 7fa03b7ad700 1 -- 172.21.15.82:0/2794141226 shutdown_connections 2023-09-23T08:55:22.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:22.124+0000 7fa03b7ad700 1 --2- 172.21.15.82:0/2794141226 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa034101300 0x7fa03410d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:22.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:22.124+0000 7fa03b7ad700 1 --2- 172.21.15.82:0/2794141226 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa034106940 0x7fa034106d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:22.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:22.124+0000 7fa03b7ad700 1 --2- 172.21.15.82:0/2794141226 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa034100940 0x7fa034100dc0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:22.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:22.124+0000 7fa03b7ad700 1 -- 172.21.15.82:0/2794141226 >> 172.21.15.82:0/2794141226 conn(0x7fa0340fc410 msgr2=0x7fa0340fe830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:22.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:22.124+0000 7fa03b7ad700 1 -- 172.21.15.82:0/2794141226 shutdown_connections 2023-09-23T08:55:22.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:22.124+0000 7fa03b7ad700 1 -- 172.21.15.82:0/2794141226 wait complete. 2023-09-23T08:55:22.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:22.125+0000 7fa03b7ad700 1 Processor -- start 2023-09-23T08:55:22.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:22.126+0000 7fa03b7ad700 1 -- start start 2023-09-23T08:55:22.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:22.126+0000 7fa03b7ad700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa034100940 0x7fa034072c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:22.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:22.126+0000 7fa03b7ad700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa034101300 0x7fa034073160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:22.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:22.126+0000 7fa03b7ad700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa034106940 0x7fa0340736e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:22.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:22.126+0000 7fa03b7ad700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0341a4eb0 con 0x7fa034101300 2023-09-23T08:55:22.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:22.126+0000 7fa03b7ad700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0341a5020 con 0x7fa034106940 2023-09-23T08:55:22.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:22.126+0000 7fa03b7ad700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0341a51e0 con 0x7fa034100940 2023-09-23T08:55:22.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:22.126+0000 7fa038d48700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa034101300 0x7fa034073160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:22.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:22.126+0000 7fa038d48700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa034101300 0x7fa034073160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34818/0 (socket says 172.21.15.82:34818) 2023-09-23T08:55:22.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:22.126+0000 7fa038d48700 1 -- 172.21.15.82:0/3906153601 learned_addr learned my addr 172.21.15.82:0/3906153601 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:55:22.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:22.126+0000 7fa039549700 1 --2- 172.21.15.82:0/3906153601 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa034100940 0x7fa034072c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:22.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:22.127+0000 7fa039d4a700 1 --2- 172.21.15.82:0/3906153601 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa034106940 0x7fa0340736e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:22.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:22.127+0000 7fa038d48700 1 -- 172.21.15.82:0/3906153601 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa034100940 msgr2=0x7fa034072c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:22.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:22.127+0000 7fa038d48700 1 --2- 172.21.15.82:0/3906153601 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa034100940 0x7fa034072c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:22.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:22.127+0000 7fa038d48700 1 -- 172.21.15.82:0/3906153601 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa034106940 msgr2=0x7fa0340736e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:22.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:22.127+0000 7fa038d48700 1 --2- 172.21.15.82:0/3906153601 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa034106940 0x7fa0340736e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:22.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:22.127+0000 7fa038d48700 1 -- 172.21.15.82:0/3906153601 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0240095f0 con 0x7fa034101300 2023-09-23T08:55:22.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:22.127+0000 7fa039d4a700 1 --2- 172.21.15.82:0/3906153601 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa034106940 0x7fa0340736e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T08:55:22.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:22.127+0000 7fa038d48700 1 --2- 172.21.15.82:0/3906153601 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa034101300 0x7fa034073160 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fa024005910 tx=0x7fa024009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:22.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:22.127+0000 7fa02a7fc700 1 -- 172.21.15.82:0/3906153601 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa02401d070 con 0x7fa034101300 2023-09-23T08:55:22.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:22.127+0000 7fa03b7ad700 1 -- 172.21.15.82:0/3906153601 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0341a5460 con 0x7fa034101300 2023-09-23T08:55:22.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:22.127+0000 7fa02a7fc700 1 -- 172.21.15.82:0/3906153601 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa024003f40 con 0x7fa034101300 2023-09-23T08:55:22.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:22.127+0000 7fa02a7fc700 1 -- 172.21.15.82:0/3906153601 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa02400fc60 con 0x7fa034101300 2023-09-23T08:55:22.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:22.127+0000 7fa03b7ad700 1 -- 172.21.15.82:0/3906153601 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0341a58d0 con 0x7fa034101300 2023-09-23T08:55:22.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:22.128+0000 7fa03b7ad700 1 -- 172.21.15.82:0/3906153601 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa03404e620 con 0x7fa034101300 2023-09-23T08:55:22.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:22.130+0000 7fa02a7fc700 1 -- 172.21.15.82:0/3906153601 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) v1 ==== 134722+0+0 (secure 0 0 0) 0x7fa0240040b0 con 0x7fa034101300 2023-09-23T08:55:22.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:22.132+0000 7fa02a7fc700 1 --2- 172.21.15.82:0/3906153601 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fa02009ffe0 0x7fa0200a24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:22.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:22.132+0000 7fa02a7fc700 1 -- 172.21.15.82:0/3906153601 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fa0240cc730 con 0x7fa034101300 2023-09-23T08:55:22.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:22.132+0000 7fa039549700 1 --2- 172.21.15.82:0/3906153601 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fa02009ffe0 0x7fa0200a24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:22.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:22.132+0000 7fa02a7fc700 1 --2- 172.21.15.82:0/3906153601 >> [v2:172.21.15.161:6816/948521536,v1:172.21.15.161:6817/948521536] conn(0x7fa0200a97c0 0x7fa0200abbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:22.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:22.132+0000 7fa02a7fc700 1 -- 172.21.15.82:0/3906153601 --> [v2:172.21.15.161:6816/948521536,v1:172.21.15.161:6817/948521536] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa0200ac290 con 0x7fa0200a97c0 2023-09-23T08:55:22.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:22.132+0000 7fa02a7fc700 1 -- 172.21.15.82:0/3906153601 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa0240ccaa0 con 0x7fa034101300 2023-09-23T08:55:22.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:22.132+0000 7fa039549700 1 --2- 172.21.15.82:0/3906153601 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fa02009ffe0 0x7fa0200a24a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa030005950 tx=0x7fa0300058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:22.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:22.132+0000 7fa039d4a700 1 --2- 172.21.15.82:0/3906153601 >> [v2:172.21.15.161:6816/948521536,v1:172.21.15.161:6817/948521536] conn(0x7fa0200a97c0 0x7fa0200abbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:22.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:22.133+0000 7fa039d4a700 1 --2- 172.21.15.82:0/3906153601 >> [v2:172.21.15.161:6816/948521536,v1:172.21.15.161:6817/948521536] conn(0x7fa0200a97c0 0x7fa0200abbe0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:22.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:22.134+0000 7fa02a7fc700 1 -- 172.21.15.82:0/3906153601 <== osd.8 v2:172.21.15.161:6816/948521536 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fa0200ac290 con 0x7fa0200a97c0 2023-09-23T08:55:22.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:22.151+0000 7fa03b7ad700 1 -- 172.21.15.82:0/3906153601 --> [v2:172.21.15.161:6816/948521536,v1:172.21.15.161:6817/948521536] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa034110b30 con 0x7fa0200a97c0 2023-09-23T08:55:22.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:22.152+0000 7fa02a7fc700 1 -- 172.21.15.82:0/3906153601 <== osd.8 v2:172.21.15.161:6816/948521536 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fa02c007a00 con 0x7fa0200a97c0 2023-09-23T08:55:22.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:22.152+0000 7fa03b7ad700 1 -- 172.21.15.82:0/3906153601 >> [v2:172.21.15.161:6816/948521536,v1:172.21.15.161:6817/948521536] conn(0x7fa0200a97c0 msgr2=0x7fa0200abbe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:22.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:22.152+0000 7fa03b7ad700 1 --2- 172.21.15.82:0/3906153601 >> [v2:172.21.15.161:6816/948521536,v1:172.21.15.161:6817/948521536] conn(0x7fa0200a97c0 0x7fa0200abbe0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:22.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:22.152+0000 7fa03b7ad700 1 -- 172.21.15.82:0/3906153601 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fa02009ffe0 msgr2=0x7fa0200a24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:22.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:22.152+0000 7fa03b7ad700 1 --2- 172.21.15.82:0/3906153601 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fa02009ffe0 0x7fa0200a24a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa030005950 tx=0x7fa0300058e0 comp rx=0 tx=0).stop 2023-09-23T08:55:22.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:22.152+0000 7fa03b7ad700 1 -- 172.21.15.82:0/3906153601 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa034101300 msgr2=0x7fa034073160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:22.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:22.152+0000 7fa03b7ad700 1 --2- 172.21.15.82:0/3906153601 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa034101300 0x7fa034073160 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fa024005910 tx=0x7fa024009580 comp rx=0 tx=0).stop 2023-09-23T08:55:22.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:22.152+0000 7fa039d4a700 1 -- 172.21.15.82:0/3906153601 reap_dead start 2023-09-23T08:55:22.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:22.152+0000 7fa03b7ad700 1 -- 172.21.15.82:0/3906153601 shutdown_connections 2023-09-23T08:55:22.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:22.152+0000 7fa03b7ad700 1 -- 172.21.15.82:0/3906153601 >> 172.21.15.82:0/3906153601 conn(0x7fa0340fc410 msgr2=0x7fa0340fca80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:22.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:22.152+0000 7fa03b7ad700 1 -- 172.21.15.82:0/3906153601 shutdown_connections 2023-09-23T08:55:22.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:22.152+0000 7fa03b7ad700 1 -- 172.21.15.82:0/3906153601 wait complete. 2023-09-23T08:55:22.554 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:22 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11]}]: dispatch 2023-09-23T08:55:22.555 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:22 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]: dispatch 2023-09-23T08:55:22.555 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:22 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]: dispatch 2023-09-23T08:55:22.555 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:22 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]: dispatch 2023-09-23T08:55:22.555 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:22 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]: dispatch 2023-09-23T08:55:22.555 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:22 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]: dispatch 2023-09-23T08:55:22.555 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:22 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]: dispatch 2023-09-23T08:55:22.555 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:22 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]: dispatch 2023-09-23T08:55:22.768 INFO:teuthology.orchestra.run.smithi082.stdout:146028888121 2023-09-23T08:55:22.768 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- ceph osd last-stat-seq osd.4 2023-09-23T08:55:22.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:22 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11]}]: dispatch 2023-09-23T08:55:22.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:22 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]: dispatch 2023-09-23T08:55:22.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:22 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]: dispatch 2023-09-23T08:55:22.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:22 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]: dispatch 2023-09-23T08:55:22.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:22 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]: dispatch 2023-09-23T08:55:22.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:22 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]: dispatch 2023-09-23T08:55:22.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:22 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]: dispatch 2023-09-23T08:55:22.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:22 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]: dispatch 2023-09-23T08:55:22.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:22 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11]}]: dispatch 2023-09-23T08:55:22.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:22 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]: dispatch 2023-09-23T08:55:22.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:22 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]: dispatch 2023-09-23T08:55:22.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:22 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]: dispatch 2023-09-23T08:55:22.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:22 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]: dispatch 2023-09-23T08:55:22.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:22 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]: dispatch 2023-09-23T08:55:22.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:22 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]: dispatch 2023-09-23T08:55:22.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:22 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]: dispatch 2023-09-23T08:55:23.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:23 smithi135 ceph-mon[99205]: pgmap v316: 97 pgs: 97 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 1.8 KiB/s wr, 12 op/s 2023-09-23T08:55:23.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:23 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11]}]': finished 2023-09-23T08:55:23.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:23 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2023-09-23T08:55:23.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:23 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]': finished 2023-09-23T08:55:23.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:23 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]': finished 2023-09-23T08:55:23.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:23 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2023-09-23T08:55:23.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:23 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]': finished 2023-09-23T08:55:23.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:23 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]': finished 2023-09-23T08:55:23.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:23 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2023-09-23T08:55:23.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:23 smithi135 ceph-mon[99205]: osdmap e87: 12 total, 12 up, 12 in 2023-09-23T08:55:23.825 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:23 smithi082 ceph-mon[97694]: pgmap v316: 97 pgs: 97 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 1.8 KiB/s wr, 12 op/s 2023-09-23T08:55:23.825 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:23 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11]}]': finished 2023-09-23T08:55:23.825 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:23 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2023-09-23T08:55:23.825 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:23 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]': finished 2023-09-23T08:55:23.825 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:23 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]': finished 2023-09-23T08:55:23.826 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:23 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2023-09-23T08:55:23.826 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:23 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]': finished 2023-09-23T08:55:23.826 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:23 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]': finished 2023-09-23T08:55:23.826 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:23 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2023-09-23T08:55:23.826 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:23 smithi082 ceph-mon[97694]: osdmap e87: 12 total, 12 up, 12 in 2023-09-23T08:55:23.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:23.775+0000 7fa1e3064700 1 -- 172.21.15.82:0/2196273044 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1dc072d50 msgr2=0x7fa1dc073130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:23.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:23.775+0000 7fa1e3064700 1 --2- 172.21.15.82:0/2196273044 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1dc072d50 0x7fa1dc073130 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa1d0009990 tx=0x7fa1d0009ca0 comp rx=0 tx=0).stop 2023-09-23T08:55:23.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:23.776+0000 7fa1e3064700 1 -- 172.21.15.82:0/2196273044 shutdown_connections 2023-09-23T08:55:23.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:23.776+0000 7fa1e3064700 1 --2- 172.21.15.82:0/2196273044 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa1dc10d180 0x7fa1dc10f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:23.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:23.776+0000 7fa1e3064700 1 --2- 172.21.15.82:0/2196273044 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1dc072d50 0x7fa1dc073130 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:23.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:23.776+0000 7fa1e3064700 1 --2- 172.21.15.82:0/2196273044 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1dc073670 0x7fa1dc10cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:23.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:23.776+0000 7fa1e3064700 1 -- 172.21.15.82:0/2196273044 >> 172.21.15.82:0/2196273044 conn(0x7fa1dc0fc410 msgr2=0x7fa1dc0fe830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:23.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:23.776+0000 7fa1e3064700 1 -- 172.21.15.82:0/2196273044 shutdown_connections 2023-09-23T08:55:23.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:23.776+0000 7fa1e3064700 1 -- 172.21.15.82:0/2196273044 wait complete. 2023-09-23T08:55:23.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:23.777+0000 7fa1e3064700 1 Processor -- start 2023-09-23T08:55:23.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:23.777+0000 7fa1e3064700 1 -- start start 2023-09-23T08:55:23.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:23.777+0000 7fa1e3064700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1dc072d50 0x7fa1dc19e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:23.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:23.777+0000 7fa1e3064700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa1dc073670 0x7fa1dc19ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:23.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:23.777+0000 7fa1e3064700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1dc10d180 0x7fa1dc1989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:23.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:23.777+0000 7fa1e3064700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1dc199020 con 0x7fa1dc072d50 2023-09-23T08:55:23.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:23.777+0000 7fa1e3064700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1dc199190 con 0x7fa1dc10d180 2023-09-23T08:55:23.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:23.777+0000 7fa1e3064700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1dc199350 con 0x7fa1dc073670 2023-09-23T08:55:23.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:23.778+0000 7fa1e0e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1dc072d50 0x7fa1dc19e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:23.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:23.778+0000 7fa1e0e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1dc072d50 0x7fa1dc19e930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34828/0 (socket says 172.21.15.82:34828) 2023-09-23T08:55:23.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:23.778+0000 7fa1e0e00700 1 -- 172.21.15.82:0/3282806168 learned_addr learned my addr 172.21.15.82:0/3282806168 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:55:23.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:23.778+0000 7fa1e1601700 1 --2- 172.21.15.82:0/3282806168 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1dc10d180 0x7fa1dc1989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:23.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:23.778+0000 7fa1dbfff700 1 --2- 172.21.15.82:0/3282806168 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa1dc073670 0x7fa1dc19ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:23.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:23.778+0000 7fa1e0e00700 1 -- 172.21.15.82:0/3282806168 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa1dc073670 msgr2=0x7fa1dc19ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:23.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:23.778+0000 7fa1e0e00700 1 --2- 172.21.15.82:0/3282806168 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa1dc073670 0x7fa1dc19ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:23.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:23.778+0000 7fa1e0e00700 1 -- 172.21.15.82:0/3282806168 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1dc10d180 msgr2=0x7fa1dc1989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:23.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:23.778+0000 7fa1e0e00700 1 --2- 172.21.15.82:0/3282806168 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1dc10d180 0x7fa1dc1989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:23.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:23.778+0000 7fa1e0e00700 1 -- 172.21.15.82:0/3282806168 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1d00095f0 con 0x7fa1dc072d50 2023-09-23T08:55:23.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:23.778+0000 7fa1dbfff700 1 --2- 172.21.15.82:0/3282806168 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa1dc073670 0x7fa1dc19ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T08:55:23.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:23.778+0000 7fa1e0e00700 1 --2- 172.21.15.82:0/3282806168 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1dc072d50 0x7fa1dc19e930 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa1d0005910 tx=0x7fa1d00047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:23.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:23.778+0000 7fa1d9ffb700 1 -- 172.21.15.82:0/3282806168 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d001d070 con 0x7fa1dc072d50 2023-09-23T08:55:23.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:23.779+0000 7fa1d9ffb700 1 -- 172.21.15.82:0/3282806168 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa1d0021410 con 0x7fa1dc072d50 2023-09-23T08:55:23.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:23.779+0000 7fa1e3064700 1 -- 172.21.15.82:0/3282806168 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1dc1995d0 con 0x7fa1dc072d50 2023-09-23T08:55:23.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:23.779+0000 7fa1d9ffb700 1 -- 172.21.15.82:0/3282806168 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d0017650 con 0x7fa1dc072d50 2023-09-23T08:55:23.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:23.779+0000 7fa1e3064700 1 -- 172.21.15.82:0/3282806168 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1dc1a5920 con 0x7fa1dc072d50 2023-09-23T08:55:23.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:23.779+0000 7fa1e3064700 1 -- 172.21.15.82:0/3282806168 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa1dc112c40 con 0x7fa1dc072d50 2023-09-23T08:55:23.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:23.781+0000 7fa1d9ffb700 1 -- 172.21.15.82:0/3282806168 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) v1 ==== 134722+0+0 (secure 0 0 0) 0x7fa1d000fb00 con 0x7fa1dc072d50 2023-09-23T08:55:23.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:23.783+0000 7fa1d9ffb700 1 --2- 172.21.15.82:0/3282806168 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fa1cc0a0060 0x7fa1cc0a2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:23.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:23.783+0000 7fa1d9ffb700 1 -- 172.21.15.82:0/3282806168 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fa1d00cce30 con 0x7fa1dc072d50 2023-09-23T08:55:23.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:23.783+0000 7fa1dbfff700 1 --2- 172.21.15.82:0/3282806168 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fa1cc0a0060 0x7fa1cc0a2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:23.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:23.783+0000 7fa1d9ffb700 1 --2- 172.21.15.82:0/3282806168 >> [v2:172.21.15.82:6802/892441948,v1:172.21.15.82:6803/892441948] conn(0x7fa1cc0a9a70 0x7fa1cc0abf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:23.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:23.783+0000 7fa1d9ffb700 1 -- 172.21.15.82:0/3282806168 --> [v2:172.21.15.82:6802/892441948,v1:172.21.15.82:6803/892441948] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa1cc0ac5e0 con 0x7fa1cc0a9a70 2023-09-23T08:55:23.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:23.783+0000 7fa1d9ffb700 1 -- 172.21.15.82:0/3282806168 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa1d00cd1a0 con 0x7fa1dc072d50 2023-09-23T08:55:23.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:23.783+0000 7fa1e1601700 1 --2- 172.21.15.82:0/3282806168 >> [v2:172.21.15.82:6802/892441948,v1:172.21.15.82:6803/892441948] conn(0x7fa1cc0a9a70 0x7fa1cc0abf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:23.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:23.784+0000 7fa1dbfff700 1 --2- 172.21.15.82:0/3282806168 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fa1cc0a0060 0x7fa1cc0a2520 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa1c8005950 tx=0x7fa1c80058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:23.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:23.784+0000 7fa1e1601700 1 --2- 172.21.15.82:0/3282806168 >> [v2:172.21.15.82:6802/892441948,v1:172.21.15.82:6803/892441948] conn(0x7fa1cc0a9a70 0x7fa1cc0abf10 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:23.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:23.785+0000 7fa1d9ffb700 1 -- 172.21.15.82:0/3282806168 <== osd.0 v2:172.21.15.82:6802/892441948 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fa1cc0ac5e0 con 0x7fa1cc0a9a70 2023-09-23T08:55:23.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:23.802+0000 7fa1e3064700 1 -- 172.21.15.82:0/3282806168 --> [v2:172.21.15.82:6802/892441948,v1:172.21.15.82:6803/892441948] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa1dc0fe2d0 con 0x7fa1cc0a9a70 2023-09-23T08:55:23.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:23.802+0000 7fa1d9ffb700 1 -- 172.21.15.82:0/3282806168 <== osd.0 v2:172.21.15.82:6802/892441948 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa1dc0fe2d0 con 0x7fa1cc0a9a70 2023-09-23T08:55:23.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:23.802+0000 7fa1e3064700 1 -- 172.21.15.82:0/3282806168 >> [v2:172.21.15.82:6802/892441948,v1:172.21.15.82:6803/892441948] conn(0x7fa1cc0a9a70 msgr2=0x7fa1cc0abf10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:23.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:23.802+0000 7fa1e3064700 1 --2- 172.21.15.82:0/3282806168 >> [v2:172.21.15.82:6802/892441948,v1:172.21.15.82:6803/892441948] conn(0x7fa1cc0a9a70 0x7fa1cc0abf10 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:23.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:23.803+0000 7fa1e3064700 1 -- 172.21.15.82:0/3282806168 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fa1cc0a0060 msgr2=0x7fa1cc0a2520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:23.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:23.803+0000 7fa1e3064700 1 --2- 172.21.15.82:0/3282806168 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fa1cc0a0060 0x7fa1cc0a2520 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa1c8005950 tx=0x7fa1c80058e0 comp rx=0 tx=0).stop 2023-09-23T08:55:23.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:23.803+0000 7fa1e3064700 1 -- 172.21.15.82:0/3282806168 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1dc072d50 msgr2=0x7fa1dc19e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:23.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:23.803+0000 7fa1e3064700 1 --2- 172.21.15.82:0/3282806168 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1dc072d50 0x7fa1dc19e930 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa1d0005910 tx=0x7fa1d00047b0 comp rx=0 tx=0).stop 2023-09-23T08:55:23.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:23.803+0000 7fa1e1601700 1 -- 172.21.15.82:0/3282806168 reap_dead start 2023-09-23T08:55:23.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:23.803+0000 7fa1e3064700 1 -- 172.21.15.82:0/3282806168 shutdown_connections 2023-09-23T08:55:23.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:23.803+0000 7fa1e3064700 1 -- 172.21.15.82:0/3282806168 >> 172.21.15.82:0/3282806168 conn(0x7fa1dc0fc410 msgr2=0x7fa1dc10f3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:23.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:23.803+0000 7fa1e3064700 1 -- 172.21.15.82:0/3282806168 shutdown_connections 2023-09-23T08:55:23.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:23.803+0000 7fa1e3064700 1 -- 172.21.15.82:0/3282806168 wait complete. 2023-09-23T08:55:23.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:23 smithi161 ceph-mon[99580]: pgmap v316: 97 pgs: 97 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 1.8 KiB/s wr, 12 op/s 2023-09-23T08:55:23.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:23 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11]}]': finished 2023-09-23T08:55:23.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:23 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2023-09-23T08:55:23.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:23 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]': finished 2023-09-23T08:55:23.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:23 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]': finished 2023-09-23T08:55:23.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:23 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2023-09-23T08:55:23.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:23 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]': finished 2023-09-23T08:55:23.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:23 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]': finished 2023-09-23T08:55:23.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:23 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2023-09-23T08:55:23.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:23 smithi161 ceph-mon[99580]: osdmap e87: 12 total, 12 up, 12 in 2023-09-23T08:55:24.238 INFO:teuthology.orchestra.run.smithi082.stdout:77309411394 2023-09-23T08:55:24.239 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- ceph osd last-stat-seq osd.2 2023-09-23T08:55:24.561 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:24 smithi082 ceph-mon[97694]: osdmap e88: 12 total, 12 up, 12 in 2023-09-23T08:55:24.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:24 smithi135 ceph-mon[99205]: osdmap e88: 12 total, 12 up, 12 in 2023-09-23T08:55:24.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:24 smithi161 ceph-mon[99580]: osdmap e88: 12 total, 12 up, 12 in 2023-09-23T08:55:25.406 INFO:teuthology.orchestra.run.smithi082.stdout:34359738446 2023-09-23T08:55:25.406 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- ceph osd last-stat-seq osd.0 2023-09-23T08:55:25.596 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:25 smithi082 ceph-mon[97694]: pgmap v319: 97 pgs: 4 peering, 93 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 639 B/s wr, 8 op/s 2023-09-23T08:55:25.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:25 smithi135 ceph-mon[99205]: pgmap v319: 97 pgs: 4 peering, 93 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 639 B/s wr, 8 op/s 2023-09-23T08:55:25.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:25 smithi161 ceph-mon[99580]: pgmap v319: 97 pgs: 4 peering, 93 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 639 B/s wr, 8 op/s 2023-09-23T08:55:25.993 INFO:teuthology.orchestra.run.smithi082.stdout:257698037795 2023-09-23T08:55:25.993 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- ceph osd last-stat-seq osd.8 2023-09-23T08:55:25.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.993+0000 7fef2287b700 1 -- 172.21.15.82:0/3424443521 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef1c101300 msgr2=0x7fef1c10d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:25.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.993+0000 7fef2287b700 1 --2- 172.21.15.82:0/3424443521 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef1c101300 0x7fef1c10d810 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fef1400b0a0 tx=0x7fef1400b3b0 comp rx=0 tx=0).stop 2023-09-23T08:55:25.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.993+0000 7fef2287b700 1 -- 172.21.15.82:0/3424443521 shutdown_connections 2023-09-23T08:55:25.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.993+0000 7fef2287b700 1 --2- 172.21.15.82:0/3424443521 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef1c101300 0x7fef1c10d810 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:25.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.993+0000 7fef2287b700 1 --2- 172.21.15.82:0/3424443521 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef1c106940 0x7fef1c106d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:25.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.993+0000 7fef2287b700 1 --2- 172.21.15.82:0/3424443521 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fef1c100940 0x7fef1c100dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:25.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.993+0000 7fef2287b700 1 -- 172.21.15.82:0/3424443521 >> 172.21.15.82:0/3424443521 conn(0x7fef1c0fc410 msgr2=0x7fef1c0fe830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:25.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.993+0000 7fef2287b700 1 -- 172.21.15.82:0/3424443521 shutdown_connections 2023-09-23T08:55:25.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.993+0000 7fef2287b700 1 -- 172.21.15.82:0/3424443521 wait complete. 2023-09-23T08:55:26.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.994+0000 7fef2287b700 1 Processor -- start 2023-09-23T08:55:26.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.994+0000 7fef2287b700 1 -- start start 2023-09-23T08:55:26.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.995+0000 7fef2287b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef1c100940 0x7fef1c198ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:26.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.995+0000 7fef2287b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef1c101300 0x7fef1c1991e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:26.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.995+0000 7fef2287b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fef1c106940 0x7fef1c19c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:26.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.995+0000 7fef2287b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef1c19cba0 con 0x7fef1c100940 2023-09-23T08:55:26.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.995+0000 7fef2287b700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef1c19cd10 con 0x7fef1c101300 2023-09-23T08:55:26.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.995+0000 7fef2287b700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef1c19ced0 con 0x7fef1c106940 2023-09-23T08:55:26.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.995+0000 7fef1bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef1c100940 0x7fef1c198ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:26.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.995+0000 7fef1bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef1c100940 0x7fef1c198ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34894/0 (socket says 172.21.15.82:34894) 2023-09-23T08:55:26.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.995+0000 7fef1bfff700 1 -- 172.21.15.82:0/1577674160 learned_addr learned my addr 172.21.15.82:0/1577674160 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:55:26.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.995+0000 7fef20e18700 1 --2- 172.21.15.82:0/1577674160 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fef1c106940 0x7fef1c19c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:26.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.995+0000 7fef1b7fe700 1 --2- 172.21.15.82:0/1577674160 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef1c101300 0x7fef1c1991e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:26.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.995+0000 7fef1bfff700 1 -- 172.21.15.82:0/1577674160 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fef1c106940 msgr2=0x7fef1c19c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:26.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.995+0000 7fef1bfff700 1 --2- 172.21.15.82:0/1577674160 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fef1c106940 0x7fef1c19c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:26.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.995+0000 7fef1bfff700 1 -- 172.21.15.82:0/1577674160 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef1c101300 msgr2=0x7fef1c1991e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:26.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.995+0000 7fef1bfff700 1 --2- 172.21.15.82:0/1577674160 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef1c101300 0x7fef1c1991e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:26.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.995+0000 7fef1bfff700 1 -- 172.21.15.82:0/1577674160 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef14009d00 con 0x7fef1c100940 2023-09-23T08:55:26.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.995+0000 7fef1b7fe700 1 --2- 172.21.15.82:0/1577674160 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef1c101300 0x7fef1c1991e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T08:55:26.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.996+0000 7fef1bfff700 1 --2- 172.21.15.82:0/1577674160 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef1c100940 0x7fef1c198ca0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fef0c00e9a0 tx=0x7fef0c00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:26.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.996+0000 7fef197fa700 1 -- 172.21.15.82:0/1577674160 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef0c009790 con 0x7fef1c100940 2023-09-23T08:55:26.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.996+0000 7fef197fa700 1 -- 172.21.15.82:0/1577674160 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fef0c00cbd0 con 0x7fef1c100940 2023-09-23T08:55:26.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.996+0000 7fef2287b700 1 -- 172.21.15.82:0/1577674160 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef1c19d1b0 con 0x7fef1c100940 2023-09-23T08:55:26.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.996+0000 7fef197fa700 1 -- 172.21.15.82:0/1577674160 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef0c018680 con 0x7fef1c100940 2023-09-23T08:55:26.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.996+0000 7fef2287b700 1 -- 172.21.15.82:0/1577674160 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef1c1a5b00 con 0x7fef1c100940 2023-09-23T08:55:26.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.997+0000 7fef2287b700 1 -- 172.21.15.82:0/1577674160 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fef1c110a10 con 0x7fef1c100940 2023-09-23T08:55:26.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.999+0000 7fef197fa700 1 -- 172.21.15.82:0/1577674160 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) v1 ==== 134722+0+0 (secure 0 0 0) 0x7fef0c00cd40 con 0x7fef1c100940 2023-09-23T08:55:26.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:26.000+0000 7fef197fa700 1 --2- 172.21.15.82:0/1577674160 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fef0409ffe0 0x7fef040a24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:26.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:26.001+0000 7fef197fa700 1 -- 172.21.15.82:0/1577674160 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fef0c014070 con 0x7fef1c100940 2023-09-23T08:55:26.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:26.001+0000 7fef1b7fe700 1 --2- 172.21.15.82:0/1577674160 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fef0409ffe0 0x7fef040a24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:26.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:26.001+0000 7fef197fa700 1 --2- 172.21.15.82:0/1577674160 >> [v2:172.21.15.161:6808/1252638628,v1:172.21.15.161:6809/1252638628] conn(0x7fef040a9b20 0x7fef040abfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:26.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:26.001+0000 7fef197fa700 1 -- 172.21.15.82:0/1577674160 --> [v2:172.21.15.161:6808/1252638628,v1:172.21.15.161:6809/1252638628] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fef040ac690 con 0x7fef040a9b20 2023-09-23T08:55:26.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:26.001+0000 7fef197fa700 1 -- 172.21.15.82:0/1577674160 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7fef0c0cbd30 con 0x7fef1c100940 2023-09-23T08:55:26.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:26.001+0000 7fef1b7fe700 1 --2- 172.21.15.82:0/1577674160 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fef0409ffe0 0x7fef040a24a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fef10005d90 tx=0x7fef10005d00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:26.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:26.002+0000 7fef20e18700 1 --2- 172.21.15.82:0/1577674160 >> [v2:172.21.15.161:6808/1252638628,v1:172.21.15.161:6809/1252638628] conn(0x7fef040a9b20 0x7fef040abfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:26.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:26.002+0000 7fef20e18700 1 --2- 172.21.15.82:0/1577674160 >> [v2:172.21.15.161:6808/1252638628,v1:172.21.15.161:6809/1252638628] conn(0x7fef040a9b20 0x7fef040abfc0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:26.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:26.003+0000 7fef197fa700 1 -- 172.21.15.82:0/1577674160 <== osd.5 v2:172.21.15.161:6808/1252638628 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fef040ac690 con 0x7fef040a9b20 2023-09-23T08:55:26.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:26.021+0000 7fef2287b700 1 -- 172.21.15.82:0/1577674160 --> [v2:172.21.15.161:6808/1252638628,v1:172.21.15.161:6809/1252638628] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fef1c04e620 con 0x7fef040a9b20 2023-09-23T08:55:26.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:26.021+0000 7fef197fa700 1 -- 172.21.15.82:0/1577674160 <== osd.5 v2:172.21.15.161:6808/1252638628 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fef1c04e620 con 0x7fef040a9b20 2023-09-23T08:55:26.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:26.022+0000 7fef2287b700 1 -- 172.21.15.82:0/1577674160 >> [v2:172.21.15.161:6808/1252638628,v1:172.21.15.161:6809/1252638628] conn(0x7fef040a9b20 msgr2=0x7fef040abfc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:26.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:26.022+0000 7fef2287b700 1 --2- 172.21.15.82:0/1577674160 >> [v2:172.21.15.161:6808/1252638628,v1:172.21.15.161:6809/1252638628] conn(0x7fef040a9b20 0x7fef040abfc0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:26.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:26.022+0000 7fef2287b700 1 -- 172.21.15.82:0/1577674160 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fef0409ffe0 msgr2=0x7fef040a24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:26.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:26.022+0000 7fef2287b700 1 --2- 172.21.15.82:0/1577674160 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fef0409ffe0 0x7fef040a24a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fef10005d90 tx=0x7fef10005d00 comp rx=0 tx=0).stop 2023-09-23T08:55:26.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:26.022+0000 7fef2287b700 1 -- 172.21.15.82:0/1577674160 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef1c100940 msgr2=0x7fef1c198ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:26.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:26.022+0000 7fef2287b700 1 --2- 172.21.15.82:0/1577674160 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef1c100940 0x7fef1c198ca0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fef0c00e9a0 tx=0x7fef0c00ed60 comp rx=0 tx=0).stop 2023-09-23T08:55:26.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:26.022+0000 7fef20e18700 1 -- 172.21.15.82:0/1577674160 reap_dead start 2023-09-23T08:55:26.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:26.022+0000 7fef2287b700 1 -- 172.21.15.82:0/1577674160 shutdown_connections 2023-09-23T08:55:26.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:26.022+0000 7fef2287b700 1 -- 172.21.15.82:0/1577674160 >> 172.21.15.82:0/1577674160 conn(0x7fef1c0fc410 msgr2=0x7fef1c10bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:26.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:26.022+0000 7fef2287b700 1 -- 172.21.15.82:0/1577674160 shutdown_connections 2023-09-23T08:55:26.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:26.022+0000 7fef2287b700 1 -- 172.21.15.82:0/1577674160 wait complete. 2023-09-23T08:55:26.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.750+0000 7f2556398700 1 -- 172.21.15.82:0/3353393433 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f255010d180 msgr2=0x7f255010f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:26.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.750+0000 7f2556398700 1 --2- 172.21.15.82:0/3353393433 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f255010d180 0x7f255010f5f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f254800b0a0 tx=0x7f254800b3b0 comp rx=0 tx=0).stop 2023-09-23T08:55:26.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.750+0000 7f2556398700 1 -- 172.21.15.82:0/3353393433 shutdown_connections 2023-09-23T08:55:26.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.750+0000 7f2556398700 1 --2- 172.21.15.82:0/3353393433 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f255010d180 0x7f255010f5f0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:26.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.750+0000 7f2556398700 1 --2- 172.21.15.82:0/3353393433 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2550072d50 0x7f2550073130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:26.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.750+0000 7f2556398700 1 --2- 172.21.15.82:0/3353393433 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2550073670 0x7f255010cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:26.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.750+0000 7f2556398700 1 -- 172.21.15.82:0/3353393433 >> 172.21.15.82:0/3353393433 conn(0x7f25500fc410 msgr2=0x7f25500fe830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:26.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.750+0000 7f2556398700 1 -- 172.21.15.82:0/3353393433 shutdown_connections 2023-09-23T08:55:26.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.750+0000 7f2556398700 1 -- 172.21.15.82:0/3353393433 wait complete. 2023-09-23T08:55:26.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.751+0000 7f2556398700 1 Processor -- start 2023-09-23T08:55:26.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.751+0000 7f2556398700 1 -- start start 2023-09-23T08:55:26.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.752+0000 7f2556398700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2550072d50 0x7f2550198d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:26.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.752+0000 7f2556398700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2550073670 0x7f2550199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:26.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.752+0000 7f2556398700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f255010d180 0x7f255019d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:26.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.752+0000 7f2556398700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f255019dcd0 con 0x7f255010d180 2023-09-23T08:55:26.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.752+0000 7f2556398700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f255019de40 con 0x7f2550072d50 2023-09-23T08:55:26.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.752+0000 7f2556398700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f255019e000 con 0x7f2550073670 2023-09-23T08:55:26.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.752+0000 7f2554935700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f255010d180 0x7f255019d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:26.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.752+0000 7f2554935700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f255010d180 0x7f255019d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34874/0 (socket says 172.21.15.82:34874) 2023-09-23T08:55:26.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.752+0000 7f2554935700 1 -- 172.21.15.82:0/1788038595 learned_addr learned my addr 172.21.15.82:0/1788038595 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:55:26.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.752+0000 7f2547fff700 1 --2- 172.21.15.82:0/1788038595 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2550072d50 0x7f2550198d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:26.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.752+0000 7f254ffff700 1 --2- 172.21.15.82:0/1788038595 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2550073670 0x7f2550199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:26.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.752+0000 7f2554935700 1 -- 172.21.15.82:0/1788038595 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2550073670 msgr2=0x7f2550199250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:26.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.752+0000 7f2554935700 1 --2- 172.21.15.82:0/1788038595 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2550073670 0x7f2550199250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:26.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.752+0000 7f2554935700 1 -- 172.21.15.82:0/1788038595 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2550072d50 msgr2=0x7f2550198d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:26.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.752+0000 7f2554935700 1 --2- 172.21.15.82:0/1788038595 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2550072d50 0x7f2550198d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:26.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.752+0000 7f2554935700 1 -- 172.21.15.82:0/1788038595 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2548009d00 con 0x7f255010d180 2023-09-23T08:55:26.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.752+0000 7f2547fff700 1 --2- 172.21.15.82:0/1788038595 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2550072d50 0x7f2550198d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T08:55:26.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.752+0000 7f254ffff700 1 --2- 172.21.15.82:0/1788038595 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2550073670 0x7f2550199250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T08:55:26.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.753+0000 7f2554935700 1 --2- 172.21.15.82:0/1788038595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f255010d180 0x7f255019d6c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f254800b780 tx=0x7f254800be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:26.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.753+0000 7f254dffb700 1 -- 172.21.15.82:0/1788038595 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254800e040 con 0x7f255010d180 2023-09-23T08:55:26.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.753+0000 7f2556398700 1 -- 172.21.15.82:0/1788038595 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f255019e280 con 0x7f255010d180 2023-09-23T08:55:26.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.753+0000 7f254dffb700 1 -- 172.21.15.82:0/1788038595 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2548004e60 con 0x7f255010d180 2023-09-23T08:55:26.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.753+0000 7f254dffb700 1 -- 172.21.15.82:0/1788038595 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25480052a0 con 0x7f255010d180 2023-09-23T08:55:26.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.753+0000 7f2556398700 1 -- 172.21.15.82:0/1788038595 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25501a5b40 con 0x7f255010d180 2023-09-23T08:55:26.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.754+0000 7f2556398700 1 -- 172.21.15.82:0/1788038595 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2550112b80 con 0x7f255010d180 2023-09-23T08:55:26.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.756+0000 7f254dffb700 1 -- 172.21.15.82:0/1788038595 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) v1 ==== 134722+0+0 (secure 0 0 0) 0x7f254801da00 con 0x7f255010d180 2023-09-23T08:55:26.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.758+0000 7f254dffb700 1 --2- 172.21.15.82:0/1788038595 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f253c09ffe0 0x7f253c0a24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:26.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.758+0000 7f254dffb700 1 -- 172.21.15.82:0/1788038595 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f25480cd190 con 0x7f255010d180 2023-09-23T08:55:26.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.758+0000 7f254dffb700 1 --2- 172.21.15.82:0/1788038595 >> [v2:172.21.15.82:6826/1438762840,v1:172.21.15.82:6827/1438762840] conn(0x7f253c0a9b20 0x7f253c0abfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:26.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.758+0000 7f254dffb700 1 -- 172.21.15.82:0/1788038595 --> [v2:172.21.15.82:6826/1438762840,v1:172.21.15.82:6827/1438762840] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f253c0ac690 con 0x7f253c0a9b20 2023-09-23T08:55:26.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.758+0000 7f254dffb700 1 -- 172.21.15.82:0/1788038595 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7f25480cd5a0 con 0x7f255010d180 2023-09-23T08:55:26.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.758+0000 7f2547fff700 1 --2- 172.21.15.82:0/1788038595 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f253c09ffe0 0x7f253c0a24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:26.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.758+0000 7f254ffff700 1 --2- 172.21.15.82:0/1788038595 >> [v2:172.21.15.82:6826/1438762840,v1:172.21.15.82:6827/1438762840] conn(0x7f253c0a9b20 0x7f253c0abfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:26.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.759+0000 7f2547fff700 1 --2- 172.21.15.82:0/1788038595 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f253c09ffe0 0x7f253c0a24a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2540009cb0 tx=0x7f2540009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:26.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.759+0000 7f254ffff700 1 --2- 172.21.15.82:0/1788038595 >> [v2:172.21.15.82:6826/1438762840,v1:172.21.15.82:6827/1438762840] conn(0x7f253c0a9b20 0x7f253c0abfc0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:26.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.760+0000 7f254dffb700 1 -- 172.21.15.82:0/1788038595 <== osd.9 v2:172.21.15.82:6826/1438762840 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f253c0ac690 con 0x7f253c0a9b20 2023-09-23T08:55:26.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.779+0000 7f2556398700 1 -- 172.21.15.82:0/1788038595 --> [v2:172.21.15.82:6826/1438762840,v1:172.21.15.82:6827/1438762840] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f255004e620 con 0x7f253c0a9b20 2023-09-23T08:55:26.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.779+0000 7f254dffb700 1 -- 172.21.15.82:0/1788038595 <== osd.9 v2:172.21.15.82:6826/1438762840 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f255004e620 con 0x7f253c0a9b20 2023-09-23T08:55:26.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.780+0000 7f2556398700 1 -- 172.21.15.82:0/1788038595 >> [v2:172.21.15.82:6826/1438762840,v1:172.21.15.82:6827/1438762840] conn(0x7f253c0a9b20 msgr2=0x7f253c0abfc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:26.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.780+0000 7f2556398700 1 --2- 172.21.15.82:0/1788038595 >> [v2:172.21.15.82:6826/1438762840,v1:172.21.15.82:6827/1438762840] conn(0x7f253c0a9b20 0x7f253c0abfc0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:26.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.780+0000 7f2556398700 1 -- 172.21.15.82:0/1788038595 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f253c09ffe0 msgr2=0x7f253c0a24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:26.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.780+0000 7f2556398700 1 --2- 172.21.15.82:0/1788038595 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f253c09ffe0 0x7f253c0a24a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2540009cb0 tx=0x7f2540009260 comp rx=0 tx=0).stop 2023-09-23T08:55:26.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.780+0000 7f2556398700 1 -- 172.21.15.82:0/1788038595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f255010d180 msgr2=0x7f255019d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:26.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.780+0000 7f2556398700 1 --2- 172.21.15.82:0/1788038595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f255010d180 0x7f255019d6c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f254800b780 tx=0x7f254800be10 comp rx=0 tx=0).stop 2023-09-23T08:55:26.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.780+0000 7f2554935700 1 -- 172.21.15.82:0/1788038595 reap_dead start 2023-09-23T08:55:26.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.780+0000 7f2556398700 1 -- 172.21.15.82:0/1788038595 shutdown_connections 2023-09-23T08:55:26.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.780+0000 7f2556398700 1 -- 172.21.15.82:0/1788038595 >> 172.21.15.82:0/1788038595 conn(0x7f25500fc410 msgr2=0x7f255010f370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:26.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.780+0000 7f2556398700 1 -- 172.21.15.82:0/1788038595 shutdown_connections 2023-09-23T08:55:26.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.781+0000 7f2556398700 1 -- 172.21.15.82:0/1788038595 wait complete. 2023-09-23T08:55:26.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.360+0000 7f0dec88b700 1 -- 172.21.15.82:0/1582528447 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0de8073670 msgr2=0x7f0de810cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:26.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.360+0000 7f0dec88b700 1 --2- 172.21.15.82:0/1582528447 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0de8073670 0x7f0de810cc40 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0dd0009990 tx=0x7f0dd0009ca0 comp rx=0 tx=0).stop 2023-09-23T08:55:26.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.360+0000 7f0dec88b700 1 -- 172.21.15.82:0/1582528447 shutdown_connections 2023-09-23T08:55:26.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.360+0000 7f0dec88b700 1 --2- 172.21.15.82:0/1582528447 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0de810d180 0x7f0de810f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:26.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.360+0000 7f0dec88b700 1 --2- 172.21.15.82:0/1582528447 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0de8072d50 0x7f0de8073130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:26.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.360+0000 7f0dec88b700 1 --2- 172.21.15.82:0/1582528447 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0de8073670 0x7f0de810cc40 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:26.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.360+0000 7f0dec88b700 1 -- 172.21.15.82:0/1582528447 >> 172.21.15.82:0/1582528447 conn(0x7f0de80fc410 msgr2=0x7f0de80fe830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:26.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.361+0000 7f0dec88b700 1 -- 172.21.15.82:0/1582528447 shutdown_connections 2023-09-23T08:55:26.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.361+0000 7f0dec88b700 1 -- 172.21.15.82:0/1582528447 wait complete. 2023-09-23T08:55:26.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.362+0000 7f0dec88b700 1 Processor -- start 2023-09-23T08:55:26.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.362+0000 7f0dec88b700 1 -- start start 2023-09-23T08:55:26.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.362+0000 7f0dec88b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0de8072d50 0x7f0de819e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:26.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.362+0000 7f0dec88b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0de8073670 0x7f0de819eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:26.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.362+0000 7f0dec88b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0de810d180 0x7f0de8198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:26.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.362+0000 7f0dec88b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0de8199080 con 0x7f0de810d180 2023-09-23T08:55:26.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.362+0000 7f0dec88b700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0de81991f0 con 0x7f0de8072d50 2023-09-23T08:55:26.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.362+0000 7f0dec88b700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0de81993b0 con 0x7f0de8073670 2023-09-23T08:55:26.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.363+0000 7f0dde59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0de8072d50 0x7f0de819e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:26.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.363+0000 7f0de6d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0de810d180 0x7f0de8198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:26.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.363+0000 7f0dde59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0de8072d50 0x7f0de819e990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:44966/0 (socket says 172.21.15.82:44966) 2023-09-23T08:55:26.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.363+0000 7f0dde59c700 1 -- 172.21.15.82:0/3793706014 learned_addr learned my addr 172.21.15.82:0/3793706014 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:55:26.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.363+0000 7f0de659c700 1 --2- 172.21.15.82:0/3793706014 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0de8073670 0x7f0de819eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:26.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.363+0000 7f0de6d9d700 1 -- 172.21.15.82:0/3793706014 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0de8073670 msgr2=0x7f0de819eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:26.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.363+0000 7f0de6d9d700 1 --2- 172.21.15.82:0/3793706014 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0de8073670 0x7f0de819eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:26.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.363+0000 7f0de6d9d700 1 -- 172.21.15.82:0/3793706014 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0de8072d50 msgr2=0x7f0de819e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:26.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.363+0000 7f0de6d9d700 1 --2- 172.21.15.82:0/3793706014 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0de8072d50 0x7f0de819e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:26.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.363+0000 7f0de6d9d700 1 -- 172.21.15.82:0/3793706014 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dd00095f0 con 0x7f0de810d180 2023-09-23T08:55:26.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.363+0000 7f0de6d9d700 1 --2- 172.21.15.82:0/3793706014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0de810d180 0x7f0de8198a10 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f0de0007f10 tx=0x7f0de000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:26.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.363+0000 7f0ddffff700 1 -- 172.21.15.82:0/3793706014 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de0009ea0 con 0x7f0de810d180 2023-09-23T08:55:26.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.363+0000 7f0ddffff700 1 -- 172.21.15.82:0/3793706014 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0de000f040 con 0x7f0de810d180 2023-09-23T08:55:26.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.363+0000 7f0ddffff700 1 -- 172.21.15.82:0/3793706014 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de0004260 con 0x7f0de810d180 2023-09-23T08:55:26.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.364+0000 7f0dec88b700 1 -- 172.21.15.82:0/3793706014 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0de8199690 con 0x7f0de810d180 2023-09-23T08:55:26.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.364+0000 7f0dec88b700 1 -- 172.21.15.82:0/3793706014 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0de81a5980 con 0x7f0de810d180 2023-09-23T08:55:26.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.365+0000 7f0dec88b700 1 -- 172.21.15.82:0/3793706014 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0de8112ca0 con 0x7f0de810d180 2023-09-23T08:55:26.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.367+0000 7f0ddffff700 1 -- 172.21.15.82:0/3793706014 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) v1 ==== 134722+0+0 (secure 0 0 0) 0x7f0de0003a00 con 0x7f0de810d180 2023-09-23T08:55:26.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.368+0000 7f0ddffff700 1 --2- 172.21.15.82:0/3793706014 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f0dd409ffe0 0x7f0dd40a24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:26.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.368+0000 7f0ddffff700 1 -- 172.21.15.82:0/3793706014 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f0de00cb9f0 con 0x7f0de810d180 2023-09-23T08:55:26.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.369+0000 7f0dde59c700 1 --2- 172.21.15.82:0/3793706014 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f0dd409ffe0 0x7f0dd40a24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:26.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.369+0000 7f0ddffff700 1 --2- 172.21.15.82:0/3793706014 >> [v2:172.21.15.135:6816/3683951498,v1:172.21.15.135:6817/3683951498] conn(0x7f0dd40a9b20 0x7f0dd40abfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:26.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.369+0000 7f0ddffff700 1 -- 172.21.15.82:0/3793706014 --> [v2:172.21.15.135:6816/3683951498,v1:172.21.15.135:6817/3683951498] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0dd40ac690 con 0x7f0dd40a9b20 2023-09-23T08:55:26.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.369+0000 7f0ddffff700 1 -- 172.21.15.82:0/3793706014 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0de00cbd60 con 0x7f0de810d180 2023-09-23T08:55:26.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.369+0000 7f0de659c700 1 --2- 172.21.15.82:0/3793706014 >> [v2:172.21.15.135:6816/3683951498,v1:172.21.15.135:6817/3683951498] conn(0x7f0dd40a9b20 0x7f0dd40abfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:26.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.369+0000 7f0dde59c700 1 --2- 172.21.15.82:0/3793706014 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f0dd409ffe0 0x7f0dd40a24a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0dd8005950 tx=0x7f0dd800b500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:26.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.370+0000 7f0de659c700 1 --2- 172.21.15.82:0/3793706014 >> [v2:172.21.15.135:6816/3683951498,v1:172.21.15.135:6817/3683951498] conn(0x7f0dd40a9b20 0x7f0dd40abfc0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:26.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.371+0000 7f0ddffff700 1 -- 172.21.15.82:0/3793706014 <== osd.7 v2:172.21.15.135:6816/3683951498 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f0dd40ac690 con 0x7f0dd40a9b20 2023-09-23T08:55:26.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.393+0000 7f0dec88b700 1 -- 172.21.15.82:0/3793706014 --> [v2:172.21.15.135:6816/3683951498,v1:172.21.15.135:6817/3683951498] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0de80fe350 con 0x7f0dd40a9b20 2023-09-23T08:55:26.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.393+0000 7f0ddffff700 1 -- 172.21.15.82:0/3793706014 <== osd.7 v2:172.21.15.135:6816/3683951498 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f0de80fe350 con 0x7f0dd40a9b20 2023-09-23T08:55:26.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.394+0000 7f0dec88b700 1 -- 172.21.15.82:0/3793706014 >> [v2:172.21.15.135:6816/3683951498,v1:172.21.15.135:6817/3683951498] conn(0x7f0dd40a9b20 msgr2=0x7f0dd40abfc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:26.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.394+0000 7f0dec88b700 1 --2- 172.21.15.82:0/3793706014 >> [v2:172.21.15.135:6816/3683951498,v1:172.21.15.135:6817/3683951498] conn(0x7f0dd40a9b20 0x7f0dd40abfc0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:26.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.394+0000 7f0dec88b700 1 -- 172.21.15.82:0/3793706014 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f0dd409ffe0 msgr2=0x7f0dd40a24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:26.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.394+0000 7f0dec88b700 1 --2- 172.21.15.82:0/3793706014 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f0dd409ffe0 0x7f0dd40a24a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0dd8005950 tx=0x7f0dd800b500 comp rx=0 tx=0).stop 2023-09-23T08:55:26.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.394+0000 7f0dec88b700 1 -- 172.21.15.82:0/3793706014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0de810d180 msgr2=0x7f0de8198a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:26.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.394+0000 7f0dec88b700 1 --2- 172.21.15.82:0/3793706014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0de810d180 0x7f0de8198a10 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f0de0007f10 tx=0x7f0de000d3b0 comp rx=0 tx=0).stop 2023-09-23T08:55:26.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.394+0000 7f0de6d9d700 1 -- 172.21.15.82:0/3793706014 reap_dead start 2023-09-23T08:55:26.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.394+0000 7f0dec88b700 1 -- 172.21.15.82:0/3793706014 shutdown_connections 2023-09-23T08:55:26.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.394+0000 7f0dec88b700 1 -- 172.21.15.82:0/3793706014 >> 172.21.15.82:0/3793706014 conn(0x7f0de80fc410 msgr2=0x7f0de810f3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:26.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.394+0000 7f0dec88b700 1 -- 172.21.15.82:0/3793706014 shutdown_connections 2023-09-23T08:55:26.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:25.394+0000 7f0dec88b700 1 -- 172.21.15.82:0/3793706014 wait complete. 2023-09-23T08:55:26.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:26.898+0000 7f3083d9a700 1 -- 172.21.15.82:0/3529248743 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f307c106940 msgr2=0x7f307c106d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:26.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:26.898+0000 7f3083d9a700 1 --2- 172.21.15.82:0/3529248743 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f307c106940 0x7f307c106d20 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f3078009990 tx=0x7f3078009ca0 comp rx=0 tx=0).stop 2023-09-23T08:55:26.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:26.898+0000 7f3083d9a700 1 -- 172.21.15.82:0/3529248743 shutdown_connections 2023-09-23T08:55:26.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:26.898+0000 7f3083d9a700 1 --2- 172.21.15.82:0/3529248743 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f307c101300 0x7f307c10d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:26.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:26.898+0000 7f3083d9a700 1 --2- 172.21.15.82:0/3529248743 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f307c106940 0x7f307c106d20 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:26.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:26.898+0000 7f3083d9a700 1 --2- 172.21.15.82:0/3529248743 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f307c100940 0x7f307c100dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:26.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:26.898+0000 7f3083d9a700 1 -- 172.21.15.82:0/3529248743 >> 172.21.15.82:0/3529248743 conn(0x7f307c0fc410 msgr2=0x7f307c0fe830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:26.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:26.898+0000 7f3083d9a700 1 -- 172.21.15.82:0/3529248743 shutdown_connections 2023-09-23T08:55:26.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:26.898+0000 7f3083d9a700 1 -- 172.21.15.82:0/3529248743 wait complete. 2023-09-23T08:55:26.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:26.900+0000 7f3083d9a700 1 Processor -- start 2023-09-23T08:55:26.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:26.900+0000 7f3083d9a700 1 -- start start 2023-09-23T08:55:26.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:26.901+0000 7f3083d9a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f307c100940 0x7f307c19c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:26.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:26.901+0000 7f3083d9a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f307c101300 0x7f307c19ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:26.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:26.901+0000 7f3083d9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f307c106940 0x7f307c196800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:26.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:26.901+0000 7f3083d9a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f307c196e70 con 0x7f307c100940 2023-09-23T08:55:26.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:26.901+0000 7f3083d9a700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f307c196fe0 con 0x7f307c106940 2023-09-23T08:55:26.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:26.901+0000 7f3083d9a700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f307c1971a0 con 0x7f307c101300 2023-09-23T08:55:26.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:26.901+0000 7f3081b36700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f307c100940 0x7f307c19c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:26.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:26.901+0000 7f3081b36700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f307c100940 0x7f307c19c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34906/0 (socket says 172.21.15.82:34906) 2023-09-23T08:55:26.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:26.901+0000 7f3081b36700 1 -- 172.21.15.82:0/3159476439 learned_addr learned my addr 172.21.15.82:0/3159476439 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:55:26.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:26.901+0000 7f3081335700 1 --2- 172.21.15.82:0/3159476439 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f307c101300 0x7f307c19ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:26.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:26.901+0000 7f3081b36700 1 -- 172.21.15.82:0/3159476439 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f307c101300 msgr2=0x7f307c19ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:26.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:26.901+0000 7f3081b36700 1 --2- 172.21.15.82:0/3159476439 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f307c101300 0x7f307c19ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:26.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:26.901+0000 7f3081b36700 1 -- 172.21.15.82:0/3159476439 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f307c106940 msgr2=0x7f307c196800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:26.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:26.901+0000 7f3081b36700 1 --2- 172.21.15.82:0/3159476439 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f307c106940 0x7f307c196800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:26.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:26.901+0000 7f3081b36700 1 -- 172.21.15.82:0/3159476439 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30780095f0 con 0x7f307c100940 2023-09-23T08:55:26.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:26.902+0000 7f3081b36700 1 --2- 172.21.15.82:0/3159476439 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f307c100940 0x7f307c19c780 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f30780036c0 tx=0x7f30780057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:26.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:26.902+0000 7f3072ffd700 1 -- 172.21.15.82:0/3159476439 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f307801d070 con 0x7f307c100940 2023-09-23T08:55:26.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:26.902+0000 7f3072ffd700 1 -- 172.21.15.82:0/3159476439 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3078003fc0 con 0x7f307c100940 2023-09-23T08:55:26.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:26.902+0000 7f3072ffd700 1 -- 172.21.15.82:0/3159476439 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3078022ca0 con 0x7f307c100940 2023-09-23T08:55:26.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:26.902+0000 7f3083d9a700 1 -- 172.21.15.82:0/3159476439 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f307c197420 con 0x7f307c100940 2023-09-23T08:55:26.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:26.902+0000 7f3083d9a700 1 -- 172.21.15.82:0/3159476439 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f307c072d20 con 0x7f307c100940 2023-09-23T08:55:26.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:26.903+0000 7f3083d9a700 1 -- 172.21.15.82:0/3159476439 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f307c04e620 con 0x7f307c100940 2023-09-23T08:55:26.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:26.906+0000 7f3072ffd700 1 -- 172.21.15.82:0/3159476439 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) v1 ==== 134722+0+0 (secure 0 0 0) 0x7f3078022470 con 0x7f307c100940 2023-09-23T08:55:26.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:26.907+0000 7f3072ffd700 1 --2- 172.21.15.82:0/3159476439 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f30680a4470 0x7f30680a6930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:26.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:26.908+0000 7f3072ffd700 1 -- 172.21.15.82:0/3159476439 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f30780cd300 con 0x7f307c100940 2023-09-23T08:55:26.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:26.908+0000 7f3081335700 1 --2- 172.21.15.82:0/3159476439 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f30680a4470 0x7f30680a6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:26.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:26.908+0000 7f3072ffd700 1 --2- 172.21.15.82:0/3159476439 >> [v2:172.21.15.82:6818/1052038408,v1:172.21.15.82:6819/1052038408] conn(0x7f30680adfb0 0x7f30680b0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:26.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:26.908+0000 7f3072ffd700 1 -- 172.21.15.82:0/3159476439 --> [v2:172.21.15.82:6818/1052038408,v1:172.21.15.82:6819/1052038408] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f30680b0b20 con 0x7f30680adfb0 2023-09-23T08:55:26.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:26.908+0000 7f3072ffd700 1 -- 172.21.15.82:0/3159476439 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7f30780cd670 con 0x7f307c100940 2023-09-23T08:55:26.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:26.908+0000 7f3082337700 1 --2- 172.21.15.82:0/3159476439 >> [v2:172.21.15.82:6818/1052038408,v1:172.21.15.82:6819/1052038408] conn(0x7f30680adfb0 0x7f30680b0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:26.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:26.908+0000 7f3081335700 1 --2- 172.21.15.82:0/3159476439 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f30680a4470 0x7f30680a6930 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f306c005950 tx=0x7f306c0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:26.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:26.909+0000 7f3082337700 1 --2- 172.21.15.82:0/3159476439 >> [v2:172.21.15.82:6818/1052038408,v1:172.21.15.82:6819/1052038408] conn(0x7f30680adfb0 0x7f30680b0450 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:26.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:26.910+0000 7f3072ffd700 1 -- 172.21.15.82:0/3159476439 <== osd.6 v2:172.21.15.82:6818/1052038408 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f30680b0b20 con 0x7f30680adfb0 2023-09-23T08:55:26.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:26.929+0000 7f3083d9a700 1 -- 172.21.15.82:0/3159476439 --> [v2:172.21.15.82:6818/1052038408,v1:172.21.15.82:6819/1052038408] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f307c110af0 con 0x7f30680adfb0 2023-09-23T08:55:26.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:26.929+0000 7f3072ffd700 1 -- 172.21.15.82:0/3159476439 <== osd.6 v2:172.21.15.82:6818/1052038408 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f307400f040 con 0x7f30680adfb0 2023-09-23T08:55:26.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:26.930+0000 7f3083d9a700 1 -- 172.21.15.82:0/3159476439 >> [v2:172.21.15.82:6818/1052038408,v1:172.21.15.82:6819/1052038408] conn(0x7f30680adfb0 msgr2=0x7f30680b0450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:26.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:26.930+0000 7f3083d9a700 1 --2- 172.21.15.82:0/3159476439 >> [v2:172.21.15.82:6818/1052038408,v1:172.21.15.82:6819/1052038408] conn(0x7f30680adfb0 0x7f30680b0450 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:26.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:26.930+0000 7f3083d9a700 1 -- 172.21.15.82:0/3159476439 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f30680a4470 msgr2=0x7f30680a6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:26.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:26.930+0000 7f3083d9a700 1 --2- 172.21.15.82:0/3159476439 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f30680a4470 0x7f30680a6930 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f306c005950 tx=0x7f306c0058e0 comp rx=0 tx=0).stop 2023-09-23T08:55:26.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:26.930+0000 7f3083d9a700 1 -- 172.21.15.82:0/3159476439 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f307c100940 msgr2=0x7f307c19c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:26.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:26.930+0000 7f3083d9a700 1 --2- 172.21.15.82:0/3159476439 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f307c100940 0x7f307c19c780 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f30780036c0 tx=0x7f30780057f0 comp rx=0 tx=0).stop 2023-09-23T08:55:26.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:26.930+0000 7f3082337700 1 -- 172.21.15.82:0/3159476439 reap_dead start 2023-09-23T08:55:26.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:26.930+0000 7f3083d9a700 1 -- 172.21.15.82:0/3159476439 shutdown_connections 2023-09-23T08:55:26.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:26.930+0000 7f3083d9a700 1 -- 172.21.15.82:0/3159476439 >> 172.21.15.82:0/3159476439 conn(0x7f307c0fc410 msgr2=0x7f307c0fca80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:26.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:26.930+0000 7f3083d9a700 1 -- 172.21.15.82:0/3159476439 shutdown_connections 2023-09-23T08:55:26.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:26.930+0000 7f3083d9a700 1 -- 172.21.15.82:0/3159476439 wait complete. 2023-09-23T08:55:27.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:27.030+0000 7f247bea4700 1 -- 172.21.15.82:0/1792906671 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2474072d50 msgr2=0x7f2474073130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:27.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:27.030+0000 7f247bea4700 1 --2- 172.21.15.82:0/1792906671 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2474072d50 0x7f2474073130 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2470009990 tx=0x7f2470009ca0 comp rx=0 tx=0).stop 2023-09-23T08:55:27.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:27.030+0000 7f247bea4700 1 -- 172.21.15.82:0/1792906671 shutdown_connections 2023-09-23T08:55:27.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:27.030+0000 7f247bea4700 1 --2- 172.21.15.82:0/1792906671 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f247410d180 0x7f247410f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:27.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:27.030+0000 7f247bea4700 1 --2- 172.21.15.82:0/1792906671 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2474072d50 0x7f2474073130 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:27.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:27.030+0000 7f247bea4700 1 --2- 172.21.15.82:0/1792906671 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2474073670 0x7f247410cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:27.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:27.030+0000 7f247bea4700 1 -- 172.21.15.82:0/1792906671 >> 172.21.15.82:0/1792906671 conn(0x7f24740fc410 msgr2=0x7f24740fe830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:27.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:27.030+0000 7f247bea4700 1 -- 172.21.15.82:0/1792906671 shutdown_connections 2023-09-23T08:55:27.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:27.030+0000 7f247bea4700 1 -- 172.21.15.82:0/1792906671 wait complete. 2023-09-23T08:55:27.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:27.032+0000 7f247bea4700 1 Processor -- start 2023-09-23T08:55:27.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:27.032+0000 7f247bea4700 1 -- start start 2023-09-23T08:55:27.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:27.032+0000 7f247bea4700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2474072d50 0x7f247419e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:27.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:27.032+0000 7f247bea4700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2474073670 0x7f247419ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:27.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:27.032+0000 7f247bea4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f247410d180 0x7f24741989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:27.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:27.033+0000 7f247bea4700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2474199040 con 0x7f247410d180 2023-09-23T08:55:27.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:27.033+0000 7f247bea4700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24741991b0 con 0x7f2474072d50 2023-09-23T08:55:27.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:27.033+0000 7f247bea4700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2474199370 con 0x7f2474073670 2023-09-23T08:55:27.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:27.033+0000 7f247a441700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f247410d180 0x7f24741989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:27.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:27.033+0000 7f247a441700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f247410d180 0x7f24741989d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34918/0 (socket says 172.21.15.82:34918) 2023-09-23T08:55:27.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:27.033+0000 7f247a441700 1 -- 172.21.15.82:0/1159133234 learned_addr learned my addr 172.21.15.82:0/1159133234 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:55:27.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:27.033+0000 7f2479c40700 1 --2- 172.21.15.82:0/1159133234 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2474072d50 0x7f247419e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:27.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:27.033+0000 7f247943f700 1 --2- 172.21.15.82:0/1159133234 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2474073670 0x7f247419ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:27.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:27.033+0000 7f247a441700 1 -- 172.21.15.82:0/1159133234 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2474073670 msgr2=0x7f247419ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:27.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:27.033+0000 7f247a441700 1 --2- 172.21.15.82:0/1159133234 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2474073670 0x7f247419ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:27.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:27.033+0000 7f247a441700 1 -- 172.21.15.82:0/1159133234 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2474072d50 msgr2=0x7f247419e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:27.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:27.033+0000 7f247a441700 1 --2- 172.21.15.82:0/1159133234 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2474072d50 0x7f247419e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:27.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:27.033+0000 7f247a441700 1 -- 172.21.15.82:0/1159133234 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24700095f0 con 0x7f247410d180 2023-09-23T08:55:27.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:27.033+0000 7f247943f700 1 --2- 172.21.15.82:0/1159133234 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2474073670 0x7f247419ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T08:55:27.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:27.034+0000 7f247a441700 1 --2- 172.21.15.82:0/1159133234 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f247410d180 0x7f24741989d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f246c00ef30 tx=0x7f246c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:27.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:27.034+0000 7f246affd700 1 -- 172.21.15.82:0/1159133234 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f246c018070 con 0x7f247410d180 2023-09-23T08:55:27.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:27.034+0000 7f246affd700 1 -- 172.21.15.82:0/1159133234 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f246c00f040 con 0x7f247410d180 2023-09-23T08:55:27.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:27.034+0000 7f246affd700 1 -- 172.21.15.82:0/1159133234 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f246c00cc70 con 0x7f247410d180 2023-09-23T08:55:27.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:27.034+0000 7f247bea4700 1 -- 172.21.15.82:0/1159133234 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24741995f0 con 0x7f247410d180 2023-09-23T08:55:27.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:27.034+0000 7f247bea4700 1 -- 172.21.15.82:0/1159133234 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24741a5940 con 0x7f247410d180 2023-09-23T08:55:27.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:27.035+0000 7f247bea4700 1 -- 172.21.15.82:0/1159133234 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2474112c20 con 0x7f247410d180 2023-09-23T08:55:27.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:27.037+0000 7f246affd700 1 -- 172.21.15.82:0/1159133234 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) v1 ==== 134722+0+0 (secure 0 0 0) 0x7f246c007500 con 0x7f247410d180 2023-09-23T08:55:27.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:27.040+0000 7f246affd700 1 --2- 172.21.15.82:0/1159133234 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f24600a0060 0x7f24600a2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:27.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:27.040+0000 7f246affd700 1 -- 172.21.15.82:0/1159133234 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f246c0cb800 con 0x7f247410d180 2023-09-23T08:55:27.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:27.040+0000 7f2479c40700 1 --2- 172.21.15.82:0/1159133234 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f24600a0060 0x7f24600a2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:27.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:27.041+0000 7f246affd700 1 --2- 172.21.15.82:0/1159133234 >> [v2:172.21.15.82:6810/1081464528,v1:172.21.15.82:6811/1081464528] conn(0x7f24600a9ba0 0x7f24600ac040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:27.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:27.041+0000 7f246affd700 1 -- 172.21.15.82:0/1159133234 --> [v2:172.21.15.82:6810/1081464528,v1:172.21.15.82:6811/1081464528] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f24600ac710 con 0x7f24600a9ba0 2023-09-23T08:55:27.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:27.041+0000 7f246affd700 1 -- 172.21.15.82:0/1159133234 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7f246c0cbb70 con 0x7f247410d180 2023-09-23T08:55:27.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:27.041+0000 7f2479c40700 1 --2- 172.21.15.82:0/1159133234 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f24600a0060 0x7f24600a2520 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2470006010 tx=0x7f247000b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:27.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:27.041+0000 7f247943f700 1 --2- 172.21.15.82:0/1159133234 >> [v2:172.21.15.82:6810/1081464528,v1:172.21.15.82:6811/1081464528] conn(0x7f24600a9ba0 0x7f24600ac040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:27.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:27.042+0000 7f247943f700 1 --2- 172.21.15.82:0/1159133234 >> [v2:172.21.15.82:6810/1081464528,v1:172.21.15.82:6811/1081464528] conn(0x7f24600a9ba0 0x7f24600ac040 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:27.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:27.042+0000 7f246affd700 1 -- 172.21.15.82:0/1159133234 <== osd.3 v2:172.21.15.82:6810/1081464528 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f24600ac710 con 0x7f24600a9ba0 2023-09-23T08:55:27.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:27.068+0000 7f247bea4700 1 -- 172.21.15.82:0/1159133234 --> [v2:172.21.15.82:6810/1081464528,v1:172.21.15.82:6811/1081464528] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f24740fe350 con 0x7f24600a9ba0 2023-09-23T08:55:27.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:27.068+0000 7f246affd700 1 -- 172.21.15.82:0/1159133234 <== osd.3 v2:172.21.15.82:6810/1081464528 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f24740fe350 con 0x7f24600a9ba0 2023-09-23T08:55:27.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:27.069+0000 7f247bea4700 1 -- 172.21.15.82:0/1159133234 >> [v2:172.21.15.82:6810/1081464528,v1:172.21.15.82:6811/1081464528] conn(0x7f24600a9ba0 msgr2=0x7f24600ac040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:27.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:27.069+0000 7f247bea4700 1 --2- 172.21.15.82:0/1159133234 >> [v2:172.21.15.82:6810/1081464528,v1:172.21.15.82:6811/1081464528] conn(0x7f24600a9ba0 0x7f24600ac040 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:27.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:27.069+0000 7f247bea4700 1 -- 172.21.15.82:0/1159133234 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f24600a0060 msgr2=0x7f24600a2520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:27.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:27.069+0000 7f247bea4700 1 --2- 172.21.15.82:0/1159133234 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f24600a0060 0x7f24600a2520 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2470006010 tx=0x7f247000b260 comp rx=0 tx=0).stop 2023-09-23T08:55:27.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:27.069+0000 7f247bea4700 1 -- 172.21.15.82:0/1159133234 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f247410d180 msgr2=0x7f24741989d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:27.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:27.069+0000 7f247bea4700 1 --2- 172.21.15.82:0/1159133234 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f247410d180 0x7f24741989d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f246c00ef30 tx=0x7f246c00c3a0 comp rx=0 tx=0).stop 2023-09-23T08:55:27.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:27.071+0000 7f247a441700 1 -- 172.21.15.82:0/1159133234 reap_dead start 2023-09-23T08:55:27.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:27.071+0000 7f247bea4700 1 -- 172.21.15.82:0/1159133234 shutdown_connections 2023-09-23T08:55:27.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:27.071+0000 7f247bea4700 1 -- 172.21.15.82:0/1159133234 >> 172.21.15.82:0/1159133234 conn(0x7f24740fc410 msgr2=0x7f247410f3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:27.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:27.071+0000 7f247bea4700 1 -- 172.21.15.82:0/1159133234 shutdown_connections 2023-09-23T08:55:27.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:27.071+0000 7f247bea4700 1 -- 172.21.15.82:0/1159133234 wait complete. 2023-09-23T08:55:27.514 INFO:teuthology.orchestra.run.smithi082.stdout:223338299434 2023-09-23T08:55:27.514 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- ceph osd last-stat-seq osd.7 2023-09-23T08:55:27.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:27 smithi135 ceph-mon[99205]: pgmap v320: 97 pgs: 3 peering, 94 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 639 B/s wr, 11 op/s; 83 B/s, 0 objects/s recovering 2023-09-23T08:55:27.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:27 smithi082 ceph-mon[97694]: pgmap v320: 97 pgs: 3 peering, 94 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 639 B/s wr, 11 op/s; 83 B/s, 0 objects/s recovering 2023-09-23T08:55:27.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:27 smithi161 ceph-mon[99580]: pgmap v320: 97 pgs: 3 peering, 94 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 639 B/s wr, 11 op/s; 83 B/s, 0 objects/s recovering 2023-09-23T08:55:27.941 INFO:teuthology.orchestra.run.smithi082.stdout:167503724597 2023-09-23T08:55:27.941 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- ceph osd last-stat-seq osd.5 2023-09-23T08:55:28.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.106+0000 7f218a8dd700 1 -- 172.21.15.82:0/505125135 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2184113a70 msgr2=0x7f2184115e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:28.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.106+0000 7f218a8dd700 1 --2- 172.21.15.82:0/505125135 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2184113a70 0x7f2184115e60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f217c009f90 tx=0x7f217c00b330 comp rx=0 tx=0).stop 2023-09-23T08:55:28.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.106+0000 7f218a8dd700 1 -- 172.21.15.82:0/505125135 shutdown_connections 2023-09-23T08:55:28.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.106+0000 7f218a8dd700 1 --2- 172.21.15.82:0/505125135 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2184113a70 0x7f2184115e60 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:28.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.106+0000 7f218a8dd700 1 --2- 172.21.15.82:0/505125135 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2184107b30 0x7f2184107f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:28.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.106+0000 7f218a8dd700 1 --2- 172.21.15.82:0/505125135 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2184108450 0x7f2184113530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:28.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.106+0000 7f218a8dd700 1 -- 172.21.15.82:0/505125135 >> 172.21.15.82:0/505125135 conn(0x7f218406cb20 msgr2=0x7f218406cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:28.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.106+0000 7f218a8dd700 1 -- 172.21.15.82:0/505125135 shutdown_connections 2023-09-23T08:55:28.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.106+0000 7f218a8dd700 1 -- 172.21.15.82:0/505125135 wait complete. 2023-09-23T08:55:28.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.107+0000 7f218a8dd700 1 Processor -- start 2023-09-23T08:55:28.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.107+0000 7f218a8dd700 1 -- start start 2023-09-23T08:55:28.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.108+0000 7f218a8dd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2184107b30 0x7f21841a1510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:28.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.108+0000 7f218a8dd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2184108450 0x7f21841a1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:28.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.108+0000 7f218a8dd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2184113a70 0x7f21841a5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:28.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.108+0000 7f218a8dd700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21841a64d0 con 0x7f2184113a70 2023-09-23T08:55:28.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.108+0000 7f218a8dd700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21841a6640 con 0x7f2184108450 2023-09-23T08:55:28.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.108+0000 7f218a8dd700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21841a6800 con 0x7f2184107b30 2023-09-23T08:55:28.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.108+0000 7f2188e7a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2184113a70 0x7f21841a5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:28.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.108+0000 7f2188e7a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2184113a70 0x7f21841a5ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34930/0 (socket says 172.21.15.82:34930) 2023-09-23T08:55:28.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.108+0000 7f2188e7a700 1 -- 172.21.15.82:0/2391585308 learned_addr learned my addr 172.21.15.82:0/2391585308 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:55:28.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.109+0000 7f21837fe700 1 --2- 172.21.15.82:0/2391585308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2184108450 0x7f21841a1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:28.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.109+0000 7f2188e7a700 1 -- 172.21.15.82:0/2391585308 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2184107b30 msgr2=0x7f21841a1510 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-09-23T08:55:28.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.109+0000 7f2188e7a700 1 --2- 172.21.15.82:0/2391585308 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2184107b30 0x7f21841a1510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:28.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.109+0000 7f2188e7a700 1 -- 172.21.15.82:0/2391585308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2184108450 msgr2=0x7f21841a1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:28.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.109+0000 7f2188e7a700 1 --2- 172.21.15.82:0/2391585308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2184108450 0x7f21841a1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:28.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.109+0000 7f2188e7a700 1 -- 172.21.15.82:0/2391585308 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f217c009c40 con 0x7f2184113a70 2023-09-23T08:55:28.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.109+0000 7f2188e7a700 1 --2- 172.21.15.82:0/2391585308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2184113a70 0x7f21841a5ec0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f217c00d010 tx=0x7f217c0077e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:28.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.110+0000 7f21817fa700 1 -- 172.21.15.82:0/2391585308 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f217c00e040 con 0x7f2184113a70 2023-09-23T08:55:28.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.110+0000 7f218a8dd700 1 -- 172.21.15.82:0/2391585308 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21841a6a80 con 0x7f2184113a70 2023-09-23T08:55:28.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.110+0000 7f21817fa700 1 -- 172.21.15.82:0/2391585308 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f217c009350 con 0x7f2184113a70 2023-09-23T08:55:28.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.110+0000 7f21817fa700 1 -- 172.21.15.82:0/2391585308 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f217c01b6b0 con 0x7f2184113a70 2023-09-23T08:55:28.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.110+0000 7f218a8dd700 1 -- 172.21.15.82:0/2391585308 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21841ae340 con 0x7f2184113a70 2023-09-23T08:55:28.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.111+0000 7f218a8dd700 1 -- 172.21.15.82:0/2391585308 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f21841192b0 con 0x7f2184113a70 2023-09-23T08:55:28.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.116+0000 7f21817fa700 1 -- 172.21.15.82:0/2391585308 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) v1 ==== 134722+0+0 (secure 0 0 0) 0x7f217c01d480 con 0x7f2184113a70 2023-09-23T08:55:28.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.118+0000 7f21817fa700 1 --2- 172.21.15.82:0/2391585308 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f216c0a0060 0x7f216c0a2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:28.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.118+0000 7f21817fa700 1 -- 172.21.15.82:0/2391585308 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f217c0cd3d0 con 0x7f2184113a70 2023-09-23T08:55:28.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.119+0000 7f2183fff700 1 --2- 172.21.15.82:0/2391585308 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f216c0a0060 0x7f216c0a2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:28.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.119+0000 7f21817fa700 1 --2- 172.21.15.82:0/2391585308 >> [v2:172.21.15.161:6824/1459332081,v1:172.21.15.161:6825/1459332081] conn(0x7f216c0a9ba0 0x7f216c0ac040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:28.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.119+0000 7f21817fa700 1 -- 172.21.15.82:0/2391585308 --> [v2:172.21.15.161:6824/1459332081,v1:172.21.15.161:6825/1459332081] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f216c0ac710 con 0x7f216c0a9ba0 2023-09-23T08:55:28.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.119+0000 7f21817fa700 1 -- 172.21.15.82:0/2391585308 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7f217c0cd740 con 0x7f2184113a70 2023-09-23T08:55:28.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.119+0000 7f21837fe700 1 --2- 172.21.15.82:0/2391585308 >> [v2:172.21.15.161:6824/1459332081,v1:172.21.15.161:6825/1459332081] conn(0x7f216c0a9ba0 0x7f216c0ac040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:28.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.119+0000 7f2183fff700 1 --2- 172.21.15.82:0/2391585308 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f216c0a0060 0x7f216c0a2520 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2174009af0 tx=0x7f2174009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:28.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.120+0000 7f21837fe700 1 --2- 172.21.15.82:0/2391585308 >> [v2:172.21.15.161:6824/1459332081,v1:172.21.15.161:6825/1459332081] conn(0x7f216c0a9ba0 0x7f216c0ac040 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:28.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.121+0000 7f21817fa700 1 -- 172.21.15.82:0/2391585308 <== osd.11 v2:172.21.15.161:6824/1459332081 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f216c0ac710 con 0x7f216c0a9ba0 2023-09-23T08:55:28.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.154+0000 7f218a8dd700 1 -- 172.21.15.82:0/2391585308 --> [v2:172.21.15.161:6824/1459332081,v1:172.21.15.161:6825/1459332081] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f218404e620 con 0x7f216c0a9ba0 2023-09-23T08:55:28.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.155+0000 7f21817fa700 1 -- 172.21.15.82:0/2391585308 <== osd.11 v2:172.21.15.161:6824/1459332081 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f218404e620 con 0x7f216c0a9ba0 2023-09-23T08:55:28.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.156+0000 7f218a8dd700 1 -- 172.21.15.82:0/2391585308 >> [v2:172.21.15.161:6824/1459332081,v1:172.21.15.161:6825/1459332081] conn(0x7f216c0a9ba0 msgr2=0x7f216c0ac040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:28.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.156+0000 7f218a8dd700 1 --2- 172.21.15.82:0/2391585308 >> [v2:172.21.15.161:6824/1459332081,v1:172.21.15.161:6825/1459332081] conn(0x7f216c0a9ba0 0x7f216c0ac040 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:28.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.156+0000 7f218a8dd700 1 -- 172.21.15.82:0/2391585308 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f216c0a0060 msgr2=0x7f216c0a2520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:28.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.156+0000 7f218a8dd700 1 --2- 172.21.15.82:0/2391585308 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f216c0a0060 0x7f216c0a2520 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2174009af0 tx=0x7f2174009260 comp rx=0 tx=0).stop 2023-09-23T08:55:28.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.156+0000 7f218a8dd700 1 -- 172.21.15.82:0/2391585308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2184113a70 msgr2=0x7f21841a5ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:28.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.156+0000 7f218a8dd700 1 --2- 172.21.15.82:0/2391585308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2184113a70 0x7f21841a5ec0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f217c00d010 tx=0x7f217c0077e0 comp rx=0 tx=0).stop 2023-09-23T08:55:28.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.156+0000 7f2188e7a700 1 -- 172.21.15.82:0/2391585308 reap_dead start 2023-09-23T08:55:28.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.156+0000 7f218a8dd700 1 -- 172.21.15.82:0/2391585308 shutdown_connections 2023-09-23T08:55:28.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.156+0000 7f218a8dd700 1 -- 172.21.15.82:0/2391585308 >> 172.21.15.82:0/2391585308 conn(0x7f218406cb20 msgr2=0x7f218410f8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:28.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.156+0000 7f218a8dd700 1 -- 172.21.15.82:0/2391585308 shutdown_connections 2023-09-23T08:55:28.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.156+0000 7f218a8dd700 1 -- 172.21.15.82:0/2391585308 wait complete. 2023-09-23T08:55:28.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.197+0000 7f8f2593f700 1 -- 172.21.15.82:0/3554530800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f20106940 msgr2=0x7f8f20106d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:28.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.197+0000 7f8f2593f700 1 --2- 172.21.15.82:0/3554530800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f20106940 0x7f8f20106d20 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8f10009990 tx=0x7f8f10009ca0 comp rx=0 tx=0).stop 2023-09-23T08:55:28.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.197+0000 7f8f2593f700 1 -- 172.21.15.82:0/3554530800 shutdown_connections 2023-09-23T08:55:28.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.197+0000 7f8f2593f700 1 --2- 172.21.15.82:0/3554530800 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f20101300 0x7f8f2010d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:28.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.197+0000 7f8f2593f700 1 --2- 172.21.15.82:0/3554530800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f20106940 0x7f8f20106d20 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:28.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.197+0000 7f8f2593f700 1 --2- 172.21.15.82:0/3554530800 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8f20100940 0x7f8f20100dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:28.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.197+0000 7f8f2593f700 1 -- 172.21.15.82:0/3554530800 >> 172.21.15.82:0/3554530800 conn(0x7f8f200fc410 msgr2=0x7f8f200fe830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:28.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.197+0000 7f8f2593f700 1 -- 172.21.15.82:0/3554530800 shutdown_connections 2023-09-23T08:55:28.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.197+0000 7f8f2593f700 1 -- 172.21.15.82:0/3554530800 wait complete. 2023-09-23T08:55:28.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.199+0000 7f8f2593f700 1 Processor -- start 2023-09-23T08:55:28.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.199+0000 7f8f2593f700 1 -- start start 2023-09-23T08:55:28.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.199+0000 7f8f2593f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f20100940 0x7f8f20072c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:28.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.199+0000 7f8f2593f700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8f20101300 0x7f8f20073160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:28.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.199+0000 7f8f2593f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f20106940 0x7f8f200736e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:28.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.199+0000 7f8f2593f700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f201a4eb0 con 0x7f8f20106940 2023-09-23T08:55:28.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.199+0000 7f8f2593f700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f201a5020 con 0x7f8f20100940 2023-09-23T08:55:28.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.199+0000 7f8f2593f700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f201a51e0 con 0x7f8f20101300 2023-09-23T08:55:28.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.200+0000 7f8f16ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f20100940 0x7f8f20072c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:28.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.200+0000 7f8f1f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f20106940 0x7f8f200736e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:28.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.200+0000 7f8f16ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f20100940 0x7f8f20072c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:45082/0 (socket says 172.21.15.82:45082) 2023-09-23T08:55:28.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.200+0000 7f8f1effd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8f20101300 0x7f8f20073160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:28.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.200+0000 7f8f16ffd700 1 -- 172.21.15.82:0/732993374 learned_addr learned my addr 172.21.15.82:0/732993374 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:55:28.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.200+0000 7f8f1effd700 1 -- 172.21.15.82:0/732993374 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f20100940 msgr2=0x7f8f20072c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:28.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.200+0000 7f8f1effd700 1 --2- 172.21.15.82:0/732993374 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f20100940 0x7f8f20072c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:28.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.200+0000 7f8f1effd700 1 -- 172.21.15.82:0/732993374 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f20106940 msgr2=0x7f8f200736e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:28.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.200+0000 7f8f1effd700 1 --2- 172.21.15.82:0/732993374 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f20106940 0x7f8f200736e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:28.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.200+0000 7f8f1effd700 1 -- 172.21.15.82:0/732993374 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f100095f0 con 0x7f8f20101300 2023-09-23T08:55:28.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.200+0000 7f8f1f7fe700 1 --2- 172.21.15.82:0/732993374 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f20106940 0x7f8f200736e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T08:55:28.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.201+0000 7f8f1effd700 1 --2- 172.21.15.82:0/732993374 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8f20101300 0x7f8f20073160 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8f0800e9f0 tx=0x7f8f0800ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:28.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.201+0000 7f8f2493d700 1 -- 172.21.15.82:0/732993374 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f0800c9c0 con 0x7f8f20101300 2023-09-23T08:55:28.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.201+0000 7f8f2593f700 1 -- 172.21.15.82:0/732993374 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f201a54c0 con 0x7f8f20101300 2023-09-23T08:55:28.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.201+0000 7f8f2493d700 1 -- 172.21.15.82:0/732993374 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8f08010430 con 0x7f8f20101300 2023-09-23T08:55:28.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.201+0000 7f8f2493d700 1 -- 172.21.15.82:0/732993374 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f08018680 con 0x7f8f20101300 2023-09-23T08:55:28.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.201+0000 7f8f2593f700 1 -- 172.21.15.82:0/732993374 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f201a5a10 con 0x7f8f20101300 2023-09-23T08:55:28.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.202+0000 7f8f2593f700 1 -- 172.21.15.82:0/732993374 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8f20110a90 con 0x7f8f20101300 2023-09-23T08:55:28.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.204+0000 7f8f2493d700 1 -- 172.21.15.82:0/732993374 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 17) v1 ==== 134722+0+0 (secure 0 0 0) 0x7f8f080105a0 con 0x7f8f20101300 2023-09-23T08:55:28.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.207+0000 7f8f2493d700 1 --2- 172.21.15.82:0/732993374 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f8f0c09ffe0 0x7f8f0c0a24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:28.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.207+0000 7f8f2493d700 1 -- 172.21.15.82:0/732993374 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f8f08014070 con 0x7f8f20101300 2023-09-23T08:55:28.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.207+0000 7f8f16ffd700 1 --2- 172.21.15.82:0/732993374 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f8f0c09ffe0 0x7f8f0c0a24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:28.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.207+0000 7f8f2493d700 1 --2- 172.21.15.82:0/732993374 >> [v2:172.21.15.135:6824/2853697851,v1:172.21.15.135:6825/2853697851] conn(0x7f8f0c0a9b20 0x7f8f0c0abfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:28.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.207+0000 7f8f2493d700 1 -- 172.21.15.82:0/732993374 --> [v2:172.21.15.135:6824/2853697851,v1:172.21.15.135:6825/2853697851] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8f0c0ac690 con 0x7f8f0c0a9b20 2023-09-23T08:55:28.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.207+0000 7f8f2493d700 1 -- 172.21.15.82:0/732993374 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8f080cbcb0 con 0x7f8f20101300 2023-09-23T08:55:28.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.208+0000 7f8f1f7fe700 1 --2- 172.21.15.82:0/732993374 >> [v2:172.21.15.135:6824/2853697851,v1:172.21.15.135:6825/2853697851] conn(0x7f8f0c0a9b20 0x7f8f0c0abfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:28.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.208+0000 7f8f16ffd700 1 --2- 172.21.15.82:0/732993374 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f8f0c09ffe0 0x7f8f0c0a24a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8f10006010 tx=0x7f8f1000b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:28.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.208+0000 7f8f1f7fe700 1 --2- 172.21.15.82:0/732993374 >> [v2:172.21.15.135:6824/2853697851,v1:172.21.15.135:6825/2853697851] conn(0x7f8f0c0a9b20 0x7f8f0c0abfc0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:28.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.221+0000 7f8f2493d700 1 -- 172.21.15.82:0/732993374 <== osd.10 v2:172.21.15.135:6824/2853697851 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f8f0c0ac690 con 0x7f8f0c0a9b20 2023-09-23T08:55:28.249 INFO:teuthology.orchestra.run.smithi082.stdout:292057776158 2023-09-23T08:55:28.249 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- ceph osd last-stat-seq osd.9 2023-09-23T08:55:28.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.251+0000 7f8f2593f700 1 -- 172.21.15.82:0/732993374 --> [v2:172.21.15.135:6824/2853697851,v1:172.21.15.135:6825/2853697851] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8f2004e620 con 0x7f8f0c0a9b20 2023-09-23T08:55:28.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.252+0000 7f8f2493d700 1 -- 172.21.15.82:0/732993374 <== osd.10 v2:172.21.15.135:6824/2853697851 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f8f2004e620 con 0x7f8f0c0a9b20 2023-09-23T08:55:28.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.253+0000 7f8f2593f700 1 -- 172.21.15.82:0/732993374 >> [v2:172.21.15.135:6824/2853697851,v1:172.21.15.135:6825/2853697851] conn(0x7f8f0c0a9b20 msgr2=0x7f8f0c0abfc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:28.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.253+0000 7f8f2593f700 1 --2- 172.21.15.82:0/732993374 >> [v2:172.21.15.135:6824/2853697851,v1:172.21.15.135:6825/2853697851] conn(0x7f8f0c0a9b20 0x7f8f0c0abfc0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:28.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.253+0000 7f8f2593f700 1 -- 172.21.15.82:0/732993374 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f8f0c09ffe0 msgr2=0x7f8f0c0a24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:28.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.253+0000 7f8f2593f700 1 --2- 172.21.15.82:0/732993374 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f8f0c09ffe0 0x7f8f0c0a24a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8f10006010 tx=0x7f8f1000b260 comp rx=0 tx=0).stop 2023-09-23T08:55:28.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.253+0000 7f8f2593f700 1 -- 172.21.15.82:0/732993374 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8f20101300 msgr2=0x7f8f20073160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:28.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.253+0000 7f8f2593f700 1 --2- 172.21.15.82:0/732993374 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8f20101300 0x7f8f20073160 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8f0800e9f0 tx=0x7f8f0800ed00 comp rx=0 tx=0).stop 2023-09-23T08:55:28.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.253+0000 7f8f1f7fe700 1 -- 172.21.15.82:0/732993374 reap_dead start 2023-09-23T08:55:28.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.254+0000 7f8f2593f700 1 -- 172.21.15.82:0/732993374 shutdown_connections 2023-09-23T08:55:28.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.254+0000 7f8f2593f700 1 -- 172.21.15.82:0/732993374 >> 172.21.15.82:0/732993374 conn(0x7f8f200fc410 msgr2=0x7f8f200fcbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:28.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.254+0000 7f8f2593f700 1 -- 172.21.15.82:0/732993374 shutdown_connections 2023-09-23T08:55:28.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:28.254+0000 7f8f2593f700 1 -- 172.21.15.82:0/732993374 wait complete. 2023-09-23T08:55:28.826 INFO:teuthology.orchestra.run.smithi082.stdout:347892350998 2023-09-23T08:55:28.827 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- ceph osd last-stat-seq osd.11 2023-09-23T08:55:29.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:29.179+0000 7f59ad55e700 1 -- 172.21.15.82:0/3934872206 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59a8101b00 msgr2=0x7f59a8101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:29.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:29.179+0000 7f59ad55e700 1 --2- 172.21.15.82:0/3934872206 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59a8101b00 0x7f59a8101ee0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f5998009990 tx=0x7f5998009ca0 comp rx=0 tx=0).stop 2023-09-23T08:55:29.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:29.179+0000 7f59ad55e700 1 -- 172.21.15.82:0/3934872206 shutdown_connections 2023-09-23T08:55:29.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:29.179+0000 7f59ad55e700 1 --2- 172.21.15.82:0/3934872206 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f59a810af30 0x7f59a810d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:29.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:29.179+0000 7f59ad55e700 1 --2- 172.21.15.82:0/3934872206 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59a8101b00 0x7f59a8101ee0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:29.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:29.179+0000 7f59ad55e700 1 --2- 172.21.15.82:0/3934872206 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59a8102420 0x7f59a810a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:29.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:29.179+0000 7f59ad55e700 1 -- 172.21.15.82:0/3934872206 >> 172.21.15.82:0/3934872206 conn(0x7f59a80fb390 msgr2=0x7f59a80fd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:29.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:29.179+0000 7f59ad55e700 1 -- 172.21.15.82:0/3934872206 shutdown_connections 2023-09-23T08:55:29.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:29.179+0000 7f59ad55e700 1 -- 172.21.15.82:0/3934872206 wait complete. 2023-09-23T08:55:29.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:29.180+0000 7f59ad55e700 1 Processor -- start 2023-09-23T08:55:29.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:29.180+0000 7f59ad55e700 1 -- start start 2023-09-23T08:55:29.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:29.181+0000 7f59ad55e700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f59a8101b00 0x7f59a819e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:29.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:29.181+0000 7f59ad55e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59a8102420 0x7f59a819eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:29.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:29.181+0000 7f59ad55e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59a810af30 0x7f59a8198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:29.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:29.181+0000 7f59ad55e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59a8199080 con 0x7f59a810af30 2023-09-23T08:55:29.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:29.181+0000 7f59ad55e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59a81991f0 con 0x7f59a8102420 2023-09-23T08:55:29.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:29.181+0000 7f59ad55e700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59a81993b0 con 0x7f59a8101b00 2023-09-23T08:55:29.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:29.181+0000 7f59a77fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59a810af30 0x7f59a8198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:29.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:29.181+0000 7f59a77fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59a810af30 0x7f59a8198a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34964/0 (socket says 172.21.15.82:34964) 2023-09-23T08:55:29.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:29.181+0000 7f59a77fe700 1 -- 172.21.15.82:0/2026467136 learned_addr learned my addr 172.21.15.82:0/2026467136 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:55:29.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:29.181+0000 7f59a67fc700 1 --2- 172.21.15.82:0/2026467136 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59a8102420 0x7f59a819eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:29.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:29.181+0000 7f59a6ffd700 1 --2- 172.21.15.82:0/2026467136 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f59a8101b00 0x7f59a819e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:29.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:29.182+0000 7f59a77fe700 1 -- 172.21.15.82:0/2026467136 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f59a8101b00 msgr2=0x7f59a819e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:29.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:29.182+0000 7f59a77fe700 1 --2- 172.21.15.82:0/2026467136 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f59a8101b00 0x7f59a819e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:29.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:29.182+0000 7f59a77fe700 1 -- 172.21.15.82:0/2026467136 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59a8102420 msgr2=0x7f59a819eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:29.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:29.182+0000 7f59a77fe700 1 --2- 172.21.15.82:0/2026467136 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59a8102420 0x7f59a819eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:29.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:29.182+0000 7f59a77fe700 1 -- 172.21.15.82:0/2026467136 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59980095f0 con 0x7f59a810af30 2023-09-23T08:55:29.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:29.182+0000 7f59a77fe700 1 --2- 172.21.15.82:0/2026467136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59a810af30 0x7f59a8198a10 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f59a0007ee0 tx=0x7f59a000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:29.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:29.182+0000 7f598ffff700 1 -- 172.21.15.82:0/2026467136 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a0017070 con 0x7f59a810af30 2023-09-23T08:55:29.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:29.182+0000 7f598ffff700 1 -- 172.21.15.82:0/2026467136 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f59a000f040 con 0x7f59a810af30 2023-09-23T08:55:29.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:29.182+0000 7f59ad55e700 1 -- 172.21.15.82:0/2026467136 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59a8199690 con 0x7f59a810af30 2023-09-23T08:55:29.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:29.182+0000 7f598ffff700 1 -- 172.21.15.82:0/2026467136 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a0005570 con 0x7f59a810af30 2023-09-23T08:55:29.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:29.182+0000 7f59ad55e700 1 -- 172.21.15.82:0/2026467136 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59a81a5980 con 0x7f59a810af30 2023-09-23T08:55:29.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:29.183+0000 7f59ad55e700 1 -- 172.21.15.82:0/2026467136 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f59a8110a70 con 0x7f59a810af30 2023-09-23T08:55:29.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:29.185+0000 7f598ffff700 1 -- 172.21.15.82:0/2026467136 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) v1 ==== 134722+0+0 (secure 0 0 0) 0x7f59a000db20 con 0x7f59a810af30 2023-09-23T08:55:29.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:29.187+0000 7f598ffff700 1 --2- 172.21.15.82:0/2026467136 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f599009ffe0 0x7f59900a24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:29.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:29.187+0000 7f598ffff700 1 -- 172.21.15.82:0/2026467136 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f59a00cb170 con 0x7f59a810af30 2023-09-23T08:55:29.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:29.187+0000 7f59a6ffd700 1 --2- 172.21.15.82:0/2026467136 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f599009ffe0 0x7f59900a24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:29.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:29.187+0000 7f598ffff700 1 --2- 172.21.15.82:0/2026467136 >> [v2:172.21.15.135:6800/3224546922,v1:172.21.15.135:6801/3224546922] conn(0x7f59900a9b20 0x7f59900abfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:29.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:29.187+0000 7f598ffff700 1 -- 172.21.15.82:0/2026467136 --> [v2:172.21.15.135:6800/3224546922,v1:172.21.15.135:6801/3224546922] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f59900ac690 con 0x7f59900a9b20 2023-09-23T08:55:29.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:29.187+0000 7f598ffff700 1 -- 172.21.15.82:0/2026467136 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7f59a00cb580 con 0x7f59a810af30 2023-09-23T08:55:29.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:29.187+0000 7f59a6ffd700 1 --2- 172.21.15.82:0/2026467136 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f599009ffe0 0x7f59900a24a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f599800b5c0 tx=0x7f5998009f00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:29.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:29.188+0000 7f59a67fc700 1 --2- 172.21.15.82:0/2026467136 >> [v2:172.21.15.135:6800/3224546922,v1:172.21.15.135:6801/3224546922] conn(0x7f59900a9b20 0x7f59900abfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:29.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:29.188+0000 7f59a67fc700 1 --2- 172.21.15.82:0/2026467136 >> [v2:172.21.15.135:6800/3224546922,v1:172.21.15.135:6801/3224546922] conn(0x7f59900a9b20 0x7f59900abfc0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:29.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:29.189+0000 7f598ffff700 1 -- 172.21.15.82:0/2026467136 <== osd.1 v2:172.21.15.135:6800/3224546922 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f59900ac690 con 0x7f59900a9b20 2023-09-23T08:55:29.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:29.208+0000 7f59ad55e700 1 -- 172.21.15.82:0/2026467136 --> [v2:172.21.15.135:6800/3224546922,v1:172.21.15.135:6801/3224546922] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f59a8061020 con 0x7f59900a9b20 2023-09-23T08:55:29.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:29.208+0000 7f598ffff700 1 -- 172.21.15.82:0/2026467136 <== osd.1 v2:172.21.15.135:6800/3224546922 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f59a8061020 con 0x7f59900a9b20 2023-09-23T08:55:29.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:29.209+0000 7f59ad55e700 1 -- 172.21.15.82:0/2026467136 >> [v2:172.21.15.135:6800/3224546922,v1:172.21.15.135:6801/3224546922] conn(0x7f59900a9b20 msgr2=0x7f59900abfc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:29.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:29.209+0000 7f59ad55e700 1 --2- 172.21.15.82:0/2026467136 >> [v2:172.21.15.135:6800/3224546922,v1:172.21.15.135:6801/3224546922] conn(0x7f59900a9b20 0x7f59900abfc0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:29.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:29.209+0000 7f59ad55e700 1 -- 172.21.15.82:0/2026467136 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f599009ffe0 msgr2=0x7f59900a24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:29.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:29.209+0000 7f59ad55e700 1 --2- 172.21.15.82:0/2026467136 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f599009ffe0 0x7f59900a24a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f599800b5c0 tx=0x7f5998009f00 comp rx=0 tx=0).stop 2023-09-23T08:55:29.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:29.209+0000 7f59ad55e700 1 -- 172.21.15.82:0/2026467136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59a810af30 msgr2=0x7f59a8198a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:29.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:29.209+0000 7f59ad55e700 1 --2- 172.21.15.82:0/2026467136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59a810af30 0x7f59a8198a10 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f59a0007ee0 tx=0x7f59a000d3b0 comp rx=0 tx=0).stop 2023-09-23T08:55:29.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:29.209+0000 7f59a77fe700 1 -- 172.21.15.82:0/2026467136 reap_dead start 2023-09-23T08:55:29.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:29.209+0000 7f59ad55e700 1 -- 172.21.15.82:0/2026467136 shutdown_connections 2023-09-23T08:55:29.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:29.209+0000 7f59ad55e700 1 -- 172.21.15.82:0/2026467136 >> 172.21.15.82:0/2026467136 conn(0x7f59a80fb390 msgr2=0x7f59a810d1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:29.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:29.209+0000 7f59ad55e700 1 -- 172.21.15.82:0/2026467136 shutdown_connections 2023-09-23T08:55:29.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:29.209+0000 7f59ad55e700 1 -- 172.21.15.82:0/2026467136 wait complete. 2023-09-23T08:55:29.246 INFO:teuthology.orchestra.run.smithi082.stdout:111669149758 2023-09-23T08:55:29.247 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- ceph osd last-stat-seq osd.3 2023-09-23T08:55:29.517 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:29 smithi082 ceph-mon[97694]: pgmap v321: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 639 B/s wr, 10 op/s; 83 B/s, 1 objects/s recovering 2023-09-23T08:55:29.669 INFO:teuthology.orchestra.run.smithi082.stdout:313532612635 2023-09-23T08:55:29.669 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- ceph osd last-stat-seq osd.10 2023-09-23T08:55:29.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:29 smithi135 ceph-mon[99205]: pgmap v321: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 639 B/s wr, 10 op/s; 83 B/s, 1 objects/s recovering 2023-09-23T08:55:29.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:29 smithi161 ceph-mon[99580]: pgmap v321: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 639 B/s wr, 10 op/s; 83 B/s, 1 objects/s recovering 2023-09-23T08:55:29.996 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.a/config 2023-09-23T08:55:30.073 INFO:teuthology.orchestra.run.smithi082.stdout:201863462960 2023-09-23T08:55:30.074 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- ceph osd last-stat-seq osd.6 2023-09-23T08:55:30.106 INFO:teuthology.orchestra.run.smithi082.stdout:55834574921 2023-09-23T08:55:30.106 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- ceph osd last-stat-seq osd.1 2023-09-23T08:55:30.259 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.a/config 2023-09-23T08:55:30.408 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.a/config 2023-09-23T08:55:30.778 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.a/config 2023-09-23T08:55:30.815 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.a/config 2023-09-23T08:55:31.540 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:31 smithi082 ceph-mon[97694]: pgmap v322: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s; 83 B/s, 1 objects/s recovering 2023-09-23T08:55:31.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:31 smithi135 ceph-mon[99205]: pgmap v322: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s; 83 B/s, 1 objects/s recovering 2023-09-23T08:55:31.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:31 smithi161 ceph-mon[99580]: pgmap v322: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s; 83 B/s, 1 objects/s recovering 2023-09-23T08:55:32.900 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.a/config 2023-09-23T08:55:33.792 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:33 smithi082 ceph-mon[97694]: pgmap v323: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s; 69 B/s, 1 objects/s recovering 2023-09-23T08:55:33.798 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.a/config 2023-09-23T08:55:33.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:33 smithi135 ceph-mon[99205]: pgmap v323: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s; 69 B/s, 1 objects/s recovering 2023-09-23T08:55:33.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:33 smithi161 ceph-mon[99580]: pgmap v323: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s; 69 B/s, 1 objects/s recovering 2023-09-23T08:55:34.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:34.080+0000 7f9681994700 1 -- 172.21.15.82:0/127387416 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f967c106940 msgr2=0x7f967c106d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:34.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:34.080+0000 7f9681994700 1 --2- 172.21.15.82:0/127387416 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f967c106940 0x7f967c106d20 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f966c009990 tx=0x7f966c009ca0 comp rx=0 tx=0).stop 2023-09-23T08:55:34.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:34.080+0000 7f9681994700 1 -- 172.21.15.82:0/127387416 shutdown_connections 2023-09-23T08:55:34.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:34.080+0000 7f9681994700 1 --2- 172.21.15.82:0/127387416 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f967c101300 0x7f967c10d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:34.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:34.080+0000 7f9681994700 1 --2- 172.21.15.82:0/127387416 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f967c106940 0x7f967c106d20 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:34.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:34.080+0000 7f9681994700 1 --2- 172.21.15.82:0/127387416 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f967c100940 0x7f967c100dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:34.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:34.080+0000 7f9681994700 1 -- 172.21.15.82:0/127387416 >> 172.21.15.82:0/127387416 conn(0x7f967c0fc410 msgr2=0x7f967c0fe830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:34.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:34.080+0000 7f9681994700 1 -- 172.21.15.82:0/127387416 shutdown_connections 2023-09-23T08:55:34.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:34.080+0000 7f9681994700 1 -- 172.21.15.82:0/127387416 wait complete. 2023-09-23T08:55:34.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:34.081+0000 7f9681994700 1 Processor -- start 2023-09-23T08:55:34.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:34.081+0000 7f9681994700 1 -- start start 2023-09-23T08:55:34.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:34.081+0000 7f9681994700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f967c100940 0x7f967c072c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:34.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:34.081+0000 7f9681994700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f967c101300 0x7f967c073160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:34.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:34.081+0000 7f9681994700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f967c106940 0x7f967c0736e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:34.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:34.082+0000 7f9681994700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f967c1a4f30 con 0x7f967c106940 2023-09-23T08:55:34.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:34.082+0000 7f9681994700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f967c1a50a0 con 0x7f967c101300 2023-09-23T08:55:34.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:34.082+0000 7f9681994700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f967c1a5260 con 0x7f967c100940 2023-09-23T08:55:34.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:34.082+0000 7f967affd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f967c100940 0x7f967c072c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:34.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:34.082+0000 7f967b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f967c106940 0x7f967c0736e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:34.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:34.082+0000 7f967a7fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f967c101300 0x7f967c073160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:34.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:34.082+0000 7f967affd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f967c100940 0x7f967c072c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:50346/0 (socket says 172.21.15.82:50346) 2023-09-23T08:55:34.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:34.082+0000 7f967affd700 1 -- 172.21.15.82:0/2097320157 learned_addr learned my addr 172.21.15.82:0/2097320157 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:55:34.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:34.082+0000 7f967b7fe700 1 -- 172.21.15.82:0/2097320157 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f967c100940 msgr2=0x7f967c072c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:34.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:34.082+0000 7f967b7fe700 1 --2- 172.21.15.82:0/2097320157 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f967c100940 0x7f967c072c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:34.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:34.082+0000 7f967b7fe700 1 -- 172.21.15.82:0/2097320157 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f967c101300 msgr2=0x7f967c073160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:34.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:34.082+0000 7f967b7fe700 1 --2- 172.21.15.82:0/2097320157 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f967c101300 0x7f967c073160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:34.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:34.082+0000 7f967b7fe700 1 -- 172.21.15.82:0/2097320157 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f966c0095f0 con 0x7f967c106940 2023-09-23T08:55:34.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:34.083+0000 7f967b7fe700 1 --2- 172.21.15.82:0/2097320157 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f967c106940 0x7f967c0736e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f9674007f10 tx=0x7f967400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:34.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:34.083+0000 7f9680992700 1 -- 172.21.15.82:0/2097320157 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9674004db0 con 0x7f967c106940 2023-09-23T08:55:34.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:34.083+0000 7f9681994700 1 -- 172.21.15.82:0/2097320157 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f967c1a5540 con 0x7f967c106940 2023-09-23T08:55:34.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:34.083+0000 7f9681994700 1 -- 172.21.15.82:0/2097320157 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f967c1a5a90 con 0x7f967c106940 2023-09-23T08:55:34.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:34.083+0000 7f9680992700 1 -- 172.21.15.82:0/2097320157 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f967400f040 con 0x7f967c106940 2023-09-23T08:55:34.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:34.083+0000 7f9680992700 1 -- 172.21.15.82:0/2097320157 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9674005960 con 0x7f967c106940 2023-09-23T08:55:34.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:34.085+0000 7f9681994700 1 -- 172.21.15.82:0/2097320157 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9668005320 con 0x7f967c106940 2023-09-23T08:55:34.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:34.087+0000 7f9680992700 1 -- 172.21.15.82:0/2097320157 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) v1 ==== 134722+0+0 (secure 0 0 0) 0x7f9674005000 con 0x7f967c106940 2023-09-23T08:55:34.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:34.089+0000 7f9680992700 1 --2- 172.21.15.82:0/2097320157 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f96640a0060 0x7f96640a2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:34.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:34.090+0000 7f9680992700 1 -- 172.21.15.82:0/2097320157 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f96740cb330 con 0x7f967c106940 2023-09-23T08:55:34.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:34.090+0000 7f967affd700 1 --2- 172.21.15.82:0/2097320157 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f96640a0060 0x7f96640a2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:34.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:34.091+0000 7f967affd700 1 --2- 172.21.15.82:0/2097320157 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f96640a0060 0x7f96640a2520 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f966c006010 tx=0x7f966c00b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:34.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:34.093+0000 7f9680992700 1 -- 172.21.15.82:0/2097320157 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f9674094f10 con 0x7f967c106940 2023-09-23T08:55:34.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:34.333+0000 7f9681994700 1 -- 172.21.15.82:0/2097320157 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9668005190 con 0x7f967c106940 2023-09-23T08:55:34.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:34.334+0000 7f9680992700 1 -- 172.21.15.82:0/2097320157 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9674023020 con 0x7f967c106940 2023-09-23T08:55:34.337 INFO:teuthology.orchestra.run.smithi082.stdout:77309411396 2023-09-23T08:55:34.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:34.337+0000 7f9681994700 1 -- 172.21.15.82:0/2097320157 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f96640a0060 msgr2=0x7f96640a2520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:34.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:34.337+0000 7f9681994700 1 --2- 172.21.15.82:0/2097320157 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f96640a0060 0x7f96640a2520 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f966c006010 tx=0x7f966c00b540 comp rx=0 tx=0).stop 2023-09-23T08:55:34.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:34.337+0000 7f9681994700 1 -- 172.21.15.82:0/2097320157 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f967c106940 msgr2=0x7f967c0736e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:34.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:34.337+0000 7f9681994700 1 --2- 172.21.15.82:0/2097320157 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f967c106940 0x7f967c0736e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f9674007f10 tx=0x7f967400d3b0 comp rx=0 tx=0).stop 2023-09-23T08:55:34.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:34.337+0000 7f9681994700 1 -- 172.21.15.82:0/2097320157 shutdown_connections 2023-09-23T08:55:34.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:34.337+0000 7f9681994700 1 --2- 172.21.15.82:0/2097320157 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f96640a0060 0x7f96640a2520 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:34.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:34.337+0000 7f9681994700 1 --2- 172.21.15.82:0/2097320157 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f967c106940 0x7f967c0736e0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:34.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:34.337+0000 7f9681994700 1 --2- 172.21.15.82:0/2097320157 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f967c100940 0x7f967c072c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:34.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:34.337+0000 7f9681994700 1 --2- 172.21.15.82:0/2097320157 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f967c101300 0x7f967c073160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:34.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:34.337+0000 7f9681994700 1 -- 172.21.15.82:0/2097320157 >> 172.21.15.82:0/2097320157 conn(0x7f967c0fc410 msgr2=0x7f967c0fcbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:34.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:34.337+0000 7f9681994700 1 -- 172.21.15.82:0/2097320157 shutdown_connections 2023-09-23T08:55:34.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:34.337+0000 7f9681994700 1 -- 172.21.15.82:0/2097320157 wait complete. 2023-09-23T08:55:34.614 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.a/config 2023-09-23T08:55:34.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:34 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/2097320157' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-09-23T08:55:34.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:34 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/2097320157' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-09-23T08:55:34.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:34 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/2097320157' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-09-23T08:55:35.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.236+0000 7fa036004700 1 -- 172.21.15.82:0/1149795440 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa030105390 msgr2=0x7fa030105810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:35.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.236+0000 7fa036004700 1 --2- 172.21.15.82:0/1149795440 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa030105390 0x7fa030105810 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fa0240099c0 tx=0x7fa024009cd0 comp rx=0 tx=0).stop 2023-09-23T08:55:35.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.236+0000 7fa036004700 1 -- 172.21.15.82:0/1149795440 shutdown_connections 2023-09-23T08:55:35.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.236+0000 7fa036004700 1 --2- 172.21.15.82:0/1149795440 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa030105d50 0x7fa03010d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:35.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.236+0000 7fa036004700 1 --2- 172.21.15.82:0/1149795440 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa0300688e0 0x7fa030068cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:35.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.236+0000 7fa036004700 1 --2- 172.21.15.82:0/1149795440 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa030105390 0x7fa030105810 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:35.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.236+0000 7fa036004700 1 -- 172.21.15.82:0/1149795440 >> 172.21.15.82:0/1149795440 conn(0x7fa030076920 msgr2=0x7fa030076d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:35.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.236+0000 7fa036004700 1 -- 172.21.15.82:0/1149795440 shutdown_connections 2023-09-23T08:55:35.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.236+0000 7fa036004700 1 -- 172.21.15.82:0/1149795440 wait complete. 2023-09-23T08:55:35.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.237+0000 7fa036004700 1 Processor -- start 2023-09-23T08:55:35.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.237+0000 7fa036004700 1 -- start start 2023-09-23T08:55:35.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.237+0000 7fa036004700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa0300688e0 0x7fa03019ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:35.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.237+0000 7fa036004700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa030105390 0x7fa03019ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:35.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.237+0000 7fa036004700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa030105d50 0x7fa030198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:35.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.237+0000 7fa036004700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0301991d0 con 0x7fa030105390 2023-09-23T08:55:35.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.237+0000 7fa036004700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa030199340 con 0x7fa0300688e0 2023-09-23T08:55:35.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.237+0000 7fa036004700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa030199500 con 0x7fa030105d50 2023-09-23T08:55:35.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.238+0000 7fa02effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa030105390 0x7fa03019ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:35.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.238+0000 7fa02effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa030105390 0x7fa03019ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47212/0 (socket says 172.21.15.82:47212) 2023-09-23T08:55:35.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.238+0000 7fa02effd700 1 -- 172.21.15.82:0/2933351141 learned_addr learned my addr 172.21.15.82:0/2933351141 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:55:35.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.238+0000 7fa02f7fe700 1 --2- 172.21.15.82:0/2933351141 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa0300688e0 0x7fa03019ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:35.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.238+0000 7fa02ffff700 1 --2- 172.21.15.82:0/2933351141 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa030105d50 0x7fa030198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:35.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.238+0000 7fa02effd700 1 -- 172.21.15.82:0/2933351141 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa030105d50 msgr2=0x7fa030198a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:35.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.238+0000 7fa02effd700 1 --2- 172.21.15.82:0/2933351141 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa030105d50 0x7fa030198a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:35.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.238+0000 7fa02effd700 1 -- 172.21.15.82:0/2933351141 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa0300688e0 msgr2=0x7fa03019ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:35.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.238+0000 7fa02effd700 1 --2- 172.21.15.82:0/2933351141 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa0300688e0 0x7fa03019ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:35.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.238+0000 7fa02effd700 1 -- 172.21.15.82:0/2933351141 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0240095f0 con 0x7fa030105390 2023-09-23T08:55:35.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.238+0000 7fa02effd700 1 --2- 172.21.15.82:0/2933351141 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa030105390 0x7fa03019ef70 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa024009f50 tx=0x7fa024005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:35.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.238+0000 7fa02cff9700 1 -- 172.21.15.82:0/2933351141 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa02401d070 con 0x7fa030105390 2023-09-23T08:55:35.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.239+0000 7fa02cff9700 1 -- 172.21.15.82:0/2933351141 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa024003fc0 con 0x7fa030105390 2023-09-23T08:55:35.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.239+0000 7fa02cff9700 1 -- 172.21.15.82:0/2933351141 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa024022ca0 con 0x7fa030105390 2023-09-23T08:55:35.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.239+0000 7fa036004700 1 -- 172.21.15.82:0/2933351141 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa030199780 con 0x7fa030105390 2023-09-23T08:55:35.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.239+0000 7fa036004700 1 -- 172.21.15.82:0/2933351141 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0301a59b0 con 0x7fa030105390 2023-09-23T08:55:35.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.240+0000 7fa036004700 1 -- 172.21.15.82:0/2933351141 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa03004e620 con 0x7fa030105390 2023-09-23T08:55:35.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.242+0000 7fa02cff9700 1 -- 172.21.15.82:0/2933351141 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) v1 ==== 134722+0+0 (secure 0 0 0) 0x7fa024022470 con 0x7fa030105390 2023-09-23T08:55:35.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.244+0000 7fa02cff9700 1 --2- 172.21.15.82:0/2933351141 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fa0180a0060 0x7fa0180a2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:35.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.244+0000 7fa02cff9700 1 -- 172.21.15.82:0/2933351141 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fa0240ccf40 con 0x7fa030105390 2023-09-23T08:55:35.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.244+0000 7fa02f7fe700 1 --2- 172.21.15.82:0/2933351141 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fa0180a0060 0x7fa0180a2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:35.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.245+0000 7fa02f7fe700 1 --2- 172.21.15.82:0/2933351141 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fa0180a0060 0x7fa0180a2520 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa020009a10 tx=0x7fa020009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:35.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.247+0000 7fa02cff9700 1 -- 172.21.15.82:0/2933351141 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7fa024096c10 con 0x7fa030105390 2023-09-23T08:55:35.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.461+0000 7fa036004700 1 -- 172.21.15.82:0/2933351141 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) v1 -- 0x7fa0301108c0 con 0x7fa030105390 2023-09-23T08:55:35.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.462+0000 7fa02cff9700 1 -- 172.21.15.82:0/2933351141 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa02409a230 con 0x7fa030105390 2023-09-23T08:55:35.465 INFO:teuthology.orchestra.run.smithi082.stdout:257698037797 2023-09-23T08:55:35.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.464+0000 7fa036004700 1 -- 172.21.15.82:0/2933351141 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fa0180a0060 msgr2=0x7fa0180a2520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:35.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.464+0000 7fa036004700 1 --2- 172.21.15.82:0/2933351141 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fa0180a0060 0x7fa0180a2520 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa020009a10 tx=0x7fa020009190 comp rx=0 tx=0).stop 2023-09-23T08:55:35.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.464+0000 7fa036004700 1 -- 172.21.15.82:0/2933351141 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa030105390 msgr2=0x7fa03019ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:35.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.464+0000 7fa036004700 1 --2- 172.21.15.82:0/2933351141 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa030105390 0x7fa03019ef70 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa024009f50 tx=0x7fa024005740 comp rx=0 tx=0).stop 2023-09-23T08:55:35.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.464+0000 7fa036004700 1 -- 172.21.15.82:0/2933351141 shutdown_connections 2023-09-23T08:55:35.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.464+0000 7fa036004700 1 --2- 172.21.15.82:0/2933351141 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fa0180a0060 0x7fa0180a2520 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:35.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.464+0000 7fa036004700 1 --2- 172.21.15.82:0/2933351141 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa030105d50 0x7fa030198a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:35.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.464+0000 7fa036004700 1 --2- 172.21.15.82:0/2933351141 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa0300688e0 0x7fa03019ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:35.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.464+0000 7fa036004700 1 --2- 172.21.15.82:0/2933351141 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa030105390 0x7fa03019ef70 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:35.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.464+0000 7fa036004700 1 -- 172.21.15.82:0/2933351141 >> 172.21.15.82:0/2933351141 conn(0x7fa030076920 msgr2=0x7fa03010bb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:35.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.465+0000 7fa036004700 1 -- 172.21.15.82:0/2933351141 shutdown_connections 2023-09-23T08:55:35.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.465+0000 7fa036004700 1 -- 172.21.15.82:0/2933351141 wait complete. 2023-09-23T08:55:35.486 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.a/config 2023-09-23T08:55:35.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.486+0000 7fc499698700 1 -- 172.21.15.82:0/4290488992 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc494106940 msgr2=0x7fc494106d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:35.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.486+0000 7fc499698700 1 --2- 172.21.15.82:0/4290488992 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc494106940 0x7fc494106d20 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc484009990 tx=0x7fc484009ca0 comp rx=0 tx=0).stop 2023-09-23T08:55:35.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.487+0000 7fc499698700 1 -- 172.21.15.82:0/4290488992 shutdown_connections 2023-09-23T08:55:35.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.487+0000 7fc499698700 1 --2- 172.21.15.82:0/4290488992 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc494101300 0x7fc49410d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:35.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.487+0000 7fc499698700 1 --2- 172.21.15.82:0/4290488992 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc494106940 0x7fc494106d20 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:35.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.487+0000 7fc499698700 1 --2- 172.21.15.82:0/4290488992 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc494100940 0x7fc494100dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:35.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.487+0000 7fc499698700 1 -- 172.21.15.82:0/4290488992 >> 172.21.15.82:0/4290488992 conn(0x7fc4940fc410 msgr2=0x7fc4940fe830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:35.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.487+0000 7fc499698700 1 -- 172.21.15.82:0/4290488992 shutdown_connections 2023-09-23T08:55:35.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.487+0000 7fc499698700 1 -- 172.21.15.82:0/4290488992 wait complete. 2023-09-23T08:55:35.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.488+0000 7fc499698700 1 Processor -- start 2023-09-23T08:55:35.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.488+0000 7fc499698700 1 -- start start 2023-09-23T08:55:35.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.489+0000 7fc499698700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc494100940 0x7fc494072c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:35.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.489+0000 7fc499698700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc494101300 0x7fc494073160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:35.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.489+0000 7fc499698700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc494106940 0x7fc4940736e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:35.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.489+0000 7fc499698700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4941a4eb0 con 0x7fc494100940 2023-09-23T08:55:35.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.489+0000 7fc499698700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4941a5020 con 0x7fc494101300 2023-09-23T08:55:35.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.489+0000 7fc499698700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4941a51e0 con 0x7fc494106940 2023-09-23T08:55:35.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.489+0000 7fc48affd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc494100940 0x7fc494072c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:35.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.489+0000 7fc48affd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc494100940 0x7fc494072c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47228/0 (socket says 172.21.15.82:47228) 2023-09-23T08:55:35.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.489+0000 7fc48affd700 1 -- 172.21.15.82:0/1804580996 learned_addr learned my addr 172.21.15.82:0/1804580996 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:55:35.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.490+0000 7fc4937fe700 1 --2- 172.21.15.82:0/1804580996 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc494106940 0x7fc4940736e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:35.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.490+0000 7fc492ffd700 1 --2- 172.21.15.82:0/1804580996 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc494101300 0x7fc494073160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:35.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.490+0000 7fc48affd700 1 -- 172.21.15.82:0/1804580996 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc494106940 msgr2=0x7fc4940736e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:35.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.490+0000 7fc48affd700 1 --2- 172.21.15.82:0/1804580996 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc494106940 0x7fc4940736e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:35.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.490+0000 7fc48affd700 1 -- 172.21.15.82:0/1804580996 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc494101300 msgr2=0x7fc494073160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:35.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.490+0000 7fc48affd700 1 --2- 172.21.15.82:0/1804580996 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc494101300 0x7fc494073160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:35.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.490+0000 7fc48affd700 1 -- 172.21.15.82:0/1804580996 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4840095f0 con 0x7fc494100940 2023-09-23T08:55:35.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.490+0000 7fc48affd700 1 --2- 172.21.15.82:0/1804580996 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc494100940 0x7fc494072c20 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc484005740 tx=0x7fc484005770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:35.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.491+0000 7fc490ff9700 1 -- 172.21.15.82:0/1804580996 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc48401d070 con 0x7fc494100940 2023-09-23T08:55:35.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.491+0000 7fc490ff9700 1 -- 172.21.15.82:0/1804580996 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc484022470 con 0x7fc494100940 2023-09-23T08:55:35.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.491+0000 7fc490ff9700 1 -- 172.21.15.82:0/1804580996 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc484017650 con 0x7fc494100940 2023-09-23T08:55:35.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.492+0000 7fc499698700 1 -- 172.21.15.82:0/1804580996 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4941a5460 con 0x7fc494100940 2023-09-23T08:55:35.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.492+0000 7fc499698700 1 -- 172.21.15.82:0/1804580996 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4941a5820 con 0x7fc494100940 2023-09-23T08:55:35.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.494+0000 7fc499698700 1 -- 172.21.15.82:0/1804580996 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc49404e620 con 0x7fc494100940 2023-09-23T08:55:35.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.495+0000 7fc490ff9700 1 -- 172.21.15.82:0/1804580996 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) v1 ==== 134722+0+0 (secure 0 0 0) 0x7fc48400fb40 con 0x7fc494100940 2023-09-23T08:55:35.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.496+0000 7fc490ff9700 1 --2- 172.21.15.82:0/1804580996 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fc4800a0060 0x7fc4800a2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:35.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.497+0000 7fc490ff9700 1 -- 172.21.15.82:0/1804580996 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fc4840cc2e0 con 0x7fc494100940 2023-09-23T08:55:35.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.497+0000 7fc492ffd700 1 --2- 172.21.15.82:0/1804580996 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fc4800a0060 0x7fc4800a2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:35.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.497+0000 7fc492ffd700 1 --2- 172.21.15.82:0/1804580996 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fc4800a0060 0x7fc4800a2520 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc494074410 tx=0x7fc47c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:35.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.500+0000 7fc490ff9700 1 -- 172.21.15.82:0/1804580996 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7fc4840960d0 con 0x7fc494100940 2023-09-23T08:55:35.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.727+0000 7fc499698700 1 -- 172.21.15.82:0/1804580996 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fc4941107d0 con 0x7fc494100940 2023-09-23T08:55:35.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.727+0000 7fc490ff9700 1 -- 172.21.15.82:0/1804580996 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc484022e60 con 0x7fc494100940 2023-09-23T08:55:35.730 INFO:teuthology.orchestra.run.smithi082.stdout:146028888124 2023-09-23T08:55:35.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.730+0000 7fc499698700 1 -- 172.21.15.82:0/1804580996 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fc4800a0060 msgr2=0x7fc4800a2520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:35.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.730+0000 7fc499698700 1 --2- 172.21.15.82:0/1804580996 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fc4800a0060 0x7fc4800a2520 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc494074410 tx=0x7fc47c009260 comp rx=0 tx=0).stop 2023-09-23T08:55:35.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.730+0000 7fc499698700 1 -- 172.21.15.82:0/1804580996 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc494100940 msgr2=0x7fc494072c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:35.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.730+0000 7fc499698700 1 --2- 172.21.15.82:0/1804580996 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc494100940 0x7fc494072c20 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc484005740 tx=0x7fc484005770 comp rx=0 tx=0).stop 2023-09-23T08:55:35.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.730+0000 7fc499698700 1 -- 172.21.15.82:0/1804580996 shutdown_connections 2023-09-23T08:55:35.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.730+0000 7fc499698700 1 --2- 172.21.15.82:0/1804580996 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fc4800a0060 0x7fc4800a2520 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:35.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.730+0000 7fc499698700 1 --2- 172.21.15.82:0/1804580996 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc494106940 0x7fc4940736e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:35.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.730+0000 7fc499698700 1 --2- 172.21.15.82:0/1804580996 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc494100940 0x7fc494072c20 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:35.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.730+0000 7fc499698700 1 --2- 172.21.15.82:0/1804580996 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc494101300 0x7fc494073160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:35.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.730+0000 7fc499698700 1 -- 172.21.15.82:0/1804580996 >> 172.21.15.82:0/1804580996 conn(0x7fc4940fc410 msgr2=0x7fc4940fcbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:35.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.730+0000 7fc499698700 1 -- 172.21.15.82:0/1804580996 shutdown_connections 2023-09-23T08:55:35.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:35.730+0000 7fc499698700 1 -- 172.21.15.82:0/1804580996 wait complete. 2023-09-23T08:55:35.762 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:35 smithi082 ceph-mon[97694]: pgmap v324: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 10 op/s; 63 B/s, 0 objects/s recovering 2023-09-23T08:55:35.762 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:35 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/2933351141' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-09-23T08:55:35.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:35 smithi135 ceph-mon[99205]: pgmap v324: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 10 op/s; 63 B/s, 0 objects/s recovering 2023-09-23T08:55:35.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:35 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/2933351141' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-09-23T08:55:35.877 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.a/config 2023-09-23T08:55:35.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:35 smithi161 ceph-mon[99580]: pgmap v324: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 10 op/s; 63 B/s, 0 objects/s recovering 2023-09-23T08:55:35.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:35 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/2933351141' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-09-23T08:55:36.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:36.211+0000 7fcdb7604700 1 -- 172.21.15.82:0/1043152757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcdb01000c0 msgr2=0x7fcdb010cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:36.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:36.211+0000 7fcdb7604700 1 --2- 172.21.15.82:0/1043152757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcdb01000c0 0x7fcdb010cd80 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fcda0009990 tx=0x7fcda0009ca0 comp rx=0 tx=0).stop 2023-09-23T08:55:36.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:36.211+0000 7fcdb7604700 1 -- 172.21.15.82:0/1043152757 shutdown_connections 2023-09-23T08:55:36.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:36.211+0000 7fcdb7604700 1 --2- 172.21.15.82:0/1043152757 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcdb010d2c0 0x7fcdb010f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:36.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:36.211+0000 7fcdb7604700 1 --2- 172.21.15.82:0/1043152757 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcdb00ff710 0x7fcdb00ffaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:36.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:36.211+0000 7fcdb7604700 1 --2- 172.21.15.82:0/1043152757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcdb01000c0 0x7fcdb010cd80 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:36.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:36.211+0000 7fcdb7604700 1 -- 172.21.15.82:0/1043152757 >> 172.21.15.82:0/1043152757 conn(0x7fcdb00fb390 msgr2=0x7fcdb00fd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:36.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:36.211+0000 7fcdb7604700 1 -- 172.21.15.82:0/1043152757 shutdown_connections 2023-09-23T08:55:36.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:36.211+0000 7fcdb7604700 1 -- 172.21.15.82:0/1043152757 wait complete. 2023-09-23T08:55:36.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:36.212+0000 7fcdb7604700 1 Processor -- start 2023-09-23T08:55:36.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:36.212+0000 7fcdb7604700 1 -- start start 2023-09-23T08:55:36.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:36.213+0000 7fcdb7604700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcdb00ff710 0x7fcdb019ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:36.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:36.213+0000 7fcdb7604700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcdb01000c0 0x7fcdb019ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:36.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:36.213+0000 7fcdb7604700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcdb010d2c0 0x7fcdb0198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:36.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:36.213+0000 7fcdb7604700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb0199150 con 0x7fcdb010d2c0 2023-09-23T08:55:36.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:36.213+0000 7fcdb7604700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb0199290 con 0x7fcdb01000c0 2023-09-23T08:55:36.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:36.213+0000 7fcdb7604700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb0199450 con 0x7fcdb00ff710 2023-09-23T08:55:36.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:36.213+0000 7fcdb5ba1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcdb010d2c0 0x7fcdb0198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:36.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:36.213+0000 7fcdb5ba1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcdb010d2c0 0x7fcdb0198af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47236/0 (socket says 172.21.15.82:47236) 2023-09-23T08:55:36.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:36.213+0000 7fcdb53a0700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcdb00ff710 0x7fcdb019ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:36.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:36.213+0000 7fcdb5ba1700 1 -- 172.21.15.82:0/3736543506 learned_addr learned my addr 172.21.15.82:0/3736543506 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:55:36.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:36.213+0000 7fcdb4b9f700 1 --2- 172.21.15.82:0/3736543506 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcdb01000c0 0x7fcdb019ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:36.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:36.214+0000 7fcdb5ba1700 1 -- 172.21.15.82:0/3736543506 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcdb00ff710 msgr2=0x7fcdb019ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:36.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:36.214+0000 7fcdb5ba1700 1 --2- 172.21.15.82:0/3736543506 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcdb00ff710 0x7fcdb019ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:36.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:36.214+0000 7fcdb5ba1700 1 -- 172.21.15.82:0/3736543506 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcdb01000c0 msgr2=0x7fcdb019ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:36.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:36.214+0000 7fcdb5ba1700 1 --2- 172.21.15.82:0/3736543506 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcdb01000c0 0x7fcdb019ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:36.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:36.214+0000 7fcdb5ba1700 1 -- 172.21.15.82:0/3736543506 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcda00095f0 con 0x7fcdb010d2c0 2023-09-23T08:55:36.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:36.214+0000 7fcdb5ba1700 1 --2- 172.21.15.82:0/3736543506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcdb010d2c0 0x7fcdb0198af0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fcda8007ce0 tx=0x7fcda800d0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:36.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:36.214+0000 7fcda67fc700 1 -- 172.21.15.82:0/3736543506 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda8004db0 con 0x7fcdb010d2c0 2023-09-23T08:55:36.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:36.214+0000 7fcda67fc700 1 -- 172.21.15.82:0/3736543506 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcda800f040 con 0x7fcdb010d2c0 2023-09-23T08:55:36.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:36.214+0000 7fcdb7604700 1 -- 172.21.15.82:0/3736543506 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdb0199730 con 0x7fcdb010d2c0 2023-09-23T08:55:36.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:36.214+0000 7fcda67fc700 1 -- 172.21.15.82:0/3736543506 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda8005880 con 0x7fcdb010d2c0 2023-09-23T08:55:36.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:36.214+0000 7fcdb7604700 1 -- 172.21.15.82:0/3736543506 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdb01a5ab0 con 0x7fcdb010d2c0 2023-09-23T08:55:36.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:36.215+0000 7fcdb7604700 1 -- 172.21.15.82:0/3736543506 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdb01084e0 con 0x7fcdb010d2c0 2023-09-23T08:55:36.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:36.217+0000 7fcda67fc700 1 -- 172.21.15.82:0/3736543506 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) v1 ==== 134722+0+0 (secure 0 0 0) 0x7fcda800d960 con 0x7fcdb010d2c0 2023-09-23T08:55:36.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:36.218+0000 7fcda67fc700 1 --2- 172.21.15.82:0/3736543506 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fcd9c09ffe0 0x7fcd9c0a24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:36.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:36.218+0000 7fcda67fc700 1 -- 172.21.15.82:0/3736543506 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fcda80cac40 con 0x7fcdb010d2c0 2023-09-23T08:55:36.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:36.219+0000 7fcdb53a0700 1 --2- 172.21.15.82:0/3736543506 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fcd9c09ffe0 0x7fcd9c0a24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:36.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:36.219+0000 7fcdb53a0700 1 --2- 172.21.15.82:0/3736543506 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fcd9c09ffe0 0x7fcd9c0a24a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fcdac005950 tx=0x7fcdac00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:36.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:36.222+0000 7fcda67fc700 1 -- 172.21.15.82:0/3736543506 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7fcda8094820 con 0x7fcdb010d2c0 2023-09-23T08:55:36.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:36.430+0000 7fcdb7604700 1 -- 172.21.15.82:0/3736543506 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fcdb004e620 con 0x7fcdb010d2c0 2023-09-23T08:55:36.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:36.431+0000 7fcda67fc700 1 -- 172.21.15.82:0/3736543506 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcda800dc10 con 0x7fcdb010d2c0 2023-09-23T08:55:36.434 INFO:teuthology.orchestra.run.smithi082.stdout:223338299435 2023-09-23T08:55:36.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:36.433+0000 7fcdb7604700 1 -- 172.21.15.82:0/3736543506 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fcd9c09ffe0 msgr2=0x7fcd9c0a24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:36.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:36.433+0000 7fcdb7604700 1 --2- 172.21.15.82:0/3736543506 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fcd9c09ffe0 0x7fcd9c0a24a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fcdac005950 tx=0x7fcdac00b410 comp rx=0 tx=0).stop 2023-09-23T08:55:36.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:36.433+0000 7fcdb7604700 1 -- 172.21.15.82:0/3736543506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcdb010d2c0 msgr2=0x7fcdb0198af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:36.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:36.433+0000 7fcdb7604700 1 --2- 172.21.15.82:0/3736543506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcdb010d2c0 0x7fcdb0198af0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fcda8007ce0 tx=0x7fcda800d0d0 comp rx=0 tx=0).stop 2023-09-23T08:55:36.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:36.433+0000 7fcdb7604700 1 -- 172.21.15.82:0/3736543506 shutdown_connections 2023-09-23T08:55:36.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:36.433+0000 7fcdb7604700 1 --2- 172.21.15.82:0/3736543506 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fcd9c09ffe0 0x7fcd9c0a24a0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:36.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:36.433+0000 7fcdb7604700 1 --2- 172.21.15.82:0/3736543506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcdb010d2c0 0x7fcdb0198af0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:36.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:36.433+0000 7fcdb7604700 1 --2- 172.21.15.82:0/3736543506 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcdb00ff710 0x7fcdb019ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:36.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:36.433+0000 7fcdb7604700 1 --2- 172.21.15.82:0/3736543506 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcdb01000c0 0x7fcdb019ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:36.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:36.433+0000 7fcdb7604700 1 -- 172.21.15.82:0/3736543506 >> 172.21.15.82:0/3736543506 conn(0x7fcdb00fb390 msgr2=0x7fcdb010f450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:36.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:36.433+0000 7fcdb7604700 1 -- 172.21.15.82:0/3736543506 shutdown_connections 2023-09-23T08:55:36.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:36.433+0000 7fcdb7604700 1 -- 172.21.15.82:0/3736543506 wait complete. 2023-09-23T08:55:36.710 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.a/config 2023-09-23T08:55:36.734 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:36 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/1804580996' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-09-23T08:55:36.734 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:36 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/3736543506' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-09-23T08:55:36.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:36 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/1804580996' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-09-23T08:55:36.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:36 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/3736543506' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-09-23T08:55:36.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:36 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/1804580996' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-09-23T08:55:36.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:36 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/3736543506' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-09-23T08:55:37.134 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411394 got 77309411396 for osd.2 2023-09-23T08:55:37.135 DEBUG:teuthology.parallel:result is None 2023-09-23T08:55:37.228 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.a/config 2023-09-23T08:55:37.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:37.428+0000 7f5cb13e1700 1 -- 172.21.15.82:0/480217003 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5cac0735e0 msgr2=0x7f5cac111410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:37.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:37.428+0000 7f5cb13e1700 1 --2- 172.21.15.82:0/480217003 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5cac0735e0 0x7f5cac111410 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f5c94009990 tx=0x7f5c94009ca0 comp rx=0 tx=0).stop 2023-09-23T08:55:37.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:37.428+0000 7f5cb13e1700 1 -- 172.21.15.82:0/480217003 shutdown_connections 2023-09-23T08:55:37.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:37.428+0000 7f5cb13e1700 1 --2- 172.21.15.82:0/480217003 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5cac111950 0x7f5cac113d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:37.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:37.428+0000 7f5cb13e1700 1 --2- 172.21.15.82:0/480217003 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5cac072cc0 0x7f5cac0730a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:37.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:37.428+0000 7f5cb13e1700 1 --2- 172.21.15.82:0/480217003 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5cac0735e0 0x7f5cac111410 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:37.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:37.428+0000 7f5cb13e1700 1 -- 172.21.15.82:0/480217003 >> 172.21.15.82:0/480217003 conn(0x7f5cac0fc410 msgr2=0x7f5cac0fe830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:37.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:37.428+0000 7f5cb13e1700 1 -- 172.21.15.82:0/480217003 shutdown_connections 2023-09-23T08:55:37.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:37.428+0000 7f5cb13e1700 1 -- 172.21.15.82:0/480217003 wait complete. 2023-09-23T08:55:37.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:37.429+0000 7f5cb13e1700 1 Processor -- start 2023-09-23T08:55:37.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:37.429+0000 7f5cb13e1700 1 -- start start 2023-09-23T08:55:37.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:37.429+0000 7f5cb13e1700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5cac072cc0 0x7f5cac19d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:37.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:37.429+0000 7f5cb13e1700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5cac0735e0 0x7f5cac19d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:37.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:37.429+0000 7f5cb13e1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5cac111950 0x7f5cac1a19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:37.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:37.429+0000 7f5cb13e1700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cac1a1fd0 con 0x7f5cac111950 2023-09-23T08:55:37.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:37.429+0000 7f5cb13e1700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cac1a2140 con 0x7f5cac072cc0 2023-09-23T08:55:37.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:37.429+0000 7f5cb13e1700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cac1a2300 con 0x7f5cac0735e0 2023-09-23T08:55:37.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:37.430+0000 7f5cab7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5cac111950 0x7f5cac1a19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:37.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:37.430+0000 7f5ca2ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5cac072cc0 0x7f5cac19d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:37.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:37.430+0000 7f5ca2ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5cac072cc0 0x7f5cac19d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:52784/0 (socket says 172.21.15.82:52784) 2023-09-23T08:55:37.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:37.430+0000 7f5cab7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5cac111950 0x7f5cac1a19c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47260/0 (socket says 172.21.15.82:47260) 2023-09-23T08:55:37.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:37.430+0000 7f5ca2ffd700 1 -- 172.21.15.82:0/3644008592 learned_addr learned my addr 172.21.15.82:0/3644008592 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:55:37.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:37.430+0000 7f5caaffd700 1 --2- 172.21.15.82:0/3644008592 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5cac0735e0 0x7f5cac19d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:37.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:37.430+0000 7f5cab7fe700 1 -- 172.21.15.82:0/3644008592 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5cac0735e0 msgr2=0x7f5cac19d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:37.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:37.430+0000 7f5cab7fe700 1 --2- 172.21.15.82:0/3644008592 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5cac0735e0 0x7f5cac19d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:37.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:37.430+0000 7f5cab7fe700 1 -- 172.21.15.82:0/3644008592 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5cac072cc0 msgr2=0x7f5cac19d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:37.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:37.430+0000 7f5cab7fe700 1 --2- 172.21.15.82:0/3644008592 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5cac072cc0 0x7f5cac19d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:37.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:37.430+0000 7f5cab7fe700 1 -- 172.21.15.82:0/3644008592 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c940095f0 con 0x7f5cac111950 2023-09-23T08:55:37.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:37.430+0000 7f5cab7fe700 1 --2- 172.21.15.82:0/3644008592 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5cac111950 0x7f5cac1a19c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f5ca4007ee0 tx=0x7f5ca400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:37.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:37.431+0000 7f5ca8ff9700 1 -- 172.21.15.82:0/3644008592 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ca4004db0 con 0x7f5cac111950 2023-09-23T08:55:37.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:37.431+0000 7f5ca8ff9700 1 -- 172.21.15.82:0/3644008592 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5ca400f040 con 0x7f5cac111950 2023-09-23T08:55:37.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:37.431+0000 7f5cb13e1700 1 -- 172.21.15.82:0/3644008592 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cac1a25e0 con 0x7f5cac111950 2023-09-23T08:55:37.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:37.431+0000 7f5ca8ff9700 1 -- 172.21.15.82:0/3644008592 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ca4005880 con 0x7f5cac111950 2023-09-23T08:55:37.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:37.431+0000 7f5cb13e1700 1 -- 172.21.15.82:0/3644008592 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cac1a9e40 con 0x7f5cac111950 2023-09-23T08:55:37.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:37.432+0000 7f5cb13e1700 1 -- 172.21.15.82:0/3644008592 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cac103e30 con 0x7f5cac111950 2023-09-23T08:55:37.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:37.434+0000 7f5ca8ff9700 1 -- 172.21.15.82:0/3644008592 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) v1 ==== 134722+0+0 (secure 0 0 0) 0x7f5ca400db20 con 0x7f5cac111950 2023-09-23T08:55:37.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:37.435+0000 7f5ca8ff9700 1 --2- 172.21.15.82:0/3644008592 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f5c9809ffe0 0x7f5c980a24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:37.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:37.435+0000 7f5ca8ff9700 1 -- 172.21.15.82:0/3644008592 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f5ca40cacf0 con 0x7f5cac111950 2023-09-23T08:55:37.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:37.435+0000 7f5ca2ffd700 1 --2- 172.21.15.82:0/3644008592 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f5c9809ffe0 0x7f5c980a24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:37.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:37.436+0000 7f5ca2ffd700 1 --2- 172.21.15.82:0/3644008592 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f5c9809ffe0 0x7f5c980a24a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c009ad0 tx=0x7f5c9c009290 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:37.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:37.439+0000 7f5ca8ff9700 1 -- 172.21.15.82:0/3644008592 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f5ca40948d0 con 0x7f5cac111950 2023-09-23T08:55:37.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:37.655+0000 7f5cb13e1700 1 -- 172.21.15.82:0/3644008592 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5cac116e30 con 0x7f5cac111950 2023-09-23T08:55:37.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:37.655+0000 7f5ca8ff9700 1 -- 172.21.15.82:0/3644008592 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5ca4097ef0 con 0x7f5cac111950 2023-09-23T08:55:37.658 INFO:teuthology.orchestra.run.smithi082.stdout:34359738448 2023-09-23T08:55:37.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:37.658+0000 7f5cb13e1700 1 -- 172.21.15.82:0/3644008592 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f5c9809ffe0 msgr2=0x7f5c980a24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:37.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:37.658+0000 7f5cb13e1700 1 --2- 172.21.15.82:0/3644008592 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f5c9809ffe0 0x7f5c980a24a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c009ad0 tx=0x7f5c9c009290 comp rx=0 tx=0).stop 2023-09-23T08:55:37.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:37.658+0000 7f5cb13e1700 1 -- 172.21.15.82:0/3644008592 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5cac111950 msgr2=0x7f5cac1a19c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:37.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:37.658+0000 7f5cb13e1700 1 --2- 172.21.15.82:0/3644008592 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5cac111950 0x7f5cac1a19c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f5ca4007ee0 tx=0x7f5ca400d3b0 comp rx=0 tx=0).stop 2023-09-23T08:55:37.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:37.658+0000 7f5cb13e1700 1 -- 172.21.15.82:0/3644008592 shutdown_connections 2023-09-23T08:55:37.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:37.658+0000 7f5cb13e1700 1 --2- 172.21.15.82:0/3644008592 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f5c9809ffe0 0x7f5c980a24a0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:37.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:37.658+0000 7f5cb13e1700 1 --2- 172.21.15.82:0/3644008592 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5cac111950 0x7f5cac1a19c0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:37.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:37.658+0000 7f5cb13e1700 1 --2- 172.21.15.82:0/3644008592 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5cac072cc0 0x7f5cac19d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:37.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:37.658+0000 7f5cb13e1700 1 --2- 172.21.15.82:0/3644008592 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5cac0735e0 0x7f5cac19d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:37.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:37.658+0000 7f5cb13e1700 1 -- 172.21.15.82:0/3644008592 >> 172.21.15.82:0/3644008592 conn(0x7f5cac0fc410 msgr2=0x7f5cac0fd080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:37.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:37.658+0000 7f5cb13e1700 1 -- 172.21.15.82:0/3644008592 shutdown_connections 2023-09-23T08:55:37.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:37.658+0000 7f5cb13e1700 1 -- 172.21.15.82:0/3644008592 wait complete. 2023-09-23T08:55:37.737 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:37 smithi082 ceph-mon[97694]: pgmap v325: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s; 55 B/s, 0 objects/s recovering 2023-09-23T08:55:37.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:37 smithi135 ceph-mon[99205]: pgmap v325: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s; 55 B/s, 0 objects/s recovering 2023-09-23T08:55:37.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:37 smithi161 ceph-mon[99580]: pgmap v325: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s; 55 B/s, 0 objects/s recovering 2023-09-23T08:55:38.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:38 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/3644008592' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-09-23T08:55:38.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:38.862+0000 7f2bb45b8700 1 -- 172.21.15.82:0/3478226983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bac101300 msgr2=0x7f2bac10d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:38.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:38.862+0000 7f2bb45b8700 1 --2- 172.21.15.82:0/3478226983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bac101300 0x7f2bac10d810 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f2ba400b0a0 tx=0x7f2ba400b3b0 comp rx=0 tx=0).stop 2023-09-23T08:55:38.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:38.862+0000 7f2bb45b8700 1 -- 172.21.15.82:0/3478226983 shutdown_connections 2023-09-23T08:55:38.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:38.862+0000 7f2bb45b8700 1 --2- 172.21.15.82:0/3478226983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bac101300 0x7f2bac10d810 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:38.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:38.863+0000 7f2bb45b8700 1 --2- 172.21.15.82:0/3478226983 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2bac106940 0x7f2bac106d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:38.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:38.863+0000 7f2bb45b8700 1 --2- 172.21.15.82:0/3478226983 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2bac100940 0x7f2bac100dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:38.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:38.863+0000 7f2bb45b8700 1 -- 172.21.15.82:0/3478226983 >> 172.21.15.82:0/3478226983 conn(0x7f2bac0fc410 msgr2=0x7f2bac0fe830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:38.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:38.863+0000 7f2bb45b8700 1 -- 172.21.15.82:0/3478226983 shutdown_connections 2023-09-23T08:55:38.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:38.863+0000 7f2bb45b8700 1 -- 172.21.15.82:0/3478226983 wait complete. 2023-09-23T08:55:38.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:38.864+0000 7f2bb45b8700 1 Processor -- start 2023-09-23T08:55:38.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:38.864+0000 7f2bb45b8700 1 -- start start 2023-09-23T08:55:38.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:38.865+0000 7f2bb45b8700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2bac100940 0x7f2bac198ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:38.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:38.865+0000 7f2bb45b8700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2bac101300 0x7f2bac1991e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:38.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:38.865+0000 7f2bb45b8700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bac106940 0x7f2bac19c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:38.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:38.865+0000 7f2bb45b8700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bac19cba0 con 0x7f2bac106940 2023-09-23T08:55:38.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:38.865+0000 7f2bb45b8700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bac19cd10 con 0x7f2bac100940 2023-09-23T08:55:38.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:38.865+0000 7f2bb45b8700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bac19ced0 con 0x7f2bac101300 2023-09-23T08:55:38.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:38.865+0000 7f2bb2b55700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bac106940 0x7f2bac19c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:38.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:38.865+0000 7f2bb1b53700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2bac101300 0x7f2bac1991e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:38.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:38.865+0000 7f2bb2b55700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bac106940 0x7f2bac19c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47286/0 (socket says 172.21.15.82:47286) 2023-09-23T08:55:38.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:38.865+0000 7f2bb2b55700 1 -- 172.21.15.82:0/3534678021 learned_addr learned my addr 172.21.15.82:0/3534678021 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:55:38.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:38.865+0000 7f2bb2354700 1 --2- 172.21.15.82:0/3534678021 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2bac100940 0x7f2bac198ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:38.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:38.866+0000 7f2bb2b55700 1 -- 172.21.15.82:0/3534678021 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2bac101300 msgr2=0x7f2bac1991e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:38.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:38.866+0000 7f2bb2b55700 1 --2- 172.21.15.82:0/3534678021 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2bac101300 0x7f2bac1991e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:38.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:38.866+0000 7f2bb2b55700 1 -- 172.21.15.82:0/3534678021 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2bac100940 msgr2=0x7f2bac198ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:38.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:38.866+0000 7f2bb2b55700 1 --2- 172.21.15.82:0/3534678021 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2bac100940 0x7f2bac198ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:38.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:38.866+0000 7f2bb2b55700 1 -- 172.21.15.82:0/3534678021 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ba4009d00 con 0x7f2bac106940 2023-09-23T08:55:38.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:38.866+0000 7f2bb2354700 1 --2- 172.21.15.82:0/3534678021 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2bac100940 0x7f2bac198ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T08:55:38.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:38.866+0000 7f2bb2b55700 1 --2- 172.21.15.82:0/3534678021 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bac106940 0x7f2bac19c5a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f2ba4009fd0 tx=0x7f2ba4004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:38.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:38.866+0000 7f2ba37fe700 1 -- 172.21.15.82:0/3534678021 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba400e040 con 0x7f2bac106940 2023-09-23T08:55:38.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:38.866+0000 7f2ba37fe700 1 -- 172.21.15.82:0/3534678021 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2ba400ceb0 con 0x7f2bac106940 2023-09-23T08:55:38.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:38.866+0000 7f2ba37fe700 1 -- 172.21.15.82:0/3534678021 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba4005680 con 0x7f2bac106940 2023-09-23T08:55:38.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:38.866+0000 7f2bb45b8700 1 -- 172.21.15.82:0/3534678021 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bac19d150 con 0x7f2bac106940 2023-09-23T08:55:38.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:38.867+0000 7f2bb45b8700 1 -- 172.21.15.82:0/3534678021 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bac1a5b00 con 0x7f2bac106940 2023-09-23T08:55:38.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:38 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/3644008592' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-09-23T08:55:38.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:38.868+0000 7f2bb45b8700 1 -- 172.21.15.82:0/3534678021 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bac04e620 con 0x7f2bac106940 2023-09-23T08:55:38.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:38.870+0000 7f2ba37fe700 1 -- 172.21.15.82:0/3534678021 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) v1 ==== 134722+0+0 (secure 0 0 0) 0x7f2ba401bd60 con 0x7f2bac106940 2023-09-23T08:55:38.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:38.871+0000 7f2ba37fe700 1 --2- 172.21.15.82:0/3534678021 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f2b980a0060 0x7f2b980a2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:38.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:38.871+0000 7f2ba37fe700 1 -- 172.21.15.82:0/3534678021 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f2ba40ccc80 con 0x7f2bac106940 2023-09-23T08:55:38.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:38.871+0000 7f2bb2354700 1 --2- 172.21.15.82:0/3534678021 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f2b980a0060 0x7f2b980a2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:38.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:38.872+0000 7f2bb2354700 1 --2- 172.21.15.82:0/3534678021 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f2b980a0060 0x7f2b980a2520 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2ba8005e10 tx=0x7f2ba8005d60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:38.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:38.875+0000 7f2ba37fe700 1 -- 172.21.15.82:0/3534678021 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f2ba40968f0 con 0x7f2bac106940 2023-09-23T08:55:38.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:38 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/3644008592' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-09-23T08:55:39.063 INFO:tasks.cephadm.ceph_manager.ceph:need seq 146028888121 got 146028888124 for osd.4 2023-09-23T08:55:39.063 DEBUG:teuthology.parallel:result is None 2023-09-23T08:55:39.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:39.126+0000 7f2bb45b8700 1 -- 172.21.15.82:0/3534678021 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) v1 -- 0x7f2bac19d340 con 0x7f2bac106940 2023-09-23T08:55:39.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:39.127+0000 7f2ba37fe700 1 -- 172.21.15.82:0/3534678021 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7f2ba4099f10 con 0x7f2bac106940 2023-09-23T08:55:39.130 INFO:teuthology.orchestra.run.smithi082.stdout:347892351000 2023-09-23T08:55:39.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:39.129+0000 7f2bb45b8700 1 -- 172.21.15.82:0/3534678021 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f2b980a0060 msgr2=0x7f2b980a2520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:39.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:39.129+0000 7f2bb45b8700 1 --2- 172.21.15.82:0/3534678021 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f2b980a0060 0x7f2b980a2520 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2ba8005e10 tx=0x7f2ba8005d60 comp rx=0 tx=0).stop 2023-09-23T08:55:39.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:39.129+0000 7f2bb45b8700 1 -- 172.21.15.82:0/3534678021 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bac106940 msgr2=0x7f2bac19c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:39.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:39.129+0000 7f2bb45b8700 1 --2- 172.21.15.82:0/3534678021 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bac106940 0x7f2bac19c5a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f2ba4009fd0 tx=0x7f2ba4004c80 comp rx=0 tx=0).stop 2023-09-23T08:55:39.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:39.130+0000 7f2bb45b8700 1 -- 172.21.15.82:0/3534678021 shutdown_connections 2023-09-23T08:55:39.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:39.130+0000 7f2bb45b8700 1 --2- 172.21.15.82:0/3534678021 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f2b980a0060 0x7f2b980a2520 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:39.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:39.130+0000 7f2bb45b8700 1 --2- 172.21.15.82:0/3534678021 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bac106940 0x7f2bac19c5a0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:39.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:39.130+0000 7f2bb45b8700 1 --2- 172.21.15.82:0/3534678021 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2bac100940 0x7f2bac198ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:39.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:39.130+0000 7f2bb45b8700 1 --2- 172.21.15.82:0/3534678021 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2bac101300 0x7f2bac1991e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:39.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:39.130+0000 7f2bb45b8700 1 -- 172.21.15.82:0/3534678021 >> 172.21.15.82:0/3534678021 conn(0x7f2bac0fc410 msgr2=0x7f2bac10bd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:39.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:39.130+0000 7f2bb45b8700 1 -- 172.21.15.82:0/3534678021 shutdown_connections 2023-09-23T08:55:39.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:39.130+0000 7f2bb45b8700 1 -- 172.21.15.82:0/3534678021 wait complete. 2023-09-23T08:55:39.392 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738446 got 34359738448 for osd.0 2023-09-23T08:55:39.392 DEBUG:teuthology.parallel:result is None 2023-09-23T08:55:39.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:39 smithi135 ceph-mon[99205]: pgmap v326: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s; 0 B/s, 0 objects/s recovering 2023-09-23T08:55:39.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:39 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/3534678021' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-09-23T08:55:39.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:39 smithi082 ceph-mon[97694]: pgmap v326: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s; 0 B/s, 0 objects/s recovering 2023-09-23T08:55:39.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:39 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/3534678021' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-09-23T08:55:39.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:39 smithi161 ceph-mon[99580]: pgmap v326: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s; 0 B/s, 0 objects/s recovering 2023-09-23T08:55:39.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:39 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/3534678021' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-09-23T08:55:40.191 INFO:tasks.cephadm.ceph_manager.ceph:need seq 223338299434 got 223338299435 for osd.7 2023-09-23T08:55:40.191 DEBUG:teuthology.parallel:result is None 2023-09-23T08:55:40.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:39.796+0000 7fa824e2f700 1 -- 172.21.15.82:0/3451444915 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa820100940 msgr2=0x7fa820100dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:40.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:39.796+0000 7fa824e2f700 1 --2- 172.21.15.82:0/3451444915 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa820100940 0x7fa820100dc0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fa814009990 tx=0x7fa814009ca0 comp rx=0 tx=0).stop 2023-09-23T08:55:40.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:39.796+0000 7fa824e2f700 1 -- 172.21.15.82:0/3451444915 shutdown_connections 2023-09-23T08:55:40.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:39.796+0000 7fa824e2f700 1 --2- 172.21.15.82:0/3451444915 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa820101300 0x7fa82010d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:40.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:39.796+0000 7fa824e2f700 1 --2- 172.21.15.82:0/3451444915 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa820106940 0x7fa820106d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:40.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:39.796+0000 7fa824e2f700 1 --2- 172.21.15.82:0/3451444915 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa820100940 0x7fa820100dc0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:40.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:39.796+0000 7fa824e2f700 1 -- 172.21.15.82:0/3451444915 >> 172.21.15.82:0/3451444915 conn(0x7fa8200fc410 msgr2=0x7fa8200fe830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:40.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:39.796+0000 7fa824e2f700 1 -- 172.21.15.82:0/3451444915 shutdown_connections 2023-09-23T08:55:40.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:39.796+0000 7fa824e2f700 1 -- 172.21.15.82:0/3451444915 wait complete. 2023-09-23T08:55:40.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:39.797+0000 7fa824e2f700 1 Processor -- start 2023-09-23T08:55:40.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:39.797+0000 7fa824e2f700 1 -- start start 2023-09-23T08:55:40.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:39.797+0000 7fa824e2f700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa820100940 0x7fa82019e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:40.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:39.797+0000 7fa824e2f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa820101300 0x7fa82019ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:40.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:39.797+0000 7fa824e2f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa820106940 0x7fa8201989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:40.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:39.797+0000 7fa824e2f700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa820199040 con 0x7fa820106940 2023-09-23T08:55:40.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:39.797+0000 7fa824e2f700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8201991b0 con 0x7fa820101300 2023-09-23T08:55:40.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:39.797+0000 7fa824e2f700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa820199370 con 0x7fa820100940 2023-09-23T08:55:40.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:39.797+0000 7fa81ed9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa820106940 0x7fa8201989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:40.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:39.798+0000 7fa81ed9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa820106940 0x7fa8201989d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47296/0 (socket says 172.21.15.82:47296) 2023-09-23T08:55:40.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:39.798+0000 7fa81ed9d700 1 -- 172.21.15.82:0/4278091286 learned_addr learned my addr 172.21.15.82:0/4278091286 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:55:40.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:39.798+0000 7fa81dd9b700 1 --2- 172.21.15.82:0/4278091286 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa820101300 0x7fa82019ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:40.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:39.798+0000 7fa81e59c700 1 --2- 172.21.15.82:0/4278091286 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa820100940 0x7fa82019e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:40.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:39.798+0000 7fa81ed9d700 1 -- 172.21.15.82:0/4278091286 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa820100940 msgr2=0x7fa82019e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:40.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:39.798+0000 7fa81ed9d700 1 --2- 172.21.15.82:0/4278091286 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa820100940 0x7fa82019e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:40.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:39.798+0000 7fa81ed9d700 1 -- 172.21.15.82:0/4278091286 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa820101300 msgr2=0x7fa82019ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:40.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:39.798+0000 7fa81ed9d700 1 --2- 172.21.15.82:0/4278091286 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa820101300 0x7fa82019ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:40.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:39.798+0000 7fa81ed9d700 1 -- 172.21.15.82:0/4278091286 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8140095f0 con 0x7fa820106940 2023-09-23T08:55:40.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:39.798+0000 7fa81ed9d700 1 --2- 172.21.15.82:0/4278091286 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa820106940 0x7fa8201989d0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa81800b970 tx=0x7fa81800bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:40.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:39.798+0000 7fa80f7fe700 1 -- 172.21.15.82:0/4278091286 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa81800d860 con 0x7fa820106940 2023-09-23T08:55:40.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:39.798+0000 7fa824e2f700 1 -- 172.21.15.82:0/4278091286 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa820199650 con 0x7fa820106940 2023-09-23T08:55:40.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:39.798+0000 7fa80f7fe700 1 -- 172.21.15.82:0/4278091286 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa81800de50 con 0x7fa820106940 2023-09-23T08:55:40.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:39.798+0000 7fa80f7fe700 1 -- 172.21.15.82:0/4278091286 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa818017400 con 0x7fa820106940 2023-09-23T08:55:40.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:39.799+0000 7fa824e2f700 1 -- 172.21.15.82:0/4278091286 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8201a5940 con 0x7fa820106940 2023-09-23T08:55:40.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:39.799+0000 7fa824e2f700 1 -- 172.21.15.82:0/4278091286 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa82004e620 con 0x7fa820106940 2023-09-23T08:55:40.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:39.801+0000 7fa80f7fe700 1 -- 172.21.15.82:0/4278091286 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) v1 ==== 134722+0+0 (secure 0 0 0) 0x7fa81800d9c0 con 0x7fa820106940 2023-09-23T08:55:40.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:39.803+0000 7fa80f7fe700 1 --2- 172.21.15.82:0/4278091286 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fa80809ffe0 0x7fa8080a24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:40.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:39.803+0000 7fa80f7fe700 1 -- 172.21.15.82:0/4278091286 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fa818006e40 con 0x7fa820106940 2023-09-23T08:55:40.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:39.803+0000 7fa81e59c700 1 --2- 172.21.15.82:0/4278091286 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fa80809ffe0 0x7fa8080a24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:40.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:39.803+0000 7fa81e59c700 1 --2- 172.21.15.82:0/4278091286 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fa80809ffe0 0x7fa8080a24a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa810005950 tx=0x7fa81000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:40.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:39.806+0000 7fa80f7fe700 1 -- 172.21.15.82:0/4278091286 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7fa818094c90 con 0x7fa820106940 2023-09-23T08:55:40.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:40.024+0000 7fa824e2f700 1 -- 172.21.15.82:0/4278091286 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) v1 -- 0x7fa8201109a0 con 0x7fa820106940 2023-09-23T08:55:40.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:40.025+0000 7fa80f7fe700 1 -- 172.21.15.82:0/4278091286 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa8180982b0 con 0x7fa820106940 2023-09-23T08:55:40.346 INFO:teuthology.orchestra.run.smithi082.stdout:292057776161 2023-09-23T08:55:40.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:40.028+0000 7fa824e2f700 1 -- 172.21.15.82:0/4278091286 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fa80809ffe0 msgr2=0x7fa8080a24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:40.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:40.028+0000 7fa824e2f700 1 --2- 172.21.15.82:0/4278091286 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fa80809ffe0 0x7fa8080a24a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa810005950 tx=0x7fa81000b410 comp rx=0 tx=0).stop 2023-09-23T08:55:40.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:40.028+0000 7fa824e2f700 1 -- 172.21.15.82:0/4278091286 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa820106940 msgr2=0x7fa8201989d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:40.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:40.028+0000 7fa824e2f700 1 --2- 172.21.15.82:0/4278091286 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa820106940 0x7fa8201989d0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa81800b970 tx=0x7fa81800bc80 comp rx=0 tx=0).stop 2023-09-23T08:55:40.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:40.028+0000 7fa824e2f700 1 -- 172.21.15.82:0/4278091286 shutdown_connections 2023-09-23T08:55:40.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:40.028+0000 7fa824e2f700 1 --2- 172.21.15.82:0/4278091286 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fa80809ffe0 0x7fa8080a24a0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:40.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:40.028+0000 7fa824e2f700 1 --2- 172.21.15.82:0/4278091286 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa820106940 0x7fa8201989d0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:40.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:40.028+0000 7fa824e2f700 1 --2- 172.21.15.82:0/4278091286 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa820100940 0x7fa82019e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:40.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:40.028+0000 7fa824e2f700 1 --2- 172.21.15.82:0/4278091286 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa820101300 0x7fa82019ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:40.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:40.028+0000 7fa824e2f700 1 -- 172.21.15.82:0/4278091286 >> 172.21.15.82:0/4278091286 conn(0x7fa8200fc410 msgr2=0x7fa82010bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:40.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:40.028+0000 7fa824e2f700 1 -- 172.21.15.82:0/4278091286 shutdown_connections 2023-09-23T08:55:40.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:40.028+0000 7fa824e2f700 1 -- 172.21.15.82:0/4278091286 wait complete. 2023-09-23T08:55:40.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:40 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/4278091286' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-09-23T08:55:40.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:40 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/4278091286' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-09-23T08:55:40.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:40 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/4278091286' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-09-23T08:55:41.061 INFO:tasks.cephadm.ceph_manager.ceph:need seq 347892350998 got 347892351000 for osd.11 2023-09-23T08:55:41.061 DEBUG:teuthology.parallel:result is None 2023-09-23T08:55:41.554 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:41 smithi082 ceph-mon[97694]: pgmap v327: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 9 op/s 2023-09-23T08:55:41.558 INFO:tasks.cephadm.ceph_manager.ceph:need seq 257698037795 got 257698037797 for osd.8 2023-09-23T08:55:41.558 DEBUG:teuthology.parallel:result is None 2023-09-23T08:55:41.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:41 smithi135 ceph-mon[99205]: pgmap v327: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 9 op/s 2023-09-23T08:55:41.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:41.738+0000 7f4852e74700 1 -- 172.21.15.82:0/2273887042 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f484c106940 msgr2=0x7f484c106d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:41.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:41.738+0000 7f4852e74700 1 --2- 172.21.15.82:0/2273887042 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f484c106940 0x7f484c106d20 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f4840009990 tx=0x7f4840009ca0 comp rx=0 tx=0).stop 2023-09-23T08:55:41.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:41.738+0000 7f4852e74700 1 -- 172.21.15.82:0/2273887042 shutdown_connections 2023-09-23T08:55:41.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:41.738+0000 7f4852e74700 1 --2- 172.21.15.82:0/2273887042 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f484c101300 0x7f484c10d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:41.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:41.738+0000 7f4852e74700 1 --2- 172.21.15.82:0/2273887042 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f484c106940 0x7f484c106d20 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:41.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:41.738+0000 7f4852e74700 1 --2- 172.21.15.82:0/2273887042 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f484c100940 0x7f484c100dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:41.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:41.738+0000 7f4852e74700 1 -- 172.21.15.82:0/2273887042 >> 172.21.15.82:0/2273887042 conn(0x7f484c0fc410 msgr2=0x7f484c0fe830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:41.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:41.738+0000 7f4852e74700 1 -- 172.21.15.82:0/2273887042 shutdown_connections 2023-09-23T08:55:41.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:41.738+0000 7f4852e74700 1 -- 172.21.15.82:0/2273887042 wait complete. 2023-09-23T08:55:41.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:41.740+0000 7f4852e74700 1 Processor -- start 2023-09-23T08:55:41.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:41.740+0000 7f4852e74700 1 -- start start 2023-09-23T08:55:41.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:41.740+0000 7f4852e74700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f484c100940 0x7f484c19e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:41.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:41.741+0000 7f4852e74700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f484c101300 0x7f484c19ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:41.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:41.741+0000 7f4852e74700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f484c106940 0x7f484c1989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:41.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:41.741+0000 7f4852e74700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f484c199040 con 0x7f484c101300 2023-09-23T08:55:41.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:41.741+0000 7f4852e74700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f484c1991b0 con 0x7f484c106940 2023-09-23T08:55:41.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:41.741+0000 7f4852e74700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f484c199370 con 0x7f484c100940 2023-09-23T08:55:41.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:41.741+0000 7f484bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f484c101300 0x7f484c19ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:41.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:41.741+0000 7f484bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f484c101300 0x7f484c19ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47320/0 (socket says 172.21.15.82:47320) 2023-09-23T08:55:41.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:41.741+0000 7f484bfff700 1 -- 172.21.15.82:0/1441909049 learned_addr learned my addr 172.21.15.82:0/1441909049 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:55:41.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:41.741+0000 7f4850c10700 1 --2- 172.21.15.82:0/1441909049 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f484c100940 0x7f484c19e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:41.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:41.741+0000 7f484bfff700 1 -- 172.21.15.82:0/1441909049 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f484c100940 msgr2=0x7f484c19e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:41.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:41.741+0000 7f484bfff700 1 --2- 172.21.15.82:0/1441909049 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f484c100940 0x7f484c19e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:41.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:41.741+0000 7f484bfff700 1 -- 172.21.15.82:0/1441909049 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f484c106940 msgr2=0x7f484c1989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:41.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:41.741+0000 7f484bfff700 1 --2- 172.21.15.82:0/1441909049 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f484c106940 0x7f484c1989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:41.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:41.741+0000 7f484bfff700 1 -- 172.21.15.82:0/1441909049 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48400095f0 con 0x7f484c101300 2023-09-23T08:55:41.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:41.741+0000 7f484bfff700 1 --2- 172.21.15.82:0/1441909049 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f484c101300 0x7f484c19ee90 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f483800d950 tx=0x7f483800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:41.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:41.742+0000 7f4849ffb700 1 -- 172.21.15.82:0/1441909049 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4838009940 con 0x7f484c101300 2023-09-23T08:55:41.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:41.742+0000 7f4852e74700 1 -- 172.21.15.82:0/1441909049 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f484c199650 con 0x7f484c101300 2023-09-23T08:55:41.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:41.742+0000 7f4849ffb700 1 -- 172.21.15.82:0/1441909049 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4838010460 con 0x7f484c101300 2023-09-23T08:55:41.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:41.742+0000 7f4849ffb700 1 -- 172.21.15.82:0/1441909049 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f483800f620 con 0x7f484c101300 2023-09-23T08:55:41.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:41.742+0000 7f4852e74700 1 -- 172.21.15.82:0/1441909049 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f484c1a5940 con 0x7f484c101300 2023-09-23T08:55:41.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:41.743+0000 7f4852e74700 1 -- 172.21.15.82:0/1441909049 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f484c04e620 con 0x7f484c101300 2023-09-23T08:55:41.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:41.744+0000 7f4849ffb700 1 -- 172.21.15.82:0/1441909049 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) v1 ==== 134722+0+0 (secure 0 0 0) 0x7f48380105d0 con 0x7f484c101300 2023-09-23T08:55:41.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:41.746+0000 7f4849ffb700 1 --2- 172.21.15.82:0/1441909049 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f483c09ffe0 0x7f483c0a24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:41.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:41.746+0000 7f4849ffb700 1 -- 172.21.15.82:0/1441909049 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f48380cb1f0 con 0x7f484c101300 2023-09-23T08:55:41.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:41.746+0000 7f4850c10700 1 --2- 172.21.15.82:0/1441909049 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f483c09ffe0 0x7f483c0a24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:41.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:41.747+0000 7f4850c10700 1 --2- 172.21.15.82:0/1441909049 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f483c09ffe0 0x7f483c0a24a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f484000b5c0 tx=0x7f4840009f00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:41.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:41.750+0000 7f4849ffb700 1 -- 172.21.15.82:0/1441909049 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f4838094e30 con 0x7f484c101300 2023-09-23T08:55:41.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:41 smithi161 ceph-mon[99580]: pgmap v327: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 9 op/s 2023-09-23T08:55:41.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:41.965+0000 7f4852e74700 1 -- 172.21.15.82:0/1441909049 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f484c110a20 con 0x7f484c101300 2023-09-23T08:55:41.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:41.965+0000 7f4849ffb700 1 -- 172.21.15.82:0/1441909049 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4838098450 con 0x7f484c101300 2023-09-23T08:55:41.968 INFO:teuthology.orchestra.run.smithi082.stdout:111669149760 2023-09-23T08:55:41.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:41.968+0000 7f4852e74700 1 -- 172.21.15.82:0/1441909049 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f483c09ffe0 msgr2=0x7f483c0a24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:41.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:41.968+0000 7f4852e74700 1 --2- 172.21.15.82:0/1441909049 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f483c09ffe0 0x7f483c0a24a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f484000b5c0 tx=0x7f4840009f00 comp rx=0 tx=0).stop 2023-09-23T08:55:41.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:41.968+0000 7f4852e74700 1 -- 172.21.15.82:0/1441909049 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f484c101300 msgr2=0x7f484c19ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:41.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:41.968+0000 7f4852e74700 1 --2- 172.21.15.82:0/1441909049 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f484c101300 0x7f484c19ee90 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f483800d950 tx=0x7f483800dc60 comp rx=0 tx=0).stop 2023-09-23T08:55:41.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:41.968+0000 7f4852e74700 1 -- 172.21.15.82:0/1441909049 shutdown_connections 2023-09-23T08:55:41.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:41.968+0000 7f4852e74700 1 --2- 172.21.15.82:0/1441909049 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f483c09ffe0 0x7f483c0a24a0 secure :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f484000b5c0 tx=0x7f4840009f00 comp rx=0 tx=0).stop 2023-09-23T08:55:41.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:41.968+0000 7f4852e74700 1 --2- 172.21.15.82:0/1441909049 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f484c106940 0x7f484c1989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:41.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:41.968+0000 7f4852e74700 1 --2- 172.21.15.82:0/1441909049 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f484c100940 0x7f484c19e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:41.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:41.968+0000 7f4852e74700 1 --2- 172.21.15.82:0/1441909049 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f484c101300 0x7f484c19ee90 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:41.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:41.968+0000 7f4852e74700 1 -- 172.21.15.82:0/1441909049 >> 172.21.15.82:0/1441909049 conn(0x7f484c0fc410 msgr2=0x7f484c10bd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:41.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:41.968+0000 7f4852e74700 1 -- 172.21.15.82:0/1441909049 shutdown_connections 2023-09-23T08:55:41.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:41.968+0000 7f4852e74700 1 -- 172.21.15.82:0/1441909049 wait complete. 2023-09-23T08:55:42.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:42.364+0000 7f68effff700 1 -- 172.21.15.82:0/2187941340 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68f010d120 msgr2=0x7f68f010f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:42.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:42.364+0000 7f68effff700 1 --2- 172.21.15.82:0/2187941340 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68f010d120 0x7f68f010f510 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f68e800b0a0 tx=0x7f68e800b3b0 comp rx=0 tx=0).stop 2023-09-23T08:55:42.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:42.364+0000 7f68effff700 1 -- 172.21.15.82:0/2187941340 shutdown_connections 2023-09-23T08:55:42.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:42.364+0000 7f68effff700 1 --2- 172.21.15.82:0/2187941340 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68f010d120 0x7f68f010f510 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:42.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:42.364+0000 7f68effff700 1 --2- 172.21.15.82:0/2187941340 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68f00ff570 0x7f68f00ff950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:42.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:42.364+0000 7f68effff700 1 --2- 172.21.15.82:0/2187941340 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68f00fff20 0x7f68f010cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:42.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:42.364+0000 7f68effff700 1 -- 172.21.15.82:0/2187941340 >> 172.21.15.82:0/2187941340 conn(0x7f68f00fb1b0 msgr2=0x7f68f00fd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:42.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:42.364+0000 7f68effff700 1 -- 172.21.15.82:0/2187941340 shutdown_connections 2023-09-23T08:55:42.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:42.364+0000 7f68effff700 1 -- 172.21.15.82:0/2187941340 wait complete. 2023-09-23T08:55:42.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:42.365+0000 7f68effff700 1 Processor -- start 2023-09-23T08:55:42.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:42.366+0000 7f68effff700 1 -- start start 2023-09-23T08:55:42.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:42.366+0000 7f68effff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68f00ff570 0x7f68f019e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:42.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:42.366+0000 7f68effff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68f00fff20 0x7f68f019ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:42.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:42.366+0000 7f68effff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68f010d120 0x7f68f0198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:42.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:42.366+0000 7f68effff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f0198fb0 con 0x7f68f00fff20 2023-09-23T08:55:42.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:42.366+0000 7f68effff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f0199120 con 0x7f68f010d120 2023-09-23T08:55:42.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:42.366+0000 7f68effff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f01992e0 con 0x7f68f00ff570 2023-09-23T08:55:42.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:42.366+0000 7f68ee7fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68f00fff20 0x7f68f019ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:42.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:42.366+0000 7f68ee7fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68f00fff20 0x7f68f019ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40430/0 (socket says 172.21.15.82:40430) 2023-09-23T08:55:42.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:42.366+0000 7f68ee7fc700 1 -- 172.21.15.82:0/1574917157 learned_addr learned my addr 172.21.15.82:0/1574917157 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:55:42.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:42.367+0000 7f68ee7fc700 1 -- 172.21.15.82:0/1574917157 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68f00ff570 msgr2=0x7f68f019e8c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-09-23T08:55:42.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:42.367+0000 7f68ee7fc700 1 --2- 172.21.15.82:0/1574917157 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68f00ff570 0x7f68f019e8c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:42.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:42.367+0000 7f68ee7fc700 1 -- 172.21.15.82:0/1574917157 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68f010d120 msgr2=0x7f68f0198940 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-09-23T08:55:42.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:42.367+0000 7f68ee7fc700 1 --2- 172.21.15.82:0/1574917157 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68f010d120 0x7f68f0198940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:42.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:42.367+0000 7f68ee7fc700 1 -- 172.21.15.82:0/1574917157 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68e8009d00 con 0x7f68f00fff20 2023-09-23T08:55:42.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:42.367+0000 7f68ee7fc700 1 --2- 172.21.15.82:0/1574917157 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68f00fff20 0x7f68f019ee00 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f68e400d950 tx=0x7f68e400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:42.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:42.367+0000 7f68f4923700 1 -- 172.21.15.82:0/1574917157 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e4009b40 con 0x7f68f00fff20 2023-09-23T08:55:42.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:42.367+0000 7f68effff700 1 -- 172.21.15.82:0/1574917157 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68f01995c0 con 0x7f68f00fff20 2023-09-23T08:55:42.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:42.368+0000 7f68effff700 1 -- 172.21.15.82:0/1574917157 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68f01a58b0 con 0x7f68f00fff20 2023-09-23T08:55:42.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:42.368+0000 7f68f4923700 1 -- 172.21.15.82:0/1574917157 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f68e4009ca0 con 0x7f68f00fff20 2023-09-23T08:55:42.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:42.368+0000 7f68f4923700 1 -- 172.21.15.82:0/1574917157 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e400f620 con 0x7f68f00fff20 2023-09-23T08:55:42.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:42.369+0000 7f68effff700 1 -- 172.21.15.82:0/1574917157 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68dc005320 con 0x7f68f00fff20 2023-09-23T08:55:42.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:42.371+0000 7f68f4923700 1 -- 172.21.15.82:0/1574917157 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) v1 ==== 134722+0+0 (secure 0 0 0) 0x7f68e4010460 con 0x7f68f00fff20 2023-09-23T08:55:42.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:42.373+0000 7f68f4923700 1 --2- 172.21.15.82:0/1574917157 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f68d80a0060 0x7f68d80a2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:42.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:42.374+0000 7f68f4923700 1 -- 172.21.15.82:0/1574917157 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f68e40cb710 con 0x7f68f00fff20 2023-09-23T08:55:42.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:42.374+0000 7f68eeffd700 1 --2- 172.21.15.82:0/1574917157 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f68d80a0060 0x7f68d80a2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:42.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:42.375+0000 7f68eeffd700 1 --2- 172.21.15.82:0/1574917157 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f68d80a0060 0x7f68d80a2520 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f68e000ba30 tx=0x7f68e000b3f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:42.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:42.376+0000 7f68f4923700 1 -- 172.21.15.82:0/1574917157 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f68e40952f0 con 0x7f68f00fff20 2023-09-23T08:55:42.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:42.593+0000 7f68effff700 1 -- 172.21.15.82:0/1574917157 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f68dc005190 con 0x7f68f00fff20 2023-09-23T08:55:42.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:42.594+0000 7f68f4923700 1 -- 172.21.15.82:0/1574917157 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f68e4016090 con 0x7f68f00fff20 2023-09-23T08:55:42.597 INFO:teuthology.orchestra.run.smithi082.stdout:167503724600 2023-09-23T08:55:42.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:42.596+0000 7f68effff700 1 -- 172.21.15.82:0/1574917157 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f68d80a0060 msgr2=0x7f68d80a2520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:42.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:42.596+0000 7f68effff700 1 --2- 172.21.15.82:0/1574917157 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f68d80a0060 0x7f68d80a2520 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f68e000ba30 tx=0x7f68e000b3f0 comp rx=0 tx=0).stop 2023-09-23T08:55:42.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:42.596+0000 7f68effff700 1 -- 172.21.15.82:0/1574917157 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68f00fff20 msgr2=0x7f68f019ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:42.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:42.596+0000 7f68effff700 1 --2- 172.21.15.82:0/1574917157 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68f00fff20 0x7f68f019ee00 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f68e400d950 tx=0x7f68e400dd10 comp rx=0 tx=0).stop 2023-09-23T08:55:42.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:42.596+0000 7f68effff700 1 -- 172.21.15.82:0/1574917157 shutdown_connections 2023-09-23T08:55:42.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:42.596+0000 7f68effff700 1 --2- 172.21.15.82:0/1574917157 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f68d80a0060 0x7f68d80a2520 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:42.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:42.596+0000 7f68effff700 1 --2- 172.21.15.82:0/1574917157 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68f010d120 0x7f68f0198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:42.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:42.596+0000 7f68effff700 1 --2- 172.21.15.82:0/1574917157 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68f00ff570 0x7f68f019e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:42.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:42.596+0000 7f68effff700 1 --2- 172.21.15.82:0/1574917157 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68f00fff20 0x7f68f019ee00 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:42.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:42.596+0000 7f68effff700 1 -- 172.21.15.82:0/1574917157 >> 172.21.15.82:0/1574917157 conn(0x7f68f00fb1b0 msgr2=0x7f68f010e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:42.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:42.596+0000 7f68effff700 1 -- 172.21.15.82:0/1574917157 shutdown_connections 2023-09-23T08:55:42.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:42.596+0000 7f68effff700 1 -- 172.21.15.82:0/1574917157 wait complete. 2023-09-23T08:55:42.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:42 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/1441909049' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-09-23T08:55:42.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:42 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/1441909049' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-09-23T08:55:42.814 INFO:tasks.cephadm.ceph_manager.ceph:need seq 292057776158 got 292057776161 for osd.9 2023-09-23T08:55:42.815 DEBUG:teuthology.parallel:result is None 2023-09-23T08:55:42.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:42 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/1441909049' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-09-23T08:55:42.921 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149758 got 111669149760 for osd.3 2023-09-23T08:55:42.921 DEBUG:teuthology.parallel:result is None 2023-09-23T08:55:43.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.184+0000 7ffaf6cf5700 1 -- 172.21.15.82:0/3537360831 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffaf0106940 msgr2=0x7ffaf0106d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:43.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.184+0000 7ffaf6cf5700 1 --2- 172.21.15.82:0/3537360831 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffaf0106940 0x7ffaf0106d20 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ffae4009990 tx=0x7ffae4009ca0 comp rx=0 tx=0).stop 2023-09-23T08:55:43.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.184+0000 7ffaf6cf5700 1 -- 172.21.15.82:0/3537360831 shutdown_connections 2023-09-23T08:55:43.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.184+0000 7ffaf6cf5700 1 --2- 172.21.15.82:0/3537360831 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffaf0101300 0x7ffaf010d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:43.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.184+0000 7ffaf6cf5700 1 --2- 172.21.15.82:0/3537360831 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffaf0106940 0x7ffaf0106d20 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:43.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.184+0000 7ffaf6cf5700 1 --2- 172.21.15.82:0/3537360831 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffaf0100940 0x7ffaf0100dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:43.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.184+0000 7ffaf6cf5700 1 -- 172.21.15.82:0/3537360831 >> 172.21.15.82:0/3537360831 conn(0x7ffaf00fc410 msgr2=0x7ffaf00fe830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:43.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.184+0000 7ffaf6cf5700 1 -- 172.21.15.82:0/3537360831 shutdown_connections 2023-09-23T08:55:43.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.184+0000 7ffaf6cf5700 1 -- 172.21.15.82:0/3537360831 wait complete. 2023-09-23T08:55:43.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.185+0000 7ffaf6cf5700 1 Processor -- start 2023-09-23T08:55:43.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.186+0000 7ffaf6cf5700 1 -- start start 2023-09-23T08:55:43.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.186+0000 7ffaf6cf5700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffaf0100940 0x7ffaf0196960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:43.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.186+0000 7ffaf6cf5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffaf0101300 0x7ffaf0196ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:43.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.186+0000 7ffaf6cf5700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffaf0106940 0x7ffaf019b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:43.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.186+0000 7ffaf6cf5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf019b910 con 0x7ffaf0101300 2023-09-23T08:55:43.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.186+0000 7ffaf6cf5700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf019ba80 con 0x7ffaf0106940 2023-09-23T08:55:43.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.186+0000 7ffaf6cf5700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf019bc40 con 0x7ffaf0100940 2023-09-23T08:55:43.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.186+0000 7ffaeffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffaf0101300 0x7ffaf0196ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:43.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.187+0000 7ffaeffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffaf0101300 0x7ffaf0196ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40444/0 (socket says 172.21.15.82:40444) 2023-09-23T08:55:43.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.187+0000 7ffaeffff700 1 -- 172.21.15.82:0/3287402884 learned_addr learned my addr 172.21.15.82:0/3287402884 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:55:43.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.187+0000 7ffaf5292700 1 --2- 172.21.15.82:0/3287402884 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffaf0106940 0x7ffaf019b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:43.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.187+0000 7ffaf4a91700 1 --2- 172.21.15.82:0/3287402884 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffaf0100940 0x7ffaf0196960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:43.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.187+0000 7ffaeffff700 1 -- 172.21.15.82:0/3287402884 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffaf0100940 msgr2=0x7ffaf0196960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:43.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.187+0000 7ffaeffff700 1 --2- 172.21.15.82:0/3287402884 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffaf0100940 0x7ffaf0196960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:43.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.187+0000 7ffaeffff700 1 -- 172.21.15.82:0/3287402884 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffaf0106940 msgr2=0x7ffaf019b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:43.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.187+0000 7ffaeffff700 1 --2- 172.21.15.82:0/3287402884 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffaf0106940 0x7ffaf019b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:43.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.187+0000 7ffaeffff700 1 -- 172.21.15.82:0/3287402884 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffae40095f0 con 0x7ffaf0101300 2023-09-23T08:55:43.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.187+0000 7ffaf4a91700 1 --2- 172.21.15.82:0/3287402884 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffaf0100940 0x7ffaf0196960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T08:55:43.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.187+0000 7ffaeffff700 1 --2- 172.21.15.82:0/3287402884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffaf0101300 0x7ffaf0196ea0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ffadc00d950 tx=0x7ffadc00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:43.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.188+0000 7ffaedffb700 1 -- 172.21.15.82:0/3287402884 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffadc00dea0 con 0x7ffaf0101300 2023-09-23T08:55:43.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.188+0000 7ffaedffb700 1 -- 172.21.15.82:0/3287402884 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ffadc01a070 con 0x7ffaf0101300 2023-09-23T08:55:43.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.188+0000 7ffaedffb700 1 -- 172.21.15.82:0/3287402884 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffadc021b50 con 0x7ffaf0101300 2023-09-23T08:55:43.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.188+0000 7ffaf6cf5700 1 -- 172.21.15.82:0/3287402884 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaf019bf20 con 0x7ffaf0101300 2023-09-23T08:55:43.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.188+0000 7ffaf6cf5700 1 -- 172.21.15.82:0/3287402884 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaf0072d20 con 0x7ffaf0101300 2023-09-23T08:55:43.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.189+0000 7ffaf6cf5700 1 -- 172.21.15.82:0/3287402884 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaf004e620 con 0x7ffaf0101300 2023-09-23T08:55:43.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.191+0000 7ffaedffb700 1 -- 172.21.15.82:0/3287402884 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) v1 ==== 134722+0+0 (secure 0 0 0) 0x7ffadc021cb0 con 0x7ffaf0101300 2023-09-23T08:55:43.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.193+0000 7ffaedffb700 1 --2- 172.21.15.82:0/3287402884 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7ffae00a0060 0x7ffae00a2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:43.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.193+0000 7ffaedffb700 1 -- 172.21.15.82:0/3287402884 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7ffadc01c070 con 0x7ffaf0101300 2023-09-23T08:55:43.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.193+0000 7ffaf4a91700 1 --2- 172.21.15.82:0/3287402884 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7ffae00a0060 0x7ffae00a2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:43.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.194+0000 7ffaf4a91700 1 --2- 172.21.15.82:0/3287402884 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7ffae00a0060 0x7ffae00a2520 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ffae4006010 tx=0x7ffae400b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:43.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.199+0000 7ffaedffb700 1 -- 172.21.15.82:0/3287402884 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7ffadc09d4c0 con 0x7ffaf0101300 2023-09-23T08:55:43.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.399+0000 7f3173fff700 1 -- 172.21.15.82:0/505770321 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3174102250 msgr2=0x7f317410a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:43.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.399+0000 7f3173fff700 1 --2- 172.21.15.82:0/505770321 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3174102250 0x7f317410a740 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f3168009990 tx=0x7f3168009ca0 comp rx=0 tx=0).stop 2023-09-23T08:55:43.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.399+0000 7f3173fff700 1 -- 172.21.15.82:0/505770321 shutdown_connections 2023-09-23T08:55:43.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.399+0000 7f3173fff700 1 --2- 172.21.15.82:0/505770321 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f317410ad60 0x7f317410d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:43.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.399+0000 7f3173fff700 1 --2- 172.21.15.82:0/505770321 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3174101930 0x7f3174101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:43.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.399+0000 7f3173fff700 1 --2- 172.21.15.82:0/505770321 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3174102250 0x7f317410a740 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:43.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.399+0000 7f3173fff700 1 -- 172.21.15.82:0/505770321 >> 172.21.15.82:0/505770321 conn(0x7f31740fb1c0 msgr2=0x7f31740fd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:43.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.399+0000 7f3173fff700 1 -- 172.21.15.82:0/505770321 shutdown_connections 2023-09-23T08:55:43.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.399+0000 7f3173fff700 1 -- 172.21.15.82:0/505770321 wait complete. 2023-09-23T08:55:43.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.400+0000 7f3173fff700 1 Processor -- start 2023-09-23T08:55:43.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.400+0000 7f3173fff700 1 -- start start 2023-09-23T08:55:43.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.400+0000 7f3173fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3174101930 0x7f31740ff590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:43.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.400+0000 7f3173fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3174102250 0x7f31740ffad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:43.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.400+0000 7f3173fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f317410ad60 0x7f3174100050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:43.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.400+0000 7f3173fff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31741a4c70 con 0x7f3174102250 2023-09-23T08:55:43.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.400+0000 7f3173fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31741a4de0 con 0x7f317410ad60 2023-09-23T08:55:43.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.400+0000 7f3173fff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31741a4fa0 con 0x7f3174101930 2023-09-23T08:55:43.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.401+0000 7f31727fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3174102250 0x7f31740ffad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:43.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.401+0000 7f3172ffd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3174101930 0x7f31740ff590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:43.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.401+0000 7f3172ffd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3174101930 0x7f31740ff590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:45258/0 (socket says 172.21.15.82:45258) 2023-09-23T08:55:43.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.401+0000 7f3172ffd700 1 -- 172.21.15.82:0/1289102355 learned_addr learned my addr 172.21.15.82:0/1289102355 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:55:43.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.401+0000 7f31727fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3174102250 0x7f31740ffad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40466/0 (socket says 172.21.15.82:40466) 2023-09-23T08:55:43.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.401+0000 7f31737fe700 1 --2- 172.21.15.82:0/1289102355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f317410ad60 0x7f3174100050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:43.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.401+0000 7f3172ffd700 1 -- 172.21.15.82:0/1289102355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f317410ad60 msgr2=0x7f3174100050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:43.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.401+0000 7f3172ffd700 1 --2- 172.21.15.82:0/1289102355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f317410ad60 0x7f3174100050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:43.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.401+0000 7f3172ffd700 1 -- 172.21.15.82:0/1289102355 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3174102250 msgr2=0x7f31740ffad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:43.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.401+0000 7f3172ffd700 1 --2- 172.21.15.82:0/1289102355 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3174102250 0x7f31740ffad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:43.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.401+0000 7f3172ffd700 1 -- 172.21.15.82:0/1289102355 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31680095f0 con 0x7f3174101930 2023-09-23T08:55:43.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.402+0000 7f3172ffd700 1 --2- 172.21.15.82:0/1289102355 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3174101930 0x7f31740ff590 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f316400e9a0 tx=0x7f316400ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:43.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.402+0000 7f3178a20700 1 -- 172.21.15.82:0/1289102355 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3164009790 con 0x7f3174101930 2023-09-23T08:55:43.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.402+0000 7f3178a20700 1 -- 172.21.15.82:0/1289102355 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f316400cbd0 con 0x7f3174101930 2023-09-23T08:55:43.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.402+0000 7f3173fff700 1 -- 172.21.15.82:0/1289102355 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31741a5280 con 0x7f3174101930 2023-09-23T08:55:43.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.402+0000 7f3178a20700 1 -- 172.21.15.82:0/1289102355 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3164018680 con 0x7f3174101930 2023-09-23T08:55:43.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.402+0000 7f3173fff700 1 -- 172.21.15.82:0/1289102355 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31741a5750 con 0x7f3174101930 2023-09-23T08:55:43.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.403+0000 7f3173fff700 1 -- 172.21.15.82:0/1289102355 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3174105e90 con 0x7f3174101930 2023-09-23T08:55:43.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.405+0000 7f3178a20700 1 -- 172.21.15.82:0/1289102355 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 17) v1 ==== 134722+0+0 (secure 0 0 0) 0x7f316400cd40 con 0x7f3174101930 2023-09-23T08:55:43.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.406+0000 7f3178a20700 1 --2- 172.21.15.82:0/1289102355 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f315c09ffe0 0x7f315c0a24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:43.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.407+0000 7f3178a20700 1 -- 172.21.15.82:0/1289102355 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f3164014070 con 0x7f3174101930 2023-09-23T08:55:43.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.407+0000 7f31727fc700 1 --2- 172.21.15.82:0/1289102355 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f315c09ffe0 0x7f315c0a24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:43.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.407+0000 7f31727fc700 1 --2- 172.21.15.82:0/1289102355 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f315c09ffe0 0x7f315c0a24a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3168006010 tx=0x7f316800b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:43.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.409+0000 7f3178a20700 1 -- 172.21.15.82:0/1289102355 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f3164095650 con 0x7f3174101930 2023-09-23T08:55:43.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.424+0000 7ffaf6cf5700 1 -- 172.21.15.82:0/3287402884 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7ffaf0197cc0 con 0x7ffaf0101300 2023-09-23T08:55:43.428 INFO:teuthology.orchestra.run.smithi082.stdout:201863462963 2023-09-23T08:55:43.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.425+0000 7ffaedffb700 1 -- 172.21.15.82:0/3287402884 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffadc0c0020 con 0x7ffaf0101300 2023-09-23T08:55:43.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.429+0000 7ffaf6cf5700 1 -- 172.21.15.82:0/3287402884 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7ffae00a0060 msgr2=0x7ffae00a2520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:43.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.429+0000 7ffaf6cf5700 1 --2- 172.21.15.82:0/3287402884 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7ffae00a0060 0x7ffae00a2520 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ffae4006010 tx=0x7ffae400b260 comp rx=0 tx=0).stop 2023-09-23T08:55:43.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.429+0000 7ffaf6cf5700 1 -- 172.21.15.82:0/3287402884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffaf0101300 msgr2=0x7ffaf0196ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:43.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.429+0000 7ffaf6cf5700 1 --2- 172.21.15.82:0/3287402884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffaf0101300 0x7ffaf0196ea0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ffadc00d950 tx=0x7ffadc00dc60 comp rx=0 tx=0).stop 2023-09-23T08:55:43.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.429+0000 7ffaf6cf5700 1 -- 172.21.15.82:0/3287402884 shutdown_connections 2023-09-23T08:55:43.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.429+0000 7ffaf6cf5700 1 --2- 172.21.15.82:0/3287402884 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7ffae00a0060 0x7ffae00a2520 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:43.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.429+0000 7ffaf6cf5700 1 --2- 172.21.15.82:0/3287402884 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffaf0106940 0x7ffaf019b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:43.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.429+0000 7ffaf6cf5700 1 --2- 172.21.15.82:0/3287402884 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffaf0100940 0x7ffaf0196960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:43.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.429+0000 7ffaf6cf5700 1 --2- 172.21.15.82:0/3287402884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffaf0101300 0x7ffaf0196ea0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:43.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.429+0000 7ffaf6cf5700 1 -- 172.21.15.82:0/3287402884 >> 172.21.15.82:0/3287402884 conn(0x7ffaf00fc410 msgr2=0x7ffaf00fcb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:43.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.429+0000 7ffaf6cf5700 1 -- 172.21.15.82:0/3287402884 shutdown_connections 2023-09-23T08:55:43.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.430+0000 7ffaf6cf5700 1 -- 172.21.15.82:0/3287402884 wait complete. 2023-09-23T08:55:43.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.482+0000 7f1613d2c700 1 -- 172.21.15.82:0/2124733876 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f160c100940 msgr2=0x7f160c100dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:43.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.482+0000 7f1613d2c700 1 --2- 172.21.15.82:0/2124733876 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f160c100940 0x7f160c100dc0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f15fc009990 tx=0x7f15fc009ca0 comp rx=0 tx=0).stop 2023-09-23T08:55:43.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.482+0000 7f1613d2c700 1 -- 172.21.15.82:0/2124733876 shutdown_connections 2023-09-23T08:55:43.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.482+0000 7f1613d2c700 1 --2- 172.21.15.82:0/2124733876 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f160c101300 0x7f160c10d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:43.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.482+0000 7f1613d2c700 1 --2- 172.21.15.82:0/2124733876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f160c106940 0x7f160c106d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:43.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.482+0000 7f1613d2c700 1 --2- 172.21.15.82:0/2124733876 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f160c100940 0x7f160c100dc0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:43.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.482+0000 7f1613d2c700 1 -- 172.21.15.82:0/2124733876 >> 172.21.15.82:0/2124733876 conn(0x7f160c0fc410 msgr2=0x7f160c0fe830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:43.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.482+0000 7f1613d2c700 1 -- 172.21.15.82:0/2124733876 shutdown_connections 2023-09-23T08:55:43.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.482+0000 7f1613d2c700 1 -- 172.21.15.82:0/2124733876 wait complete. 2023-09-23T08:55:43.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.483+0000 7f1613d2c700 1 Processor -- start 2023-09-23T08:55:43.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.483+0000 7f1613d2c700 1 -- start start 2023-09-23T08:55:43.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.484+0000 7f1613d2c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f160c100940 0x7f160c072c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:43.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.484+0000 7f1613d2c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f160c101300 0x7f160c073160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:43.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.484+0000 7f1613d2c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f160c106940 0x7f160c0736e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:43.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.484+0000 7f1613d2c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f160c1a4da0 con 0x7f160c106940 2023-09-23T08:55:43.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.484+0000 7f1613d2c700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f160c1a4f10 con 0x7f160c101300 2023-09-23T08:55:43.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.484+0000 7f1613d2c700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f160c1a50d0 con 0x7f160c100940 2023-09-23T08:55:43.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.484+0000 7f1611ac8700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f160c100940 0x7f160c072c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:43.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.484+0000 7f16122c9700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f160c106940 0x7f160c0736e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:43.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.484+0000 7f1611ac8700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f160c100940 0x7f160c072c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:45282/0 (socket says 172.21.15.82:45282) 2023-09-23T08:55:43.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.484+0000 7f1611ac8700 1 -- 172.21.15.82:0/3574367395 learned_addr learned my addr 172.21.15.82:0/3574367395 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:55:43.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.484+0000 7f16112c7700 1 --2- 172.21.15.82:0/3574367395 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f160c101300 0x7f160c073160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:43.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.484+0000 7f16122c9700 1 -- 172.21.15.82:0/3574367395 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f160c100940 msgr2=0x7f160c072c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:43.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.484+0000 7f16122c9700 1 --2- 172.21.15.82:0/3574367395 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f160c100940 0x7f160c072c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:43.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.484+0000 7f16122c9700 1 -- 172.21.15.82:0/3574367395 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f160c101300 msgr2=0x7f160c073160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:43.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.484+0000 7f16122c9700 1 --2- 172.21.15.82:0/3574367395 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f160c101300 0x7f160c073160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:43.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.484+0000 7f16122c9700 1 -- 172.21.15.82:0/3574367395 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15fc0095f0 con 0x7f160c106940 2023-09-23T08:55:43.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.485+0000 7f16122c9700 1 --2- 172.21.15.82:0/3574367395 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f160c106940 0x7f160c0736e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f1604007f10 tx=0x7f160400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:43.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.485+0000 7f1602ffd700 1 -- 172.21.15.82:0/3574367395 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1604004db0 con 0x7f160c106940 2023-09-23T08:55:43.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.485+0000 7f1602ffd700 1 -- 172.21.15.82:0/3574367395 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f160400f040 con 0x7f160c106940 2023-09-23T08:55:43.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.485+0000 7f1613d2c700 1 -- 172.21.15.82:0/3574367395 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f160c1a53b0 con 0x7f160c106940 2023-09-23T08:55:43.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.485+0000 7f1602ffd700 1 -- 172.21.15.82:0/3574367395 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1604005960 con 0x7f160c106940 2023-09-23T08:55:43.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.485+0000 7f1613d2c700 1 -- 172.21.15.82:0/3574367395 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f160c1a5880 con 0x7f160c106940 2023-09-23T08:55:43.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.486+0000 7f1613d2c700 1 -- 172.21.15.82:0/3574367395 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f160c04e620 con 0x7f160c106940 2023-09-23T08:55:43.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.490+0000 7f1602ffd700 1 -- 172.21.15.82:0/3574367395 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) v1 ==== 134722+0+0 (secure 0 0 0) 0x7f160400db20 con 0x7f160c106940 2023-09-23T08:55:43.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.492+0000 7f1602ffd700 1 --2- 172.21.15.82:0/3574367395 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f15f80a0060 0x7f15f80a2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:43.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.492+0000 7f1602ffd700 1 -- 172.21.15.82:0/3574367395 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f16040cb450 con 0x7f160c106940 2023-09-23T08:55:43.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.492+0000 7f1611ac8700 1 --2- 172.21.15.82:0/3574367395 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f15f80a0060 0x7f15f80a2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:43.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.493+0000 7f1611ac8700 1 --2- 172.21.15.82:0/3574367395 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f15f80a0060 0x7f15f80a2520 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1608009ca0 tx=0x7f1608009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:43.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.493+0000 7f1602ffd700 1 -- 172.21.15.82:0/3574367395 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f1604095030 con 0x7f160c106940 2023-09-23T08:55:43.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.630+0000 7f3173fff700 1 -- 172.21.15.82:0/1289102355 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) v1 -- 0x7f317404ee70 con 0x7f3174101930 2023-09-23T08:55:43.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.631+0000 7f3178a20700 1 -- 172.21.15.82:0/1289102355 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7f3164098c70 con 0x7f3174101930 2023-09-23T08:55:43.634 INFO:teuthology.orchestra.run.smithi082.stdout:313532612638 2023-09-23T08:55:43.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.633+0000 7f3173fff700 1 -- 172.21.15.82:0/1289102355 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f315c09ffe0 msgr2=0x7f315c0a24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:43.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.633+0000 7f3173fff700 1 --2- 172.21.15.82:0/1289102355 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f315c09ffe0 0x7f315c0a24a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3168006010 tx=0x7f316800b260 comp rx=0 tx=0).stop 2023-09-23T08:55:43.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.633+0000 7f3173fff700 1 -- 172.21.15.82:0/1289102355 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3174101930 msgr2=0x7f31740ff590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:43.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.633+0000 7f3173fff700 1 --2- 172.21.15.82:0/1289102355 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3174101930 0x7f31740ff590 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f316400e9a0 tx=0x7f316400ecb0 comp rx=0 tx=0).stop 2023-09-23T08:55:43.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.634+0000 7f3173fff700 1 -- 172.21.15.82:0/1289102355 shutdown_connections 2023-09-23T08:55:43.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.634+0000 7f3173fff700 1 --2- 172.21.15.82:0/1289102355 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f315c09ffe0 0x7f315c0a24a0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:43.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.634+0000 7f3173fff700 1 --2- 172.21.15.82:0/1289102355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f317410ad60 0x7f3174100050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:43.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.634+0000 7f3173fff700 1 --2- 172.21.15.82:0/1289102355 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3174101930 0x7f31740ff590 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:43.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.634+0000 7f3173fff700 1 --2- 172.21.15.82:0/1289102355 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3174102250 0x7f31740ffad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:43.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.634+0000 7f3173fff700 1 -- 172.21.15.82:0/1289102355 >> 172.21.15.82:0/1289102355 conn(0x7f31740fb1c0 msgr2=0x7f31740fbe30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:43.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.634+0000 7f3173fff700 1 -- 172.21.15.82:0/1289102355 shutdown_connections 2023-09-23T08:55:43.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.634+0000 7f3173fff700 1 -- 172.21.15.82:0/1289102355 wait complete. 2023-09-23T08:55:43.733 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:43 smithi082 ceph-mon[97694]: pgmap v328: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2023-09-23T08:55:43.734 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:43 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/1574917157' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-09-23T08:55:43.734 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:43 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/3287402884' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-09-23T08:55:43.738 INFO:tasks.cephadm.ceph_manager.ceph:need seq 167503724597 got 167503724600 for osd.5 2023-09-23T08:55:43.738 DEBUG:teuthology.parallel:result is None 2023-09-23T08:55:43.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.738+0000 7f1613d2c700 1 -- 172.21.15.82:0/3574367395 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f160c074150 con 0x7f160c106940 2023-09-23T08:55:43.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.738+0000 7f1602ffd700 1 -- 172.21.15.82:0/3574367395 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1604023020 con 0x7f160c106940 2023-09-23T08:55:43.741 INFO:teuthology.orchestra.run.smithi082.stdout:55834574923 2023-09-23T08:55:43.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.741+0000 7f1613d2c700 1 -- 172.21.15.82:0/3574367395 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f15f80a0060 msgr2=0x7f15f80a2520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:43.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.741+0000 7f1613d2c700 1 --2- 172.21.15.82:0/3574367395 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f15f80a0060 0x7f15f80a2520 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1608009ca0 tx=0x7f1608009260 comp rx=0 tx=0).stop 2023-09-23T08:55:43.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.741+0000 7f1613d2c700 1 -- 172.21.15.82:0/3574367395 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f160c106940 msgr2=0x7f160c0736e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:43.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.741+0000 7f1613d2c700 1 --2- 172.21.15.82:0/3574367395 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f160c106940 0x7f160c0736e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f1604007f10 tx=0x7f160400d3b0 comp rx=0 tx=0).stop 2023-09-23T08:55:43.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.741+0000 7f1613d2c700 1 -- 172.21.15.82:0/3574367395 shutdown_connections 2023-09-23T08:55:43.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.741+0000 7f1613d2c700 1 --2- 172.21.15.82:0/3574367395 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f15f80a0060 0x7f15f80a2520 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:43.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.741+0000 7f1613d2c700 1 --2- 172.21.15.82:0/3574367395 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f160c106940 0x7f160c0736e0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:43.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.741+0000 7f1613d2c700 1 --2- 172.21.15.82:0/3574367395 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f160c100940 0x7f160c072c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:43.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.741+0000 7f1613d2c700 1 --2- 172.21.15.82:0/3574367395 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f160c101300 0x7f160c073160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:43.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.741+0000 7f1613d2c700 1 -- 172.21.15.82:0/3574367395 >> 172.21.15.82:0/3574367395 conn(0x7f160c0fc410 msgr2=0x7f160c104450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:43.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.741+0000 7f1613d2c700 1 -- 172.21.15.82:0/3574367395 shutdown_connections 2023-09-23T08:55:43.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:43.741+0000 7f1613d2c700 1 -- 172.21.15.82:0/3574367395 wait complete. 2023-09-23T08:55:43.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:43 smithi135 ceph-mon[99205]: pgmap v328: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2023-09-23T08:55:43.824 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:43 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/1574917157' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-09-23T08:55:43.824 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:43 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/3287402884' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-09-23T08:55:43.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:43 smithi161 ceph-mon[99580]: pgmap v328: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2023-09-23T08:55:43.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:43 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/1574917157' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-09-23T08:55:43.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:43 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/3287402884' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-09-23T08:55:44.271 INFO:tasks.cephadm.ceph_manager.ceph:need seq 201863462960 got 201863462963 for osd.6 2023-09-23T08:55:44.271 DEBUG:teuthology.parallel:result is None 2023-09-23T08:55:44.613 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574921 got 55834574923 for osd.1 2023-09-23T08:55:44.614 DEBUG:teuthology.parallel:result is None 2023-09-23T08:55:44.675 INFO:tasks.cephadm.ceph_manager.ceph:need seq 313532612635 got 313532612638 for osd.10 2023-09-23T08:55:44.675 DEBUG:teuthology.parallel:result is None 2023-09-23T08:55:44.675 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2023-09-23T08:55:44.675 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- ceph pg dump --format=json 2023-09-23T08:55:44.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:44 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/1289102355' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-09-23T08:55:44.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:44 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/3574367395' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-09-23T08:55:44.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:44 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/1289102355' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-09-23T08:55:44.932 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:44 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/3574367395' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-09-23T08:55:44.933 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:44 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/1289102355' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-09-23T08:55:44.933 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:44 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/3574367395' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-09-23T08:55:45.396 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.a/config 2023-09-23T08:55:45.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:45 smithi135 ceph-mon[99205]: pgmap v329: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-09-23T08:55:45.816 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:45 smithi082 ceph-mon[97694]: pgmap v329: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-09-23T08:55:45.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:45 smithi161 ceph-mon[99580]: pgmap v329: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-09-23T08:55:46.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:46.901+0000 7fa4bc181700 1 -- 172.21.15.82:0/2667256261 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4b4100940 msgr2=0x7fa4b4100dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:46.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:46.901+0000 7fa4bc181700 1 --2- 172.21.15.82:0/2667256261 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4b4100940 0x7fa4b4100dc0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fa4a4009990 tx=0x7fa4a4009ca0 comp rx=0 tx=0).stop 2023-09-23T08:55:46.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:46.901+0000 7fa4bc181700 1 -- 172.21.15.82:0/2667256261 shutdown_connections 2023-09-23T08:55:46.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:46.901+0000 7fa4bc181700 1 --2- 172.21.15.82:0/2667256261 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa4b4101300 0x7fa4b410d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:46.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:46.901+0000 7fa4bc181700 1 --2- 172.21.15.82:0/2667256261 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4b4106940 0x7fa4b4106d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:46.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:46.901+0000 7fa4bc181700 1 --2- 172.21.15.82:0/2667256261 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4b4100940 0x7fa4b4100dc0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:46.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:46.901+0000 7fa4bc181700 1 -- 172.21.15.82:0/2667256261 >> 172.21.15.82:0/2667256261 conn(0x7fa4b40fc410 msgr2=0x7fa4b40fe830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:46.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:46.901+0000 7fa4bc181700 1 -- 172.21.15.82:0/2667256261 shutdown_connections 2023-09-23T08:55:46.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:46.901+0000 7fa4bc181700 1 -- 172.21.15.82:0/2667256261 wait complete. 2023-09-23T08:55:46.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:46.902+0000 7fa4bc181700 1 Processor -- start 2023-09-23T08:55:46.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:46.902+0000 7fa4bc181700 1 -- start start 2023-09-23T08:55:46.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:46.903+0000 7fa4bc181700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa4b4100940 0x7fa4b419ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:46.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:46.903+0000 7fa4bc181700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4b4101300 0x7fa4b419ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:46.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:46.903+0000 7fa4bc181700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4b4106940 0x7fa4b41989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:46.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:46.903+0000 7fa4bc181700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b41991a0 con 0x7fa4b4106940 2023-09-23T08:55:46.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:46.903+0000 7fa4bc181700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b4199310 con 0x7fa4b4101300 2023-09-23T08:55:46.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:46.903+0000 7fa4bc181700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b41994d0 con 0x7fa4b4100940 2023-09-23T08:55:46.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:46.903+0000 7fa4ba71e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4b4106940 0x7fa4b41989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:46.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:46.903+0000 7fa4ba71e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4b4106940 0x7fa4b41989f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40504/0 (socket says 172.21.15.82:40504) 2023-09-23T08:55:46.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:46.903+0000 7fa4b9f1d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa4b4100940 0x7fa4b419ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:46.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:46.903+0000 7fa4ba71e700 1 -- 172.21.15.82:0/1913730328 learned_addr learned my addr 172.21.15.82:0/1913730328 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:55:46.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:46.903+0000 7fa4b971c700 1 --2- 172.21.15.82:0/1913730328 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4b4101300 0x7fa4b419ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:46.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:46.903+0000 7fa4ba71e700 1 -- 172.21.15.82:0/1913730328 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa4b4100940 msgr2=0x7fa4b419ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:46.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:46.903+0000 7fa4ba71e700 1 --2- 172.21.15.82:0/1913730328 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa4b4100940 0x7fa4b419ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:46.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:46.903+0000 7fa4ba71e700 1 -- 172.21.15.82:0/1913730328 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4b4101300 msgr2=0x7fa4b419ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:46.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:46.903+0000 7fa4ba71e700 1 --2- 172.21.15.82:0/1913730328 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4b4101300 0x7fa4b419ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:46.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:46.903+0000 7fa4ba71e700 1 -- 172.21.15.82:0/1913730328 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4a40095f0 con 0x7fa4b4106940 2023-09-23T08:55:46.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:46.904+0000 7fa4ba71e700 1 --2- 172.21.15.82:0/1913730328 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4b4106940 0x7fa4b41989f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac007ee0 tx=0x7fa4ac00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:46.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:46.904+0000 7fa4aaffd700 1 -- 172.21.15.82:0/1913730328 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4ac00dd20 con 0x7fa4b4106940 2023-09-23T08:55:46.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:46.904+0000 7fa4aaffd700 1 -- 172.21.15.82:0/1913730328 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa4ac00f040 con 0x7fa4b4106940 2023-09-23T08:55:46.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:46.904+0000 7fa4bc181700 1 -- 172.21.15.82:0/1913730328 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4b41997b0 con 0x7fa4b4106940 2023-09-23T08:55:46.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:46.904+0000 7fa4aaffd700 1 -- 172.21.15.82:0/1913730328 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4ac004750 con 0x7fa4b4106940 2023-09-23T08:55:46.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:46.904+0000 7fa4bc181700 1 -- 172.21.15.82:0/1913730328 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4b41a5980 con 0x7fa4b4106940 2023-09-23T08:55:46.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:46.905+0000 7fa4bc181700 1 -- 172.21.15.82:0/1913730328 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4b404e620 con 0x7fa4b4106940 2023-09-23T08:55:46.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:46.907+0000 7fa4aaffd700 1 -- 172.21.15.82:0/1913730328 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) v1 ==== 134722+0+0 (secure 0 0 0) 0x7fa4ac003a00 con 0x7fa4b4106940 2023-09-23T08:55:46.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:46.908+0000 7fa4aaffd700 1 --2- 172.21.15.82:0/1913730328 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fa4a00a0060 0x7fa4a00a2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:46.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:46.908+0000 7fa4aaffd700 1 -- 172.21.15.82:0/1913730328 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fa4ac0cabf0 con 0x7fa4b4106940 2023-09-23T08:55:46.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:46.908+0000 7fa4b9f1d700 1 --2- 172.21.15.82:0/1913730328 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fa4a00a0060 0x7fa4a00a2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:46.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:46.909+0000 7fa4b9f1d700 1 --2- 172.21.15.82:0/1913730328 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fa4a00a0060 0x7fa4a00a2520 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa4b0005950 tx=0x7fa4b000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:46.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:46.913+0000 7fa4aaffd700 1 -- 172.21.15.82:0/1913730328 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7fa4ac0947d0 con 0x7fa4b4106940 2023-09-23T08:55:47.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:47.109+0000 7fa4bc181700 1 -- 172.21.15.82:0/1913730328 --> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa4b4110af0 con 0x7fa4a00a0060 2023-09-23T08:55:47.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:47.120+0000 7fa4aaffd700 1 -- 172.21.15.82:0/1913730328 <== mgr.14152 v2:172.21.15.82:6800/3698954311 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+339674 (secure 0 0 0) 0x7fa4b4110af0 con 0x7fa4a00a0060 2023-09-23T08:55:47.126 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:55:47.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:47.125+0000 7fa4bc181700 1 -- 172.21.15.82:0/1913730328 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fa4a00a0060 msgr2=0x7fa4a00a2520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:47.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:47.125+0000 7fa4bc181700 1 --2- 172.21.15.82:0/1913730328 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fa4a00a0060 0x7fa4a00a2520 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa4b0005950 tx=0x7fa4b000b410 comp rx=0 tx=0).stop 2023-09-23T08:55:47.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:47.125+0000 7fa4bc181700 1 -- 172.21.15.82:0/1913730328 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4b4106940 msgr2=0x7fa4b41989f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:47.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:47.125+0000 7fa4bc181700 1 --2- 172.21.15.82:0/1913730328 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4b4106940 0x7fa4b41989f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac007ee0 tx=0x7fa4ac00d3b0 comp rx=0 tx=0).stop 2023-09-23T08:55:47.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:47.125+0000 7fa4bc181700 1 -- 172.21.15.82:0/1913730328 shutdown_connections 2023-09-23T08:55:47.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:47.125+0000 7fa4bc181700 1 --2- 172.21.15.82:0/1913730328 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fa4a00a0060 0x7fa4a00a2520 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:47.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:47.125+0000 7fa4bc181700 1 --2- 172.21.15.82:0/1913730328 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4b4106940 0x7fa4b41989f0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:47.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:47.125+0000 7fa4bc181700 1 --2- 172.21.15.82:0/1913730328 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa4b4100940 0x7fa4b419ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:47.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:47.125+0000 7fa4bc181700 1 --2- 172.21.15.82:0/1913730328 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4b4101300 0x7fa4b419ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:47.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:47.125+0000 7fa4bc181700 1 -- 172.21.15.82:0/1913730328 >> 172.21.15.82:0/1913730328 conn(0x7fa4b40fc410 msgr2=0x7fa4b4072c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:47.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:47.125+0000 7fa4bc181700 1 -- 172.21.15.82:0/1913730328 shutdown_connections 2023-09-23T08:55:47.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:47.125+0000 7fa4bc181700 1 -- 172.21.15.82:0/1913730328 wait complete. 2023-09-23T08:55:47.143 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-09-23T08:55:47.669 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":330,"stamp":"2023-09-23T08:55:46.064516+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":655292,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":607,"num_read_kb":423,"num_write":417,"num_write_kb":3068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":1181408,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":343,"ondisk_log_size":343,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":337644,"kb_used_data":13364,"kb_used_omap":20,"kb_used_meta":324075,"kb_avail":1124604180,"statfs":{"total":1151940427776,"available":1151594680320,"internally_reserved":0,"allocated":13684736,"data_stored":7468177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21372,"internal_metadata":331852932},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":68,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003070"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.428816+0000","last_change":"2023-09-23T08:54:53.110235+0000","last_active":"2023-09-23T08:55:23.428816+0000","last_peered":"2023-09-23T08:55:23.428816+0000","last_clean":"2023-09-23T08:55:23.428816+0000","last_became_active":"2023-09-23T08:54:53.109445+0000","last_became_peered":"2023-09-23T08:54:53.109445+0000","last_unstale":"2023-09-23T08:55:23.428816+0000","last_undegraded":"2023-09-23T08:55:23.428816+0000","last_fullsized":"2023-09-23T08:55:23.428816+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T10:56:35.558203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.432042+0000","last_change":"2023-09-23T08:54:53.105948+0000","last_active":"2023-09-23T08:55:23.432042+0000","last_peered":"2023-09-23T08:55:23.432042+0000","last_clean":"2023-09-23T08:55:23.432042+0000","last_became_active":"2023-09-23T08:54:53.105627+0000","last_became_peered":"2023-09-23T08:54:53.105627+0000","last_unstale":"2023-09-23T08:55:23.432042+0000","last_undegraded":"2023-09-23T08:55:23.432042+0000","last_fullsized":"2023-09-23T08:55:23.432042+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T13:02:00.876110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.431657+0000","last_change":"2023-09-23T08:54:53.099318+0000","last_active":"2023-09-23T08:55:23.431657+0000","last_peered":"2023-09-23T08:55:23.431657+0000","last_clean":"2023-09-23T08:55:23.431657+0000","last_became_active":"2023-09-23T08:54:53.099002+0000","last_became_peered":"2023-09-23T08:54:53.099002+0000","last_unstale":"2023-09-23T08:55:23.431657+0000","last_undegraded":"2023-09-23T08:55:23.431657+0000","last_fullsized":"2023-09-23T08:55:23.431657+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T11:00:15.427942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.533888+0000","last_change":"2023-09-23T08:54:53.114757+0000","last_active":"2023-09-23T08:55:23.533888+0000","last_peered":"2023-09-23T08:55:23.533888+0000","last_clean":"2023-09-23T08:55:23.533888+0000","last_became_active":"2023-09-23T08:54:53.113979+0000","last_became_peered":"2023-09-23T08:54:53.113979+0000","last_unstale":"2023-09-23T08:55:23.533888+0000","last_undegraded":"2023-09-23T08:55:23.533888+0000","last_fullsized":"2023-09-23T08:55:23.533888+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T11:02:27.209284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.431672+0000","last_change":"2023-09-23T08:54:53.102122+0000","last_active":"2023-09-23T08:55:23.431672+0000","last_peered":"2023-09-23T08:55:23.431672+0000","last_clean":"2023-09-23T08:55:23.431672+0000","last_became_active":"2023-09-23T08:54:53.101781+0000","last_became_peered":"2023-09-23T08:54:53.101781+0000","last_unstale":"2023-09-23T08:55:23.431672+0000","last_undegraded":"2023-09-23T08:55:23.431672+0000","last_fullsized":"2023-09-23T08:55:23.431672+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T18:27:41.371961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.428186+0000","last_change":"2023-09-23T08:54:53.103617+0000","last_active":"2023-09-23T08:55:23.428186+0000","last_peered":"2023-09-23T08:55:23.428186+0000","last_clean":"2023-09-23T08:55:23.428186+0000","last_became_active":"2023-09-23T08:54:53.103259+0000","last_became_peered":"2023-09-23T08:54:53.103259+0000","last_unstale":"2023-09-23T08:55:23.428186+0000","last_undegraded":"2023-09-23T08:55:23.428186+0000","last_fullsized":"2023-09-23T08:55:23.428186+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:51:15.970275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.431792+0000","last_change":"2023-09-23T08:54:53.110512+0000","last_active":"2023-09-23T08:55:23.431792+0000","last_peered":"2023-09-23T08:55:23.431792+0000","last_clean":"2023-09-23T08:55:23.431792+0000","last_became_active":"2023-09-23T08:54:53.110166+0000","last_became_peered":"2023-09-23T08:54:53.110166+0000","last_unstale":"2023-09-23T08:55:23.431792+0000","last_undegraded":"2023-09-23T08:55:23.431792+0000","last_fullsized":"2023-09-23T08:55:23.431792+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T20:45:16.248775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.439672+0000","last_change":"2023-09-23T08:54:53.111373+0000","last_active":"2023-09-23T08:55:23.439672+0000","last_peered":"2023-09-23T08:55:23.439672+0000","last_clean":"2023-09-23T08:55:23.439672+0000","last_became_active":"2023-09-23T08:54:53.111045+0000","last_became_peered":"2023-09-23T08:54:53.111045+0000","last_unstale":"2023-09-23T08:55:23.439672+0000","last_undegraded":"2023-09-23T08:55:23.439672+0000","last_fullsized":"2023-09-23T08:55:23.439672+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:25:16.099829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.432716+0000","last_change":"2023-09-23T08:54:53.100219+0000","last_active":"2023-09-23T08:55:23.432716+0000","last_peered":"2023-09-23T08:55:23.432716+0000","last_clean":"2023-09-23T08:55:23.432716+0000","last_became_active":"2023-09-23T08:54:53.099925+0000","last_became_peered":"2023-09-23T08:54:53.099925+0000","last_unstale":"2023-09-23T08:55:23.432716+0000","last_undegraded":"2023-09-23T08:55:23.432716+0000","last_fullsized":"2023-09-23T08:55:23.432716+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T20:53:32.264331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.439006+0000","last_change":"2023-09-23T08:55:23.439006+0000","last_active":"2023-09-23T08:55:23.439006+0000","last_peered":"2023-09-23T08:55:23.439006+0000","last_clean":"2023-09-23T08:55:23.439006+0000","last_became_active":"2023-09-23T08:55:23.438533+0000","last_became_peered":"2023-09-23T08:55:23.438533+0000","last_unstale":"2023-09-23T08:55:23.439006+0000","last_undegraded":"2023-09-23T08:55:23.439006+0000","last_fullsized":"2023-09-23T08:55:23.439006+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T12:30:40.717065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.431583+0000","last_change":"2023-09-23T08:54:53.108175+0000","last_active":"2023-09-23T08:55:23.431583+0000","last_peered":"2023-09-23T08:55:23.431583+0000","last_clean":"2023-09-23T08:55:23.431583+0000","last_became_active":"2023-09-23T08:54:53.107889+0000","last_became_peered":"2023-09-23T08:54:53.107889+0000","last_unstale":"2023-09-23T08:55:23.431583+0000","last_undegraded":"2023-09-23T08:55:23.431583+0000","last_fullsized":"2023-09-23T08:55:23.431583+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T11:57:28.537929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.533759+0000","last_change":"2023-09-23T08:54:53.114564+0000","last_active":"2023-09-23T08:55:23.533759+0000","last_peered":"2023-09-23T08:55:23.533759+0000","last_clean":"2023-09-23T08:55:23.533759+0000","last_became_active":"2023-09-23T08:54:53.113937+0000","last_became_peered":"2023-09-23T08:54:53.113937+0000","last_unstale":"2023-09-23T08:55:23.533759+0000","last_undegraded":"2023-09-23T08:55:23.533759+0000","last_fullsized":"2023-09-23T08:55:23.533759+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:07:59.125776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.433104+0000","last_change":"2023-09-23T08:54:53.108544+0000","last_active":"2023-09-23T08:55:23.433104+0000","last_peered":"2023-09-23T08:55:23.433104+0000","last_clean":"2023-09-23T08:55:23.433104+0000","last_became_active":"2023-09-23T08:54:53.108226+0000","last_became_peered":"2023-09-23T08:54:53.108226+0000","last_unstale":"2023-09-23T08:55:23.433104+0000","last_undegraded":"2023-09-23T08:55:23.433104+0000","last_fullsized":"2023-09-23T08:55:23.433104+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T20:44:46.654608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.430951+0000","last_change":"2023-09-23T08:54:53.106250+0000","last_active":"2023-09-23T08:55:23.430951+0000","last_peered":"2023-09-23T08:55:23.430951+0000","last_clean":"2023-09-23T08:55:23.430951+0000","last_became_active":"2023-09-23T08:54:53.105912+0000","last_became_peered":"2023-09-23T08:54:53.105912+0000","last_unstale":"2023-09-23T08:55:23.430951+0000","last_undegraded":"2023-09-23T08:55:23.430951+0000","last_fullsized":"2023-09-23T08:55:23.430951+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T09:50:26.711654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.441265+0000","last_change":"2023-09-23T08:55:23.441265+0000","last_active":"2023-09-23T08:55:23.441265+0000","last_peered":"2023-09-23T08:55:23.441265+0000","last_clean":"2023-09-23T08:55:23.441265+0000","last_became_active":"2023-09-23T08:55:23.440800+0000","last_became_peered":"2023-09-23T08:55:23.440800+0000","last_unstale":"2023-09-23T08:55:23.441265+0000","last_undegraded":"2023-09-23T08:55:23.441265+0000","last_fullsized":"2023-09-23T08:55:23.441265+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T10:27:59.968816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.431778+0000","last_change":"2023-09-23T08:54:53.098507+0000","last_active":"2023-09-23T08:55:23.431778+0000","last_peered":"2023-09-23T08:55:23.431778+0000","last_clean":"2023-09-23T08:55:23.431778+0000","last_became_active":"2023-09-23T08:54:53.098153+0000","last_became_peered":"2023-09-23T08:54:53.098153+0000","last_unstale":"2023-09-23T08:55:23.431778+0000","last_undegraded":"2023-09-23T08:55:23.431778+0000","last_fullsized":"2023-09-23T08:55:23.431778+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T09:39:06.960825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.428944+0000","last_change":"2023-09-23T08:54:53.110427+0000","last_active":"2023-09-23T08:55:23.428944+0000","last_peered":"2023-09-23T08:55:23.428944+0000","last_clean":"2023-09-23T08:55:23.428944+0000","last_became_active":"2023-09-23T08:54:53.109868+0000","last_became_peered":"2023-09-23T08:54:53.109868+0000","last_unstale":"2023-09-23T08:55:23.428944+0000","last_undegraded":"2023-09-23T08:55:23.428944+0000","last_fullsized":"2023-09-23T08:55:23.428944+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:58:18.067768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.428188+0000","last_change":"2023-09-23T08:54:53.107613+0000","last_active":"2023-09-23T08:55:23.428188+0000","last_peered":"2023-09-23T08:55:23.428188+0000","last_clean":"2023-09-23T08:55:23.428188+0000","last_became_active":"2023-09-23T08:54:53.107230+0000","last_became_peered":"2023-09-23T08:54:53.107230+0000","last_unstale":"2023-09-23T08:55:23.428188+0000","last_undegraded":"2023-09-23T08:55:23.428188+0000","last_fullsized":"2023-09-23T08:55:23.428188+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:36:14.702321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.437172+0000","last_change":"2023-09-23T08:54:53.102530+0000","last_active":"2023-09-23T08:55:23.437172+0000","last_peered":"2023-09-23T08:55:23.437172+0000","last_clean":"2023-09-23T08:55:23.437172+0000","last_became_active":"2023-09-23T08:54:53.102004+0000","last_became_peered":"2023-09-23T08:54:53.102004+0000","last_unstale":"2023-09-23T08:55:23.437172+0000","last_undegraded":"2023-09-23T08:55:23.437172+0000","last_fullsized":"2023-09-23T08:55:23.437172+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:18:54.809976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"86'13","reported_seq":94,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:41.464978+0000","last_change":"2023-09-23T08:55:23.449398+0000","last_active":"2023-09-23T08:55:41.464978+0000","last_peered":"2023-09-23T08:55:41.464978+0000","last_clean":"2023-09-23T08:55:41.464978+0000","last_became_active":"2023-09-23T08:55:23.434193+0000","last_became_peered":"2023-09-23T08:55:23.434193+0000","last_unstale":"2023-09-23T08:55:41.464978+0000","last_undegraded":"2023-09-23T08:55:41.464978+0000","last_fullsized":"2023-09-23T08:55:41.464978+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:21:58.024636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.437670+0000","last_change":"2023-09-23T08:54:53.109844+0000","last_active":"2023-09-23T08:55:23.437670+0000","last_peered":"2023-09-23T08:55:23.437670+0000","last_clean":"2023-09-23T08:55:23.437670+0000","last_became_active":"2023-09-23T08:54:53.109456+0000","last_became_peered":"2023-09-23T08:54:53.109456+0000","last_unstale":"2023-09-23T08:55:23.437670+0000","last_undegraded":"2023-09-23T08:55:23.437670+0000","last_fullsized":"2023-09-23T08:55:23.437670+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:35:18.729698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.437928+0000","last_change":"2023-09-23T08:54:52.090023+0000","last_active":"2023-09-23T08:55:23.437928+0000","last_peered":"2023-09-23T08:55:23.437928+0000","last_clean":"2023-09-23T08:55:23.437928+0000","last_became_active":"2023-09-23T08:54:52.089587+0000","last_became_peered":"2023-09-23T08:54:52.089587+0000","last_unstale":"2023-09-23T08:55:23.437928+0000","last_undegraded":"2023-09-23T08:55:23.437928+0000","last_fullsized":"2023-09-23T08:55:23.437928+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T09:08:05.801189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.430638+0000","last_change":"2023-09-23T08:54:53.098662+0000","last_active":"2023-09-23T08:55:23.430638+0000","last_peered":"2023-09-23T08:55:23.430638+0000","last_clean":"2023-09-23T08:55:23.430638+0000","last_became_active":"2023-09-23T08:54:53.098288+0000","last_became_peered":"2023-09-23T08:54:53.098288+0000","last_unstale":"2023-09-23T08:55:23.430638+0000","last_undegraded":"2023-09-23T08:55:23.430638+0000","last_fullsized":"2023-09-23T08:55:23.430638+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:21:44.163895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"86'12","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.432199+0000","last_change":"2023-09-23T08:54:52.083109+0000","last_active":"2023-09-23T08:55:23.432199+0000","last_peered":"2023-09-23T08:55:23.432199+0000","last_clean":"2023-09-23T08:55:23.432199+0000","last_became_active":"2023-09-23T08:54:52.082479+0000","last_became_peered":"2023-09-23T08:54:52.082479+0000","last_unstale":"2023-09-23T08:55:23.432199+0000","last_undegraded":"2023-09-23T08:55:23.432199+0000","last_fullsized":"2023-09-23T08:55:23.432199+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T14:19:13.234767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.431822+0000","last_change":"2023-09-23T08:54:53.105112+0000","last_active":"2023-09-23T08:55:23.431822+0000","last_peered":"2023-09-23T08:55:23.431822+0000","last_clean":"2023-09-23T08:55:23.431822+0000","last_became_active":"2023-09-23T08:54:53.104639+0000","last_became_peered":"2023-09-23T08:54:53.104639+0000","last_unstale":"2023-09-23T08:55:23.431822+0000","last_undegraded":"2023-09-23T08:55:23.431822+0000","last_fullsized":"2023-09-23T08:55:23.431822+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T09:13:19.421762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"86'5","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.431617+0000","last_change":"2023-09-23T08:54:52.082798+0000","last_active":"2023-09-23T08:55:23.431617+0000","last_peered":"2023-09-23T08:55:23.431617+0000","last_clean":"2023-09-23T08:55:23.431617+0000","last_became_active":"2023-09-23T08:54:52.082455+0000","last_became_peered":"2023-09-23T08:54:52.082455+0000","last_unstale":"2023-09-23T08:55:23.431617+0000","last_undegraded":"2023-09-23T08:55:23.431617+0000","last_fullsized":"2023-09-23T08:55:23.431617+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T18:53:37.376211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.432462+0000","last_change":"2023-09-23T08:54:53.105012+0000","last_active":"2023-09-23T08:55:23.432462+0000","last_peered":"2023-09-23T08:55:23.432462+0000","last_clean":"2023-09-23T08:55:23.432462+0000","last_became_active":"2023-09-23T08:54:53.104670+0000","last_became_peered":"2023-09-23T08:54:53.104670+0000","last_unstale":"2023-09-23T08:55:23.432462+0000","last_undegraded":"2023-09-23T08:55:23.432462+0000","last_fullsized":"2023-09-23T08:55:23.432462+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T13:57:42.013692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"86'6","reported_seq":70,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:42.565140+0000","last_change":"2023-09-23T08:54:52.085771+0000","last_active":"2023-09-23T08:55:42.565140+0000","last_peered":"2023-09-23T08:55:42.565140+0000","last_clean":"2023-09-23T08:55:42.565140+0000","last_became_active":"2023-09-23T08:54:52.085424+0000","last_became_peered":"2023-09-23T08:54:52.085424+0000","last_unstale":"2023-09-23T08:55:42.565140+0000","last_undegraded":"2023-09-23T08:55:42.565140+0000","last_fullsized":"2023-09-23T08:55:42.565140+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T11:26:36.068148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1012,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":2,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.431446+0000","last_change":"2023-09-23T08:54:53.109830+0000","last_active":"2023-09-23T08:55:23.431446+0000","last_peered":"2023-09-23T08:55:23.431446+0000","last_clean":"2023-09-23T08:55:23.431446+0000","last_became_active":"2023-09-23T08:54:53.109532+0000","last_became_peered":"2023-09-23T08:54:53.109532+0000","last_unstale":"2023-09-23T08:55:23.431446+0000","last_undegraded":"2023-09-23T08:55:23.431446+0000","last_fullsized":"2023-09-23T08:55:23.431446+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:14:37.986156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"86'7","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.428457+0000","last_change":"2023-09-23T08:54:52.075998+0000","last_active":"2023-09-23T08:55:23.428457+0000","last_peered":"2023-09-23T08:55:23.428457+0000","last_clean":"2023-09-23T08:55:23.428457+0000","last_became_active":"2023-09-23T08:54:52.075701+0000","last_became_peered":"2023-09-23T08:54:52.075701+0000","last_unstale":"2023-09-23T08:55:23.428457+0000","last_undegraded":"2023-09-23T08:55:23.428457+0000","last_fullsized":"2023-09-23T08:55:23.428457+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:35:20.680135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.432114+0000","last_change":"2023-09-23T08:54:53.106654+0000","last_active":"2023-09-23T08:55:23.432114+0000","last_peered":"2023-09-23T08:55:23.432114+0000","last_clean":"2023-09-23T08:55:23.432114+0000","last_became_active":"2023-09-23T08:54:53.106348+0000","last_became_peered":"2023-09-23T08:54:53.106348+0000","last_unstale":"2023-09-23T08:55:23.432114+0000","last_undegraded":"2023-09-23T08:55:23.432114+0000","last_fullsized":"2023-09-23T08:55:23.432114+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:48:44.274107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"86'3","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.431350+0000","last_change":"2023-09-23T08:54:52.073666+0000","last_active":"2023-09-23T08:55:23.431350+0000","last_peered":"2023-09-23T08:55:23.431350+0000","last_clean":"2023-09-23T08:55:23.431350+0000","last_became_active":"2023-09-23T08:54:52.073248+0000","last_became_peered":"2023-09-23T08:54:52.073248+0000","last_unstale":"2023-09-23T08:55:23.431350+0000","last_undegraded":"2023-09-23T08:55:23.431350+0000","last_fullsized":"2023-09-23T08:55:23.431350+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T13:43:51.125737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.439563+0000","last_change":"2023-09-23T08:54:53.109621+0000","last_active":"2023-09-23T08:55:23.439563+0000","last_peered":"2023-09-23T08:55:23.439563+0000","last_clean":"2023-09-23T08:55:23.439563+0000","last_became_active":"2023-09-23T08:54:53.109304+0000","last_became_peered":"2023-09-23T08:54:53.109304+0000","last_unstale":"2023-09-23T08:55:23.439563+0000","last_undegraded":"2023-09-23T08:55:23.439563+0000","last_fullsized":"2023-09-23T08:55:23.439563+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:23:57.973639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"86'3","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.431509+0000","last_change":"2023-09-23T08:54:52.081580+0000","last_active":"2023-09-23T08:55:23.431509+0000","last_peered":"2023-09-23T08:55:23.431509+0000","last_clean":"2023-09-23T08:55:23.431509+0000","last_became_active":"2023-09-23T08:54:52.081151+0000","last_became_peered":"2023-09-23T08:54:52.081151+0000","last_unstale":"2023-09-23T08:55:23.431509+0000","last_undegraded":"2023-09-23T08:55:23.431509+0000","last_fullsized":"2023-09-23T08:55:23.431509+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T14:53:36.622852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.428124+0000","last_change":"2023-09-23T08:54:53.108334+0000","last_active":"2023-09-23T08:55:23.428124+0000","last_peered":"2023-09-23T08:55:23.428124+0000","last_clean":"2023-09-23T08:55:23.428124+0000","last_became_active":"2023-09-23T08:54:53.108038+0000","last_became_peered":"2023-09-23T08:54:53.108038+0000","last_unstale":"2023-09-23T08:55:23.428124+0000","last_undegraded":"2023-09-23T08:55:23.428124+0000","last_fullsized":"2023-09-23T08:55:23.428124+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:22:21.278138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"86'4","reported_seq":113,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:44.589438+0000","last_change":"2023-09-23T08:54:52.084025+0000","last_active":"2023-09-23T08:55:44.589438+0000","last_peered":"2023-09-23T08:55:44.589438+0000","last_clean":"2023-09-23T08:55:44.589438+0000","last_became_active":"2023-09-23T08:54:52.083625+0000","last_became_peered":"2023-09-23T08:54:52.083625+0000","last_unstale":"2023-09-23T08:55:44.589438+0000","last_undegraded":"2023-09-23T08:55:44.589438+0000","last_fullsized":"2023-09-23T08:55:44.589438+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T13:02:41.009120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":91,"num_read_kb":91,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.432082+0000","last_change":"2023-09-23T08:54:53.106602+0000","last_active":"2023-09-23T08:55:23.432082+0000","last_peered":"2023-09-23T08:55:23.432082+0000","last_clean":"2023-09-23T08:55:23.432082+0000","last_became_active":"2023-09-23T08:54:53.105501+0000","last_became_peered":"2023-09-23T08:54:53.105501+0000","last_unstale":"2023-09-23T08:55:23.432082+0000","last_undegraded":"2023-09-23T08:55:23.432082+0000","last_fullsized":"2023-09-23T08:55:23.432082+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T10:15:37.314083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"86'4","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.431239+0000","last_change":"2023-09-23T08:54:52.079197+0000","last_active":"2023-09-23T08:55:23.431239+0000","last_peered":"2023-09-23T08:55:23.431239+0000","last_clean":"2023-09-23T08:55:23.431239+0000","last_became_active":"2023-09-23T08:54:52.078748+0000","last_became_peered":"2023-09-23T08:54:52.078748+0000","last_unstale":"2023-09-23T08:55:23.431239+0000","last_undegraded":"2023-09-23T08:55:23.431239+0000","last_fullsized":"2023-09-23T08:55:23.431239+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T18:15:16.139104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.432241+0000","last_change":"2023-09-23T08:54:53.105831+0000","last_active":"2023-09-23T08:55:23.432241+0000","last_peered":"2023-09-23T08:55:23.432241+0000","last_clean":"2023-09-23T08:55:23.432241+0000","last_became_active":"2023-09-23T08:54:53.105511+0000","last_became_peered":"2023-09-23T08:54:53.105511+0000","last_unstale":"2023-09-23T08:55:23.432241+0000","last_undegraded":"2023-09-23T08:55:23.432241+0000","last_fullsized":"2023-09-23T08:55:23.432241+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T10:06:14.045381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"86'5","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.432616+0000","last_change":"2023-09-23T08:54:52.089312+0000","last_active":"2023-09-23T08:55:23.432616+0000","last_peered":"2023-09-23T08:55:23.432616+0000","last_clean":"2023-09-23T08:55:23.432616+0000","last_became_active":"2023-09-23T08:54:52.088762+0000","last_became_peered":"2023-09-23T08:54:52.088762+0000","last_unstale":"2023-09-23T08:55:23.432616+0000","last_undegraded":"2023-09-23T08:55:23.432616+0000","last_fullsized":"2023-09-23T08:55:23.432616+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:31:59.043067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.432075+0000","last_change":"2023-09-23T08:54:53.106972+0000","last_active":"2023-09-23T08:55:23.432075+0000","last_peered":"2023-09-23T08:55:23.432075+0000","last_clean":"2023-09-23T08:55:23.432075+0000","last_became_active":"2023-09-23T08:54:53.105175+0000","last_became_peered":"2023-09-23T08:54:53.105175+0000","last_unstale":"2023-09-23T08:55:23.432075+0000","last_undegraded":"2023-09-23T08:55:23.432075+0000","last_fullsized":"2023-09-23T08:55:23.432075+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T20:07:17.130820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"86'30","reported_seq":144,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:44.585088+0000","last_change":"2023-09-23T08:54:52.077758+0000","last_active":"2023-09-23T08:55:44.585088+0000","last_peered":"2023-09-23T08:55:44.585088+0000","last_clean":"2023-09-23T08:55:44.585088+0000","last_became_active":"2023-09-23T08:54:52.077461+0000","last_became_peered":"2023-09-23T08:54:52.077461+0000","last_unstale":"2023-09-23T08:55:44.585088+0000","last_undegraded":"2023-09-23T08:55:44.585088+0000","last_fullsized":"2023-09-23T08:55:44.585088+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T13:22:15.302812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57476,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":96,"num_read_kb":103,"num_write":32,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.431838+0000","last_change":"2023-09-23T08:54:53.102967+0000","last_active":"2023-09-23T08:55:23.431838+0000","last_peered":"2023-09-23T08:55:23.431838+0000","last_clean":"2023-09-23T08:55:23.431838+0000","last_became_active":"2023-09-23T08:54:53.102608+0000","last_became_peered":"2023-09-23T08:54:53.102608+0000","last_unstale":"2023-09-23T08:55:23.431838+0000","last_undegraded":"2023-09-23T08:55:23.431838+0000","last_fullsized":"2023-09-23T08:55:23.431838+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:15:18.457676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"86'9","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.436872+0000","last_change":"2023-09-23T08:54:52.083885+0000","last_active":"2023-09-23T08:55:23.436872+0000","last_peered":"2023-09-23T08:55:23.436872+0000","last_clean":"2023-09-23T08:55:23.436872+0000","last_became_active":"2023-09-23T08:54:52.083530+0000","last_became_peered":"2023-09-23T08:54:52.083530+0000","last_unstale":"2023-09-23T08:55:23.436872+0000","last_undegraded":"2023-09-23T08:55:23.436872+0000","last_fullsized":"2023-09-23T08:55:23.436872+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:13:15.173145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.431685+0000","last_change":"2023-09-23T08:54:53.102429+0000","last_active":"2023-09-23T08:55:23.431685+0000","last_peered":"2023-09-23T08:55:23.431685+0000","last_clean":"2023-09-23T08:55:23.431685+0000","last_became_active":"2023-09-23T08:54:53.102139+0000","last_became_peered":"2023-09-23T08:54:53.102139+0000","last_unstale":"2023-09-23T08:55:23.431685+0000","last_undegraded":"2023-09-23T08:55:23.431685+0000","last_fullsized":"2023-09-23T08:55:23.431685+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T14:20:29.728805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"86'5","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.431753+0000","last_change":"2023-09-23T08:54:52.083380+0000","last_active":"2023-09-23T08:55:23.431753+0000","last_peered":"2023-09-23T08:55:23.431753+0000","last_clean":"2023-09-23T08:55:23.431753+0000","last_became_active":"2023-09-23T08:54:52.083094+0000","last_became_peered":"2023-09-23T08:54:52.083094+0000","last_unstale":"2023-09-23T08:55:23.431753+0000","last_undegraded":"2023-09-23T08:55:23.431753+0000","last_fullsized":"2023-09-23T08:55:23.431753+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:31:04.004340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.431536+0000","last_change":"2023-09-23T08:54:53.107671+0000","last_active":"2023-09-23T08:55:23.431536+0000","last_peered":"2023-09-23T08:55:23.431536+0000","last_clean":"2023-09-23T08:55:23.431536+0000","last_became_active":"2023-09-23T08:54:53.107372+0000","last_became_peered":"2023-09-23T08:54:53.107372+0000","last_unstale":"2023-09-23T08:55:23.431536+0000","last_undegraded":"2023-09-23T08:55:23.431536+0000","last_fullsized":"2023-09-23T08:55:23.431536+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T18:52:05.503710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'6","reported_seq":68,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:40.557861+0000","last_change":"2023-09-23T08:54:52.080556+0000","last_active":"2023-09-23T08:55:40.557861+0000","last_peered":"2023-09-23T08:55:40.557861+0000","last_clean":"2023-09-23T08:55:40.557861+0000","last_became_active":"2023-09-23T08:54:52.080220+0000","last_became_peered":"2023-09-23T08:54:52.080220+0000","last_unstale":"2023-09-23T08:55:40.557861+0000","last_undegraded":"2023-09-23T08:55:40.557861+0000","last_fullsized":"2023-09-23T08:55:40.557861+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:05:06.321996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":978,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":45,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.431075+0000","last_change":"2023-09-23T08:54:53.107044+0000","last_active":"2023-09-23T08:55:23.431075+0000","last_peered":"2023-09-23T08:55:23.431075+0000","last_clean":"2023-09-23T08:55:23.431075+0000","last_became_active":"2023-09-23T08:54:53.106715+0000","last_became_peered":"2023-09-23T08:54:53.106715+0000","last_unstale":"2023-09-23T08:55:23.431075+0000","last_undegraded":"2023-09-23T08:55:23.431075+0000","last_fullsized":"2023-09-23T08:55:23.431075+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T09:20:08.571706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"86'17","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.432200+0000","last_change":"2023-09-23T08:54:52.078052+0000","last_active":"2023-09-23T08:55:23.432200+0000","last_peered":"2023-09-23T08:55:23.432200+0000","last_clean":"2023-09-23T08:55:23.432200+0000","last_became_active":"2023-09-23T08:54:52.077678+0000","last_became_peered":"2023-09-23T08:54:52.077678+0000","last_unstale":"2023-09-23T08:55:23.432200+0000","last_undegraded":"2023-09-23T08:55:23.432200+0000","last_fullsized":"2023-09-23T08:55:23.432200+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T18:34:12.590233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.431509+0000","last_change":"2023-09-23T08:54:53.107673+0000","last_active":"2023-09-23T08:55:23.431509+0000","last_peered":"2023-09-23T08:55:23.431509+0000","last_clean":"2023-09-23T08:55:23.431509+0000","last_became_active":"2023-09-23T08:54:53.107373+0000","last_became_peered":"2023-09-23T08:54:53.107373+0000","last_unstale":"2023-09-23T08:55:23.431509+0000","last_undegraded":"2023-09-23T08:55:23.431509+0000","last_fullsized":"2023-09-23T08:55:23.431509+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T18:11:06.759793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"86'2","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.431541+0000","last_change":"2023-09-23T08:54:52.085460+0000","last_active":"2023-09-23T08:55:23.431541+0000","last_peered":"2023-09-23T08:55:23.431541+0000","last_clean":"2023-09-23T08:55:23.431541+0000","last_became_active":"2023-09-23T08:54:52.085186+0000","last_became_peered":"2023-09-23T08:54:52.085186+0000","last_unstale":"2023-09-23T08:55:23.431541+0000","last_undegraded":"2023-09-23T08:55:23.431541+0000","last_fullsized":"2023-09-23T08:55:23.431541+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T10:44:18.969355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.428747+0000","last_change":"2023-09-23T08:54:53.103630+0000","last_active":"2023-09-23T08:55:23.428747+0000","last_peered":"2023-09-23T08:55:23.428747+0000","last_clean":"2023-09-23T08:55:23.428747+0000","last_became_active":"2023-09-23T08:54:53.103270+0000","last_became_peered":"2023-09-23T08:54:53.103270+0000","last_unstale":"2023-09-23T08:55:23.428747+0000","last_undegraded":"2023-09-23T08:55:23.428747+0000","last_fullsized":"2023-09-23T08:55:23.428747+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T13:21:04.753974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"86'1","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.427814+0000","last_change":"2023-09-23T08:54:52.089279+0000","last_active":"2023-09-23T08:55:23.427814+0000","last_peered":"2023-09-23T08:55:23.427814+0000","last_clean":"2023-09-23T08:55:23.427814+0000","last_became_active":"2023-09-23T08:54:52.088861+0000","last_became_peered":"2023-09-23T08:54:52.088861+0000","last_unstale":"2023-09-23T08:55:23.427814+0000","last_undegraded":"2023-09-23T08:55:23.427814+0000","last_fullsized":"2023-09-23T08:55:23.427814+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T12:49:36.034399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"86'1","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.428306+0000","last_change":"2023-09-23T08:54:53.105653+0000","last_active":"2023-09-23T08:55:23.428306+0000","last_peered":"2023-09-23T08:55:23.428306+0000","last_clean":"2023-09-23T08:55:23.428306+0000","last_became_active":"2023-09-23T08:54:53.105309+0000","last_became_peered":"2023-09-23T08:54:53.105309+0000","last_unstale":"2023-09-23T08:55:23.428306+0000","last_undegraded":"2023-09-23T08:55:23.428306+0000","last_fullsized":"2023-09-23T08:55:23.428306+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T10:25:27.100946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"86'5","reported_seq":68,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:43.469099+0000","last_change":"2023-09-23T08:54:52.080521+0000","last_active":"2023-09-23T08:55:43.469099+0000","last_peered":"2023-09-23T08:55:43.469099+0000","last_clean":"2023-09-23T08:55:43.469099+0000","last_became_active":"2023-09-23T08:54:52.080164+0000","last_became_peered":"2023-09-23T08:54:52.080164+0000","last_unstale":"2023-09-23T08:55:43.469099+0000","last_undegraded":"2023-09-23T08:55:43.469099+0000","last_fullsized":"2023-09-23T08:55:43.469099+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T14:07:18.272863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":45,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.428186+0000","last_change":"2023-09-23T08:54:53.107516+0000","last_active":"2023-09-23T08:55:23.428186+0000","last_peered":"2023-09-23T08:55:23.428186+0000","last_clean":"2023-09-23T08:55:23.428186+0000","last_became_active":"2023-09-23T08:54:53.106785+0000","last_became_peered":"2023-09-23T08:54:53.106785+0000","last_unstale":"2023-09-23T08:55:23.428186+0000","last_undegraded":"2023-09-23T08:55:23.428186+0000","last_fullsized":"2023-09-23T08:55:23.428186+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T11:51:04.634599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.432574+0000","last_change":"2023-09-23T08:54:53.110406+0000","last_active":"2023-09-23T08:55:23.432574+0000","last_peered":"2023-09-23T08:55:23.432574+0000","last_clean":"2023-09-23T08:55:23.432574+0000","last_became_active":"2023-09-23T08:54:53.107758+0000","last_became_peered":"2023-09-23T08:54:53.107758+0000","last_unstale":"2023-09-23T08:55:23.432574+0000","last_undegraded":"2023-09-23T08:55:23.432574+0000","last_fullsized":"2023-09-23T08:55:23.432574+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T11:50:56.031628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'5","reported_seq":68,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:42.560212+0000","last_change":"2023-09-23T08:54:52.081384+0000","last_active":"2023-09-23T08:55:42.560212+0000","last_peered":"2023-09-23T08:55:42.560212+0000","last_clean":"2023-09-23T08:55:42.560212+0000","last_became_active":"2023-09-23T08:54:52.081082+0000","last_became_peered":"2023-09-23T08:54:52.081082+0000","last_unstale":"2023-09-23T08:55:42.560212+0000","last_undegraded":"2023-09-23T08:55:42.560212+0000","last_fullsized":"2023-09-23T08:55:42.560212+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:35:45.308145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.438813+0000","last_change":"2023-09-23T08:54:53.109011+0000","last_active":"2023-09-23T08:55:23.438813+0000","last_peered":"2023-09-23T08:55:23.438813+0000","last_clean":"2023-09-23T08:55:23.438813+0000","last_became_active":"2023-09-23T08:54:53.108520+0000","last_became_peered":"2023-09-23T08:54:53.108520+0000","last_unstale":"2023-09-23T08:55:23.438813+0000","last_undegraded":"2023-09-23T08:55:23.438813+0000","last_fullsized":"2023-09-23T08:55:23.438813+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:50:01.361084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"86'6","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.533656+0000","last_change":"2023-09-23T08:54:52.078525+0000","last_active":"2023-09-23T08:55:23.533656+0000","last_peered":"2023-09-23T08:55:23.533656+0000","last_clean":"2023-09-23T08:55:23.533656+0000","last_became_active":"2023-09-23T08:54:52.078177+0000","last_became_peered":"2023-09-23T08:54:52.078177+0000","last_unstale":"2023-09-23T08:55:23.533656+0000","last_undegraded":"2023-09-23T08:55:23.533656+0000","last_fullsized":"2023-09-23T08:55:23.533656+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:53:54.342881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":352,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.431177+0000","last_change":"2023-09-23T08:53:33.610965+0000","last_active":"2023-09-23T08:55:23.431177+0000","last_peered":"2023-09-23T08:55:23.431177+0000","last_clean":"2023-09-23T08:55:23.431177+0000","last_became_active":"2023-09-23T08:53:33.610529+0000","last_became_peered":"2023-09-23T08:53:33.610529+0000","last_unstale":"2023-09-23T08:55:23.431177+0000","last_undegraded":"2023-09-23T08:55:23.431177+0000","last_fullsized":"2023-09-23T08:55:23.431177+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:50:00.779071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:50:00.779071+0000","last_clean_scrub_stamp":"2023-09-23T08:50:00.779071+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:07:05.451303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.442747+0000","last_change":"2023-09-23T08:55:23.442747+0000","last_active":"2023-09-23T08:55:23.442747+0000","last_peered":"2023-09-23T08:55:23.442747+0000","last_clean":"2023-09-23T08:55:23.442747+0000","last_became_active":"2023-09-23T08:55:23.442328+0000","last_became_peered":"2023-09-23T08:55:23.442328+0000","last_unstale":"2023-09-23T08:55:23.442747+0000","last_undegraded":"2023-09-23T08:55:23.442747+0000","last_fullsized":"2023-09-23T08:55:23.442747+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T09:31:53.487979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"86'4","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.442345+0000","last_change":"2023-09-23T08:55:23.442345+0000","last_active":"2023-09-23T08:55:23.442345+0000","last_peered":"2023-09-23T08:55:23.442345+0000","last_clean":"2023-09-23T08:55:23.442345+0000","last_became_active":"2023-09-23T08:55:23.434799+0000","last_became_peered":"2023-09-23T08:55:23.434799+0000","last_unstale":"2023-09-23T08:55:23.442345+0000","last_undegraded":"2023-09-23T08:55:23.442345+0000","last_fullsized":"2023-09-23T08:55:23.442345+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T08:56:24.431145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"86'4","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.431996+0000","last_change":"2023-09-23T08:54:52.080482+0000","last_active":"2023-09-23T08:55:23.431996+0000","last_peered":"2023-09-23T08:55:23.431996+0000","last_clean":"2023-09-23T08:55:23.431996+0000","last_became_active":"2023-09-23T08:54:52.079756+0000","last_became_peered":"2023-09-23T08:54:52.079756+0000","last_unstale":"2023-09-23T08:55:23.431996+0000","last_undegraded":"2023-09-23T08:55:23.431996+0000","last_fullsized":"2023-09-23T08:55:23.431996+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:55:32.242149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.433310+0000","last_change":"2023-09-23T08:54:53.092828+0000","last_active":"2023-09-23T08:55:23.433310+0000","last_peered":"2023-09-23T08:55:23.433310+0000","last_clean":"2023-09-23T08:55:23.433310+0000","last_became_active":"2023-09-23T08:54:53.092486+0000","last_became_peered":"2023-09-23T08:54:53.092486+0000","last_unstale":"2023-09-23T08:55:23.433310+0000","last_undegraded":"2023-09-23T08:55:23.433310+0000","last_fullsized":"2023-09-23T08:55:23.433310+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T13:54:09.634679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"86'10","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.428062+0000","last_change":"2023-09-23T08:54:52.081801+0000","last_active":"2023-09-23T08:55:23.428062+0000","last_peered":"2023-09-23T08:55:23.428062+0000","last_clean":"2023-09-23T08:55:23.428062+0000","last_became_active":"2023-09-23T08:54:52.081449+0000","last_became_peered":"2023-09-23T08:54:52.081449+0000","last_unstale":"2023-09-23T08:55:23.428062+0000","last_undegraded":"2023-09-23T08:55:23.428062+0000","last_fullsized":"2023-09-23T08:55:23.428062+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T14:36:52.210295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.439897+0000","last_change":"2023-09-23T08:54:53.101037+0000","last_active":"2023-09-23T08:55:23.439897+0000","last_peered":"2023-09-23T08:55:23.439897+0000","last_clean":"2023-09-23T08:55:23.439897+0000","last_became_active":"2023-09-23T08:54:53.100673+0000","last_became_peered":"2023-09-23T08:54:53.100673+0000","last_unstale":"2023-09-23T08:55:23.439897+0000","last_undegraded":"2023-09-23T08:55:23.439897+0000","last_fullsized":"2023-09-23T08:55:23.439897+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:11:55.146162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"86'7","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.533765+0000","last_change":"2023-09-23T08:54:52.077785+0000","last_active":"2023-09-23T08:55:23.533765+0000","last_peered":"2023-09-23T08:55:23.533765+0000","last_clean":"2023-09-23T08:55:23.533765+0000","last_became_active":"2023-09-23T08:54:52.077306+0000","last_became_peered":"2023-09-23T08:54:52.077306+0000","last_unstale":"2023-09-23T08:55:23.533765+0000","last_undegraded":"2023-09-23T08:55:23.533765+0000","last_fullsized":"2023-09-23T08:55:23.533765+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T18:21:25.957376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.431935+0000","last_change":"2023-09-23T08:54:53.106534+0000","last_active":"2023-09-23T08:55:23.431935+0000","last_peered":"2023-09-23T08:55:23.431935+0000","last_clean":"2023-09-23T08:55:23.431935+0000","last_became_active":"2023-09-23T08:54:53.105928+0000","last_became_peered":"2023-09-23T08:54:53.105928+0000","last_unstale":"2023-09-23T08:55:23.431935+0000","last_undegraded":"2023-09-23T08:55:23.431935+0000","last_fullsized":"2023-09-23T08:55:23.431935+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:25:27.390043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.444909+0000","last_change":"2023-09-23T08:55:23.444909+0000","last_active":"2023-09-23T08:55:23.444909+0000","last_peered":"2023-09-23T08:55:23.444909+0000","last_clean":"2023-09-23T08:55:23.444909+0000","last_became_active":"2023-09-23T08:55:23.440885+0000","last_became_peered":"2023-09-23T08:55:23.440885+0000","last_unstale":"2023-09-23T08:55:23.444909+0000","last_undegraded":"2023-09-23T08:55:23.444909+0000","last_fullsized":"2023-09-23T08:55:23.444909+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T14:07:59.974769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.431102+0000","last_change":"2023-09-23T08:54:53.106050+0000","last_active":"2023-09-23T08:55:23.431102+0000","last_peered":"2023-09-23T08:55:23.431102+0000","last_clean":"2023-09-23T08:55:23.431102+0000","last_became_active":"2023-09-23T08:54:53.105729+0000","last_became_peered":"2023-09-23T08:54:53.105729+0000","last_unstale":"2023-09-23T08:55:23.431102+0000","last_undegraded":"2023-09-23T08:55:23.431102+0000","last_fullsized":"2023-09-23T08:55:23.431102+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:59:01.529109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"86'7","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.438306+0000","last_change":"2023-09-23T08:54:52.086019+0000","last_active":"2023-09-23T08:55:23.438306+0000","last_peered":"2023-09-23T08:55:23.438306+0000","last_clean":"2023-09-23T08:55:23.438306+0000","last_became_active":"2023-09-23T08:54:52.085688+0000","last_became_peered":"2023-09-23T08:54:52.085688+0000","last_unstale":"2023-09-23T08:55:23.438306+0000","last_undegraded":"2023-09-23T08:55:23.438306+0000","last_fullsized":"2023-09-23T08:55:23.438306+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T13:39:29.745763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.428549+0000","last_change":"2023-09-23T08:54:53.099533+0000","last_active":"2023-09-23T08:55:23.428549+0000","last_peered":"2023-09-23T08:55:23.428549+0000","last_clean":"2023-09-23T08:55:23.428549+0000","last_became_active":"2023-09-23T08:54:53.099192+0000","last_became_peered":"2023-09-23T08:54:53.099192+0000","last_unstale":"2023-09-23T08:55:23.428549+0000","last_undegraded":"2023-09-23T08:55:23.428549+0000","last_fullsized":"2023-09-23T08:55:23.428549+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:21:20.608655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"86'3","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.436637+0000","last_change":"2023-09-23T08:54:52.086258+0000","last_active":"2023-09-23T08:55:23.436637+0000","last_peered":"2023-09-23T08:55:23.436637+0000","last_clean":"2023-09-23T08:55:23.436637+0000","last_became_active":"2023-09-23T08:54:52.085935+0000","last_became_peered":"2023-09-23T08:54:52.085935+0000","last_unstale":"2023-09-23T08:55:23.436637+0000","last_undegraded":"2023-09-23T08:55:23.436637+0000","last_fullsized":"2023-09-23T08:55:23.436637+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:20:00.595412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.439129+0000","last_change":"2023-09-23T08:54:53.105176+0000","last_active":"2023-09-23T08:55:23.439129+0000","last_peered":"2023-09-23T08:55:23.439129+0000","last_clean":"2023-09-23T08:55:23.439129+0000","last_became_active":"2023-09-23T08:54:53.104794+0000","last_became_peered":"2023-09-23T08:54:53.104794+0000","last_unstale":"2023-09-23T08:55:23.439129+0000","last_undegraded":"2023-09-23T08:55:23.439129+0000","last_fullsized":"2023-09-23T08:55:23.439129+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:38:26.392477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.431709+0000","last_change":"2023-09-23T08:54:52.078596+0000","last_active":"2023-09-23T08:55:23.431709+0000","last_peered":"2023-09-23T08:55:23.431709+0000","last_clean":"2023-09-23T08:55:23.431709+0000","last_became_active":"2023-09-23T08:54:52.078310+0000","last_became_peered":"2023-09-23T08:54:52.078310+0000","last_unstale":"2023-09-23T08:55:23.431709+0000","last_undegraded":"2023-09-23T08:55:23.431709+0000","last_fullsized":"2023-09-23T08:55:23.431709+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T10:44:34.943157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.431579+0000","last_change":"2023-09-23T08:54:53.106368+0000","last_active":"2023-09-23T08:55:23.431579+0000","last_peered":"2023-09-23T08:55:23.431579+0000","last_clean":"2023-09-23T08:55:23.431579+0000","last_became_active":"2023-09-23T08:54:53.105977+0000","last_became_peered":"2023-09-23T08:54:53.105977+0000","last_unstale":"2023-09-23T08:55:23.431579+0000","last_undegraded":"2023-09-23T08:55:23.431579+0000","last_fullsized":"2023-09-23T08:55:23.431579+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T14:38:50.938221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'5","reported_seq":69,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:42.586939+0000","last_change":"2023-09-23T08:54:52.089221+0000","last_active":"2023-09-23T08:55:42.586939+0000","last_peered":"2023-09-23T08:55:42.586939+0000","last_clean":"2023-09-23T08:55:42.586939+0000","last_became_active":"2023-09-23T08:54:52.088824+0000","last_became_peered":"2023-09-23T08:54:52.088824+0000","last_unstale":"2023-09-23T08:55:42.586939+0000","last_undegraded":"2023-09-23T08:55:42.586939+0000","last_fullsized":"2023-09-23T08:55:42.586939+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T11:18:12.157604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":46,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.431764+0000","last_change":"2023-09-23T08:54:53.107600+0000","last_active":"2023-09-23T08:55:23.431764+0000","last_peered":"2023-09-23T08:55:23.431764+0000","last_clean":"2023-09-23T08:55:23.431764+0000","last_became_active":"2023-09-23T08:54:53.105637+0000","last_became_peered":"2023-09-23T08:54:53.105637+0000","last_unstale":"2023-09-23T08:55:23.431764+0000","last_undegraded":"2023-09-23T08:55:23.431764+0000","last_fullsized":"2023-09-23T08:55:23.431764+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T13:51:08.460345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"86'3","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.431985+0000","last_change":"2023-09-23T08:54:52.081912+0000","last_active":"2023-09-23T08:55:23.431985+0000","last_peered":"2023-09-23T08:55:23.431985+0000","last_clean":"2023-09-23T08:55:23.431985+0000","last_became_active":"2023-09-23T08:54:52.081668+0000","last_became_peered":"2023-09-23T08:54:52.081668+0000","last_unstale":"2023-09-23T08:55:23.431985+0000","last_undegraded":"2023-09-23T08:55:23.431985+0000","last_fullsized":"2023-09-23T08:55:23.431985+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:38:42.963347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"86'1","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.431457+0000","last_change":"2023-09-23T08:54:53.106975+0000","last_active":"2023-09-23T08:55:23.431457+0000","last_peered":"2023-09-23T08:55:23.431457+0000","last_clean":"2023-09-23T08:55:23.431457+0000","last_became_active":"2023-09-23T08:54:53.106537+0000","last_became_peered":"2023-09-23T08:54:53.106537+0000","last_unstale":"2023-09-23T08:55:23.431457+0000","last_undegraded":"2023-09-23T08:55:23.431457+0000","last_fullsized":"2023-09-23T08:55:23.431457+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T11:16:12.417441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"86'5","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.539010+0000","last_change":"2023-09-23T08:55:23.539010+0000","last_active":"2023-09-23T08:55:23.539010+0000","last_peered":"2023-09-23T08:55:23.539010+0000","last_clean":"2023-09-23T08:55:23.539010+0000","last_became_active":"2023-09-23T08:55:23.534858+0000","last_became_peered":"2023-09-23T08:55:23.534858+0000","last_unstale":"2023-09-23T08:55:23.539010+0000","last_undegraded":"2023-09-23T08:55:23.539010+0000","last_fullsized":"2023-09-23T08:55:23.539010+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T12:04:40.067871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.431458+0000","last_change":"2023-09-23T08:54:53.109625+0000","last_active":"2023-09-23T08:55:23.431458+0000","last_peered":"2023-09-23T08:55:23.431458+0000","last_clean":"2023-09-23T08:55:23.431458+0000","last_became_active":"2023-09-23T08:54:53.109323+0000","last_became_peered":"2023-09-23T08:54:53.109323+0000","last_unstale":"2023-09-23T08:55:23.431458+0000","last_undegraded":"2023-09-23T08:55:23.431458+0000","last_fullsized":"2023-09-23T08:55:23.431458+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T12:38:52.169862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.438659+0000","last_change":"2023-09-23T08:55:23.438659+0000","last_active":"2023-09-23T08:55:23.438659+0000","last_peered":"2023-09-23T08:55:23.438659+0000","last_clean":"2023-09-23T08:55:23.438659+0000","last_became_active":"2023-09-23T08:55:23.438227+0000","last_became_peered":"2023-09-23T08:55:23.438227+0000","last_unstale":"2023-09-23T08:55:23.438659+0000","last_undegraded":"2023-09-23T08:55:23.438659+0000","last_fullsized":"2023-09-23T08:55:23.438659+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:03:51.636352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.436897+0000","last_change":"2023-09-23T08:54:53.101001+0000","last_active":"2023-09-23T08:55:23.436897+0000","last_peered":"2023-09-23T08:55:23.436897+0000","last_clean":"2023-09-23T08:55:23.436897+0000","last_became_active":"2023-09-23T08:54:53.100315+0000","last_became_peered":"2023-09-23T08:54:53.100315+0000","last_unstale":"2023-09-23T08:55:23.436897+0000","last_undegraded":"2023-09-23T08:55:23.436897+0000","last_fullsized":"2023-09-23T08:55:23.436897+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T20:08:51.255938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.436614+0000","last_change":"2023-09-23T08:54:53.102855+0000","last_active":"2023-09-23T08:55:23.436614+0000","last_peered":"2023-09-23T08:55:23.436614+0000","last_clean":"2023-09-23T08:55:23.436614+0000","last_became_active":"2023-09-23T08:54:53.102495+0000","last_became_peered":"2023-09-23T08:54:53.102495+0000","last_unstale":"2023-09-23T08:55:23.436614+0000","last_undegraded":"2023-09-23T08:55:23.436614+0000","last_fullsized":"2023-09-23T08:55:23.436614+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T11:30:08.512122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.431242+0000","last_change":"2023-09-23T08:54:53.102063+0000","last_active":"2023-09-23T08:55:23.431242+0000","last_peered":"2023-09-23T08:55:23.431242+0000","last_clean":"2023-09-23T08:55:23.431242+0000","last_became_active":"2023-09-23T08:54:53.101734+0000","last_became_peered":"2023-09-23T08:54:53.101734+0000","last_unstale":"2023-09-23T08:55:23.431242+0000","last_undegraded":"2023-09-23T08:55:23.431242+0000","last_fullsized":"2023-09-23T08:55:23.431242+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T18:20:09.964230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.433432+0000","last_change":"2023-09-23T08:54:53.110291+0000","last_active":"2023-09-23T08:55:23.433432+0000","last_peered":"2023-09-23T08:55:23.433432+0000","last_clean":"2023-09-23T08:55:23.433432+0000","last_became_active":"2023-09-23T08:54:53.109962+0000","last_became_peered":"2023-09-23T08:54:53.109962+0000","last_unstale":"2023-09-23T08:55:23.433432+0000","last_undegraded":"2023-09-23T08:55:23.433432+0000","last_fullsized":"2023-09-23T08:55:23.433432+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T13:59:01.304290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.428685+0000","last_change":"2023-09-23T08:54:53.104278+0000","last_active":"2023-09-23T08:55:23.428685+0000","last_peered":"2023-09-23T08:55:23.428685+0000","last_clean":"2023-09-23T08:55:23.428685+0000","last_became_active":"2023-09-23T08:54:53.103765+0000","last_became_peered":"2023-09-23T08:54:53.103765+0000","last_unstale":"2023-09-23T08:55:23.428685+0000","last_undegraded":"2023-09-23T08:55:23.428685+0000","last_fullsized":"2023-09-23T08:55:23.428685+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:27:28.306515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.437318+0000","last_change":"2023-09-23T08:54:53.104861+0000","last_active":"2023-09-23T08:55:23.437318+0000","last_peered":"2023-09-23T08:55:23.437318+0000","last_clean":"2023-09-23T08:55:23.437318+0000","last_became_active":"2023-09-23T08:54:53.104554+0000","last_became_peered":"2023-09-23T08:54:53.104554+0000","last_unstale":"2023-09-23T08:55:23.437318+0000","last_undegraded":"2023-09-23T08:55:23.437318+0000","last_fullsized":"2023-09-23T08:55:23.437318+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:22:47.174867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.437293+0000","last_change":"2023-09-23T08:54:53.106859+0000","last_active":"2023-09-23T08:55:23.437293+0000","last_peered":"2023-09-23T08:55:23.437293+0000","last_clean":"2023-09-23T08:55:23.437293+0000","last_became_active":"2023-09-23T08:54:53.106494+0000","last_became_peered":"2023-09-23T08:54:53.106494+0000","last_unstale":"2023-09-23T08:55:23.437293+0000","last_undegraded":"2023-09-23T08:55:23.437293+0000","last_fullsized":"2023-09-23T08:55:23.437293+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T18:25:26.029504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.432346+0000","last_change":"2023-09-23T08:54:53.101591+0000","last_active":"2023-09-23T08:55:23.432346+0000","last_peered":"2023-09-23T08:55:23.432346+0000","last_clean":"2023-09-23T08:55:23.432346+0000","last_became_active":"2023-09-23T08:54:53.101237+0000","last_became_peered":"2023-09-23T08:54:53.101237+0000","last_unstale":"2023-09-23T08:55:23.432346+0000","last_undegraded":"2023-09-23T08:55:23.432346+0000","last_fullsized":"2023-09-23T08:55:23.432346+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T11:22:22.863330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.438190+0000","last_change":"2023-09-23T08:54:53.103373+0000","last_active":"2023-09-23T08:55:23.438190+0000","last_peered":"2023-09-23T08:55:23.438190+0000","last_clean":"2023-09-23T08:55:23.438190+0000","last_became_active":"2023-09-23T08:54:53.102948+0000","last_became_peered":"2023-09-23T08:54:53.102948+0000","last_unstale":"2023-09-23T08:55:23.438190+0000","last_undegraded":"2023-09-23T08:55:23.438190+0000","last_fullsized":"2023-09-23T08:55:23.438190+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:39:31.898539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.432183+0000","last_change":"2023-09-23T08:54:53.100488+0000","last_active":"2023-09-23T08:55:23.432183+0000","last_peered":"2023-09-23T08:55:23.432183+0000","last_clean":"2023-09-23T08:55:23.432183+0000","last_became_active":"2023-09-23T08:54:53.100182+0000","last_became_peered":"2023-09-23T08:54:53.100182+0000","last_unstale":"2023-09-23T08:55:23.432183+0000","last_undegraded":"2023-09-23T08:55:23.432183+0000","last_fullsized":"2023-09-23T08:55:23.432183+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:13:20.648791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.431996+0000","last_change":"2023-09-23T08:54:53.097571+0000","last_active":"2023-09-23T08:55:23.431996+0000","last_peered":"2023-09-23T08:55:23.431996+0000","last_clean":"2023-09-23T08:55:23.431996+0000","last_became_active":"2023-09-23T08:54:53.097278+0000","last_became_peered":"2023-09-23T08:54:53.097278+0000","last_unstale":"2023-09-23T08:55:23.431996+0000","last_undegraded":"2023-09-23T08:55:23.431996+0000","last_fullsized":"2023-09-23T08:55:23.431996+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T11:32:37.554404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.428542+0000","last_change":"2023-09-23T08:54:53.113543+0000","last_active":"2023-09-23T08:55:23.428542+0000","last_peered":"2023-09-23T08:55:23.428542+0000","last_clean":"2023-09-23T08:55:23.428542+0000","last_became_active":"2023-09-23T08:54:53.113287+0000","last_became_peered":"2023-09-23T08:54:53.113287+0000","last_unstale":"2023-09-23T08:55:23.428542+0000","last_undegraded":"2023-09-23T08:55:23.428542+0000","last_fullsized":"2023-09-23T08:55:23.428542+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:56:48.219279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":64678,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":471,"num_read_kb":304,"num_write":234,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":552960,"data_stored":194034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":204,"ondisk_log_size":204,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892351001,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":459886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:54:56 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.497},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.71899999999999997}]},{"osd":1,"last update":"Sat Sep 23 08:54:56 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.64600000000000002}]},{"osd":2,"last update":"Sat Sep 23 08:54:56 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.52600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":4,"last update":"Sat Sep 23 08:54:56 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.673,"5min":1.673,"15min":1.673},"last":0.73399999999999999}]},{"osd":5,"last update":"Sat Sep 23 08:54:56 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.61799999999999999}]},{"osd":6,"last update":"Sat Sep 23 08:54:56 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.754}]},{"osd":7,"last update":"Sat Sep 23 08:54:56 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.74,"5min":1.74,"15min":1.74},"last":0.77100000000000002}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]},{"osd":9,"last update":"Sat Sep 23 08:54:56 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.93500000000000005}]},{"osd":10,"last update":"Sat Sep 23 08:54:56 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":2.3410000000000002,"5min":2.3410000000000002,"15min":2.3410000000000002},"last":0.877},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.84799999999999998}]}]},{"osd":10,"up_from":73,"seq":313532612639,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28640,"kb_used_data":1616,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716512,"statfs":{"total":95995035648,"available":95965708288,"internally_reserved":0,"allocated":1654784,"data_stored":1108787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":1,"last update":"Sat Sep 23 08:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.55300000000000005,"15min":0.56299999999999994},"min":{"1min":0.36499999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.77900000000000003,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.61799999999999999,"15min":0.621},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.88600000000000001,"5min":1.417,"15min":1.417},"last":0.45100000000000001}]},{"osd":2,"last update":"Sat Sep 23 08:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.752,"15min":0.76300000000000001},"min":{"1min":0.52700000000000002,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.996,"5min":1.214,"15min":1.214},"last":0.628},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.754,"15min":0.76000000000000001},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.97899999999999998,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.69799999999999995}]},{"osd":3,"last update":"Sat Sep 23 08:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.80300000000000005,"15min":0.82299999999999995},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.7210000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.754,"5min":0.78700000000000003,"15min":0.79300000000000004},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.8899999999999999,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":0.61599999999999999}]},{"osd":4,"last update":"Sat Sep 23 08:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.67600000000000005,"15min":0.68700000000000006},"min":{"1min":0.45800000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.81200000000000006,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.74399999999999999,"15min":0.76800000000000002},"min":{"1min":0.42899999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.80300000000000005,"5min":1.448,"15min":1.448},"last":0.71399999999999997}]},{"osd":5,"last update":"Sat Sep 23 08:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.82399999999999995,"15min":0.82999999999999996},"min":{"1min":0.54300000000000004,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.089,"5min":1.423,"15min":1.423},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.877,"15min":0.89700000000000002},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.109,"5min":1.333,"15min":1.333},"last":0.68500000000000005}]},{"osd":6,"last update":"Sat Sep 23 08:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.88200000000000001,"15min":0.90000000000000002},"min":{"1min":0.55800000000000005,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.738,"5min":1.738,"15min":1.738},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.91100000000000003,"15min":0.92500000000000004},"min":{"1min":0.60799999999999998,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.8160000000000001,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.88800000000000001}]},{"osd":7,"last update":"Sat Sep 23 08:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.52500000000000002}]},{"osd":8,"last update":"Sat Sep 23 08:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.90900000000000003,"15min":0.92100000000000004},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.133,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.96499999999999997},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.95999999999999996,"15min":0.98899999999999999},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.073,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":0.81299999999999994}]},{"osd":9,"last update":"Sat Sep 23 08:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.97999999999999998,"15min":0.99299999999999999},"min":{"1min":0.71899999999999997,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.7729999999999999,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.996,"15min":1.022},"min":{"1min":0.65800000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.794,"5min":1.794,"15min":1.794},"last":0.76600000000000001}]},{"osd":11,"last update":"Sat Sep 23 08:55:01 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":1.002}]}]},{"osd":9,"up_from":68,"seq":292057776162,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":983040,"data_stored":459816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:55:05 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.51300000000000001,"15min":0.52100000000000002},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.69699999999999995,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.442},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.56499999999999995,"15min":0.57099999999999995},"min":{"1min":0.36299999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.41199999999999998}]},{"osd":1,"last update":"Sat Sep 23 08:55:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.77600000000000002,"15min":0.79600000000000004},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.0489999999999999,"5min":1.143,"15min":1.143},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.72499999999999998,"15min":0.746},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.94899999999999995,"5min":1.095,"15min":1.095},"last":0.76200000000000001}]},{"osd":2,"last update":"Sat Sep 23 08:55:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.77900000000000003,"15min":0.79500000000000004},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0580000000000001,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.73899999999999999,"15min":0.75600000000000001},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.90400000000000003,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.59799999999999998}]},{"osd":3,"last update":"Sat Sep 23 08:55:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.63600000000000001,"15min":0.64200000000000002},"min":{"1min":0.41899999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.84199999999999997,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.627,"5min":0.68799999999999994,"15min":0.69799999999999995},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.98099999999999998,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.48799999999999999}]},{"osd":4,"last update":"Sat Sep 23 08:55:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.81000000000000005,"15min":0.82599999999999996},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.034,"5min":1.036,"15min":1.036},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.83999999999999997,"15min":0.85399999999999998},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0089999999999999,"5min":1.107,"15min":1.107},"last":0.77600000000000002}]},{"osd":5,"last update":"Sat Sep 23 08:55:05 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.80900000000000005,"15min":0.82199999999999995},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.86799999999999999,"15min":0.88400000000000001},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.1599999999999999,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.56299999999999994}]},{"osd":6,"last update":"Sat Sep 23 08:55:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.71299999999999997,"15min":0.72099999999999997},"min":{"1min":0.45800000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.94799999999999995,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.81200000000000006,"15min":0.81799999999999995},"min":{"1min":0.57099999999999995,"5min":0.44,"15min":0.44},"max":{"1min":1.123,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.50800000000000001}]},{"osd":7,"last update":"Sat Sep 23 08:55:05 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":1.159,"15min":1.2110000000000001},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.1040000000000001,"5min":7.0759999999999996,"15min":7.0759999999999996},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.87,"15min":0.88400000000000001},"min":{"1min":0.64200000000000002,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.01,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.71199999999999997}]},{"osd":8,"last update":"Sat Sep 23 08:55:05 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.872,"15min":0.89000000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.083,"5min":1.226,"15min":1.226},"last":0.628},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.91400000000000003,"15min":0.92800000000000005},"min":{"1min":0.70399999999999996,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.248,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.72699999999999998}]},{"osd":10,"last update":"Sat Sep 23 08:55:32 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.94699999999999995,"15min":0.94299999999999995},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":3.4630000000000001,"5min":3.4630000000000001,"15min":3.4630000000000001},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.90500000000000003,"15min":0.91900000000000004},"min":{"1min":0.66000000000000003,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.2250000000000001,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.78900000000000003}]}]},{"osd":8,"up_from":60,"seq":257698037799,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":970752,"data_stored":459522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:54:41 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.67700000000000005,"15min":0.68500000000000005},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.85999999999999999,"5min":1.004,"15min":1.004},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.68500000000000005,"15min":0.69299999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.85799999999999998,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.81299999999999994}]},{"osd":1,"last update":"Sat Sep 23 08:54:41 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.79400000000000004,"15min":0.80400000000000005},"min":{"1min":0.46999999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0509999999999999,"5min":1.115,"15min":1.115},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.73499999999999999,"15min":0.73899999999999999},"min":{"1min":0.52000000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.94199999999999995,"5min":0.998,"15min":0.998},"last":0.89500000000000002}]},{"osd":2,"last update":"Sat Sep 23 08:54:41 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.59199999999999997,"15min":0.59999999999999998},"min":{"1min":0.373,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58599999999999997,"15min":0.58399999999999996},"min":{"1min":0.39600000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.67500000000000004}]},{"osd":3,"last update":"Sat Sep 23 08:54:41 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.76600000000000001,"15min":0.78800000000000003},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.78700000000000003,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.82399999999999995,"15min":0.83199999999999996},"min":{"1min":0.58099999999999996,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.95199999999999996,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.91800000000000004}]},{"osd":4,"last update":"Sat Sep 23 08:54:41 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.78800000000000003,"15min":0.80000000000000004},"min":{"1min":0.48599999999999999,"5min":0.439,"15min":0.439},"max":{"1min":0.90400000000000003,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.97099999999999997,"15min":1.0029999999999999},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.1060000000000001,"5min":3.7530000000000001,"15min":3.7530000000000001},"last":0.97299999999999998}]},{"osd":5,"last update":"Sat Sep 23 08:54:41 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.69999999999999996,"15min":0.71099999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.79100000000000004,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.95599999999999996},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.75800000000000001,"15min":0.77300000000000002},"min":{"1min":0.434,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.872,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":1.0409999999999999}]},{"osd":6,"last update":"Sat Sep 23 08:54:41 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.89600000000000002,"15min":0.90700000000000003},"min":{"1min":0.53500000000000003,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0129999999999999,"5min":1.23,"15min":1.23},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.86099999999999999,"15min":0.875},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.91200000000000003,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":1.01}]},{"osd":7,"last update":"Sat Sep 23 08:54:41 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.871,"15min":0.879},"min":{"1min":0.63800000000000001,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":0.98199999999999998,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":1.0609999999999999},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.91300000000000003,"15min":0.92800000000000005},"min":{"1min":0.70099999999999996,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.98999999999999999,"5min":1.679,"15min":1.679},"last":1.111}]},{"osd":9,"last update":"Sat Sep 23 08:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.83799999999999997,"15min":0.83399999999999996},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.085,"5min":1.111,"15min":1.111},"last":1.129},{"interface":"front","average":{"1min":0.877,"5min":0.879,"15min":0.879},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.2130000000000001,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.99399999999999999}]},{"osd":10,"last update":"Sat Sep 23 08:55:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":0.86499999999999999,"15min":0.83999999999999997},"min":{"1min":0.73999999999999999,"5min":0.629,"15min":0.629},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":1.1830000000000001},{"interface":"front","average":{"1min":1.0469999999999999,"5min":0.91000000000000003,"15min":0.88700000000000001},"min":{"1min":0.66800000000000004,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":1.093}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1699999999999999}]}]},{"osd":7,"up_from":52,"seq":223338299438,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28552,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716600,"statfs":{"total":95995035648,"available":95965798400,"internally_reserved":0,"allocated":1568768,"data_stored":1052503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:54:15 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.627,"15min":0.621},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.59799999999999998,"15min":0.58599999999999997},"min":{"1min":0.48399999999999999,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.53800000000000003}]},{"osd":1,"last update":"Sat Sep 23 08:55:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.51900000000000002,"15min":0.51300000000000001},"min":{"1min":0.40600000000000003,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.53400000000000003,"15min":0.53500000000000003},"min":{"1min":0.38200000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.73199999999999998,"5min":0.999,"15min":0.999},"last":0.63600000000000001}]},{"osd":2,"last update":"Sat Sep 23 08:55:15 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.745,"15min":0.747},"min":{"1min":0.58499999999999996,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.95599999999999996,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.54200000000000004,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.68700000000000006}]},{"osd":3,"last update":"Sat Sep 23 08:55:15 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.66900000000000004,"15min":0.66300000000000003},"min":{"1min":0.46600000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.879,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.71899999999999997,"15min":0.72799999999999998},"min":{"1min":0.498,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.88400000000000001,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.76500000000000001}]},{"osd":4,"last update":"Sat Sep 23 08:55:15 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.69299999999999995,"15min":0.70899999999999996},"min":{"1min":0.49399999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.95899999999999996,"5min":1.04,"15min":1.04},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.67700000000000005,"15min":0.69499999999999995},"min":{"1min":0.39300000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.93600000000000005,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.49199999999999999}]},{"osd":5,"last update":"Sat Sep 23 08:55:15 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.80400000000000005,"15min":0.80800000000000005},"min":{"1min":0.66500000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.875},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.79500000000000004,"15min":0.80800000000000005},"min":{"1min":0.59499999999999997,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0549999999999999,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.78600000000000003}]},{"osd":6,"last update":"Sat Sep 23 08:55:15 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.82099999999999995,"15min":0.82899999999999996},"min":{"1min":0.67900000000000005,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.012,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.81399999999999995,"15min":0.82599999999999996},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.97899999999999998,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.82599999999999996}]},{"osd":8,"last update":"Sat Sep 23 08:55:39 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.84199999999999997,"15min":0.81999999999999995},"min":{"1min":0.65800000000000003,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.97599999999999998},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.84199999999999997,"15min":0.83799999999999997},"min":{"1min":0.64900000000000002,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.0580000000000001,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.91400000000000003}]},{"osd":9,"last update":"Sat Sep 23 08:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.85599999999999998,"15min":0.85399999999999998},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.107,"5min":1.115,"15min":1.115},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.92800000000000005}]},{"osd":10,"last update":"Sat Sep 23 08:55:36 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.874,"15min":0.88},"min":{"1min":0.60699999999999998,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.01,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.89800000000000002,"15min":0.90600000000000003},"min":{"1min":0.67700000000000005,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":0.98799999999999999,"5min":1.117,"15min":1.117},"last":0.998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]}]},{"osd":6,"up_from":47,"seq":201863462964,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":966656,"data_stored":459539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:54:46 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.44700000000000001,"15min":0.433},"min":{"1min":0.33400000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.441},{"interface":"front","average":{"1min":0.501,"5min":0.48099999999999998,"15min":0.46700000000000003},"min":{"1min":0.34100000000000003,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.69899999999999995,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.36799999999999999}]},{"osd":1,"last update":"Sat Sep 23 08:54:46 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.66100000000000003,"15min":0.628},"min":{"1min":0.46000000000000002,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.97899999999999998,"5min":1.071,"15min":1.071},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.752,"5min":0.69099999999999995,"15min":0.66300000000000003},"min":{"1min":0.56899999999999995,"5min":0.498,"15min":0.498},"max":{"1min":1.024,"5min":1.026,"15min":1.026},"last":0.68100000000000005}]},{"osd":2,"last update":"Sat Sep 23 08:54:46 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.67600000000000005,"15min":0.66200000000000003},"min":{"1min":0.49099999999999999,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.93799999999999994,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71399999999999997,"15min":0.69299999999999995},"min":{"1min":0.5,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.98599999999999999,"5min":1.143,"15min":1.143},"last":0.66100000000000003}]},{"osd":3,"last update":"Sat Sep 23 08:54:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.59599999999999997,"15min":0.58199999999999996},"min":{"1min":0.378,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.61199999999999999,"15min":0.59999999999999998},"min":{"1min":0.41099999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.83199999999999996,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.64000000000000001}]},{"osd":4,"last update":"Sat Sep 23 08:54:46 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.71999999999999997,"15min":0.71799999999999997},"min":{"1min":0.48699999999999999,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.999,"5min":1.151,"15min":1.151},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.75700000000000001,"15min":0.73299999999999998},"min":{"1min":0.57099999999999995,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0489999999999999,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.88700000000000001}]},{"osd":5,"last update":"Sat Sep 23 08:54:46 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.749,"15min":0.72499999999999998},"min":{"1min":0.50800000000000001,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.038,"5min":1.099,"15min":1.099},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.76400000000000001,"15min":0.76000000000000001},"min":{"1min":0.53900000000000003,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.99199999999999999,"5min":1.165,"15min":1.165},"last":0.59699999999999998}]},{"osd":7,"last update":"Sat Sep 23 08:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.79100000000000004,"15min":0.753},"min":{"1min":0.59999999999999998,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.1220000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.81899999999999995,"15min":0.79000000000000004},"min":{"1min":0.55700000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.111,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.95299999999999996}]},{"osd":8,"last update":"Sat Sep 23 08:54:44 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.89100000000000001,"15min":0.89900000000000002},"min":{"1min":0.60099999999999998,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.105,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":1.0600000000000001},{"interface":"front","average":{"1min":0.87,"5min":0.88200000000000001,"15min":0.88400000000000001},"min":{"1min":0.51800000000000002,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.145,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.58799999999999997}]},{"osd":9,"last update":"Sat Sep 23 08:55:08 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.89600000000000002,"15min":0.91600000000000004},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.997,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.90600000000000003,"15min":0.92400000000000004},"min":{"1min":0.65300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.0149999999999999,"5min":1.294,"15min":1.294},"last":0.55000000000000004}]},{"osd":10,"last update":"Sat Sep 23 08:55:31 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.96199999999999997,"15min":0.96499999999999997},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.669,"5min":1.669,"15min":1.669},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.877,"5min":0.95699999999999996,"15min":0.96999999999999997},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.444,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.98599999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574924,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1028096,"data_stored":518321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:54:43 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.57899999999999996,"15min":0.55500000000000005},"min":{"1min":0.41999999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.60599999999999998,"15min":0.58699999999999997},"min":{"1min":0.39700000000000002,"5min":0.314,"15min":0.314},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.64600000000000002}]},{"osd":2,"last update":"Sat Sep 23 08:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.71799999999999997,"15min":0.70299999999999996},"min":{"1min":0.5,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.008,"5min":1.026,"15min":1.026},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.71399999999999997,"15min":0.69399999999999995},"min":{"1min":0.51900000000000002,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.88900000000000001}]},{"osd":3,"last update":"Sat Sep 23 08:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67600000000000005,"15min":0.65300000000000002},"min":{"1min":0.46200000000000002,"5min":0.436,"15min":0.436},"max":{"1min":0.98099999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66400000000000003,"15min":0.64200000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.88200000000000001,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.71699999999999997}]},{"osd":4,"last update":"Sat Sep 23 08:54:54 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.51000000000000001,"15min":0.48199999999999998},"min":{"1min":0.38600000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.92100000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.54500000000000004,"15min":0.51500000000000001},"min":{"1min":0.35599999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.79900000000000004}]},{"osd":5,"last update":"Sat Sep 23 08:55:32 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.76500000000000001,"15min":0.73599999999999999},"min":{"1min":0.59399999999999997,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.73499999999999999,"15min":0.70999999999999996},"min":{"1min":0.57699999999999996,"5min":0.505,"15min":0.505},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":1.024}]},{"osd":6,"last update":"Sat Sep 23 08:54:45 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71999999999999997,"15min":0.72399999999999998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.69699999999999995,"15min":0.69199999999999995},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":1.054}]},{"osd":7,"last update":"Sat Sep 23 08:55:19 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.68799999999999994,"15min":0.69099999999999995},"min":{"1min":0.46500000000000002,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":1.1339999999999999},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.78000000000000003,"15min":0.77400000000000002},"min":{"1min":0.66000000000000003,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.91000000000000003}]},{"osd":8,"last update":"Sat Sep 23 08:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.79300000000000004,"15min":0.755},"min":{"1min":0.64500000000000002,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.2110000000000001,"5min":2.8010000000000002,"15min":2.8010000000000002},"last":1.2110000000000001},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.79800000000000004,"15min":0.77200000000000002},"min":{"1min":0.70099999999999996,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.117,"5min":1.165,"15min":1.165},"last":1.107}]},{"osd":9,"last update":"Sat Sep 23 08:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.83799999999999997,"15min":0.83299999999999996},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":1.232},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.86299999999999999,"15min":0.85299999999999998},"min":{"1min":0.72399999999999998,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":1.0049999999999999}]},{"osd":10,"last update":"Sat Sep 23 08:55:32 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.82999999999999996,"15min":0.82399999999999995},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.042,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":1.2589999999999999},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.86499999999999999,"15min":0.85899999999999999},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":1.177}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3}]}]},{"osd":0,"up_from":8,"seq":34359738450,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":983040,"data_stored":460599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 23 08:54:42 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61399999999999999,"15min":0.58999999999999997},"min":{"1min":0.41099999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.80800000000000005,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72399999999999998,"15min":0.64300000000000002},"min":{"1min":0.47999999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.95899999999999996,"5min":5.7450000000000001,"15min":5.7450000000000001},"last":0.64000000000000001}]},{"osd":2,"last update":"Sat Sep 23 08:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63800000000000001,"15min":0.64100000000000001},"min":{"1min":0.39800000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.874,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.63400000000000001,"15min":0.63600000000000001},"min":{"1min":0.45300000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.56399999999999995}]},{"osd":3,"last update":"Sat Sep 23 08:53:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.47199999999999998,"15min":0.45600000000000002},"min":{"1min":0.377,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.54700000000000004,"15min":0.52500000000000002},"min":{"1min":0.40500000000000003,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.51300000000000001}]},{"osd":4,"last update":"Sat Sep 23 08:54:55 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.69399999999999995,"15min":0.64000000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.98899999999999999,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.72099999999999997,"15min":0.66400000000000003},"min":{"1min":0.44800000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.88400000000000001,"5min":5.6710000000000003,"15min":5.6710000000000003},"last":0.621}]},{"osd":5,"last update":"Sat Sep 23 08:55:30 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69699999999999995,"15min":0.68899999999999995},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.86299999999999999,"5min":0.996,"15min":0.996},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.755,"5min":0.71799999999999997,"15min":0.70099999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.091,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.73999999999999999}]},{"osd":6,"last update":"Sat Sep 23 08:54:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.69399999999999995,"15min":0.69499999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.73599999999999999,"15min":0.73499999999999999},"min":{"1min":0.47999999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.93899999999999995,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.80800000000000005}]},{"osd":7,"last update":"Sat Sep 23 08:54:14 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.77300000000000002,"15min":0.77900000000000003},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.0489999999999999,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.875,"5min":0.84599999999999997,"15min":0.84099999999999997},"min":{"1min":0.63500000000000001,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.81799999999999995}]},{"osd":8,"last update":"Sat Sep 23 08:54:36 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.83799999999999997,"15min":0.85099999999999998},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":0.98499999999999999,"5min":1.147,"15min":1.147},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.80500000000000005,"15min":0.81799999999999995},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.0840000000000001,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.60399999999999998}]},{"osd":9,"last update":"Sat Sep 23 08:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.85099999999999998,"15min":0.875},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.1639999999999999,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.85699999999999998,"15min":0.88800000000000001},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0129999999999999,"5min":1.177,"15min":1.177},"last":0.747}]},{"osd":10,"last update":"Sat Sep 23 08:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.80900000000000005,"15min":0.80600000000000005},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.6200000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.876,"5min":0.92700000000000005,"15min":0.93500000000000005},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.1659999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.79600000000000004}]},{"osd":11,"last update":"Sat Sep 23 08:54:59 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.879,"5min":0.879,"15min":0.879},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.82199999999999995}]}]},{"osd":2,"up_from":18,"seq":77309411399,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1044480,"data_stored":518532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.61299999999999999,"15min":0.61399999999999999},"min":{"1min":0.37,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.68999999999999995,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.60999999999999999,"15min":0.62},"min":{"1min":0.40600000000000003,"5min":0.378,"15min":0.378},"max":{"1min":0.77500000000000002,"5min":1.196,"15min":1.196},"last":0.39000000000000001}]},{"osd":1,"last update":"Sat Sep 23 08:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.67000000000000004,"15min":0.67500000000000004},"min":{"1min":0.49299999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.98399999999999999,"5min":1.177,"15min":1.177},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.69899999999999995,"15min":0.67700000000000005},"min":{"1min":0.46800000000000003,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.026,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.58099999999999996}]},{"osd":3,"last update":"Sat Sep 23 08:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.72699999999999998,"15min":0.72099999999999997},"min":{"1min":0.54500000000000004,"5min":0.438,"15min":0.438},"max":{"1min":0.90200000000000002,"5min":1.083,"15min":1.083},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.69999999999999996,"15min":0.68700000000000006},"min":{"1min":0.56499999999999995,"5min":0.38,"15min":0.38},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.53500000000000003}]},{"osd":4,"last update":"Sat Sep 23 08:53:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.64100000000000001,"15min":0.63300000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.91100000000000003,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.66000000000000003,"15min":0.64500000000000002},"min":{"1min":0.55600000000000005,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.74399999999999999}]},{"osd":5,"last update":"Sat Sep 23 08:55:27 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.60499999999999998,"15min":0.56100000000000005},"min":{"1min":0.44500000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.012,"5min":1.04,"15min":1.04},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.56799999999999995,"15min":0.53600000000000003},"min":{"1min":0.41899999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.876,"5min":1.085,"15min":1.085},"last":0.91400000000000003}]},{"osd":6,"last update":"Sat Sep 23 08:54:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.752,"15min":0.73199999999999998},"min":{"1min":0.57099999999999995,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.96899999999999997,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.70699999999999996,"15min":0.69299999999999995},"min":{"1min":0.46899999999999997,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.95899999999999996,"5min":1.115,"15min":1.115},"last":0.59999999999999998}]},{"osd":7,"last update":"Sat Sep 23 08:54:12 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.75,"15min":0.75},"min":{"1min":0.61399999999999999,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.93999999999999995,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.81699999999999995,"15min":0.81999999999999995},"min":{"1min":0.56299999999999994,"5min":0.501,"15min":0.501},"max":{"1min":1.006,"5min":1.129,"15min":1.129},"last":0.82199999999999995}]},{"osd":8,"last update":"Sat Sep 23 08:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.753,"15min":0.74199999999999999},"min":{"1min":0.61299999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.752,"5min":0.73099999999999998,"15min":0.72899999999999998},"min":{"1min":0.60499999999999998,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.79600000000000004}]},{"osd":9,"last update":"Sat Sep 23 08:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.82699999999999996,"15min":0.82899999999999996},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.044,"5min":1.163,"15min":1.163},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.87,"15min":0.871},"min":{"1min":0.64100000000000001,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.0109999999999999,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.76600000000000001}]},{"osd":10,"last update":"Sat Sep 23 08:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.86899999999999999,"15min":0.86199999999999999},"min":{"1min":0.69199999999999995,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.90700000000000003,"15min":0.89900000000000002},"min":{"1min":0.64900000000000002,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.83799999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]}]},{"osd":3,"up_from":26,"seq":111669149762,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":974848,"data_stored":458766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.46800000000000003,"15min":0.40600000000000003},"min":{"1min":0.314,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":2.294,"5min":2.294,"15min":2.294},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.48499999999999999,"15min":0.42799999999999999},"min":{"1min":0.35299999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":0.377}]},{"osd":1,"last update":"Sat Sep 23 08:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.71699999999999997,"15min":0.629},"min":{"1min":0.53500000000000003,"5min":0.434,"15min":0.434},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.69399999999999995,"15min":0.63700000000000001},"min":{"1min":0.502,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.504}]},{"osd":2,"last update":"Sat Sep 23 08:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.69899999999999995,"15min":0.65400000000000003},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.72399999999999998,"15min":0.66800000000000004},"min":{"1min":0.496,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.63500000000000001}]},{"osd":4,"last update":"Sat Sep 23 08:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.69099999999999995,"15min":0.65800000000000003},"min":{"1min":0.46400000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.69399999999999995,"15min":0.65500000000000003},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.91900000000000004,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.60499999999999998}]},{"osd":5,"last update":"Sat Sep 23 08:55:27 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.79100000000000004,"15min":0.77300000000000002},"min":{"1min":0.60299999999999998,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78500000000000003,"15min":0.76900000000000002},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.97099999999999997,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.52200000000000002}]},{"osd":6,"last update":"Sat Sep 23 08:54:50 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.63500000000000001,"15min":0.64500000000000002},"min":{"1min":0.45900000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.746,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68600000000000005,"15min":0.66600000000000004},"min":{"1min":0.435,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.03,"5min":1.054,"15min":1.054},"last":0.755}]},{"osd":7,"last update":"Sat Sep 23 08:55:15 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.81200000000000006,"15min":0.81499999999999995},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.82399999999999995,"15min":0.83599999999999997},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.79700000000000004}]},{"osd":8,"last update":"Sat Sep 23 08:54:43 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.89200000000000002,"15min":0.90300000000000002},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.0660000000000001,"5min":1.093,"15min":1.093},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.86699999999999999,"15min":0.87},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.66000000000000003}]},{"osd":9,"last update":"Sat Sep 23 08:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.81100000000000005,"15min":0.82299999999999995},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.0489999999999999,"5min":1.28,"15min":1.28},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.90700000000000003,"15min":0.92900000000000005},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":0.99199999999999999,"5min":1.101,"15min":1.101},"last":0.78700000000000003}]},{"osd":10,"last update":"Sat Sep 23 08:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.88700000000000001,"15min":0.88100000000000001},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.91100000000000003,"15min":0.91000000000000003},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.84599999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82699999999999996}]}]},{"osd":4,"up_from":34,"seq":146028888126,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":966656,"data_stored":459784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:53:55 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.628,"15min":0.624},"min":{"1min":0.45300000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.86199999999999999,"5min":1.042,"15min":1.042},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.622,"5min":0.60699999999999998,"15min":0.60899999999999999},"min":{"1min":0.434,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.93300000000000005,"5min":1.008,"15min":1.008},"last":0.38300000000000001}]},{"osd":1,"last update":"Sat Sep 23 08:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.44600000000000001,"15min":0.442},"min":{"1min":0.36099999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.48099999999999998,"15min":0.47099999999999997},"min":{"1min":0.375,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.52500000000000002}]},{"osd":2,"last update":"Sat Sep 23 08:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.69799999999999995,"15min":0.66800000000000004},"min":{"1min":0.46000000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.623},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.65800000000000003,"15min":0.65300000000000002},"min":{"1min":0.47699999999999998,"5min":0.38,"15min":0.38},"max":{"1min":0.94999999999999996,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.55500000000000005}]},{"osd":3,"last update":"Sat Sep 23 08:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64700000000000002,"15min":0.63700000000000001},"min":{"1min":0.45700000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.89600000000000002,"5min":1.014,"15min":1.014},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.72499999999999998,"15min":0.70899999999999996},"min":{"1min":0.53300000000000003,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.99099999999999999,"5min":1.238,"15min":1.238},"last":0.81499999999999995}]},{"osd":5,"last update":"Sat Sep 23 08:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.69199999999999995,"15min":0.63800000000000001},"min":{"1min":0.60399999999999998,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.72999999999999998,"15min":0.66700000000000004},"min":{"1min":0.502,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.69799999999999995}]},{"osd":6,"last update":"Sat Sep 23 08:54:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":0.80100000000000005,"15min":0.72799999999999998},"min":{"1min":0.57499999999999996,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":7.1829999999999998,"5min":7.1829999999999998,"15min":7.1829999999999998},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70299999999999996,"15min":0.69499999999999995},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.68100000000000005}]},{"osd":7,"last update":"Sat Sep 23 08:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.65800000000000003,"15min":0.64400000000000002},"min":{"1min":0.49199999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.016,"5min":1.212,"15min":1.212},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.71999999999999997,"15min":0.70199999999999996},"min":{"1min":0.45700000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.048,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.747}]},{"osd":8,"last update":"Sat Sep 23 08:54:42 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.77700000000000002,"15min":0.77300000000000002},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.042,"5min":1.087,"15min":1.087},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.78700000000000003,"15min":0.77900000000000003},"min":{"1min":0.67500000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":1.0349999999999999}]},{"osd":9,"last update":"Sat Sep 23 08:55:08 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.79800000000000004,"15min":0.80600000000000005},"min":{"1min":0.47299999999999998,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.97999999999999998,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.84899999999999998,"15min":0.85199999999999998},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.98099999999999998}]},{"osd":10,"last update":"Sat Sep 23 08:55:32 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.88100000000000001,"15min":0.877},"min":{"1min":0.57199999999999995,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1279999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.874,"5min":0.93799999999999994,"15min":0.94799999999999995},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.86699999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0629999999999999}]}]},{"osd":5,"up_from":39,"seq":167503724601,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28572,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716580,"statfs":{"total":95995035648,"available":95965777920,"internally_reserved":0,"allocated":1585152,"data_stored":1052122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:55:30 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.66200000000000003,"15min":0.63100000000000001},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":3.5680000000000001,"5min":3.5680000000000001,"15min":3.5680000000000001},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.623,"5min":0.64200000000000002,"15min":0.64900000000000002},"min":{"1min":0.39300000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.502}]},{"osd":1,"last update":"Sat Sep 23 08:55:30 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.67000000000000004,"15min":0.64400000000000002},"min":{"1min":0.45300000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.93700000000000006,"5min":1.016,"15min":1.016},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.68500000000000005,"15min":0.63900000000000001},"min":{"1min":0.53800000000000003,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.92100000000000004,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.88800000000000001}]},{"osd":2,"last update":"Sat Sep 23 08:55:30 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.54200000000000004,"15min":0.52500000000000002},"min":{"1min":0.38800000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.72999999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.55100000000000005,"15min":0.52300000000000002},"min":{"1min":0.36199999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.79200000000000004,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.72499999999999998}]},{"osd":3,"last update":"Sat Sep 23 08:55:30 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.72399999999999998,"15min":0.68999999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":5.5339999999999998,"5min":5.5339999999999998,"15min":5.5339999999999998},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.68000000000000005,"15min":0.68899999999999995},"min":{"1min":0.48099999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.68999999999999995}]},{"osd":4,"last update":"Sat Sep 23 08:55:30 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.72499999999999998,"15min":0.69099999999999995},"min":{"1min":0.65500000000000003,"5min":0.44,"15min":0.44},"max":{"1min":0.96099999999999997,"5min":0.996,"15min":0.996},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.745,"5min":0.71899999999999997,"15min":0.69099999999999995},"min":{"1min":0.60399999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.95899999999999996,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.752}]},{"osd":6,"last update":"Sat Sep 23 08:54:47 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.747,"15min":0.72899999999999998},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.95699999999999996,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.753,"5min":0.752,"15min":0.73899999999999999},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.83899999999999997}]},{"osd":7,"last update":"Sat Sep 23 08:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.78300000000000003,"15min":0.75600000000000001},"min":{"1min":0.71399999999999997,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.98599999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.79800000000000004,"15min":0.78500000000000003},"min":{"1min":0.58999999999999997,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.95699999999999996,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.91300000000000003}]},{"osd":8,"last update":"Sat Sep 23 08:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.77200000000000002,"15min":0.77800000000000002},"min":{"1min":0.52900000000000003,"5min":0.497,"15min":0.497},"max":{"1min":0.96699999999999997,"5min":1.044,"15min":1.044},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.76300000000000001,"15min":0.77200000000000002},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.89100000000000001,"5min":1.046,"15min":1.046},"last":0.85999999999999999}]},{"osd":9,"last update":"Sat Sep 23 08:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.91000000000000003,"15min":0.92800000000000005},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.0469999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.875,"15min":0.89100000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.97699999999999998,"5min":1.95,"15min":1.95},"last":0.96199999999999997}]},{"osd":10,"last update":"Sat Sep 23 08:55:34 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.90300000000000002,"15min":0.90600000000000003},"min":{"1min":0.73499999999999999,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":0.99399999999999999,"5min":1.04,"15min":1.04},"last":1.02},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.90400000000000003,"15min":0.91300000000000003},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.01,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":1.002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":59900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":59838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":59602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-23T08:55:47.680 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- ceph pg dump --format=json 2023-09-23T08:55:47.772 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:47 smithi082 ceph-mon[97694]: pgmap v330: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2023-09-23T08:55:47.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:47 smithi135 ceph-mon[99205]: pgmap v330: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2023-09-23T08:55:47.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:47 smithi161 ceph-mon[99580]: pgmap v330: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2023-09-23T08:55:48.433 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.a/config 2023-09-23T08:55:48.794 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:48 smithi082 ceph-mon[97694]: from='client.14994 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-09-23T08:55:48.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:48 smithi135 ceph-mon[99205]: from='client.14994 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-09-23T08:55:48.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:48 smithi161 ceph-mon[99580]: from='client.14994 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-09-23T08:55:49.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:49 smithi135 ceph-mon[99205]: pgmap v331: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2023-09-23T08:55:49.825 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:49 smithi082 ceph-mon[97694]: pgmap v331: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2023-09-23T08:55:49.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:49 smithi161 ceph-mon[99580]: pgmap v331: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2023-09-23T08:55:50.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:50.057+0000 7fd8c18a9700 1 -- 172.21.15.82:0/4043961371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8bc072d50 msgr2=0x7fd8bc073130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:50.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:50.057+0000 7fd8c18a9700 1 --2- 172.21.15.82:0/4043961371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8bc072d50 0x7fd8bc073130 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac009990 tx=0x7fd8ac009ca0 comp rx=0 tx=0).stop 2023-09-23T08:55:50.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:50.057+0000 7fd8c18a9700 1 -- 172.21.15.82:0/4043961371 shutdown_connections 2023-09-23T08:55:50.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:50.057+0000 7fd8c18a9700 1 --2- 172.21.15.82:0/4043961371 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8bc10d180 0x7fd8bc10f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:50.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:50.057+0000 7fd8c18a9700 1 --2- 172.21.15.82:0/4043961371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8bc072d50 0x7fd8bc073130 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:50.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:50.057+0000 7fd8c18a9700 1 --2- 172.21.15.82:0/4043961371 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd8bc073670 0x7fd8bc10cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:50.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:50.057+0000 7fd8c18a9700 1 -- 172.21.15.82:0/4043961371 >> 172.21.15.82:0/4043961371 conn(0x7fd8bc0fc410 msgr2=0x7fd8bc0fe830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:50.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:50.058+0000 7fd8c18a9700 1 -- 172.21.15.82:0/4043961371 shutdown_connections 2023-09-23T08:55:50.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:50.058+0000 7fd8c18a9700 1 -- 172.21.15.82:0/4043961371 wait complete. 2023-09-23T08:55:50.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:50.058+0000 7fd8c18a9700 1 Processor -- start 2023-09-23T08:55:50.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:50.059+0000 7fd8c18a9700 1 -- start start 2023-09-23T08:55:50.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:50.059+0000 7fd8c18a9700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8bc072d50 0x7fd8bc19e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:50.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:50.059+0000 7fd8c18a9700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd8bc073670 0x7fd8bc19ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:50.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:50.059+0000 7fd8c18a9700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8bc10d180 0x7fd8bc1989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:50.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:50.059+0000 7fd8c18a9700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8bc199040 con 0x7fd8bc10d180 2023-09-23T08:55:50.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:50.059+0000 7fd8c18a9700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8bc1991b0 con 0x7fd8bc072d50 2023-09-23T08:55:50.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:50.059+0000 7fd8c18a9700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8bc199370 con 0x7fd8bc073670 2023-09-23T08:55:50.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:50.059+0000 7fd8bb7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8bc10d180 0x7fd8bc1989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:50.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:50.059+0000 7fd8b2ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8bc072d50 0x7fd8bc19e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:50.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:50.059+0000 7fd8bb7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8bc10d180 0x7fd8bc1989d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40534/0 (socket says 172.21.15.82:40534) 2023-09-23T08:55:50.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:50.059+0000 7fd8b2ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8bc072d50 0x7fd8bc19e950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:47238/0 (socket says 172.21.15.82:47238) 2023-09-23T08:55:50.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:50.059+0000 7fd8bb7fe700 1 -- 172.21.15.82:0/1313099139 learned_addr learned my addr 172.21.15.82:0/1313099139 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:55:50.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:50.060+0000 7fd8baffd700 1 --2- 172.21.15.82:0/1313099139 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd8bc073670 0x7fd8bc19ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:50.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:50.060+0000 7fd8bb7fe700 1 -- 172.21.15.82:0/1313099139 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd8bc073670 msgr2=0x7fd8bc19ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:50.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:50.060+0000 7fd8bb7fe700 1 --2- 172.21.15.82:0/1313099139 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd8bc073670 0x7fd8bc19ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:50.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:50.060+0000 7fd8bb7fe700 1 -- 172.21.15.82:0/1313099139 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8bc072d50 msgr2=0x7fd8bc19e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:50.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:50.060+0000 7fd8bb7fe700 1 --2- 172.21.15.82:0/1313099139 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8bc072d50 0x7fd8bc19e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:50.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:50.060+0000 7fd8bb7fe700 1 -- 172.21.15.82:0/1313099139 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8ac0095f0 con 0x7fd8bc10d180 2023-09-23T08:55:50.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:50.060+0000 7fd8baffd700 1 --2- 172.21.15.82:0/1313099139 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd8bc073670 0x7fd8bc19ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T08:55:50.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:50.060+0000 7fd8bb7fe700 1 --2- 172.21.15.82:0/1313099139 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8bc10d180 0x7fd8bc1989d0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd8b400ef30 tx=0x7fd8b400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:50.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:50.060+0000 7fd8c08a7700 1 -- 172.21.15.82:0/1313099139 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b4018070 con 0x7fd8bc10d180 2023-09-23T08:55:50.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:50.060+0000 7fd8c18a9700 1 -- 172.21.15.82:0/1313099139 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8bc1995f0 con 0x7fd8bc10d180 2023-09-23T08:55:50.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:50.060+0000 7fd8c08a7700 1 -- 172.21.15.82:0/1313099139 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd8b400f040 con 0x7fd8bc10d180 2023-09-23T08:55:50.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:50.060+0000 7fd8c08a7700 1 -- 172.21.15.82:0/1313099139 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b400cc70 con 0x7fd8bc10d180 2023-09-23T08:55:50.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:50.060+0000 7fd8c18a9700 1 -- 172.21.15.82:0/1313099139 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8bc1a5940 con 0x7fd8bc10d180 2023-09-23T08:55:50.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:50.062+0000 7fd8c18a9700 1 -- 172.21.15.82:0/1313099139 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8bc04e620 con 0x7fd8bc10d180 2023-09-23T08:55:50.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:50.064+0000 7fd8c08a7700 1 -- 172.21.15.82:0/1313099139 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) v1 ==== 134722+0+0 (secure 0 0 0) 0x7fd8b4003a00 con 0x7fd8bc10d180 2023-09-23T08:55:50.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:50.066+0000 7fd8c08a7700 1 --2- 172.21.15.82:0/1313099139 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fd8a809ffe0 0x7fd8a80a24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:50.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:50.066+0000 7fd8c08a7700 1 -- 172.21.15.82:0/1313099139 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fd8b40cb530 con 0x7fd8bc10d180 2023-09-23T08:55:50.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:50.066+0000 7fd8b2ffd700 1 --2- 172.21.15.82:0/1313099139 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fd8a809ffe0 0x7fd8a80a24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:50.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:50.067+0000 7fd8b2ffd700 1 --2- 172.21.15.82:0/1313099139 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fd8a809ffe0 0x7fd8a80a24a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac006010 tx=0x7fd8ac00b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:50.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:50.068+0000 7fd8c08a7700 1 -- 172.21.15.82:0/1313099139 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7fd8b40951a0 con 0x7fd8bc10d180 2023-09-23T08:55:50.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:50.263+0000 7fd8c18a9700 1 -- 172.21.15.82:0/1313099139 --> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd8bc112b10 con 0x7fd8a809ffe0 2023-09-23T08:55:50.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:50.273+0000 7fd8c08a7700 1 -- 172.21.15.82:0/1313099139 <== mgr.14152 v2:172.21.15.82:6800/3698954311 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+339644 (secure 0 0 0) 0x7fd8bc112b10 con 0x7fd8a809ffe0 2023-09-23T08:55:50.282 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:55:50.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:50.278+0000 7fd8c18a9700 1 -- 172.21.15.82:0/1313099139 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fd8a809ffe0 msgr2=0x7fd8a80a24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:50.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:50.278+0000 7fd8c18a9700 1 --2- 172.21.15.82:0/1313099139 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fd8a809ffe0 0x7fd8a80a24a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac006010 tx=0x7fd8ac00b260 comp rx=0 tx=0).stop 2023-09-23T08:55:50.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:50.278+0000 7fd8c18a9700 1 -- 172.21.15.82:0/1313099139 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8bc10d180 msgr2=0x7fd8bc1989d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:50.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:50.278+0000 7fd8c18a9700 1 --2- 172.21.15.82:0/1313099139 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8bc10d180 0x7fd8bc1989d0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd8b400ef30 tx=0x7fd8b400c3a0 comp rx=0 tx=0).stop 2023-09-23T08:55:50.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:50.279+0000 7fd8c18a9700 1 -- 172.21.15.82:0/1313099139 shutdown_connections 2023-09-23T08:55:50.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:50.279+0000 7fd8c18a9700 1 --2- 172.21.15.82:0/1313099139 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fd8a809ffe0 0x7fd8a80a24a0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:50.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:50.279+0000 7fd8c18a9700 1 --2- 172.21.15.82:0/1313099139 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8bc10d180 0x7fd8bc1989d0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:50.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:50.279+0000 7fd8c18a9700 1 --2- 172.21.15.82:0/1313099139 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8bc072d50 0x7fd8bc19e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:50.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:50.279+0000 7fd8c18a9700 1 --2- 172.21.15.82:0/1313099139 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd8bc073670 0x7fd8bc19ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:50.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:50.279+0000 7fd8c18a9700 1 -- 172.21.15.82:0/1313099139 >> 172.21.15.82:0/1313099139 conn(0x7fd8bc0fc410 msgr2=0x7fd8bc10f3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:50.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:50.279+0000 7fd8c18a9700 1 -- 172.21.15.82:0/1313099139 shutdown_connections 2023-09-23T08:55:50.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:50.279+0000 7fd8c18a9700 1 -- 172.21.15.82:0/1313099139 wait complete. 2023-09-23T08:55:50.286 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-09-23T08:55:50.807 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":332,"stamp":"2023-09-23T08:55:50.065431+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":655292,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":632,"num_read_kb":433,"num_write":417,"num_write_kb":3068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":1181408,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":343,"ondisk_log_size":343,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":337644,"kb_used_data":13364,"kb_used_omap":20,"kb_used_meta":324075,"kb_avail":1124604180,"statfs":{"total":1151940427776,"available":1151594680320,"internally_reserved":0,"allocated":13684736,"data_stored":7468177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21372,"internal_metadata":331852932},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":53,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002819"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.428816+0000","last_change":"2023-09-23T08:54:53.110235+0000","last_active":"2023-09-23T08:55:23.428816+0000","last_peered":"2023-09-23T08:55:23.428816+0000","last_clean":"2023-09-23T08:55:23.428816+0000","last_became_active":"2023-09-23T08:54:53.109445+0000","last_became_peered":"2023-09-23T08:54:53.109445+0000","last_unstale":"2023-09-23T08:55:23.428816+0000","last_undegraded":"2023-09-23T08:55:23.428816+0000","last_fullsized":"2023-09-23T08:55:23.428816+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T10:56:35.558203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.432042+0000","last_change":"2023-09-23T08:54:53.105948+0000","last_active":"2023-09-23T08:55:23.432042+0000","last_peered":"2023-09-23T08:55:23.432042+0000","last_clean":"2023-09-23T08:55:23.432042+0000","last_became_active":"2023-09-23T08:54:53.105627+0000","last_became_peered":"2023-09-23T08:54:53.105627+0000","last_unstale":"2023-09-23T08:55:23.432042+0000","last_undegraded":"2023-09-23T08:55:23.432042+0000","last_fullsized":"2023-09-23T08:55:23.432042+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T13:02:00.876110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.431657+0000","last_change":"2023-09-23T08:54:53.099318+0000","last_active":"2023-09-23T08:55:23.431657+0000","last_peered":"2023-09-23T08:55:23.431657+0000","last_clean":"2023-09-23T08:55:23.431657+0000","last_became_active":"2023-09-23T08:54:53.099002+0000","last_became_peered":"2023-09-23T08:54:53.099002+0000","last_unstale":"2023-09-23T08:55:23.431657+0000","last_undegraded":"2023-09-23T08:55:23.431657+0000","last_fullsized":"2023-09-23T08:55:23.431657+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T11:00:15.427942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.533888+0000","last_change":"2023-09-23T08:54:53.114757+0000","last_active":"2023-09-23T08:55:23.533888+0000","last_peered":"2023-09-23T08:55:23.533888+0000","last_clean":"2023-09-23T08:55:23.533888+0000","last_became_active":"2023-09-23T08:54:53.113979+0000","last_became_peered":"2023-09-23T08:54:53.113979+0000","last_unstale":"2023-09-23T08:55:23.533888+0000","last_undegraded":"2023-09-23T08:55:23.533888+0000","last_fullsized":"2023-09-23T08:55:23.533888+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T11:02:27.209284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.431672+0000","last_change":"2023-09-23T08:54:53.102122+0000","last_active":"2023-09-23T08:55:23.431672+0000","last_peered":"2023-09-23T08:55:23.431672+0000","last_clean":"2023-09-23T08:55:23.431672+0000","last_became_active":"2023-09-23T08:54:53.101781+0000","last_became_peered":"2023-09-23T08:54:53.101781+0000","last_unstale":"2023-09-23T08:55:23.431672+0000","last_undegraded":"2023-09-23T08:55:23.431672+0000","last_fullsized":"2023-09-23T08:55:23.431672+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T18:27:41.371961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.428186+0000","last_change":"2023-09-23T08:54:53.103617+0000","last_active":"2023-09-23T08:55:23.428186+0000","last_peered":"2023-09-23T08:55:23.428186+0000","last_clean":"2023-09-23T08:55:23.428186+0000","last_became_active":"2023-09-23T08:54:53.103259+0000","last_became_peered":"2023-09-23T08:54:53.103259+0000","last_unstale":"2023-09-23T08:55:23.428186+0000","last_undegraded":"2023-09-23T08:55:23.428186+0000","last_fullsized":"2023-09-23T08:55:23.428186+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:51:15.970275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.431792+0000","last_change":"2023-09-23T08:54:53.110512+0000","last_active":"2023-09-23T08:55:23.431792+0000","last_peered":"2023-09-23T08:55:23.431792+0000","last_clean":"2023-09-23T08:55:23.431792+0000","last_became_active":"2023-09-23T08:54:53.110166+0000","last_became_peered":"2023-09-23T08:54:53.110166+0000","last_unstale":"2023-09-23T08:55:23.431792+0000","last_undegraded":"2023-09-23T08:55:23.431792+0000","last_fullsized":"2023-09-23T08:55:23.431792+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T20:45:16.248775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.439672+0000","last_change":"2023-09-23T08:54:53.111373+0000","last_active":"2023-09-23T08:55:23.439672+0000","last_peered":"2023-09-23T08:55:23.439672+0000","last_clean":"2023-09-23T08:55:23.439672+0000","last_became_active":"2023-09-23T08:54:53.111045+0000","last_became_peered":"2023-09-23T08:54:53.111045+0000","last_unstale":"2023-09-23T08:55:23.439672+0000","last_undegraded":"2023-09-23T08:55:23.439672+0000","last_fullsized":"2023-09-23T08:55:23.439672+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:25:16.099829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.432716+0000","last_change":"2023-09-23T08:54:53.100219+0000","last_active":"2023-09-23T08:55:23.432716+0000","last_peered":"2023-09-23T08:55:23.432716+0000","last_clean":"2023-09-23T08:55:23.432716+0000","last_became_active":"2023-09-23T08:54:53.099925+0000","last_became_peered":"2023-09-23T08:54:53.099925+0000","last_unstale":"2023-09-23T08:55:23.432716+0000","last_undegraded":"2023-09-23T08:55:23.432716+0000","last_fullsized":"2023-09-23T08:55:23.432716+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T20:53:32.264331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.439006+0000","last_change":"2023-09-23T08:55:23.439006+0000","last_active":"2023-09-23T08:55:23.439006+0000","last_peered":"2023-09-23T08:55:23.439006+0000","last_clean":"2023-09-23T08:55:23.439006+0000","last_became_active":"2023-09-23T08:55:23.438533+0000","last_became_peered":"2023-09-23T08:55:23.438533+0000","last_unstale":"2023-09-23T08:55:23.439006+0000","last_undegraded":"2023-09-23T08:55:23.439006+0000","last_fullsized":"2023-09-23T08:55:23.439006+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T12:30:40.717065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.431583+0000","last_change":"2023-09-23T08:54:53.108175+0000","last_active":"2023-09-23T08:55:23.431583+0000","last_peered":"2023-09-23T08:55:23.431583+0000","last_clean":"2023-09-23T08:55:23.431583+0000","last_became_active":"2023-09-23T08:54:53.107889+0000","last_became_peered":"2023-09-23T08:54:53.107889+0000","last_unstale":"2023-09-23T08:55:23.431583+0000","last_undegraded":"2023-09-23T08:55:23.431583+0000","last_fullsized":"2023-09-23T08:55:23.431583+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T11:57:28.537929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.533759+0000","last_change":"2023-09-23T08:54:53.114564+0000","last_active":"2023-09-23T08:55:23.533759+0000","last_peered":"2023-09-23T08:55:23.533759+0000","last_clean":"2023-09-23T08:55:23.533759+0000","last_became_active":"2023-09-23T08:54:53.113937+0000","last_became_peered":"2023-09-23T08:54:53.113937+0000","last_unstale":"2023-09-23T08:55:23.533759+0000","last_undegraded":"2023-09-23T08:55:23.533759+0000","last_fullsized":"2023-09-23T08:55:23.533759+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:07:59.125776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.433104+0000","last_change":"2023-09-23T08:54:53.108544+0000","last_active":"2023-09-23T08:55:23.433104+0000","last_peered":"2023-09-23T08:55:23.433104+0000","last_clean":"2023-09-23T08:55:23.433104+0000","last_became_active":"2023-09-23T08:54:53.108226+0000","last_became_peered":"2023-09-23T08:54:53.108226+0000","last_unstale":"2023-09-23T08:55:23.433104+0000","last_undegraded":"2023-09-23T08:55:23.433104+0000","last_fullsized":"2023-09-23T08:55:23.433104+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T20:44:46.654608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.430951+0000","last_change":"2023-09-23T08:54:53.106250+0000","last_active":"2023-09-23T08:55:23.430951+0000","last_peered":"2023-09-23T08:55:23.430951+0000","last_clean":"2023-09-23T08:55:23.430951+0000","last_became_active":"2023-09-23T08:54:53.105912+0000","last_became_peered":"2023-09-23T08:54:53.105912+0000","last_unstale":"2023-09-23T08:55:23.430951+0000","last_undegraded":"2023-09-23T08:55:23.430951+0000","last_fullsized":"2023-09-23T08:55:23.430951+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T09:50:26.711654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.441265+0000","last_change":"2023-09-23T08:55:23.441265+0000","last_active":"2023-09-23T08:55:23.441265+0000","last_peered":"2023-09-23T08:55:23.441265+0000","last_clean":"2023-09-23T08:55:23.441265+0000","last_became_active":"2023-09-23T08:55:23.440800+0000","last_became_peered":"2023-09-23T08:55:23.440800+0000","last_unstale":"2023-09-23T08:55:23.441265+0000","last_undegraded":"2023-09-23T08:55:23.441265+0000","last_fullsized":"2023-09-23T08:55:23.441265+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T10:27:59.968816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.431778+0000","last_change":"2023-09-23T08:54:53.098507+0000","last_active":"2023-09-23T08:55:23.431778+0000","last_peered":"2023-09-23T08:55:23.431778+0000","last_clean":"2023-09-23T08:55:23.431778+0000","last_became_active":"2023-09-23T08:54:53.098153+0000","last_became_peered":"2023-09-23T08:54:53.098153+0000","last_unstale":"2023-09-23T08:55:23.431778+0000","last_undegraded":"2023-09-23T08:55:23.431778+0000","last_fullsized":"2023-09-23T08:55:23.431778+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T09:39:06.960825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.428944+0000","last_change":"2023-09-23T08:54:53.110427+0000","last_active":"2023-09-23T08:55:23.428944+0000","last_peered":"2023-09-23T08:55:23.428944+0000","last_clean":"2023-09-23T08:55:23.428944+0000","last_became_active":"2023-09-23T08:54:53.109868+0000","last_became_peered":"2023-09-23T08:54:53.109868+0000","last_unstale":"2023-09-23T08:55:23.428944+0000","last_undegraded":"2023-09-23T08:55:23.428944+0000","last_fullsized":"2023-09-23T08:55:23.428944+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:58:18.067768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.428188+0000","last_change":"2023-09-23T08:54:53.107613+0000","last_active":"2023-09-23T08:55:23.428188+0000","last_peered":"2023-09-23T08:55:23.428188+0000","last_clean":"2023-09-23T08:55:23.428188+0000","last_became_active":"2023-09-23T08:54:53.107230+0000","last_became_peered":"2023-09-23T08:54:53.107230+0000","last_unstale":"2023-09-23T08:55:23.428188+0000","last_undegraded":"2023-09-23T08:55:23.428188+0000","last_fullsized":"2023-09-23T08:55:23.428188+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:36:14.702321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.437172+0000","last_change":"2023-09-23T08:54:53.102530+0000","last_active":"2023-09-23T08:55:23.437172+0000","last_peered":"2023-09-23T08:55:23.437172+0000","last_clean":"2023-09-23T08:55:23.437172+0000","last_became_active":"2023-09-23T08:54:53.102004+0000","last_became_peered":"2023-09-23T08:54:53.102004+0000","last_unstale":"2023-09-23T08:55:23.437172+0000","last_undegraded":"2023-09-23T08:55:23.437172+0000","last_fullsized":"2023-09-23T08:55:23.437172+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:18:54.809976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"86'13","reported_seq":99,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:46.474002+0000","last_change":"2023-09-23T08:55:23.449398+0000","last_active":"2023-09-23T08:55:46.474002+0000","last_peered":"2023-09-23T08:55:46.474002+0000","last_clean":"2023-09-23T08:55:46.474002+0000","last_became_active":"2023-09-23T08:55:23.434193+0000","last_became_peered":"2023-09-23T08:55:23.434193+0000","last_unstale":"2023-09-23T08:55:46.474002+0000","last_undegraded":"2023-09-23T08:55:46.474002+0000","last_fullsized":"2023-09-23T08:55:46.474002+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:21:58.024636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.437670+0000","last_change":"2023-09-23T08:54:53.109844+0000","last_active":"2023-09-23T08:55:23.437670+0000","last_peered":"2023-09-23T08:55:23.437670+0000","last_clean":"2023-09-23T08:55:23.437670+0000","last_became_active":"2023-09-23T08:54:53.109456+0000","last_became_peered":"2023-09-23T08:54:53.109456+0000","last_unstale":"2023-09-23T08:55:23.437670+0000","last_undegraded":"2023-09-23T08:55:23.437670+0000","last_fullsized":"2023-09-23T08:55:23.437670+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:35:18.729698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.437928+0000","last_change":"2023-09-23T08:54:52.090023+0000","last_active":"2023-09-23T08:55:23.437928+0000","last_peered":"2023-09-23T08:55:23.437928+0000","last_clean":"2023-09-23T08:55:23.437928+0000","last_became_active":"2023-09-23T08:54:52.089587+0000","last_became_peered":"2023-09-23T08:54:52.089587+0000","last_unstale":"2023-09-23T08:55:23.437928+0000","last_undegraded":"2023-09-23T08:55:23.437928+0000","last_fullsized":"2023-09-23T08:55:23.437928+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T09:08:05.801189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.430638+0000","last_change":"2023-09-23T08:54:53.098662+0000","last_active":"2023-09-23T08:55:23.430638+0000","last_peered":"2023-09-23T08:55:23.430638+0000","last_clean":"2023-09-23T08:55:23.430638+0000","last_became_active":"2023-09-23T08:54:53.098288+0000","last_became_peered":"2023-09-23T08:54:53.098288+0000","last_unstale":"2023-09-23T08:55:23.430638+0000","last_undegraded":"2023-09-23T08:55:23.430638+0000","last_fullsized":"2023-09-23T08:55:23.430638+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:21:44.163895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"86'12","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.432199+0000","last_change":"2023-09-23T08:54:52.083109+0000","last_active":"2023-09-23T08:55:23.432199+0000","last_peered":"2023-09-23T08:55:23.432199+0000","last_clean":"2023-09-23T08:55:23.432199+0000","last_became_active":"2023-09-23T08:54:52.082479+0000","last_became_peered":"2023-09-23T08:54:52.082479+0000","last_unstale":"2023-09-23T08:55:23.432199+0000","last_undegraded":"2023-09-23T08:55:23.432199+0000","last_fullsized":"2023-09-23T08:55:23.432199+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T14:19:13.234767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.431822+0000","last_change":"2023-09-23T08:54:53.105112+0000","last_active":"2023-09-23T08:55:23.431822+0000","last_peered":"2023-09-23T08:55:23.431822+0000","last_clean":"2023-09-23T08:55:23.431822+0000","last_became_active":"2023-09-23T08:54:53.104639+0000","last_became_peered":"2023-09-23T08:54:53.104639+0000","last_unstale":"2023-09-23T08:55:23.431822+0000","last_undegraded":"2023-09-23T08:55:23.431822+0000","last_fullsized":"2023-09-23T08:55:23.431822+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T09:13:19.421762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"86'5","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.431617+0000","last_change":"2023-09-23T08:54:52.082798+0000","last_active":"2023-09-23T08:55:23.431617+0000","last_peered":"2023-09-23T08:55:23.431617+0000","last_clean":"2023-09-23T08:55:23.431617+0000","last_became_active":"2023-09-23T08:54:52.082455+0000","last_became_peered":"2023-09-23T08:54:52.082455+0000","last_unstale":"2023-09-23T08:55:23.431617+0000","last_undegraded":"2023-09-23T08:55:23.431617+0000","last_fullsized":"2023-09-23T08:55:23.431617+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T18:53:37.376211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.432462+0000","last_change":"2023-09-23T08:54:53.105012+0000","last_active":"2023-09-23T08:55:23.432462+0000","last_peered":"2023-09-23T08:55:23.432462+0000","last_clean":"2023-09-23T08:55:23.432462+0000","last_became_active":"2023-09-23T08:54:53.104670+0000","last_became_peered":"2023-09-23T08:54:53.104670+0000","last_unstale":"2023-09-23T08:55:23.432462+0000","last_undegraded":"2023-09-23T08:55:23.432462+0000","last_fullsized":"2023-09-23T08:55:23.432462+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T13:57:42.013692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"86'6","reported_seq":75,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:47.574155+0000","last_change":"2023-09-23T08:54:52.085771+0000","last_active":"2023-09-23T08:55:47.574155+0000","last_peered":"2023-09-23T08:55:47.574155+0000","last_clean":"2023-09-23T08:55:47.574155+0000","last_became_active":"2023-09-23T08:54:52.085424+0000","last_became_peered":"2023-09-23T08:54:52.085424+0000","last_unstale":"2023-09-23T08:55:47.574155+0000","last_undegraded":"2023-09-23T08:55:47.574155+0000","last_fullsized":"2023-09-23T08:55:47.574155+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T11:26:36.068148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1012,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":51,"num_read_kb":2,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.431446+0000","last_change":"2023-09-23T08:54:53.109830+0000","last_active":"2023-09-23T08:55:23.431446+0000","last_peered":"2023-09-23T08:55:23.431446+0000","last_clean":"2023-09-23T08:55:23.431446+0000","last_became_active":"2023-09-23T08:54:53.109532+0000","last_became_peered":"2023-09-23T08:54:53.109532+0000","last_unstale":"2023-09-23T08:55:23.431446+0000","last_undegraded":"2023-09-23T08:55:23.431446+0000","last_fullsized":"2023-09-23T08:55:23.431446+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:14:37.986156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"86'7","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.428457+0000","last_change":"2023-09-23T08:54:52.075998+0000","last_active":"2023-09-23T08:55:23.428457+0000","last_peered":"2023-09-23T08:55:23.428457+0000","last_clean":"2023-09-23T08:55:23.428457+0000","last_became_active":"2023-09-23T08:54:52.075701+0000","last_became_peered":"2023-09-23T08:54:52.075701+0000","last_unstale":"2023-09-23T08:55:23.428457+0000","last_undegraded":"2023-09-23T08:55:23.428457+0000","last_fullsized":"2023-09-23T08:55:23.428457+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:35:20.680135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.432114+0000","last_change":"2023-09-23T08:54:53.106654+0000","last_active":"2023-09-23T08:55:23.432114+0000","last_peered":"2023-09-23T08:55:23.432114+0000","last_clean":"2023-09-23T08:55:23.432114+0000","last_became_active":"2023-09-23T08:54:53.106348+0000","last_became_peered":"2023-09-23T08:54:53.106348+0000","last_unstale":"2023-09-23T08:55:23.432114+0000","last_undegraded":"2023-09-23T08:55:23.432114+0000","last_fullsized":"2023-09-23T08:55:23.432114+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:48:44.274107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"86'3","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.431350+0000","last_change":"2023-09-23T08:54:52.073666+0000","last_active":"2023-09-23T08:55:23.431350+0000","last_peered":"2023-09-23T08:55:23.431350+0000","last_clean":"2023-09-23T08:55:23.431350+0000","last_became_active":"2023-09-23T08:54:52.073248+0000","last_became_peered":"2023-09-23T08:54:52.073248+0000","last_unstale":"2023-09-23T08:55:23.431350+0000","last_undegraded":"2023-09-23T08:55:23.431350+0000","last_fullsized":"2023-09-23T08:55:23.431350+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T13:43:51.125737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.439563+0000","last_change":"2023-09-23T08:54:53.109621+0000","last_active":"2023-09-23T08:55:23.439563+0000","last_peered":"2023-09-23T08:55:23.439563+0000","last_clean":"2023-09-23T08:55:23.439563+0000","last_became_active":"2023-09-23T08:54:53.109304+0000","last_became_peered":"2023-09-23T08:54:53.109304+0000","last_unstale":"2023-09-23T08:55:23.439563+0000","last_undegraded":"2023-09-23T08:55:23.439563+0000","last_fullsized":"2023-09-23T08:55:23.439563+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:23:57.973639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"86'3","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.431509+0000","last_change":"2023-09-23T08:54:52.081580+0000","last_active":"2023-09-23T08:55:23.431509+0000","last_peered":"2023-09-23T08:55:23.431509+0000","last_clean":"2023-09-23T08:55:23.431509+0000","last_became_active":"2023-09-23T08:54:52.081151+0000","last_became_peered":"2023-09-23T08:54:52.081151+0000","last_unstale":"2023-09-23T08:55:23.431509+0000","last_undegraded":"2023-09-23T08:55:23.431509+0000","last_fullsized":"2023-09-23T08:55:23.431509+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T14:53:36.622852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.428124+0000","last_change":"2023-09-23T08:54:53.108334+0000","last_active":"2023-09-23T08:55:23.428124+0000","last_peered":"2023-09-23T08:55:23.428124+0000","last_clean":"2023-09-23T08:55:23.428124+0000","last_became_active":"2023-09-23T08:54:53.108038+0000","last_became_peered":"2023-09-23T08:54:53.108038+0000","last_unstale":"2023-09-23T08:55:23.428124+0000","last_undegraded":"2023-09-23T08:55:23.428124+0000","last_fullsized":"2023-09-23T08:55:23.428124+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:22:21.278138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"86'4","reported_seq":113,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:44.589438+0000","last_change":"2023-09-23T08:54:52.084025+0000","last_active":"2023-09-23T08:55:44.589438+0000","last_peered":"2023-09-23T08:55:44.589438+0000","last_clean":"2023-09-23T08:55:44.589438+0000","last_became_active":"2023-09-23T08:54:52.083625+0000","last_became_peered":"2023-09-23T08:54:52.083625+0000","last_unstale":"2023-09-23T08:55:44.589438+0000","last_undegraded":"2023-09-23T08:55:44.589438+0000","last_fullsized":"2023-09-23T08:55:44.589438+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T13:02:41.009120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":91,"num_read_kb":91,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.432082+0000","last_change":"2023-09-23T08:54:53.106602+0000","last_active":"2023-09-23T08:55:23.432082+0000","last_peered":"2023-09-23T08:55:23.432082+0000","last_clean":"2023-09-23T08:55:23.432082+0000","last_became_active":"2023-09-23T08:54:53.105501+0000","last_became_peered":"2023-09-23T08:54:53.105501+0000","last_unstale":"2023-09-23T08:55:23.432082+0000","last_undegraded":"2023-09-23T08:55:23.432082+0000","last_fullsized":"2023-09-23T08:55:23.432082+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T10:15:37.314083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"86'4","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.431239+0000","last_change":"2023-09-23T08:54:52.079197+0000","last_active":"2023-09-23T08:55:23.431239+0000","last_peered":"2023-09-23T08:55:23.431239+0000","last_clean":"2023-09-23T08:55:23.431239+0000","last_became_active":"2023-09-23T08:54:52.078748+0000","last_became_peered":"2023-09-23T08:54:52.078748+0000","last_unstale":"2023-09-23T08:55:23.431239+0000","last_undegraded":"2023-09-23T08:55:23.431239+0000","last_fullsized":"2023-09-23T08:55:23.431239+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T18:15:16.139104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.432241+0000","last_change":"2023-09-23T08:54:53.105831+0000","last_active":"2023-09-23T08:55:23.432241+0000","last_peered":"2023-09-23T08:55:23.432241+0000","last_clean":"2023-09-23T08:55:23.432241+0000","last_became_active":"2023-09-23T08:54:53.105511+0000","last_became_peered":"2023-09-23T08:54:53.105511+0000","last_unstale":"2023-09-23T08:55:23.432241+0000","last_undegraded":"2023-09-23T08:55:23.432241+0000","last_fullsized":"2023-09-23T08:55:23.432241+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T10:06:14.045381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"86'5","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.432616+0000","last_change":"2023-09-23T08:54:52.089312+0000","last_active":"2023-09-23T08:55:23.432616+0000","last_peered":"2023-09-23T08:55:23.432616+0000","last_clean":"2023-09-23T08:55:23.432616+0000","last_became_active":"2023-09-23T08:54:52.088762+0000","last_became_peered":"2023-09-23T08:54:52.088762+0000","last_unstale":"2023-09-23T08:55:23.432616+0000","last_undegraded":"2023-09-23T08:55:23.432616+0000","last_fullsized":"2023-09-23T08:55:23.432616+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:31:59.043067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.432075+0000","last_change":"2023-09-23T08:54:53.106972+0000","last_active":"2023-09-23T08:55:23.432075+0000","last_peered":"2023-09-23T08:55:23.432075+0000","last_clean":"2023-09-23T08:55:23.432075+0000","last_became_active":"2023-09-23T08:54:53.105175+0000","last_became_peered":"2023-09-23T08:54:53.105175+0000","last_unstale":"2023-09-23T08:55:23.432075+0000","last_undegraded":"2023-09-23T08:55:23.432075+0000","last_fullsized":"2023-09-23T08:55:23.432075+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T20:07:17.130820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"86'30","reported_seq":144,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:44.585088+0000","last_change":"2023-09-23T08:54:52.077758+0000","last_active":"2023-09-23T08:55:44.585088+0000","last_peered":"2023-09-23T08:55:44.585088+0000","last_clean":"2023-09-23T08:55:44.585088+0000","last_became_active":"2023-09-23T08:54:52.077461+0000","last_became_peered":"2023-09-23T08:54:52.077461+0000","last_unstale":"2023-09-23T08:55:44.585088+0000","last_undegraded":"2023-09-23T08:55:44.585088+0000","last_fullsized":"2023-09-23T08:55:44.585088+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T13:22:15.302812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57476,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":96,"num_read_kb":103,"num_write":32,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.431838+0000","last_change":"2023-09-23T08:54:53.102967+0000","last_active":"2023-09-23T08:55:23.431838+0000","last_peered":"2023-09-23T08:55:23.431838+0000","last_clean":"2023-09-23T08:55:23.431838+0000","last_became_active":"2023-09-23T08:54:53.102608+0000","last_became_peered":"2023-09-23T08:54:53.102608+0000","last_unstale":"2023-09-23T08:55:23.431838+0000","last_undegraded":"2023-09-23T08:55:23.431838+0000","last_fullsized":"2023-09-23T08:55:23.431838+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:15:18.457676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"86'9","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.436872+0000","last_change":"2023-09-23T08:54:52.083885+0000","last_active":"2023-09-23T08:55:23.436872+0000","last_peered":"2023-09-23T08:55:23.436872+0000","last_clean":"2023-09-23T08:55:23.436872+0000","last_became_active":"2023-09-23T08:54:52.083530+0000","last_became_peered":"2023-09-23T08:54:52.083530+0000","last_unstale":"2023-09-23T08:55:23.436872+0000","last_undegraded":"2023-09-23T08:55:23.436872+0000","last_fullsized":"2023-09-23T08:55:23.436872+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:13:15.173145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.431685+0000","last_change":"2023-09-23T08:54:53.102429+0000","last_active":"2023-09-23T08:55:23.431685+0000","last_peered":"2023-09-23T08:55:23.431685+0000","last_clean":"2023-09-23T08:55:23.431685+0000","last_became_active":"2023-09-23T08:54:53.102139+0000","last_became_peered":"2023-09-23T08:54:53.102139+0000","last_unstale":"2023-09-23T08:55:23.431685+0000","last_undegraded":"2023-09-23T08:55:23.431685+0000","last_fullsized":"2023-09-23T08:55:23.431685+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T14:20:29.728805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"86'5","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.431753+0000","last_change":"2023-09-23T08:54:52.083380+0000","last_active":"2023-09-23T08:55:23.431753+0000","last_peered":"2023-09-23T08:55:23.431753+0000","last_clean":"2023-09-23T08:55:23.431753+0000","last_became_active":"2023-09-23T08:54:52.083094+0000","last_became_peered":"2023-09-23T08:54:52.083094+0000","last_unstale":"2023-09-23T08:55:23.431753+0000","last_undegraded":"2023-09-23T08:55:23.431753+0000","last_fullsized":"2023-09-23T08:55:23.431753+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:31:04.004340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.431536+0000","last_change":"2023-09-23T08:54:53.107671+0000","last_active":"2023-09-23T08:55:23.431536+0000","last_peered":"2023-09-23T08:55:23.431536+0000","last_clean":"2023-09-23T08:55:23.431536+0000","last_became_active":"2023-09-23T08:54:53.107372+0000","last_became_peered":"2023-09-23T08:54:53.107372+0000","last_unstale":"2023-09-23T08:55:23.431536+0000","last_undegraded":"2023-09-23T08:55:23.431536+0000","last_fullsized":"2023-09-23T08:55:23.431536+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T18:52:05.503710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'6","reported_seq":73,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:45.564881+0000","last_change":"2023-09-23T08:54:52.080556+0000","last_active":"2023-09-23T08:55:45.564881+0000","last_peered":"2023-09-23T08:55:45.564881+0000","last_clean":"2023-09-23T08:55:45.564881+0000","last_became_active":"2023-09-23T08:54:52.080220+0000","last_became_peered":"2023-09-23T08:54:52.080220+0000","last_unstale":"2023-09-23T08:55:45.564881+0000","last_undegraded":"2023-09-23T08:55:45.564881+0000","last_fullsized":"2023-09-23T08:55:45.564881+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:05:06.321996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":978,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":50,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.431075+0000","last_change":"2023-09-23T08:54:53.107044+0000","last_active":"2023-09-23T08:55:23.431075+0000","last_peered":"2023-09-23T08:55:23.431075+0000","last_clean":"2023-09-23T08:55:23.431075+0000","last_became_active":"2023-09-23T08:54:53.106715+0000","last_became_peered":"2023-09-23T08:54:53.106715+0000","last_unstale":"2023-09-23T08:55:23.431075+0000","last_undegraded":"2023-09-23T08:55:23.431075+0000","last_fullsized":"2023-09-23T08:55:23.431075+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T09:20:08.571706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"86'17","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.432200+0000","last_change":"2023-09-23T08:54:52.078052+0000","last_active":"2023-09-23T08:55:23.432200+0000","last_peered":"2023-09-23T08:55:23.432200+0000","last_clean":"2023-09-23T08:55:23.432200+0000","last_became_active":"2023-09-23T08:54:52.077678+0000","last_became_peered":"2023-09-23T08:54:52.077678+0000","last_unstale":"2023-09-23T08:55:23.432200+0000","last_undegraded":"2023-09-23T08:55:23.432200+0000","last_fullsized":"2023-09-23T08:55:23.432200+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T18:34:12.590233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.431509+0000","last_change":"2023-09-23T08:54:53.107673+0000","last_active":"2023-09-23T08:55:23.431509+0000","last_peered":"2023-09-23T08:55:23.431509+0000","last_clean":"2023-09-23T08:55:23.431509+0000","last_became_active":"2023-09-23T08:54:53.107373+0000","last_became_peered":"2023-09-23T08:54:53.107373+0000","last_unstale":"2023-09-23T08:55:23.431509+0000","last_undegraded":"2023-09-23T08:55:23.431509+0000","last_fullsized":"2023-09-23T08:55:23.431509+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T18:11:06.759793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"86'2","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.431541+0000","last_change":"2023-09-23T08:54:52.085460+0000","last_active":"2023-09-23T08:55:23.431541+0000","last_peered":"2023-09-23T08:55:23.431541+0000","last_clean":"2023-09-23T08:55:23.431541+0000","last_became_active":"2023-09-23T08:54:52.085186+0000","last_became_peered":"2023-09-23T08:54:52.085186+0000","last_unstale":"2023-09-23T08:55:23.431541+0000","last_undegraded":"2023-09-23T08:55:23.431541+0000","last_fullsized":"2023-09-23T08:55:23.431541+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T10:44:18.969355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.428747+0000","last_change":"2023-09-23T08:54:53.103630+0000","last_active":"2023-09-23T08:55:23.428747+0000","last_peered":"2023-09-23T08:55:23.428747+0000","last_clean":"2023-09-23T08:55:23.428747+0000","last_became_active":"2023-09-23T08:54:53.103270+0000","last_became_peered":"2023-09-23T08:54:53.103270+0000","last_unstale":"2023-09-23T08:55:23.428747+0000","last_undegraded":"2023-09-23T08:55:23.428747+0000","last_fullsized":"2023-09-23T08:55:23.428747+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T13:21:04.753974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"86'1","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.427814+0000","last_change":"2023-09-23T08:54:52.089279+0000","last_active":"2023-09-23T08:55:23.427814+0000","last_peered":"2023-09-23T08:55:23.427814+0000","last_clean":"2023-09-23T08:55:23.427814+0000","last_became_active":"2023-09-23T08:54:52.088861+0000","last_became_peered":"2023-09-23T08:54:52.088861+0000","last_unstale":"2023-09-23T08:55:23.427814+0000","last_undegraded":"2023-09-23T08:55:23.427814+0000","last_fullsized":"2023-09-23T08:55:23.427814+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T12:49:36.034399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"86'1","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.428306+0000","last_change":"2023-09-23T08:54:53.105653+0000","last_active":"2023-09-23T08:55:23.428306+0000","last_peered":"2023-09-23T08:55:23.428306+0000","last_clean":"2023-09-23T08:55:23.428306+0000","last_became_active":"2023-09-23T08:54:53.105309+0000","last_became_peered":"2023-09-23T08:54:53.105309+0000","last_unstale":"2023-09-23T08:55:23.428306+0000","last_undegraded":"2023-09-23T08:55:23.428306+0000","last_fullsized":"2023-09-23T08:55:23.428306+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T10:25:27.100946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"86'5","reported_seq":68,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:43.469099+0000","last_change":"2023-09-23T08:54:52.080521+0000","last_active":"2023-09-23T08:55:43.469099+0000","last_peered":"2023-09-23T08:55:43.469099+0000","last_clean":"2023-09-23T08:55:43.469099+0000","last_became_active":"2023-09-23T08:54:52.080164+0000","last_became_peered":"2023-09-23T08:54:52.080164+0000","last_unstale":"2023-09-23T08:55:43.469099+0000","last_undegraded":"2023-09-23T08:55:43.469099+0000","last_fullsized":"2023-09-23T08:55:43.469099+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T14:07:18.272863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":45,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.428186+0000","last_change":"2023-09-23T08:54:53.107516+0000","last_active":"2023-09-23T08:55:23.428186+0000","last_peered":"2023-09-23T08:55:23.428186+0000","last_clean":"2023-09-23T08:55:23.428186+0000","last_became_active":"2023-09-23T08:54:53.106785+0000","last_became_peered":"2023-09-23T08:54:53.106785+0000","last_unstale":"2023-09-23T08:55:23.428186+0000","last_undegraded":"2023-09-23T08:55:23.428186+0000","last_fullsized":"2023-09-23T08:55:23.428186+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T11:51:04.634599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.432574+0000","last_change":"2023-09-23T08:54:53.110406+0000","last_active":"2023-09-23T08:55:23.432574+0000","last_peered":"2023-09-23T08:55:23.432574+0000","last_clean":"2023-09-23T08:55:23.432574+0000","last_became_active":"2023-09-23T08:54:53.107758+0000","last_became_peered":"2023-09-23T08:54:53.107758+0000","last_unstale":"2023-09-23T08:55:23.432574+0000","last_undegraded":"2023-09-23T08:55:23.432574+0000","last_fullsized":"2023-09-23T08:55:23.432574+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T11:50:56.031628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'5","reported_seq":73,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:47.567068+0000","last_change":"2023-09-23T08:54:52.081384+0000","last_active":"2023-09-23T08:55:47.567068+0000","last_peered":"2023-09-23T08:55:47.567068+0000","last_clean":"2023-09-23T08:55:47.567068+0000","last_became_active":"2023-09-23T08:54:52.081082+0000","last_became_peered":"2023-09-23T08:54:52.081082+0000","last_unstale":"2023-09-23T08:55:47.567068+0000","last_undegraded":"2023-09-23T08:55:47.567068+0000","last_fullsized":"2023-09-23T08:55:47.567068+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:35:45.308145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.438813+0000","last_change":"2023-09-23T08:54:53.109011+0000","last_active":"2023-09-23T08:55:23.438813+0000","last_peered":"2023-09-23T08:55:23.438813+0000","last_clean":"2023-09-23T08:55:23.438813+0000","last_became_active":"2023-09-23T08:54:53.108520+0000","last_became_peered":"2023-09-23T08:54:53.108520+0000","last_unstale":"2023-09-23T08:55:23.438813+0000","last_undegraded":"2023-09-23T08:55:23.438813+0000","last_fullsized":"2023-09-23T08:55:23.438813+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:50:01.361084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"86'6","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.533656+0000","last_change":"2023-09-23T08:54:52.078525+0000","last_active":"2023-09-23T08:55:23.533656+0000","last_peered":"2023-09-23T08:55:23.533656+0000","last_clean":"2023-09-23T08:55:23.533656+0000","last_became_active":"2023-09-23T08:54:52.078177+0000","last_became_peered":"2023-09-23T08:54:52.078177+0000","last_unstale":"2023-09-23T08:55:23.533656+0000","last_undegraded":"2023-09-23T08:55:23.533656+0000","last_fullsized":"2023-09-23T08:55:23.533656+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:53:54.342881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":352,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.431177+0000","last_change":"2023-09-23T08:53:33.610965+0000","last_active":"2023-09-23T08:55:23.431177+0000","last_peered":"2023-09-23T08:55:23.431177+0000","last_clean":"2023-09-23T08:55:23.431177+0000","last_became_active":"2023-09-23T08:53:33.610529+0000","last_became_peered":"2023-09-23T08:53:33.610529+0000","last_unstale":"2023-09-23T08:55:23.431177+0000","last_undegraded":"2023-09-23T08:55:23.431177+0000","last_fullsized":"2023-09-23T08:55:23.431177+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:50:00.779071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:50:00.779071+0000","last_clean_scrub_stamp":"2023-09-23T08:50:00.779071+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:07:05.451303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.442747+0000","last_change":"2023-09-23T08:55:23.442747+0000","last_active":"2023-09-23T08:55:23.442747+0000","last_peered":"2023-09-23T08:55:23.442747+0000","last_clean":"2023-09-23T08:55:23.442747+0000","last_became_active":"2023-09-23T08:55:23.442328+0000","last_became_peered":"2023-09-23T08:55:23.442328+0000","last_unstale":"2023-09-23T08:55:23.442747+0000","last_undegraded":"2023-09-23T08:55:23.442747+0000","last_fullsized":"2023-09-23T08:55:23.442747+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T09:31:53.487979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"86'4","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.442345+0000","last_change":"2023-09-23T08:55:23.442345+0000","last_active":"2023-09-23T08:55:23.442345+0000","last_peered":"2023-09-23T08:55:23.442345+0000","last_clean":"2023-09-23T08:55:23.442345+0000","last_became_active":"2023-09-23T08:55:23.434799+0000","last_became_peered":"2023-09-23T08:55:23.434799+0000","last_unstale":"2023-09-23T08:55:23.442345+0000","last_undegraded":"2023-09-23T08:55:23.442345+0000","last_fullsized":"2023-09-23T08:55:23.442345+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T08:56:24.431145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"86'4","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.431996+0000","last_change":"2023-09-23T08:54:52.080482+0000","last_active":"2023-09-23T08:55:23.431996+0000","last_peered":"2023-09-23T08:55:23.431996+0000","last_clean":"2023-09-23T08:55:23.431996+0000","last_became_active":"2023-09-23T08:54:52.079756+0000","last_became_peered":"2023-09-23T08:54:52.079756+0000","last_unstale":"2023-09-23T08:55:23.431996+0000","last_undegraded":"2023-09-23T08:55:23.431996+0000","last_fullsized":"2023-09-23T08:55:23.431996+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:55:32.242149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.433310+0000","last_change":"2023-09-23T08:54:53.092828+0000","last_active":"2023-09-23T08:55:23.433310+0000","last_peered":"2023-09-23T08:55:23.433310+0000","last_clean":"2023-09-23T08:55:23.433310+0000","last_became_active":"2023-09-23T08:54:53.092486+0000","last_became_peered":"2023-09-23T08:54:53.092486+0000","last_unstale":"2023-09-23T08:55:23.433310+0000","last_undegraded":"2023-09-23T08:55:23.433310+0000","last_fullsized":"2023-09-23T08:55:23.433310+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T13:54:09.634679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"86'10","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.428062+0000","last_change":"2023-09-23T08:54:52.081801+0000","last_active":"2023-09-23T08:55:23.428062+0000","last_peered":"2023-09-23T08:55:23.428062+0000","last_clean":"2023-09-23T08:55:23.428062+0000","last_became_active":"2023-09-23T08:54:52.081449+0000","last_became_peered":"2023-09-23T08:54:52.081449+0000","last_unstale":"2023-09-23T08:55:23.428062+0000","last_undegraded":"2023-09-23T08:55:23.428062+0000","last_fullsized":"2023-09-23T08:55:23.428062+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T14:36:52.210295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.439897+0000","last_change":"2023-09-23T08:54:53.101037+0000","last_active":"2023-09-23T08:55:23.439897+0000","last_peered":"2023-09-23T08:55:23.439897+0000","last_clean":"2023-09-23T08:55:23.439897+0000","last_became_active":"2023-09-23T08:54:53.100673+0000","last_became_peered":"2023-09-23T08:54:53.100673+0000","last_unstale":"2023-09-23T08:55:23.439897+0000","last_undegraded":"2023-09-23T08:55:23.439897+0000","last_fullsized":"2023-09-23T08:55:23.439897+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:11:55.146162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"86'7","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.533765+0000","last_change":"2023-09-23T08:54:52.077785+0000","last_active":"2023-09-23T08:55:23.533765+0000","last_peered":"2023-09-23T08:55:23.533765+0000","last_clean":"2023-09-23T08:55:23.533765+0000","last_became_active":"2023-09-23T08:54:52.077306+0000","last_became_peered":"2023-09-23T08:54:52.077306+0000","last_unstale":"2023-09-23T08:55:23.533765+0000","last_undegraded":"2023-09-23T08:55:23.533765+0000","last_fullsized":"2023-09-23T08:55:23.533765+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T18:21:25.957376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.431935+0000","last_change":"2023-09-23T08:54:53.106534+0000","last_active":"2023-09-23T08:55:23.431935+0000","last_peered":"2023-09-23T08:55:23.431935+0000","last_clean":"2023-09-23T08:55:23.431935+0000","last_became_active":"2023-09-23T08:54:53.105928+0000","last_became_peered":"2023-09-23T08:54:53.105928+0000","last_unstale":"2023-09-23T08:55:23.431935+0000","last_undegraded":"2023-09-23T08:55:23.431935+0000","last_fullsized":"2023-09-23T08:55:23.431935+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:25:27.390043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.444909+0000","last_change":"2023-09-23T08:55:23.444909+0000","last_active":"2023-09-23T08:55:23.444909+0000","last_peered":"2023-09-23T08:55:23.444909+0000","last_clean":"2023-09-23T08:55:23.444909+0000","last_became_active":"2023-09-23T08:55:23.440885+0000","last_became_peered":"2023-09-23T08:55:23.440885+0000","last_unstale":"2023-09-23T08:55:23.444909+0000","last_undegraded":"2023-09-23T08:55:23.444909+0000","last_fullsized":"2023-09-23T08:55:23.444909+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T14:07:59.974769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.431102+0000","last_change":"2023-09-23T08:54:53.106050+0000","last_active":"2023-09-23T08:55:23.431102+0000","last_peered":"2023-09-23T08:55:23.431102+0000","last_clean":"2023-09-23T08:55:23.431102+0000","last_became_active":"2023-09-23T08:54:53.105729+0000","last_became_peered":"2023-09-23T08:54:53.105729+0000","last_unstale":"2023-09-23T08:55:23.431102+0000","last_undegraded":"2023-09-23T08:55:23.431102+0000","last_fullsized":"2023-09-23T08:55:23.431102+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:59:01.529109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"86'7","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.438306+0000","last_change":"2023-09-23T08:54:52.086019+0000","last_active":"2023-09-23T08:55:23.438306+0000","last_peered":"2023-09-23T08:55:23.438306+0000","last_clean":"2023-09-23T08:55:23.438306+0000","last_became_active":"2023-09-23T08:54:52.085688+0000","last_became_peered":"2023-09-23T08:54:52.085688+0000","last_unstale":"2023-09-23T08:55:23.438306+0000","last_undegraded":"2023-09-23T08:55:23.438306+0000","last_fullsized":"2023-09-23T08:55:23.438306+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T13:39:29.745763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.428549+0000","last_change":"2023-09-23T08:54:53.099533+0000","last_active":"2023-09-23T08:55:23.428549+0000","last_peered":"2023-09-23T08:55:23.428549+0000","last_clean":"2023-09-23T08:55:23.428549+0000","last_became_active":"2023-09-23T08:54:53.099192+0000","last_became_peered":"2023-09-23T08:54:53.099192+0000","last_unstale":"2023-09-23T08:55:23.428549+0000","last_undegraded":"2023-09-23T08:55:23.428549+0000","last_fullsized":"2023-09-23T08:55:23.428549+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:21:20.608655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"86'3","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.436637+0000","last_change":"2023-09-23T08:54:52.086258+0000","last_active":"2023-09-23T08:55:23.436637+0000","last_peered":"2023-09-23T08:55:23.436637+0000","last_clean":"2023-09-23T08:55:23.436637+0000","last_became_active":"2023-09-23T08:54:52.085935+0000","last_became_peered":"2023-09-23T08:54:52.085935+0000","last_unstale":"2023-09-23T08:55:23.436637+0000","last_undegraded":"2023-09-23T08:55:23.436637+0000","last_fullsized":"2023-09-23T08:55:23.436637+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:20:00.595412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.439129+0000","last_change":"2023-09-23T08:54:53.105176+0000","last_active":"2023-09-23T08:55:23.439129+0000","last_peered":"2023-09-23T08:55:23.439129+0000","last_clean":"2023-09-23T08:55:23.439129+0000","last_became_active":"2023-09-23T08:54:53.104794+0000","last_became_peered":"2023-09-23T08:54:53.104794+0000","last_unstale":"2023-09-23T08:55:23.439129+0000","last_undegraded":"2023-09-23T08:55:23.439129+0000","last_fullsized":"2023-09-23T08:55:23.439129+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:38:26.392477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.431709+0000","last_change":"2023-09-23T08:54:52.078596+0000","last_active":"2023-09-23T08:55:23.431709+0000","last_peered":"2023-09-23T08:55:23.431709+0000","last_clean":"2023-09-23T08:55:23.431709+0000","last_became_active":"2023-09-23T08:54:52.078310+0000","last_became_peered":"2023-09-23T08:54:52.078310+0000","last_unstale":"2023-09-23T08:55:23.431709+0000","last_undegraded":"2023-09-23T08:55:23.431709+0000","last_fullsized":"2023-09-23T08:55:23.431709+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T10:44:34.943157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.431579+0000","last_change":"2023-09-23T08:54:53.106368+0000","last_active":"2023-09-23T08:55:23.431579+0000","last_peered":"2023-09-23T08:55:23.431579+0000","last_clean":"2023-09-23T08:55:23.431579+0000","last_became_active":"2023-09-23T08:54:53.105977+0000","last_became_peered":"2023-09-23T08:54:53.105977+0000","last_unstale":"2023-09-23T08:55:23.431579+0000","last_undegraded":"2023-09-23T08:55:23.431579+0000","last_fullsized":"2023-09-23T08:55:23.431579+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T14:38:50.938221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'5","reported_seq":74,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:47.595318+0000","last_change":"2023-09-23T08:54:52.089221+0000","last_active":"2023-09-23T08:55:47.595318+0000","last_peered":"2023-09-23T08:55:47.595318+0000","last_clean":"2023-09-23T08:55:47.595318+0000","last_became_active":"2023-09-23T08:54:52.088824+0000","last_became_peered":"2023-09-23T08:54:52.088824+0000","last_unstale":"2023-09-23T08:55:47.595318+0000","last_undegraded":"2023-09-23T08:55:47.595318+0000","last_fullsized":"2023-09-23T08:55:47.595318+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T11:18:12.157604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":51,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.431764+0000","last_change":"2023-09-23T08:54:53.107600+0000","last_active":"2023-09-23T08:55:23.431764+0000","last_peered":"2023-09-23T08:55:23.431764+0000","last_clean":"2023-09-23T08:55:23.431764+0000","last_became_active":"2023-09-23T08:54:53.105637+0000","last_became_peered":"2023-09-23T08:54:53.105637+0000","last_unstale":"2023-09-23T08:55:23.431764+0000","last_undegraded":"2023-09-23T08:55:23.431764+0000","last_fullsized":"2023-09-23T08:55:23.431764+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T13:51:08.460345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"86'3","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.431985+0000","last_change":"2023-09-23T08:54:52.081912+0000","last_active":"2023-09-23T08:55:23.431985+0000","last_peered":"2023-09-23T08:55:23.431985+0000","last_clean":"2023-09-23T08:55:23.431985+0000","last_became_active":"2023-09-23T08:54:52.081668+0000","last_became_peered":"2023-09-23T08:54:52.081668+0000","last_unstale":"2023-09-23T08:55:23.431985+0000","last_undegraded":"2023-09-23T08:55:23.431985+0000","last_fullsized":"2023-09-23T08:55:23.431985+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:38:42.963347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"86'1","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.431457+0000","last_change":"2023-09-23T08:54:53.106975+0000","last_active":"2023-09-23T08:55:23.431457+0000","last_peered":"2023-09-23T08:55:23.431457+0000","last_clean":"2023-09-23T08:55:23.431457+0000","last_became_active":"2023-09-23T08:54:53.106537+0000","last_became_peered":"2023-09-23T08:54:53.106537+0000","last_unstale":"2023-09-23T08:55:23.431457+0000","last_undegraded":"2023-09-23T08:55:23.431457+0000","last_fullsized":"2023-09-23T08:55:23.431457+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T11:16:12.417441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"86'5","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.539010+0000","last_change":"2023-09-23T08:55:23.539010+0000","last_active":"2023-09-23T08:55:23.539010+0000","last_peered":"2023-09-23T08:55:23.539010+0000","last_clean":"2023-09-23T08:55:23.539010+0000","last_became_active":"2023-09-23T08:55:23.534858+0000","last_became_peered":"2023-09-23T08:55:23.534858+0000","last_unstale":"2023-09-23T08:55:23.539010+0000","last_undegraded":"2023-09-23T08:55:23.539010+0000","last_fullsized":"2023-09-23T08:55:23.539010+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T12:04:40.067871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.431458+0000","last_change":"2023-09-23T08:54:53.109625+0000","last_active":"2023-09-23T08:55:23.431458+0000","last_peered":"2023-09-23T08:55:23.431458+0000","last_clean":"2023-09-23T08:55:23.431458+0000","last_became_active":"2023-09-23T08:54:53.109323+0000","last_became_peered":"2023-09-23T08:54:53.109323+0000","last_unstale":"2023-09-23T08:55:23.431458+0000","last_undegraded":"2023-09-23T08:55:23.431458+0000","last_fullsized":"2023-09-23T08:55:23.431458+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T12:38:52.169862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.438659+0000","last_change":"2023-09-23T08:55:23.438659+0000","last_active":"2023-09-23T08:55:23.438659+0000","last_peered":"2023-09-23T08:55:23.438659+0000","last_clean":"2023-09-23T08:55:23.438659+0000","last_became_active":"2023-09-23T08:55:23.438227+0000","last_became_peered":"2023-09-23T08:55:23.438227+0000","last_unstale":"2023-09-23T08:55:23.438659+0000","last_undegraded":"2023-09-23T08:55:23.438659+0000","last_fullsized":"2023-09-23T08:55:23.438659+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:03:51.636352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.436897+0000","last_change":"2023-09-23T08:54:53.101001+0000","last_active":"2023-09-23T08:55:23.436897+0000","last_peered":"2023-09-23T08:55:23.436897+0000","last_clean":"2023-09-23T08:55:23.436897+0000","last_became_active":"2023-09-23T08:54:53.100315+0000","last_became_peered":"2023-09-23T08:54:53.100315+0000","last_unstale":"2023-09-23T08:55:23.436897+0000","last_undegraded":"2023-09-23T08:55:23.436897+0000","last_fullsized":"2023-09-23T08:55:23.436897+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T20:08:51.255938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.436614+0000","last_change":"2023-09-23T08:54:53.102855+0000","last_active":"2023-09-23T08:55:23.436614+0000","last_peered":"2023-09-23T08:55:23.436614+0000","last_clean":"2023-09-23T08:55:23.436614+0000","last_became_active":"2023-09-23T08:54:53.102495+0000","last_became_peered":"2023-09-23T08:54:53.102495+0000","last_unstale":"2023-09-23T08:55:23.436614+0000","last_undegraded":"2023-09-23T08:55:23.436614+0000","last_fullsized":"2023-09-23T08:55:23.436614+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T11:30:08.512122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.431242+0000","last_change":"2023-09-23T08:54:53.102063+0000","last_active":"2023-09-23T08:55:23.431242+0000","last_peered":"2023-09-23T08:55:23.431242+0000","last_clean":"2023-09-23T08:55:23.431242+0000","last_became_active":"2023-09-23T08:54:53.101734+0000","last_became_peered":"2023-09-23T08:54:53.101734+0000","last_unstale":"2023-09-23T08:55:23.431242+0000","last_undegraded":"2023-09-23T08:55:23.431242+0000","last_fullsized":"2023-09-23T08:55:23.431242+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T18:20:09.964230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.433432+0000","last_change":"2023-09-23T08:54:53.110291+0000","last_active":"2023-09-23T08:55:23.433432+0000","last_peered":"2023-09-23T08:55:23.433432+0000","last_clean":"2023-09-23T08:55:23.433432+0000","last_became_active":"2023-09-23T08:54:53.109962+0000","last_became_peered":"2023-09-23T08:54:53.109962+0000","last_unstale":"2023-09-23T08:55:23.433432+0000","last_undegraded":"2023-09-23T08:55:23.433432+0000","last_fullsized":"2023-09-23T08:55:23.433432+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T13:59:01.304290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.428685+0000","last_change":"2023-09-23T08:54:53.104278+0000","last_active":"2023-09-23T08:55:23.428685+0000","last_peered":"2023-09-23T08:55:23.428685+0000","last_clean":"2023-09-23T08:55:23.428685+0000","last_became_active":"2023-09-23T08:54:53.103765+0000","last_became_peered":"2023-09-23T08:54:53.103765+0000","last_unstale":"2023-09-23T08:55:23.428685+0000","last_undegraded":"2023-09-23T08:55:23.428685+0000","last_fullsized":"2023-09-23T08:55:23.428685+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:27:28.306515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.437318+0000","last_change":"2023-09-23T08:54:53.104861+0000","last_active":"2023-09-23T08:55:23.437318+0000","last_peered":"2023-09-23T08:55:23.437318+0000","last_clean":"2023-09-23T08:55:23.437318+0000","last_became_active":"2023-09-23T08:54:53.104554+0000","last_became_peered":"2023-09-23T08:54:53.104554+0000","last_unstale":"2023-09-23T08:55:23.437318+0000","last_undegraded":"2023-09-23T08:55:23.437318+0000","last_fullsized":"2023-09-23T08:55:23.437318+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:22:47.174867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.437293+0000","last_change":"2023-09-23T08:54:53.106859+0000","last_active":"2023-09-23T08:55:23.437293+0000","last_peered":"2023-09-23T08:55:23.437293+0000","last_clean":"2023-09-23T08:55:23.437293+0000","last_became_active":"2023-09-23T08:54:53.106494+0000","last_became_peered":"2023-09-23T08:54:53.106494+0000","last_unstale":"2023-09-23T08:55:23.437293+0000","last_undegraded":"2023-09-23T08:55:23.437293+0000","last_fullsized":"2023-09-23T08:55:23.437293+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T18:25:26.029504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.432346+0000","last_change":"2023-09-23T08:54:53.101591+0000","last_active":"2023-09-23T08:55:23.432346+0000","last_peered":"2023-09-23T08:55:23.432346+0000","last_clean":"2023-09-23T08:55:23.432346+0000","last_became_active":"2023-09-23T08:54:53.101237+0000","last_became_peered":"2023-09-23T08:54:53.101237+0000","last_unstale":"2023-09-23T08:55:23.432346+0000","last_undegraded":"2023-09-23T08:55:23.432346+0000","last_fullsized":"2023-09-23T08:55:23.432346+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T11:22:22.863330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.438190+0000","last_change":"2023-09-23T08:54:53.103373+0000","last_active":"2023-09-23T08:55:23.438190+0000","last_peered":"2023-09-23T08:55:23.438190+0000","last_clean":"2023-09-23T08:55:23.438190+0000","last_became_active":"2023-09-23T08:54:53.102948+0000","last_became_peered":"2023-09-23T08:54:53.102948+0000","last_unstale":"2023-09-23T08:55:23.438190+0000","last_undegraded":"2023-09-23T08:55:23.438190+0000","last_fullsized":"2023-09-23T08:55:23.438190+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:39:31.898539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.432183+0000","last_change":"2023-09-23T08:54:53.100488+0000","last_active":"2023-09-23T08:55:23.432183+0000","last_peered":"2023-09-23T08:55:23.432183+0000","last_clean":"2023-09-23T08:55:23.432183+0000","last_became_active":"2023-09-23T08:54:53.100182+0000","last_became_peered":"2023-09-23T08:54:53.100182+0000","last_unstale":"2023-09-23T08:55:23.432183+0000","last_undegraded":"2023-09-23T08:55:23.432183+0000","last_fullsized":"2023-09-23T08:55:23.432183+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:13:20.648791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.431996+0000","last_change":"2023-09-23T08:54:53.097571+0000","last_active":"2023-09-23T08:55:23.431996+0000","last_peered":"2023-09-23T08:55:23.431996+0000","last_clean":"2023-09-23T08:55:23.431996+0000","last_became_active":"2023-09-23T08:54:53.097278+0000","last_became_peered":"2023-09-23T08:54:53.097278+0000","last_unstale":"2023-09-23T08:55:23.431996+0000","last_undegraded":"2023-09-23T08:55:23.431996+0000","last_fullsized":"2023-09-23T08:55:23.431996+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T11:32:37.554404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.428542+0000","last_change":"2023-09-23T08:54:53.113543+0000","last_active":"2023-09-23T08:55:23.428542+0000","last_peered":"2023-09-23T08:55:23.428542+0000","last_clean":"2023-09-23T08:55:23.428542+0000","last_became_active":"2023-09-23T08:54:53.113287+0000","last_became_peered":"2023-09-23T08:54:53.113287+0000","last_unstale":"2023-09-23T08:55:23.428542+0000","last_undegraded":"2023-09-23T08:55:23.428542+0000","last_fullsized":"2023-09-23T08:55:23.428542+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:56:48.219279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":64678,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":496,"num_read_kb":314,"num_write":234,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":552960,"data_stored":194034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":204,"ondisk_log_size":204,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892351002,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":459886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:54:56 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.63500000000000001}]},{"osd":1,"last update":"Sat Sep 23 08:54:56 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.83599999999999997}]},{"osd":2,"last update":"Sat Sep 23 08:54:56 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.57499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":4,"last update":"Sat Sep 23 08:54:56 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.673,"5min":1.673,"15min":1.673},"last":0.88100000000000001}]},{"osd":5,"last update":"Sat Sep 23 08:54:56 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.70799999999999996}]},{"osd":6,"last update":"Sat Sep 23 08:54:56 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.97299999999999998}]},{"osd":7,"last update":"Sat Sep 23 08:54:56 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.74,"5min":1.74,"15min":1.74},"last":0.99299999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92400000000000004}]},{"osd":9,"last update":"Sat Sep 23 08:54:56 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":1.069},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":1.05}]},{"osd":10,"last update":"Sat Sep 23 08:54:56 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":2.3410000000000002,"5min":2.3410000000000002,"15min":2.3410000000000002},"last":1.0309999999999999},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":1.1060000000000001}]}]},{"osd":10,"up_from":73,"seq":313532612639,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28640,"kb_used_data":1616,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716512,"statfs":{"total":95995035648,"available":95965708288,"internally_reserved":0,"allocated":1654784,"data_stored":1108787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":1,"last update":"Sat Sep 23 08:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.55300000000000005,"15min":0.56299999999999994},"min":{"1min":0.36499999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.77900000000000003,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.61799999999999999,"15min":0.621},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.88600000000000001,"5min":1.417,"15min":1.417},"last":0.45100000000000001}]},{"osd":2,"last update":"Sat Sep 23 08:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.752,"15min":0.76300000000000001},"min":{"1min":0.52700000000000002,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.996,"5min":1.214,"15min":1.214},"last":0.628},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.754,"15min":0.76000000000000001},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.97899999999999998,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.69799999999999995}]},{"osd":3,"last update":"Sat Sep 23 08:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.80300000000000005,"15min":0.82299999999999995},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.7210000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.754,"5min":0.78700000000000003,"15min":0.79300000000000004},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.8899999999999999,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":0.61599999999999999}]},{"osd":4,"last update":"Sat Sep 23 08:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.67600000000000005,"15min":0.68700000000000006},"min":{"1min":0.45800000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.81200000000000006,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.74399999999999999,"15min":0.76800000000000002},"min":{"1min":0.42899999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.80300000000000005,"5min":1.448,"15min":1.448},"last":0.71399999999999997}]},{"osd":5,"last update":"Sat Sep 23 08:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.82399999999999995,"15min":0.82999999999999996},"min":{"1min":0.54300000000000004,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.089,"5min":1.423,"15min":1.423},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.877,"15min":0.89700000000000002},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.109,"5min":1.333,"15min":1.333},"last":0.68500000000000005}]},{"osd":6,"last update":"Sat Sep 23 08:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.88200000000000001,"15min":0.90000000000000002},"min":{"1min":0.55800000000000005,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.738,"5min":1.738,"15min":1.738},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.91100000000000003,"15min":0.92500000000000004},"min":{"1min":0.60799999999999998,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.8160000000000001,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.88800000000000001}]},{"osd":7,"last update":"Sat Sep 23 08:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.52500000000000002}]},{"osd":8,"last update":"Sat Sep 23 08:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.90900000000000003,"15min":0.92100000000000004},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.133,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.96499999999999997},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.95999999999999996,"15min":0.98899999999999999},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.073,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":0.81299999999999994}]},{"osd":9,"last update":"Sat Sep 23 08:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.97999999999999998,"15min":0.99299999999999999},"min":{"1min":0.71899999999999997,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.7729999999999999,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.996,"15min":1.022},"min":{"1min":0.65800000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.794,"5min":1.794,"15min":1.794},"last":0.76600000000000001}]},{"osd":11,"last update":"Sat Sep 23 08:55:01 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":1.002}]}]},{"osd":9,"up_from":68,"seq":292057776163,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":983040,"data_stored":459816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:55:05 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.51300000000000001,"15min":0.52100000000000002},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.69699999999999995,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.56499999999999995,"15min":0.57099999999999995},"min":{"1min":0.36299999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.68400000000000005}]},{"osd":1,"last update":"Sat Sep 23 08:55:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.77600000000000002,"15min":0.79600000000000004},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.0489999999999999,"5min":1.143,"15min":1.143},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.72499999999999998,"15min":0.746},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.94899999999999995,"5min":1.095,"15min":1.095},"last":0.66600000000000004}]},{"osd":2,"last update":"Sat Sep 23 08:55:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.77900000000000003,"15min":0.79500000000000004},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0580000000000001,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.73899999999999999,"15min":0.75600000000000001},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.90400000000000003,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.59699999999999998}]},{"osd":3,"last update":"Sat Sep 23 08:55:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.63600000000000001,"15min":0.64200000000000002},"min":{"1min":0.41899999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.84199999999999997,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.627,"5min":0.68799999999999994,"15min":0.69799999999999995},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.98099999999999998,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.64400000000000002}]},{"osd":4,"last update":"Sat Sep 23 08:55:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.81000000000000005,"15min":0.82599999999999996},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.034,"5min":1.036,"15min":1.036},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.83999999999999997,"15min":0.85399999999999998},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0089999999999999,"5min":1.107,"15min":1.107},"last":0.85599999999999998}]},{"osd":5,"last update":"Sat Sep 23 08:55:05 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.80900000000000005,"15min":0.82199999999999995},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.86799999999999999,"15min":0.88400000000000001},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.1599999999999999,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.89300000000000002}]},{"osd":6,"last update":"Sat Sep 23 08:55:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.71299999999999997,"15min":0.72099999999999997},"min":{"1min":0.45800000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.94799999999999995,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.81200000000000006,"15min":0.81799999999999995},"min":{"1min":0.57099999999999995,"5min":0.44,"15min":0.44},"max":{"1min":1.123,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.80800000000000005}]},{"osd":7,"last update":"Sat Sep 23 08:55:05 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":1.159,"15min":1.2110000000000001},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.1040000000000001,"5min":7.0759999999999996,"15min":7.0759999999999996},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.87,"15min":0.88400000000000001},"min":{"1min":0.64200000000000002,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.01,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.88400000000000001}]},{"osd":8,"last update":"Sat Sep 23 08:55:05 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.872,"15min":0.89000000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.083,"5min":1.226,"15min":1.226},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.91400000000000003,"15min":0.92800000000000005},"min":{"1min":0.70399999999999996,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.248,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.90600000000000003}]},{"osd":10,"last update":"Sat Sep 23 08:55:32 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.94699999999999995,"15min":0.94299999999999995},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":3.4630000000000001,"5min":3.4630000000000001,"15min":3.4630000000000001},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.90500000000000003,"15min":0.91900000000000004},"min":{"1min":0.66000000000000003,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.2250000000000001,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.84499999999999997}]}]},{"osd":8,"up_from":60,"seq":257698037800,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":970752,"data_stored":459522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.68700000000000006,"15min":0.68899999999999995},"min":{"1min":0.45100000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.496},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.67800000000000005,"15min":0.68999999999999995},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.53900000000000003}]},{"osd":1,"last update":"Sat Sep 23 08:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.82299999999999995,"15min":0.81399999999999995},"min":{"1min":0.54100000000000004,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.754,"15min":0.746},"min":{"1min":0.59599999999999997,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.79200000000000004}]},{"osd":2,"last update":"Sat Sep 23 08:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.61299999999999999,"15min":0.60699999999999998},"min":{"1min":0.38300000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.59899999999999998,"15min":0.58899999999999997},"min":{"1min":0.432,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.85399999999999998,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.63200000000000001}]},{"osd":3,"last update":"Sat Sep 23 08:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.747,"15min":0.78100000000000003},"min":{"1min":0.54500000000000004,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.96099999999999997,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.81899999999999995,"15min":0.82999999999999996},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.97399999999999998,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.67400000000000004}]},{"osd":4,"last update":"Sat Sep 23 08:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.80100000000000005,"15min":0.80400000000000005},"min":{"1min":0.56299999999999994,"5min":0.439,"15min":0.439},"max":{"1min":1.024,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.96199999999999997,"15min":1},"min":{"1min":0.627,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.181,"5min":3.7530000000000001,"15min":3.7530000000000001},"last":0.82299999999999995}]},{"osd":5,"last update":"Sat Sep 23 08:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.70799999999999996,"15min":0.71399999999999997},"min":{"1min":0.51100000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.995,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.76000000000000001,"15min":0.77400000000000002},"min":{"1min":0.51000000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.0760000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.69999999999999996}]},{"osd":6,"last update":"Sat Sep 23 08:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.89900000000000002,"15min":0.90800000000000003},"min":{"1min":0.59399999999999997,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.871,"15min":0.878},"min":{"1min":0.66800000000000004,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":0.74399999999999999}]},{"osd":7,"last update":"Sat Sep 23 08:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.88400000000000001,"15min":0.88300000000000001},"min":{"1min":0.71599999999999997,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.1619999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.875},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.91300000000000003,"15min":0.92800000000000005},"min":{"1min":0.68600000000000005,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.258,"5min":1.679,"15min":1.679},"last":0.84399999999999997}]},{"osd":9,"last update":"Sat Sep 23 08:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.83799999999999997,"15min":0.83399999999999996},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.085,"5min":1.111,"15min":1.111},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.877,"5min":0.879,"15min":0.879},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.2130000000000001,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.81200000000000006}]},{"osd":10,"last update":"Sat Sep 23 08:55:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":0.86499999999999999,"15min":0.83999999999999997},"min":{"1min":0.73999999999999999,"5min":0.629,"15min":0.629},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.89800000000000002},{"interface":"front","average":{"1min":1.0469999999999999,"5min":0.91000000000000003,"15min":0.88700000000000001},"min":{"1min":0.66800000000000004,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.96899999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98899999999999999}]}]},{"osd":7,"up_from":52,"seq":223338299438,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28552,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716600,"statfs":{"total":95995035648,"available":95965798400,"internally_reserved":0,"allocated":1568768,"data_stored":1052503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:54:15 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.627,"15min":0.621},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.59799999999999998,"15min":0.58599999999999997},"min":{"1min":0.48399999999999999,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.53800000000000003}]},{"osd":1,"last update":"Sat Sep 23 08:55:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.51900000000000002,"15min":0.51300000000000001},"min":{"1min":0.40600000000000003,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.53400000000000003,"15min":0.53500000000000003},"min":{"1min":0.38200000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.73199999999999998,"5min":0.999,"15min":0.999},"last":0.63600000000000001}]},{"osd":2,"last update":"Sat Sep 23 08:55:15 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.745,"15min":0.747},"min":{"1min":0.58499999999999996,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.95599999999999996,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.54200000000000004,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.68700000000000006}]},{"osd":3,"last update":"Sat Sep 23 08:55:15 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.66900000000000004,"15min":0.66300000000000003},"min":{"1min":0.46600000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.879,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.71899999999999997,"15min":0.72799999999999998},"min":{"1min":0.498,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.88400000000000001,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.76500000000000001}]},{"osd":4,"last update":"Sat Sep 23 08:55:15 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.69299999999999995,"15min":0.70899999999999996},"min":{"1min":0.49399999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.95899999999999996,"5min":1.04,"15min":1.04},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.67700000000000005,"15min":0.69499999999999995},"min":{"1min":0.39300000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.93600000000000005,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.49199999999999999}]},{"osd":5,"last update":"Sat Sep 23 08:55:15 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.80400000000000005,"15min":0.80800000000000005},"min":{"1min":0.66500000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.875},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.79500000000000004,"15min":0.80800000000000005},"min":{"1min":0.59499999999999997,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0549999999999999,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.78600000000000003}]},{"osd":6,"last update":"Sat Sep 23 08:55:15 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.82099999999999995,"15min":0.82899999999999996},"min":{"1min":0.67900000000000005,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.012,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.81399999999999995,"15min":0.82599999999999996},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.97899999999999998,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.82599999999999996}]},{"osd":8,"last update":"Sat Sep 23 08:55:39 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.84199999999999997,"15min":0.81999999999999995},"min":{"1min":0.65800000000000003,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.97599999999999998},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.84199999999999997,"15min":0.83799999999999997},"min":{"1min":0.64900000000000002,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.0580000000000001,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.91400000000000003}]},{"osd":9,"last update":"Sat Sep 23 08:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.85599999999999998,"15min":0.85399999999999998},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.107,"5min":1.115,"15min":1.115},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.92800000000000005}]},{"osd":10,"last update":"Sat Sep 23 08:55:36 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.874,"15min":0.88},"min":{"1min":0.60699999999999998,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.01,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.89800000000000002,"15min":0.90600000000000003},"min":{"1min":0.67700000000000005,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":0.98799999999999999,"5min":1.117,"15min":1.117},"last":0.998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]}]},{"osd":6,"up_from":47,"seq":201863462965,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":966656,"data_stored":459539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:55:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.46800000000000003,"15min":0.44},"min":{"1min":0.33300000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.49299999999999999,"15min":0.47099999999999997},"min":{"1min":0.33300000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.45900000000000002}]},{"osd":1,"last update":"Sat Sep 23 08:55:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.67500000000000004,"15min":0.63300000000000001},"min":{"1min":0.442,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.70899999999999996,"15min":0.66900000000000004},"min":{"1min":0.53400000000000003,"5min":0.498,"15min":0.498},"max":{"1min":1.637,"5min":1.637,"15min":1.637},"last":0.65700000000000003}]},{"osd":2,"last update":"Sat Sep 23 08:55:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68200000000000005,"15min":0.66400000000000003},"min":{"1min":0.496,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.71499999999999997,"15min":0.69299999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0760000000000001,"5min":1.143,"15min":1.143},"last":0.63800000000000001}]},{"osd":3,"last update":"Sat Sep 23 08:55:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.58999999999999997,"15min":0.57999999999999996},"min":{"1min":0.38300000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.624,"5min":0.61799999999999999,"15min":0.60199999999999998},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.59899999999999998}]},{"osd":4,"last update":"Sat Sep 23 08:55:47 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.71899999999999997,"15min":0.71699999999999997},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.75800000000000001,"15min":0.73399999999999999},"min":{"1min":0.498,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.75900000000000001}]},{"osd":5,"last update":"Sat Sep 23 08:55:47 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.76400000000000001,"15min":0.72999999999999998},"min":{"1min":0.49199999999999999,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.76700000000000002,"15min":0.76100000000000001},"min":{"1min":0.56100000000000005,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.5820000000000001,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.80400000000000005}]},{"osd":7,"last update":"Sat Sep 23 08:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.79100000000000004,"15min":0.753},"min":{"1min":0.59999999999999998,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.1220000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.81899999999999995,"15min":0.79000000000000004},"min":{"1min":0.55700000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.111,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":4.6070000000000002}]},{"osd":8,"last update":"Sat Sep 23 08:55:47 2023","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.90700000000000003,"15min":0.90400000000000003},"min":{"1min":0.58999999999999997,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":5.2350000000000003,"5min":5.2350000000000003,"15min":5.2350000000000003},"last":0.85799999999999998},{"interface":"front","average":{"1min":1.0129999999999999,"5min":0.90800000000000003,"15min":0.89300000000000002},"min":{"1min":0.58799999999999997,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":4.5880000000000001,"5min":4.5880000000000001,"15min":4.5880000000000001},"last":4.5880000000000001}]},{"osd":9,"last update":"Sat Sep 23 08:55:08 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.89600000000000002,"15min":0.91600000000000004},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.997,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.90600000000000003,"15min":0.92400000000000004},"min":{"1min":0.65300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.0149999999999999,"5min":1.294,"15min":1.294},"last":0.86599999999999999}]},{"osd":10,"last update":"Sat Sep 23 08:55:31 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.96199999999999997,"15min":0.96499999999999997},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.669,"5min":1.669,"15min":1.669},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.877,"5min":0.95699999999999996,"15min":0.96999999999999997},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.444,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.88900000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574925,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1028096,"data_stored":518321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:55:45 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58699999999999997,"15min":0.55800000000000005},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.873},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.61299999999999999,"15min":0.58899999999999997},"min":{"1min":0.32300000000000001,"5min":0.314,"15min":0.314},"max":{"1min":1.0069999999999999,"5min":1.02,"15min":1.02},"last":0.92100000000000004}]},{"osd":2,"last update":"Sat Sep 23 08:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.71799999999999997,"15min":0.70299999999999996},"min":{"1min":0.5,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.008,"5min":1.026,"15min":1.026},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.71399999999999997,"15min":0.69399999999999995},"min":{"1min":0.51900000000000002,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.77700000000000002}]},{"osd":3,"last update":"Sat Sep 23 08:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67600000000000005,"15min":0.65300000000000002},"min":{"1min":0.46200000000000002,"5min":0.436,"15min":0.436},"max":{"1min":0.98099999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66400000000000003,"15min":0.64200000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.88200000000000001,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.97599999999999998}]},{"osd":4,"last update":"Sat Sep 23 08:54:54 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.51000000000000001,"15min":0.48199999999999998},"min":{"1min":0.38600000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.92100000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.54500000000000004,"15min":0.51500000000000001},"min":{"1min":0.35599999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.57499999999999996}]},{"osd":5,"last update":"Sat Sep 23 08:55:32 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.76500000000000001,"15min":0.73599999999999999},"min":{"1min":0.59399999999999997,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.73499999999999999,"15min":0.70999999999999996},"min":{"1min":0.57699999999999996,"5min":0.505,"15min":0.505},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.73099999999999998}]},{"osd":6,"last update":"Sat Sep 23 08:54:45 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71999999999999997,"15min":0.72399999999999998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":1.0169999999999999},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.69699999999999995,"15min":0.69199999999999995},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":1.105}]},{"osd":7,"last update":"Sat Sep 23 08:55:19 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.68799999999999994,"15min":0.69099999999999995},"min":{"1min":0.46500000000000002,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.748},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.78000000000000003,"15min":0.77400000000000002},"min":{"1min":0.66000000000000003,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.80600000000000005}]},{"osd":8,"last update":"Sat Sep 23 08:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.79300000000000004,"15min":0.755},"min":{"1min":0.64500000000000002,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.2110000000000001,"5min":2.8010000000000002,"15min":2.8010000000000002},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.79800000000000004,"15min":0.77200000000000002},"min":{"1min":0.70099999999999996,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.117,"5min":1.165,"15min":1.165},"last":1.0880000000000001}]},{"osd":9,"last update":"Sat Sep 23 08:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.83799999999999997,"15min":0.83299999999999996},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.996},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.86299999999999999,"15min":0.85299999999999998},"min":{"1min":0.72399999999999998,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":1.0649999999999999}]},{"osd":10,"last update":"Sat Sep 23 08:55:32 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.82999999999999996,"15min":0.82399999999999995},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.042,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":1.0489999999999999},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.86499999999999999,"15min":0.85899999999999999},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":1.0329999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.141}]}]},{"osd":0,"up_from":8,"seq":34359738451,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":983040,"data_stored":460599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 23 08:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.626,"15min":0.59399999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39300000000000002},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":0.75},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.73599999999999999,"15min":0.64700000000000002},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.36799999999999999},"max":{"1min":0.86299999999999999,"5min":5.7450000000000001,"15min":5.7450000000000001},"last":0.68500000000000005}]},{"osd":2,"last update":"Sat Sep 23 08:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63800000000000001,"15min":0.64100000000000001},"min":{"1min":0.39800000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.874,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.63400000000000001,"15min":0.63600000000000001},"min":{"1min":0.45300000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.64000000000000001}]},{"osd":3,"last update":"Sat Sep 23 08:53:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.47199999999999998,"15min":0.45600000000000002},"min":{"1min":0.377,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.435},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.54700000000000004,"15min":0.52500000000000002},"min":{"1min":0.40500000000000003,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.46000000000000002}]},{"osd":4,"last update":"Sat Sep 23 08:54:55 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.69399999999999995,"15min":0.64000000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.98899999999999999,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.72099999999999997,"15min":0.66400000000000003},"min":{"1min":0.44800000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.88400000000000001,"5min":5.6710000000000003,"15min":5.6710000000000003},"last":0.69499999999999995}]},{"osd":5,"last update":"Sat Sep 23 08:55:30 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69699999999999995,"15min":0.68899999999999995},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.86299999999999999,"5min":0.996,"15min":0.996},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.755,"5min":0.71799999999999997,"15min":0.70099999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.091,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.71799999999999997}]},{"osd":6,"last update":"Sat Sep 23 08:54:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.69399999999999995,"15min":0.69499999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.624},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.73599999999999999,"15min":0.73499999999999999},"min":{"1min":0.47999999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.93899999999999995,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.73599999999999999}]},{"osd":7,"last update":"Sat Sep 23 08:54:14 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.77300000000000002,"15min":0.77900000000000003},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.0489999999999999,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.875,"5min":0.84599999999999997,"15min":0.84099999999999997},"min":{"1min":0.63500000000000001,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.81799999999999995}]},{"osd":8,"last update":"Sat Sep 23 08:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.82799999999999996,"15min":0.84799999999999998},"min":{"1min":0.58799999999999997,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.80300000000000005,"15min":0.81699999999999995},"min":{"1min":0.60399999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.83699999999999997}]},{"osd":9,"last update":"Sat Sep 23 08:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.85099999999999998,"15min":0.875},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.1639999999999999,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.85699999999999998,"15min":0.88800000000000001},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0129999999999999,"5min":1.177,"15min":1.177},"last":0.80900000000000005}]},{"osd":10,"last update":"Sat Sep 23 08:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.80900000000000005,"15min":0.80600000000000005},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.6200000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.873},{"interface":"front","average":{"1min":0.876,"5min":0.92700000000000005,"15min":0.93500000000000005},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.1659999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.86799999999999999}]},{"osd":11,"last update":"Sat Sep 23 08:54:59 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.879,"5min":0.879,"15min":0.879},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.84799999999999998}]}]},{"osd":2,"up_from":18,"seq":77309411400,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1044480,"data_stored":518532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.61299999999999999,"15min":0.61399999999999999},"min":{"1min":0.37,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.68999999999999995,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.60999999999999999,"15min":0.62},"min":{"1min":0.40600000000000003,"5min":0.378,"15min":0.378},"max":{"1min":0.77500000000000002,"5min":1.196,"15min":1.196},"last":0.72999999999999998}]},{"osd":1,"last update":"Sat Sep 23 08:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.67000000000000004,"15min":0.67500000000000004},"min":{"1min":0.49299999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.98399999999999999,"5min":1.177,"15min":1.177},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.69899999999999995,"15min":0.67700000000000005},"min":{"1min":0.46800000000000003,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.026,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":1.0609999999999999}]},{"osd":3,"last update":"Sat Sep 23 08:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.72699999999999998,"15min":0.72099999999999997},"min":{"1min":0.54500000000000004,"5min":0.438,"15min":0.438},"max":{"1min":0.90200000000000002,"5min":1.083,"15min":1.083},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.69999999999999996,"15min":0.68700000000000006},"min":{"1min":0.56499999999999995,"5min":0.38,"15min":0.38},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.77800000000000002}]},{"osd":4,"last update":"Sat Sep 23 08:53:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.64100000000000001,"15min":0.63300000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.91100000000000003,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":1.0109999999999999},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.66000000000000003,"15min":0.64500000000000002},"min":{"1min":0.55600000000000005,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.76600000000000001}]},{"osd":5,"last update":"Sat Sep 23 08:55:27 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.60499999999999998,"15min":0.56100000000000005},"min":{"1min":0.44500000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.012,"5min":1.04,"15min":1.04},"last":0.624},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.56799999999999995,"15min":0.53600000000000003},"min":{"1min":0.41899999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.876,"5min":1.085,"15min":1.085},"last":0.67900000000000005}]},{"osd":6,"last update":"Sat Sep 23 08:54:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.752,"15min":0.73199999999999998},"min":{"1min":0.57099999999999995,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.96899999999999997,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.70699999999999996,"15min":0.69299999999999995},"min":{"1min":0.46899999999999997,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.95899999999999996,"5min":1.115,"15min":1.115},"last":0.82099999999999995}]},{"osd":7,"last update":"Sat Sep 23 08:54:12 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.75,"15min":0.75},"min":{"1min":0.61399999999999999,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.93999999999999995,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.81699999999999995,"15min":0.81999999999999995},"min":{"1min":0.56299999999999994,"5min":0.501,"15min":0.501},"max":{"1min":1.006,"5min":1.129,"15min":1.129},"last":0.82199999999999995}]},{"osd":8,"last update":"Sat Sep 23 08:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.753,"15min":0.74199999999999999},"min":{"1min":0.61299999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.752,"5min":0.73099999999999998,"15min":0.72899999999999998},"min":{"1min":0.60499999999999998,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.88}]},{"osd":9,"last update":"Sat Sep 23 08:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.82699999999999996,"15min":0.82899999999999996},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.044,"5min":1.163,"15min":1.163},"last":0.99099999999999999},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.87,"15min":0.871},"min":{"1min":0.64100000000000001,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.0109999999999999,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.97699999999999998}]},{"osd":10,"last update":"Sat Sep 23 08:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.86899999999999999,"15min":0.86199999999999999},"min":{"1min":0.69199999999999995,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":1.04},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.90700000000000003,"15min":0.89900000000000002},"min":{"1min":0.64900000000000002,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":1.109}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0269999999999999}]}]},{"osd":3,"up_from":26,"seq":111669149762,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":974848,"data_stored":458766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.46800000000000003,"15min":0.40600000000000003},"min":{"1min":0.314,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":2.294,"5min":2.294,"15min":2.294},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.48499999999999999,"15min":0.42799999999999999},"min":{"1min":0.35299999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":0.377}]},{"osd":1,"last update":"Sat Sep 23 08:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.71699999999999997,"15min":0.629},"min":{"1min":0.53500000000000003,"5min":0.434,"15min":0.434},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.69399999999999995,"15min":0.63700000000000001},"min":{"1min":0.502,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.504}]},{"osd":2,"last update":"Sat Sep 23 08:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.69899999999999995,"15min":0.65400000000000003},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.72399999999999998,"15min":0.66800000000000004},"min":{"1min":0.496,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.63500000000000001}]},{"osd":4,"last update":"Sat Sep 23 08:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.69099999999999995,"15min":0.65800000000000003},"min":{"1min":0.46400000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.69399999999999995,"15min":0.65500000000000003},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.91900000000000004,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.60499999999999998}]},{"osd":5,"last update":"Sat Sep 23 08:55:27 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.79100000000000004,"15min":0.77300000000000002},"min":{"1min":0.60299999999999998,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78500000000000003,"15min":0.76900000000000002},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.97099999999999997,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.52200000000000002}]},{"osd":6,"last update":"Sat Sep 23 08:54:50 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.63500000000000001,"15min":0.64500000000000002},"min":{"1min":0.45900000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.746,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68600000000000005,"15min":0.66600000000000004},"min":{"1min":0.435,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.03,"5min":1.054,"15min":1.054},"last":0.755}]},{"osd":7,"last update":"Sat Sep 23 08:55:15 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.81200000000000006,"15min":0.81499999999999995},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.82399999999999995,"15min":0.83599999999999997},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.79700000000000004}]},{"osd":8,"last update":"Sat Sep 23 08:54:43 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.89200000000000002,"15min":0.90300000000000002},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.0660000000000001,"5min":1.093,"15min":1.093},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.86699999999999999,"15min":0.87},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.66000000000000003}]},{"osd":9,"last update":"Sat Sep 23 08:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.81100000000000005,"15min":0.82299999999999995},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.0489999999999999,"5min":1.28,"15min":1.28},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.90700000000000003,"15min":0.92900000000000005},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":0.99199999999999999,"5min":1.101,"15min":1.101},"last":0.78700000000000003}]},{"osd":10,"last update":"Sat Sep 23 08:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.88700000000000001,"15min":0.88100000000000001},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.91100000000000003,"15min":0.91000000000000003},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.84599999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82699999999999996}]}]},{"osd":4,"up_from":34,"seq":146028888127,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":966656,"data_stored":459784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:53:55 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.628,"15min":0.624},"min":{"1min":0.45300000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.86199999999999999,"5min":1.042,"15min":1.042},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.622,"5min":0.60699999999999998,"15min":0.60899999999999999},"min":{"1min":0.434,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.93300000000000005,"5min":1.008,"15min":1.008},"last":0.38300000000000001}]},{"osd":1,"last update":"Sat Sep 23 08:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.44600000000000001,"15min":0.442},"min":{"1min":0.36099999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.48099999999999998,"15min":0.47099999999999997},"min":{"1min":0.375,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.65700000000000003}]},{"osd":2,"last update":"Sat Sep 23 08:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.69799999999999995,"15min":0.66800000000000004},"min":{"1min":0.46000000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.65800000000000003,"15min":0.65300000000000002},"min":{"1min":0.47699999999999998,"5min":0.38,"15min":0.38},"max":{"1min":0.94999999999999996,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.83699999999999997}]},{"osd":3,"last update":"Sat Sep 23 08:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64700000000000002,"15min":0.63700000000000001},"min":{"1min":0.45700000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.89600000000000002,"5min":1.014,"15min":1.014},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.72499999999999998,"15min":0.70899999999999996},"min":{"1min":0.53300000000000003,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.99099999999999999,"5min":1.238,"15min":1.238},"last":0.79600000000000004}]},{"osd":5,"last update":"Sat Sep 23 08:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.69199999999999995,"15min":0.63800000000000001},"min":{"1min":0.60399999999999998,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":1.006},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.72999999999999998,"15min":0.66700000000000004},"min":{"1min":0.502,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.88100000000000001}]},{"osd":6,"last update":"Sat Sep 23 08:54:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":0.80100000000000005,"15min":0.72799999999999998},"min":{"1min":0.57499999999999996,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":7.1829999999999998,"5min":7.1829999999999998,"15min":7.1829999999999998},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70299999999999996,"15min":0.69499999999999995},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.63400000000000001}]},{"osd":7,"last update":"Sat Sep 23 08:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.65800000000000003,"15min":0.64400000000000002},"min":{"1min":0.49199999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.016,"5min":1.212,"15min":1.212},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.71999999999999997,"15min":0.70199999999999996},"min":{"1min":0.45700000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.048,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.74399999999999999}]},{"osd":8,"last update":"Sat Sep 23 08:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.59899999999999998,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.94399999999999995,"5min":1.087,"15min":1.087},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.81399999999999995,"15min":0.78800000000000003},"min":{"1min":0.626,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":1.093}]},{"osd":9,"last update":"Sat Sep 23 08:55:08 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.79800000000000004,"15min":0.80600000000000005},"min":{"1min":0.47299999999999998,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.97999999999999998,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.84899999999999998,"15min":0.85199999999999998},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":1.0609999999999999}]},{"osd":10,"last update":"Sat Sep 23 08:55:32 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.88100000000000001,"15min":0.877},"min":{"1min":0.57199999999999995,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1279999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":1.1439999999999999},{"interface":"front","average":{"1min":0.874,"5min":0.93799999999999994,"15min":0.94799999999999995},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.99099999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1200000000000001}]}]},{"osd":5,"up_from":39,"seq":167503724602,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28572,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716580,"statfs":{"total":95995035648,"available":95965777920,"internally_reserved":0,"allocated":1585152,"data_stored":1052122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:55:30 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.66200000000000003,"15min":0.63100000000000001},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":3.5680000000000001,"5min":3.5680000000000001,"15min":3.5680000000000001},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.623,"5min":0.64200000000000002,"15min":0.64900000000000002},"min":{"1min":0.39300000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.91700000000000004}]},{"osd":1,"last update":"Sat Sep 23 08:55:30 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.67000000000000004,"15min":0.64400000000000002},"min":{"1min":0.45300000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.93700000000000006,"5min":1.016,"15min":1.016},"last":0.624},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.68500000000000005,"15min":0.63900000000000001},"min":{"1min":0.53800000000000003,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.92100000000000004,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.58099999999999996}]},{"osd":2,"last update":"Sat Sep 23 08:55:30 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.54200000000000004,"15min":0.52500000000000002},"min":{"1min":0.38800000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.72999999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.55100000000000005,"15min":0.52300000000000002},"min":{"1min":0.36199999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.79200000000000004,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.42599999999999999}]},{"osd":3,"last update":"Sat Sep 23 08:55:30 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.72399999999999998,"15min":0.68999999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":5.5339999999999998,"5min":5.5339999999999998,"15min":5.5339999999999998},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.68000000000000005,"15min":0.68899999999999995},"min":{"1min":0.48099999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":1.0780000000000001}]},{"osd":4,"last update":"Sat Sep 23 08:55:30 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.72499999999999998,"15min":0.69099999999999995},"min":{"1min":0.65500000000000003,"5min":0.44,"15min":0.44},"max":{"1min":0.96099999999999997,"5min":0.996,"15min":0.996},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.745,"5min":0.71899999999999997,"15min":0.69099999999999995},"min":{"1min":0.60399999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.95899999999999996,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.60899999999999999}]},{"osd":6,"last update":"Sat Sep 23 08:55:48 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.754,"15min":0.73099999999999998},"min":{"1min":0.50900000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.89100000000000001,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.878},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.76300000000000001,"15min":0.74299999999999999},"min":{"1min":0.56200000000000006,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":1.0369999999999999}]},{"osd":7,"last update":"Sat Sep 23 08:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.78300000000000003,"15min":0.75600000000000001},"min":{"1min":0.71399999999999997,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.98599999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.79800000000000004,"15min":0.78500000000000003},"min":{"1min":0.58999999999999997,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.95699999999999996,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.76100000000000001}]},{"osd":8,"last update":"Sat Sep 23 08:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.77200000000000002,"15min":0.77800000000000002},"min":{"1min":0.52900000000000003,"5min":0.497,"15min":0.497},"max":{"1min":0.96699999999999997,"5min":1.044,"15min":1.044},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.76300000000000001,"15min":0.77200000000000002},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.89100000000000001,"5min":1.046,"15min":1.046},"last":0.71699999999999997}]},{"osd":9,"last update":"Sat Sep 23 08:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.91000000000000003,"15min":0.92800000000000005},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.0469999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.875,"15min":0.89100000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.97699999999999998,"5min":1.95,"15min":1.95},"last":0.98199999999999998}]},{"osd":10,"last update":"Sat Sep 23 08:55:34 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.90300000000000002,"15min":0.90600000000000003},"min":{"1min":0.73499999999999999,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":0.99399999999999999,"5min":1.04,"15min":1.04},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.90400000000000003,"15min":0.91300000000000003},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.01,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.81299999999999994}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":59900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":59838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":59602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-23T08:55:50.816 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2023-09-23T08:55:50.816 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-09-23T08:55:50.816 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2023-09-23T08:55:50.816 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- ceph health --format=json 2023-09-23T08:55:50.843 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:50 smithi082 ceph-mon[97694]: pgmap v332: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2023-09-23T08:55:50.843 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:50 smithi082 ceph-mon[97694]: from='client.15000 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-09-23T08:55:50.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:50 smithi161 ceph-mon[99580]: pgmap v332: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2023-09-23T08:55:50.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:50 smithi161 ceph-mon[99580]: from='client.15000 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-09-23T08:55:51.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:50 smithi135 ceph-mon[99205]: pgmap v332: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2023-09-23T08:55:51.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:50 smithi135 ceph-mon[99205]: from='client.15000 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-09-23T08:55:51.541 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.a/config 2023-09-23T08:55:53.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:53.039+0000 7ff0443fd700 1 -- 172.21.15.82:0/2525716753 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff03c10d180 msgr2=0x7ff03c10f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:53.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:53.039+0000 7ff0443fd700 1 --2- 172.21.15.82:0/2525716753 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff03c10d180 0x7ff03c10f5f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff03400b0a0 tx=0x7ff03400b3b0 comp rx=0 tx=0).stop 2023-09-23T08:55:53.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:53.039+0000 7ff0443fd700 1 -- 172.21.15.82:0/2525716753 shutdown_connections 2023-09-23T08:55:53.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:53.039+0000 7ff0443fd700 1 --2- 172.21.15.82:0/2525716753 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff03c10d180 0x7ff03c10f5f0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:53.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:53.039+0000 7ff0443fd700 1 --2- 172.21.15.82:0/2525716753 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff03c072d50 0x7ff03c073130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:53.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:53.039+0000 7ff0443fd700 1 --2- 172.21.15.82:0/2525716753 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff03c073670 0x7ff03c10cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:53.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:53.039+0000 7ff0443fd700 1 -- 172.21.15.82:0/2525716753 >> 172.21.15.82:0/2525716753 conn(0x7ff03c0fc410 msgr2=0x7ff03c0fe830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:53.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:53.039+0000 7ff0443fd700 1 -- 172.21.15.82:0/2525716753 shutdown_connections 2023-09-23T08:55:53.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:53.039+0000 7ff0443fd700 1 -- 172.21.15.82:0/2525716753 wait complete. 2023-09-23T08:55:53.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:53.040+0000 7ff0443fd700 1 Processor -- start 2023-09-23T08:55:53.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:53.041+0000 7ff0443fd700 1 -- start start 2023-09-23T08:55:53.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:53.041+0000 7ff0443fd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff03c072d50 0x7ff03c198cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:53.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:53.041+0000 7ff0443fd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff03c073670 0x7ff03c199200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:53.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:53.041+0000 7ff0443fd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff03c10d180 0x7ff03c19c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:53.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:53.041+0000 7ff0443fd700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff03c19cbc0 con 0x7ff03c10d180 2023-09-23T08:55:53.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:53.041+0000 7ff0443fd700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff03c19cd30 con 0x7ff03c072d50 2023-09-23T08:55:53.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:53.041+0000 7ff0443fd700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff03c19cef0 con 0x7ff03c073670 2023-09-23T08:55:53.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:53.041+0000 7ff04299a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff03c10d180 0x7ff03c19c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:53.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:53.041+0000 7ff04299a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff03c10d180 0x7ff03c19c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54402/0 (socket says 172.21.15.82:54402) 2023-09-23T08:55:53.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:53.041+0000 7ff04299a700 1 -- 172.21.15.82:0/1314903408 learned_addr learned my addr 172.21.15.82:0/1314903408 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:55:53.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:53.041+0000 7ff042199700 1 --2- 172.21.15.82:0/1314903408 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff03c072d50 0x7ff03c198cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:53.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:53.042+0000 7ff041998700 1 --2- 172.21.15.82:0/1314903408 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff03c073670 0x7ff03c199200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:53.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:53.042+0000 7ff04299a700 1 -- 172.21.15.82:0/1314903408 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff03c073670 msgr2=0x7ff03c199200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:53.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:53.042+0000 7ff04299a700 1 --2- 172.21.15.82:0/1314903408 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff03c073670 0x7ff03c199200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:53.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:53.042+0000 7ff04299a700 1 -- 172.21.15.82:0/1314903408 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff03c072d50 msgr2=0x7ff03c198cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:53.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:53.042+0000 7ff04299a700 1 --2- 172.21.15.82:0/1314903408 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff03c072d50 0x7ff03c198cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:53.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:53.042+0000 7ff04299a700 1 -- 172.21.15.82:0/1314903408 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff034009d00 con 0x7ff03c10d180 2023-09-23T08:55:53.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:53.042+0000 7ff04299a700 1 --2- 172.21.15.82:0/1314903408 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff03c10d180 0x7ff03c19c5c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff034009fd0 tx=0x7ff034004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:53.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:53.042+0000 7ff0337fe700 1 -- 172.21.15.82:0/1314903408 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff03400e040 con 0x7ff03c10d180 2023-09-23T08:55:53.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:53.042+0000 7ff0337fe700 1 -- 172.21.15.82:0/1314903408 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff03400ceb0 con 0x7ff03c10d180 2023-09-23T08:55:53.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:53.042+0000 7ff0337fe700 1 -- 172.21.15.82:0/1314903408 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff034005680 con 0x7ff03c10d180 2023-09-23T08:55:53.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:53.042+0000 7ff0443fd700 1 -- 172.21.15.82:0/1314903408 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff03c19d170 con 0x7ff03c10d180 2023-09-23T08:55:53.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:53.043+0000 7ff0443fd700 1 -- 172.21.15.82:0/1314903408 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff03c1a5b20 con 0x7ff03c10d180 2023-09-23T08:55:53.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:53.044+0000 7ff0443fd700 1 -- 172.21.15.82:0/1314903408 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff03c04e620 con 0x7ff03c10d180 2023-09-23T08:55:53.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:53.045+0000 7ff0337fe700 1 -- 172.21.15.82:0/1314903408 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) v1 ==== 134722+0+0 (secure 0 0 0) 0x7ff03401bd60 con 0x7ff03c10d180 2023-09-23T08:55:53.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:53.047+0000 7ff0337fe700 1 --2- 172.21.15.82:0/1314903408 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7ff0280a0060 0x7ff0280a2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:53.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:53.047+0000 7ff0337fe700 1 -- 172.21.15.82:0/1314903408 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7ff0340ccf60 con 0x7ff03c10d180 2023-09-23T08:55:53.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:53.047+0000 7ff042199700 1 --2- 172.21.15.82:0/1314903408 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7ff0280a0060 0x7ff0280a2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:53.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:53.048+0000 7ff042199700 1 --2- 172.21.15.82:0/1314903408 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7ff0280a0060 0x7ff0280a2520 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff038005950 tx=0x7ff03800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:53.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:53.051+0000 7ff0337fe700 1 -- 172.21.15.82:0/1314903408 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7ff034096bd0 con 0x7ff03c10d180 2023-09-23T08:55:53.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:53.295+0000 7ff0443fd700 1 -- 172.21.15.82:0/1314903408 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7ff03c199fe0 con 0x7ff03c10d180 2023-09-23T08:55:53.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:53.295+0000 7ff0337fe700 1 -- 172.21.15.82:0/1314903408 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7ff03409a1f0 con 0x7ff03c10d180 2023-09-23T08:55:53.299 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:55:53.299 INFO:teuthology.orchestra.run.smithi082.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-09-23T08:55:53.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:53.297+0000 7ff0443fd700 1 -- 172.21.15.82:0/1314903408 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7ff0280a0060 msgr2=0x7ff0280a2520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:53.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:53.297+0000 7ff0443fd700 1 --2- 172.21.15.82:0/1314903408 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7ff0280a0060 0x7ff0280a2520 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff038005950 tx=0x7ff03800b410 comp rx=0 tx=0).stop 2023-09-23T08:55:53.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:53.297+0000 7ff0443fd700 1 -- 172.21.15.82:0/1314903408 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff03c10d180 msgr2=0x7ff03c19c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:53.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:53.297+0000 7ff0443fd700 1 --2- 172.21.15.82:0/1314903408 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff03c10d180 0x7ff03c19c5c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff034009fd0 tx=0x7ff034004c80 comp rx=0 tx=0).stop 2023-09-23T08:55:53.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:53.297+0000 7ff0443fd700 1 -- 172.21.15.82:0/1314903408 shutdown_connections 2023-09-23T08:55:53.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:53.298+0000 7ff0443fd700 1 --2- 172.21.15.82:0/1314903408 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7ff0280a0060 0x7ff0280a2520 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:53.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:53.298+0000 7ff0443fd700 1 --2- 172.21.15.82:0/1314903408 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff03c10d180 0x7ff03c19c5c0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:53.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:53.298+0000 7ff0443fd700 1 --2- 172.21.15.82:0/1314903408 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff03c072d50 0x7ff03c198cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:53.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:53.298+0000 7ff0443fd700 1 --2- 172.21.15.82:0/1314903408 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff03c073670 0x7ff03c199200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:53.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:53.298+0000 7ff0443fd700 1 -- 172.21.15.82:0/1314903408 >> 172.21.15.82:0/1314903408 conn(0x7ff03c0fc410 msgr2=0x7ff03c10f330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:53.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:53.298+0000 7ff0443fd700 1 -- 172.21.15.82:0/1314903408 shutdown_connections 2023-09-23T08:55:53.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:53.298+0000 7ff0443fd700 1 -- 172.21.15.82:0/1314903408 wait complete. 2023-09-23T08:55:53.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:53 smithi082 ceph-mon[97694]: pgmap v333: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2023-09-23T08:55:53.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:53 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/1314903408' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-09-23T08:55:53.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:53 smithi135 ceph-mon[99205]: pgmap v333: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2023-09-23T08:55:53.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:53 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/1314903408' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-09-23T08:55:53.815 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2023-09-23T08:55:53.816 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-23T08:55:53.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:53 smithi161 ceph-mon[99580]: pgmap v333: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2023-09-23T08:55:53.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:53 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/1314903408' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-09-23T08:55:54.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.053+0000 7fb4a01ff700 1 -- 172.21.15.82:0/1220225457 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb498073380 msgr2=0x7fb498073800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:54.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.053+0000 7fb4a01ff700 1 --2- 172.21.15.82:0/1220225457 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb498073380 0x7fb498073800 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb488009990 tx=0x7fb488009ca0 comp rx=0 tx=0).stop 2023-09-23T08:55:54.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.053+0000 7fb4a01ff700 1 -- 172.21.15.82:0/1220225457 shutdown_connections 2023-09-23T08:55:54.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.053+0000 7fb4a01ff700 1 --2- 172.21.15.82:0/1220225457 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb4981087f0 0x7fb49810ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:54.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.053+0000 7fb4a01ff700 1 --2- 172.21.15.82:0/1220225457 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb498074960 0x7fb498072db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:54.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.053+0000 7fb4a01ff700 1 --2- 172.21.15.82:0/1220225457 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb498073380 0x7fb498073800 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:54.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.053+0000 7fb4a01ff700 1 -- 172.21.15.82:0/1220225457 >> 172.21.15.82:0/1220225457 conn(0x7fb4980fbe60 msgr2=0x7fb4980fe2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:54.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.053+0000 7fb4a01ff700 1 -- 172.21.15.82:0/1220225457 shutdown_connections 2023-09-23T08:55:54.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.053+0000 7fb4a01ff700 1 -- 172.21.15.82:0/1220225457 wait complete. 2023-09-23T08:55:54.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.054+0000 7fb4a01ff700 1 Processor -- start 2023-09-23T08:55:54.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.054+0000 7fb4a01ff700 1 -- start start 2023-09-23T08:55:54.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.055+0000 7fb4a01ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb498073380 0x7fb498198710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:54.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.055+0000 7fb4a01ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb498074960 0x7fb498198c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:54.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.055+0000 7fb4a01ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4981087f0 0x7fb49819fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:54.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.055+0000 7fb4a01ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4981a0290 con 0x7fb498073380 2023-09-23T08:55:54.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.055+0000 7fb4a01ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4981a03d0 con 0x7fb4981087f0 2023-09-23T08:55:54.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.055+0000 7fb4a01ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4981a0560 con 0x7fb498074960 2023-09-23T08:55:54.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.055+0000 7fb49df9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb498073380 0x7fb498198710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:54.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.055+0000 7fb49df9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb498073380 0x7fb498198710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54410/0 (socket says 172.21.15.82:54410) 2023-09-23T08:55:54.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.055+0000 7fb49df9b700 1 -- 172.21.15.82:0/3608539631 learned_addr learned my addr 172.21.15.82:0/3608539631 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:55:54.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.055+0000 7fb49d79a700 1 --2- 172.21.15.82:0/3608539631 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb498074960 0x7fb498198c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:54.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.055+0000 7fb49e79c700 1 --2- 172.21.15.82:0/3608539631 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4981087f0 0x7fb49819fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:54.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.055+0000 7fb49df9b700 1 -- 172.21.15.82:0/3608539631 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb498074960 msgr2=0x7fb498198c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:54.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.055+0000 7fb49df9b700 1 --2- 172.21.15.82:0/3608539631 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb498074960 0x7fb498198c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:54.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.055+0000 7fb49df9b700 1 -- 172.21.15.82:0/3608539631 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4981087f0 msgr2=0x7fb49819fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:54.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.055+0000 7fb49df9b700 1 --2- 172.21.15.82:0/3608539631 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4981087f0 0x7fb49819fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:54.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.055+0000 7fb49df9b700 1 -- 172.21.15.82:0/3608539631 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4880095f0 con 0x7fb498073380 2023-09-23T08:55:54.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.056+0000 7fb49df9b700 1 --2- 172.21.15.82:0/3608539631 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb498073380 0x7fb498198710 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb49400c9b0 tx=0x7fb49400ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:54.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.056+0000 7fb48effd700 1 -- 172.21.15.82:0/3608539631 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb494007b00 con 0x7fb498073380 2023-09-23T08:55:54.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.056+0000 7fb48effd700 1 -- 172.21.15.82:0/3608539631 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb494007c60 con 0x7fb498073380 2023-09-23T08:55:54.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.056+0000 7fb4a01ff700 1 -- 172.21.15.82:0/3608539631 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4981a0840 con 0x7fb498073380 2023-09-23T08:55:54.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.056+0000 7fb48effd700 1 -- 172.21.15.82:0/3608539631 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb494018660 con 0x7fb498073380 2023-09-23T08:55:54.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.056+0000 7fb4a01ff700 1 -- 172.21.15.82:0/3608539631 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4981a0dd0 con 0x7fb498073380 2023-09-23T08:55:54.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.057+0000 7fb4a01ff700 1 -- 172.21.15.82:0/3608539631 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb498106ea0 con 0x7fb498073380 2023-09-23T08:55:54.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.059+0000 7fb48effd700 1 -- 172.21.15.82:0/3608539631 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) v1 ==== 134722+0+0 (secure 0 0 0) 0x7fb49400f450 con 0x7fb498073380 2023-09-23T08:55:54.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.061+0000 7fb48effd700 1 --2- 172.21.15.82:0/3608539631 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fb4840a0020 0x7fb4840a24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:54.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.062+0000 7fb48effd700 1 -- 172.21.15.82:0/3608539631 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fb4940cb400 con 0x7fb498073380 2023-09-23T08:55:54.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.062+0000 7fb49d79a700 1 --2- 172.21.15.82:0/3608539631 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fb4840a0020 0x7fb4840a24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:54.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.062+0000 7fb49d79a700 1 --2- 172.21.15.82:0/3608539631 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fb4840a0020 0x7fb4840a24e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb488000c00 tx=0x7fb488005ee0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:54.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.065+0000 7fb48effd700 1 -- 172.21.15.82:0/3608539631 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7fb494094fe0 con 0x7fb498073380 2023-09-23T08:55:54.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.265+0000 7fb4a01ff700 1 -- 172.21.15.82:0/3608539631 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb49810e2c0 con 0x7fb498073380 2023-09-23T08:55:54.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.267+0000 7fb48effd700 1 -- 172.21.15.82:0/3608539631 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+22508 (secure 0 0 0) 0x7fb49400fe60 con 0x7fb498073380 2023-09-23T08:55:54.270 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:55:54.270 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":88,"fsid":"8926e286-59ed-11ee-8db4-212e2dc638e7","created":"2023-09-23T08:46:16.628057+0000","modified":"2023-09-23T08:55:23.423278+0000","last_up_change":"2023-09-23T08:53:56.524694+0000","last_in_change":"2023-09-23T08:53:35.779183+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-23T08:50:00.571063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-23T08:54:50.558630+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-23T08:54:52.055291+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7384c1ff-8c71-4feb-8cef-ba45c2a1708a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":892441948},{"type":"v1","addr":"172.21.15.82:6803","nonce":892441948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":892441948},{"type":"v1","addr":"172.21.15.82:6805","nonce":892441948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":892441948},{"type":"v1","addr":"172.21.15.82:6809","nonce":892441948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":892441948},{"type":"v1","addr":"172.21.15.82:6807","nonce":892441948}]},"public_addr":"172.21.15.82:6803/892441948","cluster_addr":"172.21.15.82:6805/892441948","heartbeat_back_addr":"172.21.15.82:6809/892441948","heartbeat_front_addr":"172.21.15.82:6807/892441948","state":["exists","up"]},{"osd":1,"uuid":"ca62333e-15db-4556-a9ed-8820f9268766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3224546922},{"type":"v1","addr":"172.21.15.135:6801","nonce":3224546922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3224546922},{"type":"v1","addr":"172.21.15.135:6803","nonce":3224546922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3224546922},{"type":"v1","addr":"172.21.15.135:6807","nonce":3224546922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3224546922},{"type":"v1","addr":"172.21.15.135:6805","nonce":3224546922}]},"public_addr":"172.21.15.135:6801/3224546922","cluster_addr":"172.21.15.135:6803/3224546922","heartbeat_back_addr":"172.21.15.135:6807/3224546922","heartbeat_front_addr":"172.21.15.135:6805/3224546922","state":["exists","up"]},{"osd":2,"uuid":"ac23eb38-216a-44f0-b316-a509b23745f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2358373459},{"type":"v1","addr":"172.21.15.161:6801","nonce":2358373459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2358373459},{"type":"v1","addr":"172.21.15.161:6803","nonce":2358373459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2358373459},{"type":"v1","addr":"172.21.15.161:6807","nonce":2358373459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2358373459},{"type":"v1","addr":"172.21.15.161:6805","nonce":2358373459}]},"public_addr":"172.21.15.161:6801/2358373459","cluster_addr":"172.21.15.161:6803/2358373459","heartbeat_back_addr":"172.21.15.161:6807/2358373459","heartbeat_front_addr":"172.21.15.161:6805/2358373459","state":["exists","up"]},{"osd":3,"uuid":"701c96b0-30fb-46ce-917d-e02d3814dc3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":1081464528},{"type":"v1","addr":"172.21.15.82:6811","nonce":1081464528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1081464528},{"type":"v1","addr":"172.21.15.82:6813","nonce":1081464528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1081464528},{"type":"v1","addr":"172.21.15.82:6817","nonce":1081464528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":1081464528},{"type":"v1","addr":"172.21.15.82:6815","nonce":1081464528}]},"public_addr":"172.21.15.82:6811/1081464528","cluster_addr":"172.21.15.82:6813/1081464528","heartbeat_back_addr":"172.21.15.82:6817/1081464528","heartbeat_front_addr":"172.21.15.82:6815/1081464528","state":["exists","up"]},{"osd":4,"uuid":"c618d2a2-3616-41b2-943c-7a4616538e13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2346495509},{"type":"v1","addr":"172.21.15.135:6809","nonce":2346495509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2346495509},{"type":"v1","addr":"172.21.15.135:6811","nonce":2346495509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2346495509},{"type":"v1","addr":"172.21.15.135:6815","nonce":2346495509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2346495509},{"type":"v1","addr":"172.21.15.135:6813","nonce":2346495509}]},"public_addr":"172.21.15.135:6809/2346495509","cluster_addr":"172.21.15.135:6811/2346495509","heartbeat_back_addr":"172.21.15.135:6815/2346495509","heartbeat_front_addr":"172.21.15.135:6813/2346495509","state":["exists","up"]},{"osd":5,"uuid":"8e1dda3d-6927-495d-b20d-78b03bb75d5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1252638628},{"type":"v1","addr":"172.21.15.161:6809","nonce":1252638628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1252638628},{"type":"v1","addr":"172.21.15.161:6811","nonce":1252638628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1252638628},{"type":"v1","addr":"172.21.15.161:6815","nonce":1252638628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1252638628},{"type":"v1","addr":"172.21.15.161:6813","nonce":1252638628}]},"public_addr":"172.21.15.161:6809/1252638628","cluster_addr":"172.21.15.161:6811/1252638628","heartbeat_back_addr":"172.21.15.161:6815/1252638628","heartbeat_front_addr":"172.21.15.161:6813/1252638628","state":["exists","up"]},{"osd":6,"uuid":"50b31960-6bc4-44e1-8116-3106bf161e56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1052038408},{"type":"v1","addr":"172.21.15.82:6819","nonce":1052038408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1052038408},{"type":"v1","addr":"172.21.15.82:6821","nonce":1052038408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":1052038408},{"type":"v1","addr":"172.21.15.82:6825","nonce":1052038408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1052038408},{"type":"v1","addr":"172.21.15.82:6823","nonce":1052038408}]},"public_addr":"172.21.15.82:6819/1052038408","cluster_addr":"172.21.15.82:6821/1052038408","heartbeat_back_addr":"172.21.15.82:6825/1052038408","heartbeat_front_addr":"172.21.15.82:6823/1052038408","state":["exists","up"]},{"osd":7,"uuid":"425ca0ee-57f7-4b27-90fb-d86bb5db5480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3683951498},{"type":"v1","addr":"172.21.15.135:6817","nonce":3683951498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":3683951498},{"type":"v1","addr":"172.21.15.135:6819","nonce":3683951498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":3683951498},{"type":"v1","addr":"172.21.15.135:6823","nonce":3683951498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":3683951498},{"type":"v1","addr":"172.21.15.135:6821","nonce":3683951498}]},"public_addr":"172.21.15.135:6817/3683951498","cluster_addr":"172.21.15.135:6819/3683951498","heartbeat_back_addr":"172.21.15.135:6823/3683951498","heartbeat_front_addr":"172.21.15.135:6821/3683951498","state":["exists","up"]},{"osd":8,"uuid":"1115c837-bef6-4bad-9974-4d913198511b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":948521536},{"type":"v1","addr":"172.21.15.161:6817","nonce":948521536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":948521536},{"type":"v1","addr":"172.21.15.161:6819","nonce":948521536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":948521536},{"type":"v1","addr":"172.21.15.161:6823","nonce":948521536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":948521536},{"type":"v1","addr":"172.21.15.161:6821","nonce":948521536}]},"public_addr":"172.21.15.161:6817/948521536","cluster_addr":"172.21.15.161:6819/948521536","heartbeat_back_addr":"172.21.15.161:6823/948521536","heartbeat_front_addr":"172.21.15.161:6821/948521536","state":["exists","up"]},{"osd":9,"uuid":"c52ec819-4bc6-402f-9cd8-62539e519e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":1438762840},{"type":"v1","addr":"172.21.15.82:6827","nonce":1438762840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":1438762840},{"type":"v1","addr":"172.21.15.82:6829","nonce":1438762840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1438762840},{"type":"v1","addr":"172.21.15.82:6833","nonce":1438762840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1438762840},{"type":"v1","addr":"172.21.15.82:6831","nonce":1438762840}]},"public_addr":"172.21.15.82:6827/1438762840","cluster_addr":"172.21.15.82:6829/1438762840","heartbeat_back_addr":"172.21.15.82:6833/1438762840","heartbeat_front_addr":"172.21.15.82:6831/1438762840","state":["exists","up"]},{"osd":10,"uuid":"1b16c795-1b91-4d46-ae5d-21b8332c1077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2853697851},{"type":"v1","addr":"172.21.15.135:6825","nonce":2853697851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2853697851},{"type":"v1","addr":"172.21.15.135:6827","nonce":2853697851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2853697851},{"type":"v1","addr":"172.21.15.135:6831","nonce":2853697851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2853697851},{"type":"v1","addr":"172.21.15.135:6829","nonce":2853697851}]},"public_addr":"172.21.15.135:6825/2853697851","cluster_addr":"172.21.15.135:6827/2853697851","heartbeat_back_addr":"172.21.15.135:6831/2853697851","heartbeat_front_addr":"172.21.15.135:6829/2853697851","state":["exists","up"]},{"osd":11,"uuid":"2551e602-4fe1-41cb-9b7d-c8b31fdd1487","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":1459332081},{"type":"v1","addr":"172.21.15.161:6825","nonce":1459332081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":1459332081},{"type":"v1","addr":"172.21.15.161:6827","nonce":1459332081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":1459332081},{"type":"v1","addr":"172.21.15.161:6831","nonce":1459332081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":1459332081},{"type":"v1","addr":"172.21.15.161:6829","nonce":1459332081}]},"public_addr":"172.21.15.161:6825/1459332081","cluster_addr":"172.21.15.161:6827/1459332081","heartbeat_back_addr":"172.21.15.161:6831/1459332081","heartbeat_front_addr":"172.21.15.161:6829/1459332081","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:49:04.007679+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:49:30.702365+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:49:56.785248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:50:22.988516+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:50:49.347055+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:51:15.830145+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:51:41.986377+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:52:08.218893+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:52:34.847450+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:53:01.317134+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:53:27.981691+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:53:54.849245+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/4204712132":"2023-09-24T08:47:21.957866+0000","172.21.15.82:6801/2733521564":"2023-09-24T08:47:21.957866+0000","172.21.15.82:6800/2733521564":"2023-09-24T08:47:21.957866+0000","172.21.15.82:0/3964794665":"2023-09-24T08:47:21.957866+0000","172.21.15.82:0/3535372205":"2023-09-24T08:46:55.187024+0000","172.21.15.82:0/285559684":"2023-09-24T08:46:55.187024+0000","172.21.15.82:0/1335891896":"2023-09-24T08:46:55.187024+0000","172.21.15.82:6801/3761509623":"2023-09-24T08:46:55.187024+0000","172.21.15.82:6800/3761509623":"2023-09-24T08:46:55.187024+0000","172.21.15.82:0/3775317005":"2023-09-24T08:47:21.957866+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-23T08:55:54.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.269+0000 7fb4a01ff700 1 -- 172.21.15.82:0/3608539631 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fb4840a0020 msgr2=0x7fb4840a24e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:54.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.269+0000 7fb4a01ff700 1 --2- 172.21.15.82:0/3608539631 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fb4840a0020 0x7fb4840a24e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb488000c00 tx=0x7fb488005ee0 comp rx=0 tx=0).stop 2023-09-23T08:55:54.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.269+0000 7fb4a01ff700 1 -- 172.21.15.82:0/3608539631 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb498073380 msgr2=0x7fb498198710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:54.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.269+0000 7fb4a01ff700 1 --2- 172.21.15.82:0/3608539631 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb498073380 0x7fb498198710 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb49400c9b0 tx=0x7fb49400ccc0 comp rx=0 tx=0).stop 2023-09-23T08:55:54.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.269+0000 7fb4a01ff700 1 -- 172.21.15.82:0/3608539631 shutdown_connections 2023-09-23T08:55:54.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.269+0000 7fb4a01ff700 1 --2- 172.21.15.82:0/3608539631 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fb4840a0020 0x7fb4840a24e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:54.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.269+0000 7fb4a01ff700 1 --2- 172.21.15.82:0/3608539631 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4981087f0 0x7fb49819fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:54.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.269+0000 7fb4a01ff700 1 --2- 172.21.15.82:0/3608539631 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb498073380 0x7fb498198710 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:54.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.269+0000 7fb4a01ff700 1 --2- 172.21.15.82:0/3608539631 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb498074960 0x7fb498198c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:54.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.269+0000 7fb4a01ff700 1 -- 172.21.15.82:0/3608539631 >> 172.21.15.82:0/3608539631 conn(0x7fb4980fbe60 msgr2=0x7fb4980fe250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:54.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.269+0000 7fb4a01ff700 1 -- 172.21.15.82:0/3608539631 shutdown_connections 2023-09-23T08:55:54.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.269+0000 7fb4a01ff700 1 -- 172.21.15.82:0/3608539631 wait complete. 2023-09-23T08:55:54.290 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-23T08:50:00.571063+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-23T08:54:50.558630+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-23T08:54:52.055291+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-23T08:55:54.291 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-23T08:55:54.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.491+0000 7fb1c7dff700 1 -- 172.21.15.82:0/3898283555 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1c0101b20 msgr2=0x7fb1c0101f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:54.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.491+0000 7fb1c7dff700 1 --2- 172.21.15.82:0/3898283555 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1c0101b20 0x7fb1c0101f80 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fb1b00099c0 tx=0x7fb1b0009cd0 comp rx=0 tx=0).stop 2023-09-23T08:55:54.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.491+0000 7fb1c7dff700 1 -- 172.21.15.82:0/3898283555 shutdown_connections 2023-09-23T08:55:54.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.491+0000 7fb1c7dff700 1 --2- 172.21.15.82:0/3898283555 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb1c01024c0 0x7fb1c0108d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:54.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.491+0000 7fb1c7dff700 1 --2- 172.21.15.82:0/3898283555 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb1c0100930 0x7fb1c0100d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:54.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.491+0000 7fb1c7dff700 1 --2- 172.21.15.82:0/3898283555 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1c0101b20 0x7fb1c0101f80 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:54.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.491+0000 7fb1c7dff700 1 -- 172.21.15.82:0/3898283555 >> 172.21.15.82:0/3898283555 conn(0x7fb1c00fbea0 msgr2=0x7fb1c00fe2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:54.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.491+0000 7fb1c7dff700 1 -- 172.21.15.82:0/3898283555 shutdown_connections 2023-09-23T08:55:54.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.492+0000 7fb1c7dff700 1 -- 172.21.15.82:0/3898283555 wait complete. 2023-09-23T08:55:54.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.492+0000 7fb1c7dff700 1 Processor -- start 2023-09-23T08:55:54.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.493+0000 7fb1c7dff700 1 -- start start 2023-09-23T08:55:54.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.493+0000 7fb1c7dff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb1c0100930 0x7fb1c01964d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:54.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.493+0000 7fb1c7dff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1c0101b20 0x7fb1c0196a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:54.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.493+0000 7fb1c7dff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb1c01024c0 0x7fb1c019da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:54.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.493+0000 7fb1c7dff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c019e050 con 0x7fb1c0101b20 2023-09-23T08:55:54.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.493+0000 7fb1c7dff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c019e190 con 0x7fb1c0100930 2023-09-23T08:55:54.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.493+0000 7fb1c7dff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c019e320 con 0x7fb1c01024c0 2023-09-23T08:55:54.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.493+0000 7fb1c539a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1c0101b20 0x7fb1c0196a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:54.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.493+0000 7fb1c539a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1c0101b20 0x7fb1c0196a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54424/0 (socket says 172.21.15.82:54424) 2023-09-23T08:55:54.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.493+0000 7fb1c539a700 1 -- 172.21.15.82:0/535356299 learned_addr learned my addr 172.21.15.82:0/535356299 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:55:54.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.493+0000 7fb1c5b9b700 1 --2- 172.21.15.82:0/535356299 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb1c0100930 0x7fb1c01964d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:54.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.493+0000 7fb1c539a700 1 -- 172.21.15.82:0/535356299 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb1c01024c0 msgr2=0x7fb1c019da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:54.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.493+0000 7fb1c539a700 1 --2- 172.21.15.82:0/535356299 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb1c01024c0 0x7fb1c019da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:54.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.493+0000 7fb1c539a700 1 -- 172.21.15.82:0/535356299 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb1c0100930 msgr2=0x7fb1c01964d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:54.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.493+0000 7fb1c539a700 1 --2- 172.21.15.82:0/535356299 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb1c0100930 0x7fb1c01964d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:54.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.493+0000 7fb1c539a700 1 -- 172.21.15.82:0/535356299 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1b00095f0 con 0x7fb1c0101b20 2023-09-23T08:55:54.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.493+0000 7fb1c5b9b700 1 --2- 172.21.15.82:0/535356299 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb1c0100930 0x7fb1c01964d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T08:55:54.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.494+0000 7fb1c539a700 1 --2- 172.21.15.82:0/535356299 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1c0101b20 0x7fb1c0196a10 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fb1b0009f50 tx=0x7fb1b0003b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:54.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.494+0000 7fb1b6ffd700 1 -- 172.21.15.82:0/535356299 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b001d070 con 0x7fb1c0101b20 2023-09-23T08:55:54.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.494+0000 7fb1c7dff700 1 -- 172.21.15.82:0/535356299 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1c019e5a0 con 0x7fb1c0101b20 2023-09-23T08:55:54.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.494+0000 7fb1b6ffd700 1 -- 172.21.15.82:0/535356299 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb1b000bda0 con 0x7fb1c0101b20 2023-09-23T08:55:54.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.494+0000 7fb1b6ffd700 1 -- 172.21.15.82:0/535356299 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b0005280 con 0x7fb1c0101b20 2023-09-23T08:55:54.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.494+0000 7fb1c7dff700 1 -- 172.21.15.82:0/535356299 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1c019e970 con 0x7fb1c0101b20 2023-09-23T08:55:54.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.495+0000 7fb1c7dff700 1 -- 172.21.15.82:0/535356299 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1c01078b0 con 0x7fb1c0101b20 2023-09-23T08:55:54.500 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.497+0000 7fb1b6ffd700 1 -- 172.21.15.82:0/535356299 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) v1 ==== 134722+0+0 (secure 0 0 0) 0x7fb1b00053e0 con 0x7fb1c0101b20 2023-09-23T08:55:54.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.499+0000 7fb1b6ffd700 1 --2- 172.21.15.82:0/535356299 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fb1ac09ffe0 0x7fb1ac0a24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:54.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.499+0000 7fb1b6ffd700 1 -- 172.21.15.82:0/535356299 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fb1b00cc5f0 con 0x7fb1c0101b20 2023-09-23T08:55:54.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.499+0000 7fb1c5b9b700 1 --2- 172.21.15.82:0/535356299 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fb1ac09ffe0 0x7fb1ac0a24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:54.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.499+0000 7fb1c5b9b700 1 --2- 172.21.15.82:0/535356299 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fb1ac09ffe0 0x7fb1ac0a24a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb1c0101980 tx=0x7fb1bc00a680 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:54.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.502+0000 7fb1b6ffd700 1 -- 172.21.15.82:0/535356299 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7fb1b0096260 con 0x7fb1c0101b20 2023-09-23T08:55:54.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:54 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/3608539631' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-23T08:55:54.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.707+0000 7fb1c7dff700 1 -- 172.21.15.82:0/535356299 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb1c010c040 con 0x7fb1c0101b20 2023-09-23T08:55:54.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.707+0000 7fb1b6ffd700 1 -- 172.21.15.82:0/535356299 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb1b0099880 con 0x7fb1c0101b20 2023-09-23T08:55:54.710 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-09-23T08:55:54.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.709+0000 7fb1c7dff700 1 -- 172.21.15.82:0/535356299 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fb1ac09ffe0 msgr2=0x7fb1ac0a24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:54.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.709+0000 7fb1c7dff700 1 --2- 172.21.15.82:0/535356299 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fb1ac09ffe0 0x7fb1ac0a24a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb1c0101980 tx=0x7fb1bc00a680 comp rx=0 tx=0).stop 2023-09-23T08:55:54.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.709+0000 7fb1c7dff700 1 -- 172.21.15.82:0/535356299 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1c0101b20 msgr2=0x7fb1c0196a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:54.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.709+0000 7fb1c7dff700 1 --2- 172.21.15.82:0/535356299 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1c0101b20 0x7fb1c0196a10 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fb1b0009f50 tx=0x7fb1b0003b00 comp rx=0 tx=0).stop 2023-09-23T08:55:54.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.710+0000 7fb1c7dff700 1 -- 172.21.15.82:0/535356299 shutdown_connections 2023-09-23T08:55:54.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.710+0000 7fb1c7dff700 1 --2- 172.21.15.82:0/535356299 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fb1ac09ffe0 0x7fb1ac0a24a0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:54.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.710+0000 7fb1c7dff700 1 --2- 172.21.15.82:0/535356299 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb1c01024c0 0x7fb1c019da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:54.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.710+0000 7fb1c7dff700 1 --2- 172.21.15.82:0/535356299 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb1c0100930 0x7fb1c01964d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:54.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.710+0000 7fb1c7dff700 1 --2- 172.21.15.82:0/535356299 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1c0101b20 0x7fb1c0196a10 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:54.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.710+0000 7fb1c7dff700 1 -- 172.21.15.82:0/535356299 >> 172.21.15.82:0/535356299 conn(0x7fb1c00fbea0 msgr2=0x7fb1c00fe140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:54.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.710+0000 7fb1c7dff700 1 -- 172.21.15.82:0/535356299 shutdown_connections 2023-09-23T08:55:54.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.710+0000 7fb1c7dff700 1 -- 172.21.15.82:0/535356299 wait complete. 2023-09-23T08:55:54.731 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-23T08:55:54.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:54 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/3608539631' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-23T08:55:54.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:54 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/3608539631' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-23T08:55:54.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.928+0000 7f759a3ff700 1 -- 172.21.15.82:0/1146108558 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75941024c0 msgr2=0x7f7594108d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:54.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.928+0000 7f759a3ff700 1 --2- 172.21.15.82:0/1146108558 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75941024c0 0x7f7594108d70 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f758c00b0d0 tx=0x7f758c00b3e0 comp rx=0 tx=0).stop 2023-09-23T08:55:54.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.928+0000 7f759a3ff700 1 -- 172.21.15.82:0/1146108558 shutdown_connections 2023-09-23T08:55:54.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.928+0000 7f759a3ff700 1 --2- 172.21.15.82:0/1146108558 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75941024c0 0x7f7594108d70 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:54.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.928+0000 7f759a3ff700 1 --2- 172.21.15.82:0/1146108558 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7594100930 0x7f7594100d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:54.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.928+0000 7f759a3ff700 1 --2- 172.21.15.82:0/1146108558 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7594101b20 0x7f7594101f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:54.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.928+0000 7f759a3ff700 1 -- 172.21.15.82:0/1146108558 >> 172.21.15.82:0/1146108558 conn(0x7f75940fbea0 msgr2=0x7f75940fe2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:54.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.928+0000 7f759a3ff700 1 -- 172.21.15.82:0/1146108558 shutdown_connections 2023-09-23T08:55:54.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.928+0000 7f759a3ff700 1 -- 172.21.15.82:0/1146108558 wait complete. 2023-09-23T08:55:54.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.929+0000 7f759a3ff700 1 Processor -- start 2023-09-23T08:55:54.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.930+0000 7f759a3ff700 1 -- start start 2023-09-23T08:55:54.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.930+0000 7f759a3ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7594100930 0x7f75940746d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:54.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.930+0000 7f759a3ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7594101b20 0x7f7594072d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:54.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.930+0000 7f759a3ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f75941024c0 0x7f7594073250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:54.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.930+0000 7f759a3ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75940739f0 con 0x7f7594101b20 2023-09-23T08:55:54.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.930+0000 7f759a3ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7594073b60 con 0x7f75941024c0 2023-09-23T08:55:54.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.930+0000 7f759a3ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75941a06a0 con 0x7f7594100930 2023-09-23T08:55:54.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.930+0000 7f75937fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7594101b20 0x7f7594072d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:54.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.930+0000 7f75937fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7594101b20 0x7f7594072d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54446/0 (socket says 172.21.15.82:54446) 2023-09-23T08:55:54.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.930+0000 7f75937fe700 1 -- 172.21.15.82:0/4185097037 learned_addr learned my addr 172.21.15.82:0/4185097037 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:55:54.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.930+0000 7f7593fff700 1 --2- 172.21.15.82:0/4185097037 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7594100930 0x7f75940746d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:54.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.930+0000 7f759899c700 1 --2- 172.21.15.82:0/4185097037 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f75941024c0 0x7f7594073250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:54.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.930+0000 7f75937fe700 1 -- 172.21.15.82:0/4185097037 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7594100930 msgr2=0x7f75940746d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:54.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.931+0000 7f75937fe700 1 --2- 172.21.15.82:0/4185097037 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7594100930 0x7f75940746d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:54.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.931+0000 7f75937fe700 1 -- 172.21.15.82:0/4185097037 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f75941024c0 msgr2=0x7f7594073250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:54.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.931+0000 7f75937fe700 1 --2- 172.21.15.82:0/4185097037 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f75941024c0 0x7f7594073250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:54.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.931+0000 7f75937fe700 1 -- 172.21.15.82:0/4185097037 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f758c009d00 con 0x7f7594101b20 2023-09-23T08:55:54.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.931+0000 7f75937fe700 1 --2- 172.21.15.82:0/4185097037 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7594101b20 0x7f7594072d10 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f758800e9a0 tx=0x7f758800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:54.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.931+0000 7f75917fa700 1 -- 172.21.15.82:0/4185097037 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7588009790 con 0x7f7594101b20 2023-09-23T08:55:54.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.931+0000 7f75917fa700 1 -- 172.21.15.82:0/4185097037 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7588010430 con 0x7f7594101b20 2023-09-23T08:55:54.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.931+0000 7f759a3ff700 1 -- 172.21.15.82:0/4185097037 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75941a0980 con 0x7f7594101b20 2023-09-23T08:55:54.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.931+0000 7f75917fa700 1 -- 172.21.15.82:0/4185097037 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758800cea0 con 0x7f7594101b20 2023-09-23T08:55:54.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.931+0000 7f759a3ff700 1 -- 172.21.15.82:0/4185097037 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75941a0e90 con 0x7f7594101b20 2023-09-23T08:55:54.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.932+0000 7f759a3ff700 1 -- 172.21.15.82:0/4185097037 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7594107f10 con 0x7f7594101b20 2023-09-23T08:55:54.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.934+0000 7f75917fa700 1 -- 172.21.15.82:0/4185097037 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) v1 ==== 134722+0+0 (secure 0 0 0) 0x7f75880105a0 con 0x7f7594101b20 2023-09-23T08:55:54.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.935+0000 7f75917fa700 1 --2- 172.21.15.82:0/4185097037 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f757c09ffe0 0x7f757c0a24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:54.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.936+0000 7f75917fa700 1 -- 172.21.15.82:0/4185097037 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f7588014070 con 0x7f7594101b20 2023-09-23T08:55:54.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.936+0000 7f7593fff700 1 --2- 172.21.15.82:0/4185097037 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f757c09ffe0 0x7f757c0a24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:54.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.936+0000 7f7593fff700 1 --2- 172.21.15.82:0/4185097037 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f757c09ffe0 0x7f757c0a24a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7594101980 tx=0x7f758400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:54.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:54.939+0000 7f75917fa700 1 -- 172.21.15.82:0/4185097037 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f7588051e00 con 0x7f7594101b20 2023-09-23T08:55:55.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.144+0000 7f759a3ff700 1 -- 172.21.15.82:0/4185097037 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f759410c210 con 0x7f7594101b20 2023-09-23T08:55:55.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.144+0000 7f75917fa700 1 -- 172.21.15.82:0/4185097037 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7f75880b6e60 con 0x7f7594101b20 2023-09-23T08:55:55.147 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2023-09-23T08:55:55.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.146+0000 7f759a3ff700 1 -- 172.21.15.82:0/4185097037 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f757c09ffe0 msgr2=0x7f757c0a24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:55.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.146+0000 7f759a3ff700 1 --2- 172.21.15.82:0/4185097037 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f757c09ffe0 0x7f757c0a24a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7594101980 tx=0x7f758400b410 comp rx=0 tx=0).stop 2023-09-23T08:55:55.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.146+0000 7f759a3ff700 1 -- 172.21.15.82:0/4185097037 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7594101b20 msgr2=0x7f7594072d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:55.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.146+0000 7f759a3ff700 1 --2- 172.21.15.82:0/4185097037 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7594101b20 0x7f7594072d10 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f758800e9a0 tx=0x7f758800ecb0 comp rx=0 tx=0).stop 2023-09-23T08:55:55.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.146+0000 7f759a3ff700 1 -- 172.21.15.82:0/4185097037 shutdown_connections 2023-09-23T08:55:55.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.146+0000 7f759a3ff700 1 --2- 172.21.15.82:0/4185097037 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f757c09ffe0 0x7f757c0a24a0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:55.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.147+0000 7f759a3ff700 1 --2- 172.21.15.82:0/4185097037 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f75941024c0 0x7f7594073250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:55.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.147+0000 7f759a3ff700 1 --2- 172.21.15.82:0/4185097037 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7594100930 0x7f75940746d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:55.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.147+0000 7f759a3ff700 1 --2- 172.21.15.82:0/4185097037 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7594101b20 0x7f7594072d10 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:55.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.147+0000 7f759a3ff700 1 -- 172.21.15.82:0/4185097037 >> 172.21.15.82:0/4185097037 conn(0x7f75940fbea0 msgr2=0x7f7594105050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:55.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.147+0000 7f759a3ff700 1 -- 172.21.15.82:0/4185097037 shutdown_connections 2023-09-23T08:55:55.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.147+0000 7f759a3ff700 1 -- 172.21.15.82:0/4185097037 wait complete. 2023-09-23T08:55:55.168 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-23T08:55:55.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.366+0000 7f05d7fff700 1 -- 172.21.15.82:0/2833969170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05d0101af0 msgr2=0x7f05d0103f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:55.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.366+0000 7f05d7fff700 1 --2- 172.21.15.82:0/2833969170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05d0101af0 0x7f05d0103f80 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f05c0009990 tx=0x7f05c0009ca0 comp rx=0 tx=0).stop 2023-09-23T08:55:55.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.367+0000 7f05d7fff700 1 -- 172.21.15.82:0/2833969170 shutdown_connections 2023-09-23T08:55:55.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.367+0000 7f05d7fff700 1 --2- 172.21.15.82:0/2833969170 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05d01044c0 0x7f05d0104940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:55.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.367+0000 7f05d7fff700 1 --2- 172.21.15.82:0/2833969170 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05d00ff180 0x7f05d01015b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:55.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.367+0000 7f05d7fff700 1 --2- 172.21.15.82:0/2833969170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05d0101af0 0x7f05d0103f80 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:55.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.367+0000 7f05d7fff700 1 -- 172.21.15.82:0/2833969170 >> 172.21.15.82:0/2833969170 conn(0x7f05d00fad80 msgr2=0x7f05d00fd1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:55.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.367+0000 7f05d7fff700 1 -- 172.21.15.82:0/2833969170 shutdown_connections 2023-09-23T08:55:55.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.367+0000 7f05d7fff700 1 -- 172.21.15.82:0/2833969170 wait complete. 2023-09-23T08:55:55.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.368+0000 7f05d7fff700 1 Processor -- start 2023-09-23T08:55:55.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.368+0000 7f05d7fff700 1 -- start start 2023-09-23T08:55:55.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.368+0000 7f05d7fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05d00ff180 0x7f05d019cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:55.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.368+0000 7f05d7fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05d0101af0 0x7f05d019d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:55.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.368+0000 7f05d7fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05d01044c0 0x7f05d01a4130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:55.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.368+0000 7f05d7fff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d01a4700 con 0x7f05d00ff180 2023-09-23T08:55:55.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.368+0000 7f05d7fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d01a4840 con 0x7f05d01044c0 2023-09-23T08:55:55.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.368+0000 7f05d7fff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d01a49d0 con 0x7f05d0101af0 2023-09-23T08:55:55.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.369+0000 7f05d5d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05d00ff180 0x7f05d019cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:55.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.369+0000 7f05d5d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05d00ff180 0x7f05d019cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54466/0 (socket says 172.21.15.82:54466) 2023-09-23T08:55:55.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.369+0000 7f05d559a700 1 --2- 172.21.15.82:0/451328874 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05d0101af0 0x7f05d019d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:55.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.369+0000 7f05d5d9b700 1 -- 172.21.15.82:0/451328874 learned_addr learned my addr 172.21.15.82:0/451328874 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:55:55.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.369+0000 7f05d659c700 1 --2- 172.21.15.82:0/451328874 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05d01044c0 0x7f05d01a4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:55.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.369+0000 7f05d5d9b700 1 -- 172.21.15.82:0/451328874 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05d0101af0 msgr2=0x7f05d019d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:55.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.369+0000 7f05d5d9b700 1 --2- 172.21.15.82:0/451328874 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05d0101af0 0x7f05d019d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:55.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.369+0000 7f05d5d9b700 1 -- 172.21.15.82:0/451328874 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05d01044c0 msgr2=0x7f05d01a4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:55.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.369+0000 7f05d5d9b700 1 --2- 172.21.15.82:0/451328874 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05d01044c0 0x7f05d01a4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:55.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.369+0000 7f05d5d9b700 1 -- 172.21.15.82:0/451328874 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05c00095f0 con 0x7f05d00ff180 2023-09-23T08:55:55.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.369+0000 7f05d559a700 1 --2- 172.21.15.82:0/451328874 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05d0101af0 0x7f05d019d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T08:55:55.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.369+0000 7f05d659c700 1 --2- 172.21.15.82:0/451328874 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05d01044c0 0x7f05d01a4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T08:55:55.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.369+0000 7f05d5d9b700 1 --2- 172.21.15.82:0/451328874 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05d00ff180 0x7f05d019cb80 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f05cc00d950 tx=0x7f05cc00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:55.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.370+0000 7f05c6ffd700 1 -- 172.21.15.82:0/451328874 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05cc00f890 con 0x7f05d00ff180 2023-09-23T08:55:55.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.370+0000 7f05c6ffd700 1 -- 172.21.15.82:0/451328874 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f05cc00fe80 con 0x7f05d00ff180 2023-09-23T08:55:55.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.370+0000 7f05c6ffd700 1 -- 172.21.15.82:0/451328874 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05cc00e3b0 con 0x7f05d00ff180 2023-09-23T08:55:55.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.370+0000 7f05d7fff700 1 -- 172.21.15.82:0/451328874 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05d01a4cb0 con 0x7f05d00ff180 2023-09-23T08:55:55.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.370+0000 7f05d7fff700 1 -- 172.21.15.82:0/451328874 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05d01a5170 con 0x7f05d00ff180 2023-09-23T08:55:55.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.371+0000 7f05d7fff700 1 -- 172.21.15.82:0/451328874 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05d00fc900 con 0x7f05d00ff180 2023-09-23T08:55:55.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.373+0000 7f05c6ffd700 1 -- 172.21.15.82:0/451328874 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) v1 ==== 134722+0+0 (secure 0 0 0) 0x7f05cc010460 con 0x7f05d00ff180 2023-09-23T08:55:55.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.374+0000 7f05c6ffd700 1 --2- 172.21.15.82:0/451328874 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f05bc09ffe0 0x7f05bc0a24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:55.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.374+0000 7f05c6ffd700 1 -- 172.21.15.82:0/451328874 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f05cc0cb190 con 0x7f05d00ff180 2023-09-23T08:55:55.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.375+0000 7f05d559a700 1 --2- 172.21.15.82:0/451328874 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f05bc09ffe0 0x7f05bc0a24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:55.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.375+0000 7f05d559a700 1 --2- 172.21.15.82:0/451328874 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f05bc09ffe0 0x7f05bc0a24a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f05c0006010 tx=0x7f05c000b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:55.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.382+0000 7f05c6ffd700 1 -- 172.21.15.82:0/451328874 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f05cc094d70 con 0x7f05d00ff180 2023-09-23T08:55:55.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.595+0000 7f05d7fff700 1 -- 172.21.15.82:0/451328874 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f05d0112870 con 0x7f05d00ff180 2023-09-23T08:55:55.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.595+0000 7f05c6ffd700 1 -- 172.21.15.82:0/451328874 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7f05cc098390 con 0x7f05d00ff180 2023-09-23T08:55:55.598 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2023-09-23T08:55:55.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.598+0000 7f05d7fff700 1 -- 172.21.15.82:0/451328874 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f05bc09ffe0 msgr2=0x7f05bc0a24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:55.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.598+0000 7f05d7fff700 1 --2- 172.21.15.82:0/451328874 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f05bc09ffe0 0x7f05bc0a24a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f05c0006010 tx=0x7f05c000b260 comp rx=0 tx=0).stop 2023-09-23T08:55:55.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.598+0000 7f05d7fff700 1 -- 172.21.15.82:0/451328874 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05d00ff180 msgr2=0x7f05d019cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:55.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.598+0000 7f05d7fff700 1 --2- 172.21.15.82:0/451328874 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05d00ff180 0x7f05d019cb80 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f05cc00d950 tx=0x7f05cc00dc60 comp rx=0 tx=0).stop 2023-09-23T08:55:55.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.598+0000 7f05d7fff700 1 -- 172.21.15.82:0/451328874 shutdown_connections 2023-09-23T08:55:55.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.598+0000 7f05d7fff700 1 --2- 172.21.15.82:0/451328874 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f05bc09ffe0 0x7f05bc0a24a0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:55.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.598+0000 7f05d7fff700 1 --2- 172.21.15.82:0/451328874 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05d01044c0 0x7f05d01a4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:55.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.598+0000 7f05d7fff700 1 --2- 172.21.15.82:0/451328874 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05d00ff180 0x7f05d019cb80 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:55.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.598+0000 7f05d7fff700 1 --2- 172.21.15.82:0/451328874 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05d0101af0 0x7f05d019d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:55.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.598+0000 7f05d7fff700 1 -- 172.21.15.82:0/451328874 >> 172.21.15.82:0/451328874 conn(0x7f05d00fad80 msgr2=0x7f05d00ffe30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:55.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.598+0000 7f05d7fff700 1 -- 172.21.15.82:0/451328874 shutdown_connections 2023-09-23T08:55:55.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.598+0000 7f05d7fff700 1 -- 172.21.15.82:0/451328874 wait complete. 2023-09-23T08:55:55.620 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-23T08:55:55.690 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:55 smithi082 ceph-mon[97694]: pgmap v334: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2023-09-23T08:55:55.691 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:55 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/535356299' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-23T08:55:55.691 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:55 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/4185097037' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-09-23T08:55:55.691 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:55 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:55:55.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:55 smithi135 ceph-mon[99205]: pgmap v334: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2023-09-23T08:55:55.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:55 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/535356299' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-23T08:55:55.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:55 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/4185097037' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-09-23T08:55:55.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:55 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:55:55.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.828+0000 7f02335ff700 1 -- 172.21.15.82:0/2842637572 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f022c073380 msgr2=0x7f022c073800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:55.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.828+0000 7f02335ff700 1 --2- 172.21.15.82:0/2842637572 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f022c073380 0x7f022c073800 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f021c009990 tx=0x7f021c009ca0 comp rx=0 tx=0).stop 2023-09-23T08:55:55.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.828+0000 7f02335ff700 1 -- 172.21.15.82:0/2842637572 shutdown_connections 2023-09-23T08:55:55.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.828+0000 7f02335ff700 1 --2- 172.21.15.82:0/2842637572 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f022c10cef0 0x7f022c10f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:55.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.828+0000 7f02335ff700 1 --2- 172.21.15.82:0/2842637572 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f022c074960 0x7f022c072db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:55.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.828+0000 7f02335ff700 1 --2- 172.21.15.82:0/2842637572 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f022c073380 0x7f022c073800 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:55.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.828+0000 7f02335ff700 1 -- 172.21.15.82:0/2842637572 >> 172.21.15.82:0/2842637572 conn(0x7f022c0fbe50 msgr2=0x7f022c0fe2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:55.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.829+0000 7f02335ff700 1 -- 172.21.15.82:0/2842637572 shutdown_connections 2023-09-23T08:55:55.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.829+0000 7f02335ff700 1 -- 172.21.15.82:0/2842637572 wait complete. 2023-09-23T08:55:55.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.830+0000 7f02335ff700 1 Processor -- start 2023-09-23T08:55:55.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.830+0000 7f02335ff700 1 -- start start 2023-09-23T08:55:55.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.830+0000 7f02335ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f022c073380 0x7f022c19cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:55.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.830+0000 7f02335ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f022c074960 0x7f022c19d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:55.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.830+0000 7f02335ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f022c10cef0 0x7f022c1a4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:55.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.830+0000 7f02335ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f022c1a46f0 con 0x7f022c073380 2023-09-23T08:55:55.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.830+0000 7f02335ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f022c1a4830 con 0x7f022c074960 2023-09-23T08:55:55.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.830+0000 7f02335ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f022c1a49c0 con 0x7f022c10cef0 2023-09-23T08:55:55.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.830+0000 7f023139b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f022c073380 0x7f022c19cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:55.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.830+0000 7f023139b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f022c073380 0x7f022c19cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54492/0 (socket says 172.21.15.82:54492) 2023-09-23T08:55:55.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.830+0000 7f0230b9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f022c074960 0x7f022c19d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:55.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.830+0000 7f023139b700 1 -- 172.21.15.82:0/2151505577 learned_addr learned my addr 172.21.15.82:0/2151505577 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:55:55.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.830+0000 7f0231b9c700 1 --2- 172.21.15.82:0/2151505577 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f022c10cef0 0x7f022c1a4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:55.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.831+0000 7f0231b9c700 1 -- 172.21.15.82:0/2151505577 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f022c074960 msgr2=0x7f022c19d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:55.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.831+0000 7f0231b9c700 1 --2- 172.21.15.82:0/2151505577 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f022c074960 0x7f022c19d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:55.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.831+0000 7f0231b9c700 1 -- 172.21.15.82:0/2151505577 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f022c073380 msgr2=0x7f022c19cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:55.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.831+0000 7f0231b9c700 1 --2- 172.21.15.82:0/2151505577 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f022c073380 0x7f022c19cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:55.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.831+0000 7f0231b9c700 1 -- 172.21.15.82:0/2151505577 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0224009c40 con 0x7f022c10cef0 2023-09-23T08:55:55.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.831+0000 7f023139b700 1 --2- 172.21.15.82:0/2151505577 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f022c073380 0x7f022c19cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T08:55:55.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.831+0000 7f0231b9c700 1 --2- 172.21.15.82:0/2151505577 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f022c10cef0 0x7f022c1a4120 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f022400efb0 tx=0x7f022400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:55.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.831+0000 7f02227fc700 1 -- 172.21.15.82:0/2151505577 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0224003a00 con 0x7f022c10cef0 2023-09-23T08:55:55.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.831+0000 7f02335ff700 1 -- 172.21.15.82:0/2151505577 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f021c0095f0 con 0x7f022c10cef0 2023-09-23T08:55:55.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.831+0000 7f02227fc700 1 -- 172.21.15.82:0/2151505577 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f022400f040 con 0x7f022c10cef0 2023-09-23T08:55:55.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.831+0000 7f02227fc700 1 -- 172.21.15.82:0/2151505577 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02240044d0 con 0x7f022c10cef0 2023-09-23T08:55:55.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.831+0000 7f02335ff700 1 -- 172.21.15.82:0/2151505577 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f022c1a5020 con 0x7f022c10cef0 2023-09-23T08:55:55.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.832+0000 7f02335ff700 1 -- 172.21.15.82:0/2151505577 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f022c102a40 con 0x7f022c10cef0 2023-09-23T08:55:55.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.834+0000 7f02227fc700 1 -- 172.21.15.82:0/2151505577 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 17) v1 ==== 134722+0+0 (secure 0 0 0) 0x7f022400cbc0 con 0x7f022c10cef0 2023-09-23T08:55:55.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.836+0000 7f02227fc700 1 --2- 172.21.15.82:0/2151505577 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f02180a00a0 0x7f02180a2560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:55.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.836+0000 7f02227fc700 1 -- 172.21.15.82:0/2151505577 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f02240cafe0 con 0x7f022c10cef0 2023-09-23T08:55:55.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.836+0000 7f023139b700 1 --2- 172.21.15.82:0/2151505577 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f02180a00a0 0x7f02180a2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:55.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.837+0000 7f023139b700 1 --2- 172.21.15.82:0/2151505577 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f02180a00a0 0x7f02180a2560 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f0228011550 tx=0x7f0228009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:55.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:55.838+0000 7f02227fc700 1 -- 172.21.15.82:0/2151505577 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f0224094c50 con 0x7f022c10cef0 2023-09-23T08:55:55.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:55 smithi161 ceph-mon[99580]: pgmap v334: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2023-09-23T08:55:55.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:55 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/535356299' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-23T08:55:55.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:55 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/4185097037' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-09-23T08:55:55.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:55 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:55:56.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.107+0000 7f02335ff700 1 -- 172.21.15.82:0/2151505577 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f022c112610 con 0x7f022c10cef0 2023-09-23T08:55:56.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.108+0000 7f02227fc700 1 -- 172.21.15.82:0/2151505577 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+11323 (secure 0 0 0) 0x7f0224098270 con 0x7f022c10cef0 2023-09-23T08:55:56.110 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:55:56.111 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/1237857359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1237857359},{"type":"v1","addr":"172.21.15.82:6835","nonce":1237857359}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/1335102362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":1335102362},{"type":"v1","addr":"172.21.15.82:6837","nonce":1335102362}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-23T08:54:52.600479+0000","modified":"2023-09-23T08:55:00.481507+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24557,"mds_1":24550,"mds_2":24526,"mds_3":24515,"mds_4":24514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/3645331700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3645331700},{"type":"v1","addr":"172.21.15.135:6835","nonce":3645331700}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14658":{"gid":14658,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6839/205725278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":205725278},{"type":"v1","addr":"172.21.15.82:6839","nonce":205725278}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14670":{"gid":14670,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6841/2659297867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":2659297867},{"type":"v1","addr":"172.21.15.82:6841","nonce":2659297867}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24461":{"gid":24461,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/503886037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":503886037},{"type":"v1","addr":"172.21.15.135:6833","nonce":503886037}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24463":{"gid":24463,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.161:6833/471569125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":471569125},{"type":"v1","addr":"172.21.15.161:6833","nonce":471569125}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24514":{"gid":24514,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":10,"addr":"172.21.15.161:6835/2237964162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":2237964162},{"type":"v1","addr":"172.21.15.161:6835","nonce":2237964162}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24515":{"gid":24515,"name":"h","rank":3,"incarnation":22,"state":"up:active","state_seq":8,"addr":"172.21.15.135:6837/2655304858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2655304858},{"type":"v1","addr":"172.21.15.135:6837","nonce":2655304858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24526":{"gid":24526,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.161:6837/43639843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":43639843},{"type":"v1","addr":"172.21.15.161:6837","nonce":43639843}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24550":{"gid":24550,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.161:6839/758982817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6838","nonce":758982817},{"type":"v1","addr":"172.21.15.161:6839","nonce":758982817}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24557":{"gid":24557,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6839/2508669274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2508669274},{"type":"v1","addr":"172.21.15.135:6839","nonce":2508669274}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-23T08:55:56.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.110+0000 7f02335ff700 1 -- 172.21.15.82:0/2151505577 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f02180a00a0 msgr2=0x7f02180a2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:56.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.110+0000 7f02335ff700 1 --2- 172.21.15.82:0/2151505577 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f02180a00a0 0x7f02180a2560 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f0228011550 tx=0x7f0228009260 comp rx=0 tx=0).stop 2023-09-23T08:55:56.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.110+0000 7f02335ff700 1 -- 172.21.15.82:0/2151505577 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f022c10cef0 msgr2=0x7f022c1a4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:56.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.110+0000 7f02335ff700 1 --2- 172.21.15.82:0/2151505577 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f022c10cef0 0x7f022c1a4120 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f022400efb0 tx=0x7f022400c3a0 comp rx=0 tx=0).stop 2023-09-23T08:55:56.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.110+0000 7f02335ff700 1 -- 172.21.15.82:0/2151505577 shutdown_connections 2023-09-23T08:55:56.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.110+0000 7f02335ff700 1 --2- 172.21.15.82:0/2151505577 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f02180a00a0 0x7f02180a2560 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:56.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.110+0000 7f02335ff700 1 --2- 172.21.15.82:0/2151505577 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f022c10cef0 0x7f022c1a4120 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:56.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.110+0000 7f02335ff700 1 --2- 172.21.15.82:0/2151505577 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f022c073380 0x7f022c19cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:56.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.110+0000 7f02335ff700 1 --2- 172.21.15.82:0/2151505577 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f022c074960 0x7f022c19d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:56.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.110+0000 7f02335ff700 1 -- 172.21.15.82:0/2151505577 >> 172.21.15.82:0/2151505577 conn(0x7f022c0fbe50 msgr2=0x7f022c0fe240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:56.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.110+0000 7f02335ff700 1 -- 172.21.15.82:0/2151505577 shutdown_connections 2023-09-23T08:55:56.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.111+0000 7f02335ff700 1 -- 172.21.15.82:0/2151505577 wait complete. 2023-09-23T08:55:56.115 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 26 2023-09-23T08:55:56.132 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-23T08:55:56.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.349+0000 7fdd72dff700 1 -- 172.21.15.82:0/3482894863 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd6c073380 msgr2=0x7fdd6c073800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:56.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.349+0000 7fdd72dff700 1 --2- 172.21.15.82:0/3482894863 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd6c073380 0x7fdd6c073800 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fdd58009990 tx=0x7fdd58009ca0 comp rx=0 tx=0).stop 2023-09-23T08:55:56.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.349+0000 7fdd72dff700 1 -- 172.21.15.82:0/3482894863 shutdown_connections 2023-09-23T08:55:56.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.349+0000 7fdd72dff700 1 --2- 172.21.15.82:0/3482894863 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd6c1087f0 0x7fdd6c10ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:56.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.349+0000 7fdd72dff700 1 --2- 172.21.15.82:0/3482894863 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd6c074960 0x7fdd6c072db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:56.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.349+0000 7fdd72dff700 1 --2- 172.21.15.82:0/3482894863 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd6c073380 0x7fdd6c073800 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:56.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.349+0000 7fdd72dff700 1 -- 172.21.15.82:0/3482894863 >> 172.21.15.82:0/3482894863 conn(0x7fdd6c0fbe60 msgr2=0x7fdd6c0fe2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:56.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.349+0000 7fdd72dff700 1 -- 172.21.15.82:0/3482894863 shutdown_connections 2023-09-23T08:55:56.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.349+0000 7fdd72dff700 1 -- 172.21.15.82:0/3482894863 wait complete. 2023-09-23T08:55:56.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.350+0000 7fdd72dff700 1 Processor -- start 2023-09-23T08:55:56.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.350+0000 7fdd72dff700 1 -- start start 2023-09-23T08:55:56.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.350+0000 7fdd72dff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd6c073380 0x7fdd6c198750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:56.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.350+0000 7fdd72dff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd6c074960 0x7fdd6c198c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:56.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.350+0000 7fdd72dff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd6c1087f0 0x7fdd6c19fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:56.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.350+0000 7fdd72dff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd6c1a02d0 con 0x7fdd6c073380 2023-09-23T08:55:56.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.350+0000 7fdd72dff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd6c1a0410 con 0x7fdd6c1087f0 2023-09-23T08:55:56.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.350+0000 7fdd72dff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd6c1a05a0 con 0x7fdd6c074960 2023-09-23T08:55:56.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.351+0000 7fdd70b9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd6c073380 0x7fdd6c198750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:56.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.351+0000 7fdd70b9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd6c073380 0x7fdd6c198750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54510/0 (socket says 172.21.15.82:54510) 2023-09-23T08:55:56.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.351+0000 7fdd70b9b700 1 -- 172.21.15.82:0/3853576254 learned_addr learned my addr 172.21.15.82:0/3853576254 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:55:56.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.351+0000 7fdd6bfff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd6c074960 0x7fdd6c198c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:56.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.351+0000 7fdd7139c700 1 --2- 172.21.15.82:0/3853576254 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd6c1087f0 0x7fdd6c19fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:56.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.351+0000 7fdd70b9b700 1 -- 172.21.15.82:0/3853576254 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd6c074960 msgr2=0x7fdd6c198c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:56.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.351+0000 7fdd70b9b700 1 --2- 172.21.15.82:0/3853576254 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd6c074960 0x7fdd6c198c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:56.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.351+0000 7fdd70b9b700 1 -- 172.21.15.82:0/3853576254 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd6c1087f0 msgr2=0x7fdd6c19fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:56.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.351+0000 7fdd70b9b700 1 --2- 172.21.15.82:0/3853576254 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd6c1087f0 0x7fdd6c19fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:56.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.351+0000 7fdd70b9b700 1 -- 172.21.15.82:0/3853576254 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd580095f0 con 0x7fdd6c073380 2023-09-23T08:55:56.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.351+0000 7fdd7139c700 1 --2- 172.21.15.82:0/3853576254 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd6c1087f0 0x7fdd6c19fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T08:55:56.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.351+0000 7fdd70b9b700 1 --2- 172.21.15.82:0/3853576254 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd6c073380 0x7fdd6c198750 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fdd6000d950 tx=0x7fdd6000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:56.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.351+0000 7fdd69ffb700 1 -- 172.21.15.82:0/3853576254 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd60009940 con 0x7fdd6c073380 2023-09-23T08:55:56.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.351+0000 7fdd69ffb700 1 -- 172.21.15.82:0/3853576254 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdd60010460 con 0x7fdd6c073380 2023-09-23T08:55:56.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.351+0000 7fdd72dff700 1 -- 172.21.15.82:0/3853576254 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd6c1a0880 con 0x7fdd6c073380 2023-09-23T08:55:56.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.352+0000 7fdd69ffb700 1 -- 172.21.15.82:0/3853576254 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd6000f620 con 0x7fdd6c073380 2023-09-23T08:55:56.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.352+0000 7fdd72dff700 1 -- 172.21.15.82:0/3853576254 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd6c1a0d90 con 0x7fdd6c073380 2023-09-23T08:55:56.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.353+0000 7fdd72dff700 1 -- 172.21.15.82:0/3853576254 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd6c106ea0 con 0x7fdd6c073380 2023-09-23T08:55:56.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.354+0000 7fdd69ffb700 1 -- 172.21.15.82:0/3853576254 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) v1 ==== 134722+0+0 (secure 0 0 0) 0x7fdd600105d0 con 0x7fdd6c073380 2023-09-23T08:55:56.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.356+0000 7fdd69ffb700 1 --2- 172.21.15.82:0/3853576254 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fdd5c0a00a0 0x7fdd5c0a2560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:56.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.356+0000 7fdd69ffb700 1 -- 172.21.15.82:0/3853576254 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fdd600cb250 con 0x7fdd6c073380 2023-09-23T08:55:56.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.356+0000 7fdd6bfff700 1 --2- 172.21.15.82:0/3853576254 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fdd5c0a00a0 0x7fdd5c0a2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:56.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.356+0000 7fdd6bfff700 1 --2- 172.21.15.82:0/3853576254 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fdd5c0a00a0 0x7fdd5c0a2560 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fdd58000c00 tx=0x7fdd5800b560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:56.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.359+0000 7fdd69ffb700 1 -- 172.21.15.82:0/3853576254 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7fdd60094e30 con 0x7fdd6c073380 2023-09-23T08:55:56.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.572+0000 7fdd72dff700 1 -- 172.21.15.82:0/3853576254 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdd6c10e4a0 con 0x7fdd6c073380 2023-09-23T08:55:56.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.574+0000 7fdd69ffb700 1 -- 172.21.15.82:0/3853576254 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+22508 (secure 0 0 0) 0x7fdd60098450 con 0x7fdd6c073380 2023-09-23T08:55:56.576 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:55:56.577 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":88,"fsid":"8926e286-59ed-11ee-8db4-212e2dc638e7","created":"2023-09-23T08:46:16.628057+0000","modified":"2023-09-23T08:55:23.423278+0000","last_up_change":"2023-09-23T08:53:56.524694+0000","last_in_change":"2023-09-23T08:53:35.779183+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-23T08:50:00.571063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-23T08:54:50.558630+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-23T08:54:52.055291+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7384c1ff-8c71-4feb-8cef-ba45c2a1708a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":892441948},{"type":"v1","addr":"172.21.15.82:6803","nonce":892441948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":892441948},{"type":"v1","addr":"172.21.15.82:6805","nonce":892441948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":892441948},{"type":"v1","addr":"172.21.15.82:6809","nonce":892441948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":892441948},{"type":"v1","addr":"172.21.15.82:6807","nonce":892441948}]},"public_addr":"172.21.15.82:6803/892441948","cluster_addr":"172.21.15.82:6805/892441948","heartbeat_back_addr":"172.21.15.82:6809/892441948","heartbeat_front_addr":"172.21.15.82:6807/892441948","state":["exists","up"]},{"osd":1,"uuid":"ca62333e-15db-4556-a9ed-8820f9268766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3224546922},{"type":"v1","addr":"172.21.15.135:6801","nonce":3224546922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3224546922},{"type":"v1","addr":"172.21.15.135:6803","nonce":3224546922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3224546922},{"type":"v1","addr":"172.21.15.135:6807","nonce":3224546922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3224546922},{"type":"v1","addr":"172.21.15.135:6805","nonce":3224546922}]},"public_addr":"172.21.15.135:6801/3224546922","cluster_addr":"172.21.15.135:6803/3224546922","heartbeat_back_addr":"172.21.15.135:6807/3224546922","heartbeat_front_addr":"172.21.15.135:6805/3224546922","state":["exists","up"]},{"osd":2,"uuid":"ac23eb38-216a-44f0-b316-a509b23745f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2358373459},{"type":"v1","addr":"172.21.15.161:6801","nonce":2358373459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2358373459},{"type":"v1","addr":"172.21.15.161:6803","nonce":2358373459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2358373459},{"type":"v1","addr":"172.21.15.161:6807","nonce":2358373459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2358373459},{"type":"v1","addr":"172.21.15.161:6805","nonce":2358373459}]},"public_addr":"172.21.15.161:6801/2358373459","cluster_addr":"172.21.15.161:6803/2358373459","heartbeat_back_addr":"172.21.15.161:6807/2358373459","heartbeat_front_addr":"172.21.15.161:6805/2358373459","state":["exists","up"]},{"osd":3,"uuid":"701c96b0-30fb-46ce-917d-e02d3814dc3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":1081464528},{"type":"v1","addr":"172.21.15.82:6811","nonce":1081464528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1081464528},{"type":"v1","addr":"172.21.15.82:6813","nonce":1081464528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1081464528},{"type":"v1","addr":"172.21.15.82:6817","nonce":1081464528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":1081464528},{"type":"v1","addr":"172.21.15.82:6815","nonce":1081464528}]},"public_addr":"172.21.15.82:6811/1081464528","cluster_addr":"172.21.15.82:6813/1081464528","heartbeat_back_addr":"172.21.15.82:6817/1081464528","heartbeat_front_addr":"172.21.15.82:6815/1081464528","state":["exists","up"]},{"osd":4,"uuid":"c618d2a2-3616-41b2-943c-7a4616538e13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2346495509},{"type":"v1","addr":"172.21.15.135:6809","nonce":2346495509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2346495509},{"type":"v1","addr":"172.21.15.135:6811","nonce":2346495509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2346495509},{"type":"v1","addr":"172.21.15.135:6815","nonce":2346495509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2346495509},{"type":"v1","addr":"172.21.15.135:6813","nonce":2346495509}]},"public_addr":"172.21.15.135:6809/2346495509","cluster_addr":"172.21.15.135:6811/2346495509","heartbeat_back_addr":"172.21.15.135:6815/2346495509","heartbeat_front_addr":"172.21.15.135:6813/2346495509","state":["exists","up"]},{"osd":5,"uuid":"8e1dda3d-6927-495d-b20d-78b03bb75d5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1252638628},{"type":"v1","addr":"172.21.15.161:6809","nonce":1252638628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1252638628},{"type":"v1","addr":"172.21.15.161:6811","nonce":1252638628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1252638628},{"type":"v1","addr":"172.21.15.161:6815","nonce":1252638628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1252638628},{"type":"v1","addr":"172.21.15.161:6813","nonce":1252638628}]},"public_addr":"172.21.15.161:6809/1252638628","cluster_addr":"172.21.15.161:6811/1252638628","heartbeat_back_addr":"172.21.15.161:6815/1252638628","heartbeat_front_addr":"172.21.15.161:6813/1252638628","state":["exists","up"]},{"osd":6,"uuid":"50b31960-6bc4-44e1-8116-3106bf161e56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1052038408},{"type":"v1","addr":"172.21.15.82:6819","nonce":1052038408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1052038408},{"type":"v1","addr":"172.21.15.82:6821","nonce":1052038408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":1052038408},{"type":"v1","addr":"172.21.15.82:6825","nonce":1052038408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1052038408},{"type":"v1","addr":"172.21.15.82:6823","nonce":1052038408}]},"public_addr":"172.21.15.82:6819/1052038408","cluster_addr":"172.21.15.82:6821/1052038408","heartbeat_back_addr":"172.21.15.82:6825/1052038408","heartbeat_front_addr":"172.21.15.82:6823/1052038408","state":["exists","up"]},{"osd":7,"uuid":"425ca0ee-57f7-4b27-90fb-d86bb5db5480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3683951498},{"type":"v1","addr":"172.21.15.135:6817","nonce":3683951498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":3683951498},{"type":"v1","addr":"172.21.15.135:6819","nonce":3683951498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":3683951498},{"type":"v1","addr":"172.21.15.135:6823","nonce":3683951498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":3683951498},{"type":"v1","addr":"172.21.15.135:6821","nonce":3683951498}]},"public_addr":"172.21.15.135:6817/3683951498","cluster_addr":"172.21.15.135:6819/3683951498","heartbeat_back_addr":"172.21.15.135:6823/3683951498","heartbeat_front_addr":"172.21.15.135:6821/3683951498","state":["exists","up"]},{"osd":8,"uuid":"1115c837-bef6-4bad-9974-4d913198511b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":948521536},{"type":"v1","addr":"172.21.15.161:6817","nonce":948521536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":948521536},{"type":"v1","addr":"172.21.15.161:6819","nonce":948521536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":948521536},{"type":"v1","addr":"172.21.15.161:6823","nonce":948521536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":948521536},{"type":"v1","addr":"172.21.15.161:6821","nonce":948521536}]},"public_addr":"172.21.15.161:6817/948521536","cluster_addr":"172.21.15.161:6819/948521536","heartbeat_back_addr":"172.21.15.161:6823/948521536","heartbeat_front_addr":"172.21.15.161:6821/948521536","state":["exists","up"]},{"osd":9,"uuid":"c52ec819-4bc6-402f-9cd8-62539e519e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":1438762840},{"type":"v1","addr":"172.21.15.82:6827","nonce":1438762840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":1438762840},{"type":"v1","addr":"172.21.15.82:6829","nonce":1438762840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1438762840},{"type":"v1","addr":"172.21.15.82:6833","nonce":1438762840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1438762840},{"type":"v1","addr":"172.21.15.82:6831","nonce":1438762840}]},"public_addr":"172.21.15.82:6827/1438762840","cluster_addr":"172.21.15.82:6829/1438762840","heartbeat_back_addr":"172.21.15.82:6833/1438762840","heartbeat_front_addr":"172.21.15.82:6831/1438762840","state":["exists","up"]},{"osd":10,"uuid":"1b16c795-1b91-4d46-ae5d-21b8332c1077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2853697851},{"type":"v1","addr":"172.21.15.135:6825","nonce":2853697851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2853697851},{"type":"v1","addr":"172.21.15.135:6827","nonce":2853697851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2853697851},{"type":"v1","addr":"172.21.15.135:6831","nonce":2853697851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2853697851},{"type":"v1","addr":"172.21.15.135:6829","nonce":2853697851}]},"public_addr":"172.21.15.135:6825/2853697851","cluster_addr":"172.21.15.135:6827/2853697851","heartbeat_back_addr":"172.21.15.135:6831/2853697851","heartbeat_front_addr":"172.21.15.135:6829/2853697851","state":["exists","up"]},{"osd":11,"uuid":"2551e602-4fe1-41cb-9b7d-c8b31fdd1487","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":1459332081},{"type":"v1","addr":"172.21.15.161:6825","nonce":1459332081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":1459332081},{"type":"v1","addr":"172.21.15.161:6827","nonce":1459332081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":1459332081},{"type":"v1","addr":"172.21.15.161:6831","nonce":1459332081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":1459332081},{"type":"v1","addr":"172.21.15.161:6829","nonce":1459332081}]},"public_addr":"172.21.15.161:6825/1459332081","cluster_addr":"172.21.15.161:6827/1459332081","heartbeat_back_addr":"172.21.15.161:6831/1459332081","heartbeat_front_addr":"172.21.15.161:6829/1459332081","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:49:04.007679+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:49:30.702365+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:49:56.785248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:50:22.988516+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:50:49.347055+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:51:15.830145+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:51:41.986377+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:52:08.218893+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:52:34.847450+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:53:01.317134+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:53:27.981691+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:53:54.849245+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/4204712132":"2023-09-24T08:47:21.957866+0000","172.21.15.82:6801/2733521564":"2023-09-24T08:47:21.957866+0000","172.21.15.82:6800/2733521564":"2023-09-24T08:47:21.957866+0000","172.21.15.82:0/3964794665":"2023-09-24T08:47:21.957866+0000","172.21.15.82:0/3535372205":"2023-09-24T08:46:55.187024+0000","172.21.15.82:0/285559684":"2023-09-24T08:46:55.187024+0000","172.21.15.82:0/1335891896":"2023-09-24T08:46:55.187024+0000","172.21.15.82:6801/3761509623":"2023-09-24T08:46:55.187024+0000","172.21.15.82:6800/3761509623":"2023-09-24T08:46:55.187024+0000","172.21.15.82:0/3775317005":"2023-09-24T08:47:21.957866+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-23T08:55:56.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.576+0000 7fdd72dff700 1 -- 172.21.15.82:0/3853576254 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fdd5c0a00a0 msgr2=0x7fdd5c0a2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:56.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.576+0000 7fdd72dff700 1 --2- 172.21.15.82:0/3853576254 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fdd5c0a00a0 0x7fdd5c0a2560 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fdd58000c00 tx=0x7fdd5800b560 comp rx=0 tx=0).stop 2023-09-23T08:55:56.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.576+0000 7fdd72dff700 1 -- 172.21.15.82:0/3853576254 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd6c073380 msgr2=0x7fdd6c198750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:56.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.576+0000 7fdd72dff700 1 --2- 172.21.15.82:0/3853576254 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd6c073380 0x7fdd6c198750 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fdd6000d950 tx=0x7fdd6000dc60 comp rx=0 tx=0).stop 2023-09-23T08:55:56.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.576+0000 7fdd72dff700 1 -- 172.21.15.82:0/3853576254 shutdown_connections 2023-09-23T08:55:56.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.576+0000 7fdd72dff700 1 --2- 172.21.15.82:0/3853576254 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fdd5c0a00a0 0x7fdd5c0a2560 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:56.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.576+0000 7fdd72dff700 1 --2- 172.21.15.82:0/3853576254 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd6c1087f0 0x7fdd6c19fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:56.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.576+0000 7fdd72dff700 1 --2- 172.21.15.82:0/3853576254 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd6c073380 0x7fdd6c198750 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:56.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.576+0000 7fdd72dff700 1 --2- 172.21.15.82:0/3853576254 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd6c074960 0x7fdd6c198c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:56.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.576+0000 7fdd72dff700 1 -- 172.21.15.82:0/3853576254 >> 172.21.15.82:0/3853576254 conn(0x7fdd6c0fbe60 msgr2=0x7fdd6c0fe250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:56.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.577+0000 7fdd72dff700 1 -- 172.21.15.82:0/3853576254 shutdown_connections 2023-09-23T08:55:56.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.577+0000 7fdd72dff700 1 -- 172.21.15.82:0/3853576254 wait complete. 2023-09-23T08:55:56.600 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-23T08:50:00.571063+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-23T08:54:50.558630+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-23T08:54:52.055291+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-23T08:55:56.601 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-23T08:55:56.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.804+0000 7fc1865ff700 1 -- 172.21.15.82:0/2555091127 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc180074960 msgr2=0x7fc180072db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:56.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.804+0000 7fc1865ff700 1 --2- 172.21.15.82:0/2555091127 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc180074960 0x7fc180072db0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc170009990 tx=0x7fc170009ca0 comp rx=0 tx=0).stop 2023-09-23T08:55:56.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.804+0000 7fc1865ff700 1 -- 172.21.15.82:0/2555091127 shutdown_connections 2023-09-23T08:55:56.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.804+0000 7fc1865ff700 1 --2- 172.21.15.82:0/2555091127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1801087f0 0x7fc18010ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:56.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.804+0000 7fc1865ff700 1 --2- 172.21.15.82:0/2555091127 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc180074960 0x7fc180072db0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:56.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.804+0000 7fc1865ff700 1 --2- 172.21.15.82:0/2555091127 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc180073380 0x7fc180073800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:56.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.804+0000 7fc1865ff700 1 -- 172.21.15.82:0/2555091127 >> 172.21.15.82:0/2555091127 conn(0x7fc1800fbea0 msgr2=0x7fc1800fe2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:56.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.804+0000 7fc1865ff700 1 -- 172.21.15.82:0/2555091127 shutdown_connections 2023-09-23T08:55:56.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.804+0000 7fc1865ff700 1 -- 172.21.15.82:0/2555091127 wait complete. 2023-09-23T08:55:56.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.805+0000 7fc1865ff700 1 Processor -- start 2023-09-23T08:55:56.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.806+0000 7fc1865ff700 1 -- start start 2023-09-23T08:55:56.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.806+0000 7fc1865ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc180073380 0x7fc180198720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:56.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.806+0000 7fc1865ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc180074960 0x7fc180198c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:56.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.806+0000 7fc1865ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1801087f0 0x7fc18019fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:56.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.806+0000 7fc1865ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1801a02a0 con 0x7fc1801087f0 2023-09-23T08:55:56.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.806+0000 7fc1865ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1801a03e0 con 0x7fc180074960 2023-09-23T08:55:56.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.806+0000 7fc1865ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1801a0570 con 0x7fc180073380 2023-09-23T08:55:56.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.806+0000 7fc17ffff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc180073380 0x7fc180198720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:56.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.806+0000 7fc17f7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc180074960 0x7fc180198c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:56.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.806+0000 7fc17ffff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc180073380 0x7fc180198720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:42084/0 (socket says 172.21.15.82:42084) 2023-09-23T08:55:56.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.806+0000 7fc17ffff700 1 -- 172.21.15.82:0/4172232212 learned_addr learned my addr 172.21.15.82:0/4172232212 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:55:56.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.806+0000 7fc184b9c700 1 --2- 172.21.15.82:0/4172232212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1801087f0 0x7fc18019fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:56.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.807+0000 7fc17ffff700 1 -- 172.21.15.82:0/4172232212 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc180074960 msgr2=0x7fc180198c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:56.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.807+0000 7fc17ffff700 1 --2- 172.21.15.82:0/4172232212 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc180074960 0x7fc180198c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:56.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.807+0000 7fc17ffff700 1 -- 172.21.15.82:0/4172232212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1801087f0 msgr2=0x7fc18019fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:56.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.807+0000 7fc17ffff700 1 --2- 172.21.15.82:0/4172232212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1801087f0 0x7fc18019fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:56.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.807+0000 7fc17ffff700 1 -- 172.21.15.82:0/4172232212 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1700095f0 con 0x7fc180073380 2023-09-23T08:55:56.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.807+0000 7fc17f7fe700 1 --2- 172.21.15.82:0/4172232212 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc180074960 0x7fc180198c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T08:55:56.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.807+0000 7fc184b9c700 1 --2- 172.21.15.82:0/4172232212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1801087f0 0x7fc18019fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T08:55:56.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.807+0000 7fc17ffff700 1 --2- 172.21.15.82:0/4172232212 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc180073380 0x7fc180198720 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc1700059d0 tx=0x7fc1700047b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:56.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.807+0000 7fc17d7fa700 1 -- 172.21.15.82:0/4172232212 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc17001d070 con 0x7fc180073380 2023-09-23T08:55:56.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.807+0000 7fc1865ff700 1 -- 172.21.15.82:0/4172232212 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1801a07f0 con 0x7fc180073380 2023-09-23T08:55:56.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.807+0000 7fc17d7fa700 1 -- 172.21.15.82:0/4172232212 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc17000bdb0 con 0x7fc180073380 2023-09-23T08:55:56.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.807+0000 7fc17d7fa700 1 -- 172.21.15.82:0/4172232212 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc17000fd90 con 0x7fc180073380 2023-09-23T08:55:56.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.807+0000 7fc1865ff700 1 -- 172.21.15.82:0/4172232212 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1801a0ca0 con 0x7fc180073380 2023-09-23T08:55:56.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:56 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/451328874' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-09-23T08:55:56.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:56 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/2151505577' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T08:55:56.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.808+0000 7fc1865ff700 1 -- 172.21.15.82:0/4172232212 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc180106ea0 con 0x7fc180073380 2023-09-23T08:55:56.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.810+0000 7fc17d7fa700 1 -- 172.21.15.82:0/4172232212 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 17) v1 ==== 134722+0+0 (secure 0 0 0) 0x7fc17000f560 con 0x7fc180073380 2023-09-23T08:55:56.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.812+0000 7fc17d7fa700 1 --2- 172.21.15.82:0/4172232212 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fc16809ffe0 0x7fc1680a24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:56.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.812+0000 7fc17d7fa700 1 -- 172.21.15.82:0/4172232212 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fc1700cc780 con 0x7fc180073380 2023-09-23T08:55:56.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.812+0000 7fc17f7fe700 1 --2- 172.21.15.82:0/4172232212 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fc16809ffe0 0x7fc1680a24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:56.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.813+0000 7fc17f7fe700 1 --2- 172.21.15.82:0/4172232212 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fc16809ffe0 0x7fc1680a24a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc180074680 tx=0x7fc174009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:56.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:56.814+0000 7fc17d7fa700 1 -- 172.21.15.82:0/4172232212 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7fc1700963f0 con 0x7fc180073380 2023-09-23T08:55:56.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:56 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/451328874' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-09-23T08:55:56.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:56 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/2151505577' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T08:55:56.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:56 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/451328874' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-09-23T08:55:56.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:56 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/2151505577' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T08:55:57.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.041+0000 7fc1865ff700 1 -- 172.21.15.82:0/4172232212 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc18010e360 con 0x7fc180073380 2023-09-23T08:55:57.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.041+0000 7fc17d7fa700 1 -- 172.21.15.82:0/4172232212 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc170026020 con 0x7fc180073380 2023-09-23T08:55:57.044 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-09-23T08:55:57.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.044+0000 7fc1865ff700 1 -- 172.21.15.82:0/4172232212 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fc16809ffe0 msgr2=0x7fc1680a24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:57.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.044+0000 7fc1865ff700 1 --2- 172.21.15.82:0/4172232212 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fc16809ffe0 0x7fc1680a24a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc180074680 tx=0x7fc174009260 comp rx=0 tx=0).stop 2023-09-23T08:55:57.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.044+0000 7fc1865ff700 1 -- 172.21.15.82:0/4172232212 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc180073380 msgr2=0x7fc180198720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:57.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.044+0000 7fc1865ff700 1 --2- 172.21.15.82:0/4172232212 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc180073380 0x7fc180198720 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc1700059d0 tx=0x7fc1700047b0 comp rx=0 tx=0).stop 2023-09-23T08:55:57.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.044+0000 7fc1865ff700 1 -- 172.21.15.82:0/4172232212 shutdown_connections 2023-09-23T08:55:57.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.044+0000 7fc1865ff700 1 --2- 172.21.15.82:0/4172232212 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fc16809ffe0 0x7fc1680a24a0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:57.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.044+0000 7fc1865ff700 1 --2- 172.21.15.82:0/4172232212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1801087f0 0x7fc18019fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:57.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.044+0000 7fc1865ff700 1 --2- 172.21.15.82:0/4172232212 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc180073380 0x7fc180198720 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:57.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.044+0000 7fc1865ff700 1 --2- 172.21.15.82:0/4172232212 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc180074960 0x7fc180198c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:57.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.044+0000 7fc1865ff700 1 -- 172.21.15.82:0/4172232212 >> 172.21.15.82:0/4172232212 conn(0x7fc1800fbea0 msgr2=0x7fc1800fe290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:57.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.044+0000 7fc1865ff700 1 -- 172.21.15.82:0/4172232212 shutdown_connections 2023-09-23T08:55:57.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.044+0000 7fc1865ff700 1 -- 172.21.15.82:0/4172232212 wait complete. 2023-09-23T08:55:57.066 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-23T08:55:57.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.275+0000 7f935d7ff700 1 -- 172.21.15.82:0/624714879 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93581024c0 msgr2=0x7f9358108d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:57.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.275+0000 7f935d7ff700 1 --2- 172.21.15.82:0/624714879 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93581024c0 0x7f9358108d70 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f935000b0d0 tx=0x7f935000b3e0 comp rx=0 tx=0).stop 2023-09-23T08:55:57.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.275+0000 7f935d7ff700 1 -- 172.21.15.82:0/624714879 shutdown_connections 2023-09-23T08:55:57.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.275+0000 7f935d7ff700 1 --2- 172.21.15.82:0/624714879 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93581024c0 0x7f9358108d70 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:57.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.275+0000 7f935d7ff700 1 --2- 172.21.15.82:0/624714879 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9358100930 0x7f9358100d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:57.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.275+0000 7f935d7ff700 1 --2- 172.21.15.82:0/624714879 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9358101b20 0x7f9358101f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:57.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.275+0000 7f935d7ff700 1 -- 172.21.15.82:0/624714879 >> 172.21.15.82:0/624714879 conn(0x7f93580fbea0 msgr2=0x7f93580fe2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:57.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.275+0000 7f935d7ff700 1 -- 172.21.15.82:0/624714879 shutdown_connections 2023-09-23T08:55:57.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.275+0000 7f935d7ff700 1 -- 172.21.15.82:0/624714879 wait complete. 2023-09-23T08:55:57.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.276+0000 7f935d7ff700 1 Processor -- start 2023-09-23T08:55:57.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.277+0000 7f935d7ff700 1 -- start start 2023-09-23T08:55:57.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.277+0000 7f935d7ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9358100930 0x7f9358198830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:57.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.277+0000 7f935d7ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9358101b20 0x7f9358198d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:57.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.277+0000 7f935d7ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f93581024c0 0x7f935819fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:57.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.277+0000 7f935d7ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93581a03b0 con 0x7f9358100930 2023-09-23T08:55:57.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.277+0000 7f935d7ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93581a04f0 con 0x7f9358101b20 2023-09-23T08:55:57.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.277+0000 7f935d7ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93581a0680 con 0x7f93581024c0 2023-09-23T08:55:57.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.277+0000 7f9356ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9358100930 0x7f9358198830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:57.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.277+0000 7f9356ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9358100930 0x7f9358198830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54536/0 (socket says 172.21.15.82:54536) 2023-09-23T08:55:57.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.277+0000 7f9356ffd700 1 -- 172.21.15.82:0/1003313787 learned_addr learned my addr 172.21.15.82:0/1003313787 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:55:57.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.277+0000 7f934ffff700 1 --2- 172.21.15.82:0/1003313787 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9358101b20 0x7f9358198d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:57.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.277+0000 7f93577fe700 1 --2- 172.21.15.82:0/1003313787 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f93581024c0 0x7f935819fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:57.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.277+0000 7f9356ffd700 1 -- 172.21.15.82:0/1003313787 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f93581024c0 msgr2=0x7f935819fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:57.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.277+0000 7f9356ffd700 1 --2- 172.21.15.82:0/1003313787 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f93581024c0 0x7f935819fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:57.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.277+0000 7f9356ffd700 1 -- 172.21.15.82:0/1003313787 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9358101b20 msgr2=0x7f9358198d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:57.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.277+0000 7f9356ffd700 1 --2- 172.21.15.82:0/1003313787 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9358101b20 0x7f9358198d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:57.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.277+0000 7f9356ffd700 1 -- 172.21.15.82:0/1003313787 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9350009d00 con 0x7f9358100930 2023-09-23T08:55:57.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.278+0000 7f9356ffd700 1 --2- 172.21.15.82:0/1003313787 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9358100930 0x7f9358198830 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f934800e970 tx=0x7f934800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:57.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.278+0000 7f9354ff9700 1 -- 172.21.15.82:0/1003313787 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9348009790 con 0x7f9358100930 2023-09-23T08:55:57.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.278+0000 7f9354ff9700 1 -- 172.21.15.82:0/1003313787 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f934800c7e0 con 0x7f9358100930 2023-09-23T08:55:57.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.278+0000 7f935d7ff700 1 -- 172.21.15.82:0/1003313787 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93581a0960 con 0x7f9358100930 2023-09-23T08:55:57.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.278+0000 7f9354ff9700 1 -- 172.21.15.82:0/1003313787 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9348003bd0 con 0x7f9358100930 2023-09-23T08:55:57.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.278+0000 7f935d7ff700 1 -- 172.21.15.82:0/1003313787 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93581a0e70 con 0x7f9358100930 2023-09-23T08:55:57.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.279+0000 7f935d7ff700 1 -- 172.21.15.82:0/1003313787 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9358192da0 con 0x7f9358100930 2023-09-23T08:55:57.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.281+0000 7f9354ff9700 1 -- 172.21.15.82:0/1003313787 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) v1 ==== 134722+0+0 (secure 0 0 0) 0x7f934800c950 con 0x7f9358100930 2023-09-23T08:55:57.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.282+0000 7f9354ff9700 1 --2- 172.21.15.82:0/1003313787 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f934409ffe0 0x7f93440a24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:57.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.283+0000 7f9354ff9700 1 -- 172.21.15.82:0/1003313787 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f9348014070 con 0x7f9358100930 2023-09-23T08:55:57.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.283+0000 7f934ffff700 1 --2- 172.21.15.82:0/1003313787 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f934409ffe0 0x7f93440a24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:57.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.283+0000 7f934ffff700 1 --2- 172.21.15.82:0/1003313787 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f934409ffe0 0x7f93440a24a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f9340009c60 tx=0x7f9340009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:57.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.286+0000 7f9354ff9700 1 -- 172.21.15.82:0/1003313787 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f93480951a0 con 0x7f9358100930 2023-09-23T08:55:57.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.499+0000 7f935d7ff700 1 -- 172.21.15.82:0/1003313787 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f935810bfb0 con 0x7f9358100930 2023-09-23T08:55:57.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.499+0000 7f9354ff9700 1 -- 172.21.15.82:0/1003313787 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7f935810bfb0 con 0x7f9358100930 2023-09-23T08:55:57.502 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2023-09-23T08:55:57.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.501+0000 7f935d7ff700 1 -- 172.21.15.82:0/1003313787 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f934409ffe0 msgr2=0x7f93440a24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:57.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.501+0000 7f935d7ff700 1 --2- 172.21.15.82:0/1003313787 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f934409ffe0 0x7f93440a24a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f9340009c60 tx=0x7f9340009260 comp rx=0 tx=0).stop 2023-09-23T08:55:57.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.501+0000 7f935d7ff700 1 -- 172.21.15.82:0/1003313787 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9358100930 msgr2=0x7f9358198830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:57.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.501+0000 7f935d7ff700 1 --2- 172.21.15.82:0/1003313787 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9358100930 0x7f9358198830 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f934800e970 tx=0x7f934800ec80 comp rx=0 tx=0).stop 2023-09-23T08:55:57.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.502+0000 7f935d7ff700 1 -- 172.21.15.82:0/1003313787 shutdown_connections 2023-09-23T08:55:57.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.502+0000 7f935d7ff700 1 --2- 172.21.15.82:0/1003313787 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f934409ffe0 0x7f93440a24a0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:57.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.502+0000 7f935d7ff700 1 --2- 172.21.15.82:0/1003313787 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f93581024c0 0x7f935819fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:57.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.502+0000 7f935d7ff700 1 --2- 172.21.15.82:0/1003313787 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9358100930 0x7f9358198830 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:57.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.502+0000 7f935d7ff700 1 --2- 172.21.15.82:0/1003313787 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9358101b20 0x7f9358198d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:57.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.502+0000 7f935d7ff700 1 -- 172.21.15.82:0/1003313787 >> 172.21.15.82:0/1003313787 conn(0x7f93580fbea0 msgr2=0x7f93581074b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:57.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.502+0000 7f935d7ff700 1 -- 172.21.15.82:0/1003313787 shutdown_connections 2023-09-23T08:55:57.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.502+0000 7f935d7ff700 1 -- 172.21.15.82:0/1003313787 wait complete. 2023-09-23T08:55:57.524 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-23T08:55:57.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.732+0000 7ff3d69ff700 1 -- 172.21.15.82:0/2810265102 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3d00ff1f0 msgr2=0x7ff3d0101620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:57.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.732+0000 7ff3d69ff700 1 --2- 172.21.15.82:0/2810265102 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3d00ff1f0 0x7ff3d0101620 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff3c00098f0 tx=0x7ff3c0009c00 comp rx=0 tx=0).stop 2023-09-23T08:55:57.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.732+0000 7ff3d69ff700 1 -- 172.21.15.82:0/2810265102 shutdown_connections 2023-09-23T08:55:57.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.732+0000 7ff3d69ff700 1 --2- 172.21.15.82:0/2810265102 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3d0104530 0x7ff3d01049b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:57.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.732+0000 7ff3d69ff700 1 --2- 172.21.15.82:0/2810265102 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3d00ff1f0 0x7ff3d0101620 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:57.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.732+0000 7ff3d69ff700 1 --2- 172.21.15.82:0/2810265102 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff3d0101b60 0x7ff3d0103ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:57.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.732+0000 7ff3d69ff700 1 -- 172.21.15.82:0/2810265102 >> 172.21.15.82:0/2810265102 conn(0x7ff3d00fadf0 msgr2=0x7ff3d00fd230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:57.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.732+0000 7ff3d69ff700 1 -- 172.21.15.82:0/2810265102 shutdown_connections 2023-09-23T08:55:57.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.732+0000 7ff3d69ff700 1 -- 172.21.15.82:0/2810265102 wait complete. 2023-09-23T08:55:57.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.734+0000 7ff3d69ff700 1 Processor -- start 2023-09-23T08:55:57.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.734+0000 7ff3d69ff700 1 -- start start 2023-09-23T08:55:57.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.734+0000 7ff3d69ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3d00ff1f0 0x7ff3d019cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:57.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.735+0000 7ff3d69ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff3d0101b60 0x7ff3d019d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:57.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.735+0000 7ff3d69ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3d0104530 0x7ff3d01a4190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:57.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.735+0000 7ff3d69ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d01a4760 con 0x7ff3d00ff1f0 2023-09-23T08:55:57.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.735+0000 7ff3d69ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d01a48d0 con 0x7ff3d0104530 2023-09-23T08:55:57.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.735+0000 7ff3d69ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d01a4a90 con 0x7ff3d0101b60 2023-09-23T08:55:57.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.735+0000 7ff3cffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3d00ff1f0 0x7ff3d019cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:57.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.735+0000 7ff3cffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3d00ff1f0 0x7ff3d019cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54554/0 (socket says 172.21.15.82:54554) 2023-09-23T08:55:57.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.735+0000 7ff3cffff700 1 -- 172.21.15.82:0/727905212 learned_addr learned my addr 172.21.15.82:0/727905212 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:55:57.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.735+0000 7ff3cf7fe700 1 --2- 172.21.15.82:0/727905212 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff3d0101b60 0x7ff3d019d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:57.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.735+0000 7ff3d4f9c700 1 --2- 172.21.15.82:0/727905212 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3d0104530 0x7ff3d01a4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:57.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.735+0000 7ff3cffff700 1 -- 172.21.15.82:0/727905212 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff3d0101b60 msgr2=0x7ff3d019d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:57.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.735+0000 7ff3cffff700 1 --2- 172.21.15.82:0/727905212 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff3d0101b60 0x7ff3d019d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:57.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.735+0000 7ff3cffff700 1 -- 172.21.15.82:0/727905212 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3d0104530 msgr2=0x7ff3d01a4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:57.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.735+0000 7ff3cffff700 1 --2- 172.21.15.82:0/727905212 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3d0104530 0x7ff3d01a4190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:57.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.735+0000 7ff3cffff700 1 -- 172.21.15.82:0/727905212 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3c8009d00 con 0x7ff3d00ff1f0 2023-09-23T08:55:57.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.736+0000 7ff3cffff700 1 --2- 172.21.15.82:0/727905212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3d00ff1f0 0x7ff3d019cc20 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff3c0009fd0 tx=0x7ff3c000b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:57.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.736+0000 7ff3cd7fa700 1 -- 172.21.15.82:0/727905212 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c001c070 con 0x7ff3d00ff1f0 2023-09-23T08:55:57.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.736+0000 7ff3d69ff700 1 -- 172.21.15.82:0/727905212 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3c0009520 con 0x7ff3d00ff1f0 2023-09-23T08:55:57.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.736+0000 7ff3cd7fa700 1 -- 172.21.15.82:0/727905212 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff3c000f7b0 con 0x7ff3d00ff1f0 2023-09-23T08:55:57.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.736+0000 7ff3cd7fa700 1 -- 172.21.15.82:0/727905212 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c0004a50 con 0x7ff3d00ff1f0 2023-09-23T08:55:57.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.736+0000 7ff3d69ff700 1 -- 172.21.15.82:0/727905212 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3d01a4fa0 con 0x7ff3d00ff1f0 2023-09-23T08:55:57.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.737+0000 7ff3d69ff700 1 -- 172.21.15.82:0/727905212 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3d00fc970 con 0x7ff3d00ff1f0 2023-09-23T08:55:57.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.739+0000 7ff3cd7fa700 1 -- 172.21.15.82:0/727905212 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) v1 ==== 134722+0+0 (secure 0 0 0) 0x7ff3c0020070 con 0x7ff3d00ff1f0 2023-09-23T08:55:57.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.740+0000 7ff3cd7fa700 1 --2- 172.21.15.82:0/727905212 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7ff3b809ffe0 0x7ff3b80a24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:57.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.741+0000 7ff3cd7fa700 1 -- 172.21.15.82:0/727905212 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7ff3c00cc740 con 0x7ff3d00ff1f0 2023-09-23T08:55:57.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.741+0000 7ff3cf7fe700 1 --2- 172.21.15.82:0/727905212 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7ff3b809ffe0 0x7ff3b80a24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:57.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.741+0000 7ff3cf7fe700 1 --2- 172.21.15.82:0/727905212 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7ff3b809ffe0 0x7ff3b80a24a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff3c4009bf0 tx=0x7ff3c4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:57.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.743+0000 7ff3cd7fa700 1 -- 172.21.15.82:0/727905212 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7ff3c00963b0 con 0x7ff3d00ff1f0 2023-09-23T08:55:57.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:57 smithi135 ceph-mon[99205]: pgmap v335: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s 2023-09-23T08:55:57.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:57 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/3853576254' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-23T08:55:57.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:57 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/4172232212' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-23T08:55:57.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:57 smithi082 ceph-mon[97694]: pgmap v335: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s 2023-09-23T08:55:57.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:57 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/3853576254' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-23T08:55:57.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:57 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/4172232212' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-23T08:55:57.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:57 smithi161 ceph-mon[99580]: pgmap v335: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s 2023-09-23T08:55:57.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:57 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/3853576254' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-23T08:55:57.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:57 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/4172232212' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-23T08:55:57.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.953+0000 7ff3d69ff700 1 -- 172.21.15.82:0/727905212 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff3d0112840 con 0x7ff3d00ff1f0 2023-09-23T08:55:57.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.954+0000 7ff3cd7fa700 1 -- 172.21.15.82:0/727905212 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff3c0022e60 con 0x7ff3d00ff1f0 2023-09-23T08:55:57.956 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2023-09-23T08:55:57.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.956+0000 7ff3d69ff700 1 -- 172.21.15.82:0/727905212 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7ff3b809ffe0 msgr2=0x7ff3b80a24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:57.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.956+0000 7ff3d69ff700 1 --2- 172.21.15.82:0/727905212 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7ff3b809ffe0 0x7ff3b80a24a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff3c4009bf0 tx=0x7ff3c4009260 comp rx=0 tx=0).stop 2023-09-23T08:55:57.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.956+0000 7ff3d69ff700 1 -- 172.21.15.82:0/727905212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3d00ff1f0 msgr2=0x7ff3d019cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:57.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.956+0000 7ff3d69ff700 1 --2- 172.21.15.82:0/727905212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3d00ff1f0 0x7ff3d019cc20 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff3c0009fd0 tx=0x7ff3c000b840 comp rx=0 tx=0).stop 2023-09-23T08:55:57.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.956+0000 7ff3d69ff700 1 -- 172.21.15.82:0/727905212 shutdown_connections 2023-09-23T08:55:57.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.956+0000 7ff3d69ff700 1 --2- 172.21.15.82:0/727905212 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7ff3b809ffe0 0x7ff3b80a24a0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:57.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.956+0000 7ff3d69ff700 1 --2- 172.21.15.82:0/727905212 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3d0104530 0x7ff3d01a4190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:57.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.956+0000 7ff3d69ff700 1 --2- 172.21.15.82:0/727905212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3d00ff1f0 0x7ff3d019cc20 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:57.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.956+0000 7ff3d69ff700 1 --2- 172.21.15.82:0/727905212 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff3d0101b60 0x7ff3d019d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:57.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.956+0000 7ff3d69ff700 1 -- 172.21.15.82:0/727905212 >> 172.21.15.82:0/727905212 conn(0x7ff3d00fadf0 msgr2=0x7ff3d0102870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:57.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.956+0000 7ff3d69ff700 1 -- 172.21.15.82:0/727905212 shutdown_connections 2023-09-23T08:55:57.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:57.956+0000 7ff3d69ff700 1 -- 172.21.15.82:0/727905212 wait complete. 2023-09-23T08:55:57.978 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-23T08:55:58.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.187+0000 7f35a8fff700 1 -- 172.21.15.82:0/2951623792 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35a41065f0 msgr2=0x7f35a4108a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:58.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.187+0000 7f35a8fff700 1 --2- 172.21.15.82:0/2951623792 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35a41065f0 0x7f35a4108a60 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f359c00b0a0 tx=0x7f359c00b3b0 comp rx=0 tx=0).stop 2023-09-23T08:55:58.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.188+0000 7f35a8fff700 1 -- 172.21.15.82:0/2951623792 shutdown_connections 2023-09-23T08:55:58.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.188+0000 7f35a8fff700 1 --2- 172.21.15.82:0/2951623792 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35a41065f0 0x7f35a4108a60 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:58.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.188+0000 7f35a8fff700 1 --2- 172.21.15.82:0/2951623792 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f35a4101390 0x7f35a4103780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:58.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.188+0000 7f35a8fff700 1 --2- 172.21.15.82:0/2951623792 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35a4103cc0 0x7f35a41060b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:58.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.188+0000 7f35a8fff700 1 -- 172.21.15.82:0/2951623792 >> 172.21.15.82:0/2951623792 conn(0x7f35a40fad80 msgr2=0x7f35a40fd1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:58.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.188+0000 7f35a8fff700 1 -- 172.21.15.82:0/2951623792 shutdown_connections 2023-09-23T08:55:58.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.188+0000 7f35a8fff700 1 -- 172.21.15.82:0/2951623792 wait complete. 2023-09-23T08:55:58.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.189+0000 7f35a8fff700 1 Processor -- start 2023-09-23T08:55:58.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.189+0000 7f35a8fff700 1 -- start start 2023-09-23T08:55:58.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.189+0000 7f35a8fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35a4101390 0x7f35a4198760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:58.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.189+0000 7f35a8fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f35a4103cc0 0x7f35a4198ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:58.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.189+0000 7f35a8fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35a41065f0 0x7f35a419fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:58.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.189+0000 7f35a8fff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a41a02e0 con 0x7f35a41065f0 2023-09-23T08:55:58.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.189+0000 7f35a8fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a41a0420 con 0x7f35a4101390 2023-09-23T08:55:58.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.189+0000 7f35a8fff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a41a05b0 con 0x7f35a4103cc0 2023-09-23T08:55:58.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.189+0000 7f35a2d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35a41065f0 0x7f35a419fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:58.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.189+0000 7f35a259c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35a4101390 0x7f35a4198760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:58.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.190+0000 7f35a2d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35a41065f0 0x7f35a419fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54574/0 (socket says 172.21.15.82:54574) 2023-09-23T08:55:58.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.190+0000 7f35a2d9d700 1 -- 172.21.15.82:0/535889403 learned_addr learned my addr 172.21.15.82:0/535889403 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:55:58.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.190+0000 7f35a1d9b700 1 --2- 172.21.15.82:0/535889403 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f35a4103cc0 0x7f35a4198ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:58.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.190+0000 7f35a2d9d700 1 -- 172.21.15.82:0/535889403 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f35a4103cc0 msgr2=0x7f35a4198ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:58.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.190+0000 7f35a2d9d700 1 --2- 172.21.15.82:0/535889403 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f35a4103cc0 0x7f35a4198ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:58.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.190+0000 7f35a2d9d700 1 -- 172.21.15.82:0/535889403 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35a4101390 msgr2=0x7f35a4198760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:58.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.190+0000 7f35a2d9d700 1 --2- 172.21.15.82:0/535889403 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35a4101390 0x7f35a4198760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:58.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.190+0000 7f35a2d9d700 1 -- 172.21.15.82:0/535889403 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f359c009d00 con 0x7f35a41065f0 2023-09-23T08:55:58.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.190+0000 7f35a259c700 1 --2- 172.21.15.82:0/535889403 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35a4101390 0x7f35a4198760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T08:55:58.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.190+0000 7f35a2d9d700 1 --2- 172.21.15.82:0/535889403 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35a41065f0 0x7f35a419fd10 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f359c00d010 tx=0x7f359c00bcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:58.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.190+0000 7f35937fe700 1 -- 172.21.15.82:0/535889403 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359c00e040 con 0x7f35a41065f0 2023-09-23T08:55:58.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.190+0000 7f35937fe700 1 -- 172.21.15.82:0/535889403 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f359c009480 con 0x7f35a41065f0 2023-09-23T08:55:58.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.190+0000 7f35a8fff700 1 -- 172.21.15.82:0/535889403 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35a41a0830 con 0x7f35a41065f0 2023-09-23T08:55:58.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.190+0000 7f35937fe700 1 -- 172.21.15.82:0/535889403 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359c0052a0 con 0x7f35a41065f0 2023-09-23T08:55:58.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.191+0000 7f35a8fff700 1 -- 172.21.15.82:0/535889403 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35a41a0cb0 con 0x7f35a41065f0 2023-09-23T08:55:58.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.192+0000 7f35a8fff700 1 -- 172.21.15.82:0/535889403 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35a4108170 con 0x7f35a41065f0 2023-09-23T08:55:58.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.194+0000 7f35937fe700 1 -- 172.21.15.82:0/535889403 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) v1 ==== 134722+0+0 (secure 0 0 0) 0x7f359c005400 con 0x7f35a41065f0 2023-09-23T08:55:58.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.195+0000 7f35937fe700 1 --2- 172.21.15.82:0/535889403 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f358c0a00a0 0x7f358c0a2560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:58.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.195+0000 7f35937fe700 1 -- 172.21.15.82:0/535889403 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f359c0cc3a0 con 0x7f35a41065f0 2023-09-23T08:55:58.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.195+0000 7f35a259c700 1 --2- 172.21.15.82:0/535889403 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f358c0a00a0 0x7f358c0a2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:58.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.196+0000 7f35a259c700 1 --2- 172.21.15.82:0/535889403 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f358c0a00a0 0x7f358c0a2560 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3594011490 tx=0x7f3594009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:58.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.199+0000 7f35937fe700 1 -- 172.21.15.82:0/535889403 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f359c096070 con 0x7f35a41065f0 2023-09-23T08:55:58.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.465+0000 7f35a8fff700 1 -- 172.21.15.82:0/535889403 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f35a410bfa0 con 0x7f35a41065f0 2023-09-23T08:55:58.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.466+0000 7f35937fe700 1 -- 172.21.15.82:0/535889403 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+11323 (secure 0 0 0) 0x7f359c099690 con 0x7f35a41065f0 2023-09-23T08:55:58.469 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:55:58.469 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/1237857359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1237857359},{"type":"v1","addr":"172.21.15.82:6835","nonce":1237857359}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/1335102362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":1335102362},{"type":"v1","addr":"172.21.15.82:6837","nonce":1335102362}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-23T08:54:52.600479+0000","modified":"2023-09-23T08:55:00.481507+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24557,"mds_1":24550,"mds_2":24526,"mds_3":24515,"mds_4":24514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/3645331700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3645331700},{"type":"v1","addr":"172.21.15.135:6835","nonce":3645331700}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14658":{"gid":14658,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6839/205725278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":205725278},{"type":"v1","addr":"172.21.15.82:6839","nonce":205725278}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14670":{"gid":14670,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6841/2659297867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":2659297867},{"type":"v1","addr":"172.21.15.82:6841","nonce":2659297867}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24461":{"gid":24461,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/503886037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":503886037},{"type":"v1","addr":"172.21.15.135:6833","nonce":503886037}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24463":{"gid":24463,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.161:6833/471569125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":471569125},{"type":"v1","addr":"172.21.15.161:6833","nonce":471569125}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24514":{"gid":24514,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":10,"addr":"172.21.15.161:6835/2237964162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":2237964162},{"type":"v1","addr":"172.21.15.161:6835","nonce":2237964162}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24515":{"gid":24515,"name":"h","rank":3,"incarnation":22,"state":"up:active","state_seq":8,"addr":"172.21.15.135:6837/2655304858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2655304858},{"type":"v1","addr":"172.21.15.135:6837","nonce":2655304858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24526":{"gid":24526,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.161:6837/43639843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":43639843},{"type":"v1","addr":"172.21.15.161:6837","nonce":43639843}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24550":{"gid":24550,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.161:6839/758982817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6838","nonce":758982817},{"type":"v1","addr":"172.21.15.161:6839","nonce":758982817}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24557":{"gid":24557,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6839/2508669274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2508669274},{"type":"v1","addr":"172.21.15.135:6839","nonce":2508669274}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-23T08:55:58.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.469+0000 7f35a8fff700 1 -- 172.21.15.82:0/535889403 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f358c0a00a0 msgr2=0x7f358c0a2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:58.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.469+0000 7f35a8fff700 1 --2- 172.21.15.82:0/535889403 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f358c0a00a0 0x7f358c0a2560 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3594011490 tx=0x7f3594009260 comp rx=0 tx=0).stop 2023-09-23T08:55:58.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.469+0000 7f35a8fff700 1 -- 172.21.15.82:0/535889403 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35a41065f0 msgr2=0x7f35a419fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:58.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.469+0000 7f35a8fff700 1 --2- 172.21.15.82:0/535889403 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35a41065f0 0x7f35a419fd10 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f359c00d010 tx=0x7f359c00bcc0 comp rx=0 tx=0).stop 2023-09-23T08:55:58.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.469+0000 7f35a8fff700 1 -- 172.21.15.82:0/535889403 shutdown_connections 2023-09-23T08:55:58.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.469+0000 7f35a8fff700 1 --2- 172.21.15.82:0/535889403 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f358c0a00a0 0x7f358c0a2560 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:58.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.469+0000 7f35a8fff700 1 --2- 172.21.15.82:0/535889403 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35a41065f0 0x7f35a419fd10 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:58.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.469+0000 7f35a8fff700 1 --2- 172.21.15.82:0/535889403 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35a4101390 0x7f35a4198760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:58.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.469+0000 7f35a8fff700 1 --2- 172.21.15.82:0/535889403 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f35a4103cc0 0x7f35a4198ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:58.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.469+0000 7f35a8fff700 1 -- 172.21.15.82:0/535889403 >> 172.21.15.82:0/535889403 conn(0x7f35a40fad80 msgr2=0x7f35a40ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:58.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.469+0000 7f35a8fff700 1 -- 172.21.15.82:0/535889403 shutdown_connections 2023-09-23T08:55:58.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.469+0000 7f35a8fff700 1 -- 172.21.15.82:0/535889403 wait complete. 2023-09-23T08:55:58.473 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 26 2023-09-23T08:55:58.490 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-23T08:55:58.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.702+0000 7f72b23ff700 1 -- 172.21.15.82:0/3359554155 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72ac1065f0 msgr2=0x7f72ac108a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:58.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.702+0000 7f72b23ff700 1 --2- 172.21.15.82:0/3359554155 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72ac1065f0 0x7f72ac108a60 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f72a400b0a0 tx=0x7f72a400b3b0 comp rx=0 tx=0).stop 2023-09-23T08:55:58.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.702+0000 7f72b23ff700 1 -- 172.21.15.82:0/3359554155 shutdown_connections 2023-09-23T08:55:58.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.702+0000 7f72b23ff700 1 --2- 172.21.15.82:0/3359554155 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72ac1065f0 0x7f72ac108a60 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:58.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.702+0000 7f72b23ff700 1 --2- 172.21.15.82:0/3359554155 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f72ac101390 0x7f72ac103780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:58.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.702+0000 7f72b23ff700 1 --2- 172.21.15.82:0/3359554155 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72ac103cc0 0x7f72ac1060b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:58.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.702+0000 7f72b23ff700 1 -- 172.21.15.82:0/3359554155 >> 172.21.15.82:0/3359554155 conn(0x7f72ac0fad80 msgr2=0x7f72ac0fd1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:58.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.702+0000 7f72b23ff700 1 -- 172.21.15.82:0/3359554155 shutdown_connections 2023-09-23T08:55:58.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.702+0000 7f72b23ff700 1 -- 172.21.15.82:0/3359554155 wait complete. 2023-09-23T08:55:58.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.703+0000 7f72b23ff700 1 Processor -- start 2023-09-23T08:55:58.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.703+0000 7f72b23ff700 1 -- start start 2023-09-23T08:55:58.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.704+0000 7f72b23ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72ac101390 0x7f72ac1965a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:58.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.704+0000 7f72b23ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72ac103cc0 0x7f72ac196ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:58.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.704+0000 7f72b23ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f72ac1065f0 0x7f72ac19db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:58.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.704+0000 7f72b23ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72ac19e120 con 0x7f72ac103cc0 2023-09-23T08:55:58.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.704+0000 7f72b23ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72ac19e260 con 0x7f72ac101390 2023-09-23T08:55:58.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.704+0000 7f72b23ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72ac19e3f0 con 0x7f72ac1065f0 2023-09-23T08:55:58.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.704+0000 7f72ab7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72ac103cc0 0x7f72ac196ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:58.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.704+0000 7f72ab7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72ac103cc0 0x7f72ac196ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54588/0 (socket says 172.21.15.82:54588) 2023-09-23T08:55:58.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.704+0000 7f72ab7fe700 1 -- 172.21.15.82:0/1498978618 learned_addr learned my addr 172.21.15.82:0/1498978618 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:55:58.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.704+0000 7f72abfff700 1 --2- 172.21.15.82:0/1498978618 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72ac101390 0x7f72ac1965a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:58.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.704+0000 7f72b099c700 1 --2- 172.21.15.82:0/1498978618 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f72ac1065f0 0x7f72ac19db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:58.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.704+0000 7f72ab7fe700 1 -- 172.21.15.82:0/1498978618 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f72ac1065f0 msgr2=0x7f72ac19db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:58.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.704+0000 7f72ab7fe700 1 --2- 172.21.15.82:0/1498978618 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f72ac1065f0 0x7f72ac19db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:58.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.704+0000 7f72ab7fe700 1 -- 172.21.15.82:0/1498978618 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72ac101390 msgr2=0x7f72ac1965a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:58.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.704+0000 7f72ab7fe700 1 --2- 172.21.15.82:0/1498978618 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72ac101390 0x7f72ac1965a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:58.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.704+0000 7f72ab7fe700 1 -- 172.21.15.82:0/1498978618 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72a4009d00 con 0x7f72ac103cc0 2023-09-23T08:55:58.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.705+0000 7f72b099c700 1 --2- 172.21.15.82:0/1498978618 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f72ac1065f0 0x7f72ac19db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T08:55:58.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.705+0000 7f72ab7fe700 1 --2- 172.21.15.82:0/1498978618 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72ac103cc0 0x7f72ac196ae0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f72a000d980 tx=0x7f72a000dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:58.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.705+0000 7f72a97fa700 1 -- 172.21.15.82:0/1498978618 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a000bb60 con 0x7f72ac103cc0 2023-09-23T08:55:58.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.705+0000 7f72b23ff700 1 -- 172.21.15.82:0/1498978618 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72ac19e6d0 con 0x7f72ac103cc0 2023-09-23T08:55:58.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.705+0000 7f72a97fa700 1 -- 172.21.15.82:0/1498978618 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f72a0007640 con 0x7f72ac103cc0 2023-09-23T08:55:58.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.705+0000 7f72a97fa700 1 -- 172.21.15.82:0/1498978618 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a0004d60 con 0x7f72ac103cc0 2023-09-23T08:55:58.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.705+0000 7f72b23ff700 1 -- 172.21.15.82:0/1498978618 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72ac19ebe0 con 0x7f72ac103cc0 2023-09-23T08:55:58.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.706+0000 7f72b23ff700 1 -- 172.21.15.82:0/1498978618 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72ac0fc900 con 0x7f72ac103cc0 2023-09-23T08:55:58.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.708+0000 7f72a97fa700 1 -- 172.21.15.82:0/1498978618 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) v1 ==== 134722+0+0 (secure 0 0 0) 0x7f72a0004020 con 0x7f72ac103cc0 2023-09-23T08:55:58.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.709+0000 7f72a97fa700 1 --2- 172.21.15.82:0/1498978618 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f72940a0020 0x7f72940a24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:58.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.710+0000 7f72a97fa700 1 -- 172.21.15.82:0/1498978618 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f72a00cb310 con 0x7f72ac103cc0 2023-09-23T08:55:58.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.710+0000 7f72abfff700 1 --2- 172.21.15.82:0/1498978618 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f72940a0020 0x7f72940a24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:58.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.710+0000 7f72abfff700 1 --2- 172.21.15.82:0/1498978618 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f72940a0020 0x7f72940a24e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f729c005950 tx=0x7f729c0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:58.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.713+0000 7f72a97fa700 1 -- 172.21.15.82:0/1498978618 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f72a0094ef0 con 0x7f72ac103cc0 2023-09-23T08:55:58.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:58 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/1003313787' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-09-23T08:55:58.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:58 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/727905212' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-09-23T08:55:58.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:58 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/1003313787' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-09-23T08:55:58.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:58 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/727905212' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-09-23T08:55:58.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:58 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/1003313787' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-09-23T08:55:58.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:58 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/727905212' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-09-23T08:55:58.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.954+0000 7f72b23ff700 1 -- 172.21.15.82:0/1498978618 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f72ac10c210 con 0x7f72ac103cc0 2023-09-23T08:55:58.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.956+0000 7f72a97fa700 1 -- 172.21.15.82:0/1498978618 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+22508 (secure 0 0 0) 0x7f72a00042d0 con 0x7f72ac103cc0 2023-09-23T08:55:58.959 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:55:58.959 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":88,"fsid":"8926e286-59ed-11ee-8db4-212e2dc638e7","created":"2023-09-23T08:46:16.628057+0000","modified":"2023-09-23T08:55:23.423278+0000","last_up_change":"2023-09-23T08:53:56.524694+0000","last_in_change":"2023-09-23T08:53:35.779183+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-23T08:50:00.571063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-23T08:54:50.558630+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-23T08:54:52.055291+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7384c1ff-8c71-4feb-8cef-ba45c2a1708a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":892441948},{"type":"v1","addr":"172.21.15.82:6803","nonce":892441948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":892441948},{"type":"v1","addr":"172.21.15.82:6805","nonce":892441948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":892441948},{"type":"v1","addr":"172.21.15.82:6809","nonce":892441948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":892441948},{"type":"v1","addr":"172.21.15.82:6807","nonce":892441948}]},"public_addr":"172.21.15.82:6803/892441948","cluster_addr":"172.21.15.82:6805/892441948","heartbeat_back_addr":"172.21.15.82:6809/892441948","heartbeat_front_addr":"172.21.15.82:6807/892441948","state":["exists","up"]},{"osd":1,"uuid":"ca62333e-15db-4556-a9ed-8820f9268766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3224546922},{"type":"v1","addr":"172.21.15.135:6801","nonce":3224546922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3224546922},{"type":"v1","addr":"172.21.15.135:6803","nonce":3224546922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3224546922},{"type":"v1","addr":"172.21.15.135:6807","nonce":3224546922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3224546922},{"type":"v1","addr":"172.21.15.135:6805","nonce":3224546922}]},"public_addr":"172.21.15.135:6801/3224546922","cluster_addr":"172.21.15.135:6803/3224546922","heartbeat_back_addr":"172.21.15.135:6807/3224546922","heartbeat_front_addr":"172.21.15.135:6805/3224546922","state":["exists","up"]},{"osd":2,"uuid":"ac23eb38-216a-44f0-b316-a509b23745f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2358373459},{"type":"v1","addr":"172.21.15.161:6801","nonce":2358373459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2358373459},{"type":"v1","addr":"172.21.15.161:6803","nonce":2358373459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2358373459},{"type":"v1","addr":"172.21.15.161:6807","nonce":2358373459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2358373459},{"type":"v1","addr":"172.21.15.161:6805","nonce":2358373459}]},"public_addr":"172.21.15.161:6801/2358373459","cluster_addr":"172.21.15.161:6803/2358373459","heartbeat_back_addr":"172.21.15.161:6807/2358373459","heartbeat_front_addr":"172.21.15.161:6805/2358373459","state":["exists","up"]},{"osd":3,"uuid":"701c96b0-30fb-46ce-917d-e02d3814dc3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":1081464528},{"type":"v1","addr":"172.21.15.82:6811","nonce":1081464528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1081464528},{"type":"v1","addr":"172.21.15.82:6813","nonce":1081464528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1081464528},{"type":"v1","addr":"172.21.15.82:6817","nonce":1081464528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":1081464528},{"type":"v1","addr":"172.21.15.82:6815","nonce":1081464528}]},"public_addr":"172.21.15.82:6811/1081464528","cluster_addr":"172.21.15.82:6813/1081464528","heartbeat_back_addr":"172.21.15.82:6817/1081464528","heartbeat_front_addr":"172.21.15.82:6815/1081464528","state":["exists","up"]},{"osd":4,"uuid":"c618d2a2-3616-41b2-943c-7a4616538e13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2346495509},{"type":"v1","addr":"172.21.15.135:6809","nonce":2346495509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2346495509},{"type":"v1","addr":"172.21.15.135:6811","nonce":2346495509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2346495509},{"type":"v1","addr":"172.21.15.135:6815","nonce":2346495509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2346495509},{"type":"v1","addr":"172.21.15.135:6813","nonce":2346495509}]},"public_addr":"172.21.15.135:6809/2346495509","cluster_addr":"172.21.15.135:6811/2346495509","heartbeat_back_addr":"172.21.15.135:6815/2346495509","heartbeat_front_addr":"172.21.15.135:6813/2346495509","state":["exists","up"]},{"osd":5,"uuid":"8e1dda3d-6927-495d-b20d-78b03bb75d5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1252638628},{"type":"v1","addr":"172.21.15.161:6809","nonce":1252638628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1252638628},{"type":"v1","addr":"172.21.15.161:6811","nonce":1252638628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1252638628},{"type":"v1","addr":"172.21.15.161:6815","nonce":1252638628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1252638628},{"type":"v1","addr":"172.21.15.161:6813","nonce":1252638628}]},"public_addr":"172.21.15.161:6809/1252638628","cluster_addr":"172.21.15.161:6811/1252638628","heartbeat_back_addr":"172.21.15.161:6815/1252638628","heartbeat_front_addr":"172.21.15.161:6813/1252638628","state":["exists","up"]},{"osd":6,"uuid":"50b31960-6bc4-44e1-8116-3106bf161e56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1052038408},{"type":"v1","addr":"172.21.15.82:6819","nonce":1052038408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1052038408},{"type":"v1","addr":"172.21.15.82:6821","nonce":1052038408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":1052038408},{"type":"v1","addr":"172.21.15.82:6825","nonce":1052038408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1052038408},{"type":"v1","addr":"172.21.15.82:6823","nonce":1052038408}]},"public_addr":"172.21.15.82:6819/1052038408","cluster_addr":"172.21.15.82:6821/1052038408","heartbeat_back_addr":"172.21.15.82:6825/1052038408","heartbeat_front_addr":"172.21.15.82:6823/1052038408","state":["exists","up"]},{"osd":7,"uuid":"425ca0ee-57f7-4b27-90fb-d86bb5db5480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3683951498},{"type":"v1","addr":"172.21.15.135:6817","nonce":3683951498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":3683951498},{"type":"v1","addr":"172.21.15.135:6819","nonce":3683951498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":3683951498},{"type":"v1","addr":"172.21.15.135:6823","nonce":3683951498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":3683951498},{"type":"v1","addr":"172.21.15.135:6821","nonce":3683951498}]},"public_addr":"172.21.15.135:6817/3683951498","cluster_addr":"172.21.15.135:6819/3683951498","heartbeat_back_addr":"172.21.15.135:6823/3683951498","heartbeat_front_addr":"172.21.15.135:6821/3683951498","state":["exists","up"]},{"osd":8,"uuid":"1115c837-bef6-4bad-9974-4d913198511b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":948521536},{"type":"v1","addr":"172.21.15.161:6817","nonce":948521536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":948521536},{"type":"v1","addr":"172.21.15.161:6819","nonce":948521536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":948521536},{"type":"v1","addr":"172.21.15.161:6823","nonce":948521536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":948521536},{"type":"v1","addr":"172.21.15.161:6821","nonce":948521536}]},"public_addr":"172.21.15.161:6817/948521536","cluster_addr":"172.21.15.161:6819/948521536","heartbeat_back_addr":"172.21.15.161:6823/948521536","heartbeat_front_addr":"172.21.15.161:6821/948521536","state":["exists","up"]},{"osd":9,"uuid":"c52ec819-4bc6-402f-9cd8-62539e519e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":1438762840},{"type":"v1","addr":"172.21.15.82:6827","nonce":1438762840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":1438762840},{"type":"v1","addr":"172.21.15.82:6829","nonce":1438762840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1438762840},{"type":"v1","addr":"172.21.15.82:6833","nonce":1438762840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1438762840},{"type":"v1","addr":"172.21.15.82:6831","nonce":1438762840}]},"public_addr":"172.21.15.82:6827/1438762840","cluster_addr":"172.21.15.82:6829/1438762840","heartbeat_back_addr":"172.21.15.82:6833/1438762840","heartbeat_front_addr":"172.21.15.82:6831/1438762840","state":["exists","up"]},{"osd":10,"uuid":"1b16c795-1b91-4d46-ae5d-21b8332c1077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2853697851},{"type":"v1","addr":"172.21.15.135:6825","nonce":2853697851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2853697851},{"type":"v1","addr":"172.21.15.135:6827","nonce":2853697851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2853697851},{"type":"v1","addr":"172.21.15.135:6831","nonce":2853697851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2853697851},{"type":"v1","addr":"172.21.15.135:6829","nonce":2853697851}]},"public_addr":"172.21.15.135:6825/2853697851","cluster_addr":"172.21.15.135:6827/2853697851","heartbeat_back_addr":"172.21.15.135:6831/2853697851","heartbeat_front_addr":"172.21.15.135:6829/2853697851","state":["exists","up"]},{"osd":11,"uuid":"2551e602-4fe1-41cb-9b7d-c8b31fdd1487","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":1459332081},{"type":"v1","addr":"172.21.15.161:6825","nonce":1459332081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":1459332081},{"type":"v1","addr":"172.21.15.161:6827","nonce":1459332081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":1459332081},{"type":"v1","addr":"172.21.15.161:6831","nonce":1459332081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":1459332081},{"type":"v1","addr":"172.21.15.161:6829","nonce":1459332081}]},"public_addr":"172.21.15.161:6825/1459332081","cluster_addr":"172.21.15.161:6827/1459332081","heartbeat_back_addr":"172.21.15.161:6831/1459332081","heartbeat_front_addr":"172.21.15.161:6829/1459332081","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:49:04.007679+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:49:30.702365+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:49:56.785248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:50:22.988516+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:50:49.347055+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:51:15.830145+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:51:41.986377+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:52:08.218893+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:52:34.847450+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:53:01.317134+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:53:27.981691+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:53:54.849245+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/4204712132":"2023-09-24T08:47:21.957866+0000","172.21.15.82:6801/2733521564":"2023-09-24T08:47:21.957866+0000","172.21.15.82:6800/2733521564":"2023-09-24T08:47:21.957866+0000","172.21.15.82:0/3964794665":"2023-09-24T08:47:21.957866+0000","172.21.15.82:0/3535372205":"2023-09-24T08:46:55.187024+0000","172.21.15.82:0/285559684":"2023-09-24T08:46:55.187024+0000","172.21.15.82:0/1335891896":"2023-09-24T08:46:55.187024+0000","172.21.15.82:6801/3761509623":"2023-09-24T08:46:55.187024+0000","172.21.15.82:6800/3761509623":"2023-09-24T08:46:55.187024+0000","172.21.15.82:0/3775317005":"2023-09-24T08:47:21.957866+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-23T08:55:58.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.958+0000 7f72b23ff700 1 -- 172.21.15.82:0/1498978618 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f72940a0020 msgr2=0x7f72940a24e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:58.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.958+0000 7f72b23ff700 1 --2- 172.21.15.82:0/1498978618 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f72940a0020 0x7f72940a24e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f729c005950 tx=0x7f729c0058e0 comp rx=0 tx=0).stop 2023-09-23T08:55:58.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.958+0000 7f72b23ff700 1 -- 172.21.15.82:0/1498978618 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72ac103cc0 msgr2=0x7f72ac196ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:58.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.958+0000 7f72b23ff700 1 --2- 172.21.15.82:0/1498978618 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72ac103cc0 0x7f72ac196ae0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f72a000d980 tx=0x7f72a000dd40 comp rx=0 tx=0).stop 2023-09-23T08:55:58.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.958+0000 7f72b23ff700 1 -- 172.21.15.82:0/1498978618 shutdown_connections 2023-09-23T08:55:58.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.958+0000 7f72b23ff700 1 --2- 172.21.15.82:0/1498978618 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f72940a0020 0x7f72940a24e0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:58.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.959+0000 7f72b23ff700 1 --2- 172.21.15.82:0/1498978618 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f72ac1065f0 0x7f72ac19db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:58.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.959+0000 7f72b23ff700 1 --2- 172.21.15.82:0/1498978618 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72ac101390 0x7f72ac1965a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:58.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.959+0000 7f72b23ff700 1 --2- 172.21.15.82:0/1498978618 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72ac103cc0 0x7f72ac196ae0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:58.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.959+0000 7f72b23ff700 1 -- 172.21.15.82:0/1498978618 >> 172.21.15.82:0/1498978618 conn(0x7f72ac0fad80 msgr2=0x7f72ac102000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:58.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.959+0000 7f72b23ff700 1 -- 172.21.15.82:0/1498978618 shutdown_connections 2023-09-23T08:55:58.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:58.959+0000 7f72b23ff700 1 -- 172.21.15.82:0/1498978618 wait complete. 2023-09-23T08:55:58.988 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-23T08:55:59.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.200+0000 7f94acfff700 1 -- 172.21.15.82:0/723097217 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94a8100920 msgr2=0x7f94a8100d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:59.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.200+0000 7f94acfff700 1 --2- 172.21.15.82:0/723097217 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94a8100920 0x7f94a8100d40 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f94980099c0 tx=0x7f9498009cd0 comp rx=0 tx=0).stop 2023-09-23T08:55:59.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.200+0000 7f94acfff700 1 -- 172.21.15.82:0/723097217 shutdown_connections 2023-09-23T08:55:59.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.200+0000 7f94acfff700 1 --2- 172.21.15.82:0/723097217 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f94a81024b0 0x7f94a8108d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:59.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.200+0000 7f94acfff700 1 --2- 172.21.15.82:0/723097217 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94a8100920 0x7f94a8100d40 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:59.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.200+0000 7f94acfff700 1 --2- 172.21.15.82:0/723097217 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94a8101b10 0x7f94a8101f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:59.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.200+0000 7f94acfff700 1 -- 172.21.15.82:0/723097217 >> 172.21.15.82:0/723097217 conn(0x7f94a80fbe50 msgr2=0x7f94a80fe2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:59.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.200+0000 7f94acfff700 1 -- 172.21.15.82:0/723097217 shutdown_connections 2023-09-23T08:55:59.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.200+0000 7f94acfff700 1 -- 172.21.15.82:0/723097217 wait complete. 2023-09-23T08:55:59.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.201+0000 7f94acfff700 1 Processor -- start 2023-09-23T08:55:59.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.201+0000 7f94acfff700 1 -- start start 2023-09-23T08:55:59.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.201+0000 7f94acfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94a8100920 0x7f94a8196560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:59.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.201+0000 7f94acfff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94a8101b10 0x7f94a8196aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:59.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.202+0000 7f94acfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f94a81024b0 0x7f94a819db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:59.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.202+0000 7f94acfff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94a819e0e0 con 0x7f94a8100920 2023-09-23T08:55:59.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.202+0000 7f94acfff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94a819e220 con 0x7f94a81024b0 2023-09-23T08:55:59.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.202+0000 7f94acfff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94a819e3b0 con 0x7f94a8101b10 2023-09-23T08:55:59.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.202+0000 7f94a5d9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94a8101b10 0x7f94a8196aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:59.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.202+0000 7f94a5d9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94a8101b10 0x7f94a8196aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:42158/0 (socket says 172.21.15.82:42158) 2023-09-23T08:55:59.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.202+0000 7f94a659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94a8100920 0x7f94a8196560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:59.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.202+0000 7f94a5d9b700 1 -- 172.21.15.82:0/2907361016 learned_addr learned my addr 172.21.15.82:0/2907361016 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:55:59.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.202+0000 7f94a6d9d700 1 --2- 172.21.15.82:0/2907361016 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f94a81024b0 0x7f94a819db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:59.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.202+0000 7f94a5d9b700 1 -- 172.21.15.82:0/2907361016 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f94a81024b0 msgr2=0x7f94a819db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:59.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.202+0000 7f94a5d9b700 1 --2- 172.21.15.82:0/2907361016 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f94a81024b0 0x7f94a819db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:59.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.202+0000 7f94a5d9b700 1 -- 172.21.15.82:0/2907361016 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94a8100920 msgr2=0x7f94a8196560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:59.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.202+0000 7f94a5d9b700 1 --2- 172.21.15.82:0/2907361016 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94a8100920 0x7f94a8196560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:59.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.202+0000 7f94a5d9b700 1 -- 172.21.15.82:0/2907361016 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f949c009520 con 0x7f94a8101b10 2023-09-23T08:55:59.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.203+0000 7f94a5d9b700 1 --2- 172.21.15.82:0/2907361016 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94a8101b10 0x7f94a8196aa0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f949c00eb30 tx=0x7f949c00ee40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:59.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.203+0000 7f94977fe700 1 -- 172.21.15.82:0/2907361016 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f949c009880 con 0x7f94a8101b10 2023-09-23T08:55:59.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.203+0000 7f94acfff700 1 -- 172.21.15.82:0/2907361016 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94980095f0 con 0x7f94a8101b10 2023-09-23T08:55:59.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.203+0000 7f94977fe700 1 -- 172.21.15.82:0/2907361016 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f949c0044b0 con 0x7f94a8101b10 2023-09-23T08:55:59.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.203+0000 7f94977fe700 1 -- 172.21.15.82:0/2907361016 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f949c003ce0 con 0x7f94a8101b10 2023-09-23T08:55:59.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.203+0000 7f94acfff700 1 -- 172.21.15.82:0/2907361016 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94a819ea10 con 0x7f94a8101b10 2023-09-23T08:55:59.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.204+0000 7f94acfff700 1 -- 172.21.15.82:0/2907361016 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94a810c030 con 0x7f94a8101b10 2023-09-23T08:55:59.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.207+0000 7f94977fe700 1 -- 172.21.15.82:0/2907361016 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 17) v1 ==== 134722+0+0 (secure 0 0 0) 0x7f949c003e40 con 0x7f94a8101b10 2023-09-23T08:55:59.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.209+0000 7f94977fe700 1 --2- 172.21.15.82:0/2907361016 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f94900a0020 0x7f94900a24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:59.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.209+0000 7f94977fe700 1 -- 172.21.15.82:0/2907361016 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f949c014070 con 0x7f94a8101b10 2023-09-23T08:55:59.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.209+0000 7f94a659c700 1 --2- 172.21.15.82:0/2907361016 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f94900a0020 0x7f94900a24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:59.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.210+0000 7f94a659c700 1 --2- 172.21.15.82:0/2907361016 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f94900a0020 0x7f94900a24e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f9498009990 tx=0x7f949800b9b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:59.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.213+0000 7f94977fe700 1 -- 172.21.15.82:0/2907361016 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f949c0954b0 con 0x7f94a8101b10 2023-09-23T08:55:59.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.479+0000 7f94acfff700 1 -- 172.21.15.82:0/2907361016 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f94a810c220 con 0x7f94a8101b10 2023-09-23T08:55:59.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.480+0000 7f94977fe700 1 -- 172.21.15.82:0/2907361016 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+11323 (secure 0 0 0) 0x7f949c098ad0 con 0x7f94a8101b10 2023-09-23T08:55:59.483 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:55:59.483 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/1237857359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1237857359},{"type":"v1","addr":"172.21.15.82:6835","nonce":1237857359}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/1335102362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":1335102362},{"type":"v1","addr":"172.21.15.82:6837","nonce":1335102362}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-23T08:54:52.600479+0000","modified":"2023-09-23T08:55:00.481507+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24557,"mds_1":24550,"mds_2":24526,"mds_3":24515,"mds_4":24514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/3645331700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3645331700},{"type":"v1","addr":"172.21.15.135:6835","nonce":3645331700}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14658":{"gid":14658,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6839/205725278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":205725278},{"type":"v1","addr":"172.21.15.82:6839","nonce":205725278}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14670":{"gid":14670,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6841/2659297867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":2659297867},{"type":"v1","addr":"172.21.15.82:6841","nonce":2659297867}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24461":{"gid":24461,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/503886037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":503886037},{"type":"v1","addr":"172.21.15.135:6833","nonce":503886037}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24463":{"gid":24463,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.161:6833/471569125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":471569125},{"type":"v1","addr":"172.21.15.161:6833","nonce":471569125}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24514":{"gid":24514,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":10,"addr":"172.21.15.161:6835/2237964162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":2237964162},{"type":"v1","addr":"172.21.15.161:6835","nonce":2237964162}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24515":{"gid":24515,"name":"h","rank":3,"incarnation":22,"state":"up:active","state_seq":8,"addr":"172.21.15.135:6837/2655304858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2655304858},{"type":"v1","addr":"172.21.15.135:6837","nonce":2655304858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24526":{"gid":24526,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.161:6837/43639843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":43639843},{"type":"v1","addr":"172.21.15.161:6837","nonce":43639843}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24550":{"gid":24550,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.161:6839/758982817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6838","nonce":758982817},{"type":"v1","addr":"172.21.15.161:6839","nonce":758982817}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24557":{"gid":24557,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6839/2508669274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2508669274},{"type":"v1","addr":"172.21.15.135:6839","nonce":2508669274}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-23T08:55:59.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.483+0000 7f94acfff700 1 -- 172.21.15.82:0/2907361016 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f94900a0020 msgr2=0x7f94900a24e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:59.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.483+0000 7f94acfff700 1 --2- 172.21.15.82:0/2907361016 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f94900a0020 0x7f94900a24e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f9498009990 tx=0x7f949800b9b0 comp rx=0 tx=0).stop 2023-09-23T08:55:59.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.483+0000 7f94acfff700 1 -- 172.21.15.82:0/2907361016 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94a8101b10 msgr2=0x7f94a8196aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:59.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.483+0000 7f94acfff700 1 --2- 172.21.15.82:0/2907361016 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94a8101b10 0x7f94a8196aa0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f949c00eb30 tx=0x7f949c00ee40 comp rx=0 tx=0).stop 2023-09-23T08:55:59.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.483+0000 7f94acfff700 1 -- 172.21.15.82:0/2907361016 shutdown_connections 2023-09-23T08:55:59.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.483+0000 7f94acfff700 1 --2- 172.21.15.82:0/2907361016 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f94900a0020 0x7f94900a24e0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:59.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.483+0000 7f94acfff700 1 --2- 172.21.15.82:0/2907361016 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f94a81024b0 0x7f94a819db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:59.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.483+0000 7f94acfff700 1 --2- 172.21.15.82:0/2907361016 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94a8100920 0x7f94a8196560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:59.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.483+0000 7f94acfff700 1 --2- 172.21.15.82:0/2907361016 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94a8101b10 0x7f94a8196aa0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:59.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.483+0000 7f94acfff700 1 -- 172.21.15.82:0/2907361016 >> 172.21.15.82:0/2907361016 conn(0x7f94a80fbe50 msgr2=0x7f94a80fe190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:59.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.483+0000 7f94acfff700 1 -- 172.21.15.82:0/2907361016 shutdown_connections 2023-09-23T08:55:59.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.483+0000 7f94acfff700 1 -- 172.21.15.82:0/2907361016 wait complete. 2023-09-23T08:55:59.487 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 26 2023-09-23T08:55:59.505 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2023-09-23T08:54:52.600479+0000', 'modified': '2023-09-23T08:55:00.481507+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24557, 'mds_1': 24550, 'mds_2': 24526, 'mds_3': 24515, 'mds_4': 24514}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14598': {'gid': 14598, 'name': 'e', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.135:6835/3645331700', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6834', 'nonce': 3645331700}, {'type': 'v1', 'addr': '172.21.15.135:6835', 'nonce': 3645331700}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_14658': {'gid': 14658, 'name': 'g', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.82:6839/205725278', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6838', 'nonce': 205725278}, {'type': 'v1', 'addr': '172.21.15.82:6839', 'nonce': 205725278}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_14670': {'gid': 14670, 'name': 'a', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.82:6841/2659297867', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6840', 'nonce': 2659297867}, {'type': 'v1', 'addr': '172.21.15.82:6841', 'nonce': 2659297867}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24461': {'gid': 24461, 'name': 'k', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.135:6833/503886037', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6832', 'nonce': 503886037}, {'type': 'v1', 'addr': '172.21.15.135:6833', 'nonce': 503886037}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24463': {'gid': 24463, 'name': 'l', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.161:6833/471569125', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.161:6832', 'nonce': 471569125}, {'type': 'v1', 'addr': '172.21.15.161:6833', 'nonce': 471569125}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24514': {'gid': 24514, 'name': 'f', 'rank': 4, 'incarnation': 24, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.161:6835/2237964162', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.161:6834', 'nonce': 2237964162}, {'type': 'v1', 'addr': '172.21.15.161:6835', 'nonce': 2237964162}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24515': {'gid': 24515, 'name': 'h', 'rank': 3, 'incarnation': 22, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.135:6837/2655304858', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6836', 'nonce': 2655304858}, {'type': 'v1', 'addr': '172.21.15.135:6837', 'nonce': 2655304858}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24526': {'gid': 24526, 'name': 'c', 'rank': 2, 'incarnation': 20, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.161:6837/43639843', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.161:6836', 'nonce': 43639843}, {'type': 'v1', 'addr': '172.21.15.161:6837', 'nonce': 43639843}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24550': {'gid': 24550, 'name': 'i', 'rank': 1, 'incarnation': 18, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.161:6839/758982817', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.161:6838', 'nonce': 758982817}, {'type': 'v1', 'addr': '172.21.15.161:6839', 'nonce': 758982817}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24557': {'gid': 24557, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.135:6839/2508669274', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6838', 'nonce': 2508669274}, {'type': 'v1', 'addr': '172.21.15.135:6839', 'nonce': 2508669274}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-09-23T08:55:59.505 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2023-09-23T08:55:59.505 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2023-09-23T08:55:59.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.709+0000 7f0cc519d700 1 -- 172.21.15.82:0/230400379 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0cc0102330 msgr2=0x7f0cc0108be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:59.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.709+0000 7f0cc519d700 1 --2- 172.21.15.82:0/230400379 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0cc0102330 0x7f0cc0108be0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f0cb800b0d0 tx=0x7f0cb800b3e0 comp rx=0 tx=0).stop 2023-09-23T08:55:59.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.709+0000 7f0cc519d700 1 -- 172.21.15.82:0/230400379 shutdown_connections 2023-09-23T08:55:59.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.709+0000 7f0cc519d700 1 --2- 172.21.15.82:0/230400379 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0cc0102330 0x7f0cc0108be0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:59.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.709+0000 7f0cc519d700 1 --2- 172.21.15.82:0/230400379 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0cc01007a0 0x7f0cc0100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:59.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.709+0000 7f0cc519d700 1 --2- 172.21.15.82:0/230400379 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0cc0101990 0x7f0cc0101df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:59.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.709+0000 7f0cc519d700 1 -- 172.21.15.82:0/230400379 >> 172.21.15.82:0/230400379 conn(0x7f0cc00fbd30 msgr2=0x7f0cc00fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:59.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.709+0000 7f0cc519d700 1 -- 172.21.15.82:0/230400379 shutdown_connections 2023-09-23T08:55:59.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.709+0000 7f0cc519d700 1 -- 172.21.15.82:0/230400379 wait complete. 2023-09-23T08:55:59.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.710+0000 7f0cc519d700 1 Processor -- start 2023-09-23T08:55:59.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.710+0000 7f0cc519d700 1 -- start start 2023-09-23T08:55:59.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.711+0000 7f0cc519d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0cc01007a0 0x7f0cc00746d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:59.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.711+0000 7f0cc519d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0cc0101990 0x7f0cc0072d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:59.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.711+0000 7f0cc519d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0cc0102330 0x7f0cc0073250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:59.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.711+0000 7f0cc519d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc00739f0 con 0x7f0cc0101990 2023-09-23T08:55:59.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.711+0000 7f0cc519d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc0073b60 con 0x7f0cc01007a0 2023-09-23T08:55:59.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.711+0000 7f0cc519d700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc01a03b0 con 0x7f0cc0102330 2023-09-23T08:55:59.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.711+0000 7f0cbf7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0cc0101990 0x7f0cc0072d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:59.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.711+0000 7f0cbffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0cc01007a0 0x7f0cc00746d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:59.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.711+0000 7f0cbffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0cc01007a0 0x7f0cc00746d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:35942/0 (socket says 172.21.15.82:35942) 2023-09-23T08:55:59.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.711+0000 7f0cbffff700 1 -- 172.21.15.82:0/2307515935 learned_addr learned my addr 172.21.15.82:0/2307515935 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:55:59.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.711+0000 7f0cc499c700 1 --2- 172.21.15.82:0/2307515935 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0cc0102330 0x7f0cc0073250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:59.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.712+0000 7f0cbf7fe700 1 -- 172.21.15.82:0/2307515935 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0cc0102330 msgr2=0x7f0cc0073250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:59.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.712+0000 7f0cbf7fe700 1 --2- 172.21.15.82:0/2307515935 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0cc0102330 0x7f0cc0073250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:59.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.712+0000 7f0cbf7fe700 1 -- 172.21.15.82:0/2307515935 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0cc01007a0 msgr2=0x7f0cc00746d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:59.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.712+0000 7f0cbf7fe700 1 --2- 172.21.15.82:0/2307515935 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0cc01007a0 0x7f0cc00746d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:59.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.712+0000 7f0cbf7fe700 1 -- 172.21.15.82:0/2307515935 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cb8009d00 con 0x7f0cc0101990 2023-09-23T08:55:59.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.712+0000 7f0cbffff700 1 --2- 172.21.15.82:0/2307515935 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0cc01007a0 0x7f0cc00746d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T08:55:59.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.712+0000 7f0cbf7fe700 1 --2- 172.21.15.82:0/2307515935 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0cc0101990 0x7f0cc0072d10 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f0cb400e9f0 tx=0x7f0cb400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:59.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.712+0000 7f0cbd7fa700 1 -- 172.21.15.82:0/2307515935 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb400c9c0 con 0x7f0cc0101990 2023-09-23T08:55:59.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.712+0000 7f0cc519d700 1 -- 172.21.15.82:0/2307515935 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cc01a0690 con 0x7f0cc0101990 2023-09-23T08:55:59.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.712+0000 7f0cbd7fa700 1 -- 172.21.15.82:0/2307515935 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0cb4010430 con 0x7f0cc0101990 2023-09-23T08:55:59.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.712+0000 7f0cbd7fa700 1 -- 172.21.15.82:0/2307515935 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb4018680 con 0x7f0cc0101990 2023-09-23T08:55:59.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.712+0000 7f0cc519d700 1 -- 172.21.15.82:0/2307515935 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cc01a0ba0 con 0x7f0cc0101990 2023-09-23T08:55:59.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.716+0000 7f0cbd7fa700 1 -- 172.21.15.82:0/2307515935 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) v1 ==== 134722+0+0 (secure 0 0 0) 0x7f0cb40105a0 con 0x7f0cc0101990 2023-09-23T08:55:59.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.717+0000 7f0cd9c5bb80 1 Processor -- start 2023-09-23T08:55:59.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.717+0000 7f0cd9c5bb80 1 -- start start 2023-09-23T08:55:59.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.717+0000 7f0cd9c5bb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55810977c980 0x55810977cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:59.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.717+0000 7f0cd9c5bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55810977d2e0 0x55810977d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:59.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.718+0000 7f0cd9c5bb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55810977df00 0x55810977e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:59.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.718+0000 7f0cd9c5bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581096e4760 con 0x55810977d2e0 2023-09-23T08:55:59.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.718+0000 7f0cd9c5bb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581096d5730 con 0x55810977df00 2023-09-23T08:55:59.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.718+0000 7f0cd9c5bb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581096d3050 con 0x55810977c980 2023-09-23T08:55:59.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.718+0000 7f0cbffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55810977d2e0 0x55810977d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:59.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.718+0000 7f0cbffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55810977d2e0 0x55810977d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54640/0 (socket says 172.21.15.82:54640) 2023-09-23T08:55:59.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.718+0000 7f0cbffff700 1 -- 172.21.15.82:0/2046524281 learned_addr learned my addr 172.21.15.82:0/2046524281 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:55:59.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.718+0000 7f0cbd7fa700 1 --2- 172.21.15.82:0/2307515935 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f0ca80a0090 0x7f0ca80a2550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:59.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.718+0000 7f0cbf7fe700 1 --2- 172.21.15.82:0/2046524281 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55810977df00 0x55810977e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:59.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.718+0000 7f0cc499c700 1 --2- 172.21.15.82:0/2046524281 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55810977c980 0x55810977cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:59.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.718+0000 7f0cc499c700 1 --2- 172.21.15.82:0/2307515935 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f0ca80a0090 0x7f0ca80a2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:59.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.718+0000 7f0cbffff700 1 -- 172.21.15.82:0/2046524281 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55810977c980 msgr2=0x55810977cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:55:59.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.718+0000 7f0cbffff700 1 --2- 172.21.15.82:0/2046524281 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55810977c980 0x55810977cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:59.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.718+0000 7f0cbd7fa700 1 -- 172.21.15.82:0/2307515935 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f0cb4014070 con 0x7f0cc0101990 2023-09-23T08:55:59.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.718+0000 7f0cbffff700 1 -- 172.21.15.82:0/2046524281 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55810977df00 msgr2=0x55810977e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:55:59.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.718+0000 7f0cbffff700 1 --2- 172.21.15.82:0/2046524281 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55810977df00 0x55810977e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:59.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.718+0000 7f0cbffff700 1 -- 172.21.15.82:0/2046524281 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55810954e5e0 con 0x55810977d2e0 2023-09-23T08:55:59.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.719+0000 7f0cbffff700 1 --2- 172.21.15.82:0/2046524281 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55810977d2e0 0x55810977d920 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f0cb0011650 tx=0x7f0cb0011960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0c35e2871aa61a7 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:59.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.719+0000 7f0ca67fc700 1 -- 172.21.15.82:0/2046524281 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb0004a30 con 0x55810977d2e0 2023-09-23T08:55:59.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.719+0000 7f0ca67fc700 1 -- 172.21.15.82:0/2046524281 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0cb00054b0 con 0x55810977d2e0 2023-09-23T08:55:59.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.719+0000 7f0ca67fc700 1 -- 172.21.15.82:0/2046524281 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb000f8e0 con 0x55810977d2e0 2023-09-23T08:55:59.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.720+0000 7f0cd9c5bb80 1 -- 172.21.15.82:0/2046524281 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55810977d2e0 msgr2=0x55810977d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:59.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.720+0000 7f0cc499c700 1 --2- 172.21.15.82:0/2307515935 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f0ca80a0090 0x7f0ca80a2550 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0cc0074d30 tx=0x7f0cb8006210 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:59.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.720+0000 7f0cd9c5bb80 1 --2- 172.21.15.82:0/2046524281 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55810977d2e0 0x55810977d920 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f0cb0011650 tx=0x7f0cb0011960 comp rx=0 tx=0).stop 2023-09-23T08:55:59.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.720+0000 7f0cd9c5bb80 1 -- 172.21.15.82:0/2046524281 shutdown_connections 2023-09-23T08:55:59.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.720+0000 7f0cd9c5bb80 1 --2- 172.21.15.82:0/2046524281 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55810977df00 0x55810977e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:59.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.720+0000 7f0cd9c5bb80 1 --2- 172.21.15.82:0/2046524281 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55810977c980 0x55810977cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:59.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.720+0000 7f0cd9c5bb80 1 --2- 172.21.15.82:0/2046524281 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55810977d2e0 0x55810977d920 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:59.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.720+0000 7f0cd9c5bb80 1 -- 172.21.15.82:0/2046524281 >> 172.21.15.82:0/2046524281 conn(0x5581096f1090 msgr2=0x558109777420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:59.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.720+0000 7f0cd9c5bb80 1 -- 172.21.15.82:0/2046524281 shutdown_connections 2023-09-23T08:55:59.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.720+0000 7f0cd9c5bb80 1 -- 172.21.15.82:0/2046524281 wait complete. 2023-09-23T08:55:59.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.720+0000 7f0cd9c5bb80 1 -- start start 2023-09-23T08:55:59.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.721+0000 7f0cd9c5bb80 1 Processor -- start 2023-09-23T08:55:59.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.721+0000 7f0cd9c5bb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55810977c980 0x5581097865b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:59.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.721+0000 7f0cd9c5bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55810977d2e0 0x558109786af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:59.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.721+0000 7f0cd9c5bb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55810977df00 0x55810978db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:59.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.721+0000 7f0cd9c5bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581096ce940 con 0x55810977d2e0 2023-09-23T08:55:59.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.721+0000 7f0cd9c5bb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55810966cb60 con 0x55810977c980 2023-09-23T08:55:59.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.721+0000 7f0cd9c5bb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55810966c860 con 0x55810977df00 2023-09-23T08:55:59.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.721+0000 7f0cd9c5bb80 10 client.0 _ll_register_callbacks cb 0x5581095b6a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T08:55:59.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.721+0000 7f0cbffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55810977c980 0x5581097865b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:59.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.722+0000 7f0cbffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55810977c980 0x5581097865b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:35966/0 (socket says 172.21.15.82:35966) 2023-09-23T08:55:59.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.722+0000 7f0cbffff700 1 -- 172.21.15.82:0/2986900406 learned_addr learned my addr 172.21.15.82:0/2986900406 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:55:59.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.722+0000 7f0cbf7fe700 1 --2- 172.21.15.82:0/2986900406 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55810977d2e0 0x558109786af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:59.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.722+0000 7f0cc499c700 1 --2- 172.21.15.82:0/2986900406 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55810977df00 0x55810978db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:59.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.722+0000 7f0cbffff700 1 -- 172.21.15.82:0/2986900406 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55810977df00 msgr2=0x55810978db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:55:59.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.722+0000 7f0cbffff700 1 --2- 172.21.15.82:0/2986900406 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55810977df00 0x55810978db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:59.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.722+0000 7f0cbffff700 1 -- 172.21.15.82:0/2986900406 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55810977d2e0 msgr2=0x558109786af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:55:59.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.722+0000 7f0cbffff700 1 --2- 172.21.15.82:0/2986900406 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55810977d2e0 0x558109786af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:59.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.722+0000 7f0cbffff700 1 -- 172.21.15.82:0/2986900406 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cb0009e10 con 0x55810977c980 2023-09-23T08:55:59.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.722+0000 7f0cc499c700 1 --2- 172.21.15.82:0/2986900406 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55810977df00 0x55810978db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T08:55:59.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.722+0000 7f0cbffff700 1 --2- 172.21.15.82:0/2986900406 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55810977c980 0x5581097865b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0cb0005950 tx=0x7f0cb00051d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f0e62e756c67585 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:59.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.722+0000 7f0c9f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-09-23T08:55:59.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.723+0000 7f0c9f7fe700 1 -- 172.21.15.82:0/2986900406 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb0005ce0 con 0x55810977c980 2023-09-23T08:55:59.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.723+0000 7f0c9f7fe700 1 -- 172.21.15.82:0/2986900406 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f0cb0005550 con 0x55810977c980 2023-09-23T08:55:59.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.723+0000 7f0cd9c5bb80 1 -- 172.21.15.82:0/2986900406 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55810974c170 con 0x55810977c980 2023-09-23T08:55:59.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.723+0000 7f0c9f7fe700 1 -- 172.21.15.82:0/2986900406 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0cb000f620 con 0x55810977c980 2023-09-23T08:55:59.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.723+0000 7f0cd9c5bb80 10 client.24899 fetch_fsmap learned FSMap version 26 2023-09-23T08:55:59.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.723+0000 7f0cd9c5bb80 1 -- 172.21.15.82:0/2986900406 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5581094fad90 con 0x55810977c980 2023-09-23T08:55:59.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.723+0000 7f0c9f7fe700 1 -- 172.21.15.82:0/2986900406 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55810974c170 con 0x55810977c980 2023-09-23T08:55:59.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.723+0000 7f0c9f7fe700 1 -- 172.21.15.82:0/2986900406 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f0cb0024550 con 0x55810977c980 2023-09-23T08:55:59.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.723+0000 7f0cd9c5bb80 10 client.24899 fetch_fsmap finished waiting for FSMap version 26 2023-09-23T08:55:59.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.723+0000 7f0cd9c5bb80 10 client.24899 resolve_mds: resolved name 'f' to daemon mds.f 2023-09-23T08:55:59.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.723+0000 7f0cd9c5bb80 20 client.24899 populate_metadata read hostname 'smithi082' 2023-09-23T08:55:59.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.723+0000 7f0cd9c5bb80 1 --2- 172.21.15.82:0/2986900406 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x5581097920d0 0x558109790be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:59.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.723+0000 7f0cd9c5bb80 4 client.24899 mds_command: new command op to 24514 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T08:55:59.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.723+0000 7f0cd9c5bb80 1 -- 172.21.15.82:0/2986900406 --> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558109674b50 con 0x5581097920d0 2023-09-23T08:55:59.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.724+0000 7f0cbf7fe700 1 --2- 172.21.15.82:0/2986900406 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x5581097920d0 0x558109790be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:59.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.724+0000 7f0c9f7fe700 10 client.24899 ms_handle_connect on v2:172.21.15.161:6834/2237964162 2023-09-23T08:55:59.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.724+0000 7f0cbf7fe700 1 --2- 172.21.15.82:0/2986900406 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x5581097920d0 0x558109790be0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=ee6810762a84eaca server_cookie=21b3ff8dd9cded45 in_seq=0 out_seq=0 2023-09-23T08:55:59.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.725+0000 7f0c9f7fe700 1 -- 172.21.15.82:0/2986900406 <== mds.4 v2:172.21.15.161:6834/2237964162 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558109674b50 con 0x5581097920d0 2023-09-23T08:55:59.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.725+0000 7f0c9f7fe700 10 client.24899 handle_command_reply: tid=0 2023-09-23T08:55:59.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.725+0000 7f0cd9c5bb80 1 client.24899 shutdown 2023-09-23T08:55:59.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.725+0000 7f0cd9c5bb80 1 -- 172.21.15.82:0/2986900406 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55810977c980 msgr2=0x5581097865b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:59.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.725+0000 7f0cd9c5bb80 1 --2- 172.21.15.82:0/2986900406 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55810977c980 0x5581097865b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0cb0005950 tx=0x7f0cb00051d0 comp rx=0 tx=0).stop 2023-09-23T08:55:59.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.726+0000 7f0cd9c5bb80 1 -- 172.21.15.82:0/2986900406 shutdown_connections 2023-09-23T08:55:59.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.726+0000 7f0cd9c5bb80 1 --2- 172.21.15.82:0/2986900406 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x5581097920d0 0x558109790be0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:59.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.726+0000 7f0cd9c5bb80 1 --2- 172.21.15.82:0/2986900406 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55810977df00 0x55810978db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:59.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.726+0000 7f0cd9c5bb80 1 --2- 172.21.15.82:0/2986900406 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55810977c980 0x5581097865b0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:59.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.726+0000 7f0cd9c5bb80 1 --2- 172.21.15.82:0/2986900406 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55810977d2e0 0x558109786af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:59.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.726+0000 7f0c9f7fe700 0 client.24899 ms_handle_reset on v2:172.21.15.161:6834/2237964162 2023-09-23T08:55:59.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.726+0000 7f0cd9c5bb80 1 -- 172.21.15.82:0/2986900406 >> 172.21.15.82:0/2986900406 conn(0x5581096f1090 msgr2=0x55810977b6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:59.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.726+0000 7f0cd9c5bb80 1 -- 172.21.15.82:0/2986900406 shutdown_connections 2023-09-23T08:55:59.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.726+0000 7f0cd9c5bb80 1 -- 172.21.15.82:0/2986900406 wait complete. 2023-09-23T08:55:59.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.726+0000 7f0cd9c5bb80 20 client.24899 trim_cache size 0 max 16384 2023-09-23T08:55:59.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.744+0000 7f0cd9c5bb80 1 Processor -- start 2023-09-23T08:55:59.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.744+0000 7f0cd9c5bb80 1 -- start start 2023-09-23T08:55:59.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.744+0000 7f0cd9c5bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55810977c980 0x55810978e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:59.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.744+0000 7f0cd9c5bb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55810977d2e0 0x55810978da50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:59.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.744+0000 7f0cd9c5bb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55810977df00 0x558109784300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:59.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.744+0000 7f0cd9c5bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581095508d0 con 0x55810977c980 2023-09-23T08:55:59.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.744+0000 7f0cd9c5bb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55810977d7e0 con 0x55810977df00 2023-09-23T08:55:59.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.744+0000 7f0cd9c5bb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55810955cde0 con 0x55810977d2e0 2023-09-23T08:55:59.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.744+0000 7f0cbffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55810977c980 0x55810978e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:59.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.745+0000 7f0cbffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55810977c980 0x55810978e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54664/0 (socket says 172.21.15.82:54664) 2023-09-23T08:55:59.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.745+0000 7f0cbffff700 1 -- 172.21.15.82:0/2327984666 learned_addr learned my addr 172.21.15.82:0/2327984666 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:55:59.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.745+0000 7f0cbf7fe700 1 --2- 172.21.15.82:0/2327984666 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55810977d2e0 0x55810978da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:59.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.745+0000 7f0cc499c700 1 --2- 172.21.15.82:0/2327984666 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55810977df00 0x558109784300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:59.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.745+0000 7f0cbffff700 1 -- 172.21.15.82:0/2327984666 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55810977d2e0 msgr2=0x55810978da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:55:59.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.745+0000 7f0cbffff700 1 --2- 172.21.15.82:0/2327984666 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55810977d2e0 0x55810978da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:59.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.745+0000 7f0cbffff700 1 -- 172.21.15.82:0/2327984666 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55810977df00 msgr2=0x558109784300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:55:59.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.745+0000 7f0cbffff700 1 --2- 172.21.15.82:0/2327984666 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55810977df00 0x558109784300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:59.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.745+0000 7f0cbffff700 1 -- 172.21.15.82:0/2327984666 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5581094e3c10 con 0x55810977c980 2023-09-23T08:55:59.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.745+0000 7f0cc499c700 1 --2- 172.21.15.82:0/2327984666 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55810977df00 0x558109784300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T08:55:59.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.745+0000 7f0cbffff700 1 --2- 172.21.15.82:0/2327984666 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55810977c980 0x55810978e3c0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f0cb0004ce0 tx=0x7f0cb0001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be279ac53ba89dd5 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:59.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.745+0000 7f0ca6ffd700 1 -- 172.21.15.82:0/2327984666 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb0005550 con 0x55810977c980 2023-09-23T08:55:59.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.745+0000 7f0ca6ffd700 1 -- 172.21.15.82:0/2327984666 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0cb0024430 con 0x55810977c980 2023-09-23T08:55:59.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.745+0000 7f0ca6ffd700 1 -- 172.21.15.82:0/2327984666 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb000fb70 con 0x55810977c980 2023-09-23T08:55:59.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.746+0000 7f0cd9c5bb80 1 -- 172.21.15.82:0/2327984666 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55810977c980 msgr2=0x55810978e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:59.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.746+0000 7f0cd9c5bb80 1 --2- 172.21.15.82:0/2327984666 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55810977c980 0x55810978e3c0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f0cb0004ce0 tx=0x7f0cb0001e50 comp rx=0 tx=0).stop 2023-09-23T08:55:59.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.746+0000 7f0cd9c5bb80 1 -- 172.21.15.82:0/2327984666 shutdown_connections 2023-09-23T08:55:59.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.746+0000 7f0cd9c5bb80 1 --2- 172.21.15.82:0/2327984666 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55810977df00 0x558109784300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:59.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.746+0000 7f0cd9c5bb80 1 --2- 172.21.15.82:0/2327984666 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55810977c980 0x55810978e3c0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:59.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.746+0000 7f0cd9c5bb80 1 --2- 172.21.15.82:0/2327984666 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55810977d2e0 0x55810978da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:59.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.746+0000 7f0cd9c5bb80 1 -- 172.21.15.82:0/2327984666 >> 172.21.15.82:0/2327984666 conn(0x5581096f1090 msgr2=0x558109785280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:59.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.746+0000 7f0cd9c5bb80 1 -- 172.21.15.82:0/2327984666 shutdown_connections 2023-09-23T08:55:59.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.747+0000 7f0cd9c5bb80 1 -- 172.21.15.82:0/2327984666 wait complete. 2023-09-23T08:55:59.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.747+0000 7f0cd9c5bb80 1 -- start start 2023-09-23T08:55:59.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.747+0000 7f0cd9c5bb80 1 Processor -- start 2023-09-23T08:55:59.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.748+0000 7f0cd9c5bb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55810977c980 0x55810978cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:59.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.748+0000 7f0cd9c5bb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55810977d2e0 0x55810978d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:59.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.748+0000 7f0cd9c5bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55810977df00 0x55810978d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:59.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.748+0000 7f0cd9c5bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55810978df60 con 0x55810977df00 2023-09-23T08:55:59.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.748+0000 7f0cd9c5bb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581097e5ac0 con 0x55810977d2e0 2023-09-23T08:55:59.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.748+0000 7f0cd9c5bb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581097e5c30 con 0x55810977c980 2023-09-23T08:55:59.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.748+0000 7f0cd9c5bb80 10 client.0 _ll_register_callbacks cb 0x7f0cb00114d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T08:55:59.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.748+0000 7f0cbffff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55810977c980 0x55810978cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:59.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.748+0000 7f0cc499c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55810977df00 0x55810978d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:59.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.748+0000 7f0cbffff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55810977c980 0x55810978cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:42212/0 (socket says 172.21.15.82:42212) 2023-09-23T08:55:59.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.748+0000 7f0cbffff700 1 -- 172.21.15.82:0/754219567 learned_addr learned my addr 172.21.15.82:0/754219567 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:55:59.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.748+0000 7f0cbf7fe700 1 --2- 172.21.15.82:0/754219567 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55810977d2e0 0x55810978d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:59.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.748+0000 7f0cbffff700 1 -- 172.21.15.82:0/754219567 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55810977d2e0 msgr2=0x55810978d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:55:59.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.748+0000 7f0cbffff700 1 --2- 172.21.15.82:0/754219567 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55810977d2e0 0x55810978d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:59.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.748+0000 7f0cbffff700 1 -- 172.21.15.82:0/754219567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55810977df00 msgr2=0x55810978d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:55:59.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.748+0000 7f0cbffff700 1 --2- 172.21.15.82:0/754219567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55810977df00 0x55810978d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:59.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.748+0000 7f0cbffff700 1 -- 172.21.15.82:0/754219567 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5581094fad90 con 0x55810977c980 2023-09-23T08:55:59.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.749+0000 7f0cbffff700 1 --2- 172.21.15.82:0/754219567 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55810977c980 0x55810978cce0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0cb00092a0 tx=0x7f0cb0004d10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd1c5d216dde837a server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:55:59.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.749+0000 7f0c9f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T08:55:59.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.749+0000 7f0c9f7fe700 1 -- 172.21.15.82:0/754219567 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb002d640 con 0x55810977c980 2023-09-23T08:55:59.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.749+0000 7f0cd9c5bb80 1 -- 172.21.15.82:0/754219567 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55810976f860 con 0x55810977c980 2023-09-23T08:55:59.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.749+0000 7f0c9f7fe700 1 -- 172.21.15.82:0/754219567 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f0cb0005610 con 0x55810977c980 2023-09-23T08:55:59.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.749+0000 7f0c9f7fe700 1 -- 172.21.15.82:0/754219567 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0cb002d7a0 con 0x55810977c980 2023-09-23T08:55:59.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.749+0000 7f0cd9c5bb80 10 client.24931 fetch_fsmap learned FSMap version 26 2023-09-23T08:55:59.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.749+0000 7f0cd9c5bb80 1 -- 172.21.15.82:0/754219567 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x558109521200 con 0x55810977c980 2023-09-23T08:55:59.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.750+0000 7f0c9f7fe700 1 -- 172.21.15.82:0/754219567 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55810976f860 con 0x55810977c980 2023-09-23T08:55:59.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.750+0000 7f0c9f7fe700 1 -- 172.21.15.82:0/754219567 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f0cb0041070 con 0x55810977c980 2023-09-23T08:55:59.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.750+0000 7f0cd9c5bb80 10 client.24931 fetch_fsmap finished waiting for FSMap version 26 2023-09-23T08:55:59.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.750+0000 7f0cd9c5bb80 10 client.24931 resolve_mds: resolved name 'f' to daemon mds.f 2023-09-23T08:55:59.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.750+0000 7f0cd9c5bb80 20 client.24931 populate_metadata read hostname 'smithi082' 2023-09-23T08:55:59.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.750+0000 7f0cd9c5bb80 1 --2- 172.21.15.82:0/754219567 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x5581097ea980 0x5581097e6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:55:59.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.750+0000 7f0cd9c5bb80 4 client.24931 mds_command: new command op to 24514 tid=0[{"prefix": "status"}] 2023-09-23T08:55:59.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.750+0000 7f0cd9c5bb80 1 -- 172.21.15.82:0/754219567 --> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5581096c7920 con 0x5581097ea980 2023-09-23T08:55:59.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.750+0000 7f0cbf7fe700 1 --2- 172.21.15.82:0/754219567 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x5581097ea980 0x5581097e6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:55:59.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.751+0000 7f0c9f7fe700 10 client.24931 ms_handle_connect on v2:172.21.15.161:6834/2237964162 2023-09-23T08:55:59.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.751+0000 7f0cbf7fe700 1 --2- 172.21.15.82:0/754219567 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x5581097ea980 0x5581097e6e00 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=f86e936e656bfa68 server_cookie=799c3a4c98ffc499 in_seq=0 out_seq=0 2023-09-23T08:55:59.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.751+0000 7f0c9f7fe700 1 -- 172.21.15.82:0/754219567 <== mds.4 v2:172.21.15.161:6834/2237964162 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x5581096c7920 con 0x5581097ea980 2023-09-23T08:55:59.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.751+0000 7f0c9f7fe700 10 client.24931 handle_command_reply: tid=0 2023-09-23T08:55:59.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.751+0000 7f0cd9c5bb80 1 client.24931 shutdown 2023-09-23T08:55:59.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.751+0000 7f0cd9c5bb80 1 -- 172.21.15.82:0/754219567 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55810977c980 msgr2=0x55810978cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:59.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.751+0000 7f0cd9c5bb80 1 --2- 172.21.15.82:0/754219567 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55810977c980 0x55810978cce0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0cb00092a0 tx=0x7f0cb0004d10 comp rx=0 tx=0).stop 2023-09-23T08:55:59.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.751+0000 7f0cd9c5bb80 1 -- 172.21.15.82:0/754219567 shutdown_connections 2023-09-23T08:55:59.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.751+0000 7f0cd9c5bb80 1 --2- 172.21.15.82:0/754219567 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x5581097ea980 0x5581097e6e00 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:59.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.751+0000 7f0cd9c5bb80 1 --2- 172.21.15.82:0/754219567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55810977df00 0x55810978d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:59.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.751+0000 7f0c9f7fe700 0 client.24931 ms_handle_reset on v2:172.21.15.161:6834/2237964162 2023-09-23T08:55:59.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.751+0000 7f0cd9c5bb80 1 --2- 172.21.15.82:0/754219567 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55810977c980 0x55810978cce0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:59.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.751+0000 7f0cd9c5bb80 1 --2- 172.21.15.82:0/754219567 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55810977d2e0 0x55810978d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:59.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.751+0000 7f0cd9c5bb80 1 -- 172.21.15.82:0/754219567 >> 172.21.15.82:0/754219567 conn(0x5581096f1090 msgr2=0x558109784300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:59.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.752+0000 7f0cd9c5bb80 1 -- 172.21.15.82:0/754219567 shutdown_connections 2023-09-23T08:55:59.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.752+0000 7f0cd9c5bb80 1 -- 172.21.15.82:0/754219567 wait complete. 2023-09-23T08:55:59.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.752+0000 7f0cd9c5bb80 20 client.24931 trim_cache size 0 max 16384 2023-09-23T08:55:59.794 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T08:55:59.794 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "8926e286-59ed-11ee-8db4-212e2dc638e7", 2023-09-23T08:55:59.794 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 4, 2023-09-23T08:55:59.794 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 24514, 2023-09-23T08:55:59.794 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2023-09-23T08:55:59.794 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2023-09-23T08:55:59.795 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2023-09-23T08:55:59.795 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 60.294600048, 2023-09-23T08:55:59.795 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 26, 2023-09-23T08:55:59.795 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 88, 2023-09-23T08:55:59.795 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 86, 2023-09-23T08:55:59.795 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 92.839618455999997 2023-09-23T08:55:59.796 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T08:55:59.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.752+0000 7f0cc519d700 1 -- 172.21.15.82:0/2307515935 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f0ca80a0090 msgr2=0x7f0ca80a2550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:59.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.752+0000 7f0cc519d700 1 --2- 172.21.15.82:0/2307515935 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f0ca80a0090 0x7f0ca80a2550 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0cc0074d30 tx=0x7f0cb8006210 comp rx=0 tx=0).stop 2023-09-23T08:55:59.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.752+0000 7f0cc519d700 1 -- 172.21.15.82:0/2307515935 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0cc0101990 msgr2=0x7f0cc0072d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:55:59.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.752+0000 7f0cc519d700 1 --2- 172.21.15.82:0/2307515935 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0cc0101990 0x7f0cc0072d10 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f0cb400e9f0 tx=0x7f0cb400ed00 comp rx=0 tx=0).stop 2023-09-23T08:55:59.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.752+0000 7f0cc519d700 1 -- 172.21.15.82:0/2307515935 shutdown_connections 2023-09-23T08:55:59.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.752+0000 7f0cc519d700 1 --2- 172.21.15.82:0/2307515935 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f0ca80a0090 0x7f0ca80a2550 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:59.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.752+0000 7f0cc519d700 1 --2- 172.21.15.82:0/2307515935 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0cc0102330 0x7f0cc0073250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:59.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.752+0000 7f0cc519d700 1 --2- 172.21.15.82:0/2307515935 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0cc01007a0 0x7f0cc00746d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:59.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.752+0000 7f0cc519d700 1 --2- 172.21.15.82:0/2307515935 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0cc0101990 0x7f0cc0072d10 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:55:59.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.752+0000 7f0cc519d700 1 -- 172.21.15.82:0/2307515935 >> 172.21.15.82:0/2307515935 conn(0x7f0cc00fbd30 msgr2=0x7f0cc00fde40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:55:59.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.753+0000 7f0cc519d700 1 -- 172.21.15.82:0/2307515935 shutdown_connections 2023-09-23T08:55:59.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.753+0000 7f0cc519d700 1 -- 172.21.15.82:0/2307515935 wait complete. 2023-09-23T08:55:59.798 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:59 smithi082 ceph-mon[97694]: pgmap v336: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-09-23T08:55:59.798 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:59 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/535889403' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T08:55:59.798 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:59 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:55:59.798 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:59 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:55:59.798 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:59 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:55:59.798 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:59 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:55:59.798 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:59 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/1498978618' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-23T08:55:59.798 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:59 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:55:59.798 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:55:59 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:55:59.799 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.h status 2023-09-23T08:55:59.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:59 smithi135 ceph-mon[99205]: pgmap v336: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-09-23T08:55:59.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:59 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/535889403' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T08:55:59.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:59 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:55:59.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:59 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:55:59.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:59 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:55:59.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:59 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:55:59.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:59 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/1498978618' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-23T08:55:59.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:59 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:55:59.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:55:59 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:55:59.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:59 smithi161 ceph-mon[99580]: pgmap v336: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-09-23T08:55:59.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:59 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/535889403' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T08:55:59.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:59 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:55:59.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:59 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:55:59.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:59 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:55:59.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:59 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:55:59.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:59 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/1498978618' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-23T08:55:59.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:59 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:55:59.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:55:59 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:56:00.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.999+0000 7fd0b07ff700 1 -- 172.21.15.82:0/2216589603 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0a8100930 msgr2=0x7fd0a8100d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:00.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.999+0000 7fd0b07ff700 1 --2- 172.21.15.82:0/2216589603 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0a8100930 0x7fd0a8100d50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd0a40099c0 tx=0x7fd0a4009cd0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.999+0000 7fd0b07ff700 1 -- 172.21.15.82:0/2216589603 shutdown_connections 2023-09-23T08:56:00.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.999+0000 7fd0b07ff700 1 --2- 172.21.15.82:0/2216589603 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0a81024c0 0x7fd0a8108d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.999+0000 7fd0b07ff700 1 --2- 172.21.15.82:0/2216589603 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0a8100930 0x7fd0a8100d50 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.999+0000 7fd0b07ff700 1 --2- 172.21.15.82:0/2216589603 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd0a8101b20 0x7fd0a8101f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.999+0000 7fd0b07ff700 1 -- 172.21.15.82:0/2216589603 >> 172.21.15.82:0/2216589603 conn(0x7fd0a80fbea0 msgr2=0x7fd0a80fe2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:00.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.999+0000 7fd0b07ff700 1 -- 172.21.15.82:0/2216589603 shutdown_connections 2023-09-23T08:56:00.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:55:59.999+0000 7fd0b07ff700 1 -- 172.21.15.82:0/2216589603 wait complete. 2023-09-23T08:56:00.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.000+0000 7fd0b07ff700 1 Processor -- start 2023-09-23T08:56:00.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.001+0000 7fd0b07ff700 1 -- start start 2023-09-23T08:56:00.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.001+0000 7fd0b07ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd0a8100930 0x7fd0a80746d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:00.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.001+0000 7fd0b07ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0a8101b20 0x7fd0a8072d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:00.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.001+0000 7fd0b07ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0a81024c0 0x7fd0a8073250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:00.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.001+0000 7fd0b07ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a80739f0 con 0x7fd0a81024c0 2023-09-23T08:56:00.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.001+0000 7fd0b07ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a8073b60 con 0x7fd0a8101b20 2023-09-23T08:56:00.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.001+0000 7fd0b07ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a81a0670 con 0x7fd0a8100930 2023-09-23T08:56:00.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.001+0000 7fd0aed9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0a81024c0 0x7fd0a8073250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:00.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.001+0000 7fd0aed9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0a81024c0 0x7fd0a8073250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54690/0 (socket says 172.21.15.82:54690) 2023-09-23T08:56:00.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.001+0000 7fd0aed9c700 1 -- 172.21.15.82:0/3301705136 learned_addr learned my addr 172.21.15.82:0/3301705136 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:00.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.001+0000 7fd0ae59b700 1 --2- 172.21.15.82:0/3301705136 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd0a8100930 0x7fd0a80746d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:00.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.001+0000 7fd0add9a700 1 --2- 172.21.15.82:0/3301705136 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0a8101b20 0x7fd0a8072d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:00.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.002+0000 7fd0aed9c700 1 -- 172.21.15.82:0/3301705136 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd0a8100930 msgr2=0x7fd0a80746d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:00.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.002+0000 7fd0aed9c700 1 --2- 172.21.15.82:0/3301705136 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd0a8100930 0x7fd0a80746d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.002+0000 7fd0aed9c700 1 -- 172.21.15.82:0/3301705136 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0a8101b20 msgr2=0x7fd0a8072d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:00.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.002+0000 7fd0aed9c700 1 --2- 172.21.15.82:0/3301705136 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0a8101b20 0x7fd0a8072d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.002+0000 7fd0aed9c700 1 -- 172.21.15.82:0/3301705136 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0a0009c40 con 0x7fd0a81024c0 2023-09-23T08:56:00.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.002+0000 7fd0add9a700 1 --2- 172.21.15.82:0/3301705136 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0a8101b20 0x7fd0a8072d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T08:56:00.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.002+0000 7fd0aed9c700 1 --2- 172.21.15.82:0/3301705136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0a81024c0 0x7fd0a8073250 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fd0a000c370 tx=0x7fd0a000c680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:00.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.002+0000 7fd09f7fe700 1 -- 172.21.15.82:0/3301705136 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a0017070 con 0x7fd0a81024c0 2023-09-23T08:56:00.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.002+0000 7fd09f7fe700 1 -- 172.21.15.82:0/3301705136 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd0a000f040 con 0x7fd0a81024c0 2023-09-23T08:56:00.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.002+0000 7fd0b07ff700 1 -- 172.21.15.82:0/3301705136 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0a40095f0 con 0x7fd0a81024c0 2023-09-23T08:56:00.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.002+0000 7fd09f7fe700 1 -- 172.21.15.82:0/3301705136 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a000e050 con 0x7fd0a81024c0 2023-09-23T08:56:00.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.002+0000 7fd0b07ff700 1 -- 172.21.15.82:0/3301705136 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0a81a0c20 con 0x7fd0a81024c0 2023-09-23T08:56:00.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.006+0000 7fd09f7fe700 1 -- 172.21.15.82:0/3301705136 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) v1 ==== 134722+0+0 (secure 0 0 0) 0x7fd0a000cb60 con 0x7fd0a81024c0 2023-09-23T08:56:00.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.006+0000 7fd0c41c4b80 1 Processor -- start 2023-09-23T08:56:00.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.006+0000 7fd0c41c4b80 1 -- start start 2023-09-23T08:56:00.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.007+0000 7fd0c41c4b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fd43bc3980 0x55fd43bc3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:00.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.007+0000 7fd0c41c4b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fd43bc42e0 0x55fd43bc4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:00.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.007+0000 7fd0c41c4b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fd43bc4d00 0x55fd43bc5180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:00.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.007+0000 7fd0c41c4b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd43b2b760 con 0x55fd43bc4d00 2023-09-23T08:56:00.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.007+0000 7fd0c41c4b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd43b1c730 con 0x55fd43bc42e0 2023-09-23T08:56:00.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.007+0000 7fd0c41c4b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd43b1a050 con 0x55fd43bc3980 2023-09-23T08:56:00.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.007+0000 7fd0add9a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fd43bc3980 0x55fd43bc3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:00.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.007+0000 7fd0add9a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fd43bc4d00 0x55fd43bc5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:00.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.007+0000 7fd0add9a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fd43bc4d00 0x55fd43bc5180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54706/0 (socket says 172.21.15.82:54706) 2023-09-23T08:56:00.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.007+0000 7fd0add9a700 1 -- 172.21.15.82:0/2909198086 learned_addr learned my addr 172.21.15.82:0/2909198086 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:00.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.007+0000 7fd0ae59b700 1 --2- 172.21.15.82:0/2909198086 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fd43bc42e0 0x55fd43bc4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:00.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.008+0000 7fd0add9a700 1 -- 172.21.15.82:0/2909198086 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fd43bc3980 msgr2=0x55fd43bc3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:56:00.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.008+0000 7fd0add9a700 1 --2- 172.21.15.82:0/2909198086 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fd43bc3980 0x55fd43bc3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.008+0000 7fd0add9a700 1 -- 172.21.15.82:0/2909198086 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fd43bc42e0 msgr2=0x55fd43bc4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:56:00.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.008+0000 7fd0add9a700 1 --2- 172.21.15.82:0/2909198086 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fd43bc42e0 0x55fd43bc4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.008+0000 7fd0add9a700 1 -- 172.21.15.82:0/2909198086 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fd439955e0 con 0x55fd43bc4d00 2023-09-23T08:56:00.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.008+0000 7fd09f7fe700 1 --2- 172.21.15.82:0/3301705136 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fd09409ffe0 0x7fd0940a24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:00.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.008+0000 7fd0add9a700 1 --2- 172.21.15.82:0/2909198086 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fd43bc4d00 0x55fd43bc5180 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fd098010df0 tx=0x7fd098009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=472c580443dcccc2 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:00.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.008+0000 7fd09f7fe700 1 -- 172.21.15.82:0/3301705136 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fd0a00cacd0 con 0x7fd0a81024c0 2023-09-23T08:56:00.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.008+0000 7fd0ae59b700 1 --2- 172.21.15.82:0/3301705136 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fd09409ffe0 0x7fd0940a24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:00.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.008+0000 7fd09cff9700 1 -- 172.21.15.82:0/2909198086 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd09800fbb0 con 0x55fd43bc4d00 2023-09-23T08:56:00.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.008+0000 7fd09cff9700 1 -- 172.21.15.82:0/2909198086 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd09800fd10 con 0x55fd43bc4d00 2023-09-23T08:56:00.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.008+0000 7fd09cff9700 1 -- 172.21.15.82:0/2909198086 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0980053a0 con 0x55fd43bc4d00 2023-09-23T08:56:00.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.009+0000 7fd0c41c4b80 1 -- 172.21.15.82:0/2909198086 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fd43bc4d00 msgr2=0x55fd43bc5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:00.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.009+0000 7fd0ae59b700 1 --2- 172.21.15.82:0/3301705136 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fd09409ffe0 0x7fd0940a24a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd0a4000c00 tx=0x7fd0a4009550 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:00.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.009+0000 7fd0c41c4b80 1 --2- 172.21.15.82:0/2909198086 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fd43bc4d00 0x55fd43bc5180 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fd098010df0 tx=0x7fd098009260 comp rx=0 tx=0).stop 2023-09-23T08:56:00.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.009+0000 7fd0c41c4b80 1 -- 172.21.15.82:0/2909198086 shutdown_connections 2023-09-23T08:56:00.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.009+0000 7fd0c41c4b80 1 --2- 172.21.15.82:0/2909198086 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fd43bc4d00 0x55fd43bc5180 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.009+0000 7fd0c41c4b80 1 --2- 172.21.15.82:0/2909198086 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fd43bc3980 0x55fd43bc3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.009+0000 7fd0c41c4b80 1 --2- 172.21.15.82:0/2909198086 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fd43bc42e0 0x55fd43bc4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.009+0000 7fd0c41c4b80 1 -- 172.21.15.82:0/2909198086 >> 172.21.15.82:0/2909198086 conn(0x55fd43b38090 msgr2=0x55fd43bbe250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:00.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.009+0000 7fd0c41c4b80 1 -- 172.21.15.82:0/2909198086 shutdown_connections 2023-09-23T08:56:00.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.009+0000 7fd0c41c4b80 1 -- 172.21.15.82:0/2909198086 wait complete. 2023-09-23T08:56:00.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.010+0000 7fd0c41c4b80 1 -- start start 2023-09-23T08:56:00.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.010+0000 7fd0c41c4b80 1 Processor -- start 2023-09-23T08:56:00.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.010+0000 7fd0c41c4b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fd43bc3980 0x55fd43bcd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:00.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.010+0000 7fd0c41c4b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fd43bc42e0 0x55fd43bcd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:00.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.010+0000 7fd0c41c4b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fd43bc4d00 0x55fd43bd4970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:00.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.010+0000 7fd0c41c4b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd43b15940 con 0x55fd43bc4d00 2023-09-23T08:56:00.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.010+0000 7fd0c41c4b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd43ab3b60 con 0x55fd43bc42e0 2023-09-23T08:56:00.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.010+0000 7fd0c41c4b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd43ab3860 con 0x55fd43bc3980 2023-09-23T08:56:00.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.011+0000 7fd0c41c4b80 10 client.0 _ll_register_callbacks cb 0x55fd439fda30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T08:56:00.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.011+0000 7fd0aed9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fd43bc4d00 0x55fd43bd4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:00.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.011+0000 7fd0aed9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fd43bc4d00 0x55fd43bd4970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54720/0 (socket says 172.21.15.82:54720) 2023-09-23T08:56:00.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.011+0000 7fd0aed9c700 1 -- 172.21.15.82:0/2082594085 learned_addr learned my addr 172.21.15.82:0/2082594085 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:00.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.011+0000 7fd0add9a700 1 --2- 172.21.15.82:0/2082594085 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fd43bc42e0 0x55fd43bcd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:00.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.011+0000 7fd0ae59b700 1 --2- 172.21.15.82:0/2082594085 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fd43bc3980 0x55fd43bcd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:00.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.011+0000 7fd0aed9c700 1 -- 172.21.15.82:0/2082594085 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fd43bc3980 msgr2=0x55fd43bcd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:56:00.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.011+0000 7fd0aed9c700 1 --2- 172.21.15.82:0/2082594085 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fd43bc3980 0x55fd43bcd3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.011+0000 7fd0aed9c700 1 -- 172.21.15.82:0/2082594085 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fd43bc42e0 msgr2=0x55fd43bcd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:56:00.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.011+0000 7fd0aed9c700 1 --2- 172.21.15.82:0/2082594085 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fd43bc42e0 0x55fd43bcd930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.011+0000 7fd0aed9c700 1 -- 172.21.15.82:0/2082594085 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd098010aa0 con 0x55fd43bc4d00 2023-09-23T08:56:00.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.011+0000 7fd0aed9c700 1 --2- 172.21.15.82:0/2082594085 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fd43bc4d00 0x55fd43bd4970 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fd0a009feb0 tx=0x7fd0a0098b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4d2b7bf98f2e286 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:00.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.011+0000 7fd091ffb700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T08:56:00.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.012+0000 7fd091ffb700 1 -- 172.21.15.82:0/2082594085 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a00192c0 con 0x55fd43bc4d00 2023-09-23T08:56:00.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.012+0000 7fd091ffb700 1 -- 172.21.15.82:0/2082594085 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fd0a000ce10 con 0x55fd43bc4d00 2023-09-23T08:56:00.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.012+0000 7fd0c41c4b80 1 -- 172.21.15.82:0/2082594085 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fd43b93170 con 0x55fd43bc4d00 2023-09-23T08:56:00.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.012+0000 7fd091ffb700 1 -- 172.21.15.82:0/2082594085 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd0a0098cd0 con 0x55fd43bc4d00 2023-09-23T08:56:00.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.012+0000 7fd0c41c4b80 10 client.15108 fetch_fsmap learned FSMap version 26 2023-09-23T08:56:00.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.012+0000 7fd0c41c4b80 1 -- 172.21.15.82:0/2082594085 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55fd43941d90 con 0x55fd43bc4d00 2023-09-23T08:56:00.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.012+0000 7fd091ffb700 1 -- 172.21.15.82:0/2082594085 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55fd43b93170 con 0x55fd43bc4d00 2023-09-23T08:56:00.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.012+0000 7fd091ffb700 1 -- 172.21.15.82:0/2082594085 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fd0a00830d0 con 0x55fd43bc4d00 2023-09-23T08:56:00.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.012+0000 7fd0c41c4b80 10 client.15108 fetch_fsmap finished waiting for FSMap version 26 2023-09-23T08:56:00.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.012+0000 7fd0c41c4b80 10 client.15108 resolve_mds: resolved name 'h' to daemon mds.h 2023-09-23T08:56:00.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.012+0000 7fd0c41c4b80 20 client.15108 populate_metadata read hostname 'smithi082' 2023-09-23T08:56:00.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.012+0000 7fd0c41c4b80 1 --2- 172.21.15.82:0/2082594085 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x55fd43bd8f30 0x55fd43bd7a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:00.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.013+0000 7fd0c41c4b80 4 client.15108 mds_command: new command op to 24515 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T08:56:00.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.013+0000 7fd0c41c4b80 1 -- 172.21.15.82:0/2082594085 --> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fd43abbb50 con 0x55fd43bd8f30 2023-09-23T08:56:00.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.013+0000 7fd0ae59b700 1 --2- 172.21.15.82:0/2082594085 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x55fd43bd8f30 0x55fd43bd7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:00.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.013+0000 7fd0ae59b700 1 --2- 172.21.15.82:0/2082594085 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x55fd43bd8f30 0x55fd43bd7a20 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=8b3374da91adf0fd server_cookie=b662aabcb5e6d9e8 in_seq=0 out_seq=0 2023-09-23T08:56:00.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.013+0000 7fd091ffb700 10 client.15108 ms_handle_connect on v2:172.21.15.135:6836/2655304858 2023-09-23T08:56:00.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.014+0000 7fd091ffb700 1 -- 172.21.15.82:0/2082594085 <== mds.3 v2:172.21.15.135:6836/2655304858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55fd43abbb50 con 0x55fd43bd8f30 2023-09-23T08:56:00.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.014+0000 7fd091ffb700 10 client.15108 handle_command_reply: tid=0 2023-09-23T08:56:00.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.014+0000 7fd0c41c4b80 1 client.15108 shutdown 2023-09-23T08:56:00.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.015+0000 7fd0c41c4b80 1 -- 172.21.15.82:0/2082594085 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fd43bc4d00 msgr2=0x55fd43bd4970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:00.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.015+0000 7fd0c41c4b80 1 --2- 172.21.15.82:0/2082594085 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fd43bc4d00 0x55fd43bd4970 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fd0a009feb0 tx=0x7fd0a0098b10 comp rx=0 tx=0).stop 2023-09-23T08:56:00.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.015+0000 7fd0c41c4b80 1 -- 172.21.15.82:0/2082594085 shutdown_connections 2023-09-23T08:56:00.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.015+0000 7fd0c41c4b80 1 --2- 172.21.15.82:0/2082594085 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fd43bc4d00 0x55fd43bd4970 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.015+0000 7fd0c41c4b80 1 --2- 172.21.15.82:0/2082594085 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x55fd43bd8f30 0x55fd43bd7a20 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.015+0000 7fd0c41c4b80 1 --2- 172.21.15.82:0/2082594085 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fd43bc3980 0x55fd43bcd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.015+0000 7fd0c41c4b80 1 --2- 172.21.15.82:0/2082594085 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fd43bc42e0 0x55fd43bcd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.015+0000 7fd091ffb700 0 client.15108 ms_handle_reset on v2:172.21.15.135:6836/2655304858 2023-09-23T08:56:00.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.015+0000 7fd0c41c4b80 1 -- 172.21.15.82:0/2082594085 >> 172.21.15.82:0/2082594085 conn(0x55fd43b38090 msgr2=0x55fd43bb8af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:00.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.015+0000 7fd0c41c4b80 1 -- 172.21.15.82:0/2082594085 shutdown_connections 2023-09-23T08:56:00.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.015+0000 7fd0c41c4b80 1 -- 172.21.15.82:0/2082594085 wait complete. 2023-09-23T08:56:00.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.015+0000 7fd0c41c4b80 20 client.15108 trim_cache size 0 max 16384 2023-09-23T08:56:00.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.033+0000 7fd0c41c4b80 1 Processor -- start 2023-09-23T08:56:00.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.033+0000 7fd0c41c4b80 1 -- start start 2023-09-23T08:56:00.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.033+0000 7fd0c41c4b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fd43bc3980 0x55fd43bbe180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:00.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.033+0000 7fd0c41c4b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fd43bc42e0 0x55fd43bd4930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:00.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.033+0000 7fd0c41c4b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fd43bc4d00 0x55fd43bcd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:00.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.033+0000 7fd0c41c4b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd439978d0 con 0x55fd43bc4d00 2023-09-23T08:56:00.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.033+0000 7fd0c41c4b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd43ad5df0 con 0x55fd43bc3980 2023-09-23T08:56:00.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.033+0000 7fd0c41c4b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd439a3de0 con 0x55fd43bc42e0 2023-09-23T08:56:00.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.034+0000 7fd0aed9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fd43bc4d00 0x55fd43bcd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:00.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.034+0000 7fd0ae59b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fd43bc3980 0x55fd43bbe180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:00.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.034+0000 7fd0ae59b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fd43bc3980 0x55fd43bbe180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:36038/0 (socket says 172.21.15.82:36038) 2023-09-23T08:56:00.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.034+0000 7fd0aed9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fd43bc4d00 0x55fd43bcd3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54736/0 (socket says 172.21.15.82:54736) 2023-09-23T08:56:00.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.034+0000 7fd0ae59b700 1 -- 172.21.15.82:0/3908138500 learned_addr learned my addr 172.21.15.82:0/3908138500 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:00.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.034+0000 7fd0add9a700 1 --2- 172.21.15.82:0/3908138500 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fd43bc42e0 0x55fd43bd4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:00.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.034+0000 7fd0aed9c700 1 -- 172.21.15.82:0/3908138500 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fd43bc42e0 msgr2=0x55fd43bd4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:56:00.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.034+0000 7fd0aed9c700 1 --2- 172.21.15.82:0/3908138500 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fd43bc42e0 0x55fd43bd4930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.034+0000 7fd0aed9c700 1 -- 172.21.15.82:0/3908138500 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fd43bc3980 msgr2=0x55fd43bbe180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:56:00.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.034+0000 7fd0aed9c700 1 --2- 172.21.15.82:0/3908138500 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fd43bc3980 0x55fd43bbe180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.034+0000 7fd0aed9c700 1 -- 172.21.15.82:0/3908138500 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fd4392ac10 con 0x55fd43bc4d00 2023-09-23T08:56:00.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.034+0000 7fd0ae59b700 1 --2- 172.21.15.82:0/3908138500 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fd43bc3980 0x55fd43bbe180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T08:56:00.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.034+0000 7fd0aed9c700 1 --2- 172.21.15.82:0/3908138500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fd43bc4d00 0x55fd43bcd3f0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fd0a00982d0 tx=0x7fd0a0096b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd48d2da9af625b8 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:00.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.034+0000 7fd09d7fa700 1 -- 172.21.15.82:0/3908138500 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a000ce10 con 0x55fd43bc4d00 2023-09-23T08:56:00.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.034+0000 7fd09d7fa700 1 -- 172.21.15.82:0/3908138500 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd0a0098cd0 con 0x55fd43bc4d00 2023-09-23T08:56:00.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.034+0000 7fd09d7fa700 1 -- 172.21.15.82:0/3908138500 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a00192c0 con 0x55fd43bc4d00 2023-09-23T08:56:00.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.035+0000 7fd0c41c4b80 1 -- 172.21.15.82:0/3908138500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fd43bc4d00 msgr2=0x55fd43bcd3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:00.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.035+0000 7fd0c41c4b80 1 --2- 172.21.15.82:0/3908138500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fd43bc4d00 0x55fd43bcd3f0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fd0a00982d0 tx=0x7fd0a0096b80 comp rx=0 tx=0).stop 2023-09-23T08:56:00.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.035+0000 7fd0c41c4b80 1 -- 172.21.15.82:0/3908138500 shutdown_connections 2023-09-23T08:56:00.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.035+0000 7fd0c41c4b80 1 --2- 172.21.15.82:0/3908138500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fd43bc4d00 0x55fd43bcd3f0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.035+0000 7fd0c41c4b80 1 --2- 172.21.15.82:0/3908138500 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fd43bc3980 0x55fd43bbe180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.035+0000 7fd0c41c4b80 1 --2- 172.21.15.82:0/3908138500 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fd43bc42e0 0x55fd43bd4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.035+0000 7fd0c41c4b80 1 -- 172.21.15.82:0/3908138500 >> 172.21.15.82:0/3908138500 conn(0x55fd43b38090 msgr2=0x55fd43bcc0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:00.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.035+0000 7fd0c41c4b80 1 -- 172.21.15.82:0/3908138500 shutdown_connections 2023-09-23T08:56:00.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.035+0000 7fd0c41c4b80 1 -- 172.21.15.82:0/3908138500 wait complete. 2023-09-23T08:56:00.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.035+0000 7fd0c41c4b80 1 -- start start 2023-09-23T08:56:00.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.036+0000 7fd0c41c4b80 1 Processor -- start 2023-09-23T08:56:00.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.036+0000 7fd0c41c4b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fd43bc3980 0x55fd43bd15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:00.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.036+0000 7fd0c41c4b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fd43bc42e0 0x55fd43bd1b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:00.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.036+0000 7fd0c41c4b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fd43bc4d00 0x55fd43c2c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:00.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.036+0000 7fd0c41c4b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd43bd2050 con 0x55fd43bc4d00 2023-09-23T08:56:00.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.036+0000 7fd0c41c4b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd43bd21c0 con 0x55fd43bc3980 2023-09-23T08:56:00.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.036+0000 7fd0c41c4b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd43c2ce60 con 0x55fd43bc42e0 2023-09-23T08:56:00.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.036+0000 7fd0c41c4b80 10 client.0 _ll_register_callbacks cb 0x7fd0a0098110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T08:56:00.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.036+0000 7fd0aed9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fd43bc4d00 0x55fd43c2c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:00.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.036+0000 7fd0ae59b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fd43bc3980 0x55fd43bd15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:00.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.036+0000 7fd0aed9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fd43bc4d00 0x55fd43c2c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54744/0 (socket says 172.21.15.82:54744) 2023-09-23T08:56:00.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.036+0000 7fd0aed9c700 1 -- 172.21.15.82:0/3158598810 learned_addr learned my addr 172.21.15.82:0/3158598810 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:00.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.036+0000 7fd0ae59b700 1 --2- 172.21.15.82:0/3158598810 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fd43bc3980 0x55fd43bd15d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:36040/0 (socket says 172.21.15.82:36040) 2023-09-23T08:56:00.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.037+0000 7fd0add9a700 1 --2- 172.21.15.82:0/3158598810 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fd43bc42e0 0x55fd43bd1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:00.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.037+0000 7fd0aed9c700 1 -- 172.21.15.82:0/3158598810 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fd43bc42e0 msgr2=0x55fd43bd1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:56:00.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.037+0000 7fd0aed9c700 1 --2- 172.21.15.82:0/3158598810 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fd43bc42e0 0x55fd43bd1b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.037+0000 7fd0aed9c700 1 -- 172.21.15.82:0/3158598810 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fd43bc3980 msgr2=0x55fd43bd15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:56:00.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.037+0000 7fd0aed9c700 1 --2- 172.21.15.82:0/3158598810 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fd43bc3980 0x55fd43bd15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.037+0000 7fd0aed9c700 1 -- 172.21.15.82:0/3158598810 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0a81096c0 con 0x55fd43bc4d00 2023-09-23T08:56:00.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.037+0000 7fd0ae59b700 1 --2- 172.21.15.82:0/3158598810 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fd43bc3980 0x55fd43bd15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T08:56:00.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.037+0000 7fd0aed9c700 1 --2- 172.21.15.82:0/3158598810 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fd43bc4d00 0x55fd43c2c920 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd0a0094ff0 tx=0x7fd0a000e1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dc1ab75b4bb5f79 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:00.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.037+0000 7fd091ffb700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T08:56:00.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.037+0000 7fd091ffb700 1 -- 172.21.15.82:0/3158598810 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a00a0150 con 0x55fd43bc4d00 2023-09-23T08:56:00.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.037+0000 7fd091ffb700 1 -- 172.21.15.82:0/3158598810 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fd0a00192c0 con 0x55fd43bc4d00 2023-09-23T08:56:00.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.037+0000 7fd0c41c4b80 1 -- 172.21.15.82:0/3158598810 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fd43bb6860 con 0x55fd43bc4d00 2023-09-23T08:56:00.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.037+0000 7fd091ffb700 1 -- 172.21.15.82:0/3158598810 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd0a00c88e0 con 0x55fd43bc4d00 2023-09-23T08:56:00.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.037+0000 7fd0c41c4b80 10 client.15114 fetch_fsmap learned FSMap version 26 2023-09-23T08:56:00.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.037+0000 7fd0c41c4b80 1 -- 172.21.15.82:0/3158598810 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55fd43941d90 con 0x55fd43bc4d00 2023-09-23T08:56:00.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.038+0000 7fd091ffb700 1 -- 172.21.15.82:0/3158598810 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55fd43bb6860 con 0x55fd43bc4d00 2023-09-23T08:56:00.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.038+0000 7fd091ffb700 1 -- 172.21.15.82:0/3158598810 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fd0a005ead0 con 0x55fd43bc4d00 2023-09-23T08:56:00.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.038+0000 7fd0c41c4b80 10 client.15114 fetch_fsmap finished waiting for FSMap version 26 2023-09-23T08:56:00.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.038+0000 7fd0c41c4b80 10 client.15114 resolve_mds: resolved name 'h' to daemon mds.h 2023-09-23T08:56:00.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.038+0000 7fd0c41c4b80 20 client.15114 populate_metadata read hostname 'smithi082' 2023-09-23T08:56:00.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.038+0000 7fd0c41c4b80 1 --2- 172.21.15.82:0/3158598810 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x55fd43c31950 0x55fd43c2e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:00.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.038+0000 7fd0c41c4b80 4 client.15114 mds_command: new command op to 24515 tid=0[{"prefix": "status"}] 2023-09-23T08:56:00.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.038+0000 7fd0c41c4b80 1 -- 172.21.15.82:0/3158598810 --> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55fd43b0e920 con 0x55fd43c31950 2023-09-23T08:56:00.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.038+0000 7fd0ae59b700 1 --2- 172.21.15.82:0/3158598810 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x55fd43c31950 0x55fd43c2e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:00.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.039+0000 7fd0ae59b700 1 --2- 172.21.15.82:0/3158598810 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x55fd43c31950 0x55fd43c2e060 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=c23561af746e2148 server_cookie=de2320fdb00cf7c5 in_seq=0 out_seq=0 2023-09-23T08:56:00.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.039+0000 7fd091ffb700 10 client.15114 ms_handle_connect on v2:172.21.15.135:6836/2655304858 2023-09-23T08:56:00.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.039+0000 7fd091ffb700 1 -- 172.21.15.82:0/3158598810 <== mds.3 v2:172.21.15.135:6836/2655304858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55fd43b0e920 con 0x55fd43c31950 2023-09-23T08:56:00.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.039+0000 7fd091ffb700 10 client.15114 handle_command_reply: tid=0 2023-09-23T08:56:00.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.039+0000 7fd0c41c4b80 1 client.15114 shutdown 2023-09-23T08:56:00.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.039+0000 7fd0c41c4b80 1 -- 172.21.15.82:0/3158598810 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fd43bc4d00 msgr2=0x55fd43c2c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:00.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.039+0000 7fd0c41c4b80 1 --2- 172.21.15.82:0/3158598810 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fd43bc4d00 0x55fd43c2c920 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd0a0094ff0 tx=0x7fd0a000e1b0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.039+0000 7fd0c41c4b80 1 -- 172.21.15.82:0/3158598810 shutdown_connections 2023-09-23T08:56:00.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.039+0000 7fd0c41c4b80 1 --2- 172.21.15.82:0/3158598810 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fd43bc4d00 0x55fd43c2c920 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.039+0000 7fd0c41c4b80 1 --2- 172.21.15.82:0/3158598810 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fd43bc3980 0x55fd43bd15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.039+0000 7fd0c41c4b80 1 --2- 172.21.15.82:0/3158598810 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x55fd43c31950 0x55fd43c2e060 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.039+0000 7fd0c41c4b80 1 --2- 172.21.15.82:0/3158598810 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fd43bc42e0 0x55fd43bd1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.039+0000 7fd0c41c4b80 1 -- 172.21.15.82:0/3158598810 >> 172.21.15.82:0/3158598810 conn(0x55fd43b38090 msgr2=0x55fd43bbe050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:00.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.039+0000 7fd091ffb700 0 client.15114 ms_handle_reset on v2:172.21.15.135:6836/2655304858 2023-09-23T08:56:00.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.039+0000 7fd0c41c4b80 1 -- 172.21.15.82:0/3158598810 shutdown_connections 2023-09-23T08:56:00.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.039+0000 7fd0c41c4b80 1 -- 172.21.15.82:0/3158598810 wait complete. 2023-09-23T08:56:00.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.039+0000 7fd0c41c4b80 20 client.15114 trim_cache size 0 max 16384 2023-09-23T08:56:00.053 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T08:56:00.053 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "8926e286-59ed-11ee-8db4-212e2dc638e7", 2023-09-23T08:56:00.053 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 3, 2023-09-23T08:56:00.053 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 24515, 2023-09-23T08:56:00.053 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2023-09-23T08:56:00.053 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2023-09-23T08:56:00.054 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2023-09-23T08:56:00.054 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 61.587397103999997, 2023-09-23T08:56:00.054 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 26, 2023-09-23T08:56:00.054 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 88, 2023-09-23T08:56:00.054 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 86, 2023-09-23T08:56:00.054 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 86.869476753000001 2023-09-23T08:56:00.054 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T08:56:00.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.040+0000 7fd0b07ff700 1 -- 172.21.15.82:0/3301705136 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fd09409ffe0 msgr2=0x7fd0940a24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:00.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.040+0000 7fd0b07ff700 1 --2- 172.21.15.82:0/3301705136 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fd09409ffe0 0x7fd0940a24a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd0a4000c00 tx=0x7fd0a4009550 comp rx=0 tx=0).stop 2023-09-23T08:56:00.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.040+0000 7fd0b07ff700 1 -- 172.21.15.82:0/3301705136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0a81024c0 msgr2=0x7fd0a8073250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:00.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.040+0000 7fd0b07ff700 1 --2- 172.21.15.82:0/3301705136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0a81024c0 0x7fd0a8073250 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fd0a000c370 tx=0x7fd0a000c680 comp rx=0 tx=0).stop 2023-09-23T08:56:00.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.040+0000 7fd0b07ff700 1 -- 172.21.15.82:0/3301705136 shutdown_connections 2023-09-23T08:56:00.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.040+0000 7fd0b07ff700 1 --2- 172.21.15.82:0/3301705136 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fd09409ffe0 0x7fd0940a24a0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.040+0000 7fd0b07ff700 1 --2- 172.21.15.82:0/3301705136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0a81024c0 0x7fd0a8073250 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.040+0000 7fd0b07ff700 1 --2- 172.21.15.82:0/3301705136 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd0a8100930 0x7fd0a80746d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.040+0000 7fd0b07ff700 1 --2- 172.21.15.82:0/3301705136 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0a8101b20 0x7fd0a8072d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.040+0000 7fd0b07ff700 1 -- 172.21.15.82:0/3301705136 >> 172.21.15.82:0/3301705136 conn(0x7fd0a80fbea0 msgr2=0x7fd0a80fe230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:00.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.040+0000 7fd0b07ff700 1 -- 172.21.15.82:0/3301705136 shutdown_connections 2023-09-23T08:56:00.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.040+0000 7fd0b07ff700 1 -- 172.21.15.82:0/3301705136 wait complete. 2023-09-23T08:56:00.061 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-09-23T08:56:00.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.256+0000 7f9db51ff700 1 -- 172.21.15.82:0/2001517096 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9db01024c0 msgr2=0x7f9db0108d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:00.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.256+0000 7f9db51ff700 1 --2- 172.21.15.82:0/2001517096 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9db01024c0 0x7f9db0108d70 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f9da800b0d0 tx=0x7f9da800b3e0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.256+0000 7f9db51ff700 1 -- 172.21.15.82:0/2001517096 shutdown_connections 2023-09-23T08:56:00.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.256+0000 7f9db51ff700 1 --2- 172.21.15.82:0/2001517096 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9db01024c0 0x7f9db0108d70 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.256+0000 7f9db51ff700 1 --2- 172.21.15.82:0/2001517096 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9db0100930 0x7f9db0100d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.256+0000 7f9db51ff700 1 --2- 172.21.15.82:0/2001517096 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9db0101b20 0x7f9db0101f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.256+0000 7f9db51ff700 1 -- 172.21.15.82:0/2001517096 >> 172.21.15.82:0/2001517096 conn(0x7f9db00fbea0 msgr2=0x7f9db00fe2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:00.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.256+0000 7f9db51ff700 1 -- 172.21.15.82:0/2001517096 shutdown_connections 2023-09-23T08:56:00.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.256+0000 7f9db51ff700 1 -- 172.21.15.82:0/2001517096 wait complete. 2023-09-23T08:56:00.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.257+0000 7f9db51ff700 1 Processor -- start 2023-09-23T08:56:00.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.257+0000 7f9db51ff700 1 -- start start 2023-09-23T08:56:00.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.257+0000 7f9db51ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9db0100930 0x7f9db0196600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:00.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.257+0000 7f9db51ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9db0101b20 0x7f9db0196b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:00.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.257+0000 7f9db51ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9db01024c0 0x7f9db019dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:00.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.257+0000 7f9db51ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db019e180 con 0x7f9db0101b20 2023-09-23T08:56:00.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.257+0000 7f9db51ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db019e2c0 con 0x7f9db0100930 2023-09-23T08:56:00.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.257+0000 7f9db51ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db019e450 con 0x7f9db01024c0 2023-09-23T08:56:00.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.258+0000 7f9dae59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9db0101b20 0x7f9db0196b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:00.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.258+0000 7f9dae59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9db0101b20 0x7f9db0196b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54762/0 (socket says 172.21.15.82:54762) 2023-09-23T08:56:00.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.258+0000 7f9dae59c700 1 -- 172.21.15.82:0/3534530522 learned_addr learned my addr 172.21.15.82:0/3534530522 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:00.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.258+0000 7f9daed9d700 1 --2- 172.21.15.82:0/3534530522 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9db0100930 0x7f9db0196600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:00.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.258+0000 7f9daf59e700 1 --2- 172.21.15.82:0/3534530522 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9db01024c0 0x7f9db019dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:00.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.258+0000 7f9dae59c700 1 -- 172.21.15.82:0/3534530522 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9db01024c0 msgr2=0x7f9db019dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:00.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.258+0000 7f9dae59c700 1 --2- 172.21.15.82:0/3534530522 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9db01024c0 0x7f9db019dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.258+0000 7f9dae59c700 1 -- 172.21.15.82:0/3534530522 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9db0100930 msgr2=0x7f9db0196600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:00.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.258+0000 7f9dae59c700 1 --2- 172.21.15.82:0/3534530522 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9db0100930 0x7f9db0196600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.258+0000 7f9dae59c700 1 -- 172.21.15.82:0/3534530522 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9da8009d00 con 0x7f9db0101b20 2023-09-23T08:56:00.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.258+0000 7f9daed9d700 1 --2- 172.21.15.82:0/3534530522 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9db0100930 0x7f9db0196600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T08:56:00.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.258+0000 7f9dae59c700 1 --2- 172.21.15.82:0/3534530522 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9db0101b20 0x7f9db0196b40 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f9da400d950 tx=0x7f9da400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:00.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.258+0000 7f9d97fff700 1 -- 172.21.15.82:0/3534530522 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da400f890 con 0x7f9db0101b20 2023-09-23T08:56:00.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.258+0000 7f9d97fff700 1 -- 172.21.15.82:0/3534530522 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9da400fe80 con 0x7f9db0101b20 2023-09-23T08:56:00.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.258+0000 7f9db51ff700 1 -- 172.21.15.82:0/3534530522 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9db019e730 con 0x7f9db0101b20 2023-09-23T08:56:00.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.258+0000 7f9d97fff700 1 -- 172.21.15.82:0/3534530522 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da400e3b0 con 0x7f9db0101b20 2023-09-23T08:56:00.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.259+0000 7f9db51ff700 1 -- 172.21.15.82:0/3534530522 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9db019ec40 con 0x7f9db0101b20 2023-09-23T08:56:00.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.262+0000 7f9d97fff700 1 -- 172.21.15.82:0/3534530522 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) v1 ==== 134722+0+0 (secure 0 0 0) 0x7f9da4010460 con 0x7f9db0101b20 2023-09-23T08:56:00.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.263+0000 7f9dc8b15b80 1 Processor -- start 2023-09-23T08:56:00.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.263+0000 7f9dc8b15b80 1 -- start start 2023-09-23T08:56:00.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.263+0000 7f9d97fff700 1 --2- 172.21.15.82:0/3534530522 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f9d9809ffe0 0x7f9d980a24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:00.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.263+0000 7f9dc8b15b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55634ba8bd90 0x55634ba8c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:00.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.263+0000 7f9d97fff700 1 -- 172.21.15.82:0/3534530522 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f9da40cb1a0 con 0x7f9db0101b20 2023-09-23T08:56:00.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.263+0000 7f9dc8b15b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55634ba8c6f0 0x55634ba8cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:00.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.263+0000 7f9dc8b15b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55634ba8d110 0x55634ba8d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:00.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.263+0000 7f9dc8b15b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55634b9ef760 con 0x55634ba8d110 2023-09-23T08:56:00.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.263+0000 7f9dc8b15b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55634b9e0730 con 0x55634ba8bd90 2023-09-23T08:56:00.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.263+0000 7f9dc8b15b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55634b9de050 con 0x55634ba8c6f0 2023-09-23T08:56:00.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.263+0000 7f9daf59e700 1 --2- 172.21.15.82:0/3534530522 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f9d9809ffe0 0x7f9d980a24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:00.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.264+0000 7f9daed9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55634ba8bd90 0x55634ba8c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:00.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.264+0000 7f9daed9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55634ba8bd90 0x55634ba8c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:36058/0 (socket says 172.21.15.82:36058) 2023-09-23T08:56:00.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.264+0000 7f9daed9d700 1 -- 172.21.15.82:0/3715303245 learned_addr learned my addr 172.21.15.82:0/3715303245 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:00.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.264+0000 7f9daf59e700 1 --2- 172.21.15.82:0/3715303245 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55634ba8d110 0x55634ba8d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:00.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.264+0000 7f9dae59c700 1 --2- 172.21.15.82:0/3715303245 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55634ba8c6f0 0x55634ba8cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:00.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.264+0000 7f9daed9d700 1 -- 172.21.15.82:0/3715303245 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55634ba8c6f0 msgr2=0x55634ba8cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:56:00.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.264+0000 7f9daed9d700 1 --2- 172.21.15.82:0/3715303245 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55634ba8c6f0 0x55634ba8cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.264+0000 7f9daed9d700 1 -- 172.21.15.82:0/3715303245 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55634ba8d110 msgr2=0x55634ba8d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:56:00.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.264+0000 7f9daed9d700 1 --2- 172.21.15.82:0/3715303245 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55634ba8d110 0x55634ba8d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.264+0000 7f9daed9d700 1 -- 172.21.15.82:0/3715303245 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55634b8595e0 con 0x55634ba8bd90 2023-09-23T08:56:00.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.264+0000 7f9dae59c700 1 --2- 172.21.15.82:0/3715303245 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55634ba8c6f0 0x55634ba8cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T08:56:00.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.264+0000 7f9daf59e700 1 --2- 172.21.15.82:0/3534530522 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f9d9809ffe0 0x7f9d980a24a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9da80062a0 tx=0x7f9da8007b90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:00.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.264+0000 7f9daed9d700 1 --2- 172.21.15.82:0/3715303245 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55634ba8bd90 0x55634ba8c1b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9da00115c0 tx=0x7f9da00118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fdabcd233da64d1a server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:00.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.265+0000 7f9d957fa700 1 -- 172.21.15.82:0/3715303245 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da0004220 con 0x55634ba8bd90 2023-09-23T08:56:00.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.265+0000 7f9d957fa700 1 -- 172.21.15.82:0/3715303245 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9da0004cc0 con 0x55634ba8bd90 2023-09-23T08:56:00.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.265+0000 7f9d957fa700 1 -- 172.21.15.82:0/3715303245 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da00055e0 con 0x55634ba8bd90 2023-09-23T08:56:00.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.265+0000 7f9dc8b15b80 1 -- 172.21.15.82:0/3715303245 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55634ba8bd90 msgr2=0x55634ba8c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:00.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.265+0000 7f9dc8b15b80 1 --2- 172.21.15.82:0/3715303245 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55634ba8bd90 0x55634ba8c1b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9da00115c0 tx=0x7f9da00118d0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.265+0000 7f9dc8b15b80 1 -- 172.21.15.82:0/3715303245 shutdown_connections 2023-09-23T08:56:00.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.265+0000 7f9dc8b15b80 1 --2- 172.21.15.82:0/3715303245 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55634ba8d110 0x55634ba8d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.265+0000 7f9dc8b15b80 1 --2- 172.21.15.82:0/3715303245 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55634ba8bd90 0x55634ba8c1b0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.265+0000 7f9dc8b15b80 1 --2- 172.21.15.82:0/3715303245 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55634ba8c6f0 0x55634ba8cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.265+0000 7f9dc8b15b80 1 -- 172.21.15.82:0/3715303245 >> 172.21.15.82:0/3715303245 conn(0x55634b9fc090 msgr2=0x55634ba82250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:00.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.265+0000 7f9dc8b15b80 1 -- 172.21.15.82:0/3715303245 shutdown_connections 2023-09-23T08:56:00.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.265+0000 7f9dc8b15b80 1 -- 172.21.15.82:0/3715303245 wait complete. 2023-09-23T08:56:00.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.266+0000 7f9dc8b15b80 1 -- start start 2023-09-23T08:56:00.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.266+0000 7f9dc8b15b80 1 Processor -- start 2023-09-23T08:56:00.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.267+0000 7f9dc8b15b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55634ba8bd90 0x55634ba95750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:00.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.267+0000 7f9dc8b15b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55634ba8c6f0 0x55634ba95c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:00.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.267+0000 7f9dc8b15b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55634ba8d110 0x55634ba9ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:00.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.267+0000 7f9dc8b15b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55634b9d9940 con 0x55634ba8bd90 2023-09-23T08:56:00.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.267+0000 7f9dc8b15b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55634b977b60 con 0x55634ba8d110 2023-09-23T08:56:00.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.267+0000 7f9dc8b15b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55634b977860 con 0x55634ba8c6f0 2023-09-23T08:56:00.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.267+0000 7f9dc8b15b80 10 client.0 _ll_register_callbacks cb 0x55634b8c1a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T08:56:00.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.267+0000 7f9daed9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55634ba8bd90 0x55634ba95750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:00.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.267+0000 7f9daed9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55634ba8bd90 0x55634ba95750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54778/0 (socket says 172.21.15.82:54778) 2023-09-23T08:56:00.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.267+0000 7f9daed9d700 1 -- 172.21.15.82:0/432160083 learned_addr learned my addr 172.21.15.82:0/432160083 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:00.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.267+0000 7f9dae59c700 1 --2- 172.21.15.82:0/432160083 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55634ba8c6f0 0x55634ba95c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:00.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.267+0000 7f9daf59e700 1 --2- 172.21.15.82:0/432160083 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55634ba8d110 0x55634ba9ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:00.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.268+0000 7f9daed9d700 1 -- 172.21.15.82:0/432160083 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55634ba8c6f0 msgr2=0x55634ba95c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:56:00.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.268+0000 7f9daed9d700 1 --2- 172.21.15.82:0/432160083 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55634ba8c6f0 0x55634ba95c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.268+0000 7f9daed9d700 1 -- 172.21.15.82:0/432160083 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55634ba8d110 msgr2=0x55634ba9ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:56:00.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.268+0000 7f9daed9d700 1 --2- 172.21.15.82:0/432160083 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55634ba8d110 0x55634ba9ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.268+0000 7f9daed9d700 1 -- 172.21.15.82:0/432160083 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9da0009d50 con 0x55634ba8bd90 2023-09-23T08:56:00.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.268+0000 7f9daed9d700 1 --2- 172.21.15.82:0/432160083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55634ba8bd90 0x55634ba95750 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f9da001b040 tx=0x7f9da0004980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d6e5c883b4261dd server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:00.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.268+0000 7f9d92ff5700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T08:56:00.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.268+0000 7f9d92ff5700 1 -- 172.21.15.82:0/432160083 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da0004f80 con 0x55634ba8bd90 2023-09-23T08:56:00.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.268+0000 7f9dc8b15b80 1 -- 172.21.15.82:0/432160083 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55634ba57170 con 0x55634ba8bd90 2023-09-23T08:56:00.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.268+0000 7f9d92ff5700 1 -- 172.21.15.82:0/432160083 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f9da0024480 con 0x55634ba8bd90 2023-09-23T08:56:00.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.268+0000 7f9d92ff5700 1 -- 172.21.15.82:0/432160083 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9da0024640 con 0x55634ba8bd90 2023-09-23T08:56:00.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.268+0000 7f9dc8b15b80 10 client.15123 fetch_fsmap learned FSMap version 26 2023-09-23T08:56:00.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.268+0000 7f9dc8b15b80 1 -- 172.21.15.82:0/432160083 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55634b805d90 con 0x55634ba8bd90 2023-09-23T08:56:00.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.269+0000 7f9d92ff5700 1 -- 172.21.15.82:0/432160083 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55634ba57170 con 0x55634ba8bd90 2023-09-23T08:56:00.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.269+0000 7f9d92ff5700 1 -- 172.21.15.82:0/432160083 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f9da0019890 con 0x55634ba8bd90 2023-09-23T08:56:00.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.269+0000 7f9dc8b15b80 10 client.15123 fetch_fsmap finished waiting for FSMap version 26 2023-09-23T08:56:00.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.269+0000 7f9dc8b15b80 10 client.15123 resolve_mds: resolved name 'c' to daemon mds.c 2023-09-23T08:56:00.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.269+0000 7f9dc8b15b80 20 client.15123 populate_metadata read hostname 'smithi082' 2023-09-23T08:56:00.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.269+0000 7f9dc8b15b80 1 --2- 172.21.15.82:0/432160083 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x55634baa1270 0x55634ba9fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:00.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.269+0000 7f9dc8b15b80 4 client.15123 mds_command: new command op to 24526 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T08:56:00.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.269+0000 7f9dc8b15b80 1 -- 172.21.15.82:0/432160083 --> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55634b97fb50 con 0x55634baa1270 2023-09-23T08:56:00.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.269+0000 7f9dae59c700 1 --2- 172.21.15.82:0/432160083 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x55634baa1270 0x55634ba9fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:00.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.270+0000 7f9dae59c700 1 --2- 172.21.15.82:0/432160083 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x55634baa1270 0x55634ba9fd80 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8f037091199b1b27 server_cookie=7c7a369e05486b99 in_seq=0 out_seq=0 2023-09-23T08:56:00.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.270+0000 7f9d92ff5700 10 client.15123 ms_handle_connect on v2:172.21.15.161:6836/43639843 2023-09-23T08:56:00.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.271+0000 7f9d92ff5700 1 -- 172.21.15.82:0/432160083 <== mds.2 v2:172.21.15.161:6836/43639843 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55634b97fb50 con 0x55634baa1270 2023-09-23T08:56:00.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.271+0000 7f9d92ff5700 10 client.15123 handle_command_reply: tid=0 2023-09-23T08:56:00.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.271+0000 7f9dc8b15b80 1 client.15123 shutdown 2023-09-23T08:56:00.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.271+0000 7f9dc8b15b80 1 -- 172.21.15.82:0/432160083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55634ba8bd90 msgr2=0x55634ba95750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:00.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.271+0000 7f9dc8b15b80 1 --2- 172.21.15.82:0/432160083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55634ba8bd90 0x55634ba95750 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f9da001b040 tx=0x7f9da0004980 comp rx=0 tx=0).stop 2023-09-23T08:56:00.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.271+0000 7f9dc8b15b80 1 -- 172.21.15.82:0/432160083 shutdown_connections 2023-09-23T08:56:00.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.271+0000 7f9dc8b15b80 1 --2- 172.21.15.82:0/432160083 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x55634baa1270 0x55634ba9fd80 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.271+0000 7f9dc8b15b80 1 --2- 172.21.15.82:0/432160083 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55634ba8d110 0x55634ba9ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.271+0000 7f9dc8b15b80 1 --2- 172.21.15.82:0/432160083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55634ba8bd90 0x55634ba95750 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.271+0000 7f9dc8b15b80 1 --2- 172.21.15.82:0/432160083 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55634ba8c6f0 0x55634ba95c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.271+0000 7f9dc8b15b80 1 -- 172.21.15.82:0/432160083 >> 172.21.15.82:0/432160083 conn(0x55634b9fc090 msgr2=0x55634ba7caf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:00.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.271+0000 7f9d92ff5700 0 client.15123 ms_handle_reset on v2:172.21.15.161:6836/43639843 2023-09-23T08:56:00.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.271+0000 7f9dc8b15b80 1 -- 172.21.15.82:0/432160083 shutdown_connections 2023-09-23T08:56:00.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.271+0000 7f9dc8b15b80 1 -- 172.21.15.82:0/432160083 wait complete. 2023-09-23T08:56:00.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.271+0000 7f9dc8b15b80 20 client.15123 trim_cache size 0 max 16384 2023-09-23T08:56:00.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.289+0000 7f9dc8b15b80 1 Processor -- start 2023-09-23T08:56:00.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.290+0000 7f9dc8b15b80 1 -- start start 2023-09-23T08:56:00.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.290+0000 7f9dc8b15b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55634ba8bd90 0x55634ba82160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:00.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.290+0000 7f9dc8b15b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55634ba8c6f0 0x55634ba9cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:00.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.290+0000 7f9dc8b15b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55634ba8d110 0x55634ba93480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:00.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.290+0000 7f9dc8b15b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55634b85b8d0 con 0x55634ba8bd90 2023-09-23T08:56:00.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.290+0000 7f9dc8b15b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55634b981470 con 0x55634ba8c6f0 2023-09-23T08:56:00.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.290+0000 7f9dc8b15b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55634ba7e810 con 0x55634ba8d110 2023-09-23T08:56:00.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.290+0000 7f9daed9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55634ba8bd90 0x55634ba82160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:00.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.290+0000 7f9daed9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55634ba8bd90 0x55634ba82160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54780/0 (socket says 172.21.15.82:54780) 2023-09-23T08:56:00.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.290+0000 7f9daed9d700 1 -- 172.21.15.82:0/4197470263 learned_addr learned my addr 172.21.15.82:0/4197470263 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:00.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.290+0000 7f9daf59e700 1 --2- 172.21.15.82:0/4197470263 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55634ba8d110 0x55634ba93480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:00.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.290+0000 7f9dae59c700 1 --2- 172.21.15.82:0/4197470263 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55634ba8c6f0 0x55634ba9cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:00.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.290+0000 7f9daed9d700 1 -- 172.21.15.82:0/4197470263 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55634ba8d110 msgr2=0x55634ba93480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:56:00.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.290+0000 7f9daed9d700 1 --2- 172.21.15.82:0/4197470263 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55634ba8d110 0x55634ba93480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.290+0000 7f9daed9d700 1 -- 172.21.15.82:0/4197470263 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55634ba8c6f0 msgr2=0x55634ba9cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:56:00.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.290+0000 7f9daed9d700 1 --2- 172.21.15.82:0/4197470263 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55634ba8c6f0 0x55634ba9cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.290+0000 7f9daed9d700 1 -- 172.21.15.82:0/4197470263 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55634b7eec10 con 0x55634ba8bd90 2023-09-23T08:56:00.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.291+0000 7f9daed9d700 1 --2- 172.21.15.82:0/4197470263 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55634ba8bd90 0x55634ba82160 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f9da0031040 tx=0x7f9da0009f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a43e4c4f5b11317f server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:00.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.291+0000 7f9d95ffb700 1 -- 172.21.15.82:0/4197470263 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da0004f80 con 0x55634ba8bd90 2023-09-23T08:56:00.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.291+0000 7f9d95ffb700 1 -- 172.21.15.82:0/4197470263 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9da00049f0 con 0x55634ba8bd90 2023-09-23T08:56:00.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.291+0000 7f9d95ffb700 1 -- 172.21.15.82:0/4197470263 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da00197b0 con 0x55634ba8bd90 2023-09-23T08:56:00.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.291+0000 7f9dc8b15b80 1 -- 172.21.15.82:0/4197470263 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55634ba8bd90 msgr2=0x55634ba82160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:00.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.291+0000 7f9dc8b15b80 1 --2- 172.21.15.82:0/4197470263 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55634ba8bd90 0x55634ba82160 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f9da0031040 tx=0x7f9da0009f70 comp rx=0 tx=0).stop 2023-09-23T08:56:00.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.292+0000 7f9dc8b15b80 1 -- 172.21.15.82:0/4197470263 shutdown_connections 2023-09-23T08:56:00.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.292+0000 7f9dc8b15b80 1 --2- 172.21.15.82:0/4197470263 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55634ba8d110 0x55634ba93480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.292+0000 7f9dc8b15b80 1 --2- 172.21.15.82:0/4197470263 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55634ba8bd90 0x55634ba82160 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.292+0000 7f9dc8b15b80 1 --2- 172.21.15.82:0/4197470263 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55634ba8c6f0 0x55634ba9cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.292+0000 7f9dc8b15b80 1 -- 172.21.15.82:0/4197470263 >> 172.21.15.82:0/4197470263 conn(0x55634b9fc090 msgr2=0x55634ba7bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:00.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.292+0000 7f9dc8b15b80 1 -- 172.21.15.82:0/4197470263 shutdown_connections 2023-09-23T08:56:00.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.292+0000 7f9dc8b15b80 1 -- 172.21.15.82:0/4197470263 wait complete. 2023-09-23T08:56:00.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.292+0000 7f9dc8b15b80 1 -- start start 2023-09-23T08:56:00.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.292+0000 7f9dc8b15b80 1 Processor -- start 2023-09-23T08:56:00.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.293+0000 7f9dc8b15b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55634ba8bd90 0x55634ba7c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:00.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.293+0000 7f9dc8b15b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55634ba8c6f0 0x55634ba9cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:00.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.293+0000 7f9dc8b15b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55634ba8d110 0x55634ba7c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:00.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.293+0000 7f9dc8b15b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55634ba7cce0 con 0x55634ba8d110 2023-09-23T08:56:00.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.293+0000 7f9dc8b15b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55634ba7ce50 con 0x55634ba8c6f0 2023-09-23T08:56:00.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.293+0000 7f9dc8b15b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55634ba7d010 con 0x55634ba8bd90 2023-09-23T08:56:00.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.293+0000 7f9dc8b15b80 10 client.0 _ll_register_callbacks cb 0x7f9da0011440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T08:56:00.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.293+0000 7f9daf59e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55634ba8d110 0x55634ba7c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:00.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.293+0000 7f9daed9d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55634ba8bd90 0x55634ba7c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:00.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.293+0000 7f9daed9d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55634ba8bd90 0x55634ba7c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:42310/0 (socket says 172.21.15.82:42310) 2023-09-23T08:56:00.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.293+0000 7f9daed9d700 1 -- 172.21.15.82:0/2505098343 learned_addr learned my addr 172.21.15.82:0/2505098343 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:00.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.293+0000 7f9daf59e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55634ba8d110 0x55634ba7c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54796/0 (socket says 172.21.15.82:54796) 2023-09-23T08:56:00.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.293+0000 7f9dae59c700 1 --2- 172.21.15.82:0/2505098343 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55634ba8c6f0 0x55634ba9cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:00.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.293+0000 7f9daed9d700 1 -- 172.21.15.82:0/2505098343 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55634ba8c6f0 msgr2=0x55634ba9cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:56:00.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.293+0000 7f9daed9d700 1 --2- 172.21.15.82:0/2505098343 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55634ba8c6f0 0x55634ba9cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.293+0000 7f9daed9d700 1 -- 172.21.15.82:0/2505098343 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55634ba8d110 msgr2=0x55634ba7c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:56:00.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.293+0000 7f9daed9d700 1 --2- 172.21.15.82:0/2505098343 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55634ba8d110 0x55634ba7c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.293+0000 7f9daed9d700 1 -- 172.21.15.82:0/2505098343 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55634b805d90 con 0x55634ba8bd90 2023-09-23T08:56:00.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.294+0000 7f9daed9d700 1 --2- 172.21.15.82:0/2505098343 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55634ba8bd90 0x55634ba7c260 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9da0004720 tx=0x7f9da0005790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df92bb29b6340df6 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:00.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.294+0000 7f9d92ff5700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T08:56:00.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.294+0000 7f9d92ff5700 1 -- 172.21.15.82:0/2505098343 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da0019530 con 0x55634ba8bd90 2023-09-23T08:56:00.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.294+0000 7f9dc8b15b80 1 -- 172.21.15.82:0/2505098343 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55634b9d2920 con 0x55634ba8bd90 2023-09-23T08:56:00.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.294+0000 7f9d92ff5700 1 -- 172.21.15.82:0/2505098343 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f9da0019690 con 0x55634ba8bd90 2023-09-23T08:56:00.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.294+0000 7f9d92ff5700 1 -- 172.21.15.82:0/2505098343 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9da0019850 con 0x55634ba8bd90 2023-09-23T08:56:00.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.294+0000 7f9dc8b15b80 10 client.24964 fetch_fsmap learned FSMap version 26 2023-09-23T08:56:00.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.294+0000 7f9dc8b15b80 1 -- 172.21.15.82:0/2505098343 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55634b82c200 con 0x55634ba8bd90 2023-09-23T08:56:00.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.295+0000 7f9d92ff5700 1 -- 172.21.15.82:0/2505098343 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9da004f080 con 0x55634ba8bd90 2023-09-23T08:56:00.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.295+0000 7f9d92ff5700 1 -- 172.21.15.82:0/2505098343 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f9da0024480 con 0x55634ba8bd90 2023-09-23T08:56:00.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.295+0000 7f9dc8b15b80 10 client.24964 fetch_fsmap finished waiting for FSMap version 26 2023-09-23T08:56:00.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.295+0000 7f9dc8b15b80 10 client.24964 resolve_mds: resolved name 'c' to daemon mds.c 2023-09-23T08:56:00.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.295+0000 7f9dc8b15b80 20 client.24964 populate_metadata read hostname 'smithi082' 2023-09-23T08:56:00.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.295+0000 7f9dc8b15b80 1 --2- 172.21.15.82:0/2505098343 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x55634baf9860 0x55634baf5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:00.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.295+0000 7f9dc8b15b80 4 client.24964 mds_command: new command op to 24526 tid=0[{"prefix": "status"}] 2023-09-23T08:56:00.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.295+0000 7f9dc8b15b80 1 -- 172.21.15.82:0/2505098343 --> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55634b993000 con 0x55634baf9860 2023-09-23T08:56:00.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.295+0000 7f9dae59c700 1 --2- 172.21.15.82:0/2505098343 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x55634baf9860 0x55634baf5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:00.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.296+0000 7f9d92ff5700 10 client.24964 ms_handle_connect on v2:172.21.15.161:6836/43639843 2023-09-23T08:56:00.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.296+0000 7f9dae59c700 1 --2- 172.21.15.82:0/2505098343 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x55634baf9860 0x55634baf5d10 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a959d239ea8d2dab server_cookie=bb15ebd14c052c27 in_seq=0 out_seq=0 2023-09-23T08:56:00.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.296+0000 7f9d92ff5700 1 -- 172.21.15.82:0/2505098343 <== mds.2 v2:172.21.15.161:6836/43639843 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55634b993000 con 0x55634baf9860 2023-09-23T08:56:00.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.296+0000 7f9d92ff5700 10 client.24964 handle_command_reply: tid=0 2023-09-23T08:56:00.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.296+0000 7f9dc8b15b80 1 client.24964 shutdown 2023-09-23T08:56:00.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.296+0000 7f9dc8b15b80 1 -- 172.21.15.82:0/2505098343 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55634ba8bd90 msgr2=0x55634ba7c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:00.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.296+0000 7f9dc8b15b80 1 --2- 172.21.15.82:0/2505098343 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55634ba8bd90 0x55634ba7c260 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9da0004720 tx=0x7f9da0005790 comp rx=0 tx=0).stop 2023-09-23T08:56:00.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.296+0000 7f9dc8b15b80 1 -- 172.21.15.82:0/2505098343 shutdown_connections 2023-09-23T08:56:00.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.296+0000 7f9dc8b15b80 1 --2- 172.21.15.82:0/2505098343 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x55634baf9860 0x55634baf5d10 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.296+0000 7f9dc8b15b80 1 --2- 172.21.15.82:0/2505098343 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55634ba8d110 0x55634ba7c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.296+0000 7f9dc8b15b80 1 --2- 172.21.15.82:0/2505098343 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55634ba8bd90 0x55634ba7c260 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.296+0000 7f9d92ff5700 0 client.24964 ms_handle_reset on v2:172.21.15.161:6836/43639843 2023-09-23T08:56:00.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.296+0000 7f9dc8b15b80 1 --2- 172.21.15.82:0/2505098343 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55634ba8c6f0 0x55634ba9cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.296+0000 7f9dc8b15b80 1 -- 172.21.15.82:0/2505098343 >> 172.21.15.82:0/2505098343 conn(0x55634b9fc090 msgr2=0x55634ba8ffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:00.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.296+0000 7f9dc8b15b80 1 -- 172.21.15.82:0/2505098343 shutdown_connections 2023-09-23T08:56:00.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.296+0000 7f9dc8b15b80 1 -- 172.21.15.82:0/2505098343 wait complete. 2023-09-23T08:56:00.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.297+0000 7f9dc8b15b80 20 client.24964 trim_cache size 0 max 16384 2023-09-23T08:56:00.306 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T08:56:00.307 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "8926e286-59ed-11ee-8db4-212e2dc638e7", 2023-09-23T08:56:00.307 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 2, 2023-09-23T08:56:00.307 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 24526, 2023-09-23T08:56:00.307 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2023-09-23T08:56:00.307 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2023-09-23T08:56:00.308 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2023-09-23T08:56:00.308 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 62.864640235000003, 2023-09-23T08:56:00.308 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 26, 2023-09-23T08:56:00.308 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 88, 2023-09-23T08:56:00.308 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 86, 2023-09-23T08:56:00.308 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 90.269748751999998 2023-09-23T08:56:00.308 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T08:56:00.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.297+0000 7f9db51ff700 1 -- 172.21.15.82:0/3534530522 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f9d9809ffe0 msgr2=0x7f9d980a24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:00.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.297+0000 7f9db51ff700 1 --2- 172.21.15.82:0/3534530522 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f9d9809ffe0 0x7f9d980a24a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9da80062a0 tx=0x7f9da8007b90 comp rx=0 tx=0).stop 2023-09-23T08:56:00.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.297+0000 7f9db51ff700 1 -- 172.21.15.82:0/3534530522 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9db0101b20 msgr2=0x7f9db0196b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:00.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.297+0000 7f9db51ff700 1 --2- 172.21.15.82:0/3534530522 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9db0101b20 0x7f9db0196b40 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f9da400d950 tx=0x7f9da400dc60 comp rx=0 tx=0).stop 2023-09-23T08:56:00.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.297+0000 7f9db51ff700 1 -- 172.21.15.82:0/3534530522 shutdown_connections 2023-09-23T08:56:00.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.297+0000 7f9db51ff700 1 --2- 172.21.15.82:0/3534530522 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f9d9809ffe0 0x7f9d980a24a0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.297+0000 7f9db51ff700 1 --2- 172.21.15.82:0/3534530522 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9db01024c0 0x7f9db019dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.297+0000 7f9db51ff700 1 --2- 172.21.15.82:0/3534530522 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9db0100930 0x7f9db0196600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.297+0000 7f9db51ff700 1 --2- 172.21.15.82:0/3534530522 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9db0101b20 0x7f9db0196b40 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.297+0000 7f9db51ff700 1 -- 172.21.15.82:0/3534530522 >> 172.21.15.82:0/3534530522 conn(0x7f9db00fbea0 msgr2=0x7f9db00fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:00.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.297+0000 7f9db51ff700 1 -- 172.21.15.82:0/3534530522 shutdown_connections 2023-09-23T08:56:00.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.297+0000 7f9db51ff700 1 -- 172.21.15.82:0/3534530522 wait complete. 2023-09-23T08:56:00.318 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2023-09-23T08:56:00.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.513+0000 7f6a15dff700 1 -- 172.21.15.82:0/471637015 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a10101b20 msgr2=0x7f6a10101f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:00.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.513+0000 7f6a15dff700 1 --2- 172.21.15.82:0/471637015 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a10101b20 0x7f6a10101f80 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f69f80099c0 tx=0x7f69f8009cd0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.513+0000 7f6a15dff700 1 -- 172.21.15.82:0/471637015 shutdown_connections 2023-09-23T08:56:00.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.513+0000 7f6a15dff700 1 --2- 172.21.15.82:0/471637015 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a101024c0 0x7f6a10108d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.513+0000 7f6a15dff700 1 --2- 172.21.15.82:0/471637015 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a10100930 0x7f6a10100d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.513+0000 7f6a15dff700 1 --2- 172.21.15.82:0/471637015 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a10101b20 0x7f6a10101f80 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.513+0000 7f6a15dff700 1 -- 172.21.15.82:0/471637015 >> 172.21.15.82:0/471637015 conn(0x7f6a100fbea0 msgr2=0x7f6a100fe2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:00.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.513+0000 7f6a15dff700 1 -- 172.21.15.82:0/471637015 shutdown_connections 2023-09-23T08:56:00.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.513+0000 7f6a15dff700 1 -- 172.21.15.82:0/471637015 wait complete. 2023-09-23T08:56:00.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.514+0000 7f6a15dff700 1 Processor -- start 2023-09-23T08:56:00.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.514+0000 7f6a15dff700 1 -- start start 2023-09-23T08:56:00.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.514+0000 7f6a15dff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a10100930 0x7f6a100746d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:00.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.514+0000 7f6a15dff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a10101b20 0x7f6a10072d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:00.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.514+0000 7f6a15dff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a101024c0 0x7f6a10073250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:00.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.514+0000 7f6a15dff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a100739f0 con 0x7f6a10100930 2023-09-23T08:56:00.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.514+0000 7f6a15dff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a10073b60 con 0x7f6a101024c0 2023-09-23T08:56:00.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.514+0000 7f6a15dff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a101a05c0 con 0x7f6a10101b20 2023-09-23T08:56:00.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.515+0000 7f6a0f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a10100930 0x7f6a100746d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:00.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.515+0000 7f6a0f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a10100930 0x7f6a100746d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54814/0 (socket says 172.21.15.82:54814) 2023-09-23T08:56:00.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.515+0000 7f6a0f7fe700 1 -- 172.21.15.82:0/2982729094 learned_addr learned my addr 172.21.15.82:0/2982729094 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:00.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.515+0000 7f6a0ffff700 1 --2- 172.21.15.82:0/2982729094 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a101024c0 0x7f6a10073250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:00.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.515+0000 7f6a07fff700 1 --2- 172.21.15.82:0/2982729094 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a10101b20 0x7f6a10072d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:00.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.515+0000 7f6a0f7fe700 1 -- 172.21.15.82:0/2982729094 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a10101b20 msgr2=0x7f6a10072d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:00.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.515+0000 7f6a0f7fe700 1 --2- 172.21.15.82:0/2982729094 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a10101b20 0x7f6a10072d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.515+0000 7f6a0f7fe700 1 -- 172.21.15.82:0/2982729094 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a101024c0 msgr2=0x7f6a10073250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:00.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.515+0000 7f6a0f7fe700 1 --2- 172.21.15.82:0/2982729094 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a101024c0 0x7f6a10073250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.515+0000 7f6a0f7fe700 1 -- 172.21.15.82:0/2982729094 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69f80095f0 con 0x7f6a10100930 2023-09-23T08:56:00.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.515+0000 7f6a07fff700 1 --2- 172.21.15.82:0/2982729094 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a10101b20 0x7f6a10072d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T08:56:00.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.515+0000 7f6a0f7fe700 1 --2- 172.21.15.82:0/2982729094 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a10100930 0x7f6a100746d0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6a0000d980 tx=0x7f6a0000dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:00.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.515+0000 7f6a0d7fa700 1 -- 172.21.15.82:0/2982729094 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a0000de60 con 0x7f6a10100930 2023-09-23T08:56:00.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.516+0000 7f6a0d7fa700 1 -- 172.21.15.82:0/2982729094 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6a000044b0 con 0x7f6a10100930 2023-09-23T08:56:00.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.516+0000 7f6a15dff700 1 -- 172.21.15.82:0/2982729094 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a101a08a0 con 0x7f6a10100930 2023-09-23T08:56:00.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.516+0000 7f6a0d7fa700 1 -- 172.21.15.82:0/2982729094 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a00003b40 con 0x7f6a10100930 2023-09-23T08:56:00.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.516+0000 7f6a15dff700 1 -- 172.21.15.82:0/2982729094 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a101a0db0 con 0x7f6a10100930 2023-09-23T08:56:00.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.519+0000 7f6a0d7fa700 1 -- 172.21.15.82:0/2982729094 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) v1 ==== 134722+0+0 (secure 0 0 0) 0x7f6a00003ca0 con 0x7f6a10100930 2023-09-23T08:56:00.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.520+0000 7f6a29695b80 1 Processor -- start 2023-09-23T08:56:00.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.520+0000 7f6a29695b80 1 -- start start 2023-09-23T08:56:00.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.520+0000 7f6a0d7fa700 1 --2- 172.21.15.82:0/2982729094 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f69fc09ffe0 0x7f69fc0a24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:00.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.520+0000 7f6a29695b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eec8c56980 0x55eec8c56da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:00.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.520+0000 7f6a29695b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eec8c572e0 0x55eec8c57720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:00.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.520+0000 7f6a29695b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55eec8c57d00 0x55eec8c58180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:00.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.520+0000 7f6a29695b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eec8bbe760 con 0x55eec8c572e0 2023-09-23T08:56:00.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.520+0000 7f6a29695b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eec8baf730 con 0x55eec8c56980 2023-09-23T08:56:00.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.520+0000 7f6a29695b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eec8bad050 con 0x55eec8c57d00 2023-09-23T08:56:00.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.521+0000 7f6a0d7fa700 1 -- 172.21.15.82:0/2982729094 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f6a000cb0c0 con 0x7f6a10100930 2023-09-23T08:56:00.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.521+0000 7f6a07fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eec8c572e0 0x55eec8c57720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:00.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.521+0000 7f6a0ffff700 1 --2- 172.21.15.82:0/2982729094 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f69fc09ffe0 0x7f69fc0a24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:00.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.521+0000 7f6a07fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eec8c572e0 0x55eec8c57720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54816/0 (socket says 172.21.15.82:54816) 2023-09-23T08:56:00.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.521+0000 7f6a07fff700 1 -- 172.21.15.82:0/3867315556 learned_addr learned my addr 172.21.15.82:0/3867315556 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:00.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.521+0000 7f6a0f7fe700 1 --2- 172.21.15.82:0/3867315556 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eec8c56980 0x55eec8c56da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:00.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.521+0000 7f6a0ffff700 1 --2- 172.21.15.82:0/3867315556 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55eec8c57d00 0x55eec8c58180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:00.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.521+0000 7f6a07fff700 1 -- 172.21.15.82:0/3867315556 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55eec8c57d00 msgr2=0x55eec8c58180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:56:00.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.521+0000 7f6a07fff700 1 --2- 172.21.15.82:0/3867315556 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55eec8c57d00 0x55eec8c58180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.521+0000 7f6a07fff700 1 -- 172.21.15.82:0/3867315556 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eec8c56980 msgr2=0x55eec8c56da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:56:00.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.521+0000 7f6a07fff700 1 --2- 172.21.15.82:0/3867315556 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eec8c56980 0x55eec8c56da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.521+0000 7f6a07fff700 1 -- 172.21.15.82:0/3867315556 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eec8a285e0 con 0x55eec8c572e0 2023-09-23T08:56:00.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.521+0000 7f6a0ffff700 1 --2- 172.21.15.82:0/2982729094 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f69fc09ffe0 0x7f69fc0a24a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6a10074d30 tx=0x7f6a08007a80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:00.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.521+0000 7f6a07fff700 1 --2- 172.21.15.82:0/3867315556 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eec8c572e0 0x55eec8c57720 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f69f8009590 tx=0x7f69f8005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da451c22756339da server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:00.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.522+0000 7f6a05ffb700 1 -- 172.21.15.82:0/3867315556 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f801d070 con 0x55eec8c572e0 2023-09-23T08:56:00.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.522+0000 7f6a05ffb700 1 -- 172.21.15.82:0/3867315556 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f69f800bc20 con 0x55eec8c572e0 2023-09-23T08:56:00.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.522+0000 7f6a05ffb700 1 -- 172.21.15.82:0/3867315556 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f80039c0 con 0x55eec8c572e0 2023-09-23T08:56:00.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.522+0000 7f6a29695b80 1 -- 172.21.15.82:0/3867315556 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eec8c572e0 msgr2=0x55eec8c57720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:00.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.522+0000 7f6a29695b80 1 --2- 172.21.15.82:0/3867315556 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eec8c572e0 0x55eec8c57720 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f69f8009590 tx=0x7f69f8005e80 comp rx=0 tx=0).stop 2023-09-23T08:56:00.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.523+0000 7f6a29695b80 1 -- 172.21.15.82:0/3867315556 shutdown_connections 2023-09-23T08:56:00.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.523+0000 7f6a29695b80 1 --2- 172.21.15.82:0/3867315556 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55eec8c57d00 0x55eec8c58180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.523+0000 7f6a29695b80 1 --2- 172.21.15.82:0/3867315556 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eec8c56980 0x55eec8c56da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.523+0000 7f6a29695b80 1 --2- 172.21.15.82:0/3867315556 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eec8c572e0 0x55eec8c57720 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.523+0000 7f6a29695b80 1 -- 172.21.15.82:0/3867315556 >> 172.21.15.82:0/3867315556 conn(0x55eec8bcb090 msgr2=0x55eec8c51250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:00.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.523+0000 7f6a29695b80 1 -- 172.21.15.82:0/3867315556 shutdown_connections 2023-09-23T08:56:00.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.523+0000 7f6a29695b80 1 -- 172.21.15.82:0/3867315556 wait complete. 2023-09-23T08:56:00.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.523+0000 7f6a29695b80 1 -- start start 2023-09-23T08:56:00.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.523+0000 7f6a29695b80 1 Processor -- start 2023-09-23T08:56:00.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.524+0000 7f6a29695b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55eec8c56980 0x55eec8c60300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:00.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.524+0000 7f6a29695b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eec8c572e0 0x55eec8c60840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:00.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.524+0000 7f6a29695b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eec8c57d00 0x55eec8c67880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:00.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.524+0000 7f6a29695b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eec8ba8940 con 0x55eec8c572e0 2023-09-23T08:56:00.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.524+0000 7f6a29695b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eec8b46b60 con 0x55eec8c57d00 2023-09-23T08:56:00.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.524+0000 7f6a29695b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eec8b46860 con 0x55eec8c56980 2023-09-23T08:56:00.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.524+0000 7f6a29695b80 10 client.0 _ll_register_callbacks cb 0x55eec8a90a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T08:56:00.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.524+0000 7f6a07fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eec8c572e0 0x55eec8c60840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:00.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.524+0000 7f6a07fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eec8c572e0 0x55eec8c60840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54828/0 (socket says 172.21.15.82:54828) 2023-09-23T08:56:00.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.524+0000 7f6a07fff700 1 -- 172.21.15.82:0/975876925 learned_addr learned my addr 172.21.15.82:0/975876925 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:00.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.524+0000 7f6a0f7fe700 1 --2- 172.21.15.82:0/975876925 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55eec8c56980 0x55eec8c60300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:00.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.524+0000 7f6a0ffff700 1 --2- 172.21.15.82:0/975876925 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eec8c57d00 0x55eec8c67880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:00.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.524+0000 7f6a07fff700 1 -- 172.21.15.82:0/975876925 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55eec8c56980 msgr2=0x55eec8c60300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:56:00.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.524+0000 7f6a07fff700 1 --2- 172.21.15.82:0/975876925 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55eec8c56980 0x55eec8c60300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.524+0000 7f6a07fff700 1 -- 172.21.15.82:0/975876925 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eec8c57d00 msgr2=0x55eec8c67880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:56:00.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.524+0000 7f6a07fff700 1 --2- 172.21.15.82:0/975876925 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eec8c57d00 0x55eec8c67880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.524+0000 7f6a07fff700 1 -- 172.21.15.82:0/975876925 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a101096c0 con 0x55eec8c572e0 2023-09-23T08:56:00.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.525+0000 7f6a07fff700 1 --2- 172.21.15.82:0/975876925 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eec8c572e0 0x55eec8c60840 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f69f80099c0 tx=0x7f69f800ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4aaf70525d32028e server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:00.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.525+0000 7f69eeffd700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T08:56:00.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.525+0000 7f69eeffd700 1 -- 172.21.15.82:0/975876925 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f801d040 con 0x55eec8c572e0 2023-09-23T08:56:00.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.525+0000 7f69eeffd700 1 -- 172.21.15.82:0/975876925 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f69f800bce0 con 0x55eec8c572e0 2023-09-23T08:56:00.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.525+0000 7f6a29695b80 1 -- 172.21.15.82:0/975876925 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55eec8c26170 con 0x55eec8c572e0 2023-09-23T08:56:00.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.525+0000 7f69eeffd700 1 -- 172.21.15.82:0/975876925 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f69f8003b70 con 0x55eec8c572e0 2023-09-23T08:56:00.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.525+0000 7f6a29695b80 10 client.15141 fetch_fsmap learned FSMap version 26 2023-09-23T08:56:00.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.525+0000 7f6a29695b80 1 -- 172.21.15.82:0/975876925 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55eec89d4d90 con 0x55eec8c572e0 2023-09-23T08:56:00.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.525+0000 7f69eeffd700 1 -- 172.21.15.82:0/975876925 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55eec8c26170 con 0x55eec8c572e0 2023-09-23T08:56:00.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.525+0000 7f69eeffd700 1 -- 172.21.15.82:0/975876925 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f69f8028070 con 0x55eec8c572e0 2023-09-23T08:56:00.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.526+0000 7f6a29695b80 10 client.15141 fetch_fsmap finished waiting for FSMap version 26 2023-09-23T08:56:00.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.526+0000 7f6a29695b80 10 client.15141 resolve_mds: resolved name 'i' to daemon mds.i 2023-09-23T08:56:00.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.526+0000 7f6a29695b80 20 client.15141 populate_metadata read hostname 'smithi082' 2023-09-23T08:56:00.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.526+0000 7f6a29695b80 1 --2- 172.21.15.82:0/975876925 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x55eec8c6ba20 0x55eec8c6a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:00.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.526+0000 7f6a29695b80 4 client.15141 mds_command: new command op to 24550 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T08:56:00.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.526+0000 7f6a29695b80 1 -- 172.21.15.82:0/975876925 --> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55eec8b4eb50 con 0x55eec8c6ba20 2023-09-23T08:56:00.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.526+0000 7f6a0f7fe700 1 --2- 172.21.15.82:0/975876925 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x55eec8c6ba20 0x55eec8c6a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:00.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.526+0000 7f6a0f7fe700 1 --2- 172.21.15.82:0/975876925 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x55eec8c6ba20 0x55eec8c6a7b0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4796e3ed6841bb2f server_cookie=41c572ca0cd1d674 in_seq=0 out_seq=0 2023-09-23T08:56:00.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.526+0000 7f69eeffd700 10 client.15141 ms_handle_connect on v2:172.21.15.161:6838/758982817 2023-09-23T08:56:00.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.527+0000 7f69eeffd700 1 -- 172.21.15.82:0/975876925 <== mds.1 v2:172.21.15.161:6838/758982817 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55eec8b4eb50 con 0x55eec8c6ba20 2023-09-23T08:56:00.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.527+0000 7f69eeffd700 10 client.15141 handle_command_reply: tid=0 2023-09-23T08:56:00.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.527+0000 7f6a29695b80 1 client.15141 shutdown 2023-09-23T08:56:00.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.527+0000 7f6a29695b80 1 -- 172.21.15.82:0/975876925 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eec8c572e0 msgr2=0x55eec8c60840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:00.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.527+0000 7f6a29695b80 1 --2- 172.21.15.82:0/975876925 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eec8c572e0 0x55eec8c60840 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f69f80099c0 tx=0x7f69f800ba40 comp rx=0 tx=0).stop 2023-09-23T08:56:00.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.528+0000 7f6a29695b80 1 -- 172.21.15.82:0/975876925 shutdown_connections 2023-09-23T08:56:00.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.528+0000 7f6a29695b80 1 --2- 172.21.15.82:0/975876925 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x55eec8c6ba20 0x55eec8c6a7b0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.528+0000 7f6a29695b80 1 --2- 172.21.15.82:0/975876925 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eec8c57d00 0x55eec8c67880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.528+0000 7f6a29695b80 1 --2- 172.21.15.82:0/975876925 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55eec8c56980 0x55eec8c60300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.528+0000 7f6a29695b80 1 --2- 172.21.15.82:0/975876925 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eec8c572e0 0x55eec8c60840 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.528+0000 7f69eeffd700 0 client.15141 ms_handle_reset on v2:172.21.15.161:6838/758982817 2023-09-23T08:56:00.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.528+0000 7f6a29695b80 1 -- 172.21.15.82:0/975876925 >> 172.21.15.82:0/975876925 conn(0x55eec8bcb090 msgr2=0x55eec8c4baf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:00.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.528+0000 7f6a29695b80 1 -- 172.21.15.82:0/975876925 shutdown_connections 2023-09-23T08:56:00.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.528+0000 7f6a29695b80 1 -- 172.21.15.82:0/975876925 wait complete. 2023-09-23T08:56:00.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.528+0000 7f6a29695b80 20 client.15141 trim_cache size 0 max 16384 2023-09-23T08:56:00.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.546+0000 7f6a29695b80 1 Processor -- start 2023-09-23T08:56:00.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.546+0000 7f6a29695b80 1 -- start start 2023-09-23T08:56:00.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.546+0000 7f6a29695b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eec8c56980 0x55eec8c6a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:00.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.546+0000 7f6a29695b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55eec8c572e0 0x55eec8c6acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:00.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.546+0000 7f6a29695b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eec8c57d00 0x55eec8c67810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:00.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.546+0000 7f6a29695b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eec8a2a8d0 con 0x55eec8c56980 2023-09-23T08:56:00.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.546+0000 7f6a29695b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eec8c51b50 con 0x55eec8c57d00 2023-09-23T08:56:00.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.546+0000 7f6a29695b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eec8b50470 con 0x55eec8c572e0 2023-09-23T08:56:00.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.546+0000 7f6a0f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eec8c56980 0x55eec8c6a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:00.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.547+0000 7f6a0f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eec8c56980 0x55eec8c6a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54844/0 (socket says 172.21.15.82:54844) 2023-09-23T08:56:00.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.547+0000 7f6a0f7fe700 1 -- 172.21.15.82:0/3759327404 learned_addr learned my addr 172.21.15.82:0/3759327404 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:00.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.547+0000 7f6a0ffff700 1 --2- 172.21.15.82:0/3759327404 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eec8c57d00 0x55eec8c67810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:00.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.547+0000 7f6a07fff700 1 --2- 172.21.15.82:0/3759327404 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55eec8c572e0 0x55eec8c6acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:00.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.547+0000 7f6a0f7fe700 1 -- 172.21.15.82:0/3759327404 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55eec8c572e0 msgr2=0x55eec8c6acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:56:00.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.547+0000 7f6a0f7fe700 1 --2- 172.21.15.82:0/3759327404 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55eec8c572e0 0x55eec8c6acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.547+0000 7f6a0f7fe700 1 -- 172.21.15.82:0/3759327404 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eec8c57d00 msgr2=0x55eec8c67810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:56:00.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.547+0000 7f6a0f7fe700 1 --2- 172.21.15.82:0/3759327404 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eec8c57d00 0x55eec8c67810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.547+0000 7f6a0f7fe700 1 -- 172.21.15.82:0/3759327404 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eec89bdc10 con 0x55eec8c56980 2023-09-23T08:56:00.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.547+0000 7f6a07fff700 1 --2- 172.21.15.82:0/3759327404 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55eec8c572e0 0x55eec8c6acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T08:56:00.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.547+0000 7f6a0f7fe700 1 --2- 172.21.15.82:0/3759327404 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eec8c56980 0x55eec8c6a7b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f6a0000d950 tx=0x7f6a00094660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8545dd63c67e3d82 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:00.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.547+0000 7f6a067fc700 1 -- 172.21.15.82:0/3759327404 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a000b9040 con 0x55eec8c56980 2023-09-23T08:56:00.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.547+0000 7f6a067fc700 1 -- 172.21.15.82:0/3759327404 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6a000989c0 con 0x55eec8c56980 2023-09-23T08:56:00.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.547+0000 7f6a067fc700 1 -- 172.21.15.82:0/3759327404 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a000c8cd0 con 0x55eec8c56980 2023-09-23T08:56:00.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.548+0000 7f6a29695b80 1 -- 172.21.15.82:0/3759327404 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eec8c56980 msgr2=0x55eec8c6a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:00.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.548+0000 7f6a29695b80 1 --2- 172.21.15.82:0/3759327404 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eec8c56980 0x55eec8c6a7b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f6a0000d950 tx=0x7f6a00094660 comp rx=0 tx=0).stop 2023-09-23T08:56:00.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.548+0000 7f6a29695b80 1 -- 172.21.15.82:0/3759327404 shutdown_connections 2023-09-23T08:56:00.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.548+0000 7f6a29695b80 1 --2- 172.21.15.82:0/3759327404 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eec8c57d00 0x55eec8c67810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.548+0000 7f6a29695b80 1 --2- 172.21.15.82:0/3759327404 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eec8c56980 0x55eec8c6a7b0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.548+0000 7f6a29695b80 1 --2- 172.21.15.82:0/3759327404 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55eec8c572e0 0x55eec8c6acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.548+0000 7f6a29695b80 1 -- 172.21.15.82:0/3759327404 >> 172.21.15.82:0/3759327404 conn(0x55eec8bcb090 msgr2=0x55eec8c5e070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:00.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.548+0000 7f6a29695b80 1 -- 172.21.15.82:0/3759327404 shutdown_connections 2023-09-23T08:56:00.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.548+0000 7f6a29695b80 1 -- 172.21.15.82:0/3759327404 wait complete. 2023-09-23T08:56:00.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.548+0000 7f6a29695b80 1 -- start start 2023-09-23T08:56:00.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.549+0000 7f6a29695b80 1 Processor -- start 2023-09-23T08:56:00.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.549+0000 7f6a29695b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eec8c56980 0x55eec8c4b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:00.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.549+0000 7f6a29695b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eec8c572e0 0x55eec8c677a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:00.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.549+0000 7f6a29695b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55eec8c57d00 0x55eec8c4bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:00.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.549+0000 7f6a29695b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eec8cbf590 con 0x55eec8c56980 2023-09-23T08:56:00.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.549+0000 7f6a29695b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eec8cbf700 con 0x55eec8c572e0 2023-09-23T08:56:00.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.549+0000 7f6a29695b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eec8cbf8c0 con 0x55eec8c57d00 2023-09-23T08:56:00.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.549+0000 7f6a29695b80 10 client.0 _ll_register_callbacks cb 0x7f6a00004750 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T08:56:00.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.549+0000 7f6a0f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eec8c56980 0x55eec8c4b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:00.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.549+0000 7f6a0f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eec8c56980 0x55eec8c4b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54858/0 (socket says 172.21.15.82:54858) 2023-09-23T08:56:00.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.549+0000 7f6a0f7fe700 1 -- 172.21.15.82:0/2199837801 learned_addr learned my addr 172.21.15.82:0/2199837801 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:00.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.549+0000 7f6a07fff700 1 --2- 172.21.15.82:0/2199837801 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eec8c572e0 0x55eec8c677a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:00.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.549+0000 7f6a0ffff700 1 --2- 172.21.15.82:0/2199837801 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55eec8c57d00 0x55eec8c4bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:00.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.550+0000 7f6a0f7fe700 1 -- 172.21.15.82:0/2199837801 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55eec8c57d00 msgr2=0x55eec8c4bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:56:00.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.550+0000 7f6a0f7fe700 1 --2- 172.21.15.82:0/2199837801 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55eec8c57d00 0x55eec8c4bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.550+0000 7f6a0f7fe700 1 -- 172.21.15.82:0/2199837801 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eec8c572e0 msgr2=0x55eec8c677a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:56:00.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.550+0000 7f6a0f7fe700 1 --2- 172.21.15.82:0/2199837801 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eec8c572e0 0x55eec8c677a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.550+0000 7f6a0f7fe700 1 -- 172.21.15.82:0/2199837801 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a101a0db0 con 0x55eec8c56980 2023-09-23T08:56:00.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.550+0000 7f6a0ffff700 1 --2- 172.21.15.82:0/2199837801 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55eec8c57d00 0x55eec8c4bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T08:56:00.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.550+0000 7f6a0f7fe700 1 --2- 172.21.15.82:0/2199837801 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eec8c56980 0x55eec8c4b6b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f6a00009fd0 tx=0x7f6a00094e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeb719f3333799a5 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:00.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.550+0000 7f69eeffd700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T08:56:00.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.550+0000 7f69eeffd700 1 -- 172.21.15.82:0/2199837801 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a000af070 con 0x55eec8c56980 2023-09-23T08:56:00.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.550+0000 7f69eeffd700 1 -- 172.21.15.82:0/2199837801 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f6a0009c7f0 con 0x55eec8c56980 2023-09-23T08:56:00.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.550+0000 7f6a29695b80 1 -- 172.21.15.82:0/2199837801 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55eec8c49860 con 0x55eec8c56980 2023-09-23T08:56:00.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.550+0000 7f69eeffd700 1 -- 172.21.15.82:0/2199837801 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6a000b9040 con 0x55eec8c56980 2023-09-23T08:56:00.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.550+0000 7f6a29695b80 10 client.15147 fetch_fsmap learned FSMap version 26 2023-09-23T08:56:00.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.550+0000 7f6a29695b80 1 -- 172.21.15.82:0/2199837801 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55eec89fb200 con 0x55eec8c56980 2023-09-23T08:56:00.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.551+0000 7f69eeffd700 1 -- 172.21.15.82:0/2199837801 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6a00062020 con 0x55eec8c56980 2023-09-23T08:56:00.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.551+0000 7f69eeffd700 1 -- 172.21.15.82:0/2199837801 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f6a00098cb0 con 0x55eec8c56980 2023-09-23T08:56:00.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.551+0000 7f6a29695b80 10 client.15147 fetch_fsmap finished waiting for FSMap version 26 2023-09-23T08:56:00.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.551+0000 7f6a29695b80 10 client.15147 resolve_mds: resolved name 'i' to daemon mds.i 2023-09-23T08:56:00.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.551+0000 7f6a29695b80 20 client.15147 populate_metadata read hostname 'smithi082' 2023-09-23T08:56:00.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.551+0000 7f6a29695b80 1 --2- 172.21.15.82:0/2199837801 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x55eec8cc4790 0x55eec8cc0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:00.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.551+0000 7f6a29695b80 4 client.15147 mds_command: new command op to 24550 tid=0[{"prefix": "status"}] 2023-09-23T08:56:00.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.551+0000 7f6a29695b80 1 -- 172.21.15.82:0/2199837801 --> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55eec8ba1920 con 0x55eec8cc4790 2023-09-23T08:56:00.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.551+0000 7f6a07fff700 1 --2- 172.21.15.82:0/2199837801 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x55eec8cc4790 0x55eec8cc0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:00.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.552+0000 7f69eeffd700 10 client.15147 ms_handle_connect on v2:172.21.15.161:6838/758982817 2023-09-23T08:56:00.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.552+0000 7f6a07fff700 1 --2- 172.21.15.82:0/2199837801 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x55eec8cc4790 0x55eec8cc0cf0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ef0d176fcccaddb8 server_cookie=ab05d61aec42716c in_seq=0 out_seq=0 2023-09-23T08:56:00.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.552+0000 7f69eeffd700 1 -- 172.21.15.82:0/2199837801 <== mds.1 v2:172.21.15.161:6838/758982817 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x55eec8ba1920 con 0x55eec8cc4790 2023-09-23T08:56:00.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.552+0000 7f69eeffd700 10 client.15147 handle_command_reply: tid=0 2023-09-23T08:56:00.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.552+0000 7f6a29695b80 1 client.15147 shutdown 2023-09-23T08:56:00.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.552+0000 7f6a29695b80 1 -- 172.21.15.82:0/2199837801 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eec8c56980 msgr2=0x55eec8c4b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:00.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.552+0000 7f6a29695b80 1 --2- 172.21.15.82:0/2199837801 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eec8c56980 0x55eec8c4b6b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f6a00009fd0 tx=0x7f6a00094e30 comp rx=0 tx=0).stop 2023-09-23T08:56:00.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.552+0000 7f6a29695b80 1 -- 172.21.15.82:0/2199837801 shutdown_connections 2023-09-23T08:56:00.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.552+0000 7f6a29695b80 1 --2- 172.21.15.82:0/2199837801 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x55eec8cc4790 0x55eec8cc0cf0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.552+0000 7f6a29695b80 1 --2- 172.21.15.82:0/2199837801 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55eec8c57d00 0x55eec8c4bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.552+0000 7f6a29695b80 1 --2- 172.21.15.82:0/2199837801 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eec8c56980 0x55eec8c4b6b0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.552+0000 7f69eeffd700 0 client.15147 ms_handle_reset on v2:172.21.15.161:6838/758982817 2023-09-23T08:56:00.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.552+0000 7f6a29695b80 1 --2- 172.21.15.82:0/2199837801 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eec8c572e0 0x55eec8c677a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.552+0000 7f6a29695b80 1 -- 172.21.15.82:0/2199837801 >> 172.21.15.82:0/2199837801 conn(0x55eec8bcb090 msgr2=0x55eec8c6a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:00.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.552+0000 7f6a29695b80 1 -- 172.21.15.82:0/2199837801 shutdown_connections 2023-09-23T08:56:00.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.552+0000 7f6a29695b80 1 -- 172.21.15.82:0/2199837801 wait complete. 2023-09-23T08:56:00.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.552+0000 7f6a29695b80 20 client.15147 trim_cache size 0 max 16384 2023-09-23T08:56:00.563 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T08:56:00.564 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "8926e286-59ed-11ee-8db4-212e2dc638e7", 2023-09-23T08:56:00.564 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 1, 2023-09-23T08:56:00.564 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 24550, 2023-09-23T08:56:00.564 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2023-09-23T08:56:00.564 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2023-09-23T08:56:00.564 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2023-09-23T08:56:00.564 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 64.145775809, 2023-09-23T08:56:00.564 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 26, 2023-09-23T08:56:00.564 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 88, 2023-09-23T08:56:00.564 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 86, 2023-09-23T08:56:00.565 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 84.091648230000004 2023-09-23T08:56:00.565 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T08:56:00.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.553+0000 7f6a15dff700 1 -- 172.21.15.82:0/2982729094 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f69fc09ffe0 msgr2=0x7f69fc0a24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:00.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.553+0000 7f6a15dff700 1 --2- 172.21.15.82:0/2982729094 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f69fc09ffe0 0x7f69fc0a24a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6a10074d30 tx=0x7f6a08007a80 comp rx=0 tx=0).stop 2023-09-23T08:56:00.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.553+0000 7f6a15dff700 1 -- 172.21.15.82:0/2982729094 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a10100930 msgr2=0x7f6a100746d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:00.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.553+0000 7f6a15dff700 1 --2- 172.21.15.82:0/2982729094 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a10100930 0x7f6a100746d0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6a0000d980 tx=0x7f6a0000dd40 comp rx=0 tx=0).stop 2023-09-23T08:56:00.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.553+0000 7f6a15dff700 1 -- 172.21.15.82:0/2982729094 shutdown_connections 2023-09-23T08:56:00.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.553+0000 7f6a15dff700 1 --2- 172.21.15.82:0/2982729094 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f69fc09ffe0 0x7f69fc0a24a0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.553+0000 7f6a15dff700 1 --2- 172.21.15.82:0/2982729094 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a101024c0 0x7f6a10073250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.553+0000 7f6a15dff700 1 --2- 172.21.15.82:0/2982729094 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a10100930 0x7f6a100746d0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.553+0000 7f6a15dff700 1 --2- 172.21.15.82:0/2982729094 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a10101b20 0x7f6a10072d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.553+0000 7f6a15dff700 1 -- 172.21.15.82:0/2982729094 >> 172.21.15.82:0/2982729094 conn(0x7f6a100fbea0 msgr2=0x7f6a100fe1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:00.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.553+0000 7f6a15dff700 1 -- 172.21.15.82:0/2982729094 shutdown_connections 2023-09-23T08:56:00.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.553+0000 7f6a15dff700 1 -- 172.21.15.82:0/2982729094 wait complete. 2023-09-23T08:56:00.572 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:00 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/2907361016' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T08:56:00.572 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:00 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:56:00.572 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:00 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:56:00.573 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:00 smithi082 ceph-mon[97694]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:56:00.575 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-09-23T08:56:00.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.770+0000 7f5931dff700 1 -- 172.21.15.82:0/2029663925 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f592c100a00 msgr2=0x7f592c100e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:00.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.770+0000 7f5931dff700 1 --2- 172.21.15.82:0/2029663925 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f592c100a00 0x7f592c100e60 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f59140099c0 tx=0x7f5914009cd0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.770+0000 7f5931dff700 1 -- 172.21.15.82:0/2029663925 shutdown_connections 2023-09-23T08:56:00.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.770+0000 7f5931dff700 1 --2- 172.21.15.82:0/2029663925 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f592c1013a0 0x7f592c107c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.770+0000 7f5931dff700 1 --2- 172.21.15.82:0/2029663925 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f592c0ff810 0x7f592c0ffc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.770+0000 7f5931dff700 1 --2- 172.21.15.82:0/2029663925 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f592c100a00 0x7f592c100e60 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.770+0000 7f5931dff700 1 -- 172.21.15.82:0/2029663925 >> 172.21.15.82:0/2029663925 conn(0x7f592c0fad80 msgr2=0x7f592c0fd1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:00.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.770+0000 7f5931dff700 1 -- 172.21.15.82:0/2029663925 shutdown_connections 2023-09-23T08:56:00.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.770+0000 7f5931dff700 1 -- 172.21.15.82:0/2029663925 wait complete. 2023-09-23T08:56:00.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.771+0000 7f5931dff700 1 Processor -- start 2023-09-23T08:56:00.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.771+0000 7f5931dff700 1 -- start start 2023-09-23T08:56:00.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.771+0000 7f5931dff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f592c0ff810 0x7f592c10a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:00.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.771+0000 7f5931dff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f592c100a00 0x7f592c108760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:00.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.771+0000 7f5931dff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f592c1013a0 0x7f592c108ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:00.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.771+0000 7f5931dff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f592c109440 con 0x7f592c1013a0 2023-09-23T08:56:00.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.771+0000 7f5931dff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f592c1095b0 con 0x7f592c0ff810 2023-09-23T08:56:00.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.771+0000 7f5931dff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f592c1a05e0 con 0x7f592c100a00 2023-09-23T08:56:00.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.772+0000 7f592bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f592c1013a0 0x7f592c108ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:00.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.772+0000 7f592bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f592c1013a0 0x7f592c108ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54876/0 (socket says 172.21.15.82:54876) 2023-09-23T08:56:00.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.772+0000 7f592bfff700 1 -- 172.21.15.82:0/3191268327 learned_addr learned my addr 172.21.15.82:0/3191268327 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:00.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.772+0000 7f592b7fe700 1 --2- 172.21.15.82:0/3191268327 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f592c0ff810 0x7f592c10a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:00.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.772+0000 7f5923fff700 1 --2- 172.21.15.82:0/3191268327 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f592c100a00 0x7f592c108760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:00.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.772+0000 7f592bfff700 1 -- 172.21.15.82:0/3191268327 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f592c100a00 msgr2=0x7f592c108760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:00.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.772+0000 7f592bfff700 1 --2- 172.21.15.82:0/3191268327 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f592c100a00 0x7f592c108760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.772+0000 7f592bfff700 1 -- 172.21.15.82:0/3191268327 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f592c0ff810 msgr2=0x7f592c10a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:00.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.772+0000 7f592bfff700 1 --2- 172.21.15.82:0/3191268327 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f592c0ff810 0x7f592c10a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.772+0000 7f592bfff700 1 -- 172.21.15.82:0/3191268327 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59140095f0 con 0x7f592c1013a0 2023-09-23T08:56:00.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.772+0000 7f5923fff700 1 --2- 172.21.15.82:0/3191268327 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f592c100a00 0x7f592c108760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T08:56:00.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.772+0000 7f592bfff700 1 --2- 172.21.15.82:0/3191268327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f592c1013a0 0x7f592c108ca0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f5924007ee0 tx=0x7f592400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:00.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.772+0000 7f59297fa700 1 -- 172.21.15.82:0/3191268327 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f592400ddd0 con 0x7f592c1013a0 2023-09-23T08:56:00.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.772+0000 7f59297fa700 1 -- 172.21.15.82:0/3191268327 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f592400f040 con 0x7f592c1013a0 2023-09-23T08:56:00.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.772+0000 7f5931dff700 1 -- 172.21.15.82:0/3191268327 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f592c1a08c0 con 0x7f592c1013a0 2023-09-23T08:56:00.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.773+0000 7f59297fa700 1 -- 172.21.15.82:0/3191268327 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59240047d0 con 0x7f592c1013a0 2023-09-23T08:56:00.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.773+0000 7f5931dff700 1 -- 172.21.15.82:0/3191268327 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f592c1a0d80 con 0x7f592c1013a0 2023-09-23T08:56:00.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.775+0000 7f59297fa700 1 -- 172.21.15.82:0/3191268327 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) v1 ==== 134722+0+0 (secure 0 0 0) 0x7f5924003a00 con 0x7f592c1013a0 2023-09-23T08:56:00.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.777+0000 7f5945794b80 1 Processor -- start 2023-09-23T08:56:00.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.777+0000 7f59297fa700 1 --2- 172.21.15.82:0/3191268327 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f591809ffe0 0x7f59180a24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:00.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.777+0000 7f5945794b80 1 -- start start 2023-09-23T08:56:00.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.778+0000 7f59297fa700 1 -- 172.21.15.82:0/3191268327 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f59240cad50 con 0x7f592c1013a0 2023-09-23T08:56:00.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.778+0000 7f5923fff700 1 --2- 172.21.15.82:0/3191268327 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f591809ffe0 0x7f59180a24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:00.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.778+0000 7f5945794b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561548c49980 0x561548c49da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:00.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.778+0000 7f5945794b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561548c4a2e0 0x561548c4a720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:00.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.778+0000 7f5945794b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561548c4ad00 0x561548c4b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:00.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.778+0000 7f5945794b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561548bb1760 con 0x561548c4ad00 2023-09-23T08:56:00.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.778+0000 7f5945794b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561548ba2730 con 0x561548c4a2e0 2023-09-23T08:56:00.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.778+0000 7f5945794b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x561548ba0050 con 0x561548c49980 2023-09-23T08:56:00.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.778+0000 7f592bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561548c4ad00 0x561548c4b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:00.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.778+0000 7f592b7fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561548c49980 0x561548c49da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:00.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.778+0000 7f592bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561548c4ad00 0x561548c4b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54888/0 (socket says 172.21.15.82:54888) 2023-09-23T08:56:00.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.778+0000 7f592bfff700 1 -- 172.21.15.82:0/1104160693 learned_addr learned my addr 172.21.15.82:0/1104160693 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:00.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.778+0000 7f5923fff700 1 --2- 172.21.15.82:0/3191268327 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f591809ffe0 0x7f59180a24a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5914006010 tx=0x7f591400b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:00.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.778+0000 7f5923fff700 1 --2- 172.21.15.82:0/1104160693 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561548c4a2e0 0x561548c4a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:00.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.779+0000 7f592b7fe700 1 -- 172.21.15.82:0/1104160693 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561548c4a2e0 msgr2=0x561548c4a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:56:00.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.779+0000 7f592b7fe700 1 --2- 172.21.15.82:0/1104160693 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561548c4a2e0 0x561548c4a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.779+0000 7f592b7fe700 1 -- 172.21.15.82:0/1104160693 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561548c4ad00 msgr2=0x561548c4b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:56:00.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.779+0000 7f592b7fe700 1 --2- 172.21.15.82:0/1104160693 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561548c4ad00 0x561548c4b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.779+0000 7f592b7fe700 1 -- 172.21.15.82:0/1104160693 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561548a1b5e0 con 0x561548c49980 2023-09-23T08:56:00.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.779+0000 7f5923fff700 1 --2- 172.21.15.82:0/1104160693 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561548c4a2e0 0x561548c4a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T08:56:00.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.779+0000 7f592bfff700 1 --2- 172.21.15.82:0/1104160693 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561548c4ad00 0x561548c4b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T08:56:00.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.779+0000 7f592b7fe700 1 --2- 172.21.15.82:0/1104160693 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561548c49980 0x561548c49da0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f591c009c80 tx=0x7f591c009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=62c1a7212481e015 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:00.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.779+0000 7f5921ffb700 1 -- 172.21.15.82:0/1104160693 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f591c011cb0 con 0x561548c49980 2023-09-23T08:56:00.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.779+0000 7f5921ffb700 1 -- 172.21.15.82:0/1104160693 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f591c011e10 con 0x561548c49980 2023-09-23T08:56:00.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.779+0000 7f5921ffb700 1 -- 172.21.15.82:0/1104160693 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f591c005020 con 0x561548c49980 2023-09-23T08:56:00.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.780+0000 7f5945794b80 1 -- 172.21.15.82:0/1104160693 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561548c49980 msgr2=0x561548c49da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:00.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.780+0000 7f5945794b80 1 --2- 172.21.15.82:0/1104160693 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561548c49980 0x561548c49da0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f591c009c80 tx=0x7f591c009f90 comp rx=0 tx=0).stop 2023-09-23T08:56:00.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.780+0000 7f5945794b80 1 -- 172.21.15.82:0/1104160693 shutdown_connections 2023-09-23T08:56:00.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.780+0000 7f5945794b80 1 --2- 172.21.15.82:0/1104160693 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561548c4ad00 0x561548c4b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.780+0000 7f5945794b80 1 --2- 172.21.15.82:0/1104160693 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561548c49980 0x561548c49da0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.780+0000 7f5945794b80 1 --2- 172.21.15.82:0/1104160693 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561548c4a2e0 0x561548c4a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.780+0000 7f5945794b80 1 -- 172.21.15.82:0/1104160693 >> 172.21.15.82:0/1104160693 conn(0x561548bbe090 msgr2=0x561548c44250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:00.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.780+0000 7f5945794b80 1 -- 172.21.15.82:0/1104160693 shutdown_connections 2023-09-23T08:56:00.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.780+0000 7f5945794b80 1 -- 172.21.15.82:0/1104160693 wait complete. 2023-09-23T08:56:00.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.781+0000 7f5945794b80 1 -- start start 2023-09-23T08:56:00.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.781+0000 7f5945794b80 1 Processor -- start 2023-09-23T08:56:00.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.782+0000 7f5945794b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561548c49980 0x561548c533b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:00.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.782+0000 7f5945794b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561548c4a2e0 0x561548c538f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:00.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.782+0000 7f5945794b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561548c4ad00 0x561548c5a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:00.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.782+0000 7f5945794b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561548b9b940 con 0x561548c4a2e0 2023-09-23T08:56:00.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.782+0000 7f5945794b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561548b39b60 con 0x561548c4ad00 2023-09-23T08:56:00.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.782+0000 7f5945794b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x561548b39860 con 0x561548c49980 2023-09-23T08:56:00.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.782+0000 7f5945794b80 10 client.0 _ll_register_callbacks cb 0x561548a83a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T08:56:00.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.782+0000 7f5923fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561548c4a2e0 0x561548c538f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:00.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.782+0000 7f5923fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561548c4a2e0 0x561548c538f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54892/0 (socket says 172.21.15.82:54892) 2023-09-23T08:56:00.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.782+0000 7f592b7fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561548c49980 0x561548c533b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:00.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.782+0000 7f5923fff700 1 -- 172.21.15.82:0/1981140009 learned_addr learned my addr 172.21.15.82:0/1981140009 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:00.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.782+0000 7f592bfff700 1 --2- 172.21.15.82:0/1981140009 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561548c4ad00 0x561548c5a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:00.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.782+0000 7f592b7fe700 1 -- 172.21.15.82:0/1981140009 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561548c4ad00 msgr2=0x561548c5a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:56:00.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.782+0000 7f592b7fe700 1 --2- 172.21.15.82:0/1981140009 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561548c4ad00 0x561548c5a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.782+0000 7f592b7fe700 1 -- 172.21.15.82:0/1981140009 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561548c4a2e0 msgr2=0x561548c538f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:56:00.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.782+0000 7f592b7fe700 1 --2- 172.21.15.82:0/1981140009 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561548c4a2e0 0x561548c538f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.782+0000 7f592b7fe700 1 -- 172.21.15.82:0/1981140009 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f592c1a0d80 con 0x561548c49980 2023-09-23T08:56:00.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.782+0000 7f5923fff700 1 --2- 172.21.15.82:0/1981140009 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561548c4a2e0 0x561548c538f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T08:56:00.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.783+0000 7f592b7fe700 1 --2- 172.21.15.82:0/1981140009 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561548c49980 0x561548c533b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f591c009c80 tx=0x7f591c0047e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bdd0672a830b61ad server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:00.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.783+0000 7f590affd700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T08:56:00.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.783+0000 7f590affd700 1 -- 172.21.15.82:0/1981140009 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f591c004fa0 con 0x561548c49980 2023-09-23T08:56:00.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.783+0000 7f5945794b80 1 -- 172.21.15.82:0/1981140009 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561548c19170 con 0x561548c49980 2023-09-23T08:56:00.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.783+0000 7f590affd700 1 -- 172.21.15.82:0/1981140009 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f591c005100 con 0x561548c49980 2023-09-23T08:56:00.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.783+0000 7f590affd700 1 -- 172.21.15.82:0/1981140009 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f591c0052c0 con 0x561548c49980 2023-09-23T08:56:00.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.783+0000 7f5945794b80 10 client.24985 fetch_fsmap learned FSMap version 26 2023-09-23T08:56:00.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.783+0000 7f5945794b80 1 -- 172.21.15.82:0/1981140009 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7f591c0098e0 con 0x561548c49980 2023-09-23T08:56:00.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.784+0000 7f590affd700 1 -- 172.21.15.82:0/1981140009 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x561548c19170 con 0x561548c49980 2023-09-23T08:56:00.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.784+0000 7f590affd700 1 -- 172.21.15.82:0/1981140009 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f591c022400 con 0x561548c49980 2023-09-23T08:56:00.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.784+0000 7f5945794b80 10 client.24985 fetch_fsmap finished waiting for FSMap version 26 2023-09-23T08:56:00.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.784+0000 7f5945794b80 10 client.24985 resolve_mds: resolved name 'b' to daemon mds.b 2023-09-23T08:56:00.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.784+0000 7f5945794b80 20 client.24985 populate_metadata read hostname 'smithi082' 2023-09-23T08:56:00.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.784+0000 7f5945794b80 1 --2- 172.21.15.82:0/1981140009 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x561548c5ee30 0x561548c5d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:00.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.784+0000 7f5945794b80 4 client.24985 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T08:56:00.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.784+0000 7f5945794b80 1 -- 172.21.15.82:0/1981140009 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561548b41b50 con 0x561548c5ee30 2023-09-23T08:56:00.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.784+0000 7f5923fff700 1 --2- 172.21.15.82:0/1981140009 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x561548c5ee30 0x561548c5d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:00.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.785+0000 7f5923fff700 1 --2- 172.21.15.82:0/1981140009 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x561548c5ee30 0x561548c5d980 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae7117de4bea81f1 server_cookie=2e4b44c165f19738 in_seq=0 out_seq=0 2023-09-23T08:56:00.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.785+0000 7f590affd700 10 client.24985 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T08:56:00.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.786+0000 7f590affd700 1 -- 172.21.15.82:0/1981140009 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x561548b41b50 con 0x561548c5ee30 2023-09-23T08:56:00.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.786+0000 7f590affd700 10 client.24985 handle_command_reply: tid=0 2023-09-23T08:56:00.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.786+0000 7f5945794b80 1 client.24985 shutdown 2023-09-23T08:56:00.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.786+0000 7f5945794b80 1 -- 172.21.15.82:0/1981140009 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561548c49980 msgr2=0x561548c533b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:00.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.786+0000 7f5945794b80 1 --2- 172.21.15.82:0/1981140009 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561548c49980 0x561548c533b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f591c009c80 tx=0x7f591c0047e0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.786+0000 7f5945794b80 1 -- 172.21.15.82:0/1981140009 shutdown_connections 2023-09-23T08:56:00.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.786+0000 7f5945794b80 1 --2- 172.21.15.82:0/1981140009 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561548c4ad00 0x561548c5a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.786+0000 7f5945794b80 1 --2- 172.21.15.82:0/1981140009 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561548c49980 0x561548c533b0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.786+0000 7f5945794b80 1 --2- 172.21.15.82:0/1981140009 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x561548c5ee30 0x561548c5d980 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.786+0000 7f5945794b80 1 --2- 172.21.15.82:0/1981140009 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561548c4a2e0 0x561548c538f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.786+0000 7f590affd700 0 client.24985 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T08:56:00.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.786+0000 7f5945794b80 1 -- 172.21.15.82:0/1981140009 >> 172.21.15.82:0/1981140009 conn(0x561548bbe090 msgr2=0x561548c3eaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:00.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.787+0000 7f5945794b80 1 -- 172.21.15.82:0/1981140009 shutdown_connections 2023-09-23T08:56:00.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.787+0000 7f5945794b80 1 -- 172.21.15.82:0/1981140009 wait complete. 2023-09-23T08:56:00.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.787+0000 7f5945794b80 20 client.24985 trim_cache size 0 max 16384 2023-09-23T08:56:00.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.805+0000 7f5945794b80 1 Processor -- start 2023-09-23T08:56:00.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.805+0000 7f5945794b80 1 -- start start 2023-09-23T08:56:00.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.805+0000 7f5945794b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561548c49980 0x561548c4dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:00.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.805+0000 7f5945794b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561548c4a2e0 0x561548c4e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:00.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.805+0000 7f5945794b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561548c4ad00 0x561548c5a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:00.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.805+0000 7f5945794b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561548a1d8d0 con 0x561548c4a2e0 2023-09-23T08:56:00.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.805+0000 7f5945794b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561548b5bdf0 con 0x561548c4ad00 2023-09-23T08:56:00.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.805+0000 7f5945794b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x561548b57f00 con 0x561548c49980 2023-09-23T08:56:00.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.805+0000 7f5923fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561548c4a2e0 0x561548c4e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:00.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.805+0000 7f5923fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561548c4a2e0 0x561548c4e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54906/0 (socket says 172.21.15.82:54906) 2023-09-23T08:56:00.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.805+0000 7f5923fff700 1 -- 172.21.15.82:0/553756160 learned_addr learned my addr 172.21.15.82:0/553756160 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:00.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.805+0000 7f592b7fe700 1 --2- 172.21.15.82:0/553756160 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561548c49980 0x561548c4dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:00.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.806+0000 7f592bfff700 1 --2- 172.21.15.82:0/553756160 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561548c4ad00 0x561548c5a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:00.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.806+0000 7f5923fff700 1 -- 172.21.15.82:0/553756160 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561548c49980 msgr2=0x561548c4dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:56:00.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.806+0000 7f5923fff700 1 --2- 172.21.15.82:0/553756160 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561548c49980 0x561548c4dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.806+0000 7f5923fff700 1 -- 172.21.15.82:0/553756160 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561548c4ad00 msgr2=0x561548c5a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:56:00.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.806+0000 7f5923fff700 1 --2- 172.21.15.82:0/553756160 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561548c4ad00 0x561548c5a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.806+0000 7f5923fff700 1 -- 172.21.15.82:0/553756160 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561548c67a60 con 0x561548c4a2e0 2023-09-23T08:56:00.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.806+0000 7f592bfff700 1 --2- 172.21.15.82:0/553756160 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561548c4ad00 0x561548c5a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T08:56:00.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.806+0000 7f5923fff700 1 --2- 172.21.15.82:0/553756160 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561548c4a2e0 0x561548c4e100 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x561548c54410 tx=0x7f591401f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12329ea3a9cfda14 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:00.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.806+0000 7f59227fc700 1 -- 172.21.15.82:0/553756160 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f591401d070 con 0x561548c4a2e0 2023-09-23T08:56:00.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.806+0000 7f59227fc700 1 -- 172.21.15.82:0/553756160 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f591402c040 con 0x561548c4a2e0 2023-09-23T08:56:00.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.806+0000 7f59227fc700 1 -- 172.21.15.82:0/553756160 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5914031e60 con 0x561548c4a2e0 2023-09-23T08:56:00.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.807+0000 7f5945794b80 1 -- 172.21.15.82:0/553756160 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561548c4a2e0 msgr2=0x561548c4e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:00.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.807+0000 7f5945794b80 1 --2- 172.21.15.82:0/553756160 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561548c4a2e0 0x561548c4e100 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x561548c54410 tx=0x7f591401f000 comp rx=0 tx=0).stop 2023-09-23T08:56:00.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.807+0000 7f5945794b80 1 -- 172.21.15.82:0/553756160 shutdown_connections 2023-09-23T08:56:00.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.807+0000 7f5945794b80 1 --2- 172.21.15.82:0/553756160 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561548c4ad00 0x561548c5a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.807+0000 7f5945794b80 1 --2- 172.21.15.82:0/553756160 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561548c49980 0x561548c4dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.807+0000 7f5945794b80 1 --2- 172.21.15.82:0/553756160 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561548c4a2e0 0x561548c4e100 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.807+0000 7f5945794b80 1 -- 172.21.15.82:0/553756160 >> 172.21.15.82:0/553756160 conn(0x561548bbe090 msgr2=0x561548c520c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:00.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.807+0000 7f5945794b80 1 -- 172.21.15.82:0/553756160 shutdown_connections 2023-09-23T08:56:00.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.807+0000 7f5945794b80 1 -- 172.21.15.82:0/553756160 wait complete. 2023-09-23T08:56:00.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.807+0000 7f5945794b80 1 -- start start 2023-09-23T08:56:00.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.807+0000 7f5945794b80 1 Processor -- start 2023-09-23T08:56:00.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.808+0000 7f5945794b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561548c49980 0x561548c3e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:00.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.808+0000 7f5945794b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561548c4a2e0 0x561548c5a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:00.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.808+0000 7f5945794b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561548c4ad00 0x561548c3eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:00.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.808+0000 7f5945794b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561548cb2860 con 0x561548c49980 2023-09-23T08:56:00.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.808+0000 7f5945794b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561548cb29d0 con 0x561548c4ad00 2023-09-23T08:56:00.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.808+0000 7f5945794b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x561548cb2b90 con 0x561548c4a2e0 2023-09-23T08:56:00.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.808+0000 7f5945794b80 10 client.0 _ll_register_callbacks cb 0x7f5924007f10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T08:56:00.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.808+0000 7f592b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561548c49980 0x561548c3e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:00.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.808+0000 7f5923fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561548c4a2e0 0x561548c5a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:00.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.808+0000 7f592b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561548c49980 0x561548c3e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54920/0 (socket says 172.21.15.82:54920) 2023-09-23T08:56:00.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.808+0000 7f592b7fe700 1 -- 172.21.15.82:0/393147843 learned_addr learned my addr 172.21.15.82:0/393147843 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:00.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.808+0000 7f592bfff700 1 --2- 172.21.15.82:0/393147843 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561548c4ad00 0x561548c3eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:00.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.808+0000 7f592b7fe700 1 -- 172.21.15.82:0/393147843 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561548c4a2e0 msgr2=0x561548c5a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:56:00.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.808+0000 7f592b7fe700 1 --2- 172.21.15.82:0/393147843 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561548c4a2e0 0x561548c5a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.808+0000 7f592b7fe700 1 -- 172.21.15.82:0/393147843 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561548c4ad00 msgr2=0x561548c3eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:56:00.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.808+0000 7f592b7fe700 1 --2- 172.21.15.82:0/393147843 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561548c4ad00 0x561548c3eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.808+0000 7f592b7fe700 1 -- 172.21.15.82:0/393147843 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f592c067a80 con 0x561548c49980 2023-09-23T08:56:00.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.809+0000 7f592b7fe700 1 --2- 172.21.15.82:0/393147843 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561548c49980 0x561548c3e600 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f591c022810 tx=0x7f591c022980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad54f615947ee1b3 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:00.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.809+0000 7f590affd700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T08:56:00.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.809+0000 7f590affd700 1 -- 172.21.15.82:0/393147843 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f591c022400 con 0x561548c49980 2023-09-23T08:56:00.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.809+0000 7f5945794b80 1 -- 172.21.15.82:0/393147843 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561548c3c860 con 0x561548c49980 2023-09-23T08:56:00.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.809+0000 7f590affd700 1 -- 172.21.15.82:0/393147843 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f591c022560 con 0x561548c49980 2023-09-23T08:56:00.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.809+0000 7f590affd700 1 -- 172.21.15.82:0/393147843 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f591c004040 con 0x561548c49980 2023-09-23T08:56:00.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.809+0000 7f5945794b80 10 client.15165 fetch_fsmap learned FSMap version 26 2023-09-23T08:56:00.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.809+0000 7f5945794b80 1 -- 172.21.15.82:0/393147843 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5615489c7d90 con 0x561548c49980 2023-09-23T08:56:00.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.809+0000 7f590affd700 1 -- 172.21.15.82:0/393147843 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x561548c3c860 con 0x561548c49980 2023-09-23T08:56:00.818 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:00 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/2907361016' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T08:56:00.819 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:00 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:56:00.819 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:00 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:56:00.819 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:00 smithi135 ceph-mon[99205]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:56:00.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.809+0000 7f590affd700 1 -- 172.21.15.82:0/393147843 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f591c003680 con 0x561548c49980 2023-09-23T08:56:00.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.810+0000 7f5945794b80 10 client.15165 fetch_fsmap finished waiting for FSMap version 26 2023-09-23T08:56:00.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.810+0000 7f5945794b80 10 client.15165 resolve_mds: resolved name 'b' to daemon mds.b 2023-09-23T08:56:00.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.810+0000 7f5945794b80 20 client.15165 populate_metadata read hostname 'smithi082' 2023-09-23T08:56:00.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.810+0000 7f5945794b80 1 --2- 172.21.15.82:0/393147843 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x561548cb78b0 0x561548cb3d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:00.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.810+0000 7f5945794b80 4 client.15165 mds_command: new command op to 24557 tid=0[{"prefix": "status"}] 2023-09-23T08:56:00.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.810+0000 7f5945794b80 1 -- 172.21.15.82:0/393147843 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "status"}) v1 -- 0x561548b94920 con 0x561548cb78b0 2023-09-23T08:56:00.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.810+0000 7f5923fff700 1 --2- 172.21.15.82:0/393147843 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x561548cb78b0 0x561548cb3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:00.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.811+0000 7f590affd700 10 client.15165 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T08:56:00.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.811+0000 7f5923fff700 1 --2- 172.21.15.82:0/393147843 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x561548cb78b0 0x561548cb3d30 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d0e0dfd7738f618a server_cookie=a0458901e93958d in_seq=0 out_seq=0 2023-09-23T08:56:00.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.811+0000 7f590affd700 1 -- 172.21.15.82:0/393147843 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x561548b94920 con 0x561548cb78b0 2023-09-23T08:56:00.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.811+0000 7f590affd700 10 client.15165 handle_command_reply: tid=0 2023-09-23T08:56:00.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.811+0000 7f5945794b80 1 client.15165 shutdown 2023-09-23T08:56:00.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.811+0000 7f5945794b80 1 -- 172.21.15.82:0/393147843 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561548c49980 msgr2=0x561548c3e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:00.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.811+0000 7f5945794b80 1 --2- 172.21.15.82:0/393147843 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561548c49980 0x561548c3e600 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f591c022810 tx=0x7f591c022980 comp rx=0 tx=0).stop 2023-09-23T08:56:00.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.811+0000 7f5945794b80 1 -- 172.21.15.82:0/393147843 shutdown_connections 2023-09-23T08:56:00.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.811+0000 7f5945794b80 1 --2- 172.21.15.82:0/393147843 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561548c4ad00 0x561548c3eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.811+0000 7f5945794b80 1 --2- 172.21.15.82:0/393147843 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x561548cb78b0 0x561548cb3d30 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.811+0000 7f5945794b80 1 --2- 172.21.15.82:0/393147843 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561548c49980 0x561548c3e600 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.811+0000 7f5945794b80 1 --2- 172.21.15.82:0/393147843 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561548c4a2e0 0x561548c5a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.811+0000 7f590affd700 0 client.15165 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T08:56:00.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.811+0000 7f5945794b80 1 -- 172.21.15.82:0/393147843 >> 172.21.15.82:0/393147843 conn(0x561548bbe090 msgr2=0x561548c4dbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:00.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.811+0000 7f5945794b80 1 -- 172.21.15.82:0/393147843 shutdown_connections 2023-09-23T08:56:00.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.812+0000 7f5945794b80 1 -- 172.21.15.82:0/393147843 wait complete. 2023-09-23T08:56:00.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.812+0000 7f5945794b80 20 client.15165 trim_cache size 0 max 16384 2023-09-23T08:56:00.823 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T08:56:00.823 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "8926e286-59ed-11ee-8db4-212e2dc638e7", 2023-09-23T08:56:00.823 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 0, 2023-09-23T08:56:00.823 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 24557, 2023-09-23T08:56:00.823 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2023-09-23T08:56:00.823 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2023-09-23T08:56:00.823 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2023-09-23T08:56:00.823 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 67.403421937999994, 2023-09-23T08:56:00.823 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 26, 2023-09-23T08:56:00.823 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 88, 2023-09-23T08:56:00.824 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 86, 2023-09-23T08:56:00.824 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 74.994695725 2023-09-23T08:56:00.824 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T08:56:00.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.812+0000 7f5931dff700 1 -- 172.21.15.82:0/3191268327 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f591809ffe0 msgr2=0x7f59180a24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:00.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.812+0000 7f5931dff700 1 --2- 172.21.15.82:0/3191268327 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f591809ffe0 0x7f59180a24a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5914006010 tx=0x7f591400b540 comp rx=0 tx=0).stop 2023-09-23T08:56:00.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.812+0000 7f5931dff700 1 -- 172.21.15.82:0/3191268327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f592c1013a0 msgr2=0x7f592c108ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:00.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.812+0000 7f5931dff700 1 --2- 172.21.15.82:0/3191268327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f592c1013a0 0x7f592c108ca0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f5924007ee0 tx=0x7f592400d3b0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.812+0000 7f5931dff700 1 -- 172.21.15.82:0/3191268327 shutdown_connections 2023-09-23T08:56:00.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.812+0000 7f5931dff700 1 --2- 172.21.15.82:0/3191268327 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f591809ffe0 0x7f59180a24a0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.812+0000 7f5931dff700 1 --2- 172.21.15.82:0/3191268327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f592c1013a0 0x7f592c108ca0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.812+0000 7f5931dff700 1 --2- 172.21.15.82:0/3191268327 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f592c0ff810 0x7f592c10a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.812+0000 7f5931dff700 1 --2- 172.21.15.82:0/3191268327 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f592c100a00 0x7f592c108760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:00.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.812+0000 7f5931dff700 1 -- 172.21.15.82:0/3191268327 >> 172.21.15.82:0/3191268327 conn(0x7f592c0fad80 msgr2=0x7f592c0fd0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:00.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.812+0000 7f5931dff700 1 -- 172.21.15.82:0/3191268327 shutdown_connections 2023-09-23T08:56:00.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:00.812+0000 7f5931dff700 1 -- 172.21.15.82:0/3191268327 wait complete. 2023-09-23T08:56:00.834 INFO:tasks.cephadm:Setup complete, yielding 2023-09-23T08:56:00.834 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-09-23T08:56:00.843 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi082.front.sepia.ceph.com 2023-09-23T08:56:00.844 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- bash -c 'ceph orch status' 2023-09-23T08:56:00.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:00 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/2907361016' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T08:56:00.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:00 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:56:00.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:00 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:56:00.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:00 smithi161 ceph-mon[99580]: from='mgr.14152 172.21.15.82:0/2067380268' entity='mgr.x' 2023-09-23T08:56:01.559 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.a/config 2023-09-23T08:56:01.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:01 smithi135 ceph-mon[99205]: pgmap v337: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-09-23T08:56:01.830 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:01 smithi082 ceph-mon[97694]: pgmap v337: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-09-23T08:56:01.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:01 smithi161 ceph-mon[99580]: pgmap v337: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-09-23T08:56:03.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:03.106+0000 7fe914b85700 1 -- 172.21.15.82:0/3052799733 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9101009b0 msgr2=0x7fe910100dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:03.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:03.106+0000 7fe914b85700 1 --2- 172.21.15.82:0/3052799733 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9101009b0 0x7fe910100dd0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fe9000099c0 tx=0x7fe900009cd0 comp rx=0 tx=0).stop 2023-09-23T08:56:03.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:03.106+0000 7fe914b85700 1 -- 172.21.15.82:0/3052799733 shutdown_connections 2023-09-23T08:56:03.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:03.106+0000 7fe914b85700 1 --2- 172.21.15.82:0/3052799733 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe910102550 0x7fe910108e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:03.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:03.106+0000 7fe914b85700 1 --2- 172.21.15.82:0/3052799733 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9101009b0 0x7fe910100dd0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:03.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:03.106+0000 7fe914b85700 1 --2- 172.21.15.82:0/3052799733 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe910101bb0 0x7fe910102010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:03.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:03.106+0000 7fe914b85700 1 -- 172.21.15.82:0/3052799733 >> 172.21.15.82:0/3052799733 conn(0x7fe9100fbf10 msgr2=0x7fe9100fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:03.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:03.106+0000 7fe914b85700 1 -- 172.21.15.82:0/3052799733 shutdown_connections 2023-09-23T08:56:03.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:03.106+0000 7fe914b85700 1 -- 172.21.15.82:0/3052799733 wait complete. 2023-09-23T08:56:03.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:03.107+0000 7fe914b85700 1 Processor -- start 2023-09-23T08:56:03.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:03.107+0000 7fe914b85700 1 -- start start 2023-09-23T08:56:03.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:03.107+0000 7fe914b85700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9101009b0 0x7fe9101987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:03.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:03.107+0000 7fe914b85700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe910101bb0 0x7fe910198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:03.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:03.107+0000 7fe914b85700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe910102550 0x7fe91019fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:03.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:03.107+0000 7fe914b85700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9101a0370 con 0x7fe910102550 2023-09-23T08:56:03.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:03.107+0000 7fe914b85700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9101a04b0 con 0x7fe9101009b0 2023-09-23T08:56:03.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:03.107+0000 7fe914b85700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9101a0640 con 0x7fe910101bb0 2023-09-23T08:56:03.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:03.108+0000 7fe90dd9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe910101bb0 0x7fe910198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:03.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:03.108+0000 7fe90dd9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe910101bb0 0x7fe910198d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:37214/0 (socket says 172.21.15.82:37214) 2023-09-23T08:56:03.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:03.108+0000 7fe90dd9b700 1 -- 172.21.15.82:0/1108738471 learned_addr learned my addr 172.21.15.82:0/1108738471 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:03.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:03.108+0000 7fe90ed9d700 1 --2- 172.21.15.82:0/1108738471 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe910102550 0x7fe91019fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:03.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:03.108+0000 7fe90e59c700 1 --2- 172.21.15.82:0/1108738471 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9101009b0 0x7fe9101987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:03.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:03.109+0000 7fe90dd9b700 1 -- 172.21.15.82:0/1108738471 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9101009b0 msgr2=0x7fe9101987e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:03.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:03.109+0000 7fe90dd9b700 1 --2- 172.21.15.82:0/1108738471 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9101009b0 0x7fe9101987e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:03.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:03.109+0000 7fe90dd9b700 1 -- 172.21.15.82:0/1108738471 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe910102550 msgr2=0x7fe91019fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:03.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:03.109+0000 7fe90dd9b700 1 --2- 172.21.15.82:0/1108738471 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe910102550 0x7fe91019fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:03.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:03.109+0000 7fe90dd9b700 1 -- 172.21.15.82:0/1108738471 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9000095f0 con 0x7fe910101bb0 2023-09-23T08:56:03.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:03.109+0000 7fe90e59c700 1 --2- 172.21.15.82:0/1108738471 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9101009b0 0x7fe9101987e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T08:56:03.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:03.109+0000 7fe90dd9b700 1 --2- 172.21.15.82:0/1108738471 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe910101bb0 0x7fe910198d20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe90400d980 tx=0x7fe90400dc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:03.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:03.109+0000 7fe8ff7fe700 1 -- 172.21.15.82:0/1108738471 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe904009b40 con 0x7fe910101bb0 2023-09-23T08:56:03.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:03.109+0000 7fe8ff7fe700 1 -- 172.21.15.82:0/1108738471 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe90400b6e0 con 0x7fe910101bb0 2023-09-23T08:56:03.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:03.109+0000 7fe914b85700 1 -- 172.21.15.82:0/1108738471 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9101a0920 con 0x7fe910101bb0 2023-09-23T08:56:03.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:03.109+0000 7fe8ff7fe700 1 -- 172.21.15.82:0/1108738471 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe90400f3c0 con 0x7fe910101bb0 2023-09-23T08:56:03.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:03.109+0000 7fe914b85700 1 -- 172.21.15.82:0/1108738471 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9101a0e20 con 0x7fe910101bb0 2023-09-23T08:56:03.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:03.110+0000 7fe914b85700 1 -- 172.21.15.82:0/1108738471 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe91010c0b0 con 0x7fe910101bb0 2023-09-23T08:56:03.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:03.113+0000 7fe8ff7fe700 1 -- 172.21.15.82:0/1108738471 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 17) v1 ==== 134722+0+0 (secure 0 0 0) 0x7fe904010460 con 0x7fe910101bb0 2023-09-23T08:56:03.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:03.114+0000 7fe8ff7fe700 1 --2- 172.21.15.82:0/1108738471 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fe8f809ffe0 0x7fe8f80a24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:03.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:03.114+0000 7fe8ff7fe700 1 -- 172.21.15.82:0/1108738471 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fe9040cb2c0 con 0x7fe910101bb0 2023-09-23T08:56:03.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:03.114+0000 7fe90e59c700 1 --2- 172.21.15.82:0/1108738471 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fe8f809ffe0 0x7fe8f80a24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:03.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:03.115+0000 7fe90e59c700 1 --2- 172.21.15.82:0/1108738471 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fe8f809ffe0 0x7fe8f80a24a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe900000c00 tx=0x7fe900005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:03.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:03.116+0000 7fe8ff7fe700 1 -- 172.21.15.82:0/1108738471 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7fe904094ea0 con 0x7fe910101bb0 2023-09-23T08:56:03.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:03.331+0000 7fe914b85700 1 -- 172.21.15.82:0/1108738471 --> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe9101085b0 con 0x7fe8f809ffe0 2023-09-23T08:56:03.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:03.332+0000 7fe8ff7fe700 1 -- 172.21.15.82:0/1108738471 <== mgr.14152 v2:172.21.15.82:6800/3698954311 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fe9101085b0 con 0x7fe8f809ffe0 2023-09-23T08:56:03.338 INFO:teuthology.orchestra.run.smithi082.stdout:Backend: cephadm 2023-09-23T08:56:03.338 INFO:teuthology.orchestra.run.smithi082.stdout:Available: Yes 2023-09-23T08:56:03.338 INFO:teuthology.orchestra.run.smithi082.stdout:Paused: No 2023-09-23T08:56:03.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:03.334+0000 7fe914b85700 1 -- 172.21.15.82:0/1108738471 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fe8f809ffe0 msgr2=0x7fe8f80a24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:03.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:03.334+0000 7fe914b85700 1 --2- 172.21.15.82:0/1108738471 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fe8f809ffe0 0x7fe8f80a24a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe900000c00 tx=0x7fe900005fb0 comp rx=0 tx=0).stop 2023-09-23T08:56:03.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:03.334+0000 7fe914b85700 1 -- 172.21.15.82:0/1108738471 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe910101bb0 msgr2=0x7fe910198d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:03.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:03.334+0000 7fe914b85700 1 --2- 172.21.15.82:0/1108738471 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe910101bb0 0x7fe910198d20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe90400d980 tx=0x7fe90400dc90 comp rx=0 tx=0).stop 2023-09-23T08:56:03.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:03.334+0000 7fe914b85700 1 -- 172.21.15.82:0/1108738471 shutdown_connections 2023-09-23T08:56:03.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:03.334+0000 7fe914b85700 1 --2- 172.21.15.82:0/1108738471 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fe8f809ffe0 0x7fe8f80a24a0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:03.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:03.334+0000 7fe914b85700 1 --2- 172.21.15.82:0/1108738471 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe910102550 0x7fe91019fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:03.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:03.334+0000 7fe914b85700 1 --2- 172.21.15.82:0/1108738471 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9101009b0 0x7fe9101987e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:03.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:03.334+0000 7fe914b85700 1 --2- 172.21.15.82:0/1108738471 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe910101bb0 0x7fe910198d20 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:03.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:03.334+0000 7fe914b85700 1 -- 172.21.15.82:0/1108738471 >> 172.21.15.82:0/1108738471 conn(0x7fe9100fbf10 msgr2=0x7fe9100fe200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:03.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:03.335+0000 7fe914b85700 1 -- 172.21.15.82:0/1108738471 shutdown_connections 2023-09-23T08:56:03.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:03.335+0000 7fe914b85700 1 -- 172.21.15.82:0/1108738471 wait complete. 2023-09-23T08:56:03.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:03 smithi082 ceph-mon[97694]: pgmap v338: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2023-09-23T08:56:03.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:03 smithi135 ceph-mon[99205]: pgmap v338: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2023-09-23T08:56:03.833 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- bash -c 'ceph orch ps' 2023-09-23T08:56:03.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:03 smithi161 ceph-mon[99580]: pgmap v338: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2023-09-23T08:56:04.559 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.a/config 2023-09-23T08:56:04.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:04 smithi135 ceph-mon[99205]: from='client.24997 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:56:04.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:04 smithi082 ceph-mon[97694]: from='client.24997 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:56:04.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:04 smithi161 ceph-mon[99580]: from='client.24997 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:56:05.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:05 smithi135 ceph-mon[99205]: pgmap v339: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-09-23T08:56:05.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:05 smithi082 ceph-mon[97694]: pgmap v339: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-09-23T08:56:05.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:05 smithi161 ceph-mon[99580]: pgmap v339: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-09-23T08:56:06.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:06.181+0000 7f519b25c700 1 -- 172.21.15.82:0/1403907989 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5194108880 msgr2=0x7f519410ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:06.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:06.181+0000 7f519b25c700 1 --2- 172.21.15.82:0/1403907989 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5194108880 0x7f519410ad10 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f518c00b0a0 tx=0x7f518c00b3b0 comp rx=0 tx=0).stop 2023-09-23T08:56:06.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:06.181+0000 7f519b25c700 1 -- 172.21.15.82:0/1403907989 shutdown_connections 2023-09-23T08:56:06.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:06.181+0000 7f519b25c700 1 --2- 172.21.15.82:0/1403907989 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5194108880 0x7f519410ad10 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:06.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:06.181+0000 7f519b25c700 1 --2- 172.21.15.82:0/1403907989 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5194074950 0x7f5194072db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:06.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:06.181+0000 7f519b25c700 1 --2- 172.21.15.82:0/1403907989 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5194073380 0x7f5194073800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:06.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:06.181+0000 7f519b25c700 1 -- 172.21.15.82:0/1403907989 >> 172.21.15.82:0/1403907989 conn(0x7f51940fbf10 msgr2=0x7f51940fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:06.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:06.181+0000 7f519b25c700 1 -- 172.21.15.82:0/1403907989 shutdown_connections 2023-09-23T08:56:06.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:06.182+0000 7f519b25c700 1 -- 172.21.15.82:0/1403907989 wait complete. 2023-09-23T08:56:06.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:06.182+0000 7f519b25c700 1 Processor -- start 2023-09-23T08:56:06.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:06.183+0000 7f519b25c700 1 -- start start 2023-09-23T08:56:06.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:06.183+0000 7f519b25c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5194073380 0x7f5194198810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:06.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:06.183+0000 7f519b25c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5194074950 0x7f5194198d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:06.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:06.183+0000 7f519b25c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5194108880 0x7f519419fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:06.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:06.183+0000 7f519b25c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51941a03a0 con 0x7f5194073380 2023-09-23T08:56:06.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:06.183+0000 7f519b25c700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51941a04e0 con 0x7f5194108880 2023-09-23T08:56:06.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:06.183+0000 7f519b25c700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51941a0670 con 0x7f5194074950 2023-09-23T08:56:06.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:06.183+0000 7f5198ff8700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5194073380 0x7f5194198810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:06.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:06.183+0000 7f5198ff8700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5194073380 0x7f5194198810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55178/0 (socket says 172.21.15.82:55178) 2023-09-23T08:56:06.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:06.183+0000 7f5198ff8700 1 -- 172.21.15.82:0/3971374844 learned_addr learned my addr 172.21.15.82:0/3971374844 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:06.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:06.183+0000 7f51997f9700 1 --2- 172.21.15.82:0/3971374844 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5194108880 0x7f519419fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:06.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:06.183+0000 7f518bfff700 1 --2- 172.21.15.82:0/3971374844 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5194074950 0x7f5194198d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:06.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:06.184+0000 7f5198ff8700 1 -- 172.21.15.82:0/3971374844 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5194074950 msgr2=0x7f5194198d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:06.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:06.184+0000 7f5198ff8700 1 --2- 172.21.15.82:0/3971374844 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5194074950 0x7f5194198d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:06.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:06.184+0000 7f5198ff8700 1 -- 172.21.15.82:0/3971374844 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5194108880 msgr2=0x7f519419fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:06.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:06.184+0000 7f5198ff8700 1 --2- 172.21.15.82:0/3971374844 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5194108880 0x7f519419fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:06.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:06.184+0000 7f5198ff8700 1 -- 172.21.15.82:0/3971374844 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f518c009d00 con 0x7f5194073380 2023-09-23T08:56:06.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:06.184+0000 7f518bfff700 1 --2- 172.21.15.82:0/3971374844 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5194074950 0x7f5194198d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T08:56:06.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:06.184+0000 7f5198ff8700 1 --2- 172.21.15.82:0/3971374844 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5194073380 0x7f5194198810 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f519000d9b0 tx=0x7f519000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:06.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:06.184+0000 7f5189ffb700 1 -- 172.21.15.82:0/3971374844 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5190009930 con 0x7f5194073380 2023-09-23T08:56:06.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:06.184+0000 7f5189ffb700 1 -- 172.21.15.82:0/3971374844 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5190010460 con 0x7f5194073380 2023-09-23T08:56:06.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:06.184+0000 7f519b25c700 1 -- 172.21.15.82:0/3971374844 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51941a0950 con 0x7f5194073380 2023-09-23T08:56:06.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:06.184+0000 7f5189ffb700 1 -- 172.21.15.82:0/3971374844 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f519000f620 con 0x7f5194073380 2023-09-23T08:56:06.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:06.184+0000 7f519b25c700 1 -- 172.21.15.82:0/3971374844 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51941a0ea0 con 0x7f5194073380 2023-09-23T08:56:06.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:06.185+0000 7f519b25c700 1 -- 172.21.15.82:0/3971374844 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5194106f30 con 0x7f5194073380 2023-09-23T08:56:06.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:06.187+0000 7f5189ffb700 1 -- 172.21.15.82:0/3971374844 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) v1 ==== 134722+0+0 (secure 0 0 0) 0x7f51900105d0 con 0x7f5194073380 2023-09-23T08:56:06.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:06.188+0000 7f5189ffb700 1 --2- 172.21.15.82:0/3971374844 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f517c0a0060 0x7f517c0a2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:06.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:06.189+0000 7f5189ffb700 1 -- 172.21.15.82:0/3971374844 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f51900cae30 con 0x7f5194073380 2023-09-23T08:56:06.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:06.189+0000 7f518bfff700 1 --2- 172.21.15.82:0/3971374844 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f517c0a0060 0x7f517c0a2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:06.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:06.189+0000 7f518bfff700 1 --2- 172.21.15.82:0/3971374844 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f517c0a0060 0x7f517c0a2520 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5194074680 tx=0x7f518400a680 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:06.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:06.193+0000 7f5189ffb700 1 -- 172.21.15.82:0/3971374844 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f5190094a10 con 0x7f5194073380 2023-09-23T08:56:06.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:06.402+0000 7f519b25c700 1 -- 172.21.15.82:0/3971374844 --> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f519402ce10 con 0x7f517c0a0060 2023-09-23T08:56:06.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:06.415+0000 7f5189ffb700 1 -- 172.21.15.82:0/3971374844 <== mgr.14152 v2:172.21.15.82:6800/3698954311 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+4185 (secure 0 0 0) 0x7f519402ce10 con 0x7f517c0a0060 2023-09-23T08:56:06.418 INFO:teuthology.orchestra.run.smithi082.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-09-23T08:56:06.418 INFO:teuthology.orchestra.run.smithi082.stdout:mds.a smithi082 running (84s) - 83s 16.7M - 18.0.0-5661-gdb9a2d12 5cd91c880530 d4a368dd8c1b 2023-09-23T08:56:06.418 INFO:teuthology.orchestra.run.smithi082.stdout:mds.b smithi135 running (81s) - 80s 29.0M - 18.0.0-5661-gdb9a2d12 5cd91c880530 e5d4d1cf949e 2023-09-23T08:56:06.418 INFO:teuthology.orchestra.run.smithi082.stdout:mds.c smithi161 running (96s) - 96s 18.0M - 18.0.0-5661-gdb9a2d12 5cd91c880530 e872c9bc3827 2023-09-23T08:56:06.418 INFO:teuthology.orchestra.run.smithi082.stdout:mds.d smithi082 running (106s) - 105s 13.7M - 18.0.0-5661-gdb9a2d12 5cd91c880530 2684fe8c931a 2023-09-23T08:56:06.418 INFO:teuthology.orchestra.run.smithi082.stdout:mds.e smithi135 running (102s) - 102s 16.8M - 18.0.0-5661-gdb9a2d12 5cd91c880530 f4482dd3e3d9 2023-09-23T08:56:06.419 INFO:teuthology.orchestra.run.smithi082.stdout:mds.f smithi161 running (99s) - 99s 17.9M - 18.0.0-5661-gdb9a2d12 5cd91c880530 34b6d82d1f2e 2023-09-23T08:56:06.419 INFO:teuthology.orchestra.run.smithi082.stdout:mds.g smithi082 running (87s) - 86s 16.7M - 18.0.0-5661-gdb9a2d12 5cd91c880530 1f6a848f10ef 2023-09-23T08:56:06.419 INFO:teuthology.orchestra.run.smithi082.stdout:mds.h smithi135 running (93s) - 93s 17.9M - 18.0.0-5661-gdb9a2d12 5cd91c880530 9b7e5b51ac7e 2023-09-23T08:56:06.419 INFO:teuthology.orchestra.run.smithi082.stdout:mds.i smithi161 running (90s) - 89s 17.8M - 18.0.0-5661-gdb9a2d12 5cd91c880530 aaff3dd55715 2023-09-23T08:56:06.419 INFO:teuthology.orchestra.run.smithi082.stdout:mds.j smithi082 running (109s) - 108s 13.7M - 18.0.0-5661-gdb9a2d12 5cd91c880530 272e3bf19378 2023-09-23T08:56:06.420 INFO:teuthology.orchestra.run.smithi082.stdout:mds.k smithi135 running (112s) - 111s 16.7M - 18.0.0-5661-gdb9a2d12 5cd91c880530 3e02f088cb9a 2023-09-23T08:56:06.420 INFO:teuthology.orchestra.run.smithi082.stdout:mds.l smithi161 running (115s) - 114s 18.1M - 18.0.0-5661-gdb9a2d12 5cd91c880530 f1dea9e1b3ec 2023-09-23T08:56:06.420 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.x smithi082 *:9283,8765 running (9m) - 9m 525M - 18.0.0-5661-gdb9a2d12 5cd91c880530 d3678f5583e0 2023-09-23T08:56:06.420 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.y smithi135 *:8443,8765 running (7m) - 7m 452M - 18.0.0-5661-gdb9a2d12 5cd91c880530 a517b52f1b38 2023-09-23T08:56:06.421 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.z smithi161 *:8443,8765 running (7m) - 7m 452M - 18.0.0-5661-gdb9a2d12 5cd91c880530 af08f631700b 2023-09-23T08:56:06.421 INFO:teuthology.orchestra.run.smithi082.stdout:mon.a smithi082 running (9m) - 9m 98.0M 2048M 18.0.0-5661-gdb9a2d12 5cd91c880530 2a0ccc5d8371 2023-09-23T08:56:06.421 INFO:teuthology.orchestra.run.smithi082.stdout:mon.b smithi135 running (7m) - 7m 66.5M 2048M 18.0.0-5661-gdb9a2d12 5cd91c880530 61f6e4182640 2023-09-23T08:56:06.421 INFO:teuthology.orchestra.run.smithi082.stdout:mon.c smithi161 running (7m) - 7m 66.5M 2048M 18.0.0-5661-gdb9a2d12 5cd91c880530 eda21ec5175c 2023-09-23T08:56:06.421 INFO:teuthology.orchestra.run.smithi082.stdout:osd.0 smithi082 running (7m) - 7m 65.0M 4316M 18.0.0-5661-gdb9a2d12 5cd91c880530 3cbd7cdcb813 2023-09-23T08:56:06.421 INFO:teuthology.orchestra.run.smithi082.stdout:osd.1 smithi135 running (6m) - 6m 70.9M 4316M 18.0.0-5661-gdb9a2d12 5cd91c880530 633573c6d5fd 2023-09-23T08:56:06.422 INFO:teuthology.orchestra.run.smithi082.stdout:osd.2 smithi161 running (6m) - 6m 68.5M 4316M 18.0.0-5661-gdb9a2d12 5cd91c880530 c2e95e133ae5 2023-09-23T08:56:06.422 INFO:teuthology.orchestra.run.smithi082.stdout:osd.3 smithi082 running (5m) - 5m 60.9M 4316M 18.0.0-5661-gdb9a2d12 5cd91c880530 779a966c6e5b 2023-09-23T08:56:06.422 INFO:teuthology.orchestra.run.smithi082.stdout:osd.4 smithi135 running (5m) - 5m 59.5M 4316M 18.0.0-5661-gdb9a2d12 5cd91c880530 d53fa8041dae 2023-09-23T08:56:06.422 INFO:teuthology.orchestra.run.smithi082.stdout:osd.5 smithi161 running (4m) - 4m 62.7M 4316M 18.0.0-5661-gdb9a2d12 5cd91c880530 b90178c088e1 2023-09-23T08:56:06.422 INFO:teuthology.orchestra.run.smithi082.stdout:osd.6 smithi082 running (4m) - 4m 58.2M 4316M 18.0.0-5661-gdb9a2d12 5cd91c880530 1b5c9200e32d 2023-09-23T08:56:06.422 INFO:teuthology.orchestra.run.smithi082.stdout:osd.7 smithi135 running (4m) - 4m 63.5M 4316M 18.0.0-5661-gdb9a2d12 5cd91c880530 fab78e403a33 2023-09-23T08:56:06.423 INFO:teuthology.orchestra.run.smithi082.stdout:osd.8 smithi161 running (3m) - 3m 61.1M 4316M 18.0.0-5661-gdb9a2d12 5cd91c880530 58391db5e325 2023-09-23T08:56:06.423 INFO:teuthology.orchestra.run.smithi082.stdout:osd.9 smithi082 running (3m) - 3m 57.1M 4316M 18.0.0-5661-gdb9a2d12 5cd91c880530 5b4df0f86cb5 2023-09-23T08:56:06.423 INFO:teuthology.orchestra.run.smithi082.stdout:osd.10 smithi135 running (2m) - 2m 62.5M 4316M 18.0.0-5661-gdb9a2d12 5cd91c880530 0283564f7445 2023-09-23T08:56:06.423 INFO:teuthology.orchestra.run.smithi082.stdout:osd.11 smithi161 running (2m) - 2m 52.5M 4316M 18.0.0-5661-gdb9a2d12 5cd91c880530 cabf0aaaabb7 2023-09-23T08:56:06.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:06.417+0000 7f519b25c700 1 -- 172.21.15.82:0/3971374844 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f517c0a0060 msgr2=0x7f517c0a2520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:06.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:06.417+0000 7f519b25c700 1 --2- 172.21.15.82:0/3971374844 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f517c0a0060 0x7f517c0a2520 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5194074680 tx=0x7f518400a680 comp rx=0 tx=0).stop 2023-09-23T08:56:06.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:06.417+0000 7f519b25c700 1 -- 172.21.15.82:0/3971374844 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5194073380 msgr2=0x7f5194198810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:06.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:06.417+0000 7f519b25c700 1 --2- 172.21.15.82:0/3971374844 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5194073380 0x7f5194198810 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f519000d9b0 tx=0x7f519000dcc0 comp rx=0 tx=0).stop 2023-09-23T08:56:06.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:06.417+0000 7f519b25c700 1 -- 172.21.15.82:0/3971374844 shutdown_connections 2023-09-23T08:56:06.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:06.417+0000 7f519b25c700 1 --2- 172.21.15.82:0/3971374844 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f517c0a0060 0x7f517c0a2520 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:06.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:06.417+0000 7f519b25c700 1 --2- 172.21.15.82:0/3971374844 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5194108880 0x7f519419fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:06.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:06.417+0000 7f519b25c700 1 --2- 172.21.15.82:0/3971374844 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5194073380 0x7f5194198810 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:06.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:06.417+0000 7f519b25c700 1 --2- 172.21.15.82:0/3971374844 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5194074950 0x7f5194198d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:06.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:06.417+0000 7f519b25c700 1 -- 172.21.15.82:0/3971374844 >> 172.21.15.82:0/3971374844 conn(0x7f51940fbf10 msgr2=0x7f51940fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:06.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:06.418+0000 7f519b25c700 1 -- 172.21.15.82:0/3971374844 shutdown_connections 2023-09-23T08:56:06.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:06.418+0000 7f519b25c700 1 -- 172.21.15.82:0/3971374844 wait complete. 2023-09-23T08:56:06.933 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- bash -c 'ceph orch ls' 2023-09-23T08:56:07.657 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.a/config 2023-09-23T08:56:07.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:07 smithi135 ceph-mon[99205]: pgmap v340: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2023-09-23T08:56:07.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:07 smithi135 ceph-mon[99205]: from='client.15177 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:56:07.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:07 smithi082 ceph-mon[97694]: pgmap v340: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2023-09-23T08:56:07.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:07 smithi082 ceph-mon[97694]: from='client.15177 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:56:07.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:07 smithi161 ceph-mon[99580]: pgmap v340: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2023-09-23T08:56:07.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:07 smithi161 ceph-mon[99580]: from='client.15177 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:56:09.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:09.172+0000 7f100c8d4700 1 -- 172.21.15.82:0/1624861135 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1008100980 msgr2=0x7f1008100da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:09.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:09.172+0000 7f100c8d4700 1 --2- 172.21.15.82:0/1624861135 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1008100980 0x7f1008100da0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f0ff80099c0 tx=0x7f0ff8009cd0 comp rx=0 tx=0).stop 2023-09-23T08:56:09.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:09.172+0000 7f100c8d4700 1 -- 172.21.15.82:0/1624861135 shutdown_connections 2023-09-23T08:56:09.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:09.172+0000 7f100c8d4700 1 --2- 172.21.15.82:0/1624861135 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1008102520 0x7f1008108dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:09.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:09.172+0000 7f100c8d4700 1 --2- 172.21.15.82:0/1624861135 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1008100980 0x7f1008100da0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:09.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:09.172+0000 7f100c8d4700 1 --2- 172.21.15.82:0/1624861135 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1008101b80 0x7f1008101fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:09.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:09.172+0000 7f100c8d4700 1 -- 172.21.15.82:0/1624861135 >> 172.21.15.82:0/1624861135 conn(0x7f10080fbf00 msgr2=0x7f10080fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:09.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:09.172+0000 7f100c8d4700 1 -- 172.21.15.82:0/1624861135 shutdown_connections 2023-09-23T08:56:09.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:09.172+0000 7f100c8d4700 1 -- 172.21.15.82:0/1624861135 wait complete. 2023-09-23T08:56:09.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:09.173+0000 7f100c8d4700 1 Processor -- start 2023-09-23T08:56:09.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:09.173+0000 7f100c8d4700 1 -- start start 2023-09-23T08:56:09.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:09.173+0000 7f100c8d4700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1008100980 0x7f1008196580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:09.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:09.173+0000 7f100c8d4700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1008101b80 0x7f1008196ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:09.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:09.173+0000 7f100c8d4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1008102520 0x7f100819db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:09.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:09.173+0000 7f100c8d4700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f100819e110 con 0x7f1008102520 2023-09-23T08:56:09.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:09.173+0000 7f100c8d4700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f100819e250 con 0x7f1008101b80 2023-09-23T08:56:09.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:09.173+0000 7f100c8d4700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f100819e3e0 con 0x7f1008100980 2023-09-23T08:56:09.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:09.174+0000 7f1006d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1008102520 0x7f100819db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:09.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:09.174+0000 7f1006d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1008102520 0x7f100819db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55194/0 (socket says 172.21.15.82:55194) 2023-09-23T08:56:09.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:09.174+0000 7f1006d9d700 1 -- 172.21.15.82:0/2409914403 learned_addr learned my addr 172.21.15.82:0/2409914403 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:09.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:09.174+0000 7f1005d9b700 1 --2- 172.21.15.82:0/2409914403 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1008101b80 0x7f1008196ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:09.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:09.174+0000 7f100659c700 1 --2- 172.21.15.82:0/2409914403 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1008100980 0x7f1008196580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:09.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:09.174+0000 7f1006d9d700 1 -- 172.21.15.82:0/2409914403 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1008100980 msgr2=0x7f1008196580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:09.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:09.174+0000 7f1006d9d700 1 --2- 172.21.15.82:0/2409914403 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1008100980 0x7f1008196580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:09.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:09.174+0000 7f1006d9d700 1 -- 172.21.15.82:0/2409914403 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1008101b80 msgr2=0x7f1008196ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:09.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:09.174+0000 7f1006d9d700 1 --2- 172.21.15.82:0/2409914403 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1008101b80 0x7f1008196ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:09.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:09.174+0000 7f1006d9d700 1 -- 172.21.15.82:0/2409914403 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff80095f0 con 0x7f1008102520 2023-09-23T08:56:09.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:09.174+0000 7f1006d9d700 1 --2- 172.21.15.82:0/2409914403 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1008102520 0x7f100819db40 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f1000007f10 tx=0x7f100000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:09.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:09.175+0000 7f0ff77fe700 1 -- 172.21.15.82:0/2409914403 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1000017070 con 0x7f1008102520 2023-09-23T08:56:09.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:09.175+0000 7f100c8d4700 1 -- 172.21.15.82:0/2409914403 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f100819e6c0 con 0x7f1008102520 2023-09-23T08:56:09.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:09.175+0000 7f0ff77fe700 1 -- 172.21.15.82:0/2409914403 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f100000f040 con 0x7f1008102520 2023-09-23T08:56:09.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:09.175+0000 7f0ff77fe700 1 -- 172.21.15.82:0/2409914403 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1000005570 con 0x7f1008102520 2023-09-23T08:56:09.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:09.175+0000 7f100c8d4700 1 -- 172.21.15.82:0/2409914403 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f100819ebc0 con 0x7f1008102520 2023-09-23T08:56:09.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:09.176+0000 7f100c8d4700 1 -- 172.21.15.82:0/2409914403 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1008108020 con 0x7f1008102520 2023-09-23T08:56:09.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:09.178+0000 7f0ff77fe700 1 -- 172.21.15.82:0/2409914403 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) v1 ==== 134722+0+0 (secure 0 0 0) 0x7f100000db20 con 0x7f1008102520 2023-09-23T08:56:09.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:09.179+0000 7f0ff77fe700 1 --2- 172.21.15.82:0/2409914403 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f0ff00a0060 0x7f0ff00a2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:09.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:09.179+0000 7f0ff77fe700 1 -- 172.21.15.82:0/2409914403 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f10000cab20 con 0x7f1008102520 2023-09-23T08:56:09.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:09.179+0000 7f100659c700 1 --2- 172.21.15.82:0/2409914403 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f0ff00a0060 0x7f0ff00a2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:09.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:09.180+0000 7f100659c700 1 --2- 172.21.15.82:0/2409914403 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f0ff00a0060 0x7f0ff00a2520 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0ff8006010 tx=0x7f0ff8005e80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:09.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:09.183+0000 7f0ff77fe700 1 -- 172.21.15.82:0/2409914403 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f1000094700 con 0x7f1008102520 2023-09-23T08:56:09.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:09.389+0000 7f100c8d4700 1 -- 172.21.15.82:0/2409914403 --> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f100802cdf0 con 0x7f0ff00a0060 2023-09-23T08:56:09.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:09.394+0000 7f0ff77fe700 1 -- 172.21.15.82:0/2409914403 <== mgr.14152 v2:172.21.15.82:6800/3698954311 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+980 (secure 0 0 0) 0x7f100802cdf0 con 0x7f0ff00a0060 2023-09-23T08:56:09.396 INFO:teuthology.orchestra.run.smithi082.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2023-09-23T08:56:09.397 INFO:teuthology.orchestra.run.smithi082.stdout:mds.all 12/12 - 2m smithi082=a;smithi082=d;smithi082=g;smithi082=j;smithi135=b;smithi135=e;smithi135=h;smithi135=k;smithi161=c;smithi161=f;smithi161=i;smithi161=l;count:12 2023-09-23T08:56:09.397 INFO:teuthology.orchestra.run.smithi082.stdout:mgr 3/3 - 7m smithi082=x;smithi135=y;smithi161=z;count:3 2023-09-23T08:56:09.397 INFO:teuthology.orchestra.run.smithi082.stdout:mon 3/3 - 8m smithi082:172.21.15.82=a;smithi135:172.21.15.135=b;smithi161:172.21.15.161=c;count:3 2023-09-23T08:56:09.397 INFO:teuthology.orchestra.run.smithi082.stdout:osd 12 - - 2023-09-23T08:56:09.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:09.396+0000 7f100c8d4700 1 -- 172.21.15.82:0/2409914403 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f0ff00a0060 msgr2=0x7f0ff00a2520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:09.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:09.396+0000 7f100c8d4700 1 --2- 172.21.15.82:0/2409914403 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f0ff00a0060 0x7f0ff00a2520 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0ff8006010 tx=0x7f0ff8005e80 comp rx=0 tx=0).stop 2023-09-23T08:56:09.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:09.396+0000 7f100c8d4700 1 -- 172.21.15.82:0/2409914403 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1008102520 msgr2=0x7f100819db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:09.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:09.396+0000 7f100c8d4700 1 --2- 172.21.15.82:0/2409914403 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1008102520 0x7f100819db40 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f1000007f10 tx=0x7f100000d3b0 comp rx=0 tx=0).stop 2023-09-23T08:56:09.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:09.396+0000 7f100c8d4700 1 -- 172.21.15.82:0/2409914403 shutdown_connections 2023-09-23T08:56:09.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:09.396+0000 7f100c8d4700 1 --2- 172.21.15.82:0/2409914403 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f0ff00a0060 0x7f0ff00a2520 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:09.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:09.396+0000 7f100c8d4700 1 --2- 172.21.15.82:0/2409914403 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1008102520 0x7f100819db40 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:09.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:09.396+0000 7f100c8d4700 1 --2- 172.21.15.82:0/2409914403 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1008100980 0x7f1008196580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:09.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:09.396+0000 7f100c8d4700 1 --2- 172.21.15.82:0/2409914403 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1008101b80 0x7f1008196ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:09.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:09.396+0000 7f100c8d4700 1 -- 172.21.15.82:0/2409914403 >> 172.21.15.82:0/2409914403 conn(0x7f10080fbf00 msgr2=0x7f1008105160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:09.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:09.396+0000 7f100c8d4700 1 -- 172.21.15.82:0/2409914403 shutdown_connections 2023-09-23T08:56:09.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:09.396+0000 7f100c8d4700 1 -- 172.21.15.82:0/2409914403 wait complete. 2023-09-23T08:56:09.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:09 smithi135 ceph-mon[99205]: pgmap v341: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-09-23T08:56:09.819 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:09 smithi082 ceph-mon[97694]: pgmap v341: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-09-23T08:56:09.834 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- bash -c 'ceph orch host ls' 2023-09-23T08:56:09.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:09 smithi161 ceph-mon[99580]: pgmap v341: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-09-23T08:56:10.563 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.a/config 2023-09-23T08:56:10.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:10 smithi135 ceph-mon[99205]: from='client.15183 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:56:10.835 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:10 smithi082 ceph-mon[97694]: from='client.15183 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:56:10.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:10 smithi161 ceph-mon[99580]: from='client.15183 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:56:11.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:11 smithi135 ceph-mon[99205]: pgmap v342: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-09-23T08:56:11.826 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:11 smithi082 ceph-mon[97694]: pgmap v342: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-09-23T08:56:11.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:11 smithi161 ceph-mon[99580]: pgmap v342: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-09-23T08:56:12.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:12.064+0000 7eff91bba700 1 -- 172.21.15.82:0/74257988 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff8c1009b0 msgr2=0x7eff8c100dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:12.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:12.064+0000 7eff91bba700 1 --2- 172.21.15.82:0/74257988 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff8c1009b0 0x7eff8c100dd0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7eff7c0099c0 tx=0x7eff7c009cd0 comp rx=0 tx=0).stop 2023-09-23T08:56:12.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:12.064+0000 7eff91bba700 1 -- 172.21.15.82:0/74257988 shutdown_connections 2023-09-23T08:56:12.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:12.064+0000 7eff91bba700 1 --2- 172.21.15.82:0/74257988 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff8c102550 0x7eff8c108e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:12.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:12.064+0000 7eff91bba700 1 --2- 172.21.15.82:0/74257988 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff8c1009b0 0x7eff8c100dd0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:12.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:12.064+0000 7eff91bba700 1 --2- 172.21.15.82:0/74257988 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff8c101bb0 0x7eff8c102010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:12.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:12.064+0000 7eff91bba700 1 -- 172.21.15.82:0/74257988 >> 172.21.15.82:0/74257988 conn(0x7eff8c0fbf10 msgr2=0x7eff8c0fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:12.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:12.064+0000 7eff91bba700 1 -- 172.21.15.82:0/74257988 shutdown_connections 2023-09-23T08:56:12.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:12.064+0000 7eff91bba700 1 -- 172.21.15.82:0/74257988 wait complete. 2023-09-23T08:56:12.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:12.066+0000 7eff91bba700 1 Processor -- start 2023-09-23T08:56:12.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:12.066+0000 7eff91bba700 1 -- start start 2023-09-23T08:56:12.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:12.066+0000 7eff91bba700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff8c1009b0 0x7eff8c1965f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:12.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:12.066+0000 7eff91bba700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff8c101bb0 0x7eff8c196b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:12.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:12.066+0000 7eff91bba700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff8c102550 0x7eff8c19dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:12.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:12.066+0000 7eff91bba700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff8c19e180 con 0x7eff8c101bb0 2023-09-23T08:56:12.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:12.066+0000 7eff91bba700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff8c19e2c0 con 0x7eff8c102550 2023-09-23T08:56:12.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:12.066+0000 7eff91bba700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff8c19e450 con 0x7eff8c1009b0 2023-09-23T08:56:12.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:12.067+0000 7eff8affd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff8c101bb0 0x7eff8c196b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:12.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:12.067+0000 7eff8affd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff8c101bb0 0x7eff8c196b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38900/0 (socket says 172.21.15.82:38900) 2023-09-23T08:56:12.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:12.067+0000 7eff8affd700 1 -- 172.21.15.82:0/938631322 learned_addr learned my addr 172.21.15.82:0/938631322 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:12.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:12.067+0000 7eff8b7fe700 1 --2- 172.21.15.82:0/938631322 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff8c1009b0 0x7eff8c1965f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:12.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:12.067+0000 7eff8bfff700 1 --2- 172.21.15.82:0/938631322 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff8c102550 0x7eff8c19dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:12.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:12.067+0000 7eff8affd700 1 -- 172.21.15.82:0/938631322 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff8c1009b0 msgr2=0x7eff8c1965f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:12.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:12.067+0000 7eff8affd700 1 --2- 172.21.15.82:0/938631322 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff8c1009b0 0x7eff8c1965f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:12.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:12.067+0000 7eff8affd700 1 -- 172.21.15.82:0/938631322 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff8c102550 msgr2=0x7eff8c19dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:12.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:12.067+0000 7eff8affd700 1 --2- 172.21.15.82:0/938631322 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff8c102550 0x7eff8c19dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:12.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:12.067+0000 7eff8affd700 1 -- 172.21.15.82:0/938631322 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff7c0095f0 con 0x7eff8c101bb0 2023-09-23T08:56:12.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:12.067+0000 7eff8affd700 1 --2- 172.21.15.82:0/938631322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff8c101bb0 0x7eff8c196b30 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7eff80011d90 tx=0x7eff80009520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:12.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:12.068+0000 7eff88ff9700 1 -- 172.21.15.82:0/938631322 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff80009e90 con 0x7eff8c101bb0 2023-09-23T08:56:12.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:12.068+0000 7eff91bba700 1 -- 172.21.15.82:0/938631322 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff8c072bb0 con 0x7eff8c101bb0 2023-09-23T08:56:12.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:12.068+0000 7eff88ff9700 1 -- 172.21.15.82:0/938631322 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7eff80019880 con 0x7eff8c101bb0 2023-09-23T08:56:12.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:12.068+0000 7eff88ff9700 1 -- 172.21.15.82:0/938631322 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff80017790 con 0x7eff8c101bb0 2023-09-23T08:56:12.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:12.068+0000 7eff91bba700 1 -- 172.21.15.82:0/938631322 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff8c073100 con 0x7eff8c101bb0 2023-09-23T08:56:12.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:12.069+0000 7eff91bba700 1 -- 172.21.15.82:0/938631322 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff8c10c0b0 con 0x7eff8c101bb0 2023-09-23T08:56:12.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:12.071+0000 7eff88ff9700 1 -- 172.21.15.82:0/938631322 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) v1 ==== 134722+0+0 (secure 0 0 0) 0x7eff800199f0 con 0x7eff8c101bb0 2023-09-23T08:56:12.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:12.072+0000 7eff88ff9700 1 --2- 172.21.15.82:0/938631322 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7eff7409ffe0 0x7eff740a24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:12.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:12.072+0000 7eff88ff9700 1 -- 172.21.15.82:0/938631322 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7eff800cee40 con 0x7eff8c101bb0 2023-09-23T08:56:12.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:12.072+0000 7eff8b7fe700 1 --2- 172.21.15.82:0/938631322 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7eff7409ffe0 0x7eff740a24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:12.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:12.073+0000 7eff8b7fe700 1 --2- 172.21.15.82:0/938631322 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7eff7409ffe0 0x7eff740a24a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7eff7c006010 tx=0x7eff7c005e80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:12.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:12.076+0000 7eff88ff9700 1 -- 172.21.15.82:0/938631322 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7eff80098a20 con 0x7eff8c101bb0 2023-09-23T08:56:12.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:12.287+0000 7eff91bba700 1 -- 172.21.15.82:0/938631322 --> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7eff8c072d40 con 0x7eff7409ffe0 2023-09-23T08:56:12.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:12.288+0000 7eff88ff9700 1 -- 172.21.15.82:0/938631322 <== mgr.14152 v2:172.21.15.82:6800/3698954311 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+191 (secure 0 0 0) 0x7eff8c072d40 con 0x7eff7409ffe0 2023-09-23T08:56:12.291 INFO:teuthology.orchestra.run.smithi082.stdout:HOST ADDR LABELS STATUS 2023-09-23T08:56:12.291 INFO:teuthology.orchestra.run.smithi082.stdout:smithi082 172.21.15.82 2023-09-23T08:56:12.291 INFO:teuthology.orchestra.run.smithi082.stdout:smithi135 172.21.15.135 2023-09-23T08:56:12.291 INFO:teuthology.orchestra.run.smithi082.stdout:smithi161 172.21.15.161 2023-09-23T08:56:12.292 INFO:teuthology.orchestra.run.smithi082.stdout:3 hosts in cluster 2023-09-23T08:56:12.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:12.291+0000 7eff91bba700 1 -- 172.21.15.82:0/938631322 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7eff7409ffe0 msgr2=0x7eff740a24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:12.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:12.291+0000 7eff91bba700 1 --2- 172.21.15.82:0/938631322 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7eff7409ffe0 0x7eff740a24a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7eff7c006010 tx=0x7eff7c005e80 comp rx=0 tx=0).stop 2023-09-23T08:56:12.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:12.291+0000 7eff91bba700 1 -- 172.21.15.82:0/938631322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff8c101bb0 msgr2=0x7eff8c196b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:12.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:12.291+0000 7eff91bba700 1 --2- 172.21.15.82:0/938631322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff8c101bb0 0x7eff8c196b30 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7eff80011d90 tx=0x7eff80009520 comp rx=0 tx=0).stop 2023-09-23T08:56:12.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:12.291+0000 7eff91bba700 1 -- 172.21.15.82:0/938631322 shutdown_connections 2023-09-23T08:56:12.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:12.291+0000 7eff91bba700 1 --2- 172.21.15.82:0/938631322 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7eff7409ffe0 0x7eff740a24a0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:12.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:12.291+0000 7eff91bba700 1 --2- 172.21.15.82:0/938631322 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff8c102550 0x7eff8c19dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:12.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:12.291+0000 7eff91bba700 1 --2- 172.21.15.82:0/938631322 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff8c1009b0 0x7eff8c1965f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:12.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:12.291+0000 7eff91bba700 1 --2- 172.21.15.82:0/938631322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff8c101bb0 0x7eff8c196b30 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:12.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:12.291+0000 7eff91bba700 1 -- 172.21.15.82:0/938631322 >> 172.21.15.82:0/938631322 conn(0x7eff8c0fbf10 msgr2=0x7eff8c0fe260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:12.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:12.291+0000 7eff91bba700 1 -- 172.21.15.82:0/938631322 shutdown_connections 2023-09-23T08:56:12.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:12.291+0000 7eff91bba700 1 -- 172.21.15.82:0/938631322 wait complete. 2023-09-23T08:56:12.841 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- bash -c 'ceph orch device ls' 2023-09-23T08:56:13.563 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.a/config 2023-09-23T08:56:13.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:13 smithi135 ceph-mon[99205]: pgmap v343: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-09-23T08:56:13.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:13 smithi135 ceph-mon[99205]: from='client.15189 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:56:13.832 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:13 smithi082 ceph-mon[97694]: pgmap v343: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-09-23T08:56:13.832 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:13 smithi082 ceph-mon[97694]: from='client.15189 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:56:13.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:13 smithi161 ceph-mon[99580]: pgmap v343: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-09-23T08:56:13.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:13 smithi161 ceph-mon[99580]: from='client.15189 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:56:15.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:15.047+0000 7fe6b9519700 1 -- 172.21.15.82:0/1520387553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6b4101bb0 msgr2=0x7fe6b4102010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:15.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:15.047+0000 7fe6b9519700 1 --2- 172.21.15.82:0/1520387553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6b4101bb0 0x7fe6b4102010 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fe6a80099c0 tx=0x7fe6a8009cd0 comp rx=0 tx=0).stop 2023-09-23T08:56:15.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:15.047+0000 7fe6b9519700 1 -- 172.21.15.82:0/1520387553 shutdown_connections 2023-09-23T08:56:15.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:15.047+0000 7fe6b9519700 1 --2- 172.21.15.82:0/1520387553 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6b4102550 0x7fe6b4108e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:15.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:15.047+0000 7fe6b9519700 1 --2- 172.21.15.82:0/1520387553 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6b41009b0 0x7fe6b4100dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:15.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:15.047+0000 7fe6b9519700 1 --2- 172.21.15.82:0/1520387553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6b4101bb0 0x7fe6b4102010 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:15.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:15.047+0000 7fe6b9519700 1 -- 172.21.15.82:0/1520387553 >> 172.21.15.82:0/1520387553 conn(0x7fe6b40fbf10 msgr2=0x7fe6b40fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:15.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:15.048+0000 7fe6b9519700 1 -- 172.21.15.82:0/1520387553 shutdown_connections 2023-09-23T08:56:15.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:15.048+0000 7fe6b9519700 1 -- 172.21.15.82:0/1520387553 wait complete. 2023-09-23T08:56:15.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:15.049+0000 7fe6b9519700 1 Processor -- start 2023-09-23T08:56:15.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:15.049+0000 7fe6b9519700 1 -- start start 2023-09-23T08:56:15.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:15.049+0000 7fe6b9519700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6b41009b0 0x7fe6b4196550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:15.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:15.049+0000 7fe6b9519700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6b4101bb0 0x7fe6b4196a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:15.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:15.049+0000 7fe6b9519700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6b4102550 0x7fe6b419db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:15.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:15.049+0000 7fe6b9519700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b419e0e0 con 0x7fe6b4102550 2023-09-23T08:56:15.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:15.049+0000 7fe6b9519700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b419e220 con 0x7fe6b4101bb0 2023-09-23T08:56:15.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:15.049+0000 7fe6b9519700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b419e3b0 con 0x7fe6b41009b0 2023-09-23T08:56:15.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:15.049+0000 7fe6b37fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6b4102550 0x7fe6b419db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:15.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:15.049+0000 7fe6b2ffd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6b41009b0 0x7fe6b4196550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:15.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:15.049+0000 7fe6b37fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6b4102550 0x7fe6b419db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38932/0 (socket says 172.21.15.82:38932) 2023-09-23T08:56:15.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:15.049+0000 7fe6b2ffd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6b41009b0 0x7fe6b4196550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:49640/0 (socket says 172.21.15.82:49640) 2023-09-23T08:56:15.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:15.049+0000 7fe6b37fe700 1 -- 172.21.15.82:0/734704710 learned_addr learned my addr 172.21.15.82:0/734704710 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:15.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:15.049+0000 7fe6b27fc700 1 --2- 172.21.15.82:0/734704710 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6b4101bb0 0x7fe6b4196a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:15.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:15.050+0000 7fe6b37fe700 1 -- 172.21.15.82:0/734704710 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6b41009b0 msgr2=0x7fe6b4196550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:15.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:15.050+0000 7fe6b37fe700 1 --2- 172.21.15.82:0/734704710 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6b41009b0 0x7fe6b4196550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:15.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:15.050+0000 7fe6b37fe700 1 -- 172.21.15.82:0/734704710 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6b4101bb0 msgr2=0x7fe6b4196a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:15.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:15.050+0000 7fe6b37fe700 1 --2- 172.21.15.82:0/734704710 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6b4101bb0 0x7fe6b4196a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:15.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:15.050+0000 7fe6b37fe700 1 -- 172.21.15.82:0/734704710 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6a80095f0 con 0x7fe6b4102550 2023-09-23T08:56:15.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:15.050+0000 7fe6b37fe700 1 --2- 172.21.15.82:0/734704710 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6b4102550 0x7fe6b419db10 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac007f10 tx=0x7fe6ac00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:15.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:15.050+0000 7fe69bfff700 1 -- 172.21.15.82:0/734704710 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6ac017070 con 0x7fe6b4102550 2023-09-23T08:56:15.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:15.050+0000 7fe6b9519700 1 -- 172.21.15.82:0/734704710 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6b419e690 con 0x7fe6b4102550 2023-09-23T08:56:15.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:15.050+0000 7fe69bfff700 1 -- 172.21.15.82:0/734704710 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe6ac00f040 con 0x7fe6b4102550 2023-09-23T08:56:15.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:15.050+0000 7fe69bfff700 1 -- 172.21.15.82:0/734704710 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6ac005570 con 0x7fe6b4102550 2023-09-23T08:56:15.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:15.050+0000 7fe6b9519700 1 -- 172.21.15.82:0/734704710 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6b419eb40 con 0x7fe6b4102550 2023-09-23T08:56:15.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:15.051+0000 7fe6b9519700 1 -- 172.21.15.82:0/734704710 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6b4108020 con 0x7fe6b4102550 2023-09-23T08:56:15.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:15.053+0000 7fe69bfff700 1 -- 172.21.15.82:0/734704710 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) v1 ==== 134722+0+0 (secure 0 0 0) 0x7fe6ac00db20 con 0x7fe6b4102550 2023-09-23T08:56:15.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:15.054+0000 7fe69bfff700 1 --2- 172.21.15.82:0/734704710 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fe69c09ffe0 0x7fe69c0a24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:15.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:15.055+0000 7fe69bfff700 1 -- 172.21.15.82:0/734704710 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fe6ac0cabb0 con 0x7fe6b4102550 2023-09-23T08:56:15.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:15.055+0000 7fe6b2ffd700 1 --2- 172.21.15.82:0/734704710 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fe69c09ffe0 0x7fe69c0a24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:15.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:15.055+0000 7fe6b2ffd700 1 --2- 172.21.15.82:0/734704710 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fe69c09ffe0 0x7fe69c0a24a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe6b4101a10 tx=0x7fe6a400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:15.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:15.059+0000 7fe69bfff700 1 -- 172.21.15.82:0/734704710 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7fe6ac094790 con 0x7fe6b4102550 2023-09-23T08:56:15.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:15.265+0000 7fe6b9519700 1 -- 172.21.15.82:0/734704710 --> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fe6b402ce10 con 0x7fe69c09ffe0 2023-09-23T08:56:15.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:15.267+0000 7fe69bfff700 1 -- 172.21.15.82:0/734704710 <== mgr.14152 v2:172.21.15.82:6800/3698954311 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+492 (secure 0 0 0) 0x7fe6b402ce10 con 0x7fe69c09ffe0 2023-09-23T08:56:15.269 INFO:teuthology.orchestra.run.smithi082.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2023-09-23T08:56:15.270 INFO:teuthology.orchestra.run.smithi082.stdout:smithi082 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400SD400BGN 372G No 3m ago LVM detected, locked 2023-09-23T08:56:15.270 INFO:teuthology.orchestra.run.smithi082.stdout:smithi135 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620401BA400BGN 372G No 2m ago LVM detected, locked 2023-09-23T08:56:15.270 INFO:teuthology.orchestra.run.smithi082.stdout:smithi161 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6233001X400BGN 372G No 2m ago LVM detected, locked 2023-09-23T08:56:15.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:15.269+0000 7fe6b9519700 1 -- 172.21.15.82:0/734704710 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fe69c09ffe0 msgr2=0x7fe69c0a24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:15.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:15.269+0000 7fe6b9519700 1 --2- 172.21.15.82:0/734704710 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fe69c09ffe0 0x7fe69c0a24a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe6b4101a10 tx=0x7fe6a400b410 comp rx=0 tx=0).stop 2023-09-23T08:56:15.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:15.269+0000 7fe6b9519700 1 -- 172.21.15.82:0/734704710 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6b4102550 msgr2=0x7fe6b419db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:15.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:15.269+0000 7fe6b9519700 1 --2- 172.21.15.82:0/734704710 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6b4102550 0x7fe6b419db10 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac007f10 tx=0x7fe6ac00d3b0 comp rx=0 tx=0).stop 2023-09-23T08:56:15.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:15.269+0000 7fe6b9519700 1 -- 172.21.15.82:0/734704710 shutdown_connections 2023-09-23T08:56:15.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:15.269+0000 7fe6b9519700 1 --2- 172.21.15.82:0/734704710 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fe69c09ffe0 0x7fe69c0a24a0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:15.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:15.269+0000 7fe6b9519700 1 --2- 172.21.15.82:0/734704710 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6b4102550 0x7fe6b419db10 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:15.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:15.270+0000 7fe6b9519700 1 --2- 172.21.15.82:0/734704710 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6b41009b0 0x7fe6b4196550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:15.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:15.270+0000 7fe6b9519700 1 --2- 172.21.15.82:0/734704710 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6b4101bb0 0x7fe6b4196a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:15.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:15.270+0000 7fe6b9519700 1 -- 172.21.15.82:0/734704710 >> 172.21.15.82:0/734704710 conn(0x7fe6b40fbf10 msgr2=0x7fe6b4105160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:15.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:15.270+0000 7fe6b9519700 1 -- 172.21.15.82:0/734704710 shutdown_connections 2023-09-23T08:56:15.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:15.270+0000 7fe6b9519700 1 -- 172.21.15.82:0/734704710 wait complete. 2023-09-23T08:56:15.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:15 smithi082 ceph-mon[97694]: pgmap v344: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-09-23T08:56:15.739 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-09-23T08:56:15.750 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi082.front.sepia.ceph.com 2023-09-23T08:56:15.750 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- bash -c 'ceph fs dump' 2023-09-23T08:56:15.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:15 smithi135 ceph-mon[99205]: pgmap v344: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-09-23T08:56:15.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:15 smithi161 ceph-mon[99580]: pgmap v344: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-09-23T08:56:16.489 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.a/config 2023-09-23T08:56:16.765 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:16 smithi082 ceph-mon[97694]: from='client.15195 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:56:16.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:16 smithi135 ceph-mon[99205]: from='client.15195 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:56:16.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:16 smithi161 ceph-mon[99580]: from='client.15195 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:56:17.740 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:17 smithi082 ceph-mon[97694]: pgmap v345: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-09-23T08:56:17.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:17 smithi135 ceph-mon[99205]: pgmap v345: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-09-23T08:56:17.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:17 smithi161 ceph-mon[99580]: pgmap v345: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-09-23T08:56:17.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:17.978+0000 7ff62996d700 1 -- 172.21.15.82:0/1997229217 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff624101bb0 msgr2=0x7ff624102010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:17.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:17.978+0000 7ff62996d700 1 --2- 172.21.15.82:0/1997229217 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff624101bb0 0x7ff624102010 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ff6180099c0 tx=0x7ff618009cd0 comp rx=0 tx=0).stop 2023-09-23T08:56:17.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:17.978+0000 7ff62996d700 1 -- 172.21.15.82:0/1997229217 shutdown_connections 2023-09-23T08:56:17.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:17.978+0000 7ff62996d700 1 --2- 172.21.15.82:0/1997229217 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff624102550 0x7ff624108e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:17.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:17.978+0000 7ff62996d700 1 --2- 172.21.15.82:0/1997229217 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff6241009b0 0x7ff624100dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:17.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:17.978+0000 7ff62996d700 1 --2- 172.21.15.82:0/1997229217 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff624101bb0 0x7ff624102010 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:17.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:17.978+0000 7ff62996d700 1 -- 172.21.15.82:0/1997229217 >> 172.21.15.82:0/1997229217 conn(0x7ff6240fbf10 msgr2=0x7ff6240fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:17.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:17.979+0000 7ff62996d700 1 -- 172.21.15.82:0/1997229217 shutdown_connections 2023-09-23T08:56:17.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:17.979+0000 7ff62996d700 1 -- 172.21.15.82:0/1997229217 wait complete. 2023-09-23T08:56:17.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:17.980+0000 7ff62996d700 1 Processor -- start 2023-09-23T08:56:17.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:17.980+0000 7ff62996d700 1 -- start start 2023-09-23T08:56:17.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:17.980+0000 7ff62996d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6241009b0 0x7ff6241987b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:17.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:17.980+0000 7ff62996d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff624101bb0 0x7ff624198cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:17.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:17.980+0000 7ff62996d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff624102550 0x7ff62419fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:17.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:17.980+0000 7ff62996d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6241a0340 con 0x7ff6241009b0 2023-09-23T08:56:17.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:17.980+0000 7ff62996d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6241a0480 con 0x7ff624101bb0 2023-09-23T08:56:17.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:17.980+0000 7ff62996d700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6241a0610 con 0x7ff624102550 2023-09-23T08:56:17.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:17.980+0000 7ff622ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6241009b0 0x7ff6241987b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:17.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:17.980+0000 7ff622ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6241009b0 0x7ff6241987b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38946/0 (socket says 172.21.15.82:38946) 2023-09-23T08:56:17.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:17.980+0000 7ff622ffd700 1 -- 172.21.15.82:0/1448561701 learned_addr learned my addr 172.21.15.82:0/1448561701 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:17.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:17.980+0000 7ff6237fe700 1 --2- 172.21.15.82:0/1448561701 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff624102550 0x7ff62419fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:17.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:17.981+0000 7ff6227fc700 1 --2- 172.21.15.82:0/1448561701 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff624101bb0 0x7ff624198cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:17.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:17.981+0000 7ff622ffd700 1 -- 172.21.15.82:0/1448561701 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff624102550 msgr2=0x7ff62419fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:17.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:17.981+0000 7ff622ffd700 1 --2- 172.21.15.82:0/1448561701 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff624102550 0x7ff62419fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:17.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:17.981+0000 7ff622ffd700 1 -- 172.21.15.82:0/1448561701 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff624101bb0 msgr2=0x7ff624198cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:17.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:17.981+0000 7ff622ffd700 1 --2- 172.21.15.82:0/1448561701 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff624101bb0 0x7ff624198cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:17.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:17.981+0000 7ff622ffd700 1 -- 172.21.15.82:0/1448561701 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6180095f0 con 0x7ff6241009b0 2023-09-23T08:56:17.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:17.981+0000 7ff622ffd700 1 --2- 172.21.15.82:0/1448561701 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6241009b0 0x7ff6241987b0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7ff61400d9b0 tx=0x7ff61400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:17.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:17.981+0000 7ff62896b700 1 -- 172.21.15.82:0/1448561701 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff614004020 con 0x7ff6241009b0 2023-09-23T08:56:17.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:17.981+0000 7ff62896b700 1 -- 172.21.15.82:0/1448561701 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff614009730 con 0x7ff6241009b0 2023-09-23T08:56:17.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:17.981+0000 7ff62996d700 1 -- 172.21.15.82:0/1448561701 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6241a08f0 con 0x7ff6241009b0 2023-09-23T08:56:17.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:17.981+0000 7ff62896b700 1 -- 172.21.15.82:0/1448561701 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6140038e0 con 0x7ff6241009b0 2023-09-23T08:56:17.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:17.981+0000 7ff62996d700 1 -- 172.21.15.82:0/1448561701 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6241a0e40 con 0x7ff6241009b0 2023-09-23T08:56:17.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:17.983+0000 7ff62996d700 1 -- 172.21.15.82:0/1448561701 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff62410c0b0 con 0x7ff6241009b0 2023-09-23T08:56:17.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:17.984+0000 7ff62896b700 1 -- 172.21.15.82:0/1448561701 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) v1 ==== 134722+0+0 (secure 0 0 0) 0x7ff6140098a0 con 0x7ff6241009b0 2023-09-23T08:56:17.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:17.986+0000 7ff62896b700 1 --2- 172.21.15.82:0/1448561701 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7ff60c0a0060 0x7ff60c0a2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:17.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:17.986+0000 7ff62896b700 1 -- 172.21.15.82:0/1448561701 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7ff6140cafc0 con 0x7ff6241009b0 2023-09-23T08:56:17.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:17.986+0000 7ff6227fc700 1 --2- 172.21.15.82:0/1448561701 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7ff60c0a0060 0x7ff60c0a2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:17.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:17.986+0000 7ff6227fc700 1 --2- 172.21.15.82:0/1448561701 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7ff60c0a0060 0x7ff60c0a2520 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff618006010 tx=0x7ff6180058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:17.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:17.990+0000 7ff62896b700 1 -- 172.21.15.82:0/1448561701 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7ff614094ba0 con 0x7ff6241009b0 2023-09-23T08:56:18.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:18.233+0000 7ff62996d700 1 -- 172.21.15.82:0/1448561701 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff6241a0a80 con 0x7ff6241009b0 2023-09-23T08:56:18.237 INFO:teuthology.orchestra.run.smithi082.stdout:e26 2023-09-23T08:56:18.237 INFO:teuthology.orchestra.run.smithi082.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-09-23T08:56:18.237 INFO:teuthology.orchestra.run.smithi082.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-09-23T08:56:18.237 INFO:teuthology.orchestra.run.smithi082.stdout:legacy client fscid: 1 2023-09-23T08:56:18.237 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:56:18.238 INFO:teuthology.orchestra.run.smithi082.stdout:Filesystem 'cephfs' (1) 2023-09-23T08:56:18.238 INFO:teuthology.orchestra.run.smithi082.stdout:fs_name cephfs 2023-09-23T08:56:18.238 INFO:teuthology.orchestra.run.smithi082.stdout:epoch 26 2023-09-23T08:56:18.238 INFO:teuthology.orchestra.run.smithi082.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2023-09-23T08:56:18.238 INFO:teuthology.orchestra.run.smithi082.stdout:created 2023-09-23T08:54:52.600479+0000 2023-09-23T08:56:18.238 INFO:teuthology.orchestra.run.smithi082.stdout:modified 2023-09-23T08:55:00.481507+0000 2023-09-23T08:56:18.238 INFO:teuthology.orchestra.run.smithi082.stdout:tableserver 0 2023-09-23T08:56:18.238 INFO:teuthology.orchestra.run.smithi082.stdout:root 0 2023-09-23T08:56:18.238 INFO:teuthology.orchestra.run.smithi082.stdout:session_timeout 300 2023-09-23T08:56:18.238 INFO:teuthology.orchestra.run.smithi082.stdout:session_autoclose 300 2023-09-23T08:56:18.238 INFO:teuthology.orchestra.run.smithi082.stdout:max_file_size 1099511627776 2023-09-23T08:56:18.239 INFO:teuthology.orchestra.run.smithi082.stdout:max_xattr_size 65536 2023-09-23T08:56:18.239 INFO:teuthology.orchestra.run.smithi082.stdout:required_client_features {} 2023-09-23T08:56:18.239 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure 0 2023-09-23T08:56:18.239 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure_osd_epoch 0 2023-09-23T08:56:18.239 INFO:teuthology.orchestra.run.smithi082.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-09-23T08:56:18.239 INFO:teuthology.orchestra.run.smithi082.stdout:max_mds 5 2023-09-23T08:56:18.239 INFO:teuthology.orchestra.run.smithi082.stdout:in 0,1,2,3,4 2023-09-23T08:56:18.239 INFO:teuthology.orchestra.run.smithi082.stdout:up {0=24557,1=24550,2=24526,3=24515,4=24514} 2023-09-23T08:56:18.239 INFO:teuthology.orchestra.run.smithi082.stdout:failed 2023-09-23T08:56:18.239 INFO:teuthology.orchestra.run.smithi082.stdout:damaged 2023-09-23T08:56:18.239 INFO:teuthology.orchestra.run.smithi082.stdout:stopped 2023-09-23T08:56:18.239 INFO:teuthology.orchestra.run.smithi082.stdout:data_pools [3] 2023-09-23T08:56:18.240 INFO:teuthology.orchestra.run.smithi082.stdout:metadata_pool 2 2023-09-23T08:56:18.240 INFO:teuthology.orchestra.run.smithi082.stdout:inline_data disabled 2023-09-23T08:56:18.240 INFO:teuthology.orchestra.run.smithi082.stdout:balancer 2023-09-23T08:56:18.240 INFO:teuthology.orchestra.run.smithi082.stdout:bal_rank_mask -1 2023-09-23T08:56:18.240 INFO:teuthology.orchestra.run.smithi082.stdout:standby_count_wanted 0 2023-09-23T08:56:18.240 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.b{0:24557} state up:active seq 3 addr [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] compat {c=[1],r=[1],i=[fff]}] 2023-09-23T08:56:18.240 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.l{0:24463} state up:standby-replay seq 1 addr [v2:172.21.15.161:6832/471569125,v1:172.21.15.161:6833/471569125] compat {c=[1],r=[1],i=[fff]}] 2023-09-23T08:56:18.240 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.i{1:24550} state up:active seq 6 addr [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] compat {c=[1],r=[1],i=[fff]}] 2023-09-23T08:56:18.240 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.k{1:24461} state up:standby-replay seq 1 addr [v2:172.21.15.135:6832/503886037,v1:172.21.15.135:6833/503886037] compat {c=[1],r=[1],i=[fff]}] 2023-09-23T08:56:18.240 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.c{2:24526} state up:active seq 8 addr [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] compat {c=[1],r=[1],i=[fff]}] 2023-09-23T08:56:18.240 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.a{2:14670} state up:standby-replay seq 1 addr [v2:172.21.15.82:6840/2659297867,v1:172.21.15.82:6841/2659297867] compat {c=[1],r=[1],i=[fff]}] 2023-09-23T08:56:18.240 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.h{3:24515} state up:active seq 8 addr [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] compat {c=[1],r=[1],i=[fff]}] 2023-09-23T08:56:18.241 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.g{3:14658} state up:standby-replay seq 1 addr [v2:172.21.15.82:6838/205725278,v1:172.21.15.82:6839/205725278] compat {c=[1],r=[1],i=[fff]}] 2023-09-23T08:56:18.241 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.f{4:24514} state up:active seq 10 addr [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] compat {c=[1],r=[1],i=[fff]}] 2023-09-23T08:56:18.241 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.e{4:14598} state up:standby-replay seq 1 addr [v2:172.21.15.135:6834/3645331700,v1:172.21.15.135:6835/3645331700] compat {c=[1],r=[1],i=[fff]}] 2023-09-23T08:56:18.241 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:56:18.241 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:56:18.241 INFO:teuthology.orchestra.run.smithi082.stdout:Standby daemons: 2023-09-23T08:56:18.241 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:56:18.241 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.j{-1:14568} state up:standby seq 1 addr [v2:172.21.15.82:6834/1237857359,v1:172.21.15.82:6835/1237857359] compat {c=[1],r=[1],i=[fff]}] 2023-09-23T08:56:18.241 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.d{-1:14586} state up:standby seq 1 addr [v2:172.21.15.82:6836/1335102362,v1:172.21.15.82:6837/1335102362] compat {c=[1],r=[1],i=[fff]}] 2023-09-23T08:56:18.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:18.234+0000 7ff62896b700 1 -- 172.21.15.82:0/1448561701 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) v1 ==== 76+0+2966 (secure 0 0 0) 0x7ff6241a0a80 con 0x7ff6241009b0 2023-09-23T08:56:18.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:18.236+0000 7ff62996d700 1 -- 172.21.15.82:0/1448561701 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7ff60c0a0060 msgr2=0x7ff60c0a2520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:18.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:18.236+0000 7ff62996d700 1 --2- 172.21.15.82:0/1448561701 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7ff60c0a0060 0x7ff60c0a2520 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff618006010 tx=0x7ff6180058e0 comp rx=0 tx=0).stop 2023-09-23T08:56:18.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:18.236+0000 7ff62996d700 1 -- 172.21.15.82:0/1448561701 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6241009b0 msgr2=0x7ff6241987b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:18.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:18.236+0000 7ff62996d700 1 --2- 172.21.15.82:0/1448561701 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6241009b0 0x7ff6241987b0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7ff61400d9b0 tx=0x7ff61400dcc0 comp rx=0 tx=0).stop 2023-09-23T08:56:18.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:18.236+0000 7ff62996d700 1 -- 172.21.15.82:0/1448561701 shutdown_connections 2023-09-23T08:56:18.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:18.236+0000 7ff62996d700 1 --2- 172.21.15.82:0/1448561701 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7ff60c0a0060 0x7ff60c0a2520 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:18.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:18.236+0000 7ff62996d700 1 --2- 172.21.15.82:0/1448561701 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff624102550 0x7ff62419fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:18.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:18.236+0000 7ff62996d700 1 --2- 172.21.15.82:0/1448561701 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6241009b0 0x7ff6241987b0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:18.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:18.236+0000 7ff62996d700 1 --2- 172.21.15.82:0/1448561701 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff624101bb0 0x7ff624198cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:18.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:18.236+0000 7ff62996d700 1 -- 172.21.15.82:0/1448561701 >> 172.21.15.82:0/1448561701 conn(0x7ff6240fbf10 msgr2=0x7ff6240fe1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:18.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:18.237+0000 7ff62996d700 1 -- 172.21.15.82:0/1448561701 shutdown_connections 2023-09-23T08:56:18.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:18.237+0000 7ff62996d700 1 -- 172.21.15.82:0/1448561701 wait complete. 2023-09-23T08:56:18.243 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 26 2023-09-23T08:56:18.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:18 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/1448561701' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-09-23T08:56:18.766 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- bash -c 'ceph osd dump' 2023-09-23T08:56:18.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:18 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/1448561701' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-09-23T08:56:18.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:18 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/1448561701' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-09-23T08:56:19.486 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.a/config 2023-09-23T08:56:19.799 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:19 smithi082 ceph-mon[97694]: pgmap v346: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-09-23T08:56:19.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:19 smithi135 ceph-mon[99205]: pgmap v346: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-09-23T08:56:19.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:19 smithi161 ceph-mon[99580]: pgmap v346: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-09-23T08:56:20.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:20.970+0000 7f6a933fe700 1 -- 172.21.15.82:0/2971301063 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a8c101bb0 msgr2=0x7f6a8c102010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:20.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:20.970+0000 7f6a933fe700 1 --2- 172.21.15.82:0/2971301063 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a8c101bb0 0x7f6a8c102010 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c0099c0 tx=0x7f6a7c009cd0 comp rx=0 tx=0).stop 2023-09-23T08:56:20.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:20.970+0000 7f6a933fe700 1 -- 172.21.15.82:0/2971301063 shutdown_connections 2023-09-23T08:56:20.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:20.970+0000 7f6a933fe700 1 --2- 172.21.15.82:0/2971301063 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a8c102550 0x7f6a8c108e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:20.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:20.970+0000 7f6a933fe700 1 --2- 172.21.15.82:0/2971301063 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a8c1009b0 0x7f6a8c100dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:20.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:20.970+0000 7f6a933fe700 1 --2- 172.21.15.82:0/2971301063 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a8c101bb0 0x7f6a8c102010 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:20.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:20.970+0000 7f6a933fe700 1 -- 172.21.15.82:0/2971301063 >> 172.21.15.82:0/2971301063 conn(0x7f6a8c0fbf10 msgr2=0x7f6a8c0fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:20.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:20.971+0000 7f6a933fe700 1 -- 172.21.15.82:0/2971301063 shutdown_connections 2023-09-23T08:56:20.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:20.971+0000 7f6a933fe700 1 -- 172.21.15.82:0/2971301063 wait complete. 2023-09-23T08:56:20.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:20.972+0000 7f6a933fe700 1 Processor -- start 2023-09-23T08:56:20.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:20.972+0000 7f6a933fe700 1 -- start start 2023-09-23T08:56:20.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:20.973+0000 7f6a933fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a8c1009b0 0x7f6a8c1965c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:20.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:20.973+0000 7f6a933fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a8c101bb0 0x7f6a8c196b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:20.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:20.973+0000 7f6a933fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a8c102550 0x7f6a8c19db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:20.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:20.973+0000 7f6a933fe700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8c19e150 con 0x7f6a8c101bb0 2023-09-23T08:56:20.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:20.973+0000 7f6a933fe700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8c19e290 con 0x7f6a8c102550 2023-09-23T08:56:20.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:20.973+0000 7f6a933fe700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8c19e420 con 0x7f6a8c1009b0 2023-09-23T08:56:20.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:20.973+0000 7f6a90999700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a8c101bb0 0x7f6a8c196b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:20.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:20.973+0000 7f6a90999700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a8c101bb0 0x7f6a8c196b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38960/0 (socket says 172.21.15.82:38960) 2023-09-23T08:56:20.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:20.973+0000 7f6a90999700 1 -- 172.21.15.82:0/1005205349 learned_addr learned my addr 172.21.15.82:0/1005205349 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:20.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:20.973+0000 7f6a9119a700 1 --2- 172.21.15.82:0/1005205349 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a8c1009b0 0x7f6a8c1965c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:20.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:20.973+0000 7f6a9199b700 1 --2- 172.21.15.82:0/1005205349 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a8c102550 0x7f6a8c19db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:20.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:20.973+0000 7f6a90999700 1 -- 172.21.15.82:0/1005205349 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a8c1009b0 msgr2=0x7f6a8c1965c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:20.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:20.973+0000 7f6a90999700 1 --2- 172.21.15.82:0/1005205349 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a8c1009b0 0x7f6a8c1965c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:20.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:20.973+0000 7f6a90999700 1 -- 172.21.15.82:0/1005205349 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a8c102550 msgr2=0x7f6a8c19db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:20.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:20.973+0000 7f6a90999700 1 --2- 172.21.15.82:0/1005205349 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a8c102550 0x7f6a8c19db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:20.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:20.973+0000 7f6a90999700 1 -- 172.21.15.82:0/1005205349 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a7c0095f0 con 0x7f6a8c101bb0 2023-09-23T08:56:20.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:20.974+0000 7f6a90999700 1 --2- 172.21.15.82:0/1005205349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a8c101bb0 0x7f6a8c196b00 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c004800 tx=0x7f6a7c003a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:20.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:20.974+0000 7f6a827fc700 1 -- 172.21.15.82:0/1005205349 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a7c01d070 con 0x7f6a8c101bb0 2023-09-23T08:56:20.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:20.974+0000 7f6a933fe700 1 -- 172.21.15.82:0/1005205349 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a8c19e6a0 con 0x7f6a8c101bb0 2023-09-23T08:56:20.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:20.974+0000 7f6a827fc700 1 -- 172.21.15.82:0/1005205349 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6a7c00bda0 con 0x7f6a8c101bb0 2023-09-23T08:56:20.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:20.974+0000 7f6a827fc700 1 -- 172.21.15.82:0/1005205349 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a7c005280 con 0x7f6a8c101bb0 2023-09-23T08:56:20.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:20.974+0000 7f6a933fe700 1 -- 172.21.15.82:0/1005205349 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a8c19ea50 con 0x7f6a8c101bb0 2023-09-23T08:56:20.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:20.975+0000 7f6a933fe700 1 -- 172.21.15.82:0/1005205349 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a8c10c0b0 con 0x7f6a8c101bb0 2023-09-23T08:56:20.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:20.977+0000 7f6a827fc700 1 -- 172.21.15.82:0/1005205349 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) v1 ==== 134722+0+0 (secure 0 0 0) 0x7f6a7c003eb0 con 0x7f6a8c101bb0 2023-09-23T08:56:20.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:20.978+0000 7f6a827fc700 1 --2- 172.21.15.82:0/1005205349 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f6a7809ffe0 0x7f6a780a24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:20.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:20.978+0000 7f6a827fc700 1 -- 172.21.15.82:0/1005205349 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f6a7c0cc570 con 0x7f6a8c101bb0 2023-09-23T08:56:20.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:20.978+0000 7f6a9119a700 1 --2- 172.21.15.82:0/1005205349 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f6a7809ffe0 0x7f6a780a24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:20.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:20.979+0000 7f6a9119a700 1 --2- 172.21.15.82:0/1005205349 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f6a7809ffe0 0x7f6a780a24a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c101a10 tx=0x7f6a8800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:20.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:20.982+0000 7f6a827fc700 1 -- 172.21.15.82:0/1005205349 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f6a7c0961e0 con 0x7f6a8c101bb0 2023-09-23T08:56:21.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:21.187+0000 7f6a933fe700 1 -- 172.21.15.82:0/1005205349 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump"} v 0) v1 -- 0x7f6a8c107960 con 0x7f6a8c101bb0 2023-09-23T08:56:21.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:21.188+0000 7f6a827fc700 1 -- 172.21.15.82:0/1005205349 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v88) v1 ==== 56+0+5286 (secure 0 0 0) 0x7f6a7c099800 con 0x7f6a8c101bb0 2023-09-23T08:56:21.191 INFO:teuthology.orchestra.run.smithi082.stdout:epoch 88 2023-09-23T08:56:21.191 INFO:teuthology.orchestra.run.smithi082.stdout:fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 2023-09-23T08:56:21.191 INFO:teuthology.orchestra.run.smithi082.stdout:created 2023-09-23T08:46:16.628057+0000 2023-09-23T08:56:21.191 INFO:teuthology.orchestra.run.smithi082.stdout:modified 2023-09-23T08:55:23.423278+0000 2023-09-23T08:56:21.191 INFO:teuthology.orchestra.run.smithi082.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2023-09-23T08:56:21.191 INFO:teuthology.orchestra.run.smithi082.stdout:crush_version 26 2023-09-23T08:56:21.191 INFO:teuthology.orchestra.run.smithi082.stdout:full_ratio 0.95 2023-09-23T08:56:21.191 INFO:teuthology.orchestra.run.smithi082.stdout:backfillfull_ratio 0.9 2023-09-23T08:56:21.192 INFO:teuthology.orchestra.run.smithi082.stdout:nearfull_ratio 0.85 2023-09-23T08:56:21.192 INFO:teuthology.orchestra.run.smithi082.stdout:require_min_compat_client luminous 2023-09-23T08:56:21.192 INFO:teuthology.orchestra.run.smithi082.stdout:min_compat_client luminous 2023-09-23T08:56:21.192 INFO:teuthology.orchestra.run.smithi082.stdout:require_osd_release reef 2023-09-23T08:56:21.192 INFO:teuthology.orchestra.run.smithi082.stdout:stretch_mode_enabled false 2023-09-23T08:56:21.192 INFO:teuthology.orchestra.run.smithi082.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2023-09-23T08:56:21.192 INFO:teuthology.orchestra.run.smithi082.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 85 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 2.25 2023-09-23T08:56:21.192 INFO:teuthology.orchestra.run.smithi082.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 86 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2023-09-23T08:56:21.192 INFO:teuthology.orchestra.run.smithi082.stdout:max_osd 12 2023-09-23T08:56:21.193 INFO:teuthology.orchestra.run.smithi082.stdout:osd.0 up in weight 1 up_from 8 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.82:6802/892441948,v1:172.21.15.82:6803/892441948] [v2:172.21.15.82:6804/892441948,v1:172.21.15.82:6805/892441948] exists,up 7384c1ff-8c71-4feb-8cef-ba45c2a1708a 2023-09-23T08:56:21.193 INFO:teuthology.orchestra.run.smithi082.stdout:osd.1 up in weight 1 up_from 13 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.135:6800/3224546922,v1:172.21.15.135:6801/3224546922] [v2:172.21.15.135:6802/3224546922,v1:172.21.15.135:6803/3224546922] exists,up ca62333e-15db-4556-a9ed-8820f9268766 2023-09-23T08:56:21.193 INFO:teuthology.orchestra.run.smithi082.stdout:osd.2 up in weight 1 up_from 18 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.161:6800/2358373459,v1:172.21.15.161:6801/2358373459] [v2:172.21.15.161:6802/2358373459,v1:172.21.15.161:6803/2358373459] exists,up ac23eb38-216a-44f0-b316-a509b23745f6 2023-09-23T08:56:21.193 INFO:teuthology.orchestra.run.smithi082.stdout:osd.3 up in weight 1 up_from 26 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.82:6810/1081464528,v1:172.21.15.82:6811/1081464528] [v2:172.21.15.82:6812/1081464528,v1:172.21.15.82:6813/1081464528] exists,up 701c96b0-30fb-46ce-917d-e02d3814dc3c 2023-09-23T08:56:21.193 INFO:teuthology.orchestra.run.smithi082.stdout:osd.4 up in weight 1 up_from 34 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.135:6808/2346495509,v1:172.21.15.135:6809/2346495509] [v2:172.21.15.135:6810/2346495509,v1:172.21.15.135:6811/2346495509] exists,up c618d2a2-3616-41b2-943c-7a4616538e13 2023-09-23T08:56:21.193 INFO:teuthology.orchestra.run.smithi082.stdout:osd.5 up in weight 1 up_from 39 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.161:6808/1252638628,v1:172.21.15.161:6809/1252638628] [v2:172.21.15.161:6810/1252638628,v1:172.21.15.161:6811/1252638628] exists,up 8e1dda3d-6927-495d-b20d-78b03bb75d5e 2023-09-23T08:56:21.193 INFO:teuthology.orchestra.run.smithi082.stdout:osd.6 up in weight 1 up_from 47 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.82:6818/1052038408,v1:172.21.15.82:6819/1052038408] [v2:172.21.15.82:6820/1052038408,v1:172.21.15.82:6821/1052038408] exists,up 50b31960-6bc4-44e1-8116-3106bf161e56 2023-09-23T08:56:21.193 INFO:teuthology.orchestra.run.smithi082.stdout:osd.7 up in weight 1 up_from 52 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.135:6816/3683951498,v1:172.21.15.135:6817/3683951498] [v2:172.21.15.135:6818/3683951498,v1:172.21.15.135:6819/3683951498] exists,up 425ca0ee-57f7-4b27-90fb-d86bb5db5480 2023-09-23T08:56:21.193 INFO:teuthology.orchestra.run.smithi082.stdout:osd.8 up in weight 1 up_from 60 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.161:6816/948521536,v1:172.21.15.161:6817/948521536] [v2:172.21.15.161:6818/948521536,v1:172.21.15.161:6819/948521536] exists,up 1115c837-bef6-4bad-9974-4d913198511b 2023-09-23T08:56:21.194 INFO:teuthology.orchestra.run.smithi082.stdout:osd.9 up in weight 1 up_from 68 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.82:6826/1438762840,v1:172.21.15.82:6827/1438762840] [v2:172.21.15.82:6828/1438762840,v1:172.21.15.82:6829/1438762840] exists,up c52ec819-4bc6-402f-9cd8-62539e519e6d 2023-09-23T08:56:21.194 INFO:teuthology.orchestra.run.smithi082.stdout:osd.10 up in weight 1 up_from 73 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.135:6824/2853697851,v1:172.21.15.135:6825/2853697851] [v2:172.21.15.135:6826/2853697851,v1:172.21.15.135:6827/2853697851] exists,up 1b16c795-1b91-4d46-ae5d-21b8332c1077 2023-09-23T08:56:21.194 INFO:teuthology.orchestra.run.smithi082.stdout:osd.11 up in weight 1 up_from 81 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.161:6824/1459332081,v1:172.21.15.161:6825/1459332081] [v2:172.21.15.161:6826/1459332081,v1:172.21.15.161:6827/1459332081] exists,up 2551e602-4fe1-41cb-9b7d-c8b31fdd1487 2023-09-23T08:56:21.194 INFO:teuthology.orchestra.run.smithi082.stdout:pg_upmap_items 2.0 [7,11] 2023-09-23T08:56:21.194 INFO:teuthology.orchestra.run.smithi082.stdout:pg_upmap_items 2.8 [2,11] 2023-09-23T08:56:21.194 INFO:teuthology.orchestra.run.smithi082.stdout:pg_upmap_items 2.e [2,4] 2023-09-23T08:56:21.194 INFO:teuthology.orchestra.run.smithi082.stdout:pg_upmap_items 2.1f [8,1] 2023-09-23T08:56:21.194 INFO:teuthology.orchestra.run.smithi082.stdout:pg_upmap_items 3.1 [4,9] 2023-09-23T08:56:21.194 INFO:teuthology.orchestra.run.smithi082.stdout:pg_upmap_items 3.20 [5,9] 2023-09-23T08:56:21.194 INFO:teuthology.orchestra.run.smithi082.stdout:pg_upmap_items 3.31 [4,8] 2023-09-23T08:56:21.195 INFO:teuthology.orchestra.run.smithi082.stdout:pg_upmap_items 3.36 [4,9] 2023-09-23T08:56:21.195 INFO:teuthology.orchestra.run.smithi082.stdout:blocklist 172.21.15.82:0/4204712132 expires 2023-09-24T08:47:21.957866+0000 2023-09-23T08:56:21.195 INFO:teuthology.orchestra.run.smithi082.stdout:blocklist 172.21.15.82:6801/2733521564 expires 2023-09-24T08:47:21.957866+0000 2023-09-23T08:56:21.195 INFO:teuthology.orchestra.run.smithi082.stdout:blocklist 172.21.15.82:6800/2733521564 expires 2023-09-24T08:47:21.957866+0000 2023-09-23T08:56:21.195 INFO:teuthology.orchestra.run.smithi082.stdout:blocklist 172.21.15.82:0/3964794665 expires 2023-09-24T08:47:21.957866+0000 2023-09-23T08:56:21.195 INFO:teuthology.orchestra.run.smithi082.stdout:blocklist 172.21.15.82:0/3535372205 expires 2023-09-24T08:46:55.187024+0000 2023-09-23T08:56:21.195 INFO:teuthology.orchestra.run.smithi082.stdout:blocklist 172.21.15.82:0/285559684 expires 2023-09-24T08:46:55.187024+0000 2023-09-23T08:56:21.195 INFO:teuthology.orchestra.run.smithi082.stdout:blocklist 172.21.15.82:0/1335891896 expires 2023-09-24T08:46:55.187024+0000 2023-09-23T08:56:21.195 INFO:teuthology.orchestra.run.smithi082.stdout:blocklist 172.21.15.82:6801/3761509623 expires 2023-09-24T08:46:55.187024+0000 2023-09-23T08:56:21.195 INFO:teuthology.orchestra.run.smithi082.stdout:blocklist 172.21.15.82:6800/3761509623 expires 2023-09-24T08:46:55.187024+0000 2023-09-23T08:56:21.195 INFO:teuthology.orchestra.run.smithi082.stdout:blocklist 172.21.15.82:0/3775317005 expires 2023-09-24T08:47:21.957866+0000 2023-09-23T08:56:21.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:21.190+0000 7f6a933fe700 1 -- 172.21.15.82:0/1005205349 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f6a7809ffe0 msgr2=0x7f6a780a24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:21.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:21.190+0000 7f6a933fe700 1 --2- 172.21.15.82:0/1005205349 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f6a7809ffe0 0x7f6a780a24a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c101a10 tx=0x7f6a8800b410 comp rx=0 tx=0).stop 2023-09-23T08:56:21.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:21.190+0000 7f6a933fe700 1 -- 172.21.15.82:0/1005205349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a8c101bb0 msgr2=0x7f6a8c196b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:21.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:21.190+0000 7f6a933fe700 1 --2- 172.21.15.82:0/1005205349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a8c101bb0 0x7f6a8c196b00 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c004800 tx=0x7f6a7c003a50 comp rx=0 tx=0).stop 2023-09-23T08:56:21.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:21.190+0000 7f6a933fe700 1 -- 172.21.15.82:0/1005205349 shutdown_connections 2023-09-23T08:56:21.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:21.190+0000 7f6a933fe700 1 --2- 172.21.15.82:0/1005205349 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f6a7809ffe0 0x7f6a780a24a0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:21.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:21.190+0000 7f6a933fe700 1 --2- 172.21.15.82:0/1005205349 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a8c102550 0x7f6a8c19db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:21.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:21.190+0000 7f6a933fe700 1 --2- 172.21.15.82:0/1005205349 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a8c1009b0 0x7f6a8c1965c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:21.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:21.190+0000 7f6a933fe700 1 --2- 172.21.15.82:0/1005205349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a8c101bb0 0x7f6a8c196b00 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:21.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:21.190+0000 7f6a933fe700 1 -- 172.21.15.82:0/1005205349 >> 172.21.15.82:0/1005205349 conn(0x7f6a8c0fbf10 msgr2=0x7f6a8c0fe210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:21.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:21.191+0000 7f6a933fe700 1 -- 172.21.15.82:0/1005205349 shutdown_connections 2023-09-23T08:56:21.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:21.191+0000 7f6a933fe700 1 -- 172.21.15.82:0/1005205349 wait complete. 2023-09-23T08:56:21.657 INFO:teuthology.run_tasks:Running task fs.ready... 2023-09-23T08:56:21.703 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-23T08:56:21.765 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:21 smithi082 ceph-mon[97694]: pgmap v347: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-09-23T08:56:21.765 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:21 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/1005205349' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-09-23T08:56:21.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:21 smithi135 ceph-mon[99205]: pgmap v347: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-09-23T08:56:21.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:21 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/1005205349' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-09-23T08:56:21.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:21 smithi161 ceph-mon[99580]: pgmap v347: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-09-23T08:56:21.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:21 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/1005205349' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-09-23T08:56:21.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:21.903+0000 7fd1769ff700 1 -- 172.21.15.82:0/3355072464 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd170100930 msgr2=0x7fd170100d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:21.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:21.903+0000 7fd1769ff700 1 --2- 172.21.15.82:0/3355072464 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd170100930 0x7fd170100d50 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fd1600099c0 tx=0x7fd160009cd0 comp rx=0 tx=0).stop 2023-09-23T08:56:21.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:21.903+0000 7fd1769ff700 1 -- 172.21.15.82:0/3355072464 shutdown_connections 2023-09-23T08:56:21.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:21.903+0000 7fd1769ff700 1 --2- 172.21.15.82:0/3355072464 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd1701024c0 0x7fd170108d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:21.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:21.903+0000 7fd1769ff700 1 --2- 172.21.15.82:0/3355072464 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd170100930 0x7fd170100d50 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:21.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:21.903+0000 7fd1769ff700 1 --2- 172.21.15.82:0/3355072464 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd170101b20 0x7fd170101f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:21.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:21.903+0000 7fd1769ff700 1 -- 172.21.15.82:0/3355072464 >> 172.21.15.82:0/3355072464 conn(0x7fd1700fbe60 msgr2=0x7fd1700fe2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:21.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:21.903+0000 7fd1769ff700 1 -- 172.21.15.82:0/3355072464 shutdown_connections 2023-09-23T08:56:21.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:21.903+0000 7fd1769ff700 1 -- 172.21.15.82:0/3355072464 wait complete. 2023-09-23T08:56:21.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:21.904+0000 7fd1769ff700 1 Processor -- start 2023-09-23T08:56:21.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:21.904+0000 7fd1769ff700 1 -- start start 2023-09-23T08:56:21.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:21.905+0000 7fd1769ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd170100930 0x7fd1701964a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:21.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:21.905+0000 7fd1769ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd170101b20 0x7fd1701969e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:21.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:21.905+0000 7fd1769ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd1701024c0 0x7fd17019da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:21.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:21.905+0000 7fd1769ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd17019e020 con 0x7fd170101b20 2023-09-23T08:56:21.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:21.905+0000 7fd1769ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd17019e160 con 0x7fd170100930 2023-09-23T08:56:21.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:21.905+0000 7fd1769ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd17019e2f0 con 0x7fd1701024c0 2023-09-23T08:56:21.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:21.905+0000 7fd167fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd170101b20 0x7fd1701969e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:21.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:21.905+0000 7fd167fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd170101b20 0x7fd1701969e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34908/0 (socket says 172.21.15.82:34908) 2023-09-23T08:56:21.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:21.905+0000 7fd167fff700 1 -- 172.21.15.82:0/3944380876 learned_addr learned my addr 172.21.15.82:0/3944380876 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:21.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:21.905+0000 7fd16ffff700 1 --2- 172.21.15.82:0/3944380876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd170100930 0x7fd1701964a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:21.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:21.905+0000 7fd174f9c700 1 --2- 172.21.15.82:0/3944380876 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd1701024c0 0x7fd17019da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:21.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:21.905+0000 7fd167fff700 1 -- 172.21.15.82:0/3944380876 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd1701024c0 msgr2=0x7fd17019da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:21.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:21.905+0000 7fd167fff700 1 --2- 172.21.15.82:0/3944380876 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd1701024c0 0x7fd17019da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:21.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:21.905+0000 7fd167fff700 1 -- 172.21.15.82:0/3944380876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd170100930 msgr2=0x7fd1701964a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:21.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:21.905+0000 7fd167fff700 1 --2- 172.21.15.82:0/3944380876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd170100930 0x7fd1701964a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:21.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:21.905+0000 7fd167fff700 1 -- 172.21.15.82:0/3944380876 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1600095f0 con 0x7fd170101b20 2023-09-23T08:56:21.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:21.905+0000 7fd16ffff700 1 --2- 172.21.15.82:0/3944380876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd170100930 0x7fd1701964a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T08:56:21.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:21.906+0000 7fd167fff700 1 --2- 172.21.15.82:0/3944380876 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd170101b20 0x7fd1701969e0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fd15800c9b0 tx=0x7fd15800ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:21.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:21.906+0000 7fd16dffb700 1 -- 172.21.15.82:0/3944380876 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd158007b00 con 0x7fd170101b20 2023-09-23T08:56:21.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:21.906+0000 7fd16dffb700 1 -- 172.21.15.82:0/3944380876 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd158007c60 con 0x7fd170101b20 2023-09-23T08:56:21.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:21.906+0000 7fd16dffb700 1 -- 172.21.15.82:0/3944380876 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd158018660 con 0x7fd170101b20 2023-09-23T08:56:21.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:21.906+0000 7fd1769ff700 1 -- 172.21.15.82:0/3944380876 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd17019e5d0 con 0x7fd170101b20 2023-09-23T08:56:21.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:21.906+0000 7fd1769ff700 1 -- 172.21.15.82:0/3944380876 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd17019eae0 con 0x7fd170101b20 2023-09-23T08:56:21.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:21.907+0000 7fd1769ff700 1 -- 172.21.15.82:0/3944380876 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd170107860 con 0x7fd170101b20 2023-09-23T08:56:21.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:21.909+0000 7fd16dffb700 1 -- 172.21.15.82:0/3944380876 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) v1 ==== 134722+0+0 (secure 0 0 0) 0x7fd15800f450 con 0x7fd170101b20 2023-09-23T08:56:21.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:21.910+0000 7fd16dffb700 1 --2- 172.21.15.82:0/3944380876 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fd15c0a00a0 0x7fd15c0a2560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:21.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:21.910+0000 7fd16dffb700 1 -- 172.21.15.82:0/3944380876 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fd1580cb380 con 0x7fd170101b20 2023-09-23T08:56:21.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:21.910+0000 7fd16ffff700 1 --2- 172.21.15.82:0/3944380876 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fd15c0a00a0 0x7fd15c0a2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:21.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:21.911+0000 7fd16ffff700 1 --2- 172.21.15.82:0/3944380876 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fd15c0a00a0 0x7fd15c0a2560 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd160000c00 tx=0x7fd160005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:21.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:21.914+0000 7fd16dffb700 1 -- 172.21.15.82:0/3944380876 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7fd158094f60 con 0x7fd170101b20 2023-09-23T08:56:22.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.144+0000 7fd1769ff700 1 -- 172.21.15.82:0/3944380876 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd17010c040 con 0x7fd170101b20 2023-09-23T08:56:22.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.146+0000 7fd16dffb700 1 -- 172.21.15.82:0/3944380876 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+22508 (secure 0 0 0) 0x7fd15800fe60 con 0x7fd170101b20 2023-09-23T08:56:22.149 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:56:22.149 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":88,"fsid":"8926e286-59ed-11ee-8db4-212e2dc638e7","created":"2023-09-23T08:46:16.628057+0000","modified":"2023-09-23T08:55:23.423278+0000","last_up_change":"2023-09-23T08:53:56.524694+0000","last_in_change":"2023-09-23T08:53:35.779183+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-23T08:50:00.571063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-23T08:54:50.558630+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-23T08:54:52.055291+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7384c1ff-8c71-4feb-8cef-ba45c2a1708a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":892441948},{"type":"v1","addr":"172.21.15.82:6803","nonce":892441948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":892441948},{"type":"v1","addr":"172.21.15.82:6805","nonce":892441948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":892441948},{"type":"v1","addr":"172.21.15.82:6809","nonce":892441948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":892441948},{"type":"v1","addr":"172.21.15.82:6807","nonce":892441948}]},"public_addr":"172.21.15.82:6803/892441948","cluster_addr":"172.21.15.82:6805/892441948","heartbeat_back_addr":"172.21.15.82:6809/892441948","heartbeat_front_addr":"172.21.15.82:6807/892441948","state":["exists","up"]},{"osd":1,"uuid":"ca62333e-15db-4556-a9ed-8820f9268766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3224546922},{"type":"v1","addr":"172.21.15.135:6801","nonce":3224546922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3224546922},{"type":"v1","addr":"172.21.15.135:6803","nonce":3224546922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3224546922},{"type":"v1","addr":"172.21.15.135:6807","nonce":3224546922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3224546922},{"type":"v1","addr":"172.21.15.135:6805","nonce":3224546922}]},"public_addr":"172.21.15.135:6801/3224546922","cluster_addr":"172.21.15.135:6803/3224546922","heartbeat_back_addr":"172.21.15.135:6807/3224546922","heartbeat_front_addr":"172.21.15.135:6805/3224546922","state":["exists","up"]},{"osd":2,"uuid":"ac23eb38-216a-44f0-b316-a509b23745f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2358373459},{"type":"v1","addr":"172.21.15.161:6801","nonce":2358373459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2358373459},{"type":"v1","addr":"172.21.15.161:6803","nonce":2358373459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2358373459},{"type":"v1","addr":"172.21.15.161:6807","nonce":2358373459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2358373459},{"type":"v1","addr":"172.21.15.161:6805","nonce":2358373459}]},"public_addr":"172.21.15.161:6801/2358373459","cluster_addr":"172.21.15.161:6803/2358373459","heartbeat_back_addr":"172.21.15.161:6807/2358373459","heartbeat_front_addr":"172.21.15.161:6805/2358373459","state":["exists","up"]},{"osd":3,"uuid":"701c96b0-30fb-46ce-917d-e02d3814dc3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":1081464528},{"type":"v1","addr":"172.21.15.82:6811","nonce":1081464528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1081464528},{"type":"v1","addr":"172.21.15.82:6813","nonce":1081464528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1081464528},{"type":"v1","addr":"172.21.15.82:6817","nonce":1081464528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":1081464528},{"type":"v1","addr":"172.21.15.82:6815","nonce":1081464528}]},"public_addr":"172.21.15.82:6811/1081464528","cluster_addr":"172.21.15.82:6813/1081464528","heartbeat_back_addr":"172.21.15.82:6817/1081464528","heartbeat_front_addr":"172.21.15.82:6815/1081464528","state":["exists","up"]},{"osd":4,"uuid":"c618d2a2-3616-41b2-943c-7a4616538e13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2346495509},{"type":"v1","addr":"172.21.15.135:6809","nonce":2346495509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2346495509},{"type":"v1","addr":"172.21.15.135:6811","nonce":2346495509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2346495509},{"type":"v1","addr":"172.21.15.135:6815","nonce":2346495509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2346495509},{"type":"v1","addr":"172.21.15.135:6813","nonce":2346495509}]},"public_addr":"172.21.15.135:6809/2346495509","cluster_addr":"172.21.15.135:6811/2346495509","heartbeat_back_addr":"172.21.15.135:6815/2346495509","heartbeat_front_addr":"172.21.15.135:6813/2346495509","state":["exists","up"]},{"osd":5,"uuid":"8e1dda3d-6927-495d-b20d-78b03bb75d5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1252638628},{"type":"v1","addr":"172.21.15.161:6809","nonce":1252638628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1252638628},{"type":"v1","addr":"172.21.15.161:6811","nonce":1252638628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1252638628},{"type":"v1","addr":"172.21.15.161:6815","nonce":1252638628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1252638628},{"type":"v1","addr":"172.21.15.161:6813","nonce":1252638628}]},"public_addr":"172.21.15.161:6809/1252638628","cluster_addr":"172.21.15.161:6811/1252638628","heartbeat_back_addr":"172.21.15.161:6815/1252638628","heartbeat_front_addr":"172.21.15.161:6813/1252638628","state":["exists","up"]},{"osd":6,"uuid":"50b31960-6bc4-44e1-8116-3106bf161e56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1052038408},{"type":"v1","addr":"172.21.15.82:6819","nonce":1052038408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1052038408},{"type":"v1","addr":"172.21.15.82:6821","nonce":1052038408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":1052038408},{"type":"v1","addr":"172.21.15.82:6825","nonce":1052038408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1052038408},{"type":"v1","addr":"172.21.15.82:6823","nonce":1052038408}]},"public_addr":"172.21.15.82:6819/1052038408","cluster_addr":"172.21.15.82:6821/1052038408","heartbeat_back_addr":"172.21.15.82:6825/1052038408","heartbeat_front_addr":"172.21.15.82:6823/1052038408","state":["exists","up"]},{"osd":7,"uuid":"425ca0ee-57f7-4b27-90fb-d86bb5db5480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3683951498},{"type":"v1","addr":"172.21.15.135:6817","nonce":3683951498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":3683951498},{"type":"v1","addr":"172.21.15.135:6819","nonce":3683951498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":3683951498},{"type":"v1","addr":"172.21.15.135:6823","nonce":3683951498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":3683951498},{"type":"v1","addr":"172.21.15.135:6821","nonce":3683951498}]},"public_addr":"172.21.15.135:6817/3683951498","cluster_addr":"172.21.15.135:6819/3683951498","heartbeat_back_addr":"172.21.15.135:6823/3683951498","heartbeat_front_addr":"172.21.15.135:6821/3683951498","state":["exists","up"]},{"osd":8,"uuid":"1115c837-bef6-4bad-9974-4d913198511b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":948521536},{"type":"v1","addr":"172.21.15.161:6817","nonce":948521536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":948521536},{"type":"v1","addr":"172.21.15.161:6819","nonce":948521536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":948521536},{"type":"v1","addr":"172.21.15.161:6823","nonce":948521536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":948521536},{"type":"v1","addr":"172.21.15.161:6821","nonce":948521536}]},"public_addr":"172.21.15.161:6817/948521536","cluster_addr":"172.21.15.161:6819/948521536","heartbeat_back_addr":"172.21.15.161:6823/948521536","heartbeat_front_addr":"172.21.15.161:6821/948521536","state":["exists","up"]},{"osd":9,"uuid":"c52ec819-4bc6-402f-9cd8-62539e519e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":1438762840},{"type":"v1","addr":"172.21.15.82:6827","nonce":1438762840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":1438762840},{"type":"v1","addr":"172.21.15.82:6829","nonce":1438762840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1438762840},{"type":"v1","addr":"172.21.15.82:6833","nonce":1438762840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1438762840},{"type":"v1","addr":"172.21.15.82:6831","nonce":1438762840}]},"public_addr":"172.21.15.82:6827/1438762840","cluster_addr":"172.21.15.82:6829/1438762840","heartbeat_back_addr":"172.21.15.82:6833/1438762840","heartbeat_front_addr":"172.21.15.82:6831/1438762840","state":["exists","up"]},{"osd":10,"uuid":"1b16c795-1b91-4d46-ae5d-21b8332c1077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2853697851},{"type":"v1","addr":"172.21.15.135:6825","nonce":2853697851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2853697851},{"type":"v1","addr":"172.21.15.135:6827","nonce":2853697851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2853697851},{"type":"v1","addr":"172.21.15.135:6831","nonce":2853697851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2853697851},{"type":"v1","addr":"172.21.15.135:6829","nonce":2853697851}]},"public_addr":"172.21.15.135:6825/2853697851","cluster_addr":"172.21.15.135:6827/2853697851","heartbeat_back_addr":"172.21.15.135:6831/2853697851","heartbeat_front_addr":"172.21.15.135:6829/2853697851","state":["exists","up"]},{"osd":11,"uuid":"2551e602-4fe1-41cb-9b7d-c8b31fdd1487","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":1459332081},{"type":"v1","addr":"172.21.15.161:6825","nonce":1459332081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":1459332081},{"type":"v1","addr":"172.21.15.161:6827","nonce":1459332081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":1459332081},{"type":"v1","addr":"172.21.15.161:6831","nonce":1459332081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":1459332081},{"type":"v1","addr":"172.21.15.161:6829","nonce":1459332081}]},"public_addr":"172.21.15.161:6825/1459332081","cluster_addr":"172.21.15.161:6827/1459332081","heartbeat_back_addr":"172.21.15.161:6831/1459332081","heartbeat_front_addr":"172.21.15.161:6829/1459332081","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:49:04.007679+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:49:30.702365+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:49:56.785248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:50:22.988516+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:50:49.347055+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:51:15.830145+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:51:41.986377+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:52:08.218893+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:52:34.847450+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:53:01.317134+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:53:27.981691+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:53:54.849245+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/4204712132":"2023-09-24T08:47:21.957866+0000","172.21.15.82:6801/2733521564":"2023-09-24T08:47:21.957866+0000","172.21.15.82:6800/2733521564":"2023-09-24T08:47:21.957866+0000","172.21.15.82:0/3964794665":"2023-09-24T08:47:21.957866+0000","172.21.15.82:0/3535372205":"2023-09-24T08:46:55.187024+0000","172.21.15.82:0/285559684":"2023-09-24T08:46:55.187024+0000","172.21.15.82:0/1335891896":"2023-09-24T08:46:55.187024+0000","172.21.15.82:6801/3761509623":"2023-09-24T08:46:55.187024+0000","172.21.15.82:6800/3761509623":"2023-09-24T08:46:55.187024+0000","172.21.15.82:0/3775317005":"2023-09-24T08:47:21.957866+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-23T08:56:22.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.148+0000 7fd1769ff700 1 -- 172.21.15.82:0/3944380876 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fd15c0a00a0 msgr2=0x7fd15c0a2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:22.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.148+0000 7fd1769ff700 1 --2- 172.21.15.82:0/3944380876 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fd15c0a00a0 0x7fd15c0a2560 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd160000c00 tx=0x7fd160005fb0 comp rx=0 tx=0).stop 2023-09-23T08:56:22.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.148+0000 7fd1769ff700 1 -- 172.21.15.82:0/3944380876 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd170101b20 msgr2=0x7fd1701969e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:22.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.148+0000 7fd1769ff700 1 --2- 172.21.15.82:0/3944380876 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd170101b20 0x7fd1701969e0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fd15800c9b0 tx=0x7fd15800ccc0 comp rx=0 tx=0).stop 2023-09-23T08:56:22.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.148+0000 7fd1769ff700 1 -- 172.21.15.82:0/3944380876 shutdown_connections 2023-09-23T08:56:22.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.148+0000 7fd1769ff700 1 --2- 172.21.15.82:0/3944380876 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fd15c0a00a0 0x7fd15c0a2560 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:22.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.148+0000 7fd1769ff700 1 --2- 172.21.15.82:0/3944380876 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd1701024c0 0x7fd17019da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:22.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.148+0000 7fd1769ff700 1 --2- 172.21.15.82:0/3944380876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd170100930 0x7fd1701964a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:22.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.148+0000 7fd1769ff700 1 --2- 172.21.15.82:0/3944380876 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd170101b20 0x7fd1701969e0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:22.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.148+0000 7fd1769ff700 1 -- 172.21.15.82:0/3944380876 >> 172.21.15.82:0/3944380876 conn(0x7fd1700fbe60 msgr2=0x7fd1700fe0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:22.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.149+0000 7fd1769ff700 1 -- 172.21.15.82:0/3944380876 shutdown_connections 2023-09-23T08:56:22.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.149+0000 7fd1769ff700 1 -- 172.21.15.82:0/3944380876 wait complete. 2023-09-23T08:56:22.171 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-23T08:50:00.571063+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-23T08:54:50.558630+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-23T08:54:52.055291+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-23T08:56:22.172 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-23T08:56:22.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.371+0000 7f9675fff700 1 -- 172.21.15.82:0/2014446529 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9670101b00 msgr2=0x7f9670101f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:22.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.371+0000 7f9675fff700 1 --2- 172.21.15.82:0/2014446529 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9670101b00 0x7f9670101f60 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f96640099c0 tx=0x7f9664009cd0 comp rx=0 tx=0).stop 2023-09-23T08:56:22.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.371+0000 7f9675fff700 1 -- 172.21.15.82:0/2014446529 shutdown_connections 2023-09-23T08:56:22.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.371+0000 7f9675fff700 1 --2- 172.21.15.82:0/2014446529 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96701024a0 0x7f9670108d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:22.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.371+0000 7f9675fff700 1 --2- 172.21.15.82:0/2014446529 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9670100910 0x7f9670100d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:22.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.371+0000 7f9675fff700 1 --2- 172.21.15.82:0/2014446529 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9670101b00 0x7f9670101f60 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:22.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.371+0000 7f9675fff700 1 -- 172.21.15.82:0/2014446529 >> 172.21.15.82:0/2014446529 conn(0x7f96700fbe60 msgr2=0x7f96700fe2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:22.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.371+0000 7f9675fff700 1 -- 172.21.15.82:0/2014446529 shutdown_connections 2023-09-23T08:56:22.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.371+0000 7f9675fff700 1 -- 172.21.15.82:0/2014446529 wait complete. 2023-09-23T08:56:22.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.372+0000 7f9675fff700 1 Processor -- start 2023-09-23T08:56:22.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.372+0000 7f9675fff700 1 -- start start 2023-09-23T08:56:22.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.373+0000 7f9675fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9670100910 0x7f9670196580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:22.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.373+0000 7f9675fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9670101b00 0x7f9670196ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:22.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.373+0000 7f9675fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f96701024a0 0x7f967019db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:22.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.373+0000 7f9675fff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f967019e100 con 0x7f9670100910 2023-09-23T08:56:22.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.373+0000 7f9675fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f967019e240 con 0x7f96701024a0 2023-09-23T08:56:22.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.373+0000 7f9675fff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f967019e3d0 con 0x7f9670101b00 2023-09-23T08:56:22.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.373+0000 7f966f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9670100910 0x7f9670196580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:22.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.373+0000 7f966f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9670100910 0x7f9670196580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34928/0 (socket says 172.21.15.82:34928) 2023-09-23T08:56:22.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.373+0000 7f966f7fe700 1 -- 172.21.15.82:0/24130929 learned_addr learned my addr 172.21.15.82:0/24130929 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:22.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.373+0000 7f966effd700 1 --2- 172.21.15.82:0/24130929 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9670101b00 0x7f9670196ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:22.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.373+0000 7f966f7fe700 1 -- 172.21.15.82:0/24130929 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9670101b00 msgr2=0x7f9670196ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:22.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.373+0000 7f966f7fe700 1 --2- 172.21.15.82:0/24130929 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9670101b00 0x7f9670196ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:22.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.373+0000 7f966ffff700 1 --2- 172.21.15.82:0/24130929 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f96701024a0 0x7f967019db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:22.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.373+0000 7f966f7fe700 1 -- 172.21.15.82:0/24130929 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f96701024a0 msgr2=0x7f967019db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:22.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.373+0000 7f966f7fe700 1 --2- 172.21.15.82:0/24130929 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f96701024a0 0x7f967019db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:22.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.373+0000 7f966f7fe700 1 -- 172.21.15.82:0/24130929 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96640095f0 con 0x7f9670100910 2023-09-23T08:56:22.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.373+0000 7f966ffff700 1 --2- 172.21.15.82:0/24130929 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f96701024a0 0x7f967019db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T08:56:22.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.374+0000 7f966f7fe700 1 --2- 172.21.15.82:0/24130929 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9670100910 0x7f9670196580 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f966000d980 tx=0x7f966000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:22.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.374+0000 7f966cff9700 1 -- 172.21.15.82:0/24130929 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9660004020 con 0x7f9670100910 2023-09-23T08:56:22.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.374+0000 7f966cff9700 1 -- 172.21.15.82:0/24130929 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9660009730 con 0x7f9670100910 2023-09-23T08:56:22.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.374+0000 7f966cff9700 1 -- 172.21.15.82:0/24130929 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9660003a00 con 0x7f9670100910 2023-09-23T08:56:22.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.374+0000 7f9675fff700 1 -- 172.21.15.82:0/24130929 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f967019e6b0 con 0x7f9670100910 2023-09-23T08:56:22.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.374+0000 7f9675fff700 1 -- 172.21.15.82:0/24130929 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f967019ebc0 con 0x7f9670100910 2023-09-23T08:56:22.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.375+0000 7f9675fff700 1 -- 172.21.15.82:0/24130929 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f967010c020 con 0x7f9670100910 2023-09-23T08:56:22.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.377+0000 7f966cff9700 1 -- 172.21.15.82:0/24130929 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) v1 ==== 134722+0+0 (secure 0 0 0) 0x7f96600098a0 con 0x7f9670100910 2023-09-23T08:56:22.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.378+0000 7f966cff9700 1 --2- 172.21.15.82:0/24130929 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f96580a0060 0x7f96580a2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:22.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.378+0000 7f966cff9700 1 -- 172.21.15.82:0/24130929 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f96600cb030 con 0x7f9670100910 2023-09-23T08:56:22.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.378+0000 7f966effd700 1 --2- 172.21.15.82:0/24130929 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f96580a0060 0x7f96580a2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:22.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.379+0000 7f966effd700 1 --2- 172.21.15.82:0/24130929 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f96580a0060 0x7f96580a2520 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f966400b580 tx=0x7f9664005ea0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:22.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.382+0000 7f966cff9700 1 -- 172.21.15.82:0/24130929 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f9660094c70 con 0x7f9670100910 2023-09-23T08:56:22.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.518+0000 7f966cff9700 1 -- 172.21.15.82:0/24130929 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 18) v1 ==== 134671+0+0 (secure 0 0 0) 0x7f9660095040 con 0x7f9670100910 2023-09-23T08:56:22.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.588+0000 7f9675fff700 1 -- 172.21.15.82:0/24130929 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f96701078e0 con 0x7f9670100910 2023-09-23T08:56:22.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.589+0000 7f966cff9700 1 -- 172.21.15.82:0/24130929 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9660098700 con 0x7f9670100910 2023-09-23T08:56:22.591 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-09-23T08:56:22.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.591+0000 7f9675fff700 1 -- 172.21.15.82:0/24130929 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f96580a0060 msgr2=0x7f96580a2520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:22.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.591+0000 7f9675fff700 1 --2- 172.21.15.82:0/24130929 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f96580a0060 0x7f96580a2520 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f966400b580 tx=0x7f9664005ea0 comp rx=0 tx=0).stop 2023-09-23T08:56:22.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.591+0000 7f9675fff700 1 -- 172.21.15.82:0/24130929 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9670100910 msgr2=0x7f9670196580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:22.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.591+0000 7f9675fff700 1 --2- 172.21.15.82:0/24130929 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9670100910 0x7f9670196580 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f966000d980 tx=0x7f966000dc90 comp rx=0 tx=0).stop 2023-09-23T08:56:22.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.591+0000 7f9675fff700 1 -- 172.21.15.82:0/24130929 shutdown_connections 2023-09-23T08:56:22.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.591+0000 7f9675fff700 1 --2- 172.21.15.82:0/24130929 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f96580a0060 0x7f96580a2520 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:22.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.591+0000 7f9675fff700 1 --2- 172.21.15.82:0/24130929 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f96701024a0 0x7f967019db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:22.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.591+0000 7f9675fff700 1 --2- 172.21.15.82:0/24130929 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9670100910 0x7f9670196580 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:22.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.591+0000 7f9675fff700 1 --2- 172.21.15.82:0/24130929 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9670101b00 0x7f9670196ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:22.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.591+0000 7f9675fff700 1 -- 172.21.15.82:0/24130929 >> 172.21.15.82:0/24130929 conn(0x7f96700fbe60 msgr2=0x7f96700fe1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:22.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.591+0000 7f9675fff700 1 -- 172.21.15.82:0/24130929 shutdown_connections 2023-09-23T08:56:22.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.591+0000 7f9675fff700 1 -- 172.21.15.82:0/24130929 wait complete. 2023-09-23T08:56:22.612 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-23T08:56:22.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:22 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/3944380876' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-23T08:56:22.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.811+0000 7f776a3ff700 1 -- 172.21.15.82:0/1369390128 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77641024c0 msgr2=0x7f7764108d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:22.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.811+0000 7f776a3ff700 1 --2- 172.21.15.82:0/1369390128 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77641024c0 0x7f7764108d70 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f775c00b0d0 tx=0x7f775c00b3e0 comp rx=0 tx=0).stop 2023-09-23T08:56:22.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.811+0000 7f776a3ff700 1 -- 172.21.15.82:0/1369390128 shutdown_connections 2023-09-23T08:56:22.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.811+0000 7f776a3ff700 1 --2- 172.21.15.82:0/1369390128 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77641024c0 0x7f7764108d70 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:22.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.811+0000 7f776a3ff700 1 --2- 172.21.15.82:0/1369390128 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7764100930 0x7f7764100d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:22.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.811+0000 7f776a3ff700 1 --2- 172.21.15.82:0/1369390128 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7764101b20 0x7f7764101f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:22.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.811+0000 7f776a3ff700 1 -- 172.21.15.82:0/1369390128 >> 172.21.15.82:0/1369390128 conn(0x7f77640fbea0 msgr2=0x7f77640fe2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:22.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.811+0000 7f776a3ff700 1 -- 172.21.15.82:0/1369390128 shutdown_connections 2023-09-23T08:56:22.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.811+0000 7f776a3ff700 1 -- 172.21.15.82:0/1369390128 wait complete. 2023-09-23T08:56:22.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.812+0000 7f776a3ff700 1 Processor -- start 2023-09-23T08:56:22.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.812+0000 7f776a3ff700 1 -- start start 2023-09-23T08:56:22.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.812+0000 7f776a3ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7764100930 0x7f77640746d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:22.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.812+0000 7f776a3ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7764101b20 0x7f7764072d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:22.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.812+0000 7f776a3ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77641024c0 0x7f7764073250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:22.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.812+0000 7f776a3ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77640739f0 con 0x7f7764100930 2023-09-23T08:56:22.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.812+0000 7f776a3ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7764073b60 con 0x7f7764101b20 2023-09-23T08:56:22.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.812+0000 7f776a3ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77641a0690 con 0x7f77641024c0 2023-09-23T08:56:22.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.813+0000 7f776899c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77641024c0 0x7f7764073250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:22.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.813+0000 7f776899c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77641024c0 0x7f7764073250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:47970/0 (socket says 172.21.15.82:47970) 2023-09-23T08:56:22.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.813+0000 7f776899c700 1 -- 172.21.15.82:0/3520051401 learned_addr learned my addr 172.21.15.82:0/3520051401 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:22.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.813+0000 7f7763fff700 1 --2- 172.21.15.82:0/3520051401 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7764100930 0x7f77640746d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:22.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.813+0000 7f77637fe700 1 --2- 172.21.15.82:0/3520051401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7764101b20 0x7f7764072d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:22.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.813+0000 7f776899c700 1 -- 172.21.15.82:0/3520051401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7764101b20 msgr2=0x7f7764072d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:22.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.813+0000 7f776899c700 1 --2- 172.21.15.82:0/3520051401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7764101b20 0x7f7764072d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:22.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.813+0000 7f776899c700 1 -- 172.21.15.82:0/3520051401 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7764100930 msgr2=0x7f77640746d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:22.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.813+0000 7f776899c700 1 --2- 172.21.15.82:0/3520051401 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7764100930 0x7f77640746d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:22.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.813+0000 7f776899c700 1 -- 172.21.15.82:0/3520051401 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f775c009d00 con 0x7f77641024c0 2023-09-23T08:56:22.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.814+0000 7f776899c700 1 --2- 172.21.15.82:0/3520051401 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77641024c0 0x7f7764073250 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f775c009fd0 tx=0x7f775c00ccc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:22.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.814+0000 7f77617fa700 1 -- 172.21.15.82:0/3520051401 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f775c00e040 con 0x7f77641024c0 2023-09-23T08:56:22.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.814+0000 7f776a3ff700 1 -- 172.21.15.82:0/3520051401 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77641a0910 con 0x7f77641024c0 2023-09-23T08:56:22.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.814+0000 7f77617fa700 1 -- 172.21.15.82:0/3520051401 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f775c003e10 con 0x7f77641024c0 2023-09-23T08:56:22.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.814+0000 7f77617fa700 1 -- 172.21.15.82:0/3520051401 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f775c0052a0 con 0x7f77641024c0 2023-09-23T08:56:22.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.814+0000 7f776a3ff700 1 -- 172.21.15.82:0/3520051401 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77641a0de0 con 0x7f77641024c0 2023-09-23T08:56:22.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.815+0000 7f776a3ff700 1 -- 172.21.15.82:0/3520051401 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f776410c020 con 0x7f77641024c0 2023-09-23T08:56:22.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.817+0000 7f77617fa700 1 -- 172.21.15.82:0/3520051401 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 18) v1 ==== 134671+0+0 (secure 0 0 0) 0x7f775c005400 con 0x7f77641024c0 2023-09-23T08:56:22.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.819+0000 7f77617fa700 1 --2- 172.21.15.82:0/3520051401 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f774c09ff50 0x7f774c0a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:22.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.819+0000 7f77617fa700 1 -- 172.21.15.82:0/3520051401 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f775c0cd060 con 0x7f77641024c0 2023-09-23T08:56:22.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.819+0000 7f7763fff700 1 --2- 172.21.15.82:0/3520051401 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f774c09ff50 0x7f774c0a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:22.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.819+0000 7f7763fff700 1 --2- 172.21.15.82:0/3520051401 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f774c09ff50 0x7f774c0a2410 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7764101980 tx=0x7f775400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:22.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:22.820+0000 7f77617fa700 1 -- 172.21.15.82:0/3520051401 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f775c096e30 con 0x7f77641024c0 2023-09-23T08:56:22.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:22 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/3944380876' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-23T08:56:22.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:22 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/3944380876' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-23T08:56:23.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.019+0000 7f776a3ff700 1 -- 172.21.15.82:0/3520051401 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7764107870 con 0x7f77641024c0 2023-09-23T08:56:23.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.020+0000 7f77617fa700 1 -- 172.21.15.82:0/3520051401 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7f775c09a450 con 0x7f77641024c0 2023-09-23T08:56:23.022 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2023-09-23T08:56:23.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.022+0000 7f776a3ff700 1 -- 172.21.15.82:0/3520051401 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f774c09ff50 msgr2=0x7f774c0a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:23.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.022+0000 7f776a3ff700 1 --2- 172.21.15.82:0/3520051401 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f774c09ff50 0x7f774c0a2410 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7764101980 tx=0x7f775400b410 comp rx=0 tx=0).stop 2023-09-23T08:56:23.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.022+0000 7f776a3ff700 1 -- 172.21.15.82:0/3520051401 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77641024c0 msgr2=0x7f7764073250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:23.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.022+0000 7f776a3ff700 1 --2- 172.21.15.82:0/3520051401 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77641024c0 0x7f7764073250 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f775c009fd0 tx=0x7f775c00ccc0 comp rx=0 tx=0).stop 2023-09-23T08:56:23.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.023+0000 7f776a3ff700 1 -- 172.21.15.82:0/3520051401 shutdown_connections 2023-09-23T08:56:23.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.023+0000 7f776a3ff700 1 --2- 172.21.15.82:0/3520051401 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f774c09ff50 0x7f774c0a2410 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:23.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.023+0000 7f776a3ff700 1 --2- 172.21.15.82:0/3520051401 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77641024c0 0x7f7764073250 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:23.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.023+0000 7f776a3ff700 1 --2- 172.21.15.82:0/3520051401 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7764100930 0x7f77640746d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:23.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.023+0000 7f776a3ff700 1 --2- 172.21.15.82:0/3520051401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7764101b20 0x7f7764072d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:23.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.023+0000 7f776a3ff700 1 -- 172.21.15.82:0/3520051401 >> 172.21.15.82:0/3520051401 conn(0x7f77640fbea0 msgr2=0x7f77640fe160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:23.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.023+0000 7f776a3ff700 1 -- 172.21.15.82:0/3520051401 shutdown_connections 2023-09-23T08:56:23.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.023+0000 7f776a3ff700 1 -- 172.21.15.82:0/3520051401 wait complete. 2023-09-23T08:56:23.043 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-23T08:56:23.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.240+0000 7f32a43ff700 1 -- 172.21.15.82:0/3663735049 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f329c073380 msgr2=0x7f329c073800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:23.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.240+0000 7f32a43ff700 1 --2- 172.21.15.82:0/3663735049 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f329c073380 0x7f329c073800 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f328c009990 tx=0x7f328c009ca0 comp rx=0 tx=0).stop 2023-09-23T08:56:23.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.240+0000 7f32a43ff700 1 -- 172.21.15.82:0/3663735049 shutdown_connections 2023-09-23T08:56:23.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.240+0000 7f32a43ff700 1 --2- 172.21.15.82:0/3663735049 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f329c1087d0 0x7f329c10ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:23.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.240+0000 7f32a43ff700 1 --2- 172.21.15.82:0/3663735049 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f329c074960 0x7f329c072db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:23.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.240+0000 7f32a43ff700 1 --2- 172.21.15.82:0/3663735049 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f329c073380 0x7f329c073800 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:23.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.240+0000 7f32a43ff700 1 -- 172.21.15.82:0/3663735049 >> 172.21.15.82:0/3663735049 conn(0x7f329c0fbe60 msgr2=0x7f329c0fe2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:23.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.240+0000 7f32a43ff700 1 -- 172.21.15.82:0/3663735049 shutdown_connections 2023-09-23T08:56:23.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.240+0000 7f32a43ff700 1 -- 172.21.15.82:0/3663735049 wait complete. 2023-09-23T08:56:23.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.241+0000 7f32a43ff700 1 Processor -- start 2023-09-23T08:56:23.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.241+0000 7f32a43ff700 1 -- start start 2023-09-23T08:56:23.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.242+0000 7f32a43ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f329c073380 0x7f329c1986d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:23.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.242+0000 7f32a43ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f329c074960 0x7f329c198c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:23.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.242+0000 7f32a43ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f329c1087d0 0x7f329c19fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:23.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.242+0000 7f32a43ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f329c1a0250 con 0x7f329c073380 2023-09-23T08:56:23.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.242+0000 7f32a43ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f329c1a0390 con 0x7f329c074960 2023-09-23T08:56:23.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.242+0000 7f32a43ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f329c1a0520 con 0x7f329c1087d0 2023-09-23T08:56:23.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.242+0000 7f32a219b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f329c073380 0x7f329c1986d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:23.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.242+0000 7f32a219b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f329c073380 0x7f329c1986d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34966/0 (socket says 172.21.15.82:34966) 2023-09-23T08:56:23.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.242+0000 7f32a219b700 1 -- 172.21.15.82:0/1724002053 learned_addr learned my addr 172.21.15.82:0/1724002053 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:23.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.242+0000 7f32a299c700 1 --2- 172.21.15.82:0/1724002053 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f329c1087d0 0x7f329c19fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:23.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.242+0000 7f32a199a700 1 --2- 172.21.15.82:0/1724002053 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f329c074960 0x7f329c198c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:23.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.242+0000 7f32a219b700 1 -- 172.21.15.82:0/1724002053 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f329c1087d0 msgr2=0x7f329c19fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:23.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.242+0000 7f32a219b700 1 --2- 172.21.15.82:0/1724002053 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f329c1087d0 0x7f329c19fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:23.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.242+0000 7f32a219b700 1 -- 172.21.15.82:0/1724002053 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f329c074960 msgr2=0x7f329c198c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:23.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.242+0000 7f32a219b700 1 --2- 172.21.15.82:0/1724002053 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f329c074960 0x7f329c198c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:23.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.242+0000 7f32a219b700 1 -- 172.21.15.82:0/1724002053 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f328c0095f0 con 0x7f329c073380 2023-09-23T08:56:23.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.242+0000 7f32a299c700 1 --2- 172.21.15.82:0/1724002053 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f329c1087d0 0x7f329c19fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T08:56:23.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.242+0000 7f32a219b700 1 --2- 172.21.15.82:0/1724002053 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f329c073380 0x7f329c1986d0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f329800c9b0 tx=0x7f329800cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:23.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.243+0000 7f32937fe700 1 -- 172.21.15.82:0/1724002053 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3298007b00 con 0x7f329c073380 2023-09-23T08:56:23.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.243+0000 7f32937fe700 1 -- 172.21.15.82:0/1724002053 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3298007c60 con 0x7f329c073380 2023-09-23T08:56:23.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.243+0000 7f32a43ff700 1 -- 172.21.15.82:0/1724002053 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f329c1a0800 con 0x7f329c073380 2023-09-23T08:56:23.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.243+0000 7f32937fe700 1 -- 172.21.15.82:0/1724002053 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3298018660 con 0x7f329c073380 2023-09-23T08:56:23.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.243+0000 7f32a43ff700 1 -- 172.21.15.82:0/1724002053 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f329c1a0d60 con 0x7f329c073380 2023-09-23T08:56:23.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.244+0000 7f32a43ff700 1 -- 172.21.15.82:0/1724002053 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f329c106e80 con 0x7f329c073380 2023-09-23T08:56:23.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.245+0000 7f32937fe700 1 -- 172.21.15.82:0/1724002053 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 134671+0+0 (secure 0 0 0) 0x7f329800f450 con 0x7f329c073380 2023-09-23T08:56:23.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.247+0000 7f32937fe700 1 --2- 172.21.15.82:0/1724002053 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f328809ffd0 0x7f32880a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:23.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.247+0000 7f32937fe700 1 -- 172.21.15.82:0/1724002053 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f32980cb250 con 0x7f329c073380 2023-09-23T08:56:23.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.247+0000 7f32a199a700 1 --2- 172.21.15.82:0/1724002053 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f328809ffd0 0x7f32880a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:23.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.248+0000 7f32a199a700 1 --2- 172.21.15.82:0/1724002053 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f328809ffd0 0x7f32880a2490 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f328c00b5c0 tx=0x7f328c005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:23.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.250+0000 7f32937fe700 1 -- 172.21.15.82:0/1724002053 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f3298094ff0 con 0x7f329c073380 2023-09-23T08:56:23.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.449+0000 7f32a43ff700 1 -- 172.21.15.82:0/1724002053 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f329c02cd80 con 0x7f329c073380 2023-09-23T08:56:23.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.450+0000 7f32937fe700 1 -- 172.21.15.82:0/1724002053 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3298098610 con 0x7f329c073380 2023-09-23T08:56:23.453 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2023-09-23T08:56:23.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.452+0000 7f32a43ff700 1 -- 172.21.15.82:0/1724002053 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f328809ffd0 msgr2=0x7f32880a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:23.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.452+0000 7f32a43ff700 1 --2- 172.21.15.82:0/1724002053 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f328809ffd0 0x7f32880a2490 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f328c00b5c0 tx=0x7f328c005fb0 comp rx=0 tx=0).stop 2023-09-23T08:56:23.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.452+0000 7f32a43ff700 1 -- 172.21.15.82:0/1724002053 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f329c073380 msgr2=0x7f329c1986d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:23.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.452+0000 7f32a43ff700 1 --2- 172.21.15.82:0/1724002053 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f329c073380 0x7f329c1986d0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f329800c9b0 tx=0x7f329800cd70 comp rx=0 tx=0).stop 2023-09-23T08:56:23.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.452+0000 7f32a43ff700 1 -- 172.21.15.82:0/1724002053 shutdown_connections 2023-09-23T08:56:23.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.452+0000 7f32a43ff700 1 --2- 172.21.15.82:0/1724002053 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f328809ffd0 0x7f32880a2490 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:23.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.452+0000 7f32a43ff700 1 --2- 172.21.15.82:0/1724002053 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f329c1087d0 0x7f329c19fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:23.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.452+0000 7f32a43ff700 1 --2- 172.21.15.82:0/1724002053 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f329c073380 0x7f329c1986d0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:23.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.452+0000 7f32a43ff700 1 --2- 172.21.15.82:0/1724002053 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f329c074960 0x7f329c198c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:23.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.452+0000 7f32a43ff700 1 -- 172.21.15.82:0/1724002053 >> 172.21.15.82:0/1724002053 conn(0x7f329c0fbe60 msgr2=0x7f329c0fe250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:23.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.452+0000 7f32a43ff700 1 -- 172.21.15.82:0/1724002053 shutdown_connections 2023-09-23T08:56:23.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.452+0000 7f32a43ff700 1 -- 172.21.15.82:0/1724002053 wait complete. 2023-09-23T08:56:23.473 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-23T08:56:23.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.668+0000 7f50121ff700 1 -- 172.21.15.82:0/152665644 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f500c100930 msgr2=0x7f500c100d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:23.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.668+0000 7f50121ff700 1 --2- 172.21.15.82:0/152665644 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f500c100930 0x7f500c100d50 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc0099c0 tx=0x7f4ffc009cd0 comp rx=0 tx=0).stop 2023-09-23T08:56:23.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.668+0000 7f50121ff700 1 -- 172.21.15.82:0/152665644 shutdown_connections 2023-09-23T08:56:23.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.668+0000 7f50121ff700 1 --2- 172.21.15.82:0/152665644 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f500c1024c0 0x7f500c108d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:23.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.668+0000 7f50121ff700 1 --2- 172.21.15.82:0/152665644 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f500c100930 0x7f500c100d50 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:23.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.668+0000 7f50121ff700 1 --2- 172.21.15.82:0/152665644 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f500c101b20 0x7f500c101f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:23.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.668+0000 7f50121ff700 1 -- 172.21.15.82:0/152665644 >> 172.21.15.82:0/152665644 conn(0x7f500c0fbe60 msgr2=0x7f500c0fe2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:23.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.668+0000 7f50121ff700 1 -- 172.21.15.82:0/152665644 shutdown_connections 2023-09-23T08:56:23.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.668+0000 7f50121ff700 1 -- 172.21.15.82:0/152665644 wait complete. 2023-09-23T08:56:23.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.669+0000 7f50121ff700 1 Processor -- start 2023-09-23T08:56:23.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.669+0000 7f50121ff700 1 -- start start 2023-09-23T08:56:23.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.669+0000 7f50121ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f500c100930 0x7f500c1964c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:23.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.669+0000 7f50121ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f500c101b20 0x7f500c196a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:23.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.669+0000 7f50121ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f500c1024c0 0x7f500c19da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:23.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.669+0000 7f50121ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f500c19e040 con 0x7f500c101b20 2023-09-23T08:56:23.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.669+0000 7f50121ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f500c19e180 con 0x7f500c1024c0 2023-09-23T08:56:23.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.669+0000 7f50121ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f500c19e310 con 0x7f500c100930 2023-09-23T08:56:23.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.669+0000 7f500affd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f500c101b20 0x7f500c196a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:23.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.669+0000 7f500affd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f500c101b20 0x7f500c196a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34982/0 (socket says 172.21.15.82:34982) 2023-09-23T08:56:23.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.669+0000 7f500affd700 1 -- 172.21.15.82:0/1265083280 learned_addr learned my addr 172.21.15.82:0/1265083280 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:23.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.670+0000 7f500bfff700 1 --2- 172.21.15.82:0/1265083280 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f500c1024c0 0x7f500c19da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:23.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.670+0000 7f500b7fe700 1 --2- 172.21.15.82:0/1265083280 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f500c100930 0x7f500c1964c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:23.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.670+0000 7f500affd700 1 -- 172.21.15.82:0/1265083280 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f500c100930 msgr2=0x7f500c1964c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:23.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.670+0000 7f500affd700 1 --2- 172.21.15.82:0/1265083280 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f500c100930 0x7f500c1964c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:23.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.670+0000 7f500affd700 1 -- 172.21.15.82:0/1265083280 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f500c1024c0 msgr2=0x7f500c19da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:23.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.670+0000 7f500affd700 1 --2- 172.21.15.82:0/1265083280 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f500c1024c0 0x7f500c19da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:23.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.670+0000 7f500affd700 1 -- 172.21.15.82:0/1265083280 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ffc0095f0 con 0x7f500c101b20 2023-09-23T08:56:23.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.670+0000 7f500affd700 1 --2- 172.21.15.82:0/1265083280 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f500c101b20 0x7f500c196a00 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f500000d950 tx=0x7f500000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:23.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.670+0000 7f5008ff9700 1 -- 172.21.15.82:0/1265083280 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f500000f890 con 0x7f500c101b20 2023-09-23T08:56:23.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.670+0000 7f5008ff9700 1 -- 172.21.15.82:0/1265083280 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f500000fe80 con 0x7f500c101b20 2023-09-23T08:56:23.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.670+0000 7f5008ff9700 1 -- 172.21.15.82:0/1265083280 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f500000e3b0 con 0x7f500c101b20 2023-09-23T08:56:23.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.670+0000 7f50121ff700 1 -- 172.21.15.82:0/1265083280 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f500c19e5f0 con 0x7f500c101b20 2023-09-23T08:56:23.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.670+0000 7f50121ff700 1 -- 172.21.15.82:0/1265083280 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f500c19eab0 con 0x7f500c101b20 2023-09-23T08:56:23.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.672+0000 7f50121ff700 1 -- 172.21.15.82:0/1265083280 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f500c107f20 con 0x7f500c101b20 2023-09-23T08:56:23.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.673+0000 7f5008ff9700 1 -- 172.21.15.82:0/1265083280 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 134671+0+0 (secure 0 0 0) 0x7f5000010460 con 0x7f500c101b20 2023-09-23T08:56:23.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.675+0000 7f5008ff9700 1 --2- 172.21.15.82:0/1265083280 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f4ff409ffa0 0x7f4ff40a2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:23.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.675+0000 7f5008ff9700 1 -- 172.21.15.82:0/1265083280 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f50000cafa0 con 0x7f500c101b20 2023-09-23T08:56:23.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.675+0000 7f500b7fe700 1 --2- 172.21.15.82:0/1265083280 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f4ff409ffa0 0x7f4ff40a2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:23.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.676+0000 7f500b7fe700 1 --2- 172.21.15.82:0/1265083280 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f4ff409ffa0 0x7f4ff40a2460 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc00c010 tx=0x7f4ffc005e80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:23.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.679+0000 7f5008ff9700 1 -- 172.21.15.82:0/1265083280 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f50000fde00 con 0x7f500c101b20 2023-09-23T08:56:23.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:23 smithi135 ceph-mon[99205]: pgmap v348: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-09-23T08:56:23.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:23 smithi135 ceph-mon[99205]: mgrmap e18: x(active, since 9m), standbys: z, y 2023-09-23T08:56:23.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:23 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/24130929' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-23T08:56:23.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:23 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/3520051401' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-09-23T08:56:23.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:23 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/1724002053' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-09-23T08:56:23.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:23 smithi082 ceph-mon[97694]: pgmap v348: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-09-23T08:56:23.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:23 smithi082 ceph-mon[97694]: mgrmap e18: x(active, since 9m), standbys: z, y 2023-09-23T08:56:23.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:23 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/24130929' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-23T08:56:23.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:23 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/3520051401' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-09-23T08:56:23.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:23 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/1724002053' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-09-23T08:56:23.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:23 smithi161 ceph-mon[99580]: pgmap v348: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-09-23T08:56:23.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:23 smithi161 ceph-mon[99580]: mgrmap e18: x(active, since 9m), standbys: z, y 2023-09-23T08:56:23.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:23 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/24130929' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-23T08:56:23.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:23 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/3520051401' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-09-23T08:56:23.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:23 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/1724002053' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-09-23T08:56:23.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.927+0000 7f50121ff700 1 -- 172.21.15.82:0/1265083280 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f500c10bff0 con 0x7f500c101b20 2023-09-23T08:56:23.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.927+0000 7f5008ff9700 1 -- 172.21.15.82:0/1265083280 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+11323 (secure 0 0 0) 0x7f5000016090 con 0x7f500c101b20 2023-09-23T08:56:23.930 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:56:23.930 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/1237857359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1237857359},{"type":"v1","addr":"172.21.15.82:6835","nonce":1237857359}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/1335102362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":1335102362},{"type":"v1","addr":"172.21.15.82:6837","nonce":1335102362}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-23T08:54:52.600479+0000","modified":"2023-09-23T08:55:00.481507+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24557,"mds_1":24550,"mds_2":24526,"mds_3":24515,"mds_4":24514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/3645331700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3645331700},{"type":"v1","addr":"172.21.15.135:6835","nonce":3645331700}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14658":{"gid":14658,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6839/205725278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":205725278},{"type":"v1","addr":"172.21.15.82:6839","nonce":205725278}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14670":{"gid":14670,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6841/2659297867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":2659297867},{"type":"v1","addr":"172.21.15.82:6841","nonce":2659297867}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24461":{"gid":24461,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/503886037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":503886037},{"type":"v1","addr":"172.21.15.135:6833","nonce":503886037}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24463":{"gid":24463,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.161:6833/471569125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":471569125},{"type":"v1","addr":"172.21.15.161:6833","nonce":471569125}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24514":{"gid":24514,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":10,"addr":"172.21.15.161:6835/2237964162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":2237964162},{"type":"v1","addr":"172.21.15.161:6835","nonce":2237964162}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24515":{"gid":24515,"name":"h","rank":3,"incarnation":22,"state":"up:active","state_seq":8,"addr":"172.21.15.135:6837/2655304858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2655304858},{"type":"v1","addr":"172.21.15.135:6837","nonce":2655304858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24526":{"gid":24526,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.161:6837/43639843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":43639843},{"type":"v1","addr":"172.21.15.161:6837","nonce":43639843}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24550":{"gid":24550,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.161:6839/758982817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6838","nonce":758982817},{"type":"v1","addr":"172.21.15.161:6839","nonce":758982817}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24557":{"gid":24557,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6839/2508669274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2508669274},{"type":"v1","addr":"172.21.15.135:6839","nonce":2508669274}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-23T08:56:23.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.930+0000 7f50121ff700 1 -- 172.21.15.82:0/1265083280 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f4ff409ffa0 msgr2=0x7f4ff40a2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:23.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.930+0000 7f50121ff700 1 --2- 172.21.15.82:0/1265083280 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f4ff409ffa0 0x7f4ff40a2460 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc00c010 tx=0x7f4ffc005e80 comp rx=0 tx=0).stop 2023-09-23T08:56:23.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.930+0000 7f50121ff700 1 -- 172.21.15.82:0/1265083280 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f500c101b20 msgr2=0x7f500c196a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:23.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.930+0000 7f50121ff700 1 --2- 172.21.15.82:0/1265083280 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f500c101b20 0x7f500c196a00 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f500000d950 tx=0x7f500000dc60 comp rx=0 tx=0).stop 2023-09-23T08:56:23.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.930+0000 7f50121ff700 1 -- 172.21.15.82:0/1265083280 shutdown_connections 2023-09-23T08:56:23.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.930+0000 7f50121ff700 1 --2- 172.21.15.82:0/1265083280 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f4ff409ffa0 0x7f4ff40a2460 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:23.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.930+0000 7f50121ff700 1 --2- 172.21.15.82:0/1265083280 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f500c1024c0 0x7f500c19da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:23.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.930+0000 7f50121ff700 1 --2- 172.21.15.82:0/1265083280 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f500c100930 0x7f500c1964c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:23.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.930+0000 7f50121ff700 1 --2- 172.21.15.82:0/1265083280 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f500c101b20 0x7f500c196a00 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:23.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.930+0000 7f50121ff700 1 -- 172.21.15.82:0/1265083280 >> 172.21.15.82:0/1265083280 conn(0x7f500c0fbe60 msgr2=0x7f500c105060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:23.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.930+0000 7f50121ff700 1 -- 172.21.15.82:0/1265083280 shutdown_connections 2023-09-23T08:56:23.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:23.930+0000 7f50121ff700 1 -- 172.21.15.82:0/1265083280 wait complete. 2023-09-23T08:56:23.934 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 26 2023-09-23T08:56:23.952 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-23T08:56:24.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.146+0000 7fb9c17ff700 1 -- 172.21.15.82:0/183710966 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9bc101b20 msgr2=0x7fb9bc101f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:24.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.146+0000 7fb9c17ff700 1 --2- 172.21.15.82:0/183710966 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9bc101b20 0x7fb9bc101f80 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fb9b00099c0 tx=0x7fb9b0009cd0 comp rx=0 tx=0).stop 2023-09-23T08:56:24.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.147+0000 7fb9c17ff700 1 -- 172.21.15.82:0/183710966 shutdown_connections 2023-09-23T08:56:24.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.147+0000 7fb9c17ff700 1 --2- 172.21.15.82:0/183710966 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb9bc1024c0 0x7fb9bc108d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:24.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.147+0000 7fb9c17ff700 1 --2- 172.21.15.82:0/183710966 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9bc100930 0x7fb9bc100d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:24.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.147+0000 7fb9c17ff700 1 --2- 172.21.15.82:0/183710966 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9bc101b20 0x7fb9bc101f80 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:24.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.147+0000 7fb9c17ff700 1 -- 172.21.15.82:0/183710966 >> 172.21.15.82:0/183710966 conn(0x7fb9bc0fbe60 msgr2=0x7fb9bc0fe2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:24.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.147+0000 7fb9c17ff700 1 -- 172.21.15.82:0/183710966 shutdown_connections 2023-09-23T08:56:24.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.147+0000 7fb9c17ff700 1 -- 172.21.15.82:0/183710966 wait complete. 2023-09-23T08:56:24.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.148+0000 7fb9c17ff700 1 Processor -- start 2023-09-23T08:56:24.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.148+0000 7fb9c17ff700 1 -- start start 2023-09-23T08:56:24.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.149+0000 7fb9c17ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb9bc100930 0x7fb9bc0746d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:24.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.149+0000 7fb9c17ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9bc101b20 0x7fb9bc072d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:24.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.149+0000 7fb9c17ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9bc1024c0 0x7fb9bc073250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:24.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.149+0000 7fb9c17ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9bc0739f0 con 0x7fb9bc1024c0 2023-09-23T08:56:24.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.149+0000 7fb9c17ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9bc073b60 con 0x7fb9bc101b20 2023-09-23T08:56:24.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.149+0000 7fb9c17ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9bc1a0590 con 0x7fb9bc100930 2023-09-23T08:56:24.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.149+0000 7fb9bb7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9bc1024c0 0x7fb9bc073250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:24.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.149+0000 7fb9bb7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9bc1024c0 0x7fb9bc073250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35006/0 (socket says 172.21.15.82:35006) 2023-09-23T08:56:24.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.149+0000 7fb9bb7fe700 1 -- 172.21.15.82:0/3243706576 learned_addr learned my addr 172.21.15.82:0/3243706576 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:24.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.149+0000 7fb9baffd700 1 --2- 172.21.15.82:0/3243706576 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb9bc100930 0x7fb9bc0746d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:24.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.149+0000 7fb9bb7fe700 1 -- 172.21.15.82:0/3243706576 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb9bc100930 msgr2=0x7fb9bc0746d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:24.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.149+0000 7fb9bb7fe700 1 --2- 172.21.15.82:0/3243706576 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb9bc100930 0x7fb9bc0746d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:24.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.149+0000 7fb9bb7fe700 1 -- 172.21.15.82:0/3243706576 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9bc101b20 msgr2=0x7fb9bc072d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:24.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.149+0000 7fb9bb7fe700 1 --2- 172.21.15.82:0/3243706576 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9bc101b20 0x7fb9bc072d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:24.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.149+0000 7fb9bb7fe700 1 -- 172.21.15.82:0/3243706576 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9b00095f0 con 0x7fb9bc1024c0 2023-09-23T08:56:24.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.149+0000 7fb9baffd700 1 --2- 172.21.15.82:0/3243706576 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb9bc100930 0x7fb9bc0746d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T08:56:24.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.150+0000 7fb9bb7fe700 1 --2- 172.21.15.82:0/3243706576 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9bc1024c0 0x7fb9bc073250 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fb9b4007ee0 tx=0x7fb9b400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:24.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.150+0000 7fb9a3fff700 1 -- 172.21.15.82:0/3243706576 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b4017070 con 0x7fb9bc1024c0 2023-09-23T08:56:24.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.150+0000 7fb9a3fff700 1 -- 172.21.15.82:0/3243706576 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb9b400f040 con 0x7fb9bc1024c0 2023-09-23T08:56:24.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.150+0000 7fb9a3fff700 1 -- 172.21.15.82:0/3243706576 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b4005710 con 0x7fb9bc1024c0 2023-09-23T08:56:24.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.150+0000 7fb9c17ff700 1 -- 172.21.15.82:0/3243706576 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9bc1a0870 con 0x7fb9bc1024c0 2023-09-23T08:56:24.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.150+0000 7fb9c17ff700 1 -- 172.21.15.82:0/3243706576 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9bc1a0d30 con 0x7fb9bc1024c0 2023-09-23T08:56:24.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.151+0000 7fb9c17ff700 1 -- 172.21.15.82:0/3243706576 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9bc10c040 con 0x7fb9bc1024c0 2023-09-23T08:56:24.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.153+0000 7fb9a3fff700 1 -- 172.21.15.82:0/3243706576 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 134671+0+0 (secure 0 0 0) 0x7fb9b4005870 con 0x7fb9bc1024c0 2023-09-23T08:56:24.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.154+0000 7fb9a3fff700 1 --2- 172.21.15.82:0/3243706576 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fb9a409ffa0 0x7fb9a40a2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:24.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.154+0000 7fb9a3fff700 1 -- 172.21.15.82:0/3243706576 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fb9b40cb140 con 0x7fb9bc1024c0 2023-09-23T08:56:24.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.155+0000 7fb9baffd700 1 --2- 172.21.15.82:0/3243706576 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fb9a409ffa0 0x7fb9a40a2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:24.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.155+0000 7fb9baffd700 1 --2- 172.21.15.82:0/3243706576 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fb9a409ffa0 0x7fb9a40a2460 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac005950 tx=0x7fb9ac0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:24.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.156+0000 7fb9a3fff700 1 -- 172.21.15.82:0/3243706576 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7fb9b4094e80 con 0x7fb9bc1024c0 2023-09-23T08:56:24.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.356+0000 7fb9c17ff700 1 -- 172.21.15.82:0/3243706576 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb9bc10c230 con 0x7fb9bc1024c0 2023-09-23T08:56:24.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.358+0000 7fb9a3fff700 1 -- 172.21.15.82:0/3243706576 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+22508 (secure 0 0 0) 0x7fb9b40984a0 con 0x7fb9bc1024c0 2023-09-23T08:56:24.360 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:56:24.361 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":88,"fsid":"8926e286-59ed-11ee-8db4-212e2dc638e7","created":"2023-09-23T08:46:16.628057+0000","modified":"2023-09-23T08:55:23.423278+0000","last_up_change":"2023-09-23T08:53:56.524694+0000","last_in_change":"2023-09-23T08:53:35.779183+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-23T08:50:00.571063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-23T08:54:50.558630+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-23T08:54:52.055291+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7384c1ff-8c71-4feb-8cef-ba45c2a1708a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":892441948},{"type":"v1","addr":"172.21.15.82:6803","nonce":892441948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":892441948},{"type":"v1","addr":"172.21.15.82:6805","nonce":892441948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":892441948},{"type":"v1","addr":"172.21.15.82:6809","nonce":892441948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":892441948},{"type":"v1","addr":"172.21.15.82:6807","nonce":892441948}]},"public_addr":"172.21.15.82:6803/892441948","cluster_addr":"172.21.15.82:6805/892441948","heartbeat_back_addr":"172.21.15.82:6809/892441948","heartbeat_front_addr":"172.21.15.82:6807/892441948","state":["exists","up"]},{"osd":1,"uuid":"ca62333e-15db-4556-a9ed-8820f9268766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3224546922},{"type":"v1","addr":"172.21.15.135:6801","nonce":3224546922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3224546922},{"type":"v1","addr":"172.21.15.135:6803","nonce":3224546922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3224546922},{"type":"v1","addr":"172.21.15.135:6807","nonce":3224546922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3224546922},{"type":"v1","addr":"172.21.15.135:6805","nonce":3224546922}]},"public_addr":"172.21.15.135:6801/3224546922","cluster_addr":"172.21.15.135:6803/3224546922","heartbeat_back_addr":"172.21.15.135:6807/3224546922","heartbeat_front_addr":"172.21.15.135:6805/3224546922","state":["exists","up"]},{"osd":2,"uuid":"ac23eb38-216a-44f0-b316-a509b23745f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2358373459},{"type":"v1","addr":"172.21.15.161:6801","nonce":2358373459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2358373459},{"type":"v1","addr":"172.21.15.161:6803","nonce":2358373459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2358373459},{"type":"v1","addr":"172.21.15.161:6807","nonce":2358373459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2358373459},{"type":"v1","addr":"172.21.15.161:6805","nonce":2358373459}]},"public_addr":"172.21.15.161:6801/2358373459","cluster_addr":"172.21.15.161:6803/2358373459","heartbeat_back_addr":"172.21.15.161:6807/2358373459","heartbeat_front_addr":"172.21.15.161:6805/2358373459","state":["exists","up"]},{"osd":3,"uuid":"701c96b0-30fb-46ce-917d-e02d3814dc3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":1081464528},{"type":"v1","addr":"172.21.15.82:6811","nonce":1081464528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1081464528},{"type":"v1","addr":"172.21.15.82:6813","nonce":1081464528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1081464528},{"type":"v1","addr":"172.21.15.82:6817","nonce":1081464528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":1081464528},{"type":"v1","addr":"172.21.15.82:6815","nonce":1081464528}]},"public_addr":"172.21.15.82:6811/1081464528","cluster_addr":"172.21.15.82:6813/1081464528","heartbeat_back_addr":"172.21.15.82:6817/1081464528","heartbeat_front_addr":"172.21.15.82:6815/1081464528","state":["exists","up"]},{"osd":4,"uuid":"c618d2a2-3616-41b2-943c-7a4616538e13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2346495509},{"type":"v1","addr":"172.21.15.135:6809","nonce":2346495509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2346495509},{"type":"v1","addr":"172.21.15.135:6811","nonce":2346495509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2346495509},{"type":"v1","addr":"172.21.15.135:6815","nonce":2346495509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2346495509},{"type":"v1","addr":"172.21.15.135:6813","nonce":2346495509}]},"public_addr":"172.21.15.135:6809/2346495509","cluster_addr":"172.21.15.135:6811/2346495509","heartbeat_back_addr":"172.21.15.135:6815/2346495509","heartbeat_front_addr":"172.21.15.135:6813/2346495509","state":["exists","up"]},{"osd":5,"uuid":"8e1dda3d-6927-495d-b20d-78b03bb75d5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1252638628},{"type":"v1","addr":"172.21.15.161:6809","nonce":1252638628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1252638628},{"type":"v1","addr":"172.21.15.161:6811","nonce":1252638628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1252638628},{"type":"v1","addr":"172.21.15.161:6815","nonce":1252638628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1252638628},{"type":"v1","addr":"172.21.15.161:6813","nonce":1252638628}]},"public_addr":"172.21.15.161:6809/1252638628","cluster_addr":"172.21.15.161:6811/1252638628","heartbeat_back_addr":"172.21.15.161:6815/1252638628","heartbeat_front_addr":"172.21.15.161:6813/1252638628","state":["exists","up"]},{"osd":6,"uuid":"50b31960-6bc4-44e1-8116-3106bf161e56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1052038408},{"type":"v1","addr":"172.21.15.82:6819","nonce":1052038408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1052038408},{"type":"v1","addr":"172.21.15.82:6821","nonce":1052038408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":1052038408},{"type":"v1","addr":"172.21.15.82:6825","nonce":1052038408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1052038408},{"type":"v1","addr":"172.21.15.82:6823","nonce":1052038408}]},"public_addr":"172.21.15.82:6819/1052038408","cluster_addr":"172.21.15.82:6821/1052038408","heartbeat_back_addr":"172.21.15.82:6825/1052038408","heartbeat_front_addr":"172.21.15.82:6823/1052038408","state":["exists","up"]},{"osd":7,"uuid":"425ca0ee-57f7-4b27-90fb-d86bb5db5480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3683951498},{"type":"v1","addr":"172.21.15.135:6817","nonce":3683951498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":3683951498},{"type":"v1","addr":"172.21.15.135:6819","nonce":3683951498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":3683951498},{"type":"v1","addr":"172.21.15.135:6823","nonce":3683951498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":3683951498},{"type":"v1","addr":"172.21.15.135:6821","nonce":3683951498}]},"public_addr":"172.21.15.135:6817/3683951498","cluster_addr":"172.21.15.135:6819/3683951498","heartbeat_back_addr":"172.21.15.135:6823/3683951498","heartbeat_front_addr":"172.21.15.135:6821/3683951498","state":["exists","up"]},{"osd":8,"uuid":"1115c837-bef6-4bad-9974-4d913198511b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":948521536},{"type":"v1","addr":"172.21.15.161:6817","nonce":948521536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":948521536},{"type":"v1","addr":"172.21.15.161:6819","nonce":948521536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":948521536},{"type":"v1","addr":"172.21.15.161:6823","nonce":948521536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":948521536},{"type":"v1","addr":"172.21.15.161:6821","nonce":948521536}]},"public_addr":"172.21.15.161:6817/948521536","cluster_addr":"172.21.15.161:6819/948521536","heartbeat_back_addr":"172.21.15.161:6823/948521536","heartbeat_front_addr":"172.21.15.161:6821/948521536","state":["exists","up"]},{"osd":9,"uuid":"c52ec819-4bc6-402f-9cd8-62539e519e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":1438762840},{"type":"v1","addr":"172.21.15.82:6827","nonce":1438762840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":1438762840},{"type":"v1","addr":"172.21.15.82:6829","nonce":1438762840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1438762840},{"type":"v1","addr":"172.21.15.82:6833","nonce":1438762840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1438762840},{"type":"v1","addr":"172.21.15.82:6831","nonce":1438762840}]},"public_addr":"172.21.15.82:6827/1438762840","cluster_addr":"172.21.15.82:6829/1438762840","heartbeat_back_addr":"172.21.15.82:6833/1438762840","heartbeat_front_addr":"172.21.15.82:6831/1438762840","state":["exists","up"]},{"osd":10,"uuid":"1b16c795-1b91-4d46-ae5d-21b8332c1077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2853697851},{"type":"v1","addr":"172.21.15.135:6825","nonce":2853697851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2853697851},{"type":"v1","addr":"172.21.15.135:6827","nonce":2853697851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2853697851},{"type":"v1","addr":"172.21.15.135:6831","nonce":2853697851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2853697851},{"type":"v1","addr":"172.21.15.135:6829","nonce":2853697851}]},"public_addr":"172.21.15.135:6825/2853697851","cluster_addr":"172.21.15.135:6827/2853697851","heartbeat_back_addr":"172.21.15.135:6831/2853697851","heartbeat_front_addr":"172.21.15.135:6829/2853697851","state":["exists","up"]},{"osd":11,"uuid":"2551e602-4fe1-41cb-9b7d-c8b31fdd1487","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":1459332081},{"type":"v1","addr":"172.21.15.161:6825","nonce":1459332081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":1459332081},{"type":"v1","addr":"172.21.15.161:6827","nonce":1459332081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":1459332081},{"type":"v1","addr":"172.21.15.161:6831","nonce":1459332081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":1459332081},{"type":"v1","addr":"172.21.15.161:6829","nonce":1459332081}]},"public_addr":"172.21.15.161:6825/1459332081","cluster_addr":"172.21.15.161:6827/1459332081","heartbeat_back_addr":"172.21.15.161:6831/1459332081","heartbeat_front_addr":"172.21.15.161:6829/1459332081","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:49:04.007679+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:49:30.702365+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:49:56.785248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:50:22.988516+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:50:49.347055+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:51:15.830145+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:51:41.986377+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:52:08.218893+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:52:34.847450+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:53:01.317134+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:53:27.981691+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:53:54.849245+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/4204712132":"2023-09-24T08:47:21.957866+0000","172.21.15.82:6801/2733521564":"2023-09-24T08:47:21.957866+0000","172.21.15.82:6800/2733521564":"2023-09-24T08:47:21.957866+0000","172.21.15.82:0/3964794665":"2023-09-24T08:47:21.957866+0000","172.21.15.82:0/3535372205":"2023-09-24T08:46:55.187024+0000","172.21.15.82:0/285559684":"2023-09-24T08:46:55.187024+0000","172.21.15.82:0/1335891896":"2023-09-24T08:46:55.187024+0000","172.21.15.82:6801/3761509623":"2023-09-24T08:46:55.187024+0000","172.21.15.82:6800/3761509623":"2023-09-24T08:46:55.187024+0000","172.21.15.82:0/3775317005":"2023-09-24T08:47:21.957866+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-23T08:56:24.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.360+0000 7fb9c17ff700 1 -- 172.21.15.82:0/3243706576 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fb9a409ffa0 msgr2=0x7fb9a40a2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:24.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.360+0000 7fb9c17ff700 1 --2- 172.21.15.82:0/3243706576 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fb9a409ffa0 0x7fb9a40a2460 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac005950 tx=0x7fb9ac0058e0 comp rx=0 tx=0).stop 2023-09-23T08:56:24.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.360+0000 7fb9c17ff700 1 -- 172.21.15.82:0/3243706576 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9bc1024c0 msgr2=0x7fb9bc073250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:24.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.360+0000 7fb9c17ff700 1 --2- 172.21.15.82:0/3243706576 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9bc1024c0 0x7fb9bc073250 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fb9b4007ee0 tx=0x7fb9b400d3b0 comp rx=0 tx=0).stop 2023-09-23T08:56:24.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.360+0000 7fb9c17ff700 1 -- 172.21.15.82:0/3243706576 shutdown_connections 2023-09-23T08:56:24.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.360+0000 7fb9c17ff700 1 --2- 172.21.15.82:0/3243706576 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fb9a409ffa0 0x7fb9a40a2460 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:24.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.360+0000 7fb9c17ff700 1 --2- 172.21.15.82:0/3243706576 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9bc1024c0 0x7fb9bc073250 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:24.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.360+0000 7fb9c17ff700 1 --2- 172.21.15.82:0/3243706576 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb9bc100930 0x7fb9bc0746d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:24.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.360+0000 7fb9c17ff700 1 --2- 172.21.15.82:0/3243706576 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9bc101b20 0x7fb9bc072d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:24.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.360+0000 7fb9c17ff700 1 -- 172.21.15.82:0/3243706576 >> 172.21.15.82:0/3243706576 conn(0x7fb9bc0fbe60 msgr2=0x7fb9bc0fe190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:24.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.360+0000 7fb9c17ff700 1 -- 172.21.15.82:0/3243706576 shutdown_connections 2023-09-23T08:56:24.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.360+0000 7fb9c17ff700 1 -- 172.21.15.82:0/3243706576 wait complete. 2023-09-23T08:56:24.382 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-23T08:50:00.571063+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-23T08:54:50.558630+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-23T08:54:52.055291+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-23T08:56:24.382 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-23T08:56:24.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.584+0000 7f9d7e5ff700 1 -- 172.21.15.82:0/401455181 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d781024a0 msgr2=0x7f9d78108d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:24.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.584+0000 7f9d7e5ff700 1 --2- 172.21.15.82:0/401455181 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d781024a0 0x7f9d78108d50 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f9d7000b0d0 tx=0x7f9d7000b3e0 comp rx=0 tx=0).stop 2023-09-23T08:56:24.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.584+0000 7f9d7e5ff700 1 -- 172.21.15.82:0/401455181 shutdown_connections 2023-09-23T08:56:24.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.584+0000 7f9d7e5ff700 1 --2- 172.21.15.82:0/401455181 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d781024a0 0x7f9d78108d50 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:24.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.584+0000 7f9d7e5ff700 1 --2- 172.21.15.82:0/401455181 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d78100910 0x7f9d78100d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:24.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.584+0000 7f9d7e5ff700 1 --2- 172.21.15.82:0/401455181 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9d78101b00 0x7f9d78101f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:24.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.584+0000 7f9d7e5ff700 1 -- 172.21.15.82:0/401455181 >> 172.21.15.82:0/401455181 conn(0x7f9d780fbe60 msgr2=0x7f9d780fe2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:24.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.584+0000 7f9d7e5ff700 1 -- 172.21.15.82:0/401455181 shutdown_connections 2023-09-23T08:56:24.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.584+0000 7f9d7e5ff700 1 -- 172.21.15.82:0/401455181 wait complete. 2023-09-23T08:56:24.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.585+0000 7f9d7e5ff700 1 Processor -- start 2023-09-23T08:56:24.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.585+0000 7f9d7e5ff700 1 -- start start 2023-09-23T08:56:24.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.585+0000 7f9d7e5ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9d78100910 0x7f9d780746d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:24.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.585+0000 7f9d7e5ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d78101b00 0x7f9d78072d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:24.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.585+0000 7f9d7e5ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d781024a0 0x7f9d78073250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:24.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.585+0000 7f9d7e5ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d780739f0 con 0x7f9d781024a0 2023-09-23T08:56:24.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.585+0000 7f9d7e5ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d78073b60 con 0x7f9d78101b00 2023-09-23T08:56:24.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.585+0000 7f9d7e5ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d781a06d0 con 0x7f9d78100910 2023-09-23T08:56:24.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.586+0000 7f9d7cb9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d781024a0 0x7f9d78073250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:24.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.586+0000 7f9d7cb9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d781024a0 0x7f9d78073250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35016/0 (socket says 172.21.15.82:35016) 2023-09-23T08:56:24.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.586+0000 7f9d7cb9c700 1 -- 172.21.15.82:0/256741157 learned_addr learned my addr 172.21.15.82:0/256741157 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:24.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.586+0000 7f9d77fff700 1 --2- 172.21.15.82:0/256741157 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9d78100910 0x7f9d780746d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:24.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.586+0000 7f9d777fe700 1 --2- 172.21.15.82:0/256741157 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d78101b00 0x7f9d78072d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:24.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.586+0000 7f9d7cb9c700 1 -- 172.21.15.82:0/256741157 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9d78100910 msgr2=0x7f9d780746d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:24.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.586+0000 7f9d7cb9c700 1 --2- 172.21.15.82:0/256741157 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9d78100910 0x7f9d780746d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:24.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.586+0000 7f9d7cb9c700 1 -- 172.21.15.82:0/256741157 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d78101b00 msgr2=0x7f9d78072d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:24.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.586+0000 7f9d7cb9c700 1 --2- 172.21.15.82:0/256741157 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d78101b00 0x7f9d78072d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:24.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.586+0000 7f9d7cb9c700 1 -- 172.21.15.82:0/256741157 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d70009d00 con 0x7f9d781024a0 2023-09-23T08:56:24.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.586+0000 7f9d7cb9c700 1 --2- 172.21.15.82:0/256741157 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d781024a0 0x7f9d78073250 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f9d70009440 tx=0x7f9d70009470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:24.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.586+0000 7f9d757fa700 1 -- 172.21.15.82:0/256741157 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7000e040 con 0x7f9d781024a0 2023-09-23T08:56:24.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.587+0000 7f9d7e5ff700 1 -- 172.21.15.82:0/256741157 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d781a0950 con 0x7f9d781024a0 2023-09-23T08:56:24.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.587+0000 7f9d757fa700 1 -- 172.21.15.82:0/256741157 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9d70012d90 con 0x7f9d781024a0 2023-09-23T08:56:24.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.587+0000 7f9d757fa700 1 -- 172.21.15.82:0/256741157 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7001de30 con 0x7f9d781024a0 2023-09-23T08:56:24.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.587+0000 7f9d7e5ff700 1 -- 172.21.15.82:0/256741157 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d781a0dd0 con 0x7f9d781024a0 2023-09-23T08:56:24.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.588+0000 7f9d7e5ff700 1 -- 172.21.15.82:0/256741157 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d78107890 con 0x7f9d781024a0 2023-09-23T08:56:24.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.589+0000 7f9d757fa700 1 -- 172.21.15.82:0/256741157 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 134671+0+0 (secure 0 0 0) 0x7f9d70012900 con 0x7f9d781024a0 2023-09-23T08:56:24.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.591+0000 7f9d757fa700 1 --2- 172.21.15.82:0/256741157 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f9d6009ff50 0x7f9d600a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:24.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.591+0000 7f9d757fa700 1 -- 172.21.15.82:0/256741157 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f9d700ccfe0 con 0x7f9d781024a0 2023-09-23T08:56:24.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.591+0000 7f9d77fff700 1 --2- 172.21.15.82:0/256741157 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f9d6009ff50 0x7f9d600a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:24.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.592+0000 7f9d77fff700 1 --2- 172.21.15.82:0/256741157 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f9d6009ff50 0x7f9d600a2410 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9d78101960 tx=0x7f9d68007400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:24.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.595+0000 7f9d757fa700 1 -- 172.21.15.82:0/256741157 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f9d70096dd0 con 0x7f9d781024a0 2023-09-23T08:56:24.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.797+0000 7f9d7e5ff700 1 -- 172.21.15.82:0/256741157 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9d7802cd30 con 0x7f9d781024a0 2023-09-23T08:56:24.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.798+0000 7f9d757fa700 1 -- 172.21.15.82:0/256741157 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9d7009a3f0 con 0x7f9d781024a0 2023-09-23T08:56:24.801 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-09-23T08:56:24.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.800+0000 7f9d7e5ff700 1 -- 172.21.15.82:0/256741157 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f9d6009ff50 msgr2=0x7f9d600a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:24.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.800+0000 7f9d7e5ff700 1 --2- 172.21.15.82:0/256741157 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f9d6009ff50 0x7f9d600a2410 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9d78101960 tx=0x7f9d68007400 comp rx=0 tx=0).stop 2023-09-23T08:56:24.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.800+0000 7f9d7e5ff700 1 -- 172.21.15.82:0/256741157 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d781024a0 msgr2=0x7f9d78073250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:24.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.800+0000 7f9d7e5ff700 1 --2- 172.21.15.82:0/256741157 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d781024a0 0x7f9d78073250 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f9d70009440 tx=0x7f9d70009470 comp rx=0 tx=0).stop 2023-09-23T08:56:24.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.800+0000 7f9d7e5ff700 1 -- 172.21.15.82:0/256741157 shutdown_connections 2023-09-23T08:56:24.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.800+0000 7f9d7e5ff700 1 --2- 172.21.15.82:0/256741157 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f9d6009ff50 0x7f9d600a2410 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:24.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.800+0000 7f9d7e5ff700 1 --2- 172.21.15.82:0/256741157 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d781024a0 0x7f9d78073250 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:24.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.800+0000 7f9d7e5ff700 1 --2- 172.21.15.82:0/256741157 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9d78100910 0x7f9d780746d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:24.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.800+0000 7f9d7e5ff700 1 --2- 172.21.15.82:0/256741157 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d78101b00 0x7f9d78072d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:24.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.800+0000 7f9d7e5ff700 1 -- 172.21.15.82:0/256741157 >> 172.21.15.82:0/256741157 conn(0x7f9d780fbe60 msgr2=0x7f9d780fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:24.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.800+0000 7f9d7e5ff700 1 -- 172.21.15.82:0/256741157 shutdown_connections 2023-09-23T08:56:24.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:24.800+0000 7f9d7e5ff700 1 -- 172.21.15.82:0/256741157 wait complete. 2023-09-23T08:56:24.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:24 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/1265083280' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T08:56:24.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:24 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/3243706576' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-23T08:56:24.819 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:24 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/1265083280' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T08:56:24.819 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:24 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/3243706576' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-23T08:56:24.824 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-23T08:56:24.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:24 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/1265083280' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T08:56:24.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:24 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/3243706576' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-23T08:56:25.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.019+0000 7f8c6adff700 1 -- 172.21.15.82:0/383192723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c641024c0 msgr2=0x7f8c64108d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:25.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.019+0000 7f8c6adff700 1 --2- 172.21.15.82:0/383192723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c641024c0 0x7f8c64108d70 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c00b0d0 tx=0x7f8c5c00b3e0 comp rx=0 tx=0).stop 2023-09-23T08:56:25.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.019+0000 7f8c6adff700 1 -- 172.21.15.82:0/383192723 shutdown_connections 2023-09-23T08:56:25.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.019+0000 7f8c6adff700 1 --2- 172.21.15.82:0/383192723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c641024c0 0x7f8c64108d70 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:25.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.019+0000 7f8c6adff700 1 --2- 172.21.15.82:0/383192723 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c64100930 0x7f8c64100d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:25.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.019+0000 7f8c6adff700 1 --2- 172.21.15.82:0/383192723 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c64101b20 0x7f8c64101f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:25.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.019+0000 7f8c6adff700 1 -- 172.21.15.82:0/383192723 >> 172.21.15.82:0/383192723 conn(0x7f8c640fbea0 msgr2=0x7f8c640fe2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:25.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.019+0000 7f8c6adff700 1 -- 172.21.15.82:0/383192723 shutdown_connections 2023-09-23T08:56:25.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.019+0000 7f8c6adff700 1 -- 172.21.15.82:0/383192723 wait complete. 2023-09-23T08:56:25.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.020+0000 7f8c6adff700 1 Processor -- start 2023-09-23T08:56:25.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.020+0000 7f8c6adff700 1 -- start start 2023-09-23T08:56:25.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.021+0000 7f8c6adff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c64100930 0x7f8c64198850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:25.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.021+0000 7f8c6adff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c64101b20 0x7f8c64198d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:25.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.021+0000 7f8c6adff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c641024c0 0x7f8c6419fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:25.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.021+0000 7f8c6adff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c641a03d0 con 0x7f8c64100930 2023-09-23T08:56:25.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.021+0000 7f8c6adff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c641a0510 con 0x7f8c641024c0 2023-09-23T08:56:25.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.021+0000 7f8c6adff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c641a06a0 con 0x7f8c64101b20 2023-09-23T08:56:25.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.021+0000 7f8c68b9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c64100930 0x7f8c64198850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:25.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.021+0000 7f8c68b9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c64100930 0x7f8c64198850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35036/0 (socket says 172.21.15.82:35036) 2023-09-23T08:56:25.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.021+0000 7f8c68b9b700 1 -- 172.21.15.82:0/2988384972 learned_addr learned my addr 172.21.15.82:0/2988384972 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:25.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.021+0000 7f8c6939c700 1 --2- 172.21.15.82:0/2988384972 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c641024c0 0x7f8c6419fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:25.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.021+0000 7f8c63fff700 1 --2- 172.21.15.82:0/2988384972 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c64101b20 0x7f8c64198d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:25.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.021+0000 7f8c68b9b700 1 -- 172.21.15.82:0/2988384972 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c64101b20 msgr2=0x7f8c64198d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:25.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.021+0000 7f8c68b9b700 1 --2- 172.21.15.82:0/2988384972 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c64101b20 0x7f8c64198d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:25.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.021+0000 7f8c68b9b700 1 -- 172.21.15.82:0/2988384972 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c641024c0 msgr2=0x7f8c6419fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:25.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.021+0000 7f8c68b9b700 1 --2- 172.21.15.82:0/2988384972 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c641024c0 0x7f8c6419fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:25.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.021+0000 7f8c68b9b700 1 -- 172.21.15.82:0/2988384972 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c5c009d00 con 0x7f8c64100930 2023-09-23T08:56:25.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.022+0000 7f8c68b9b700 1 --2- 172.21.15.82:0/2988384972 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c64100930 0x7f8c64198850 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f8c5800d980 tx=0x7f8c5800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:25.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.022+0000 7f8c61ffb700 1 -- 172.21.15.82:0/2988384972 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c58004020 con 0x7f8c64100930 2023-09-23T08:56:25.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.022+0000 7f8c6adff700 1 -- 172.21.15.82:0/2988384972 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c641a0980 con 0x7f8c64100930 2023-09-23T08:56:25.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.022+0000 7f8c61ffb700 1 -- 172.21.15.82:0/2988384972 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8c5800f690 con 0x7f8c64100930 2023-09-23T08:56:25.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.022+0000 7f8c61ffb700 1 -- 172.21.15.82:0/2988384972 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c580039e0 con 0x7f8c64100930 2023-09-23T08:56:25.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.022+0000 7f8c6adff700 1 -- 172.21.15.82:0/2988384972 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c641a0e90 con 0x7f8c64100930 2023-09-23T08:56:25.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.023+0000 7f8c6adff700 1 -- 172.21.15.82:0/2988384972 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c64192e40 con 0x7f8c64100930 2023-09-23T08:56:25.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.025+0000 7f8c61ffb700 1 -- 172.21.15.82:0/2988384972 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 134671+0+0 (secure 0 0 0) 0x7f8c5800f800 con 0x7f8c64100930 2023-09-23T08:56:25.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.026+0000 7f8c61ffb700 1 --2- 172.21.15.82:0/2988384972 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f8c5409ff50 0x7f8c540a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:25.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.026+0000 7f8c61ffb700 1 -- 172.21.15.82:0/2988384972 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f8c580cadb0 con 0x7f8c64100930 2023-09-23T08:56:25.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.026+0000 7f8c63fff700 1 --2- 172.21.15.82:0/2988384972 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f8c5409ff50 0x7f8c540a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:25.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.027+0000 7f8c63fff700 1 --2- 172.21.15.82:0/2988384972 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f8c5409ff50 0x7f8c540a2410 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8c50005950 tx=0x7f8c5000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:25.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.030+0000 7f8c61ffb700 1 -- 172.21.15.82:0/2988384972 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f8c58094b50 con 0x7f8c64100930 2023-09-23T08:56:25.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.232+0000 7f8c6adff700 1 -- 172.21.15.82:0/2988384972 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8c6402cb70 con 0x7f8c64100930 2023-09-23T08:56:25.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.232+0000 7f8c61ffb700 1 -- 172.21.15.82:0/2988384972 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8c58098170 con 0x7f8c64100930 2023-09-23T08:56:25.236 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2023-09-23T08:56:25.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.235+0000 7f8c6adff700 1 -- 172.21.15.82:0/2988384972 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f8c5409ff50 msgr2=0x7f8c540a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:25.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.235+0000 7f8c6adff700 1 --2- 172.21.15.82:0/2988384972 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f8c5409ff50 0x7f8c540a2410 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8c50005950 tx=0x7f8c5000b410 comp rx=0 tx=0).stop 2023-09-23T08:56:25.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.235+0000 7f8c6adff700 1 -- 172.21.15.82:0/2988384972 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c64100930 msgr2=0x7f8c64198850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:25.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.235+0000 7f8c6adff700 1 --2- 172.21.15.82:0/2988384972 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c64100930 0x7f8c64198850 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f8c5800d980 tx=0x7f8c5800dc90 comp rx=0 tx=0).stop 2023-09-23T08:56:25.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.235+0000 7f8c6adff700 1 -- 172.21.15.82:0/2988384972 shutdown_connections 2023-09-23T08:56:25.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.235+0000 7f8c6adff700 1 --2- 172.21.15.82:0/2988384972 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f8c5409ff50 0x7f8c540a2410 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:25.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.235+0000 7f8c6adff700 1 --2- 172.21.15.82:0/2988384972 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c641024c0 0x7f8c6419fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:25.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.235+0000 7f8c6adff700 1 --2- 172.21.15.82:0/2988384972 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c64100930 0x7f8c64198850 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:25.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.235+0000 7f8c6adff700 1 --2- 172.21.15.82:0/2988384972 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c64101b20 0x7f8c64198d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:25.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.235+0000 7f8c6adff700 1 -- 172.21.15.82:0/2988384972 >> 172.21.15.82:0/2988384972 conn(0x7f8c640fbea0 msgr2=0x7f8c64107410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:25.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.235+0000 7f8c6adff700 1 -- 172.21.15.82:0/2988384972 shutdown_connections 2023-09-23T08:56:25.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.235+0000 7f8c6adff700 1 -- 172.21.15.82:0/2988384972 wait complete. 2023-09-23T08:56:25.256 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-23T08:56:25.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.453+0000 7f38d27ff700 1 -- 172.21.15.82:0/1347093603 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38cc101b20 msgr2=0x7f38cc101f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:25.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.453+0000 7f38d27ff700 1 --2- 172.21.15.82:0/1347093603 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38cc101b20 0x7f38cc101f80 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f38b40099c0 tx=0x7f38b4009cd0 comp rx=0 tx=0).stop 2023-09-23T08:56:25.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.453+0000 7f38d27ff700 1 -- 172.21.15.82:0/1347093603 shutdown_connections 2023-09-23T08:56:25.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.453+0000 7f38d27ff700 1 --2- 172.21.15.82:0/1347093603 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f38cc1024c0 0x7f38cc108d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:25.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.453+0000 7f38d27ff700 1 --2- 172.21.15.82:0/1347093603 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38cc100930 0x7f38cc100d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:25.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.453+0000 7f38d27ff700 1 --2- 172.21.15.82:0/1347093603 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38cc101b20 0x7f38cc101f80 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:25.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.453+0000 7f38d27ff700 1 -- 172.21.15.82:0/1347093603 >> 172.21.15.82:0/1347093603 conn(0x7f38cc0fbea0 msgr2=0x7f38cc0fe2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:25.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.453+0000 7f38d27ff700 1 -- 172.21.15.82:0/1347093603 shutdown_connections 2023-09-23T08:56:25.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.453+0000 7f38d27ff700 1 -- 172.21.15.82:0/1347093603 wait complete. 2023-09-23T08:56:25.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.454+0000 7f38d27ff700 1 Processor -- start 2023-09-23T08:56:25.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.455+0000 7f38d27ff700 1 -- start start 2023-09-23T08:56:25.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.455+0000 7f38d27ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38cc100930 0x7f38cc198770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:25.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.455+0000 7f38d27ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f38cc101b20 0x7f38cc198cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:25.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.455+0000 7f38d27ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38cc1024c0 0x7f38cc19fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:25.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.455+0000 7f38d27ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38cc1a02f0 con 0x7f38cc1024c0 2023-09-23T08:56:25.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.455+0000 7f38d27ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38cc1a0430 con 0x7f38cc100930 2023-09-23T08:56:25.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.455+0000 7f38d27ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38cc1a05c0 con 0x7f38cc101b20 2023-09-23T08:56:25.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.455+0000 7f38d0d9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38cc1024c0 0x7f38cc19fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:25.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.455+0000 7f38d0d9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38cc1024c0 0x7f38cc19fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35054/0 (socket says 172.21.15.82:35054) 2023-09-23T08:56:25.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.455+0000 7f38d0d9c700 1 -- 172.21.15.82:0/1261868590 learned_addr learned my addr 172.21.15.82:0/1261868590 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:25.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.455+0000 7f38c3fff700 1 --2- 172.21.15.82:0/1261868590 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f38cc101b20 0x7f38cc198cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:25.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.455+0000 7f38cbfff700 1 --2- 172.21.15.82:0/1261868590 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38cc100930 0x7f38cc198770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:25.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.456+0000 7f38d0d9c700 1 -- 172.21.15.82:0/1261868590 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f38cc101b20 msgr2=0x7f38cc198cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:25.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.456+0000 7f38d0d9c700 1 --2- 172.21.15.82:0/1261868590 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f38cc101b20 0x7f38cc198cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:25.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.456+0000 7f38d0d9c700 1 -- 172.21.15.82:0/1261868590 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38cc100930 msgr2=0x7f38cc198770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:25.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.456+0000 7f38d0d9c700 1 --2- 172.21.15.82:0/1261868590 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38cc100930 0x7f38cc198770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:25.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.456+0000 7f38d0d9c700 1 -- 172.21.15.82:0/1261868590 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38b40095f0 con 0x7f38cc1024c0 2023-09-23T08:56:25.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.456+0000 7f38d0d9c700 1 --2- 172.21.15.82:0/1261868590 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38cc1024c0 0x7f38cc19fd20 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f38c4007ee0 tx=0x7f38c400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:25.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.456+0000 7f38c9ffb700 1 -- 172.21.15.82:0/1261868590 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c4017070 con 0x7f38cc1024c0 2023-09-23T08:56:25.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.456+0000 7f38d27ff700 1 -- 172.21.15.82:0/1261868590 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38cc1a08a0 con 0x7f38cc1024c0 2023-09-23T08:56:25.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.456+0000 7f38c9ffb700 1 -- 172.21.15.82:0/1261868590 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f38c400f040 con 0x7f38cc1024c0 2023-09-23T08:56:25.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.456+0000 7f38c9ffb700 1 -- 172.21.15.82:0/1261868590 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c4005570 con 0x7f38cc1024c0 2023-09-23T08:56:25.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.456+0000 7f38d27ff700 1 -- 172.21.15.82:0/1261868590 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38cc1a0db0 con 0x7f38cc1024c0 2023-09-23T08:56:25.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.457+0000 7f38d27ff700 1 -- 172.21.15.82:0/1261868590 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38cc10c040 con 0x7f38cc1024c0 2023-09-23T08:56:25.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.459+0000 7f38c9ffb700 1 -- 172.21.15.82:0/1261868590 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 134671+0+0 (secure 0 0 0) 0x7f38c400db20 con 0x7f38cc1024c0 2023-09-23T08:56:25.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.460+0000 7f38c9ffb700 1 --2- 172.21.15.82:0/1261868590 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f38b809ff50 0x7f38b80a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:25.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.460+0000 7f38c9ffb700 1 -- 172.21.15.82:0/1261868590 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f38c40ca980 con 0x7f38cc1024c0 2023-09-23T08:56:25.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.461+0000 7f38cbfff700 1 --2- 172.21.15.82:0/1261868590 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f38b809ff50 0x7f38b80a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:25.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.461+0000 7f38cbfff700 1 --2- 172.21.15.82:0/1261868590 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f38b809ff50 0x7f38b80a2410 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f38cc101980 tx=0x7f38bc00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:25.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.464+0000 7f38c9ffb700 1 -- 172.21.15.82:0/1261868590 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f38c4094720 con 0x7f38cc1024c0 2023-09-23T08:56:25.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.666+0000 7f38d27ff700 1 -- 172.21.15.82:0/1261868590 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f38cc1a0fd0 con 0x7f38cc1024c0 2023-09-23T08:56:25.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.666+0000 7f38c9ffb700 1 -- 172.21.15.82:0/1261868590 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7f38c4097d40 con 0x7f38cc1024c0 2023-09-23T08:56:25.669 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2023-09-23T08:56:25.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.668+0000 7f38d27ff700 1 -- 172.21.15.82:0/1261868590 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f38b809ff50 msgr2=0x7f38b80a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:25.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.668+0000 7f38d27ff700 1 --2- 172.21.15.82:0/1261868590 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f38b809ff50 0x7f38b80a2410 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f38cc101980 tx=0x7f38bc00b410 comp rx=0 tx=0).stop 2023-09-23T08:56:25.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.668+0000 7f38d27ff700 1 -- 172.21.15.82:0/1261868590 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38cc1024c0 msgr2=0x7f38cc19fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:25.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.668+0000 7f38d27ff700 1 --2- 172.21.15.82:0/1261868590 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38cc1024c0 0x7f38cc19fd20 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f38c4007ee0 tx=0x7f38c400d3b0 comp rx=0 tx=0).stop 2023-09-23T08:56:25.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.668+0000 7f38d27ff700 1 -- 172.21.15.82:0/1261868590 shutdown_connections 2023-09-23T08:56:25.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.668+0000 7f38d27ff700 1 --2- 172.21.15.82:0/1261868590 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f38b809ff50 0x7f38b80a2410 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:25.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.668+0000 7f38d27ff700 1 --2- 172.21.15.82:0/1261868590 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38cc1024c0 0x7f38cc19fd20 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:25.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.668+0000 7f38d27ff700 1 --2- 172.21.15.82:0/1261868590 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38cc100930 0x7f38cc198770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:25.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.668+0000 7f38d27ff700 1 --2- 172.21.15.82:0/1261868590 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f38cc101b20 0x7f38cc198cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:25.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.668+0000 7f38d27ff700 1 -- 172.21.15.82:0/1261868590 >> 172.21.15.82:0/1261868590 conn(0x7f38cc0fbea0 msgr2=0x7f38cc0fe170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:25.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.669+0000 7f38d27ff700 1 -- 172.21.15.82:0/1261868590 shutdown_connections 2023-09-23T08:56:25.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.669+0000 7f38d27ff700 1 -- 172.21.15.82:0/1261868590 wait complete. 2023-09-23T08:56:25.690 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-23T08:56:25.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:25 smithi135 ceph-mon[99205]: pgmap v349: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 9 op/s 2023-09-23T08:56:25.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:25 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/256741157' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-23T08:56:25.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:25 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/2988384972' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-09-23T08:56:25.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:25 smithi082 ceph-mon[97694]: pgmap v349: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 9 op/s 2023-09-23T08:56:25.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:25 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/256741157' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-23T08:56:25.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:25 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/2988384972' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-09-23T08:56:25.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.885+0000 7f447b3ff700 1 -- 172.21.15.82:0/3693447940 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4474100920 msgr2=0x7f4474100d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:25.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.885+0000 7f447b3ff700 1 --2- 172.21.15.82:0/3693447940 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4474100920 0x7f4474100d40 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f44700099c0 tx=0x7f4470009cd0 comp rx=0 tx=0).stop 2023-09-23T08:56:25.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.885+0000 7f447b3ff700 1 -- 172.21.15.82:0/3693447940 shutdown_connections 2023-09-23T08:56:25.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.885+0000 7f447b3ff700 1 --2- 172.21.15.82:0/3693447940 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f44741024b0 0x7f4474108d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:25.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.885+0000 7f447b3ff700 1 --2- 172.21.15.82:0/3693447940 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4474100920 0x7f4474100d40 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:25.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.885+0000 7f447b3ff700 1 --2- 172.21.15.82:0/3693447940 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4474101b10 0x7f4474101f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:25.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.885+0000 7f447b3ff700 1 -- 172.21.15.82:0/3693447940 >> 172.21.15.82:0/3693447940 conn(0x7f44740fbe50 msgr2=0x7f44740fe2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:25.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.885+0000 7f447b3ff700 1 -- 172.21.15.82:0/3693447940 shutdown_connections 2023-09-23T08:56:25.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.886+0000 7f447b3ff700 1 -- 172.21.15.82:0/3693447940 wait complete. 2023-09-23T08:56:25.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.886+0000 7f447b3ff700 1 Processor -- start 2023-09-23T08:56:25.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.887+0000 7f447b3ff700 1 -- start start 2023-09-23T08:56:25.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.887+0000 7f447b3ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4474100920 0x7f4474198770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:25.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.887+0000 7f447b3ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4474101b10 0x7f4474198cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:25.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.887+0000 7f447b3ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44741024b0 0x7f447419fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:25.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.887+0000 7f447b3ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44741a02f0 con 0x7f4474101b10 2023-09-23T08:56:25.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.887+0000 7f447b3ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44741a0430 con 0x7f44741024b0 2023-09-23T08:56:25.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.887+0000 7f447b3ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44741a05c0 con 0x7f4474100920 2023-09-23T08:56:25.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.887+0000 7f447899a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4474101b10 0x7f4474198cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:25.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.887+0000 7f447899a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4474101b10 0x7f4474198cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35066/0 (socket says 172.21.15.82:35066) 2023-09-23T08:56:25.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.887+0000 7f447899a700 1 -- 172.21.15.82:0/816477408 learned_addr learned my addr 172.21.15.82:0/816477408 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:25.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.887+0000 7f447919b700 1 --2- 172.21.15.82:0/816477408 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4474100920 0x7f4474198770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:25.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.887+0000 7f447999c700 1 --2- 172.21.15.82:0/816477408 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44741024b0 0x7f447419fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:25.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.887+0000 7f447899a700 1 -- 172.21.15.82:0/816477408 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4474100920 msgr2=0x7f4474198770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:25.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.887+0000 7f447899a700 1 --2- 172.21.15.82:0/816477408 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4474100920 0x7f4474198770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:25.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.887+0000 7f447899a700 1 -- 172.21.15.82:0/816477408 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44741024b0 msgr2=0x7f447419fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:25.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.887+0000 7f447899a700 1 --2- 172.21.15.82:0/816477408 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44741024b0 0x7f447419fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:25.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.887+0000 7f447899a700 1 -- 172.21.15.82:0/816477408 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44700095f0 con 0x7f4474101b10 2023-09-23T08:56:25.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.887+0000 7f447919b700 1 --2- 172.21.15.82:0/816477408 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4474100920 0x7f4474198770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T08:56:25.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.888+0000 7f447899a700 1 --2- 172.21.15.82:0/816477408 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4474101b10 0x7f4474198cb0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f446400d950 tx=0x7f446400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:25.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.888+0000 7f446a7fc700 1 -- 172.21.15.82:0/816477408 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4464009b40 con 0x7f4474101b10 2023-09-23T08:56:25.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.888+0000 7f446a7fc700 1 -- 172.21.15.82:0/816477408 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4464009ca0 con 0x7f4474101b10 2023-09-23T08:56:25.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.888+0000 7f446a7fc700 1 -- 172.21.15.82:0/816477408 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f446400f620 con 0x7f4474101b10 2023-09-23T08:56:25.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.888+0000 7f447b3ff700 1 -- 172.21.15.82:0/816477408 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44741a08a0 con 0x7f4474101b10 2023-09-23T08:56:25.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.888+0000 7f447b3ff700 1 -- 172.21.15.82:0/816477408 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44741a0d60 con 0x7f4474101b10 2023-09-23T08:56:25.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.889+0000 7f447b3ff700 1 -- 172.21.15.82:0/816477408 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4474192e20 con 0x7f4474101b10 2023-09-23T08:56:25.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.891+0000 7f446a7fc700 1 -- 172.21.15.82:0/816477408 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 134671+0+0 (secure 0 0 0) 0x7f4464010460 con 0x7f4474101b10 2023-09-23T08:56:25.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.892+0000 7f446a7fc700 1 --2- 172.21.15.82:0/816477408 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f446009ffa0 0x7f44600a2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:25.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.892+0000 7f446a7fc700 1 -- 172.21.15.82:0/816477408 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f44640cb610 con 0x7f4474101b10 2023-09-23T08:56:25.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.893+0000 7f447919b700 1 --2- 172.21.15.82:0/816477408 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f446009ffa0 0x7f44600a2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:25.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.893+0000 7f447919b700 1 --2- 172.21.15.82:0/816477408 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f446009ffa0 0x7f44600a2460 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4470000c00 tx=0x7f4470005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:25.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:25 smithi161 ceph-mon[99580]: pgmap v349: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 9 op/s 2023-09-23T08:56:25.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:25 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/256741157' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-23T08:56:25.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:25 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/2988384972' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-09-23T08:56:25.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:25.896+0000 7f446a7fc700 1 -- 172.21.15.82:0/816477408 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f4464095350 con 0x7f4474101b10 2023-09-23T08:56:26.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.138+0000 7f447b3ff700 1 -- 172.21.15.82:0/816477408 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f447410c030 con 0x7f4474101b10 2023-09-23T08:56:26.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.138+0000 7f446a7fc700 1 -- 172.21.15.82:0/816477408 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+11323 (secure 0 0 0) 0x7f4464098970 con 0x7f4474101b10 2023-09-23T08:56:26.141 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:56:26.141 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/1237857359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1237857359},{"type":"v1","addr":"172.21.15.82:6835","nonce":1237857359}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/1335102362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":1335102362},{"type":"v1","addr":"172.21.15.82:6837","nonce":1335102362}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-23T08:54:52.600479+0000","modified":"2023-09-23T08:55:00.481507+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24557,"mds_1":24550,"mds_2":24526,"mds_3":24515,"mds_4":24514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/3645331700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3645331700},{"type":"v1","addr":"172.21.15.135:6835","nonce":3645331700}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14658":{"gid":14658,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6839/205725278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":205725278},{"type":"v1","addr":"172.21.15.82:6839","nonce":205725278}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14670":{"gid":14670,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6841/2659297867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":2659297867},{"type":"v1","addr":"172.21.15.82:6841","nonce":2659297867}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24461":{"gid":24461,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/503886037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":503886037},{"type":"v1","addr":"172.21.15.135:6833","nonce":503886037}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24463":{"gid":24463,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.161:6833/471569125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":471569125},{"type":"v1","addr":"172.21.15.161:6833","nonce":471569125}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24514":{"gid":24514,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":10,"addr":"172.21.15.161:6835/2237964162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":2237964162},{"type":"v1","addr":"172.21.15.161:6835","nonce":2237964162}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24515":{"gid":24515,"name":"h","rank":3,"incarnation":22,"state":"up:active","state_seq":8,"addr":"172.21.15.135:6837/2655304858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2655304858},{"type":"v1","addr":"172.21.15.135:6837","nonce":2655304858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24526":{"gid":24526,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.161:6837/43639843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":43639843},{"type":"v1","addr":"172.21.15.161:6837","nonce":43639843}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24550":{"gid":24550,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.161:6839/758982817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6838","nonce":758982817},{"type":"v1","addr":"172.21.15.161:6839","nonce":758982817}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24557":{"gid":24557,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6839/2508669274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2508669274},{"type":"v1","addr":"172.21.15.135:6839","nonce":2508669274}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-23T08:56:26.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.141+0000 7f447b3ff700 1 -- 172.21.15.82:0/816477408 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f446009ffa0 msgr2=0x7f44600a2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:26.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.141+0000 7f447b3ff700 1 --2- 172.21.15.82:0/816477408 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f446009ffa0 0x7f44600a2460 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4470000c00 tx=0x7f4470005fb0 comp rx=0 tx=0).stop 2023-09-23T08:56:26.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.141+0000 7f447b3ff700 1 -- 172.21.15.82:0/816477408 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4474101b10 msgr2=0x7f4474198cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:26.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.141+0000 7f447b3ff700 1 --2- 172.21.15.82:0/816477408 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4474101b10 0x7f4474198cb0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f446400d950 tx=0x7f446400dd10 comp rx=0 tx=0).stop 2023-09-23T08:56:26.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.141+0000 7f447b3ff700 1 -- 172.21.15.82:0/816477408 shutdown_connections 2023-09-23T08:56:26.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.141+0000 7f447b3ff700 1 --2- 172.21.15.82:0/816477408 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f446009ffa0 0x7f44600a2460 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:26.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.141+0000 7f447b3ff700 1 --2- 172.21.15.82:0/816477408 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44741024b0 0x7f447419fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:26.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.141+0000 7f447b3ff700 1 --2- 172.21.15.82:0/816477408 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4474100920 0x7f4474198770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:26.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.141+0000 7f447b3ff700 1 --2- 172.21.15.82:0/816477408 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4474101b10 0x7f4474198cb0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:26.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.141+0000 7f447b3ff700 1 -- 172.21.15.82:0/816477408 >> 172.21.15.82:0/816477408 conn(0x7f44740fbe50 msgr2=0x7f4474107480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:26.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.141+0000 7f447b3ff700 1 -- 172.21.15.82:0/816477408 shutdown_connections 2023-09-23T08:56:26.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.141+0000 7f447b3ff700 1 -- 172.21.15.82:0/816477408 wait complete. 2023-09-23T08:56:26.145 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 26 2023-09-23T08:56:26.162 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-23T08:56:26.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.358+0000 7fabcefff700 1 -- 172.21.15.82:0/767194909 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabc81024c0 msgr2=0x7fabc8108d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:26.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.358+0000 7fabcefff700 1 --2- 172.21.15.82:0/767194909 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabc81024c0 0x7fabc8108d70 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fabc000b0d0 tx=0x7fabc000b3e0 comp rx=0 tx=0).stop 2023-09-23T08:56:26.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.358+0000 7fabcefff700 1 -- 172.21.15.82:0/767194909 shutdown_connections 2023-09-23T08:56:26.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.358+0000 7fabcefff700 1 --2- 172.21.15.82:0/767194909 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabc81024c0 0x7fabc8108d70 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:26.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.358+0000 7fabcefff700 1 --2- 172.21.15.82:0/767194909 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fabc8100930 0x7fabc8100d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:26.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.358+0000 7fabcefff700 1 --2- 172.21.15.82:0/767194909 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fabc8101b20 0x7fabc8101f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:26.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.358+0000 7fabcefff700 1 -- 172.21.15.82:0/767194909 >> 172.21.15.82:0/767194909 conn(0x7fabc80fbe60 msgr2=0x7fabc80fe2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:26.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.358+0000 7fabcefff700 1 -- 172.21.15.82:0/767194909 shutdown_connections 2023-09-23T08:56:26.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.358+0000 7fabcefff700 1 -- 172.21.15.82:0/767194909 wait complete. 2023-09-23T08:56:26.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.359+0000 7fabcefff700 1 Processor -- start 2023-09-23T08:56:26.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.359+0000 7fabcefff700 1 -- start start 2023-09-23T08:56:26.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.359+0000 7fabcefff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabc8100930 0x7fabc8196630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:26.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.359+0000 7fabcefff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fabc8101b20 0x7fabc8196b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:26.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.359+0000 7fabcefff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fabc81024c0 0x7fabc819dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:26.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.359+0000 7fabcefff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabc819e1b0 con 0x7fabc8100930 2023-09-23T08:56:26.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.359+0000 7fabcefff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabc819e2f0 con 0x7fabc81024c0 2023-09-23T08:56:26.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.359+0000 7fabcefff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabc819e480 con 0x7fabc8101b20 2023-09-23T08:56:26.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.360+0000 7fabccd9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabc8100930 0x7fabc8196630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:26.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.360+0000 7fabccd9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabc8100930 0x7fabc8196630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35080/0 (socket says 172.21.15.82:35080) 2023-09-23T08:56:26.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.360+0000 7fabccd9b700 1 -- 172.21.15.82:0/1815227085 learned_addr learned my addr 172.21.15.82:0/1815227085 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:26.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.360+0000 7fabcd59c700 1 --2- 172.21.15.82:0/1815227085 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fabc81024c0 0x7fabc819dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:26.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.360+0000 7fabccd9b700 1 -- 172.21.15.82:0/1815227085 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fabc8101b20 msgr2=0x7fabc8196b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:26.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.360+0000 7fabccd9b700 1 --2- 172.21.15.82:0/1815227085 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fabc8101b20 0x7fabc8196b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:26.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.360+0000 7fabccd9b700 1 -- 172.21.15.82:0/1815227085 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fabc81024c0 msgr2=0x7fabc819dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:26.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.360+0000 7fabccd9b700 1 --2- 172.21.15.82:0/1815227085 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fabc81024c0 0x7fabc819dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:26.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.360+0000 7fabccd9b700 1 -- 172.21.15.82:0/1815227085 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabc0009d00 con 0x7fabc8100930 2023-09-23T08:56:26.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.360+0000 7fabcd59c700 1 --2- 172.21.15.82:0/1815227085 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fabc81024c0 0x7fabc819dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T08:56:26.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.360+0000 7fabccd9b700 1 --2- 172.21.15.82:0/1815227085 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabc8100930 0x7fabc8196630 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fabbc00d980 tx=0x7fabbc00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:26.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.360+0000 7fabc5ffb700 1 -- 172.21.15.82:0/1815227085 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabbc00bb60 con 0x7fabc8100930 2023-09-23T08:56:26.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.360+0000 7fabc5ffb700 1 -- 172.21.15.82:0/1815227085 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fabbc007620 con 0x7fabc8100930 2023-09-23T08:56:26.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.360+0000 7fabcefff700 1 -- 172.21.15.82:0/1815227085 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabc819e760 con 0x7fabc8100930 2023-09-23T08:56:26.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.360+0000 7fabc5ffb700 1 -- 172.21.15.82:0/1815227085 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabbc00f3c0 con 0x7fabc8100930 2023-09-23T08:56:26.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.361+0000 7fabcefff700 1 -- 172.21.15.82:0/1815227085 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabc819ecc0 con 0x7fabc8100930 2023-09-23T08:56:26.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.361+0000 7fabcefff700 1 -- 172.21.15.82:0/1815227085 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabc8107e70 con 0x7fabc8100930 2023-09-23T08:56:26.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.363+0000 7fabc5ffb700 1 -- 172.21.15.82:0/1815227085 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 134671+0+0 (secure 0 0 0) 0x7fabbc010460 con 0x7fabc8100930 2023-09-23T08:56:26.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.365+0000 7fabc5ffb700 1 --2- 172.21.15.82:0/1815227085 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fabb80a0020 0x7fabb80a24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:26.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.365+0000 7fabc5ffb700 1 -- 172.21.15.82:0/1815227085 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fabbc0cb480 con 0x7fabc8100930 2023-09-23T08:56:26.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.365+0000 7fabc7fff700 1 --2- 172.21.15.82:0/1815227085 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fabb80a0020 0x7fabb80a24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:26.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.365+0000 7fabc7fff700 1 --2- 172.21.15.82:0/1815227085 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fabb80a0020 0x7fabb80a24e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fabb4009b60 tx=0x7fabb4009620 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:26.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.368+0000 7fabc5ffb700 1 -- 172.21.15.82:0/1815227085 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7fabbc0951c0 con 0x7fabc8100930 2023-09-23T08:56:26.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.572+0000 7fabcefff700 1 -- 172.21.15.82:0/1815227085 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fabc810c000 con 0x7fabc8100930 2023-09-23T08:56:26.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.574+0000 7fabc5ffb700 1 -- 172.21.15.82:0/1815227085 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+22508 (secure 0 0 0) 0x7fabbc010710 con 0x7fabc8100930 2023-09-23T08:56:26.577 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:56:26.577 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":88,"fsid":"8926e286-59ed-11ee-8db4-212e2dc638e7","created":"2023-09-23T08:46:16.628057+0000","modified":"2023-09-23T08:55:23.423278+0000","last_up_change":"2023-09-23T08:53:56.524694+0000","last_in_change":"2023-09-23T08:53:35.779183+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-23T08:50:00.571063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-23T08:54:50.558630+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-23T08:54:52.055291+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7384c1ff-8c71-4feb-8cef-ba45c2a1708a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":892441948},{"type":"v1","addr":"172.21.15.82:6803","nonce":892441948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":892441948},{"type":"v1","addr":"172.21.15.82:6805","nonce":892441948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":892441948},{"type":"v1","addr":"172.21.15.82:6809","nonce":892441948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":892441948},{"type":"v1","addr":"172.21.15.82:6807","nonce":892441948}]},"public_addr":"172.21.15.82:6803/892441948","cluster_addr":"172.21.15.82:6805/892441948","heartbeat_back_addr":"172.21.15.82:6809/892441948","heartbeat_front_addr":"172.21.15.82:6807/892441948","state":["exists","up"]},{"osd":1,"uuid":"ca62333e-15db-4556-a9ed-8820f9268766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3224546922},{"type":"v1","addr":"172.21.15.135:6801","nonce":3224546922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3224546922},{"type":"v1","addr":"172.21.15.135:6803","nonce":3224546922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3224546922},{"type":"v1","addr":"172.21.15.135:6807","nonce":3224546922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3224546922},{"type":"v1","addr":"172.21.15.135:6805","nonce":3224546922}]},"public_addr":"172.21.15.135:6801/3224546922","cluster_addr":"172.21.15.135:6803/3224546922","heartbeat_back_addr":"172.21.15.135:6807/3224546922","heartbeat_front_addr":"172.21.15.135:6805/3224546922","state":["exists","up"]},{"osd":2,"uuid":"ac23eb38-216a-44f0-b316-a509b23745f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2358373459},{"type":"v1","addr":"172.21.15.161:6801","nonce":2358373459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2358373459},{"type":"v1","addr":"172.21.15.161:6803","nonce":2358373459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2358373459},{"type":"v1","addr":"172.21.15.161:6807","nonce":2358373459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2358373459},{"type":"v1","addr":"172.21.15.161:6805","nonce":2358373459}]},"public_addr":"172.21.15.161:6801/2358373459","cluster_addr":"172.21.15.161:6803/2358373459","heartbeat_back_addr":"172.21.15.161:6807/2358373459","heartbeat_front_addr":"172.21.15.161:6805/2358373459","state":["exists","up"]},{"osd":3,"uuid":"701c96b0-30fb-46ce-917d-e02d3814dc3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":1081464528},{"type":"v1","addr":"172.21.15.82:6811","nonce":1081464528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1081464528},{"type":"v1","addr":"172.21.15.82:6813","nonce":1081464528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1081464528},{"type":"v1","addr":"172.21.15.82:6817","nonce":1081464528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":1081464528},{"type":"v1","addr":"172.21.15.82:6815","nonce":1081464528}]},"public_addr":"172.21.15.82:6811/1081464528","cluster_addr":"172.21.15.82:6813/1081464528","heartbeat_back_addr":"172.21.15.82:6817/1081464528","heartbeat_front_addr":"172.21.15.82:6815/1081464528","state":["exists","up"]},{"osd":4,"uuid":"c618d2a2-3616-41b2-943c-7a4616538e13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2346495509},{"type":"v1","addr":"172.21.15.135:6809","nonce":2346495509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2346495509},{"type":"v1","addr":"172.21.15.135:6811","nonce":2346495509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2346495509},{"type":"v1","addr":"172.21.15.135:6815","nonce":2346495509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2346495509},{"type":"v1","addr":"172.21.15.135:6813","nonce":2346495509}]},"public_addr":"172.21.15.135:6809/2346495509","cluster_addr":"172.21.15.135:6811/2346495509","heartbeat_back_addr":"172.21.15.135:6815/2346495509","heartbeat_front_addr":"172.21.15.135:6813/2346495509","state":["exists","up"]},{"osd":5,"uuid":"8e1dda3d-6927-495d-b20d-78b03bb75d5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1252638628},{"type":"v1","addr":"172.21.15.161:6809","nonce":1252638628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1252638628},{"type":"v1","addr":"172.21.15.161:6811","nonce":1252638628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1252638628},{"type":"v1","addr":"172.21.15.161:6815","nonce":1252638628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1252638628},{"type":"v1","addr":"172.21.15.161:6813","nonce":1252638628}]},"public_addr":"172.21.15.161:6809/1252638628","cluster_addr":"172.21.15.161:6811/1252638628","heartbeat_back_addr":"172.21.15.161:6815/1252638628","heartbeat_front_addr":"172.21.15.161:6813/1252638628","state":["exists","up"]},{"osd":6,"uuid":"50b31960-6bc4-44e1-8116-3106bf161e56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1052038408},{"type":"v1","addr":"172.21.15.82:6819","nonce":1052038408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1052038408},{"type":"v1","addr":"172.21.15.82:6821","nonce":1052038408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":1052038408},{"type":"v1","addr":"172.21.15.82:6825","nonce":1052038408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1052038408},{"type":"v1","addr":"172.21.15.82:6823","nonce":1052038408}]},"public_addr":"172.21.15.82:6819/1052038408","cluster_addr":"172.21.15.82:6821/1052038408","heartbeat_back_addr":"172.21.15.82:6825/1052038408","heartbeat_front_addr":"172.21.15.82:6823/1052038408","state":["exists","up"]},{"osd":7,"uuid":"425ca0ee-57f7-4b27-90fb-d86bb5db5480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3683951498},{"type":"v1","addr":"172.21.15.135:6817","nonce":3683951498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":3683951498},{"type":"v1","addr":"172.21.15.135:6819","nonce":3683951498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":3683951498},{"type":"v1","addr":"172.21.15.135:6823","nonce":3683951498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":3683951498},{"type":"v1","addr":"172.21.15.135:6821","nonce":3683951498}]},"public_addr":"172.21.15.135:6817/3683951498","cluster_addr":"172.21.15.135:6819/3683951498","heartbeat_back_addr":"172.21.15.135:6823/3683951498","heartbeat_front_addr":"172.21.15.135:6821/3683951498","state":["exists","up"]},{"osd":8,"uuid":"1115c837-bef6-4bad-9974-4d913198511b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":948521536},{"type":"v1","addr":"172.21.15.161:6817","nonce":948521536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":948521536},{"type":"v1","addr":"172.21.15.161:6819","nonce":948521536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":948521536},{"type":"v1","addr":"172.21.15.161:6823","nonce":948521536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":948521536},{"type":"v1","addr":"172.21.15.161:6821","nonce":948521536}]},"public_addr":"172.21.15.161:6817/948521536","cluster_addr":"172.21.15.161:6819/948521536","heartbeat_back_addr":"172.21.15.161:6823/948521536","heartbeat_front_addr":"172.21.15.161:6821/948521536","state":["exists","up"]},{"osd":9,"uuid":"c52ec819-4bc6-402f-9cd8-62539e519e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":1438762840},{"type":"v1","addr":"172.21.15.82:6827","nonce":1438762840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":1438762840},{"type":"v1","addr":"172.21.15.82:6829","nonce":1438762840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1438762840},{"type":"v1","addr":"172.21.15.82:6833","nonce":1438762840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1438762840},{"type":"v1","addr":"172.21.15.82:6831","nonce":1438762840}]},"public_addr":"172.21.15.82:6827/1438762840","cluster_addr":"172.21.15.82:6829/1438762840","heartbeat_back_addr":"172.21.15.82:6833/1438762840","heartbeat_front_addr":"172.21.15.82:6831/1438762840","state":["exists","up"]},{"osd":10,"uuid":"1b16c795-1b91-4d46-ae5d-21b8332c1077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2853697851},{"type":"v1","addr":"172.21.15.135:6825","nonce":2853697851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2853697851},{"type":"v1","addr":"172.21.15.135:6827","nonce":2853697851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2853697851},{"type":"v1","addr":"172.21.15.135:6831","nonce":2853697851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2853697851},{"type":"v1","addr":"172.21.15.135:6829","nonce":2853697851}]},"public_addr":"172.21.15.135:6825/2853697851","cluster_addr":"172.21.15.135:6827/2853697851","heartbeat_back_addr":"172.21.15.135:6831/2853697851","heartbeat_front_addr":"172.21.15.135:6829/2853697851","state":["exists","up"]},{"osd":11,"uuid":"2551e602-4fe1-41cb-9b7d-c8b31fdd1487","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":1459332081},{"type":"v1","addr":"172.21.15.161:6825","nonce":1459332081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":1459332081},{"type":"v1","addr":"172.21.15.161:6827","nonce":1459332081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":1459332081},{"type":"v1","addr":"172.21.15.161:6831","nonce":1459332081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":1459332081},{"type":"v1","addr":"172.21.15.161:6829","nonce":1459332081}]},"public_addr":"172.21.15.161:6825/1459332081","cluster_addr":"172.21.15.161:6827/1459332081","heartbeat_back_addr":"172.21.15.161:6831/1459332081","heartbeat_front_addr":"172.21.15.161:6829/1459332081","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:49:04.007679+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:49:30.702365+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:49:56.785248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:50:22.988516+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:50:49.347055+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:51:15.830145+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:51:41.986377+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:52:08.218893+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:52:34.847450+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:53:01.317134+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:53:27.981691+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:53:54.849245+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/4204712132":"2023-09-24T08:47:21.957866+0000","172.21.15.82:6801/2733521564":"2023-09-24T08:47:21.957866+0000","172.21.15.82:6800/2733521564":"2023-09-24T08:47:21.957866+0000","172.21.15.82:0/3964794665":"2023-09-24T08:47:21.957866+0000","172.21.15.82:0/3535372205":"2023-09-24T08:46:55.187024+0000","172.21.15.82:0/285559684":"2023-09-24T08:46:55.187024+0000","172.21.15.82:0/1335891896":"2023-09-24T08:46:55.187024+0000","172.21.15.82:6801/3761509623":"2023-09-24T08:46:55.187024+0000","172.21.15.82:6800/3761509623":"2023-09-24T08:46:55.187024+0000","172.21.15.82:0/3775317005":"2023-09-24T08:47:21.957866+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-23T08:56:26.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.576+0000 7fabcefff700 1 -- 172.21.15.82:0/1815227085 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fabb80a0020 msgr2=0x7fabb80a24e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:26.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.576+0000 7fabcefff700 1 --2- 172.21.15.82:0/1815227085 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fabb80a0020 0x7fabb80a24e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fabb4009b60 tx=0x7fabb4009620 comp rx=0 tx=0).stop 2023-09-23T08:56:26.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.576+0000 7fabcefff700 1 -- 172.21.15.82:0/1815227085 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabc8100930 msgr2=0x7fabc8196630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:26.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.576+0000 7fabcefff700 1 --2- 172.21.15.82:0/1815227085 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabc8100930 0x7fabc8196630 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fabbc00d980 tx=0x7fabbc00dd40 comp rx=0 tx=0).stop 2023-09-23T08:56:26.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.576+0000 7fabcefff700 1 -- 172.21.15.82:0/1815227085 shutdown_connections 2023-09-23T08:56:26.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.576+0000 7fabcefff700 1 --2- 172.21.15.82:0/1815227085 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fabb80a0020 0x7fabb80a24e0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:26.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.576+0000 7fabcefff700 1 --2- 172.21.15.82:0/1815227085 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fabc81024c0 0x7fabc819dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:26.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.576+0000 7fabcefff700 1 --2- 172.21.15.82:0/1815227085 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabc8100930 0x7fabc8196630 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:26.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.577+0000 7fabcefff700 1 --2- 172.21.15.82:0/1815227085 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fabc8101b20 0x7fabc8196b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:26.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.577+0000 7fabcefff700 1 -- 172.21.15.82:0/1815227085 >> 172.21.15.82:0/1815227085 conn(0x7fabc80fbe60 msgr2=0x7fabc8104fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:26.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.577+0000 7fabcefff700 1 -- 172.21.15.82:0/1815227085 shutdown_connections 2023-09-23T08:56:26.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.577+0000 7fabcefff700 1 -- 172.21.15.82:0/1815227085 wait complete. 2023-09-23T08:56:26.599 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2023-09-23T08:54:52.600479+0000', 'modified': '2023-09-23T08:55:00.481507+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24557, 'mds_1': 24550, 'mds_2': 24526, 'mds_3': 24515, 'mds_4': 24514}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14598': {'gid': 14598, 'name': 'e', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.135:6835/3645331700', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6834', 'nonce': 3645331700}, {'type': 'v1', 'addr': '172.21.15.135:6835', 'nonce': 3645331700}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_14658': {'gid': 14658, 'name': 'g', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.82:6839/205725278', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6838', 'nonce': 205725278}, {'type': 'v1', 'addr': '172.21.15.82:6839', 'nonce': 205725278}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_14670': {'gid': 14670, 'name': 'a', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.82:6841/2659297867', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6840', 'nonce': 2659297867}, {'type': 'v1', 'addr': '172.21.15.82:6841', 'nonce': 2659297867}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24461': {'gid': 24461, 'name': 'k', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.135:6833/503886037', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6832', 'nonce': 503886037}, {'type': 'v1', 'addr': '172.21.15.135:6833', 'nonce': 503886037}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24463': {'gid': 24463, 'name': 'l', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.161:6833/471569125', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.161:6832', 'nonce': 471569125}, {'type': 'v1', 'addr': '172.21.15.161:6833', 'nonce': 471569125}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24514': {'gid': 24514, 'name': 'f', 'rank': 4, 'incarnation': 24, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.161:6835/2237964162', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.161:6834', 'nonce': 2237964162}, {'type': 'v1', 'addr': '172.21.15.161:6835', 'nonce': 2237964162}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24515': {'gid': 24515, 'name': 'h', 'rank': 3, 'incarnation': 22, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.135:6837/2655304858', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6836', 'nonce': 2655304858}, {'type': 'v1', 'addr': '172.21.15.135:6837', 'nonce': 2655304858}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24526': {'gid': 24526, 'name': 'c', 'rank': 2, 'incarnation': 20, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.161:6837/43639843', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.161:6836', 'nonce': 43639843}, {'type': 'v1', 'addr': '172.21.15.161:6837', 'nonce': 43639843}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24550': {'gid': 24550, 'name': 'i', 'rank': 1, 'incarnation': 18, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.161:6839/758982817', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.161:6838', 'nonce': 758982817}, {'type': 'v1', 'addr': '172.21.15.161:6839', 'nonce': 758982817}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24557': {'gid': 24557, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.135:6839/2508669274', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6838', 'nonce': 2508669274}, {'type': 'v1', 'addr': '172.21.15.135:6839', 'nonce': 2508669274}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-09-23T08:56:26.600 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2023-09-23T08:56:26.600 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2023-09-23T08:56:26.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.798+0000 7f214b1ff700 1 -- 172.21.15.82:0/3336021680 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21441008d0 msgr2=0x7f2144100cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:26.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.798+0000 7f214b1ff700 1 --2- 172.21.15.82:0/3336021680 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21441008d0 0x7f2144100cf0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f21380099c0 tx=0x7f2138009cd0 comp rx=0 tx=0).stop 2023-09-23T08:56:26.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.798+0000 7f214b1ff700 1 -- 172.21.15.82:0/3336021680 shutdown_connections 2023-09-23T08:56:26.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.798+0000 7f214b1ff700 1 --2- 172.21.15.82:0/3336021680 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2144102460 0x7f2144108d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:26.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.798+0000 7f214b1ff700 1 --2- 172.21.15.82:0/3336021680 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21441008d0 0x7f2144100cf0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:26.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.798+0000 7f214b1ff700 1 --2- 172.21.15.82:0/3336021680 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2144101ac0 0x7f2144101f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:26.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.798+0000 7f214b1ff700 1 -- 172.21.15.82:0/3336021680 >> 172.21.15.82:0/3336021680 conn(0x7f21440fbe40 msgr2=0x7f21440fe280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:26.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.798+0000 7f214b1ff700 1 -- 172.21.15.82:0/3336021680 shutdown_connections 2023-09-23T08:56:26.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.798+0000 7f214b1ff700 1 -- 172.21.15.82:0/3336021680 wait complete. 2023-09-23T08:56:26.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.799+0000 7f214b1ff700 1 Processor -- start 2023-09-23T08:56:26.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.799+0000 7f214b1ff700 1 -- start start 2023-09-23T08:56:26.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.799+0000 7f214b1ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21441008d0 0x7f21441965b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:26.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.800+0000 7f214b1ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2144101ac0 0x7f2144196af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:26.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.800+0000 7f214b1ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2144102460 0x7f214419db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:26.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.800+0000 7f214b1ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f214419e130 con 0x7f21441008d0 2023-09-23T08:56:26.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.800+0000 7f214b1ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f214419e270 con 0x7f2144101ac0 2023-09-23T08:56:26.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.800+0000 7f214b1ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f214419e400 con 0x7f2144102460 2023-09-23T08:56:26.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.800+0000 7f2148f9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21441008d0 0x7f21441965b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:26.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.800+0000 7f2148f9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21441008d0 0x7f21441965b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35098/0 (socket says 172.21.15.82:35098) 2023-09-23T08:56:26.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.800+0000 7f2148f9b700 1 -- 172.21.15.82:0/68582476 learned_addr learned my addr 172.21.15.82:0/68582476 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:26.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.800+0000 7f214979c700 1 --2- 172.21.15.82:0/68582476 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2144102460 0x7f214419db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:26.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.800+0000 7f2143fff700 1 --2- 172.21.15.82:0/68582476 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2144101ac0 0x7f2144196af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:26.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.800+0000 7f2148f9b700 1 -- 172.21.15.82:0/68582476 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2144102460 msgr2=0x7f214419db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:26.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.800+0000 7f2148f9b700 1 --2- 172.21.15.82:0/68582476 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2144102460 0x7f214419db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:26.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.800+0000 7f2148f9b700 1 -- 172.21.15.82:0/68582476 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2144101ac0 msgr2=0x7f2144196af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:26.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.800+0000 7f2148f9b700 1 --2- 172.21.15.82:0/68582476 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2144101ac0 0x7f2144196af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:26.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.800+0000 7f2148f9b700 1 -- 172.21.15.82:0/68582476 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21380095f0 con 0x7f21441008d0 2023-09-23T08:56:26.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.800+0000 7f2143fff700 1 --2- 172.21.15.82:0/68582476 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2144101ac0 0x7f2144196af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T08:56:26.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.800+0000 7f2148f9b700 1 --2- 172.21.15.82:0/68582476 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21441008d0 0x7f21441965b0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f21380098e0 tx=0x7f2138009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:26.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.801+0000 7f2141ffb700 1 -- 172.21.15.82:0/68582476 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f213801d070 con 0x7f21441008d0 2023-09-23T08:56:26.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.801+0000 7f2141ffb700 1 -- 172.21.15.82:0/68582476 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2138004080 con 0x7f21441008d0 2023-09-23T08:56:26.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.801+0000 7f214b1ff700 1 -- 172.21.15.82:0/68582476 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f214419e680 con 0x7f21441008d0 2023-09-23T08:56:26.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.801+0000 7f2141ffb700 1 -- 172.21.15.82:0/68582476 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2138005290 con 0x7f21441008d0 2023-09-23T08:56:26.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.801+0000 7f214b1ff700 1 -- 172.21.15.82:0/68582476 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f214419eb00 con 0x7f21441008d0 2023-09-23T08:56:26.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.804+0000 7f2141ffb700 1 -- 172.21.15.82:0/68582476 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 134671+0+0 (secure 0 0 0) 0x7f2138004810 con 0x7f21441008d0 2023-09-23T08:56:26.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.805+0000 7f215ea59b80 1 Processor -- start 2023-09-23T08:56:26.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.805+0000 7f2141ffb700 1 --2- 172.21.15.82:0/68582476 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f213409ffd0 0x7f21340a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:26.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.806+0000 7f215ea59b80 1 -- start start 2023-09-23T08:56:26.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.806+0000 7f2141ffb700 1 -- 172.21.15.82:0/68582476 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f21380cc110 con 0x7f21441008d0 2023-09-23T08:56:26.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.806+0000 7f214979c700 1 --2- 172.21.15.82:0/68582476 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f213409ffd0 0x7f21340a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:26.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.806+0000 7f215ea59b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f735dfd90 0x561f735e01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:26.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.806+0000 7f215ea59b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561f735e06f0 0x561f735e0b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:26.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.806+0000 7f215ea59b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561f735e1110 0x561f735e1590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:26.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.806+0000 7f215ea59b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f73543760 con 0x561f735e1110 2023-09-23T08:56:26.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.806+0000 7f215ea59b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f73534730 con 0x561f735dfd90 2023-09-23T08:56:26.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.806+0000 7f215ea59b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f73532050 con 0x561f735e06f0 2023-09-23T08:56:26.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.806+0000 7f214979c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561f735e1110 0x561f735e1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:26.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.806+0000 7f2143fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561f735e06f0 0x561f735e0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:26.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.806+0000 7f2148f9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f735dfd90 0x561f735e01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:26.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.806+0000 7f2143fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561f735e06f0 0x561f735e0b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:48122/0 (socket says 172.21.15.82:48122) 2023-09-23T08:56:26.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.806+0000 7f2143fff700 1 -- 172.21.15.82:0/3380376693 learned_addr learned my addr 172.21.15.82:0/3380376693 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:26.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.806+0000 7f214979c700 1 --2- 172.21.15.82:0/68582476 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f213409ffd0 0x7f21340a2490 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f213c003ee0 tx=0x7f213c009ba0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:26.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.807+0000 7f214979c700 1 -- 172.21.15.82:0/3380376693 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561f735e06f0 msgr2=0x561f735e0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:56:26.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.807+0000 7f214979c700 1 --2- 172.21.15.82:0/3380376693 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561f735e06f0 0x561f735e0b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:26.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.807+0000 7f214979c700 1 -- 172.21.15.82:0/3380376693 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f735dfd90 msgr2=0x561f735e01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:56:26.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.807+0000 7f214979c700 1 --2- 172.21.15.82:0/3380376693 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f735dfd90 0x561f735e01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:26.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.807+0000 7f214979c700 1 -- 172.21.15.82:0/3380376693 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561f733ad5e0 con 0x561f735e1110 2023-09-23T08:56:26.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.807+0000 7f214979c700 1 --2- 172.21.15.82:0/3380376693 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561f735e1110 0x561f735e1590 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f213c009fa0 tx=0x7f213c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22e24ee363c99db2 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:26.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.807+0000 7f212effd700 1 -- 172.21.15.82:0/3380376693 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f213c004db0 con 0x561f735e1110 2023-09-23T08:56:26.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.807+0000 7f212effd700 1 -- 172.21.15.82:0/3380376693 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f213c00f040 con 0x561f735e1110 2023-09-23T08:56:26.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.807+0000 7f212effd700 1 -- 172.21.15.82:0/3380376693 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f213c021c60 con 0x561f735e1110 2023-09-23T08:56:26.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.808+0000 7f215ea59b80 1 -- 172.21.15.82:0/3380376693 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561f735e1110 msgr2=0x561f735e1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:26.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.808+0000 7f215ea59b80 1 --2- 172.21.15.82:0/3380376693 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561f735e1110 0x561f735e1590 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f213c009fa0 tx=0x7f213c019000 comp rx=0 tx=0).stop 2023-09-23T08:56:26.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.808+0000 7f215ea59b80 1 -- 172.21.15.82:0/3380376693 shutdown_connections 2023-09-23T08:56:26.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.808+0000 7f215ea59b80 1 --2- 172.21.15.82:0/3380376693 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561f735e1110 0x561f735e1590 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:26.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.808+0000 7f215ea59b80 1 --2- 172.21.15.82:0/3380376693 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f735dfd90 0x561f735e01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:26.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.808+0000 7f215ea59b80 1 --2- 172.21.15.82:0/3380376693 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561f735e06f0 0x561f735e0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:26.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.808+0000 7f215ea59b80 1 -- 172.21.15.82:0/3380376693 >> 172.21.15.82:0/3380376693 conn(0x561f73550090 msgr2=0x561f735d6250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:26.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.808+0000 7f215ea59b80 1 -- 172.21.15.82:0/3380376693 shutdown_connections 2023-09-23T08:56:26.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.808+0000 7f215ea59b80 1 -- 172.21.15.82:0/3380376693 wait complete. 2023-09-23T08:56:26.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.809+0000 7f215ea59b80 1 -- start start 2023-09-23T08:56:26.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.809+0000 7f215ea59b80 1 Processor -- start 2023-09-23T08:56:26.815 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:26 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/1261868590' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-09-23T08:56:26.815 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:26 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/816477408' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T08:56:26.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.809+0000 7f215ea59b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561f735dfd90 0x561f735e9790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:26.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.809+0000 7f215ea59b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f735e06f0 0x561f735e9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:26.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.809+0000 7f215ea59b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561f735e1110 0x561f735f0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:26.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.809+0000 7f215ea59b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f7352d940 con 0x561f735dfd90 2023-09-23T08:56:26.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.809+0000 7f215ea59b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f734cbb60 con 0x561f735e06f0 2023-09-23T08:56:26.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.809+0000 7f215ea59b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f734cb860 con 0x561f735e1110 2023-09-23T08:56:26.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.809+0000 7f215ea59b80 10 client.0 _ll_register_callbacks cb 0x561f73415a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T08:56:26.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.809+0000 7f2148f9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561f735dfd90 0x561f735e9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:26.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.809+0000 7f2148f9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561f735dfd90 0x561f735e9790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35120/0 (socket says 172.21.15.82:35120) 2023-09-23T08:56:26.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.809+0000 7f2148f9b700 1 -- 172.21.15.82:0/4269261825 learned_addr learned my addr 172.21.15.82:0/4269261825 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:26.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.810+0000 7f2143fff700 1 --2- 172.21.15.82:0/4269261825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f735e06f0 0x561f735e9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:26.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.810+0000 7f214979c700 1 --2- 172.21.15.82:0/4269261825 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561f735e1110 0x561f735f0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:26.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.810+0000 7f2148f9b700 1 -- 172.21.15.82:0/4269261825 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561f735e1110 msgr2=0x561f735f0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:56:26.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.810+0000 7f2148f9b700 1 --2- 172.21.15.82:0/4269261825 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561f735e1110 0x561f735f0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:26.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.810+0000 7f2148f9b700 1 -- 172.21.15.82:0/4269261825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f735e06f0 msgr2=0x561f735e9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:56:26.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.810+0000 7f2148f9b700 1 --2- 172.21.15.82:0/4269261825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f735e06f0 0x561f735e9cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:26.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.810+0000 7f2148f9b700 1 -- 172.21.15.82:0/4269261825 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f213c0042a0 con 0x561f735dfd90 2023-09-23T08:56:26.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.810+0000 7f2143fff700 1 --2- 172.21.15.82:0/4269261825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f735e06f0 0x561f735e9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T08:56:26.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.810+0000 7f2148f9b700 1 --2- 172.21.15.82:0/4269261825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561f735dfd90 0x561f735e9790 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f21380960b0 tx=0x7f213809a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97834f017d6501e4 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:26.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.810+0000 7f2123fff700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T08:56:26.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.810+0000 7f2123fff700 1 -- 172.21.15.82:0/4269261825 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21380a16f0 con 0x561f735dfd90 2023-09-23T08:56:26.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.810+0000 7f215ea59b80 1 -- 172.21.15.82:0/4269261825 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561f735ab170 con 0x561f735dfd90 2023-09-23T08:56:26.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.810+0000 7f2123fff700 1 -- 172.21.15.82:0/4269261825 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f2138099c00 con 0x561f735dfd90 2023-09-23T08:56:26.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.810+0000 7f2123fff700 1 -- 172.21.15.82:0/4269261825 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f213809da30 con 0x561f735dfd90 2023-09-23T08:56:26.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.810+0000 7f215ea59b80 10 client.15285 fetch_fsmap learned FSMap version 26 2023-09-23T08:56:26.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.810+0000 7f215ea59b80 1 -- 172.21.15.82:0/4269261825 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x561f73359d90 con 0x561f735dfd90 2023-09-23T08:56:26.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.811+0000 7f2123fff700 1 -- 172.21.15.82:0/4269261825 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x561f735ab170 con 0x561f735dfd90 2023-09-23T08:56:26.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.811+0000 7f2123fff700 1 -- 172.21.15.82:0/4269261825 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f21380053f0 con 0x561f735dfd90 2023-09-23T08:56:26.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.811+0000 7f215ea59b80 10 client.15285 fetch_fsmap finished waiting for FSMap version 26 2023-09-23T08:56:26.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.811+0000 7f215ea59b80 10 client.15285 resolve_mds: resolved name 'f' to daemon mds.f 2023-09-23T08:56:26.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.811+0000 7f215ea59b80 20 client.15285 populate_metadata read hostname 'smithi082' 2023-09-23T08:56:26.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.811+0000 7f215ea59b80 1 --2- 172.21.15.82:0/4269261825 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x561f735f4f50 0x561f735f3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:26.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.811+0000 7f215ea59b80 4 client.15285 mds_command: new command op to 24514 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T08:56:26.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.811+0000 7f215ea59b80 1 -- 172.21.15.82:0/4269261825 --> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561f734d3b50 con 0x561f735f4f50 2023-09-23T08:56:26.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.811+0000 7f2143fff700 1 --2- 172.21.15.82:0/4269261825 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x561f735f4f50 0x561f735f3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:26.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.812+0000 7f2123fff700 10 client.15285 ms_handle_connect on v2:172.21.15.161:6834/2237964162 2023-09-23T08:56:26.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.812+0000 7f2143fff700 1 --2- 172.21.15.82:0/4269261825 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x561f735f4f50 0x561f735f3c40 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=2109ceb8119e8e60 server_cookie=b6f72e40e0216aa8 in_seq=0 out_seq=0 2023-09-23T08:56:26.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.813+0000 7f2123fff700 1 -- 172.21.15.82:0/4269261825 <== mds.4 v2:172.21.15.161:6834/2237964162 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x561f734d3b50 con 0x561f735f4f50 2023-09-23T08:56:26.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.813+0000 7f2123fff700 10 client.15285 handle_command_reply: tid=0 2023-09-23T08:56:26.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.813+0000 7f215ea59b80 1 client.15285 shutdown 2023-09-23T08:56:26.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.813+0000 7f215ea59b80 1 -- 172.21.15.82:0/4269261825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561f735dfd90 msgr2=0x561f735e9790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:26.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.813+0000 7f215ea59b80 1 --2- 172.21.15.82:0/4269261825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561f735dfd90 0x561f735e9790 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f21380960b0 tx=0x7f213809a140 comp rx=0 tx=0).stop 2023-09-23T08:56:26.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.813+0000 7f215ea59b80 1 -- 172.21.15.82:0/4269261825 shutdown_connections 2023-09-23T08:56:26.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.813+0000 7f215ea59b80 1 --2- 172.21.15.82:0/4269261825 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x561f735f4f50 0x561f735f3c40 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:26.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.813+0000 7f215ea59b80 1 --2- 172.21.15.82:0/4269261825 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561f735e1110 0x561f735f0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:26.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.813+0000 7f215ea59b80 1 --2- 172.21.15.82:0/4269261825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561f735dfd90 0x561f735e9790 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:26.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.813+0000 7f2123fff700 0 client.15285 ms_handle_reset on v2:172.21.15.161:6834/2237964162 2023-09-23T08:56:26.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.813+0000 7f215ea59b80 1 --2- 172.21.15.82:0/4269261825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f735e06f0 0x561f735e9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:26.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.813+0000 7f215ea59b80 1 -- 172.21.15.82:0/4269261825 >> 172.21.15.82:0/4269261825 conn(0x561f73550090 msgr2=0x561f735d0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:26.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.813+0000 7f215ea59b80 1 -- 172.21.15.82:0/4269261825 shutdown_connections 2023-09-23T08:56:26.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.813+0000 7f215ea59b80 1 -- 172.21.15.82:0/4269261825 wait complete. 2023-09-23T08:56:26.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.813+0000 7f215ea59b80 20 client.15285 trim_cache size 0 max 16384 2023-09-23T08:56:26.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.832+0000 7f215ea59b80 1 Processor -- start 2023-09-23T08:56:26.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.832+0000 7f215ea59b80 1 -- start start 2023-09-23T08:56:26.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.832+0000 7f215ea59b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f735dfd90 0x561f735e0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:26.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.832+0000 7f215ea59b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561f735e06f0 0x561f735f0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:26.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.832+0000 7f215ea59b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561f735e1110 0x561f735d61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:26.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.832+0000 7f215ea59b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f733af8d0 con 0x561f735e06f0 2023-09-23T08:56:26.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.832+0000 7f215ea59b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f735ea980 con 0x561f735dfd90 2023-09-23T08:56:26.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.832+0000 7f215ea59b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f735d27e0 con 0x561f735e1110 2023-09-23T08:56:26.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.832+0000 7f2143fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561f735e06f0 0x561f735f0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:26.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.832+0000 7f2143fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561f735e06f0 0x561f735f0cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35132/0 (socket says 172.21.15.82:35132) 2023-09-23T08:56:26.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.832+0000 7f2143fff700 1 -- 172.21.15.82:0/3274576071 learned_addr learned my addr 172.21.15.82:0/3274576071 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:26.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.832+0000 7f214979c700 1 --2- 172.21.15.82:0/3274576071 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561f735e1110 0x561f735d61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:26.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.832+0000 7f2148f9b700 1 --2- 172.21.15.82:0/3274576071 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f735dfd90 0x561f735e0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:26.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.832+0000 7f2143fff700 1 -- 172.21.15.82:0/3274576071 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561f735e1110 msgr2=0x561f735d61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:56:26.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.832+0000 7f2143fff700 1 --2- 172.21.15.82:0/3274576071 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561f735e1110 0x561f735d61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:26.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.832+0000 7f2143fff700 1 -- 172.21.15.82:0/3274576071 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f735dfd90 msgr2=0x561f735e0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:56:26.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.832+0000 7f2143fff700 1 --2- 172.21.15.82:0/3274576071 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f735dfd90 0x561f735e0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:26.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.832+0000 7f2143fff700 1 -- 172.21.15.82:0/3274576071 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561f73342c10 con 0x561f735e06f0 2023-09-23T08:56:26.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.833+0000 7f2143fff700 1 --2- 172.21.15.82:0/3274576071 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561f735e06f0 0x561f735f0cd0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x561f735f5c80 tx=0x7f213000bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7ea518c31799405 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:26.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.833+0000 7f212f7fe700 1 -- 172.21.15.82:0/3274576071 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2130017040 con 0x561f735e06f0 2023-09-23T08:56:26.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.833+0000 7f212f7fe700 1 -- 172.21.15.82:0/3274576071 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2130003ef0 con 0x561f735e06f0 2023-09-23T08:56:26.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.833+0000 7f212f7fe700 1 -- 172.21.15.82:0/3274576071 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2130011840 con 0x561f735e06f0 2023-09-23T08:56:26.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.834+0000 7f215ea59b80 1 -- 172.21.15.82:0/3274576071 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561f735e06f0 msgr2=0x561f735f0cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:26.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.834+0000 7f215ea59b80 1 --2- 172.21.15.82:0/3274576071 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561f735e06f0 0x561f735f0cd0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x561f735f5c80 tx=0x7f213000bf40 comp rx=0 tx=0).stop 2023-09-23T08:56:26.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.834+0000 7f215ea59b80 1 -- 172.21.15.82:0/3274576071 shutdown_connections 2023-09-23T08:56:26.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.834+0000 7f215ea59b80 1 --2- 172.21.15.82:0/3274576071 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561f735e1110 0x561f735d61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:26.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.834+0000 7f215ea59b80 1 --2- 172.21.15.82:0/3274576071 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f735dfd90 0x561f735e0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:26.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.834+0000 7f215ea59b80 1 --2- 172.21.15.82:0/3274576071 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561f735e06f0 0x561f735f0cd0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:26.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.834+0000 7f215ea59b80 1 -- 172.21.15.82:0/3274576071 >> 172.21.15.82:0/3274576071 conn(0x561f73550090 msgr2=0x561f735e84d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:26.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.834+0000 7f215ea59b80 1 -- 172.21.15.82:0/3274576071 shutdown_connections 2023-09-23T08:56:26.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.834+0000 7f215ea59b80 1 -- 172.21.15.82:0/3274576071 wait complete. 2023-09-23T08:56:26.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.834+0000 7f215ea59b80 1 -- start start 2023-09-23T08:56:26.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.834+0000 7f215ea59b80 1 Processor -- start 2023-09-23T08:56:26.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.835+0000 7f215ea59b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561f735dfd90 0x561f735d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:26.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.835+0000 7f215ea59b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561f735e06f0 0x561f735efc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:26.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.835+0000 7f215ea59b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f735e1110 0x561f735f01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:26.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.835+0000 7f215ea59b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f735f0860 con 0x561f735e06f0 2023-09-23T08:56:26.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.835+0000 7f215ea59b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f735f09d0 con 0x561f735e1110 2023-09-23T08:56:26.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.835+0000 7f215ea59b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f735f0b90 con 0x561f735dfd90 2023-09-23T08:56:26.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.835+0000 7f215ea59b80 10 client.0 _ll_register_callbacks cb 0x7f2138099740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T08:56:26.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.835+0000 7f2143fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561f735e06f0 0x561f735efc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:26.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.835+0000 7f2143fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561f735e06f0 0x561f735efc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35146/0 (socket says 172.21.15.82:35146) 2023-09-23T08:56:26.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.835+0000 7f2143fff700 1 -- 172.21.15.82:0/4060598976 learned_addr learned my addr 172.21.15.82:0/4060598976 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:26.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.835+0000 7f2148f9b700 1 --2- 172.21.15.82:0/4060598976 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561f735dfd90 0x561f735d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:26.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.835+0000 7f214979c700 1 --2- 172.21.15.82:0/4060598976 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f735e1110 0x561f735f01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:26.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.835+0000 7f2143fff700 1 -- 172.21.15.82:0/4060598976 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561f735dfd90 msgr2=0x561f735d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:56:26.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.835+0000 7f2143fff700 1 --2- 172.21.15.82:0/4060598976 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561f735dfd90 0x561f735d0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:26.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.835+0000 7f2143fff700 1 -- 172.21.15.82:0/4060598976 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f735e1110 msgr2=0x561f735f01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:56:26.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.835+0000 7f2143fff700 1 --2- 172.21.15.82:0/4060598976 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f735e1110 0x561f735f01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:26.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.835+0000 7f2143fff700 1 -- 172.21.15.82:0/4060598976 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f213000b940 con 0x561f735e06f0 2023-09-23T08:56:26.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.835+0000 7f214979c700 1 --2- 172.21.15.82:0/4060598976 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f735e1110 0x561f735f01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T08:56:26.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.836+0000 7f2143fff700 1 --2- 172.21.15.82:0/4060598976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561f735e06f0 0x561f735efc70 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f21300045a0 tx=0x7f213001c5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69b129cc359b2da0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:26.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.836+0000 7f2123fff700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T08:56:26.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.836+0000 7f2123fff700 1 -- 172.21.15.82:0/4060598976 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2130017070 con 0x561f735e06f0 2023-09-23T08:56:26.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.836+0000 7f215ea59b80 1 -- 172.21.15.82:0/4060598976 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561f735ce860 con 0x561f735e06f0 2023-09-23T08:56:26.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.836+0000 7f2123fff700 1 -- 172.21.15.82:0/4060598976 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f213001cb00 con 0x561f735e06f0 2023-09-23T08:56:26.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.836+0000 7f2123fff700 1 -- 172.21.15.82:0/4060598976 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2130005040 con 0x561f735e06f0 2023-09-23T08:56:26.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.836+0000 7f215ea59b80 10 client.15291 fetch_fsmap learned FSMap version 26 2023-09-23T08:56:26.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.836+0000 7f215ea59b80 1 -- 172.21.15.82:0/4060598976 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x561f73380200 con 0x561f735e06f0 2023-09-23T08:56:26.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.836+0000 7f2123fff700 1 -- 172.21.15.82:0/4060598976 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x561f735ce860 con 0x561f735e06f0 2023-09-23T08:56:26.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.836+0000 7f2123fff700 1 -- 172.21.15.82:0/4060598976 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f2130037070 con 0x561f735e06f0 2023-09-23T08:56:26.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.837+0000 7f215ea59b80 10 client.15291 fetch_fsmap finished waiting for FSMap version 26 2023-09-23T08:56:26.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.837+0000 7f215ea59b80 10 client.15291 resolve_mds: resolved name 'f' to daemon mds.f 2023-09-23T08:56:26.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.837+0000 7f215ea59b80 20 client.15291 populate_metadata read hostname 'smithi082' 2023-09-23T08:56:26.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.837+0000 7f215ea59b80 1 --2- 172.21.15.82:0/4060598976 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x561f7364d4c0 0x561f73649900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:26.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.837+0000 7f215ea59b80 4 client.15291 mds_command: new command op to 24514 tid=0[{"prefix": "status"}] 2023-09-23T08:56:26.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.837+0000 7f215ea59b80 1 -- 172.21.15.82:0/4060598976 --> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] -- command(tid 0: {"prefix": "status"}) v1 -- 0x561f73526920 con 0x561f7364d4c0 2023-09-23T08:56:26.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.837+0000 7f2148f9b700 1 --2- 172.21.15.82:0/4060598976 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x561f7364d4c0 0x561f73649900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:26.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.837+0000 7f2148f9b700 1 --2- 172.21.15.82:0/4060598976 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x561f7364d4c0 0x561f73649900 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=772ad44ddd070b07 server_cookie=682f83a4ee1b2fcf in_seq=0 out_seq=0 2023-09-23T08:56:26.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.837+0000 7f2123fff700 10 client.15291 ms_handle_connect on v2:172.21.15.161:6834/2237964162 2023-09-23T08:56:26.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.838+0000 7f2123fff700 1 -- 172.21.15.82:0/4060598976 <== mds.4 v2:172.21.15.161:6834/2237964162 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x561f73526920 con 0x561f7364d4c0 2023-09-23T08:56:26.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.838+0000 7f2123fff700 10 client.15291 handle_command_reply: tid=0 2023-09-23T08:56:26.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.838+0000 7f215ea59b80 1 client.15291 shutdown 2023-09-23T08:56:26.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.838+0000 7f215ea59b80 1 -- 172.21.15.82:0/4060598976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561f735e06f0 msgr2=0x561f735efc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:26.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.838+0000 7f215ea59b80 1 --2- 172.21.15.82:0/4060598976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561f735e06f0 0x561f735efc70 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f21300045a0 tx=0x7f213001c5b0 comp rx=0 tx=0).stop 2023-09-23T08:56:26.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.838+0000 7f215ea59b80 1 -- 172.21.15.82:0/4060598976 shutdown_connections 2023-09-23T08:56:26.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.838+0000 7f215ea59b80 1 --2- 172.21.15.82:0/4060598976 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x561f7364d4c0 0x561f73649900 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:26.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.838+0000 7f215ea59b80 1 --2- 172.21.15.82:0/4060598976 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f735e1110 0x561f735f01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:26.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.838+0000 7f215ea59b80 1 --2- 172.21.15.82:0/4060598976 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561f735dfd90 0x561f735d0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:26.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.838+0000 7f2123fff700 0 client.15291 ms_handle_reset on v2:172.21.15.161:6834/2237964162 2023-09-23T08:56:26.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.838+0000 7f215ea59b80 1 --2- 172.21.15.82:0/4060598976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561f735e06f0 0x561f735efc70 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:26.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.838+0000 7f215ea59b80 1 -- 172.21.15.82:0/4060598976 >> 172.21.15.82:0/4060598976 conn(0x561f73550090 msgr2=0x561f735d61e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:26.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.838+0000 7f215ea59b80 1 -- 172.21.15.82:0/4060598976 shutdown_connections 2023-09-23T08:56:26.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.838+0000 7f215ea59b80 1 -- 172.21.15.82:0/4060598976 wait complete. 2023-09-23T08:56:26.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.838+0000 7f215ea59b80 20 client.15291 trim_cache size 0 max 16384 2023-09-23T08:56:26.847 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T08:56:26.847 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "8926e286-59ed-11ee-8db4-212e2dc638e7", 2023-09-23T08:56:26.847 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 4, 2023-09-23T08:56:26.848 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 24514, 2023-09-23T08:56:26.848 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2023-09-23T08:56:26.848 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2023-09-23T08:56:26.848 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2023-09-23T08:56:26.848 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 87.380275326000003, 2023-09-23T08:56:26.848 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 26, 2023-09-23T08:56:26.848 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 88, 2023-09-23T08:56:26.848 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 86, 2023-09-23T08:56:26.848 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 119.925296706 2023-09-23T08:56:26.848 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T08:56:26.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.839+0000 7f214b1ff700 1 -- 172.21.15.82:0/68582476 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f213409ffd0 msgr2=0x7f21340a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:26.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.839+0000 7f214b1ff700 1 --2- 172.21.15.82:0/68582476 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f213409ffd0 0x7f21340a2490 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f213c003ee0 tx=0x7f213c009ba0 comp rx=0 tx=0).stop 2023-09-23T08:56:26.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.839+0000 7f214b1ff700 1 -- 172.21.15.82:0/68582476 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21441008d0 msgr2=0x7f21441965b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:26.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.839+0000 7f214b1ff700 1 --2- 172.21.15.82:0/68582476 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21441008d0 0x7f21441965b0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f21380098e0 tx=0x7f2138009580 comp rx=0 tx=0).stop 2023-09-23T08:56:26.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.839+0000 7f214b1ff700 1 -- 172.21.15.82:0/68582476 shutdown_connections 2023-09-23T08:56:26.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.839+0000 7f214b1ff700 1 --2- 172.21.15.82:0/68582476 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f213409ffd0 0x7f21340a2490 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:26.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.839+0000 7f214b1ff700 1 --2- 172.21.15.82:0/68582476 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2144102460 0x7f214419db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:26.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.839+0000 7f214b1ff700 1 --2- 172.21.15.82:0/68582476 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21441008d0 0x7f21441965b0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:26.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.839+0000 7f214b1ff700 1 --2- 172.21.15.82:0/68582476 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2144101ac0 0x7f2144196af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:26.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.839+0000 7f214b1ff700 1 -- 172.21.15.82:0/68582476 >> 172.21.15.82:0/68582476 conn(0x7f21440fbe40 msgr2=0x7f21440fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:26.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.839+0000 7f214b1ff700 1 -- 172.21.15.82:0/68582476 shutdown_connections 2023-09-23T08:56:26.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:26.839+0000 7f214b1ff700 1 -- 172.21.15.82:0/68582476 wait complete. 2023-09-23T08:56:26.857 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:26 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/1261868590' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-09-23T08:56:26.857 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:26 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/816477408' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T08:56:26.859 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.h status 2023-09-23T08:56:26.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:26 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/1261868590' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-09-23T08:56:26.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:26 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/816477408' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T08:56:27.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.053+0000 7f38fdbff700 1 -- 172.21.15.82:0/2155866360 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38f8074960 msgr2=0x7f38f8072db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:27.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.053+0000 7f38fdbff700 1 --2- 172.21.15.82:0/2155866360 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38f8074960 0x7f38f8072db0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f38e8009990 tx=0x7f38e8009ca0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.053+0000 7f38fdbff700 1 -- 172.21.15.82:0/2155866360 shutdown_connections 2023-09-23T08:56:27.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.053+0000 7f38fdbff700 1 --2- 172.21.15.82:0/2155866360 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38f810cf00 0x7f38f810f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.053+0000 7f38fdbff700 1 --2- 172.21.15.82:0/2155866360 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38f8074960 0x7f38f8072db0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.053+0000 7f38fdbff700 1 --2- 172.21.15.82:0/2155866360 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f38f8073380 0x7f38f8073800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.053+0000 7f38fdbff700 1 -- 172.21.15.82:0/2155866360 >> 172.21.15.82:0/2155866360 conn(0x7f38f80fbea0 msgr2=0x7f38f80fe2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:27.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.053+0000 7f38fdbff700 1 -- 172.21.15.82:0/2155866360 shutdown_connections 2023-09-23T08:56:27.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.053+0000 7f38fdbff700 1 -- 172.21.15.82:0/2155866360 wait complete. 2023-09-23T08:56:27.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.054+0000 7f38fdbff700 1 Processor -- start 2023-09-23T08:56:27.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.054+0000 7f38fdbff700 1 -- start start 2023-09-23T08:56:27.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.055+0000 7f38fdbff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f38f8073380 0x7f38f819cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:27.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.055+0000 7f38fdbff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38f8074960 0x7f38f819d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:27.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.055+0000 7f38fdbff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38f810cf00 0x7f38f81a4130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:27.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.055+0000 7f38fdbff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38f81a4700 con 0x7f38f810cf00 2023-09-23T08:56:27.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.055+0000 7f38fdbff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38f81a4840 con 0x7f38f8074960 2023-09-23T08:56:27.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.055+0000 7f38fdbff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38f81a49d0 con 0x7f38f8073380 2023-09-23T08:56:27.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.055+0000 7f38f7fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38f810cf00 0x7f38f81a4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:27.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.055+0000 7f38f7fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38f810cf00 0x7f38f81a4130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35160/0 (socket says 172.21.15.82:35160) 2023-09-23T08:56:27.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.055+0000 7f38f7fff700 1 -- 172.21.15.82:0/4249352561 learned_addr learned my addr 172.21.15.82:0/4249352561 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:27.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.055+0000 7f38f6ffd700 1 --2- 172.21.15.82:0/4249352561 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38f8074960 0x7f38f819d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:27.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.055+0000 7f38f7fff700 1 -- 172.21.15.82:0/4249352561 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f38f8073380 msgr2=0x7f38f819cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:27.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.055+0000 7f38f7fff700 1 --2- 172.21.15.82:0/4249352561 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f38f8073380 0x7f38f819cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.055+0000 7f38f7fff700 1 -- 172.21.15.82:0/4249352561 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38f8074960 msgr2=0x7f38f819d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:27.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.055+0000 7f38f7fff700 1 --2- 172.21.15.82:0/4249352561 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38f8074960 0x7f38f819d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.055+0000 7f38f7fff700 1 -- 172.21.15.82:0/4249352561 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38e80095f0 con 0x7f38f810cf00 2023-09-23T08:56:27.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.056+0000 7f38f7fff700 1 --2- 172.21.15.82:0/4249352561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38f810cf00 0x7f38f81a4130 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f38f000ef30 tx=0x7f38f000c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:27.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.056+0000 7f38f4ff9700 1 -- 172.21.15.82:0/4249352561 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f0018070 con 0x7f38f810cf00 2023-09-23T08:56:27.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.056+0000 7f38f4ff9700 1 -- 172.21.15.82:0/4249352561 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f38f000f040 con 0x7f38f810cf00 2023-09-23T08:56:27.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.056+0000 7f38fdbff700 1 -- 172.21.15.82:0/4249352561 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38f81a4c50 con 0x7f38f810cf00 2023-09-23T08:56:27.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.056+0000 7f38f4ff9700 1 -- 172.21.15.82:0/4249352561 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f0003d00 con 0x7f38f810cf00 2023-09-23T08:56:27.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.056+0000 7f38fdbff700 1 -- 172.21.15.82:0/4249352561 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38f81a5160 con 0x7f38f810cf00 2023-09-23T08:56:27.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.060+0000 7f38f4ff9700 1 -- 172.21.15.82:0/4249352561 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 134671+0+0 (secure 0 0 0) 0x7f38f000caa0 con 0x7f38f810cf00 2023-09-23T08:56:27.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.061+0000 7f391152bb80 1 Processor -- start 2023-09-23T08:56:27.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.061+0000 7f391152bb80 1 -- start start 2023-09-23T08:56:27.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.062+0000 7f391152bb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55dfe1202980 0x55dfe1202da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:27.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.062+0000 7f391152bb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dfe12032e0 0x55dfe1203720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:27.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.062+0000 7f391152bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfe1203d00 0x55dfe1204180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:27.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.062+0000 7f391152bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfe116a760 con 0x55dfe1203d00 2023-09-23T08:56:27.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.062+0000 7f391152bb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfe115b730 con 0x55dfe12032e0 2023-09-23T08:56:27.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.062+0000 7f391152bb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfe1159050 con 0x55dfe1202980 2023-09-23T08:56:27.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.062+0000 7f38f4ff9700 1 --2- 172.21.15.82:0/4249352561 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f38e009ffd0 0x7f38e00a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:27.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.062+0000 7f38f6ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfe1203d00 0x55dfe1204180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:27.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.062+0000 7f38f6ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfe1203d00 0x55dfe1204180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35168/0 (socket says 172.21.15.82:35168) 2023-09-23T08:56:27.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.062+0000 7f38f6ffd700 1 -- 172.21.15.82:0/2865544490 learned_addr learned my addr 172.21.15.82:0/2865544490 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:27.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.062+0000 7f38f6ffd700 1 --2- 172.21.15.82:0/2865544490 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55dfe1202980 0x55dfe1202da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:27.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.062+0000 7f38f7fff700 1 --2- 172.21.15.82:0/4249352561 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f38e009ffd0 0x7f38e00a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:27.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.062+0000 7f38f77fe700 1 --2- 172.21.15.82:0/2865544490 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dfe12032e0 0x55dfe1203720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:27.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.062+0000 7f38f4ff9700 1 -- 172.21.15.82:0/4249352561 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f38f00caf20 con 0x7f38f810cf00 2023-09-23T08:56:27.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.063+0000 7f38f6ffd700 1 -- 172.21.15.82:0/2865544490 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55dfe1202980 msgr2=0x55dfe1202da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:56:27.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.063+0000 7f38f6ffd700 1 --2- 172.21.15.82:0/2865544490 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55dfe1202980 0x55dfe1202da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.063+0000 7f38f6ffd700 1 -- 172.21.15.82:0/2865544490 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dfe12032e0 msgr2=0x55dfe1203720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:56:27.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.063+0000 7f38f6ffd700 1 --2- 172.21.15.82:0/2865544490 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dfe12032e0 0x55dfe1203720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.063+0000 7f38f6ffd700 1 -- 172.21.15.82:0/2865544490 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dfe0fd45e0 con 0x55dfe1203d00 2023-09-23T08:56:27.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.063+0000 7f38f77fe700 1 --2- 172.21.15.82:0/2865544490 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dfe12032e0 0x55dfe1203720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T08:56:27.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.063+0000 7f38f6ffd700 1 --2- 172.21.15.82:0/2865544490 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfe1203d00 0x55dfe1204180 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f38ec0094f0 tx=0x7f38ec0096e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a748aaa68a574069 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:27.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.063+0000 7f38f7fff700 1 --2- 172.21.15.82:0/4249352561 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f38e009ffd0 0x7f38e00a2490 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f38f00c89d0 tx=0x7f38f0021000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:27.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.063+0000 7f38ddffb700 1 -- 172.21.15.82:0/2865544490 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38ec014310 con 0x55dfe1203d00 2023-09-23T08:56:27.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.063+0000 7f38ddffb700 1 -- 172.21.15.82:0/2865544490 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f38ec01a020 con 0x55dfe1203d00 2023-09-23T08:56:27.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.063+0000 7f38ddffb700 1 -- 172.21.15.82:0/2865544490 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38ec003c80 con 0x55dfe1203d00 2023-09-23T08:56:27.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.064+0000 7f391152bb80 1 -- 172.21.15.82:0/2865544490 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfe1203d00 msgr2=0x55dfe1204180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:27.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.064+0000 7f391152bb80 1 --2- 172.21.15.82:0/2865544490 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfe1203d00 0x55dfe1204180 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f38ec0094f0 tx=0x7f38ec0096e0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.064+0000 7f391152bb80 1 -- 172.21.15.82:0/2865544490 shutdown_connections 2023-09-23T08:56:27.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.064+0000 7f391152bb80 1 --2- 172.21.15.82:0/2865544490 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfe1203d00 0x55dfe1204180 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.064+0000 7f391152bb80 1 --2- 172.21.15.82:0/2865544490 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55dfe1202980 0x55dfe1202da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.064+0000 7f391152bb80 1 --2- 172.21.15.82:0/2865544490 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dfe12032e0 0x55dfe1203720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.064+0000 7f391152bb80 1 -- 172.21.15.82:0/2865544490 >> 172.21.15.82:0/2865544490 conn(0x55dfe1177090 msgr2=0x55dfe11fd250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:27.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.064+0000 7f391152bb80 1 -- 172.21.15.82:0/2865544490 shutdown_connections 2023-09-23T08:56:27.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.064+0000 7f391152bb80 1 -- 172.21.15.82:0/2865544490 wait complete. 2023-09-23T08:56:27.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.065+0000 7f391152bb80 1 -- start start 2023-09-23T08:56:27.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.065+0000 7f391152bb80 1 Processor -- start 2023-09-23T08:56:27.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.066+0000 7f391152bb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dfe1202980 0x55dfe120c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:27.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.066+0000 7f391152bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfe12032e0 0x55dfe120c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:27.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.066+0000 7f391152bb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55dfe1203d00 0x55dfe1213970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:27.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.066+0000 7f391152bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfe1154940 con 0x55dfe12032e0 2023-09-23T08:56:27.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.066+0000 7f391152bb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfe10f2b60 con 0x55dfe1202980 2023-09-23T08:56:27.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.066+0000 7f391152bb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfe10f2860 con 0x55dfe1203d00 2023-09-23T08:56:27.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.066+0000 7f391152bb80 10 client.0 _ll_register_callbacks cb 0x55dfe103ca30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T08:56:27.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.066+0000 7f38f77fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfe12032e0 0x55dfe120c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:27.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.066+0000 7f38f77fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfe12032e0 0x55dfe120c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35172/0 (socket says 172.21.15.82:35172) 2023-09-23T08:56:27.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.066+0000 7f38f77fe700 1 -- 172.21.15.82:0/112050678 learned_addr learned my addr 172.21.15.82:0/112050678 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:27.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.066+0000 7f38f6ffd700 1 --2- 172.21.15.82:0/112050678 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55dfe1203d00 0x55dfe1213970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:27.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.066+0000 7f38f6ffd700 1 --2- 172.21.15.82:0/112050678 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dfe1202980 0x55dfe120c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:27.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.066+0000 7f38f77fe700 1 -- 172.21.15.82:0/112050678 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55dfe1203d00 msgr2=0x55dfe1213970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:56:27.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.066+0000 7f38f77fe700 1 --2- 172.21.15.82:0/112050678 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55dfe1203d00 0x55dfe1213970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.066+0000 7f38f77fe700 1 -- 172.21.15.82:0/112050678 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dfe1202980 msgr2=0x55dfe120c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:56:27.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.066+0000 7f38f77fe700 1 --2- 172.21.15.82:0/112050678 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dfe1202980 0x55dfe120c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.066+0000 7f38f77fe700 1 -- 172.21.15.82:0/112050678 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38ec014600 con 0x55dfe12032e0 2023-09-23T08:56:27.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.067+0000 7f38f77fe700 1 --2- 172.21.15.82:0/112050678 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfe12032e0 0x55dfe120c930 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f38e800b2e0 tx=0x7f38e8005320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f0ade2e88d6a815 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:27.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.067+0000 7f38d6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T08:56:27.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.067+0000 7f38d6ffd700 1 -- 172.21.15.82:0/112050678 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e8003a90 con 0x55dfe12032e0 2023-09-23T08:56:27.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.067+0000 7f391152bb80 1 -- 172.21.15.82:0/112050678 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dfe11d2170 con 0x55dfe12032e0 2023-09-23T08:56:27.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.067+0000 7f38d6ffd700 1 -- 172.21.15.82:0/112050678 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f38e8003bf0 con 0x55dfe12032e0 2023-09-23T08:56:27.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.067+0000 7f38d6ffd700 1 -- 172.21.15.82:0/112050678 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f38e800b710 con 0x55dfe12032e0 2023-09-23T08:56:27.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.067+0000 7f391152bb80 10 client.15303 fetch_fsmap learned FSMap version 26 2023-09-23T08:56:27.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.067+0000 7f391152bb80 1 -- 172.21.15.82:0/112050678 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55dfe0f80d90 con 0x55dfe12032e0 2023-09-23T08:56:27.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.067+0000 7f38d6ffd700 1 -- 172.21.15.82:0/112050678 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55dfe11d2170 con 0x55dfe12032e0 2023-09-23T08:56:27.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.067+0000 7f38d6ffd700 1 -- 172.21.15.82:0/112050678 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f38e8004a30 con 0x55dfe12032e0 2023-09-23T08:56:27.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.068+0000 7f391152bb80 10 client.15303 fetch_fsmap finished waiting for FSMap version 26 2023-09-23T08:56:27.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.068+0000 7f391152bb80 10 client.15303 resolve_mds: resolved name 'h' to daemon mds.h 2023-09-23T08:56:27.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.068+0000 7f391152bb80 20 client.15303 populate_metadata read hostname 'smithi082' 2023-09-23T08:56:27.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.068+0000 7f391152bb80 1 --2- 172.21.15.82:0/112050678 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x55dfe1217fa0 0x55dfe1216ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:27.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.068+0000 7f391152bb80 4 client.15303 mds_command: new command op to 24515 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T08:56:27.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.068+0000 7f391152bb80 1 -- 172.21.15.82:0/112050678 --> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55dfe10fab50 con 0x55dfe1217fa0 2023-09-23T08:56:27.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.068+0000 7f38f6ffd700 1 --2- 172.21.15.82:0/112050678 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x55dfe1217fa0 0x55dfe1216ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:27.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.069+0000 7f38d6ffd700 10 client.15303 ms_handle_connect on v2:172.21.15.135:6836/2655304858 2023-09-23T08:56:27.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.069+0000 7f38f6ffd700 1 --2- 172.21.15.82:0/112050678 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x55dfe1217fa0 0x55dfe1216ac0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=8d8b444c2e36feb3 server_cookie=3e5bd9f9071871e3 in_seq=0 out_seq=0 2023-09-23T08:56:27.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.069+0000 7f38d6ffd700 1 -- 172.21.15.82:0/112050678 <== mds.3 v2:172.21.15.135:6836/2655304858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55dfe10fab50 con 0x55dfe1217fa0 2023-09-23T08:56:27.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.069+0000 7f38d6ffd700 10 client.15303 handle_command_reply: tid=0 2023-09-23T08:56:27.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.069+0000 7f391152bb80 1 client.15303 shutdown 2023-09-23T08:56:27.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.070+0000 7f391152bb80 1 -- 172.21.15.82:0/112050678 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfe12032e0 msgr2=0x55dfe120c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:27.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.070+0000 7f391152bb80 1 --2- 172.21.15.82:0/112050678 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfe12032e0 0x55dfe120c930 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f38e800b2e0 tx=0x7f38e8005320 comp rx=0 tx=0).stop 2023-09-23T08:56:27.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.070+0000 7f391152bb80 1 -- 172.21.15.82:0/112050678 shutdown_connections 2023-09-23T08:56:27.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.070+0000 7f391152bb80 1 --2- 172.21.15.82:0/112050678 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x55dfe1217fa0 0x55dfe1216ac0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.070+0000 7f391152bb80 1 --2- 172.21.15.82:0/112050678 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55dfe1203d00 0x55dfe1213970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.070+0000 7f391152bb80 1 --2- 172.21.15.82:0/112050678 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dfe1202980 0x55dfe120c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.070+0000 7f391152bb80 1 --2- 172.21.15.82:0/112050678 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfe12032e0 0x55dfe120c930 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.070+0000 7f38d6ffd700 0 client.15303 ms_handle_reset on v2:172.21.15.135:6836/2655304858 2023-09-23T08:56:27.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.070+0000 7f391152bb80 1 -- 172.21.15.82:0/112050678 >> 172.21.15.82:0/112050678 conn(0x55dfe1177090 msgr2=0x55dfe11f7af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:27.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.070+0000 7f391152bb80 1 -- 172.21.15.82:0/112050678 shutdown_connections 2023-09-23T08:56:27.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.070+0000 7f391152bb80 1 -- 172.21.15.82:0/112050678 wait complete. 2023-09-23T08:56:27.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.070+0000 7f391152bb80 20 client.15303 trim_cache size 0 max 16384 2023-09-23T08:56:27.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.088+0000 7f391152bb80 1 Processor -- start 2023-09-23T08:56:27.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.088+0000 7f391152bb80 1 -- start start 2023-09-23T08:56:27.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.088+0000 7f391152bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfe1202980 0x55dfe120b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:27.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.088+0000 7f391152bb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55dfe12032e0 0x55dfe1213890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:27.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.088+0000 7f391152bb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dfe1203d00 0x55dfe1206cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:27.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.088+0000 7f391152bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfe0fd68d0 con 0x55dfe1202980 2023-09-23T08:56:27.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.088+0000 7f391152bb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfe1215660 con 0x55dfe1203d00 2023-09-23T08:56:27.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.088+0000 7f391152bb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfe1114df0 con 0x55dfe12032e0 2023-09-23T08:56:27.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.088+0000 7f38f6ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfe1202980 0x55dfe120b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:27.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.088+0000 7f38f6ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfe1202980 0x55dfe120b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35186/0 (socket says 172.21.15.82:35186) 2023-09-23T08:56:27.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.089+0000 7f38f6ffd700 1 -- 172.21.15.82:0/3976955088 learned_addr learned my addr 172.21.15.82:0/3976955088 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:27.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.089+0000 7f38f77fe700 1 --2- 172.21.15.82:0/3976955088 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55dfe12032e0 0x55dfe1213890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:27.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.089+0000 7f38f6ffd700 1 -- 172.21.15.82:0/3976955088 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55dfe12032e0 msgr2=0x55dfe1213890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:56:27.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.089+0000 7f38f6ffd700 1 --2- 172.21.15.82:0/3976955088 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55dfe12032e0 0x55dfe1213890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.089+0000 7f38f6ffd700 1 -- 172.21.15.82:0/3976955088 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dfe1203d00 msgr2=0x55dfe1206cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:56:27.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.089+0000 7f38f6ffd700 1 --2- 172.21.15.82:0/3976955088 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dfe1203d00 0x55dfe1206cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.089+0000 7f38f6ffd700 1 -- 172.21.15.82:0/3976955088 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dfe0f69c10 con 0x55dfe1202980 2023-09-23T08:56:27.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.089+0000 7f38f6ffd700 1 --2- 172.21.15.82:0/3976955088 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfe1202980 0x55dfe120b0f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f38ec009fd0 tx=0x7f38ec009cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7d41c7c6de75f5d server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:27.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.089+0000 7f38de7fc700 1 -- 172.21.15.82:0/3976955088 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38ec0142c0 con 0x55dfe1202980 2023-09-23T08:56:27.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.089+0000 7f38de7fc700 1 -- 172.21.15.82:0/3976955088 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f38ec023070 con 0x55dfe1202980 2023-09-23T08:56:27.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.089+0000 7f38de7fc700 1 -- 172.21.15.82:0/3976955088 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38ec011d40 con 0x55dfe1202980 2023-09-23T08:56:27.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.090+0000 7f391152bb80 1 -- 172.21.15.82:0/3976955088 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfe1202980 msgr2=0x55dfe120b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:27.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.090+0000 7f391152bb80 1 --2- 172.21.15.82:0/3976955088 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfe1202980 0x55dfe120b0f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f38ec009fd0 tx=0x7f38ec009cb0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.090+0000 7f391152bb80 1 -- 172.21.15.82:0/3976955088 shutdown_connections 2023-09-23T08:56:27.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.090+0000 7f391152bb80 1 --2- 172.21.15.82:0/3976955088 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dfe1203d00 0x55dfe1206cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.090+0000 7f391152bb80 1 --2- 172.21.15.82:0/3976955088 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfe1202980 0x55dfe120b0f0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.090+0000 7f391152bb80 1 --2- 172.21.15.82:0/3976955088 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55dfe12032e0 0x55dfe1213890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.090+0000 7f391152bb80 1 -- 172.21.15.82:0/3976955088 >> 172.21.15.82:0/3976955088 conn(0x55dfe1177090 msgr2=0x55dfe11f6ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:27.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.090+0000 7f391152bb80 1 -- 172.21.15.82:0/3976955088 shutdown_connections 2023-09-23T08:56:27.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.090+0000 7f391152bb80 1 -- 172.21.15.82:0/3976955088 wait complete. 2023-09-23T08:56:27.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.090+0000 7f391152bb80 1 -- start start 2023-09-23T08:56:27.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.091+0000 7f391152bb80 1 Processor -- start 2023-09-23T08:56:27.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.091+0000 7f391152bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfe1202980 0x55dfe1210460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:27.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.091+0000 7f391152bb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55dfe12032e0 0x55dfe12109a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:27.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.091+0000 7f391152bb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dfe1203d00 0x55dfe126b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:27.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.091+0000 7f391152bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfe12139c0 con 0x55dfe1202980 2023-09-23T08:56:27.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.091+0000 7f391152bb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfe1213b30 con 0x55dfe1203d00 2023-09-23T08:56:27.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.091+0000 7f391152bb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfe126bed0 con 0x55dfe12032e0 2023-09-23T08:56:27.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.091+0000 7f391152bb80 10 client.0 _ll_register_callbacks cb 0x7f38f00097c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T08:56:27.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.091+0000 7f38f6ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfe1202980 0x55dfe1210460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:27.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.091+0000 7f38f6ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfe1202980 0x55dfe1210460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35188/0 (socket says 172.21.15.82:35188) 2023-09-23T08:56:27.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.091+0000 7f38f6ffd700 1 -- 172.21.15.82:0/2816979237 learned_addr learned my addr 172.21.15.82:0/2816979237 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:27.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.091+0000 7f38f77fe700 1 --2- 172.21.15.82:0/2816979237 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55dfe12032e0 0x55dfe12109a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:27.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.092+0000 7f38f6ffd700 1 -- 172.21.15.82:0/2816979237 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55dfe12032e0 msgr2=0x55dfe12109a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:56:27.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.092+0000 7f38f6ffd700 1 --2- 172.21.15.82:0/2816979237 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55dfe12032e0 0x55dfe12109a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.092+0000 7f38f6ffd700 1 -- 172.21.15.82:0/2816979237 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dfe1203d00 msgr2=0x55dfe126b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:56:27.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.092+0000 7f38f6ffd700 1 --2- 172.21.15.82:0/2816979237 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dfe1203d00 0x55dfe126b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.092+0000 7f38f6ffd700 1 -- 172.21.15.82:0/2816979237 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dfe0fd45e0 con 0x55dfe1202980 2023-09-23T08:56:27.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.092+0000 7f38f77fe700 1 --2- 172.21.15.82:0/2816979237 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55dfe12032e0 0x55dfe12109a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T08:56:27.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.092+0000 7f38f6ffd700 1 --2- 172.21.15.82:0/2816979237 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfe1202980 0x55dfe1210460 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f38ec005950 tx=0x7f38ec003680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24781403fcf607d server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:27.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.092+0000 7f38d6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T08:56:27.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.092+0000 7f38d6ffd700 1 -- 172.21.15.82:0/2816979237 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38ec014310 con 0x55dfe1202980 2023-09-23T08:56:27.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.092+0000 7f38d6ffd700 1 -- 172.21.15.82:0/2816979237 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f38ec000e40 con 0x55dfe1202980 2023-09-23T08:56:27.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.092+0000 7f391152bb80 1 -- 172.21.15.82:0/2816979237 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dfe11f5860 con 0x55dfe1202980 2023-09-23T08:56:27.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.092+0000 7f38d6ffd700 1 -- 172.21.15.82:0/2816979237 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f38ec02b310 con 0x55dfe1202980 2023-09-23T08:56:27.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.092+0000 7f391152bb80 10 client.15309 fetch_fsmap learned FSMap version 26 2023-09-23T08:56:27.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.092+0000 7f391152bb80 1 -- 172.21.15.82:0/2816979237 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55dfe0fa7200 con 0x55dfe1202980 2023-09-23T08:56:27.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.093+0000 7f38d6ffd700 1 -- 172.21.15.82:0/2816979237 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55dfe11f5860 con 0x55dfe1202980 2023-09-23T08:56:27.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.093+0000 7f38d6ffd700 1 -- 172.21.15.82:0/2816979237 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f38ec02bc20 con 0x55dfe1202980 2023-09-23T08:56:27.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.093+0000 7f391152bb80 10 client.15309 fetch_fsmap finished waiting for FSMap version 26 2023-09-23T08:56:27.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.093+0000 7f391152bb80 10 client.15309 resolve_mds: resolved name 'h' to daemon mds.h 2023-09-23T08:56:27.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.093+0000 7f391152bb80 20 client.15309 populate_metadata read hostname 'smithi082' 2023-09-23T08:56:27.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.093+0000 7f391152bb80 1 --2- 172.21.15.82:0/2816979237 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x55dfe1270c50 0x55dfe126d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:27.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.093+0000 7f391152bb80 4 client.15309 mds_command: new command op to 24515 tid=0[{"prefix": "status"}] 2023-09-23T08:56:27.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.093+0000 7f391152bb80 1 -- 172.21.15.82:0/2816979237 --> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55dfe114d920 con 0x55dfe1270c50 2023-09-23T08:56:27.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.093+0000 7f38f77fe700 1 --2- 172.21.15.82:0/2816979237 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x55dfe1270c50 0x55dfe126d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:27.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.094+0000 7f38f77fe700 1 --2- 172.21.15.82:0/2816979237 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x55dfe1270c50 0x55dfe126d0f0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=d8e77255226c3c32 server_cookie=c37ff252fbffde04 in_seq=0 out_seq=0 2023-09-23T08:56:27.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.094+0000 7f38d6ffd700 10 client.15309 ms_handle_connect on v2:172.21.15.135:6836/2655304858 2023-09-23T08:56:27.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.094+0000 7f38d6ffd700 1 -- 172.21.15.82:0/2816979237 <== mds.3 v2:172.21.15.135:6836/2655304858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55dfe114d920 con 0x55dfe1270c50 2023-09-23T08:56:27.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.094+0000 7f38d6ffd700 10 client.15309 handle_command_reply: tid=0 2023-09-23T08:56:27.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.094+0000 7f391152bb80 1 client.15309 shutdown 2023-09-23T08:56:27.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.094+0000 7f391152bb80 1 -- 172.21.15.82:0/2816979237 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfe1202980 msgr2=0x55dfe1210460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:27.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.094+0000 7f391152bb80 1 --2- 172.21.15.82:0/2816979237 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfe1202980 0x55dfe1210460 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f38ec005950 tx=0x7f38ec003680 comp rx=0 tx=0).stop 2023-09-23T08:56:27.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.094+0000 7f391152bb80 1 -- 172.21.15.82:0/2816979237 shutdown_connections 2023-09-23T08:56:27.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.094+0000 7f391152bb80 1 --2- 172.21.15.82:0/2816979237 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dfe1203d00 0x55dfe126b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.094+0000 7f391152bb80 1 --2- 172.21.15.82:0/2816979237 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfe1202980 0x55dfe1210460 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.094+0000 7f391152bb80 1 --2- 172.21.15.82:0/2816979237 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x55dfe1270c50 0x55dfe126d0f0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.094+0000 7f391152bb80 1 --2- 172.21.15.82:0/2816979237 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55dfe12032e0 0x55dfe12109a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.094+0000 7f38d6ffd700 0 client.15309 ms_handle_reset on v2:172.21.15.135:6836/2655304858 2023-09-23T08:56:27.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.094+0000 7f391152bb80 1 -- 172.21.15.82:0/2816979237 >> 172.21.15.82:0/2816979237 conn(0x55dfe1177090 msgr2=0x55dfe120b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:27.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.094+0000 7f391152bb80 1 -- 172.21.15.82:0/2816979237 shutdown_connections 2023-09-23T08:56:27.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.094+0000 7f391152bb80 1 -- 172.21.15.82:0/2816979237 wait complete. 2023-09-23T08:56:27.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.094+0000 7f391152bb80 20 client.15309 trim_cache size 0 max 16384 2023-09-23T08:56:27.103 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T08:56:27.103 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "8926e286-59ed-11ee-8db4-212e2dc638e7", 2023-09-23T08:56:27.103 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 3, 2023-09-23T08:56:27.103 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 24515, 2023-09-23T08:56:27.103 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2023-09-23T08:56:27.103 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2023-09-23T08:56:27.103 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2023-09-23T08:56:27.103 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 88.641490676000004, 2023-09-23T08:56:27.104 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 26, 2023-09-23T08:56:27.104 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 88, 2023-09-23T08:56:27.104 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 86, 2023-09-23T08:56:27.104 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 113.92356458899999 2023-09-23T08:56:27.104 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T08:56:27.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.095+0000 7f38fdbff700 1 -- 172.21.15.82:0/4249352561 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f38e009ffd0 msgr2=0x7f38e00a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:27.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.095+0000 7f38fdbff700 1 --2- 172.21.15.82:0/4249352561 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f38e009ffd0 0x7f38e00a2490 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f38f00c89d0 tx=0x7f38f0021000 comp rx=0 tx=0).stop 2023-09-23T08:56:27.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.095+0000 7f38fdbff700 1 -- 172.21.15.82:0/4249352561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38f810cf00 msgr2=0x7f38f81a4130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:27.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.095+0000 7f38fdbff700 1 --2- 172.21.15.82:0/4249352561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38f810cf00 0x7f38f81a4130 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f38f000ef30 tx=0x7f38f000c450 comp rx=0 tx=0).stop 2023-09-23T08:56:27.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.095+0000 7f38fdbff700 1 -- 172.21.15.82:0/4249352561 shutdown_connections 2023-09-23T08:56:27.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.095+0000 7f38fdbff700 1 --2- 172.21.15.82:0/4249352561 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f38e009ffd0 0x7f38e00a2490 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.095+0000 7f38fdbff700 1 --2- 172.21.15.82:0/4249352561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38f810cf00 0x7f38f81a4130 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.095+0000 7f38fdbff700 1 --2- 172.21.15.82:0/4249352561 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f38f8073380 0x7f38f819cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.095+0000 7f38fdbff700 1 --2- 172.21.15.82:0/4249352561 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38f8074960 0x7f38f819d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.095+0000 7f38fdbff700 1 -- 172.21.15.82:0/4249352561 >> 172.21.15.82:0/4249352561 conn(0x7f38f80fbea0 msgr2=0x7f38f80fe290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:27.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.095+0000 7f38fdbff700 1 -- 172.21.15.82:0/4249352561 shutdown_connections 2023-09-23T08:56:27.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.095+0000 7f38fdbff700 1 -- 172.21.15.82:0/4249352561 wait complete. 2023-09-23T08:56:27.116 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-09-23T08:56:27.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.310+0000 7f2cf37ff700 1 -- 172.21.15.82:0/1411511280 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2cec074960 msgr2=0x7f2cec072db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:27.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.310+0000 7f2cf37ff700 1 --2- 172.21.15.82:0/1411511280 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2cec074960 0x7f2cec072db0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f2ce8009990 tx=0x7f2ce8009ca0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.311+0000 7f2cf37ff700 1 -- 172.21.15.82:0/1411511280 shutdown_connections 2023-09-23T08:56:27.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.311+0000 7f2cf37ff700 1 --2- 172.21.15.82:0/1411511280 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2cec1087d0 0x7f2cec10ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.311+0000 7f2cf37ff700 1 --2- 172.21.15.82:0/1411511280 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2cec074960 0x7f2cec072db0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.311+0000 7f2cf37ff700 1 --2- 172.21.15.82:0/1411511280 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2cec073380 0x7f2cec073800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.311+0000 7f2cf37ff700 1 -- 172.21.15.82:0/1411511280 >> 172.21.15.82:0/1411511280 conn(0x7f2cec0fbe60 msgr2=0x7f2cec0fe2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:27.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.311+0000 7f2cf37ff700 1 -- 172.21.15.82:0/1411511280 shutdown_connections 2023-09-23T08:56:27.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.311+0000 7f2cf37ff700 1 -- 172.21.15.82:0/1411511280 wait complete. 2023-09-23T08:56:27.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.312+0000 7f2cf37ff700 1 Processor -- start 2023-09-23T08:56:27.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.312+0000 7f2cf37ff700 1 -- start start 2023-09-23T08:56:27.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.312+0000 7f2cf37ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2cec073380 0x7f2cec198770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:27.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.312+0000 7f2cf37ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2cec074960 0x7f2cec198cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:27.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.312+0000 7f2cf37ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2cec1087d0 0x7f2cec19fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:27.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.312+0000 7f2cf37ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cec1a02f0 con 0x7f2cec074960 2023-09-23T08:56:27.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.312+0000 7f2cf37ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cec1a0430 con 0x7f2cec1087d0 2023-09-23T08:56:27.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.312+0000 7f2cf37ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cec1a05c0 con 0x7f2cec073380 2023-09-23T08:56:27.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.312+0000 7f2cf0d9a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2cec074960 0x7f2cec198cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:27.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.312+0000 7f2cf0d9a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2cec074960 0x7f2cec198cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35208/0 (socket says 172.21.15.82:35208) 2023-09-23T08:56:27.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.312+0000 7f2cf0d9a700 1 -- 172.21.15.82:0/2201410055 learned_addr learned my addr 172.21.15.82:0/2201410055 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:27.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.313+0000 7f2cf159b700 1 --2- 172.21.15.82:0/2201410055 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2cec073380 0x7f2cec198770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:27.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.313+0000 7f2cf1d9c700 1 --2- 172.21.15.82:0/2201410055 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2cec1087d0 0x7f2cec19fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:27.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.313+0000 7f2cf0d9a700 1 -- 172.21.15.82:0/2201410055 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2cec073380 msgr2=0x7f2cec198770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:27.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.313+0000 7f2cf0d9a700 1 --2- 172.21.15.82:0/2201410055 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2cec073380 0x7f2cec198770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.313+0000 7f2cf0d9a700 1 -- 172.21.15.82:0/2201410055 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2cec1087d0 msgr2=0x7f2cec19fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:27.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.313+0000 7f2cf0d9a700 1 --2- 172.21.15.82:0/2201410055 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2cec1087d0 0x7f2cec19fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.313+0000 7f2cf0d9a700 1 -- 172.21.15.82:0/2201410055 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ce80095f0 con 0x7f2cec074960 2023-09-23T08:56:27.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.313+0000 7f2cf1d9c700 1 --2- 172.21.15.82:0/2201410055 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2cec1087d0 0x7f2cec19fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T08:56:27.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.313+0000 7f2cf0d9a700 1 --2- 172.21.15.82:0/2201410055 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2cec074960 0x7f2cec198cb0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc00d980 tx=0x7f2cdc00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:27.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.313+0000 7f2ce27fc700 1 -- 172.21.15.82:0/2201410055 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cdc00de60 con 0x7f2cec074960 2023-09-23T08:56:27.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.313+0000 7f2ce27fc700 1 -- 172.21.15.82:0/2201410055 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2cdc0044b0 con 0x7f2cec074960 2023-09-23T08:56:27.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.313+0000 7f2cf37ff700 1 -- 172.21.15.82:0/2201410055 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cec1a08a0 con 0x7f2cec074960 2023-09-23T08:56:27.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.313+0000 7f2ce27fc700 1 -- 172.21.15.82:0/2201410055 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cdc003b40 con 0x7f2cec074960 2023-09-23T08:56:27.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.313+0000 7f2cf37ff700 1 -- 172.21.15.82:0/2201410055 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cec1a0e00 con 0x7f2cec074960 2023-09-23T08:56:27.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.316+0000 7f2ce27fc700 1 -- 172.21.15.82:0/2201410055 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 134671+0+0 (secure 0 0 0) 0x7f2cdc003ca0 con 0x7f2cec074960 2023-09-23T08:56:27.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.318+0000 7f2d07062b80 1 Processor -- start 2023-09-23T08:56:27.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.318+0000 7f2ce27fc700 1 --2- 172.21.15.82:0/2201410055 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f2cd809ffd0 0x7f2cd80a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:27.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.318+0000 7f2d07062b80 1 -- start start 2023-09-23T08:56:27.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.318+0000 7f2ce27fc700 1 -- 172.21.15.82:0/2201410055 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f2cdc0caf20 con 0x7f2cec074960 2023-09-23T08:56:27.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.318+0000 7f2cf1d9c700 1 --2- 172.21.15.82:0/2201410055 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f2cd809ffd0 0x7f2cd80a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:27.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.318+0000 7f2d07062b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56050d252980 0x56050d252da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:27.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.318+0000 7f2d07062b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56050d2532e0 0x56050d253720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:27.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.318+0000 7f2d07062b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56050d253d00 0x56050d254180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:27.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.318+0000 7f2d07062b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56050d1ba760 con 0x56050d252980 2023-09-23T08:56:27.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.318+0000 7f2d07062b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56050d1ab730 con 0x56050d2532e0 2023-09-23T08:56:27.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.318+0000 7f2d07062b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x56050d1a9050 con 0x56050d253d00 2023-09-23T08:56:27.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.318+0000 7f2cf159b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56050d252980 0x56050d252da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:27.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.319+0000 7f2cf159b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56050d252980 0x56050d252da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35224/0 (socket says 172.21.15.82:35224) 2023-09-23T08:56:27.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.319+0000 7f2cf159b700 1 -- 172.21.15.82:0/679285906 learned_addr learned my addr 172.21.15.82:0/679285906 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:27.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.319+0000 7f2cf0d9a700 1 --2- 172.21.15.82:0/679285906 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56050d2532e0 0x56050d253720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:27.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.319+0000 7f2cf159b700 1 -- 172.21.15.82:0/679285906 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56050d253d00 msgr2=0x56050d254180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:56:27.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.319+0000 7f2cf159b700 1 --2- 172.21.15.82:0/679285906 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56050d253d00 0x56050d254180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.319+0000 7f2cf159b700 1 -- 172.21.15.82:0/679285906 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56050d2532e0 msgr2=0x56050d253720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:56:27.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.319+0000 7f2cf1d9c700 1 --2- 172.21.15.82:0/2201410055 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f2cd809ffd0 0x7f2cd80a2490 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2ce4009400 tx=0x7f2ce4009920 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:27.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.319+0000 7f2cf159b700 1 --2- 172.21.15.82:0/679285906 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56050d2532e0 0x56050d253720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.319+0000 7f2cf159b700 1 -- 172.21.15.82:0/679285906 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56050d0245e0 con 0x56050d252980 2023-09-23T08:56:27.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.319+0000 7f2cf159b700 1 --2- 172.21.15.82:0/679285906 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56050d252980 0x56050d252da0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f2ce8009990 tx=0x7f2ce8005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c6727621efa3fc4 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:27.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.319+0000 7f2cd77fe700 1 -- 172.21.15.82:0/679285906 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce8005340 con 0x56050d252980 2023-09-23T08:56:27.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.319+0000 7f2cd77fe700 1 -- 172.21.15.82:0/679285906 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2ce801e040 con 0x56050d252980 2023-09-23T08:56:27.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.319+0000 7f2cd77fe700 1 -- 172.21.15.82:0/679285906 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce800b970 con 0x56050d252980 2023-09-23T08:56:27.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.320+0000 7f2d07062b80 1 -- 172.21.15.82:0/679285906 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56050d252980 msgr2=0x56050d252da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:27.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.320+0000 7f2d07062b80 1 --2- 172.21.15.82:0/679285906 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56050d252980 0x56050d252da0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f2ce8009990 tx=0x7f2ce8005ef0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.320+0000 7f2d07062b80 1 -- 172.21.15.82:0/679285906 shutdown_connections 2023-09-23T08:56:27.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.320+0000 7f2d07062b80 1 --2- 172.21.15.82:0/679285906 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56050d253d00 0x56050d254180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.320+0000 7f2d07062b80 1 --2- 172.21.15.82:0/679285906 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56050d252980 0x56050d252da0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.320+0000 7f2d07062b80 1 --2- 172.21.15.82:0/679285906 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56050d2532e0 0x56050d253720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.320+0000 7f2d07062b80 1 -- 172.21.15.82:0/679285906 >> 172.21.15.82:0/679285906 conn(0x56050d1c7090 msgr2=0x56050d24d250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:27.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.320+0000 7f2d07062b80 1 -- 172.21.15.82:0/679285906 shutdown_connections 2023-09-23T08:56:27.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.320+0000 7f2d07062b80 1 -- 172.21.15.82:0/679285906 wait complete. 2023-09-23T08:56:27.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.321+0000 7f2d07062b80 1 -- start start 2023-09-23T08:56:27.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.321+0000 7f2d07062b80 1 Processor -- start 2023-09-23T08:56:27.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.321+0000 7f2d07062b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56050d252980 0x56050d25c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:27.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.321+0000 7f2d07062b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56050d2532e0 0x56050d25c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:27.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.321+0000 7f2d07062b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56050d253d00 0x56050d2638e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:27.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.322+0000 7f2d07062b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56050d1a4940 con 0x56050d2532e0 2023-09-23T08:56:27.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.322+0000 7f2d07062b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56050d142b60 con 0x56050d253d00 2023-09-23T08:56:27.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.322+0000 7f2d07062b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x56050d142860 con 0x56050d252980 2023-09-23T08:56:27.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.322+0000 7f2d07062b80 10 client.0 _ll_register_callbacks cb 0x56050d08ca30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T08:56:27.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.322+0000 7f2cf0d9a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56050d2532e0 0x56050d25c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:27.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.322+0000 7f2cf0d9a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56050d2532e0 0x56050d25c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35228/0 (socket says 172.21.15.82:35228) 2023-09-23T08:56:27.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.322+0000 7f2cf0d9a700 1 -- 172.21.15.82:0/3633977970 learned_addr learned my addr 172.21.15.82:0/3633977970 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:27.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.322+0000 7f2cf159b700 1 --2- 172.21.15.82:0/3633977970 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56050d252980 0x56050d25c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:27.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.322+0000 7f2cf0d9a700 1 -- 172.21.15.82:0/3633977970 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56050d252980 msgr2=0x56050d25c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:56:27.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.322+0000 7f2cf0d9a700 1 --2- 172.21.15.82:0/3633977970 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56050d252980 0x56050d25c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.322+0000 7f2cf0d9a700 1 -- 172.21.15.82:0/3633977970 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56050d253d00 msgr2=0x56050d2638e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:56:27.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.322+0000 7f2cf0d9a700 1 --2- 172.21.15.82:0/3633977970 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56050d253d00 0x56050d2638e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.322+0000 7f2cf0d9a700 1 -- 172.21.15.82:0/3633977970 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cec10b880 con 0x56050d2532e0 2023-09-23T08:56:27.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.322+0000 7f2cf0d9a700 1 --2- 172.21.15.82:0/3633977970 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56050d2532e0 0x56050d25c8a0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc0a0200 tx=0x7f2cdc009a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ec17f04a7ef0a1e server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:27.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.322+0000 7f2cd4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T08:56:27.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.322+0000 7f2cd4ff9700 1 -- 172.21.15.82:0/3633977970 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cdc098010 con 0x56050d2532e0 2023-09-23T08:56:27.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.322+0000 7f2cd4ff9700 1 -- 172.21.15.82:0/3633977970 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f2cdc098920 con 0x56050d2532e0 2023-09-23T08:56:27.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.322+0000 7f2d07062b80 1 -- 172.21.15.82:0/3633977970 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56050d222170 con 0x56050d2532e0 2023-09-23T08:56:27.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.323+0000 7f2cd4ff9700 1 -- 172.21.15.82:0/3633977970 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2cdc09c750 con 0x56050d2532e0 2023-09-23T08:56:27.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.323+0000 7f2d07062b80 10 client.15321 fetch_fsmap learned FSMap version 26 2023-09-23T08:56:27.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.323+0000 7f2d07062b80 1 -- 172.21.15.82:0/3633977970 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x56050cfd0d90 con 0x56050d2532e0 2023-09-23T08:56:27.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.323+0000 7f2cd4ff9700 1 -- 172.21.15.82:0/3633977970 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56050d222170 con 0x56050d2532e0 2023-09-23T08:56:27.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.323+0000 7f2cd4ff9700 1 -- 172.21.15.82:0/3633977970 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f2cdc097880 con 0x56050d2532e0 2023-09-23T08:56:27.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.323+0000 7f2d07062b80 10 client.15321 fetch_fsmap finished waiting for FSMap version 26 2023-09-23T08:56:27.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.323+0000 7f2d07062b80 10 client.15321 resolve_mds: resolved name 'c' to daemon mds.c 2023-09-23T08:56:27.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.323+0000 7f2d07062b80 20 client.15321 populate_metadata read hostname 'smithi082' 2023-09-23T08:56:27.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.323+0000 7f2d07062b80 1 --2- 172.21.15.82:0/3633977970 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x56050d267f50 0x56050d2669e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:27.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.323+0000 7f2d07062b80 4 client.15321 mds_command: new command op to 24526 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T08:56:27.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.323+0000 7f2d07062b80 1 -- 172.21.15.82:0/3633977970 --> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56050d14ab50 con 0x56050d267f50 2023-09-23T08:56:27.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.324+0000 7f2cf159b700 1 --2- 172.21.15.82:0/3633977970 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x56050d267f50 0x56050d2669e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:27.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.324+0000 7f2cf159b700 1 --2- 172.21.15.82:0/3633977970 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x56050d267f50 0x56050d2669e0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=dca855926c7626ad server_cookie=d4345cd422a6bb70 in_seq=0 out_seq=0 2023-09-23T08:56:27.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.324+0000 7f2cd4ff9700 10 client.15321 ms_handle_connect on v2:172.21.15.161:6836/43639843 2023-09-23T08:56:27.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.325+0000 7f2cd4ff9700 1 -- 172.21.15.82:0/3633977970 <== mds.2 v2:172.21.15.161:6836/43639843 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56050d14ab50 con 0x56050d267f50 2023-09-23T08:56:27.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.325+0000 7f2cd4ff9700 10 client.15321 handle_command_reply: tid=0 2023-09-23T08:56:27.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.325+0000 7f2d07062b80 1 client.15321 shutdown 2023-09-23T08:56:27.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.325+0000 7f2d07062b80 1 -- 172.21.15.82:0/3633977970 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56050d2532e0 msgr2=0x56050d25c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:27.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.325+0000 7f2d07062b80 1 --2- 172.21.15.82:0/3633977970 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56050d2532e0 0x56050d25c8a0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc0a0200 tx=0x7f2cdc009a70 comp rx=0 tx=0).stop 2023-09-23T08:56:27.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.326+0000 7f2d07062b80 1 -- 172.21.15.82:0/3633977970 shutdown_connections 2023-09-23T08:56:27.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.326+0000 7f2d07062b80 1 --2- 172.21.15.82:0/3633977970 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x56050d267f50 0x56050d2669e0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.326+0000 7f2d07062b80 1 --2- 172.21.15.82:0/3633977970 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56050d253d00 0x56050d2638e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.326+0000 7f2d07062b80 1 --2- 172.21.15.82:0/3633977970 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56050d252980 0x56050d25c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.326+0000 7f2d07062b80 1 --2- 172.21.15.82:0/3633977970 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56050d2532e0 0x56050d25c8a0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.326+0000 7f2d07062b80 1 -- 172.21.15.82:0/3633977970 >> 172.21.15.82:0/3633977970 conn(0x56050d1c7090 msgr2=0x56050d247af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:27.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.326+0000 7f2cd4ff9700 0 client.15321 ms_handle_reset on v2:172.21.15.161:6836/43639843 2023-09-23T08:56:27.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.326+0000 7f2d07062b80 1 -- 172.21.15.82:0/3633977970 shutdown_connections 2023-09-23T08:56:27.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.326+0000 7f2d07062b80 1 -- 172.21.15.82:0/3633977970 wait complete. 2023-09-23T08:56:27.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.326+0000 7f2d07062b80 20 client.15321 trim_cache size 0 max 16384 2023-09-23T08:56:27.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.344+0000 7f2d07062b80 1 Processor -- start 2023-09-23T08:56:27.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.344+0000 7f2d07062b80 1 -- start start 2023-09-23T08:56:27.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.344+0000 7f2d07062b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56050d252980 0x56050d256bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:27.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.344+0000 7f2d07062b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56050d2532e0 0x56050d2638a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:27.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.344+0000 7f2d07062b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56050d253d00 0x56050d257100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:27.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.344+0000 7f2d07062b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56050d0268d0 con 0x56050d253d00 2023-09-23T08:56:27.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.344+0000 7f2d07062b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56050d164df0 con 0x56050d2532e0 2023-09-23T08:56:27.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.344+0000 7f2d07062b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x56050d032de0 con 0x56050d252980 2023-09-23T08:56:27.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.344+0000 7f2cf1d9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56050d253d00 0x56050d257100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:27.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.344+0000 7f2cf1d9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56050d253d00 0x56050d257100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35236/0 (socket says 172.21.15.82:35236) 2023-09-23T08:56:27.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.344+0000 7f2cf1d9c700 1 -- 172.21.15.82:0/2940564317 learned_addr learned my addr 172.21.15.82:0/2940564317 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:27.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.345+0000 7f2cf0d9a700 1 --2- 172.21.15.82:0/2940564317 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56050d2532e0 0x56050d2638a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:27.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.345+0000 7f2cf159b700 1 --2- 172.21.15.82:0/2940564317 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56050d252980 0x56050d256bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:27.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.345+0000 7f2cf1d9c700 1 -- 172.21.15.82:0/2940564317 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56050d252980 msgr2=0x56050d256bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:56:27.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.345+0000 7f2cf1d9c700 1 --2- 172.21.15.82:0/2940564317 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56050d252980 0x56050d256bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.345+0000 7f2cf1d9c700 1 -- 172.21.15.82:0/2940564317 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56050d2532e0 msgr2=0x56050d2638a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:56:27.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.345+0000 7f2cf1d9c700 1 --2- 172.21.15.82:0/2940564317 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56050d2532e0 0x56050d2638a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.345+0000 7f2cf1d9c700 1 -- 172.21.15.82:0/2940564317 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56050d270b80 con 0x56050d253d00 2023-09-23T08:56:27.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.345+0000 7f2cf0d9a700 1 --2- 172.21.15.82:0/2940564317 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56050d2532e0 0x56050d2638a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T08:56:27.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.345+0000 7f2cf159b700 1 --2- 172.21.15.82:0/2940564317 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56050d252980 0x56050d256bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T08:56:27.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.345+0000 7f2cf1d9c700 1 --2- 172.21.15.82:0/2940564317 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56050d253d00 0x56050d257100 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f2ce4007fc0 tx=0x7f2ce4004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed9d7784c3b11fab server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:27.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.345+0000 7f2cd7fff700 1 -- 172.21.15.82:0/2940564317 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce401e070 con 0x56050d253d00 2023-09-23T08:56:27.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.345+0000 7f2cd7fff700 1 -- 172.21.15.82:0/2940564317 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2ce4004bb0 con 0x56050d253d00 2023-09-23T08:56:27.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.345+0000 7f2cd7fff700 1 -- 172.21.15.82:0/2940564317 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce4005890 con 0x56050d253d00 2023-09-23T08:56:27.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.346+0000 7f2d07062b80 1 -- 172.21.15.82:0/2940564317 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56050d253d00 msgr2=0x56050d257100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:27.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.346+0000 7f2d07062b80 1 --2- 172.21.15.82:0/2940564317 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56050d253d00 0x56050d257100 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f2ce4007fc0 tx=0x7f2ce4004b40 comp rx=0 tx=0).stop 2023-09-23T08:56:27.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.346+0000 7f2d07062b80 1 -- 172.21.15.82:0/2940564317 shutdown_connections 2023-09-23T08:56:27.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.346+0000 7f2d07062b80 1 --2- 172.21.15.82:0/2940564317 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56050d253d00 0x56050d257100 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.346+0000 7f2d07062b80 1 --2- 172.21.15.82:0/2940564317 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56050d252980 0x56050d256bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.346+0000 7f2d07062b80 1 --2- 172.21.15.82:0/2940564317 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56050d2532e0 0x56050d2638a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.346+0000 7f2d07062b80 1 -- 172.21.15.82:0/2940564317 >> 172.21.15.82:0/2940564317 conn(0x56050d1c7090 msgr2=0x56050d25b060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:27.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.346+0000 7f2d07062b80 1 -- 172.21.15.82:0/2940564317 shutdown_connections 2023-09-23T08:56:27.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.346+0000 7f2d07062b80 1 -- 172.21.15.82:0/2940564317 wait complete. 2023-09-23T08:56:27.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.346+0000 7f2d07062b80 1 -- start start 2023-09-23T08:56:27.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.347+0000 7f2d07062b80 1 Processor -- start 2023-09-23T08:56:27.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.347+0000 7f2d07062b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56050d252980 0x56050d25eb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:27.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.347+0000 7f2d07062b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56050d2532e0 0x56050d25f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:27.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.347+0000 7f2d07062b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56050d253d00 0x56050d2bb940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:27.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.347+0000 7f2d07062b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56050d25f600 con 0x56050d2532e0 2023-09-23T08:56:27.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.347+0000 7f2d07062b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56050d25f770 con 0x56050d253d00 2023-09-23T08:56:27.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.347+0000 7f2d07062b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x56050d2bbf00 con 0x56050d252980 2023-09-23T08:56:27.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.347+0000 7f2d07062b80 10 client.0 _ll_register_callbacks cb 0x7f2cdc098460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T08:56:27.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.347+0000 7f2cf0d9a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56050d2532e0 0x56050d25f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:27.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.347+0000 7f2cf0d9a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56050d2532e0 0x56050d25f070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35246/0 (socket says 172.21.15.82:35246) 2023-09-23T08:56:27.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.347+0000 7f2cf0d9a700 1 -- 172.21.15.82:0/1820900756 learned_addr learned my addr 172.21.15.82:0/1820900756 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:27.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.347+0000 7f2cf159b700 1 --2- 172.21.15.82:0/1820900756 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56050d252980 0x56050d25eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:27.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.347+0000 7f2cf1d9c700 1 --2- 172.21.15.82:0/1820900756 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56050d253d00 0x56050d2bb940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:27.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.348+0000 7f2cf0d9a700 1 -- 172.21.15.82:0/1820900756 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56050d252980 msgr2=0x56050d25eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:56:27.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.348+0000 7f2cf0d9a700 1 --2- 172.21.15.82:0/1820900756 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56050d252980 0x56050d25eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.348+0000 7f2cf0d9a700 1 -- 172.21.15.82:0/1820900756 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56050d253d00 msgr2=0x56050d2bb940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:56:27.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.348+0000 7f2cf0d9a700 1 --2- 172.21.15.82:0/1820900756 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56050d253d00 0x56050d2bb940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.348+0000 7f2cf0d9a700 1 -- 172.21.15.82:0/1820900756 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ce4007c40 con 0x56050d2532e0 2023-09-23T08:56:27.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.348+0000 7f2cf0d9a700 1 --2- 172.21.15.82:0/1820900756 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56050d2532e0 0x56050d25f070 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc009fd0 tx=0x7f2cdc005c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e06b8a58e6e4ff6a server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:27.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.348+0000 7f2cd4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T08:56:27.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.348+0000 7f2cd4ff9700 1 -- 172.21.15.82:0/1820900756 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cdc0c2d10 con 0x56050d2532e0 2023-09-23T08:56:27.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.348+0000 7f2cd4ff9700 1 -- 172.21.15.82:0/1820900756 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f2cdc098920 con 0x56050d2532e0 2023-09-23T08:56:27.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.348+0000 7f2d07062b80 1 -- 172.21.15.82:0/1820900756 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56050d245860 con 0x56050d2532e0 2023-09-23T08:56:27.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.348+0000 7f2cd4ff9700 1 -- 172.21.15.82:0/1820900756 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2cdc0c2e70 con 0x56050d2532e0 2023-09-23T08:56:27.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.348+0000 7f2d07062b80 10 client.15327 fetch_fsmap learned FSMap version 26 2023-09-23T08:56:27.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.348+0000 7f2d07062b80 1 -- 172.21.15.82:0/1820900756 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x56050cfb9c10 con 0x56050d2532e0 2023-09-23T08:56:27.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.348+0000 7f2cd4ff9700 1 -- 172.21.15.82:0/1820900756 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56050d245860 con 0x56050d2532e0 2023-09-23T08:56:27.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.348+0000 7f2cd4ff9700 1 -- 172.21.15.82:0/1820900756 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f2cdc094830 con 0x56050d2532e0 2023-09-23T08:56:27.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.348+0000 7f2d07062b80 10 client.15327 fetch_fsmap finished waiting for FSMap version 26 2023-09-23T08:56:27.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.349+0000 7f2d07062b80 10 client.15327 resolve_mds: resolved name 'c' to daemon mds.c 2023-09-23T08:56:27.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.349+0000 7f2d07062b80 20 client.15327 populate_metadata read hostname 'smithi082' 2023-09-23T08:56:27.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.349+0000 7f2d07062b80 1 --2- 172.21.15.82:0/1820900756 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x56050d2c0e00 0x56050d2bd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:27.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.349+0000 7f2d07062b80 4 client.15327 mds_command: new command op to 24526 tid=0[{"prefix": "status"}] 2023-09-23T08:56:27.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.349+0000 7f2d07062b80 1 -- 172.21.15.82:0/1820900756 --> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56050d19d920 con 0x56050d2c0e00 2023-09-23T08:56:27.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.349+0000 7f2cf159b700 1 --2- 172.21.15.82:0/1820900756 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x56050d2c0e00 0x56050d2bd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:27.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.350+0000 7f2cd4ff9700 10 client.15327 ms_handle_connect on v2:172.21.15.161:6836/43639843 2023-09-23T08:56:27.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.350+0000 7f2cf159b700 1 --2- 172.21.15.82:0/1820900756 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x56050d2c0e00 0x56050d2bd320 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6558afb3ad8d5496 server_cookie=ee3b46f8b27773d5 in_seq=0 out_seq=0 2023-09-23T08:56:27.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.350+0000 7f2cd4ff9700 1 -- 172.21.15.82:0/1820900756 <== mds.2 v2:172.21.15.161:6836/43639843 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x56050d19d920 con 0x56050d2c0e00 2023-09-23T08:56:27.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.350+0000 7f2cd4ff9700 10 client.15327 handle_command_reply: tid=0 2023-09-23T08:56:27.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.350+0000 7f2d07062b80 1 client.15327 shutdown 2023-09-23T08:56:27.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.350+0000 7f2d07062b80 1 -- 172.21.15.82:0/1820900756 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56050d2532e0 msgr2=0x56050d25f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:27.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.350+0000 7f2d07062b80 1 --2- 172.21.15.82:0/1820900756 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56050d2532e0 0x56050d25f070 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc009fd0 tx=0x7f2cdc005c40 comp rx=0 tx=0).stop 2023-09-23T08:56:27.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.350+0000 7f2d07062b80 1 -- 172.21.15.82:0/1820900756 shutdown_connections 2023-09-23T08:56:27.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.350+0000 7f2d07062b80 1 --2- 172.21.15.82:0/1820900756 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x56050d2c0e00 0x56050d2bd320 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.350+0000 7f2d07062b80 1 --2- 172.21.15.82:0/1820900756 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56050d253d00 0x56050d2bb940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.350+0000 7f2d07062b80 1 --2- 172.21.15.82:0/1820900756 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56050d252980 0x56050d25eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.350+0000 7f2d07062b80 1 --2- 172.21.15.82:0/1820900756 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56050d2532e0 0x56050d25f070 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.350+0000 7f2cd4ff9700 0 client.15327 ms_handle_reset on v2:172.21.15.161:6836/43639843 2023-09-23T08:56:27.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.350+0000 7f2d07062b80 1 -- 172.21.15.82:0/1820900756 >> 172.21.15.82:0/1820900756 conn(0x56050d1c7090 msgr2=0x56050d256bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:27.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.350+0000 7f2d07062b80 1 -- 172.21.15.82:0/1820900756 shutdown_connections 2023-09-23T08:56:27.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.351+0000 7f2d07062b80 1 -- 172.21.15.82:0/1820900756 wait complete. 2023-09-23T08:56:27.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.351+0000 7f2d07062b80 20 client.15327 trim_cache size 0 max 16384 2023-09-23T08:56:27.359 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T08:56:27.359 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "8926e286-59ed-11ee-8db4-212e2dc638e7", 2023-09-23T08:56:27.359 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 2, 2023-09-23T08:56:27.360 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 24526, 2023-09-23T08:56:27.360 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2023-09-23T08:56:27.360 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2023-09-23T08:56:27.360 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2023-09-23T08:56:27.360 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 89.917378760999995, 2023-09-23T08:56:27.360 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 26, 2023-09-23T08:56:27.360 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 88, 2023-09-23T08:56:27.360 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 86, 2023-09-23T08:56:27.360 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 117.322505042 2023-09-23T08:56:27.360 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T08:56:27.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.351+0000 7f2cf37ff700 1 -- 172.21.15.82:0/2201410055 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f2cd809ffd0 msgr2=0x7f2cd80a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:27.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.351+0000 7f2cf37ff700 1 --2- 172.21.15.82:0/2201410055 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f2cd809ffd0 0x7f2cd80a2490 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2ce4009400 tx=0x7f2ce4009920 comp rx=0 tx=0).stop 2023-09-23T08:56:27.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.351+0000 7f2cf37ff700 1 -- 172.21.15.82:0/2201410055 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2cec074960 msgr2=0x7f2cec198cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:27.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.351+0000 7f2cf37ff700 1 --2- 172.21.15.82:0/2201410055 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2cec074960 0x7f2cec198cb0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc00d980 tx=0x7f2cdc00dd40 comp rx=0 tx=0).stop 2023-09-23T08:56:27.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.351+0000 7f2cf37ff700 1 -- 172.21.15.82:0/2201410055 shutdown_connections 2023-09-23T08:56:27.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.351+0000 7f2cf37ff700 1 --2- 172.21.15.82:0/2201410055 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f2cd809ffd0 0x7f2cd80a2490 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.351+0000 7f2cf37ff700 1 --2- 172.21.15.82:0/2201410055 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2cec1087d0 0x7f2cec19fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.351+0000 7f2cf37ff700 1 --2- 172.21.15.82:0/2201410055 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2cec073380 0x7f2cec198770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.351+0000 7f2cf37ff700 1 --2- 172.21.15.82:0/2201410055 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2cec074960 0x7f2cec198cb0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.351+0000 7f2cf37ff700 1 -- 172.21.15.82:0/2201410055 >> 172.21.15.82:0/2201410055 conn(0x7f2cec0fbe60 msgr2=0x7f2cec0fe250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:27.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.351+0000 7f2cf37ff700 1 -- 172.21.15.82:0/2201410055 shutdown_connections 2023-09-23T08:56:27.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.351+0000 7f2cf37ff700 1 -- 172.21.15.82:0/2201410055 wait complete. 2023-09-23T08:56:27.372 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2023-09-23T08:56:27.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.568+0000 7f00901ff700 1 -- 172.21.15.82:0/797138103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0088100930 msgr2=0x7f0088100d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:27.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.568+0000 7f00901ff700 1 --2- 172.21.15.82:0/797138103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0088100930 0x7f0088100d50 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f00840099c0 tx=0x7f0084009cd0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.568+0000 7f00901ff700 1 -- 172.21.15.82:0/797138103 shutdown_connections 2023-09-23T08:56:27.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.568+0000 7f00901ff700 1 --2- 172.21.15.82:0/797138103 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00881024c0 0x7f0088108d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.568+0000 7f00901ff700 1 --2- 172.21.15.82:0/797138103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0088100930 0x7f0088100d50 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.568+0000 7f00901ff700 1 --2- 172.21.15.82:0/797138103 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0088101b20 0x7f0088101f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.568+0000 7f00901ff700 1 -- 172.21.15.82:0/797138103 >> 172.21.15.82:0/797138103 conn(0x7f00880fbea0 msgr2=0x7f00880fe2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:27.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.568+0000 7f00901ff700 1 -- 172.21.15.82:0/797138103 shutdown_connections 2023-09-23T08:56:27.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.568+0000 7f00901ff700 1 -- 172.21.15.82:0/797138103 wait complete. 2023-09-23T08:56:27.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.569+0000 7f00901ff700 1 Processor -- start 2023-09-23T08:56:27.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.570+0000 7f00901ff700 1 -- start start 2023-09-23T08:56:27.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.570+0000 7f00901ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0088100930 0x7f0088198830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:27.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.570+0000 7f00901ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0088101b20 0x7f0088198d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:27.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.570+0000 7f00901ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00881024c0 0x7f008819fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:27.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.570+0000 7f00901ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00881a03b0 con 0x7f0088101b20 2023-09-23T08:56:27.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.570+0000 7f00901ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00881a04f0 con 0x7f0088100930 2023-09-23T08:56:27.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.570+0000 7f00901ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00881a0680 con 0x7f00881024c0 2023-09-23T08:56:27.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.570+0000 7f008d79a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0088101b20 0x7f0088198d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:27.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.570+0000 7f008d79a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0088101b20 0x7f0088198d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35264/0 (socket says 172.21.15.82:35264) 2023-09-23T08:56:27.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.570+0000 7f008d79a700 1 -- 172.21.15.82:0/2997129683 learned_addr learned my addr 172.21.15.82:0/2997129683 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:27.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.570+0000 7f008e79c700 1 --2- 172.21.15.82:0/2997129683 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00881024c0 0x7f008819fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:27.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.570+0000 7f008df9b700 1 --2- 172.21.15.82:0/2997129683 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0088100930 0x7f0088198830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:27.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.570+0000 7f008d79a700 1 -- 172.21.15.82:0/2997129683 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00881024c0 msgr2=0x7f008819fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:27.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.570+0000 7f008d79a700 1 --2- 172.21.15.82:0/2997129683 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00881024c0 0x7f008819fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.570+0000 7f008d79a700 1 -- 172.21.15.82:0/2997129683 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0088100930 msgr2=0x7f0088198830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:27.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.570+0000 7f008d79a700 1 --2- 172.21.15.82:0/2997129683 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0088100930 0x7f0088198830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.570+0000 7f008d79a700 1 -- 172.21.15.82:0/2997129683 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00840095f0 con 0x7f0088101b20 2023-09-23T08:56:27.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.570+0000 7f008df9b700 1 --2- 172.21.15.82:0/2997129683 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0088100930 0x7f0088198830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T08:56:27.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.570+0000 7f008e79c700 1 --2- 172.21.15.82:0/2997129683 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00881024c0 0x7f008819fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T08:56:27.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.571+0000 7f008d79a700 1 --2- 172.21.15.82:0/2997129683 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0088101b20 0x7f0088198d70 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f007800b530 tx=0x7f007800b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:27.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.571+0000 7f007effd700 1 -- 172.21.15.82:0/2997129683 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0078011830 con 0x7f0088101b20 2023-09-23T08:56:27.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.571+0000 7f007effd700 1 -- 172.21.15.82:0/2997129683 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0078011e20 con 0x7f0088101b20 2023-09-23T08:56:27.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.571+0000 7f00901ff700 1 -- 172.21.15.82:0/2997129683 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00881a0960 con 0x7f0088101b20 2023-09-23T08:56:27.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.571+0000 7f007effd700 1 -- 172.21.15.82:0/2997129683 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0078010dd0 con 0x7f0088101b20 2023-09-23T08:56:27.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.571+0000 7f00901ff700 1 -- 172.21.15.82:0/2997129683 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00881a0e70 con 0x7f0088101b20 2023-09-23T08:56:27.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.574+0000 7f007effd700 1 -- 172.21.15.82:0/2997129683 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 134671+0+0 (secure 0 0 0) 0x7f0078011990 con 0x7f0088101b20 2023-09-23T08:56:27.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.576+0000 7f00a3be4b80 1 Processor -- start 2023-09-23T08:56:27.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.576+0000 7f00a3be4b80 1 -- start start 2023-09-23T08:56:27.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.576+0000 7f007effd700 1 --2- 172.21.15.82:0/2997129683 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f007409ff50 0x7f00740a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:27.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.577+0000 7f00a3be4b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d6affc5980 0x55d6affc5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:27.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.577+0000 7f00a3be4b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6affc62e0 0x55d6affc6720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:27.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.577+0000 7f00a3be4b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6affc6d00 0x55d6affc7180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:27.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.577+0000 7f00a3be4b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6aff2d760 con 0x55d6affc62e0 2023-09-23T08:56:27.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.577+0000 7f00a3be4b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6aff1e730 con 0x55d6affc6d00 2023-09-23T08:56:27.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.577+0000 7f00a3be4b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6aff1c050 con 0x55d6affc5980 2023-09-23T08:56:27.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.577+0000 7f007effd700 1 -- 172.21.15.82:0/2997129683 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f00780cae00 con 0x7f0088101b20 2023-09-23T08:56:27.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.577+0000 7f008e79c700 1 --2- 172.21.15.82:0/2997129683 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f007409ff50 0x7f00740a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:27.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.577+0000 7f008d79a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6affc62e0 0x55d6affc6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:27.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.577+0000 7f008d79a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6affc62e0 0x55d6affc6720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35274/0 (socket says 172.21.15.82:35274) 2023-09-23T08:56:27.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.577+0000 7f008d79a700 1 -- 172.21.15.82:0/4236755756 learned_addr learned my addr 172.21.15.82:0/4236755756 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:27.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.577+0000 7f008df9b700 1 --2- 172.21.15.82:0/4236755756 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d6affc5980 0x55d6affc5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:27.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.577+0000 7f008d79a700 1 -- 172.21.15.82:0/4236755756 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d6affc5980 msgr2=0x55d6affc5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:56:27.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.577+0000 7f008d79a700 1 --2- 172.21.15.82:0/4236755756 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d6affc5980 0x55d6affc5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.577+0000 7f008d79a700 1 -- 172.21.15.82:0/4236755756 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6affc6d00 msgr2=0x55d6affc7180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:56:27.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.577+0000 7f008d79a700 1 --2- 172.21.15.82:0/4236755756 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6affc6d00 0x55d6affc7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.577+0000 7f008d79a700 1 -- 172.21.15.82:0/4236755756 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d6afd975e0 con 0x55d6affc62e0 2023-09-23T08:56:27.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.578+0000 7f008d79a700 1 --2- 172.21.15.82:0/4236755756 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6affc62e0 0x55d6affc6720 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f0078098790 tx=0x7f0078004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cee230c68c5b1194 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:27.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.577+0000 7f008e79c700 1 --2- 172.21.15.82:0/2997129683 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f007409ff50 0x7f00740a2410 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f0080009460 tx=0x7f0080009920 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:27.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.578+0000 7f0073fff700 1 -- 172.21.15.82:0/4236755756 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0078098160 con 0x55d6affc62e0 2023-09-23T08:56:27.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.578+0000 7f0073fff700 1 -- 172.21.15.82:0/4236755756 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0078062940 con 0x55d6affc62e0 2023-09-23T08:56:27.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.578+0000 7f0073fff700 1 -- 172.21.15.82:0/4236755756 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0078098f00 con 0x55d6affc62e0 2023-09-23T08:56:27.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.578+0000 7f00a3be4b80 1 -- 172.21.15.82:0/4236755756 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6affc62e0 msgr2=0x55d6affc6720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:27.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.578+0000 7f00a3be4b80 1 --2- 172.21.15.82:0/4236755756 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6affc62e0 0x55d6affc6720 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f0078098790 tx=0x7f0078004750 comp rx=0 tx=0).stop 2023-09-23T08:56:27.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.579+0000 7f00a3be4b80 1 -- 172.21.15.82:0/4236755756 shutdown_connections 2023-09-23T08:56:27.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.579+0000 7f00a3be4b80 1 --2- 172.21.15.82:0/4236755756 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6affc6d00 0x55d6affc7180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.579+0000 7f00a3be4b80 1 --2- 172.21.15.82:0/4236755756 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d6affc5980 0x55d6affc5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.579+0000 7f00a3be4b80 1 --2- 172.21.15.82:0/4236755756 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6affc62e0 0x55d6affc6720 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.579+0000 7f00a3be4b80 1 -- 172.21.15.82:0/4236755756 >> 172.21.15.82:0/4236755756 conn(0x55d6aff3a090 msgr2=0x55d6affc0250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:27.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.579+0000 7f00a3be4b80 1 -- 172.21.15.82:0/4236755756 shutdown_connections 2023-09-23T08:56:27.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.579+0000 7f00a3be4b80 1 -- 172.21.15.82:0/4236755756 wait complete. 2023-09-23T08:56:27.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.579+0000 7f00a3be4b80 1 -- start start 2023-09-23T08:56:27.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.580+0000 7f00a3be4b80 1 Processor -- start 2023-09-23T08:56:27.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.580+0000 7f00a3be4b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d6affc5980 0x55d6affcf3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:27.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.580+0000 7f00a3be4b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6affc62e0 0x55d6affcf920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:27.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.580+0000 7f00a3be4b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6affc6d00 0x55d6affd6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:27.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.580+0000 7f00a3be4b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6aff17940 con 0x55d6affc6d00 2023-09-23T08:56:27.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.580+0000 7f00a3be4b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6afeb5b60 con 0x55d6affc62e0 2023-09-23T08:56:27.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.580+0000 7f00a3be4b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6afeb5860 con 0x55d6affc5980 2023-09-23T08:56:27.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.580+0000 7f00a3be4b80 10 client.0 _ll_register_callbacks cb 0x55d6afdffa30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T08:56:27.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.580+0000 7f008e79c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6affc6d00 0x55d6affd6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:27.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.581+0000 7f008e79c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6affc6d00 0x55d6affd6960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35288/0 (socket says 172.21.15.82:35288) 2023-09-23T08:56:27.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.581+0000 7f008e79c700 1 -- 172.21.15.82:0/3399804939 learned_addr learned my addr 172.21.15.82:0/3399804939 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:27.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.581+0000 7f008d79a700 1 --2- 172.21.15.82:0/3399804939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6affc62e0 0x55d6affcf920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:27.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.581+0000 7f008e79c700 1 -- 172.21.15.82:0/3399804939 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d6affc5980 msgr2=0x55d6affcf3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:56:27.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.581+0000 7f008e79c700 1 --2- 172.21.15.82:0/3399804939 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d6affc5980 0x55d6affcf3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.581+0000 7f008e79c700 1 -- 172.21.15.82:0/3399804939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6affc62e0 msgr2=0x55d6affcf920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:56:27.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.581+0000 7f008e79c700 1 --2- 172.21.15.82:0/3399804939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6affc62e0 0x55d6affcf920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.581+0000 7f008e79c700 1 -- 172.21.15.82:0/3399804939 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00881a0e70 con 0x55d6affc6d00 2023-09-23T08:56:27.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.581+0000 7f008e79c700 1 --2- 172.21.15.82:0/3399804939 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6affc6d00 0x55d6affd6960 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f0080009320 tx=0x7f0080004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6262bfb4f8d834b server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:27.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.581+0000 7f00717fa700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T08:56:27.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.581+0000 7f00717fa700 1 -- 172.21.15.82:0/3399804939 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f008001f070 con 0x55d6affc6d00 2023-09-23T08:56:27.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.581+0000 7f00a3be4b80 1 -- 172.21.15.82:0/3399804939 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d6aff95170 con 0x55d6affc6d00 2023-09-23T08:56:27.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.581+0000 7f00717fa700 1 -- 172.21.15.82:0/3399804939 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f0080016810 con 0x55d6affc6d00 2023-09-23T08:56:27.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.582+0000 7f00717fa700 1 -- 172.21.15.82:0/3399804939 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f008000e050 con 0x55d6affc6d00 2023-09-23T08:56:27.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.582+0000 7f00a3be4b80 10 client.15339 fetch_fsmap learned FSMap version 26 2023-09-23T08:56:27.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.582+0000 7f00a3be4b80 1 -- 172.21.15.82:0/3399804939 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55d6afd43d90 con 0x55d6affc6d00 2023-09-23T08:56:27.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.582+0000 7f00717fa700 1 -- 172.21.15.82:0/3399804939 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d6aff95170 con 0x55d6affc6d00 2023-09-23T08:56:27.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.582+0000 7f00717fa700 1 -- 172.21.15.82:0/3399804939 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f0080023840 con 0x55d6affc6d00 2023-09-23T08:56:27.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.582+0000 7f00a3be4b80 10 client.15339 fetch_fsmap finished waiting for FSMap version 26 2023-09-23T08:56:27.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.582+0000 7f00a3be4b80 10 client.15339 resolve_mds: resolved name 'i' to daemon mds.i 2023-09-23T08:56:27.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.582+0000 7f00a3be4b80 20 client.15339 populate_metadata read hostname 'smithi082' 2023-09-23T08:56:27.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.582+0000 7f00a3be4b80 1 --2- 172.21.15.82:0/3399804939 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x55d6affdafe0 0x55d6affd9a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:27.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.582+0000 7f00a3be4b80 4 client.15339 mds_command: new command op to 24550 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T08:56:27.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.582+0000 7f00a3be4b80 1 -- 172.21.15.82:0/3399804939 --> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d6afebdb50 con 0x55d6affdafe0 2023-09-23T08:56:27.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.583+0000 7f008df9b700 1 --2- 172.21.15.82:0/3399804939 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x55d6affdafe0 0x55d6affd9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:27.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.583+0000 7f00717fa700 10 client.15339 ms_handle_connect on v2:172.21.15.161:6838/758982817 2023-09-23T08:56:27.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.583+0000 7f008df9b700 1 --2- 172.21.15.82:0/3399804939 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x55d6affdafe0 0x55d6affd9a60 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5aa4a8bc75f29f90 server_cookie=60f31b9ded693fb7 in_seq=0 out_seq=0 2023-09-23T08:56:27.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.584+0000 7f00717fa700 1 -- 172.21.15.82:0/3399804939 <== mds.1 v2:172.21.15.161:6838/758982817 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55d6afebdb50 con 0x55d6affdafe0 2023-09-23T08:56:27.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.584+0000 7f00717fa700 10 client.15339 handle_command_reply: tid=0 2023-09-23T08:56:27.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.584+0000 7f00a3be4b80 1 client.15339 shutdown 2023-09-23T08:56:27.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.585+0000 7f00a3be4b80 1 -- 172.21.15.82:0/3399804939 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6affc6d00 msgr2=0x55d6affd6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:27.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.585+0000 7f00a3be4b80 1 --2- 172.21.15.82:0/3399804939 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6affc6d00 0x55d6affd6960 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f0080009320 tx=0x7f0080004b40 comp rx=0 tx=0).stop 2023-09-23T08:56:27.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.585+0000 7f00a3be4b80 1 -- 172.21.15.82:0/3399804939 shutdown_connections 2023-09-23T08:56:27.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.585+0000 7f00a3be4b80 1 --2- 172.21.15.82:0/3399804939 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x55d6affdafe0 0x55d6affd9a60 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.585+0000 7f00a3be4b80 1 --2- 172.21.15.82:0/3399804939 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6affc6d00 0x55d6affd6960 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.585+0000 7f00a3be4b80 1 --2- 172.21.15.82:0/3399804939 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d6affc5980 0x55d6affcf3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.585+0000 7f00a3be4b80 1 --2- 172.21.15.82:0/3399804939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6affc62e0 0x55d6affcf920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.585+0000 7f00717fa700 0 client.15339 ms_handle_reset on v2:172.21.15.161:6838/758982817 2023-09-23T08:56:27.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.585+0000 7f00a3be4b80 1 -- 172.21.15.82:0/3399804939 >> 172.21.15.82:0/3399804939 conn(0x55d6aff3a090 msgr2=0x55d6affbaaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:27.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.585+0000 7f00a3be4b80 1 -- 172.21.15.82:0/3399804939 shutdown_connections 2023-09-23T08:56:27.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.585+0000 7f00a3be4b80 1 -- 172.21.15.82:0/3399804939 wait complete. 2023-09-23T08:56:27.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.585+0000 7f00a3be4b80 20 client.15339 trim_cache size 0 max 16384 2023-09-23T08:56:27.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.603+0000 7f00a3be4b80 1 Processor -- start 2023-09-23T08:56:27.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.603+0000 7f00a3be4b80 1 -- start start 2023-09-23T08:56:27.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.603+0000 7f00a3be4b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d6affc5980 0x55d6affce0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:27.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.603+0000 7f00a3be4b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6affc62e0 0x55d6affd6880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:27.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.603+0000 7f00a3be4b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6affc6d00 0x55d6affc9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:27.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.603+0000 7f00a3be4b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6afd998d0 con 0x55d6affc6d00 2023-09-23T08:56:27.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.603+0000 7f00a3be4b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6afed7df0 con 0x55d6affc62e0 2023-09-23T08:56:27.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.603+0000 7f00a3be4b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6afda5de0 con 0x55d6affc5980 2023-09-23T08:56:27.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.603+0000 7f008e79c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6affc6d00 0x55d6affc9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:27.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.603+0000 7f008e79c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6affc6d00 0x55d6affc9bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35300/0 (socket says 172.21.15.82:35300) 2023-09-23T08:56:27.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.603+0000 7f008e79c700 1 -- 172.21.15.82:0/2194087800 learned_addr learned my addr 172.21.15.82:0/2194087800 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:27.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.603+0000 7f008df9b700 1 --2- 172.21.15.82:0/2194087800 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d6affc5980 0x55d6affce0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:27.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.603+0000 7f008d79a700 1 --2- 172.21.15.82:0/2194087800 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6affc62e0 0x55d6affd6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:27.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.604+0000 7f008e79c700 1 -- 172.21.15.82:0/2194087800 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d6affc5980 msgr2=0x55d6affce0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:56:27.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.604+0000 7f008e79c700 1 --2- 172.21.15.82:0/2194087800 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d6affc5980 0x55d6affce0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.604+0000 7f008e79c700 1 -- 172.21.15.82:0/2194087800 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6affc62e0 msgr2=0x55d6affd6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:56:27.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.604+0000 7f008e79c700 1 --2- 172.21.15.82:0/2194087800 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6affc62e0 0x55d6affd6880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.604+0000 7f008e79c700 1 -- 172.21.15.82:0/2194087800 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d6afd2cc10 con 0x55d6affc6d00 2023-09-23T08:56:27.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.604+0000 7f008d79a700 1 --2- 172.21.15.82:0/2194087800 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6affc62e0 0x55d6affd6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T08:56:27.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.604+0000 7f008e79c700 1 --2- 172.21.15.82:0/2194087800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6affc6d00 0x55d6affc9bc0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f0080007c20 tx=0x7f00800095e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13efdd530197c918 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:27.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.604+0000 7f007cff9700 1 -- 172.21.15.82:0/2194087800 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f008001f070 con 0x55d6affc6d00 2023-09-23T08:56:27.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.604+0000 7f007cff9700 1 -- 172.21.15.82:0/2194087800 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f008000f040 con 0x55d6affc6d00 2023-09-23T08:56:27.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.604+0000 7f007cff9700 1 -- 172.21.15.82:0/2194087800 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f008000e040 con 0x55d6affc6d00 2023-09-23T08:56:27.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.605+0000 7f00a3be4b80 1 -- 172.21.15.82:0/2194087800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6affc6d00 msgr2=0x55d6affc9bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:27.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.605+0000 7f00a3be4b80 1 --2- 172.21.15.82:0/2194087800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6affc6d00 0x55d6affc9bc0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f0080007c20 tx=0x7f00800095e0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.605+0000 7f00a3be4b80 1 -- 172.21.15.82:0/2194087800 shutdown_connections 2023-09-23T08:56:27.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.605+0000 7f00a3be4b80 1 --2- 172.21.15.82:0/2194087800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6affc6d00 0x55d6affc9bc0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.605+0000 7f00a3be4b80 1 --2- 172.21.15.82:0/2194087800 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d6affc5980 0x55d6affce0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.605+0000 7f00a3be4b80 1 --2- 172.21.15.82:0/2194087800 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6affc62e0 0x55d6affd6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.605+0000 7f00a3be4b80 1 -- 172.21.15.82:0/2194087800 >> 172.21.15.82:0/2194087800 conn(0x55d6aff3a090 msgr2=0x55d6affb9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:27.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.605+0000 7f00a3be4b80 1 -- 172.21.15.82:0/2194087800 shutdown_connections 2023-09-23T08:56:27.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.605+0000 7f00a3be4b80 1 -- 172.21.15.82:0/2194087800 wait complete. 2023-09-23T08:56:27.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.605+0000 7f00a3be4b80 1 -- start start 2023-09-23T08:56:27.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.606+0000 7f00a3be4b80 1 Processor -- start 2023-09-23T08:56:27.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.606+0000 7f00a3be4b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6affc5980 0x55d6affba260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:27.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.606+0000 7f00a3be4b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d6affc62e0 0x55d6affd6880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:27.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.606+0000 7f00a3be4b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6affc6d00 0x55d6affba7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:27.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.606+0000 7f00a3be4b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6affbadb0 con 0x55d6affc5980 2023-09-23T08:56:27.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.606+0000 7f00a3be4b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6affbaf20 con 0x55d6affc6d00 2023-09-23T08:56:27.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.606+0000 7f00a3be4b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6affbb0e0 con 0x55d6affc62e0 2023-09-23T08:56:27.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.606+0000 7f00a3be4b80 10 client.0 _ll_register_callbacks cb 0x7f008001a7d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T08:56:27.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.606+0000 7f008df9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6affc5980 0x55d6affba260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:27.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.606+0000 7f008df9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6affc5980 0x55d6affba260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35314/0 (socket says 172.21.15.82:35314) 2023-09-23T08:56:27.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.606+0000 7f008df9b700 1 -- 172.21.15.82:0/1522805983 learned_addr learned my addr 172.21.15.82:0/1522805983 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:27.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.607+0000 7f008df9b700 1 -- 172.21.15.82:0/1522805983 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d6affc62e0 msgr2=0x55d6affd6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:56:27.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.607+0000 7f008d79a700 1 --2- 172.21.15.82:0/1522805983 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d6affc62e0 0x55d6affd6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:27.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.607+0000 7f008df9b700 1 --2- 172.21.15.82:0/1522805983 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d6affc62e0 0x55d6affd6880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.607+0000 7f008df9b700 1 -- 172.21.15.82:0/1522805983 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6affc6d00 msgr2=0x55d6affba7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:56:27.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.607+0000 7f008df9b700 1 --2- 172.21.15.82:0/1522805983 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6affc6d00 0x55d6affba7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.607+0000 7f008df9b700 1 -- 172.21.15.82:0/1522805983 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d6afd43d90 con 0x55d6affc5980 2023-09-23T08:56:27.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.607+0000 7f008d79a700 1 --2- 172.21.15.82:0/1522805983 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d6affc62e0 0x55d6affd6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T08:56:27.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.607+0000 7f008df9b700 1 --2- 172.21.15.82:0/1522805983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6affc5980 0x55d6affba260 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f0084009350 tx=0x7f00840246b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd797ac52ef40142 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:27.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.607+0000 7f00717fa700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T08:56:27.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.607+0000 7f00717fa700 1 -- 172.21.15.82:0/1522805983 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0084024b90 con 0x55d6affc5980 2023-09-23T08:56:27.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.607+0000 7f00a3be4b80 1 -- 172.21.15.82:0/1522805983 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d6affb8860 con 0x55d6affc5980 2023-09-23T08:56:27.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.607+0000 7f00717fa700 1 -- 172.21.15.82:0/1522805983 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f0084024cf0 con 0x55d6affc5980 2023-09-23T08:56:27.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.607+0000 7f00717fa700 1 -- 172.21.15.82:0/1522805983 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0084033030 con 0x55d6affc5980 2023-09-23T08:56:27.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.608+0000 7f00a3be4b80 10 client.15345 fetch_fsmap learned FSMap version 26 2023-09-23T08:56:27.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.608+0000 7f00a3be4b80 1 -- 172.21.15.82:0/1522805983 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55d6afd6a200 con 0x55d6affc5980 2023-09-23T08:56:27.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.608+0000 7f00717fa700 1 -- 172.21.15.82:0/1522805983 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d6affb8860 con 0x55d6affc5980 2023-09-23T08:56:27.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.608+0000 7f00717fa700 1 -- 172.21.15.82:0/1522805983 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f0084022050 con 0x55d6affc5980 2023-09-23T08:56:27.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.608+0000 7f00a3be4b80 10 client.15345 fetch_fsmap finished waiting for FSMap version 26 2023-09-23T08:56:27.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.608+0000 7f00a3be4b80 10 client.15345 resolve_mds: resolved name 'i' to daemon mds.i 2023-09-23T08:56:27.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.608+0000 7f00a3be4b80 20 client.15345 populate_metadata read hostname 'smithi082' 2023-09-23T08:56:27.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.608+0000 7f00a3be4b80 1 --2- 172.21.15.82:0/1522805983 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x55d6b0033b50 0x55d6b002ff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:27.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.608+0000 7f00a3be4b80 4 client.15345 mds_command: new command op to 24550 tid=0[{"prefix": "status"}] 2023-09-23T08:56:27.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.608+0000 7f00a3be4b80 1 -- 172.21.15.82:0/1522805983 --> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d6aff10920 con 0x55d6b0033b50 2023-09-23T08:56:27.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.608+0000 7f008d79a700 1 --2- 172.21.15.82:0/1522805983 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x55d6b0033b50 0x55d6b002ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:27.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.609+0000 7f008d79a700 1 --2- 172.21.15.82:0/1522805983 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x55d6b0033b50 0x55d6b002ff30 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5254f8dcc7ea61ef server_cookie=17a35fbf6f3905d in_seq=0 out_seq=0 2023-09-23T08:56:27.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.609+0000 7f00717fa700 10 client.15345 ms_handle_connect on v2:172.21.15.161:6838/758982817 2023-09-23T08:56:27.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.609+0000 7f00717fa700 1 -- 172.21.15.82:0/1522805983 <== mds.1 v2:172.21.15.161:6838/758982817 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55d6aff10920 con 0x55d6b0033b50 2023-09-23T08:56:27.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.609+0000 7f00717fa700 10 client.15345 handle_command_reply: tid=0 2023-09-23T08:56:27.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.609+0000 7f00a3be4b80 1 client.15345 shutdown 2023-09-23T08:56:27.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.609+0000 7f00a3be4b80 1 -- 172.21.15.82:0/1522805983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6affc5980 msgr2=0x55d6affba260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:27.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.609+0000 7f00a3be4b80 1 --2- 172.21.15.82:0/1522805983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6affc5980 0x55d6affba260 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f0084009350 tx=0x7f00840246b0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.609+0000 7f00a3be4b80 1 -- 172.21.15.82:0/1522805983 shutdown_connections 2023-09-23T08:56:27.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.609+0000 7f00a3be4b80 1 --2- 172.21.15.82:0/1522805983 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x55d6b0033b50 0x55d6b002ff30 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.609+0000 7f00a3be4b80 1 --2- 172.21.15.82:0/1522805983 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6affc6d00 0x55d6affba7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.609+0000 7f00a3be4b80 1 --2- 172.21.15.82:0/1522805983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6affc5980 0x55d6affba260 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.609+0000 7f00717fa700 0 client.15345 ms_handle_reset on v2:172.21.15.161:6838/758982817 2023-09-23T08:56:27.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.609+0000 7f00a3be4b80 1 --2- 172.21.15.82:0/1522805983 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d6affc62e0 0x55d6affd6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.609+0000 7f00a3be4b80 1 -- 172.21.15.82:0/1522805983 >> 172.21.15.82:0/1522805983 conn(0x55d6aff3a090 msgr2=0x55d6affce0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:27.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.610+0000 7f00a3be4b80 1 -- 172.21.15.82:0/1522805983 shutdown_connections 2023-09-23T08:56:27.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.610+0000 7f00a3be4b80 1 -- 172.21.15.82:0/1522805983 wait complete. 2023-09-23T08:56:27.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.610+0000 7f00a3be4b80 20 client.15345 trim_cache size 0 max 16384 2023-09-23T08:56:27.618 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T08:56:27.618 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "8926e286-59ed-11ee-8db4-212e2dc638e7", 2023-09-23T08:56:27.619 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 1, 2023-09-23T08:56:27.619 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 24550, 2023-09-23T08:56:27.619 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2023-09-23T08:56:27.619 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2023-09-23T08:56:27.619 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2023-09-23T08:56:27.619 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 91.202038228000006, 2023-09-23T08:56:27.619 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 26, 2023-09-23T08:56:27.619 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 88, 2023-09-23T08:56:27.619 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 86, 2023-09-23T08:56:27.619 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 111.147911444 2023-09-23T08:56:27.619 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T08:56:27.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.610+0000 7f00901ff700 1 -- 172.21.15.82:0/2997129683 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f007409ff50 msgr2=0x7f00740a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:27.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.610+0000 7f00901ff700 1 --2- 172.21.15.82:0/2997129683 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f007409ff50 0x7f00740a2410 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f0080009460 tx=0x7f0080009920 comp rx=0 tx=0).stop 2023-09-23T08:56:27.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.610+0000 7f00901ff700 1 -- 172.21.15.82:0/2997129683 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0088101b20 msgr2=0x7f0088198d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:27.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.610+0000 7f00901ff700 1 --2- 172.21.15.82:0/2997129683 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0088101b20 0x7f0088198d70 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f007800b530 tx=0x7f007800b8f0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.610+0000 7f00901ff700 1 -- 172.21.15.82:0/2997129683 shutdown_connections 2023-09-23T08:56:27.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.610+0000 7f00901ff700 1 --2- 172.21.15.82:0/2997129683 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f007409ff50 0x7f00740a2410 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.610+0000 7f00901ff700 1 --2- 172.21.15.82:0/2997129683 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00881024c0 0x7f008819fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.610+0000 7f00901ff700 1 --2- 172.21.15.82:0/2997129683 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0088100930 0x7f0088198830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.610+0000 7f00901ff700 1 --2- 172.21.15.82:0/2997129683 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0088101b20 0x7f0088198d70 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.610+0000 7f00901ff700 1 -- 172.21.15.82:0/2997129683 >> 172.21.15.82:0/2997129683 conn(0x7f00880fbea0 msgr2=0x7f00880fe1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:27.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.611+0000 7f00901ff700 1 -- 172.21.15.82:0/2997129683 shutdown_connections 2023-09-23T08:56:27.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.611+0000 7f00901ff700 1 -- 172.21.15.82:0/2997129683 wait complete. 2023-09-23T08:56:27.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:27 smithi082 ceph-mon[97694]: pgmap v350: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 511 B/s wr, 11 op/s 2023-09-23T08:56:27.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:27 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/1815227085' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-23T08:56:27.631 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-09-23T08:56:27.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:27 smithi135 ceph-mon[99205]: pgmap v350: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 511 B/s wr, 11 op/s 2023-09-23T08:56:27.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:27 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/1815227085' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-23T08:56:27.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.827+0000 7fa3879ff700 1 -- 172.21.15.82:0/3534703892 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3801024c0 msgr2=0x7fa380108d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:27.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.827+0000 7fa3879ff700 1 --2- 172.21.15.82:0/3534703892 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3801024c0 0x7fa380108d70 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fa37800b0d0 tx=0x7fa37800b3e0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.827+0000 7fa3879ff700 1 -- 172.21.15.82:0/3534703892 shutdown_connections 2023-09-23T08:56:27.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.827+0000 7fa3879ff700 1 --2- 172.21.15.82:0/3534703892 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3801024c0 0x7fa380108d70 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.827+0000 7fa3879ff700 1 --2- 172.21.15.82:0/3534703892 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa380100930 0x7fa380100d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.827+0000 7fa3879ff700 1 --2- 172.21.15.82:0/3534703892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa380101b20 0x7fa380101f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.827+0000 7fa3879ff700 1 -- 172.21.15.82:0/3534703892 >> 172.21.15.82:0/3534703892 conn(0x7fa3800fbea0 msgr2=0x7fa3800fe2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:27.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.827+0000 7fa3879ff700 1 -- 172.21.15.82:0/3534703892 shutdown_connections 2023-09-23T08:56:27.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.827+0000 7fa3879ff700 1 -- 172.21.15.82:0/3534703892 wait complete. 2023-09-23T08:56:27.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.828+0000 7fa3879ff700 1 Processor -- start 2023-09-23T08:56:27.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.828+0000 7fa3879ff700 1 -- start start 2023-09-23T08:56:27.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.829+0000 7fa3879ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa380100930 0x7fa3800746d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:27.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.829+0000 7fa3879ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa380101b20 0x7fa380072d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:27.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.829+0000 7fa3879ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3801024c0 0x7fa380073250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:27.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.829+0000 7fa3879ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3800739f0 con 0x7fa380101b20 2023-09-23T08:56:27.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.829+0000 7fa3879ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa380073b60 con 0x7fa3801024c0 2023-09-23T08:56:27.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.829+0000 7fa3879ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3801a05f0 con 0x7fa380100930 2023-09-23T08:56:27.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.829+0000 7fa384f9a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa380101b20 0x7fa380072d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:27.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.829+0000 7fa384f9a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa380101b20 0x7fa380072d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35332/0 (socket says 172.21.15.82:35332) 2023-09-23T08:56:27.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.829+0000 7fa384f9a700 1 -- 172.21.15.82:0/1288969986 learned_addr learned my addr 172.21.15.82:0/1288969986 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:27.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.829+0000 7fa38579b700 1 --2- 172.21.15.82:0/1288969986 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa380100930 0x7fa3800746d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:27.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.830+0000 7fa385f9c700 1 --2- 172.21.15.82:0/1288969986 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3801024c0 0x7fa380073250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:27.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.830+0000 7fa384f9a700 1 -- 172.21.15.82:0/1288969986 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa380100930 msgr2=0x7fa3800746d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:27.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.830+0000 7fa384f9a700 1 --2- 172.21.15.82:0/1288969986 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa380100930 0x7fa3800746d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.830+0000 7fa384f9a700 1 -- 172.21.15.82:0/1288969986 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3801024c0 msgr2=0x7fa380073250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:27.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.830+0000 7fa384f9a700 1 --2- 172.21.15.82:0/1288969986 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3801024c0 0x7fa380073250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.830+0000 7fa384f9a700 1 -- 172.21.15.82:0/1288969986 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa378009d00 con 0x7fa380101b20 2023-09-23T08:56:27.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.830+0000 7fa38579b700 1 --2- 172.21.15.82:0/1288969986 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa380100930 0x7fa3800746d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T08:56:27.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.830+0000 7fa385f9c700 1 --2- 172.21.15.82:0/1288969986 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3801024c0 0x7fa380073250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T08:56:27.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.830+0000 7fa384f9a700 1 --2- 172.21.15.82:0/1288969986 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa380101b20 0x7fa380072d10 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fa37000c9b0 tx=0x7fa37000cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:27.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.830+0000 7fa3767fc700 1 -- 172.21.15.82:0/1288969986 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa370007b00 con 0x7fa380101b20 2023-09-23T08:56:27.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.830+0000 7fa3767fc700 1 -- 172.21.15.82:0/1288969986 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa370007c60 con 0x7fa380101b20 2023-09-23T08:56:27.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.830+0000 7fa3879ff700 1 -- 172.21.15.82:0/1288969986 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3801a08d0 con 0x7fa380101b20 2023-09-23T08:56:27.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.830+0000 7fa3767fc700 1 -- 172.21.15.82:0/1288969986 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa370018660 con 0x7fa380101b20 2023-09-23T08:56:27.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.830+0000 7fa3879ff700 1 -- 172.21.15.82:0/1288969986 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3801a0de0 con 0x7fa380101b20 2023-09-23T08:56:27.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.833+0000 7fa3767fc700 1 -- 172.21.15.82:0/1288969986 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 134671+0+0 (secure 0 0 0) 0x7fa37000f450 con 0x7fa380101b20 2023-09-23T08:56:27.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.834+0000 7fa3767fc700 1 --2- 172.21.15.82:0/1288969986 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fa36c09ff50 0x7fa36c0a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:27.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.834+0000 7fa39b3dcb80 1 Processor -- start 2023-09-23T08:56:27.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.835+0000 7fa3767fc700 1 -- 172.21.15.82:0/1288969986 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fa3700cb310 con 0x7fa380101b20 2023-09-23T08:56:27.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.835+0000 7fa39b3dcb80 1 -- start start 2023-09-23T08:56:27.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.835+0000 7fa38579b700 1 --2- 172.21.15.82:0/1288969986 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fa36c09ff50 0x7fa36c0a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:27.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.835+0000 7fa39b3dcb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561383e97980 0x561383e97da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:27.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.835+0000 7fa39b3dcb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561383e982e0 0x561383e98720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:27.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.835+0000 7fa39b3dcb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561383e98d00 0x561383e99180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:27.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.835+0000 7fa39b3dcb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561383dff760 con 0x561383e97980 2023-09-23T08:56:27.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.835+0000 7fa39b3dcb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561383df0730 con 0x561383e98d00 2023-09-23T08:56:27.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.835+0000 7fa39b3dcb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x561383dee050 con 0x561383e982e0 2023-09-23T08:56:27.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.835+0000 7fa38579b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561383e97980 0x561383e97da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:27.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.835+0000 7fa38579b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561383e97980 0x561383e97da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35338/0 (socket says 172.21.15.82:35338) 2023-09-23T08:56:27.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.836+0000 7fa38579b700 1 -- 172.21.15.82:0/2693195080 learned_addr learned my addr 172.21.15.82:0/2693195080 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:27.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.836+0000 7fa384f9a700 1 --2- 172.21.15.82:0/2693195080 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561383e982e0 0x561383e98720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:27.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.836+0000 7fa38579b700 1 --2- 172.21.15.82:0/1288969986 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fa36c09ff50 0x7fa36c0a2410 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fa380101980 tx=0x7fa37c010370 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:27.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.836+0000 7fa385f9c700 1 --2- 172.21.15.82:0/2693195080 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561383e98d00 0x561383e99180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:27.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.836+0000 7fa38579b700 1 -- 172.21.15.82:0/2693195080 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561383e982e0 msgr2=0x561383e98720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:56:27.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.836+0000 7fa38579b700 1 --2- 172.21.15.82:0/2693195080 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561383e982e0 0x561383e98720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.836+0000 7fa38579b700 1 -- 172.21.15.82:0/2693195080 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561383e98d00 msgr2=0x561383e99180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:56:27.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.836+0000 7fa38579b700 1 --2- 172.21.15.82:0/2693195080 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561383e98d00 0x561383e99180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.836+0000 7fa38579b700 1 -- 172.21.15.82:0/2693195080 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561383c695e0 con 0x561383e97980 2023-09-23T08:56:27.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.836+0000 7fa38579b700 1 --2- 172.21.15.82:0/2693195080 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561383e97980 0x561383e97da0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fa37c005d30 tx=0x7fa37c01b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6ad8c18bcde64dd server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:27.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.836+0000 7fa36b7fe700 1 -- 172.21.15.82:0/2693195080 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37c013e20 con 0x561383e97980 2023-09-23T08:56:27.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.836+0000 7fa36b7fe700 1 -- 172.21.15.82:0/2693195080 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa37c004cc0 con 0x561383e97980 2023-09-23T08:56:27.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.836+0000 7fa36b7fe700 1 -- 172.21.15.82:0/2693195080 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37c005700 con 0x561383e97980 2023-09-23T08:56:27.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.837+0000 7fa39b3dcb80 1 -- 172.21.15.82:0/2693195080 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561383e97980 msgr2=0x561383e97da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:27.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.837+0000 7fa39b3dcb80 1 --2- 172.21.15.82:0/2693195080 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561383e97980 0x561383e97da0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fa37c005d30 tx=0x7fa37c01b000 comp rx=0 tx=0).stop 2023-09-23T08:56:27.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.837+0000 7fa39b3dcb80 1 -- 172.21.15.82:0/2693195080 shutdown_connections 2023-09-23T08:56:27.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.837+0000 7fa39b3dcb80 1 --2- 172.21.15.82:0/2693195080 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561383e98d00 0x561383e99180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.837+0000 7fa39b3dcb80 1 --2- 172.21.15.82:0/2693195080 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561383e97980 0x561383e97da0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.837+0000 7fa39b3dcb80 1 --2- 172.21.15.82:0/2693195080 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561383e982e0 0x561383e98720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.837+0000 7fa39b3dcb80 1 -- 172.21.15.82:0/2693195080 >> 172.21.15.82:0/2693195080 conn(0x561383e0c090 msgr2=0x561383e92250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:27.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.837+0000 7fa39b3dcb80 1 -- 172.21.15.82:0/2693195080 shutdown_connections 2023-09-23T08:56:27.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.837+0000 7fa39b3dcb80 1 -- 172.21.15.82:0/2693195080 wait complete. 2023-09-23T08:56:27.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.838+0000 7fa39b3dcb80 1 -- start start 2023-09-23T08:56:27.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.838+0000 7fa39b3dcb80 1 Processor -- start 2023-09-23T08:56:27.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.838+0000 7fa39b3dcb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561383e97980 0x561383ea13e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:27.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.838+0000 7fa39b3dcb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561383e982e0 0x561383ea1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:27.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.838+0000 7fa39b3dcb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561383e98d00 0x561383ea8960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:27.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.838+0000 7fa39b3dcb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561383de9940 con 0x561383e98d00 2023-09-23T08:56:27.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.838+0000 7fa39b3dcb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561383d87b60 con 0x561383e982e0 2023-09-23T08:56:27.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.838+0000 7fa39b3dcb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x561383d87860 con 0x561383e97980 2023-09-23T08:56:27.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.838+0000 7fa39b3dcb80 10 client.0 _ll_register_callbacks cb 0x561383cd1a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T08:56:27.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.839+0000 7fa38579b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561383e97980 0x561383ea13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:27.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.839+0000 7fa385f9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561383e98d00 0x561383ea8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:27.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.839+0000 7fa384f9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561383e982e0 0x561383ea1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:27.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.839+0000 7fa385f9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561383e98d00 0x561383ea8960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35344/0 (socket says 172.21.15.82:35344) 2023-09-23T08:56:27.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.839+0000 7fa38579b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561383e97980 0x561383ea13e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:48340/0 (socket says 172.21.15.82:48340) 2023-09-23T08:56:27.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.839+0000 7fa385f9c700 1 -- 172.21.15.82:0/4012017074 learned_addr learned my addr 172.21.15.82:0/4012017074 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:27.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.839+0000 7fa385f9c700 1 -- 172.21.15.82:0/4012017074 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561383e97980 msgr2=0x561383ea13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:56:27.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.839+0000 7fa385f9c700 1 --2- 172.21.15.82:0/4012017074 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561383e97980 0x561383ea13e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.839+0000 7fa385f9c700 1 -- 172.21.15.82:0/4012017074 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561383e982e0 msgr2=0x561383ea1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:56:27.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.839+0000 7fa385f9c700 1 --2- 172.21.15.82:0/4012017074 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561383e982e0 0x561383ea1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.839+0000 7fa385f9c700 1 -- 172.21.15.82:0/4012017074 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa37c010b30 con 0x561383e98d00 2023-09-23T08:56:27.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.839+0000 7fa384f9a700 1 --2- 172.21.15.82:0/4012017074 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561383e982e0 0x561383ea1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T08:56:27.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.840+0000 7fa385f9c700 1 --2- 172.21.15.82:0/4012017074 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561383e98d00 0x561383ea8960 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fa3780062a0 tx=0x7fa378007e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4874ec3cc6b08fe8 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:27.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.840+0000 7fa368ff9700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T08:56:27.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.840+0000 7fa368ff9700 1 -- 172.21.15.82:0/4012017074 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37800e070 con 0x561383e98d00 2023-09-23T08:56:27.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.840+0000 7fa39b3dcb80 1 -- 172.21.15.82:0/4012017074 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561383e67170 con 0x561383e98d00 2023-09-23T08:56:27.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.840+0000 7fa368ff9700 1 -- 172.21.15.82:0/4012017074 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fa378007770 con 0x561383e98d00 2023-09-23T08:56:27.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.840+0000 7fa368ff9700 1 -- 172.21.15.82:0/4012017074 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa37800baa0 con 0x561383e98d00 2023-09-23T08:56:27.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.840+0000 7fa39b3dcb80 10 client.15357 fetch_fsmap learned FSMap version 26 2023-09-23T08:56:27.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.840+0000 7fa39b3dcb80 1 -- 172.21.15.82:0/4012017074 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x561383c15d90 con 0x561383e98d00 2023-09-23T08:56:27.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.840+0000 7fa368ff9700 1 -- 172.21.15.82:0/4012017074 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x561383e67170 con 0x561383e98d00 2023-09-23T08:56:27.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.840+0000 7fa368ff9700 1 -- 172.21.15.82:0/4012017074 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fa37802d070 con 0x561383e98d00 2023-09-23T08:56:27.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.840+0000 7fa39b3dcb80 10 client.15357 fetch_fsmap finished waiting for FSMap version 26 2023-09-23T08:56:27.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.841+0000 7fa39b3dcb80 10 client.15357 resolve_mds: resolved name 'b' to daemon mds.b 2023-09-23T08:56:27.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.841+0000 7fa39b3dcb80 20 client.15357 populate_metadata read hostname 'smithi082' 2023-09-23T08:56:27.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.841+0000 7fa39b3dcb80 1 --2- 172.21.15.82:0/4012017074 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x561383eacf90 0x561383eaba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:27.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.841+0000 7fa39b3dcb80 4 client.15357 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T08:56:27.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.841+0000 7fa39b3dcb80 1 -- 172.21.15.82:0/4012017074 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561383d8fb50 con 0x561383eacf90 2023-09-23T08:56:27.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.841+0000 7fa38579b700 1 --2- 172.21.15.82:0/4012017074 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x561383eacf90 0x561383eaba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:27.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.842+0000 7fa38579b700 1 --2- 172.21.15.82:0/4012017074 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x561383eacf90 0x561383eaba10 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f183069fdc4f03f server_cookie=fb16046458a0863d in_seq=0 out_seq=0 2023-09-23T08:56:27.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.842+0000 7fa368ff9700 10 client.15357 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T08:56:27.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.842+0000 7fa368ff9700 1 -- 172.21.15.82:0/4012017074 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x561383d8fb50 con 0x561383eacf90 2023-09-23T08:56:27.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.842+0000 7fa368ff9700 10 client.15357 handle_command_reply: tid=0 2023-09-23T08:56:27.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.843+0000 7fa39b3dcb80 1 client.15357 shutdown 2023-09-23T08:56:27.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.843+0000 7fa39b3dcb80 1 -- 172.21.15.82:0/4012017074 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561383e98d00 msgr2=0x561383ea8960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:27.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.843+0000 7fa39b3dcb80 1 --2- 172.21.15.82:0/4012017074 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561383e98d00 0x561383ea8960 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fa3780062a0 tx=0x7fa378007e90 comp rx=0 tx=0).stop 2023-09-23T08:56:27.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.843+0000 7fa39b3dcb80 1 -- 172.21.15.82:0/4012017074 shutdown_connections 2023-09-23T08:56:27.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.843+0000 7fa39b3dcb80 1 --2- 172.21.15.82:0/4012017074 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x561383eacf90 0x561383eaba10 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.843+0000 7fa39b3dcb80 1 --2- 172.21.15.82:0/4012017074 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561383e98d00 0x561383ea8960 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.843+0000 7fa39b3dcb80 1 --2- 172.21.15.82:0/4012017074 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561383e97980 0x561383ea13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.843+0000 7fa39b3dcb80 1 --2- 172.21.15.82:0/4012017074 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561383e982e0 0x561383ea1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.843+0000 7fa39b3dcb80 1 -- 172.21.15.82:0/4012017074 >> 172.21.15.82:0/4012017074 conn(0x561383e0c090 msgr2=0x561383e8caf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:27.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.843+0000 7fa368ff9700 0 client.15357 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T08:56:27.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.843+0000 7fa39b3dcb80 1 -- 172.21.15.82:0/4012017074 shutdown_connections 2023-09-23T08:56:27.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.843+0000 7fa39b3dcb80 1 -- 172.21.15.82:0/4012017074 wait complete. 2023-09-23T08:56:27.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.843+0000 7fa39b3dcb80 20 client.15357 trim_cache size 0 max 16384 2023-09-23T08:56:27.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.861+0000 7fa39b3dcb80 1 Processor -- start 2023-09-23T08:56:27.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.861+0000 7fa39b3dcb80 1 -- start start 2023-09-23T08:56:27.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.861+0000 7fa39b3dcb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561383e0c090 0x561383e9bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:27.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.861+0000 7fa39b3dcb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561383e97980 0x561383e9c240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:27.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.861+0000 7fa39b3dcb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561383e982e0 0x561383ea8880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:27.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.861+0000 7fa39b3dcb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561383c6b8d0 con 0x561383e982e0 2023-09-23T08:56:27.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.861+0000 7fa39b3dcb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561383da9df0 con 0x561383e0c090 2023-09-23T08:56:27.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.861+0000 7fa39b3dcb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x561383c77de0 con 0x561383e97980 2023-09-23T08:56:27.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.862+0000 7fa385f9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561383e982e0 0x561383ea8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:27.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.862+0000 7fa385f9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561383e982e0 0x561383ea8880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35358/0 (socket says 172.21.15.82:35358) 2023-09-23T08:56:27.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.862+0000 7fa385f9c700 1 -- 172.21.15.82:0/3657801585 learned_addr learned my addr 172.21.15.82:0/3657801585 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:27.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.862+0000 7fa38579b700 1 --2- 172.21.15.82:0/3657801585 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561383e0c090 0x561383e9bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:27.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.862+0000 7fa384f9a700 1 --2- 172.21.15.82:0/3657801585 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561383e97980 0x561383e9c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:27.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.862+0000 7fa385f9c700 1 -- 172.21.15.82:0/3657801585 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561383e97980 msgr2=0x561383e9c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:56:27.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.862+0000 7fa385f9c700 1 --2- 172.21.15.82:0/3657801585 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561383e97980 0x561383e9c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.862+0000 7fa385f9c700 1 -- 172.21.15.82:0/3657801585 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561383e0c090 msgr2=0x561383e9bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:56:27.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.862+0000 7fa385f9c700 1 --2- 172.21.15.82:0/3657801585 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561383e0c090 0x561383e9bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.862+0000 7fa385f9c700 1 -- 172.21.15.82:0/3657801585 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561383bfec10 con 0x561383e982e0 2023-09-23T08:56:27.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.862+0000 7fa38579b700 1 --2- 172.21.15.82:0/3657801585 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561383e0c090 0x561383e9bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T08:56:27.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.862+0000 7fa385f9c700 1 --2- 172.21.15.82:0/3657801585 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561383e982e0 0x561383ea8880 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fa378007f80 tx=0x7fa3780095f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bda3ed23b3d452a server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:27.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.862+0000 7fa36bfff700 1 -- 172.21.15.82:0/3657801585 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37800e040 con 0x561383e982e0 2023-09-23T08:56:27.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.862+0000 7fa36bfff700 1 -- 172.21.15.82:0/3657801585 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa37802a070 con 0x561383e982e0 2023-09-23T08:56:27.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.863+0000 7fa36bfff700 1 -- 172.21.15.82:0/3657801585 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa378004a50 con 0x561383e982e0 2023-09-23T08:56:27.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.863+0000 7fa39b3dcb80 1 -- 172.21.15.82:0/3657801585 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561383e982e0 msgr2=0x561383ea8880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:27.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.863+0000 7fa39b3dcb80 1 --2- 172.21.15.82:0/3657801585 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561383e982e0 0x561383ea8880 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fa378007f80 tx=0x7fa3780095f0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.863+0000 7fa39b3dcb80 1 -- 172.21.15.82:0/3657801585 shutdown_connections 2023-09-23T08:56:27.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.863+0000 7fa39b3dcb80 1 --2- 172.21.15.82:0/3657801585 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561383e982e0 0x561383ea8880 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.863+0000 7fa39b3dcb80 1 --2- 172.21.15.82:0/3657801585 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561383e0c090 0x561383e9bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.863+0000 7fa39b3dcb80 1 --2- 172.21.15.82:0/3657801585 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561383e97980 0x561383e9c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.863+0000 7fa39b3dcb80 1 -- 172.21.15.82:0/3657801585 >> 172.21.15.82:0/3657801585 conn(0x561383e92580 msgr2=0x561383ea00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:27.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.863+0000 7fa39b3dcb80 1 -- 172.21.15.82:0/3657801585 shutdown_connections 2023-09-23T08:56:27.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.863+0000 7fa39b3dcb80 1 -- 172.21.15.82:0/3657801585 wait complete. 2023-09-23T08:56:27.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.864+0000 7fa39b3dcb80 1 -- start start 2023-09-23T08:56:27.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.864+0000 7fa39b3dcb80 1 Processor -- start 2023-09-23T08:56:27.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.864+0000 7fa39b3dcb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561383e0c090 0x561383ea85c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:27.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.864+0000 7fa39b3dcb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561383e97980 0x561383ea5160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:27.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.864+0000 7fa39b3dcb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561383e982e0 0x561383ea56a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:27.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.864+0000 7fa39b3dcb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561383ea5c20 con 0x561383e97980 2023-09-23T08:56:27.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.864+0000 7fa39b3dcb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561383ea5d90 con 0x561383e982e0 2023-09-23T08:56:27.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.864+0000 7fa39b3dcb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x561383f009b0 con 0x561383e0c090 2023-09-23T08:56:27.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.864+0000 7fa39b3dcb80 10 client.0 _ll_register_callbacks cb 0x7fa37c005ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T08:56:27.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.864+0000 7fa384f9a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561383e97980 0x561383ea5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:27.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.864+0000 7fa384f9a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561383e97980 0x561383ea5160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35370/0 (socket says 172.21.15.82:35370) 2023-09-23T08:56:27.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.864+0000 7fa384f9a700 1 -- 172.21.15.82:0/3395072235 learned_addr learned my addr 172.21.15.82:0/3395072235 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:27.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.865+0000 7fa38579b700 1 --2- 172.21.15.82:0/3395072235 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561383e0c090 0x561383ea85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:27.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.865+0000 7fa384f9a700 1 -- 172.21.15.82:0/3395072235 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561383e0c090 msgr2=0x561383ea85c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:56:27.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.865+0000 7fa384f9a700 1 --2- 172.21.15.82:0/3395072235 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561383e0c090 0x561383ea85c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.865+0000 7fa384f9a700 1 -- 172.21.15.82:0/3395072235 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561383e982e0 msgr2=0x561383ea56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:56:27.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.865+0000 7fa384f9a700 1 --2- 172.21.15.82:0/3395072235 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561383e982e0 0x561383ea56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.865+0000 7fa384f9a700 1 -- 172.21.15.82:0/3395072235 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561383c15d90 con 0x561383e97980 2023-09-23T08:56:27.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.865+0000 7fa384f9a700 1 --2- 172.21.15.82:0/3395072235 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561383e97980 0x561383ea5160 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fa370098ca0 tx=0x7fa37000a6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bc1d819179e9688 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:27.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.865+0000 7fa368ff9700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T08:56:27.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.865+0000 7fa368ff9700 1 -- 172.21.15.82:0/3395072235 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa370098d10 con 0x561383e97980 2023-09-23T08:56:27.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.865+0000 7fa368ff9700 1 -- 172.21.15.82:0/3395072235 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fa37009cb40 con 0x561383e97980 2023-09-23T08:56:27.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.865+0000 7fa39b3dcb80 1 -- 172.21.15.82:0/3395072235 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561383e8a860 con 0x561383e97980 2023-09-23T08:56:27.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.865+0000 7fa368ff9700 1 -- 172.21.15.82:0/3395072235 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa3700a0b20 con 0x561383e97980 2023-09-23T08:56:27.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.865+0000 7fa39b3dcb80 10 client.15363 fetch_fsmap learned FSMap version 26 2023-09-23T08:56:27.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.865+0000 7fa39b3dcb80 1 -- 172.21.15.82:0/3395072235 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x561383c3c200 con 0x561383e97980 2023-09-23T08:56:27.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.866+0000 7fa368ff9700 1 -- 172.21.15.82:0/3395072235 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa3700c6070 con 0x561383e97980 2023-09-23T08:56:27.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.866+0000 7fa368ff9700 1 -- 172.21.15.82:0/3395072235 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fa3700a0690 con 0x561383e97980 2023-09-23T08:56:27.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.866+0000 7fa39b3dcb80 10 client.15363 fetch_fsmap finished waiting for FSMap version 26 2023-09-23T08:56:27.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.866+0000 7fa39b3dcb80 10 client.15363 resolve_mds: resolved name 'b' to daemon mds.b 2023-09-23T08:56:27.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.866+0000 7fa39b3dcb80 20 client.15363 populate_metadata read hostname 'smithi082' 2023-09-23T08:56:27.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.866+0000 7fa39b3dcb80 1 --2- 172.21.15.82:0/3395072235 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x561383e98d00 0x561383f02170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:27.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.866+0000 7fa39b3dcb80 4 client.15363 mds_command: new command op to 24557 tid=0[{"prefix": "status"}] 2023-09-23T08:56:27.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.866+0000 7fa39b3dcb80 1 -- 172.21.15.82:0/3395072235 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "status"}) v1 -- 0x561383de2920 con 0x561383e98d00 2023-09-23T08:56:27.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.866+0000 7fa38579b700 1 --2- 172.21.15.82:0/3395072235 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x561383e98d00 0x561383f02170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:27.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.867+0000 7fa368ff9700 10 client.15363 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T08:56:27.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.867+0000 7fa38579b700 1 --2- 172.21.15.82:0/3395072235 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x561383e98d00 0x561383f02170 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b56352a04200cb25 server_cookie=461fc5b2075a89fb in_seq=0 out_seq=0 2023-09-23T08:56:27.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.867+0000 7fa368ff9700 1 -- 172.21.15.82:0/3395072235 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x561383de2920 con 0x561383e98d00 2023-09-23T08:56:27.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.867+0000 7fa368ff9700 10 client.15363 handle_command_reply: tid=0 2023-09-23T08:56:27.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.867+0000 7fa39b3dcb80 1 client.15363 shutdown 2023-09-23T08:56:27.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.867+0000 7fa39b3dcb80 1 -- 172.21.15.82:0/3395072235 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561383e97980 msgr2=0x561383ea5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:27.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.867+0000 7fa39b3dcb80 1 --2- 172.21.15.82:0/3395072235 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561383e97980 0x561383ea5160 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fa370098ca0 tx=0x7fa37000a6b0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.867+0000 7fa39b3dcb80 1 -- 172.21.15.82:0/3395072235 shutdown_connections 2023-09-23T08:56:27.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.867+0000 7fa39b3dcb80 1 --2- 172.21.15.82:0/3395072235 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561383e982e0 0x561383ea56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.867+0000 7fa39b3dcb80 1 --2- 172.21.15.82:0/3395072235 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561383e0c090 0x561383ea85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.867+0000 7fa39b3dcb80 1 --2- 172.21.15.82:0/3395072235 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x561383e98d00 0x561383f02170 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.867+0000 7fa39b3dcb80 1 --2- 172.21.15.82:0/3395072235 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561383e97980 0x561383ea5160 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.867+0000 7fa368ff9700 0 client.15363 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T08:56:27.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.867+0000 7fa39b3dcb80 1 -- 172.21.15.82:0/3395072235 >> 172.21.15.82:0/3395072235 conn(0x561383e92580 msgr2=0x561383ea1380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:27.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.867+0000 7fa39b3dcb80 1 -- 172.21.15.82:0/3395072235 shutdown_connections 2023-09-23T08:56:27.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.868+0000 7fa39b3dcb80 1 -- 172.21.15.82:0/3395072235 wait complete. 2023-09-23T08:56:27.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.868+0000 7fa39b3dcb80 20 client.15363 trim_cache size 0 max 16384 2023-09-23T08:56:27.878 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T08:56:27.878 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "8926e286-59ed-11ee-8db4-212e2dc638e7", 2023-09-23T08:56:27.879 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 0, 2023-09-23T08:56:27.879 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 24557, 2023-09-23T08:56:27.879 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2023-09-23T08:56:27.879 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2023-09-23T08:56:27.879 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2023-09-23T08:56:27.879 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 94.458375680000003, 2023-09-23T08:56:27.879 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 26, 2023-09-23T08:56:27.879 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 88, 2023-09-23T08:56:27.879 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 86, 2023-09-23T08:56:27.880 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 102.049650103 2023-09-23T08:56:27.880 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T08:56:27.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.868+0000 7fa3879ff700 1 -- 172.21.15.82:0/1288969986 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fa36c09ff50 msgr2=0x7fa36c0a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:27.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.868+0000 7fa3879ff700 1 --2- 172.21.15.82:0/1288969986 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fa36c09ff50 0x7fa36c0a2410 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fa380101980 tx=0x7fa37c010370 comp rx=0 tx=0).stop 2023-09-23T08:56:27.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.868+0000 7fa3879ff700 1 -- 172.21.15.82:0/1288969986 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa380101b20 msgr2=0x7fa380072d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:27.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.868+0000 7fa3879ff700 1 --2- 172.21.15.82:0/1288969986 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa380101b20 0x7fa380072d10 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fa37000c9b0 tx=0x7fa37000cd70 comp rx=0 tx=0).stop 2023-09-23T08:56:27.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.868+0000 7fa3879ff700 1 -- 172.21.15.82:0/1288969986 shutdown_connections 2023-09-23T08:56:27.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.868+0000 7fa3879ff700 1 --2- 172.21.15.82:0/1288969986 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fa36c09ff50 0x7fa36c0a2410 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.868+0000 7fa3879ff700 1 --2- 172.21.15.82:0/1288969986 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3801024c0 0x7fa380073250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.868+0000 7fa3879ff700 1 --2- 172.21.15.82:0/1288969986 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa380100930 0x7fa3800746d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.868+0000 7fa3879ff700 1 --2- 172.21.15.82:0/1288969986 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa380101b20 0x7fa380072d10 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:27.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.868+0000 7fa3879ff700 1 -- 172.21.15.82:0/1288969986 >> 172.21.15.82:0/1288969986 conn(0x7fa3800fbea0 msgr2=0x7fa380104fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:27.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.868+0000 7fa3879ff700 1 -- 172.21.15.82:0/1288969986 shutdown_connections 2023-09-23T08:56:27.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:27.868+0000 7fa3879ff700 1 -- 172.21.15.82:0/1288969986 wait complete. 2023-09-23T08:56:27.889 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-09-23T08:56:27.949 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-09-23T08:56:27.949 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2023-09-23T08:56:27.949 INFO:tasks.ceph_fuse:client.0 config is {'mntopts': ['context=system_u:object_r:postgresql_db_t:s0'], 'mount_subvol_num': 0, 'mountpoint': '/tmp/cephfs'} 2023-09-23T08:56:27.949 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-09-23T08:56:27.950 INFO:tasks.cephfs.mount:using client_config["hostfs_mntpt"] = /tmp/cephfs 2023-09-23T08:56:27.950 INFO:tasks.cephfs.mount:hostfs_mntpt = /tmp/cephfs 2023-09-23T08:56:27.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-23T08:56:27.950 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2023-09-23T08:56:27.951 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:27 smithi161 ceph-mon[99580]: pgmap v350: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 511 B/s wr, 11 op/s 2023-09-23T08:56:27.952 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:27 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/1815227085' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-23T08:56:27.995 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-23T08:56:27.995 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link delete ceph-brx 2023-09-23T08:56:28.109 INFO:teuthology.orchestra.run.smithi082.stderr:Cannot find device "ceph-brx" 2023-09-23T08:56:28.111 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-23T08:56:28.112 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-09-23T08:56:28.112 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- ceph fs ls 2023-09-23T08:56:28.734 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.a/config 2023-09-23T08:56:29.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:29 smithi082 ceph-mon[97694]: pgmap v351: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 10 op/s 2023-09-23T08:56:29.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:29 smithi135 ceph-mon[99205]: pgmap v351: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 10 op/s 2023-09-23T08:56:29.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:29 smithi161 ceph-mon[99580]: pgmap v351: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 10 op/s 2023-09-23T08:56:30.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:30.374+0000 7fbe3ef12700 1 -- 172.21.15.82:0/2474226073 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe38100940 msgr2=0x7fbe38100dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:30.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:30.374+0000 7fbe3ef12700 1 --2- 172.21.15.82:0/2474226073 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe38100940 0x7fbe38100dc0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fbe24009990 tx=0x7fbe24009ca0 comp rx=0 tx=0).stop 2023-09-23T08:56:30.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:30.374+0000 7fbe3ef12700 1 -- 172.21.15.82:0/2474226073 shutdown_connections 2023-09-23T08:56:30.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:30.374+0000 7fbe3ef12700 1 --2- 172.21.15.82:0/2474226073 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbe38101300 0x7fbe3810d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:30.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:30.374+0000 7fbe3ef12700 1 --2- 172.21.15.82:0/2474226073 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe38106940 0x7fbe38106d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:30.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:30.374+0000 7fbe3ef12700 1 --2- 172.21.15.82:0/2474226073 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe38100940 0x7fbe38100dc0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:30.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:30.374+0000 7fbe3ef12700 1 -- 172.21.15.82:0/2474226073 >> 172.21.15.82:0/2474226073 conn(0x7fbe380fc410 msgr2=0x7fbe380fe830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:30.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:30.374+0000 7fbe3ef12700 1 -- 172.21.15.82:0/2474226073 shutdown_connections 2023-09-23T08:56:30.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:30.374+0000 7fbe3ef12700 1 -- 172.21.15.82:0/2474226073 wait complete. 2023-09-23T08:56:30.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:30.375+0000 7fbe3ef12700 1 Processor -- start 2023-09-23T08:56:30.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:30.376+0000 7fbe3ef12700 1 -- start start 2023-09-23T08:56:30.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:30.376+0000 7fbe3ef12700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbe38100940 0x7fbe38072c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:30.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:30.376+0000 7fbe3ef12700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe38101300 0x7fbe38073160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:30.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:30.376+0000 7fbe3ef12700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe38106940 0x7fbe380736e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:30.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:30.376+0000 7fbe3ef12700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe381a4eb0 con 0x7fbe38106940 2023-09-23T08:56:30.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:30.376+0000 7fbe3ef12700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe381a5020 con 0x7fbe38101300 2023-09-23T08:56:30.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:30.376+0000 7fbe3ef12700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe381a51e0 con 0x7fbe38100940 2023-09-23T08:56:30.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:30.376+0000 7fbe3d4af700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe38106940 0x7fbe380736e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:30.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:30.376+0000 7fbe3d4af700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe38106940 0x7fbe380736e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35392/0 (socket says 172.21.15.82:35392) 2023-09-23T08:56:30.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:30.376+0000 7fbe3d4af700 1 -- 172.21.15.82:0/1633930672 learned_addr learned my addr 172.21.15.82:0/1633930672 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:30.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:30.376+0000 7fbe3ccae700 1 --2- 172.21.15.82:0/1633930672 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbe38100940 0x7fbe38072c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:30.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:30.376+0000 7fbe37fff700 1 --2- 172.21.15.82:0/1633930672 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe38101300 0x7fbe38073160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:30.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:30.377+0000 7fbe3d4af700 1 -- 172.21.15.82:0/1633930672 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbe38100940 msgr2=0x7fbe38072c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:30.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:30.377+0000 7fbe3d4af700 1 --2- 172.21.15.82:0/1633930672 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbe38100940 0x7fbe38072c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:30.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:30.377+0000 7fbe3d4af700 1 -- 172.21.15.82:0/1633930672 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe38101300 msgr2=0x7fbe38073160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:30.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:30.377+0000 7fbe3d4af700 1 --2- 172.21.15.82:0/1633930672 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe38101300 0x7fbe38073160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:30.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:30.377+0000 7fbe3d4af700 1 -- 172.21.15.82:0/1633930672 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe240095f0 con 0x7fbe38106940 2023-09-23T08:56:30.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:30.377+0000 7fbe3d4af700 1 --2- 172.21.15.82:0/1633930672 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe38106940 0x7fbe380736e0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fbe30007ee0 tx=0x7fbe3000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:30.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:30.377+0000 7fbe35ffb700 1 -- 172.21.15.82:0/1633930672 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe30017070 con 0x7fbe38106940 2023-09-23T08:56:30.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:30.377+0000 7fbe35ffb700 1 -- 172.21.15.82:0/1633930672 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbe3000f040 con 0x7fbe38106940 2023-09-23T08:56:30.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:30.377+0000 7fbe3ef12700 1 -- 172.21.15.82:0/1633930672 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe381a54c0 con 0x7fbe38106940 2023-09-23T08:56:30.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:30.377+0000 7fbe35ffb700 1 -- 172.21.15.82:0/1633930672 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe30005570 con 0x7fbe38106940 2023-09-23T08:56:30.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:30.378+0000 7fbe3ef12700 1 -- 172.21.15.82:0/1633930672 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe381a5990 con 0x7fbe38106940 2023-09-23T08:56:30.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:30.379+0000 7fbe3ef12700 1 -- 172.21.15.82:0/1633930672 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe3804e620 con 0x7fbe38106940 2023-09-23T08:56:30.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:30.380+0000 7fbe35ffb700 1 -- 172.21.15.82:0/1633930672 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 134671+0+0 (secure 0 0 0) 0x7fbe3000db20 con 0x7fbe38106940 2023-09-23T08:56:30.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:30.382+0000 7fbe35ffb700 1 --2- 172.21.15.82:0/1633930672 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fbe2809ff50 0x7fbe280a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:30.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:30.382+0000 7fbe35ffb700 1 -- 172.21.15.82:0/1633930672 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fbe300ca9a0 con 0x7fbe38106940 2023-09-23T08:56:30.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:30.382+0000 7fbe3ccae700 1 --2- 172.21.15.82:0/1633930672 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fbe2809ff50 0x7fbe280a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:30.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:30.382+0000 7fbe3ccae700 1 --2- 172.21.15.82:0/1633930672 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fbe2809ff50 0x7fbe280a2410 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c009a10 tx=0x7fbe2c009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:30.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:30.386+0000 7fbe35ffb700 1 -- 172.21.15.82:0/1633930672 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7fbe300946e0 con 0x7fbe38106940 2023-09-23T08:56:30.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:30.634+0000 7fbe3ef12700 1 -- 172.21.15.82:0/1633930672 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fbe38110a80 con 0x7fbe38106940 2023-09-23T08:56:30.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:30.634+0000 7fbe35ffb700 1 -- 172.21.15.82:0/1633930672 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v26) v1 ==== 53+0+73 (secure 0 0 0) 0x7fbe30097d00 con 0x7fbe38106940 2023-09-23T08:56:30.637 INFO:teuthology.orchestra.run.smithi082.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-09-23T08:56:30.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:30.636+0000 7fbe3ef12700 1 -- 172.21.15.82:0/1633930672 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fbe2809ff50 msgr2=0x7fbe280a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:30.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:30.636+0000 7fbe3ef12700 1 --2- 172.21.15.82:0/1633930672 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fbe2809ff50 0x7fbe280a2410 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c009a10 tx=0x7fbe2c009190 comp rx=0 tx=0).stop 2023-09-23T08:56:30.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:30.636+0000 7fbe3ef12700 1 -- 172.21.15.82:0/1633930672 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe38106940 msgr2=0x7fbe380736e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:30.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:30.636+0000 7fbe3ef12700 1 --2- 172.21.15.82:0/1633930672 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe38106940 0x7fbe380736e0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fbe30007ee0 tx=0x7fbe3000d3b0 comp rx=0 tx=0).stop 2023-09-23T08:56:30.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:30.636+0000 7fbe3ef12700 1 -- 172.21.15.82:0/1633930672 shutdown_connections 2023-09-23T08:56:30.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:30.636+0000 7fbe3ef12700 1 --2- 172.21.15.82:0/1633930672 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fbe2809ff50 0x7fbe280a2410 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:30.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:30.636+0000 7fbe3ef12700 1 --2- 172.21.15.82:0/1633930672 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe38106940 0x7fbe380736e0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:30.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:30.636+0000 7fbe3ef12700 1 --2- 172.21.15.82:0/1633930672 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbe38100940 0x7fbe38072c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:30.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:30.637+0000 7fbe3ef12700 1 --2- 172.21.15.82:0/1633930672 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe38101300 0x7fbe38073160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:30.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:30.637+0000 7fbe3ef12700 1 -- 172.21.15.82:0/1633930672 >> 172.21.15.82:0/1633930672 conn(0x7fbe380fc410 msgr2=0x7fbe380fcaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:30.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:30.637+0000 7fbe3ef12700 1 -- 172.21.15.82:0/1633930672 shutdown_connections 2023-09-23T08:56:30.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:30.637+0000 7fbe3ef12700 1 -- 172.21.15.82:0/1633930672 wait complete. 2023-09-23T08:56:30.791 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:30 smithi082 ceph-mon[97694]: pgmap v352: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 10 op/s 2023-09-23T08:56:30.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:30 smithi135 ceph-mon[99205]: pgmap v352: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 10 op/s 2023-09-23T08:56:30.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:30 smithi161 ceph-mon[99580]: pgmap v352: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 10 op/s 2023-09-23T08:56:31.106 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-09-23T08:56:31.107 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-23T08:56:31.107 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi082.front.sepia.ceph.com 2023-09-23T08:56:31.107 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-09-23T08:56:31.107 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /tmp/cephfs 2023-09-23T08:56:31.107 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-09-23T08:56:31.107 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-09-23T08:56:31.107 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-23T08:56:31.107 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/tmp/cephfs' 2023-09-23T08:56:31.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-23T08:56:31.108 DEBUG:teuthology.orchestra.run.smithi082:> ip addr 2023-09-23T08:56:31.153 INFO:teuthology.orchestra.run.smithi082.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-23T08:56:31.153 INFO:teuthology.orchestra.run.smithi082.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-23T08:56:31.153 INFO:teuthology.orchestra.run.smithi082.stdout: inet 127.0.0.1/8 scope host lo 2023-09-23T08:56:31.153 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-09-23T08:56:31.154 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 ::1/128 scope host 2023-09-23T08:56:31.154 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-09-23T08:56:31.154 INFO:teuthology.orchestra.run.smithi082.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-23T08:56:31.154 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c6 brd ff:ff:ff:ff:ff:ff 2023-09-23T08:56:31.154 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f0 2023-09-23T08:56:31.154 INFO:teuthology.orchestra.run.smithi082.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-23T08:56:31.154 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c7 brd ff:ff:ff:ff:ff:ff 2023-09-23T08:56:31.154 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f1 2023-09-23T08:56:31.154 INFO:teuthology.orchestra.run.smithi082.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-23T08:56:31.154 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:fe brd ff:ff:ff:ff:ff:ff 2023-09-23T08:56:31.154 INFO:teuthology.orchestra.run.smithi082.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-23T08:56:31.155 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:ff brd ff:ff:ff:ff:ff:ff 2023-09-23T08:56:31.155 INFO:teuthology.orchestra.run.smithi082.stdout: inet 172.21.15.82/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-09-23T08:56:31.155 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft 41601sec preferred_lft 41601sec 2023-09-23T08:56:31.155 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::4094:8a44:ea89:d02c/64 scope link noprefixroute 2023-09-23T08:56:31.155 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-09-23T08:56:31.155 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-09-23T08:56:31.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-23T08:56:31.156 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec bash -c ' 2023-09-23T08:56:31.156 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2023-09-23T08:56:31.156 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link add name ceph-brx type bridge 2023-09-23T08:56:31.156 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip addr flush dev ceph-brx 2023-09-23T08:56:31.156 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set ceph-brx up 2023-09-23T08:56:31.156 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-09-23T08:56:31.156 DEBUG:teuthology.orchestra.run.smithi082:> ') 2023-09-23T08:56:31.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-23T08:56:31.636 DEBUG:teuthology.orchestra.run.smithi082:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-23T08:56:31.706 INFO:teuthology.orchestra.run.smithi082.stdout:1 2023-09-23T08:56:31.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-23T08:56:31.709 DEBUG:teuthology.orchestra.run.smithi082:> route 2023-09-23T08:56:31.768 INFO:teuthology.orchestra.run.smithi082.stdout:Kernel IP routing table 2023-09-23T08:56:31.768 INFO:teuthology.orchestra.run.smithi082.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-23T08:56:31.768 INFO:teuthology.orchestra.run.smithi082.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-09-23T08:56:31.768 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-09-23T08:56:31.769 INFO:teuthology.orchestra.run.smithi082.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-23T08:56:31.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-23T08:56:31.770 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec bash -c ' 2023-09-23T08:56:31.770 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2023-09-23T08:56:31.770 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-09-23T08:56:31.770 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-09-23T08:56:31.770 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-09-23T08:56:31.770 DEBUG:teuthology.orchestra.run.smithi082:> ') 2023-09-23T08:56:31.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:31 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/1633930672' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-09-23T08:56:31.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:31 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/1633930672' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-09-23T08:56:31.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:31 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/1633930672' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-09-23T08:56:32.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-23T08:56:32.473 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2023-09-23T08:56:32.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-23T08:56:32.518 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list-id 2023-09-23T08:56:32.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-23T08:56:32.602 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec bash -c ' 2023-09-23T08:56:32.603 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2023-09-23T08:56:32.603 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns add ceph-ns--tmp-cephfs 2023-09-23T08:56:32.603 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns set ceph-ns--tmp-cephfs 0 2023-09-23T08:56:32.603 DEBUG:teuthology.orchestra.run.smithi082:> ') 2023-09-23T08:56:32.744 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:32 smithi082 ceph-mon[97694]: pgmap v353: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 597 B/s wr, 11 op/s 2023-09-23T08:56:32.787 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--tmp-cephfs' with 192.168.0.1/16 2023-09-23T08:56:32.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-23T08:56:32.787 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec bash -c ' 2023-09-23T08:56:32.787 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2023-09-23T08:56:32.787 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link add veth0 netns ceph-ns--tmp-cephfs type veth peer name brx.0 2023-09-23T08:56:32.787 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--tmp-cephfs ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-09-23T08:56:32.787 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--tmp-cephfs ip link set veth0 up 2023-09-23T08:56:32.787 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--tmp-cephfs ip link set lo up 2023-09-23T08:56:32.788 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--tmp-cephfs ip route add default via 192.168.255.254 2023-09-23T08:56:32.788 DEBUG:teuthology.orchestra.run.smithi082:> ') 2023-09-23T08:56:32.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:32 smithi135 ceph-mon[99205]: pgmap v353: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 597 B/s wr, 11 op/s 2023-09-23T08:56:32.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:32 smithi161 ceph-mon[99580]: pgmap v353: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 597 B/s wr, 11 op/s 2023-09-23T08:56:33.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-23T08:56:33.091 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec bash -c ' 2023-09-23T08:56:33.091 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2023-09-23T08:56:33.091 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set brx.0 up 2023-09-23T08:56:33.091 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set dev brx.0 master ceph-brx 2023-09-23T08:56:33.091 DEBUG:teuthology.orchestra.run.smithi082:> ') 2023-09-23T08:56:33.266 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'mntopts': ['context=system_u:object_r:postgresql_db_t:s0'], 'mount_subvol_num': 0, 'mountpoint': '/tmp/cephfs'} 2023-09-23T08:56:33.266 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-23T08:56:33.266 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -v /tmp/cephfs 2023-09-23T08:56:33.309 INFO:teuthology.orchestra.run.smithi082.stdout:mkdir: created directory '/tmp/cephfs' 2023-09-23T08:56:33.310 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-23T08:56:33.310 DEBUG:teuthology.orchestra.run.smithi082:> chmod 0000 /tmp/cephfs 2023-09-23T08:56:33.394 DEBUG:teuthology.orchestra.run.smithi082:> sudo modprobe fuse 2023-09-23T08:56:33.512 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-09-23T08:56:33.512 DEBUG:teuthology.orchestra.run.smithi082:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-09-23T08:56:33.580 INFO:teuthology.orchestra.run.smithi082.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-09-23T08:56:33.582 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-09-23T08:56:33.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-23T08:56:33.583 DEBUG:teuthology.orchestra.run.smithi082:> ls /sys/fs/fuse/connections 2023-09-23T08:56:33.626 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-09-23T08:56:33.627 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--tmp-cephfs sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /tmp/cephfs --id 0 --client_mountpoint=/volumes/_nogroup/sv_0/4a4aa33e-0419-4bf8-bddc-904368245988 --client_fs=cephfs -o context=system_u:object_r:postgresql_db_t:s0) 2023-09-23T08:56:33.671 DEBUG:teuthology.orchestra.run.smithi082:> sudo modprobe fuse 2023-09-23T08:56:33.742 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-09-23T08:56:33.742 DEBUG:teuthology.orchestra.run.smithi082:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-09-23T08:56:33.810 INFO:teuthology.orchestra.run.smithi082.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-09-23T08:56:33.813 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-09-23T08:56:33.814 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-23T08:56:33.814 DEBUG:teuthology.orchestra.run.smithi082:> ls /sys/fs/fuse/connections 2023-09-23T08:56:33.862 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi082.stderr:2023-09-23T08:56:33.860+0000 7fe1a38485c0 -1 init, newargv = 0x55f1df73a5b0 newargc=17 2023-09-23T08:56:33.863 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi082.stderr:ceph-fuse[146379]: starting ceph client 2023-09-23T08:56:33.896 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi082.stderr:ceph-fuse[146379]: starting fuse 2023-09-23T08:56:34.959 DEBUG:teuthology.orchestra.run.smithi082:> sudo modprobe fuse 2023-09-23T08:56:35.036 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-09-23T08:56:35.036 DEBUG:teuthology.orchestra.run.smithi082:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-09-23T08:56:35.105 INFO:teuthology.orchestra.run.smithi082.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-09-23T08:56:35.108 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-09-23T08:56:35.108 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-23T08:56:35.109 DEBUG:teuthology.orchestra.run.smithi082:> ls /sys/fs/fuse/connections 2023-09-23T08:56:35.152 INFO:teuthology.orchestra.run.smithi082.stdout:121 2023-09-23T08:56:35.153 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [121] 2023-09-23T08:56:35.153 DEBUG:teuthology.orchestra.run.smithi082:> sudo stdin-killer -- python3 -c ' 2023-09-23T08:56:35.153 DEBUG:teuthology.orchestra.run.smithi082:> import glob 2023-09-23T08:56:35.153 DEBUG:teuthology.orchestra.run.smithi082:> import re 2023-09-23T08:56:35.153 DEBUG:teuthology.orchestra.run.smithi082:> import os 2023-09-23T08:56:35.153 DEBUG:teuthology.orchestra.run.smithi082:> import subprocess 2023-09-23T08:56:35.153 DEBUG:teuthology.orchestra.run.smithi082:> 2023-09-23T08:56:35.154 DEBUG:teuthology.orchestra.run.smithi082:> def _find_admin_socket(client_name): 2023-09-23T08:56:35.154 DEBUG:teuthology.orchestra.run.smithi082:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-09-23T08:56:35.154 DEBUG:teuthology.orchestra.run.smithi082:> files = glob.glob(asok_path) 2023-09-23T08:56:35.154 DEBUG:teuthology.orchestra.run.smithi082:> mountpoint = "/tmp/cephfs" 2023-09-23T08:56:35.154 DEBUG:teuthology.orchestra.run.smithi082:> 2023-09-23T08:56:35.154 DEBUG:teuthology.orchestra.run.smithi082:> # Given a non-glob path, it better be there 2023-09-23T08:56:35.154 DEBUG:teuthology.orchestra.run.smithi082:> if "*" not in asok_path: 2023-09-23T08:56:35.154 DEBUG:teuthology.orchestra.run.smithi082:> assert(len(files) == 1) 2023-09-23T08:56:35.154 DEBUG:teuthology.orchestra.run.smithi082:> return files[0] 2023-09-23T08:56:35.154 DEBUG:teuthology.orchestra.run.smithi082:> 2023-09-23T08:56:35.155 DEBUG:teuthology.orchestra.run.smithi082:> for f in files: 2023-09-23T08:56:35.155 DEBUG:teuthology.orchestra.run.smithi082:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-09-23T08:56:35.155 DEBUG:teuthology.orchestra.run.smithi082:> if os.path.exists("/proc/{0}".format(pid)): 2023-09-23T08:56:35.155 DEBUG:teuthology.orchestra.run.smithi082:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-09-23T08:56:35.155 DEBUG:teuthology.orchestra.run.smithi082:> contents = proc_f.read() 2023-09-23T08:56:35.155 DEBUG:teuthology.orchestra.run.smithi082:> if mountpoint in contents: 2023-09-23T08:56:35.155 DEBUG:teuthology.orchestra.run.smithi082:> return f 2023-09-23T08:56:35.155 DEBUG:teuthology.orchestra.run.smithi082:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-09-23T08:56:35.155 DEBUG:teuthology.orchestra.run.smithi082:> 2023-09-23T08:56:35.156 DEBUG:teuthology.orchestra.run.smithi082:> print(_find_admin_socket("client.0")) 2023-09-23T08:56:35.156 DEBUG:teuthology.orchestra.run.smithi082:> ' 2023-09-23T08:56:35.333 INFO:teuthology.orchestra.run.smithi082.stdout:/var/run/ceph/ceph-client.0.146379.asok 2023-09-23T08:56:35.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-09-23T08:56:35.345 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:35 smithi082 ceph-mon[97694]: pgmap v354: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 10 op/s 2023-09-23T08:56:35.347 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.146379.asok 2023-09-23T08:56:35.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-23T08:56:35.347 DEBUG:teuthology.orchestra.run.smithi082:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.146379.asok status 2023-09-23T08:56:35.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:35 smithi161 ceph-mon[99580]: pgmap v354: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 10 op/s 2023-09-23T08:56:35.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:35 smithi135 ceph-mon[99205]: pgmap v354: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 10 op/s 2023-09-23T08:56:35.576 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T08:56:35.577 INFO:teuthology.orchestra.run.smithi082.stdout: "metadata": { 2023-09-23T08:56:35.577 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_sha1": "db9a2d12746faa158579b8d032d53d472ae6b6b0", 2023-09-23T08:56:35.577 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_version": "ceph version 18.0.0-5661-gdb9a2d12 (db9a2d12746faa158579b8d032d53d472ae6b6b0) reef (dev)", 2023-09-23T08:56:35.577 INFO:teuthology.orchestra.run.smithi082.stdout: "entity_id": "0", 2023-09-23T08:56:35.577 INFO:teuthology.orchestra.run.smithi082.stdout: "hostname": "smithi082", 2023-09-23T08:56:35.577 INFO:teuthology.orchestra.run.smithi082.stdout: "mount_point": "/tmp/cephfs", 2023-09-23T08:56:35.577 INFO:teuthology.orchestra.run.smithi082.stdout: "pid": "146379", 2023-09-23T08:56:35.577 INFO:teuthology.orchestra.run.smithi082.stdout: "root": "/volumes/_nogroup/sv_0/4a4aa33e-0419-4bf8-bddc-904368245988" 2023-09-23T08:56:35.577 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T08:56:35.577 INFO:teuthology.orchestra.run.smithi082.stdout: "dentry_count": 0, 2023-09-23T08:56:35.578 INFO:teuthology.orchestra.run.smithi082.stdout: "dentry_pinned_count": 0, 2023-09-23T08:56:35.578 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 15375, 2023-09-23T08:56:35.578 INFO:teuthology.orchestra.run.smithi082.stdout: "inst": { 2023-09-23T08:56:35.578 INFO:teuthology.orchestra.run.smithi082.stdout: "name": { 2023-09-23T08:56:35.578 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "client", 2023-09-23T08:56:35.578 INFO:teuthology.orchestra.run.smithi082.stdout: "num": 15375 2023-09-23T08:56:35.578 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T08:56:35.578 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": { 2023-09-23T08:56:35.578 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "v1", 2023-09-23T08:56:35.578 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": "192.168.0.1:0", 2023-09-23T08:56:35.578 INFO:teuthology.orchestra.run.smithi082.stdout: "nonce": 2260925533 2023-09-23T08:56:35.579 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T08:56:35.579 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T08:56:35.579 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": { 2023-09-23T08:56:35.579 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "v1", 2023-09-23T08:56:35.579 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": "192.168.0.1:0", 2023-09-23T08:56:35.579 INFO:teuthology.orchestra.run.smithi082.stdout: "nonce": 2260925533 2023-09-23T08:56:35.579 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T08:56:35.579 INFO:teuthology.orchestra.run.smithi082.stdout: "inst_str": "client.15375 192.168.0.1:0/2260925533", 2023-09-23T08:56:35.579 INFO:teuthology.orchestra.run.smithi082.stdout: "addr_str": "192.168.0.1:0/2260925533", 2023-09-23T08:56:35.579 INFO:teuthology.orchestra.run.smithi082.stdout: "inode_count": 5, 2023-09-23T08:56:35.579 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_epoch": 26, 2023-09-23T08:56:35.580 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_epoch": 88, 2023-09-23T08:56:35.580 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_epoch_barrier": 0, 2023-09-23T08:56:35.580 INFO:teuthology.orchestra.run.smithi082.stdout: "blocklisted": false, 2023-09-23T08:56:35.580 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs" 2023-09-23T08:56:35.580 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T08:56:35.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-23T08:56:35.591 DEBUG:teuthology.orchestra.run.smithi082:> stat --file-system '--printf=%T 2023-09-23T08:56:35.591 DEBUG:teuthology.orchestra.run.smithi082:> ' -- /tmp/cephfs 2023-09-23T08:56:35.635 INFO:teuthology.orchestra.run.smithi082.stdout:fuseblk 2023-09-23T08:56:35.636 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /tmp/cephfs 2023-09-23T08:56:35.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-23T08:56:35.636 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 1777 /tmp/cephfs 2023-09-23T08:56:35.747 INFO:teuthology.run_tasks:Running task check-counter... 2023-09-23T08:56:35.774 INFO:teuthology.run_tasks:Running task fwd_scrub... 2023-09-23T08:56:35.842 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-23T08:56:36.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.036+0000 7fc1605ff700 1 -- 172.21.15.82:0/2070075645 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc158100930 msgr2=0x7fc158100d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:36.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.036+0000 7fc1605ff700 1 --2- 172.21.15.82:0/2070075645 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc158100930 0x7fc158100d50 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fc1540099c0 tx=0x7fc154009cd0 comp rx=0 tx=0).stop 2023-09-23T08:56:36.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.036+0000 7fc1605ff700 1 -- 172.21.15.82:0/2070075645 shutdown_connections 2023-09-23T08:56:36.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.036+0000 7fc1605ff700 1 --2- 172.21.15.82:0/2070075645 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc1581024c0 0x7fc158108d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:36.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.036+0000 7fc1605ff700 1 --2- 172.21.15.82:0/2070075645 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc158100930 0x7fc158100d50 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:36.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.036+0000 7fc1605ff700 1 --2- 172.21.15.82:0/2070075645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc158101b20 0x7fc158101f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:36.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.036+0000 7fc1605ff700 1 -- 172.21.15.82:0/2070075645 >> 172.21.15.82:0/2070075645 conn(0x7fc1580fbe60 msgr2=0x7fc1580fe2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:36.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.036+0000 7fc1605ff700 1 -- 172.21.15.82:0/2070075645 shutdown_connections 2023-09-23T08:56:36.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.036+0000 7fc1605ff700 1 -- 172.21.15.82:0/2070075645 wait complete. 2023-09-23T08:56:36.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.037+0000 7fc1605ff700 1 Processor -- start 2023-09-23T08:56:36.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.038+0000 7fc1605ff700 1 -- start start 2023-09-23T08:56:36.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.038+0000 7fc1605ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc158100930 0x7fc158198740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:36.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.038+0000 7fc1605ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc158101b20 0x7fc158198c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:36.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.038+0000 7fc1605ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1581024c0 0x7fc15819fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:36.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.038+0000 7fc1605ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1581a02c0 con 0x7fc1581024c0 2023-09-23T08:56:36.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.038+0000 7fc1605ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1581a0400 con 0x7fc158100930 2023-09-23T08:56:36.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.038+0000 7fc1605ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1581a0590 con 0x7fc158101b20 2023-09-23T08:56:36.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.038+0000 7fc15eb9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1581024c0 0x7fc15819fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:36.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.038+0000 7fc15eb9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1581024c0 0x7fc15819fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45026/0 (socket says 172.21.15.82:45026) 2023-09-23T08:56:36.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.038+0000 7fc15eb9c700 1 -- 172.21.15.82:0/899965233 learned_addr learned my addr 172.21.15.82:0/899965233 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:36.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.038+0000 7fc15e39b700 1 --2- 172.21.15.82:0/899965233 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc158100930 0x7fc158198740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:36.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.038+0000 7fc15db9a700 1 --2- 172.21.15.82:0/899965233 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc158101b20 0x7fc158198c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:36.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.039+0000 7fc15eb9c700 1 -- 172.21.15.82:0/899965233 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc158101b20 msgr2=0x7fc158198c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:36.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.039+0000 7fc15eb9c700 1 --2- 172.21.15.82:0/899965233 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc158101b20 0x7fc158198c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:36.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.039+0000 7fc15eb9c700 1 -- 172.21.15.82:0/899965233 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc158100930 msgr2=0x7fc158198740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:36.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.039+0000 7fc15eb9c700 1 --2- 172.21.15.82:0/899965233 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc158100930 0x7fc158198740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:36.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.039+0000 7fc15eb9c700 1 -- 172.21.15.82:0/899965233 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1540095f0 con 0x7fc1581024c0 2023-09-23T08:56:36.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.039+0000 7fc15eb9c700 1 --2- 172.21.15.82:0/899965233 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1581024c0 0x7fc15819fcf0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fc150007ee0 tx=0x7fc15000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:36.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.039+0000 7fc14f7fe700 1 -- 172.21.15.82:0/899965233 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc150017070 con 0x7fc1581024c0 2023-09-23T08:56:36.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.039+0000 7fc14f7fe700 1 -- 172.21.15.82:0/899965233 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc15000f040 con 0x7fc1581024c0 2023-09-23T08:56:36.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.039+0000 7fc1605ff700 1 -- 172.21.15.82:0/899965233 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1581a0870 con 0x7fc1581024c0 2023-09-23T08:56:36.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.039+0000 7fc14f7fe700 1 -- 172.21.15.82:0/899965233 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc150005570 con 0x7fc1581024c0 2023-09-23T08:56:36.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.039+0000 7fc1605ff700 1 -- 172.21.15.82:0/899965233 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1581a0d80 con 0x7fc1581024c0 2023-09-23T08:56:36.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.040+0000 7fc1605ff700 1 -- 172.21.15.82:0/899965233 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc158192de0 con 0x7fc1581024c0 2023-09-23T08:56:36.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.042+0000 7fc14f7fe700 1 -- 172.21.15.82:0/899965233 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 134671+0+0 (secure 0 0 0) 0x7fc15000db20 con 0x7fc1581024c0 2023-09-23T08:56:36.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.043+0000 7fc14f7fe700 1 --2- 172.21.15.82:0/899965233 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fc1440a0020 0x7fc1440a24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:36.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.044+0000 7fc14f7fe700 1 -- 172.21.15.82:0/899965233 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fc1500ca990 con 0x7fc1581024c0 2023-09-23T08:56:36.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.044+0000 7fc15e39b700 1 --2- 172.21.15.82:0/899965233 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fc1440a0020 0x7fc1440a24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:36.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.044+0000 7fc15e39b700 1 --2- 172.21.15.82:0/899965233 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fc1440a0020 0x7fc1440a24e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc154006010 tx=0x7fc154005e80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:36.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.048+0000 7fc14f7fe700 1 -- 172.21.15.82:0/899965233 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7fc1500946d0 con 0x7fc1581024c0 2023-09-23T08:56:36.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.259+0000 7fc1605ff700 1 -- 172.21.15.82:0/899965233 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc15810bff0 con 0x7fc1581024c0 2023-09-23T08:56:36.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.261+0000 7fc14f7fe700 1 -- 172.21.15.82:0/899965233 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+22508 (secure 0 0 0) 0x7fc150097cf0 con 0x7fc1581024c0 2023-09-23T08:56:36.264 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:56:36.264 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":88,"fsid":"8926e286-59ed-11ee-8db4-212e2dc638e7","created":"2023-09-23T08:46:16.628057+0000","modified":"2023-09-23T08:55:23.423278+0000","last_up_change":"2023-09-23T08:53:56.524694+0000","last_in_change":"2023-09-23T08:53:35.779183+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-23T08:50:00.571063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-23T08:54:50.558630+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-23T08:54:52.055291+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7384c1ff-8c71-4feb-8cef-ba45c2a1708a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":892441948},{"type":"v1","addr":"172.21.15.82:6803","nonce":892441948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":892441948},{"type":"v1","addr":"172.21.15.82:6805","nonce":892441948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":892441948},{"type":"v1","addr":"172.21.15.82:6809","nonce":892441948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":892441948},{"type":"v1","addr":"172.21.15.82:6807","nonce":892441948}]},"public_addr":"172.21.15.82:6803/892441948","cluster_addr":"172.21.15.82:6805/892441948","heartbeat_back_addr":"172.21.15.82:6809/892441948","heartbeat_front_addr":"172.21.15.82:6807/892441948","state":["exists","up"]},{"osd":1,"uuid":"ca62333e-15db-4556-a9ed-8820f9268766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3224546922},{"type":"v1","addr":"172.21.15.135:6801","nonce":3224546922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3224546922},{"type":"v1","addr":"172.21.15.135:6803","nonce":3224546922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3224546922},{"type":"v1","addr":"172.21.15.135:6807","nonce":3224546922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3224546922},{"type":"v1","addr":"172.21.15.135:6805","nonce":3224546922}]},"public_addr":"172.21.15.135:6801/3224546922","cluster_addr":"172.21.15.135:6803/3224546922","heartbeat_back_addr":"172.21.15.135:6807/3224546922","heartbeat_front_addr":"172.21.15.135:6805/3224546922","state":["exists","up"]},{"osd":2,"uuid":"ac23eb38-216a-44f0-b316-a509b23745f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2358373459},{"type":"v1","addr":"172.21.15.161:6801","nonce":2358373459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2358373459},{"type":"v1","addr":"172.21.15.161:6803","nonce":2358373459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2358373459},{"type":"v1","addr":"172.21.15.161:6807","nonce":2358373459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2358373459},{"type":"v1","addr":"172.21.15.161:6805","nonce":2358373459}]},"public_addr":"172.21.15.161:6801/2358373459","cluster_addr":"172.21.15.161:6803/2358373459","heartbeat_back_addr":"172.21.15.161:6807/2358373459","heartbeat_front_addr":"172.21.15.161:6805/2358373459","state":["exists","up"]},{"osd":3,"uuid":"701c96b0-30fb-46ce-917d-e02d3814dc3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":1081464528},{"type":"v1","addr":"172.21.15.82:6811","nonce":1081464528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1081464528},{"type":"v1","addr":"172.21.15.82:6813","nonce":1081464528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1081464528},{"type":"v1","addr":"172.21.15.82:6817","nonce":1081464528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":1081464528},{"type":"v1","addr":"172.21.15.82:6815","nonce":1081464528}]},"public_addr":"172.21.15.82:6811/1081464528","cluster_addr":"172.21.15.82:6813/1081464528","heartbeat_back_addr":"172.21.15.82:6817/1081464528","heartbeat_front_addr":"172.21.15.82:6815/1081464528","state":["exists","up"]},{"osd":4,"uuid":"c618d2a2-3616-41b2-943c-7a4616538e13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2346495509},{"type":"v1","addr":"172.21.15.135:6809","nonce":2346495509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2346495509},{"type":"v1","addr":"172.21.15.135:6811","nonce":2346495509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2346495509},{"type":"v1","addr":"172.21.15.135:6815","nonce":2346495509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2346495509},{"type":"v1","addr":"172.21.15.135:6813","nonce":2346495509}]},"public_addr":"172.21.15.135:6809/2346495509","cluster_addr":"172.21.15.135:6811/2346495509","heartbeat_back_addr":"172.21.15.135:6815/2346495509","heartbeat_front_addr":"172.21.15.135:6813/2346495509","state":["exists","up"]},{"osd":5,"uuid":"8e1dda3d-6927-495d-b20d-78b03bb75d5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1252638628},{"type":"v1","addr":"172.21.15.161:6809","nonce":1252638628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1252638628},{"type":"v1","addr":"172.21.15.161:6811","nonce":1252638628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1252638628},{"type":"v1","addr":"172.21.15.161:6815","nonce":1252638628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1252638628},{"type":"v1","addr":"172.21.15.161:6813","nonce":1252638628}]},"public_addr":"172.21.15.161:6809/1252638628","cluster_addr":"172.21.15.161:6811/1252638628","heartbeat_back_addr":"172.21.15.161:6815/1252638628","heartbeat_front_addr":"172.21.15.161:6813/1252638628","state":["exists","up"]},{"osd":6,"uuid":"50b31960-6bc4-44e1-8116-3106bf161e56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1052038408},{"type":"v1","addr":"172.21.15.82:6819","nonce":1052038408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1052038408},{"type":"v1","addr":"172.21.15.82:6821","nonce":1052038408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":1052038408},{"type":"v1","addr":"172.21.15.82:6825","nonce":1052038408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1052038408},{"type":"v1","addr":"172.21.15.82:6823","nonce":1052038408}]},"public_addr":"172.21.15.82:6819/1052038408","cluster_addr":"172.21.15.82:6821/1052038408","heartbeat_back_addr":"172.21.15.82:6825/1052038408","heartbeat_front_addr":"172.21.15.82:6823/1052038408","state":["exists","up"]},{"osd":7,"uuid":"425ca0ee-57f7-4b27-90fb-d86bb5db5480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3683951498},{"type":"v1","addr":"172.21.15.135:6817","nonce":3683951498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":3683951498},{"type":"v1","addr":"172.21.15.135:6819","nonce":3683951498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":3683951498},{"type":"v1","addr":"172.21.15.135:6823","nonce":3683951498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":3683951498},{"type":"v1","addr":"172.21.15.135:6821","nonce":3683951498}]},"public_addr":"172.21.15.135:6817/3683951498","cluster_addr":"172.21.15.135:6819/3683951498","heartbeat_back_addr":"172.21.15.135:6823/3683951498","heartbeat_front_addr":"172.21.15.135:6821/3683951498","state":["exists","up"]},{"osd":8,"uuid":"1115c837-bef6-4bad-9974-4d913198511b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":948521536},{"type":"v1","addr":"172.21.15.161:6817","nonce":948521536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":948521536},{"type":"v1","addr":"172.21.15.161:6819","nonce":948521536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":948521536},{"type":"v1","addr":"172.21.15.161:6823","nonce":948521536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":948521536},{"type":"v1","addr":"172.21.15.161:6821","nonce":948521536}]},"public_addr":"172.21.15.161:6817/948521536","cluster_addr":"172.21.15.161:6819/948521536","heartbeat_back_addr":"172.21.15.161:6823/948521536","heartbeat_front_addr":"172.21.15.161:6821/948521536","state":["exists","up"]},{"osd":9,"uuid":"c52ec819-4bc6-402f-9cd8-62539e519e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":1438762840},{"type":"v1","addr":"172.21.15.82:6827","nonce":1438762840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":1438762840},{"type":"v1","addr":"172.21.15.82:6829","nonce":1438762840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1438762840},{"type":"v1","addr":"172.21.15.82:6833","nonce":1438762840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1438762840},{"type":"v1","addr":"172.21.15.82:6831","nonce":1438762840}]},"public_addr":"172.21.15.82:6827/1438762840","cluster_addr":"172.21.15.82:6829/1438762840","heartbeat_back_addr":"172.21.15.82:6833/1438762840","heartbeat_front_addr":"172.21.15.82:6831/1438762840","state":["exists","up"]},{"osd":10,"uuid":"1b16c795-1b91-4d46-ae5d-21b8332c1077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2853697851},{"type":"v1","addr":"172.21.15.135:6825","nonce":2853697851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2853697851},{"type":"v1","addr":"172.21.15.135:6827","nonce":2853697851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2853697851},{"type":"v1","addr":"172.21.15.135:6831","nonce":2853697851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2853697851},{"type":"v1","addr":"172.21.15.135:6829","nonce":2853697851}]},"public_addr":"172.21.15.135:6825/2853697851","cluster_addr":"172.21.15.135:6827/2853697851","heartbeat_back_addr":"172.21.15.135:6831/2853697851","heartbeat_front_addr":"172.21.15.135:6829/2853697851","state":["exists","up"]},{"osd":11,"uuid":"2551e602-4fe1-41cb-9b7d-c8b31fdd1487","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":1459332081},{"type":"v1","addr":"172.21.15.161:6825","nonce":1459332081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":1459332081},{"type":"v1","addr":"172.21.15.161:6827","nonce":1459332081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":1459332081},{"type":"v1","addr":"172.21.15.161:6831","nonce":1459332081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":1459332081},{"type":"v1","addr":"172.21.15.161:6829","nonce":1459332081}]},"public_addr":"172.21.15.161:6825/1459332081","cluster_addr":"172.21.15.161:6827/1459332081","heartbeat_back_addr":"172.21.15.161:6831/1459332081","heartbeat_front_addr":"172.21.15.161:6829/1459332081","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:49:04.007679+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:49:30.702365+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:49:56.785248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:50:22.988516+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:50:49.347055+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:51:15.830145+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:51:41.986377+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:52:08.218893+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:52:34.847450+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:53:01.317134+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:53:27.981691+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:53:54.849245+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/4204712132":"2023-09-24T08:47:21.957866+0000","172.21.15.82:6801/2733521564":"2023-09-24T08:47:21.957866+0000","172.21.15.82:6800/2733521564":"2023-09-24T08:47:21.957866+0000","172.21.15.82:0/3964794665":"2023-09-24T08:47:21.957866+0000","172.21.15.82:0/3535372205":"2023-09-24T08:46:55.187024+0000","172.21.15.82:0/285559684":"2023-09-24T08:46:55.187024+0000","172.21.15.82:0/1335891896":"2023-09-24T08:46:55.187024+0000","172.21.15.82:6801/3761509623":"2023-09-24T08:46:55.187024+0000","172.21.15.82:6800/3761509623":"2023-09-24T08:46:55.187024+0000","172.21.15.82:0/3775317005":"2023-09-24T08:47:21.957866+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-23T08:56:36.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.263+0000 7fc1605ff700 1 -- 172.21.15.82:0/899965233 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fc1440a0020 msgr2=0x7fc1440a24e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:36.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.263+0000 7fc1605ff700 1 --2- 172.21.15.82:0/899965233 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fc1440a0020 0x7fc1440a24e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc154006010 tx=0x7fc154005e80 comp rx=0 tx=0).stop 2023-09-23T08:56:36.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.263+0000 7fc1605ff700 1 -- 172.21.15.82:0/899965233 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1581024c0 msgr2=0x7fc15819fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:36.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.263+0000 7fc1605ff700 1 --2- 172.21.15.82:0/899965233 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1581024c0 0x7fc15819fcf0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fc150007ee0 tx=0x7fc15000d3b0 comp rx=0 tx=0).stop 2023-09-23T08:56:36.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.263+0000 7fc1605ff700 1 -- 172.21.15.82:0/899965233 shutdown_connections 2023-09-23T08:56:36.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.263+0000 7fc1605ff700 1 --2- 172.21.15.82:0/899965233 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fc1440a0020 0x7fc1440a24e0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:36.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.263+0000 7fc1605ff700 1 --2- 172.21.15.82:0/899965233 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1581024c0 0x7fc15819fcf0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:36.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.263+0000 7fc1605ff700 1 --2- 172.21.15.82:0/899965233 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc158100930 0x7fc158198740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:36.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.263+0000 7fc1605ff700 1 --2- 172.21.15.82:0/899965233 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc158101b20 0x7fc158198c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:36.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.263+0000 7fc1605ff700 1 -- 172.21.15.82:0/899965233 >> 172.21.15.82:0/899965233 conn(0x7fc1580fbe60 msgr2=0x7fc1581074c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:36.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.264+0000 7fc1605ff700 1 -- 172.21.15.82:0/899965233 shutdown_connections 2023-09-23T08:56:36.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.264+0000 7fc1605ff700 1 -- 172.21.15.82:0/899965233 wait complete. 2023-09-23T08:56:36.285 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-23T08:50:00.571063+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-23T08:54:50.558630+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-23T08:54:52.055291+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-23T08:56:36.285 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-23T08:56:36.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.484+0000 7f6a1dfff700 1 -- 172.21.15.82:0/3771372822 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a18100930 msgr2=0x7f6a18100d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:36.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.484+0000 7f6a1dfff700 1 --2- 172.21.15.82:0/3771372822 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a18100930 0x7f6a18100d50 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f6a080099c0 tx=0x7f6a08009cd0 comp rx=0 tx=0).stop 2023-09-23T08:56:36.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.485+0000 7f6a1dfff700 1 -- 172.21.15.82:0/3771372822 shutdown_connections 2023-09-23T08:56:36.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.485+0000 7f6a1dfff700 1 --2- 172.21.15.82:0/3771372822 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a181024c0 0x7f6a18108d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:36.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.485+0000 7f6a1dfff700 1 --2- 172.21.15.82:0/3771372822 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a18100930 0x7f6a18100d50 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:36.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.485+0000 7f6a1dfff700 1 --2- 172.21.15.82:0/3771372822 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a18101b20 0x7f6a18101f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:36.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.485+0000 7f6a1dfff700 1 -- 172.21.15.82:0/3771372822 >> 172.21.15.82:0/3771372822 conn(0x7f6a180fbea0 msgr2=0x7f6a180fe2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:36.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.485+0000 7f6a1dfff700 1 -- 172.21.15.82:0/3771372822 shutdown_connections 2023-09-23T08:56:36.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.485+0000 7f6a1dfff700 1 -- 172.21.15.82:0/3771372822 wait complete. 2023-09-23T08:56:36.490 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.486+0000 7f6a1dfff700 1 Processor -- start 2023-09-23T08:56:36.490 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.486+0000 7f6a1dfff700 1 -- start start 2023-09-23T08:56:36.490 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.486+0000 7f6a1dfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a18100930 0x7f6a18198750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:36.490 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.486+0000 7f6a1dfff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a18101b20 0x7f6a18198c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:36.490 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.486+0000 7f6a1dfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a181024c0 0x7f6a1819fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:36.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.486+0000 7f6a1dfff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a181a02d0 con 0x7f6a18100930 2023-09-23T08:56:36.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.486+0000 7f6a1dfff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a181a0410 con 0x7f6a181024c0 2023-09-23T08:56:36.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.486+0000 7f6a1dfff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a181a05a0 con 0x7f6a18101b20 2023-09-23T08:56:36.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.486+0000 7f6a177fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a18100930 0x7f6a18198750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:36.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.486+0000 7f6a177fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a18100930 0x7f6a18198750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45054/0 (socket says 172.21.15.82:45054) 2023-09-23T08:56:36.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.486+0000 7f6a177fe700 1 -- 172.21.15.82:0/563672398 learned_addr learned my addr 172.21.15.82:0/563672398 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:36.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.486+0000 7f6a16ffd700 1 --2- 172.21.15.82:0/563672398 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a18101b20 0x7f6a18198c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:36.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.487+0000 7f6a17fff700 1 --2- 172.21.15.82:0/563672398 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a181024c0 0x7f6a1819fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:36.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.487+0000 7f6a177fe700 1 -- 172.21.15.82:0/563672398 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a18101b20 msgr2=0x7f6a18198c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:36.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.487+0000 7f6a177fe700 1 --2- 172.21.15.82:0/563672398 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a18101b20 0x7f6a18198c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:36.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.487+0000 7f6a177fe700 1 -- 172.21.15.82:0/563672398 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a181024c0 msgr2=0x7f6a1819fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:36.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.487+0000 7f6a177fe700 1 --2- 172.21.15.82:0/563672398 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a181024c0 0x7f6a1819fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:36.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.487+0000 7f6a177fe700 1 -- 172.21.15.82:0/563672398 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a080095f0 con 0x7f6a18100930 2023-09-23T08:56:36.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.487+0000 7f6a16ffd700 1 --2- 172.21.15.82:0/563672398 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a18101b20 0x7f6a18198c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T08:56:36.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.487+0000 7f6a17fff700 1 --2- 172.21.15.82:0/563672398 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a181024c0 0x7f6a1819fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T08:56:36.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.487+0000 7f6a177fe700 1 --2- 172.21.15.82:0/563672398 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a18100930 0x7f6a18198750 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f6a080098e0 tx=0x7f6a08009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:36.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.487+0000 7f6a14ff9700 1 -- 172.21.15.82:0/563672398 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a0801d070 con 0x7f6a18100930 2023-09-23T08:56:36.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.487+0000 7f6a14ff9700 1 -- 172.21.15.82:0/563672398 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6a08004100 con 0x7f6a18100930 2023-09-23T08:56:36.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.487+0000 7f6a14ff9700 1 -- 172.21.15.82:0/563672398 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a08005270 con 0x7f6a18100930 2023-09-23T08:56:36.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.487+0000 7f6a1dfff700 1 -- 172.21.15.82:0/563672398 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a181a0820 con 0x7f6a18100930 2023-09-23T08:56:36.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.487+0000 7f6a1dfff700 1 -- 172.21.15.82:0/563672398 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a181a0b90 con 0x7f6a18100930 2023-09-23T08:56:36.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.488+0000 7f6a1dfff700 1 -- 172.21.15.82:0/563672398 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a1810c040 con 0x7f6a18100930 2023-09-23T08:56:36.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.490+0000 7f6a14ff9700 1 -- 172.21.15.82:0/563672398 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 134671+0+0 (secure 0 0 0) 0x7f6a080049a0 con 0x7f6a18100930 2023-09-23T08:56:36.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.491+0000 7f6a14ff9700 1 --2- 172.21.15.82:0/563672398 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f6a0009ffd0 0x7f6a000a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:36.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.492+0000 7f6a14ff9700 1 -- 172.21.15.82:0/563672398 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f6a080cc240 con 0x7f6a18100930 2023-09-23T08:56:36.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.492+0000 7f6a16ffd700 1 --2- 172.21.15.82:0/563672398 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f6a0009ffd0 0x7f6a000a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:36.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.492+0000 7f6a16ffd700 1 --2- 172.21.15.82:0/563672398 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f6a0009ffd0 0x7f6a000a2490 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c005fd0 tx=0x7f6a0c005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:36.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.494+0000 7f6a14ff9700 1 -- 172.21.15.82:0/563672398 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f6a08096010 con 0x7f6a18100930 2023-09-23T08:56:36.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.699+0000 7f6a1dfff700 1 -- 172.21.15.82:0/563672398 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6a181a0e10 con 0x7f6a18100930 2023-09-23T08:56:36.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.699+0000 7f6a14ff9700 1 -- 172.21.15.82:0/563672398 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6a08099630 con 0x7f6a18100930 2023-09-23T08:56:36.730 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-09-23T08:56:36.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.701+0000 7f6a1dfff700 1 -- 172.21.15.82:0/563672398 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f6a0009ffd0 msgr2=0x7f6a000a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:36.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.701+0000 7f6a1dfff700 1 --2- 172.21.15.82:0/563672398 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f6a0009ffd0 0x7f6a000a2490 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c005fd0 tx=0x7f6a0c005e30 comp rx=0 tx=0).stop 2023-09-23T08:56:36.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.701+0000 7f6a1dfff700 1 -- 172.21.15.82:0/563672398 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a18100930 msgr2=0x7f6a18198750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:36.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.701+0000 7f6a1dfff700 1 --2- 172.21.15.82:0/563672398 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a18100930 0x7f6a18198750 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f6a080098e0 tx=0x7f6a08009580 comp rx=0 tx=0).stop 2023-09-23T08:56:36.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.701+0000 7f6a1dfff700 1 -- 172.21.15.82:0/563672398 shutdown_connections 2023-09-23T08:56:36.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.701+0000 7f6a1dfff700 1 --2- 172.21.15.82:0/563672398 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f6a0009ffd0 0x7f6a000a2490 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:36.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.701+0000 7f6a1dfff700 1 --2- 172.21.15.82:0/563672398 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a181024c0 0x7f6a1819fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:36.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.701+0000 7f6a1dfff700 1 --2- 172.21.15.82:0/563672398 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a18100930 0x7f6a18198750 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:36.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.701+0000 7f6a1dfff700 1 --2- 172.21.15.82:0/563672398 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a18101b20 0x7f6a18198c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:36.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.701+0000 7f6a1dfff700 1 -- 172.21.15.82:0/563672398 >> 172.21.15.82:0/563672398 conn(0x7f6a180fbea0 msgr2=0x7f6a180fe120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:36.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.701+0000 7f6a1dfff700 1 -- 172.21.15.82:0/563672398 shutdown_connections 2023-09-23T08:56:36.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.702+0000 7f6a1dfff700 1 -- 172.21.15.82:0/563672398 wait complete. 2023-09-23T08:56:36.732 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-23T08:56:36.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.930+0000 7fbec939d700 1 -- 172.21.15.82:0/1694533243 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbec41007a0 msgr2=0x7fbec4100bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:36.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.930+0000 7fbec939d700 1 --2- 172.21.15.82:0/1694533243 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbec41007a0 0x7fbec4100bc0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fbeb40099c0 tx=0x7fbeb4009cd0 comp rx=0 tx=0).stop 2023-09-23T08:56:36.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.930+0000 7fbec939d700 1 -- 172.21.15.82:0/1694533243 shutdown_connections 2023-09-23T08:56:36.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.930+0000 7fbec939d700 1 --2- 172.21.15.82:0/1694533243 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbec4102330 0x7fbec4108be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:36.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.930+0000 7fbec939d700 1 --2- 172.21.15.82:0/1694533243 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbec41007a0 0x7fbec4100bc0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:36.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.930+0000 7fbec939d700 1 --2- 172.21.15.82:0/1694533243 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbec4101990 0x7fbec4101df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:36.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.930+0000 7fbec939d700 1 -- 172.21.15.82:0/1694533243 >> 172.21.15.82:0/1694533243 conn(0x7fbec40fbd30 msgr2=0x7fbec40fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:36.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.930+0000 7fbec939d700 1 -- 172.21.15.82:0/1694533243 shutdown_connections 2023-09-23T08:56:36.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.930+0000 7fbec939d700 1 -- 172.21.15.82:0/1694533243 wait complete. 2023-09-23T08:56:36.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.931+0000 7fbec939d700 1 Processor -- start 2023-09-23T08:56:36.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.931+0000 7fbec939d700 1 -- start start 2023-09-23T08:56:36.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.932+0000 7fbec939d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbec41007a0 0x7fbec41984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:36.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.932+0000 7fbec939d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbec4101990 0x7fbec4198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:36.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.932+0000 7fbec939d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbec4102330 0x7fbec419fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:36.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.932+0000 7fbec939d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbec41a0040 con 0x7fbec4102330 2023-09-23T08:56:36.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.932+0000 7fbec939d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbec41a0180 con 0x7fbec41007a0 2023-09-23T08:56:36.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.932+0000 7fbec939d700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbec41a0310 con 0x7fbec4101990 2023-09-23T08:56:36.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.932+0000 7fbec8b9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbec4102330 0x7fbec419fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:36.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.932+0000 7fbec8b9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbec4102330 0x7fbec419fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45078/0 (socket says 172.21.15.82:45078) 2023-09-23T08:56:36.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.932+0000 7fbec8b9c700 1 -- 172.21.15.82:0/3678918027 learned_addr learned my addr 172.21.15.82:0/3678918027 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:36.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.932+0000 7fbec37fe700 1 --2- 172.21.15.82:0/3678918027 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbec4101990 0x7fbec4198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:36.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.932+0000 7fbec3fff700 1 --2- 172.21.15.82:0/3678918027 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbec41007a0 0x7fbec41984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:36.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.932+0000 7fbec8b9c700 1 -- 172.21.15.82:0/3678918027 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbec4101990 msgr2=0x7fbec4198a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:36.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.932+0000 7fbec8b9c700 1 --2- 172.21.15.82:0/3678918027 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbec4101990 0x7fbec4198a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:36.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.932+0000 7fbec8b9c700 1 -- 172.21.15.82:0/3678918027 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbec41007a0 msgr2=0x7fbec41984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:36.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.932+0000 7fbec8b9c700 1 --2- 172.21.15.82:0/3678918027 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbec41007a0 0x7fbec41984c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:36.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.932+0000 7fbec8b9c700 1 -- 172.21.15.82:0/3678918027 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeb40095f0 con 0x7fbec4102330 2023-09-23T08:56:36.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.932+0000 7fbec3fff700 1 --2- 172.21.15.82:0/3678918027 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbec41007a0 0x7fbec41984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T08:56:36.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.933+0000 7fbec8b9c700 1 --2- 172.21.15.82:0/3678918027 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbec4102330 0x7fbec419fa70 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fbebc007ee0 tx=0x7fbebc00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:36.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.933+0000 7fbec17fa700 1 -- 172.21.15.82:0/3678918027 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbebc00ddd0 con 0x7fbec4102330 2023-09-23T08:56:36.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.933+0000 7fbec17fa700 1 -- 172.21.15.82:0/3678918027 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbebc00f040 con 0x7fbec4102330 2023-09-23T08:56:36.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.933+0000 7fbec939d700 1 -- 172.21.15.82:0/3678918027 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbec41a05f0 con 0x7fbec4102330 2023-09-23T08:56:36.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.933+0000 7fbec17fa700 1 -- 172.21.15.82:0/3678918027 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbebc0047d0 con 0x7fbec4102330 2023-09-23T08:56:36.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.933+0000 7fbec939d700 1 -- 172.21.15.82:0/3678918027 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbec41a0ab0 con 0x7fbec4102330 2023-09-23T08:56:36.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.934+0000 7fbec939d700 1 -- 172.21.15.82:0/3678918027 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbec4192c60 con 0x7fbec4102330 2023-09-23T08:56:36.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.936+0000 7fbec17fa700 1 -- 172.21.15.82:0/3678918027 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 134671+0+0 (secure 0 0 0) 0x7fbebc003a00 con 0x7fbec4102330 2023-09-23T08:56:36.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.937+0000 7fbec17fa700 1 --2- 172.21.15.82:0/3678918027 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fbeac09fff0 0x7fbeac0a24b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:36.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.938+0000 7fbec17fa700 1 -- 172.21.15.82:0/3678918027 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fbebc0cabb0 con 0x7fbec4102330 2023-09-23T08:56:36.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.938+0000 7fbec3fff700 1 --2- 172.21.15.82:0/3678918027 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fbeac09fff0 0x7fbeac0a24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:36.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.938+0000 7fbec3fff700 1 --2- 172.21.15.82:0/3678918027 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fbeac09fff0 0x7fbeac0a24b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fbeb400c010 tx=0x7fbeb4005c20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:36.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:36.941+0000 7fbec17fa700 1 -- 172.21.15.82:0/3678918027 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7fbebc0948f0 con 0x7fbec4102330 2023-09-23T08:56:37.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.151+0000 7fbec939d700 1 -- 172.21.15.82:0/3678918027 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbec402cd30 con 0x7fbec4102330 2023-09-23T08:56:37.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.151+0000 7fbec17fa700 1 -- 172.21.15.82:0/3678918027 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbebc097f10 con 0x7fbec4102330 2023-09-23T08:56:37.154 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2023-09-23T08:56:37.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.154+0000 7fbec939d700 1 -- 172.21.15.82:0/3678918027 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fbeac09fff0 msgr2=0x7fbeac0a24b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:37.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.154+0000 7fbec939d700 1 --2- 172.21.15.82:0/3678918027 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fbeac09fff0 0x7fbeac0a24b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fbeb400c010 tx=0x7fbeb4005c20 comp rx=0 tx=0).stop 2023-09-23T08:56:37.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.154+0000 7fbec939d700 1 -- 172.21.15.82:0/3678918027 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbec4102330 msgr2=0x7fbec419fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:37.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.154+0000 7fbec939d700 1 --2- 172.21.15.82:0/3678918027 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbec4102330 0x7fbec419fa70 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fbebc007ee0 tx=0x7fbebc00d3b0 comp rx=0 tx=0).stop 2023-09-23T08:56:37.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.154+0000 7fbec939d700 1 -- 172.21.15.82:0/3678918027 shutdown_connections 2023-09-23T08:56:37.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.154+0000 7fbec939d700 1 --2- 172.21.15.82:0/3678918027 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fbeac09fff0 0x7fbeac0a24b0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:37.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.154+0000 7fbec939d700 1 --2- 172.21.15.82:0/3678918027 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbec4102330 0x7fbec419fa70 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:37.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.154+0000 7fbec939d700 1 --2- 172.21.15.82:0/3678918027 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbec41007a0 0x7fbec41984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:37.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.154+0000 7fbec939d700 1 --2- 172.21.15.82:0/3678918027 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbec4101990 0x7fbec4198a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:37.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.154+0000 7fbec939d700 1 -- 172.21.15.82:0/3678918027 >> 172.21.15.82:0/3678918027 conn(0x7fbec40fbd30 msgr2=0x7fbec4107250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:37.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.154+0000 7fbec939d700 1 -- 172.21.15.82:0/3678918027 shutdown_connections 2023-09-23T08:56:37.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.154+0000 7fbec939d700 1 -- 172.21.15.82:0/3678918027 wait complete. 2023-09-23T08:56:37.175 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-23T08:56:37.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.371+0000 7f0f5bfff700 1 -- 172.21.15.82:0/4206882885 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f54101b00 msgr2=0x7f0f54101f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:37.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.371+0000 7f0f5bfff700 1 --2- 172.21.15.82:0/4206882885 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f54101b00 0x7f0f54101f60 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f0f440099c0 tx=0x7f0f44009cd0 comp rx=0 tx=0).stop 2023-09-23T08:56:37.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.371+0000 7f0f5bfff700 1 -- 172.21.15.82:0/4206882885 shutdown_connections 2023-09-23T08:56:37.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.371+0000 7f0f5bfff700 1 --2- 172.21.15.82:0/4206882885 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f541024a0 0x7f0f54108d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:37.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.371+0000 7f0f5bfff700 1 --2- 172.21.15.82:0/4206882885 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f54100910 0x7f0f54100d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:37.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.371+0000 7f0f5bfff700 1 --2- 172.21.15.82:0/4206882885 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f54101b00 0x7f0f54101f60 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:37.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.371+0000 7f0f5bfff700 1 -- 172.21.15.82:0/4206882885 >> 172.21.15.82:0/4206882885 conn(0x7f0f540fbe60 msgr2=0x7f0f540fe2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:37.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.371+0000 7f0f5bfff700 1 -- 172.21.15.82:0/4206882885 shutdown_connections 2023-09-23T08:56:37.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.371+0000 7f0f5bfff700 1 -- 172.21.15.82:0/4206882885 wait complete. 2023-09-23T08:56:37.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.372+0000 7f0f5bfff700 1 Processor -- start 2023-09-23T08:56:37.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.372+0000 7f0f5bfff700 1 -- start start 2023-09-23T08:56:37.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.373+0000 7f0f5bfff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f54100910 0x7f0f540746d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:37.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.373+0000 7f0f5bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f54101b00 0x7f0f54072d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:37.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.373+0000 7f0f5bfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f541024a0 0x7f0f54073250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:37.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.373+0000 7f0f5bfff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f540739f0 con 0x7f0f54101b00 2023-09-23T08:56:37.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.373+0000 7f0f5bfff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f54073b60 con 0x7f0f541024a0 2023-09-23T08:56:37.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.373+0000 7f0f5bfff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f541a05b0 con 0x7f0f54100910 2023-09-23T08:56:37.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.373+0000 7f0f5959a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f54101b00 0x7f0f54072d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:37.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.373+0000 7f0f5959a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f54101b00 0x7f0f54072d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45086/0 (socket says 172.21.15.82:45086) 2023-09-23T08:56:37.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.373+0000 7f0f5959a700 1 -- 172.21.15.82:0/908634881 learned_addr learned my addr 172.21.15.82:0/908634881 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:37.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.373+0000 7f0f5a59c700 1 --2- 172.21.15.82:0/908634881 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f541024a0 0x7f0f54073250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:37.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.373+0000 7f0f59d9b700 1 --2- 172.21.15.82:0/908634881 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f54100910 0x7f0f540746d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:37.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.373+0000 7f0f5959a700 1 -- 172.21.15.82:0/908634881 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f54100910 msgr2=0x7f0f540746d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:37.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.373+0000 7f0f5959a700 1 --2- 172.21.15.82:0/908634881 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f54100910 0x7f0f540746d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:37.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.373+0000 7f0f5959a700 1 -- 172.21.15.82:0/908634881 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f541024a0 msgr2=0x7f0f54073250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:37.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.373+0000 7f0f5959a700 1 --2- 172.21.15.82:0/908634881 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f541024a0 0x7f0f54073250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:37.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.373+0000 7f0f5959a700 1 -- 172.21.15.82:0/908634881 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f440095f0 con 0x7f0f54101b00 2023-09-23T08:56:37.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.373+0000 7f0f5a59c700 1 --2- 172.21.15.82:0/908634881 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f541024a0 0x7f0f54073250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T08:56:37.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.373+0000 7f0f59d9b700 1 --2- 172.21.15.82:0/908634881 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f54100910 0x7f0f540746d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T08:56:37.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.374+0000 7f0f5959a700 1 --2- 172.21.15.82:0/908634881 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f54101b00 0x7f0f54072d10 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f0f44009fd0 tx=0x7f0f4400fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:37.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.374+0000 7f0f4affd700 1 -- 172.21.15.82:0/908634881 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f4401d070 con 0x7f0f54101b00 2023-09-23T08:56:37.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.374+0000 7f0f5bfff700 1 -- 172.21.15.82:0/908634881 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f541a0830 con 0x7f0f54101b00 2023-09-23T08:56:37.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.374+0000 7f0f4affd700 1 -- 172.21.15.82:0/908634881 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0f440059a0 con 0x7f0f54101b00 2023-09-23T08:56:37.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.374+0000 7f0f4affd700 1 -- 172.21.15.82:0/908634881 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f44017650 con 0x7f0f54101b00 2023-09-23T08:56:37.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.374+0000 7f0f5bfff700 1 -- 172.21.15.82:0/908634881 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f541a0ce0 con 0x7f0f54101b00 2023-09-23T08:56:37.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.375+0000 7f0f5bfff700 1 -- 172.21.15.82:0/908634881 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f5410bfd0 con 0x7f0f54101b00 2023-09-23T08:56:37.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.377+0000 7f0f4affd700 1 -- 172.21.15.82:0/908634881 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 134671+0+0 (secure 0 0 0) 0x7f0f44022470 con 0x7f0f54101b00 2023-09-23T08:56:37.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.379+0000 7f0f4affd700 1 --2- 172.21.15.82:0/908634881 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f0f4009ff50 0x7f0f400a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:37.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.379+0000 7f0f4affd700 1 -- 172.21.15.82:0/908634881 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f0f440cc590 con 0x7f0f54101b00 2023-09-23T08:56:37.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.379+0000 7f0f59d9b700 1 --2- 172.21.15.82:0/908634881 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f0f4009ff50 0x7f0f400a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:37.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.379+0000 7f0f59d9b700 1 --2- 172.21.15.82:0/908634881 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f0f4009ff50 0x7f0f400a2410 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f0f54101960 tx=0x7f0f50009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:37.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.380+0000 7f0f4affd700 1 -- 172.21.15.82:0/908634881 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f0f44096360 con 0x7f0f54101b00 2023-09-23T08:56:37.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:37 smithi161 ceph-mon[99580]: pgmap v355: 97 pgs: 97 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 767 B/s wr, 12 op/s 2023-09-23T08:56:37.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:37 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/899965233' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-23T08:56:37.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:37 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/563672398' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-23T08:56:37.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:37 smithi135 ceph-mon[99205]: pgmap v355: 97 pgs: 97 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 767 B/s wr, 12 op/s 2023-09-23T08:56:37.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:37 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/899965233' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-23T08:56:37.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:37 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/563672398' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-23T08:56:37.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.581+0000 7f0f5bfff700 1 -- 172.21.15.82:0/908634881 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0f54107920 con 0x7f0f54101b00 2023-09-23T08:56:37.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.582+0000 7f0f4affd700 1 -- 172.21.15.82:0/908634881 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0f44022e60 con 0x7f0f54101b00 2023-09-23T08:56:37.584 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2023-09-23T08:56:37.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.584+0000 7f0f5bfff700 1 -- 172.21.15.82:0/908634881 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f0f4009ff50 msgr2=0x7f0f400a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:37.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.584+0000 7f0f5bfff700 1 --2- 172.21.15.82:0/908634881 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f0f4009ff50 0x7f0f400a2410 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f0f54101960 tx=0x7f0f50009260 comp rx=0 tx=0).stop 2023-09-23T08:56:37.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.584+0000 7f0f5bfff700 1 -- 172.21.15.82:0/908634881 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f54101b00 msgr2=0x7f0f54072d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:37.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.584+0000 7f0f5bfff700 1 --2- 172.21.15.82:0/908634881 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f54101b00 0x7f0f54072d10 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f0f44009fd0 tx=0x7f0f4400fab0 comp rx=0 tx=0).stop 2023-09-23T08:56:37.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.584+0000 7f0f5bfff700 1 -- 172.21.15.82:0/908634881 shutdown_connections 2023-09-23T08:56:37.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.584+0000 7f0f5bfff700 1 --2- 172.21.15.82:0/908634881 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f0f4009ff50 0x7f0f400a2410 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:37.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.584+0000 7f0f5bfff700 1 --2- 172.21.15.82:0/908634881 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f541024a0 0x7f0f54073250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:37.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.584+0000 7f0f5bfff700 1 --2- 172.21.15.82:0/908634881 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f54100910 0x7f0f540746d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:37.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.584+0000 7f0f5bfff700 1 --2- 172.21.15.82:0/908634881 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f54101b00 0x7f0f54072d10 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:37.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.584+0000 7f0f5bfff700 1 -- 172.21.15.82:0/908634881 >> 172.21.15.82:0/908634881 conn(0x7f0f540fbe60 msgr2=0x7f0f540fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:37.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.584+0000 7f0f5bfff700 1 -- 172.21.15.82:0/908634881 shutdown_connections 2023-09-23T08:56:37.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.584+0000 7f0f5bfff700 1 -- 172.21.15.82:0/908634881 wait complete. 2023-09-23T08:56:37.602 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:37 smithi082 ceph-mon[97694]: pgmap v355: 97 pgs: 97 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 767 B/s wr, 12 op/s 2023-09-23T08:56:37.603 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:37 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/899965233' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-23T08:56:37.603 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:37 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/563672398' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-23T08:56:37.605 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-23T08:56:37.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.800+0000 7fa26e7ff700 1 -- 172.21.15.82:0/3099723656 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa268102b20 msgr2=0x7fa268102f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:37.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.800+0000 7fa26e7ff700 1 --2- 172.21.15.82:0/3099723656 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa268102b20 0x7fa268102f40 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fa2580099c0 tx=0x7fa258009cd0 comp rx=0 tx=0).stop 2023-09-23T08:56:37.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.800+0000 7fa26e7ff700 1 -- 172.21.15.82:0/3099723656 shutdown_connections 2023-09-23T08:56:37.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.800+0000 7fa26e7ff700 1 --2- 172.21.15.82:0/3099723656 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2681046b0 0x7fa26810af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:37.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.800+0000 7fa26e7ff700 1 --2- 172.21.15.82:0/3099723656 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa268102b20 0x7fa268102f40 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:37.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.800+0000 7fa26e7ff700 1 --2- 172.21.15.82:0/3099723656 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa268103d10 0x7fa268104170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:37.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.800+0000 7fa26e7ff700 1 -- 172.21.15.82:0/3099723656 >> 172.21.15.82:0/3099723656 conn(0x7fa2680fe070 msgr2=0x7fa2681004d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:37.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.800+0000 7fa26e7ff700 1 -- 172.21.15.82:0/3099723656 shutdown_connections 2023-09-23T08:56:37.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.800+0000 7fa26e7ff700 1 -- 172.21.15.82:0/3099723656 wait complete. 2023-09-23T08:56:37.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.801+0000 7fa26e7ff700 1 Processor -- start 2023-09-23T08:56:37.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.801+0000 7fa26e7ff700 1 -- start start 2023-09-23T08:56:37.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.801+0000 7fa26e7ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa268102b20 0x7fa268198760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:37.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.801+0000 7fa26e7ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa268103d10 0x7fa268198ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:37.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.801+0000 7fa26e7ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2681046b0 0x7fa26819fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:37.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.801+0000 7fa26e7ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2681a02e0 con 0x7fa2681046b0 2023-09-23T08:56:37.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.801+0000 7fa26e7ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2681a0420 con 0x7fa268102b20 2023-09-23T08:56:37.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.801+0000 7fa26e7ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2681a05b0 con 0x7fa268103d10 2023-09-23T08:56:37.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.802+0000 7fa267fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa268102b20 0x7fa268198760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:37.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.802+0000 7fa26cd9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2681046b0 0x7fa26819fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:37.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.802+0000 7fa267fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa268102b20 0x7fa268198760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:44558/0 (socket says 172.21.15.82:44558) 2023-09-23T08:56:37.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.802+0000 7fa267fff700 1 -- 172.21.15.82:0/1637679124 learned_addr learned my addr 172.21.15.82:0/1637679124 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:37.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.802+0000 7fa2677fe700 1 --2- 172.21.15.82:0/1637679124 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa268103d10 0x7fa268198ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:37.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.802+0000 7fa26cd9c700 1 -- 172.21.15.82:0/1637679124 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa268103d10 msgr2=0x7fa268198ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:37.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.802+0000 7fa26cd9c700 1 --2- 172.21.15.82:0/1637679124 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa268103d10 0x7fa268198ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:37.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.802+0000 7fa26cd9c700 1 -- 172.21.15.82:0/1637679124 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa268102b20 msgr2=0x7fa268198760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:37.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.802+0000 7fa26cd9c700 1 --2- 172.21.15.82:0/1637679124 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa268102b20 0x7fa268198760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:37.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.802+0000 7fa26cd9c700 1 -- 172.21.15.82:0/1637679124 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2580095f0 con 0x7fa2681046b0 2023-09-23T08:56:37.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.802+0000 7fa26cd9c700 1 --2- 172.21.15.82:0/1637679124 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2681046b0 0x7fa26819fd10 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fa260007f10 tx=0x7fa26000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:37.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.802+0000 7fa2657fa700 1 -- 172.21.15.82:0/1637679124 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa260004db0 con 0x7fa2681046b0 2023-09-23T08:56:37.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.803+0000 7fa2657fa700 1 -- 172.21.15.82:0/1637679124 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa26000f040 con 0x7fa2681046b0 2023-09-23T08:56:37.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.803+0000 7fa26e7ff700 1 -- 172.21.15.82:0/1637679124 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2681a0890 con 0x7fa2681046b0 2023-09-23T08:56:37.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.803+0000 7fa2657fa700 1 -- 172.21.15.82:0/1637679124 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa260005960 con 0x7fa2681046b0 2023-09-23T08:56:37.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.803+0000 7fa26e7ff700 1 -- 172.21.15.82:0/1637679124 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2681a0d50 con 0x7fa2681046b0 2023-09-23T08:56:37.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.804+0000 7fa26e7ff700 1 -- 172.21.15.82:0/1637679124 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa26810a100 con 0x7fa2681046b0 2023-09-23T08:56:37.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.806+0000 7fa2657fa700 1 -- 172.21.15.82:0/1637679124 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 134671+0+0 (secure 0 0 0) 0x7fa26000db20 con 0x7fa2681046b0 2023-09-23T08:56:37.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.807+0000 7fa2657fa700 1 --2- 172.21.15.82:0/1637679124 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fa25009ffa0 0x7fa2500a2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:37.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.807+0000 7fa2657fa700 1 -- 172.21.15.82:0/1637679124 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fa2600cb2a0 con 0x7fa2681046b0 2023-09-23T08:56:37.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.807+0000 7fa267fff700 1 --2- 172.21.15.82:0/1637679124 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fa25009ffa0 0x7fa2500a2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:37.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.808+0000 7fa267fff700 1 --2- 172.21.15.82:0/1637679124 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fa25009ffa0 0x7fa2500a2460 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa25800c010 tx=0x7fa258009f10 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:37.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:37.809+0000 7fa2657fa700 1 -- 172.21.15.82:0/1637679124 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7fa260094fe0 con 0x7fa2681046b0 2023-09-23T08:56:38.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.016+0000 7fa26e7ff700 1 -- 172.21.15.82:0/1637679124 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa26810e400 con 0x7fa2681046b0 2023-09-23T08:56:38.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.017+0000 7fa2657fa700 1 -- 172.21.15.82:0/1637679124 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+22508 (secure 0 0 0) 0x7fa260023090 con 0x7fa2681046b0 2023-09-23T08:56:38.020 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:56:38.020 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":88,"fsid":"8926e286-59ed-11ee-8db4-212e2dc638e7","created":"2023-09-23T08:46:16.628057+0000","modified":"2023-09-23T08:55:23.423278+0000","last_up_change":"2023-09-23T08:53:56.524694+0000","last_in_change":"2023-09-23T08:53:35.779183+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-23T08:50:00.571063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-23T08:54:50.558630+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-23T08:54:52.055291+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7384c1ff-8c71-4feb-8cef-ba45c2a1708a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":892441948},{"type":"v1","addr":"172.21.15.82:6803","nonce":892441948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":892441948},{"type":"v1","addr":"172.21.15.82:6805","nonce":892441948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":892441948},{"type":"v1","addr":"172.21.15.82:6809","nonce":892441948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":892441948},{"type":"v1","addr":"172.21.15.82:6807","nonce":892441948}]},"public_addr":"172.21.15.82:6803/892441948","cluster_addr":"172.21.15.82:6805/892441948","heartbeat_back_addr":"172.21.15.82:6809/892441948","heartbeat_front_addr":"172.21.15.82:6807/892441948","state":["exists","up"]},{"osd":1,"uuid":"ca62333e-15db-4556-a9ed-8820f9268766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3224546922},{"type":"v1","addr":"172.21.15.135:6801","nonce":3224546922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3224546922},{"type":"v1","addr":"172.21.15.135:6803","nonce":3224546922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3224546922},{"type":"v1","addr":"172.21.15.135:6807","nonce":3224546922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3224546922},{"type":"v1","addr":"172.21.15.135:6805","nonce":3224546922}]},"public_addr":"172.21.15.135:6801/3224546922","cluster_addr":"172.21.15.135:6803/3224546922","heartbeat_back_addr":"172.21.15.135:6807/3224546922","heartbeat_front_addr":"172.21.15.135:6805/3224546922","state":["exists","up"]},{"osd":2,"uuid":"ac23eb38-216a-44f0-b316-a509b23745f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2358373459},{"type":"v1","addr":"172.21.15.161:6801","nonce":2358373459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2358373459},{"type":"v1","addr":"172.21.15.161:6803","nonce":2358373459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2358373459},{"type":"v1","addr":"172.21.15.161:6807","nonce":2358373459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2358373459},{"type":"v1","addr":"172.21.15.161:6805","nonce":2358373459}]},"public_addr":"172.21.15.161:6801/2358373459","cluster_addr":"172.21.15.161:6803/2358373459","heartbeat_back_addr":"172.21.15.161:6807/2358373459","heartbeat_front_addr":"172.21.15.161:6805/2358373459","state":["exists","up"]},{"osd":3,"uuid":"701c96b0-30fb-46ce-917d-e02d3814dc3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":1081464528},{"type":"v1","addr":"172.21.15.82:6811","nonce":1081464528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1081464528},{"type":"v1","addr":"172.21.15.82:6813","nonce":1081464528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1081464528},{"type":"v1","addr":"172.21.15.82:6817","nonce":1081464528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":1081464528},{"type":"v1","addr":"172.21.15.82:6815","nonce":1081464528}]},"public_addr":"172.21.15.82:6811/1081464528","cluster_addr":"172.21.15.82:6813/1081464528","heartbeat_back_addr":"172.21.15.82:6817/1081464528","heartbeat_front_addr":"172.21.15.82:6815/1081464528","state":["exists","up"]},{"osd":4,"uuid":"c618d2a2-3616-41b2-943c-7a4616538e13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2346495509},{"type":"v1","addr":"172.21.15.135:6809","nonce":2346495509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2346495509},{"type":"v1","addr":"172.21.15.135:6811","nonce":2346495509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2346495509},{"type":"v1","addr":"172.21.15.135:6815","nonce":2346495509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2346495509},{"type":"v1","addr":"172.21.15.135:6813","nonce":2346495509}]},"public_addr":"172.21.15.135:6809/2346495509","cluster_addr":"172.21.15.135:6811/2346495509","heartbeat_back_addr":"172.21.15.135:6815/2346495509","heartbeat_front_addr":"172.21.15.135:6813/2346495509","state":["exists","up"]},{"osd":5,"uuid":"8e1dda3d-6927-495d-b20d-78b03bb75d5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1252638628},{"type":"v1","addr":"172.21.15.161:6809","nonce":1252638628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1252638628},{"type":"v1","addr":"172.21.15.161:6811","nonce":1252638628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1252638628},{"type":"v1","addr":"172.21.15.161:6815","nonce":1252638628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1252638628},{"type":"v1","addr":"172.21.15.161:6813","nonce":1252638628}]},"public_addr":"172.21.15.161:6809/1252638628","cluster_addr":"172.21.15.161:6811/1252638628","heartbeat_back_addr":"172.21.15.161:6815/1252638628","heartbeat_front_addr":"172.21.15.161:6813/1252638628","state":["exists","up"]},{"osd":6,"uuid":"50b31960-6bc4-44e1-8116-3106bf161e56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1052038408},{"type":"v1","addr":"172.21.15.82:6819","nonce":1052038408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1052038408},{"type":"v1","addr":"172.21.15.82:6821","nonce":1052038408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":1052038408},{"type":"v1","addr":"172.21.15.82:6825","nonce":1052038408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1052038408},{"type":"v1","addr":"172.21.15.82:6823","nonce":1052038408}]},"public_addr":"172.21.15.82:6819/1052038408","cluster_addr":"172.21.15.82:6821/1052038408","heartbeat_back_addr":"172.21.15.82:6825/1052038408","heartbeat_front_addr":"172.21.15.82:6823/1052038408","state":["exists","up"]},{"osd":7,"uuid":"425ca0ee-57f7-4b27-90fb-d86bb5db5480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3683951498},{"type":"v1","addr":"172.21.15.135:6817","nonce":3683951498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":3683951498},{"type":"v1","addr":"172.21.15.135:6819","nonce":3683951498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":3683951498},{"type":"v1","addr":"172.21.15.135:6823","nonce":3683951498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":3683951498},{"type":"v1","addr":"172.21.15.135:6821","nonce":3683951498}]},"public_addr":"172.21.15.135:6817/3683951498","cluster_addr":"172.21.15.135:6819/3683951498","heartbeat_back_addr":"172.21.15.135:6823/3683951498","heartbeat_front_addr":"172.21.15.135:6821/3683951498","state":["exists","up"]},{"osd":8,"uuid":"1115c837-bef6-4bad-9974-4d913198511b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":948521536},{"type":"v1","addr":"172.21.15.161:6817","nonce":948521536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":948521536},{"type":"v1","addr":"172.21.15.161:6819","nonce":948521536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":948521536},{"type":"v1","addr":"172.21.15.161:6823","nonce":948521536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":948521536},{"type":"v1","addr":"172.21.15.161:6821","nonce":948521536}]},"public_addr":"172.21.15.161:6817/948521536","cluster_addr":"172.21.15.161:6819/948521536","heartbeat_back_addr":"172.21.15.161:6823/948521536","heartbeat_front_addr":"172.21.15.161:6821/948521536","state":["exists","up"]},{"osd":9,"uuid":"c52ec819-4bc6-402f-9cd8-62539e519e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":1438762840},{"type":"v1","addr":"172.21.15.82:6827","nonce":1438762840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":1438762840},{"type":"v1","addr":"172.21.15.82:6829","nonce":1438762840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1438762840},{"type":"v1","addr":"172.21.15.82:6833","nonce":1438762840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1438762840},{"type":"v1","addr":"172.21.15.82:6831","nonce":1438762840}]},"public_addr":"172.21.15.82:6827/1438762840","cluster_addr":"172.21.15.82:6829/1438762840","heartbeat_back_addr":"172.21.15.82:6833/1438762840","heartbeat_front_addr":"172.21.15.82:6831/1438762840","state":["exists","up"]},{"osd":10,"uuid":"1b16c795-1b91-4d46-ae5d-21b8332c1077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2853697851},{"type":"v1","addr":"172.21.15.135:6825","nonce":2853697851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2853697851},{"type":"v1","addr":"172.21.15.135:6827","nonce":2853697851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2853697851},{"type":"v1","addr":"172.21.15.135:6831","nonce":2853697851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2853697851},{"type":"v1","addr":"172.21.15.135:6829","nonce":2853697851}]},"public_addr":"172.21.15.135:6825/2853697851","cluster_addr":"172.21.15.135:6827/2853697851","heartbeat_back_addr":"172.21.15.135:6831/2853697851","heartbeat_front_addr":"172.21.15.135:6829/2853697851","state":["exists","up"]},{"osd":11,"uuid":"2551e602-4fe1-41cb-9b7d-c8b31fdd1487","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":1459332081},{"type":"v1","addr":"172.21.15.161:6825","nonce":1459332081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":1459332081},{"type":"v1","addr":"172.21.15.161:6827","nonce":1459332081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":1459332081},{"type":"v1","addr":"172.21.15.161:6831","nonce":1459332081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":1459332081},{"type":"v1","addr":"172.21.15.161:6829","nonce":1459332081}]},"public_addr":"172.21.15.161:6825/1459332081","cluster_addr":"172.21.15.161:6827/1459332081","heartbeat_back_addr":"172.21.15.161:6831/1459332081","heartbeat_front_addr":"172.21.15.161:6829/1459332081","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:49:04.007679+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:49:30.702365+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:49:56.785248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:50:22.988516+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:50:49.347055+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:51:15.830145+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:51:41.986377+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:52:08.218893+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:52:34.847450+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:53:01.317134+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:53:27.981691+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:53:54.849245+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/4204712132":"2023-09-24T08:47:21.957866+0000","172.21.15.82:6801/2733521564":"2023-09-24T08:47:21.957866+0000","172.21.15.82:6800/2733521564":"2023-09-24T08:47:21.957866+0000","172.21.15.82:0/3964794665":"2023-09-24T08:47:21.957866+0000","172.21.15.82:0/3535372205":"2023-09-24T08:46:55.187024+0000","172.21.15.82:0/285559684":"2023-09-24T08:46:55.187024+0000","172.21.15.82:0/1335891896":"2023-09-24T08:46:55.187024+0000","172.21.15.82:6801/3761509623":"2023-09-24T08:46:55.187024+0000","172.21.15.82:6800/3761509623":"2023-09-24T08:46:55.187024+0000","172.21.15.82:0/3775317005":"2023-09-24T08:47:21.957866+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-23T08:56:38.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.019+0000 7fa26e7ff700 1 -- 172.21.15.82:0/1637679124 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fa25009ffa0 msgr2=0x7fa2500a2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:38.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.019+0000 7fa26e7ff700 1 --2- 172.21.15.82:0/1637679124 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fa25009ffa0 0x7fa2500a2460 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa25800c010 tx=0x7fa258009f10 comp rx=0 tx=0).stop 2023-09-23T08:56:38.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.020+0000 7fa26e7ff700 1 -- 172.21.15.82:0/1637679124 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2681046b0 msgr2=0x7fa26819fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:38.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.020+0000 7fa26e7ff700 1 --2- 172.21.15.82:0/1637679124 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2681046b0 0x7fa26819fd10 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fa260007f10 tx=0x7fa26000d3b0 comp rx=0 tx=0).stop 2023-09-23T08:56:38.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.020+0000 7fa26e7ff700 1 -- 172.21.15.82:0/1637679124 shutdown_connections 2023-09-23T08:56:38.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.020+0000 7fa26e7ff700 1 --2- 172.21.15.82:0/1637679124 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fa25009ffa0 0x7fa2500a2460 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:38.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.020+0000 7fa26e7ff700 1 --2- 172.21.15.82:0/1637679124 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2681046b0 0x7fa26819fd10 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:38.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.020+0000 7fa26e7ff700 1 --2- 172.21.15.82:0/1637679124 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa268102b20 0x7fa268198760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:38.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.020+0000 7fa26e7ff700 1 --2- 172.21.15.82:0/1637679124 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa268103d10 0x7fa268198ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:38.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.020+0000 7fa26e7ff700 1 -- 172.21.15.82:0/1637679124 >> 172.21.15.82:0/1637679124 conn(0x7fa2680fe070 msgr2=0x7fa268107240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:38.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.020+0000 7fa26e7ff700 1 -- 172.21.15.82:0/1637679124 shutdown_connections 2023-09-23T08:56:38.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.020+0000 7fa26e7ff700 1 -- 172.21.15.82:0/1637679124 wait complete. 2023-09-23T08:56:38.040 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-23T08:50:00.571063+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-23T08:54:50.558630+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-23T08:54:52.055291+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-23T08:56:38.041 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-23T08:56:38.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.242+0000 7f3d715ff700 1 -- 172.21.15.82:0/4188355689 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d6c100930 msgr2=0x7f3d6c100d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:38.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.242+0000 7f3d715ff700 1 --2- 172.21.15.82:0/4188355689 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d6c100930 0x7f3d6c100d50 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c0099c0 tx=0x7f3d5c009cd0 comp rx=0 tx=0).stop 2023-09-23T08:56:38.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.242+0000 7f3d715ff700 1 -- 172.21.15.82:0/4188355689 shutdown_connections 2023-09-23T08:56:38.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.242+0000 7f3d715ff700 1 --2- 172.21.15.82:0/4188355689 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d6c1024c0 0x7f3d6c108d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:38.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.242+0000 7f3d715ff700 1 --2- 172.21.15.82:0/4188355689 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d6c100930 0x7f3d6c100d50 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:38.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.242+0000 7f3d715ff700 1 --2- 172.21.15.82:0/4188355689 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3d6c101b20 0x7f3d6c101f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:38.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.242+0000 7f3d715ff700 1 -- 172.21.15.82:0/4188355689 >> 172.21.15.82:0/4188355689 conn(0x7f3d6c0fbea0 msgr2=0x7f3d6c0fe2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:38.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.242+0000 7f3d715ff700 1 -- 172.21.15.82:0/4188355689 shutdown_connections 2023-09-23T08:56:38.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.242+0000 7f3d715ff700 1 -- 172.21.15.82:0/4188355689 wait complete. 2023-09-23T08:56:38.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.243+0000 7f3d715ff700 1 Processor -- start 2023-09-23T08:56:38.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.243+0000 7f3d715ff700 1 -- start start 2023-09-23T08:56:38.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.243+0000 7f3d715ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3d6c100930 0x7f3d6c196590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:38.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.243+0000 7f3d715ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d6c101b20 0x7f3d6c196ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:38.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.244+0000 7f3d715ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d6c1024c0 0x7f3d6c19db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:38.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.244+0000 7f3d715ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6c19e110 con 0x7f3d6c101b20 2023-09-23T08:56:38.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.244+0000 7f3d715ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6c19e250 con 0x7f3d6c1024c0 2023-09-23T08:56:38.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.244+0000 7f3d715ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6c19e3e0 con 0x7f3d6c100930 2023-09-23T08:56:38.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.244+0000 7f3d6a7fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d6c101b20 0x7f3d6c196ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:38.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.244+0000 7f3d6a7fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d6c101b20 0x7f3d6c196ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45128/0 (socket says 172.21.15.82:45128) 2023-09-23T08:56:38.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.244+0000 7f3d6a7fc700 1 -- 172.21.15.82:0/3789364248 learned_addr learned my addr 172.21.15.82:0/3789364248 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:38.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.244+0000 7f3d6b7fe700 1 --2- 172.21.15.82:0/3789364248 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d6c1024c0 0x7f3d6c19db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:38.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.244+0000 7f3d6affd700 1 --2- 172.21.15.82:0/3789364248 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3d6c100930 0x7f3d6c196590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:38.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.244+0000 7f3d6a7fc700 1 -- 172.21.15.82:0/3789364248 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3d6c100930 msgr2=0x7f3d6c196590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:38.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.244+0000 7f3d6a7fc700 1 --2- 172.21.15.82:0/3789364248 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3d6c100930 0x7f3d6c196590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:38.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.244+0000 7f3d6a7fc700 1 -- 172.21.15.82:0/3789364248 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d6c1024c0 msgr2=0x7f3d6c19db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:38.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.244+0000 7f3d6a7fc700 1 --2- 172.21.15.82:0/3789364248 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d6c1024c0 0x7f3d6c19db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:38.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.244+0000 7f3d6a7fc700 1 -- 172.21.15.82:0/3789364248 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d5c0095f0 con 0x7f3d6c101b20 2023-09-23T08:56:38.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.244+0000 7f3d6a7fc700 1 --2- 172.21.15.82:0/3789364248 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d6c101b20 0x7f3d6c196ad0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f3d6000e9a0 tx=0x7f3d6000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:38.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.245+0000 7f3d53fff700 1 -- 172.21.15.82:0/3789364248 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d60009790 con 0x7f3d6c101b20 2023-09-23T08:56:38.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.245+0000 7f3d53fff700 1 -- 172.21.15.82:0/3789364248 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3d6000cbd0 con 0x7f3d6c101b20 2023-09-23T08:56:38.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.245+0000 7f3d53fff700 1 -- 172.21.15.82:0/3789364248 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d60018680 con 0x7f3d6c101b20 2023-09-23T08:56:38.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.245+0000 7f3d715ff700 1 -- 172.21.15.82:0/3789364248 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d6c19e6c0 con 0x7f3d6c101b20 2023-09-23T08:56:38.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.245+0000 7f3d715ff700 1 -- 172.21.15.82:0/3789364248 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d6c19ebd0 con 0x7f3d6c101b20 2023-09-23T08:56:38.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.246+0000 7f3d715ff700 1 -- 172.21.15.82:0/3789364248 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d6c107970 con 0x7f3d6c101b20 2023-09-23T08:56:38.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.248+0000 7f3d53fff700 1 -- 172.21.15.82:0/3789364248 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 134671+0+0 (secure 0 0 0) 0x7f3d6000cd40 con 0x7f3d6c101b20 2023-09-23T08:56:38.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.249+0000 7f3d53fff700 1 --2- 172.21.15.82:0/3789364248 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f3d5409ffd0 0x7f3d540a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:38.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.249+0000 7f3d53fff700 1 -- 172.21.15.82:0/3789364248 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f3d60014070 con 0x7f3d6c101b20 2023-09-23T08:56:38.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.249+0000 7f3d6affd700 1 --2- 172.21.15.82:0/3789364248 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f3d5409ffd0 0x7f3d540a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:38.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.250+0000 7f3d6affd700 1 --2- 172.21.15.82:0/3789364248 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f3d5409ffd0 0x7f3d540a2490 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c009990 tx=0x7f3d5c01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:38.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.253+0000 7f3d53fff700 1 -- 172.21.15.82:0/3789364248 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f3d60051e00 con 0x7f3d6c101b20 2023-09-23T08:56:38.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:38 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/3678918027' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-09-23T08:56:38.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:38 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/908634881' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-09-23T08:56:38.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:38 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/1637679124' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-23T08:56:38.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.454+0000 7f3d715ff700 1 -- 172.21.15.82:0/3789364248 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3d6c02cdc0 con 0x7f3d6c101b20 2023-09-23T08:56:38.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.454+0000 7f3d53fff700 1 -- 172.21.15.82:0/3789364248 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3d60098cd0 con 0x7f3d6c101b20 2023-09-23T08:56:38.457 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-09-23T08:56:38.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.456+0000 7f3d715ff700 1 -- 172.21.15.82:0/3789364248 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f3d5409ffd0 msgr2=0x7f3d540a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:38.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.456+0000 7f3d715ff700 1 --2- 172.21.15.82:0/3789364248 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f3d5409ffd0 0x7f3d540a2490 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c009990 tx=0x7f3d5c01a040 comp rx=0 tx=0).stop 2023-09-23T08:56:38.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.456+0000 7f3d715ff700 1 -- 172.21.15.82:0/3789364248 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d6c101b20 msgr2=0x7f3d6c196ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:38.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.456+0000 7f3d715ff700 1 --2- 172.21.15.82:0/3789364248 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d6c101b20 0x7f3d6c196ad0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f3d6000e9a0 tx=0x7f3d6000ed60 comp rx=0 tx=0).stop 2023-09-23T08:56:38.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.457+0000 7f3d715ff700 1 -- 172.21.15.82:0/3789364248 shutdown_connections 2023-09-23T08:56:38.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.457+0000 7f3d715ff700 1 --2- 172.21.15.82:0/3789364248 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f3d5409ffd0 0x7f3d540a2490 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:38.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.457+0000 7f3d715ff700 1 --2- 172.21.15.82:0/3789364248 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d6c1024c0 0x7f3d6c19db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:38.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.457+0000 7f3d715ff700 1 --2- 172.21.15.82:0/3789364248 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3d6c100930 0x7f3d6c196590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:38.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.457+0000 7f3d715ff700 1 --2- 172.21.15.82:0/3789364248 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d6c101b20 0x7f3d6c196ad0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:38.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.457+0000 7f3d715ff700 1 -- 172.21.15.82:0/3789364248 >> 172.21.15.82:0/3789364248 conn(0x7f3d6c0fbea0 msgr2=0x7f3d6c0fe230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:38.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.457+0000 7f3d715ff700 1 -- 172.21.15.82:0/3789364248 shutdown_connections 2023-09-23T08:56:38.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.457+0000 7f3d715ff700 1 -- 172.21.15.82:0/3789364248 wait complete. 2023-09-23T08:56:38.477 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-23T08:56:38.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:38 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/3678918027' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-09-23T08:56:38.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:38 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/908634881' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-09-23T08:56:38.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:38 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/1637679124' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-23T08:56:38.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:38 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/3678918027' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-09-23T08:56:38.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:38 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/908634881' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-09-23T08:56:38.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:38 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/1637679124' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-23T08:56:38.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.676+0000 7f0dee1ff700 1 -- 172.21.15.82:0/500957186 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0de8101b20 msgr2=0x7f0de8101f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:38.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.676+0000 7f0dee1ff700 1 --2- 172.21.15.82:0/500957186 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0de8101b20 0x7f0de8101f80 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc0099c0 tx=0x7f0ddc009cd0 comp rx=0 tx=0).stop 2023-09-23T08:56:38.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.676+0000 7f0dee1ff700 1 -- 172.21.15.82:0/500957186 shutdown_connections 2023-09-23T08:56:38.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.676+0000 7f0dee1ff700 1 --2- 172.21.15.82:0/500957186 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0de81024c0 0x7f0de8108d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:38.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.676+0000 7f0dee1ff700 1 --2- 172.21.15.82:0/500957186 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0de8100930 0x7f0de8100d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:38.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.676+0000 7f0dee1ff700 1 --2- 172.21.15.82:0/500957186 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0de8101b20 0x7f0de8101f80 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:38.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.676+0000 7f0dee1ff700 1 -- 172.21.15.82:0/500957186 >> 172.21.15.82:0/500957186 conn(0x7f0de80fbea0 msgr2=0x7f0de80fe2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:38.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.676+0000 7f0dee1ff700 1 -- 172.21.15.82:0/500957186 shutdown_connections 2023-09-23T08:56:38.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.676+0000 7f0dee1ff700 1 -- 172.21.15.82:0/500957186 wait complete. 2023-09-23T08:56:38.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.677+0000 7f0dee1ff700 1 Processor -- start 2023-09-23T08:56:38.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.677+0000 7f0dee1ff700 1 -- start start 2023-09-23T08:56:38.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.677+0000 7f0dee1ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0de8100930 0x7f0de80746d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:38.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.677+0000 7f0dee1ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0de8101b20 0x7f0de8072d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:38.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.678+0000 7f0dee1ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0de81024c0 0x7f0de8073250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:38.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.678+0000 7f0dee1ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0de80739f0 con 0x7f0de8101b20 2023-09-23T08:56:38.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.678+0000 7f0dee1ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0de8073b60 con 0x7f0de81024c0 2023-09-23T08:56:38.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.678+0000 7f0dee1ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0de81a0560 con 0x7f0de8100930 2023-09-23T08:56:38.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.678+0000 7f0de6ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0de8101b20 0x7f0de8072d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:38.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.678+0000 7f0de6ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0de8101b20 0x7f0de8072d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45148/0 (socket says 172.21.15.82:45148) 2023-09-23T08:56:38.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.678+0000 7f0de6ffd700 1 -- 172.21.15.82:0/1263263478 learned_addr learned my addr 172.21.15.82:0/1263263478 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:38.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.678+0000 7f0de77fe700 1 --2- 172.21.15.82:0/1263263478 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0de8100930 0x7f0de80746d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:38.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.678+0000 7f0de7fff700 1 --2- 172.21.15.82:0/1263263478 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0de81024c0 0x7f0de8073250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:38.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.678+0000 7f0de6ffd700 1 -- 172.21.15.82:0/1263263478 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0de8100930 msgr2=0x7f0de80746d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:38.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.678+0000 7f0de6ffd700 1 --2- 172.21.15.82:0/1263263478 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0de8100930 0x7f0de80746d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:38.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.678+0000 7f0de6ffd700 1 -- 172.21.15.82:0/1263263478 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0de81024c0 msgr2=0x7f0de8073250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:38.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.678+0000 7f0de6ffd700 1 --2- 172.21.15.82:0/1263263478 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0de81024c0 0x7f0de8073250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:38.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.678+0000 7f0de6ffd700 1 -- 172.21.15.82:0/1263263478 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ddc0095f0 con 0x7f0de8101b20 2023-09-23T08:56:38.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.678+0000 7f0de6ffd700 1 --2- 172.21.15.82:0/1263263478 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0de8101b20 0x7f0de8072d10 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc009fd0 tx=0x7f0ddc00fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:38.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.679+0000 7f0de4ff9700 1 -- 172.21.15.82:0/1263263478 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ddc01d070 con 0x7f0de8101b20 2023-09-23T08:56:38.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.679+0000 7f0de4ff9700 1 -- 172.21.15.82:0/1263263478 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0ddc0059a0 con 0x7f0de8101b20 2023-09-23T08:56:38.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.679+0000 7f0dee1ff700 1 -- 172.21.15.82:0/1263263478 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0de81a07e0 con 0x7f0de8101b20 2023-09-23T08:56:38.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.679+0000 7f0de4ff9700 1 -- 172.21.15.82:0/1263263478 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ddc0173f0 con 0x7f0de8101b20 2023-09-23T08:56:38.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.679+0000 7f0dee1ff700 1 -- 172.21.15.82:0/1263263478 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0de81a0ce0 con 0x7f0de8101b20 2023-09-23T08:56:38.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.680+0000 7f0dee1ff700 1 -- 172.21.15.82:0/1263263478 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0de81078b0 con 0x7f0de8101b20 2023-09-23T08:56:38.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.682+0000 7f0de4ff9700 1 -- 172.21.15.82:0/1263263478 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 134671+0+0 (secure 0 0 0) 0x7f0ddc022470 con 0x7f0de8101b20 2023-09-23T08:56:38.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.683+0000 7f0de4ff9700 1 --2- 172.21.15.82:0/1263263478 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f0dd009ffd0 0x7f0dd00a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:38.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.683+0000 7f0de4ff9700 1 -- 172.21.15.82:0/1263263478 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f0ddc0cc7a0 con 0x7f0de8101b20 2023-09-23T08:56:38.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.683+0000 7f0de77fe700 1 --2- 172.21.15.82:0/1263263478 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f0dd009ffd0 0x7f0dd00a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:38.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.684+0000 7f0de77fe700 1 --2- 172.21.15.82:0/1263263478 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f0dd009ffd0 0x7f0dd00a2490 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f0de8101980 tx=0x7f0dd8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:38.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.685+0000 7f0de4ff9700 1 -- 172.21.15.82:0/1263263478 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f0ddc096570 con 0x7f0de8101b20 2023-09-23T08:56:38.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.887+0000 7f0dee1ff700 1 -- 172.21.15.82:0/1263263478 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0de810c220 con 0x7f0de8101b20 2023-09-23T08:56:38.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.887+0000 7f0de4ff9700 1 -- 172.21.15.82:0/1263263478 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0ddc099b90 con 0x7f0de8101b20 2023-09-23T08:56:38.890 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2023-09-23T08:56:38.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.890+0000 7f0dee1ff700 1 -- 172.21.15.82:0/1263263478 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f0dd009ffd0 msgr2=0x7f0dd00a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:38.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.890+0000 7f0dee1ff700 1 --2- 172.21.15.82:0/1263263478 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f0dd009ffd0 0x7f0dd00a2490 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f0de8101980 tx=0x7f0dd8009260 comp rx=0 tx=0).stop 2023-09-23T08:56:38.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.890+0000 7f0dee1ff700 1 -- 172.21.15.82:0/1263263478 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0de8101b20 msgr2=0x7f0de8072d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:38.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.890+0000 7f0dee1ff700 1 --2- 172.21.15.82:0/1263263478 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0de8101b20 0x7f0de8072d10 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc009fd0 tx=0x7f0ddc00fa00 comp rx=0 tx=0).stop 2023-09-23T08:56:38.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.890+0000 7f0dee1ff700 1 -- 172.21.15.82:0/1263263478 shutdown_connections 2023-09-23T08:56:38.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.890+0000 7f0dee1ff700 1 --2- 172.21.15.82:0/1263263478 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f0dd009ffd0 0x7f0dd00a2490 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:38.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.890+0000 7f0dee1ff700 1 --2- 172.21.15.82:0/1263263478 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0de81024c0 0x7f0de8073250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:38.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.890+0000 7f0dee1ff700 1 --2- 172.21.15.82:0/1263263478 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0de8100930 0x7f0de80746d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:38.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.890+0000 7f0dee1ff700 1 --2- 172.21.15.82:0/1263263478 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0de8101b20 0x7f0de8072d10 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:38.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.890+0000 7f0dee1ff700 1 -- 172.21.15.82:0/1263263478 >> 172.21.15.82:0/1263263478 conn(0x7f0de80fbea0 msgr2=0x7f0de80fe190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:38.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.890+0000 7f0dee1ff700 1 -- 172.21.15.82:0/1263263478 shutdown_connections 2023-09-23T08:56:38.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:38.890+0000 7f0dee1ff700 1 -- 172.21.15.82:0/1263263478 wait complete. 2023-09-23T08:56:38.911 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-23T08:56:39.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.109+0000 7f7ca8fff700 1 -- 172.21.15.82:0/536392001 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ca4100930 msgr2=0x7f7ca4100d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:39.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.109+0000 7f7ca8fff700 1 --2- 172.21.15.82:0/536392001 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ca4100930 0x7f7ca4100d50 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f7c940099c0 tx=0x7f7c94009cd0 comp rx=0 tx=0).stop 2023-09-23T08:56:39.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.109+0000 7f7ca8fff700 1 -- 172.21.15.82:0/536392001 shutdown_connections 2023-09-23T08:56:39.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.109+0000 7f7ca8fff700 1 --2- 172.21.15.82:0/536392001 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ca41024c0 0x7f7ca4108d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:39.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.109+0000 7f7ca8fff700 1 --2- 172.21.15.82:0/536392001 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ca4100930 0x7f7ca4100d50 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:39.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.109+0000 7f7ca8fff700 1 --2- 172.21.15.82:0/536392001 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ca4101b20 0x7f7ca4101f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:39.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.109+0000 7f7ca8fff700 1 -- 172.21.15.82:0/536392001 >> 172.21.15.82:0/536392001 conn(0x7f7ca40fbea0 msgr2=0x7f7ca40fe2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:39.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.109+0000 7f7ca8fff700 1 -- 172.21.15.82:0/536392001 shutdown_connections 2023-09-23T08:56:39.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.109+0000 7f7ca8fff700 1 -- 172.21.15.82:0/536392001 wait complete. 2023-09-23T08:56:39.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.110+0000 7f7ca8fff700 1 Processor -- start 2023-09-23T08:56:39.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.110+0000 7f7ca8fff700 1 -- start start 2023-09-23T08:56:39.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.110+0000 7f7ca8fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ca4100930 0x7f7ca4196550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:39.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.110+0000 7f7ca8fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ca4101b20 0x7f7ca4196a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:39.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.110+0000 7f7ca8fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ca41024c0 0x7f7ca419db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:39.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.110+0000 7f7ca8fff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca419e0d0 con 0x7f7ca41024c0 2023-09-23T08:56:39.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.110+0000 7f7ca8fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca419e210 con 0x7f7ca4100930 2023-09-23T08:56:39.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.110+0000 7f7ca8fff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca419e3a0 con 0x7f7ca4101b20 2023-09-23T08:56:39.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.111+0000 7f7ca259c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ca4100930 0x7f7ca4196550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:39.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.111+0000 7f7ca2d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ca41024c0 0x7f7ca419db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:39.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.111+0000 7f7ca259c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ca4100930 0x7f7ca4196550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:44598/0 (socket says 172.21.15.82:44598) 2023-09-23T08:56:39.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.111+0000 7f7ca259c700 1 -- 172.21.15.82:0/964663249 learned_addr learned my addr 172.21.15.82:0/964663249 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:39.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.111+0000 7f7c9bfff700 1 --2- 172.21.15.82:0/964663249 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ca4101b20 0x7f7ca4196a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:39.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.111+0000 7f7ca2d9d700 1 -- 172.21.15.82:0/964663249 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ca4101b20 msgr2=0x7f7ca4196a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:39.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.111+0000 7f7ca2d9d700 1 --2- 172.21.15.82:0/964663249 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ca4101b20 0x7f7ca4196a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:39.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.111+0000 7f7ca2d9d700 1 -- 172.21.15.82:0/964663249 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ca4100930 msgr2=0x7f7ca4196550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:39.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.111+0000 7f7ca2d9d700 1 --2- 172.21.15.82:0/964663249 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ca4100930 0x7f7ca4196550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:39.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.111+0000 7f7ca2d9d700 1 -- 172.21.15.82:0/964663249 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c940095f0 con 0x7f7ca41024c0 2023-09-23T08:56:39.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.111+0000 7f7c9bfff700 1 --2- 172.21.15.82:0/964663249 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ca4101b20 0x7f7ca4196a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T08:56:39.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.111+0000 7f7ca2d9d700 1 --2- 172.21.15.82:0/964663249 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ca41024c0 0x7f7ca419db00 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c007f10 tx=0x7f7c9c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:39.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.111+0000 7f7c9b7fe700 1 -- 172.21.15.82:0/964663249 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c9c00ddd0 con 0x7f7ca41024c0 2023-09-23T08:56:39.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.111+0000 7f7ca8fff700 1 -- 172.21.15.82:0/964663249 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ca419e680 con 0x7f7ca41024c0 2023-09-23T08:56:39.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.111+0000 7f7c9b7fe700 1 -- 172.21.15.82:0/964663249 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7c9c00f040 con 0x7f7ca41024c0 2023-09-23T08:56:39.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.111+0000 7f7c9b7fe700 1 -- 172.21.15.82:0/964663249 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c9c0059c0 con 0x7f7ca41024c0 2023-09-23T08:56:39.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.112+0000 7f7ca8fff700 1 -- 172.21.15.82:0/964663249 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ca419eb90 con 0x7f7ca41024c0 2023-09-23T08:56:39.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.113+0000 7f7ca8fff700 1 -- 172.21.15.82:0/964663249 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ca410bff0 con 0x7f7ca41024c0 2023-09-23T08:56:39.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.114+0000 7f7c9b7fe700 1 -- 172.21.15.82:0/964663249 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 134671+0+0 (secure 0 0 0) 0x7f7c9c005020 con 0x7f7ca41024c0 2023-09-23T08:56:39.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.116+0000 7f7c9b7fe700 1 --2- 172.21.15.82:0/964663249 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f7c9009ff50 0x7f7c900a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:39.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.116+0000 7f7c9b7fe700 1 -- 172.21.15.82:0/964663249 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f7c9c0cab50 con 0x7f7ca41024c0 2023-09-23T08:56:39.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.116+0000 7f7ca259c700 1 --2- 172.21.15.82:0/964663249 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f7c9009ff50 0x7f7c900a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:39.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.117+0000 7f7ca259c700 1 --2- 172.21.15.82:0/964663249 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f7c9009ff50 0x7f7c900a2410 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7c9400b580 tx=0x7f7c94005c00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:39.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.119+0000 7f7c9b7fe700 1 -- 172.21.15.82:0/964663249 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f7c9c094890 con 0x7f7ca41024c0 2023-09-23T08:56:39.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.320+0000 7f7ca8fff700 1 -- 172.21.15.82:0/964663249 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7ca4107930 con 0x7f7ca41024c0 2023-09-23T08:56:39.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.321+0000 7f7c9b7fe700 1 -- 172.21.15.82:0/964663249 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7c9c097eb0 con 0x7f7ca41024c0 2023-09-23T08:56:39.323 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2023-09-23T08:56:39.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.323+0000 7f7ca8fff700 1 -- 172.21.15.82:0/964663249 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f7c9009ff50 msgr2=0x7f7c900a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:39.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.323+0000 7f7ca8fff700 1 --2- 172.21.15.82:0/964663249 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f7c9009ff50 0x7f7c900a2410 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7c9400b580 tx=0x7f7c94005c00 comp rx=0 tx=0).stop 2023-09-23T08:56:39.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.323+0000 7f7ca8fff700 1 -- 172.21.15.82:0/964663249 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ca41024c0 msgr2=0x7f7ca419db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:39.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.323+0000 7f7ca8fff700 1 --2- 172.21.15.82:0/964663249 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ca41024c0 0x7f7ca419db00 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c007f10 tx=0x7f7c9c00d3b0 comp rx=0 tx=0).stop 2023-09-23T08:56:39.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.323+0000 7f7ca8fff700 1 -- 172.21.15.82:0/964663249 shutdown_connections 2023-09-23T08:56:39.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.323+0000 7f7ca8fff700 1 --2- 172.21.15.82:0/964663249 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f7c9009ff50 0x7f7c900a2410 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:39.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.323+0000 7f7ca8fff700 1 --2- 172.21.15.82:0/964663249 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ca41024c0 0x7f7ca419db00 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:39.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.323+0000 7f7ca8fff700 1 --2- 172.21.15.82:0/964663249 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ca4100930 0x7f7ca4196550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:39.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.323+0000 7f7ca8fff700 1 --2- 172.21.15.82:0/964663249 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ca4101b20 0x7f7ca4196a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:39.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.323+0000 7f7ca8fff700 1 -- 172.21.15.82:0/964663249 >> 172.21.15.82:0/964663249 conn(0x7f7ca40fbea0 msgr2=0x7f7ca40fe270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:39.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.323+0000 7f7ca8fff700 1 -- 172.21.15.82:0/964663249 shutdown_connections 2023-09-23T08:56:39.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.323+0000 7f7ca8fff700 1 -- 172.21.15.82:0/964663249 wait complete. 2023-09-23T08:56:39.342 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:39 smithi082 ceph-mon[97694]: pgmap v356: 97 pgs: 97 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 682 B/s wr, 10 op/s 2023-09-23T08:56:39.342 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:39 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/3789364248' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-23T08:56:39.342 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:39 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/1263263478' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-09-23T08:56:39.344 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2023-09-23T08:56:39.345 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-23T08:56:39.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.540+0000 7f25639ff700 1 -- 172.21.15.82:0/1064127365 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f255c108800 msgr2=0x7f255c10ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:39.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.540+0000 7f25639ff700 1 --2- 172.21.15.82:0/1064127365 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f255c108800 0x7f255c10ac70 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f255400b0a0 tx=0x7f255400b3b0 comp rx=0 tx=0).stop 2023-09-23T08:56:39.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.540+0000 7f25639ff700 1 -- 172.21.15.82:0/1064127365 shutdown_connections 2023-09-23T08:56:39.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.540+0000 7f25639ff700 1 --2- 172.21.15.82:0/1064127365 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f255c108800 0x7f255c10ac70 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:39.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.540+0000 7f25639ff700 1 --2- 172.21.15.82:0/1064127365 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f255c074900 0x7f255c072d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:39.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.540+0000 7f25639ff700 1 --2- 172.21.15.82:0/1064127365 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f255c073320 0x7f255c0737a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:39.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.540+0000 7f25639ff700 1 -- 172.21.15.82:0/1064127365 >> 172.21.15.82:0/1064127365 conn(0x7f255c0fbe60 msgr2=0x7f255c0fe2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:39.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.540+0000 7f25639ff700 1 -- 172.21.15.82:0/1064127365 shutdown_connections 2023-09-23T08:56:39.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.540+0000 7f25639ff700 1 -- 172.21.15.82:0/1064127365 wait complete. 2023-09-23T08:56:39.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.541+0000 7f25639ff700 1 Processor -- start 2023-09-23T08:56:39.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.542+0000 7f25639ff700 1 -- start start 2023-09-23T08:56:39.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.542+0000 7f25639ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f255c073320 0x7f255c1987a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:39.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.542+0000 7f25639ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f255c074900 0x7f255c198ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:39.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.542+0000 7f25639ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f255c108800 0x7f255c19fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:39.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.542+0000 7f25639ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f255c1a0320 con 0x7f255c073320 2023-09-23T08:56:39.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.542+0000 7f25639ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f255c1a0460 con 0x7f255c074900 2023-09-23T08:56:39.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.542+0000 7f25639ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f255c1a05f0 con 0x7f255c108800 2023-09-23T08:56:39.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.542+0000 7f256179b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f255c073320 0x7f255c1987a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:39.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.542+0000 7f256179b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f255c073320 0x7f255c1987a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45186/0 (socket says 172.21.15.82:45186) 2023-09-23T08:56:39.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.542+0000 7f256179b700 1 -- 172.21.15.82:0/425501270 learned_addr learned my addr 172.21.15.82:0/425501270 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:39.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.542+0000 7f2560f9a700 1 --2- 172.21.15.82:0/425501270 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f255c074900 0x7f255c198ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:39.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.543+0000 7f2561f9c700 1 --2- 172.21.15.82:0/425501270 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f255c108800 0x7f255c19fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:39.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.543+0000 7f256179b700 1 -- 172.21.15.82:0/425501270 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f255c108800 msgr2=0x7f255c19fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:39.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.543+0000 7f256179b700 1 --2- 172.21.15.82:0/425501270 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f255c108800 0x7f255c19fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:39.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.543+0000 7f256179b700 1 -- 172.21.15.82:0/425501270 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f255c074900 msgr2=0x7f255c198ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:39.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.543+0000 7f256179b700 1 --2- 172.21.15.82:0/425501270 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f255c074900 0x7f255c198ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:39.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.543+0000 7f256179b700 1 -- 172.21.15.82:0/425501270 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2554009d00 con 0x7f255c073320 2023-09-23T08:56:39.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.543+0000 7f2561f9c700 1 --2- 172.21.15.82:0/425501270 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f255c108800 0x7f255c19fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T08:56:39.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.543+0000 7f2560f9a700 1 --2- 172.21.15.82:0/425501270 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f255c074900 0x7f255c198ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T08:56:39.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.543+0000 7f256179b700 1 --2- 172.21.15.82:0/425501270 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f255c073320 0x7f255c1987a0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f255800e9a0 tx=0x7f255800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:39.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.543+0000 7f25527fc700 1 -- 172.21.15.82:0/425501270 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2558009790 con 0x7f255c073320 2023-09-23T08:56:39.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.543+0000 7f25639ff700 1 -- 172.21.15.82:0/425501270 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f255c1a08d0 con 0x7f255c073320 2023-09-23T08:56:39.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.543+0000 7f25527fc700 1 -- 172.21.15.82:0/425501270 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f255800cbd0 con 0x7f255c073320 2023-09-23T08:56:39.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.543+0000 7f25527fc700 1 -- 172.21.15.82:0/425501270 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2558018680 con 0x7f255c073320 2023-09-23T08:56:39.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.543+0000 7f25639ff700 1 -- 172.21.15.82:0/425501270 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f255c1a0de0 con 0x7f255c073320 2023-09-23T08:56:39.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.544+0000 7f25639ff700 1 -- 172.21.15.82:0/425501270 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f255c106f00 con 0x7f255c073320 2023-09-23T08:56:39.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.546+0000 7f25527fc700 1 -- 172.21.15.82:0/425501270 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 134671+0+0 (secure 0 0 0) 0x7f255800cd40 con 0x7f255c073320 2023-09-23T08:56:39.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.547+0000 7f25527fc700 1 --2- 172.21.15.82:0/425501270 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f254809ffa0 0x7f25480a2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:39.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.548+0000 7f25527fc700 1 -- 172.21.15.82:0/425501270 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f2558014070 con 0x7f255c073320 2023-09-23T08:56:39.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.548+0000 7f2560f9a700 1 --2- 172.21.15.82:0/425501270 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f254809ffa0 0x7f25480a2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:39.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.548+0000 7f2560f9a700 1 --2- 172.21.15.82:0/425501270 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f254809ffa0 0x7f25480a2460 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f254c009cb0 tx=0x7f254c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:39.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.551+0000 7f25527fc700 1 -- 172.21.15.82:0/425501270 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f2558051e00 con 0x7f255c073320 2023-09-23T08:56:39.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:39 smithi135 ceph-mon[99205]: pgmap v356: 97 pgs: 97 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 682 B/s wr, 10 op/s 2023-09-23T08:56:39.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:39 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/3789364248' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-23T08:56:39.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:39 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/1263263478' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-09-23T08:56:39.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:39 smithi161 ceph-mon[99580]: pgmap v356: 97 pgs: 97 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 682 B/s wr, 10 op/s 2023-09-23T08:56:39.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:39 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/3789364248' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-23T08:56:39.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:39 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/1263263478' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-09-23T08:56:39.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.796+0000 7f25639ff700 1 -- 172.21.15.82:0/425501270 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f255c10e1c0 con 0x7f255c073320 2023-09-23T08:56:39.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.797+0000 7f25527fc700 1 -- 172.21.15.82:0/425501270 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+11323 (secure 0 0 0) 0x7f2558098d40 con 0x7f255c073320 2023-09-23T08:56:39.799 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:56:39.799 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/1237857359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1237857359},{"type":"v1","addr":"172.21.15.82:6835","nonce":1237857359}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/1335102362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":1335102362},{"type":"v1","addr":"172.21.15.82:6837","nonce":1335102362}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-23T08:54:52.600479+0000","modified":"2023-09-23T08:55:00.481507+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24557,"mds_1":24550,"mds_2":24526,"mds_3":24515,"mds_4":24514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/3645331700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3645331700},{"type":"v1","addr":"172.21.15.135:6835","nonce":3645331700}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14658":{"gid":14658,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6839/205725278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":205725278},{"type":"v1","addr":"172.21.15.82:6839","nonce":205725278}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14670":{"gid":14670,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6841/2659297867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":2659297867},{"type":"v1","addr":"172.21.15.82:6841","nonce":2659297867}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24461":{"gid":24461,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/503886037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":503886037},{"type":"v1","addr":"172.21.15.135:6833","nonce":503886037}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24463":{"gid":24463,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.161:6833/471569125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":471569125},{"type":"v1","addr":"172.21.15.161:6833","nonce":471569125}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24514":{"gid":24514,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":10,"addr":"172.21.15.161:6835/2237964162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":2237964162},{"type":"v1","addr":"172.21.15.161:6835","nonce":2237964162}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24515":{"gid":24515,"name":"h","rank":3,"incarnation":22,"state":"up:active","state_seq":8,"addr":"172.21.15.135:6837/2655304858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2655304858},{"type":"v1","addr":"172.21.15.135:6837","nonce":2655304858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24526":{"gid":24526,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.161:6837/43639843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":43639843},{"type":"v1","addr":"172.21.15.161:6837","nonce":43639843}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24550":{"gid":24550,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.161:6839/758982817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6838","nonce":758982817},{"type":"v1","addr":"172.21.15.161:6839","nonce":758982817}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24557":{"gid":24557,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6839/2508669274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2508669274},{"type":"v1","addr":"172.21.15.135:6839","nonce":2508669274}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-23T08:56:39.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.799+0000 7f25639ff700 1 -- 172.21.15.82:0/425501270 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f254809ffa0 msgr2=0x7f25480a2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:39.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.799+0000 7f25639ff700 1 --2- 172.21.15.82:0/425501270 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f254809ffa0 0x7f25480a2460 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f254c009cb0 tx=0x7f254c009260 comp rx=0 tx=0).stop 2023-09-23T08:56:39.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.799+0000 7f25639ff700 1 -- 172.21.15.82:0/425501270 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f255c073320 msgr2=0x7f255c1987a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:39.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.799+0000 7f25639ff700 1 --2- 172.21.15.82:0/425501270 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f255c073320 0x7f255c1987a0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f255800e9a0 tx=0x7f255800ed60 comp rx=0 tx=0).stop 2023-09-23T08:56:39.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.799+0000 7f25639ff700 1 -- 172.21.15.82:0/425501270 shutdown_connections 2023-09-23T08:56:39.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.799+0000 7f25639ff700 1 --2- 172.21.15.82:0/425501270 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f254809ffa0 0x7f25480a2460 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:39.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.799+0000 7f25639ff700 1 --2- 172.21.15.82:0/425501270 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f255c108800 0x7f255c19fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:39.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.799+0000 7f25639ff700 1 --2- 172.21.15.82:0/425501270 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f255c073320 0x7f255c1987a0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:39.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.799+0000 7f25639ff700 1 --2- 172.21.15.82:0/425501270 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f255c074900 0x7f255c198ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:39.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.799+0000 7f25639ff700 1 -- 172.21.15.82:0/425501270 >> 172.21.15.82:0/425501270 conn(0x7f255c0fbe60 msgr2=0x7f255c0fe250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:39.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.799+0000 7f25639ff700 1 -- 172.21.15.82:0/425501270 shutdown_connections 2023-09-23T08:56:39.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:39.799+0000 7f25639ff700 1 -- 172.21.15.82:0/425501270 wait complete. 2023-09-23T08:56:39.803 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 26 2023-09-23T08:56:39.820 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2023-09-23T08:56:39.821 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2023-09-23T08:56:39.821 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-23T08:56:40.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.015+0000 7f0781bff700 1 -- 172.21.15.82:0/709853194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f077c1024c0 msgr2=0x7f077c108d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:40.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.015+0000 7f0781bff700 1 --2- 172.21.15.82:0/709853194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f077c1024c0 0x7f077c108d70 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f077400b0d0 tx=0x7f077400b3e0 comp rx=0 tx=0).stop 2023-09-23T08:56:40.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.015+0000 7f0781bff700 1 -- 172.21.15.82:0/709853194 shutdown_connections 2023-09-23T08:56:40.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.015+0000 7f0781bff700 1 --2- 172.21.15.82:0/709853194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f077c1024c0 0x7f077c108d70 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:40.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.015+0000 7f0781bff700 1 --2- 172.21.15.82:0/709853194 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f077c100930 0x7f077c100d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:40.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.015+0000 7f0781bff700 1 --2- 172.21.15.82:0/709853194 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f077c101b20 0x7f077c101f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:40.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.015+0000 7f0781bff700 1 -- 172.21.15.82:0/709853194 >> 172.21.15.82:0/709853194 conn(0x7f077c0fbe60 msgr2=0x7f077c0fe2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:40.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.015+0000 7f0781bff700 1 -- 172.21.15.82:0/709853194 shutdown_connections 2023-09-23T08:56:40.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.015+0000 7f0781bff700 1 -- 172.21.15.82:0/709853194 wait complete. 2023-09-23T08:56:40.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.016+0000 7f0781bff700 1 Processor -- start 2023-09-23T08:56:40.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.016+0000 7f0781bff700 1 -- start start 2023-09-23T08:56:40.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.016+0000 7f0781bff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f077c100930 0x7f077c0746d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:40.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.016+0000 7f0781bff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f077c101b20 0x7f077c072d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:40.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.016+0000 7f0781bff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f077c1024c0 0x7f077c073250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:40.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.016+0000 7f0781bff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f077c0739f0 con 0x7f077c101b20 2023-09-23T08:56:40.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.016+0000 7f0781bff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f077c073b60 con 0x7f077c1024c0 2023-09-23T08:56:40.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.016+0000 7f0781bff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f077c1a0640 con 0x7f077c100930 2023-09-23T08:56:40.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.017+0000 7f077affd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f077c101b20 0x7f077c072d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:40.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.017+0000 7f077affd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f077c101b20 0x7f077c072d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45202/0 (socket says 172.21.15.82:45202) 2023-09-23T08:56:40.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.017+0000 7f077affd700 1 -- 172.21.15.82:0/3053147388 learned_addr learned my addr 172.21.15.82:0/3053147388 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:40.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.017+0000 7f077b7fe700 1 --2- 172.21.15.82:0/3053147388 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f077c100930 0x7f077c0746d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:40.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.017+0000 7f077affd700 1 -- 172.21.15.82:0/3053147388 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f077c100930 msgr2=0x7f077c0746d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:40.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.017+0000 7f077affd700 1 --2- 172.21.15.82:0/3053147388 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f077c100930 0x7f077c0746d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:40.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.017+0000 7f077affd700 1 -- 172.21.15.82:0/3053147388 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f077c1024c0 msgr2=0x7f077c073250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:40.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.017+0000 7f077bfff700 1 --2- 172.21.15.82:0/3053147388 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f077c1024c0 0x7f077c073250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:40.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.017+0000 7f077affd700 1 --2- 172.21.15.82:0/3053147388 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f077c1024c0 0x7f077c073250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:40.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.017+0000 7f077affd700 1 -- 172.21.15.82:0/3053147388 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0774009d00 con 0x7f077c101b20 2023-09-23T08:56:40.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.017+0000 7f077b7fe700 1 --2- 172.21.15.82:0/3053147388 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f077c100930 0x7f077c0746d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T08:56:40.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.017+0000 7f077bfff700 1 --2- 172.21.15.82:0/3053147388 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f077c1024c0 0x7f077c073250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T08:56:40.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.017+0000 7f077affd700 1 --2- 172.21.15.82:0/3053147388 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f077c101b20 0x7f077c072d10 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f077000d950 tx=0x7f077000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:40.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.018+0000 7f0778ff9700 1 -- 172.21.15.82:0/3053147388 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0770009b40 con 0x7f077c101b20 2023-09-23T08:56:40.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.018+0000 7f0778ff9700 1 -- 172.21.15.82:0/3053147388 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0770009ca0 con 0x7f077c101b20 2023-09-23T08:56:40.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.018+0000 7f0781bff700 1 -- 172.21.15.82:0/3053147388 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f077c1a0920 con 0x7f077c101b20 2023-09-23T08:56:40.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.018+0000 7f0778ff9700 1 -- 172.21.15.82:0/3053147388 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f077000f620 con 0x7f077c101b20 2023-09-23T08:56:40.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.018+0000 7f0781bff700 1 -- 172.21.15.82:0/3053147388 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f077c1a0e80 con 0x7f077c101b20 2023-09-23T08:56:40.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.019+0000 7f0781bff700 1 -- 172.21.15.82:0/3053147388 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f077c107ec0 con 0x7f077c101b20 2023-09-23T08:56:40.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.021+0000 7f0778ff9700 1 -- 172.21.15.82:0/3053147388 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 134671+0+0 (secure 0 0 0) 0x7f0770010460 con 0x7f077c101b20 2023-09-23T08:56:40.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.022+0000 7f0778ff9700 1 --2- 172.21.15.82:0/3053147388 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f07640a0020 0x7f07640a24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:40.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.022+0000 7f0778ff9700 1 -- 172.21.15.82:0/3053147388 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f07700cb590 con 0x7f077c101b20 2023-09-23T08:56:40.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.022+0000 7f077b7fe700 1 --2- 172.21.15.82:0/3053147388 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f07640a0020 0x7f07640a24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:40.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.023+0000 7f077b7fe700 1 --2- 172.21.15.82:0/3053147388 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f07640a0020 0x7f07640a24e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f076c005950 tx=0x7f076c0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:40.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.026+0000 7f0778ff9700 1 -- 172.21.15.82:0/3053147388 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f07700952d0 con 0x7f077c101b20 2023-09-23T08:56:40.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.228+0000 7f0781bff700 1 -- 172.21.15.82:0/3053147388 --> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f077c02cde0 con 0x7f07640a0020 2023-09-23T08:56:40.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.239+0000 7f0778ff9700 1 -- 172.21.15.82:0/3053147388 <== mgr.14152 v2:172.21.15.82:6800/3698954311 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+343229 (secure 0 0 0) 0x7f077c02cde0 con 0x7f07640a0020 2023-09-23T08:56:40.246 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:56:40.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.244+0000 7f0781bff700 1 -- 172.21.15.82:0/3053147388 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f07640a0020 msgr2=0x7f07640a24e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:40.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.244+0000 7f0781bff700 1 --2- 172.21.15.82:0/3053147388 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f07640a0020 0x7f07640a24e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f076c005950 tx=0x7f076c0058e0 comp rx=0 tx=0).stop 2023-09-23T08:56:40.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.244+0000 7f0781bff700 1 -- 172.21.15.82:0/3053147388 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f077c101b20 msgr2=0x7f077c072d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:40.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.244+0000 7f0781bff700 1 --2- 172.21.15.82:0/3053147388 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f077c101b20 0x7f077c072d10 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f077000d950 tx=0x7f077000dd10 comp rx=0 tx=0).stop 2023-09-23T08:56:40.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.244+0000 7f0781bff700 1 -- 172.21.15.82:0/3053147388 shutdown_connections 2023-09-23T08:56:40.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.244+0000 7f0781bff700 1 --2- 172.21.15.82:0/3053147388 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f07640a0020 0x7f07640a24e0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:40.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.244+0000 7f0781bff700 1 --2- 172.21.15.82:0/3053147388 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f077c1024c0 0x7f077c073250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:40.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.244+0000 7f0781bff700 1 --2- 172.21.15.82:0/3053147388 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f077c100930 0x7f077c0746d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:40.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.244+0000 7f0781bff700 1 --2- 172.21.15.82:0/3053147388 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f077c101b20 0x7f077c072d10 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:40.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.244+0000 7f0781bff700 1 -- 172.21.15.82:0/3053147388 >> 172.21.15.82:0/3053147388 conn(0x7f077c0fbe60 msgr2=0x7f077c105000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:40.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.244+0000 7f0781bff700 1 -- 172.21.15.82:0/3053147388 shutdown_connections 2023-09-23T08:56:40.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.244+0000 7f0781bff700 1 -- 172.21.15.82:0/3053147388 wait complete. 2023-09-23T08:56:40.250 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-09-23T08:56:40.266 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":357,"stamp":"2023-09-23T08:56:40.079391+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658238,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1139,"num_read_kb":690,"num_write":441,"num_write_kb":3086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":1181408,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":862,"ondisk_log_size":862,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":337576,"kb_used_data":13384,"kb_used_omap":20,"kb_used_meta":324075,"kb_avail":1124604248,"statfs":{"total":1151940427776,"available":1151594749952,"internally_reserved":0,"allocated":13705216,"data_stored":7485655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21372,"internal_metadata":331852932},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2415,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":60,"num_write":15,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003060"},"pg_stats":[{"pgid":"3.3f","version":"88'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.099015+0000","last_change":"2023-09-23T08:54:53.110235+0000","last_active":"2023-09-23T08:56:22.099015+0000","last_peered":"2023-09-23T08:56:22.099015+0000","last_clean":"2023-09-23T08:56:22.099015+0000","last_became_active":"2023-09-23T08:54:53.109445+0000","last_became_peered":"2023-09-23T08:54:53.109445+0000","last_unstale":"2023-09-23T08:56:22.099015+0000","last_undegraded":"2023-09-23T08:56:22.099015+0000","last_fullsized":"2023-09-23T08:56:22.099015+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T10:56:35.558203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"88'4","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.085205+0000","last_change":"2023-09-23T08:54:53.105948+0000","last_active":"2023-09-23T08:56:22.085205+0000","last_peered":"2023-09-23T08:56:22.085205+0000","last_clean":"2023-09-23T08:56:22.085205+0000","last_became_active":"2023-09-23T08:54:53.105627+0000","last_became_peered":"2023-09-23T08:54:53.105627+0000","last_unstale":"2023-09-23T08:56:22.085205+0000","last_undegraded":"2023-09-23T08:56:22.085205+0000","last_fullsized":"2023-09-23T08:56:22.085205+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T13:02:00.876110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"88'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.095519+0000","last_change":"2023-09-23T08:54:53.099318+0000","last_active":"2023-09-23T08:56:22.095519+0000","last_peered":"2023-09-23T08:56:22.095519+0000","last_clean":"2023-09-23T08:56:22.095519+0000","last_became_active":"2023-09-23T08:54:53.099002+0000","last_became_peered":"2023-09-23T08:54:53.099002+0000","last_unstale":"2023-09-23T08:56:22.095519+0000","last_undegraded":"2023-09-23T08:56:22.095519+0000","last_fullsized":"2023-09-23T08:56:22.095519+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T11:00:15.427942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"88'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.094825+0000","last_change":"2023-09-23T08:54:53.114757+0000","last_active":"2023-09-23T08:56:22.094825+0000","last_peered":"2023-09-23T08:56:22.094825+0000","last_clean":"2023-09-23T08:56:22.094825+0000","last_became_active":"2023-09-23T08:54:53.113979+0000","last_became_peered":"2023-09-23T08:54:53.113979+0000","last_unstale":"2023-09-23T08:56:22.094825+0000","last_undegraded":"2023-09-23T08:56:22.094825+0000","last_fullsized":"2023-09-23T08:56:22.094825+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T11:02:27.209284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"88'4","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.090455+0000","last_change":"2023-09-23T08:54:53.102122+0000","last_active":"2023-09-23T08:56:22.090455+0000","last_peered":"2023-09-23T08:56:22.090455+0000","last_clean":"2023-09-23T08:56:22.090455+0000","last_became_active":"2023-09-23T08:54:53.101781+0000","last_became_peered":"2023-09-23T08:54:53.101781+0000","last_unstale":"2023-09-23T08:56:22.090455+0000","last_undegraded":"2023-09-23T08:56:22.090455+0000","last_fullsized":"2023-09-23T08:56:22.090455+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T18:27:41.371961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"88'6","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.076942+0000","last_change":"2023-09-23T08:54:53.103617+0000","last_active":"2023-09-23T08:56:22.076942+0000","last_peered":"2023-09-23T08:56:22.076942+0000","last_clean":"2023-09-23T08:56:22.076942+0000","last_became_active":"2023-09-23T08:54:53.103259+0000","last_became_peered":"2023-09-23T08:54:53.103259+0000","last_unstale":"2023-09-23T08:56:22.076942+0000","last_undegraded":"2023-09-23T08:56:22.076942+0000","last_fullsized":"2023-09-23T08:56:22.076942+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:51:15.970275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"88'5","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.082702+0000","last_change":"2023-09-23T08:54:53.110512+0000","last_active":"2023-09-23T08:56:22.082702+0000","last_peered":"2023-09-23T08:56:22.082702+0000","last_clean":"2023-09-23T08:56:22.082702+0000","last_became_active":"2023-09-23T08:54:53.110166+0000","last_became_peered":"2023-09-23T08:54:53.110166+0000","last_unstale":"2023-09-23T08:56:22.082702+0000","last_undegraded":"2023-09-23T08:56:22.082702+0000","last_fullsized":"2023-09-23T08:56:22.082702+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T20:45:16.248775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"88'9","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.099630+0000","last_change":"2023-09-23T08:54:53.111373+0000","last_active":"2023-09-23T08:56:22.099630+0000","last_peered":"2023-09-23T08:56:22.099630+0000","last_clean":"2023-09-23T08:56:22.099630+0000","last_became_active":"2023-09-23T08:54:53.111045+0000","last_became_peered":"2023-09-23T08:54:53.111045+0000","last_unstale":"2023-09-23T08:56:22.099630+0000","last_undegraded":"2023-09-23T08:56:22.099630+0000","last_fullsized":"2023-09-23T08:56:22.099630+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:25:16.099829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"88'11","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.098906+0000","last_change":"2023-09-23T08:54:53.100219+0000","last_active":"2023-09-23T08:56:22.098906+0000","last_peered":"2023-09-23T08:56:22.098906+0000","last_clean":"2023-09-23T08:56:22.098906+0000","last_became_active":"2023-09-23T08:54:53.099925+0000","last_became_peered":"2023-09-23T08:54:53.099925+0000","last_unstale":"2023-09-23T08:56:22.098906+0000","last_undegraded":"2023-09-23T08:56:22.098906+0000","last_fullsized":"2023-09-23T08:56:22.098906+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T20:53:32.264331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"88'16","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.090196+0000","last_change":"2023-09-23T08:55:23.439006+0000","last_active":"2023-09-23T08:56:22.090196+0000","last_peered":"2023-09-23T08:56:22.090196+0000","last_clean":"2023-09-23T08:56:22.090196+0000","last_became_active":"2023-09-23T08:55:23.438533+0000","last_became_peered":"2023-09-23T08:55:23.438533+0000","last_unstale":"2023-09-23T08:56:22.090196+0000","last_undegraded":"2023-09-23T08:56:22.090196+0000","last_fullsized":"2023-09-23T08:56:22.090196+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T12:30:40.717065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"88'6","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.099302+0000","last_change":"2023-09-23T08:54:53.108175+0000","last_active":"2023-09-23T08:56:22.099302+0000","last_peered":"2023-09-23T08:56:22.099302+0000","last_clean":"2023-09-23T08:56:22.099302+0000","last_became_active":"2023-09-23T08:54:53.107889+0000","last_became_peered":"2023-09-23T08:54:53.107889+0000","last_unstale":"2023-09-23T08:56:22.099302+0000","last_undegraded":"2023-09-23T08:56:22.099302+0000","last_fullsized":"2023-09-23T08:56:22.099302+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T11:57:28.537929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"88'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.092255+0000","last_change":"2023-09-23T08:54:53.114564+0000","last_active":"2023-09-23T08:56:22.092255+0000","last_peered":"2023-09-23T08:56:22.092255+0000","last_clean":"2023-09-23T08:56:22.092255+0000","last_became_active":"2023-09-23T08:54:53.113937+0000","last_became_peered":"2023-09-23T08:54:53.113937+0000","last_unstale":"2023-09-23T08:56:22.092255+0000","last_undegraded":"2023-09-23T08:56:22.092255+0000","last_fullsized":"2023-09-23T08:56:22.092255+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:07:59.125776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"88'10","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.086442+0000","last_change":"2023-09-23T08:54:53.108544+0000","last_active":"2023-09-23T08:56:22.086442+0000","last_peered":"2023-09-23T08:56:22.086442+0000","last_clean":"2023-09-23T08:56:22.086442+0000","last_became_active":"2023-09-23T08:54:53.108226+0000","last_became_peered":"2023-09-23T08:54:53.108226+0000","last_unstale":"2023-09-23T08:56:22.086442+0000","last_undegraded":"2023-09-23T08:56:22.086442+0000","last_fullsized":"2023-09-23T08:56:22.086442+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T20:44:46.654608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"88'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.082551+0000","last_change":"2023-09-23T08:54:53.106250+0000","last_active":"2023-09-23T08:56:22.082551+0000","last_peered":"2023-09-23T08:56:22.082551+0000","last_clean":"2023-09-23T08:56:22.082551+0000","last_became_active":"2023-09-23T08:54:53.105912+0000","last_became_peered":"2023-09-23T08:54:53.105912+0000","last_unstale":"2023-09-23T08:56:22.082551+0000","last_undegraded":"2023-09-23T08:56:22.082551+0000","last_fullsized":"2023-09-23T08:56:22.082551+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T09:50:26.711654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"88'7","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.091889+0000","last_change":"2023-09-23T08:55:23.441265+0000","last_active":"2023-09-23T08:56:22.091889+0000","last_peered":"2023-09-23T08:56:22.091889+0000","last_clean":"2023-09-23T08:56:22.091889+0000","last_became_active":"2023-09-23T08:55:23.440800+0000","last_became_peered":"2023-09-23T08:55:23.440800+0000","last_unstale":"2023-09-23T08:56:22.091889+0000","last_undegraded":"2023-09-23T08:56:22.091889+0000","last_fullsized":"2023-09-23T08:56:22.091889+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T10:27:59.968816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"88'9","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.100645+0000","last_change":"2023-09-23T08:54:53.098507+0000","last_active":"2023-09-23T08:56:22.100645+0000","last_peered":"2023-09-23T08:56:22.100645+0000","last_clean":"2023-09-23T08:56:22.100645+0000","last_became_active":"2023-09-23T08:54:53.098153+0000","last_became_peered":"2023-09-23T08:54:53.098153+0000","last_unstale":"2023-09-23T08:56:22.100645+0000","last_undegraded":"2023-09-23T08:56:22.100645+0000","last_fullsized":"2023-09-23T08:56:22.100645+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T09:39:06.960825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"88'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.098807+0000","last_change":"2023-09-23T08:54:53.110427+0000","last_active":"2023-09-23T08:56:22.098807+0000","last_peered":"2023-09-23T08:56:22.098807+0000","last_clean":"2023-09-23T08:56:22.098807+0000","last_became_active":"2023-09-23T08:54:53.109868+0000","last_became_peered":"2023-09-23T08:54:53.109868+0000","last_unstale":"2023-09-23T08:56:22.098807+0000","last_undegraded":"2023-09-23T08:56:22.098807+0000","last_fullsized":"2023-09-23T08:56:22.098807+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:58:18.067768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"88'10","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.095604+0000","last_change":"2023-09-23T08:54:53.107613+0000","last_active":"2023-09-23T08:56:22.095604+0000","last_peered":"2023-09-23T08:56:22.095604+0000","last_clean":"2023-09-23T08:56:22.095604+0000","last_became_active":"2023-09-23T08:54:53.107230+0000","last_became_peered":"2023-09-23T08:54:53.107230+0000","last_unstale":"2023-09-23T08:56:22.095604+0000","last_undegraded":"2023-09-23T08:56:22.095604+0000","last_fullsized":"2023-09-23T08:56:22.095604+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:36:14.702321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"88'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.094185+0000","last_change":"2023-09-23T08:54:53.102530+0000","last_active":"2023-09-23T08:56:22.094185+0000","last_peered":"2023-09-23T08:56:22.094185+0000","last_clean":"2023-09-23T08:56:22.094185+0000","last_became_active":"2023-09-23T08:54:53.102004+0000","last_became_peered":"2023-09-23T08:54:53.102004+0000","last_unstale":"2023-09-23T08:56:22.094185+0000","last_undegraded":"2023-09-23T08:56:22.094185+0000","last_fullsized":"2023-09-23T08:56:22.094185+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:18:54.809976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"88'14","reported_seq":150,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:36.557416+0000","last_change":"2023-09-23T08:55:23.449398+0000","last_active":"2023-09-23T08:56:36.557416+0000","last_peered":"2023-09-23T08:56:36.557416+0000","last_clean":"2023-09-23T08:56:36.557416+0000","last_became_active":"2023-09-23T08:55:23.434193+0000","last_became_peered":"2023-09-23T08:55:23.434193+0000","last_unstale":"2023-09-23T08:56:36.557416+0000","last_undegraded":"2023-09-23T08:56:36.557416+0000","last_fullsized":"2023-09-23T08:56:36.557416+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:21:58.024636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":92,"num_read_kb":92,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"88'5","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.088274+0000","last_change":"2023-09-23T08:54:53.109844+0000","last_active":"2023-09-23T08:56:22.088274+0000","last_peered":"2023-09-23T08:56:22.088274+0000","last_clean":"2023-09-23T08:56:22.088274+0000","last_became_active":"2023-09-23T08:54:53.109456+0000","last_became_peered":"2023-09-23T08:54:53.109456+0000","last_unstale":"2023-09-23T08:56:22.088274+0000","last_undegraded":"2023-09-23T08:56:22.088274+0000","last_fullsized":"2023-09-23T08:56:22.088274+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:35:18.729698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.437928+0000","last_change":"2023-09-23T08:54:52.090023+0000","last_active":"2023-09-23T08:55:23.437928+0000","last_peered":"2023-09-23T08:55:23.437928+0000","last_clean":"2023-09-23T08:55:23.437928+0000","last_became_active":"2023-09-23T08:54:52.089587+0000","last_became_peered":"2023-09-23T08:54:52.089587+0000","last_unstale":"2023-09-23T08:55:23.437928+0000","last_undegraded":"2023-09-23T08:55:23.437928+0000","last_fullsized":"2023-09-23T08:55:23.437928+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T09:08:05.801189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"88'6","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.090783+0000","last_change":"2023-09-23T08:54:53.098662+0000","last_active":"2023-09-23T08:56:22.090783+0000","last_peered":"2023-09-23T08:56:22.090783+0000","last_clean":"2023-09-23T08:56:22.090783+0000","last_became_active":"2023-09-23T08:54:53.098288+0000","last_became_peered":"2023-09-23T08:54:53.098288+0000","last_unstale":"2023-09-23T08:56:22.090783+0000","last_undegraded":"2023-09-23T08:56:22.090783+0000","last_fullsized":"2023-09-23T08:56:22.090783+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:21:44.163895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"86'12","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.432199+0000","last_change":"2023-09-23T08:54:52.083109+0000","last_active":"2023-09-23T08:55:23.432199+0000","last_peered":"2023-09-23T08:55:23.432199+0000","last_clean":"2023-09-23T08:55:23.432199+0000","last_became_active":"2023-09-23T08:54:52.082479+0000","last_became_peered":"2023-09-23T08:54:52.082479+0000","last_unstale":"2023-09-23T08:55:23.432199+0000","last_undegraded":"2023-09-23T08:55:23.432199+0000","last_fullsized":"2023-09-23T08:55:23.432199+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T14:19:13.234767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"88'9","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.100922+0000","last_change":"2023-09-23T08:54:53.105112+0000","last_active":"2023-09-23T08:56:22.100922+0000","last_peered":"2023-09-23T08:56:22.100922+0000","last_clean":"2023-09-23T08:56:22.100922+0000","last_became_active":"2023-09-23T08:54:53.104639+0000","last_became_peered":"2023-09-23T08:54:53.104639+0000","last_unstale":"2023-09-23T08:56:22.100922+0000","last_undegraded":"2023-09-23T08:56:22.100922+0000","last_fullsized":"2023-09-23T08:56:22.100922+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T09:13:19.421762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"86'5","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.431617+0000","last_change":"2023-09-23T08:54:52.082798+0000","last_active":"2023-09-23T08:55:23.431617+0000","last_peered":"2023-09-23T08:55:23.431617+0000","last_clean":"2023-09-23T08:55:23.431617+0000","last_became_active":"2023-09-23T08:54:52.082455+0000","last_became_peered":"2023-09-23T08:54:52.082455+0000","last_unstale":"2023-09-23T08:55:23.431617+0000","last_undegraded":"2023-09-23T08:55:23.431617+0000","last_fullsized":"2023-09-23T08:55:23.431617+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T18:53:37.376211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"88'15","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.098805+0000","last_change":"2023-09-23T08:54:53.105012+0000","last_active":"2023-09-23T08:56:22.098805+0000","last_peered":"2023-09-23T08:56:22.098805+0000","last_clean":"2023-09-23T08:56:22.098805+0000","last_became_active":"2023-09-23T08:54:53.104670+0000","last_became_peered":"2023-09-23T08:54:53.104670+0000","last_unstale":"2023-09-23T08:56:22.098805+0000","last_undegraded":"2023-09-23T08:56:22.098805+0000","last_fullsized":"2023-09-23T08:56:22.098805+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T13:57:42.013692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"88'8","reported_seq":129,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:37.661645+0000","last_change":"2023-09-23T08:54:52.085771+0000","last_active":"2023-09-23T08:56:37.661645+0000","last_peered":"2023-09-23T08:56:37.661645+0000","last_clean":"2023-09-23T08:56:37.661645+0000","last_became_active":"2023-09-23T08:54:52.085424+0000","last_became_peered":"2023-09-23T08:54:52.085424+0000","last_unstale":"2023-09-23T08:56:37.661645+0000","last_undegraded":"2023-09-23T08:56:37.661645+0000","last_fullsized":"2023-09-23T08:56:37.661645+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T11:26:36.068148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1636,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":4,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"88'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.080931+0000","last_change":"2023-09-23T08:54:53.109830+0000","last_active":"2023-09-23T08:56:22.080931+0000","last_peered":"2023-09-23T08:56:22.080931+0000","last_clean":"2023-09-23T08:56:22.080931+0000","last_became_active":"2023-09-23T08:54:53.109532+0000","last_became_peered":"2023-09-23T08:54:53.109532+0000","last_unstale":"2023-09-23T08:56:22.080931+0000","last_undegraded":"2023-09-23T08:56:22.080931+0000","last_fullsized":"2023-09-23T08:56:22.080931+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:14:37.986156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"86'7","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.428457+0000","last_change":"2023-09-23T08:54:52.075998+0000","last_active":"2023-09-23T08:55:23.428457+0000","last_peered":"2023-09-23T08:55:23.428457+0000","last_clean":"2023-09-23T08:55:23.428457+0000","last_became_active":"2023-09-23T08:54:52.075701+0000","last_became_peered":"2023-09-23T08:54:52.075701+0000","last_unstale":"2023-09-23T08:55:23.428457+0000","last_undegraded":"2023-09-23T08:55:23.428457+0000","last_fullsized":"2023-09-23T08:55:23.428457+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:35:20.680135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"88'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.094881+0000","last_change":"2023-09-23T08:54:53.106654+0000","last_active":"2023-09-23T08:56:22.094881+0000","last_peered":"2023-09-23T08:56:22.094881+0000","last_clean":"2023-09-23T08:56:22.094881+0000","last_became_active":"2023-09-23T08:54:53.106348+0000","last_became_peered":"2023-09-23T08:54:53.106348+0000","last_unstale":"2023-09-23T08:56:22.094881+0000","last_undegraded":"2023-09-23T08:56:22.094881+0000","last_fullsized":"2023-09-23T08:56:22.094881+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:48:44.274107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"86'3","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.431350+0000","last_change":"2023-09-23T08:54:52.073666+0000","last_active":"2023-09-23T08:55:23.431350+0000","last_peered":"2023-09-23T08:55:23.431350+0000","last_clean":"2023-09-23T08:55:23.431350+0000","last_became_active":"2023-09-23T08:54:52.073248+0000","last_became_peered":"2023-09-23T08:54:52.073248+0000","last_unstale":"2023-09-23T08:55:23.431350+0000","last_undegraded":"2023-09-23T08:55:23.431350+0000","last_fullsized":"2023-09-23T08:55:23.431350+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T13:43:51.125737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"88'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.094756+0000","last_change":"2023-09-23T08:54:53.109621+0000","last_active":"2023-09-23T08:56:22.094756+0000","last_peered":"2023-09-23T08:56:22.094756+0000","last_clean":"2023-09-23T08:56:22.094756+0000","last_became_active":"2023-09-23T08:54:53.109304+0000","last_became_peered":"2023-09-23T08:54:53.109304+0000","last_unstale":"2023-09-23T08:56:22.094756+0000","last_undegraded":"2023-09-23T08:56:22.094756+0000","last_fullsized":"2023-09-23T08:56:22.094756+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:23:57.973639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"86'3","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.431509+0000","last_change":"2023-09-23T08:54:52.081580+0000","last_active":"2023-09-23T08:55:23.431509+0000","last_peered":"2023-09-23T08:55:23.431509+0000","last_clean":"2023-09-23T08:55:23.431509+0000","last_became_active":"2023-09-23T08:54:52.081151+0000","last_became_peered":"2023-09-23T08:54:52.081151+0000","last_unstale":"2023-09-23T08:55:23.431509+0000","last_undegraded":"2023-09-23T08:55:23.431509+0000","last_fullsized":"2023-09-23T08:55:23.431509+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T14:53:36.622852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"88'11","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.091347+0000","last_change":"2023-09-23T08:54:53.108334+0000","last_active":"2023-09-23T08:56:22.091347+0000","last_peered":"2023-09-23T08:56:22.091347+0000","last_clean":"2023-09-23T08:56:22.091347+0000","last_became_active":"2023-09-23T08:54:53.108038+0000","last_became_peered":"2023-09-23T08:54:53.108038+0000","last_unstale":"2023-09-23T08:56:22.091347+0000","last_undegraded":"2023-09-23T08:56:22.091347+0000","last_fullsized":"2023-09-23T08:56:22.091347+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:22:21.278138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"88'6","reported_seq":214,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:34.654350+0000","last_change":"2023-09-23T08:54:52.084025+0000","last_active":"2023-09-23T08:56:34.654350+0000","last_peered":"2023-09-23T08:56:34.654350+0000","last_clean":"2023-09-23T08:56:34.654350+0000","last_became_active":"2023-09-23T08:54:52.083625+0000","last_became_peered":"2023-09-23T08:54:52.083625+0000","last_unstale":"2023-09-23T08:56:34.654350+0000","last_undegraded":"2023-09-23T08:56:34.654350+0000","last_fullsized":"2023-09-23T08:56:34.654350+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T13:02:41.009120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":190,"num_read_kb":190,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"88'10","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.096159+0000","last_change":"2023-09-23T08:54:53.106602+0000","last_active":"2023-09-23T08:56:22.096159+0000","last_peered":"2023-09-23T08:56:22.096159+0000","last_clean":"2023-09-23T08:56:22.096159+0000","last_became_active":"2023-09-23T08:54:53.105501+0000","last_became_peered":"2023-09-23T08:54:53.105501+0000","last_unstale":"2023-09-23T08:56:22.096159+0000","last_undegraded":"2023-09-23T08:56:22.096159+0000","last_fullsized":"2023-09-23T08:56:22.096159+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T10:15:37.314083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"86'4","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.431239+0000","last_change":"2023-09-23T08:54:52.079197+0000","last_active":"2023-09-23T08:55:23.431239+0000","last_peered":"2023-09-23T08:55:23.431239+0000","last_clean":"2023-09-23T08:55:23.431239+0000","last_became_active":"2023-09-23T08:54:52.078748+0000","last_became_peered":"2023-09-23T08:54:52.078748+0000","last_unstale":"2023-09-23T08:55:23.431239+0000","last_undegraded":"2023-09-23T08:55:23.431239+0000","last_fullsized":"2023-09-23T08:55:23.431239+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T18:15:16.139104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"88'9","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.089627+0000","last_change":"2023-09-23T08:54:53.105831+0000","last_active":"2023-09-23T08:56:22.089627+0000","last_peered":"2023-09-23T08:56:22.089627+0000","last_clean":"2023-09-23T08:56:22.089627+0000","last_became_active":"2023-09-23T08:54:53.105511+0000","last_became_peered":"2023-09-23T08:54:53.105511+0000","last_unstale":"2023-09-23T08:56:22.089627+0000","last_undegraded":"2023-09-23T08:56:22.089627+0000","last_fullsized":"2023-09-23T08:56:22.089627+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T10:06:14.045381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"86'5","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.432616+0000","last_change":"2023-09-23T08:54:52.089312+0000","last_active":"2023-09-23T08:55:23.432616+0000","last_peered":"2023-09-23T08:55:23.432616+0000","last_clean":"2023-09-23T08:55:23.432616+0000","last_became_active":"2023-09-23T08:54:52.088762+0000","last_became_peered":"2023-09-23T08:54:52.088762+0000","last_unstale":"2023-09-23T08:55:23.432616+0000","last_undegraded":"2023-09-23T08:55:23.432616+0000","last_fullsized":"2023-09-23T08:55:23.432616+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:31:59.043067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"88'11","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.100051+0000","last_change":"2023-09-23T08:54:53.106972+0000","last_active":"2023-09-23T08:56:22.100051+0000","last_peered":"2023-09-23T08:56:22.100051+0000","last_clean":"2023-09-23T08:56:22.100051+0000","last_became_active":"2023-09-23T08:54:53.105175+0000","last_became_peered":"2023-09-23T08:54:53.105175+0000","last_unstale":"2023-09-23T08:56:22.100051+0000","last_undegraded":"2023-09-23T08:56:22.100051+0000","last_fullsized":"2023-09-23T08:56:22.100051+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T20:07:17.130820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"88'34","reported_seq":250,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:34.675103+0000","last_change":"2023-09-23T08:54:52.077758+0000","last_active":"2023-09-23T08:56:34.675103+0000","last_peered":"2023-09-23T08:56:34.675103+0000","last_clean":"2023-09-23T08:56:34.675103+0000","last_became_active":"2023-09-23T08:54:52.077461+0000","last_became_peered":"2023-09-23T08:54:52.077461+0000","last_unstale":"2023-09-23T08:56:34.675103+0000","last_undegraded":"2023-09-23T08:56:34.675103+0000","last_fullsized":"2023-09-23T08:56:34.675103+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T13:22:15.302812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58208,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":198,"num_read_kb":155,"num_write":36,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"88'6","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.085121+0000","last_change":"2023-09-23T08:54:53.102967+0000","last_active":"2023-09-23T08:56:22.085121+0000","last_peered":"2023-09-23T08:56:22.085121+0000","last_clean":"2023-09-23T08:56:22.085121+0000","last_became_active":"2023-09-23T08:54:53.102608+0000","last_became_peered":"2023-09-23T08:54:53.102608+0000","last_unstale":"2023-09-23T08:56:22.085121+0000","last_undegraded":"2023-09-23T08:56:22.085121+0000","last_fullsized":"2023-09-23T08:56:22.085121+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:15:18.457676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"86'9","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.436872+0000","last_change":"2023-09-23T08:54:52.083885+0000","last_active":"2023-09-23T08:55:23.436872+0000","last_peered":"2023-09-23T08:55:23.436872+0000","last_clean":"2023-09-23T08:55:23.436872+0000","last_became_active":"2023-09-23T08:54:52.083530+0000","last_became_peered":"2023-09-23T08:54:52.083530+0000","last_unstale":"2023-09-23T08:55:23.436872+0000","last_undegraded":"2023-09-23T08:55:23.436872+0000","last_fullsized":"2023-09-23T08:55:23.436872+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:13:15.173145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"88'9","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.093090+0000","last_change":"2023-09-23T08:54:53.102429+0000","last_active":"2023-09-23T08:56:22.093090+0000","last_peered":"2023-09-23T08:56:22.093090+0000","last_clean":"2023-09-23T08:56:22.093090+0000","last_became_active":"2023-09-23T08:54:53.102139+0000","last_became_peered":"2023-09-23T08:54:53.102139+0000","last_unstale":"2023-09-23T08:56:22.093090+0000","last_undegraded":"2023-09-23T08:56:22.093090+0000","last_fullsized":"2023-09-23T08:56:22.093090+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T14:20:29.728805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"86'5","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.431753+0000","last_change":"2023-09-23T08:54:52.083380+0000","last_active":"2023-09-23T08:55:23.431753+0000","last_peered":"2023-09-23T08:55:23.431753+0000","last_clean":"2023-09-23T08:55:23.431753+0000","last_became_active":"2023-09-23T08:54:52.083094+0000","last_became_peered":"2023-09-23T08:54:52.083094+0000","last_unstale":"2023-09-23T08:55:23.431753+0000","last_undegraded":"2023-09-23T08:55:23.431753+0000","last_fullsized":"2023-09-23T08:55:23.431753+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:31:04.004340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"88'15","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.097750+0000","last_change":"2023-09-23T08:54:53.107671+0000","last_active":"2023-09-23T08:56:22.097750+0000","last_peered":"2023-09-23T08:56:22.097750+0000","last_clean":"2023-09-23T08:56:22.097750+0000","last_became_active":"2023-09-23T08:54:53.107372+0000","last_became_peered":"2023-09-23T08:54:53.107372+0000","last_unstale":"2023-09-23T08:56:22.097750+0000","last_undegraded":"2023-09-23T08:56:22.097750+0000","last_fullsized":"2023-09-23T08:56:22.097750+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T18:52:05.503710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"88'8","reported_seq":127,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:35.641915+0000","last_change":"2023-09-23T08:54:52.080556+0000","last_active":"2023-09-23T08:56:35.641915+0000","last_peered":"2023-09-23T08:56:35.641915+0000","last_clean":"2023-09-23T08:56:35.641915+0000","last_became_active":"2023-09-23T08:54:52.080220+0000","last_became_peered":"2023-09-23T08:54:52.080220+0000","last_unstale":"2023-09-23T08:56:35.641915+0000","last_undegraded":"2023-09-23T08:56:35.641915+0000","last_fullsized":"2023-09-23T08:56:35.641915+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:05:06.321996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1602,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":102,"num_read_kb":5,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"88'6","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.083467+0000","last_change":"2023-09-23T08:54:53.107044+0000","last_active":"2023-09-23T08:56:22.083467+0000","last_peered":"2023-09-23T08:56:22.083467+0000","last_clean":"2023-09-23T08:56:22.083467+0000","last_became_active":"2023-09-23T08:54:53.106715+0000","last_became_peered":"2023-09-23T08:54:53.106715+0000","last_unstale":"2023-09-23T08:56:22.083467+0000","last_undegraded":"2023-09-23T08:56:22.083467+0000","last_fullsized":"2023-09-23T08:56:22.083467+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T09:20:08.571706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"86'17","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.432200+0000","last_change":"2023-09-23T08:54:52.078052+0000","last_active":"2023-09-23T08:55:23.432200+0000","last_peered":"2023-09-23T08:55:23.432200+0000","last_clean":"2023-09-23T08:55:23.432200+0000","last_became_active":"2023-09-23T08:54:52.077678+0000","last_became_peered":"2023-09-23T08:54:52.077678+0000","last_unstale":"2023-09-23T08:55:23.432200+0000","last_undegraded":"2023-09-23T08:55:23.432200+0000","last_fullsized":"2023-09-23T08:55:23.432200+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T18:34:12.590233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"88'6","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.098976+0000","last_change":"2023-09-23T08:54:53.107673+0000","last_active":"2023-09-23T08:56:22.098976+0000","last_peered":"2023-09-23T08:56:22.098976+0000","last_clean":"2023-09-23T08:56:22.098976+0000","last_became_active":"2023-09-23T08:54:53.107373+0000","last_became_peered":"2023-09-23T08:54:53.107373+0000","last_unstale":"2023-09-23T08:56:22.098976+0000","last_undegraded":"2023-09-23T08:56:22.098976+0000","last_fullsized":"2023-09-23T08:56:22.098976+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T18:11:06.759793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"88'3","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.431740+0000","last_change":"2023-09-23T08:54:52.085460+0000","last_active":"2023-09-23T08:55:23.431740+0000","last_peered":"2023-09-23T08:55:23.431740+0000","last_clean":"2023-09-23T08:55:23.431740+0000","last_became_active":"2023-09-23T08:54:52.085186+0000","last_became_peered":"2023-09-23T08:54:52.085186+0000","last_unstale":"2023-09-23T08:55:23.431740+0000","last_undegraded":"2023-09-23T08:55:23.431740+0000","last_fullsized":"2023-09-23T08:55:23.431740+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T10:44:18.969355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"88'5","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.096477+0000","last_change":"2023-09-23T08:54:53.103630+0000","last_active":"2023-09-23T08:56:22.096477+0000","last_peered":"2023-09-23T08:56:22.096477+0000","last_clean":"2023-09-23T08:56:22.096477+0000","last_became_active":"2023-09-23T08:54:53.103270+0000","last_became_peered":"2023-09-23T08:54:53.103270+0000","last_unstale":"2023-09-23T08:56:22.096477+0000","last_undegraded":"2023-09-23T08:56:22.096477+0000","last_fullsized":"2023-09-23T08:56:22.096477+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T13:21:04.753974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"86'1","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.427814+0000","last_change":"2023-09-23T08:54:52.089279+0000","last_active":"2023-09-23T08:55:23.427814+0000","last_peered":"2023-09-23T08:55:23.427814+0000","last_clean":"2023-09-23T08:55:23.427814+0000","last_became_active":"2023-09-23T08:54:52.088861+0000","last_became_peered":"2023-09-23T08:54:52.088861+0000","last_unstale":"2023-09-23T08:55:23.427814+0000","last_undegraded":"2023-09-23T08:55:23.427814+0000","last_fullsized":"2023-09-23T08:55:23.427814+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T12:49:36.034399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"88'5","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.091248+0000","last_change":"2023-09-23T08:54:53.105653+0000","last_active":"2023-09-23T08:56:22.091248+0000","last_peered":"2023-09-23T08:56:22.091248+0000","last_clean":"2023-09-23T08:56:22.091248+0000","last_became_active":"2023-09-23T08:54:53.105309+0000","last_became_peered":"2023-09-23T08:54:53.105309+0000","last_unstale":"2023-09-23T08:56:22.091248+0000","last_undegraded":"2023-09-23T08:56:22.091248+0000","last_fullsized":"2023-09-23T08:56:22.091248+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T10:25:27.100946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"88'6","reported_seq":120,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:34.553871+0000","last_change":"2023-09-23T08:54:52.080521+0000","last_active":"2023-09-23T08:56:34.553871+0000","last_peered":"2023-09-23T08:56:34.553871+0000","last_clean":"2023-09-23T08:56:34.553871+0000","last_became_active":"2023-09-23T08:54:52.080164+0000","last_became_peered":"2023-09-23T08:54:52.080164+0000","last_unstale":"2023-09-23T08:56:34.553871+0000","last_undegraded":"2023-09-23T08:56:34.553871+0000","last_fullsized":"2023-09-23T08:56:34.553871+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T14:07:18.272863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1071,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"88'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.084429+0000","last_change":"2023-09-23T08:54:53.107516+0000","last_active":"2023-09-23T08:56:22.084429+0000","last_peered":"2023-09-23T08:56:22.084429+0000","last_clean":"2023-09-23T08:56:22.084429+0000","last_became_active":"2023-09-23T08:54:53.106785+0000","last_became_peered":"2023-09-23T08:54:53.106785+0000","last_unstale":"2023-09-23T08:56:22.084429+0000","last_undegraded":"2023-09-23T08:56:22.084429+0000","last_fullsized":"2023-09-23T08:56:22.084429+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T11:51:04.634599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"88'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.090187+0000","last_change":"2023-09-23T08:54:53.110406+0000","last_active":"2023-09-23T08:56:22.090187+0000","last_peered":"2023-09-23T08:56:22.090187+0000","last_clean":"2023-09-23T08:56:22.090187+0000","last_became_active":"2023-09-23T08:54:53.107758+0000","last_became_peered":"2023-09-23T08:54:53.107758+0000","last_unstale":"2023-09-23T08:56:22.090187+0000","last_undegraded":"2023-09-23T08:56:22.090187+0000","last_fullsized":"2023-09-23T08:56:22.090187+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T11:50:56.031628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"88'6","reported_seq":124,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:37.644087+0000","last_change":"2023-09-23T08:54:52.081384+0000","last_active":"2023-09-23T08:56:37.644087+0000","last_peered":"2023-09-23T08:56:37.644087+0000","last_clean":"2023-09-23T08:56:37.644087+0000","last_became_active":"2023-09-23T08:54:52.081082+0000","last_became_peered":"2023-09-23T08:54:52.081082+0000","last_unstale":"2023-09-23T08:56:37.644087+0000","last_undegraded":"2023-09-23T08:56:37.644087+0000","last_fullsized":"2023-09-23T08:56:37.644087+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:35:45.308145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"88'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.096426+0000","last_change":"2023-09-23T08:54:53.109011+0000","last_active":"2023-09-23T08:56:22.096426+0000","last_peered":"2023-09-23T08:56:22.096426+0000","last_clean":"2023-09-23T08:56:22.096426+0000","last_became_active":"2023-09-23T08:54:53.108520+0000","last_became_peered":"2023-09-23T08:54:53.108520+0000","last_unstale":"2023-09-23T08:56:22.096426+0000","last_undegraded":"2023-09-23T08:56:22.096426+0000","last_fullsized":"2023-09-23T08:56:22.096426+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:50:01.361084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"86'6","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.533656+0000","last_change":"2023-09-23T08:54:52.078525+0000","last_active":"2023-09-23T08:55:23.533656+0000","last_peered":"2023-09-23T08:55:23.533656+0000","last_clean":"2023-09-23T08:55:23.533656+0000","last_became_active":"2023-09-23T08:54:52.078177+0000","last_became_peered":"2023-09-23T08:54:52.078177+0000","last_unstale":"2023-09-23T08:55:23.533656+0000","last_undegraded":"2023-09-23T08:55:23.533656+0000","last_fullsized":"2023-09-23T08:55:23.533656+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:53:54.342881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":353,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.431236+0000","last_change":"2023-09-23T08:53:33.610965+0000","last_active":"2023-09-23T08:55:23.431236+0000","last_peered":"2023-09-23T08:55:23.431236+0000","last_clean":"2023-09-23T08:55:23.431236+0000","last_became_active":"2023-09-23T08:53:33.610529+0000","last_became_peered":"2023-09-23T08:53:33.610529+0000","last_unstale":"2023-09-23T08:55:23.431236+0000","last_undegraded":"2023-09-23T08:55:23.431236+0000","last_fullsized":"2023-09-23T08:55:23.431236+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:50:00.779071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:50:00.779071+0000","last_clean_scrub_stamp":"2023-09-23T08:50:00.779071+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:07:05.451303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"88'5","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.085480+0000","last_change":"2023-09-23T08:55:23.442747+0000","last_active":"2023-09-23T08:56:22.085480+0000","last_peered":"2023-09-23T08:56:22.085480+0000","last_clean":"2023-09-23T08:56:22.085480+0000","last_became_active":"2023-09-23T08:55:23.442328+0000","last_became_peered":"2023-09-23T08:55:23.442328+0000","last_unstale":"2023-09-23T08:56:22.085480+0000","last_undegraded":"2023-09-23T08:56:22.085480+0000","last_fullsized":"2023-09-23T08:56:22.085480+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T09:31:53.487979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"86'4","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.442345+0000","last_change":"2023-09-23T08:55:23.442345+0000","last_active":"2023-09-23T08:55:23.442345+0000","last_peered":"2023-09-23T08:55:23.442345+0000","last_clean":"2023-09-23T08:55:23.442345+0000","last_became_active":"2023-09-23T08:55:23.434799+0000","last_became_peered":"2023-09-23T08:55:23.434799+0000","last_unstale":"2023-09-23T08:55:23.442345+0000","last_undegraded":"2023-09-23T08:55:23.442345+0000","last_fullsized":"2023-09-23T08:55:23.442345+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T08:56:24.431145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"86'4","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.431996+0000","last_change":"2023-09-23T08:54:52.080482+0000","last_active":"2023-09-23T08:55:23.431996+0000","last_peered":"2023-09-23T08:55:23.431996+0000","last_clean":"2023-09-23T08:55:23.431996+0000","last_became_active":"2023-09-23T08:54:52.079756+0000","last_became_peered":"2023-09-23T08:54:52.079756+0000","last_unstale":"2023-09-23T08:55:23.431996+0000","last_undegraded":"2023-09-23T08:55:23.431996+0000","last_fullsized":"2023-09-23T08:55:23.431996+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:55:32.242149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"88'9","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.089453+0000","last_change":"2023-09-23T08:54:53.092828+0000","last_active":"2023-09-23T08:56:22.089453+0000","last_peered":"2023-09-23T08:56:22.089453+0000","last_clean":"2023-09-23T08:56:22.089453+0000","last_became_active":"2023-09-23T08:54:53.092486+0000","last_became_peered":"2023-09-23T08:54:53.092486+0000","last_unstale":"2023-09-23T08:56:22.089453+0000","last_undegraded":"2023-09-23T08:56:22.089453+0000","last_fullsized":"2023-09-23T08:56:22.089453+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T13:54:09.634679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"88'12","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:25.825380+0000","last_change":"2023-09-23T08:54:52.081801+0000","last_active":"2023-09-23T08:56:25.825380+0000","last_peered":"2023-09-23T08:56:25.825380+0000","last_clean":"2023-09-23T08:56:25.825380+0000","last_became_active":"2023-09-23T08:54:52.081449+0000","last_became_peered":"2023-09-23T08:54:52.081449+0000","last_unstale":"2023-09-23T08:56:25.825380+0000","last_undegraded":"2023-09-23T08:56:25.825380+0000","last_fullsized":"2023-09-23T08:56:25.825380+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T14:36:52.210295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"88'5","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.091904+0000","last_change":"2023-09-23T08:54:53.101037+0000","last_active":"2023-09-23T08:56:22.091904+0000","last_peered":"2023-09-23T08:56:22.091904+0000","last_clean":"2023-09-23T08:56:22.091904+0000","last_became_active":"2023-09-23T08:54:53.100673+0000","last_became_peered":"2023-09-23T08:54:53.100673+0000","last_unstale":"2023-09-23T08:56:22.091904+0000","last_undegraded":"2023-09-23T08:56:22.091904+0000","last_fullsized":"2023-09-23T08:56:22.091904+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:11:55.146162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"86'7","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.533765+0000","last_change":"2023-09-23T08:54:52.077785+0000","last_active":"2023-09-23T08:55:23.533765+0000","last_peered":"2023-09-23T08:55:23.533765+0000","last_clean":"2023-09-23T08:55:23.533765+0000","last_became_active":"2023-09-23T08:54:52.077306+0000","last_became_peered":"2023-09-23T08:54:52.077306+0000","last_unstale":"2023-09-23T08:55:23.533765+0000","last_undegraded":"2023-09-23T08:55:23.533765+0000","last_fullsized":"2023-09-23T08:55:23.533765+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T18:21:25.957376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"88'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.092590+0000","last_change":"2023-09-23T08:54:53.106534+0000","last_active":"2023-09-23T08:56:22.092590+0000","last_peered":"2023-09-23T08:56:22.092590+0000","last_clean":"2023-09-23T08:56:22.092590+0000","last_became_active":"2023-09-23T08:54:53.105928+0000","last_became_peered":"2023-09-23T08:54:53.105928+0000","last_unstale":"2023-09-23T08:56:22.092590+0000","last_undegraded":"2023-09-23T08:56:22.092590+0000","last_fullsized":"2023-09-23T08:56:22.092590+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:25:27.390043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.444909+0000","last_change":"2023-09-23T08:55:23.444909+0000","last_active":"2023-09-23T08:55:23.444909+0000","last_peered":"2023-09-23T08:55:23.444909+0000","last_clean":"2023-09-23T08:55:23.444909+0000","last_became_active":"2023-09-23T08:55:23.440885+0000","last_became_peered":"2023-09-23T08:55:23.440885+0000","last_unstale":"2023-09-23T08:55:23.444909+0000","last_undegraded":"2023-09-23T08:55:23.444909+0000","last_fullsized":"2023-09-23T08:55:23.444909+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T14:07:59.974769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"88'2","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.052548+0000","last_change":"2023-09-23T08:54:53.106050+0000","last_active":"2023-09-23T08:56:22.052548+0000","last_peered":"2023-09-23T08:56:22.052548+0000","last_clean":"2023-09-23T08:56:22.052548+0000","last_became_active":"2023-09-23T08:54:53.105729+0000","last_became_peered":"2023-09-23T08:54:53.105729+0000","last_unstale":"2023-09-23T08:56:22.052548+0000","last_undegraded":"2023-09-23T08:56:22.052548+0000","last_fullsized":"2023-09-23T08:56:22.052548+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:59:01.529109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"86'7","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.438306+0000","last_change":"2023-09-23T08:54:52.086019+0000","last_active":"2023-09-23T08:55:23.438306+0000","last_peered":"2023-09-23T08:55:23.438306+0000","last_clean":"2023-09-23T08:55:23.438306+0000","last_became_active":"2023-09-23T08:54:52.085688+0000","last_became_peered":"2023-09-23T08:54:52.085688+0000","last_unstale":"2023-09-23T08:55:23.438306+0000","last_undegraded":"2023-09-23T08:55:23.438306+0000","last_fullsized":"2023-09-23T08:55:23.438306+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T13:39:29.745763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"88'9","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.091491+0000","last_change":"2023-09-23T08:54:53.099533+0000","last_active":"2023-09-23T08:56:22.091491+0000","last_peered":"2023-09-23T08:56:22.091491+0000","last_clean":"2023-09-23T08:56:22.091491+0000","last_became_active":"2023-09-23T08:54:53.099192+0000","last_became_peered":"2023-09-23T08:54:53.099192+0000","last_unstale":"2023-09-23T08:56:22.091491+0000","last_undegraded":"2023-09-23T08:56:22.091491+0000","last_fullsized":"2023-09-23T08:56:22.091491+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:21:20.608655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"88'5","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:36.470170+0000","last_change":"2023-09-23T08:54:52.086258+0000","last_active":"2023-09-23T08:56:36.470170+0000","last_peered":"2023-09-23T08:56:36.470170+0000","last_clean":"2023-09-23T08:56:36.470170+0000","last_became_active":"2023-09-23T08:54:52.085935+0000","last_became_peered":"2023-09-23T08:54:52.085935+0000","last_unstale":"2023-09-23T08:56:36.470170+0000","last_undegraded":"2023-09-23T08:56:36.470170+0000","last_fullsized":"2023-09-23T08:56:36.470170+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:20:00.595412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"88'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.099984+0000","last_change":"2023-09-23T08:54:53.105176+0000","last_active":"2023-09-23T08:56:22.099984+0000","last_peered":"2023-09-23T08:56:22.099984+0000","last_clean":"2023-09-23T08:56:22.099984+0000","last_became_active":"2023-09-23T08:54:53.104794+0000","last_became_peered":"2023-09-23T08:54:53.104794+0000","last_unstale":"2023-09-23T08:56:22.099984+0000","last_undegraded":"2023-09-23T08:56:22.099984+0000","last_fullsized":"2023-09-23T08:56:22.099984+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:38:26.392477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.431709+0000","last_change":"2023-09-23T08:54:52.078596+0000","last_active":"2023-09-23T08:55:23.431709+0000","last_peered":"2023-09-23T08:55:23.431709+0000","last_clean":"2023-09-23T08:55:23.431709+0000","last_became_active":"2023-09-23T08:54:52.078310+0000","last_became_peered":"2023-09-23T08:54:52.078310+0000","last_unstale":"2023-09-23T08:55:23.431709+0000","last_undegraded":"2023-09-23T08:55:23.431709+0000","last_fullsized":"2023-09-23T08:55:23.431709+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T10:44:34.943157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"88'5","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.098797+0000","last_change":"2023-09-23T08:54:53.106368+0000","last_active":"2023-09-23T08:56:22.098797+0000","last_peered":"2023-09-23T08:56:22.098797+0000","last_clean":"2023-09-23T08:56:22.098797+0000","last_became_active":"2023-09-23T08:54:53.105977+0000","last_became_peered":"2023-09-23T08:54:53.105977+0000","last_unstale":"2023-09-23T08:56:22.098797+0000","last_undegraded":"2023-09-23T08:56:22.098797+0000","last_fullsized":"2023-09-23T08:56:22.098797+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T14:38:50.938221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"88'6","reported_seq":126,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:37.679550+0000","last_change":"2023-09-23T08:54:52.089221+0000","last_active":"2023-09-23T08:56:37.679550+0000","last_peered":"2023-09-23T08:56:37.679550+0000","last_clean":"2023-09-23T08:56:37.679550+0000","last_became_active":"2023-09-23T08:54:52.088824+0000","last_became_peered":"2023-09-23T08:54:52.088824+0000","last_unstale":"2023-09-23T08:56:37.679550+0000","last_undegraded":"2023-09-23T08:56:37.679550+0000","last_fullsized":"2023-09-23T08:56:37.679550+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T11:18:12.157604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1653,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":102,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"88'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.099408+0000","last_change":"2023-09-23T08:54:53.107600+0000","last_active":"2023-09-23T08:56:22.099408+0000","last_peered":"2023-09-23T08:56:22.099408+0000","last_clean":"2023-09-23T08:56:22.099408+0000","last_became_active":"2023-09-23T08:54:53.105637+0000","last_became_peered":"2023-09-23T08:54:53.105637+0000","last_unstale":"2023-09-23T08:56:22.099408+0000","last_undegraded":"2023-09-23T08:56:22.099408+0000","last_fullsized":"2023-09-23T08:56:22.099408+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T13:51:08.460345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"86'3","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.431985+0000","last_change":"2023-09-23T08:54:52.081912+0000","last_active":"2023-09-23T08:55:23.431985+0000","last_peered":"2023-09-23T08:55:23.431985+0000","last_clean":"2023-09-23T08:55:23.431985+0000","last_became_active":"2023-09-23T08:54:52.081668+0000","last_became_peered":"2023-09-23T08:54:52.081668+0000","last_unstale":"2023-09-23T08:55:23.431985+0000","last_undegraded":"2023-09-23T08:55:23.431985+0000","last_fullsized":"2023-09-23T08:55:23.431985+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:38:42.963347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"88'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.091654+0000","last_change":"2023-09-23T08:54:53.106975+0000","last_active":"2023-09-23T08:56:22.091654+0000","last_peered":"2023-09-23T08:56:22.091654+0000","last_clean":"2023-09-23T08:56:22.091654+0000","last_became_active":"2023-09-23T08:54:53.106537+0000","last_became_peered":"2023-09-23T08:54:53.106537+0000","last_unstale":"2023-09-23T08:56:22.091654+0000","last_undegraded":"2023-09-23T08:56:22.091654+0000","last_fullsized":"2023-09-23T08:56:22.091654+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T11:16:12.417441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"86'5","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.539010+0000","last_change":"2023-09-23T08:55:23.539010+0000","last_active":"2023-09-23T08:55:23.539010+0000","last_peered":"2023-09-23T08:55:23.539010+0000","last_clean":"2023-09-23T08:55:23.539010+0000","last_became_active":"2023-09-23T08:55:23.534858+0000","last_became_peered":"2023-09-23T08:55:23.534858+0000","last_unstale":"2023-09-23T08:55:23.539010+0000","last_undegraded":"2023-09-23T08:55:23.539010+0000","last_fullsized":"2023-09-23T08:55:23.539010+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T12:04:40.067871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"88'9","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.088734+0000","last_change":"2023-09-23T08:54:53.109625+0000","last_active":"2023-09-23T08:56:22.088734+0000","last_peered":"2023-09-23T08:56:22.088734+0000","last_clean":"2023-09-23T08:56:22.088734+0000","last_became_active":"2023-09-23T08:54:53.109323+0000","last_became_peered":"2023-09-23T08:54:53.109323+0000","last_unstale":"2023-09-23T08:56:22.088734+0000","last_undegraded":"2023-09-23T08:56:22.088734+0000","last_fullsized":"2023-09-23T08:56:22.088734+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T12:38:52.169862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"88'9","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.092147+0000","last_change":"2023-09-23T08:55:23.438659+0000","last_active":"2023-09-23T08:56:22.092147+0000","last_peered":"2023-09-23T08:56:22.092147+0000","last_clean":"2023-09-23T08:56:22.092147+0000","last_became_active":"2023-09-23T08:55:23.438227+0000","last_became_peered":"2023-09-23T08:55:23.438227+0000","last_unstale":"2023-09-23T08:56:22.092147+0000","last_undegraded":"2023-09-23T08:56:22.092147+0000","last_fullsized":"2023-09-23T08:56:22.092147+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:03:51.636352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"88'12","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.085926+0000","last_change":"2023-09-23T08:54:53.101001+0000","last_active":"2023-09-23T08:56:22.085926+0000","last_peered":"2023-09-23T08:56:22.085926+0000","last_clean":"2023-09-23T08:56:22.085926+0000","last_became_active":"2023-09-23T08:54:53.100315+0000","last_became_peered":"2023-09-23T08:54:53.100315+0000","last_unstale":"2023-09-23T08:56:22.085926+0000","last_undegraded":"2023-09-23T08:56:22.085926+0000","last_fullsized":"2023-09-23T08:56:22.085926+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T20:08:51.255938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"88'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.092225+0000","last_change":"2023-09-23T08:54:53.102855+0000","last_active":"2023-09-23T08:56:22.092225+0000","last_peered":"2023-09-23T08:56:22.092225+0000","last_clean":"2023-09-23T08:56:22.092225+0000","last_became_active":"2023-09-23T08:54:53.102495+0000","last_became_peered":"2023-09-23T08:54:53.102495+0000","last_unstale":"2023-09-23T08:56:22.092225+0000","last_undegraded":"2023-09-23T08:56:22.092225+0000","last_fullsized":"2023-09-23T08:56:22.092225+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T11:30:08.512122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"88'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.094014+0000","last_change":"2023-09-23T08:54:53.102063+0000","last_active":"2023-09-23T08:56:22.094014+0000","last_peered":"2023-09-23T08:56:22.094014+0000","last_clean":"2023-09-23T08:56:22.094014+0000","last_became_active":"2023-09-23T08:54:53.101734+0000","last_became_peered":"2023-09-23T08:54:53.101734+0000","last_unstale":"2023-09-23T08:56:22.094014+0000","last_undegraded":"2023-09-23T08:56:22.094014+0000","last_fullsized":"2023-09-23T08:56:22.094014+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T18:20:09.964230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"88'4","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.085117+0000","last_change":"2023-09-23T08:54:53.110291+0000","last_active":"2023-09-23T08:56:22.085117+0000","last_peered":"2023-09-23T08:56:22.085117+0000","last_clean":"2023-09-23T08:56:22.085117+0000","last_became_active":"2023-09-23T08:54:53.109962+0000","last_became_peered":"2023-09-23T08:54:53.109962+0000","last_unstale":"2023-09-23T08:56:22.085117+0000","last_undegraded":"2023-09-23T08:56:22.085117+0000","last_fullsized":"2023-09-23T08:56:22.085117+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T13:59:01.304290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"88'6","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.084223+0000","last_change":"2023-09-23T08:54:53.104278+0000","last_active":"2023-09-23T08:56:22.084223+0000","last_peered":"2023-09-23T08:56:22.084223+0000","last_clean":"2023-09-23T08:56:22.084223+0000","last_became_active":"2023-09-23T08:54:53.103765+0000","last_became_peered":"2023-09-23T08:54:53.103765+0000","last_unstale":"2023-09-23T08:56:22.084223+0000","last_undegraded":"2023-09-23T08:56:22.084223+0000","last_fullsized":"2023-09-23T08:56:22.084223+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:27:28.306515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"88'15","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.098180+0000","last_change":"2023-09-23T08:54:53.104861+0000","last_active":"2023-09-23T08:56:22.098180+0000","last_peered":"2023-09-23T08:56:22.098180+0000","last_clean":"2023-09-23T08:56:22.098180+0000","last_became_active":"2023-09-23T08:54:53.104554+0000","last_became_peered":"2023-09-23T08:54:53.104554+0000","last_unstale":"2023-09-23T08:56:22.098180+0000","last_undegraded":"2023-09-23T08:56:22.098180+0000","last_fullsized":"2023-09-23T08:56:22.098180+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:22:47.174867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"88'2","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.096180+0000","last_change":"2023-09-23T08:54:53.106859+0000","last_active":"2023-09-23T08:56:22.096180+0000","last_peered":"2023-09-23T08:56:22.096180+0000","last_clean":"2023-09-23T08:56:22.096180+0000","last_became_active":"2023-09-23T08:54:53.106494+0000","last_became_peered":"2023-09-23T08:54:53.106494+0000","last_unstale":"2023-09-23T08:56:22.096180+0000","last_undegraded":"2023-09-23T08:56:22.096180+0000","last_fullsized":"2023-09-23T08:56:22.096180+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T18:25:26.029504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"88'6","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.091618+0000","last_change":"2023-09-23T08:54:53.101591+0000","last_active":"2023-09-23T08:56:22.091618+0000","last_peered":"2023-09-23T08:56:22.091618+0000","last_clean":"2023-09-23T08:56:22.091618+0000","last_became_active":"2023-09-23T08:54:53.101237+0000","last_became_peered":"2023-09-23T08:54:53.101237+0000","last_unstale":"2023-09-23T08:56:22.091618+0000","last_undegraded":"2023-09-23T08:56:22.091618+0000","last_fullsized":"2023-09-23T08:56:22.091618+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T11:22:22.863330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"88'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.089724+0000","last_change":"2023-09-23T08:54:53.103373+0000","last_active":"2023-09-23T08:56:22.089724+0000","last_peered":"2023-09-23T08:56:22.089724+0000","last_clean":"2023-09-23T08:56:22.089724+0000","last_became_active":"2023-09-23T08:54:53.102948+0000","last_became_peered":"2023-09-23T08:54:53.102948+0000","last_unstale":"2023-09-23T08:56:22.089724+0000","last_undegraded":"2023-09-23T08:56:22.089724+0000","last_fullsized":"2023-09-23T08:56:22.089724+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:39:31.898539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"88'10","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.100654+0000","last_change":"2023-09-23T08:54:53.100488+0000","last_active":"2023-09-23T08:56:22.100654+0000","last_peered":"2023-09-23T08:56:22.100654+0000","last_clean":"2023-09-23T08:56:22.100654+0000","last_became_active":"2023-09-23T08:54:53.100182+0000","last_became_peered":"2023-09-23T08:54:53.100182+0000","last_unstale":"2023-09-23T08:56:22.100654+0000","last_undegraded":"2023-09-23T08:56:22.100654+0000","last_fullsized":"2023-09-23T08:56:22.100654+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:13:20.648791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"88'11","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.086910+0000","last_change":"2023-09-23T08:54:53.097571+0000","last_active":"2023-09-23T08:56:22.086910+0000","last_peered":"2023-09-23T08:56:22.086910+0000","last_clean":"2023-09-23T08:56:22.086910+0000","last_became_active":"2023-09-23T08:54:53.097278+0000","last_became_peered":"2023-09-23T08:54:53.097278+0000","last_unstale":"2023-09-23T08:56:22.086910+0000","last_undegraded":"2023-09-23T08:56:22.086910+0000","last_fullsized":"2023-09-23T08:56:22.086910+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T11:32:37.554404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"88'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.096985+0000","last_change":"2023-09-23T08:54:53.113543+0000","last_active":"2023-09-23T08:56:22.096985+0000","last_peered":"2023-09-23T08:56:22.096985+0000","last_clean":"2023-09-23T08:56:22.096985+0000","last_became_active":"2023-09-23T08:54:53.113287+0000","last_became_peered":"2023-09-23T08:54:53.113287+0000","last_unstale":"2023-09-23T08:56:22.096985+0000","last_undegraded":"2023-09-23T08:56:22.096985+0000","last_fullsized":"2023-09-23T08:56:22.096985+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:56:48.219279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":67624,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1003,"num_read_kb":571,"num_write":258,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":211512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":223,"ondisk_log_size":223,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892351012,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":958464,"data_stored":460369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:55:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.68899999999999995,"15min":0.68500000000000005},"min":{"1min":0.497,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.752,"15min":0.74399999999999999},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":0.77500000000000002}]},{"osd":1,"last update":"Sat Sep 23 08:55:59 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.72099999999999997,"15min":0.70699999999999996},"min":{"1min":0.54800000000000004,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0269999999999999,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.76500000000000001,"15min":0.75700000000000001},"min":{"1min":0.59399999999999997,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.95599999999999996,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.91500000000000004}]},{"osd":2,"last update":"Sat Sep 23 08:55:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64700000000000002,"15min":0.64800000000000002},"min":{"1min":0.35999999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.98799999999999999,"5min":1.141,"15min":1.141},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.621,"5min":0.65700000000000003,"15min":0.66300000000000003},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.91000000000000003,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.63100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":4,"last update":"Sat Sep 23 08:55:59 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.79300000000000004,"15min":0.78000000000000003},"min":{"1min":0.59499999999999997,"5min":0.379,"15min":0.379},"max":{"1min":1.105,"5min":1.179,"15min":1.179},"last":0.98199999999999998},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.86899999999999999,"15min":0.872},"min":{"1min":0.63300000000000001,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.008,"5min":1.673,"15min":1.673},"last":0.96899999999999997}]},{"osd":5,"last update":"Sat Sep 23 08:55:59 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.79700000000000004,"15min":0.80300000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.075,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.78100000000000003,"15min":0.77700000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.0309999999999999,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.88500000000000001}]},{"osd":6,"last update":"Sat Sep 23 08:55:59 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.89500000000000002,"15min":0.90600000000000003},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.2909999999999999,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.755},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.90600000000000003,"15min":0.90800000000000003},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.2350000000000001,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":1.1040000000000001}]},{"osd":7,"last update":"Sat Sep 23 08:55:59 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.91800000000000004,"15min":0.91200000000000003},"min":{"1min":0.67200000000000004,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.228,"5min":1.25,"15min":1.25},"last":1.0680000000000001},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.69899999999999995,"5min":0.625,"15min":0.625},"max":{"1min":1.1899999999999999,"5min":1.74,"15min":1.74},"last":1.0189999999999999}]},{"osd":8,"last update":"Sat Sep 23 08:55:55 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":1.1200000000000001},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":1.0329999999999999}]},{"osd":9,"last update":"Sat Sep 23 08:55:59 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":0.98799999999999999,"15min":0.98499999999999999},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.3169999999999999,"5min":1.365,"15min":1.365},"last":1.002},{"interface":"front","average":{"1min":1.0429999999999999,"5min":0.96699999999999997,"15min":0.95399999999999996},"min":{"1min":0.71799999999999997,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":1.1359999999999999}]},{"osd":10,"last update":"Sat Sep 23 08:55:59 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.052,"15min":1.052},"min":{"1min":0.73399999999999999,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.274,"5min":2.3410000000000002,"15min":2.3410000000000002},"last":1.0880000000000001},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.0149999999999999,"15min":1.0089999999999999},"min":{"1min":0.748,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.3340000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":1.1519999999999999}]}]},{"osd":10,"up_from":73,"seq":313532612649,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28636,"kb_used_data":1620,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716516,"statfs":{"total":95995035648,"available":95965712384,"internally_reserved":0,"allocated":1658880,"data_stored":1110143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:55:52 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.8380000000000001,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.853,"5min":1.853,"15min":1.853},"last":0.75}]},{"osd":1,"last update":"Sat Sep 23 08:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.55300000000000005,"15min":0.56299999999999994},"min":{"1min":0.36499999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.77900000000000003,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.442},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.61799999999999999,"15min":0.621},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.88600000000000001,"5min":1.417,"15min":1.417},"last":0.42399999999999999}]},{"osd":2,"last update":"Sat Sep 23 08:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.752,"15min":0.76300000000000001},"min":{"1min":0.52700000000000002,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.996,"5min":1.214,"15min":1.214},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.754,"15min":0.76000000000000001},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.97899999999999998,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.79100000000000004}]},{"osd":3,"last update":"Sat Sep 23 08:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.80300000000000005,"15min":0.82299999999999995},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.7210000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.754,"5min":0.78700000000000003,"15min":0.79300000000000004},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.8899999999999999,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":0.72699999999999998}]},{"osd":4,"last update":"Sat Sep 23 08:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.67600000000000005,"15min":0.68700000000000006},"min":{"1min":0.45800000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.81200000000000006,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.74399999999999999,"15min":0.76800000000000002},"min":{"1min":0.42899999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.80300000000000005,"5min":1.448,"15min":1.448},"last":0.47899999999999998}]},{"osd":5,"last update":"Sat Sep 23 08:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.82399999999999995,"15min":0.82999999999999996},"min":{"1min":0.54300000000000004,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.089,"5min":1.423,"15min":1.423},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.877,"15min":0.89700000000000002},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.109,"5min":1.333,"15min":1.333},"last":0.76900000000000002}]},{"osd":6,"last update":"Sat Sep 23 08:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.88200000000000001,"15min":0.90000000000000002},"min":{"1min":0.55800000000000005,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.738,"5min":1.738,"15min":1.738},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.91100000000000003,"15min":0.92500000000000004},"min":{"1min":0.60799999999999998,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.8160000000000001,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.61799999999999999}]},{"osd":7,"last update":"Sat Sep 23 08:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.52500000000000002}]},{"osd":8,"last update":"Sat Sep 23 08:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.90900000000000003,"15min":0.92100000000000004},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.133,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.95999999999999996,"15min":0.98899999999999999},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.073,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":0.80900000000000005}]},{"osd":9,"last update":"Sat Sep 23 08:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.97999999999999998,"15min":0.99299999999999999},"min":{"1min":0.71899999999999997,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.7729999999999999,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.996,"15min":1.022},"min":{"1min":0.65800000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.794,"5min":1.794,"15min":1.794},"last":0.68100000000000005}]},{"osd":11,"last update":"Sat Sep 23 08:56:02 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.86499999999999999,"15min":0.87},"min":{"1min":0.68500000000000005,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.038,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.79200000000000004,"5min":0.626,"15min":0.626},"max":{"1min":1.0549999999999999,"5min":1.135,"15min":1.135},"last":0.85899999999999999}]}]},{"osd":9,"up_from":68,"seq":292057776173,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":983040,"data_stored":459816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:56:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.54800000000000004,"15min":0.53300000000000003},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":4.9619999999999997,"5min":4.9619999999999997,"15min":4.9619999999999997},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.56799999999999995,"15min":0.57199999999999995},"min":{"1min":0.35699999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":2.5299999999999998,"5min":2.5299999999999998,"15min":2.5299999999999998},"last":0.35499999999999998}]},{"osd":1,"last update":"Sat Sep 23 08:56:07 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.78100000000000003,"15min":0.79700000000000004},"min":{"1min":0.51800000000000002,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":3.4319999999999999,"5min":3.4319999999999999,"15min":3.4319999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.71499999999999997,"15min":0.74299999999999999},"min":{"1min":0.46700000000000003,"5min":0.375,"15min":0.375},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.68000000000000005}]},{"osd":2,"last update":"Sat Sep 23 08:56:07 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.78100000000000003,"15min":0.79600000000000004},"min":{"1min":0.52900000000000003,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":3.399,"5min":3.399,"15min":3.399},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.71599999999999997,"15min":0.748},"min":{"1min":0.47599999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.65200000000000002}]},{"osd":3,"last update":"Sat Sep 23 08:56:07 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.63300000000000001,"15min":0.64100000000000001},"min":{"1min":0.36399999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":2.5009999999999999,"5min":2.5009999999999999,"15min":2.5009999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.69399999999999995,"15min":0.69999999999999996},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":3.6000000000000001,"5min":3.6000000000000001,"15min":3.6000000000000001},"last":0.47899999999999998}]},{"osd":4,"last update":"Sat Sep 23 08:56:07 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.81599999999999995,"15min":0.82799999999999996},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":2.7879999999999998,"5min":2.7879999999999998,"15min":2.7879999999999998},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.84399999999999997,"15min":0.85599999999999998},"min":{"1min":0.59999999999999998,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":3.5579999999999998,"5min":3.5579999999999998,"15min":3.5579999999999998},"last":0.69099999999999995}]},{"osd":5,"last update":"Sat Sep 23 08:56:07 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.79700000000000004,"15min":0.81799999999999995},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":2.3999999999999999,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.85899999999999999,"15min":0.88100000000000001},"min":{"1min":0.56299999999999994,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":3.359,"5min":3.359,"15min":3.359},"last":0.66800000000000004}]},{"osd":6,"last update":"Sat Sep 23 08:56:07 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.71599999999999997,"15min":0.72199999999999998},"min":{"1min":0.45200000000000001,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":3.5169999999999999,"5min":3.5169999999999999,"15min":3.5169999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.755,"5min":0.79900000000000004,"15min":0.81399999999999995},"min":{"1min":0.46200000000000002,"5min":0.44,"15min":0.44},"max":{"1min":2.3599999999999999,"5min":2.3599999999999999,"15min":2.3599999999999999},"last":0.61699999999999999}]},{"osd":7,"last update":"Sat Sep 23 08:56:07 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.1160000000000001,"15min":1.1970000000000001},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":3.4940000000000002,"5min":7.0759999999999996,"15min":7.0759999999999996},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.84499999999999997,"15min":0.876},"min":{"1min":0.56899999999999995,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.74199999999999999}]},{"osd":8,"last update":"Sat Sep 23 08:56:07 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.84499999999999997,"15min":0.88100000000000001},"min":{"1min":0.60199999999999998,"5min":0.501,"15min":0.501},"max":{"1min":1.1919999999999999,"5min":1.226,"15min":1.226},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.90000000000000002,"15min":0.92400000000000004},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":2.4319999999999999,"5min":2.4319999999999999,"15min":2.4319999999999999},"last":0.753}]},{"osd":10,"last update":"Sat Sep 23 08:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.70199999999999996,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.6299999999999999,"5min":3.4630000000000001,"15min":3.4630000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.89300000000000002,"15min":0.91500000000000004},"min":{"1min":0.69099999999999995,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.456,"5min":1.456,"15min":1.456},"last":0.71999999999999997}]}]},{"osd":8,"up_from":60,"seq":257698037810,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":970752,"data_stored":459522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.68700000000000006,"15min":0.68899999999999995},"min":{"1min":0.45100000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.67800000000000005,"15min":0.68999999999999995},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.58299999999999996}]},{"osd":1,"last update":"Sat Sep 23 08:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.82299999999999995,"15min":0.81399999999999995},"min":{"1min":0.54100000000000004,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.754,"15min":0.746},"min":{"1min":0.59599999999999997,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.61699999999999999}]},{"osd":2,"last update":"Sat Sep 23 08:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.61299999999999999,"15min":0.60699999999999998},"min":{"1min":0.38300000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.59899999999999998,"15min":0.58899999999999997},"min":{"1min":0.432,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.85399999999999998,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.83399999999999996}]},{"osd":3,"last update":"Sat Sep 23 08:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.747,"15min":0.78100000000000003},"min":{"1min":0.54500000000000004,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.96099999999999997,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.81899999999999995,"15min":0.82999999999999996},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.97399999999999998,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.77000000000000002}]},{"osd":4,"last update":"Sat Sep 23 08:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.80100000000000005,"15min":0.80400000000000005},"min":{"1min":0.56299999999999994,"5min":0.439,"15min":0.439},"max":{"1min":1.024,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.96199999999999997,"15min":1},"min":{"1min":0.627,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.181,"5min":3.7530000000000001,"15min":3.7530000000000001},"last":0.875}]},{"osd":5,"last update":"Sat Sep 23 08:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.70799999999999996,"15min":0.71399999999999997},"min":{"1min":0.51100000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.995,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.76000000000000001,"15min":0.77400000000000002},"min":{"1min":0.51000000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.0760000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.86299999999999999}]},{"osd":6,"last update":"Sat Sep 23 08:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.89900000000000002,"15min":0.90800000000000003},"min":{"1min":0.59399999999999997,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.871,"15min":0.878},"min":{"1min":0.66800000000000004,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":0.94199999999999995}]},{"osd":7,"last update":"Sat Sep 23 08:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.88400000000000001,"15min":0.88300000000000001},"min":{"1min":0.71599999999999997,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.1619999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":1.097},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.91300000000000003,"15min":0.92800000000000005},"min":{"1min":0.68600000000000005,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.258,"5min":1.679,"15min":1.679},"last":0.91400000000000003}]},{"osd":9,"last update":"Sat Sep 23 08:56:09 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.871,"15min":0.84499999999999997},"min":{"1min":0.69299999999999995,"5min":0.498,"15min":0.498},"max":{"1min":1.333,"5min":1.333,"15min":1.333},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.89400000000000002,"15min":0.88400000000000001},"min":{"1min":0.69599999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.349,"5min":1.349,"15min":1.349},"last":1.0189999999999999}]},{"osd":10,"last update":"Sat Sep 23 08:56:35 2023","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":0.90300000000000002,"15min":0.85299999999999998},"min":{"1min":0.72699999999999998,"5min":0.629,"15min":0.629},"max":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.95799999999999996},{"interface":"front","average":{"1min":1.0700000000000001,"5min":0.94899999999999995,"15min":0.90000000000000002},"min":{"1min":0.85399999999999998,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":1.002}]},{"osd":11,"last update":"Sat Sep 23 08:55:56 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":1.0609999999999999},{"interface":"front","average":{"1min":1.111,"5min":1.111,"15min":1.111},"min":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":1.044}]}]},{"osd":7,"up_from":52,"seq":223338299448,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28548,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716604,"statfs":{"total":95995035648,"available":95965802496,"internally_reserved":0,"allocated":1568768,"data_stored":1054234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:54:15 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.627,"15min":0.621},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.59799999999999998,"15min":0.58599999999999997},"min":{"1min":0.48399999999999999,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.53800000000000003}]},{"osd":1,"last update":"Sat Sep 23 08:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.51200000000000001,"15min":0.51000000000000001},"min":{"1min":0.34300000000000003,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.67300000000000004,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.53800000000000003,"15min":0.53600000000000003},"min":{"1min":0.38900000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.86299999999999999,"5min":0.999,"15min":0.999},"last":0.71499999999999997}]},{"osd":2,"last update":"Sat Sep 23 08:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.747,"15min":0.747},"min":{"1min":0.51700000000000002,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.998,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.745},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72899999999999998,"15min":0.73099999999999998},"min":{"1min":0.59699999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.86399999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.997}]},{"osd":3,"last update":"Sat Sep 23 08:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.66800000000000004,"15min":0.66300000000000003},"min":{"1min":0.48399999999999999,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.88500000000000001,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.71099999999999997,"15min":0.72499999999999998},"min":{"1min":0.501,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.80500000000000005}]},{"osd":4,"last update":"Sat Sep 23 08:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.68500000000000005,"15min":0.70699999999999996},"min":{"1min":0.47299999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.95599999999999996,"5min":1.04,"15min":1.04},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.65000000000000002,"15min":0.68600000000000005},"min":{"1min":0.42799999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.72699999999999998,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.54800000000000004}]},{"osd":5,"last update":"Sat Sep 23 08:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.80600000000000005,"15min":0.80800000000000005},"min":{"1min":0.63800000000000001,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.0169999999999999,"5min":1.089,"15min":1.089},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.79000000000000004,"15min":0.80600000000000005},"min":{"1min":0.54500000000000004,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.98299999999999998,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.92400000000000004}]},{"osd":6,"last update":"Sat Sep 23 08:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.81200000000000006,"15min":0.82599999999999996},"min":{"1min":0.55300000000000005,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0069999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.80000000000000004,"15min":0.82099999999999995},"min":{"1min":0.63100000000000001,"5min":0.502,"15min":0.502},"max":{"1min":1.0449999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.69399999999999995}]},{"osd":8,"last update":"Sat Sep 23 08:55:39 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.84199999999999997,"15min":0.81999999999999995},"min":{"1min":0.65800000000000003,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.88},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.84199999999999997,"15min":0.83799999999999997},"min":{"1min":0.64900000000000002,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.0580000000000001,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":1.0369999999999999}]},{"osd":9,"last update":"Sat Sep 23 08:56:05 2023","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":0.91100000000000003,"15min":0.872},"min":{"1min":0.67600000000000005,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":4.9400000000000004,"5min":4.9400000000000004,"15min":4.9400000000000004},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.84599999999999997,"15min":0.84899999999999998},"min":{"1min":0.61899999999999999,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.96499999999999997,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.78500000000000003}]},{"osd":10,"last update":"Sat Sep 23 08:55:36 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.874,"15min":0.88},"min":{"1min":0.60699999999999998,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.01,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":1.0640000000000001},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.89800000000000002,"15min":0.90600000000000003},"min":{"1min":0.67700000000000005,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":0.98799999999999999,"5min":1.117,"15min":1.117},"last":0.96899999999999997}]},{"osd":11,"last update":"Sat Sep 23 08:55:56 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":1.087},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.98499999999999999}]}]},{"osd":6,"up_from":47,"seq":201863462975,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":966656,"data_stored":460022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:55:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.46800000000000003,"15min":0.44},"min":{"1min":0.33300000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.49299999999999999,"15min":0.47099999999999997},"min":{"1min":0.33300000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.52600000000000002}]},{"osd":1,"last update":"Sat Sep 23 08:55:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.67500000000000004,"15min":0.63300000000000001},"min":{"1min":0.442,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.70899999999999996,"15min":0.66900000000000004},"min":{"1min":0.53400000000000003,"5min":0.498,"15min":0.498},"max":{"1min":1.637,"5min":1.637,"15min":1.637},"last":0.82199999999999995}]},{"osd":2,"last update":"Sat Sep 23 08:55:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68200000000000005,"15min":0.66400000000000003},"min":{"1min":0.496,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.71499999999999997,"15min":0.69299999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0760000000000001,"5min":1.143,"15min":1.143},"last":0.55000000000000004}]},{"osd":3,"last update":"Sat Sep 23 08:55:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.58999999999999997,"15min":0.57999999999999996},"min":{"1min":0.38300000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.624,"5min":0.61799999999999999,"15min":0.60199999999999998},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.433}]},{"osd":4,"last update":"Sat Sep 23 08:55:47 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.71899999999999997,"15min":0.71699999999999997},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.75800000000000001,"15min":0.73399999999999999},"min":{"1min":0.498,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.77200000000000002}]},{"osd":5,"last update":"Sat Sep 23 08:55:47 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.76400000000000001,"15min":0.72999999999999998},"min":{"1min":0.49199999999999999,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.76700000000000002,"15min":0.76100000000000001},"min":{"1min":0.56100000000000005,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.5820000000000001,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.626}]},{"osd":7,"last update":"Sat Sep 23 08:56:17 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.81399999999999995,"15min":0.76100000000000001},"min":{"1min":0.56799999999999995,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.85399999999999998,"15min":0.80200000000000005},"min":{"1min":0.58999999999999997,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":4.6070000000000002,"5min":4.6070000000000002,"15min":4.6070000000000002},"last":0.83899999999999997}]},{"osd":8,"last update":"Sat Sep 23 08:55:47 2023","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.90700000000000003,"15min":0.90400000000000003},"min":{"1min":0.58999999999999997,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":5.2350000000000003,"5min":5.2350000000000003,"15min":5.2350000000000003},"last":0.61899999999999999},{"interface":"front","average":{"1min":1.0129999999999999,"5min":0.90800000000000003,"15min":0.89300000000000002},"min":{"1min":0.58799999999999997,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":4.5880000000000001,"5min":4.5880000000000001,"15min":4.5880000000000001},"last":0.51300000000000001}]},{"osd":9,"last update":"Sat Sep 23 08:56:08 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.876,"15min":0.90900000000000003},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.7170000000000001,"5min":1.7170000000000001,"15min":1.7170000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.89200000000000002,"15min":0.91900000000000004},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.764,"5min":1.764,"15min":1.764},"last":0.60899999999999999}]},{"osd":10,"last update":"Sat Sep 23 08:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.93899999999999995,"15min":0.95699999999999996},"min":{"1min":0.70599999999999996,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.0669999999999999,"5min":1.669,"15min":1.669},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.92800000000000005,"15min":0.95999999999999996},"min":{"1min":0.64700000000000002,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.1699999999999999,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.753}]}]},{"osd":1,"up_from":13,"seq":55834574935,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1036288,"data_stored":523856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:55:45 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58699999999999997,"15min":0.55800000000000005},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.61299999999999999,"15min":0.58899999999999997},"min":{"1min":0.32300000000000001,"5min":0.314,"15min":0.314},"max":{"1min":1.0069999999999999,"5min":1.02,"15min":1.02},"last":0.76000000000000001}]},{"osd":2,"last update":"Sat Sep 23 08:56:13 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.74099999999999999,"15min":0.71099999999999997},"min":{"1min":0.47999999999999998,"5min":0.47299999999999998,"15min":0.45900000000000002},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.74399999999999999,"15min":0.70399999999999996},"min":{"1min":0.60799999999999998,"5min":0.45700000000000002,"15min":0.44800000000000001},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.86199999999999999}]},{"osd":3,"last update":"Sat Sep 23 08:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67600000000000005,"15min":0.65300000000000002},"min":{"1min":0.46200000000000002,"5min":0.436,"15min":0.436},"max":{"1min":0.98099999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66400000000000003,"15min":0.64200000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.88200000000000001,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.47299999999999998}]},{"osd":4,"last update":"Sat Sep 23 08:55:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.54600000000000004,"15min":0.49399999999999999},"min":{"1min":0.44600000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.57799999999999996,"15min":0.52600000000000002},"min":{"1min":0.46800000000000003,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.97099999999999997,"5min":1.022,"15min":1.022},"last":0.82899999999999996}]},{"osd":5,"last update":"Sat Sep 23 08:55:32 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.76500000000000001,"15min":0.73599999999999999},"min":{"1min":0.59399999999999997,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.873},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.73499999999999999,"15min":0.70999999999999996},"min":{"1min":0.57699999999999996,"5min":0.505,"15min":0.505},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.89400000000000002}]},{"osd":6,"last update":"Sat Sep 23 08:55:47 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.76900000000000002,"15min":0.74099999999999999},"min":{"1min":0.57799999999999996,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":3.7120000000000002,"5min":3.7120000000000002,"15min":3.7120000000000002},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.751,"15min":0.70999999999999996},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":3.7229999999999999,"5min":3.7229999999999999,"15min":3.7229999999999999},"last":0.78700000000000003}]},{"osd":7,"last update":"Sat Sep 23 08:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.71099999999999997,"15min":0.69899999999999995},"min":{"1min":0.5,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.80400000000000005,"15min":0.78200000000000003},"min":{"1min":0.622,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.93400000000000005}]},{"osd":8,"last update":"Sat Sep 23 08:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.79300000000000004,"15min":0.755},"min":{"1min":0.64500000000000002,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.2110000000000001,"5min":2.8010000000000002,"15min":2.8010000000000002},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.79800000000000004,"15min":0.77200000000000002},"min":{"1min":0.70099999999999996,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.117,"5min":1.165,"15min":1.165},"last":0.81299999999999994}]},{"osd":9,"last update":"Sat Sep 23 08:56:13 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.85899999999999999,"15min":0.83999999999999997},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.88800000000000001,"15min":0.86099999999999999},"min":{"1min":0.79400000000000004,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":1.0109999999999999}]},{"osd":10,"last update":"Sat Sep 23 08:55:32 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.82999999999999996,"15min":0.82399999999999995},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.042,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.86499999999999999,"15min":0.85899999999999999},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":1.1319999999999999}]},{"osd":11,"last update":"Sat Sep 23 08:55:52 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.997},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":1.216}]}]},{"osd":0,"up_from":8,"seq":34359738461,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":983040,"data_stored":461082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 23 08:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.626,"15min":0.59399999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39300000000000002},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.73599999999999999,"15min":0.64700000000000002},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.36799999999999999},"max":{"1min":0.86299999999999999,"5min":5.7450000000000001,"15min":5.7450000000000001},"last":0.68500000000000005}]},{"osd":2,"last update":"Sat Sep 23 08:56:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.65100000000000002,"15min":0.64500000000000002},"min":{"1min":0.49299999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.88700000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.64300000000000002,"15min":0.63900000000000001},"min":{"1min":0.40300000000000002,"5min":0.373,"15min":0.373},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":0.63600000000000001}]},{"osd":3,"last update":"Sat Sep 23 08:55:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.7070000000000001,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.52200000000000002}]},{"osd":4,"last update":"Sat Sep 23 08:55:58 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.71699999999999997,"15min":0.64700000000000002},"min":{"1min":0.52300000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.90500000000000003,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.72699999999999998,"15min":0.66600000000000004},"min":{"1min":0.49299999999999999,"5min":0.435,"15min":0.435},"max":{"1min":0.879,"5min":5.6710000000000003,"15min":5.6710000000000003},"last":0.66600000000000004}]},{"osd":5,"last update":"Sat Sep 23 08:56:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.70399999999999996,"15min":0.69199999999999995},"min":{"1min":0.52600000000000002,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.92400000000000004,"5min":0.996,"15min":0.996},"last":0.755},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.73199999999999998,"15min":0.70599999999999996},"min":{"1min":0.62,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.96599999999999997,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.71799999999999997}]},{"osd":6,"last update":"Sat Sep 23 08:55:58 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.71099999999999997,"15min":0.70099999999999996},"min":{"1min":0.55100000000000005,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.9239999999999999,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73599999999999999,"15min":0.73499999999999999},"min":{"1min":0.438,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.823,"5min":1.823,"15min":1.823},"last":0.70599999999999996}]},{"osd":7,"last update":"Sat Sep 23 08:54:14 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.77300000000000002,"15min":0.77900000000000003},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.0489999999999999,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.875,"5min":0.84599999999999997,"15min":0.84099999999999997},"min":{"1min":0.63500000000000001,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.81799999999999995}]},{"osd":8,"last update":"Sat Sep 23 08:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.82799999999999996,"15min":0.84799999999999998},"min":{"1min":0.58799999999999997,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.80300000000000005,"15min":0.81699999999999995},"min":{"1min":0.60399999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.84799999999999998}]},{"osd":9,"last update":"Sat Sep 23 08:56:12 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.83999999999999997,"15min":0.872},"min":{"1min":0.49099999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.966,"5min":1.966,"15min":1.966},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.83699999999999997,"15min":0.88100000000000001},"min":{"1min":0.47399999999999998,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.333,"5min":1.333,"15min":1.333},"last":0.61599999999999999}]},{"osd":10,"last update":"Sat Sep 23 08:56:35 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.79600000000000004,"15min":0.80200000000000005},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.98799999999999999,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.90700000000000003,"15min":0.92900000000000005},"min":{"1min":0.68000000000000005,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.0069999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.74199999999999999}]},{"osd":11,"last update":"Sat Sep 23 08:56:01 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.82299999999999995,"15min":0.81499999999999995},"min":{"1min":0.69099999999999995,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.659,"5min":1.659,"15min":1.659},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.88300000000000001,"15min":0.88},"min":{"1min":0.79100000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.2130000000000001,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.83699999999999997}]}]},{"osd":2,"up_from":18,"seq":77309411410,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1052672,"data_stored":524691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:56:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.61699999999999999,"15min":0.61499999999999999},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.59999999999999998,"15min":0.61699999999999999},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.98799999999999999,"5min":1.004,"15min":1.196},"last":0.65900000000000003}]},{"osd":1,"last update":"Sat Sep 23 08:56:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.46899999999999997,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.95699999999999996,"5min":0.98399999999999999,"15min":1.177},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.72599999999999998,"15min":0.68600000000000005},"min":{"1min":0.46400000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.3100000000000001},"last":0.80800000000000005}]},{"osd":3,"last update":"Sat Sep 23 08:56:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72799999999999998,"15min":0.72199999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.083},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.70199999999999996,"15min":0.68799999999999994},"min":{"1min":0.48099999999999998,"5min":0.38,"15min":0.38},"max":{"1min":1.0269999999999999,"5min":1.129,"15min":1.129},"last":0.77500000000000002}]},{"osd":4,"last update":"Sat Sep 23 08:55:52 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.85999999999999999}]},{"osd":5,"last update":"Sat Sep 23 08:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.64300000000000002,"15min":0.57399999999999995},"min":{"1min":0.54700000000000004,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.98999999999999999,"5min":1.04,"15min":1.04},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.60299999999999998,"15min":0.54700000000000004},"min":{"1min":0.52300000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.93700000000000006,"5min":1.085,"15min":1.085},"last":0.61499999999999999}]},{"osd":6,"last update":"Sat Sep 23 08:55:52 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.77200000000000002,"15min":0.73899999999999999},"min":{"1min":0.58999999999999997,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.1060000000000001,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.72999999999999998,"15min":0.70099999999999996},"min":{"1min":0.59999999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.84699999999999998}]},{"osd":7,"last update":"Sat Sep 23 08:54:12 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.75,"15min":0.75},"min":{"1min":0.61399999999999999,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.93999999999999995,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.81699999999999995,"15min":0.81999999999999995},"min":{"1min":0.56299999999999994,"5min":0.501,"15min":0.501},"max":{"1min":1.006,"5min":1.129,"15min":1.129},"last":0.82199999999999995}]},{"osd":8,"last update":"Sat Sep 23 08:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.753,"15min":0.74199999999999999},"min":{"1min":0.61299999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.752,"5min":0.73099999999999998,"15min":0.72899999999999998},"min":{"1min":0.60499999999999998,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.91400000000000003}]},{"osd":9,"last update":"Sat Sep 23 08:56:08 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":0.873,"15min":0.84399999999999997},"min":{"1min":0.70299999999999996,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":4.0810000000000004,"5min":4.0810000000000004,"15min":4.0810000000000004},"last":0.752},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.878,"15min":0.874},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.88300000000000001}]},{"osd":10,"last update":"Sat Sep 23 08:56:34 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.88400000000000001,"15min":0.86699999999999999},"min":{"1min":0.73999999999999999,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.0640000000000001,"5min":1.157,"15min":1.157},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.91800000000000004,"15min":0.90300000000000002},"min":{"1min":0.61199999999999999,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.93200000000000005}]},{"osd":11,"last update":"Sat Sep 23 08:55:52 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.79600000000000004}]}]},{"osd":3,"up_from":26,"seq":111669149772,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":974848,"data_stored":458766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.46800000000000003,"15min":0.40600000000000003},"min":{"1min":0.314,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":2.294,"5min":2.294,"15min":2.294},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.48499999999999999,"15min":0.42799999999999999},"min":{"1min":0.35299999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":0.42099999999999999}]},{"osd":1,"last update":"Sat Sep 23 08:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.71699999999999997,"15min":0.629},"min":{"1min":0.53500000000000003,"5min":0.434,"15min":0.434},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.69399999999999995,"15min":0.63700000000000001},"min":{"1min":0.502,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.91400000000000003}]},{"osd":2,"last update":"Sat Sep 23 08:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.69899999999999995,"15min":0.65400000000000003},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.72399999999999998,"15min":0.66800000000000004},"min":{"1min":0.496,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.76200000000000001}]},{"osd":4,"last update":"Sat Sep 23 08:56:06 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.70999999999999996,"15min":0.66400000000000003},"min":{"1min":0.46999999999999997,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.1919999999999999,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.71999999999999997,"15min":0.66400000000000003},"min":{"1min":0.47499999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.3799999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.90000000000000002}]},{"osd":5,"last update":"Sat Sep 23 08:56:30 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.79000000000000004,"15min":0.77200000000000002},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.78800000000000003,"15min":0.77000000000000002},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.93100000000000005}]},{"osd":6,"last update":"Sat Sep 23 08:55:52 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.65600000000000003,"15min":0.65200000000000002},"min":{"1min":0.43099999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":2.637,"5min":2.637,"15min":2.637},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69399999999999995,"15min":0.66900000000000004},"min":{"1min":0.443,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.52700000000000002}]},{"osd":7,"last update":"Sat Sep 23 08:56:18 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.80700000000000005,"15min":0.81299999999999994},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0780000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.875},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81799999999999995,"15min":0.83399999999999996},"min":{"1min":0.59799999999999998,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.78100000000000003}]},{"osd":8,"last update":"Sat Sep 23 08:54:43 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.89200000000000002,"15min":0.90300000000000002},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.0660000000000001,"5min":1.093,"15min":1.093},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.86699999999999999,"15min":0.87},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.66000000000000003}]},{"osd":9,"last update":"Sat Sep 23 08:56:06 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.81299999999999994,"15min":0.82399999999999995},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":2.2050000000000001,"5min":2.2050000000000001,"15min":2.2050000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.89200000000000002,"15min":0.92400000000000004},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":2.258,"5min":2.258,"15min":2.258},"last":0.57699999999999996}]},{"osd":10,"last update":"Sat Sep 23 08:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.88700000000000001,"15min":0.88100000000000001},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.755},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.91100000000000003,"15min":0.91000000000000003},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.86299999999999999}]},{"osd":11,"last update":"Sat Sep 23 08:55:52 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.88600000000000001}]}]},{"osd":4,"up_from":34,"seq":146028888137,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":966656,"data_stored":460408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:53:55 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.628,"15min":0.624},"min":{"1min":0.45300000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.86199999999999999,"5min":1.042,"15min":1.042},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.622,"5min":0.60699999999999998,"15min":0.60899999999999999},"min":{"1min":0.434,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.93300000000000005,"5min":1.008,"15min":1.008},"last":0.38300000000000001}]},{"osd":1,"last update":"Sat Sep 23 08:55:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.46200000000000002,"15min":0.44700000000000001},"min":{"1min":0.39400000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.495,"15min":0.47499999999999998},"min":{"1min":0.39200000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.65700000000000003,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.48699999999999999}]},{"osd":2,"last update":"Sat Sep 23 08:55:59 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.73499999999999999,"15min":0.68000000000000005},"min":{"1min":0.59699999999999998,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.67000000000000004,"15min":0.65700000000000003},"min":{"1min":0.51100000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.96699999999999997,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.52200000000000002}]},{"osd":3,"last update":"Sat Sep 23 08:55:59 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.67500000000000004,"15min":0.64600000000000002},"min":{"1min":0.53300000000000003,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.74399999999999999,"15min":0.71499999999999997},"min":{"1min":0.56699999999999995,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.0800000000000001,"5min":1.238,"15min":1.238},"last":0.81899999999999995}]},{"osd":5,"last update":"Sat Sep 23 08:56:26 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.74199999999999999,"15min":0.65500000000000003},"min":{"1min":0.66200000000000003,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.77500000000000002,"15min":0.68200000000000005},"min":{"1min":0.67800000000000005,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.0189999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.65000000000000002}]},{"osd":6,"last update":"Sat Sep 23 08:55:53 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.82899999999999996,"15min":0.73699999999999999},"min":{"1min":0.67100000000000004,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.081,"5min":7.1829999999999998,"15min":7.1829999999999998},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.69999999999999996,"15min":0.69399999999999995},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.96899999999999997,"5min":1.127,"15min":1.127},"last":0.624}]},{"osd":7,"last update":"Sat Sep 23 08:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.68500000000000005,"15min":0.65300000000000002},"min":{"1min":0.627,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.94999999999999996,"5min":1.212,"15min":1.212},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.73699999999999999,"15min":0.70699999999999996},"min":{"1min":0.55200000000000005,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.97199999999999998,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.95099999999999996}]},{"osd":8,"last update":"Sat Sep 23 08:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.59899999999999998,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.94399999999999995,"5min":1.087,"15min":1.087},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.81399999999999995,"15min":0.78800000000000003},"min":{"1min":0.626,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.88700000000000001}]},{"osd":9,"last update":"Sat Sep 23 08:56:10 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.78700000000000003,"15min":0.80200000000000005},"min":{"1min":0.59599999999999997,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.1870000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.85999999999999999,"15min":0.85599999999999998},"min":{"1min":0.72899999999999998,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.98599999999999999}]},{"osd":10,"last update":"Sat Sep 23 08:56:35 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.90200000000000002,"15min":0.88400000000000001},"min":{"1min":0.79500000000000004,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":1.0489999999999999},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.93899999999999995,"15min":0.94899999999999995},"min":{"1min":0.68700000000000006,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.1100000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.91300000000000003}]},{"osd":11,"last update":"Sat Sep 23 08:55:53 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":1.0249999999999999},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.86199999999999999}]}]},{"osd":5,"up_from":39,"seq":167503724612,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28564,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716588,"statfs":{"total":95995035648,"available":95965786112,"internally_reserved":0,"allocated":1585152,"data_stored":1052746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.66600000000000004,"15min":0.63200000000000001},"min":{"1min":0.40300000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.6240000000000001,"5min":3.5680000000000001,"15min":3.5680000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63900000000000001,"15min":0.64800000000000002},"min":{"1min":0.40699999999999997,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":0.76200000000000001}]},{"osd":1,"last update":"Sat Sep 23 08:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.68500000000000005,"15min":0.64900000000000002},"min":{"1min":0.42699999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.92100000000000004,"5min":1.016,"15min":1.016},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.71599999999999997,"15min":0.64900000000000002},"min":{"1min":0.58099999999999996,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.0840000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.83899999999999997}]},{"osd":2,"last update":"Sat Sep 23 08:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.55600000000000005,"15min":0.53000000000000003},"min":{"1min":0.435,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.84599999999999997,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.56399999999999995,"15min":0.52800000000000002},"min":{"1min":0.42599999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.77600000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.70699999999999996}]},{"osd":3,"last update":"Sat Sep 23 08:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.72999999999999998,"15min":0.69199999999999995},"min":{"1min":0.49199999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.6930000000000001,"5min":5.5339999999999998,"15min":5.5339999999999998},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.68100000000000005,"15min":0.68899999999999995},"min":{"1min":0.5,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.621}]},{"osd":4,"last update":"Sat Sep 23 08:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.746,"15min":0.69799999999999995},"min":{"1min":0.54200000000000004,"5min":0.44,"15min":0.44},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.73599999999999999,"15min":0.69599999999999995},"min":{"1min":0.57399999999999995,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.98199999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.875}]},{"osd":6,"last update":"Sat Sep 23 08:55:48 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.754,"15min":0.73099999999999998},"min":{"1min":0.50900000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.89100000000000001,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.76300000000000001,"15min":0.74299999999999999},"min":{"1min":0.56200000000000006,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.85599999999999998}]},{"osd":7,"last update":"Sat Sep 23 08:56:12 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.79300000000000004,"15min":0.75900000000000001},"min":{"1min":0.58799999999999997,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.94799999999999995,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.745},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.80900000000000005,"15min":0.78900000000000003},"min":{"1min":0.67800000000000005,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.98799999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.94199999999999995}]},{"osd":8,"last update":"Sat Sep 23 08:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.77200000000000002,"15min":0.77800000000000002},"min":{"1min":0.52900000000000003,"5min":0.497,"15min":0.497},"max":{"1min":0.96699999999999997,"5min":1.044,"15min":1.044},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.76300000000000001,"15min":0.77200000000000002},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.89100000000000001,"5min":1.046,"15min":1.046},"last":1.0580000000000001}]},{"osd":9,"last update":"Sat Sep 23 08:56:12 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.92100000000000004,"15min":0.93100000000000005},"min":{"1min":0.66100000000000003,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":3.419,"5min":3.419,"15min":3.419},"last":1.0149999999999999},{"interface":"front","average":{"1min":1.02,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.60899999999999999,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":3.407,"5min":3.407,"15min":3.407},"last":0.89700000000000002}]},{"osd":10,"last update":"Sat Sep 23 08:56:35 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.90300000000000002,"15min":0.90600000000000003},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":1.042},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.90000000000000002,"15min":0.91200000000000003},"min":{"1min":0.71299999999999997,"5min":0.629,"15min":0.629},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":65435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":65997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":60958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-23T08:56:40.275 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-23T08:56:40.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.500+0000 7f84ebbff700 1 -- 172.21.15.82:0/2787778872 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f84e4101b10 msgr2=0x7f84e4101f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:40.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.500+0000 7f84ebbff700 1 --2- 172.21.15.82:0/2787778872 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f84e4101b10 0x7f84e4101f70 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f84d40099c0 tx=0x7f84d4009cd0 comp rx=0 tx=0).stop 2023-09-23T08:56:40.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.500+0000 7f84ebbff700 1 -- 172.21.15.82:0/2787778872 shutdown_connections 2023-09-23T08:56:40.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.500+0000 7f84ebbff700 1 --2- 172.21.15.82:0/2787778872 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84e41024b0 0x7f84e4108d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:40.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.500+0000 7f84ebbff700 1 --2- 172.21.15.82:0/2787778872 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84e4100920 0x7f84e4100d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:40.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.500+0000 7f84ebbff700 1 --2- 172.21.15.82:0/2787778872 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f84e4101b10 0x7f84e4101f70 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:40.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.500+0000 7f84ebbff700 1 -- 172.21.15.82:0/2787778872 >> 172.21.15.82:0/2787778872 conn(0x7f84e40fbe50 msgr2=0x7f84e40fe2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:40.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.500+0000 7f84ebbff700 1 -- 172.21.15.82:0/2787778872 shutdown_connections 2023-09-23T08:56:40.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.500+0000 7f84ebbff700 1 -- 172.21.15.82:0/2787778872 wait complete. 2023-09-23T08:56:40.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.501+0000 7f84ebbff700 1 Processor -- start 2023-09-23T08:56:40.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.501+0000 7f84ebbff700 1 -- start start 2023-09-23T08:56:40.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.501+0000 7f84ebbff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f84e4100920 0x7f84e40746d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:40.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.502+0000 7f84ebbff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84e4101b10 0x7f84e4072d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:40.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.502+0000 7f84ebbff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84e41024b0 0x7f84e4073250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:40.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.502+0000 7f84ebbff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84e40739f0 con 0x7f84e4100920 2023-09-23T08:56:40.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.502+0000 7f84ebbff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84e4073b60 con 0x7f84e4101b10 2023-09-23T08:56:40.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.502+0000 7f84ebbff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84e41a0530 con 0x7f84e41024b0 2023-09-23T08:56:40.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.502+0000 7f84e999b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f84e4100920 0x7f84e40746d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:40.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.502+0000 7f84e999b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f84e4100920 0x7f84e40746d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45228/0 (socket says 172.21.15.82:45228) 2023-09-23T08:56:40.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.502+0000 7f84e999b700 1 -- 172.21.15.82:0/3642950763 learned_addr learned my addr 172.21.15.82:0/3642950763 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:40.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.502+0000 7f84e919a700 1 --2- 172.21.15.82:0/3642950763 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84e4101b10 0x7f84e4072d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:40.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.502+0000 7f84e999b700 1 -- 172.21.15.82:0/3642950763 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84e41024b0 msgr2=0x7f84e4073250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:40.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.502+0000 7f84ea19c700 1 --2- 172.21.15.82:0/3642950763 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84e41024b0 0x7f84e4073250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:40.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.502+0000 7f84e999b700 1 --2- 172.21.15.82:0/3642950763 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84e41024b0 0x7f84e4073250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:40.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.502+0000 7f84e999b700 1 -- 172.21.15.82:0/3642950763 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84e4101b10 msgr2=0x7f84e4072d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:40.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.502+0000 7f84e999b700 1 --2- 172.21.15.82:0/3642950763 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84e4101b10 0x7f84e4072d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:40.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.502+0000 7f84e999b700 1 -- 172.21.15.82:0/3642950763 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84d40095f0 con 0x7f84e4100920 2023-09-23T08:56:40.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.502+0000 7f84ea19c700 1 --2- 172.21.15.82:0/3642950763 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84e41024b0 0x7f84e4073250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T08:56:40.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.503+0000 7f84e999b700 1 --2- 172.21.15.82:0/3642950763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f84e4100920 0x7f84e40746d0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f84e000e970 tx=0x7f84e000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:40.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.503+0000 7f84daffd700 1 -- 172.21.15.82:0/3642950763 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e0009790 con 0x7f84e4100920 2023-09-23T08:56:40.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.503+0000 7f84ebbff700 1 -- 172.21.15.82:0/3642950763 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84e41a0810 con 0x7f84e4100920 2023-09-23T08:56:40.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.503+0000 7f84daffd700 1 -- 172.21.15.82:0/3642950763 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f84e000eec0 con 0x7f84e4100920 2023-09-23T08:56:40.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.503+0000 7f84daffd700 1 -- 172.21.15.82:0/3642950763 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e0003c10 con 0x7f84e4100920 2023-09-23T08:56:40.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.503+0000 7f84ebbff700 1 -- 172.21.15.82:0/3642950763 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84e41a0d20 con 0x7f84e4100920 2023-09-23T08:56:40.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.504+0000 7f84ebbff700 1 -- 172.21.15.82:0/3642950763 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84e410bfe0 con 0x7f84e4100920 2023-09-23T08:56:40.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.506+0000 7f84daffd700 1 -- 172.21.15.82:0/3642950763 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 134671+0+0 (secure 0 0 0) 0x7f84e0003db0 con 0x7f84e4100920 2023-09-23T08:56:40.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.507+0000 7f84daffd700 1 --2- 172.21.15.82:0/3642950763 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f84d009ffa0 0x7f84d00a2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:40.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.508+0000 7f84daffd700 1 -- 172.21.15.82:0/3642950763 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f84e0014070 con 0x7f84e4100920 2023-09-23T08:56:40.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.508+0000 7f84e919a700 1 --2- 172.21.15.82:0/3642950763 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f84d009ffa0 0x7f84d00a2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:40.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.508+0000 7f84e919a700 1 --2- 172.21.15.82:0/3642950763 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f84d009ffa0 0x7f84d00a2460 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f84d4009990 tx=0x7f84d4005be0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:40.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.511+0000 7f84daffd700 1 -- 172.21.15.82:0/3642950763 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f84e0095230 con 0x7f84e4100920 2023-09-23T08:56:40.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:40 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/964663249' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-09-23T08:56:40.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:40 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/425501270' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T08:56:40.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:40 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/964663249' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-09-23T08:56:40.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:40 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/425501270' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T08:56:40.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:40 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/964663249' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-09-23T08:56:40.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:40 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/425501270' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T08:56:40.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.708+0000 7f84ebbff700 1 -- 172.21.15.82:0/3642950763 --> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f84e4060d60 con 0x7f84d009ffa0 2023-09-23T08:56:40.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.718+0000 7f84daffd700 1 -- 172.21.15.82:0/3642950763 <== mgr.14152 v2:172.21.15.82:6800/3698954311 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+343229 (secure 0 0 0) 0x7f84e4060d60 con 0x7f84d009ffa0 2023-09-23T08:56:40.725 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:56:40.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.723+0000 7f84ebbff700 1 -- 172.21.15.82:0/3642950763 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f84d009ffa0 msgr2=0x7f84d00a2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:40.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.723+0000 7f84ebbff700 1 --2- 172.21.15.82:0/3642950763 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f84d009ffa0 0x7f84d00a2460 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f84d4009990 tx=0x7f84d4005be0 comp rx=0 tx=0).stop 2023-09-23T08:56:40.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.723+0000 7f84ebbff700 1 -- 172.21.15.82:0/3642950763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f84e4100920 msgr2=0x7f84e40746d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:40.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.723+0000 7f84ebbff700 1 --2- 172.21.15.82:0/3642950763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f84e4100920 0x7f84e40746d0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f84e000e970 tx=0x7f84e000ec80 comp rx=0 tx=0).stop 2023-09-23T08:56:40.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.723+0000 7f84ebbff700 1 -- 172.21.15.82:0/3642950763 shutdown_connections 2023-09-23T08:56:40.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.723+0000 7f84ebbff700 1 --2- 172.21.15.82:0/3642950763 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f84d009ffa0 0x7f84d00a2460 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:40.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.723+0000 7f84ebbff700 1 --2- 172.21.15.82:0/3642950763 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84e41024b0 0x7f84e4073250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:40.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.723+0000 7f84ebbff700 1 --2- 172.21.15.82:0/3642950763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f84e4100920 0x7f84e40746d0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:40.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.723+0000 7f84ebbff700 1 --2- 172.21.15.82:0/3642950763 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84e4101b10 0x7f84e4072d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:40.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.723+0000 7f84ebbff700 1 -- 172.21.15.82:0/3642950763 >> 172.21.15.82:0/3642950763 conn(0x7f84e40fbe50 msgr2=0x7f84e40fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:40.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.723+0000 7f84ebbff700 1 -- 172.21.15.82:0/3642950763 shutdown_connections 2023-09-23T08:56:40.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.723+0000 7f84ebbff700 1 -- 172.21.15.82:0/3642950763 wait complete. 2023-09-23T08:56:40.729 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-09-23T08:56:40.744 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":357,"stamp":"2023-09-23T08:56:40.079391+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658238,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1139,"num_read_kb":690,"num_write":441,"num_write_kb":3086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":1181408,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":862,"ondisk_log_size":862,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":337576,"kb_used_data":13384,"kb_used_omap":20,"kb_used_meta":324075,"kb_avail":1124604248,"statfs":{"total":1151940427776,"available":1151594749952,"internally_reserved":0,"allocated":13705216,"data_stored":7485655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21372,"internal_metadata":331852932},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2415,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":60,"num_write":15,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003060"},"pg_stats":[{"pgid":"3.3f","version":"88'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.099015+0000","last_change":"2023-09-23T08:54:53.110235+0000","last_active":"2023-09-23T08:56:22.099015+0000","last_peered":"2023-09-23T08:56:22.099015+0000","last_clean":"2023-09-23T08:56:22.099015+0000","last_became_active":"2023-09-23T08:54:53.109445+0000","last_became_peered":"2023-09-23T08:54:53.109445+0000","last_unstale":"2023-09-23T08:56:22.099015+0000","last_undegraded":"2023-09-23T08:56:22.099015+0000","last_fullsized":"2023-09-23T08:56:22.099015+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T10:56:35.558203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"88'4","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.085205+0000","last_change":"2023-09-23T08:54:53.105948+0000","last_active":"2023-09-23T08:56:22.085205+0000","last_peered":"2023-09-23T08:56:22.085205+0000","last_clean":"2023-09-23T08:56:22.085205+0000","last_became_active":"2023-09-23T08:54:53.105627+0000","last_became_peered":"2023-09-23T08:54:53.105627+0000","last_unstale":"2023-09-23T08:56:22.085205+0000","last_undegraded":"2023-09-23T08:56:22.085205+0000","last_fullsized":"2023-09-23T08:56:22.085205+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T13:02:00.876110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"88'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.095519+0000","last_change":"2023-09-23T08:54:53.099318+0000","last_active":"2023-09-23T08:56:22.095519+0000","last_peered":"2023-09-23T08:56:22.095519+0000","last_clean":"2023-09-23T08:56:22.095519+0000","last_became_active":"2023-09-23T08:54:53.099002+0000","last_became_peered":"2023-09-23T08:54:53.099002+0000","last_unstale":"2023-09-23T08:56:22.095519+0000","last_undegraded":"2023-09-23T08:56:22.095519+0000","last_fullsized":"2023-09-23T08:56:22.095519+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T11:00:15.427942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"88'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.094825+0000","last_change":"2023-09-23T08:54:53.114757+0000","last_active":"2023-09-23T08:56:22.094825+0000","last_peered":"2023-09-23T08:56:22.094825+0000","last_clean":"2023-09-23T08:56:22.094825+0000","last_became_active":"2023-09-23T08:54:53.113979+0000","last_became_peered":"2023-09-23T08:54:53.113979+0000","last_unstale":"2023-09-23T08:56:22.094825+0000","last_undegraded":"2023-09-23T08:56:22.094825+0000","last_fullsized":"2023-09-23T08:56:22.094825+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T11:02:27.209284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"88'4","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.090455+0000","last_change":"2023-09-23T08:54:53.102122+0000","last_active":"2023-09-23T08:56:22.090455+0000","last_peered":"2023-09-23T08:56:22.090455+0000","last_clean":"2023-09-23T08:56:22.090455+0000","last_became_active":"2023-09-23T08:54:53.101781+0000","last_became_peered":"2023-09-23T08:54:53.101781+0000","last_unstale":"2023-09-23T08:56:22.090455+0000","last_undegraded":"2023-09-23T08:56:22.090455+0000","last_fullsized":"2023-09-23T08:56:22.090455+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T18:27:41.371961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"88'6","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.076942+0000","last_change":"2023-09-23T08:54:53.103617+0000","last_active":"2023-09-23T08:56:22.076942+0000","last_peered":"2023-09-23T08:56:22.076942+0000","last_clean":"2023-09-23T08:56:22.076942+0000","last_became_active":"2023-09-23T08:54:53.103259+0000","last_became_peered":"2023-09-23T08:54:53.103259+0000","last_unstale":"2023-09-23T08:56:22.076942+0000","last_undegraded":"2023-09-23T08:56:22.076942+0000","last_fullsized":"2023-09-23T08:56:22.076942+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:51:15.970275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"88'5","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.082702+0000","last_change":"2023-09-23T08:54:53.110512+0000","last_active":"2023-09-23T08:56:22.082702+0000","last_peered":"2023-09-23T08:56:22.082702+0000","last_clean":"2023-09-23T08:56:22.082702+0000","last_became_active":"2023-09-23T08:54:53.110166+0000","last_became_peered":"2023-09-23T08:54:53.110166+0000","last_unstale":"2023-09-23T08:56:22.082702+0000","last_undegraded":"2023-09-23T08:56:22.082702+0000","last_fullsized":"2023-09-23T08:56:22.082702+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T20:45:16.248775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"88'9","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.099630+0000","last_change":"2023-09-23T08:54:53.111373+0000","last_active":"2023-09-23T08:56:22.099630+0000","last_peered":"2023-09-23T08:56:22.099630+0000","last_clean":"2023-09-23T08:56:22.099630+0000","last_became_active":"2023-09-23T08:54:53.111045+0000","last_became_peered":"2023-09-23T08:54:53.111045+0000","last_unstale":"2023-09-23T08:56:22.099630+0000","last_undegraded":"2023-09-23T08:56:22.099630+0000","last_fullsized":"2023-09-23T08:56:22.099630+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:25:16.099829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"88'11","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.098906+0000","last_change":"2023-09-23T08:54:53.100219+0000","last_active":"2023-09-23T08:56:22.098906+0000","last_peered":"2023-09-23T08:56:22.098906+0000","last_clean":"2023-09-23T08:56:22.098906+0000","last_became_active":"2023-09-23T08:54:53.099925+0000","last_became_peered":"2023-09-23T08:54:53.099925+0000","last_unstale":"2023-09-23T08:56:22.098906+0000","last_undegraded":"2023-09-23T08:56:22.098906+0000","last_fullsized":"2023-09-23T08:56:22.098906+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T20:53:32.264331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"88'16","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.090196+0000","last_change":"2023-09-23T08:55:23.439006+0000","last_active":"2023-09-23T08:56:22.090196+0000","last_peered":"2023-09-23T08:56:22.090196+0000","last_clean":"2023-09-23T08:56:22.090196+0000","last_became_active":"2023-09-23T08:55:23.438533+0000","last_became_peered":"2023-09-23T08:55:23.438533+0000","last_unstale":"2023-09-23T08:56:22.090196+0000","last_undegraded":"2023-09-23T08:56:22.090196+0000","last_fullsized":"2023-09-23T08:56:22.090196+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T12:30:40.717065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"88'6","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.099302+0000","last_change":"2023-09-23T08:54:53.108175+0000","last_active":"2023-09-23T08:56:22.099302+0000","last_peered":"2023-09-23T08:56:22.099302+0000","last_clean":"2023-09-23T08:56:22.099302+0000","last_became_active":"2023-09-23T08:54:53.107889+0000","last_became_peered":"2023-09-23T08:54:53.107889+0000","last_unstale":"2023-09-23T08:56:22.099302+0000","last_undegraded":"2023-09-23T08:56:22.099302+0000","last_fullsized":"2023-09-23T08:56:22.099302+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T11:57:28.537929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"88'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.092255+0000","last_change":"2023-09-23T08:54:53.114564+0000","last_active":"2023-09-23T08:56:22.092255+0000","last_peered":"2023-09-23T08:56:22.092255+0000","last_clean":"2023-09-23T08:56:22.092255+0000","last_became_active":"2023-09-23T08:54:53.113937+0000","last_became_peered":"2023-09-23T08:54:53.113937+0000","last_unstale":"2023-09-23T08:56:22.092255+0000","last_undegraded":"2023-09-23T08:56:22.092255+0000","last_fullsized":"2023-09-23T08:56:22.092255+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:07:59.125776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"88'10","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.086442+0000","last_change":"2023-09-23T08:54:53.108544+0000","last_active":"2023-09-23T08:56:22.086442+0000","last_peered":"2023-09-23T08:56:22.086442+0000","last_clean":"2023-09-23T08:56:22.086442+0000","last_became_active":"2023-09-23T08:54:53.108226+0000","last_became_peered":"2023-09-23T08:54:53.108226+0000","last_unstale":"2023-09-23T08:56:22.086442+0000","last_undegraded":"2023-09-23T08:56:22.086442+0000","last_fullsized":"2023-09-23T08:56:22.086442+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T20:44:46.654608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"88'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.082551+0000","last_change":"2023-09-23T08:54:53.106250+0000","last_active":"2023-09-23T08:56:22.082551+0000","last_peered":"2023-09-23T08:56:22.082551+0000","last_clean":"2023-09-23T08:56:22.082551+0000","last_became_active":"2023-09-23T08:54:53.105912+0000","last_became_peered":"2023-09-23T08:54:53.105912+0000","last_unstale":"2023-09-23T08:56:22.082551+0000","last_undegraded":"2023-09-23T08:56:22.082551+0000","last_fullsized":"2023-09-23T08:56:22.082551+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T09:50:26.711654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"88'7","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.091889+0000","last_change":"2023-09-23T08:55:23.441265+0000","last_active":"2023-09-23T08:56:22.091889+0000","last_peered":"2023-09-23T08:56:22.091889+0000","last_clean":"2023-09-23T08:56:22.091889+0000","last_became_active":"2023-09-23T08:55:23.440800+0000","last_became_peered":"2023-09-23T08:55:23.440800+0000","last_unstale":"2023-09-23T08:56:22.091889+0000","last_undegraded":"2023-09-23T08:56:22.091889+0000","last_fullsized":"2023-09-23T08:56:22.091889+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T10:27:59.968816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"88'9","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.100645+0000","last_change":"2023-09-23T08:54:53.098507+0000","last_active":"2023-09-23T08:56:22.100645+0000","last_peered":"2023-09-23T08:56:22.100645+0000","last_clean":"2023-09-23T08:56:22.100645+0000","last_became_active":"2023-09-23T08:54:53.098153+0000","last_became_peered":"2023-09-23T08:54:53.098153+0000","last_unstale":"2023-09-23T08:56:22.100645+0000","last_undegraded":"2023-09-23T08:56:22.100645+0000","last_fullsized":"2023-09-23T08:56:22.100645+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T09:39:06.960825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"88'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.098807+0000","last_change":"2023-09-23T08:54:53.110427+0000","last_active":"2023-09-23T08:56:22.098807+0000","last_peered":"2023-09-23T08:56:22.098807+0000","last_clean":"2023-09-23T08:56:22.098807+0000","last_became_active":"2023-09-23T08:54:53.109868+0000","last_became_peered":"2023-09-23T08:54:53.109868+0000","last_unstale":"2023-09-23T08:56:22.098807+0000","last_undegraded":"2023-09-23T08:56:22.098807+0000","last_fullsized":"2023-09-23T08:56:22.098807+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:58:18.067768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"88'10","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.095604+0000","last_change":"2023-09-23T08:54:53.107613+0000","last_active":"2023-09-23T08:56:22.095604+0000","last_peered":"2023-09-23T08:56:22.095604+0000","last_clean":"2023-09-23T08:56:22.095604+0000","last_became_active":"2023-09-23T08:54:53.107230+0000","last_became_peered":"2023-09-23T08:54:53.107230+0000","last_unstale":"2023-09-23T08:56:22.095604+0000","last_undegraded":"2023-09-23T08:56:22.095604+0000","last_fullsized":"2023-09-23T08:56:22.095604+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:36:14.702321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"88'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.094185+0000","last_change":"2023-09-23T08:54:53.102530+0000","last_active":"2023-09-23T08:56:22.094185+0000","last_peered":"2023-09-23T08:56:22.094185+0000","last_clean":"2023-09-23T08:56:22.094185+0000","last_became_active":"2023-09-23T08:54:53.102004+0000","last_became_peered":"2023-09-23T08:54:53.102004+0000","last_unstale":"2023-09-23T08:56:22.094185+0000","last_undegraded":"2023-09-23T08:56:22.094185+0000","last_fullsized":"2023-09-23T08:56:22.094185+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:18:54.809976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"88'14","reported_seq":150,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:36.557416+0000","last_change":"2023-09-23T08:55:23.449398+0000","last_active":"2023-09-23T08:56:36.557416+0000","last_peered":"2023-09-23T08:56:36.557416+0000","last_clean":"2023-09-23T08:56:36.557416+0000","last_became_active":"2023-09-23T08:55:23.434193+0000","last_became_peered":"2023-09-23T08:55:23.434193+0000","last_unstale":"2023-09-23T08:56:36.557416+0000","last_undegraded":"2023-09-23T08:56:36.557416+0000","last_fullsized":"2023-09-23T08:56:36.557416+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:21:58.024636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":92,"num_read_kb":92,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"88'5","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.088274+0000","last_change":"2023-09-23T08:54:53.109844+0000","last_active":"2023-09-23T08:56:22.088274+0000","last_peered":"2023-09-23T08:56:22.088274+0000","last_clean":"2023-09-23T08:56:22.088274+0000","last_became_active":"2023-09-23T08:54:53.109456+0000","last_became_peered":"2023-09-23T08:54:53.109456+0000","last_unstale":"2023-09-23T08:56:22.088274+0000","last_undegraded":"2023-09-23T08:56:22.088274+0000","last_fullsized":"2023-09-23T08:56:22.088274+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:35:18.729698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.437928+0000","last_change":"2023-09-23T08:54:52.090023+0000","last_active":"2023-09-23T08:55:23.437928+0000","last_peered":"2023-09-23T08:55:23.437928+0000","last_clean":"2023-09-23T08:55:23.437928+0000","last_became_active":"2023-09-23T08:54:52.089587+0000","last_became_peered":"2023-09-23T08:54:52.089587+0000","last_unstale":"2023-09-23T08:55:23.437928+0000","last_undegraded":"2023-09-23T08:55:23.437928+0000","last_fullsized":"2023-09-23T08:55:23.437928+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T09:08:05.801189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"88'6","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.090783+0000","last_change":"2023-09-23T08:54:53.098662+0000","last_active":"2023-09-23T08:56:22.090783+0000","last_peered":"2023-09-23T08:56:22.090783+0000","last_clean":"2023-09-23T08:56:22.090783+0000","last_became_active":"2023-09-23T08:54:53.098288+0000","last_became_peered":"2023-09-23T08:54:53.098288+0000","last_unstale":"2023-09-23T08:56:22.090783+0000","last_undegraded":"2023-09-23T08:56:22.090783+0000","last_fullsized":"2023-09-23T08:56:22.090783+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:21:44.163895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"86'12","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.432199+0000","last_change":"2023-09-23T08:54:52.083109+0000","last_active":"2023-09-23T08:55:23.432199+0000","last_peered":"2023-09-23T08:55:23.432199+0000","last_clean":"2023-09-23T08:55:23.432199+0000","last_became_active":"2023-09-23T08:54:52.082479+0000","last_became_peered":"2023-09-23T08:54:52.082479+0000","last_unstale":"2023-09-23T08:55:23.432199+0000","last_undegraded":"2023-09-23T08:55:23.432199+0000","last_fullsized":"2023-09-23T08:55:23.432199+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T14:19:13.234767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"88'9","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.100922+0000","last_change":"2023-09-23T08:54:53.105112+0000","last_active":"2023-09-23T08:56:22.100922+0000","last_peered":"2023-09-23T08:56:22.100922+0000","last_clean":"2023-09-23T08:56:22.100922+0000","last_became_active":"2023-09-23T08:54:53.104639+0000","last_became_peered":"2023-09-23T08:54:53.104639+0000","last_unstale":"2023-09-23T08:56:22.100922+0000","last_undegraded":"2023-09-23T08:56:22.100922+0000","last_fullsized":"2023-09-23T08:56:22.100922+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T09:13:19.421762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"86'5","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.431617+0000","last_change":"2023-09-23T08:54:52.082798+0000","last_active":"2023-09-23T08:55:23.431617+0000","last_peered":"2023-09-23T08:55:23.431617+0000","last_clean":"2023-09-23T08:55:23.431617+0000","last_became_active":"2023-09-23T08:54:52.082455+0000","last_became_peered":"2023-09-23T08:54:52.082455+0000","last_unstale":"2023-09-23T08:55:23.431617+0000","last_undegraded":"2023-09-23T08:55:23.431617+0000","last_fullsized":"2023-09-23T08:55:23.431617+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T18:53:37.376211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"88'15","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.098805+0000","last_change":"2023-09-23T08:54:53.105012+0000","last_active":"2023-09-23T08:56:22.098805+0000","last_peered":"2023-09-23T08:56:22.098805+0000","last_clean":"2023-09-23T08:56:22.098805+0000","last_became_active":"2023-09-23T08:54:53.104670+0000","last_became_peered":"2023-09-23T08:54:53.104670+0000","last_unstale":"2023-09-23T08:56:22.098805+0000","last_undegraded":"2023-09-23T08:56:22.098805+0000","last_fullsized":"2023-09-23T08:56:22.098805+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T13:57:42.013692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"88'8","reported_seq":129,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:37.661645+0000","last_change":"2023-09-23T08:54:52.085771+0000","last_active":"2023-09-23T08:56:37.661645+0000","last_peered":"2023-09-23T08:56:37.661645+0000","last_clean":"2023-09-23T08:56:37.661645+0000","last_became_active":"2023-09-23T08:54:52.085424+0000","last_became_peered":"2023-09-23T08:54:52.085424+0000","last_unstale":"2023-09-23T08:56:37.661645+0000","last_undegraded":"2023-09-23T08:56:37.661645+0000","last_fullsized":"2023-09-23T08:56:37.661645+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T11:26:36.068148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1636,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":4,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"88'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.080931+0000","last_change":"2023-09-23T08:54:53.109830+0000","last_active":"2023-09-23T08:56:22.080931+0000","last_peered":"2023-09-23T08:56:22.080931+0000","last_clean":"2023-09-23T08:56:22.080931+0000","last_became_active":"2023-09-23T08:54:53.109532+0000","last_became_peered":"2023-09-23T08:54:53.109532+0000","last_unstale":"2023-09-23T08:56:22.080931+0000","last_undegraded":"2023-09-23T08:56:22.080931+0000","last_fullsized":"2023-09-23T08:56:22.080931+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:14:37.986156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"86'7","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.428457+0000","last_change":"2023-09-23T08:54:52.075998+0000","last_active":"2023-09-23T08:55:23.428457+0000","last_peered":"2023-09-23T08:55:23.428457+0000","last_clean":"2023-09-23T08:55:23.428457+0000","last_became_active":"2023-09-23T08:54:52.075701+0000","last_became_peered":"2023-09-23T08:54:52.075701+0000","last_unstale":"2023-09-23T08:55:23.428457+0000","last_undegraded":"2023-09-23T08:55:23.428457+0000","last_fullsized":"2023-09-23T08:55:23.428457+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:35:20.680135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"88'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.094881+0000","last_change":"2023-09-23T08:54:53.106654+0000","last_active":"2023-09-23T08:56:22.094881+0000","last_peered":"2023-09-23T08:56:22.094881+0000","last_clean":"2023-09-23T08:56:22.094881+0000","last_became_active":"2023-09-23T08:54:53.106348+0000","last_became_peered":"2023-09-23T08:54:53.106348+0000","last_unstale":"2023-09-23T08:56:22.094881+0000","last_undegraded":"2023-09-23T08:56:22.094881+0000","last_fullsized":"2023-09-23T08:56:22.094881+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:48:44.274107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"86'3","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.431350+0000","last_change":"2023-09-23T08:54:52.073666+0000","last_active":"2023-09-23T08:55:23.431350+0000","last_peered":"2023-09-23T08:55:23.431350+0000","last_clean":"2023-09-23T08:55:23.431350+0000","last_became_active":"2023-09-23T08:54:52.073248+0000","last_became_peered":"2023-09-23T08:54:52.073248+0000","last_unstale":"2023-09-23T08:55:23.431350+0000","last_undegraded":"2023-09-23T08:55:23.431350+0000","last_fullsized":"2023-09-23T08:55:23.431350+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T13:43:51.125737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"88'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.094756+0000","last_change":"2023-09-23T08:54:53.109621+0000","last_active":"2023-09-23T08:56:22.094756+0000","last_peered":"2023-09-23T08:56:22.094756+0000","last_clean":"2023-09-23T08:56:22.094756+0000","last_became_active":"2023-09-23T08:54:53.109304+0000","last_became_peered":"2023-09-23T08:54:53.109304+0000","last_unstale":"2023-09-23T08:56:22.094756+0000","last_undegraded":"2023-09-23T08:56:22.094756+0000","last_fullsized":"2023-09-23T08:56:22.094756+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:23:57.973639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"86'3","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.431509+0000","last_change":"2023-09-23T08:54:52.081580+0000","last_active":"2023-09-23T08:55:23.431509+0000","last_peered":"2023-09-23T08:55:23.431509+0000","last_clean":"2023-09-23T08:55:23.431509+0000","last_became_active":"2023-09-23T08:54:52.081151+0000","last_became_peered":"2023-09-23T08:54:52.081151+0000","last_unstale":"2023-09-23T08:55:23.431509+0000","last_undegraded":"2023-09-23T08:55:23.431509+0000","last_fullsized":"2023-09-23T08:55:23.431509+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T14:53:36.622852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"88'11","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.091347+0000","last_change":"2023-09-23T08:54:53.108334+0000","last_active":"2023-09-23T08:56:22.091347+0000","last_peered":"2023-09-23T08:56:22.091347+0000","last_clean":"2023-09-23T08:56:22.091347+0000","last_became_active":"2023-09-23T08:54:53.108038+0000","last_became_peered":"2023-09-23T08:54:53.108038+0000","last_unstale":"2023-09-23T08:56:22.091347+0000","last_undegraded":"2023-09-23T08:56:22.091347+0000","last_fullsized":"2023-09-23T08:56:22.091347+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:22:21.278138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"88'6","reported_seq":214,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:34.654350+0000","last_change":"2023-09-23T08:54:52.084025+0000","last_active":"2023-09-23T08:56:34.654350+0000","last_peered":"2023-09-23T08:56:34.654350+0000","last_clean":"2023-09-23T08:56:34.654350+0000","last_became_active":"2023-09-23T08:54:52.083625+0000","last_became_peered":"2023-09-23T08:54:52.083625+0000","last_unstale":"2023-09-23T08:56:34.654350+0000","last_undegraded":"2023-09-23T08:56:34.654350+0000","last_fullsized":"2023-09-23T08:56:34.654350+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T13:02:41.009120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":190,"num_read_kb":190,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"88'10","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.096159+0000","last_change":"2023-09-23T08:54:53.106602+0000","last_active":"2023-09-23T08:56:22.096159+0000","last_peered":"2023-09-23T08:56:22.096159+0000","last_clean":"2023-09-23T08:56:22.096159+0000","last_became_active":"2023-09-23T08:54:53.105501+0000","last_became_peered":"2023-09-23T08:54:53.105501+0000","last_unstale":"2023-09-23T08:56:22.096159+0000","last_undegraded":"2023-09-23T08:56:22.096159+0000","last_fullsized":"2023-09-23T08:56:22.096159+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T10:15:37.314083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"86'4","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.431239+0000","last_change":"2023-09-23T08:54:52.079197+0000","last_active":"2023-09-23T08:55:23.431239+0000","last_peered":"2023-09-23T08:55:23.431239+0000","last_clean":"2023-09-23T08:55:23.431239+0000","last_became_active":"2023-09-23T08:54:52.078748+0000","last_became_peered":"2023-09-23T08:54:52.078748+0000","last_unstale":"2023-09-23T08:55:23.431239+0000","last_undegraded":"2023-09-23T08:55:23.431239+0000","last_fullsized":"2023-09-23T08:55:23.431239+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T18:15:16.139104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"88'9","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.089627+0000","last_change":"2023-09-23T08:54:53.105831+0000","last_active":"2023-09-23T08:56:22.089627+0000","last_peered":"2023-09-23T08:56:22.089627+0000","last_clean":"2023-09-23T08:56:22.089627+0000","last_became_active":"2023-09-23T08:54:53.105511+0000","last_became_peered":"2023-09-23T08:54:53.105511+0000","last_unstale":"2023-09-23T08:56:22.089627+0000","last_undegraded":"2023-09-23T08:56:22.089627+0000","last_fullsized":"2023-09-23T08:56:22.089627+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T10:06:14.045381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"86'5","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.432616+0000","last_change":"2023-09-23T08:54:52.089312+0000","last_active":"2023-09-23T08:55:23.432616+0000","last_peered":"2023-09-23T08:55:23.432616+0000","last_clean":"2023-09-23T08:55:23.432616+0000","last_became_active":"2023-09-23T08:54:52.088762+0000","last_became_peered":"2023-09-23T08:54:52.088762+0000","last_unstale":"2023-09-23T08:55:23.432616+0000","last_undegraded":"2023-09-23T08:55:23.432616+0000","last_fullsized":"2023-09-23T08:55:23.432616+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:31:59.043067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"88'11","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.100051+0000","last_change":"2023-09-23T08:54:53.106972+0000","last_active":"2023-09-23T08:56:22.100051+0000","last_peered":"2023-09-23T08:56:22.100051+0000","last_clean":"2023-09-23T08:56:22.100051+0000","last_became_active":"2023-09-23T08:54:53.105175+0000","last_became_peered":"2023-09-23T08:54:53.105175+0000","last_unstale":"2023-09-23T08:56:22.100051+0000","last_undegraded":"2023-09-23T08:56:22.100051+0000","last_fullsized":"2023-09-23T08:56:22.100051+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T20:07:17.130820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"88'34","reported_seq":250,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:34.675103+0000","last_change":"2023-09-23T08:54:52.077758+0000","last_active":"2023-09-23T08:56:34.675103+0000","last_peered":"2023-09-23T08:56:34.675103+0000","last_clean":"2023-09-23T08:56:34.675103+0000","last_became_active":"2023-09-23T08:54:52.077461+0000","last_became_peered":"2023-09-23T08:54:52.077461+0000","last_unstale":"2023-09-23T08:56:34.675103+0000","last_undegraded":"2023-09-23T08:56:34.675103+0000","last_fullsized":"2023-09-23T08:56:34.675103+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T13:22:15.302812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58208,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":198,"num_read_kb":155,"num_write":36,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"88'6","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.085121+0000","last_change":"2023-09-23T08:54:53.102967+0000","last_active":"2023-09-23T08:56:22.085121+0000","last_peered":"2023-09-23T08:56:22.085121+0000","last_clean":"2023-09-23T08:56:22.085121+0000","last_became_active":"2023-09-23T08:54:53.102608+0000","last_became_peered":"2023-09-23T08:54:53.102608+0000","last_unstale":"2023-09-23T08:56:22.085121+0000","last_undegraded":"2023-09-23T08:56:22.085121+0000","last_fullsized":"2023-09-23T08:56:22.085121+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:15:18.457676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"86'9","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.436872+0000","last_change":"2023-09-23T08:54:52.083885+0000","last_active":"2023-09-23T08:55:23.436872+0000","last_peered":"2023-09-23T08:55:23.436872+0000","last_clean":"2023-09-23T08:55:23.436872+0000","last_became_active":"2023-09-23T08:54:52.083530+0000","last_became_peered":"2023-09-23T08:54:52.083530+0000","last_unstale":"2023-09-23T08:55:23.436872+0000","last_undegraded":"2023-09-23T08:55:23.436872+0000","last_fullsized":"2023-09-23T08:55:23.436872+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:13:15.173145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"88'9","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.093090+0000","last_change":"2023-09-23T08:54:53.102429+0000","last_active":"2023-09-23T08:56:22.093090+0000","last_peered":"2023-09-23T08:56:22.093090+0000","last_clean":"2023-09-23T08:56:22.093090+0000","last_became_active":"2023-09-23T08:54:53.102139+0000","last_became_peered":"2023-09-23T08:54:53.102139+0000","last_unstale":"2023-09-23T08:56:22.093090+0000","last_undegraded":"2023-09-23T08:56:22.093090+0000","last_fullsized":"2023-09-23T08:56:22.093090+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T14:20:29.728805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"86'5","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.431753+0000","last_change":"2023-09-23T08:54:52.083380+0000","last_active":"2023-09-23T08:55:23.431753+0000","last_peered":"2023-09-23T08:55:23.431753+0000","last_clean":"2023-09-23T08:55:23.431753+0000","last_became_active":"2023-09-23T08:54:52.083094+0000","last_became_peered":"2023-09-23T08:54:52.083094+0000","last_unstale":"2023-09-23T08:55:23.431753+0000","last_undegraded":"2023-09-23T08:55:23.431753+0000","last_fullsized":"2023-09-23T08:55:23.431753+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:31:04.004340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"88'15","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.097750+0000","last_change":"2023-09-23T08:54:53.107671+0000","last_active":"2023-09-23T08:56:22.097750+0000","last_peered":"2023-09-23T08:56:22.097750+0000","last_clean":"2023-09-23T08:56:22.097750+0000","last_became_active":"2023-09-23T08:54:53.107372+0000","last_became_peered":"2023-09-23T08:54:53.107372+0000","last_unstale":"2023-09-23T08:56:22.097750+0000","last_undegraded":"2023-09-23T08:56:22.097750+0000","last_fullsized":"2023-09-23T08:56:22.097750+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T18:52:05.503710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"88'8","reported_seq":127,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:35.641915+0000","last_change":"2023-09-23T08:54:52.080556+0000","last_active":"2023-09-23T08:56:35.641915+0000","last_peered":"2023-09-23T08:56:35.641915+0000","last_clean":"2023-09-23T08:56:35.641915+0000","last_became_active":"2023-09-23T08:54:52.080220+0000","last_became_peered":"2023-09-23T08:54:52.080220+0000","last_unstale":"2023-09-23T08:56:35.641915+0000","last_undegraded":"2023-09-23T08:56:35.641915+0000","last_fullsized":"2023-09-23T08:56:35.641915+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:05:06.321996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1602,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":102,"num_read_kb":5,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"88'6","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.083467+0000","last_change":"2023-09-23T08:54:53.107044+0000","last_active":"2023-09-23T08:56:22.083467+0000","last_peered":"2023-09-23T08:56:22.083467+0000","last_clean":"2023-09-23T08:56:22.083467+0000","last_became_active":"2023-09-23T08:54:53.106715+0000","last_became_peered":"2023-09-23T08:54:53.106715+0000","last_unstale":"2023-09-23T08:56:22.083467+0000","last_undegraded":"2023-09-23T08:56:22.083467+0000","last_fullsized":"2023-09-23T08:56:22.083467+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T09:20:08.571706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"86'17","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.432200+0000","last_change":"2023-09-23T08:54:52.078052+0000","last_active":"2023-09-23T08:55:23.432200+0000","last_peered":"2023-09-23T08:55:23.432200+0000","last_clean":"2023-09-23T08:55:23.432200+0000","last_became_active":"2023-09-23T08:54:52.077678+0000","last_became_peered":"2023-09-23T08:54:52.077678+0000","last_unstale":"2023-09-23T08:55:23.432200+0000","last_undegraded":"2023-09-23T08:55:23.432200+0000","last_fullsized":"2023-09-23T08:55:23.432200+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T18:34:12.590233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"88'6","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.098976+0000","last_change":"2023-09-23T08:54:53.107673+0000","last_active":"2023-09-23T08:56:22.098976+0000","last_peered":"2023-09-23T08:56:22.098976+0000","last_clean":"2023-09-23T08:56:22.098976+0000","last_became_active":"2023-09-23T08:54:53.107373+0000","last_became_peered":"2023-09-23T08:54:53.107373+0000","last_unstale":"2023-09-23T08:56:22.098976+0000","last_undegraded":"2023-09-23T08:56:22.098976+0000","last_fullsized":"2023-09-23T08:56:22.098976+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T18:11:06.759793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"88'3","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.431740+0000","last_change":"2023-09-23T08:54:52.085460+0000","last_active":"2023-09-23T08:55:23.431740+0000","last_peered":"2023-09-23T08:55:23.431740+0000","last_clean":"2023-09-23T08:55:23.431740+0000","last_became_active":"2023-09-23T08:54:52.085186+0000","last_became_peered":"2023-09-23T08:54:52.085186+0000","last_unstale":"2023-09-23T08:55:23.431740+0000","last_undegraded":"2023-09-23T08:55:23.431740+0000","last_fullsized":"2023-09-23T08:55:23.431740+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T10:44:18.969355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"88'5","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.096477+0000","last_change":"2023-09-23T08:54:53.103630+0000","last_active":"2023-09-23T08:56:22.096477+0000","last_peered":"2023-09-23T08:56:22.096477+0000","last_clean":"2023-09-23T08:56:22.096477+0000","last_became_active":"2023-09-23T08:54:53.103270+0000","last_became_peered":"2023-09-23T08:54:53.103270+0000","last_unstale":"2023-09-23T08:56:22.096477+0000","last_undegraded":"2023-09-23T08:56:22.096477+0000","last_fullsized":"2023-09-23T08:56:22.096477+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T13:21:04.753974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"86'1","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.427814+0000","last_change":"2023-09-23T08:54:52.089279+0000","last_active":"2023-09-23T08:55:23.427814+0000","last_peered":"2023-09-23T08:55:23.427814+0000","last_clean":"2023-09-23T08:55:23.427814+0000","last_became_active":"2023-09-23T08:54:52.088861+0000","last_became_peered":"2023-09-23T08:54:52.088861+0000","last_unstale":"2023-09-23T08:55:23.427814+0000","last_undegraded":"2023-09-23T08:55:23.427814+0000","last_fullsized":"2023-09-23T08:55:23.427814+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T12:49:36.034399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"88'5","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.091248+0000","last_change":"2023-09-23T08:54:53.105653+0000","last_active":"2023-09-23T08:56:22.091248+0000","last_peered":"2023-09-23T08:56:22.091248+0000","last_clean":"2023-09-23T08:56:22.091248+0000","last_became_active":"2023-09-23T08:54:53.105309+0000","last_became_peered":"2023-09-23T08:54:53.105309+0000","last_unstale":"2023-09-23T08:56:22.091248+0000","last_undegraded":"2023-09-23T08:56:22.091248+0000","last_fullsized":"2023-09-23T08:56:22.091248+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T10:25:27.100946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"88'6","reported_seq":120,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:34.553871+0000","last_change":"2023-09-23T08:54:52.080521+0000","last_active":"2023-09-23T08:56:34.553871+0000","last_peered":"2023-09-23T08:56:34.553871+0000","last_clean":"2023-09-23T08:56:34.553871+0000","last_became_active":"2023-09-23T08:54:52.080164+0000","last_became_peered":"2023-09-23T08:54:52.080164+0000","last_unstale":"2023-09-23T08:56:34.553871+0000","last_undegraded":"2023-09-23T08:56:34.553871+0000","last_fullsized":"2023-09-23T08:56:34.553871+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T14:07:18.272863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1071,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"88'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.084429+0000","last_change":"2023-09-23T08:54:53.107516+0000","last_active":"2023-09-23T08:56:22.084429+0000","last_peered":"2023-09-23T08:56:22.084429+0000","last_clean":"2023-09-23T08:56:22.084429+0000","last_became_active":"2023-09-23T08:54:53.106785+0000","last_became_peered":"2023-09-23T08:54:53.106785+0000","last_unstale":"2023-09-23T08:56:22.084429+0000","last_undegraded":"2023-09-23T08:56:22.084429+0000","last_fullsized":"2023-09-23T08:56:22.084429+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T11:51:04.634599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"88'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.090187+0000","last_change":"2023-09-23T08:54:53.110406+0000","last_active":"2023-09-23T08:56:22.090187+0000","last_peered":"2023-09-23T08:56:22.090187+0000","last_clean":"2023-09-23T08:56:22.090187+0000","last_became_active":"2023-09-23T08:54:53.107758+0000","last_became_peered":"2023-09-23T08:54:53.107758+0000","last_unstale":"2023-09-23T08:56:22.090187+0000","last_undegraded":"2023-09-23T08:56:22.090187+0000","last_fullsized":"2023-09-23T08:56:22.090187+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T11:50:56.031628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"88'6","reported_seq":124,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:37.644087+0000","last_change":"2023-09-23T08:54:52.081384+0000","last_active":"2023-09-23T08:56:37.644087+0000","last_peered":"2023-09-23T08:56:37.644087+0000","last_clean":"2023-09-23T08:56:37.644087+0000","last_became_active":"2023-09-23T08:54:52.081082+0000","last_became_peered":"2023-09-23T08:54:52.081082+0000","last_unstale":"2023-09-23T08:56:37.644087+0000","last_undegraded":"2023-09-23T08:56:37.644087+0000","last_fullsized":"2023-09-23T08:56:37.644087+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:35:45.308145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"88'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.096426+0000","last_change":"2023-09-23T08:54:53.109011+0000","last_active":"2023-09-23T08:56:22.096426+0000","last_peered":"2023-09-23T08:56:22.096426+0000","last_clean":"2023-09-23T08:56:22.096426+0000","last_became_active":"2023-09-23T08:54:53.108520+0000","last_became_peered":"2023-09-23T08:54:53.108520+0000","last_unstale":"2023-09-23T08:56:22.096426+0000","last_undegraded":"2023-09-23T08:56:22.096426+0000","last_fullsized":"2023-09-23T08:56:22.096426+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:50:01.361084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"86'6","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.533656+0000","last_change":"2023-09-23T08:54:52.078525+0000","last_active":"2023-09-23T08:55:23.533656+0000","last_peered":"2023-09-23T08:55:23.533656+0000","last_clean":"2023-09-23T08:55:23.533656+0000","last_became_active":"2023-09-23T08:54:52.078177+0000","last_became_peered":"2023-09-23T08:54:52.078177+0000","last_unstale":"2023-09-23T08:55:23.533656+0000","last_undegraded":"2023-09-23T08:55:23.533656+0000","last_fullsized":"2023-09-23T08:55:23.533656+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:53:54.342881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":353,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.431236+0000","last_change":"2023-09-23T08:53:33.610965+0000","last_active":"2023-09-23T08:55:23.431236+0000","last_peered":"2023-09-23T08:55:23.431236+0000","last_clean":"2023-09-23T08:55:23.431236+0000","last_became_active":"2023-09-23T08:53:33.610529+0000","last_became_peered":"2023-09-23T08:53:33.610529+0000","last_unstale":"2023-09-23T08:55:23.431236+0000","last_undegraded":"2023-09-23T08:55:23.431236+0000","last_fullsized":"2023-09-23T08:55:23.431236+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:50:00.779071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:50:00.779071+0000","last_clean_scrub_stamp":"2023-09-23T08:50:00.779071+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:07:05.451303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"88'5","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.085480+0000","last_change":"2023-09-23T08:55:23.442747+0000","last_active":"2023-09-23T08:56:22.085480+0000","last_peered":"2023-09-23T08:56:22.085480+0000","last_clean":"2023-09-23T08:56:22.085480+0000","last_became_active":"2023-09-23T08:55:23.442328+0000","last_became_peered":"2023-09-23T08:55:23.442328+0000","last_unstale":"2023-09-23T08:56:22.085480+0000","last_undegraded":"2023-09-23T08:56:22.085480+0000","last_fullsized":"2023-09-23T08:56:22.085480+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T09:31:53.487979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"86'4","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.442345+0000","last_change":"2023-09-23T08:55:23.442345+0000","last_active":"2023-09-23T08:55:23.442345+0000","last_peered":"2023-09-23T08:55:23.442345+0000","last_clean":"2023-09-23T08:55:23.442345+0000","last_became_active":"2023-09-23T08:55:23.434799+0000","last_became_peered":"2023-09-23T08:55:23.434799+0000","last_unstale":"2023-09-23T08:55:23.442345+0000","last_undegraded":"2023-09-23T08:55:23.442345+0000","last_fullsized":"2023-09-23T08:55:23.442345+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T08:56:24.431145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"86'4","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.431996+0000","last_change":"2023-09-23T08:54:52.080482+0000","last_active":"2023-09-23T08:55:23.431996+0000","last_peered":"2023-09-23T08:55:23.431996+0000","last_clean":"2023-09-23T08:55:23.431996+0000","last_became_active":"2023-09-23T08:54:52.079756+0000","last_became_peered":"2023-09-23T08:54:52.079756+0000","last_unstale":"2023-09-23T08:55:23.431996+0000","last_undegraded":"2023-09-23T08:55:23.431996+0000","last_fullsized":"2023-09-23T08:55:23.431996+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:55:32.242149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"88'9","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.089453+0000","last_change":"2023-09-23T08:54:53.092828+0000","last_active":"2023-09-23T08:56:22.089453+0000","last_peered":"2023-09-23T08:56:22.089453+0000","last_clean":"2023-09-23T08:56:22.089453+0000","last_became_active":"2023-09-23T08:54:53.092486+0000","last_became_peered":"2023-09-23T08:54:53.092486+0000","last_unstale":"2023-09-23T08:56:22.089453+0000","last_undegraded":"2023-09-23T08:56:22.089453+0000","last_fullsized":"2023-09-23T08:56:22.089453+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T13:54:09.634679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"88'12","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:25.825380+0000","last_change":"2023-09-23T08:54:52.081801+0000","last_active":"2023-09-23T08:56:25.825380+0000","last_peered":"2023-09-23T08:56:25.825380+0000","last_clean":"2023-09-23T08:56:25.825380+0000","last_became_active":"2023-09-23T08:54:52.081449+0000","last_became_peered":"2023-09-23T08:54:52.081449+0000","last_unstale":"2023-09-23T08:56:25.825380+0000","last_undegraded":"2023-09-23T08:56:25.825380+0000","last_fullsized":"2023-09-23T08:56:25.825380+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T14:36:52.210295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"88'5","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.091904+0000","last_change":"2023-09-23T08:54:53.101037+0000","last_active":"2023-09-23T08:56:22.091904+0000","last_peered":"2023-09-23T08:56:22.091904+0000","last_clean":"2023-09-23T08:56:22.091904+0000","last_became_active":"2023-09-23T08:54:53.100673+0000","last_became_peered":"2023-09-23T08:54:53.100673+0000","last_unstale":"2023-09-23T08:56:22.091904+0000","last_undegraded":"2023-09-23T08:56:22.091904+0000","last_fullsized":"2023-09-23T08:56:22.091904+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:11:55.146162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"86'7","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.533765+0000","last_change":"2023-09-23T08:54:52.077785+0000","last_active":"2023-09-23T08:55:23.533765+0000","last_peered":"2023-09-23T08:55:23.533765+0000","last_clean":"2023-09-23T08:55:23.533765+0000","last_became_active":"2023-09-23T08:54:52.077306+0000","last_became_peered":"2023-09-23T08:54:52.077306+0000","last_unstale":"2023-09-23T08:55:23.533765+0000","last_undegraded":"2023-09-23T08:55:23.533765+0000","last_fullsized":"2023-09-23T08:55:23.533765+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T18:21:25.957376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"88'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.092590+0000","last_change":"2023-09-23T08:54:53.106534+0000","last_active":"2023-09-23T08:56:22.092590+0000","last_peered":"2023-09-23T08:56:22.092590+0000","last_clean":"2023-09-23T08:56:22.092590+0000","last_became_active":"2023-09-23T08:54:53.105928+0000","last_became_peered":"2023-09-23T08:54:53.105928+0000","last_unstale":"2023-09-23T08:56:22.092590+0000","last_undegraded":"2023-09-23T08:56:22.092590+0000","last_fullsized":"2023-09-23T08:56:22.092590+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:25:27.390043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.444909+0000","last_change":"2023-09-23T08:55:23.444909+0000","last_active":"2023-09-23T08:55:23.444909+0000","last_peered":"2023-09-23T08:55:23.444909+0000","last_clean":"2023-09-23T08:55:23.444909+0000","last_became_active":"2023-09-23T08:55:23.440885+0000","last_became_peered":"2023-09-23T08:55:23.440885+0000","last_unstale":"2023-09-23T08:55:23.444909+0000","last_undegraded":"2023-09-23T08:55:23.444909+0000","last_fullsized":"2023-09-23T08:55:23.444909+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T14:07:59.974769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"88'2","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.052548+0000","last_change":"2023-09-23T08:54:53.106050+0000","last_active":"2023-09-23T08:56:22.052548+0000","last_peered":"2023-09-23T08:56:22.052548+0000","last_clean":"2023-09-23T08:56:22.052548+0000","last_became_active":"2023-09-23T08:54:53.105729+0000","last_became_peered":"2023-09-23T08:54:53.105729+0000","last_unstale":"2023-09-23T08:56:22.052548+0000","last_undegraded":"2023-09-23T08:56:22.052548+0000","last_fullsized":"2023-09-23T08:56:22.052548+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:59:01.529109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"86'7","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.438306+0000","last_change":"2023-09-23T08:54:52.086019+0000","last_active":"2023-09-23T08:55:23.438306+0000","last_peered":"2023-09-23T08:55:23.438306+0000","last_clean":"2023-09-23T08:55:23.438306+0000","last_became_active":"2023-09-23T08:54:52.085688+0000","last_became_peered":"2023-09-23T08:54:52.085688+0000","last_unstale":"2023-09-23T08:55:23.438306+0000","last_undegraded":"2023-09-23T08:55:23.438306+0000","last_fullsized":"2023-09-23T08:55:23.438306+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T13:39:29.745763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"88'9","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.091491+0000","last_change":"2023-09-23T08:54:53.099533+0000","last_active":"2023-09-23T08:56:22.091491+0000","last_peered":"2023-09-23T08:56:22.091491+0000","last_clean":"2023-09-23T08:56:22.091491+0000","last_became_active":"2023-09-23T08:54:53.099192+0000","last_became_peered":"2023-09-23T08:54:53.099192+0000","last_unstale":"2023-09-23T08:56:22.091491+0000","last_undegraded":"2023-09-23T08:56:22.091491+0000","last_fullsized":"2023-09-23T08:56:22.091491+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:21:20.608655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"88'5","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:36.470170+0000","last_change":"2023-09-23T08:54:52.086258+0000","last_active":"2023-09-23T08:56:36.470170+0000","last_peered":"2023-09-23T08:56:36.470170+0000","last_clean":"2023-09-23T08:56:36.470170+0000","last_became_active":"2023-09-23T08:54:52.085935+0000","last_became_peered":"2023-09-23T08:54:52.085935+0000","last_unstale":"2023-09-23T08:56:36.470170+0000","last_undegraded":"2023-09-23T08:56:36.470170+0000","last_fullsized":"2023-09-23T08:56:36.470170+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:20:00.595412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"88'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.099984+0000","last_change":"2023-09-23T08:54:53.105176+0000","last_active":"2023-09-23T08:56:22.099984+0000","last_peered":"2023-09-23T08:56:22.099984+0000","last_clean":"2023-09-23T08:56:22.099984+0000","last_became_active":"2023-09-23T08:54:53.104794+0000","last_became_peered":"2023-09-23T08:54:53.104794+0000","last_unstale":"2023-09-23T08:56:22.099984+0000","last_undegraded":"2023-09-23T08:56:22.099984+0000","last_fullsized":"2023-09-23T08:56:22.099984+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:38:26.392477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.431709+0000","last_change":"2023-09-23T08:54:52.078596+0000","last_active":"2023-09-23T08:55:23.431709+0000","last_peered":"2023-09-23T08:55:23.431709+0000","last_clean":"2023-09-23T08:55:23.431709+0000","last_became_active":"2023-09-23T08:54:52.078310+0000","last_became_peered":"2023-09-23T08:54:52.078310+0000","last_unstale":"2023-09-23T08:55:23.431709+0000","last_undegraded":"2023-09-23T08:55:23.431709+0000","last_fullsized":"2023-09-23T08:55:23.431709+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T10:44:34.943157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"88'5","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.098797+0000","last_change":"2023-09-23T08:54:53.106368+0000","last_active":"2023-09-23T08:56:22.098797+0000","last_peered":"2023-09-23T08:56:22.098797+0000","last_clean":"2023-09-23T08:56:22.098797+0000","last_became_active":"2023-09-23T08:54:53.105977+0000","last_became_peered":"2023-09-23T08:54:53.105977+0000","last_unstale":"2023-09-23T08:56:22.098797+0000","last_undegraded":"2023-09-23T08:56:22.098797+0000","last_fullsized":"2023-09-23T08:56:22.098797+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T14:38:50.938221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"88'6","reported_seq":126,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:37.679550+0000","last_change":"2023-09-23T08:54:52.089221+0000","last_active":"2023-09-23T08:56:37.679550+0000","last_peered":"2023-09-23T08:56:37.679550+0000","last_clean":"2023-09-23T08:56:37.679550+0000","last_became_active":"2023-09-23T08:54:52.088824+0000","last_became_peered":"2023-09-23T08:54:52.088824+0000","last_unstale":"2023-09-23T08:56:37.679550+0000","last_undegraded":"2023-09-23T08:56:37.679550+0000","last_fullsized":"2023-09-23T08:56:37.679550+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T11:18:12.157604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1653,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":102,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"88'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.099408+0000","last_change":"2023-09-23T08:54:53.107600+0000","last_active":"2023-09-23T08:56:22.099408+0000","last_peered":"2023-09-23T08:56:22.099408+0000","last_clean":"2023-09-23T08:56:22.099408+0000","last_became_active":"2023-09-23T08:54:53.105637+0000","last_became_peered":"2023-09-23T08:54:53.105637+0000","last_unstale":"2023-09-23T08:56:22.099408+0000","last_undegraded":"2023-09-23T08:56:22.099408+0000","last_fullsized":"2023-09-23T08:56:22.099408+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T13:51:08.460345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"86'3","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.431985+0000","last_change":"2023-09-23T08:54:52.081912+0000","last_active":"2023-09-23T08:55:23.431985+0000","last_peered":"2023-09-23T08:55:23.431985+0000","last_clean":"2023-09-23T08:55:23.431985+0000","last_became_active":"2023-09-23T08:54:52.081668+0000","last_became_peered":"2023-09-23T08:54:52.081668+0000","last_unstale":"2023-09-23T08:55:23.431985+0000","last_undegraded":"2023-09-23T08:55:23.431985+0000","last_fullsized":"2023-09-23T08:55:23.431985+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:38:42.963347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"88'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.091654+0000","last_change":"2023-09-23T08:54:53.106975+0000","last_active":"2023-09-23T08:56:22.091654+0000","last_peered":"2023-09-23T08:56:22.091654+0000","last_clean":"2023-09-23T08:56:22.091654+0000","last_became_active":"2023-09-23T08:54:53.106537+0000","last_became_peered":"2023-09-23T08:54:53.106537+0000","last_unstale":"2023-09-23T08:56:22.091654+0000","last_undegraded":"2023-09-23T08:56:22.091654+0000","last_fullsized":"2023-09-23T08:56:22.091654+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T11:16:12.417441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"86'5","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.539010+0000","last_change":"2023-09-23T08:55:23.539010+0000","last_active":"2023-09-23T08:55:23.539010+0000","last_peered":"2023-09-23T08:55:23.539010+0000","last_clean":"2023-09-23T08:55:23.539010+0000","last_became_active":"2023-09-23T08:55:23.534858+0000","last_became_peered":"2023-09-23T08:55:23.534858+0000","last_unstale":"2023-09-23T08:55:23.539010+0000","last_undegraded":"2023-09-23T08:55:23.539010+0000","last_fullsized":"2023-09-23T08:55:23.539010+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T12:04:40.067871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"88'9","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.088734+0000","last_change":"2023-09-23T08:54:53.109625+0000","last_active":"2023-09-23T08:56:22.088734+0000","last_peered":"2023-09-23T08:56:22.088734+0000","last_clean":"2023-09-23T08:56:22.088734+0000","last_became_active":"2023-09-23T08:54:53.109323+0000","last_became_peered":"2023-09-23T08:54:53.109323+0000","last_unstale":"2023-09-23T08:56:22.088734+0000","last_undegraded":"2023-09-23T08:56:22.088734+0000","last_fullsized":"2023-09-23T08:56:22.088734+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T12:38:52.169862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"88'9","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.092147+0000","last_change":"2023-09-23T08:55:23.438659+0000","last_active":"2023-09-23T08:56:22.092147+0000","last_peered":"2023-09-23T08:56:22.092147+0000","last_clean":"2023-09-23T08:56:22.092147+0000","last_became_active":"2023-09-23T08:55:23.438227+0000","last_became_peered":"2023-09-23T08:55:23.438227+0000","last_unstale":"2023-09-23T08:56:22.092147+0000","last_undegraded":"2023-09-23T08:56:22.092147+0000","last_fullsized":"2023-09-23T08:56:22.092147+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:03:51.636352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"88'12","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.085926+0000","last_change":"2023-09-23T08:54:53.101001+0000","last_active":"2023-09-23T08:56:22.085926+0000","last_peered":"2023-09-23T08:56:22.085926+0000","last_clean":"2023-09-23T08:56:22.085926+0000","last_became_active":"2023-09-23T08:54:53.100315+0000","last_became_peered":"2023-09-23T08:54:53.100315+0000","last_unstale":"2023-09-23T08:56:22.085926+0000","last_undegraded":"2023-09-23T08:56:22.085926+0000","last_fullsized":"2023-09-23T08:56:22.085926+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T20:08:51.255938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"88'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.092225+0000","last_change":"2023-09-23T08:54:53.102855+0000","last_active":"2023-09-23T08:56:22.092225+0000","last_peered":"2023-09-23T08:56:22.092225+0000","last_clean":"2023-09-23T08:56:22.092225+0000","last_became_active":"2023-09-23T08:54:53.102495+0000","last_became_peered":"2023-09-23T08:54:53.102495+0000","last_unstale":"2023-09-23T08:56:22.092225+0000","last_undegraded":"2023-09-23T08:56:22.092225+0000","last_fullsized":"2023-09-23T08:56:22.092225+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T11:30:08.512122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"88'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.094014+0000","last_change":"2023-09-23T08:54:53.102063+0000","last_active":"2023-09-23T08:56:22.094014+0000","last_peered":"2023-09-23T08:56:22.094014+0000","last_clean":"2023-09-23T08:56:22.094014+0000","last_became_active":"2023-09-23T08:54:53.101734+0000","last_became_peered":"2023-09-23T08:54:53.101734+0000","last_unstale":"2023-09-23T08:56:22.094014+0000","last_undegraded":"2023-09-23T08:56:22.094014+0000","last_fullsized":"2023-09-23T08:56:22.094014+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T18:20:09.964230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"88'4","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.085117+0000","last_change":"2023-09-23T08:54:53.110291+0000","last_active":"2023-09-23T08:56:22.085117+0000","last_peered":"2023-09-23T08:56:22.085117+0000","last_clean":"2023-09-23T08:56:22.085117+0000","last_became_active":"2023-09-23T08:54:53.109962+0000","last_became_peered":"2023-09-23T08:54:53.109962+0000","last_unstale":"2023-09-23T08:56:22.085117+0000","last_undegraded":"2023-09-23T08:56:22.085117+0000","last_fullsized":"2023-09-23T08:56:22.085117+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T13:59:01.304290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"88'6","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.084223+0000","last_change":"2023-09-23T08:54:53.104278+0000","last_active":"2023-09-23T08:56:22.084223+0000","last_peered":"2023-09-23T08:56:22.084223+0000","last_clean":"2023-09-23T08:56:22.084223+0000","last_became_active":"2023-09-23T08:54:53.103765+0000","last_became_peered":"2023-09-23T08:54:53.103765+0000","last_unstale":"2023-09-23T08:56:22.084223+0000","last_undegraded":"2023-09-23T08:56:22.084223+0000","last_fullsized":"2023-09-23T08:56:22.084223+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:27:28.306515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"88'15","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.098180+0000","last_change":"2023-09-23T08:54:53.104861+0000","last_active":"2023-09-23T08:56:22.098180+0000","last_peered":"2023-09-23T08:56:22.098180+0000","last_clean":"2023-09-23T08:56:22.098180+0000","last_became_active":"2023-09-23T08:54:53.104554+0000","last_became_peered":"2023-09-23T08:54:53.104554+0000","last_unstale":"2023-09-23T08:56:22.098180+0000","last_undegraded":"2023-09-23T08:56:22.098180+0000","last_fullsized":"2023-09-23T08:56:22.098180+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:22:47.174867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"88'2","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.096180+0000","last_change":"2023-09-23T08:54:53.106859+0000","last_active":"2023-09-23T08:56:22.096180+0000","last_peered":"2023-09-23T08:56:22.096180+0000","last_clean":"2023-09-23T08:56:22.096180+0000","last_became_active":"2023-09-23T08:54:53.106494+0000","last_became_peered":"2023-09-23T08:54:53.106494+0000","last_unstale":"2023-09-23T08:56:22.096180+0000","last_undegraded":"2023-09-23T08:56:22.096180+0000","last_fullsized":"2023-09-23T08:56:22.096180+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T18:25:26.029504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"88'6","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.091618+0000","last_change":"2023-09-23T08:54:53.101591+0000","last_active":"2023-09-23T08:56:22.091618+0000","last_peered":"2023-09-23T08:56:22.091618+0000","last_clean":"2023-09-23T08:56:22.091618+0000","last_became_active":"2023-09-23T08:54:53.101237+0000","last_became_peered":"2023-09-23T08:54:53.101237+0000","last_unstale":"2023-09-23T08:56:22.091618+0000","last_undegraded":"2023-09-23T08:56:22.091618+0000","last_fullsized":"2023-09-23T08:56:22.091618+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T11:22:22.863330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"88'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.089724+0000","last_change":"2023-09-23T08:54:53.103373+0000","last_active":"2023-09-23T08:56:22.089724+0000","last_peered":"2023-09-23T08:56:22.089724+0000","last_clean":"2023-09-23T08:56:22.089724+0000","last_became_active":"2023-09-23T08:54:53.102948+0000","last_became_peered":"2023-09-23T08:54:53.102948+0000","last_unstale":"2023-09-23T08:56:22.089724+0000","last_undegraded":"2023-09-23T08:56:22.089724+0000","last_fullsized":"2023-09-23T08:56:22.089724+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:39:31.898539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"88'10","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.100654+0000","last_change":"2023-09-23T08:54:53.100488+0000","last_active":"2023-09-23T08:56:22.100654+0000","last_peered":"2023-09-23T08:56:22.100654+0000","last_clean":"2023-09-23T08:56:22.100654+0000","last_became_active":"2023-09-23T08:54:53.100182+0000","last_became_peered":"2023-09-23T08:54:53.100182+0000","last_unstale":"2023-09-23T08:56:22.100654+0000","last_undegraded":"2023-09-23T08:56:22.100654+0000","last_fullsized":"2023-09-23T08:56:22.100654+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:13:20.648791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"88'11","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.086910+0000","last_change":"2023-09-23T08:54:53.097571+0000","last_active":"2023-09-23T08:56:22.086910+0000","last_peered":"2023-09-23T08:56:22.086910+0000","last_clean":"2023-09-23T08:56:22.086910+0000","last_became_active":"2023-09-23T08:54:53.097278+0000","last_became_peered":"2023-09-23T08:54:53.097278+0000","last_unstale":"2023-09-23T08:56:22.086910+0000","last_undegraded":"2023-09-23T08:56:22.086910+0000","last_fullsized":"2023-09-23T08:56:22.086910+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T11:32:37.554404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"88'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.096985+0000","last_change":"2023-09-23T08:54:53.113543+0000","last_active":"2023-09-23T08:56:22.096985+0000","last_peered":"2023-09-23T08:56:22.096985+0000","last_clean":"2023-09-23T08:56:22.096985+0000","last_became_active":"2023-09-23T08:54:53.113287+0000","last_became_peered":"2023-09-23T08:54:53.113287+0000","last_unstale":"2023-09-23T08:56:22.096985+0000","last_undegraded":"2023-09-23T08:56:22.096985+0000","last_fullsized":"2023-09-23T08:56:22.096985+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:56:48.219279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":67624,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1003,"num_read_kb":571,"num_write":258,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":211512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":223,"ondisk_log_size":223,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892351012,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":958464,"data_stored":460369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:55:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.68899999999999995,"15min":0.68500000000000005},"min":{"1min":0.497,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.752,"15min":0.74399999999999999},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":0.77500000000000002}]},{"osd":1,"last update":"Sat Sep 23 08:55:59 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.72099999999999997,"15min":0.70699999999999996},"min":{"1min":0.54800000000000004,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0269999999999999,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.76500000000000001,"15min":0.75700000000000001},"min":{"1min":0.59399999999999997,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.95599999999999996,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.91500000000000004}]},{"osd":2,"last update":"Sat Sep 23 08:55:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64700000000000002,"15min":0.64800000000000002},"min":{"1min":0.35999999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.98799999999999999,"5min":1.141,"15min":1.141},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.621,"5min":0.65700000000000003,"15min":0.66300000000000003},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.91000000000000003,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.63100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":4,"last update":"Sat Sep 23 08:55:59 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.79300000000000004,"15min":0.78000000000000003},"min":{"1min":0.59499999999999997,"5min":0.379,"15min":0.379},"max":{"1min":1.105,"5min":1.179,"15min":1.179},"last":0.98199999999999998},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.86899999999999999,"15min":0.872},"min":{"1min":0.63300000000000001,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.008,"5min":1.673,"15min":1.673},"last":0.96899999999999997}]},{"osd":5,"last update":"Sat Sep 23 08:55:59 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.79700000000000004,"15min":0.80300000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.075,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.78100000000000003,"15min":0.77700000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.0309999999999999,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.88500000000000001}]},{"osd":6,"last update":"Sat Sep 23 08:55:59 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.89500000000000002,"15min":0.90600000000000003},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.2909999999999999,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.755},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.90600000000000003,"15min":0.90800000000000003},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.2350000000000001,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":1.1040000000000001}]},{"osd":7,"last update":"Sat Sep 23 08:55:59 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.91800000000000004,"15min":0.91200000000000003},"min":{"1min":0.67200000000000004,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.228,"5min":1.25,"15min":1.25},"last":1.0680000000000001},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.69899999999999995,"5min":0.625,"15min":0.625},"max":{"1min":1.1899999999999999,"5min":1.74,"15min":1.74},"last":1.0189999999999999}]},{"osd":8,"last update":"Sat Sep 23 08:55:55 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":1.1200000000000001},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":1.0329999999999999}]},{"osd":9,"last update":"Sat Sep 23 08:55:59 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":0.98799999999999999,"15min":0.98499999999999999},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.3169999999999999,"5min":1.365,"15min":1.365},"last":1.002},{"interface":"front","average":{"1min":1.0429999999999999,"5min":0.96699999999999997,"15min":0.95399999999999996},"min":{"1min":0.71799999999999997,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":1.1359999999999999}]},{"osd":10,"last update":"Sat Sep 23 08:55:59 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.052,"15min":1.052},"min":{"1min":0.73399999999999999,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.274,"5min":2.3410000000000002,"15min":2.3410000000000002},"last":1.0880000000000001},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.0149999999999999,"15min":1.0089999999999999},"min":{"1min":0.748,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.3340000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":1.1519999999999999}]}]},{"osd":10,"up_from":73,"seq":313532612649,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28636,"kb_used_data":1620,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716516,"statfs":{"total":95995035648,"available":95965712384,"internally_reserved":0,"allocated":1658880,"data_stored":1110143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:55:52 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.8380000000000001,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.853,"5min":1.853,"15min":1.853},"last":0.75}]},{"osd":1,"last update":"Sat Sep 23 08:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.55300000000000005,"15min":0.56299999999999994},"min":{"1min":0.36499999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.77900000000000003,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.442},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.61799999999999999,"15min":0.621},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.88600000000000001,"5min":1.417,"15min":1.417},"last":0.42399999999999999}]},{"osd":2,"last update":"Sat Sep 23 08:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.752,"15min":0.76300000000000001},"min":{"1min":0.52700000000000002,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.996,"5min":1.214,"15min":1.214},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.754,"15min":0.76000000000000001},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.97899999999999998,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.79100000000000004}]},{"osd":3,"last update":"Sat Sep 23 08:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.80300000000000005,"15min":0.82299999999999995},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.7210000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.754,"5min":0.78700000000000003,"15min":0.79300000000000004},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.8899999999999999,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":0.72699999999999998}]},{"osd":4,"last update":"Sat Sep 23 08:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.67600000000000005,"15min":0.68700000000000006},"min":{"1min":0.45800000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.81200000000000006,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.74399999999999999,"15min":0.76800000000000002},"min":{"1min":0.42899999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.80300000000000005,"5min":1.448,"15min":1.448},"last":0.47899999999999998}]},{"osd":5,"last update":"Sat Sep 23 08:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.82399999999999995,"15min":0.82999999999999996},"min":{"1min":0.54300000000000004,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.089,"5min":1.423,"15min":1.423},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.877,"15min":0.89700000000000002},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.109,"5min":1.333,"15min":1.333},"last":0.76900000000000002}]},{"osd":6,"last update":"Sat Sep 23 08:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.88200000000000001,"15min":0.90000000000000002},"min":{"1min":0.55800000000000005,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.738,"5min":1.738,"15min":1.738},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.91100000000000003,"15min":0.92500000000000004},"min":{"1min":0.60799999999999998,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.8160000000000001,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.61799999999999999}]},{"osd":7,"last update":"Sat Sep 23 08:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.52500000000000002}]},{"osd":8,"last update":"Sat Sep 23 08:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.90900000000000003,"15min":0.92100000000000004},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.133,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.95999999999999996,"15min":0.98899999999999999},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.073,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":0.80900000000000005}]},{"osd":9,"last update":"Sat Sep 23 08:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.97999999999999998,"15min":0.99299999999999999},"min":{"1min":0.71899999999999997,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.7729999999999999,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.996,"15min":1.022},"min":{"1min":0.65800000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.794,"5min":1.794,"15min":1.794},"last":0.68100000000000005}]},{"osd":11,"last update":"Sat Sep 23 08:56:02 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.86499999999999999,"15min":0.87},"min":{"1min":0.68500000000000005,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.038,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.79200000000000004,"5min":0.626,"15min":0.626},"max":{"1min":1.0549999999999999,"5min":1.135,"15min":1.135},"last":0.85899999999999999}]}]},{"osd":9,"up_from":68,"seq":292057776173,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":983040,"data_stored":459816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:56:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.54800000000000004,"15min":0.53300000000000003},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":4.9619999999999997,"5min":4.9619999999999997,"15min":4.9619999999999997},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.56799999999999995,"15min":0.57199999999999995},"min":{"1min":0.35699999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":2.5299999999999998,"5min":2.5299999999999998,"15min":2.5299999999999998},"last":0.35499999999999998}]},{"osd":1,"last update":"Sat Sep 23 08:56:07 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.78100000000000003,"15min":0.79700000000000004},"min":{"1min":0.51800000000000002,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":3.4319999999999999,"5min":3.4319999999999999,"15min":3.4319999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.71499999999999997,"15min":0.74299999999999999},"min":{"1min":0.46700000000000003,"5min":0.375,"15min":0.375},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.68000000000000005}]},{"osd":2,"last update":"Sat Sep 23 08:56:07 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.78100000000000003,"15min":0.79600000000000004},"min":{"1min":0.52900000000000003,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":3.399,"5min":3.399,"15min":3.399},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.71599999999999997,"15min":0.748},"min":{"1min":0.47599999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.65200000000000002}]},{"osd":3,"last update":"Sat Sep 23 08:56:07 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.63300000000000001,"15min":0.64100000000000001},"min":{"1min":0.36399999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":2.5009999999999999,"5min":2.5009999999999999,"15min":2.5009999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.69399999999999995,"15min":0.69999999999999996},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":3.6000000000000001,"5min":3.6000000000000001,"15min":3.6000000000000001},"last":0.47899999999999998}]},{"osd":4,"last update":"Sat Sep 23 08:56:07 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.81599999999999995,"15min":0.82799999999999996},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":2.7879999999999998,"5min":2.7879999999999998,"15min":2.7879999999999998},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.84399999999999997,"15min":0.85599999999999998},"min":{"1min":0.59999999999999998,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":3.5579999999999998,"5min":3.5579999999999998,"15min":3.5579999999999998},"last":0.69099999999999995}]},{"osd":5,"last update":"Sat Sep 23 08:56:07 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.79700000000000004,"15min":0.81799999999999995},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":2.3999999999999999,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.85899999999999999,"15min":0.88100000000000001},"min":{"1min":0.56299999999999994,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":3.359,"5min":3.359,"15min":3.359},"last":0.66800000000000004}]},{"osd":6,"last update":"Sat Sep 23 08:56:07 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.71599999999999997,"15min":0.72199999999999998},"min":{"1min":0.45200000000000001,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":3.5169999999999999,"5min":3.5169999999999999,"15min":3.5169999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.755,"5min":0.79900000000000004,"15min":0.81399999999999995},"min":{"1min":0.46200000000000002,"5min":0.44,"15min":0.44},"max":{"1min":2.3599999999999999,"5min":2.3599999999999999,"15min":2.3599999999999999},"last":0.61699999999999999}]},{"osd":7,"last update":"Sat Sep 23 08:56:07 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.1160000000000001,"15min":1.1970000000000001},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":3.4940000000000002,"5min":7.0759999999999996,"15min":7.0759999999999996},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.84499999999999997,"15min":0.876},"min":{"1min":0.56899999999999995,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.74199999999999999}]},{"osd":8,"last update":"Sat Sep 23 08:56:07 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.84499999999999997,"15min":0.88100000000000001},"min":{"1min":0.60199999999999998,"5min":0.501,"15min":0.501},"max":{"1min":1.1919999999999999,"5min":1.226,"15min":1.226},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.90000000000000002,"15min":0.92400000000000004},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":2.4319999999999999,"5min":2.4319999999999999,"15min":2.4319999999999999},"last":0.753}]},{"osd":10,"last update":"Sat Sep 23 08:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.70199999999999996,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.6299999999999999,"5min":3.4630000000000001,"15min":3.4630000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.89300000000000002,"15min":0.91500000000000004},"min":{"1min":0.69099999999999995,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.456,"5min":1.456,"15min":1.456},"last":0.71999999999999997}]}]},{"osd":8,"up_from":60,"seq":257698037810,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":970752,"data_stored":459522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.68700000000000006,"15min":0.68899999999999995},"min":{"1min":0.45100000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.67800000000000005,"15min":0.68999999999999995},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.58299999999999996}]},{"osd":1,"last update":"Sat Sep 23 08:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.82299999999999995,"15min":0.81399999999999995},"min":{"1min":0.54100000000000004,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.754,"15min":0.746},"min":{"1min":0.59599999999999997,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.61699999999999999}]},{"osd":2,"last update":"Sat Sep 23 08:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.61299999999999999,"15min":0.60699999999999998},"min":{"1min":0.38300000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.59899999999999998,"15min":0.58899999999999997},"min":{"1min":0.432,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.85399999999999998,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.83399999999999996}]},{"osd":3,"last update":"Sat Sep 23 08:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.747,"15min":0.78100000000000003},"min":{"1min":0.54500000000000004,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.96099999999999997,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.81899999999999995,"15min":0.82999999999999996},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.97399999999999998,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.77000000000000002}]},{"osd":4,"last update":"Sat Sep 23 08:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.80100000000000005,"15min":0.80400000000000005},"min":{"1min":0.56299999999999994,"5min":0.439,"15min":0.439},"max":{"1min":1.024,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.96199999999999997,"15min":1},"min":{"1min":0.627,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.181,"5min":3.7530000000000001,"15min":3.7530000000000001},"last":0.875}]},{"osd":5,"last update":"Sat Sep 23 08:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.70799999999999996,"15min":0.71399999999999997},"min":{"1min":0.51100000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.995,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.76000000000000001,"15min":0.77400000000000002},"min":{"1min":0.51000000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.0760000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.86299999999999999}]},{"osd":6,"last update":"Sat Sep 23 08:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.89900000000000002,"15min":0.90800000000000003},"min":{"1min":0.59399999999999997,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.871,"15min":0.878},"min":{"1min":0.66800000000000004,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":0.94199999999999995}]},{"osd":7,"last update":"Sat Sep 23 08:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.88400000000000001,"15min":0.88300000000000001},"min":{"1min":0.71599999999999997,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.1619999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":1.097},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.91300000000000003,"15min":0.92800000000000005},"min":{"1min":0.68600000000000005,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.258,"5min":1.679,"15min":1.679},"last":0.91400000000000003}]},{"osd":9,"last update":"Sat Sep 23 08:56:09 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.871,"15min":0.84499999999999997},"min":{"1min":0.69299999999999995,"5min":0.498,"15min":0.498},"max":{"1min":1.333,"5min":1.333,"15min":1.333},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.89400000000000002,"15min":0.88400000000000001},"min":{"1min":0.69599999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.349,"5min":1.349,"15min":1.349},"last":1.0189999999999999}]},{"osd":10,"last update":"Sat Sep 23 08:56:35 2023","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":0.90300000000000002,"15min":0.85299999999999998},"min":{"1min":0.72699999999999998,"5min":0.629,"15min":0.629},"max":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.95799999999999996},{"interface":"front","average":{"1min":1.0700000000000001,"5min":0.94899999999999995,"15min":0.90000000000000002},"min":{"1min":0.85399999999999998,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":1.002}]},{"osd":11,"last update":"Sat Sep 23 08:55:56 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":1.0609999999999999},{"interface":"front","average":{"1min":1.111,"5min":1.111,"15min":1.111},"min":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":1.044}]}]},{"osd":7,"up_from":52,"seq":223338299448,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28548,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716604,"statfs":{"total":95995035648,"available":95965802496,"internally_reserved":0,"allocated":1568768,"data_stored":1054234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:54:15 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.627,"15min":0.621},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.59799999999999998,"15min":0.58599999999999997},"min":{"1min":0.48399999999999999,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.53800000000000003}]},{"osd":1,"last update":"Sat Sep 23 08:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.51200000000000001,"15min":0.51000000000000001},"min":{"1min":0.34300000000000003,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.67300000000000004,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.53800000000000003,"15min":0.53600000000000003},"min":{"1min":0.38900000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.86299999999999999,"5min":0.999,"15min":0.999},"last":0.71499999999999997}]},{"osd":2,"last update":"Sat Sep 23 08:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.747,"15min":0.747},"min":{"1min":0.51700000000000002,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.998,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.745},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72899999999999998,"15min":0.73099999999999998},"min":{"1min":0.59699999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.86399999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.997}]},{"osd":3,"last update":"Sat Sep 23 08:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.66800000000000004,"15min":0.66300000000000003},"min":{"1min":0.48399999999999999,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.88500000000000001,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.71099999999999997,"15min":0.72499999999999998},"min":{"1min":0.501,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.80500000000000005}]},{"osd":4,"last update":"Sat Sep 23 08:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.68500000000000005,"15min":0.70699999999999996},"min":{"1min":0.47299999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.95599999999999996,"5min":1.04,"15min":1.04},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.65000000000000002,"15min":0.68600000000000005},"min":{"1min":0.42799999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.72699999999999998,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.54800000000000004}]},{"osd":5,"last update":"Sat Sep 23 08:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.80600000000000005,"15min":0.80800000000000005},"min":{"1min":0.63800000000000001,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.0169999999999999,"5min":1.089,"15min":1.089},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.79000000000000004,"15min":0.80600000000000005},"min":{"1min":0.54500000000000004,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.98299999999999998,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.92400000000000004}]},{"osd":6,"last update":"Sat Sep 23 08:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.81200000000000006,"15min":0.82599999999999996},"min":{"1min":0.55300000000000005,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0069999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.80000000000000004,"15min":0.82099999999999995},"min":{"1min":0.63100000000000001,"5min":0.502,"15min":0.502},"max":{"1min":1.0449999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.69399999999999995}]},{"osd":8,"last update":"Sat Sep 23 08:55:39 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.84199999999999997,"15min":0.81999999999999995},"min":{"1min":0.65800000000000003,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.88},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.84199999999999997,"15min":0.83799999999999997},"min":{"1min":0.64900000000000002,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.0580000000000001,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":1.0369999999999999}]},{"osd":9,"last update":"Sat Sep 23 08:56:05 2023","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":0.91100000000000003,"15min":0.872},"min":{"1min":0.67600000000000005,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":4.9400000000000004,"5min":4.9400000000000004,"15min":4.9400000000000004},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.84599999999999997,"15min":0.84899999999999998},"min":{"1min":0.61899999999999999,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.96499999999999997,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.78500000000000003}]},{"osd":10,"last update":"Sat Sep 23 08:55:36 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.874,"15min":0.88},"min":{"1min":0.60699999999999998,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.01,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":1.0640000000000001},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.89800000000000002,"15min":0.90600000000000003},"min":{"1min":0.67700000000000005,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":0.98799999999999999,"5min":1.117,"15min":1.117},"last":0.96899999999999997}]},{"osd":11,"last update":"Sat Sep 23 08:55:56 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":1.087},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.98499999999999999}]}]},{"osd":6,"up_from":47,"seq":201863462975,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":966656,"data_stored":460022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:55:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.46800000000000003,"15min":0.44},"min":{"1min":0.33300000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.49299999999999999,"15min":0.47099999999999997},"min":{"1min":0.33300000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.52600000000000002}]},{"osd":1,"last update":"Sat Sep 23 08:55:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.67500000000000004,"15min":0.63300000000000001},"min":{"1min":0.442,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.70899999999999996,"15min":0.66900000000000004},"min":{"1min":0.53400000000000003,"5min":0.498,"15min":0.498},"max":{"1min":1.637,"5min":1.637,"15min":1.637},"last":0.82199999999999995}]},{"osd":2,"last update":"Sat Sep 23 08:55:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68200000000000005,"15min":0.66400000000000003},"min":{"1min":0.496,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.71499999999999997,"15min":0.69299999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0760000000000001,"5min":1.143,"15min":1.143},"last":0.55000000000000004}]},{"osd":3,"last update":"Sat Sep 23 08:55:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.58999999999999997,"15min":0.57999999999999996},"min":{"1min":0.38300000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.624,"5min":0.61799999999999999,"15min":0.60199999999999998},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.433}]},{"osd":4,"last update":"Sat Sep 23 08:55:47 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.71899999999999997,"15min":0.71699999999999997},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.75800000000000001,"15min":0.73399999999999999},"min":{"1min":0.498,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.77200000000000002}]},{"osd":5,"last update":"Sat Sep 23 08:55:47 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.76400000000000001,"15min":0.72999999999999998},"min":{"1min":0.49199999999999999,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.76700000000000002,"15min":0.76100000000000001},"min":{"1min":0.56100000000000005,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.5820000000000001,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.626}]},{"osd":7,"last update":"Sat Sep 23 08:56:17 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.81399999999999995,"15min":0.76100000000000001},"min":{"1min":0.56799999999999995,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.85399999999999998,"15min":0.80200000000000005},"min":{"1min":0.58999999999999997,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":4.6070000000000002,"5min":4.6070000000000002,"15min":4.6070000000000002},"last":0.83899999999999997}]},{"osd":8,"last update":"Sat Sep 23 08:55:47 2023","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.90700000000000003,"15min":0.90400000000000003},"min":{"1min":0.58999999999999997,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":5.2350000000000003,"5min":5.2350000000000003,"15min":5.2350000000000003},"last":0.61899999999999999},{"interface":"front","average":{"1min":1.0129999999999999,"5min":0.90800000000000003,"15min":0.89300000000000002},"min":{"1min":0.58799999999999997,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":4.5880000000000001,"5min":4.5880000000000001,"15min":4.5880000000000001},"last":0.51300000000000001}]},{"osd":9,"last update":"Sat Sep 23 08:56:08 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.876,"15min":0.90900000000000003},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.7170000000000001,"5min":1.7170000000000001,"15min":1.7170000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.89200000000000002,"15min":0.91900000000000004},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.764,"5min":1.764,"15min":1.764},"last":0.60899999999999999}]},{"osd":10,"last update":"Sat Sep 23 08:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.93899999999999995,"15min":0.95699999999999996},"min":{"1min":0.70599999999999996,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.0669999999999999,"5min":1.669,"15min":1.669},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.92800000000000005,"15min":0.95999999999999996},"min":{"1min":0.64700000000000002,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.1699999999999999,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.753}]}]},{"osd":1,"up_from":13,"seq":55834574935,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1036288,"data_stored":523856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:55:45 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58699999999999997,"15min":0.55800000000000005},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.61299999999999999,"15min":0.58899999999999997},"min":{"1min":0.32300000000000001,"5min":0.314,"15min":0.314},"max":{"1min":1.0069999999999999,"5min":1.02,"15min":1.02},"last":0.76000000000000001}]},{"osd":2,"last update":"Sat Sep 23 08:56:13 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.74099999999999999,"15min":0.71099999999999997},"min":{"1min":0.47999999999999998,"5min":0.47299999999999998,"15min":0.45900000000000002},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.74399999999999999,"15min":0.70399999999999996},"min":{"1min":0.60799999999999998,"5min":0.45700000000000002,"15min":0.44800000000000001},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.86199999999999999}]},{"osd":3,"last update":"Sat Sep 23 08:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67600000000000005,"15min":0.65300000000000002},"min":{"1min":0.46200000000000002,"5min":0.436,"15min":0.436},"max":{"1min":0.98099999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66400000000000003,"15min":0.64200000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.88200000000000001,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.47299999999999998}]},{"osd":4,"last update":"Sat Sep 23 08:55:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.54600000000000004,"15min":0.49399999999999999},"min":{"1min":0.44600000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.57799999999999996,"15min":0.52600000000000002},"min":{"1min":0.46800000000000003,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.97099999999999997,"5min":1.022,"15min":1.022},"last":0.82899999999999996}]},{"osd":5,"last update":"Sat Sep 23 08:55:32 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.76500000000000001,"15min":0.73599999999999999},"min":{"1min":0.59399999999999997,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.873},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.73499999999999999,"15min":0.70999999999999996},"min":{"1min":0.57699999999999996,"5min":0.505,"15min":0.505},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.89400000000000002}]},{"osd":6,"last update":"Sat Sep 23 08:55:47 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.76900000000000002,"15min":0.74099999999999999},"min":{"1min":0.57799999999999996,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":3.7120000000000002,"5min":3.7120000000000002,"15min":3.7120000000000002},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.751,"15min":0.70999999999999996},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":3.7229999999999999,"5min":3.7229999999999999,"15min":3.7229999999999999},"last":0.78700000000000003}]},{"osd":7,"last update":"Sat Sep 23 08:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.71099999999999997,"15min":0.69899999999999995},"min":{"1min":0.5,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.80400000000000005,"15min":0.78200000000000003},"min":{"1min":0.622,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.93400000000000005}]},{"osd":8,"last update":"Sat Sep 23 08:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.79300000000000004,"15min":0.755},"min":{"1min":0.64500000000000002,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.2110000000000001,"5min":2.8010000000000002,"15min":2.8010000000000002},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.79800000000000004,"15min":0.77200000000000002},"min":{"1min":0.70099999999999996,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.117,"5min":1.165,"15min":1.165},"last":0.81299999999999994}]},{"osd":9,"last update":"Sat Sep 23 08:56:13 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.85899999999999999,"15min":0.83999999999999997},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.88800000000000001,"15min":0.86099999999999999},"min":{"1min":0.79400000000000004,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":1.0109999999999999}]},{"osd":10,"last update":"Sat Sep 23 08:55:32 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.82999999999999996,"15min":0.82399999999999995},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.042,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.86499999999999999,"15min":0.85899999999999999},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":1.1319999999999999}]},{"osd":11,"last update":"Sat Sep 23 08:55:52 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.997},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":1.216}]}]},{"osd":0,"up_from":8,"seq":34359738461,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":983040,"data_stored":461082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 23 08:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.626,"15min":0.59399999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39300000000000002},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.73599999999999999,"15min":0.64700000000000002},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.36799999999999999},"max":{"1min":0.86299999999999999,"5min":5.7450000000000001,"15min":5.7450000000000001},"last":0.68500000000000005}]},{"osd":2,"last update":"Sat Sep 23 08:56:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.65100000000000002,"15min":0.64500000000000002},"min":{"1min":0.49299999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.88700000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.64300000000000002,"15min":0.63900000000000001},"min":{"1min":0.40300000000000002,"5min":0.373,"15min":0.373},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":0.63600000000000001}]},{"osd":3,"last update":"Sat Sep 23 08:55:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.7070000000000001,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.52200000000000002}]},{"osd":4,"last update":"Sat Sep 23 08:55:58 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.71699999999999997,"15min":0.64700000000000002},"min":{"1min":0.52300000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.90500000000000003,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.72699999999999998,"15min":0.66600000000000004},"min":{"1min":0.49299999999999999,"5min":0.435,"15min":0.435},"max":{"1min":0.879,"5min":5.6710000000000003,"15min":5.6710000000000003},"last":0.66600000000000004}]},{"osd":5,"last update":"Sat Sep 23 08:56:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.70399999999999996,"15min":0.69199999999999995},"min":{"1min":0.52600000000000002,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.92400000000000004,"5min":0.996,"15min":0.996},"last":0.755},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.73199999999999998,"15min":0.70599999999999996},"min":{"1min":0.62,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.96599999999999997,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.71799999999999997}]},{"osd":6,"last update":"Sat Sep 23 08:55:58 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.71099999999999997,"15min":0.70099999999999996},"min":{"1min":0.55100000000000005,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.9239999999999999,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73599999999999999,"15min":0.73499999999999999},"min":{"1min":0.438,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.823,"5min":1.823,"15min":1.823},"last":0.70599999999999996}]},{"osd":7,"last update":"Sat Sep 23 08:54:14 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.77300000000000002,"15min":0.77900000000000003},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.0489999999999999,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.875,"5min":0.84599999999999997,"15min":0.84099999999999997},"min":{"1min":0.63500000000000001,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.81799999999999995}]},{"osd":8,"last update":"Sat Sep 23 08:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.82799999999999996,"15min":0.84799999999999998},"min":{"1min":0.58799999999999997,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.80300000000000005,"15min":0.81699999999999995},"min":{"1min":0.60399999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.84799999999999998}]},{"osd":9,"last update":"Sat Sep 23 08:56:12 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.83999999999999997,"15min":0.872},"min":{"1min":0.49099999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.966,"5min":1.966,"15min":1.966},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.83699999999999997,"15min":0.88100000000000001},"min":{"1min":0.47399999999999998,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.333,"5min":1.333,"15min":1.333},"last":0.61599999999999999}]},{"osd":10,"last update":"Sat Sep 23 08:56:35 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.79600000000000004,"15min":0.80200000000000005},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.98799999999999999,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.90700000000000003,"15min":0.92900000000000005},"min":{"1min":0.68000000000000005,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.0069999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.74199999999999999}]},{"osd":11,"last update":"Sat Sep 23 08:56:01 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.82299999999999995,"15min":0.81499999999999995},"min":{"1min":0.69099999999999995,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.659,"5min":1.659,"15min":1.659},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.88300000000000001,"15min":0.88},"min":{"1min":0.79100000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.2130000000000001,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.83699999999999997}]}]},{"osd":2,"up_from":18,"seq":77309411410,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1052672,"data_stored":524691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:56:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.61699999999999999,"15min":0.61499999999999999},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.59999999999999998,"15min":0.61699999999999999},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.98799999999999999,"5min":1.004,"15min":1.196},"last":0.65900000000000003}]},{"osd":1,"last update":"Sat Sep 23 08:56:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.46899999999999997,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.95699999999999996,"5min":0.98399999999999999,"15min":1.177},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.72599999999999998,"15min":0.68600000000000005},"min":{"1min":0.46400000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.3100000000000001},"last":0.80800000000000005}]},{"osd":3,"last update":"Sat Sep 23 08:56:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72799999999999998,"15min":0.72199999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.083},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.70199999999999996,"15min":0.68799999999999994},"min":{"1min":0.48099999999999998,"5min":0.38,"15min":0.38},"max":{"1min":1.0269999999999999,"5min":1.129,"15min":1.129},"last":0.77500000000000002}]},{"osd":4,"last update":"Sat Sep 23 08:55:52 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.85999999999999999}]},{"osd":5,"last update":"Sat Sep 23 08:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.64300000000000002,"15min":0.57399999999999995},"min":{"1min":0.54700000000000004,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.98999999999999999,"5min":1.04,"15min":1.04},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.60299999999999998,"15min":0.54700000000000004},"min":{"1min":0.52300000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.93700000000000006,"5min":1.085,"15min":1.085},"last":0.61499999999999999}]},{"osd":6,"last update":"Sat Sep 23 08:55:52 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.77200000000000002,"15min":0.73899999999999999},"min":{"1min":0.58999999999999997,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.1060000000000001,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.72999999999999998,"15min":0.70099999999999996},"min":{"1min":0.59999999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.84699999999999998}]},{"osd":7,"last update":"Sat Sep 23 08:54:12 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.75,"15min":0.75},"min":{"1min":0.61399999999999999,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.93999999999999995,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.81699999999999995,"15min":0.81999999999999995},"min":{"1min":0.56299999999999994,"5min":0.501,"15min":0.501},"max":{"1min":1.006,"5min":1.129,"15min":1.129},"last":0.82199999999999995}]},{"osd":8,"last update":"Sat Sep 23 08:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.753,"15min":0.74199999999999999},"min":{"1min":0.61299999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.752,"5min":0.73099999999999998,"15min":0.72899999999999998},"min":{"1min":0.60499999999999998,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.91400000000000003}]},{"osd":9,"last update":"Sat Sep 23 08:56:08 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":0.873,"15min":0.84399999999999997},"min":{"1min":0.70299999999999996,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":4.0810000000000004,"5min":4.0810000000000004,"15min":4.0810000000000004},"last":0.752},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.878,"15min":0.874},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.88300000000000001}]},{"osd":10,"last update":"Sat Sep 23 08:56:34 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.88400000000000001,"15min":0.86699999999999999},"min":{"1min":0.73999999999999999,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.0640000000000001,"5min":1.157,"15min":1.157},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.91800000000000004,"15min":0.90300000000000002},"min":{"1min":0.61199999999999999,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.93200000000000005}]},{"osd":11,"last update":"Sat Sep 23 08:55:52 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.79600000000000004}]}]},{"osd":3,"up_from":26,"seq":111669149772,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":974848,"data_stored":458766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.46800000000000003,"15min":0.40600000000000003},"min":{"1min":0.314,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":2.294,"5min":2.294,"15min":2.294},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.48499999999999999,"15min":0.42799999999999999},"min":{"1min":0.35299999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":0.42099999999999999}]},{"osd":1,"last update":"Sat Sep 23 08:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.71699999999999997,"15min":0.629},"min":{"1min":0.53500000000000003,"5min":0.434,"15min":0.434},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.69399999999999995,"15min":0.63700000000000001},"min":{"1min":0.502,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.91400000000000003}]},{"osd":2,"last update":"Sat Sep 23 08:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.69899999999999995,"15min":0.65400000000000003},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.72399999999999998,"15min":0.66800000000000004},"min":{"1min":0.496,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.76200000000000001}]},{"osd":4,"last update":"Sat Sep 23 08:56:06 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.70999999999999996,"15min":0.66400000000000003},"min":{"1min":0.46999999999999997,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.1919999999999999,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.71999999999999997,"15min":0.66400000000000003},"min":{"1min":0.47499999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.3799999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.90000000000000002}]},{"osd":5,"last update":"Sat Sep 23 08:56:30 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.79000000000000004,"15min":0.77200000000000002},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.78800000000000003,"15min":0.77000000000000002},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.93100000000000005}]},{"osd":6,"last update":"Sat Sep 23 08:55:52 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.65600000000000003,"15min":0.65200000000000002},"min":{"1min":0.43099999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":2.637,"5min":2.637,"15min":2.637},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69399999999999995,"15min":0.66900000000000004},"min":{"1min":0.443,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.52700000000000002}]},{"osd":7,"last update":"Sat Sep 23 08:56:18 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.80700000000000005,"15min":0.81299999999999994},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0780000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.875},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81799999999999995,"15min":0.83399999999999996},"min":{"1min":0.59799999999999998,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.78100000000000003}]},{"osd":8,"last update":"Sat Sep 23 08:54:43 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.89200000000000002,"15min":0.90300000000000002},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.0660000000000001,"5min":1.093,"15min":1.093},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.86699999999999999,"15min":0.87},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.66000000000000003}]},{"osd":9,"last update":"Sat Sep 23 08:56:06 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.81299999999999994,"15min":0.82399999999999995},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":2.2050000000000001,"5min":2.2050000000000001,"15min":2.2050000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.89200000000000002,"15min":0.92400000000000004},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":2.258,"5min":2.258,"15min":2.258},"last":0.57699999999999996}]},{"osd":10,"last update":"Sat Sep 23 08:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.88700000000000001,"15min":0.88100000000000001},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.755},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.91100000000000003,"15min":0.91000000000000003},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.86299999999999999}]},{"osd":11,"last update":"Sat Sep 23 08:55:52 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.88600000000000001}]}]},{"osd":4,"up_from":34,"seq":146028888137,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":966656,"data_stored":460408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:53:55 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.628,"15min":0.624},"min":{"1min":0.45300000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.86199999999999999,"5min":1.042,"15min":1.042},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.622,"5min":0.60699999999999998,"15min":0.60899999999999999},"min":{"1min":0.434,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.93300000000000005,"5min":1.008,"15min":1.008},"last":0.38300000000000001}]},{"osd":1,"last update":"Sat Sep 23 08:55:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.46200000000000002,"15min":0.44700000000000001},"min":{"1min":0.39400000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.495,"15min":0.47499999999999998},"min":{"1min":0.39200000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.65700000000000003,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.48699999999999999}]},{"osd":2,"last update":"Sat Sep 23 08:55:59 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.73499999999999999,"15min":0.68000000000000005},"min":{"1min":0.59699999999999998,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.67000000000000004,"15min":0.65700000000000003},"min":{"1min":0.51100000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.96699999999999997,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.52200000000000002}]},{"osd":3,"last update":"Sat Sep 23 08:55:59 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.67500000000000004,"15min":0.64600000000000002},"min":{"1min":0.53300000000000003,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.74399999999999999,"15min":0.71499999999999997},"min":{"1min":0.56699999999999995,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.0800000000000001,"5min":1.238,"15min":1.238},"last":0.81899999999999995}]},{"osd":5,"last update":"Sat Sep 23 08:56:26 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.74199999999999999,"15min":0.65500000000000003},"min":{"1min":0.66200000000000003,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.77500000000000002,"15min":0.68200000000000005},"min":{"1min":0.67800000000000005,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.0189999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.65000000000000002}]},{"osd":6,"last update":"Sat Sep 23 08:55:53 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.82899999999999996,"15min":0.73699999999999999},"min":{"1min":0.67100000000000004,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.081,"5min":7.1829999999999998,"15min":7.1829999999999998},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.69999999999999996,"15min":0.69399999999999995},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.96899999999999997,"5min":1.127,"15min":1.127},"last":0.624}]},{"osd":7,"last update":"Sat Sep 23 08:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.68500000000000005,"15min":0.65300000000000002},"min":{"1min":0.627,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.94999999999999996,"5min":1.212,"15min":1.212},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.73699999999999999,"15min":0.70699999999999996},"min":{"1min":0.55200000000000005,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.97199999999999998,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.95099999999999996}]},{"osd":8,"last update":"Sat Sep 23 08:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.59899999999999998,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.94399999999999995,"5min":1.087,"15min":1.087},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.81399999999999995,"15min":0.78800000000000003},"min":{"1min":0.626,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.88700000000000001}]},{"osd":9,"last update":"Sat Sep 23 08:56:10 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.78700000000000003,"15min":0.80200000000000005},"min":{"1min":0.59599999999999997,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.1870000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.85999999999999999,"15min":0.85599999999999998},"min":{"1min":0.72899999999999998,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.98599999999999999}]},{"osd":10,"last update":"Sat Sep 23 08:56:35 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.90200000000000002,"15min":0.88400000000000001},"min":{"1min":0.79500000000000004,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":1.0489999999999999},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.93899999999999995,"15min":0.94899999999999995},"min":{"1min":0.68700000000000006,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.1100000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.91300000000000003}]},{"osd":11,"last update":"Sat Sep 23 08:55:53 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":1.0249999999999999},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.86199999999999999}]}]},{"osd":5,"up_from":39,"seq":167503724612,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28564,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716588,"statfs":{"total":95995035648,"available":95965786112,"internally_reserved":0,"allocated":1585152,"data_stored":1052746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.66600000000000004,"15min":0.63200000000000001},"min":{"1min":0.40300000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.6240000000000001,"5min":3.5680000000000001,"15min":3.5680000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63900000000000001,"15min":0.64800000000000002},"min":{"1min":0.40699999999999997,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":0.76200000000000001}]},{"osd":1,"last update":"Sat Sep 23 08:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.68500000000000005,"15min":0.64900000000000002},"min":{"1min":0.42699999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.92100000000000004,"5min":1.016,"15min":1.016},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.71599999999999997,"15min":0.64900000000000002},"min":{"1min":0.58099999999999996,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.0840000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.83899999999999997}]},{"osd":2,"last update":"Sat Sep 23 08:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.55600000000000005,"15min":0.53000000000000003},"min":{"1min":0.435,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.84599999999999997,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.56399999999999995,"15min":0.52800000000000002},"min":{"1min":0.42599999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.77600000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.70699999999999996}]},{"osd":3,"last update":"Sat Sep 23 08:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.72999999999999998,"15min":0.69199999999999995},"min":{"1min":0.49199999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.6930000000000001,"5min":5.5339999999999998,"15min":5.5339999999999998},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.68100000000000005,"15min":0.68899999999999995},"min":{"1min":0.5,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.621}]},{"osd":4,"last update":"Sat Sep 23 08:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.746,"15min":0.69799999999999995},"min":{"1min":0.54200000000000004,"5min":0.44,"15min":0.44},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.73599999999999999,"15min":0.69599999999999995},"min":{"1min":0.57399999999999995,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.98199999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.875}]},{"osd":6,"last update":"Sat Sep 23 08:55:48 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.754,"15min":0.73099999999999998},"min":{"1min":0.50900000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.89100000000000001,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.76300000000000001,"15min":0.74299999999999999},"min":{"1min":0.56200000000000006,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.85599999999999998}]},{"osd":7,"last update":"Sat Sep 23 08:56:12 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.79300000000000004,"15min":0.75900000000000001},"min":{"1min":0.58799999999999997,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.94799999999999995,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.745},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.80900000000000005,"15min":0.78900000000000003},"min":{"1min":0.67800000000000005,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.98799999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.94199999999999995}]},{"osd":8,"last update":"Sat Sep 23 08:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.77200000000000002,"15min":0.77800000000000002},"min":{"1min":0.52900000000000003,"5min":0.497,"15min":0.497},"max":{"1min":0.96699999999999997,"5min":1.044,"15min":1.044},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.76300000000000001,"15min":0.77200000000000002},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.89100000000000001,"5min":1.046,"15min":1.046},"last":1.0580000000000001}]},{"osd":9,"last update":"Sat Sep 23 08:56:12 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.92100000000000004,"15min":0.93100000000000005},"min":{"1min":0.66100000000000003,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":3.419,"5min":3.419,"15min":3.419},"last":1.0149999999999999},{"interface":"front","average":{"1min":1.02,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.60899999999999999,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":3.407,"5min":3.407,"15min":3.407},"last":0.89700000000000002}]},{"osd":10,"last update":"Sat Sep 23 08:56:35 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.90300000000000002,"15min":0.90600000000000003},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":1.042},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.90000000000000002,"15min":0.91200000000000003},"min":{"1min":0.71299999999999997,"5min":0.629,"15min":0.629},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":65435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":65997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":60958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-23T08:56:40.754 INFO:tasks.fwd_scrub.ceph_manager:clean! 2023-09-23T08:56:40.754 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-23T08:56:40.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.978+0000 7f61331ff700 1 -- 172.21.15.82:0/3439155058 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f612c106620 msgr2=0x7f612c108a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:40.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.978+0000 7f61331ff700 1 --2- 172.21.15.82:0/3439155058 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f612c106620 0x7f612c108a50 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f612400b0a0 tx=0x7f612400b3b0 comp rx=0 tx=0).stop 2023-09-23T08:56:40.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.978+0000 7f61331ff700 1 -- 172.21.15.82:0/3439155058 shutdown_connections 2023-09-23T08:56:40.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.978+0000 7f61331ff700 1 --2- 172.21.15.82:0/3439155058 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f612c106620 0x7f612c108a50 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:40.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.978+0000 7f61331ff700 1 --2- 172.21.15.82:0/3439155058 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f612c1013c0 0x7f612c1037b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:40.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.978+0000 7f61331ff700 1 --2- 172.21.15.82:0/3439155058 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f612c103cf0 0x7f612c1060e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:40.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.978+0000 7f61331ff700 1 -- 172.21.15.82:0/3439155058 >> 172.21.15.82:0/3439155058 conn(0x7f612c0fad50 msgr2=0x7f612c0fd1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:40.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.978+0000 7f61331ff700 1 -- 172.21.15.82:0/3439155058 shutdown_connections 2023-09-23T08:56:40.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.978+0000 7f61331ff700 1 -- 172.21.15.82:0/3439155058 wait complete. 2023-09-23T08:56:40.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.979+0000 7f61331ff700 1 Processor -- start 2023-09-23T08:56:40.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.980+0000 7f61331ff700 1 -- start start 2023-09-23T08:56:40.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.980+0000 7f61331ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f612c1013c0 0x7f612c100d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:40.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.980+0000 7f61331ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f612c103cf0 0x7f612c0ff370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:40.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.980+0000 7f61331ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f612c106620 0x7f612c0ff8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:40.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.980+0000 7f61331ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f612c100050 con 0x7f612c103cf0 2023-09-23T08:56:40.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.980+0000 7f61331ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f612c1001c0 con 0x7f612c1013c0 2023-09-23T08:56:40.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.980+0000 7f61331ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f612c1a0600 con 0x7f612c106620 2023-09-23T08:56:40.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.980+0000 7f612bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f612c103cf0 0x7f612c0ff370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:40.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.980+0000 7f612bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f612c103cf0 0x7f612c0ff370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45252/0 (socket says 172.21.15.82:45252) 2023-09-23T08:56:40.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.980+0000 7f612bfff700 1 -- 172.21.15.82:0/740212603 learned_addr learned my addr 172.21.15.82:0/740212603 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:40.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.981+0000 7f6130f9b700 1 --2- 172.21.15.82:0/740212603 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f612c1013c0 0x7f612c100d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:40.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.981+0000 7f613179c700 1 --2- 172.21.15.82:0/740212603 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f612c106620 0x7f612c0ff8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:40.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.981+0000 7f612bfff700 1 -- 172.21.15.82:0/740212603 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f612c106620 msgr2=0x7f612c0ff8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:40.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.981+0000 7f612bfff700 1 --2- 172.21.15.82:0/740212603 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f612c106620 0x7f612c0ff8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:40.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.981+0000 7f612bfff700 1 -- 172.21.15.82:0/740212603 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f612c1013c0 msgr2=0x7f612c100d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:40.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.981+0000 7f612bfff700 1 --2- 172.21.15.82:0/740212603 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f612c1013c0 0x7f612c100d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:40.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.981+0000 7f612bfff700 1 -- 172.21.15.82:0/740212603 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6124009d00 con 0x7f612c103cf0 2023-09-23T08:56:40.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.981+0000 7f612bfff700 1 --2- 172.21.15.82:0/740212603 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f612c103cf0 0x7f612c0ff370 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f611800d950 tx=0x7f611800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:40.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.981+0000 7f6129ffb700 1 -- 172.21.15.82:0/740212603 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6118009940 con 0x7f612c103cf0 2023-09-23T08:56:40.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.981+0000 7f61331ff700 1 -- 172.21.15.82:0/740212603 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f612c1a08e0 con 0x7f612c103cf0 2023-09-23T08:56:40.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.981+0000 7f6129ffb700 1 -- 172.21.15.82:0/740212603 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6118010460 con 0x7f612c103cf0 2023-09-23T08:56:40.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.981+0000 7f6129ffb700 1 -- 172.21.15.82:0/740212603 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f611800f620 con 0x7f612c103cf0 2023-09-23T08:56:40.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.981+0000 7f61331ff700 1 -- 172.21.15.82:0/740212603 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f612c1a0e40 con 0x7f612c103cf0 2023-09-23T08:56:40.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.982+0000 7f61331ff700 1 -- 172.21.15.82:0/740212603 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f612c0fc8d0 con 0x7f612c103cf0 2023-09-23T08:56:40.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.984+0000 7f6129ffb700 1 -- 172.21.15.82:0/740212603 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 134671+0+0 (secure 0 0 0) 0x7f61180105d0 con 0x7f612c103cf0 2023-09-23T08:56:40.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.985+0000 7f6129ffb700 1 --2- 172.21.15.82:0/740212603 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f611c09ffa0 0x7f611c0a2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:40.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.986+0000 7f6129ffb700 1 -- 172.21.15.82:0/740212603 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f61180cb050 con 0x7f612c103cf0 2023-09-23T08:56:40.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.986+0000 7f6130f9b700 1 --2- 172.21.15.82:0/740212603 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f611c09ffa0 0x7f611c0a2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:40.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.986+0000 7f6130f9b700 1 --2- 172.21.15.82:0/740212603 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f611c09ffa0 0x7f611c0a2460 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6120005950 tx=0x7f612000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:40.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:40.989+0000 7f6129ffb700 1 -- 172.21.15.82:0/740212603 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f6118094df0 con 0x7f612c103cf0 2023-09-23T08:56:41.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.190+0000 7f61331ff700 1 -- 172.21.15.82:0/740212603 --> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f612c02ce30 con 0x7f611c09ffa0 2023-09-23T08:56:41.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.200+0000 7f6129ffb700 1 -- 172.21.15.82:0/740212603 <== mgr.14152 v2:172.21.15.82:6800/3698954311 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+343229 (secure 0 0 0) 0x7f612c02ce30 con 0x7f611c09ffa0 2023-09-23T08:56:41.204 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:56:41.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.204+0000 7f61331ff700 1 -- 172.21.15.82:0/740212603 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f611c09ffa0 msgr2=0x7f611c0a2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:41.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.204+0000 7f61331ff700 1 --2- 172.21.15.82:0/740212603 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f611c09ffa0 0x7f611c0a2460 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6120005950 tx=0x7f612000b410 comp rx=0 tx=0).stop 2023-09-23T08:56:41.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.205+0000 7f61331ff700 1 -- 172.21.15.82:0/740212603 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f612c103cf0 msgr2=0x7f612c0ff370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:41.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.205+0000 7f61331ff700 1 --2- 172.21.15.82:0/740212603 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f612c103cf0 0x7f612c0ff370 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f611800d950 tx=0x7f611800dc60 comp rx=0 tx=0).stop 2023-09-23T08:56:41.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.205+0000 7f61331ff700 1 -- 172.21.15.82:0/740212603 shutdown_connections 2023-09-23T08:56:41.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.205+0000 7f61331ff700 1 --2- 172.21.15.82:0/740212603 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f611c09ffa0 0x7f611c0a2460 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:41.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.205+0000 7f61331ff700 1 --2- 172.21.15.82:0/740212603 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f612c106620 0x7f612c0ff8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:41.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.205+0000 7f61331ff700 1 --2- 172.21.15.82:0/740212603 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f612c1013c0 0x7f612c100d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:41.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.205+0000 7f61331ff700 1 --2- 172.21.15.82:0/740212603 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f612c103cf0 0x7f612c0ff370 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:41.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.205+0000 7f61331ff700 1 -- 172.21.15.82:0/740212603 >> 172.21.15.82:0/740212603 conn(0x7f612c0fad50 msgr2=0x7f612c102090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:41.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.205+0000 7f61331ff700 1 -- 172.21.15.82:0/740212603 shutdown_connections 2023-09-23T08:56:41.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.205+0000 7f61331ff700 1 -- 172.21.15.82:0/740212603 wait complete. 2023-09-23T08:56:41.224 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-09-23T08:56:41.227 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":357,"stamp":"2023-09-23T08:56:40.079391+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658238,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1139,"num_read_kb":690,"num_write":441,"num_write_kb":3086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":1181408,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":862,"ondisk_log_size":862,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":337576,"kb_used_data":13384,"kb_used_omap":20,"kb_used_meta":324075,"kb_avail":1124604248,"statfs":{"total":1151940427776,"available":1151594749952,"internally_reserved":0,"allocated":13705216,"data_stored":7485655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21372,"internal_metadata":331852932},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2415,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":60,"num_write":15,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003060"},"pg_stats":[{"pgid":"3.3f","version":"88'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.099015+0000","last_change":"2023-09-23T08:54:53.110235+0000","last_active":"2023-09-23T08:56:22.099015+0000","last_peered":"2023-09-23T08:56:22.099015+0000","last_clean":"2023-09-23T08:56:22.099015+0000","last_became_active":"2023-09-23T08:54:53.109445+0000","last_became_peered":"2023-09-23T08:54:53.109445+0000","last_unstale":"2023-09-23T08:56:22.099015+0000","last_undegraded":"2023-09-23T08:56:22.099015+0000","last_fullsized":"2023-09-23T08:56:22.099015+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T10:56:35.558203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"88'4","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.085205+0000","last_change":"2023-09-23T08:54:53.105948+0000","last_active":"2023-09-23T08:56:22.085205+0000","last_peered":"2023-09-23T08:56:22.085205+0000","last_clean":"2023-09-23T08:56:22.085205+0000","last_became_active":"2023-09-23T08:54:53.105627+0000","last_became_peered":"2023-09-23T08:54:53.105627+0000","last_unstale":"2023-09-23T08:56:22.085205+0000","last_undegraded":"2023-09-23T08:56:22.085205+0000","last_fullsized":"2023-09-23T08:56:22.085205+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T13:02:00.876110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"88'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.095519+0000","last_change":"2023-09-23T08:54:53.099318+0000","last_active":"2023-09-23T08:56:22.095519+0000","last_peered":"2023-09-23T08:56:22.095519+0000","last_clean":"2023-09-23T08:56:22.095519+0000","last_became_active":"2023-09-23T08:54:53.099002+0000","last_became_peered":"2023-09-23T08:54:53.099002+0000","last_unstale":"2023-09-23T08:56:22.095519+0000","last_undegraded":"2023-09-23T08:56:22.095519+0000","last_fullsized":"2023-09-23T08:56:22.095519+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T11:00:15.427942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"88'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.094825+0000","last_change":"2023-09-23T08:54:53.114757+0000","last_active":"2023-09-23T08:56:22.094825+0000","last_peered":"2023-09-23T08:56:22.094825+0000","last_clean":"2023-09-23T08:56:22.094825+0000","last_became_active":"2023-09-23T08:54:53.113979+0000","last_became_peered":"2023-09-23T08:54:53.113979+0000","last_unstale":"2023-09-23T08:56:22.094825+0000","last_undegraded":"2023-09-23T08:56:22.094825+0000","last_fullsized":"2023-09-23T08:56:22.094825+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T11:02:27.209284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"88'4","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.090455+0000","last_change":"2023-09-23T08:54:53.102122+0000","last_active":"2023-09-23T08:56:22.090455+0000","last_peered":"2023-09-23T08:56:22.090455+0000","last_clean":"2023-09-23T08:56:22.090455+0000","last_became_active":"2023-09-23T08:54:53.101781+0000","last_became_peered":"2023-09-23T08:54:53.101781+0000","last_unstale":"2023-09-23T08:56:22.090455+0000","last_undegraded":"2023-09-23T08:56:22.090455+0000","last_fullsized":"2023-09-23T08:56:22.090455+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T18:27:41.371961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"88'6","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.076942+0000","last_change":"2023-09-23T08:54:53.103617+0000","last_active":"2023-09-23T08:56:22.076942+0000","last_peered":"2023-09-23T08:56:22.076942+0000","last_clean":"2023-09-23T08:56:22.076942+0000","last_became_active":"2023-09-23T08:54:53.103259+0000","last_became_peered":"2023-09-23T08:54:53.103259+0000","last_unstale":"2023-09-23T08:56:22.076942+0000","last_undegraded":"2023-09-23T08:56:22.076942+0000","last_fullsized":"2023-09-23T08:56:22.076942+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:51:15.970275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"88'5","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.082702+0000","last_change":"2023-09-23T08:54:53.110512+0000","last_active":"2023-09-23T08:56:22.082702+0000","last_peered":"2023-09-23T08:56:22.082702+0000","last_clean":"2023-09-23T08:56:22.082702+0000","last_became_active":"2023-09-23T08:54:53.110166+0000","last_became_peered":"2023-09-23T08:54:53.110166+0000","last_unstale":"2023-09-23T08:56:22.082702+0000","last_undegraded":"2023-09-23T08:56:22.082702+0000","last_fullsized":"2023-09-23T08:56:22.082702+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T20:45:16.248775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"88'9","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.099630+0000","last_change":"2023-09-23T08:54:53.111373+0000","last_active":"2023-09-23T08:56:22.099630+0000","last_peered":"2023-09-23T08:56:22.099630+0000","last_clean":"2023-09-23T08:56:22.099630+0000","last_became_active":"2023-09-23T08:54:53.111045+0000","last_became_peered":"2023-09-23T08:54:53.111045+0000","last_unstale":"2023-09-23T08:56:22.099630+0000","last_undegraded":"2023-09-23T08:56:22.099630+0000","last_fullsized":"2023-09-23T08:56:22.099630+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:25:16.099829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"88'11","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.098906+0000","last_change":"2023-09-23T08:54:53.100219+0000","last_active":"2023-09-23T08:56:22.098906+0000","last_peered":"2023-09-23T08:56:22.098906+0000","last_clean":"2023-09-23T08:56:22.098906+0000","last_became_active":"2023-09-23T08:54:53.099925+0000","last_became_peered":"2023-09-23T08:54:53.099925+0000","last_unstale":"2023-09-23T08:56:22.098906+0000","last_undegraded":"2023-09-23T08:56:22.098906+0000","last_fullsized":"2023-09-23T08:56:22.098906+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T20:53:32.264331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"88'16","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.090196+0000","last_change":"2023-09-23T08:55:23.439006+0000","last_active":"2023-09-23T08:56:22.090196+0000","last_peered":"2023-09-23T08:56:22.090196+0000","last_clean":"2023-09-23T08:56:22.090196+0000","last_became_active":"2023-09-23T08:55:23.438533+0000","last_became_peered":"2023-09-23T08:55:23.438533+0000","last_unstale":"2023-09-23T08:56:22.090196+0000","last_undegraded":"2023-09-23T08:56:22.090196+0000","last_fullsized":"2023-09-23T08:56:22.090196+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T12:30:40.717065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"88'6","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.099302+0000","last_change":"2023-09-23T08:54:53.108175+0000","last_active":"2023-09-23T08:56:22.099302+0000","last_peered":"2023-09-23T08:56:22.099302+0000","last_clean":"2023-09-23T08:56:22.099302+0000","last_became_active":"2023-09-23T08:54:53.107889+0000","last_became_peered":"2023-09-23T08:54:53.107889+0000","last_unstale":"2023-09-23T08:56:22.099302+0000","last_undegraded":"2023-09-23T08:56:22.099302+0000","last_fullsized":"2023-09-23T08:56:22.099302+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T11:57:28.537929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"88'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.092255+0000","last_change":"2023-09-23T08:54:53.114564+0000","last_active":"2023-09-23T08:56:22.092255+0000","last_peered":"2023-09-23T08:56:22.092255+0000","last_clean":"2023-09-23T08:56:22.092255+0000","last_became_active":"2023-09-23T08:54:53.113937+0000","last_became_peered":"2023-09-23T08:54:53.113937+0000","last_unstale":"2023-09-23T08:56:22.092255+0000","last_undegraded":"2023-09-23T08:56:22.092255+0000","last_fullsized":"2023-09-23T08:56:22.092255+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:07:59.125776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"88'10","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.086442+0000","last_change":"2023-09-23T08:54:53.108544+0000","last_active":"2023-09-23T08:56:22.086442+0000","last_peered":"2023-09-23T08:56:22.086442+0000","last_clean":"2023-09-23T08:56:22.086442+0000","last_became_active":"2023-09-23T08:54:53.108226+0000","last_became_peered":"2023-09-23T08:54:53.108226+0000","last_unstale":"2023-09-23T08:56:22.086442+0000","last_undegraded":"2023-09-23T08:56:22.086442+0000","last_fullsized":"2023-09-23T08:56:22.086442+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T20:44:46.654608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"88'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.082551+0000","last_change":"2023-09-23T08:54:53.106250+0000","last_active":"2023-09-23T08:56:22.082551+0000","last_peered":"2023-09-23T08:56:22.082551+0000","last_clean":"2023-09-23T08:56:22.082551+0000","last_became_active":"2023-09-23T08:54:53.105912+0000","last_became_peered":"2023-09-23T08:54:53.105912+0000","last_unstale":"2023-09-23T08:56:22.082551+0000","last_undegraded":"2023-09-23T08:56:22.082551+0000","last_fullsized":"2023-09-23T08:56:22.082551+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T09:50:26.711654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"88'7","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.091889+0000","last_change":"2023-09-23T08:55:23.441265+0000","last_active":"2023-09-23T08:56:22.091889+0000","last_peered":"2023-09-23T08:56:22.091889+0000","last_clean":"2023-09-23T08:56:22.091889+0000","last_became_active":"2023-09-23T08:55:23.440800+0000","last_became_peered":"2023-09-23T08:55:23.440800+0000","last_unstale":"2023-09-23T08:56:22.091889+0000","last_undegraded":"2023-09-23T08:56:22.091889+0000","last_fullsized":"2023-09-23T08:56:22.091889+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T10:27:59.968816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"88'9","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.100645+0000","last_change":"2023-09-23T08:54:53.098507+0000","last_active":"2023-09-23T08:56:22.100645+0000","last_peered":"2023-09-23T08:56:22.100645+0000","last_clean":"2023-09-23T08:56:22.100645+0000","last_became_active":"2023-09-23T08:54:53.098153+0000","last_became_peered":"2023-09-23T08:54:53.098153+0000","last_unstale":"2023-09-23T08:56:22.100645+0000","last_undegraded":"2023-09-23T08:56:22.100645+0000","last_fullsized":"2023-09-23T08:56:22.100645+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T09:39:06.960825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"88'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.098807+0000","last_change":"2023-09-23T08:54:53.110427+0000","last_active":"2023-09-23T08:56:22.098807+0000","last_peered":"2023-09-23T08:56:22.098807+0000","last_clean":"2023-09-23T08:56:22.098807+0000","last_became_active":"2023-09-23T08:54:53.109868+0000","last_became_peered":"2023-09-23T08:54:53.109868+0000","last_unstale":"2023-09-23T08:56:22.098807+0000","last_undegraded":"2023-09-23T08:56:22.098807+0000","last_fullsized":"2023-09-23T08:56:22.098807+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:58:18.067768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"88'10","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.095604+0000","last_change":"2023-09-23T08:54:53.107613+0000","last_active":"2023-09-23T08:56:22.095604+0000","last_peered":"2023-09-23T08:56:22.095604+0000","last_clean":"2023-09-23T08:56:22.095604+0000","last_became_active":"2023-09-23T08:54:53.107230+0000","last_became_peered":"2023-09-23T08:54:53.107230+0000","last_unstale":"2023-09-23T08:56:22.095604+0000","last_undegraded":"2023-09-23T08:56:22.095604+0000","last_fullsized":"2023-09-23T08:56:22.095604+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:36:14.702321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"88'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.094185+0000","last_change":"2023-09-23T08:54:53.102530+0000","last_active":"2023-09-23T08:56:22.094185+0000","last_peered":"2023-09-23T08:56:22.094185+0000","last_clean":"2023-09-23T08:56:22.094185+0000","last_became_active":"2023-09-23T08:54:53.102004+0000","last_became_peered":"2023-09-23T08:54:53.102004+0000","last_unstale":"2023-09-23T08:56:22.094185+0000","last_undegraded":"2023-09-23T08:56:22.094185+0000","last_fullsized":"2023-09-23T08:56:22.094185+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:18:54.809976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"88'14","reported_seq":150,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:36.557416+0000","last_change":"2023-09-23T08:55:23.449398+0000","last_active":"2023-09-23T08:56:36.557416+0000","last_peered":"2023-09-23T08:56:36.557416+0000","last_clean":"2023-09-23T08:56:36.557416+0000","last_became_active":"2023-09-23T08:55:23.434193+0000","last_became_peered":"2023-09-23T08:55:23.434193+0000","last_unstale":"2023-09-23T08:56:36.557416+0000","last_undegraded":"2023-09-23T08:56:36.557416+0000","last_fullsized":"2023-09-23T08:56:36.557416+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:21:58.024636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":92,"num_read_kb":92,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"88'5","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.088274+0000","last_change":"2023-09-23T08:54:53.109844+0000","last_active":"2023-09-23T08:56:22.088274+0000","last_peered":"2023-09-23T08:56:22.088274+0000","last_clean":"2023-09-23T08:56:22.088274+0000","last_became_active":"2023-09-23T08:54:53.109456+0000","last_became_peered":"2023-09-23T08:54:53.109456+0000","last_unstale":"2023-09-23T08:56:22.088274+0000","last_undegraded":"2023-09-23T08:56:22.088274+0000","last_fullsized":"2023-09-23T08:56:22.088274+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:35:18.729698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.437928+0000","last_change":"2023-09-23T08:54:52.090023+0000","last_active":"2023-09-23T08:55:23.437928+0000","last_peered":"2023-09-23T08:55:23.437928+0000","last_clean":"2023-09-23T08:55:23.437928+0000","last_became_active":"2023-09-23T08:54:52.089587+0000","last_became_peered":"2023-09-23T08:54:52.089587+0000","last_unstale":"2023-09-23T08:55:23.437928+0000","last_undegraded":"2023-09-23T08:55:23.437928+0000","last_fullsized":"2023-09-23T08:55:23.437928+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T09:08:05.801189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"88'6","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.090783+0000","last_change":"2023-09-23T08:54:53.098662+0000","last_active":"2023-09-23T08:56:22.090783+0000","last_peered":"2023-09-23T08:56:22.090783+0000","last_clean":"2023-09-23T08:56:22.090783+0000","last_became_active":"2023-09-23T08:54:53.098288+0000","last_became_peered":"2023-09-23T08:54:53.098288+0000","last_unstale":"2023-09-23T08:56:22.090783+0000","last_undegraded":"2023-09-23T08:56:22.090783+0000","last_fullsized":"2023-09-23T08:56:22.090783+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:21:44.163895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"86'12","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.432199+0000","last_change":"2023-09-23T08:54:52.083109+0000","last_active":"2023-09-23T08:55:23.432199+0000","last_peered":"2023-09-23T08:55:23.432199+0000","last_clean":"2023-09-23T08:55:23.432199+0000","last_became_active":"2023-09-23T08:54:52.082479+0000","last_became_peered":"2023-09-23T08:54:52.082479+0000","last_unstale":"2023-09-23T08:55:23.432199+0000","last_undegraded":"2023-09-23T08:55:23.432199+0000","last_fullsized":"2023-09-23T08:55:23.432199+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T14:19:13.234767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"88'9","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.100922+0000","last_change":"2023-09-23T08:54:53.105112+0000","last_active":"2023-09-23T08:56:22.100922+0000","last_peered":"2023-09-23T08:56:22.100922+0000","last_clean":"2023-09-23T08:56:22.100922+0000","last_became_active":"2023-09-23T08:54:53.104639+0000","last_became_peered":"2023-09-23T08:54:53.104639+0000","last_unstale":"2023-09-23T08:56:22.100922+0000","last_undegraded":"2023-09-23T08:56:22.100922+0000","last_fullsized":"2023-09-23T08:56:22.100922+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T09:13:19.421762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"86'5","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.431617+0000","last_change":"2023-09-23T08:54:52.082798+0000","last_active":"2023-09-23T08:55:23.431617+0000","last_peered":"2023-09-23T08:55:23.431617+0000","last_clean":"2023-09-23T08:55:23.431617+0000","last_became_active":"2023-09-23T08:54:52.082455+0000","last_became_peered":"2023-09-23T08:54:52.082455+0000","last_unstale":"2023-09-23T08:55:23.431617+0000","last_undegraded":"2023-09-23T08:55:23.431617+0000","last_fullsized":"2023-09-23T08:55:23.431617+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T18:53:37.376211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"88'15","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.098805+0000","last_change":"2023-09-23T08:54:53.105012+0000","last_active":"2023-09-23T08:56:22.098805+0000","last_peered":"2023-09-23T08:56:22.098805+0000","last_clean":"2023-09-23T08:56:22.098805+0000","last_became_active":"2023-09-23T08:54:53.104670+0000","last_became_peered":"2023-09-23T08:54:53.104670+0000","last_unstale":"2023-09-23T08:56:22.098805+0000","last_undegraded":"2023-09-23T08:56:22.098805+0000","last_fullsized":"2023-09-23T08:56:22.098805+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T13:57:42.013692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"88'8","reported_seq":129,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:37.661645+0000","last_change":"2023-09-23T08:54:52.085771+0000","last_active":"2023-09-23T08:56:37.661645+0000","last_peered":"2023-09-23T08:56:37.661645+0000","last_clean":"2023-09-23T08:56:37.661645+0000","last_became_active":"2023-09-23T08:54:52.085424+0000","last_became_peered":"2023-09-23T08:54:52.085424+0000","last_unstale":"2023-09-23T08:56:37.661645+0000","last_undegraded":"2023-09-23T08:56:37.661645+0000","last_fullsized":"2023-09-23T08:56:37.661645+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T11:26:36.068148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1636,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":4,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"88'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.080931+0000","last_change":"2023-09-23T08:54:53.109830+0000","last_active":"2023-09-23T08:56:22.080931+0000","last_peered":"2023-09-23T08:56:22.080931+0000","last_clean":"2023-09-23T08:56:22.080931+0000","last_became_active":"2023-09-23T08:54:53.109532+0000","last_became_peered":"2023-09-23T08:54:53.109532+0000","last_unstale":"2023-09-23T08:56:22.080931+0000","last_undegraded":"2023-09-23T08:56:22.080931+0000","last_fullsized":"2023-09-23T08:56:22.080931+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:14:37.986156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"86'7","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.428457+0000","last_change":"2023-09-23T08:54:52.075998+0000","last_active":"2023-09-23T08:55:23.428457+0000","last_peered":"2023-09-23T08:55:23.428457+0000","last_clean":"2023-09-23T08:55:23.428457+0000","last_became_active":"2023-09-23T08:54:52.075701+0000","last_became_peered":"2023-09-23T08:54:52.075701+0000","last_unstale":"2023-09-23T08:55:23.428457+0000","last_undegraded":"2023-09-23T08:55:23.428457+0000","last_fullsized":"2023-09-23T08:55:23.428457+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:35:20.680135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"88'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.094881+0000","last_change":"2023-09-23T08:54:53.106654+0000","last_active":"2023-09-23T08:56:22.094881+0000","last_peered":"2023-09-23T08:56:22.094881+0000","last_clean":"2023-09-23T08:56:22.094881+0000","last_became_active":"2023-09-23T08:54:53.106348+0000","last_became_peered":"2023-09-23T08:54:53.106348+0000","last_unstale":"2023-09-23T08:56:22.094881+0000","last_undegraded":"2023-09-23T08:56:22.094881+0000","last_fullsized":"2023-09-23T08:56:22.094881+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:48:44.274107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"86'3","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.431350+0000","last_change":"2023-09-23T08:54:52.073666+0000","last_active":"2023-09-23T08:55:23.431350+0000","last_peered":"2023-09-23T08:55:23.431350+0000","last_clean":"2023-09-23T08:55:23.431350+0000","last_became_active":"2023-09-23T08:54:52.073248+0000","last_became_peered":"2023-09-23T08:54:52.073248+0000","last_unstale":"2023-09-23T08:55:23.431350+0000","last_undegraded":"2023-09-23T08:55:23.431350+0000","last_fullsized":"2023-09-23T08:55:23.431350+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T13:43:51.125737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"88'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.094756+0000","last_change":"2023-09-23T08:54:53.109621+0000","last_active":"2023-09-23T08:56:22.094756+0000","last_peered":"2023-09-23T08:56:22.094756+0000","last_clean":"2023-09-23T08:56:22.094756+0000","last_became_active":"2023-09-23T08:54:53.109304+0000","last_became_peered":"2023-09-23T08:54:53.109304+0000","last_unstale":"2023-09-23T08:56:22.094756+0000","last_undegraded":"2023-09-23T08:56:22.094756+0000","last_fullsized":"2023-09-23T08:56:22.094756+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:23:57.973639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"86'3","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.431509+0000","last_change":"2023-09-23T08:54:52.081580+0000","last_active":"2023-09-23T08:55:23.431509+0000","last_peered":"2023-09-23T08:55:23.431509+0000","last_clean":"2023-09-23T08:55:23.431509+0000","last_became_active":"2023-09-23T08:54:52.081151+0000","last_became_peered":"2023-09-23T08:54:52.081151+0000","last_unstale":"2023-09-23T08:55:23.431509+0000","last_undegraded":"2023-09-23T08:55:23.431509+0000","last_fullsized":"2023-09-23T08:55:23.431509+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T14:53:36.622852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"88'11","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.091347+0000","last_change":"2023-09-23T08:54:53.108334+0000","last_active":"2023-09-23T08:56:22.091347+0000","last_peered":"2023-09-23T08:56:22.091347+0000","last_clean":"2023-09-23T08:56:22.091347+0000","last_became_active":"2023-09-23T08:54:53.108038+0000","last_became_peered":"2023-09-23T08:54:53.108038+0000","last_unstale":"2023-09-23T08:56:22.091347+0000","last_undegraded":"2023-09-23T08:56:22.091347+0000","last_fullsized":"2023-09-23T08:56:22.091347+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:22:21.278138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"88'6","reported_seq":214,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:34.654350+0000","last_change":"2023-09-23T08:54:52.084025+0000","last_active":"2023-09-23T08:56:34.654350+0000","last_peered":"2023-09-23T08:56:34.654350+0000","last_clean":"2023-09-23T08:56:34.654350+0000","last_became_active":"2023-09-23T08:54:52.083625+0000","last_became_peered":"2023-09-23T08:54:52.083625+0000","last_unstale":"2023-09-23T08:56:34.654350+0000","last_undegraded":"2023-09-23T08:56:34.654350+0000","last_fullsized":"2023-09-23T08:56:34.654350+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T13:02:41.009120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":190,"num_read_kb":190,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"88'10","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.096159+0000","last_change":"2023-09-23T08:54:53.106602+0000","last_active":"2023-09-23T08:56:22.096159+0000","last_peered":"2023-09-23T08:56:22.096159+0000","last_clean":"2023-09-23T08:56:22.096159+0000","last_became_active":"2023-09-23T08:54:53.105501+0000","last_became_peered":"2023-09-23T08:54:53.105501+0000","last_unstale":"2023-09-23T08:56:22.096159+0000","last_undegraded":"2023-09-23T08:56:22.096159+0000","last_fullsized":"2023-09-23T08:56:22.096159+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T10:15:37.314083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"86'4","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.431239+0000","last_change":"2023-09-23T08:54:52.079197+0000","last_active":"2023-09-23T08:55:23.431239+0000","last_peered":"2023-09-23T08:55:23.431239+0000","last_clean":"2023-09-23T08:55:23.431239+0000","last_became_active":"2023-09-23T08:54:52.078748+0000","last_became_peered":"2023-09-23T08:54:52.078748+0000","last_unstale":"2023-09-23T08:55:23.431239+0000","last_undegraded":"2023-09-23T08:55:23.431239+0000","last_fullsized":"2023-09-23T08:55:23.431239+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T18:15:16.139104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"88'9","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.089627+0000","last_change":"2023-09-23T08:54:53.105831+0000","last_active":"2023-09-23T08:56:22.089627+0000","last_peered":"2023-09-23T08:56:22.089627+0000","last_clean":"2023-09-23T08:56:22.089627+0000","last_became_active":"2023-09-23T08:54:53.105511+0000","last_became_peered":"2023-09-23T08:54:53.105511+0000","last_unstale":"2023-09-23T08:56:22.089627+0000","last_undegraded":"2023-09-23T08:56:22.089627+0000","last_fullsized":"2023-09-23T08:56:22.089627+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T10:06:14.045381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"86'5","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.432616+0000","last_change":"2023-09-23T08:54:52.089312+0000","last_active":"2023-09-23T08:55:23.432616+0000","last_peered":"2023-09-23T08:55:23.432616+0000","last_clean":"2023-09-23T08:55:23.432616+0000","last_became_active":"2023-09-23T08:54:52.088762+0000","last_became_peered":"2023-09-23T08:54:52.088762+0000","last_unstale":"2023-09-23T08:55:23.432616+0000","last_undegraded":"2023-09-23T08:55:23.432616+0000","last_fullsized":"2023-09-23T08:55:23.432616+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:31:59.043067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"88'11","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.100051+0000","last_change":"2023-09-23T08:54:53.106972+0000","last_active":"2023-09-23T08:56:22.100051+0000","last_peered":"2023-09-23T08:56:22.100051+0000","last_clean":"2023-09-23T08:56:22.100051+0000","last_became_active":"2023-09-23T08:54:53.105175+0000","last_became_peered":"2023-09-23T08:54:53.105175+0000","last_unstale":"2023-09-23T08:56:22.100051+0000","last_undegraded":"2023-09-23T08:56:22.100051+0000","last_fullsized":"2023-09-23T08:56:22.100051+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T20:07:17.130820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"88'34","reported_seq":250,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:34.675103+0000","last_change":"2023-09-23T08:54:52.077758+0000","last_active":"2023-09-23T08:56:34.675103+0000","last_peered":"2023-09-23T08:56:34.675103+0000","last_clean":"2023-09-23T08:56:34.675103+0000","last_became_active":"2023-09-23T08:54:52.077461+0000","last_became_peered":"2023-09-23T08:54:52.077461+0000","last_unstale":"2023-09-23T08:56:34.675103+0000","last_undegraded":"2023-09-23T08:56:34.675103+0000","last_fullsized":"2023-09-23T08:56:34.675103+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T13:22:15.302812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58208,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":198,"num_read_kb":155,"num_write":36,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"88'6","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.085121+0000","last_change":"2023-09-23T08:54:53.102967+0000","last_active":"2023-09-23T08:56:22.085121+0000","last_peered":"2023-09-23T08:56:22.085121+0000","last_clean":"2023-09-23T08:56:22.085121+0000","last_became_active":"2023-09-23T08:54:53.102608+0000","last_became_peered":"2023-09-23T08:54:53.102608+0000","last_unstale":"2023-09-23T08:56:22.085121+0000","last_undegraded":"2023-09-23T08:56:22.085121+0000","last_fullsized":"2023-09-23T08:56:22.085121+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:15:18.457676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"86'9","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.436872+0000","last_change":"2023-09-23T08:54:52.083885+0000","last_active":"2023-09-23T08:55:23.436872+0000","last_peered":"2023-09-23T08:55:23.436872+0000","last_clean":"2023-09-23T08:55:23.436872+0000","last_became_active":"2023-09-23T08:54:52.083530+0000","last_became_peered":"2023-09-23T08:54:52.083530+0000","last_unstale":"2023-09-23T08:55:23.436872+0000","last_undegraded":"2023-09-23T08:55:23.436872+0000","last_fullsized":"2023-09-23T08:55:23.436872+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:13:15.173145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"88'9","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.093090+0000","last_change":"2023-09-23T08:54:53.102429+0000","last_active":"2023-09-23T08:56:22.093090+0000","last_peered":"2023-09-23T08:56:22.093090+0000","last_clean":"2023-09-23T08:56:22.093090+0000","last_became_active":"2023-09-23T08:54:53.102139+0000","last_became_peered":"2023-09-23T08:54:53.102139+0000","last_unstale":"2023-09-23T08:56:22.093090+0000","last_undegraded":"2023-09-23T08:56:22.093090+0000","last_fullsized":"2023-09-23T08:56:22.093090+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T14:20:29.728805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"86'5","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.431753+0000","last_change":"2023-09-23T08:54:52.083380+0000","last_active":"2023-09-23T08:55:23.431753+0000","last_peered":"2023-09-23T08:55:23.431753+0000","last_clean":"2023-09-23T08:55:23.431753+0000","last_became_active":"2023-09-23T08:54:52.083094+0000","last_became_peered":"2023-09-23T08:54:52.083094+0000","last_unstale":"2023-09-23T08:55:23.431753+0000","last_undegraded":"2023-09-23T08:55:23.431753+0000","last_fullsized":"2023-09-23T08:55:23.431753+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:31:04.004340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"88'15","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.097750+0000","last_change":"2023-09-23T08:54:53.107671+0000","last_active":"2023-09-23T08:56:22.097750+0000","last_peered":"2023-09-23T08:56:22.097750+0000","last_clean":"2023-09-23T08:56:22.097750+0000","last_became_active":"2023-09-23T08:54:53.107372+0000","last_became_peered":"2023-09-23T08:54:53.107372+0000","last_unstale":"2023-09-23T08:56:22.097750+0000","last_undegraded":"2023-09-23T08:56:22.097750+0000","last_fullsized":"2023-09-23T08:56:22.097750+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T18:52:05.503710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"88'8","reported_seq":127,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:35.641915+0000","last_change":"2023-09-23T08:54:52.080556+0000","last_active":"2023-09-23T08:56:35.641915+0000","last_peered":"2023-09-23T08:56:35.641915+0000","last_clean":"2023-09-23T08:56:35.641915+0000","last_became_active":"2023-09-23T08:54:52.080220+0000","last_became_peered":"2023-09-23T08:54:52.080220+0000","last_unstale":"2023-09-23T08:56:35.641915+0000","last_undegraded":"2023-09-23T08:56:35.641915+0000","last_fullsized":"2023-09-23T08:56:35.641915+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:05:06.321996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1602,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":102,"num_read_kb":5,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"88'6","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.083467+0000","last_change":"2023-09-23T08:54:53.107044+0000","last_active":"2023-09-23T08:56:22.083467+0000","last_peered":"2023-09-23T08:56:22.083467+0000","last_clean":"2023-09-23T08:56:22.083467+0000","last_became_active":"2023-09-23T08:54:53.106715+0000","last_became_peered":"2023-09-23T08:54:53.106715+0000","last_unstale":"2023-09-23T08:56:22.083467+0000","last_undegraded":"2023-09-23T08:56:22.083467+0000","last_fullsized":"2023-09-23T08:56:22.083467+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T09:20:08.571706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"86'17","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.432200+0000","last_change":"2023-09-23T08:54:52.078052+0000","last_active":"2023-09-23T08:55:23.432200+0000","last_peered":"2023-09-23T08:55:23.432200+0000","last_clean":"2023-09-23T08:55:23.432200+0000","last_became_active":"2023-09-23T08:54:52.077678+0000","last_became_peered":"2023-09-23T08:54:52.077678+0000","last_unstale":"2023-09-23T08:55:23.432200+0000","last_undegraded":"2023-09-23T08:55:23.432200+0000","last_fullsized":"2023-09-23T08:55:23.432200+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T18:34:12.590233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"88'6","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.098976+0000","last_change":"2023-09-23T08:54:53.107673+0000","last_active":"2023-09-23T08:56:22.098976+0000","last_peered":"2023-09-23T08:56:22.098976+0000","last_clean":"2023-09-23T08:56:22.098976+0000","last_became_active":"2023-09-23T08:54:53.107373+0000","last_became_peered":"2023-09-23T08:54:53.107373+0000","last_unstale":"2023-09-23T08:56:22.098976+0000","last_undegraded":"2023-09-23T08:56:22.098976+0000","last_fullsized":"2023-09-23T08:56:22.098976+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T18:11:06.759793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"88'3","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.431740+0000","last_change":"2023-09-23T08:54:52.085460+0000","last_active":"2023-09-23T08:55:23.431740+0000","last_peered":"2023-09-23T08:55:23.431740+0000","last_clean":"2023-09-23T08:55:23.431740+0000","last_became_active":"2023-09-23T08:54:52.085186+0000","last_became_peered":"2023-09-23T08:54:52.085186+0000","last_unstale":"2023-09-23T08:55:23.431740+0000","last_undegraded":"2023-09-23T08:55:23.431740+0000","last_fullsized":"2023-09-23T08:55:23.431740+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T10:44:18.969355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"88'5","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.096477+0000","last_change":"2023-09-23T08:54:53.103630+0000","last_active":"2023-09-23T08:56:22.096477+0000","last_peered":"2023-09-23T08:56:22.096477+0000","last_clean":"2023-09-23T08:56:22.096477+0000","last_became_active":"2023-09-23T08:54:53.103270+0000","last_became_peered":"2023-09-23T08:54:53.103270+0000","last_unstale":"2023-09-23T08:56:22.096477+0000","last_undegraded":"2023-09-23T08:56:22.096477+0000","last_fullsized":"2023-09-23T08:56:22.096477+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T13:21:04.753974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"86'1","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.427814+0000","last_change":"2023-09-23T08:54:52.089279+0000","last_active":"2023-09-23T08:55:23.427814+0000","last_peered":"2023-09-23T08:55:23.427814+0000","last_clean":"2023-09-23T08:55:23.427814+0000","last_became_active":"2023-09-23T08:54:52.088861+0000","last_became_peered":"2023-09-23T08:54:52.088861+0000","last_unstale":"2023-09-23T08:55:23.427814+0000","last_undegraded":"2023-09-23T08:55:23.427814+0000","last_fullsized":"2023-09-23T08:55:23.427814+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T12:49:36.034399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"88'5","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.091248+0000","last_change":"2023-09-23T08:54:53.105653+0000","last_active":"2023-09-23T08:56:22.091248+0000","last_peered":"2023-09-23T08:56:22.091248+0000","last_clean":"2023-09-23T08:56:22.091248+0000","last_became_active":"2023-09-23T08:54:53.105309+0000","last_became_peered":"2023-09-23T08:54:53.105309+0000","last_unstale":"2023-09-23T08:56:22.091248+0000","last_undegraded":"2023-09-23T08:56:22.091248+0000","last_fullsized":"2023-09-23T08:56:22.091248+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T10:25:27.100946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"88'6","reported_seq":120,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:34.553871+0000","last_change":"2023-09-23T08:54:52.080521+0000","last_active":"2023-09-23T08:56:34.553871+0000","last_peered":"2023-09-23T08:56:34.553871+0000","last_clean":"2023-09-23T08:56:34.553871+0000","last_became_active":"2023-09-23T08:54:52.080164+0000","last_became_peered":"2023-09-23T08:54:52.080164+0000","last_unstale":"2023-09-23T08:56:34.553871+0000","last_undegraded":"2023-09-23T08:56:34.553871+0000","last_fullsized":"2023-09-23T08:56:34.553871+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T14:07:18.272863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1071,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"88'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.084429+0000","last_change":"2023-09-23T08:54:53.107516+0000","last_active":"2023-09-23T08:56:22.084429+0000","last_peered":"2023-09-23T08:56:22.084429+0000","last_clean":"2023-09-23T08:56:22.084429+0000","last_became_active":"2023-09-23T08:54:53.106785+0000","last_became_peered":"2023-09-23T08:54:53.106785+0000","last_unstale":"2023-09-23T08:56:22.084429+0000","last_undegraded":"2023-09-23T08:56:22.084429+0000","last_fullsized":"2023-09-23T08:56:22.084429+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T11:51:04.634599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"88'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.090187+0000","last_change":"2023-09-23T08:54:53.110406+0000","last_active":"2023-09-23T08:56:22.090187+0000","last_peered":"2023-09-23T08:56:22.090187+0000","last_clean":"2023-09-23T08:56:22.090187+0000","last_became_active":"2023-09-23T08:54:53.107758+0000","last_became_peered":"2023-09-23T08:54:53.107758+0000","last_unstale":"2023-09-23T08:56:22.090187+0000","last_undegraded":"2023-09-23T08:56:22.090187+0000","last_fullsized":"2023-09-23T08:56:22.090187+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T11:50:56.031628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"88'6","reported_seq":124,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:37.644087+0000","last_change":"2023-09-23T08:54:52.081384+0000","last_active":"2023-09-23T08:56:37.644087+0000","last_peered":"2023-09-23T08:56:37.644087+0000","last_clean":"2023-09-23T08:56:37.644087+0000","last_became_active":"2023-09-23T08:54:52.081082+0000","last_became_peered":"2023-09-23T08:54:52.081082+0000","last_unstale":"2023-09-23T08:56:37.644087+0000","last_undegraded":"2023-09-23T08:56:37.644087+0000","last_fullsized":"2023-09-23T08:56:37.644087+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:35:45.308145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"88'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.096426+0000","last_change":"2023-09-23T08:54:53.109011+0000","last_active":"2023-09-23T08:56:22.096426+0000","last_peered":"2023-09-23T08:56:22.096426+0000","last_clean":"2023-09-23T08:56:22.096426+0000","last_became_active":"2023-09-23T08:54:53.108520+0000","last_became_peered":"2023-09-23T08:54:53.108520+0000","last_unstale":"2023-09-23T08:56:22.096426+0000","last_undegraded":"2023-09-23T08:56:22.096426+0000","last_fullsized":"2023-09-23T08:56:22.096426+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:50:01.361084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"86'6","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.533656+0000","last_change":"2023-09-23T08:54:52.078525+0000","last_active":"2023-09-23T08:55:23.533656+0000","last_peered":"2023-09-23T08:55:23.533656+0000","last_clean":"2023-09-23T08:55:23.533656+0000","last_became_active":"2023-09-23T08:54:52.078177+0000","last_became_peered":"2023-09-23T08:54:52.078177+0000","last_unstale":"2023-09-23T08:55:23.533656+0000","last_undegraded":"2023-09-23T08:55:23.533656+0000","last_fullsized":"2023-09-23T08:55:23.533656+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:53:54.342881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":353,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.431236+0000","last_change":"2023-09-23T08:53:33.610965+0000","last_active":"2023-09-23T08:55:23.431236+0000","last_peered":"2023-09-23T08:55:23.431236+0000","last_clean":"2023-09-23T08:55:23.431236+0000","last_became_active":"2023-09-23T08:53:33.610529+0000","last_became_peered":"2023-09-23T08:53:33.610529+0000","last_unstale":"2023-09-23T08:55:23.431236+0000","last_undegraded":"2023-09-23T08:55:23.431236+0000","last_fullsized":"2023-09-23T08:55:23.431236+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:50:00.779071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:50:00.779071+0000","last_clean_scrub_stamp":"2023-09-23T08:50:00.779071+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:07:05.451303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"88'5","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.085480+0000","last_change":"2023-09-23T08:55:23.442747+0000","last_active":"2023-09-23T08:56:22.085480+0000","last_peered":"2023-09-23T08:56:22.085480+0000","last_clean":"2023-09-23T08:56:22.085480+0000","last_became_active":"2023-09-23T08:55:23.442328+0000","last_became_peered":"2023-09-23T08:55:23.442328+0000","last_unstale":"2023-09-23T08:56:22.085480+0000","last_undegraded":"2023-09-23T08:56:22.085480+0000","last_fullsized":"2023-09-23T08:56:22.085480+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T09:31:53.487979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"86'4","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.442345+0000","last_change":"2023-09-23T08:55:23.442345+0000","last_active":"2023-09-23T08:55:23.442345+0000","last_peered":"2023-09-23T08:55:23.442345+0000","last_clean":"2023-09-23T08:55:23.442345+0000","last_became_active":"2023-09-23T08:55:23.434799+0000","last_became_peered":"2023-09-23T08:55:23.434799+0000","last_unstale":"2023-09-23T08:55:23.442345+0000","last_undegraded":"2023-09-23T08:55:23.442345+0000","last_fullsized":"2023-09-23T08:55:23.442345+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T08:56:24.431145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"86'4","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.431996+0000","last_change":"2023-09-23T08:54:52.080482+0000","last_active":"2023-09-23T08:55:23.431996+0000","last_peered":"2023-09-23T08:55:23.431996+0000","last_clean":"2023-09-23T08:55:23.431996+0000","last_became_active":"2023-09-23T08:54:52.079756+0000","last_became_peered":"2023-09-23T08:54:52.079756+0000","last_unstale":"2023-09-23T08:55:23.431996+0000","last_undegraded":"2023-09-23T08:55:23.431996+0000","last_fullsized":"2023-09-23T08:55:23.431996+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:55:32.242149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"88'9","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.089453+0000","last_change":"2023-09-23T08:54:53.092828+0000","last_active":"2023-09-23T08:56:22.089453+0000","last_peered":"2023-09-23T08:56:22.089453+0000","last_clean":"2023-09-23T08:56:22.089453+0000","last_became_active":"2023-09-23T08:54:53.092486+0000","last_became_peered":"2023-09-23T08:54:53.092486+0000","last_unstale":"2023-09-23T08:56:22.089453+0000","last_undegraded":"2023-09-23T08:56:22.089453+0000","last_fullsized":"2023-09-23T08:56:22.089453+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T13:54:09.634679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"88'12","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:25.825380+0000","last_change":"2023-09-23T08:54:52.081801+0000","last_active":"2023-09-23T08:56:25.825380+0000","last_peered":"2023-09-23T08:56:25.825380+0000","last_clean":"2023-09-23T08:56:25.825380+0000","last_became_active":"2023-09-23T08:54:52.081449+0000","last_became_peered":"2023-09-23T08:54:52.081449+0000","last_unstale":"2023-09-23T08:56:25.825380+0000","last_undegraded":"2023-09-23T08:56:25.825380+0000","last_fullsized":"2023-09-23T08:56:25.825380+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T14:36:52.210295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"88'5","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.091904+0000","last_change":"2023-09-23T08:54:53.101037+0000","last_active":"2023-09-23T08:56:22.091904+0000","last_peered":"2023-09-23T08:56:22.091904+0000","last_clean":"2023-09-23T08:56:22.091904+0000","last_became_active":"2023-09-23T08:54:53.100673+0000","last_became_peered":"2023-09-23T08:54:53.100673+0000","last_unstale":"2023-09-23T08:56:22.091904+0000","last_undegraded":"2023-09-23T08:56:22.091904+0000","last_fullsized":"2023-09-23T08:56:22.091904+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:11:55.146162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"86'7","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.533765+0000","last_change":"2023-09-23T08:54:52.077785+0000","last_active":"2023-09-23T08:55:23.533765+0000","last_peered":"2023-09-23T08:55:23.533765+0000","last_clean":"2023-09-23T08:55:23.533765+0000","last_became_active":"2023-09-23T08:54:52.077306+0000","last_became_peered":"2023-09-23T08:54:52.077306+0000","last_unstale":"2023-09-23T08:55:23.533765+0000","last_undegraded":"2023-09-23T08:55:23.533765+0000","last_fullsized":"2023-09-23T08:55:23.533765+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T18:21:25.957376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"88'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.092590+0000","last_change":"2023-09-23T08:54:53.106534+0000","last_active":"2023-09-23T08:56:22.092590+0000","last_peered":"2023-09-23T08:56:22.092590+0000","last_clean":"2023-09-23T08:56:22.092590+0000","last_became_active":"2023-09-23T08:54:53.105928+0000","last_became_peered":"2023-09-23T08:54:53.105928+0000","last_unstale":"2023-09-23T08:56:22.092590+0000","last_undegraded":"2023-09-23T08:56:22.092590+0000","last_fullsized":"2023-09-23T08:56:22.092590+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:25:27.390043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.444909+0000","last_change":"2023-09-23T08:55:23.444909+0000","last_active":"2023-09-23T08:55:23.444909+0000","last_peered":"2023-09-23T08:55:23.444909+0000","last_clean":"2023-09-23T08:55:23.444909+0000","last_became_active":"2023-09-23T08:55:23.440885+0000","last_became_peered":"2023-09-23T08:55:23.440885+0000","last_unstale":"2023-09-23T08:55:23.444909+0000","last_undegraded":"2023-09-23T08:55:23.444909+0000","last_fullsized":"2023-09-23T08:55:23.444909+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T14:07:59.974769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"88'2","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.052548+0000","last_change":"2023-09-23T08:54:53.106050+0000","last_active":"2023-09-23T08:56:22.052548+0000","last_peered":"2023-09-23T08:56:22.052548+0000","last_clean":"2023-09-23T08:56:22.052548+0000","last_became_active":"2023-09-23T08:54:53.105729+0000","last_became_peered":"2023-09-23T08:54:53.105729+0000","last_unstale":"2023-09-23T08:56:22.052548+0000","last_undegraded":"2023-09-23T08:56:22.052548+0000","last_fullsized":"2023-09-23T08:56:22.052548+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:59:01.529109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"86'7","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.438306+0000","last_change":"2023-09-23T08:54:52.086019+0000","last_active":"2023-09-23T08:55:23.438306+0000","last_peered":"2023-09-23T08:55:23.438306+0000","last_clean":"2023-09-23T08:55:23.438306+0000","last_became_active":"2023-09-23T08:54:52.085688+0000","last_became_peered":"2023-09-23T08:54:52.085688+0000","last_unstale":"2023-09-23T08:55:23.438306+0000","last_undegraded":"2023-09-23T08:55:23.438306+0000","last_fullsized":"2023-09-23T08:55:23.438306+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T13:39:29.745763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"88'9","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.091491+0000","last_change":"2023-09-23T08:54:53.099533+0000","last_active":"2023-09-23T08:56:22.091491+0000","last_peered":"2023-09-23T08:56:22.091491+0000","last_clean":"2023-09-23T08:56:22.091491+0000","last_became_active":"2023-09-23T08:54:53.099192+0000","last_became_peered":"2023-09-23T08:54:53.099192+0000","last_unstale":"2023-09-23T08:56:22.091491+0000","last_undegraded":"2023-09-23T08:56:22.091491+0000","last_fullsized":"2023-09-23T08:56:22.091491+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:21:20.608655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"88'5","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:36.470170+0000","last_change":"2023-09-23T08:54:52.086258+0000","last_active":"2023-09-23T08:56:36.470170+0000","last_peered":"2023-09-23T08:56:36.470170+0000","last_clean":"2023-09-23T08:56:36.470170+0000","last_became_active":"2023-09-23T08:54:52.085935+0000","last_became_peered":"2023-09-23T08:54:52.085935+0000","last_unstale":"2023-09-23T08:56:36.470170+0000","last_undegraded":"2023-09-23T08:56:36.470170+0000","last_fullsized":"2023-09-23T08:56:36.470170+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:20:00.595412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"88'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.099984+0000","last_change":"2023-09-23T08:54:53.105176+0000","last_active":"2023-09-23T08:56:22.099984+0000","last_peered":"2023-09-23T08:56:22.099984+0000","last_clean":"2023-09-23T08:56:22.099984+0000","last_became_active":"2023-09-23T08:54:53.104794+0000","last_became_peered":"2023-09-23T08:54:53.104794+0000","last_unstale":"2023-09-23T08:56:22.099984+0000","last_undegraded":"2023-09-23T08:56:22.099984+0000","last_fullsized":"2023-09-23T08:56:22.099984+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:38:26.392477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.431709+0000","last_change":"2023-09-23T08:54:52.078596+0000","last_active":"2023-09-23T08:55:23.431709+0000","last_peered":"2023-09-23T08:55:23.431709+0000","last_clean":"2023-09-23T08:55:23.431709+0000","last_became_active":"2023-09-23T08:54:52.078310+0000","last_became_peered":"2023-09-23T08:54:52.078310+0000","last_unstale":"2023-09-23T08:55:23.431709+0000","last_undegraded":"2023-09-23T08:55:23.431709+0000","last_fullsized":"2023-09-23T08:55:23.431709+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T10:44:34.943157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"88'5","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.098797+0000","last_change":"2023-09-23T08:54:53.106368+0000","last_active":"2023-09-23T08:56:22.098797+0000","last_peered":"2023-09-23T08:56:22.098797+0000","last_clean":"2023-09-23T08:56:22.098797+0000","last_became_active":"2023-09-23T08:54:53.105977+0000","last_became_peered":"2023-09-23T08:54:53.105977+0000","last_unstale":"2023-09-23T08:56:22.098797+0000","last_undegraded":"2023-09-23T08:56:22.098797+0000","last_fullsized":"2023-09-23T08:56:22.098797+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T14:38:50.938221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"88'6","reported_seq":126,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:37.679550+0000","last_change":"2023-09-23T08:54:52.089221+0000","last_active":"2023-09-23T08:56:37.679550+0000","last_peered":"2023-09-23T08:56:37.679550+0000","last_clean":"2023-09-23T08:56:37.679550+0000","last_became_active":"2023-09-23T08:54:52.088824+0000","last_became_peered":"2023-09-23T08:54:52.088824+0000","last_unstale":"2023-09-23T08:56:37.679550+0000","last_undegraded":"2023-09-23T08:56:37.679550+0000","last_fullsized":"2023-09-23T08:56:37.679550+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T11:18:12.157604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1653,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":102,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"88'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.099408+0000","last_change":"2023-09-23T08:54:53.107600+0000","last_active":"2023-09-23T08:56:22.099408+0000","last_peered":"2023-09-23T08:56:22.099408+0000","last_clean":"2023-09-23T08:56:22.099408+0000","last_became_active":"2023-09-23T08:54:53.105637+0000","last_became_peered":"2023-09-23T08:54:53.105637+0000","last_unstale":"2023-09-23T08:56:22.099408+0000","last_undegraded":"2023-09-23T08:56:22.099408+0000","last_fullsized":"2023-09-23T08:56:22.099408+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T13:51:08.460345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"86'3","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.431985+0000","last_change":"2023-09-23T08:54:52.081912+0000","last_active":"2023-09-23T08:55:23.431985+0000","last_peered":"2023-09-23T08:55:23.431985+0000","last_clean":"2023-09-23T08:55:23.431985+0000","last_became_active":"2023-09-23T08:54:52.081668+0000","last_became_peered":"2023-09-23T08:54:52.081668+0000","last_unstale":"2023-09-23T08:55:23.431985+0000","last_undegraded":"2023-09-23T08:55:23.431985+0000","last_fullsized":"2023-09-23T08:55:23.431985+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:38:42.963347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"88'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.091654+0000","last_change":"2023-09-23T08:54:53.106975+0000","last_active":"2023-09-23T08:56:22.091654+0000","last_peered":"2023-09-23T08:56:22.091654+0000","last_clean":"2023-09-23T08:56:22.091654+0000","last_became_active":"2023-09-23T08:54:53.106537+0000","last_became_peered":"2023-09-23T08:54:53.106537+0000","last_unstale":"2023-09-23T08:56:22.091654+0000","last_undegraded":"2023-09-23T08:56:22.091654+0000","last_fullsized":"2023-09-23T08:56:22.091654+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T11:16:12.417441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"86'5","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:55:23.539010+0000","last_change":"2023-09-23T08:55:23.539010+0000","last_active":"2023-09-23T08:55:23.539010+0000","last_peered":"2023-09-23T08:55:23.539010+0000","last_clean":"2023-09-23T08:55:23.539010+0000","last_became_active":"2023-09-23T08:55:23.534858+0000","last_became_peered":"2023-09-23T08:55:23.534858+0000","last_unstale":"2023-09-23T08:55:23.539010+0000","last_undegraded":"2023-09-23T08:55:23.539010+0000","last_fullsized":"2023-09-23T08:55:23.539010+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:51.048811+0000","last_clean_scrub_stamp":"2023-09-23T08:54:51.048811+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T12:04:40.067871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"88'9","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.088734+0000","last_change":"2023-09-23T08:54:53.109625+0000","last_active":"2023-09-23T08:56:22.088734+0000","last_peered":"2023-09-23T08:56:22.088734+0000","last_clean":"2023-09-23T08:56:22.088734+0000","last_became_active":"2023-09-23T08:54:53.109323+0000","last_became_peered":"2023-09-23T08:54:53.109323+0000","last_unstale":"2023-09-23T08:56:22.088734+0000","last_undegraded":"2023-09-23T08:56:22.088734+0000","last_fullsized":"2023-09-23T08:56:22.088734+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T12:38:52.169862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"88'9","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.092147+0000","last_change":"2023-09-23T08:55:23.438659+0000","last_active":"2023-09-23T08:56:22.092147+0000","last_peered":"2023-09-23T08:56:22.092147+0000","last_clean":"2023-09-23T08:56:22.092147+0000","last_became_active":"2023-09-23T08:55:23.438227+0000","last_became_peered":"2023-09-23T08:55:23.438227+0000","last_unstale":"2023-09-23T08:56:22.092147+0000","last_undegraded":"2023-09-23T08:56:22.092147+0000","last_fullsized":"2023-09-23T08:56:22.092147+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:03:51.636352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"88'12","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.085926+0000","last_change":"2023-09-23T08:54:53.101001+0000","last_active":"2023-09-23T08:56:22.085926+0000","last_peered":"2023-09-23T08:56:22.085926+0000","last_clean":"2023-09-23T08:56:22.085926+0000","last_became_active":"2023-09-23T08:54:53.100315+0000","last_became_peered":"2023-09-23T08:54:53.100315+0000","last_unstale":"2023-09-23T08:56:22.085926+0000","last_undegraded":"2023-09-23T08:56:22.085926+0000","last_fullsized":"2023-09-23T08:56:22.085926+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T20:08:51.255938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"88'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.092225+0000","last_change":"2023-09-23T08:54:53.102855+0000","last_active":"2023-09-23T08:56:22.092225+0000","last_peered":"2023-09-23T08:56:22.092225+0000","last_clean":"2023-09-23T08:56:22.092225+0000","last_became_active":"2023-09-23T08:54:53.102495+0000","last_became_peered":"2023-09-23T08:54:53.102495+0000","last_unstale":"2023-09-23T08:56:22.092225+0000","last_undegraded":"2023-09-23T08:56:22.092225+0000","last_fullsized":"2023-09-23T08:56:22.092225+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T11:30:08.512122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"88'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.094014+0000","last_change":"2023-09-23T08:54:53.102063+0000","last_active":"2023-09-23T08:56:22.094014+0000","last_peered":"2023-09-23T08:56:22.094014+0000","last_clean":"2023-09-23T08:56:22.094014+0000","last_became_active":"2023-09-23T08:54:53.101734+0000","last_became_peered":"2023-09-23T08:54:53.101734+0000","last_unstale":"2023-09-23T08:56:22.094014+0000","last_undegraded":"2023-09-23T08:56:22.094014+0000","last_fullsized":"2023-09-23T08:56:22.094014+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T18:20:09.964230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"88'4","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.085117+0000","last_change":"2023-09-23T08:54:53.110291+0000","last_active":"2023-09-23T08:56:22.085117+0000","last_peered":"2023-09-23T08:56:22.085117+0000","last_clean":"2023-09-23T08:56:22.085117+0000","last_became_active":"2023-09-23T08:54:53.109962+0000","last_became_peered":"2023-09-23T08:54:53.109962+0000","last_unstale":"2023-09-23T08:56:22.085117+0000","last_undegraded":"2023-09-23T08:56:22.085117+0000","last_fullsized":"2023-09-23T08:56:22.085117+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T13:59:01.304290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"88'6","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.084223+0000","last_change":"2023-09-23T08:54:53.104278+0000","last_active":"2023-09-23T08:56:22.084223+0000","last_peered":"2023-09-23T08:56:22.084223+0000","last_clean":"2023-09-23T08:56:22.084223+0000","last_became_active":"2023-09-23T08:54:53.103765+0000","last_became_peered":"2023-09-23T08:54:53.103765+0000","last_unstale":"2023-09-23T08:56:22.084223+0000","last_undegraded":"2023-09-23T08:56:22.084223+0000","last_fullsized":"2023-09-23T08:56:22.084223+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:27:28.306515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"88'15","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.098180+0000","last_change":"2023-09-23T08:54:53.104861+0000","last_active":"2023-09-23T08:56:22.098180+0000","last_peered":"2023-09-23T08:56:22.098180+0000","last_clean":"2023-09-23T08:56:22.098180+0000","last_became_active":"2023-09-23T08:54:53.104554+0000","last_became_peered":"2023-09-23T08:54:53.104554+0000","last_unstale":"2023-09-23T08:56:22.098180+0000","last_undegraded":"2023-09-23T08:56:22.098180+0000","last_fullsized":"2023-09-23T08:56:22.098180+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:22:47.174867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"88'2","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.096180+0000","last_change":"2023-09-23T08:54:53.106859+0000","last_active":"2023-09-23T08:56:22.096180+0000","last_peered":"2023-09-23T08:56:22.096180+0000","last_clean":"2023-09-23T08:56:22.096180+0000","last_became_active":"2023-09-23T08:54:53.106494+0000","last_became_peered":"2023-09-23T08:54:53.106494+0000","last_unstale":"2023-09-23T08:56:22.096180+0000","last_undegraded":"2023-09-23T08:56:22.096180+0000","last_fullsized":"2023-09-23T08:56:22.096180+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T18:25:26.029504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"88'6","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.091618+0000","last_change":"2023-09-23T08:54:53.101591+0000","last_active":"2023-09-23T08:56:22.091618+0000","last_peered":"2023-09-23T08:56:22.091618+0000","last_clean":"2023-09-23T08:56:22.091618+0000","last_became_active":"2023-09-23T08:54:53.101237+0000","last_became_peered":"2023-09-23T08:54:53.101237+0000","last_unstale":"2023-09-23T08:56:22.091618+0000","last_undegraded":"2023-09-23T08:56:22.091618+0000","last_fullsized":"2023-09-23T08:56:22.091618+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T11:22:22.863330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"88'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.089724+0000","last_change":"2023-09-23T08:54:53.103373+0000","last_active":"2023-09-23T08:56:22.089724+0000","last_peered":"2023-09-23T08:56:22.089724+0000","last_clean":"2023-09-23T08:56:22.089724+0000","last_became_active":"2023-09-23T08:54:53.102948+0000","last_became_peered":"2023-09-23T08:54:53.102948+0000","last_unstale":"2023-09-23T08:56:22.089724+0000","last_undegraded":"2023-09-23T08:56:22.089724+0000","last_fullsized":"2023-09-23T08:56:22.089724+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:39:31.898539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"88'10","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.100654+0000","last_change":"2023-09-23T08:54:53.100488+0000","last_active":"2023-09-23T08:56:22.100654+0000","last_peered":"2023-09-23T08:56:22.100654+0000","last_clean":"2023-09-23T08:56:22.100654+0000","last_became_active":"2023-09-23T08:54:53.100182+0000","last_became_peered":"2023-09-23T08:54:53.100182+0000","last_unstale":"2023-09-23T08:56:22.100654+0000","last_undegraded":"2023-09-23T08:56:22.100654+0000","last_fullsized":"2023-09-23T08:56:22.100654+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:13:20.648791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"88'11","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.086910+0000","last_change":"2023-09-23T08:54:53.097571+0000","last_active":"2023-09-23T08:56:22.086910+0000","last_peered":"2023-09-23T08:56:22.086910+0000","last_clean":"2023-09-23T08:56:22.086910+0000","last_became_active":"2023-09-23T08:54:53.097278+0000","last_became_peered":"2023-09-23T08:54:53.097278+0000","last_unstale":"2023-09-23T08:56:22.086910+0000","last_undegraded":"2023-09-23T08:56:22.086910+0000","last_fullsized":"2023-09-23T08:56:22.086910+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T11:32:37.554404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"88'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:56:22.096985+0000","last_change":"2023-09-23T08:54:53.113543+0000","last_active":"2023-09-23T08:56:22.096985+0000","last_peered":"2023-09-23T08:56:22.096985+0000","last_clean":"2023-09-23T08:56:22.096985+0000","last_became_active":"2023-09-23T08:54:53.113287+0000","last_became_peered":"2023-09-23T08:54:53.113287+0000","last_unstale":"2023-09-23T08:56:22.096985+0000","last_undegraded":"2023-09-23T08:56:22.096985+0000","last_fullsized":"2023-09-23T08:56:22.096985+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T08:54:52.057782+0000","last_clean_scrub_stamp":"2023-09-23T08:54:52.057782+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:56:48.219279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":67624,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1003,"num_read_kb":571,"num_write":258,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":211512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":223,"ondisk_log_size":223,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892351012,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":958464,"data_stored":460369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:55:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.68899999999999995,"15min":0.68500000000000005},"min":{"1min":0.497,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.752,"15min":0.74399999999999999},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":0.77500000000000002}]},{"osd":1,"last update":"Sat Sep 23 08:55:59 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.72099999999999997,"15min":0.70699999999999996},"min":{"1min":0.54800000000000004,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0269999999999999,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.76500000000000001,"15min":0.75700000000000001},"min":{"1min":0.59399999999999997,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.95599999999999996,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.91500000000000004}]},{"osd":2,"last update":"Sat Sep 23 08:55:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64700000000000002,"15min":0.64800000000000002},"min":{"1min":0.35999999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.98799999999999999,"5min":1.141,"15min":1.141},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.621,"5min":0.65700000000000003,"15min":0.66300000000000003},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.91000000000000003,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.63100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":4,"last update":"Sat Sep 23 08:55:59 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.79300000000000004,"15min":0.78000000000000003},"min":{"1min":0.59499999999999997,"5min":0.379,"15min":0.379},"max":{"1min":1.105,"5min":1.179,"15min":1.179},"last":0.98199999999999998},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.86899999999999999,"15min":0.872},"min":{"1min":0.63300000000000001,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.008,"5min":1.673,"15min":1.673},"last":0.96899999999999997}]},{"osd":5,"last update":"Sat Sep 23 08:55:59 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.79700000000000004,"15min":0.80300000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.075,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.78100000000000003,"15min":0.77700000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.0309999999999999,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.88500000000000001}]},{"osd":6,"last update":"Sat Sep 23 08:55:59 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.89500000000000002,"15min":0.90600000000000003},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.2909999999999999,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.755},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.90600000000000003,"15min":0.90800000000000003},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.2350000000000001,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":1.1040000000000001}]},{"osd":7,"last update":"Sat Sep 23 08:55:59 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.91800000000000004,"15min":0.91200000000000003},"min":{"1min":0.67200000000000004,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.228,"5min":1.25,"15min":1.25},"last":1.0680000000000001},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.69899999999999995,"5min":0.625,"15min":0.625},"max":{"1min":1.1899999999999999,"5min":1.74,"15min":1.74},"last":1.0189999999999999}]},{"osd":8,"last update":"Sat Sep 23 08:55:55 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":1.1200000000000001},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":1.0329999999999999}]},{"osd":9,"last update":"Sat Sep 23 08:55:59 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":0.98799999999999999,"15min":0.98499999999999999},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.3169999999999999,"5min":1.365,"15min":1.365},"last":1.002},{"interface":"front","average":{"1min":1.0429999999999999,"5min":0.96699999999999997,"15min":0.95399999999999996},"min":{"1min":0.71799999999999997,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":1.1359999999999999}]},{"osd":10,"last update":"Sat Sep 23 08:55:59 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.052,"15min":1.052},"min":{"1min":0.73399999999999999,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.274,"5min":2.3410000000000002,"15min":2.3410000000000002},"last":1.0880000000000001},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.0149999999999999,"15min":1.0089999999999999},"min":{"1min":0.748,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.3340000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":1.1519999999999999}]}]},{"osd":10,"up_from":73,"seq":313532612649,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28636,"kb_used_data":1620,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716516,"statfs":{"total":95995035648,"available":95965712384,"internally_reserved":0,"allocated":1658880,"data_stored":1110143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:55:52 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.8380000000000001,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.853,"5min":1.853,"15min":1.853},"last":0.75}]},{"osd":1,"last update":"Sat Sep 23 08:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.55300000000000005,"15min":0.56299999999999994},"min":{"1min":0.36499999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.77900000000000003,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.442},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.61799999999999999,"15min":0.621},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.88600000000000001,"5min":1.417,"15min":1.417},"last":0.42399999999999999}]},{"osd":2,"last update":"Sat Sep 23 08:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.752,"15min":0.76300000000000001},"min":{"1min":0.52700000000000002,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.996,"5min":1.214,"15min":1.214},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.754,"15min":0.76000000000000001},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.97899999999999998,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.79100000000000004}]},{"osd":3,"last update":"Sat Sep 23 08:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.80300000000000005,"15min":0.82299999999999995},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.7210000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.754,"5min":0.78700000000000003,"15min":0.79300000000000004},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.8899999999999999,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":0.72699999999999998}]},{"osd":4,"last update":"Sat Sep 23 08:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.67600000000000005,"15min":0.68700000000000006},"min":{"1min":0.45800000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.81200000000000006,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.74399999999999999,"15min":0.76800000000000002},"min":{"1min":0.42899999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.80300000000000005,"5min":1.448,"15min":1.448},"last":0.47899999999999998}]},{"osd":5,"last update":"Sat Sep 23 08:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.82399999999999995,"15min":0.82999999999999996},"min":{"1min":0.54300000000000004,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.089,"5min":1.423,"15min":1.423},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.877,"15min":0.89700000000000002},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.109,"5min":1.333,"15min":1.333},"last":0.76900000000000002}]},{"osd":6,"last update":"Sat Sep 23 08:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.88200000000000001,"15min":0.90000000000000002},"min":{"1min":0.55800000000000005,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.738,"5min":1.738,"15min":1.738},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.91100000000000003,"15min":0.92500000000000004},"min":{"1min":0.60799999999999998,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.8160000000000001,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.61799999999999999}]},{"osd":7,"last update":"Sat Sep 23 08:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.52500000000000002}]},{"osd":8,"last update":"Sat Sep 23 08:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.90900000000000003,"15min":0.92100000000000004},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.133,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.95999999999999996,"15min":0.98899999999999999},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.073,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":0.80900000000000005}]},{"osd":9,"last update":"Sat Sep 23 08:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.97999999999999998,"15min":0.99299999999999999},"min":{"1min":0.71899999999999997,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.7729999999999999,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.996,"15min":1.022},"min":{"1min":0.65800000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.794,"5min":1.794,"15min":1.794},"last":0.68100000000000005}]},{"osd":11,"last update":"Sat Sep 23 08:56:02 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.86499999999999999,"15min":0.87},"min":{"1min":0.68500000000000005,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.038,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.79200000000000004,"5min":0.626,"15min":0.626},"max":{"1min":1.0549999999999999,"5min":1.135,"15min":1.135},"last":0.85899999999999999}]}]},{"osd":9,"up_from":68,"seq":292057776173,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":983040,"data_stored":459816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:56:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.54800000000000004,"15min":0.53300000000000003},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":4.9619999999999997,"5min":4.9619999999999997,"15min":4.9619999999999997},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.56799999999999995,"15min":0.57199999999999995},"min":{"1min":0.35699999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":2.5299999999999998,"5min":2.5299999999999998,"15min":2.5299999999999998},"last":0.35499999999999998}]},{"osd":1,"last update":"Sat Sep 23 08:56:07 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.78100000000000003,"15min":0.79700000000000004},"min":{"1min":0.51800000000000002,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":3.4319999999999999,"5min":3.4319999999999999,"15min":3.4319999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.71499999999999997,"15min":0.74299999999999999},"min":{"1min":0.46700000000000003,"5min":0.375,"15min":0.375},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.68000000000000005}]},{"osd":2,"last update":"Sat Sep 23 08:56:07 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.78100000000000003,"15min":0.79600000000000004},"min":{"1min":0.52900000000000003,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":3.399,"5min":3.399,"15min":3.399},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.71599999999999997,"15min":0.748},"min":{"1min":0.47599999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.65200000000000002}]},{"osd":3,"last update":"Sat Sep 23 08:56:07 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.63300000000000001,"15min":0.64100000000000001},"min":{"1min":0.36399999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":2.5009999999999999,"5min":2.5009999999999999,"15min":2.5009999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.69399999999999995,"15min":0.69999999999999996},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":3.6000000000000001,"5min":3.6000000000000001,"15min":3.6000000000000001},"last":0.47899999999999998}]},{"osd":4,"last update":"Sat Sep 23 08:56:07 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.81599999999999995,"15min":0.82799999999999996},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":2.7879999999999998,"5min":2.7879999999999998,"15min":2.7879999999999998},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.84399999999999997,"15min":0.85599999999999998},"min":{"1min":0.59999999999999998,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":3.5579999999999998,"5min":3.5579999999999998,"15min":3.5579999999999998},"last":0.69099999999999995}]},{"osd":5,"last update":"Sat Sep 23 08:56:07 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.79700000000000004,"15min":0.81799999999999995},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":2.3999999999999999,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.85899999999999999,"15min":0.88100000000000001},"min":{"1min":0.56299999999999994,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":3.359,"5min":3.359,"15min":3.359},"last":0.66800000000000004}]},{"osd":6,"last update":"Sat Sep 23 08:56:07 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.71599999999999997,"15min":0.72199999999999998},"min":{"1min":0.45200000000000001,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":3.5169999999999999,"5min":3.5169999999999999,"15min":3.5169999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.755,"5min":0.79900000000000004,"15min":0.81399999999999995},"min":{"1min":0.46200000000000002,"5min":0.44,"15min":0.44},"max":{"1min":2.3599999999999999,"5min":2.3599999999999999,"15min":2.3599999999999999},"last":0.61699999999999999}]},{"osd":7,"last update":"Sat Sep 23 08:56:07 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.1160000000000001,"15min":1.1970000000000001},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":3.4940000000000002,"5min":7.0759999999999996,"15min":7.0759999999999996},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.84499999999999997,"15min":0.876},"min":{"1min":0.56899999999999995,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.74199999999999999}]},{"osd":8,"last update":"Sat Sep 23 08:56:07 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.84499999999999997,"15min":0.88100000000000001},"min":{"1min":0.60199999999999998,"5min":0.501,"15min":0.501},"max":{"1min":1.1919999999999999,"5min":1.226,"15min":1.226},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.90000000000000002,"15min":0.92400000000000004},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":2.4319999999999999,"5min":2.4319999999999999,"15min":2.4319999999999999},"last":0.753}]},{"osd":10,"last update":"Sat Sep 23 08:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.70199999999999996,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.6299999999999999,"5min":3.4630000000000001,"15min":3.4630000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.89300000000000002,"15min":0.91500000000000004},"min":{"1min":0.69099999999999995,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.456,"5min":1.456,"15min":1.456},"last":0.71999999999999997}]}]},{"osd":8,"up_from":60,"seq":257698037810,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":970752,"data_stored":459522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.68700000000000006,"15min":0.68899999999999995},"min":{"1min":0.45100000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.67800000000000005,"15min":0.68999999999999995},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.58299999999999996}]},{"osd":1,"last update":"Sat Sep 23 08:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.82299999999999995,"15min":0.81399999999999995},"min":{"1min":0.54100000000000004,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.754,"15min":0.746},"min":{"1min":0.59599999999999997,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.61699999999999999}]},{"osd":2,"last update":"Sat Sep 23 08:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.61299999999999999,"15min":0.60699999999999998},"min":{"1min":0.38300000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.59899999999999998,"15min":0.58899999999999997},"min":{"1min":0.432,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.85399999999999998,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.83399999999999996}]},{"osd":3,"last update":"Sat Sep 23 08:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.747,"15min":0.78100000000000003},"min":{"1min":0.54500000000000004,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.96099999999999997,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.81899999999999995,"15min":0.82999999999999996},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.97399999999999998,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.77000000000000002}]},{"osd":4,"last update":"Sat Sep 23 08:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.80100000000000005,"15min":0.80400000000000005},"min":{"1min":0.56299999999999994,"5min":0.439,"15min":0.439},"max":{"1min":1.024,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.96199999999999997,"15min":1},"min":{"1min":0.627,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.181,"5min":3.7530000000000001,"15min":3.7530000000000001},"last":0.875}]},{"osd":5,"last update":"Sat Sep 23 08:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.70799999999999996,"15min":0.71399999999999997},"min":{"1min":0.51100000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.995,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.76000000000000001,"15min":0.77400000000000002},"min":{"1min":0.51000000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.0760000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.86299999999999999}]},{"osd":6,"last update":"Sat Sep 23 08:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.89900000000000002,"15min":0.90800000000000003},"min":{"1min":0.59399999999999997,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.871,"15min":0.878},"min":{"1min":0.66800000000000004,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":0.94199999999999995}]},{"osd":7,"last update":"Sat Sep 23 08:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.88400000000000001,"15min":0.88300000000000001},"min":{"1min":0.71599999999999997,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.1619999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":1.097},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.91300000000000003,"15min":0.92800000000000005},"min":{"1min":0.68600000000000005,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.258,"5min":1.679,"15min":1.679},"last":0.91400000000000003}]},{"osd":9,"last update":"Sat Sep 23 08:56:09 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.871,"15min":0.84499999999999997},"min":{"1min":0.69299999999999995,"5min":0.498,"15min":0.498},"max":{"1min":1.333,"5min":1.333,"15min":1.333},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.89400000000000002,"15min":0.88400000000000001},"min":{"1min":0.69599999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.349,"5min":1.349,"15min":1.349},"last":1.0189999999999999}]},{"osd":10,"last update":"Sat Sep 23 08:56:35 2023","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":0.90300000000000002,"15min":0.85299999999999998},"min":{"1min":0.72699999999999998,"5min":0.629,"15min":0.629},"max":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.95799999999999996},{"interface":"front","average":{"1min":1.0700000000000001,"5min":0.94899999999999995,"15min":0.90000000000000002},"min":{"1min":0.85399999999999998,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":1.002}]},{"osd":11,"last update":"Sat Sep 23 08:55:56 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":1.0609999999999999},{"interface":"front","average":{"1min":1.111,"5min":1.111,"15min":1.111},"min":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":1.044}]}]},{"osd":7,"up_from":52,"seq":223338299448,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28548,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716604,"statfs":{"total":95995035648,"available":95965802496,"internally_reserved":0,"allocated":1568768,"data_stored":1054234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:54:15 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.627,"15min":0.621},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.59799999999999998,"15min":0.58599999999999997},"min":{"1min":0.48399999999999999,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.53800000000000003}]},{"osd":1,"last update":"Sat Sep 23 08:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.51200000000000001,"15min":0.51000000000000001},"min":{"1min":0.34300000000000003,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.67300000000000004,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.53800000000000003,"15min":0.53600000000000003},"min":{"1min":0.38900000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.86299999999999999,"5min":0.999,"15min":0.999},"last":0.71499999999999997}]},{"osd":2,"last update":"Sat Sep 23 08:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.747,"15min":0.747},"min":{"1min":0.51700000000000002,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.998,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.745},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72899999999999998,"15min":0.73099999999999998},"min":{"1min":0.59699999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.86399999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.997}]},{"osd":3,"last update":"Sat Sep 23 08:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.66800000000000004,"15min":0.66300000000000003},"min":{"1min":0.48399999999999999,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.88500000000000001,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.71099999999999997,"15min":0.72499999999999998},"min":{"1min":0.501,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.80500000000000005}]},{"osd":4,"last update":"Sat Sep 23 08:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.68500000000000005,"15min":0.70699999999999996},"min":{"1min":0.47299999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.95599999999999996,"5min":1.04,"15min":1.04},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.65000000000000002,"15min":0.68600000000000005},"min":{"1min":0.42799999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.72699999999999998,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.54800000000000004}]},{"osd":5,"last update":"Sat Sep 23 08:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.80600000000000005,"15min":0.80800000000000005},"min":{"1min":0.63800000000000001,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.0169999999999999,"5min":1.089,"15min":1.089},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.79000000000000004,"15min":0.80600000000000005},"min":{"1min":0.54500000000000004,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.98299999999999998,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.92400000000000004}]},{"osd":6,"last update":"Sat Sep 23 08:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.81200000000000006,"15min":0.82599999999999996},"min":{"1min":0.55300000000000005,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0069999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.80000000000000004,"15min":0.82099999999999995},"min":{"1min":0.63100000000000001,"5min":0.502,"15min":0.502},"max":{"1min":1.0449999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.69399999999999995}]},{"osd":8,"last update":"Sat Sep 23 08:55:39 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.84199999999999997,"15min":0.81999999999999995},"min":{"1min":0.65800000000000003,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.88},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.84199999999999997,"15min":0.83799999999999997},"min":{"1min":0.64900000000000002,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.0580000000000001,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":1.0369999999999999}]},{"osd":9,"last update":"Sat Sep 23 08:56:05 2023","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":0.91100000000000003,"15min":0.872},"min":{"1min":0.67600000000000005,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":4.9400000000000004,"5min":4.9400000000000004,"15min":4.9400000000000004},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.84599999999999997,"15min":0.84899999999999998},"min":{"1min":0.61899999999999999,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.96499999999999997,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.78500000000000003}]},{"osd":10,"last update":"Sat Sep 23 08:55:36 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.874,"15min":0.88},"min":{"1min":0.60699999999999998,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.01,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":1.0640000000000001},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.89800000000000002,"15min":0.90600000000000003},"min":{"1min":0.67700000000000005,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":0.98799999999999999,"5min":1.117,"15min":1.117},"last":0.96899999999999997}]},{"osd":11,"last update":"Sat Sep 23 08:55:56 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":1.087},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.98499999999999999}]}]},{"osd":6,"up_from":47,"seq":201863462975,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":966656,"data_stored":460022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:55:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.46800000000000003,"15min":0.44},"min":{"1min":0.33300000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.49299999999999999,"15min":0.47099999999999997},"min":{"1min":0.33300000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.52600000000000002}]},{"osd":1,"last update":"Sat Sep 23 08:55:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.67500000000000004,"15min":0.63300000000000001},"min":{"1min":0.442,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.70899999999999996,"15min":0.66900000000000004},"min":{"1min":0.53400000000000003,"5min":0.498,"15min":0.498},"max":{"1min":1.637,"5min":1.637,"15min":1.637},"last":0.82199999999999995}]},{"osd":2,"last update":"Sat Sep 23 08:55:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68200000000000005,"15min":0.66400000000000003},"min":{"1min":0.496,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.71499999999999997,"15min":0.69299999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0760000000000001,"5min":1.143,"15min":1.143},"last":0.55000000000000004}]},{"osd":3,"last update":"Sat Sep 23 08:55:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.58999999999999997,"15min":0.57999999999999996},"min":{"1min":0.38300000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.624,"5min":0.61799999999999999,"15min":0.60199999999999998},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.433}]},{"osd":4,"last update":"Sat Sep 23 08:55:47 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.71899999999999997,"15min":0.71699999999999997},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.75800000000000001,"15min":0.73399999999999999},"min":{"1min":0.498,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.77200000000000002}]},{"osd":5,"last update":"Sat Sep 23 08:55:47 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.76400000000000001,"15min":0.72999999999999998},"min":{"1min":0.49199999999999999,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.76700000000000002,"15min":0.76100000000000001},"min":{"1min":0.56100000000000005,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.5820000000000001,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.626}]},{"osd":7,"last update":"Sat Sep 23 08:56:17 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.81399999999999995,"15min":0.76100000000000001},"min":{"1min":0.56799999999999995,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.85399999999999998,"15min":0.80200000000000005},"min":{"1min":0.58999999999999997,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":4.6070000000000002,"5min":4.6070000000000002,"15min":4.6070000000000002},"last":0.83899999999999997}]},{"osd":8,"last update":"Sat Sep 23 08:55:47 2023","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.90700000000000003,"15min":0.90400000000000003},"min":{"1min":0.58999999999999997,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":5.2350000000000003,"5min":5.2350000000000003,"15min":5.2350000000000003},"last":0.61899999999999999},{"interface":"front","average":{"1min":1.0129999999999999,"5min":0.90800000000000003,"15min":0.89300000000000002},"min":{"1min":0.58799999999999997,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":4.5880000000000001,"5min":4.5880000000000001,"15min":4.5880000000000001},"last":0.51300000000000001}]},{"osd":9,"last update":"Sat Sep 23 08:56:08 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.876,"15min":0.90900000000000003},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.7170000000000001,"5min":1.7170000000000001,"15min":1.7170000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.89200000000000002,"15min":0.91900000000000004},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.764,"5min":1.764,"15min":1.764},"last":0.60899999999999999}]},{"osd":10,"last update":"Sat Sep 23 08:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.93899999999999995,"15min":0.95699999999999996},"min":{"1min":0.70599999999999996,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.0669999999999999,"5min":1.669,"15min":1.669},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.92800000000000005,"15min":0.95999999999999996},"min":{"1min":0.64700000000000002,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.1699999999999999,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.753}]}]},{"osd":1,"up_from":13,"seq":55834574935,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1036288,"data_stored":523856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:55:45 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58699999999999997,"15min":0.55800000000000005},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.61299999999999999,"15min":0.58899999999999997},"min":{"1min":0.32300000000000001,"5min":0.314,"15min":0.314},"max":{"1min":1.0069999999999999,"5min":1.02,"15min":1.02},"last":0.76000000000000001}]},{"osd":2,"last update":"Sat Sep 23 08:56:13 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.74099999999999999,"15min":0.71099999999999997},"min":{"1min":0.47999999999999998,"5min":0.47299999999999998,"15min":0.45900000000000002},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.74399999999999999,"15min":0.70399999999999996},"min":{"1min":0.60799999999999998,"5min":0.45700000000000002,"15min":0.44800000000000001},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.86199999999999999}]},{"osd":3,"last update":"Sat Sep 23 08:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67600000000000005,"15min":0.65300000000000002},"min":{"1min":0.46200000000000002,"5min":0.436,"15min":0.436},"max":{"1min":0.98099999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66400000000000003,"15min":0.64200000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.88200000000000001,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.47299999999999998}]},{"osd":4,"last update":"Sat Sep 23 08:55:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.54600000000000004,"15min":0.49399999999999999},"min":{"1min":0.44600000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.57799999999999996,"15min":0.52600000000000002},"min":{"1min":0.46800000000000003,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.97099999999999997,"5min":1.022,"15min":1.022},"last":0.82899999999999996}]},{"osd":5,"last update":"Sat Sep 23 08:55:32 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.76500000000000001,"15min":0.73599999999999999},"min":{"1min":0.59399999999999997,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.873},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.73499999999999999,"15min":0.70999999999999996},"min":{"1min":0.57699999999999996,"5min":0.505,"15min":0.505},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.89400000000000002}]},{"osd":6,"last update":"Sat Sep 23 08:55:47 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.76900000000000002,"15min":0.74099999999999999},"min":{"1min":0.57799999999999996,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":3.7120000000000002,"5min":3.7120000000000002,"15min":3.7120000000000002},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.751,"15min":0.70999999999999996},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":3.7229999999999999,"5min":3.7229999999999999,"15min":3.7229999999999999},"last":0.78700000000000003}]},{"osd":7,"last update":"Sat Sep 23 08:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.71099999999999997,"15min":0.69899999999999995},"min":{"1min":0.5,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.80400000000000005,"15min":0.78200000000000003},"min":{"1min":0.622,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.93400000000000005}]},{"osd":8,"last update":"Sat Sep 23 08:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.79300000000000004,"15min":0.755},"min":{"1min":0.64500000000000002,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.2110000000000001,"5min":2.8010000000000002,"15min":2.8010000000000002},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.79800000000000004,"15min":0.77200000000000002},"min":{"1min":0.70099999999999996,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.117,"5min":1.165,"15min":1.165},"last":0.81299999999999994}]},{"osd":9,"last update":"Sat Sep 23 08:56:13 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.85899999999999999,"15min":0.83999999999999997},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.88800000000000001,"15min":0.86099999999999999},"min":{"1min":0.79400000000000004,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":1.0109999999999999}]},{"osd":10,"last update":"Sat Sep 23 08:55:32 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.82999999999999996,"15min":0.82399999999999995},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.042,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.86499999999999999,"15min":0.85899999999999999},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":1.1319999999999999}]},{"osd":11,"last update":"Sat Sep 23 08:55:52 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.997},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":1.216}]}]},{"osd":0,"up_from":8,"seq":34359738461,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":983040,"data_stored":461082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 23 08:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.626,"15min":0.59399999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39300000000000002},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.73599999999999999,"15min":0.64700000000000002},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.36799999999999999},"max":{"1min":0.86299999999999999,"5min":5.7450000000000001,"15min":5.7450000000000001},"last":0.68500000000000005}]},{"osd":2,"last update":"Sat Sep 23 08:56:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.65100000000000002,"15min":0.64500000000000002},"min":{"1min":0.49299999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.88700000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.64300000000000002,"15min":0.63900000000000001},"min":{"1min":0.40300000000000002,"5min":0.373,"15min":0.373},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":0.63600000000000001}]},{"osd":3,"last update":"Sat Sep 23 08:55:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.7070000000000001,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.52200000000000002}]},{"osd":4,"last update":"Sat Sep 23 08:55:58 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.71699999999999997,"15min":0.64700000000000002},"min":{"1min":0.52300000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.90500000000000003,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.72699999999999998,"15min":0.66600000000000004},"min":{"1min":0.49299999999999999,"5min":0.435,"15min":0.435},"max":{"1min":0.879,"5min":5.6710000000000003,"15min":5.6710000000000003},"last":0.66600000000000004}]},{"osd":5,"last update":"Sat Sep 23 08:56:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.70399999999999996,"15min":0.69199999999999995},"min":{"1min":0.52600000000000002,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.92400000000000004,"5min":0.996,"15min":0.996},"last":0.755},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.73199999999999998,"15min":0.70599999999999996},"min":{"1min":0.62,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.96599999999999997,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.71799999999999997}]},{"osd":6,"last update":"Sat Sep 23 08:55:58 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.71099999999999997,"15min":0.70099999999999996},"min":{"1min":0.55100000000000005,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.9239999999999999,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73599999999999999,"15min":0.73499999999999999},"min":{"1min":0.438,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.823,"5min":1.823,"15min":1.823},"last":0.70599999999999996}]},{"osd":7,"last update":"Sat Sep 23 08:54:14 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.77300000000000002,"15min":0.77900000000000003},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.0489999999999999,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.875,"5min":0.84599999999999997,"15min":0.84099999999999997},"min":{"1min":0.63500000000000001,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.81799999999999995}]},{"osd":8,"last update":"Sat Sep 23 08:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.82799999999999996,"15min":0.84799999999999998},"min":{"1min":0.58799999999999997,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.80300000000000005,"15min":0.81699999999999995},"min":{"1min":0.60399999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.84799999999999998}]},{"osd":9,"last update":"Sat Sep 23 08:56:12 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.83999999999999997,"15min":0.872},"min":{"1min":0.49099999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.966,"5min":1.966,"15min":1.966},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.83699999999999997,"15min":0.88100000000000001},"min":{"1min":0.47399999999999998,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.333,"5min":1.333,"15min":1.333},"last":0.61599999999999999}]},{"osd":10,"last update":"Sat Sep 23 08:56:35 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.79600000000000004,"15min":0.80200000000000005},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.98799999999999999,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.90700000000000003,"15min":0.92900000000000005},"min":{"1min":0.68000000000000005,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.0069999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.74199999999999999}]},{"osd":11,"last update":"Sat Sep 23 08:56:01 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.82299999999999995,"15min":0.81499999999999995},"min":{"1min":0.69099999999999995,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.659,"5min":1.659,"15min":1.659},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.88300000000000001,"15min":0.88},"min":{"1min":0.79100000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.2130000000000001,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.83699999999999997}]}]},{"osd":2,"up_from":18,"seq":77309411410,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1052672,"data_stored":524691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:56:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.61699999999999999,"15min":0.61499999999999999},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.59999999999999998,"15min":0.61699999999999999},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.98799999999999999,"5min":1.004,"15min":1.196},"last":0.65900000000000003}]},{"osd":1,"last update":"Sat Sep 23 08:56:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.46899999999999997,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.95699999999999996,"5min":0.98399999999999999,"15min":1.177},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.72599999999999998,"15min":0.68600000000000005},"min":{"1min":0.46400000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.3100000000000001},"last":0.80800000000000005}]},{"osd":3,"last update":"Sat Sep 23 08:56:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72799999999999998,"15min":0.72199999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.083},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.70199999999999996,"15min":0.68799999999999994},"min":{"1min":0.48099999999999998,"5min":0.38,"15min":0.38},"max":{"1min":1.0269999999999999,"5min":1.129,"15min":1.129},"last":0.77500000000000002}]},{"osd":4,"last update":"Sat Sep 23 08:55:52 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.85999999999999999}]},{"osd":5,"last update":"Sat Sep 23 08:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.64300000000000002,"15min":0.57399999999999995},"min":{"1min":0.54700000000000004,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.98999999999999999,"5min":1.04,"15min":1.04},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.60299999999999998,"15min":0.54700000000000004},"min":{"1min":0.52300000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.93700000000000006,"5min":1.085,"15min":1.085},"last":0.61499999999999999}]},{"osd":6,"last update":"Sat Sep 23 08:55:52 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.77200000000000002,"15min":0.73899999999999999},"min":{"1min":0.58999999999999997,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.1060000000000001,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.72999999999999998,"15min":0.70099999999999996},"min":{"1min":0.59999999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.84699999999999998}]},{"osd":7,"last update":"Sat Sep 23 08:54:12 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.75,"15min":0.75},"min":{"1min":0.61399999999999999,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.93999999999999995,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.81699999999999995,"15min":0.81999999999999995},"min":{"1min":0.56299999999999994,"5min":0.501,"15min":0.501},"max":{"1min":1.006,"5min":1.129,"15min":1.129},"last":0.82199999999999995}]},{"osd":8,"last update":"Sat Sep 23 08:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.753,"15min":0.74199999999999999},"min":{"1min":0.61299999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.752,"5min":0.73099999999999998,"15min":0.72899999999999998},"min":{"1min":0.60499999999999998,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.91400000000000003}]},{"osd":9,"last update":"Sat Sep 23 08:56:08 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":0.873,"15min":0.84399999999999997},"min":{"1min":0.70299999999999996,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":4.0810000000000004,"5min":4.0810000000000004,"15min":4.0810000000000004},"last":0.752},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.878,"15min":0.874},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.88300000000000001}]},{"osd":10,"last update":"Sat Sep 23 08:56:34 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.88400000000000001,"15min":0.86699999999999999},"min":{"1min":0.73999999999999999,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.0640000000000001,"5min":1.157,"15min":1.157},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.91800000000000004,"15min":0.90300000000000002},"min":{"1min":0.61199999999999999,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.93200000000000005}]},{"osd":11,"last update":"Sat Sep 23 08:55:52 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.79600000000000004}]}]},{"osd":3,"up_from":26,"seq":111669149772,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":974848,"data_stored":458766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.46800000000000003,"15min":0.40600000000000003},"min":{"1min":0.314,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":2.294,"5min":2.294,"15min":2.294},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.48499999999999999,"15min":0.42799999999999999},"min":{"1min":0.35299999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":0.42099999999999999}]},{"osd":1,"last update":"Sat Sep 23 08:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.71699999999999997,"15min":0.629},"min":{"1min":0.53500000000000003,"5min":0.434,"15min":0.434},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.69399999999999995,"15min":0.63700000000000001},"min":{"1min":0.502,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.91400000000000003}]},{"osd":2,"last update":"Sat Sep 23 08:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.69899999999999995,"15min":0.65400000000000003},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.72399999999999998,"15min":0.66800000000000004},"min":{"1min":0.496,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.76200000000000001}]},{"osd":4,"last update":"Sat Sep 23 08:56:06 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.70999999999999996,"15min":0.66400000000000003},"min":{"1min":0.46999999999999997,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.1919999999999999,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.71999999999999997,"15min":0.66400000000000003},"min":{"1min":0.47499999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.3799999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.90000000000000002}]},{"osd":5,"last update":"Sat Sep 23 08:56:30 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.79000000000000004,"15min":0.77200000000000002},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.78800000000000003,"15min":0.77000000000000002},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.93100000000000005}]},{"osd":6,"last update":"Sat Sep 23 08:55:52 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.65600000000000003,"15min":0.65200000000000002},"min":{"1min":0.43099999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":2.637,"5min":2.637,"15min":2.637},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69399999999999995,"15min":0.66900000000000004},"min":{"1min":0.443,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.52700000000000002}]},{"osd":7,"last update":"Sat Sep 23 08:56:18 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.80700000000000005,"15min":0.81299999999999994},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0780000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.875},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81799999999999995,"15min":0.83399999999999996},"min":{"1min":0.59799999999999998,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.78100000000000003}]},{"osd":8,"last update":"Sat Sep 23 08:54:43 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.89200000000000002,"15min":0.90300000000000002},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.0660000000000001,"5min":1.093,"15min":1.093},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.86699999999999999,"15min":0.87},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.66000000000000003}]},{"osd":9,"last update":"Sat Sep 23 08:56:06 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.81299999999999994,"15min":0.82399999999999995},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":2.2050000000000001,"5min":2.2050000000000001,"15min":2.2050000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.89200000000000002,"15min":0.92400000000000004},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":2.258,"5min":2.258,"15min":2.258},"last":0.57699999999999996}]},{"osd":10,"last update":"Sat Sep 23 08:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.88700000000000001,"15min":0.88100000000000001},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.755},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.91100000000000003,"15min":0.91000000000000003},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.86299999999999999}]},{"osd":11,"last update":"Sat Sep 23 08:55:52 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.88600000000000001}]}]},{"osd":4,"up_from":34,"seq":146028888137,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":966656,"data_stored":460408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:53:55 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.628,"15min":0.624},"min":{"1min":0.45300000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.86199999999999999,"5min":1.042,"15min":1.042},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.622,"5min":0.60699999999999998,"15min":0.60899999999999999},"min":{"1min":0.434,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.93300000000000005,"5min":1.008,"15min":1.008},"last":0.38300000000000001}]},{"osd":1,"last update":"Sat Sep 23 08:55:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.46200000000000002,"15min":0.44700000000000001},"min":{"1min":0.39400000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.495,"15min":0.47499999999999998},"min":{"1min":0.39200000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.65700000000000003,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.48699999999999999}]},{"osd":2,"last update":"Sat Sep 23 08:55:59 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.73499999999999999,"15min":0.68000000000000005},"min":{"1min":0.59699999999999998,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.67000000000000004,"15min":0.65700000000000003},"min":{"1min":0.51100000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.96699999999999997,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.52200000000000002}]},{"osd":3,"last update":"Sat Sep 23 08:55:59 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.67500000000000004,"15min":0.64600000000000002},"min":{"1min":0.53300000000000003,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.74399999999999999,"15min":0.71499999999999997},"min":{"1min":0.56699999999999995,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.0800000000000001,"5min":1.238,"15min":1.238},"last":0.81899999999999995}]},{"osd":5,"last update":"Sat Sep 23 08:56:26 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.74199999999999999,"15min":0.65500000000000003},"min":{"1min":0.66200000000000003,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.77500000000000002,"15min":0.68200000000000005},"min":{"1min":0.67800000000000005,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.0189999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.65000000000000002}]},{"osd":6,"last update":"Sat Sep 23 08:55:53 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.82899999999999996,"15min":0.73699999999999999},"min":{"1min":0.67100000000000004,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.081,"5min":7.1829999999999998,"15min":7.1829999999999998},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.69999999999999996,"15min":0.69399999999999995},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.96899999999999997,"5min":1.127,"15min":1.127},"last":0.624}]},{"osd":7,"last update":"Sat Sep 23 08:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.68500000000000005,"15min":0.65300000000000002},"min":{"1min":0.627,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.94999999999999996,"5min":1.212,"15min":1.212},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.73699999999999999,"15min":0.70699999999999996},"min":{"1min":0.55200000000000005,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.97199999999999998,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.95099999999999996}]},{"osd":8,"last update":"Sat Sep 23 08:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.59899999999999998,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.94399999999999995,"5min":1.087,"15min":1.087},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.81399999999999995,"15min":0.78800000000000003},"min":{"1min":0.626,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.88700000000000001}]},{"osd":9,"last update":"Sat Sep 23 08:56:10 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.78700000000000003,"15min":0.80200000000000005},"min":{"1min":0.59599999999999997,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.1870000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.85999999999999999,"15min":0.85599999999999998},"min":{"1min":0.72899999999999998,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.98599999999999999}]},{"osd":10,"last update":"Sat Sep 23 08:56:35 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.90200000000000002,"15min":0.88400000000000001},"min":{"1min":0.79500000000000004,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":1.0489999999999999},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.93899999999999995,"15min":0.94899999999999995},"min":{"1min":0.68700000000000006,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.1100000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.91300000000000003}]},{"osd":11,"last update":"Sat Sep 23 08:55:53 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":1.0249999999999999},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.86199999999999999}]}]},{"osd":5,"up_from":39,"seq":167503724612,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28564,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716588,"statfs":{"total":95995035648,"available":95965786112,"internally_reserved":0,"allocated":1585152,"data_stored":1052746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.66600000000000004,"15min":0.63200000000000001},"min":{"1min":0.40300000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.6240000000000001,"5min":3.5680000000000001,"15min":3.5680000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63900000000000001,"15min":0.64800000000000002},"min":{"1min":0.40699999999999997,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":0.76200000000000001}]},{"osd":1,"last update":"Sat Sep 23 08:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.68500000000000005,"15min":0.64900000000000002},"min":{"1min":0.42699999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.92100000000000004,"5min":1.016,"15min":1.016},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.71599999999999997,"15min":0.64900000000000002},"min":{"1min":0.58099999999999996,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.0840000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.83899999999999997}]},{"osd":2,"last update":"Sat Sep 23 08:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.55600000000000005,"15min":0.53000000000000003},"min":{"1min":0.435,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.84599999999999997,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.56399999999999995,"15min":0.52800000000000002},"min":{"1min":0.42599999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.77600000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.70699999999999996}]},{"osd":3,"last update":"Sat Sep 23 08:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.72999999999999998,"15min":0.69199999999999995},"min":{"1min":0.49199999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.6930000000000001,"5min":5.5339999999999998,"15min":5.5339999999999998},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.68100000000000005,"15min":0.68899999999999995},"min":{"1min":0.5,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.621}]},{"osd":4,"last update":"Sat Sep 23 08:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.746,"15min":0.69799999999999995},"min":{"1min":0.54200000000000004,"5min":0.44,"15min":0.44},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.73599999999999999,"15min":0.69599999999999995},"min":{"1min":0.57399999999999995,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.98199999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.875}]},{"osd":6,"last update":"Sat Sep 23 08:55:48 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.754,"15min":0.73099999999999998},"min":{"1min":0.50900000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.89100000000000001,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.76300000000000001,"15min":0.74299999999999999},"min":{"1min":0.56200000000000006,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.85599999999999998}]},{"osd":7,"last update":"Sat Sep 23 08:56:12 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.79300000000000004,"15min":0.75900000000000001},"min":{"1min":0.58799999999999997,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.94799999999999995,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.745},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.80900000000000005,"15min":0.78900000000000003},"min":{"1min":0.67800000000000005,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.98799999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.94199999999999995}]},{"osd":8,"last update":"Sat Sep 23 08:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.77200000000000002,"15min":0.77800000000000002},"min":{"1min":0.52900000000000003,"5min":0.497,"15min":0.497},"max":{"1min":0.96699999999999997,"5min":1.044,"15min":1.044},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.76300000000000001,"15min":0.77200000000000002},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.89100000000000001,"5min":1.046,"15min":1.046},"last":1.0580000000000001}]},{"osd":9,"last update":"Sat Sep 23 08:56:12 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.92100000000000004,"15min":0.93100000000000005},"min":{"1min":0.66100000000000003,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":3.419,"5min":3.419,"15min":3.419},"last":1.0149999999999999},{"interface":"front","average":{"1min":1.02,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.60899999999999999,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":3.407,"5min":3.407,"15min":3.407},"last":0.89700000000000002}]},{"osd":10,"last update":"Sat Sep 23 08:56:35 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.90300000000000002,"15min":0.90600000000000003},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":1.042},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.90000000000000002,"15min":0.91200000000000003},"min":{"1min":0.71299999999999997,"5min":0.629,"15min":0.629},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":65435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":65997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":60958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-23T08:56:41.239 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-23T08:56:41.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.470+0000 7f8b257ff700 1 -- 172.21.15.82:0/3426416957 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b20074960 msgr2=0x7f8b20072db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:41.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.470+0000 7f8b257ff700 1 --2- 172.21.15.82:0/3426416957 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b20074960 0x7f8b20072db0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f8b10009990 tx=0x7f8b10009ca0 comp rx=0 tx=0).stop 2023-09-23T08:56:41.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.470+0000 7f8b257ff700 1 -- 172.21.15.82:0/3426416957 shutdown_connections 2023-09-23T08:56:41.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.470+0000 7f8b257ff700 1 --2- 172.21.15.82:0/3426416957 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b201087f0 0x7f8b2010ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:41.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.470+0000 7f8b257ff700 1 --2- 172.21.15.82:0/3426416957 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b20074960 0x7f8b20072db0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:41.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.470+0000 7f8b257ff700 1 --2- 172.21.15.82:0/3426416957 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b20073380 0x7f8b20073800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:41.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.470+0000 7f8b257ff700 1 -- 172.21.15.82:0/3426416957 >> 172.21.15.82:0/3426416957 conn(0x7f8b200fbe60 msgr2=0x7f8b200fe2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:41.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.470+0000 7f8b257ff700 1 -- 172.21.15.82:0/3426416957 shutdown_connections 2023-09-23T08:56:41.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.470+0000 7f8b257ff700 1 -- 172.21.15.82:0/3426416957 wait complete. 2023-09-23T08:56:41.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.471+0000 7f8b257ff700 1 Processor -- start 2023-09-23T08:56:41.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.471+0000 7f8b257ff700 1 -- start start 2023-09-23T08:56:41.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.471+0000 7f8b257ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b20073380 0x7f8b20198770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:41.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.471+0000 7f8b257ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b20074960 0x7f8b20198cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:41.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.471+0000 7f8b257ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b201087f0 0x7f8b2019fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:41.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.471+0000 7f8b257ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b201a02f0 con 0x7f8b20073380 2023-09-23T08:56:41.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.471+0000 7f8b257ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b201a0430 con 0x7f8b201087f0 2023-09-23T08:56:41.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.471+0000 7f8b257ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b201a05c0 con 0x7f8b20074960 2023-09-23T08:56:41.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.472+0000 7f8b1effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b20073380 0x7f8b20198770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:41.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.472+0000 7f8b1effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b20073380 0x7f8b20198770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45282/0 (socket says 172.21.15.82:45282) 2023-09-23T08:56:41.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.472+0000 7f8b1effd700 1 -- 172.21.15.82:0/4034747300 learned_addr learned my addr 172.21.15.82:0/4034747300 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:41.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.472+0000 7f8b1f7fe700 1 --2- 172.21.15.82:0/4034747300 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b201087f0 0x7f8b2019fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:41.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.472+0000 7f8b17fff700 1 --2- 172.21.15.82:0/4034747300 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b20074960 0x7f8b20198cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:41.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.472+0000 7f8b1effd700 1 -- 172.21.15.82:0/4034747300 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b20074960 msgr2=0x7f8b20198cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:41.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.472+0000 7f8b1effd700 1 --2- 172.21.15.82:0/4034747300 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b20074960 0x7f8b20198cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:41.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.472+0000 7f8b1effd700 1 -- 172.21.15.82:0/4034747300 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b201087f0 msgr2=0x7f8b2019fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:41.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.472+0000 7f8b1effd700 1 --2- 172.21.15.82:0/4034747300 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b201087f0 0x7f8b2019fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:41.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.472+0000 7f8b1effd700 1 -- 172.21.15.82:0/4034747300 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b100095f0 con 0x7f8b20073380 2023-09-23T08:56:41.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.472+0000 7f8b17fff700 1 --2- 172.21.15.82:0/4034747300 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b20074960 0x7f8b20198cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T08:56:41.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.472+0000 7f8b1effd700 1 --2- 172.21.15.82:0/4034747300 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b20073380 0x7f8b20198770 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f8b10005910 tx=0x7f8b10005720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:41.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.473+0000 7f8b1cff9700 1 -- 172.21.15.82:0/4034747300 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1001d070 con 0x7f8b20073380 2023-09-23T08:56:41.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.473+0000 7f8b1cff9700 1 -- 172.21.15.82:0/4034747300 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8b10022470 con 0x7f8b20073380 2023-09-23T08:56:41.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.473+0000 7f8b257ff700 1 -- 172.21.15.82:0/4034747300 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b201a0840 con 0x7f8b20073380 2023-09-23T08:56:41.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.473+0000 7f8b1cff9700 1 -- 172.21.15.82:0/4034747300 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1000f6c0 con 0x7f8b20073380 2023-09-23T08:56:41.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.473+0000 7f8b257ff700 1 -- 172.21.15.82:0/4034747300 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b201a0c60 con 0x7f8b20073380 2023-09-23T08:56:41.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.474+0000 7f8b257ff700 1 -- 172.21.15.82:0/4034747300 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b20106ea0 con 0x7f8b20073380 2023-09-23T08:56:41.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.476+0000 7f8b1cff9700 1 -- 172.21.15.82:0/4034747300 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 134671+0+0 (secure 0 0 0) 0x7f8b100225e0 con 0x7f8b20073380 2023-09-23T08:56:41.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.477+0000 7f8b1cff9700 1 --2- 172.21.15.82:0/4034747300 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f8b0c09ffa0 0x7f8b0c0a2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:41.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.477+0000 7f8b1cff9700 1 -- 172.21.15.82:0/4034747300 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f8b100ccec0 con 0x7f8b20073380 2023-09-23T08:56:41.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.477+0000 7f8b17fff700 1 --2- 172.21.15.82:0/4034747300 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f8b0c09ffa0 0x7f8b0c0a2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:41.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.478+0000 7f8b17fff700 1 --2- 172.21.15.82:0/4034747300 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f8b0c09ffa0 0x7f8b0c0a2460 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8b20074680 tx=0x7f8b08009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:41.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.479+0000 7f8b1cff9700 1 -- 172.21.15.82:0/4034747300 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f8b10096c90 con 0x7f8b20073380 2023-09-23T08:56:41.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:41 smithi135 ceph-mon[99205]: pgmap v357: 97 pgs: 97 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 938 B/s wr, 11 op/s 2023-09-23T08:56:41.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:41 smithi135 ceph-mon[99205]: from='client.15435 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-09-23T08:56:41.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:41 smithi082 ceph-mon[97694]: pgmap v357: 97 pgs: 97 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 938 B/s wr, 11 op/s 2023-09-23T08:56:41.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:41 smithi082 ceph-mon[97694]: from='client.15435 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-09-23T08:56:41.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:41 smithi161 ceph-mon[99580]: pgmap v357: 97 pgs: 97 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 938 B/s wr, 11 op/s 2023-09-23T08:56:41.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:41 smithi161 ceph-mon[99580]: from='client.15435 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-09-23T08:56:41.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.687+0000 7f8b257ff700 1 -- 172.21.15.82:0/4034747300 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8b2010e220 con 0x7f8b20073380 2023-09-23T08:56:41.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.689+0000 7f8b1cff9700 1 -- 172.21.15.82:0/4034747300 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+22508 (secure 0 0 0) 0x7f8b1009a2b0 con 0x7f8b20073380 2023-09-23T08:56:41.692 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:56:41.692 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":88,"fsid":"8926e286-59ed-11ee-8db4-212e2dc638e7","created":"2023-09-23T08:46:16.628057+0000","modified":"2023-09-23T08:55:23.423278+0000","last_up_change":"2023-09-23T08:53:56.524694+0000","last_in_change":"2023-09-23T08:53:35.779183+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-23T08:50:00.571063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-23T08:54:50.558630+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-23T08:54:52.055291+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7384c1ff-8c71-4feb-8cef-ba45c2a1708a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":892441948},{"type":"v1","addr":"172.21.15.82:6803","nonce":892441948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":892441948},{"type":"v1","addr":"172.21.15.82:6805","nonce":892441948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":892441948},{"type":"v1","addr":"172.21.15.82:6809","nonce":892441948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":892441948},{"type":"v1","addr":"172.21.15.82:6807","nonce":892441948}]},"public_addr":"172.21.15.82:6803/892441948","cluster_addr":"172.21.15.82:6805/892441948","heartbeat_back_addr":"172.21.15.82:6809/892441948","heartbeat_front_addr":"172.21.15.82:6807/892441948","state":["exists","up"]},{"osd":1,"uuid":"ca62333e-15db-4556-a9ed-8820f9268766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3224546922},{"type":"v1","addr":"172.21.15.135:6801","nonce":3224546922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3224546922},{"type":"v1","addr":"172.21.15.135:6803","nonce":3224546922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3224546922},{"type":"v1","addr":"172.21.15.135:6807","nonce":3224546922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3224546922},{"type":"v1","addr":"172.21.15.135:6805","nonce":3224546922}]},"public_addr":"172.21.15.135:6801/3224546922","cluster_addr":"172.21.15.135:6803/3224546922","heartbeat_back_addr":"172.21.15.135:6807/3224546922","heartbeat_front_addr":"172.21.15.135:6805/3224546922","state":["exists","up"]},{"osd":2,"uuid":"ac23eb38-216a-44f0-b316-a509b23745f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2358373459},{"type":"v1","addr":"172.21.15.161:6801","nonce":2358373459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2358373459},{"type":"v1","addr":"172.21.15.161:6803","nonce":2358373459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2358373459},{"type":"v1","addr":"172.21.15.161:6807","nonce":2358373459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2358373459},{"type":"v1","addr":"172.21.15.161:6805","nonce":2358373459}]},"public_addr":"172.21.15.161:6801/2358373459","cluster_addr":"172.21.15.161:6803/2358373459","heartbeat_back_addr":"172.21.15.161:6807/2358373459","heartbeat_front_addr":"172.21.15.161:6805/2358373459","state":["exists","up"]},{"osd":3,"uuid":"701c96b0-30fb-46ce-917d-e02d3814dc3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":1081464528},{"type":"v1","addr":"172.21.15.82:6811","nonce":1081464528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1081464528},{"type":"v1","addr":"172.21.15.82:6813","nonce":1081464528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1081464528},{"type":"v1","addr":"172.21.15.82:6817","nonce":1081464528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":1081464528},{"type":"v1","addr":"172.21.15.82:6815","nonce":1081464528}]},"public_addr":"172.21.15.82:6811/1081464528","cluster_addr":"172.21.15.82:6813/1081464528","heartbeat_back_addr":"172.21.15.82:6817/1081464528","heartbeat_front_addr":"172.21.15.82:6815/1081464528","state":["exists","up"]},{"osd":4,"uuid":"c618d2a2-3616-41b2-943c-7a4616538e13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2346495509},{"type":"v1","addr":"172.21.15.135:6809","nonce":2346495509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2346495509},{"type":"v1","addr":"172.21.15.135:6811","nonce":2346495509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2346495509},{"type":"v1","addr":"172.21.15.135:6815","nonce":2346495509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2346495509},{"type":"v1","addr":"172.21.15.135:6813","nonce":2346495509}]},"public_addr":"172.21.15.135:6809/2346495509","cluster_addr":"172.21.15.135:6811/2346495509","heartbeat_back_addr":"172.21.15.135:6815/2346495509","heartbeat_front_addr":"172.21.15.135:6813/2346495509","state":["exists","up"]},{"osd":5,"uuid":"8e1dda3d-6927-495d-b20d-78b03bb75d5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1252638628},{"type":"v1","addr":"172.21.15.161:6809","nonce":1252638628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1252638628},{"type":"v1","addr":"172.21.15.161:6811","nonce":1252638628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1252638628},{"type":"v1","addr":"172.21.15.161:6815","nonce":1252638628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1252638628},{"type":"v1","addr":"172.21.15.161:6813","nonce":1252638628}]},"public_addr":"172.21.15.161:6809/1252638628","cluster_addr":"172.21.15.161:6811/1252638628","heartbeat_back_addr":"172.21.15.161:6815/1252638628","heartbeat_front_addr":"172.21.15.161:6813/1252638628","state":["exists","up"]},{"osd":6,"uuid":"50b31960-6bc4-44e1-8116-3106bf161e56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1052038408},{"type":"v1","addr":"172.21.15.82:6819","nonce":1052038408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1052038408},{"type":"v1","addr":"172.21.15.82:6821","nonce":1052038408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":1052038408},{"type":"v1","addr":"172.21.15.82:6825","nonce":1052038408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1052038408},{"type":"v1","addr":"172.21.15.82:6823","nonce":1052038408}]},"public_addr":"172.21.15.82:6819/1052038408","cluster_addr":"172.21.15.82:6821/1052038408","heartbeat_back_addr":"172.21.15.82:6825/1052038408","heartbeat_front_addr":"172.21.15.82:6823/1052038408","state":["exists","up"]},{"osd":7,"uuid":"425ca0ee-57f7-4b27-90fb-d86bb5db5480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3683951498},{"type":"v1","addr":"172.21.15.135:6817","nonce":3683951498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":3683951498},{"type":"v1","addr":"172.21.15.135:6819","nonce":3683951498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":3683951498},{"type":"v1","addr":"172.21.15.135:6823","nonce":3683951498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":3683951498},{"type":"v1","addr":"172.21.15.135:6821","nonce":3683951498}]},"public_addr":"172.21.15.135:6817/3683951498","cluster_addr":"172.21.15.135:6819/3683951498","heartbeat_back_addr":"172.21.15.135:6823/3683951498","heartbeat_front_addr":"172.21.15.135:6821/3683951498","state":["exists","up"]},{"osd":8,"uuid":"1115c837-bef6-4bad-9974-4d913198511b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":948521536},{"type":"v1","addr":"172.21.15.161:6817","nonce":948521536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":948521536},{"type":"v1","addr":"172.21.15.161:6819","nonce":948521536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":948521536},{"type":"v1","addr":"172.21.15.161:6823","nonce":948521536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":948521536},{"type":"v1","addr":"172.21.15.161:6821","nonce":948521536}]},"public_addr":"172.21.15.161:6817/948521536","cluster_addr":"172.21.15.161:6819/948521536","heartbeat_back_addr":"172.21.15.161:6823/948521536","heartbeat_front_addr":"172.21.15.161:6821/948521536","state":["exists","up"]},{"osd":9,"uuid":"c52ec819-4bc6-402f-9cd8-62539e519e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":1438762840},{"type":"v1","addr":"172.21.15.82:6827","nonce":1438762840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":1438762840},{"type":"v1","addr":"172.21.15.82:6829","nonce":1438762840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1438762840},{"type":"v1","addr":"172.21.15.82:6833","nonce":1438762840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1438762840},{"type":"v1","addr":"172.21.15.82:6831","nonce":1438762840}]},"public_addr":"172.21.15.82:6827/1438762840","cluster_addr":"172.21.15.82:6829/1438762840","heartbeat_back_addr":"172.21.15.82:6833/1438762840","heartbeat_front_addr":"172.21.15.82:6831/1438762840","state":["exists","up"]},{"osd":10,"uuid":"1b16c795-1b91-4d46-ae5d-21b8332c1077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2853697851},{"type":"v1","addr":"172.21.15.135:6825","nonce":2853697851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2853697851},{"type":"v1","addr":"172.21.15.135:6827","nonce":2853697851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2853697851},{"type":"v1","addr":"172.21.15.135:6831","nonce":2853697851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2853697851},{"type":"v1","addr":"172.21.15.135:6829","nonce":2853697851}]},"public_addr":"172.21.15.135:6825/2853697851","cluster_addr":"172.21.15.135:6827/2853697851","heartbeat_back_addr":"172.21.15.135:6831/2853697851","heartbeat_front_addr":"172.21.15.135:6829/2853697851","state":["exists","up"]},{"osd":11,"uuid":"2551e602-4fe1-41cb-9b7d-c8b31fdd1487","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":1459332081},{"type":"v1","addr":"172.21.15.161:6825","nonce":1459332081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":1459332081},{"type":"v1","addr":"172.21.15.161:6827","nonce":1459332081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":1459332081},{"type":"v1","addr":"172.21.15.161:6831","nonce":1459332081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":1459332081},{"type":"v1","addr":"172.21.15.161:6829","nonce":1459332081}]},"public_addr":"172.21.15.161:6825/1459332081","cluster_addr":"172.21.15.161:6827/1459332081","heartbeat_back_addr":"172.21.15.161:6831/1459332081","heartbeat_front_addr":"172.21.15.161:6829/1459332081","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:49:04.007679+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:49:30.702365+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:49:56.785248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:50:22.988516+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:50:49.347055+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:51:15.830145+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:51:41.986377+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:52:08.218893+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:52:34.847450+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:53:01.317134+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:53:27.981691+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:53:54.849245+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/4204712132":"2023-09-24T08:47:21.957866+0000","172.21.15.82:6801/2733521564":"2023-09-24T08:47:21.957866+0000","172.21.15.82:6800/2733521564":"2023-09-24T08:47:21.957866+0000","172.21.15.82:0/3964794665":"2023-09-24T08:47:21.957866+0000","172.21.15.82:0/3535372205":"2023-09-24T08:46:55.187024+0000","172.21.15.82:0/285559684":"2023-09-24T08:46:55.187024+0000","172.21.15.82:0/1335891896":"2023-09-24T08:46:55.187024+0000","172.21.15.82:6801/3761509623":"2023-09-24T08:46:55.187024+0000","172.21.15.82:6800/3761509623":"2023-09-24T08:46:55.187024+0000","172.21.15.82:0/3775317005":"2023-09-24T08:47:21.957866+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-23T08:56:41.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.691+0000 7f8b257ff700 1 -- 172.21.15.82:0/4034747300 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f8b0c09ffa0 msgr2=0x7f8b0c0a2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:41.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.691+0000 7f8b257ff700 1 --2- 172.21.15.82:0/4034747300 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f8b0c09ffa0 0x7f8b0c0a2460 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8b20074680 tx=0x7f8b08009260 comp rx=0 tx=0).stop 2023-09-23T08:56:41.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.691+0000 7f8b257ff700 1 -- 172.21.15.82:0/4034747300 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b20073380 msgr2=0x7f8b20198770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:41.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.691+0000 7f8b257ff700 1 --2- 172.21.15.82:0/4034747300 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b20073380 0x7f8b20198770 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f8b10005910 tx=0x7f8b10005720 comp rx=0 tx=0).stop 2023-09-23T08:56:41.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.691+0000 7f8b257ff700 1 -- 172.21.15.82:0/4034747300 shutdown_connections 2023-09-23T08:56:41.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.691+0000 7f8b257ff700 1 --2- 172.21.15.82:0/4034747300 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f8b0c09ffa0 0x7f8b0c0a2460 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:41.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.691+0000 7f8b257ff700 1 --2- 172.21.15.82:0/4034747300 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b201087f0 0x7f8b2019fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:41.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.691+0000 7f8b257ff700 1 --2- 172.21.15.82:0/4034747300 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b20073380 0x7f8b20198770 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:41.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.691+0000 7f8b257ff700 1 --2- 172.21.15.82:0/4034747300 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b20074960 0x7f8b20198cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:41.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.691+0000 7f8b257ff700 1 -- 172.21.15.82:0/4034747300 >> 172.21.15.82:0/4034747300 conn(0x7f8b200fbe60 msgr2=0x7f8b200fe250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:41.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.692+0000 7f8b257ff700 1 -- 172.21.15.82:0/4034747300 shutdown_connections 2023-09-23T08:56:41.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.692+0000 7f8b257ff700 1 -- 172.21.15.82:0/4034747300 wait complete. 2023-09-23T08:56:41.713 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-23T08:50:00.571063+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-23T08:54:50.558630+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-23T08:54:52.055291+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-23T08:56:41.714 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-23T08:56:41.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.914+0000 7f7f675ff700 1 -- 172.21.15.82:0/4162603758 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f601024a0 msgr2=0x7f7f60108d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:41.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.914+0000 7f7f675ff700 1 --2- 172.21.15.82:0/4162603758 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f601024a0 0x7f7f60108d50 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f7f5800b0d0 tx=0x7f7f5800b3e0 comp rx=0 tx=0).stop 2023-09-23T08:56:41.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.914+0000 7f7f675ff700 1 -- 172.21.15.82:0/4162603758 shutdown_connections 2023-09-23T08:56:41.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.914+0000 7f7f675ff700 1 --2- 172.21.15.82:0/4162603758 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f601024a0 0x7f7f60108d50 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:41.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.914+0000 7f7f675ff700 1 --2- 172.21.15.82:0/4162603758 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f60100910 0x7f7f60100d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:41.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.914+0000 7f7f675ff700 1 --2- 172.21.15.82:0/4162603758 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7f60101b00 0x7f7f60101f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:41.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.914+0000 7f7f675ff700 1 -- 172.21.15.82:0/4162603758 >> 172.21.15.82:0/4162603758 conn(0x7f7f600fbe60 msgr2=0x7f7f600fe2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:41.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.914+0000 7f7f675ff700 1 -- 172.21.15.82:0/4162603758 shutdown_connections 2023-09-23T08:56:41.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.914+0000 7f7f675ff700 1 -- 172.21.15.82:0/4162603758 wait complete. 2023-09-23T08:56:41.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.915+0000 7f7f675ff700 1 Processor -- start 2023-09-23T08:56:41.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.915+0000 7f7f675ff700 1 -- start start 2023-09-23T08:56:41.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.916+0000 7f7f675ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f60100910 0x7f7f60198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:41.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.916+0000 7f7f675ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f60101b00 0x7f7f60198d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:41.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.916+0000 7f7f675ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7f601024a0 0x7f7f6019fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:41.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.916+0000 7f7f675ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f601a03a0 con 0x7f7f60101b00 2023-09-23T08:56:41.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.916+0000 7f7f675ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f601a04e0 con 0x7f7f60100910 2023-09-23T08:56:41.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.916+0000 7f7f675ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f601a0670 con 0x7f7f601024a0 2023-09-23T08:56:41.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.916+0000 7f7f64b9a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f60101b00 0x7f7f60198d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:41.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.916+0000 7f7f64b9a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f60101b00 0x7f7f60198d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36870/0 (socket says 172.21.15.82:36870) 2023-09-23T08:56:41.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.916+0000 7f7f64b9a700 1 -- 172.21.15.82:0/858491574 learned_addr learned my addr 172.21.15.82:0/858491574 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:41.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.916+0000 7f7f65b9c700 1 --2- 172.21.15.82:0/858491574 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7f601024a0 0x7f7f6019fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:41.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.916+0000 7f7f6539b700 1 --2- 172.21.15.82:0/858491574 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f60100910 0x7f7f60198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:41.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.916+0000 7f7f64b9a700 1 -- 172.21.15.82:0/858491574 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7f601024a0 msgr2=0x7f7f6019fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:41.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.916+0000 7f7f64b9a700 1 --2- 172.21.15.82:0/858491574 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7f601024a0 0x7f7f6019fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:41.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.916+0000 7f7f64b9a700 1 -- 172.21.15.82:0/858491574 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f60100910 msgr2=0x7f7f60198820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:41.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.916+0000 7f7f64b9a700 1 --2- 172.21.15.82:0/858491574 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f60100910 0x7f7f60198820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:41.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.916+0000 7f7f64b9a700 1 -- 172.21.15.82:0/858491574 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f58009d00 con 0x7f7f60101b00 2023-09-23T08:56:41.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.916+0000 7f7f65b9c700 1 --2- 172.21.15.82:0/858491574 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7f601024a0 0x7f7f6019fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T08:56:41.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.917+0000 7f7f64b9a700 1 --2- 172.21.15.82:0/858491574 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f60101b00 0x7f7f60198d60 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f7f5000d950 tx=0x7f7f5000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:41.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.917+0000 7f7f567fc700 1 -- 172.21.15.82:0/858491574 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f50009b40 con 0x7f7f60101b00 2023-09-23T08:56:41.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.917+0000 7f7f567fc700 1 -- 172.21.15.82:0/858491574 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7f50009ca0 con 0x7f7f60101b00 2023-09-23T08:56:41.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.917+0000 7f7f675ff700 1 -- 172.21.15.82:0/858491574 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f601a0950 con 0x7f7f60101b00 2023-09-23T08:56:41.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.917+0000 7f7f567fc700 1 -- 172.21.15.82:0/858491574 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f5000f620 con 0x7f7f60101b00 2023-09-23T08:56:41.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.917+0000 7f7f675ff700 1 -- 172.21.15.82:0/858491574 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f601a0e60 con 0x7f7f60101b00 2023-09-23T08:56:41.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.918+0000 7f7f675ff700 1 -- 172.21.15.82:0/858491574 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f6010bf90 con 0x7f7f60101b00 2023-09-23T08:56:41.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.920+0000 7f7f567fc700 1 -- 172.21.15.82:0/858491574 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 134671+0+0 (secure 0 0 0) 0x7f7f50010460 con 0x7f7f60101b00 2023-09-23T08:56:41.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.921+0000 7f7f567fc700 1 --2- 172.21.15.82:0/858491574 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f7f4c09ff50 0x7f7f4c0a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:41.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.922+0000 7f7f567fc700 1 -- 172.21.15.82:0/858491574 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f7f500cb610 con 0x7f7f60101b00 2023-09-23T08:56:41.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.922+0000 7f7f6539b700 1 --2- 172.21.15.82:0/858491574 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f7f4c09ff50 0x7f7f4c0a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:41.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.922+0000 7f7f6539b700 1 --2- 172.21.15.82:0/858491574 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f7f4c09ff50 0x7f7f4c0a2410 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7f60101960 tx=0x7f7f5c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:41.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:41.925+0000 7f7f567fc700 1 -- 172.21.15.82:0/858491574 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f7f50095350 con 0x7f7f60101b00 2023-09-23T08:56:42.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.125+0000 7f7f675ff700 1 -- 172.21.15.82:0/858491574 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7f601a10b0 con 0x7f7f60101b00 2023-09-23T08:56:42.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.126+0000 7f7f567fc700 1 -- 172.21.15.82:0/858491574 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7f50098970 con 0x7f7f60101b00 2023-09-23T08:56:42.129 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-09-23T08:56:42.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.128+0000 7f7f675ff700 1 -- 172.21.15.82:0/858491574 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f7f4c09ff50 msgr2=0x7f7f4c0a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:42.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.128+0000 7f7f675ff700 1 --2- 172.21.15.82:0/858491574 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f7f4c09ff50 0x7f7f4c0a2410 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7f60101960 tx=0x7f7f5c009260 comp rx=0 tx=0).stop 2023-09-23T08:56:42.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.128+0000 7f7f675ff700 1 -- 172.21.15.82:0/858491574 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f60101b00 msgr2=0x7f7f60198d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:42.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.128+0000 7f7f675ff700 1 --2- 172.21.15.82:0/858491574 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f60101b00 0x7f7f60198d60 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f7f5000d950 tx=0x7f7f5000dd10 comp rx=0 tx=0).stop 2023-09-23T08:56:42.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.128+0000 7f7f675ff700 1 -- 172.21.15.82:0/858491574 shutdown_connections 2023-09-23T08:56:42.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.128+0000 7f7f675ff700 1 --2- 172.21.15.82:0/858491574 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f7f4c09ff50 0x7f7f4c0a2410 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:42.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.128+0000 7f7f675ff700 1 --2- 172.21.15.82:0/858491574 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7f601024a0 0x7f7f6019fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:42.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.128+0000 7f7f675ff700 1 --2- 172.21.15.82:0/858491574 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f60100910 0x7f7f60198820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:42.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.128+0000 7f7f675ff700 1 --2- 172.21.15.82:0/858491574 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f60101b00 0x7f7f60198d60 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:42.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.128+0000 7f7f675ff700 1 -- 172.21.15.82:0/858491574 >> 172.21.15.82:0/858491574 conn(0x7f7f600fbe60 msgr2=0x7f7f600fe170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:42.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.128+0000 7f7f675ff700 1 -- 172.21.15.82:0/858491574 shutdown_connections 2023-09-23T08:56:42.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.129+0000 7f7f675ff700 1 -- 172.21.15.82:0/858491574 wait complete. 2023-09-23T08:56:42.149 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-23T08:56:42.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.346+0000 7fe46a9ff700 1 -- 172.21.15.82:0/449237774 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe464100930 msgr2=0x7fe464100d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:42.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.346+0000 7fe46a9ff700 1 --2- 172.21.15.82:0/449237774 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe464100930 0x7fe464100d50 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fe4540099c0 tx=0x7fe454009cd0 comp rx=0 tx=0).stop 2023-09-23T08:56:42.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.347+0000 7fe46a9ff700 1 -- 172.21.15.82:0/449237774 shutdown_connections 2023-09-23T08:56:42.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.347+0000 7fe46a9ff700 1 --2- 172.21.15.82:0/449237774 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4641024c0 0x7fe464108d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:42.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.347+0000 7fe46a9ff700 1 --2- 172.21.15.82:0/449237774 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe464100930 0x7fe464100d50 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:42.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.347+0000 7fe46a9ff700 1 --2- 172.21.15.82:0/449237774 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe464101b20 0x7fe464101f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:42.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.347+0000 7fe46a9ff700 1 -- 172.21.15.82:0/449237774 >> 172.21.15.82:0/449237774 conn(0x7fe4640fbea0 msgr2=0x7fe4640fe2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:42.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.347+0000 7fe46a9ff700 1 -- 172.21.15.82:0/449237774 shutdown_connections 2023-09-23T08:56:42.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.347+0000 7fe46a9ff700 1 -- 172.21.15.82:0/449237774 wait complete. 2023-09-23T08:56:42.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.348+0000 7fe46a9ff700 1 Processor -- start 2023-09-23T08:56:42.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.348+0000 7fe46a9ff700 1 -- start start 2023-09-23T08:56:42.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.348+0000 7fe46a9ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe464100930 0x7fe464198770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:42.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.348+0000 7fe46a9ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe464101b20 0x7fe464198cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:42.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.348+0000 7fe46a9ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4641024c0 0x7fe46419fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:42.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.348+0000 7fe46a9ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4641a02f0 con 0x7fe4641024c0 2023-09-23T08:56:42.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.348+0000 7fe46a9ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4641a0430 con 0x7fe464101b20 2023-09-23T08:56:42.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.348+0000 7fe46a9ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4641a05c0 con 0x7fe464100930 2023-09-23T08:56:42.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.348+0000 7fe468f9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4641024c0 0x7fe46419fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:42.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.348+0000 7fe468f9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4641024c0 0x7fe46419fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36888/0 (socket says 172.21.15.82:36888) 2023-09-23T08:56:42.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.348+0000 7fe468f9c700 1 -- 172.21.15.82:0/927321213 learned_addr learned my addr 172.21.15.82:0/927321213 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:42.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.348+0000 7fe4637fe700 1 --2- 172.21.15.82:0/927321213 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe464101b20 0x7fe464198cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:42.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.349+0000 7fe463fff700 1 --2- 172.21.15.82:0/927321213 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe464100930 0x7fe464198770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:42.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.349+0000 7fe468f9c700 1 -- 172.21.15.82:0/927321213 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe464100930 msgr2=0x7fe464198770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:42.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.349+0000 7fe468f9c700 1 --2- 172.21.15.82:0/927321213 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe464100930 0x7fe464198770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:42.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.349+0000 7fe468f9c700 1 -- 172.21.15.82:0/927321213 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe464101b20 msgr2=0x7fe464198cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:42.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.349+0000 7fe468f9c700 1 --2- 172.21.15.82:0/927321213 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe464101b20 0x7fe464198cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:42.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.349+0000 7fe468f9c700 1 -- 172.21.15.82:0/927321213 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4540095f0 con 0x7fe4641024c0 2023-09-23T08:56:42.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.349+0000 7fe4637fe700 1 --2- 172.21.15.82:0/927321213 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe464101b20 0x7fe464198cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T08:56:42.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.349+0000 7fe468f9c700 1 --2- 172.21.15.82:0/927321213 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4641024c0 0x7fe46419fd20 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fe45c007ee0 tx=0x7fe45c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:42.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.349+0000 7fe4617fa700 1 -- 172.21.15.82:0/927321213 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe45c017070 con 0x7fe4641024c0 2023-09-23T08:56:42.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.349+0000 7fe46a9ff700 1 -- 172.21.15.82:0/927321213 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4641a08a0 con 0x7fe4641024c0 2023-09-23T08:56:42.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.349+0000 7fe4617fa700 1 -- 172.21.15.82:0/927321213 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe45c00f040 con 0x7fe4641024c0 2023-09-23T08:56:42.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.349+0000 7fe4617fa700 1 -- 172.21.15.82:0/927321213 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe45c005710 con 0x7fe4641024c0 2023-09-23T08:56:42.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.349+0000 7fe46a9ff700 1 -- 172.21.15.82:0/927321213 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4641a0db0 con 0x7fe4641024c0 2023-09-23T08:56:42.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.350+0000 7fe46a9ff700 1 -- 172.21.15.82:0/927321213 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe46410c040 con 0x7fe4641024c0 2023-09-23T08:56:42.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.354+0000 7fe4617fa700 1 -- 172.21.15.82:0/927321213 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 134671+0+0 (secure 0 0 0) 0x7fe45c005870 con 0x7fe4641024c0 2023-09-23T08:56:42.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.355+0000 7fe4617fa700 1 --2- 172.21.15.82:0/927321213 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fe44c09ff50 0x7fe44c0a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:42.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.355+0000 7fe4617fa700 1 -- 172.21.15.82:0/927321213 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fe45c0cb0f0 con 0x7fe4641024c0 2023-09-23T08:56:42.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.356+0000 7fe463fff700 1 --2- 172.21.15.82:0/927321213 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fe44c09ff50 0x7fe44c0a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:42.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.356+0000 7fe463fff700 1 --2- 172.21.15.82:0/927321213 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fe44c09ff50 0x7fe44c0a2410 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fe454000c00 tx=0x7fe454005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:42.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.357+0000 7fe4617fa700 1 -- 172.21.15.82:0/927321213 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7fe45c094e30 con 0x7fe4641024c0 2023-09-23T08:56:42.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.561+0000 7fe46a9ff700 1 -- 172.21.15.82:0/927321213 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe46410c200 con 0x7fe4641024c0 2023-09-23T08:56:42.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.562+0000 7fe4617fa700 1 -- 172.21.15.82:0/927321213 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe45c098450 con 0x7fe4641024c0 2023-09-23T08:56:42.565 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2023-09-23T08:56:42.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.564+0000 7fe46a9ff700 1 -- 172.21.15.82:0/927321213 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fe44c09ff50 msgr2=0x7fe44c0a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:42.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.564+0000 7fe46a9ff700 1 --2- 172.21.15.82:0/927321213 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fe44c09ff50 0x7fe44c0a2410 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fe454000c00 tx=0x7fe454005fb0 comp rx=0 tx=0).stop 2023-09-23T08:56:42.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.565+0000 7fe46a9ff700 1 -- 172.21.15.82:0/927321213 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4641024c0 msgr2=0x7fe46419fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:42.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.565+0000 7fe46a9ff700 1 --2- 172.21.15.82:0/927321213 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4641024c0 0x7fe46419fd20 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fe45c007ee0 tx=0x7fe45c00d3b0 comp rx=0 tx=0).stop 2023-09-23T08:56:42.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.565+0000 7fe46a9ff700 1 -- 172.21.15.82:0/927321213 shutdown_connections 2023-09-23T08:56:42.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.565+0000 7fe46a9ff700 1 --2- 172.21.15.82:0/927321213 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fe44c09ff50 0x7fe44c0a2410 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:42.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.565+0000 7fe46a9ff700 1 --2- 172.21.15.82:0/927321213 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4641024c0 0x7fe46419fd20 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:42.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.565+0000 7fe46a9ff700 1 --2- 172.21.15.82:0/927321213 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe464100930 0x7fe464198770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:42.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.565+0000 7fe46a9ff700 1 --2- 172.21.15.82:0/927321213 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe464101b20 0x7fe464198cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:42.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.565+0000 7fe46a9ff700 1 -- 172.21.15.82:0/927321213 >> 172.21.15.82:0/927321213 conn(0x7fe4640fbea0 msgr2=0x7fe4640fe170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:42.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.565+0000 7fe46a9ff700 1 -- 172.21.15.82:0/927321213 shutdown_connections 2023-09-23T08:56:42.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.565+0000 7fe46a9ff700 1 -- 172.21.15.82:0/927321213 wait complete. 2023-09-23T08:56:42.586 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-23T08:56:42.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.785+0000 7ff0569ff700 1 -- 172.21.15.82:0/2736390122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff050100930 msgr2=0x7ff050100d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:42.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.785+0000 7ff0569ff700 1 --2- 172.21.15.82:0/2736390122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff050100930 0x7ff050100d50 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7ff0400099c0 tx=0x7ff040009cd0 comp rx=0 tx=0).stop 2023-09-23T08:56:42.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.785+0000 7ff0569ff700 1 -- 172.21.15.82:0/2736390122 shutdown_connections 2023-09-23T08:56:42.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.785+0000 7ff0569ff700 1 --2- 172.21.15.82:0/2736390122 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0501024c0 0x7ff050108d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:42.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.785+0000 7ff0569ff700 1 --2- 172.21.15.82:0/2736390122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff050100930 0x7ff050100d50 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:42.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.785+0000 7ff0569ff700 1 --2- 172.21.15.82:0/2736390122 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff050101b20 0x7ff050101f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:42.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.785+0000 7ff0569ff700 1 -- 172.21.15.82:0/2736390122 >> 172.21.15.82:0/2736390122 conn(0x7ff0500fbea0 msgr2=0x7ff0500fe2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:42.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.785+0000 7ff0569ff700 1 -- 172.21.15.82:0/2736390122 shutdown_connections 2023-09-23T08:56:42.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.785+0000 7ff0569ff700 1 -- 172.21.15.82:0/2736390122 wait complete. 2023-09-23T08:56:42.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.786+0000 7ff0569ff700 1 Processor -- start 2023-09-23T08:56:42.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.787+0000 7ff0569ff700 1 -- start start 2023-09-23T08:56:42.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.787+0000 7ff0569ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff050100930 0x7ff050198730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:42.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.787+0000 7ff0569ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff050101b20 0x7ff050198c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:42.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.787+0000 7ff0569ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0501024c0 0x7ff05019fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:42.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.787+0000 7ff0569ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0501a02b0 con 0x7ff050101b20 2023-09-23T08:56:42.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.787+0000 7ff0569ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0501a03f0 con 0x7ff050100930 2023-09-23T08:56:42.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.787+0000 7ff0569ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0501a0580 con 0x7ff0501024c0 2023-09-23T08:56:42.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.787+0000 7ff04f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff050101b20 0x7ff050198c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:42.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.787+0000 7ff04f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff050101b20 0x7ff050198c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36906/0 (socket says 172.21.15.82:36906) 2023-09-23T08:56:42.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.787+0000 7ff04f7fe700 1 -- 172.21.15.82:0/3260525102 learned_addr learned my addr 172.21.15.82:0/3260525102 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:42.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.787+0000 7ff04ffff700 1 --2- 172.21.15.82:0/3260525102 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff050100930 0x7ff050198730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:42.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.787+0000 7ff054f9c700 1 --2- 172.21.15.82:0/3260525102 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0501024c0 0x7ff05019fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:42.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.788+0000 7ff04f7fe700 1 -- 172.21.15.82:0/3260525102 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0501024c0 msgr2=0x7ff05019fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:42.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.788+0000 7ff04f7fe700 1 --2- 172.21.15.82:0/3260525102 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0501024c0 0x7ff05019fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:42.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.788+0000 7ff04f7fe700 1 -- 172.21.15.82:0/3260525102 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff050100930 msgr2=0x7ff050198730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:42.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.788+0000 7ff04f7fe700 1 --2- 172.21.15.82:0/3260525102 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff050100930 0x7ff050198730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:42.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.788+0000 7ff04f7fe700 1 -- 172.21.15.82:0/3260525102 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0400095f0 con 0x7ff050101b20 2023-09-23T08:56:42.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.788+0000 7ff054f9c700 1 --2- 172.21.15.82:0/3260525102 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0501024c0 0x7ff05019fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T08:56:42.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.788+0000 7ff04f7fe700 1 --2- 172.21.15.82:0/3260525102 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff050101b20 0x7ff050198c70 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7ff04400d980 tx=0x7ff04400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:42.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.788+0000 7ff04d7fa700 1 -- 172.21.15.82:0/3260525102 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff044004220 con 0x7ff050101b20 2023-09-23T08:56:42.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.788+0000 7ff0569ff700 1 -- 172.21.15.82:0/3260525102 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0501a0860 con 0x7ff050101b20 2023-09-23T08:56:42.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.788+0000 7ff04d7fa700 1 -- 172.21.15.82:0/3260525102 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff044007640 con 0x7ff050101b20 2023-09-23T08:56:42.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.788+0000 7ff04d7fa700 1 -- 172.21.15.82:0/3260525102 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0440055e0 con 0x7ff050101b20 2023-09-23T08:56:42.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.788+0000 7ff0569ff700 1 -- 172.21.15.82:0/3260525102 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0501a0d70 con 0x7ff050101b20 2023-09-23T08:56:42.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.789+0000 7ff0569ff700 1 -- 172.21.15.82:0/3260525102 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff05010bff0 con 0x7ff050101b20 2023-09-23T08:56:42.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.791+0000 7ff04d7fa700 1 -- 172.21.15.82:0/3260525102 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 134671+0+0 (secure 0 0 0) 0x7ff044004750 con 0x7ff050101b20 2023-09-23T08:56:42.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.792+0000 7ff04d7fa700 1 --2- 172.21.15.82:0/3260525102 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7ff03809ff50 0x7ff0380a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:42.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.793+0000 7ff04d7fa700 1 -- 172.21.15.82:0/3260525102 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7ff0440cb110 con 0x7ff050101b20 2023-09-23T08:56:42.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.793+0000 7ff04ffff700 1 --2- 172.21.15.82:0/3260525102 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7ff03809ff50 0x7ff0380a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:42.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.793+0000 7ff04ffff700 1 --2- 172.21.15.82:0/3260525102 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7ff03809ff50 0x7ff0380a2410 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff040006010 tx=0x7ff040005e80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:42.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.796+0000 7ff04d7fa700 1 -- 172.21.15.82:0/3260525102 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7ff044094e50 con 0x7ff050101b20 2023-09-23T08:56:42.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:42 smithi135 ceph-mon[99205]: from='client.15441 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-09-23T08:56:42.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:42 smithi135 ceph-mon[99205]: from='client.15447 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-09-23T08:56:42.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:42 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/4034747300' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-23T08:56:42.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:42 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/858491574' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-23T08:56:42.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:42 smithi082 ceph-mon[97694]: from='client.15441 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-09-23T08:56:42.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:42 smithi082 ceph-mon[97694]: from='client.15447 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-09-23T08:56:42.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:42 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/4034747300' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-23T08:56:42.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:42 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/858491574' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-23T08:56:42.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:42 smithi161 ceph-mon[99580]: from='client.15441 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-09-23T08:56:42.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:42 smithi161 ceph-mon[99580]: from='client.15447 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-09-23T08:56:42.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:42 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/4034747300' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-23T08:56:42.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:42 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/858491574' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-23T08:56:42.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.996+0000 7ff0569ff700 1 -- 172.21.15.82:0/3260525102 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff0501a0f90 con 0x7ff050101b20 2023-09-23T08:56:42.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.996+0000 7ff04d7fa700 1 -- 172.21.15.82:0/3260525102 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff044005740 con 0x7ff050101b20 2023-09-23T08:56:42.999 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2023-09-23T08:56:43.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.998+0000 7ff0569ff700 1 -- 172.21.15.82:0/3260525102 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7ff03809ff50 msgr2=0x7ff0380a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:43.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.998+0000 7ff0569ff700 1 --2- 172.21.15.82:0/3260525102 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7ff03809ff50 0x7ff0380a2410 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff040006010 tx=0x7ff040005e80 comp rx=0 tx=0).stop 2023-09-23T08:56:43.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.998+0000 7ff0569ff700 1 -- 172.21.15.82:0/3260525102 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff050101b20 msgr2=0x7ff050198c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:43.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.998+0000 7ff0569ff700 1 --2- 172.21.15.82:0/3260525102 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff050101b20 0x7ff050198c70 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7ff04400d980 tx=0x7ff04400dc90 comp rx=0 tx=0).stop 2023-09-23T08:56:43.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.998+0000 7ff0569ff700 1 -- 172.21.15.82:0/3260525102 shutdown_connections 2023-09-23T08:56:43.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.998+0000 7ff0569ff700 1 --2- 172.21.15.82:0/3260525102 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7ff03809ff50 0x7ff0380a2410 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:43.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.998+0000 7ff0569ff700 1 --2- 172.21.15.82:0/3260525102 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0501024c0 0x7ff05019fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:43.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.998+0000 7ff0569ff700 1 --2- 172.21.15.82:0/3260525102 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff050100930 0x7ff050198730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:43.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.998+0000 7ff0569ff700 1 --2- 172.21.15.82:0/3260525102 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff050101b20 0x7ff050198c70 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:43.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.998+0000 7ff0569ff700 1 -- 172.21.15.82:0/3260525102 >> 172.21.15.82:0/3260525102 conn(0x7ff0500fbea0 msgr2=0x7ff0500fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:43.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.999+0000 7ff0569ff700 1 -- 172.21.15.82:0/3260525102 shutdown_connections 2023-09-23T08:56:43.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:42.999+0000 7ff0569ff700 1 -- 172.21.15.82:0/3260525102 wait complete. 2023-09-23T08:56:43.020 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-23T08:56:43.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.214+0000 7f2bae3ff700 1 -- 172.21.15.82:0/758067026 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ba81065e0 msgr2=0x7f2ba8108a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:43.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.214+0000 7f2bae3ff700 1 --2- 172.21.15.82:0/758067026 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ba81065e0 0x7f2ba8108a50 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f2ba000b0a0 tx=0x7f2ba000b3b0 comp rx=0 tx=0).stop 2023-09-23T08:56:43.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.214+0000 7f2bae3ff700 1 -- 172.21.15.82:0/758067026 shutdown_connections 2023-09-23T08:56:43.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.214+0000 7f2bae3ff700 1 --2- 172.21.15.82:0/758067026 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ba81065e0 0x7f2ba8108a50 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:43.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.214+0000 7f2bae3ff700 1 --2- 172.21.15.82:0/758067026 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2ba8101380 0x7f2ba8103770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:43.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.214+0000 7f2bae3ff700 1 --2- 172.21.15.82:0/758067026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ba8103cb0 0x7f2ba81060a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:43.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.214+0000 7f2bae3ff700 1 -- 172.21.15.82:0/758067026 >> 172.21.15.82:0/758067026 conn(0x7f2ba80fad50 msgr2=0x7f2ba80fd1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:43.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.214+0000 7f2bae3ff700 1 -- 172.21.15.82:0/758067026 shutdown_connections 2023-09-23T08:56:43.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.214+0000 7f2bae3ff700 1 -- 172.21.15.82:0/758067026 wait complete. 2023-09-23T08:56:43.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.215+0000 7f2bae3ff700 1 Processor -- start 2023-09-23T08:56:43.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.216+0000 7f2bae3ff700 1 -- start start 2023-09-23T08:56:43.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.216+0000 7f2bae3ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2ba8101380 0x7f2ba8100cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:43.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.216+0000 7f2bae3ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ba8103cb0 0x7f2ba80ff330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:43.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.216+0000 7f2bae3ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ba81065e0 0x7f2ba80ff870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:43.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.216+0000 7f2bae3ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba8100010 con 0x7f2ba81065e0 2023-09-23T08:56:43.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.216+0000 7f2bae3ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba8100180 con 0x7f2ba8103cb0 2023-09-23T08:56:43.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.216+0000 7f2bae3ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba81a05f0 con 0x7f2ba8101380 2023-09-23T08:56:43.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.217+0000 7f2bac99c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ba81065e0 0x7f2ba80ff870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:43.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.217+0000 7f2ba77fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ba8103cb0 0x7f2ba80ff330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:43.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.217+0000 7f2bac99c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ba81065e0 0x7f2ba80ff870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36918/0 (socket says 172.21.15.82:36918) 2023-09-23T08:56:43.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.217+0000 7f2bac99c700 1 -- 172.21.15.82:0/2345225658 learned_addr learned my addr 172.21.15.82:0/2345225658 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:43.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.217+0000 7f2ba7fff700 1 --2- 172.21.15.82:0/2345225658 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2ba8101380 0x7f2ba8100cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:43.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.217+0000 7f2bac99c700 1 -- 172.21.15.82:0/2345225658 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2ba8101380 msgr2=0x7f2ba8100cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:43.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.217+0000 7f2bac99c700 1 --2- 172.21.15.82:0/2345225658 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2ba8101380 0x7f2ba8100cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:43.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.217+0000 7f2bac99c700 1 -- 172.21.15.82:0/2345225658 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ba8103cb0 msgr2=0x7f2ba80ff330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:43.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.217+0000 7f2bac99c700 1 --2- 172.21.15.82:0/2345225658 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ba8103cb0 0x7f2ba80ff330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:43.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.217+0000 7f2bac99c700 1 -- 172.21.15.82:0/2345225658 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ba0009d00 con 0x7f2ba81065e0 2023-09-23T08:56:43.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.217+0000 7f2ba77fe700 1 --2- 172.21.15.82:0/2345225658 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ba8103cb0 0x7f2ba80ff330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T08:56:43.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.217+0000 7f2bac99c700 1 --2- 172.21.15.82:0/2345225658 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ba81065e0 0x7f2ba80ff870 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f2ba000b780 tx=0x7f2ba000bd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:43.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.217+0000 7f2ba57fa700 1 -- 172.21.15.82:0/2345225658 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba000e040 con 0x7f2ba81065e0 2023-09-23T08:56:43.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.217+0000 7f2ba57fa700 1 -- 172.21.15.82:0/2345225658 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2ba0004e60 con 0x7f2ba81065e0 2023-09-23T08:56:43.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.217+0000 7f2ba57fa700 1 -- 172.21.15.82:0/2345225658 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba00052a0 con 0x7f2ba81065e0 2023-09-23T08:56:43.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.218+0000 7f2bae3ff700 1 -- 172.21.15.82:0/2345225658 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ba81a0870 con 0x7f2ba81065e0 2023-09-23T08:56:43.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.218+0000 7f2bae3ff700 1 -- 172.21.15.82:0/2345225658 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ba81a0ca0 con 0x7f2ba81065e0 2023-09-23T08:56:43.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.219+0000 7f2bae3ff700 1 -- 172.21.15.82:0/2345225658 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ba80fc8d0 con 0x7f2ba81065e0 2023-09-23T08:56:43.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.220+0000 7f2ba57fa700 1 -- 172.21.15.82:0/2345225658 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 134671+0+0 (secure 0 0 0) 0x7f2ba001d470 con 0x7f2ba81065e0 2023-09-23T08:56:43.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.222+0000 7f2ba57fa700 1 --2- 172.21.15.82:0/2345225658 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f2b900a0020 0x7f2b900a24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:43.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.222+0000 7f2ba57fa700 1 -- 172.21.15.82:0/2345225658 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f2ba00cc8e0 con 0x7f2ba81065e0 2023-09-23T08:56:43.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.222+0000 7f2ba7fff700 1 --2- 172.21.15.82:0/2345225658 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f2b900a0020 0x7f2b900a24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:43.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.222+0000 7f2ba7fff700 1 --2- 172.21.15.82:0/2345225658 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f2b900a0020 0x7f2b900a24e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f2b9800bbd0 tx=0x7f2b9800b5b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:43.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.225+0000 7f2ba57fa700 1 -- 172.21.15.82:0/2345225658 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f2ba00966b0 con 0x7f2ba81065e0 2023-09-23T08:56:43.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.471+0000 7f2bae3ff700 1 -- 172.21.15.82:0/2345225658 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2ba810bf40 con 0x7f2ba81065e0 2023-09-23T08:56:43.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.472+0000 7f2ba57fa700 1 -- 172.21.15.82:0/2345225658 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+11323 (secure 0 0 0) 0x7f2ba0099cd0 con 0x7f2ba81065e0 2023-09-23T08:56:43.475 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:56:43.475 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/1237857359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1237857359},{"type":"v1","addr":"172.21.15.82:6835","nonce":1237857359}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/1335102362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":1335102362},{"type":"v1","addr":"172.21.15.82:6837","nonce":1335102362}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-23T08:54:52.600479+0000","modified":"2023-09-23T08:55:00.481507+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24557,"mds_1":24550,"mds_2":24526,"mds_3":24515,"mds_4":24514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/3645331700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3645331700},{"type":"v1","addr":"172.21.15.135:6835","nonce":3645331700}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14658":{"gid":14658,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6839/205725278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":205725278},{"type":"v1","addr":"172.21.15.82:6839","nonce":205725278}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14670":{"gid":14670,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6841/2659297867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":2659297867},{"type":"v1","addr":"172.21.15.82:6841","nonce":2659297867}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24461":{"gid":24461,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/503886037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":503886037},{"type":"v1","addr":"172.21.15.135:6833","nonce":503886037}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24463":{"gid":24463,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.161:6833/471569125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":471569125},{"type":"v1","addr":"172.21.15.161:6833","nonce":471569125}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24514":{"gid":24514,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":10,"addr":"172.21.15.161:6835/2237964162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":2237964162},{"type":"v1","addr":"172.21.15.161:6835","nonce":2237964162}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24515":{"gid":24515,"name":"h","rank":3,"incarnation":22,"state":"up:active","state_seq":8,"addr":"172.21.15.135:6837/2655304858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2655304858},{"type":"v1","addr":"172.21.15.135:6837","nonce":2655304858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24526":{"gid":24526,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.161:6837/43639843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":43639843},{"type":"v1","addr":"172.21.15.161:6837","nonce":43639843}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24550":{"gid":24550,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.161:6839/758982817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6838","nonce":758982817},{"type":"v1","addr":"172.21.15.161:6839","nonce":758982817}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24557":{"gid":24557,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6839/2508669274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2508669274},{"type":"v1","addr":"172.21.15.135:6839","nonce":2508669274}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-23T08:56:43.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.475+0000 7f2bae3ff700 1 -- 172.21.15.82:0/2345225658 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f2b900a0020 msgr2=0x7f2b900a24e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:43.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.475+0000 7f2bae3ff700 1 --2- 172.21.15.82:0/2345225658 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f2b900a0020 0x7f2b900a24e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f2b9800bbd0 tx=0x7f2b9800b5b0 comp rx=0 tx=0).stop 2023-09-23T08:56:43.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.475+0000 7f2bae3ff700 1 -- 172.21.15.82:0/2345225658 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ba81065e0 msgr2=0x7f2ba80ff870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:43.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.475+0000 7f2bae3ff700 1 --2- 172.21.15.82:0/2345225658 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ba81065e0 0x7f2ba80ff870 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f2ba000b780 tx=0x7f2ba000bd40 comp rx=0 tx=0).stop 2023-09-23T08:56:43.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.475+0000 7f2bae3ff700 1 -- 172.21.15.82:0/2345225658 shutdown_connections 2023-09-23T08:56:43.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.475+0000 7f2bae3ff700 1 --2- 172.21.15.82:0/2345225658 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f2b900a0020 0x7f2b900a24e0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:43.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.475+0000 7f2bae3ff700 1 --2- 172.21.15.82:0/2345225658 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ba81065e0 0x7f2ba80ff870 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:43.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.475+0000 7f2bae3ff700 1 --2- 172.21.15.82:0/2345225658 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2ba8101380 0x7f2ba8100cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:43.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.475+0000 7f2bae3ff700 1 --2- 172.21.15.82:0/2345225658 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ba8103cb0 0x7f2ba80ff330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:43.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.475+0000 7f2bae3ff700 1 -- 172.21.15.82:0/2345225658 >> 172.21.15.82:0/2345225658 conn(0x7f2ba80fad50 msgr2=0x7f2ba8101ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:43.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.475+0000 7f2bae3ff700 1 -- 172.21.15.82:0/2345225658 shutdown_connections 2023-09-23T08:56:43.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.475+0000 7f2bae3ff700 1 -- 172.21.15.82:0/2345225658 wait complete. 2023-09-23T08:56:43.479 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 26 2023-09-23T08:56:43.496 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-23T08:56:43.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.691+0000 7f16c1bff700 1 -- 172.21.15.82:0/3304105475 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16bc100930 msgr2=0x7f16bc100d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:43.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.691+0000 7f16c1bff700 1 --2- 172.21.15.82:0/3304105475 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16bc100930 0x7f16bc100d50 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f16ac0099c0 tx=0x7f16ac009cd0 comp rx=0 tx=0).stop 2023-09-23T08:56:43.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.691+0000 7f16c1bff700 1 -- 172.21.15.82:0/3304105475 shutdown_connections 2023-09-23T08:56:43.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.691+0000 7f16c1bff700 1 --2- 172.21.15.82:0/3304105475 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16bc1024c0 0x7f16bc108d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:43.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.691+0000 7f16c1bff700 1 --2- 172.21.15.82:0/3304105475 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16bc100930 0x7f16bc100d50 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:43.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.691+0000 7f16c1bff700 1 --2- 172.21.15.82:0/3304105475 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f16bc101b20 0x7f16bc101f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:43.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.691+0000 7f16c1bff700 1 -- 172.21.15.82:0/3304105475 >> 172.21.15.82:0/3304105475 conn(0x7f16bc0fbe60 msgr2=0x7f16bc0fe2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:43.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.691+0000 7f16c1bff700 1 -- 172.21.15.82:0/3304105475 shutdown_connections 2023-09-23T08:56:43.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.691+0000 7f16c1bff700 1 -- 172.21.15.82:0/3304105475 wait complete. 2023-09-23T08:56:43.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.692+0000 7f16c1bff700 1 Processor -- start 2023-09-23T08:56:43.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.693+0000 7f16c1bff700 1 -- start start 2023-09-23T08:56:43.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.693+0000 7f16c1bff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16bc100930 0x7f16bc196560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:43.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.693+0000 7f16c1bff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16bc101b20 0x7f16bc196aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:43.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.693+0000 7f16c1bff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f16bc1024c0 0x7f16bc19db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:43.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.693+0000 7f16c1bff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16bc19e0e0 con 0x7f16bc101b20 2023-09-23T08:56:43.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.693+0000 7f16c1bff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16bc19e220 con 0x7f16bc100930 2023-09-23T08:56:43.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.693+0000 7f16c1bff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16bc19e3b0 con 0x7f16bc1024c0 2023-09-23T08:56:43.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.693+0000 7f16baffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16bc101b20 0x7f16bc196aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:43.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.693+0000 7f16baffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16bc101b20 0x7f16bc196aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36932/0 (socket says 172.21.15.82:36932) 2023-09-23T08:56:43.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.693+0000 7f16baffd700 1 -- 172.21.15.82:0/961417880 learned_addr learned my addr 172.21.15.82:0/961417880 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:43.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.693+0000 7f16bb7fe700 1 --2- 172.21.15.82:0/961417880 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16bc100930 0x7f16bc196560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:43.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.694+0000 7f16baffd700 1 -- 172.21.15.82:0/961417880 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f16bc1024c0 msgr2=0x7f16bc19db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:43.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.694+0000 7f16baffd700 1 --2- 172.21.15.82:0/961417880 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f16bc1024c0 0x7f16bc19db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:43.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.694+0000 7f16baffd700 1 -- 172.21.15.82:0/961417880 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16bc100930 msgr2=0x7f16bc196560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:43.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.694+0000 7f16baffd700 1 --2- 172.21.15.82:0/961417880 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16bc100930 0x7f16bc196560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:43.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.694+0000 7f16baffd700 1 -- 172.21.15.82:0/961417880 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16ac0095f0 con 0x7f16bc101b20 2023-09-23T08:56:43.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.694+0000 7f16baffd700 1 --2- 172.21.15.82:0/961417880 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16bc101b20 0x7f16bc196aa0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f16b000e9a0 tx=0x7f16b000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:43.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.694+0000 7f16b8ff9700 1 -- 172.21.15.82:0/961417880 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b0009790 con 0x7f16bc101b20 2023-09-23T08:56:43.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.694+0000 7f16b8ff9700 1 -- 172.21.15.82:0/961417880 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f16b000cbd0 con 0x7f16bc101b20 2023-09-23T08:56:43.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.694+0000 7f16b8ff9700 1 -- 172.21.15.82:0/961417880 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b0018680 con 0x7f16bc101b20 2023-09-23T08:56:43.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.694+0000 7f16c1bff700 1 -- 172.21.15.82:0/961417880 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16bc19e690 con 0x7f16bc101b20 2023-09-23T08:56:43.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.694+0000 7f16c1bff700 1 -- 172.21.15.82:0/961417880 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16bc19eb50 con 0x7f16bc101b20 2023-09-23T08:56:43.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.695+0000 7f16c1bff700 1 -- 172.21.15.82:0/961417880 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16bc10c040 con 0x7f16bc101b20 2023-09-23T08:56:43.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.698+0000 7f16b8ff9700 1 -- 172.21.15.82:0/961417880 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 134671+0+0 (secure 0 0 0) 0x7f16b000cd40 con 0x7f16bc101b20 2023-09-23T08:56:43.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.699+0000 7f16b8ff9700 1 --2- 172.21.15.82:0/961417880 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f16a409ffa0 0x7f16a40a2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:43.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.699+0000 7f16b8ff9700 1 -- 172.21.15.82:0/961417880 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f16b0014070 con 0x7f16bc101b20 2023-09-23T08:56:43.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.699+0000 7f16bb7fe700 1 --2- 172.21.15.82:0/961417880 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f16a409ffa0 0x7f16a40a2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:43.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.700+0000 7f16bb7fe700 1 --2- 172.21.15.82:0/961417880 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f16a409ffa0 0x7f16a40a2460 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f16ac009990 tx=0x7f16ac00b9b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:43.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.702+0000 7f16b8ff9700 1 -- 172.21.15.82:0/961417880 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f16b0095240 con 0x7f16bc101b20 2023-09-23T08:56:43.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:43 smithi135 ceph-mon[99205]: pgmap v358: 97 pgs: 97 active+clean; 647 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.3 KiB/s wr, 12 op/s 2023-09-23T08:56:43.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:43 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/927321213' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-09-23T08:56:43.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:43 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/3260525102' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-09-23T08:56:43.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:43 smithi082 ceph-mon[97694]: pgmap v358: 97 pgs: 97 active+clean; 647 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.3 KiB/s wr, 12 op/s 2023-09-23T08:56:43.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:43 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/927321213' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-09-23T08:56:43.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:43 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/3260525102' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-09-23T08:56:43.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:43 smithi161 ceph-mon[99580]: pgmap v358: 97 pgs: 97 active+clean; 647 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.3 KiB/s wr, 12 op/s 2023-09-23T08:56:43.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:43 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/927321213' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-09-23T08:56:43.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:43 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/3260525102' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-09-23T08:56:43.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.905+0000 7f16c1bff700 1 -- 172.21.15.82:0/961417880 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f16bc10c280 con 0x7f16bc101b20 2023-09-23T08:56:43.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.906+0000 7f16b8ff9700 1 -- 172.21.15.82:0/961417880 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+22508 (secure 0 0 0) 0x7f16b0098860 con 0x7f16bc101b20 2023-09-23T08:56:43.909 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:56:43.909 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":88,"fsid":"8926e286-59ed-11ee-8db4-212e2dc638e7","created":"2023-09-23T08:46:16.628057+0000","modified":"2023-09-23T08:55:23.423278+0000","last_up_change":"2023-09-23T08:53:56.524694+0000","last_in_change":"2023-09-23T08:53:35.779183+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-23T08:50:00.571063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-23T08:54:50.558630+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-23T08:54:52.055291+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7384c1ff-8c71-4feb-8cef-ba45c2a1708a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":892441948},{"type":"v1","addr":"172.21.15.82:6803","nonce":892441948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":892441948},{"type":"v1","addr":"172.21.15.82:6805","nonce":892441948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":892441948},{"type":"v1","addr":"172.21.15.82:6809","nonce":892441948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":892441948},{"type":"v1","addr":"172.21.15.82:6807","nonce":892441948}]},"public_addr":"172.21.15.82:6803/892441948","cluster_addr":"172.21.15.82:6805/892441948","heartbeat_back_addr":"172.21.15.82:6809/892441948","heartbeat_front_addr":"172.21.15.82:6807/892441948","state":["exists","up"]},{"osd":1,"uuid":"ca62333e-15db-4556-a9ed-8820f9268766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3224546922},{"type":"v1","addr":"172.21.15.135:6801","nonce":3224546922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3224546922},{"type":"v1","addr":"172.21.15.135:6803","nonce":3224546922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3224546922},{"type":"v1","addr":"172.21.15.135:6807","nonce":3224546922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3224546922},{"type":"v1","addr":"172.21.15.135:6805","nonce":3224546922}]},"public_addr":"172.21.15.135:6801/3224546922","cluster_addr":"172.21.15.135:6803/3224546922","heartbeat_back_addr":"172.21.15.135:6807/3224546922","heartbeat_front_addr":"172.21.15.135:6805/3224546922","state":["exists","up"]},{"osd":2,"uuid":"ac23eb38-216a-44f0-b316-a509b23745f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2358373459},{"type":"v1","addr":"172.21.15.161:6801","nonce":2358373459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2358373459},{"type":"v1","addr":"172.21.15.161:6803","nonce":2358373459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2358373459},{"type":"v1","addr":"172.21.15.161:6807","nonce":2358373459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2358373459},{"type":"v1","addr":"172.21.15.161:6805","nonce":2358373459}]},"public_addr":"172.21.15.161:6801/2358373459","cluster_addr":"172.21.15.161:6803/2358373459","heartbeat_back_addr":"172.21.15.161:6807/2358373459","heartbeat_front_addr":"172.21.15.161:6805/2358373459","state":["exists","up"]},{"osd":3,"uuid":"701c96b0-30fb-46ce-917d-e02d3814dc3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":1081464528},{"type":"v1","addr":"172.21.15.82:6811","nonce":1081464528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1081464528},{"type":"v1","addr":"172.21.15.82:6813","nonce":1081464528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1081464528},{"type":"v1","addr":"172.21.15.82:6817","nonce":1081464528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":1081464528},{"type":"v1","addr":"172.21.15.82:6815","nonce":1081464528}]},"public_addr":"172.21.15.82:6811/1081464528","cluster_addr":"172.21.15.82:6813/1081464528","heartbeat_back_addr":"172.21.15.82:6817/1081464528","heartbeat_front_addr":"172.21.15.82:6815/1081464528","state":["exists","up"]},{"osd":4,"uuid":"c618d2a2-3616-41b2-943c-7a4616538e13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2346495509},{"type":"v1","addr":"172.21.15.135:6809","nonce":2346495509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2346495509},{"type":"v1","addr":"172.21.15.135:6811","nonce":2346495509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2346495509},{"type":"v1","addr":"172.21.15.135:6815","nonce":2346495509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2346495509},{"type":"v1","addr":"172.21.15.135:6813","nonce":2346495509}]},"public_addr":"172.21.15.135:6809/2346495509","cluster_addr":"172.21.15.135:6811/2346495509","heartbeat_back_addr":"172.21.15.135:6815/2346495509","heartbeat_front_addr":"172.21.15.135:6813/2346495509","state":["exists","up"]},{"osd":5,"uuid":"8e1dda3d-6927-495d-b20d-78b03bb75d5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1252638628},{"type":"v1","addr":"172.21.15.161:6809","nonce":1252638628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1252638628},{"type":"v1","addr":"172.21.15.161:6811","nonce":1252638628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1252638628},{"type":"v1","addr":"172.21.15.161:6815","nonce":1252638628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1252638628},{"type":"v1","addr":"172.21.15.161:6813","nonce":1252638628}]},"public_addr":"172.21.15.161:6809/1252638628","cluster_addr":"172.21.15.161:6811/1252638628","heartbeat_back_addr":"172.21.15.161:6815/1252638628","heartbeat_front_addr":"172.21.15.161:6813/1252638628","state":["exists","up"]},{"osd":6,"uuid":"50b31960-6bc4-44e1-8116-3106bf161e56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1052038408},{"type":"v1","addr":"172.21.15.82:6819","nonce":1052038408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1052038408},{"type":"v1","addr":"172.21.15.82:6821","nonce":1052038408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":1052038408},{"type":"v1","addr":"172.21.15.82:6825","nonce":1052038408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1052038408},{"type":"v1","addr":"172.21.15.82:6823","nonce":1052038408}]},"public_addr":"172.21.15.82:6819/1052038408","cluster_addr":"172.21.15.82:6821/1052038408","heartbeat_back_addr":"172.21.15.82:6825/1052038408","heartbeat_front_addr":"172.21.15.82:6823/1052038408","state":["exists","up"]},{"osd":7,"uuid":"425ca0ee-57f7-4b27-90fb-d86bb5db5480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3683951498},{"type":"v1","addr":"172.21.15.135:6817","nonce":3683951498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":3683951498},{"type":"v1","addr":"172.21.15.135:6819","nonce":3683951498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":3683951498},{"type":"v1","addr":"172.21.15.135:6823","nonce":3683951498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":3683951498},{"type":"v1","addr":"172.21.15.135:6821","nonce":3683951498}]},"public_addr":"172.21.15.135:6817/3683951498","cluster_addr":"172.21.15.135:6819/3683951498","heartbeat_back_addr":"172.21.15.135:6823/3683951498","heartbeat_front_addr":"172.21.15.135:6821/3683951498","state":["exists","up"]},{"osd":8,"uuid":"1115c837-bef6-4bad-9974-4d913198511b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":948521536},{"type":"v1","addr":"172.21.15.161:6817","nonce":948521536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":948521536},{"type":"v1","addr":"172.21.15.161:6819","nonce":948521536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":948521536},{"type":"v1","addr":"172.21.15.161:6823","nonce":948521536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":948521536},{"type":"v1","addr":"172.21.15.161:6821","nonce":948521536}]},"public_addr":"172.21.15.161:6817/948521536","cluster_addr":"172.21.15.161:6819/948521536","heartbeat_back_addr":"172.21.15.161:6823/948521536","heartbeat_front_addr":"172.21.15.161:6821/948521536","state":["exists","up"]},{"osd":9,"uuid":"c52ec819-4bc6-402f-9cd8-62539e519e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":1438762840},{"type":"v1","addr":"172.21.15.82:6827","nonce":1438762840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":1438762840},{"type":"v1","addr":"172.21.15.82:6829","nonce":1438762840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1438762840},{"type":"v1","addr":"172.21.15.82:6833","nonce":1438762840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1438762840},{"type":"v1","addr":"172.21.15.82:6831","nonce":1438762840}]},"public_addr":"172.21.15.82:6827/1438762840","cluster_addr":"172.21.15.82:6829/1438762840","heartbeat_back_addr":"172.21.15.82:6833/1438762840","heartbeat_front_addr":"172.21.15.82:6831/1438762840","state":["exists","up"]},{"osd":10,"uuid":"1b16c795-1b91-4d46-ae5d-21b8332c1077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2853697851},{"type":"v1","addr":"172.21.15.135:6825","nonce":2853697851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2853697851},{"type":"v1","addr":"172.21.15.135:6827","nonce":2853697851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2853697851},{"type":"v1","addr":"172.21.15.135:6831","nonce":2853697851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2853697851},{"type":"v1","addr":"172.21.15.135:6829","nonce":2853697851}]},"public_addr":"172.21.15.135:6825/2853697851","cluster_addr":"172.21.15.135:6827/2853697851","heartbeat_back_addr":"172.21.15.135:6831/2853697851","heartbeat_front_addr":"172.21.15.135:6829/2853697851","state":["exists","up"]},{"osd":11,"uuid":"2551e602-4fe1-41cb-9b7d-c8b31fdd1487","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":1459332081},{"type":"v1","addr":"172.21.15.161:6825","nonce":1459332081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":1459332081},{"type":"v1","addr":"172.21.15.161:6827","nonce":1459332081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":1459332081},{"type":"v1","addr":"172.21.15.161:6831","nonce":1459332081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":1459332081},{"type":"v1","addr":"172.21.15.161:6829","nonce":1459332081}]},"public_addr":"172.21.15.161:6825/1459332081","cluster_addr":"172.21.15.161:6827/1459332081","heartbeat_back_addr":"172.21.15.161:6831/1459332081","heartbeat_front_addr":"172.21.15.161:6829/1459332081","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:49:04.007679+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:49:30.702365+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:49:56.785248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:50:22.988516+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:50:49.347055+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:51:15.830145+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:51:41.986377+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:52:08.218893+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:52:34.847450+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:53:01.317134+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:53:27.981691+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:53:54.849245+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/4204712132":"2023-09-24T08:47:21.957866+0000","172.21.15.82:6801/2733521564":"2023-09-24T08:47:21.957866+0000","172.21.15.82:6800/2733521564":"2023-09-24T08:47:21.957866+0000","172.21.15.82:0/3964794665":"2023-09-24T08:47:21.957866+0000","172.21.15.82:0/3535372205":"2023-09-24T08:46:55.187024+0000","172.21.15.82:0/285559684":"2023-09-24T08:46:55.187024+0000","172.21.15.82:0/1335891896":"2023-09-24T08:46:55.187024+0000","172.21.15.82:6801/3761509623":"2023-09-24T08:46:55.187024+0000","172.21.15.82:6800/3761509623":"2023-09-24T08:46:55.187024+0000","172.21.15.82:0/3775317005":"2023-09-24T08:47:21.957866+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-23T08:56:43.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.909+0000 7f16c1bff700 1 -- 172.21.15.82:0/961417880 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f16a409ffa0 msgr2=0x7f16a40a2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:43.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.909+0000 7f16c1bff700 1 --2- 172.21.15.82:0/961417880 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f16a409ffa0 0x7f16a40a2460 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f16ac009990 tx=0x7f16ac00b9b0 comp rx=0 tx=0).stop 2023-09-23T08:56:43.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.909+0000 7f16c1bff700 1 -- 172.21.15.82:0/961417880 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16bc101b20 msgr2=0x7f16bc196aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:43.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.909+0000 7f16c1bff700 1 --2- 172.21.15.82:0/961417880 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16bc101b20 0x7f16bc196aa0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f16b000e9a0 tx=0x7f16b000ecb0 comp rx=0 tx=0).stop 2023-09-23T08:56:43.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.909+0000 7f16c1bff700 1 -- 172.21.15.82:0/961417880 shutdown_connections 2023-09-23T08:56:43.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.909+0000 7f16c1bff700 1 --2- 172.21.15.82:0/961417880 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f16a409ffa0 0x7f16a40a2460 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:43.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.909+0000 7f16c1bff700 1 --2- 172.21.15.82:0/961417880 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f16bc1024c0 0x7f16bc19db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:43.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.909+0000 7f16c1bff700 1 --2- 172.21.15.82:0/961417880 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16bc100930 0x7f16bc196560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:43.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.909+0000 7f16c1bff700 1 --2- 172.21.15.82:0/961417880 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16bc101b20 0x7f16bc196aa0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:43.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.909+0000 7f16c1bff700 1 -- 172.21.15.82:0/961417880 >> 172.21.15.82:0/961417880 conn(0x7f16bc0fbe60 msgr2=0x7f16bc0fe190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:43.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.909+0000 7f16c1bff700 1 -- 172.21.15.82:0/961417880 shutdown_connections 2023-09-23T08:56:43.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:43.909+0000 7f16c1bff700 1 -- 172.21.15.82:0/961417880 wait complete. 2023-09-23T08:56:43.930 DEBUG:tasks.fwd_scrub:Yielding 2023-09-23T08:56:43.930 INFO:teuthology.run_tasks:Running task exec... 2023-09-23T08:56:43.941 INFO:teuthology.task.exec:Executing custom commands... 2023-09-23T08:56:43.941 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi082.front.sepia.ceph.com 2023-09-23T08:56:43.941 DEBUG:teuthology.orchestra.run.smithi082:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph mgr module enable snap_schedule' 2023-09-23T08:56:43.942 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2023-09-23T08:56:43.942 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-09-23T08:56:43.942 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-09-23T08:56:44.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.140+0000 7f9415fff700 1 -- 172.21.15.82:0/3669376459 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9410074960 msgr2=0x7f9410072db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:44.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.140+0000 7f9415fff700 1 --2- 172.21.15.82:0/3669376459 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9410074960 0x7f9410072db0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f9400009990 tx=0x7f9400009ca0 comp rx=0 tx=0).stop 2023-09-23T08:56:44.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.140+0000 7f9415fff700 1 -- 172.21.15.82:0/3669376459 shutdown_connections 2023-09-23T08:56:44.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.140+0000 7f9415fff700 1 --2- 172.21.15.82:0/3669376459 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f941010cf20 0x7f941010f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:44.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.140+0000 7f9415fff700 1 --2- 172.21.15.82:0/3669376459 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9410074960 0x7f9410072db0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:44.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.140+0000 7f9415fff700 1 --2- 172.21.15.82:0/3669376459 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9410073380 0x7f9410073800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:44.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.140+0000 7f9415fff700 1 -- 172.21.15.82:0/3669376459 >> 172.21.15.82:0/3669376459 conn(0x7f94100fbea0 msgr2=0x7f94100fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:44.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.140+0000 7f9415fff700 1 -- 172.21.15.82:0/3669376459 shutdown_connections 2023-09-23T08:56:44.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.140+0000 7f9415fff700 1 -- 172.21.15.82:0/3669376459 wait complete. 2023-09-23T08:56:44.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.141+0000 7f9415fff700 1 Processor -- start 2023-09-23T08:56:44.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.142+0000 7f9415fff700 1 -- start start 2023-09-23T08:56:44.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.142+0000 7f9415fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9410073380 0x7f941019cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:44.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.142+0000 7f9415fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9410074960 0x7f941019d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:44.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.142+0000 7f9415fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f941010cf20 0x7f941019dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:44.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.142+0000 7f9415fff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f941019e6a0 con 0x7f9410073380 2023-09-23T08:56:44.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.142+0000 7f9415fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f941019e810 con 0x7f9410074960 2023-09-23T08:56:44.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.142+0000 7f9415fff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f941019e9d0 con 0x7f941010cf20 2023-09-23T08:56:44.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.142+0000 7f940f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9410073380 0x7f941019cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:44.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.142+0000 7f940f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9410073380 0x7f941019cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36948/0 (socket says 172.21.15.82:36948) 2023-09-23T08:56:44.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.142+0000 7f940f7fe700 1 -- 172.21.15.82:0/3200397608 learned_addr learned my addr 172.21.15.82:0/3200397608 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:44.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.142+0000 7f940effd700 1 --2- 172.21.15.82:0/3200397608 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9410074960 0x7f941019d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:44.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.142+0000 7f940ffff700 1 --2- 172.21.15.82:0/3200397608 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f941010cf20 0x7f941019dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:44.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.143+0000 7f940f7fe700 1 -- 172.21.15.82:0/3200397608 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f941010cf20 msgr2=0x7f941019dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:44.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.143+0000 7f940f7fe700 1 --2- 172.21.15.82:0/3200397608 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f941010cf20 0x7f941019dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:44.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.143+0000 7f940f7fe700 1 -- 172.21.15.82:0/3200397608 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9410074960 msgr2=0x7f941019d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:44.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.143+0000 7f940f7fe700 1 --2- 172.21.15.82:0/3200397608 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9410074960 0x7f941019d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:44.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.143+0000 7f940f7fe700 1 -- 172.21.15.82:0/3200397608 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94000095f0 con 0x7f9410073380 2023-09-23T08:56:44.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.143+0000 7f940ffff700 1 --2- 172.21.15.82:0/3200397608 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f941010cf20 0x7f941019dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T08:56:44.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.143+0000 7f940effd700 1 --2- 172.21.15.82:0/3200397608 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9410074960 0x7f941019d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T08:56:44.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.143+0000 7f940f7fe700 1 --2- 172.21.15.82:0/3200397608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9410073380 0x7f941019cd20 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f9400005910 tx=0x7f94000057d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:44.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.143+0000 7f940cff9700 1 -- 172.21.15.82:0/3200397608 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f940001d070 con 0x7f9410073380 2023-09-23T08:56:44.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.143+0000 7f9415fff700 1 -- 172.21.15.82:0/3200397608 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f941019ec50 con 0x7f9410073380 2023-09-23T08:56:44.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.143+0000 7f940cff9700 1 -- 172.21.15.82:0/3200397608 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9400022470 con 0x7f9410073380 2023-09-23T08:56:44.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.143+0000 7f940cff9700 1 -- 172.21.15.82:0/3200397608 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f940000f6c0 con 0x7f9410073380 2023-09-23T08:56:44.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.144+0000 7f9415fff700 1 -- 172.21.15.82:0/3200397608 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94101a53d0 con 0x7f9410073380 2023-09-23T08:56:44.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.145+0000 7f9415fff700 1 -- 172.21.15.82:0/3200397608 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9410102a70 con 0x7f9410073380 2023-09-23T08:56:44.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.146+0000 7f940cff9700 1 -- 172.21.15.82:0/3200397608 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 134671+0+0 (secure 0 0 0) 0x7f94000225e0 con 0x7f9410073380 2023-09-23T08:56:44.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.148+0000 7f940cff9700 1 --2- 172.21.15.82:0/3200397608 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f93f809ff50 0x7f93f80a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:44.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.148+0000 7f940cff9700 1 -- 172.21.15.82:0/3200397608 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f94000cc8c0 con 0x7f9410073380 2023-09-23T08:56:44.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.148+0000 7f940effd700 1 --2- 172.21.15.82:0/3200397608 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f93f809ff50 0x7f93f80a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:44.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.149+0000 7f940effd700 1 --2- 172.21.15.82:0/3200397608 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f93f809ff50 0x7f93f80a2410 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f9410074680 tx=0x7f9404009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:44.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.152+0000 7f940cff9700 1 -- 172.21.15.82:0/3200397608 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f9400096690 con 0x7f9410073380 2023-09-23T08:56:44.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.152+0000 7f255a3ff700 1 -- 172.21.15.82:0/834507636 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2554100940 msgr2=0x7f2554100d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:44.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.152+0000 7f255a3ff700 1 --2- 172.21.15.82:0/834507636 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2554100940 0x7f2554100d60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2544009990 tx=0x7f2544009ca0 comp rx=0 tx=0).stop 2023-09-23T08:56:44.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.152+0000 7f255a3ff700 1 -- 172.21.15.82:0/834507636 shutdown_connections 2023-09-23T08:56:44.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.152+0000 7f255a3ff700 1 --2- 172.21.15.82:0/834507636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25541024d0 0x7f2554108d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:44.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.152+0000 7f255a3ff700 1 --2- 172.21.15.82:0/834507636 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2554100940 0x7f2554100d60 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:44.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.152+0000 7f255a3ff700 1 --2- 172.21.15.82:0/834507636 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2554101b30 0x7f2554101f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:44.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.152+0000 7f255a3ff700 1 -- 172.21.15.82:0/834507636 >> 172.21.15.82:0/834507636 conn(0x7f25540fbed0 msgr2=0x7f25540fe2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:44.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.152+0000 7f255a3ff700 1 -- 172.21.15.82:0/834507636 shutdown_connections 2023-09-23T08:56:44.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.152+0000 7f255a3ff700 1 -- 172.21.15.82:0/834507636 wait complete. 2023-09-23T08:56:44.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.153+0000 7f255a3ff700 1 Processor -- start 2023-09-23T08:56:44.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.154+0000 7f255a3ff700 1 -- start start 2023-09-23T08:56:44.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.154+0000 7f255a3ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2554100940 0x7f2554198740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:44.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.154+0000 7f255a3ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2554101b30 0x7f2554198c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:44.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.154+0000 7f255a3ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25541024d0 0x7f255419fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:44.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.154+0000 7f255a3ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25541a02c0 con 0x7f2554101b30 2023-09-23T08:56:44.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.154+0000 7f255a3ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25541a0400 con 0x7f25541024d0 2023-09-23T08:56:44.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.154+0000 7f255a3ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25541a0590 con 0x7f2554100940 2023-09-23T08:56:44.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.154+0000 7f25537fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2554101b30 0x7f2554198c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:44.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.154+0000 7f25537fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2554101b30 0x7f2554198c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36974/0 (socket says 172.21.15.82:36974) 2023-09-23T08:56:44.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.154+0000 7f25537fe700 1 -- 172.21.15.82:0/4091184013 learned_addr learned my addr 172.21.15.82:0/4091184013 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:44.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.154+0000 7f2553fff700 1 --2- 172.21.15.82:0/4091184013 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2554100940 0x7f2554198740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:44.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.155+0000 7f255899c700 1 --2- 172.21.15.82:0/4091184013 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25541024d0 0x7f255419fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:44.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.155+0000 7f25537fe700 1 -- 172.21.15.82:0/4091184013 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2554100940 msgr2=0x7f2554198740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:44.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.155+0000 7f25537fe700 1 --2- 172.21.15.82:0/4091184013 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2554100940 0x7f2554198740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:44.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.155+0000 7f25537fe700 1 -- 172.21.15.82:0/4091184013 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25541024d0 msgr2=0x7f255419fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:44.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.155+0000 7f25537fe700 1 --2- 172.21.15.82:0/4091184013 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25541024d0 0x7f255419fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:44.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.155+0000 7f25537fe700 1 -- 172.21.15.82:0/4091184013 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25440095f0 con 0x7f2554101b30 2023-09-23T08:56:44.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.155+0000 7f25537fe700 1 --2- 172.21.15.82:0/4091184013 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2554101b30 0x7f2554198c80 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f254800e9a0 tx=0x7f254800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:44.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.155+0000 7f25517fa700 1 -- 172.21.15.82:0/4091184013 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2548009790 con 0x7f2554101b30 2023-09-23T08:56:44.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.155+0000 7f25517fa700 1 -- 172.21.15.82:0/4091184013 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f254800cbd0 con 0x7f2554101b30 2023-09-23T08:56:44.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.155+0000 7f25517fa700 1 -- 172.21.15.82:0/4091184013 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2548018680 con 0x7f2554101b30 2023-09-23T08:56:44.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.155+0000 7f255a3ff700 1 -- 172.21.15.82:0/4091184013 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25541a0870 con 0x7f2554101b30 2023-09-23T08:56:44.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.155+0000 7f255a3ff700 1 -- 172.21.15.82:0/4091184013 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25541a0d30 con 0x7f2554101b30 2023-09-23T08:56:44.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.160+0000 7f256dc5cb80 1 Processor -- start 2023-09-23T08:56:44.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.160+0000 7f256dc5cb80 1 -- start start 2023-09-23T08:56:44.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.160+0000 7f25517fa700 1 -- 172.21.15.82:0/4091184013 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 134671+0+0 (secure 0 0 0) 0x7f254800cd40 con 0x7f2554101b30 2023-09-23T08:56:44.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.160+0000 7f256dc5cb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562bfd5aea50 0x562bfd5aee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:44.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.160+0000 7f256dc5cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562bfd5af3b0 0x562bfd5af7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:44.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.160+0000 7f256dc5cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562bfd5afdd0 0x562bfd5b0250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:44.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.160+0000 7f256dc5cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bfd516830 con 0x562bfd5af3b0 2023-09-23T08:56:44.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.160+0000 7f256dc5cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bfd507800 con 0x562bfd5afdd0 2023-09-23T08:56:44.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.160+0000 7f256dc5cb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bfd505120 con 0x562bfd5aea50 2023-09-23T08:56:44.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.161+0000 7f2553fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562bfd5af3b0 0x562bfd5af7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:44.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.161+0000 7f2553fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562bfd5af3b0 0x562bfd5af7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36984/0 (socket says 172.21.15.82:36984) 2023-09-23T08:56:44.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.161+0000 7f2553fff700 1 -- 172.21.15.82:0/2736947282 learned_addr learned my addr 172.21.15.82:0/2736947282 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:44.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.161+0000 7f255899c700 1 --2- 172.21.15.82:0/2736947282 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562bfd5aea50 0x562bfd5aee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:44.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.161+0000 7f25537fe700 1 --2- 172.21.15.82:0/2736947282 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562bfd5afdd0 0x562bfd5b0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:44.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.161+0000 7f2553fff700 1 -- 172.21.15.82:0/2736947282 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562bfd5aea50 msgr2=0x562bfd5aee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:56:44.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.161+0000 7f2553fff700 1 --2- 172.21.15.82:0/2736947282 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562bfd5aea50 0x562bfd5aee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:44.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.161+0000 7f2553fff700 1 -- 172.21.15.82:0/2736947282 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562bfd5afdd0 msgr2=0x562bfd5b0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:56:44.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.161+0000 7f2553fff700 1 --2- 172.21.15.82:0/2736947282 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562bfd5afdd0 0x562bfd5b0250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:44.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.161+0000 7f2553fff700 1 -- 172.21.15.82:0/2736947282 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562bfd3806b0 con 0x562bfd5af3b0 2023-09-23T08:56:44.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.161+0000 7f25537fe700 1 --2- 172.21.15.82:0/2736947282 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562bfd5afdd0 0x562bfd5b0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T08:56:44.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.162+0000 7f2553fff700 1 --2- 172.21.15.82:0/2736947282 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562bfd5af3b0 0x562bfd5af7f0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f2544006010 tx=0x7f2544005f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70525d611d995c7f server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:44.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.162+0000 7f253a7fc700 1 -- 172.21.15.82:0/2736947282 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2544005240 con 0x562bfd5af3b0 2023-09-23T08:56:44.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.162+0000 7f253a7fc700 1 -- 172.21.15.82:0/2736947282 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f254401e040 con 0x562bfd5af3b0 2023-09-23T08:56:44.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.162+0000 7f253a7fc700 1 -- 172.21.15.82:0/2736947282 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254400bee0 con 0x562bfd5af3b0 2023-09-23T08:56:44.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.162+0000 7f25517fa700 1 --2- 172.21.15.82:0/4091184013 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f253c09ffd0 0x7f253c0a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:44.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.163+0000 7f25517fa700 1 -- 172.21.15.82:0/4091184013 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f2548014070 con 0x7f2554101b30 2023-09-23T08:56:44.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.163+0000 7f256dc5cb80 1 -- 172.21.15.82:0/2736947282 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562bfd5af3b0 msgr2=0x562bfd5af7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:44.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.163+0000 7f256dc5cb80 1 --2- 172.21.15.82:0/2736947282 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562bfd5af3b0 0x562bfd5af7f0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f2544006010 tx=0x7f2544005f00 comp rx=0 tx=0).stop 2023-09-23T08:56:44.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.163+0000 7f255899c700 1 --2- 172.21.15.82:0/4091184013 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f253c09ffd0 0x7f253c0a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:44.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.163+0000 7f256dc5cb80 1 -- 172.21.15.82:0/2736947282 shutdown_connections 2023-09-23T08:56:44.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.163+0000 7f256dc5cb80 1 --2- 172.21.15.82:0/2736947282 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562bfd5afdd0 0x562bfd5b0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:44.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.163+0000 7f256dc5cb80 1 --2- 172.21.15.82:0/2736947282 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562bfd5aea50 0x562bfd5aee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:44.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.163+0000 7f256dc5cb80 1 --2- 172.21.15.82:0/2736947282 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562bfd5af3b0 0x562bfd5af7f0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:44.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.163+0000 7f256dc5cb80 1 -- 172.21.15.82:0/2736947282 >> 172.21.15.82:0/2736947282 conn(0x562bfd523160 msgr2=0x562bfd5a9320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:44.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.163+0000 7f256dc5cb80 1 -- 172.21.15.82:0/2736947282 shutdown_connections 2023-09-23T08:56:44.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.163+0000 7f256dc5cb80 1 -- 172.21.15.82:0/2736947282 wait complete. 2023-09-23T08:56:44.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.163+0000 7f255899c700 1 --2- 172.21.15.82:0/4091184013 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f253c09ffd0 0x7f253c0a2490 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f254c009fd0 tx=0x7f254c009040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:44.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.164+0000 7f256dc5cb80 1 -- start start 2023-09-23T08:56:44.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.164+0000 7f256dc5cb80 1 Processor -- start 2023-09-23T08:56:44.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.164+0000 7f256dc5cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562bfd5aea50 0x562bfd5b8420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:44.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.164+0000 7f256dc5cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562bfd5af3b0 0x562bfd5b8960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:44.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.164+0000 7f256dc5cb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562bfd5afdd0 0x562bfd5bf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:44.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.165+0000 7f256dc5cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bfd500a10 con 0x562bfd5aea50 2023-09-23T08:56:44.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.165+0000 7f256dc5cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bfd49ec30 con 0x562bfd5af3b0 2023-09-23T08:56:44.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.165+0000 7f256dc5cb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bfd49e930 con 0x562bfd5afdd0 2023-09-23T08:56:44.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.165+0000 7f256dc5cb80 10 client.0 _ll_register_callbacks cb 0x562bfd3e8b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T08:56:44.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.165+0000 7f2553fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562bfd5aea50 0x562bfd5b8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:44.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.165+0000 7f2553fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562bfd5aea50 0x562bfd5b8420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36990/0 (socket says 172.21.15.82:36990) 2023-09-23T08:56:44.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.165+0000 7f2553fff700 1 -- 172.21.15.82:0/1625098184 learned_addr learned my addr 172.21.15.82:0/1625098184 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:44.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.165+0000 7f25537fe700 1 --2- 172.21.15.82:0/1625098184 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562bfd5af3b0 0x562bfd5b8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:44.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.165+0000 7f255899c700 1 --2- 172.21.15.82:0/1625098184 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562bfd5afdd0 0x562bfd5bf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:44.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.165+0000 7f2553fff700 1 -- 172.21.15.82:0/1625098184 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562bfd5afdd0 msgr2=0x562bfd5bf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:56:44.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.165+0000 7f2553fff700 1 --2- 172.21.15.82:0/1625098184 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562bfd5afdd0 0x562bfd5bf9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:44.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.165+0000 7f2553fff700 1 -- 172.21.15.82:0/1625098184 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562bfd5af3b0 msgr2=0x562bfd5b8960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:56:44.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.165+0000 7f2553fff700 1 --2- 172.21.15.82:0/1625098184 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562bfd5af3b0 0x562bfd5b8960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:44.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.165+0000 7f2553fff700 1 -- 172.21.15.82:0/1625098184 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25541096d0 con 0x562bfd5aea50 2023-09-23T08:56:44.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.165+0000 7f255899c700 1 --2- 172.21.15.82:0/1625098184 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562bfd5afdd0 0x562bfd5bf9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T08:56:44.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.166+0000 7f2553fff700 1 --2- 172.21.15.82:0/1625098184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562bfd5aea50 0x562bfd5b8420 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f25440059d0 tx=0x7f2544005270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a42fb135dd9f7ea server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:44.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.166+0000 7f25337fe700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T08:56:44.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.166+0000 7f25337fe700 1 -- 172.21.15.82:0/1625098184 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2544005720 con 0x562bfd5aea50 2023-09-23T08:56:44.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.166+0000 7f256dc5cb80 1 -- 172.21.15.82:0/1625098184 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562bfd57e240 con 0x562bfd5aea50 2023-09-23T08:56:44.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.166+0000 7f25337fe700 1 -- 172.21.15.82:0/1625098184 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f2544003880 con 0x562bfd5aea50 2023-09-23T08:56:44.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.166+0000 7f25337fe700 1 -- 172.21.15.82:0/1625098184 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2544003a40 con 0x562bfd5aea50 2023-09-23T08:56:44.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.166+0000 7f256dc5cb80 10 client.15501 fetch_fsmap learned FSMap version 26 2023-09-23T08:56:44.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.166+0000 7f256dc5cb80 1 -- 172.21.15.82:0/1625098184 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x562bfd32ce60 con 0x562bfd5aea50 2023-09-23T08:56:44.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.166+0000 7f25337fe700 1 -- 172.21.15.82:0/1625098184 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562bfd57e240 con 0x562bfd5aea50 2023-09-23T08:56:44.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.167+0000 7f25337fe700 1 -- 172.21.15.82:0/1625098184 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f2544004cf0 con 0x562bfd5aea50 2023-09-23T08:56:44.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.167+0000 7f256dc5cb80 10 client.15501 fetch_fsmap finished waiting for FSMap version 26 2023-09-23T08:56:44.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.167+0000 7f256dc5cb80 10 client.15501 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T08:56:44.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.167+0000 7f256dc5cb80 20 client.15501 populate_metadata read hostname 'smithi082' 2023-09-23T08:56:44.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.167+0000 7f256dc5cb80 1 --2- 172.21.15.82:0/1625098184 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x562bfd5c3cd0 0x562bfd5c60f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:44.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.167+0000 7f256dc5cb80 4 client.15501 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T08:56:44.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.167+0000 7f256dc5cb80 1 -- 172.21.15.82:0/1625098184 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562bfd4a6c20 con 0x562bfd5c3cd0 2023-09-23T08:56:44.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.167+0000 7f25537fe700 1 --2- 172.21.15.82:0/1625098184 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x562bfd5c3cd0 0x562bfd5c60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:44.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.168+0000 7f25337fe700 10 client.15501 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T08:56:44.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.168+0000 7f25537fe700 1 --2- 172.21.15.82:0/1625098184 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x562bfd5c3cd0 0x562bfd5c60f0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1170b91fb97d10b server_cookie=6486ff8123c68da6 in_seq=0 out_seq=0 2023-09-23T08:56:44.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.168+0000 7f25337fe700 1 -- 172.21.15.82:0/1625098184 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x562bfd4a6c20 con 0x562bfd5c3cd0 2023-09-23T08:56:44.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.168+0000 7f25337fe700 10 client.15501 handle_command_reply: tid=0 2023-09-23T08:56:44.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.169+0000 7f256dc5cb80 1 client.15501 shutdown 2023-09-23T08:56:44.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.169+0000 7f256dc5cb80 1 -- 172.21.15.82:0/1625098184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562bfd5aea50 msgr2=0x562bfd5b8420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:44.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.169+0000 7f256dc5cb80 1 --2- 172.21.15.82:0/1625098184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562bfd5aea50 0x562bfd5b8420 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f25440059d0 tx=0x7f2544005270 comp rx=0 tx=0).stop 2023-09-23T08:56:44.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.169+0000 7f256dc5cb80 1 -- 172.21.15.82:0/1625098184 shutdown_connections 2023-09-23T08:56:44.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.169+0000 7f256dc5cb80 1 --2- 172.21.15.82:0/1625098184 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562bfd5afdd0 0x562bfd5bf9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:44.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.169+0000 7f256dc5cb80 1 --2- 172.21.15.82:0/1625098184 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x562bfd5c3cd0 0x562bfd5c60f0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:44.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.169+0000 7f256dc5cb80 1 --2- 172.21.15.82:0/1625098184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562bfd5aea50 0x562bfd5b8420 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:44.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.169+0000 7f256dc5cb80 1 --2- 172.21.15.82:0/1625098184 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562bfd5af3b0 0x562bfd5b8960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:44.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.169+0000 7f256dc5cb80 1 -- 172.21.15.82:0/1625098184 >> 172.21.15.82:0/1625098184 conn(0x562bfd523160 msgr2=0x562bfd5a3bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:44.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.169+0000 7f25337fe700 0 client.15501 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T08:56:44.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.169+0000 7f256dc5cb80 1 -- 172.21.15.82:0/1625098184 shutdown_connections 2023-09-23T08:56:44.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.169+0000 7f256dc5cb80 1 -- 172.21.15.82:0/1625098184 wait complete. 2023-09-23T08:56:44.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.169+0000 7f256dc5cb80 20 client.15501 trim_cache size 0 max 16384 2023-09-23T08:56:44.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.204+0000 7f256dc5cb80 1 Processor -- start 2023-09-23T08:56:44.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.204+0000 7f256dc5cb80 1 -- start start 2023-09-23T08:56:44.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.204+0000 7f256dc5cb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562bfd5aea50 0x562bfd5b2c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:44.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.204+0000 7f256dc5cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562bfd5af3b0 0x562bfd5b31d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:44.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.204+0000 7f256dc5cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562bfd5afdd0 0x562bfd5bf960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:44.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.204+0000 7f256dc5cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bfd3829a0 con 0x562bfd5af3b0 2023-09-23T08:56:44.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.204+0000 7f256dc5cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bfd5aa610 con 0x562bfd5afdd0 2023-09-23T08:56:44.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.204+0000 7f256dc5cb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bfd5b78d0 con 0x562bfd5aea50 2023-09-23T08:56:44.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.204+0000 7f25537fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562bfd5af3b0 0x562bfd5b31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:44.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.204+0000 7f25537fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562bfd5af3b0 0x562bfd5b31d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36992/0 (socket says 172.21.15.82:36992) 2023-09-23T08:56:44.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.204+0000 7f25537fe700 1 -- 172.21.15.82:0/829468703 learned_addr learned my addr 172.21.15.82:0/829468703 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:44.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.205+0000 7f2553fff700 1 --2- 172.21.15.82:0/829468703 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562bfd5aea50 0x562bfd5b2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:44.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.205+0000 7f255899c700 1 --2- 172.21.15.82:0/829468703 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562bfd5afdd0 0x562bfd5bf960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:44.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.205+0000 7f25537fe700 1 -- 172.21.15.82:0/829468703 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562bfd5aea50 msgr2=0x562bfd5b2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:56:44.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.205+0000 7f25537fe700 1 --2- 172.21.15.82:0/829468703 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562bfd5aea50 0x562bfd5b2c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:44.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.205+0000 7f25537fe700 1 -- 172.21.15.82:0/829468703 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562bfd5afdd0 msgr2=0x562bfd5bf960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:56:44.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.205+0000 7f25537fe700 1 --2- 172.21.15.82:0/829468703 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562bfd5afdd0 0x562bfd5bf960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:44.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.205+0000 7f25537fe700 1 -- 172.21.15.82:0/829468703 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562bfd5cace0 con 0x562bfd5af3b0 2023-09-23T08:56:44.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.205+0000 7f2553fff700 1 --2- 172.21.15.82:0/829468703 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562bfd5aea50 0x562bfd5b2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T08:56:44.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.205+0000 7f25537fe700 1 --2- 172.21.15.82:0/829468703 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562bfd5af3b0 0x562bfd5b31d0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f2548098e90 tx=0x7f25480c8e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e294f7b3b9e4153 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:44.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.205+0000 7f253affd700 1 -- 172.21.15.82:0/829468703 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2548099600 con 0x562bfd5af3b0 2023-09-23T08:56:44.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.205+0000 7f253affd700 1 -- 172.21.15.82:0/829468703 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2548098f00 con 0x562bfd5af3b0 2023-09-23T08:56:44.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.205+0000 7f253affd700 1 -- 172.21.15.82:0/829468703 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2548099160 con 0x562bfd5af3b0 2023-09-23T08:56:44.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.206+0000 7f256dc5cb80 1 -- 172.21.15.82:0/829468703 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562bfd5af3b0 msgr2=0x562bfd5b31d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:44.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.206+0000 7f256dc5cb80 1 --2- 172.21.15.82:0/829468703 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562bfd5af3b0 0x562bfd5b31d0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f2548098e90 tx=0x7f25480c8e80 comp rx=0 tx=0).stop 2023-09-23T08:56:44.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.206+0000 7f256dc5cb80 1 -- 172.21.15.82:0/829468703 shutdown_connections 2023-09-23T08:56:44.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.206+0000 7f256dc5cb80 1 --2- 172.21.15.82:0/829468703 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562bfd5afdd0 0x562bfd5bf960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:44.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.206+0000 7f256dc5cb80 1 --2- 172.21.15.82:0/829468703 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562bfd5aea50 0x562bfd5b2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:44.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.206+0000 7f256dc5cb80 1 --2- 172.21.15.82:0/829468703 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562bfd5af3b0 0x562bfd5b31d0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:44.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.206+0000 7f256dc5cb80 1 -- 172.21.15.82:0/829468703 >> 172.21.15.82:0/829468703 conn(0x562bfd523160 msgr2=0x562bfd5b6160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:44.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.206+0000 7f256dc5cb80 1 -- 172.21.15.82:0/829468703 shutdown_connections 2023-09-23T08:56:44.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.206+0000 7f256dc5cb80 1 -- 172.21.15.82:0/829468703 wait complete. 2023-09-23T08:56:44.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.207+0000 7f256dc5cb80 1 -- start start 2023-09-23T08:56:44.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.207+0000 7f256dc5cb80 1 Processor -- start 2023-09-23T08:56:44.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.208+0000 7f256dc5cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562bfd5aea50 0x562bfd5bf640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:44.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.208+0000 7f256dc5cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562bfd5af3b0 0x562bfd5bc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:44.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.208+0000 7f256dc5cb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562bfd5afdd0 0x562bfd5bc620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:44.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.208+0000 7f256dc5cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bfd5bcb60 con 0x562bfd5af3b0 2023-09-23T08:56:44.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.208+0000 7f256dc5cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bfd5bccd0 con 0x562bfd5aea50 2023-09-23T08:56:44.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.208+0000 7f256dc5cb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bfd617ab0 con 0x562bfd5afdd0 2023-09-23T08:56:44.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.208+0000 7f256dc5cb80 10 client.0 _ll_register_callbacks cb 0x7f254c009d40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T08:56:44.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.208+0000 7f25537fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562bfd5af3b0 0x562bfd5bc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:44.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.208+0000 7f25537fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562bfd5af3b0 0x562bfd5bc0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37000/0 (socket says 172.21.15.82:37000) 2023-09-23T08:56:44.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.208+0000 7f25537fe700 1 -- 172.21.15.82:0/1628097849 learned_addr learned my addr 172.21.15.82:0/1628097849 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:44.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.208+0000 7f2553fff700 1 --2- 172.21.15.82:0/1628097849 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562bfd5aea50 0x562bfd5bf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:44.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.208+0000 7f255899c700 1 --2- 172.21.15.82:0/1628097849 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562bfd5afdd0 0x562bfd5bc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:44.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.208+0000 7f25537fe700 1 -- 172.21.15.82:0/1628097849 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562bfd5afdd0 msgr2=0x562bfd5bc620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:56:44.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.208+0000 7f25537fe700 1 --2- 172.21.15.82:0/1628097849 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562bfd5afdd0 0x562bfd5bc620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:44.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.208+0000 7f25537fe700 1 -- 172.21.15.82:0/1628097849 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562bfd5aea50 msgr2=0x562bfd5bf640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:56:44.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.208+0000 7f25537fe700 1 --2- 172.21.15.82:0/1628097849 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562bfd5aea50 0x562bfd5bf640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:44.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.208+0000 7f25537fe700 1 -- 172.21.15.82:0/1628097849 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25541a0d30 con 0x562bfd5af3b0 2023-09-23T08:56:44.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.208+0000 7f2553fff700 1 --2- 172.21.15.82:0/1628097849 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562bfd5aea50 0x562bfd5bf640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T08:56:44.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.208+0000 7f25537fe700 1 --2- 172.21.15.82:0/1628097849 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562bfd5af3b0 0x562bfd5bc0e0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f2548098c00 tx=0x7f2548095370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ea8e06c27aa8118 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:44.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.208+0000 7f25337fe700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T08:56:44.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.209+0000 7f25337fe700 1 -- 172.21.15.82:0/1628097849 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25480973a0 con 0x562bfd5af3b0 2023-09-23T08:56:44.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.209+0000 7f256dc5cb80 1 -- 172.21.15.82:0/1628097849 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562bfd5a1930 con 0x562bfd5af3b0 2023-09-23T08:56:44.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.209+0000 7f25337fe700 1 -- 172.21.15.82:0/1628097849 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f25480cb2d0 con 0x562bfd5af3b0 2023-09-23T08:56:44.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.209+0000 7f25337fe700 1 -- 172.21.15.82:0/1628097849 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2548099600 con 0x562bfd5af3b0 2023-09-23T08:56:44.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.209+0000 7f256dc5cb80 10 client.15507 fetch_fsmap learned FSMap version 26 2023-09-23T08:56:44.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.209+0000 7f256dc5cb80 1 -- 172.21.15.82:0/1628097849 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x562bfd315ce0 con 0x562bfd5af3b0 2023-09-23T08:56:44.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.209+0000 7f25337fe700 1 -- 172.21.15.82:0/1628097849 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562bfd5a1930 con 0x562bfd5af3b0 2023-09-23T08:56:44.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.209+0000 7f25337fe700 1 -- 172.21.15.82:0/1628097849 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f2548099280 con 0x562bfd5af3b0 2023-09-23T08:56:44.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.209+0000 7f256dc5cb80 10 client.15507 fetch_fsmap finished waiting for FSMap version 26 2023-09-23T08:56:44.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.209+0000 7f256dc5cb80 10 client.15507 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T08:56:44.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.209+0000 7f256dc5cb80 20 client.15507 populate_metadata read hostname 'smithi082' 2023-09-23T08:56:44.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.209+0000 7f256dc5cb80 1 --2- 172.21.15.82:0/1628097849 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x562bfd619150 0x562bfd61b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:44.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.209+0000 7f256dc5cb80 4 client.15507 mds_command: new command op to 24557 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-09-23T08:56:44.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.209+0000 7f256dc5cb80 1 -- 172.21.15.82:0/1628097849 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x562bfd4f99f0 con 0x562bfd619150 2023-09-23T08:56:44.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.210+0000 7f2553fff700 1 --2- 172.21.15.82:0/1628097849 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x562bfd619150 0x562bfd61b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:44.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.210+0000 7f2553fff700 1 --2- 172.21.15.82:0/1628097849 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x562bfd619150 0x562bfd61b570 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=557ae2e117a01651 server_cookie=6d10f0d8b2262033 in_seq=0 out_seq=0 2023-09-23T08:56:44.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.210+0000 7f25337fe700 10 client.15507 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T08:56:44.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.212+0000 7f25337fe700 1 -- 172.21.15.82:0/1628097849 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x562bfd4f99f0 con 0x562bfd619150 2023-09-23T08:56:44.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.212+0000 7f25337fe700 10 client.15507 handle_command_reply: tid=0 2023-09-23T08:56:44.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.212+0000 7f256dc5cb80 1 client.15507 shutdown 2023-09-23T08:56:44.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.212+0000 7f256dc5cb80 1 -- 172.21.15.82:0/1628097849 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562bfd5af3b0 msgr2=0x562bfd5bc0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:44.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.212+0000 7f256dc5cb80 1 --2- 172.21.15.82:0/1628097849 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562bfd5af3b0 0x562bfd5bc0e0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f2548098c00 tx=0x7f2548095370 comp rx=0 tx=0).stop 2023-09-23T08:56:44.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.212+0000 7f256dc5cb80 1 -- 172.21.15.82:0/1628097849 shutdown_connections 2023-09-23T08:56:44.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.212+0000 7f256dc5cb80 1 --2- 172.21.15.82:0/1628097849 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562bfd5afdd0 0x562bfd5bc620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:44.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.212+0000 7f256dc5cb80 1 --2- 172.21.15.82:0/1628097849 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562bfd5aea50 0x562bfd5bf640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:44.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.212+0000 7f256dc5cb80 1 --2- 172.21.15.82:0/1628097849 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x562bfd619150 0x562bfd61b570 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:44.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.212+0000 7f256dc5cb80 1 --2- 172.21.15.82:0/1628097849 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562bfd5af3b0 0x562bfd5bc0e0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:44.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.212+0000 7f25337fe700 0 client.15507 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T08:56:44.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.212+0000 7f256dc5cb80 1 -- 172.21.15.82:0/1628097849 >> 172.21.15.82:0/1628097849 conn(0x562bfd523160 msgr2=0x562bfd5b6160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:44.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.212+0000 7f256dc5cb80 1 -- 172.21.15.82:0/1628097849 shutdown_connections 2023-09-23T08:56:44.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.212+0000 7f256dc5cb80 1 -- 172.21.15.82:0/1628097849 wait complete. 2023-09-23T08:56:44.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.212+0000 7f256dc5cb80 20 client.15507 trim_cache size 0 max 16384 2023-09-23T08:56:44.220 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T08:56:44.220 INFO:teuthology.orchestra.run.smithi082.stdout: "return_code": 0, 2023-09-23T08:56:44.220 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_tag": "bc317b63-fc76-43e1-9c32-1e8d4be07baa", 2023-09-23T08:56:44.220 INFO:teuthology.orchestra.run.smithi082.stdout: "mode": "asynchronous" 2023-09-23T08:56:44.220 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T08:56:44.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.213+0000 7f255a3ff700 1 -- 172.21.15.82:0/4091184013 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f253c09ffd0 msgr2=0x7f253c0a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:44.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.213+0000 7f255a3ff700 1 --2- 172.21.15.82:0/4091184013 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f253c09ffd0 0x7f253c0a2490 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f254c009fd0 tx=0x7f254c009040 comp rx=0 tx=0).stop 2023-09-23T08:56:44.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.213+0000 7f255a3ff700 1 -- 172.21.15.82:0/4091184013 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2554101b30 msgr2=0x7f2554198c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:44.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.213+0000 7f255a3ff700 1 --2- 172.21.15.82:0/4091184013 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2554101b30 0x7f2554198c80 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f254800e9a0 tx=0x7f254800ed60 comp rx=0 tx=0).stop 2023-09-23T08:56:44.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.213+0000 7f255a3ff700 1 -- 172.21.15.82:0/4091184013 shutdown_connections 2023-09-23T08:56:44.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.213+0000 7f255a3ff700 1 --2- 172.21.15.82:0/4091184013 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f253c09ffd0 0x7f253c0a2490 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:44.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.213+0000 7f255a3ff700 1 --2- 172.21.15.82:0/4091184013 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25541024d0 0x7f255419fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:44.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.213+0000 7f255a3ff700 1 --2- 172.21.15.82:0/4091184013 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2554100940 0x7f2554198740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:44.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.213+0000 7f255a3ff700 1 --2- 172.21.15.82:0/4091184013 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2554101b30 0x7f2554198c80 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:44.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.213+0000 7f255a3ff700 1 -- 172.21.15.82:0/4091184013 >> 172.21.15.82:0/4091184013 conn(0x7f25540fbed0 msgr2=0x7f25541074a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:44.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.213+0000 7f255a3ff700 1 -- 172.21.15.82:0/4091184013 shutdown_connections 2023-09-23T08:56:44.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.213+0000 7f255a3ff700 1 -- 172.21.15.82:0/4091184013 wait complete. 2023-09-23T08:56:44.234 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T08:56:44.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.433+0000 7fdcd7fff700 1 -- 172.21.15.82:0/3882563583 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdcd0100930 msgr2=0x7fdcd0100d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:44.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.433+0000 7fdcd7fff700 1 --2- 172.21.15.82:0/3882563583 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdcd0100930 0x7fdcd0100d50 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fdccc0099c0 tx=0x7fdccc009cd0 comp rx=0 tx=0).stop 2023-09-23T08:56:44.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.433+0000 7fdcd7fff700 1 -- 172.21.15.82:0/3882563583 shutdown_connections 2023-09-23T08:56:44.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.433+0000 7fdcd7fff700 1 --2- 172.21.15.82:0/3882563583 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdcd01024c0 0x7fdcd0108d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:44.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.433+0000 7fdcd7fff700 1 --2- 172.21.15.82:0/3882563583 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdcd0100930 0x7fdcd0100d50 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:44.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.433+0000 7fdcd7fff700 1 --2- 172.21.15.82:0/3882563583 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdcd0101b20 0x7fdcd0101f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:44.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.433+0000 7fdcd7fff700 1 -- 172.21.15.82:0/3882563583 >> 172.21.15.82:0/3882563583 conn(0x7fdcd00fbea0 msgr2=0x7fdcd00fe2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:44.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.433+0000 7fdcd7fff700 1 -- 172.21.15.82:0/3882563583 shutdown_connections 2023-09-23T08:56:44.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.433+0000 7fdcd7fff700 1 -- 172.21.15.82:0/3882563583 wait complete. 2023-09-23T08:56:44.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.435+0000 7fdcd7fff700 1 Processor -- start 2023-09-23T08:56:44.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.435+0000 7fdcd7fff700 1 -- start start 2023-09-23T08:56:44.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.435+0000 7fdcd7fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdcd0100930 0x7fdcd0196570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:44.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.435+0000 7fdcd7fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdcd0101b20 0x7fdcd0196ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:44.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.435+0000 7fdcd7fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdcd01024c0 0x7fdcd019db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:44.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.435+0000 7fdcd7fff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd019e0f0 con 0x7fdcd0101b20 2023-09-23T08:56:44.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.435+0000 7fdcd7fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd019e230 con 0x7fdcd01024c0 2023-09-23T08:56:44.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.435+0000 7fdcd7fff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd019e3c0 con 0x7fdcd0100930 2023-09-23T08:56:44.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.436+0000 7fdcd559a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdcd0101b20 0x7fdcd0196ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:44.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.436+0000 7fdcd559a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdcd0101b20 0x7fdcd0196ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37004/0 (socket says 172.21.15.82:37004) 2023-09-23T08:56:44.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.436+0000 7fdcd559a700 1 -- 172.21.15.82:0/1211625279 learned_addr learned my addr 172.21.15.82:0/1211625279 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:44.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.436+0000 7fdcd659c700 1 --2- 172.21.15.82:0/1211625279 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdcd01024c0 0x7fdcd019db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:44.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.436+0000 7fdcd5d9b700 1 --2- 172.21.15.82:0/1211625279 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdcd0100930 0x7fdcd0196570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:44.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.436+0000 7fdcd559a700 1 -- 172.21.15.82:0/1211625279 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdcd0100930 msgr2=0x7fdcd0196570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:44.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.436+0000 7fdcd559a700 1 --2- 172.21.15.82:0/1211625279 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdcd0100930 0x7fdcd0196570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:44.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.436+0000 7fdcd559a700 1 -- 172.21.15.82:0/1211625279 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdcd01024c0 msgr2=0x7fdcd019db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:44.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.436+0000 7fdcd559a700 1 --2- 172.21.15.82:0/1211625279 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdcd01024c0 0x7fdcd019db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:44.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.436+0000 7fdcd559a700 1 -- 172.21.15.82:0/1211625279 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdccc0095f0 con 0x7fdcd0101b20 2023-09-23T08:56:44.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.436+0000 7fdcd5d9b700 1 --2- 172.21.15.82:0/1211625279 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdcd0100930 0x7fdcd0196570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T08:56:44.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.436+0000 7fdcd559a700 1 --2- 172.21.15.82:0/1211625279 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdcd0101b20 0x7fdcd0196ab0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fdcc000d950 tx=0x7fdcc000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:44.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.437+0000 7fdcc6ffd700 1 -- 172.21.15.82:0/1211625279 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc0009940 con 0x7fdcd0101b20 2023-09-23T08:56:44.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.437+0000 7fdcd7fff700 1 -- 172.21.15.82:0/1211625279 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcd019e6a0 con 0x7fdcd0101b20 2023-09-23T08:56:44.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.437+0000 7fdcc6ffd700 1 -- 172.21.15.82:0/1211625279 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdcc0010460 con 0x7fdcd0101b20 2023-09-23T08:56:44.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.437+0000 7fdcc6ffd700 1 -- 172.21.15.82:0/1211625279 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc000f620 con 0x7fdcd0101b20 2023-09-23T08:56:44.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.437+0000 7fdcd7fff700 1 -- 172.21.15.82:0/1211625279 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcd019ebb0 con 0x7fdcd0101b20 2023-09-23T08:56:44.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.441+0000 7fdceb979b80 1 Processor -- start 2023-09-23T08:56:44.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.441+0000 7fdceb979b80 1 -- start start 2023-09-23T08:56:44.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.442+0000 7fdcc6ffd700 1 -- 172.21.15.82:0/1211625279 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 134671+0+0 (secure 0 0 0) 0x7fdcc00105d0 con 0x7fdcd0101b20 2023-09-23T08:56:44.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.442+0000 7fdceb979b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575c30ccde0 0x5575c30cd200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:44.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.442+0000 7fdceb979b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575c30cd740 0x5575c30cdb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:44.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.442+0000 7fdceb979b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575c30ce160 0x5575c30ce5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:44.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.442+0000 7fdceb979b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575c30307b0 con 0x5575c30ccde0 2023-09-23T08:56:44.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.442+0000 7fdceb979b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575c3021780 con 0x5575c30ce160 2023-09-23T08:56:44.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.442+0000 7fdceb979b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575c301f0a0 con 0x5575c30cd740 2023-09-23T08:56:44.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.442+0000 7fdcd659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575c30ccde0 0x5575c30cd200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:44.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.442+0000 7fdcd659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575c30ccde0 0x5575c30cd200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37006/0 (socket says 172.21.15.82:37006) 2023-09-23T08:56:44.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.442+0000 7fdcd659c700 1 -- 172.21.15.82:0/2654699358 learned_addr learned my addr 172.21.15.82:0/2654699358 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:44.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.442+0000 7fdcd5d9b700 1 --2- 172.21.15.82:0/2654699358 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575c30cd740 0x5575c30cdb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:44.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.442+0000 7fdcd659c700 1 -- 172.21.15.82:0/2654699358 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575c30cd740 msgr2=0x5575c30cdb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:56:44.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.442+0000 7fdcd659c700 1 --2- 172.21.15.82:0/2654699358 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575c30cd740 0x5575c30cdb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:44.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.442+0000 7fdcd659c700 1 -- 172.21.15.82:0/2654699358 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575c30ce160 msgr2=0x5575c30ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:56:44.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.442+0000 7fdcd659c700 1 --2- 172.21.15.82:0/2654699358 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575c30ce160 0x5575c30ce5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:44.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.442+0000 7fdcd659c700 1 -- 172.21.15.82:0/2654699358 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5575c2e9a630 con 0x5575c30ccde0 2023-09-23T08:56:44.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.443+0000 7fdcd659c700 1 --2- 172.21.15.82:0/2654699358 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575c30ccde0 0x5575c30cd200 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fdcc80098f0 tx=0x7fdcc8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7566a6b1773435c server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:44.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.443+0000 7fdcbbfff700 1 -- 172.21.15.82:0/2654699358 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc8019070 con 0x5575c30ccde0 2023-09-23T08:56:44.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.443+0000 7fdcbbfff700 1 -- 172.21.15.82:0/2654699358 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdcc800f040 con 0x5575c30ccde0 2023-09-23T08:56:44.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.443+0000 7fdcbbfff700 1 -- 172.21.15.82:0/2654699358 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc8007ac0 con 0x5575c30ccde0 2023-09-23T08:56:44.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.444+0000 7fdcc6ffd700 1 --2- 172.21.15.82:0/1211625279 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fdcbc09ff50 0x7fdcbc0a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:44.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.444+0000 7fdceb979b80 1 -- 172.21.15.82:0/2654699358 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575c30ccde0 msgr2=0x5575c30cd200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:44.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.444+0000 7fdceb979b80 1 --2- 172.21.15.82:0/2654699358 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575c30ccde0 0x5575c30cd200 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fdcc80098f0 tx=0x7fdcc8009c00 comp rx=0 tx=0).stop 2023-09-23T08:56:44.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.444+0000 7fdcc6ffd700 1 -- 172.21.15.82:0/1211625279 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fdcc00cb050 con 0x7fdcd0101b20 2023-09-23T08:56:44.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.444+0000 7fdceb979b80 1 -- 172.21.15.82:0/2654699358 shutdown_connections 2023-09-23T08:56:44.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.444+0000 7fdceb979b80 1 --2- 172.21.15.82:0/2654699358 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575c30ce160 0x5575c30ce5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:44.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.444+0000 7fdceb979b80 1 --2- 172.21.15.82:0/2654699358 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575c30ccde0 0x5575c30cd200 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:44.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.444+0000 7fdceb979b80 1 --2- 172.21.15.82:0/2654699358 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575c30cd740 0x5575c30cdb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:44.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.444+0000 7fdceb979b80 1 -- 172.21.15.82:0/2654699358 >> 172.21.15.82:0/2654699358 conn(0x5575c303d0e0 msgr2=0x5575c30c32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:44.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.444+0000 7fdcd5d9b700 1 --2- 172.21.15.82:0/1211625279 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fdcbc09ff50 0x7fdcbc0a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:44.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.444+0000 7fdceb979b80 1 -- 172.21.15.82:0/2654699358 shutdown_connections 2023-09-23T08:56:44.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.444+0000 7fdceb979b80 1 -- 172.21.15.82:0/2654699358 wait complete. 2023-09-23T08:56:44.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.445+0000 7fdceb979b80 1 -- start start 2023-09-23T08:56:44.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.445+0000 7fdcd5d9b700 1 --2- 172.21.15.82:0/1211625279 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fdcbc09ff50 0x7fdcbc0a2410 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fdccc000c00 tx=0x7fdccc005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:44.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.445+0000 7fdceb979b80 1 Processor -- start 2023-09-23T08:56:44.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.445+0000 7fdceb979b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575c30ccde0 0x5575c30d68f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:44.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.445+0000 7fdceb979b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575c30cd740 0x5575c30d6e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:44.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.445+0000 7fdceb979b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575c30ce160 0x5575c30dde70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:44.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.445+0000 7fdceb979b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575c301a990 con 0x5575c30cd740 2023-09-23T08:56:44.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.445+0000 7fdceb979b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575c2fb8bb0 con 0x5575c30ce160 2023-09-23T08:56:44.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.445+0000 7fdceb979b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575c2fb88b0 con 0x5575c30ccde0 2023-09-23T08:56:44.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.446+0000 7fdceb979b80 10 client.0 _ll_register_callbacks cb 0x5575c2f02a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T08:56:44.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.446+0000 7fdcd559a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575c30cd740 0x5575c30d6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:44.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.446+0000 7fdcd559a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575c30cd740 0x5575c30d6e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37020/0 (socket says 172.21.15.82:37020) 2023-09-23T08:56:44.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.446+0000 7fdcd559a700 1 -- 172.21.15.82:0/2574630884 learned_addr learned my addr 172.21.15.82:0/2574630884 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:44.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.446+0000 7fdcd5d9b700 1 --2- 172.21.15.82:0/2574630884 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575c30ccde0 0x5575c30d68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:44.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.446+0000 7fdcd559a700 1 -- 172.21.15.82:0/2574630884 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575c30ccde0 msgr2=0x5575c30d68f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:56:44.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.446+0000 7fdcd559a700 1 --2- 172.21.15.82:0/2574630884 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575c30ccde0 0x5575c30d68f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:44.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.446+0000 7fdcd559a700 1 -- 172.21.15.82:0/2574630884 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575c30ce160 msgr2=0x5575c30dde70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:56:44.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.446+0000 7fdcd559a700 1 --2- 172.21.15.82:0/2574630884 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575c30ce160 0x5575c30dde70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:44.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.446+0000 7fdcd559a700 1 -- 172.21.15.82:0/2574630884 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcc8003c50 con 0x5575c30cd740 2023-09-23T08:56:44.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.446+0000 7fdcd559a700 1 --2- 172.21.15.82:0/2574630884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575c30cd740 0x5575c30d6e30 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fdcc0010880 tx=0x7fdcc00986f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7119b80bda9f13ba server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:44.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.446+0000 7fdcb97fa700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T08:56:44.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.447+0000 7fdcb97fa700 1 -- 172.21.15.82:0/2574630884 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc00cd2d0 con 0x5575c30cd740 2023-09-23T08:56:44.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.447+0000 7fdcb97fa700 1 -- 172.21.15.82:0/2574630884 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fdcc0098ab0 con 0x5575c30cd740 2023-09-23T08:56:44.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.447+0000 7fdceb979b80 1 -- 172.21.15.82:0/2574630884 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5575c30981c0 con 0x5575c30cd740 2023-09-23T08:56:44.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.447+0000 7fdcb97fa700 1 -- 172.21.15.82:0/2574630884 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdcc009c8e0 con 0x5575c30cd740 2023-09-23T08:56:44.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.447+0000 7fdceb979b80 10 client.15519 fetch_fsmap learned FSMap version 26 2023-09-23T08:56:44.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.447+0000 7fdceb979b80 1 -- 172.21.15.82:0/2574630884 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5575c2e46de0 con 0x5575c30cd740 2023-09-23T08:56:44.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.447+0000 7fdcb97fa700 1 -- 172.21.15.82:0/2574630884 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdcc00b4080 con 0x5575c30cd740 2023-09-23T08:56:44.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.447+0000 7fdcb97fa700 1 -- 172.21.15.82:0/2574630884 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fdcc00a0430 con 0x5575c30cd740 2023-09-23T08:56:44.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.447+0000 7fdceb979b80 10 client.15519 fetch_fsmap finished waiting for FSMap version 26 2023-09-23T08:56:44.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.447+0000 7fdceb979b80 10 client.15519 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T08:56:44.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.447+0000 7fdceb979b80 20 client.15519 populate_metadata read hostname 'smithi082' 2023-09-23T08:56:44.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.447+0000 7fdceb979b80 1 --2- 172.21.15.82:0/2574630884 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5575c30e26b0 0x5575c30e4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:44.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.447+0000 7fdceb979b80 4 client.15519 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T08:56:44.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.447+0000 7fdceb979b80 1 -- 172.21.15.82:0/2574630884 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5575c2fc0ba0 con 0x5575c30e26b0 2023-09-23T08:56:44.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.448+0000 7fdcd5d9b700 1 --2- 172.21.15.82:0/2574630884 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5575c30e26b0 0x5575c30e4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:44.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.448+0000 7fdcb97fa700 10 client.15519 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T08:56:44.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.448+0000 7fdcd5d9b700 1 --2- 172.21.15.82:0/2574630884 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5575c30e26b0 0x5575c30e4ad0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb063ce340f8d14b server_cookie=742583c4454763af in_seq=0 out_seq=0 2023-09-23T08:56:44.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.449+0000 7fdcb97fa700 1 -- 172.21.15.82:0/2574630884 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5575c2fc0ba0 con 0x5575c30e26b0 2023-09-23T08:56:44.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.449+0000 7fdcb97fa700 10 client.15519 handle_command_reply: tid=0 2023-09-23T08:56:44.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.449+0000 7fdceb979b80 1 client.15519 shutdown 2023-09-23T08:56:44.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.449+0000 7fdceb979b80 1 -- 172.21.15.82:0/2574630884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575c30cd740 msgr2=0x5575c30d6e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:44.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.449+0000 7fdceb979b80 1 --2- 172.21.15.82:0/2574630884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575c30cd740 0x5575c30d6e30 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fdcc0010880 tx=0x7fdcc00986f0 comp rx=0 tx=0).stop 2023-09-23T08:56:44.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.449+0000 7fdceb979b80 1 -- 172.21.15.82:0/2574630884 shutdown_connections 2023-09-23T08:56:44.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.449+0000 7fdceb979b80 1 --2- 172.21.15.82:0/2574630884 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575c30ce160 0x5575c30dde70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:44.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.449+0000 7fdceb979b80 1 --2- 172.21.15.82:0/2574630884 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575c30ccde0 0x5575c30d68f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:44.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.449+0000 7fdceb979b80 1 --2- 172.21.15.82:0/2574630884 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5575c30e26b0 0x5575c30e4ad0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:44.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.449+0000 7fdceb979b80 1 --2- 172.21.15.82:0/2574630884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575c30cd740 0x5575c30d6e30 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:44.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.449+0000 7fdcb97fa700 0 client.15519 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T08:56:44.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.449+0000 7fdceb979b80 1 -- 172.21.15.82:0/2574630884 >> 172.21.15.82:0/2574630884 conn(0x5575c303d0e0 msgr2=0x5575c30bdb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:44.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.449+0000 7fdceb979b80 1 -- 172.21.15.82:0/2574630884 shutdown_connections 2023-09-23T08:56:44.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.450+0000 7fdceb979b80 1 -- 172.21.15.82:0/2574630884 wait complete. 2023-09-23T08:56:44.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.450+0000 7fdceb979b80 20 client.15519 trim_cache size 0 max 16384 2023-09-23T08:56:44.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.454+0000 7f9415fff700 1 -- 172.21.15.82:0/3200397608 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f9410112640 con 0x7f9410073380 2023-09-23T08:56:44.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.469+0000 7fdceb979b80 1 Processor -- start 2023-09-23T08:56:44.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.469+0000 7fdceb979b80 1 -- start start 2023-09-23T08:56:44.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.469+0000 7fdceb979b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575c30ccde0 0x5575c30c31a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:44.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.469+0000 7fdceb979b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575c30cd740 0x5575c30dde30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:44.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.469+0000 7fdceb979b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575c30ce160 0x5575c30d4680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:44.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.469+0000 7fdceb979b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575c2e9c920 con 0x5575c30cd740 2023-09-23T08:56:44.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.469+0000 7fdceb979b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575c30bf810 con 0x5575c30ccde0 2023-09-23T08:56:44.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.469+0000 7fdceb979b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575c30d5de0 con 0x5575c30ce160 2023-09-23T08:56:44.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.469+0000 7fdcd559a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575c30cd740 0x5575c30dde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:44.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.469+0000 7fdcd559a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575c30cd740 0x5575c30dde30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37034/0 (socket says 172.21.15.82:37034) 2023-09-23T08:56:44.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.469+0000 7fdcd559a700 1 -- 172.21.15.82:0/128051683 learned_addr learned my addr 172.21.15.82:0/128051683 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:44.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.469+0000 7fdcd659c700 1 --2- 172.21.15.82:0/128051683 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575c30ce160 0x5575c30d4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:44.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.470+0000 7fdcd5d9b700 1 --2- 172.21.15.82:0/128051683 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575c30ccde0 0x5575c30c31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:44.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.470+0000 7fdcd559a700 1 -- 172.21.15.82:0/128051683 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575c30ce160 msgr2=0x5575c30d4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:56:44.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.470+0000 7fdcd559a700 1 --2- 172.21.15.82:0/128051683 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575c30ce160 0x5575c30d4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:44.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.470+0000 7fdcd559a700 1 -- 172.21.15.82:0/128051683 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575c30ccde0 msgr2=0x5575c30c31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:56:44.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.470+0000 7fdcd559a700 1 --2- 172.21.15.82:0/128051683 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575c30ccde0 0x5575c30c31a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:44.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.470+0000 7fdcd559a700 1 -- 172.21.15.82:0/128051683 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5575c2e2fc60 con 0x5575c30cd740 2023-09-23T08:56:44.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.470+0000 7fdcd5d9b700 1 --2- 172.21.15.82:0/128051683 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575c30ccde0 0x5575c30c31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T08:56:44.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.470+0000 7fdcd559a700 1 --2- 172.21.15.82:0/128051683 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575c30cd740 0x5575c30dde30 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fdcc0095520 tx=0x7fdcc0097060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81eed31845109dc2 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:44.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.470+0000 7fdcc4ff9700 1 -- 172.21.15.82:0/128051683 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc0098ab0 con 0x5575c30cd740 2023-09-23T08:56:44.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.470+0000 7fdcc4ff9700 1 -- 172.21.15.82:0/128051683 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5575c30981c0 con 0x5575c30cd740 2023-09-23T08:56:44.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.470+0000 7fdcc4ff9700 1 -- 172.21.15.82:0/128051683 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc0097bf0 con 0x5575c30cd740 2023-09-23T08:56:44.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.471+0000 7fdceb979b80 1 -- 172.21.15.82:0/128051683 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575c30cd740 msgr2=0x5575c30dde30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:44.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.471+0000 7fdceb979b80 1 --2- 172.21.15.82:0/128051683 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575c30cd740 0x5575c30dde30 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fdcc0095520 tx=0x7fdcc0097060 comp rx=0 tx=0).stop 2023-09-23T08:56:44.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.471+0000 7fdceb979b80 1 -- 172.21.15.82:0/128051683 shutdown_connections 2023-09-23T08:56:44.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.471+0000 7fdceb979b80 1 --2- 172.21.15.82:0/128051683 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575c30ce160 0x5575c30d4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:44.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.471+0000 7fdceb979b80 1 --2- 172.21.15.82:0/128051683 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575c30ccde0 0x5575c30c31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:44.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.471+0000 7fdceb979b80 1 --2- 172.21.15.82:0/128051683 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575c30cd740 0x5575c30dde30 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:44.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.471+0000 7fdceb979b80 1 -- 172.21.15.82:0/128051683 >> 172.21.15.82:0/128051683 conn(0x5575c303d0e0 msgr2=0x5575c30bcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:44.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.471+0000 7fdceb979b80 1 -- 172.21.15.82:0/128051683 shutdown_connections 2023-09-23T08:56:44.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.471+0000 7fdceb979b80 1 -- 172.21.15.82:0/128051683 wait complete. 2023-09-23T08:56:44.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.471+0000 7fdceb979b80 1 -- start start 2023-09-23T08:56:44.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.472+0000 7fdceb979b80 1 Processor -- start 2023-09-23T08:56:44.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.472+0000 7fdceb979b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575c30ccde0 0x5575c30db7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:44.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.472+0000 7fdceb979b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575c30cd740 0x5575c30dbd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:44.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.472+0000 7fdceb979b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575c30ce160 0x5575c30dccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:44.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.472+0000 7fdceb979b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575c30dd230 con 0x5575c30cd740 2023-09-23T08:56:44.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.472+0000 7fdceb979b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575c30dd3a0 con 0x5575c30ccde0 2023-09-23T08:56:44.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.472+0000 7fdceb979b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575c30dd560 con 0x5575c30ce160 2023-09-23T08:56:44.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.472+0000 7fdceb979b80 10 client.0 _ll_register_callbacks cb 0x7fdcc0094e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T08:56:44.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.472+0000 7fdcd559a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575c30cd740 0x5575c30dbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:44.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.472+0000 7fdcd559a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575c30cd740 0x5575c30dbd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37040/0 (socket says 172.21.15.82:37040) 2023-09-23T08:56:44.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.472+0000 7fdcd559a700 1 -- 172.21.15.82:0/2985825542 learned_addr learned my addr 172.21.15.82:0/2985825542 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:44.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.473+0000 7fdcd5d9b700 1 --2- 172.21.15.82:0/2985825542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575c30ccde0 0x5575c30db7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:44.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.473+0000 7fdcd659c700 1 --2- 172.21.15.82:0/2985825542 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575c30ce160 0x5575c30dccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:44.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.473+0000 7fdcd559a700 1 -- 172.21.15.82:0/2985825542 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575c30ce160 msgr2=0x5575c30dccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:56:44.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.473+0000 7fdcd559a700 1 --2- 172.21.15.82:0/2985825542 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575c30ce160 0x5575c30dccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:44.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.473+0000 7fdcd559a700 1 -- 172.21.15.82:0/2985825542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575c30ccde0 msgr2=0x5575c30db7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:56:44.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.473+0000 7fdcd559a700 1 --2- 172.21.15.82:0/2985825542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575c30ccde0 0x5575c30db7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:44.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.473+0000 7fdcd559a700 1 -- 172.21.15.82:0/2985825542 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5575c2e46de0 con 0x5575c30cd740 2023-09-23T08:56:44.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.473+0000 7fdcd5d9b700 1 --2- 172.21.15.82:0/2985825542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575c30ccde0 0x5575c30db7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T08:56:44.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.473+0000 7fdcd559a700 1 --2- 172.21.15.82:0/2985825542 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575c30cd740 0x5575c30dbd10 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fdcc00983a0 tx=0x7fdcc000b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3728bea7cb93d23 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:44.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.473+0000 7fdcb97fa700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T08:56:44.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.473+0000 7fdcb97fa700 1 -- 172.21.15.82:0/2985825542 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc0097e00 con 0x5575c30cd740 2023-09-23T08:56:44.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.473+0000 7fdceb979b80 1 -- 172.21.15.82:0/2985825542 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5575c30bb8b0 con 0x5575c30cd740 2023-09-23T08:56:44.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.473+0000 7fdcb97fa700 1 -- 172.21.15.82:0/2985825542 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fdcc0098ab0 con 0x5575c30cd740 2023-09-23T08:56:44.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.473+0000 7fdcb97fa700 1 -- 172.21.15.82:0/2985825542 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdcc0097a10 con 0x5575c30cd740 2023-09-23T08:56:44.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.473+0000 7fdceb979b80 10 client.15525 fetch_fsmap learned FSMap version 26 2023-09-23T08:56:44.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.473+0000 7fdceb979b80 1 -- 172.21.15.82:0/2985825542 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5575c2e6d250 con 0x5575c30cd740 2023-09-23T08:56:44.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.474+0000 7fdcb97fa700 1 -- 172.21.15.82:0/2985825542 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdcc007b080 con 0x5575c30cd740 2023-09-23T08:56:44.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.474+0000 7fdcb97fa700 1 -- 172.21.15.82:0/2985825542 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fdcc0009aa0 con 0x5575c30cd740 2023-09-23T08:56:44.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.474+0000 7fdceb979b80 10 client.15525 fetch_fsmap finished waiting for FSMap version 26 2023-09-23T08:56:44.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.474+0000 7fdceb979b80 10 client.15525 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T08:56:44.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.474+0000 7fdceb979b80 20 client.15525 populate_metadata read hostname 'smithi082' 2023-09-23T08:56:44.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.474+0000 7fdceb979b80 1 --2- 172.21.15.82:0/2985825542 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5575c3136ba0 0x5575c3138fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:44.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.474+0000 7fdceb979b80 4 client.15525 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T08:56:44.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.474+0000 7fdceb979b80 1 -- 172.21.15.82:0/2985825542 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5575c3013970 con 0x5575c3136ba0 2023-09-23T08:56:44.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.474+0000 7fdcd5d9b700 1 --2- 172.21.15.82:0/2985825542 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5575c3136ba0 0x5575c3138fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:44.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.475+0000 7fdcb97fa700 10 client.15525 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T08:56:44.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.475+0000 7fdcd5d9b700 1 --2- 172.21.15.82:0/2985825542 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5575c3136ba0 0x5575c3138fc0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=78a7deeb479ab695 server_cookie=1f3836ef4a5cd168 in_seq=0 out_seq=0 2023-09-23T08:56:44.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.475+0000 7fdcb97fa700 1 -- 172.21.15.82:0/2985825542 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5575c3013970 con 0x5575c3136ba0 2023-09-23T08:56:44.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.475+0000 7fdcb97fa700 10 client.15525 handle_command_reply: tid=0 2023-09-23T08:56:44.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.475+0000 7fdceb979b80 1 client.15525 shutdown 2023-09-23T08:56:44.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.475+0000 7fdceb979b80 1 -- 172.21.15.82:0/2985825542 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575c30cd740 msgr2=0x5575c30dbd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:44.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.475+0000 7fdceb979b80 1 --2- 172.21.15.82:0/2985825542 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575c30cd740 0x5575c30dbd10 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fdcc00983a0 tx=0x7fdcc000b5b0 comp rx=0 tx=0).stop 2023-09-23T08:56:44.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.475+0000 7fdceb979b80 1 -- 172.21.15.82:0/2985825542 shutdown_connections 2023-09-23T08:56:44.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.475+0000 7fdceb979b80 1 --2- 172.21.15.82:0/2985825542 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575c30ce160 0x5575c30dccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:44.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.475+0000 7fdceb979b80 1 --2- 172.21.15.82:0/2985825542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575c30ccde0 0x5575c30db7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:44.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.475+0000 7fdceb979b80 1 --2- 172.21.15.82:0/2985825542 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5575c3136ba0 0x5575c3138fc0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:44.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.475+0000 7fdceb979b80 1 --2- 172.21.15.82:0/2985825542 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575c30cd740 0x5575c30dbd10 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:44.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.476+0000 7fdcb97fa700 0 client.15525 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T08:56:44.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.476+0000 7fdceb979b80 1 -- 172.21.15.82:0/2985825542 >> 172.21.15.82:0/2985825542 conn(0x5575c303d0e0 msgr2=0x5575c30d4680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:44.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.476+0000 7fdceb979b80 1 -- 172.21.15.82:0/2985825542 shutdown_connections 2023-09-23T08:56:44.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.476+0000 7fdceb979b80 1 -- 172.21.15.82:0/2985825542 wait complete. 2023-09-23T08:56:44.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.476+0000 7fdceb979b80 20 client.15525 trim_cache size 0 max 16384 2023-09-23T08:56:44.484 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T08:56:44.484 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "IDLE (waiting for more scrubs)", 2023-09-23T08:56:44.484 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T08:56:44.484 INFO:teuthology.orchestra.run.smithi082.stdout: "bc317b63-fc76-43e1-9c32-1e8d4be07baa": { 2023-09-23T08:56:44.485 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T08:56:44.485 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "bc317b63-fc76-43e1-9c32-1e8d4be07baa", 2023-09-23T08:56:44.485 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T08:56:44.485 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T08:56:44.485 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T08:56:44.485 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T08:56:44.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.476+0000 7fdcd7fff700 1 -- 172.21.15.82:0/1211625279 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fdcbc09ff50 msgr2=0x7fdcbc0a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:44.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.476+0000 7fdcd7fff700 1 --2- 172.21.15.82:0/1211625279 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fdcbc09ff50 0x7fdcbc0a2410 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fdccc000c00 tx=0x7fdccc005fb0 comp rx=0 tx=0).stop 2023-09-23T08:56:44.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.476+0000 7fdcd7fff700 1 -- 172.21.15.82:0/1211625279 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdcd0101b20 msgr2=0x7fdcd0196ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:44.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.476+0000 7fdcd7fff700 1 --2- 172.21.15.82:0/1211625279 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdcd0101b20 0x7fdcd0196ab0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fdcc000d950 tx=0x7fdcc000dc60 comp rx=0 tx=0).stop 2023-09-23T08:56:44.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.476+0000 7fdcd7fff700 1 -- 172.21.15.82:0/1211625279 shutdown_connections 2023-09-23T08:56:44.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.476+0000 7fdcd7fff700 1 --2- 172.21.15.82:0/1211625279 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fdcbc09ff50 0x7fdcbc0a2410 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:44.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.476+0000 7fdcd7fff700 1 --2- 172.21.15.82:0/1211625279 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdcd01024c0 0x7fdcd019db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:44.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.476+0000 7fdcd7fff700 1 --2- 172.21.15.82:0/1211625279 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdcd0100930 0x7fdcd0196570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:44.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.476+0000 7fdcd7fff700 1 --2- 172.21.15.82:0/1211625279 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdcd0101b20 0x7fdcd0196ab0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:44.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.476+0000 7fdcd7fff700 1 -- 172.21.15.82:0/1211625279 >> 172.21.15.82:0/1211625279 conn(0x7fdcd00fbea0 msgr2=0x7fdcd00fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:44.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.477+0000 7fdcd7fff700 1 -- 172.21.15.82:0/1211625279 shutdown_connections 2023-09-23T08:56:44.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.477+0000 7fdcd7fff700 1 -- 172.21.15.82:0/1211625279 wait complete. 2023-09-23T08:56:44.494 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:44 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/2345225658' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T08:56:44.494 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:44 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/961417880' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-23T08:56:44.496 INFO:tasks.cephfs.filesystem:scrub status for tag:bc317b63-fc76-43e1-9c32-1e8d4be07baa - {'path': '/', 'tag': 'bc317b63-fc76-43e1-9c32-1e8d4be07baa', 'options': 'recursive,force'} 2023-09-23T08:56:44.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.520+0000 7f940cff9700 1 -- 172.21.15.82:0/3200397608 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 19) v1 ==== 134688+0+0 (secure 0 0 0) 0x7f9400096a60 con 0x7f9410073380 2023-09-23T08:56:44.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.521+0000 7f940cff9700 1 -- 172.21.15.82:0/3200397608 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v19) v1 ==== 92+0+0 (secure 0 0 0) 0x7f94000779b0 con 0x7f9410073380 2023-09-23T08:56:44.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.523+0000 7f9415fff700 1 -- 172.21.15.82:0/3200397608 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f93f809ff50 msgr2=0x7f93f80a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:44.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.523+0000 7f9415fff700 1 --2- 172.21.15.82:0/3200397608 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f93f809ff50 0x7f93f80a2410 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f9410074680 tx=0x7f9404009260 comp rx=0 tx=0).stop 2023-09-23T08:56:44.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.523+0000 7f9415fff700 1 -- 172.21.15.82:0/3200397608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9410073380 msgr2=0x7f941019cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:44.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.523+0000 7f9415fff700 1 --2- 172.21.15.82:0/3200397608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9410073380 0x7f941019cd20 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f9400005910 tx=0x7f94000057d0 comp rx=0 tx=0).stop 2023-09-23T08:56:44.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.524+0000 7f9415fff700 1 -- 172.21.15.82:0/3200397608 shutdown_connections 2023-09-23T08:56:44.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.524+0000 7f9415fff700 1 --2- 172.21.15.82:0/3200397608 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f93f809ff50 0x7f93f80a2410 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:44.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.524+0000 7f9415fff700 1 --2- 172.21.15.82:0/3200397608 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f941010cf20 0x7f941019dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:44.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.524+0000 7f9415fff700 1 --2- 172.21.15.82:0/3200397608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9410073380 0x7f941019cd20 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:44.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.524+0000 7f9415fff700 1 --2- 172.21.15.82:0/3200397608 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9410074960 0x7f941019d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:44.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.524+0000 7f9415fff700 1 -- 172.21.15.82:0/3200397608 >> 172.21.15.82:0/3200397608 conn(0x7f94100fbea0 msgr2=0x7f94100fe290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:44.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.524+0000 7f9415fff700 1 -- 172.21.15.82:0/3200397608 shutdown_connections 2023-09-23T08:56:44.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.524+0000 7f9415fff700 1 -- 172.21.15.82:0/3200397608 wait complete. 2023-09-23T08:56:44.545 DEBUG:teuthology.orchestra.run.smithi082:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/allow_m_granularity true' 2023-09-23T08:56:44.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.786+0000 7f193c1ff700 1 -- 172.21.15.82:0/480205939 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1934074960 msgr2=0x7f1934072db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:44.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.786+0000 7f193c1ff700 1 --2- 172.21.15.82:0/480205939 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1934074960 0x7f1934072db0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f1930009990 tx=0x7f1930009ca0 comp rx=0 tx=0).stop 2023-09-23T08:56:44.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.786+0000 7f193c1ff700 1 -- 172.21.15.82:0/480205939 shutdown_connections 2023-09-23T08:56:44.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.786+0000 7f193c1ff700 1 --2- 172.21.15.82:0/480205939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f193410cf20 0x7f193410f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:44.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.786+0000 7f193c1ff700 1 --2- 172.21.15.82:0/480205939 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1934074960 0x7f1934072db0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:44.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.786+0000 7f193c1ff700 1 --2- 172.21.15.82:0/480205939 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1934073380 0x7f1934073800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:44.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.786+0000 7f193c1ff700 1 -- 172.21.15.82:0/480205939 >> 172.21.15.82:0/480205939 conn(0x7f19340fbea0 msgr2=0x7f19340fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:44.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.787+0000 7f193c1ff700 1 -- 172.21.15.82:0/480205939 shutdown_connections 2023-09-23T08:56:44.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.787+0000 7f193c1ff700 1 -- 172.21.15.82:0/480205939 wait complete. 2023-09-23T08:56:44.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.788+0000 7f193c1ff700 1 Processor -- start 2023-09-23T08:56:44.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.788+0000 7f193c1ff700 1 -- start start 2023-09-23T08:56:44.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.788+0000 7f193c1ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1934073380 0x7f193419cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:44.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.788+0000 7f193c1ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1934074960 0x7f193419d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:44.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.788+0000 7f193c1ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f193410cf20 0x7f193419dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:44.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.788+0000 7f193c1ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f193419e650 con 0x7f193410cf20 2023-09-23T08:56:44.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.788+0000 7f193c1ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f193419e7c0 con 0x7f1934073380 2023-09-23T08:56:44.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.788+0000 7f193c1ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f193419e980 con 0x7f1934074960 2023-09-23T08:56:44.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.788+0000 7f193a79c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f193410cf20 0x7f193419dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:44.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.788+0000 7f193a79c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f193410cf20 0x7f193419dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37096/0 (socket says 172.21.15.82:37096) 2023-09-23T08:56:44.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.788+0000 7f193a79c700 1 -- 172.21.15.82:0/3703188540 learned_addr learned my addr 172.21.15.82:0/3703188540 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:44.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.788+0000 7f1939f9b700 1 --2- 172.21.15.82:0/3703188540 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1934073380 0x7f193419cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:44.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.788+0000 7f193979a700 1 --2- 172.21.15.82:0/3703188540 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1934074960 0x7f193419d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:44.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.789+0000 7f193a79c700 1 -- 172.21.15.82:0/3703188540 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1934074960 msgr2=0x7f193419d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:44.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.789+0000 7f193a79c700 1 --2- 172.21.15.82:0/3703188540 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1934074960 0x7f193419d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:44.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.789+0000 7f193a79c700 1 -- 172.21.15.82:0/3703188540 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1934073380 msgr2=0x7f193419cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:44.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.789+0000 7f193a79c700 1 --2- 172.21.15.82:0/3703188540 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1934073380 0x7f193419cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:44.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.789+0000 7f193a79c700 1 -- 172.21.15.82:0/3703188540 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19300095f0 con 0x7f193410cf20 2023-09-23T08:56:44.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.789+0000 7f193a79c700 1 --2- 172.21.15.82:0/3703188540 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f193410cf20 0x7f193419dff0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f192c00ef30 tx=0x7f192c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:44.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.789+0000 7f192affd700 1 -- 172.21.15.82:0/3703188540 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192c018070 con 0x7f193410cf20 2023-09-23T08:56:44.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.789+0000 7f193c1ff700 1 -- 172.21.15.82:0/3703188540 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f193419ec00 con 0x7f193410cf20 2023-09-23T08:56:44.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.789+0000 7f192affd700 1 -- 172.21.15.82:0/3703188540 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f192c00f040 con 0x7f193410cf20 2023-09-23T08:56:44.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.789+0000 7f192affd700 1 -- 172.21.15.82:0/3703188540 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192c00cbc0 con 0x7f193410cf20 2023-09-23T08:56:44.795 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:44 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/2345225658' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T08:56:44.795 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:44 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/961417880' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-23T08:56:44.795 INFO:journalctl@ceph.mgr.z.smithi161.stdout:Sep 23 08:56:44 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-z[101707]: ignoring --setuser ceph since I am not root 2023-09-23T08:56:44.795 INFO:journalctl@ceph.mgr.z.smithi161.stdout:Sep 23 08:56:44 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-z[101707]: ignoring --setgroup ceph since I am not root 2023-09-23T08:56:44.795 INFO:journalctl@ceph.mgr.z.smithi161.stdout:Sep 23 08:56:44 smithi161 ceph-mgr[101732]: -- 172.21.15.161:0/557462298 <== mon.2 v2:172.21.15.135:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55b6cf9851e0 con 0x55b6cf95a800 2023-09-23T08:56:44.795 INFO:journalctl@ceph.mgr.z.smithi161.stdout:Sep 23 08:56:44 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-z[101707]: 2023-09-23T08:56:44.790+0000 7fd5f5f9f200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-09-23T08:56:44.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.789+0000 7f193c1ff700 1 -- 172.21.15.82:0/3703188540 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19341a5420 con 0x7f193410cf20 2023-09-23T08:56:44.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.791+0000 7f193c1ff700 1 -- 172.21.15.82:0/3703188540 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1934102a70 con 0x7f193410cf20 2023-09-23T08:56:44.796 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:56:44 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: ignoring --setuser ceph since I am not root 2023-09-23T08:56:44.796 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:56:44 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: ignoring --setgroup ceph since I am not root 2023-09-23T08:56:44.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.793+0000 7f192affd700 1 -- 172.21.15.82:0/3703188540 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) v1 ==== 134688+0+0 (secure 0 0 0) 0x7f192c007500 con 0x7f193410cf20 2023-09-23T08:56:44.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.794+0000 7f192affd700 1 --2- 172.21.15.82:0/3703188540 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f192009ffa0 0x7f19200a2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:44.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.794+0000 7f1939f9b700 1 -- 172.21.15.82:0/3703188540 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f192009ffa0 msgr2=0x7f19200a2460 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/3698954311 2023-09-23T08:56:44.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.794+0000 7f192affd700 1 -- 172.21.15.82:0/3703188540 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f192c0cad80 con 0x7f193410cf20 2023-09-23T08:56:44.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.794+0000 7f1939f9b700 1 --2- 172.21.15.82:0/3703188540 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f192009ffa0 0x7f19200a2460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-09-23T08:56:44.798 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:44 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/2345225658' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T08:56:44.798 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:44 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/961417880' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-23T08:56:44.798 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Sep 23 08:56:44 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-y[100663]: ignoring --setuser ceph since I am not root 2023-09-23T08:56:44.798 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Sep 23 08:56:44 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-y[100663]: ignoring --setgroup ceph since I am not root 2023-09-23T08:56:44.799 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Sep 23 08:56:44 smithi135 ceph-mgr[100687]: -- 172.21.15.135:0/523565089 <== mon.2 v2:172.21.15.135:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5613817f91e0 con 0x5613817cec00 2023-09-23T08:56:44.799 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Sep 23 08:56:44 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-y[100663]: 2023-09-23T08:56:44.793+0000 7f54a27e7200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-09-23T08:56:44.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.799+0000 7f192affd700 1 -- 172.21.15.82:0/3703188540 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f192c094bb0 con 0x7f193410cf20 2023-09-23T08:56:44.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.995+0000 7f1939f9b700 1 -- 172.21.15.82:0/3703188540 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f192009ffa0 msgr2=0x7f19200a2460 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/3698954311 2023-09-23T08:56:44.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:44.995+0000 7f1939f9b700 1 --2- 172.21.15.82:0/3703188540 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f192009ffa0 0x7f19200a2460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-09-23T08:56:45.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.006+0000 7f193c1ff700 1 -- 172.21.15.82:0/3703188540 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f193404e700 con 0x7f193410cf20 2023-09-23T08:56:45.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.012+0000 7f192affd700 1 -- 172.21.15.82:0/3703188540 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v23)=0 v23) v1 ==== 138+0+0 (secure 0 0 0) 0x7f192c0981d0 con 0x7f193410cf20 2023-09-23T08:56:45.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.014+0000 7f193c1ff700 1 -- 172.21.15.82:0/3703188540 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f192009ffa0 msgr2=0x7f19200a2460 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-23T08:56:45.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.014+0000 7f193c1ff700 1 --2- 172.21.15.82:0/3703188540 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f192009ffa0 0x7f19200a2460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:45.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.014+0000 7f193c1ff700 1 -- 172.21.15.82:0/3703188540 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f193410cf20 msgr2=0x7f193419dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:45.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.014+0000 7f193c1ff700 1 --2- 172.21.15.82:0/3703188540 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f193410cf20 0x7f193419dff0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f192c00ef30 tx=0x7f192c00c3a0 comp rx=0 tx=0).stop 2023-09-23T08:56:45.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.014+0000 7f193c1ff700 1 -- 172.21.15.82:0/3703188540 shutdown_connections 2023-09-23T08:56:45.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.014+0000 7f193c1ff700 1 --2- 172.21.15.82:0/3703188540 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f192009ffa0 0x7f19200a2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:45.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.014+0000 7f193c1ff700 1 --2- 172.21.15.82:0/3703188540 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f193410cf20 0x7f193419dff0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:45.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.014+0000 7f193c1ff700 1 --2- 172.21.15.82:0/3703188540 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1934073380 0x7f193419cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:45.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.014+0000 7f193c1ff700 1 --2- 172.21.15.82:0/3703188540 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1934074960 0x7f193419d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:45.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.014+0000 7f193c1ff700 1 -- 172.21.15.82:0/3703188540 >> 172.21.15.82:0/3703188540 conn(0x7f19340fbea0 msgr2=0x7f19340fe290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:45.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.014+0000 7f193c1ff700 1 -- 172.21.15.82:0/3703188540 shutdown_connections 2023-09-23T08:56:45.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.014+0000 7f193c1ff700 1 -- 172.21.15.82:0/3703188540 wait complete. 2023-09-23T08:56:45.036 DEBUG:teuthology.orchestra.run.smithi082:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/dump_on_update true' 2023-09-23T08:56:45.062 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Sep 23 08:56:44 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-y[100663]: 2023-09-23T08:56:44.897+0000 7f54a27e7200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-09-23T08:56:45.062 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Sep 23 08:56:45 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-y[100663]: 2023-09-23T08:56:45.010+0000 7f54a27e7200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-09-23T08:56:45.095 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:56:44 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:56:44.792+0000 7f493940f200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-09-23T08:56:45.095 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:56:44 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:56:44.901+0000 7f493940f200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-09-23T08:56:45.096 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:56:45 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:56:45.019+0000 7f493940f200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-09-23T08:56:45.134 INFO:journalctl@ceph.mgr.z.smithi161.stdout:Sep 23 08:56:44 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-z[101707]: 2023-09-23T08:56:44.896+0000 7fd5f5f9f200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-09-23T08:56:45.135 INFO:journalctl@ceph.mgr.z.smithi161.stdout:Sep 23 08:56:45 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-z[101707]: 2023-09-23T08:56:45.009+0000 7fd5f5f9f200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-09-23T08:56:45.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.234+0000 7f426a5ff700 1 -- 172.21.15.82:0/2639898056 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4264100950 msgr2=0x7f4264100d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:45.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.234+0000 7f426a5ff700 1 --2- 172.21.15.82:0/2639898056 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4264100950 0x7f4264100d70 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f42540099c0 tx=0x7f4254009cd0 comp rx=0 tx=0).stop 2023-09-23T08:56:45.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.234+0000 7f426a5ff700 1 -- 172.21.15.82:0/2639898056 shutdown_connections 2023-09-23T08:56:45.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.234+0000 7f426a5ff700 1 --2- 172.21.15.82:0/2639898056 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42641024e0 0x7f4264108d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:45.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.234+0000 7f426a5ff700 1 --2- 172.21.15.82:0/2639898056 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4264100950 0x7f4264100d70 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:45.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.234+0000 7f426a5ff700 1 --2- 172.21.15.82:0/2639898056 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4264101b40 0x7f4264101fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:45.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.234+0000 7f426a5ff700 1 -- 172.21.15.82:0/2639898056 >> 172.21.15.82:0/2639898056 conn(0x7f42640fbea0 msgr2=0x7f42640fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:45.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.234+0000 7f426a5ff700 1 -- 172.21.15.82:0/2639898056 shutdown_connections 2023-09-23T08:56:45.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.234+0000 7f426a5ff700 1 -- 172.21.15.82:0/2639898056 wait complete. 2023-09-23T08:56:45.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.235+0000 7f426a5ff700 1 Processor -- start 2023-09-23T08:56:45.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.235+0000 7f426a5ff700 1 -- start start 2023-09-23T08:56:45.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.235+0000 7f426a5ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4264100950 0x7f4264198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:45.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.236+0000 7f426a5ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4264101b40 0x7f4264198db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:45.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.236+0000 7f426a5ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f42641024e0 0x7f4264199c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:45.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.236+0000 7f426a5ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f426419a290 con 0x7f4264100950 2023-09-23T08:56:45.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.236+0000 7f426a5ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f426419a400 con 0x7f4264101b40 2023-09-23T08:56:45.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.236+0000 7f426a5ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f426419a5c0 con 0x7f42641024e0 2023-09-23T08:56:45.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.236+0000 7f4263fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4264100950 0x7f4264198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:45.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.236+0000 7f4263fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4264100950 0x7f4264198870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37120/0 (socket says 172.21.15.82:37120) 2023-09-23T08:56:45.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.236+0000 7f4263fff700 1 -- 172.21.15.82:0/3982000175 learned_addr learned my addr 172.21.15.82:0/3982000175 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:45.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.236+0000 7f4268b9c700 1 --2- 172.21.15.82:0/3982000175 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f42641024e0 0x7f4264199c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:45.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.236+0000 7f42637fe700 1 --2- 172.21.15.82:0/3982000175 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4264101b40 0x7f4264198db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:45.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.236+0000 7f4263fff700 1 -- 172.21.15.82:0/3982000175 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f42641024e0 msgr2=0x7f4264199c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:45.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.236+0000 7f4263fff700 1 --2- 172.21.15.82:0/3982000175 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f42641024e0 0x7f4264199c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:45.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.236+0000 7f4263fff700 1 -- 172.21.15.82:0/3982000175 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4264101b40 msgr2=0x7f4264198db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:45.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.236+0000 7f4263fff700 1 --2- 172.21.15.82:0/3982000175 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4264101b40 0x7f4264198db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:45.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.236+0000 7f4263fff700 1 -- 172.21.15.82:0/3982000175 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42540095f0 con 0x7f4264100950 2023-09-23T08:56:45.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.237+0000 7f4263fff700 1 --2- 172.21.15.82:0/3982000175 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4264100950 0x7f4264198870 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f4254000c00 tx=0x7f425400fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:45.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.237+0000 7f42617fa700 1 -- 172.21.15.82:0/3982000175 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f425401d070 con 0x7f4264100950 2023-09-23T08:56:45.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.237+0000 7f42617fa700 1 -- 172.21.15.82:0/3982000175 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f425400fdc0 con 0x7f4264100950 2023-09-23T08:56:45.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.237+0000 7f426a5ff700 1 -- 172.21.15.82:0/3982000175 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f426419a840 con 0x7f4264100950 2023-09-23T08:56:45.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.237+0000 7f42617fa700 1 -- 172.21.15.82:0/3982000175 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42540173f0 con 0x7f4264100950 2023-09-23T08:56:45.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.237+0000 7f426a5ff700 1 -- 172.21.15.82:0/3982000175 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42641a1060 con 0x7f4264100950 2023-09-23T08:56:45.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.238+0000 7f424affd700 1 -- 172.21.15.82:0/3982000175 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f426404e700 con 0x7f4264100950 2023-09-23T08:56:45.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.242+0000 7f42617fa700 1 -- 172.21.15.82:0/3982000175 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) v1 ==== 134688+0+0 (secure 0 0 0) 0x7f4254022470 con 0x7f4264100950 2023-09-23T08:56:45.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.243+0000 7f42617fa700 1 --2- 172.21.15.82:0/3982000175 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f424c09ffa0 0x7f424c0a2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:45.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.243+0000 7f42617fa700 1 -- 172.21.15.82:0/3982000175 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f42540cc3d0 con 0x7f4264100950 2023-09-23T08:56:45.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.243+0000 7f42637fe700 1 -- 172.21.15.82:0/3982000175 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f424c09ffa0 msgr2=0x7f424c0a2460 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/3698954311 2023-09-23T08:56:45.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.243+0000 7f42637fe700 1 --2- 172.21.15.82:0/3982000175 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f424c09ffa0 0x7f424c0a2460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-09-23T08:56:45.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.247+0000 7f42617fa700 1 -- 172.21.15.82:0/3982000175 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f4254096320 con 0x7f4264100950 2023-09-23T08:56:45.370 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:56:45 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:56:45.150+0000 7f493940f200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-09-23T08:56:45.398 INFO:journalctl@ceph.mgr.z.smithi161.stdout:Sep 23 08:56:45 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-z[101707]: 2023-09-23T08:56:45.131+0000 7fd5f5f9f200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-09-23T08:56:45.398 INFO:journalctl@ceph.mgr.z.smithi161.stdout:Sep 23 08:56:45 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-z[101707]: 2023-09-23T08:56:45.354+0000 7fd5f5f9f200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-09-23T08:56:45.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.444+0000 7f42637fe700 1 -- 172.21.15.82:0/3982000175 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f424c09ffa0 msgr2=0x7f424c0a2460 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/3698954311 2023-09-23T08:56:45.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.444+0000 7f42637fe700 1 --2- 172.21.15.82:0/3982000175 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f424c09ffa0 0x7f424c0a2460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-09-23T08:56:45.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.455+0000 7f424affd700 1 -- 172.21.15.82:0/3982000175 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f426410c280 con 0x7f4264100950 2023-09-23T08:56:45.459 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Sep 23 08:56:45 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-y[100663]: 2023-09-23T08:56:45.133+0000 7f54a27e7200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-09-23T08:56:45.459 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Sep 23 08:56:45 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-y[100663]: 2023-09-23T08:56:45.356+0000 7f54a27e7200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-09-23T08:56:45.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.464+0000 7f42617fa700 1 -- 172.21.15.82:0/3982000175 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v24)=0 v24) v1 ==== 133+0+0 (secure 0 0 0) 0x7f4254099940 con 0x7f4264100950 2023-09-23T08:56:45.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.466+0000 7f424affd700 1 -- 172.21.15.82:0/3982000175 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f424c09ffa0 msgr2=0x7f424c0a2460 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-23T08:56:45.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.466+0000 7f424affd700 1 --2- 172.21.15.82:0/3982000175 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f424c09ffa0 0x7f424c0a2460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:45.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.467+0000 7f424affd700 1 -- 172.21.15.82:0/3982000175 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4264100950 msgr2=0x7f4264198870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:45.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.467+0000 7f424affd700 1 --2- 172.21.15.82:0/3982000175 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4264100950 0x7f4264198870 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f4254000c00 tx=0x7f425400fa00 comp rx=0 tx=0).stop 2023-09-23T08:56:45.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.467+0000 7f424affd700 1 -- 172.21.15.82:0/3982000175 shutdown_connections 2023-09-23T08:56:45.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.467+0000 7f424affd700 1 --2- 172.21.15.82:0/3982000175 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7f424c09ffa0 0x7f424c0a2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:45.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.467+0000 7f424affd700 1 --2- 172.21.15.82:0/3982000175 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f42641024e0 0x7f4264199c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:45.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.467+0000 7f424affd700 1 --2- 172.21.15.82:0/3982000175 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4264100950 0x7f4264198870 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:45.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.467+0000 7f424affd700 1 --2- 172.21.15.82:0/3982000175 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4264101b40 0x7f4264198db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:45.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.467+0000 7f424affd700 1 -- 172.21.15.82:0/3982000175 >> 172.21.15.82:0/3982000175 conn(0x7f42640fbea0 msgr2=0x7f42640fe190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:45.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.467+0000 7f424affd700 1 -- 172.21.15.82:0/3982000175 shutdown_connections 2023-09-23T08:56:45.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.467+0000 7f424affd700 1 -- 172.21.15.82:0/3982000175 wait complete. 2023-09-23T08:56:45.488 DEBUG:teuthology.orchestra.run.smithi082:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1M' 2023-09-23T08:56:45.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.685+0000 7fa2f5bff700 1 -- 172.21.15.82:0/1525674706 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2f0073380 msgr2=0x7fa2f0073800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:45.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.685+0000 7fa2f5bff700 1 --2- 172.21.15.82:0/1525674706 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2f0073380 0x7fa2f0073800 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa2e40098f0 tx=0x7fa2e4009c00 comp rx=0 tx=0).stop 2023-09-23T08:56:45.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.685+0000 7fa2f5bff700 1 -- 172.21.15.82:0/1525674706 shutdown_connections 2023-09-23T08:56:45.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.685+0000 7fa2f5bff700 1 --2- 172.21.15.82:0/1525674706 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa2f01087f0 0x7fa2f010ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:45.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.685+0000 7fa2f5bff700 1 --2- 172.21.15.82:0/1525674706 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2f0074960 0x7fa2f0072db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:45.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.685+0000 7fa2f5bff700 1 --2- 172.21.15.82:0/1525674706 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2f0073380 0x7fa2f0073800 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:45.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.685+0000 7fa2f5bff700 1 -- 172.21.15.82:0/1525674706 >> 172.21.15.82:0/1525674706 conn(0x7fa2f00fbe60 msgr2=0x7fa2f00fe2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:45.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.686+0000 7fa2f5bff700 1 -- 172.21.15.82:0/1525674706 shutdown_connections 2023-09-23T08:56:45.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.686+0000 7fa2f5bff700 1 -- 172.21.15.82:0/1525674706 wait complete. 2023-09-23T08:56:45.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.687+0000 7fa2f5bff700 1 Processor -- start 2023-09-23T08:56:45.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.687+0000 7fa2f5bff700 1 -- start start 2023-09-23T08:56:45.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.687+0000 7fa2f5bff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa2f0073380 0x7fa2f0198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:45.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.687+0000 7fa2f5bff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2f0074960 0x7fa2f0198ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:45.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.687+0000 7fa2f5bff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2f01087f0 0x7fa2f0199d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:45.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.687+0000 7fa2f5bff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f019a380 con 0x7fa2f01087f0 2023-09-23T08:56:45.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.687+0000 7fa2f5bff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f019a4f0 con 0x7fa2f0074960 2023-09-23T08:56:45.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.687+0000 7fa2f5bff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f019a6b0 con 0x7fa2f0073380 2023-09-23T08:56:45.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.688+0000 7fa2ef7fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa2f0073380 0x7fa2f0198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:45.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.688+0000 7fa2effff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2f01087f0 0x7fa2f0199d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:45.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.688+0000 7fa2ef7fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa2f0073380 0x7fa2f0198960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:38224/0 (socket says 172.21.15.82:38224) 2023-09-23T08:56:45.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.688+0000 7fa2ef7fe700 1 -- 172.21.15.82:0/2654052222 learned_addr learned my addr 172.21.15.82:0/2654052222 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:45.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.688+0000 7fa2eeffd700 1 --2- 172.21.15.82:0/2654052222 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2f0074960 0x7fa2f0198ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:45.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.688+0000 7fa2ef7fe700 1 -- 172.21.15.82:0/2654052222 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2f0074960 msgr2=0x7fa2f0198ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:45.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.688+0000 7fa2ef7fe700 1 --2- 172.21.15.82:0/2654052222 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2f0074960 0x7fa2f0198ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:45.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.688+0000 7fa2ef7fe700 1 -- 172.21.15.82:0/2654052222 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2f01087f0 msgr2=0x7fa2f0199d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:45.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.688+0000 7fa2ef7fe700 1 --2- 172.21.15.82:0/2654052222 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2f01087f0 0x7fa2f0199d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:45.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.688+0000 7fa2ef7fe700 1 -- 172.21.15.82:0/2654052222 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2e4009520 con 0x7fa2f0073380 2023-09-23T08:56:45.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.688+0000 7fa2ef7fe700 1 --2- 172.21.15.82:0/2654052222 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa2f0073380 0x7fa2f0198960 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa2e000e9c0 tx=0x7fa2e000ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:45.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.689+0000 7fa2ecff9700 1 -- 172.21.15.82:0/2654052222 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e0004a30 con 0x7fa2f0073380 2023-09-23T08:56:45.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.689+0000 7fa2ecff9700 1 -- 172.21.15.82:0/2654052222 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa2e000cc50 con 0x7fa2f0073380 2023-09-23T08:56:45.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.689+0000 7fa2f5bff700 1 -- 172.21.15.82:0/2654052222 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2f019a990 con 0x7fa2f0073380 2023-09-23T08:56:45.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.689+0000 7fa2ecff9700 1 -- 172.21.15.82:0/2654052222 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e0005410 con 0x7fa2f0073380 2023-09-23T08:56:45.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.689+0000 7fa2f5bff700 1 -- 172.21.15.82:0/2654052222 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2f01a1150 con 0x7fa2f0073380 2023-09-23T08:56:45.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.690+0000 7fa2f5bff700 1 -- 172.21.15.82:0/2654052222 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2f0106ea0 con 0x7fa2f0073380 2023-09-23T08:56:45.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.692+0000 7fa2ecff9700 1 -- 172.21.15.82:0/2654052222 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 19) v1 ==== 134688+0+0 (secure 0 0 0) 0x7fa2e0005570 con 0x7fa2f0073380 2023-09-23T08:56:45.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.693+0000 7fa2ecff9700 1 --2- 172.21.15.82:0/2654052222 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fa2d809ffa0 0x7fa2d80a2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:45.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.693+0000 7fa2eeffd700 1 -- 172.21.15.82:0/2654052222 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fa2d809ffa0 msgr2=0x7fa2d80a2460 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/3698954311 2023-09-23T08:56:45.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.693+0000 7fa2ecff9700 1 -- 172.21.15.82:0/2654052222 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fa2e0014070 con 0x7fa2f0073380 2023-09-23T08:56:45.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.693+0000 7fa2eeffd700 1 --2- 172.21.15.82:0/2654052222 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fa2d809ffa0 0x7fa2d80a2460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-09-23T08:56:45.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.700+0000 7fa2ecff9700 1 -- 172.21.15.82:0/2654052222 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7fa2e00950d0 con 0x7fa2f0073380 2023-09-23T08:56:45.808 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:45 smithi135 ceph-mon[99205]: scrub queued for path: / 2023-09-23T08:56:45.809 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:45 smithi135 ceph-mon[99205]: scrub summary: idle+waiting paths [/] 2023-09-23T08:56:45.809 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:45 smithi135 ceph-mon[99205]: scrub summary: active paths [/] 2023-09-23T08:56:45.809 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:45 smithi135 ceph-mon[99205]: scrub summary: idle+waiting paths [/] 2023-09-23T08:56:45.809 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:45 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/3200397608' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2023-09-23T08:56:45.809 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:45 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/3200397608' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2023-09-23T08:56:45.809 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:45 smithi135 ceph-mon[99205]: mgrmap e19: x(active, since 9m), standbys: z, y 2023-09-23T08:56:45.809 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:45 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/3703188540' entity='client.admin' 2023-09-23T08:56:45.814 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:45 smithi161 ceph-mon[99580]: scrub queued for path: / 2023-09-23T08:56:45.814 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:45 smithi161 ceph-mon[99580]: scrub summary: idle+waiting paths [/] 2023-09-23T08:56:45.814 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:45 smithi161 ceph-mon[99580]: scrub summary: active paths [/] 2023-09-23T08:56:45.814 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:45 smithi161 ceph-mon[99580]: scrub summary: idle+waiting paths [/] 2023-09-23T08:56:45.814 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:45 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/3200397608' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2023-09-23T08:56:45.814 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:45 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/3200397608' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2023-09-23T08:56:45.814 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:45 smithi161 ceph-mon[99580]: mgrmap e19: x(active, since 9m), standbys: z, y 2023-09-23T08:56:45.815 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:45 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/3703188540' entity='client.admin' 2023-09-23T08:56:45.860 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:56:45 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:56:45.384+0000 7f493940f200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-09-23T08:56:45.861 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:45 smithi082 ceph-mon[97694]: scrub queued for path: / 2023-09-23T08:56:45.861 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:45 smithi082 ceph-mon[97694]: scrub summary: idle+waiting paths [/] 2023-09-23T08:56:45.861 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:45 smithi082 ceph-mon[97694]: scrub summary: active paths [/] 2023-09-23T08:56:45.861 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:45 smithi082 ceph-mon[97694]: scrub summary: idle+waiting paths [/] 2023-09-23T08:56:45.861 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:45 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/3200397608' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2023-09-23T08:56:45.861 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:45 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/3200397608' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2023-09-23T08:56:45.862 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:45 smithi082 ceph-mon[97694]: mgrmap e19: x(active, since 9m), standbys: z, y 2023-09-23T08:56:45.862 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:45 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/3703188540' entity='client.admin' 2023-09-23T08:56:45.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.894+0000 7fa2eeffd700 1 -- 172.21.15.82:0/2654052222 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fa2d809ffa0 msgr2=0x7fa2d80a2460 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/3698954311 2023-09-23T08:56:45.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.894+0000 7fa2eeffd700 1 --2- 172.21.15.82:0/2654052222 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fa2d809ffa0 0x7fa2d80a2460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-09-23T08:56:45.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:45.935+0000 7fa2f5bff700 1 -- 172.21.15.82:0/2654052222 --> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fa2f002cc80 con 0x7fa2d809ffa0 2023-09-23T08:56:46.062 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Sep 23 08:56:45 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-y[100663]: 2023-09-23T08:56:45.806+0000 7f54a27e7200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-09-23T08:56:46.062 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Sep 23 08:56:45 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-y[100663]: 2023-09-23T08:56:45.969+0000 7f54a27e7200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-09-23T08:56:46.094 INFO:journalctl@ceph.mgr.z.smithi161.stdout:Sep 23 08:56:45 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-z[101707]: 2023-09-23T08:56:45.811+0000 7fd5f5f9f200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-09-23T08:56:46.095 INFO:journalctl@ceph.mgr.z.smithi161.stdout:Sep 23 08:56:45 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-z[101707]: 2023-09-23T08:56:45.975+0000 7fd5f5f9f200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-09-23T08:56:46.120 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:56:45 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:56:45.858+0000 7f493940f200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-09-23T08:56:46.120 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:56:46 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:56:46.027+0000 7f493940f200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-09-23T08:56:46.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:46.295+0000 7fa2eeffd700 1 -- 172.21.15.82:0/2654052222 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fa2d809ffa0 msgr2=0x7fa2d80a2460 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/3698954311 2023-09-23T08:56:46.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:46.295+0000 7fa2eeffd700 1 --2- 172.21.15.82:0/2654052222 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fa2d809ffa0 0x7fa2d80a2460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-09-23T08:56:46.398 INFO:journalctl@ceph.mgr.z.smithi161.stdout:Sep 23 08:56:46 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-z[101707]: 2023-09-23T08:56:46.092+0000 7fd5f5f9f200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-09-23T08:56:46.398 INFO:journalctl@ceph.mgr.z.smithi161.stdout:Sep 23 08:56:46 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-z[101707]: 2023-09-23T08:56:46.214+0000 7fd5f5f9f200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-09-23T08:56:46.465 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:56:46 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:56:46.144+0000 7f493940f200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-09-23T08:56:46.465 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:56:46 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:56:46.268+0000 7f493940f200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-09-23T08:56:46.467 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Sep 23 08:56:46 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-y[100663]: 2023-09-23T08:56:46.086+0000 7f54a27e7200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-09-23T08:56:46.467 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Sep 23 08:56:46 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-y[100663]: 2023-09-23T08:56:46.208+0000 7f54a27e7200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-09-23T08:56:46.745 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:46 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/3982000175' entity='client.admin' 2023-09-23T08:56:46.757 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:46 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/3982000175' entity='client.admin' 2023-09-23T08:56:46.811 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:46 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/3982000175' entity='client.admin' 2023-09-23T08:56:47.062 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Sep 23 08:56:46 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-y[100663]: 2023-09-23T08:56:46.742+0000 7f54a27e7200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-09-23T08:56:47.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:47.096+0000 7fa2eeffd700 1 -- 172.21.15.82:0/2654052222 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fa2d809ffa0 msgr2=0x7fa2d80a2460 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/3698954311 2023-09-23T08:56:47.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:47.096+0000 7fa2eeffd700 1 --2- 172.21.15.82:0/2654052222 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fa2d809ffa0 0x7fa2d80a2460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-09-23T08:56:47.120 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:56:46 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:56:46.808+0000 7f493940f200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-09-23T08:56:47.148 INFO:journalctl@ceph.mgr.z.smithi161.stdout:Sep 23 08:56:46 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-z[101707]: 2023-09-23T08:56:46.754+0000 7fd5f5f9f200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-09-23T08:56:47.898 INFO:journalctl@ceph.mgr.z.smithi161.stdout:Sep 23 08:56:47 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-z[101707]: 2023-09-23T08:56:47.600+0000 7fd5f5f9f200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-09-23T08:56:47.898 INFO:journalctl@ceph.mgr.z.smithi161.stdout:Sep 23 08:56:47 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-z[101707]: 2023-09-23T08:56:47.706+0000 7fd5f5f9f200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-09-23T08:56:48.062 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Sep 23 08:56:47 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-y[100663]: 2023-09-23T08:56:47.584+0000 7f54a27e7200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-09-23T08:56:48.062 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Sep 23 08:56:47 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-y[100663]: 2023-09-23T08:56:47.690+0000 7f54a27e7200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-09-23T08:56:48.120 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:56:47 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:56:47.653+0000 7f493940f200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-09-23T08:56:48.120 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:56:47 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:56:47.761+0000 7f493940f200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-09-23T08:56:48.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:48.697+0000 7fa2eeffd700 1 -- 172.21.15.82:0/2654052222 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fa2d809ffa0 msgr2=0x7fa2d80a2460 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/3698954311 2023-09-23T08:56:48.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:48.697+0000 7fa2eeffd700 1 --2- 172.21.15.82:0/2654052222 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fa2d809ffa0 0x7fa2d80a2460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-09-23T08:56:48.979 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Sep 23 08:56:48 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-y[100663]: 2023-09-23T08:56:48.635+0000 7f54a27e7200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-09-23T08:56:48.979 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Sep 23 08:56:48 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-y[100663]: 2023-09-23T08:56:48.753+0000 7f54a27e7200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-09-23T08:56:49.003 INFO:journalctl@ceph.mgr.z.smithi161.stdout:Sep 23 08:56:48 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-z[101707]: 2023-09-23T08:56:48.657+0000 7fd5f5f9f200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-09-23T08:56:49.003 INFO:journalctl@ceph.mgr.z.smithi161.stdout:Sep 23 08:56:48 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-z[101707]: 2023-09-23T08:56:48.776+0000 7fd5f5f9f200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-09-23T08:56:49.059 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:56:48 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:56:48.713+0000 7f493940f200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-09-23T08:56:49.059 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:56:48 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:56:48.832+0000 7f493940f200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-09-23T08:56:49.312 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Sep 23 08:56:48 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-y[100663]: 2023-09-23T08:56:48.976+0000 7f54a27e7200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-09-23T08:56:49.367 INFO:journalctl@ceph.mgr.z.smithi161.stdout:Sep 23 08:56:49 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-z[101707]: 2023-09-23T08:56:49.000+0000 7fd5f5f9f200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-09-23T08:56:49.370 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:56:49 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:56:49.056+0000 7f493940f200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-09-23T08:56:49.613 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Sep 23 08:56:49 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-y[100663]: 2023-09-23T08:56:49.332+0000 7f54a27e7200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-09-23T08:56:49.648 INFO:journalctl@ceph.mgr.z.smithi161.stdout:Sep 23 08:56:49 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-z[101707]: 2023-09-23T08:56:49.364+0000 7fd5f5f9f200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-09-23T08:56:49.700 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:56:49 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:56:49.418+0000 7f493940f200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-09-23T08:56:50.062 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Sep 23 08:56:49 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-y[100663]: 2023-09-23T08:56:49.610+0000 7f54a27e7200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-09-23T08:56:50.062 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Sep 23 08:56:49 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-y[100663]: 2023-09-23T08:56:49.803+0000 7f54a27e7200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-09-23T08:56:50.120 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:56:49 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:56:49.697+0000 7f493940f200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-09-23T08:56:50.121 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:56:49 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:56:49.891+0000 7f493940f200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-09-23T08:56:50.148 INFO:journalctl@ceph.mgr.z.smithi161.stdout:Sep 23 08:56:49 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-z[101707]: 2023-09-23T08:56:49.646+0000 7fd5f5f9f200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-09-23T08:56:50.148 INFO:journalctl@ceph.mgr.z.smithi161.stdout:Sep 23 08:56:49 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-z[101707]: 2023-09-23T08:56:49.841+0000 7fd5f5f9f200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-09-23T08:56:50.562 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Sep 23 08:56:50 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-y[100663]: 2023-09-23T08:56:50.143+0000 7f54a27e7200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-09-23T08:56:50.620 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:56:50 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:56:50.234+0000 7f493940f200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-09-23T08:56:50.648 INFO:journalctl@ceph.mgr.z.smithi161.stdout:Sep 23 08:56:50 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-z[101707]: 2023-09-23T08:56:50.187+0000 7fd5f5f9f200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-09-23T08:56:51.398 INFO:journalctl@ceph.mgr.z.smithi161.stdout:Sep 23 08:56:51 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-z[101707]: 2023-09-23T08:56:51.114+0000 7fd5f5f9f200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-09-23T08:56:51.398 INFO:journalctl@ceph.mgr.z.smithi161.stdout:Sep 23 08:56:51 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-z[101707]: 2023-09-23T08:56:51.288+0000 7fd5f5f9f200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-09-23T08:56:51.489 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Sep 23 08:56:51 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-y[100663]: 2023-09-23T08:56:51.065+0000 7f54a27e7200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-09-23T08:56:51.490 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Sep 23 08:56:51 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-y[100663]: 2023-09-23T08:56:51.240+0000 7f54a27e7200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-09-23T08:56:51.592 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:56:51 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:56:51.163+0000 7f493940f200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-09-23T08:56:51.592 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:56:51 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:56:51.337+0000 7f493940f200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-09-23T08:56:51.812 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Sep 23 08:56:51 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-y[100663]: 2023-09-23T08:56:51.487+0000 7f54a27e7200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-09-23T08:56:51.812 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Sep 23 08:56:51 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-y[100663]: 2023-09-23T08:56:51.631+0000 7f54a27e7200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-09-23T08:56:51.870 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:56:51 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:56:51.589+0000 7f493940f200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-09-23T08:56:51.870 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:56:51 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:56:51.737+0000 7f493940f200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-09-23T08:56:51.898 INFO:journalctl@ceph.mgr.z.smithi161.stdout:Sep 23 08:56:51 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-z[101707]: 2023-09-23T08:56:51.539+0000 7fd5f5f9f200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-09-23T08:56:51.898 INFO:journalctl@ceph.mgr.z.smithi161.stdout:Sep 23 08:56:51 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-z[101707]: 2023-09-23T08:56:51.685+0000 7fd5f5f9f200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-09-23T08:56:51.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:51.898+0000 7fa2eeffd700 1 -- 172.21.15.82:0/2654052222 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fa2d809ffa0 msgr2=0x7fa2d80a2460 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/3698954311 2023-09-23T08:56:51.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:51.898+0000 7fa2eeffd700 1 --2- 172.21.15.82:0/2654052222 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fa2d809ffa0 0x7fa2d80a2460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2023-09-23T08:56:52.312 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Sep 23 08:56:51 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-y[100663]: 2023-09-23T08:56:51.907+0000 7f54a27e7200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-09-23T08:56:52.370 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:56:52 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:56:52.017+0000 7f493940f200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-09-23T08:56:52.398 INFO:journalctl@ceph.mgr.z.smithi161.stdout:Sep 23 08:56:51 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-z[101707]: 2023-09-23T08:56:51.962+0000 7fd5f5f9f200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-09-23T08:56:53.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:53.041+0000 7fa2ecff9700 1 -- 172.21.15.82:0/2654052222 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mgrmap(e 20) v1 ==== 134688+0+0 (secure 0 0 0) 0x7fa2e00954a0 con 0x7fa2f0073380 2023-09-23T08:56:53.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:53.107+0000 7fa2ecff9700 1 -- 172.21.15.82:0/2654052222 <== mon.1 v2:172.21.15.161:3300/0 8 ==== mgrmap(e 21) v1 ==== 134356+0+0 (secure 0 0 0) 0x7fa2e00c8ec0 con 0x7fa2f0073380 2023-09-23T08:56:53.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:53.107+0000 7fa2ecff9700 1 -- 172.21.15.82:0/2654052222 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fa2d809ffa0 msgr2=0x7fa2d80a2460 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-23T08:56:53.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:53.107+0000 7fa2ecff9700 1 --2- 172.21.15.82:0/2654052222 >> [v2:172.21.15.82:6800/3698954311,v1:172.21.15.82:6801/3698954311] conn(0x7fa2d809ffa0 0x7fa2d80a2460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:53.245 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Sep 23 08:56:52 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-y[100663]: 2023-09-23T08:56:52.976+0000 7f54a27e7200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-09-23T08:56:53.245 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:53 smithi135 ceph-mon[99205]: Standby manager daemon y restarted 2023-09-23T08:56:53.245 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:53 smithi135 ceph-mon[99205]: Standby manager daemon y started 2023-09-23T08:56:53.246 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:53 smithi135 ceph-mon[99205]: from='mgr.? 172.21.15.135:0/2690164807' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-09-23T08:56:53.246 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:53 smithi135 ceph-mon[99205]: from='mgr.? 172.21.15.135:0/2690164807' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-09-23T08:56:53.246 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:53 smithi135 ceph-mon[99205]: from='mgr.? 172.21.15.135:0/2690164807' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-09-23T08:56:53.246 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:53 smithi135 ceph-mon[99205]: from='mgr.? 172.21.15.135:0/2690164807' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-09-23T08:56:53.308 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:56:53 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:56:53.088+0000 7f493940f200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-09-23T08:56:53.308 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:53 smithi082 ceph-mon[97694]: Standby manager daemon y restarted 2023-09-23T08:56:53.308 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:53 smithi082 ceph-mon[97694]: Standby manager daemon y started 2023-09-23T08:56:53.309 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:53 smithi082 ceph-mon[97694]: from='mgr.? 172.21.15.135:0/2690164807' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-09-23T08:56:53.309 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:53 smithi082 ceph-mon[97694]: from='mgr.? 172.21.15.135:0/2690164807' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-09-23T08:56:53.309 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:53 smithi082 ceph-mon[97694]: from='mgr.? 172.21.15.135:0/2690164807' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-09-23T08:56:53.309 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:53 smithi082 ceph-mon[97694]: from='mgr.? 172.21.15.135:0/2690164807' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-09-23T08:56:53.398 INFO:journalctl@ceph.mgr.z.smithi161.stdout:Sep 23 08:56:53 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-z[101707]: 2023-09-23T08:56:53.035+0000 7fd5f5f9f200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-09-23T08:56:53.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:53 smithi161 ceph-mon[99580]: Standby manager daemon y restarted 2023-09-23T08:56:53.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:53 smithi161 ceph-mon[99580]: Standby manager daemon y started 2023-09-23T08:56:53.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:53 smithi161 ceph-mon[99580]: from='mgr.? 172.21.15.135:0/2690164807' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-09-23T08:56:53.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:53 smithi161 ceph-mon[99580]: from='mgr.? 172.21.15.135:0/2690164807' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-09-23T08:56:53.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:53 smithi161 ceph-mon[99580]: from='mgr.? 172.21.15.135:0/2690164807' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-09-23T08:56:53.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:53 smithi161 ceph-mon[99580]: from='mgr.? 172.21.15.135:0/2690164807' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-09-23T08:56:53.620 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:56:53 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:56:53.304+0000 7f489ae44700 -1 client.0 error registering admin socket command: (17) File exists 2023-09-23T08:56:53.621 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:56:53 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:56:53.304+0000 7f489ae44700 -1 client.0 error registering admin socket command: (17) File exists 2023-09-23T08:56:53.621 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:56:53 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:56:53.304+0000 7f489ae44700 -1 client.0 error registering admin socket command: (17) File exists 2023-09-23T08:56:53.621 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:56:53 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:56:53.304+0000 7f489ae44700 -1 client.0 error registering admin socket command: (17) File exists 2023-09-23T08:56:53.621 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:56:53 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:56:53.304+0000 7f489ae44700 -1 client.0 error registering admin socket command: (17) File exists 2023-09-23T08:56:53.621 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:56:53 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:56:53.307+0000 7f4898e40700 -1 client.0 error registering admin socket command: (17) File exists 2023-09-23T08:56:53.621 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:56:53 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:56:53.307+0000 7f4898e40700 -1 client.0 error registering admin socket command: (17) File exists 2023-09-23T08:56:53.621 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:56:53 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:56:53.307+0000 7f4898e40700 -1 client.0 error registering admin socket command: (17) File exists 2023-09-23T08:56:53.621 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:56:53 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:56:53.307+0000 7f4898e40700 -1 client.0 error registering admin socket command: (17) File exists 2023-09-23T08:56:53.621 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:56:53 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:56:53.307+0000 7f4898e40700 -1 client.0 error registering admin socket command: (17) File exists 2023-09-23T08:56:54.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.110+0000 7fa2ecff9700 1 -- 172.21.15.82:0/2654052222 <== mon.1 v2:172.21.15.161:3300/0 9 ==== mgrmap(e 22) v1 ==== 134483+0+0 (secure 0 0 0) 0x7fa2e000c760 con 0x7fa2f0073380 2023-09-23T08:56:54.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.111+0000 7fa2ecff9700 1 --2- 172.21.15.82:0/2654052222 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fa2d801b0d0 0x7fa2d801b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:54.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.111+0000 7fa2ecff9700 1 -- 172.21.15.82:0/2654052222 --> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fa2f002cc80 con 0x7fa2d801b0d0 2023-09-23T08:56:54.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.112+0000 7fa2eeffd700 1 --2- 172.21.15.82:0/2654052222 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fa2d801b0d0 0x7fa2d801b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:54.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.116+0000 7fa2eeffd700 1 --2- 172.21.15.82:0/2654052222 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fa2d801b0d0 0x7fa2d801b4b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa2e4009fd0 tx=0x7fa2e4005dc0 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:54.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.177+0000 7fa2ecff9700 1 -- 172.21.15.82:0/2654052222 <== mgr.15537 v2:172.21.15.82:6800/630725563 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fa2f002cc80 con 0x7fa2d801b0d0 2023-09-23T08:56:54.181 INFO:teuthology.orchestra.run.smithi082.stdout:Schedule set for path / 2023-09-23T08:56:54.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.179+0000 7fa2f5bff700 1 -- 172.21.15.82:0/2654052222 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fa2d801b0d0 msgr2=0x7fa2d801b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:54.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.179+0000 7fa2f5bff700 1 --2- 172.21.15.82:0/2654052222 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fa2d801b0d0 0x7fa2d801b4b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa2e4009fd0 tx=0x7fa2e4005dc0 comp rx=0 tx=0).stop 2023-09-23T08:56:54.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.179+0000 7fa2f5bff700 1 -- 172.21.15.82:0/2654052222 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa2f0073380 msgr2=0x7fa2f0198960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:54.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.179+0000 7fa2f5bff700 1 --2- 172.21.15.82:0/2654052222 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa2f0073380 0x7fa2f0198960 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa2e000e9c0 tx=0x7fa2e000ecd0 comp rx=0 tx=0).stop 2023-09-23T08:56:54.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.179+0000 7fa2effff700 1 -- 172.21.15.82:0/2654052222 reap_dead start 2023-09-23T08:56:54.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.179+0000 7fa2f5bff700 1 -- 172.21.15.82:0/2654052222 shutdown_connections 2023-09-23T08:56:54.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.179+0000 7fa2f5bff700 1 -- 172.21.15.82:0/2654052222 >> 172.21.15.82:0/2654052222 conn(0x7fa2f00fbe60 msgr2=0x7fa2f00fe250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:54.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.179+0000 7fa2f5bff700 1 -- 172.21.15.82:0/2654052222 shutdown_connections 2023-09-23T08:56:54.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.179+0000 7fa2f5bff700 1 -- 172.21.15.82:0/2654052222 wait complete. 2023-09-23T08:56:54.202 DEBUG:teuthology.orchestra.run.smithi082:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6M3h' 2023-09-23T08:56:54.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:54 smithi135 ceph-mon[99205]: mgrmap e20: x(active, since 9m), standbys: z, y 2023-09-23T08:56:54.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:54 smithi135 ceph-mon[99205]: from='mgr.? 172.21.15.161:0/1151627430' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-09-23T08:56:54.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:54 smithi135 ceph-mon[99205]: from='mgr.? 172.21.15.161:0/1151627430' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-09-23T08:56:54.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:54 smithi135 ceph-mon[99205]: Standby manager daemon z restarted 2023-09-23T08:56:54.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:54 smithi135 ceph-mon[99205]: Standby manager daemon z started 2023-09-23T08:56:54.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:54 smithi135 ceph-mon[99205]: from='mgr.? 172.21.15.161:0/1151627430' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-09-23T08:56:54.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:54 smithi135 ceph-mon[99205]: from='mgr.? 172.21.15.161:0/1151627430' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-09-23T08:56:54.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:54 smithi135 ceph-mon[99205]: Active manager daemon x restarted 2023-09-23T08:56:54.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:54 smithi135 ceph-mon[99205]: Activating manager daemon x 2023-09-23T08:56:54.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:54 smithi135 ceph-mon[99205]: osdmap e89: 12 total, 12 up, 12 in 2023-09-23T08:56:54.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:54 smithi135 ceph-mon[99205]: mgrmap e21: x(active, starting, since 0.0143488s), standbys: y, z 2023-09-23T08:56:54.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:54 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-09-23T08:56:54.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:54 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-23T08:56:54.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:54 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-23T08:56:54.314 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:54 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-09-23T08:56:54.314 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:54 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-09-23T08:56:54.314 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:54 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-09-23T08:56:54.314 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:54 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-09-23T08:56:54.314 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:54 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-09-23T08:56:54.314 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:54 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-09-23T08:56:54.314 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:54 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-09-23T08:56:54.314 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:54 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-09-23T08:56:54.314 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:54 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-09-23T08:56:54.314 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:54 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-09-23T08:56:54.314 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:54 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-09-23T08:56:54.315 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:54 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-09-23T08:56:54.315 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:54 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-09-23T08:56:54.315 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:54 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-09-23T08:56:54.315 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:54 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-09-23T08:56:54.315 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:54 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-09-23T08:56:54.315 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:54 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-09-23T08:56:54.315 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:54 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-09-23T08:56:54.315 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:54 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-09-23T08:56:54.315 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:54 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-09-23T08:56:54.315 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:54 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-09-23T08:56:54.315 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:54 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-09-23T08:56:54.315 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:54 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-09-23T08:56:54.316 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:54 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-09-23T08:56:54.316 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:54 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-09-23T08:56:54.316 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:54 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-09-23T08:56:54.316 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:54 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-09-23T08:56:54.316 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:54 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-09-23T08:56:54.316 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:54 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-09-23T08:56:54.316 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:54 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-09-23T08:56:54.316 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:54 smithi135 ceph-mon[99205]: Manager daemon x is now available 2023-09-23T08:56:54.316 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:54 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:56:54.316 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:54 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:56:54.316 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:54 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-09-23T08:56:54.316 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:54 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-09-23T08:56:54.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:54 smithi082 ceph-mon[97694]: mgrmap e20: x(active, since 9m), standbys: z, y 2023-09-23T08:56:54.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:54 smithi082 ceph-mon[97694]: from='mgr.? 172.21.15.161:0/1151627430' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-09-23T08:56:54.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:54 smithi082 ceph-mon[97694]: from='mgr.? 172.21.15.161:0/1151627430' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-09-23T08:56:54.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:54 smithi082 ceph-mon[97694]: Standby manager daemon z restarted 2023-09-23T08:56:54.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:54 smithi082 ceph-mon[97694]: Standby manager daemon z started 2023-09-23T08:56:54.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:54 smithi082 ceph-mon[97694]: from='mgr.? 172.21.15.161:0/1151627430' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-09-23T08:56:54.372 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:54 smithi082 ceph-mon[97694]: from='mgr.? 172.21.15.161:0/1151627430' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-09-23T08:56:54.372 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:54 smithi082 ceph-mon[97694]: Active manager daemon x restarted 2023-09-23T08:56:54.372 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:54 smithi082 ceph-mon[97694]: Activating manager daemon x 2023-09-23T08:56:54.372 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:54 smithi082 ceph-mon[97694]: osdmap e89: 12 total, 12 up, 12 in 2023-09-23T08:56:54.372 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:54 smithi082 ceph-mon[97694]: mgrmap e21: x(active, starting, since 0.0143488s), standbys: y, z 2023-09-23T08:56:54.372 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:54 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-09-23T08:56:54.372 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:54 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-23T08:56:54.372 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:54 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-23T08:56:54.372 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:54 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-09-23T08:56:54.372 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:54 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-09-23T08:56:54.372 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:54 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-09-23T08:56:54.372 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:54 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-09-23T08:56:54.373 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:54 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-09-23T08:56:54.373 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:54 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-09-23T08:56:54.373 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:54 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-09-23T08:56:54.373 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:54 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-09-23T08:56:54.373 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:54 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-09-23T08:56:54.373 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:54 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-09-23T08:56:54.373 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:54 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-09-23T08:56:54.373 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:54 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-09-23T08:56:54.373 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:54 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-09-23T08:56:54.373 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:54 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-09-23T08:56:54.373 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:54 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-09-23T08:56:54.373 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:54 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-09-23T08:56:54.373 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:54 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-09-23T08:56:54.374 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:54 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-09-23T08:56:54.374 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:54 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-09-23T08:56:54.374 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:54 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-09-23T08:56:54.374 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:54 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-09-23T08:56:54.374 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:54 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-09-23T08:56:54.374 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:54 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-09-23T08:56:54.374 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:54 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-09-23T08:56:54.374 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:54 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-09-23T08:56:54.374 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:54 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-09-23T08:56:54.374 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:54 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-09-23T08:56:54.374 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:54 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-09-23T08:56:54.374 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:54 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-09-23T08:56:54.375 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:54 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-09-23T08:56:54.375 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:54 smithi082 ceph-mon[97694]: Manager daemon x is now available 2023-09-23T08:56:54.375 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:54 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:56:54.375 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:54 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:56:54.375 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:54 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-09-23T08:56:54.375 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:54 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-09-23T08:56:54.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:54 smithi161 ceph-mon[99580]: mgrmap e20: x(active, since 9m), standbys: z, y 2023-09-23T08:56:54.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:54 smithi161 ceph-mon[99580]: from='mgr.? 172.21.15.161:0/1151627430' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-09-23T08:56:54.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:54 smithi161 ceph-mon[99580]: from='mgr.? 172.21.15.161:0/1151627430' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-09-23T08:56:54.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:54 smithi161 ceph-mon[99580]: Standby manager daemon z restarted 2023-09-23T08:56:54.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:54 smithi161 ceph-mon[99580]: Standby manager daemon z started 2023-09-23T08:56:54.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:54 smithi161 ceph-mon[99580]: from='mgr.? 172.21.15.161:0/1151627430' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-09-23T08:56:54.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:54 smithi161 ceph-mon[99580]: from='mgr.? 172.21.15.161:0/1151627430' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-09-23T08:56:54.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:54 smithi161 ceph-mon[99580]: Active manager daemon x restarted 2023-09-23T08:56:54.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:54 smithi161 ceph-mon[99580]: Activating manager daemon x 2023-09-23T08:56:54.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:54 smithi161 ceph-mon[99580]: osdmap e89: 12 total, 12 up, 12 in 2023-09-23T08:56:54.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:54 smithi161 ceph-mon[99580]: mgrmap e21: x(active, starting, since 0.0143488s), standbys: y, z 2023-09-23T08:56:54.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:54 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-09-23T08:56:54.400 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:54 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-23T08:56:54.400 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:54 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-23T08:56:54.400 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:54 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-09-23T08:56:54.400 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:54 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-09-23T08:56:54.400 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:54 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-09-23T08:56:54.400 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:54 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-09-23T08:56:54.400 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:54 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-09-23T08:56:54.400 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:54 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-09-23T08:56:54.400 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:54 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-09-23T08:56:54.400 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:54 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-09-23T08:56:54.400 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:54 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-09-23T08:56:54.400 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:54 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-09-23T08:56:54.401 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:54 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-09-23T08:56:54.401 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:54 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-09-23T08:56:54.401 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:54 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-09-23T08:56:54.401 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:54 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-09-23T08:56:54.401 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:54 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-09-23T08:56:54.401 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:54 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-09-23T08:56:54.401 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:54 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-09-23T08:56:54.401 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:54 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-09-23T08:56:54.401 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:54 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-09-23T08:56:54.401 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:54 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-09-23T08:56:54.401 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:54 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-09-23T08:56:54.401 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:54 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-09-23T08:56:54.401 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:54 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-09-23T08:56:54.402 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:54 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-09-23T08:56:54.402 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:54 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-09-23T08:56:54.402 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:54 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-09-23T08:56:54.402 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:54 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-09-23T08:56:54.402 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:54 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-09-23T08:56:54.402 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:54 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-09-23T08:56:54.402 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:54 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-09-23T08:56:54.402 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:54 smithi161 ceph-mon[99580]: Manager daemon x is now available 2023-09-23T08:56:54.402 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:54 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:56:54.402 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:54 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:56:54.402 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:54 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-09-23T08:56:54.402 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:54 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-09-23T08:56:54.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.410+0000 7f04129ff700 1 -- 172.21.15.82:0/2592764183 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f040c101b40 msgr2=0x7f040c101fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:54.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.410+0000 7f04129ff700 1 --2- 172.21.15.82:0/2592764183 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f040c101b40 0x7f040c101fa0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f04000099c0 tx=0x7f0400009cd0 comp rx=0 tx=0).stop 2023-09-23T08:56:54.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.410+0000 7f04129ff700 1 -- 172.21.15.82:0/2592764183 shutdown_connections 2023-09-23T08:56:54.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.410+0000 7f04129ff700 1 --2- 172.21.15.82:0/2592764183 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f040c1024e0 0x7f040c108d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:54.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.410+0000 7f04129ff700 1 --2- 172.21.15.82:0/2592764183 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f040c100950 0x7f040c100d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:54.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.410+0000 7f04129ff700 1 --2- 172.21.15.82:0/2592764183 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f040c101b40 0x7f040c101fa0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:54.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.410+0000 7f04129ff700 1 -- 172.21.15.82:0/2592764183 >> 172.21.15.82:0/2592764183 conn(0x7f040c0fbea0 msgr2=0x7f040c0fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:54.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.410+0000 7f04129ff700 1 -- 172.21.15.82:0/2592764183 shutdown_connections 2023-09-23T08:56:54.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.410+0000 7f04129ff700 1 -- 172.21.15.82:0/2592764183 wait complete. 2023-09-23T08:56:54.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.411+0000 7f04129ff700 1 Processor -- start 2023-09-23T08:56:54.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.411+0000 7f04129ff700 1 -- start start 2023-09-23T08:56:54.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.411+0000 7f04129ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f040c100950 0x7f040c198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:54.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.411+0000 7f04129ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f040c101b40 0x7f040c198db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:54.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.411+0000 7f04129ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f040c1024e0 0x7f040c199c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:54.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.411+0000 7f04129ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f040c19a290 con 0x7f040c1024e0 2023-09-23T08:56:54.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.411+0000 7f04129ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f040c19a400 con 0x7f040c101b40 2023-09-23T08:56:54.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.411+0000 7f04129ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f040c19a5c0 con 0x7f040c100950 2023-09-23T08:56:54.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.412+0000 7f040bfff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f040c100950 0x7f040c198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:54.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.412+0000 7f040bfff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f040c100950 0x7f040c198870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:45600/0 (socket says 172.21.15.82:45600) 2023-09-23T08:56:54.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.412+0000 7f040bfff700 1 -- 172.21.15.82:0/2247602349 learned_addr learned my addr 172.21.15.82:0/2247602349 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:54.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.412+0000 7f0410f9c700 1 --2- 172.21.15.82:0/2247602349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f040c1024e0 0x7f040c199c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:54.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.412+0000 7f040b7fe700 1 --2- 172.21.15.82:0/2247602349 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f040c101b40 0x7f040c198db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:54.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.412+0000 7f040bfff700 1 -- 172.21.15.82:0/2247602349 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f040c101b40 msgr2=0x7f040c198db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:54.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.412+0000 7f040bfff700 1 --2- 172.21.15.82:0/2247602349 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f040c101b40 0x7f040c198db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:54.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.412+0000 7f040bfff700 1 -- 172.21.15.82:0/2247602349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f040c1024e0 msgr2=0x7f040c199c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:54.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.412+0000 7f040bfff700 1 --2- 172.21.15.82:0/2247602349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f040c1024e0 0x7f040c199c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:54.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.412+0000 7f040bfff700 1 -- 172.21.15.82:0/2247602349 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04000095f0 con 0x7f040c100950 2023-09-23T08:56:54.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.412+0000 7f040bfff700 1 --2- 172.21.15.82:0/2247602349 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f040c100950 0x7f040c198870 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f03fc00e970 tx=0x7f03fc00ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:54.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.413+0000 7f04097fa700 1 -- 172.21.15.82:0/2247602349 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03fc009790 con 0x7f040c100950 2023-09-23T08:56:54.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.413+0000 7f04097fa700 1 -- 172.21.15.82:0/2247602349 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f03fc00eec0 con 0x7f040c100950 2023-09-23T08:56:54.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.413+0000 7f04129ff700 1 -- 172.21.15.82:0/2247602349 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f040c19a8a0 con 0x7f040c100950 2023-09-23T08:56:54.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.413+0000 7f04097fa700 1 -- 172.21.15.82:0/2247602349 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03fc003c10 con 0x7f040c100950 2023-09-23T08:56:54.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.413+0000 7f04129ff700 1 -- 172.21.15.82:0/2247602349 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f040c1a1060 con 0x7f040c100950 2023-09-23T08:56:54.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.414+0000 7f04129ff700 1 -- 172.21.15.82:0/2247602349 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f040c192e50 con 0x7f040c100950 2023-09-23T08:56:54.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.416+0000 7f04097fa700 1 -- 172.21.15.82:0/2247602349 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 22) v1 ==== 134483+0+0 (secure 0 0 0) 0x7f03fc003db0 con 0x7f040c100950 2023-09-23T08:56:54.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.417+0000 7f04097fa700 1 --2- 172.21.15.82:0/2247602349 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f03f409fd50 0x7f03f40a2210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:54.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.418+0000 7f04097fa700 1 -- 172.21.15.82:0/2247602349 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f03fc014070 con 0x7f040c100950 2023-09-23T08:56:54.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.418+0000 7f040b7fe700 1 --2- 172.21.15.82:0/2247602349 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f03f409fd50 0x7f03f40a2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:54.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.418+0000 7f040b7fe700 1 --2- 172.21.15.82:0/2247602349 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f03f409fd50 0x7f03f40a2210 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f040000b580 tx=0x7f040001a040 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:54.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.421+0000 7f04097fa700 1 -- 172.21.15.82:0/2247602349 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f03fc095130 con 0x7f040c100950 2023-09-23T08:56:54.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.664+0000 7f04129ff700 1 -- 172.21.15.82:0/2247602349 --> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6M3h", "target": ["mon-mgr", ""]}) v1 -- 0x7f040c02cbe0 con 0x7f03f409fd50 2023-09-23T08:56:54.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.721+0000 7f04097fa700 1 -- 172.21.15.82:0/2247602349 <== mgr.15537 v2:172.21.15.82:6800/630725563 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7f040c02cbe0 con 0x7f03f409fd50 2023-09-23T08:56:54.725 INFO:teuthology.orchestra.run.smithi082.stdout:Retention added to path / 2023-09-23T08:56:54.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.723+0000 7f04129ff700 1 -- 172.21.15.82:0/2247602349 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f03f409fd50 msgr2=0x7f03f40a2210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:54.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.723+0000 7f04129ff700 1 --2- 172.21.15.82:0/2247602349 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f03f409fd50 0x7f03f40a2210 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f040000b580 tx=0x7f040001a040 comp rx=0 tx=0).stop 2023-09-23T08:56:54.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.723+0000 7f04129ff700 1 -- 172.21.15.82:0/2247602349 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f040c100950 msgr2=0x7f040c198870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:54.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.723+0000 7f04129ff700 1 --2- 172.21.15.82:0/2247602349 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f040c100950 0x7f040c198870 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f03fc00e970 tx=0x7f03fc00ec80 comp rx=0 tx=0).stop 2023-09-23T08:56:54.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.724+0000 7f04129ff700 1 -- 172.21.15.82:0/2247602349 shutdown_connections 2023-09-23T08:56:54.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.724+0000 7f04129ff700 1 --2- 172.21.15.82:0/2247602349 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f03f409fd50 0x7f03f40a2210 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:54.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.724+0000 7f04129ff700 1 --2- 172.21.15.82:0/2247602349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f040c1024e0 0x7f040c199c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:54.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.724+0000 7f04129ff700 1 --2- 172.21.15.82:0/2247602349 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f040c100950 0x7f040c198870 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:54.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.724+0000 7f04129ff700 1 --2- 172.21.15.82:0/2247602349 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f040c101b40 0x7f040c198db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:54.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.724+0000 7f04129ff700 1 -- 172.21.15.82:0/2247602349 >> 172.21.15.82:0/2247602349 conn(0x7f040c0fbea0 msgr2=0x7f040c1074e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:54.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.724+0000 7f04129ff700 1 -- 172.21.15.82:0/2247602349 shutdown_connections 2023-09-23T08:56:54.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.724+0000 7f04129ff700 1 -- 172.21.15.82:0/2247602349 wait complete. 2023-09-23T08:56:54.746 DEBUG:teuthology.orchestra.run.smithi082:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2023-09-23T08:56:54.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.948+0000 7f83e1fff700 1 -- 172.21.15.82:0/2631232212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83dc101b40 msgr2=0x7f83dc101fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:54.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.948+0000 7f83e1fff700 1 --2- 172.21.15.82:0/2631232212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83dc101b40 0x7f83dc101fa0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f83d00099c0 tx=0x7f83d0009cd0 comp rx=0 tx=0).stop 2023-09-23T08:56:54.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.948+0000 7f83e1fff700 1 -- 172.21.15.82:0/2631232212 shutdown_connections 2023-09-23T08:56:54.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.948+0000 7f83e1fff700 1 --2- 172.21.15.82:0/2631232212 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83dc1024e0 0x7f83dc108d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:54.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.948+0000 7f83e1fff700 1 --2- 172.21.15.82:0/2631232212 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83dc100950 0x7f83dc100d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:54.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.948+0000 7f83e1fff700 1 --2- 172.21.15.82:0/2631232212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83dc101b40 0x7f83dc101fa0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:54.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.948+0000 7f83e1fff700 1 -- 172.21.15.82:0/2631232212 >> 172.21.15.82:0/2631232212 conn(0x7f83dc0fbea0 msgr2=0x7f83dc0fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:54.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.948+0000 7f83e1fff700 1 -- 172.21.15.82:0/2631232212 shutdown_connections 2023-09-23T08:56:54.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.948+0000 7f83e1fff700 1 -- 172.21.15.82:0/2631232212 wait complete. 2023-09-23T08:56:54.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.949+0000 7f83e1fff700 1 Processor -- start 2023-09-23T08:56:54.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.949+0000 7f83e1fff700 1 -- start start 2023-09-23T08:56:54.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.950+0000 7f83e1fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83dc100950 0x7f83dc196670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:54.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.950+0000 7f83e1fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83dc101b40 0x7f83dc196bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:54.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.950+0000 7f83e1fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83dc1024e0 0x7f83dc197a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:54.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.950+0000 7f83e1fff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83dc198090 con 0x7f83dc101b40 2023-09-23T08:56:54.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.950+0000 7f83e1fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83dc198200 con 0x7f83dc1024e0 2023-09-23T08:56:54.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.950+0000 7f83e1fff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83dc1983c0 con 0x7f83dc100950 2023-09-23T08:56:54.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.950+0000 7f83daffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83dc101b40 0x7f83dc196bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:54.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.950+0000 7f83daffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83dc101b40 0x7f83dc196bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38888/0 (socket says 172.21.15.82:38888) 2023-09-23T08:56:54.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.950+0000 7f83daffd700 1 -- 172.21.15.82:0/1684868527 learned_addr learned my addr 172.21.15.82:0/1684868527 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:54.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.950+0000 7f83db7fe700 1 --2- 172.21.15.82:0/1684868527 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83dc100950 0x7f83dc196670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:54.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.950+0000 7f83dbfff700 1 --2- 172.21.15.82:0/1684868527 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83dc1024e0 0x7f83dc197a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:54.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.951+0000 7f83daffd700 1 -- 172.21.15.82:0/1684868527 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83dc100950 msgr2=0x7f83dc196670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:54.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.951+0000 7f83daffd700 1 --2- 172.21.15.82:0/1684868527 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83dc100950 0x7f83dc196670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:54.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.951+0000 7f83daffd700 1 -- 172.21.15.82:0/1684868527 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83dc1024e0 msgr2=0x7f83dc197a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:54.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.951+0000 7f83daffd700 1 --2- 172.21.15.82:0/1684868527 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83dc1024e0 0x7f83dc197a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:54.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.951+0000 7f83daffd700 1 -- 172.21.15.82:0/1684868527 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83d00095f0 con 0x7f83dc101b40 2023-09-23T08:56:54.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.951+0000 7f83daffd700 1 --2- 172.21.15.82:0/1684868527 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83dc101b40 0x7f83dc196bb0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f83d0000c00 tx=0x7f83d000fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:54.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.951+0000 7f83d8ff9700 1 -- 172.21.15.82:0/1684868527 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83d001d070 con 0x7f83dc101b40 2023-09-23T08:56:54.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.951+0000 7f83e1fff700 1 -- 172.21.15.82:0/1684868527 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83dc198640 con 0x7f83dc101b40 2023-09-23T08:56:54.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.951+0000 7f83d8ff9700 1 -- 172.21.15.82:0/1684868527 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f83d000bcf0 con 0x7f83dc101b40 2023-09-23T08:56:54.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.951+0000 7f83d8ff9700 1 -- 172.21.15.82:0/1684868527 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83d00173f0 con 0x7f83dc101b40 2023-09-23T08:56:54.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.951+0000 7f83e1fff700 1 -- 172.21.15.82:0/1684868527 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83dc19ee60 con 0x7f83dc101b40 2023-09-23T08:56:54.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.952+0000 7f83e1fff700 1 -- 172.21.15.82:0/1684868527 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83dc04e700 con 0x7f83dc101b40 2023-09-23T08:56:54.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.956+0000 7f83d8ff9700 1 -- 172.21.15.82:0/1684868527 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 22) v1 ==== 134483+0+0 (secure 0 0 0) 0x7f83d0022470 con 0x7f83dc101b40 2023-09-23T08:56:54.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.958+0000 7f83d8ff9700 1 --2- 172.21.15.82:0/1684868527 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f83c409fd50 0x7f83c40a2210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:54.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.958+0000 7f83d8ff9700 1 -- 172.21.15.82:0/1684868527 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f83d00cc140 con 0x7f83dc101b40 2023-09-23T08:56:54.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.958+0000 7f83db7fe700 1 --2- 172.21.15.82:0/1684868527 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f83c409fd50 0x7f83c40a2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:54.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.959+0000 7f83db7fe700 1 --2- 172.21.15.82:0/1684868527 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f83c409fd50 0x7f83c40a2210 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f83dc1019a0 tx=0x7f83cc009260 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:54.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:54.962+0000 7f83d8ff9700 1 -- 172.21.15.82:0/1684868527 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f83d0096160 con 0x7f83dc101b40 2023-09-23T08:56:55.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:55.121+0000 7f83d8ff9700 1 -- 172.21.15.82:0/1684868527 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 23) v1 ==== 134791+0+0 (secure 0 0 0) 0x7f83d0022720 con 0x7f83dc101b40 2023-09-23T08:56:55.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:55.220+0000 7f83e1fff700 1 -- 172.21.15.82:0/1684868527 --> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) v1 -- 0x7f83dc060d60 con 0x7f83c409fd50 2023-09-23T08:56:55.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:55.228+0000 7f83d8ff9700 1 -- 172.21.15.82:0/1684868527 <== mgr.15537 v2:172.21.15.82:6800/630725563 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+283 (secure 0 0 0) 0x7f83dc060d60 con 0x7f83c409fd50 2023-09-23T08:56:55.232 INFO:teuthology.orchestra.run.smithi082.stdout:{"fs": "cephfs", "subvol": null, "path": "/", "rel_path": "/", "schedule": "1M", "retention": {"h": 3, "M": 6}, "start": "2023-09-23T00:00:00", "created": "2023-09-23T08:56:54", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2023-09-23T08:56:55.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:55.230+0000 7f83e1fff700 1 -- 172.21.15.82:0/1684868527 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f83c409fd50 msgr2=0x7f83c40a2210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:55.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:55.230+0000 7f83e1fff700 1 --2- 172.21.15.82:0/1684868527 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f83c409fd50 0x7f83c40a2210 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f83dc1019a0 tx=0x7f83cc009260 comp rx=0 tx=0).stop 2023-09-23T08:56:55.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:55.230+0000 7f83e1fff700 1 -- 172.21.15.82:0/1684868527 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83dc101b40 msgr2=0x7f83dc196bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:55.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:55.230+0000 7f83e1fff700 1 --2- 172.21.15.82:0/1684868527 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83dc101b40 0x7f83dc196bb0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f83d0000c00 tx=0x7f83d000fa00 comp rx=0 tx=0).stop 2023-09-23T08:56:55.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:55.230+0000 7f83e1fff700 1 -- 172.21.15.82:0/1684868527 shutdown_connections 2023-09-23T08:56:55.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:55.230+0000 7f83e1fff700 1 --2- 172.21.15.82:0/1684868527 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f83c409fd50 0x7f83c40a2210 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:55.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:55.230+0000 7f83e1fff700 1 --2- 172.21.15.82:0/1684868527 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83dc1024e0 0x7f83dc197a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:55.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:55.230+0000 7f83e1fff700 1 --2- 172.21.15.82:0/1684868527 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83dc100950 0x7f83dc196670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:55.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:55.230+0000 7f83e1fff700 1 --2- 172.21.15.82:0/1684868527 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83dc101b40 0x7f83dc196bb0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:55.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:55.230+0000 7f83e1fff700 1 -- 172.21.15.82:0/1684868527 >> 172.21.15.82:0/1684868527 conn(0x7f83dc0fbea0 msgr2=0x7f83dc0fe160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:55.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:55.231+0000 7f83e1fff700 1 -- 172.21.15.82:0/1684868527 shutdown_connections 2023-09-23T08:56:55.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:55.231+0000 7f83e1fff700 1 -- 172.21.15.82:0/1684868527 wait complete. 2023-09-23T08:56:55.252 DEBUG:teuthology.orchestra.run.smithi082:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2023-09-23T08:56:55.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:55 smithi082 ceph-mon[97694]: [23/Sep/2023:08:56:53] ENGINE Bus STARTING 2023-09-23T08:56:55.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:55 smithi082 ceph-mon[97694]: [23/Sep/2023:08:56:54] ENGINE Serving on http://172.21.15.82:8765 2023-09-23T08:56:55.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:55 smithi082 ceph-mon[97694]: mgrmap e22: x(active, since 1.02055s), standbys: y, z 2023-09-23T08:56:55.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:55 smithi082 ceph-mon[97694]: from='client.25327 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1M", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:56:55.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:55 smithi082 ceph-mon[97694]: [23/Sep/2023:08:56:54] ENGINE Serving on https://172.21.15.82:7150 2023-09-23T08:56:55.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:55 smithi082 ceph-mon[97694]: [23/Sep/2023:08:56:54] ENGINE Bus STARTED 2023-09-23T08:56:55.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:55 smithi082 ceph-mon[97694]: pgmap v3: 97 pgs: 97 active+clean; 1.0 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:56:55.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:55 smithi161 ceph-mon[99580]: [23/Sep/2023:08:56:53] ENGINE Bus STARTING 2023-09-23T08:56:55.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:55 smithi161 ceph-mon[99580]: [23/Sep/2023:08:56:54] ENGINE Serving on http://172.21.15.82:8765 2023-09-23T08:56:55.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:55 smithi161 ceph-mon[99580]: mgrmap e22: x(active, since 1.02055s), standbys: y, z 2023-09-23T08:56:55.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:55 smithi161 ceph-mon[99580]: from='client.25327 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1M", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:56:55.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:55 smithi161 ceph-mon[99580]: [23/Sep/2023:08:56:54] ENGINE Serving on https://172.21.15.82:7150 2023-09-23T08:56:55.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:55 smithi161 ceph-mon[99580]: [23/Sep/2023:08:56:54] ENGINE Bus STARTED 2023-09-23T08:56:55.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:55 smithi161 ceph-mon[99580]: pgmap v3: 97 pgs: 97 active+clean; 1.0 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:56:55.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:55.455+0000 7f93ddfff700 1 -- 172.21.15.82:0/1861472772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93d8103d40 msgr2=0x7f93d81041a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:55.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:55.455+0000 7f93ddfff700 1 --2- 172.21.15.82:0/1861472772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93d8103d40 0x7f93d81041a0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f93c00099c0 tx=0x7f93c0009cd0 comp rx=0 tx=0).stop 2023-09-23T08:56:55.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:55.455+0000 7f93ddfff700 1 -- 172.21.15.82:0/1861472772 shutdown_connections 2023-09-23T08:56:55.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:55.455+0000 7f93ddfff700 1 --2- 172.21.15.82:0/1861472772 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f93d81046e0 0x7f93d810af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:55.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:55.455+0000 7f93ddfff700 1 --2- 172.21.15.82:0/1861472772 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93d8102b50 0x7f93d8102f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:55.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:55.455+0000 7f93ddfff700 1 --2- 172.21.15.82:0/1861472772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93d8103d40 0x7f93d81041a0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:55.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:55.455+0000 7f93ddfff700 1 -- 172.21.15.82:0/1861472772 >> 172.21.15.82:0/1861472772 conn(0x7f93d80fe0a0 msgr2=0x7f93d8100500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:55.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:55.455+0000 7f93ddfff700 1 -- 172.21.15.82:0/1861472772 shutdown_connections 2023-09-23T08:56:55.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:55.455+0000 7f93ddfff700 1 -- 172.21.15.82:0/1861472772 wait complete. 2023-09-23T08:56:55.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:55.456+0000 7f93ddfff700 1 Processor -- start 2023-09-23T08:56:55.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:55.457+0000 7f93ddfff700 1 -- start start 2023-09-23T08:56:55.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:55.457+0000 7f93ddfff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f93d8102b50 0x7f93d8198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:55.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:55.457+0000 7f93ddfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93d8103d40 0x7f93d8198ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:55.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:55.457+0000 7f93ddfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93d81046e0 0x7f93d8199d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:55.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:55.457+0000 7f93ddfff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d819a3b0 con 0x7f93d8103d40 2023-09-23T08:56:55.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:55.457+0000 7f93ddfff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d819a520 con 0x7f93d81046e0 2023-09-23T08:56:55.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:55.457+0000 7f93ddfff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d819a6e0 con 0x7f93d8102b50 2023-09-23T08:56:55.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:55.457+0000 7f93cffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93d8103d40 0x7f93d8198ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:55.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:55.457+0000 7f93cffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93d8103d40 0x7f93d8198ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38930/0 (socket says 172.21.15.82:38930) 2023-09-23T08:56:55.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:55.457+0000 7f93cffff700 1 -- 172.21.15.82:0/1860397338 learned_addr learned my addr 172.21.15.82:0/1860397338 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:56:55.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:55.458+0000 7f93d7fff700 1 --2- 172.21.15.82:0/1860397338 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93d81046e0 0x7f93d8199d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:55.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:55.458+0000 7f93d77fe700 1 --2- 172.21.15.82:0/1860397338 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f93d8102b50 0x7f93d8198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:55.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:55.458+0000 7f93cffff700 1 -- 172.21.15.82:0/1860397338 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f93d8102b50 msgr2=0x7f93d8198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:55.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:55.458+0000 7f93cffff700 1 --2- 172.21.15.82:0/1860397338 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f93d8102b50 0x7f93d8198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:55.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:55.458+0000 7f93cffff700 1 -- 172.21.15.82:0/1860397338 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93d81046e0 msgr2=0x7f93d8199d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:55.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:55.458+0000 7f93cffff700 1 --2- 172.21.15.82:0/1860397338 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93d81046e0 0x7f93d8199d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:55.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:55.458+0000 7f93cffff700 1 -- 172.21.15.82:0/1860397338 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93c00095f0 con 0x7f93d8103d40 2023-09-23T08:56:55.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:55.458+0000 7f93d7fff700 1 --2- 172.21.15.82:0/1860397338 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93d81046e0 0x7f93d8199d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T08:56:55.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:55.458+0000 7f93cffff700 1 --2- 172.21.15.82:0/1860397338 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93d8103d40 0x7f93d8198ed0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f93c0000c00 tx=0x7f93c000fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:55.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:55.458+0000 7f93d57fa700 1 -- 172.21.15.82:0/1860397338 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c001d070 con 0x7f93d8103d40 2023-09-23T08:56:55.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:55.458+0000 7f93ddfff700 1 -- 172.21.15.82:0/1860397338 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93d819a960 con 0x7f93d8103d40 2023-09-23T08:56:55.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:55.458+0000 7f93d57fa700 1 -- 172.21.15.82:0/1860397338 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f93c0022900 con 0x7f93d8103d40 2023-09-23T08:56:55.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:55.458+0000 7f93d57fa700 1 -- 172.21.15.82:0/1860397338 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c0017630 con 0x7f93d8103d40 2023-09-23T08:56:55.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:55.459+0000 7f93ddfff700 1 -- 172.21.15.82:0/1860397338 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93d81a1180 con 0x7f93d8103d40 2023-09-23T08:56:55.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:55.459+0000 7f93ddfff700 1 -- 172.21.15.82:0/1860397338 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93d810a1e0 con 0x7f93d8103d40 2023-09-23T08:56:55.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:55.462+0000 7f93d57fa700 1 -- 172.21.15.82:0/1860397338 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 23) v1 ==== 134791+0+0 (secure 0 0 0) 0x7f93c0022a70 con 0x7f93d8103d40 2023-09-23T08:56:55.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:55.463+0000 7f93d57fa700 1 --2- 172.21.15.82:0/1860397338 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f93c40a00c0 0x7f93c40a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:56:55.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:55.463+0000 7f93d57fa700 1 -- 172.21.15.82:0/1860397338 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f93c00cc890 con 0x7f93d8103d40 2023-09-23T08:56:55.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:55.463+0000 7f93d77fe700 1 --2- 172.21.15.82:0/1860397338 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f93c40a00c0 0x7f93c40a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:56:55.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:55.464+0000 7f93d77fe700 1 --2- 172.21.15.82:0/1860397338 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f93c40a00c0 0x7f93c40a2580 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f93c8006fd0 tx=0x7f93c8008040 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:56:55.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:55.465+0000 7f93d57fa700 1 -- 172.21.15.82:0/1860397338 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f93c00963d0 con 0x7f93d8103d40 2023-09-23T08:56:55.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:55 smithi135 ceph-mon[99205]: [23/Sep/2023:08:56:53] ENGINE Bus STARTING 2023-09-23T08:56:55.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:55 smithi135 ceph-mon[99205]: [23/Sep/2023:08:56:54] ENGINE Serving on http://172.21.15.82:8765 2023-09-23T08:56:55.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:55 smithi135 ceph-mon[99205]: mgrmap e22: x(active, since 1.02055s), standbys: y, z 2023-09-23T08:56:55.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:55 smithi135 ceph-mon[99205]: from='client.25327 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1M", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:56:55.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:55 smithi135 ceph-mon[99205]: [23/Sep/2023:08:56:54] ENGINE Serving on https://172.21.15.82:7150 2023-09-23T08:56:55.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:55 smithi135 ceph-mon[99205]: [23/Sep/2023:08:56:54] ENGINE Bus STARTED 2023-09-23T08:56:55.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:55 smithi135 ceph-mon[99205]: pgmap v3: 97 pgs: 97 active+clean; 1.0 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:56:55.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:55.699+0000 7f93ddfff700 1 -- 172.21.15.82:0/1860397338 --> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f93d8060d60 con 0x7f93c40a00c0 2023-09-23T08:56:55.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:55.706+0000 7f93d57fa700 1 -- 172.21.15.82:0/1860397338 <== mgr.15537 v2:172.21.15.82:6800/630725563 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+10 (secure 0 0 0) 0x7f93d8060d60 con 0x7f93c40a00c0 2023-09-23T08:56:55.710 INFO:teuthology.orchestra.run.smithi082.stdout:/ 1M 6M3h 2023-09-23T08:56:55.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:55.708+0000 7f93ddfff700 1 -- 172.21.15.82:0/1860397338 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f93c40a00c0 msgr2=0x7f93c40a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:55.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:55.708+0000 7f93ddfff700 1 --2- 172.21.15.82:0/1860397338 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f93c40a00c0 0x7f93c40a2580 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f93c8006fd0 tx=0x7f93c8008040 comp rx=0 tx=0).stop 2023-09-23T08:56:55.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:55.708+0000 7f93ddfff700 1 -- 172.21.15.82:0/1860397338 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93d8103d40 msgr2=0x7f93d8198ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:56:55.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:55.708+0000 7f93ddfff700 1 --2- 172.21.15.82:0/1860397338 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93d8103d40 0x7f93d8198ed0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f93c0000c00 tx=0x7f93c000fab0 comp rx=0 tx=0).stop 2023-09-23T08:56:55.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:55.708+0000 7f93ddfff700 1 -- 172.21.15.82:0/1860397338 shutdown_connections 2023-09-23T08:56:55.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:55.708+0000 7f93ddfff700 1 --2- 172.21.15.82:0/1860397338 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f93c40a00c0 0x7f93c40a2580 secure :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f93c8006fd0 tx=0x7f93c8008040 comp rx=0 tx=0).stop 2023-09-23T08:56:55.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:55.708+0000 7f93ddfff700 1 --2- 172.21.15.82:0/1860397338 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93d81046e0 0x7f93d8199d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:55.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:55.708+0000 7f93ddfff700 1 --2- 172.21.15.82:0/1860397338 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f93d8102b50 0x7f93d8198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:55.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:55.708+0000 7f93ddfff700 1 --2- 172.21.15.82:0/1860397338 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93d8103d40 0x7f93d8198ed0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:56:55.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:55.708+0000 7f93ddfff700 1 -- 172.21.15.82:0/1860397338 >> 172.21.15.82:0/1860397338 conn(0x7f93d80fe0a0 msgr2=0x7f93d8107320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:56:55.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:55.710+0000 7f93ddfff700 1 -- 172.21.15.82:0/1860397338 shutdown_connections 2023-09-23T08:56:55.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:56:55.710+0000 7f93ddfff700 1 -- 172.21.15.82:0/1860397338 wait complete. 2023-09-23T08:56:55.734 DEBUG:teuthology.orchestra.run.smithi082:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2023-09-23T08:56:55.819 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2023-09-23T08:56:55.843 INFO:teuthology.run_tasks:Running task exec... 2023-09-23T08:56:55.852 INFO:teuthology.task.exec:Executing custom commands... 2023-09-23T08:56:55.852 INFO:teuthology.task.exec:Running commands on role client.0 host ubuntu@smithi082.front.sepia.ceph.com 2023-09-23T08:56:55.852 DEBUG:teuthology.orchestra.run.smithi082:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -l /tmp/cephfs/ && sudo df -h /tmp/cephfs/' 2023-09-23T08:56:55.954 INFO:teuthology.orchestra.run.smithi082.stdout:total 0 2023-09-23T08:56:55.988 INFO:teuthology.orchestra.run.smithi082.stdout:Filesystem Size Used Avail Use% Mounted on 2023-09-23T08:56:55.988 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-fuse 340G 0 340G 0% /tmp/cephfs 2023-09-23T08:56:55.994 DEBUG:teuthology.orchestra.run.smithi082:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo mkdir -m 755 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres && sudo chown postgres:postgres /tmp/cephfs/postgres' 2023-09-23T08:56:56.135 DEBUG:teuthology.orchestra.run.smithi082:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- mkdir -m 700 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres/data' 2023-09-23T08:56:56.243 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:56 smithi082 ceph-mon[97694]: from='client.25369 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6M3h", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:56:56.243 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:56 smithi082 ceph-mon[97694]: pgmap v4: 97 pgs: 97 active+clean; 1.0 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:56:56.243 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:56 smithi082 ceph-mon[97694]: mgrmap e23: x(active, since 2s), standbys: y, z 2023-09-23T08:56:56.244 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:56 smithi082 ceph-mon[97694]: from='client.15600 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:56:56.244 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:56 smithi082 ceph-mon[97694]: scrub summary: idle 2023-09-23T08:56:56.247 DEBUG:teuthology.orchestra.run.smithi082:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo semanage fcontext -a -t postgresql_db_t "/tmp/cephfs/postgres(/.*)?"' 2023-09-23T08:56:56.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:56 smithi161 ceph-mon[99580]: from='client.25369 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6M3h", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:56:56.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:56 smithi161 ceph-mon[99580]: pgmap v4: 97 pgs: 97 active+clean; 1.0 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:56:56.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:56 smithi161 ceph-mon[99580]: mgrmap e23: x(active, since 2s), standbys: y, z 2023-09-23T08:56:56.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:56 smithi161 ceph-mon[99580]: from='client.15600 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:56:56.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:56 smithi161 ceph-mon[99580]: scrub summary: idle 2023-09-23T08:56:56.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:56 smithi135 ceph-mon[99205]: from='client.25369 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6M3h", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:56:56.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:56 smithi135 ceph-mon[99205]: pgmap v4: 97 pgs: 97 active+clean; 1.0 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:56:56.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:56 smithi135 ceph-mon[99205]: mgrmap e23: x(active, since 2s), standbys: y, z 2023-09-23T08:56:56.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:56 smithi135 ceph-mon[99205]: from='client.15600 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:56:56.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:56 smithi135 ceph-mon[99205]: scrub summary: idle 2023-09-23T08:56:57.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:57 smithi135 ceph-mon[99205]: from='client.15612 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:56:57.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:57 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T08:56:57.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:57 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T08:56:57.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:57 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T08:56:57.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:57 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T08:56:57.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:57 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T08:56:57.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:57 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T08:56:57.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:57 smithi082 ceph-mon[97694]: from='client.15612 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:56:57.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:57 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T08:56:57.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:57 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T08:56:57.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:57 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T08:56:57.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:57 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T08:56:57.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:57 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T08:56:57.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:57 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T08:56:57.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:57 smithi161 ceph-mon[99580]: from='client.15612 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T08:56:57.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:57 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T08:56:57.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:57 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T08:56:57.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:57 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T08:56:57.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:57 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T08:56:57.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:57 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T08:56:57.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:57 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T08:56:58.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:58 smithi135 ceph-mon[99205]: pgmap v5: 97 pgs: 97 active+clean; 1.0 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:56:58.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:58 smithi135 ceph-mon[99205]: mgrmap e24: x(active, since 4s), standbys: y, z 2023-09-23T08:56:58.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:58 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T08:56:58.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:58 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T08:56:58.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:58 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:56:58.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:58 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:56:58.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:58 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:56:58.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:58 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:56:58.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:58 smithi082 ceph-mon[97694]: pgmap v5: 97 pgs: 97 active+clean; 1.0 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:56:58.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:58 smithi082 ceph-mon[97694]: mgrmap e24: x(active, since 4s), standbys: y, z 2023-09-23T08:56:58.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:58 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T08:56:58.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:58 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T08:56:58.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:58 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:56:58.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:58 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:56:58.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:58 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:56:58.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:58 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:56:58.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:58 smithi161 ceph-mon[99580]: pgmap v5: 97 pgs: 97 active+clean; 1.0 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-23T08:56:58.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:58 smithi161 ceph-mon[99580]: mgrmap e24: x(active, since 4s), standbys: y, z 2023-09-23T08:56:58.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:58 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T08:56:58.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:58 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T08:56:58.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:58 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:56:58.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:58 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:56:58.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:58 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:56:58.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:58 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:56:59.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:59 smithi082 ceph-mon[97694]: Adjusting osd_memory_target on smithi135 to 220.9M 2023-09-23T08:56:59.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:59 smithi082 ceph-mon[97694]: Unable to set osd_memory_target on smithi135 to 231659008: error parsing value: Value '231659008' is below minimum 939524096 2023-09-23T08:56:59.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:59 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T08:56:59.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:59 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T08:56:59.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:59 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:56:59.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:59 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:56:59.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:59 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:56:59.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:59 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:56:59.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:59 smithi082 ceph-mon[97694]: Adjusting osd_memory_target on smithi161 to 220.9M 2023-09-23T08:56:59.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:59 smithi082 ceph-mon[97694]: Unable to set osd_memory_target on smithi161 to 231676211: error parsing value: Value '231676211' is below minimum 939524096 2023-09-23T08:56:59.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:59 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T08:56:59.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:59 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T08:56:59.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:59 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:56:59.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:59 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:56:59.623 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:59 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:56:59.623 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:59 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:56:59.623 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:59 smithi082 ceph-mon[97694]: Adjusting osd_memory_target on smithi082 to 220.9M 2023-09-23T08:56:59.623 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:59 smithi082 ceph-mon[97694]: Unable to set osd_memory_target on smithi082 to 231651840: error parsing value: Value '231651840' is below minimum 939524096 2023-09-23T08:56:59.623 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:59 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:56:59.623 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:59 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:56:59.623 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:59 smithi082 ceph-mon[97694]: Updating smithi082:/etc/ceph/ceph.conf 2023-09-23T08:56:59.623 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:59 smithi082 ceph-mon[97694]: Updating smithi135:/etc/ceph/ceph.conf 2023-09-23T08:56:59.623 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:56:59 smithi082 ceph-mon[97694]: Updating smithi161:/etc/ceph/ceph.conf 2023-09-23T08:56:59.657 DEBUG:teuthology.orchestra.run.smithi082:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo grep -i postgresql /etc/selinux/targeted/contexts/files/file_contexts.local' 2023-09-23T08:56:59.754 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres(/.*)? system_u:object_r:postgresql_db_t:s0 2023-09-23T08:56:59.759 DEBUG:teuthology.orchestra.run.smithi082:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo restorecon -R -v /tmp/cephfs/postgres' 2023-09-23T08:56:59.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:59 smithi135 ceph-mon[99205]: Adjusting osd_memory_target on smithi135 to 220.9M 2023-09-23T08:56:59.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:59 smithi135 ceph-mon[99205]: Unable to set osd_memory_target on smithi135 to 231659008: error parsing value: Value '231659008' is below minimum 939524096 2023-09-23T08:56:59.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:59 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T08:56:59.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:59 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T08:56:59.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:59 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:56:59.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:59 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:56:59.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:59 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:56:59.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:59 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:56:59.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:59 smithi135 ceph-mon[99205]: Adjusting osd_memory_target on smithi161 to 220.9M 2023-09-23T08:56:59.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:59 smithi135 ceph-mon[99205]: Unable to set osd_memory_target on smithi161 to 231676211: error parsing value: Value '231676211' is below minimum 939524096 2023-09-23T08:56:59.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:59 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T08:56:59.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:59 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T08:56:59.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:59 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:56:59.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:59 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:56:59.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:59 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:56:59.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:59 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:56:59.814 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:59 smithi135 ceph-mon[99205]: Adjusting osd_memory_target on smithi082 to 220.9M 2023-09-23T08:56:59.814 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:59 smithi135 ceph-mon[99205]: Unable to set osd_memory_target on smithi082 to 231651840: error parsing value: Value '231651840' is below minimum 939524096 2023-09-23T08:56:59.814 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:59 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:56:59.814 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:59 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:56:59.814 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:59 smithi135 ceph-mon[99205]: Updating smithi082:/etc/ceph/ceph.conf 2023-09-23T08:56:59.814 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:59 smithi135 ceph-mon[99205]: Updating smithi135:/etc/ceph/ceph.conf 2023-09-23T08:56:59.814 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:56:59 smithi135 ceph-mon[99205]: Updating smithi161:/etc/ceph/ceph.conf 2023-09-23T08:56:59.867 DEBUG:teuthology.orchestra.run.smithi082:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2023-09-23T08:56:59.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:59 smithi161 ceph-mon[99580]: Adjusting osd_memory_target on smithi135 to 220.9M 2023-09-23T08:56:59.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:59 smithi161 ceph-mon[99580]: Unable to set osd_memory_target on smithi135 to 231659008: error parsing value: Value '231659008' is below minimum 939524096 2023-09-23T08:56:59.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:59 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T08:56:59.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:59 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T08:56:59.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:59 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:56:59.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:59 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:56:59.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:59 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:56:59.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:59 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:56:59.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:59 smithi161 ceph-mon[99580]: Adjusting osd_memory_target on smithi161 to 220.9M 2023-09-23T08:56:59.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:59 smithi161 ceph-mon[99580]: Unable to set osd_memory_target on smithi161 to 231676211: error parsing value: Value '231676211' is below minimum 939524096 2023-09-23T08:56:59.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:59 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T08:56:59.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:59 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T08:56:59.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:59 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:56:59.900 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:59 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:56:59.900 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:59 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:56:59.900 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:59 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-09-23T08:56:59.900 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:59 smithi161 ceph-mon[99580]: Adjusting osd_memory_target on smithi082 to 220.9M 2023-09-23T08:56:59.900 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:59 smithi161 ceph-mon[99580]: Unable to set osd_memory_target on smithi082 to 231651840: error parsing value: Value '231651840' is below minimum 939524096 2023-09-23T08:56:59.900 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:59 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:56:59.900 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:59 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:56:59.900 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:59 smithi161 ceph-mon[99580]: Updating smithi082:/etc/ceph/ceph.conf 2023-09-23T08:56:59.900 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:59 smithi161 ceph-mon[99580]: Updating smithi135:/etc/ceph/ceph.conf 2023-09-23T08:56:59.900 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:56:59 smithi161 ceph-mon[99580]: Updating smithi161:/etc/ceph/ceph.conf 2023-09-23T08:56:59.973 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/: 2023-09-23T08:56:59.973 INFO:teuthology.orchestra.run.smithi082.stdout:total 2 2023-09-23T08:56:59.973 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:56 . 2023-09-23T08:56:59.974 INFO:teuthology.orchestra.run.smithi082.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:56 .. 2023-09-23T08:56:59.974 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:56 data 2023-09-23T08:56:59.974 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:56:59.974 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data: 2023-09-23T08:56:59.974 INFO:teuthology.orchestra.run.smithi082.stdout:total 1 2023-09-23T08:56:59.974 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:56 . 2023-09-23T08:56:59.974 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:56 .. 2023-09-23T08:56:59.979 DEBUG:teuthology.orchestra.run.smithi082:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo mkdir -p /etc/systemd/system/postgresql.service.d/ && printf '"'"'[Service]\nEnvironment=PGDATA=/tmp/cephfs/postgres/data\nEnvironment=PGLOG=/tmp/cephfs/postgres/pgstartup.log\n'"'"' | sudo tee /etc/systemd/system/postgresql.service.d/env.conf' 2023-09-23T08:57:00.106 INFO:teuthology.orchestra.run.smithi082.stdout:[Service] 2023-09-23T08:57:00.107 INFO:teuthology.orchestra.run.smithi082.stdout:Environment=PGDATA=/tmp/cephfs/postgres/data 2023-09-23T08:57:00.107 INFO:teuthology.orchestra.run.smithi082.stdout:Environment=PGLOG=/tmp/cephfs/postgres/pgstartup.log 2023-09-23T08:57:00.112 DEBUG:teuthology.orchestra.run.smithi082:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- postgresql-setup --initdb' 2023-09-23T08:57:00.312 INFO:teuthology.orchestra.run.smithi082.stderr: * Initializing database in '/tmp/cephfs/postgres/data' 2023-09-23T08:57:00.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:57:00 smithi082 ceph-mon[97694]: pgmap v6: 97 pgs: 97 active+clean; 1.0 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 90 KiB/s wr, 56 op/s 2023-09-23T08:57:00.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:57:00 smithi082 ceph-mon[97694]: Updating smithi082:/var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/config/ceph.conf 2023-09-23T08:57:00.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:57:00 smithi082 ceph-mon[97694]: Updating smithi161:/var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/config/ceph.conf 2023-09-23T08:57:00.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:57:00 smithi082 ceph-mon[97694]: Updating smithi135:/var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/config/ceph.conf 2023-09-23T08:57:00.872 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:57:00 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:57:00.735+0000 7f487a1c3700 -1 client.0 error registering admin socket command: (17) File exists 2023-09-23T08:57:00.872 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:57:00 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:57:00.735+0000 7f487a1c3700 -1 client.0 error registering admin socket command: (17) File exists 2023-09-23T08:57:00.872 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:57:00 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:57:00.735+0000 7f487a1c3700 -1 client.0 error registering admin socket command: (17) File exists 2023-09-23T08:57:00.872 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:57:00 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:57:00.735+0000 7f487a1c3700 -1 client.0 error registering admin socket command: (17) File exists 2023-09-23T08:57:00.872 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 08:57:00 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T08:57:00.735+0000 7f487a1c3700 -1 client.0 error registering admin socket command: (17) File exists 2023-09-23T08:57:00.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:57:00 smithi161 ceph-mon[99580]: pgmap v6: 97 pgs: 97 active+clean; 1.0 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 90 KiB/s wr, 56 op/s 2023-09-23T08:57:00.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:57:00 smithi161 ceph-mon[99580]: Updating smithi082:/var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/config/ceph.conf 2023-09-23T08:57:00.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:57:00 smithi161 ceph-mon[99580]: Updating smithi161:/var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/config/ceph.conf 2023-09-23T08:57:00.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:57:00 smithi161 ceph-mon[99580]: Updating smithi135:/var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/config/ceph.conf 2023-09-23T08:57:01.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:57:00 smithi135 ceph-mon[99205]: pgmap v6: 97 pgs: 97 active+clean; 1.0 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 90 KiB/s wr, 56 op/s 2023-09-23T08:57:01.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:57:00 smithi135 ceph-mon[99205]: Updating smithi082:/var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/config/ceph.conf 2023-09-23T08:57:01.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:57:00 smithi135 ceph-mon[99205]: Updating smithi161:/var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/config/ceph.conf 2023-09-23T08:57:01.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:57:00 smithi135 ceph-mon[99205]: Updating smithi135:/var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/config/ceph.conf 2023-09-23T08:57:01.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:57:01 smithi082 ceph-mon[97694]: Updating smithi082:/etc/ceph/ceph.client.admin.keyring 2023-09-23T08:57:01.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:57:01 smithi082 ceph-mon[97694]: Updating smithi161:/etc/ceph/ceph.client.admin.keyring 2023-09-23T08:57:01.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:57:01 smithi082 ceph-mon[97694]: Updating smithi135:/etc/ceph/ceph.client.admin.keyring 2023-09-23T08:57:01.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:57:01 smithi082 ceph-mon[97694]: Updating smithi135:/var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/config/ceph.client.admin.keyring 2023-09-23T08:57:01.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:57:01 smithi082 ceph-mon[97694]: Updating smithi082:/var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/config/ceph.client.admin.keyring 2023-09-23T08:57:01.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:57:01 smithi082 ceph-mon[97694]: Updating smithi161:/var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/config/ceph.client.admin.keyring 2023-09-23T08:57:01.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:57:01 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T08:57:01.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:57:01 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T08:57:01.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:57:01 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T08:57:01.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:57:01 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T08:57:01.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:57:01 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T08:57:01.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:57:01 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T08:57:01.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:57:01 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T08:57:01.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:57:01 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:57:01.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:57:01 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:57:01.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:57:01 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:57:01.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:57:01 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T08:57:01.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:57:01 smithi161 ceph-mon[99580]: Updating smithi082:/etc/ceph/ceph.client.admin.keyring 2023-09-23T08:57:01.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:57:01 smithi161 ceph-mon[99580]: Updating smithi161:/etc/ceph/ceph.client.admin.keyring 2023-09-23T08:57:01.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:57:01 smithi161 ceph-mon[99580]: Updating smithi135:/etc/ceph/ceph.client.admin.keyring 2023-09-23T08:57:01.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:57:01 smithi161 ceph-mon[99580]: Updating smithi135:/var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/config/ceph.client.admin.keyring 2023-09-23T08:57:01.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:57:01 smithi161 ceph-mon[99580]: Updating smithi082:/var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/config/ceph.client.admin.keyring 2023-09-23T08:57:01.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:57:01 smithi161 ceph-mon[99580]: Updating smithi161:/var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/config/ceph.client.admin.keyring 2023-09-23T08:57:01.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:57:01 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T08:57:01.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:57:01 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T08:57:01.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:57:01 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T08:57:01.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:57:01 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T08:57:01.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:57:01 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T08:57:01.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:57:01 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T08:57:01.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:57:01 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T08:57:01.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:57:01 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:57:01.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:57:01 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:57:01.900 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:57:01 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:57:01.900 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:57:01 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T08:57:02.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:57:01 smithi135 ceph-mon[99205]: Updating smithi082:/etc/ceph/ceph.client.admin.keyring 2023-09-23T08:57:02.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:57:01 smithi135 ceph-mon[99205]: Updating smithi161:/etc/ceph/ceph.client.admin.keyring 2023-09-23T08:57:02.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:57:01 smithi135 ceph-mon[99205]: Updating smithi135:/etc/ceph/ceph.client.admin.keyring 2023-09-23T08:57:02.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:57:01 smithi135 ceph-mon[99205]: Updating smithi135:/var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/config/ceph.client.admin.keyring 2023-09-23T08:57:02.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:57:01 smithi135 ceph-mon[99205]: Updating smithi082:/var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/config/ceph.client.admin.keyring 2023-09-23T08:57:02.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:57:01 smithi135 ceph-mon[99205]: Updating smithi161:/var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/config/ceph.client.admin.keyring 2023-09-23T08:57:02.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:57:01 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T08:57:02.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:57:01 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T08:57:02.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:57:01 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T08:57:02.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:57:01 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T08:57:02.064 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:57:01 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T08:57:02.064 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:57:01 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T08:57:02.064 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:57:01 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T08:57:02.064 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:57:01 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:57:02.064 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:57:01 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:57:02.064 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:57:01 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:57:02.064 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:57:01 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T08:57:02.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:57:02 smithi082 ceph-mon[97694]: pgmap v7: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 132 KiB/s wr, 71 op/s 2023-09-23T08:57:02.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:57:02 smithi082 ceph-mon[97694]: mgrmap e25: x(active, since 8s), standbys: y, z 2023-09-23T08:57:02.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:57:02 smithi161 ceph-mon[99580]: pgmap v7: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 132 KiB/s wr, 71 op/s 2023-09-23T08:57:02.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:57:02 smithi161 ceph-mon[99580]: mgrmap e25: x(active, since 8s), standbys: y, z 2023-09-23T08:57:03.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:57:02 smithi135 ceph-mon[99205]: pgmap v7: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 132 KiB/s wr, 71 op/s 2023-09-23T08:57:03.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:57:02 smithi135 ceph-mon[99205]: mgrmap e25: x(active, since 8s), standbys: y, z 2023-09-23T08:57:04.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:57:04 smithi082 ceph-mon[97694]: pgmap v8: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 103 KiB/s wr, 55 op/s 2023-09-23T08:57:04.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:57:04 smithi161 ceph-mon[99580]: pgmap v8: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 103 KiB/s wr, 55 op/s 2023-09-23T08:57:05.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:57:04 smithi135 ceph-mon[99205]: pgmap v8: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 103 KiB/s wr, 55 op/s 2023-09-23T08:57:06.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:57:06 smithi082 ceph-mon[97694]: pgmap v9: 97 pgs: 97 active+clean; 23 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 2.2 MiB/s wr, 91 op/s 2023-09-23T08:57:06.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:57:06 smithi161 ceph-mon[99580]: pgmap v9: 97 pgs: 97 active+clean; 23 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 2.2 MiB/s wr, 91 op/s 2023-09-23T08:57:07.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:57:06 smithi135 ceph-mon[99205]: pgmap v9: 97 pgs: 97 active+clean; 23 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 2.2 MiB/s wr, 91 op/s 2023-09-23T08:57:08.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:57:08 smithi082 ceph-mon[97694]: pgmap v10: 97 pgs: 97 active+clean; 23 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 2.0 MiB/s wr, 83 op/s 2023-09-23T08:57:08.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:57:08 smithi161 ceph-mon[99580]: pgmap v10: 97 pgs: 97 active+clean; 23 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 2.0 MiB/s wr, 83 op/s 2023-09-23T08:57:09.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:57:08 smithi135 ceph-mon[99205]: pgmap v10: 97 pgs: 97 active+clean; 23 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 2.0 MiB/s wr, 83 op/s 2023-09-23T08:57:10.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:57:10 smithi082 ceph-mon[97694]: pgmap v11: 97 pgs: 97 active+clean; 24 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 2.2 MiB/s wr, 92 op/s 2023-09-23T08:57:10.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:57:10 smithi161 ceph-mon[99580]: pgmap v11: 97 pgs: 97 active+clean; 24 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 2.2 MiB/s wr, 92 op/s 2023-09-23T08:57:11.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:57:10 smithi135 ceph-mon[99205]: pgmap v11: 97 pgs: 97 active+clean; 24 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 2.2 MiB/s wr, 92 op/s 2023-09-23T08:57:12.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:57:12 smithi082 ceph-mon[97694]: pgmap v12: 97 pgs: 97 active+clean; 30 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 3.2 MiB/s wr, 109 op/s 2023-09-23T08:57:12.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:57:12 smithi161 ceph-mon[99580]: pgmap v12: 97 pgs: 97 active+clean; 30 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 3.2 MiB/s wr, 109 op/s 2023-09-23T08:57:13.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:57:12 smithi135 ceph-mon[99205]: pgmap v12: 97 pgs: 97 active+clean; 30 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 3.2 MiB/s wr, 109 op/s 2023-09-23T08:57:14.497 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T08:57:14.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.706+0000 7f4e34dff700 1 -- 172.21.15.82:0/1423783279 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e301068a0 msgr2=0x7f4e30106c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:14.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.706+0000 7f4e34dff700 1 --2- 172.21.15.82:0/1423783279 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e301068a0 0x7f4e30106c80 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f4e20009990 tx=0x7f4e20009ca0 comp rx=0 tx=0).stop 2023-09-23T08:57:14.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.706+0000 7f4e34dff700 1 -- 172.21.15.82:0/1423783279 shutdown_connections 2023-09-23T08:57:14.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.706+0000 7f4e34dff700 1 --2- 172.21.15.82:0/1423783279 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e30101250 0x7f4e3010d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:14.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.706+0000 7f4e34dff700 1 --2- 172.21.15.82:0/1423783279 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e301068a0 0x7f4e30106c80 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:14.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.706+0000 7f4e34dff700 1 --2- 172.21.15.82:0/1423783279 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e30100890 0x7f4e30100d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:14.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.706+0000 7f4e34dff700 1 -- 172.21.15.82:0/1423783279 >> 172.21.15.82:0/1423783279 conn(0x7f4e300fc380 msgr2=0x7f4e300fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:14.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.706+0000 7f4e34dff700 1 -- 172.21.15.82:0/1423783279 shutdown_connections 2023-09-23T08:57:14.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.706+0000 7f4e34dff700 1 -- 172.21.15.82:0/1423783279 wait complete. 2023-09-23T08:57:14.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.707+0000 7f4e34dff700 1 Processor -- start 2023-09-23T08:57:14.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.707+0000 7f4e34dff700 1 -- start start 2023-09-23T08:57:14.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.708+0000 7f4e34dff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e30100890 0x7f4e30072c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:14.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.708+0000 7f4e34dff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e30101250 0x7f4e30073160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:14.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.708+0000 7f4e34dff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e301068a0 0x7f4e301a4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:14.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.708+0000 7f4e34dff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e30073990 con 0x7f4e301068a0 2023-09-23T08:57:14.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.708+0000 7f4e34dff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e301a4fc0 con 0x7f4e30101250 2023-09-23T08:57:14.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.708+0000 7f4e34dff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e301a5100 con 0x7f4e30100890 2023-09-23T08:57:14.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.708+0000 7f4e2ed9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e301068a0 0x7f4e301a4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:14.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.708+0000 7f4e2ed9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e301068a0 0x7f4e301a4a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51620/0 (socket says 172.21.15.82:51620) 2023-09-23T08:57:14.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.708+0000 7f4e2ed9d700 1 -- 172.21.15.82:0/3765580889 learned_addr learned my addr 172.21.15.82:0/3765580889 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:57:14.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.708+0000 7f4e2dd9b700 1 --2- 172.21.15.82:0/3765580889 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e30101250 0x7f4e30073160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:14.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.708+0000 7f4e2e59c700 1 --2- 172.21.15.82:0/3765580889 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e30100890 0x7f4e30072c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:14.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.708+0000 7f4e2ed9d700 1 -- 172.21.15.82:0/3765580889 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e30100890 msgr2=0x7f4e30072c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:14.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.708+0000 7f4e2ed9d700 1 --2- 172.21.15.82:0/3765580889 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e30100890 0x7f4e30072c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:14.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.708+0000 7f4e2ed9d700 1 -- 172.21.15.82:0/3765580889 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e30101250 msgr2=0x7f4e30073160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:14.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.708+0000 7f4e2ed9d700 1 --2- 172.21.15.82:0/3765580889 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e30101250 0x7f4e30073160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:14.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.708+0000 7f4e2ed9d700 1 -- 172.21.15.82:0/3765580889 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e200095f0 con 0x7f4e301068a0 2023-09-23T08:57:14.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.709+0000 7f4e2ed9d700 1 --2- 172.21.15.82:0/3765580889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e301068a0 0x7f4e301a4a80 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f4e28007ee0 tx=0x7f4e2800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:14.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.709+0000 7f4e1f7fe700 1 -- 172.21.15.82:0/3765580889 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e28017070 con 0x7f4e301068a0 2023-09-23T08:57:14.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.709+0000 7f4e1f7fe700 1 -- 172.21.15.82:0/3765580889 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4e2800f040 con 0x7f4e301068a0 2023-09-23T08:57:14.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.709+0000 7f4e34dff700 1 -- 172.21.15.82:0/3765580889 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e301a5360 con 0x7f4e301068a0 2023-09-23T08:57:14.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.709+0000 7f4e1f7fe700 1 -- 172.21.15.82:0/3765580889 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e28005710 con 0x7f4e301068a0 2023-09-23T08:57:14.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.709+0000 7f4e34dff700 1 -- 172.21.15.82:0/3765580889 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e301a5840 con 0x7f4e301068a0 2023-09-23T08:57:14.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.712+0000 7f4e1f7fe700 1 -- 172.21.15.82:0/3765580889 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) v1 ==== 134904+0+0 (secure 0 0 0) 0x7f4e28005870 con 0x7f4e301068a0 2023-09-23T08:57:14.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.713+0000 7f4e487dcb80 1 Processor -- start 2023-09-23T08:57:14.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.714+0000 7f4e487dcb80 1 -- start start 2023-09-23T08:57:14.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.714+0000 7f4e1f7fe700 1 --2- 172.21.15.82:0/3765580889 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f4e180a0260 0x7f4e180a2720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:14.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.714+0000 7f4e1f7fe700 1 -- 172.21.15.82:0/3765580889 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f4e280cafe0 con 0x7f4e301068a0 2023-09-23T08:57:14.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.714+0000 7f4e2dd9b700 1 --2- 172.21.15.82:0/3765580889 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f4e180a0260 0x7f4e180a2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:14.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.714+0000 7f4e487dcb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bf326dd380 0x55bf326dd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:14.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.714+0000 7f4e487dcb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55bf326ddca0 0x55bf326d7700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:14.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.714+0000 7f4e487dcb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf326d7c40 0x55bf326d80a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:14.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.714+0000 7f4e487dcb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf3263f7b0 con 0x55bf326d7c40 2023-09-23T08:57:14.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.714+0000 7f4e487dcb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf32630780 con 0x55bf326dd380 2023-09-23T08:57:14.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.714+0000 7f4e487dcb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf3262e0a0 con 0x55bf326ddca0 2023-09-23T08:57:14.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.715+0000 7f4e2ed9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf326d7c40 0x55bf326d80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:14.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.715+0000 7f4e2ed9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf326d7c40 0x55bf326d80a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51630/0 (socket says 172.21.15.82:51630) 2023-09-23T08:57:14.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.715+0000 7f4e2ed9d700 1 -- 172.21.15.82:0/3231934170 learned_addr learned my addr 172.21.15.82:0/3231934170 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:57:14.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.715+0000 7f4e2e59c700 1 --2- 172.21.15.82:0/3231934170 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bf326dd380 0x55bf326dd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:14.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.715+0000 7f4e2dd9b700 1 --2- 172.21.15.82:0/3231934170 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55bf326ddca0 0x55bf326d7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:14.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.715+0000 7f4e2ed9d700 1 -- 172.21.15.82:0/3231934170 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55bf326ddca0 msgr2=0x55bf326d7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:14.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.715+0000 7f4e2ed9d700 1 --2- 172.21.15.82:0/3231934170 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55bf326ddca0 0x55bf326d7700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:14.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.715+0000 7f4e2ed9d700 1 -- 172.21.15.82:0/3231934170 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bf326dd380 msgr2=0x55bf326dd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:14.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.715+0000 7f4e2ed9d700 1 --2- 172.21.15.82:0/3231934170 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bf326dd380 0x55bf326dd760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:14.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.715+0000 7f4e2ed9d700 1 -- 172.21.15.82:0/3231934170 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bf324a9630 con 0x55bf326d7c40 2023-09-23T08:57:14.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.715+0000 7f4e2dd9b700 1 --2- 172.21.15.82:0/3765580889 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f4e180a0260 0x7f4e180a2720 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f4e30074410 tx=0x7f4e24007f80 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:14.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.715+0000 7f4e2ed9d700 1 --2- 172.21.15.82:0/3231934170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf326d7c40 0x55bf326d80a0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f4e2800d7b0 tx=0x7f4e28094190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a3618a50241544c server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:14.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.715+0000 7f4e1cff9700 1 -- 172.21.15.82:0/3231934170 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e28098b90 con 0x55bf326d7c40 2023-09-23T08:57:14.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.715+0000 7f4e1cff9700 1 -- 172.21.15.82:0/3231934170 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4e28098490 con 0x55bf326d7c40 2023-09-23T08:57:14.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.715+0000 7f4e1cff9700 1 -- 172.21.15.82:0/3231934170 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e28098910 con 0x55bf326d7c40 2023-09-23T08:57:14.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.716+0000 7f4e487dcb80 1 -- 172.21.15.82:0/3231934170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf326d7c40 msgr2=0x55bf326d80a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:14.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.716+0000 7f4e487dcb80 1 --2- 172.21.15.82:0/3231934170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf326d7c40 0x55bf326d80a0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f4e2800d7b0 tx=0x7f4e28094190 comp rx=0 tx=0).stop 2023-09-23T08:57:14.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.716+0000 7f4e487dcb80 1 -- 172.21.15.82:0/3231934170 shutdown_connections 2023-09-23T08:57:14.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.716+0000 7f4e487dcb80 1 --2- 172.21.15.82:0/3231934170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf326d7c40 0x55bf326d80a0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:14.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.716+0000 7f4e487dcb80 1 --2- 172.21.15.82:0/3231934170 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bf326dd380 0x55bf326dd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:14.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.716+0000 7f4e487dcb80 1 --2- 172.21.15.82:0/3231934170 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55bf326ddca0 0x55bf326d7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:14.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.716+0000 7f4e487dcb80 1 -- 172.21.15.82:0/3231934170 >> 172.21.15.82:0/3231934170 conn(0x55bf3264c0e0 msgr2=0x55bf326d2410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:14.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.716+0000 7f4e487dcb80 1 -- 172.21.15.82:0/3231934170 shutdown_connections 2023-09-23T08:57:14.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.716+0000 7f4e487dcb80 1 -- 172.21.15.82:0/3231934170 wait complete. 2023-09-23T08:57:14.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.717+0000 7f4e487dcb80 1 -- start start 2023-09-23T08:57:14.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.717+0000 7f4e487dcb80 1 Processor -- start 2023-09-23T08:57:14.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.717+0000 7f4e487dcb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55bf326d7c40 0x55bf326e3c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:14.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.717+0000 7f4e487dcb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf326dd380 0x55bf326e0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:14.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.717+0000 7f4e487dcb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bf326ddca0 0x55bf326e16a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:14.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.717+0000 7f4e487dcb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf32629990 con 0x55bf326dd380 2023-09-23T08:57:14.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.717+0000 7f4e487dcb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf325c7bb0 con 0x55bf326ddca0 2023-09-23T08:57:14.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.717+0000 7f4e487dcb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf325c78b0 con 0x55bf326d7c40 2023-09-23T08:57:14.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.718+0000 7f4e487dcb80 10 client.0 _ll_register_callbacks cb 0x55bf32511a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T08:57:14.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.718+0000 7f4e2dd9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf326dd380 0x55bf326e0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:14.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.718+0000 7f4e2dd9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf326dd380 0x55bf326e0f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51644/0 (socket says 172.21.15.82:51644) 2023-09-23T08:57:14.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.718+0000 7f4e2dd9b700 1 -- 172.21.15.82:0/3225321713 learned_addr learned my addr 172.21.15.82:0/3225321713 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:57:14.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.718+0000 7f4e2ed9d700 1 --2- 172.21.15.82:0/3225321713 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bf326ddca0 0x55bf326e16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:14.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.718+0000 7f4e2e59c700 1 --2- 172.21.15.82:0/3225321713 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55bf326d7c40 0x55bf326e3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:14.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.718+0000 7f4e2dd9b700 1 -- 172.21.15.82:0/3225321713 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55bf326d7c40 msgr2=0x55bf326e3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:14.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.718+0000 7f4e2dd9b700 1 --2- 172.21.15.82:0/3225321713 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55bf326d7c40 0x55bf326e3c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:14.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.718+0000 7f4e2dd9b700 1 -- 172.21.15.82:0/3225321713 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bf326ddca0 msgr2=0x55bf326e16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:14.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.718+0000 7f4e2dd9b700 1 --2- 172.21.15.82:0/3225321713 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bf326ddca0 0x55bf326e16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:14.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.718+0000 7f4e2dd9b700 1 -- 172.21.15.82:0/3225321713 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e301a5840 con 0x55bf326dd380 2023-09-23T08:57:14.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.718+0000 7f4e2ed9d700 1 --2- 172.21.15.82:0/3225321713 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bf326ddca0 0x55bf326e16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T08:57:14.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.719+0000 7f4e2dd9b700 1 --2- 172.21.15.82:0/3225321713 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf326dd380 0x55bf326e0f60 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f4e24011440 tx=0x7f4e240047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d86254d95ddb41d1 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:14.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.719+0000 7f4e15ffb700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T08:57:14.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.719+0000 7f4e15ffb700 1 -- 172.21.15.82:0/3225321713 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e24004050 con 0x55bf326dd380 2023-09-23T08:57:14.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.719+0000 7f4e487dcb80 1 -- 172.21.15.82:0/3225321713 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bf326a71c0 con 0x55bf326dd380 2023-09-23T08:57:14.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.719+0000 7f4e15ffb700 1 -- 172.21.15.82:0/3225321713 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f4e24019070 con 0x55bf326dd380 2023-09-23T08:57:14.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.719+0000 7f4e15ffb700 1 -- 172.21.15.82:0/3225321713 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4e240041b0 con 0x55bf326dd380 2023-09-23T08:57:14.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.719+0000 7f4e487dcb80 10 client.15630 fetch_fsmap learned FSMap version 26 2023-09-23T08:57:14.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.719+0000 7f4e487dcb80 1 -- 172.21.15.82:0/3225321713 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55bf32455de0 con 0x55bf326dd380 2023-09-23T08:57:14.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.719+0000 7f4e15ffb700 1 -- 172.21.15.82:0/3225321713 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55bf326a71c0 con 0x55bf326dd380 2023-09-23T08:57:14.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.720+0000 7f4e15ffb700 1 -- 172.21.15.82:0/3225321713 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f4e2401c070 con 0x55bf326dd380 2023-09-23T08:57:14.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.720+0000 7f4e487dcb80 10 client.15630 fetch_fsmap finished waiting for FSMap version 26 2023-09-23T08:57:14.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.720+0000 7f4e487dcb80 10 client.15630 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T08:57:14.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.720+0000 7f4e487dcb80 20 client.15630 populate_metadata read hostname 'smithi082' 2023-09-23T08:57:14.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.720+0000 7f4e487dcb80 1 --2- 172.21.15.82:0/3225321713 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55bf326f1860 0x55bf326f3c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:14.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.720+0000 7f4e487dcb80 4 client.15630 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T08:57:14.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.720+0000 7f4e487dcb80 1 -- 172.21.15.82:0/3225321713 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bf325cfba0 con 0x55bf326f1860 2023-09-23T08:57:14.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.720+0000 7f4e2e59c700 1 --2- 172.21.15.82:0/3225321713 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55bf326f1860 0x55bf326f3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:14.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.721+0000 7f4e2e59c700 1 --2- 172.21.15.82:0/3225321713 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55bf326f1860 0x55bf326f3c80 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf218650876f69b9 server_cookie=9329437f2779e234 in_seq=0 out_seq=0 2023-09-23T08:57:14.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.721+0000 7f4e15ffb700 10 client.15630 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T08:57:14.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.721+0000 7f4e15ffb700 1 -- 172.21.15.82:0/3225321713 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55bf325cfba0 con 0x55bf326f1860 2023-09-23T08:57:14.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.721+0000 7f4e15ffb700 10 client.15630 handle_command_reply: tid=0 2023-09-23T08:57:14.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.722+0000 7f4e487dcb80 1 client.15630 shutdown 2023-09-23T08:57:14.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.722+0000 7f4e487dcb80 1 -- 172.21.15.82:0/3225321713 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf326dd380 msgr2=0x55bf326e0f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:14.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.722+0000 7f4e487dcb80 1 --2- 172.21.15.82:0/3225321713 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf326dd380 0x55bf326e0f60 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f4e24011440 tx=0x7f4e240047c0 comp rx=0 tx=0).stop 2023-09-23T08:57:14.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.722+0000 7f4e487dcb80 1 -- 172.21.15.82:0/3225321713 shutdown_connections 2023-09-23T08:57:14.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.722+0000 7f4e487dcb80 1 --2- 172.21.15.82:0/3225321713 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bf326ddca0 0x55bf326e16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:14.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.722+0000 7f4e487dcb80 1 --2- 172.21.15.82:0/3225321713 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55bf326d7c40 0x55bf326e3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:14.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.722+0000 7f4e487dcb80 1 --2- 172.21.15.82:0/3225321713 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55bf326f1860 0x55bf326f3c80 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:14.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.722+0000 7f4e487dcb80 1 --2- 172.21.15.82:0/3225321713 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf326dd380 0x55bf326e0f60 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:14.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.722+0000 7f4e15ffb700 0 client.15630 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T08:57:14.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.722+0000 7f4e487dcb80 1 -- 172.21.15.82:0/3225321713 >> 172.21.15.82:0/3225321713 conn(0x55bf3264c0e0 msgr2=0x55bf326ccb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:14.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.722+0000 7f4e487dcb80 1 -- 172.21.15.82:0/3225321713 shutdown_connections 2023-09-23T08:57:14.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.722+0000 7f4e487dcb80 1 -- 172.21.15.82:0/3225321713 wait complete. 2023-09-23T08:57:14.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.722+0000 7f4e487dcb80 20 client.15630 trim_cache size 0 max 16384 2023-09-23T08:57:14.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.739+0000 7f4e487dcb80 1 Processor -- start 2023-09-23T08:57:14.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.739+0000 7f4e487dcb80 1 -- start start 2023-09-23T08:57:14.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.740+0000 7f4e487dcb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bf326d7c40 0x55bf326d7700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:14.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.740+0000 7f4e487dcb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55bf326dd380 0x55bf326e0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:14.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.740+0000 7f4e487dcb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf326ddca0 0x55bf326e0c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:14.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.740+0000 7f4e487dcb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf324ab920 con 0x55bf326ddca0 2023-09-23T08:57:14.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.740+0000 7f4e487dcb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf326e2070 con 0x55bf326d7c40 2023-09-23T08:57:14.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.740+0000 7f4e487dcb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf326cec80 con 0x55bf326dd380 2023-09-23T08:57:14.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.740+0000 7f4e2ed9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf326ddca0 0x55bf326e0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:14.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.740+0000 7f4e2ed9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf326ddca0 0x55bf326e0c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51658/0 (socket says 172.21.15.82:51658) 2023-09-23T08:57:14.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.740+0000 7f4e2ed9d700 1 -- 172.21.15.82:0/3961601026 learned_addr learned my addr 172.21.15.82:0/3961601026 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:57:14.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.740+0000 7f4e2e59c700 1 --2- 172.21.15.82:0/3961601026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bf326d7c40 0x55bf326d7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:14.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.740+0000 7f4e2dd9b700 1 --2- 172.21.15.82:0/3961601026 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55bf326dd380 0x55bf326e0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:14.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.740+0000 7f4e2ed9d700 1 -- 172.21.15.82:0/3961601026 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55bf326dd380 msgr2=0x55bf326e0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:14.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.740+0000 7f4e2ed9d700 1 --2- 172.21.15.82:0/3961601026 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55bf326dd380 0x55bf326e0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:14.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.740+0000 7f4e2ed9d700 1 -- 172.21.15.82:0/3961601026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bf326d7c40 msgr2=0x55bf326d7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:14.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.740+0000 7f4e2ed9d700 1 --2- 172.21.15.82:0/3961601026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bf326d7c40 0x55bf326d7700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:14.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.740+0000 7f4e2ed9d700 1 -- 172.21.15.82:0/3961601026 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bf3243ec60 con 0x55bf326ddca0 2023-09-23T08:57:14.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.741+0000 7f4e2ed9d700 1 --2- 172.21.15.82:0/3961601026 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf326ddca0 0x55bf326e0c60 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f4e28098420 tx=0x7f4e2809c170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69b23cb74298e68f server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:14.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.741+0000 7f4e1d7fa700 1 -- 172.21.15.82:0/3961601026 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e28098b90 con 0x55bf326ddca0 2023-09-23T08:57:14.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.741+0000 7f4e1d7fa700 1 -- 172.21.15.82:0/3961601026 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4e280b6270 con 0x55bf326ddca0 2023-09-23T08:57:14.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.741+0000 7f4e1d7fa700 1 -- 172.21.15.82:0/3961601026 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e28098520 con 0x55bf326ddca0 2023-09-23T08:57:14.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.741+0000 7f4e487dcb80 1 -- 172.21.15.82:0/3961601026 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf326ddca0 msgr2=0x55bf326e0c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:14.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.741+0000 7f4e487dcb80 1 --2- 172.21.15.82:0/3961601026 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf326ddca0 0x55bf326e0c60 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f4e28098420 tx=0x7f4e2809c170 comp rx=0 tx=0).stop 2023-09-23T08:57:14.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.741+0000 7f4e487dcb80 1 -- 172.21.15.82:0/3961601026 shutdown_connections 2023-09-23T08:57:14.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.741+0000 7f4e487dcb80 1 --2- 172.21.15.82:0/3961601026 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf326ddca0 0x55bf326e0c60 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:14.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.741+0000 7f4e487dcb80 1 --2- 172.21.15.82:0/3961601026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bf326d7c40 0x55bf326d7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:14.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.741+0000 7f4e487dcb80 1 --2- 172.21.15.82:0/3961601026 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55bf326dd380 0x55bf326e0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:14.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.741+0000 7f4e487dcb80 1 -- 172.21.15.82:0/3961601026 >> 172.21.15.82:0/3961601026 conn(0x55bf3264c0e0 msgr2=0x55bf326db0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:14.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.742+0000 7f4e487dcb80 1 -- 172.21.15.82:0/3961601026 shutdown_connections 2023-09-23T08:57:14.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.742+0000 7f4e487dcb80 1 -- 172.21.15.82:0/3961601026 wait complete. 2023-09-23T08:57:14.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.742+0000 7f4e487dcb80 1 -- start start 2023-09-23T08:57:14.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.742+0000 7f4e487dcb80 1 Processor -- start 2023-09-23T08:57:14.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.743+0000 7f4e487dcb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf326d7c40 0x55bf326da590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:14.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.743+0000 7f4e487dcb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bf326dd380 0x55bf326d8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:14.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.743+0000 7f4e487dcb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55bf326ddca0 0x55bf326d9340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:14.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.743+0000 7f4e487dcb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf326dac10 con 0x55bf326d7c40 2023-09-23T08:57:14.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.743+0000 7f4e487dcb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf326d9880 con 0x55bf326dd380 2023-09-23T08:57:14.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.743+0000 7f4e487dcb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf326d9a10 con 0x55bf326ddca0 2023-09-23T08:57:14.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.743+0000 7f4e487dcb80 10 client.0 _ll_register_callbacks cb 0x7f4e24010bf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T08:57:14.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.743+0000 7f4e2e59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf326d7c40 0x55bf326da590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:14.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.743+0000 7f4e2e59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf326d7c40 0x55bf326da590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51660/0 (socket says 172.21.15.82:51660) 2023-09-23T08:57:14.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.743+0000 7f4e2e59c700 1 -- 172.21.15.82:0/3697860810 learned_addr learned my addr 172.21.15.82:0/3697860810 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:57:14.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.743+0000 7f4e2ed9d700 1 --2- 172.21.15.82:0/3697860810 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55bf326ddca0 0x55bf326d9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:14.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.743+0000 7f4e2dd9b700 1 --2- 172.21.15.82:0/3697860810 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bf326dd380 0x55bf326d8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:14.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.743+0000 7f4e2e59c700 1 -- 172.21.15.82:0/3697860810 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55bf326ddca0 msgr2=0x55bf326d9340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:14.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.743+0000 7f4e2e59c700 1 --2- 172.21.15.82:0/3697860810 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55bf326ddca0 0x55bf326d9340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:14.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.743+0000 7f4e2e59c700 1 -- 172.21.15.82:0/3697860810 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bf326dd380 msgr2=0x55bf326d8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:14.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.743+0000 7f4e2e59c700 1 --2- 172.21.15.82:0/3697860810 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bf326dd380 0x55bf326d8e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:14.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.743+0000 7f4e2e59c700 1 -- 172.21.15.82:0/3697860810 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bf324a9630 con 0x55bf326d7c40 2023-09-23T08:57:14.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.743+0000 7f4e2dd9b700 1 --2- 172.21.15.82:0/3697860810 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bf326dd380 0x55bf326d8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T08:57:14.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.744+0000 7f4e2e59c700 1 --2- 172.21.15.82:0/3697860810 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf326d7c40 0x55bf326da590 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f4e200059d0 tx=0x7f4e20028570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a64c673daaed080c server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:14.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.744+0000 7f4e15ffb700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T08:57:14.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.744+0000 7f4e15ffb700 1 -- 172.21.15.82:0/3697860810 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e200056f0 con 0x55bf326d7c40 2023-09-23T08:57:14.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.744+0000 7f4e487dcb80 1 -- 172.21.15.82:0/3697860810 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bf326ca8b0 con 0x55bf326d7c40 2023-09-23T08:57:14.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.744+0000 7f4e15ffb700 1 -- 172.21.15.82:0/3697860810 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f4e20028a00 con 0x55bf326d7c40 2023-09-23T08:57:14.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.744+0000 7f4e15ffb700 1 -- 172.21.15.82:0/3697860810 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4e20028bc0 con 0x55bf326d7c40 2023-09-23T08:57:14.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.744+0000 7f4e487dcb80 10 client.15636 fetch_fsmap learned FSMap version 26 2023-09-23T08:57:14.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.744+0000 7f4e487dcb80 1 -- 172.21.15.82:0/3697860810 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55bf3247c250 con 0x55bf326d7c40 2023-09-23T08:57:14.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.744+0000 7f4e15ffb700 1 -- 172.21.15.82:0/3697860810 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55bf326ca8b0 con 0x55bf326d7c40 2023-09-23T08:57:14.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.745+0000 7f4e15ffb700 1 -- 172.21.15.82:0/3697860810 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f4e2002e020 con 0x55bf326d7c40 2023-09-23T08:57:14.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.745+0000 7f4e487dcb80 10 client.15636 fetch_fsmap finished waiting for FSMap version 26 2023-09-23T08:57:14.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.745+0000 7f4e487dcb80 10 client.15636 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T08:57:14.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.745+0000 7f4e487dcb80 20 client.15636 populate_metadata read hostname 'smithi082' 2023-09-23T08:57:14.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.745+0000 7f4e487dcb80 1 --2- 172.21.15.82:0/3697860810 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55bf327468b0 0x55bf32748cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:14.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.745+0000 7f4e487dcb80 4 client.15636 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T08:57:14.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.745+0000 7f4e487dcb80 1 -- 172.21.15.82:0/3697860810 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55bf32622970 con 0x55bf327468b0 2023-09-23T08:57:14.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.745+0000 7f4e2dd9b700 1 --2- 172.21.15.82:0/3697860810 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55bf327468b0 0x55bf32748cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:14.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.746+0000 7f4e15ffb700 10 client.15636 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T08:57:14.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.746+0000 7f4e2dd9b700 1 --2- 172.21.15.82:0/3697860810 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55bf327468b0 0x55bf32748cd0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=faed2f0367a23509 server_cookie=58d185f5e41efcd0 in_seq=0 out_seq=0 2023-09-23T08:57:14.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.746+0000 7f4e15ffb700 1 -- 172.21.15.82:0/3697860810 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55bf32622970 con 0x55bf327468b0 2023-09-23T08:57:14.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.746+0000 7f4e15ffb700 10 client.15636 handle_command_reply: tid=0 2023-09-23T08:57:14.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.746+0000 7f4e487dcb80 1 client.15636 shutdown 2023-09-23T08:57:14.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.746+0000 7f4e487dcb80 1 -- 172.21.15.82:0/3697860810 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf326d7c40 msgr2=0x55bf326da590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:14.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.746+0000 7f4e487dcb80 1 --2- 172.21.15.82:0/3697860810 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf326d7c40 0x55bf326da590 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f4e200059d0 tx=0x7f4e20028570 comp rx=0 tx=0).stop 2023-09-23T08:57:14.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.746+0000 7f4e487dcb80 1 -- 172.21.15.82:0/3697860810 shutdown_connections 2023-09-23T08:57:14.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.746+0000 7f4e487dcb80 1 --2- 172.21.15.82:0/3697860810 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55bf326ddca0 0x55bf326d9340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:14.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.746+0000 7f4e487dcb80 1 --2- 172.21.15.82:0/3697860810 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55bf327468b0 0x55bf32748cd0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:14.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.746+0000 7f4e487dcb80 1 --2- 172.21.15.82:0/3697860810 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf326d7c40 0x55bf326da590 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:14.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.746+0000 7f4e487dcb80 1 --2- 172.21.15.82:0/3697860810 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bf326dd380 0x55bf326d8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:14.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.746+0000 7f4e15ffb700 0 client.15636 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T08:57:14.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.746+0000 7f4e487dcb80 1 -- 172.21.15.82:0/3697860810 >> 172.21.15.82:0/3697860810 conn(0x55bf3264c0e0 msgr2=0x55bf326dc020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:14.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.747+0000 7f4e487dcb80 1 -- 172.21.15.82:0/3697860810 shutdown_connections 2023-09-23T08:57:14.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.747+0000 7f4e487dcb80 1 -- 172.21.15.82:0/3697860810 wait complete. 2023-09-23T08:57:14.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.747+0000 7f4e487dcb80 20 client.15636 trim_cache size 0 max 16384 2023-09-23T08:57:14.757 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T08:57:14.757 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "no active scrubs running", 2023-09-23T08:57:14.757 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": {} 2023-09-23T08:57:14.757 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T08:57:14.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.747+0000 7f4e34dff700 1 -- 172.21.15.82:0/3765580889 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f4e180a0260 msgr2=0x7f4e180a2720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:14.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.747+0000 7f4e34dff700 1 --2- 172.21.15.82:0/3765580889 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f4e180a0260 0x7f4e180a2720 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f4e30074410 tx=0x7f4e24007f80 comp rx=0 tx=0).stop 2023-09-23T08:57:14.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.747+0000 7f4e34dff700 1 -- 172.21.15.82:0/3765580889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e301068a0 msgr2=0x7f4e301a4a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:14.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.747+0000 7f4e34dff700 1 --2- 172.21.15.82:0/3765580889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e301068a0 0x7f4e301a4a80 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f4e28007ee0 tx=0x7f4e2800d3b0 comp rx=0 tx=0).stop 2023-09-23T08:57:14.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.747+0000 7f4e34dff700 1 -- 172.21.15.82:0/3765580889 shutdown_connections 2023-09-23T08:57:14.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.747+0000 7f4e34dff700 1 --2- 172.21.15.82:0/3765580889 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f4e180a0260 0x7f4e180a2720 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:14.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.747+0000 7f4e34dff700 1 --2- 172.21.15.82:0/3765580889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e301068a0 0x7f4e301a4a80 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:14.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.747+0000 7f4e34dff700 1 --2- 172.21.15.82:0/3765580889 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e30100890 0x7f4e30072c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:14.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.747+0000 7f4e34dff700 1 --2- 172.21.15.82:0/3765580889 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e30101250 0x7f4e30073160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:14.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.747+0000 7f4e34dff700 1 -- 172.21.15.82:0/3765580889 >> 172.21.15.82:0/3765580889 conn(0x7f4e300fc380 msgr2=0x7f4e300fca20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:14.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.748+0000 7f4e34dff700 1 -- 172.21.15.82:0/3765580889 shutdown_connections 2023-09-23T08:57:14.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.748+0000 7f4e34dff700 1 -- 172.21.15.82:0/3765580889 wait complete. 2023-09-23T08:57:14.767 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-09-23T08:57:14.767 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-23T08:57:14.827 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:57:14 smithi082 ceph-mon[97694]: pgmap v13: 97 pgs: 97 active+clean; 30 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 3.2 MiB/s wr, 91 op/s 2023-09-23T08:57:14.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:57:14 smithi161 ceph-mon[99580]: pgmap v13: 97 pgs: 97 active+clean; 30 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 3.2 MiB/s wr, 91 op/s 2023-09-23T08:57:14.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.963+0000 7f792dbff700 1 -- 172.21.15.82:0/1598299089 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7928101260 msgr2=0x7f792810d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:14.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.963+0000 7f792dbff700 1 --2- 172.21.15.82:0/1598299089 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7928101260 0x7f792810d770 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f792000b0a0 tx=0x7f792000b3b0 comp rx=0 tx=0).stop 2023-09-23T08:57:14.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.963+0000 7f792dbff700 1 -- 172.21.15.82:0/1598299089 shutdown_connections 2023-09-23T08:57:14.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.963+0000 7f792dbff700 1 --2- 172.21.15.82:0/1598299089 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7928101260 0x7f792810d770 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:14.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.963+0000 7f792dbff700 1 --2- 172.21.15.82:0/1598299089 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79281068b0 0x7f7928106c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:14.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.963+0000 7f792dbff700 1 --2- 172.21.15.82:0/1598299089 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79281008a0 0x7f7928100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:14.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.963+0000 7f792dbff700 1 -- 172.21.15.82:0/1598299089 >> 172.21.15.82:0/1598299089 conn(0x7f79280fc3d0 msgr2=0x7f79280fe7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:14.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.963+0000 7f792dbff700 1 -- 172.21.15.82:0/1598299089 shutdown_connections 2023-09-23T08:57:14.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.963+0000 7f792dbff700 1 -- 172.21.15.82:0/1598299089 wait complete. 2023-09-23T08:57:14.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.964+0000 7f792dbff700 1 Processor -- start 2023-09-23T08:57:14.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.964+0000 7f792dbff700 1 -- start start 2023-09-23T08:57:14.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.965+0000 7f792dbff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79281008a0 0x7f7928072c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:14.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.965+0000 7f792dbff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7928101260 0x7f7928073160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:14.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.965+0000 7f792dbff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79281068b0 0x7f79281a49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:14.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.965+0000 7f792dbff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7928073990 con 0x7f7928101260 2023-09-23T08:57:14.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.965+0000 7f792dbff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79281a4f20 con 0x7f79281068b0 2023-09-23T08:57:14.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.965+0000 7f792dbff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79281a5060 con 0x7f79281008a0 2023-09-23T08:57:14.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.965+0000 7f7926ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7928101260 0x7f7928073160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:14.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.965+0000 7f79277fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79281008a0 0x7f7928072c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:14.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.965+0000 7f7926ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7928101260 0x7f7928073160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51668/0 (socket says 172.21.15.82:51668) 2023-09-23T08:57:14.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.965+0000 7f7926ffd700 1 -- 172.21.15.82:0/1661708374 learned_addr learned my addr 172.21.15.82:0/1661708374 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:57:14.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.965+0000 7f7927fff700 1 --2- 172.21.15.82:0/1661708374 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79281068b0 0x7f79281a49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:14.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.965+0000 7f7926ffd700 1 -- 172.21.15.82:0/1661708374 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79281008a0 msgr2=0x7f7928072c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:14.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.965+0000 7f7926ffd700 1 --2- 172.21.15.82:0/1661708374 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79281008a0 0x7f7928072c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:14.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.965+0000 7f7926ffd700 1 -- 172.21.15.82:0/1661708374 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79281068b0 msgr2=0x7f79281a49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:14.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.965+0000 7f7926ffd700 1 --2- 172.21.15.82:0/1661708374 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79281068b0 0x7f79281a49e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:14.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.965+0000 7f7926ffd700 1 -- 172.21.15.82:0/1661708374 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7920009d00 con 0x7f7928101260 2023-09-23T08:57:14.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.966+0000 7f7926ffd700 1 --2- 172.21.15.82:0/1661708374 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7928101260 0x7f7928073160 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f791c00d980 tx=0x7f791c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:14.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.966+0000 7f7924ff9700 1 -- 172.21.15.82:0/1661708374 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f791c004220 con 0x7f7928101260 2023-09-23T08:57:14.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.966+0000 7f792dbff700 1 -- 172.21.15.82:0/1661708374 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79281a52c0 con 0x7f7928101260 2023-09-23T08:57:14.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.966+0000 7f7924ff9700 1 -- 172.21.15.82:0/1661708374 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f791c007640 con 0x7f7928101260 2023-09-23T08:57:14.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.966+0000 7f7924ff9700 1 -- 172.21.15.82:0/1661708374 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f791c005660 con 0x7f7928101260 2023-09-23T08:57:14.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.966+0000 7f792dbff700 1 -- 172.21.15.82:0/1661708374 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79281a57f0 con 0x7f7928101260 2023-09-23T08:57:14.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.967+0000 7f792dbff700 1 -- 172.21.15.82:0/1661708374 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7928067710 con 0x7f7928101260 2023-09-23T08:57:14.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.969+0000 7f7924ff9700 1 -- 172.21.15.82:0/1661708374 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) v1 ==== 134904+0+0 (secure 0 0 0) 0x7f791c004750 con 0x7f7928101260 2023-09-23T08:57:14.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.970+0000 7f7924ff9700 1 --2- 172.21.15.82:0/1661708374 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f79100a0230 0x7f79100a26f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:14.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.970+0000 7f7924ff9700 1 -- 172.21.15.82:0/1661708374 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f791c0cb5d0 con 0x7f7928101260 2023-09-23T08:57:14.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.971+0000 7f79277fe700 1 --2- 172.21.15.82:0/1661708374 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f79100a0230 0x7f79100a26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:14.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.971+0000 7f79277fe700 1 --2- 172.21.15.82:0/1661708374 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f79100a0230 0x7f79100a26f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7918005950 tx=0x7f791800b410 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:14.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:14.975+0000 7f7924ff9700 1 -- 172.21.15.82:0/1661708374 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f791c094e00 con 0x7f7928101260 2023-09-23T08:57:15.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:57:14 smithi135 ceph-mon[99205]: pgmap v13: 97 pgs: 97 active+clean; 30 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 3.2 MiB/s wr, 91 op/s 2023-09-23T08:57:15.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.220+0000 7f792dbff700 1 -- 172.21.15.82:0/1661708374 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7928110910 con 0x7f7928101260 2023-09-23T08:57:15.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.221+0000 7f7924ff9700 1 -- 172.21.15.82:0/1661708374 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+11323 (secure 0 0 0) 0x7f791c098420 con 0x7f7928101260 2023-09-23T08:57:15.223 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:57:15.224 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/1237857359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1237857359},{"type":"v1","addr":"172.21.15.82:6835","nonce":1237857359}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/1335102362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":1335102362},{"type":"v1","addr":"172.21.15.82:6837","nonce":1335102362}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-23T08:54:52.600479+0000","modified":"2023-09-23T08:55:00.481507+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24557,"mds_1":24550,"mds_2":24526,"mds_3":24515,"mds_4":24514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/3645331700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3645331700},{"type":"v1","addr":"172.21.15.135:6835","nonce":3645331700}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14658":{"gid":14658,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6839/205725278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":205725278},{"type":"v1","addr":"172.21.15.82:6839","nonce":205725278}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14670":{"gid":14670,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6841/2659297867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":2659297867},{"type":"v1","addr":"172.21.15.82:6841","nonce":2659297867}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24461":{"gid":24461,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/503886037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":503886037},{"type":"v1","addr":"172.21.15.135:6833","nonce":503886037}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24463":{"gid":24463,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.161:6833/471569125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":471569125},{"type":"v1","addr":"172.21.15.161:6833","nonce":471569125}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24514":{"gid":24514,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":10,"addr":"172.21.15.161:6835/2237964162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":2237964162},{"type":"v1","addr":"172.21.15.161:6835","nonce":2237964162}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24515":{"gid":24515,"name":"h","rank":3,"incarnation":22,"state":"up:active","state_seq":8,"addr":"172.21.15.135:6837/2655304858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2655304858},{"type":"v1","addr":"172.21.15.135:6837","nonce":2655304858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24526":{"gid":24526,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.161:6837/43639843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":43639843},{"type":"v1","addr":"172.21.15.161:6837","nonce":43639843}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24550":{"gid":24550,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.161:6839/758982817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6838","nonce":758982817},{"type":"v1","addr":"172.21.15.161:6839","nonce":758982817}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24557":{"gid":24557,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6839/2508669274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2508669274},{"type":"v1","addr":"172.21.15.135:6839","nonce":2508669274}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-23T08:57:15.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.223+0000 7f792dbff700 1 -- 172.21.15.82:0/1661708374 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f79100a0230 msgr2=0x7f79100a26f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:15.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.223+0000 7f792dbff700 1 --2- 172.21.15.82:0/1661708374 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f79100a0230 0x7f79100a26f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7918005950 tx=0x7f791800b410 comp rx=0 tx=0).stop 2023-09-23T08:57:15.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.223+0000 7f792dbff700 1 -- 172.21.15.82:0/1661708374 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7928101260 msgr2=0x7f7928073160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:15.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.223+0000 7f792dbff700 1 --2- 172.21.15.82:0/1661708374 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7928101260 0x7f7928073160 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f791c00d980 tx=0x7f791c00dc90 comp rx=0 tx=0).stop 2023-09-23T08:57:15.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.223+0000 7f792dbff700 1 -- 172.21.15.82:0/1661708374 shutdown_connections 2023-09-23T08:57:15.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.223+0000 7f792dbff700 1 --2- 172.21.15.82:0/1661708374 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f79100a0230 0x7f79100a26f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:15.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.223+0000 7f792dbff700 1 --2- 172.21.15.82:0/1661708374 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79281068b0 0x7f79281a49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:15.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.223+0000 7f792dbff700 1 --2- 172.21.15.82:0/1661708374 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79281008a0 0x7f7928072c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:15.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.223+0000 7f792dbff700 1 --2- 172.21.15.82:0/1661708374 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7928101260 0x7f7928073160 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:15.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.223+0000 7f792dbff700 1 -- 172.21.15.82:0/1661708374 >> 172.21.15.82:0/1661708374 conn(0x7f79280fc3d0 msgr2=0x7f79280fc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:15.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.223+0000 7f792dbff700 1 -- 172.21.15.82:0/1661708374 shutdown_connections 2023-09-23T08:57:15.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.223+0000 7f792dbff700 1 -- 172.21.15.82:0/1661708374 wait complete. 2023-09-23T08:57:15.227 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 26 2023-09-23T08:57:15.244 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-09-23T08:57:15.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.441+0000 7f18ea7ff700 1 -- 172.21.15.82:0/1123291996 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18e41068a0 msgr2=0x7f18e4106c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:15.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.441+0000 7f18ea7ff700 1 --2- 172.21.15.82:0/1123291996 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18e41068a0 0x7f18e4106c80 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f18d4009990 tx=0x7f18d4009ca0 comp rx=0 tx=0).stop 2023-09-23T08:57:15.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.441+0000 7f18ea7ff700 1 -- 172.21.15.82:0/1123291996 shutdown_connections 2023-09-23T08:57:15.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.441+0000 7f18ea7ff700 1 --2- 172.21.15.82:0/1123291996 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f18e4101250 0x7f18e410d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:15.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.441+0000 7f18ea7ff700 1 --2- 172.21.15.82:0/1123291996 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18e41068a0 0x7f18e4106c80 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:15.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.441+0000 7f18ea7ff700 1 --2- 172.21.15.82:0/1123291996 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18e4100890 0x7f18e4100d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:15.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.441+0000 7f18ea7ff700 1 -- 172.21.15.82:0/1123291996 >> 172.21.15.82:0/1123291996 conn(0x7f18e40fc380 msgr2=0x7f18e40fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:15.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.441+0000 7f18ea7ff700 1 -- 172.21.15.82:0/1123291996 shutdown_connections 2023-09-23T08:57:15.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.441+0000 7f18ea7ff700 1 -- 172.21.15.82:0/1123291996 wait complete. 2023-09-23T08:57:15.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.442+0000 7f18ea7ff700 1 Processor -- start 2023-09-23T08:57:15.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.442+0000 7f18ea7ff700 1 -- start start 2023-09-23T08:57:15.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.443+0000 7f18ea7ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f18e4100890 0x7f18e4072c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:15.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.443+0000 7f18ea7ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18e4101250 0x7f18e4073160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:15.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.443+0000 7f18ea7ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18e41068a0 0x7f18e41a4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:15.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.443+0000 7f18ea7ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e4073990 con 0x7f18e4101250 2023-09-23T08:57:15.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.443+0000 7f18ea7ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e41a5080 con 0x7f18e4100890 2023-09-23T08:57:15.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.443+0000 7f18ea7ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e41a51c0 con 0x7f18e41068a0 2023-09-23T08:57:15.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.443+0000 7f18e3fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f18e4100890 0x7f18e4072c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:15.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.443+0000 7f18e37fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18e4101250 0x7f18e4073160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:15.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.443+0000 7f18e37fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18e4101250 0x7f18e4073160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51680/0 (socket says 172.21.15.82:51680) 2023-09-23T08:57:15.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.443+0000 7f18e37fe700 1 -- 172.21.15.82:0/574333167 learned_addr learned my addr 172.21.15.82:0/574333167 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:57:15.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.443+0000 7f18e8d9c700 1 --2- 172.21.15.82:0/574333167 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18e41068a0 0x7f18e41a4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:15.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.444+0000 7f18e37fe700 1 -- 172.21.15.82:0/574333167 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18e41068a0 msgr2=0x7f18e41a4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:15.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.444+0000 7f18e37fe700 1 --2- 172.21.15.82:0/574333167 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18e41068a0 0x7f18e41a4b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:15.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.444+0000 7f18e37fe700 1 -- 172.21.15.82:0/574333167 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f18e4100890 msgr2=0x7f18e4072c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:15.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.444+0000 7f18e37fe700 1 --2- 172.21.15.82:0/574333167 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f18e4100890 0x7f18e4072c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:15.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.444+0000 7f18e37fe700 1 -- 172.21.15.82:0/574333167 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18d40095f0 con 0x7f18e4101250 2023-09-23T08:57:15.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.444+0000 7f18e37fe700 1 --2- 172.21.15.82:0/574333167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18e4101250 0x7f18e4073160 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f18d800e9a0 tx=0x7f18d800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:15.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.444+0000 7f18e17fa700 1 -- 172.21.15.82:0/574333167 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d8009790 con 0x7f18e4101250 2023-09-23T08:57:15.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.444+0000 7f18ea7ff700 1 -- 172.21.15.82:0/574333167 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18e41a5420 con 0x7f18e4101250 2023-09-23T08:57:15.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.444+0000 7f18e17fa700 1 -- 172.21.15.82:0/574333167 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f18d8010430 con 0x7f18e4101250 2023-09-23T08:57:15.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.444+0000 7f18e17fa700 1 -- 172.21.15.82:0/574333167 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d800cea0 con 0x7f18e4101250 2023-09-23T08:57:15.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.444+0000 7f18ea7ff700 1 -- 172.21.15.82:0/574333167 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18e41a5950 con 0x7f18e4101250 2023-09-23T08:57:15.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.447+0000 7f18e17fa700 1 -- 172.21.15.82:0/574333167 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) v1 ==== 134904+0+0 (secure 0 0 0) 0x7f18d80105a0 con 0x7f18e4101250 2023-09-23T08:57:15.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.449+0000 7f18fe0f6b80 1 Processor -- start 2023-09-23T08:57:15.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.449+0000 7f18fe0f6b80 1 -- start start 2023-09-23T08:57:15.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.449+0000 7f18e17fa700 1 --2- 172.21.15.82:0/574333167 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f18cc0a01e0 0x7f18cc0a26a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:15.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.449+0000 7f18fe0f6b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c615bf4380 0x55c615bf4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:15.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.449+0000 7f18e17fa700 1 -- 172.21.15.82:0/574333167 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f18d8014070 con 0x7f18e4101250 2023-09-23T08:57:15.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.449+0000 7f18fe0f6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c615bf4ca0 0x55c615bee700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:15.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.449+0000 7f18fe0f6b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c615beec40 0x55c615bef0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:15.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.449+0000 7f18fe0f6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c615b567b0 con 0x55c615bf4ca0 2023-09-23T08:57:15.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.449+0000 7f18fe0f6b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c615b47780 con 0x55c615beec40 2023-09-23T08:57:15.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.449+0000 7f18fe0f6b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c615b450a0 con 0x55c615bf4380 2023-09-23T08:57:15.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.449+0000 7f18e8d9c700 1 --2- 172.21.15.82:0/574333167 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f18cc0a01e0 0x7f18cc0a26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:15.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.449+0000 7f18e37fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c615bf4ca0 0x55c615bee700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:15.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.449+0000 7f18e37fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c615bf4ca0 0x55c615bee700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51686/0 (socket says 172.21.15.82:51686) 2023-09-23T08:57:15.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.449+0000 7f18e37fe700 1 -- 172.21.15.82:0/1287041399 learned_addr learned my addr 172.21.15.82:0/1287041399 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:57:15.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.449+0000 7f18e3fff700 1 --2- 172.21.15.82:0/1287041399 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c615bf4380 0x55c615bf4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:15.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.450+0000 7f18e8d9c700 1 --2- 172.21.15.82:0/1287041399 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c615beec40 0x55c615bef0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:15.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.450+0000 7f18e37fe700 1 -- 172.21.15.82:0/1287041399 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c615bf4380 msgr2=0x55c615bf4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:15.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.450+0000 7f18e37fe700 1 --2- 172.21.15.82:0/1287041399 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c615bf4380 0x55c615bf4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:15.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.450+0000 7f18e37fe700 1 -- 172.21.15.82:0/1287041399 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c615beec40 msgr2=0x55c615bef0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:15.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.450+0000 7f18e37fe700 1 --2- 172.21.15.82:0/1287041399 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c615beec40 0x55c615bef0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:15.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.450+0000 7f18e37fe700 1 -- 172.21.15.82:0/1287041399 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c6159c0630 con 0x55c615bf4ca0 2023-09-23T08:57:15.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.450+0000 7f18e3fff700 1 --2- 172.21.15.82:0/1287041399 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c615bf4380 0x55c615bf4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T08:57:15.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.450+0000 7f18e8d9c700 1 --2- 172.21.15.82:0/1287041399 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c615beec40 0x55c615bef0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T08:57:15.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.450+0000 7f18e8d9c700 1 --2- 172.21.15.82:0/574333167 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f18cc0a01e0 0x7f18cc0a26a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f18dc009550 tx=0x7f18dc009c20 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:15.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.450+0000 7f18e37fe700 1 --2- 172.21.15.82:0/1287041399 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c615bf4ca0 0x55c615bee700 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f18d8098f00 tx=0x7f18d80989d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba9fb89cada68101 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:15.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.450+0000 7f18ca7fc700 1 -- 172.21.15.82:0/1287041399 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d8098f70 con 0x55c615bf4ca0 2023-09-23T08:57:15.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.450+0000 7f18ca7fc700 1 -- 172.21.15.82:0/1287041399 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f18d809cda0 con 0x55c615bf4ca0 2023-09-23T08:57:15.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.450+0000 7f18ca7fc700 1 -- 172.21.15.82:0/1287041399 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d80a0af0 con 0x55c615bf4ca0 2023-09-23T08:57:15.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.451+0000 7f18fe0f6b80 1 -- 172.21.15.82:0/1287041399 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c615bf4ca0 msgr2=0x55c615bee700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:15.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.451+0000 7f18fe0f6b80 1 --2- 172.21.15.82:0/1287041399 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c615bf4ca0 0x55c615bee700 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f18d8098f00 tx=0x7f18d80989d0 comp rx=0 tx=0).stop 2023-09-23T08:57:15.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.451+0000 7f18fe0f6b80 1 -- 172.21.15.82:0/1287041399 shutdown_connections 2023-09-23T08:57:15.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.451+0000 7f18fe0f6b80 1 --2- 172.21.15.82:0/1287041399 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c615beec40 0x55c615bef0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:15.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.451+0000 7f18fe0f6b80 1 --2- 172.21.15.82:0/1287041399 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c615bf4380 0x55c615bf4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:15.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.451+0000 7f18fe0f6b80 1 --2- 172.21.15.82:0/1287041399 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c615bf4ca0 0x55c615bee700 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:15.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.451+0000 7f18fe0f6b80 1 -- 172.21.15.82:0/1287041399 >> 172.21.15.82:0/1287041399 conn(0x55c615b630e0 msgr2=0x55c615be9410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:15.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.451+0000 7f18fe0f6b80 1 -- 172.21.15.82:0/1287041399 shutdown_connections 2023-09-23T08:57:15.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.451+0000 7f18fe0f6b80 1 -- 172.21.15.82:0/1287041399 wait complete. 2023-09-23T08:57:15.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.452+0000 7f18fe0f6b80 1 -- start start 2023-09-23T08:57:15.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.452+0000 7f18fe0f6b80 1 Processor -- start 2023-09-23T08:57:15.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.452+0000 7f18fe0f6b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c615beec40 0x55c615bfac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:15.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.452+0000 7f18fe0f6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c615bf4380 0x55c615bf7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:15.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.452+0000 7f18fe0f6b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c615bf4ca0 0x55c615bf8620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:15.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.452+0000 7f18fe0f6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c615b40990 con 0x55c615bf4380 2023-09-23T08:57:15.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.452+0000 7f18fe0f6b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c615adebb0 con 0x55c615beec40 2023-09-23T08:57:15.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.452+0000 7f18fe0f6b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c615ade8b0 con 0x55c615bf4ca0 2023-09-23T08:57:15.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.452+0000 7f18fe0f6b80 10 client.0 _ll_register_callbacks cb 0x55c615a28a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T08:57:15.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.453+0000 7f18e37fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c615bf4380 0x55c615bf7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:15.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.453+0000 7f18e37fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c615bf4380 0x55c615bf7ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51690/0 (socket says 172.21.15.82:51690) 2023-09-23T08:57:15.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.453+0000 7f18e37fe700 1 -- 172.21.15.82:0/3608855003 learned_addr learned my addr 172.21.15.82:0/3608855003 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:57:15.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.453+0000 7f18e3fff700 1 --2- 172.21.15.82:0/3608855003 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c615beec40 0x55c615bfac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:15.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.453+0000 7f18e8d9c700 1 --2- 172.21.15.82:0/3608855003 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c615bf4ca0 0x55c615bf8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:15.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.453+0000 7f18e37fe700 1 -- 172.21.15.82:0/3608855003 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c615bf4ca0 msgr2=0x55c615bf8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:15.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.453+0000 7f18e37fe700 1 --2- 172.21.15.82:0/3608855003 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c615bf4ca0 0x55c615bf8620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:15.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.453+0000 7f18e37fe700 1 -- 172.21.15.82:0/3608855003 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c615beec40 msgr2=0x55c615bfac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:15.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.453+0000 7f18e37fe700 1 --2- 172.21.15.82:0/3608855003 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c615beec40 0x55c615bfac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:15.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.453+0000 7f18e37fe700 1 -- 172.21.15.82:0/3608855003 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18e410e060 con 0x55c615bf4380 2023-09-23T08:57:15.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.453+0000 7f18e37fe700 1 --2- 172.21.15.82:0/3608855003 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c615bf4380 0x55c615bf7ee0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f18d8098eb0 tx=0x7f18d8010ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8a4469ccfa23f81 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:15.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.453+0000 7f18c37fe700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T08:57:15.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.453+0000 7f18c37fe700 1 -- 172.21.15.82:0/3608855003 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d809cda0 con 0x55c615bf4380 2023-09-23T08:57:15.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.453+0000 7f18fe0f6b80 1 -- 172.21.15.82:0/3608855003 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c615bbe1c0 con 0x55c615bf4380 2023-09-23T08:57:15.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.453+0000 7f18c37fe700 1 -- 172.21.15.82:0/3608855003 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f18d80a0d80 con 0x55c615bf4380 2023-09-23T08:57:15.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.454+0000 7f18c37fe700 1 -- 172.21.15.82:0/3608855003 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f18d80b1120 con 0x55c615bf4380 2023-09-23T08:57:15.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.454+0000 7f18fe0f6b80 10 client.15654 fetch_fsmap learned FSMap version 26 2023-09-23T08:57:15.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.454+0000 7f18fe0f6b80 1 -- 172.21.15.82:0/3608855003 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7f18e41a5950 con 0x55c615bf4380 2023-09-23T08:57:15.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.454+0000 7f18c37fe700 1 -- 172.21.15.82:0/3608855003 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55c615bbe1c0 con 0x55c615bf4380 2023-09-23T08:57:15.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.454+0000 7f18c37fe700 1 -- 172.21.15.82:0/3608855003 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f18d80b80c0 con 0x55c615bf4380 2023-09-23T08:57:15.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.454+0000 7f18fe0f6b80 10 client.15654 fetch_fsmap finished waiting for FSMap version 26 2023-09-23T08:57:15.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.454+0000 7f18fe0f6b80 10 client.15654 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2023-09-23T08:57:15.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.454+0000 7f18fe0f6b80 20 client.15654 populate_metadata read hostname 'smithi082' 2023-09-23T08:57:15.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.454+0000 7f18fe0f6b80 1 --2- 172.21.15.82:0/3608855003 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x55c615c08210 0x55c615c0a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:15.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.454+0000 7f18fe0f6b80 4 client.15654 mds_command: new command op to 24514 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T08:57:15.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.454+0000 7f18fe0f6b80 1 -- 172.21.15.82:0/3608855003 --> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c615ae6ba0 con 0x55c615c08210 2023-09-23T08:57:15.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.455+0000 7f18e3fff700 1 --2- 172.21.15.82:0/3608855003 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x55c615c08210 0x55c615c0a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:15.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.455+0000 7f18e3fff700 1 --2- 172.21.15.82:0/3608855003 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x55c615c08210 0x55c615c0a630 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=89e3c8b16b8d30cb server_cookie=5d434a2fe46b6823 in_seq=0 out_seq=0 2023-09-23T08:57:15.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.455+0000 7f18c37fe700 10 client.15654 ms_handle_connect on v2:172.21.15.161:6834/2237964162 2023-09-23T08:57:15.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.456+0000 7f18c37fe700 1 -- 172.21.15.82:0/3608855003 <== mds.4 v2:172.21.15.161:6834/2237964162 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c615ae6ba0 con 0x55c615c08210 2023-09-23T08:57:15.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.456+0000 7f18c37fe700 10 client.15654 handle_command_reply: tid=0 2023-09-23T08:57:15.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.457+0000 7f18fe0f6b80 1 client.15654 shutdown 2023-09-23T08:57:15.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.457+0000 7f18fe0f6b80 1 -- 172.21.15.82:0/3608855003 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c615bf4380 msgr2=0x55c615bf7ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:15.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.457+0000 7f18fe0f6b80 1 --2- 172.21.15.82:0/3608855003 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c615bf4380 0x55c615bf7ee0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f18d8098eb0 tx=0x7f18d8010ae0 comp rx=0 tx=0).stop 2023-09-23T08:57:15.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.457+0000 7f18fe0f6b80 1 -- 172.21.15.82:0/3608855003 shutdown_connections 2023-09-23T08:57:15.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.457+0000 7f18fe0f6b80 1 --2- 172.21.15.82:0/3608855003 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x55c615c08210 0x55c615c0a630 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:15.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.457+0000 7f18fe0f6b80 1 --2- 172.21.15.82:0/3608855003 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c615bf4ca0 0x55c615bf8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:15.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.457+0000 7f18fe0f6b80 1 --2- 172.21.15.82:0/3608855003 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c615beec40 0x55c615bfac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:15.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.457+0000 7f18c37fe700 0 client.15654 ms_handle_reset on v2:172.21.15.161:6834/2237964162 2023-09-23T08:57:15.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.457+0000 7f18fe0f6b80 1 --2- 172.21.15.82:0/3608855003 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c615bf4380 0x55c615bf7ee0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:15.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.457+0000 7f18fe0f6b80 1 -- 172.21.15.82:0/3608855003 >> 172.21.15.82:0/3608855003 conn(0x55c615b630e0 msgr2=0x55c615be3b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:15.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.457+0000 7f18fe0f6b80 1 -- 172.21.15.82:0/3608855003 shutdown_connections 2023-09-23T08:57:15.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.457+0000 7f18fe0f6b80 1 -- 172.21.15.82:0/3608855003 wait complete. 2023-09-23T08:57:15.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.457+0000 7f18fe0f6b80 20 client.15654 trim_cache size 0 max 16384 2023-09-23T08:57:15.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.471+0000 7f18fe0f6b80 1 Processor -- start 2023-09-23T08:57:15.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.471+0000 7f18fe0f6b80 1 -- start start 2023-09-23T08:57:15.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.471+0000 7f18fe0f6b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c615beec40 0x55c615c03e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:15.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.471+0000 7f18fe0f6b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c615bf4380 0x55c615bf2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:15.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.471+0000 7f18fe0f6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c615bf4ca0 0x55c615bf25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:15.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.471+0000 7f18fe0f6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6159c2920 con 0x55c615bf4ca0 2023-09-23T08:57:15.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.471+0000 7f18fe0f6b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c615bea1a0 con 0x55c615beec40 2023-09-23T08:57:15.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.471+0000 7f18fe0f6b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c615be5cd0 con 0x55c615bf4380 2023-09-23T08:57:15.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.472+0000 7f18e8d9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c615bf4ca0 0x55c615bf25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:15.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.472+0000 7f18e8d9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c615bf4ca0 0x55c615bf25d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51706/0 (socket says 172.21.15.82:51706) 2023-09-23T08:57:15.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.472+0000 7f18e8d9c700 1 -- 172.21.15.82:0/2067796486 learned_addr learned my addr 172.21.15.82:0/2067796486 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:57:15.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.472+0000 7f18e3fff700 1 --2- 172.21.15.82:0/2067796486 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c615beec40 0x55c615c03e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:15.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.472+0000 7f18e37fe700 1 --2- 172.21.15.82:0/2067796486 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c615bf4380 0x55c615bf2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:15.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.472+0000 7f18e8d9c700 1 -- 172.21.15.82:0/2067796486 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c615bf4380 msgr2=0x55c615bf2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:15.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.472+0000 7f18e8d9c700 1 --2- 172.21.15.82:0/2067796486 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c615bf4380 0x55c615bf2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:15.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.472+0000 7f18e8d9c700 1 -- 172.21.15.82:0/2067796486 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c615beec40 msgr2=0x55c615c03e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:15.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.472+0000 7f18e8d9c700 1 --2- 172.21.15.82:0/2067796486 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c615beec40 0x55c615c03e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:15.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.472+0000 7f18e8d9c700 1 -- 172.21.15.82:0/2067796486 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c615c0f260 con 0x55c615bf4ca0 2023-09-23T08:57:15.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.472+0000 7f18e3fff700 1 --2- 172.21.15.82:0/2067796486 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c615beec40 0x55c615c03e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T08:57:15.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.472+0000 7f18e8d9c700 1 --2- 172.21.15.82:0/2067796486 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c615bf4ca0 0x55c615bf25d0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f18dc004820 tx=0x7f18dc015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93eb002b030670b3 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:15.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.473+0000 7f18caffd700 1 -- 172.21.15.82:0/2067796486 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18dc017d60 con 0x55c615bf4ca0 2023-09-23T08:57:15.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.473+0000 7f18caffd700 1 -- 172.21.15.82:0/2067796486 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f18dc020040 con 0x55c615bf4ca0 2023-09-23T08:57:15.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.473+0000 7f18caffd700 1 -- 172.21.15.82:0/2067796486 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18dc0246e0 con 0x55c615bf4ca0 2023-09-23T08:57:15.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.473+0000 7f18fe0f6b80 1 -- 172.21.15.82:0/2067796486 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c615bf4ca0 msgr2=0x55c615bf25d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:15.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.473+0000 7f18fe0f6b80 1 --2- 172.21.15.82:0/2067796486 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c615bf4ca0 0x55c615bf25d0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f18dc004820 tx=0x7f18dc015000 comp rx=0 tx=0).stop 2023-09-23T08:57:15.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.473+0000 7f18fe0f6b80 1 -- 172.21.15.82:0/2067796486 shutdown_connections 2023-09-23T08:57:15.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.473+0000 7f18fe0f6b80 1 --2- 172.21.15.82:0/2067796486 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c615bf4ca0 0x55c615bf25d0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:15.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.473+0000 7f18fe0f6b80 1 --2- 172.21.15.82:0/2067796486 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c615beec40 0x55c615c03e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:15.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.473+0000 7f18fe0f6b80 1 --2- 172.21.15.82:0/2067796486 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c615bf4380 0x55c615bf2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:15.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.473+0000 7f18fe0f6b80 1 -- 172.21.15.82:0/2067796486 >> 172.21.15.82:0/2067796486 conn(0x55c615b630e0 msgr2=0x55c615c04a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:15.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.473+0000 7f18fe0f6b80 1 -- 172.21.15.82:0/2067796486 shutdown_connections 2023-09-23T08:57:15.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.473+0000 7f18fe0f6b80 1 -- 172.21.15.82:0/2067796486 wait complete. 2023-09-23T08:57:15.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.474+0000 7f18fe0f6b80 1 -- start start 2023-09-23T08:57:15.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.474+0000 7f18fe0f6b80 1 Processor -- start 2023-09-23T08:57:15.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.474+0000 7f18fe0f6b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c615beec40 0x55c615bf7700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:15.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.474+0000 7f18fe0f6b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c615bf4380 0x55c615bf7c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:15.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.474+0000 7f18fe0f6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c615bf4ca0 0x55c615bf6460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:15.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.474+0000 7f18fe0f6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c615bf8290 con 0x55c615bf4ca0 2023-09-23T08:57:15.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.474+0000 7f18fe0f6b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c615bf69a0 con 0x55c615bf4380 2023-09-23T08:57:15.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.474+0000 7f18fe0f6b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c615bf6b60 con 0x55c615beec40 2023-09-23T08:57:15.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.474+0000 7f18fe0f6b80 10 client.0 _ll_register_callbacks cb 0x7f18d8005ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T08:57:15.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.475+0000 7f18e8d9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c615bf4ca0 0x55c615bf6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:15.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.475+0000 7f18e8d9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c615bf4ca0 0x55c615bf6460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51718/0 (socket says 172.21.15.82:51718) 2023-09-23T08:57:15.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.475+0000 7f18e8d9c700 1 -- 172.21.15.82:0/3754983101 learned_addr learned my addr 172.21.15.82:0/3754983101 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:57:15.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.475+0000 7f18e3fff700 1 --2- 172.21.15.82:0/3754983101 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c615beec40 0x55c615bf7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:15.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.475+0000 7f18e37fe700 1 --2- 172.21.15.82:0/3754983101 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c615bf4380 0x55c615bf7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:15.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.475+0000 7f18e8d9c700 1 -- 172.21.15.82:0/3754983101 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c615beec40 msgr2=0x55c615bf7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:15.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.475+0000 7f18e8d9c700 1 --2- 172.21.15.82:0/3754983101 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c615beec40 0x55c615bf7700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:15.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.475+0000 7f18e8d9c700 1 -- 172.21.15.82:0/3754983101 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c615bf4380 msgr2=0x55c615bf7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:15.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.475+0000 7f18e8d9c700 1 --2- 172.21.15.82:0/3754983101 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c615bf4380 0x55c615bf7c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:15.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.475+0000 7f18e8d9c700 1 -- 172.21.15.82:0/3754983101 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18d4005340 con 0x55c615bf4ca0 2023-09-23T08:57:15.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.475+0000 7f18e8d9c700 1 --2- 172.21.15.82:0/3754983101 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c615bf4ca0 0x55c615bf6460 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f18dc004cf0 tx=0x7f18dc004dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=253a113479978029 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:15.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.475+0000 7f18c37fe700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T08:57:15.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.476+0000 7f18c37fe700 1 -- 172.21.15.82:0/3754983101 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18dc018820 con 0x55c615bf4ca0 2023-09-23T08:57:15.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.476+0000 7f18fe0f6b80 1 -- 172.21.15.82:0/3754983101 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c615be18b0 con 0x55c615bf4ca0 2023-09-23T08:57:15.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.476+0000 7f18c37fe700 1 -- 172.21.15.82:0/3754983101 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f18dc018980 con 0x55c615bf4ca0 2023-09-23T08:57:15.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.476+0000 7f18c37fe700 1 -- 172.21.15.82:0/3754983101 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f18dc018b40 con 0x55c615bf4ca0 2023-09-23T08:57:15.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.476+0000 7f18fe0f6b80 10 client.15660 fetch_fsmap learned FSMap version 26 2023-09-23T08:57:15.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.476+0000 7f18fe0f6b80 1 -- 172.21.15.82:0/3754983101 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7f18dc004500 con 0x55c615bf4ca0 2023-09-23T08:57:15.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.476+0000 7f18c37fe700 1 -- 172.21.15.82:0/3754983101 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55c615be18b0 con 0x55c615bf4ca0 2023-09-23T08:57:15.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.476+0000 7f18c37fe700 1 -- 172.21.15.82:0/3754983101 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f18dc02b070 con 0x55c615bf4ca0 2023-09-23T08:57:15.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.476+0000 7f18fe0f6b80 10 client.15660 fetch_fsmap finished waiting for FSMap version 26 2023-09-23T08:57:15.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.476+0000 7f18fe0f6b80 10 client.15660 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2023-09-23T08:57:15.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.476+0000 7f18fe0f6b80 20 client.15660 populate_metadata read hostname 'smithi082' 2023-09-23T08:57:15.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.476+0000 7f18fe0f6b80 1 --2- 172.21.15.82:0/3754983101 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x55c615c5ce20 0x55c615c5f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:15.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.476+0000 7f18fe0f6b80 4 client.15660 mds_command: new command op to 24514 tid=0[{"prefix": "damage ls"}] 2023-09-23T08:57:15.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.476+0000 7f18fe0f6b80 1 -- 172.21.15.82:0/3754983101 --> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55c615b39970 con 0x55c615c5ce20 2023-09-23T08:57:15.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.477+0000 7f18e3fff700 1 --2- 172.21.15.82:0/3754983101 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x55c615c5ce20 0x55c615c5f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:15.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.477+0000 7f18c37fe700 10 client.15660 ms_handle_connect on v2:172.21.15.161:6834/2237964162 2023-09-23T08:57:15.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.477+0000 7f18e3fff700 1 --2- 172.21.15.82:0/3754983101 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x55c615c5ce20 0x55c615c5f240 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=914e25a7fdde3b27 server_cookie=e377643f58d2f2ab in_seq=0 out_seq=0 2023-09-23T08:57:15.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.478+0000 7f18c37fe700 1 -- 172.21.15.82:0/3754983101 <== mds.4 v2:172.21.15.161:6834/2237964162 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55c615b39970 con 0x55c615c5ce20 2023-09-23T08:57:15.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.478+0000 7f18c37fe700 10 client.15660 handle_command_reply: tid=0 2023-09-23T08:57:15.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.478+0000 7f18fe0f6b80 1 client.15660 shutdown 2023-09-23T08:57:15.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.478+0000 7f18fe0f6b80 1 -- 172.21.15.82:0/3754983101 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c615bf4ca0 msgr2=0x55c615bf6460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:15.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.478+0000 7f18fe0f6b80 1 --2- 172.21.15.82:0/3754983101 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c615bf4ca0 0x55c615bf6460 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f18dc004cf0 tx=0x7f18dc004dd0 comp rx=0 tx=0).stop 2023-09-23T08:57:15.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.478+0000 7f18fe0f6b80 1 -- 172.21.15.82:0/3754983101 shutdown_connections 2023-09-23T08:57:15.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.478+0000 7f18fe0f6b80 1 --2- 172.21.15.82:0/3754983101 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x55c615c5ce20 0x55c615c5f240 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:15.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.478+0000 7f18fe0f6b80 1 --2- 172.21.15.82:0/3754983101 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c615bf4ca0 0x55c615bf6460 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:15.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.478+0000 7f18fe0f6b80 1 --2- 172.21.15.82:0/3754983101 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c615beec40 0x55c615bf7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:15.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.478+0000 7f18c37fe700 0 client.15660 ms_handle_reset on v2:172.21.15.161:6834/2237964162 2023-09-23T08:57:15.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.478+0000 7f18fe0f6b80 1 --2- 172.21.15.82:0/3754983101 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c615bf4380 0x55c615bf7c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:15.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.478+0000 7f18fe0f6b80 1 -- 172.21.15.82:0/3754983101 >> 172.21.15.82:0/3754983101 conn(0x55c615b630e0 msgr2=0x55c615bf2090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:15.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.478+0000 7f18fe0f6b80 1 -- 172.21.15.82:0/3754983101 shutdown_connections 2023-09-23T08:57:15.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.478+0000 7f18fe0f6b80 1 -- 172.21.15.82:0/3754983101 wait complete. 2023-09-23T08:57:15.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.478+0000 7f18fe0f6b80 20 client.15660 trim_cache size 0 max 16384 2023-09-23T08:57:15.486 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2023-09-23T08:57:15.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.479+0000 7f18ea7ff700 1 -- 172.21.15.82:0/574333167 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f18cc0a01e0 msgr2=0x7f18cc0a26a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:15.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.479+0000 7f18ea7ff700 1 --2- 172.21.15.82:0/574333167 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f18cc0a01e0 0x7f18cc0a26a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f18dc009550 tx=0x7f18dc009c20 comp rx=0 tx=0).stop 2023-09-23T08:57:15.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.479+0000 7f18ea7ff700 1 -- 172.21.15.82:0/574333167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18e4101250 msgr2=0x7f18e4073160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:15.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.479+0000 7f18ea7ff700 1 --2- 172.21.15.82:0/574333167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18e4101250 0x7f18e4073160 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f18d800e9a0 tx=0x7f18d800ecb0 comp rx=0 tx=0).stop 2023-09-23T08:57:15.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.479+0000 7f18ea7ff700 1 -- 172.21.15.82:0/574333167 shutdown_connections 2023-09-23T08:57:15.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.479+0000 7f18ea7ff700 1 --2- 172.21.15.82:0/574333167 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f18cc0a01e0 0x7f18cc0a26a0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:15.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.479+0000 7f18ea7ff700 1 --2- 172.21.15.82:0/574333167 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18e41068a0 0x7f18e41a4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:15.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.479+0000 7f18ea7ff700 1 --2- 172.21.15.82:0/574333167 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f18e4100890 0x7f18e4072c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:15.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.479+0000 7f18ea7ff700 1 --2- 172.21.15.82:0/574333167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18e4101250 0x7f18e4073160 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:15.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.479+0000 7f18ea7ff700 1 -- 172.21.15.82:0/574333167 >> 172.21.15.82:0/574333167 conn(0x7f18e40fc380 msgr2=0x7f18e40fcaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:15.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.479+0000 7f18ea7ff700 1 -- 172.21.15.82:0/574333167 shutdown_connections 2023-09-23T08:57:15.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.479+0000 7f18ea7ff700 1 -- 172.21.15.82:0/574333167 wait complete. 2023-09-23T08:57:15.498 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-09-23T08:57:15.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.699+0000 7f1868bff700 1 -- 172.21.15.82:0/540603448 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1864101250 msgr2=0x7f186410d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:15.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.699+0000 7f1868bff700 1 --2- 172.21.15.82:0/540603448 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1864101250 0x7f186410d760 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f185c00b0a0 tx=0x7f185c00b3b0 comp rx=0 tx=0).stop 2023-09-23T08:57:15.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.699+0000 7f1868bff700 1 -- 172.21.15.82:0/540603448 shutdown_connections 2023-09-23T08:57:15.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.699+0000 7f1868bff700 1 --2- 172.21.15.82:0/540603448 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1864101250 0x7f186410d760 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:15.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.699+0000 7f1868bff700 1 --2- 172.21.15.82:0/540603448 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18641068a0 0x7f1864106c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:15.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.699+0000 7f1868bff700 1 --2- 172.21.15.82:0/540603448 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1864100890 0x7f1864100d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:15.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.699+0000 7f1868bff700 1 -- 172.21.15.82:0/540603448 >> 172.21.15.82:0/540603448 conn(0x7f18640fc380 msgr2=0x7f18640fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:15.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.699+0000 7f1868bff700 1 -- 172.21.15.82:0/540603448 shutdown_connections 2023-09-23T08:57:15.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.700+0000 7f1868bff700 1 -- 172.21.15.82:0/540603448 wait complete. 2023-09-23T08:57:15.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.700+0000 7f1868bff700 1 Processor -- start 2023-09-23T08:57:15.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.701+0000 7f1868bff700 1 -- start start 2023-09-23T08:57:15.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.701+0000 7f1868bff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1864100890 0x7f186419e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:15.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.701+0000 7f1868bff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1864101250 0x7f186419ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:15.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.701+0000 7f1868bff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18641068a0 0x7f18641988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:15.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.701+0000 7f1868bff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1864198f10 con 0x7f1864101250 2023-09-23T08:57:15.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.701+0000 7f1868bff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1864199080 con 0x7f1864100890 2023-09-23T08:57:15.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.701+0000 7f1868bff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1864199240 con 0x7f18641068a0 2023-09-23T08:57:15.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.701+0000 7f1861d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1864101250 0x7f186419ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:15.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.701+0000 7f1861d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1864101250 0x7f186419ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51740/0 (socket says 172.21.15.82:51740) 2023-09-23T08:57:15.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.701+0000 7f1861d9b700 1 -- 172.21.15.82:0/708347172 learned_addr learned my addr 172.21.15.82:0/708347172 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:57:15.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.701+0000 7f186259c700 1 --2- 172.21.15.82:0/708347172 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1864100890 0x7f186419e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:15.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.702+0000 7f1862d9d700 1 --2- 172.21.15.82:0/708347172 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18641068a0 0x7f18641988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:15.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.702+0000 7f1861d9b700 1 -- 172.21.15.82:0/708347172 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18641068a0 msgr2=0x7f18641988b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:15.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.702+0000 7f1861d9b700 1 --2- 172.21.15.82:0/708347172 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18641068a0 0x7f18641988b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:15.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.702+0000 7f1861d9b700 1 -- 172.21.15.82:0/708347172 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1864100890 msgr2=0x7f186419e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:15.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.702+0000 7f1861d9b700 1 --2- 172.21.15.82:0/708347172 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1864100890 0x7f186419e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:15.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.702+0000 7f1861d9b700 1 -- 172.21.15.82:0/708347172 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f185c009d00 con 0x7f1864101250 2023-09-23T08:57:15.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.702+0000 7f1862d9d700 1 --2- 172.21.15.82:0/708347172 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18641068a0 0x7f18641988b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T08:57:15.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.702+0000 7f1861d9b700 1 --2- 172.21.15.82:0/708347172 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1864101250 0x7f186419ed10 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f185800e9a0 tx=0x7f185800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:15.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.702+0000 7f18537fe700 1 -- 172.21.15.82:0/708347172 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1858009790 con 0x7f1864101250 2023-09-23T08:57:15.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.702+0000 7f18537fe700 1 -- 172.21.15.82:0/708347172 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f185800cbd0 con 0x7f1864101250 2023-09-23T08:57:15.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.702+0000 7f1868bff700 1 -- 172.21.15.82:0/708347172 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1864199520 con 0x7f1864101250 2023-09-23T08:57:15.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.702+0000 7f18537fe700 1 -- 172.21.15.82:0/708347172 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1858018680 con 0x7f1864101250 2023-09-23T08:57:15.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.702+0000 7f1868bff700 1 -- 172.21.15.82:0/708347172 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18641a57c0 con 0x7f1864101250 2023-09-23T08:57:15.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.705+0000 7f18537fe700 1 -- 172.21.15.82:0/708347172 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) v1 ==== 134904+0+0 (secure 0 0 0) 0x7f185800cd40 con 0x7f1864101250 2023-09-23T08:57:15.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.707+0000 7f187c5bcb80 1 Processor -- start 2023-09-23T08:57:15.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.708+0000 7f187c5bcb80 1 -- start start 2023-09-23T08:57:15.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.708+0000 7f18537fe700 1 --2- 172.21.15.82:0/708347172 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f184c0a0260 0x7f184c0a2720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:15.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.708+0000 7f187c5bcb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5627db197380 0x5627db197760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:15.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.708+0000 7f187c5bcb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5627db197ca0 0x5627db191700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:15.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.708+0000 7f18537fe700 1 -- 172.21.15.82:0/708347172 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f1858014070 con 0x7f1864101250 2023-09-23T08:57:15.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.708+0000 7f187c5bcb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627db191c40 0x5627db1920a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:15.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.708+0000 7f187c5bcb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627db0f97b0 con 0x5627db197ca0 2023-09-23T08:57:15.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.708+0000 7f187c5bcb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627db0ea780 con 0x5627db191c40 2023-09-23T08:57:15.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.708+0000 7f187c5bcb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627db0e80a0 con 0x5627db197380 2023-09-23T08:57:15.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.708+0000 7f1862d9d700 1 --2- 172.21.15.82:0/708347172 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f184c0a0260 0x7f184c0a2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:15.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.708+0000 7f1861d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5627db197ca0 0x5627db191700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:15.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.708+0000 7f1861d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5627db197ca0 0x5627db191700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51744/0 (socket says 172.21.15.82:51744) 2023-09-23T08:57:15.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.708+0000 7f1861d9b700 1 -- 172.21.15.82:0/3975751913 learned_addr learned my addr 172.21.15.82:0/3975751913 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:57:15.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.709+0000 7f186259c700 1 --2- 172.21.15.82:0/3975751913 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5627db197380 0x5627db197760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:15.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.709+0000 7f1862d9d700 1 --2- 172.21.15.82:0/3975751913 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627db191c40 0x5627db1920a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:15.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.709+0000 7f1861d9b700 1 -- 172.21.15.82:0/3975751913 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5627db197380 msgr2=0x5627db197760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:15.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.709+0000 7f1861d9b700 1 --2- 172.21.15.82:0/3975751913 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5627db197380 0x5627db197760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:15.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.709+0000 7f1861d9b700 1 -- 172.21.15.82:0/3975751913 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627db191c40 msgr2=0x5627db1920a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:15.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.709+0000 7f1861d9b700 1 --2- 172.21.15.82:0/3975751913 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627db191c40 0x5627db1920a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:15.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.709+0000 7f1861d9b700 1 -- 172.21.15.82:0/3975751913 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5627daf63630 con 0x5627db197ca0 2023-09-23T08:57:15.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.709+0000 7f186259c700 1 --2- 172.21.15.82:0/3975751913 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5627db197380 0x5627db197760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T08:57:15.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.709+0000 7f1861d9b700 1 --2- 172.21.15.82:0/3975751913 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5627db197ca0 0x5627db191700 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f1858098f80 tx=0x7f1858098c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=980be3ed09149103 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:15.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.709+0000 7f1862d9d700 1 --2- 172.21.15.82:0/708347172 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f184c0a0260 0x7f184c0a2720 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f185c009610 tx=0x7f185c00bd60 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:15.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.709+0000 7f1850ff9700 1 -- 172.21.15.82:0/3975751913 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1858098ff0 con 0x5627db197ca0 2023-09-23T08:57:15.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.709+0000 7f1850ff9700 1 -- 172.21.15.82:0/3975751913 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f185809ce20 con 0x5627db197ca0 2023-09-23T08:57:15.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.709+0000 7f1850ff9700 1 -- 172.21.15.82:0/3975751913 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18580a0bd0 con 0x5627db197ca0 2023-09-23T08:57:15.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.710+0000 7f187c5bcb80 1 -- 172.21.15.82:0/3975751913 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5627db197ca0 msgr2=0x5627db191700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:15.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.710+0000 7f187c5bcb80 1 --2- 172.21.15.82:0/3975751913 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5627db197ca0 0x5627db191700 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f1858098f80 tx=0x7f1858098c50 comp rx=0 tx=0).stop 2023-09-23T08:57:15.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.710+0000 7f187c5bcb80 1 -- 172.21.15.82:0/3975751913 shutdown_connections 2023-09-23T08:57:15.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.710+0000 7f187c5bcb80 1 --2- 172.21.15.82:0/3975751913 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627db191c40 0x5627db1920a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:15.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.710+0000 7f187c5bcb80 1 --2- 172.21.15.82:0/3975751913 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5627db197380 0x5627db197760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:15.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.710+0000 7f187c5bcb80 1 --2- 172.21.15.82:0/3975751913 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5627db197ca0 0x5627db191700 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:15.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.710+0000 7f187c5bcb80 1 -- 172.21.15.82:0/3975751913 >> 172.21.15.82:0/3975751913 conn(0x5627db1060e0 msgr2=0x5627db18c410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:15.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.710+0000 7f187c5bcb80 1 -- 172.21.15.82:0/3975751913 shutdown_connections 2023-09-23T08:57:15.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.710+0000 7f187c5bcb80 1 -- 172.21.15.82:0/3975751913 wait complete. 2023-09-23T08:57:15.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.711+0000 7f187c5bcb80 1 -- start start 2023-09-23T08:57:15.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.711+0000 7f187c5bcb80 1 Processor -- start 2023-09-23T08:57:15.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.711+0000 7f187c5bcb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627db191c40 0x5627db19dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:15.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.711+0000 7f187c5bcb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5627db197380 0x5627db19aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:15.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.711+0000 7f187c5bcb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5627db197ca0 0x5627db19b610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:15.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.711+0000 7f187c5bcb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627db0e3990 con 0x5627db197380 2023-09-23T08:57:15.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.711+0000 7f187c5bcb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627db081bb0 con 0x5627db191c40 2023-09-23T08:57:15.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.711+0000 7f187c5bcb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627db0818b0 con 0x5627db197ca0 2023-09-23T08:57:15.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.711+0000 7f187c5bcb80 10 client.0 _ll_register_callbacks cb 0x5627dafcba80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T08:57:15.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.712+0000 7f1861d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5627db197380 0x5627db19aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:15.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.712+0000 7f1861d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5627db197380 0x5627db19aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51752/0 (socket says 172.21.15.82:51752) 2023-09-23T08:57:15.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.712+0000 7f1861d9b700 1 -- 172.21.15.82:0/1934125691 learned_addr learned my addr 172.21.15.82:0/1934125691 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:57:15.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.712+0000 7f186259c700 1 --2- 172.21.15.82:0/1934125691 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627db191c40 0x5627db19dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:15.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.712+0000 7f1862d9d700 1 --2- 172.21.15.82:0/1934125691 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5627db197ca0 0x5627db19b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:15.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.712+0000 7f1861d9b700 1 -- 172.21.15.82:0/1934125691 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5627db197ca0 msgr2=0x5627db19b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:15.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.712+0000 7f1861d9b700 1 --2- 172.21.15.82:0/1934125691 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5627db197ca0 0x5627db19b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:15.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.712+0000 7f1861d9b700 1 -- 172.21.15.82:0/1934125691 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627db191c40 msgr2=0x5627db19dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:15.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.712+0000 7f1861d9b700 1 --2- 172.21.15.82:0/1934125691 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627db191c40 0x5627db19dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:15.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.712+0000 7f1861d9b700 1 -- 172.21.15.82:0/1934125691 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18641a57c0 con 0x5627db197380 2023-09-23T08:57:15.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.712+0000 7f186259c700 1 --2- 172.21.15.82:0/1934125691 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627db191c40 0x5627db19dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T08:57:15.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.712+0000 7f1861d9b700 1 --2- 172.21.15.82:0/1934125691 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5627db197380 0x5627db19aed0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f1858099650 tx=0x7f1858094d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f2a2b689667a8f9 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:15.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.712+0000 7f1849ffb700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T08:57:15.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.712+0000 7f1849ffb700 1 -- 172.21.15.82:0/1934125691 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18580b6070 con 0x5627db197380 2023-09-23T08:57:15.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.712+0000 7f187c5bcb80 1 -- 172.21.15.82:0/1934125691 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5627db1611c0 con 0x5627db197380 2023-09-23T08:57:15.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.712+0000 7f1849ffb700 1 -- 172.21.15.82:0/1934125691 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f18580a0e00 con 0x5627db197380 2023-09-23T08:57:15.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.713+0000 7f1849ffb700 1 -- 172.21.15.82:0/1934125691 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f185809ce20 con 0x5627db197380 2023-09-23T08:57:15.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.713+0000 7f187c5bcb80 10 client.15672 fetch_fsmap learned FSMap version 26 2023-09-23T08:57:15.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.713+0000 7f187c5bcb80 1 -- 172.21.15.82:0/1934125691 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5627daf0fde0 con 0x5627db197380 2023-09-23T08:57:15.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.713+0000 7f1849ffb700 1 -- 172.21.15.82:0/1934125691 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f185807b080 con 0x5627db197380 2023-09-23T08:57:15.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.713+0000 7f1849ffb700 1 -- 172.21.15.82:0/1934125691 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f1858094f70 con 0x5627db197380 2023-09-23T08:57:15.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.713+0000 7f187c5bcb80 10 client.15672 fetch_fsmap finished waiting for FSMap version 26 2023-09-23T08:57:15.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.713+0000 7f187c5bcb80 10 client.15672 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2023-09-23T08:57:15.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.713+0000 7f187c5bcb80 20 client.15672 populate_metadata read hostname 'smithi082' 2023-09-23T08:57:15.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.713+0000 7f187c5bcb80 1 --2- 172.21.15.82:0/1934125691 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x5627db1ab320 0x5627db1ad740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:15.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.713+0000 7f187c5bcb80 4 client.15672 mds_command: new command op to 24515 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T08:57:15.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.713+0000 7f187c5bcb80 1 -- 172.21.15.82:0/1934125691 --> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5627db089ba0 con 0x5627db1ab320 2023-09-23T08:57:15.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.714+0000 7f186259c700 1 --2- 172.21.15.82:0/1934125691 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x5627db1ab320 0x5627db1ad740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:15.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.714+0000 7f1849ffb700 10 client.15672 ms_handle_connect on v2:172.21.15.135:6836/2655304858 2023-09-23T08:57:15.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.714+0000 7f186259c700 1 --2- 172.21.15.82:0/1934125691 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x5627db1ab320 0x5627db1ad740 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=aa31b697a2d10a0f server_cookie=35938698fa85ed7b in_seq=0 out_seq=0 2023-09-23T08:57:15.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.715+0000 7f1849ffb700 1 -- 172.21.15.82:0/1934125691 <== mds.3 v2:172.21.15.135:6836/2655304858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5627db089ba0 con 0x5627db1ab320 2023-09-23T08:57:15.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.715+0000 7f1849ffb700 10 client.15672 handle_command_reply: tid=0 2023-09-23T08:57:15.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.715+0000 7f187c5bcb80 1 client.15672 shutdown 2023-09-23T08:57:15.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.715+0000 7f187c5bcb80 1 -- 172.21.15.82:0/1934125691 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5627db197380 msgr2=0x5627db19aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:15.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.715+0000 7f187c5bcb80 1 --2- 172.21.15.82:0/1934125691 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5627db197380 0x5627db19aed0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f1858099650 tx=0x7f1858094d30 comp rx=0 tx=0).stop 2023-09-23T08:57:15.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.715+0000 7f187c5bcb80 1 -- 172.21.15.82:0/1934125691 shutdown_connections 2023-09-23T08:57:15.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.715+0000 7f187c5bcb80 1 --2- 172.21.15.82:0/1934125691 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x5627db1ab320 0x5627db1ad740 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:15.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.715+0000 7f187c5bcb80 1 --2- 172.21.15.82:0/1934125691 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5627db197ca0 0x5627db19b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:15.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.715+0000 7f187c5bcb80 1 --2- 172.21.15.82:0/1934125691 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627db191c40 0x5627db19dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:15.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.715+0000 7f1849ffb700 0 client.15672 ms_handle_reset on v2:172.21.15.135:6836/2655304858 2023-09-23T08:57:15.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.715+0000 7f187c5bcb80 1 --2- 172.21.15.82:0/1934125691 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5627db197380 0x5627db19aed0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:15.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.715+0000 7f187c5bcb80 1 -- 172.21.15.82:0/1934125691 >> 172.21.15.82:0/1934125691 conn(0x5627db1060e0 msgr2=0x5627db186b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:15.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.716+0000 7f187c5bcb80 1 -- 172.21.15.82:0/1934125691 shutdown_connections 2023-09-23T08:57:15.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.716+0000 7f187c5bcb80 1 -- 172.21.15.82:0/1934125691 wait complete. 2023-09-23T08:57:15.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.716+0000 7f187c5bcb80 20 client.15672 trim_cache size 0 max 16384 2023-09-23T08:57:15.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.729+0000 7f187c5bcb80 1 Processor -- start 2023-09-23T08:57:15.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.729+0000 7f187c5bcb80 1 -- start start 2023-09-23T08:57:15.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.729+0000 7f187c5bcb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627db191c40 0x5627db191700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:15.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.729+0000 7f187c5bcb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5627db197380 0x5627db194ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:15.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.729+0000 7f187c5bcb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5627db197ca0 0x5627db195530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:15.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.729+0000 7f187c5bcb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627daf65920 con 0x5627db197380 2023-09-23T08:57:15.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.729+0000 7f187c5bcb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627db18cf00 con 0x5627db191c40 2023-09-23T08:57:15.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.729+0000 7f187c5bcb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627db19e2a0 con 0x5627db197ca0 2023-09-23T08:57:15.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.730+0000 7f1861d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5627db197380 0x5627db194ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:15.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.730+0000 7f1861d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5627db197380 0x5627db194ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51762/0 (socket says 172.21.15.82:51762) 2023-09-23T08:57:15.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.730+0000 7f1861d9b700 1 -- 172.21.15.82:0/3353091898 learned_addr learned my addr 172.21.15.82:0/3353091898 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:57:15.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.730+0000 7f186259c700 1 --2- 172.21.15.82:0/3353091898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627db191c40 0x5627db191700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:15.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.730+0000 7f1861d9b700 1 -- 172.21.15.82:0/3353091898 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5627db197ca0 msgr2=0x5627db195530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:15.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.730+0000 7f1862d9d700 1 --2- 172.21.15.82:0/3353091898 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5627db197ca0 0x5627db195530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:15.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.730+0000 7f1861d9b700 1 --2- 172.21.15.82:0/3353091898 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5627db197ca0 0x5627db195530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:15.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.730+0000 7f1861d9b700 1 -- 172.21.15.82:0/3353091898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627db191c40 msgr2=0x5627db191700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:15.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.730+0000 7f1861d9b700 1 --2- 172.21.15.82:0/3353091898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627db191c40 0x5627db191700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:15.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.730+0000 7f1861d9b700 1 -- 172.21.15.82:0/3353091898 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5627daef8c60 con 0x5627db197380 2023-09-23T08:57:15.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.730+0000 7f1862d9d700 1 --2- 172.21.15.82:0/3353091898 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5627db197ca0 0x5627db195530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T08:57:15.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.730+0000 7f1861d9b700 1 --2- 172.21.15.82:0/3353091898 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5627db197380 0x5627db194ff0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f185800e970 tx=0x7f185800efb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9735a624a9895c58 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:15.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.730+0000 7f18517fa700 1 -- 172.21.15.82:0/3353091898 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18580b6030 con 0x5627db197380 2023-09-23T08:57:15.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.730+0000 7f18517fa700 1 -- 172.21.15.82:0/3353091898 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5627db1611c0 con 0x5627db197380 2023-09-23T08:57:15.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.730+0000 7f18517fa700 1 -- 172.21.15.82:0/3353091898 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1858098ff0 con 0x5627db197380 2023-09-23T08:57:15.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.731+0000 7f187c5bcb80 1 -- 172.21.15.82:0/3353091898 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5627db197380 msgr2=0x5627db194ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:15.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.731+0000 7f187c5bcb80 1 --2- 172.21.15.82:0/3353091898 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5627db197380 0x5627db194ff0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f185800e970 tx=0x7f185800efb0 comp rx=0 tx=0).stop 2023-09-23T08:57:15.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.731+0000 7f187c5bcb80 1 -- 172.21.15.82:0/3353091898 shutdown_connections 2023-09-23T08:57:15.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.731+0000 7f187c5bcb80 1 --2- 172.21.15.82:0/3353091898 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5627db197ca0 0x5627db195530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:15.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.731+0000 7f187c5bcb80 1 --2- 172.21.15.82:0/3353091898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627db191c40 0x5627db191700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:15.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.731+0000 7f187c5bcb80 1 --2- 172.21.15.82:0/3353091898 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5627db197380 0x5627db194ff0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:15.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.731+0000 7f187c5bcb80 1 -- 172.21.15.82:0/3353091898 >> 172.21.15.82:0/3353091898 conn(0x5627db1060e0 msgr2=0x5627db1a7a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:15.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.731+0000 7f187c5bcb80 1 -- 172.21.15.82:0/3353091898 shutdown_connections 2023-09-23T08:57:15.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.731+0000 7f187c5bcb80 1 -- 172.21.15.82:0/3353091898 wait complete. 2023-09-23T08:57:15.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.731+0000 7f187c5bcb80 1 -- start start 2023-09-23T08:57:15.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.732+0000 7f187c5bcb80 1 Processor -- start 2023-09-23T08:57:15.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.732+0000 7f187c5bcb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5627db191c40 0x5627db194180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:15.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.732+0000 7f187c5bcb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5627db197380 0x5627db1946c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:15.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.732+0000 7f187c5bcb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627db197ca0 0x5627db192da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:15.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.732+0000 7f187c5bcb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627db193320 con 0x5627db191c40 2023-09-23T08:57:15.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.732+0000 7f187c5bcb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627db193460 con 0x5627db197ca0 2023-09-23T08:57:15.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.732+0000 7f187c5bcb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627db193620 con 0x5627db197380 2023-09-23T08:57:15.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.732+0000 7f187c5bcb80 10 client.0 _ll_register_callbacks cb 0x5627dafcba80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T08:57:15.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.732+0000 7f186259c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5627db191c40 0x5627db194180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:15.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.732+0000 7f186259c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5627db191c40 0x5627db194180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51770/0 (socket says 172.21.15.82:51770) 2023-09-23T08:57:15.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.732+0000 7f186259c700 1 -- 172.21.15.82:0/3062628425 learned_addr learned my addr 172.21.15.82:0/3062628425 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:57:15.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.732+0000 7f1861d9b700 1 --2- 172.21.15.82:0/3062628425 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5627db197380 0x5627db1946c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:15.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.733+0000 7f1862d9d700 1 --2- 172.21.15.82:0/3062628425 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627db197ca0 0x5627db192da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:15.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.733+0000 7f186259c700 1 -- 172.21.15.82:0/3062628425 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5627db197380 msgr2=0x5627db1946c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:15.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.733+0000 7f186259c700 1 --2- 172.21.15.82:0/3062628425 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5627db197380 0x5627db1946c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:15.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.733+0000 7f186259c700 1 -- 172.21.15.82:0/3062628425 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627db197ca0 msgr2=0x5627db192da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:15.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.733+0000 7f186259c700 1 --2- 172.21.15.82:0/3062628425 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627db197ca0 0x5627db192da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:15.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.733+0000 7f186259c700 1 -- 172.21.15.82:0/3062628425 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5627daf0fde0 con 0x5627db191c40 2023-09-23T08:57:15.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.733+0000 7f186259c700 1 --2- 172.21.15.82:0/3062628425 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5627db191c40 0x5627db194180 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x5627db1adfd0 tx=0x7f18540094b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1c097166efef386 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:15.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.733+0000 7f1849ffb700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T08:57:15.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.733+0000 7f1849ffb700 1 -- 172.21.15.82:0/3062628425 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1854015040 con 0x5627db191c40 2023-09-23T08:57:15.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.733+0000 7f1849ffb700 1 -- 172.21.15.82:0/3062628425 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f185401ee40 con 0x5627db191c40 2023-09-23T08:57:15.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.733+0000 7f187c5bcb80 1 -- 172.21.15.82:0/3062628425 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5627db1848b0 con 0x5627db191c40 2023-09-23T08:57:15.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.734+0000 7f1849ffb700 1 -- 172.21.15.82:0/3062628425 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1854004a30 con 0x5627db191c40 2023-09-23T08:57:15.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.734+0000 7f187c5bcb80 10 client.15678 fetch_fsmap learned FSMap version 26 2023-09-23T08:57:15.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.734+0000 7f187c5bcb80 1 -- 172.21.15.82:0/3062628425 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5627daf36250 con 0x5627db191c40 2023-09-23T08:57:15.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.734+0000 7f1849ffb700 1 -- 172.21.15.82:0/3062628425 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5627db1848b0 con 0x5627db191c40 2023-09-23T08:57:15.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.734+0000 7f1849ffb700 1 -- 172.21.15.82:0/3062628425 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f1854010760 con 0x5627db191c40 2023-09-23T08:57:15.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.734+0000 7f187c5bcb80 10 client.15678 fetch_fsmap finished waiting for FSMap version 26 2023-09-23T08:57:15.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.734+0000 7f187c5bcb80 10 client.15678 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2023-09-23T08:57:15.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.734+0000 7f187c5bcb80 20 client.15678 populate_metadata read hostname 'smithi082' 2023-09-23T08:57:15.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.734+0000 7f187c5bcb80 1 --2- 172.21.15.82:0/3062628425 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x5627db200110 0x5627db202530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:15.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.734+0000 7f187c5bcb80 4 client.15678 mds_command: new command op to 24515 tid=0[{"prefix": "damage ls"}] 2023-09-23T08:57:15.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.734+0000 7f187c5bcb80 1 -- 172.21.15.82:0/3062628425 --> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5627db0dc970 con 0x5627db200110 2023-09-23T08:57:15.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.735+0000 7f1861d9b700 1 --2- 172.21.15.82:0/3062628425 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x5627db200110 0x5627db202530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:15.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.735+0000 7f1849ffb700 10 client.15678 ms_handle_connect on v2:172.21.15.135:6836/2655304858 2023-09-23T08:57:15.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.735+0000 7f1861d9b700 1 --2- 172.21.15.82:0/3062628425 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x5627db200110 0x5627db202530 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=57721f40acff3ca server_cookie=290e16c013b780e9 in_seq=0 out_seq=0 2023-09-23T08:57:15.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.735+0000 7f1849ffb700 1 -- 172.21.15.82:0/3062628425 <== mds.3 v2:172.21.15.135:6836/2655304858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5627db0dc970 con 0x5627db200110 2023-09-23T08:57:15.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.735+0000 7f1849ffb700 10 client.15678 handle_command_reply: tid=0 2023-09-23T08:57:15.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.735+0000 7f187c5bcb80 1 client.15678 shutdown 2023-09-23T08:57:15.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.736+0000 7f187c5bcb80 1 -- 172.21.15.82:0/3062628425 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5627db191c40 msgr2=0x5627db194180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:15.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.736+0000 7f187c5bcb80 1 --2- 172.21.15.82:0/3062628425 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5627db191c40 0x5627db194180 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x5627db1adfd0 tx=0x7f18540094b0 comp rx=0 tx=0).stop 2023-09-23T08:57:15.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.736+0000 7f187c5bcb80 1 -- 172.21.15.82:0/3062628425 shutdown_connections 2023-09-23T08:57:15.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.736+0000 7f187c5bcb80 1 --2- 172.21.15.82:0/3062628425 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627db197ca0 0x5627db192da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:15.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.736+0000 7f187c5bcb80 1 --2- 172.21.15.82:0/3062628425 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5627db191c40 0x5627db194180 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:15.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.736+0000 7f187c5bcb80 1 --2- 172.21.15.82:0/3062628425 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x5627db200110 0x5627db202530 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:15.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.736+0000 7f187c5bcb80 1 --2- 172.21.15.82:0/3062628425 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5627db197380 0x5627db1946c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:15.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.736+0000 7f1849ffb700 0 client.15678 ms_handle_reset on v2:172.21.15.135:6836/2655304858 2023-09-23T08:57:15.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.736+0000 7f187c5bcb80 1 -- 172.21.15.82:0/3062628425 >> 172.21.15.82:0/3062628425 conn(0x5627db1060e0 msgr2=0x5627db194ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:15.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.736+0000 7f187c5bcb80 1 -- 172.21.15.82:0/3062628425 shutdown_connections 2023-09-23T08:57:15.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.736+0000 7f187c5bcb80 1 -- 172.21.15.82:0/3062628425 wait complete. 2023-09-23T08:57:15.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.736+0000 7f187c5bcb80 20 client.15678 trim_cache size 0 max 16384 2023-09-23T08:57:15.744 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2023-09-23T08:57:15.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.737+0000 7f1868bff700 1 -- 172.21.15.82:0/708347172 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f184c0a0260 msgr2=0x7f184c0a2720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:15.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.737+0000 7f1868bff700 1 --2- 172.21.15.82:0/708347172 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f184c0a0260 0x7f184c0a2720 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f185c009610 tx=0x7f185c00bd60 comp rx=0 tx=0).stop 2023-09-23T08:57:15.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.737+0000 7f1868bff700 1 -- 172.21.15.82:0/708347172 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1864101250 msgr2=0x7f186419ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:15.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.737+0000 7f1868bff700 1 --2- 172.21.15.82:0/708347172 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1864101250 0x7f186419ed10 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f185800e9a0 tx=0x7f185800ecb0 comp rx=0 tx=0).stop 2023-09-23T08:57:15.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.737+0000 7f1868bff700 1 -- 172.21.15.82:0/708347172 shutdown_connections 2023-09-23T08:57:15.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.737+0000 7f1868bff700 1 --2- 172.21.15.82:0/708347172 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f184c0a0260 0x7f184c0a2720 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:15.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.737+0000 7f1868bff700 1 --2- 172.21.15.82:0/708347172 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18641068a0 0x7f18641988b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:15.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.737+0000 7f1868bff700 1 --2- 172.21.15.82:0/708347172 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1864100890 0x7f186419e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:15.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.737+0000 7f1868bff700 1 --2- 172.21.15.82:0/708347172 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1864101250 0x7f186419ed10 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:15.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.737+0000 7f1868bff700 1 -- 172.21.15.82:0/708347172 >> 172.21.15.82:0/708347172 conn(0x7f18640fc380 msgr2=0x7f186410bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:15.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.737+0000 7f1868bff700 1 -- 172.21.15.82:0/708347172 shutdown_connections 2023-09-23T08:57:15.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.737+0000 7f1868bff700 1 -- 172.21.15.82:0/708347172 wait complete. 2023-09-23T08:57:15.754 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:57:15 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/1661708374' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T08:57:15.757 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-09-23T08:57:15.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:57:15 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/1661708374' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T08:57:15.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.991+0000 7f61559ff700 1 -- 172.21.15.82:0/1487636860 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6150100870 msgr2=0x7f6150100cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:15.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.991+0000 7f61559ff700 1 --2- 172.21.15.82:0/1487636860 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6150100870 0x7f6150100cf0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f6144009990 tx=0x7f6144009ca0 comp rx=0 tx=0).stop 2023-09-23T08:57:15.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.991+0000 7f61559ff700 1 -- 172.21.15.82:0/1487636860 shutdown_connections 2023-09-23T08:57:15.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.991+0000 7f61559ff700 1 --2- 172.21.15.82:0/1487636860 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6150101230 0x7f615010d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:15.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.991+0000 7f61559ff700 1 --2- 172.21.15.82:0/1487636860 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6150106880 0x7f6150106c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:15.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.991+0000 7f61559ff700 1 --2- 172.21.15.82:0/1487636860 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6150100870 0x7f6150100cf0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:15.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.991+0000 7f61559ff700 1 -- 172.21.15.82:0/1487636860 >> 172.21.15.82:0/1487636860 conn(0x7f61500fc3a0 msgr2=0x7f61500fe7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:15.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.991+0000 7f61559ff700 1 -- 172.21.15.82:0/1487636860 shutdown_connections 2023-09-23T08:57:15.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.991+0000 7f61559ff700 1 -- 172.21.15.82:0/1487636860 wait complete. 2023-09-23T08:57:15.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.992+0000 7f61559ff700 1 Processor -- start 2023-09-23T08:57:15.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.992+0000 7f61559ff700 1 -- start start 2023-09-23T08:57:15.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.992+0000 7f61559ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6150100870 0x7f6150072c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:15.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.993+0000 7f61559ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6150101230 0x7f6150073160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:15.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.993+0000 7f61559ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6150106880 0x7f61500736a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:15.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.993+0000 7f61559ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61501a9240 con 0x7f6150106880 2023-09-23T08:57:15.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.993+0000 7f61559ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61501a9380 con 0x7f6150101230 2023-09-23T08:57:15.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.993+0000 7f61559ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61501a94c0 con 0x7f6150100870 2023-09-23T08:57:15.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.993+0000 7f614f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6150106880 0x7f61500736a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:15.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.993+0000 7f614f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6150106880 0x7f61500736a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51794/0 (socket says 172.21.15.82:51794) 2023-09-23T08:57:15.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.993+0000 7f614f7fe700 1 -- 172.21.15.82:0/3479503946 learned_addr learned my addr 172.21.15.82:0/3479503946 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:57:15.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.993+0000 7f614effd700 1 --2- 172.21.15.82:0/3479503946 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6150100870 0x7f6150072c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:15.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.993+0000 7f614e7fc700 1 --2- 172.21.15.82:0/3479503946 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6150101230 0x7f6150073160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:15.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.993+0000 7f614f7fe700 1 -- 172.21.15.82:0/3479503946 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6150100870 msgr2=0x7f6150072c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:15.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.993+0000 7f614f7fe700 1 --2- 172.21.15.82:0/3479503946 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6150100870 0x7f6150072c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:15.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.993+0000 7f614f7fe700 1 -- 172.21.15.82:0/3479503946 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6150101230 msgr2=0x7f6150073160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:15.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.993+0000 7f614f7fe700 1 --2- 172.21.15.82:0/3479503946 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6150101230 0x7f6150073160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:15.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.993+0000 7f614f7fe700 1 -- 172.21.15.82:0/3479503946 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61440095f0 con 0x7f6150106880 2023-09-23T08:57:15.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.994+0000 7f614f7fe700 1 --2- 172.21.15.82:0/3479503946 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6150106880 0x7f61500736a0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f614800ef30 tx=0x7f614800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:15.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.994+0000 7f61549fd700 1 -- 172.21.15.82:0/3479503946 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6148018070 con 0x7f6150106880 2023-09-23T08:57:15.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.994+0000 7f61549fd700 1 -- 172.21.15.82:0/3479503946 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f614800f040 con 0x7f6150106880 2023-09-23T08:57:15.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.994+0000 7f61559ff700 1 -- 172.21.15.82:0/3479503946 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61501a9740 con 0x7f6150106880 2023-09-23T08:57:15.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.994+0000 7f61549fd700 1 -- 172.21.15.82:0/3479503946 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f614800cbc0 con 0x7f6150106880 2023-09-23T08:57:15.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.994+0000 7f61559ff700 1 -- 172.21.15.82:0/3479503946 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61501a9bd0 con 0x7f6150106880 2023-09-23T08:57:16.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.998+0000 7f61549fd700 1 -- 172.21.15.82:0/3479503946 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) v1 ==== 134904+0+0 (secure 0 0 0) 0x7f6148007500 con 0x7f6150106880 2023-09-23T08:57:16.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:15.999+0000 7f6169361b80 1 Processor -- start 2023-09-23T08:57:16.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.000+0000 7f6169361b80 1 -- start start 2023-09-23T08:57:16.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.000+0000 7f61549fd700 1 --2- 172.21.15.82:0/3479503946 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f61380a01e0 0x7f61380a26a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:16.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.000+0000 7f6169361b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560e746bb380 0x560e746bb760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:16.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.000+0000 7f6169361b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560e746bbca0 0x560e746b5700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:16.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.000+0000 7f6169361b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e746b5c40 0x560e746b60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:16.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.000+0000 7f6169361b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e7461d7b0 con 0x560e746bb380 2023-09-23T08:57:16.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.000+0000 7f6169361b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e7460e780 con 0x560e746b5c40 2023-09-23T08:57:16.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.000+0000 7f6169361b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e7460c0a0 con 0x560e746bbca0 2023-09-23T08:57:16.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.000+0000 7f61549fd700 1 -- 172.21.15.82:0/3479503946 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f61480cb3d0 con 0x7f6150106880 2023-09-23T08:57:16.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.000+0000 7f614e7fc700 1 --2- 172.21.15.82:0/3479503946 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f61380a01e0 0x7f61380a26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:16.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.001+0000 7f614f7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e746b5c40 0x560e746b60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:16.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.001+0000 7f614effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560e746bb380 0x560e746bb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:16.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.001+0000 7f614f7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e746b5c40 0x560e746b60a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:44548/0 (socket says 172.21.15.82:44548) 2023-09-23T08:57:16.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.001+0000 7f614f7fe700 1 -- 172.21.15.82:0/2258705297 learned_addr learned my addr 172.21.15.82:0/2258705297 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:57:16.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.001+0000 7f614e7fc700 1 --2- 172.21.15.82:0/2258705297 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560e746bbca0 0x560e746b5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:16.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.001+0000 7f614f7fe700 1 -- 172.21.15.82:0/2258705297 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560e746bbca0 msgr2=0x560e746b5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:16.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.001+0000 7f614f7fe700 1 --2- 172.21.15.82:0/2258705297 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560e746bbca0 0x560e746b5700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.001+0000 7f614f7fe700 1 -- 172.21.15.82:0/2258705297 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560e746bb380 msgr2=0x560e746bb760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:16.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.001+0000 7f614f7fe700 1 --2- 172.21.15.82:0/2258705297 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560e746bb380 0x560e746bb760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.001+0000 7f614f7fe700 1 -- 172.21.15.82:0/2258705297 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560e74487630 con 0x560e746b5c40 2023-09-23T08:57:16.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.001+0000 7f614f7fe700 1 --2- 172.21.15.82:0/2258705297 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e746b5c40 0x560e746b60a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6148098650 tx=0x7f6148098590 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8fde17363c5176d server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:16.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.002+0000 7f614e7fc700 1 --2- 172.21.15.82:0/3479503946 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f61380a01e0 0x7f61380a26a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f61440059d0 tx=0x7f6144005510 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:16.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.002+0000 7f6135ffb700 1 -- 172.21.15.82:0/2258705297 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6148099050 con 0x560e746b5c40 2023-09-23T08:57:16.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.002+0000 7f6135ffb700 1 -- 172.21.15.82:0/2258705297 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6148098950 con 0x560e746b5c40 2023-09-23T08:57:16.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.002+0000 7f6135ffb700 1 -- 172.21.15.82:0/2258705297 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6148096dd0 con 0x560e746b5c40 2023-09-23T08:57:16.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.003+0000 7f6169361b80 1 -- 172.21.15.82:0/2258705297 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e746b5c40 msgr2=0x560e746b60a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:16.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.003+0000 7f6169361b80 1 --2- 172.21.15.82:0/2258705297 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e746b5c40 0x560e746b60a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6148098650 tx=0x7f6148098590 comp rx=0 tx=0).stop 2023-09-23T08:57:16.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.003+0000 7f6169361b80 1 -- 172.21.15.82:0/2258705297 shutdown_connections 2023-09-23T08:57:16.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.003+0000 7f6169361b80 1 --2- 172.21.15.82:0/2258705297 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e746b5c40 0x560e746b60a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.003+0000 7f6169361b80 1 --2- 172.21.15.82:0/2258705297 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560e746bb380 0x560e746bb760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.003+0000 7f6169361b80 1 --2- 172.21.15.82:0/2258705297 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560e746bbca0 0x560e746b5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.003+0000 7f6169361b80 1 -- 172.21.15.82:0/2258705297 >> 172.21.15.82:0/2258705297 conn(0x560e7462a0e0 msgr2=0x560e746b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:16.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.003+0000 7f6169361b80 1 -- 172.21.15.82:0/2258705297 shutdown_connections 2023-09-23T08:57:16.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.003+0000 7f6169361b80 1 -- 172.21.15.82:0/2258705297 wait complete. 2023-09-23T08:57:16.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.004+0000 7f6169361b80 1 -- start start 2023-09-23T08:57:16.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.004+0000 7f6169361b80 1 Processor -- start 2023-09-23T08:57:16.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.004+0000 7f6169361b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560e746b5c40 0x560e746c1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:16.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.004+0000 7f6169361b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560e746bb380 0x560e746beea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:16.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.004+0000 7f6169361b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e746bbca0 0x560e746bf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:16.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.004+0000 7f6169361b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e74607990 con 0x560e746bb380 2023-09-23T08:57:16.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.004+0000 7f6169361b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e745a5bb0 con 0x560e746bbca0 2023-09-23T08:57:16.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.004+0000 7f6169361b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e745a58b0 con 0x560e746b5c40 2023-09-23T08:57:16.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.004+0000 7f6169361b80 10 client.0 _ll_register_callbacks cb 0x560e744efa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T08:57:16.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.005+0000 7f614e7fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560e746bb380 0x560e746beea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:16.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.005+0000 7f614e7fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560e746bb380 0x560e746beea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51812/0 (socket says 172.21.15.82:51812) 2023-09-23T08:57:16.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.005+0000 7f614e7fc700 1 -- 172.21.15.82:0/3463078261 learned_addr learned my addr 172.21.15.82:0/3463078261 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:57:16.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.005+0000 7f614f7fe700 1 --2- 172.21.15.82:0/3463078261 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e746bbca0 0x560e746bf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:16.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.005+0000 7f614effd700 1 --2- 172.21.15.82:0/3463078261 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560e746b5c40 0x560e746c1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:16.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.005+0000 7f614e7fc700 1 -- 172.21.15.82:0/3463078261 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560e746b5c40 msgr2=0x560e746c1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:16.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.005+0000 7f614e7fc700 1 --2- 172.21.15.82:0/3463078261 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560e746b5c40 0x560e746c1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.005+0000 7f614e7fc700 1 -- 172.21.15.82:0/3463078261 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e746bbca0 msgr2=0x560e746bf540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:16.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.005+0000 7f614e7fc700 1 --2- 172.21.15.82:0/3463078261 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e746bbca0 0x560e746bf540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.005+0000 7f614e7fc700 1 -- 172.21.15.82:0/3463078261 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61501a9bd0 con 0x560e746bb380 2023-09-23T08:57:16.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.005+0000 7f614effd700 1 --2- 172.21.15.82:0/3463078261 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560e746b5c40 0x560e746c1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T08:57:16.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.005+0000 7f614e7fc700 1 --2- 172.21.15.82:0/3463078261 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560e746bb380 0x560e746beea0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f6144015000 tx=0x7f6144009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7748d6c040f457bf server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:16.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.005+0000 7f612effd700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T08:57:16.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.006+0000 7f612effd700 1 -- 172.21.15.82:0/3463078261 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f614401d040 con 0x560e746bb380 2023-09-23T08:57:16.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.006+0000 7f6169361b80 1 -- 172.21.15.82:0/3463078261 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560e746851c0 con 0x560e746bb380 2023-09-23T08:57:16.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.006+0000 7f612effd700 1 -- 172.21.15.82:0/3463078261 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f6144004b20 con 0x560e746bb380 2023-09-23T08:57:16.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.006+0000 7f612effd700 1 -- 172.21.15.82:0/3463078261 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6144004ce0 con 0x560e746bb380 2023-09-23T08:57:16.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.006+0000 7f6169361b80 10 client.15690 fetch_fsmap learned FSMap version 26 2023-09-23T08:57:16.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.006+0000 7f6169361b80 1 -- 172.21.15.82:0/3463078261 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x560e74433de0 con 0x560e746bb380 2023-09-23T08:57:16.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.006+0000 7f612effd700 1 -- 172.21.15.82:0/3463078261 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x560e746851c0 con 0x560e746bb380 2023-09-23T08:57:16.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.006+0000 7f612effd700 1 -- 172.21.15.82:0/3463078261 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f6144032440 con 0x560e746bb380 2023-09-23T08:57:16.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.007+0000 7f6169361b80 10 client.15690 fetch_fsmap finished waiting for FSMap version 26 2023-09-23T08:57:16.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.007+0000 7f6169361b80 10 client.15690 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-09-23T08:57:16.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.007+0000 7f6169361b80 20 client.15690 populate_metadata read hostname 'smithi082' 2023-09-23T08:57:16.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.007+0000 7f6169361b80 1 --2- 172.21.15.82:0/3463078261 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x560e746cf6d0 0x560e746d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:16.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.007+0000 7f6169361b80 4 client.15690 mds_command: new command op to 24526 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T08:57:16.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.007+0000 7f6169361b80 1 -- 172.21.15.82:0/3463078261 --> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560e745adba0 con 0x560e746cf6d0 2023-09-23T08:57:16.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.007+0000 7f614effd700 1 --2- 172.21.15.82:0/3463078261 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x560e746cf6d0 0x560e746d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:16.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.008+0000 7f614effd700 1 --2- 172.21.15.82:0/3463078261 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x560e746cf6d0 0x560e746d1af0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=45135f4d615f40b5 server_cookie=fee17be88f99e3ef in_seq=0 out_seq=0 2023-09-23T08:57:16.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.008+0000 7f612effd700 10 client.15690 ms_handle_connect on v2:172.21.15.161:6836/43639843 2023-09-23T08:57:16.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.008+0000 7f612effd700 1 -- 172.21.15.82:0/3463078261 <== mds.2 v2:172.21.15.161:6836/43639843 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x560e745adba0 con 0x560e746cf6d0 2023-09-23T08:57:16.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.008+0000 7f612effd700 10 client.15690 handle_command_reply: tid=0 2023-09-23T08:57:16.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.008+0000 7f6169361b80 1 client.15690 shutdown 2023-09-23T08:57:16.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.009+0000 7f6169361b80 1 -- 172.21.15.82:0/3463078261 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560e746bb380 msgr2=0x560e746beea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:16.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.009+0000 7f6169361b80 1 --2- 172.21.15.82:0/3463078261 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560e746bb380 0x560e746beea0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f6144015000 tx=0x7f6144009ca0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.009+0000 7f6169361b80 1 -- 172.21.15.82:0/3463078261 shutdown_connections 2023-09-23T08:57:16.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.009+0000 7f6169361b80 1 --2- 172.21.15.82:0/3463078261 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x560e746cf6d0 0x560e746d1af0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.009+0000 7f6169361b80 1 --2- 172.21.15.82:0/3463078261 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e746bbca0 0x560e746bf540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.009+0000 7f6169361b80 1 --2- 172.21.15.82:0/3463078261 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560e746b5c40 0x560e746c1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.009+0000 7f6169361b80 1 --2- 172.21.15.82:0/3463078261 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560e746bb380 0x560e746beea0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.009+0000 7f612effd700 0 client.15690 ms_handle_reset on v2:172.21.15.161:6836/43639843 2023-09-23T08:57:16.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.009+0000 7f6169361b80 1 -- 172.21.15.82:0/3463078261 >> 172.21.15.82:0/3463078261 conn(0x560e7462a0e0 msgr2=0x560e746aab40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:16.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.009+0000 7f6169361b80 1 -- 172.21.15.82:0/3463078261 shutdown_connections 2023-09-23T08:57:16.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.009+0000 7f6169361b80 1 -- 172.21.15.82:0/3463078261 wait complete. 2023-09-23T08:57:16.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.009+0000 7f6169361b80 20 client.15690 trim_cache size 0 max 16384 2023-09-23T08:57:16.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.026+0000 7f6169361b80 1 Processor -- start 2023-09-23T08:57:16.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.026+0000 7f6169361b80 1 -- start start 2023-09-23T08:57:16.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.026+0000 7f6169361b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560e746b5c40 0x560e746c17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:16.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.026+0000 7f6169361b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560e746bb380 0x560e746be660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:16.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.026+0000 7f6169361b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e746bbca0 0x560e746beba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:16.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.026+0000 7f6169361b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e74489920 con 0x560e746bb380 2023-09-23T08:57:16.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.026+0000 7f6169361b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e746b0fe0 con 0x560e746bbca0 2023-09-23T08:57:16.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.026+0000 7f6169361b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e746cc0b0 con 0x560e746b5c40 2023-09-23T08:57:16.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.027+0000 7f614e7fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560e746bb380 0x560e746be660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:16.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.027+0000 7f614e7fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560e746bb380 0x560e746be660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51824/0 (socket says 172.21.15.82:51824) 2023-09-23T08:57:16.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.027+0000 7f614e7fc700 1 -- 172.21.15.82:0/4080826931 learned_addr learned my addr 172.21.15.82:0/4080826931 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:57:16.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.027+0000 7f614f7fe700 1 --2- 172.21.15.82:0/4080826931 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e746bbca0 0x560e746beba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:16.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.027+0000 7f614effd700 1 --2- 172.21.15.82:0/4080826931 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560e746b5c40 0x560e746c17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:16.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.027+0000 7f614e7fc700 1 -- 172.21.15.82:0/4080826931 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560e746b5c40 msgr2=0x560e746c17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:16.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.027+0000 7f614e7fc700 1 --2- 172.21.15.82:0/4080826931 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560e746b5c40 0x560e746c17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.027+0000 7f614e7fc700 1 -- 172.21.15.82:0/4080826931 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e746bbca0 msgr2=0x560e746beba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:16.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.027+0000 7f614e7fc700 1 --2- 172.21.15.82:0/4080826931 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e746bbca0 0x560e746beba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.027+0000 7f614e7fc700 1 -- 172.21.15.82:0/4080826931 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560e7441cc60 con 0x560e746bb380 2023-09-23T08:57:16.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.027+0000 7f614f7fe700 1 --2- 172.21.15.82:0/4080826931 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e746bbca0 0x560e746beba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T08:57:16.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.027+0000 7f614e7fc700 1 --2- 172.21.15.82:0/4080826931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560e746bb380 0x560e746be660 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f6144005c40 tx=0x7f6144009290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e7a289df2194aa5 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:16.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.028+0000 7f61367fc700 1 -- 172.21.15.82:0/4080826931 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f614401d040 con 0x560e746bb380 2023-09-23T08:57:16.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.028+0000 7f61367fc700 1 -- 172.21.15.82:0/4080826931 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6144032440 con 0x560e746bb380 2023-09-23T08:57:16.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.028+0000 7f61367fc700 1 -- 172.21.15.82:0/4080826931 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f614400f460 con 0x560e746bb380 2023-09-23T08:57:16.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.028+0000 7f6169361b80 1 -- 172.21.15.82:0/4080826931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560e746bb380 msgr2=0x560e746be660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:16.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.028+0000 7f6169361b80 1 --2- 172.21.15.82:0/4080826931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560e746bb380 0x560e746be660 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f6144005c40 tx=0x7f6144009290 comp rx=0 tx=0).stop 2023-09-23T08:57:16.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.028+0000 7f6169361b80 1 -- 172.21.15.82:0/4080826931 shutdown_connections 2023-09-23T08:57:16.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.028+0000 7f6169361b80 1 --2- 172.21.15.82:0/4080826931 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e746bbca0 0x560e746beba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.028+0000 7f6169361b80 1 --2- 172.21.15.82:0/4080826931 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560e746b5c40 0x560e746c17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.028+0000 7f6169361b80 1 --2- 172.21.15.82:0/4080826931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560e746bb380 0x560e746be660 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.028+0000 7f6169361b80 1 -- 172.21.15.82:0/4080826931 >> 172.21.15.82:0/4080826931 conn(0x560e7462a0e0 msgr2=0x560e746b9050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:16.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.029+0000 7f6169361b80 1 -- 172.21.15.82:0/4080826931 shutdown_connections 2023-09-23T08:57:16.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.029+0000 7f6169361b80 1 -- 172.21.15.82:0/4080826931 wait complete. 2023-09-23T08:57:16.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.029+0000 7f6169361b80 1 -- start start 2023-09-23T08:57:16.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.029+0000 7f6169361b80 1 Processor -- start 2023-09-23T08:57:16.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.030+0000 7f6169361b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e746b5c40 0x560e746b7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:16.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.030+0000 7f6169361b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560e746bb380 0x560e746b8510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:16.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.030+0000 7f6169361b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560e746bbca0 0x560e746b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:16.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.030+0000 7f6169361b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e746b8c10 con 0x560e746bb380 2023-09-23T08:57:16.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.030+0000 7f6169361b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e746b7340 con 0x560e746b5c40 2023-09-23T08:57:16.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.030+0000 7f6169361b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e746b7500 con 0x560e746bbca0 2023-09-23T08:57:16.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.030+0000 7f6169361b80 10 client.0 _ll_register_callbacks cb 0x7f614400b9a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T08:57:16.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.030+0000 7f614e7fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560e746bb380 0x560e746b8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:16.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.030+0000 7f614e7fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560e746bb380 0x560e746b8510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51830/0 (socket says 172.21.15.82:51830) 2023-09-23T08:57:16.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.030+0000 7f614e7fc700 1 -- 172.21.15.82:0/2994756889 learned_addr learned my addr 172.21.15.82:0/2994756889 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:57:16.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.031+0000 7f614effd700 1 --2- 172.21.15.82:0/2994756889 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e746b5c40 0x560e746b7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:16.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.031+0000 7f614e7fc700 1 -- 172.21.15.82:0/2994756889 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560e746bbca0 msgr2=0x560e746b6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:16.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.031+0000 7f614e7fc700 1 --2- 172.21.15.82:0/2994756889 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560e746bbca0 0x560e746b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.031+0000 7f614e7fc700 1 -- 172.21.15.82:0/2994756889 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e746b5c40 msgr2=0x560e746b7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:16.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.031+0000 7f614e7fc700 1 --2- 172.21.15.82:0/2994756889 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e746b5c40 0x560e746b7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.031+0000 7f614e7fc700 1 -- 172.21.15.82:0/2994756889 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560e74487630 con 0x560e746bb380 2023-09-23T08:57:16.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.031+0000 7f614effd700 1 --2- 172.21.15.82:0/2994756889 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e746b5c40 0x560e746b7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T08:57:16.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.031+0000 7f614e7fc700 1 --2- 172.21.15.82:0/2994756889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560e746bb380 0x560e746b8510 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f6144006010 tx=0x7f6144005410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37ee5843a2110c54 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:16.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.031+0000 7f612effd700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T08:57:16.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.031+0000 7f612effd700 1 -- 172.21.15.82:0/2994756889 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f614401d040 con 0x560e746bb380 2023-09-23T08:57:16.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.031+0000 7f6169361b80 1 -- 172.21.15.82:0/2994756889 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560e746a88b0 con 0x560e746bb380 2023-09-23T08:57:16.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.031+0000 7f612effd700 1 -- 172.21.15.82:0/2994756889 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f6144032dc0 con 0x560e746bb380 2023-09-23T08:57:16.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.032+0000 7f612effd700 1 -- 172.21.15.82:0/2994756889 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6144004b20 con 0x560e746bb380 2023-09-23T08:57:16.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.032+0000 7f6169361b80 10 client.15696 fetch_fsmap learned FSMap version 26 2023-09-23T08:57:16.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.032+0000 7f6169361b80 1 -- 172.21.15.82:0/2994756889 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x560e74433de0 con 0x560e746bb380 2023-09-23T08:57:16.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.032+0000 7f612effd700 1 -- 172.21.15.82:0/2994756889 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x560e746a88b0 con 0x560e746bb380 2023-09-23T08:57:16.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.032+0000 7f612effd700 1 -- 172.21.15.82:0/2994756889 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f614400fca0 con 0x560e746bb380 2023-09-23T08:57:16.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.032+0000 7f6169361b80 10 client.15696 fetch_fsmap finished waiting for FSMap version 26 2023-09-23T08:57:16.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.032+0000 7f6169361b80 10 client.15696 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-09-23T08:57:16.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.032+0000 7f6169361b80 20 client.15696 populate_metadata read hostname 'smithi082' 2023-09-23T08:57:16.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.032+0000 7f6169361b80 1 --2- 172.21.15.82:0/2994756889 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x560e74723d90 0x560e74726180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:16.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.032+0000 7f6169361b80 4 client.15696 mds_command: new command op to 24526 tid=0[{"prefix": "damage ls"}] 2023-09-23T08:57:16.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.032+0000 7f6169361b80 1 -- 172.21.15.82:0/2994756889 --> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x560e74600970 con 0x560e74723d90 2023-09-23T08:57:16.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.033+0000 7f614effd700 1 --2- 172.21.15.82:0/2994756889 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x560e74723d90 0x560e74726180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:16.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.033+0000 7f612effd700 10 client.15696 ms_handle_connect on v2:172.21.15.161:6836/43639843 2023-09-23T08:57:16.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.033+0000 7f614effd700 1 --2- 172.21.15.82:0/2994756889 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x560e74723d90 0x560e74726180 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2545ab896ceb9bc7 server_cookie=d47aa6a62ebeca12 in_seq=0 out_seq=0 2023-09-23T08:57:16.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.033+0000 7f612effd700 1 -- 172.21.15.82:0/2994756889 <== mds.2 v2:172.21.15.161:6836/43639843 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x560e74600970 con 0x560e74723d90 2023-09-23T08:57:16.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.034+0000 7f612effd700 10 client.15696 handle_command_reply: tid=0 2023-09-23T08:57:16.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.034+0000 7f6169361b80 1 client.15696 shutdown 2023-09-23T08:57:16.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.034+0000 7f6169361b80 1 -- 172.21.15.82:0/2994756889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560e746bb380 msgr2=0x560e746b8510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:16.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.034+0000 7f6169361b80 1 --2- 172.21.15.82:0/2994756889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560e746bb380 0x560e746b8510 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f6144006010 tx=0x7f6144005410 comp rx=0 tx=0).stop 2023-09-23T08:57:16.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.034+0000 7f6169361b80 1 -- 172.21.15.82:0/2994756889 shutdown_connections 2023-09-23T08:57:16.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.034+0000 7f6169361b80 1 --2- 172.21.15.82:0/2994756889 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x560e74723d90 0x560e74726180 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.034+0000 7f6169361b80 1 --2- 172.21.15.82:0/2994756889 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560e746bbca0 0x560e746b6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.034+0000 7f6169361b80 1 --2- 172.21.15.82:0/2994756889 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e746b5c40 0x560e746b7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.034+0000 7f6169361b80 1 --2- 172.21.15.82:0/2994756889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560e746bb380 0x560e746b8510 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.034+0000 7f6169361b80 1 -- 172.21.15.82:0/2994756889 >> 172.21.15.82:0/2994756889 conn(0x560e7462a0e0 msgr2=0x560e746aa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:16.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.034+0000 7f612effd700 0 client.15696 ms_handle_reset on v2:172.21.15.161:6836/43639843 2023-09-23T08:57:16.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.034+0000 7f6169361b80 1 -- 172.21.15.82:0/2994756889 shutdown_connections 2023-09-23T08:57:16.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.034+0000 7f6169361b80 1 -- 172.21.15.82:0/2994756889 wait complete. 2023-09-23T08:57:16.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.034+0000 7f6169361b80 20 client.15696 trim_cache size 0 max 16384 2023-09-23T08:57:16.042 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2023-09-23T08:57:16.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.035+0000 7f61559ff700 1 -- 172.21.15.82:0/3479503946 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f61380a01e0 msgr2=0x7f61380a26a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:16.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.035+0000 7f61559ff700 1 --2- 172.21.15.82:0/3479503946 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f61380a01e0 0x7f61380a26a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f61440059d0 tx=0x7f6144005510 comp rx=0 tx=0).stop 2023-09-23T08:57:16.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.035+0000 7f61559ff700 1 -- 172.21.15.82:0/3479503946 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6150106880 msgr2=0x7f61500736a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:16.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.035+0000 7f61559ff700 1 --2- 172.21.15.82:0/3479503946 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6150106880 0x7f61500736a0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f614800ef30 tx=0x7f614800c3a0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.035+0000 7f61559ff700 1 -- 172.21.15.82:0/3479503946 shutdown_connections 2023-09-23T08:57:16.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.035+0000 7f61559ff700 1 --2- 172.21.15.82:0/3479503946 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f61380a01e0 0x7f61380a26a0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.035+0000 7f61559ff700 1 --2- 172.21.15.82:0/3479503946 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6150106880 0x7f61500736a0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.035+0000 7f61559ff700 1 --2- 172.21.15.82:0/3479503946 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6150100870 0x7f6150072c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.035+0000 7f61559ff700 1 --2- 172.21.15.82:0/3479503946 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6150101230 0x7f6150073160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.035+0000 7f61559ff700 1 -- 172.21.15.82:0/3479503946 >> 172.21.15.82:0/3479503946 conn(0x7f61500fc3a0 msgr2=0x7f61500fca20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:16.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.035+0000 7f61559ff700 1 -- 172.21.15.82:0/3479503946 shutdown_connections 2023-09-23T08:57:16.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.035+0000 7f61559ff700 1 -- 172.21.15.82:0/3479503946 wait complete. 2023-09-23T08:57:16.057 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-09-23T08:57:16.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:57:15 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/1661708374' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T08:57:16.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.293+0000 7feeeb9ff700 1 -- 172.21.15.82:0/2492428318 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feee4102400 msgr2=0x7feee410a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:16.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.293+0000 7feeeb9ff700 1 --2- 172.21.15.82:0/2492428318 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feee4102400 0x7feee410a8e0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7feed4009990 tx=0x7feed4009ca0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.293+0000 7feeeb9ff700 1 -- 172.21.15.82:0/2492428318 shutdown_connections 2023-09-23T08:57:16.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.293+0000 7feeeb9ff700 1 --2- 172.21.15.82:0/2492428318 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feee410aeb0 0x7feee410d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.293+0000 7feeeb9ff700 1 --2- 172.21.15.82:0/2492428318 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feee4101ae0 0x7feee4101ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.293+0000 7feeeb9ff700 1 --2- 172.21.15.82:0/2492428318 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feee4102400 0x7feee410a8e0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.293+0000 7feeeb9ff700 1 -- 172.21.15.82:0/2492428318 >> 172.21.15.82:0/2492428318 conn(0x7feee40fb260 msgr2=0x7feee40fd680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:16.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.293+0000 7feeeb9ff700 1 -- 172.21.15.82:0/2492428318 shutdown_connections 2023-09-23T08:57:16.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.293+0000 7feeeb9ff700 1 -- 172.21.15.82:0/2492428318 wait complete. 2023-09-23T08:57:16.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.294+0000 7feeeb9ff700 1 Processor -- start 2023-09-23T08:57:16.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.294+0000 7feeeb9ff700 1 -- start start 2023-09-23T08:57:16.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.295+0000 7feeeb9ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feee4101ae0 0x7feee40ff730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:16.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.295+0000 7feeeb9ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feee4102400 0x7feee40ffc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:16.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.295+0000 7feeeb9ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feee410aeb0 0x7feee41a4b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:16.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.295+0000 7feeeb9ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee41004a0 con 0x7feee410aeb0 2023-09-23T08:57:16.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.295+0000 7feeeb9ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee41a5050 con 0x7feee4101ae0 2023-09-23T08:57:16.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.295+0000 7feeeb9ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee41a5190 con 0x7feee4102400 2023-09-23T08:57:16.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.295+0000 7feee979b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feee4101ae0 0x7feee40ff730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:16.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.295+0000 7feee979b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feee4101ae0 0x7feee40ff730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:44582/0 (socket says 172.21.15.82:44582) 2023-09-23T08:57:16.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.295+0000 7feee979b700 1 -- 172.21.15.82:0/2058913246 learned_addr learned my addr 172.21.15.82:0/2058913246 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:57:16.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.295+0000 7feee9f9c700 1 --2- 172.21.15.82:0/2058913246 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feee410aeb0 0x7feee41a4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:16.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.295+0000 7feee8f9a700 1 --2- 172.21.15.82:0/2058913246 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feee4102400 0x7feee40ffc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:16.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.295+0000 7feee979b700 1 -- 172.21.15.82:0/2058913246 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feee4102400 msgr2=0x7feee40ffc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:16.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.295+0000 7feee979b700 1 --2- 172.21.15.82:0/2058913246 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feee4102400 0x7feee40ffc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.295+0000 7feee979b700 1 -- 172.21.15.82:0/2058913246 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feee410aeb0 msgr2=0x7feee41a4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:16.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.295+0000 7feee979b700 1 --2- 172.21.15.82:0/2058913246 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feee410aeb0 0x7feee41a4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.295+0000 7feee979b700 1 -- 172.21.15.82:0/2058913246 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feed40095f0 con 0x7feee4101ae0 2023-09-23T08:57:16.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.296+0000 7feee979b700 1 --2- 172.21.15.82:0/2058913246 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feee4101ae0 0x7feee40ff730 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7feee000e9a0 tx=0x7feee000ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:16.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.296+0000 7feeda7fc700 1 -- 172.21.15.82:0/2058913246 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee0009790 con 0x7feee4101ae0 2023-09-23T08:57:16.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.296+0000 7feeeb9ff700 1 -- 172.21.15.82:0/2058913246 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feee41a53f0 con 0x7feee4101ae0 2023-09-23T08:57:16.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.296+0000 7feeda7fc700 1 -- 172.21.15.82:0/2058913246 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7feee0010430 con 0x7feee4101ae0 2023-09-23T08:57:16.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.296+0000 7feeda7fc700 1 -- 172.21.15.82:0/2058913246 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee000cea0 con 0x7feee4101ae0 2023-09-23T08:57:16.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.296+0000 7feeeb9ff700 1 -- 172.21.15.82:0/2058913246 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feee41a5920 con 0x7feee4101ae0 2023-09-23T08:57:16.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.300+0000 7feeda7fc700 1 -- 172.21.15.82:0/2058913246 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) v1 ==== 134904+0+0 (secure 0 0 0) 0x7feee00105a0 con 0x7feee4101ae0 2023-09-23T08:57:16.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.301+0000 7feeff298b80 1 Processor -- start 2023-09-23T08:57:16.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.301+0000 7feeda7fc700 1 --2- 172.21.15.82:0/2058913246 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7feed00a01e0 0x7feed00a26a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:16.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.302+0000 7feeff298b80 1 -- start start 2023-09-23T08:57:16.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.302+0000 7feeda7fc700 1 -- 172.21.15.82:0/2058913246 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7feee0014070 con 0x7feee4101ae0 2023-09-23T08:57:16.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.302+0000 7feeff298b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563f39807380 0x563f39807760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:16.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.302+0000 7feeff298b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563f39807ca0 0x563f39801700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:16.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.302+0000 7feeff298b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f39801c40 0x563f398020a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:16.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.302+0000 7feeff298b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f397697b0 con 0x563f39807ca0 2023-09-23T08:57:16.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.302+0000 7feee9f9c700 1 --2- 172.21.15.82:0/2058913246 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7feed00a01e0 0x7feed00a26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:16.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.302+0000 7feeff298b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f3975a780 con 0x563f39801c40 2023-09-23T08:57:16.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.302+0000 7feeff298b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f397580a0 con 0x563f39807380 2023-09-23T08:57:16.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.302+0000 7feee979b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563f39807380 0x563f39807760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:16.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.302+0000 7feee979b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563f39807380 0x563f39807760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:34562/0 (socket says 172.21.15.82:34562) 2023-09-23T08:57:16.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.302+0000 7feee979b700 1 -- 172.21.15.82:0/2075157757 learned_addr learned my addr 172.21.15.82:0/2075157757 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:57:16.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.302+0000 7feee8f9a700 1 --2- 172.21.15.82:0/2075157757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563f39807ca0 0x563f39801700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:16.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.303+0000 7feee9f9c700 1 --2- 172.21.15.82:0/2075157757 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f39801c40 0x563f398020a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:16.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.303+0000 7feee979b700 1 -- 172.21.15.82:0/2075157757 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f39801c40 msgr2=0x563f398020a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:16.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.303+0000 7feee979b700 1 --2- 172.21.15.82:0/2075157757 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f39801c40 0x563f398020a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.303+0000 7feee979b700 1 -- 172.21.15.82:0/2075157757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563f39807ca0 msgr2=0x563f39801700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:16.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.303+0000 7feee979b700 1 --2- 172.21.15.82:0/2075157757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563f39807ca0 0x563f39801700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.303+0000 7feee979b700 1 -- 172.21.15.82:0/2075157757 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563f395d3630 con 0x563f39807380 2023-09-23T08:57:16.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.303+0000 7feee9f9c700 1 --2- 172.21.15.82:0/2058913246 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7feed00a01e0 0x7feed00a26a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7feee4101840 tx=0x7feedc013250 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:16.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.303+0000 7feee979b700 1 --2- 172.21.15.82:0/2075157757 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563f39807380 0x563f39807760 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7feee0098f00 tx=0x7feee00989d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ebd52d8641ee7ec6 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:16.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.303+0000 7feecf7fe700 1 -- 172.21.15.82:0/2075157757 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee0098f70 con 0x563f39807380 2023-09-23T08:57:16.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.303+0000 7feecf7fe700 1 -- 172.21.15.82:0/2075157757 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7feee009cda0 con 0x563f39807380 2023-09-23T08:57:16.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.303+0000 7feecf7fe700 1 -- 172.21.15.82:0/2075157757 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee00a0b50 con 0x563f39807380 2023-09-23T08:57:16.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.304+0000 7feeff298b80 1 -- 172.21.15.82:0/2075157757 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563f39807380 msgr2=0x563f39807760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:16.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.304+0000 7feeff298b80 1 --2- 172.21.15.82:0/2075157757 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563f39807380 0x563f39807760 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7feee0098f00 tx=0x7feee00989d0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.304+0000 7feeff298b80 1 -- 172.21.15.82:0/2075157757 shutdown_connections 2023-09-23T08:57:16.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.304+0000 7feeff298b80 1 --2- 172.21.15.82:0/2075157757 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f39801c40 0x563f398020a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.304+0000 7feeff298b80 1 --2- 172.21.15.82:0/2075157757 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563f39807380 0x563f39807760 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.304+0000 7feeff298b80 1 --2- 172.21.15.82:0/2075157757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563f39807ca0 0x563f39801700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.304+0000 7feeff298b80 1 -- 172.21.15.82:0/2075157757 >> 172.21.15.82:0/2075157757 conn(0x563f397760e0 msgr2=0x563f397fc410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:16.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.304+0000 7feeff298b80 1 -- 172.21.15.82:0/2075157757 shutdown_connections 2023-09-23T08:57:16.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.304+0000 7feeff298b80 1 -- 172.21.15.82:0/2075157757 wait complete. 2023-09-23T08:57:16.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.305+0000 7feeff298b80 1 -- start start 2023-09-23T08:57:16.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.305+0000 7feeff298b80 1 Processor -- start 2023-09-23T08:57:16.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.306+0000 7feeff298b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563f39801c40 0x563f3980dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:16.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.306+0000 7feeff298b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f39807380 0x563f3980aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:16.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.306+0000 7feeff298b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563f39807ca0 0x563f3980b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:16.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.306+0000 7feeff298b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f39753990 con 0x563f39801c40 2023-09-23T08:57:16.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.306+0000 7feeff298b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f396f1bb0 con 0x563f39807380 2023-09-23T08:57:16.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.306+0000 7feeff298b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f396f18b0 con 0x563f39807ca0 2023-09-23T08:57:16.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.306+0000 7feeff298b80 10 client.0 _ll_register_callbacks cb 0x563f3963ba80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T08:57:16.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.306+0000 7feee979b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563f39801c40 0x563f3980dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:16.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.306+0000 7feee979b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563f39801c40 0x563f3980dc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51864/0 (socket says 172.21.15.82:51864) 2023-09-23T08:57:16.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.306+0000 7feee979b700 1 -- 172.21.15.82:0/107106906 learned_addr learned my addr 172.21.15.82:0/107106906 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:57:16.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.306+0000 7feee8f9a700 1 --2- 172.21.15.82:0/107106906 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f39807380 0x563f3980aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:16.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.306+0000 7feee9f9c700 1 --2- 172.21.15.82:0/107106906 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563f39807ca0 0x563f3980b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:16.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.307+0000 7feee979b700 1 -- 172.21.15.82:0/107106906 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563f39807ca0 msgr2=0x563f3980b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:16.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.307+0000 7feee979b700 1 --2- 172.21.15.82:0/107106906 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563f39807ca0 0x563f3980b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.307+0000 7feee979b700 1 -- 172.21.15.82:0/107106906 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f39807380 msgr2=0x563f3980aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:16.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.307+0000 7feee979b700 1 --2- 172.21.15.82:0/107106906 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f39807380 0x563f3980aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.307+0000 7feee979b700 1 -- 172.21.15.82:0/107106906 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feee41a5920 con 0x563f39801c40 2023-09-23T08:57:16.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.307+0000 7feee8f9a700 1 --2- 172.21.15.82:0/107106906 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f39807380 0x563f3980aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T08:57:16.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.307+0000 7feee979b700 1 --2- 172.21.15.82:0/107106906 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563f39801c40 0x563f3980dc20 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7feee000e970 tx=0x7feee00a0bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6ffd048cd8b5f99 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:16.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.307+0000 7feeccff9700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T08:57:16.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.307+0000 7feeccff9700 1 -- 172.21.15.82:0/107106906 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee009cda0 con 0x563f39801c40 2023-09-23T08:57:16.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.308+0000 7feeccff9700 1 -- 172.21.15.82:0/107106906 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7feee00a0d80 con 0x563f39801c40 2023-09-23T08:57:16.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.308+0000 7feeff298b80 1 -- 172.21.15.82:0/107106906 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563f397d11c0 con 0x563f39801c40 2023-09-23T08:57:16.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.308+0000 7feeccff9700 1 -- 172.21.15.82:0/107106906 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7feee0098f70 con 0x563f39801c40 2023-09-23T08:57:16.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.308+0000 7feeff298b80 10 client.15708 fetch_fsmap learned FSMap version 26 2023-09-23T08:57:16.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.308+0000 7feeff298b80 1 -- 172.21.15.82:0/107106906 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x563f3957fde0 con 0x563f39801c40 2023-09-23T08:57:16.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.308+0000 7feeccff9700 1 -- 172.21.15.82:0/107106906 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x563f397d11c0 con 0x563f39801c40 2023-09-23T08:57:16.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.308+0000 7feeccff9700 1 -- 172.21.15.82:0/107106906 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7feee00b80c0 con 0x563f39801c40 2023-09-23T08:57:16.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.308+0000 7feeff298b80 10 client.15708 fetch_fsmap finished waiting for FSMap version 26 2023-09-23T08:57:16.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.308+0000 7feeff298b80 10 client.15708 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-23T08:57:16.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.308+0000 7feeff298b80 20 client.15708 populate_metadata read hostname 'smithi082' 2023-09-23T08:57:16.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.308+0000 7feeff298b80 1 --2- 172.21.15.82:0/107106906 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x563f3981b3a0 0x563f3981d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:16.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.309+0000 7feeff298b80 4 client.15708 mds_command: new command op to 24550 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T08:57:16.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.309+0000 7feeff298b80 1 -- 172.21.15.82:0/107106906 --> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563f396f9ba0 con 0x563f3981b3a0 2023-09-23T08:57:16.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.309+0000 7feee8f9a700 1 --2- 172.21.15.82:0/107106906 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x563f3981b3a0 0x563f3981d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:16.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.310+0000 7feee8f9a700 1 --2- 172.21.15.82:0/107106906 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x563f3981b3a0 0x563f3981d790 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=633673950ae45615 server_cookie=b86d949d62bfade in_seq=0 out_seq=0 2023-09-23T08:57:16.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.310+0000 7feeccff9700 10 client.15708 ms_handle_connect on v2:172.21.15.161:6838/758982817 2023-09-23T08:57:16.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.310+0000 7feeccff9700 1 -- 172.21.15.82:0/107106906 <== mds.1 v2:172.21.15.161:6838/758982817 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x563f396f9ba0 con 0x563f3981b3a0 2023-09-23T08:57:16.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.310+0000 7feeccff9700 10 client.15708 handle_command_reply: tid=0 2023-09-23T08:57:16.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.310+0000 7feeff298b80 1 client.15708 shutdown 2023-09-23T08:57:16.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.311+0000 7feeff298b80 1 -- 172.21.15.82:0/107106906 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563f39801c40 msgr2=0x563f3980dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:16.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.311+0000 7feeff298b80 1 --2- 172.21.15.82:0/107106906 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563f39801c40 0x563f3980dc20 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7feee000e970 tx=0x7feee00a0bd0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.311+0000 7feeff298b80 1 -- 172.21.15.82:0/107106906 shutdown_connections 2023-09-23T08:57:16.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.311+0000 7feeff298b80 1 --2- 172.21.15.82:0/107106906 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x563f3981b3a0 0x563f3981d790 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.311+0000 7feeff298b80 1 --2- 172.21.15.82:0/107106906 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563f39807ca0 0x563f3980b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.311+0000 7feeff298b80 1 --2- 172.21.15.82:0/107106906 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563f39801c40 0x563f3980dc20 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.311+0000 7feeccff9700 0 client.15708 ms_handle_reset on v2:172.21.15.161:6838/758982817 2023-09-23T08:57:16.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.311+0000 7feeff298b80 1 --2- 172.21.15.82:0/107106906 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f39807380 0x563f3980aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.311+0000 7feeff298b80 1 -- 172.21.15.82:0/107106906 >> 172.21.15.82:0/107106906 conn(0x563f397760e0 msgr2=0x563f397f6b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:16.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.311+0000 7feeff298b80 1 -- 172.21.15.82:0/107106906 shutdown_connections 2023-09-23T08:57:16.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.311+0000 7feeff298b80 1 -- 172.21.15.82:0/107106906 wait complete. 2023-09-23T08:57:16.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.311+0000 7feeff298b80 20 client.15708 trim_cache size 0 max 16384 2023-09-23T08:57:16.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.326+0000 7feeff298b80 1 Processor -- start 2023-09-23T08:57:16.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.327+0000 7feeff298b80 1 -- start start 2023-09-23T08:57:16.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.327+0000 7feeff298b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f39801c40 0x563f3980b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:16.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.327+0000 7feeff298b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563f39807380 0x563f3980d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:16.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.327+0000 7feeff298b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563f39807ca0 0x563f397fc160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:16.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.327+0000 7feeff298b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f395d5920 con 0x563f39807380 2023-09-23T08:57:16.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.327+0000 7feeff298b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f3980c4f0 con 0x563f39801c40 2023-09-23T08:57:16.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.327+0000 7feeff298b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f3980e320 con 0x563f39807ca0 2023-09-23T08:57:16.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.327+0000 7feee979b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f39801c40 0x563f3980b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:16.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.327+0000 7feee979b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f39801c40 0x563f3980b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:44610/0 (socket says 172.21.15.82:44610) 2023-09-23T08:57:16.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.327+0000 7feee979b700 1 -- 172.21.15.82:0/1420324030 learned_addr learned my addr 172.21.15.82:0/1420324030 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:57:16.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.328+0000 7feee8f9a700 1 --2- 172.21.15.82:0/1420324030 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563f39807380 0x563f3980d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:16.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.328+0000 7feee9f9c700 1 --2- 172.21.15.82:0/1420324030 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563f39807ca0 0x563f397fc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:16.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.328+0000 7feee979b700 1 -- 172.21.15.82:0/1420324030 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563f39807ca0 msgr2=0x563f397fc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:16.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.328+0000 7feee979b700 1 --2- 172.21.15.82:0/1420324030 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563f39807ca0 0x563f397fc160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.328+0000 7feee979b700 1 -- 172.21.15.82:0/1420324030 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563f39807380 msgr2=0x563f3980d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:16.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.328+0000 7feee979b700 1 --2- 172.21.15.82:0/1420324030 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563f39807380 0x563f3980d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.328+0000 7feee979b700 1 -- 172.21.15.82:0/1420324030 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563f39568c60 con 0x563f39801c40 2023-09-23T08:57:16.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.328+0000 7feee979b700 1 --2- 172.21.15.82:0/1420324030 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f39801c40 0x563f3980b500 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7feee00959e0 tx=0x7feee0098be0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d29c60f0e6df105 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:16.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.329+0000 7feecffff700 1 -- 172.21.15.82:0/1420324030 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee009cda0 con 0x563f39801c40 2023-09-23T08:57:16.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.329+0000 7feecffff700 1 -- 172.21.15.82:0/1420324030 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7feee00988d0 con 0x563f39801c40 2023-09-23T08:57:16.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.329+0000 7feecffff700 1 -- 172.21.15.82:0/1420324030 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee0098f70 con 0x563f39801c40 2023-09-23T08:57:16.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.329+0000 7feeff298b80 1 -- 172.21.15.82:0/1420324030 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f39801c40 msgr2=0x563f3980b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:16.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.329+0000 7feeff298b80 1 --2- 172.21.15.82:0/1420324030 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f39801c40 0x563f3980b500 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7feee00959e0 tx=0x7feee0098be0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.329+0000 7feeff298b80 1 -- 172.21.15.82:0/1420324030 shutdown_connections 2023-09-23T08:57:16.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.329+0000 7feeff298b80 1 --2- 172.21.15.82:0/1420324030 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563f39807ca0 0x563f397fc160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.329+0000 7feeff298b80 1 --2- 172.21.15.82:0/1420324030 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f39801c40 0x563f3980b500 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.329+0000 7feeff298b80 1 --2- 172.21.15.82:0/1420324030 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563f39807380 0x563f3980d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.329+0000 7feeff298b80 1 -- 172.21.15.82:0/1420324030 >> 172.21.15.82:0/1420324030 conn(0x563f397760e0 msgr2=0x563f39816e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:16.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.330+0000 7feeff298b80 1 -- 172.21.15.82:0/1420324030 shutdown_connections 2023-09-23T08:57:16.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.330+0000 7feeff298b80 1 -- 172.21.15.82:0/1420324030 wait complete. 2023-09-23T08:57:16.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.330+0000 7feeff298b80 1 -- start start 2023-09-23T08:57:16.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.330+0000 7feeff298b80 1 Processor -- start 2023-09-23T08:57:16.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.331+0000 7feeff298b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563f39801c40 0x563f39812930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:16.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.331+0000 7feeff298b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f39807380 0x563f39802e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:16.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.331+0000 7feeff298b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563f39807ca0 0x563f39803340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:16.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.331+0000 7feeff298b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f39803a30 con 0x563f39801c40 2023-09-23T08:57:16.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.331+0000 7feeff298b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f39803ba0 con 0x563f39807380 2023-09-23T08:57:16.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.331+0000 7feeff298b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f39803d60 con 0x563f39807ca0 2023-09-23T08:57:16.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.331+0000 7feeff298b80 10 client.0 _ll_register_callbacks cb 0x563f3963ba80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T08:57:16.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.331+0000 7feee979b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563f39801c40 0x563f39812930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:16.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.331+0000 7feee979b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563f39801c40 0x563f39812930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51874/0 (socket says 172.21.15.82:51874) 2023-09-23T08:57:16.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.331+0000 7feee979b700 1 -- 172.21.15.82:0/1714309140 learned_addr learned my addr 172.21.15.82:0/1714309140 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:57:16.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.331+0000 7feee9f9c700 1 --2- 172.21.15.82:0/1714309140 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563f39807ca0 0x563f39803340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:16.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.331+0000 7feee8f9a700 1 --2- 172.21.15.82:0/1714309140 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f39807380 0x563f39802e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:16.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.332+0000 7feee979b700 1 -- 172.21.15.82:0/1714309140 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563f39807ca0 msgr2=0x563f39803340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:16.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.332+0000 7feee979b700 1 --2- 172.21.15.82:0/1714309140 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563f39807ca0 0x563f39803340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.332+0000 7feee979b700 1 -- 172.21.15.82:0/1714309140 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f39807380 msgr2=0x563f39802e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:16.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.332+0000 7feee979b700 1 --2- 172.21.15.82:0/1714309140 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f39807380 0x563f39802e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.332+0000 7feee979b700 1 -- 172.21.15.82:0/1714309140 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563f3957fde0 con 0x563f39801c40 2023-09-23T08:57:16.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.332+0000 7feee979b700 1 --2- 172.21.15.82:0/1714309140 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563f39801c40 0x563f39812930 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7feee00b8450 tx=0x7feee0095160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b1433b4aa4df558 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:16.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.332+0000 7feeccff9700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T08:57:16.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.332+0000 7feeccff9700 1 -- 172.21.15.82:0/1714309140 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee009cda0 con 0x563f39801c40 2023-09-23T08:57:16.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.332+0000 7feeccff9700 1 -- 172.21.15.82:0/1714309140 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7feee0098f70 con 0x563f39801c40 2023-09-23T08:57:16.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.332+0000 7feeff298b80 1 -- 172.21.15.82:0/1714309140 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563f397f48b0 con 0x563f39801c40 2023-09-23T08:57:16.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.332+0000 7feeccff9700 1 -- 172.21.15.82:0/1714309140 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7feee00a0d80 con 0x563f39801c40 2023-09-23T08:57:16.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.333+0000 7feeff298b80 10 client.15714 fetch_fsmap learned FSMap version 26 2023-09-23T08:57:16.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.333+0000 7feeff298b80 1 -- 172.21.15.82:0/1714309140 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x563f395a6250 con 0x563f39801c40 2023-09-23T08:57:16.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.333+0000 7feeccff9700 1 -- 172.21.15.82:0/1714309140 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x563f397f48b0 con 0x563f39801c40 2023-09-23T08:57:16.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.333+0000 7feeccff9700 1 -- 172.21.15.82:0/1714309140 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7feee0097f60 con 0x563f39801c40 2023-09-23T08:57:16.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.333+0000 7feeff298b80 10 client.15714 fetch_fsmap finished waiting for FSMap version 26 2023-09-23T08:57:16.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.333+0000 7feeff298b80 10 client.15714 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-23T08:57:16.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.333+0000 7feeff298b80 20 client.15714 populate_metadata read hostname 'smithi082' 2023-09-23T08:57:16.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.333+0000 7feeff298b80 1 --2- 172.21.15.82:0/1714309140 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x563f39877c10 0x563f3987a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:16.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.333+0000 7feeff298b80 4 client.15714 mds_command: new command op to 24550 tid=0[{"prefix": "damage ls"}] 2023-09-23T08:57:16.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.333+0000 7feeff298b80 1 -- 172.21.15.82:0/1714309140 --> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x563f3974c970 con 0x563f39877c10 2023-09-23T08:57:16.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.334+0000 7feee8f9a700 1 --2- 172.21.15.82:0/1714309140 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x563f39877c10 0x563f3987a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:16.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.334+0000 7feee8f9a700 1 --2- 172.21.15.82:0/1714309140 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x563f39877c10 0x563f3987a000 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d7aca4cb303f330b server_cookie=444dfc2aa695f072 in_seq=0 out_seq=0 2023-09-23T08:57:16.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.334+0000 7feeccff9700 10 client.15714 ms_handle_connect on v2:172.21.15.161:6838/758982817 2023-09-23T08:57:16.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.334+0000 7feeccff9700 1 -- 172.21.15.82:0/1714309140 <== mds.1 v2:172.21.15.161:6838/758982817 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x563f3974c970 con 0x563f39877c10 2023-09-23T08:57:16.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.334+0000 7feeccff9700 10 client.15714 handle_command_reply: tid=0 2023-09-23T08:57:16.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.334+0000 7feeff298b80 1 client.15714 shutdown 2023-09-23T08:57:16.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.335+0000 7feeff298b80 1 -- 172.21.15.82:0/1714309140 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563f39801c40 msgr2=0x563f39812930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:16.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.335+0000 7feeff298b80 1 --2- 172.21.15.82:0/1714309140 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563f39801c40 0x563f39812930 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7feee00b8450 tx=0x7feee0095160 comp rx=0 tx=0).stop 2023-09-23T08:57:16.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.335+0000 7feeff298b80 1 -- 172.21.15.82:0/1714309140 shutdown_connections 2023-09-23T08:57:16.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.335+0000 7feeff298b80 1 --2- 172.21.15.82:0/1714309140 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x563f39877c10 0x563f3987a000 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.335+0000 7feeff298b80 1 --2- 172.21.15.82:0/1714309140 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563f39807ca0 0x563f39803340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.335+0000 7feeff298b80 1 --2- 172.21.15.82:0/1714309140 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563f39801c40 0x563f39812930 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.335+0000 7feeccff9700 0 client.15714 ms_handle_reset on v2:172.21.15.161:6838/758982817 2023-09-23T08:57:16.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.335+0000 7feeff298b80 1 --2- 172.21.15.82:0/1714309140 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f39807380 0x563f39802e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.335+0000 7feeff298b80 1 -- 172.21.15.82:0/1714309140 >> 172.21.15.82:0/1714309140 conn(0x563f397760e0 msgr2=0x563f397fc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:16.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.335+0000 7feeff298b80 1 -- 172.21.15.82:0/1714309140 shutdown_connections 2023-09-23T08:57:16.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.335+0000 7feeff298b80 1 -- 172.21.15.82:0/1714309140 wait complete. 2023-09-23T08:57:16.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.335+0000 7feeff298b80 20 client.15714 trim_cache size 0 max 16384 2023-09-23T08:57:16.343 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2023-09-23T08:57:16.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.336+0000 7feeeb9ff700 1 -- 172.21.15.82:0/2058913246 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7feed00a01e0 msgr2=0x7feed00a26a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:16.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.336+0000 7feeeb9ff700 1 --2- 172.21.15.82:0/2058913246 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7feed00a01e0 0x7feed00a26a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7feee4101840 tx=0x7feedc013250 comp rx=0 tx=0).stop 2023-09-23T08:57:16.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.336+0000 7feeeb9ff700 1 -- 172.21.15.82:0/2058913246 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feee4101ae0 msgr2=0x7feee40ff730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:16.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.336+0000 7feeeb9ff700 1 --2- 172.21.15.82:0/2058913246 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feee4101ae0 0x7feee40ff730 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7feee000e9a0 tx=0x7feee000ecb0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.336+0000 7feeeb9ff700 1 -- 172.21.15.82:0/2058913246 shutdown_connections 2023-09-23T08:57:16.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.336+0000 7feeeb9ff700 1 --2- 172.21.15.82:0/2058913246 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7feed00a01e0 0x7feed00a26a0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.336+0000 7feeeb9ff700 1 --2- 172.21.15.82:0/2058913246 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feee410aeb0 0x7feee41a4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.336+0000 7feeeb9ff700 1 --2- 172.21.15.82:0/2058913246 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feee4101ae0 0x7feee40ff730 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.336+0000 7feeeb9ff700 1 --2- 172.21.15.82:0/2058913246 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feee4102400 0x7feee40ffc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.336+0000 7feeeb9ff700 1 -- 172.21.15.82:0/2058913246 >> 172.21.15.82:0/2058913246 conn(0x7feee40fb260 msgr2=0x7feee40fbed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:16.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.336+0000 7feeeb9ff700 1 -- 172.21.15.82:0/2058913246 shutdown_connections 2023-09-23T08:57:16.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.336+0000 7feeeb9ff700 1 -- 172.21.15.82:0/2058913246 wait complete. 2023-09-23T08:57:16.359 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-09-23T08:57:16.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.589+0000 7f42e999d700 1 -- 172.21.15.82:0/2544249874 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42e41018e0 msgr2=0x7f42e4101cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:16.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.589+0000 7f42e999d700 1 --2- 172.21.15.82:0/2544249874 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42e41018e0 0x7f42e4101cc0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f42d8009990 tx=0x7f42d8009ca0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.589+0000 7f42e999d700 1 -- 172.21.15.82:0/2544249874 shutdown_connections 2023-09-23T08:57:16.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.589+0000 7f42e999d700 1 --2- 172.21.15.82:0/2544249874 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f42e410acb0 0x7f42e410d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.589+0000 7f42e999d700 1 --2- 172.21.15.82:0/2544249874 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42e41018e0 0x7f42e4101cc0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.589+0000 7f42e999d700 1 --2- 172.21.15.82:0/2544249874 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42e4102200 0x7f42e410a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.589+0000 7f42e999d700 1 -- 172.21.15.82:0/2544249874 >> 172.21.15.82:0/2544249874 conn(0x7f42e40fb080 msgr2=0x7f42e40fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:16.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.589+0000 7f42e999d700 1 -- 172.21.15.82:0/2544249874 shutdown_connections 2023-09-23T08:57:16.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.589+0000 7f42e999d700 1 -- 172.21.15.82:0/2544249874 wait complete. 2023-09-23T08:57:16.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.590+0000 7f42e999d700 1 Processor -- start 2023-09-23T08:57:16.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.590+0000 7f42e999d700 1 -- start start 2023-09-23T08:57:16.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.591+0000 7f42e999d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42e41018e0 0x7f42e419e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:16.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.591+0000 7f42e999d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42e4102200 0x7f42e419eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:16.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.591+0000 7f42e999d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f42e410acb0 0x7f42e41986d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:16.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.591+0000 7f42e999d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42e4198d40 con 0x7f42e4102200 2023-09-23T08:57:16.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.591+0000 7f42e999d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42e4198eb0 con 0x7f42e41018e0 2023-09-23T08:57:16.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.591+0000 7f42e999d700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42e4199070 con 0x7f42e410acb0 2023-09-23T08:57:16.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.591+0000 7f42e899b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42e41018e0 0x7f42e419e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:16.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.591+0000 7f42e899b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42e41018e0 0x7f42e419e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:44630/0 (socket says 172.21.15.82:44630) 2023-09-23T08:57:16.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.591+0000 7f42e899b700 1 -- 172.21.15.82:0/595351293 learned_addr learned my addr 172.21.15.82:0/595351293 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:57:16.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.591+0000 7f42e3fff700 1 --2- 172.21.15.82:0/595351293 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42e4102200 0x7f42e419eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:16.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.591+0000 7f42e899b700 1 -- 172.21.15.82:0/595351293 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f42e410acb0 msgr2=0x7f42e41986d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-09-23T08:57:16.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.591+0000 7f42e899b700 1 --2- 172.21.15.82:0/595351293 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f42e410acb0 0x7f42e41986d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.591+0000 7f42e899b700 1 -- 172.21.15.82:0/595351293 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42e4102200 msgr2=0x7f42e419eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:16.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.591+0000 7f42e899b700 1 --2- 172.21.15.82:0/595351293 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42e4102200 0x7f42e419eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.591+0000 7f42e899b700 1 -- 172.21.15.82:0/595351293 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42d80095f0 con 0x7f42e41018e0 2023-09-23T08:57:16.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.592+0000 7f42e899b700 1 --2- 172.21.15.82:0/595351293 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42e41018e0 0x7f42e419e660 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f42d8005740 tx=0x7f42d8005770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:16.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.592+0000 7f42e1ffb700 1 -- 172.21.15.82:0/595351293 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42d801d070 con 0x7f42e41018e0 2023-09-23T08:57:16.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.592+0000 7f42e999d700 1 -- 172.21.15.82:0/595351293 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42e41992f0 con 0x7f42e41018e0 2023-09-23T08:57:16.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.593+0000 7f42e1ffb700 1 -- 172.21.15.82:0/595351293 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f42d8022470 con 0x7f42e41018e0 2023-09-23T08:57:16.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.593+0000 7f42e1ffb700 1 -- 172.21.15.82:0/595351293 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42d8022ea0 con 0x7f42e41018e0 2023-09-23T08:57:16.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.593+0000 7f42e999d700 1 -- 172.21.15.82:0/595351293 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42e41a5650 con 0x7f42e41018e0 2023-09-23T08:57:16.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.596+0000 7f42e1ffb700 1 -- 172.21.15.82:0/595351293 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) v1 ==== 134904+0+0 (secure 0 0 0) 0x7f42d8022830 con 0x7f42e41018e0 2023-09-23T08:57:16.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.597+0000 7f42e1ffb700 1 --2- 172.21.15.82:0/595351293 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f42d40a0280 0x7f42d40a2740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:16.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.598+0000 7f42fe45cb80 1 Processor -- start 2023-09-23T08:57:16.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.598+0000 7f42e1ffb700 1 -- 172.21.15.82:0/595351293 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f42d80ccaa0 con 0x7f42e41018e0 2023-09-23T08:57:16.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.598+0000 7f42e3fff700 1 --2- 172.21.15.82:0/595351293 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f42d40a0280 0x7f42d40a2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:16.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.598+0000 7f42fe45cb80 1 -- start start 2023-09-23T08:57:16.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.598+0000 7f42fe45cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560dbbb77500 0x560dbbb778e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:16.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.598+0000 7f42fe45cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560dbbb77e20 0x560dbbb71700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:16.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.598+0000 7f42fe45cb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560dbbb71c40 0x560dbbb72080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:16.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.598+0000 7f42fe45cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560dbbad97b0 con 0x560dbbb77500 2023-09-23T08:57:16.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.598+0000 7f42fe45cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x560dbbaca780 con 0x560dbbb77e20 2023-09-23T08:57:16.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.598+0000 7f42fe45cb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x560dbbac80a0 con 0x560dbbb71c40 2023-09-23T08:57:16.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.599+0000 7f42e3fff700 1 --2- 172.21.15.82:0/595351293 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f42d40a0280 0x7f42d40a2740 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f42e4199b40 tx=0x7f42d0009260 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:16.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.599+0000 7f42e899b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560dbbb77500 0x560dbbb778e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:16.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.599+0000 7f42e899b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560dbbb77500 0x560dbbb778e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51894/0 (socket says 172.21.15.82:51894) 2023-09-23T08:57:16.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.599+0000 7f42e899b700 1 -- 172.21.15.82:0/1491492362 learned_addr learned my addr 172.21.15.82:0/1491492362 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:57:16.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.599+0000 7f42e919c700 1 --2- 172.21.15.82:0/1491492362 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560dbbb71c40 0x560dbbb72080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:16.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.599+0000 7f42e3fff700 1 --2- 172.21.15.82:0/1491492362 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560dbbb77e20 0x560dbbb71700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:16.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.599+0000 7f42e899b700 1 -- 172.21.15.82:0/1491492362 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560dbbb71c40 msgr2=0x560dbbb72080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:16.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.599+0000 7f42e899b700 1 --2- 172.21.15.82:0/1491492362 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560dbbb71c40 0x560dbbb72080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.599+0000 7f42e899b700 1 -- 172.21.15.82:0/1491492362 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560dbbb77e20 msgr2=0x560dbbb71700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:16.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.599+0000 7f42e899b700 1 --2- 172.21.15.82:0/1491492362 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560dbbb77e20 0x560dbbb71700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.599+0000 7f42e899b700 1 -- 172.21.15.82:0/1491492362 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560dbb943630 con 0x560dbbb77500 2023-09-23T08:57:16.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.599+0000 7f42e3fff700 1 --2- 172.21.15.82:0/1491492362 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560dbbb77e20 0x560dbbb71700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T08:57:16.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.599+0000 7f42e899b700 1 --2- 172.21.15.82:0/1491492362 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560dbbb77500 0x560dbbb778e0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f42d8006010 tx=0x7f42d8009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee9babeca1fd7ec0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:16.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.600+0000 7f42ceffd700 1 -- 172.21.15.82:0/1491492362 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42d809a6c0 con 0x560dbbb77500 2023-09-23T08:57:16.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.600+0000 7f42ceffd700 1 -- 172.21.15.82:0/1491492362 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f42d8099fc0 con 0x560dbbb77500 2023-09-23T08:57:16.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.600+0000 7f42ceffd700 1 -- 172.21.15.82:0/1491492362 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42d80996d0 con 0x560dbbb77500 2023-09-23T08:57:16.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.600+0000 7f42fe45cb80 1 -- 172.21.15.82:0/1491492362 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560dbbb77500 msgr2=0x560dbbb778e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:16.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.600+0000 7f42fe45cb80 1 --2- 172.21.15.82:0/1491492362 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560dbbb77500 0x560dbbb778e0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f42d8006010 tx=0x7f42d8009310 comp rx=0 tx=0).stop 2023-09-23T08:57:16.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.601+0000 7f42fe45cb80 1 -- 172.21.15.82:0/1491492362 shutdown_connections 2023-09-23T08:57:16.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.601+0000 7f42fe45cb80 1 --2- 172.21.15.82:0/1491492362 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560dbbb71c40 0x560dbbb72080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.601+0000 7f42fe45cb80 1 --2- 172.21.15.82:0/1491492362 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560dbbb77500 0x560dbbb778e0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.601+0000 7f42fe45cb80 1 --2- 172.21.15.82:0/1491492362 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560dbbb77e20 0x560dbbb71700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.601+0000 7f42fe45cb80 1 -- 172.21.15.82:0/1491492362 >> 172.21.15.82:0/1491492362 conn(0x560dbbae60e0 msgr2=0x560dbbb6c940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:16.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.601+0000 7f42fe45cb80 1 -- 172.21.15.82:0/1491492362 shutdown_connections 2023-09-23T08:57:16.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.601+0000 7f42fe45cb80 1 -- 172.21.15.82:0/1491492362 wait complete. 2023-09-23T08:57:16.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.601+0000 7f42fe45cb80 1 -- start start 2023-09-23T08:57:16.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.602+0000 7f42fe45cb80 1 Processor -- start 2023-09-23T08:57:16.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.602+0000 7f42fe45cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560dbbb71c40 0x560dbbb7dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:16.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.602+0000 7f42fe45cb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560dbbb77500 0x560dbbb7b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:16.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.602+0000 7f42fe45cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560dbbb77e20 0x560dbbb7b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:16.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.602+0000 7f42fe45cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560dbbac3990 con 0x560dbbb71c40 2023-09-23T08:57:16.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.602+0000 7f42fe45cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x560dbba61bb0 con 0x560dbbb77e20 2023-09-23T08:57:16.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.602+0000 7f42fe45cb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x560dbba618b0 con 0x560dbbb77500 2023-09-23T08:57:16.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.602+0000 7f42fe45cb80 10 client.0 _ll_register_callbacks cb 0x560dbb9aba80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T08:57:16.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.603+0000 7f42e899b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560dbbb71c40 0x560dbbb7dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:16.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.603+0000 7f42e899b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560dbbb71c40 0x560dbbb7dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51898/0 (socket says 172.21.15.82:51898) 2023-09-23T08:57:16.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.603+0000 7f42e899b700 1 -- 172.21.15.82:0/1277152286 learned_addr learned my addr 172.21.15.82:0/1277152286 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:57:16.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.603+0000 7f42e919c700 1 --2- 172.21.15.82:0/1277152286 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560dbbb77e20 0x560dbbb7b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:16.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.603+0000 7f42e899b700 1 -- 172.21.15.82:0/1277152286 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560dbbb77500 msgr2=0x560dbbb7b000 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-23T08:57:16.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.603+0000 7f42e899b700 1 --2- 172.21.15.82:0/1277152286 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560dbbb77500 0x560dbbb7b000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.603+0000 7f42e899b700 1 -- 172.21.15.82:0/1277152286 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560dbbb77e20 msgr2=0x560dbbb7b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:16.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.603+0000 7f42e899b700 1 --2- 172.21.15.82:0/1277152286 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560dbbb77e20 0x560dbbb7b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.603+0000 7f42e899b700 1 -- 172.21.15.82:0/1277152286 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42e41a5650 con 0x560dbbb71c40 2023-09-23T08:57:16.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.603+0000 7f42e899b700 1 --2- 172.21.15.82:0/1277152286 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560dbbb71c40 0x560dbbb7dce0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f42d80964c0 tx=0x7f42d8099870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adf53dca4784fa04 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:16.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.603+0000 7f42c3fff700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T08:57:16.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.603+0000 7f42c3fff700 1 -- 172.21.15.82:0/1277152286 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42d809a6c0 con 0x560dbbb71c40 2023-09-23T08:57:16.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.604+0000 7f42c3fff700 1 -- 172.21.15.82:0/1277152286 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f42d809ddf0 con 0x560dbbb71c40 2023-09-23T08:57:16.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.604+0000 7f42fe45cb80 1 -- 172.21.15.82:0/1277152286 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560dbbb411c0 con 0x560dbbb71c40 2023-09-23T08:57:16.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.604+0000 7f42c3fff700 1 -- 172.21.15.82:0/1277152286 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f42d8099fc0 con 0x560dbbb71c40 2023-09-23T08:57:16.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.604+0000 7f42fe45cb80 10 client.15726 fetch_fsmap learned FSMap version 26 2023-09-23T08:57:16.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.604+0000 7f42fe45cb80 1 -- 172.21.15.82:0/1277152286 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x560dbb8efde0 con 0x560dbbb71c40 2023-09-23T08:57:16.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.604+0000 7f42c3fff700 1 -- 172.21.15.82:0/1277152286 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f42d807c020 con 0x560dbbb71c40 2023-09-23T08:57:16.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.604+0000 7f42c3fff700 1 -- 172.21.15.82:0/1277152286 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f42d80b9140 con 0x560dbbb71c40 2023-09-23T08:57:16.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.604+0000 7f42fe45cb80 10 client.15726 fetch_fsmap finished waiting for FSMap version 26 2023-09-23T08:57:16.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.604+0000 7f42fe45cb80 10 client.15726 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T08:57:16.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.604+0000 7f42fe45cb80 20 client.15726 populate_metadata read hostname 'smithi082' 2023-09-23T08:57:16.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.604+0000 7f42fe45cb80 1 --2- 172.21.15.82:0/1277152286 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x560dbbb8b150 0x560dbbb8d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:16.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.604+0000 7f42fe45cb80 4 client.15726 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T08:57:16.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.604+0000 7f42fe45cb80 1 -- 172.21.15.82:0/1277152286 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560dbba69ba0 con 0x560dbbb8b150 2023-09-23T08:57:16.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.604+0000 7f42e3fff700 1 --2- 172.21.15.82:0/1277152286 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x560dbbb8b150 0x560dbbb8d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:16.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.605+0000 7f42c3fff700 10 client.15726 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T08:57:16.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.605+0000 7f42e3fff700 1 --2- 172.21.15.82:0/1277152286 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x560dbbb8b150 0x560dbbb8d570 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42820515423081e3 server_cookie=9701c72b8f713b83 in_seq=0 out_seq=0 2023-09-23T08:57:16.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.606+0000 7f42c3fff700 1 -- 172.21.15.82:0/1277152286 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x560dbba69ba0 con 0x560dbbb8b150 2023-09-23T08:57:16.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.606+0000 7f42c3fff700 10 client.15726 handle_command_reply: tid=0 2023-09-23T08:57:16.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.606+0000 7f42fe45cb80 1 client.15726 shutdown 2023-09-23T08:57:16.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.606+0000 7f42fe45cb80 1 -- 172.21.15.82:0/1277152286 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560dbbb71c40 msgr2=0x560dbbb7dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:16.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.606+0000 7f42fe45cb80 1 --2- 172.21.15.82:0/1277152286 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560dbbb71c40 0x560dbbb7dce0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f42d80964c0 tx=0x7f42d8099870 comp rx=0 tx=0).stop 2023-09-23T08:57:16.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.606+0000 7f42fe45cb80 1 -- 172.21.15.82:0/1277152286 shutdown_connections 2023-09-23T08:57:16.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.606+0000 7f42fe45cb80 1 --2- 172.21.15.82:0/1277152286 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560dbbb77e20 0x560dbbb7b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.606+0000 7f42fe45cb80 1 --2- 172.21.15.82:0/1277152286 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x560dbbb8b150 0x560dbbb8d570 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.606+0000 7f42fe45cb80 1 --2- 172.21.15.82:0/1277152286 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560dbbb71c40 0x560dbbb7dce0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.606+0000 7f42fe45cb80 1 --2- 172.21.15.82:0/1277152286 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560dbbb77500 0x560dbbb7b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.606+0000 7f42c3fff700 0 client.15726 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T08:57:16.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.606+0000 7f42fe45cb80 1 -- 172.21.15.82:0/1277152286 >> 172.21.15.82:0/1277152286 conn(0x560dbbae60e0 msgr2=0x560dbbb6c530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:16.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.606+0000 7f42fe45cb80 1 -- 172.21.15.82:0/1277152286 shutdown_connections 2023-09-23T08:57:16.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.606+0000 7f42fe45cb80 1 -- 172.21.15.82:0/1277152286 wait complete. 2023-09-23T08:57:16.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.606+0000 7f42fe45cb80 20 client.15726 trim_cache size 0 max 16384 2023-09-23T08:57:16.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.621+0000 7f42fe45cb80 1 Processor -- start 2023-09-23T08:57:16.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.621+0000 7f42fe45cb80 1 -- start start 2023-09-23T08:57:16.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.622+0000 7f42fe45cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560dbbb71c40 0x560dbbb7d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:16.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.622+0000 7f42fe45cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560dbbb77500 0x560dbbb751d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:16.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.622+0000 7f42fe45cb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560dbbb77e20 0x560dbbb75710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:16.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.622+0000 7f42fe45cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560dbb945920 con 0x560dbbb71c40 2023-09-23T08:57:16.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.622+0000 7f42fe45cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x560dbbb795a0 con 0x560dbbb77500 2023-09-23T08:57:16.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.622+0000 7f42fe45cb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x560dbbb66930 con 0x560dbbb77e20 2023-09-23T08:57:16.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.622+0000 7f42e3fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560dbbb77500 0x560dbbb751d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:16.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.622+0000 7f42e919c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560dbbb77e20 0x560dbbb75710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:16.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.622+0000 7f42e3fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560dbbb77500 0x560dbbb751d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:44664/0 (socket says 172.21.15.82:44664) 2023-09-23T08:57:16.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.622+0000 7f42e3fff700 1 -- 172.21.15.82:0/619199559 learned_addr learned my addr 172.21.15.82:0/619199559 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:57:16.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.622+0000 7f42e899b700 1 --2- 172.21.15.82:0/619199559 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560dbbb71c40 0x560dbbb7d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:16.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.623+0000 7f42e3fff700 1 -- 172.21.15.82:0/619199559 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560dbbb77e20 msgr2=0x560dbbb75710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:16.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.623+0000 7f42e3fff700 1 --2- 172.21.15.82:0/619199559 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560dbbb77e20 0x560dbbb75710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.623+0000 7f42e3fff700 1 -- 172.21.15.82:0/619199559 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560dbbb71c40 msgr2=0x560dbbb7d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:16.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.623+0000 7f42e3fff700 1 --2- 172.21.15.82:0/619199559 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560dbbb71c40 0x560dbbb7d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.623+0000 7f42e3fff700 1 -- 172.21.15.82:0/619199559 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560dbb8d8c60 con 0x560dbbb77500 2023-09-23T08:57:16.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.623+0000 7f42e919c700 1 --2- 172.21.15.82:0/619199559 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560dbbb77e20 0x560dbbb75710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T08:57:16.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.623+0000 7f42e3fff700 1 --2- 172.21.15.82:0/619199559 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560dbbb77500 0x560dbbb751d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x560dbbb782a0 tx=0x7f42d0014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df0390d3ca27ce87 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:16.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.625+0000 7f42cf7fe700 1 -- 172.21.15.82:0/619199559 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42d0023070 con 0x560dbbb77500 2023-09-23T08:57:16.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.625+0000 7f42cf7fe700 1 -- 172.21.15.82:0/619199559 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f42d0011d80 con 0x560dbbb77500 2023-09-23T08:57:16.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.625+0000 7f42cf7fe700 1 -- 172.21.15.82:0/619199559 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42d0003680 con 0x560dbbb77500 2023-09-23T08:57:16.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.626+0000 7f42fe45cb80 1 -- 172.21.15.82:0/619199559 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560dbbb77500 msgr2=0x560dbbb751d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:16.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.626+0000 7f42fe45cb80 1 --2- 172.21.15.82:0/619199559 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560dbbb77500 0x560dbbb751d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x560dbbb782a0 tx=0x7f42d0014000 comp rx=0 tx=0).stop 2023-09-23T08:57:16.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.627+0000 7f42fe45cb80 1 -- 172.21.15.82:0/619199559 shutdown_connections 2023-09-23T08:57:16.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.627+0000 7f42fe45cb80 1 --2- 172.21.15.82:0/619199559 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560dbbb77e20 0x560dbbb75710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.627+0000 7f42fe45cb80 1 --2- 172.21.15.82:0/619199559 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560dbbb71c40 0x560dbbb7d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.627+0000 7f42fe45cb80 1 --2- 172.21.15.82:0/619199559 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560dbbb77500 0x560dbbb751d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.627+0000 7f42fe45cb80 1 -- 172.21.15.82:0/619199559 >> 172.21.15.82:0/619199559 conn(0x560dbbae60e0 msgr2=0x560dbbb6c1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:16.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.627+0000 7f42fe45cb80 1 -- 172.21.15.82:0/619199559 shutdown_connections 2023-09-23T08:57:16.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.627+0000 7f42fe45cb80 1 -- 172.21.15.82:0/619199559 wait complete. 2023-09-23T08:57:16.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.627+0000 7f42fe45cb80 1 -- start start 2023-09-23T08:57:16.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.628+0000 7f42fe45cb80 1 Processor -- start 2023-09-23T08:57:16.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.629+0000 7f42fe45cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560dbbb71c40 0x560dbbb82910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:16.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.629+0000 7f42fe45cb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560dbbb77500 0x560dbbb733b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:16.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.629+0000 7f42fe45cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560dbbb77e20 0x560dbbb738f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:16.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.629+0000 7f42fe45cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560dbbb74000 con 0x560dbbb77e20 2023-09-23T08:57:16.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.629+0000 7f42fe45cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x560dbbb74170 con 0x560dbbb71c40 2023-09-23T08:57:16.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.629+0000 7f42fe45cb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x560dbbbdef80 con 0x560dbbb77500 2023-09-23T08:57:16.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.629+0000 7f42fe45cb80 10 client.0 _ll_register_callbacks cb 0x7f42dc009d20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T08:57:16.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.629+0000 7f42e919c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560dbbb77e20 0x560dbbb738f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:16.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.629+0000 7f42e919c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560dbbb77e20 0x560dbbb738f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51926/0 (socket says 172.21.15.82:51926) 2023-09-23T08:57:16.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.629+0000 7f42e899b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560dbbb71c40 0x560dbbb82910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:16.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.629+0000 7f42e919c700 1 -- 172.21.15.82:0/2140015054 learned_addr learned my addr 172.21.15.82:0/2140015054 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:57:16.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.629+0000 7f42e3fff700 1 --2- 172.21.15.82:0/2140015054 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560dbbb77500 0x560dbbb733b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:16.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.630+0000 7f42e919c700 1 -- 172.21.15.82:0/2140015054 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560dbbb77500 msgr2=0x560dbbb733b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:16.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.630+0000 7f42e919c700 1 --2- 172.21.15.82:0/2140015054 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560dbbb77500 0x560dbbb733b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.630+0000 7f42e919c700 1 -- 172.21.15.82:0/2140015054 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560dbbb71c40 msgr2=0x560dbbb82910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:16.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.630+0000 7f42e919c700 1 --2- 172.21.15.82:0/2140015054 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560dbbb71c40 0x560dbbb82910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.630+0000 7f42e919c700 1 -- 172.21.15.82:0/2140015054 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42dc0142a0 con 0x560dbbb77e20 2023-09-23T08:57:16.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.630+0000 7f42e899b700 1 --2- 172.21.15.82:0/2140015054 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560dbbb71c40 0x560dbbb82910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T08:57:16.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.630+0000 7f42e919c700 1 --2- 172.21.15.82:0/2140015054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560dbbb77e20 0x560dbbb738f0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f42dc004680 tx=0x7f42dc004990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95e37d00bcbc0a95 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:16.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.630+0000 7f42c3fff700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T08:57:16.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.630+0000 7f42c3fff700 1 -- 172.21.15.82:0/2140015054 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42dc010040 con 0x560dbbb77e20 2023-09-23T08:57:16.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.630+0000 7f42fe45cb80 1 -- 172.21.15.82:0/2140015054 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560dbbb648b0 con 0x560dbbb77e20 2023-09-23T08:57:16.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.630+0000 7f42c3fff700 1 -- 172.21.15.82:0/2140015054 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f42dc0093a0 con 0x560dbbb77e20 2023-09-23T08:57:16.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.630+0000 7f42c3fff700 1 -- 172.21.15.82:0/2140015054 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f42dc004db0 con 0x560dbbb77e20 2023-09-23T08:57:16.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.630+0000 7f42fe45cb80 10 client.15732 fetch_fsmap learned FSMap version 27 2023-09-23T08:57:16.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.630+0000 7f42fe45cb80 1 -- 172.21.15.82:0/2140015054 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7f42d0017070 con 0x560dbbb77e20 2023-09-23T08:57:16.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.631+0000 7f42c3fff700 1 -- 172.21.15.82:0/2140015054 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x560dbbb648b0 con 0x560dbbb77e20 2023-09-23T08:57:16.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.631+0000 7f42c3fff700 1 -- 172.21.15.82:0/2140015054 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 27) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f42dc007980 con 0x560dbbb77e20 2023-09-23T08:57:16.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.631+0000 7f42fe45cb80 10 client.15732 fetch_fsmap finished waiting for FSMap version 27 2023-09-23T08:57:16.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.631+0000 7f42fe45cb80 10 client.15732 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T08:57:16.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.631+0000 7f42fe45cb80 20 client.15732 populate_metadata read hostname 'smithi082' 2023-09-23T08:57:16.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.631+0000 7f42fe45cb80 1 --2- 172.21.15.82:0/2140015054 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x560dbbbe06b0 0x560dbbbe2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:16.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.631+0000 7f42fe45cb80 4 client.15732 mds_command: new command op to 24557 tid=0[{"prefix": "damage ls"}] 2023-09-23T08:57:16.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.631+0000 7f42fe45cb80 1 -- 172.21.15.82:0/2140015054 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x560dbbabc970 con 0x560dbbbe06b0 2023-09-23T08:57:16.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.631+0000 7f42e899b700 1 --2- 172.21.15.82:0/2140015054 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x560dbbbe06b0 0x560dbbbe2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:16.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.632+0000 7f42c3fff700 10 client.15732 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T08:57:16.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.632+0000 7f42e899b700 1 --2- 172.21.15.82:0/2140015054 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x560dbbbe06b0 0x560dbbbe2ad0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0d9dd361b2f5634 server_cookie=670870ad1a1acaf0 in_seq=0 out_seq=0 2023-09-23T08:57:16.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.634+0000 7f42c3fff700 1 -- 172.21.15.82:0/2140015054 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x560dbbabc970 con 0x560dbbbe06b0 2023-09-23T08:57:16.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.634+0000 7f42c3fff700 10 client.15732 handle_command_reply: tid=0 2023-09-23T08:57:16.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.634+0000 7f42fe45cb80 1 client.15732 shutdown 2023-09-23T08:57:16.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.634+0000 7f42fe45cb80 1 -- 172.21.15.82:0/2140015054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560dbbb77e20 msgr2=0x560dbbb738f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:16.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.634+0000 7f42fe45cb80 1 --2- 172.21.15.82:0/2140015054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560dbbb77e20 0x560dbbb738f0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f42dc004680 tx=0x7f42dc004990 comp rx=0 tx=0).stop 2023-09-23T08:57:16.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.634+0000 7f42fe45cb80 1 -- 172.21.15.82:0/2140015054 shutdown_connections 2023-09-23T08:57:16.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.634+0000 7f42fe45cb80 1 --2- 172.21.15.82:0/2140015054 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x560dbbbe06b0 0x560dbbbe2ad0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.634+0000 7f42fe45cb80 1 --2- 172.21.15.82:0/2140015054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560dbbb77e20 0x560dbbb738f0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.634+0000 7f42fe45cb80 1 --2- 172.21.15.82:0/2140015054 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560dbbb71c40 0x560dbbb82910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.634+0000 7f42fe45cb80 1 --2- 172.21.15.82:0/2140015054 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560dbbb77500 0x560dbbb733b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.634+0000 7f42fe45cb80 1 -- 172.21.15.82:0/2140015054 >> 172.21.15.82:0/2140015054 conn(0x560dbbae60e0 msgr2=0x560dbbb6c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:16.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.634+0000 7f42c3fff700 0 client.15732 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T08:57:16.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.634+0000 7f42fe45cb80 1 -- 172.21.15.82:0/2140015054 shutdown_connections 2023-09-23T08:57:16.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.634+0000 7f42fe45cb80 1 -- 172.21.15.82:0/2140015054 wait complete. 2023-09-23T08:57:16.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.634+0000 7f42fe45cb80 20 client.15732 trim_cache size 0 max 16384 2023-09-23T08:57:16.639 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2023-09-23T08:57:16.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.635+0000 7f42e999d700 1 -- 172.21.15.82:0/595351293 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f42d40a0280 msgr2=0x7f42d40a2740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:16.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.635+0000 7f42e999d700 1 --2- 172.21.15.82:0/595351293 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f42d40a0280 0x7f42d40a2740 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f42e4199b40 tx=0x7f42d0009260 comp rx=0 tx=0).stop 2023-09-23T08:57:16.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.635+0000 7f42e999d700 1 -- 172.21.15.82:0/595351293 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42e41018e0 msgr2=0x7f42e419e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:16.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.635+0000 7f42e999d700 1 --2- 172.21.15.82:0/595351293 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42e41018e0 0x7f42e419e660 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f42d8005740 tx=0x7f42d8005770 comp rx=0 tx=0).stop 2023-09-23T08:57:16.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.635+0000 7f42e999d700 1 -- 172.21.15.82:0/595351293 shutdown_connections 2023-09-23T08:57:16.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.635+0000 7f42e999d700 1 --2- 172.21.15.82:0/595351293 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f42d40a0280 0x7f42d40a2740 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.635+0000 7f42e999d700 1 --2- 172.21.15.82:0/595351293 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f42e410acb0 0x7f42e41986d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.635+0000 7f42e999d700 1 --2- 172.21.15.82:0/595351293 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42e41018e0 0x7f42e419e660 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.635+0000 7f42e999d700 1 --2- 172.21.15.82:0/595351293 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42e4102200 0x7f42e419eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:16.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.635+0000 7f42e999d700 1 -- 172.21.15.82:0/595351293 >> 172.21.15.82:0/595351293 conn(0x7f42e40fb080 msgr2=0x7f42e410cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:16.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.635+0000 7f42e999d700 1 -- 172.21.15.82:0/595351293 shutdown_connections 2023-09-23T08:57:16.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:16.635+0000 7f42e999d700 1 -- 172.21.15.82:0/595351293 wait complete. 2023-09-23T08:57:16.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:57:16 smithi161 ceph-mon[99580]: pgmap v14: 97 pgs: 97 active+clean; 41 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 288 KiB/s rd, 4.2 MiB/s wr, 118 op/s 2023-09-23T08:57:17.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:57:16 smithi135 ceph-mon[99205]: pgmap v14: 97 pgs: 97 active+clean; 41 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 288 KiB/s rd, 4.2 MiB/s wr, 118 op/s 2023-09-23T08:57:17.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:57:16 smithi082 ceph-mon[97694]: pgmap v14: 97 pgs: 97 active+clean; 41 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 288 KiB/s rd, 4.2 MiB/s wr, 118 op/s 2023-09-23T08:57:17.656 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-09-23T08:57:17.656 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-09-23T08:57:17.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.886+0000 7f42a1f9d700 1 -- 172.21.15.82:0/3591596433 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f429c067a80 msgr2=0x7f429c067f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:17.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.886+0000 7f42a1f9d700 1 --2- 172.21.15.82:0/3591596433 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f429c067a80 0x7f429c067f00 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f4288009990 tx=0x7f4288009ca0 comp rx=0 tx=0).stop 2023-09-23T08:57:17.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.886+0000 7f42a1f9d700 1 -- 172.21.15.82:0/3591596433 shutdown_connections 2023-09-23T08:57:17.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.886+0000 7f42a1f9d700 1 --2- 172.21.15.82:0/3591596433 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f429c068440 0x7f429c10d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:17.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.886+0000 7f42a1f9d700 1 --2- 172.21.15.82:0/3591596433 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f429c106780 0x7f429c106b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:17.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.886+0000 7f42a1f9d700 1 --2- 172.21.15.82:0/3591596433 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f429c067a80 0x7f429c067f00 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:17.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.886+0000 7f42a1f9d700 1 -- 172.21.15.82:0/3591596433 >> 172.21.15.82:0/3591596433 conn(0x7f429c0750e0 msgr2=0x7f429c0754f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:17.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.886+0000 7f42a1f9d700 1 -- 172.21.15.82:0/3591596433 shutdown_connections 2023-09-23T08:57:17.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.887+0000 7f42a1f9d700 1 -- 172.21.15.82:0/3591596433 wait complete. 2023-09-23T08:57:17.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.888+0000 7f42a1f9d700 1 Processor -- start 2023-09-23T08:57:17.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.888+0000 7f42a1f9d700 1 -- start start 2023-09-23T08:57:17.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.888+0000 7f42a1f9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f429c067a80 0x7f429c19e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:17.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.888+0000 7f42a1f9d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f429c068440 0x7f429c19ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:17.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.888+0000 7f42a1f9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f429c106780 0x7f429c1986f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:17.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.888+0000 7f42a1f9d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f429c198d60 con 0x7f429c106780 2023-09-23T08:57:17.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.888+0000 7f42a1f9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f429c198ed0 con 0x7f429c067a80 2023-09-23T08:57:17.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.888+0000 7f42a1f9d700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f429c199090 con 0x7f429c068440 2023-09-23T08:57:17.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.889+0000 7f42a0f9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f429c067a80 0x7f429c19e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:17.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.889+0000 7f42a0f9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f429c067a80 0x7f429c19e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:44704/0 (socket says 172.21.15.82:44704) 2023-09-23T08:57:17.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.889+0000 7f42a179c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f429c106780 0x7f429c1986f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:17.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.889+0000 7f42a0f9b700 1 -- 172.21.15.82:0/3569675779 learned_addr learned my addr 172.21.15.82:0/3569675779 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:57:17.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.889+0000 7f429bfff700 1 --2- 172.21.15.82:0/3569675779 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f429c068440 0x7f429c19ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:17.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.889+0000 7f42a0f9b700 1 -- 172.21.15.82:0/3569675779 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f429c068440 msgr2=0x7f429c19ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:17.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.889+0000 7f42a0f9b700 1 --2- 172.21.15.82:0/3569675779 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f429c068440 0x7f429c19ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:17.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.889+0000 7f42a0f9b700 1 -- 172.21.15.82:0/3569675779 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f429c106780 msgr2=0x7f429c1986f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:17.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.889+0000 7f42a0f9b700 1 --2- 172.21.15.82:0/3569675779 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f429c106780 0x7f429c1986f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:17.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.889+0000 7f42a0f9b700 1 -- 172.21.15.82:0/3569675779 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42880095f0 con 0x7f429c067a80 2023-09-23T08:57:17.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.889+0000 7f429bfff700 1 --2- 172.21.15.82:0/3569675779 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f429c068440 0x7f429c19ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T08:57:17.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.889+0000 7f42a179c700 1 --2- 172.21.15.82:0/3569675779 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f429c106780 0x7f429c1986f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T08:57:17.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.889+0000 7f42a0f9b700 1 --2- 172.21.15.82:0/3569675779 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f429c067a80 0x7f429c19e680 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f429000e9a0 tx=0x7f429000ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:17.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.890+0000 7f4299ffb700 1 -- 172.21.15.82:0/3569675779 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4290009790 con 0x7f429c067a80 2023-09-23T08:57:17.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.890+0000 7f4299ffb700 1 -- 172.21.15.82:0/3569675779 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f429000cbd0 con 0x7f429c067a80 2023-09-23T08:57:17.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.890+0000 7f42a1f9d700 1 -- 172.21.15.82:0/3569675779 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f429c199370 con 0x7f429c067a80 2023-09-23T08:57:17.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.890+0000 7f4299ffb700 1 -- 172.21.15.82:0/3569675779 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4290018680 con 0x7f429c067a80 2023-09-23T08:57:17.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.890+0000 7f42a1f9d700 1 -- 172.21.15.82:0/3569675779 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f429c1a5670 con 0x7f429c067a80 2023-09-23T08:57:17.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.894+0000 7f4299ffb700 1 -- 172.21.15.82:0/3569675779 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) v1 ==== 134904+0+0 (secure 0 0 0) 0x7f429000cd40 con 0x7f429c067a80 2023-09-23T08:57:17.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:57:17 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T08:57:17.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.895+0000 7f42b6a7cb80 1 Processor -- start 2023-09-23T08:57:17.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.896+0000 7f42b6a7cb80 1 -- start start 2023-09-23T08:57:17.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.896+0000 7f42b6a7cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56153a9f6580 0x56153a9f6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:17.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.896+0000 7f42b6a7cb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56153a9f6ea0 0x56153a9f0780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:17.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.896+0000 7f42b6a7cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56153a9f0cc0 0x56153a9f1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:17.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.896+0000 7f42b6a7cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56153a958830 con 0x56153a9f6580 2023-09-23T08:57:17.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.896+0000 7f42b6a7cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56153a949800 con 0x56153a9f0cc0 2023-09-23T08:57:17.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.896+0000 7f42b6a7cb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x56153a947120 con 0x56153a9f6ea0 2023-09-23T08:57:17.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.896+0000 7f42a179c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56153a9f6580 0x56153a9f6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:17.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.896+0000 7f42a179c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56153a9f6580 0x56153a9f6960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51966/0 (socket says 172.21.15.82:51966) 2023-09-23T08:57:17.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.896+0000 7f42a179c700 1 -- 172.21.15.82:0/3727697884 learned_addr learned my addr 172.21.15.82:0/3727697884 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:57:17.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.896+0000 7f4299ffb700 1 --2- 172.21.15.82:0/3569675779 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f428c0a0300 0x7f428c0a27c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:17.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.897+0000 7f429bfff700 1 --2- 172.21.15.82:0/3727697884 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56153a9f0cc0 0x56153a9f1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:17.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.897+0000 7f42a0f9b700 1 --2- 172.21.15.82:0/3727697884 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56153a9f6ea0 0x56153a9f0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:17.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.897+0000 7f4299ffb700 1 -- 172.21.15.82:0/3569675779 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f4290014070 con 0x7f429c067a80 2023-09-23T08:57:17.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.897+0000 7f42a179c700 1 --2- 172.21.15.82:0/3569675779 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f428c0a0300 0x7f428c0a27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:17.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.897+0000 7f429bfff700 1 -- 172.21.15.82:0/3727697884 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56153a9f6ea0 msgr2=0x56153a9f0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:17.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.897+0000 7f429bfff700 1 --2- 172.21.15.82:0/3727697884 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56153a9f6ea0 0x56153a9f0780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:17.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.897+0000 7f429bfff700 1 -- 172.21.15.82:0/3727697884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56153a9f6580 msgr2=0x56153a9f6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:17.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.897+0000 7f429bfff700 1 --2- 172.21.15.82:0/3727697884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56153a9f6580 0x56153a9f6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:17.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.897+0000 7f429bfff700 1 -- 172.21.15.82:0/3727697884 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56153a7c26b0 con 0x56153a9f0cc0 2023-09-23T08:57:17.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.897+0000 7f42a179c700 1 --2- 172.21.15.82:0/3727697884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56153a9f6580 0x56153a9f6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T08:57:17.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.897+0000 7f429bfff700 1 --2- 172.21.15.82:0/3727697884 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56153a9f0cc0 0x56153a9f1100 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4288005910 tx=0x7f4288005c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=31766b40651db82e server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:17.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.898+0000 7f4286ffd700 1 -- 172.21.15.82:0/3727697884 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42880056a0 con 0x56153a9f0cc0 2023-09-23T08:57:17.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.898+0000 7f42a179c700 1 --2- 172.21.15.82:0/3569675779 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f428c0a0300 0x7f428c0a27c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4294007f50 tx=0x7f4294004b40 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:17.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.898+0000 7f4286ffd700 1 -- 172.21.15.82:0/3727697884 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f428801e040 con 0x56153a9f0cc0 2023-09-23T08:57:17.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.898+0000 7f4286ffd700 1 -- 172.21.15.82:0/3727697884 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4288004a00 con 0x56153a9f0cc0 2023-09-23T08:57:17.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.898+0000 7f42b6a7cb80 1 -- 172.21.15.82:0/3727697884 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56153a9f0cc0 msgr2=0x56153a9f1100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:17.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.898+0000 7f42b6a7cb80 1 --2- 172.21.15.82:0/3727697884 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56153a9f0cc0 0x56153a9f1100 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4288005910 tx=0x7f4288005c00 comp rx=0 tx=0).stop 2023-09-23T08:57:17.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.899+0000 7f42b6a7cb80 1 -- 172.21.15.82:0/3727697884 shutdown_connections 2023-09-23T08:57:17.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.899+0000 7f42b6a7cb80 1 --2- 172.21.15.82:0/3727697884 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56153a9f0cc0 0x56153a9f1100 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:17.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.899+0000 7f42b6a7cb80 1 --2- 172.21.15.82:0/3727697884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56153a9f6580 0x56153a9f6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:17.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.899+0000 7f42b6a7cb80 1 --2- 172.21.15.82:0/3727697884 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56153a9f6ea0 0x56153a9f0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:17.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.899+0000 7f42b6a7cb80 1 -- 172.21.15.82:0/3727697884 >> 172.21.15.82:0/3727697884 conn(0x56153a965160 msgr2=0x56153a9eb9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:17.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.899+0000 7f42b6a7cb80 1 -- 172.21.15.82:0/3727697884 shutdown_connections 2023-09-23T08:57:17.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.899+0000 7f42b6a7cb80 1 -- 172.21.15.82:0/3727697884 wait complete. 2023-09-23T08:57:17.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.899+0000 7f42b6a7cb80 1 -- start start 2023-09-23T08:57:17.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.900+0000 7f42b6a7cb80 1 Processor -- start 2023-09-23T08:57:17.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.900+0000 7f42b6a7cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56153a9f0cc0 0x56153a9fcea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:17.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.900+0000 7f42b6a7cb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56153a9f6580 0x56153a9fa0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:17.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.900+0000 7f42b6a7cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56153a9f6ea0 0x56153a9fa7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:17.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.900+0000 7f42b6a7cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56153a942a10 con 0x56153a9f0cc0 2023-09-23T08:57:17.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.900+0000 7f42b6a7cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56153a8e0c30 con 0x56153a9f6ea0 2023-09-23T08:57:17.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.900+0000 7f42b6a7cb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x56153a8e0930 con 0x56153a9f6580 2023-09-23T08:57:17.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.900+0000 7f42b6a7cb80 10 client.0 _ll_register_callbacks cb 0x56153a82ab00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T08:57:17.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.901+0000 7f42a0f9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56153a9f0cc0 0x56153a9fcea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:17.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.901+0000 7f42a0f9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56153a9f0cc0 0x56153a9fcea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51972/0 (socket says 172.21.15.82:51972) 2023-09-23T08:57:17.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.901+0000 7f42a0f9b700 1 -- 172.21.15.82:0/3475272213 learned_addr learned my addr 172.21.15.82:0/3475272213 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:57:17.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.901+0000 7f429bfff700 1 --2- 172.21.15.82:0/3475272213 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56153a9f6580 0x56153a9fa0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:17.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.901+0000 7f42a179c700 1 --2- 172.21.15.82:0/3475272213 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56153a9f6ea0 0x56153a9fa7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:17.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.901+0000 7f42a0f9b700 1 -- 172.21.15.82:0/3475272213 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56153a9f6580 msgr2=0x56153a9fa0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:17.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.901+0000 7f42a0f9b700 1 --2- 172.21.15.82:0/3475272213 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56153a9f6580 0x56153a9fa0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:17.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.901+0000 7f42a0f9b700 1 -- 172.21.15.82:0/3475272213 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56153a9f6ea0 msgr2=0x56153a9fa7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:17.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.901+0000 7f42a0f9b700 1 --2- 172.21.15.82:0/3475272213 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56153a9f6ea0 0x56153a9fa7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:17.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.901+0000 7f42a0f9b700 1 -- 172.21.15.82:0/3475272213 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4294007a00 con 0x56153a9f0cc0 2023-09-23T08:57:17.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.901+0000 7f429bfff700 1 --2- 172.21.15.82:0/3475272213 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56153a9f6580 0x56153a9fa0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T08:57:17.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.901+0000 7f42a179c700 1 --2- 172.21.15.82:0/3475272213 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56153a9f6ea0 0x56153a9fa7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T08:57:17.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.901+0000 7f42a0f9b700 1 --2- 172.21.15.82:0/3475272213 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56153a9f0cc0 0x56153a9fcea0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f429000c5b0 tx=0x7f4290064ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b606cf621a2b506 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:17.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.901+0000 7f427bfff700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T08:57:17.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.902+0000 7f427bfff700 1 -- 172.21.15.82:0/3475272213 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4290098680 con 0x56153a9f0cc0 2023-09-23T08:57:17.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.902+0000 7f427bfff700 1 -- 172.21.15.82:0/3475272213 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f4290064f30 con 0x56153a9f0cc0 2023-09-23T08:57:17.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.902+0000 7f42b6a7cb80 1 -- 172.21.15.82:0/3475272213 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56153a9c0240 con 0x56153a9f0cc0 2023-09-23T08:57:17.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.902+0000 7f427bfff700 1 -- 172.21.15.82:0/3475272213 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f42900988f0 con 0x56153a9f0cc0 2023-09-23T08:57:17.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.902+0000 7f42b6a7cb80 10 client.15744 fetch_fsmap learned FSMap version 27 2023-09-23T08:57:17.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.902+0000 7f42b6a7cb80 1 -- 172.21.15.82:0/3475272213 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7f429c10de30 con 0x56153a9f0cc0 2023-09-23T08:57:17.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.902+0000 7f427bfff700 1 -- 172.21.15.82:0/3475272213 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56153a9c0240 con 0x56153a9f0cc0 2023-09-23T08:57:17.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.902+0000 7f427bfff700 1 -- 172.21.15.82:0/3475272213 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 27) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f42900a0910 con 0x56153a9f0cc0 2023-09-23T08:57:17.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.902+0000 7f42b6a7cb80 10 client.15744 fetch_fsmap finished waiting for FSMap version 27 2023-09-23T08:57:17.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.902+0000 7f42b6a7cb80 10 client.15744 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T08:57:17.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.902+0000 7f42b6a7cb80 20 client.15744 populate_metadata read hostname 'smithi082' 2023-09-23T08:57:17.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.902+0000 7f42b6a7cb80 1 --2- 172.21.15.82:0/3475272213 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56153aa0a820 0x56153aa0cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:17.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.902+0000 7f42b6a7cb80 4 client.15744 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T08:57:17.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.902+0000 7f42b6a7cb80 1 -- 172.21.15.82:0/3475272213 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56153a8e8c20 con 0x56153aa0a820 2023-09-23T08:57:17.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.903+0000 7f429bfff700 1 --2- 172.21.15.82:0/3475272213 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56153aa0a820 0x56153aa0cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:17.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.903+0000 7f429bfff700 1 --2- 172.21.15.82:0/3475272213 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56153aa0a820 0x56153aa0cc40 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dea33708605ab6d1 server_cookie=ad2c1c75a1531949 in_seq=0 out_seq=0 2023-09-23T08:57:17.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.903+0000 7f427bfff700 10 client.15744 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T08:57:17.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.904+0000 7f427bfff700 1 -- 172.21.15.82:0/3475272213 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56153a8e8c20 con 0x56153aa0a820 2023-09-23T08:57:17.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.904+0000 7f427bfff700 10 client.15744 handle_command_reply: tid=0 2023-09-23T08:57:17.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.904+0000 7f42b6a7cb80 1 client.15744 shutdown 2023-09-23T08:57:17.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.904+0000 7f42b6a7cb80 1 -- 172.21.15.82:0/3475272213 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56153a9f0cc0 msgr2=0x56153a9fcea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:17.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.904+0000 7f42b6a7cb80 1 --2- 172.21.15.82:0/3475272213 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56153a9f0cc0 0x56153a9fcea0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f429000c5b0 tx=0x7f4290064ec0 comp rx=0 tx=0).stop 2023-09-23T08:57:17.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.904+0000 7f42b6a7cb80 1 -- 172.21.15.82:0/3475272213 shutdown_connections 2023-09-23T08:57:17.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.904+0000 7f42b6a7cb80 1 --2- 172.21.15.82:0/3475272213 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56153a9f6ea0 0x56153a9fa7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:17.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.904+0000 7f42b6a7cb80 1 --2- 172.21.15.82:0/3475272213 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56153aa0a820 0x56153aa0cc40 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:17.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.904+0000 7f42b6a7cb80 1 --2- 172.21.15.82:0/3475272213 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56153a9f0cc0 0x56153a9fcea0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:17.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.904+0000 7f42b6a7cb80 1 --2- 172.21.15.82:0/3475272213 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56153a9f6580 0x56153a9fa0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:17.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.904+0000 7f42b6a7cb80 1 -- 172.21.15.82:0/3475272213 >> 172.21.15.82:0/3475272213 conn(0x56153a965160 msgr2=0x56153a9ef770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:17.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.904+0000 7f427bfff700 0 client.15744 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T08:57:17.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.905+0000 7f42b6a7cb80 1 -- 172.21.15.82:0/3475272213 shutdown_connections 2023-09-23T08:57:17.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.905+0000 7f42b6a7cb80 1 -- 172.21.15.82:0/3475272213 wait complete. 2023-09-23T08:57:17.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.905+0000 7f42b6a7cb80 20 client.15744 trim_cache size 0 max 16384 2023-09-23T08:57:17.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.925+0000 7f42b6a7cb80 1 Processor -- start 2023-09-23T08:57:17.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.925+0000 7f42b6a7cb80 1 -- start start 2023-09-23T08:57:17.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.925+0000 7f42b6a7cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56153a9f0cc0 0x56153a9f9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:17.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.925+0000 7f42b6a7cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56153a9f6580 0x56153a9eb830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:17.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.925+0000 7f42b6a7cb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56153a9f6ea0 0x56153a9fc9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:17.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.925+0000 7f42b6a7cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56153a7c49a0 con 0x56153a9f6580 2023-09-23T08:57:17.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.925+0000 7f42b6a7cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56153a9ec600 con 0x56153a9f0cc0 2023-09-23T08:57:17.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.925+0000 7f42b6a7cb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x56153a9e7d10 con 0x56153a9f6ea0 2023-09-23T08:57:17.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.925+0000 7f429bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56153a9f6580 0x56153a9eb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:17.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.925+0000 7f42a0f9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56153a9f0cc0 0x56153a9f9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:17.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.925+0000 7f42a179c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56153a9f6ea0 0x56153a9fc9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:17.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.925+0000 7f429bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56153a9f6580 0x56153a9eb830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51980/0 (socket says 172.21.15.82:51980) 2023-09-23T08:57:17.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.925+0000 7f429bfff700 1 -- 172.21.15.82:0/1997318470 learned_addr learned my addr 172.21.15.82:0/1997318470 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:57:17.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.926+0000 7f42a0f9b700 1 -- 172.21.15.82:0/1997318470 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56153a9f6ea0 msgr2=0x56153a9fc9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:17.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.926+0000 7f42a0f9b700 1 --2- 172.21.15.82:0/1997318470 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56153a9f6ea0 0x56153a9fc9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:17.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.926+0000 7f42a0f9b700 1 -- 172.21.15.82:0/1997318470 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56153a9f6580 msgr2=0x56153a9eb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:17.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.926+0000 7f42a0f9b700 1 --2- 172.21.15.82:0/1997318470 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56153a9f6580 0x56153a9eb830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:17.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.926+0000 7f42a0f9b700 1 -- 172.21.15.82:0/1997318470 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56153a76ee60 con 0x56153a9f0cc0 2023-09-23T08:57:17.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.926+0000 7f42a0f9b700 1 --2- 172.21.15.82:0/1997318470 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56153a9f0cc0 0x56153a9f9ff0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4290098c90 tx=0x7f4290097540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e7172ed9a9cccbe server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:17.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.926+0000 7f42877fe700 1 -- 172.21.15.82:0/1997318470 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42900988f0 con 0x56153a9f0cc0 2023-09-23T08:57:17.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.926+0000 7f42877fe700 1 -- 172.21.15.82:0/1997318470 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f42900c8fe0 con 0x56153a9f0cc0 2023-09-23T08:57:17.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.926+0000 7f42877fe700 1 -- 172.21.15.82:0/1997318470 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42900986e0 con 0x56153a9f0cc0 2023-09-23T08:57:17.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.927+0000 7f42b6a7cb80 1 -- 172.21.15.82:0/1997318470 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56153a9f0cc0 msgr2=0x56153a9f9ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:17.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.927+0000 7f42b6a7cb80 1 --2- 172.21.15.82:0/1997318470 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56153a9f0cc0 0x56153a9f9ff0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4290098c90 tx=0x7f4290097540 comp rx=0 tx=0).stop 2023-09-23T08:57:17.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.927+0000 7f42b6a7cb80 1 -- 172.21.15.82:0/1997318470 shutdown_connections 2023-09-23T08:57:17.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.927+0000 7f42b6a7cb80 1 --2- 172.21.15.82:0/1997318470 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56153a9f6ea0 0x56153a9fc9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:17.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.927+0000 7f42b6a7cb80 1 --2- 172.21.15.82:0/1997318470 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56153a9f0cc0 0x56153a9f9ff0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:17.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.927+0000 7f42b6a7cb80 1 --2- 172.21.15.82:0/1997318470 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56153a9f6580 0x56153a9eb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:17.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.927+0000 7f42b6a7cb80 1 -- 172.21.15.82:0/1997318470 >> 172.21.15.82:0/1997318470 conn(0x56153a965160 msgr2=0x56153a9eb120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:17.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.927+0000 7f42b6a7cb80 1 -- 172.21.15.82:0/1997318470 shutdown_connections 2023-09-23T08:57:17.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.927+0000 7f42b6a7cb80 1 -- 172.21.15.82:0/1997318470 wait complete. 2023-09-23T08:57:17.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.928+0000 7f42b6a7cb80 1 -- start start 2023-09-23T08:57:17.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.928+0000 7f42b6a7cb80 1 Processor -- start 2023-09-23T08:57:17.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.928+0000 7f42b6a7cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56153a9f0cc0 0x56153aa58d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:17.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.928+0000 7f42b6a7cb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56153a9f6580 0x56153aa59290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:17.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.928+0000 7f42b6a7cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56153a9f6ea0 0x56153aa00b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:17.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.928+0000 7f42b6a7cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56153aa01170 con 0x56153a9f6ea0 2023-09-23T08:57:17.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.928+0000 7f42b6a7cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56153aa012e0 con 0x56153a9f0cc0 2023-09-23T08:57:17.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.928+0000 7f42b6a7cb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x56153aa014a0 con 0x56153a9f6580 2023-09-23T08:57:17.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.929+0000 7f42b6a7cb80 10 client.0 _ll_register_callbacks cb 0x7f42900952d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T08:57:17.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.929+0000 7f42a0f9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56153a9f0cc0 0x56153aa58d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:17.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.929+0000 7f42a0f9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56153a9f0cc0 0x56153aa58d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:44726/0 (socket says 172.21.15.82:44726) 2023-09-23T08:57:17.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.929+0000 7f42a0f9b700 1 -- 172.21.15.82:0/3209172912 learned_addr learned my addr 172.21.15.82:0/3209172912 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:57:17.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.929+0000 7f42a179c700 1 --2- 172.21.15.82:0/3209172912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56153a9f6ea0 0x56153aa00b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:17.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.929+0000 7f429bfff700 1 --2- 172.21.15.82:0/3209172912 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56153a9f6580 0x56153aa59290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:17.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.929+0000 7f42a0f9b700 1 -- 172.21.15.82:0/3209172912 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56153a9f6580 msgr2=0x56153aa59290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:17.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.929+0000 7f42a0f9b700 1 --2- 172.21.15.82:0/3209172912 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56153a9f6580 0x56153aa59290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:17.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.929+0000 7f42a0f9b700 1 -- 172.21.15.82:0/3209172912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56153a9f6ea0 msgr2=0x56153aa00b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:17.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.929+0000 7f42a0f9b700 1 --2- 172.21.15.82:0/3209172912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56153a9f6ea0 0x56153aa00b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:17.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.929+0000 7f42a0f9b700 1 -- 172.21.15.82:0/3209172912 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f429c10de30 con 0x56153a9f0cc0 2023-09-23T08:57:17.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.929+0000 7f42a0f9b700 1 --2- 172.21.15.82:0/3209172912 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56153a9f0cc0 0x56153aa58d50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4290009230 tx=0x7f42900a0ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2393792ebfa47abb server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:17.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.929+0000 7f427bfff700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-09-23T08:57:17.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.930+0000 7f427bfff700 1 -- 172.21.15.82:0/3209172912 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4290098680 con 0x56153a9f0cc0 2023-09-23T08:57:17.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.930+0000 7f42b6a7cb80 1 -- 172.21.15.82:0/3209172912 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56153a9e3930 con 0x56153a9f0cc0 2023-09-23T08:57:17.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.930+0000 7f427bfff700 1 -- 172.21.15.82:0/3209172912 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f4290099690 con 0x56153a9f0cc0 2023-09-23T08:57:17.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.930+0000 7f427bfff700 1 -- 172.21.15.82:0/3209172912 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f42900988f0 con 0x56153a9f0cc0 2023-09-23T08:57:17.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.930+0000 7f42b6a7cb80 10 client.25463 fetch_fsmap learned FSMap version 27 2023-09-23T08:57:17.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.930+0000 7f42b6a7cb80 1 -- 172.21.15.82:0/3209172912 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x56153a757ce0 con 0x56153a9f0cc0 2023-09-23T08:57:17.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.930+0000 7f427bfff700 1 -- 172.21.15.82:0/3209172912 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56153a9e3930 con 0x56153a9f0cc0 2023-09-23T08:57:17.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.930+0000 7f427bfff700 1 -- 172.21.15.82:0/3209172912 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 27) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f4290010430 con 0x56153a9f0cc0 2023-09-23T08:57:17.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.931+0000 7f42b6a7cb80 10 client.25463 fetch_fsmap finished waiting for FSMap version 27 2023-09-23T08:57:17.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.931+0000 7f42b6a7cb80 10 client.25463 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T08:57:17.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.931+0000 7f42b6a7cb80 20 client.25463 populate_metadata read hostname 'smithi082' 2023-09-23T08:57:17.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.931+0000 7f42b6a7cb80 1 --2- 172.21.15.82:0/3209172912 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56153aa60770 0x56153aa62b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:17.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.931+0000 7f42b6a7cb80 4 client.25463 mds_command: new command op to 24557 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-09-23T08:57:17.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.931+0000 7f42b6a7cb80 1 -- 172.21.15.82:0/3209172912 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x56153a93b9f0 con 0x56153aa60770 2023-09-23T08:57:17.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.931+0000 7f429bfff700 1 --2- 172.21.15.82:0/3209172912 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56153aa60770 0x56153aa62b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:17.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.931+0000 7f427bfff700 10 client.25463 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T08:57:17.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.931+0000 7f429bfff700 1 --2- 172.21.15.82:0/3209172912 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56153aa60770 0x56153aa62b90 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1de00814c6e5755e server_cookie=1b39d94278e6324d in_seq=0 out_seq=0 2023-09-23T08:57:17.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.933+0000 7f427bfff700 1 -- 172.21.15.82:0/3209172912 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x56153a93b9f0 con 0x56153aa60770 2023-09-23T08:57:17.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.933+0000 7f427bfff700 10 client.25463 handle_command_reply: tid=0 2023-09-23T08:57:17.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.933+0000 7f42b6a7cb80 1 client.25463 shutdown 2023-09-23T08:57:17.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.933+0000 7f42b6a7cb80 1 -- 172.21.15.82:0/3209172912 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56153a9f0cc0 msgr2=0x56153aa58d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:17.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.933+0000 7f42b6a7cb80 1 --2- 172.21.15.82:0/3209172912 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56153a9f0cc0 0x56153aa58d50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4290009230 tx=0x7f42900a0ca0 comp rx=0 tx=0).stop 2023-09-23T08:57:17.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.933+0000 7f42b6a7cb80 1 -- 172.21.15.82:0/3209172912 shutdown_connections 2023-09-23T08:57:17.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.933+0000 7f42b6a7cb80 1 --2- 172.21.15.82:0/3209172912 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56153aa60770 0x56153aa62b90 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:17.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.933+0000 7f42b6a7cb80 1 --2- 172.21.15.82:0/3209172912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56153a9f6ea0 0x56153aa00b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:17.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.934+0000 7f42b6a7cb80 1 --2- 172.21.15.82:0/3209172912 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56153a9f0cc0 0x56153aa58d50 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:17.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.934+0000 7f42b6a7cb80 1 --2- 172.21.15.82:0/3209172912 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56153a9f6580 0x56153aa59290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:17.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.934+0000 7f427bfff700 0 client.25463 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T08:57:17.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.934+0000 7f42b6a7cb80 1 -- 172.21.15.82:0/3209172912 >> 172.21.15.82:0/3209172912 conn(0x56153a965160 msgr2=0x56153a9eb9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:17.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.934+0000 7f42b6a7cb80 1 -- 172.21.15.82:0/3209172912 shutdown_connections 2023-09-23T08:57:17.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.934+0000 7f42b6a7cb80 1 -- 172.21.15.82:0/3209172912 wait complete. 2023-09-23T08:57:17.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.934+0000 7f42b6a7cb80 20 client.25463 trim_cache size 0 max 16384 2023-09-23T08:57:17.940 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T08:57:17.940 INFO:teuthology.orchestra.run.smithi082.stdout: "return_code": 0, 2023-09-23T08:57:17.941 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_tag": "d3e3cd6e-8641-4b29-b735-b756840b11ec", 2023-09-23T08:57:17.941 INFO:teuthology.orchestra.run.smithi082.stdout: "mode": "asynchronous" 2023-09-23T08:57:17.941 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T08:57:17.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.934+0000 7f42a1f9d700 1 -- 172.21.15.82:0/3569675779 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f428c0a0300 msgr2=0x7f428c0a27c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:17.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.934+0000 7f42a1f9d700 1 --2- 172.21.15.82:0/3569675779 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f428c0a0300 0x7f428c0a27c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4294007f50 tx=0x7f4294004b40 comp rx=0 tx=0).stop 2023-09-23T08:57:17.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.934+0000 7f42a1f9d700 1 -- 172.21.15.82:0/3569675779 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f429c067a80 msgr2=0x7f429c19e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:17.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.934+0000 7f42a1f9d700 1 --2- 172.21.15.82:0/3569675779 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f429c067a80 0x7f429c19e680 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f429000e9a0 tx=0x7f429000ecb0 comp rx=0 tx=0).stop 2023-09-23T08:57:17.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.935+0000 7f42a1f9d700 1 -- 172.21.15.82:0/3569675779 shutdown_connections 2023-09-23T08:57:17.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.935+0000 7f42a1f9d700 1 --2- 172.21.15.82:0/3569675779 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f428c0a0300 0x7f428c0a27c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:17.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.935+0000 7f42a1f9d700 1 --2- 172.21.15.82:0/3569675779 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f429c106780 0x7f429c1986f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:17.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.935+0000 7f42a1f9d700 1 --2- 172.21.15.82:0/3569675779 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f429c067a80 0x7f429c19e680 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:17.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.935+0000 7f42a1f9d700 1 --2- 172.21.15.82:0/3569675779 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f429c068440 0x7f429c19ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:17.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.935+0000 7f42a1f9d700 1 -- 172.21.15.82:0/3569675779 >> 172.21.15.82:0/3569675779 conn(0x7f429c0750e0 msgr2=0x7f429c10b870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:17.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.935+0000 7f42a1f9d700 1 -- 172.21.15.82:0/3569675779 shutdown_connections 2023-09-23T08:57:17.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:17.935+0000 7f42a1f9d700 1 -- 172.21.15.82:0/3569675779 wait complete. 2023-09-23T08:57:17.955 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:57:17 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T08:57:17.957 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T08:57:18.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:57:17 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T08:57:18.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.201+0000 7f05b0fff700 1 -- 172.21.15.82:0/3187195455 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05ac10ae50 msgr2=0x7f05ac10d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:18.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.201+0000 7f05b0fff700 1 --2- 172.21.15.82:0/3187195455 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05ac10ae50 0x7f05ac10d310 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f05a400b0a0 tx=0x7f05a400b3b0 comp rx=0 tx=0).stop 2023-09-23T08:57:18.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.201+0000 7f05b0fff700 1 -- 172.21.15.82:0/3187195455 shutdown_connections 2023-09-23T08:57:18.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.201+0000 7f05b0fff700 1 --2- 172.21.15.82:0/3187195455 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05ac10ae50 0x7f05ac10d310 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:18.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.201+0000 7f05b0fff700 1 --2- 172.21.15.82:0/3187195455 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05ac101a30 0x7f05ac101e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:18.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.201+0000 7f05b0fff700 1 --2- 172.21.15.82:0/3187195455 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05ac102350 0x7f05ac10a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:18.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.201+0000 7f05b0fff700 1 -- 172.21.15.82:0/3187195455 >> 172.21.15.82:0/3187195455 conn(0x7f05ac0fb270 msgr2=0x7f05ac0fd690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:18.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.201+0000 7f05b0fff700 1 -- 172.21.15.82:0/3187195455 shutdown_connections 2023-09-23T08:57:18.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.201+0000 7f05b0fff700 1 -- 172.21.15.82:0/3187195455 wait complete. 2023-09-23T08:57:18.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.202+0000 7f05b0fff700 1 Processor -- start 2023-09-23T08:57:18.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.202+0000 7f05b0fff700 1 -- start start 2023-09-23T08:57:18.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.203+0000 7f05b0fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05ac101a30 0x7f05ac19ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:18.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.203+0000 7f05b0fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05ac102350 0x7f05ac19ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:18.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.203+0000 7f05b0fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05ac10ae50 0x7f05ac198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:18.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.203+0000 7f05b0fff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05ac199100 con 0x7f05ac10ae50 2023-09-23T08:57:18.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.203+0000 7f05b0fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05ac199270 con 0x7f05ac102350 2023-09-23T08:57:18.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.203+0000 7f05b0fff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05ac199430 con 0x7f05ac101a30 2023-09-23T08:57:18.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.203+0000 7f05a9d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05ac102350 0x7f05ac19ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:18.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.203+0000 7f05a9d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05ac102350 0x7f05ac19ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:44744/0 (socket says 172.21.15.82:44744) 2023-09-23T08:57:18.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.203+0000 7f05a9d9b700 1 -- 172.21.15.82:0/874035636 learned_addr learned my addr 172.21.15.82:0/874035636 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:57:18.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.203+0000 7f05aa59c700 1 --2- 172.21.15.82:0/874035636 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05ac101a30 0x7f05ac19ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:18.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.203+0000 7f05aad9d700 1 --2- 172.21.15.82:0/874035636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05ac10ae50 0x7f05ac198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:18.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.204+0000 7f05a9d9b700 1 -- 172.21.15.82:0/874035636 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05ac101a30 msgr2=0x7f05ac19ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:18.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.204+0000 7f05a9d9b700 1 --2- 172.21.15.82:0/874035636 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05ac101a30 0x7f05ac19ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:18.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.204+0000 7f05a9d9b700 1 -- 172.21.15.82:0/874035636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05ac10ae50 msgr2=0x7f05ac198a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:18.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.204+0000 7f05a9d9b700 1 --2- 172.21.15.82:0/874035636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05ac10ae50 0x7f05ac198a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:18.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.204+0000 7f05a9d9b700 1 -- 172.21.15.82:0/874035636 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05a0009520 con 0x7f05ac102350 2023-09-23T08:57:18.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.204+0000 7f05aa59c700 1 --2- 172.21.15.82:0/874035636 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05ac101a30 0x7f05ac19ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T08:57:18.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.204+0000 7f05a9d9b700 1 --2- 172.21.15.82:0/874035636 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05ac102350 0x7f05ac19ef60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f05a000e9f0 tx=0x7f05a000ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:18.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.204+0000 7f059b7fe700 1 -- 172.21.15.82:0/874035636 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a000cbd0 con 0x7f05ac102350 2023-09-23T08:57:18.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.204+0000 7f059b7fe700 1 -- 172.21.15.82:0/874035636 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f05a0009750 con 0x7f05ac102350 2023-09-23T08:57:18.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.204+0000 7f059b7fe700 1 -- 172.21.15.82:0/874035636 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a0003bf0 con 0x7f05ac102350 2023-09-23T08:57:18.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.204+0000 7f05b0fff700 1 -- 172.21.15.82:0/874035636 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05a4009d00 con 0x7f05ac102350 2023-09-23T08:57:18.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.204+0000 7f05b0fff700 1 -- 172.21.15.82:0/874035636 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05ac1a5830 con 0x7f05ac102350 2023-09-23T08:57:18.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.208+0000 7f059b7fe700 1 -- 172.21.15.82:0/874035636 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) v1 ==== 134904+0+0 (secure 0 0 0) 0x7f05a0003d90 con 0x7f05ac102350 2023-09-23T08:57:18.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.209+0000 7f05c492fb80 1 Processor -- start 2023-09-23T08:57:18.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.209+0000 7f05c492fb80 1 -- start start 2023-09-23T08:57:18.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.210+0000 7f059b7fe700 1 --2- 172.21.15.82:0/874035636 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f05940a01e0 0x7f05940a26a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:18.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.210+0000 7f05c492fb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5623ae051380 0x5623ae051760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:18.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.210+0000 7f05c492fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623ae051ca0 0x5623ae04b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:18.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.210+0000 7f05c492fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623ae04bc40 0x5623ae04c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:18.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.210+0000 7f05c492fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623adfb37b0 con 0x5623ae051ca0 2023-09-23T08:57:18.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.210+0000 7f05c492fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623adfa4780 con 0x5623ae04bc40 2023-09-23T08:57:18.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.210+0000 7f05c492fb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623adfa20a0 con 0x5623ae051380 2023-09-23T08:57:18.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.210+0000 7f059b7fe700 1 -- 172.21.15.82:0/874035636 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f05a0014070 con 0x7f05ac102350 2023-09-23T08:57:18.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.210+0000 7f05aa59c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5623ae051380 0x5623ae051760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:18.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.210+0000 7f05aa59c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5623ae051380 0x5623ae051760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:34730/0 (socket says 172.21.15.82:34730) 2023-09-23T08:57:18.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.210+0000 7f05aa59c700 1 -- 172.21.15.82:0/997496151 learned_addr learned my addr 172.21.15.82:0/997496151 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:57:18.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.210+0000 7f05a9d9b700 1 --2- 172.21.15.82:0/997496151 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623ae051ca0 0x5623ae04b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:18.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.210+0000 7f05aad9d700 1 --2- 172.21.15.82:0/874035636 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f05940a01e0 0x7f05940a26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:18.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.210+0000 7f05aa59c700 1 -- 172.21.15.82:0/997496151 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623ae04bc40 msgr2=0x5623ae04c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:18.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.210+0000 7f05aad9d700 1 --2- 172.21.15.82:0/997496151 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623ae04bc40 0x5623ae04c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:18.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.210+0000 7f05aa59c700 1 --2- 172.21.15.82:0/997496151 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623ae04bc40 0x5623ae04c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:18.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.211+0000 7f05aa59c700 1 -- 172.21.15.82:0/997496151 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623ae051ca0 msgr2=0x5623ae04b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:18.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.211+0000 7f05aa59c700 1 --2- 172.21.15.82:0/997496151 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623ae051ca0 0x5623ae04b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:18.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.211+0000 7f05aa59c700 1 -- 172.21.15.82:0/997496151 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5623ade1d630 con 0x5623ae051380 2023-09-23T08:57:18.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.211+0000 7f05a9d9b700 1 --2- 172.21.15.82:0/997496151 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623ae051ca0 0x5623ae04b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T08:57:18.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.211+0000 7f05aa59c700 1 --2- 172.21.15.82:0/997496151 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5623ae051380 0x5623ae051760 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f059c0115f0 tx=0x7f059c011900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5771517443a9b28 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:18.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.211+0000 7f05aad9d700 1 --2- 172.21.15.82:0/874035636 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f05940a01e0 0x7f05940a26a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f05a4009cd0 tx=0x7f05a4009c60 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:18.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.211+0000 7f0598ff9700 1 -- 172.21.15.82:0/997496151 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f059c00f680 con 0x5623ae051380 2023-09-23T08:57:18.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.211+0000 7f0598ff9700 1 -- 172.21.15.82:0/997496151 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f059c00fc70 con 0x5623ae051380 2023-09-23T08:57:18.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.211+0000 7f0598ff9700 1 -- 172.21.15.82:0/997496151 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f059c019c50 con 0x5623ae051380 2023-09-23T08:57:18.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.212+0000 7f05c492fb80 1 -- 172.21.15.82:0/997496151 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5623ae051380 msgr2=0x5623ae051760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:18.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.212+0000 7f05c492fb80 1 --2- 172.21.15.82:0/997496151 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5623ae051380 0x5623ae051760 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f059c0115f0 tx=0x7f059c011900 comp rx=0 tx=0).stop 2023-09-23T08:57:18.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.212+0000 7f05c492fb80 1 -- 172.21.15.82:0/997496151 shutdown_connections 2023-09-23T08:57:18.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.212+0000 7f05c492fb80 1 --2- 172.21.15.82:0/997496151 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623ae04bc40 0x5623ae04c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:18.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.212+0000 7f05c492fb80 1 --2- 172.21.15.82:0/997496151 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5623ae051380 0x5623ae051760 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:18.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.212+0000 7f05c492fb80 1 --2- 172.21.15.82:0/997496151 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623ae051ca0 0x5623ae04b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:18.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.212+0000 7f05c492fb80 1 -- 172.21.15.82:0/997496151 >> 172.21.15.82:0/997496151 conn(0x5623adfc00e0 msgr2=0x5623ae046410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:18.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.212+0000 7f05c492fb80 1 -- 172.21.15.82:0/997496151 shutdown_connections 2023-09-23T08:57:18.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.212+0000 7f05c492fb80 1 -- 172.21.15.82:0/997496151 wait complete. 2023-09-23T08:57:18.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.213+0000 7f05c492fb80 1 -- start start 2023-09-23T08:57:18.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.213+0000 7f05c492fb80 1 Processor -- start 2023-09-23T08:57:18.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.214+0000 7f05c492fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623ae04bc40 0x5623ae057c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:18.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.214+0000 7f05c492fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623ae051380 0x5623ae054ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:18.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.214+0000 7f05c492fb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5623ae051ca0 0x5623ae055600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:18.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.214+0000 7f05c492fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623adf9d990 con 0x5623ae04bc40 2023-09-23T08:57:18.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.214+0000 7f05c492fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623adf3bbb0 con 0x5623ae051380 2023-09-23T08:57:18.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.214+0000 7f05c492fb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623adf3b8b0 con 0x5623ae051ca0 2023-09-23T08:57:18.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.214+0000 7f05c492fb80 10 client.0 _ll_register_callbacks cb 0x5623ade85a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T08:57:18.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.214+0000 7f05aa59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623ae04bc40 0x5623ae057c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:18.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.214+0000 7f05aa59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623ae04bc40 0x5623ae057c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52032/0 (socket says 172.21.15.82:52032) 2023-09-23T08:57:18.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.214+0000 7f05aa59c700 1 -- 172.21.15.82:0/3884916447 learned_addr learned my addr 172.21.15.82:0/3884916447 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:57:18.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.214+0000 7f05a9d9b700 1 --2- 172.21.15.82:0/3884916447 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623ae051380 0x5623ae054ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:18.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.214+0000 7f05aa59c700 1 -- 172.21.15.82:0/3884916447 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5623ae051ca0 msgr2=0x5623ae055600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:18.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.214+0000 7f05aa59c700 1 --2- 172.21.15.82:0/3884916447 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5623ae051ca0 0x5623ae055600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:18.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.214+0000 7f05aa59c700 1 -- 172.21.15.82:0/3884916447 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623ae051380 msgr2=0x5623ae054ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:18.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.214+0000 7f05aa59c700 1 --2- 172.21.15.82:0/3884916447 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623ae051380 0x5623ae054ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:18.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.215+0000 7f05aa59c700 1 -- 172.21.15.82:0/3884916447 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f059c009dd0 con 0x5623ae04bc40 2023-09-23T08:57:18.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.215+0000 7f05a9d9b700 1 --2- 172.21.15.82:0/3884916447 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623ae051380 0x5623ae054ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T08:57:18.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.215+0000 7f05aa59c700 1 --2- 172.21.15.82:0/3884916447 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623ae04bc40 0x5623ae057c40 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f059c000c00 tx=0x7f059c005df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d2a0deb93483a33 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:18.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.215+0000 7f0591ffb700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T08:57:18.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.215+0000 7f0591ffb700 1 -- 172.21.15.82:0/3884916447 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f059c005440 con 0x5623ae04bc40 2023-09-23T08:57:18.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.215+0000 7f05c492fb80 1 -- 172.21.15.82:0/3884916447 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5623ae01b1c0 con 0x5623ae04bc40 2023-09-23T08:57:18.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.215+0000 7f0591ffb700 1 -- 172.21.15.82:0/3884916447 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f059c0055a0 con 0x5623ae04bc40 2023-09-23T08:57:18.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.215+0000 7f0591ffb700 1 -- 172.21.15.82:0/3884916447 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f059c004750 con 0x5623ae04bc40 2023-09-23T08:57:18.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.215+0000 7f05c492fb80 10 client.15762 fetch_fsmap learned FSMap version 27 2023-09-23T08:57:18.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.216+0000 7f05c492fb80 1 -- 172.21.15.82:0/3884916447 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5623addc9de0 con 0x5623ae04bc40 2023-09-23T08:57:18.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.216+0000 7f0591ffb700 1 -- 172.21.15.82:0/3884916447 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5623ae01b1c0 con 0x5623ae04bc40 2023-09-23T08:57:18.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.216+0000 7f0591ffb700 1 -- 172.21.15.82:0/3884916447 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 27) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f059c00f970 con 0x5623ae04bc40 2023-09-23T08:57:18.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.216+0000 7f05c492fb80 10 client.15762 fetch_fsmap finished waiting for FSMap version 27 2023-09-23T08:57:18.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.216+0000 7f05c492fb80 10 client.15762 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T08:57:18.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.216+0000 7f05c492fb80 20 client.15762 populate_metadata read hostname 'smithi082' 2023-09-23T08:57:18.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.216+0000 7f05c492fb80 1 --2- 172.21.15.82:0/3884916447 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5623ae065620 0x5623ae067a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:18.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.216+0000 7f05c492fb80 4 client.15762 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T08:57:18.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.216+0000 7f05c492fb80 1 -- 172.21.15.82:0/3884916447 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5623adf43ba0 con 0x5623ae065620 2023-09-23T08:57:18.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.217+0000 7f05a9d9b700 1 --2- 172.21.15.82:0/3884916447 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5623ae065620 0x5623ae067a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:18.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.217+0000 7f0591ffb700 10 client.15762 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T08:57:18.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.217+0000 7f05a9d9b700 1 --2- 172.21.15.82:0/3884916447 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5623ae065620 0x5623ae067a40 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=281959b4103bb676 server_cookie=7579a232332a7ad8 in_seq=0 out_seq=0 2023-09-23T08:57:18.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.218+0000 7f0591ffb700 1 -- 172.21.15.82:0/3884916447 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5623adf43ba0 con 0x5623ae065620 2023-09-23T08:57:18.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.218+0000 7f0591ffb700 10 client.15762 handle_command_reply: tid=0 2023-09-23T08:57:18.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.218+0000 7f05c492fb80 1 client.15762 shutdown 2023-09-23T08:57:18.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.218+0000 7f05c492fb80 1 -- 172.21.15.82:0/3884916447 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623ae04bc40 msgr2=0x5623ae057c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:18.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.218+0000 7f05c492fb80 1 --2- 172.21.15.82:0/3884916447 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623ae04bc40 0x5623ae057c40 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f059c000c00 tx=0x7f059c005df0 comp rx=0 tx=0).stop 2023-09-23T08:57:18.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.218+0000 7f05c492fb80 1 -- 172.21.15.82:0/3884916447 shutdown_connections 2023-09-23T08:57:18.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.218+0000 7f05c492fb80 1 --2- 172.21.15.82:0/3884916447 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5623ae051ca0 0x5623ae055600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:18.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.218+0000 7f05c492fb80 1 --2- 172.21.15.82:0/3884916447 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5623ae065620 0x5623ae067a40 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:18.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.218+0000 7f05c492fb80 1 --2- 172.21.15.82:0/3884916447 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623ae04bc40 0x5623ae057c40 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:18.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.218+0000 7f05c492fb80 1 --2- 172.21.15.82:0/3884916447 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623ae051380 0x5623ae054ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:18.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.218+0000 7f05c492fb80 1 -- 172.21.15.82:0/3884916447 >> 172.21.15.82:0/3884916447 conn(0x5623adfc00e0 msgr2=0x5623ae040b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:18.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.218+0000 7f0591ffb700 0 client.15762 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T08:57:18.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.218+0000 7f05c492fb80 1 -- 172.21.15.82:0/3884916447 shutdown_connections 2023-09-23T08:57:18.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.218+0000 7f05c492fb80 1 -- 172.21.15.82:0/3884916447 wait complete. 2023-09-23T08:57:18.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.219+0000 7f05c492fb80 20 client.15762 trim_cache size 0 max 16384 2023-09-23T08:57:18.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.239+0000 7f05c492fb80 1 Processor -- start 2023-09-23T08:57:18.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.239+0000 7f05c492fb80 1 -- start start 2023-09-23T08:57:18.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.239+0000 7f05c492fb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5623ae04bc40 0x5623ae0577e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:18.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.239+0000 7f05c492fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623ae051380 0x5623ae04efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:18.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.239+0000 7f05c492fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623ae051ca0 0x5623ae04f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:18.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.239+0000 7f05c492fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623ade1f920 con 0x5623ae051ca0 2023-09-23T08:57:18.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.239+0000 7f05c492fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623ae042810 con 0x5623ae051380 2023-09-23T08:57:18.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.239+0000 7f05c492fb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623ae047580 con 0x5623ae04bc40 2023-09-23T08:57:18.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.240+0000 7f05a9d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623ae051380 0x5623ae04efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:18.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.240+0000 7f05aad9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623ae051ca0 0x5623ae04f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:18.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.240+0000 7f05a9d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623ae051380 0x5623ae04efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:44782/0 (socket says 172.21.15.82:44782) 2023-09-23T08:57:18.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.240+0000 7f05a9d9b700 1 -- 172.21.15.82:0/793286391 learned_addr learned my addr 172.21.15.82:0/793286391 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:57:18.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.240+0000 7f05aa59c700 1 --2- 172.21.15.82:0/793286391 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5623ae04bc40 0x5623ae0577e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:18.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.240+0000 7f05a9d9b700 1 -- 172.21.15.82:0/793286391 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5623ae04bc40 msgr2=0x5623ae0577e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:18.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.240+0000 7f05a9d9b700 1 --2- 172.21.15.82:0/793286391 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5623ae04bc40 0x5623ae0577e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:18.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.240+0000 7f05a9d9b700 1 -- 172.21.15.82:0/793286391 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623ae051ca0 msgr2=0x5623ae04f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:18.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.240+0000 7f05a9d9b700 1 --2- 172.21.15.82:0/793286391 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623ae051ca0 0x5623ae04f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:18.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.240+0000 7f05a9d9b700 1 -- 172.21.15.82:0/793286391 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5623addb2c60 con 0x5623ae051380 2023-09-23T08:57:18.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.240+0000 7f05a9d9b700 1 --2- 172.21.15.82:0/793286391 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623ae051380 0x5623ae04efb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f05a0095b00 tx=0x7f05a0003680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5937e8bee6446653 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:18.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.240+0000 7f05997fa700 1 -- 172.21.15.82:0/793286391 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a00a0ea0 con 0x5623ae051380 2023-09-23T08:57:18.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.241+0000 7f05997fa700 1 -- 172.21.15.82:0/793286391 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f05a00b0070 con 0x5623ae051380 2023-09-23T08:57:18.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.241+0000 7f05997fa700 1 -- 172.21.15.82:0/793286391 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a0098580 con 0x5623ae051380 2023-09-23T08:57:18.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.241+0000 7f05c492fb80 1 -- 172.21.15.82:0/793286391 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623ae051380 msgr2=0x5623ae04efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:18.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.241+0000 7f05c492fb80 1 --2- 172.21.15.82:0/793286391 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623ae051380 0x5623ae04efb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f05a0095b00 tx=0x7f05a0003680 comp rx=0 tx=0).stop 2023-09-23T08:57:18.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.241+0000 7f05c492fb80 1 -- 172.21.15.82:0/793286391 shutdown_connections 2023-09-23T08:57:18.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.241+0000 7f05c492fb80 1 --2- 172.21.15.82:0/793286391 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623ae051ca0 0x5623ae04f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:18.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.241+0000 7f05c492fb80 1 --2- 172.21.15.82:0/793286391 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5623ae04bc40 0x5623ae0577e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:18.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.241+0000 7f05c492fb80 1 --2- 172.21.15.82:0/793286391 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623ae051380 0x5623ae04efb0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:18.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.241+0000 7f05c492fb80 1 -- 172.21.15.82:0/793286391 >> 172.21.15.82:0/793286391 conn(0x5623adfc00e0 msgr2=0x5623ae060ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:18.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.241+0000 7f05c492fb80 1 -- 172.21.15.82:0/793286391 shutdown_connections 2023-09-23T08:57:18.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.241+0000 7f05c492fb80 1 -- 172.21.15.82:0/793286391 wait complete. 2023-09-23T08:57:18.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.242+0000 7f05c492fb80 1 -- start start 2023-09-23T08:57:18.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.242+0000 7f05c492fb80 1 Processor -- start 2023-09-23T08:57:18.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.243+0000 7f05c492fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623ae04bc40 0x5623ae04e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:18.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.243+0000 7f05c492fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623ae051380 0x5623ae04e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:18.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.243+0000 7f05c492fb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5623ae051ca0 0x5623ae04cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:18.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.243+0000 7f05c492fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623ae04d2e0 con 0x5623ae04bc40 2023-09-23T08:57:18.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.243+0000 7f05c492fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623ae04d450 con 0x5623ae051380 2023-09-23T08:57:18.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.243+0000 7f05c492fb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623ae04d610 con 0x5623ae051ca0 2023-09-23T08:57:18.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.243+0000 7f05c492fb80 10 client.0 _ll_register_callbacks cb 0x7f059c011440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T08:57:18.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.243+0000 7f05aa59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623ae04bc40 0x5623ae04e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:18.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.243+0000 7f05aa59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623ae04bc40 0x5623ae04e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52046/0 (socket says 172.21.15.82:52046) 2023-09-23T08:57:18.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.243+0000 7f05aa59c700 1 -- 172.21.15.82:0/1140009254 learned_addr learned my addr 172.21.15.82:0/1140009254 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:57:18.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.243+0000 7f05a9d9b700 1 --2- 172.21.15.82:0/1140009254 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623ae051380 0x5623ae04e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:18.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.243+0000 7f05aa59c700 1 -- 172.21.15.82:0/1140009254 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5623ae051ca0 msgr2=0x5623ae04cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:18.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.243+0000 7f05aad9d700 1 --2- 172.21.15.82:0/1140009254 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5623ae051ca0 0x5623ae04cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:18.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.243+0000 7f05aa59c700 1 --2- 172.21.15.82:0/1140009254 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5623ae051ca0 0x5623ae04cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:18.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.243+0000 7f05aa59c700 1 -- 172.21.15.82:0/1140009254 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623ae051380 msgr2=0x5623ae04e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:18.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.243+0000 7f05aa59c700 1 --2- 172.21.15.82:0/1140009254 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623ae051380 0x5623ae04e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:18.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.243+0000 7f05aa59c700 1 -- 172.21.15.82:0/1140009254 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05ac1a5830 con 0x5623ae04bc40 2023-09-23T08:57:18.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.243+0000 7f05a9d9b700 1 --2- 172.21.15.82:0/1140009254 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623ae051380 0x5623ae04e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T08:57:18.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.243+0000 7f05aad9d700 1 --2- 172.21.15.82:0/1140009254 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5623ae051ca0 0x5623ae04cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T08:57:18.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.244+0000 7f05aa59c700 1 --2- 172.21.15.82:0/1140009254 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623ae04bc40 0x5623ae04e040 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f059c0054f0 tx=0x7f059c009fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1161c2d20cf41a2f server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:18.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.244+0000 7f0591ffb700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T08:57:18.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.244+0000 7f0591ffb700 1 -- 172.21.15.82:0/1140009254 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f059c00f680 con 0x5623ae04bc40 2023-09-23T08:57:18.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.244+0000 7f05c492fb80 1 -- 172.21.15.82:0/1140009254 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5623ae03e8b0 con 0x5623ae04bc40 2023-09-23T08:57:18.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.244+0000 7f0591ffb700 1 -- 172.21.15.82:0/1140009254 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f059c00f7e0 con 0x5623ae04bc40 2023-09-23T08:57:18.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.244+0000 7f0591ffb700 1 -- 172.21.15.82:0/1140009254 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f059c0194e0 con 0x5623ae04bc40 2023-09-23T08:57:18.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.244+0000 7f05c492fb80 10 client.15768 fetch_fsmap learned FSMap version 27 2023-09-23T08:57:18.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.244+0000 7f05c492fb80 1 -- 172.21.15.82:0/1140009254 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5623addf0250 con 0x5623ae04bc40 2023-09-23T08:57:18.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.245+0000 7f0591ffb700 1 -- 172.21.15.82:0/1140009254 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5623ae03e8b0 con 0x5623ae04bc40 2023-09-23T08:57:18.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.245+0000 7f0591ffb700 1 -- 172.21.15.82:0/1140009254 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 27) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f059c003b10 con 0x5623ae04bc40 2023-09-23T08:57:18.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.245+0000 7f05c492fb80 10 client.15768 fetch_fsmap finished waiting for FSMap version 27 2023-09-23T08:57:18.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.245+0000 7f05c492fb80 10 client.15768 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T08:57:18.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.245+0000 7f05c492fb80 20 client.15768 populate_metadata read hostname 'smithi082' 2023-09-23T08:57:18.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.245+0000 7f05c492fb80 1 --2- 172.21.15.82:0/1140009254 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5623ae0b9ed0 0x5623ae0bc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:18.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.245+0000 7f05c492fb80 4 client.15768 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T08:57:18.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.245+0000 7f05c492fb80 1 -- 172.21.15.82:0/1140009254 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5623adf96970 con 0x5623ae0b9ed0 2023-09-23T08:57:18.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.245+0000 7f05a9d9b700 1 --2- 172.21.15.82:0/1140009254 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5623ae0b9ed0 0x5623ae0bc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:18.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.246+0000 7f05a9d9b700 1 --2- 172.21.15.82:0/1140009254 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5623ae0b9ed0 0x5623ae0bc2f0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7626ec90124fd310 server_cookie=b9bce7185adf224b in_seq=0 out_seq=0 2023-09-23T08:57:18.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.246+0000 7f0591ffb700 10 client.15768 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T08:57:18.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.246+0000 7f0591ffb700 1 -- 172.21.15.82:0/1140009254 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5623adf96970 con 0x5623ae0b9ed0 2023-09-23T08:57:18.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.246+0000 7f0591ffb700 10 client.15768 handle_command_reply: tid=0 2023-09-23T08:57:18.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.246+0000 7f05c492fb80 1 client.15768 shutdown 2023-09-23T08:57:18.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.246+0000 7f05c492fb80 1 -- 172.21.15.82:0/1140009254 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623ae04bc40 msgr2=0x5623ae04e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:18.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.246+0000 7f05c492fb80 1 --2- 172.21.15.82:0/1140009254 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623ae04bc40 0x5623ae04e040 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f059c0054f0 tx=0x7f059c009fd0 comp rx=0 tx=0).stop 2023-09-23T08:57:18.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.246+0000 7f05c492fb80 1 -- 172.21.15.82:0/1140009254 shutdown_connections 2023-09-23T08:57:18.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.246+0000 7f05c492fb80 1 --2- 172.21.15.82:0/1140009254 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5623ae051ca0 0x5623ae04cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:18.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.246+0000 7f05c492fb80 1 --2- 172.21.15.82:0/1140009254 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5623ae0b9ed0 0x5623ae0bc2f0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:18.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.246+0000 7f05c492fb80 1 --2- 172.21.15.82:0/1140009254 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623ae04bc40 0x5623ae04e040 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:18.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.246+0000 7f05c492fb80 1 --2- 172.21.15.82:0/1140009254 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623ae051380 0x5623ae04e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:18.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.246+0000 7f05c492fb80 1 -- 172.21.15.82:0/1140009254 >> 172.21.15.82:0/1140009254 conn(0x5623adfc00e0 msgr2=0x5623ae04efb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:18.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.246+0000 7f0591ffb700 0 client.15768 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T08:57:18.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.247+0000 7f05c492fb80 1 -- 172.21.15.82:0/1140009254 shutdown_connections 2023-09-23T08:57:18.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.247+0000 7f05c492fb80 1 -- 172.21.15.82:0/1140009254 wait complete. 2023-09-23T08:57:18.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.247+0000 7f05c492fb80 20 client.15768 trim_cache size 0 max 16384 2023-09-23T08:57:18.256 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T08:57:18.256 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "IDLE (waiting for more scrubs)", 2023-09-23T08:57:18.257 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T08:57:18.257 INFO:teuthology.orchestra.run.smithi082.stdout: "d3e3cd6e-8641-4b29-b735-b756840b11ec": { 2023-09-23T08:57:18.257 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T08:57:18.257 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "d3e3cd6e-8641-4b29-b735-b756840b11ec", 2023-09-23T08:57:18.257 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T08:57:18.257 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T08:57:18.257 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T08:57:18.257 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T08:57:18.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.247+0000 7f05b0fff700 1 -- 172.21.15.82:0/874035636 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f05940a01e0 msgr2=0x7f05940a26a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:18.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.247+0000 7f05b0fff700 1 --2- 172.21.15.82:0/874035636 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f05940a01e0 0x7f05940a26a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f05a4009cd0 tx=0x7f05a4009c60 comp rx=0 tx=0).stop 2023-09-23T08:57:18.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.247+0000 7f05b0fff700 1 -- 172.21.15.82:0/874035636 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05ac102350 msgr2=0x7f05ac19ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:18.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.247+0000 7f05b0fff700 1 --2- 172.21.15.82:0/874035636 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05ac102350 0x7f05ac19ef60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f05a000e9f0 tx=0x7f05a000ed00 comp rx=0 tx=0).stop 2023-09-23T08:57:18.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.247+0000 7f05b0fff700 1 -- 172.21.15.82:0/874035636 shutdown_connections 2023-09-23T08:57:18.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.247+0000 7f05b0fff700 1 --2- 172.21.15.82:0/874035636 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f05940a01e0 0x7f05940a26a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:18.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.247+0000 7f05b0fff700 1 --2- 172.21.15.82:0/874035636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05ac10ae50 0x7f05ac198a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:18.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.247+0000 7f05b0fff700 1 --2- 172.21.15.82:0/874035636 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05ac101a30 0x7f05ac19ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:18.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.247+0000 7f05b0fff700 1 --2- 172.21.15.82:0/874035636 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05ac102350 0x7f05ac19ef60 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:18.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.248+0000 7f05b0fff700 1 -- 172.21.15.82:0/874035636 >> 172.21.15.82:0/874035636 conn(0x7f05ac0fb270 msgr2=0x7f05ac0fd660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:18.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.248+0000 7f05b0fff700 1 -- 172.21.15.82:0/874035636 shutdown_connections 2023-09-23T08:57:18.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:18.248+0000 7f05b0fff700 1 -- 172.21.15.82:0/874035636 wait complete. 2023-09-23T08:57:18.270 INFO:tasks.cephfs.filesystem:scrub status for tag:d3e3cd6e-8641-4b29-b735-b756840b11ec - {'path': '/', 'tag': 'd3e3cd6e-8641-4b29-b735-b756840b11ec', 'options': 'recursive,force'} 2023-09-23T08:57:18.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:57:18 smithi161 ceph-mon[99580]: pgmap v15: 97 pgs: 97 active+clean; 41 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 2.2 MiB/s wr, 76 op/s 2023-09-23T08:57:18.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:57:18 smithi161 ceph-mon[99580]: scrub summary: active paths [/] 2023-09-23T08:57:18.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:57:18 smithi161 ceph-mon[99580]: scrub summary: idle+waiting paths [/] 2023-09-23T08:57:18.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:57:18 smithi161 ceph-mon[99580]: scrub summary: active paths [/] 2023-09-23T08:57:18.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:57:18 smithi161 ceph-mon[99580]: scrub summary: idle+waiting paths [/] 2023-09-23T08:57:19.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:57:18 smithi135 ceph-mon[99205]: pgmap v15: 97 pgs: 97 active+clean; 41 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 2.2 MiB/s wr, 76 op/s 2023-09-23T08:57:19.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:57:18 smithi135 ceph-mon[99205]: scrub summary: active paths [/] 2023-09-23T08:57:19.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:57:18 smithi135 ceph-mon[99205]: scrub summary: idle+waiting paths [/] 2023-09-23T08:57:19.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:57:18 smithi135 ceph-mon[99205]: scrub summary: active paths [/] 2023-09-23T08:57:19.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:57:18 smithi135 ceph-mon[99205]: scrub summary: idle+waiting paths [/] 2023-09-23T08:57:19.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:57:18 smithi082 ceph-mon[97694]: pgmap v15: 97 pgs: 97 active+clean; 41 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 2.2 MiB/s wr, 76 op/s 2023-09-23T08:57:19.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:57:18 smithi082 ceph-mon[97694]: scrub summary: active paths [/] 2023-09-23T08:57:19.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:57:18 smithi082 ceph-mon[97694]: scrub summary: idle+waiting paths [/] 2023-09-23T08:57:19.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:57:18 smithi082 ceph-mon[97694]: scrub summary: active paths [/] 2023-09-23T08:57:19.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:57:18 smithi082 ceph-mon[97694]: scrub summary: idle+waiting paths [/] 2023-09-23T08:57:19.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:57:19 smithi161 ceph-mon[99580]: scrub queued for path: / 2023-09-23T08:57:19.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:57:19 smithi161 ceph-mon[99580]: scrub summary: idle+waiting paths [/] 2023-09-23T08:57:19.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:57:19 smithi161 ceph-mon[99580]: scrub summary: active paths [/] 2023-09-23T08:57:19.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:57:19 smithi161 ceph-mon[99580]: scrub summary: idle+waiting paths [/] 2023-09-23T08:57:20.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:57:19 smithi135 ceph-mon[99205]: scrub queued for path: / 2023-09-23T08:57:20.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:57:19 smithi135 ceph-mon[99205]: scrub summary: idle+waiting paths [/] 2023-09-23T08:57:20.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:57:19 smithi135 ceph-mon[99205]: scrub summary: active paths [/] 2023-09-23T08:57:20.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:57:19 smithi135 ceph-mon[99205]: scrub summary: idle+waiting paths [/] 2023-09-23T08:57:20.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:57:19 smithi082 ceph-mon[97694]: scrub queued for path: / 2023-09-23T08:57:20.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:57:19 smithi082 ceph-mon[97694]: scrub summary: idle+waiting paths [/] 2023-09-23T08:57:20.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:57:19 smithi082 ceph-mon[97694]: scrub summary: active paths [/] 2023-09-23T08:57:20.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:57:19 smithi082 ceph-mon[97694]: scrub summary: idle+waiting paths [/] 2023-09-23T08:57:20.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:57:20 smithi161 ceph-mon[99580]: pgmap v16: 97 pgs: 97 active+clean; 42 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 2.5 MiB/s wr, 82 op/s 2023-09-23T08:57:21.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:57:20 smithi135 ceph-mon[99205]: pgmap v16: 97 pgs: 97 active+clean; 42 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 2.5 MiB/s wr, 82 op/s 2023-09-23T08:57:21.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:57:20 smithi082 ceph-mon[97694]: pgmap v16: 97 pgs: 97 active+clean; 42 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 2.5 MiB/s wr, 82 op/s 2023-09-23T08:57:22.247 INFO:teuthology.orchestra.run.smithi082.stderr: * Initialized, logs are in /var/lib/pgsql/initdb_postgresql.log 2023-09-23T08:57:22.252 DEBUG:teuthology.orchestra.run.smithi082:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2023-09-23T08:57:22.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:57:22 smithi082 ceph-mon[97694]: pgmap v17: 97 pgs: 97 active+clean; 48 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 470 KiB/s rd, 2.7 MiB/s wr, 98 op/s 2023-09-23T08:57:22.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:57:22 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T08:57:22.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:57:22 smithi135 ceph-mon[99205]: pgmap v17: 97 pgs: 97 active+clean; 48 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 470 KiB/s rd, 2.7 MiB/s wr, 98 op/s 2023-09-23T08:57:22.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:57:22 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T08:57:22.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:57:22 smithi161 ceph-mon[99580]: pgmap v17: 97 pgs: 97 active+clean; 48 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 470 KiB/s rd, 2.7 MiB/s wr, 98 op/s 2023-09-23T08:57:22.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:57:22 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T08:57:22.986 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/: 2023-09-23T08:57:22.986 INFO:teuthology.orchestra.run.smithi082.stdout:total 2 2023-09-23T08:57:22.986 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Sep 23 08:56 . 2023-09-23T08:57:22.987 INFO:teuthology.orchestra.run.smithi082.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 39557450 Sep 23 08:56 .. 2023-09-23T08:57:22.987 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Sep 23 08:57 data 2023-09-23T08:57:22.987 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:57:22.987 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data: 2023-09-23T08:57:22.987 INFO:teuthology.orchestra.run.smithi082.stdout:total 40 2023-09-23T08:57:22.987 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Sep 23 08:57 . 2023-09-23T08:57:22.987 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Sep 23 08:56 .. 2023-09-23T08:57:22.987 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 22144521 Sep 23 08:57 base 2023-09-23T08:57:22.987 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 565760 Sep 23 08:57 global 2023-09-23T08:57:22.987 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 log 2023-09-23T08:57:22.987 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 pg_commit_ts 2023-09-23T08:57:22.988 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 pg_dynshmem 2023-09-23T08:57:22.988 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 4269 Sep 23 08:57 pg_hba.conf 2023-09-23T08:57:22.988 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1636 Sep 23 08:57 pg_ident.conf 2023-09-23T08:57:22.988 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Sep 23 08:57 pg_logical 2023-09-23T08:57:22.988 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 pg_multixact 2023-09-23T08:57:22.988 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 pg_notify 2023-09-23T08:57:22.988 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 pg_replslot 2023-09-23T08:57:22.988 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 pg_serial 2023-09-23T08:57:22.988 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 pg_snapshots 2023-09-23T08:57:22.988 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 pg_stat 2023-09-23T08:57:22.988 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 pg_stat_tmp 2023-09-23T08:57:22.988 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 pg_subtrans 2023-09-23T08:57:22.989 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 pg_tblspc 2023-09-23T08:57:22.989 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 pg_twophase 2023-09-23T08:57:22.989 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 23 08:57 PG_VERSION 2023-09-23T08:57:22.989 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 23 08:57 pg_wal 2023-09-23T08:57:22.989 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 pg_xact 2023-09-23T08:57:22.989 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 88 Sep 23 08:57 postgresql.auto.conf 2023-09-23T08:57:22.989 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 22989 Sep 23 08:57 postgresql.conf 2023-09-23T08:57:22.989 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:57:22.989 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/base: 2023-09-23T08:57:22.989 INFO:teuthology.orchestra.run.smithi082.stdout:total 3 2023-09-23T08:57:22.989 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 22144521 Sep 23 08:57 . 2023-09-23T08:57:22.989 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Sep 23 08:57 .. 2023-09-23T08:57:22.990 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7381507 Sep 23 08:57 1 2023-09-23T08:57:22.990 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7381507 Sep 23 08:57 12346 2023-09-23T08:57:22.990 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7381507 Sep 23 08:57 12347 2023-09-23T08:57:22.990 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:57:22.990 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/base/1: 2023-09-23T08:57:22.990 INFO:teuthology.orchestra.run.smithi082.stdout:total 7210 2023-09-23T08:57:22.990 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7381507 Sep 23 08:57 . 2023-09-23T08:57:22.990 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 22144521 Sep 23 08:57 .. 2023-09-23T08:57:22.990 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 112 2023-09-23T08:57:22.990 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 113 2023-09-23T08:57:22.990 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 23 08:57 12182 2023-09-23T08:57:22.990 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 12182_fsm 2023-09-23T08:57:22.991 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12182_vm 2023-09-23T08:57:22.991 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 12184 2023-09-23T08:57:22.991 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12186 2023-09-23T08:57:22.991 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12187 2023-09-23T08:57:22.991 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 12187_fsm 2023-09-23T08:57:22.991 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12187_vm 2023-09-23T08:57:22.991 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 12189 2023-09-23T08:57:22.991 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12191 2023-09-23T08:57:22.991 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12192 2023-09-23T08:57:22.991 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 12192_fsm 2023-09-23T08:57:22.991 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12192_vm 2023-09-23T08:57:22.991 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 12194 2023-09-23T08:57:22.992 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12196 2023-09-23T08:57:22.992 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12197 2023-09-23T08:57:22.992 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 12197_fsm 2023-09-23T08:57:22.992 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12197_vm 2023-09-23T08:57:22.992 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 12199 2023-09-23T08:57:22.992 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12201 2023-09-23T08:57:22.992 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12202 2023-09-23T08:57:22.992 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 12202_fsm 2023-09-23T08:57:22.992 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12202_vm 2023-09-23T08:57:22.992 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 12204 2023-09-23T08:57:22.992 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12206 2023-09-23T08:57:22.992 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12207 2023-09-23T08:57:22.993 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 12207_fsm 2023-09-23T08:57:22.993 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12207_vm 2023-09-23T08:57:22.993 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 12209 2023-09-23T08:57:22.993 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12211 2023-09-23T08:57:22.993 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 12212 2023-09-23T08:57:22.993 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 12214 2023-09-23T08:57:22.993 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12216 2023-09-23T08:57:22.993 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 73728 Sep 23 08:57 1247 2023-09-23T08:57:22.993 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 1247_fsm 2023-09-23T08:57:22.993 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 1247_vm 2023-09-23T08:57:22.993 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 393216 Sep 23 08:57 1249 2023-09-23T08:57:22.993 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 1249_fsm 2023-09-23T08:57:22.994 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 1249_vm 2023-09-23T08:57:22.994 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 606208 Sep 23 08:57 1255 2023-09-23T08:57:22.994 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 1255_fsm 2023-09-23T08:57:22.994 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 1255_vm 2023-09-23T08:57:22.994 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 23 08:57 1259 2023-09-23T08:57:22.994 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 1259_fsm 2023-09-23T08:57:22.994 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 1259_vm 2023-09-23T08:57:22.994 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 1417 2023-09-23T08:57:22.994 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 1417_vm 2023-09-23T08:57:22.994 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 1418 2023-09-23T08:57:22.994 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 1418_vm 2023-09-23T08:57:22.995 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 174 2023-09-23T08:57:22.995 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 175 2023-09-23T08:57:22.995 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2187 2023-09-23T08:57:22.995 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2224 2023-09-23T08:57:22.995 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2224_vm 2023-09-23T08:57:22.995 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2328 2023-09-23T08:57:22.995 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2328_vm 2023-09-23T08:57:22.995 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2336 2023-09-23T08:57:22.995 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2336_vm 2023-09-23T08:57:22.995 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2337 2023-09-23T08:57:22.995 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2600 2023-09-23T08:57:22.995 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2600_fsm 2023-09-23T08:57:22.996 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2600_vm 2023-09-23T08:57:22.996 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2601 2023-09-23T08:57:22.996 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2601_fsm 2023-09-23T08:57:22.996 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2601_vm 2023-09-23T08:57:22.996 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 23 08:57 2602 2023-09-23T08:57:22.996 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2602_fsm 2023-09-23T08:57:22.996 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2602_vm 2023-09-23T08:57:22.996 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 23 08:57 2603 2023-09-23T08:57:22.996 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2603_fsm 2023-09-23T08:57:22.996 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2603_vm 2023-09-23T08:57:22.996 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2604 2023-09-23T08:57:22.996 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2604_vm 2023-09-23T08:57:22.997 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2605 2023-09-23T08:57:22.997 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2605_fsm 2023-09-23T08:57:22.997 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2605_vm 2023-09-23T08:57:22.997 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2606 2023-09-23T08:57:22.997 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2606_fsm 2023-09-23T08:57:22.997 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2606_vm 2023-09-23T08:57:22.997 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2607 2023-09-23T08:57:22.997 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2607_fsm 2023-09-23T08:57:22.997 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2607_vm 2023-09-23T08:57:22.997 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 442368 Sep 23 08:57 2608 2023-09-23T08:57:22.997 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2608_fsm 2023-09-23T08:57:22.998 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2608_vm 2023-09-23T08:57:22.998 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 286720 Sep 23 08:57 2609 2023-09-23T08:57:22.998 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2609_fsm 2023-09-23T08:57:22.998 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2609_vm 2023-09-23T08:57:22.998 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2610 2023-09-23T08:57:22.998 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2610_fsm 2023-09-23T08:57:22.998 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2610_vm 2023-09-23T08:57:22.998 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2611 2023-09-23T08:57:22.998 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2611_vm 2023-09-23T08:57:22.998 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2612 2023-09-23T08:57:22.998 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2612_fsm 2023-09-23T08:57:22.999 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2612_vm 2023-09-23T08:57:22.999 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2613 2023-09-23T08:57:22.999 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2613_vm 2023-09-23T08:57:22.999 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2615 2023-09-23T08:57:22.999 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2615_fsm 2023-09-23T08:57:22.999 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2615_vm 2023-09-23T08:57:22.999 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2616 2023-09-23T08:57:22.999 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2616_fsm 2023-09-23T08:57:22.999 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2616_vm 2023-09-23T08:57:22.999 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Sep 23 08:57 2617 2023-09-23T08:57:22.999 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2617_fsm 2023-09-23T08:57:22.999 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2617_vm 2023-09-23T08:57:23.000 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Sep 23 08:57 2618 2023-09-23T08:57:23.000 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2618_fsm 2023-09-23T08:57:23.000 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2618_vm 2023-09-23T08:57:23.000 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Sep 23 08:57 2619 2023-09-23T08:57:23.000 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2619_fsm 2023-09-23T08:57:23.000 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2619_vm 2023-09-23T08:57:23.000 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2620 2023-09-23T08:57:23.000 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2620_vm 2023-09-23T08:57:23.000 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2650 2023-09-23T08:57:23.000 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2651 2023-09-23T08:57:23.000 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2652 2023-09-23T08:57:23.000 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 23 08:57 2653 2023-09-23T08:57:23.001 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 23 08:57 2654 2023-09-23T08:57:23.001 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 23 08:57 2655 2023-09-23T08:57:23.001 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2656 2023-09-23T08:57:23.001 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2657 2023-09-23T08:57:23.001 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 23 08:57 2658 2023-09-23T08:57:23.001 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 23 08:57 2659 2023-09-23T08:57:23.001 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2660 2023-09-23T08:57:23.001 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2661 2023-09-23T08:57:23.001 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 23 08:57 2662 2023-09-23T08:57:23.001 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 23 08:57 2663 2023-09-23T08:57:23.001 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2664 2023-09-23T08:57:23.002 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2665 2023-09-23T08:57:23.002 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2666 2023-09-23T08:57:23.002 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2667 2023-09-23T08:57:23.002 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2668 2023-09-23T08:57:23.002 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2669 2023-09-23T08:57:23.002 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2670 2023-09-23T08:57:23.002 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 335872 Sep 23 08:57 2673 2023-09-23T08:57:23.002 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 376832 Sep 23 08:57 2674 2023-09-23T08:57:23.002 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 180224 Sep 23 08:57 2675 2023-09-23T08:57:23.002 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2678 2023-09-23T08:57:23.002 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2679 2023-09-23T08:57:23.003 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2680 2023-09-23T08:57:23.003 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2681 2023-09-23T08:57:23.003 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2682 2023-09-23T08:57:23.003 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2683 2023-09-23T08:57:23.003 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2684 2023-09-23T08:57:23.003 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2685 2023-09-23T08:57:23.003 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2686 2023-09-23T08:57:23.003 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2687 2023-09-23T08:57:23.003 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 23 08:57 2688 2023-09-23T08:57:23.003 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 23 08:57 2689 2023-09-23T08:57:23.003 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 23 08:57 2690 2023-09-23T08:57:23.004 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 270336 Sep 23 08:57 2691 2023-09-23T08:57:23.004 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2692 2023-09-23T08:57:23.004 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2693 2023-09-23T08:57:23.004 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2696 2023-09-23T08:57:23.004 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2699 2023-09-23T08:57:23.004 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2701 2023-09-23T08:57:23.004 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2702 2023-09-23T08:57:23.004 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2703 2023-09-23T08:57:23.004 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 23 08:57 2704 2023-09-23T08:57:23.004 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2753 2023-09-23T08:57:23.004 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2753_fsm 2023-09-23T08:57:23.005 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2753_vm 2023-09-23T08:57:23.005 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2754 2023-09-23T08:57:23.005 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2755 2023-09-23T08:57:23.005 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 23 08:57 2756 2023-09-23T08:57:23.005 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 23 08:57 2757 2023-09-23T08:57:23.005 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2830 2023-09-23T08:57:23.005 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2830_vm 2023-09-23T08:57:23.005 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2831 2023-09-23T08:57:23.005 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2832 2023-09-23T08:57:23.005 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2832_vm 2023-09-23T08:57:23.005 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2833 2023-09-23T08:57:23.005 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2834 2023-09-23T08:57:23.006 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2834_vm 2023-09-23T08:57:23.006 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2835 2023-09-23T08:57:23.006 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2836 2023-09-23T08:57:23.006 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2836_vm 2023-09-23T08:57:23.006 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2837 2023-09-23T08:57:23.006 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 417792 Sep 23 08:57 2838 2023-09-23T08:57:23.006 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2838_fsm 2023-09-23T08:57:23.006 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2838_vm 2023-09-23T08:57:23.006 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2839 2023-09-23T08:57:23.007 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2840 2023-09-23T08:57:23.007 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2840_fsm 2023-09-23T08:57:23.007 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2840_vm 2023-09-23T08:57:23.007 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2841 2023-09-23T08:57:23.007 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2995 2023-09-23T08:57:23.007 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2995_vm 2023-09-23T08:57:23.007 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2996 2023-09-23T08:57:23.007 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3079 2023-09-23T08:57:23.007 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 3079_fsm 2023-09-23T08:57:23.007 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3079_vm 2023-09-23T08:57:23.007 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3080 2023-09-23T08:57:23.007 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3081 2023-09-23T08:57:23.008 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3085 2023-09-23T08:57:23.008 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3118 2023-09-23T08:57:23.008 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3118_vm 2023-09-23T08:57:23.008 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3119 2023-09-23T08:57:23.008 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3164 2023-09-23T08:57:23.008 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3256 2023-09-23T08:57:23.008 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3256_vm 2023-09-23T08:57:23.008 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3257 2023-09-23T08:57:23.008 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3258 2023-09-23T08:57:23.008 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3350 2023-09-23T08:57:23.008 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3350_vm 2023-09-23T08:57:23.008 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3351 2023-09-23T08:57:23.009 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3379 2023-09-23T08:57:23.009 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3380 2023-09-23T08:57:23.009 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3381 2023-09-23T08:57:23.009 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3381_vm 2023-09-23T08:57:23.009 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3394 2023-09-23T08:57:23.009 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 3394_fsm 2023-09-23T08:57:23.009 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3394_vm 2023-09-23T08:57:23.009 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3395 2023-09-23T08:57:23.009 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3439 2023-09-23T08:57:23.009 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3439_vm 2023-09-23T08:57:23.009 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3440 2023-09-23T08:57:23.010 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 23 08:57 3455 2023-09-23T08:57:23.010 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3456 2023-09-23T08:57:23.010 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 3456_fsm 2023-09-23T08:57:23.010 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3456_vm 2023-09-23T08:57:23.010 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3466 2023-09-23T08:57:23.010 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3466_vm 2023-09-23T08:57:23.010 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3467 2023-09-23T08:57:23.010 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3468 2023-09-23T08:57:23.010 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3501 2023-09-23T08:57:23.011 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3501_vm 2023-09-23T08:57:23.011 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3502 2023-09-23T08:57:23.011 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3503 2023-09-23T08:57:23.011 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3534 2023-09-23T08:57:23.011 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3541 2023-09-23T08:57:23.011 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 3541_fsm 2023-09-23T08:57:23.012 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3541_vm 2023-09-23T08:57:23.012 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3542 2023-09-23T08:57:23.012 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3574 2023-09-23T08:57:23.012 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3575 2023-09-23T08:57:23.012 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3576 2023-09-23T08:57:23.012 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3576_vm 2023-09-23T08:57:23.013 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3596 2023-09-23T08:57:23.013 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3596_vm 2023-09-23T08:57:23.013 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3597 2023-09-23T08:57:23.013 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3598 2023-09-23T08:57:23.013 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3598_vm 2023-09-23T08:57:23.013 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3599 2023-09-23T08:57:23.014 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3600 2023-09-23T08:57:23.014 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 3600_fsm 2023-09-23T08:57:23.014 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3600_vm 2023-09-23T08:57:23.014 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3601 2023-09-23T08:57:23.014 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 3601_fsm 2023-09-23T08:57:23.014 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3601_vm 2023-09-23T08:57:23.015 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3602 2023-09-23T08:57:23.015 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 3602_fsm 2023-09-23T08:57:23.534 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3602_vm 2023-09-23T08:57:23.534 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3603 2023-09-23T08:57:23.534 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 3603_fsm 2023-09-23T08:57:23.534 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3603_vm 2023-09-23T08:57:23.534 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3604 2023-09-23T08:57:23.534 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3605 2023-09-23T08:57:23.534 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3606 2023-09-23T08:57:23.534 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3607 2023-09-23T08:57:23.534 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3608 2023-09-23T08:57:23.535 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 23 08:57 3609 2023-09-23T08:57:23.535 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3712 2023-09-23T08:57:23.535 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3764 2023-09-23T08:57:23.535 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 3764_fsm 2023-09-23T08:57:23.535 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3764_vm 2023-09-23T08:57:23.535 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3766 2023-09-23T08:57:23.535 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3767 2023-09-23T08:57:23.535 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3997 2023-09-23T08:57:23.535 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 5002 2023-09-23T08:57:23.535 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 548 2023-09-23T08:57:23.535 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 549 2023-09-23T08:57:23.536 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 6102 2023-09-23T08:57:23.536 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 6102_vm 2023-09-23T08:57:23.536 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 6104 2023-09-23T08:57:23.536 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 6104_vm 2023-09-23T08:57:23.536 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 6106 2023-09-23T08:57:23.536 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 6106_vm 2023-09-23T08:57:23.536 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 6110 2023-09-23T08:57:23.536 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 6111 2023-09-23T08:57:23.536 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 6112 2023-09-23T08:57:23.536 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 6113 2023-09-23T08:57:23.536 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 6117 2023-09-23T08:57:23.537 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 826 2023-09-23T08:57:23.537 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 826_vm 2023-09-23T08:57:23.537 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 827 2023-09-23T08:57:23.537 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 828 2023-09-23T08:57:23.537 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 23 08:57 pg_filenode.map 2023-09-23T08:57:23.537 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 23 08:57 PG_VERSION 2023-09-23T08:57:23.537 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:57:23.537 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/base/12346: 2023-09-23T08:57:23.537 INFO:teuthology.orchestra.run.smithi082.stdout:total 7210 2023-09-23T08:57:23.537 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7381507 Sep 23 08:57 . 2023-09-23T08:57:23.537 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 22144521 Sep 23 08:57 .. 2023-09-23T08:57:23.538 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 112 2023-09-23T08:57:23.538 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 113 2023-09-23T08:57:23.538 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 23 08:57 12182 2023-09-23T08:57:23.538 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 12182_fsm 2023-09-23T08:57:23.538 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12182_vm 2023-09-23T08:57:23.538 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 12184 2023-09-23T08:57:23.538 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12186 2023-09-23T08:57:23.538 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12187 2023-09-23T08:57:23.538 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 12187_fsm 2023-09-23T08:57:23.538 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12187_vm 2023-09-23T08:57:23.539 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 12189 2023-09-23T08:57:23.539 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12191 2023-09-23T08:57:23.539 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12192 2023-09-23T08:57:23.539 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 12192_fsm 2023-09-23T08:57:23.539 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12192_vm 2023-09-23T08:57:23.539 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 12194 2023-09-23T08:57:23.539 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12196 2023-09-23T08:57:23.539 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12197 2023-09-23T08:57:23.539 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 12197_fsm 2023-09-23T08:57:23.539 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12197_vm 2023-09-23T08:57:23.539 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 12199 2023-09-23T08:57:23.540 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12201 2023-09-23T08:57:23.540 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12202 2023-09-23T08:57:23.540 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 12202_fsm 2023-09-23T08:57:23.540 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12202_vm 2023-09-23T08:57:23.540 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 12204 2023-09-23T08:57:23.540 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12206 2023-09-23T08:57:23.540 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12207 2023-09-23T08:57:23.540 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 12207_fsm 2023-09-23T08:57:23.540 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12207_vm 2023-09-23T08:57:23.540 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 12209 2023-09-23T08:57:23.541 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12211 2023-09-23T08:57:23.541 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 12212 2023-09-23T08:57:23.541 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 12214 2023-09-23T08:57:23.541 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12216 2023-09-23T08:57:23.541 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 73728 Sep 23 08:57 1247 2023-09-23T08:57:23.541 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 1247_fsm 2023-09-23T08:57:23.541 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 1247_vm 2023-09-23T08:57:23.541 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 393216 Sep 23 08:57 1249 2023-09-23T08:57:23.541 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 1249_fsm 2023-09-23T08:57:23.541 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 1249_vm 2023-09-23T08:57:23.541 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 606208 Sep 23 08:57 1255 2023-09-23T08:57:23.542 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 1255_fsm 2023-09-23T08:57:23.542 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 1255_vm 2023-09-23T08:57:23.542 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 23 08:57 1259 2023-09-23T08:57:23.542 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 1259_fsm 2023-09-23T08:57:23.542 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 1259_vm 2023-09-23T08:57:23.542 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 1417 2023-09-23T08:57:23.542 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 1417_vm 2023-09-23T08:57:23.542 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 1418 2023-09-23T08:57:23.542 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 1418_vm 2023-09-23T08:57:23.542 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 174 2023-09-23T08:57:23.542 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 175 2023-09-23T08:57:23.543 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2187 2023-09-23T08:57:23.543 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2224 2023-09-23T08:57:23.543 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2224_vm 2023-09-23T08:57:23.543 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2328 2023-09-23T08:57:23.543 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2328_vm 2023-09-23T08:57:23.543 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2336 2023-09-23T08:57:23.543 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2336_vm 2023-09-23T08:57:23.543 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2337 2023-09-23T08:57:23.543 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2600 2023-09-23T08:57:23.543 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2600_fsm 2023-09-23T08:57:23.543 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2600_vm 2023-09-23T08:57:23.543 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2601 2023-09-23T08:57:23.544 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2601_fsm 2023-09-23T08:57:23.544 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2601_vm 2023-09-23T08:57:23.544 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 23 08:57 2602 2023-09-23T08:57:23.544 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2602_fsm 2023-09-23T08:57:23.544 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2602_vm 2023-09-23T08:57:23.544 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 23 08:57 2603 2023-09-23T08:57:23.544 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2603_fsm 2023-09-23T08:57:23.544 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2603_vm 2023-09-23T08:57:23.544 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2604 2023-09-23T08:57:23.544 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2604_vm 2023-09-23T08:57:23.544 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2605 2023-09-23T08:57:23.544 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2605_fsm 2023-09-23T08:57:23.545 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2605_vm 2023-09-23T08:57:23.545 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2606 2023-09-23T08:57:23.545 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2606_fsm 2023-09-23T08:57:23.545 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2606_vm 2023-09-23T08:57:23.545 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2607 2023-09-23T08:57:23.545 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2607_fsm 2023-09-23T08:57:23.545 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2607_vm 2023-09-23T08:57:23.545 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 442368 Sep 23 08:57 2608 2023-09-23T08:57:23.545 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2608_fsm 2023-09-23T08:57:23.545 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2608_vm 2023-09-23T08:57:23.545 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 286720 Sep 23 08:57 2609 2023-09-23T08:57:23.546 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2609_fsm 2023-09-23T08:57:23.546 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2609_vm 2023-09-23T08:57:23.546 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2610 2023-09-23T08:57:23.546 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2610_fsm 2023-09-23T08:57:23.546 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2610_vm 2023-09-23T08:57:23.546 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2611 2023-09-23T08:57:23.546 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2611_vm 2023-09-23T08:57:23.546 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2612 2023-09-23T08:57:23.547 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2612_fsm 2023-09-23T08:57:23.547 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2612_vm 2023-09-23T08:57:23.547 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2613 2023-09-23T08:57:23.547 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2613_vm 2023-09-23T08:57:23.547 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2615 2023-09-23T08:57:23.548 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2615_fsm 2023-09-23T08:57:23.548 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2615_vm 2023-09-23T08:57:23.548 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2616 2023-09-23T08:57:23.548 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2616_fsm 2023-09-23T08:57:23.548 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2616_vm 2023-09-23T08:57:23.548 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Sep 23 08:57 2617 2023-09-23T08:57:23.548 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2617_fsm 2023-09-23T08:57:23.548 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2617_vm 2023-09-23T08:57:23.548 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Sep 23 08:57 2618 2023-09-23T08:57:23.548 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2618_fsm 2023-09-23T08:57:23.549 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2618_vm 2023-09-23T08:57:23.549 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Sep 23 08:57 2619 2023-09-23T08:57:23.549 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2619_fsm 2023-09-23T08:57:23.549 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2619_vm 2023-09-23T08:57:23.549 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2620 2023-09-23T08:57:23.549 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2620_vm 2023-09-23T08:57:23.549 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2650 2023-09-23T08:57:23.549 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2651 2023-09-23T08:57:23.549 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2652 2023-09-23T08:57:23.549 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 23 08:57 2653 2023-09-23T08:57:23.549 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 23 08:57 2654 2023-09-23T08:57:23.549 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 23 08:57 2655 2023-09-23T08:57:23.550 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2656 2023-09-23T08:57:23.550 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2657 2023-09-23T08:57:23.550 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 23 08:57 2658 2023-09-23T08:57:23.550 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 23 08:57 2659 2023-09-23T08:57:23.550 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2660 2023-09-23T08:57:23.550 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2661 2023-09-23T08:57:23.550 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 23 08:57 2662 2023-09-23T08:57:23.550 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 23 08:57 2663 2023-09-23T08:57:23.550 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2664 2023-09-23T08:57:23.550 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2665 2023-09-23T08:57:23.550 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2666 2023-09-23T08:57:23.551 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2667 2023-09-23T08:57:23.551 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2668 2023-09-23T08:57:23.551 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2669 2023-09-23T08:57:23.551 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2670 2023-09-23T08:57:23.551 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 335872 Sep 23 08:57 2673 2023-09-23T08:57:23.551 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 376832 Sep 23 08:57 2674 2023-09-23T08:57:23.551 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 180224 Sep 23 08:57 2675 2023-09-23T08:57:23.551 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2678 2023-09-23T08:57:23.551 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2679 2023-09-23T08:57:23.551 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2680 2023-09-23T08:57:23.551 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2681 2023-09-23T08:57:23.552 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2682 2023-09-23T08:57:23.552 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2683 2023-09-23T08:57:23.552 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2684 2023-09-23T08:57:23.552 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2685 2023-09-23T08:57:23.552 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2686 2023-09-23T08:57:23.552 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2687 2023-09-23T08:57:23.552 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 23 08:57 2688 2023-09-23T08:57:23.552 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 23 08:57 2689 2023-09-23T08:57:23.552 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 23 08:57 2690 2023-09-23T08:57:23.552 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 270336 Sep 23 08:57 2691 2023-09-23T08:57:23.552 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2692 2023-09-23T08:57:23.552 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2693 2023-09-23T08:57:23.553 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2696 2023-09-23T08:57:23.553 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2699 2023-09-23T08:57:23.553 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2701 2023-09-23T08:57:23.553 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2702 2023-09-23T08:57:23.553 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2703 2023-09-23T08:57:23.553 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 23 08:57 2704 2023-09-23T08:57:23.553 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2753 2023-09-23T08:57:23.553 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2753_fsm 2023-09-23T08:57:23.553 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2753_vm 2023-09-23T08:57:23.553 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2754 2023-09-23T08:57:23.554 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2755 2023-09-23T08:57:23.554 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 23 08:57 2756 2023-09-23T08:57:23.554 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 23 08:57 2757 2023-09-23T08:57:23.554 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2830 2023-09-23T08:57:23.554 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2830_vm 2023-09-23T08:57:23.554 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2831 2023-09-23T08:57:23.554 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2832 2023-09-23T08:57:23.554 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2832_vm 2023-09-23T08:57:23.554 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2833 2023-09-23T08:57:23.554 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2834 2023-09-23T08:57:23.554 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2834_vm 2023-09-23T08:57:23.555 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2835 2023-09-23T08:57:23.555 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2836 2023-09-23T08:57:23.555 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2836_vm 2023-09-23T08:57:23.555 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2837 2023-09-23T08:57:23.555 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 417792 Sep 23 08:57 2838 2023-09-23T08:57:23.555 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2838_fsm 2023-09-23T08:57:23.555 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2838_vm 2023-09-23T08:57:23.555 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2839 2023-09-23T08:57:23.555 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2840 2023-09-23T08:57:23.555 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2840_fsm 2023-09-23T08:57:23.556 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2840_vm 2023-09-23T08:57:23.556 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2841 2023-09-23T08:57:23.556 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2995 2023-09-23T08:57:23.556 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2995_vm 2023-09-23T08:57:23.556 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2996 2023-09-23T08:57:23.556 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3079 2023-09-23T08:57:23.556 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 3079_fsm 2023-09-23T08:57:23.556 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3079_vm 2023-09-23T08:57:23.556 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3080 2023-09-23T08:57:23.556 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3081 2023-09-23T08:57:23.556 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3085 2023-09-23T08:57:23.556 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3118 2023-09-23T08:57:23.557 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3118_vm 2023-09-23T08:57:23.557 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3119 2023-09-23T08:57:23.557 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3164 2023-09-23T08:57:23.557 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3256 2023-09-23T08:57:23.557 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3256_vm 2023-09-23T08:57:23.557 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3257 2023-09-23T08:57:23.557 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3258 2023-09-23T08:57:23.557 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3350 2023-09-23T08:57:23.557 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3350_vm 2023-09-23T08:57:23.558 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3351 2023-09-23T08:57:23.558 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3379 2023-09-23T08:57:23.558 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3380 2023-09-23T08:57:23.558 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3381 2023-09-23T08:57:23.558 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3381_vm 2023-09-23T08:57:23.558 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3394 2023-09-23T08:57:23.558 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 3394_fsm 2023-09-23T08:57:23.558 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3394_vm 2023-09-23T08:57:23.558 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3395 2023-09-23T08:57:23.558 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3439 2023-09-23T08:57:23.559 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3439_vm 2023-09-23T08:57:23.559 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3440 2023-09-23T08:57:23.559 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 23 08:57 3455 2023-09-23T08:57:23.559 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3456 2023-09-23T08:57:23.559 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 3456_fsm 2023-09-23T08:57:23.559 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3456_vm 2023-09-23T08:57:23.559 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3466 2023-09-23T08:57:23.559 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3466_vm 2023-09-23T08:57:23.559 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3467 2023-09-23T08:57:23.559 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3468 2023-09-23T08:57:23.559 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3501 2023-09-23T08:57:23.559 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3501_vm 2023-09-23T08:57:23.560 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3502 2023-09-23T08:57:23.560 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3503 2023-09-23T08:57:23.560 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3534 2023-09-23T08:57:23.560 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3541 2023-09-23T08:57:23.560 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 3541_fsm 2023-09-23T08:57:23.560 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3541_vm 2023-09-23T08:57:23.560 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3542 2023-09-23T08:57:23.560 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3574 2023-09-23T08:57:23.560 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3575 2023-09-23T08:57:23.560 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3576 2023-09-23T08:57:23.560 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3576_vm 2023-09-23T08:57:23.560 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3596 2023-09-23T08:57:23.560 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3596_vm 2023-09-23T08:57:23.561 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3597 2023-09-23T08:57:23.561 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3598 2023-09-23T08:57:23.561 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3598_vm 2023-09-23T08:57:23.561 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3599 2023-09-23T08:57:23.561 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3600 2023-09-23T08:57:23.561 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 3600_fsm 2023-09-23T08:57:23.561 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3600_vm 2023-09-23T08:57:23.561 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3601 2023-09-23T08:57:23.561 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 3601_fsm 2023-09-23T08:57:23.561 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3601_vm 2023-09-23T08:57:23.561 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3602 2023-09-23T08:57:24.087 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 3602_fsm 2023-09-23T08:57:24.087 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3602_vm 2023-09-23T08:57:24.087 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3603 2023-09-23T08:57:24.087 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 3603_fsm 2023-09-23T08:57:24.088 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3603_vm 2023-09-23T08:57:24.088 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3604 2023-09-23T08:57:24.088 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3605 2023-09-23T08:57:24.088 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3606 2023-09-23T08:57:24.088 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3607 2023-09-23T08:57:24.088 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3608 2023-09-23T08:57:24.088 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 23 08:57 3609 2023-09-23T08:57:24.088 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3712 2023-09-23T08:57:24.089 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3764 2023-09-23T08:57:24.089 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 3764_fsm 2023-09-23T08:57:24.089 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3764_vm 2023-09-23T08:57:24.089 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3766 2023-09-23T08:57:24.089 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3767 2023-09-23T08:57:24.089 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3997 2023-09-23T08:57:24.089 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 5002 2023-09-23T08:57:24.089 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 548 2023-09-23T08:57:24.089 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 549 2023-09-23T08:57:24.089 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 6102 2023-09-23T08:57:24.089 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 6102_vm 2023-09-23T08:57:24.090 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 6104 2023-09-23T08:57:24.090 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 6104_vm 2023-09-23T08:57:24.090 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 6106 2023-09-23T08:57:24.090 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 6106_vm 2023-09-23T08:57:24.090 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 6110 2023-09-23T08:57:24.090 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 6111 2023-09-23T08:57:24.090 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 6112 2023-09-23T08:57:24.090 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 6113 2023-09-23T08:57:24.090 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 6117 2023-09-23T08:57:24.090 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 826 2023-09-23T08:57:24.090 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 826_vm 2023-09-23T08:57:24.091 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 827 2023-09-23T08:57:24.091 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 828 2023-09-23T08:57:24.091 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 23 08:57 pg_filenode.map 2023-09-23T08:57:24.091 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 23 08:57 PG_VERSION 2023-09-23T08:57:24.091 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:57:24.091 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/base/12347: 2023-09-23T08:57:24.091 INFO:teuthology.orchestra.run.smithi082.stdout:total 7210 2023-09-23T08:57:24.091 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7381507 Sep 23 08:57 . 2023-09-23T08:57:24.091 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 22144521 Sep 23 08:57 .. 2023-09-23T08:57:24.091 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 112 2023-09-23T08:57:24.091 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 113 2023-09-23T08:57:24.091 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 23 08:57 12182 2023-09-23T08:57:24.092 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 12182_fsm 2023-09-23T08:57:24.092 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12182_vm 2023-09-23T08:57:24.092 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 12184 2023-09-23T08:57:24.092 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12186 2023-09-23T08:57:24.092 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12187 2023-09-23T08:57:24.092 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 12187_fsm 2023-09-23T08:57:24.092 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12187_vm 2023-09-23T08:57:24.092 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 12189 2023-09-23T08:57:24.092 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12191 2023-09-23T08:57:24.092 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12192 2023-09-23T08:57:24.092 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 12192_fsm 2023-09-23T08:57:24.092 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12192_vm 2023-09-23T08:57:24.093 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 12194 2023-09-23T08:57:24.093 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12196 2023-09-23T08:57:24.093 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12197 2023-09-23T08:57:24.093 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 12197_fsm 2023-09-23T08:57:24.093 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12197_vm 2023-09-23T08:57:24.093 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 12199 2023-09-23T08:57:24.093 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12201 2023-09-23T08:57:24.093 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12202 2023-09-23T08:57:24.093 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 12202_fsm 2023-09-23T08:57:24.093 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12202_vm 2023-09-23T08:57:24.093 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 12204 2023-09-23T08:57:24.093 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12206 2023-09-23T08:57:24.094 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12207 2023-09-23T08:57:24.094 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 12207_fsm 2023-09-23T08:57:24.094 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12207_vm 2023-09-23T08:57:24.094 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 12209 2023-09-23T08:57:24.094 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12211 2023-09-23T08:57:24.094 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 12212 2023-09-23T08:57:24.094 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 12214 2023-09-23T08:57:24.094 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12216 2023-09-23T08:57:24.094 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 73728 Sep 23 08:57 1247 2023-09-23T08:57:24.094 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 1247_fsm 2023-09-23T08:57:24.094 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 1247_vm 2023-09-23T08:57:24.095 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 393216 Sep 23 08:57 1249 2023-09-23T08:57:24.095 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 1249_fsm 2023-09-23T08:57:24.095 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 1249_vm 2023-09-23T08:57:24.095 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 606208 Sep 23 08:57 1255 2023-09-23T08:57:24.095 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 1255_fsm 2023-09-23T08:57:24.095 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 1255_vm 2023-09-23T08:57:24.095 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 23 08:57 1259 2023-09-23T08:57:24.095 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 1259_fsm 2023-09-23T08:57:24.095 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 1259_vm 2023-09-23T08:57:24.095 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 1417 2023-09-23T08:57:24.095 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 1417_vm 2023-09-23T08:57:24.096 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 1418 2023-09-23T08:57:24.096 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 1418_vm 2023-09-23T08:57:24.096 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 174 2023-09-23T08:57:24.096 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 175 2023-09-23T08:57:24.096 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2187 2023-09-23T08:57:24.096 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2224 2023-09-23T08:57:24.096 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2224_vm 2023-09-23T08:57:24.096 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2328 2023-09-23T08:57:24.096 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2328_vm 2023-09-23T08:57:24.096 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2336 2023-09-23T08:57:24.096 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2336_vm 2023-09-23T08:57:24.096 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2337 2023-09-23T08:57:24.097 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2600 2023-09-23T08:57:24.097 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2600_fsm 2023-09-23T08:57:24.097 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2600_vm 2023-09-23T08:57:24.097 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2601 2023-09-23T08:57:24.097 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2601_fsm 2023-09-23T08:57:24.097 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2601_vm 2023-09-23T08:57:24.097 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 23 08:57 2602 2023-09-23T08:57:24.097 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2602_fsm 2023-09-23T08:57:24.097 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2602_vm 2023-09-23T08:57:24.097 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 23 08:57 2603 2023-09-23T08:57:24.097 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2603_fsm 2023-09-23T08:57:24.098 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2603_vm 2023-09-23T08:57:24.098 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2604 2023-09-23T08:57:24.098 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2604_vm 2023-09-23T08:57:24.098 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2605 2023-09-23T08:57:24.098 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2605_fsm 2023-09-23T08:57:24.098 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2605_vm 2023-09-23T08:57:24.098 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2606 2023-09-23T08:57:24.098 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2606_fsm 2023-09-23T08:57:24.098 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2606_vm 2023-09-23T08:57:24.099 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2607 2023-09-23T08:57:24.099 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2607_fsm 2023-09-23T08:57:24.099 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2607_vm 2023-09-23T08:57:24.099 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 442368 Sep 23 08:57 2608 2023-09-23T08:57:24.099 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2608_fsm 2023-09-23T08:57:24.099 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2608_vm 2023-09-23T08:57:24.099 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 286720 Sep 23 08:57 2609 2023-09-23T08:57:24.099 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2609_fsm 2023-09-23T08:57:24.099 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2609_vm 2023-09-23T08:57:24.099 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2610 2023-09-23T08:57:24.099 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2610_fsm 2023-09-23T08:57:24.099 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2610_vm 2023-09-23T08:57:24.100 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2611 2023-09-23T08:57:24.100 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2611_vm 2023-09-23T08:57:24.100 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2612 2023-09-23T08:57:24.100 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2612_fsm 2023-09-23T08:57:24.100 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2612_vm 2023-09-23T08:57:24.100 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2613 2023-09-23T08:57:24.100 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2613_vm 2023-09-23T08:57:24.100 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2615 2023-09-23T08:57:24.100 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2615_fsm 2023-09-23T08:57:24.100 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2615_vm 2023-09-23T08:57:24.100 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2616 2023-09-23T08:57:24.100 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2616_fsm 2023-09-23T08:57:24.101 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2616_vm 2023-09-23T08:57:24.101 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Sep 23 08:57 2617 2023-09-23T08:57:24.101 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2617_fsm 2023-09-23T08:57:24.101 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2617_vm 2023-09-23T08:57:24.101 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Sep 23 08:57 2618 2023-09-23T08:57:24.101 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2618_fsm 2023-09-23T08:57:24.101 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2618_vm 2023-09-23T08:57:24.101 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Sep 23 08:57 2619 2023-09-23T08:57:24.101 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2619_fsm 2023-09-23T08:57:24.101 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2619_vm 2023-09-23T08:57:24.101 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2620 2023-09-23T08:57:24.101 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2620_vm 2023-09-23T08:57:24.102 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2650 2023-09-23T08:57:24.102 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2651 2023-09-23T08:57:24.102 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2652 2023-09-23T08:57:24.102 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 23 08:57 2653 2023-09-23T08:57:24.102 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 23 08:57 2654 2023-09-23T08:57:24.102 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 23 08:57 2655 2023-09-23T08:57:24.102 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2656 2023-09-23T08:57:24.102 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2657 2023-09-23T08:57:24.102 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 23 08:57 2658 2023-09-23T08:57:24.102 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 23 08:57 2659 2023-09-23T08:57:24.102 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2660 2023-09-23T08:57:24.103 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2661 2023-09-23T08:57:24.103 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 23 08:57 2662 2023-09-23T08:57:24.103 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 23 08:57 2663 2023-09-23T08:57:24.103 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2664 2023-09-23T08:57:24.103 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2665 2023-09-23T08:57:24.103 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2666 2023-09-23T08:57:24.103 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2667 2023-09-23T08:57:24.103 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2668 2023-09-23T08:57:24.103 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2669 2023-09-23T08:57:24.103 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2670 2023-09-23T08:57:24.103 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 335872 Sep 23 08:57 2673 2023-09-23T08:57:24.104 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 376832 Sep 23 08:57 2674 2023-09-23T08:57:24.104 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 180224 Sep 23 08:57 2675 2023-09-23T08:57:24.104 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2678 2023-09-23T08:57:24.104 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2679 2023-09-23T08:57:24.104 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2680 2023-09-23T08:57:24.104 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2681 2023-09-23T08:57:24.104 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2682 2023-09-23T08:57:24.104 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2683 2023-09-23T08:57:24.104 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2684 2023-09-23T08:57:24.104 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2685 2023-09-23T08:57:24.104 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2686 2023-09-23T08:57:24.104 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2687 2023-09-23T08:57:24.105 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 23 08:57 2688 2023-09-23T08:57:24.105 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 23 08:57 2689 2023-09-23T08:57:24.105 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 23 08:57 2690 2023-09-23T08:57:24.105 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 270336 Sep 23 08:57 2691 2023-09-23T08:57:24.105 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2692 2023-09-23T08:57:24.105 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2693 2023-09-23T08:57:24.105 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2696 2023-09-23T08:57:24.105 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2699 2023-09-23T08:57:24.105 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2701 2023-09-23T08:57:24.105 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2702 2023-09-23T08:57:24.105 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2703 2023-09-23T08:57:24.105 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 23 08:57 2704 2023-09-23T08:57:24.106 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2753 2023-09-23T08:57:24.106 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2753_fsm 2023-09-23T08:57:24.106 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2753_vm 2023-09-23T08:57:24.106 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2754 2023-09-23T08:57:24.106 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2755 2023-09-23T08:57:24.106 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 23 08:57 2756 2023-09-23T08:57:24.106 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 23 08:57 2757 2023-09-23T08:57:24.106 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2830 2023-09-23T08:57:24.106 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2830_vm 2023-09-23T08:57:24.106 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2831 2023-09-23T08:57:24.106 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2832 2023-09-23T08:57:24.107 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2832_vm 2023-09-23T08:57:24.107 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2833 2023-09-23T08:57:24.107 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2834 2023-09-23T08:57:24.107 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2834_vm 2023-09-23T08:57:24.107 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2835 2023-09-23T08:57:24.107 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2836 2023-09-23T08:57:24.107 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2836_vm 2023-09-23T08:57:24.108 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2837 2023-09-23T08:57:24.108 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 417792 Sep 23 08:57 2838 2023-09-23T08:57:24.108 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2838_fsm 2023-09-23T08:57:24.108 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2838_vm 2023-09-23T08:57:24.108 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2839 2023-09-23T08:57:24.108 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2840 2023-09-23T08:57:24.110 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2840_fsm 2023-09-23T08:57:24.110 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2840_vm 2023-09-23T08:57:24.110 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2841 2023-09-23T08:57:24.110 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2995 2023-09-23T08:57:24.110 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2995_vm 2023-09-23T08:57:24.111 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2996 2023-09-23T08:57:24.111 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3079 2023-09-23T08:57:24.111 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 3079_fsm 2023-09-23T08:57:24.111 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3079_vm 2023-09-23T08:57:24.111 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3080 2023-09-23T08:57:24.111 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3081 2023-09-23T08:57:24.111 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3085 2023-09-23T08:57:24.111 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3118 2023-09-23T08:57:24.111 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3118_vm 2023-09-23T08:57:24.111 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3119 2023-09-23T08:57:24.111 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3164 2023-09-23T08:57:24.112 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3256 2023-09-23T08:57:24.112 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3256_vm 2023-09-23T08:57:24.112 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3257 2023-09-23T08:57:24.112 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3258 2023-09-23T08:57:24.112 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3350 2023-09-23T08:57:24.112 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3350_vm 2023-09-23T08:57:24.112 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3351 2023-09-23T08:57:24.112 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3379 2023-09-23T08:57:24.112 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3380 2023-09-23T08:57:24.112 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3381 2023-09-23T08:57:24.112 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3381_vm 2023-09-23T08:57:24.112 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3394 2023-09-23T08:57:24.113 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 3394_fsm 2023-09-23T08:57:24.113 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3394_vm 2023-09-23T08:57:24.113 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3395 2023-09-23T08:57:24.113 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3439 2023-09-23T08:57:24.113 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3439_vm 2023-09-23T08:57:24.113 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3440 2023-09-23T08:57:24.113 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 23 08:57 3455 2023-09-23T08:57:24.113 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3456 2023-09-23T08:57:24.113 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 3456_fsm 2023-09-23T08:57:24.113 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3456_vm 2023-09-23T08:57:24.113 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3466 2023-09-23T08:57:24.114 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3466_vm 2023-09-23T08:57:24.114 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3467 2023-09-23T08:57:24.114 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3468 2023-09-23T08:57:24.114 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3501 2023-09-23T08:57:24.114 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3501_vm 2023-09-23T08:57:24.114 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3502 2023-09-23T08:57:24.114 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3503 2023-09-23T08:57:24.114 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3534 2023-09-23T08:57:24.114 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3541 2023-09-23T08:57:24.114 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 3541_fsm 2023-09-23T08:57:24.114 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3541_vm 2023-09-23T08:57:24.114 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3542 2023-09-23T08:57:24.115 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3574 2023-09-23T08:57:24.115 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3575 2023-09-23T08:57:24.115 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3576 2023-09-23T08:57:24.115 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3576_vm 2023-09-23T08:57:24.115 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3596 2023-09-23T08:57:24.115 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3596_vm 2023-09-23T08:57:24.115 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3597 2023-09-23T08:57:24.115 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3598 2023-09-23T08:57:24.115 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3598_vm 2023-09-23T08:57:24.115 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3599 2023-09-23T08:57:24.115 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3600 2023-09-23T08:57:24.115 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 3600_fsm 2023-09-23T08:57:24.116 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3600_vm 2023-09-23T08:57:24.116 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3601 2023-09-23T08:57:24.116 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 3601_fsm 2023-09-23T08:57:24.116 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3601_vm 2023-09-23T08:57:24.116 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3602 2023-09-23T08:57:24.179 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 3602_fsm 2023-09-23T08:57:24.179 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3602_vm 2023-09-23T08:57:24.179 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3603 2023-09-23T08:57:24.179 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 3603_fsm 2023-09-23T08:57:24.179 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3603_vm 2023-09-23T08:57:24.180 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3604 2023-09-23T08:57:24.180 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3605 2023-09-23T08:57:24.180 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3606 2023-09-23T08:57:24.180 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3607 2023-09-23T08:57:24.180 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3608 2023-09-23T08:57:24.180 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 23 08:57 3609 2023-09-23T08:57:24.180 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3712 2023-09-23T08:57:24.180 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3764 2023-09-23T08:57:24.180 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 3764_fsm 2023-09-23T08:57:24.180 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3764_vm 2023-09-23T08:57:24.180 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3766 2023-09-23T08:57:24.180 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3767 2023-09-23T08:57:24.181 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3997 2023-09-23T08:57:24.181 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 5002 2023-09-23T08:57:24.181 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 548 2023-09-23T08:57:24.181 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 549 2023-09-23T08:57:24.181 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 6102 2023-09-23T08:57:24.181 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 6102_vm 2023-09-23T08:57:24.181 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 6104 2023-09-23T08:57:24.181 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 6104_vm 2023-09-23T08:57:24.181 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 6106 2023-09-23T08:57:24.181 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 6106_vm 2023-09-23T08:57:24.181 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 6110 2023-09-23T08:57:24.182 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 6111 2023-09-23T08:57:24.182 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 6112 2023-09-23T08:57:24.182 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 6113 2023-09-23T08:57:24.182 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 6117 2023-09-23T08:57:24.182 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 826 2023-09-23T08:57:24.182 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 826_vm 2023-09-23T08:57:24.182 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 827 2023-09-23T08:57:24.182 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 828 2023-09-23T08:57:24.182 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 23 08:57 pg_filenode.map 2023-09-23T08:57:24.182 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 23 08:57 PG_VERSION 2023-09-23T08:57:24.182 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:57:24.183 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/global: 2023-09-23T08:57:24.183 INFO:teuthology.orchestra.run.smithi082.stdout:total 554 2023-09-23T08:57:24.183 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 565760 Sep 23 08:57 . 2023-09-23T08:57:24.183 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Sep 23 08:57 .. 2023-09-23T08:57:24.183 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 1136 2023-09-23T08:57:24.183 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 1136_fsm 2023-09-23T08:57:24.183 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 1136_vm 2023-09-23T08:57:24.183 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 1137 2023-09-23T08:57:24.183 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 1213 2023-09-23T08:57:24.183 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 1213_fsm 2023-09-23T08:57:24.183 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 1213_vm 2023-09-23T08:57:24.183 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 1214 2023-09-23T08:57:24.184 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 1214_fsm 2023-09-23T08:57:24.184 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 1214_vm 2023-09-23T08:57:24.184 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 1232 2023-09-23T08:57:24.184 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 1233 2023-09-23T08:57:24.184 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 1260 2023-09-23T08:57:24.184 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 1260_fsm 2023-09-23T08:57:24.184 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 1260_vm 2023-09-23T08:57:24.184 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 1261 2023-09-23T08:57:24.184 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 1261_fsm 2023-09-23T08:57:24.184 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 1261_vm 2023-09-23T08:57:24.184 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 1262 2023-09-23T08:57:24.184 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 1262_fsm 2023-09-23T08:57:24.185 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 1262_vm 2023-09-23T08:57:24.185 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2396 2023-09-23T08:57:24.185 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2396_fsm 2023-09-23T08:57:24.185 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2396_vm 2023-09-23T08:57:24.185 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2397 2023-09-23T08:57:24.185 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2671 2023-09-23T08:57:24.185 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2672 2023-09-23T08:57:24.185 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2676 2023-09-23T08:57:24.185 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2677 2023-09-23T08:57:24.185 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2694 2023-09-23T08:57:24.185 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2695 2023-09-23T08:57:24.186 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2697 2023-09-23T08:57:24.186 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2698 2023-09-23T08:57:24.186 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2846 2023-09-23T08:57:24.186 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2846_vm 2023-09-23T08:57:24.186 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2847 2023-09-23T08:57:24.186 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2964 2023-09-23T08:57:24.186 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2964_vm 2023-09-23T08:57:24.186 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2965 2023-09-23T08:57:24.186 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2966 2023-09-23T08:57:24.186 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2966_vm 2023-09-23T08:57:24.186 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2967 2023-09-23T08:57:24.186 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3592 2023-09-23T08:57:24.241 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3592_vm 2023-09-23T08:57:24.241 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3593 2023-09-23T08:57:24.241 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 4060 2023-09-23T08:57:24.242 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 4060_vm 2023-09-23T08:57:24.242 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 4061 2023-09-23T08:57:24.242 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 6000 2023-09-23T08:57:24.242 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 6000_vm 2023-09-23T08:57:24.242 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 6001 2023-09-23T08:57:24.242 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 6002 2023-09-23T08:57:24.242 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 6100 2023-09-23T08:57:24.242 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 6100_vm 2023-09-23T08:57:24.242 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 6114 2023-09-23T08:57:24.242 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 6115 2023-09-23T08:57:24.242 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 pg_control 2023-09-23T08:57:24.242 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 23 08:57 pg_filenode.map 2023-09-23T08:57:24.243 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:57:24.243 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/log: 2023-09-23T08:57:24.243 INFO:teuthology.orchestra.run.smithi082.stdout:total 1 2023-09-23T08:57:24.243 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 . 2023-09-23T08:57:24.243 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Sep 23 08:57 .. 2023-09-23T08:57:24.243 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:57:24.243 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/pg_commit_ts: 2023-09-23T08:57:24.243 INFO:teuthology.orchestra.run.smithi082.stdout:total 1 2023-09-23T08:57:24.243 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 . 2023-09-23T08:57:24.243 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Sep 23 08:57 .. 2023-09-23T08:57:24.243 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:57:24.243 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/pg_dynshmem: 2023-09-23T08:57:24.244 INFO:teuthology.orchestra.run.smithi082.stdout:total 1 2023-09-23T08:57:24.244 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 . 2023-09-23T08:57:24.244 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Sep 23 08:57 .. 2023-09-23T08:57:24.244 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:57:24.244 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/pg_logical: 2023-09-23T08:57:24.244 INFO:teuthology.orchestra.run.smithi082.stdout:total 3 2023-09-23T08:57:24.244 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Sep 23 08:57 . 2023-09-23T08:57:24.244 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Sep 23 08:57 .. 2023-09-23T08:57:24.244 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 mappings 2023-09-23T08:57:24.244 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Sep 23 08:57 replorigin_checkpoint 2023-09-23T08:57:24.244 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 snapshots 2023-09-23T08:57:24.245 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:57:24.245 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/pg_logical/mappings: 2023-09-23T08:57:24.245 INFO:teuthology.orchestra.run.smithi082.stdout:total 1 2023-09-23T08:57:24.245 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 . 2023-09-23T08:57:24.245 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Sep 23 08:57 .. 2023-09-23T08:57:24.245 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:57:24.245 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/pg_logical/snapshots: 2023-09-23T08:57:24.245 INFO:teuthology.orchestra.run.smithi082.stdout:total 1 2023-09-23T08:57:24.245 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 . 2023-09-23T08:57:24.245 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Sep 23 08:57 .. 2023-09-23T08:57:24.245 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:57:24.245 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/pg_multixact: 2023-09-23T08:57:24.245 INFO:teuthology.orchestra.run.smithi082.stdout:total 2 2023-09-23T08:57:24.246 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 . 2023-09-23T08:57:24.246 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Sep 23 08:57 .. 2023-09-23T08:57:24.246 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 members 2023-09-23T08:57:24.246 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 offsets 2023-09-23T08:57:24.246 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:57:24.246 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/pg_multixact/members: 2023-09-23T08:57:24.246 INFO:teuthology.orchestra.run.smithi082.stdout:total 9 2023-09-23T08:57:24.246 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 . 2023-09-23T08:57:24.246 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 .. 2023-09-23T08:57:24.246 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 0000 2023-09-23T08:57:24.246 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:57:24.246 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/pg_multixact/offsets: 2023-09-23T08:57:24.247 INFO:teuthology.orchestra.run.smithi082.stdout:total 9 2023-09-23T08:57:24.247 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 . 2023-09-23T08:57:24.313 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 .. 2023-09-23T08:57:24.313 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 0000 2023-09-23T08:57:24.313 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:57:24.313 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/pg_notify: 2023-09-23T08:57:24.314 INFO:teuthology.orchestra.run.smithi082.stdout:total 9 2023-09-23T08:57:24.314 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 . 2023-09-23T08:57:24.314 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Sep 23 08:57 .. 2023-09-23T08:57:24.314 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 0000 2023-09-23T08:57:24.314 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:57:24.314 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/pg_replslot: 2023-09-23T08:57:24.314 INFO:teuthology.orchestra.run.smithi082.stdout:total 1 2023-09-23T08:57:24.314 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 . 2023-09-23T08:57:24.314 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Sep 23 08:57 .. 2023-09-23T08:57:24.314 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:57:24.314 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/pg_serial: 2023-09-23T08:57:24.315 INFO:teuthology.orchestra.run.smithi082.stdout:total 1 2023-09-23T08:57:24.315 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 . 2023-09-23T08:57:24.315 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Sep 23 08:57 .. 2023-09-23T08:57:24.315 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:57:24.315 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/pg_snapshots: 2023-09-23T08:57:24.315 INFO:teuthology.orchestra.run.smithi082.stdout:total 1 2023-09-23T08:57:24.315 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 . 2023-09-23T08:57:24.315 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Sep 23 08:57 .. 2023-09-23T08:57:24.315 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:57:24.315 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/pg_stat: 2023-09-23T08:57:24.315 INFO:teuthology.orchestra.run.smithi082.stdout:total 1 2023-09-23T08:57:24.315 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 . 2023-09-23T08:57:24.316 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Sep 23 08:57 .. 2023-09-23T08:57:24.316 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:57:24.316 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/pg_stat_tmp: 2023-09-23T08:57:24.316 INFO:teuthology.orchestra.run.smithi082.stdout:total 1 2023-09-23T08:57:24.316 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 . 2023-09-23T08:57:24.316 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Sep 23 08:57 .. 2023-09-23T08:57:24.316 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:57:24.316 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/pg_subtrans: 2023-09-23T08:57:24.316 INFO:teuthology.orchestra.run.smithi082.stdout:total 9 2023-09-23T08:57:24.316 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 . 2023-09-23T08:57:24.316 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Sep 23 08:57 .. 2023-09-23T08:57:24.317 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 0000 2023-09-23T08:57:24.317 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:57:24.317 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/pg_tblspc: 2023-09-23T08:57:24.317 INFO:teuthology.orchestra.run.smithi082.stdout:total 1 2023-09-23T08:57:24.317 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 . 2023-09-23T08:57:24.317 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Sep 23 08:57 .. 2023-09-23T08:57:24.317 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:57:24.317 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/pg_twophase: 2023-09-23T08:57:24.317 INFO:teuthology.orchestra.run.smithi082.stdout:total 1 2023-09-23T08:57:24.317 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 . 2023-09-23T08:57:24.317 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Sep 23 08:57 .. 2023-09-23T08:57:24.317 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:57:24.318 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/pg_wal: 2023-09-23T08:57:24.318 INFO:teuthology.orchestra.run.smithi082.stdout:total 16386 2023-09-23T08:57:24.318 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 23 08:57 . 2023-09-23T08:57:24.318 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Sep 23 08:57 .. 2023-09-23T08:57:24.318 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 23 08:57 000000010000000000000001 2023-09-23T08:57:24.318 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 archive_status 2023-09-23T08:57:24.318 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:57:24.318 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/pg_wal/archive_status: 2023-09-23T08:57:24.318 INFO:teuthology.orchestra.run.smithi082.stdout:total 1 2023-09-23T08:57:24.318 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 . 2023-09-23T08:57:24.319 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 23 08:57 .. 2023-09-23T08:57:24.319 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:57:24.319 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/pg_xact: 2023-09-23T08:57:24.319 INFO:teuthology.orchestra.run.smithi082.stdout:total 9 2023-09-23T08:57:24.319 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 . 2023-09-23T08:57:24.319 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Sep 23 08:57 .. 2023-09-23T08:57:24.319 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 0000 2023-09-23T08:57:24.320 DEBUG:teuthology.orchestra.run.smithi082:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo systemctl start postgresql' 2023-09-23T08:57:24.579 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:57:24 smithi082 ceph-mon[97694]: pgmap v18: 97 pgs: 97 active+clean; 48 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 1.7 MiB/s wr, 57 op/s 2023-09-23T08:57:24.666 DEBUG:teuthology.orchestra.run.smithi082:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- pgbench -s 500 -i' 2023-09-23T08:57:24.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:57:24 smithi135 ceph-mon[99205]: pgmap v18: 97 pgs: 97 active+clean; 48 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 1.7 MiB/s wr, 57 op/s 2023-09-23T08:57:24.859 INFO:teuthology.orchestra.run.smithi082.stderr:NOTICE: table "pgbench_history" does not exist, skipping 2023-09-23T08:57:24.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:57:24 smithi161 ceph-mon[99580]: pgmap v18: 97 pgs: 97 active+clean; 48 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 1.7 MiB/s wr, 57 op/s 2023-09-23T08:57:24.915 INFO:teuthology.orchestra.run.smithi082.stderr:NOTICE: table "pgbench_tellers" does not exist, skipping 2023-09-23T08:57:24.921 INFO:teuthology.orchestra.run.smithi082.stderr:NOTICE: table "pgbench_accounts" does not exist, skipping 2023-09-23T08:57:24.927 INFO:teuthology.orchestra.run.smithi082.stderr:NOTICE: table "pgbench_branches" does not exist, skipping 2023-09-23T08:57:25.254 INFO:teuthology.orchestra.run.smithi082.stderr:creating tables... 2023-09-23T08:57:25.963 INFO:teuthology.orchestra.run.smithi082.stderr:100000 of 50000000 tuples (0%) done (elapsed 0.71 s, remaining 352.03 s) 2023-09-23T08:57:26.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:57:26 smithi135 ceph-mon[99205]: pgmap v19: 97 pgs: 97 active+clean; 51 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 627 KiB/s rd, 2.0 MiB/s wr, 127 op/s 2023-09-23T08:57:26.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:57:26 smithi135 ceph-mon[99205]: scrub summary: idle 2023-09-23T08:57:26.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:57:26 smithi082 ceph-mon[97694]: pgmap v19: 97 pgs: 97 active+clean; 51 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 627 KiB/s rd, 2.0 MiB/s wr, 127 op/s 2023-09-23T08:57:26.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:57:26 smithi082 ceph-mon[97694]: scrub summary: idle 2023-09-23T08:57:26.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:57:26 smithi161 ceph-mon[99580]: pgmap v19: 97 pgs: 97 active+clean; 51 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 627 KiB/s rd, 2.0 MiB/s wr, 127 op/s 2023-09-23T08:57:26.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:57:26 smithi161 ceph-mon[99580]: scrub summary: idle 2023-09-23T08:57:27.713 INFO:teuthology.orchestra.run.smithi082.stderr:200000 of 50000000 tuples (0%) done (elapsed 2.46 s, remaining 611.32 s) 2023-09-23T08:57:27.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:57:27 smithi135 ceph-mon[99205]: scrub summary: idle 2023-09-23T08:57:27.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:57:27 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T08:57:27.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:57:27 smithi082 ceph-mon[97694]: scrub summary: idle 2023-09-23T08:57:27.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:57:27 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T08:57:27.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:57:27 smithi161 ceph-mon[99580]: scrub summary: idle 2023-09-23T08:57:27.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:57:27 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T08:57:28.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:57:28 smithi135 ceph-mon[99205]: pgmap v20: 97 pgs: 97 active+clean; 51 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 530 KiB/s rd, 1.1 MiB/s wr, 100 op/s 2023-09-23T08:57:28.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:57:28 smithi082 ceph-mon[97694]: pgmap v20: 97 pgs: 97 active+clean; 51 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 530 KiB/s rd, 1.1 MiB/s wr, 100 op/s 2023-09-23T08:57:28.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:57:28 smithi161 ceph-mon[99580]: pgmap v20: 97 pgs: 97 active+clean; 51 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 530 KiB/s rd, 1.1 MiB/s wr, 100 op/s 2023-09-23T08:57:29.473 INFO:teuthology.orchestra.run.smithi082.stderr:300000 of 50000000 tuples (0%) done (elapsed 4.22 s, remaining 698.30 s) 2023-09-23T08:57:30.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:57:30 smithi135 ceph-mon[99205]: pgmap v21: 97 pgs: 97 active+clean; 63 MiB data, 526 MiB used, 1.0 TiB / 1.0 TiB avail; 531 KiB/s rd, 3.9 MiB/s wr, 104 op/s 2023-09-23T08:57:30.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:57:30 smithi082 ceph-mon[97694]: pgmap v21: 97 pgs: 97 active+clean; 63 MiB data, 526 MiB used, 1.0 TiB / 1.0 TiB avail; 531 KiB/s rd, 3.9 MiB/s wr, 104 op/s 2023-09-23T08:57:30.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:57:30 smithi161 ceph-mon[99580]: pgmap v21: 97 pgs: 97 active+clean; 63 MiB data, 526 MiB used, 1.0 TiB / 1.0 TiB avail; 531 KiB/s rd, 3.9 MiB/s wr, 104 op/s 2023-09-23T08:57:30.997 INFO:teuthology.orchestra.run.smithi082.stderr:400000 of 50000000 tuples (0%) done (elapsed 5.74 s, remaining 711.72 s) 2023-09-23T08:57:32.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:57:32 smithi135 ceph-mon[99205]: pgmap v22: 97 pgs: 97 active+clean; 109 MiB data, 646 MiB used, 1.0 TiB / 1.0 TiB avail; 625 KiB/s rd, 9.5 MiB/s wr, 115 op/s 2023-09-23T08:57:32.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:57:32 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T08:57:32.815 INFO:teuthology.orchestra.run.smithi082.stderr:500000 of 50000000 tuples (1%) done (elapsed 7.56 s, remaining 748.15 s) 2023-09-23T08:57:32.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:57:32 smithi082 ceph-mon[97694]: pgmap v22: 97 pgs: 97 active+clean; 109 MiB data, 646 MiB used, 1.0 TiB / 1.0 TiB avail; 625 KiB/s rd, 9.5 MiB/s wr, 115 op/s 2023-09-23T08:57:32.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:57:32 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T08:57:32.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:57:32 smithi161 ceph-mon[99580]: pgmap v22: 97 pgs: 97 active+clean; 109 MiB data, 646 MiB used, 1.0 TiB / 1.0 TiB avail; 625 KiB/s rd, 9.5 MiB/s wr, 115 op/s 2023-09-23T08:57:32.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:57:32 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T08:57:34.070 INFO:teuthology.orchestra.run.smithi082.stderr:600000 of 50000000 tuples (1%) done (elapsed 8.81 s, remaining 725.47 s) 2023-09-23T08:57:34.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:57:34 smithi135 ceph-mon[99205]: pgmap v23: 97 pgs: 97 active+clean; 109 MiB data, 646 MiB used, 1.0 TiB / 1.0 TiB avail; 377 KiB/s rd, 9.0 MiB/s wr, 90 op/s 2023-09-23T08:57:34.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:57:34 smithi082 ceph-mon[97694]: pgmap v23: 97 pgs: 97 active+clean; 109 MiB data, 646 MiB used, 1.0 TiB / 1.0 TiB avail; 377 KiB/s rd, 9.0 MiB/s wr, 90 op/s 2023-09-23T08:57:34.905 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:57:34 smithi161 ceph-mon[99580]: pgmap v23: 97 pgs: 97 active+clean; 109 MiB data, 646 MiB used, 1.0 TiB / 1.0 TiB avail; 377 KiB/s rd, 9.0 MiB/s wr, 90 op/s 2023-09-23T08:57:35.672 INFO:teuthology.orchestra.run.smithi082.stderr:700000 of 50000000 tuples (1%) done (elapsed 10.41 s, remaining 733.43 s) 2023-09-23T08:57:36.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:57:36 smithi135 ceph-mon[99205]: pgmap v24: 97 pgs: 97 active+clean; 177 MiB data, 859 MiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 21 MiB/s wr, 104 op/s 2023-09-23T08:57:36.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:57:36 smithi082 ceph-mon[97694]: pgmap v24: 97 pgs: 97 active+clean; 177 MiB data, 859 MiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 21 MiB/s wr, 104 op/s 2023-09-23T08:57:36.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:57:36 smithi161 ceph-mon[99580]: pgmap v24: 97 pgs: 97 active+clean; 177 MiB data, 859 MiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 21 MiB/s wr, 104 op/s 2023-09-23T08:57:37.424 INFO:teuthology.orchestra.run.smithi082.stderr:800000 of 50000000 tuples (1%) done (elapsed 12.17 s, remaining 748.21 s) 2023-09-23T08:57:38.654 INFO:teuthology.orchestra.run.smithi082.stderr:900000 of 50000000 tuples (1%) done (elapsed 13.40 s, remaining 730.83 s) 2023-09-23T08:57:38.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:57:38 smithi135 ceph-mon[99205]: pgmap v25: 97 pgs: 97 active+clean; 177 MiB data, 859 MiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 20 MiB/s wr, 34 op/s 2023-09-23T08:57:38.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:57:38 smithi082 ceph-mon[97694]: pgmap v25: 97 pgs: 97 active+clean; 177 MiB data, 859 MiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 20 MiB/s wr, 34 op/s 2023-09-23T08:57:38.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:57:38 smithi161 ceph-mon[99580]: pgmap v25: 97 pgs: 97 active+clean; 177 MiB data, 859 MiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 20 MiB/s wr, 34 op/s 2023-09-23T08:57:40.412 INFO:teuthology.orchestra.run.smithi082.stderr:1000000 of 50000000 tuples (2%) done (elapsed 15.15 s, remaining 742.58 s) 2023-09-23T08:57:40.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:57:40 smithi135 ceph-mon[99205]: pgmap v26: 97 pgs: 97 active+clean; 209 MiB data, 951 MiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 26 MiB/s wr, 37 op/s 2023-09-23T08:57:40.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:57:40 smithi082 ceph-mon[97694]: pgmap v26: 97 pgs: 97 active+clean; 209 MiB data, 951 MiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 26 MiB/s wr, 37 op/s 2023-09-23T08:57:40.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:57:40 smithi161 ceph-mon[99580]: pgmap v26: 97 pgs: 97 active+clean; 209 MiB data, 951 MiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 26 MiB/s wr, 37 op/s 2023-09-23T08:57:42.133 INFO:teuthology.orchestra.run.smithi082.stderr:1100000 of 50000000 tuples (2%) done (elapsed 16.88 s, remaining 750.20 s) 2023-09-23T08:57:42.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:57:42 smithi135 ceph-mon[99205]: pgmap v27: 97 pgs: 97 active+clean; 253 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 30 MiB/s wr, 45 op/s 2023-09-23T08:57:42.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:57:42 smithi082 ceph-mon[97694]: pgmap v27: 97 pgs: 97 active+clean; 253 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 30 MiB/s wr, 45 op/s 2023-09-23T08:57:42.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:57:42 smithi161 ceph-mon[99580]: pgmap v27: 97 pgs: 97 active+clean; 253 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 30 MiB/s wr, 45 op/s 2023-09-23T08:57:43.355 INFO:teuthology.orchestra.run.smithi082.stderr:1200000 of 50000000 tuples (2%) done (elapsed 18.10 s, remaining 735.97 s) 2023-09-23T08:57:44.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:57:44 smithi135 ceph-mon[99205]: pgmap v28: 97 pgs: 97 active+clean; 253 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 24 MiB/s wr, 28 op/s 2023-09-23T08:57:44.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:57:44 smithi082 ceph-mon[97694]: pgmap v28: 97 pgs: 97 active+clean; 253 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 24 MiB/s wr, 28 op/s 2023-09-23T08:57:44.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:57:44 smithi161 ceph-mon[99580]: pgmap v28: 97 pgs: 97 active+clean; 253 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 24 MiB/s wr, 28 op/s 2023-09-23T08:57:44.977 INFO:teuthology.orchestra.run.smithi082.stderr:1300000 of 50000000 tuples (2%) done (elapsed 19.72 s, remaining 738.71 s) 2023-09-23T08:57:46.693 INFO:teuthology.orchestra.run.smithi082.stderr:1400000 of 50000000 tuples (2%) done (elapsed 21.44 s, remaining 744.13 s) 2023-09-23T08:57:46.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:57:46 smithi135 ceph-mon[99205]: pgmap v29: 97 pgs: 97 active+clean; 331 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 37 MiB/s wr, 41 op/s 2023-09-23T08:57:46.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:57:46 smithi082 ceph-mon[97694]: pgmap v29: 97 pgs: 97 active+clean; 331 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 37 MiB/s wr, 41 op/s 2023-09-23T08:57:46.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:57:46 smithi161 ceph-mon[99580]: pgmap v29: 97 pgs: 97 active+clean; 331 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 37 MiB/s wr, 41 op/s 2023-09-23T08:57:47.892 INFO:teuthology.orchestra.run.smithi082.stderr:1500000 of 50000000 tuples (3%) done (elapsed 22.63 s, remaining 731.83 s) 2023-09-23T08:57:48.272 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T08:57:48.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.512+0000 7f57e33ff700 1 -- 172.21.15.82:0/2344241489 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57dc100890 msgr2=0x7f57dc100d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:48.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.512+0000 7f57e33ff700 1 --2- 172.21.15.82:0/2344241489 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57dc100890 0x7f57dc100d10 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f57cc009990 tx=0x7f57cc009ca0 comp rx=0 tx=0).stop 2023-09-23T08:57:48.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.512+0000 7f57e33ff700 1 -- 172.21.15.82:0/2344241489 shutdown_connections 2023-09-23T08:57:48.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.513+0000 7f57e33ff700 1 --2- 172.21.15.82:0/2344241489 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57dc101250 0x7f57dc10d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:48.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.513+0000 7f57e33ff700 1 --2- 172.21.15.82:0/2344241489 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57dc1068a0 0x7f57dc106c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:48.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.513+0000 7f57e33ff700 1 --2- 172.21.15.82:0/2344241489 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57dc100890 0x7f57dc100d10 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:48.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.513+0000 7f57e33ff700 1 -- 172.21.15.82:0/2344241489 >> 172.21.15.82:0/2344241489 conn(0x7f57dc0fc380 msgr2=0x7f57dc0fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:48.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.513+0000 7f57e33ff700 1 -- 172.21.15.82:0/2344241489 shutdown_connections 2023-09-23T08:57:48.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.513+0000 7f57e33ff700 1 -- 172.21.15.82:0/2344241489 wait complete. 2023-09-23T08:57:48.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.514+0000 7f57e33ff700 1 Processor -- start 2023-09-23T08:57:48.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.514+0000 7f57e33ff700 1 -- start start 2023-09-23T08:57:48.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.514+0000 7f57e33ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57dc100890 0x7f57dc19c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:48.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.514+0000 7f57e33ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57dc101250 0x7f57dc19cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:48.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.514+0000 7f57e33ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57dc1068a0 0x7f57dc196750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:48.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.514+0000 7f57e33ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57dc196e00 con 0x7f57dc101250 2023-09-23T08:57:48.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.514+0000 7f57e33ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57dc196f70 con 0x7f57dc100890 2023-09-23T08:57:48.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.514+0000 7f57e33ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57dc197130 con 0x7f57dc1068a0 2023-09-23T08:57:48.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.514+0000 7f57e099a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57dc101250 0x7f57dc19cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:48.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.515+0000 7f57e099a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57dc101250 0x7f57dc19cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37070/0 (socket says 172.21.15.82:37070) 2023-09-23T08:57:48.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.515+0000 7f57e119b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57dc100890 0x7f57dc19c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:48.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.515+0000 7f57e099a700 1 -- 172.21.15.82:0/2812284869 learned_addr learned my addr 172.21.15.82:0/2812284869 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:57:48.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.515+0000 7f57e199c700 1 --2- 172.21.15.82:0/2812284869 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57dc1068a0 0x7f57dc196750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:48.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.515+0000 7f57e099a700 1 -- 172.21.15.82:0/2812284869 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57dc1068a0 msgr2=0x7f57dc196750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:48.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.515+0000 7f57e099a700 1 --2- 172.21.15.82:0/2812284869 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57dc1068a0 0x7f57dc196750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:48.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.515+0000 7f57e099a700 1 -- 172.21.15.82:0/2812284869 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57dc100890 msgr2=0x7f57dc19c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:48.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.515+0000 7f57e099a700 1 --2- 172.21.15.82:0/2812284869 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57dc100890 0x7f57dc19c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:48.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.515+0000 7f57e099a700 1 -- 172.21.15.82:0/2812284869 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57cc0095f0 con 0x7f57dc101250 2023-09-23T08:57:48.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.515+0000 7f57e099a700 1 --2- 172.21.15.82:0/2812284869 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57dc101250 0x7f57dc19cc00 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f57cc000c00 tx=0x7f57cc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:48.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.516+0000 7f57d27fc700 1 -- 172.21.15.82:0/2812284869 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57cc01d070 con 0x7f57dc101250 2023-09-23T08:57:48.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.516+0000 7f57d27fc700 1 -- 172.21.15.82:0/2812284869 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f57cc022470 con 0x7f57dc101250 2023-09-23T08:57:48.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.516+0000 7f57e33ff700 1 -- 172.21.15.82:0/2812284869 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57dc1973b0 con 0x7f57dc101250 2023-09-23T08:57:48.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.516+0000 7f57d27fc700 1 -- 172.21.15.82:0/2812284869 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57cc017650 con 0x7f57dc101250 2023-09-23T08:57:48.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.516+0000 7f57e33ff700 1 -- 172.21.15.82:0/2812284869 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57dc072d30 con 0x7f57dc101250 2023-09-23T08:57:48.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.520+0000 7f57d27fc700 1 -- 172.21.15.82:0/2812284869 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) v1 ==== 134904+0+0 (secure 0 0 0) 0x7f57cc0225e0 con 0x7f57dc101250 2023-09-23T08:57:48.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.521+0000 7f57f6ccfb80 1 Processor -- start 2023-09-23T08:57:48.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.522+0000 7f57f6ccfb80 1 -- start start 2023-09-23T08:57:48.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.522+0000 7f57f6ccfb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575a7a23380 0x5575a7a23760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:48.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.522+0000 7f57f6ccfb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575a7a23ca0 0x5575a7a1d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:48.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.522+0000 7f57f6ccfb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575a7a1dc40 0x5575a7a1e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:48.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.522+0000 7f57f6ccfb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575a79857b0 con 0x5575a7a23ca0 2023-09-23T08:57:48.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.522+0000 7f57f6ccfb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575a7976780 con 0x5575a7a23380 2023-09-23T08:57:48.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.522+0000 7f57f6ccfb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575a79740a0 con 0x5575a7a1dc40 2023-09-23T08:57:48.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.522+0000 7f57e119b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575a7a23ca0 0x5575a7a1d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:48.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.522+0000 7f57e119b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575a7a23ca0 0x5575a7a1d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37082/0 (socket says 172.21.15.82:37082) 2023-09-23T08:57:48.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.522+0000 7f57e119b700 1 -- 172.21.15.82:0/1613183616 learned_addr learned my addr 172.21.15.82:0/1613183616 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:57:48.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.523+0000 7f57e199c700 1 --2- 172.21.15.82:0/1613183616 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575a7a23380 0x5575a7a23760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:48.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.523+0000 7f57e099a700 1 --2- 172.21.15.82:0/1613183616 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575a7a1dc40 0x5575a7a1e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:48.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.523+0000 7f57e119b700 1 -- 172.21.15.82:0/1613183616 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575a7a1dc40 msgr2=0x5575a7a1e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:48.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.523+0000 7f57e119b700 1 --2- 172.21.15.82:0/1613183616 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575a7a1dc40 0x5575a7a1e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:48.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.523+0000 7f57d27fc700 1 --2- 172.21.15.82:0/2812284869 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f57c80a0260 0x7f57c80a2720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:48.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.523+0000 7f57e119b700 1 -- 172.21.15.82:0/1613183616 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575a7a23380 msgr2=0x5575a7a23760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:48.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.523+0000 7f57e119b700 1 --2- 172.21.15.82:0/1613183616 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575a7a23380 0x5575a7a23760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:48.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.523+0000 7f57e119b700 1 -- 172.21.15.82:0/1613183616 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5575a77ef630 con 0x5575a7a23ca0 2023-09-23T08:57:48.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.523+0000 7f57e199c700 1 --2- 172.21.15.82:0/1613183616 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575a7a23380 0x5575a7a23760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T08:57:48.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.523+0000 7f57d27fc700 1 -- 172.21.15.82:0/2812284869 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f57cc0ccbe0 con 0x7f57dc101250 2023-09-23T08:57:48.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.523+0000 7f57e119b700 1 --2- 172.21.15.82:0/1613183616 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575a7a23ca0 0x5575a7a1d700 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f57d8009d00 tx=0x7f57d8011720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b3e47d57ec4cae0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:48.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.523+0000 7f57e199c700 1 --2- 172.21.15.82:0/2812284869 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f57c80a0260 0x7f57c80a2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:48.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.524+0000 7f57c77fe700 1 -- 172.21.15.82:0/1613183616 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d8004230 con 0x5575a7a23ca0 2023-09-23T08:57:48.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.524+0000 7f57c77fe700 1 -- 172.21.15.82:0/1613183616 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f57d8004390 con 0x5575a7a23ca0 2023-09-23T08:57:48.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.524+0000 7f57c77fe700 1 -- 172.21.15.82:0/1613183616 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d8019750 con 0x5575a7a23ca0 2023-09-23T08:57:48.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.525+0000 7f57f6ccfb80 1 -- 172.21.15.82:0/1613183616 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575a7a23ca0 msgr2=0x5575a7a1d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:48.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.525+0000 7f57e199c700 1 --2- 172.21.15.82:0/2812284869 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f57c80a0260 0x7f57c80a2720 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f57d4009ec0 tx=0x7f57d4009040 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:48.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.525+0000 7f57f6ccfb80 1 --2- 172.21.15.82:0/1613183616 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575a7a23ca0 0x5575a7a1d700 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f57d8009d00 tx=0x7f57d8011720 comp rx=0 tx=0).stop 2023-09-23T08:57:48.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.525+0000 7f57f6ccfb80 1 -- 172.21.15.82:0/1613183616 shutdown_connections 2023-09-23T08:57:48.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.525+0000 7f57f6ccfb80 1 --2- 172.21.15.82:0/1613183616 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575a7a1dc40 0x5575a7a1e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:48.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.525+0000 7f57f6ccfb80 1 --2- 172.21.15.82:0/1613183616 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575a7a23380 0x5575a7a23760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:48.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.525+0000 7f57f6ccfb80 1 --2- 172.21.15.82:0/1613183616 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575a7a23ca0 0x5575a7a1d700 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:48.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.525+0000 7f57f6ccfb80 1 -- 172.21.15.82:0/1613183616 >> 172.21.15.82:0/1613183616 conn(0x5575a79920e0 msgr2=0x5575a7a18410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:48.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.525+0000 7f57f6ccfb80 1 -- 172.21.15.82:0/1613183616 shutdown_connections 2023-09-23T08:57:48.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.525+0000 7f57f6ccfb80 1 -- 172.21.15.82:0/1613183616 wait complete. 2023-09-23T08:57:48.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.525+0000 7f57f6ccfb80 1 -- start start 2023-09-23T08:57:48.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.526+0000 7f57f6ccfb80 1 Processor -- start 2023-09-23T08:57:48.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.526+0000 7f57f6ccfb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575a7a1dc40 0x5575a7a29ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:48.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.526+0000 7f57f6ccfb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575a7a23380 0x5575a7a26f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:48.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.526+0000 7f57f6ccfb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575a7a23ca0 0x5575a7a27660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:48.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.526+0000 7f57f6ccfb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575a796f990 con 0x5575a7a23ca0 2023-09-23T08:57:48.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.526+0000 7f57f6ccfb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575a790dbb0 con 0x5575a7a23380 2023-09-23T08:57:48.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.526+0000 7f57f6ccfb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575a790d8b0 con 0x5575a7a1dc40 2023-09-23T08:57:48.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.526+0000 7f57f6ccfb80 10 client.0 _ll_register_callbacks cb 0x5575a7857a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T08:57:48.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.526+0000 7f57e199c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575a7a23ca0 0x5575a7a27660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:48.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.527+0000 7f57e119b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575a7a1dc40 0x5575a7a29ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:48.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.527+0000 7f57e099a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575a7a23380 0x5575a7a26f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:48.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.527+0000 7f57e119b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575a7a1dc40 0x5575a7a29ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:37758/0 (socket says 172.21.15.82:37758) 2023-09-23T08:57:48.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.527+0000 7f57e099a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575a7a23380 0x5575a7a26f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:37022/0 (socket says 172.21.15.82:37022) 2023-09-23T08:57:48.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.527+0000 7f57e119b700 1 -- 172.21.15.82:0/1274207121 learned_addr learned my addr 172.21.15.82:0/1274207121 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:57:48.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.527+0000 7f57e119b700 1 -- 172.21.15.82:0/1274207121 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575a7a23380 msgr2=0x5575a7a26f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:48.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.527+0000 7f57e119b700 1 --2- 172.21.15.82:0/1274207121 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575a7a23380 0x5575a7a26f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:48.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.527+0000 7f57e119b700 1 -- 172.21.15.82:0/1274207121 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575a7a23ca0 msgr2=0x5575a7a27660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:48.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.527+0000 7f57e119b700 1 --2- 172.21.15.82:0/1274207121 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575a7a23ca0 0x5575a7a27660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:48.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.527+0000 7f57e119b700 1 -- 172.21.15.82:0/1274207121 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57d8009960 con 0x5575a7a1dc40 2023-09-23T08:57:48.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.527+0000 7f57e199c700 1 --2- 172.21.15.82:0/1274207121 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575a7a23ca0 0x5575a7a27660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T08:57:48.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.527+0000 7f57e099a700 1 --2- 172.21.15.82:0/1274207121 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575a7a23380 0x5575a7a26f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T08:57:48.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.528+0000 7f57e119b700 1 --2- 172.21.15.82:0/1274207121 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575a7a1dc40 0x5575a7a29ca0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f57d8009f50 tx=0x7f57d8003b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20343fa00ba9e895 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:48.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.528+0000 7f57c4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T08:57:48.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.530+0000 7f57c4ff9700 1 -- 172.21.15.82:0/1274207121 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d8003d30 con 0x5575a7a1dc40 2023-09-23T08:57:48.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.530+0000 7f57f6ccfb80 1 -- 172.21.15.82:0/1274207121 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5575a79ed1c0 con 0x5575a7a1dc40 2023-09-23T08:57:48.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.530+0000 7f57c4ff9700 1 -- 172.21.15.82:0/1274207121 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f57d8005040 con 0x5575a7a1dc40 2023-09-23T08:57:48.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.530+0000 7f57c4ff9700 1 -- 172.21.15.82:0/1274207121 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f57d8005240 con 0x5575a7a1dc40 2023-09-23T08:57:48.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.530+0000 7f57f6ccfb80 10 client.25528 fetch_fsmap learned FSMap version 30 2023-09-23T08:57:48.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.530+0000 7f57f6ccfb80 1 -- 172.21.15.82:0/1274207121 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x5575a779bde0 con 0x5575a7a1dc40 2023-09-23T08:57:48.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.531+0000 7f57c4ff9700 1 -- 172.21.15.82:0/1274207121 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5575a79ed1c0 con 0x5575a7a1dc40 2023-09-23T08:57:48.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.531+0000 7f57c4ff9700 1 -- 172.21.15.82:0/1274207121 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 30) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f57d8028020 con 0x5575a7a1dc40 2023-09-23T08:57:48.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.531+0000 7f57f6ccfb80 10 client.25528 fetch_fsmap finished waiting for FSMap version 30 2023-09-23T08:57:48.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.531+0000 7f57f6ccfb80 10 client.25528 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T08:57:48.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.531+0000 7f57f6ccfb80 20 client.25528 populate_metadata read hostname 'smithi082' 2023-09-23T08:57:48.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.531+0000 7f57f6ccfb80 1 --2- 172.21.15.82:0/1274207121 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5575a7a376b0 0x5575a7a39ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:48.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.531+0000 7f57f6ccfb80 4 client.25528 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T08:57:48.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.531+0000 7f57f6ccfb80 1 -- 172.21.15.82:0/1274207121 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5575a7915ba0 con 0x5575a7a376b0 2023-09-23T08:57:48.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.532+0000 7f57e099a700 1 --2- 172.21.15.82:0/1274207121 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5575a7a376b0 0x5575a7a39ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:48.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.532+0000 7f57e099a700 1 --2- 172.21.15.82:0/1274207121 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5575a7a376b0 0x5575a7a39ad0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e4769040b626bfc server_cookie=c8bbb59a14342e4 in_seq=0 out_seq=0 2023-09-23T08:57:48.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.532+0000 7f57c4ff9700 10 client.25528 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T08:57:48.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.533+0000 7f57c4ff9700 1 -- 172.21.15.82:0/1274207121 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5575a7915ba0 con 0x5575a7a376b0 2023-09-23T08:57:48.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.533+0000 7f57c4ff9700 10 client.25528 handle_command_reply: tid=0 2023-09-23T08:57:48.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.533+0000 7f57f6ccfb80 1 client.25528 shutdown 2023-09-23T08:57:48.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.533+0000 7f57f6ccfb80 1 -- 172.21.15.82:0/1274207121 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575a7a1dc40 msgr2=0x5575a7a29ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:48.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.533+0000 7f57f6ccfb80 1 --2- 172.21.15.82:0/1274207121 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575a7a1dc40 0x5575a7a29ca0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f57d8009f50 tx=0x7f57d8003b80 comp rx=0 tx=0).stop 2023-09-23T08:57:48.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.533+0000 7f57f6ccfb80 1 -- 172.21.15.82:0/1274207121 shutdown_connections 2023-09-23T08:57:48.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.533+0000 7f57f6ccfb80 1 --2- 172.21.15.82:0/1274207121 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5575a7a376b0 0x5575a7a39ad0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:48.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.533+0000 7f57f6ccfb80 1 --2- 172.21.15.82:0/1274207121 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575a7a23ca0 0x5575a7a27660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:48.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.533+0000 7f57f6ccfb80 1 --2- 172.21.15.82:0/1274207121 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575a7a1dc40 0x5575a7a29ca0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:48.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.533+0000 7f57f6ccfb80 1 --2- 172.21.15.82:0/1274207121 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575a7a23380 0x5575a7a26f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:48.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.533+0000 7f57c4ff9700 0 client.25528 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T08:57:48.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.533+0000 7f57f6ccfb80 1 -- 172.21.15.82:0/1274207121 >> 172.21.15.82:0/1274207121 conn(0x5575a79920e0 msgr2=0x5575a7a12b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:48.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.533+0000 7f57f6ccfb80 1 -- 172.21.15.82:0/1274207121 shutdown_connections 2023-09-23T08:57:48.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.533+0000 7f57f6ccfb80 1 -- 172.21.15.82:0/1274207121 wait complete. 2023-09-23T08:57:48.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.534+0000 7f57f6ccfb80 20 client.25528 trim_cache size 0 max 16384 2023-09-23T08:57:48.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.553+0000 7f57f6ccfb80 1 Processor -- start 2023-09-23T08:57:48.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.553+0000 7f57f6ccfb80 1 -- start start 2023-09-23T08:57:48.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.553+0000 7f57f6ccfb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575a7a1dc40 0x5575a7a29840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:48.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.553+0000 7f57f6ccfb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575a7a23380 0x5575a7a21fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:48.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.553+0000 7f57f6ccfb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575a7a23ca0 0x5575a7a22520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:48.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.553+0000 7f57f6ccfb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575a77f1920 con 0x5575a7a23ca0 2023-09-23T08:57:48.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.553+0000 7f57f6ccfb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575a7a34140 con 0x5575a7a23380 2023-09-23T08:57:48.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.553+0000 7f57f6ccfb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575a7a14cb0 con 0x5575a7a1dc40 2023-09-23T08:57:48.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.554+0000 7f57e199c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575a7a23ca0 0x5575a7a22520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:48.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.554+0000 7f57e119b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575a7a1dc40 0x5575a7a29840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:48.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.554+0000 7f57e199c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575a7a23ca0 0x5575a7a22520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37098/0 (socket says 172.21.15.82:37098) 2023-09-23T08:57:48.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.554+0000 7f57e199c700 1 -- 172.21.15.82:0/3592265037 learned_addr learned my addr 172.21.15.82:0/3592265037 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:57:48.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.554+0000 7f57e099a700 1 --2- 172.21.15.82:0/3592265037 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575a7a23380 0x5575a7a21fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:48.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.554+0000 7f57e119b700 1 -- 172.21.15.82:0/3592265037 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575a7a23380 msgr2=0x5575a7a21fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:48.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.554+0000 7f57e119b700 1 --2- 172.21.15.82:0/3592265037 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575a7a23380 0x5575a7a21fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:48.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.554+0000 7f57e119b700 1 -- 172.21.15.82:0/3592265037 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575a7a23ca0 msgr2=0x5575a7a22520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:48.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.554+0000 7f57e119b700 1 --2- 172.21.15.82:0/3592265037 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575a7a23ca0 0x5575a7a22520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:48.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.554+0000 7f57e119b700 1 -- 172.21.15.82:0/3592265037 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5575a7784c60 con 0x5575a7a1dc40 2023-09-23T08:57:48.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.554+0000 7f57e099a700 1 --2- 172.21.15.82:0/3592265037 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575a7a23380 0x5575a7a21fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T08:57:48.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.554+0000 7f57e119b700 1 --2- 172.21.15.82:0/3592265037 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575a7a1dc40 0x5575a7a29840 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f57d8009c50 tx=0x7f57d8009230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e0f58574aa46ea10 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:48.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.554+0000 7f57c7fff700 1 -- 172.21.15.82:0/3592265037 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d8003ce0 con 0x5575a7a1dc40 2023-09-23T08:57:48.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.555+0000 7f57c7fff700 1 -- 172.21.15.82:0/3592265037 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f57d8022c50 con 0x5575a7a1dc40 2023-09-23T08:57:48.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.555+0000 7f57c7fff700 1 -- 172.21.15.82:0/3592265037 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d8005660 con 0x5575a7a1dc40 2023-09-23T08:57:48.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.555+0000 7f57f6ccfb80 1 -- 172.21.15.82:0/3592265037 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575a7a1dc40 msgr2=0x5575a7a29840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:48.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.555+0000 7f57f6ccfb80 1 --2- 172.21.15.82:0/3592265037 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575a7a1dc40 0x5575a7a29840 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f57d8009c50 tx=0x7f57d8009230 comp rx=0 tx=0).stop 2023-09-23T08:57:48.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.555+0000 7f57f6ccfb80 1 -- 172.21.15.82:0/3592265037 shutdown_connections 2023-09-23T08:57:48.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.555+0000 7f57f6ccfb80 1 --2- 172.21.15.82:0/3592265037 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575a7a23ca0 0x5575a7a22520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:48.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.555+0000 7f57f6ccfb80 1 --2- 172.21.15.82:0/3592265037 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575a7a1dc40 0x5575a7a29840 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:48.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.555+0000 7f57f6ccfb80 1 --2- 172.21.15.82:0/3592265037 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575a7a23380 0x5575a7a21fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:48.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.555+0000 7f57f6ccfb80 1 -- 172.21.15.82:0/3592265037 >> 172.21.15.82:0/3592265037 conn(0x5575a79920e0 msgr2=0x5575a7a21090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:48.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.555+0000 7f57f6ccfb80 1 -- 172.21.15.82:0/3592265037 shutdown_connections 2023-09-23T08:57:48.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.555+0000 7f57f6ccfb80 1 -- 172.21.15.82:0/3592265037 wait complete. 2023-09-23T08:57:48.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.556+0000 7f57f6ccfb80 1 -- start start 2023-09-23T08:57:48.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.556+0000 7f57f6ccfb80 1 Processor -- start 2023-09-23T08:57:48.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.557+0000 7f57f6ccfb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575a7a1dc40 0x5575a7a26500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:48.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.557+0000 7f57f6ccfb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575a7a23380 0x5575a7a26a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:48.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.557+0000 7f57f6ccfb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575a7a23ca0 0x5575a7a25480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:48.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.557+0000 7f57f6ccfb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575a7a27120 con 0x5575a7a23ca0 2023-09-23T08:57:48.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.557+0000 7f57f6ccfb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575a7a27290 con 0x5575a7a1dc40 2023-09-23T08:57:48.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.557+0000 7f57f6ccfb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575a7a259c0 con 0x5575a7a23380 2023-09-23T08:57:48.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.557+0000 7f57f6ccfb80 10 client.0 _ll_register_callbacks cb 0x7f57d8009b80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T08:57:48.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.557+0000 7f57e199c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575a7a23ca0 0x5575a7a25480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:48.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.557+0000 7f57e199c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575a7a23ca0 0x5575a7a25480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37106/0 (socket says 172.21.15.82:37106) 2023-09-23T08:57:48.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.557+0000 7f57e199c700 1 -- 172.21.15.82:0/244519891 learned_addr learned my addr 172.21.15.82:0/244519891 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:57:48.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.557+0000 7f57e099a700 1 --2- 172.21.15.82:0/244519891 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575a7a23380 0x5575a7a26a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:48.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.557+0000 7f57e119b700 1 --2- 172.21.15.82:0/244519891 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575a7a1dc40 0x5575a7a26500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:48.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.557+0000 7f57e199c700 1 -- 172.21.15.82:0/244519891 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575a7a23380 msgr2=0x5575a7a26a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:48.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.557+0000 7f57e199c700 1 --2- 172.21.15.82:0/244519891 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575a7a23380 0x5575a7a26a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:48.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.557+0000 7f57e199c700 1 -- 172.21.15.82:0/244519891 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575a7a1dc40 msgr2=0x5575a7a26500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:48.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.557+0000 7f57e199c700 1 --2- 172.21.15.82:0/244519891 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575a7a1dc40 0x5575a7a26500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:48.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.557+0000 7f57e199c700 1 -- 172.21.15.82:0/244519891 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5575a779bde0 con 0x5575a7a23ca0 2023-09-23T08:57:48.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.558+0000 7f57e199c700 1 --2- 172.21.15.82:0/244519891 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575a7a23ca0 0x5575a7a25480 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f57d40259d0 tx=0x7f57d4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d64a491bf501112 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:48.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.558+0000 7f57c4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T08:57:48.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.558+0000 7f57c4ff9700 1 -- 172.21.15.82:0/244519891 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d4007ea0 con 0x5575a7a23ca0 2023-09-23T08:57:48.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.558+0000 7f57f6ccfb80 1 -- 172.21.15.82:0/244519891 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5575a7a108b0 con 0x5575a7a23ca0 2023-09-23T08:57:48.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.558+0000 7f57c4ff9700 1 -- 172.21.15.82:0/244519891 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f57d401c030 con 0x5575a7a23ca0 2023-09-23T08:57:48.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.558+0000 7f57c4ff9700 1 -- 172.21.15.82:0/244519891 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f57d400e040 con 0x5575a7a23ca0 2023-09-23T08:57:48.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.558+0000 7f57f6ccfb80 10 client.15786 fetch_fsmap learned FSMap version 30 2023-09-23T08:57:48.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.558+0000 7f57f6ccfb80 1 -- 172.21.15.82:0/244519891 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x5575a77c2250 con 0x5575a7a23ca0 2023-09-23T08:57:48.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.559+0000 7f57c4ff9700 1 -- 172.21.15.82:0/244519891 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5575a7a108b0 con 0x5575a7a23ca0 2023-09-23T08:57:48.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.559+0000 7f57c4ff9700 1 -- 172.21.15.82:0/244519891 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 30) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f57d4036380 con 0x5575a7a23ca0 2023-09-23T08:57:48.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.559+0000 7f57f6ccfb80 10 client.15786 fetch_fsmap finished waiting for FSMap version 30 2023-09-23T08:57:48.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.559+0000 7f57f6ccfb80 10 client.15786 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T08:57:48.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.559+0000 7f57f6ccfb80 20 client.15786 populate_metadata read hostname 'smithi082' 2023-09-23T08:57:48.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.559+0000 7f57f6ccfb80 1 --2- 172.21.15.82:0/244519891 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5575a7a8c1f0 0x5575a7a8e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:48.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.559+0000 7f57f6ccfb80 4 client.15786 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T08:57:48.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.559+0000 7f57f6ccfb80 1 -- 172.21.15.82:0/244519891 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5575a7968970 con 0x5575a7a8c1f0 2023-09-23T08:57:48.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.559+0000 7f57e119b700 1 --2- 172.21.15.82:0/244519891 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5575a7a8c1f0 0x5575a7a8e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:48.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.560+0000 7f57e119b700 1 --2- 172.21.15.82:0/244519891 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5575a7a8c1f0 0x5575a7a8e610 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1025378b362e8164 server_cookie=1d2b182cfbd46394 in_seq=0 out_seq=0 2023-09-23T08:57:48.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.560+0000 7f57c4ff9700 10 client.15786 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T08:57:48.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.560+0000 7f57c4ff9700 1 -- 172.21.15.82:0/244519891 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x5575a7968970 con 0x5575a7a8c1f0 2023-09-23T08:57:48.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.560+0000 7f57c4ff9700 10 client.15786 handle_command_reply: tid=0 2023-09-23T08:57:48.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.560+0000 7f57f6ccfb80 1 client.15786 shutdown 2023-09-23T08:57:48.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.560+0000 7f57f6ccfb80 1 -- 172.21.15.82:0/244519891 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575a7a23ca0 msgr2=0x5575a7a25480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:48.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.560+0000 7f57f6ccfb80 1 --2- 172.21.15.82:0/244519891 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575a7a23ca0 0x5575a7a25480 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f57d40259d0 tx=0x7f57d4004ad0 comp rx=0 tx=0).stop 2023-09-23T08:57:48.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.560+0000 7f57f6ccfb80 1 -- 172.21.15.82:0/244519891 shutdown_connections 2023-09-23T08:57:48.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.560+0000 7f57f6ccfb80 1 --2- 172.21.15.82:0/244519891 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5575a7a8c1f0 0x5575a7a8e610 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:48.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.560+0000 7f57f6ccfb80 1 --2- 172.21.15.82:0/244519891 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575a7a23ca0 0x5575a7a25480 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:48.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.560+0000 7f57f6ccfb80 1 --2- 172.21.15.82:0/244519891 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575a7a1dc40 0x5575a7a26500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:48.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.560+0000 7f57c4ff9700 0 client.15786 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T08:57:48.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.560+0000 7f57f6ccfb80 1 --2- 172.21.15.82:0/244519891 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575a7a23380 0x5575a7a26a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:48.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.560+0000 7f57f6ccfb80 1 -- 172.21.15.82:0/244519891 >> 172.21.15.82:0/244519891 conn(0x5575a79920e0 msgr2=0x5575a7a21fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:48.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.561+0000 7f57f6ccfb80 1 -- 172.21.15.82:0/244519891 shutdown_connections 2023-09-23T08:57:48.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.561+0000 7f57f6ccfb80 1 -- 172.21.15.82:0/244519891 wait complete. 2023-09-23T08:57:48.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.561+0000 7f57f6ccfb80 20 client.15786 trim_cache size 0 max 16384 2023-09-23T08:57:48.569 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T08:57:48.569 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "no active scrubs running", 2023-09-23T08:57:48.569 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": {} 2023-09-23T08:57:48.569 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T08:57:48.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.561+0000 7f57e33ff700 1 -- 172.21.15.82:0/2812284869 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f57c80a0260 msgr2=0x7f57c80a2720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:48.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.561+0000 7f57e33ff700 1 --2- 172.21.15.82:0/2812284869 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f57c80a0260 0x7f57c80a2720 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f57d4009ec0 tx=0x7f57d4009040 comp rx=0 tx=0).stop 2023-09-23T08:57:48.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.561+0000 7f57e33ff700 1 -- 172.21.15.82:0/2812284869 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57dc101250 msgr2=0x7f57dc19cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:48.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.561+0000 7f57e33ff700 1 --2- 172.21.15.82:0/2812284869 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57dc101250 0x7f57dc19cc00 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f57cc000c00 tx=0x7f57cc004730 comp rx=0 tx=0).stop 2023-09-23T08:57:48.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.562+0000 7f57e33ff700 1 -- 172.21.15.82:0/2812284869 shutdown_connections 2023-09-23T08:57:48.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.562+0000 7f57e33ff700 1 --2- 172.21.15.82:0/2812284869 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f57c80a0260 0x7f57c80a2720 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:48.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.562+0000 7f57e33ff700 1 --2- 172.21.15.82:0/2812284869 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57dc1068a0 0x7f57dc196750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:48.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.562+0000 7f57e33ff700 1 --2- 172.21.15.82:0/2812284869 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57dc100890 0x7f57dc19c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:48.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.562+0000 7f57e33ff700 1 --2- 172.21.15.82:0/2812284869 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57dc101250 0x7f57dc19cc00 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:48.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.562+0000 7f57e33ff700 1 -- 172.21.15.82:0/2812284869 >> 172.21.15.82:0/2812284869 conn(0x7f57dc0fc380 msgr2=0x7f57dc0fca60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:48.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.562+0000 7f57e33ff700 1 -- 172.21.15.82:0/2812284869 shutdown_connections 2023-09-23T08:57:48.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.562+0000 7f57e33ff700 1 -- 172.21.15.82:0/2812284869 wait complete. 2023-09-23T08:57:48.585 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-09-23T08:57:48.585 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-23T08:57:48.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:57:48 smithi082 ceph-mon[97694]: pgmap v30: 97 pgs: 97 active+clean; 331 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 25 MiB/s wr, 28 op/s 2023-09-23T08:57:48.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.804+0000 7f57d85ff700 1 -- 172.21.15.82:0/2509238470 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57d01008a0 msgr2=0x7f57d0100d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:48.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.804+0000 7f57d85ff700 1 --2- 172.21.15.82:0/2509238470 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57d01008a0 0x7f57d0100d20 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f57c0009990 tx=0x7f57c0009ca0 comp rx=0 tx=0).stop 2023-09-23T08:57:48.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.804+0000 7f57d85ff700 1 -- 172.21.15.82:0/2509238470 shutdown_connections 2023-09-23T08:57:48.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.804+0000 7f57d85ff700 1 --2- 172.21.15.82:0/2509238470 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57d0101260 0x7f57d010d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:48.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.804+0000 7f57d85ff700 1 --2- 172.21.15.82:0/2509238470 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57d01068b0 0x7f57d0106c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:48.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.804+0000 7f57d85ff700 1 --2- 172.21.15.82:0/2509238470 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57d01008a0 0x7f57d0100d20 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:48.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.804+0000 7f57d85ff700 1 -- 172.21.15.82:0/2509238470 >> 172.21.15.82:0/2509238470 conn(0x7f57d00fc3d0 msgr2=0x7f57d00fe7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:48.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.804+0000 7f57d85ff700 1 -- 172.21.15.82:0/2509238470 shutdown_connections 2023-09-23T08:57:48.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.804+0000 7f57d85ff700 1 -- 172.21.15.82:0/2509238470 wait complete. 2023-09-23T08:57:48.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.806+0000 7f57d85ff700 1 Processor -- start 2023-09-23T08:57:48.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.806+0000 7f57d85ff700 1 -- start start 2023-09-23T08:57:48.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.806+0000 7f57d85ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57d01008a0 0x7f57d019c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:48.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.806+0000 7f57d85ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57d0101260 0x7f57d019cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:48.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.806+0000 7f57d85ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57d01068b0 0x7f57d0196720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:48.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.806+0000 7f57d85ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57d0196d90 con 0x7f57d0101260 2023-09-23T08:57:48.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.806+0000 7f57d85ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57d0196f00 con 0x7f57d01068b0 2023-09-23T08:57:48.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.806+0000 7f57d85ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57d01970c0 con 0x7f57d01008a0 2023-09-23T08:57:48.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.807+0000 7f57d5b9a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57d0101260 0x7f57d019cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:48.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.807+0000 7f57d639b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57d01008a0 0x7f57d019c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:48.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.807+0000 7f57d5b9a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57d0101260 0x7f57d019cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37124/0 (socket says 172.21.15.82:37124) 2023-09-23T08:57:48.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.807+0000 7f57d5b9a700 1 -- 172.21.15.82:0/546410865 learned_addr learned my addr 172.21.15.82:0/546410865 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:57:48.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.807+0000 7f57d6b9c700 1 --2- 172.21.15.82:0/546410865 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57d01068b0 0x7f57d0196720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:48.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.807+0000 7f57d5b9a700 1 -- 172.21.15.82:0/546410865 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57d01008a0 msgr2=0x7f57d019c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:48.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.807+0000 7f57d5b9a700 1 --2- 172.21.15.82:0/546410865 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57d01008a0 0x7f57d019c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:48.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.807+0000 7f57d5b9a700 1 -- 172.21.15.82:0/546410865 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57d01068b0 msgr2=0x7f57d0196720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:48.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.807+0000 7f57d5b9a700 1 --2- 172.21.15.82:0/546410865 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57d01068b0 0x7f57d0196720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:48.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.807+0000 7f57d5b9a700 1 -- 172.21.15.82:0/546410865 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57c00095f0 con 0x7f57d0101260 2023-09-23T08:57:48.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.807+0000 7f57d639b700 1 --2- 172.21.15.82:0/546410865 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57d01008a0 0x7f57d019c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T08:57:48.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.807+0000 7f57d5b9a700 1 --2- 172.21.15.82:0/546410865 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57d0101260 0x7f57d019cbf0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f57c0000c00 tx=0x7f57c0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:48.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:57:48 smithi135 ceph-mon[99205]: pgmap v30: 97 pgs: 97 active+clean; 331 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 25 MiB/s wr, 28 op/s 2023-09-23T08:57:48.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.808+0000 7f57c77fe700 1 -- 172.21.15.82:0/546410865 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c001d070 con 0x7f57d0101260 2023-09-23T08:57:48.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.808+0000 7f57c77fe700 1 -- 172.21.15.82:0/546410865 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f57c0022470 con 0x7f57d0101260 2023-09-23T08:57:48.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.808+0000 7f57d85ff700 1 -- 172.21.15.82:0/546410865 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57d0197340 con 0x7f57d0101260 2023-09-23T08:57:48.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.808+0000 7f57c77fe700 1 -- 172.21.15.82:0/546410865 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c0017650 con 0x7f57d0101260 2023-09-23T08:57:48.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.808+0000 7f57d85ff700 1 -- 172.21.15.82:0/546410865 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57d01a36a0 con 0x7f57d0101260 2023-09-23T08:57:48.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.809+0000 7f57d85ff700 1 -- 172.21.15.82:0/546410865 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57d0067710 con 0x7f57d0101260 2023-09-23T08:57:48.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.811+0000 7f57c77fe700 1 -- 172.21.15.82:0/546410865 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) v1 ==== 134904+0+0 (secure 0 0 0) 0x7f57c00225e0 con 0x7f57d0101260 2023-09-23T08:57:48.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.812+0000 7f57c77fe700 1 --2- 172.21.15.82:0/546410865 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f57bc0a0230 0x7f57bc0a26f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:48.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.813+0000 7f57c77fe700 1 -- 172.21.15.82:0/546410865 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f57c00cccf0 con 0x7f57d0101260 2023-09-23T08:57:48.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.813+0000 7f57d639b700 1 --2- 172.21.15.82:0/546410865 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f57bc0a0230 0x7f57bc0a26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:48.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.814+0000 7f57d639b700 1 --2- 172.21.15.82:0/546410865 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f57bc0a0230 0x7f57bc0a26f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f57cc009fd0 tx=0x7f57cc009260 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:48.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:48.817+0000 7f57c77fe700 1 -- 172.21.15.82:0/546410865 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f57c0096550 con 0x7f57d0101260 2023-09-23T08:57:48.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:57:48 smithi161 ceph-mon[99580]: pgmap v30: 97 pgs: 97 active+clean; 331 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 25 MiB/s wr, 28 op/s 2023-09-23T08:57:49.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.107+0000 7f57d85ff700 1 -- 172.21.15.82:0/546410865 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f57d0197c30 con 0x7f57d0101260 2023-09-23T08:57:49.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.108+0000 7f57c77fe700 1 -- 172.21.15.82:0/546410865 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+11330 (secure 0 0 0) 0x7f57c0027090 con 0x7f57d0101260 2023-09-23T08:57:49.112 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T08:57:49.112 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/1237857359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1237857359},{"type":"v1","addr":"172.21.15.82:6835","nonce":1237857359}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/1335102362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":1335102362},{"type":"v1","addr":"172.21.15.82:6837","nonce":1335102362}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-23T08:54:52.600479+0000","modified":"2023-09-23T08:57:30.827732+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24557,"mds_1":24550,"mds_2":24526,"mds_3":24515,"mds_4":24514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/3645331700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3645331700},{"type":"v1","addr":"172.21.15.135:6835","nonce":3645331700}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14658":{"gid":14658,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6839/205725278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":205725278},{"type":"v1","addr":"172.21.15.82:6839","nonce":205725278}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14670":{"gid":14670,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6841/2659297867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":2659297867},{"type":"v1","addr":"172.21.15.82:6841","nonce":2659297867}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24461":{"gid":24461,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/503886037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":503886037},{"type":"v1","addr":"172.21.15.135:6833","nonce":503886037}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24463":{"gid":24463,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.161:6833/471569125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":471569125},{"type":"v1","addr":"172.21.15.161:6833","nonce":471569125}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24514":{"gid":24514,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":10,"addr":"172.21.15.161:6835/2237964162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":2237964162},{"type":"v1","addr":"172.21.15.161:6835","nonce":2237964162}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24515":{"gid":24515,"name":"h","rank":3,"incarnation":22,"state":"up:active","state_seq":8,"addr":"172.21.15.135:6837/2655304858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2655304858},{"type":"v1","addr":"172.21.15.135:6837","nonce":2655304858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24526":{"gid":24526,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.161:6837/43639843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":43639843},{"type":"v1","addr":"172.21.15.161:6837","nonce":43639843}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24550":{"gid":24550,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.161:6839/758982817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6838","nonce":758982817},{"type":"v1","addr":"172.21.15.161:6839","nonce":758982817}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24557":{"gid":24557,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6839/2508669274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2508669274},{"type":"v1","addr":"172.21.15.135:6839","nonce":2508669274}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-23T08:57:49.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.112+0000 7f57d85ff700 1 -- 172.21.15.82:0/546410865 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f57bc0a0230 msgr2=0x7f57bc0a26f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:49.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.112+0000 7f57d85ff700 1 --2- 172.21.15.82:0/546410865 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f57bc0a0230 0x7f57bc0a26f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f57cc009fd0 tx=0x7f57cc009260 comp rx=0 tx=0).stop 2023-09-23T08:57:49.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.112+0000 7f57d85ff700 1 -- 172.21.15.82:0/546410865 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57d0101260 msgr2=0x7f57d019cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:49.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.112+0000 7f57d85ff700 1 --2- 172.21.15.82:0/546410865 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57d0101260 0x7f57d019cbf0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f57c0000c00 tx=0x7f57c0004730 comp rx=0 tx=0).stop 2023-09-23T08:57:49.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.112+0000 7f57d85ff700 1 -- 172.21.15.82:0/546410865 shutdown_connections 2023-09-23T08:57:49.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.112+0000 7f57d85ff700 1 --2- 172.21.15.82:0/546410865 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f57bc0a0230 0x7f57bc0a26f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:49.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.112+0000 7f57d85ff700 1 --2- 172.21.15.82:0/546410865 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57d01068b0 0x7f57d0196720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:49.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.112+0000 7f57d85ff700 1 --2- 172.21.15.82:0/546410865 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57d01008a0 0x7f57d019c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:49.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.112+0000 7f57d85ff700 1 --2- 172.21.15.82:0/546410865 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57d0101260 0x7f57d019cbf0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:49.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.112+0000 7f57d85ff700 1 -- 172.21.15.82:0/546410865 >> 172.21.15.82:0/546410865 conn(0x7f57d00fc3d0 msgr2=0x7f57d00fca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:49.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.113+0000 7f57d85ff700 1 -- 172.21.15.82:0/546410865 shutdown_connections 2023-09-23T08:57:49.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.113+0000 7f57d85ff700 1 -- 172.21.15.82:0/546410865 wait complete. 2023-09-23T08:57:49.117 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 30 2023-09-23T08:57:49.138 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-09-23T08:57:49.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.403+0000 7f4bab59e700 1 -- 172.21.15.82:0/3484747053 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bac10cfd0 msgr2=0x7f4bac10f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:49.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.403+0000 7f4bab59e700 1 --2- 172.21.15.82:0/3484747053 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bac10cfd0 0x7f4bac10f3c0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f4ba400b0a0 tx=0x7f4ba400b3b0 comp rx=0 tx=0).stop 2023-09-23T08:57:49.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.403+0000 7f4bab59e700 1 -- 172.21.15.82:0/3484747053 shutdown_connections 2023-09-23T08:57:49.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.403+0000 7f4bab59e700 1 --2- 172.21.15.82:0/3484747053 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bac10cfd0 0x7f4bac10f3c0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:49.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.403+0000 7f4bab59e700 1 --2- 172.21.15.82:0/3484747053 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4bac072cd0 0x7f4bac0730b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:49.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.403+0000 7f4bab59e700 1 --2- 172.21.15.82:0/3484747053 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4bac0735f0 0x7f4bac10ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:49.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.403+0000 7f4bab59e700 1 -- 172.21.15.82:0/3484747053 >> 172.21.15.82:0/3484747053 conn(0x7f4bac0fc1e0 msgr2=0x7f4bac0fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:49.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.403+0000 7f4bab59e700 1 -- 172.21.15.82:0/3484747053 shutdown_connections 2023-09-23T08:57:49.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.403+0000 7f4bab59e700 1 -- 172.21.15.82:0/3484747053 wait complete. 2023-09-23T08:57:49.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.405+0000 7f4bab59e700 1 Processor -- start 2023-09-23T08:57:49.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.405+0000 7f4bab59e700 1 -- start start 2023-09-23T08:57:49.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.406+0000 7f4bab59e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4bac072cd0 0x7f4bac19e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:49.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.406+0000 7f4bab59e700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4bac0735f0 0x7f4bac19ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:49.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.406+0000 7f4bab59e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bac10cfd0 0x7f4bac198830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:49.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.406+0000 7f4bab59e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bac198ea0 con 0x7f4bac10cfd0 2023-09-23T08:57:49.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.406+0000 7f4bab59e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bac199010 con 0x7f4bac072cd0 2023-09-23T08:57:49.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.406+0000 7f4bab59e700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bac1991d0 con 0x7f4bac0735f0 2023-09-23T08:57:49.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.406+0000 7f4ba9d9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4bac0735f0 0x7f4bac19ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:49.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.406+0000 7f4ba9d9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4bac0735f0 0x7f4bac19ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:37810/0 (socket says 172.21.15.82:37810) 2023-09-23T08:57:49.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.406+0000 7f4ba9d9b700 1 -- 172.21.15.82:0/3041218451 learned_addr learned my addr 172.21.15.82:0/3041218451 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:57:49.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.406+0000 7f4baad9d700 1 --2- 172.21.15.82:0/3041218451 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bac10cfd0 0x7f4bac198830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:49.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.406+0000 7f4baa59c700 1 --2- 172.21.15.82:0/3041218451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4bac072cd0 0x7f4bac19e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:49.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.406+0000 7f4ba9d9b700 1 -- 172.21.15.82:0/3041218451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4bac072cd0 msgr2=0x7f4bac19e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:49.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.406+0000 7f4ba9d9b700 1 --2- 172.21.15.82:0/3041218451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4bac072cd0 0x7f4bac19e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:49.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.406+0000 7f4ba9d9b700 1 -- 172.21.15.82:0/3041218451 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bac10cfd0 msgr2=0x7f4bac198830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:49.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.406+0000 7f4ba9d9b700 1 --2- 172.21.15.82:0/3041218451 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bac10cfd0 0x7f4bac198830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:49.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.406+0000 7f4ba9d9b700 1 -- 172.21.15.82:0/3041218451 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ba4009d00 con 0x7f4bac0735f0 2023-09-23T08:57:49.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.406+0000 7f4baa59c700 1 --2- 172.21.15.82:0/3041218451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4bac072cd0 0x7f4bac19e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T08:57:49.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.407+0000 7f4ba9d9b700 1 --2- 172.21.15.82:0/3041218451 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4bac0735f0 0x7f4bac19ed00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4ba000e9a0 tx=0x7f4ba000ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:49.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.407+0000 7f4b9b7fe700 1 -- 172.21.15.82:0/3041218451 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba0009790 con 0x7f4bac0735f0 2023-09-23T08:57:49.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.407+0000 7f4bab59e700 1 -- 172.21.15.82:0/3041218451 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bac1994b0 con 0x7f4bac0735f0 2023-09-23T08:57:49.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.407+0000 7f4b9b7fe700 1 -- 172.21.15.82:0/3041218451 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4ba000cbd0 con 0x7f4bac0735f0 2023-09-23T08:57:49.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.407+0000 7f4b9b7fe700 1 -- 172.21.15.82:0/3041218451 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba0018680 con 0x7f4bac0735f0 2023-09-23T08:57:49.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.407+0000 7f4bab59e700 1 -- 172.21.15.82:0/3041218451 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bac1a57b0 con 0x7f4bac0735f0 2023-09-23T08:57:49.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.411+0000 7f4b9b7fe700 1 -- 172.21.15.82:0/3041218451 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 25) v1 ==== 134904+0+0 (secure 0 0 0) 0x7f4ba000cd40 con 0x7f4bac0735f0 2023-09-23T08:57:49.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.412+0000 7f4bc47aab80 1 Processor -- start 2023-09-23T08:57:49.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.412+0000 7f4bc47aab80 1 -- start start 2023-09-23T08:57:49.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.412+0000 7f4bc47aab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5585b6110500 0x5585b61108e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:49.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.412+0000 7f4bc47aab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585b6110e20 0x5585b610a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:49.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.412+0000 7f4bc47aab80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5585b610ac40 0x5585b610b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:49.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.412+0000 7f4bc47aab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585b60727b0 con 0x5585b6110e20 2023-09-23T08:57:49.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.412+0000 7f4bc47aab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585b6063780 con 0x5585b6110500 2023-09-23T08:57:49.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.412+0000 7f4bc47aab80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585b60610a0 con 0x5585b610ac40 2023-09-23T08:57:49.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.413+0000 7f4b9b7fe700 1 --2- 172.21.15.82:0/3041218451 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f4b940a0280 0x7f4b940a2740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:49.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.413+0000 7f4baa59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585b6110e20 0x5585b610a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:49.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.413+0000 7f4b9b7fe700 1 -- 172.21.15.82:0/3041218451 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f4ba0014070 con 0x7f4bac0735f0 2023-09-23T08:57:49.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.413+0000 7f4baa59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585b6110e20 0x5585b610a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37152/0 (socket says 172.21.15.82:37152) 2023-09-23T08:57:49.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.413+0000 7f4baa59c700 1 -- 172.21.15.82:0/1669961509 learned_addr learned my addr 172.21.15.82:0/1669961509 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:57:49.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.413+0000 7f4baad9d700 1 --2- 172.21.15.82:0/1669961509 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5585b6110500 0x5585b61108e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:49.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.413+0000 7f4ba9d9b700 1 --2- 172.21.15.82:0/1669961509 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5585b610ac40 0x5585b610b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:49.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.413+0000 7f4baad9d700 1 -- 172.21.15.82:0/1669961509 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5585b610ac40 msgr2=0x5585b610b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:49.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.413+0000 7f4baad9d700 1 --2- 172.21.15.82:0/1669961509 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5585b610ac40 0x5585b610b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:49.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.413+0000 7f4baad9d700 1 -- 172.21.15.82:0/1669961509 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585b6110e20 msgr2=0x5585b610a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:49.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.413+0000 7f4baad9d700 1 --2- 172.21.15.82:0/1669961509 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585b6110e20 0x5585b610a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:49.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.413+0000 7f4baad9d700 1 -- 172.21.15.82:0/1669961509 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5585b5edc630 con 0x5585b6110500 2023-09-23T08:57:49.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.413+0000 7f4baa59c700 1 --2- 172.21.15.82:0/1669961509 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585b6110e20 0x5585b610a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T08:57:49.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.414+0000 7f4baad9d700 1 --2- 172.21.15.82:0/3041218451 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f4b940a0280 0x7f4b940a2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:49.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.414+0000 7f4baad9d700 1 --2- 172.21.15.82:0/1669961509 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5585b6110500 0x5585b61108e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4ba4009fd0 tx=0x7f4ba4009380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=adaa2ffec9c41c0a server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:49.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.414+0000 7f4baad9d700 1 --2- 172.21.15.82:0/3041218451 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f4b940a0280 0x7f4b940a2740 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x5585b61174f0 tx=0x7f4ba402b000 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:49.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.414+0000 7f4b98ff9700 1 -- 172.21.15.82:0/1669961509 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba400e040 con 0x5585b6110500 2023-09-23T08:57:49.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.414+0000 7f4b98ff9700 1 -- 172.21.15.82:0/1669961509 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4ba4003e90 con 0x5585b6110500 2023-09-23T08:57:49.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.414+0000 7f4b98ff9700 1 -- 172.21.15.82:0/1669961509 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba40052a0 con 0x5585b6110500 2023-09-23T08:57:49.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.415+0000 7f4bc47aab80 1 -- 172.21.15.82:0/1669961509 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5585b6110500 msgr2=0x5585b61108e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:49.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.415+0000 7f4bc47aab80 1 --2- 172.21.15.82:0/1669961509 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5585b6110500 0x5585b61108e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4ba4009fd0 tx=0x7f4ba4009380 comp rx=0 tx=0).stop 2023-09-23T08:57:49.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.415+0000 7f4bc47aab80 1 -- 172.21.15.82:0/1669961509 shutdown_connections 2023-09-23T08:57:49.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.415+0000 7f4bc47aab80 1 --2- 172.21.15.82:0/1669961509 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5585b610ac40 0x5585b610b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:49.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.415+0000 7f4bc47aab80 1 --2- 172.21.15.82:0/1669961509 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5585b6110500 0x5585b61108e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:49.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.415+0000 7f4bc47aab80 1 --2- 172.21.15.82:0/1669961509 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585b6110e20 0x5585b610a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:49.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.415+0000 7f4bc47aab80 1 -- 172.21.15.82:0/1669961509 >> 172.21.15.82:0/1669961509 conn(0x5585b607f0e0 msgr2=0x5585b6105940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:49.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.415+0000 7f4bc47aab80 1 -- 172.21.15.82:0/1669961509 shutdown_connections 2023-09-23T08:57:49.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.415+0000 7f4bc47aab80 1 -- 172.21.15.82:0/1669961509 wait complete. 2023-09-23T08:57:49.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.416+0000 7f4bc47aab80 1 -- start start 2023-09-23T08:57:49.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.416+0000 7f4bc47aab80 1 Processor -- start 2023-09-23T08:57:49.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.417+0000 7f4bc47aab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5585b610ac40 0x5585b6116e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:49.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.417+0000 7f4bc47aab80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5585b6110500 0x5585b6114160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:49.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.417+0000 7f4bc47aab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585b6110e20 0x5585b61148a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:49.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.417+0000 7f4bc47aab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585b605c990 con 0x5585b6110e20 2023-09-23T08:57:49.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.417+0000 7f4bc47aab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585b5ffabb0 con 0x5585b610ac40 2023-09-23T08:57:49.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.417+0000 7f4bc47aab80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585b5ffa8b0 con 0x5585b6110500 2023-09-23T08:57:49.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.417+0000 7f4bc47aab80 10 client.0 _ll_register_callbacks cb 0x5585b5f44a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T08:57:49.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.417+0000 7f4baad9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585b6110e20 0x5585b61148a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:49.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.417+0000 7f4baad9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585b6110e20 0x5585b61148a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37156/0 (socket says 172.21.15.82:37156) 2023-09-23T08:57:49.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.417+0000 7f4baad9d700 1 -- 172.21.15.82:0/1133048780 learned_addr learned my addr 172.21.15.82:0/1133048780 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:57:49.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.417+0000 7f4ba9d9b700 1 --2- 172.21.15.82:0/1133048780 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5585b6110500 0x5585b6114160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:49.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.417+0000 7f4baa59c700 1 --2- 172.21.15.82:0/1133048780 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5585b610ac40 0x5585b6116e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:49.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.418+0000 7f4baad9d700 1 -- 172.21.15.82:0/1133048780 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5585b6110500 msgr2=0x5585b6114160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:49.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.418+0000 7f4baad9d700 1 --2- 172.21.15.82:0/1133048780 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5585b6110500 0x5585b6114160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:49.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.418+0000 7f4baad9d700 1 -- 172.21.15.82:0/1133048780 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5585b610ac40 msgr2=0x5585b6116e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:49.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.418+0000 7f4baad9d700 1 --2- 172.21.15.82:0/1133048780 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5585b610ac40 0x5585b6116e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:49.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.418+0000 7f4baad9d700 1 -- 172.21.15.82:0/1133048780 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b9c009a10 con 0x5585b6110e20 2023-09-23T08:57:49.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.418+0000 7f4baad9d700 1 --2- 172.21.15.82:0/1133048780 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585b6110e20 0x5585b61148a0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f4ba4009850 tx=0x7f4ba400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae6af475a6058a90 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:49.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.418+0000 7f4b91ffb700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T08:57:49.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.418+0000 7f4b91ffb700 1 -- 172.21.15.82:0/1133048780 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba400e040 con 0x5585b6110e20 2023-09-23T08:57:49.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.418+0000 7f4bc47aab80 1 -- 172.21.15.82:0/1133048780 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5585b60da1c0 con 0x5585b6110e20 2023-09-23T08:57:49.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.418+0000 7f4b91ffb700 1 -- 172.21.15.82:0/1133048780 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f4ba4007b90 con 0x5585b6110e20 2023-09-23T08:57:49.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.418+0000 7f4b91ffb700 1 -- 172.21.15.82:0/1133048780 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4ba4033650 con 0x5585b6110e20 2023-09-23T08:57:49.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.418+0000 7f4bc47aab80 10 client.15804 fetch_fsmap learned FSMap version 30 2023-09-23T08:57:49.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.419+0000 7f4bc47aab80 1 -- 172.21.15.82:0/1133048780 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x7f4bac110080 con 0x5585b6110e20 2023-09-23T08:57:49.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.419+0000 7f4b91ffb700 1 -- 172.21.15.82:0/1133048780 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5585b60da1c0 con 0x5585b6110e20 2023-09-23T08:57:49.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.419+0000 7f4b91ffb700 1 -- 172.21.15.82:0/1133048780 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 30) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f4ba4005280 con 0x5585b6110e20 2023-09-23T08:57:49.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.419+0000 7f4bc47aab80 10 client.15804 fetch_fsmap finished waiting for FSMap version 30 2023-09-23T08:57:49.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.419+0000 7f4bc47aab80 10 client.15804 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2023-09-23T08:57:49.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.419+0000 7f4bc47aab80 20 client.15804 populate_metadata read hostname 'smithi082' 2023-09-23T08:57:49.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.419+0000 7f4bc47aab80 1 --2- 172.21.15.82:0/1133048780 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x5585b6124650 0x5585b6126a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:49.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.419+0000 7f4bc47aab80 4 client.15804 mds_command: new command op to 24514 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T08:57:49.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.419+0000 7f4bc47aab80 1 -- 172.21.15.82:0/1133048780 --> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5585b6002ba0 con 0x5585b6124650 2023-09-23T08:57:49.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.420+0000 7f4baa59c700 1 --2- 172.21.15.82:0/1133048780 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x5585b6124650 0x5585b6126a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:49.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.420+0000 7f4baa59c700 1 --2- 172.21.15.82:0/1133048780 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x5585b6124650 0x5585b6126a70 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=6da27281518f16a3 server_cookie=d069771a367221c8 in_seq=0 out_seq=0 2023-09-23T08:57:49.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.420+0000 7f4b91ffb700 10 client.15804 ms_handle_connect on v2:172.21.15.161:6834/2237964162 2023-09-23T08:57:49.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.421+0000 7f4b91ffb700 1 -- 172.21.15.82:0/1133048780 <== mds.4 v2:172.21.15.161:6834/2237964162 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5585b6002ba0 con 0x5585b6124650 2023-09-23T08:57:49.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.421+0000 7f4b91ffb700 10 client.15804 handle_command_reply: tid=0 2023-09-23T08:57:49.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.421+0000 7f4bc47aab80 1 client.15804 shutdown 2023-09-23T08:57:49.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.421+0000 7f4bc47aab80 1 -- 172.21.15.82:0/1133048780 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585b6110e20 msgr2=0x5585b61148a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:49.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.421+0000 7f4bc47aab80 1 --2- 172.21.15.82:0/1133048780 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585b6110e20 0x5585b61148a0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f4ba4009850 tx=0x7f4ba400bf10 comp rx=0 tx=0).stop 2023-09-23T08:57:49.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.422+0000 7f4bc47aab80 1 -- 172.21.15.82:0/1133048780 shutdown_connections 2023-09-23T08:57:49.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.422+0000 7f4bc47aab80 1 --2- 172.21.15.82:0/1133048780 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x5585b6124650 0x5585b6126a70 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:49.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.422+0000 7f4bc47aab80 1 --2- 172.21.15.82:0/1133048780 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585b6110e20 0x5585b61148a0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:49.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.422+0000 7f4bc47aab80 1 --2- 172.21.15.82:0/1133048780 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5585b610ac40 0x5585b6116e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:49.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.422+0000 7f4bc47aab80 1 --2- 172.21.15.82:0/1133048780 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5585b6110500 0x5585b6114160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:49.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.422+0000 7f4bc47aab80 1 -- 172.21.15.82:0/1133048780 >> 172.21.15.82:0/1133048780 conn(0x5585b607f0e0 msgr2=0x5585b61096f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:49.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.422+0000 7f4b91ffb700 0 client.15804 ms_handle_reset on v2:172.21.15.161:6834/2237964162 2023-09-23T08:57:49.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.422+0000 7f4bc47aab80 1 -- 172.21.15.82:0/1133048780 shutdown_connections 2023-09-23T08:57:49.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.422+0000 7f4bc47aab80 1 -- 172.21.15.82:0/1133048780 wait complete. 2023-09-23T08:57:49.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.422+0000 7f4bc47aab80 20 client.15804 trim_cache size 0 max 16384 2023-09-23T08:57:49.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.440+0000 7f4bc47aab80 1 Processor -- start 2023-09-23T08:57:49.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.440+0000 7f4bc47aab80 1 -- start start 2023-09-23T08:57:49.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.441+0000 7f4bc47aab80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5585b610ac40 0x5585b610a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:49.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.441+0000 7f4bc47aab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5585b6110500 0x5585b61200f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:49.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.441+0000 7f4bc47aab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585b6110e20 0x5585b6113940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:49.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.441+0000 7f4bc47aab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585b5ede920 con 0x5585b6110e20 2023-09-23T08:57:49.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.441+0000 7f4bc47aab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585b6101810 con 0x5585b6110500 2023-09-23T08:57:49.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.441+0000 7f4bc47aab80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585b6106770 con 0x5585b610ac40 2023-09-23T08:57:49.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.441+0000 7f4baad9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585b6110e20 0x5585b6113940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:49.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.441+0000 7f4baad9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585b6110e20 0x5585b6113940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37160/0 (socket says 172.21.15.82:37160) 2023-09-23T08:57:49.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.441+0000 7f4baad9d700 1 -- 172.21.15.82:0/4071875554 learned_addr learned my addr 172.21.15.82:0/4071875554 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:57:49.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.441+0000 7f4ba9d9b700 1 --2- 172.21.15.82:0/4071875554 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5585b6110500 0x5585b61200f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:49.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.441+0000 7f4baa59c700 1 --2- 172.21.15.82:0/4071875554 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5585b610ac40 0x5585b610a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:49.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.442+0000 7f4baad9d700 1 -- 172.21.15.82:0/4071875554 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5585b610ac40 msgr2=0x5585b610a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:49.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.442+0000 7f4baad9d700 1 --2- 172.21.15.82:0/4071875554 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5585b610ac40 0x5585b610a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:49.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.442+0000 7f4baad9d700 1 -- 172.21.15.82:0/4071875554 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5585b6110500 msgr2=0x5585b61200f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:49.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.442+0000 7f4baad9d700 1 --2- 172.21.15.82:0/4071875554 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5585b6110500 0x5585b61200f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:49.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.442+0000 7f4baad9d700 1 -- 172.21.15.82:0/4071875554 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5585b612b660 con 0x5585b6110e20 2023-09-23T08:57:49.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.442+0000 7f4ba9d9b700 1 --2- 172.21.15.82:0/4071875554 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5585b6110500 0x5585b61200f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T08:57:49.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.442+0000 7f4baad9d700 1 --2- 172.21.15.82:0/4071875554 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585b6110e20 0x5585b6113940 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f4ba40055e0 tx=0x7f4ba4009be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88ce4b421c26def3 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:49.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.442+0000 7f4b997fa700 1 -- 172.21.15.82:0/4071875554 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba400e070 con 0x5585b6110e20 2023-09-23T08:57:49.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.442+0000 7f4b997fa700 1 -- 172.21.15.82:0/4071875554 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4ba4007e10 con 0x5585b6110e20 2023-09-23T08:57:49.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.442+0000 7f4b997fa700 1 -- 172.21.15.82:0/4071875554 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba4033c10 con 0x5585b6110e20 2023-09-23T08:57:49.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.443+0000 7f4bc47aab80 1 -- 172.21.15.82:0/4071875554 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585b6110e20 msgr2=0x5585b6113940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:49.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.443+0000 7f4bc47aab80 1 --2- 172.21.15.82:0/4071875554 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585b6110e20 0x5585b6113940 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f4ba40055e0 tx=0x7f4ba4009be0 comp rx=0 tx=0).stop 2023-09-23T08:57:49.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.443+0000 7f4bc47aab80 1 -- 172.21.15.82:0/4071875554 shutdown_connections 2023-09-23T08:57:49.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.443+0000 7f4bc47aab80 1 --2- 172.21.15.82:0/4071875554 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585b6110e20 0x5585b6113940 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:49.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.443+0000 7f4bc47aab80 1 --2- 172.21.15.82:0/4071875554 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5585b610ac40 0x5585b610a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:49.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.443+0000 7f4bc47aab80 1 --2- 172.21.15.82:0/4071875554 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5585b6110500 0x5585b61200f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:49.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.443+0000 7f4bc47aab80 1 -- 172.21.15.82:0/4071875554 >> 172.21.15.82:0/4071875554 conn(0x5585b607f0e0 msgr2=0x5585b6126660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:49.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.443+0000 7f4bc47aab80 1 -- 172.21.15.82:0/4071875554 shutdown_connections 2023-09-23T08:57:49.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.443+0000 7f4bc47aab80 1 -- 172.21.15.82:0/4071875554 wait complete. 2023-09-23T08:57:49.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.443+0000 7f4bc47aab80 1 -- start start 2023-09-23T08:57:49.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.444+0000 7f4bc47aab80 1 Processor -- start 2023-09-23T08:57:49.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.444+0000 7f4bc47aab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5585b610ac40 0x5585b611b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:49.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.444+0000 7f4bc47aab80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5585b6110500 0x5585b61197b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:49.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.444+0000 7f4bc47aab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585b6110e20 0x5585b6119cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:49.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.444+0000 7f4bc47aab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585b611a230 con 0x5585b6110e20 2023-09-23T08:57:49.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.444+0000 7f4bc47aab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585b611a370 con 0x5585b610ac40 2023-09-23T08:57:49.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.444+0000 7f4bc47aab80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585b611a530 con 0x5585b6110500 2023-09-23T08:57:49.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.444+0000 7f4bc47aab80 10 client.0 _ll_register_callbacks cb 0x7f4b9c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T08:57:49.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.445+0000 7f4baad9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585b6110e20 0x5585b6119cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:49.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.445+0000 7f4baa59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5585b610ac40 0x5585b611b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:49.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.445+0000 7f4baa59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5585b610ac40 0x5585b611b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:37098/0 (socket says 172.21.15.82:37098) 2023-09-23T08:57:49.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.445+0000 7f4baa59c700 1 -- 172.21.15.82:0/4023110564 learned_addr learned my addr 172.21.15.82:0/4023110564 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:57:49.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.445+0000 7f4baad9d700 1 --2- 172.21.15.82:0/4023110564 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585b6110e20 0x5585b6119cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37164/0 (socket says 172.21.15.82:37164) 2023-09-23T08:57:49.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.445+0000 7f4ba9d9b700 1 --2- 172.21.15.82:0/4023110564 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5585b6110500 0x5585b61197b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:49.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.445+0000 7f4baad9d700 1 -- 172.21.15.82:0/4023110564 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5585b6110500 msgr2=0x5585b61197b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:49.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.445+0000 7f4baad9d700 1 --2- 172.21.15.82:0/4023110564 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5585b6110500 0x5585b61197b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:49.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.445+0000 7f4baad9d700 1 -- 172.21.15.82:0/4023110564 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5585b610ac40 msgr2=0x5585b611b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:49.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.445+0000 7f4baad9d700 1 --2- 172.21.15.82:0/4023110564 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5585b610ac40 0x5585b611b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:49.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.445+0000 7f4baad9d700 1 -- 172.21.15.82:0/4023110564 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bac110080 con 0x5585b6110e20 2023-09-23T08:57:49.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.445+0000 7f4baa59c700 1 --2- 172.21.15.82:0/4023110564 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5585b610ac40 0x5585b611b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T08:57:49.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.445+0000 7f4baad9d700 1 --2- 172.21.15.82:0/4023110564 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585b6110e20 0x5585b6119cf0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f4ba401f0b0 tx=0x7f4ba40337a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48d97141d3d092c1 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:49.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.445+0000 7f4b91ffb700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T08:57:49.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.445+0000 7f4b91ffb700 1 -- 172.21.15.82:0/4023110564 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba400e070 con 0x5585b6110e20 2023-09-23T08:57:49.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.446+0000 7f4bc47aab80 1 -- 172.21.15.82:0/4023110564 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5585b60fd8b0 con 0x5585b6110e20 2023-09-23T08:57:49.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.446+0000 7f4b91ffb700 1 -- 172.21.15.82:0/4023110564 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f4ba4005270 con 0x5585b6110e20 2023-09-23T08:57:49.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.446+0000 7f4b91ffb700 1 -- 172.21.15.82:0/4023110564 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4ba4005430 con 0x5585b6110e20 2023-09-23T08:57:49.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.446+0000 7f4bc47aab80 10 client.15810 fetch_fsmap learned FSMap version 30 2023-09-23T08:57:49.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.446+0000 7f4bc47aab80 1 -- 172.21.15.82:0/4023110564 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x5585b5e88de0 con 0x5585b6110e20 2023-09-23T08:57:49.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.446+0000 7f4b91ffb700 1 -- 172.21.15.82:0/4023110564 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5585b60fd8b0 con 0x5585b6110e20 2023-09-23T08:57:49.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.446+0000 7f4b91ffb700 1 -- 172.21.15.82:0/4023110564 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 30) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f4ba4048780 con 0x5585b6110e20 2023-09-23T08:57:49.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.446+0000 7f4bc47aab80 10 client.15810 fetch_fsmap finished waiting for FSMap version 30 2023-09-23T08:57:49.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.446+0000 7f4bc47aab80 10 client.15810 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2023-09-23T08:57:49.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.446+0000 7f4bc47aab80 20 client.15810 populate_metadata read hostname 'smithi082' 2023-09-23T08:57:49.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.446+0000 7f4bc47aab80 1 --2- 172.21.15.82:0/4023110564 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x5585b6178450 0x5585b617a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:49.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.446+0000 7f4bc47aab80 4 client.15810 mds_command: new command op to 24514 tid=0[{"prefix": "damage ls"}] 2023-09-23T08:57:49.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.446+0000 7f4bc47aab80 1 -- 172.21.15.82:0/4023110564 --> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5585b6055970 con 0x5585b6178450 2023-09-23T08:57:49.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.447+0000 7f4baa59c700 1 --2- 172.21.15.82:0/4023110564 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x5585b6178450 0x5585b617a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:49.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.447+0000 7f4b91ffb700 10 client.15810 ms_handle_connect on v2:172.21.15.161:6834/2237964162 2023-09-23T08:57:49.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.447+0000 7f4baa59c700 1 --2- 172.21.15.82:0/4023110564 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x5585b6178450 0x5585b617a840 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=3387472d1e875229 server_cookie=31ada13035acde21 in_seq=0 out_seq=0 2023-09-23T08:57:49.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.448+0000 7f4b91ffb700 1 -- 172.21.15.82:0/4023110564 <== mds.4 v2:172.21.15.161:6834/2237964162 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5585b6055970 con 0x5585b6178450 2023-09-23T08:57:49.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.448+0000 7f4b91ffb700 10 client.15810 handle_command_reply: tid=0 2023-09-23T08:57:49.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.448+0000 7f4bc47aab80 1 client.15810 shutdown 2023-09-23T08:57:49.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.448+0000 7f4bc47aab80 1 -- 172.21.15.82:0/4023110564 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585b6110e20 msgr2=0x5585b6119cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:49.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.448+0000 7f4bc47aab80 1 --2- 172.21.15.82:0/4023110564 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585b6110e20 0x5585b6119cf0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f4ba401f0b0 tx=0x7f4ba40337a0 comp rx=0 tx=0).stop 2023-09-23T08:57:49.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.448+0000 7f4bc47aab80 1 -- 172.21.15.82:0/4023110564 shutdown_connections 2023-09-23T08:57:49.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.448+0000 7f4bc47aab80 1 --2- 172.21.15.82:0/4023110564 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x5585b6178450 0x5585b617a840 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:49.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.448+0000 7f4bc47aab80 1 --2- 172.21.15.82:0/4023110564 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585b6110e20 0x5585b6119cf0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:49.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.448+0000 7f4bc47aab80 1 --2- 172.21.15.82:0/4023110564 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5585b610ac40 0x5585b611b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:49.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.448+0000 7f4b91ffb700 0 client.15810 ms_handle_reset on v2:172.21.15.161:6834/2237964162 2023-09-23T08:57:49.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.448+0000 7f4bc47aab80 1 --2- 172.21.15.82:0/4023110564 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5585b6110500 0x5585b61197b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:49.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.448+0000 7f4bc47aab80 1 -- 172.21.15.82:0/4023110564 >> 172.21.15.82:0/4023110564 conn(0x5585b607f0e0 msgr2=0x5585b61200f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:49.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.448+0000 7f4bc47aab80 1 -- 172.21.15.82:0/4023110564 shutdown_connections 2023-09-23T08:57:49.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.448+0000 7f4bc47aab80 1 -- 172.21.15.82:0/4023110564 wait complete. 2023-09-23T08:57:49.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.448+0000 7f4bc47aab80 20 client.15810 trim_cache size 0 max 16384 2023-09-23T08:57:49.458 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2023-09-23T08:57:49.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.449+0000 7f4bab59e700 1 -- 172.21.15.82:0/3041218451 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f4b940a0280 msgr2=0x7f4b940a2740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:49.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.449+0000 7f4bab59e700 1 --2- 172.21.15.82:0/3041218451 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f4b940a0280 0x7f4b940a2740 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x5585b61174f0 tx=0x7f4ba402b000 comp rx=0 tx=0).stop 2023-09-23T08:57:49.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.449+0000 7f4bab59e700 1 -- 172.21.15.82:0/3041218451 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4bac0735f0 msgr2=0x7f4bac19ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:49.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.449+0000 7f4bab59e700 1 --2- 172.21.15.82:0/3041218451 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4bac0735f0 0x7f4bac19ed00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4ba000e9a0 tx=0x7f4ba000ecb0 comp rx=0 tx=0).stop 2023-09-23T08:57:49.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.449+0000 7f4bab59e700 1 -- 172.21.15.82:0/3041218451 shutdown_connections 2023-09-23T08:57:49.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.449+0000 7f4bab59e700 1 --2- 172.21.15.82:0/3041218451 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f4b940a0280 0x7f4b940a2740 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:49.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.449+0000 7f4bab59e700 1 --2- 172.21.15.82:0/3041218451 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bac10cfd0 0x7f4bac198830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:49.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.449+0000 7f4bab59e700 1 --2- 172.21.15.82:0/3041218451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4bac072cd0 0x7f4bac19e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:49.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.449+0000 7f4bab59e700 1 --2- 172.21.15.82:0/3041218451 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4bac0735f0 0x7f4bac19ed00 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:49.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.449+0000 7f4bab59e700 1 -- 172.21.15.82:0/3041218451 >> 172.21.15.82:0/3041218451 conn(0x7f4bac0fc1e0 msgr2=0x7f4bac104a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:49.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.449+0000 7f4bab59e700 1 -- 172.21.15.82:0/3041218451 shutdown_connections 2023-09-23T08:57:49.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.449+0000 7f4bab59e700 1 -- 172.21.15.82:0/3041218451 wait complete. 2023-09-23T08:57:49.476 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-09-23T08:57:49.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.707+0000 7ff7753ff700 1 -- 172.21.15.82:0/899156611 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff7701068a0 msgr2=0x7ff770106c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:49.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.707+0000 7ff7753ff700 1 --2- 172.21.15.82:0/899156611 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff7701068a0 0x7ff770106c80 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7ff760009990 tx=0x7ff760009ca0 comp rx=0 tx=0).stop 2023-09-23T08:57:49.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.707+0000 7ff7753ff700 1 -- 172.21.15.82:0/899156611 shutdown_connections 2023-09-23T08:57:49.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.707+0000 7ff7753ff700 1 --2- 172.21.15.82:0/899156611 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff770101250 0x7ff77010d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:49.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.707+0000 7ff7753ff700 1 --2- 172.21.15.82:0/899156611 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff7701068a0 0x7ff770106c80 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:49.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.708+0000 7ff7753ff700 1 --2- 172.21.15.82:0/899156611 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff770100890 0x7ff770100d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:49.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.708+0000 7ff7753ff700 1 -- 172.21.15.82:0/899156611 >> 172.21.15.82:0/899156611 conn(0x7ff7700fc380 msgr2=0x7ff7700fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:49.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.708+0000 7ff7753ff700 1 -- 172.21.15.82:0/899156611 shutdown_connections 2023-09-23T08:57:49.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.708+0000 7ff7753ff700 1 -- 172.21.15.82:0/899156611 wait complete. 2023-09-23T08:57:49.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.709+0000 7ff7753ff700 1 Processor -- start 2023-09-23T08:57:49.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.709+0000 7ff7753ff700 1 -- start start 2023-09-23T08:57:49.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.709+0000 7ff7753ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff770100890 0x7ff77019e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:49.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.709+0000 7ff7753ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff770101250 0x7ff77019eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:49.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.709+0000 7ff7753ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7701068a0 0x7ff770198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:49.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.709+0000 7ff7753ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff770199140 con 0x7ff770101250 2023-09-23T08:57:49.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.709+0000 7ff7753ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7701992b0 con 0x7ff7701068a0 2023-09-23T08:57:49.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.709+0000 7ff7753ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff770199470 con 0x7ff770100890 2023-09-23T08:57:49.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.710+0000 7ff76e7fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff770101250 0x7ff77019eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:49.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.710+0000 7ff76e7fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff770101250 0x7ff77019eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37176/0 (socket says 172.21.15.82:37176) 2023-09-23T08:57:49.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.710+0000 7ff76e7fc700 1 -- 172.21.15.82:0/4252925036 learned_addr learned my addr 172.21.15.82:0/4252925036 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:57:49.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.710+0000 7ff76f7fe700 1 --2- 172.21.15.82:0/4252925036 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7701068a0 0x7ff770198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:49.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.710+0000 7ff76effd700 1 --2- 172.21.15.82:0/4252925036 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff770100890 0x7ff77019e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:49.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.710+0000 7ff76e7fc700 1 -- 172.21.15.82:0/4252925036 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff770100890 msgr2=0x7ff77019e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:49.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.710+0000 7ff76e7fc700 1 --2- 172.21.15.82:0/4252925036 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff770100890 0x7ff77019e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:49.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.710+0000 7ff76e7fc700 1 -- 172.21.15.82:0/4252925036 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7701068a0 msgr2=0x7ff770198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:49.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.710+0000 7ff76e7fc700 1 --2- 172.21.15.82:0/4252925036 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7701068a0 0x7ff770198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:49.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.710+0000 7ff76e7fc700 1 -- 172.21.15.82:0/4252925036 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7600095f0 con 0x7ff770101250 2023-09-23T08:57:49.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.711+0000 7ff76e7fc700 1 --2- 172.21.15.82:0/4252925036 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff770101250 0x7ff77019eed0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7ff76400d950 tx=0x7ff76400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:49.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.711+0000 7ff757fff700 1 -- 172.21.15.82:0/4252925036 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff76400f890 con 0x7ff770101250 2023-09-23T08:57:49.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.711+0000 7ff757fff700 1 -- 172.21.15.82:0/4252925036 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff76400fe80 con 0x7ff770101250 2023-09-23T08:57:49.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.711+0000 7ff757fff700 1 -- 172.21.15.82:0/4252925036 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff76400e3b0 con 0x7ff770101250 2023-09-23T08:57:49.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.711+0000 7ff7753ff700 1 -- 172.21.15.82:0/4252925036 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff770199750 con 0x7ff770101250 2023-09-23T08:57:49.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.711+0000 7ff7753ff700 1 -- 172.21.15.82:0/4252925036 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7701a5910 con 0x7ff770101250 2023-09-23T08:57:49.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.714+0000 7ff757fff700 1 -- 172.21.15.82:0/4252925036 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) v1 ==== 134904+0+0 (secure 0 0 0) 0x7ff764010460 con 0x7ff770101250 2023-09-23T08:57:49.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.716+0000 7ff757fff700 1 --2- 172.21.15.82:0/4252925036 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7ff7580a0260 0x7ff7580a2720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:49.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.716+0000 7ff757fff700 1 -- 172.21.15.82:0/4252925036 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7ff7640cb5e0 con 0x7ff770101250 2023-09-23T08:57:49.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.716+0000 7ff76effd700 1 --2- 172.21.15.82:0/4252925036 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7ff7580a0260 0x7ff7580a2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:49.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.717+0000 7ff788cf0b80 1 Processor -- start 2023-09-23T08:57:49.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.717+0000 7ff788cf0b80 1 -- start start 2023-09-23T08:57:49.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.717+0000 7ff788cf0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579fc192380 0x5579fc192760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:49.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.717+0000 7ff788cf0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5579fc192ca0 0x5579fc18c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:49.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.717+0000 7ff788cf0b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5579fc18cc40 0x5579fc18d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:49.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.717+0000 7ff788cf0b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579fc0f47b0 con 0x5579fc192380 2023-09-23T08:57:49.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.717+0000 7ff788cf0b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579fc0e5780 con 0x5579fc192ca0 2023-09-23T08:57:49.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.717+0000 7ff788cf0b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579fc0e30a0 con 0x5579fc18cc40 2023-09-23T08:57:49.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.718+0000 7ff76e7fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5579fc192ca0 0x5579fc18c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:49.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.718+0000 7ff76effd700 1 --2- 172.21.15.82:0/4252925036 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7ff7580a0260 0x7ff7580a2720 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff76000b5c0 tx=0x7ff760005fb0 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:49.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.718+0000 7ff76effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579fc192380 0x5579fc192760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:49.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.718+0000 7ff76e7fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5579fc192ca0 0x5579fc18c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:37114/0 (socket says 172.21.15.82:37114) 2023-09-23T08:57:49.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.718+0000 7ff76e7fc700 1 -- 172.21.15.82:0/508108190 learned_addr learned my addr 172.21.15.82:0/508108190 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:57:49.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.718+0000 7ff76f7fe700 1 --2- 172.21.15.82:0/508108190 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5579fc18cc40 0x5579fc18d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:49.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.718+0000 7ff76e7fc700 1 -- 172.21.15.82:0/508108190 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5579fc18cc40 msgr2=0x5579fc18d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:49.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.718+0000 7ff76e7fc700 1 --2- 172.21.15.82:0/508108190 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5579fc18cc40 0x5579fc18d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:49.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.719+0000 7ff76e7fc700 1 -- 172.21.15.82:0/508108190 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579fc192380 msgr2=0x5579fc192760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:49.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.719+0000 7ff76e7fc700 1 --2- 172.21.15.82:0/508108190 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579fc192380 0x5579fc192760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:49.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.719+0000 7ff76e7fc700 1 -- 172.21.15.82:0/508108190 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5579fbf5e630 con 0x5579fc192ca0 2023-09-23T08:57:49.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.719+0000 7ff76e7fc700 1 --2- 172.21.15.82:0/508108190 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5579fc192ca0 0x5579fc18c700 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff7640987d0 tx=0x7ff764010760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ecdcde4cfd9d6e5b server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:49.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.719+0000 7ff7557fa700 1 -- 172.21.15.82:0/508108190 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff764098ad0 con 0x5579fc192ca0 2023-09-23T08:57:49.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.719+0000 7ff7557fa700 1 -- 172.21.15.82:0/508108190 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff76409c900 con 0x5579fc192ca0 2023-09-23T08:57:49.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.719+0000 7ff7557fa700 1 -- 172.21.15.82:0/508108190 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7640a06b0 con 0x5579fc192ca0 2023-09-23T08:57:49.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.720+0000 7ff788cf0b80 1 -- 172.21.15.82:0/508108190 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5579fc192ca0 msgr2=0x5579fc18c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:49.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.720+0000 7ff788cf0b80 1 --2- 172.21.15.82:0/508108190 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5579fc192ca0 0x5579fc18c700 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff7640987d0 tx=0x7ff764010760 comp rx=0 tx=0).stop 2023-09-23T08:57:49.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.720+0000 7ff788cf0b80 1 -- 172.21.15.82:0/508108190 shutdown_connections 2023-09-23T08:57:49.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.720+0000 7ff788cf0b80 1 --2- 172.21.15.82:0/508108190 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5579fc18cc40 0x5579fc18d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:49.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.720+0000 7ff788cf0b80 1 --2- 172.21.15.82:0/508108190 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579fc192380 0x5579fc192760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:49.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.720+0000 7ff788cf0b80 1 --2- 172.21.15.82:0/508108190 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5579fc192ca0 0x5579fc18c700 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:49.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.720+0000 7ff788cf0b80 1 -- 172.21.15.82:0/508108190 >> 172.21.15.82:0/508108190 conn(0x5579fc1010e0 msgr2=0x5579fc187410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:49.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.720+0000 7ff788cf0b80 1 -- 172.21.15.82:0/508108190 shutdown_connections 2023-09-23T08:57:49.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.720+0000 7ff788cf0b80 1 -- 172.21.15.82:0/508108190 wait complete. 2023-09-23T08:57:49.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.721+0000 7ff788cf0b80 1 -- start start 2023-09-23T08:57:49.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.721+0000 7ff788cf0b80 1 Processor -- start 2023-09-23T08:57:49.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.722+0000 7ff788cf0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5579fc18cc40 0x5579fc198c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:49.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.722+0000 7ff788cf0b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5579fc192380 0x5579fc195ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:49.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.722+0000 7ff788cf0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579fc192ca0 0x5579fc196600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:49.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.722+0000 7ff788cf0b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579fc0de990 con 0x5579fc192ca0 2023-09-23T08:57:49.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.722+0000 7ff788cf0b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579fc07cbb0 con 0x5579fc18cc40 2023-09-23T08:57:49.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.722+0000 7ff788cf0b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579fc07c8b0 con 0x5579fc192380 2023-09-23T08:57:49.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.722+0000 7ff788cf0b80 10 client.0 _ll_register_callbacks cb 0x5579fbfc6a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T08:57:49.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.722+0000 7ff76f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579fc192ca0 0x5579fc196600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:49.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.723+0000 7ff76f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579fc192ca0 0x5579fc196600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37186/0 (socket says 172.21.15.82:37186) 2023-09-23T08:57:49.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.723+0000 7ff76f7fe700 1 -- 172.21.15.82:0/651174213 learned_addr learned my addr 172.21.15.82:0/651174213 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:57:49.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.723+0000 7ff76e7fc700 1 --2- 172.21.15.82:0/651174213 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5579fc192380 0x5579fc195ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:49.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.723+0000 7ff76effd700 1 --2- 172.21.15.82:0/651174213 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5579fc18cc40 0x5579fc198c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:49.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.723+0000 7ff76f7fe700 1 -- 172.21.15.82:0/651174213 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5579fc192380 msgr2=0x5579fc195ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:49.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.723+0000 7ff76f7fe700 1 --2- 172.21.15.82:0/651174213 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5579fc192380 0x5579fc195ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:49.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.723+0000 7ff76f7fe700 1 -- 172.21.15.82:0/651174213 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5579fc18cc40 msgr2=0x5579fc198c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:49.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.723+0000 7ff76f7fe700 1 --2- 172.21.15.82:0/651174213 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5579fc18cc40 0x5579fc198c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:49.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.723+0000 7ff76f7fe700 1 -- 172.21.15.82:0/651174213 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7701a5910 con 0x5579fc192ca0 2023-09-23T08:57:49.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.723+0000 7ff76f7fe700 1 --2- 172.21.15.82:0/651174213 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579fc192ca0 0x5579fc196600 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7ff768009ed0 tx=0x7ff768004320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f21e5af385542c2 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:49.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.723+0000 7ff752ff5700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T08:57:49.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.724+0000 7ff752ff5700 1 -- 172.21.15.82:0/651174213 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff768004930 con 0x5579fc192ca0 2023-09-23T08:57:49.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.724+0000 7ff788cf0b80 1 -- 172.21.15.82:0/651174213 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5579fc15c1c0 con 0x5579fc192ca0 2023-09-23T08:57:49.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.724+0000 7ff752ff5700 1 -- 172.21.15.82:0/651174213 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7ff768007910 con 0x5579fc192ca0 2023-09-23T08:57:49.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.724+0000 7ff752ff5700 1 -- 172.21.15.82:0/651174213 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff768003ab0 con 0x5579fc192ca0 2023-09-23T08:57:49.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.724+0000 7ff788cf0b80 10 client.15822 fetch_fsmap learned FSMap version 30 2023-09-23T08:57:49.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.724+0000 7ff788cf0b80 1 -- 172.21.15.82:0/651174213 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x5579fbf0ade0 con 0x5579fc192ca0 2023-09-23T08:57:49.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.724+0000 7ff752ff5700 1 -- 172.21.15.82:0/651174213 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5579fc15c1c0 con 0x5579fc192ca0 2023-09-23T08:57:49.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.724+0000 7ff752ff5700 1 -- 172.21.15.82:0/651174213 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 30) v1 ==== 7898+0+0 (secure 0 0 0) 0x7ff768014040 con 0x5579fc192ca0 2023-09-23T08:57:49.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.725+0000 7ff788cf0b80 10 client.15822 fetch_fsmap finished waiting for FSMap version 30 2023-09-23T08:57:49.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.725+0000 7ff788cf0b80 10 client.15822 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2023-09-23T08:57:49.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.725+0000 7ff788cf0b80 20 client.15822 populate_metadata read hostname 'smithi082' 2023-09-23T08:57:49.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.725+0000 7ff788cf0b80 1 --2- 172.21.15.82:0/651174213 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x5579fc1aef60 0x5579fc1b1380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:49.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.725+0000 7ff788cf0b80 4 client.15822 mds_command: new command op to 24515 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T08:57:49.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.725+0000 7ff788cf0b80 1 -- 172.21.15.82:0/651174213 --> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5579fc084ba0 con 0x5579fc1aef60 2023-09-23T08:57:49.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.725+0000 7ff76effd700 1 --2- 172.21.15.82:0/651174213 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x5579fc1aef60 0x5579fc1b1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:49.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.726+0000 7ff76effd700 1 --2- 172.21.15.82:0/651174213 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x5579fc1aef60 0x5579fc1b1380 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=e96ffdd7494826bb server_cookie=c73770387476b6ab in_seq=0 out_seq=0 2023-09-23T08:57:49.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.726+0000 7ff752ff5700 10 client.15822 ms_handle_connect on v2:172.21.15.135:6836/2655304858 2023-09-23T08:57:49.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.727+0000 7ff752ff5700 1 -- 172.21.15.82:0/651174213 <== mds.3 v2:172.21.15.135:6836/2655304858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5579fc084ba0 con 0x5579fc1aef60 2023-09-23T08:57:49.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.727+0000 7ff752ff5700 10 client.15822 handle_command_reply: tid=0 2023-09-23T08:57:49.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.727+0000 7ff788cf0b80 1 client.15822 shutdown 2023-09-23T08:57:49.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.727+0000 7ff788cf0b80 1 -- 172.21.15.82:0/651174213 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579fc192ca0 msgr2=0x5579fc196600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:49.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.727+0000 7ff788cf0b80 1 --2- 172.21.15.82:0/651174213 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579fc192ca0 0x5579fc196600 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7ff768009ed0 tx=0x7ff768004320 comp rx=0 tx=0).stop 2023-09-23T08:57:49.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.727+0000 7ff788cf0b80 1 -- 172.21.15.82:0/651174213 shutdown_connections 2023-09-23T08:57:49.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.727+0000 7ff788cf0b80 1 --2- 172.21.15.82:0/651174213 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579fc192ca0 0x5579fc196600 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:49.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.727+0000 7ff788cf0b80 1 --2- 172.21.15.82:0/651174213 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5579fc18cc40 0x5579fc198c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:49.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.727+0000 7ff788cf0b80 1 --2- 172.21.15.82:0/651174213 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x5579fc1aef60 0x5579fc1b1380 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:49.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.727+0000 7ff788cf0b80 1 --2- 172.21.15.82:0/651174213 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5579fc192380 0x5579fc195ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:49.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.727+0000 7ff788cf0b80 1 -- 172.21.15.82:0/651174213 >> 172.21.15.82:0/651174213 conn(0x5579fc1010e0 msgr2=0x5579fc181b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:49.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.727+0000 7ff752ff5700 0 client.15822 ms_handle_reset on v2:172.21.15.135:6836/2655304858 2023-09-23T08:57:49.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.727+0000 7ff788cf0b80 1 -- 172.21.15.82:0/651174213 shutdown_connections 2023-09-23T08:57:49.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.727+0000 7ff788cf0b80 1 -- 172.21.15.82:0/651174213 wait complete. 2023-09-23T08:57:49.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.727+0000 7ff788cf0b80 20 client.15822 trim_cache size 0 max 16384 2023-09-23T08:57:49.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.741+0000 7ff788cf0b80 1 Processor -- start 2023-09-23T08:57:49.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.741+0000 7ff788cf0b80 1 -- start start 2023-09-23T08:57:49.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.741+0000 7ff788cf0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579fc18cc40 0x5579fc18c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:49.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.741+0000 7ff788cf0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5579fc192380 0x5579fc18fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:49.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.741+0000 7ff788cf0b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5579fc192ca0 0x5579fc190530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:49.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.741+0000 7ff788cf0b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579fbf60920 con 0x5579fc18cc40 2023-09-23T08:57:49.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.741+0000 7ff788cf0b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579fc1885d0 con 0x5579fc192380 2023-09-23T08:57:49.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.741+0000 7ff788cf0b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579fc183810 con 0x5579fc192ca0 2023-09-23T08:57:49.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.741+0000 7ff76effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579fc18cc40 0x5579fc18c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:49.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.741+0000 7ff76effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579fc18cc40 0x5579fc18c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37198/0 (socket says 172.21.15.82:37198) 2023-09-23T08:57:49.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.741+0000 7ff76effd700 1 -- 172.21.15.82:0/3093423751 learned_addr learned my addr 172.21.15.82:0/3093423751 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:57:49.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.742+0000 7ff76e7fc700 1 --2- 172.21.15.82:0/3093423751 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5579fc192380 0x5579fc18fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:49.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.742+0000 7ff76f7fe700 1 --2- 172.21.15.82:0/3093423751 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5579fc192ca0 0x5579fc190530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:49.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.742+0000 7ff76effd700 1 -- 172.21.15.82:0/3093423751 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5579fc192ca0 msgr2=0x5579fc190530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:49.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.742+0000 7ff76effd700 1 --2- 172.21.15.82:0/3093423751 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5579fc192ca0 0x5579fc190530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:49.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.742+0000 7ff76effd700 1 -- 172.21.15.82:0/3093423751 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5579fc192380 msgr2=0x5579fc18fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:49.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.742+0000 7ff76effd700 1 --2- 172.21.15.82:0/3093423751 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5579fc192380 0x5579fc18fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:49.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.742+0000 7ff76effd700 1 -- 172.21.15.82:0/3093423751 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5579fbef3c60 con 0x5579fc18cc40 2023-09-23T08:57:49.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.742+0000 7ff76f7fe700 1 --2- 172.21.15.82:0/3093423751 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5579fc192ca0 0x5579fc190530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T08:57:49.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.742+0000 7ff76effd700 1 --2- 172.21.15.82:0/3093423751 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579fc18cc40 0x5579fc18c700 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7ff7600098e0 tx=0x7ff760020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14c2146cd08e0574 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:49.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.742+0000 7ff755ffb700 1 -- 172.21.15.82:0/3093423751 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff76000be30 con 0x5579fc18cc40 2023-09-23T08:57:49.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.743+0000 7ff755ffb700 1 -- 172.21.15.82:0/3093423751 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff76001e040 con 0x5579fc18cc40 2023-09-23T08:57:49.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.743+0000 7ff755ffb700 1 -- 172.21.15.82:0/3093423751 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff760004500 con 0x5579fc18cc40 2023-09-23T08:57:49.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.743+0000 7ff788cf0b80 1 -- 172.21.15.82:0/3093423751 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579fc18cc40 msgr2=0x5579fc18c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:49.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.743+0000 7ff788cf0b80 1 --2- 172.21.15.82:0/3093423751 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579fc18cc40 0x5579fc18c700 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7ff7600098e0 tx=0x7ff760020000 comp rx=0 tx=0).stop 2023-09-23T08:57:49.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.743+0000 7ff788cf0b80 1 -- 172.21.15.82:0/3093423751 shutdown_connections 2023-09-23T08:57:49.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.743+0000 7ff788cf0b80 1 --2- 172.21.15.82:0/3093423751 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5579fc192ca0 0x5579fc190530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:49.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.743+0000 7ff788cf0b80 1 --2- 172.21.15.82:0/3093423751 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579fc18cc40 0x5579fc18c700 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:49.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.743+0000 7ff788cf0b80 1 --2- 172.21.15.82:0/3093423751 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5579fc192380 0x5579fc18fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:49.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.743+0000 7ff788cf0b80 1 -- 172.21.15.82:0/3093423751 >> 172.21.15.82:0/3093423751 conn(0x5579fc1010e0 msgr2=0x5579fc1ab160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:49.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.744+0000 7ff788cf0b80 1 -- 172.21.15.82:0/3093423751 shutdown_connections 2023-09-23T08:57:49.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.744+0000 7ff788cf0b80 1 -- 172.21.15.82:0/3093423751 wait complete. 2023-09-23T08:57:49.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.744+0000 7ff788cf0b80 1 -- start start 2023-09-23T08:57:49.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.744+0000 7ff788cf0b80 1 Processor -- start 2023-09-23T08:57:49.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.745+0000 7ff788cf0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5579fc18cc40 0x5579fc18f300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:49.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.745+0000 7ff788cf0b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5579fc192380 0x5579fc18dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:49.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.745+0000 7ff788cf0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579fc192ca0 0x5579fc18e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:49.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.745+0000 7ff788cf0b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579fc18fa40 con 0x5579fc192ca0 2023-09-23T08:57:49.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.745+0000 7ff788cf0b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579fc18fbb0 con 0x5579fc18cc40 2023-09-23T08:57:49.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.745+0000 7ff788cf0b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579fc18e820 con 0x5579fc192380 2023-09-23T08:57:49.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.745+0000 7ff788cf0b80 10 client.0 _ll_register_callbacks cb 0x7ff7680097e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T08:57:49.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.745+0000 7ff76f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579fc192ca0 0x5579fc18e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:49.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.745+0000 7ff76effd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5579fc18cc40 0x5579fc18f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:49.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.745+0000 7ff76effd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5579fc18cc40 0x5579fc18f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:37156/0 (socket says 172.21.15.82:37156) 2023-09-23T08:57:49.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.745+0000 7ff76f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579fc192ca0 0x5579fc18e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37204/0 (socket says 172.21.15.82:37204) 2023-09-23T08:57:49.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.745+0000 7ff76effd700 1 -- 172.21.15.82:0/2654481748 learned_addr learned my addr 172.21.15.82:0/2654481748 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:57:49.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.745+0000 7ff76e7fc700 1 --2- 172.21.15.82:0/2654481748 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5579fc192380 0x5579fc18dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:49.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.746+0000 7ff76f7fe700 1 -- 172.21.15.82:0/2654481748 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5579fc192380 msgr2=0x5579fc18dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:49.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.746+0000 7ff76f7fe700 1 --2- 172.21.15.82:0/2654481748 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5579fc192380 0x5579fc18dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:49.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.746+0000 7ff76f7fe700 1 -- 172.21.15.82:0/2654481748 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5579fc18cc40 msgr2=0x5579fc18f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:49.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.746+0000 7ff76f7fe700 1 --2- 172.21.15.82:0/2654481748 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5579fc18cc40 0x5579fc18f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:49.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.746+0000 7ff76f7fe700 1 -- 172.21.15.82:0/2654481748 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff77010e060 con 0x5579fc192ca0 2023-09-23T08:57:49.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.746+0000 7ff76effd700 1 --2- 172.21.15.82:0/2654481748 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5579fc18cc40 0x5579fc18f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T08:57:49.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.746+0000 7ff76f7fe700 1 --2- 172.21.15.82:0/2654481748 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579fc192ca0 0x5579fc18e2e0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7ff768016d30 tx=0x7ff7680095f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7801dce3a4950e4 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:49.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.746+0000 7ff752ff5700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T08:57:49.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.746+0000 7ff752ff5700 1 -- 172.21.15.82:0/2654481748 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff768004e00 con 0x5579fc192ca0 2023-09-23T08:57:49.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.746+0000 7ff752ff5700 1 -- 172.21.15.82:0/2654481748 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7ff768016460 con 0x5579fc192ca0 2023-09-23T08:57:49.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.746+0000 7ff788cf0b80 1 -- 172.21.15.82:0/2654481748 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5579fc17f8b0 con 0x5579fc192ca0 2023-09-23T08:57:49.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.747+0000 7ff752ff5700 1 -- 172.21.15.82:0/2654481748 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff768016620 con 0x5579fc192ca0 2023-09-23T08:57:49.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.747+0000 7ff788cf0b80 10 client.15828 fetch_fsmap learned FSMap version 30 2023-09-23T08:57:49.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.747+0000 7ff788cf0b80 1 -- 172.21.15.82:0/2654481748 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x5579fbf31250 con 0x5579fc192ca0 2023-09-23T08:57:49.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.747+0000 7ff752ff5700 1 -- 172.21.15.82:0/2654481748 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5579fc17f8b0 con 0x5579fc192ca0 2023-09-23T08:57:49.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.747+0000 7ff752ff5700 1 -- 172.21.15.82:0/2654481748 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 30) v1 ==== 7898+0+0 (secure 0 0 0) 0x7ff768014070 con 0x5579fc192ca0 2023-09-23T08:57:49.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.747+0000 7ff788cf0b80 10 client.15828 fetch_fsmap finished waiting for FSMap version 30 2023-09-23T08:57:49.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.747+0000 7ff788cf0b80 10 client.15828 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2023-09-23T08:57:49.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.747+0000 7ff788cf0b80 20 client.15828 populate_metadata read hostname 'smithi082' 2023-09-23T08:57:49.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.747+0000 7ff788cf0b80 1 --2- 172.21.15.82:0/2654481748 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x5579fc203da0 0x5579fc206190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:49.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.747+0000 7ff788cf0b80 4 client.15828 mds_command: new command op to 24515 tid=0[{"prefix": "damage ls"}] 2023-09-23T08:57:49.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.747+0000 7ff788cf0b80 1 -- 172.21.15.82:0/2654481748 --> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5579fc0d7970 con 0x5579fc203da0 2023-09-23T08:57:49.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.748+0000 7ff76effd700 1 --2- 172.21.15.82:0/2654481748 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x5579fc203da0 0x5579fc206190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:49.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.749+0000 7ff76effd700 1 --2- 172.21.15.82:0/2654481748 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x5579fc203da0 0x5579fc206190 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=7621c5946ddfdbd8 server_cookie=bfe56891dcd5c23b in_seq=0 out_seq=0 2023-09-23T08:57:49.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.749+0000 7ff752ff5700 10 client.15828 ms_handle_connect on v2:172.21.15.135:6836/2655304858 2023-09-23T08:57:49.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.749+0000 7ff752ff5700 1 -- 172.21.15.82:0/2654481748 <== mds.3 v2:172.21.15.135:6836/2655304858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5579fc0d7970 con 0x5579fc203da0 2023-09-23T08:57:49.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.749+0000 7ff752ff5700 10 client.15828 handle_command_reply: tid=0 2023-09-23T08:57:49.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.749+0000 7ff788cf0b80 1 client.15828 shutdown 2023-09-23T08:57:49.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.749+0000 7ff788cf0b80 1 -- 172.21.15.82:0/2654481748 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579fc192ca0 msgr2=0x5579fc18e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:49.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.749+0000 7ff788cf0b80 1 --2- 172.21.15.82:0/2654481748 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579fc192ca0 0x5579fc18e2e0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7ff768016d30 tx=0x7ff7680095f0 comp rx=0 tx=0).stop 2023-09-23T08:57:49.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.749+0000 7ff788cf0b80 1 -- 172.21.15.82:0/2654481748 shutdown_connections 2023-09-23T08:57:49.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.749+0000 7ff788cf0b80 1 --2- 172.21.15.82:0/2654481748 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579fc192ca0 0x5579fc18e2e0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:49.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.749+0000 7ff788cf0b80 1 --2- 172.21.15.82:0/2654481748 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5579fc18cc40 0x5579fc18f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:49.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.749+0000 7ff788cf0b80 1 --2- 172.21.15.82:0/2654481748 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x5579fc203da0 0x5579fc206190 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:49.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.749+0000 7ff788cf0b80 1 --2- 172.21.15.82:0/2654481748 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5579fc192380 0x5579fc18dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:49.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.749+0000 7ff752ff5700 0 client.15828 ms_handle_reset on v2:172.21.15.135:6836/2655304858 2023-09-23T08:57:49.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.749+0000 7ff788cf0b80 1 -- 172.21.15.82:0/2654481748 >> 172.21.15.82:0/2654481748 conn(0x5579fc1010e0 msgr2=0x5579fc18fff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:49.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.749+0000 7ff788cf0b80 1 -- 172.21.15.82:0/2654481748 shutdown_connections 2023-09-23T08:57:49.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.749+0000 7ff788cf0b80 1 -- 172.21.15.82:0/2654481748 wait complete. 2023-09-23T08:57:49.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.750+0000 7ff788cf0b80 20 client.15828 trim_cache size 0 max 16384 2023-09-23T08:57:49.759 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2023-09-23T08:57:49.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.750+0000 7ff7753ff700 1 -- 172.21.15.82:0/4252925036 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7ff7580a0260 msgr2=0x7ff7580a2720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:49.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.750+0000 7ff7753ff700 1 --2- 172.21.15.82:0/4252925036 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7ff7580a0260 0x7ff7580a2720 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff76000b5c0 tx=0x7ff760005fb0 comp rx=0 tx=0).stop 2023-09-23T08:57:49.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.750+0000 7ff7753ff700 1 -- 172.21.15.82:0/4252925036 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff770101250 msgr2=0x7ff77019eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:49.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.750+0000 7ff7753ff700 1 --2- 172.21.15.82:0/4252925036 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff770101250 0x7ff77019eed0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7ff76400d950 tx=0x7ff76400dc60 comp rx=0 tx=0).stop 2023-09-23T08:57:49.760 INFO:teuthology.orchestra.run.smithi082.stderr:1600000 of 50000000 tuples (3%) done (elapsed 24.50 s, remaining 741.00 s) 2023-09-23T08:57:49.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.750+0000 7ff7753ff700 1 -- 172.21.15.82:0/4252925036 shutdown_connections 2023-09-23T08:57:49.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.750+0000 7ff7753ff700 1 --2- 172.21.15.82:0/4252925036 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7ff7580a0260 0x7ff7580a2720 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:49.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.750+0000 7ff7753ff700 1 --2- 172.21.15.82:0/4252925036 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7701068a0 0x7ff770198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:49.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.750+0000 7ff7753ff700 1 --2- 172.21.15.82:0/4252925036 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff770100890 0x7ff77019e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:49.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.750+0000 7ff7753ff700 1 --2- 172.21.15.82:0/4252925036 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff770101250 0x7ff77019eed0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:49.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.750+0000 7ff7753ff700 1 -- 172.21.15.82:0/4252925036 >> 172.21.15.82:0/4252925036 conn(0x7ff7700fc380 msgr2=0x7ff77010bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:49.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.751+0000 7ff7753ff700 1 -- 172.21.15.82:0/4252925036 shutdown_connections 2023-09-23T08:57:49.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:49.751+0000 7ff7753ff700 1 -- 172.21.15.82:0/4252925036 wait complete. 2023-09-23T08:57:49.774 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:57:49 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/546410865' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T08:57:49.778 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-09-23T08:57:49.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:57:49 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/546410865' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T08:57:49.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:57:49 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/546410865' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T08:57:50.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.006+0000 7f042f39d700 1 -- 172.21.15.82:0/407714506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0428068440 msgr2=0x7f042810d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:50.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.006+0000 7f042f39d700 1 --2- 172.21.15.82:0/407714506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0428068440 0x7f042810d540 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f042000b0a0 tx=0x7f042000b3b0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.006+0000 7f042f39d700 1 -- 172.21.15.82:0/407714506 shutdown_connections 2023-09-23T08:57:50.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.006+0000 7f042f39d700 1 --2- 172.21.15.82:0/407714506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0428068440 0x7f042810d540 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.006+0000 7f042f39d700 1 --2- 172.21.15.82:0/407714506 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0428106780 0x7f0428106b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.006+0000 7f042f39d700 1 --2- 172.21.15.82:0/407714506 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0428067a80 0x7f0428067f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.006+0000 7f042f39d700 1 -- 172.21.15.82:0/407714506 >> 172.21.15.82:0/407714506 conn(0x7f04280750e0 msgr2=0x7f04280754f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:50.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.007+0000 7f042f39d700 1 -- 172.21.15.82:0/407714506 shutdown_connections 2023-09-23T08:57:50.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.007+0000 7f042f39d700 1 -- 172.21.15.82:0/407714506 wait complete. 2023-09-23T08:57:50.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.008+0000 7f042f39d700 1 Processor -- start 2023-09-23T08:57:50.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.008+0000 7f042f39d700 1 -- start start 2023-09-23T08:57:50.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.008+0000 7f042f39d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0428067a80 0x7f042819e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:50.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.008+0000 7f042f39d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0428068440 0x7f042819ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:50.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.008+0000 7f042f39d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0428106780 0x7f0428198730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:50.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.008+0000 7f042f39d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0428198da0 con 0x7f0428106780 2023-09-23T08:57:50.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.008+0000 7f042f39d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0428198f10 con 0x7f0428067a80 2023-09-23T08:57:50.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.008+0000 7f042f39d700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04281990d0 con 0x7f0428068440 2023-09-23T08:57:50.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.009+0000 7f042e39b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0428067a80 0x7f042819e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:50.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.009+0000 7f042e39b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0428067a80 0x7f042819e6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:37170/0 (socket says 172.21.15.82:37170) 2023-09-23T08:57:50.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.009+0000 7f042e39b700 1 -- 172.21.15.82:0/2487877348 learned_addr learned my addr 172.21.15.82:0/2487877348 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:57:50.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.009+0000 7f042eb9c700 1 --2- 172.21.15.82:0/2487877348 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0428106780 0x7f0428198730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:50.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.009+0000 7f042db9a700 1 --2- 172.21.15.82:0/2487877348 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0428068440 0x7f042819ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:50.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.009+0000 7f042eb9c700 1 -- 172.21.15.82:0/2487877348 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0428068440 msgr2=0x7f042819ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:50.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.009+0000 7f042eb9c700 1 --2- 172.21.15.82:0/2487877348 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0428068440 0x7f042819ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.009+0000 7f042eb9c700 1 -- 172.21.15.82:0/2487877348 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0428067a80 msgr2=0x7f042819e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:50.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.009+0000 7f042eb9c700 1 --2- 172.21.15.82:0/2487877348 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0428067a80 0x7f042819e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.009+0000 7f042eb9c700 1 -- 172.21.15.82:0/2487877348 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0420009d00 con 0x7f0428106780 2023-09-23T08:57:50.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.009+0000 7f042eb9c700 1 --2- 172.21.15.82:0/2487877348 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0428106780 0x7f0428198730 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f0420009fd0 tx=0x7f042000bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:50.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.010+0000 7f041f7fe700 1 -- 172.21.15.82:0/2487877348 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f042000e040 con 0x7f0428106780 2023-09-23T08:57:50.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.010+0000 7f041f7fe700 1 -- 172.21.15.82:0/2487877348 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0420009480 con 0x7f0428106780 2023-09-23T08:57:50.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.010+0000 7f042f39d700 1 -- 172.21.15.82:0/2487877348 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0428199350 con 0x7f0428106780 2023-09-23T08:57:50.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.010+0000 7f041f7fe700 1 -- 172.21.15.82:0/2487877348 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04200052a0 con 0x7f0428106780 2023-09-23T08:57:50.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.010+0000 7f042f39d700 1 -- 172.21.15.82:0/2487877348 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04281a56b0 con 0x7f0428106780 2023-09-23T08:57:50.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.013+0000 7f041f7fe700 1 -- 172.21.15.82:0/2487877348 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) v1 ==== 134904+0+0 (secure 0 0 0) 0x7f042001d480 con 0x7f0428106780 2023-09-23T08:57:50.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.015+0000 7f0443e36b80 1 Processor -- start 2023-09-23T08:57:50.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.015+0000 7f0443e36b80 1 -- start start 2023-09-23T08:57:50.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.015+0000 7f041f7fe700 1 --2- 172.21.15.82:0/2487877348 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f04140a0300 0x7f04140a27c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:50.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.015+0000 7f041f7fe700 1 -- 172.21.15.82:0/2487877348 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f04200cc850 con 0x7f0428106780 2023-09-23T08:57:50.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.016+0000 7f0443e36b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ac0a0f500 0x560ac0a0f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:50.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.016+0000 7f0443e36b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560ac0a0fe20 0x560ac0a09700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:50.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.016+0000 7f0443e36b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560ac0a09c40 0x560ac0a0a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:50.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.016+0000 7f0443e36b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ac09717b0 con 0x560ac0a0f500 2023-09-23T08:57:50.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.016+0000 7f0443e36b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ac0962780 con 0x560ac0a09c40 2023-09-23T08:57:50.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.016+0000 7f0443e36b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ac09600a0 con 0x560ac0a0fe20 2023-09-23T08:57:50.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.016+0000 7f042db9a700 1 --2- 172.21.15.82:0/2487877348 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f04140a0300 0x7f04140a27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:50.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.016+0000 7f042db9a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560ac0a0fe20 0x560ac0a09700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:50.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.016+0000 7f042db9a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560ac0a0fe20 0x560ac0a09700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:37924/0 (socket says 172.21.15.82:37924) 2023-09-23T08:57:50.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.016+0000 7f042db9a700 1 -- 172.21.15.82:0/2216690961 learned_addr learned my addr 172.21.15.82:0/2216690961 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:57:50.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.016+0000 7f042e39b700 1 --2- 172.21.15.82:0/2216690961 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ac0a0f500 0x560ac0a0f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:50.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.017+0000 7f042e39b700 1 -- 172.21.15.82:0/2216690961 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560ac0a0fe20 msgr2=0x560ac0a09700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:50.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.017+0000 7f042e39b700 1 --2- 172.21.15.82:0/2216690961 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560ac0a0fe20 0x560ac0a09700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.017+0000 7f042e39b700 1 -- 172.21.15.82:0/2216690961 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560ac0a09c40 msgr2=0x560ac0a0a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:50.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.017+0000 7f042eb9c700 1 --2- 172.21.15.82:0/2216690961 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560ac0a09c40 0x560ac0a0a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:50.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.017+0000 7f042e39b700 1 --2- 172.21.15.82:0/2216690961 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560ac0a09c40 0x560ac0a0a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.017+0000 7f042e39b700 1 -- 172.21.15.82:0/2216690961 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560ac07db630 con 0x560ac0a0f500 2023-09-23T08:57:50.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.017+0000 7f042eb9c700 1 --2- 172.21.15.82:0/2216690961 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560ac0a09c40 0x560ac0a0a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T08:57:50.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.017+0000 7f042db9a700 1 --2- 172.21.15.82:0/2487877348 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f04140a0300 0x7f04140a27c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f04180129e0 tx=0x7f041800bbf0 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:50.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.017+0000 7f042e39b700 1 --2- 172.21.15.82:0/2216690961 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ac0a0f500 0x560ac0a0f8e0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f0424009c90 tx=0x7f0424011440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cede2d8f7daf9d4 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:50.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.017+0000 7f041cbfe700 1 -- 172.21.15.82:0/2216690961 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0424011d20 con 0x560ac0a0f500 2023-09-23T08:57:50.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.017+0000 7f041cbfe700 1 -- 172.21.15.82:0/2216690961 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0424011e80 con 0x560ac0a0f500 2023-09-23T08:57:50.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.017+0000 7f041cbfe700 1 -- 172.21.15.82:0/2216690961 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0424005020 con 0x560ac0a0f500 2023-09-23T08:57:50.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.018+0000 7f0443e36b80 1 -- 172.21.15.82:0/2216690961 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ac0a0f500 msgr2=0x560ac0a0f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:50.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.018+0000 7f0443e36b80 1 --2- 172.21.15.82:0/2216690961 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ac0a0f500 0x560ac0a0f8e0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f0424009c90 tx=0x7f0424011440 comp rx=0 tx=0).stop 2023-09-23T08:57:50.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.018+0000 7f0443e36b80 1 -- 172.21.15.82:0/2216690961 shutdown_connections 2023-09-23T08:57:50.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.018+0000 7f0443e36b80 1 --2- 172.21.15.82:0/2216690961 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560ac0a09c40 0x560ac0a0a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.018+0000 7f0443e36b80 1 --2- 172.21.15.82:0/2216690961 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ac0a0f500 0x560ac0a0f8e0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.018+0000 7f0443e36b80 1 --2- 172.21.15.82:0/2216690961 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560ac0a0fe20 0x560ac0a09700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.018+0000 7f0443e36b80 1 -- 172.21.15.82:0/2216690961 >> 172.21.15.82:0/2216690961 conn(0x560ac097e0e0 msgr2=0x560ac0a04940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:50.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.018+0000 7f0443e36b80 1 -- 172.21.15.82:0/2216690961 shutdown_connections 2023-09-23T08:57:50.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.018+0000 7f0443e36b80 1 -- 172.21.15.82:0/2216690961 wait complete. 2023-09-23T08:57:50.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.019+0000 7f0443e36b80 1 -- start start 2023-09-23T08:57:50.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.019+0000 7f0443e36b80 1 Processor -- start 2023-09-23T08:57:50.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.019+0000 7f0443e36b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ac0a09c40 0x560ac0a15e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:50.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.019+0000 7f0443e36b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560ac0a0f500 0x560ac0a13020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:50.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.020+0000 7f0443e36b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560ac0a0fe20 0x560ac0a13760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:50.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.020+0000 7f0443e36b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ac095b990 con 0x560ac0a09c40 2023-09-23T08:57:50.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.020+0000 7f0443e36b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ac08f9bb0 con 0x560ac0a0f500 2023-09-23T08:57:50.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.020+0000 7f0443e36b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ac08f98b0 con 0x560ac0a0fe20 2023-09-23T08:57:50.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.020+0000 7f0443e36b80 10 client.0 _ll_register_callbacks cb 0x560ac0843a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T08:57:50.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.020+0000 7f042e39b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ac0a09c40 0x560ac0a15e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:50.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.020+0000 7f042e39b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ac0a09c40 0x560ac0a15e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37242/0 (socket says 172.21.15.82:37242) 2023-09-23T08:57:50.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.020+0000 7f042e39b700 1 -- 172.21.15.82:0/2704950876 learned_addr learned my addr 172.21.15.82:0/2704950876 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:57:50.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.020+0000 7f042db9a700 1 --2- 172.21.15.82:0/2704950876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560ac0a0f500 0x560ac0a13020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:50.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.020+0000 7f042eb9c700 1 --2- 172.21.15.82:0/2704950876 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560ac0a0fe20 0x560ac0a13760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:50.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.020+0000 7f042e39b700 1 -- 172.21.15.82:0/2704950876 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560ac0a0fe20 msgr2=0x560ac0a13760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:50.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.020+0000 7f042e39b700 1 --2- 172.21.15.82:0/2704950876 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560ac0a0fe20 0x560ac0a13760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.020+0000 7f042e39b700 1 -- 172.21.15.82:0/2704950876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560ac0a0f500 msgr2=0x560ac0a13020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:50.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.020+0000 7f042e39b700 1 --2- 172.21.15.82:0/2704950876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560ac0a0f500 0x560ac0a13020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.020+0000 7f042e39b700 1 -- 172.21.15.82:0/2704950876 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0424009970 con 0x560ac0a09c40 2023-09-23T08:57:50.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.021+0000 7f042e39b700 1 --2- 172.21.15.82:0/2704950876 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ac0a09c40 0x560ac0a15e10 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f0424004b00 tx=0x7f0424005ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb0f96e50cbca0db server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:50.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.021+0000 7f0411ffb700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T08:57:50.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.021+0000 7f0411ffb700 1 -- 172.21.15.82:0/2704950876 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0424004360 con 0x560ac0a09c40 2023-09-23T08:57:50.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.021+0000 7f0443e36b80 1 -- 172.21.15.82:0/2704950876 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560ac09d91c0 con 0x560ac0a09c40 2023-09-23T08:57:50.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.021+0000 7f0411ffb700 1 -- 172.21.15.82:0/2704950876 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f04240044c0 con 0x560ac0a09c40 2023-09-23T08:57:50.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.021+0000 7f0411ffb700 1 -- 172.21.15.82:0/2704950876 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0424003680 con 0x560ac0a09c40 2023-09-23T08:57:50.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.021+0000 7f0443e36b80 10 client.15840 fetch_fsmap learned FSMap version 30 2023-09-23T08:57:50.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.021+0000 7f0443e36b80 1 -- 172.21.15.82:0/2704950876 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x560ac0787de0 con 0x560ac0a09c40 2023-09-23T08:57:50.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.022+0000 7f0411ffb700 1 -- 172.21.15.82:0/2704950876 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x560ac09d91c0 con 0x560ac0a09c40 2023-09-23T08:57:50.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.022+0000 7f0411ffb700 1 -- 172.21.15.82:0/2704950876 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 30) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f0424022710 con 0x560ac0a09c40 2023-09-23T08:57:50.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.022+0000 7f0443e36b80 10 client.15840 fetch_fsmap finished waiting for FSMap version 30 2023-09-23T08:57:50.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.022+0000 7f0443e36b80 10 client.15840 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-09-23T08:57:50.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.022+0000 7f0443e36b80 20 client.15840 populate_metadata read hostname 'smithi082' 2023-09-23T08:57:50.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.022+0000 7f0443e36b80 1 --2- 172.21.15.82:0/2704950876 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x560ac0a23720 0x560ac0a25b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:50.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.022+0000 7f0443e36b80 4 client.15840 mds_command: new command op to 24526 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T08:57:50.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.022+0000 7f0443e36b80 1 -- 172.21.15.82:0/2704950876 --> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560ac0901ba0 con 0x560ac0a23720 2023-09-23T08:57:50.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.022+0000 7f042db9a700 1 --2- 172.21.15.82:0/2704950876 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x560ac0a23720 0x560ac0a25b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:50.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.023+0000 7f0411ffb700 10 client.15840 ms_handle_connect on v2:172.21.15.161:6836/43639843 2023-09-23T08:57:50.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.023+0000 7f042db9a700 1 --2- 172.21.15.82:0/2704950876 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x560ac0a23720 0x560ac0a25b40 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=514a2458700bf74 server_cookie=f9746bae2ec53df5 in_seq=0 out_seq=0 2023-09-23T08:57:50.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.024+0000 7f0411ffb700 1 -- 172.21.15.82:0/2704950876 <== mds.2 v2:172.21.15.161:6836/43639843 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x560ac0901ba0 con 0x560ac0a23720 2023-09-23T08:57:50.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.024+0000 7f0411ffb700 10 client.15840 handle_command_reply: tid=0 2023-09-23T08:57:50.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.024+0000 7f0443e36b80 1 client.15840 shutdown 2023-09-23T08:57:50.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.024+0000 7f0443e36b80 1 -- 172.21.15.82:0/2704950876 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ac0a09c40 msgr2=0x560ac0a15e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:50.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.024+0000 7f0443e36b80 1 --2- 172.21.15.82:0/2704950876 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ac0a09c40 0x560ac0a15e10 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f0424004b00 tx=0x7f0424005ce0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.024+0000 7f0443e36b80 1 -- 172.21.15.82:0/2704950876 shutdown_connections 2023-09-23T08:57:50.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.024+0000 7f0443e36b80 1 --2- 172.21.15.82:0/2704950876 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x560ac0a23720 0x560ac0a25b40 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.024+0000 7f0443e36b80 1 --2- 172.21.15.82:0/2704950876 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560ac0a0fe20 0x560ac0a13760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.024+0000 7f0443e36b80 1 --2- 172.21.15.82:0/2704950876 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ac0a09c40 0x560ac0a15e10 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.024+0000 7f0443e36b80 1 --2- 172.21.15.82:0/2704950876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560ac0a0f500 0x560ac0a13020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.024+0000 7f0443e36b80 1 -- 172.21.15.82:0/2704950876 >> 172.21.15.82:0/2704950876 conn(0x560ac097e0e0 msgr2=0x560ac0a086f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:50.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.024+0000 7f0411ffb700 0 client.15840 ms_handle_reset on v2:172.21.15.161:6836/43639843 2023-09-23T08:57:50.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.024+0000 7f0443e36b80 1 -- 172.21.15.82:0/2704950876 shutdown_connections 2023-09-23T08:57:50.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.024+0000 7f0443e36b80 1 -- 172.21.15.82:0/2704950876 wait complete. 2023-09-23T08:57:50.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.024+0000 7f0443e36b80 20 client.15840 trim_cache size 0 max 16384 2023-09-23T08:57:50.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.039+0000 7f0443e36b80 1 Processor -- start 2023-09-23T08:57:50.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.039+0000 7f0443e36b80 1 -- start start 2023-09-23T08:57:50.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.039+0000 7f0443e36b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ac0a09c40 0x560ac0a09700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:50.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.039+0000 7f0443e36b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560ac0a0f500 0x560ac0a0a020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:50.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.039+0000 7f0443e36b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560ac0a0fe20 0x560ac0a1a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:50.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.039+0000 7f0443e36b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ac07dd920 con 0x560ac0a09c40 2023-09-23T08:57:50.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.039+0000 7f0443e36b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ac09ff130 con 0x560ac0a0f500 2023-09-23T08:57:50.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.039+0000 7f0443e36b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ac09fc710 con 0x560ac0a0fe20 2023-09-23T08:57:50.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.039+0000 7f042e39b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ac0a09c40 0x560ac0a09700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:50.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.039+0000 7f042e39b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ac0a09c40 0x560ac0a09700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37254/0 (socket says 172.21.15.82:37254) 2023-09-23T08:57:50.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.040+0000 7f042e39b700 1 -- 172.21.15.82:0/1820287766 learned_addr learned my addr 172.21.15.82:0/1820287766 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:57:50.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.040+0000 7f042eb9c700 1 --2- 172.21.15.82:0/1820287766 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560ac0a0fe20 0x560ac0a1a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:50.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.040+0000 7f042db9a700 1 --2- 172.21.15.82:0/1820287766 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560ac0a0f500 0x560ac0a0a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:50.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.040+0000 7f042e39b700 1 -- 172.21.15.82:0/1820287766 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560ac0a0fe20 msgr2=0x560ac0a1a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:50.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.040+0000 7f042e39b700 1 --2- 172.21.15.82:0/1820287766 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560ac0a0fe20 0x560ac0a1a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.040+0000 7f042e39b700 1 -- 172.21.15.82:0/1820287766 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560ac0a0f500 msgr2=0x560ac0a0a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:50.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.040+0000 7f042e39b700 1 --2- 172.21.15.82:0/1820287766 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560ac0a0f500 0x560ac0a0a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.040+0000 7f042e39b700 1 -- 172.21.15.82:0/1820287766 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560ac0770c60 con 0x560ac0a09c40 2023-09-23T08:57:50.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.040+0000 7f042e39b700 1 --2- 172.21.15.82:0/1820287766 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ac0a09c40 0x560ac0a09700 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f0424011480 tx=0x7f0424005e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5129730f2bdd492f server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:50.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.041+0000 7f041d3ff700 1 -- 172.21.15.82:0/1820287766 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0424004880 con 0x560ac0a09c40 2023-09-23T08:57:50.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.041+0000 7f041d3ff700 1 -- 172.21.15.82:0/1820287766 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0424015070 con 0x560ac0a09c40 2023-09-23T08:57:50.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.041+0000 7f041d3ff700 1 -- 172.21.15.82:0/1820287766 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0424003b10 con 0x560ac0a09c40 2023-09-23T08:57:50.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.041+0000 7f0443e36b80 1 -- 172.21.15.82:0/1820287766 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ac0a09c40 msgr2=0x560ac0a09700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:50.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.041+0000 7f0443e36b80 1 --2- 172.21.15.82:0/1820287766 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ac0a09c40 0x560ac0a09700 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f0424011480 tx=0x7f0424005e00 comp rx=0 tx=0).stop 2023-09-23T08:57:50.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.041+0000 7f0443e36b80 1 -- 172.21.15.82:0/1820287766 shutdown_connections 2023-09-23T08:57:50.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.041+0000 7f0443e36b80 1 --2- 172.21.15.82:0/1820287766 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560ac0a0fe20 0x560ac0a1a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.041+0000 7f0443e36b80 1 --2- 172.21.15.82:0/1820287766 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ac0a09c40 0x560ac0a09700 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.041+0000 7f0443e36b80 1 --2- 172.21.15.82:0/1820287766 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560ac0a0f500 0x560ac0a0a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.041+0000 7f0443e36b80 1 -- 172.21.15.82:0/1820287766 >> 172.21.15.82:0/1820287766 conn(0x560ac097e0e0 msgr2=0x560ac09fe2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:50.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.041+0000 7f0443e36b80 1 -- 172.21.15.82:0/1820287766 shutdown_connections 2023-09-23T08:57:50.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.041+0000 7f0443e36b80 1 -- 172.21.15.82:0/1820287766 wait complete. 2023-09-23T08:57:50.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.042+0000 7f0443e36b80 1 -- start start 2023-09-23T08:57:50.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.042+0000 7f0443e36b80 1 Processor -- start 2023-09-23T08:57:50.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.043+0000 7f0443e36b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560ac0a09c40 0x560ac0a19b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:50.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.043+0000 7f0443e36b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560ac0a0f500 0x560ac0a1a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:50.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.043+0000 7f0443e36b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ac0a0fe20 0x560ac0a76570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:50.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.043+0000 7f0443e36b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ac0a1a840 con 0x560ac0a0fe20 2023-09-23T08:57:50.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.043+0000 7f0443e36b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ac0a1a9b0 con 0x560ac0a09c40 2023-09-23T08:57:50.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.043+0000 7f0443e36b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ac0a76ae0 con 0x560ac0a0f500 2023-09-23T08:57:50.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.043+0000 7f0443e36b80 10 client.0 _ll_register_callbacks cb 0x7f0418012530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T08:57:50.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.043+0000 7f042eb9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ac0a0fe20 0x560ac0a76570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:50.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.043+0000 7f042eb9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ac0a0fe20 0x560ac0a76570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37270/0 (socket says 172.21.15.82:37270) 2023-09-23T08:57:50.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.043+0000 7f042eb9c700 1 -- 172.21.15.82:0/1249894362 learned_addr learned my addr 172.21.15.82:0/1249894362 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:57:50.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.043+0000 7f042e39b700 1 --2- 172.21.15.82:0/1249894362 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560ac0a09c40 0x560ac0a19b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:50.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.043+0000 7f042db9a700 1 --2- 172.21.15.82:0/1249894362 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560ac0a0f500 0x560ac0a1a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:50.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.043+0000 7f042eb9c700 1 -- 172.21.15.82:0/1249894362 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560ac0a0f500 msgr2=0x560ac0a1a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:50.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.043+0000 7f042eb9c700 1 --2- 172.21.15.82:0/1249894362 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560ac0a0f500 0x560ac0a1a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.043+0000 7f042eb9c700 1 -- 172.21.15.82:0/1249894362 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560ac0a09c40 msgr2=0x560ac0a19b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:50.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.043+0000 7f042eb9c700 1 --2- 172.21.15.82:0/1249894362 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560ac0a09c40 0x560ac0a19b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.043+0000 7f042eb9c700 1 -- 172.21.15.82:0/1249894362 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560ac0787de0 con 0x560ac0a0fe20 2023-09-23T08:57:50.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.044+0000 7f042e39b700 1 --2- 172.21.15.82:0/1249894362 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560ac0a09c40 0x560ac0a19b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T08:57:50.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.044+0000 7f042eb9c700 1 --2- 172.21.15.82:0/1249894362 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ac0a0fe20 0x560ac0a76570 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f04200ca5d0 tx=0x7f042000b3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dde828bef1f8f852 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:50.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.044+0000 7f0411ffb700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T08:57:50.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.044+0000 7f0411ffb700 1 -- 172.21.15.82:0/1249894362 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0420024310 con 0x560ac0a0fe20 2023-09-23T08:57:50.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.044+0000 7f0411ffb700 1 -- 172.21.15.82:0/1249894362 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f042009a4d0 con 0x560ac0a0fe20 2023-09-23T08:57:50.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.044+0000 7f0443e36b80 1 -- 172.21.15.82:0/1249894362 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560ac09fc8b0 con 0x560ac0a0fe20 2023-09-23T08:57:50.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.045+0000 7f0411ffb700 1 -- 172.21.15.82:0/1249894362 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0420099dd0 con 0x560ac0a0fe20 2023-09-23T08:57:50.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.045+0000 7f0443e36b80 10 client.15846 fetch_fsmap learned FSMap version 30 2023-09-23T08:57:50.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.045+0000 7f0443e36b80 1 -- 172.21.15.82:0/1249894362 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x560ac07ae250 con 0x560ac0a0fe20 2023-09-23T08:57:50.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.045+0000 7f0411ffb700 1 -- 172.21.15.82:0/1249894362 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x560ac09fc8b0 con 0x560ac0a0fe20 2023-09-23T08:57:50.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.046+0000 7f0411ffb700 1 -- 172.21.15.82:0/1249894362 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 30) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f04200a16c0 con 0x560ac0a0fe20 2023-09-23T08:57:50.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.046+0000 7f0443e36b80 10 client.15846 fetch_fsmap finished waiting for FSMap version 30 2023-09-23T08:57:50.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.046+0000 7f0443e36b80 10 client.15846 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-09-23T08:57:50.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.046+0000 7f0443e36b80 20 client.15846 populate_metadata read hostname 'smithi082' 2023-09-23T08:57:50.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.046+0000 7f0443e36b80 1 --2- 172.21.15.82:0/1249894362 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x560ac0a77fc0 0x560ac0a7a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:50.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.046+0000 7f0443e36b80 4 client.15846 mds_command: new command op to 24526 tid=0[{"prefix": "damage ls"}] 2023-09-23T08:57:50.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.046+0000 7f0443e36b80 1 -- 172.21.15.82:0/1249894362 --> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x560ac0954970 con 0x560ac0a77fc0 2023-09-23T08:57:50.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.046+0000 7f042e39b700 1 --2- 172.21.15.82:0/1249894362 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x560ac0a77fc0 0x560ac0a7a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:50.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.047+0000 7f042e39b700 1 --2- 172.21.15.82:0/1249894362 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x560ac0a77fc0 0x560ac0a7a3e0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5489c91bf1bed368 server_cookie=a63581a46cd15ebb in_seq=0 out_seq=0 2023-09-23T08:57:50.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.047+0000 7f0411ffb700 10 client.15846 ms_handle_connect on v2:172.21.15.161:6836/43639843 2023-09-23T08:57:50.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.047+0000 7f0411ffb700 1 -- 172.21.15.82:0/1249894362 <== mds.2 v2:172.21.15.161:6836/43639843 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x560ac0954970 con 0x560ac0a77fc0 2023-09-23T08:57:50.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.047+0000 7f0411ffb700 10 client.15846 handle_command_reply: tid=0 2023-09-23T08:57:50.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.047+0000 7f0443e36b80 1 client.15846 shutdown 2023-09-23T08:57:50.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.047+0000 7f0443e36b80 1 -- 172.21.15.82:0/1249894362 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ac0a0fe20 msgr2=0x560ac0a76570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:50.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.047+0000 7f0443e36b80 1 --2- 172.21.15.82:0/1249894362 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ac0a0fe20 0x560ac0a76570 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f04200ca5d0 tx=0x7f042000b3b0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.047+0000 7f0443e36b80 1 -- 172.21.15.82:0/1249894362 shutdown_connections 2023-09-23T08:57:50.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.047+0000 7f0443e36b80 1 --2- 172.21.15.82:0/1249894362 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x560ac0a77fc0 0x560ac0a7a3e0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.047+0000 7f0443e36b80 1 --2- 172.21.15.82:0/1249894362 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ac0a0fe20 0x560ac0a76570 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.047+0000 7f0443e36b80 1 --2- 172.21.15.82:0/1249894362 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560ac0a09c40 0x560ac0a19b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.047+0000 7f0411ffb700 0 client.15846 ms_handle_reset on v2:172.21.15.161:6836/43639843 2023-09-23T08:57:50.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.047+0000 7f0443e36b80 1 --2- 172.21.15.82:0/1249894362 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560ac0a0f500 0x560ac0a1a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.047+0000 7f0443e36b80 1 -- 172.21.15.82:0/1249894362 >> 172.21.15.82:0/1249894362 conn(0x560ac097e0e0 msgr2=0x560ac0a0cf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:50.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.048+0000 7f0443e36b80 1 -- 172.21.15.82:0/1249894362 shutdown_connections 2023-09-23T08:57:50.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.048+0000 7f0443e36b80 1 -- 172.21.15.82:0/1249894362 wait complete. 2023-09-23T08:57:50.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.048+0000 7f0443e36b80 20 client.15846 trim_cache size 0 max 16384 2023-09-23T08:57:50.055 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2023-09-23T08:57:50.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.048+0000 7f042f39d700 1 -- 172.21.15.82:0/2487877348 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f04140a0300 msgr2=0x7f04140a27c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:50.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.048+0000 7f042f39d700 1 --2- 172.21.15.82:0/2487877348 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f04140a0300 0x7f04140a27c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f04180129e0 tx=0x7f041800bbf0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.048+0000 7f042f39d700 1 -- 172.21.15.82:0/2487877348 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0428106780 msgr2=0x7f0428198730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:50.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.048+0000 7f042f39d700 1 --2- 172.21.15.82:0/2487877348 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0428106780 0x7f0428198730 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f0420009fd0 tx=0x7f042000bce0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.048+0000 7f042f39d700 1 -- 172.21.15.82:0/2487877348 shutdown_connections 2023-09-23T08:57:50.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.048+0000 7f042f39d700 1 --2- 172.21.15.82:0/2487877348 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f04140a0300 0x7f04140a27c0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.048+0000 7f042f39d700 1 --2- 172.21.15.82:0/2487877348 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0428106780 0x7f0428198730 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.048+0000 7f042f39d700 1 --2- 172.21.15.82:0/2487877348 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0428067a80 0x7f042819e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.049+0000 7f042f39d700 1 --2- 172.21.15.82:0/2487877348 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0428068440 0x7f042819ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.049+0000 7f042f39d700 1 -- 172.21.15.82:0/2487877348 >> 172.21.15.82:0/2487877348 conn(0x7f04280750e0 msgr2=0x7f042810b870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:50.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.049+0000 7f042f39d700 1 -- 172.21.15.82:0/2487877348 shutdown_connections 2023-09-23T08:57:50.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.049+0000 7f042f39d700 1 -- 172.21.15.82:0/2487877348 wait complete. 2023-09-23T08:57:50.071 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-09-23T08:57:50.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.297+0000 7f11881ff700 1 -- 172.21.15.82:0/1844049910 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1180102aa0 msgr2=0x7f1180102f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:50.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.297+0000 7f11881ff700 1 --2- 172.21.15.82:0/1844049910 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1180102aa0 0x7f1180102f20 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f1170009990 tx=0x7f1170009ca0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.297+0000 7f11881ff700 1 -- 172.21.15.82:0/1844049910 shutdown_connections 2023-09-23T08:57:50.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.297+0000 7f11881ff700 1 --2- 172.21.15.82:0/1844049910 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1180103460 0x7f118010f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.297+0000 7f11881ff700 1 --2- 172.21.15.82:0/1844049910 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1180108ab0 0x7f1180108e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.297+0000 7f11881ff700 1 --2- 172.21.15.82:0/1844049910 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1180102aa0 0x7f1180102f20 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.297+0000 7f11881ff700 1 -- 172.21.15.82:0/1844049910 >> 172.21.15.82:0/1844049910 conn(0x7f11800fe590 msgr2=0x7f11801009b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:50.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.297+0000 7f11881ff700 1 -- 172.21.15.82:0/1844049910 shutdown_connections 2023-09-23T08:57:50.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.297+0000 7f11881ff700 1 -- 172.21.15.82:0/1844049910 wait complete. 2023-09-23T08:57:50.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.298+0000 7f11881ff700 1 Processor -- start 2023-09-23T08:57:50.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.298+0000 7f11881ff700 1 -- start start 2023-09-23T08:57:50.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.298+0000 7f11881ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1180102aa0 0x7f118019e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:50.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.299+0000 7f11881ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1180103460 0x7f118019ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:50.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.299+0000 7f11881ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1180108ab0 0x7f1180198830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:50.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.299+0000 7f11881ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1180198ea0 con 0x7f1180103460 2023-09-23T08:57:50.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.299+0000 7f11881ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1180199010 con 0x7f1180108ab0 2023-09-23T08:57:50.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.299+0000 7f11881ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11801991d0 con 0x7f1180102aa0 2023-09-23T08:57:50.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.299+0000 7f118579a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1180103460 0x7f118019ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:50.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.299+0000 7f1185f9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1180102aa0 0x7f118019e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:50.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.299+0000 7f118579a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1180103460 0x7f118019ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37288/0 (socket says 172.21.15.82:37288) 2023-09-23T08:57:50.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.299+0000 7f118579a700 1 -- 172.21.15.82:0/2410456037 learned_addr learned my addr 172.21.15.82:0/2410456037 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:57:50.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.299+0000 7f118679c700 1 --2- 172.21.15.82:0/2410456037 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1180108ab0 0x7f1180198830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:50.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.299+0000 7f1185f9b700 1 -- 172.21.15.82:0/2410456037 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1180108ab0 msgr2=0x7f1180198830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:50.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.299+0000 7f1185f9b700 1 --2- 172.21.15.82:0/2410456037 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1180108ab0 0x7f1180198830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.299+0000 7f1185f9b700 1 -- 172.21.15.82:0/2410456037 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1180103460 msgr2=0x7f118019ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:50.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.299+0000 7f1185f9b700 1 --2- 172.21.15.82:0/2410456037 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1180103460 0x7f118019ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.299+0000 7f1185f9b700 1 -- 172.21.15.82:0/2410456037 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11700095f0 con 0x7f1180102aa0 2023-09-23T08:57:50.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.300+0000 7f1185f9b700 1 --2- 172.21.15.82:0/2410456037 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1180102aa0 0x7f118019e7c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f117c00c970 tx=0x7f117c00cc80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:50.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.300+0000 7f1176ffd700 1 -- 172.21.15.82:0/2410456037 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f117c004440 con 0x7f1180102aa0 2023-09-23T08:57:50.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.300+0000 7f11881ff700 1 -- 172.21.15.82:0/2410456037 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11801994b0 con 0x7f1180102aa0 2023-09-23T08:57:50.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.300+0000 7f1176ffd700 1 -- 172.21.15.82:0/2410456037 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f117c003b10 con 0x7f1180102aa0 2023-09-23T08:57:50.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.300+0000 7f1176ffd700 1 -- 172.21.15.82:0/2410456037 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f117c007aa0 con 0x7f1180102aa0 2023-09-23T08:57:50.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.300+0000 7f11881ff700 1 -- 172.21.15.82:0/2410456037 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11801a57b0 con 0x7f1180102aa0 2023-09-23T08:57:50.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.305+0000 7f1176ffd700 1 -- 172.21.15.82:0/2410456037 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 25) v1 ==== 134904+0+0 (secure 0 0 0) 0x7f117c003c80 con 0x7f1180102aa0 2023-09-23T08:57:50.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.306+0000 7f119ba32b80 1 Processor -- start 2023-09-23T08:57:50.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.306+0000 7f119ba32b80 1 -- start start 2023-09-23T08:57:50.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.307+0000 7f119ba32b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f48495380 0x555f48495760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:50.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.307+0000 7f119ba32b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555f48495ca0 0x555f4848f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:50.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.307+0000 7f119ba32b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f4848fc40 0x555f484900a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:50.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.307+0000 7f119ba32b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f483f77b0 con 0x555f4848fc40 2023-09-23T08:57:50.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.307+0000 7f119ba32b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f483e8780 con 0x555f48495380 2023-09-23T08:57:50.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.307+0000 7f119ba32b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f483e60a0 con 0x555f48495ca0 2023-09-23T08:57:50.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.307+0000 7f1176ffd700 1 --2- 172.21.15.82:0/2410456037 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f116c0a0260 0x7f116c0a2720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:50.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.307+0000 7f118579a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f4848fc40 0x555f484900a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:50.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.307+0000 7f1185f9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555f48495ca0 0x555f4848f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:50.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.307+0000 7f118579a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f4848fc40 0x555f484900a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37294/0 (socket says 172.21.15.82:37294) 2023-09-23T08:57:50.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.307+0000 7f118579a700 1 -- 172.21.15.82:0/1515164396 learned_addr learned my addr 172.21.15.82:0/1515164396 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:57:50.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.307+0000 7f118679c700 1 --2- 172.21.15.82:0/1515164396 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f48495380 0x555f48495760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:50.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.308+0000 7f1176ffd700 1 -- 172.21.15.82:0/2410456037 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f117c0cb3f0 con 0x7f1180102aa0 2023-09-23T08:57:50.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.308+0000 7f118679c700 1 --2- 172.21.15.82:0/2410456037 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f116c0a0260 0x7f116c0a2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:50.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.308+0000 7f118579a700 1 -- 172.21.15.82:0/1515164396 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555f48495ca0 msgr2=0x555f4848f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:50.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.308+0000 7f118579a700 1 --2- 172.21.15.82:0/1515164396 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555f48495ca0 0x555f4848f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.308+0000 7f118579a700 1 -- 172.21.15.82:0/1515164396 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f48495380 msgr2=0x555f48495760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:50.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.308+0000 7f118579a700 1 --2- 172.21.15.82:0/1515164396 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f48495380 0x555f48495760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.308+0000 7f118579a700 1 -- 172.21.15.82:0/1515164396 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555f48261630 con 0x555f4848fc40 2023-09-23T08:57:50.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.308+0000 7f118679c700 1 --2- 172.21.15.82:0/1515164396 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f48495380 0x555f48495760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T08:57:50.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.308+0000 7f118579a700 1 --2- 172.21.15.82:0/1515164396 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f4848fc40 0x555f484900a0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f1170000c00 tx=0x7f1170005040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e40176a12824698d server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:50.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.308+0000 7f118679c700 1 --2- 172.21.15.82:0/2410456037 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f116c0a0260 0x7f116c0a2720 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f11780060b0 tx=0x7f1178009040 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:50.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.308+0000 7f116bfff700 1 -- 172.21.15.82:0/1515164396 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f117001d070 con 0x555f4848fc40 2023-09-23T08:57:50.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.309+0000 7f116bfff700 1 -- 172.21.15.82:0/1515164396 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f117001e040 con 0x555f4848fc40 2023-09-23T08:57:50.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.309+0000 7f116bfff700 1 -- 172.21.15.82:0/1515164396 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1170004760 con 0x555f4848fc40 2023-09-23T08:57:50.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.309+0000 7f119ba32b80 1 -- 172.21.15.82:0/1515164396 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f4848fc40 msgr2=0x555f484900a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:50.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.309+0000 7f119ba32b80 1 --2- 172.21.15.82:0/1515164396 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f4848fc40 0x555f484900a0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f1170000c00 tx=0x7f1170005040 comp rx=0 tx=0).stop 2023-09-23T08:57:50.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.309+0000 7f119ba32b80 1 -- 172.21.15.82:0/1515164396 shutdown_connections 2023-09-23T08:57:50.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.309+0000 7f119ba32b80 1 --2- 172.21.15.82:0/1515164396 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f4848fc40 0x555f484900a0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.309+0000 7f119ba32b80 1 --2- 172.21.15.82:0/1515164396 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f48495380 0x555f48495760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.309+0000 7f119ba32b80 1 --2- 172.21.15.82:0/1515164396 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555f48495ca0 0x555f4848f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.309+0000 7f119ba32b80 1 -- 172.21.15.82:0/1515164396 >> 172.21.15.82:0/1515164396 conn(0x555f484040e0 msgr2=0x555f4848a410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:50.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.309+0000 7f119ba32b80 1 -- 172.21.15.82:0/1515164396 shutdown_connections 2023-09-23T08:57:50.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.309+0000 7f119ba32b80 1 -- 172.21.15.82:0/1515164396 wait complete. 2023-09-23T08:57:50.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.310+0000 7f119ba32b80 1 -- start start 2023-09-23T08:57:50.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.310+0000 7f119ba32b80 1 Processor -- start 2023-09-23T08:57:50.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.311+0000 7f119ba32b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f4848fc40 0x555f4849bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:50.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.311+0000 7f119ba32b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f48495380 0x555f48498e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:50.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.311+0000 7f119ba32b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555f48495ca0 0x555f484994d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:50.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.311+0000 7f119ba32b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f483e1990 con 0x555f4848fc40 2023-09-23T08:57:50.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.311+0000 7f119ba32b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f4837fbb0 con 0x555f48495380 2023-09-23T08:57:50.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.311+0000 7f119ba32b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f4837f8b0 con 0x555f48495ca0 2023-09-23T08:57:50.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.311+0000 7f119ba32b80 10 client.0 _ll_register_callbacks cb 0x555f482c9a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T08:57:50.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.311+0000 7f1185f9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f4848fc40 0x555f4849bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:50.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.311+0000 7f1185f9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f4848fc40 0x555f4849bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37310/0 (socket says 172.21.15.82:37310) 2023-09-23T08:57:50.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.311+0000 7f1185f9b700 1 -- 172.21.15.82:0/1707579627 learned_addr learned my addr 172.21.15.82:0/1707579627 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:57:50.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.311+0000 7f118579a700 1 --2- 172.21.15.82:0/1707579627 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f48495380 0x555f48498e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:50.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.311+0000 7f1185f9b700 1 -- 172.21.15.82:0/1707579627 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555f48495ca0 msgr2=0x555f484994d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:50.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.311+0000 7f1185f9b700 1 --2- 172.21.15.82:0/1707579627 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555f48495ca0 0x555f484994d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.311+0000 7f1185f9b700 1 -- 172.21.15.82:0/1707579627 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f48495380 msgr2=0x555f48498e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:50.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.311+0000 7f1185f9b700 1 --2- 172.21.15.82:0/1707579627 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f48495380 0x555f48498e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.311+0000 7f1185f9b700 1 -- 172.21.15.82:0/1707579627 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1180110270 con 0x555f4848fc40 2023-09-23T08:57:50.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.312+0000 7f1185f9b700 1 --2- 172.21.15.82:0/1707579627 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f4848fc40 0x555f4849bbd0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f117c098810 tx=0x7f117c0647b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b523d251b115206 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:50.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.312+0000 7f11697fa700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T08:57:50.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.312+0000 7f11697fa700 1 -- 172.21.15.82:0/1707579627 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f117c064580 con 0x555f4848fc40 2023-09-23T08:57:50.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.312+0000 7f119ba32b80 1 -- 172.21.15.82:0/1707579627 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555f4845f1c0 con 0x555f4848fc40 2023-09-23T08:57:50.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.312+0000 7f11697fa700 1 -- 172.21.15.82:0/1707579627 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f117c00d550 con 0x555f4848fc40 2023-09-23T08:57:50.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.312+0000 7f11697fa700 1 -- 172.21.15.82:0/1707579627 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f117c098f80 con 0x555f4848fc40 2023-09-23T08:57:50.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.312+0000 7f119ba32b80 10 client.15858 fetch_fsmap learned FSMap version 30 2023-09-23T08:57:50.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.312+0000 7f119ba32b80 1 -- 172.21.15.82:0/1707579627 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x555f4820dde0 con 0x555f4848fc40 2023-09-23T08:57:50.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.312+0000 7f11697fa700 1 -- 172.21.15.82:0/1707579627 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x555f4845f1c0 con 0x555f4848fc40 2023-09-23T08:57:50.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.313+0000 7f11697fa700 1 -- 172.21.15.82:0/1707579627 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 30) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f117c098b70 con 0x555f4848fc40 2023-09-23T08:57:50.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.313+0000 7f119ba32b80 10 client.15858 fetch_fsmap finished waiting for FSMap version 30 2023-09-23T08:57:50.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.313+0000 7f119ba32b80 10 client.15858 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-23T08:57:50.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.313+0000 7f119ba32b80 20 client.15858 populate_metadata read hostname 'smithi082' 2023-09-23T08:57:50.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.313+0000 7f119ba32b80 1 --2- 172.21.15.82:0/1707579627 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x555f484a9690 0x555f484aba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:50.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.313+0000 7f119ba32b80 4 client.15858 mds_command: new command op to 24550 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T08:57:50.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.313+0000 7f119ba32b80 1 -- 172.21.15.82:0/1707579627 --> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555f48387ba0 con 0x555f484a9690 2023-09-23T08:57:50.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.314+0000 7f118579a700 1 --2- 172.21.15.82:0/1707579627 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x555f484a9690 0x555f484aba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:50.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.314+0000 7f118579a700 1 --2- 172.21.15.82:0/1707579627 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x555f484a9690 0x555f484aba80 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ee433815c524fd3f server_cookie=72f4a891ecfd2e5d in_seq=0 out_seq=0 2023-09-23T08:57:50.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.314+0000 7f11697fa700 10 client.15858 ms_handle_connect on v2:172.21.15.161:6838/758982817 2023-09-23T08:57:50.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.315+0000 7f11697fa700 1 -- 172.21.15.82:0/1707579627 <== mds.1 v2:172.21.15.161:6838/758982817 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x555f48387ba0 con 0x555f484a9690 2023-09-23T08:57:50.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.315+0000 7f11697fa700 10 client.15858 handle_command_reply: tid=0 2023-09-23T08:57:50.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.315+0000 7f119ba32b80 1 client.15858 shutdown 2023-09-23T08:57:50.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.315+0000 7f119ba32b80 1 -- 172.21.15.82:0/1707579627 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f4848fc40 msgr2=0x555f4849bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:50.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.315+0000 7f119ba32b80 1 --2- 172.21.15.82:0/1707579627 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f4848fc40 0x555f4849bbd0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f117c098810 tx=0x7f117c0647b0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.315+0000 7f119ba32b80 1 -- 172.21.15.82:0/1707579627 shutdown_connections 2023-09-23T08:57:50.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.315+0000 7f119ba32b80 1 --2- 172.21.15.82:0/1707579627 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x555f484a9690 0x555f484aba80 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.315+0000 7f119ba32b80 1 --2- 172.21.15.82:0/1707579627 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555f48495ca0 0x555f484994d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.315+0000 7f119ba32b80 1 --2- 172.21.15.82:0/1707579627 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f4848fc40 0x555f4849bbd0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.315+0000 7f11697fa700 0 client.15858 ms_handle_reset on v2:172.21.15.161:6838/758982817 2023-09-23T08:57:50.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.315+0000 7f119ba32b80 1 --2- 172.21.15.82:0/1707579627 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f48495380 0x555f48498e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.315+0000 7f119ba32b80 1 -- 172.21.15.82:0/1707579627 >> 172.21.15.82:0/1707579627 conn(0x555f484040e0 msgr2=0x555f48484b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:50.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.316+0000 7f119ba32b80 1 -- 172.21.15.82:0/1707579627 shutdown_connections 2023-09-23T08:57:50.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.316+0000 7f119ba32b80 1 -- 172.21.15.82:0/1707579627 wait complete. 2023-09-23T08:57:50.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.316+0000 7f119ba32b80 20 client.15858 trim_cache size 0 max 16384 2023-09-23T08:57:50.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.331+0000 7f119ba32b80 1 Processor -- start 2023-09-23T08:57:50.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.332+0000 7f119ba32b80 1 -- start start 2023-09-23T08:57:50.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.332+0000 7f119ba32b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f4848fc40 0x555f48490020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:50.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.332+0000 7f119ba32b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555f48495380 0x555f48498610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:50.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.332+0000 7f119ba32b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f48495ca0 0x555f4849b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:50.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.332+0000 7f119ba32b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f48263920 con 0x555f4848fc40 2023-09-23T08:57:50.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.332+0000 7f119ba32b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f48486c80 con 0x555f48495ca0 2023-09-23T08:57:50.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.332+0000 7f119ba32b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f48493b30 con 0x555f48495380 2023-09-23T08:57:50.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.332+0000 7f1185f9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f4848fc40 0x555f48490020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:50.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.332+0000 7f1185f9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f4848fc40 0x555f48490020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37322/0 (socket says 172.21.15.82:37322) 2023-09-23T08:57:50.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.332+0000 7f1185f9b700 1 -- 172.21.15.82:0/4024934495 learned_addr learned my addr 172.21.15.82:0/4024934495 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:57:50.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.332+0000 7f118579a700 1 --2- 172.21.15.82:0/4024934495 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555f48495380 0x555f48498610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:50.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.333+0000 7f118679c700 1 --2- 172.21.15.82:0/4024934495 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f48495ca0 0x555f4849b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:50.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.333+0000 7f1185f9b700 1 -- 172.21.15.82:0/4024934495 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555f48495380 msgr2=0x555f48498610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:50.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.333+0000 7f1185f9b700 1 --2- 172.21.15.82:0/4024934495 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555f48495380 0x555f48498610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.333+0000 7f1185f9b700 1 -- 172.21.15.82:0/4024934495 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f48495ca0 msgr2=0x555f4849b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:50.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.333+0000 7f1185f9b700 1 --2- 172.21.15.82:0/4024934495 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f48495ca0 0x555f4849b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.333+0000 7f1185f9b700 1 -- 172.21.15.82:0/4024934495 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555f481f6c60 con 0x555f4848fc40 2023-09-23T08:57:50.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.333+0000 7f118679c700 1 --2- 172.21.15.82:0/4024934495 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f48495ca0 0x555f4849b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T08:57:50.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.333+0000 7f118579a700 1 --2- 172.21.15.82:0/4024934495 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555f48495380 0x555f48498610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T08:57:50.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.333+0000 7f1185f9b700 1 --2- 172.21.15.82:0/4024934495 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f4848fc40 0x555f48490020 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f117c0952f0 tx=0x7f117c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61efdb470c8c643a server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:50.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.333+0000 7f1174ff9700 1 -- 172.21.15.82:0/4024934495 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f117c098ce0 con 0x555f4848fc40 2023-09-23T08:57:50.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.333+0000 7f1174ff9700 1 -- 172.21.15.82:0/4024934495 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f117c0c88d0 con 0x555f4848fc40 2023-09-23T08:57:50.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.333+0000 7f1174ff9700 1 -- 172.21.15.82:0/4024934495 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f117c098910 con 0x555f4848fc40 2023-09-23T08:57:50.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.334+0000 7f119ba32b80 1 -- 172.21.15.82:0/4024934495 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f4848fc40 msgr2=0x555f48490020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:50.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.334+0000 7f119ba32b80 1 --2- 172.21.15.82:0/4024934495 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f4848fc40 0x555f48490020 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f117c0952f0 tx=0x7f117c000bc0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.334+0000 7f119ba32b80 1 -- 172.21.15.82:0/4024934495 shutdown_connections 2023-09-23T08:57:50.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.334+0000 7f119ba32b80 1 --2- 172.21.15.82:0/4024934495 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f48495ca0 0x555f4849b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.334+0000 7f119ba32b80 1 --2- 172.21.15.82:0/4024934495 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f4848fc40 0x555f48490020 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.334+0000 7f119ba32b80 1 --2- 172.21.15.82:0/4024934495 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555f48495380 0x555f48498610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.334+0000 7f119ba32b80 1 -- 172.21.15.82:0/4024934495 >> 172.21.15.82:0/4024934495 conn(0x555f484040e0 msgr2=0x555f4848a0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:50.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.334+0000 7f119ba32b80 1 -- 172.21.15.82:0/4024934495 shutdown_connections 2023-09-23T08:57:50.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.334+0000 7f119ba32b80 1 -- 172.21.15.82:0/4024934495 wait complete. 2023-09-23T08:57:50.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.335+0000 7f119ba32b80 1 -- start start 2023-09-23T08:57:50.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.335+0000 7f119ba32b80 1 Processor -- start 2023-09-23T08:57:50.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.336+0000 7f119ba32b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f4848fc40 0x555f48491fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:50.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.336+0000 7f119ba32b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555f48495380 0x555f48492510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:50.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.336+0000 7f119ba32b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f48495ca0 0x555f48490e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:50.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.336+0000 7f119ba32b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f48492b90 con 0x555f48495ca0 2023-09-23T08:57:50.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.336+0000 7f119ba32b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f48491340 con 0x555f4848fc40 2023-09-23T08:57:50.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.336+0000 7f119ba32b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f484914b0 con 0x555f48495380 2023-09-23T08:57:50.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.336+0000 7f119ba32b80 10 client.0 _ll_register_callbacks cb 0x7f117c00a560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T08:57:50.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.336+0000 7f118679c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f48495ca0 0x555f48490e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:50.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.336+0000 7f1185f9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f4848fc40 0x555f48491fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:50.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.336+0000 7f118679c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f48495ca0 0x555f48490e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37336/0 (socket says 172.21.15.82:37336) 2023-09-23T08:57:50.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.336+0000 7f1185f9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f4848fc40 0x555f48491fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:37230/0 (socket says 172.21.15.82:37230) 2023-09-23T08:57:50.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.336+0000 7f118679c700 1 -- 172.21.15.82:0/3477079046 learned_addr learned my addr 172.21.15.82:0/3477079046 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:57:50.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.336+0000 7f118579a700 1 --2- 172.21.15.82:0/3477079046 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555f48495380 0x555f48492510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:50.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.336+0000 7f1185f9b700 1 -- 172.21.15.82:0/3477079046 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555f48495380 msgr2=0x555f48492510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:50.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.336+0000 7f1185f9b700 1 --2- 172.21.15.82:0/3477079046 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555f48495380 0x555f48492510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.337+0000 7f1185f9b700 1 -- 172.21.15.82:0/3477079046 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f48495ca0 msgr2=0x555f48490e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:50.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.337+0000 7f1185f9b700 1 --2- 172.21.15.82:0/3477079046 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f48495ca0 0x555f48490e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.337+0000 7f1185f9b700 1 -- 172.21.15.82:0/3477079046 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555f48261630 con 0x555f4848fc40 2023-09-23T08:57:50.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.337+0000 7f1185f9b700 1 --2- 172.21.15.82:0/3477079046 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f4848fc40 0x555f48491fd0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f117c098580 tx=0x7f117c0a04b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35b29794693188ce server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:50.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.337+0000 7f11697fa700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-09-23T08:57:50.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.337+0000 7f11697fa700 1 -- 172.21.15.82:0/3477079046 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f117c00d550 con 0x555f4848fc40 2023-09-23T08:57:50.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.337+0000 7f11697fa700 1 -- 172.21.15.82:0/3477079046 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f117c09c6b0 con 0x555f4848fc40 2023-09-23T08:57:50.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.337+0000 7f119ba32b80 1 -- 172.21.15.82:0/3477079046 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555f484828b0 con 0x555f4848fc40 2023-09-23T08:57:50.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.337+0000 7f11697fa700 1 -- 172.21.15.82:0/3477079046 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f117c0a0690 con 0x555f4848fc40 2023-09-23T08:57:50.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.337+0000 7f119ba32b80 10 client.25565 fetch_fsmap learned FSMap version 30 2023-09-23T08:57:50.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.337+0000 7f119ba32b80 1 -- 172.21.15.82:0/3477079046 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x555f4820dde0 con 0x555f4848fc40 2023-09-23T08:57:50.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.338+0000 7f11697fa700 1 -- 172.21.15.82:0/3477079046 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x555f484828b0 con 0x555f4848fc40 2023-09-23T08:57:50.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.338+0000 7f11697fa700 1 -- 172.21.15.82:0/3477079046 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 30) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f117c094670 con 0x555f4848fc40 2023-09-23T08:57:50.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.338+0000 7f119ba32b80 10 client.25565 fetch_fsmap finished waiting for FSMap version 30 2023-09-23T08:57:50.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.338+0000 7f119ba32b80 10 client.25565 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-23T08:57:50.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.338+0000 7f119ba32b80 20 client.25565 populate_metadata read hostname 'smithi082' 2023-09-23T08:57:50.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.338+0000 7f119ba32b80 1 --2- 172.21.15.82:0/3477079046 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x555f484fdd70 0x555f48500160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:50.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.338+0000 7f119ba32b80 4 client.25565 mds_command: new command op to 24550 tid=0[{"prefix": "damage ls"}] 2023-09-23T08:57:50.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.338+0000 7f119ba32b80 1 -- 172.21.15.82:0/3477079046 --> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x555f483da970 con 0x555f484fdd70 2023-09-23T08:57:50.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.338+0000 7f118579a700 1 --2- 172.21.15.82:0/3477079046 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x555f484fdd70 0x555f48500160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:50.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.339+0000 7f11697fa700 10 client.25565 ms_handle_connect on v2:172.21.15.161:6838/758982817 2023-09-23T08:57:50.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.339+0000 7f118579a700 1 --2- 172.21.15.82:0/3477079046 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x555f484fdd70 0x555f48500160 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ee8f4ca049a7156 server_cookie=dbaa9f4e4edaaa01 in_seq=0 out_seq=0 2023-09-23T08:57:50.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.339+0000 7f11697fa700 1 -- 172.21.15.82:0/3477079046 <== mds.1 v2:172.21.15.161:6838/758982817 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x555f483da970 con 0x555f484fdd70 2023-09-23T08:57:50.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.339+0000 7f11697fa700 10 client.25565 handle_command_reply: tid=0 2023-09-23T08:57:50.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.339+0000 7f119ba32b80 1 client.25565 shutdown 2023-09-23T08:57:50.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.340+0000 7f119ba32b80 1 -- 172.21.15.82:0/3477079046 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f4848fc40 msgr2=0x555f48491fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:50.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.340+0000 7f119ba32b80 1 --2- 172.21.15.82:0/3477079046 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f4848fc40 0x555f48491fd0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f117c098580 tx=0x7f117c0a04b0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.340+0000 7f119ba32b80 1 -- 172.21.15.82:0/3477079046 shutdown_connections 2023-09-23T08:57:50.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.340+0000 7f119ba32b80 1 --2- 172.21.15.82:0/3477079046 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x555f484fdd70 0x555f48500160 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.340+0000 7f119ba32b80 1 --2- 172.21.15.82:0/3477079046 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f48495ca0 0x555f48490e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.340+0000 7f119ba32b80 1 --2- 172.21.15.82:0/3477079046 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f4848fc40 0x555f48491fd0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.340+0000 7f119ba32b80 1 --2- 172.21.15.82:0/3477079046 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555f48495380 0x555f48492510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.340+0000 7f11697fa700 0 client.25565 ms_handle_reset on v2:172.21.15.161:6838/758982817 2023-09-23T08:57:50.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.340+0000 7f119ba32b80 1 -- 172.21.15.82:0/3477079046 >> 172.21.15.82:0/3477079046 conn(0x555f484040e0 msgr2=0x555f48493050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:50.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.340+0000 7f119ba32b80 1 -- 172.21.15.82:0/3477079046 shutdown_connections 2023-09-23T08:57:50.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.340+0000 7f119ba32b80 1 -- 172.21.15.82:0/3477079046 wait complete. 2023-09-23T08:57:50.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.340+0000 7f119ba32b80 20 client.25565 trim_cache size 0 max 16384 2023-09-23T08:57:50.348 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2023-09-23T08:57:50.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.341+0000 7f11881ff700 1 -- 172.21.15.82:0/2410456037 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f116c0a0260 msgr2=0x7f116c0a2720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:50.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.341+0000 7f11881ff700 1 --2- 172.21.15.82:0/2410456037 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f116c0a0260 0x7f116c0a2720 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f11780060b0 tx=0x7f1178009040 comp rx=0 tx=0).stop 2023-09-23T08:57:50.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.341+0000 7f11881ff700 1 -- 172.21.15.82:0/2410456037 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1180102aa0 msgr2=0x7f118019e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:50.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.341+0000 7f11881ff700 1 --2- 172.21.15.82:0/2410456037 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1180102aa0 0x7f118019e7c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f117c00c970 tx=0x7f117c00cc80 comp rx=0 tx=0).stop 2023-09-23T08:57:50.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.341+0000 7f11881ff700 1 -- 172.21.15.82:0/2410456037 shutdown_connections 2023-09-23T08:57:50.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.341+0000 7f11881ff700 1 --2- 172.21.15.82:0/2410456037 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f116c0a0260 0x7f116c0a2720 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.341+0000 7f11881ff700 1 --2- 172.21.15.82:0/2410456037 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1180108ab0 0x7f1180198830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.341+0000 7f11881ff700 1 --2- 172.21.15.82:0/2410456037 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1180102aa0 0x7f118019e7c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.341+0000 7f11881ff700 1 --2- 172.21.15.82:0/2410456037 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1180103460 0x7f118019ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.341+0000 7f11881ff700 1 -- 172.21.15.82:0/2410456037 >> 172.21.15.82:0/2410456037 conn(0x7f11800fe590 msgr2=0x7f11800feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:50.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.341+0000 7f11881ff700 1 -- 172.21.15.82:0/2410456037 shutdown_connections 2023-09-23T08:57:50.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.341+0000 7f11881ff700 1 -- 172.21.15.82:0/2410456037 wait complete. 2023-09-23T08:57:50.363 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-09-23T08:57:50.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.597+0000 7fefdf7ff700 1 -- 172.21.15.82:0/2315108499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefd8101260 msgr2=0x7fefd810d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:50.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.597+0000 7fefdf7ff700 1 --2- 172.21.15.82:0/2315108499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefd8101260 0x7fefd810d770 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fefd000b0a0 tx=0x7fefd000b3b0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.597+0000 7fefdf7ff700 1 -- 172.21.15.82:0/2315108499 shutdown_connections 2023-09-23T08:57:50.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.597+0000 7fefdf7ff700 1 --2- 172.21.15.82:0/2315108499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefd8101260 0x7fefd810d770 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.597+0000 7fefdf7ff700 1 --2- 172.21.15.82:0/2315108499 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fefd81068b0 0x7fefd8106c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.597+0000 7fefdf7ff700 1 --2- 172.21.15.82:0/2315108499 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fefd81008a0 0x7fefd8100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.597+0000 7fefdf7ff700 1 -- 172.21.15.82:0/2315108499 >> 172.21.15.82:0/2315108499 conn(0x7fefd80fc390 msgr2=0x7fefd80fe7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:50.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.597+0000 7fefdf7ff700 1 -- 172.21.15.82:0/2315108499 shutdown_connections 2023-09-23T08:57:50.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.597+0000 7fefdf7ff700 1 -- 172.21.15.82:0/2315108499 wait complete. 2023-09-23T08:57:50.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.599+0000 7fefdf7ff700 1 Processor -- start 2023-09-23T08:57:50.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.599+0000 7fefdf7ff700 1 -- start start 2023-09-23T08:57:50.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.599+0000 7fefdf7ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefd81008a0 0x7fefd819c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:50.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.599+0000 7fefdf7ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fefd8101260 0x7fefd819cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:50.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.599+0000 7fefdf7ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fefd81068b0 0x7fefd8196680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:50.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.599+0000 7fefdf7ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefd8196cf0 con 0x7fefd81008a0 2023-09-23T08:57:50.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.599+0000 7fefdf7ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefd8196e60 con 0x7fefd8101260 2023-09-23T08:57:50.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.599+0000 7fefdf7ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefd8197020 con 0x7fefd81068b0 2023-09-23T08:57:50.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.600+0000 7fefdd59b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefd81008a0 0x7fefd819c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:50.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.600+0000 7fefdd59b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefd81008a0 0x7fefd819c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37352/0 (socket says 172.21.15.82:37352) 2023-09-23T08:57:50.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.600+0000 7fefdd59b700 1 -- 172.21.15.82:0/2225950119 learned_addr learned my addr 172.21.15.82:0/2225950119 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:57:50.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.600+0000 7fefddd9c700 1 --2- 172.21.15.82:0/2225950119 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fefd81068b0 0x7fefd8196680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:50.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.600+0000 7fefdd59b700 1 -- 172.21.15.82:0/2225950119 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fefd81068b0 msgr2=0x7fefd8196680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:50.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.600+0000 7fefdd59b700 1 --2- 172.21.15.82:0/2225950119 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fefd81068b0 0x7fefd8196680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.600+0000 7fefdcd9a700 1 --2- 172.21.15.82:0/2225950119 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fefd8101260 0x7fefd819cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:50.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.600+0000 7fefdd59b700 1 -- 172.21.15.82:0/2225950119 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fefd8101260 msgr2=0x7fefd819cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:50.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.600+0000 7fefdd59b700 1 --2- 172.21.15.82:0/2225950119 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fefd8101260 0x7fefd819cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.600+0000 7fefdd59b700 1 -- 172.21.15.82:0/2225950119 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefd0009d00 con 0x7fefd81008a0 2023-09-23T08:57:50.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.601+0000 7fefdd59b700 1 --2- 172.21.15.82:0/2225950119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefd81008a0 0x7fefd819c610 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fefd400e9a0 tx=0x7fefd400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:50.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.601+0000 7fefce7fc700 1 -- 172.21.15.82:0/2225950119 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd4009790 con 0x7fefd81008a0 2023-09-23T08:57:50.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.601+0000 7fefce7fc700 1 -- 172.21.15.82:0/2225950119 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fefd400cbd0 con 0x7fefd81008a0 2023-09-23T08:57:50.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.601+0000 7fefce7fc700 1 -- 172.21.15.82:0/2225950119 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd4018680 con 0x7fefd81008a0 2023-09-23T08:57:50.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.602+0000 7fefdf7ff700 1 -- 172.21.15.82:0/2225950119 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefd8197300 con 0x7fefd81008a0 2023-09-23T08:57:50.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.602+0000 7fefdf7ff700 1 -- 172.21.15.82:0/2225950119 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefd81a3600 con 0x7fefd81008a0 2023-09-23T08:57:50.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.606+0000 7fefce7fc700 1 -- 172.21.15.82:0/2225950119 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) v1 ==== 134904+0+0 (secure 0 0 0) 0x7fefd400cd40 con 0x7fefd81008a0 2023-09-23T08:57:50.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.608+0000 7fefce7fc700 1 --2- 172.21.15.82:0/2225950119 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fefc40a0260 0x7fefc40a2720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:50.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.608+0000 7fefce7fc700 1 -- 172.21.15.82:0/2225950119 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fefd4014070 con 0x7fefd81008a0 2023-09-23T08:57:50.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.608+0000 7feff3076b80 1 Processor -- start 2023-09-23T08:57:50.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.608+0000 7fefdcd9a700 1 --2- 172.21.15.82:0/2225950119 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fefc40a0260 0x7fefc40a2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:50.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.609+0000 7feff3076b80 1 -- start start 2023-09-23T08:57:50.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.609+0000 7feff3076b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4588a6790 0x55c4588a6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:50.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.609+0000 7feff3076b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4588a70b0 0x55c4588a0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:50.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.609+0000 7feff3076b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c4588a1050 0x55c4588a14b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:50.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.609+0000 7feff3076b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4588047b0 con 0x55c4588a6790 2023-09-23T08:57:50.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.609+0000 7feff3076b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4587f5780 con 0x55c4588a70b0 2023-09-23T08:57:50.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.609+0000 7feff3076b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4587f30a0 con 0x55c4588a1050 2023-09-23T08:57:50.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.609+0000 7fefdcd9a700 1 --2- 172.21.15.82:0/2225950119 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fefc40a0260 0x7fefc40a2720 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fefd8105ee0 tx=0x7fefc8009260 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:50.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.609+0000 7fefdd59b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4588a6790 0x55c4588a6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:50.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.609+0000 7fefdd59b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4588a6790 0x55c4588a6b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37356/0 (socket says 172.21.15.82:37356) 2023-09-23T08:57:50.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.609+0000 7fefdd59b700 1 -- 172.21.15.82:0/1355135345 learned_addr learned my addr 172.21.15.82:0/1355135345 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:57:50.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.610+0000 7fefddd9c700 1 --2- 172.21.15.82:0/1355135345 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c4588a1050 0x55c4588a14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:50.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.610+0000 7fefdcd9a700 1 --2- 172.21.15.82:0/1355135345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4588a70b0 0x55c4588a0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:50.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.610+0000 7fefdd59b700 1 -- 172.21.15.82:0/1355135345 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c4588a1050 msgr2=0x55c4588a14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:50.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.610+0000 7fefdd59b700 1 --2- 172.21.15.82:0/1355135345 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c4588a1050 0x55c4588a14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.610+0000 7fefdd59b700 1 -- 172.21.15.82:0/1355135345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4588a70b0 msgr2=0x55c4588a0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:50.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.610+0000 7fefdd59b700 1 --2- 172.21.15.82:0/1355135345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4588a70b0 0x55c4588a0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.610+0000 7fefdd59b700 1 -- 172.21.15.82:0/1355135345 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c45866e630 con 0x55c4588a6790 2023-09-23T08:57:50.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.610+0000 7fefdd59b700 1 --2- 172.21.15.82:0/1355135345 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4588a6790 0x55c4588a6b70 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fefd40a09c0 tx=0x7fefd4098b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e4cb1cc812871f0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:50.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.610+0000 7fefc37fe700 1 -- 172.21.15.82:0/1355135345 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd40b12b0 con 0x55c4588a6790 2023-09-23T08:57:50.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.610+0000 7fefc37fe700 1 -- 172.21.15.82:0/1355135345 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fefd40a0ef0 con 0x55c4588a6790 2023-09-23T08:57:50.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.610+0000 7fefc37fe700 1 -- 172.21.15.82:0/1355135345 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd40a0a60 con 0x55c4588a6790 2023-09-23T08:57:50.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.611+0000 7feff3076b80 1 -- 172.21.15.82:0/1355135345 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4588a6790 msgr2=0x55c4588a6b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:50.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.611+0000 7feff3076b80 1 --2- 172.21.15.82:0/1355135345 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4588a6790 0x55c4588a6b70 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fefd40a09c0 tx=0x7fefd4098b10 comp rx=0 tx=0).stop 2023-09-23T08:57:50.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.611+0000 7feff3076b80 1 -- 172.21.15.82:0/1355135345 shutdown_connections 2023-09-23T08:57:50.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.611+0000 7feff3076b80 1 --2- 172.21.15.82:0/1355135345 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c4588a1050 0x55c4588a14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.611+0000 7feff3076b80 1 --2- 172.21.15.82:0/1355135345 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4588a6790 0x55c4588a6b70 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.611+0000 7feff3076b80 1 --2- 172.21.15.82:0/1355135345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4588a70b0 0x55c4588a0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.611+0000 7feff3076b80 1 -- 172.21.15.82:0/1355135345 >> 172.21.15.82:0/1355135345 conn(0x55c4588110e0 msgr2=0x55c458897410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:50.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.611+0000 7feff3076b80 1 -- 172.21.15.82:0/1355135345 shutdown_connections 2023-09-23T08:57:50.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.611+0000 7feff3076b80 1 -- 172.21.15.82:0/1355135345 wait complete. 2023-09-23T08:57:50.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.612+0000 7feff3076b80 1 -- start start 2023-09-23T08:57:50.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.612+0000 7feff3076b80 1 Processor -- start 2023-09-23T08:57:50.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.613+0000 7feff3076b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c4588a1050 0x55c4588ad0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:50.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.613+0000 7feff3076b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4588a6790 0x55c4588aa2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:50.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.613+0000 7feff3076b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4588a70b0 0x55c4588aaa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:50.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.613+0000 7feff3076b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4587ee990 con 0x55c4588a70b0 2023-09-23T08:57:50.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.613+0000 7feff3076b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c45878cbb0 con 0x55c4588a6790 2023-09-23T08:57:50.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.613+0000 7feff3076b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c45878c8b0 con 0x55c4588a1050 2023-09-23T08:57:50.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.613+0000 7feff3076b80 10 client.0 _ll_register_callbacks cb 0x55c4586d6a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T08:57:50.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.613+0000 7fefdd59b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c4588a1050 0x55c4588ad0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:50.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.613+0000 7fefdd59b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c4588a1050 0x55c4588ad0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:38052/0 (socket says 172.21.15.82:38052) 2023-09-23T08:57:50.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.613+0000 7fefdd59b700 1 -- 172.21.15.82:0/1323914050 learned_addr learned my addr 172.21.15.82:0/1323914050 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:57:50.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.613+0000 7fefddd9c700 1 --2- 172.21.15.82:0/1323914050 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4588a70b0 0x55c4588aaa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:50.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.613+0000 7fefdcd9a700 1 --2- 172.21.15.82:0/1323914050 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4588a6790 0x55c4588aa2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:50.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.614+0000 7fefdd59b700 1 -- 172.21.15.82:0/1323914050 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4588a6790 msgr2=0x55c4588aa2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:50.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.614+0000 7fefdd59b700 1 --2- 172.21.15.82:0/1323914050 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4588a6790 0x55c4588aa2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.614+0000 7fefdd59b700 1 -- 172.21.15.82:0/1323914050 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4588a70b0 msgr2=0x55c4588aaa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:50.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.614+0000 7fefdd59b700 1 --2- 172.21.15.82:0/1323914050 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4588a70b0 0x55c4588aaa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.614+0000 7fefdd59b700 1 -- 172.21.15.82:0/1323914050 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefd81a3600 con 0x55c4588a1050 2023-09-23T08:57:50.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.614+0000 7fefddd9c700 1 --2- 172.21.15.82:0/1323914050 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4588a70b0 0x55c4588aaa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T08:57:50.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.614+0000 7fefdd59b700 1 --2- 172.21.15.82:0/1323914050 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c4588a1050 0x55c4588ad0c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fefd40c9300 tx=0x7fefd40995f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cdc6d7d3bbef0133 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:50.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.614+0000 7fefc0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T08:57:50.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.614+0000 7fefc0ff9700 1 -- 172.21.15.82:0/1323914050 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd40a0ef0 con 0x55c4588a1050 2023-09-23T08:57:50.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.615+0000 7fefc0ff9700 1 -- 172.21.15.82:0/1323914050 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fefd409c050 con 0x55c4588a1050 2023-09-23T08:57:50.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.615+0000 7feff3076b80 1 -- 172.21.15.82:0/1323914050 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c45886c1c0 con 0x55c4588a1050 2023-09-23T08:57:50.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.615+0000 7fefc0ff9700 1 -- 172.21.15.82:0/1323914050 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fefd40b12b0 con 0x55c4588a1050 2023-09-23T08:57:50.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.615+0000 7feff3076b80 10 client.25618 fetch_fsmap learned FSMap version 30 2023-09-23T08:57:50.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.615+0000 7feff3076b80 1 -- 172.21.15.82:0/1323914050 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55c45861ade0 con 0x55c4588a1050 2023-09-23T08:57:50.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.615+0000 7fefc0ff9700 1 -- 172.21.15.82:0/1323914050 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55c45886c1c0 con 0x55c4588a1050 2023-09-23T08:57:50.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.615+0000 7fefc0ff9700 1 -- 172.21.15.82:0/1323914050 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 30) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fefd40c9640 con 0x55c4588a1050 2023-09-23T08:57:50.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.616+0000 7feff3076b80 10 client.25618 fetch_fsmap finished waiting for FSMap version 30 2023-09-23T08:57:50.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.616+0000 7feff3076b80 10 client.25618 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T08:57:50.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.616+0000 7feff3076b80 20 client.25618 populate_metadata read hostname 'smithi082' 2023-09-23T08:57:50.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.616+0000 7feff3076b80 1 --2- 172.21.15.82:0/1323914050 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55c4588ba840 0x55c4588bcc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:50.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.616+0000 7feff3076b80 4 client.25618 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T08:57:50.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.616+0000 7feff3076b80 1 -- 172.21.15.82:0/1323914050 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c458794ba0 con 0x55c4588ba840 2023-09-23T08:57:50.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.616+0000 7fefdcd9a700 1 --2- 172.21.15.82:0/1323914050 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55c4588ba840 0x55c4588bcc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:50.623 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:57:50 smithi082 ceph-mon[97694]: pgmap v31: 97 pgs: 97 active+clean; 364 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 30 MiB/s wr, 32 op/s 2023-09-23T08:57:50.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.617+0000 7fefdcd9a700 1 --2- 172.21.15.82:0/1323914050 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55c4588ba840 0x55c4588bcc60 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f01f3d43e5654a19 server_cookie=1c56bdb29425cd77 in_seq=0 out_seq=0 2023-09-23T08:57:50.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.617+0000 7fefc0ff9700 10 client.25618 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T08:57:50.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.617+0000 7fefc0ff9700 1 -- 172.21.15.82:0/1323914050 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c458794ba0 con 0x55c4588ba840 2023-09-23T08:57:50.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.617+0000 7fefc0ff9700 10 client.25618 handle_command_reply: tid=0 2023-09-23T08:57:50.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.618+0000 7feff3076b80 1 client.25618 shutdown 2023-09-23T08:57:50.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.618+0000 7feff3076b80 1 -- 172.21.15.82:0/1323914050 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c4588a1050 msgr2=0x55c4588ad0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:50.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.618+0000 7feff3076b80 1 --2- 172.21.15.82:0/1323914050 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c4588a1050 0x55c4588ad0c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fefd40c9300 tx=0x7fefd40995f0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.618+0000 7feff3076b80 1 -- 172.21.15.82:0/1323914050 shutdown_connections 2023-09-23T08:57:50.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.618+0000 7feff3076b80 1 --2- 172.21.15.82:0/1323914050 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55c4588ba840 0x55c4588bcc60 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.618+0000 7feff3076b80 1 --2- 172.21.15.82:0/1323914050 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4588a70b0 0x55c4588aaa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.618+0000 7feff3076b80 1 --2- 172.21.15.82:0/1323914050 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c4588a1050 0x55c4588ad0c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.618+0000 7fefc0ff9700 0 client.25618 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T08:57:50.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.618+0000 7feff3076b80 1 --2- 172.21.15.82:0/1323914050 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4588a6790 0x55c4588aa2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.618+0000 7feff3076b80 1 -- 172.21.15.82:0/1323914050 >> 172.21.15.82:0/1323914050 conn(0x55c4588110e0 msgr2=0x55c458891b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:50.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.618+0000 7feff3076b80 1 -- 172.21.15.82:0/1323914050 shutdown_connections 2023-09-23T08:57:50.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.618+0000 7feff3076b80 1 -- 172.21.15.82:0/1323914050 wait complete. 2023-09-23T08:57:50.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.618+0000 7feff3076b80 20 client.25618 trim_cache size 0 max 16384 2023-09-23T08:57:50.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.636+0000 7feff3076b80 1 Processor -- start 2023-09-23T08:57:50.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.636+0000 7feff3076b80 1 -- start start 2023-09-23T08:57:50.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.636+0000 7feff3076b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4588a1050 0x55c4588a0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:50.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.636+0000 7feff3076b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c4588a6790 0x55c4588b1b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:50.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.636+0000 7feff3076b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4588a70b0 0x55c4588b6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:50.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.637+0000 7feff3076b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c458670920 con 0x55c4588a70b0 2023-09-23T08:57:50.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.637+0000 7feff3076b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4588981b0 con 0x55c4588a1050 2023-09-23T08:57:50.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.637+0000 7feff3076b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c458893d00 con 0x55c4588a6790 2023-09-23T08:57:50.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.637+0000 7fefddd9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4588a70b0 0x55c4588b6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:50.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.637+0000 7fefddd9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4588a70b0 0x55c4588b6dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37388/0 (socket says 172.21.15.82:37388) 2023-09-23T08:57:50.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.637+0000 7fefddd9c700 1 -- 172.21.15.82:0/1712770014 learned_addr learned my addr 172.21.15.82:0/1712770014 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:57:50.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.637+0000 7fefdd59b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4588a1050 0x55c4588a0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:50.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.637+0000 7fefdcd9a700 1 --2- 172.21.15.82:0/1712770014 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c4588a6790 0x55c4588b1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:50.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.637+0000 7fefddd9c700 1 -- 172.21.15.82:0/1712770014 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c4588a6790 msgr2=0x55c4588b1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:50.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.637+0000 7fefddd9c700 1 --2- 172.21.15.82:0/1712770014 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c4588a6790 0x55c4588b1b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.637+0000 7fefddd9c700 1 -- 172.21.15.82:0/1712770014 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4588a1050 msgr2=0x55c4588a0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:50.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.637+0000 7fefddd9c700 1 --2- 172.21.15.82:0/1712770014 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4588a1050 0x55c4588a0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.637+0000 7fefddd9c700 1 -- 172.21.15.82:0/1712770014 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c458603c60 con 0x55c4588a70b0 2023-09-23T08:57:50.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.638+0000 7fefddd9c700 1 --2- 172.21.15.82:0/1712770014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4588a70b0 0x55c4588b6dc0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fefd000b0a0 tx=0x7fefd0009510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e604ee9783883c5f server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:50.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.638+0000 7fefc3fff700 1 -- 172.21.15.82:0/1712770014 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd000e040 con 0x55c4588a70b0 2023-09-23T08:57:50.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.638+0000 7fefc3fff700 1 -- 172.21.15.82:0/1712770014 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fefd000be40 con 0x55c4588a70b0 2023-09-23T08:57:50.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.638+0000 7fefc3fff700 1 -- 172.21.15.82:0/1712770014 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd0005520 con 0x55c4588a70b0 2023-09-23T08:57:50.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.639+0000 7feff3076b80 1 -- 172.21.15.82:0/1712770014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4588a70b0 msgr2=0x55c4588b6dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:50.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.639+0000 7feff3076b80 1 --2- 172.21.15.82:0/1712770014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4588a70b0 0x55c4588b6dc0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fefd000b0a0 tx=0x7fefd0009510 comp rx=0 tx=0).stop 2023-09-23T08:57:50.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.639+0000 7feff3076b80 1 -- 172.21.15.82:0/1712770014 shutdown_connections 2023-09-23T08:57:50.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.639+0000 7feff3076b80 1 --2- 172.21.15.82:0/1712770014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4588a70b0 0x55c4588b6dc0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.639+0000 7feff3076b80 1 --2- 172.21.15.82:0/1712770014 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4588a1050 0x55c4588a0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.639+0000 7feff3076b80 1 --2- 172.21.15.82:0/1712770014 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c4588a6790 0x55c4588b1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.639+0000 7feff3076b80 1 -- 172.21.15.82:0/1712770014 >> 172.21.15.82:0/1712770014 conn(0x55c4588110e0 msgr2=0x55c458890b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:50.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.639+0000 7feff3076b80 1 -- 172.21.15.82:0/1712770014 shutdown_connections 2023-09-23T08:57:50.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.639+0000 7feff3076b80 1 -- 172.21.15.82:0/1712770014 wait complete. 2023-09-23T08:57:50.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.639+0000 7feff3076b80 1 -- start start 2023-09-23T08:57:50.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.640+0000 7feff3076b80 1 Processor -- start 2023-09-23T08:57:50.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.640+0000 7feff3076b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c4588a1050 0x55c4588afd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:50.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.640+0000 7feff3076b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4588a6790 0x55c4588b0280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:50.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.640+0000 7feff3076b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4588a70b0 0x55c458907600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:50.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.640+0000 7feff3076b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c458907b80 con 0x55c4588a70b0 2023-09-23T08:57:50.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.640+0000 7feff3076b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c458907cf0 con 0x55c4588a6790 2023-09-23T08:57:50.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.640+0000 7feff3076b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c458907eb0 con 0x55c4588a1050 2023-09-23T08:57:50.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.640+0000 7feff3076b80 10 client.0 _ll_register_callbacks cb 0x7fefd4098cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T08:57:50.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.641+0000 7fefdcd9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4588a6790 0x55c4588b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:50.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.641+0000 7fefdcd9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4588a6790 0x55c4588b0280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:37266/0 (socket says 172.21.15.82:37266) 2023-09-23T08:57:50.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.641+0000 7fefdcd9a700 1 -- 172.21.15.82:0/1542770188 learned_addr learned my addr 172.21.15.82:0/1542770188 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:57:50.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.641+0000 7fefddd9c700 1 --2- 172.21.15.82:0/1542770188 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4588a70b0 0x55c458907600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:50.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.641+0000 7fefdd59b700 1 --2- 172.21.15.82:0/1542770188 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c4588a1050 0x55c4588afd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:50.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.641+0000 7fefddd9c700 1 -- 172.21.15.82:0/1542770188 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c4588a1050 msgr2=0x55c4588afd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:50.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.641+0000 7fefddd9c700 1 --2- 172.21.15.82:0/1542770188 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c4588a1050 0x55c4588afd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.641+0000 7fefddd9c700 1 -- 172.21.15.82:0/1542770188 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4588a6790 msgr2=0x55c4588b0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:50.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.641+0000 7fefddd9c700 1 --2- 172.21.15.82:0/1542770188 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4588a6790 0x55c4588b0280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.641+0000 7fefddd9c700 1 -- 172.21.15.82:0/1542770188 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefd810e070 con 0x55c4588a70b0 2023-09-23T08:57:50.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.641+0000 7fefdd59b700 1 --2- 172.21.15.82:0/1542770188 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c4588a1050 0x55c4588afd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T08:57:50.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.641+0000 7fefddd9c700 1 --2- 172.21.15.82:0/1542770188 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4588a70b0 0x55c458907600 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fefd000bfd0 tx=0x7fefd0004e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd178236f0713c2c server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:50.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.641+0000 7fefc0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T08:57:50.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.642+0000 7fefc0ff9700 1 -- 172.21.15.82:0/1542770188 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd000e030 con 0x55c4588a70b0 2023-09-23T08:57:50.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.642+0000 7feff3076b80 1 -- 172.21.15.82:0/1542770188 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c45888f8b0 con 0x55c4588a70b0 2023-09-23T08:57:50.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.642+0000 7fefc0ff9700 1 -- 172.21.15.82:0/1542770188 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fefd0004ee0 con 0x55c4588a70b0 2023-09-23T08:57:50.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.642+0000 7fefc0ff9700 1 -- 172.21.15.82:0/1542770188 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fefd0006040 con 0x55c4588a70b0 2023-09-23T08:57:50.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.642+0000 7feff3076b80 10 client.15882 fetch_fsmap learned FSMap version 30 2023-09-23T08:57:50.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.642+0000 7feff3076b80 1 -- 172.21.15.82:0/1542770188 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55c458641250 con 0x55c4588a70b0 2023-09-23T08:57:50.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.642+0000 7fefc0ff9700 1 -- 172.21.15.82:0/1542770188 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55c45888f8b0 con 0x55c4588a70b0 2023-09-23T08:57:50.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.642+0000 7fefc0ff9700 1 -- 172.21.15.82:0/1542770188 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 30) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fefd0025030 con 0x55c4588a70b0 2023-09-23T08:57:50.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.643+0000 7feff3076b80 10 client.15882 fetch_fsmap finished waiting for FSMap version 30 2023-09-23T08:57:50.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.643+0000 7feff3076b80 10 client.15882 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T08:57:50.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.643+0000 7feff3076b80 20 client.15882 populate_metadata read hostname 'smithi082' 2023-09-23T08:57:50.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.643+0000 7feff3076b80 1 --2- 172.21.15.82:0/1542770188 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55c45890f620 0x55c458911a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:50.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.643+0000 7feff3076b80 4 client.15882 mds_command: new command op to 24557 tid=0[{"prefix": "damage ls"}] 2023-09-23T08:57:50.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.643+0000 7feff3076b80 1 -- 172.21.15.82:0/1542770188 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55c4587e7970 con 0x55c45890f620 2023-09-23T08:57:50.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.643+0000 7fefdd59b700 1 --2- 172.21.15.82:0/1542770188 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55c45890f620 0x55c458911a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:50.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.644+0000 7fefc0ff9700 10 client.15882 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T08:57:50.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.644+0000 7fefdd59b700 1 --2- 172.21.15.82:0/1542770188 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55c45890f620 0x55c458911a40 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f549a83d988a53 server_cookie=8db59fb1673a5ab6 in_seq=0 out_seq=0 2023-09-23T08:57:50.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.644+0000 7fefc0ff9700 1 -- 172.21.15.82:0/1542770188 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55c4587e7970 con 0x55c45890f620 2023-09-23T08:57:50.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.644+0000 7fefc0ff9700 10 client.15882 handle_command_reply: tid=0 2023-09-23T08:57:50.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.644+0000 7feff3076b80 1 client.15882 shutdown 2023-09-23T08:57:50.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.644+0000 7feff3076b80 1 -- 172.21.15.82:0/1542770188 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4588a70b0 msgr2=0x55c458907600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:50.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.644+0000 7feff3076b80 1 --2- 172.21.15.82:0/1542770188 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4588a70b0 0x55c458907600 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fefd000bfd0 tx=0x7fefd0004e40 comp rx=0 tx=0).stop 2023-09-23T08:57:50.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.644+0000 7feff3076b80 1 -- 172.21.15.82:0/1542770188 shutdown_connections 2023-09-23T08:57:50.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.644+0000 7feff3076b80 1 --2- 172.21.15.82:0/1542770188 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55c45890f620 0x55c458911a40 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.644+0000 7feff3076b80 1 --2- 172.21.15.82:0/1542770188 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4588a70b0 0x55c458907600 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.644+0000 7feff3076b80 1 --2- 172.21.15.82:0/1542770188 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c4588a1050 0x55c4588afd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.644+0000 7fefc0ff9700 0 client.15882 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T08:57:50.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.644+0000 7feff3076b80 1 --2- 172.21.15.82:0/1542770188 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4588a6790 0x55c4588b0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.644+0000 7feff3076b80 1 -- 172.21.15.82:0/1542770188 >> 172.21.15.82:0/1542770188 conn(0x55c4588110e0 msgr2=0x55c4588b6dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:50.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.644+0000 7feff3076b80 1 -- 172.21.15.82:0/1542770188 shutdown_connections 2023-09-23T08:57:50.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.645+0000 7feff3076b80 1 -- 172.21.15.82:0/1542770188 wait complete. 2023-09-23T08:57:50.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.645+0000 7feff3076b80 20 client.15882 trim_cache size 0 max 16384 2023-09-23T08:57:50.652 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2023-09-23T08:57:50.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.645+0000 7fefdf7ff700 1 -- 172.21.15.82:0/2225950119 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fefc40a0260 msgr2=0x7fefc40a2720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:50.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.645+0000 7fefdf7ff700 1 --2- 172.21.15.82:0/2225950119 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fefc40a0260 0x7fefc40a2720 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fefd8105ee0 tx=0x7fefc8009260 comp rx=0 tx=0).stop 2023-09-23T08:57:50.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.645+0000 7fefdf7ff700 1 -- 172.21.15.82:0/2225950119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefd81008a0 msgr2=0x7fefd819c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:50.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.645+0000 7fefdf7ff700 1 --2- 172.21.15.82:0/2225950119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefd81008a0 0x7fefd819c610 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fefd400e9a0 tx=0x7fefd400ed60 comp rx=0 tx=0).stop 2023-09-23T08:57:50.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.645+0000 7fefdf7ff700 1 -- 172.21.15.82:0/2225950119 shutdown_connections 2023-09-23T08:57:50.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.645+0000 7fefdf7ff700 1 --2- 172.21.15.82:0/2225950119 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fefc40a0260 0x7fefc40a2720 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.645+0000 7fefdf7ff700 1 --2- 172.21.15.82:0/2225950119 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fefd81068b0 0x7fefd8196680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.645+0000 7fefdf7ff700 1 --2- 172.21.15.82:0/2225950119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefd81008a0 0x7fefd819c610 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.645+0000 7fefdf7ff700 1 --2- 172.21.15.82:0/2225950119 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fefd8101260 0x7fefd819cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:50.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.645+0000 7fefdf7ff700 1 -- 172.21.15.82:0/2225950119 >> 172.21.15.82:0/2225950119 conn(0x7fefd80fc390 msgr2=0x7fefd80fc950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:50.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.646+0000 7fefdf7ff700 1 -- 172.21.15.82:0/2225950119 shutdown_connections 2023-09-23T08:57:50.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:50.646+0000 7fefdf7ff700 1 -- 172.21.15.82:0/2225950119 wait complete. 2023-09-23T08:57:50.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:57:50 smithi135 ceph-mon[99205]: pgmap v31: 97 pgs: 97 active+clean; 364 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 30 MiB/s wr, 32 op/s 2023-09-23T08:57:50.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:57:50 smithi161 ceph-mon[99580]: pgmap v31: 97 pgs: 97 active+clean; 364 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 30 MiB/s wr, 32 op/s 2023-09-23T08:57:51.082 INFO:teuthology.orchestra.run.smithi082.stderr:1700000 of 50000000 tuples (3%) done (elapsed 25.82 s, remaining 733.70 s) 2023-09-23T08:57:51.668 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-09-23T08:57:51.669 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-09-23T08:57:51.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.887+0000 7f21bf59e700 1 -- 172.21.15.82:0/837686531 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21c0106720 msgr2=0x7f21c0106b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:51.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.887+0000 7f21bf59e700 1 --2- 172.21.15.82:0/837686531 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21c0106720 0x7f21c0106b00 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f21b0009990 tx=0x7f21b0009ca0 comp rx=0 tx=0).stop 2023-09-23T08:57:51.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.887+0000 7f21bf59e700 1 -- 172.21.15.82:0/837686531 shutdown_connections 2023-09-23T08:57:51.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.887+0000 7f21bf59e700 1 --2- 172.21.15.82:0/837686531 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f21c01010d0 0x7f21c010d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:51.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.888+0000 7f21bf59e700 1 --2- 172.21.15.82:0/837686531 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21c0106720 0x7f21c0106b00 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:51.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.888+0000 7f21bf59e700 1 --2- 172.21.15.82:0/837686531 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f21c0100710 0x7f21c0100b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:51.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.888+0000 7f21bf59e700 1 -- 172.21.15.82:0/837686531 >> 172.21.15.82:0/837686531 conn(0x7f21c00fc1e0 msgr2=0x7f21c00fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:51.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.888+0000 7f21bf59e700 1 -- 172.21.15.82:0/837686531 shutdown_connections 2023-09-23T08:57:51.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.888+0000 7f21bf59e700 1 -- 172.21.15.82:0/837686531 wait complete. 2023-09-23T08:57:51.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.889+0000 7f21bf59e700 1 Processor -- start 2023-09-23T08:57:51.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.889+0000 7f21bf59e700 1 -- start start 2023-09-23T08:57:51.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.889+0000 7f21bf59e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f21c0100710 0x7f21c0072c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:51.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.889+0000 7f21bf59e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21c01010d0 0x7f21c0073160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:51.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.889+0000 7f21bf59e700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f21c0106720 0x7f21c01a4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:51.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.889+0000 7f21bf59e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c0073990 con 0x7f21c01010d0 2023-09-23T08:57:51.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.889+0000 7f21bf59e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c01a4da0 con 0x7f21c0100710 2023-09-23T08:57:51.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.889+0000 7f21bf59e700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c01a4ee0 con 0x7f21c0106720 2023-09-23T08:57:51.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.890+0000 7f21be59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f21c0100710 0x7f21c0072c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:51.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.890+0000 7f21bdd9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21c01010d0 0x7f21c0073160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:51.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.890+0000 7f21be59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f21c0100710 0x7f21c0072c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:41408/0 (socket says 172.21.15.82:41408) 2023-09-23T08:57:51.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.890+0000 7f21be59c700 1 -- 172.21.15.82:0/3384907062 learned_addr learned my addr 172.21.15.82:0/3384907062 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:57:51.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.890+0000 7f21bed9d700 1 --2- 172.21.15.82:0/3384907062 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f21c0106720 0x7f21c01a4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:51.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.890+0000 7f21bdd9b700 1 -- 172.21.15.82:0/3384907062 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f21c0106720 msgr2=0x7f21c01a4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:51.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.890+0000 7f21bdd9b700 1 --2- 172.21.15.82:0/3384907062 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f21c0106720 0x7f21c01a4860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:51.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.890+0000 7f21bdd9b700 1 -- 172.21.15.82:0/3384907062 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f21c0100710 msgr2=0x7f21c0072c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:51.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.890+0000 7f21bdd9b700 1 --2- 172.21.15.82:0/3384907062 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f21c0100710 0x7f21c0072c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:51.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.890+0000 7f21bdd9b700 1 -- 172.21.15.82:0/3384907062 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21b00095f0 con 0x7f21c01010d0 2023-09-23T08:57:51.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.890+0000 7f21be59c700 1 --2- 172.21.15.82:0/3384907062 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f21c0100710 0x7f21c0072c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T08:57:51.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.891+0000 7f21bdd9b700 1 --2- 172.21.15.82:0/3384907062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21c01010d0 0x7f21c0073160 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f21b400e9f0 tx=0x7f21b400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:51.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.891+0000 7f21af7fe700 1 -- 172.21.15.82:0/3384907062 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b400c9c0 con 0x7f21c01010d0 2023-09-23T08:57:51.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.891+0000 7f21bf59e700 1 -- 172.21.15.82:0/3384907062 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21c01a5140 con 0x7f21c01010d0 2023-09-23T08:57:51.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.891+0000 7f21af7fe700 1 -- 172.21.15.82:0/3384907062 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f21b4010430 con 0x7f21c01010d0 2023-09-23T08:57:51.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.891+0000 7f21af7fe700 1 -- 172.21.15.82:0/3384907062 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b4018680 con 0x7f21c01010d0 2023-09-23T08:57:51.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.891+0000 7f21bf59e700 1 -- 172.21.15.82:0/3384907062 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21c01a5670 con 0x7f21c01010d0 2023-09-23T08:57:51.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.896+0000 7f21af7fe700 1 -- 172.21.15.82:0/3384907062 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) v1 ==== 134904+0+0 (secure 0 0 0) 0x7f21b40105a0 con 0x7f21c01010d0 2023-09-23T08:57:51.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.897+0000 7f21d8764b80 1 Processor -- start 2023-09-23T08:57:51.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.897+0000 7f21d8764b80 1 -- start start 2023-09-23T08:57:51.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.897+0000 7f21d8764b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562b9434c580 0x562b9434c960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:51.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.897+0000 7f21d8764b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562b9434cea0 0x562b94346780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:51.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.897+0000 7f21d8764b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b94346cc0 0x562b94347100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:51.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.897+0000 7f21d8764b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b942ae830 con 0x562b9434c580 2023-09-23T08:57:51.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.897+0000 7f21d8764b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b9429f800 con 0x562b94346cc0 2023-09-23T08:57:51.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.897+0000 7f21d8764b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b9429d120 con 0x562b9434cea0 2023-09-23T08:57:51.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.898+0000 7f21af7fe700 1 --2- 172.21.15.82:0/3384907062 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f21a80a0280 0x7f21a80a2740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:51.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.898+0000 7f21be59c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562b9434cea0 0x562b94346780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:51.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.898+0000 7f21be59c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562b9434cea0 0x562b94346780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:55990/0 (socket says 172.21.15.82:55990) 2023-09-23T08:57:51.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.898+0000 7f21be59c700 1 -- 172.21.15.82:0/3114359876 learned_addr learned my addr 172.21.15.82:0/3114359876 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:57:51.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.898+0000 7f21bed9d700 1 --2- 172.21.15.82:0/3114359876 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562b9434c580 0x562b9434c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:51.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.898+0000 7f21bdd9b700 1 --2- 172.21.15.82:0/3114359876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b94346cc0 0x562b94347100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:51.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.898+0000 7f21bed9d700 1 --2- 172.21.15.82:0/3384907062 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f21a80a0280 0x7f21a80a2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:51.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.898+0000 7f21af7fe700 1 -- 172.21.15.82:0/3384907062 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f21b4014070 con 0x7f21c01010d0 2023-09-23T08:57:51.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.898+0000 7f21be59c700 1 -- 172.21.15.82:0/3114359876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b94346cc0 msgr2=0x562b94347100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:51.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.898+0000 7f21be59c700 1 --2- 172.21.15.82:0/3114359876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b94346cc0 0x562b94347100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:51.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.898+0000 7f21be59c700 1 -- 172.21.15.82:0/3114359876 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562b9434c580 msgr2=0x562b9434c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:51.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.898+0000 7f21be59c700 1 --2- 172.21.15.82:0/3114359876 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562b9434c580 0x562b9434c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:51.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.898+0000 7f21be59c700 1 -- 172.21.15.82:0/3114359876 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562b941186b0 con 0x562b9434cea0 2023-09-23T08:57:51.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.898+0000 7f21bed9d700 1 --2- 172.21.15.82:0/3114359876 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562b9434c580 0x562b9434c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T08:57:51.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.899+0000 7f21be59c700 1 --2- 172.21.15.82:0/3114359876 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562b9434cea0 0x562b94346780 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f21b0005c70 tx=0x7f21b0004500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2fb9350e11b0344c server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:51.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.899+0000 7f21bed9d700 1 --2- 172.21.15.82:0/3384907062 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f21a80a0280 0x7f21a80a2740 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f21c0074d30 tx=0x7f21b8009100 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:51.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.899+0000 7f21acff9700 1 -- 172.21.15.82:0/3114359876 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b001d050 con 0x562b9434cea0 2023-09-23T08:57:51.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.899+0000 7f21acff9700 1 -- 172.21.15.82:0/3114359876 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f21b001e040 con 0x562b9434cea0 2023-09-23T08:57:51.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.899+0000 7f21acff9700 1 -- 172.21.15.82:0/3114359876 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b0004d00 con 0x562b9434cea0 2023-09-23T08:57:51.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.900+0000 7f21d8764b80 1 -- 172.21.15.82:0/3114359876 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562b9434cea0 msgr2=0x562b94346780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:51.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.900+0000 7f21d8764b80 1 --2- 172.21.15.82:0/3114359876 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562b9434cea0 0x562b94346780 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f21b0005c70 tx=0x7f21b0004500 comp rx=0 tx=0).stop 2023-09-23T08:57:51.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.900+0000 7f21d8764b80 1 -- 172.21.15.82:0/3114359876 shutdown_connections 2023-09-23T08:57:51.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.900+0000 7f21d8764b80 1 --2- 172.21.15.82:0/3114359876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b94346cc0 0x562b94347100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:51.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.900+0000 7f21d8764b80 1 --2- 172.21.15.82:0/3114359876 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562b9434c580 0x562b9434c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:51.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.900+0000 7f21d8764b80 1 --2- 172.21.15.82:0/3114359876 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562b9434cea0 0x562b94346780 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:51.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.900+0000 7f21d8764b80 1 -- 172.21.15.82:0/3114359876 >> 172.21.15.82:0/3114359876 conn(0x562b942bb160 msgr2=0x562b943419c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:51.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.900+0000 7f21d8764b80 1 -- 172.21.15.82:0/3114359876 shutdown_connections 2023-09-23T08:57:51.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.900+0000 7f21d8764b80 1 -- 172.21.15.82:0/3114359876 wait complete. 2023-09-23T08:57:51.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.900+0000 7f21d8764b80 1 -- start start 2023-09-23T08:57:51.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.901+0000 7f21d8764b80 1 Processor -- start 2023-09-23T08:57:51.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.901+0000 7f21d8764b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562b94346cc0 0x562b94350220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:51.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.901+0000 7f21d8764b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b9434c580 0x562b94350760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:51.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.901+0000 7f21d8764b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562b9434cea0 0x562b94350ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:51.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.902+0000 7f21d8764b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b94298a10 con 0x562b9434cea0 2023-09-23T08:57:51.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.902+0000 7f21d8764b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b94236c30 con 0x562b9434c580 2023-09-23T08:57:51.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.902+0000 7f21d8764b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b94236930 con 0x562b94346cc0 2023-09-23T08:57:51.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.902+0000 7f21d8764b80 10 client.0 _ll_register_callbacks cb 0x562b94180b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T08:57:51.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.902+0000 7f21be59c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562b94346cc0 0x562b94350220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:51.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.902+0000 7f21be59c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562b94346cc0 0x562b94350220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:56002/0 (socket says 172.21.15.82:56002) 2023-09-23T08:57:51.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.902+0000 7f21be59c700 1 -- 172.21.15.82:0/2104986050 learned_addr learned my addr 172.21.15.82:0/2104986050 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:57:51.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.902+0000 7f21bed9d700 1 --2- 172.21.15.82:0/2104986050 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562b9434cea0 0x562b94350ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:51.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.902+0000 7f21be59c700 1 -- 172.21.15.82:0/2104986050 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b9434c580 msgr2=0x562b94350760 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-23T08:57:51.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.902+0000 7f21be59c700 1 --2- 172.21.15.82:0/2104986050 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b9434c580 0x562b94350760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:51.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.902+0000 7f21be59c700 1 -- 172.21.15.82:0/2104986050 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562b9434cea0 msgr2=0x562b94350ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:51.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.902+0000 7f21be59c700 1 --2- 172.21.15.82:0/2104986050 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562b9434cea0 0x562b94350ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:51.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.902+0000 7f21be59c700 1 -- 172.21.15.82:0/2104986050 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21b8011040 con 0x562b94346cc0 2023-09-23T08:57:51.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.903+0000 7f21be59c700 1 --2- 172.21.15.82:0/2104986050 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562b94346cc0 0x562b94350220 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f21b0009ce0 tx=0x7f21b0023aa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd71009515f97b3a server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:51.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.903+0000 7f21a5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T08:57:51.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.903+0000 7f21a5ffb700 1 -- 172.21.15.82:0/2104986050 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b000f660 con 0x562b94346cc0 2023-09-23T08:57:51.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.903+0000 7f21a5ffb700 1 -- 172.21.15.82:0/2104986050 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f21b0004570 con 0x562b94346cc0 2023-09-23T08:57:51.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.903+0000 7f21d8764b80 1 -- 172.21.15.82:0/2104986050 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562b94316240 con 0x562b94346cc0 2023-09-23T08:57:51.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.903+0000 7f21a5ffb700 1 -- 172.21.15.82:0/2104986050 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f21b0005940 con 0x562b94346cc0 2023-09-23T08:57:51.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.903+0000 7f21d8764b80 10 client.25636 fetch_fsmap learned FSMap version 30 2023-09-23T08:57:51.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.903+0000 7f21d8764b80 1 -- 172.21.15.82:0/2104986050 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x7f21c010dee0 con 0x562b94346cc0 2023-09-23T08:57:51.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.904+0000 7f21a5ffb700 1 -- 172.21.15.82:0/2104986050 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562b94316240 con 0x562b94346cc0 2023-09-23T08:57:51.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.904+0000 7f21a5ffb700 1 -- 172.21.15.82:0/2104986050 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 30) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f21b002c720 con 0x562b94346cc0 2023-09-23T08:57:51.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.904+0000 7f21d8764b80 10 client.25636 fetch_fsmap finished waiting for FSMap version 30 2023-09-23T08:57:51.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.904+0000 7f21d8764b80 10 client.25636 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T08:57:51.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.904+0000 7f21d8764b80 20 client.25636 populate_metadata read hostname 'smithi082' 2023-09-23T08:57:51.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.904+0000 7f21d8764b80 1 --2- 172.21.15.82:0/2104986050 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x562b943715e0 0x562b94373a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:51.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.904+0000 7f21d8764b80 4 client.25636 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T08:57:51.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.904+0000 7f21d8764b80 1 -- 172.21.15.82:0/2104986050 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562b9423ec20 con 0x562b943715e0 2023-09-23T08:57:51.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.905+0000 7f21bdd9b700 1 --2- 172.21.15.82:0/2104986050 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x562b943715e0 0x562b94373a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:51.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.905+0000 7f21bdd9b700 1 --2- 172.21.15.82:0/2104986050 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x562b943715e0 0x562b94373a00 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1796b90c72433cf6 server_cookie=dbb88d35739ea3d5 in_seq=0 out_seq=0 2023-09-23T08:57:51.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.905+0000 7f21a5ffb700 10 client.25636 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T08:57:51.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.906+0000 7f21a5ffb700 1 -- 172.21.15.82:0/2104986050 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x562b9423ec20 con 0x562b943715e0 2023-09-23T08:57:51.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.906+0000 7f21a5ffb700 10 client.25636 handle_command_reply: tid=0 2023-09-23T08:57:51.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.906+0000 7f21d8764b80 1 client.25636 shutdown 2023-09-23T08:57:51.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.906+0000 7f21d8764b80 1 -- 172.21.15.82:0/2104986050 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562b94346cc0 msgr2=0x562b94350220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:51.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.906+0000 7f21d8764b80 1 --2- 172.21.15.82:0/2104986050 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562b94346cc0 0x562b94350220 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f21b0009ce0 tx=0x7f21b0023aa0 comp rx=0 tx=0).stop 2023-09-23T08:57:51.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.906+0000 7f21d8764b80 1 -- 172.21.15.82:0/2104986050 shutdown_connections 2023-09-23T08:57:51.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.906+0000 7f21d8764b80 1 --2- 172.21.15.82:0/2104986050 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x562b943715e0 0x562b94373a00 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:51.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.906+0000 7f21d8764b80 1 --2- 172.21.15.82:0/2104986050 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562b9434cea0 0x562b94350ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:51.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.906+0000 7f21d8764b80 1 --2- 172.21.15.82:0/2104986050 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562b94346cc0 0x562b94350220 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:51.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.906+0000 7f21a5ffb700 0 client.25636 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T08:57:51.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.906+0000 7f21d8764b80 1 --2- 172.21.15.82:0/2104986050 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b9434c580 0x562b94350760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:51.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.906+0000 7f21d8764b80 1 -- 172.21.15.82:0/2104986050 >> 172.21.15.82:0/2104986050 conn(0x562b942bb160 msgr2=0x562b94345770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:51.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.906+0000 7f21d8764b80 1 -- 172.21.15.82:0/2104986050 shutdown_connections 2023-09-23T08:57:51.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.906+0000 7f21d8764b80 1 -- 172.21.15.82:0/2104986050 wait complete. 2023-09-23T08:57:51.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.907+0000 7f21d8764b80 20 client.25636 trim_cache size 0 max 16384 2023-09-23T08:57:51.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.925+0000 7f21d8764b80 1 Processor -- start 2023-09-23T08:57:51.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.925+0000 7f21d8764b80 1 -- start start 2023-09-23T08:57:51.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.925+0000 7f21d8764b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562b94346cc0 0x562b9434a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:51.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.925+0000 7f21d8764b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562b9434c580 0x562b9434bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:51.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.925+0000 7f21d8764b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b9434cea0 0x562b94350ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:51.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.925+0000 7f21d8764b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b9411a9a0 con 0x562b94346cc0 2023-09-23T08:57:51.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.925+0000 7f21d8764b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b9433da80 con 0x562b9434cea0 2023-09-23T08:57:51.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.925+0000 7f21d8764b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b94342820 con 0x562b9434c580 2023-09-23T08:57:51.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.926+0000 7f21be59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562b94346cc0 0x562b9434a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:51.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.926+0000 7f21be59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562b94346cc0 0x562b9434a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43110/0 (socket says 172.21.15.82:43110) 2023-09-23T08:57:51.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.926+0000 7f21be59c700 1 -- 172.21.15.82:0/1957992107 learned_addr learned my addr 172.21.15.82:0/1957992107 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:57:51.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.926+0000 7f21bdd9b700 1 --2- 172.21.15.82:0/1957992107 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562b9434c580 0x562b9434bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:51.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.926+0000 7f21bed9d700 1 --2- 172.21.15.82:0/1957992107 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b9434cea0 0x562b94350ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:51.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.926+0000 7f21bdd9b700 1 -- 172.21.15.82:0/1957992107 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b9434cea0 msgr2=0x562b94350ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:51.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.926+0000 7f21bdd9b700 1 --2- 172.21.15.82:0/1957992107 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b9434cea0 0x562b94350ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:51.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.926+0000 7f21bdd9b700 1 -- 172.21.15.82:0/1957992107 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562b94346cc0 msgr2=0x562b9434a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:51.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.926+0000 7f21bdd9b700 1 --2- 172.21.15.82:0/1957992107 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562b94346cc0 0x562b9434a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:51.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.926+0000 7f21bdd9b700 1 -- 172.21.15.82:0/1957992107 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562b94378650 con 0x562b9434c580 2023-09-23T08:57:51.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.926+0000 7f21bed9d700 1 --2- 172.21.15.82:0/1957992107 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b9434cea0 0x562b94350ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T08:57:51.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.926+0000 7f21be59c700 1 --2- 172.21.15.82:0/1957992107 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562b94346cc0 0x562b9434a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T08:57:51.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.927+0000 7f21bdd9b700 1 --2- 172.21.15.82:0/1957992107 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562b9434c580 0x562b9434bb00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f21b40c8fe0 tx=0x7f21b408e860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ecde000a1255fab server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:51.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.927+0000 7f21ad7fa700 1 -- 172.21.15.82:0/1957992107 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b4098830 con 0x562b9434c580 2023-09-23T08:57:51.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.927+0000 7f21ad7fa700 1 -- 172.21.15.82:0/1957992107 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f21b4010880 con 0x562b9434c580 2023-09-23T08:57:51.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.927+0000 7f21ad7fa700 1 -- 172.21.15.82:0/1957992107 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b409cd90 con 0x562b9434c580 2023-09-23T08:57:51.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.928+0000 7f21d8764b80 1 -- 172.21.15.82:0/1957992107 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562b9434c580 msgr2=0x562b9434bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:51.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.928+0000 7f21d8764b80 1 --2- 172.21.15.82:0/1957992107 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562b9434c580 0x562b9434bb00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f21b40c8fe0 tx=0x7f21b408e860 comp rx=0 tx=0).stop 2023-09-23T08:57:51.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.928+0000 7f21d8764b80 1 -- 172.21.15.82:0/1957992107 shutdown_connections 2023-09-23T08:57:51.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.928+0000 7f21d8764b80 1 --2- 172.21.15.82:0/1957992107 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b9434cea0 0x562b94350ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:51.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.928+0000 7f21d8764b80 1 --2- 172.21.15.82:0/1957992107 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562b94346cc0 0x562b9434a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:51.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.928+0000 7f21d8764b80 1 --2- 172.21.15.82:0/1957992107 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562b9434c580 0x562b9434bb00 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:51.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.928+0000 7f21d8764b80 1 -- 172.21.15.82:0/1957992107 >> 172.21.15.82:0/1957992107 conn(0x562b942bb160 msgr2=0x562b94341120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:51.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.928+0000 7f21d8764b80 1 -- 172.21.15.82:0/1957992107 shutdown_connections 2023-09-23T08:57:51.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.928+0000 7f21d8764b80 1 -- 172.21.15.82:0/1957992107 wait complete. 2023-09-23T08:57:51.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.928+0000 7f21d8764b80 1 -- start start 2023-09-23T08:57:51.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.929+0000 7f21d8764b80 1 Processor -- start 2023-09-23T08:57:51.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.929+0000 7f21d8764b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562b94346cc0 0x562b94356160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:51.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.929+0000 7f21d8764b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562b9434c580 0x562b943566a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:51.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.929+0000 7f21d8764b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b9434cea0 0x562b94356be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:51.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.929+0000 7f21d8764b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b943c5480 con 0x562b94346cc0 2023-09-23T08:57:51.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.929+0000 7f21d8764b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b943c55c0 con 0x562b9434cea0 2023-09-23T08:57:51.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.929+0000 7f21d8764b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b943c5750 con 0x562b9434c580 2023-09-23T08:57:51.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.929+0000 7f21d8764b80 10 client.0 _ll_register_callbacks cb 0x7f21b8009c90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T08:57:51.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.930+0000 7f21be59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562b94346cc0 0x562b94356160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:51.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.930+0000 7f21be59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562b94346cc0 0x562b94356160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43124/0 (socket says 172.21.15.82:43124) 2023-09-23T08:57:51.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.930+0000 7f21be59c700 1 -- 172.21.15.82:0/3335919202 learned_addr learned my addr 172.21.15.82:0/3335919202 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:57:51.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.930+0000 7f21bed9d700 1 --2- 172.21.15.82:0/3335919202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b9434cea0 0x562b94356be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:51.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.930+0000 7f21bdd9b700 1 --2- 172.21.15.82:0/3335919202 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562b9434c580 0x562b943566a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:51.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.930+0000 7f21be59c700 1 -- 172.21.15.82:0/3335919202 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562b9434c580 msgr2=0x562b943566a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:51.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.930+0000 7f21be59c700 1 --2- 172.21.15.82:0/3335919202 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562b9434c580 0x562b943566a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:51.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.930+0000 7f21be59c700 1 -- 172.21.15.82:0/3335919202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b9434cea0 msgr2=0x562b94356be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:51.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.930+0000 7f21be59c700 1 --2- 172.21.15.82:0/3335919202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b9434cea0 0x562b94356be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:51.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.930+0000 7f21be59c700 1 -- 172.21.15.82:0/3335919202 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21c010dee0 con 0x562b94346cc0 2023-09-23T08:57:51.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.930+0000 7f21bdd9b700 1 --2- 172.21.15.82:0/3335919202 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562b9434c580 0x562b943566a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T08:57:51.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.931+0000 7f21be59c700 1 --2- 172.21.15.82:0/3335919202 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562b94346cc0 0x562b94356160 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f21b0009ce0 tx=0x7f21b002cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3713ad8cfd800d8d server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:51.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.931+0000 7f21a5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T08:57:51.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.931+0000 7f21a5ffb700 1 -- 172.21.15.82:0/3335919202 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b001d040 con 0x562b94346cc0 2023-09-23T08:57:51.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.931+0000 7f21d8764b80 1 -- 172.21.15.82:0/3335919202 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562b9436e420 con 0x562b94346cc0 2023-09-23T08:57:51.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.931+0000 7f21a5ffb700 1 -- 172.21.15.82:0/3335919202 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f21b002c840 con 0x562b94346cc0 2023-09-23T08:57:51.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.931+0000 7f21a5ffb700 1 -- 172.21.15.82:0/3335919202 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f21b0005070 con 0x562b94346cc0 2023-09-23T08:57:51.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.931+0000 7f21d8764b80 10 client.15900 fetch_fsmap learned FSMap version 30 2023-09-23T08:57:51.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.931+0000 7f21d8764b80 1 -- 172.21.15.82:0/3335919202 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x7f21c01a5670 con 0x562b94346cc0 2023-09-23T08:57:51.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.931+0000 7f21a5ffb700 1 -- 172.21.15.82:0/3335919202 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562b9436e420 con 0x562b94346cc0 2023-09-23T08:57:51.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.932+0000 7f21a5ffb700 1 -- 172.21.15.82:0/3335919202 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 30) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f21b00049c0 con 0x562b94346cc0 2023-09-23T08:57:51.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.932+0000 7f21d8764b80 10 client.15900 fetch_fsmap finished waiting for FSMap version 30 2023-09-23T08:57:51.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.932+0000 7f21d8764b80 10 client.15900 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T08:57:51.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.932+0000 7f21d8764b80 20 client.15900 populate_metadata read hostname 'smithi082' 2023-09-23T08:57:51.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.932+0000 7f21d8764b80 1 --2- 172.21.15.82:0/3335919202 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x562b943c6bd0 0x562b943c8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:51.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.932+0000 7f21d8764b80 4 client.15900 mds_command: new command op to 24557 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-09-23T08:57:51.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.932+0000 7f21d8764b80 1 -- 172.21.15.82:0/3335919202 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x562b94339930 con 0x562b943c6bd0 2023-09-23T08:57:51.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.932+0000 7f21bdd9b700 1 --2- 172.21.15.82:0/3335919202 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x562b943c6bd0 0x562b943c8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:51.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.933+0000 7f21a5ffb700 10 client.15900 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T08:57:51.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.933+0000 7f21bdd9b700 1 --2- 172.21.15.82:0/3335919202 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x562b943c6bd0 0x562b943c8ff0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=edc8e68d8a10d372 server_cookie=c7ee6bddcc20e418 in_seq=0 out_seq=0 2023-09-23T08:57:51.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.934+0000 7f21a5ffb700 1 -- 172.21.15.82:0/3335919202 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x562b94339930 con 0x562b943c6bd0 2023-09-23T08:57:51.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.934+0000 7f21a5ffb700 10 client.15900 handle_command_reply: tid=0 2023-09-23T08:57:51.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.934+0000 7f21d8764b80 1 client.15900 shutdown 2023-09-23T08:57:51.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.934+0000 7f21d8764b80 1 -- 172.21.15.82:0/3335919202 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562b94346cc0 msgr2=0x562b94356160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:51.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.934+0000 7f21d8764b80 1 --2- 172.21.15.82:0/3335919202 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562b94346cc0 0x562b94356160 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f21b0009ce0 tx=0x7f21b002cef0 comp rx=0 tx=0).stop 2023-09-23T08:57:51.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.934+0000 7f21d8764b80 1 -- 172.21.15.82:0/3335919202 shutdown_connections 2023-09-23T08:57:51.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.934+0000 7f21d8764b80 1 --2- 172.21.15.82:0/3335919202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b9434cea0 0x562b94356be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:51.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.934+0000 7f21d8764b80 1 --2- 172.21.15.82:0/3335919202 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x562b943c6bd0 0x562b943c8ff0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:51.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.934+0000 7f21d8764b80 1 --2- 172.21.15.82:0/3335919202 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562b94346cc0 0x562b94356160 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:51.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.934+0000 7f21d8764b80 1 --2- 172.21.15.82:0/3335919202 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562b9434c580 0x562b943566a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:51.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.934+0000 7f21a5ffb700 0 client.15900 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T08:57:51.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.934+0000 7f21d8764b80 1 -- 172.21.15.82:0/3335919202 >> 172.21.15.82:0/3335919202 conn(0x562b942bb160 msgr2=0x562b943419b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:51.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.934+0000 7f21d8764b80 1 -- 172.21.15.82:0/3335919202 shutdown_connections 2023-09-23T08:57:51.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.934+0000 7f21d8764b80 1 -- 172.21.15.82:0/3335919202 wait complete. 2023-09-23T08:57:51.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.935+0000 7f21d8764b80 20 client.15900 trim_cache size 0 max 16384 2023-09-23T08:57:51.953 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T08:57:51.953 INFO:teuthology.orchestra.run.smithi082.stdout: "return_code": 0, 2023-09-23T08:57:51.953 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_tag": "6f0fe3a6-7212-425d-a0a6-f38e8b42ec13", 2023-09-23T08:57:51.954 INFO:teuthology.orchestra.run.smithi082.stdout: "mode": "asynchronous" 2023-09-23T08:57:51.954 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T08:57:51.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.935+0000 7f21bf59e700 1 -- 172.21.15.82:0/3384907062 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f21a80a0280 msgr2=0x7f21a80a2740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:51.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.935+0000 7f21bf59e700 1 --2- 172.21.15.82:0/3384907062 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f21a80a0280 0x7f21a80a2740 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f21c0074d30 tx=0x7f21b8009100 comp rx=0 tx=0).stop 2023-09-23T08:57:51.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.935+0000 7f21bf59e700 1 -- 172.21.15.82:0/3384907062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21c01010d0 msgr2=0x7f21c0073160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:51.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.935+0000 7f21bf59e700 1 --2- 172.21.15.82:0/3384907062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21c01010d0 0x7f21c0073160 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f21b400e9f0 tx=0x7f21b400ed00 comp rx=0 tx=0).stop 2023-09-23T08:57:51.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.935+0000 7f21bf59e700 1 -- 172.21.15.82:0/3384907062 shutdown_connections 2023-09-23T08:57:51.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.935+0000 7f21bf59e700 1 --2- 172.21.15.82:0/3384907062 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f21a80a0280 0x7f21a80a2740 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:51.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.935+0000 7f21bf59e700 1 --2- 172.21.15.82:0/3384907062 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f21c0106720 0x7f21c01a4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:51.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.935+0000 7f21bf59e700 1 --2- 172.21.15.82:0/3384907062 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f21c0100710 0x7f21c0072c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:51.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.935+0000 7f21bf59e700 1 --2- 172.21.15.82:0/3384907062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21c01010d0 0x7f21c0073160 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:51.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.935+0000 7f21bf59e700 1 -- 172.21.15.82:0/3384907062 >> 172.21.15.82:0/3384907062 conn(0x7f21c00fc1e0 msgr2=0x7f21c00fc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:51.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.936+0000 7f21bf59e700 1 -- 172.21.15.82:0/3384907062 shutdown_connections 2023-09-23T08:57:51.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:51.936+0000 7f21bf59e700 1 -- 172.21.15.82:0/3384907062 wait complete. 2023-09-23T08:57:51.961 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T08:57:52.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.205+0000 7fbc771ff700 1 -- 172.21.15.82:0/3849226453 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc70072cd0 msgr2=0x7fbc700730b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:52.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.206+0000 7fbc771ff700 1 --2- 172.21.15.82:0/3849226453 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc70072cd0 0x7fbc700730b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fbc64009990 tx=0x7fbc64009ca0 comp rx=0 tx=0).stop 2023-09-23T08:57:52.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.206+0000 7fbc771ff700 1 -- 172.21.15.82:0/3849226453 shutdown_connections 2023-09-23T08:57:52.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.206+0000 7fbc771ff700 1 --2- 172.21.15.82:0/3849226453 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc7010d150 0x7fbc7010f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:52.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.206+0000 7fbc771ff700 1 --2- 172.21.15.82:0/3849226453 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc70072cd0 0x7fbc700730b0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:52.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.206+0000 7fbc771ff700 1 --2- 172.21.15.82:0/3849226453 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc700735f0 0x7fbc7010cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:52.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.206+0000 7fbc771ff700 1 -- 172.21.15.82:0/3849226453 >> 172.21.15.82:0/3849226453 conn(0x7fbc700fc380 msgr2=0x7fbc700fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:52.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.206+0000 7fbc771ff700 1 -- 172.21.15.82:0/3849226453 shutdown_connections 2023-09-23T08:57:52.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.206+0000 7fbc771ff700 1 -- 172.21.15.82:0/3849226453 wait complete. 2023-09-23T08:57:52.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.207+0000 7fbc771ff700 1 Processor -- start 2023-09-23T08:57:52.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.207+0000 7fbc771ff700 1 -- start start 2023-09-23T08:57:52.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.207+0000 7fbc771ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc70072cd0 0x7fbc7019e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:52.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.207+0000 7fbc771ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc700735f0 0x7fbc7019ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:52.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.208+0000 7fbc771ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc7010d150 0x7fbc70198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:52.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.208+0000 7fbc771ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc70198ff0 con 0x7fbc70072cd0 2023-09-23T08:57:52.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.208+0000 7fbc771ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc70199160 con 0x7fbc7010d150 2023-09-23T08:57:52.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.208+0000 7fbc771ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc70199320 con 0x7fbc700735f0 2023-09-23T08:57:52.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.208+0000 7fbc6ffff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc700735f0 0x7fbc7019ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:52.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.208+0000 7fbc74f9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc70072cd0 0x7fbc7019e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:52.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.208+0000 7fbc7579c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc7010d150 0x7fbc70198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:52.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.208+0000 7fbc6ffff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc700735f0 0x7fbc7019ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:56040/0 (socket says 172.21.15.82:56040) 2023-09-23T08:57:52.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.208+0000 7fbc6ffff700 1 -- 172.21.15.82:0/329522912 learned_addr learned my addr 172.21.15.82:0/329522912 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:57:52.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.208+0000 7fbc6ffff700 1 -- 172.21.15.82:0/329522912 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc7010d150 msgr2=0x7fbc70198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:52.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.208+0000 7fbc6ffff700 1 --2- 172.21.15.82:0/329522912 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc7010d150 0x7fbc70198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:52.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.208+0000 7fbc6ffff700 1 -- 172.21.15.82:0/329522912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc70072cd0 msgr2=0x7fbc7019e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:52.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.208+0000 7fbc6ffff700 1 --2- 172.21.15.82:0/329522912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc70072cd0 0x7fbc7019e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:52.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.208+0000 7fbc6ffff700 1 -- 172.21.15.82:0/329522912 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc640095f0 con 0x7fbc700735f0 2023-09-23T08:57:52.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.208+0000 7fbc7579c700 1 --2- 172.21.15.82:0/329522912 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc7010d150 0x7fbc70198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T08:57:52.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.209+0000 7fbc6ffff700 1 --2- 172.21.15.82:0/329522912 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc700735f0 0x7fbc7019ee50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c00e9a0 tx=0x7fbc5c00ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:52.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.209+0000 7fbc6dffb700 1 -- 172.21.15.82:0/329522912 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc5c009790 con 0x7fbc700735f0 2023-09-23T08:57:52.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.209+0000 7fbc771ff700 1 -- 172.21.15.82:0/329522912 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc70199600 con 0x7fbc700735f0 2023-09-23T08:57:52.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.209+0000 7fbc6dffb700 1 -- 172.21.15.82:0/329522912 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbc5c010430 con 0x7fbc700735f0 2023-09-23T08:57:52.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.209+0000 7fbc6dffb700 1 -- 172.21.15.82:0/329522912 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc5c00cea0 con 0x7fbc700735f0 2023-09-23T08:57:52.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.209+0000 7fbc771ff700 1 -- 172.21.15.82:0/329522912 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc701a5900 con 0x7fbc700735f0 2023-09-23T08:57:52.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.212+0000 7fbc6dffb700 1 -- 172.21.15.82:0/329522912 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 25) v1 ==== 134904+0+0 (secure 0 0 0) 0x7fbc5c0105a0 con 0x7fbc700735f0 2023-09-23T08:57:52.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.214+0000 7fbc8aad6b80 1 Processor -- start 2023-09-23T08:57:52.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.214+0000 7fbc8aad6b80 1 -- start start 2023-09-23T08:57:52.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.214+0000 7fbc6dffb700 1 --2- 172.21.15.82:0/329522912 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fbc600a01e0 0x7fbc600a26a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:52.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.214+0000 7fbc8aad6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558240c26380 0x558240c26760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:52.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.214+0000 7fbc8aad6b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558240c26ca0 0x558240c20700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:52.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.214+0000 7fbc8aad6b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558240c20c40 0x558240c210a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:52.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.214+0000 7fbc8aad6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x558240b887b0 con 0x558240c26380 2023-09-23T08:57:52.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.214+0000 7fbc8aad6b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x558240b79780 con 0x558240c20c40 2023-09-23T08:57:52.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.214+0000 7fbc8aad6b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x558240b770a0 con 0x558240c26ca0 2023-09-23T08:57:52.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.214+0000 7fbc6dffb700 1 -- 172.21.15.82:0/329522912 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fbc5c014070 con 0x7fbc700735f0 2023-09-23T08:57:52.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.215+0000 7fbc7579c700 1 --2- 172.21.15.82:0/329522912 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fbc600a01e0 0x7fbc600a26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:52.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.215+0000 7fbc74f9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558240c26380 0x558240c26760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:52.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.215+0000 7fbc74f9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558240c26380 0x558240c26760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43150/0 (socket says 172.21.15.82:43150) 2023-09-23T08:57:52.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.215+0000 7fbc74f9b700 1 -- 172.21.15.82:0/1861540385 learned_addr learned my addr 172.21.15.82:0/1861540385 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:57:52.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.215+0000 7fbc7579c700 1 --2- 172.21.15.82:0/1861540385 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558240c20c40 0x558240c210a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:52.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.215+0000 7fbc6ffff700 1 --2- 172.21.15.82:0/1861540385 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558240c26ca0 0x558240c20700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:52.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.215+0000 7fbc74f9b700 1 -- 172.21.15.82:0/1861540385 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558240c26ca0 msgr2=0x558240c20700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:52.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.215+0000 7fbc74f9b700 1 --2- 172.21.15.82:0/1861540385 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558240c26ca0 0x558240c20700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:52.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.215+0000 7fbc74f9b700 1 -- 172.21.15.82:0/1861540385 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558240c20c40 msgr2=0x558240c210a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:52.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.215+0000 7fbc74f9b700 1 --2- 172.21.15.82:0/1861540385 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558240c20c40 0x558240c210a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:52.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.215+0000 7fbc74f9b700 1 -- 172.21.15.82:0/1861540385 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5582409f2630 con 0x558240c26380 2023-09-23T08:57:52.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.215+0000 7fbc7579c700 1 --2- 172.21.15.82:0/1861540385 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558240c20c40 0x558240c210a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T08:57:52.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.215+0000 7fbc6ffff700 1 --2- 172.21.15.82:0/1861540385 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558240c26ca0 0x558240c20700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T08:57:52.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.215+0000 7fbc7579c700 1 --2- 172.21.15.82:0/329522912 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fbc600a01e0 0x7fbc600a26a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbc68009ec0 tx=0x7fbc68003ac0 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:52.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.216+0000 7fbc74f9b700 1 --2- 172.21.15.82:0/1861540385 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558240c26380 0x558240c26760 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fbc64015000 tx=0x7fbc64005f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13e9ac0bd496358c server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:52.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.216+0000 7fbc5affd700 1 -- 172.21.15.82:0/1861540385 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6401d070 con 0x558240c26380 2023-09-23T08:57:52.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.216+0000 7fbc5affd700 1 -- 172.21.15.82:0/1861540385 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbc6401e040 con 0x558240c26380 2023-09-23T08:57:52.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.216+0000 7fbc5affd700 1 -- 172.21.15.82:0/1861540385 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc64004740 con 0x558240c26380 2023-09-23T08:57:52.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.217+0000 7fbc8aad6b80 1 -- 172.21.15.82:0/1861540385 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558240c26380 msgr2=0x558240c26760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:52.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.217+0000 7fbc8aad6b80 1 --2- 172.21.15.82:0/1861540385 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558240c26380 0x558240c26760 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fbc64015000 tx=0x7fbc64005f00 comp rx=0 tx=0).stop 2023-09-23T08:57:52.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.217+0000 7fbc8aad6b80 1 -- 172.21.15.82:0/1861540385 shutdown_connections 2023-09-23T08:57:52.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.217+0000 7fbc8aad6b80 1 --2- 172.21.15.82:0/1861540385 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558240c20c40 0x558240c210a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:52.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.217+0000 7fbc8aad6b80 1 --2- 172.21.15.82:0/1861540385 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558240c26380 0x558240c26760 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:52.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.217+0000 7fbc8aad6b80 1 --2- 172.21.15.82:0/1861540385 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558240c26ca0 0x558240c20700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:52.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.217+0000 7fbc8aad6b80 1 -- 172.21.15.82:0/1861540385 >> 172.21.15.82:0/1861540385 conn(0x558240b950e0 msgr2=0x558240c1b410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:52.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.217+0000 7fbc8aad6b80 1 -- 172.21.15.82:0/1861540385 shutdown_connections 2023-09-23T08:57:52.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.217+0000 7fbc8aad6b80 1 -- 172.21.15.82:0/1861540385 wait complete. 2023-09-23T08:57:52.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.217+0000 7fbc8aad6b80 1 -- start start 2023-09-23T08:57:52.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.218+0000 7fbc8aad6b80 1 Processor -- start 2023-09-23T08:57:52.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.218+0000 7fbc8aad6b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558240c20c40 0x558240c2cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:52.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.218+0000 7fbc8aad6b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558240c26380 0x558240c29ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:52.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.218+0000 7fbc8aad6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558240c26ca0 0x558240c2a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:52.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.218+0000 7fbc8aad6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x558240b72990 con 0x558240c26ca0 2023-09-23T08:57:52.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.218+0000 7fbc8aad6b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x558240b10bb0 con 0x558240c26380 2023-09-23T08:57:52.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.218+0000 7fbc8aad6b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x558240b108b0 con 0x558240c20c40 2023-09-23T08:57:52.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.218+0000 7fbc8aad6b80 10 client.0 _ll_register_callbacks cb 0x558240a5aa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T08:57:52.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.218+0000 7fbc74f9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558240c20c40 0x558240c2cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:52.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.218+0000 7fbc7579c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558240c26ca0 0x558240c2a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:52.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.218+0000 7fbc74f9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558240c20c40 0x558240c2cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:56054/0 (socket says 172.21.15.82:56054) 2023-09-23T08:57:52.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.219+0000 7fbc74f9b700 1 -- 172.21.15.82:0/2838247130 learned_addr learned my addr 172.21.15.82:0/2838247130 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:57:52.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.218+0000 7fbc7579c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558240c26ca0 0x558240c2a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43164/0 (socket says 172.21.15.82:43164) 2023-09-23T08:57:52.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.219+0000 7fbc6ffff700 1 --2- 172.21.15.82:0/2838247130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558240c26380 0x558240c29ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:52.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.219+0000 7fbc74f9b700 1 -- 172.21.15.82:0/2838247130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558240c26380 msgr2=0x558240c29ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:52.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.219+0000 7fbc74f9b700 1 --2- 172.21.15.82:0/2838247130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558240c26380 0x558240c29ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:52.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.219+0000 7fbc74f9b700 1 -- 172.21.15.82:0/2838247130 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558240c26ca0 msgr2=0x558240c2a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:52.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.219+0000 7fbc74f9b700 1 --2- 172.21.15.82:0/2838247130 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558240c26ca0 0x558240c2a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:52.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.219+0000 7fbc74f9b700 1 -- 172.21.15.82:0/2838247130 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc701a5900 con 0x558240c20c40 2023-09-23T08:57:52.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.219+0000 7fbc74f9b700 1 --2- 172.21.15.82:0/2838247130 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558240c20c40 0x558240c2cc20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fbc640098e0 tx=0x7fbc6400b940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5b83d5c4eabe06c server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:52.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.219+0000 7fbc4ffff700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T08:57:52.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.219+0000 7fbc4ffff700 1 -- 172.21.15.82:0/2838247130 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6401d040 con 0x558240c20c40 2023-09-23T08:57:52.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.220+0000 7fbc8aad6b80 1 -- 172.21.15.82:0/2838247130 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558240bf01c0 con 0x558240c20c40 2023-09-23T08:57:52.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.220+0000 7fbc4ffff700 1 -- 172.21.15.82:0/2838247130 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fbc6400bca0 con 0x558240c20c40 2023-09-23T08:57:52.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.220+0000 7fbc4ffff700 1 -- 172.21.15.82:0/2838247130 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbc64004910 con 0x558240c20c40 2023-09-23T08:57:52.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.220+0000 7fbc8aad6b80 10 client.25651 fetch_fsmap learned FSMap version 30 2023-09-23T08:57:52.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.220+0000 7fbc8aad6b80 1 -- 172.21.15.82:0/2838247130 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x7fbc70110200 con 0x558240c20c40 2023-09-23T08:57:52.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.220+0000 7fbc4ffff700 1 -- 172.21.15.82:0/2838247130 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x558240bf01c0 con 0x558240c20c40 2023-09-23T08:57:52.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.220+0000 7fbc4ffff700 1 -- 172.21.15.82:0/2838247130 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 30) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fbc6400fb00 con 0x558240c20c40 2023-09-23T08:57:52.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.220+0000 7fbc8aad6b80 10 client.25651 fetch_fsmap finished waiting for FSMap version 30 2023-09-23T08:57:52.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.220+0000 7fbc8aad6b80 10 client.25651 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T08:57:52.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.221+0000 7fbc8aad6b80 20 client.25651 populate_metadata read hostname 'smithi082' 2023-09-23T08:57:52.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.221+0000 7fbc8aad6b80 1 --2- 172.21.15.82:0/2838247130 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x558240c3a2f0 0x558240c3c710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:52.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.221+0000 7fbc8aad6b80 4 client.25651 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T08:57:52.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.221+0000 7fbc8aad6b80 1 -- 172.21.15.82:0/2838247130 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558240b18ba0 con 0x558240c3a2f0 2023-09-23T08:57:52.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.221+0000 7fbc6ffff700 1 --2- 172.21.15.82:0/2838247130 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x558240c3a2f0 0x558240c3c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:52.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.221+0000 7fbc6ffff700 1 --2- 172.21.15.82:0/2838247130 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x558240c3a2f0 0x558240c3c710 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1be62d6659c4f166 server_cookie=cf90d6bc9dc3ed63 in_seq=0 out_seq=0 2023-09-23T08:57:52.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.221+0000 7fbc4ffff700 10 client.25651 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T08:57:52.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.222+0000 7fbc4ffff700 1 -- 172.21.15.82:0/2838247130 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558240b18ba0 con 0x558240c3a2f0 2023-09-23T08:57:52.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.222+0000 7fbc4ffff700 10 client.25651 handle_command_reply: tid=0 2023-09-23T08:57:52.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.222+0000 7fbc8aad6b80 1 client.25651 shutdown 2023-09-23T08:57:52.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.222+0000 7fbc8aad6b80 1 -- 172.21.15.82:0/2838247130 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558240c20c40 msgr2=0x558240c2cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:52.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.222+0000 7fbc8aad6b80 1 --2- 172.21.15.82:0/2838247130 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558240c20c40 0x558240c2cc20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fbc640098e0 tx=0x7fbc6400b940 comp rx=0 tx=0).stop 2023-09-23T08:57:52.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.223+0000 7fbc8aad6b80 1 -- 172.21.15.82:0/2838247130 shutdown_connections 2023-09-23T08:57:52.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.223+0000 7fbc8aad6b80 1 --2- 172.21.15.82:0/2838247130 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x558240c3a2f0 0x558240c3c710 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:52.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.223+0000 7fbc8aad6b80 1 --2- 172.21.15.82:0/2838247130 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558240c26ca0 0x558240c2a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:52.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.223+0000 7fbc8aad6b80 1 --2- 172.21.15.82:0/2838247130 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558240c20c40 0x558240c2cc20 secure :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fbc640098e0 tx=0x7fbc6400b940 comp rx=0 tx=0).stop 2023-09-23T08:57:52.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.223+0000 7fbc4ffff700 0 client.25651 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T08:57:52.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.223+0000 7fbc8aad6b80 1 --2- 172.21.15.82:0/2838247130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558240c26380 0x558240c29ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:52.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.223+0000 7fbc8aad6b80 1 -- 172.21.15.82:0/2838247130 >> 172.21.15.82:0/2838247130 conn(0x558240b950e0 msgr2=0x558240c15b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:52.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.223+0000 7fbc8aad6b80 1 -- 172.21.15.82:0/2838247130 shutdown_connections 2023-09-23T08:57:52.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.223+0000 7fbc8aad6b80 1 -- 172.21.15.82:0/2838247130 wait complete. 2023-09-23T08:57:52.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.223+0000 7fbc8aad6b80 20 client.25651 trim_cache size 0 max 16384 2023-09-23T08:57:52.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.247+0000 7fbc8aad6b80 1 Processor -- start 2023-09-23T08:57:52.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.247+0000 7fbc8aad6b80 1 -- start start 2023-09-23T08:57:52.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.247+0000 7fbc8aad6b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558240c26380 0x558240c2c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:52.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.247+0000 7fbc8aad6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558240c26ca0 0x558240c24010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:52.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.247+0000 7fbc8aad6b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558240c2cd00 0x558240c24550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:52.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.247+0000 7fbc8aad6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582409f4920 con 0x558240c26ca0 2023-09-23T08:57:52.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.247+0000 7fbc8aad6b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x558240c1cbd0 con 0x558240c2cd00 2023-09-23T08:57:52.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.247+0000 7fbc8aad6b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x558240c17cd0 con 0x558240c26380 2023-09-23T08:57:52.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.247+0000 7fbc74f9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558240c26380 0x558240c2c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:52.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.247+0000 7fbc6ffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558240c26ca0 0x558240c24010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:52.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.247+0000 7fbc74f9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558240c26380 0x558240c2c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:56070/0 (socket says 172.21.15.82:56070) 2023-09-23T08:57:52.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.247+0000 7fbc74f9b700 1 -- 172.21.15.82:0/462665787 learned_addr learned my addr 172.21.15.82:0/462665787 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:57:52.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.248+0000 7fbc7579c700 1 --2- 172.21.15.82:0/462665787 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558240c2cd00 0x558240c24550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:52.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.248+0000 7fbc74f9b700 1 -- 172.21.15.82:0/462665787 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558240c2cd00 msgr2=0x558240c24550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:52.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.248+0000 7fbc74f9b700 1 --2- 172.21.15.82:0/462665787 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558240c2cd00 0x558240c24550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:52.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.248+0000 7fbc74f9b700 1 -- 172.21.15.82:0/462665787 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558240c26ca0 msgr2=0x558240c24010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:52.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.248+0000 7fbc74f9b700 1 --2- 172.21.15.82:0/462665787 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558240c26ca0 0x558240c24010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:52.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.248+0000 7fbc74f9b700 1 -- 172.21.15.82:0/462665787 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55824099ede0 con 0x558240c26380 2023-09-23T08:57:52.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.248+0000 7fbc6ffff700 1 --2- 172.21.15.82:0/462665787 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558240c26ca0 0x558240c24010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T08:57:52.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.248+0000 7fbc74f9b700 1 --2- 172.21.15.82:0/462665787 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558240c26380 0x558240c2c7c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbc64011040 tx=0x7fbc6400b260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a4ede9cb6b76f7e server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:52.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.248+0000 7fbc5b7fe700 1 -- 172.21.15.82:0/462665787 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc64005a00 con 0x558240c26380 2023-09-23T08:57:52.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.248+0000 7fbc5b7fe700 1 -- 172.21.15.82:0/462665787 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbc6400ba60 con 0x558240c26380 2023-09-23T08:57:52.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.248+0000 7fbc5b7fe700 1 -- 172.21.15.82:0/462665787 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc64004b10 con 0x558240c26380 2023-09-23T08:57:52.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.249+0000 7fbc8aad6b80 1 -- 172.21.15.82:0/462665787 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558240c26380 msgr2=0x558240c2c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:52.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.249+0000 7fbc8aad6b80 1 --2- 172.21.15.82:0/462665787 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558240c26380 0x558240c2c7c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbc64011040 tx=0x7fbc6400b260 comp rx=0 tx=0).stop 2023-09-23T08:57:52.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.249+0000 7fbc8aad6b80 1 -- 172.21.15.82:0/462665787 shutdown_connections 2023-09-23T08:57:52.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.249+0000 7fbc8aad6b80 1 --2- 172.21.15.82:0/462665787 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558240c2cd00 0x558240c24550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:52.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.249+0000 7fbc8aad6b80 1 --2- 172.21.15.82:0/462665787 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558240c26380 0x558240c2c7c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:52.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.249+0000 7fbc8aad6b80 1 --2- 172.21.15.82:0/462665787 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558240c26ca0 0x558240c24010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:52.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.249+0000 7fbc8aad6b80 1 -- 172.21.15.82:0/462665787 >> 172.21.15.82:0/462665787 conn(0x558240b950e0 msgr2=0x558240c1b160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:52.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.249+0000 7fbc8aad6b80 1 -- 172.21.15.82:0/462665787 shutdown_connections 2023-09-23T08:57:52.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.249+0000 7fbc8aad6b80 1 -- 172.21.15.82:0/462665787 wait complete. 2023-09-23T08:57:52.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.250+0000 7fbc8aad6b80 1 -- start start 2023-09-23T08:57:52.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.250+0000 7fbc8aad6b80 1 Processor -- start 2023-09-23T08:57:52.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.250+0000 7fbc8aad6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558240c26380 0x558240c23460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:52.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.250+0000 7fbc8aad6b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558240c26ca0 0x558240c21da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:52.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.250+0000 7fbc8aad6b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558240c2cd00 0x558240c222e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:52.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.250+0000 7fbc8aad6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x558240c23ab0 con 0x558240c26380 2023-09-23T08:57:52.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.250+0000 7fbc8aad6b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x558240c22820 con 0x558240c2cd00 2023-09-23T08:57:52.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.250+0000 7fbc8aad6b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x558240c229e0 con 0x558240c26ca0 2023-09-23T08:57:52.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.250+0000 7fbc8aad6b80 10 client.0 _ll_register_callbacks cb 0x7fbc5c0952b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T08:57:52.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.251+0000 7fbc7579c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558240c2cd00 0x558240c222e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:52.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.251+0000 7fbc6ffff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558240c26ca0 0x558240c21da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:52.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.251+0000 7fbc7579c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558240c2cd00 0x558240c222e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:41504/0 (socket says 172.21.15.82:41504) 2023-09-23T08:57:52.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.251+0000 7fbc7579c700 1 -- 172.21.15.82:0/2122816990 learned_addr learned my addr 172.21.15.82:0/2122816990 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:57:52.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.251+0000 7fbc74f9b700 1 --2- 172.21.15.82:0/2122816990 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558240c26380 0x558240c23460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:52.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.251+0000 7fbc7579c700 1 -- 172.21.15.82:0/2122816990 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558240c26ca0 msgr2=0x558240c21da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:52.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.251+0000 7fbc7579c700 1 --2- 172.21.15.82:0/2122816990 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558240c26ca0 0x558240c21da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:52.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.251+0000 7fbc7579c700 1 -- 172.21.15.82:0/2122816990 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558240c26380 msgr2=0x558240c23460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:57:52.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.251+0000 7fbc7579c700 1 --2- 172.21.15.82:0/2122816990 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558240c26380 0x558240c23460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:52.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.251+0000 7fbc7579c700 1 -- 172.21.15.82:0/2122816990 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc70199600 con 0x558240c2cd00 2023-09-23T08:57:52.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.251+0000 7fbc74f9b700 1 --2- 172.21.15.82:0/2122816990 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558240c26380 0x558240c23460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T08:57:52.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.251+0000 7fbc7579c700 1 --2- 172.21.15.82:0/2122816990 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558240c2cd00 0x558240c222e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbc6800ebe0 tx=0x7fbc68004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25fcf575ecbb0060 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:57:52.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.251+0000 7fbc4ffff700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-09-23T08:57:52.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.252+0000 7fbc4ffff700 1 -- 172.21.15.82:0/2122816990 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc68008db0 con 0x558240c2cd00 2023-09-23T08:57:52.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.252+0000 7fbc8aad6b80 1 -- 172.21.15.82:0/2122816990 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558240b6b970 con 0x558240c2cd00 2023-09-23T08:57:52.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.252+0000 7fbc4ffff700 1 -- 172.21.15.82:0/2122816990 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fbc6801a440 con 0x558240c2cd00 2023-09-23T08:57:52.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.252+0000 7fbc4ffff700 1 -- 172.21.15.82:0/2122816990 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbc6801a600 con 0x558240c2cd00 2023-09-23T08:57:52.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.252+0000 7fbc8aad6b80 10 client.25610 fetch_fsmap learned FSMap version 30 2023-09-23T08:57:52.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.252+0000 7fbc8aad6b80 1 -- 172.21.15.82:0/2122816990 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x7fbc70110200 con 0x558240c2cd00 2023-09-23T08:57:52.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.252+0000 7fbc4ffff700 1 -- 172.21.15.82:0/2122816990 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x558240b6b970 con 0x558240c2cd00 2023-09-23T08:57:52.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.253+0000 7fbc4ffff700 1 -- 172.21.15.82:0/2122816990 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 30) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fbc6802c020 con 0x558240c2cd00 2023-09-23T08:57:52.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.253+0000 7fbc8aad6b80 10 client.25610 fetch_fsmap finished waiting for FSMap version 30 2023-09-23T08:57:52.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.253+0000 7fbc8aad6b80 10 client.25610 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T08:57:52.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.253+0000 7fbc8aad6b80 20 client.25610 populate_metadata read hostname 'smithi082' 2023-09-23T08:57:52.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.253+0000 7fbc8aad6b80 1 --2- 172.21.15.82:0/2122816990 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x558240c8f520 0x558240c91940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:57:52.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.253+0000 7fbc8aad6b80 4 client.25610 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T08:57:52.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.253+0000 7fbc8aad6b80 1 -- 172.21.15.82:0/2122816990 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x558240b2c050 con 0x558240c8f520 2023-09-23T08:57:52.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.253+0000 7fbc74f9b700 1 --2- 172.21.15.82:0/2122816990 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x558240c8f520 0x558240c91940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:57:52.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.254+0000 7fbc4ffff700 10 client.25610 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T08:57:52.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.254+0000 7fbc74f9b700 1 --2- 172.21.15.82:0/2122816990 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x558240c8f520 0x558240c91940 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3a8d777f51409e0 server_cookie=f339066dfcc9f16b in_seq=0 out_seq=0 2023-09-23T08:57:52.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.254+0000 7fbc4ffff700 1 -- 172.21.15.82:0/2122816990 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x558240b2c050 con 0x558240c8f520 2023-09-23T08:57:52.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.254+0000 7fbc4ffff700 10 client.25610 handle_command_reply: tid=0 2023-09-23T08:57:52.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.254+0000 7fbc8aad6b80 1 client.25610 shutdown 2023-09-23T08:57:52.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.254+0000 7fbc8aad6b80 1 -- 172.21.15.82:0/2122816990 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558240c2cd00 msgr2=0x558240c222e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:52.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.254+0000 7fbc8aad6b80 1 --2- 172.21.15.82:0/2122816990 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558240c2cd00 0x558240c222e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbc6800ebe0 tx=0x7fbc68004b40 comp rx=0 tx=0).stop 2023-09-23T08:57:52.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.254+0000 7fbc8aad6b80 1 -- 172.21.15.82:0/2122816990 shutdown_connections 2023-09-23T08:57:52.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.254+0000 7fbc8aad6b80 1 --2- 172.21.15.82:0/2122816990 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558240c2cd00 0x558240c222e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:52.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.254+0000 7fbc8aad6b80 1 --2- 172.21.15.82:0/2122816990 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x558240c8f520 0x558240c91940 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:52.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.254+0000 7fbc8aad6b80 1 --2- 172.21.15.82:0/2122816990 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558240c26380 0x558240c23460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:52.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.254+0000 7fbc8aad6b80 1 --2- 172.21.15.82:0/2122816990 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558240c26ca0 0x558240c21da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:52.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.254+0000 7fbc4ffff700 0 client.25610 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T08:57:52.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.254+0000 7fbc8aad6b80 1 -- 172.21.15.82:0/2122816990 >> 172.21.15.82:0/2122816990 conn(0x558240b950e0 msgr2=0x558240c24010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:52.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.254+0000 7fbc8aad6b80 1 -- 172.21.15.82:0/2122816990 shutdown_connections 2023-09-23T08:57:52.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.254+0000 7fbc8aad6b80 1 -- 172.21.15.82:0/2122816990 wait complete. 2023-09-23T08:57:52.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.255+0000 7fbc8aad6b80 20 client.25610 trim_cache size 0 max 16384 2023-09-23T08:57:52.266 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T08:57:52.266 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-23T08:57:52.266 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T08:57:52.266 INFO:teuthology.orchestra.run.smithi082.stdout: "6f0fe3a6-7212-425d-a0a6-f38e8b42ec13": { 2023-09-23T08:57:52.266 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T08:57:52.267 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "6f0fe3a6-7212-425d-a0a6-f38e8b42ec13", 2023-09-23T08:57:52.267 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T08:57:52.267 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T08:57:52.267 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T08:57:52.267 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T08:57:52.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.255+0000 7fbc771ff700 1 -- 172.21.15.82:0/329522912 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fbc600a01e0 msgr2=0x7fbc600a26a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:52.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.255+0000 7fbc771ff700 1 --2- 172.21.15.82:0/329522912 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fbc600a01e0 0x7fbc600a26a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbc68009ec0 tx=0x7fbc68003ac0 comp rx=0 tx=0).stop 2023-09-23T08:57:52.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.255+0000 7fbc771ff700 1 -- 172.21.15.82:0/329522912 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc700735f0 msgr2=0x7fbc7019ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:57:52.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.255+0000 7fbc771ff700 1 --2- 172.21.15.82:0/329522912 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc700735f0 0x7fbc7019ee50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c00e9a0 tx=0x7fbc5c00ecb0 comp rx=0 tx=0).stop 2023-09-23T08:57:52.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.255+0000 7fbc771ff700 1 -- 172.21.15.82:0/329522912 shutdown_connections 2023-09-23T08:57:52.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.255+0000 7fbc771ff700 1 --2- 172.21.15.82:0/329522912 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fbc600a01e0 0x7fbc600a26a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:52.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.255+0000 7fbc771ff700 1 --2- 172.21.15.82:0/329522912 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc7010d150 0x7fbc70198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:52.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.255+0000 7fbc771ff700 1 --2- 172.21.15.82:0/329522912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc70072cd0 0x7fbc7019e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:52.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.255+0000 7fbc771ff700 1 --2- 172.21.15.82:0/329522912 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc700735f0 0x7fbc7019ee50 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:57:52.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.255+0000 7fbc771ff700 1 -- 172.21.15.82:0/329522912 >> 172.21.15.82:0/329522912 conn(0x7fbc700fc380 msgr2=0x7fbc700fcff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:57:52.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.255+0000 7fbc771ff700 1 -- 172.21.15.82:0/329522912 shutdown_connections 2023-09-23T08:57:52.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:57:52.255+0000 7fbc771ff700 1 -- 172.21.15.82:0/329522912 wait complete. 2023-09-23T08:57:52.279 INFO:tasks.cephfs.filesystem:scrub status for tag:6f0fe3a6-7212-425d-a0a6-f38e8b42ec13 - {'path': '/', 'tag': '6f0fe3a6-7212-425d-a0a6-f38e8b42ec13', 'options': 'recursive,force'} 2023-09-23T08:57:52.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:57:52 smithi135 ceph-mon[99205]: pgmap v32: 97 pgs: 97 active+clean; 411 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 32 MiB/s wr, 38 op/s 2023-09-23T08:57:52.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:57:52 smithi135 ceph-mon[99205]: scrub summary: active paths [/] 2023-09-23T08:57:52.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:57:52 smithi135 ceph-mon[99205]: scrub summary: idle+waiting paths [/] 2023-09-23T08:57:52.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:57:52 smithi135 ceph-mon[99205]: scrub summary: active paths [/] 2023-09-23T08:57:52.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:57:52 smithi135 ceph-mon[99205]: scrub summary: active paths [/] 2023-09-23T08:57:52.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:57:52 smithi135 ceph-mon[99205]: scrub summary: idle+waiting paths [/] 2023-09-23T08:57:52.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:57:52 smithi135 ceph-mon[99205]: scrub summary: active paths [/] 2023-09-23T08:57:52.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:57:52 smithi135 ceph-mon[99205]: scrub summary: idle+waiting paths [/] 2023-09-23T08:57:52.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:57:52 smithi135 ceph-mon[99205]: scrub summary: active paths [/] 2023-09-23T08:57:52.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:57:52 smithi135 ceph-mon[99205]: scrub summary: active paths [/] 2023-09-23T08:57:52.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:57:52 smithi135 ceph-mon[99205]: scrub summary: idle+waiting paths [/] 2023-09-23T08:57:52.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:57:52 smithi135 ceph-mon[99205]: scrub summary: idle+waiting paths [/] 2023-09-23T08:57:52.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:57:52 smithi135 ceph-mon[99205]: scrub summary: idle+waiting paths [/] 2023-09-23T08:57:52.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:57:52 smithi082 ceph-mon[97694]: pgmap v32: 97 pgs: 97 active+clean; 411 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 32 MiB/s wr, 38 op/s 2023-09-23T08:57:52.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:57:52 smithi082 ceph-mon[97694]: scrub summary: active paths [/] 2023-09-23T08:57:52.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:57:52 smithi082 ceph-mon[97694]: scrub summary: idle+waiting paths [/] 2023-09-23T08:57:52.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:57:52 smithi082 ceph-mon[97694]: scrub summary: active paths [/] 2023-09-23T08:57:52.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:57:52 smithi082 ceph-mon[97694]: scrub summary: active paths [/] 2023-09-23T08:57:52.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:57:52 smithi082 ceph-mon[97694]: scrub summary: idle+waiting paths [/] 2023-09-23T08:57:52.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:57:52 smithi082 ceph-mon[97694]: scrub summary: active paths [/] 2023-09-23T08:57:52.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:57:52 smithi082 ceph-mon[97694]: scrub summary: idle+waiting paths [/] 2023-09-23T08:57:52.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:57:52 smithi082 ceph-mon[97694]: scrub summary: active paths [/] 2023-09-23T08:57:52.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:57:52 smithi082 ceph-mon[97694]: scrub summary: active paths [/] 2023-09-23T08:57:52.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:57:52 smithi082 ceph-mon[97694]: scrub summary: idle+waiting paths [/] 2023-09-23T08:57:52.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:57:52 smithi082 ceph-mon[97694]: scrub summary: idle+waiting paths [/] 2023-09-23T08:57:52.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:57:52 smithi082 ceph-mon[97694]: scrub summary: idle+waiting paths [/] 2023-09-23T08:57:52.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:57:52 smithi161 ceph-mon[99580]: pgmap v32: 97 pgs: 97 active+clean; 411 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 32 MiB/s wr, 38 op/s 2023-09-23T08:57:52.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:57:52 smithi161 ceph-mon[99580]: scrub summary: active paths [/] 2023-09-23T08:57:52.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:57:52 smithi161 ceph-mon[99580]: scrub summary: idle+waiting paths [/] 2023-09-23T08:57:52.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:57:52 smithi161 ceph-mon[99580]: scrub summary: active paths [/] 2023-09-23T08:57:52.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:57:52 smithi161 ceph-mon[99580]: scrub summary: active paths [/] 2023-09-23T08:57:52.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:57:52 smithi161 ceph-mon[99580]: scrub summary: idle+waiting paths [/] 2023-09-23T08:57:52.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:57:52 smithi161 ceph-mon[99580]: scrub summary: active paths [/] 2023-09-23T08:57:52.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:57:52 smithi161 ceph-mon[99580]: scrub summary: idle+waiting paths [/] 2023-09-23T08:57:52.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:57:52 smithi161 ceph-mon[99580]: scrub summary: active paths [/] 2023-09-23T08:57:52.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:57:52 smithi161 ceph-mon[99580]: scrub summary: active paths [/] 2023-09-23T08:57:52.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:57:52 smithi161 ceph-mon[99580]: scrub summary: idle+waiting paths [/] 2023-09-23T08:57:52.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:57:52 smithi161 ceph-mon[99580]: scrub summary: idle+waiting paths [/] 2023-09-23T08:57:52.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:57:52 smithi161 ceph-mon[99580]: scrub summary: idle+waiting paths [/] 2023-09-23T08:57:52.919 INFO:teuthology.orchestra.run.smithi082.stderr:1800000 of 50000000 tuples (3%) done (elapsed 27.66 s, remaining 740.70 s) 2023-09-23T08:57:53.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:57:53 smithi135 ceph-mon[99205]: scrub queued for path: / 2023-09-23T08:57:53.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:57:53 smithi135 ceph-mon[99205]: scrub summary: idle+waiting paths [/] 2023-09-23T08:57:53.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:57:53 smithi135 ceph-mon[99205]: scrub summary: active paths [/] 2023-09-23T08:57:53.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:57:53 smithi135 ceph-mon[99205]: scrub summary: active paths [/] 2023-09-23T08:57:53.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:57:53 smithi135 ceph-mon[99205]: scrub summary: idle+waiting paths [/] 2023-09-23T08:57:53.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:57:53 smithi082 ceph-mon[97694]: scrub queued for path: / 2023-09-23T08:57:53.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:57:53 smithi082 ceph-mon[97694]: scrub summary: idle+waiting paths [/] 2023-09-23T08:57:53.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:57:53 smithi082 ceph-mon[97694]: scrub summary: active paths [/] 2023-09-23T08:57:53.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:57:53 smithi082 ceph-mon[97694]: scrub summary: active paths [/] 2023-09-23T08:57:53.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:57:53 smithi082 ceph-mon[97694]: scrub summary: idle+waiting paths [/] 2023-09-23T08:57:53.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:57:53 smithi161 ceph-mon[99580]: scrub queued for path: / 2023-09-23T08:57:53.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:57:53 smithi161 ceph-mon[99580]: scrub summary: idle+waiting paths [/] 2023-09-23T08:57:53.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:57:53 smithi161 ceph-mon[99580]: scrub summary: active paths [/] 2023-09-23T08:57:53.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:57:53 smithi161 ceph-mon[99580]: scrub summary: active paths [/] 2023-09-23T08:57:53.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:57:53 smithi161 ceph-mon[99580]: scrub summary: idle+waiting paths [/] 2023-09-23T08:57:54.591 INFO:teuthology.orchestra.run.smithi082.stderr:1900000 of 50000000 tuples (3%) done (elapsed 29.33 s, remaining 742.60 s) 2023-09-23T08:57:54.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:57:54 smithi135 ceph-mon[99205]: pgmap v33: 97 pgs: 97 active+clean; 411 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 25 MiB/s wr, 27 op/s 2023-09-23T08:57:54.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:57:54 smithi082 ceph-mon[97694]: pgmap v33: 97 pgs: 97 active+clean; 411 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 25 MiB/s wr, 27 op/s 2023-09-23T08:57:54.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:57:54 smithi161 ceph-mon[99580]: pgmap v33: 97 pgs: 97 active+clean; 411 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 25 MiB/s wr, 27 op/s 2023-09-23T08:57:55.702 INFO:teuthology.orchestra.run.smithi082.stderr:2000000 of 50000000 tuples (4%) done (elapsed 30.44 s, remaining 730.67 s) 2023-09-23T08:57:56.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:57:56 smithi135 ceph-mon[99205]: pgmap v34: 97 pgs: 97 active+clean; 483 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 37 MiB/s wr, 39 op/s 2023-09-23T08:57:56.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:57:56 smithi082 ceph-mon[97694]: pgmap v34: 97 pgs: 97 active+clean; 483 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 37 MiB/s wr, 39 op/s 2023-09-23T08:57:56.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:57:56 smithi161 ceph-mon[99580]: pgmap v34: 97 pgs: 97 active+clean; 483 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 37 MiB/s wr, 39 op/s 2023-09-23T08:57:57.399 INFO:teuthology.orchestra.run.smithi082.stderr:2100000 of 50000000 tuples (4%) done (elapsed 32.14 s, remaining 733.12 s) 2023-09-23T08:57:58.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:57:58 smithi135 ceph-mon[99205]: pgmap v35: 97 pgs: 97 active+clean; 483 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 25 MiB/s wr, 26 op/s 2023-09-23T08:57:58.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:57:58 smithi082 ceph-mon[97694]: pgmap v35: 97 pgs: 97 active+clean; 483 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 25 MiB/s wr, 26 op/s 2023-09-23T08:57:58.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:57:58 smithi161 ceph-mon[99580]: pgmap v35: 97 pgs: 97 active+clean; 483 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 25 MiB/s wr, 26 op/s 2023-09-23T08:57:59.070 INFO:teuthology.orchestra.run.smithi082.stderr:2200000 of 50000000 tuples (4%) done (elapsed 33.81 s, remaining 734.65 s) 2023-09-23T08:58:00.295 INFO:teuthology.orchestra.run.smithi082.stderr:2300000 of 50000000 tuples (4%) done (elapsed 35.04 s, remaining 726.63 s) 2023-09-23T08:58:00.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:58:00 smithi135 ceph-mon[99205]: pgmap v36: 97 pgs: 97 active+clean; 547 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 35 MiB/s wr, 35 op/s 2023-09-23T08:58:00.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:58:00 smithi082 ceph-mon[97694]: pgmap v36: 97 pgs: 97 active+clean; 547 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 35 MiB/s wr, 35 op/s 2023-09-23T08:58:00.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:58:00 smithi161 ceph-mon[99580]: pgmap v36: 97 pgs: 97 active+clean; 547 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 35 MiB/s wr, 35 op/s 2023-09-23T08:58:02.077 INFO:teuthology.orchestra.run.smithi082.stderr:2400000 of 50000000 tuples (4%) done (elapsed 36.82 s, remaining 730.25 s) 2023-09-23T08:58:02.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:58:02 smithi135 ceph-mon[99205]: pgmap v37: 97 pgs: 97 active+clean; 555 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 32 MiB/s wr, 35 op/s 2023-09-23T08:58:02.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:58:02 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:58:02.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:58:02 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T08:58:02.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:58:02 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T08:58:02.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:58:02 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T08:58:02.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:58:02 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T08:58:02.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:58:02 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T08:58:02.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:58:02 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T08:58:02.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:58:02 smithi082 ceph-mon[97694]: pgmap v37: 97 pgs: 97 active+clean; 555 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 32 MiB/s wr, 35 op/s 2023-09-23T08:58:02.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:58:02 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:58:02.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:58:02 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T08:58:02.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:58:02 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T08:58:02.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:58:02 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T08:58:02.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:58:02 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T08:58:02.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:58:02 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T08:58:02.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:58:02 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T08:58:02.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:58:02 smithi161 ceph-mon[99580]: pgmap v37: 97 pgs: 97 active+clean; 555 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 32 MiB/s wr, 35 op/s 2023-09-23T08:58:02.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:58:02 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:58:02.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:58:02 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T08:58:02.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:58:02 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T08:58:02.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:58:02 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T08:58:02.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:58:02 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T08:58:02.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:58:02 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T08:58:02.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:58:02 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T08:58:03.807 INFO:teuthology.orchestra.run.smithi082.stderr:2500000 of 50000000 tuples (5%) done (elapsed 38.55 s, remaining 732.43 s) 2023-09-23T08:58:03.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:58:03 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:58:03.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:58:03 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:58:03.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:58:03 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T08:58:03.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:58:03 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:58:03.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:58:03 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:58:03.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:58:03 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T08:58:03.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:58:03 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:58:03.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:58:03 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:58:03.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:58:03 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T08:58:04.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:58:04 smithi082 ceph-mon[97694]: pgmap v38: 97 pgs: 97 active+clean; 555 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 24 MiB/s wr, 25 op/s 2023-09-23T08:58:04.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:58:04 smithi161 ceph-mon[99580]: pgmap v38: 97 pgs: 97 active+clean; 555 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 24 MiB/s wr, 25 op/s 2023-09-23T08:58:05.024 INFO:teuthology.orchestra.run.smithi082.stderr:2600000 of 50000000 tuples (5%) done (elapsed 39.77 s, remaining 724.96 s) 2023-09-23T08:58:05.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:58:04 smithi135 ceph-mon[99205]: pgmap v38: 97 pgs: 97 active+clean; 555 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 24 MiB/s wr, 25 op/s 2023-09-23T08:58:06.651 INFO:teuthology.orchestra.run.smithi082.stderr:2700000 of 50000000 tuples (5%) done (elapsed 41.39 s, remaining 725.14 s) 2023-09-23T08:58:06.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:58:06 smithi082 ceph-mon[97694]: pgmap v39: 97 pgs: 97 active+clean; 655 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 37 MiB/s wr, 49 op/s 2023-09-23T08:58:06.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:58:06 smithi161 ceph-mon[99580]: pgmap v39: 97 pgs: 97 active+clean; 655 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 37 MiB/s wr, 49 op/s 2023-09-23T08:58:07.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:58:06 smithi135 ceph-mon[99205]: pgmap v39: 97 pgs: 97 active+clean; 655 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 37 MiB/s wr, 49 op/s 2023-09-23T08:58:08.354 INFO:teuthology.orchestra.run.smithi082.stderr:2800000 of 50000000 tuples (5%) done (elapsed 43.10 s, remaining 726.47 s) 2023-09-23T08:58:08.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:58:08 smithi082 ceph-mon[97694]: pgmap v40: 97 pgs: 97 active+clean; 655 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 25 MiB/s wr, 37 op/s 2023-09-23T08:58:08.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:58:08 smithi161 ceph-mon[99580]: pgmap v40: 97 pgs: 97 active+clean; 655 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 25 MiB/s wr, 37 op/s 2023-09-23T08:58:09.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:58:08 smithi135 ceph-mon[99205]: pgmap v40: 97 pgs: 97 active+clean; 655 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 25 MiB/s wr, 37 op/s 2023-09-23T08:58:09.549 INFO:teuthology.orchestra.run.smithi082.stderr:2900000 of 50000000 tuples (5%) done (elapsed 44.29 s, remaining 719.34 s) 2023-09-23T08:58:10.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:58:10 smithi082 ceph-mon[97694]: pgmap v41: 97 pgs: 97 active+clean; 719 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 MiB/s wr, 48 op/s 2023-09-23T08:58:10.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:58:10 smithi161 ceph-mon[99580]: pgmap v41: 97 pgs: 97 active+clean; 719 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 MiB/s wr, 48 op/s 2023-09-23T08:58:11.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:58:10 smithi135 ceph-mon[99205]: pgmap v41: 97 pgs: 97 active+clean; 719 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 MiB/s wr, 48 op/s 2023-09-23T08:58:11.302 INFO:teuthology.orchestra.run.smithi082.stderr:3000000 of 50000000 tuples (6%) done (elapsed 46.04 s, remaining 721.35 s) 2023-09-23T08:58:12.537 INFO:teuthology.orchestra.run.smithi082.stderr:3100000 of 50000000 tuples (6%) done (elapsed 47.28 s, remaining 715.28 s) 2023-09-23T08:58:12.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:58:12 smithi082 ceph-mon[97694]: pgmap v42: 97 pgs: 97 active+clean; 727 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 27 MiB/s wr, 40 op/s 2023-09-23T08:58:12.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:58:12 smithi161 ceph-mon[99580]: pgmap v42: 97 pgs: 97 active+clean; 727 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 27 MiB/s wr, 40 op/s 2023-09-23T08:58:13.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:58:12 smithi135 ceph-mon[99205]: pgmap v42: 97 pgs: 97 active+clean; 727 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 27 MiB/s wr, 40 op/s 2023-09-23T08:58:14.246 INFO:teuthology.orchestra.run.smithi082.stderr:3200000 of 50000000 tuples (6%) done (elapsed 48.99 s, remaining 716.45 s) 2023-09-23T08:58:14.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:58:14 smithi082 ceph-mon[97694]: pgmap v43: 97 pgs: 97 active+clean; 727 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 25 MiB/s wr, 37 op/s 2023-09-23T08:58:14.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:58:14 smithi161 ceph-mon[99580]: pgmap v43: 97 pgs: 97 active+clean; 727 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 25 MiB/s wr, 37 op/s 2023-09-23T08:58:15.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:58:14 smithi135 ceph-mon[99205]: pgmap v43: 97 pgs: 97 active+clean; 727 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 25 MiB/s wr, 37 op/s 2023-09-23T08:58:15.973 INFO:teuthology.orchestra.run.smithi082.stderr:3300000 of 50000000 tuples (6%) done (elapsed 50.72 s, remaining 717.69 s) 2023-09-23T08:58:16.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:58:16 smithi082 ceph-mon[97694]: pgmap v44: 97 pgs: 97 active+clean; 803 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 38 MiB/s wr, 49 op/s 2023-09-23T08:58:16.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:58:16 smithi161 ceph-mon[99580]: pgmap v44: 97 pgs: 97 active+clean; 803 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 38 MiB/s wr, 49 op/s 2023-09-23T08:58:17.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:58:16 smithi135 ceph-mon[99205]: pgmap v44: 97 pgs: 97 active+clean; 803 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 38 MiB/s wr, 49 op/s 2023-09-23T08:58:17.088 INFO:teuthology.orchestra.run.smithi082.stderr:3400000 of 50000000 tuples (6%) done (elapsed 51.83 s, remaining 710.38 s) 2023-09-23T08:58:18.809 INFO:teuthology.orchestra.run.smithi082.stderr:3500000 of 50000000 tuples (7%) done (elapsed 53.55 s, remaining 711.46 s) 2023-09-23T08:58:18.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:58:18 smithi082 ceph-mon[97694]: pgmap v45: 97 pgs: 97 active+clean; 803 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 25 MiB/s wr, 25 op/s 2023-09-23T08:58:18.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:58:18 smithi161 ceph-mon[99580]: pgmap v45: 97 pgs: 97 active+clean; 803 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 25 MiB/s wr, 25 op/s 2023-09-23T08:58:19.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:58:18 smithi135 ceph-mon[99205]: pgmap v45: 97 pgs: 97 active+clean; 803 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 25 MiB/s wr, 25 op/s 2023-09-23T08:58:20.537 INFO:teuthology.orchestra.run.smithi082.stderr:3600000 of 50000000 tuples (7%) done (elapsed 55.28 s, remaining 712.48 s) 2023-09-23T08:58:20.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:58:20 smithi082 ceph-mon[97694]: pgmap v46: 97 pgs: 97 active+clean; 867 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 36 MiB/s wr, 35 op/s 2023-09-23T08:58:20.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:58:20 smithi161 ceph-mon[99580]: pgmap v46: 97 pgs: 97 active+clean; 867 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 36 MiB/s wr, 35 op/s 2023-09-23T08:58:21.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:58:20 smithi135 ceph-mon[99205]: pgmap v46: 97 pgs: 97 active+clean; 867 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 36 MiB/s wr, 35 op/s 2023-09-23T08:58:21.757 INFO:teuthology.orchestra.run.smithi082.stderr:3700000 of 50000000 tuples (7%) done (elapsed 56.50 s, remaining 707.01 s) 2023-09-23T08:58:22.280 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T08:58:22.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.510+0000 7f1f7a5ff700 1 -- 172.21.15.82:0/194154131 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f741023b0 msgr2=0x7f1f7410a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:58:22.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.510+0000 7f1f7a5ff700 1 --2- 172.21.15.82:0/194154131 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f741023b0 0x7f1f7410a890 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1f68009990 tx=0x7f1f68009ca0 comp rx=0 tx=0).stop 2023-09-23T08:58:22.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.510+0000 7f1f7a5ff700 1 -- 172.21.15.82:0/194154131 shutdown_connections 2023-09-23T08:58:22.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.510+0000 7f1f7a5ff700 1 --2- 172.21.15.82:0/194154131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f7410ae60 0x7f1f7410d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:58:22.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.510+0000 7f1f7a5ff700 1 --2- 172.21.15.82:0/194154131 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1f74101a90 0x7f1f74101e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:58:22.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.510+0000 7f1f7a5ff700 1 --2- 172.21.15.82:0/194154131 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f741023b0 0x7f1f7410a890 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:58:22.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.510+0000 7f1f7a5ff700 1 -- 172.21.15.82:0/194154131 >> 172.21.15.82:0/194154131 conn(0x7f1f740fb270 msgr2=0x7f1f740fd690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:58:22.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.511+0000 7f1f7a5ff700 1 -- 172.21.15.82:0/194154131 shutdown_connections 2023-09-23T08:58:22.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.511+0000 7f1f7a5ff700 1 -- 172.21.15.82:0/194154131 wait complete. 2023-09-23T08:58:22.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.511+0000 7f1f7a5ff700 1 Processor -- start 2023-09-23T08:58:22.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.512+0000 7f1f7a5ff700 1 -- start start 2023-09-23T08:58:22.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.512+0000 7f1f7a5ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f74101a90 0x7f1f740ff6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:58:22.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.512+0000 7f1f7a5ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f741023b0 0x7f1f740ffc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:58:22.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.512+0000 7f1f7a5ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1f7410ae60 0x7f1f741a4a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:58:22.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.512+0000 7f1f7a5ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f74100450 con 0x7f1f74101a90 2023-09-23T08:58:22.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.512+0000 7f1f7a5ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f741a4fb0 con 0x7f1f741023b0 2023-09-23T08:58:22.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.512+0000 7f1f7a5ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f741a50f0 con 0x7f1f7410ae60 2023-09-23T08:58:22.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.512+0000 7f1f73fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f74101a90 0x7f1f740ff6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:58:22.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.513+0000 7f1f73fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f74101a90 0x7f1f740ff6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36320/0 (socket says 172.21.15.82:36320) 2023-09-23T08:58:22.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.513+0000 7f1f73fff700 1 -- 172.21.15.82:0/2573847296 learned_addr learned my addr 172.21.15.82:0/2573847296 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:58:22.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.513+0000 7f1f737fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f741023b0 0x7f1f740ffc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:58:22.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.513+0000 7f1f78b9c700 1 --2- 172.21.15.82:0/2573847296 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1f7410ae60 0x7f1f741a4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:58:22.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.513+0000 7f1f73fff700 1 -- 172.21.15.82:0/2573847296 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1f7410ae60 msgr2=0x7f1f741a4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:58:22.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.513+0000 7f1f73fff700 1 --2- 172.21.15.82:0/2573847296 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1f7410ae60 0x7f1f741a4a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:58:22.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.513+0000 7f1f73fff700 1 -- 172.21.15.82:0/2573847296 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f741023b0 msgr2=0x7f1f740ffc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:58:22.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.513+0000 7f1f73fff700 1 --2- 172.21.15.82:0/2573847296 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f741023b0 0x7f1f740ffc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:58:22.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.513+0000 7f1f73fff700 1 -- 172.21.15.82:0/2573847296 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f680095f0 con 0x7f1f74101a90 2023-09-23T08:58:22.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.513+0000 7f1f737fe700 1 --2- 172.21.15.82:0/2573847296 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f741023b0 0x7f1f740ffc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T08:58:22.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.513+0000 7f1f73fff700 1 --2- 172.21.15.82:0/2573847296 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f74101a90 0x7f1f740ff6e0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f1f6400e9a0 tx=0x7f1f6400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:58:22.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.513+0000 7f1f717fa700 1 -- 172.21.15.82:0/2573847296 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f64009790 con 0x7f1f74101a90 2023-09-23T08:58:22.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.514+0000 7f1f7a5ff700 1 -- 172.21.15.82:0/2573847296 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f741a5350 con 0x7f1f74101a90 2023-09-23T08:58:22.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.514+0000 7f1f717fa700 1 -- 172.21.15.82:0/2573847296 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1f64010430 con 0x7f1f74101a90 2023-09-23T08:58:22.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.514+0000 7f1f717fa700 1 -- 172.21.15.82:0/2573847296 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f6400cea0 con 0x7f1f74101a90 2023-09-23T08:58:22.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.514+0000 7f1f7a5ff700 1 -- 172.21.15.82:0/2573847296 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f741a5830 con 0x7f1f74101a90 2023-09-23T08:58:22.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.518+0000 7f1f717fa700 1 -- 172.21.15.82:0/2573847296 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) v1 ==== 134904+0+0 (secure 0 0 0) 0x7f1f640105a0 con 0x7f1f74101a90 2023-09-23T08:58:22.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.519+0000 7f1f8de21b80 1 Processor -- start 2023-09-23T08:58:22.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.520+0000 7f1f8de21b80 1 -- start start 2023-09-23T08:58:22.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.520+0000 7f1f717fa700 1 --2- 172.21.15.82:0/2573847296 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f1f5c0a01e0 0x7f1f5c0a26a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:58:22.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.520+0000 7f1f8de21b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e979ea6380 0x55e979ea6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:58:22.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.520+0000 7f1f8de21b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e979ea6ca0 0x55e979ea0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:58:22.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.520+0000 7f1f8de21b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e979ea0c40 0x55e979ea10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:58:22.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.520+0000 7f1f8de21b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e979e087b0 con 0x55e979ea6ca0 2023-09-23T08:58:22.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.520+0000 7f1f717fa700 1 -- 172.21.15.82:0/2573847296 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f1f64014070 con 0x7f1f74101a90 2023-09-23T08:58:22.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.520+0000 7f1f8de21b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e979df9780 con 0x55e979ea0c40 2023-09-23T08:58:22.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.520+0000 7f1f8de21b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e979df70a0 con 0x55e979ea6380 2023-09-23T08:58:22.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.521+0000 7f1f78b9c700 1 --2- 172.21.15.82:0/2573847296 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f1f5c0a01e0 0x7f1f5c0a26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:58:22.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.521+0000 7f1f73fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e979ea6380 0x55e979ea6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:58:22.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.521+0000 7f1f737fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e979ea6ca0 0x55e979ea0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:58:22.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.521+0000 7f1f73fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e979ea6380 0x55e979ea6760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:33682/0 (socket says 172.21.15.82:33682) 2023-09-23T08:58:22.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.521+0000 7f1f78b9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e979ea0c40 0x55e979ea10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:58:22.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.521+0000 7f1f73fff700 1 -- 172.21.15.82:0/1107312631 learned_addr learned my addr 172.21.15.82:0/1107312631 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:58:22.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.521+0000 7f1f73fff700 1 -- 172.21.15.82:0/1107312631 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e979ea0c40 msgr2=0x55e979ea10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:58:22.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.521+0000 7f1f73fff700 1 --2- 172.21.15.82:0/1107312631 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e979ea0c40 0x55e979ea10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:58:22.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.521+0000 7f1f73fff700 1 -- 172.21.15.82:0/1107312631 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e979ea6ca0 msgr2=0x55e979ea0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:58:22.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.521+0000 7f1f73fff700 1 --2- 172.21.15.82:0/1107312631 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e979ea6ca0 0x55e979ea0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:58:22.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.521+0000 7f1f73fff700 1 -- 172.21.15.82:0/1107312631 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e979c72630 con 0x55e979ea6380 2023-09-23T08:58:22.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.521+0000 7f1f737fe700 1 --2- 172.21.15.82:0/1107312631 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e979ea6ca0 0x55e979ea0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T08:58:22.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.521+0000 7f1f78b9c700 1 --2- 172.21.15.82:0/2573847296 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f1f5c0a01e0 0x7f1f5c0a26a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c009ec0 tx=0x7f1f6c013250 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:58:22.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.521+0000 7f1f73fff700 1 --2- 172.21.15.82:0/1107312631 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e979ea6380 0x55e979ea6760 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1f64098dd0 tx=0x7f1f64098870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6aa0d0561d19f07a server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:58:22.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.522+0000 7f1f5a7fc700 1 -- 172.21.15.82:0/1107312631 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f64098e40 con 0x55e979ea6380 2023-09-23T08:58:22.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.522+0000 7f1f5a7fc700 1 -- 172.21.15.82:0/1107312631 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1f6409cc70 con 0x55e979ea6380 2023-09-23T08:58:22.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.522+0000 7f1f5a7fc700 1 -- 172.21.15.82:0/1107312631 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f64098590 con 0x55e979ea6380 2023-09-23T08:58:22.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.523+0000 7f1f8de21b80 1 -- 172.21.15.82:0/1107312631 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e979ea6380 msgr2=0x55e979ea6760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:58:22.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.523+0000 7f1f8de21b80 1 --2- 172.21.15.82:0/1107312631 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e979ea6380 0x55e979ea6760 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1f64098dd0 tx=0x7f1f64098870 comp rx=0 tx=0).stop 2023-09-23T08:58:22.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.523+0000 7f1f8de21b80 1 -- 172.21.15.82:0/1107312631 shutdown_connections 2023-09-23T08:58:22.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.523+0000 7f1f8de21b80 1 --2- 172.21.15.82:0/1107312631 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e979ea0c40 0x55e979ea10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:58:22.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.523+0000 7f1f8de21b80 1 --2- 172.21.15.82:0/1107312631 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e979ea6380 0x55e979ea6760 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:58:22.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.523+0000 7f1f8de21b80 1 --2- 172.21.15.82:0/1107312631 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e979ea6ca0 0x55e979ea0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:58:22.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.523+0000 7f1f8de21b80 1 -- 172.21.15.82:0/1107312631 >> 172.21.15.82:0/1107312631 conn(0x55e979e150e0 msgr2=0x55e979e9b410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:58:22.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.523+0000 7f1f8de21b80 1 -- 172.21.15.82:0/1107312631 shutdown_connections 2023-09-23T08:58:22.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.523+0000 7f1f8de21b80 1 -- 172.21.15.82:0/1107312631 wait complete. 2023-09-23T08:58:22.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.523+0000 7f1f8de21b80 1 -- start start 2023-09-23T08:58:22.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.524+0000 7f1f8de21b80 1 Processor -- start 2023-09-23T08:58:22.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.524+0000 7f1f8de21b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e979ea0c40 0x55e979eacca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:58:22.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.525+0000 7f1f8de21b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e979ea6380 0x55e979ea9f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:58:22.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.525+0000 7f1f8de21b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e979ea6ca0 0x55e979eaa660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:58:22.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.525+0000 7f1f8de21b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e979df2990 con 0x55e979ea6380 2023-09-23T08:58:22.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.525+0000 7f1f8de21b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e979d90bb0 con 0x55e979ea6ca0 2023-09-23T08:58:22.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.525+0000 7f1f8de21b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e979d908b0 con 0x55e979ea0c40 2023-09-23T08:58:22.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.525+0000 7f1f8de21b80 10 client.0 _ll_register_callbacks cb 0x55e979cdaa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T08:58:22.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.525+0000 7f1f737fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e979ea6380 0x55e979ea9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:58:22.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.525+0000 7f1f73fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e979ea0c40 0x55e979eacca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:58:22.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.525+0000 7f1f73fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e979ea0c40 0x55e979eacca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:33686/0 (socket says 172.21.15.82:33686) 2023-09-23T08:58:22.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.525+0000 7f1f78b9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e979ea6ca0 0x55e979eaa660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:58:22.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.525+0000 7f1f73fff700 1 -- 172.21.15.82:0/1731246123 learned_addr learned my addr 172.21.15.82:0/1731246123 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:58:22.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.525+0000 7f1f737fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e979ea6380 0x55e979ea9f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36336/0 (socket says 172.21.15.82:36336) 2023-09-23T08:58:22.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.525+0000 7f1f73fff700 1 -- 172.21.15.82:0/1731246123 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e979ea6ca0 msgr2=0x55e979eaa660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:58:22.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.525+0000 7f1f73fff700 1 --2- 172.21.15.82:0/1731246123 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e979ea6ca0 0x55e979eaa660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:58:22.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.525+0000 7f1f73fff700 1 -- 172.21.15.82:0/1731246123 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e979ea6380 msgr2=0x55e979ea9f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:58:22.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.525+0000 7f1f73fff700 1 --2- 172.21.15.82:0/1731246123 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e979ea6380 0x55e979ea9f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:58:22.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.525+0000 7f1f73fff700 1 -- 172.21.15.82:0/1731246123 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f7410dfc0 con 0x55e979ea0c40 2023-09-23T08:58:22.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.526+0000 7f1f73fff700 1 --2- 172.21.15.82:0/1731246123 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e979ea0c40 0x55e979eacca0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1f640952f0 tx=0x7f1f64098d40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=556f2c5015d11d5b server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:58:22.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.526+0000 7f1f537fe700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T08:58:22.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.526+0000 7f1f537fe700 1 -- 172.21.15.82:0/1731246123 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f6409cc70 con 0x55e979ea0c40 2023-09-23T08:58:22.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.526+0000 7f1f537fe700 1 -- 172.21.15.82:0/1731246123 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f1f640a0c50 con 0x55e979ea0c40 2023-09-23T08:58:22.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.526+0000 7f1f8de21b80 1 -- 172.21.15.82:0/1731246123 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e979e701c0 con 0x55e979ea0c40 2023-09-23T08:58:22.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.526+0000 7f1f537fe700 1 -- 172.21.15.82:0/1731246123 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1f640c6020 con 0x55e979ea0c40 2023-09-23T08:58:22.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.526+0000 7f1f8de21b80 10 client.25669 fetch_fsmap learned FSMap version 30 2023-09-23T08:58:22.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.526+0000 7f1f8de21b80 1 -- 172.21.15.82:0/1731246123 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x7f1f741a5830 con 0x55e979ea0c40 2023-09-23T08:58:22.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.526+0000 7f1f537fe700 1 -- 172.21.15.82:0/1731246123 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55e979e701c0 con 0x55e979ea0c40 2023-09-23T08:58:22.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.527+0000 7f1f537fe700 1 -- 172.21.15.82:0/1731246123 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 30) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f1f6400ca80 con 0x55e979ea0c40 2023-09-23T08:58:22.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.527+0000 7f1f8de21b80 10 client.25669 fetch_fsmap finished waiting for FSMap version 30 2023-09-23T08:58:22.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.527+0000 7f1f8de21b80 10 client.25669 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T08:58:22.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.527+0000 7f1f8de21b80 20 client.25669 populate_metadata read hostname 'smithi082' 2023-09-23T08:58:22.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.527+0000 7f1f8de21b80 1 --2- 172.21.15.82:0/1731246123 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55e979eba3e0 0x55e979ebc800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:58:22.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.527+0000 7f1f8de21b80 4 client.25669 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T08:58:22.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.527+0000 7f1f8de21b80 1 -- 172.21.15.82:0/1731246123 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e979d98ba0 con 0x55e979eba3e0 2023-09-23T08:58:22.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.527+0000 7f1f737fe700 1 --2- 172.21.15.82:0/1731246123 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55e979eba3e0 0x55e979ebc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:58:22.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.527+0000 7f1f737fe700 1 --2- 172.21.15.82:0/1731246123 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55e979eba3e0 0x55e979ebc800 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8118ffb21c144f6b server_cookie=a0045ab2fbae406c in_seq=0 out_seq=0 2023-09-23T08:58:22.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.527+0000 7f1f537fe700 10 client.25669 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T08:58:22.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.528+0000 7f1f537fe700 1 -- 172.21.15.82:0/1731246123 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e979d98ba0 con 0x55e979eba3e0 2023-09-23T08:58:22.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.528+0000 7f1f537fe700 10 client.25669 handle_command_reply: tid=0 2023-09-23T08:58:22.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.528+0000 7f1f8de21b80 1 client.25669 shutdown 2023-09-23T08:58:22.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.528+0000 7f1f8de21b80 1 -- 172.21.15.82:0/1731246123 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e979ea0c40 msgr2=0x55e979eacca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:58:22.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.528+0000 7f1f8de21b80 1 --2- 172.21.15.82:0/1731246123 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e979ea0c40 0x55e979eacca0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1f640952f0 tx=0x7f1f64098d40 comp rx=0 tx=0).stop 2023-09-23T08:58:22.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.529+0000 7f1f8de21b80 1 -- 172.21.15.82:0/1731246123 shutdown_connections 2023-09-23T08:58:22.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.529+0000 7f1f8de21b80 1 --2- 172.21.15.82:0/1731246123 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e979ea6ca0 0x55e979eaa660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:58:22.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.529+0000 7f1f8de21b80 1 --2- 172.21.15.82:0/1731246123 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e979ea0c40 0x55e979eacca0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:58:22.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.529+0000 7f1f8de21b80 1 --2- 172.21.15.82:0/1731246123 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55e979eba3e0 0x55e979ebc800 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:58:22.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.529+0000 7f1f8de21b80 1 --2- 172.21.15.82:0/1731246123 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e979ea6380 0x55e979ea9f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:58:22.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.529+0000 7f1f537fe700 0 client.25669 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T08:58:22.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.529+0000 7f1f8de21b80 1 -- 172.21.15.82:0/1731246123 >> 172.21.15.82:0/1731246123 conn(0x55e979e150e0 msgr2=0x55e979e95b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:58:22.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.529+0000 7f1f8de21b80 1 -- 172.21.15.82:0/1731246123 shutdown_connections 2023-09-23T08:58:22.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.529+0000 7f1f8de21b80 1 -- 172.21.15.82:0/1731246123 wait complete. 2023-09-23T08:58:22.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.529+0000 7f1f8de21b80 20 client.25669 trim_cache size 0 max 16384 2023-09-23T08:58:22.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.555+0000 7f1f8de21b80 1 Processor -- start 2023-09-23T08:58:22.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.555+0000 7f1f8de21b80 1 -- start start 2023-09-23T08:58:22.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.555+0000 7f1f8de21b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e979ea0c40 0x55e979e9b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:58:22.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.555+0000 7f1f8de21b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e979ea6380 0x55e979eac840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:58:22.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.555+0000 7f1f8de21b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e979ea6ca0 0x55e979ea96e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:58:22.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.555+0000 7f1f8de21b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e979c74920 con 0x55e979ea6380 2023-09-23T08:58:22.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.555+0000 7f1f8de21b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e979e97810 con 0x55e979ea0c40 2023-09-23T08:58:22.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.555+0000 7f1f8de21b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e979e93640 con 0x55e979ea6ca0 2023-09-23T08:58:22.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.556+0000 7f1f78b9c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e979ea6ca0 0x55e979ea96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:58:22.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.556+0000 7f1f73fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e979ea0c40 0x55e979e9b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:58:22.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.556+0000 7f1f78b9c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e979ea6ca0 0x55e979ea96e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:33696/0 (socket says 172.21.15.82:33696) 2023-09-23T08:58:22.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.556+0000 7f1f737fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e979ea6380 0x55e979eac840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:58:22.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.556+0000 7f1f78b9c700 1 -- 172.21.15.82:0/2698653766 learned_addr learned my addr 172.21.15.82:0/2698653766 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:58:22.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.556+0000 7f1f78b9c700 1 -- 172.21.15.82:0/2698653766 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e979ea0c40 msgr2=0x55e979e9b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:58:22.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.556+0000 7f1f78b9c700 1 --2- 172.21.15.82:0/2698653766 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e979ea0c40 0x55e979e9b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:58:22.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.556+0000 7f1f78b9c700 1 -- 172.21.15.82:0/2698653766 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e979ea6380 msgr2=0x55e979eac840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:58:22.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.556+0000 7f1f78b9c700 1 --2- 172.21.15.82:0/2698653766 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e979ea6380 0x55e979eac840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:58:22.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.556+0000 7f1f78b9c700 1 -- 172.21.15.82:0/2698653766 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e979ec13f0 con 0x55e979ea6ca0 2023-09-23T08:58:22.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.557+0000 7f1f78b9c700 1 --2- 172.21.15.82:0/2698653766 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e979ea6ca0 0x55e979ea96e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1f741017f0 tx=0x7f1f6c01f000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea009d80f4ca4c74 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:58:22.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.557+0000 7f1f5affd700 1 -- 172.21.15.82:0/2698653766 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f6c00e040 con 0x55e979ea6ca0 2023-09-23T08:58:22.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.557+0000 7f1f5affd700 1 -- 172.21.15.82:0/2698653766 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1f6c00f040 con 0x55e979ea6ca0 2023-09-23T08:58:22.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.557+0000 7f1f5affd700 1 -- 172.21.15.82:0/2698653766 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f6c004820 con 0x55e979ea6ca0 2023-09-23T08:58:22.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.558+0000 7f1f8de21b80 1 -- 172.21.15.82:0/2698653766 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e979ea6ca0 msgr2=0x55e979ea96e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:58:22.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.558+0000 7f1f8de21b80 1 --2- 172.21.15.82:0/2698653766 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e979ea6ca0 0x55e979ea96e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1f741017f0 tx=0x7f1f6c01f000 comp rx=0 tx=0).stop 2023-09-23T08:58:22.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.558+0000 7f1f8de21b80 1 -- 172.21.15.82:0/2698653766 shutdown_connections 2023-09-23T08:58:22.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.558+0000 7f1f8de21b80 1 --2- 172.21.15.82:0/2698653766 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e979ea6ca0 0x55e979ea96e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:58:22.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.558+0000 7f1f8de21b80 1 --2- 172.21.15.82:0/2698653766 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e979ea0c40 0x55e979e9b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:58:22.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.558+0000 7f1f8de21b80 1 --2- 172.21.15.82:0/2698653766 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e979ea6380 0x55e979eac840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:58:22.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.558+0000 7f1f8de21b80 1 -- 172.21.15.82:0/2698653766 >> 172.21.15.82:0/2698653766 conn(0x55e979e150e0 msgr2=0x55e979eb6a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:58:22.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.558+0000 7f1f8de21b80 1 -- 172.21.15.82:0/2698653766 shutdown_connections 2023-09-23T08:58:22.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.558+0000 7f1f8de21b80 1 -- 172.21.15.82:0/2698653766 wait complete. 2023-09-23T08:58:22.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.558+0000 7f1f8de21b80 1 -- start start 2023-09-23T08:58:22.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.558+0000 7f1f8de21b80 1 Processor -- start 2023-09-23T08:58:22.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.559+0000 7f1f8de21b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e979ea0c40 0x55e979ea3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:58:22.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.559+0000 7f1f8de21b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e979ea6380 0x55e979ea3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:58:22.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.559+0000 7f1f8de21b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e979ea6ca0 0x55e979ea1e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:58:22.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.559+0000 7f1f8de21b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e979ea2380 con 0x55e979ea6380 2023-09-23T08:58:22.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.559+0000 7f1f8de21b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e979ea24f0 con 0x55e979ea6ca0 2023-09-23T08:58:22.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.559+0000 7f1f8de21b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e979ea26b0 con 0x55e979ea0c40 2023-09-23T08:58:22.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.559+0000 7f1f8de21b80 10 client.0 _ll_register_callbacks cb 0x7f1f6c0097c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T08:58:22.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.559+0000 7f1f73fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e979ea0c40 0x55e979ea3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:58:22.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.559+0000 7f1f737fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e979ea6380 0x55e979ea3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:58:22.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.559+0000 7f1f73fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e979ea0c40 0x55e979ea3230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:33708/0 (socket says 172.21.15.82:33708) 2023-09-23T08:58:22.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.559+0000 7f1f73fff700 1 -- 172.21.15.82:0/36915193 learned_addr learned my addr 172.21.15.82:0/36915193 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:58:22.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.560+0000 7f1f78b9c700 1 --2- 172.21.15.82:0/36915193 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e979ea6ca0 0x55e979ea1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:58:22.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.560+0000 7f1f73fff700 1 -- 172.21.15.82:0/36915193 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e979ea6ca0 msgr2=0x55e979ea1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:58:22.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.560+0000 7f1f73fff700 1 --2- 172.21.15.82:0/36915193 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e979ea6ca0 0x55e979ea1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:58:22.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.560+0000 7f1f73fff700 1 -- 172.21.15.82:0/36915193 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e979ea6380 msgr2=0x55e979ea3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:58:22.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.560+0000 7f1f73fff700 1 --2- 172.21.15.82:0/36915193 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e979ea6380 0x55e979ea3770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:58:22.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.560+0000 7f1f73fff700 1 -- 172.21.15.82:0/36915193 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f6c009040 con 0x55e979ea0c40 2023-09-23T08:58:22.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.560+0000 7f1f737fe700 1 --2- 172.21.15.82:0/36915193 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e979ea6380 0x55e979ea3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T08:58:22.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.560+0000 7f1f73fff700 1 --2- 172.21.15.82:0/36915193 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e979ea0c40 0x55e979ea3230 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1f64098dd0 tx=0x7f1f64010a70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d1aa9d40e9e3b07 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:58:22.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.560+0000 7f1f537fe700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T08:58:22.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.561+0000 7f1f537fe700 1 -- 172.21.15.82:0/36915193 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f6409cc70 con 0x55e979ea0c40 2023-09-23T08:58:22.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.561+0000 7f1f537fe700 1 -- 172.21.15.82:0/36915193 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f1f640a0c50 con 0x55e979ea0c40 2023-09-23T08:58:22.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.561+0000 7f1f8de21b80 1 -- 172.21.15.82:0/36915193 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e979e938b0 con 0x55e979ea0c40 2023-09-23T08:58:22.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.561+0000 7f1f537fe700 1 -- 172.21.15.82:0/36915193 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1f64094fe0 con 0x55e979ea0c40 2023-09-23T08:58:22.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.561+0000 7f1f8de21b80 10 client.25675 fetch_fsmap learned FSMap version 30 2023-09-23T08:58:22.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.561+0000 7f1f8de21b80 1 -- 172.21.15.82:0/36915193 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55e979c1ede0 con 0x55e979ea0c40 2023-09-23T08:58:22.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.561+0000 7f1f537fe700 1 -- 172.21.15.82:0/36915193 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55e979e938b0 con 0x55e979ea0c40 2023-09-23T08:58:22.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.561+0000 7f1f537fe700 1 -- 172.21.15.82:0/36915193 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 30) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f1f6407e050 con 0x55e979ea0c40 2023-09-23T08:58:22.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.561+0000 7f1f8de21b80 10 client.25675 fetch_fsmap finished waiting for FSMap version 30 2023-09-23T08:58:22.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.561+0000 7f1f8de21b80 10 client.25675 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T08:58:22.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.561+0000 7f1f8de21b80 20 client.25675 populate_metadata read hostname 'smithi082' 2023-09-23T08:58:22.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.561+0000 7f1f8de21b80 1 --2- 172.21.15.82:0/36915193 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55e979f0ecc0 0x55e979f110e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:58:22.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.561+0000 7f1f8de21b80 4 client.25675 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T08:58:22.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.561+0000 7f1f8de21b80 1 -- 172.21.15.82:0/36915193 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55e979deb970 con 0x55e979f0ecc0 2023-09-23T08:58:22.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.562+0000 7f1f737fe700 1 --2- 172.21.15.82:0/36915193 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55e979f0ecc0 0x55e979f110e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:58:22.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.562+0000 7f1f537fe700 10 client.25675 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T08:58:22.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.562+0000 7f1f737fe700 1 --2- 172.21.15.82:0/36915193 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55e979f0ecc0 0x55e979f110e0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a77cfee160993a8 server_cookie=d201e504acc0e8b4 in_seq=0 out_seq=0 2023-09-23T08:58:22.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.563+0000 7f1f537fe700 1 -- 172.21.15.82:0/36915193 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55e979deb970 con 0x55e979f0ecc0 2023-09-23T08:58:22.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.563+0000 7f1f537fe700 10 client.25675 handle_command_reply: tid=0 2023-09-23T08:58:22.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.563+0000 7f1f8de21b80 1 client.25675 shutdown 2023-09-23T08:58:22.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.563+0000 7f1f8de21b80 1 -- 172.21.15.82:0/36915193 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e979ea0c40 msgr2=0x55e979ea3230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:58:22.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.563+0000 7f1f8de21b80 1 --2- 172.21.15.82:0/36915193 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e979ea0c40 0x55e979ea3230 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1f64098dd0 tx=0x7f1f64010a70 comp rx=0 tx=0).stop 2023-09-23T08:58:22.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.563+0000 7f1f8de21b80 1 -- 172.21.15.82:0/36915193 shutdown_connections 2023-09-23T08:58:22.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.563+0000 7f1f8de21b80 1 --2- 172.21.15.82:0/36915193 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e979ea6ca0 0x55e979ea1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:58:22.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.563+0000 7f1f8de21b80 1 --2- 172.21.15.82:0/36915193 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e979ea0c40 0x55e979ea3230 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:58:22.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.563+0000 7f1f8de21b80 1 --2- 172.21.15.82:0/36915193 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55e979f0ecc0 0x55e979f110e0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:58:22.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.563+0000 7f1f8de21b80 1 --2- 172.21.15.82:0/36915193 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e979ea6380 0x55e979ea3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:58:22.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.563+0000 7f1f537fe700 0 client.25675 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T08:58:22.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.563+0000 7f1f8de21b80 1 -- 172.21.15.82:0/36915193 >> 172.21.15.82:0/36915193 conn(0x55e979e150e0 msgr2=0x55e979ea4090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:58:22.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.563+0000 7f1f8de21b80 1 -- 172.21.15.82:0/36915193 shutdown_connections 2023-09-23T08:58:22.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.563+0000 7f1f8de21b80 1 -- 172.21.15.82:0/36915193 wait complete. 2023-09-23T08:58:22.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.564+0000 7f1f8de21b80 20 client.25675 trim_cache size 0 max 16384 2023-09-23T08:58:22.570 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T08:58:22.571 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-23T08:58:22.571 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T08:58:22.571 INFO:teuthology.orchestra.run.smithi082.stdout: "6f0fe3a6-7212-425d-a0a6-f38e8b42ec13": { 2023-09-23T08:58:22.571 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T08:58:22.571 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "6f0fe3a6-7212-425d-a0a6-f38e8b42ec13", 2023-09-23T08:58:22.571 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T08:58:22.571 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T08:58:22.571 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T08:58:22.571 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T08:58:22.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.564+0000 7f1f7a5ff700 1 -- 172.21.15.82:0/2573847296 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f1f5c0a01e0 msgr2=0x7f1f5c0a26a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:58:22.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.564+0000 7f1f7a5ff700 1 --2- 172.21.15.82:0/2573847296 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f1f5c0a01e0 0x7f1f5c0a26a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c009ec0 tx=0x7f1f6c013250 comp rx=0 tx=0).stop 2023-09-23T08:58:22.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.564+0000 7f1f7a5ff700 1 -- 172.21.15.82:0/2573847296 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f74101a90 msgr2=0x7f1f740ff6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:58:22.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.564+0000 7f1f7a5ff700 1 --2- 172.21.15.82:0/2573847296 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f74101a90 0x7f1f740ff6e0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f1f6400e9a0 tx=0x7f1f6400ecb0 comp rx=0 tx=0).stop 2023-09-23T08:58:22.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.564+0000 7f1f7a5ff700 1 -- 172.21.15.82:0/2573847296 shutdown_connections 2023-09-23T08:58:22.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.564+0000 7f1f7a5ff700 1 --2- 172.21.15.82:0/2573847296 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f1f5c0a01e0 0x7f1f5c0a26a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:58:22.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.564+0000 7f1f7a5ff700 1 --2- 172.21.15.82:0/2573847296 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1f7410ae60 0x7f1f741a4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:58:22.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.564+0000 7f1f7a5ff700 1 --2- 172.21.15.82:0/2573847296 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f74101a90 0x7f1f740ff6e0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:58:22.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.564+0000 7f1f7a5ff700 1 --2- 172.21.15.82:0/2573847296 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f741023b0 0x7f1f740ffc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:58:22.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.564+0000 7f1f7a5ff700 1 -- 172.21.15.82:0/2573847296 >> 172.21.15.82:0/2573847296 conn(0x7f1f740fb270 msgr2=0x7f1f740fbee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:58:22.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.565+0000 7f1f7a5ff700 1 -- 172.21.15.82:0/2573847296 shutdown_connections 2023-09-23T08:58:22.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:22.565+0000 7f1f7a5ff700 1 -- 172.21.15.82:0/2573847296 wait complete. 2023-09-23T08:58:22.589 INFO:tasks.cephfs.filesystem:scrub status for tag:6f0fe3a6-7212-425d-a0a6-f38e8b42ec13 - {'path': '/', 'tag': '6f0fe3a6-7212-425d-a0a6-f38e8b42ec13', 'options': 'recursive,force'} 2023-09-23T08:58:22.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:58:22 smithi082 ceph-mon[97694]: pgmap v47: 97 pgs: 97 active+clean; 879 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 MiB/s wr, 27 op/s 2023-09-23T08:58:22.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:58:22 smithi161 ceph-mon[99580]: pgmap v47: 97 pgs: 97 active+clean; 879 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 MiB/s wr, 27 op/s 2023-09-23T08:58:23.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:58:22 smithi135 ceph-mon[99205]: pgmap v47: 97 pgs: 97 active+clean; 879 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 MiB/s wr, 27 op/s 2023-09-23T08:58:23.578 INFO:teuthology.orchestra.run.smithi082.stderr:3800000 of 50000000 tuples (7%) done (elapsed 58.32 s, remaining 709.05 s) 2023-09-23T08:58:24.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:58:24 smithi082 ceph-mon[97694]: pgmap v48: 97 pgs: 97 active+clean; 879 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 25 MiB/s wr, 24 op/s 2023-09-23T08:58:24.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:58:24 smithi161 ceph-mon[99580]: pgmap v48: 97 pgs: 97 active+clean; 879 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 25 MiB/s wr, 24 op/s 2023-09-23T08:58:25.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:58:24 smithi135 ceph-mon[99205]: pgmap v48: 97 pgs: 97 active+clean; 879 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 25 MiB/s wr, 24 op/s 2023-09-23T08:58:25.312 INFO:teuthology.orchestra.run.smithi082.stderr:3900000 of 50000000 tuples (7%) done (elapsed 60.05 s, remaining 709.87 s) 2023-09-23T08:58:26.525 INFO:teuthology.orchestra.run.smithi082.stderr:4000000 of 50000000 tuples (8%) done (elapsed 61.27 s, remaining 704.57 s) 2023-09-23T08:58:26.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:58:26 smithi082 ceph-mon[97694]: pgmap v49: 97 pgs: 97 active+clean; 951 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 38 MiB/s wr, 38 op/s 2023-09-23T08:58:26.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:58:26 smithi082 ceph-mon[97694]: mgrmap e26: x(active, since 92s), standbys: y, z 2023-09-23T08:58:26.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:58:26 smithi161 ceph-mon[99580]: pgmap v49: 97 pgs: 97 active+clean; 951 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 38 MiB/s wr, 38 op/s 2023-09-23T08:58:26.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:58:26 smithi161 ceph-mon[99580]: mgrmap e26: x(active, since 92s), standbys: y, z 2023-09-23T08:58:27.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:58:26 smithi135 ceph-mon[99205]: pgmap v49: 97 pgs: 97 active+clean; 951 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 38 MiB/s wr, 38 op/s 2023-09-23T08:58:27.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:58:26 smithi135 ceph-mon[99205]: mgrmap e26: x(active, since 92s), standbys: y, z 2023-09-23T08:58:28.143 INFO:teuthology.orchestra.run.smithi082.stderr:4100000 of 50000000 tuples (8%) done (elapsed 62.88 s, remaining 704.00 s) 2023-09-23T08:58:28.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:58:28 smithi082 ceph-mon[97694]: pgmap v50: 97 pgs: 97 active+clean; 951 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 25 MiB/s wr, 26 op/s 2023-09-23T08:58:28.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:58:28 smithi161 ceph-mon[99580]: pgmap v50: 97 pgs: 97 active+clean; 951 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 25 MiB/s wr, 26 op/s 2023-09-23T08:58:29.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:58:28 smithi135 ceph-mon[99205]: pgmap v50: 97 pgs: 97 active+clean; 951 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 25 MiB/s wr, 26 op/s 2023-09-23T08:58:29.411 INFO:teuthology.orchestra.run.smithi082.stderr:4200000 of 50000000 tuples (8%) done (elapsed 64.15 s, remaining 699.58 s) 2023-09-23T08:58:30.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:58:30 smithi082 ceph-mon[97694]: pgmap v51: 97 pgs: 97 active+clean; 1.0 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 37 MiB/s wr, 45 op/s 2023-09-23T08:58:30.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:58:30 smithi161 ceph-mon[99580]: pgmap v51: 97 pgs: 97 active+clean; 1.0 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 37 MiB/s wr, 45 op/s 2023-09-23T08:58:31.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:58:30 smithi135 ceph-mon[99205]: pgmap v51: 97 pgs: 97 active+clean; 1.0 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 37 MiB/s wr, 45 op/s 2023-09-23T08:58:31.076 INFO:teuthology.orchestra.run.smithi082.stderr:4300000 of 50000000 tuples (8%) done (elapsed 65.82 s, remaining 699.51 s) 2023-09-23T08:58:32.756 INFO:teuthology.orchestra.run.smithi082.stderr:4400000 of 50000000 tuples (8%) done (elapsed 67.50 s, remaining 699.52 s) 2023-09-23T08:58:32.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:58:32 smithi161 ceph-mon[99580]: pgmap v52: 97 pgs: 97 active+clean; 1.0 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 27 MiB/s wr, 35 op/s 2023-09-23T08:58:33.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:58:32 smithi135 ceph-mon[99205]: pgmap v52: 97 pgs: 97 active+clean; 1.0 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 27 MiB/s wr, 35 op/s 2023-09-23T08:58:33.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:58:32 smithi082 ceph-mon[97694]: pgmap v52: 97 pgs: 97 active+clean; 1.0 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 27 MiB/s wr, 35 op/s 2023-09-23T08:58:33.974 INFO:teuthology.orchestra.run.smithi082.stderr:4500000 of 50000000 tuples (9%) done (elapsed 68.72 s, remaining 694.80 s) 2023-09-23T08:58:34.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:58:34 smithi161 ceph-mon[99580]: pgmap v53: 97 pgs: 97 active+clean; 1.0 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 25 MiB/s wr, 32 op/s 2023-09-23T08:58:35.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:58:34 smithi135 ceph-mon[99205]: pgmap v53: 97 pgs: 97 active+clean; 1.0 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 25 MiB/s wr, 32 op/s 2023-09-23T08:58:35.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:58:34 smithi082 ceph-mon[97694]: pgmap v53: 97 pgs: 97 active+clean; 1.0 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 25 MiB/s wr, 32 op/s 2023-09-23T08:58:35.711 INFO:teuthology.orchestra.run.smithi082.stderr:4600000 of 50000000 tuples (9%) done (elapsed 70.45 s, remaining 695.35 s) 2023-09-23T08:58:36.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:58:36 smithi161 ceph-mon[99580]: pgmap v54: 97 pgs: 97 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 38 MiB/s wr, 46 op/s 2023-09-23T08:58:37.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:58:36 smithi135 ceph-mon[99205]: pgmap v54: 97 pgs: 97 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 38 MiB/s wr, 46 op/s 2023-09-23T08:58:37.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:58:36 smithi082 ceph-mon[97694]: pgmap v54: 97 pgs: 97 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 38 MiB/s wr, 46 op/s 2023-09-23T08:58:37.411 INFO:teuthology.orchestra.run.smithi082.stderr:4700000 of 50000000 tuples (9%) done (elapsed 72.15 s, remaining 695.43 s) 2023-09-23T08:58:38.541 INFO:teuthology.orchestra.run.smithi082.stderr:4800000 of 50000000 tuples (9%) done (elapsed 73.28 s, remaining 690.08 s) 2023-09-23T08:58:38.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:58:38 smithi161 ceph-mon[99580]: pgmap v55: 97 pgs: 97 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 25 MiB/s wr, 32 op/s 2023-09-23T08:58:39.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:58:38 smithi135 ceph-mon[99205]: pgmap v55: 97 pgs: 97 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 25 MiB/s wr, 32 op/s 2023-09-23T08:58:39.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:58:38 smithi082 ceph-mon[97694]: pgmap v55: 97 pgs: 97 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 25 MiB/s wr, 32 op/s 2023-09-23T08:58:40.237 INFO:teuthology.orchestra.run.smithi082.stderr:4900000 of 50000000 tuples (9%) done (elapsed 74.98 s, remaining 690.12 s) 2023-09-23T08:58:40.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:58:40 smithi161 ceph-mon[99580]: pgmap v56: 97 pgs: 97 active+clean; 1.2 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 38 MiB/s wr, 46 op/s 2023-09-23T08:58:41.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:58:40 smithi135 ceph-mon[99205]: pgmap v56: 97 pgs: 97 active+clean; 1.2 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 38 MiB/s wr, 46 op/s 2023-09-23T08:58:41.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:58:40 smithi082 ceph-mon[97694]: pgmap v56: 97 pgs: 97 active+clean; 1.2 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 38 MiB/s wr, 46 op/s 2023-09-23T08:58:42.269 INFO:teuthology.orchestra.run.smithi082.stderr:5000000 of 50000000 tuples (10%) done (elapsed 77.01 s, remaining 693.10 s) 2023-09-23T08:58:42.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:58:42 smithi161 ceph-mon[99580]: pgmap v57: 97 pgs: 97 active+clean; 1.2 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 25 MiB/s wr, 27 op/s 2023-09-23T08:58:43.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:58:42 smithi135 ceph-mon[99205]: pgmap v57: 97 pgs: 97 active+clean; 1.2 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 25 MiB/s wr, 27 op/s 2023-09-23T08:58:43.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:58:42 smithi082 ceph-mon[97694]: pgmap v57: 97 pgs: 97 active+clean; 1.2 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 25 MiB/s wr, 27 op/s 2023-09-23T08:58:43.480 INFO:teuthology.orchestra.run.smithi082.stderr:5100000 of 50000000 tuples (10%) done (elapsed 78.22 s, remaining 688.67 s) 2023-09-23T08:58:44.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:58:44 smithi161 ceph-mon[99580]: pgmap v58: 97 pgs: 97 active+clean; 1.2 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 25 MiB/s wr, 27 op/s 2023-09-23T08:58:45.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:58:44 smithi135 ceph-mon[99205]: pgmap v58: 97 pgs: 97 active+clean; 1.2 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 25 MiB/s wr, 27 op/s 2023-09-23T08:58:45.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:58:44 smithi082 ceph-mon[97694]: pgmap v58: 97 pgs: 97 active+clean; 1.2 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 25 MiB/s wr, 27 op/s 2023-09-23T08:58:45.187 INFO:teuthology.orchestra.run.smithi082.stderr:5200000 of 50000000 tuples (10%) done (elapsed 79.93 s, remaining 688.62 s) 2023-09-23T08:58:46.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:58:46 smithi161 ceph-mon[99580]: pgmap v59: 97 pgs: 97 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 37 MiB/s wr, 39 op/s 2023-09-23T08:58:46.922 INFO:teuthology.orchestra.run.smithi082.stderr:5300000 of 50000000 tuples (10%) done (elapsed 81.66 s, remaining 688.75 s) 2023-09-23T08:58:47.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:58:46 smithi135 ceph-mon[99205]: pgmap v59: 97 pgs: 97 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 37 MiB/s wr, 39 op/s 2023-09-23T08:58:47.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:58:46 smithi082 ceph-mon[97694]: pgmap v59: 97 pgs: 97 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 37 MiB/s wr, 39 op/s 2023-09-23T08:58:48.124 INFO:teuthology.orchestra.run.smithi082.stderr:5400000 of 50000000 tuples (10%) done (elapsed 82.87 s, remaining 684.41 s) 2023-09-23T08:58:49.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:58:48 smithi135 ceph-mon[99205]: pgmap v60: 97 pgs: 97 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 24 MiB/s wr, 25 op/s 2023-09-23T08:58:49.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:58:48 smithi082 ceph-mon[97694]: pgmap v60: 97 pgs: 97 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 24 MiB/s wr, 25 op/s 2023-09-23T08:58:49.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:58:48 smithi161 ceph-mon[99580]: pgmap v60: 97 pgs: 97 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 24 MiB/s wr, 25 op/s 2023-09-23T08:58:49.753 INFO:teuthology.orchestra.run.smithi082.stderr:5500000 of 50000000 tuples (11%) done (elapsed 84.50 s, remaining 683.65 s) 2023-09-23T08:58:50.949 INFO:teuthology.orchestra.run.smithi082.stderr:5600000 of 50000000 tuples (11%) done (elapsed 85.69 s, remaining 679.41 s) 2023-09-23T08:58:51.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:58:50 smithi135 ceph-mon[99205]: pgmap v61: 97 pgs: 97 active+clean; 1.3 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 37 MiB/s wr, 39 op/s 2023-09-23T08:58:51.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:58:50 smithi082 ceph-mon[97694]: pgmap v61: 97 pgs: 97 active+clean; 1.3 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 37 MiB/s wr, 39 op/s 2023-09-23T08:58:51.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:58:50 smithi161 ceph-mon[99580]: pgmap v61: 97 pgs: 97 active+clean; 1.3 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 37 MiB/s wr, 39 op/s 2023-09-23T08:58:52.591 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T08:58:52.696 INFO:teuthology.orchestra.run.smithi082.stderr:5700000 of 50000000 tuples (11%) done (elapsed 87.44 s, remaining 679.56 s) 2023-09-23T08:58:52.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:58:52 smithi135 ceph-mon[99205]: pgmap v62: 97 pgs: 97 active+clean; 1.3 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 MiB/s wr, 26 op/s 2023-09-23T08:58:52.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.818+0000 7f0441f9d700 1 -- 172.21.15.82:0/2912289603 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f043c106720 msgr2=0x7f043c106b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:58:52.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.818+0000 7f0441f9d700 1 --2- 172.21.15.82:0/2912289603 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f043c106720 0x7f043c106b00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0430009990 tx=0x7f0430009ca0 comp rx=0 tx=0).stop 2023-09-23T08:58:52.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.818+0000 7f0441f9d700 1 -- 172.21.15.82:0/2912289603 shutdown_connections 2023-09-23T08:58:52.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.818+0000 7f0441f9d700 1 --2- 172.21.15.82:0/2912289603 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f043c1010d0 0x7f043c10d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:58:52.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.818+0000 7f0441f9d700 1 --2- 172.21.15.82:0/2912289603 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f043c106720 0x7f043c106b00 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:58:52.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.818+0000 7f0441f9d700 1 --2- 172.21.15.82:0/2912289603 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f043c100710 0x7f043c100b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:58:52.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.818+0000 7f0441f9d700 1 -- 172.21.15.82:0/2912289603 >> 172.21.15.82:0/2912289603 conn(0x7f043c0fc1e0 msgr2=0x7f043c0fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:58:52.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.818+0000 7f0441f9d700 1 -- 172.21.15.82:0/2912289603 shutdown_connections 2023-09-23T08:58:52.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.818+0000 7f0441f9d700 1 -- 172.21.15.82:0/2912289603 wait complete. 2023-09-23T08:58:52.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.819+0000 7f0441f9d700 1 Processor -- start 2023-09-23T08:58:52.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.819+0000 7f0441f9d700 1 -- start start 2023-09-23T08:58:52.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.819+0000 7f0441f9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f043c100710 0x7f043c19e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:58:52.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.819+0000 7f0441f9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f043c1010d0 0x7f043c19eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:58:52.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.819+0000 7f0441f9d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f043c106720 0x7f043c198690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:58:52.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.819+0000 7f0441f9d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f043c198d00 con 0x7f043c100710 2023-09-23T08:58:52.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.819+0000 7f0441f9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f043c198e70 con 0x7f043c1010d0 2023-09-23T08:58:52.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.819+0000 7f0441f9d700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f043c199030 con 0x7f043c106720 2023-09-23T08:58:52.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.820+0000 7f0440f9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f043c100710 0x7f043c19e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:58:52.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.820+0000 7f043bfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f043c1010d0 0x7f043c19eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:58:52.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.820+0000 7f044179c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f043c106720 0x7f043c198690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:58:52.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.820+0000 7f0440f9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f043c100710 0x7f043c19e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53570/0 (socket says 172.21.15.82:53570) 2023-09-23T08:58:52.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.820+0000 7f0440f9b700 1 -- 172.21.15.82:0/155381497 learned_addr learned my addr 172.21.15.82:0/155381497 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:58:52.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.820+0000 7f0440f9b700 1 -- 172.21.15.82:0/155381497 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f043c106720 msgr2=0x7f043c198690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:58:52.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.820+0000 7f0440f9b700 1 --2- 172.21.15.82:0/155381497 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f043c106720 0x7f043c198690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:58:52.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.820+0000 7f0440f9b700 1 -- 172.21.15.82:0/155381497 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f043c1010d0 msgr2=0x7f043c19eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:58:52.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.820+0000 7f0440f9b700 1 --2- 172.21.15.82:0/155381497 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f043c1010d0 0x7f043c19eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:58:52.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.820+0000 7f0440f9b700 1 -- 172.21.15.82:0/155381497 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04300095f0 con 0x7f043c100710 2023-09-23T08:58:52.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.821+0000 7f0440f9b700 1 --2- 172.21.15.82:0/155381497 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f043c100710 0x7f043c19e620 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f0430005910 tx=0x7f04300047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:58:52.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.821+0000 7f0439ffb700 1 -- 172.21.15.82:0/155381497 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f043001d070 con 0x7f043c100710 2023-09-23T08:58:52.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.821+0000 7f0439ffb700 1 -- 172.21.15.82:0/155381497 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0430021410 con 0x7f043c100710 2023-09-23T08:58:52.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.821+0000 7f0439ffb700 1 -- 172.21.15.82:0/155381497 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0430017650 con 0x7f043c100710 2023-09-23T08:58:52.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.821+0000 7f0441f9d700 1 -- 172.21.15.82:0/155381497 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f043c199310 con 0x7f043c100710 2023-09-23T08:58:52.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.821+0000 7f0441f9d700 1 -- 172.21.15.82:0/155381497 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f043c1a5610 con 0x7f043c100710 2023-09-23T08:58:52.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.825+0000 7f0439ffb700 1 -- 172.21.15.82:0/155381497 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f0430021580 con 0x7f043c100710 2023-09-23T08:58:52.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.826+0000 7f0456b95b80 1 Processor -- start 2023-09-23T08:58:52.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.826+0000 7f0456b95b80 1 -- start start 2023-09-23T08:58:52.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.827+0000 7f0456b95b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563a4d581500 0x563a4d5818e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:58:52.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.827+0000 7f0439ffb700 1 --2- 172.21.15.82:0/155381497 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f042c0a0160 0x7f042c0a2620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:58:52.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.827+0000 7f0456b95b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a4d581e20 0x563a4d57b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:58:52.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.827+0000 7f0456b95b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563a4d57bc40 0x563a4d57c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:58:52.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.827+0000 7f0456b95b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a4d4e37b0 con 0x563a4d581e20 2023-09-23T08:58:52.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.827+0000 7f0456b95b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a4d4d4780 con 0x563a4d57bc40 2023-09-23T08:58:52.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.827+0000 7f0456b95b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a4d4d20a0 con 0x563a4d581500 2023-09-23T08:58:52.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.827+0000 7f0439ffb700 1 -- 172.21.15.82:0/155381497 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f04300cc840 con 0x7f043c100710 2023-09-23T08:58:52.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.827+0000 7f044179c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563a4d581500 0x563a4d5818e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:58:52.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.827+0000 7f044179c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563a4d581500 0x563a4d5818e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:51622/0 (socket says 172.21.15.82:51622) 2023-09-23T08:58:52.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.827+0000 7f044179c700 1 -- 172.21.15.82:0/2169512832 learned_addr learned my addr 172.21.15.82:0/2169512832 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:58:52.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.827+0000 7f0440f9b700 1 --2- 172.21.15.82:0/155381497 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f042c0a0160 0x7f042c0a2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:58:52.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.827+0000 7f044179c700 1 --2- 172.21.15.82:0/2169512832 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563a4d57bc40 0x563a4d57c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:58:52.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.827+0000 7f043bfff700 1 --2- 172.21.15.82:0/2169512832 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a4d581e20 0x563a4d57b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:58:52.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.828+0000 7f044179c700 1 -- 172.21.15.82:0/2169512832 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563a4d57bc40 msgr2=0x563a4d57c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:58:52.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.828+0000 7f044179c700 1 --2- 172.21.15.82:0/2169512832 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563a4d57bc40 0x563a4d57c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:58:52.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.828+0000 7f044179c700 1 -- 172.21.15.82:0/2169512832 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a4d581e20 msgr2=0x563a4d57b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:58:52.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.828+0000 7f044179c700 1 --2- 172.21.15.82:0/2169512832 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a4d581e20 0x563a4d57b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:58:52.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.828+0000 7f044179c700 1 -- 172.21.15.82:0/2169512832 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563a4d34d630 con 0x563a4d581500 2023-09-23T08:58:52.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.828+0000 7f044179c700 1 --2- 172.21.15.82:0/2169512832 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563a4d581500 0x563a4d5818e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0434013e70 tx=0x7f0434009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=22d66afa4ab9814c server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:58:52.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.828+0000 7f0440f9b700 1 --2- 172.21.15.82:0/155381497 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f042c0a0160 0x7f042c0a2620 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0430005b40 tx=0x7f043009f040 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:58:52.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.828+0000 7f0426ffd700 1 -- 172.21.15.82:0/2169512832 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f043400e040 con 0x563a4d581500 2023-09-23T08:58:52.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.828+0000 7f0426ffd700 1 -- 172.21.15.82:0/2169512832 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f043400f040 con 0x563a4d581500 2023-09-23T08:58:52.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.828+0000 7f0426ffd700 1 -- 172.21.15.82:0/2169512832 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0434003e20 con 0x563a4d581500 2023-09-23T08:58:52.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.829+0000 7f0456b95b80 1 -- 172.21.15.82:0/2169512832 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563a4d581500 msgr2=0x563a4d5818e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:58:52.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.829+0000 7f0456b95b80 1 --2- 172.21.15.82:0/2169512832 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563a4d581500 0x563a4d5818e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0434013e70 tx=0x7f0434009920 comp rx=0 tx=0).stop 2023-09-23T08:58:52.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.829+0000 7f0456b95b80 1 -- 172.21.15.82:0/2169512832 shutdown_connections 2023-09-23T08:58:52.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.829+0000 7f0456b95b80 1 --2- 172.21.15.82:0/2169512832 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563a4d57bc40 0x563a4d57c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:58:52.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.829+0000 7f0456b95b80 1 --2- 172.21.15.82:0/2169512832 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563a4d581500 0x563a4d5818e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:58:52.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.829+0000 7f0456b95b80 1 --2- 172.21.15.82:0/2169512832 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a4d581e20 0x563a4d57b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:58:52.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.829+0000 7f0456b95b80 1 -- 172.21.15.82:0/2169512832 >> 172.21.15.82:0/2169512832 conn(0x563a4d4f00e0 msgr2=0x563a4d576940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:58:52.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.829+0000 7f0456b95b80 1 -- 172.21.15.82:0/2169512832 shutdown_connections 2023-09-23T08:58:52.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.829+0000 7f0456b95b80 1 -- 172.21.15.82:0/2169512832 wait complete. 2023-09-23T08:58:52.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.830+0000 7f0456b95b80 1 -- start start 2023-09-23T08:58:52.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.830+0000 7f0456b95b80 1 Processor -- start 2023-09-23T08:58:52.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.831+0000 7f0456b95b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563a4d57bc40 0x563a4d587de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:58:52.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.831+0000 7f0456b95b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a4d581500 0x563a4d585060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:58:52.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.831+0000 7f0456b95b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563a4d581e20 0x563a4d5857a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:58:52.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.831+0000 7f0456b95b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a4d4cd990 con 0x563a4d581500 2023-09-23T08:58:52.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.831+0000 7f0456b95b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a4d46bbb0 con 0x563a4d57bc40 2023-09-23T08:58:52.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.831+0000 7f0456b95b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a4d46b8b0 con 0x563a4d581e20 2023-09-23T08:58:52.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.831+0000 7f0456b95b80 10 client.0 _ll_register_callbacks cb 0x563a4d3b5a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T08:58:52.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.831+0000 7f043bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a4d581500 0x563a4d585060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:58:52.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.831+0000 7f043bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a4d581500 0x563a4d585060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53598/0 (socket says 172.21.15.82:53598) 2023-09-23T08:58:52.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.831+0000 7f043bfff700 1 -- 172.21.15.82:0/1518741718 learned_addr learned my addr 172.21.15.82:0/1518741718 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:58:52.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.831+0000 7f044179c700 1 --2- 172.21.15.82:0/1518741718 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563a4d57bc40 0x563a4d587de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:58:52.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.831+0000 7f044179c700 1 --2- 172.21.15.82:0/1518741718 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563a4d581e20 0x563a4d5857a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:58:52.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.832+0000 7f043bfff700 1 -- 172.21.15.82:0/1518741718 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563a4d581e20 msgr2=0x563a4d5857a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:58:52.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.832+0000 7f043bfff700 1 --2- 172.21.15.82:0/1518741718 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563a4d581e20 0x563a4d5857a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:58:52.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.832+0000 7f043bfff700 1 -- 172.21.15.82:0/1518741718 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563a4d57bc40 msgr2=0x563a4d587de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:58:52.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.832+0000 7f043bfff700 1 --2- 172.21.15.82:0/1518741718 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563a4d57bc40 0x563a4d587de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:58:52.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.832+0000 7f043bfff700 1 -- 172.21.15.82:0/1518741718 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0434013b20 con 0x563a4d581500 2023-09-23T08:58:52.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.832+0000 7f044179c700 1 --2- 172.21.15.82:0/1518741718 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563a4d581e20 0x563a4d5857a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T08:58:52.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.832+0000 7f043bfff700 1 --2- 172.21.15.82:0/1518741718 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a4d581500 0x563a4d585060 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f0428012840 tx=0x7f0428012b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb5f6614fad30e75 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:58:52.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.832+0000 7f041bfff700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T08:58:52.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.832+0000 7f041bfff700 1 -- 172.21.15.82:0/1518741718 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0428017070 con 0x563a4d581500 2023-09-23T08:58:52.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.832+0000 7f041bfff700 1 -- 172.21.15.82:0/1518741718 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f0428004830 con 0x563a4d581500 2023-09-23T08:58:52.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.832+0000 7f0456b95b80 1 -- 172.21.15.82:0/1518741718 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563a4d54b1c0 con 0x563a4d581500 2023-09-23T08:58:52.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.832+0000 7f041bfff700 1 -- 172.21.15.82:0/1518741718 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0428004a30 con 0x563a4d581500 2023-09-23T08:58:52.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.832+0000 7f0456b95b80 10 client.15948 fetch_fsmap learned FSMap version 30 2023-09-23T08:58:52.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.832+0000 7f0456b95b80 1 -- 172.21.15.82:0/1518741718 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x563a4d2f9de0 con 0x563a4d581500 2023-09-23T08:58:52.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.833+0000 7f041bfff700 1 -- 172.21.15.82:0/1518741718 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x563a4d54b1c0 con 0x563a4d581500 2023-09-23T08:58:52.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.833+0000 7f041bfff700 1 -- 172.21.15.82:0/1518741718 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 30) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f042801c630 con 0x563a4d581500 2023-09-23T08:58:52.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.833+0000 7f0456b95b80 10 client.15948 fetch_fsmap finished waiting for FSMap version 30 2023-09-23T08:58:52.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.833+0000 7f0456b95b80 10 client.15948 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T08:58:52.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.833+0000 7f0456b95b80 20 client.15948 populate_metadata read hostname 'smithi082' 2023-09-23T08:58:52.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.833+0000 7f0456b95b80 1 --2- 172.21.15.82:0/1518741718 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x563a4d595940 0x563a4d597d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:58:52.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.833+0000 7f0456b95b80 4 client.15948 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T08:58:52.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.833+0000 7f0456b95b80 1 -- 172.21.15.82:0/1518741718 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563a4d473ba0 con 0x563a4d595940 2023-09-23T08:58:52.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.833+0000 7f044179c700 1 --2- 172.21.15.82:0/1518741718 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x563a4d595940 0x563a4d597d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:58:52.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.834+0000 7f041bfff700 10 client.15948 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T08:58:52.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.834+0000 7f044179c700 1 --2- 172.21.15.82:0/1518741718 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x563a4d595940 0x563a4d597d60 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc201710ed17bfc9 server_cookie=31f6cd203c4fa372 in_seq=0 out_seq=0 2023-09-23T08:58:52.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.835+0000 7f041bfff700 1 -- 172.21.15.82:0/1518741718 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x563a4d473ba0 con 0x563a4d595940 2023-09-23T08:58:52.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.835+0000 7f041bfff700 10 client.15948 handle_command_reply: tid=0 2023-09-23T08:58:52.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.835+0000 7f0456b95b80 1 client.15948 shutdown 2023-09-23T08:58:52.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.835+0000 7f0456b95b80 1 -- 172.21.15.82:0/1518741718 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a4d581500 msgr2=0x563a4d585060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:58:52.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.835+0000 7f0456b95b80 1 --2- 172.21.15.82:0/1518741718 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a4d581500 0x563a4d585060 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f0428012840 tx=0x7f0428012b50 comp rx=0 tx=0).stop 2023-09-23T08:58:52.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.835+0000 7f0456b95b80 1 -- 172.21.15.82:0/1518741718 shutdown_connections 2023-09-23T08:58:52.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.835+0000 7f0456b95b80 1 --2- 172.21.15.82:0/1518741718 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563a4d581e20 0x563a4d5857a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:58:52.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.835+0000 7f0456b95b80 1 --2- 172.21.15.82:0/1518741718 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563a4d57bc40 0x563a4d587de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:58:52.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.835+0000 7f0456b95b80 1 --2- 172.21.15.82:0/1518741718 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x563a4d595940 0x563a4d597d60 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:58:52.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.835+0000 7f0456b95b80 1 --2- 172.21.15.82:0/1518741718 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a4d581500 0x563a4d585060 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:58:52.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.835+0000 7f0456b95b80 1 -- 172.21.15.82:0/1518741718 >> 172.21.15.82:0/1518741718 conn(0x563a4d4f00e0 msgr2=0x563a4d576530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:58:52.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.835+0000 7f041bfff700 0 client.15948 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T08:58:52.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.835+0000 7f0456b95b80 1 -- 172.21.15.82:0/1518741718 shutdown_connections 2023-09-23T08:58:52.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.835+0000 7f0456b95b80 1 -- 172.21.15.82:0/1518741718 wait complete. 2023-09-23T08:58:52.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.836+0000 7f0456b95b80 20 client.15948 trim_cache size 0 max 16384 2023-09-23T08:58:52.858 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.856+0000 7f0456b95b80 1 Processor -- start 2023-09-23T08:58:52.858 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.856+0000 7f0456b95b80 1 -- start start 2023-09-23T08:58:52.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.856+0000 7f0456b95b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563a4d57bc40 0x563a4d57b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:58:52.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.856+0000 7f0456b95b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563a4d581500 0x563a4d591090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:58:52.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.856+0000 7f0456b95b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a4d581e20 0x563a4d57f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:58:52.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.856+0000 7f0456b95b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a4d34f920 con 0x563a4d581e20 2023-09-23T08:58:52.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.856+0000 7f0456b95b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a4d57c990 con 0x563a4d57bc40 2023-09-23T08:58:52.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.856+0000 7f0456b95b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a4d56e640 con 0x563a4d581500 2023-09-23T08:58:52.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.857+0000 7f044179c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563a4d57bc40 0x563a4d57b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:58:52.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.857+0000 7f043bfff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563a4d581500 0x563a4d591090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:58:52.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.857+0000 7f043bfff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563a4d581500 0x563a4d591090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:51632/0 (socket says 172.21.15.82:51632) 2023-09-23T08:58:52.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.857+0000 7f043bfff700 1 -- 172.21.15.82:0/3541667942 learned_addr learned my addr 172.21.15.82:0/3541667942 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:58:52.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.857+0000 7f044179c700 1 --2- 172.21.15.82:0/3541667942 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a4d581e20 0x563a4d57f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:58:52.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.857+0000 7f043bfff700 1 -- 172.21.15.82:0/3541667942 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563a4d57bc40 msgr2=0x563a4d57b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:58:52.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.857+0000 7f043bfff700 1 --2- 172.21.15.82:0/3541667942 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563a4d57bc40 0x563a4d57b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:58:52.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.857+0000 7f043bfff700 1 -- 172.21.15.82:0/3541667942 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a4d581e20 msgr2=0x563a4d57f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:58:52.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.857+0000 7f043bfff700 1 --2- 172.21.15.82:0/3541667942 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a4d581e20 0x563a4d57f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:58:52.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.857+0000 7f043bfff700 1 -- 172.21.15.82:0/3541667942 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563a4d59c990 con 0x563a4d581500 2023-09-23T08:58:52.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.857+0000 7f044179c700 1 --2- 172.21.15.82:0/3541667942 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a4d581e20 0x563a4d57f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T08:58:52.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.857+0000 7f043bfff700 1 --2- 172.21.15.82:0/3541667942 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563a4d581500 0x563a4d591090 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f042801ca40 tx=0x7f0428009750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e915f4929c836b12 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:58:52.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.858+0000 7f04277fe700 1 -- 172.21.15.82:0/3541667942 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f042802a070 con 0x563a4d581500 2023-09-23T08:58:52.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.858+0000 7f04277fe700 1 -- 172.21.15.82:0/3541667942 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f042801cd30 con 0x563a4d581500 2023-09-23T08:58:52.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.858+0000 7f04277fe700 1 -- 172.21.15.82:0/3541667942 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0428017040 con 0x563a4d581500 2023-09-23T08:58:52.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.858+0000 7f0456b95b80 1 -- 172.21.15.82:0/3541667942 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563a4d581500 msgr2=0x563a4d591090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:58:52.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.858+0000 7f0456b95b80 1 --2- 172.21.15.82:0/3541667942 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563a4d581500 0x563a4d591090 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f042801ca40 tx=0x7f0428009750 comp rx=0 tx=0).stop 2023-09-23T08:58:52.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.858+0000 7f0456b95b80 1 -- 172.21.15.82:0/3541667942 shutdown_connections 2023-09-23T08:58:52.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.858+0000 7f0456b95b80 1 --2- 172.21.15.82:0/3541667942 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a4d581e20 0x563a4d57f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:58:52.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.858+0000 7f0456b95b80 1 --2- 172.21.15.82:0/3541667942 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563a4d57bc40 0x563a4d57b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:58:52.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.858+0000 7f0456b95b80 1 --2- 172.21.15.82:0/3541667942 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563a4d581500 0x563a4d591090 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:58:52.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.858+0000 7f0456b95b80 1 -- 172.21.15.82:0/3541667942 >> 172.21.15.82:0/3541667942 conn(0x563a4d4f00e0 msgr2=0x563a4d597950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:58:52.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.859+0000 7f0456b95b80 1 -- 172.21.15.82:0/3541667942 shutdown_connections 2023-09-23T08:58:52.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.859+0000 7f0456b95b80 1 -- 172.21.15.82:0/3541667942 wait complete. 2023-09-23T08:58:52.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.859+0000 7f0456b95b80 1 -- start start 2023-09-23T08:58:52.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.859+0000 7f0456b95b80 1 Processor -- start 2023-09-23T08:58:52.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.860+0000 7f0456b95b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a4d57bc40 0x563a4d584720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:58:52.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.860+0000 7f0456b95b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563a4d581500 0x563a4d584c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:58:52.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.860+0000 7f0456b95b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563a4d581e20 0x563a4d5835c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:58:52.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.860+0000 7f0456b95b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a4d5852b0 con 0x563a4d57bc40 2023-09-23T08:58:52.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.860+0000 7f0456b95b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a4d585420 con 0x563a4d581e20 2023-09-23T08:58:52.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.860+0000 7f0456b95b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a4d583b80 con 0x563a4d581500 2023-09-23T08:58:52.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.860+0000 7f0456b95b80 10 client.0 _ll_register_callbacks cb 0x7f0428009e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T08:58:52.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.860+0000 7f044179c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a4d57bc40 0x563a4d584720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:58:52.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.860+0000 7f043bfff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563a4d581500 0x563a4d584c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:58:52.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.860+0000 7f044179c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a4d57bc40 0x563a4d584720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53620/0 (socket says 172.21.15.82:53620) 2023-09-23T08:58:52.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.860+0000 7f044179c700 1 -- 172.21.15.82:0/2958991260 learned_addr learned my addr 172.21.15.82:0/2958991260 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:58:52.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.860+0000 7f044179c700 1 --2- 172.21.15.82:0/2958991260 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563a4d581e20 0x563a4d5835c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:58:52.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.860+0000 7f043bfff700 1 -- 172.21.15.82:0/2958991260 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563a4d581e20 msgr2=0x563a4d5835c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:58:52.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.860+0000 7f043bfff700 1 --2- 172.21.15.82:0/2958991260 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563a4d581e20 0x563a4d5835c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:58:52.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.860+0000 7f043bfff700 1 -- 172.21.15.82:0/2958991260 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a4d57bc40 msgr2=0x563a4d584720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:58:52.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.860+0000 7f043bfff700 1 --2- 172.21.15.82:0/2958991260 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a4d57bc40 0x563a4d584720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:58:52.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.860+0000 7f043bfff700 1 -- 172.21.15.82:0/2958991260 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563a4d34d630 con 0x563a4d581500 2023-09-23T08:58:52.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.860+0000 7f044179c700 1 --2- 172.21.15.82:0/2958991260 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a4d57bc40 0x563a4d584720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T08:58:52.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.861+0000 7f043bfff700 1 --2- 172.21.15.82:0/2958991260 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563a4d581500 0x563a4d584c60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x563a4d588460 tx=0x7f0428004740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a6aa07102ec5f2c5 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:58:52.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.861+0000 7f041bfff700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T08:58:52.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.861+0000 7f041bfff700 1 -- 172.21.15.82:0/2958991260 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f042802a040 con 0x563a4d581500 2023-09-23T08:58:52.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.861+0000 7f0456b95b80 1 -- 172.21.15.82:0/2958991260 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563a4d56e8b0 con 0x563a4d581500 2023-09-23T08:58:52.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.861+0000 7f041bfff700 1 -- 172.21.15.82:0/2958991260 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f0428000e40 con 0x563a4d581500 2023-09-23T08:58:52.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.861+0000 7f041bfff700 1 -- 172.21.15.82:0/2958991260 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0428017040 con 0x563a4d581500 2023-09-23T08:58:52.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.861+0000 7f0456b95b80 10 client.25693 fetch_fsmap learned FSMap version 30 2023-09-23T08:58:52.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.861+0000 7f0456b95b80 1 -- 172.21.15.82:0/2958991260 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x563a4d2f9de0 con 0x563a4d581500 2023-09-23T08:58:52.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.862+0000 7f041bfff700 1 -- 172.21.15.82:0/2958991260 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f042803c020 con 0x563a4d581500 2023-09-23T08:58:52.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.862+0000 7f041bfff700 1 -- 172.21.15.82:0/2958991260 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 30) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f0428005690 con 0x563a4d581500 2023-09-23T08:58:52.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.862+0000 7f0456b95b80 10 client.25693 fetch_fsmap finished waiting for FSMap version 30 2023-09-23T08:58:52.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.862+0000 7f0456b95b80 10 client.25693 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T08:58:52.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.862+0000 7f0456b95b80 20 client.25693 populate_metadata read hostname 'smithi082' 2023-09-23T08:58:52.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.862+0000 7f0456b95b80 1 --2- 172.21.15.82:0/2958991260 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x563a4d5ea040 0x563a4d5ec460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:58:52.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.862+0000 7f0456b95b80 4 client.25693 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T08:58:52.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.862+0000 7f0456b95b80 1 -- 172.21.15.82:0/2958991260 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x563a4d4c6970 con 0x563a4d5ea040 2023-09-23T08:58:52.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.862+0000 7f044179c700 1 --2- 172.21.15.82:0/2958991260 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x563a4d5ea040 0x563a4d5ec460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:58:52.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.863+0000 7f041bfff700 10 client.25693 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T08:58:52.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.863+0000 7f044179c700 1 --2- 172.21.15.82:0/2958991260 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x563a4d5ea040 0x563a4d5ec460 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46acddf6e38e5a4 server_cookie=4b9af906283b61f in_seq=0 out_seq=0 2023-09-23T08:58:52.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.863+0000 7f041bfff700 1 -- 172.21.15.82:0/2958991260 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x563a4d4c6970 con 0x563a4d5ea040 2023-09-23T08:58:52.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.863+0000 7f041bfff700 10 client.25693 handle_command_reply: tid=0 2023-09-23T08:58:52.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.863+0000 7f0456b95b80 1 client.25693 shutdown 2023-09-23T08:58:52.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.863+0000 7f0456b95b80 1 -- 172.21.15.82:0/2958991260 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563a4d581500 msgr2=0x563a4d584c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:58:52.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.863+0000 7f0456b95b80 1 --2- 172.21.15.82:0/2958991260 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563a4d581500 0x563a4d584c60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x563a4d588460 tx=0x7f0428004740 comp rx=0 tx=0).stop 2023-09-23T08:58:52.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.863+0000 7f0456b95b80 1 -- 172.21.15.82:0/2958991260 shutdown_connections 2023-09-23T08:58:52.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.863+0000 7f0456b95b80 1 --2- 172.21.15.82:0/2958991260 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563a4d581e20 0x563a4d5835c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:58:52.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.863+0000 7f0456b95b80 1 --2- 172.21.15.82:0/2958991260 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x563a4d5ea040 0x563a4d5ec460 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:58:52.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.863+0000 7f0456b95b80 1 --2- 172.21.15.82:0/2958991260 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a4d57bc40 0x563a4d584720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:58:52.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.863+0000 7f0456b95b80 1 --2- 172.21.15.82:0/2958991260 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563a4d581500 0x563a4d584c60 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:58:52.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.863+0000 7f041bfff700 0 client.25693 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T08:58:52.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.863+0000 7f0456b95b80 1 -- 172.21.15.82:0/2958991260 >> 172.21.15.82:0/2958991260 conn(0x563a4d4f00e0 msgr2=0x563a4d5879f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:58:52.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.864+0000 7f0456b95b80 1 -- 172.21.15.82:0/2958991260 shutdown_connections 2023-09-23T08:58:52.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.864+0000 7f0456b95b80 1 -- 172.21.15.82:0/2958991260 wait complete. 2023-09-23T08:58:52.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.864+0000 7f0456b95b80 20 client.25693 trim_cache size 0 max 16384 2023-09-23T08:58:52.871 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T08:58:52.871 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-23T08:58:52.871 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T08:58:52.871 INFO:teuthology.orchestra.run.smithi082.stdout: "6f0fe3a6-7212-425d-a0a6-f38e8b42ec13": { 2023-09-23T08:58:52.871 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T08:58:52.872 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "6f0fe3a6-7212-425d-a0a6-f38e8b42ec13", 2023-09-23T08:58:52.872 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T08:58:52.872 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T08:58:52.872 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T08:58:52.872 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T08:58:52.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.864+0000 7f0441f9d700 1 -- 172.21.15.82:0/155381497 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f042c0a0160 msgr2=0x7f042c0a2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:58:52.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.864+0000 7f0441f9d700 1 --2- 172.21.15.82:0/155381497 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f042c0a0160 0x7f042c0a2620 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0430005b40 tx=0x7f043009f040 comp rx=0 tx=0).stop 2023-09-23T08:58:52.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.864+0000 7f0441f9d700 1 -- 172.21.15.82:0/155381497 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f043c100710 msgr2=0x7f043c19e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:58:52.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.864+0000 7f0441f9d700 1 --2- 172.21.15.82:0/155381497 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f043c100710 0x7f043c19e620 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f0430005910 tx=0x7f04300047b0 comp rx=0 tx=0).stop 2023-09-23T08:58:52.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.864+0000 7f0441f9d700 1 -- 172.21.15.82:0/155381497 shutdown_connections 2023-09-23T08:58:52.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.864+0000 7f0441f9d700 1 --2- 172.21.15.82:0/155381497 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f042c0a0160 0x7f042c0a2620 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:58:52.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.864+0000 7f0441f9d700 1 --2- 172.21.15.82:0/155381497 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f043c106720 0x7f043c198690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:58:52.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.864+0000 7f0441f9d700 1 --2- 172.21.15.82:0/155381497 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f043c100710 0x7f043c19e620 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:58:52.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.864+0000 7f0441f9d700 1 --2- 172.21.15.82:0/155381497 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f043c1010d0 0x7f043c19eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:58:52.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.864+0000 7f0441f9d700 1 -- 172.21.15.82:0/155381497 >> 172.21.15.82:0/155381497 conn(0x7f043c0fc1e0 msgr2=0x7f043c0fc880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:58:52.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.865+0000 7f0441f9d700 1 -- 172.21.15.82:0/155381497 shutdown_connections 2023-09-23T08:58:52.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:58:52.865+0000 7f0441f9d700 1 -- 172.21.15.82:0/155381497 wait complete. 2023-09-23T08:58:52.874 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:58:52 smithi082 ceph-mon[97694]: pgmap v62: 97 pgs: 97 active+clean; 1.3 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 MiB/s wr, 26 op/s 2023-09-23T08:58:52.885 INFO:tasks.cephfs.filesystem:scrub status for tag:6f0fe3a6-7212-425d-a0a6-f38e8b42ec13 - {'path': '/', 'tag': '6f0fe3a6-7212-425d-a0a6-f38e8b42ec13', 'options': 'recursive,force'} 2023-09-23T08:58:52.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:58:52 smithi161 ceph-mon[99580]: pgmap v62: 97 pgs: 97 active+clean; 1.3 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 MiB/s wr, 26 op/s 2023-09-23T08:58:54.433 INFO:teuthology.orchestra.run.smithi082.stderr:5800000 of 50000000 tuples (11%) done (elapsed 89.18 s, remaining 679.58 s) 2023-09-23T08:58:54.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:58:54 smithi135 ceph-mon[99205]: pgmap v63: 97 pgs: 97 active+clean; 1.3 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 MiB/s wr, 26 op/s 2023-09-23T08:58:54.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:58:54 smithi082 ceph-mon[97694]: pgmap v63: 97 pgs: 97 active+clean; 1.3 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 MiB/s wr, 26 op/s 2023-09-23T08:58:54.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:58:54 smithi161 ceph-mon[99580]: pgmap v63: 97 pgs: 97 active+clean; 1.3 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 MiB/s wr, 26 op/s 2023-09-23T08:58:55.684 INFO:teuthology.orchestra.run.smithi082.stderr:5900000 of 50000000 tuples (11%) done (elapsed 90.43 s, remaining 675.90 s) 2023-09-23T08:58:56.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:58:56 smithi135 ceph-mon[99205]: pgmap v64: 97 pgs: 97 active+clean; 1.4 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 37 MiB/s wr, 39 op/s 2023-09-23T08:58:56.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:58:56 smithi082 ceph-mon[97694]: pgmap v64: 97 pgs: 97 active+clean; 1.4 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 37 MiB/s wr, 39 op/s 2023-09-23T08:58:56.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:58:56 smithi161 ceph-mon[99580]: pgmap v64: 97 pgs: 97 active+clean; 1.4 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 37 MiB/s wr, 39 op/s 2023-09-23T08:58:57.295 INFO:teuthology.orchestra.run.smithi082.stderr:6000000 of 50000000 tuples (12%) done (elapsed 92.04 s, remaining 674.94 s) 2023-09-23T08:58:58.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:58:58 smithi135 ceph-mon[99205]: pgmap v65: 97 pgs: 97 active+clean; 1.4 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 26 MiB/s wr, 27 op/s 2023-09-23T08:58:58.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:58:58 smithi082 ceph-mon[97694]: pgmap v65: 97 pgs: 97 active+clean; 1.4 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 26 MiB/s wr, 27 op/s 2023-09-23T08:58:58.939 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:58:58 smithi161 ceph-mon[99580]: pgmap v65: 97 pgs: 97 active+clean; 1.4 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 26 MiB/s wr, 27 op/s 2023-09-23T08:58:59.003 INFO:teuthology.orchestra.run.smithi082.stderr:6100000 of 50000000 tuples (12%) done (elapsed 93.75 s, remaining 674.66 s) 2023-09-23T08:59:00.131 INFO:teuthology.orchestra.run.smithi082.stderr:6200000 of 50000000 tuples (12%) done (elapsed 94.87 s, remaining 670.24 s) 2023-09-23T08:59:00.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:59:00 smithi135 ceph-mon[99205]: pgmap v66: 97 pgs: 97 active+clean; 1.5 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 38 MiB/s wr, 41 op/s 2023-09-23T08:59:00.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:59:00 smithi082 ceph-mon[97694]: pgmap v66: 97 pgs: 97 active+clean; 1.5 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 38 MiB/s wr, 41 op/s 2023-09-23T08:59:00.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:59:00 smithi161 ceph-mon[99580]: pgmap v66: 97 pgs: 97 active+clean; 1.5 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 38 MiB/s wr, 41 op/s 2023-09-23T08:59:01.853 INFO:teuthology.orchestra.run.smithi082.stderr:6300000 of 50000000 tuples (12%) done (elapsed 96.60 s, remaining 670.03 s) 2023-09-23T08:59:02.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:59:02 smithi135 ceph-mon[99205]: pgmap v67: 97 pgs: 97 active+clean; 1.5 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 MiB/s wr, 27 op/s 2023-09-23T08:59:02.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:59:02 smithi082 ceph-mon[97694]: pgmap v67: 97 pgs: 97 active+clean; 1.5 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 MiB/s wr, 27 op/s 2023-09-23T08:59:02.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:59:02 smithi161 ceph-mon[99580]: pgmap v67: 97 pgs: 97 active+clean; 1.5 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 MiB/s wr, 27 op/s 2023-09-23T08:59:03.588 INFO:teuthology.orchestra.run.smithi082.stderr:6400000 of 50000000 tuples (12%) done (elapsed 98.33 s, remaining 669.87 s) 2023-09-23T08:59:04.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:59:04 smithi135 ceph-mon[99205]: pgmap v68: 97 pgs: 97 active+clean; 1.5 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 MiB/s wr, 27 op/s 2023-09-23T08:59:04.839 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:59:04 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:59:04.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:59:04 smithi082 ceph-mon[97694]: pgmap v68: 97 pgs: 97 active+clean; 1.5 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 MiB/s wr, 27 op/s 2023-09-23T08:59:05.158 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:59:04 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:59:05.159 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:59:04 smithi161 ceph-mon[99580]: pgmap v68: 97 pgs: 97 active+clean; 1.5 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 MiB/s wr, 27 op/s 2023-09-23T08:59:05.159 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:59:04 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T08:59:05.159 INFO:teuthology.orchestra.run.smithi082.stderr:6500000 of 50000000 tuples (13%) done (elapsed 99.63 s, remaining 666.77 s) 2023-09-23T08:59:05.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:59:05 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:59:05.816 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:59:05 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:59:05.816 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:59:05 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T08:59:05.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:59:05 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:59:05.874 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:59:05 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:59:05.874 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:59:05 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T08:59:05.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:59:05 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T08:59:05.982 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:59:05 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T08:59:05.982 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:59:05 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T08:59:06.550 INFO:teuthology.orchestra.run.smithi082.stderr:6600000 of 50000000 tuples (13%) done (elapsed 101.29 s, remaining 666.07 s) 2023-09-23T08:59:06.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:59:06 smithi135 ceph-mon[99205]: pgmap v69: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 38 MiB/s wr, 54 op/s 2023-09-23T08:59:06.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:59:06 smithi082 ceph-mon[97694]: pgmap v69: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 38 MiB/s wr, 54 op/s 2023-09-23T08:59:06.941 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:59:06 smithi161 ceph-mon[99580]: pgmap v69: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 38 MiB/s wr, 54 op/s 2023-09-23T08:59:08.277 INFO:teuthology.orchestra.run.smithi082.stderr:6700000 of 50000000 tuples (13%) done (elapsed 103.02 s, remaining 665.78 s) 2023-09-23T08:59:08.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:59:08 smithi135 ceph-mon[99205]: pgmap v70: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 25 MiB/s wr, 40 op/s 2023-09-23T08:59:08.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:59:08 smithi082 ceph-mon[97694]: pgmap v70: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 25 MiB/s wr, 40 op/s 2023-09-23T08:59:08.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:59:08 smithi161 ceph-mon[99580]: pgmap v70: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 25 MiB/s wr, 40 op/s 2023-09-23T08:59:09.761 INFO:teuthology.orchestra.run.smithi082.stderr:6800000 of 50000000 tuples (13%) done (elapsed 104.50 s, remaining 663.90 s) 2023-09-23T08:59:10.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:59:10 smithi135 ceph-mon[99205]: pgmap v71: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 37 MiB/s wr, 53 op/s 2023-09-23T08:59:10.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:59:10 smithi082 ceph-mon[97694]: pgmap v71: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 37 MiB/s wr, 53 op/s 2023-09-23T08:59:10.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:59:10 smithi161 ceph-mon[99580]: pgmap v71: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 37 MiB/s wr, 53 op/s 2023-09-23T08:59:11.374 INFO:teuthology.orchestra.run.smithi082.stderr:6900000 of 50000000 tuples (13%) done (elapsed 106.12 s, remaining 662.84 s) 2023-09-23T08:59:12.594 INFO:teuthology.orchestra.run.smithi082.stderr:7000000 of 50000000 tuples (14%) done (elapsed 107.34 s, remaining 659.35 s) 2023-09-23T08:59:12.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:59:12 smithi135 ceph-mon[99205]: pgmap v72: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 24 MiB/s wr, 38 op/s 2023-09-23T08:59:12.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:59:12 smithi082 ceph-mon[97694]: pgmap v72: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 24 MiB/s wr, 38 op/s 2023-09-23T08:59:12.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:59:12 smithi161 ceph-mon[99580]: pgmap v72: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 24 MiB/s wr, 38 op/s 2023-09-23T08:59:14.321 INFO:teuthology.orchestra.run.smithi082.stderr:7100000 of 50000000 tuples (14%) done (elapsed 109.06 s, remaining 658.99 s) 2023-09-23T08:59:14.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:59:14 smithi135 ceph-mon[99205]: pgmap v73: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 24 MiB/s wr, 38 op/s 2023-09-23T08:59:14.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:59:14 smithi082 ceph-mon[97694]: pgmap v73: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 24 MiB/s wr, 38 op/s 2023-09-23T08:59:14.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:59:14 smithi161 ceph-mon[99580]: pgmap v73: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 24 MiB/s wr, 38 op/s 2023-09-23T08:59:16.039 INFO:teuthology.orchestra.run.smithi082.stderr:7200000 of 50000000 tuples (14%) done (elapsed 110.78 s, remaining 658.53 s) 2023-09-23T08:59:16.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:59:16 smithi135 ceph-mon[99205]: pgmap v74: 97 pgs: 97 active+clean; 1.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 37 MiB/s wr, 51 op/s 2023-09-23T08:59:16.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:59:16 smithi082 ceph-mon[97694]: pgmap v74: 97 pgs: 97 active+clean; 1.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 37 MiB/s wr, 51 op/s 2023-09-23T08:59:16.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:59:16 smithi161 ceph-mon[99580]: pgmap v74: 97 pgs: 97 active+clean; 1.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 37 MiB/s wr, 51 op/s 2023-09-23T08:59:17.267 INFO:teuthology.orchestra.run.smithi082.stderr:7300000 of 50000000 tuples (14%) done (elapsed 112.01 s, remaining 655.18 s) 2023-09-23T08:59:18.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:59:18 smithi135 ceph-mon[99205]: pgmap v75: 97 pgs: 97 active+clean; 1.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 24 MiB/s wr, 24 op/s 2023-09-23T08:59:18.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:59:18 smithi082 ceph-mon[97694]: pgmap v75: 97 pgs: 97 active+clean; 1.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 24 MiB/s wr, 24 op/s 2023-09-23T08:59:18.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:59:18 smithi161 ceph-mon[99580]: pgmap v75: 97 pgs: 97 active+clean; 1.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 24 MiB/s wr, 24 op/s 2023-09-23T08:59:18.970 INFO:teuthology.orchestra.run.smithi082.stderr:7400000 of 50000000 tuples (14%) done (elapsed 113.71 s, remaining 654.61 s) 2023-09-23T08:59:20.656 INFO:teuthology.orchestra.run.smithi082.stderr:7500000 of 50000000 tuples (15%) done (elapsed 115.40 s, remaining 653.92 s) 2023-09-23T08:59:20.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:59:20 smithi135 ceph-mon[99205]: pgmap v76: 97 pgs: 97 active+clean; 1.8 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 37 MiB/s wr, 36 op/s 2023-09-23T08:59:20.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:59:20 smithi082 ceph-mon[97694]: pgmap v76: 97 pgs: 97 active+clean; 1.8 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 37 MiB/s wr, 36 op/s 2023-09-23T08:59:20.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:59:20 smithi161 ceph-mon[99580]: pgmap v76: 97 pgs: 97 active+clean; 1.8 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 37 MiB/s wr, 36 op/s 2023-09-23T08:59:21.767 INFO:teuthology.orchestra.run.smithi082.stderr:7600000 of 50000000 tuples (15%) done (elapsed 116.51 s, remaining 650.00 s) 2023-09-23T08:59:22.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:59:22 smithi135 ceph-mon[99205]: pgmap v77: 97 pgs: 97 active+clean; 1.8 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 25 MiB/s wr, 24 op/s 2023-09-23T08:59:22.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:59:22 smithi082 ceph-mon[97694]: pgmap v77: 97 pgs: 97 active+clean; 1.8 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 25 MiB/s wr, 24 op/s 2023-09-23T08:59:22.886 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T08:59:22.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:59:22 smithi161 ceph-mon[99580]: pgmap v77: 97 pgs: 97 active+clean; 1.8 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 25 MiB/s wr, 24 op/s 2023-09-23T08:59:23.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.106+0000 7f4b0e1ff700 1 -- 172.21.15.82:0/3479926469 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b08102390 msgr2=0x7f4b0810a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:59:23.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.106+0000 7f4b0e1ff700 1 --2- 172.21.15.82:0/3479926469 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b08102390 0x7f4b0810a870 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f4afc009990 tx=0x7f4afc009ca0 comp rx=0 tx=0).stop 2023-09-23T08:59:23.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.107+0000 7f4b0e1ff700 1 -- 172.21.15.82:0/3479926469 shutdown_connections 2023-09-23T08:59:23.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.107+0000 7f4b0e1ff700 1 --2- 172.21.15.82:0/3479926469 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4b0810ae90 0x7f4b0810d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:59:23.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.107+0000 7f4b0e1ff700 1 --2- 172.21.15.82:0/3479926469 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b08101a70 0x7f4b08101e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:59:23.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.107+0000 7f4b0e1ff700 1 --2- 172.21.15.82:0/3479926469 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b08102390 0x7f4b0810a870 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:59:23.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.107+0000 7f4b0e1ff700 1 -- 172.21.15.82:0/3479926469 >> 172.21.15.82:0/3479926469 conn(0x7f4b080fb2b0 msgr2=0x7f4b080fd6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:59:23.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.107+0000 7f4b0e1ff700 1 -- 172.21.15.82:0/3479926469 shutdown_connections 2023-09-23T08:59:23.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.107+0000 7f4b0e1ff700 1 -- 172.21.15.82:0/3479926469 wait complete. 2023-09-23T08:59:23.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.108+0000 7f4b0e1ff700 1 Processor -- start 2023-09-23T08:59:23.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.108+0000 7f4b0e1ff700 1 -- start start 2023-09-23T08:59:23.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.108+0000 7f4b0e1ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b08101a70 0x7f4b0819e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:59:23.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.108+0000 7f4b0e1ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4b08102390 0x7f4b0819eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:59:23.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.108+0000 7f4b0e1ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b0810ae90 0x7f4b08198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:59:23.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.108+0000 7f4b0e1ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b08199080 con 0x7f4b08101a70 2023-09-23T08:59:23.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.108+0000 7f4b0e1ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b081991f0 con 0x7f4b0810ae90 2023-09-23T08:59:23.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.108+0000 7f4b0e1ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b081993b0 con 0x7f4b08102390 2023-09-23T08:59:23.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.109+0000 7f4b077fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b08101a70 0x7f4b0819e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:59:23.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.109+0000 7f4b06ffd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4b08102390 0x7f4b0819eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:59:23.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.109+0000 7f4b077fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b08101a70 0x7f4b0819e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39330/0 (socket says 172.21.15.82:39330) 2023-09-23T08:59:23.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.109+0000 7f4b077fe700 1 -- 172.21.15.82:0/3295382490 learned_addr learned my addr 172.21.15.82:0/3295382490 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:59:23.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.109+0000 7f4b07fff700 1 --2- 172.21.15.82:0/3295382490 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b0810ae90 0x7f4b08198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:59:23.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.109+0000 7f4b06ffd700 1 -- 172.21.15.82:0/3295382490 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b0810ae90 msgr2=0x7f4b08198a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:59:23.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.109+0000 7f4b06ffd700 1 --2- 172.21.15.82:0/3295382490 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b0810ae90 0x7f4b08198a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:59:23.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.109+0000 7f4b06ffd700 1 -- 172.21.15.82:0/3295382490 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b08101a70 msgr2=0x7f4b0819e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:59:23.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.109+0000 7f4b06ffd700 1 --2- 172.21.15.82:0/3295382490 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b08101a70 0x7f4b0819e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:59:23.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.109+0000 7f4b06ffd700 1 -- 172.21.15.82:0/3295382490 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4afc0095f0 con 0x7f4b08102390 2023-09-23T08:59:23.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.109+0000 7f4b06ffd700 1 --2- 172.21.15.82:0/3295382490 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4b08102390 0x7f4b0819eee0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4afc005910 tx=0x7f4afc005740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:59:23.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.110+0000 7f4b04ff9700 1 -- 172.21.15.82:0/3295382490 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4afc01d070 con 0x7f4b08102390 2023-09-23T08:59:23.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.110+0000 7f4b04ff9700 1 -- 172.21.15.82:0/3295382490 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4afc00bec0 con 0x7f4b08102390 2023-09-23T08:59:23.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.110+0000 7f4b0e1ff700 1 -- 172.21.15.82:0/3295382490 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b08199630 con 0x7f4b08102390 2023-09-23T08:59:23.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.110+0000 7f4b04ff9700 1 -- 172.21.15.82:0/3295382490 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4afc022d30 con 0x7f4b08102390 2023-09-23T08:59:23.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.110+0000 7f4b0e1ff700 1 -- 172.21.15.82:0/3295382490 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b081a5990 con 0x7f4b08102390 2023-09-23T08:59:23.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.113+0000 7f4b04ff9700 1 -- 172.21.15.82:0/3295382490 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f4afc022500 con 0x7f4b08102390 2023-09-23T08:59:23.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.115+0000 7f4b21bbbb80 1 Processor -- start 2023-09-23T08:59:23.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.115+0000 7f4b04ff9700 1 --2- 172.21.15.82:0/3295382490 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f4af00a00c0 0x7f4af00a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:59:23.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.115+0000 7f4b21bbbb80 1 -- start start 2023-09-23T08:59:23.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.115+0000 7f4b04ff9700 1 -- 172.21.15.82:0/3295382490 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f4afc0ccad0 con 0x7f4b08102390 2023-09-23T08:59:23.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.116+0000 7f4b21bbbb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55594a15c380 0x55594a15c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:59:23.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.116+0000 7f4b21bbbb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55594a15cca0 0x55594a156700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:59:23.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.116+0000 7f4b07fff700 1 --2- 172.21.15.82:0/3295382490 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f4af00a00c0 0x7f4af00a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:59:23.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.116+0000 7f4b21bbbb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55594a156c40 0x55594a1570a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:59:23.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.116+0000 7f4b21bbbb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55594a0be7b0 con 0x55594a15c380 2023-09-23T08:59:23.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.116+0000 7f4b21bbbb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55594a0af780 con 0x55594a156c40 2023-09-23T08:59:23.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.116+0000 7f4b21bbbb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55594a0ad0a0 con 0x55594a15cca0 2023-09-23T08:59:23.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.116+0000 7f4b077fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55594a15c380 0x55594a15c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:59:23.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.116+0000 7f4b07fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55594a156c40 0x55594a1570a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:59:23.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.116+0000 7f4b077fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55594a15c380 0x55594a15c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39336/0 (socket says 172.21.15.82:39336) 2023-09-23T08:59:23.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.116+0000 7f4b07fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55594a156c40 0x55594a1570a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:34072/0 (socket says 172.21.15.82:34072) 2023-09-23T08:59:23.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.116+0000 7f4b077fe700 1 -- 172.21.15.82:0/892873043 learned_addr learned my addr 172.21.15.82:0/892873043 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:59:23.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.116+0000 7f4b06ffd700 1 --2- 172.21.15.82:0/892873043 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55594a15cca0 0x55594a156700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:59:23.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.117+0000 7f4b077fe700 1 -- 172.21.15.82:0/892873043 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55594a15cca0 msgr2=0x55594a156700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:59:23.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.117+0000 7f4b077fe700 1 --2- 172.21.15.82:0/892873043 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55594a15cca0 0x55594a156700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:59:23.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.117+0000 7f4b077fe700 1 -- 172.21.15.82:0/892873043 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55594a156c40 msgr2=0x55594a1570a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:59:23.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.117+0000 7f4b077fe700 1 --2- 172.21.15.82:0/892873043 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55594a156c40 0x55594a1570a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:59:23.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.117+0000 7f4b077fe700 1 -- 172.21.15.82:0/892873043 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555949f28630 con 0x55594a15c380 2023-09-23T08:59:23.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.117+0000 7f4b07fff700 1 --2- 172.21.15.82:0/3295382490 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f4af00a00c0 0x7f4af00a2580 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4b0819f6a0 tx=0x7f4b0000fc00 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:59:23.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.117+0000 7f4b077fe700 1 --2- 172.21.15.82:0/892873043 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55594a15c380 0x55594a15c760 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f4af8009e50 tx=0x7f4af8011720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d019c9e959cb04f server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:59:23.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.117+0000 7f4aedffb700 1 -- 172.21.15.82:0/892873043 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af8004a30 con 0x55594a15c380 2023-09-23T08:59:23.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.117+0000 7f4aedffb700 1 -- 172.21.15.82:0/892873043 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4af80054b0 con 0x55594a15c380 2023-09-23T08:59:23.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.117+0000 7f4aedffb700 1 -- 172.21.15.82:0/892873043 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af80197d0 con 0x55594a15c380 2023-09-23T08:59:23.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.118+0000 7f4b21bbbb80 1 -- 172.21.15.82:0/892873043 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55594a15c380 msgr2=0x55594a15c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:59:23.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.118+0000 7f4b21bbbb80 1 --2- 172.21.15.82:0/892873043 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55594a15c380 0x55594a15c760 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f4af8009e50 tx=0x7f4af8011720 comp rx=0 tx=0).stop 2023-09-23T08:59:23.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.118+0000 7f4b21bbbb80 1 -- 172.21.15.82:0/892873043 shutdown_connections 2023-09-23T08:59:23.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.118+0000 7f4b21bbbb80 1 --2- 172.21.15.82:0/892873043 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55594a156c40 0x55594a1570a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:59:23.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.118+0000 7f4b21bbbb80 1 --2- 172.21.15.82:0/892873043 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55594a15c380 0x55594a15c760 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:59:23.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.118+0000 7f4b21bbbb80 1 --2- 172.21.15.82:0/892873043 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55594a15cca0 0x55594a156700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:59:23.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.118+0000 7f4b21bbbb80 1 -- 172.21.15.82:0/892873043 >> 172.21.15.82:0/892873043 conn(0x55594a0cb0e0 msgr2=0x55594a151410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:59:23.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.118+0000 7f4b21bbbb80 1 -- 172.21.15.82:0/892873043 shutdown_connections 2023-09-23T08:59:23.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.119+0000 7f4b21bbbb80 1 -- 172.21.15.82:0/892873043 wait complete. 2023-09-23T08:59:23.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.119+0000 7f4b21bbbb80 1 -- start start 2023-09-23T08:59:23.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.119+0000 7f4b21bbbb80 1 Processor -- start 2023-09-23T08:59:23.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.120+0000 7f4b21bbbb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55594a156c40 0x55594a162c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:59:23.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.120+0000 7f4b21bbbb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55594a15c380 0x55594a15fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:59:23.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.120+0000 7f4b21bbbb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55594a15cca0 0x55594a160610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:59:23.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.120+0000 7f4b21bbbb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55594a0a8990 con 0x55594a15c380 2023-09-23T08:59:23.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.120+0000 7f4b21bbbb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55594a046bb0 con 0x55594a156c40 2023-09-23T08:59:23.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.120+0000 7f4b21bbbb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55594a0468b0 con 0x55594a15cca0 2023-09-23T08:59:23.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.120+0000 7f4b21bbbb80 10 client.0 _ll_register_callbacks cb 0x555949f90a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T08:59:23.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.120+0000 7f4b06ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55594a15c380 0x55594a15fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:59:23.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.120+0000 7f4b06ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55594a15c380 0x55594a15fed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39346/0 (socket says 172.21.15.82:39346) 2023-09-23T08:59:23.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.120+0000 7f4b06ffd700 1 -- 172.21.15.82:0/2099317182 learned_addr learned my addr 172.21.15.82:0/2099317182 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:59:23.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.120+0000 7f4b077fe700 1 --2- 172.21.15.82:0/2099317182 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55594a156c40 0x55594a162c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:59:23.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.120+0000 7f4b07fff700 1 --2- 172.21.15.82:0/2099317182 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55594a15cca0 0x55594a160610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:59:23.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.121+0000 7f4b077fe700 1 -- 172.21.15.82:0/2099317182 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55594a15cca0 msgr2=0x55594a160610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:59:23.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.121+0000 7f4b077fe700 1 --2- 172.21.15.82:0/2099317182 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55594a15cca0 0x55594a160610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:59:23.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.121+0000 7f4b077fe700 1 -- 172.21.15.82:0/2099317182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55594a15c380 msgr2=0x55594a15fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:59:23.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.121+0000 7f4b077fe700 1 --2- 172.21.15.82:0/2099317182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55594a15c380 0x55594a15fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:59:23.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.121+0000 7f4b077fe700 1 -- 172.21.15.82:0/2099317182 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4af8009a80 con 0x55594a156c40 2023-09-23T08:59:23.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.121+0000 7f4b06ffd700 1 --2- 172.21.15.82:0/2099317182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55594a15c380 0x55594a15fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T08:59:23.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.121+0000 7f4b07fff700 1 --2- 172.21.15.82:0/2099317182 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55594a15cca0 0x55594a160610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T08:59:23.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.121+0000 7f4b077fe700 1 --2- 172.21.15.82:0/2099317182 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55594a156c40 0x55594a162c50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4af801b040 tx=0x7f4af8004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7af2c1ebc3699894 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:59:23.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.121+0000 7f4ae6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-09-23T08:59:23.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.121+0000 7f4ae6ffd700 1 -- 172.21.15.82:0/2099317182 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af8005ce0 con 0x55594a156c40 2023-09-23T08:59:23.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.122+0000 7f4b21bbbb80 1 -- 172.21.15.82:0/2099317182 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55594a1261c0 con 0x55594a156c40 2023-09-23T08:59:23.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.122+0000 7f4ae6ffd700 1 -- 172.21.15.82:0/2099317182 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f4af80051e0 con 0x55594a156c40 2023-09-23T08:59:23.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.122+0000 7f4ae6ffd700 1 -- 172.21.15.82:0/2099317182 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4af80053e0 con 0x55594a156c40 2023-09-23T08:59:23.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.122+0000 7f4b21bbbb80 10 client.25658 fetch_fsmap learned FSMap version 30 2023-09-23T08:59:23.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.122+0000 7f4b21bbbb80 1 -- 172.21.15.82:0/2099317182 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x555949ed4de0 con 0x55594a156c40 2023-09-23T08:59:23.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.122+0000 7f4ae6ffd700 1 -- 172.21.15.82:0/2099317182 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55594a1261c0 con 0x55594a156c40 2023-09-23T08:59:23.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.122+0000 7f4ae6ffd700 1 -- 172.21.15.82:0/2099317182 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 30) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f4af8021040 con 0x55594a156c40 2023-09-23T08:59:23.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.122+0000 7f4b21bbbb80 10 client.25658 fetch_fsmap finished waiting for FSMap version 30 2023-09-23T08:59:23.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.122+0000 7f4b21bbbb80 10 client.25658 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T08:59:23.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.123+0000 7f4b21bbbb80 20 client.25658 populate_metadata read hostname 'smithi082' 2023-09-23T08:59:23.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.123+0000 7f4b21bbbb80 1 --2- 172.21.15.82:0/2099317182 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55594a170660 0x55594a172a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:59:23.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.123+0000 7f4b21bbbb80 4 client.25658 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T08:59:23.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.123+0000 7f4b21bbbb80 1 -- 172.21.15.82:0/2099317182 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55594a04eba0 con 0x55594a170660 2023-09-23T08:59:23.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.123+0000 7f4b06ffd700 1 --2- 172.21.15.82:0/2099317182 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55594a170660 0x55594a172a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:59:23.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.123+0000 7f4b06ffd700 1 --2- 172.21.15.82:0/2099317182 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55594a170660 0x55594a172a80 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=153f0634e46541c4 server_cookie=773872ffd92c0089 in_seq=0 out_seq=0 2023-09-23T08:59:23.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.123+0000 7f4ae6ffd700 10 client.25658 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T08:59:23.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.124+0000 7f4ae6ffd700 1 -- 172.21.15.82:0/2099317182 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55594a04eba0 con 0x55594a170660 2023-09-23T08:59:23.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.124+0000 7f4ae6ffd700 10 client.25658 handle_command_reply: tid=0 2023-09-23T08:59:23.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.124+0000 7f4b21bbbb80 1 client.25658 shutdown 2023-09-23T08:59:23.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.124+0000 7f4b21bbbb80 1 -- 172.21.15.82:0/2099317182 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55594a156c40 msgr2=0x55594a162c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:59:23.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.124+0000 7f4b21bbbb80 1 --2- 172.21.15.82:0/2099317182 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55594a156c40 0x55594a162c50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4af801b040 tx=0x7f4af8004270 comp rx=0 tx=0).stop 2023-09-23T08:59:23.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.124+0000 7f4b21bbbb80 1 -- 172.21.15.82:0/2099317182 shutdown_connections 2023-09-23T08:59:23.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.124+0000 7f4b21bbbb80 1 --2- 172.21.15.82:0/2099317182 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55594a15cca0 0x55594a160610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:59:23.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.124+0000 7f4b21bbbb80 1 --2- 172.21.15.82:0/2099317182 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55594a156c40 0x55594a162c50 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:59:23.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.124+0000 7f4b21bbbb80 1 --2- 172.21.15.82:0/2099317182 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55594a170660 0x55594a172a80 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:59:23.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.124+0000 7f4b21bbbb80 1 --2- 172.21.15.82:0/2099317182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55594a15c380 0x55594a15fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:59:23.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.124+0000 7f4b21bbbb80 1 -- 172.21.15.82:0/2099317182 >> 172.21.15.82:0/2099317182 conn(0x55594a0cb0e0 msgr2=0x55594a14bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:59:23.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.124+0000 7f4ae6ffd700 0 client.25658 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T08:59:23.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.124+0000 7f4b21bbbb80 1 -- 172.21.15.82:0/2099317182 shutdown_connections 2023-09-23T08:59:23.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.125+0000 7f4b21bbbb80 1 -- 172.21.15.82:0/2099317182 wait complete. 2023-09-23T08:59:23.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.125+0000 7f4b21bbbb80 20 client.25658 trim_cache size 0 max 16384 2023-09-23T08:59:23.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.149+0000 7f4b21bbbb80 1 Processor -- start 2023-09-23T08:59:23.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.149+0000 7f4b21bbbb80 1 -- start start 2023-09-23T08:59:23.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.150+0000 7f4b21bbbb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55594a156c40 0x55594a16c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:59:23.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.150+0000 7f4b21bbbb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55594a15c380 0x55594a1627f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:59:23.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.150+0000 7f4b21bbbb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55594a15cca0 0x55594a15f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:59:23.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.150+0000 7f4b21bbbb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x555949f2a920 con 0x55594a15cca0 2023-09-23T08:59:23.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.150+0000 7f4b21bbbb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55594a16dd70 con 0x55594a15c380 2023-09-23T08:59:23.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.150+0000 7f4b21bbbb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55594a14dcb0 con 0x55594a156c40 2023-09-23T08:59:23.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.150+0000 7f4b07fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55594a15cca0 0x55594a15f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:59:23.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.150+0000 7f4b077fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55594a156c40 0x55594a16c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:59:23.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.150+0000 7f4b077fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55594a156c40 0x55594a16c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:59296/0 (socket says 172.21.15.82:59296) 2023-09-23T08:59:23.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.150+0000 7f4b07fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55594a15cca0 0x55594a15f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39362/0 (socket says 172.21.15.82:39362) 2023-09-23T08:59:23.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.150+0000 7f4b077fe700 1 -- 172.21.15.82:0/2541479397 learned_addr learned my addr 172.21.15.82:0/2541479397 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:59:23.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.150+0000 7f4b06ffd700 1 --2- 172.21.15.82:0/2541479397 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55594a15c380 0x55594a1627f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:59:23.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.151+0000 7f4b077fe700 1 -- 172.21.15.82:0/2541479397 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55594a15c380 msgr2=0x55594a1627f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:59:23.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.151+0000 7f4b077fe700 1 --2- 172.21.15.82:0/2541479397 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55594a15c380 0x55594a1627f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:59:23.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.151+0000 7f4b077fe700 1 -- 172.21.15.82:0/2541479397 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55594a15cca0 msgr2=0x55594a15f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:59:23.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.151+0000 7f4b077fe700 1 --2- 172.21.15.82:0/2541479397 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55594a15cca0 0x55594a15f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:59:23.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.151+0000 7f4b077fe700 1 -- 172.21.15.82:0/2541479397 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555949ebdc60 con 0x55594a156c40 2023-09-23T08:59:23.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.151+0000 7f4b077fe700 1 --2- 172.21.15.82:0/2541479397 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55594a156c40 0x55594a16c9d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4af80092a0 tx=0x7f4af8023570 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c34f4b4088711af9 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:59:23.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.151+0000 7f4aee7fc700 1 -- 172.21.15.82:0/2541479397 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af8003ee0 con 0x55594a156c40 2023-09-23T08:59:23.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.151+0000 7f4aee7fc700 1 -- 172.21.15.82:0/2541479397 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4af8009d50 con 0x55594a156c40 2023-09-23T08:59:23.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.151+0000 7f4aee7fc700 1 -- 172.21.15.82:0/2541479397 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af802a360 con 0x55594a156c40 2023-09-23T08:59:23.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.152+0000 7f4b21bbbb80 1 -- 172.21.15.82:0/2541479397 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55594a156c40 msgr2=0x55594a16c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:59:23.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.152+0000 7f4b21bbbb80 1 --2- 172.21.15.82:0/2541479397 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55594a156c40 0x55594a16c9d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4af80092a0 tx=0x7f4af8023570 comp rx=0 tx=0).stop 2023-09-23T08:59:23.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.152+0000 7f4b21bbbb80 1 -- 172.21.15.82:0/2541479397 shutdown_connections 2023-09-23T08:59:23.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.152+0000 7f4b21bbbb80 1 --2- 172.21.15.82:0/2541479397 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55594a15cca0 0x55594a15f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:59:23.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.152+0000 7f4b21bbbb80 1 --2- 172.21.15.82:0/2541479397 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55594a156c40 0x55594a16c9d0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:59:23.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.152+0000 7f4b21bbbb80 1 --2- 172.21.15.82:0/2541479397 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55594a15c380 0x55594a1627f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:59:23.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.152+0000 7f4b21bbbb80 1 -- 172.21.15.82:0/2541479397 >> 172.21.15.82:0/2541479397 conn(0x55594a0cb0e0 msgr2=0x55594a151110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:59:23.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.152+0000 7f4b21bbbb80 1 -- 172.21.15.82:0/2541479397 shutdown_connections 2023-09-23T08:59:23.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.152+0000 7f4b21bbbb80 1 -- 172.21.15.82:0/2541479397 wait complete. 2023-09-23T08:59:23.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.153+0000 7f4b21bbbb80 1 -- start start 2023-09-23T08:59:23.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.153+0000 7f4b21bbbb80 1 Processor -- start 2023-09-23T08:59:23.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.153+0000 7f4b21bbbb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55594a156c40 0x55594a157e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:59:23.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.153+0000 7f4b21bbbb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55594a15c380 0x55594a158340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:59:23.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.153+0000 7f4b21bbbb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55594a15cca0 0x55594a158880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:59:23.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.153+0000 7f4b21bbbb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55594a158dc0 con 0x55594a156c40 2023-09-23T08:59:23.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.153+0000 7f4b21bbbb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55594a158f30 con 0x55594a15c380 2023-09-23T08:59:23.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.153+0000 7f4b21bbbb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55594a1590f0 con 0x55594a15cca0 2023-09-23T08:59:23.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.153+0000 7f4b21bbbb80 10 client.0 _ll_register_callbacks cb 0x7f4b0001e050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T08:59:23.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.154+0000 7f4b077fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55594a156c40 0x55594a157e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:59:23.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.154+0000 7f4b07fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55594a15cca0 0x55594a158880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:59:23.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.154+0000 7f4b07fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55594a15cca0 0x55594a158880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:59302/0 (socket says 172.21.15.82:59302) 2023-09-23T08:59:23.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.154+0000 7f4b07fff700 1 -- 172.21.15.82:0/1239916668 learned_addr learned my addr 172.21.15.82:0/1239916668 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:59:23.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.154+0000 7f4b077fe700 1 --2- 172.21.15.82:0/1239916668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55594a156c40 0x55594a157e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39376/0 (socket says 172.21.15.82:39376) 2023-09-23T08:59:23.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.154+0000 7f4b06ffd700 1 --2- 172.21.15.82:0/1239916668 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55594a15c380 0x55594a158340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:59:23.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.154+0000 7f4b07fff700 1 -- 172.21.15.82:0/1239916668 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55594a15c380 msgr2=0x55594a158340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:59:23.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.154+0000 7f4b07fff700 1 --2- 172.21.15.82:0/1239916668 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55594a15c380 0x55594a158340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:59:23.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.154+0000 7f4b07fff700 1 -- 172.21.15.82:0/1239916668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55594a156c40 msgr2=0x55594a157e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:59:23.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.154+0000 7f4b07fff700 1 --2- 172.21.15.82:0/1239916668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55594a156c40 0x55594a157e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:59:23.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.154+0000 7f4b07fff700 1 -- 172.21.15.82:0/1239916668 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555949ed4de0 con 0x55594a15cca0 2023-09-23T08:59:23.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.154+0000 7f4b07fff700 1 --2- 172.21.15.82:0/1239916668 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55594a15cca0 0x55594a158880 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4b00018b50 tx=0x7f4b00004b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b21368eae84f58c8 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:59:23.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.155+0000 7f4ae6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T08:59:23.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.155+0000 7f4ae6ffd700 1 -- 172.21.15.82:0/1239916668 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0000e040 con 0x55594a15cca0 2023-09-23T08:59:23.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.155+0000 7f4b21bbbb80 1 -- 172.21.15.82:0/1239916668 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55594a1498b0 con 0x55594a15cca0 2023-09-23T08:59:23.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.155+0000 7f4ae6ffd700 1 -- 172.21.15.82:0/1239916668 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f4b00004db0 con 0x55594a15cca0 2023-09-23T08:59:23.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.155+0000 7f4ae6ffd700 1 -- 172.21.15.82:0/1239916668 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4b00008bb0 con 0x55594a15cca0 2023-09-23T08:59:23.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.155+0000 7f4b21bbbb80 10 client.25711 fetch_fsmap learned FSMap version 30 2023-09-23T08:59:23.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.155+0000 7f4b21bbbb80 1 -- 172.21.15.82:0/1239916668 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x555949efb250 con 0x55594a15cca0 2023-09-23T08:59:23.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.155+0000 7f4ae6ffd700 1 -- 172.21.15.82:0/1239916668 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55594a1498b0 con 0x55594a15cca0 2023-09-23T08:59:23.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.156+0000 7f4ae6ffd700 1 -- 172.21.15.82:0/1239916668 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 30) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f4b00025c50 con 0x55594a15cca0 2023-09-23T08:59:23.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.156+0000 7f4b21bbbb80 10 client.25711 fetch_fsmap finished waiting for FSMap version 30 2023-09-23T08:59:23.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.156+0000 7f4b21bbbb80 10 client.25711 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T08:59:23.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.156+0000 7f4b21bbbb80 20 client.25711 populate_metadata read hostname 'smithi082' 2023-09-23T08:59:23.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.156+0000 7f4b21bbbb80 1 --2- 172.21.15.82:0/1239916668 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55594a1c4eb0 0x55594a1c72d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:59:23.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.156+0000 7f4b21bbbb80 4 client.25711 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T08:59:23.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.156+0000 7f4b21bbbb80 1 -- 172.21.15.82:0/1239916668 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55594a0a1970 con 0x55594a1c4eb0 2023-09-23T08:59:23.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.156+0000 7f4b077fe700 1 --2- 172.21.15.82:0/1239916668 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55594a1c4eb0 0x55594a1c72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:59:23.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.157+0000 7f4ae6ffd700 10 client.25711 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T08:59:23.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.157+0000 7f4b077fe700 1 --2- 172.21.15.82:0/1239916668 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55594a1c4eb0 0x55594a1c72d0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a470cb4a40a45741 server_cookie=bcfe150da63b0f19 in_seq=0 out_seq=0 2023-09-23T08:59:23.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.157+0000 7f4ae6ffd700 1 -- 172.21.15.82:0/1239916668 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55594a0a1970 con 0x55594a1c4eb0 2023-09-23T08:59:23.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.157+0000 7f4ae6ffd700 10 client.25711 handle_command_reply: tid=0 2023-09-23T08:59:23.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.157+0000 7f4b21bbbb80 1 client.25711 shutdown 2023-09-23T08:59:23.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.157+0000 7f4b21bbbb80 1 -- 172.21.15.82:0/1239916668 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55594a15cca0 msgr2=0x55594a158880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:59:23.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.157+0000 7f4b21bbbb80 1 --2- 172.21.15.82:0/1239916668 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55594a15cca0 0x55594a158880 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4b00018b50 tx=0x7f4b00004b40 comp rx=0 tx=0).stop 2023-09-23T08:59:23.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.157+0000 7f4b21bbbb80 1 -- 172.21.15.82:0/1239916668 shutdown_connections 2023-09-23T08:59:23.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.157+0000 7f4b21bbbb80 1 --2- 172.21.15.82:0/1239916668 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55594a15cca0 0x55594a158880 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:59:23.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.157+0000 7f4b21bbbb80 1 --2- 172.21.15.82:0/1239916668 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55594a1c4eb0 0x55594a1c72d0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:59:23.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.157+0000 7f4b21bbbb80 1 --2- 172.21.15.82:0/1239916668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55594a156c40 0x55594a157e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:59:23.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.157+0000 7f4b21bbbb80 1 --2- 172.21.15.82:0/1239916668 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55594a15c380 0x55594a158340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:59:23.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.157+0000 7f4b21bbbb80 1 -- 172.21.15.82:0/1239916668 >> 172.21.15.82:0/1239916668 conn(0x55594a0cb0e0 msgr2=0x55594a15a050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:59:23.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.157+0000 7f4ae6ffd700 0 client.25711 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T08:59:23.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.157+0000 7f4b21bbbb80 1 -- 172.21.15.82:0/1239916668 shutdown_connections 2023-09-23T08:59:23.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.157+0000 7f4b21bbbb80 1 -- 172.21.15.82:0/1239916668 wait complete. 2023-09-23T08:59:23.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.158+0000 7f4b21bbbb80 20 client.25711 trim_cache size 0 max 16384 2023-09-23T08:59:23.166 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T08:59:23.166 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-23T08:59:23.166 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T08:59:23.166 INFO:teuthology.orchestra.run.smithi082.stdout: "6f0fe3a6-7212-425d-a0a6-f38e8b42ec13": { 2023-09-23T08:59:23.166 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T08:59:23.166 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "6f0fe3a6-7212-425d-a0a6-f38e8b42ec13", 2023-09-23T08:59:23.166 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T08:59:23.166 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T08:59:23.166 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T08:59:23.166 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T08:59:23.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.158+0000 7f4b0e1ff700 1 -- 172.21.15.82:0/3295382490 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f4af00a00c0 msgr2=0x7f4af00a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:59:23.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.158+0000 7f4b0e1ff700 1 --2- 172.21.15.82:0/3295382490 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f4af00a00c0 0x7f4af00a2580 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4b0819f6a0 tx=0x7f4b0000fc00 comp rx=0 tx=0).stop 2023-09-23T08:59:23.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.158+0000 7f4b0e1ff700 1 -- 172.21.15.82:0/3295382490 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4b08102390 msgr2=0x7f4b0819eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:59:23.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.158+0000 7f4b0e1ff700 1 --2- 172.21.15.82:0/3295382490 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4b08102390 0x7f4b0819eee0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4afc005910 tx=0x7f4afc005740 comp rx=0 tx=0).stop 2023-09-23T08:59:23.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.158+0000 7f4b0e1ff700 1 -- 172.21.15.82:0/3295382490 shutdown_connections 2023-09-23T08:59:23.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.158+0000 7f4b0e1ff700 1 --2- 172.21.15.82:0/3295382490 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f4af00a00c0 0x7f4af00a2580 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:59:23.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.158+0000 7f4b0e1ff700 1 --2- 172.21.15.82:0/3295382490 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b0810ae90 0x7f4b08198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:59:23.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.158+0000 7f4b0e1ff700 1 --2- 172.21.15.82:0/3295382490 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b08101a70 0x7f4b0819e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:59:23.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.158+0000 7f4b0e1ff700 1 --2- 172.21.15.82:0/3295382490 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4b08102390 0x7f4b0819eee0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:59:23.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.158+0000 7f4b0e1ff700 1 -- 172.21.15.82:0/3295382490 >> 172.21.15.82:0/3295382490 conn(0x7f4b080fb2b0 msgr2=0x7f4b080fd6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:59:23.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.158+0000 7f4b0e1ff700 1 -- 172.21.15.82:0/3295382490 shutdown_connections 2023-09-23T08:59:23.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:23.158+0000 7f4b0e1ff700 1 -- 172.21.15.82:0/3295382490 wait complete. 2023-09-23T08:59:23.181 INFO:tasks.cephfs.filesystem:scrub status for tag:6f0fe3a6-7212-425d-a0a6-f38e8b42ec13 - {'path': '/', 'tag': '6f0fe3a6-7212-425d-a0a6-f38e8b42ec13', 'options': 'recursive,force'} 2023-09-23T08:59:23.513 INFO:teuthology.orchestra.run.smithi082.stderr:7700000 of 50000000 tuples (15%) done (elapsed 118.26 s, remaining 649.64 s) 2023-09-23T08:59:24.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:59:24 smithi135 ceph-mon[99205]: pgmap v78: 97 pgs: 97 active+clean; 1.8 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 25 MiB/s wr, 24 op/s 2023-09-23T08:59:24.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:59:24 smithi082 ceph-mon[97694]: pgmap v78: 97 pgs: 97 active+clean; 1.8 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 25 MiB/s wr, 24 op/s 2023-09-23T08:59:24.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:59:24 smithi161 ceph-mon[99580]: pgmap v78: 97 pgs: 97 active+clean; 1.8 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 25 MiB/s wr, 24 op/s 2023-09-23T08:59:25.222 INFO:teuthology.orchestra.run.smithi082.stderr:7800000 of 50000000 tuples (15%) done (elapsed 119.96 s, remaining 649.04 s) 2023-09-23T08:59:26.442 INFO:teuthology.orchestra.run.smithi082.stderr:7900000 of 50000000 tuples (15%) done (elapsed 121.18 s, remaining 645.80 s) 2023-09-23T08:59:26.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:59:26 smithi135 ceph-mon[99205]: pgmap v79: 97 pgs: 97 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 38 MiB/s wr, 36 op/s 2023-09-23T08:59:26.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:59:26 smithi082 ceph-mon[97694]: pgmap v79: 97 pgs: 97 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 38 MiB/s wr, 36 op/s 2023-09-23T08:59:26.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:59:26 smithi161 ceph-mon[99580]: pgmap v79: 97 pgs: 97 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 38 MiB/s wr, 36 op/s 2023-09-23T08:59:28.166 INFO:teuthology.orchestra.run.smithi082.stderr:8000000 of 50000000 tuples (16%) done (elapsed 122.91 s, remaining 645.27 s) 2023-09-23T08:59:28.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:59:28 smithi135 ceph-mon[99205]: pgmap v80: 97 pgs: 97 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 26 MiB/s wr, 24 op/s 2023-09-23T08:59:28.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:59:28 smithi082 ceph-mon[97694]: pgmap v80: 97 pgs: 97 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 26 MiB/s wr, 24 op/s 2023-09-23T08:59:28.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:59:28 smithi161 ceph-mon[99580]: pgmap v80: 97 pgs: 97 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 26 MiB/s wr, 24 op/s 2023-09-23T08:59:29.381 INFO:teuthology.orchestra.run.smithi082.stderr:8100000 of 50000000 tuples (16%) done (elapsed 124.12 s, remaining 642.07 s) 2023-09-23T08:59:30.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:59:30 smithi135 ceph-mon[99205]: pgmap v81: 97 pgs: 97 active+clean; 1.9 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 38 MiB/s wr, 39 op/s 2023-09-23T08:59:30.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:59:30 smithi082 ceph-mon[97694]: pgmap v81: 97 pgs: 97 active+clean; 1.9 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 38 MiB/s wr, 39 op/s 2023-09-23T08:59:30.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:59:30 smithi161 ceph-mon[99580]: pgmap v81: 97 pgs: 97 active+clean; 1.9 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 38 MiB/s wr, 39 op/s 2023-09-23T08:59:31.098 INFO:teuthology.orchestra.run.smithi082.stderr:8200000 of 50000000 tuples (16%) done (elapsed 125.84 s, remaining 641.48 s) 2023-09-23T08:59:32.724 INFO:teuthology.orchestra.run.smithi082.stderr:8300000 of 50000000 tuples (16%) done (elapsed 127.47 s, remaining 640.40 s) 2023-09-23T08:59:32.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:59:32 smithi135 ceph-mon[99205]: pgmap v82: 97 pgs: 97 active+clean; 1.9 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 26 MiB/s wr, 27 op/s 2023-09-23T08:59:32.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:59:32 smithi082 ceph-mon[97694]: pgmap v82: 97 pgs: 97 active+clean; 1.9 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 26 MiB/s wr, 27 op/s 2023-09-23T08:59:32.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:59:32 smithi161 ceph-mon[99580]: pgmap v82: 97 pgs: 97 active+clean; 1.9 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 26 MiB/s wr, 27 op/s 2023-09-23T08:59:33.962 INFO:teuthology.orchestra.run.smithi082.stderr:8400000 of 50000000 tuples (16%) done (elapsed 128.70 s, remaining 637.39 s) 2023-09-23T08:59:34.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:59:34 smithi135 ceph-mon[99205]: pgmap v83: 97 pgs: 97 active+clean; 1.9 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 26 MiB/s wr, 27 op/s 2023-09-23T08:59:34.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:59:34 smithi082 ceph-mon[97694]: pgmap v83: 97 pgs: 97 active+clean; 1.9 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 26 MiB/s wr, 27 op/s 2023-09-23T08:59:34.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:59:34 smithi161 ceph-mon[99580]: pgmap v83: 97 pgs: 97 active+clean; 1.9 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 26 MiB/s wr, 27 op/s 2023-09-23T08:59:35.649 INFO:teuthology.orchestra.run.smithi082.stderr:8500000 of 50000000 tuples (17%) done (elapsed 130.39 s, remaining 636.62 s) 2023-09-23T08:59:36.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:59:36 smithi135 ceph-mon[99205]: pgmap v84: 97 pgs: 97 active+clean; 2.0 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 38 MiB/s wr, 40 op/s 2023-09-23T08:59:36.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:59:36 smithi082 ceph-mon[97694]: pgmap v84: 97 pgs: 97 active+clean; 2.0 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 38 MiB/s wr, 40 op/s 2023-09-23T08:59:36.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:59:36 smithi161 ceph-mon[99580]: pgmap v84: 97 pgs: 97 active+clean; 2.0 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 38 MiB/s wr, 40 op/s 2023-09-23T08:59:37.370 INFO:teuthology.orchestra.run.smithi082.stderr:8600000 of 50000000 tuples (17%) done (elapsed 132.11 s, remaining 635.98 s) 2023-09-23T08:59:38.584 INFO:teuthology.orchestra.run.smithi082.stderr:8700000 of 50000000 tuples (17%) done (elapsed 133.33 s, remaining 632.92 s) 2023-09-23T08:59:38.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:59:38 smithi135 ceph-mon[99205]: pgmap v85: 97 pgs: 97 active+clean; 2.0 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 25 MiB/s wr, 28 op/s 2023-09-23T08:59:38.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:59:38 smithi082 ceph-mon[97694]: pgmap v85: 97 pgs: 97 active+clean; 2.0 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 25 MiB/s wr, 28 op/s 2023-09-23T08:59:38.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:59:38 smithi161 ceph-mon[99580]: pgmap v85: 97 pgs: 97 active+clean; 2.0 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 25 MiB/s wr, 28 op/s 2023-09-23T08:59:40.319 INFO:teuthology.orchestra.run.smithi082.stderr:8800000 of 50000000 tuples (17%) done (elapsed 135.06 s, remaining 632.33 s) 2023-09-23T08:59:40.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:59:40 smithi135 ceph-mon[99205]: pgmap v86: 97 pgs: 97 active+clean; 2.1 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 38 MiB/s wr, 42 op/s 2023-09-23T08:59:40.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:59:40 smithi082 ceph-mon[97694]: pgmap v86: 97 pgs: 97 active+clean; 2.1 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 38 MiB/s wr, 42 op/s 2023-09-23T08:59:40.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:59:40 smithi161 ceph-mon[99580]: pgmap v86: 97 pgs: 97 active+clean; 2.1 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 38 MiB/s wr, 42 op/s 2023-09-23T08:59:42.035 INFO:teuthology.orchestra.run.smithi082.stderr:8900000 of 50000000 tuples (17%) done (elapsed 136.78 s, remaining 631.63 s) 2023-09-23T08:59:42.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:59:42 smithi082 ceph-mon[97694]: pgmap v87: 97 pgs: 97 active+clean; 2.1 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 25 MiB/s wr, 27 op/s 2023-09-23T08:59:42.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:59:42 smithi161 ceph-mon[99580]: pgmap v87: 97 pgs: 97 active+clean; 2.1 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 25 MiB/s wr, 27 op/s 2023-09-23T08:59:43.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:59:42 smithi135 ceph-mon[99205]: pgmap v87: 97 pgs: 97 active+clean; 2.1 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 25 MiB/s wr, 27 op/s 2023-09-23T08:59:43.141 INFO:teuthology.orchestra.run.smithi082.stderr:9000000 of 50000000 tuples (18%) done (elapsed 137.88 s, remaining 628.13 s) 2023-09-23T08:59:44.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:59:44 smithi082 ceph-mon[97694]: pgmap v88: 97 pgs: 97 active+clean; 2.1 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 25 MiB/s wr, 27 op/s 2023-09-23T08:59:44.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:59:44 smithi161 ceph-mon[99580]: pgmap v88: 97 pgs: 97 active+clean; 2.1 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 25 MiB/s wr, 27 op/s 2023-09-23T08:59:45.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:59:44 smithi135 ceph-mon[99205]: pgmap v88: 97 pgs: 97 active+clean; 2.1 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 25 MiB/s wr, 27 op/s 2023-09-23T08:59:45.273 INFO:teuthology.orchestra.run.smithi082.stderr:9100000 of 50000000 tuples (18%) done (elapsed 140.02 s, remaining 629.30 s) 2023-09-23T08:59:46.493 INFO:teuthology.orchestra.run.smithi082.stderr:9200000 of 50000000 tuples (18%) done (elapsed 141.24 s, remaining 626.35 s) 2023-09-23T08:59:46.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:59:46 smithi082 ceph-mon[97694]: pgmap v89: 97 pgs: 97 active+clean; 2.1 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 37 MiB/s wr, 40 op/s 2023-09-23T08:59:46.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:59:46 smithi161 ceph-mon[99580]: pgmap v89: 97 pgs: 97 active+clean; 2.1 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 37 MiB/s wr, 40 op/s 2023-09-23T08:59:47.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:59:46 smithi135 ceph-mon[99205]: pgmap v89: 97 pgs: 97 active+clean; 2.1 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 37 MiB/s wr, 40 op/s 2023-09-23T08:59:48.212 INFO:teuthology.orchestra.run.smithi082.stderr:9300000 of 50000000 tuples (18%) done (elapsed 142.95 s, remaining 625.62 s) 2023-09-23T08:59:48.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:59:48 smithi082 ceph-mon[97694]: pgmap v90: 97 pgs: 97 active+clean; 2.1 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 24 MiB/s wr, 26 op/s 2023-09-23T08:59:48.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:59:48 smithi161 ceph-mon[99580]: pgmap v90: 97 pgs: 97 active+clean; 2.1 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 24 MiB/s wr, 26 op/s 2023-09-23T08:59:49.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:59:48 smithi135 ceph-mon[99205]: pgmap v90: 97 pgs: 97 active+clean; 2.1 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 24 MiB/s wr, 26 op/s 2023-09-23T08:59:49.950 INFO:teuthology.orchestra.run.smithi082.stderr:9400000 of 50000000 tuples (18%) done (elapsed 144.69 s, remaining 624.95 s) 2023-09-23T08:59:50.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:59:50 smithi082 ceph-mon[97694]: pgmap v91: 97 pgs: 97 active+clean; 2.2 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 37 MiB/s wr, 39 op/s 2023-09-23T08:59:50.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:59:50 smithi161 ceph-mon[99580]: pgmap v91: 97 pgs: 97 active+clean; 2.2 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 37 MiB/s wr, 39 op/s 2023-09-23T08:59:51.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:59:50 smithi135 ceph-mon[99205]: pgmap v91: 97 pgs: 97 active+clean; 2.2 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 37 MiB/s wr, 39 op/s 2023-09-23T08:59:51.182 INFO:teuthology.orchestra.run.smithi082.stderr:9500000 of 50000000 tuples (19%) done (elapsed 145.92 s, remaining 622.10 s) 2023-09-23T08:59:52.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:59:52 smithi082 ceph-mon[97694]: pgmap v92: 97 pgs: 97 active+clean; 2.2 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 24 MiB/s wr, 26 op/s 2023-09-23T08:59:52.895 INFO:teuthology.orchestra.run.smithi082.stderr:9600000 of 50000000 tuples (19%) done (elapsed 147.64 s, remaining 621.31 s) 2023-09-23T08:59:52.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:59:52 smithi161 ceph-mon[99580]: pgmap v92: 97 pgs: 97 active+clean; 2.2 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 24 MiB/s wr, 26 op/s 2023-09-23T08:59:53.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:59:52 smithi135 ceph-mon[99205]: pgmap v92: 97 pgs: 97 active+clean; 2.2 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 24 MiB/s wr, 26 op/s 2023-09-23T08:59:53.182 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T08:59:53.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.403+0000 7f0e4e7ff700 1 -- 172.21.15.82:0/3794003594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e48100870 msgr2=0x7f0e48100cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:59:53.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.403+0000 7f0e4e7ff700 1 --2- 172.21.15.82:0/3794003594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e48100870 0x7f0e48100cf0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c009990 tx=0x7f0e3c009ca0 comp rx=0 tx=0).stop 2023-09-23T08:59:53.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.403+0000 7f0e4e7ff700 1 -- 172.21.15.82:0/3794003594 shutdown_connections 2023-09-23T08:59:53.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.403+0000 7f0e4e7ff700 1 --2- 172.21.15.82:0/3794003594 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0e48101230 0x7f0e4810d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:59:53.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.403+0000 7f0e4e7ff700 1 --2- 172.21.15.82:0/3794003594 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0e48106880 0x7f0e48106c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:59:53.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.403+0000 7f0e4e7ff700 1 --2- 172.21.15.82:0/3794003594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e48100870 0x7f0e48100cf0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:59:53.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.403+0000 7f0e4e7ff700 1 -- 172.21.15.82:0/3794003594 >> 172.21.15.82:0/3794003594 conn(0x7f0e480fc3a0 msgr2=0x7f0e480fe7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:59:53.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.404+0000 7f0e4e7ff700 1 -- 172.21.15.82:0/3794003594 shutdown_connections 2023-09-23T08:59:53.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.404+0000 7f0e4e7ff700 1 -- 172.21.15.82:0/3794003594 wait complete. 2023-09-23T08:59:53.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.405+0000 7f0e4e7ff700 1 Processor -- start 2023-09-23T08:59:53.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.405+0000 7f0e4e7ff700 1 -- start start 2023-09-23T08:59:53.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.405+0000 7f0e4e7ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0e48100870 0x7f0e48072c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:59:53.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.405+0000 7f0e4e7ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e48101230 0x7f0e48073160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:59:53.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.405+0000 7f0e4e7ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0e48106880 0x7f0e481a4a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:59:53.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.406+0000 7f0e4e7ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e48073990 con 0x7f0e48100870 2023-09-23T08:59:53.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.406+0000 7f0e4e7ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e481a4fa0 con 0x7f0e48101230 2023-09-23T08:59:53.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.406+0000 7f0e4e7ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e481a50e0 con 0x7f0e48106880 2023-09-23T08:59:53.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.406+0000 7f0e47fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0e48100870 0x7f0e48072c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:59:53.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.406+0000 7f0e47fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0e48100870 0x7f0e48072c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47190/0 (socket says 172.21.15.82:47190) 2023-09-23T08:59:53.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.406+0000 7f0e47fff700 1 -- 172.21.15.82:0/2117891687 learned_addr learned my addr 172.21.15.82:0/2117891687 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:59:53.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.406+0000 7f0e477fe700 1 --2- 172.21.15.82:0/2117891687 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e48101230 0x7f0e48073160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:59:53.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.406+0000 7f0e4cd9c700 1 --2- 172.21.15.82:0/2117891687 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0e48106880 0x7f0e481a4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:59:53.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.406+0000 7f0e47fff700 1 -- 172.21.15.82:0/2117891687 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0e48106880 msgr2=0x7f0e481a4a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:59:53.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.406+0000 7f0e47fff700 1 --2- 172.21.15.82:0/2117891687 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0e48106880 0x7f0e481a4a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:59:53.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.406+0000 7f0e47fff700 1 -- 172.21.15.82:0/2117891687 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e48101230 msgr2=0x7f0e48073160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:59:53.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.406+0000 7f0e47fff700 1 --2- 172.21.15.82:0/2117891687 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e48101230 0x7f0e48073160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:59:53.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.406+0000 7f0e47fff700 1 -- 172.21.15.82:0/2117891687 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e3c0095f0 con 0x7f0e48100870 2023-09-23T08:59:53.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.406+0000 7f0e477fe700 1 --2- 172.21.15.82:0/2117891687 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e48101230 0x7f0e48073160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T08:59:53.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.407+0000 7f0e47fff700 1 --2- 172.21.15.82:0/2117891687 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0e48100870 0x7f0e48072c20 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f0e3800e9a0 tx=0x7f0e3800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:59:53.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.407+0000 7f0e457fa700 1 -- 172.21.15.82:0/2117891687 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e38009790 con 0x7f0e48100870 2023-09-23T08:59:53.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.407+0000 7f0e4e7ff700 1 -- 172.21.15.82:0/2117891687 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e481a5340 con 0x7f0e48100870 2023-09-23T08:59:53.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.407+0000 7f0e457fa700 1 -- 172.21.15.82:0/2117891687 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0e38010430 con 0x7f0e48100870 2023-09-23T08:59:53.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.407+0000 7f0e457fa700 1 -- 172.21.15.82:0/2117891687 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3800cea0 con 0x7f0e48100870 2023-09-23T08:59:53.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.407+0000 7f0e4e7ff700 1 -- 172.21.15.82:0/2117891687 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e481a5820 con 0x7f0e48100870 2023-09-23T08:59:53.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.411+0000 7f0e457fa700 1 -- 172.21.15.82:0/2117891687 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f0e380105a0 con 0x7f0e48100870 2023-09-23T08:59:53.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.412+0000 7f0e6213eb80 1 Processor -- start 2023-09-23T08:59:53.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.412+0000 7f0e6213eb80 1 -- start start 2023-09-23T08:59:53.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.413+0000 7f0e6213eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cfad857380 0x55cfad857760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:59:53.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.413+0000 7f0e6213eb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55cfad857ca0 0x55cfad851700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:59:53.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.413+0000 7f0e6213eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cfad851c40 0x55cfad8520a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:59:53.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.413+0000 7f0e6213eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cfad7b97b0 con 0x55cfad857380 2023-09-23T08:59:53.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.413+0000 7f0e6213eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cfad7aa780 con 0x55cfad851c40 2023-09-23T08:59:53.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.413+0000 7f0e6213eb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cfad7a80a0 con 0x55cfad857ca0 2023-09-23T08:59:53.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.413+0000 7f0e457fa700 1 --2- 172.21.15.82:0/2117891687 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f0e300a00c0 0x7f0e300a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:59:53.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.413+0000 7f0e47fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55cfad857ca0 0x55cfad851700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:59:53.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.413+0000 7f0e477fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cfad851c40 0x55cfad8520a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:59:53.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.413+0000 7f0e4cd9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cfad857380 0x55cfad857760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:59:53.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.413+0000 7f0e477fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cfad851c40 0x55cfad8520a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:44368/0 (socket says 172.21.15.82:44368) 2023-09-23T08:59:53.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.413+0000 7f0e47fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55cfad857ca0 0x55cfad851700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:46776/0 (socket says 172.21.15.82:46776) 2023-09-23T08:59:53.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.413+0000 7f0e477fe700 1 -- 172.21.15.82:0/1445960172 learned_addr learned my addr 172.21.15.82:0/1445960172 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:59:53.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.413+0000 7f0e4cd9c700 1 --2- 172.21.15.82:0/2117891687 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f0e300a00c0 0x7f0e300a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:59:53.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.413+0000 7f0e457fa700 1 -- 172.21.15.82:0/2117891687 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f0e38014070 con 0x7f0e48100870 2023-09-23T08:59:53.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.414+0000 7f0e477fe700 1 -- 172.21.15.82:0/1445960172 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55cfad857ca0 msgr2=0x55cfad851700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:59:53.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.414+0000 7f0e477fe700 1 --2- 172.21.15.82:0/1445960172 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55cfad857ca0 0x55cfad851700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:59:53.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.414+0000 7f0e477fe700 1 -- 172.21.15.82:0/1445960172 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cfad857380 msgr2=0x55cfad857760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:59:53.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.414+0000 7f0e477fe700 1 --2- 172.21.15.82:0/1445960172 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cfad857380 0x55cfad857760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:59:53.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.414+0000 7f0e477fe700 1 -- 172.21.15.82:0/1445960172 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cfad623630 con 0x55cfad851c40 2023-09-23T08:59:53.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.414+0000 7f0e4cd9c700 1 --2- 172.21.15.82:0/1445960172 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cfad857380 0x55cfad857760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T08:59:53.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.414+0000 7f0e4cd9c700 1 --2- 172.21.15.82:0/2117891687 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f0e300a00c0 0x7f0e300a2580 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0e40009ec0 tx=0x7f0e4000b040 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:59:53.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.414+0000 7f0e477fe700 1 --2- 172.21.15.82:0/1445960172 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cfad851c40 0x55cfad8520a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c000c00 tx=0x7f0e3c005c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a23f18e13002b92 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:59:53.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.414+0000 7f0e2e7fc700 1 -- 172.21.15.82:0/1445960172 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3c01d050 con 0x55cfad851c40 2023-09-23T08:59:53.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.414+0000 7f0e2e7fc700 1 -- 172.21.15.82:0/1445960172 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0e3c01e040 con 0x55cfad851c40 2023-09-23T08:59:53.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.414+0000 7f0e2e7fc700 1 -- 172.21.15.82:0/1445960172 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3c0053b0 con 0x55cfad851c40 2023-09-23T08:59:53.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.415+0000 7f0e6213eb80 1 -- 172.21.15.82:0/1445960172 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cfad851c40 msgr2=0x55cfad8520a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:59:53.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.415+0000 7f0e6213eb80 1 --2- 172.21.15.82:0/1445960172 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cfad851c40 0x55cfad8520a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c000c00 tx=0x7f0e3c005c00 comp rx=0 tx=0).stop 2023-09-23T08:59:53.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.415+0000 7f0e6213eb80 1 -- 172.21.15.82:0/1445960172 shutdown_connections 2023-09-23T08:59:53.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.415+0000 7f0e6213eb80 1 --2- 172.21.15.82:0/1445960172 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cfad851c40 0x55cfad8520a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:59:53.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.415+0000 7f0e6213eb80 1 --2- 172.21.15.82:0/1445960172 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cfad857380 0x55cfad857760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:59:53.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.415+0000 7f0e6213eb80 1 --2- 172.21.15.82:0/1445960172 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55cfad857ca0 0x55cfad851700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:59:53.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.415+0000 7f0e6213eb80 1 -- 172.21.15.82:0/1445960172 >> 172.21.15.82:0/1445960172 conn(0x55cfad7c60e0 msgr2=0x55cfad84c410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:59:53.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.415+0000 7f0e6213eb80 1 -- 172.21.15.82:0/1445960172 shutdown_connections 2023-09-23T08:59:53.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.416+0000 7f0e6213eb80 1 -- 172.21.15.82:0/1445960172 wait complete. 2023-09-23T08:59:53.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.416+0000 7f0e6213eb80 1 -- start start 2023-09-23T08:59:53.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.416+0000 7f0e6213eb80 1 Processor -- start 2023-09-23T08:59:53.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.417+0000 7f0e6213eb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55cfad851c40 0x55cfad85dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:59:53.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.417+0000 7f0e6213eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cfad857380 0x55cfad85aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:59:53.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.417+0000 7f0e6213eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cfad857ca0 0x55cfad85b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:59:53.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.417+0000 7f0e6213eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cfad7a3990 con 0x55cfad857ca0 2023-09-23T08:59:53.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.417+0000 7f0e6213eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cfad741bb0 con 0x55cfad857380 2023-09-23T08:59:53.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.417+0000 7f0e6213eb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cfad7418b0 con 0x55cfad851c40 2023-09-23T08:59:53.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.417+0000 7f0e6213eb80 10 client.0 _ll_register_callbacks cb 0x55cfad68ba80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T08:59:53.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.417+0000 7f0e47fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55cfad851c40 0x55cfad85dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:59:53.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.417+0000 7f0e477fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cfad857380 0x55cfad85aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:59:53.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.417+0000 7f0e47fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55cfad851c40 0x55cfad85dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:46792/0 (socket says 172.21.15.82:46792) 2023-09-23T08:59:53.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.417+0000 7f0e47fff700 1 -- 172.21.15.82:0/2290873611 learned_addr learned my addr 172.21.15.82:0/2290873611 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:59:53.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.417+0000 7f0e4cd9c700 1 --2- 172.21.15.82:0/2290873611 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cfad857ca0 0x55cfad85b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:59:53.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.417+0000 7f0e477fe700 1 -- 172.21.15.82:0/2290873611 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55cfad851c40 msgr2=0x55cfad85dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:59:53.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.417+0000 7f0e477fe700 1 --2- 172.21.15.82:0/2290873611 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55cfad851c40 0x55cfad85dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:59:53.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.418+0000 7f0e477fe700 1 -- 172.21.15.82:0/2290873611 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cfad857ca0 msgr2=0x55cfad85b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:59:53.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.418+0000 7f0e477fe700 1 --2- 172.21.15.82:0/2290873611 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cfad857ca0 0x55cfad85b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:59:53.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.418+0000 7f0e477fe700 1 -- 172.21.15.82:0/2290873611 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e40008a20 con 0x55cfad857380 2023-09-23T08:59:53.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.418+0000 7f0e4cd9c700 1 --2- 172.21.15.82:0/2290873611 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cfad857ca0 0x55cfad85b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T08:59:53.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.418+0000 7f0e477fe700 1 --2- 172.21.15.82:0/2290873611 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cfad857380 0x55cfad85aed0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c005930 tx=0x7f0e3c004a10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4eae40c3e9845bf6 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:59:53.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.418+0000 7f0e277fe700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-09-23T08:59:53.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.418+0000 7f0e277fe700 1 -- 172.21.15.82:0/2290873611 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3c0053d0 con 0x55cfad857380 2023-09-23T08:59:53.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.418+0000 7f0e6213eb80 1 -- 172.21.15.82:0/2290873611 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cfad8211c0 con 0x55cfad857380 2023-09-23T08:59:53.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.418+0000 7f0e277fe700 1 -- 172.21.15.82:0/2290873611 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f0e3c005530 con 0x55cfad857380 2023-09-23T08:59:53.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.418+0000 7f0e277fe700 1 -- 172.21.15.82:0/2290873611 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0e3c004d80 con 0x55cfad857380 2023-09-23T08:59:53.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.418+0000 7f0e6213eb80 10 client.25676 fetch_fsmap learned FSMap version 30 2023-09-23T08:59:53.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.418+0000 7f0e6213eb80 1 -- 172.21.15.82:0/2290873611 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x7f0e4810e040 con 0x55cfad857380 2023-09-23T08:59:53.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.419+0000 7f0e277fe700 1 -- 172.21.15.82:0/2290873611 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55cfad8211c0 con 0x55cfad857380 2023-09-23T08:59:53.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.419+0000 7f0e277fe700 1 -- 172.21.15.82:0/2290873611 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 30) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f0e3c023cf0 con 0x55cfad857380 2023-09-23T08:59:53.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.419+0000 7f0e6213eb80 10 client.25676 fetch_fsmap finished waiting for FSMap version 30 2023-09-23T08:59:53.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.419+0000 7f0e6213eb80 10 client.25676 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T08:59:53.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.419+0000 7f0e6213eb80 20 client.25676 populate_metadata read hostname 'smithi082' 2023-09-23T08:59:53.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.419+0000 7f0e6213eb80 1 --2- 172.21.15.82:0/2290873611 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55cfad86b2a0 0x55cfad86d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:59:53.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.419+0000 7f0e6213eb80 4 client.25676 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T08:59:53.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.419+0000 7f0e6213eb80 1 -- 172.21.15.82:0/2290873611 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cfad749ba0 con 0x55cfad86b2a0 2023-09-23T08:59:53.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.419+0000 7f0e47fff700 1 --2- 172.21.15.82:0/2290873611 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55cfad86b2a0 0x55cfad86d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:59:53.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.420+0000 7f0e277fe700 10 client.25676 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T08:59:53.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.420+0000 7f0e47fff700 1 --2- 172.21.15.82:0/2290873611 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55cfad86b2a0 0x55cfad86d6c0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d98e0e3a945bbdc server_cookie=4833b686555aa564 in_seq=0 out_seq=0 2023-09-23T08:59:53.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.421+0000 7f0e277fe700 1 -- 172.21.15.82:0/2290873611 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55cfad749ba0 con 0x55cfad86b2a0 2023-09-23T08:59:53.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.421+0000 7f0e277fe700 10 client.25676 handle_command_reply: tid=0 2023-09-23T08:59:53.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.421+0000 7f0e6213eb80 1 client.25676 shutdown 2023-09-23T08:59:53.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.421+0000 7f0e6213eb80 1 -- 172.21.15.82:0/2290873611 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cfad857380 msgr2=0x55cfad85aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:59:53.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.421+0000 7f0e6213eb80 1 --2- 172.21.15.82:0/2290873611 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cfad857380 0x55cfad85aed0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c005930 tx=0x7f0e3c004a10 comp rx=0 tx=0).stop 2023-09-23T08:59:53.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.421+0000 7f0e6213eb80 1 -- 172.21.15.82:0/2290873611 shutdown_connections 2023-09-23T08:59:53.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.421+0000 7f0e6213eb80 1 --2- 172.21.15.82:0/2290873611 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55cfad86b2a0 0x55cfad86d6c0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:59:53.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.421+0000 7f0e6213eb80 1 --2- 172.21.15.82:0/2290873611 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cfad857ca0 0x55cfad85b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:59:53.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.421+0000 7f0e6213eb80 1 --2- 172.21.15.82:0/2290873611 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55cfad851c40 0x55cfad85dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:59:53.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.421+0000 7f0e277fe700 0 client.25676 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T08:59:53.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.421+0000 7f0e6213eb80 1 --2- 172.21.15.82:0/2290873611 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cfad857380 0x55cfad85aed0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:59:53.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.421+0000 7f0e6213eb80 1 -- 172.21.15.82:0/2290873611 >> 172.21.15.82:0/2290873611 conn(0x55cfad7c60e0 msgr2=0x55cfad846b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:59:53.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.421+0000 7f0e6213eb80 1 -- 172.21.15.82:0/2290873611 shutdown_connections 2023-09-23T08:59:53.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.421+0000 7f0e6213eb80 1 -- 172.21.15.82:0/2290873611 wait complete. 2023-09-23T08:59:53.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.421+0000 7f0e6213eb80 20 client.25676 trim_cache size 0 max 16384 2023-09-23T08:59:53.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.441+0000 7f0e6213eb80 1 Processor -- start 2023-09-23T08:59:53.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.441+0000 7f0e6213eb80 1 -- start start 2023-09-23T08:59:53.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.442+0000 7f0e6213eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cfad851c40 0x55cfad851700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:59:53.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.442+0000 7f0e6213eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cfad857380 0x55cfad84c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:59:53.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.442+0000 7f0e6213eb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55cfad857ca0 0x55cfad855050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:59:53.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.442+0000 7f0e6213eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cfad625920 con 0x55cfad857380 2023-09-23T08:59:53.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.442+0000 7f0e6213eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cfad848cc0 con 0x55cfad851c40 2023-09-23T08:59:53.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.442+0000 7f0e6213eb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cfad84de20 con 0x55cfad857ca0 2023-09-23T08:59:53.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.442+0000 7f0e477fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cfad857380 0x55cfad84c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:59:53.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.442+0000 7f0e47fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cfad851c40 0x55cfad851700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:59:53.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.442+0000 7f0e4cd9c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55cfad857ca0 0x55cfad855050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:59:53.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.442+0000 7f0e47fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cfad851c40 0x55cfad851700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:44386/0 (socket says 172.21.15.82:44386) 2023-09-23T08:59:53.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.442+0000 7f0e47fff700 1 -- 172.21.15.82:0/3561638054 learned_addr learned my addr 172.21.15.82:0/3561638054 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:59:53.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.442+0000 7f0e477fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cfad857380 0x55cfad84c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47208/0 (socket says 172.21.15.82:47208) 2023-09-23T08:59:53.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.442+0000 7f0e47fff700 1 -- 172.21.15.82:0/3561638054 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55cfad857ca0 msgr2=0x55cfad855050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:59:53.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.442+0000 7f0e47fff700 1 --2- 172.21.15.82:0/3561638054 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55cfad857ca0 0x55cfad855050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:59:53.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.442+0000 7f0e47fff700 1 -- 172.21.15.82:0/3561638054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cfad857380 msgr2=0x55cfad84c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:59:53.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.442+0000 7f0e47fff700 1 --2- 172.21.15.82:0/3561638054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cfad857380 0x55cfad84c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:59:53.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.442+0000 7f0e47fff700 1 -- 172.21.15.82:0/3561638054 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cfad8722b0 con 0x55cfad851c40 2023-09-23T08:59:53.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.442+0000 7f0e477fe700 1 --2- 172.21.15.82:0/3561638054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cfad857380 0x55cfad84c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T08:59:53.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.443+0000 7f0e47fff700 1 --2- 172.21.15.82:0/3561638054 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cfad851c40 0x55cfad851700 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0e380958e0 tx=0x7f0e380951b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=474405b76897dd3e server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:59:53.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.443+0000 7f0e2effd700 1 -- 172.21.15.82:0/3561638054 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e380b0070 con 0x55cfad851c40 2023-09-23T08:59:53.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.443+0000 7f0e2effd700 1 -- 172.21.15.82:0/3561638054 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0e3809ae90 con 0x55cfad851c40 2023-09-23T08:59:53.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.443+0000 7f0e2effd700 1 -- 172.21.15.82:0/3561638054 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e380b8310 con 0x55cfad851c40 2023-09-23T08:59:53.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.444+0000 7f0e6213eb80 1 -- 172.21.15.82:0/3561638054 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cfad851c40 msgr2=0x55cfad851700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:59:53.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.444+0000 7f0e6213eb80 1 --2- 172.21.15.82:0/3561638054 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cfad851c40 0x55cfad851700 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0e380958e0 tx=0x7f0e380951b0 comp rx=0 tx=0).stop 2023-09-23T08:59:53.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.444+0000 7f0e6213eb80 1 -- 172.21.15.82:0/3561638054 shutdown_connections 2023-09-23T08:59:53.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.444+0000 7f0e6213eb80 1 --2- 172.21.15.82:0/3561638054 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55cfad857ca0 0x55cfad855050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:59:53.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.444+0000 7f0e6213eb80 1 --2- 172.21.15.82:0/3561638054 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cfad851c40 0x55cfad851700 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:59:53.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.444+0000 7f0e6213eb80 1 --2- 172.21.15.82:0/3561638054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cfad857380 0x55cfad84c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:59:53.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.444+0000 7f0e6213eb80 1 -- 172.21.15.82:0/3561638054 >> 172.21.15.82:0/3561638054 conn(0x55cfad7c60e0 msgr2=0x55cfad866ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:59:53.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.444+0000 7f0e6213eb80 1 -- 172.21.15.82:0/3561638054 shutdown_connections 2023-09-23T08:59:53.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.444+0000 7f0e6213eb80 1 -- 172.21.15.82:0/3561638054 wait complete. 2023-09-23T08:59:53.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.444+0000 7f0e6213eb80 1 -- start start 2023-09-23T08:59:53.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.444+0000 7f0e6213eb80 1 Processor -- start 2023-09-23T08:59:53.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.445+0000 7f0e6213eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cfad851c40 0x55cfad8543a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:59:53.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.445+0000 7f0e6213eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cfad857380 0x55cfad852da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:59:53.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.445+0000 7f0e6213eb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55cfad857ca0 0x55cfad8532e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:59:53.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.445+0000 7f0e6213eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cfad854ab0 con 0x55cfad857380 2023-09-23T08:59:53.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.445+0000 7f0e6213eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cfad853820 con 0x55cfad851c40 2023-09-23T08:59:53.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.445+0000 7f0e6213eb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cfad8539e0 con 0x55cfad857ca0 2023-09-23T08:59:53.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.445+0000 7f0e6213eb80 10 client.0 _ll_register_callbacks cb 0x7f0e40009360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T08:59:53.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.445+0000 7f0e477fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cfad857380 0x55cfad852da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:59:53.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.445+0000 7f0e47fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cfad851c40 0x55cfad8543a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:59:53.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.445+0000 7f0e477fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cfad857380 0x55cfad852da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47210/0 (socket says 172.21.15.82:47210) 2023-09-23T08:59:53.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.445+0000 7f0e477fe700 1 -- 172.21.15.82:0/2818228401 learned_addr learned my addr 172.21.15.82:0/2818228401 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T08:59:53.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.445+0000 7f0e4cd9c700 1 --2- 172.21.15.82:0/2818228401 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55cfad857ca0 0x55cfad8532e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:59:53.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.446+0000 7f0e47fff700 1 -- 172.21.15.82:0/2818228401 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55cfad857ca0 msgr2=0x55cfad8532e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:59:53.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.446+0000 7f0e47fff700 1 --2- 172.21.15.82:0/2818228401 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55cfad857ca0 0x55cfad8532e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:59:53.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.446+0000 7f0e47fff700 1 -- 172.21.15.82:0/2818228401 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cfad857380 msgr2=0x55cfad852da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T08:59:53.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.446+0000 7f0e47fff700 1 --2- 172.21.15.82:0/2818228401 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cfad857380 0x55cfad852da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:59:53.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.446+0000 7f0e47fff700 1 -- 172.21.15.82:0/2818228401 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e4810e040 con 0x55cfad851c40 2023-09-23T08:59:53.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.446+0000 7f0e477fe700 1 --2- 172.21.15.82:0/2818228401 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cfad857380 0x55cfad852da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T08:59:53.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.446+0000 7f0e47fff700 1 --2- 172.21.15.82:0/2818228401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cfad851c40 0x55cfad8543a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0e38095370 tx=0x7f0e38099570 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55f8222953367b47 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T08:59:53.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.446+0000 7f0e277fe700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-09-23T08:59:53.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.446+0000 7f0e277fe700 1 -- 172.21.15.82:0/2818228401 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e380b0070 con 0x55cfad851c40 2023-09-23T08:59:53.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.446+0000 7f0e277fe700 1 -- 172.21.15.82:0/2818228401 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f0e380a0c80 con 0x55cfad851c40 2023-09-23T08:59:53.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.446+0000 7f0e6213eb80 1 -- 172.21.15.82:0/2818228401 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cfad8448b0 con 0x55cfad851c40 2023-09-23T08:59:53.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.446+0000 7f0e277fe700 1 -- 172.21.15.82:0/2818228401 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0e3809cd20 con 0x55cfad851c40 2023-09-23T08:59:53.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.446+0000 7f0e6213eb80 10 client.25682 fetch_fsmap learned FSMap version 30 2023-09-23T08:59:53.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.447+0000 7f0e6213eb80 1 -- 172.21.15.82:0/2818228401 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x7f0e481a5820 con 0x55cfad851c40 2023-09-23T08:59:53.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.447+0000 7f0e277fe700 1 -- 172.21.15.82:0/2818228401 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55cfad8448b0 con 0x55cfad851c40 2023-09-23T08:59:53.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.447+0000 7f0e277fe700 1 -- 172.21.15.82:0/2818228401 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 30) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f0e380b3020 con 0x55cfad851c40 2023-09-23T08:59:53.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.447+0000 7f0e6213eb80 10 client.25682 fetch_fsmap finished waiting for FSMap version 30 2023-09-23T08:59:53.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.447+0000 7f0e6213eb80 10 client.25682 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T08:59:53.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.447+0000 7f0e6213eb80 20 client.25682 populate_metadata read hostname 'smithi082' 2023-09-23T08:59:53.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.447+0000 7f0e6213eb80 1 --2- 172.21.15.82:0/2818228401 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55cfad8c0010 0x55cfad8c2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T08:59:53.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.447+0000 7f0e6213eb80 4 client.25682 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T08:59:53.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.447+0000 7f0e6213eb80 1 -- 172.21.15.82:0/2818228401 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55cfad79c970 con 0x55cfad8c0010 2023-09-23T08:59:53.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.447+0000 7f0e477fe700 1 --2- 172.21.15.82:0/2818228401 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55cfad8c0010 0x55cfad8c2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T08:59:53.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.448+0000 7f0e477fe700 1 --2- 172.21.15.82:0/2818228401 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55cfad8c0010 0x55cfad8c2430 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8ae3dd2f400f5698 server_cookie=643f7d99f7a1cb97 in_seq=0 out_seq=0 2023-09-23T08:59:53.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.448+0000 7f0e277fe700 10 client.25682 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T08:59:53.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.448+0000 7f0e277fe700 1 -- 172.21.15.82:0/2818228401 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55cfad79c970 con 0x55cfad8c0010 2023-09-23T08:59:53.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.448+0000 7f0e277fe700 10 client.25682 handle_command_reply: tid=0 2023-09-23T08:59:53.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.448+0000 7f0e6213eb80 1 client.25682 shutdown 2023-09-23T08:59:53.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.448+0000 7f0e6213eb80 1 -- 172.21.15.82:0/2818228401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cfad851c40 msgr2=0x55cfad8543a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:59:53.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.448+0000 7f0e6213eb80 1 --2- 172.21.15.82:0/2818228401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cfad851c40 0x55cfad8543a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0e38095370 tx=0x7f0e38099570 comp rx=0 tx=0).stop 2023-09-23T08:59:53.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.448+0000 7f0e6213eb80 1 -- 172.21.15.82:0/2818228401 shutdown_connections 2023-09-23T08:59:53.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.448+0000 7f0e6213eb80 1 --2- 172.21.15.82:0/2818228401 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55cfad857ca0 0x55cfad8532e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:59:53.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.448+0000 7f0e6213eb80 1 --2- 172.21.15.82:0/2818228401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cfad851c40 0x55cfad8543a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:59:53.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.448+0000 7f0e6213eb80 1 --2- 172.21.15.82:0/2818228401 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55cfad8c0010 0x55cfad8c2430 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:59:53.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.448+0000 7f0e6213eb80 1 --2- 172.21.15.82:0/2818228401 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cfad857380 0x55cfad852da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:59:53.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.448+0000 7f0e277fe700 0 client.25682 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T08:59:53.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.448+0000 7f0e6213eb80 1 -- 172.21.15.82:0/2818228401 >> 172.21.15.82:0/2818228401 conn(0x55cfad7c60e0 msgr2=0x55cfad84c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:59:53.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.449+0000 7f0e6213eb80 1 -- 172.21.15.82:0/2818228401 shutdown_connections 2023-09-23T08:59:53.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.449+0000 7f0e6213eb80 1 -- 172.21.15.82:0/2818228401 wait complete. 2023-09-23T08:59:53.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.449+0000 7f0e6213eb80 20 client.25682 trim_cache size 0 max 16384 2023-09-23T08:59:53.458 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T08:59:53.458 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-23T08:59:53.458 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T08:59:53.458 INFO:teuthology.orchestra.run.smithi082.stdout: "6f0fe3a6-7212-425d-a0a6-f38e8b42ec13": { 2023-09-23T08:59:53.458 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T08:59:53.458 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "6f0fe3a6-7212-425d-a0a6-f38e8b42ec13", 2023-09-23T08:59:53.459 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T08:59:53.459 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T08:59:53.459 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T08:59:53.459 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T08:59:53.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.449+0000 7f0e4e7ff700 1 -- 172.21.15.82:0/2117891687 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f0e300a00c0 msgr2=0x7f0e300a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:59:53.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.449+0000 7f0e4e7ff700 1 --2- 172.21.15.82:0/2117891687 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f0e300a00c0 0x7f0e300a2580 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0e40009ec0 tx=0x7f0e4000b040 comp rx=0 tx=0).stop 2023-09-23T08:59:53.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.449+0000 7f0e4e7ff700 1 -- 172.21.15.82:0/2117891687 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0e48100870 msgr2=0x7f0e48072c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T08:59:53.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.449+0000 7f0e4e7ff700 1 --2- 172.21.15.82:0/2117891687 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0e48100870 0x7f0e48072c20 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f0e3800e9a0 tx=0x7f0e3800ecb0 comp rx=0 tx=0).stop 2023-09-23T08:59:53.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.449+0000 7f0e4e7ff700 1 -- 172.21.15.82:0/2117891687 shutdown_connections 2023-09-23T08:59:53.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.449+0000 7f0e4e7ff700 1 --2- 172.21.15.82:0/2117891687 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f0e300a00c0 0x7f0e300a2580 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:59:53.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.449+0000 7f0e4e7ff700 1 --2- 172.21.15.82:0/2117891687 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0e48106880 0x7f0e481a4a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:59:53.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.449+0000 7f0e4e7ff700 1 --2- 172.21.15.82:0/2117891687 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0e48100870 0x7f0e48072c20 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:59:53.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.449+0000 7f0e4e7ff700 1 --2- 172.21.15.82:0/2117891687 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e48101230 0x7f0e48073160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T08:59:53.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.449+0000 7f0e4e7ff700 1 -- 172.21.15.82:0/2117891687 >> 172.21.15.82:0/2117891687 conn(0x7f0e480fc3a0 msgr2=0x7f0e480fca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T08:59:53.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.450+0000 7f0e4e7ff700 1 -- 172.21.15.82:0/2117891687 shutdown_connections 2023-09-23T08:59:53.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T08:59:53.450+0000 7f0e4e7ff700 1 -- 172.21.15.82:0/2117891687 wait complete. 2023-09-23T08:59:53.470 INFO:tasks.cephfs.filesystem:scrub status for tag:6f0fe3a6-7212-425d-a0a6-f38e8b42ec13 - {'path': '/', 'tag': '6f0fe3a6-7212-425d-a0a6-f38e8b42ec13', 'options': 'recursive,force'} 2023-09-23T08:59:54.655 INFO:teuthology.orchestra.run.smithi082.stderr:9700000 of 50000000 tuples (19%) done (elapsed 149.40 s, remaining 620.69 s) 2023-09-23T08:59:54.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:59:54 smithi082 ceph-mon[97694]: pgmap v93: 97 pgs: 97 active+clean; 2.2 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 24 MiB/s wr, 26 op/s 2023-09-23T08:59:54.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:59:54 smithi161 ceph-mon[99580]: pgmap v93: 97 pgs: 97 active+clean; 2.2 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 24 MiB/s wr, 26 op/s 2023-09-23T08:59:55.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:59:54 smithi135 ceph-mon[99205]: pgmap v93: 97 pgs: 97 active+clean; 2.2 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 24 MiB/s wr, 26 op/s 2023-09-23T08:59:55.930 INFO:teuthology.orchestra.run.smithi082.stderr:9800000 of 50000000 tuples (19%) done (elapsed 150.67 s, remaining 618.06 s) 2023-09-23T08:59:56.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:59:56 smithi082 ceph-mon[97694]: pgmap v94: 97 pgs: 97 active+clean; 2.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 37 MiB/s wr, 39 op/s 2023-09-23T08:59:56.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:59:56 smithi161 ceph-mon[99580]: pgmap v94: 97 pgs: 97 active+clean; 2.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 37 MiB/s wr, 39 op/s 2023-09-23T08:59:57.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:59:56 smithi135 ceph-mon[99205]: pgmap v94: 97 pgs: 97 active+clean; 2.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 37 MiB/s wr, 39 op/s 2023-09-23T08:59:57.248 INFO:teuthology.orchestra.run.smithi082.stderr:9900000 of 50000000 tuples (19%) done (elapsed 151.99 s, remaining 615.64 s) 2023-09-23T08:59:58.507 INFO:teuthology.orchestra.run.smithi082.stderr:10000000 of 50000000 tuples (20%) done (elapsed 153.25 s, remaining 613.00 s) 2023-09-23T08:59:58.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 08:59:58 smithi082 ceph-mon[97694]: pgmap v95: 97 pgs: 97 active+clean; 2.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 MiB/s wr, 26 op/s 2023-09-23T08:59:58.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 08:59:58 smithi161 ceph-mon[99580]: pgmap v95: 97 pgs: 97 active+clean; 2.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 MiB/s wr, 26 op/s 2023-09-23T08:59:59.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 08:59:58 smithi135 ceph-mon[99205]: pgmap v95: 97 pgs: 97 active+clean; 2.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 MiB/s wr, 26 op/s 2023-09-23T08:59:59.674 INFO:teuthology.orchestra.run.smithi082.stderr:10100000 of 50000000 tuples (20%) done (elapsed 154.42 s, remaining 610.02 s) 2023-09-23T09:00:00.834 INFO:teuthology.orchestra.run.smithi082.stderr:10200000 of 50000000 tuples (20%) done (elapsed 155.58 s, remaining 607.05 s) 2023-09-23T09:00:00.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:00:00 smithi082 ceph-mon[97694]: pgmap v96: 97 pgs: 97 active+clean; 2.4 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 37 MiB/s wr, 57 op/s 2023-09-23T09:00:00.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:00:00 smithi082 ceph-mon[97694]: overall HEALTH_OK 2023-09-23T09:00:00.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:00:00 smithi161 ceph-mon[99580]: pgmap v96: 97 pgs: 97 active+clean; 2.4 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 37 MiB/s wr, 57 op/s 2023-09-23T09:00:00.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:00:00 smithi161 ceph-mon[99580]: overall HEALTH_OK 2023-09-23T09:00:01.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:00:00 smithi135 ceph-mon[99205]: pgmap v96: 97 pgs: 97 active+clean; 2.4 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 37 MiB/s wr, 57 op/s 2023-09-23T09:00:01.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:00:00 smithi135 ceph-mon[99205]: overall HEALTH_OK 2023-09-23T09:00:02.138 INFO:teuthology.orchestra.run.smithi082.stderr:10300000 of 50000000 tuples (20%) done (elapsed 156.88 s, remaining 604.68 s) 2023-09-23T09:00:02.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:00:02 smithi082 ceph-mon[97694]: pgmap v97: 97 pgs: 97 active+clean; 2.4 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 24 MiB/s wr, 44 op/s 2023-09-23T09:00:02.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:00:02 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:00:02.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:00:02 smithi161 ceph-mon[99580]: pgmap v97: 97 pgs: 97 active+clean; 2.4 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 24 MiB/s wr, 44 op/s 2023-09-23T09:00:02.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:00:02 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:00:03.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:00:02 smithi135 ceph-mon[99205]: pgmap v97: 97 pgs: 97 active+clean; 2.4 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 24 MiB/s wr, 44 op/s 2023-09-23T09:00:03.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:00:02 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:00:03.314 INFO:teuthology.orchestra.run.smithi082.stderr:10400000 of 50000000 tuples (20%) done (elapsed 158.06 s, remaining 601.83 s) 2023-09-23T09:00:04.497 INFO:teuthology.orchestra.run.smithi082.stderr:10500000 of 50000000 tuples (21%) done (elapsed 159.24 s, remaining 599.04 s) 2023-09-23T09:00:04.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:00:04 smithi082 ceph-mon[97694]: pgmap v98: 97 pgs: 97 active+clean; 2.4 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 24 MiB/s wr, 44 op/s 2023-09-23T09:00:04.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:00:04 smithi161 ceph-mon[99580]: pgmap v98: 97 pgs: 97 active+clean; 2.4 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 24 MiB/s wr, 44 op/s 2023-09-23T09:00:05.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:00:04 smithi135 ceph-mon[99205]: pgmap v98: 97 pgs: 97 active+clean; 2.4 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 24 MiB/s wr, 44 op/s 2023-09-23T09:00:05.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:00:05 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:00:05.853 INFO:teuthology.orchestra.run.smithi082.stderr:10600000 of 50000000 tuples (21%) done (elapsed 160.59 s, remaining 596.93 s) 2023-09-23T09:00:05.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:00:05 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:00:05.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:00:05 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:00:06.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:00:06 smithi082 ceph-mon[97694]: pgmap v99: 97 pgs: 97 active+clean; 2.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 37 MiB/s wr, 67 op/s 2023-09-23T09:00:06.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:00:06 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:00:06.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:00:06 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:00:06.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:00:06 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:00:06.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:00:06 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:00:06.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:00:06 smithi161 ceph-mon[99580]: pgmap v99: 97 pgs: 97 active+clean; 2.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 37 MiB/s wr, 67 op/s 2023-09-23T09:00:06.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:00:06 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:00:06.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:00:06 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:00:06.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:00:06 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:00:06.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:00:06 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:00:07.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:00:06 smithi135 ceph-mon[99205]: pgmap v99: 97 pgs: 97 active+clean; 2.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 37 MiB/s wr, 67 op/s 2023-09-23T09:00:07.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:00:06 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:00:07.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:00:06 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:00:07.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:00:06 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:00:07.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:00:06 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:00:07.065 INFO:teuthology.orchestra.run.smithi082.stderr:10700000 of 50000000 tuples (21%) done (elapsed 161.81 s, remaining 594.30 s) 2023-09-23T09:00:07.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:00:07 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:00:07.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:00:07 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:00:08.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:00:07 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:00:08.233 INFO:teuthology.orchestra.run.smithi082.stderr:10800000 of 50000000 tuples (21%) done (elapsed 162.98 s, remaining 591.54 s) 2023-09-23T09:00:08.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:00:08 smithi082 ceph-mon[97694]: pgmap v100: 97 pgs: 97 active+clean; 2.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 24 MiB/s wr, 54 op/s 2023-09-23T09:00:08.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:00:08 smithi161 ceph-mon[99580]: pgmap v100: 97 pgs: 97 active+clean; 2.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 24 MiB/s wr, 54 op/s 2023-09-23T09:00:09.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:00:08 smithi135 ceph-mon[99205]: pgmap v100: 97 pgs: 97 active+clean; 2.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 24 MiB/s wr, 54 op/s 2023-09-23T09:00:09.439 INFO:teuthology.orchestra.run.smithi082.stderr:10900000 of 50000000 tuples (21%) done (elapsed 164.18 s, remaining 588.94 s) 2023-09-23T09:00:10.615 INFO:teuthology.orchestra.run.smithi082.stderr:11000000 of 50000000 tuples (22%) done (elapsed 165.36 s, remaining 586.27 s) 2023-09-23T09:00:10.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:00:10 smithi082 ceph-mon[97694]: pgmap v101: 97 pgs: 97 active+clean; 2.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 37 MiB/s wr, 66 op/s 2023-09-23T09:00:10.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:00:10 smithi161 ceph-mon[99580]: pgmap v101: 97 pgs: 97 active+clean; 2.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 37 MiB/s wr, 66 op/s 2023-09-23T09:00:11.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:00:10 smithi135 ceph-mon[99205]: pgmap v101: 97 pgs: 97 active+clean; 2.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 37 MiB/s wr, 66 op/s 2023-09-23T09:00:11.897 INFO:teuthology.orchestra.run.smithi082.stderr:11100000 of 50000000 tuples (22%) done (elapsed 166.64 s, remaining 583.99 s) 2023-09-23T09:00:12.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:00:12 smithi161 ceph-mon[99580]: pgmap v102: 97 pgs: 97 active+clean; 2.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 25 MiB/s wr, 34 op/s 2023-09-23T09:00:12.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:00:12 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:00:13.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:00:12 smithi135 ceph-mon[99205]: pgmap v102: 97 pgs: 97 active+clean; 2.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 25 MiB/s wr, 34 op/s 2023-09-23T09:00:13.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:00:12 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:00:13.082 INFO:teuthology.orchestra.run.smithi082.stderr:11200000 of 50000000 tuples (22%) done (elapsed 167.82 s, remaining 581.39 s) 2023-09-23T09:00:13.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:00:12 smithi082 ceph-mon[97694]: pgmap v102: 97 pgs: 97 active+clean; 2.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 25 MiB/s wr, 34 op/s 2023-09-23T09:00:13.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:00:12 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:00:14.258 INFO:teuthology.orchestra.run.smithi082.stderr:11300000 of 50000000 tuples (22%) done (elapsed 169.00 s, remaining 578.79 s) 2023-09-23T09:00:14.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:00:14 smithi161 ceph-mon[99580]: pgmap v103: 97 pgs: 97 active+clean; 2.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 25 MiB/s wr, 34 op/s 2023-09-23T09:00:15.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:00:14 smithi135 ceph-mon[99205]: pgmap v103: 97 pgs: 97 active+clean; 2.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 25 MiB/s wr, 34 op/s 2023-09-23T09:00:15.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:00:14 smithi082 ceph-mon[97694]: pgmap v103: 97 pgs: 97 active+clean; 2.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 25 MiB/s wr, 34 op/s 2023-09-23T09:00:15.411 INFO:teuthology.orchestra.run.smithi082.stderr:11400000 of 50000000 tuples (22%) done (elapsed 170.15 s, remaining 576.13 s) 2023-09-23T09:00:16.834 INFO:teuthology.orchestra.run.smithi082.stderr:11500000 of 50000000 tuples (23%) done (elapsed 171.58 s, remaining 574.41 s) 2023-09-23T09:00:16.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:00:16 smithi161 ceph-mon[99580]: pgmap v104: 97 pgs: 97 active+clean; 2.7 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 37 MiB/s wr, 44 op/s 2023-09-23T09:00:17.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:00:16 smithi135 ceph-mon[99205]: pgmap v104: 97 pgs: 97 active+clean; 2.7 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 37 MiB/s wr, 44 op/s 2023-09-23T09:00:17.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:00:16 smithi082 ceph-mon[97694]: pgmap v104: 97 pgs: 97 active+clean; 2.7 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 37 MiB/s wr, 44 op/s 2023-09-23T09:00:18.014 INFO:teuthology.orchestra.run.smithi082.stderr:11600000 of 50000000 tuples (23%) done (elapsed 172.76 s, remaining 571.88 s) 2023-09-23T09:00:18.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:00:18 smithi161 ceph-mon[99580]: pgmap v105: 97 pgs: 97 active+clean; 2.7 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 25 MiB/s wr, 21 op/s 2023-09-23T09:00:19.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:00:18 smithi135 ceph-mon[99205]: pgmap v105: 97 pgs: 97 active+clean; 2.7 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 25 MiB/s wr, 21 op/s 2023-09-23T09:00:19.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:00:18 smithi082 ceph-mon[97694]: pgmap v105: 97 pgs: 97 active+clean; 2.7 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 25 MiB/s wr, 21 op/s 2023-09-23T09:00:19.205 INFO:teuthology.orchestra.run.smithi082.stderr:11700000 of 50000000 tuples (23%) done (elapsed 173.95 s, remaining 569.41 s) 2023-09-23T09:00:20.474 INFO:teuthology.orchestra.run.smithi082.stderr:11800000 of 50000000 tuples (23%) done (elapsed 175.22 s, remaining 567.23 s) 2023-09-23T09:00:20.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:00:20 smithi161 ceph-mon[99580]: pgmap v106: 97 pgs: 97 active+clean; 2.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 37 MiB/s wr, 31 op/s 2023-09-23T09:00:21.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:00:20 smithi135 ceph-mon[99205]: pgmap v106: 97 pgs: 97 active+clean; 2.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 37 MiB/s wr, 31 op/s 2023-09-23T09:00:21.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:00:20 smithi082 ceph-mon[97694]: pgmap v106: 97 pgs: 97 active+clean; 2.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 37 MiB/s wr, 31 op/s 2023-09-23T09:00:21.642 INFO:teuthology.orchestra.run.smithi082.stderr:11900000 of 50000000 tuples (23%) done (elapsed 176.38 s, remaining 564.72 s) 2023-09-23T09:00:22.821 INFO:teuthology.orchestra.run.smithi082.stderr:12000000 of 50000000 tuples (24%) done (elapsed 177.56 s, remaining 562.28 s) 2023-09-23T09:00:22.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:00:22 smithi161 ceph-mon[99580]: pgmap v107: 97 pgs: 97 active+clean; 2.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 24 MiB/s wr, 20 op/s 2023-09-23T09:00:23.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:00:22 smithi135 ceph-mon[99205]: pgmap v107: 97 pgs: 97 active+clean; 2.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 24 MiB/s wr, 20 op/s 2023-09-23T09:00:23.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:00:22 smithi082 ceph-mon[97694]: pgmap v107: 97 pgs: 97 active+clean; 2.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 24 MiB/s wr, 20 op/s 2023-09-23T09:00:23.471 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:00:23.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.696+0000 7f9036bff700 1 -- 172.21.15.82:0/3809918072 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9030100870 msgr2=0x7f9030100cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:00:23.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.696+0000 7f9036bff700 1 --2- 172.21.15.82:0/3809918072 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9030100870 0x7f9030100cf0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f901c009990 tx=0x7f901c009ca0 comp rx=0 tx=0).stop 2023-09-23T09:00:23.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.696+0000 7f9036bff700 1 -- 172.21.15.82:0/3809918072 shutdown_connections 2023-09-23T09:00:23.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.696+0000 7f9036bff700 1 --2- 172.21.15.82:0/3809918072 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9030101230 0x7f903010d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:00:23.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.696+0000 7f9036bff700 1 --2- 172.21.15.82:0/3809918072 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9030106880 0x7f9030106c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:00:23.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.696+0000 7f9036bff700 1 --2- 172.21.15.82:0/3809918072 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9030100870 0x7f9030100cf0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:00:23.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.696+0000 7f9036bff700 1 -- 172.21.15.82:0/3809918072 >> 172.21.15.82:0/3809918072 conn(0x7f90300fc3a0 msgr2=0x7f90300fe7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:00:23.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.696+0000 7f9036bff700 1 -- 172.21.15.82:0/3809918072 shutdown_connections 2023-09-23T09:00:23.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.696+0000 7f9036bff700 1 -- 172.21.15.82:0/3809918072 wait complete. 2023-09-23T09:00:23.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.698+0000 7f9036bff700 1 Processor -- start 2023-09-23T09:00:23.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.698+0000 7f9036bff700 1 -- start start 2023-09-23T09:00:23.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.698+0000 7f9036bff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9030100870 0x7f9030072c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:00:23.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.699+0000 7f9036bff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9030101230 0x7f9030073160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:00:23.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.699+0000 7f9036bff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9030106880 0x7f90301a4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:00:23.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.699+0000 7f9036bff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9030073990 con 0x7f9030101230 2023-09-23T09:00:23.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.699+0000 7f9036bff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90301a4fe0 con 0x7f9030100870 2023-09-23T09:00:23.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.699+0000 7f9036bff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90301a5120 con 0x7f9030106880 2023-09-23T09:00:23.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.699+0000 7f903499b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9030100870 0x7f9030072c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:00:23.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.699+0000 7f903499b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9030100870 0x7f9030072c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:58940/0 (socket says 172.21.15.82:58940) 2023-09-23T09:00:23.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.699+0000 7f903499b700 1 -- 172.21.15.82:0/832872143 learned_addr learned my addr 172.21.15.82:0/832872143 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:00:23.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.699+0000 7f903519c700 1 --2- 172.21.15.82:0/832872143 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9030106880 0x7f90301a4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:00:23.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.699+0000 7f902ffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9030101230 0x7f9030073160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:00:23.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.699+0000 7f903499b700 1 -- 172.21.15.82:0/832872143 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9030106880 msgr2=0x7f90301a4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:00:23.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.699+0000 7f903499b700 1 --2- 172.21.15.82:0/832872143 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9030106880 0x7f90301a4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:00:23.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.699+0000 7f903499b700 1 -- 172.21.15.82:0/832872143 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9030101230 msgr2=0x7f9030073160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:00:23.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.699+0000 7f903499b700 1 --2- 172.21.15.82:0/832872143 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9030101230 0x7f9030073160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:00:23.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.699+0000 7f903499b700 1 -- 172.21.15.82:0/832872143 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f901c0095f0 con 0x7f9030100870 2023-09-23T09:00:23.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.699+0000 7f903519c700 1 --2- 172.21.15.82:0/832872143 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9030106880 0x7f90301a4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:00:23.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.700+0000 7f903499b700 1 --2- 172.21.15.82:0/832872143 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9030100870 0x7f9030072c20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f902400e9a0 tx=0x7f902400ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:00:23.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.700+0000 7f902dffb700 1 -- 172.21.15.82:0/832872143 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9024009790 con 0x7f9030100870 2023-09-23T09:00:23.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.700+0000 7f9036bff700 1 -- 172.21.15.82:0/832872143 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90301a5380 con 0x7f9030100870 2023-09-23T09:00:23.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.700+0000 7f902dffb700 1 -- 172.21.15.82:0/832872143 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9024010430 con 0x7f9030100870 2023-09-23T09:00:23.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.700+0000 7f902dffb700 1 -- 172.21.15.82:0/832872143 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f902400cea0 con 0x7f9030100870 2023-09-23T09:00:23.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.700+0000 7f9036bff700 1 -- 172.21.15.82:0/832872143 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90301a58b0 con 0x7f9030100870 2023-09-23T09:00:23.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.704+0000 7f902dffb700 1 -- 172.21.15.82:0/832872143 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f90240105a0 con 0x7f9030100870 2023-09-23T09:00:23.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.704+0000 7f904a445b80 1 Processor -- start 2023-09-23T09:00:23.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.705+0000 7f904a445b80 1 -- start start 2023-09-23T09:00:23.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.705+0000 7f904a445b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56068dd06380 0x56068dd06760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:00:23.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.705+0000 7f904a445b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56068dd06ca0 0x56068dd00700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:00:23.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.705+0000 7f904a445b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56068dd00c40 0x56068dd010a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:00:23.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.705+0000 7f904a445b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56068dc687b0 con 0x56068dd00c40 2023-09-23T09:00:23.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.705+0000 7f904a445b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56068dc59780 con 0x56068dd06380 2023-09-23T09:00:23.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.705+0000 7f904a445b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x56068dc570a0 con 0x56068dd06ca0 2023-09-23T09:00:23.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.705+0000 7f902dffb700 1 --2- 172.21.15.82:0/832872143 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f90200a0140 0x7f90200a2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:00:23.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.705+0000 7f903499b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56068dd06ca0 0x56068dd00700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:00:23.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.706+0000 7f903499b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56068dd06ca0 0x56068dd00700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:52570/0 (socket says 172.21.15.82:52570) 2023-09-23T09:00:23.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.706+0000 7f903499b700 1 -- 172.21.15.82:0/1525553255 learned_addr learned my addr 172.21.15.82:0/1525553255 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:00:23.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.706+0000 7f902ffff700 1 --2- 172.21.15.82:0/1525553255 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56068dd00c40 0x56068dd010a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:00:23.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.706+0000 7f903519c700 1 --2- 172.21.15.82:0/1525553255 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56068dd06380 0x56068dd06760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:00:23.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.706+0000 7f902dffb700 1 -- 172.21.15.82:0/832872143 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f9024014070 con 0x7f9030100870 2023-09-23T09:00:23.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.706+0000 7f903519c700 1 --2- 172.21.15.82:0/832872143 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f90200a0140 0x7f90200a2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:00:23.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.706+0000 7f903499b700 1 -- 172.21.15.82:0/1525553255 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56068dd06380 msgr2=0x56068dd06760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:00:23.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.706+0000 7f903499b700 1 --2- 172.21.15.82:0/1525553255 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56068dd06380 0x56068dd06760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:00:23.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.706+0000 7f903499b700 1 -- 172.21.15.82:0/1525553255 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56068dd00c40 msgr2=0x56068dd010a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:00:23.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.706+0000 7f903499b700 1 --2- 172.21.15.82:0/1525553255 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56068dd00c40 0x56068dd010a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:00:23.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.706+0000 7f903499b700 1 -- 172.21.15.82:0/1525553255 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56068dad2630 con 0x56068dd06ca0 2023-09-23T09:00:23.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.706+0000 7f903519c700 1 --2- 172.21.15.82:0/1525553255 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56068dd06380 0x56068dd06760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:00:23.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.706+0000 7f903499b700 1 --2- 172.21.15.82:0/1525553255 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56068dd06ca0 0x56068dd00700 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f90240a06c0 tx=0x7f902406ae50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b114d5a7d95d7d65 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:00:23.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.707+0000 7f901affd700 1 -- 172.21.15.82:0/1525553255 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9024010880 con 0x56068dd06ca0 2023-09-23T09:00:23.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.707+0000 7f901affd700 1 -- 172.21.15.82:0/1525553255 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f90240994e0 con 0x56068dd06ca0 2023-09-23T09:00:23.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.707+0000 7f901affd700 1 -- 172.21.15.82:0/1525553255 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90240992a0 con 0x56068dd06ca0 2023-09-23T09:00:23.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.707+0000 7f903519c700 1 --2- 172.21.15.82:0/832872143 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f90200a0140 0x7f90200a2600 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9028009fd0 tx=0x7f902800b040 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:00:23.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.707+0000 7f904a445b80 1 -- 172.21.15.82:0/1525553255 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56068dd06ca0 msgr2=0x56068dd00700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:00:23.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.707+0000 7f904a445b80 1 --2- 172.21.15.82:0/1525553255 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56068dd06ca0 0x56068dd00700 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f90240a06c0 tx=0x7f902406ae50 comp rx=0 tx=0).stop 2023-09-23T09:00:23.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.708+0000 7f904a445b80 1 -- 172.21.15.82:0/1525553255 shutdown_connections 2023-09-23T09:00:23.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.708+0000 7f904a445b80 1 --2- 172.21.15.82:0/1525553255 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56068dd00c40 0x56068dd010a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:00:23.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.708+0000 7f904a445b80 1 --2- 172.21.15.82:0/1525553255 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56068dd06380 0x56068dd06760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:00:23.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.708+0000 7f904a445b80 1 --2- 172.21.15.82:0/1525553255 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56068dd06ca0 0x56068dd00700 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:00:23.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.708+0000 7f904a445b80 1 -- 172.21.15.82:0/1525553255 >> 172.21.15.82:0/1525553255 conn(0x56068dc750e0 msgr2=0x56068dcfb410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:00:23.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.708+0000 7f904a445b80 1 -- 172.21.15.82:0/1525553255 shutdown_connections 2023-09-23T09:00:23.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.708+0000 7f904a445b80 1 -- 172.21.15.82:0/1525553255 wait complete. 2023-09-23T09:00:23.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.708+0000 7f904a445b80 1 -- start start 2023-09-23T09:00:23.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.709+0000 7f904a445b80 1 Processor -- start 2023-09-23T09:00:23.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.709+0000 7f904a445b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56068dd00c40 0x56068dd09f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:00:23.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.709+0000 7f904a445b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56068dd06380 0x56068dd0a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:00:23.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.709+0000 7f904a445b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56068dd06ca0 0x56068dd0a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:00:23.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.709+0000 7f904a445b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56068dc52990 con 0x56068dd06ca0 2023-09-23T09:00:23.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.709+0000 7f904a445b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56068dbf0bb0 con 0x56068dd06380 2023-09-23T09:00:23.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.709+0000 7f904a445b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x56068dbf08b0 con 0x56068dd00c40 2023-09-23T09:00:23.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.709+0000 7f904a445b80 10 client.0 _ll_register_callbacks cb 0x56068db3aa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:00:23.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.709+0000 7f903519c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56068dd06ca0 0x56068dd0a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:00:23.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.709+0000 7f903499b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56068dd00c40 0x56068dd09f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:00:23.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.709+0000 7f903499b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56068dd00c40 0x56068dd09f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:52582/0 (socket says 172.21.15.82:52582) 2023-09-23T09:00:23.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.709+0000 7f902ffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56068dd06380 0x56068dd0a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:00:23.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.709+0000 7f903499b700 1 -- 172.21.15.82:0/3083522068 learned_addr learned my addr 172.21.15.82:0/3083522068 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:00:23.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.710+0000 7f903499b700 1 -- 172.21.15.82:0/3083522068 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56068dd06380 msgr2=0x56068dd0a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:00:23.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.710+0000 7f903499b700 1 --2- 172.21.15.82:0/3083522068 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56068dd06380 0x56068dd0a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:00:23.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.710+0000 7f903499b700 1 -- 172.21.15.82:0/3083522068 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56068dd06ca0 msgr2=0x56068dd0a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:00:23.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.710+0000 7f903499b700 1 --2- 172.21.15.82:0/3083522068 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56068dd06ca0 0x56068dd0a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:00:23.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.710+0000 7f903499b700 1 -- 172.21.15.82:0/3083522068 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90301a58b0 con 0x56068dd00c40 2023-09-23T09:00:23.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.710+0000 7f903499b700 1 --2- 172.21.15.82:0/3083522068 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56068dd00c40 0x56068dd09f30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f902400c2d0 tx=0x7f9024098580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f0970c3ad6ef416 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:00:23.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.710+0000 7f900ffff700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T09:00:23.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.710+0000 7f900ffff700 1 -- 172.21.15.82:0/3083522068 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9024010880 con 0x56068dd00c40 2023-09-23T09:00:23.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.710+0000 7f900ffff700 1 -- 172.21.15.82:0/3083522068 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f902409cc10 con 0x56068dd00c40 2023-09-23T09:00:23.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.710+0000 7f904a445b80 1 -- 172.21.15.82:0/3083522068 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56068dcd01c0 con 0x56068dd00c40 2023-09-23T09:00:23.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.711+0000 7f900ffff700 1 -- 172.21.15.82:0/3083522068 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f90240994e0 con 0x56068dd00c40 2023-09-23T09:00:23.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.711+0000 7f904a445b80 10 client.25741 fetch_fsmap learned FSMap version 34 2023-09-23T09:00:23.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.711+0000 7f904a445b80 1 -- 172.21.15.82:0/3083522068 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x56068da7ede0 con 0x56068dd00c40 2023-09-23T09:00:23.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.711+0000 7f900ffff700 1 -- 172.21.15.82:0/3083522068 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56068dcd01c0 con 0x56068dd00c40 2023-09-23T09:00:23.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.711+0000 7f900ffff700 1 -- 172.21.15.82:0/3083522068 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 34) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f9024094c60 con 0x56068dd00c40 2023-09-23T09:00:23.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.711+0000 7f904a445b80 10 client.25741 fetch_fsmap finished waiting for FSMap version 34 2023-09-23T09:00:23.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.711+0000 7f904a445b80 10 client.25741 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:00:23.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.711+0000 7f904a445b80 20 client.25741 populate_metadata read hostname 'smithi082' 2023-09-23T09:00:23.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.711+0000 7f904a445b80 1 --2- 172.21.15.82:0/3083522068 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56068dd1a330 0x56068dd1c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:00:23.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.711+0000 7f904a445b80 4 client.25741 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:00:23.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.711+0000 7f904a445b80 1 -- 172.21.15.82:0/3083522068 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56068dbf8ba0 con 0x56068dd1a330 2023-09-23T09:00:23.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.711+0000 7f902ffff700 1 --2- 172.21.15.82:0/3083522068 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56068dd1a330 0x56068dd1c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:00:23.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.712+0000 7f902ffff700 1 --2- 172.21.15.82:0/3083522068 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56068dd1a330 0x56068dd1c720 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ecda32bf1f0e2d4c server_cookie=68d598001a87a3c7 in_seq=0 out_seq=0 2023-09-23T09:00:23.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.712+0000 7f900ffff700 10 client.25741 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:00:23.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.713+0000 7f900ffff700 1 -- 172.21.15.82:0/3083522068 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56068dbf8ba0 con 0x56068dd1a330 2023-09-23T09:00:23.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.713+0000 7f900ffff700 10 client.25741 handle_command_reply: tid=0 2023-09-23T09:00:23.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.713+0000 7f904a445b80 1 client.25741 shutdown 2023-09-23T09:00:23.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.713+0000 7f904a445b80 1 -- 172.21.15.82:0/3083522068 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56068dd00c40 msgr2=0x56068dd09f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:00:23.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.713+0000 7f904a445b80 1 --2- 172.21.15.82:0/3083522068 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56068dd00c40 0x56068dd09f30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f902400c2d0 tx=0x7f9024098580 comp rx=0 tx=0).stop 2023-09-23T09:00:23.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.713+0000 7f904a445b80 1 -- 172.21.15.82:0/3083522068 shutdown_connections 2023-09-23T09:00:23.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.713+0000 7f904a445b80 1 --2- 172.21.15.82:0/3083522068 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56068dd1a330 0x56068dd1c720 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:00:23.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.713+0000 7f904a445b80 1 --2- 172.21.15.82:0/3083522068 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56068dd06ca0 0x56068dd0a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:00:23.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.713+0000 7f904a445b80 1 --2- 172.21.15.82:0/3083522068 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56068dd00c40 0x56068dd09f30 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:00:23.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.713+0000 7f900ffff700 0 client.25741 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:00:23.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.713+0000 7f904a445b80 1 --2- 172.21.15.82:0/3083522068 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56068dd06380 0x56068dd0a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:00:23.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.713+0000 7f904a445b80 1 -- 172.21.15.82:0/3083522068 >> 172.21.15.82:0/3083522068 conn(0x56068dc750e0 msgr2=0x56068dcf52b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:00:23.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.713+0000 7f904a445b80 1 -- 172.21.15.82:0/3083522068 shutdown_connections 2023-09-23T09:00:23.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.713+0000 7f904a445b80 1 -- 172.21.15.82:0/3083522068 wait complete. 2023-09-23T09:00:23.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.714+0000 7f904a445b80 20 client.25741 trim_cache size 0 max 16384 2023-09-23T09:00:23.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.736+0000 7f904a445b80 1 Processor -- start 2023-09-23T09:00:23.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.736+0000 7f904a445b80 1 -- start start 2023-09-23T09:00:23.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.736+0000 7f904a445b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56068dd00c40 0x56068dd00700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:00:23.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.736+0000 7f904a445b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56068dd06380 0x56068dd11730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:00:23.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.736+0000 7f904a445b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56068dd06ca0 0x56068dd056e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:00:23.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.736+0000 7f904a445b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56068dad4920 con 0x56068dd06ca0 2023-09-23T09:00:23.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.736+0000 7f904a445b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56068dcf7cf0 con 0x56068dd00c40 2023-09-23T09:00:23.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.736+0000 7f904a445b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x56068dcfc430 con 0x56068dd06380 2023-09-23T09:00:23.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.737+0000 7f903519c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56068dd06ca0 0x56068dd056e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:00:23.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.737+0000 7f902ffff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56068dd06380 0x56068dd11730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:00:23.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.737+0000 7f902ffff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56068dd06380 0x56068dd11730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:52596/0 (socket says 172.21.15.82:52596) 2023-09-23T09:00:23.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.737+0000 7f903499b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56068dd00c40 0x56068dd00700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:00:23.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.737+0000 7f902ffff700 1 -- 172.21.15.82:0/2877942978 learned_addr learned my addr 172.21.15.82:0/2877942978 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:00:23.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.737+0000 7f902ffff700 1 -- 172.21.15.82:0/2877942978 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56068dd00c40 msgr2=0x56068dd00700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:00:23.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.737+0000 7f902ffff700 1 --2- 172.21.15.82:0/2877942978 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56068dd00c40 0x56068dd00700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:00:23.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.737+0000 7f902ffff700 1 -- 172.21.15.82:0/2877942978 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56068dd06ca0 msgr2=0x56068dd056e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:00:23.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.737+0000 7f902ffff700 1 --2- 172.21.15.82:0/2877942978 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56068dd06ca0 0x56068dd056e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:00:23.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.737+0000 7f902ffff700 1 -- 172.21.15.82:0/2877942978 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56068da67c60 con 0x56068dd06380 2023-09-23T09:00:23.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.737+0000 7f903519c700 1 --2- 172.21.15.82:0/2877942978 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56068dd06ca0 0x56068dd056e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:00:23.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.737+0000 7f903499b700 1 --2- 172.21.15.82:0/2877942978 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56068dd00c40 0x56068dd00700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:00:23.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.738+0000 7f902ffff700 1 --2- 172.21.15.82:0/2877942978 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56068dd06380 0x56068dd11730 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f901c009990 tx=0x7f901c00b260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc2a68a797d40d5c server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:00:23.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.738+0000 7f901b7fe700 1 -- 172.21.15.82:0/2877942978 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f901c02a070 con 0x56068dd06380 2023-09-23T09:00:23.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.738+0000 7f901b7fe700 1 -- 172.21.15.82:0/2877942978 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f901c02e070 con 0x56068dd06380 2023-09-23T09:00:23.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.738+0000 7f901b7fe700 1 -- 172.21.15.82:0/2877942978 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f901c01d040 con 0x56068dd06380 2023-09-23T09:00:23.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.739+0000 7f904a445b80 1 -- 172.21.15.82:0/2877942978 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56068dd06380 msgr2=0x56068dd11730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:00:23.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.739+0000 7f904a445b80 1 --2- 172.21.15.82:0/2877942978 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56068dd06380 0x56068dd11730 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f901c009990 tx=0x7f901c00b260 comp rx=0 tx=0).stop 2023-09-23T09:00:23.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.739+0000 7f904a445b80 1 -- 172.21.15.82:0/2877942978 shutdown_connections 2023-09-23T09:00:23.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.739+0000 7f904a445b80 1 --2- 172.21.15.82:0/2877942978 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56068dd06ca0 0x56068dd056e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:00:23.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.739+0000 7f904a445b80 1 --2- 172.21.15.82:0/2877942978 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56068dd00c40 0x56068dd00700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:00:23.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.739+0000 7f904a445b80 1 --2- 172.21.15.82:0/2877942978 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56068dd06380 0x56068dd11730 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:00:23.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.739+0000 7f904a445b80 1 -- 172.21.15.82:0/2877942978 >> 172.21.15.82:0/2877942978 conn(0x56068dc750e0 msgr2=0x56068dd04fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:00:23.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.739+0000 7f904a445b80 1 -- 172.21.15.82:0/2877942978 shutdown_connections 2023-09-23T09:00:23.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.739+0000 7f904a445b80 1 -- 172.21.15.82:0/2877942978 wait complete. 2023-09-23T09:00:23.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.740+0000 7f904a445b80 1 -- start start 2023-09-23T09:00:23.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.740+0000 7f904a445b80 1 Processor -- start 2023-09-23T09:00:23.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.740+0000 7f904a445b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56068dd00c40 0x56068dd11750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:00:23.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.740+0000 7f904a445b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56068dd06380 0x56068dd0db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:00:23.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.740+0000 7f904a445b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56068dd06ca0 0x56068dd0e270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:00:23.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.740+0000 7f904a445b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56068dd0e9b0 con 0x56068dd06ca0 2023-09-23T09:00:23.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.740+0000 7f904a445b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56068dd6e110 con 0x56068dd00c40 2023-09-23T09:00:23.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.740+0000 7f904a445b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x56068dd6e250 con 0x56068dd06380 2023-09-23T09:00:23.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.741+0000 7f904a445b80 10 client.0 _ll_register_callbacks cb 0x7f90280097c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:00:23.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.741+0000 7f903499b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56068dd00c40 0x56068dd11750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:00:23.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.741+0000 7f902ffff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56068dd06380 0x56068dd0db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:00:23.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.741+0000 7f903519c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56068dd06ca0 0x56068dd0e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:00:23.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.741+0000 7f903499b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56068dd00c40 0x56068dd11750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:58964/0 (socket says 172.21.15.82:58964) 2023-09-23T09:00:23.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.741+0000 7f903499b700 1 -- 172.21.15.82:0/192072315 learned_addr learned my addr 172.21.15.82:0/192072315 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:00:23.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.741+0000 7f903499b700 1 -- 172.21.15.82:0/192072315 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56068dd06380 msgr2=0x56068dd0db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:00:23.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.741+0000 7f903499b700 1 --2- 172.21.15.82:0/192072315 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56068dd06380 0x56068dd0db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:00:23.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.741+0000 7f903499b700 1 -- 172.21.15.82:0/192072315 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56068dd06ca0 msgr2=0x56068dd0e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:00:23.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.741+0000 7f903499b700 1 --2- 172.21.15.82:0/192072315 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56068dd06ca0 0x56068dd0e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:00:23.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.741+0000 7f903499b700 1 -- 172.21.15.82:0/192072315 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56068da7ede0 con 0x56068dd00c40 2023-09-23T09:00:23.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.741+0000 7f903519c700 1 --2- 172.21.15.82:0/192072315 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56068dd06ca0 0x56068dd0e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:00:23.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.741+0000 7f903499b700 1 --2- 172.21.15.82:0/192072315 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56068dd00c40 0x56068dd11750 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9024097130 tx=0x7f9024005b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=176f688848b26aa6 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:00:23.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.741+0000 7f900ffff700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-09-23T09:00:23.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.742+0000 7f900ffff700 1 -- 172.21.15.82:0/192072315 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9024010880 con 0x56068dd00c40 2023-09-23T09:00:23.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.742+0000 7f900ffff700 1 -- 172.21.15.82:0/192072315 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f90240b0030 con 0x56068dd00c40 2023-09-23T09:00:23.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.742+0000 7f904a445b80 1 -- 172.21.15.82:0/192072315 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56068dcf38b0 con 0x56068dd00c40 2023-09-23T09:00:23.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.742+0000 7f900ffff700 1 -- 172.21.15.82:0/192072315 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f90240994e0 con 0x56068dd00c40 2023-09-23T09:00:23.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.742+0000 7f904a445b80 10 client.25700 fetch_fsmap learned FSMap version 34 2023-09-23T09:00:23.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.742+0000 7f904a445b80 1 -- 172.21.15.82:0/192072315 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x7f902800e5d0 con 0x56068dd00c40 2023-09-23T09:00:23.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.742+0000 7f900ffff700 1 -- 172.21.15.82:0/192072315 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56068dcf38b0 con 0x56068dd00c40 2023-09-23T09:00:23.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.742+0000 7f900ffff700 1 -- 172.21.15.82:0/192072315 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 34) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f90240c8050 con 0x56068dd00c40 2023-09-23T09:00:23.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.742+0000 7f904a445b80 10 client.25700 fetch_fsmap finished waiting for FSMap version 34 2023-09-23T09:00:23.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.742+0000 7f904a445b80 10 client.25700 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:00:23.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.742+0000 7f904a445b80 20 client.25700 populate_metadata read hostname 'smithi082' 2023-09-23T09:00:23.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.742+0000 7f904a445b80 1 --2- 172.21.15.82:0/192072315 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56068dd6f510 0x56068dd71930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:00:23.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.743+0000 7f904a445b80 4 client.25700 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:00:23.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.743+0000 7f904a445b80 1 -- 172.21.15.82:0/192072315 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x56068dc4b970 con 0x56068dd6f510 2023-09-23T09:00:23.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.743+0000 7f902ffff700 1 --2- 172.21.15.82:0/192072315 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56068dd6f510 0x56068dd71930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:00:23.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.743+0000 7f902ffff700 1 --2- 172.21.15.82:0/192072315 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56068dd6f510 0x56068dd71930 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c7252b831605f9a1 server_cookie=882fa90cc14a9a59 in_seq=0 out_seq=0 2023-09-23T09:00:23.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.743+0000 7f900ffff700 10 client.25700 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:00:23.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.744+0000 7f900ffff700 1 -- 172.21.15.82:0/192072315 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x56068dc4b970 con 0x56068dd6f510 2023-09-23T09:00:23.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.744+0000 7f900ffff700 10 client.25700 handle_command_reply: tid=0 2023-09-23T09:00:23.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.744+0000 7f904a445b80 1 client.25700 shutdown 2023-09-23T09:00:23.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.744+0000 7f904a445b80 1 -- 172.21.15.82:0/192072315 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56068dd00c40 msgr2=0x56068dd11750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:00:23.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.744+0000 7f904a445b80 1 --2- 172.21.15.82:0/192072315 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56068dd00c40 0x56068dd11750 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9024097130 tx=0x7f9024005b40 comp rx=0 tx=0).stop 2023-09-23T09:00:23.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.744+0000 7f904a445b80 1 -- 172.21.15.82:0/192072315 shutdown_connections 2023-09-23T09:00:23.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.744+0000 7f904a445b80 1 --2- 172.21.15.82:0/192072315 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56068dd6f510 0x56068dd71930 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:00:23.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.744+0000 7f904a445b80 1 --2- 172.21.15.82:0/192072315 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56068dd06ca0 0x56068dd0e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:00:23.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.744+0000 7f904a445b80 1 --2- 172.21.15.82:0/192072315 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56068dd00c40 0x56068dd11750 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:00:23.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.744+0000 7f900ffff700 0 client.25700 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:00:23.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.744+0000 7f904a445b80 1 --2- 172.21.15.82:0/192072315 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56068dd06380 0x56068dd0db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:00:23.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.744+0000 7f904a445b80 1 -- 172.21.15.82:0/192072315 >> 172.21.15.82:0/192072315 conn(0x56068dc750e0 msgr2=0x56068dd0a4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:00:23.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.744+0000 7f904a445b80 1 -- 172.21.15.82:0/192072315 shutdown_connections 2023-09-23T09:00:23.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.744+0000 7f904a445b80 1 -- 172.21.15.82:0/192072315 wait complete. 2023-09-23T09:00:23.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.744+0000 7f904a445b80 20 client.25700 trim_cache size 0 max 16384 2023-09-23T09:00:23.756 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:00:23.756 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-23T09:00:23.756 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:00:23.757 INFO:teuthology.orchestra.run.smithi082.stdout: "6f0fe3a6-7212-425d-a0a6-f38e8b42ec13": { 2023-09-23T09:00:23.757 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:00:23.757 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "6f0fe3a6-7212-425d-a0a6-f38e8b42ec13", 2023-09-23T09:00:23.757 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:00:23.757 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:00:23.757 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:00:23.757 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:00:23.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.745+0000 7f9036bff700 1 -- 172.21.15.82:0/832872143 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f90200a0140 msgr2=0x7f90200a2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:00:23.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.745+0000 7f9036bff700 1 --2- 172.21.15.82:0/832872143 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f90200a0140 0x7f90200a2600 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9028009fd0 tx=0x7f902800b040 comp rx=0 tx=0).stop 2023-09-23T09:00:23.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.745+0000 7f9036bff700 1 -- 172.21.15.82:0/832872143 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9030100870 msgr2=0x7f9030072c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:00:23.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.745+0000 7f9036bff700 1 --2- 172.21.15.82:0/832872143 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9030100870 0x7f9030072c20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f902400e9a0 tx=0x7f902400ecb0 comp rx=0 tx=0).stop 2023-09-23T09:00:23.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.745+0000 7f9036bff700 1 -- 172.21.15.82:0/832872143 shutdown_connections 2023-09-23T09:00:23.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.745+0000 7f9036bff700 1 --2- 172.21.15.82:0/832872143 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f90200a0140 0x7f90200a2600 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:00:23.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.745+0000 7f9036bff700 1 --2- 172.21.15.82:0/832872143 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9030106880 0x7f90301a4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:00:23.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.745+0000 7f9036bff700 1 --2- 172.21.15.82:0/832872143 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9030100870 0x7f9030072c20 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:00:23.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.745+0000 7f9036bff700 1 --2- 172.21.15.82:0/832872143 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9030101230 0x7f9030073160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:00:23.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.745+0000 7f9036bff700 1 -- 172.21.15.82:0/832872143 >> 172.21.15.82:0/832872143 conn(0x7f90300fc3a0 msgr2=0x7f90300fc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:00:23.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.745+0000 7f9036bff700 1 -- 172.21.15.82:0/832872143 shutdown_connections 2023-09-23T09:00:23.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:23.745+0000 7f9036bff700 1 -- 172.21.15.82:0/832872143 wait complete. 2023-09-23T09:00:23.770 INFO:tasks.cephfs.filesystem:scrub status for tag:6f0fe3a6-7212-425d-a0a6-f38e8b42ec13 - {'path': '/', 'tag': '6f0fe3a6-7212-425d-a0a6-f38e8b42ec13', 'options': 'recursive,force'} 2023-09-23T09:00:24.114 INFO:teuthology.orchestra.run.smithi082.stderr:12100000 of 50000000 tuples (24%) done (elapsed 178.86 s, remaining 560.22 s) 2023-09-23T09:00:24.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:00:24 smithi161 ceph-mon[99580]: pgmap v108: 97 pgs: 97 active+clean; 2.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 24 MiB/s wr, 20 op/s 2023-09-23T09:00:25.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:00:24 smithi135 ceph-mon[99205]: pgmap v108: 97 pgs: 97 active+clean; 2.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 24 MiB/s wr, 20 op/s 2023-09-23T09:00:25.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:00:24 smithi082 ceph-mon[97694]: pgmap v108: 97 pgs: 97 active+clean; 2.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 24 MiB/s wr, 20 op/s 2023-09-23T09:00:25.316 INFO:teuthology.orchestra.run.smithi082.stderr:12200000 of 50000000 tuples (24%) done (elapsed 180.06 s, remaining 557.88 s) 2023-09-23T09:00:26.506 INFO:teuthology.orchestra.run.smithi082.stderr:12300000 of 50000000 tuples (24%) done (elapsed 181.25 s, remaining 555.53 s) 2023-09-23T09:00:26.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:00:26 smithi161 ceph-mon[99580]: pgmap v109: 97 pgs: 97 active+clean; 2.8 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 36 MiB/s wr, 29 op/s 2023-09-23T09:00:27.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:00:26 smithi135 ceph-mon[99205]: pgmap v109: 97 pgs: 97 active+clean; 2.8 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 36 MiB/s wr, 29 op/s 2023-09-23T09:00:27.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:00:26 smithi082 ceph-mon[97694]: pgmap v109: 97 pgs: 97 active+clean; 2.8 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 36 MiB/s wr, 29 op/s 2023-09-23T09:00:27.707 INFO:teuthology.orchestra.run.smithi082.stderr:12400000 of 50000000 tuples (24%) done (elapsed 182.45 s, remaining 553.23 s) 2023-09-23T09:00:29.009 INFO:teuthology.orchestra.run.smithi082.stderr:12500000 of 50000000 tuples (25%) done (elapsed 183.75 s, remaining 551.25 s) 2023-09-23T09:00:29.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:00:28 smithi135 ceph-mon[99205]: pgmap v110: 97 pgs: 97 active+clean; 2.8 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 24 MiB/s wr, 19 op/s 2023-09-23T09:00:29.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:00:28 smithi082 ceph-mon[97694]: pgmap v110: 97 pgs: 97 active+clean; 2.8 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 24 MiB/s wr, 19 op/s 2023-09-23T09:00:29.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:00:28 smithi161 ceph-mon[99580]: pgmap v110: 97 pgs: 97 active+clean; 2.8 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 24 MiB/s wr, 19 op/s 2023-09-23T09:00:30.191 INFO:teuthology.orchestra.run.smithi082.stderr:12600000 of 50000000 tuples (25%) done (elapsed 184.93 s, remaining 548.93 s) 2023-09-23T09:00:31.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:00:30 smithi135 ceph-mon[99205]: pgmap v111: 97 pgs: 97 active+clean; 2.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 35 MiB/s wr, 30 op/s 2023-09-23T09:00:31.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:00:30 smithi082 ceph-mon[97694]: pgmap v111: 97 pgs: 97 active+clean; 2.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 35 MiB/s wr, 30 op/s 2023-09-23T09:00:31.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:00:30 smithi161 ceph-mon[99580]: pgmap v111: 97 pgs: 97 active+clean; 2.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 35 MiB/s wr, 30 op/s 2023-09-23T09:00:31.371 INFO:teuthology.orchestra.run.smithi082.stderr:12700000 of 50000000 tuples (25%) done (elapsed 186.11 s, remaining 546.62 s) 2023-09-23T09:00:32.548 INFO:teuthology.orchestra.run.smithi082.stderr:12800000 of 50000000 tuples (25%) done (elapsed 187.29 s, remaining 544.31 s) 2023-09-23T09:00:33.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:00:32 smithi135 ceph-mon[99205]: pgmap v112: 97 pgs: 97 active+clean; 2.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 24 MiB/s wr, 21 op/s 2023-09-23T09:00:33.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:00:32 smithi082 ceph-mon[97694]: pgmap v112: 97 pgs: 97 active+clean; 2.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 24 MiB/s wr, 21 op/s 2023-09-23T09:00:33.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:00:32 smithi161 ceph-mon[99580]: pgmap v112: 97 pgs: 97 active+clean; 2.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 24 MiB/s wr, 21 op/s 2023-09-23T09:00:33.823 INFO:teuthology.orchestra.run.smithi082.stderr:12900000 of 50000000 tuples (25%) done (elapsed 188.56 s, remaining 542.31 s) 2023-09-23T09:00:35.008 INFO:teuthology.orchestra.run.smithi082.stderr:13000000 of 50000000 tuples (26%) done (elapsed 189.75 s, remaining 540.06 s) 2023-09-23T09:00:35.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:00:34 smithi135 ceph-mon[99205]: pgmap v113: 97 pgs: 97 active+clean; 2.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 24 MiB/s wr, 21 op/s 2023-09-23T09:00:35.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:00:34 smithi082 ceph-mon[97694]: pgmap v113: 97 pgs: 97 active+clean; 2.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 24 MiB/s wr, 21 op/s 2023-09-23T09:00:35.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:00:34 smithi161 ceph-mon[99580]: pgmap v113: 97 pgs: 97 active+clean; 2.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 24 MiB/s wr, 21 op/s 2023-09-23T09:00:36.203 INFO:teuthology.orchestra.run.smithi082.stderr:13100000 of 50000000 tuples (26%) done (elapsed 190.94 s, remaining 537.85 s) 2023-09-23T09:00:37.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:00:36 smithi135 ceph-mon[99205]: pgmap v114: 97 pgs: 97 active+clean; 3.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 37 MiB/s wr, 32 op/s 2023-09-23T09:00:37.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:00:36 smithi082 ceph-mon[97694]: pgmap v114: 97 pgs: 97 active+clean; 3.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 37 MiB/s wr, 32 op/s 2023-09-23T09:00:37.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:00:36 smithi161 ceph-mon[99580]: pgmap v114: 97 pgs: 97 active+clean; 3.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 37 MiB/s wr, 32 op/s 2023-09-23T09:00:37.484 INFO:teuthology.orchestra.run.smithi082.stderr:13200000 of 50000000 tuples (26%) done (elapsed 192.23 s, remaining 535.90 s) 2023-09-23T09:00:38.649 INFO:teuthology.orchestra.run.smithi082.stderr:13300000 of 50000000 tuples (26%) done (elapsed 193.39 s, remaining 533.64 s) 2023-09-23T09:00:39.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:00:38 smithi135 ceph-mon[99205]: pgmap v115: 97 pgs: 97 active+clean; 3.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 25 MiB/s wr, 22 op/s 2023-09-23T09:00:39.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:00:38 smithi082 ceph-mon[97694]: pgmap v115: 97 pgs: 97 active+clean; 3.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 25 MiB/s wr, 22 op/s 2023-09-23T09:00:39.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:00:38 smithi161 ceph-mon[99580]: pgmap v115: 97 pgs: 97 active+clean; 3.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 25 MiB/s wr, 22 op/s 2023-09-23T09:00:39.834 INFO:teuthology.orchestra.run.smithi082.stderr:13400000 of 50000000 tuples (26%) done (elapsed 194.58 s, remaining 531.45 s) 2023-09-23T09:00:40.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:00:39 smithi135 ceph-mon[99205]: pgmap v116: 97 pgs: 97 active+clean; 3.1 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 36 MiB/s wr, 31 op/s 2023-09-23T09:00:40.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:00:39 smithi082 ceph-mon[97694]: pgmap v116: 97 pgs: 97 active+clean; 3.1 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 36 MiB/s wr, 31 op/s 2023-09-23T09:00:40.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:00:39 smithi161 ceph-mon[99580]: pgmap v116: 97 pgs: 97 active+clean; 3.1 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 36 MiB/s wr, 31 op/s 2023-09-23T09:00:41.103 INFO:teuthology.orchestra.run.smithi082.stderr:13500000 of 50000000 tuples (27%) done (elapsed 195.85 s, remaining 529.51 s) 2023-09-23T09:00:42.263 INFO:teuthology.orchestra.run.smithi082.stderr:13600000 of 50000000 tuples (27%) done (elapsed 197.01 s, remaining 527.28 s) 2023-09-23T09:00:42.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:00:42 smithi135 ceph-mon[99205]: pgmap v117: 97 pgs: 97 active+clean; 3.1 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 26 MiB/s wr, 21 op/s 2023-09-23T09:00:42.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:00:42 smithi082 ceph-mon[97694]: pgmap v117: 97 pgs: 97 active+clean; 3.1 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 26 MiB/s wr, 21 op/s 2023-09-23T09:00:42.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:00:42 smithi161 ceph-mon[99580]: pgmap v117: 97 pgs: 97 active+clean; 3.1 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 26 MiB/s wr, 21 op/s 2023-09-23T09:00:43.598 INFO:teuthology.orchestra.run.smithi082.stderr:13700000 of 50000000 tuples (27%) done (elapsed 198.34 s, remaining 525.53 s) 2023-09-23T09:00:44.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:00:44 smithi135 ceph-mon[99205]: pgmap v118: 97 pgs: 97 active+clean; 3.1 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 25 MiB/s wr, 20 op/s 2023-09-23T09:00:44.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:00:44 smithi082 ceph-mon[97694]: pgmap v118: 97 pgs: 97 active+clean; 3.1 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 25 MiB/s wr, 20 op/s 2023-09-23T09:00:44.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:00:44 smithi161 ceph-mon[99580]: pgmap v118: 97 pgs: 97 active+clean; 3.1 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 25 MiB/s wr, 20 op/s 2023-09-23T09:00:44.985 INFO:teuthology.orchestra.run.smithi082.stderr:13800000 of 50000000 tuples (27%) done (elapsed 199.73 s, remaining 523.92 s) 2023-09-23T09:00:46.174 INFO:teuthology.orchestra.run.smithi082.stderr:13900000 of 50000000 tuples (27%) done (elapsed 200.92 s, remaining 521.80 s) 2023-09-23T09:00:46.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:00:46 smithi135 ceph-mon[99205]: pgmap v119: 97 pgs: 97 active+clean; 3.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 37 MiB/s wr, 48 op/s 2023-09-23T09:00:46.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:00:46 smithi082 ceph-mon[97694]: pgmap v119: 97 pgs: 97 active+clean; 3.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 37 MiB/s wr, 48 op/s 2023-09-23T09:00:46.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:00:46 smithi161 ceph-mon[99580]: pgmap v119: 97 pgs: 97 active+clean; 3.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 37 MiB/s wr, 48 op/s 2023-09-23T09:00:47.349 INFO:teuthology.orchestra.run.smithi082.stderr:14000000 of 50000000 tuples (28%) done (elapsed 202.09 s, remaining 519.66 s) 2023-09-23T09:00:48.543 INFO:teuthology.orchestra.run.smithi082.stderr:14100000 of 50000000 tuples (28%) done (elapsed 203.29 s, remaining 517.58 s) 2023-09-23T09:00:48.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:00:48 smithi135 ceph-mon[99205]: pgmap v120: 97 pgs: 97 active+clean; 3.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 24 MiB/s wr, 37 op/s 2023-09-23T09:00:48.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:00:48 smithi082 ceph-mon[97694]: pgmap v120: 97 pgs: 97 active+clean; 3.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 24 MiB/s wr, 37 op/s 2023-09-23T09:00:48.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:00:48 smithi161 ceph-mon[99580]: pgmap v120: 97 pgs: 97 active+clean; 3.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 24 MiB/s wr, 37 op/s 2023-09-23T09:00:49.833 INFO:teuthology.orchestra.run.smithi082.stderr:14200000 of 50000000 tuples (28%) done (elapsed 204.57 s, remaining 515.76 s) 2023-09-23T09:00:50.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:00:50 smithi135 ceph-mon[99205]: pgmap v121: 97 pgs: 97 active+clean; 3.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 36 MiB/s wr, 49 op/s 2023-09-23T09:00:50.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:00:50 smithi082 ceph-mon[97694]: pgmap v121: 97 pgs: 97 active+clean; 3.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 36 MiB/s wr, 49 op/s 2023-09-23T09:00:50.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:00:50 smithi161 ceph-mon[99580]: pgmap v121: 97 pgs: 97 active+clean; 3.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 36 MiB/s wr, 49 op/s 2023-09-23T09:00:51.338 INFO:teuthology.orchestra.run.smithi082.stderr:14300000 of 50000000 tuples (28%) done (elapsed 206.08 s, remaining 514.48 s) 2023-09-23T09:00:52.509 INFO:teuthology.orchestra.run.smithi082.stderr:14400000 of 50000000 tuples (28%) done (elapsed 207.25 s, remaining 512.37 s) 2023-09-23T09:00:52.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:00:52 smithi135 ceph-mon[99205]: pgmap v122: 97 pgs: 97 active+clean; 3.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 25 MiB/s wr, 41 op/s 2023-09-23T09:00:52.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:00:52 smithi082 ceph-mon[97694]: pgmap v122: 97 pgs: 97 active+clean; 3.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 25 MiB/s wr, 41 op/s 2023-09-23T09:00:52.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:00:52 smithi161 ceph-mon[99580]: pgmap v122: 97 pgs: 97 active+clean; 3.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 25 MiB/s wr, 41 op/s 2023-09-23T09:00:53.686 INFO:teuthology.orchestra.run.smithi082.stderr:14500000 of 50000000 tuples (29%) done (elapsed 208.43 s, remaining 510.29 s) 2023-09-23T09:00:53.771 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:00:54.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.007+0000 7f06f45ff700 1 -- 172.21.15.82:0/808463312 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06ec108ad0 msgr2=0x7f06ec108eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:00:54.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.007+0000 7f06f45ff700 1 --2- 172.21.15.82:0/808463312 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06ec108ad0 0x7f06ec108eb0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f06e8009990 tx=0x7f06e8009ca0 comp rx=0 tx=0).stop 2023-09-23T09:00:54.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.007+0000 7f06f45ff700 1 -- 172.21.15.82:0/808463312 shutdown_connections 2023-09-23T09:00:54.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.007+0000 7f06f45ff700 1 --2- 172.21.15.82:0/808463312 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f06ec103480 0x7f06ec10f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:00:54.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.007+0000 7f06f45ff700 1 --2- 172.21.15.82:0/808463312 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06ec108ad0 0x7f06ec108eb0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:00:54.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.007+0000 7f06f45ff700 1 --2- 172.21.15.82:0/808463312 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06ec102ac0 0x7f06ec102f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:00:54.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.007+0000 7f06f45ff700 1 -- 172.21.15.82:0/808463312 >> 172.21.15.82:0/808463312 conn(0x7f06ec0fe570 msgr2=0x7f06ec100990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:00:54.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.007+0000 7f06f45ff700 1 -- 172.21.15.82:0/808463312 shutdown_connections 2023-09-23T09:00:54.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.007+0000 7f06f45ff700 1 -- 172.21.15.82:0/808463312 wait complete. 2023-09-23T09:00:54.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.008+0000 7f06f45ff700 1 Processor -- start 2023-09-23T09:00:54.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.009+0000 7f06f45ff700 1 -- start start 2023-09-23T09:00:54.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.009+0000 7f06f45ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06ec102ac0 0x7f06ec19e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:00:54.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.009+0000 7f06f45ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06ec103480 0x7f06ec19ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:00:54.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.009+0000 7f06f45ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f06ec108ad0 0x7f06ec198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:00:54.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.009+0000 7f06f45ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06ec198fd0 con 0x7f06ec103480 2023-09-23T09:00:54.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.009+0000 7f06f45ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06ec199140 con 0x7f06ec102ac0 2023-09-23T09:00:54.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.009+0000 7f06f45ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06ec199300 con 0x7f06ec108ad0 2023-09-23T09:00:54.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.009+0000 7f06f1b9a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06ec103480 0x7f06ec19ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:00:54.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.009+0000 7f06f239b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06ec102ac0 0x7f06ec19e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:00:54.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.009+0000 7f06f1b9a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06ec103480 0x7f06ec19ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52866/0 (socket says 172.21.15.82:52866) 2023-09-23T09:00:54.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.009+0000 7f06f1b9a700 1 -- 172.21.15.82:0/3272237847 learned_addr learned my addr 172.21.15.82:0/3272237847 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:00:54.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.009+0000 7f06f2b9c700 1 --2- 172.21.15.82:0/3272237847 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f06ec108ad0 0x7f06ec198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:00:54.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.010+0000 7f06f239b700 1 -- 172.21.15.82:0/3272237847 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f06ec108ad0 msgr2=0x7f06ec198960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:00:54.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.010+0000 7f06f239b700 1 --2- 172.21.15.82:0/3272237847 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f06ec108ad0 0x7f06ec198960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:00:54.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.010+0000 7f06f239b700 1 -- 172.21.15.82:0/3272237847 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06ec103480 msgr2=0x7f06ec19ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:00:54.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.010+0000 7f06f239b700 1 --2- 172.21.15.82:0/3272237847 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06ec103480 0x7f06ec19ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:00:54.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.010+0000 7f06f239b700 1 -- 172.21.15.82:0/3272237847 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06e80095f0 con 0x7f06ec102ac0 2023-09-23T09:00:54.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.010+0000 7f06f239b700 1 --2- 172.21.15.82:0/3272237847 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06ec102ac0 0x7f06ec19e8f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f06e8005910 tx=0x7f06e8005740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:00:54.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.010+0000 7f06e37fe700 1 -- 172.21.15.82:0/3272237847 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e801d070 con 0x7f06ec102ac0 2023-09-23T09:00:54.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.010+0000 7f06f45ff700 1 -- 172.21.15.82:0/3272237847 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06ec199580 con 0x7f06ec102ac0 2023-09-23T09:00:54.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.010+0000 7f06e37fe700 1 -- 172.21.15.82:0/3272237847 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f06e8022470 con 0x7f06ec102ac0 2023-09-23T09:00:54.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.010+0000 7f06e37fe700 1 -- 172.21.15.82:0/3272237847 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e8017650 con 0x7f06ec102ac0 2023-09-23T09:00:54.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.011+0000 7f06f45ff700 1 -- 172.21.15.82:0/3272237847 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06ec1a58e0 con 0x7f06ec102ac0 2023-09-23T09:00:54.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.015+0000 7f06e37fe700 1 -- 172.21.15.82:0/3272237847 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f06e80225e0 con 0x7f06ec102ac0 2023-09-23T09:00:54.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.016+0000 7f0707fa4b80 1 Processor -- start 2023-09-23T09:00:54.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.016+0000 7f0707fa4b80 1 -- start start 2023-09-23T09:00:54.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.016+0000 7f06e37fe700 1 --2- 172.21.15.82:0/3272237847 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f06d80a00c0 0x7f06d80a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:00:54.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.016+0000 7f0707fa4b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be4f9bc380 0x55be4f9bc760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:00:54.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.016+0000 7f0707fa4b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55be4f9bcca0 0x55be4f9b6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:00:54.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.016+0000 7f0707fa4b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be4f9b6c40 0x55be4f9b70a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:00:54.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.016+0000 7f0707fa4b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be4f91e7b0 con 0x55be4f9b6c40 2023-09-23T09:00:54.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.016+0000 7f0707fa4b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be4f90f780 con 0x55be4f9bc380 2023-09-23T09:00:54.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.016+0000 7f0707fa4b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be4f90d0a0 con 0x55be4f9bcca0 2023-09-23T09:00:54.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.016+0000 7f06e37fe700 1 -- 172.21.15.82:0/3272237847 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f06e80cc960 con 0x7f06ec102ac0 2023-09-23T09:00:54.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.017+0000 7f06f239b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be4f9bc380 0x55be4f9bc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:00:54.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.017+0000 7f06f2b9c700 1 --2- 172.21.15.82:0/3272237847 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f06d80a00c0 0x7f06d80a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:00:54.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.017+0000 7f06f239b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be4f9bc380 0x55be4f9bc760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:53752/0 (socket says 172.21.15.82:53752) 2023-09-23T09:00:54.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.017+0000 7f06f239b700 1 -- 172.21.15.82:0/2033970633 learned_addr learned my addr 172.21.15.82:0/2033970633 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:00:54.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.017+0000 7f06f2b9c700 1 --2- 172.21.15.82:0/2033970633 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be4f9b6c40 0x55be4f9b70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:00:54.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.017+0000 7f06f1b9a700 1 --2- 172.21.15.82:0/2033970633 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55be4f9bcca0 0x55be4f9b6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:00:54.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.017+0000 7f06f239b700 1 -- 172.21.15.82:0/2033970633 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55be4f9bcca0 msgr2=0x55be4f9b6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:00:54.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.017+0000 7f06f239b700 1 --2- 172.21.15.82:0/2033970633 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55be4f9bcca0 0x55be4f9b6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:00:54.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.017+0000 7f06f239b700 1 -- 172.21.15.82:0/2033970633 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be4f9b6c40 msgr2=0x55be4f9b70a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:00:54.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.017+0000 7f06f239b700 1 --2- 172.21.15.82:0/2033970633 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be4f9b6c40 0x55be4f9b70a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:00:54.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.017+0000 7f06f239b700 1 -- 172.21.15.82:0/2033970633 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55be4f788630 con 0x55be4f9bc380 2023-09-23T09:00:54.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.017+0000 7f06f2b9c700 1 --2- 172.21.15.82:0/2033970633 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be4f9b6c40 0x55be4f9b70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:00:54.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.017+0000 7f06f1b9a700 1 --2- 172.21.15.82:0/2033970633 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55be4f9bcca0 0x55be4f9b6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T09:00:54.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.017+0000 7f06f239b700 1 --2- 172.21.15.82:0/2033970633 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be4f9bc380 0x55be4f9bc760 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f06e8096690 tx=0x7f06e8099fe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6eacc95268f9231e server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:00:54.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.017+0000 7f06f2b9c700 1 --2- 172.21.15.82:0/3272237847 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f06d80a00c0 0x7f06d80a2580 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f06e4009ec0 tx=0x7f06e4009920 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:00:54.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.017+0000 7f06e0bfe700 1 -- 172.21.15.82:0/2033970633 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e80b25c0 con 0x55be4f9bc380 2023-09-23T09:00:54.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.018+0000 7f06e0bfe700 1 -- 172.21.15.82:0/2033970633 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f06e80b23e0 con 0x55be4f9bc380 2023-09-23T09:00:54.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.018+0000 7f06e0bfe700 1 -- 172.21.15.82:0/2033970633 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e80ca300 con 0x55be4f9bc380 2023-09-23T09:00:54.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.018+0000 7f0707fa4b80 1 -- 172.21.15.82:0/2033970633 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be4f9bc380 msgr2=0x55be4f9bc760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:00:54.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.018+0000 7f0707fa4b80 1 --2- 172.21.15.82:0/2033970633 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be4f9bc380 0x55be4f9bc760 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f06e8096690 tx=0x7f06e8099fe0 comp rx=0 tx=0).stop 2023-09-23T09:00:54.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.018+0000 7f0707fa4b80 1 -- 172.21.15.82:0/2033970633 shutdown_connections 2023-09-23T09:00:54.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.018+0000 7f0707fa4b80 1 --2- 172.21.15.82:0/2033970633 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be4f9b6c40 0x55be4f9b70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:00:54.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.018+0000 7f0707fa4b80 1 --2- 172.21.15.82:0/2033970633 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be4f9bc380 0x55be4f9bc760 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:00:54.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.018+0000 7f0707fa4b80 1 --2- 172.21.15.82:0/2033970633 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55be4f9bcca0 0x55be4f9b6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:00:54.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.018+0000 7f0707fa4b80 1 -- 172.21.15.82:0/2033970633 >> 172.21.15.82:0/2033970633 conn(0x55be4f92b0e0 msgr2=0x55be4f9b1410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:00:54.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.018+0000 7f0707fa4b80 1 -- 172.21.15.82:0/2033970633 shutdown_connections 2023-09-23T09:00:54.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.018+0000 7f0707fa4b80 1 -- 172.21.15.82:0/2033970633 wait complete. 2023-09-23T09:00:54.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.019+0000 7f0707fa4b80 1 -- start start 2023-09-23T09:00:54.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.019+0000 7f0707fa4b80 1 Processor -- start 2023-09-23T09:00:54.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.020+0000 7f0707fa4b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be4f9b6c40 0x55be4f9c2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:00:54.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.020+0000 7f0707fa4b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be4f9bc380 0x55be4f9bfea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:00:54.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.020+0000 7f0707fa4b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55be4f9bcca0 0x55be4f9c04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:00:54.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.020+0000 7f0707fa4b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be4f908990 con 0x55be4f9b6c40 2023-09-23T09:00:54.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.020+0000 7f0707fa4b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be4f8a6bb0 con 0x55be4f9bc380 2023-09-23T09:00:54.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.020+0000 7f0707fa4b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be4f8a68b0 con 0x55be4f9bcca0 2023-09-23T09:00:54.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.020+0000 7f0707fa4b80 10 client.0 _ll_register_callbacks cb 0x55be4f7f0a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:00:54.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.020+0000 7f06f239b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be4f9b6c40 0x55be4f9c2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:00:54.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.020+0000 7f06f1b9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be4f9bc380 0x55be4f9bfea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:00:54.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.020+0000 7f06f239b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be4f9b6c40 0x55be4f9c2bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52876/0 (socket says 172.21.15.82:52876) 2023-09-23T09:00:54.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.020+0000 7f06f239b700 1 -- 172.21.15.82:0/651824924 learned_addr learned my addr 172.21.15.82:0/651824924 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:00:54.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.020+0000 7f06f2b9c700 1 --2- 172.21.15.82:0/651824924 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55be4f9bcca0 0x55be4f9c04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:00:54.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.020+0000 7f06f1b9a700 1 -- 172.21.15.82:0/651824924 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55be4f9bcca0 msgr2=0x55be4f9c04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:00:54.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.020+0000 7f06f1b9a700 1 --2- 172.21.15.82:0/651824924 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55be4f9bcca0 0x55be4f9c04d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:00:54.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.020+0000 7f06f1b9a700 1 -- 172.21.15.82:0/651824924 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be4f9b6c40 msgr2=0x55be4f9c2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:00:54.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.021+0000 7f06f1b9a700 1 --2- 172.21.15.82:0/651824924 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be4f9b6c40 0x55be4f9c2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:00:54.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.021+0000 7f06f1b9a700 1 -- 172.21.15.82:0/651824924 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06ec1a58e0 con 0x55be4f9bc380 2023-09-23T09:00:54.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.021+0000 7f06f1b9a700 1 --2- 172.21.15.82:0/651824924 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be4f9bc380 0x55be4f9bfea0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f06dc0096b0 tx=0x7f06dc0139c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5e03cbf11eab815 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:00:54.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.021+0000 7f06d5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-09-23T09:00:54.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.021+0000 7f06d5ffb700 1 -- 172.21.15.82:0/651824924 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06dc004460 con 0x55be4f9bc380 2023-09-23T09:00:54.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.021+0000 7f0707fa4b80 1 -- 172.21.15.82:0/651824924 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55be4f9861c0 con 0x55be4f9bc380 2023-09-23T09:00:54.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.021+0000 7f06d5ffb700 1 -- 172.21.15.82:0/651824924 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f06dc004830 con 0x55be4f9bc380 2023-09-23T09:00:54.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.021+0000 7f06d5ffb700 1 -- 172.21.15.82:0/651824924 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f06dc0049f0 con 0x55be4f9bc380 2023-09-23T09:00:54.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.021+0000 7f0707fa4b80 10 client.25712 fetch_fsmap learned FSMap version 34 2023-09-23T09:00:54.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.021+0000 7f0707fa4b80 1 -- 172.21.15.82:0/651824924 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55be4f734de0 con 0x55be4f9bc380 2023-09-23T09:00:54.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.022+0000 7f06d5ffb700 1 -- 172.21.15.82:0/651824924 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55be4f9861c0 con 0x55be4f9bc380 2023-09-23T09:00:54.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.022+0000 7f06d5ffb700 1 -- 172.21.15.82:0/651824924 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 34) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f06dc003680 con 0x55be4f9bc380 2023-09-23T09:00:54.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.022+0000 7f0707fa4b80 10 client.25712 fetch_fsmap finished waiting for FSMap version 34 2023-09-23T09:00:54.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.022+0000 7f0707fa4b80 10 client.25712 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:00:54.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.022+0000 7f0707fa4b80 20 client.25712 populate_metadata read hostname 'smithi082' 2023-09-23T09:00:54.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.022+0000 7f0707fa4b80 1 --2- 172.21.15.82:0/651824924 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55be4f9d0300 0x55be4f9d2720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:00:54.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.022+0000 7f0707fa4b80 4 client.25712 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:00:54.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.022+0000 7f0707fa4b80 1 -- 172.21.15.82:0/651824924 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55be4f8aeba0 con 0x55be4f9d0300 2023-09-23T09:00:54.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.022+0000 7f06f239b700 1 --2- 172.21.15.82:0/651824924 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55be4f9d0300 0x55be4f9d2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:00:54.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.023+0000 7f06d5ffb700 10 client.25712 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:00:54.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.023+0000 7f06f239b700 1 --2- 172.21.15.82:0/651824924 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55be4f9d0300 0x55be4f9d2720 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=76a965b3fc0443fe server_cookie=f754396017b88595 in_seq=0 out_seq=0 2023-09-23T09:00:54.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.023+0000 7f06d5ffb700 1 -- 172.21.15.82:0/651824924 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55be4f8aeba0 con 0x55be4f9d0300 2023-09-23T09:00:54.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.023+0000 7f06d5ffb700 10 client.25712 handle_command_reply: tid=0 2023-09-23T09:00:54.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.023+0000 7f0707fa4b80 1 client.25712 shutdown 2023-09-23T09:00:54.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.024+0000 7f0707fa4b80 1 -- 172.21.15.82:0/651824924 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be4f9bc380 msgr2=0x55be4f9bfea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:00:54.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.024+0000 7f0707fa4b80 1 --2- 172.21.15.82:0/651824924 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be4f9bc380 0x55be4f9bfea0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f06dc0096b0 tx=0x7f06dc0139c0 comp rx=0 tx=0).stop 2023-09-23T09:00:54.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.024+0000 7f0707fa4b80 1 -- 172.21.15.82:0/651824924 shutdown_connections 2023-09-23T09:00:54.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.024+0000 7f0707fa4b80 1 --2- 172.21.15.82:0/651824924 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55be4f9bcca0 0x55be4f9c04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:00:54.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.024+0000 7f0707fa4b80 1 --2- 172.21.15.82:0/651824924 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55be4f9d0300 0x55be4f9d2720 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:00:54.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.024+0000 7f0707fa4b80 1 --2- 172.21.15.82:0/651824924 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be4f9b6c40 0x55be4f9c2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:00:54.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.024+0000 7f0707fa4b80 1 --2- 172.21.15.82:0/651824924 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be4f9bc380 0x55be4f9bfea0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:00:54.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.024+0000 7f06d5ffb700 0 client.25712 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:00:54.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.024+0000 7f0707fa4b80 1 -- 172.21.15.82:0/651824924 >> 172.21.15.82:0/651824924 conn(0x55be4f92b0e0 msgr2=0x55be4f9abb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:00:54.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.024+0000 7f0707fa4b80 1 -- 172.21.15.82:0/651824924 shutdown_connections 2023-09-23T09:00:54.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.024+0000 7f0707fa4b80 1 -- 172.21.15.82:0/651824924 wait complete. 2023-09-23T09:00:54.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.024+0000 7f0707fa4b80 20 client.25712 trim_cache size 0 max 16384 2023-09-23T09:00:54.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.043+0000 7f0707fa4b80 1 Processor -- start 2023-09-23T09:00:54.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.044+0000 7f0707fa4b80 1 -- start start 2023-09-23T09:00:54.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.044+0000 7f0707fa4b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be4f9b6c40 0x55be4f9b6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:00:54.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.044+0000 7f0707fa4b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55be4f9bc380 0x55be4f9ba010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:00:54.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.044+0000 7f0707fa4b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be4f9bcca0 0x55be4f9ba550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:00:54.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.044+0000 7f0707fa4b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be4f78a920 con 0x55be4f9b6c40 2023-09-23T09:00:54.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.044+0000 7f0707fa4b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be4f9b2580 con 0x55be4f9bcca0 2023-09-23T09:00:54.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.044+0000 7f0707fa4b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be4f9b31b0 con 0x55be4f9bc380 2023-09-23T09:00:54.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.044+0000 7f06f239b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be4f9b6c40 0x55be4f9b6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:00:54.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.044+0000 7f06f239b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be4f9b6c40 0x55be4f9b6700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52884/0 (socket says 172.21.15.82:52884) 2023-09-23T09:00:54.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.044+0000 7f06f1b9a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55be4f9bc380 0x55be4f9ba010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:00:54.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.044+0000 7f06f239b700 1 -- 172.21.15.82:0/2009500175 learned_addr learned my addr 172.21.15.82:0/2009500175 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:00:54.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.044+0000 7f06f2b9c700 1 --2- 172.21.15.82:0/2009500175 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be4f9bcca0 0x55be4f9ba550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:00:54.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.045+0000 7f06f239b700 1 -- 172.21.15.82:0/2009500175 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55be4f9bc380 msgr2=0x55be4f9ba010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:00:54.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.045+0000 7f06f239b700 1 --2- 172.21.15.82:0/2009500175 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55be4f9bc380 0x55be4f9ba010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:00:54.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.045+0000 7f06f239b700 1 -- 172.21.15.82:0/2009500175 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be4f9bcca0 msgr2=0x55be4f9ba550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:00:54.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.045+0000 7f06f239b700 1 --2- 172.21.15.82:0/2009500175 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be4f9bcca0 0x55be4f9ba550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:00:54.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.045+0000 7f06f239b700 1 -- 172.21.15.82:0/2009500175 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55be4f71dc60 con 0x55be4f9b6c40 2023-09-23T09:00:54.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.045+0000 7f06f239b700 1 --2- 172.21.15.82:0/2009500175 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be4f9b6c40 0x55be4f9b6700 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f06e8096690 tx=0x7f06e801a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27374895a020273d server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:00:54.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.045+0000 7f06e13ff700 1 -- 172.21.15.82:0/2009500175 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e809a190 con 0x55be4f9b6c40 2023-09-23T09:00:54.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.045+0000 7f06e13ff700 1 -- 172.21.15.82:0/2009500175 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f06e80a1f10 con 0x55be4f9b6c40 2023-09-23T09:00:54.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.045+0000 7f06e13ff700 1 -- 172.21.15.82:0/2009500175 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e8066250 con 0x55be4f9b6c40 2023-09-23T09:00:54.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.046+0000 7f0707fa4b80 1 -- 172.21.15.82:0/2009500175 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be4f9b6c40 msgr2=0x55be4f9b6700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:00:54.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.046+0000 7f0707fa4b80 1 --2- 172.21.15.82:0/2009500175 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be4f9b6c40 0x55be4f9b6700 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f06e8096690 tx=0x7f06e801a040 comp rx=0 tx=0).stop 2023-09-23T09:00:54.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.046+0000 7f0707fa4b80 1 -- 172.21.15.82:0/2009500175 shutdown_connections 2023-09-23T09:00:54.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.046+0000 7f0707fa4b80 1 --2- 172.21.15.82:0/2009500175 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be4f9bcca0 0x55be4f9ba550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:00:54.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.046+0000 7f0707fa4b80 1 --2- 172.21.15.82:0/2009500175 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be4f9b6c40 0x55be4f9b6700 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:00:54.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.046+0000 7f0707fa4b80 1 --2- 172.21.15.82:0/2009500175 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55be4f9bc380 0x55be4f9ba010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:00:54.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.046+0000 7f0707fa4b80 1 -- 172.21.15.82:0/2009500175 >> 172.21.15.82:0/2009500175 conn(0x55be4f92b0e0 msgr2=0x55be4f9cba20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:00:54.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.046+0000 7f0707fa4b80 1 -- 172.21.15.82:0/2009500175 shutdown_connections 2023-09-23T09:00:54.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.046+0000 7f0707fa4b80 1 -- 172.21.15.82:0/2009500175 wait complete. 2023-09-23T09:00:54.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.047+0000 7f0707fa4b80 1 -- start start 2023-09-23T09:00:54.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.047+0000 7f0707fa4b80 1 Processor -- start 2023-09-23T09:00:54.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.048+0000 7f0707fa4b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be4f9b6c40 0x55be4f9b92a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:00:54.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.048+0000 7f0707fa4b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be4f9bc380 0x55be4f9b7e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:00:54.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.048+0000 7f0707fa4b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55be4f9bcca0 0x55be4f9b8340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:00:54.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.048+0000 7f0707fa4b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be4f9b98f0 con 0x55be4f9b6c40 2023-09-23T09:00:54.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.048+0000 7f0707fa4b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be4f9b9a60 con 0x55be4f9bc380 2023-09-23T09:00:54.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.048+0000 7f0707fa4b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be4f9b8880 con 0x55be4f9bcca0 2023-09-23T09:00:54.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.048+0000 7f0707fa4b80 10 client.0 _ll_register_callbacks cb 0x7f06dc009cb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:00:54.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.048+0000 7f06f239b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be4f9b6c40 0x55be4f9b92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:00:54.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.048+0000 7f06f239b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be4f9b6c40 0x55be4f9b92a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52894/0 (socket says 172.21.15.82:52894) 2023-09-23T09:00:54.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.048+0000 7f06f239b700 1 -- 172.21.15.82:0/1916872683 learned_addr learned my addr 172.21.15.82:0/1916872683 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:00:54.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.048+0000 7f06f1b9a700 1 --2- 172.21.15.82:0/1916872683 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be4f9bc380 0x55be4f9b7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:00:54.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.048+0000 7f06f2b9c700 1 --2- 172.21.15.82:0/1916872683 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55be4f9bcca0 0x55be4f9b8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:00:54.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.048+0000 7f06f239b700 1 -- 172.21.15.82:0/1916872683 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55be4f9bcca0 msgr2=0x55be4f9b8340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:00:54.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.048+0000 7f06f239b700 1 --2- 172.21.15.82:0/1916872683 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55be4f9bcca0 0x55be4f9b8340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:00:54.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.048+0000 7f06f239b700 1 -- 172.21.15.82:0/1916872683 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be4f9bc380 msgr2=0x55be4f9b7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:00:54.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.048+0000 7f06f239b700 1 --2- 172.21.15.82:0/1916872683 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be4f9bc380 0x55be4f9b7e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:00:54.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.048+0000 7f06f239b700 1 -- 172.21.15.82:0/1916872683 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55be4f788630 con 0x55be4f9b6c40 2023-09-23T09:00:54.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.049+0000 7f06f239b700 1 --2- 172.21.15.82:0/1916872683 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be4f9b6c40 0x55be4f9b92a0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f06e8022890 tx=0x7f06e8009530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a91e100ec4eaca5a server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:00:54.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.049+0000 7f06d5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:00:54.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.049+0000 7f06d5ffb700 1 -- 172.21.15.82:0/1916872683 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e80228e0 con 0x55be4f9b6c40 2023-09-23T09:00:54.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.049+0000 7f06d5ffb700 1 -- 172.21.15.82:0/1916872683 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f06e8022a40 con 0x55be4f9b6c40 2023-09-23T09:00:54.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.049+0000 7f0707fa4b80 1 -- 172.21.15.82:0/1916872683 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55be4f9a98b0 con 0x55be4f9b6c40 2023-09-23T09:00:54.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.049+0000 7f06d5ffb700 1 -- 172.21.15.82:0/1916872683 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f06e80ca300 con 0x55be4f9b6c40 2023-09-23T09:00:54.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.049+0000 7f0707fa4b80 10 client.16026 fetch_fsmap learned FSMap version 34 2023-09-23T09:00:54.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.049+0000 7f0707fa4b80 1 -- 172.21.15.82:0/1916872683 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55be4f75b250 con 0x55be4f9b6c40 2023-09-23T09:00:54.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.050+0000 7f06d5ffb700 1 -- 172.21.15.82:0/1916872683 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f06e80bd080 con 0x55be4f9b6c40 2023-09-23T09:00:54.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.050+0000 7f06d5ffb700 1 -- 172.21.15.82:0/1916872683 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 34) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f06e8099680 con 0x55be4f9b6c40 2023-09-23T09:00:54.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.050+0000 7f0707fa4b80 10 client.16026 fetch_fsmap finished waiting for FSMap version 34 2023-09-23T09:00:54.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.050+0000 7f0707fa4b80 10 client.16026 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:00:54.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.050+0000 7f0707fa4b80 20 client.16026 populate_metadata read hostname 'smithi082' 2023-09-23T09:00:54.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.050+0000 7f0707fa4b80 1 --2- 172.21.15.82:0/1916872683 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55be4fa24da0 0x55be4fa27190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:00:54.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.050+0000 7f0707fa4b80 4 client.16026 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:00:54.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.050+0000 7f0707fa4b80 1 -- 172.21.15.82:0/1916872683 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55be4f901970 con 0x55be4fa24da0 2023-09-23T09:00:54.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.050+0000 7f06f1b9a700 1 --2- 172.21.15.82:0/1916872683 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55be4fa24da0 0x55be4fa27190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:00:54.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.051+0000 7f06d5ffb700 10 client.16026 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:00:54.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.051+0000 7f06f1b9a700 1 --2- 172.21.15.82:0/1916872683 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55be4fa24da0 0x55be4fa27190 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc2ce2c6dd0830bc server_cookie=8f656c78d9d5a49c in_seq=0 out_seq=0 2023-09-23T09:00:54.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.051+0000 7f06d5ffb700 1 -- 172.21.15.82:0/1916872683 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55be4f901970 con 0x55be4fa24da0 2023-09-23T09:00:54.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.051+0000 7f06d5ffb700 10 client.16026 handle_command_reply: tid=0 2023-09-23T09:00:54.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.051+0000 7f0707fa4b80 1 client.16026 shutdown 2023-09-23T09:00:54.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.051+0000 7f0707fa4b80 1 -- 172.21.15.82:0/1916872683 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be4f9b6c40 msgr2=0x55be4f9b92a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:00:54.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.051+0000 7f0707fa4b80 1 --2- 172.21.15.82:0/1916872683 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be4f9b6c40 0x55be4f9b92a0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f06e8022890 tx=0x7f06e8009530 comp rx=0 tx=0).stop 2023-09-23T09:00:54.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.051+0000 7f0707fa4b80 1 -- 172.21.15.82:0/1916872683 shutdown_connections 2023-09-23T09:00:54.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.051+0000 7f0707fa4b80 1 --2- 172.21.15.82:0/1916872683 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55be4f9bcca0 0x55be4f9b8340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:00:54.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.051+0000 7f0707fa4b80 1 --2- 172.21.15.82:0/1916872683 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55be4fa24da0 0x55be4fa27190 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:00:54.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.051+0000 7f0707fa4b80 1 --2- 172.21.15.82:0/1916872683 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be4f9b6c40 0x55be4f9b92a0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:00:54.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.051+0000 7f0707fa4b80 1 --2- 172.21.15.82:0/1916872683 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be4f9bc380 0x55be4f9b7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:00:54.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.052+0000 7f0707fa4b80 1 -- 172.21.15.82:0/1916872683 >> 172.21.15.82:0/1916872683 conn(0x55be4f92b0e0 msgr2=0x55be4f9ba010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:00:54.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.052+0000 7f06d5ffb700 0 client.16026 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:00:54.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.052+0000 7f0707fa4b80 1 -- 172.21.15.82:0/1916872683 shutdown_connections 2023-09-23T09:00:54.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.052+0000 7f0707fa4b80 1 -- 172.21.15.82:0/1916872683 wait complete. 2023-09-23T09:00:54.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.052+0000 7f0707fa4b80 20 client.16026 trim_cache size 0 max 16384 2023-09-23T09:00:54.058 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:00:54.059 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-23T09:00:54.059 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:00:54.059 INFO:teuthology.orchestra.run.smithi082.stdout: "6f0fe3a6-7212-425d-a0a6-f38e8b42ec13": { 2023-09-23T09:00:54.059 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:00:54.059 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "6f0fe3a6-7212-425d-a0a6-f38e8b42ec13", 2023-09-23T09:00:54.059 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:00:54.059 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:00:54.059 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:00:54.059 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:00:54.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.052+0000 7f06f45ff700 1 -- 172.21.15.82:0/3272237847 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f06d80a00c0 msgr2=0x7f06d80a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:00:54.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.052+0000 7f06f45ff700 1 --2- 172.21.15.82:0/3272237847 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f06d80a00c0 0x7f06d80a2580 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f06e4009ec0 tx=0x7f06e4009920 comp rx=0 tx=0).stop 2023-09-23T09:00:54.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.052+0000 7f06f45ff700 1 -- 172.21.15.82:0/3272237847 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06ec102ac0 msgr2=0x7f06ec19e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:00:54.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.052+0000 7f06f45ff700 1 --2- 172.21.15.82:0/3272237847 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06ec102ac0 0x7f06ec19e8f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f06e8005910 tx=0x7f06e8005740 comp rx=0 tx=0).stop 2023-09-23T09:00:54.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.053+0000 7f06f45ff700 1 -- 172.21.15.82:0/3272237847 shutdown_connections 2023-09-23T09:00:54.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.053+0000 7f06f45ff700 1 --2- 172.21.15.82:0/3272237847 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f06d80a00c0 0x7f06d80a2580 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:00:54.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.053+0000 7f06f45ff700 1 --2- 172.21.15.82:0/3272237847 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f06ec108ad0 0x7f06ec198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:00:54.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.053+0000 7f06f45ff700 1 --2- 172.21.15.82:0/3272237847 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06ec102ac0 0x7f06ec19e8f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:00:54.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.053+0000 7f06f45ff700 1 --2- 172.21.15.82:0/3272237847 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06ec103480 0x7f06ec19ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:00:54.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.053+0000 7f06f45ff700 1 -- 172.21.15.82:0/3272237847 >> 172.21.15.82:0/3272237847 conn(0x7f06ec0fe570 msgr2=0x7f06ec0fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:00:54.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.053+0000 7f06f45ff700 1 -- 172.21.15.82:0/3272237847 shutdown_connections 2023-09-23T09:00:54.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:00:54.053+0000 7f06f45ff700 1 -- 172.21.15.82:0/3272237847 wait complete. 2023-09-23T09:00:54.074 INFO:tasks.cephfs.filesystem:scrub status for tag:6f0fe3a6-7212-425d-a0a6-f38e8b42ec13 - {'path': '/', 'tag': '6f0fe3a6-7212-425d-a0a6-f38e8b42ec13', 'options': 'recursive,force'} 2023-09-23T09:00:54.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:00:54 smithi135 ceph-mon[99205]: pgmap v123: 97 pgs: 97 active+clean; 3.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 24 MiB/s wr, 41 op/s 2023-09-23T09:00:54.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:00:54 smithi082 ceph-mon[97694]: pgmap v123: 97 pgs: 97 active+clean; 3.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 24 MiB/s wr, 41 op/s 2023-09-23T09:00:54.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:00:54 smithi161 ceph-mon[99580]: pgmap v123: 97 pgs: 97 active+clean; 3.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 24 MiB/s wr, 41 op/s 2023-09-23T09:00:55.009 INFO:teuthology.orchestra.run.smithi082.stderr:14600000 of 50000000 tuples (29%) done (elapsed 209.75 s, remaining 508.57 s) 2023-09-23T09:00:56.192 INFO:teuthology.orchestra.run.smithi082.stderr:14700000 of 50000000 tuples (29%) done (elapsed 210.93 s, remaining 506.53 s) 2023-09-23T09:00:56.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:00:56 smithi135 ceph-mon[99205]: pgmap v124: 97 pgs: 97 active+clean; 3.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 36 MiB/s wr, 52 op/s 2023-09-23T09:00:56.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:00:56 smithi082 ceph-mon[97694]: pgmap v124: 97 pgs: 97 active+clean; 3.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 36 MiB/s wr, 52 op/s 2023-09-23T09:00:56.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:00:56 smithi161 ceph-mon[99580]: pgmap v124: 97 pgs: 97 active+clean; 3.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 36 MiB/s wr, 52 op/s 2023-09-23T09:00:57.386 INFO:teuthology.orchestra.run.smithi082.stderr:14800000 of 50000000 tuples (29%) done (elapsed 212.13 s, remaining 504.52 s) 2023-09-23T09:00:58.677 INFO:teuthology.orchestra.run.smithi082.stderr:14900000 of 50000000 tuples (29%) done (elapsed 213.42 s, remaining 502.75 s) 2023-09-23T09:00:58.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:00:58 smithi135 ceph-mon[99205]: pgmap v125: 97 pgs: 97 active+clean; 3.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 24 MiB/s wr, 24 op/s 2023-09-23T09:00:58.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:00:58 smithi082 ceph-mon[97694]: pgmap v125: 97 pgs: 97 active+clean; 3.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 24 MiB/s wr, 24 op/s 2023-09-23T09:00:58.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:00:58 smithi161 ceph-mon[99580]: pgmap v125: 97 pgs: 97 active+clean; 3.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 24 MiB/s wr, 24 op/s 2023-09-23T09:00:59.866 INFO:teuthology.orchestra.run.smithi082.stderr:15000000 of 50000000 tuples (30%) done (elapsed 214.61 s, remaining 500.75 s) 2023-09-23T09:01:00.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:01:00 smithi135 ceph-mon[99205]: pgmap v126: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 35 MiB/s wr, 33 op/s 2023-09-23T09:01:00.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:01:00 smithi082 ceph-mon[97694]: pgmap v126: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 35 MiB/s wr, 33 op/s 2023-09-23T09:01:00.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:01:00 smithi161 ceph-mon[99580]: pgmap v126: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 35 MiB/s wr, 33 op/s 2023-09-23T09:01:01.073 INFO:teuthology.orchestra.run.smithi082.stderr:15100000 of 50000000 tuples (30%) done (elapsed 215.82 s, remaining 498.80 s) 2023-09-23T09:01:01.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:01:01 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:01:01.838 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:01:01 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:01:01.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:01:01 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:01:02.254 INFO:teuthology.orchestra.run.smithi082.stderr:15200000 of 50000000 tuples (30%) done (elapsed 217.00 s, remaining 496.81 s) 2023-09-23T09:01:02.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:01:02 smithi135 ceph-mon[99205]: pgmap v127: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 24 MiB/s wr, 21 op/s 2023-09-23T09:01:02.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:01:02 smithi082 ceph-mon[97694]: pgmap v127: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 24 MiB/s wr, 21 op/s 2023-09-23T09:01:02.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:01:02 smithi161 ceph-mon[99580]: pgmap v127: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 24 MiB/s wr, 21 op/s 2023-09-23T09:01:03.528 INFO:teuthology.orchestra.run.smithi082.stderr:15300000 of 50000000 tuples (30%) done (elapsed 218.27 s, remaining 495.03 s) 2023-09-23T09:01:04.711 INFO:teuthology.orchestra.run.smithi082.stderr:15400000 of 50000000 tuples (30%) done (elapsed 219.45 s, remaining 493.06 s) 2023-09-23T09:01:04.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:01:04 smithi135 ceph-mon[99205]: pgmap v128: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 24 MiB/s wr, 20 op/s 2023-09-23T09:01:04.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:01:04 smithi082 ceph-mon[97694]: pgmap v128: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 24 MiB/s wr, 20 op/s 2023-09-23T09:01:04.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:01:04 smithi161 ceph-mon[99580]: pgmap v128: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 24 MiB/s wr, 20 op/s 2023-09-23T09:01:05.884 INFO:teuthology.orchestra.run.smithi082.stderr:15500000 of 50000000 tuples (31%) done (elapsed 220.63 s, remaining 491.07 s) 2023-09-23T09:01:06.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:01:06 smithi082 ceph-mon[97694]: pgmap v129: 97 pgs: 97 active+clean; 3.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 36 MiB/s wr, 43 op/s 2023-09-23T09:01:06.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:01:06 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:01:06.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:01:06 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:01:06.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:01:06 smithi161 ceph-mon[99580]: pgmap v129: 97 pgs: 97 active+clean; 3.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 36 MiB/s wr, 43 op/s 2023-09-23T09:01:06.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:01:06 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:01:06.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:01:06 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:01:07.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:01:06 smithi135 ceph-mon[99205]: pgmap v129: 97 pgs: 97 active+clean; 3.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 36 MiB/s wr, 43 op/s 2023-09-23T09:01:07.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:01:06 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:01:07.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:01:06 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:01:07.201 INFO:teuthology.orchestra.run.smithi082.stderr:15600000 of 50000000 tuples (31%) done (elapsed 221.94 s, remaining 489.41 s) 2023-09-23T09:01:07.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:01:07 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:01:07.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:01:07 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:01:07.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:01:07 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:01:07.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:01:07 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:01:07.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:01:07 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:01:07.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:01:07 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:01:08.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:01:07 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:01:08.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:01:07 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:01:08.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:01:07 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:01:08.398 INFO:teuthology.orchestra.run.smithi082.stderr:15700000 of 50000000 tuples (31%) done (elapsed 223.14 s, remaining 487.50 s) 2023-09-23T09:01:08.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:01:08 smithi082 ceph-mon[97694]: pgmap v130: 97 pgs: 97 active+clean; 3.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 24 MiB/s wr, 32 op/s 2023-09-23T09:01:08.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:01:08 smithi161 ceph-mon[99580]: pgmap v130: 97 pgs: 97 active+clean; 3.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 24 MiB/s wr, 32 op/s 2023-09-23T09:01:09.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:01:08 smithi135 ceph-mon[99205]: pgmap v130: 97 pgs: 97 active+clean; 3.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 24 MiB/s wr, 32 op/s 2023-09-23T09:01:09.597 INFO:teuthology.orchestra.run.smithi082.stderr:15800000 of 50000000 tuples (31%) done (elapsed 224.34 s, remaining 485.59 s) 2023-09-23T09:01:10.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:01:10 smithi082 ceph-mon[97694]: pgmap v131: 97 pgs: 97 active+clean; 3.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 36 MiB/s wr, 42 op/s 2023-09-23T09:01:10.878 INFO:teuthology.orchestra.run.smithi082.stderr:15900000 of 50000000 tuples (31%) done (elapsed 225.62 s, remaining 483.88 s) 2023-09-23T09:01:10.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:01:10 smithi161 ceph-mon[99580]: pgmap v131: 97 pgs: 97 active+clean; 3.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 36 MiB/s wr, 42 op/s 2023-09-23T09:01:11.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:01:10 smithi135 ceph-mon[99205]: pgmap v131: 97 pgs: 97 active+clean; 3.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 36 MiB/s wr, 42 op/s 2023-09-23T09:01:12.053 INFO:teuthology.orchestra.run.smithi082.stderr:16000000 of 50000000 tuples (32%) done (elapsed 226.79 s, remaining 481.94 s) 2023-09-23T09:01:12.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:01:12 smithi082 ceph-mon[97694]: pgmap v132: 97 pgs: 97 active+clean; 3.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 26 MiB/s wr, 34 op/s 2023-09-23T09:01:12.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:01:12 smithi161 ceph-mon[99580]: pgmap v132: 97 pgs: 97 active+clean; 3.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 26 MiB/s wr, 34 op/s 2023-09-23T09:01:13.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:01:12 smithi135 ceph-mon[99205]: pgmap v132: 97 pgs: 97 active+clean; 3.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 26 MiB/s wr, 34 op/s 2023-09-23T09:01:14.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:01:14 smithi082 ceph-mon[97694]: pgmap v133: 97 pgs: 97 active+clean; 3.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 25 MiB/s wr, 33 op/s 2023-09-23T09:01:14.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:01:14 smithi161 ceph-mon[99580]: pgmap v133: 97 pgs: 97 active+clean; 3.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 25 MiB/s wr, 33 op/s 2023-09-23T09:01:15.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:01:14 smithi135 ceph-mon[99205]: pgmap v133: 97 pgs: 97 active+clean; 3.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 25 MiB/s wr, 33 op/s 2023-09-23T09:01:15.393 INFO:teuthology.orchestra.run.smithi082.stderr:16100000 of 50000000 tuples (32%) done (elapsed 230.14 s, remaining 484.57 s) 2023-09-23T09:01:16.586 INFO:teuthology.orchestra.run.smithi082.stderr:16200000 of 50000000 tuples (32%) done (elapsed 231.33 s, remaining 482.65 s) 2023-09-23T09:01:16.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:01:16 smithi082 ceph-mon[97694]: pgmap v134: 97 pgs: 97 active+clean; 3.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 34 MiB/s wr, 43 op/s 2023-09-23T09:01:16.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:01:16 smithi161 ceph-mon[99580]: pgmap v134: 97 pgs: 97 active+clean; 3.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 34 MiB/s wr, 43 op/s 2023-09-23T09:01:17.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:01:16 smithi135 ceph-mon[99205]: pgmap v134: 97 pgs: 97 active+clean; 3.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 34 MiB/s wr, 43 op/s 2023-09-23T09:01:17.866 INFO:teuthology.orchestra.run.smithi082.stderr:16300000 of 50000000 tuples (32%) done (elapsed 232.61 s, remaining 480.91 s) 2023-09-23T09:01:18.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:01:18 smithi082 ceph-mon[97694]: pgmap v135: 97 pgs: 97 active+clean; 3.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 21 MiB/s wr, 20 op/s 2023-09-23T09:01:18.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:01:18 smithi161 ceph-mon[99580]: pgmap v135: 97 pgs: 97 active+clean; 3.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 21 MiB/s wr, 20 op/s 2023-09-23T09:01:19.028 INFO:teuthology.orchestra.run.smithi082.stderr:16400000 of 50000000 tuples (32%) done (elapsed 233.77 s, remaining 478.94 s) 2023-09-23T09:01:19.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:01:18 smithi135 ceph-mon[99205]: pgmap v135: 97 pgs: 97 active+clean; 3.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 21 MiB/s wr, 20 op/s 2023-09-23T09:01:20.221 INFO:teuthology.orchestra.run.smithi082.stderr:16500000 of 50000000 tuples (33%) done (elapsed 234.96 s, remaining 477.05 s) 2023-09-23T09:01:20.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:01:20 smithi082 ceph-mon[97694]: pgmap v136: 97 pgs: 97 active+clean; 3.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 31 MiB/s wr, 29 op/s 2023-09-23T09:01:20.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:01:20 smithi161 ceph-mon[99580]: pgmap v136: 97 pgs: 97 active+clean; 3.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 31 MiB/s wr, 29 op/s 2023-09-23T09:01:21.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:01:20 smithi135 ceph-mon[99205]: pgmap v136: 97 pgs: 97 active+clean; 3.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 31 MiB/s wr, 29 op/s 2023-09-23T09:01:21.419 INFO:teuthology.orchestra.run.smithi082.stderr:16600000 of 50000000 tuples (33%) done (elapsed 236.16 s, remaining 475.17 s) 2023-09-23T09:01:22.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:01:22 smithi082 ceph-mon[97694]: pgmap v137: 97 pgs: 97 active+clean; 3.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 20 MiB/s wr, 19 op/s 2023-09-23T09:01:22.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:01:22 smithi161 ceph-mon[99580]: pgmap v137: 97 pgs: 97 active+clean; 3.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 20 MiB/s wr, 19 op/s 2023-09-23T09:01:22.953 INFO:teuthology.orchestra.run.smithi082.stderr:16700000 of 50000000 tuples (33%) done (elapsed 237.69 s, remaining 473.97 s) 2023-09-23T09:01:23.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:01:22 smithi135 ceph-mon[99205]: pgmap v137: 97 pgs: 97 active+clean; 3.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 20 MiB/s wr, 19 op/s 2023-09-23T09:01:24.076 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:01:24.197 INFO:teuthology.orchestra.run.smithi082.stderr:16800000 of 50000000 tuples (33%) done (elapsed 238.94 s, remaining 472.19 s) 2023-09-23T09:01:24.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.347+0000 7f8cdc7ff700 1 -- 172.21.15.82:0/4265482510 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cd41068a0 msgr2=0x7f8cd4106c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:01:24.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.347+0000 7f8cdc7ff700 1 --2- 172.21.15.82:0/4265482510 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cd41068a0 0x7f8cd4106c80 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f8cd0009990 tx=0x7f8cd0009ca0 comp rx=0 tx=0).stop 2023-09-23T09:01:24.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.347+0000 7f8cdc7ff700 1 -- 172.21.15.82:0/4265482510 shutdown_connections 2023-09-23T09:01:24.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.347+0000 7f8cdc7ff700 1 --2- 172.21.15.82:0/4265482510 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8cd4101250 0x7f8cd410d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:01:24.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.347+0000 7f8cdc7ff700 1 --2- 172.21.15.82:0/4265482510 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cd41068a0 0x7f8cd4106c80 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:01:24.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.347+0000 7f8cdc7ff700 1 --2- 172.21.15.82:0/4265482510 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cd4100890 0x7f8cd4100d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:01:24.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.347+0000 7f8cdc7ff700 1 -- 172.21.15.82:0/4265482510 >> 172.21.15.82:0/4265482510 conn(0x7f8cd40fc380 msgr2=0x7f8cd40fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:01:24.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.348+0000 7f8cdc7ff700 1 -- 172.21.15.82:0/4265482510 shutdown_connections 2023-09-23T09:01:24.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.348+0000 7f8cdc7ff700 1 -- 172.21.15.82:0/4265482510 wait complete. 2023-09-23T09:01:24.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.349+0000 7f8cdc7ff700 1 Processor -- start 2023-09-23T09:01:24.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.349+0000 7f8cdc7ff700 1 -- start start 2023-09-23T09:01:24.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.349+0000 7f8cdc7ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cd4100890 0x7f8cd419e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:01:24.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.349+0000 7f8cdc7ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cd4101250 0x7f8cd419ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:01:24.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.349+0000 7f8cdc7ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8cd41068a0 0x7f8cd41988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:01:24.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.350+0000 7f8cdc7ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd4198f30 con 0x7f8cd4100890 2023-09-23T09:01:24.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.350+0000 7f8cdc7ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd41990a0 con 0x7f8cd4101250 2023-09-23T09:01:24.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.350+0000 7f8cdc7ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd4199260 con 0x7f8cd41068a0 2023-09-23T09:01:24.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.350+0000 7f8cda59b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cd4100890 0x7f8cd419e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:01:24.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.350+0000 7f8cd9d9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cd4101250 0x7f8cd419ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:01:24.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.350+0000 7f8cdad9c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8cd41068a0 0x7f8cd41988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:01:24.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.350+0000 7f8cd9d9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cd4101250 0x7f8cd419ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:56064/0 (socket says 172.21.15.82:56064) 2023-09-23T09:01:24.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.350+0000 7f8cd9d9a700 1 -- 172.21.15.82:0/3627998873 learned_addr learned my addr 172.21.15.82:0/3627998873 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:01:24.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.350+0000 7f8cd9d9a700 1 -- 172.21.15.82:0/3627998873 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8cd41068a0 msgr2=0x7f8cd41988c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:01:24.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.350+0000 7f8cd9d9a700 1 --2- 172.21.15.82:0/3627998873 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8cd41068a0 0x7f8cd41988c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:01:24.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.350+0000 7f8cd9d9a700 1 -- 172.21.15.82:0/3627998873 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cd4100890 msgr2=0x7f8cd419e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:01:24.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.350+0000 7f8cd9d9a700 1 --2- 172.21.15.82:0/3627998873 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cd4100890 0x7f8cd419e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:01:24.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.350+0000 7f8cd9d9a700 1 -- 172.21.15.82:0/3627998873 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cd00095f0 con 0x7f8cd4101250 2023-09-23T09:01:24.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.351+0000 7f8cd9d9a700 1 --2- 172.21.15.82:0/3627998873 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cd4101250 0x7f8cd419ed90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8cc400e9a0 tx=0x7f8cc400ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:01:24.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.351+0000 7f8ccb7fe700 1 -- 172.21.15.82:0/3627998873 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc4009790 con 0x7f8cd4101250 2023-09-23T09:01:24.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.351+0000 7f8cdc7ff700 1 -- 172.21.15.82:0/3627998873 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cd4199540 con 0x7f8cd4101250 2023-09-23T09:01:24.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.351+0000 7f8ccb7fe700 1 -- 172.21.15.82:0/3627998873 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8cc4010430 con 0x7f8cd4101250 2023-09-23T09:01:24.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.351+0000 7f8ccb7fe700 1 -- 172.21.15.82:0/3627998873 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc400cea0 con 0x7f8cd4101250 2023-09-23T09:01:24.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.351+0000 7f8cdc7ff700 1 -- 172.21.15.82:0/3627998873 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cd41a5840 con 0x7f8cd4101250 2023-09-23T09:01:24.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.356+0000 7f8ccb7fe700 1 -- 172.21.15.82:0/3627998873 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f8cc40105a0 con 0x7f8cd4101250 2023-09-23T09:01:24.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.357+0000 7f8cf015cb80 1 Processor -- start 2023-09-23T09:01:24.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.357+0000 7f8cf015cb80 1 -- start start 2023-09-23T09:01:24.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.357+0000 7f8ccb7fe700 1 --2- 172.21.15.82:0/3627998873 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f8cc00a00c0 0x7f8cc00a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:01:24.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.357+0000 7f8cf015cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c30fb05380 0x55c30fb05760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:01:24.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.357+0000 7f8cf015cb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c30fb05ca0 0x55c30faff700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:01:24.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.357+0000 7f8ccb7fe700 1 -- 172.21.15.82:0/3627998873 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f8cc4014070 con 0x7f8cd4101250 2023-09-23T09:01:24.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.357+0000 7f8cf015cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c30faffc40 0x55c30fb000a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:01:24.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.357+0000 7f8cf015cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c30fa677b0 con 0x55c30fb05380 2023-09-23T09:01:24.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.357+0000 7f8cf015cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c30fa58780 con 0x55c30faffc40 2023-09-23T09:01:24.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.357+0000 7f8cf015cb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c30fa560a0 con 0x55c30fb05ca0 2023-09-23T09:01:24.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.358+0000 7f8cdad9c700 1 --2- 172.21.15.82:0/3627998873 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f8cc00a00c0 0x7f8cc00a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:01:24.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.358+0000 7f8cda59b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c30fb05380 0x55c30fb05760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:01:24.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.358+0000 7f8cd9d9a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c30fb05ca0 0x55c30faff700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:01:24.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.358+0000 7f8cdad9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c30faffc40 0x55c30fb000a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:01:24.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.358+0000 7f8cd9d9a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c30fb05ca0 0x55c30faff700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:57394/0 (socket says 172.21.15.82:57394) 2023-09-23T09:01:24.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.358+0000 7f8cd9d9a700 1 -- 172.21.15.82:0/3944682197 learned_addr learned my addr 172.21.15.82:0/3944682197 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:01:24.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.358+0000 7f8cd9d9a700 1 -- 172.21.15.82:0/3944682197 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c30faffc40 msgr2=0x55c30fb000a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:01:24.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.358+0000 7f8cd9d9a700 1 --2- 172.21.15.82:0/3944682197 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c30faffc40 0x55c30fb000a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:01:24.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.358+0000 7f8cd9d9a700 1 -- 172.21.15.82:0/3944682197 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c30fb05380 msgr2=0x55c30fb05760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:01:24.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.358+0000 7f8cd9d9a700 1 --2- 172.21.15.82:0/3944682197 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c30fb05380 0x55c30fb05760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:01:24.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.358+0000 7f8cd9d9a700 1 -- 172.21.15.82:0/3944682197 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c30f8d1630 con 0x55c30fb05ca0 2023-09-23T09:01:24.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.358+0000 7f8cdad9c700 1 --2- 172.21.15.82:0/3627998873 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f8cc00a00c0 0x7f8cc00a2580 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc009ec0 tx=0x7f8ccc0092f0 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:01:24.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.359+0000 7f8cd9d9a700 1 --2- 172.21.15.82:0/3944682197 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c30fb05ca0 0x55c30faff700 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8cc4095980 tx=0x7f8cc4098b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a575d94d224a8be server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:01:24.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.359+0000 7f8cc8ff9700 1 -- 172.21.15.82:0/3944682197 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc409cd40 con 0x55c30fb05ca0 2023-09-23T09:01:24.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.359+0000 7f8cc8ff9700 1 -- 172.21.15.82:0/3944682197 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8cc40a0d20 con 0x55c30fb05ca0 2023-09-23T09:01:24.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.359+0000 7f8cc8ff9700 1 -- 172.21.15.82:0/3944682197 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc40986b0 con 0x55c30fb05ca0 2023-09-23T09:01:24.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.360+0000 7f8cf015cb80 1 -- 172.21.15.82:0/3944682197 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c30fb05ca0 msgr2=0x55c30faff700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:01:24.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.360+0000 7f8cf015cb80 1 --2- 172.21.15.82:0/3944682197 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c30fb05ca0 0x55c30faff700 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8cc4095980 tx=0x7f8cc4098b60 comp rx=0 tx=0).stop 2023-09-23T09:01:24.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.360+0000 7f8cf015cb80 1 -- 172.21.15.82:0/3944682197 shutdown_connections 2023-09-23T09:01:24.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.360+0000 7f8cf015cb80 1 --2- 172.21.15.82:0/3944682197 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c30faffc40 0x55c30fb000a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:01:24.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.360+0000 7f8cf015cb80 1 --2- 172.21.15.82:0/3944682197 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c30fb05380 0x55c30fb05760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:01:24.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.360+0000 7f8cf015cb80 1 --2- 172.21.15.82:0/3944682197 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c30fb05ca0 0x55c30faff700 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:01:24.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.360+0000 7f8cf015cb80 1 -- 172.21.15.82:0/3944682197 >> 172.21.15.82:0/3944682197 conn(0x55c30fa740e0 msgr2=0x55c30fafa410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:01:24.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.360+0000 7f8cf015cb80 1 -- 172.21.15.82:0/3944682197 shutdown_connections 2023-09-23T09:01:24.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.360+0000 7f8cf015cb80 1 -- 172.21.15.82:0/3944682197 wait complete. 2023-09-23T09:01:24.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.360+0000 7f8cf015cb80 1 -- start start 2023-09-23T09:01:24.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.361+0000 7f8cf015cb80 1 Processor -- start 2023-09-23T09:01:24.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.361+0000 7f8cf015cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c30faffc40 0x55c30fb0bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:01:24.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.361+0000 7f8cf015cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c30fb05380 0x55c30fb08f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:01:24.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.361+0000 7f8cf015cb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c30fb05ca0 0x55c30fb09690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:01:24.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.361+0000 7f8cf015cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c30fa51990 con 0x55c30faffc40 2023-09-23T09:01:24.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.361+0000 7f8cf015cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c30f9efbb0 con 0x55c30fb05380 2023-09-23T09:01:24.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.361+0000 7f8cf015cb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c30f9ef8b0 con 0x55c30fb05ca0 2023-09-23T09:01:24.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.362+0000 7f8cf015cb80 10 client.0 _ll_register_callbacks cb 0x55c30f939a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:01:24.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.362+0000 7f8cda59b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c30faffc40 0x55c30fb0bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:01:24.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.362+0000 7f8cd9d9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c30fb05380 0x55c30fb08f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:01:24.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.362+0000 7f8cd9d9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c30fb05380 0x55c30fb08f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:56088/0 (socket says 172.21.15.82:56088) 2023-09-23T09:01:24.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.362+0000 7f8cd9d9a700 1 -- 172.21.15.82:0/283380400 learned_addr learned my addr 172.21.15.82:0/283380400 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:01:24.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.362+0000 7f8cdad9c700 1 --2- 172.21.15.82:0/283380400 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c30fb05ca0 0x55c30fb09690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:01:24.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.362+0000 7f8cd9d9a700 1 -- 172.21.15.82:0/283380400 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c30fb05ca0 msgr2=0x55c30fb09690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:01:24.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.362+0000 7f8cd9d9a700 1 --2- 172.21.15.82:0/283380400 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c30fb05ca0 0x55c30fb09690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:01:24.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.362+0000 7f8cd9d9a700 1 -- 172.21.15.82:0/283380400 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c30faffc40 msgr2=0x55c30fb0bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:01:24.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.362+0000 7f8cd9d9a700 1 --2- 172.21.15.82:0/283380400 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c30faffc40 0x55c30fb0bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:01:24.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.362+0000 7f8cd9d9a700 1 -- 172.21.15.82:0/283380400 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cd41a5840 con 0x55c30fb05380 2023-09-23T09:01:24.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.362+0000 7f8cd9d9a700 1 --2- 172.21.15.82:0/283380400 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c30fb05380 0x55c30fb08f50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8cc4098ea0 tx=0x7f8cc4099530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b37f1625eb17b22 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:01:24.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.362+0000 7f8cbdffb700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-09-23T09:01:24.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.363+0000 7f8cbdffb700 1 -- 172.21.15.82:0/283380400 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc40a0d20 con 0x55c30fb05380 2023-09-23T09:01:24.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.363+0000 7f8cbdffb700 1 -- 172.21.15.82:0/283380400 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f8cc409cd40 con 0x55c30fb05380 2023-09-23T09:01:24.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.363+0000 7f8cf015cb80 1 -- 172.21.15.82:0/283380400 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c30facf1c0 con 0x55c30fb05380 2023-09-23T09:01:24.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.363+0000 7f8cbdffb700 1 -- 172.21.15.82:0/283380400 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8cc40a0aa0 con 0x55c30fb05380 2023-09-23T09:01:24.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.363+0000 7f8cf015cb80 10 client.25730 fetch_fsmap learned FSMap version 36 2023-09-23T09:01:24.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.363+0000 7f8cf015cb80 1 -- 172.21.15.82:0/283380400 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55c30f87dde0 con 0x55c30fb05380 2023-09-23T09:01:24.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.363+0000 7f8cbdffb700 1 -- 172.21.15.82:0/283380400 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55c30facf1c0 con 0x55c30fb05380 2023-09-23T09:01:24.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.363+0000 7f8cbdffb700 1 -- 172.21.15.82:0/283380400 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 36) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f8cc40b2070 con 0x55c30fb05380 2023-09-23T09:01:24.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.363+0000 7f8cf015cb80 10 client.25730 fetch_fsmap finished waiting for FSMap version 36 2023-09-23T09:01:24.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.363+0000 7f8cf015cb80 10 client.25730 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:01:24.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.363+0000 7f8cf015cb80 20 client.25730 populate_metadata read hostname 'smithi082' 2023-09-23T09:01:24.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.363+0000 7f8cf015cb80 1 --2- 172.21.15.82:0/283380400 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55c30fb192a0 0x55c30fb1b690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:01:24.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.363+0000 7f8cf015cb80 4 client.25730 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:01:24.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.363+0000 7f8cf015cb80 1 -- 172.21.15.82:0/283380400 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c30f9f7ba0 con 0x55c30fb192a0 2023-09-23T09:01:24.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.364+0000 7f8cda59b700 1 --2- 172.21.15.82:0/283380400 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55c30fb192a0 0x55c30fb1b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:01:24.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.364+0000 7f8cda59b700 1 --2- 172.21.15.82:0/283380400 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55c30fb192a0 0x55c30fb1b690 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e27a91042fb1353 server_cookie=1b35f18a78320f19 in_seq=0 out_seq=0 2023-09-23T09:01:24.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.364+0000 7f8cbdffb700 10 client.25730 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:01:24.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.365+0000 7f8cbdffb700 1 -- 172.21.15.82:0/283380400 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c30f9f7ba0 con 0x55c30fb192a0 2023-09-23T09:01:24.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.365+0000 7f8cbdffb700 10 client.25730 handle_command_reply: tid=0 2023-09-23T09:01:24.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.365+0000 7f8cf015cb80 1 client.25730 shutdown 2023-09-23T09:01:24.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.365+0000 7f8cf015cb80 1 -- 172.21.15.82:0/283380400 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c30fb05380 msgr2=0x55c30fb08f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:01:24.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.365+0000 7f8cf015cb80 1 --2- 172.21.15.82:0/283380400 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c30fb05380 0x55c30fb08f50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8cc4098ea0 tx=0x7f8cc4099530 comp rx=0 tx=0).stop 2023-09-23T09:01:24.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.365+0000 7f8cf015cb80 1 -- 172.21.15.82:0/283380400 shutdown_connections 2023-09-23T09:01:24.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.365+0000 7f8cf015cb80 1 --2- 172.21.15.82:0/283380400 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c30fb05ca0 0x55c30fb09690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:01:24.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.365+0000 7f8cf015cb80 1 --2- 172.21.15.82:0/283380400 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55c30fb192a0 0x55c30fb1b690 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:01:24.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.365+0000 7f8cf015cb80 1 --2- 172.21.15.82:0/283380400 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c30faffc40 0x55c30fb0bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:01:24.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.365+0000 7f8cf015cb80 1 --2- 172.21.15.82:0/283380400 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c30fb05380 0x55c30fb08f50 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:01:24.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.365+0000 7f8cbdffb700 0 client.25730 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:01:24.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.365+0000 7f8cf015cb80 1 -- 172.21.15.82:0/283380400 >> 172.21.15.82:0/283380400 conn(0x55c30fa740e0 msgr2=0x55c30faf4b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:01:24.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.365+0000 7f8cf015cb80 1 -- 172.21.15.82:0/283380400 shutdown_connections 2023-09-23T09:01:24.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.365+0000 7f8cf015cb80 1 -- 172.21.15.82:0/283380400 wait complete. 2023-09-23T09:01:24.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.366+0000 7f8cf015cb80 20 client.25730 trim_cache size 0 max 16384 2023-09-23T09:01:24.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.386+0000 7f8cf015cb80 1 Processor -- start 2023-09-23T09:01:24.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.386+0000 7f8cf015cb80 1 -- start start 2023-09-23T09:01:24.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.387+0000 7f8cf015cb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c30faffc40 0x55c30fafa0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:01:24.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.387+0000 7f8cf015cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c30fb05380 0x55c30fb030f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:01:24.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.387+0000 7f8cf015cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c30fb05ca0 0x55c30fb03630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:01:24.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.387+0000 7f8cf015cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c30f8d3920 con 0x55c30fb05ca0 2023-09-23T09:01:24.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.387+0000 7f8cf015cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c30fb0c2a0 con 0x55c30fb05380 2023-09-23T09:01:24.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.387+0000 7f8cf015cb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c30faf6c80 con 0x55c30faffc40 2023-09-23T09:01:24.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.387+0000 7f8cdad9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c30fb05ca0 0x55c30fb03630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:01:24.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.387+0000 7f8cda59b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c30faffc40 0x55c30fafa0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:01:24.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.387+0000 7f8cda59b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c30faffc40 0x55c30fafa0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:57408/0 (socket says 172.21.15.82:57408) 2023-09-23T09:01:24.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.387+0000 7f8cdad9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c30fb05ca0 0x55c30fb03630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45212/0 (socket says 172.21.15.82:45212) 2023-09-23T09:01:24.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.387+0000 7f8cda59b700 1 -- 172.21.15.82:0/3533275240 learned_addr learned my addr 172.21.15.82:0/3533275240 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:01:24.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.387+0000 7f8cd9d9a700 1 --2- 172.21.15.82:0/3533275240 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c30fb05380 0x55c30fb030f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:01:24.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.387+0000 7f8cda59b700 1 -- 172.21.15.82:0/3533275240 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c30fb05380 msgr2=0x55c30fb030f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:01:24.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.387+0000 7f8cda59b700 1 --2- 172.21.15.82:0/3533275240 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c30fb05380 0x55c30fb030f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:01:24.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.387+0000 7f8cda59b700 1 -- 172.21.15.82:0/3533275240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c30fb05ca0 msgr2=0x55c30fb03630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:01:24.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.387+0000 7f8cda59b700 1 --2- 172.21.15.82:0/3533275240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c30fb05ca0 0x55c30fb03630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:01:24.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.387+0000 7f8cda59b700 1 -- 172.21.15.82:0/3533275240 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c30f866c60 con 0x55c30faffc40 2023-09-23T09:01:24.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.387+0000 7f8cd9d9a700 1 --2- 172.21.15.82:0/3533275240 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c30fb05380 0x55c30fb030f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:01:24.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.388+0000 7f8cda59b700 1 --2- 172.21.15.82:0/3533275240 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c30faffc40 0x55c30fafa0a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8cd0005910 tx=0x7f8cd000b260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d824ba3cc5ee7ad5 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:01:24.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.388+0000 7f8cc97fa700 1 -- 172.21.15.82:0/3533275240 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd002a070 con 0x55c30faffc40 2023-09-23T09:01:24.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.388+0000 7f8cc97fa700 1 -- 172.21.15.82:0/3533275240 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8cd001e040 con 0x55c30faffc40 2023-09-23T09:01:24.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.388+0000 7f8cc97fa700 1 -- 172.21.15.82:0/3533275240 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd001d040 con 0x55c30faffc40 2023-09-23T09:01:24.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.389+0000 7f8cf015cb80 1 -- 172.21.15.82:0/3533275240 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c30faffc40 msgr2=0x55c30fafa0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:01:24.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.389+0000 7f8cf015cb80 1 --2- 172.21.15.82:0/3533275240 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c30faffc40 0x55c30fafa0a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8cd0005910 tx=0x7f8cd000b260 comp rx=0 tx=0).stop 2023-09-23T09:01:24.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.389+0000 7f8cf015cb80 1 -- 172.21.15.82:0/3533275240 shutdown_connections 2023-09-23T09:01:24.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.389+0000 7f8cf015cb80 1 --2- 172.21.15.82:0/3533275240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c30fb05ca0 0x55c30fb03630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:01:24.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.389+0000 7f8cf015cb80 1 --2- 172.21.15.82:0/3533275240 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c30faffc40 0x55c30fafa0a0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:01:24.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.389+0000 7f8cf015cb80 1 --2- 172.21.15.82:0/3533275240 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c30fb05380 0x55c30fb030f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:01:24.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.389+0000 7f8cf015cb80 1 -- 172.21.15.82:0/3533275240 >> 172.21.15.82:0/3533275240 conn(0x55c30fa740e0 msgr2=0x55c30fb00020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:01:24.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.389+0000 7f8cf015cb80 1 -- 172.21.15.82:0/3533275240 shutdown_connections 2023-09-23T09:01:24.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.389+0000 7f8cf015cb80 1 -- 172.21.15.82:0/3533275240 wait complete. 2023-09-23T09:01:24.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.390+0000 7f8cf015cb80 1 -- start start 2023-09-23T09:01:24.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.390+0000 7f8cf015cb80 1 Processor -- start 2023-09-23T09:01:24.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.390+0000 7f8cf015cb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c30faffc40 0x55c30fb10740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:01:24.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.390+0000 7f8cf015cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c30fb05380 0x55c30fb00f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:01:24.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.390+0000 7f8cf015cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c30fb05ca0 0x55c30fb01460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:01:24.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.390+0000 7f8cf015cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c30fb019a0 con 0x55c30fb05380 2023-09-23T09:01:24.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.390+0000 7f8cf015cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c30fb01ae0 con 0x55c30fb05ca0 2023-09-23T09:01:24.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.390+0000 7f8cf015cb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c30fb01ca0 con 0x55c30faffc40 2023-09-23T09:01:24.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.390+0000 7f8cf015cb80 10 client.0 _ll_register_callbacks cb 0x7f8cc4005ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:01:24.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.391+0000 7f8cd9d9a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c30fb05380 0x55c30fb00f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:01:24.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.391+0000 7f8cda59b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c30faffc40 0x55c30fb10740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:01:24.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.391+0000 7f8cda59b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c30faffc40 0x55c30fb10740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:57418/0 (socket says 172.21.15.82:57418) 2023-09-23T09:01:24.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.391+0000 7f8cda59b700 1 -- 172.21.15.82:0/3939979878 learned_addr learned my addr 172.21.15.82:0/3939979878 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:01:24.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.391+0000 7f8cdad9c700 1 --2- 172.21.15.82:0/3939979878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c30fb05ca0 0x55c30fb01460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:01:24.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.391+0000 7f8cda59b700 1 -- 172.21.15.82:0/3939979878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c30fb05ca0 msgr2=0x55c30fb01460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:01:24.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.391+0000 7f8cda59b700 1 --2- 172.21.15.82:0/3939979878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c30fb05ca0 0x55c30fb01460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:01:24.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.391+0000 7f8cda59b700 1 -- 172.21.15.82:0/3939979878 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c30fb05380 msgr2=0x55c30fb00f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:01:24.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.391+0000 7f8cda59b700 1 --2- 172.21.15.82:0/3939979878 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c30fb05380 0x55c30fb00f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:01:24.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.391+0000 7f8cda59b700 1 -- 172.21.15.82:0/3939979878 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c30f87dde0 con 0x55c30faffc40 2023-09-23T09:01:24.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.391+0000 7f8cd9d9a700 1 --2- 172.21.15.82:0/3939979878 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c30fb05380 0x55c30fb00f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:01:24.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.391+0000 7f8cda59b700 1 --2- 172.21.15.82:0/3939979878 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c30faffc40 0x55c30fb10740 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8cd0000c00 tx=0x7f8cd000bd50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0442951b4db57a4 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:01:24.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.391+0000 7f8cbdffb700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T09:01:24.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.392+0000 7f8cbdffb700 1 -- 172.21.15.82:0/3939979878 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd001d050 con 0x55c30faffc40 2023-09-23T09:01:24.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.392+0000 7f8cf015cb80 1 -- 172.21.15.82:0/3939979878 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c30faf28b0 con 0x55c30faffc40 2023-09-23T09:01:24.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.392+0000 7f8cbdffb700 1 -- 172.21.15.82:0/3939979878 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f8cd000b920 con 0x55c30faffc40 2023-09-23T09:01:24.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.392+0000 7f8cbdffb700 1 -- 172.21.15.82:0/3939979878 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8cd002a040 con 0x55c30faffc40 2023-09-23T09:01:24.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.392+0000 7f8cf015cb80 10 client.25780 fetch_fsmap learned FSMap version 36 2023-09-23T09:01:24.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.392+0000 7f8cf015cb80 1 -- 172.21.15.82:0/3939979878 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x7f8cd410e060 con 0x55c30faffc40 2023-09-23T09:01:24.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.392+0000 7f8cbdffb700 1 -- 172.21.15.82:0/3939979878 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55c30faf28b0 con 0x55c30faffc40 2023-09-23T09:01:24.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.393+0000 7f8cbdffb700 1 -- 172.21.15.82:0/3939979878 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 36) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f8cd002f460 con 0x55c30faffc40 2023-09-23T09:01:24.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.393+0000 7f8cf015cb80 10 client.25780 fetch_fsmap finished waiting for FSMap version 36 2023-09-23T09:01:24.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.393+0000 7f8cf015cb80 10 client.25780 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:01:24.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.393+0000 7f8cf015cb80 20 client.25780 populate_metadata read hostname 'smithi082' 2023-09-23T09:01:24.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.393+0000 7f8cf015cb80 1 --2- 172.21.15.82:0/3939979878 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55c30fb6e0d0 0x55c30fb704c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:01:24.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.393+0000 7f8cf015cb80 4 client.25780 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:01:24.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.393+0000 7f8cf015cb80 1 -- 172.21.15.82:0/3939979878 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55c30fa4a970 con 0x55c30fb6e0d0 2023-09-23T09:01:24.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.393+0000 7f8cd9d9a700 1 --2- 172.21.15.82:0/3939979878 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55c30fb6e0d0 0x55c30fb704c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:01:24.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.393+0000 7f8cbdffb700 10 client.25780 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:01:24.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.393+0000 7f8cd9d9a700 1 --2- 172.21.15.82:0/3939979878 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55c30fb6e0d0 0x55c30fb704c0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d659802642762afd server_cookie=57293f8e4d73aab2 in_seq=0 out_seq=0 2023-09-23T09:01:24.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.394+0000 7f8cbdffb700 1 -- 172.21.15.82:0/3939979878 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55c30fa4a970 con 0x55c30fb6e0d0 2023-09-23T09:01:24.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.394+0000 7f8cbdffb700 10 client.25780 handle_command_reply: tid=0 2023-09-23T09:01:24.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.394+0000 7f8cf015cb80 1 client.25780 shutdown 2023-09-23T09:01:24.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.394+0000 7f8cf015cb80 1 -- 172.21.15.82:0/3939979878 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c30faffc40 msgr2=0x55c30fb10740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:01:24.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.394+0000 7f8cf015cb80 1 --2- 172.21.15.82:0/3939979878 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c30faffc40 0x55c30fb10740 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8cd0000c00 tx=0x7f8cd000bd50 comp rx=0 tx=0).stop 2023-09-23T09:01:24.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.394+0000 7f8cf015cb80 1 -- 172.21.15.82:0/3939979878 shutdown_connections 2023-09-23T09:01:24.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.394+0000 7f8cf015cb80 1 --2- 172.21.15.82:0/3939979878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c30fb05ca0 0x55c30fb01460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:01:24.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.394+0000 7f8cf015cb80 1 --2- 172.21.15.82:0/3939979878 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c30faffc40 0x55c30fb10740 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:01:24.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.394+0000 7f8cf015cb80 1 --2- 172.21.15.82:0/3939979878 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55c30fb6e0d0 0x55c30fb704c0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:01:24.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.394+0000 7f8cf015cb80 1 --2- 172.21.15.82:0/3939979878 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c30fb05380 0x55c30fb00f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:01:24.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.394+0000 7f8cbdffb700 0 client.25780 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:01:24.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.394+0000 7f8cf015cb80 1 -- 172.21.15.82:0/3939979878 >> 172.21.15.82:0/3939979878 conn(0x55c30fa740e0 msgr2=0x55c30fafa0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:01:24.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.394+0000 7f8cf015cb80 1 -- 172.21.15.82:0/3939979878 shutdown_connections 2023-09-23T09:01:24.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.394+0000 7f8cf015cb80 1 -- 172.21.15.82:0/3939979878 wait complete. 2023-09-23T09:01:24.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.394+0000 7f8cf015cb80 20 client.25780 trim_cache size 0 max 16384 2023-09-23T09:01:24.404 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:01:24.404 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-23T09:01:24.404 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:01:24.404 INFO:teuthology.orchestra.run.smithi082.stdout: "6f0fe3a6-7212-425d-a0a6-f38e8b42ec13": { 2023-09-23T09:01:24.405 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:01:24.405 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "6f0fe3a6-7212-425d-a0a6-f38e8b42ec13", 2023-09-23T09:01:24.405 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:01:24.405 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:01:24.405 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:01:24.405 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:01:24.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.395+0000 7f8cdc7ff700 1 -- 172.21.15.82:0/3627998873 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f8cc00a00c0 msgr2=0x7f8cc00a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:01:24.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.395+0000 7f8cdc7ff700 1 --2- 172.21.15.82:0/3627998873 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f8cc00a00c0 0x7f8cc00a2580 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc009ec0 tx=0x7f8ccc0092f0 comp rx=0 tx=0).stop 2023-09-23T09:01:24.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.395+0000 7f8cdc7ff700 1 -- 172.21.15.82:0/3627998873 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cd4101250 msgr2=0x7f8cd419ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:01:24.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.395+0000 7f8cdc7ff700 1 --2- 172.21.15.82:0/3627998873 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cd4101250 0x7f8cd419ed90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8cc400e9a0 tx=0x7f8cc400ecb0 comp rx=0 tx=0).stop 2023-09-23T09:01:24.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.395+0000 7f8cdc7ff700 1 -- 172.21.15.82:0/3627998873 shutdown_connections 2023-09-23T09:01:24.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.395+0000 7f8cdc7ff700 1 --2- 172.21.15.82:0/3627998873 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f8cc00a00c0 0x7f8cc00a2580 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:01:24.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.395+0000 7f8cdc7ff700 1 --2- 172.21.15.82:0/3627998873 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8cd41068a0 0x7f8cd41988c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:01:24.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.395+0000 7f8cdc7ff700 1 --2- 172.21.15.82:0/3627998873 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cd4100890 0x7f8cd419e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:01:24.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.395+0000 7f8cdc7ff700 1 --2- 172.21.15.82:0/3627998873 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cd4101250 0x7f8cd419ed90 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:01:24.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.395+0000 7f8cdc7ff700 1 -- 172.21.15.82:0/3627998873 >> 172.21.15.82:0/3627998873 conn(0x7f8cd40fc380 msgr2=0x7f8cd410bc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:01:24.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.395+0000 7f8cdc7ff700 1 -- 172.21.15.82:0/3627998873 shutdown_connections 2023-09-23T09:01:24.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:24.395+0000 7f8cdc7ff700 1 -- 172.21.15.82:0/3627998873 wait complete. 2023-09-23T09:01:24.417 INFO:tasks.cephfs.filesystem:scrub status for tag:6f0fe3a6-7212-425d-a0a6-f38e8b42ec13 - {'path': '/', 'tag': '6f0fe3a6-7212-425d-a0a6-f38e8b42ec13', 'options': 'recursive,force'} 2023-09-23T09:01:24.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:01:24 smithi082 ceph-mon[97694]: pgmap v138: 97 pgs: 97 active+clean; 3.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 19 MiB/s wr, 18 op/s 2023-09-23T09:01:24.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:01:24 smithi161 ceph-mon[99580]: pgmap v138: 97 pgs: 97 active+clean; 3.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 19 MiB/s wr, 18 op/s 2023-09-23T09:01:25.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:01:24 smithi135 ceph-mon[99205]: pgmap v138: 97 pgs: 97 active+clean; 3.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 19 MiB/s wr, 18 op/s 2023-09-23T09:01:25.425 INFO:teuthology.orchestra.run.smithi082.stderr:16900000 of 50000000 tuples (33%) done (elapsed 240.17 s, remaining 470.39 s) 2023-09-23T09:01:26.683 INFO:teuthology.orchestra.run.smithi082.stderr:17000000 of 50000000 tuples (34%) done (elapsed 241.43 s, remaining 468.65 s) 2023-09-23T09:01:26.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:01:26 smithi082 ceph-mon[97694]: pgmap v139: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 31 MiB/s wr, 29 op/s 2023-09-23T09:01:26.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:01:26 smithi161 ceph-mon[99580]: pgmap v139: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 31 MiB/s wr, 29 op/s 2023-09-23T09:01:27.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:01:26 smithi135 ceph-mon[99205]: pgmap v139: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 31 MiB/s wr, 29 op/s 2023-09-23T09:01:27.878 INFO:teuthology.orchestra.run.smithi082.stderr:17100000 of 50000000 tuples (34%) done (elapsed 242.62 s, remaining 466.80 s) 2023-09-23T09:01:28.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:01:28 smithi082 ceph-mon[97694]: pgmap v140: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 22 MiB/s wr, 20 op/s 2023-09-23T09:01:28.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:01:28 smithi161 ceph-mon[99580]: pgmap v140: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 22 MiB/s wr, 20 op/s 2023-09-23T09:01:29.059 INFO:teuthology.orchestra.run.smithi082.stderr:17200000 of 50000000 tuples (34%) done (elapsed 243.80 s, remaining 464.92 s) 2023-09-23T09:01:29.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:01:28 smithi135 ceph-mon[99205]: pgmap v140: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 22 MiB/s wr, 20 op/s 2023-09-23T09:01:30.216 INFO:teuthology.orchestra.run.smithi082.stderr:17300000 of 50000000 tuples (34%) done (elapsed 244.96 s, remaining 463.01 s) 2023-09-23T09:01:30.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:01:30 smithi082 ceph-mon[97694]: pgmap v141: 97 pgs: 97 active+clean; 4.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 33 MiB/s wr, 31 op/s 2023-09-23T09:01:30.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:01:30 smithi161 ceph-mon[99580]: pgmap v141: 97 pgs: 97 active+clean; 4.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 33 MiB/s wr, 31 op/s 2023-09-23T09:01:31.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:01:30 smithi135 ceph-mon[99205]: pgmap v141: 97 pgs: 97 active+clean; 4.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 33 MiB/s wr, 31 op/s 2023-09-23T09:01:31.480 INFO:teuthology.orchestra.run.smithi082.stderr:17400000 of 50000000 tuples (34%) done (elapsed 246.22 s, remaining 461.31 s) 2023-09-23T09:01:32.650 INFO:teuthology.orchestra.run.smithi082.stderr:17500000 of 50000000 tuples (35%) done (elapsed 247.39 s, remaining 459.44 s) 2023-09-23T09:01:32.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:01:32 smithi082 ceph-mon[97694]: pgmap v142: 97 pgs: 97 active+clean; 4.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 MiB/s wr, 24 op/s 2023-09-23T09:01:32.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:01:32 smithi161 ceph-mon[99580]: pgmap v142: 97 pgs: 97 active+clean; 4.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 MiB/s wr, 24 op/s 2023-09-23T09:01:33.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:01:32 smithi135 ceph-mon[99205]: pgmap v142: 97 pgs: 97 active+clean; 4.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 MiB/s wr, 24 op/s 2023-09-23T09:01:33.920 INFO:teuthology.orchestra.run.smithi082.stderr:17600000 of 50000000 tuples (35%) done (elapsed 248.66 s, remaining 457.76 s) 2023-09-23T09:01:34.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:01:34 smithi082 ceph-mon[97694]: pgmap v143: 97 pgs: 97 active+clean; 4.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 24 MiB/s wr, 23 op/s 2023-09-23T09:01:34.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:01:34 smithi161 ceph-mon[99580]: pgmap v143: 97 pgs: 97 active+clean; 4.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 24 MiB/s wr, 23 op/s 2023-09-23T09:01:35.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:01:34 smithi135 ceph-mon[99205]: pgmap v143: 97 pgs: 97 active+clean; 4.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 24 MiB/s wr, 23 op/s 2023-09-23T09:01:35.254 INFO:teuthology.orchestra.run.smithi082.stderr:17700000 of 50000000 tuples (35%) done (elapsed 250.00 s, remaining 456.21 s) 2023-09-23T09:01:36.473 INFO:teuthology.orchestra.run.smithi082.stderr:17800000 of 50000000 tuples (35%) done (elapsed 251.22 s, remaining 454.45 s) 2023-09-23T09:01:36.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:01:36 smithi082 ceph-mon[97694]: pgmap v144: 97 pgs: 97 active+clean; 4.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 36 MiB/s wr, 42 op/s 2023-09-23T09:01:36.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:01:36 smithi161 ceph-mon[99580]: pgmap v144: 97 pgs: 97 active+clean; 4.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 36 MiB/s wr, 42 op/s 2023-09-23T09:01:37.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:01:36 smithi135 ceph-mon[99205]: pgmap v144: 97 pgs: 97 active+clean; 4.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 36 MiB/s wr, 42 op/s 2023-09-23T09:01:37.690 INFO:teuthology.orchestra.run.smithi082.stderr:17900000 of 50000000 tuples (35%) done (elapsed 252.43 s, remaining 452.69 s) 2023-09-23T09:01:38.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:01:38 smithi082 ceph-mon[97694]: pgmap v145: 97 pgs: 97 active+clean; 4.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 24 MiB/s wr, 31 op/s 2023-09-23T09:01:38.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:01:38 smithi161 ceph-mon[99580]: pgmap v145: 97 pgs: 97 active+clean; 4.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 24 MiB/s wr, 31 op/s 2023-09-23T09:01:38.969 INFO:teuthology.orchestra.run.smithi082.stderr:18000000 of 50000000 tuples (36%) done (elapsed 253.71 s, remaining 451.04 s) 2023-09-23T09:01:39.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:01:38 smithi135 ceph-mon[99205]: pgmap v145: 97 pgs: 97 active+clean; 4.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 24 MiB/s wr, 31 op/s 2023-09-23T09:01:40.172 INFO:teuthology.orchestra.run.smithi082.stderr:18100000 of 50000000 tuples (36%) done (elapsed 254.91 s, remaining 449.27 s) 2023-09-23T09:01:40.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:01:40 smithi161 ceph-mon[99580]: pgmap v146: 97 pgs: 97 active+clean; 4.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 34 MiB/s wr, 48 op/s 2023-09-23T09:01:41.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:01:40 smithi135 ceph-mon[99205]: pgmap v146: 97 pgs: 97 active+clean; 4.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 34 MiB/s wr, 48 op/s 2023-09-23T09:01:41.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:01:40 smithi082 ceph-mon[97694]: pgmap v146: 97 pgs: 97 active+clean; 4.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 34 MiB/s wr, 48 op/s 2023-09-23T09:01:41.390 INFO:teuthology.orchestra.run.smithi082.stderr:18200000 of 50000000 tuples (36%) done (elapsed 256.13 s, remaining 447.53 s) 2023-09-23T09:01:42.658 INFO:teuthology.orchestra.run.smithi082.stderr:18300000 of 50000000 tuples (36%) done (elapsed 257.40 s, remaining 445.88 s) 2023-09-23T09:01:42.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:01:42 smithi161 ceph-mon[99580]: pgmap v147: 97 pgs: 97 active+clean; 4.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 26 MiB/s wr, 39 op/s 2023-09-23T09:01:42.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:01:42 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:01:43.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:01:42 smithi135 ceph-mon[99205]: pgmap v147: 97 pgs: 97 active+clean; 4.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 26 MiB/s wr, 39 op/s 2023-09-23T09:01:43.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:01:42 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:01:43.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:01:42 smithi082 ceph-mon[97694]: pgmap v147: 97 pgs: 97 active+clean; 4.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 26 MiB/s wr, 39 op/s 2023-09-23T09:01:43.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:01:42 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:01:43.944 INFO:teuthology.orchestra.run.smithi082.stderr:18400000 of 50000000 tuples (36%) done (elapsed 258.69 s, remaining 444.26 s) 2023-09-23T09:01:44.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:01:44 smithi161 ceph-mon[99580]: pgmap v148: 97 pgs: 97 active+clean; 4.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 24 MiB/s wr, 38 op/s 2023-09-23T09:01:45.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:01:44 smithi135 ceph-mon[99205]: pgmap v148: 97 pgs: 97 active+clean; 4.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 24 MiB/s wr, 38 op/s 2023-09-23T09:01:45.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:01:44 smithi082 ceph-mon[97694]: pgmap v148: 97 pgs: 97 active+clean; 4.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 24 MiB/s wr, 38 op/s 2023-09-23T09:01:45.174 INFO:teuthology.orchestra.run.smithi082.stderr:18500000 of 50000000 tuples (37%) done (elapsed 259.92 s, remaining 442.56 s) 2023-09-23T09:01:46.404 INFO:teuthology.orchestra.run.smithi082.stderr:18600000 of 50000000 tuples (37%) done (elapsed 261.15 s, remaining 440.86 s) 2023-09-23T09:01:46.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:01:46 smithi161 ceph-mon[99580]: pgmap v149: 97 pgs: 97 active+clean; 4.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 36 MiB/s wr, 60 op/s 2023-09-23T09:01:47.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:01:46 smithi135 ceph-mon[99205]: pgmap v149: 97 pgs: 97 active+clean; 4.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 36 MiB/s wr, 60 op/s 2023-09-23T09:01:47.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:01:46 smithi082 ceph-mon[97694]: pgmap v149: 97 pgs: 97 active+clean; 4.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 36 MiB/s wr, 60 op/s 2023-09-23T09:01:47.778 INFO:teuthology.orchestra.run.smithi082.stderr:18700000 of 50000000 tuples (37%) done (elapsed 262.52 s, remaining 439.40 s) 2023-09-23T09:01:47.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:01:47 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:01:48.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:01:47 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:01:48.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:01:47 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:01:49.004 INFO:teuthology.orchestra.run.smithi082.stderr:18800000 of 50000000 tuples (37%) done (elapsed 263.75 s, remaining 437.71 s) 2023-09-23T09:01:49.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:01:48 smithi135 ceph-mon[99205]: pgmap v150: 97 pgs: 97 active+clean; 4.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 24 MiB/s wr, 41 op/s 2023-09-23T09:01:49.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:01:48 smithi082 ceph-mon[97694]: pgmap v150: 97 pgs: 97 active+clean; 4.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 24 MiB/s wr, 41 op/s 2023-09-23T09:01:49.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:01:48 smithi161 ceph-mon[99580]: pgmap v150: 97 pgs: 97 active+clean; 4.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 24 MiB/s wr, 41 op/s 2023-09-23T09:01:50.214 INFO:teuthology.orchestra.run.smithi082.stderr:18900000 of 50000000 tuples (37%) done (elapsed 264.96 s, remaining 435.99 s) 2023-09-23T09:01:51.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:01:50 smithi135 ceph-mon[99205]: pgmap v151: 97 pgs: 97 active+clean; 4.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 35 MiB/s wr, 79 op/s 2023-09-23T09:01:51.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:01:50 smithi082 ceph-mon[97694]: pgmap v151: 97 pgs: 97 active+clean; 4.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 35 MiB/s wr, 79 op/s 2023-09-23T09:01:51.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:01:50 smithi161 ceph-mon[99580]: pgmap v151: 97 pgs: 97 active+clean; 4.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 35 MiB/s wr, 79 op/s 2023-09-23T09:01:51.422 INFO:teuthology.orchestra.run.smithi082.stderr:19000000 of 50000000 tuples (38%) done (elapsed 266.16 s, remaining 434.27 s) 2023-09-23T09:01:52.718 INFO:teuthology.orchestra.run.smithi082.stderr:19100000 of 50000000 tuples (38%) done (elapsed 267.46 s, remaining 432.70 s) 2023-09-23T09:01:53.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:01:52 smithi135 ceph-mon[99205]: pgmap v152: 97 pgs: 97 active+clean; 4.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 26 MiB/s wr, 65 op/s 2023-09-23T09:01:53.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:01:52 smithi082 ceph-mon[97694]: pgmap v152: 97 pgs: 97 active+clean; 4.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 26 MiB/s wr, 65 op/s 2023-09-23T09:01:53.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:01:52 smithi161 ceph-mon[99580]: pgmap v152: 97 pgs: 97 active+clean; 4.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 26 MiB/s wr, 65 op/s 2023-09-23T09:01:53.936 INFO:teuthology.orchestra.run.smithi082.stderr:19200000 of 50000000 tuples (38%) done (elapsed 268.68 s, remaining 431.01 s) 2023-09-23T09:01:54.417 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:01:54.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.638+0000 7f5099fff700 1 -- 172.21.15.82:0/2382104521 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5094101250 msgr2=0x7f509410d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:01:54.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.638+0000 7f5099fff700 1 --2- 172.21.15.82:0/2382104521 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5094101250 0x7f509410d760 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f508c009f90 tx=0x7f508c00b330 comp rx=0 tx=0).stop 2023-09-23T09:01:54.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.639+0000 7f5099fff700 1 -- 172.21.15.82:0/2382104521 shutdown_connections 2023-09-23T09:01:54.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.639+0000 7f5099fff700 1 --2- 172.21.15.82:0/2382104521 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5094101250 0x7f509410d760 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:01:54.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.639+0000 7f5099fff700 1 --2- 172.21.15.82:0/2382104521 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f50941068a0 0x7f5094106c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:01:54.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.639+0000 7f5099fff700 1 --2- 172.21.15.82:0/2382104521 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5094100890 0x7f5094100d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:01:54.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.639+0000 7f5099fff700 1 -- 172.21.15.82:0/2382104521 >> 172.21.15.82:0/2382104521 conn(0x7f50940fc380 msgr2=0x7f50940fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:01:54.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.639+0000 7f5099fff700 1 -- 172.21.15.82:0/2382104521 shutdown_connections 2023-09-23T09:01:54.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.639+0000 7f5099fff700 1 -- 172.21.15.82:0/2382104521 wait complete. 2023-09-23T09:01:54.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.640+0000 7f5099fff700 1 Processor -- start 2023-09-23T09:01:54.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.640+0000 7f5099fff700 1 -- start start 2023-09-23T09:01:54.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.640+0000 7f5099fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5094100890 0x7f509419e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:01:54.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.640+0000 7f5099fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5094101250 0x7f509419eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:01:54.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.640+0000 7f5099fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f50941068a0 0x7f50941989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:01:54.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.640+0000 7f5099fff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5094199040 con 0x7f5094101250 2023-09-23T09:01:54.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.640+0000 7f5099fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50941991b0 con 0x7f50941068a0 2023-09-23T09:01:54.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.640+0000 7f5099fff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5094199370 con 0x7f5094100890 2023-09-23T09:01:54.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.641+0000 7f50937fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5094100890 0x7f509419e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:01:54.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.641+0000 7f5092ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5094101250 0x7f509419eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:01:54.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.641+0000 7f50937fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5094100890 0x7f509419e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:48702/0 (socket says 172.21.15.82:48702) 2023-09-23T09:01:54.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.641+0000 7f50937fe700 1 -- 172.21.15.82:0/3299387604 learned_addr learned my addr 172.21.15.82:0/3299387604 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:01:54.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.641+0000 7f5093fff700 1 --2- 172.21.15.82:0/3299387604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f50941068a0 0x7f50941989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:01:54.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.641+0000 7f5092ffd700 1 -- 172.21.15.82:0/3299387604 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5094100890 msgr2=0x7f509419e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:01:54.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.641+0000 7f5092ffd700 1 --2- 172.21.15.82:0/3299387604 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5094100890 0x7f509419e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:01:54.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.641+0000 7f5092ffd700 1 -- 172.21.15.82:0/3299387604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f50941068a0 msgr2=0x7f50941989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:01:54.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.641+0000 7f5092ffd700 1 --2- 172.21.15.82:0/3299387604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f50941068a0 0x7f50941989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:01:54.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.641+0000 7f5092ffd700 1 -- 172.21.15.82:0/3299387604 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50880095f0 con 0x7f5094101250 2023-09-23T09:01:54.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.641+0000 7f50937fe700 1 --2- 172.21.15.82:0/3299387604 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5094100890 0x7f509419e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:01:54.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.641+0000 7f5092ffd700 1 --2- 172.21.15.82:0/3299387604 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5094101250 0x7f509419eea0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f508800eb90 tx=0x7f508800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:01:54.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.642+0000 7f5090ff9700 1 -- 172.21.15.82:0/3299387604 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5088009970 con 0x7f5094101250 2023-09-23T09:01:54.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.642+0000 7f5090ff9700 1 -- 172.21.15.82:0/3299387604 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f50880044b0 con 0x7f5094101250 2023-09-23T09:01:54.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.642+0000 7f5099fff700 1 -- 172.21.15.82:0/3299387604 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f508c009c40 con 0x7f5094101250 2023-09-23T09:01:54.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.642+0000 7f5090ff9700 1 -- 172.21.15.82:0/3299387604 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5088003d70 con 0x7f5094101250 2023-09-23T09:01:54.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.642+0000 7f5099fff700 1 -- 172.21.15.82:0/3299387604 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50941a5770 con 0x7f5094101250 2023-09-23T09:01:54.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.647+0000 7f5090ff9700 1 -- 172.21.15.82:0/3299387604 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f5088003f10 con 0x7f5094101250 2023-09-23T09:01:54.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.648+0000 7f50ad9ebb80 1 Processor -- start 2023-09-23T09:01:54.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.648+0000 7f50ad9ebb80 1 -- start start 2023-09-23T09:01:54.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.648+0000 7f50ad9ebb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627adc5a380 0x5627adc5a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:01:54.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.648+0000 7f50ad9ebb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5627adc5aca0 0x5627adc54700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:01:54.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.648+0000 7f50ad9ebb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5627adc54c40 0x5627adc550a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:01:54.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.648+0000 7f50ad9ebb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627adbbc7b0 con 0x5627adc54c40 2023-09-23T09:01:54.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.648+0000 7f50ad9ebb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627adbad780 con 0x5627adc5a380 2023-09-23T09:01:54.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.648+0000 7f50ad9ebb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627adbab0a0 con 0x5627adc5aca0 2023-09-23T09:01:54.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.649+0000 7f5093fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627adc5a380 0x5627adc5a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:01:54.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.649+0000 7f5093fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627adc5a380 0x5627adc5a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:59146/0 (socket says 172.21.15.82:59146) 2023-09-23T09:01:54.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.649+0000 7f5093fff700 1 -- 172.21.15.82:0/3813616909 learned_addr learned my addr 172.21.15.82:0/3813616909 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:01:54.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.649+0000 7f50937fe700 1 --2- 172.21.15.82:0/3813616909 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5627adc5aca0 0x5627adc54700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:01:54.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.649+0000 7f5090ff9700 1 --2- 172.21.15.82:0/3299387604 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f507c0a00c0 0x7f507c0a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:01:54.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.649+0000 7f5092ffd700 1 --2- 172.21.15.82:0/3813616909 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5627adc54c40 0x5627adc550a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:01:54.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.649+0000 7f5093fff700 1 -- 172.21.15.82:0/3813616909 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5627adc5aca0 msgr2=0x5627adc54700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:01:54.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.649+0000 7f5093fff700 1 --2- 172.21.15.82:0/3813616909 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5627adc5aca0 0x5627adc54700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:01:54.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.649+0000 7f5093fff700 1 -- 172.21.15.82:0/3813616909 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5627adc54c40 msgr2=0x5627adc550a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:01:54.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.649+0000 7f5090ff9700 1 -- 172.21.15.82:0/3299387604 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f5088014070 con 0x7f5094101250 2023-09-23T09:01:54.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.649+0000 7f5093fff700 1 --2- 172.21.15.82:0/3813616909 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5627adc54c40 0x5627adc550a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:01:54.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.649+0000 7f5093fff700 1 -- 172.21.15.82:0/3813616909 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5627ada26630 con 0x5627adc5a380 2023-09-23T09:01:54.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.649+0000 7f50937fe700 1 --2- 172.21.15.82:0/3813616909 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5627adc5aca0 0x5627adc54700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:01:54.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.649+0000 7f5093fff700 1 --2- 172.21.15.82:0/3299387604 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f507c0a00c0 0x7f507c0a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:01:54.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.650+0000 7f5093fff700 1 --2- 172.21.15.82:0/3813616909 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627adc5a380 0x5627adc5a760 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f508c015000 tx=0x7f508c009460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e5b08975bb769ad server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:01:54.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.650+0000 7f5079ffb700 1 -- 172.21.15.82:0/3813616909 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f508c00e040 con 0x5627adc5a380 2023-09-23T09:01:54.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.650+0000 7f5079ffb700 1 -- 172.21.15.82:0/3813616909 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f508c00be80 con 0x5627adc5a380 2023-09-23T09:01:54.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.650+0000 7f5079ffb700 1 -- 172.21.15.82:0/3813616909 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f508c027750 con 0x5627adc5a380 2023-09-23T09:01:54.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.650+0000 7f5093fff700 1 --2- 172.21.15.82:0/3299387604 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f507c0a00c0 0x7f507c0a2580 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f508c029000 tx=0x7f508c026000 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:01:54.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.651+0000 7f50ad9ebb80 1 -- 172.21.15.82:0/3813616909 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627adc5a380 msgr2=0x5627adc5a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:01:54.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.651+0000 7f50ad9ebb80 1 --2- 172.21.15.82:0/3813616909 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627adc5a380 0x5627adc5a760 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f508c015000 tx=0x7f508c009460 comp rx=0 tx=0).stop 2023-09-23T09:01:54.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.651+0000 7f50ad9ebb80 1 -- 172.21.15.82:0/3813616909 shutdown_connections 2023-09-23T09:01:54.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.651+0000 7f50ad9ebb80 1 --2- 172.21.15.82:0/3813616909 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5627adc54c40 0x5627adc550a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:01:54.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.651+0000 7f50ad9ebb80 1 --2- 172.21.15.82:0/3813616909 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627adc5a380 0x5627adc5a760 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:01:54.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.651+0000 7f50ad9ebb80 1 --2- 172.21.15.82:0/3813616909 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5627adc5aca0 0x5627adc54700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:01:54.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.651+0000 7f50ad9ebb80 1 -- 172.21.15.82:0/3813616909 >> 172.21.15.82:0/3813616909 conn(0x5627adbc90e0 msgr2=0x5627adc4f410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:01:54.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.651+0000 7f50ad9ebb80 1 -- 172.21.15.82:0/3813616909 shutdown_connections 2023-09-23T09:01:54.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.651+0000 7f50ad9ebb80 1 -- 172.21.15.82:0/3813616909 wait complete. 2023-09-23T09:01:54.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.652+0000 7f50ad9ebb80 1 -- start start 2023-09-23T09:01:54.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.652+0000 7f50ad9ebb80 1 Processor -- start 2023-09-23T09:01:54.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.653+0000 7f50ad9ebb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627adc54c40 0x5627adc60c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:01:54.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.653+0000 7f50ad9ebb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5627adc5a380 0x5627adc5df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:01:54.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.653+0000 7f50ad9ebb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5627adc5aca0 0x5627adc5e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:01:54.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.653+0000 7f50ad9ebb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627adba6990 con 0x5627adc5a380 2023-09-23T09:01:54.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.653+0000 7f50ad9ebb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627adb44bb0 con 0x5627adc54c40 2023-09-23T09:01:54.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.653+0000 7f50ad9ebb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627adb448b0 con 0x5627adc5aca0 2023-09-23T09:01:54.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.653+0000 7f50ad9ebb80 10 client.0 _ll_register_callbacks cb 0x5627ada8ea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:01:54.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.653+0000 7f5092ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5627adc5a380 0x5627adc5df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:01:54.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.653+0000 7f50937fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627adc54c40 0x5627adc60c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:01:54.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.653+0000 7f5092ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5627adc5a380 0x5627adc5df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55262/0 (socket says 172.21.15.82:55262) 2023-09-23T09:01:54.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.653+0000 7f5092ffd700 1 -- 172.21.15.82:0/4217946636 learned_addr learned my addr 172.21.15.82:0/4217946636 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:01:54.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.653+0000 7f5093fff700 1 --2- 172.21.15.82:0/4217946636 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5627adc5aca0 0x5627adc5e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:01:54.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.653+0000 7f50937fe700 1 -- 172.21.15.82:0/4217946636 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5627adc5aca0 msgr2=0x5627adc5e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:01:54.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.653+0000 7f50937fe700 1 --2- 172.21.15.82:0/4217946636 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5627adc5aca0 0x5627adc5e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:01:54.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.653+0000 7f50937fe700 1 -- 172.21.15.82:0/4217946636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5627adc5a380 msgr2=0x5627adc5df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:01:54.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.653+0000 7f50937fe700 1 --2- 172.21.15.82:0/4217946636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5627adc5a380 0x5627adc5df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:01:54.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.653+0000 7f50937fe700 1 -- 172.21.15.82:0/4217946636 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5084009ce0 con 0x5627adc54c40 2023-09-23T09:01:54.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.654+0000 7f50937fe700 1 --2- 172.21.15.82:0/4217946636 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627adc54c40 0x5627adc60c80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f50840096b0 tx=0x7f5084009f80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=353032bb09e514e9 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:01:54.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.654+0000 7f5072ffd700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-09-23T09:01:54.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.654+0000 7f5072ffd700 1 -- 172.21.15.82:0/4217946636 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5084016070 con 0x5627adc54c40 2023-09-23T09:01:54.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.654+0000 7f50ad9ebb80 1 -- 172.21.15.82:0/4217946636 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5627adc241c0 con 0x5627adc54c40 2023-09-23T09:01:54.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.654+0000 7f5072ffd700 1 -- 172.21.15.82:0/4217946636 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f508400fc20 con 0x5627adc54c40 2023-09-23T09:01:54.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.654+0000 7f5072ffd700 1 -- 172.21.15.82:0/4217946636 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f508400fde0 con 0x5627adc54c40 2023-09-23T09:01:54.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.654+0000 7f50ad9ebb80 10 client.25748 fetch_fsmap learned FSMap version 38 2023-09-23T09:01:54.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.654+0000 7f50ad9ebb80 1 -- 172.21.15.82:0/4217946636 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) v3 -- 0x7f509410e060 con 0x5627adc54c40 2023-09-23T09:01:54.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.655+0000 7f5072ffd700 1 -- 172.21.15.82:0/4217946636 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5084027020 con 0x5627adc54c40 2023-09-23T09:01:54.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.655+0000 7f5072ffd700 1 -- 172.21.15.82:0/4217946636 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 38) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f5084021070 con 0x5627adc54c40 2023-09-23T09:01:54.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.655+0000 7f50ad9ebb80 10 client.25748 fetch_fsmap finished waiting for FSMap version 38 2023-09-23T09:01:54.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.655+0000 7f50ad9ebb80 10 client.25748 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:01:54.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.655+0000 7f50ad9ebb80 20 client.25748 populate_metadata read hostname 'smithi082' 2023-09-23T09:01:54.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.655+0000 7f50ad9ebb80 1 --2- 172.21.15.82:0/4217946636 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5627adc6e830 0x5627adc70c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:01:54.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.655+0000 7f50ad9ebb80 4 client.25748 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:01:54.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.655+0000 7f50ad9ebb80 1 -- 172.21.15.82:0/4217946636 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5627adb4cba0 con 0x5627adc6e830 2023-09-23T09:01:54.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.655+0000 7f5092ffd700 1 --2- 172.21.15.82:0/4217946636 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5627adc6e830 0x5627adc70c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:01:54.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.656+0000 7f5072ffd700 10 client.25748 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:01:54.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.656+0000 7f5092ffd700 1 --2- 172.21.15.82:0/4217946636 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5627adc6e830 0x5627adc70c50 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f4baa5a5c0bba127 server_cookie=bad379cfb87972f4 in_seq=0 out_seq=0 2023-09-23T09:01:54.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.657+0000 7f5072ffd700 1 -- 172.21.15.82:0/4217946636 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5627adb4cba0 con 0x5627adc6e830 2023-09-23T09:01:54.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.657+0000 7f5072ffd700 10 client.25748 handle_command_reply: tid=0 2023-09-23T09:01:54.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.657+0000 7f50ad9ebb80 1 client.25748 shutdown 2023-09-23T09:01:54.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.657+0000 7f50ad9ebb80 1 -- 172.21.15.82:0/4217946636 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627adc54c40 msgr2=0x5627adc60c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:01:54.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.657+0000 7f50ad9ebb80 1 --2- 172.21.15.82:0/4217946636 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627adc54c40 0x5627adc60c80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f50840096b0 tx=0x7f5084009f80 comp rx=0 tx=0).stop 2023-09-23T09:01:54.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.657+0000 7f50ad9ebb80 1 -- 172.21.15.82:0/4217946636 shutdown_connections 2023-09-23T09:01:54.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.657+0000 7f50ad9ebb80 1 --2- 172.21.15.82:0/4217946636 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5627adc5aca0 0x5627adc5e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:01:54.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.657+0000 7f50ad9ebb80 1 --2- 172.21.15.82:0/4217946636 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627adc54c40 0x5627adc60c80 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:01:54.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.657+0000 7f50ad9ebb80 1 --2- 172.21.15.82:0/4217946636 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5627adc6e830 0x5627adc70c50 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:01:54.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.657+0000 7f50ad9ebb80 1 --2- 172.21.15.82:0/4217946636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5627adc5a380 0x5627adc5df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:01:54.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.657+0000 7f50ad9ebb80 1 -- 172.21.15.82:0/4217946636 >> 172.21.15.82:0/4217946636 conn(0x5627adbc90e0 msgr2=0x5627adc49b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:01:54.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.657+0000 7f5072ffd700 0 client.25748 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:01:54.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.657+0000 7f50ad9ebb80 1 -- 172.21.15.82:0/4217946636 shutdown_connections 2023-09-23T09:01:54.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.657+0000 7f50ad9ebb80 1 -- 172.21.15.82:0/4217946636 wait complete. 2023-09-23T09:01:54.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.657+0000 7f50ad9ebb80 20 client.25748 trim_cache size 0 max 16384 2023-09-23T09:01:54.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.678+0000 7f50ad9ebb80 1 Processor -- start 2023-09-23T09:01:54.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.678+0000 7f50ad9ebb80 1 -- start start 2023-09-23T09:01:54.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.678+0000 7f50ad9ebb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5627adc54c40 0x5627adc5d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:01:54.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.678+0000 7f50ad9ebb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627adc5a380 0x5627adc60820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:01:54.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.678+0000 7f50ad9ebb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5627adc5aca0 0x5627adc58090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:01:54.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.679+0000 7f50ad9ebb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627ada28920 con 0x5627adc5aca0 2023-09-23T09:01:54.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.679+0000 7f50ad9ebb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627adc5f4e0 con 0x5627adc5a380 2023-09-23T09:01:54.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.679+0000 7f50ad9ebb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627adc4bc80 con 0x5627adc54c40 2023-09-23T09:01:54.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.679+0000 7f5093fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5627adc5aca0 0x5627adc58090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:01:54.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.679+0000 7f5093fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5627adc5aca0 0x5627adc58090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55270/0 (socket says 172.21.15.82:55270) 2023-09-23T09:01:54.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.679+0000 7f5093fff700 1 -- 172.21.15.82:0/3050426793 learned_addr learned my addr 172.21.15.82:0/3050426793 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:01:54.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.679+0000 7f50937fe700 1 --2- 172.21.15.82:0/3050426793 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5627adc54c40 0x5627adc5d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:01:54.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.679+0000 7f5092ffd700 1 --2- 172.21.15.82:0/3050426793 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627adc5a380 0x5627adc60820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:01:54.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.679+0000 7f5093fff700 1 -- 172.21.15.82:0/3050426793 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5627adc54c40 msgr2=0x5627adc5d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:01:54.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.679+0000 7f5093fff700 1 --2- 172.21.15.82:0/3050426793 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5627adc54c40 0x5627adc5d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:01:54.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.679+0000 7f5093fff700 1 -- 172.21.15.82:0/3050426793 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627adc5a380 msgr2=0x5627adc60820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:01:54.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.679+0000 7f5093fff700 1 --2- 172.21.15.82:0/3050426793 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627adc5a380 0x5627adc60820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:01:54.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.679+0000 7f5093fff700 1 -- 172.21.15.82:0/3050426793 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5627ad9d2de0 con 0x5627adc5aca0 2023-09-23T09:01:54.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.679+0000 7f5092ffd700 1 --2- 172.21.15.82:0/3050426793 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627adc5a380 0x5627adc60820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:01:54.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.680+0000 7f5093fff700 1 --2- 172.21.15.82:0/3050426793 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5627adc5aca0 0x5627adc58090 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f508c0094d0 tx=0x7f508c006040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63345c19f8459b85 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:01:54.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.680+0000 7f507a7fc700 1 -- 172.21.15.82:0/3050426793 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f508c00e070 con 0x5627adc5aca0 2023-09-23T09:01:54.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.680+0000 7f507a7fc700 1 -- 172.21.15.82:0/3050426793 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f508c027660 con 0x5627adc5aca0 2023-09-23T09:01:54.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.680+0000 7f507a7fc700 1 -- 172.21.15.82:0/3050426793 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f508c00bc50 con 0x5627adc5aca0 2023-09-23T09:01:54.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.681+0000 7f50ad9ebb80 1 -- 172.21.15.82:0/3050426793 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5627adc5aca0 msgr2=0x5627adc58090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:01:54.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.681+0000 7f50ad9ebb80 1 --2- 172.21.15.82:0/3050426793 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5627adc5aca0 0x5627adc58090 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f508c0094d0 tx=0x7f508c006040 comp rx=0 tx=0).stop 2023-09-23T09:01:54.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.681+0000 7f50ad9ebb80 1 -- 172.21.15.82:0/3050426793 shutdown_connections 2023-09-23T09:01:54.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.681+0000 7f50ad9ebb80 1 --2- 172.21.15.82:0/3050426793 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5627adc5aca0 0x5627adc58090 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:01:54.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.681+0000 7f50ad9ebb80 1 --2- 172.21.15.82:0/3050426793 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5627adc54c40 0x5627adc5d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:01:54.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.681+0000 7f50ad9ebb80 1 --2- 172.21.15.82:0/3050426793 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627adc5a380 0x5627adc60820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:01:54.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.681+0000 7f50ad9ebb80 1 -- 172.21.15.82:0/3050426793 >> 172.21.15.82:0/3050426793 conn(0x5627adbc90e0 msgr2=0x5627adc4f0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:01:54.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.681+0000 7f50ad9ebb80 1 -- 172.21.15.82:0/3050426793 shutdown_connections 2023-09-23T09:01:54.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.681+0000 7f50ad9ebb80 1 -- 172.21.15.82:0/3050426793 wait complete. 2023-09-23T09:01:54.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.681+0000 7f50ad9ebb80 1 -- start start 2023-09-23T09:01:54.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.682+0000 7f50ad9ebb80 1 Processor -- start 2023-09-23T09:01:54.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.682+0000 7f50ad9ebb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627adc54c40 0x5627adc57190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:01:54.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.682+0000 7f50ad9ebb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5627adc5a380 0x5627adc576d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:01:54.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.682+0000 7f50ad9ebb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5627adc5aca0 0x5627adc55e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:01:54.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.682+0000 7f50ad9ebb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627adc56340 con 0x5627adc5a380 2023-09-23T09:01:54.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.682+0000 7f50ad9ebb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627adc564b0 con 0x5627adc54c40 2023-09-23T09:01:54.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.682+0000 7f50ad9ebb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627adc56670 con 0x5627adc5aca0 2023-09-23T09:01:54.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.682+0000 7f50ad9ebb80 10 client.0 _ll_register_callbacks cb 0x7f5084011920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:01:54.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.682+0000 7f50937fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627adc54c40 0x5627adc57190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:01:54.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.682+0000 7f5092ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5627adc5a380 0x5627adc576d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:01:54.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.682+0000 7f50937fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627adc54c40 0x5627adc57190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:59176/0 (socket says 172.21.15.82:59176) 2023-09-23T09:01:54.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.682+0000 7f50937fe700 1 -- 172.21.15.82:0/1433320298 learned_addr learned my addr 172.21.15.82:0/1433320298 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:01:54.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.682+0000 7f5093fff700 1 --2- 172.21.15.82:0/1433320298 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5627adc5aca0 0x5627adc55e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:01:54.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.683+0000 7f50937fe700 1 -- 172.21.15.82:0/1433320298 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5627adc5aca0 msgr2=0x5627adc55e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:01:54.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.683+0000 7f50937fe700 1 --2- 172.21.15.82:0/1433320298 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5627adc5aca0 0x5627adc55e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:01:54.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.683+0000 7f50937fe700 1 -- 172.21.15.82:0/1433320298 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5627adc5a380 msgr2=0x5627adc576d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:01:54.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.683+0000 7f50937fe700 1 --2- 172.21.15.82:0/1433320298 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5627adc5a380 0x5627adc576d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:01:54.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.683+0000 7f50937fe700 1 -- 172.21.15.82:0/1433320298 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5627ada26630 con 0x5627adc54c40 2023-09-23T09:01:54.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.683+0000 7f5092ffd700 1 --2- 172.21.15.82:0/1433320298 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5627adc5a380 0x5627adc576d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:01:54.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.683+0000 7f50937fe700 1 --2- 172.21.15.82:0/1433320298 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627adc54c40 0x5627adc57190 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f50840096b0 tx=0x7f5084003890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f4b96ba39fc69c2 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:01:54.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.683+0000 7f5072ffd700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-09-23T09:01:54.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.683+0000 7f5072ffd700 1 -- 172.21.15.82:0/1433320298 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5084016070 con 0x5627adc54c40 2023-09-23T09:01:54.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.683+0000 7f50ad9ebb80 1 -- 172.21.15.82:0/1433320298 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5627adc478b0 con 0x5627adc54c40 2023-09-23T09:01:54.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.683+0000 7f5072ffd700 1 -- 172.21.15.82:0/1433320298 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f5084000e40 con 0x5627adc54c40 2023-09-23T09:01:54.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.684+0000 7f5072ffd700 1 -- 172.21.15.82:0/1433320298 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5084003cc0 con 0x5627adc54c40 2023-09-23T09:01:54.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.684+0000 7f50ad9ebb80 10 client.25754 fetch_fsmap learned FSMap version 38 2023-09-23T09:01:54.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.684+0000 7f50ad9ebb80 1 -- 172.21.15.82:0/1433320298 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) v3 -- 0x5627ad9bbc60 con 0x5627adc54c40 2023-09-23T09:01:54.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.684+0000 7f5072ffd700 1 -- 172.21.15.82:0/1433320298 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5627adc478b0 con 0x5627adc54c40 2023-09-23T09:01:54.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.684+0000 7f5072ffd700 1 -- 172.21.15.82:0/1433320298 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 38) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f5084011ce0 con 0x5627adc54c40 2023-09-23T09:01:54.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.684+0000 7f50ad9ebb80 10 client.25754 fetch_fsmap finished waiting for FSMap version 38 2023-09-23T09:01:54.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.684+0000 7f50ad9ebb80 10 client.25754 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:01:54.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.684+0000 7f50ad9ebb80 20 client.25754 populate_metadata read hostname 'smithi082' 2023-09-23T09:01:54.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.684+0000 7f50ad9ebb80 1 --2- 172.21.15.82:0/1433320298 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5627adcc35f0 0x5627adcc5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:01:54.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.684+0000 7f50ad9ebb80 4 client.25754 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:01:54.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.684+0000 7f50ad9ebb80 1 -- 172.21.15.82:0/1433320298 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5627adb9f970 con 0x5627adcc35f0 2023-09-23T09:01:54.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.685+0000 7f5092ffd700 1 --2- 172.21.15.82:0/1433320298 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5627adcc35f0 0x5627adcc5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:01:54.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.685+0000 7f5072ffd700 10 client.25754 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:01:54.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.685+0000 7f5092ffd700 1 --2- 172.21.15.82:0/1433320298 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5627adcc35f0 0x5627adcc5a10 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=569037fdd25888d0 server_cookie=5097532bbb4ea656 in_seq=0 out_seq=0 2023-09-23T09:01:54.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.685+0000 7f5072ffd700 1 -- 172.21.15.82:0/1433320298 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x5627adb9f970 con 0x5627adcc35f0 2023-09-23T09:01:54.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.685+0000 7f5072ffd700 10 client.25754 handle_command_reply: tid=0 2023-09-23T09:01:54.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.685+0000 7f50ad9ebb80 1 client.25754 shutdown 2023-09-23T09:01:54.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.685+0000 7f50ad9ebb80 1 -- 172.21.15.82:0/1433320298 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627adc54c40 msgr2=0x5627adc57190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:01:54.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.685+0000 7f50ad9ebb80 1 --2- 172.21.15.82:0/1433320298 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627adc54c40 0x5627adc57190 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f50840096b0 tx=0x7f5084003890 comp rx=0 tx=0).stop 2023-09-23T09:01:54.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.686+0000 7f50ad9ebb80 1 -- 172.21.15.82:0/1433320298 shutdown_connections 2023-09-23T09:01:54.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.686+0000 7f50ad9ebb80 1 --2- 172.21.15.82:0/1433320298 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5627adc5aca0 0x5627adc55e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:01:54.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.686+0000 7f50ad9ebb80 1 --2- 172.21.15.82:0/1433320298 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627adc54c40 0x5627adc57190 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:01:54.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.686+0000 7f50ad9ebb80 1 --2- 172.21.15.82:0/1433320298 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5627adcc35f0 0x5627adcc5a10 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:01:54.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.686+0000 7f50ad9ebb80 1 --2- 172.21.15.82:0/1433320298 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5627adc5a380 0x5627adc576d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:01:54.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.686+0000 7f50ad9ebb80 1 -- 172.21.15.82:0/1433320298 >> 172.21.15.82:0/1433320298 conn(0x5627adbc90e0 msgr2=0x5627adc58090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:01:54.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.686+0000 7f5072ffd700 0 client.25754 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:01:54.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.686+0000 7f50ad9ebb80 1 -- 172.21.15.82:0/1433320298 shutdown_connections 2023-09-23T09:01:54.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.686+0000 7f50ad9ebb80 1 -- 172.21.15.82:0/1433320298 wait complete. 2023-09-23T09:01:54.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.686+0000 7f50ad9ebb80 20 client.25754 trim_cache size 0 max 16384 2023-09-23T09:01:54.694 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:01:54.694 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-23T09:01:54.694 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:01:54.694 INFO:teuthology.orchestra.run.smithi082.stdout: "6f0fe3a6-7212-425d-a0a6-f38e8b42ec13": { 2023-09-23T09:01:54.695 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:01:54.695 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "6f0fe3a6-7212-425d-a0a6-f38e8b42ec13", 2023-09-23T09:01:54.695 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:01:54.695 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:01:54.695 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:01:54.695 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:01:54.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.686+0000 7f5099fff700 1 -- 172.21.15.82:0/3299387604 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f507c0a00c0 msgr2=0x7f507c0a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:01:54.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.686+0000 7f5099fff700 1 --2- 172.21.15.82:0/3299387604 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f507c0a00c0 0x7f507c0a2580 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f508c029000 tx=0x7f508c026000 comp rx=0 tx=0).stop 2023-09-23T09:01:54.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.686+0000 7f5099fff700 1 -- 172.21.15.82:0/3299387604 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5094101250 msgr2=0x7f509419eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:01:54.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.686+0000 7f5099fff700 1 --2- 172.21.15.82:0/3299387604 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5094101250 0x7f509419eea0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f508800eb90 tx=0x7f508800eea0 comp rx=0 tx=0).stop 2023-09-23T09:01:54.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.686+0000 7f5099fff700 1 -- 172.21.15.82:0/3299387604 shutdown_connections 2023-09-23T09:01:54.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.687+0000 7f5099fff700 1 --2- 172.21.15.82:0/3299387604 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f507c0a00c0 0x7f507c0a2580 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:01:54.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.687+0000 7f5099fff700 1 --2- 172.21.15.82:0/3299387604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f50941068a0 0x7f50941989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:01:54.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.687+0000 7f5099fff700 1 --2- 172.21.15.82:0/3299387604 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5094100890 0x7f509419e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:01:54.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.687+0000 7f5099fff700 1 --2- 172.21.15.82:0/3299387604 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5094101250 0x7f509419eea0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:01:54.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.687+0000 7f5099fff700 1 -- 172.21.15.82:0/3299387604 >> 172.21.15.82:0/3299387604 conn(0x7f50940fc380 msgr2=0x7f509410bda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:01:54.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.687+0000 7f5099fff700 1 -- 172.21.15.82:0/3299387604 shutdown_connections 2023-09-23T09:01:54.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:01:54.687+0000 7f5099fff700 1 -- 172.21.15.82:0/3299387604 wait complete. 2023-09-23T09:01:54.708 INFO:tasks.cephfs.filesystem:scrub status for tag:6f0fe3a6-7212-425d-a0a6-f38e8b42ec13 - {'path': '/', 'tag': '6f0fe3a6-7212-425d-a0a6-f38e8b42ec13', 'options': 'recursive,force'} 2023-09-23T09:01:54.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:01:54 smithi082 ceph-mon[97694]: pgmap v153: 97 pgs: 97 active+clean; 4.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 24 MiB/s wr, 62 op/s 2023-09-23T09:01:55.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:01:54 smithi135 ceph-mon[99205]: pgmap v153: 97 pgs: 97 active+clean; 4.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 24 MiB/s wr, 62 op/s 2023-09-23T09:01:55.138 INFO:teuthology.orchestra.run.smithi082.stderr:19300000 of 50000000 tuples (38%) done (elapsed 269.88 s, remaining 429.29 s) 2023-09-23T09:01:55.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:01:54 smithi161 ceph-mon[99580]: pgmap v153: 97 pgs: 97 active+clean; 4.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 24 MiB/s wr, 62 op/s 2023-09-23T09:01:56.319 INFO:teuthology.orchestra.run.smithi082.stderr:19400000 of 50000000 tuples (38%) done (elapsed 271.06 s, remaining 427.55 s) 2023-09-23T09:01:57.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:01:56 smithi135 ceph-mon[99205]: pgmap v154: 97 pgs: 97 active+clean; 4.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 36 MiB/s wr, 99 op/s 2023-09-23T09:01:57.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:01:56 smithi082 ceph-mon[97694]: pgmap v154: 97 pgs: 97 active+clean; 4.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 36 MiB/s wr, 99 op/s 2023-09-23T09:01:57.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:01:56 smithi161 ceph-mon[99580]: pgmap v154: 97 pgs: 97 active+clean; 4.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 36 MiB/s wr, 99 op/s 2023-09-23T09:01:57.602 INFO:teuthology.orchestra.run.smithi082.stderr:19500000 of 50000000 tuples (39%) done (elapsed 272.34 s, remaining 425.97 s) 2023-09-23T09:01:58.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:01:57 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:01:58.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:01:57 smithi135 ceph-mon[99205]: scrub summary: active paths [/] 2023-09-23T09:01:58.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:01:57 smithi135 ceph-mon[99205]: scrub summary: idle+waiting paths [/] 2023-09-23T09:01:58.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:01:57 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:01:58.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:01:57 smithi082 ceph-mon[97694]: scrub summary: active paths [/] 2023-09-23T09:01:58.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:01:57 smithi082 ceph-mon[97694]: scrub summary: idle+waiting paths [/] 2023-09-23T09:01:58.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:01:57 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:01:58.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:01:57 smithi161 ceph-mon[99580]: scrub summary: active paths [/] 2023-09-23T09:01:58.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:01:57 smithi161 ceph-mon[99580]: scrub summary: idle+waiting paths [/] 2023-09-23T09:01:58.816 INFO:teuthology.orchestra.run.smithi082.stderr:19600000 of 50000000 tuples (39%) done (elapsed 273.56 s, remaining 424.29 s) 2023-09-23T09:01:59.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:01:58 smithi135 ceph-mon[99205]: pgmap v155: 97 pgs: 97 active+clean; 4.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 24 MiB/s wr, 77 op/s 2023-09-23T09:01:59.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:01:58 smithi082 ceph-mon[97694]: pgmap v155: 97 pgs: 97 active+clean; 4.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 24 MiB/s wr, 77 op/s 2023-09-23T09:01:59.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:01:58 smithi161 ceph-mon[99580]: pgmap v155: 97 pgs: 97 active+clean; 4.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 24 MiB/s wr, 77 op/s 2023-09-23T09:02:00.037 INFO:teuthology.orchestra.run.smithi082.stderr:19700000 of 50000000 tuples (39%) done (elapsed 274.78 s, remaining 422.63 s) 2023-09-23T09:02:00.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:01:59 smithi135 ceph-mon[99205]: pgmap v156: 97 pgs: 97 active+clean; 4.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 34 MiB/s wr, 105 op/s 2023-09-23T09:02:00.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:01:59 smithi082 ceph-mon[97694]: pgmap v156: 97 pgs: 97 active+clean; 4.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 34 MiB/s wr, 105 op/s 2023-09-23T09:02:00.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:01:59 smithi161 ceph-mon[99580]: pgmap v156: 97 pgs: 97 active+clean; 4.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 34 MiB/s wr, 105 op/s 2023-09-23T09:02:01.358 INFO:teuthology.orchestra.run.smithi082.stderr:19800000 of 50000000 tuples (39%) done (elapsed 276.10 s, remaining 421.12 s) 2023-09-23T09:02:02.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:02:01 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:02:02.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:02:01 smithi161 ceph-mon[99580]: pgmap v157: 97 pgs: 97 active+clean; 4.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 25 MiB/s wr, 68 op/s 2023-09-23T09:02:02.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:02:01 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:02:02.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:02:01 smithi135 ceph-mon[99205]: pgmap v157: 97 pgs: 97 active+clean; 4.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 25 MiB/s wr, 68 op/s 2023-09-23T09:02:02.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:02:01 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:02:02.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:02:01 smithi082 ceph-mon[97694]: pgmap v157: 97 pgs: 97 active+clean; 4.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 25 MiB/s wr, 68 op/s 2023-09-23T09:02:02.538 INFO:teuthology.orchestra.run.smithi082.stderr:19900000 of 50000000 tuples (39%) done (elapsed 277.28 s, remaining 419.40 s) 2023-09-23T09:02:03.736 INFO:teuthology.orchestra.run.smithi082.stderr:20000000 of 50000000 tuples (40%) done (elapsed 278.48 s, remaining 417.72 s) 2023-09-23T09:02:04.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:02:04 smithi135 ceph-mon[99205]: pgmap v158: 97 pgs: 97 active+clean; 4.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 24 MiB/s wr, 65 op/s 2023-09-23T09:02:04.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:02:04 smithi082 ceph-mon[97694]: pgmap v158: 97 pgs: 97 active+clean; 4.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 24 MiB/s wr, 65 op/s 2023-09-23T09:02:04.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:02:04 smithi161 ceph-mon[99580]: pgmap v158: 97 pgs: 97 active+clean; 4.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 24 MiB/s wr, 65 op/s 2023-09-23T09:02:05.037 INFO:teuthology.orchestra.run.smithi082.stderr:20100000 of 50000000 tuples (40%) done (elapsed 279.78 s, remaining 416.19 s) 2023-09-23T09:02:06.257 INFO:teuthology.orchestra.run.smithi082.stderr:20200000 of 50000000 tuples (40%) done (elapsed 281.00 s, remaining 414.54 s) 2023-09-23T09:02:06.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:02:06 smithi135 ceph-mon[99205]: pgmap v159: 97 pgs: 97 active+clean; 4.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 36 MiB/s wr, 94 op/s 2023-09-23T09:02:06.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:02:06 smithi082 ceph-mon[97694]: pgmap v159: 97 pgs: 97 active+clean; 4.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 36 MiB/s wr, 94 op/s 2023-09-23T09:02:06.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:02:06 smithi161 ceph-mon[99580]: pgmap v159: 97 pgs: 97 active+clean; 4.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 36 MiB/s wr, 94 op/s 2023-09-23T09:02:07.437 INFO:teuthology.orchestra.run.smithi082.stderr:20300000 of 50000000 tuples (40%) done (elapsed 282.18 s, remaining 412.84 s) 2023-09-23T09:02:08.699 INFO:teuthology.orchestra.run.smithi082.stderr:20400000 of 50000000 tuples (40%) done (elapsed 283.44 s, remaining 411.27 s) 2023-09-23T09:02:08.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:02:08 smithi135 ceph-mon[99205]: pgmap v160: 97 pgs: 97 active+clean; 4.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 24 MiB/s wr, 57 op/s 2023-09-23T09:02:08.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:02:08 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:02:08.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:02:08 smithi082 ceph-mon[97694]: pgmap v160: 97 pgs: 97 active+clean; 4.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 24 MiB/s wr, 57 op/s 2023-09-23T09:02:08.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:02:08 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:02:08.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:02:08 smithi161 ceph-mon[99580]: pgmap v160: 97 pgs: 97 active+clean; 4.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 24 MiB/s wr, 57 op/s 2023-09-23T09:02:08.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:02:08 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:02:09.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:02:09 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:02:09.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:02:09 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:02:09.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:02:09 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:02:09.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:02:09 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:02:09.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:02:09 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:02:09.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:02:09 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:02:09.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:02:09 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:02:09.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:02:09 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:02:09.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:02:09 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:02:09.987 INFO:teuthology.orchestra.run.smithi082.stderr:20500000 of 50000000 tuples (41%) done (elapsed 284.73 s, remaining 409.73 s) 2023-09-23T09:02:10.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:02:10 smithi135 ceph-mon[99205]: pgmap v161: 97 pgs: 97 active+clean; 4.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 33 MiB/s wr, 76 op/s 2023-09-23T09:02:10.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:02:10 smithi082 ceph-mon[97694]: pgmap v161: 97 pgs: 97 active+clean; 4.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 33 MiB/s wr, 76 op/s 2023-09-23T09:02:10.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:02:10 smithi161 ceph-mon[99580]: pgmap v161: 97 pgs: 97 active+clean; 4.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 33 MiB/s wr, 76 op/s 2023-09-23T09:02:11.204 INFO:teuthology.orchestra.run.smithi082.stderr:20600000 of 50000000 tuples (41%) done (elapsed 285.95 s, remaining 408.10 s) 2023-09-23T09:02:12.412 INFO:teuthology.orchestra.run.smithi082.stderr:20700000 of 50000000 tuples (41%) done (elapsed 287.15 s, remaining 406.45 s) 2023-09-23T09:02:12.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:02:12 smithi135 ceph-mon[99205]: pgmap v162: 97 pgs: 97 active+clean; 4.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 26 MiB/s wr, 55 op/s 2023-09-23T09:02:12.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:02:12 smithi082 ceph-mon[97694]: pgmap v162: 97 pgs: 97 active+clean; 4.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 26 MiB/s wr, 55 op/s 2023-09-23T09:02:12.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:02:12 smithi161 ceph-mon[99580]: pgmap v162: 97 pgs: 97 active+clean; 4.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 26 MiB/s wr, 55 op/s 2023-09-23T09:02:13.705 INFO:teuthology.orchestra.run.smithi082.stderr:20800000 of 50000000 tuples (41%) done (elapsed 288.45 s, remaining 404.94 s) 2023-09-23T09:02:14.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:02:14 smithi135 ceph-mon[99205]: pgmap v163: 97 pgs: 97 active+clean; 4.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 24 MiB/s wr, 54 op/s 2023-09-23T09:02:14.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:02:14 smithi082 ceph-mon[97694]: pgmap v163: 97 pgs: 97 active+clean; 4.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 24 MiB/s wr, 54 op/s 2023-09-23T09:02:14.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:02:14 smithi161 ceph-mon[99580]: pgmap v163: 97 pgs: 97 active+clean; 4.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 24 MiB/s wr, 54 op/s 2023-09-23T09:02:14.905 INFO:teuthology.orchestra.run.smithi082.stderr:20900000 of 50000000 tuples (41%) done (elapsed 289.65 s, remaining 403.29 s) 2023-09-23T09:02:16.132 INFO:teuthology.orchestra.run.smithi082.stderr:21000000 of 50000000 tuples (42%) done (elapsed 290.87 s, remaining 401.68 s) 2023-09-23T09:02:16.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:02:16 smithi135 ceph-mon[99205]: pgmap v164: 97 pgs: 97 active+clean; 4.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 36 MiB/s wr, 75 op/s 2023-09-23T09:02:16.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:02:16 smithi082 ceph-mon[97694]: pgmap v164: 97 pgs: 97 active+clean; 4.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 36 MiB/s wr, 75 op/s 2023-09-23T09:02:16.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:02:16 smithi161 ceph-mon[99580]: pgmap v164: 97 pgs: 97 active+clean; 4.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 36 MiB/s wr, 75 op/s 2023-09-23T09:02:17.338 INFO:teuthology.orchestra.run.smithi082.stderr:21100000 of 50000000 tuples (42%) done (elapsed 292.08 s, remaining 400.05 s) 2023-09-23T09:02:18.621 INFO:teuthology.orchestra.run.smithi082.stderr:21200000 of 50000000 tuples (42%) done (elapsed 293.36 s, remaining 398.53 s) 2023-09-23T09:02:18.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:02:18 smithi135 ceph-mon[99205]: pgmap v165: 97 pgs: 97 active+clean; 4.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 MiB/s wr, 46 op/s 2023-09-23T09:02:18.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:02:18 smithi082 ceph-mon[97694]: pgmap v165: 97 pgs: 97 active+clean; 4.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 MiB/s wr, 46 op/s 2023-09-23T09:02:18.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:02:18 smithi161 ceph-mon[99580]: pgmap v165: 97 pgs: 97 active+clean; 4.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 MiB/s wr, 46 op/s 2023-09-23T09:02:19.838 INFO:teuthology.orchestra.run.smithi082.stderr:21300000 of 50000000 tuples (42%) done (elapsed 294.58 s, remaining 396.92 s) 2023-09-23T09:02:20.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:02:20 smithi135 ceph-mon[99205]: pgmap v166: 97 pgs: 97 active+clean; 4.9 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 36 MiB/s wr, 66 op/s 2023-09-23T09:02:20.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:02:20 smithi082 ceph-mon[97694]: pgmap v166: 97 pgs: 97 active+clean; 4.9 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 36 MiB/s wr, 66 op/s 2023-09-23T09:02:20.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:02:20 smithi161 ceph-mon[99580]: pgmap v166: 97 pgs: 97 active+clean; 4.9 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 36 MiB/s wr, 66 op/s 2023-09-23T09:02:21.034 INFO:teuthology.orchestra.run.smithi082.stderr:21400000 of 50000000 tuples (42%) done (elapsed 295.78 s, remaining 395.29 s) 2023-09-23T09:02:22.315 INFO:teuthology.orchestra.run.smithi082.stderr:21500000 of 50000000 tuples (43%) done (elapsed 297.06 s, remaining 393.77 s) 2023-09-23T09:02:22.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:02:22 smithi135 ceph-mon[99205]: pgmap v167: 97 pgs: 97 active+clean; 4.9 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 27 MiB/s wr, 48 op/s 2023-09-23T09:02:22.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:02:22 smithi082 ceph-mon[97694]: pgmap v167: 97 pgs: 97 active+clean; 4.9 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 27 MiB/s wr, 48 op/s 2023-09-23T09:02:22.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:02:22 smithi161 ceph-mon[99580]: pgmap v167: 97 pgs: 97 active+clean; 4.9 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 27 MiB/s wr, 48 op/s 2023-09-23T09:02:23.623 INFO:teuthology.orchestra.run.smithi082.stderr:21600000 of 50000000 tuples (43%) done (elapsed 298.37 s, remaining 392.30 s) 2023-09-23T09:02:24.709 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:02:24.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:02:24 smithi135 ceph-mon[99205]: pgmap v168: 97 pgs: 97 active+clean; 4.9 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 24 MiB/s wr, 41 op/s 2023-09-23T09:02:24.838 INFO:teuthology.orchestra.run.smithi082.stderr:21700000 of 50000000 tuples (43%) done (elapsed 299.58 s, remaining 390.70 s) 2023-09-23T09:02:24.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:02:24 smithi082 ceph-mon[97694]: pgmap v168: 97 pgs: 97 active+clean; 4.9 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 24 MiB/s wr, 41 op/s 2023-09-23T09:02:24.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:02:24 smithi161 ceph-mon[99580]: pgmap v168: 97 pgs: 97 active+clean; 4.9 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 24 MiB/s wr, 41 op/s 2023-09-23T09:02:24.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.928+0000 7fe8eb9ff700 1 -- 172.21.15.82:0/3622718149 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe8e40ff760 msgr2=0x7fe8e40ffbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:02:24.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.928+0000 7fe8eb9ff700 1 --2- 172.21.15.82:0/3622718149 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe8e40ff760 0x7fe8e40ffbe0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe8d40098f0 tx=0x7fe8d4009c00 comp rx=0 tx=0).stop 2023-09-23T09:02:24.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.928+0000 7fe8eb9ff700 1 -- 172.21.15.82:0/3622718149 shutdown_connections 2023-09-23T09:02:24.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.928+0000 7fe8eb9ff700 1 --2- 172.21.15.82:0/3622718149 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8e4100120 0x7fe8e410c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:02:24.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.928+0000 7fe8eb9ff700 1 --2- 172.21.15.82:0/3622718149 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8e4105770 0x7fe8e4105b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:02:24.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.928+0000 7fe8eb9ff700 1 --2- 172.21.15.82:0/3622718149 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe8e40ff760 0x7fe8e40ffbe0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:02:24.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.928+0000 7fe8eb9ff700 1 -- 172.21.15.82:0/3622718149 >> 172.21.15.82:0/3622718149 conn(0x7fe8e40fb270 msgr2=0x7fe8e40fd690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:02:24.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.928+0000 7fe8eb9ff700 1 -- 172.21.15.82:0/3622718149 shutdown_connections 2023-09-23T09:02:24.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.928+0000 7fe8eb9ff700 1 -- 172.21.15.82:0/3622718149 wait complete. 2023-09-23T09:02:24.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.929+0000 7fe8eb9ff700 1 Processor -- start 2023-09-23T09:02:24.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.930+0000 7fe8eb9ff700 1 -- start start 2023-09-23T09:02:24.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.930+0000 7fe8eb9ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe8e40ff760 0x7fe8e419e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:02:24.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.930+0000 7fe8eb9ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8e4100120 0x7fe8e419ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:02:24.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.930+0000 7fe8eb9ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8e4105770 0x7fe8e4198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:02:24.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.930+0000 7fe8eb9ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e4198f80 con 0x7fe8e4100120 2023-09-23T09:02:24.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.930+0000 7fe8eb9ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e41990f0 con 0x7fe8e4105770 2023-09-23T09:02:24.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.930+0000 7fe8eb9ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e41992b0 con 0x7fe8e40ff760 2023-09-23T09:02:24.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.930+0000 7fe8e979b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe8e40ff760 0x7fe8e419e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:02:24.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.930+0000 7fe8e979b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe8e40ff760 0x7fe8e419e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:34954/0 (socket says 172.21.15.82:34954) 2023-09-23T09:02:24.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.930+0000 7fe8e979b700 1 -- 172.21.15.82:0/1658824566 learned_addr learned my addr 172.21.15.82:0/1658824566 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:02:24.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.931+0000 7fe8e8f9a700 1 --2- 172.21.15.82:0/1658824566 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8e4100120 0x7fe8e419ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:02:24.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.931+0000 7fe8e9f9c700 1 --2- 172.21.15.82:0/1658824566 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8e4105770 0x7fe8e4198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:02:24.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.931+0000 7fe8e979b700 1 -- 172.21.15.82:0/1658824566 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8e4105770 msgr2=0x7fe8e4198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:02:24.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.931+0000 7fe8e979b700 1 --2- 172.21.15.82:0/1658824566 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8e4105770 0x7fe8e4198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:02:24.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.931+0000 7fe8e979b700 1 -- 172.21.15.82:0/1658824566 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8e4100120 msgr2=0x7fe8e419ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:02:24.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.931+0000 7fe8e979b700 1 --2- 172.21.15.82:0/1658824566 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8e4100120 0x7fe8e419ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:02:24.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.931+0000 7fe8e979b700 1 -- 172.21.15.82:0/1658824566 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d4009520 con 0x7fe8e40ff760 2023-09-23T09:02:24.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.931+0000 7fe8e979b700 1 --2- 172.21.15.82:0/1658824566 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe8e40ff760 0x7fe8e419e8a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe8e000e9a0 tx=0x7fe8e000ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:02:24.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.931+0000 7fe8da7fc700 1 -- 172.21.15.82:0/1658824566 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e0009790 con 0x7fe8e40ff760 2023-09-23T09:02:24.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.931+0000 7fe8da7fc700 1 -- 172.21.15.82:0/1658824566 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe8e0010430 con 0x7fe8e40ff760 2023-09-23T09:02:24.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.932+0000 7fe8eb9ff700 1 -- 172.21.15.82:0/1658824566 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8e4199590 con 0x7fe8e40ff760 2023-09-23T09:02:24.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.932+0000 7fe8da7fc700 1 -- 172.21.15.82:0/1658824566 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e000cea0 con 0x7fe8e40ff760 2023-09-23T09:02:24.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.932+0000 7fe8eb9ff700 1 -- 172.21.15.82:0/1658824566 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8e41a5890 con 0x7fe8e40ff760 2023-09-23T09:02:24.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.935+0000 7fe8da7fc700 1 -- 172.21.15.82:0/1658824566 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7fe8e00105a0 con 0x7fe8e40ff760 2023-09-23T09:02:24.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.936+0000 7fe8ff276b80 1 Processor -- start 2023-09-23T09:02:24.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.936+0000 7fe8ff276b80 1 -- start start 2023-09-23T09:02:24.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.936+0000 7fe8ff276b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559b546d4380 0x559b546d4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:02:24.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.936+0000 7fe8ff276b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559b546d4ca0 0x559b546ce700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:02:24.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.936+0000 7fe8ff276b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b546cec40 0x559b546cf0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:02:24.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.936+0000 7fe8ff276b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b546367b0 con 0x559b546d4ca0 2023-09-23T09:02:24.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.936+0000 7fe8ff276b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b54627780 con 0x559b546cec40 2023-09-23T09:02:24.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.936+0000 7fe8ff276b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b546250a0 con 0x559b546d4380 2023-09-23T09:02:24.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.937+0000 7fe8e9f9c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559b546d4380 0x559b546d4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:02:24.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.937+0000 7fe8e979b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559b546d4ca0 0x559b546ce700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:02:24.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.937+0000 7fe8e9f9c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559b546d4380 0x559b546d4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:34958/0 (socket says 172.21.15.82:34958) 2023-09-23T09:02:24.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.937+0000 7fe8e9f9c700 1 -- 172.21.15.82:0/838081721 learned_addr learned my addr 172.21.15.82:0/838081721 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:02:24.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.937+0000 7fe8e8f9a700 1 --2- 172.21.15.82:0/838081721 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b546cec40 0x559b546cf0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:02:24.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.937+0000 7fe8e9f9c700 1 -- 172.21.15.82:0/838081721 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b546cec40 msgr2=0x559b546cf0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:02:24.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.937+0000 7fe8e9f9c700 1 --2- 172.21.15.82:0/838081721 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b546cec40 0x559b546cf0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:02:24.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.937+0000 7fe8e9f9c700 1 -- 172.21.15.82:0/838081721 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559b546d4ca0 msgr2=0x559b546ce700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:02:24.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.937+0000 7fe8e9f9c700 1 --2- 172.21.15.82:0/838081721 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559b546d4ca0 0x559b546ce700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:02:24.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.937+0000 7fe8e9f9c700 1 -- 172.21.15.82:0/838081721 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559b544a0630 con 0x559b546d4380 2023-09-23T09:02:24.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.938+0000 7fe8da7fc700 1 --2- 172.21.15.82:0/1658824566 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fe8d00a0140 0x7fe8d00a2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:02:24.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.938+0000 7fe8e9f9c700 1 --2- 172.21.15.82:0/838081721 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559b546d4380 0x559b546d4760 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc011600 tx=0x7fe8dc0099e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ad1213b44767174 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:02:24.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.938+0000 7fe8da7fc700 1 -- 172.21.15.82:0/1658824566 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fe8e0014070 con 0x7fe8e40ff760 2023-09-23T09:02:24.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.938+0000 7fe8cf7fe700 1 -- 172.21.15.82:0/838081721 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8dc00e040 con 0x559b546d4380 2023-09-23T09:02:24.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.938+0000 7fe8cf7fe700 1 -- 172.21.15.82:0/838081721 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe8dc00f040 con 0x559b546d4380 2023-09-23T09:02:24.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.938+0000 7fe8cf7fe700 1 -- 172.21.15.82:0/838081721 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8dc0044e0 con 0x559b546d4380 2023-09-23T09:02:24.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.938+0000 7fe8e979b700 1 --2- 172.21.15.82:0/1658824566 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fe8d00a0140 0x7fe8d00a2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:02:24.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.939+0000 7fe8ff276b80 1 -- 172.21.15.82:0/838081721 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559b546d4380 msgr2=0x559b546d4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:02:24.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.939+0000 7fe8ff276b80 1 --2- 172.21.15.82:0/838081721 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559b546d4380 0x559b546d4760 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc011600 tx=0x7fe8dc0099e0 comp rx=0 tx=0).stop 2023-09-23T09:02:24.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.939+0000 7fe8e979b700 1 --2- 172.21.15.82:0/1658824566 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fe8d00a0140 0x7fe8d00a2600 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe8e00cefd0 tx=0x7fe8e00d1060 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:02:24.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.939+0000 7fe8ff276b80 1 -- 172.21.15.82:0/838081721 shutdown_connections 2023-09-23T09:02:24.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.939+0000 7fe8ff276b80 1 --2- 172.21.15.82:0/838081721 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b546cec40 0x559b546cf0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:02:24.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.939+0000 7fe8ff276b80 1 --2- 172.21.15.82:0/838081721 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559b546d4380 0x559b546d4760 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:02:24.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.939+0000 7fe8ff276b80 1 --2- 172.21.15.82:0/838081721 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559b546d4ca0 0x559b546ce700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:02:24.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.939+0000 7fe8ff276b80 1 -- 172.21.15.82:0/838081721 >> 172.21.15.82:0/838081721 conn(0x559b546430e0 msgr2=0x559b546c9410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:02:24.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.939+0000 7fe8ff276b80 1 -- 172.21.15.82:0/838081721 shutdown_connections 2023-09-23T09:02:24.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.939+0000 7fe8ff276b80 1 -- 172.21.15.82:0/838081721 wait complete. 2023-09-23T09:02:24.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.939+0000 7fe8ff276b80 1 -- start start 2023-09-23T09:02:24.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.940+0000 7fe8ff276b80 1 Processor -- start 2023-09-23T09:02:24.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.940+0000 7fe8ff276b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b546cec40 0x559b546dac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:02:24.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.940+0000 7fe8ff276b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559b546d4380 0x559b546d7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:02:24.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.940+0000 7fe8ff276b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559b546d4ca0 0x559b546d8570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:02:24.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.940+0000 7fe8ff276b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b54620990 con 0x559b546d4380 2023-09-23T09:02:24.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.940+0000 7fe8ff276b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b545bebb0 con 0x559b546cec40 2023-09-23T09:02:24.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.940+0000 7fe8ff276b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b545be8b0 con 0x559b546d4ca0 2023-09-23T09:02:24.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.940+0000 7fe8ff276b80 10 client.0 _ll_register_callbacks cb 0x559b54508a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:02:24.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.941+0000 7fe8e8f9a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559b546d4380 0x559b546d7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:02:24.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.941+0000 7fe8e9f9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b546cec40 0x559b546dac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:02:24.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.941+0000 7fe8e8f9a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559b546d4380 0x559b546d7ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57818/0 (socket says 172.21.15.82:57818) 2023-09-23T09:02:24.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.941+0000 7fe8e8f9a700 1 -- 172.21.15.82:0/2814840616 learned_addr learned my addr 172.21.15.82:0/2814840616 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:02:24.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.941+0000 7fe8e9f9c700 1 --2- 172.21.15.82:0/2814840616 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559b546d4ca0 0x559b546d8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:02:24.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.941+0000 7fe8e8f9a700 1 -- 172.21.15.82:0/2814840616 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559b546d4ca0 msgr2=0x559b546d8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:02:24.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.941+0000 7fe8e8f9a700 1 --2- 172.21.15.82:0/2814840616 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559b546d4ca0 0x559b546d8570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:02:24.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.941+0000 7fe8e8f9a700 1 -- 172.21.15.82:0/2814840616 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b546cec40 msgr2=0x559b546dac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:02:24.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.941+0000 7fe8e8f9a700 1 --2- 172.21.15.82:0/2814840616 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b546cec40 0x559b546dac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:02:24.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.941+0000 7fe8e8f9a700 1 -- 172.21.15.82:0/2814840616 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8dc0112b0 con 0x559b546d4380 2023-09-23T09:02:24.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.941+0000 7fe8e8f9a700 1 --2- 172.21.15.82:0/2814840616 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559b546d4380 0x559b546d7ef0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fe8d40098f0 tx=0x7fe8d400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bda0f84a2f9e9ab server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:02:24.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.941+0000 7fe8ccff9700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:02:24.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.942+0000 7fe8ccff9700 1 -- 172.21.15.82:0/2814840616 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d4027070 con 0x559b546d4380 2023-09-23T09:02:24.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.942+0000 7fe8ff276b80 1 -- 172.21.15.82:0/2814840616 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559b5469e1c0 con 0x559b546d4380 2023-09-23T09:02:24.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.942+0000 7fe8ccff9700 1 -- 172.21.15.82:0/2814840616 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fe8d400b770 con 0x559b546d4380 2023-09-23T09:02:24.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.942+0000 7fe8ccff9700 1 -- 172.21.15.82:0/2814840616 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe8d400b930 con 0x559b546d4380 2023-09-23T09:02:24.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.942+0000 7fe8ff276b80 10 client.16074 fetch_fsmap learned FSMap version 40 2023-09-23T09:02:24.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.942+0000 7fe8ff276b80 1 -- 172.21.15.82:0/2814840616 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) v3 -- 0x559b5444cde0 con 0x559b546d4380 2023-09-23T09:02:24.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.942+0000 7fe8ccff9700 1 -- 172.21.15.82:0/2814840616 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x559b5469e1c0 con 0x559b546d4380 2023-09-23T09:02:24.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.943+0000 7fe8ccff9700 1 -- 172.21.15.82:0/2814840616 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 40) v1 ==== 7914+0+0 (secure 0 0 0) 0x7fe8d402a020 con 0x559b546d4380 2023-09-23T09:02:24.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.943+0000 7fe8ff276b80 10 client.16074 fetch_fsmap finished waiting for FSMap version 40 2023-09-23T09:02:24.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.943+0000 7fe8ff276b80 10 client.16074 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:02:24.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.943+0000 7fe8ff276b80 20 client.16074 populate_metadata read hostname 'smithi082' 2023-09-23T09:02:24.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.943+0000 7fe8ff276b80 1 --2- 172.21.15.82:0/2814840616 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x559b546e8760 0x559b546eab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:02:24.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.943+0000 7fe8ff276b80 4 client.16074 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:02:24.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.943+0000 7fe8ff276b80 1 -- 172.21.15.82:0/2814840616 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559b545c6ba0 con 0x559b546e8760 2023-09-23T09:02:24.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.943+0000 7fe8e9f9c700 1 --2- 172.21.15.82:0/2814840616 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x559b546e8760 0x559b546eab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:02:24.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.944+0000 7fe8ccff9700 10 client.16074 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:02:24.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.944+0000 7fe8e9f9c700 1 --2- 172.21.15.82:0/2814840616 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x559b546e8760 0x559b546eab80 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f03f3587cab028c server_cookie=7e93b71d2d68d11c in_seq=0 out_seq=0 2023-09-23T09:02:24.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.944+0000 7fe8ccff9700 1 -- 172.21.15.82:0/2814840616 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x559b545c6ba0 con 0x559b546e8760 2023-09-23T09:02:24.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.944+0000 7fe8ccff9700 10 client.16074 handle_command_reply: tid=0 2023-09-23T09:02:24.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.944+0000 7fe8ff276b80 1 client.16074 shutdown 2023-09-23T09:02:24.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.945+0000 7fe8ff276b80 1 -- 172.21.15.82:0/2814840616 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559b546d4380 msgr2=0x559b546d7ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:02:24.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.945+0000 7fe8ff276b80 1 --2- 172.21.15.82:0/2814840616 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559b546d4380 0x559b546d7ef0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fe8d40098f0 tx=0x7fe8d400f690 comp rx=0 tx=0).stop 2023-09-23T09:02:24.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.945+0000 7fe8ff276b80 1 -- 172.21.15.82:0/2814840616 shutdown_connections 2023-09-23T09:02:24.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.945+0000 7fe8ff276b80 1 --2- 172.21.15.82:0/2814840616 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559b546d4ca0 0x559b546d8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:02:24.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.945+0000 7fe8ff276b80 1 --2- 172.21.15.82:0/2814840616 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b546cec40 0x559b546dac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:02:24.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.945+0000 7fe8ff276b80 1 --2- 172.21.15.82:0/2814840616 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x559b546e8760 0x559b546eab80 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:02:24.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.945+0000 7fe8ff276b80 1 --2- 172.21.15.82:0/2814840616 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559b546d4380 0x559b546d7ef0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:02:24.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.945+0000 7fe8ff276b80 1 -- 172.21.15.82:0/2814840616 >> 172.21.15.82:0/2814840616 conn(0x559b546430e0 msgr2=0x559b546c3b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:02:24.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.945+0000 7fe8ccff9700 0 client.16074 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:02:24.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.945+0000 7fe8ff276b80 1 -- 172.21.15.82:0/2814840616 shutdown_connections 2023-09-23T09:02:24.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.945+0000 7fe8ff276b80 1 -- 172.21.15.82:0/2814840616 wait complete. 2023-09-23T09:02:24.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.945+0000 7fe8ff276b80 20 client.16074 trim_cache size 0 max 16384 2023-09-23T09:02:24.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.965+0000 7fe8ff276b80 1 Processor -- start 2023-09-23T09:02:24.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.965+0000 7fe8ff276b80 1 -- start start 2023-09-23T09:02:24.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.965+0000 7fe8ff276b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b546cec40 0x559b546ce700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:02:24.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.965+0000 7fe8ff276b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559b546d4380 0x559b546d2010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:02:24.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.966+0000 7fe8ff276b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559b546d4ca0 0x559b546d2550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:02:24.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.966+0000 7fe8ff276b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b544a2920 con 0x559b546d4380 2023-09-23T09:02:24.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.966+0000 7fe8ff276b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b546db580 con 0x559b546cec40 2023-09-23T09:02:24.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.966+0000 7fe8ff276b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b546e50e0 con 0x559b546d4ca0 2023-09-23T09:02:24.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.966+0000 7fe8e8f9a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559b546d4380 0x559b546d2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:02:24.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.966+0000 7fe8e9f9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b546cec40 0x559b546ce700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:02:24.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.966+0000 7fe8e9f9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b546cec40 0x559b546ce700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:57324/0 (socket says 172.21.15.82:57324) 2023-09-23T09:02:24.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.966+0000 7fe8e9f9c700 1 -- 172.21.15.82:0/2724485153 learned_addr learned my addr 172.21.15.82:0/2724485153 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:02:24.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.966+0000 7fe8e8f9a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559b546d4380 0x559b546d2010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57830/0 (socket says 172.21.15.82:57830) 2023-09-23T09:02:24.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.966+0000 7fe8e9f9c700 1 --2- 172.21.15.82:0/2724485153 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559b546d4ca0 0x559b546d2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:02:24.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.966+0000 7fe8e8f9a700 1 -- 172.21.15.82:0/2724485153 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559b546d4ca0 msgr2=0x559b546d2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:02:24.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.966+0000 7fe8e8f9a700 1 --2- 172.21.15.82:0/2724485153 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559b546d4ca0 0x559b546d2550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:02:24.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.966+0000 7fe8e8f9a700 1 -- 172.21.15.82:0/2724485153 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b546cec40 msgr2=0x559b546ce700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:02:24.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.966+0000 7fe8e8f9a700 1 --2- 172.21.15.82:0/2724485153 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b546cec40 0x559b546ce700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:02:24.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.966+0000 7fe8e8f9a700 1 -- 172.21.15.82:0/2724485153 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559b54435c60 con 0x559b546d4380 2023-09-23T09:02:24.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.967+0000 7fe8e8f9a700 1 --2- 172.21.15.82:0/2724485153 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559b546d4380 0x559b546d2010 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fe8d4003770 tx=0x7fe8d400f9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b3af0aa88333b8e server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:02:24.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.967+0000 7fe8cffff700 1 -- 172.21.15.82:0/2724485153 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d4027070 con 0x559b546d4380 2023-09-23T09:02:24.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.967+0000 7fe8cffff700 1 -- 172.21.15.82:0/2724485153 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe8d401d070 con 0x559b546d4380 2023-09-23T09:02:24.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.967+0000 7fe8cffff700 1 -- 172.21.15.82:0/2724485153 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d4005360 con 0x559b546d4380 2023-09-23T09:02:24.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.968+0000 7fe8ff276b80 1 -- 172.21.15.82:0/2724485153 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559b546d4380 msgr2=0x559b546d2010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:02:24.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.968+0000 7fe8ff276b80 1 --2- 172.21.15.82:0/2724485153 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559b546d4380 0x559b546d2010 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fe8d4003770 tx=0x7fe8d400f9f0 comp rx=0 tx=0).stop 2023-09-23T09:02:24.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.968+0000 7fe8ff276b80 1 -- 172.21.15.82:0/2724485153 shutdown_connections 2023-09-23T09:02:24.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.968+0000 7fe8ff276b80 1 --2- 172.21.15.82:0/2724485153 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559b546d4ca0 0x559b546d2550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:02:24.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.968+0000 7fe8ff276b80 1 --2- 172.21.15.82:0/2724485153 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b546cec40 0x559b546ce700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:02:24.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.968+0000 7fe8ff276b80 1 --2- 172.21.15.82:0/2724485153 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559b546d4380 0x559b546d2010 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:02:24.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.968+0000 7fe8ff276b80 1 -- 172.21.15.82:0/2724485153 >> 172.21.15.82:0/2724485153 conn(0x559b546430e0 msgr2=0x559b546e3f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:02:24.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.968+0000 7fe8ff276b80 1 -- 172.21.15.82:0/2724485153 shutdown_connections 2023-09-23T09:02:24.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.968+0000 7fe8ff276b80 1 -- 172.21.15.82:0/2724485153 wait complete. 2023-09-23T09:02:24.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.968+0000 7fe8ff276b80 1 -- start start 2023-09-23T09:02:24.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.968+0000 7fe8ff276b80 1 Processor -- start 2023-09-23T09:02:24.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.969+0000 7fe8ff276b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559b546cec40 0x559b546d0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:02:24.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.969+0000 7fe8ff276b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b546d4380 0x559b546d14a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:02:24.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.969+0000 7fe8ff276b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559b546d4ca0 0x559b546cfe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:02:24.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.969+0000 7fe8ff276b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b546d1ba0 con 0x559b546d4ca0 2023-09-23T09:02:24.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.969+0000 7fe8ff276b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b546d0340 con 0x559b546d4380 2023-09-23T09:02:24.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.969+0000 7fe8ff276b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b546d0500 con 0x559b546cec40 2023-09-23T09:02:24.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.969+0000 7fe8ff276b80 10 client.0 _ll_register_callbacks cb 0x7fe8d400feb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:02:24.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.969+0000 7fe8e8f9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b546d4380 0x559b546d14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:02:24.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.969+0000 7fe8e8f9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b546d4380 0x559b546d14a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:57328/0 (socket says 172.21.15.82:57328) 2023-09-23T09:02:24.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.969+0000 7fe8e8f9a700 1 -- 172.21.15.82:0/3251439638 learned_addr learned my addr 172.21.15.82:0/3251439638 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:02:24.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.969+0000 7fe8e9f9c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559b546cec40 0x559b546d0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:02:24.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.969+0000 7fe8e9f9c700 1 --2- 172.21.15.82:0/3251439638 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559b546d4ca0 0x559b546cfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:02:24.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.970+0000 7fe8e8f9a700 1 -- 172.21.15.82:0/3251439638 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559b546cec40 msgr2=0x559b546d0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:02:24.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.970+0000 7fe8e8f9a700 1 --2- 172.21.15.82:0/3251439638 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559b546cec40 0x559b546d0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:02:24.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.970+0000 7fe8e8f9a700 1 -- 172.21.15.82:0/3251439638 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559b546d4ca0 msgr2=0x559b546cfe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:02:24.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.970+0000 7fe8e8f9a700 1 --2- 172.21.15.82:0/3251439638 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559b546d4ca0 0x559b546cfe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:02:24.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.970+0000 7fe8e8f9a700 1 -- 172.21.15.82:0/3251439638 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559b5444cde0 con 0x559b546d4380 2023-09-23T09:02:24.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.970+0000 7fe8e9f9c700 1 --2- 172.21.15.82:0/3251439638 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559b546d4ca0 0x559b546cfe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:02:24.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.970+0000 7fe8e8f9a700 1 --2- 172.21.15.82:0/3251439638 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b546d4380 0x559b546d14a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe8d40036f0 tx=0x7fe8d4009f50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=451168aa5f988c95 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:02:24.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.970+0000 7fe8ccff9700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-09-23T09:02:24.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.970+0000 7fe8ccff9700 1 -- 172.21.15.82:0/3251439638 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d4027070 con 0x559b546d4380 2023-09-23T09:02:24.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.970+0000 7fe8ff276b80 1 -- 172.21.15.82:0/3251439638 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559b546c18b0 con 0x559b546d4380 2023-09-23T09:02:24.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.970+0000 7fe8ccff9700 1 -- 172.21.15.82:0/3251439638 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fe8d4000e40 con 0x559b546d4380 2023-09-23T09:02:24.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.971+0000 7fe8ccff9700 1 -- 172.21.15.82:0/3251439638 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe8d400bac0 con 0x559b546d4380 2023-09-23T09:02:24.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.971+0000 7fe8ff276b80 10 client.25772 fetch_fsmap learned FSMap version 40 2023-09-23T09:02:24.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.971+0000 7fe8ff276b80 1 -- 172.21.15.82:0/3251439638 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) v3 -- 0x559b54473250 con 0x559b546d4380 2023-09-23T09:02:24.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.971+0000 7fe8ccff9700 1 -- 172.21.15.82:0/3251439638 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe8d4043020 con 0x559b546d4380 2023-09-23T09:02:24.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.971+0000 7fe8ccff9700 1 -- 172.21.15.82:0/3251439638 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 40) v1 ==== 7914+0+0 (secure 0 0 0) 0x7fe8d402a040 con 0x559b546d4380 2023-09-23T09:02:24.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.971+0000 7fe8ff276b80 10 client.25772 fetch_fsmap finished waiting for FSMap version 40 2023-09-23T09:02:24.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.971+0000 7fe8ff276b80 10 client.25772 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:02:24.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.971+0000 7fe8ff276b80 20 client.25772 populate_metadata read hostname 'smithi082' 2023-09-23T09:02:24.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.971+0000 7fe8ff276b80 1 --2- 172.21.15.82:0/3251439638 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x559b5473cf60 0x559b5473f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:02:24.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.971+0000 7fe8ff276b80 4 client.25772 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:02:24.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.971+0000 7fe8ff276b80 1 -- 172.21.15.82:0/3251439638 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x559b54619970 con 0x559b5473cf60 2023-09-23T09:02:24.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.972+0000 7fe8e9f9c700 1 --2- 172.21.15.82:0/3251439638 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x559b5473cf60 0x559b5473f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:02:24.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.972+0000 7fe8e9f9c700 1 --2- 172.21.15.82:0/3251439638 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x559b5473cf60 0x559b5473f380 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a90cc78467d213c server_cookie=11c4259501ee6ff2 in_seq=0 out_seq=0 2023-09-23T09:02:24.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.972+0000 7fe8ccff9700 10 client.25772 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:02:24.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.972+0000 7fe8ccff9700 1 -- 172.21.15.82:0/3251439638 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x559b54619970 con 0x559b5473cf60 2023-09-23T09:02:24.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.972+0000 7fe8ccff9700 10 client.25772 handle_command_reply: tid=0 2023-09-23T09:02:24.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.972+0000 7fe8ff276b80 1 client.25772 shutdown 2023-09-23T09:02:24.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.972+0000 7fe8ff276b80 1 -- 172.21.15.82:0/3251439638 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b546d4380 msgr2=0x559b546d14a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:02:24.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.972+0000 7fe8ff276b80 1 --2- 172.21.15.82:0/3251439638 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b546d4380 0x559b546d14a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe8d40036f0 tx=0x7fe8d4009f50 comp rx=0 tx=0).stop 2023-09-23T09:02:24.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.973+0000 7fe8ff276b80 1 -- 172.21.15.82:0/3251439638 shutdown_connections 2023-09-23T09:02:24.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.973+0000 7fe8ff276b80 1 --2- 172.21.15.82:0/3251439638 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x559b5473cf60 0x559b5473f380 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:02:24.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.973+0000 7fe8ff276b80 1 --2- 172.21.15.82:0/3251439638 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559b546d4ca0 0x559b546cfe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:02:24.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.973+0000 7fe8ff276b80 1 --2- 172.21.15.82:0/3251439638 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559b546cec40 0x559b546d0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:02:24.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.973+0000 7fe8ccff9700 0 client.25772 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:02:24.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.973+0000 7fe8ff276b80 1 --2- 172.21.15.82:0/3251439638 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b546d4380 0x559b546d14a0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:02:24.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.973+0000 7fe8ff276b80 1 -- 172.21.15.82:0/3251439638 >> 172.21.15.82:0/3251439638 conn(0x559b546430e0 msgr2=0x559b546e3f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:02:24.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.973+0000 7fe8ff276b80 1 -- 172.21.15.82:0/3251439638 shutdown_connections 2023-09-23T09:02:24.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.973+0000 7fe8ff276b80 1 -- 172.21.15.82:0/3251439638 wait complete. 2023-09-23T09:02:24.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.973+0000 7fe8ff276b80 20 client.25772 trim_cache size 0 max 16384 2023-09-23T09:02:24.982 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:02:24.982 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "IDLE (waiting for more scrubs)", 2023-09-23T09:02:24.982 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:02:24.982 INFO:teuthology.orchestra.run.smithi082.stdout: "6f0fe3a6-7212-425d-a0a6-f38e8b42ec13": { 2023-09-23T09:02:24.982 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:02:24.983 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "6f0fe3a6-7212-425d-a0a6-f38e8b42ec13", 2023-09-23T09:02:24.983 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:02:24.983 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:02:24.983 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:02:24.983 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:02:24.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.973+0000 7fe8eb9ff700 1 -- 172.21.15.82:0/1658824566 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fe8d00a0140 msgr2=0x7fe8d00a2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:02:24.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.973+0000 7fe8eb9ff700 1 --2- 172.21.15.82:0/1658824566 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fe8d00a0140 0x7fe8d00a2600 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe8e00cefd0 tx=0x7fe8e00d1060 comp rx=0 tx=0).stop 2023-09-23T09:02:24.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.973+0000 7fe8eb9ff700 1 -- 172.21.15.82:0/1658824566 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe8e40ff760 msgr2=0x7fe8e419e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:02:24.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.973+0000 7fe8eb9ff700 1 --2- 172.21.15.82:0/1658824566 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe8e40ff760 0x7fe8e419e8a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe8e000e9a0 tx=0x7fe8e000ecb0 comp rx=0 tx=0).stop 2023-09-23T09:02:24.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.973+0000 7fe8eb9ff700 1 -- 172.21.15.82:0/1658824566 shutdown_connections 2023-09-23T09:02:24.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.973+0000 7fe8eb9ff700 1 --2- 172.21.15.82:0/1658824566 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fe8d00a0140 0x7fe8d00a2600 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:02:24.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.973+0000 7fe8eb9ff700 1 --2- 172.21.15.82:0/1658824566 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8e4105770 0x7fe8e4198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:02:24.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.974+0000 7fe8eb9ff700 1 --2- 172.21.15.82:0/1658824566 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe8e40ff760 0x7fe8e419e8a0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:02:24.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.974+0000 7fe8eb9ff700 1 --2- 172.21.15.82:0/1658824566 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8e4100120 0x7fe8e419ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:02:24.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.974+0000 7fe8eb9ff700 1 -- 172.21.15.82:0/1658824566 >> 172.21.15.82:0/1658824566 conn(0x7fe8e40fb270 msgr2=0x7fe8e40fb9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:02:24.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.974+0000 7fe8eb9ff700 1 -- 172.21.15.82:0/1658824566 shutdown_connections 2023-09-23T09:02:24.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:24.974+0000 7fe8eb9ff700 1 -- 172.21.15.82:0/1658824566 wait complete. 2023-09-23T09:02:24.997 INFO:tasks.cephfs.filesystem:scrub status for tag:6f0fe3a6-7212-425d-a0a6-f38e8b42ec13 - {'path': '/', 'tag': '6f0fe3a6-7212-425d-a0a6-f38e8b42ec13', 'options': 'recursive,force'} 2023-09-23T09:02:26.100 INFO:teuthology.orchestra.run.smithi082.stderr:21800000 of 50000000 tuples (43%) done (elapsed 300.84 s, remaining 389.16 s) 2023-09-23T09:02:26.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:02:26 smithi082 ceph-mon[97694]: pgmap v169: 97 pgs: 97 active+clean; 5.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 37 MiB/s wr, 59 op/s 2023-09-23T09:02:26.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:02:26 smithi161 ceph-mon[99580]: pgmap v169: 97 pgs: 97 active+clean; 5.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 37 MiB/s wr, 59 op/s 2023-09-23T09:02:27.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:02:26 smithi135 ceph-mon[99205]: pgmap v169: 97 pgs: 97 active+clean; 5.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 37 MiB/s wr, 59 op/s 2023-09-23T09:02:27.419 INFO:teuthology.orchestra.run.smithi082.stderr:21900000 of 50000000 tuples (43%) done (elapsed 302.16 s, remaining 387.70 s) 2023-09-23T09:02:28.631 INFO:teuthology.orchestra.run.smithi082.stderr:22000000 of 50000000 tuples (44%) done (elapsed 303.37 s, remaining 386.11 s) 2023-09-23T09:02:28.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:02:28 smithi082 ceph-mon[97694]: pgmap v170: 97 pgs: 97 active+clean; 5.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 24 MiB/s wr, 39 op/s 2023-09-23T09:02:28.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:02:28 smithi161 ceph-mon[99580]: pgmap v170: 97 pgs: 97 active+clean; 5.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 24 MiB/s wr, 39 op/s 2023-09-23T09:02:29.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:02:28 smithi135 ceph-mon[99205]: pgmap v170: 97 pgs: 97 active+clean; 5.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 24 MiB/s wr, 39 op/s 2023-09-23T09:02:29.829 INFO:teuthology.orchestra.run.smithi082.stderr:22100000 of 50000000 tuples (44%) done (elapsed 304.57 s, remaining 384.50 s) 2023-09-23T09:02:30.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:02:30 smithi082 ceph-mon[97694]: pgmap v171: 97 pgs: 97 active+clean; 5.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 36 MiB/s wr, 62 op/s 2023-09-23T09:02:30.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:02:30 smithi161 ceph-mon[99580]: pgmap v171: 97 pgs: 97 active+clean; 5.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 36 MiB/s wr, 62 op/s 2023-09-23T09:02:31.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:02:30 smithi135 ceph-mon[99205]: pgmap v171: 97 pgs: 97 active+clean; 5.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 36 MiB/s wr, 62 op/s 2023-09-23T09:02:31.158 INFO:teuthology.orchestra.run.smithi082.stderr:22200000 of 50000000 tuples (44%) done (elapsed 305.90 s, remaining 383.06 s) 2023-09-23T09:02:32.378 INFO:teuthology.orchestra.run.smithi082.stderr:22300000 of 50000000 tuples (44%) done (elapsed 307.12 s, remaining 381.49 s) 2023-09-23T09:02:32.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:02:32 smithi082 ceph-mon[97694]: pgmap v172: 97 pgs: 97 active+clean; 5.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 24 MiB/s wr, 47 op/s 2023-09-23T09:02:32.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:02:32 smithi161 ceph-mon[99580]: pgmap v172: 97 pgs: 97 active+clean; 5.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 24 MiB/s wr, 47 op/s 2023-09-23T09:02:33.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:02:32 smithi135 ceph-mon[99205]: pgmap v172: 97 pgs: 97 active+clean; 5.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 24 MiB/s wr, 47 op/s 2023-09-23T09:02:33.641 INFO:teuthology.orchestra.run.smithi082.stderr:22400000 of 50000000 tuples (44%) done (elapsed 308.38 s, remaining 379.97 s) 2023-09-23T09:02:34.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:02:34 smithi082 ceph-mon[97694]: pgmap v173: 97 pgs: 97 active+clean; 5.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 24 MiB/s wr, 46 op/s 2023-09-23T09:02:34.878 INFO:teuthology.orchestra.run.smithi082.stderr:22500000 of 50000000 tuples (45%) done (elapsed 309.62 s, remaining 378.43 s) 2023-09-23T09:02:34.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:02:34 smithi161 ceph-mon[99580]: pgmap v173: 97 pgs: 97 active+clean; 5.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 24 MiB/s wr, 46 op/s 2023-09-23T09:02:35.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:02:34 smithi135 ceph-mon[99205]: pgmap v173: 97 pgs: 97 active+clean; 5.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 24 MiB/s wr, 46 op/s 2023-09-23T09:02:36.194 INFO:teuthology.orchestra.run.smithi082.stderr:22600000 of 50000000 tuples (45%) done (elapsed 310.94 s, remaining 376.98 s) 2023-09-23T09:02:36.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:02:36 smithi082 ceph-mon[97694]: pgmap v174: 97 pgs: 97 active+clean; 5.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 36 MiB/s wr, 86 op/s 2023-09-23T09:02:36.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:02:36 smithi161 ceph-mon[99580]: pgmap v174: 97 pgs: 97 active+clean; 5.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 36 MiB/s wr, 86 op/s 2023-09-23T09:02:37.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:02:36 smithi135 ceph-mon[99205]: pgmap v174: 97 pgs: 97 active+clean; 5.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 36 MiB/s wr, 86 op/s 2023-09-23T09:02:37.472 INFO:teuthology.orchestra.run.smithi082.stderr:22700000 of 50000000 tuples (45%) done (elapsed 312.21 s, remaining 375.48 s) 2023-09-23T09:02:38.702 INFO:teuthology.orchestra.run.smithi082.stderr:22800000 of 50000000 tuples (45%) done (elapsed 313.44 s, remaining 373.93 s) 2023-09-23T09:02:38.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:02:38 smithi082 ceph-mon[97694]: pgmap v175: 97 pgs: 97 active+clean; 5.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 24 MiB/s wr, 67 op/s 2023-09-23T09:02:38.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:02:38 smithi161 ceph-mon[99580]: pgmap v175: 97 pgs: 97 active+clean; 5.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 24 MiB/s wr, 67 op/s 2023-09-23T09:02:39.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:02:38 smithi135 ceph-mon[99205]: pgmap v175: 97 pgs: 97 active+clean; 5.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 24 MiB/s wr, 67 op/s 2023-09-23T09:02:39.997 INFO:teuthology.orchestra.run.smithi082.stderr:22900000 of 50000000 tuples (45%) done (elapsed 314.74 s, remaining 372.46 s) 2023-09-23T09:02:40.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:02:40 smithi082 ceph-mon[97694]: pgmap v176: 97 pgs: 97 active+clean; 5.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 36 MiB/s wr, 100 op/s 2023-09-23T09:02:40.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:02:40 smithi161 ceph-mon[99580]: pgmap v176: 97 pgs: 97 active+clean; 5.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 36 MiB/s wr, 100 op/s 2023-09-23T09:02:41.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:02:40 smithi135 ceph-mon[99205]: pgmap v176: 97 pgs: 97 active+clean; 5.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 36 MiB/s wr, 100 op/s 2023-09-23T09:02:42.222 INFO:teuthology.orchestra.run.smithi082.stderr:23000000 of 50000000 tuples (46%) done (elapsed 316.96 s, remaining 372.09 s) 2023-09-23T09:02:42.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:02:42 smithi082 ceph-mon[97694]: pgmap v177: 97 pgs: 97 active+clean; 5.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 24 MiB/s wr, 79 op/s 2023-09-23T09:02:42.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:02:42 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:02:42.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:02:42 smithi161 ceph-mon[99580]: pgmap v177: 97 pgs: 97 active+clean; 5.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 24 MiB/s wr, 79 op/s 2023-09-23T09:02:42.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:02:42 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:02:43.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:02:42 smithi135 ceph-mon[99205]: pgmap v177: 97 pgs: 97 active+clean; 5.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 24 MiB/s wr, 79 op/s 2023-09-23T09:02:43.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:02:42 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:02:43.446 INFO:teuthology.orchestra.run.smithi082.stderr:23100000 of 50000000 tuples (46%) done (elapsed 318.19 s, remaining 370.53 s) 2023-09-23T09:02:44.692 INFO:teuthology.orchestra.run.smithi082.stderr:23200000 of 50000000 tuples (46%) done (elapsed 319.43 s, remaining 369.00 s) 2023-09-23T09:02:44.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:02:44 smithi082 ceph-mon[97694]: pgmap v178: 97 pgs: 97 active+clean; 5.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 24 MiB/s wr, 75 op/s 2023-09-23T09:02:44.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:02:44 smithi161 ceph-mon[99580]: pgmap v178: 97 pgs: 97 active+clean; 5.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 24 MiB/s wr, 75 op/s 2023-09-23T09:02:45.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:02:44 smithi135 ceph-mon[99205]: pgmap v178: 97 pgs: 97 active+clean; 5.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 24 MiB/s wr, 75 op/s 2023-09-23T09:02:46.084 INFO:teuthology.orchestra.run.smithi082.stderr:23300000 of 50000000 tuples (46%) done (elapsed 320.83 s, remaining 367.64 s) 2023-09-23T09:02:46.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:02:46 smithi082 ceph-mon[97694]: pgmap v179: 97 pgs: 97 active+clean; 5.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 34 MiB/s wr, 105 op/s 2023-09-23T09:02:46.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:02:46 smithi161 ceph-mon[99580]: pgmap v179: 97 pgs: 97 active+clean; 5.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 34 MiB/s wr, 105 op/s 2023-09-23T09:02:47.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:02:46 smithi135 ceph-mon[99205]: pgmap v179: 97 pgs: 97 active+clean; 5.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 34 MiB/s wr, 105 op/s 2023-09-23T09:02:47.313 INFO:teuthology.orchestra.run.smithi082.stderr:23400000 of 50000000 tuples (46%) done (elapsed 322.05 s, remaining 366.10 s) 2023-09-23T09:02:47.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:02:47 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:02:47.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:02:47 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:02:48.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:02:47 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:02:48.555 INFO:teuthology.orchestra.run.smithi082.stderr:23500000 of 50000000 tuples (47%) done (elapsed 323.30 s, remaining 364.57 s) 2023-09-23T09:02:48.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:02:48 smithi082 ceph-mon[97694]: pgmap v180: 97 pgs: 97 active+clean; 5.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 21 MiB/s wr, 65 op/s 2023-09-23T09:02:48.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:02:48 smithi161 ceph-mon[99580]: pgmap v180: 97 pgs: 97 active+clean; 5.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 21 MiB/s wr, 65 op/s 2023-09-23T09:02:49.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:02:48 smithi135 ceph-mon[99205]: pgmap v180: 97 pgs: 97 active+clean; 5.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 21 MiB/s wr, 65 op/s 2023-09-23T09:02:49.866 INFO:teuthology.orchestra.run.smithi082.stderr:23600000 of 50000000 tuples (47%) done (elapsed 324.61 s, remaining 363.12 s) 2023-09-23T09:02:50.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:02:50 smithi082 ceph-mon[97694]: pgmap v181: 97 pgs: 97 active+clean; 5.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 32 MiB/s wr, 106 op/s 2023-09-23T09:02:50.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:02:50 smithi161 ceph-mon[99580]: pgmap v181: 97 pgs: 97 active+clean; 5.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 32 MiB/s wr, 106 op/s 2023-09-23T09:02:51.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:02:50 smithi135 ceph-mon[99205]: pgmap v181: 97 pgs: 97 active+clean; 5.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 32 MiB/s wr, 106 op/s 2023-09-23T09:02:51.075 INFO:teuthology.orchestra.run.smithi082.stderr:23700000 of 50000000 tuples (47%) done (elapsed 325.82 s, remaining 361.56 s) 2023-09-23T09:02:52.272 INFO:teuthology.orchestra.run.smithi082.stderr:23800000 of 50000000 tuples (47%) done (elapsed 327.01 s, remaining 359.99 s) 2023-09-23T09:02:52.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:02:52 smithi082 ceph-mon[97694]: pgmap v182: 97 pgs: 97 active+clean; 5.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 21 MiB/s wr, 76 op/s 2023-09-23T09:02:52.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:02:52 smithi161 ceph-mon[99580]: pgmap v182: 97 pgs: 97 active+clean; 5.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 21 MiB/s wr, 76 op/s 2023-09-23T09:02:53.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:02:52 smithi135 ceph-mon[99205]: pgmap v182: 97 pgs: 97 active+clean; 5.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 21 MiB/s wr, 76 op/s 2023-09-23T09:02:53.458 INFO:teuthology.orchestra.run.smithi082.stderr:23900000 of 50000000 tuples (47%) done (elapsed 328.20 s, remaining 358.41 s) 2023-09-23T09:02:54.769 INFO:teuthology.orchestra.run.smithi082.stderr:24000000 of 50000000 tuples (48%) done (elapsed 329.51 s, remaining 356.97 s) 2023-09-23T09:02:54.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:02:54 smithi082 ceph-mon[97694]: pgmap v183: 97 pgs: 97 active+clean; 5.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 21 MiB/s wr, 73 op/s 2023-09-23T09:02:54.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:02:54 smithi161 ceph-mon[99580]: pgmap v183: 97 pgs: 97 active+clean; 5.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 21 MiB/s wr, 73 op/s 2023-09-23T09:02:54.998 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:02:55.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:02:54 smithi135 ceph-mon[99205]: pgmap v183: 97 pgs: 97 active+clean; 5.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 21 MiB/s wr, 73 op/s 2023-09-23T09:02:55.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.229+0000 7fc612f9d700 1 -- 172.21.15.82:0/1364933065 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc60c106720 msgr2=0x7fc60c106b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:02:55.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.229+0000 7fc612f9d700 1 --2- 172.21.15.82:0/1364933065 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc60c106720 0x7fc60c106b00 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc608009990 tx=0x7fc608009ca0 comp rx=0 tx=0).stop 2023-09-23T09:02:55.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.230+0000 7fc612f9d700 1 -- 172.21.15.82:0/1364933065 shutdown_connections 2023-09-23T09:02:55.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.230+0000 7fc612f9d700 1 --2- 172.21.15.82:0/1364933065 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc60c1010d0 0x7fc60c10d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:02:55.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.230+0000 7fc612f9d700 1 --2- 172.21.15.82:0/1364933065 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc60c106720 0x7fc60c106b00 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:02:55.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.230+0000 7fc612f9d700 1 --2- 172.21.15.82:0/1364933065 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc60c100710 0x7fc60c100b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:02:55.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.230+0000 7fc612f9d700 1 -- 172.21.15.82:0/1364933065 >> 172.21.15.82:0/1364933065 conn(0x7fc60c0fc1e0 msgr2=0x7fc60c0fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:02:55.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.230+0000 7fc612f9d700 1 -- 172.21.15.82:0/1364933065 shutdown_connections 2023-09-23T09:02:55.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.230+0000 7fc612f9d700 1 -- 172.21.15.82:0/1364933065 wait complete. 2023-09-23T09:02:55.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.231+0000 7fc612f9d700 1 Processor -- start 2023-09-23T09:02:55.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.231+0000 7fc612f9d700 1 -- start start 2023-09-23T09:02:55.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.231+0000 7fc612f9d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc60c100710 0x7fc60c19e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:02:55.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.231+0000 7fc612f9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc60c1010d0 0x7fc60c19eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:02:55.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.231+0000 7fc612f9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc60c106720 0x7fc60c1986c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:02:55.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.231+0000 7fc612f9d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc60c198d30 con 0x7fc60c106720 2023-09-23T09:02:55.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.231+0000 7fc612f9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc60c198ea0 con 0x7fc60c1010d0 2023-09-23T09:02:55.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.231+0000 7fc612f9d700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc60c199060 con 0x7fc60c100710 2023-09-23T09:02:55.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.232+0000 7fc61179a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc60c1010d0 0x7fc60c19eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:02:55.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.232+0000 7fc611f9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc60c100710 0x7fc60c19e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:02:55.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.232+0000 7fc61179a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc60c1010d0 0x7fc60c19eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:47278/0 (socket says 172.21.15.82:47278) 2023-09-23T09:02:55.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.232+0000 7fc61179a700 1 -- 172.21.15.82:0/1665383710 learned_addr learned my addr 172.21.15.82:0/1665383710 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:02:55.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.232+0000 7fc61279c700 1 --2- 172.21.15.82:0/1665383710 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc60c106720 0x7fc60c1986c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:02:55.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.232+0000 7fc61179a700 1 -- 172.21.15.82:0/1665383710 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc60c100710 msgr2=0x7fc60c19e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:02:55.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.232+0000 7fc61179a700 1 --2- 172.21.15.82:0/1665383710 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc60c100710 0x7fc60c19e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:02:55.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.232+0000 7fc61179a700 1 -- 172.21.15.82:0/1665383710 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc60c106720 msgr2=0x7fc60c1986c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:02:55.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.232+0000 7fc61179a700 1 --2- 172.21.15.82:0/1665383710 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc60c106720 0x7fc60c1986c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:02:55.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.232+0000 7fc61179a700 1 -- 172.21.15.82:0/1665383710 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6080095f0 con 0x7fc60c1010d0 2023-09-23T09:02:55.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.232+0000 7fc611f9b700 1 --2- 172.21.15.82:0/1665383710 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc60c100710 0x7fc60c19e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:02:55.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.232+0000 7fc61179a700 1 --2- 172.21.15.82:0/1665383710 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc60c1010d0 0x7fc60c19eb90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc00e9a0 tx=0x7fc5fc00ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:02:55.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.233+0000 7fc602ffd700 1 -- 172.21.15.82:0/1665383710 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5fc009790 con 0x7fc60c1010d0 2023-09-23T09:02:55.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.233+0000 7fc612f9d700 1 -- 172.21.15.82:0/1665383710 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc60c199340 con 0x7fc60c1010d0 2023-09-23T09:02:55.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.233+0000 7fc602ffd700 1 -- 172.21.15.82:0/1665383710 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc5fc010430 con 0x7fc60c1010d0 2023-09-23T09:02:55.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.233+0000 7fc602ffd700 1 -- 172.21.15.82:0/1665383710 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5fc00cea0 con 0x7fc60c1010d0 2023-09-23T09:02:55.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.233+0000 7fc612f9d700 1 -- 172.21.15.82:0/1665383710 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc60c1a5640 con 0x7fc60c1010d0 2023-09-23T09:02:55.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.237+0000 7fc602ffd700 1 -- 172.21.15.82:0/1665383710 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7fc5fc0105a0 con 0x7fc60c1010d0 2023-09-23T09:02:55.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.238+0000 7fc627b77b80 1 Processor -- start 2023-09-23T09:02:55.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.239+0000 7fc627b77b80 1 -- start start 2023-09-23T09:02:55.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.239+0000 7fc602ffd700 1 --2- 172.21.15.82:0/1665383710 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fc5f80a0160 0x7fc5f80a2620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:02:55.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.239+0000 7fc627b77b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cda7ab2500 0x55cda7ab28e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:02:55.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.239+0000 7fc627b77b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55cda7ab2e20 0x55cda7aac700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:02:55.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.239+0000 7fc627b77b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cda7aacc40 0x55cda7aad080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:02:55.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.239+0000 7fc627b77b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cda7a147b0 con 0x55cda7aacc40 2023-09-23T09:02:55.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.239+0000 7fc627b77b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cda7a05780 con 0x55cda7ab2500 2023-09-23T09:02:55.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.239+0000 7fc627b77b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cda7a030a0 con 0x55cda7ab2e20 2023-09-23T09:02:55.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.239+0000 7fc602ffd700 1 -- 172.21.15.82:0/1665383710 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fc5fc014070 con 0x7fc60c1010d0 2023-09-23T09:02:55.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.239+0000 7fc611f9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cda7ab2500 0x55cda7ab28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:02:55.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.239+0000 7fc611f9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cda7ab2500 0x55cda7ab28e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:47294/0 (socket says 172.21.15.82:47294) 2023-09-23T09:02:55.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.239+0000 7fc611f9b700 1 -- 172.21.15.82:0/68443590 learned_addr learned my addr 172.21.15.82:0/68443590 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:02:55.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.239+0000 7fc61279c700 1 --2- 172.21.15.82:0/1665383710 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fc5f80a0160 0x7fc5f80a2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:02:55.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.239+0000 7fc61179a700 1 --2- 172.21.15.82:0/68443590 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55cda7ab2e20 0x55cda7aac700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:02:55.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.240+0000 7fc61279c700 1 --2- 172.21.15.82:0/68443590 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cda7aacc40 0x55cda7aad080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:02:55.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.240+0000 7fc611f9b700 1 -- 172.21.15.82:0/68443590 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55cda7ab2e20 msgr2=0x55cda7aac700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:02:55.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.240+0000 7fc611f9b700 1 --2- 172.21.15.82:0/68443590 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55cda7ab2e20 0x55cda7aac700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:02:55.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.240+0000 7fc611f9b700 1 -- 172.21.15.82:0/68443590 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cda7aacc40 msgr2=0x55cda7aad080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:02:55.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.240+0000 7fc611f9b700 1 --2- 172.21.15.82:0/68443590 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cda7aacc40 0x55cda7aad080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:02:55.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.240+0000 7fc611f9b700 1 -- 172.21.15.82:0/68443590 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cda787e630 con 0x55cda7ab2500 2023-09-23T09:02:55.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.240+0000 7fc611f9b700 1 --2- 172.21.15.82:0/68443590 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cda7ab2500 0x55cda7ab28e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc608015000 tx=0x7fc608005ec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=569efc1364f43796 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:02:55.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.240+0000 7fc61279c700 1 --2- 172.21.15.82:0/1665383710 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fc5f80a0160 0x7fc5f80a2620 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc604009ec0 tx=0x7fc604009920 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:02:55.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.240+0000 7fc5f7fff700 1 -- 172.21.15.82:0/68443590 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc60801d050 con 0x55cda7ab2500 2023-09-23T09:02:55.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.240+0000 7fc5f7fff700 1 -- 172.21.15.82:0/68443590 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc60801e040 con 0x55cda7ab2500 2023-09-23T09:02:55.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.240+0000 7fc5f7fff700 1 -- 172.21.15.82:0/68443590 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc608005390 con 0x55cda7ab2500 2023-09-23T09:02:55.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.241+0000 7fc627b77b80 1 -- 172.21.15.82:0/68443590 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cda7ab2500 msgr2=0x55cda7ab28e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:02:55.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.241+0000 7fc627b77b80 1 --2- 172.21.15.82:0/68443590 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cda7ab2500 0x55cda7ab28e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc608015000 tx=0x7fc608005ec0 comp rx=0 tx=0).stop 2023-09-23T09:02:55.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.241+0000 7fc627b77b80 1 -- 172.21.15.82:0/68443590 shutdown_connections 2023-09-23T09:02:55.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.241+0000 7fc627b77b80 1 --2- 172.21.15.82:0/68443590 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cda7aacc40 0x55cda7aad080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:02:55.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.241+0000 7fc627b77b80 1 --2- 172.21.15.82:0/68443590 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cda7ab2500 0x55cda7ab28e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:02:55.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.241+0000 7fc627b77b80 1 --2- 172.21.15.82:0/68443590 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55cda7ab2e20 0x55cda7aac700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:02:55.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.241+0000 7fc627b77b80 1 -- 172.21.15.82:0/68443590 >> 172.21.15.82:0/68443590 conn(0x55cda7a210e0 msgr2=0x55cda7aa7940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:02:55.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.241+0000 7fc627b77b80 1 -- 172.21.15.82:0/68443590 shutdown_connections 2023-09-23T09:02:55.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.241+0000 7fc627b77b80 1 -- 172.21.15.82:0/68443590 wait complete. 2023-09-23T09:02:55.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.242+0000 7fc627b77b80 1 -- start start 2023-09-23T09:02:55.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.242+0000 7fc627b77b80 1 Processor -- start 2023-09-23T09:02:55.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.243+0000 7fc627b77b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55cda7aacc40 0x55cda7ab8de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:02:55.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.243+0000 7fc627b77b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cda7ab2500 0x55cda7ab6060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:02:55.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.243+0000 7fc627b77b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cda7ab2e20 0x55cda7ab67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:02:55.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.243+0000 7fc627b77b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cda79fe990 con 0x55cda7ab2e20 2023-09-23T09:02:55.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.243+0000 7fc627b77b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cda799cbb0 con 0x55cda7ab2500 2023-09-23T09:02:55.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.243+0000 7fc627b77b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cda799c8b0 con 0x55cda7aacc40 2023-09-23T09:02:55.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.243+0000 7fc627b77b80 10 client.0 _ll_register_callbacks cb 0x55cda78e6a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:02:55.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.243+0000 7fc611f9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55cda7aacc40 0x55cda7ab8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:02:55.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.243+0000 7fc61179a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cda7ab2500 0x55cda7ab6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:02:55.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.243+0000 7fc611f9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55cda7aacc40 0x55cda7ab8de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:58860/0 (socket says 172.21.15.82:58860) 2023-09-23T09:02:55.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.243+0000 7fc611f9b700 1 -- 172.21.15.82:0/2786009354 learned_addr learned my addr 172.21.15.82:0/2786009354 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:02:55.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.243+0000 7fc61279c700 1 --2- 172.21.15.82:0/2786009354 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cda7ab2e20 0x55cda7ab67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:02:55.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.243+0000 7fc611f9b700 1 -- 172.21.15.82:0/2786009354 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cda7ab2500 msgr2=0x55cda7ab6060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:02:55.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.243+0000 7fc611f9b700 1 --2- 172.21.15.82:0/2786009354 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cda7ab2500 0x55cda7ab6060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:02:55.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.243+0000 7fc611f9b700 1 -- 172.21.15.82:0/2786009354 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cda7ab2e20 msgr2=0x55cda7ab67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:02:55.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.243+0000 7fc611f9b700 1 --2- 172.21.15.82:0/2786009354 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cda7ab2e20 0x55cda7ab67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:02:55.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.244+0000 7fc611f9b700 1 -- 172.21.15.82:0/2786009354 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc60c10dee0 con 0x55cda7aacc40 2023-09-23T09:02:55.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.244+0000 7fc61179a700 1 --2- 172.21.15.82:0/2786009354 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cda7ab2500 0x55cda7ab6060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:02:55.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.244+0000 7fc611f9b700 1 --2- 172.21.15.82:0/2786009354 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55cda7aacc40 0x55cda7ab8de0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc608009500 tx=0x7fc608004a10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2457aa71dd9001e2 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:02:55.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.244+0000 7fc5f57fa700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T09:02:55.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.244+0000 7fc5f57fa700 1 -- 172.21.15.82:0/2786009354 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc608005380 con 0x55cda7aacc40 2023-09-23T09:02:55.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.244+0000 7fc627b77b80 1 -- 172.21.15.82:0/2786009354 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cda7a7c1c0 con 0x55cda7aacc40 2023-09-23T09:02:55.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.244+0000 7fc5f57fa700 1 -- 172.21.15.82:0/2786009354 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fc6080054e0 con 0x55cda7aacc40 2023-09-23T09:02:55.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.245+0000 7fc5f57fa700 1 -- 172.21.15.82:0/2786009354 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc608004c30 con 0x55cda7aacc40 2023-09-23T09:02:55.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.245+0000 7fc627b77b80 10 client.25828 fetch_fsmap learned FSMap version 42 2023-09-23T09:02:55.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.245+0000 7fc627b77b80 1 -- 172.21.15.82:0/2786009354 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) v3 -- 0x55cda782ade0 con 0x55cda7aacc40 2023-09-23T09:02:55.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.245+0000 7fc5f57fa700 1 -- 172.21.15.82:0/2786009354 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55cda7a7c1c0 con 0x55cda7aacc40 2023-09-23T09:02:55.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.245+0000 7fc5f57fa700 1 -- 172.21.15.82:0/2786009354 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 42) v1 ==== 7930+0+0 (secure 0 0 0) 0x7fc60800f460 con 0x55cda7aacc40 2023-09-23T09:02:55.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.245+0000 7fc627b77b80 10 client.25828 fetch_fsmap finished waiting for FSMap version 42 2023-09-23T09:02:55.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.245+0000 7fc627b77b80 10 client.25828 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:02:55.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.245+0000 7fc627b77b80 20 client.25828 populate_metadata read hostname 'smithi082' 2023-09-23T09:02:55.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.245+0000 7fc627b77b80 1 --2- 172.21.15.82:0/2786009354 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55cda7ac6490 0x55cda7ac88b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:02:55.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.245+0000 7fc627b77b80 4 client.25828 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:02:55.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.245+0000 7fc627b77b80 1 -- 172.21.15.82:0/2786009354 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cda79a4ba0 con 0x55cda7ac6490 2023-09-23T09:02:55.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.246+0000 7fc61179a700 1 --2- 172.21.15.82:0/2786009354 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55cda7ac6490 0x55cda7ac88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:02:55.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.246+0000 7fc61179a700 1 --2- 172.21.15.82:0/2786009354 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55cda7ac6490 0x55cda7ac88b0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=473768a2f090f7c4 server_cookie=d3cf684e5c57bbf2 in_seq=0 out_seq=0 2023-09-23T09:02:55.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.246+0000 7fc5f57fa700 10 client.25828 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:02:55.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.247+0000 7fc5f57fa700 1 -- 172.21.15.82:0/2786009354 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55cda79a4ba0 con 0x55cda7ac6490 2023-09-23T09:02:55.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.247+0000 7fc5f57fa700 10 client.25828 handle_command_reply: tid=0 2023-09-23T09:02:55.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.247+0000 7fc627b77b80 1 client.25828 shutdown 2023-09-23T09:02:55.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.247+0000 7fc627b77b80 1 -- 172.21.15.82:0/2786009354 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55cda7aacc40 msgr2=0x55cda7ab8de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:02:55.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.247+0000 7fc627b77b80 1 --2- 172.21.15.82:0/2786009354 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55cda7aacc40 0x55cda7ab8de0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc608009500 tx=0x7fc608004a10 comp rx=0 tx=0).stop 2023-09-23T09:02:55.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.247+0000 7fc627b77b80 1 -- 172.21.15.82:0/2786009354 shutdown_connections 2023-09-23T09:02:55.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.247+0000 7fc627b77b80 1 --2- 172.21.15.82:0/2786009354 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55cda7ac6490 0x55cda7ac88b0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:02:55.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.247+0000 7fc627b77b80 1 --2- 172.21.15.82:0/2786009354 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cda7ab2e20 0x55cda7ab67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:02:55.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.247+0000 7fc5f57fa700 0 client.25828 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:02:55.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.247+0000 7fc627b77b80 1 --2- 172.21.15.82:0/2786009354 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55cda7aacc40 0x55cda7ab8de0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:02:55.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.247+0000 7fc627b77b80 1 --2- 172.21.15.82:0/2786009354 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cda7ab2500 0x55cda7ab6060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:02:55.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.247+0000 7fc627b77b80 1 -- 172.21.15.82:0/2786009354 >> 172.21.15.82:0/2786009354 conn(0x55cda7a210e0 msgr2=0x55cda7aa74d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:02:55.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.247+0000 7fc627b77b80 1 -- 172.21.15.82:0/2786009354 shutdown_connections 2023-09-23T09:02:55.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.247+0000 7fc627b77b80 1 -- 172.21.15.82:0/2786009354 wait complete. 2023-09-23T09:02:55.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.248+0000 7fc627b77b80 20 client.25828 trim_cache size 0 max 16384 2023-09-23T09:02:55.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.268+0000 7fc627b77b80 1 Processor -- start 2023-09-23T09:02:55.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.268+0000 7fc627b77b80 1 -- start start 2023-09-23T09:02:55.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.268+0000 7fc627b77b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cda7aacc40 0x55cda7ab8910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:02:55.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.268+0000 7fc627b77b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cda7ab2500 0x55cda7ab55d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:02:55.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.268+0000 7fc627b77b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55cda7ab2e20 0x55cda7ab01d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:02:55.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.268+0000 7fc627b77b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cda7880920 con 0x55cda7ab2500 2023-09-23T09:02:55.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.268+0000 7fc627b77b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cda7aa3c40 con 0x55cda7aacc40 2023-09-23T09:02:55.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.268+0000 7fc627b77b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cda7aad6a0 con 0x55cda7ab2e20 2023-09-23T09:02:55.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.269+0000 7fc61179a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cda7ab2500 0x55cda7ab55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:02:55.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.269+0000 7fc61179a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cda7ab2500 0x55cda7ab55d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47574/0 (socket says 172.21.15.82:47574) 2023-09-23T09:02:55.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.269+0000 7fc61179a700 1 -- 172.21.15.82:0/4271499327 learned_addr learned my addr 172.21.15.82:0/4271499327 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:02:55.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.269+0000 7fc611f9b700 1 --2- 172.21.15.82:0/4271499327 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cda7aacc40 0x55cda7ab8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:02:55.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.269+0000 7fc61279c700 1 --2- 172.21.15.82:0/4271499327 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55cda7ab2e20 0x55cda7ab01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:02:55.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.269+0000 7fc61179a700 1 -- 172.21.15.82:0/4271499327 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55cda7ab2e20 msgr2=0x55cda7ab01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:02:55.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.269+0000 7fc61179a700 1 --2- 172.21.15.82:0/4271499327 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55cda7ab2e20 0x55cda7ab01d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:02:55.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.269+0000 7fc61179a700 1 -- 172.21.15.82:0/4271499327 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cda7aacc40 msgr2=0x55cda7ab8910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:02:55.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.269+0000 7fc61179a700 1 --2- 172.21.15.82:0/4271499327 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cda7aacc40 0x55cda7ab8910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:02:55.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.269+0000 7fc61179a700 1 -- 172.21.15.82:0/4271499327 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cda7813c60 con 0x55cda7ab2500 2023-09-23T09:02:55.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.270+0000 7fc61179a700 1 --2- 172.21.15.82:0/4271499327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cda7ab2500 0x55cda7ab55d0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc0c8fb0 tx=0x7fc5fc00c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21dc321df74c3b0e server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:02:55.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.270+0000 7fc600ff9700 1 -- 172.21.15.82:0/4271499327 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5fc099610 con 0x55cda7ab2500 2023-09-23T09:02:55.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.270+0000 7fc600ff9700 1 -- 172.21.15.82:0/4271499327 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc5fc098f10 con 0x55cda7ab2500 2023-09-23T09:02:55.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.270+0000 7fc600ff9700 1 -- 172.21.15.82:0/4271499327 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5fc076d20 con 0x55cda7ab2500 2023-09-23T09:02:55.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.271+0000 7fc627b77b80 1 -- 172.21.15.82:0/4271499327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cda7ab2500 msgr2=0x55cda7ab55d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:02:55.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.271+0000 7fc627b77b80 1 --2- 172.21.15.82:0/4271499327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cda7ab2500 0x55cda7ab55d0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc0c8fb0 tx=0x7fc5fc00c480 comp rx=0 tx=0).stop 2023-09-23T09:02:55.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.271+0000 7fc627b77b80 1 -- 172.21.15.82:0/4271499327 shutdown_connections 2023-09-23T09:02:55.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.271+0000 7fc627b77b80 1 --2- 172.21.15.82:0/4271499327 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55cda7ab2e20 0x55cda7ab01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:02:55.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.271+0000 7fc627b77b80 1 --2- 172.21.15.82:0/4271499327 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cda7aacc40 0x55cda7ab8910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:02:55.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.271+0000 7fc627b77b80 1 --2- 172.21.15.82:0/4271499327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cda7ab2500 0x55cda7ab55d0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:02:55.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.271+0000 7fc627b77b80 1 -- 172.21.15.82:0/4271499327 >> 172.21.15.82:0/4271499327 conn(0x55cda7a210e0 msgr2=0x55cda7ac20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:02:55.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.271+0000 7fc627b77b80 1 -- 172.21.15.82:0/4271499327 shutdown_connections 2023-09-23T09:02:55.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.271+0000 7fc627b77b80 1 -- 172.21.15.82:0/4271499327 wait complete. 2023-09-23T09:02:55.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.271+0000 7fc627b77b80 1 -- start start 2023-09-23T09:02:55.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.272+0000 7fc627b77b80 1 Processor -- start 2023-09-23T09:02:55.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.272+0000 7fc627b77b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cda7aacc40 0x55cda7aaf2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:02:55.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.272+0000 7fc627b77b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55cda7ab2500 0x55cda7aaf7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:02:55.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.272+0000 7fc627b77b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cda7ab2e20 0x55cda7aadf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:02:55.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.272+0000 7fc627b77b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cda7aae4a0 con 0x55cda7ab2e20 2023-09-23T09:02:55.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.272+0000 7fc627b77b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cda7aae610 con 0x55cda7aacc40 2023-09-23T09:02:55.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.272+0000 7fc627b77b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cda7aae7d0 con 0x55cda7ab2500 2023-09-23T09:02:55.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.272+0000 7fc627b77b80 10 client.0 _ll_register_callbacks cb 0x7fc5fc095250 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:02:55.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.273+0000 7fc61279c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cda7ab2e20 0x55cda7aadf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:02:55.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.272+0000 7fc611f9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cda7aacc40 0x55cda7aaf2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:02:55.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.273+0000 7fc61179a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55cda7ab2500 0x55cda7aaf7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:02:55.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.273+0000 7fc611f9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cda7aacc40 0x55cda7aaf2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:47324/0 (socket says 172.21.15.82:47324) 2023-09-23T09:02:55.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.273+0000 7fc61179a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55cda7ab2500 0x55cda7aaf7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:58872/0 (socket says 172.21.15.82:58872) 2023-09-23T09:02:55.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.273+0000 7fc611f9b700 1 -- 172.21.15.82:0/1699931208 learned_addr learned my addr 172.21.15.82:0/1699931208 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:02:55.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.273+0000 7fc61179a700 1 -- 172.21.15.82:0/1699931208 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cda7aacc40 msgr2=0x55cda7aaf2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:02:55.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.273+0000 7fc61179a700 1 --2- 172.21.15.82:0/1699931208 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cda7aacc40 0x55cda7aaf2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:02:55.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.273+0000 7fc61179a700 1 -- 172.21.15.82:0/1699931208 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cda7ab2e20 msgr2=0x55cda7aadf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:02:55.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.273+0000 7fc61179a700 1 --2- 172.21.15.82:0/1699931208 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cda7ab2e20 0x55cda7aadf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:02:55.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.273+0000 7fc61179a700 1 -- 172.21.15.82:0/1699931208 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc60c1a5640 con 0x55cda7ab2500 2023-09-23T09:02:55.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.273+0000 7fc61179a700 1 --2- 172.21.15.82:0/1699931208 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55cda7ab2500 0x55cda7aaf7f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc098bc0 tx=0x7fc5fc095300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=80d61bf8ce368f07 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:02:55.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.273+0000 7fc5f57fa700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T09:02:55.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.273+0000 7fc5f57fa700 1 -- 172.21.15.82:0/1699931208 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5fc076980 con 0x55cda7ab2500 2023-09-23T09:02:55.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.273+0000 7fc5f57fa700 1 -- 172.21.15.82:0/1699931208 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fc5fc099610 con 0x55cda7ab2500 2023-09-23T09:02:55.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.273+0000 7fc627b77b80 1 -- 172.21.15.82:0/1699931208 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cda7a9f8b0 con 0x55cda7ab2500 2023-09-23T09:02:55.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.274+0000 7fc5f57fa700 1 -- 172.21.15.82:0/1699931208 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc5fc099170 con 0x55cda7ab2500 2023-09-23T09:02:55.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.274+0000 7fc627b77b80 10 client.25834 fetch_fsmap learned FSMap version 42 2023-09-23T09:02:55.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.274+0000 7fc627b77b80 1 -- 172.21.15.82:0/1699931208 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) v3 -- 0x55cda7851250 con 0x55cda7ab2500 2023-09-23T09:02:55.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.274+0000 7fc5f57fa700 1 -- 172.21.15.82:0/1699931208 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55cda7a9f8b0 con 0x55cda7ab2500 2023-09-23T09:02:55.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.274+0000 7fc5f57fa700 1 -- 172.21.15.82:0/1699931208 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 42) v1 ==== 7930+0+0 (secure 0 0 0) 0x7fc5fc0b2070 con 0x55cda7ab2500 2023-09-23T09:02:55.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.274+0000 7fc627b77b80 10 client.25834 fetch_fsmap finished waiting for FSMap version 42 2023-09-23T09:02:55.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.274+0000 7fc627b77b80 10 client.25834 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:02:55.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.274+0000 7fc627b77b80 20 client.25834 populate_metadata read hostname 'smithi082' 2023-09-23T09:02:55.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.274+0000 7fc627b77b80 1 --2- 172.21.15.82:0/1699931208 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55cda7b1aff0 0x55cda7b1d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:02:55.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.274+0000 7fc627b77b80 4 client.25834 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:02:55.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.274+0000 7fc627b77b80 1 -- 172.21.15.82:0/1699931208 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55cda79f7970 con 0x55cda7b1aff0 2023-09-23T09:02:55.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.275+0000 7fc611f9b700 1 --2- 172.21.15.82:0/1699931208 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55cda7b1aff0 0x55cda7b1d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:02:55.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.275+0000 7fc611f9b700 1 --2- 172.21.15.82:0/1699931208 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55cda7b1aff0 0x55cda7b1d410 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf88299a8aa92976 server_cookie=e8a3878ceda61686 in_seq=0 out_seq=0 2023-09-23T09:02:55.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.275+0000 7fc5f57fa700 10 client.25834 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:02:55.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.275+0000 7fc5f57fa700 1 -- 172.21.15.82:0/1699931208 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55cda79f7970 con 0x55cda7b1aff0 2023-09-23T09:02:55.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.275+0000 7fc5f57fa700 10 client.25834 handle_command_reply: tid=0 2023-09-23T09:02:55.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.275+0000 7fc627b77b80 1 client.25834 shutdown 2023-09-23T09:02:55.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.276+0000 7fc627b77b80 1 -- 172.21.15.82:0/1699931208 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55cda7ab2500 msgr2=0x55cda7aaf7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:02:55.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.276+0000 7fc627b77b80 1 --2- 172.21.15.82:0/1699931208 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55cda7ab2500 0x55cda7aaf7f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc098bc0 tx=0x7fc5fc095300 comp rx=0 tx=0).stop 2023-09-23T09:02:55.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.276+0000 7fc627b77b80 1 -- 172.21.15.82:0/1699931208 shutdown_connections 2023-09-23T09:02:55.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.276+0000 7fc627b77b80 1 --2- 172.21.15.82:0/1699931208 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55cda7b1aff0 0x55cda7b1d410 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:02:55.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.276+0000 7fc627b77b80 1 --2- 172.21.15.82:0/1699931208 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cda7ab2e20 0x55cda7aadf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:02:55.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.276+0000 7fc5f57fa700 0 client.25834 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:02:55.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.276+0000 7fc627b77b80 1 --2- 172.21.15.82:0/1699931208 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cda7aacc40 0x55cda7aaf2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:02:55.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.276+0000 7fc627b77b80 1 --2- 172.21.15.82:0/1699931208 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55cda7ab2500 0x55cda7aaf7f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:02:55.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.276+0000 7fc627b77b80 1 -- 172.21.15.82:0/1699931208 >> 172.21.15.82:0/1699931208 conn(0x55cda7a210e0 msgr2=0x55cda7ab01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:02:55.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.276+0000 7fc627b77b80 1 -- 172.21.15.82:0/1699931208 shutdown_connections 2023-09-23T09:02:55.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.276+0000 7fc627b77b80 1 -- 172.21.15.82:0/1699931208 wait complete. 2023-09-23T09:02:55.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.276+0000 7fc627b77b80 20 client.25834 trim_cache size 0 max 16384 2023-09-23T09:02:55.283 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:02:55.283 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "IDLE (waiting for more scrubs)", 2023-09-23T09:02:55.283 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:02:55.284 INFO:teuthology.orchestra.run.smithi082.stdout: "6f0fe3a6-7212-425d-a0a6-f38e8b42ec13": { 2023-09-23T09:02:55.284 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:02:55.284 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "6f0fe3a6-7212-425d-a0a6-f38e8b42ec13", 2023-09-23T09:02:55.284 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:02:55.284 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:02:55.284 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:02:55.284 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:02:55.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.277+0000 7fc612f9d700 1 -- 172.21.15.82:0/1665383710 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fc5f80a0160 msgr2=0x7fc5f80a2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:02:55.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.277+0000 7fc612f9d700 1 --2- 172.21.15.82:0/1665383710 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fc5f80a0160 0x7fc5f80a2620 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc604009ec0 tx=0x7fc604009920 comp rx=0 tx=0).stop 2023-09-23T09:02:55.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.277+0000 7fc612f9d700 1 -- 172.21.15.82:0/1665383710 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc60c1010d0 msgr2=0x7fc60c19eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:02:55.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.277+0000 7fc612f9d700 1 --2- 172.21.15.82:0/1665383710 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc60c1010d0 0x7fc60c19eb90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc00e9a0 tx=0x7fc5fc00ecb0 comp rx=0 tx=0).stop 2023-09-23T09:02:55.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.277+0000 7fc612f9d700 1 -- 172.21.15.82:0/1665383710 shutdown_connections 2023-09-23T09:02:55.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.277+0000 7fc612f9d700 1 --2- 172.21.15.82:0/1665383710 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fc5f80a0160 0x7fc5f80a2620 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:02:55.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.277+0000 7fc612f9d700 1 --2- 172.21.15.82:0/1665383710 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc60c106720 0x7fc60c1986c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:02:55.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.277+0000 7fc612f9d700 1 --2- 172.21.15.82:0/1665383710 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc60c100710 0x7fc60c19e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:02:55.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.277+0000 7fc612f9d700 1 --2- 172.21.15.82:0/1665383710 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc60c1010d0 0x7fc60c19eb90 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:02:55.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.277+0000 7fc612f9d700 1 -- 172.21.15.82:0/1665383710 >> 172.21.15.82:0/1665383710 conn(0x7fc60c0fc1e0 msgr2=0x7fc60c0fc850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:02:55.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.277+0000 7fc612f9d700 1 -- 172.21.15.82:0/1665383710 shutdown_connections 2023-09-23T09:02:55.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:02:55.277+0000 7fc612f9d700 1 -- 172.21.15.82:0/1665383710 wait complete. 2023-09-23T09:02:55.298 INFO:tasks.cephfs.filesystem:scrub status for tag:6f0fe3a6-7212-425d-a0a6-f38e8b42ec13 - {'path': '/', 'tag': '6f0fe3a6-7212-425d-a0a6-f38e8b42ec13', 'options': 'recursive,force'} 2023-09-23T09:02:56.005 INFO:teuthology.orchestra.run.smithi082.stderr:24100000 of 50000000 tuples (48%) done (elapsed 330.75 s, remaining 355.45 s) 2023-09-23T09:02:56.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:02:56 smithi161 ceph-mon[99580]: pgmap v184: 97 pgs: 97 active+clean; 5.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 33 MiB/s wr, 99 op/s 2023-09-23T09:02:57.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:02:56 smithi135 ceph-mon[99205]: pgmap v184: 97 pgs: 97 active+clean; 5.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 33 MiB/s wr, 99 op/s 2023-09-23T09:02:57.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:02:56 smithi082 ceph-mon[97694]: pgmap v184: 97 pgs: 97 active+clean; 5.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 33 MiB/s wr, 99 op/s 2023-09-23T09:02:57.231 INFO:teuthology.orchestra.run.smithi082.stderr:24200000 of 50000000 tuples (48%) done (elapsed 331.97 s, remaining 353.92 s) 2023-09-23T09:02:58.518 INFO:teuthology.orchestra.run.smithi082.stderr:24300000 of 50000000 tuples (48%) done (elapsed 333.26 s, remaining 352.46 s) 2023-09-23T09:02:58.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:02:58 smithi161 ceph-mon[99580]: pgmap v185: 97 pgs: 97 active+clean; 5.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 24 MiB/s wr, 69 op/s 2023-09-23T09:02:59.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:02:58 smithi135 ceph-mon[99205]: pgmap v185: 97 pgs: 97 active+clean; 5.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 24 MiB/s wr, 69 op/s 2023-09-23T09:02:59.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:02:58 smithi082 ceph-mon[97694]: pgmap v185: 97 pgs: 97 active+clean; 5.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 24 MiB/s wr, 69 op/s 2023-09-23T09:02:59.755 INFO:teuthology.orchestra.run.smithi082.stderr:24400000 of 50000000 tuples (48%) done (elapsed 334.50 s, remaining 350.95 s) 2023-09-23T09:03:00.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:03:00 smithi161 ceph-mon[99580]: pgmap v186: 97 pgs: 97 active+clean; 5.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 33 MiB/s wr, 101 op/s 2023-09-23T09:03:01.034 INFO:teuthology.orchestra.run.smithi082.stderr:24500000 of 50000000 tuples (49%) done (elapsed 335.78 s, remaining 349.48 s) 2023-09-23T09:03:01.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:03:00 smithi135 ceph-mon[99205]: pgmap v186: 97 pgs: 97 active+clean; 5.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 33 MiB/s wr, 101 op/s 2023-09-23T09:03:01.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:03:00 smithi082 ceph-mon[97694]: pgmap v186: 97 pgs: 97 active+clean; 5.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 33 MiB/s wr, 101 op/s 2023-09-23T09:03:02.230 INFO:teuthology.orchestra.run.smithi082.stderr:24600000 of 50000000 tuples (49%) done (elapsed 336.97 s, remaining 347.93 s) 2023-09-23T09:03:02.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:03:02 smithi161 ceph-mon[99580]: pgmap v187: 97 pgs: 97 active+clean; 5.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 25 MiB/s wr, 66 op/s 2023-09-23T09:03:03.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:03:02 smithi135 ceph-mon[99205]: pgmap v187: 97 pgs: 97 active+clean; 5.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 25 MiB/s wr, 66 op/s 2023-09-23T09:03:03.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:03:02 smithi082 ceph-mon[97694]: pgmap v187: 97 pgs: 97 active+clean; 5.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 25 MiB/s wr, 66 op/s 2023-09-23T09:03:03.488 INFO:teuthology.orchestra.run.smithi082.stderr:24700000 of 50000000 tuples (49%) done (elapsed 338.23 s, remaining 346.45 s) 2023-09-23T09:03:04.667 INFO:teuthology.orchestra.run.smithi082.stderr:24800000 of 50000000 tuples (49%) done (elapsed 339.41 s, remaining 344.88 s) 2023-09-23T09:03:04.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:03:04 smithi161 ceph-mon[99580]: pgmap v188: 97 pgs: 97 active+clean; 5.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 24 MiB/s wr, 64 op/s 2023-09-23T09:03:05.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:03:04 smithi135 ceph-mon[99205]: pgmap v188: 97 pgs: 97 active+clean; 5.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 24 MiB/s wr, 64 op/s 2023-09-23T09:03:05.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:03:04 smithi082 ceph-mon[97694]: pgmap v188: 97 pgs: 97 active+clean; 5.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 24 MiB/s wr, 64 op/s 2023-09-23T09:03:05.864 INFO:teuthology.orchestra.run.smithi082.stderr:24900000 of 50000000 tuples (49%) done (elapsed 340.61 s, remaining 343.34 s) 2023-09-23T09:03:06.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:03:06 smithi161 ceph-mon[99580]: pgmap v189: 97 pgs: 97 active+clean; 5.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 36 MiB/s wr, 99 op/s 2023-09-23T09:03:07.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:03:06 smithi135 ceph-mon[99205]: pgmap v189: 97 pgs: 97 active+clean; 5.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 36 MiB/s wr, 99 op/s 2023-09-23T09:03:07.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:03:06 smithi082 ceph-mon[97694]: pgmap v189: 97 pgs: 97 active+clean; 5.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 36 MiB/s wr, 99 op/s 2023-09-23T09:03:07.142 INFO:teuthology.orchestra.run.smithi082.stderr:25000000 of 50000000 tuples (50%) done (elapsed 341.88 s, remaining 341.88 s) 2023-09-23T09:03:08.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:03:07 smithi135 ceph-mon[99205]: osdmap e90: 12 total, 12 up, 12 in 2023-09-23T09:03:08.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:03:07 smithi082 ceph-mon[97694]: osdmap e90: 12 total, 12 up, 12 in 2023-09-23T09:03:08.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:03:07 smithi161 ceph-mon[99580]: osdmap e90: 12 total, 12 up, 12 in 2023-09-23T09:03:08.364 INFO:teuthology.orchestra.run.smithi082.stderr:25100000 of 50000000 tuples (50%) done (elapsed 343.11 s, remaining 340.37 s) 2023-09-23T09:03:09.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:03:08 smithi135 ceph-mon[99205]: pgmap v191: 97 pgs: 97 active+clean; 5.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 29 MiB/s wr, 87 op/s 2023-09-23T09:03:09.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:03:08 smithi082 ceph-mon[97694]: pgmap v191: 97 pgs: 97 active+clean; 5.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 29 MiB/s wr, 87 op/s 2023-09-23T09:03:09.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:03:08 smithi161 ceph-mon[99580]: pgmap v191: 97 pgs: 97 active+clean; 5.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 29 MiB/s wr, 87 op/s 2023-09-23T09:03:09.634 INFO:teuthology.orchestra.run.smithi082.stderr:25200000 of 50000000 tuples (50%) done (elapsed 344.38 s, remaining 338.91 s) 2023-09-23T09:03:10.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:03:09 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:03:10.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:03:09 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:03:10.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:03:09 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:03:10.946 INFO:teuthology.orchestra.run.smithi082.stderr:25300000 of 50000000 tuples (50%) done (elapsed 345.69 s, remaining 337.49 s) 2023-09-23T09:03:11.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:03:10 smithi135 ceph-mon[99205]: pgmap v192: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 31 MiB/s wr, 60 op/s 2023-09-23T09:03:11.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:03:10 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:03:11.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:03:10 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:03:11.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:03:10 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:03:11.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:03:10 smithi082 ceph-mon[97694]: pgmap v192: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 31 MiB/s wr, 60 op/s 2023-09-23T09:03:11.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:03:10 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:03:11.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:03:10 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:03:11.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:03:10 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:03:11.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:03:10 smithi161 ceph-mon[99580]: pgmap v192: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 31 MiB/s wr, 60 op/s 2023-09-23T09:03:11.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:03:10 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:03:11.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:03:10 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:03:11.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:03:10 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:03:12.213 INFO:teuthology.orchestra.run.smithi082.stderr:25400000 of 50000000 tuples (50%) done (elapsed 346.96 s, remaining 336.03 s) 2023-09-23T09:03:13.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:03:12 smithi135 ceph-mon[99205]: pgmap v193: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 29 MiB/s wr, 53 op/s 2023-09-23T09:03:13.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:03:12 smithi082 ceph-mon[97694]: pgmap v193: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 29 MiB/s wr, 53 op/s 2023-09-23T09:03:13.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:03:12 smithi161 ceph-mon[99580]: pgmap v193: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 29 MiB/s wr, 53 op/s 2023-09-23T09:03:13.430 INFO:teuthology.orchestra.run.smithi082.stderr:25500000 of 50000000 tuples (51%) done (elapsed 348.17 s, remaining 334.52 s) 2023-09-23T09:03:14.651 INFO:teuthology.orchestra.run.smithi082.stderr:25600000 of 50000000 tuples (51%) done (elapsed 349.39 s, remaining 333.02 s) 2023-09-23T09:03:15.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:03:14 smithi135 ceph-mon[99205]: pgmap v194: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 29 MiB/s wr, 53 op/s 2023-09-23T09:03:15.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:03:14 smithi082 ceph-mon[97694]: pgmap v194: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 29 MiB/s wr, 53 op/s 2023-09-23T09:03:15.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:03:14 smithi161 ceph-mon[99580]: pgmap v194: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 29 MiB/s wr, 53 op/s 2023-09-23T09:03:15.969 INFO:teuthology.orchestra.run.smithi082.stderr:25700000 of 50000000 tuples (51%) done (elapsed 350.71 s, remaining 331.61 s) 2023-09-23T09:03:17.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:03:16 smithi135 ceph-mon[99205]: pgmap v195: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 29 MiB/s wr, 38 op/s 2023-09-23T09:03:17.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:03:16 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:03:17.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:03:16 smithi135 ceph-mon[99205]: osdmap e91: 12 total, 12 up, 12 in 2023-09-23T09:03:17.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:03:16 smithi082 ceph-mon[97694]: pgmap v195: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 29 MiB/s wr, 38 op/s 2023-09-23T09:03:17.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:03:16 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:03:17.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:03:16 smithi082 ceph-mon[97694]: osdmap e91: 12 total, 12 up, 12 in 2023-09-23T09:03:17.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:03:16 smithi161 ceph-mon[99580]: pgmap v195: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 29 MiB/s wr, 38 op/s 2023-09-23T09:03:17.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:03:16 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:03:17.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:03:16 smithi161 ceph-mon[99580]: osdmap e91: 12 total, 12 up, 12 in 2023-09-23T09:03:19.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:03:18 smithi135 ceph-mon[99205]: pgmap v197: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 29 MiB/s wr, 38 op/s 2023-09-23T09:03:19.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:03:18 smithi082 ceph-mon[97694]: pgmap v197: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 29 MiB/s wr, 38 op/s 2023-09-23T09:03:19.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:03:18 smithi161 ceph-mon[99580]: pgmap v197: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 29 MiB/s wr, 38 op/s 2023-09-23T09:03:20.668 INFO:teuthology.orchestra.run.smithi082.stderr:25800000 of 50000000 tuples (51%) done (elapsed 355.41 s, remaining 333.37 s) 2023-09-23T09:03:21.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:03:20 smithi135 ceph-mon[99205]: pgmap v198: 97 pgs: 97 active+clean; 6.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 21 MiB/s wr, 49 op/s 2023-09-23T09:03:21.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:03:20 smithi082 ceph-mon[97694]: pgmap v198: 97 pgs: 97 active+clean; 6.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 21 MiB/s wr, 49 op/s 2023-09-23T09:03:21.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:03:20 smithi161 ceph-mon[99580]: pgmap v198: 97 pgs: 97 active+clean; 6.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 21 MiB/s wr, 49 op/s 2023-09-23T09:03:21.892 INFO:teuthology.orchestra.run.smithi082.stderr:25900000 of 50000000 tuples (51%) done (elapsed 356.63 s, remaining 331.85 s) 2023-09-23T09:03:23.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:03:22 smithi135 ceph-mon[99205]: pgmap v199: 97 pgs: 97 active+clean; 6.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 21 MiB/s wr, 49 op/s 2023-09-23T09:03:23.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:03:22 smithi082 ceph-mon[97694]: pgmap v199: 97 pgs: 97 active+clean; 6.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 21 MiB/s wr, 49 op/s 2023-09-23T09:03:23.128 INFO:teuthology.orchestra.run.smithi082.stderr:26000000 of 50000000 tuples (52%) done (elapsed 357.87 s, remaining 330.34 s) 2023-09-23T09:03:23.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:03:22 smithi161 ceph-mon[99580]: pgmap v199: 97 pgs: 97 active+clean; 6.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 21 MiB/s wr, 49 op/s 2023-09-23T09:03:24.466 INFO:teuthology.orchestra.run.smithi082.stderr:26100000 of 50000000 tuples (52%) done (elapsed 359.21 s, remaining 328.93 s) 2023-09-23T09:03:25.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:03:24 smithi135 ceph-mon[99205]: pgmap v200: 97 pgs: 97 active+clean; 6.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 21 MiB/s wr, 49 op/s 2023-09-23T09:03:25.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:03:24 smithi082 ceph-mon[97694]: pgmap v200: 97 pgs: 97 active+clean; 6.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 21 MiB/s wr, 49 op/s 2023-09-23T09:03:25.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:03:24 smithi161 ceph-mon[99580]: pgmap v200: 97 pgs: 97 active+clean; 6.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 21 MiB/s wr, 49 op/s 2023-09-23T09:03:25.299 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:03:25.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.535+0000 7f7d131ff700 1 -- 172.21.15.82:0/3091719228 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d0c100890 msgr2=0x7f7d0c100d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:03:25.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.535+0000 7f7d131ff700 1 --2- 172.21.15.82:0/3091719228 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d0c100890 0x7f7d0c100d10 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f7cf8009990 tx=0x7f7cf8009ca0 comp rx=0 tx=0).stop 2023-09-23T09:03:25.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.535+0000 7f7d131ff700 1 -- 172.21.15.82:0/3091719228 shutdown_connections 2023-09-23T09:03:25.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.535+0000 7f7d131ff700 1 --2- 172.21.15.82:0/3091719228 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d0c101250 0x7f7d0c10d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:03:25.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.535+0000 7f7d131ff700 1 --2- 172.21.15.82:0/3091719228 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7d0c1068a0 0x7f7d0c106c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:03:25.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.535+0000 7f7d131ff700 1 --2- 172.21.15.82:0/3091719228 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d0c100890 0x7f7d0c100d10 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:03:25.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.535+0000 7f7d131ff700 1 -- 172.21.15.82:0/3091719228 >> 172.21.15.82:0/3091719228 conn(0x7f7d0c0fc380 msgr2=0x7f7d0c0fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:03:25.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.535+0000 7f7d131ff700 1 -- 172.21.15.82:0/3091719228 shutdown_connections 2023-09-23T09:03:25.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.536+0000 7f7d131ff700 1 -- 172.21.15.82:0/3091719228 wait complete. 2023-09-23T09:03:25.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.537+0000 7f7d131ff700 1 Processor -- start 2023-09-23T09:03:25.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.537+0000 7f7d131ff700 1 -- start start 2023-09-23T09:03:25.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.538+0000 7f7d131ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7d0c100890 0x7f7d0c19e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:03:25.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.538+0000 7f7d131ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d0c101250 0x7f7d0c19edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:03:25.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.538+0000 7f7d131ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d0c1068a0 0x7f7d0c1988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:03:25.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.538+0000 7f7d131ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0c198f50 con 0x7f7d0c101250 2023-09-23T09:03:25.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.538+0000 7f7d131ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0c1990c0 con 0x7f7d0c1068a0 2023-09-23T09:03:25.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.538+0000 7f7d131ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0c199280 con 0x7f7d0c100890 2023-09-23T09:03:25.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.538+0000 7f7d10f9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7d0c100890 0x7f7d0c19e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:03:25.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.538+0000 7f7d10f9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7d0c100890 0x7f7d0c19e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:38496/0 (socket says 172.21.15.82:38496) 2023-09-23T09:03:25.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.538+0000 7f7d10f9b700 1 -- 172.21.15.82:0/2453936935 learned_addr learned my addr 172.21.15.82:0/2453936935 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:03:25.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.538+0000 7f7d0bfff700 1 --2- 172.21.15.82:0/2453936935 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d0c101250 0x7f7d0c19edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:03:25.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.538+0000 7f7d1179c700 1 --2- 172.21.15.82:0/2453936935 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d0c1068a0 0x7f7d0c1988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:03:25.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.539+0000 7f7d10f9b700 1 -- 172.21.15.82:0/2453936935 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d0c1068a0 msgr2=0x7f7d0c1988e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:03:25.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.539+0000 7f7d10f9b700 1 --2- 172.21.15.82:0/2453936935 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d0c1068a0 0x7f7d0c1988e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:03:25.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.539+0000 7f7d10f9b700 1 -- 172.21.15.82:0/2453936935 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d0c101250 msgr2=0x7f7d0c19edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:03:25.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.539+0000 7f7d10f9b700 1 --2- 172.21.15.82:0/2453936935 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d0c101250 0x7f7d0c19edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:03:25.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.539+0000 7f7d10f9b700 1 -- 172.21.15.82:0/2453936935 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cf80095f0 con 0x7f7d0c100890 2023-09-23T09:03:25.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.539+0000 7f7d10f9b700 1 --2- 172.21.15.82:0/2453936935 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7d0c100890 0x7f7d0c19e870 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7d0000e9a0 tx=0x7f7d0000ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:03:25.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.539+0000 7f7d09ffb700 1 -- 172.21.15.82:0/2453936935 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d00009790 con 0x7f7d0c100890 2023-09-23T09:03:25.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.539+0000 7f7d09ffb700 1 -- 172.21.15.82:0/2453936935 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7d00010430 con 0x7f7d0c100890 2023-09-23T09:03:25.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.539+0000 7f7d131ff700 1 -- 172.21.15.82:0/2453936935 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d0c199560 con 0x7f7d0c100890 2023-09-23T09:03:25.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.539+0000 7f7d09ffb700 1 -- 172.21.15.82:0/2453936935 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d0000cea0 con 0x7f7d0c100890 2023-09-23T09:03:25.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.539+0000 7f7d131ff700 1 -- 172.21.15.82:0/2453936935 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d0c1a5860 con 0x7f7d0c100890 2023-09-23T09:03:25.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.543+0000 7f7d09ffb700 1 -- 172.21.15.82:0/2453936935 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f7d000105a0 con 0x7f7d0c100890 2023-09-23T09:03:25.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.544+0000 7f7d09ffb700 1 --2- 172.21.15.82:0/2453936935 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f7cfc0a0140 0x7f7cfc0a2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:03:25.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.545+0000 7f7d09ffb700 1 -- 172.21.15.82:0/2453936935 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f7d00014070 con 0x7f7d0c100890 2023-09-23T09:03:25.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.545+0000 7f7d26af6b80 1 Processor -- start 2023-09-23T09:03:25.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.545+0000 7f7d0bfff700 1 --2- 172.21.15.82:0/2453936935 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f7cfc0a0140 0x7f7cfc0a2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:03:25.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.545+0000 7f7d26af6b80 1 -- start start 2023-09-23T09:03:25.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.546+0000 7f7d0bfff700 1 --2- 172.21.15.82:0/2453936935 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f7cfc0a0140 0x7f7cfc0a2600 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c10dbb0 tx=0x7f7cf800b260 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:03:25.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.546+0000 7f7d26af6b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56146ee41380 0x56146ee41760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:03:25.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.546+0000 7f7d26af6b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56146ee41ca0 0x56146ee3b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:03:25.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.546+0000 7f7d26af6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56146ee3bc40 0x56146ee3c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:03:25.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.546+0000 7f7d26af6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56146eda37b0 con 0x56146ee3bc40 2023-09-23T09:03:25.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.546+0000 7f7d26af6b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56146ed94780 con 0x56146ee41380 2023-09-23T09:03:25.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.546+0000 7f7d26af6b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x56146ed920a0 con 0x56146ee41ca0 2023-09-23T09:03:25.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.546+0000 7f7d10f9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56146ee41380 0x56146ee41760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:03:25.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.546+0000 7f7d0bfff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56146ee41ca0 0x56146ee3b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:03:25.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.546+0000 7f7d10f9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56146ee41380 0x56146ee41760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:53016/0 (socket says 172.21.15.82:53016) 2023-09-23T09:03:25.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.546+0000 7f7d10f9b700 1 -- 172.21.15.82:0/770807391 learned_addr learned my addr 172.21.15.82:0/770807391 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:03:25.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.546+0000 7f7d1179c700 1 --2- 172.21.15.82:0/770807391 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56146ee3bc40 0x56146ee3c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:03:25.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.546+0000 7f7d10f9b700 1 -- 172.21.15.82:0/770807391 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56146ee41ca0 msgr2=0x56146ee3b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:03:25.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.546+0000 7f7d10f9b700 1 --2- 172.21.15.82:0/770807391 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56146ee41ca0 0x56146ee3b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:03:25.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.546+0000 7f7d10f9b700 1 -- 172.21.15.82:0/770807391 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56146ee3bc40 msgr2=0x56146ee3c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:03:25.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.546+0000 7f7d10f9b700 1 --2- 172.21.15.82:0/770807391 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56146ee3bc40 0x56146ee3c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:03:25.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.546+0000 7f7d10f9b700 1 -- 172.21.15.82:0/770807391 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56146ec0d630 con 0x56146ee41380 2023-09-23T09:03:25.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.547+0000 7f7d10f9b700 1 --2- 172.21.15.82:0/770807391 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56146ee41380 0x56146ee41760 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7d000a06c0 tx=0x7f7d00098a30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1355c7907c26f88 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:03:25.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.547+0000 7f7cf6ffd700 1 -- 172.21.15.82:0/770807391 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d0009cc10 con 0x56146ee41380 2023-09-23T09:03:25.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.547+0000 7f7cf6ffd700 1 -- 172.21.15.82:0/770807391 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7d000a0bf0 con 0x56146ee41380 2023-09-23T09:03:25.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.547+0000 7f7cf6ffd700 1 -- 172.21.15.82:0/770807391 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d000982d0 con 0x56146ee41380 2023-09-23T09:03:25.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.548+0000 7f7d26af6b80 1 -- 172.21.15.82:0/770807391 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56146ee41380 msgr2=0x56146ee41760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:03:25.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.548+0000 7f7d26af6b80 1 --2- 172.21.15.82:0/770807391 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56146ee41380 0x56146ee41760 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7d000a06c0 tx=0x7f7d00098a30 comp rx=0 tx=0).stop 2023-09-23T09:03:25.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.548+0000 7f7d26af6b80 1 -- 172.21.15.82:0/770807391 shutdown_connections 2023-09-23T09:03:25.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.548+0000 7f7d26af6b80 1 --2- 172.21.15.82:0/770807391 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56146ee3bc40 0x56146ee3c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:03:25.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.548+0000 7f7d26af6b80 1 --2- 172.21.15.82:0/770807391 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56146ee41380 0x56146ee41760 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:03:25.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.548+0000 7f7d26af6b80 1 --2- 172.21.15.82:0/770807391 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56146ee41ca0 0x56146ee3b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:03:25.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.548+0000 7f7d26af6b80 1 -- 172.21.15.82:0/770807391 >> 172.21.15.82:0/770807391 conn(0x56146edb00e0 msgr2=0x56146ee36410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:03:25.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.548+0000 7f7d26af6b80 1 -- 172.21.15.82:0/770807391 shutdown_connections 2023-09-23T09:03:25.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.548+0000 7f7d26af6b80 1 -- 172.21.15.82:0/770807391 wait complete. 2023-09-23T09:03:25.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.549+0000 7f7d26af6b80 1 -- start start 2023-09-23T09:03:25.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.549+0000 7f7d26af6b80 1 Processor -- start 2023-09-23T09:03:25.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.549+0000 7f7d26af6b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56146ee3bc40 0x56146ee44fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:03:25.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.549+0000 7f7d26af6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56146ee41380 0x56146ee454e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:03:25.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.549+0000 7f7d26af6b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56146ee41ca0 0x56146ee45a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:03:25.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.549+0000 7f7d26af6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56146ed8d990 con 0x56146ee41380 2023-09-23T09:03:25.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.549+0000 7f7d26af6b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56146ed2bbb0 con 0x56146ee41ca0 2023-09-23T09:03:25.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.549+0000 7f7d26af6b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x56146ed2b8b0 con 0x56146ee3bc40 2023-09-23T09:03:25.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.549+0000 7f7d26af6b80 10 client.0 _ll_register_callbacks cb 0x56146ec75a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:03:25.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.550+0000 7f7d10f9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56146ee3bc40 0x56146ee44fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:03:25.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.550+0000 7f7d0bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56146ee41380 0x56146ee454e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:03:25.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.550+0000 7f7d10f9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56146ee3bc40 0x56146ee44fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:38514/0 (socket says 172.21.15.82:38514) 2023-09-23T09:03:25.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.550+0000 7f7d1179c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56146ee41ca0 0x56146ee45a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:03:25.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.550+0000 7f7d10f9b700 1 -- 172.21.15.82:0/486233379 learned_addr learned my addr 172.21.15.82:0/486233379 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:03:25.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.550+0000 7f7d10f9b700 1 -- 172.21.15.82:0/486233379 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56146ee41ca0 msgr2=0x56146ee45a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:03:25.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.550+0000 7f7d10f9b700 1 --2- 172.21.15.82:0/486233379 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56146ee41ca0 0x56146ee45a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:03:25.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.550+0000 7f7d10f9b700 1 -- 172.21.15.82:0/486233379 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56146ee41380 msgr2=0x56146ee454e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:03:25.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.550+0000 7f7d10f9b700 1 --2- 172.21.15.82:0/486233379 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56146ee41380 0x56146ee454e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:03:25.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.550+0000 7f7d10f9b700 1 -- 172.21.15.82:0/486233379 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d0c1a5860 con 0x56146ee3bc40 2023-09-23T09:03:25.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.550+0000 7f7d10f9b700 1 --2- 172.21.15.82:0/486233379 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56146ee3bc40 0x56146ee44fa0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7d00009230 tx=0x7f7d000951d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d83b92d17d5d1359 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:03:25.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.550+0000 7f7cebfff700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T09:03:25.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.551+0000 7f7cebfff700 1 -- 172.21.15.82:0/486233379 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d000b82d0 con 0x56146ee3bc40 2023-09-23T09:03:25.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.551+0000 7f7d26af6b80 1 -- 172.21.15.82:0/486233379 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56146ee0b1c0 con 0x56146ee3bc40 2023-09-23T09:03:25.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.551+0000 7f7cebfff700 1 -- 172.21.15.82:0/486233379 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f7d0009cc10 con 0x56146ee3bc40 2023-09-23T09:03:25.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.551+0000 7f7cebfff700 1 -- 172.21.15.82:0/486233379 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7d000c6030 con 0x56146ee3bc40 2023-09-23T09:03:25.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.551+0000 7f7d26af6b80 10 client.25846 fetch_fsmap learned FSMap version 43 2023-09-23T09:03:25.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.551+0000 7f7d26af6b80 1 -- 172.21.15.82:0/486233379 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x56146ebb9de0 con 0x56146ee3bc40 2023-09-23T09:03:25.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.551+0000 7f7cebfff700 1 -- 172.21.15.82:0/486233379 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56146ee0b1c0 con 0x56146ee3bc40 2023-09-23T09:03:25.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.551+0000 7f7cebfff700 1 -- 172.21.15.82:0/486233379 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 43) v1 ==== 7926+0+0 (secure 0 0 0) 0x7f7d000a0880 con 0x56146ee3bc40 2023-09-23T09:03:25.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.551+0000 7f7d26af6b80 10 client.25846 fetch_fsmap finished waiting for FSMap version 43 2023-09-23T09:03:25.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.551+0000 7f7d26af6b80 10 client.25846 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:03:25.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.551+0000 7f7d26af6b80 20 client.25846 populate_metadata read hostname 'smithi082' 2023-09-23T09:03:25.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.551+0000 7f7d26af6b80 1 --2- 172.21.15.82:0/486233379 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56146ee553f0 0x56146ee57810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:03:25.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.552+0000 7f7d26af6b80 4 client.25846 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:03:25.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.552+0000 7f7d26af6b80 1 -- 172.21.15.82:0/486233379 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56146ed33ba0 con 0x56146ee553f0 2023-09-23T09:03:25.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.552+0000 7f7d0bfff700 1 --2- 172.21.15.82:0/486233379 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56146ee553f0 0x56146ee57810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:03:25.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.552+0000 7f7d0bfff700 1 --2- 172.21.15.82:0/486233379 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56146ee553f0 0x56146ee57810 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d6da46bfcd502060 server_cookie=db3652c8aa143a73 in_seq=0 out_seq=0 2023-09-23T09:03:25.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.552+0000 7f7cebfff700 10 client.25846 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:03:25.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.553+0000 7f7cebfff700 1 -- 172.21.15.82:0/486233379 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56146ed33ba0 con 0x56146ee553f0 2023-09-23T09:03:25.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.553+0000 7f7cebfff700 10 client.25846 handle_command_reply: tid=0 2023-09-23T09:03:25.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.553+0000 7f7d26af6b80 1 client.25846 shutdown 2023-09-23T09:03:25.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.553+0000 7f7d26af6b80 1 -- 172.21.15.82:0/486233379 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56146ee3bc40 msgr2=0x56146ee44fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:03:25.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.553+0000 7f7d26af6b80 1 --2- 172.21.15.82:0/486233379 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56146ee3bc40 0x56146ee44fa0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7d00009230 tx=0x7f7d000951d0 comp rx=0 tx=0).stop 2023-09-23T09:03:25.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.553+0000 7f7d26af6b80 1 -- 172.21.15.82:0/486233379 shutdown_connections 2023-09-23T09:03:25.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.553+0000 7f7d26af6b80 1 --2- 172.21.15.82:0/486233379 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56146ee41ca0 0x56146ee45a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:03:25.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.553+0000 7f7d26af6b80 1 --2- 172.21.15.82:0/486233379 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56146ee3bc40 0x56146ee44fa0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:03:25.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.553+0000 7f7d26af6b80 1 --2- 172.21.15.82:0/486233379 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56146ee553f0 0x56146ee57810 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:03:25.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.553+0000 7f7d26af6b80 1 --2- 172.21.15.82:0/486233379 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56146ee41380 0x56146ee454e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:03:25.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.553+0000 7f7d26af6b80 1 -- 172.21.15.82:0/486233379 >> 172.21.15.82:0/486233379 conn(0x56146edb00e0 msgr2=0x56146ee30b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:03:25.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.553+0000 7f7cebfff700 0 client.25846 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:03:25.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.554+0000 7f7d26af6b80 1 -- 172.21.15.82:0/486233379 shutdown_connections 2023-09-23T09:03:25.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.554+0000 7f7d26af6b80 1 -- 172.21.15.82:0/486233379 wait complete. 2023-09-23T09:03:25.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.554+0000 7f7d26af6b80 20 client.25846 trim_cache size 0 max 16384 2023-09-23T09:03:25.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.573+0000 7f7d26af6b80 1 Processor -- start 2023-09-23T09:03:25.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.573+0000 7f7d26af6b80 1 -- start start 2023-09-23T09:03:25.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.574+0000 7f7d26af6b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56146ee3bc40 0x56146ee3b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:03:25.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.574+0000 7f7d26af6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56146ee41380 0x56146ee44290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:03:25.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.574+0000 7f7d26af6b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56146ee41ca0 0x56146ee407f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:03:25.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.574+0000 7f7d26af6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56146ec0f920 con 0x56146ee41380 2023-09-23T09:03:25.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.574+0000 7f7d26af6b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56146ee3fcd0 con 0x56146ee3bc40 2023-09-23T09:03:25.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.574+0000 7f7d26af6b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x56146ee40d30 con 0x56146ee41ca0 2023-09-23T09:03:25.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.574+0000 7f7d10f9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56146ee3bc40 0x56146ee3b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:03:25.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.574+0000 7f7d0bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56146ee41380 0x56146ee44290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:03:25.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.574+0000 7f7d0bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56146ee41380 0x56146ee44290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48820/0 (socket says 172.21.15.82:48820) 2023-09-23T09:03:25.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.574+0000 7f7d10f9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56146ee3bc40 0x56146ee3b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:53044/0 (socket says 172.21.15.82:53044) 2023-09-23T09:03:25.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.574+0000 7f7d0bfff700 1 -- 172.21.15.82:0/2530606578 learned_addr learned my addr 172.21.15.82:0/2530606578 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:03:25.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.574+0000 7f7d1179c700 1 --2- 172.21.15.82:0/2530606578 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56146ee41ca0 0x56146ee407f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:03:25.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.574+0000 7f7d10f9b700 1 -- 172.21.15.82:0/2530606578 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56146ee41ca0 msgr2=0x56146ee407f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:03:25.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.574+0000 7f7d10f9b700 1 --2- 172.21.15.82:0/2530606578 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56146ee41ca0 0x56146ee407f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:03:25.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.574+0000 7f7d10f9b700 1 -- 172.21.15.82:0/2530606578 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56146ee41380 msgr2=0x56146ee44290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:03:25.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.574+0000 7f7d10f9b700 1 --2- 172.21.15.82:0/2530606578 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56146ee41380 0x56146ee44290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:03:25.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.574+0000 7f7d10f9b700 1 -- 172.21.15.82:0/2530606578 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56146eba2c60 con 0x56146ee3bc40 2023-09-23T09:03:25.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.574+0000 7f7d0bfff700 1 --2- 172.21.15.82:0/2530606578 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56146ee41380 0x56146ee44290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:03:25.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.575+0000 7f7d10f9b700 1 --2- 172.21.15.82:0/2530606578 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56146ee3bc40 0x56146ee3b700 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7d0000e970 tx=0x7f7d00094e40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fff4fd0dda5328bb server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:03:25.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.575+0000 7f7cf77fe700 1 -- 172.21.15.82:0/2530606578 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d000b82d0 con 0x56146ee3bc40 2023-09-23T09:03:25.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.575+0000 7f7cf77fe700 1 -- 172.21.15.82:0/2530606578 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7d000a0bf0 con 0x56146ee3bc40 2023-09-23T09:03:25.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.575+0000 7f7cf77fe700 1 -- 172.21.15.82:0/2530606578 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d000a09c0 con 0x56146ee3bc40 2023-09-23T09:03:25.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.576+0000 7f7d26af6b80 1 -- 172.21.15.82:0/2530606578 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56146ee3bc40 msgr2=0x56146ee3b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:03:25.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.576+0000 7f7d26af6b80 1 --2- 172.21.15.82:0/2530606578 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56146ee3bc40 0x56146ee3b700 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7d0000e970 tx=0x7f7d00094e40 comp rx=0 tx=0).stop 2023-09-23T09:03:25.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.576+0000 7f7d26af6b80 1 -- 172.21.15.82:0/2530606578 shutdown_connections 2023-09-23T09:03:25.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.576+0000 7f7d26af6b80 1 --2- 172.21.15.82:0/2530606578 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56146ee41ca0 0x56146ee407f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:03:25.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.576+0000 7f7d26af6b80 1 --2- 172.21.15.82:0/2530606578 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56146ee3bc40 0x56146ee3b700 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:03:25.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.576+0000 7f7d26af6b80 1 --2- 172.21.15.82:0/2530606578 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56146ee41380 0x56146ee44290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:03:25.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.576+0000 7f7d26af6b80 1 -- 172.21.15.82:0/2530606578 >> 172.21.15.82:0/2530606578 conn(0x56146edb00e0 msgr2=0x56146ee400e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:03:25.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.576+0000 7f7d26af6b80 1 -- 172.21.15.82:0/2530606578 shutdown_connections 2023-09-23T09:03:25.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.576+0000 7f7d26af6b80 1 -- 172.21.15.82:0/2530606578 wait complete. 2023-09-23T09:03:25.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.576+0000 7f7d26af6b80 1 -- start start 2023-09-23T09:03:25.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.576+0000 7f7d26af6b80 1 Processor -- start 2023-09-23T09:03:25.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.577+0000 7f7d26af6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56146ee3bc40 0x56146ee4c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:03:25.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.577+0000 7f7d26af6b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56146ee41380 0x56146ee4c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:03:25.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.577+0000 7f7d26af6b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56146ee41ca0 0x56146ee4a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:03:25.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.577+0000 7f7d26af6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56146ee4ab60 con 0x56146ee3bc40 2023-09-23T09:03:25.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.577+0000 7f7d26af6b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56146ee4acd0 con 0x56146ee41ca0 2023-09-23T09:03:25.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.577+0000 7f7d26af6b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x56146ee4ae90 con 0x56146ee41380 2023-09-23T09:03:25.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.577+0000 7f7d26af6b80 10 client.0 _ll_register_callbacks cb 0x7f7d04009f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:03:25.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.577+0000 7f7d10f9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56146ee3bc40 0x56146ee4c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:03:25.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.577+0000 7f7d10f9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56146ee3bc40 0x56146ee4c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48828/0 (socket says 172.21.15.82:48828) 2023-09-23T09:03:25.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.577+0000 7f7d10f9b700 1 -- 172.21.15.82:0/2880891635 learned_addr learned my addr 172.21.15.82:0/2880891635 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:03:25.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.577+0000 7f7d1179c700 1 --2- 172.21.15.82:0/2880891635 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56146ee41ca0 0x56146ee4a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:03:25.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.577+0000 7f7d0bfff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56146ee41380 0x56146ee4c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:03:25.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.578+0000 7f7d10f9b700 1 -- 172.21.15.82:0/2880891635 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56146ee41380 msgr2=0x56146ee4c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:03:25.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.578+0000 7f7d10f9b700 1 --2- 172.21.15.82:0/2880891635 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56146ee41380 0x56146ee4c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:03:25.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.578+0000 7f7d10f9b700 1 -- 172.21.15.82:0/2880891635 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56146ee41ca0 msgr2=0x56146ee4a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:03:25.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.578+0000 7f7d10f9b700 1 --2- 172.21.15.82:0/2880891635 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56146ee41ca0 0x56146ee4a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:03:25.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.578+0000 7f7d10f9b700 1 -- 172.21.15.82:0/2880891635 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d0c10e060 con 0x56146ee3bc40 2023-09-23T09:03:25.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.578+0000 7f7d10f9b700 1 --2- 172.21.15.82:0/2880891635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56146ee3bc40 0x56146ee4c0e0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f7d000a06c0 tx=0x7f7d000951d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f689e909d626ac9 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:03:25.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.578+0000 7f7cebfff700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:03:25.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.578+0000 7f7cebfff700 1 -- 172.21.15.82:0/2880891635 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d000b82d0 con 0x56146ee3bc40 2023-09-23T09:03:25.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.578+0000 7f7cebfff700 1 -- 172.21.15.82:0/2880891635 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f7d000c7070 con 0x56146ee3bc40 2023-09-23T09:03:25.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.578+0000 7f7d26af6b80 1 -- 172.21.15.82:0/2880891635 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56146ee2e8b0 con 0x56146ee3bc40 2023-09-23T09:03:25.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.578+0000 7f7cebfff700 1 -- 172.21.15.82:0/2880891635 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7d00094c70 con 0x56146ee3bc40 2023-09-23T09:03:25.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.578+0000 7f7d26af6b80 10 client.16116 fetch_fsmap learned FSMap version 43 2023-09-23T09:03:25.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.578+0000 7f7d26af6b80 1 -- 172.21.15.82:0/2880891635 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x56146ebb9de0 con 0x56146ee3bc40 2023-09-23T09:03:25.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.579+0000 7f7cebfff700 1 -- 172.21.15.82:0/2880891635 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56146ee2e8b0 con 0x56146ee3bc40 2023-09-23T09:03:25.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.579+0000 7f7cebfff700 1 -- 172.21.15.82:0/2880891635 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 43) v1 ==== 7926+0+0 (secure 0 0 0) 0x7f7d000939f0 con 0x56146ee3bc40 2023-09-23T09:03:25.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.579+0000 7f7d26af6b80 10 client.16116 fetch_fsmap finished waiting for FSMap version 43 2023-09-23T09:03:25.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.579+0000 7f7d26af6b80 10 client.16116 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:03:25.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.579+0000 7f7d26af6b80 20 client.16116 populate_metadata read hostname 'smithi082' 2023-09-23T09:03:25.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.579+0000 7f7d26af6b80 1 --2- 172.21.15.82:0/2880891635 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56146eea9fd0 0x56146eeac3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:03:25.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.579+0000 7f7d26af6b80 4 client.16116 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:03:25.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.579+0000 7f7d26af6b80 1 -- 172.21.15.82:0/2880891635 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x56146ed86970 con 0x56146eea9fd0 2023-09-23T09:03:25.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.579+0000 7f7d0bfff700 1 --2- 172.21.15.82:0/2880891635 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56146eea9fd0 0x56146eeac3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:03:25.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.580+0000 7f7cebfff700 10 client.16116 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:03:25.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.580+0000 7f7d0bfff700 1 --2- 172.21.15.82:0/2880891635 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56146eea9fd0 0x56146eeac3f0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12728a10f1c2f07d server_cookie=a793e6639fa83c58 in_seq=0 out_seq=0 2023-09-23T09:03:25.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.580+0000 7f7cebfff700 1 -- 172.21.15.82:0/2880891635 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x56146ed86970 con 0x56146eea9fd0 2023-09-23T09:03:25.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.580+0000 7f7cebfff700 10 client.16116 handle_command_reply: tid=0 2023-09-23T09:03:25.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.580+0000 7f7d26af6b80 1 client.16116 shutdown 2023-09-23T09:03:25.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.580+0000 7f7d26af6b80 1 -- 172.21.15.82:0/2880891635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56146ee3bc40 msgr2=0x56146ee4c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:03:25.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.580+0000 7f7d26af6b80 1 --2- 172.21.15.82:0/2880891635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56146ee3bc40 0x56146ee4c0e0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f7d000a06c0 tx=0x7f7d000951d0 comp rx=0 tx=0).stop 2023-09-23T09:03:25.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.580+0000 7f7d26af6b80 1 -- 172.21.15.82:0/2880891635 shutdown_connections 2023-09-23T09:03:25.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.580+0000 7f7d26af6b80 1 --2- 172.21.15.82:0/2880891635 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56146ee41ca0 0x56146ee4a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:03:25.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.580+0000 7f7d26af6b80 1 --2- 172.21.15.82:0/2880891635 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56146eea9fd0 0x56146eeac3f0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:03:25.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.580+0000 7f7d26af6b80 1 --2- 172.21.15.82:0/2880891635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56146ee3bc40 0x56146ee4c0e0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:03:25.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.581+0000 7f7d26af6b80 1 --2- 172.21.15.82:0/2880891635 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56146ee41380 0x56146ee4c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:03:25.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.581+0000 7f7d26af6b80 1 -- 172.21.15.82:0/2880891635 >> 172.21.15.82:0/2880891635 conn(0x56146edb00e0 msgr2=0x56146ee45290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:03:25.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.581+0000 7f7cebfff700 0 client.16116 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:03:25.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.581+0000 7f7d26af6b80 1 -- 172.21.15.82:0/2880891635 shutdown_connections 2023-09-23T09:03:25.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.581+0000 7f7d26af6b80 1 -- 172.21.15.82:0/2880891635 wait complete. 2023-09-23T09:03:25.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.581+0000 7f7d26af6b80 20 client.16116 trim_cache size 0 max 16384 2023-09-23T09:03:25.588 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:03:25.588 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "IDLE (waiting for more scrubs)", 2023-09-23T09:03:25.588 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:03:25.588 INFO:teuthology.orchestra.run.smithi082.stdout: "6f0fe3a6-7212-425d-a0a6-f38e8b42ec13": { 2023-09-23T09:03:25.588 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:03:25.588 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "6f0fe3a6-7212-425d-a0a6-f38e8b42ec13", 2023-09-23T09:03:25.588 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:03:25.589 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:03:25.589 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:03:25.589 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:03:25.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.581+0000 7f7d131ff700 1 -- 172.21.15.82:0/2453936935 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f7cfc0a0140 msgr2=0x7f7cfc0a2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:03:25.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.581+0000 7f7d131ff700 1 --2- 172.21.15.82:0/2453936935 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f7cfc0a0140 0x7f7cfc0a2600 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c10dbb0 tx=0x7f7cf800b260 comp rx=0 tx=0).stop 2023-09-23T09:03:25.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.581+0000 7f7d131ff700 1 -- 172.21.15.82:0/2453936935 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7d0c100890 msgr2=0x7f7d0c19e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:03:25.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.581+0000 7f7d131ff700 1 --2- 172.21.15.82:0/2453936935 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7d0c100890 0x7f7d0c19e870 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7d0000e9a0 tx=0x7f7d0000ecb0 comp rx=0 tx=0).stop 2023-09-23T09:03:25.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.582+0000 7f7d131ff700 1 -- 172.21.15.82:0/2453936935 shutdown_connections 2023-09-23T09:03:25.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.582+0000 7f7d131ff700 1 --2- 172.21.15.82:0/2453936935 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f7cfc0a0140 0x7f7cfc0a2600 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:03:25.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.582+0000 7f7d131ff700 1 --2- 172.21.15.82:0/2453936935 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d0c1068a0 0x7f7d0c1988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:03:25.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.582+0000 7f7d131ff700 1 --2- 172.21.15.82:0/2453936935 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7d0c100890 0x7f7d0c19e870 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:03:25.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.582+0000 7f7d131ff700 1 --2- 172.21.15.82:0/2453936935 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d0c101250 0x7f7d0c19edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:03:25.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.582+0000 7f7d131ff700 1 -- 172.21.15.82:0/2453936935 >> 172.21.15.82:0/2453936935 conn(0x7f7d0c0fc380 msgr2=0x7f7d0c10bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:03:25.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.582+0000 7f7d131ff700 1 -- 172.21.15.82:0/2453936935 shutdown_connections 2023-09-23T09:03:25.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:25.582+0000 7f7d131ff700 1 -- 172.21.15.82:0/2453936935 wait complete. 2023-09-23T09:03:25.602 INFO:tasks.cephfs.filesystem:scrub status for tag:6f0fe3a6-7212-425d-a0a6-f38e8b42ec13 - {'path': '/', 'tag': '6f0fe3a6-7212-425d-a0a6-f38e8b42ec13', 'options': 'recursive,force'} 2023-09-23T09:03:25.734 INFO:teuthology.orchestra.run.smithi082.stderr:26200000 of 50000000 tuples (52%) done (elapsed 360.48 s, remaining 327.46 s) 2023-09-23T09:03:26.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:03:25 smithi135 ceph-mon[99205]: pgmap v201: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 19 MiB/s wr, 57 op/s 2023-09-23T09:03:26.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:03:25 smithi082 ceph-mon[97694]: pgmap v201: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 19 MiB/s wr, 57 op/s 2023-09-23T09:03:26.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:03:25 smithi161 ceph-mon[99580]: pgmap v201: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 19 MiB/s wr, 57 op/s 2023-09-23T09:03:26.989 INFO:teuthology.orchestra.run.smithi082.stderr:26300000 of 50000000 tuples (52%) done (elapsed 361.73 s, remaining 325.97 s) 2023-09-23T09:03:28.314 INFO:teuthology.orchestra.run.smithi082.stderr:26400000 of 50000000 tuples (52%) done (elapsed 363.06 s, remaining 324.55 s) 2023-09-23T09:03:28.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:03:28 smithi135 ceph-mon[99205]: pgmap v202: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 18 MiB/s wr, 54 op/s 2023-09-23T09:03:28.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:03:28 smithi082 ceph-mon[97694]: pgmap v202: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 18 MiB/s wr, 54 op/s 2023-09-23T09:03:28.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:03:28 smithi161 ceph-mon[99580]: pgmap v202: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 18 MiB/s wr, 54 op/s 2023-09-23T09:03:29.543 INFO:teuthology.orchestra.run.smithi082.stderr:26500000 of 50000000 tuples (53%) done (elapsed 364.29 s, remaining 323.05 s) 2023-09-23T09:03:30.794 INFO:teuthology.orchestra.run.smithi082.stderr:26600000 of 50000000 tuples (53%) done (elapsed 365.54 s, remaining 321.56 s) 2023-09-23T09:03:30.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:03:30 smithi135 ceph-mon[99205]: pgmap v203: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 27 MiB/s wr, 82 op/s 2023-09-23T09:03:30.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:03:30 smithi082 ceph-mon[97694]: pgmap v203: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 27 MiB/s wr, 82 op/s 2023-09-23T09:03:30.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:03:30 smithi161 ceph-mon[99580]: pgmap v203: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 27 MiB/s wr, 82 op/s 2023-09-23T09:03:32.139 INFO:teuthology.orchestra.run.smithi082.stderr:26700000 of 50000000 tuples (53%) done (elapsed 366.88 s, remaining 320.16 s) 2023-09-23T09:03:32.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:03:32 smithi082 ceph-mon[97694]: pgmap v204: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 22 MiB/s wr, 65 op/s 2023-09-23T09:03:32.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:03:32 smithi161 ceph-mon[99580]: pgmap v204: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 22 MiB/s wr, 65 op/s 2023-09-23T09:03:33.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:03:32 smithi135 ceph-mon[99205]: pgmap v204: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 22 MiB/s wr, 65 op/s 2023-09-23T09:03:33.419 INFO:teuthology.orchestra.run.smithi082.stderr:26800000 of 50000000 tuples (53%) done (elapsed 368.16 s, remaining 318.71 s) 2023-09-23T09:03:34.650 INFO:teuthology.orchestra.run.smithi082.stderr:26900000 of 50000000 tuples (53%) done (elapsed 369.39 s, remaining 317.21 s) 2023-09-23T09:03:34.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:03:34 smithi082 ceph-mon[97694]: pgmap v205: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 21 MiB/s wr, 64 op/s 2023-09-23T09:03:34.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:03:34 smithi161 ceph-mon[99580]: pgmap v205: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 21 MiB/s wr, 64 op/s 2023-09-23T09:03:35.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:03:34 smithi135 ceph-mon[99205]: pgmap v205: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 21 MiB/s wr, 64 op/s 2023-09-23T09:03:36.137 INFO:teuthology.orchestra.run.smithi082.stderr:27000000 of 50000000 tuples (54%) done (elapsed 370.88 s, remaining 315.93 s) 2023-09-23T09:03:36.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:03:36 smithi082 ceph-mon[97694]: pgmap v206: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 33 MiB/s wr, 109 op/s 2023-09-23T09:03:36.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:03:36 smithi161 ceph-mon[99580]: pgmap v206: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 33 MiB/s wr, 109 op/s 2023-09-23T09:03:37.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:03:36 smithi135 ceph-mon[99205]: pgmap v206: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 33 MiB/s wr, 109 op/s 2023-09-23T09:03:37.384 INFO:teuthology.orchestra.run.smithi082.stderr:27100000 of 50000000 tuples (54%) done (elapsed 372.13 s, remaining 314.45 s) 2023-09-23T09:03:38.616 INFO:teuthology.orchestra.run.smithi082.stderr:27200000 of 50000000 tuples (54%) done (elapsed 373.36 s, remaining 312.96 s) 2023-09-23T09:03:38.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:03:38 smithi082 ceph-mon[97694]: pgmap v207: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 23 MiB/s wr, 80 op/s 2023-09-23T09:03:38.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:03:38 smithi161 ceph-mon[99580]: pgmap v207: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 23 MiB/s wr, 80 op/s 2023-09-23T09:03:39.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:03:38 smithi135 ceph-mon[99205]: pgmap v207: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 23 MiB/s wr, 80 op/s 2023-09-23T09:03:39.828 INFO:teuthology.orchestra.run.smithi082.stderr:27300000 of 50000000 tuples (54%) done (elapsed 374.57 s, remaining 311.46 s) 2023-09-23T09:03:40.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:03:40 smithi082 ceph-mon[97694]: pgmap v208: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 35 MiB/s wr, 100 op/s 2023-09-23T09:03:40.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:03:40 smithi161 ceph-mon[99580]: pgmap v208: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 35 MiB/s wr, 100 op/s 2023-09-23T09:03:41.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:03:40 smithi135 ceph-mon[99205]: pgmap v208: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 35 MiB/s wr, 100 op/s 2023-09-23T09:03:41.155 INFO:teuthology.orchestra.run.smithi082.stderr:27400000 of 50000000 tuples (54%) done (elapsed 375.90 s, remaining 310.05 s) 2023-09-23T09:03:42.362 INFO:teuthology.orchestra.run.smithi082.stderr:27500000 of 50000000 tuples (55%) done (elapsed 377.10 s, remaining 308.54 s) 2023-09-23T09:03:42.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:03:42 smithi082 ceph-mon[97694]: pgmap v209: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 23 MiB/s wr, 69 op/s 2023-09-23T09:03:42.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:03:42 smithi161 ceph-mon[99580]: pgmap v209: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 23 MiB/s wr, 69 op/s 2023-09-23T09:03:43.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:03:42 smithi135 ceph-mon[99205]: pgmap v209: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 23 MiB/s wr, 69 op/s 2023-09-23T09:03:43.565 INFO:teuthology.orchestra.run.smithi082.stderr:27600000 of 50000000 tuples (55%) done (elapsed 378.31 s, remaining 307.03 s) 2023-09-23T09:03:44.779 INFO:teuthology.orchestra.run.smithi082.stderr:27700000 of 50000000 tuples (55%) done (elapsed 379.52 s, remaining 305.54 s) 2023-09-23T09:03:44.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:03:44 smithi082 ceph-mon[97694]: pgmap v210: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 23 MiB/s wr, 68 op/s 2023-09-23T09:03:44.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:03:44 smithi161 ceph-mon[99580]: pgmap v210: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 23 MiB/s wr, 68 op/s 2023-09-23T09:03:45.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:03:44 smithi135 ceph-mon[99205]: pgmap v210: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 23 MiB/s wr, 68 op/s 2023-09-23T09:03:46.086 INFO:teuthology.orchestra.run.smithi082.stderr:27800000 of 50000000 tuples (55%) done (elapsed 380.83 s, remaining 304.11 s) 2023-09-23T09:03:46.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:03:46 smithi082 ceph-mon[97694]: pgmap v211: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 35 MiB/s wr, 102 op/s 2023-09-23T09:03:46.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:03:46 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:03:46.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:03:46 smithi161 ceph-mon[99580]: pgmap v211: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 35 MiB/s wr, 102 op/s 2023-09-23T09:03:46.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:03:46 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:03:47.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:03:46 smithi135 ceph-mon[99205]: pgmap v211: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 35 MiB/s wr, 102 op/s 2023-09-23T09:03:47.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:03:46 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:03:47.320 INFO:teuthology.orchestra.run.smithi082.stderr:27900000 of 50000000 tuples (55%) done (elapsed 382.06 s, remaining 302.64 s) 2023-09-23T09:03:48.510 INFO:teuthology.orchestra.run.smithi082.stderr:28000000 of 50000000 tuples (56%) done (elapsed 383.25 s, remaining 301.13 s) 2023-09-23T09:03:48.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:03:48 smithi082 ceph-mon[97694]: pgmap v212: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 23 MiB/s wr, 57 op/s 2023-09-23T09:03:48.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:03:48 smithi161 ceph-mon[99580]: pgmap v212: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 23 MiB/s wr, 57 op/s 2023-09-23T09:03:49.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:03:48 smithi135 ceph-mon[99205]: pgmap v212: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 23 MiB/s wr, 57 op/s 2023-09-23T09:03:49.732 INFO:teuthology.orchestra.run.smithi082.stderr:28100000 of 50000000 tuples (56%) done (elapsed 384.47 s, remaining 299.64 s) 2023-09-23T09:03:50.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:03:50 smithi082 ceph-mon[97694]: pgmap v213: 97 pgs: 97 active+clean; 6.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 34 MiB/s wr, 77 op/s 2023-09-23T09:03:50.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:03:50 smithi161 ceph-mon[99580]: pgmap v213: 97 pgs: 97 active+clean; 6.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 34 MiB/s wr, 77 op/s 2023-09-23T09:03:50.974 INFO:teuthology.orchestra.run.smithi082.stderr:28200000 of 50000000 tuples (56%) done (elapsed 385.72 s, remaining 298.18 s) 2023-09-23T09:03:51.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:03:50 smithi135 ceph-mon[99205]: pgmap v213: 97 pgs: 97 active+clean; 6.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 34 MiB/s wr, 77 op/s 2023-09-23T09:03:52.207 INFO:teuthology.orchestra.run.smithi082.stderr:28300000 of 50000000 tuples (56%) done (elapsed 386.95 s, remaining 296.71 s) 2023-09-23T09:03:52.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:03:52 smithi082 ceph-mon[97694]: pgmap v214: 97 pgs: 97 active+clean; 6.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 25 MiB/s wr, 58 op/s 2023-09-23T09:03:52.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:03:52 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:03:52.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:03:52 smithi161 ceph-mon[99580]: pgmap v214: 97 pgs: 97 active+clean; 6.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 25 MiB/s wr, 58 op/s 2023-09-23T09:03:52.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:03:52 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:03:53.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:03:52 smithi135 ceph-mon[99205]: pgmap v214: 97 pgs: 97 active+clean; 6.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 25 MiB/s wr, 58 op/s 2023-09-23T09:03:53.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:03:52 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:03:53.397 INFO:teuthology.orchestra.run.smithi082.stderr:28400000 of 50000000 tuples (56%) done (elapsed 388.14 s, remaining 295.20 s) 2023-09-23T09:03:54.688 INFO:teuthology.orchestra.run.smithi082.stderr:28500000 of 50000000 tuples (57%) done (elapsed 389.43 s, remaining 293.78 s) 2023-09-23T09:03:54.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:03:54 smithi082 ceph-mon[97694]: pgmap v215: 97 pgs: 97 active+clean; 6.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 24 MiB/s wr, 55 op/s 2023-09-23T09:03:54.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:03:54 smithi161 ceph-mon[99580]: pgmap v215: 97 pgs: 97 active+clean; 6.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 24 MiB/s wr, 55 op/s 2023-09-23T09:03:55.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:03:54 smithi135 ceph-mon[99205]: pgmap v215: 97 pgs: 97 active+clean; 6.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 24 MiB/s wr, 55 op/s 2023-09-23T09:03:55.603 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:03:55.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.821+0000 7f7a8a39d700 1 -- 172.21.15.82:0/2982456392 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a84067a80 msgr2=0x7f7a84067e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:03:55.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.821+0000 7f7a8a39d700 1 --2- 172.21.15.82:0/2982456392 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a84067a80 0x7f7a84067e60 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f7a80009990 tx=0x7f7a80009ca0 comp rx=0 tx=0).stop 2023-09-23T09:03:55.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.821+0000 7f7a8a39d700 1 -- 172.21.15.82:0/2982456392 shutdown_connections 2023-09-23T09:03:55.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.821+0000 7f7a8a39d700 1 --2- 172.21.15.82:0/2982456392 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7a8410d410 0x7f7a8410f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:03:55.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.821+0000 7f7a8a39d700 1 --2- 172.21.15.82:0/2982456392 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a84067a80 0x7f7a84067e60 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:03:55.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.821+0000 7f7a8a39d700 1 --2- 172.21.15.82:0/2982456392 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7a840683a0 0x7f7a8410ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:03:55.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.821+0000 7f7a8a39d700 1 -- 172.21.15.82:0/2982456392 >> 172.21.15.82:0/2982456392 conn(0x7f7a840750e0 msgr2=0x7f7a840754f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:03:55.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.821+0000 7f7a8a39d700 1 -- 172.21.15.82:0/2982456392 shutdown_connections 2023-09-23T09:03:55.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.821+0000 7f7a8a39d700 1 -- 172.21.15.82:0/2982456392 wait complete. 2023-09-23T09:03:55.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.822+0000 7f7a8a39d700 1 Processor -- start 2023-09-23T09:03:55.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.822+0000 7f7a8a39d700 1 -- start start 2023-09-23T09:03:55.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.823+0000 7f7a8a39d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a84067a80 0x7f7a8419e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:03:55.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.823+0000 7f7a8a39d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7a840683a0 0x7f7a8419ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:03:55.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.823+0000 7f7a8a39d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7a8410d410 0x7f7a84198780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:03:55.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.823+0000 7f7a8a39d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a84198df0 con 0x7f7a84067a80 2023-09-23T09:03:55.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.823+0000 7f7a8a39d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a84198f60 con 0x7f7a8410d410 2023-09-23T09:03:55.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.823+0000 7f7a8a39d700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a84199120 con 0x7f7a840683a0 2023-09-23T09:03:55.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.823+0000 7f7a8939b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a84067a80 0x7f7a8419e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:03:55.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.823+0000 7f7a8939b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a84067a80 0x7f7a8419e710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34494/0 (socket says 172.21.15.82:34494) 2023-09-23T09:03:55.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.823+0000 7f7a8939b700 1 -- 172.21.15.82:0/2597090082 learned_addr learned my addr 172.21.15.82:0/2597090082 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:03:55.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.823+0000 7f7a88b9a700 1 --2- 172.21.15.82:0/2597090082 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7a840683a0 0x7f7a8419ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:03:55.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.823+0000 7f7a89b9c700 1 --2- 172.21.15.82:0/2597090082 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7a8410d410 0x7f7a84198780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:03:55.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.823+0000 7f7a8939b700 1 -- 172.21.15.82:0/2597090082 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7a840683a0 msgr2=0x7f7a8419ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:03:55.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.823+0000 7f7a8939b700 1 --2- 172.21.15.82:0/2597090082 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7a840683a0 0x7f7a8419ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:03:55.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.823+0000 7f7a8939b700 1 -- 172.21.15.82:0/2597090082 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7a8410d410 msgr2=0x7f7a84198780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:03:55.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.823+0000 7f7a8939b700 1 --2- 172.21.15.82:0/2597090082 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7a8410d410 0x7f7a84198780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:03:55.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.823+0000 7f7a8939b700 1 -- 172.21.15.82:0/2597090082 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a800095f0 con 0x7f7a84067a80 2023-09-23T09:03:55.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.824+0000 7f7a8939b700 1 --2- 172.21.15.82:0/2597090082 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a84067a80 0x7f7a8419e710 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f7a800098e0 tx=0x7f7a80004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:03:55.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.824+0000 7f7a7a7fc700 1 -- 172.21.15.82:0/2597090082 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a8001d070 con 0x7f7a84067a80 2023-09-23T09:03:55.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.824+0000 7f7a7a7fc700 1 -- 172.21.15.82:0/2597090082 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7a80022470 con 0x7f7a84067a80 2023-09-23T09:03:55.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.824+0000 7f7a8a39d700 1 -- 172.21.15.82:0/2597090082 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a841993a0 con 0x7f7a84067a80 2023-09-23T09:03:55.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.824+0000 7f7a7a7fc700 1 -- 172.21.15.82:0/2597090082 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a80017650 con 0x7f7a84067a80 2023-09-23T09:03:55.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.824+0000 7f7a8a39d700 1 -- 172.21.15.82:0/2597090082 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a841a5700 con 0x7f7a84067a80 2023-09-23T09:03:55.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.828+0000 7f7a7a7fc700 1 -- 172.21.15.82:0/2597090082 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f7a800225e0 con 0x7f7a84067a80 2023-09-23T09:03:55.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.829+0000 7f7a9ef07b80 1 Processor -- start 2023-09-23T09:03:55.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.829+0000 7f7a9ef07b80 1 -- start start 2023-09-23T09:03:55.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.830+0000 7f7a7a7fc700 1 --2- 172.21.15.82:0/2597090082 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f7a700a0160 0x7f7a700a2620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:03:55.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.830+0000 7f7a9ef07b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e78ad21500 0x55e78ad218e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:03:55.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.830+0000 7f7a9ef07b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e78ad21e20 0x55e78ad1b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:03:55.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.830+0000 7f7a9ef07b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e78ad1bc40 0x55e78ad1c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:03:55.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.830+0000 7f7a9ef07b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e78ac837b0 con 0x55e78ad21500 2023-09-23T09:03:55.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.830+0000 7f7a9ef07b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e78ac74780 con 0x55e78ad21e20 2023-09-23T09:03:55.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.830+0000 7f7a9ef07b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e78ac720a0 con 0x55e78ad1bc40 2023-09-23T09:03:55.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.830+0000 7f7a7a7fc700 1 -- 172.21.15.82:0/2597090082 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f7a800cc9e0 con 0x7f7a84067a80 2023-09-23T09:03:55.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.830+0000 7f7a88b9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e78ad21e20 0x55e78ad1b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:03:55.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.830+0000 7f7a88b9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e78ad21e20 0x55e78ad1b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:40256/0 (socket says 172.21.15.82:40256) 2023-09-23T09:03:55.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.830+0000 7f7a88b9a700 1 -- 172.21.15.82:0/2208437569 learned_addr learned my addr 172.21.15.82:0/2208437569 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:03:55.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.831+0000 7f7a89b9c700 1 --2- 172.21.15.82:0/2597090082 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f7a700a0160 0x7f7a700a2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:03:55.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.831+0000 7f7a8939b700 1 --2- 172.21.15.82:0/2208437569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e78ad21500 0x55e78ad218e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:03:55.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.831+0000 7f7a89b9c700 1 --2- 172.21.15.82:0/2208437569 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e78ad1bc40 0x55e78ad1c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:03:55.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.831+0000 7f7a88b9a700 1 -- 172.21.15.82:0/2208437569 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e78ad1bc40 msgr2=0x55e78ad1c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:03:55.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.831+0000 7f7a88b9a700 1 --2- 172.21.15.82:0/2208437569 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e78ad1bc40 0x55e78ad1c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:03:55.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.831+0000 7f7a88b9a700 1 -- 172.21.15.82:0/2208437569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e78ad21500 msgr2=0x55e78ad218e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:03:55.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.831+0000 7f7a88b9a700 1 --2- 172.21.15.82:0/2208437569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e78ad21500 0x55e78ad218e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:03:55.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.831+0000 7f7a88b9a700 1 -- 172.21.15.82:0/2208437569 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e78aaed630 con 0x55e78ad21e20 2023-09-23T09:03:55.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.831+0000 7f7a8939b700 1 --2- 172.21.15.82:0/2208437569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e78ad21500 0x55e78ad218e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:03:55.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.831+0000 7f7a88b9a700 1 --2- 172.21.15.82:0/2208437569 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e78ad21e20 0x55e78ad1b700 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7a74009d20 tx=0x7f7a74011720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1ca075be62d4a37 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:03:55.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.831+0000 7f7a89b9c700 1 --2- 172.21.15.82:0/2597090082 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f7a700a0160 0x7f7a700a2620 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c009ec0 tx=0x7f7a7c009920 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:03:55.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.832+0000 7f7a6f7fe700 1 -- 172.21.15.82:0/2208437569 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a74019630 con 0x55e78ad21e20 2023-09-23T09:03:55.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.832+0000 7f7a6f7fe700 1 -- 172.21.15.82:0/2208437569 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7a74019c20 con 0x55e78ad21e20 2023-09-23T09:03:55.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.832+0000 7f7a6f7fe700 1 -- 172.21.15.82:0/2208437569 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a7400eb60 con 0x55e78ad21e20 2023-09-23T09:03:55.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.833+0000 7f7a9ef07b80 1 -- 172.21.15.82:0/2208437569 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e78ad21e20 msgr2=0x55e78ad1b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:03:55.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.833+0000 7f7a9ef07b80 1 --2- 172.21.15.82:0/2208437569 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e78ad21e20 0x55e78ad1b700 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7a74009d20 tx=0x7f7a74011720 comp rx=0 tx=0).stop 2023-09-23T09:03:55.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.833+0000 7f7a9ef07b80 1 -- 172.21.15.82:0/2208437569 shutdown_connections 2023-09-23T09:03:55.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.833+0000 7f7a9ef07b80 1 --2- 172.21.15.82:0/2208437569 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e78ad1bc40 0x55e78ad1c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:03:55.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.833+0000 7f7a9ef07b80 1 --2- 172.21.15.82:0/2208437569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e78ad21500 0x55e78ad218e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:03:55.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.833+0000 7f7a9ef07b80 1 --2- 172.21.15.82:0/2208437569 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e78ad21e20 0x55e78ad1b700 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:03:55.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.833+0000 7f7a9ef07b80 1 -- 172.21.15.82:0/2208437569 >> 172.21.15.82:0/2208437569 conn(0x55e78ac900e0 msgr2=0x55e78ad16940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:03:55.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.833+0000 7f7a9ef07b80 1 -- 172.21.15.82:0/2208437569 shutdown_connections 2023-09-23T09:03:55.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.833+0000 7f7a9ef07b80 1 -- 172.21.15.82:0/2208437569 wait complete. 2023-09-23T09:03:55.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.833+0000 7f7a9ef07b80 1 -- start start 2023-09-23T09:03:55.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.834+0000 7f7a9ef07b80 1 Processor -- start 2023-09-23T09:03:55.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.834+0000 7f7a9ef07b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e78ad1bc40 0x55e78ad250d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:03:55.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.834+0000 7f7a9ef07b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e78ad21500 0x55e78ad25610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:03:55.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.834+0000 7f7a9ef07b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e78ad21e20 0x55e78ad25b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:03:55.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.834+0000 7f7a9ef07b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e78ac6d990 con 0x55e78ad1bc40 2023-09-23T09:03:55.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.834+0000 7f7a9ef07b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e78ac0bbb0 con 0x55e78ad21500 2023-09-23T09:03:55.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.834+0000 7f7a9ef07b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e78ac0b8b0 con 0x55e78ad21e20 2023-09-23T09:03:55.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.834+0000 7f7a9ef07b80 10 client.0 _ll_register_callbacks cb 0x55e78ab55a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:03:55.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.835+0000 7f7a88b9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e78ad21500 0x55e78ad25610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:03:55.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.835+0000 7f7a88b9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e78ad21500 0x55e78ad25610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:40264/0 (socket says 172.21.15.82:40264) 2023-09-23T09:03:55.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.835+0000 7f7a88b9a700 1 -- 172.21.15.82:0/656495364 learned_addr learned my addr 172.21.15.82:0/656495364 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:03:55.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.835+0000 7f7a8939b700 1 --2- 172.21.15.82:0/656495364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e78ad1bc40 0x55e78ad250d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:03:55.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.835+0000 7f7a89b9c700 1 --2- 172.21.15.82:0/656495364 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e78ad21e20 0x55e78ad25b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:03:55.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.835+0000 7f7a88b9a700 1 -- 172.21.15.82:0/656495364 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e78ad21e20 msgr2=0x55e78ad25b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:03:55.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.835+0000 7f7a88b9a700 1 --2- 172.21.15.82:0/656495364 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e78ad21e20 0x55e78ad25b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:03:55.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.835+0000 7f7a88b9a700 1 -- 172.21.15.82:0/656495364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e78ad1bc40 msgr2=0x55e78ad250d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:03:55.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.835+0000 7f7a88b9a700 1 --2- 172.21.15.82:0/656495364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e78ad1bc40 0x55e78ad250d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:03:55.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.835+0000 7f7a88b9a700 1 -- 172.21.15.82:0/656495364 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a74009980 con 0x55e78ad21500 2023-09-23T09:03:55.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.835+0000 7f7a88b9a700 1 --2- 172.21.15.82:0/656495364 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e78ad21500 0x55e78ad25610 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7a740056a0 tx=0x7f7a740056d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14cf82b3b3de3b08 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:03:55.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.835+0000 7f7a6cff9700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-09-23T09:03:55.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.836+0000 7f7a6cff9700 1 -- 172.21.15.82:0/656495364 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a74004b60 con 0x55e78ad21500 2023-09-23T09:03:55.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.836+0000 7f7a9ef07b80 1 -- 172.21.15.82:0/656495364 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e78aceb1c0 con 0x55e78ad21500 2023-09-23T09:03:55.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.836+0000 7f7a6cff9700 1 -- 172.21.15.82:0/656495364 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f7a7400e4d0 con 0x55e78ad21500 2023-09-23T09:03:55.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.836+0000 7f7a6cff9700 1 -- 172.21.15.82:0/656495364 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7a74005ce0 con 0x55e78ad21500 2023-09-23T09:03:55.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.836+0000 7f7a9ef07b80 10 client.25820 fetch_fsmap learned FSMap version 45 2023-09-23T09:03:55.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.836+0000 7f7a9ef07b80 1 -- 172.21.15.82:0/656495364 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x55e78aa99de0 con 0x55e78ad21500 2023-09-23T09:03:55.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.836+0000 7f7a6cff9700 1 -- 172.21.15.82:0/656495364 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55e78aceb1c0 con 0x55e78ad21500 2023-09-23T09:03:55.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.836+0000 7f7a6cff9700 1 -- 172.21.15.82:0/656495364 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 45) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f7a740038c0 con 0x55e78ad21500 2023-09-23T09:03:55.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.836+0000 7f7a9ef07b80 10 client.25820 fetch_fsmap finished waiting for FSMap version 45 2023-09-23T09:03:55.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.836+0000 7f7a9ef07b80 10 client.25820 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:03:55.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.836+0000 7f7a9ef07b80 20 client.25820 populate_metadata read hostname 'smithi082' 2023-09-23T09:03:55.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.836+0000 7f7a9ef07b80 1 --2- 172.21.15.82:0/656495364 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55e78ad358d0 0x55e78ad37cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:03:55.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.836+0000 7f7a9ef07b80 4 client.25820 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:03:55.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.836+0000 7f7a9ef07b80 1 -- 172.21.15.82:0/656495364 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e78ac13ba0 con 0x55e78ad358d0 2023-09-23T09:03:55.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.837+0000 7f7a8939b700 1 --2- 172.21.15.82:0/656495364 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55e78ad358d0 0x55e78ad37cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:03:55.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.837+0000 7f7a8939b700 1 --2- 172.21.15.82:0/656495364 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55e78ad358d0 0x55e78ad37cf0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f43a7ec807ccca77 server_cookie=edc7bc40f11573d4 in_seq=0 out_seq=0 2023-09-23T09:03:55.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.837+0000 7f7a6cff9700 10 client.25820 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:03:55.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.838+0000 7f7a6cff9700 1 -- 172.21.15.82:0/656495364 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e78ac13ba0 con 0x55e78ad358d0 2023-09-23T09:03:55.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.838+0000 7f7a6cff9700 10 client.25820 handle_command_reply: tid=0 2023-09-23T09:03:55.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.838+0000 7f7a9ef07b80 1 client.25820 shutdown 2023-09-23T09:03:55.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.838+0000 7f7a9ef07b80 1 -- 172.21.15.82:0/656495364 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e78ad21500 msgr2=0x55e78ad25610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:03:55.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.838+0000 7f7a9ef07b80 1 --2- 172.21.15.82:0/656495364 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e78ad21500 0x55e78ad25610 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7a740056a0 tx=0x7f7a740056d0 comp rx=0 tx=0).stop 2023-09-23T09:03:55.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.838+0000 7f7a9ef07b80 1 -- 172.21.15.82:0/656495364 shutdown_connections 2023-09-23T09:03:55.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.838+0000 7f7a9ef07b80 1 --2- 172.21.15.82:0/656495364 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e78ad21e20 0x55e78ad25b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:03:55.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.838+0000 7f7a9ef07b80 1 --2- 172.21.15.82:0/656495364 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55e78ad358d0 0x55e78ad37cf0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:03:55.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.838+0000 7f7a9ef07b80 1 --2- 172.21.15.82:0/656495364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e78ad1bc40 0x55e78ad250d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:03:55.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.838+0000 7f7a9ef07b80 1 --2- 172.21.15.82:0/656495364 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e78ad21500 0x55e78ad25610 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:03:55.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.838+0000 7f7a6cff9700 0 client.25820 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:03:55.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.838+0000 7f7a9ef07b80 1 -- 172.21.15.82:0/656495364 >> 172.21.15.82:0/656495364 conn(0x55e78ac900e0 msgr2=0x55e78ad1a6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:03:55.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.839+0000 7f7a9ef07b80 1 -- 172.21.15.82:0/656495364 shutdown_connections 2023-09-23T09:03:55.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.839+0000 7f7a9ef07b80 1 -- 172.21.15.82:0/656495364 wait complete. 2023-09-23T09:03:55.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.839+0000 7f7a9ef07b80 20 client.25820 trim_cache size 0 max 16384 2023-09-23T09:03:55.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.857+0000 7f7a9ef07b80 1 Processor -- start 2023-09-23T09:03:55.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.857+0000 7f7a9ef07b80 1 -- start start 2023-09-23T09:03:55.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.857+0000 7f7a9ef07b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e78ad1bc40 0x55e78ad20830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:03:55.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.857+0000 7f7a9ef07b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e78ad21500 0x55e78ad25980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:03:55.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.857+0000 7f7a9ef07b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e78ad21e20 0x55e78ad160a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:03:55.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.857+0000 7f7a9ef07b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e78aaef920 con 0x55e78ad1bc40 2023-09-23T09:03:55.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.857+0000 7f7a9ef07b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e78ad1baa0 con 0x55e78ad21500 2023-09-23T09:03:55.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.857+0000 7f7a9ef07b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e78ad0e710 con 0x55e78ad21e20 2023-09-23T09:03:55.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.858+0000 7f7a88b9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e78ad21500 0x55e78ad25980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:03:55.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.858+0000 7f7a8939b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e78ad1bc40 0x55e78ad20830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:03:55.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.858+0000 7f7a88b9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e78ad21500 0x55e78ad25980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:40268/0 (socket says 172.21.15.82:40268) 2023-09-23T09:03:55.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.858+0000 7f7a88b9a700 1 -- 172.21.15.82:0/2602527779 learned_addr learned my addr 172.21.15.82:0/2602527779 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:03:55.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.858+0000 7f7a89b9c700 1 --2- 172.21.15.82:0/2602527779 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e78ad21e20 0x55e78ad160a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:03:55.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.858+0000 7f7a88b9a700 1 -- 172.21.15.82:0/2602527779 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e78ad21e20 msgr2=0x55e78ad160a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:03:55.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.858+0000 7f7a88b9a700 1 --2- 172.21.15.82:0/2602527779 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e78ad21e20 0x55e78ad160a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:03:55.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.858+0000 7f7a88b9a700 1 -- 172.21.15.82:0/2602527779 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e78ad1bc40 msgr2=0x55e78ad20830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:03:55.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.858+0000 7f7a88b9a700 1 --2- 172.21.15.82:0/2602527779 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e78ad1bc40 0x55e78ad20830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:03:55.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.858+0000 7f7a88b9a700 1 -- 172.21.15.82:0/2602527779 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e78ad3c920 con 0x55e78ad21500 2023-09-23T09:03:55.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.858+0000 7f7a88b9a700 1 --2- 172.21.15.82:0/2602527779 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e78ad21500 0x55e78ad25980 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7a74000c00 tx=0x7f7a74011720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca3553e13d59c1f1 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:03:55.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.859+0000 7f7a6ffff700 1 -- 172.21.15.82:0/2602527779 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a7400e470 con 0x55e78ad21500 2023-09-23T09:03:55.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.859+0000 7f7a6ffff700 1 -- 172.21.15.82:0/2602527779 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7a7400e5d0 con 0x55e78ad21500 2023-09-23T09:03:55.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.859+0000 7f7a6ffff700 1 -- 172.21.15.82:0/2602527779 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a7400e970 con 0x55e78ad21500 2023-09-23T09:03:55.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.859+0000 7f7a9ef07b80 1 -- 172.21.15.82:0/2602527779 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e78ad21500 msgr2=0x55e78ad25980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:03:55.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.859+0000 7f7a9ef07b80 1 --2- 172.21.15.82:0/2602527779 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e78ad21500 0x55e78ad25980 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7a74000c00 tx=0x7f7a74011720 comp rx=0 tx=0).stop 2023-09-23T09:03:55.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.859+0000 7f7a9ef07b80 1 -- 172.21.15.82:0/2602527779 shutdown_connections 2023-09-23T09:03:55.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.859+0000 7f7a9ef07b80 1 --2- 172.21.15.82:0/2602527779 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e78ad21e20 0x55e78ad160a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:03:55.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.859+0000 7f7a9ef07b80 1 --2- 172.21.15.82:0/2602527779 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e78ad1bc40 0x55e78ad20830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:03:55.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.859+0000 7f7a9ef07b80 1 --2- 172.21.15.82:0/2602527779 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e78ad21500 0x55e78ad25980 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:03:55.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.859+0000 7f7a9ef07b80 1 -- 172.21.15.82:0/2602527779 >> 172.21.15.82:0/2602527779 conn(0x55e78ac900e0 msgr2=0x55e78ad20120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:03:55.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.860+0000 7f7a9ef07b80 1 -- 172.21.15.82:0/2602527779 shutdown_connections 2023-09-23T09:03:55.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.860+0000 7f7a9ef07b80 1 -- 172.21.15.82:0/2602527779 wait complete. 2023-09-23T09:03:55.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.860+0000 7f7a9ef07b80 1 -- start start 2023-09-23T09:03:55.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.860+0000 7f7a9ef07b80 1 Processor -- start 2023-09-23T09:03:55.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.861+0000 7f7a9ef07b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e78ad1bc40 0x55e78ad2a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:03:55.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.861+0000 7f7a9ef07b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e78ad21500 0x55e78ad2aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:03:55.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.861+0000 7f7a9ef07b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e78ad21e20 0x55e78ad88700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:03:55.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.861+0000 7f7a9ef07b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e78ad2b340 con 0x55e78ad1bc40 2023-09-23T09:03:55.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.861+0000 7f7a9ef07b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e78ad88c70 con 0x55e78ad21e20 2023-09-23T09:03:55.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.861+0000 7f7a9ef07b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e78ad88e30 con 0x55e78ad21500 2023-09-23T09:03:55.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.861+0000 7f7a9ef07b80 10 client.0 _ll_register_callbacks cb 0x7f7a74009ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:03:55.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.861+0000 7f7a8939b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e78ad1bc40 0x55e78ad2a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:03:55.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.861+0000 7f7a8939b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e78ad1bc40 0x55e78ad2a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34528/0 (socket says 172.21.15.82:34528) 2023-09-23T09:03:55.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.861+0000 7f7a8939b700 1 -- 172.21.15.82:0/1896515994 learned_addr learned my addr 172.21.15.82:0/1896515994 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:03:55.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.861+0000 7f7a88b9a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e78ad21500 0x55e78ad2aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:03:55.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.861+0000 7f7a89b9c700 1 --2- 172.21.15.82:0/1896515994 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e78ad21e20 0x55e78ad88700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:03:55.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.862+0000 7f7a8939b700 1 -- 172.21.15.82:0/1896515994 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e78ad21500 msgr2=0x55e78ad2aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:03:55.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.862+0000 7f7a8939b700 1 --2- 172.21.15.82:0/1896515994 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e78ad21500 0x55e78ad2aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:03:55.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.862+0000 7f7a8939b700 1 -- 172.21.15.82:0/1896515994 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e78ad21e20 msgr2=0x55e78ad88700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:03:55.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.862+0000 7f7a8939b700 1 --2- 172.21.15.82:0/1896515994 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e78ad21e20 0x55e78ad88700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:03:55.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.862+0000 7f7a8939b700 1 -- 172.21.15.82:0/1896515994 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e78aa99de0 con 0x55e78ad1bc40 2023-09-23T09:03:55.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.862+0000 7f7a8939b700 1 --2- 172.21.15.82:0/1896515994 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e78ad1bc40 0x55e78ad2a660 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f7a80096620 tx=0x7f7a80009290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16d7cfc409b3b3bd server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:03:55.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.862+0000 7f7a6cff9700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:03:55.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.862+0000 7f7a6cff9700 1 -- 172.21.15.82:0/1896515994 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a8009c040 con 0x55e78ad1bc40 2023-09-23T09:03:55.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.862+0000 7f7a6cff9700 1 -- 172.21.15.82:0/1896515994 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f7a8009a820 con 0x55e78ad1bc40 2023-09-23T09:03:55.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.862+0000 7f7a9ef07b80 1 -- 172.21.15.82:0/1896515994 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e78ad0e8b0 con 0x55e78ad1bc40 2023-09-23T09:03:55.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.863+0000 7f7a6cff9700 1 -- 172.21.15.82:0/1896515994 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7a8009a120 con 0x55e78ad1bc40 2023-09-23T09:03:55.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.863+0000 7f7a9ef07b80 10 client.16134 fetch_fsmap learned FSMap version 45 2023-09-23T09:03:55.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.863+0000 7f7a9ef07b80 1 -- 172.21.15.82:0/1896515994 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x55e78aa82c60 con 0x55e78ad1bc40 2023-09-23T09:03:55.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.863+0000 7f7a6cff9700 1 -- 172.21.15.82:0/1896515994 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7a80066030 con 0x55e78ad1bc40 2023-09-23T09:03:55.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.863+0000 7f7a6cff9700 1 -- 172.21.15.82:0/1896515994 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 45) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f7a8009a380 con 0x55e78ad1bc40 2023-09-23T09:03:55.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.863+0000 7f7a9ef07b80 10 client.16134 fetch_fsmap finished waiting for FSMap version 45 2023-09-23T09:03:55.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.863+0000 7f7a9ef07b80 10 client.16134 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:03:55.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.863+0000 7f7a9ef07b80 20 client.16134 populate_metadata read hostname 'smithi082' 2023-09-23T09:03:55.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.863+0000 7f7a9ef07b80 1 --2- 172.21.15.82:0/1896515994 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55e78ad8a270 0x55e78ad8c660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:03:55.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.863+0000 7f7a9ef07b80 4 client.16134 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:03:55.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.863+0000 7f7a9ef07b80 1 -- 172.21.15.82:0/1896515994 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55e78ac66970 con 0x55e78ad8a270 2023-09-23T09:03:55.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.863+0000 7f7a88b9a700 1 --2- 172.21.15.82:0/1896515994 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55e78ad8a270 0x55e78ad8c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:03:55.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.864+0000 7f7a88b9a700 1 --2- 172.21.15.82:0/1896515994 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55e78ad8a270 0x55e78ad8c660 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aec5e623c9fbb2df server_cookie=3ade779ddb852d5b in_seq=0 out_seq=0 2023-09-23T09:03:55.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.864+0000 7f7a6cff9700 10 client.16134 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:03:55.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.864+0000 7f7a6cff9700 1 -- 172.21.15.82:0/1896515994 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55e78ac66970 con 0x55e78ad8a270 2023-09-23T09:03:55.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.864+0000 7f7a6cff9700 10 client.16134 handle_command_reply: tid=0 2023-09-23T09:03:55.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.864+0000 7f7a9ef07b80 1 client.16134 shutdown 2023-09-23T09:03:55.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.864+0000 7f7a9ef07b80 1 -- 172.21.15.82:0/1896515994 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e78ad1bc40 msgr2=0x55e78ad2a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:03:55.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.864+0000 7f7a9ef07b80 1 --2- 172.21.15.82:0/1896515994 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e78ad1bc40 0x55e78ad2a660 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f7a80096620 tx=0x7f7a80009290 comp rx=0 tx=0).stop 2023-09-23T09:03:55.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.865+0000 7f7a9ef07b80 1 -- 172.21.15.82:0/1896515994 shutdown_connections 2023-09-23T09:03:55.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.865+0000 7f7a9ef07b80 1 --2- 172.21.15.82:0/1896515994 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e78ad21e20 0x55e78ad88700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:03:55.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.865+0000 7f7a9ef07b80 1 --2- 172.21.15.82:0/1896515994 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55e78ad8a270 0x55e78ad8c660 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:03:55.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.865+0000 7f7a6cff9700 0 client.16134 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:03:55.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.865+0000 7f7a9ef07b80 1 --2- 172.21.15.82:0/1896515994 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e78ad1bc40 0x55e78ad2a660 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:03:55.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.865+0000 7f7a9ef07b80 1 --2- 172.21.15.82:0/1896515994 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e78ad21500 0x55e78ad2aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:03:55.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.865+0000 7f7a9ef07b80 1 -- 172.21.15.82:0/1896515994 >> 172.21.15.82:0/1896515994 conn(0x55e78ac900e0 msgr2=0x55e78ad16930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:03:55.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.865+0000 7f7a9ef07b80 1 -- 172.21.15.82:0/1896515994 shutdown_connections 2023-09-23T09:03:55.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.865+0000 7f7a9ef07b80 1 -- 172.21.15.82:0/1896515994 wait complete. 2023-09-23T09:03:55.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.865+0000 7f7a9ef07b80 20 client.16134 trim_cache size 0 max 16384 2023-09-23T09:03:55.872 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:03:55.872 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "IDLE (waiting for more scrubs)", 2023-09-23T09:03:55.873 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:03:55.873 INFO:teuthology.orchestra.run.smithi082.stdout: "6f0fe3a6-7212-425d-a0a6-f38e8b42ec13": { 2023-09-23T09:03:55.873 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:03:55.873 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "6f0fe3a6-7212-425d-a0a6-f38e8b42ec13", 2023-09-23T09:03:55.873 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:03:55.873 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:03:55.873 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:03:55.873 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:03:55.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.866+0000 7f7a8a39d700 1 -- 172.21.15.82:0/2597090082 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f7a700a0160 msgr2=0x7f7a700a2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:03:55.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.866+0000 7f7a8a39d700 1 --2- 172.21.15.82:0/2597090082 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f7a700a0160 0x7f7a700a2620 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c009ec0 tx=0x7f7a7c009920 comp rx=0 tx=0).stop 2023-09-23T09:03:55.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.866+0000 7f7a8a39d700 1 -- 172.21.15.82:0/2597090082 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a84067a80 msgr2=0x7f7a8419e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:03:55.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.866+0000 7f7a8a39d700 1 --2- 172.21.15.82:0/2597090082 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a84067a80 0x7f7a8419e710 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f7a800098e0 tx=0x7f7a80004730 comp rx=0 tx=0).stop 2023-09-23T09:03:55.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.866+0000 7f7a8a39d700 1 -- 172.21.15.82:0/2597090082 shutdown_connections 2023-09-23T09:03:55.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.866+0000 7f7a8a39d700 1 --2- 172.21.15.82:0/2597090082 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f7a700a0160 0x7f7a700a2620 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:03:55.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.866+0000 7f7a8a39d700 1 --2- 172.21.15.82:0/2597090082 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7a8410d410 0x7f7a84198780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:03:55.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.866+0000 7f7a8a39d700 1 --2- 172.21.15.82:0/2597090082 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a84067a80 0x7f7a8419e710 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:03:55.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.866+0000 7f7a8a39d700 1 --2- 172.21.15.82:0/2597090082 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7a840683a0 0x7f7a8419ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:03:55.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.866+0000 7f7a8a39d700 1 -- 172.21.15.82:0/2597090082 >> 172.21.15.82:0/2597090082 conn(0x7f7a840750e0 msgr2=0x7f7a8410e800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:03:55.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.866+0000 7f7a8a39d700 1 -- 172.21.15.82:0/2597090082 shutdown_connections 2023-09-23T09:03:55.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:03:55.866+0000 7f7a8a39d700 1 -- 172.21.15.82:0/2597090082 wait complete. 2023-09-23T09:03:55.889 INFO:tasks.cephfs.filesystem:scrub status for tag:6f0fe3a6-7212-425d-a0a6-f38e8b42ec13 - {'path': '/', 'tag': '6f0fe3a6-7212-425d-a0a6-f38e8b42ec13', 'options': 'recursive,force'} 2023-09-23T09:03:55.909 INFO:teuthology.orchestra.run.smithi082.stderr:28600000 of 50000000 tuples (57%) done (elapsed 390.65 s, remaining 292.31 s) 2023-09-23T09:03:56.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:03:56 smithi082 ceph-mon[97694]: pgmap v216: 97 pgs: 97 active+clean; 6.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 36 MiB/s wr, 66 op/s 2023-09-23T09:03:56.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:03:56 smithi161 ceph-mon[99580]: pgmap v216: 97 pgs: 97 active+clean; 6.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 36 MiB/s wr, 66 op/s 2023-09-23T09:03:57.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:03:56 smithi135 ceph-mon[99205]: pgmap v216: 97 pgs: 97 active+clean; 6.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 36 MiB/s wr, 66 op/s 2023-09-23T09:03:57.125 INFO:teuthology.orchestra.run.smithi082.stderr:28700000 of 50000000 tuples (57%) done (elapsed 391.87 s, remaining 290.83 s) 2023-09-23T09:03:58.420 INFO:teuthology.orchestra.run.smithi082.stderr:28800000 of 50000000 tuples (57%) done (elapsed 393.16 s, remaining 289.41 s) 2023-09-23T09:03:58.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:03:58 smithi082 ceph-mon[97694]: pgmap v217: 97 pgs: 97 active+clean; 6.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 25 MiB/s wr, 32 op/s 2023-09-23T09:03:58.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:03:58 smithi161 ceph-mon[99580]: pgmap v217: 97 pgs: 97 active+clean; 6.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 25 MiB/s wr, 32 op/s 2023-09-23T09:03:59.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:03:58 smithi135 ceph-mon[99205]: pgmap v217: 97 pgs: 97 active+clean; 6.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 25 MiB/s wr, 32 op/s 2023-09-23T09:03:59.623 INFO:teuthology.orchestra.run.smithi082.stderr:28900000 of 50000000 tuples (57%) done (elapsed 394.37 s, remaining 287.93 s) 2023-09-23T09:04:00.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:04:00 smithi082 ceph-mon[97694]: pgmap v218: 97 pgs: 97 active+clean; 6.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 36 MiB/s wr, 52 op/s 2023-09-23T09:04:00.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:04:00 smithi161 ceph-mon[99580]: pgmap v218: 97 pgs: 97 active+clean; 6.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 36 MiB/s wr, 52 op/s 2023-09-23T09:04:00.899 INFO:teuthology.orchestra.run.smithi082.stderr:29000000 of 50000000 tuples (58%) done (elapsed 395.64 s, remaining 286.50 s) 2023-09-23T09:04:01.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:04:00 smithi135 ceph-mon[99205]: pgmap v218: 97 pgs: 97 active+clean; 6.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 36 MiB/s wr, 52 op/s 2023-09-23T09:04:01.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:04:01 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:04:01.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:04:01 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:04:02.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:04:01 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:04:02.192 INFO:teuthology.orchestra.run.smithi082.stderr:29100000 of 50000000 tuples (58%) done (elapsed 396.93 s, remaining 285.08 s) 2023-09-23T09:04:02.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:04:02 smithi161 ceph-mon[99580]: pgmap v219: 97 pgs: 97 active+clean; 6.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 26 MiB/s wr, 32 op/s 2023-09-23T09:04:02.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:04:02 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:04:03.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:04:02 smithi135 ceph-mon[99205]: pgmap v219: 97 pgs: 97 active+clean; 6.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 26 MiB/s wr, 32 op/s 2023-09-23T09:04:03.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:04:02 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:04:03.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:04:02 smithi082 ceph-mon[97694]: pgmap v219: 97 pgs: 97 active+clean; 6.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 26 MiB/s wr, 32 op/s 2023-09-23T09:04:03.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:04:02 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:04:03.432 INFO:teuthology.orchestra.run.smithi082.stderr:29200000 of 50000000 tuples (58%) done (elapsed 398.17 s, remaining 283.63 s) 2023-09-23T09:04:04.666 INFO:teuthology.orchestra.run.smithi082.stderr:29300000 of 50000000 tuples (58%) done (elapsed 399.41 s, remaining 282.18 s) 2023-09-23T09:04:04.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:04:04 smithi161 ceph-mon[99580]: pgmap v220: 97 pgs: 97 active+clean; 6.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 24 MiB/s wr, 31 op/s 2023-09-23T09:04:05.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:04:04 smithi135 ceph-mon[99205]: pgmap v220: 97 pgs: 97 active+clean; 6.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 24 MiB/s wr, 31 op/s 2023-09-23T09:04:05.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:04:04 smithi082 ceph-mon[97694]: pgmap v220: 97 pgs: 97 active+clean; 6.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 24 MiB/s wr, 31 op/s 2023-09-23T09:04:05.969 INFO:teuthology.orchestra.run.smithi082.stderr:29400000 of 50000000 tuples (58%) done (elapsed 400.71 s, remaining 280.77 s) 2023-09-23T09:04:06.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:04:06 smithi161 ceph-mon[99580]: pgmap v221: 97 pgs: 97 active+clean; 6.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 36 MiB/s wr, 79 op/s 2023-09-23T09:04:07.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:04:06 smithi135 ceph-mon[99205]: pgmap v221: 97 pgs: 97 active+clean; 6.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 36 MiB/s wr, 79 op/s 2023-09-23T09:04:07.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:04:06 smithi082 ceph-mon[97694]: pgmap v221: 97 pgs: 97 active+clean; 6.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 36 MiB/s wr, 79 op/s 2023-09-23T09:04:07.336 INFO:teuthology.orchestra.run.smithi082.stderr:29500000 of 50000000 tuples (59%) done (elapsed 402.08 s, remaining 279.41 s) 2023-09-23T09:04:07.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:04:07 smithi161 ceph-mon[99580]: osdmap e92: 12 total, 12 up, 12 in 2023-09-23T09:04:08.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:04:07 smithi135 ceph-mon[99205]: osdmap e92: 12 total, 12 up, 12 in 2023-09-23T09:04:08.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:04:07 smithi082 ceph-mon[97694]: osdmap e92: 12 total, 12 up, 12 in 2023-09-23T09:04:08.558 INFO:teuthology.orchestra.run.smithi082.stderr:29600000 of 50000000 tuples (59%) done (elapsed 403.30 s, remaining 277.95 s) 2023-09-23T09:04:08.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:04:08 smithi161 ceph-mon[99580]: pgmap v223: 97 pgs: 97 active+clean; 6.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 29 MiB/s wr, 82 op/s 2023-09-23T09:04:09.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:04:08 smithi135 ceph-mon[99205]: pgmap v223: 97 pgs: 97 active+clean; 6.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 29 MiB/s wr, 82 op/s 2023-09-23T09:04:09.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:04:08 smithi082 ceph-mon[97694]: pgmap v223: 97 pgs: 97 active+clean; 6.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 29 MiB/s wr, 82 op/s 2023-09-23T09:04:09.768 INFO:teuthology.orchestra.run.smithi082.stderr:29700000 of 50000000 tuples (59%) done (elapsed 404.51 s, remaining 276.48 s) 2023-09-23T09:04:11.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:04:10 smithi135 ceph-mon[99205]: pgmap v224: 97 pgs: 97 active+clean; 6.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 29 MiB/s wr, 94 op/s 2023-09-23T09:04:11.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:04:10 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:04:11.093 INFO:teuthology.orchestra.run.smithi082.stderr:29800000 of 50000000 tuples (59%) done (elapsed 405.83 s, remaining 275.10 s) 2023-09-23T09:04:11.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:04:10 smithi082 ceph-mon[97694]: pgmap v224: 97 pgs: 97 active+clean; 6.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 29 MiB/s wr, 94 op/s 2023-09-23T09:04:11.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:04:10 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:04:11.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:04:10 smithi161 ceph-mon[99580]: pgmap v224: 97 pgs: 97 active+clean; 6.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 29 MiB/s wr, 94 op/s 2023-09-23T09:04:11.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:04:10 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:04:12.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:04:11 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:04:12.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:04:11 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:04:12.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:04:11 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:04:12.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:04:11 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:04:12.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:04:11 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:04:12.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:04:11 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:04:12.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:04:11 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:04:12.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:04:11 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:04:12.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:04:11 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:04:12.360 INFO:teuthology.orchestra.run.smithi082.stderr:29900000 of 50000000 tuples (59%) done (elapsed 407.10 s, remaining 273.67 s) 2023-09-23T09:04:13.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:04:12 smithi135 ceph-mon[99205]: pgmap v225: 97 pgs: 97 active+clean; 6.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 29 MiB/s wr, 95 op/s 2023-09-23T09:04:13.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:04:12 smithi082 ceph-mon[97694]: pgmap v225: 97 pgs: 97 active+clean; 6.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 29 MiB/s wr, 95 op/s 2023-09-23T09:04:13.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:04:12 smithi161 ceph-mon[99580]: pgmap v225: 97 pgs: 97 active+clean; 6.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 29 MiB/s wr, 95 op/s 2023-09-23T09:04:13.676 INFO:teuthology.orchestra.run.smithi082.stderr:30000000 of 50000000 tuples (60%) done (elapsed 408.42 s, remaining 272.28 s) 2023-09-23T09:04:14.899 INFO:teuthology.orchestra.run.smithi082.stderr:30100000 of 50000000 tuples (60%) done (elapsed 409.64 s, remaining 270.83 s) 2023-09-23T09:04:15.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:04:14 smithi135 ceph-mon[99205]: pgmap v226: 97 pgs: 97 active+clean; 6.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 29 MiB/s wr, 95 op/s 2023-09-23T09:04:15.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:04:14 smithi082 ceph-mon[97694]: pgmap v226: 97 pgs: 97 active+clean; 6.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 29 MiB/s wr, 95 op/s 2023-09-23T09:04:15.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:04:14 smithi161 ceph-mon[99580]: pgmap v226: 97 pgs: 97 active+clean; 6.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 29 MiB/s wr, 95 op/s 2023-09-23T09:04:16.210 INFO:teuthology.orchestra.run.smithi082.stderr:30200000 of 50000000 tuples (60%) done (elapsed 410.95 s, remaining 269.43 s) 2023-09-23T09:04:17.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:04:16 smithi135 ceph-mon[99205]: pgmap v227: 97 pgs: 97 active+clean; 6.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 28 MiB/s wr, 79 op/s 2023-09-23T09:04:17.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:04:16 smithi135 ceph-mon[99205]: osdmap e93: 12 total, 12 up, 12 in 2023-09-23T09:04:17.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:04:16 smithi082 ceph-mon[97694]: pgmap v227: 97 pgs: 97 active+clean; 6.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 28 MiB/s wr, 79 op/s 2023-09-23T09:04:17.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:04:16 smithi082 ceph-mon[97694]: osdmap e93: 12 total, 12 up, 12 in 2023-09-23T09:04:17.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:04:16 smithi161 ceph-mon[99580]: pgmap v227: 97 pgs: 97 active+clean; 6.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 28 MiB/s wr, 79 op/s 2023-09-23T09:04:17.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:04:16 smithi161 ceph-mon[99580]: osdmap e93: 12 total, 12 up, 12 in 2023-09-23T09:04:17.507 INFO:teuthology.orchestra.run.smithi082.stderr:30300000 of 50000000 tuples (60%) done (elapsed 412.25 s, remaining 268.03 s) 2023-09-23T09:04:18.772 INFO:teuthology.orchestra.run.smithi082.stderr:30400000 of 50000000 tuples (60%) done (elapsed 413.51 s, remaining 266.61 s) 2023-09-23T09:04:19.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:04:18 smithi135 ceph-mon[99205]: pgmap v229: 97 pgs: 97 active+clean; 6.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 28 MiB/s wr, 79 op/s 2023-09-23T09:04:19.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:04:18 smithi082 ceph-mon[97694]: pgmap v229: 97 pgs: 97 active+clean; 6.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 28 MiB/s wr, 79 op/s 2023-09-23T09:04:19.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:04:18 smithi161 ceph-mon[99580]: pgmap v229: 97 pgs: 97 active+clean; 6.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 28 MiB/s wr, 79 op/s 2023-09-23T09:04:20.009 INFO:teuthology.orchestra.run.smithi082.stderr:30500000 of 50000000 tuples (61%) done (elapsed 414.75 s, remaining 265.17 s) 2023-09-23T09:04:21.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:04:20 smithi135 ceph-mon[99205]: pgmap v230: 97 pgs: 97 active+clean; 7.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 26 MiB/s wr, 75 op/s 2023-09-23T09:04:21.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:04:20 smithi082 ceph-mon[97694]: pgmap v230: 97 pgs: 97 active+clean; 7.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 26 MiB/s wr, 75 op/s 2023-09-23T09:04:21.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:04:20 smithi161 ceph-mon[99580]: pgmap v230: 97 pgs: 97 active+clean; 7.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 26 MiB/s wr, 75 op/s 2023-09-23T09:04:23.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:04:22 smithi135 ceph-mon[99205]: pgmap v231: 97 pgs: 97 active+clean; 7.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 28 MiB/s wr, 80 op/s 2023-09-23T09:04:23.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:04:22 smithi082 ceph-mon[97694]: pgmap v231: 97 pgs: 97 active+clean; 7.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 28 MiB/s wr, 80 op/s 2023-09-23T09:04:23.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:04:22 smithi161 ceph-mon[99580]: pgmap v231: 97 pgs: 97 active+clean; 7.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 28 MiB/s wr, 80 op/s 2023-09-23T09:04:25.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:04:24 smithi135 ceph-mon[99205]: pgmap v232: 97 pgs: 97 active+clean; 7.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 28 MiB/s wr, 80 op/s 2023-09-23T09:04:25.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:04:24 smithi082 ceph-mon[97694]: pgmap v232: 97 pgs: 97 active+clean; 7.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 28 MiB/s wr, 80 op/s 2023-09-23T09:04:25.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:04:24 smithi161 ceph-mon[99580]: pgmap v232: 97 pgs: 97 active+clean; 7.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 28 MiB/s wr, 80 op/s 2023-09-23T09:04:25.152 INFO:teuthology.orchestra.run.smithi082.stderr:30600000 of 50000000 tuples (61%) done (elapsed 419.89 s, remaining 266.21 s) 2023-09-23T09:04:25.890 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:04:26.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.131+0000 7fedd179d700 1 -- 172.21.15.82:0/2563045941 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fedcc067a80 msgr2=0x7fedcc067f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:04:26.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.132+0000 7fedd179d700 1 --2- 172.21.15.82:0/2563045941 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fedcc067a80 0x7fedcc067f00 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fedc0009990 tx=0x7fedc0009ca0 comp rx=0 tx=0).stop 2023-09-23T09:04:26.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.132+0000 7fedd179d700 1 -- 172.21.15.82:0/2563045941 shutdown_connections 2023-09-23T09:04:26.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.132+0000 7fedd179d700 1 --2- 172.21.15.82:0/2563045941 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fedcc068440 0x7fedcc10d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:04:26.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.132+0000 7fedd179d700 1 --2- 172.21.15.82:0/2563045941 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fedcc106780 0x7fedcc106b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:04:26.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.132+0000 7fedd179d700 1 --2- 172.21.15.82:0/2563045941 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fedcc067a80 0x7fedcc067f00 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:04:26.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.132+0000 7fedd179d700 1 -- 172.21.15.82:0/2563045941 >> 172.21.15.82:0/2563045941 conn(0x7fedcc0750e0 msgr2=0x7fedcc0754f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:04:26.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.132+0000 7fedd179d700 1 -- 172.21.15.82:0/2563045941 shutdown_connections 2023-09-23T09:04:26.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.132+0000 7fedd179d700 1 -- 172.21.15.82:0/2563045941 wait complete. 2023-09-23T09:04:26.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.133+0000 7fedd179d700 1 Processor -- start 2023-09-23T09:04:26.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.133+0000 7fedd179d700 1 -- start start 2023-09-23T09:04:26.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.134+0000 7fedd179d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fedcc067a80 0x7fedcc196620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:04:26.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.134+0000 7fedd179d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fedcc068440 0x7fedcc196b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:04:26.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.134+0000 7fedd179d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fedcc106780 0x7fedcc19afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:04:26.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.134+0000 7fedd179d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedcc19b600 con 0x7fedcc067a80 2023-09-23T09:04:26.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.134+0000 7fedd179d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedcc19b770 con 0x7fedcc106780 2023-09-23T09:04:26.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.134+0000 7fedd179d700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedcc19b930 con 0x7fedcc068440 2023-09-23T09:04:26.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.134+0000 7fedcbfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fedcc067a80 0x7fedcc196620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:04:26.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.134+0000 7fedcbfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fedcc067a80 0x7fedcc196620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44366/0 (socket says 172.21.15.82:44366) 2023-09-23T09:04:26.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.134+0000 7fedcbfff700 1 -- 172.21.15.82:0/3160027800 learned_addr learned my addr 172.21.15.82:0/3160027800 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:04:26.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.134+0000 7fedcb7fe700 1 --2- 172.21.15.82:0/3160027800 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fedcc068440 0x7fedcc196b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:04:26.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.134+0000 7fedd0f9c700 1 --2- 172.21.15.82:0/3160027800 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fedcc106780 0x7fedcc19afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:04:26.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.134+0000 7fedcb7fe700 1 -- 172.21.15.82:0/3160027800 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fedcc106780 msgr2=0x7fedcc19afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:04:26.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.134+0000 7fedcb7fe700 1 --2- 172.21.15.82:0/3160027800 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fedcc106780 0x7fedcc19afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:04:26.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.134+0000 7fedcb7fe700 1 -- 172.21.15.82:0/3160027800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fedcc067a80 msgr2=0x7fedcc196620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:04:26.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.134+0000 7fedcb7fe700 1 --2- 172.21.15.82:0/3160027800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fedcc067a80 0x7fedcc196620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:04:26.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.134+0000 7fedcb7fe700 1 -- 172.21.15.82:0/3160027800 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedc00095f0 con 0x7fedcc068440 2023-09-23T09:04:26.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.134+0000 7fedcbfff700 1 --2- 172.21.15.82:0/3160027800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fedcc067a80 0x7fedcc196620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:04:26.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.135+0000 7fedcb7fe700 1 --2- 172.21.15.82:0/3160027800 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fedcc068440 0x7fedcc196b60 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fedc0005910 tx=0x7fedc0004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:04:26.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.135+0000 7fedc97fa700 1 -- 172.21.15.82:0/3160027800 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc001d070 con 0x7fedcc068440 2023-09-23T09:04:26.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.135+0000 7fedc97fa700 1 -- 172.21.15.82:0/3160027800 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fedc0022470 con 0x7fedcc068440 2023-09-23T09:04:26.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.135+0000 7fedd179d700 1 -- 172.21.15.82:0/3160027800 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedcc19bbb0 con 0x7fedcc068440 2023-09-23T09:04:26.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.135+0000 7fedc97fa700 1 -- 172.21.15.82:0/3160027800 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc0017650 con 0x7fedcc068440 2023-09-23T09:04:26.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.135+0000 7fedd179d700 1 -- 172.21.15.82:0/3160027800 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedcc1a3450 con 0x7fedcc068440 2023-09-23T09:04:26.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.139+0000 7fedc97fa700 1 -- 172.21.15.82:0/3160027800 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7fedc00225e0 con 0x7fedcc068440 2023-09-23T09:04:26.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.140+0000 7fedc97fa700 1 --2- 172.21.15.82:0/3160027800 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fedb40a01e0 0x7fedb40a26a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:04:26.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.140+0000 7fede6311b80 1 Processor -- start 2023-09-23T09:04:26.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.141+0000 7fedc97fa700 1 -- 172.21.15.82:0/3160027800 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fedc00cc500 con 0x7fedcc068440 2023-09-23T09:04:26.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.141+0000 7fede6311b80 1 -- start start 2023-09-23T09:04:26.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.141+0000 7fedcbfff700 1 --2- 172.21.15.82:0/3160027800 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fedb40a01e0 0x7fedb40a26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:04:26.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.141+0000 7fede6311b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f854530500 0x55f8545308e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:04:26.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.141+0000 7fede6311b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f854530e20 0x55f85452a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:04:26.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.141+0000 7fede6311b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f85452ac40 0x55f85452b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:04:26.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.141+0000 7fede6311b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8544927b0 con 0x55f85452ac40 2023-09-23T09:04:26.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.141+0000 7fede6311b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f854483780 con 0x55f854530500 2023-09-23T09:04:26.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.141+0000 7fede6311b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8544810a0 con 0x55f854530e20 2023-09-23T09:04:26.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.142+0000 7fedd0f9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f85452ac40 0x55f85452b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:04:26.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.142+0000 7fedcb7fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f854530e20 0x55f85452a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:04:26.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.142+0000 7fedcb7fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f854530e20 0x55f85452a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:35020/0 (socket says 172.21.15.82:35020) 2023-09-23T09:04:26.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.142+0000 7fedcb7fe700 1 -- 172.21.15.82:0/2442968940 learned_addr learned my addr 172.21.15.82:0/2442968940 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:04:26.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.142+0000 7fedcbfff700 1 --2- 172.21.15.82:0/2442968940 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f854530500 0x55f8545308e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:04:26.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.142+0000 7fedcbfff700 1 --2- 172.21.15.82:0/3160027800 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fedb40a01e0 0x7fedb40a26a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fedbc011550 tx=0x7fedbc009260 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:04:26.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.142+0000 7fedcb7fe700 1 -- 172.21.15.82:0/2442968940 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f854530500 msgr2=0x55f8545308e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:04:26.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.142+0000 7fedcb7fe700 1 --2- 172.21.15.82:0/2442968940 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f854530500 0x55f8545308e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:04:26.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.142+0000 7fedcb7fe700 1 -- 172.21.15.82:0/2442968940 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f85452ac40 msgr2=0x55f85452b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:04:26.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.142+0000 7fedcb7fe700 1 --2- 172.21.15.82:0/2442968940 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f85452ac40 0x55f85452b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:04:26.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.142+0000 7fedcb7fe700 1 -- 172.21.15.82:0/2442968940 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f8542fc630 con 0x55f854530e20 2023-09-23T09:04:26.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.142+0000 7fedcb7fe700 1 --2- 172.21.15.82:0/2442968940 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f854530e20 0x55f85452a700 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fedc00966b0 tx=0x7fedc0099a90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=864fb5d51d18e3e2 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:04:26.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.142+0000 7fedb27fc700 1 -- 172.21.15.82:0/2442968940 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc009a340 con 0x55f854530e20 2023-09-23T09:04:26.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.143+0000 7fedb27fc700 1 -- 172.21.15.82:0/2442968940 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fedc0099c40 con 0x55f854530e20 2023-09-23T09:04:26.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.143+0000 7fedb27fc700 1 -- 172.21.15.82:0/2442968940 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc009a0a0 con 0x55f854530e20 2023-09-23T09:04:26.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.143+0000 7fede6311b80 1 -- 172.21.15.82:0/2442968940 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f854530e20 msgr2=0x55f85452a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:04:26.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.143+0000 7fede6311b80 1 --2- 172.21.15.82:0/2442968940 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f854530e20 0x55f85452a700 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fedc00966b0 tx=0x7fedc0099a90 comp rx=0 tx=0).stop 2023-09-23T09:04:26.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.144+0000 7fede6311b80 1 -- 172.21.15.82:0/2442968940 shutdown_connections 2023-09-23T09:04:26.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.144+0000 7fede6311b80 1 --2- 172.21.15.82:0/2442968940 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f85452ac40 0x55f85452b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:04:26.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.144+0000 7fede6311b80 1 --2- 172.21.15.82:0/2442968940 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f854530500 0x55f8545308e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:04:26.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.144+0000 7fede6311b80 1 --2- 172.21.15.82:0/2442968940 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f854530e20 0x55f85452a700 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:04:26.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.144+0000 7fede6311b80 1 -- 172.21.15.82:0/2442968940 >> 172.21.15.82:0/2442968940 conn(0x55f85449f0e0 msgr2=0x55f854525940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:04:26.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.144+0000 7fede6311b80 1 -- 172.21.15.82:0/2442968940 shutdown_connections 2023-09-23T09:04:26.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.144+0000 7fede6311b80 1 -- 172.21.15.82:0/2442968940 wait complete. 2023-09-23T09:04:26.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.144+0000 7fede6311b80 1 -- start start 2023-09-23T09:04:26.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.145+0000 7fede6311b80 1 Processor -- start 2023-09-23T09:04:26.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.145+0000 7fede6311b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f85452ac40 0x55f854536da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:04:26.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.145+0000 7fede6311b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f854530500 0x55f8545340c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:04:26.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.145+0000 7fede6311b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f854530e20 0x55f8545346d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:04:26.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.145+0000 7fede6311b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f85447c990 con 0x55f85452ac40 2023-09-23T09:04:26.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.145+0000 7fede6311b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f85441abb0 con 0x55f854530500 2023-09-23T09:04:26.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.145+0000 7fede6311b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f85441a8b0 con 0x55f854530e20 2023-09-23T09:04:26.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.145+0000 7fede6311b80 10 client.0 _ll_register_callbacks cb 0x55f854364a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:04:26.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.146+0000 7fedcb7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f854530500 0x55f8545340c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:04:26.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.146+0000 7fedd0f9c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f854530e20 0x55f8545346d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:04:26.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.146+0000 7fedcb7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f854530500 0x55f8545340c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:50990/0 (socket says 172.21.15.82:50990) 2023-09-23T09:04:26.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.146+0000 7fedd0f9c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f854530e20 0x55f8545346d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:35026/0 (socket says 172.21.15.82:35026) 2023-09-23T09:04:26.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.146+0000 7fedcb7fe700 1 -- 172.21.15.82:0/1571789547 learned_addr learned my addr 172.21.15.82:0/1571789547 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:04:26.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.146+0000 7fedcbfff700 1 --2- 172.21.15.82:0/1571789547 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f85452ac40 0x55f854536da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:04:26.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.146+0000 7fedd0f9c700 1 -- 172.21.15.82:0/1571789547 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f854530500 msgr2=0x55f8545340c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:04:26.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.146+0000 7fedd0f9c700 1 --2- 172.21.15.82:0/1571789547 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f854530500 0x55f8545340c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:04:26.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.146+0000 7fedd0f9c700 1 -- 172.21.15.82:0/1571789547 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f85452ac40 msgr2=0x55f854536da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:04:26.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.146+0000 7fedd0f9c700 1 --2- 172.21.15.82:0/1571789547 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f85452ac40 0x55f854536da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:04:26.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.146+0000 7fedd0f9c700 1 -- 172.21.15.82:0/1571789547 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedcc1a3450 con 0x55f854530e20 2023-09-23T09:04:26.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.146+0000 7fedcbfff700 1 --2- 172.21.15.82:0/1571789547 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f85452ac40 0x55f854536da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:04:26.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.146+0000 7fedd0f9c700 1 --2- 172.21.15.82:0/1571789547 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f854530e20 0x55f8545346d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fedc4011e90 tx=0x7fedc4014600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a14424147c2b9e09 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:04:26.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.146+0000 7fedab7fe700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T09:04:26.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.147+0000 7fedab7fe700 1 -- 172.21.15.82:0/1571789547 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc400e040 con 0x55f854530e20 2023-09-23T09:04:26.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.147+0000 7fedab7fe700 1 -- 172.21.15.82:0/1571789547 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fedc40093a0 con 0x55f854530e20 2023-09-23T09:04:26.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.147+0000 7fede6311b80 1 -- 172.21.15.82:0/1571789547 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f8544fa1c0 con 0x55f854530e20 2023-09-23T09:04:26.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.147+0000 7fedab7fe700 1 -- 172.21.15.82:0/1571789547 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) v2 ==== 24+0+0 (secure 0 0 0) 0x7fedc4004db0 con 0x55f854530e20 2023-09-23T09:04:26.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.147+0000 7fede6311b80 10 client.25882 fetch_fsmap learned FSMap version 48 2023-09-23T09:04:26.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.147+0000 7fede6311b80 1 -- 172.21.15.82:0/1571789547 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) v3 -- 0x55f8542a8de0 con 0x55f854530e20 2023-09-23T09:04:26.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.147+0000 7fedab7fe700 1 -- 172.21.15.82:0/1571789547 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f8544fa1c0 con 0x55f854530e20 2023-09-23T09:04:26.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.148+0000 7fedab7fe700 1 -- 172.21.15.82:0/1571789547 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 48) v1 ==== 7918+0+0 (secure 0 0 0) 0x7fedc401c030 con 0x55f854530e20 2023-09-23T09:04:26.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.148+0000 7fede6311b80 10 client.25882 fetch_fsmap finished waiting for FSMap version 48 2023-09-23T09:04:26.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.148+0000 7fede6311b80 10 client.25882 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:04:26.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.148+0000 7fede6311b80 20 client.25882 populate_metadata read hostname 'smithi082' 2023-09-23T09:04:26.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.148+0000 7fede6311b80 1 --2- 172.21.15.82:0/1571789547 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55f854544630 0x55f854546a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:04:26.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.148+0000 7fede6311b80 4 client.25882 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:04:26.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.148+0000 7fede6311b80 1 -- 172.21.15.82:0/1571789547 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f854422ba0 con 0x55f854544630 2023-09-23T09:04:26.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.148+0000 7fedcbfff700 1 --2- 172.21.15.82:0/1571789547 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55f854544630 0x55f854546a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:04:26.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.149+0000 7fedcbfff700 1 --2- 172.21.15.82:0/1571789547 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55f854544630 0x55f854546a50 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=30e8cb3443475025 server_cookie=2e168d0adcb218c1 in_seq=0 out_seq=0 2023-09-23T09:04:26.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.149+0000 7fedab7fe700 10 client.25882 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:04:26.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.150+0000 7fedab7fe700 1 -- 172.21.15.82:0/1571789547 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f854422ba0 con 0x55f854544630 2023-09-23T09:04:26.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.150+0000 7fedab7fe700 10 client.25882 handle_command_reply: tid=0 2023-09-23T09:04:26.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.150+0000 7fede6311b80 1 client.25882 shutdown 2023-09-23T09:04:26.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.150+0000 7fede6311b80 1 -- 172.21.15.82:0/1571789547 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f854530e20 msgr2=0x55f8545346d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:04:26.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.150+0000 7fede6311b80 1 --2- 172.21.15.82:0/1571789547 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f854530e20 0x55f8545346d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fedc4011e90 tx=0x7fedc4014600 comp rx=0 tx=0).stop 2023-09-23T09:04:26.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.150+0000 7fede6311b80 1 -- 172.21.15.82:0/1571789547 shutdown_connections 2023-09-23T09:04:26.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.150+0000 7fede6311b80 1 --2- 172.21.15.82:0/1571789547 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f854530e20 0x55f8545346d0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:04:26.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.150+0000 7fede6311b80 1 --2- 172.21.15.82:0/1571789547 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55f854544630 0x55f854546a50 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:04:26.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.150+0000 7fede6311b80 1 --2- 172.21.15.82:0/1571789547 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f85452ac40 0x55f854536da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:04:26.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.150+0000 7fede6311b80 1 --2- 172.21.15.82:0/1571789547 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f854530500 0x55f8545340c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:04:26.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.150+0000 7fedab7fe700 0 client.25882 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:04:26.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.150+0000 7fede6311b80 1 -- 172.21.15.82:0/1571789547 >> 172.21.15.82:0/1571789547 conn(0x55f85449f0e0 msgr2=0x55f854525530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:04:26.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.150+0000 7fede6311b80 1 -- 172.21.15.82:0/1571789547 shutdown_connections 2023-09-23T09:04:26.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.150+0000 7fede6311b80 1 -- 172.21.15.82:0/1571789547 wait complete. 2023-09-23T09:04:26.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.150+0000 7fede6311b80 20 client.25882 trim_cache size 0 max 16384 2023-09-23T09:04:26.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.174+0000 7fede6311b80 1 Processor -- start 2023-09-23T09:04:26.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.174+0000 7fede6311b80 1 -- start start 2023-09-23T09:04:26.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.174+0000 7fede6311b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f85452ac40 0x55f85453b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:04:26.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.174+0000 7fede6311b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f854530500 0x55f854536860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:04:26.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.174+0000 7fede6311b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f854530e20 0x55f854536da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:04:26.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.174+0000 7fede6311b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8542fe920 con 0x55f854530e20 2023-09-23T09:04:26.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.175+0000 7fede6311b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f854527130 con 0x55f854530500 2023-09-23T09:04:26.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.175+0000 7fede6311b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f854541cc0 con 0x55f85452ac40 2023-09-23T09:04:26.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.175+0000 7fedcbfff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f85452ac40 0x55f85453b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:04:26.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.175+0000 7fedcbfff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f85452ac40 0x55f85453b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:35034/0 (socket says 172.21.15.82:35034) 2023-09-23T09:04:26.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.175+0000 7fedcbfff700 1 -- 172.21.15.82:0/1706139403 learned_addr learned my addr 172.21.15.82:0/1706139403 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:04:26.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.175+0000 7fedcb7fe700 1 --2- 172.21.15.82:0/1706139403 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f854530500 0x55f854536860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:04:26.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.175+0000 7fedd0f9c700 1 --2- 172.21.15.82:0/1706139403 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f854530e20 0x55f854536da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:04:26.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.175+0000 7fedcbfff700 1 -- 172.21.15.82:0/1706139403 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f854530500 msgr2=0x55f854536860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:04:26.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.175+0000 7fedcbfff700 1 --2- 172.21.15.82:0/1706139403 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f854530500 0x55f854536860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:04:26.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.175+0000 7fedcbfff700 1 -- 172.21.15.82:0/1706139403 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f854530e20 msgr2=0x55f854536da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:04:26.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.175+0000 7fedcbfff700 1 --2- 172.21.15.82:0/1706139403 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f854530e20 0x55f854536da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:04:26.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.175+0000 7fedcbfff700 1 -- 172.21.15.82:0/1706139403 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f854533c30 con 0x55f85452ac40 2023-09-23T09:04:26.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.175+0000 7fedd0f9c700 1 --2- 172.21.15.82:0/1706139403 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f854530e20 0x55f854536da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:04:26.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.176+0000 7fedcbfff700 1 --2- 172.21.15.82:0/1706139403 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f85452ac40 0x55f85453b720 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x55f854547360 tx=0x7fedbc014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=972ded6533c3f675 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:04:26.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.176+0000 7fedb2ffd700 1 -- 172.21.15.82:0/1706139403 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedbc02e070 con 0x55f85452ac40 2023-09-23T09:04:26.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.176+0000 7fedb2ffd700 1 -- 172.21.15.82:0/1706139403 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fedbc011e90 con 0x55f85452ac40 2023-09-23T09:04:26.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.176+0000 7fedb2ffd700 1 -- 172.21.15.82:0/1706139403 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedbc024040 con 0x55f85452ac40 2023-09-23T09:04:26.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.177+0000 7fede6311b80 1 -- 172.21.15.82:0/1706139403 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f85452ac40 msgr2=0x55f85453b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:04:26.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.177+0000 7fede6311b80 1 --2- 172.21.15.82:0/1706139403 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f85452ac40 0x55f85453b720 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x55f854547360 tx=0x7fedbc014000 comp rx=0 tx=0).stop 2023-09-23T09:04:26.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.177+0000 7fede6311b80 1 -- 172.21.15.82:0/1706139403 shutdown_connections 2023-09-23T09:04:26.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.177+0000 7fede6311b80 1 --2- 172.21.15.82:0/1706139403 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f854530e20 0x55f854536da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:04:26.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.177+0000 7fede6311b80 1 --2- 172.21.15.82:0/1706139403 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f85452ac40 0x55f85453b720 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:04:26.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.177+0000 7fede6311b80 1 --2- 172.21.15.82:0/1706139403 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f854530500 0x55f854536860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:04:26.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.177+0000 7fede6311b80 1 -- 172.21.15.82:0/1706139403 >> 172.21.15.82:0/1706139403 conn(0x55f85449f0e0 msgr2=0x55f8545408f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:04:26.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.177+0000 7fede6311b80 1 -- 172.21.15.82:0/1706139403 shutdown_connections 2023-09-23T09:04:26.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.177+0000 7fede6311b80 1 -- 172.21.15.82:0/1706139403 wait complete. 2023-09-23T09:04:26.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.177+0000 7fede6311b80 1 -- start start 2023-09-23T09:04:26.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.177+0000 7fede6311b80 1 Processor -- start 2023-09-23T09:04:26.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.178+0000 7fede6311b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f85452ac40 0x55f85453b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:04:26.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.178+0000 7fede6311b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f854530500 0x55f85452c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:04:26.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.178+0000 7fede6311b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f854530e20 0x55f85452c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:04:26.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.178+0000 7fede6311b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f85452d000 con 0x55f854530500 2023-09-23T09:04:26.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.178+0000 7fede6311b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f85452d170 con 0x55f85452ac40 2023-09-23T09:04:26.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.178+0000 7fede6311b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f854598460 con 0x55f854530e20 2023-09-23T09:04:26.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.178+0000 7fede6311b80 10 client.0 _ll_register_callbacks cb 0x7fedc40117c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:04:26.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.178+0000 7fedcbfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f85452ac40 0x55f85453b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:04:26.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.178+0000 7fedcb7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f854530500 0x55f85452c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:04:26.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.178+0000 7fedcbfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f85452ac40 0x55f85453b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:51010/0 (socket says 172.21.15.82:51010) 2023-09-23T09:04:26.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.178+0000 7fedcbfff700 1 -- 172.21.15.82:0/3773995104 learned_addr learned my addr 172.21.15.82:0/3773995104 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:04:26.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.178+0000 7fedd0f9c700 1 --2- 172.21.15.82:0/3773995104 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f854530e20 0x55f85452c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:04:26.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.179+0000 7fedcbfff700 1 -- 172.21.15.82:0/3773995104 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f854530e20 msgr2=0x55f85452c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:04:26.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.179+0000 7fedcbfff700 1 --2- 172.21.15.82:0/3773995104 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f854530e20 0x55f85452c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:04:26.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.179+0000 7fedcbfff700 1 -- 172.21.15.82:0/3773995104 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f854530500 msgr2=0x55f85452c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:04:26.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.179+0000 7fedcbfff700 1 --2- 172.21.15.82:0/3773995104 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f854530500 0x55f85452c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:04:26.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.179+0000 7fedcbfff700 1 -- 172.21.15.82:0/3773995104 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedbc017070 con 0x55f85452ac40 2023-09-23T09:04:26.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.179+0000 7fedcbfff700 1 --2- 172.21.15.82:0/3773995104 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f85452ac40 0x55f85453b910 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fedbc0293b0 tx=0x7fedbc0293e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8789ea1ec0e816c server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:04:26.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.179+0000 7fedab7fe700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-09-23T09:04:26.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.179+0000 7fedab7fe700 1 -- 172.21.15.82:0/3773995104 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedbc02e040 con 0x55f85452ac40 2023-09-23T09:04:26.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.180+0000 7fede6311b80 1 -- 172.21.15.82:0/3773995104 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f85451d8b0 con 0x55f85452ac40 2023-09-23T09:04:26.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.180+0000 7fedab7fe700 1 -- 172.21.15.82:0/3773995104 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fedbc029dd0 con 0x55f85452ac40 2023-09-23T09:04:26.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.180+0000 7fedab7fe700 1 -- 172.21.15.82:0/3773995104 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) v2 ==== 24+0+0 (secure 0 0 0) 0x7fedbc024040 con 0x55f85452ac40 2023-09-23T09:04:26.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.180+0000 7fede6311b80 10 client.25844 fetch_fsmap learned FSMap version 48 2023-09-23T09:04:26.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.180+0000 7fede6311b80 1 -- 172.21.15.82:0/3773995104 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) v3 -- 0x55f854291c60 con 0x55f85452ac40 2023-09-23T09:04:26.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.180+0000 7fedab7fe700 1 -- 172.21.15.82:0/3773995104 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fedbc03f020 con 0x55f85452ac40 2023-09-23T09:04:26.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.180+0000 7fedab7fe700 1 -- 172.21.15.82:0/3773995104 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 48) v1 ==== 7918+0+0 (secure 0 0 0) 0x7fedbc01e4b0 con 0x55f85452ac40 2023-09-23T09:04:26.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.180+0000 7fede6311b80 10 client.25844 fetch_fsmap finished waiting for FSMap version 48 2023-09-23T09:04:26.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.180+0000 7fede6311b80 10 client.25844 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:04:26.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.180+0000 7fede6311b80 20 client.25844 populate_metadata read hostname 'smithi082' 2023-09-23T09:04:26.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.180+0000 7fede6311b80 1 --2- 172.21.15.82:0/3773995104 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55f854599b70 0x55f85459bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:04:26.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.180+0000 7fede6311b80 4 client.25844 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:04:26.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.180+0000 7fede6311b80 1 -- 172.21.15.82:0/3773995104 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55f854475970 con 0x55f854599b70 2023-09-23T09:04:26.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.181+0000 7fedcb7fe700 1 --2- 172.21.15.82:0/3773995104 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55f854599b70 0x55f85459bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:04:26.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.181+0000 7fedab7fe700 10 client.25844 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:04:26.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.181+0000 7fedcb7fe700 1 --2- 172.21.15.82:0/3773995104 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55f854599b70 0x55f85459bf90 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=72b7952a1a675a0e server_cookie=ee48ab6810bb8a9e in_seq=0 out_seq=0 2023-09-23T09:04:26.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.182+0000 7fedab7fe700 1 -- 172.21.15.82:0/3773995104 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55f854475970 con 0x55f854599b70 2023-09-23T09:04:26.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.182+0000 7fedab7fe700 10 client.25844 handle_command_reply: tid=0 2023-09-23T09:04:26.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.182+0000 7fede6311b80 1 client.25844 shutdown 2023-09-23T09:04:26.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.182+0000 7fede6311b80 1 -- 172.21.15.82:0/3773995104 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f85452ac40 msgr2=0x55f85453b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:04:26.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.182+0000 7fede6311b80 1 --2- 172.21.15.82:0/3773995104 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f85452ac40 0x55f85453b910 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fedbc0293b0 tx=0x7fedbc0293e0 comp rx=0 tx=0).stop 2023-09-23T09:04:26.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.182+0000 7fede6311b80 1 -- 172.21.15.82:0/3773995104 shutdown_connections 2023-09-23T09:04:26.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.182+0000 7fede6311b80 1 --2- 172.21.15.82:0/3773995104 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f854530e20 0x55f85452c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:04:26.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.182+0000 7fede6311b80 1 --2- 172.21.15.82:0/3773995104 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f85452ac40 0x55f85453b910 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:04:26.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.182+0000 7fede6311b80 1 --2- 172.21.15.82:0/3773995104 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55f854599b70 0x55f85459bf90 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:04:26.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.182+0000 7fede6311b80 1 --2- 172.21.15.82:0/3773995104 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f854530500 0x55f85452c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:04:26.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.182+0000 7fedab7fe700 0 client.25844 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:04:26.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.182+0000 7fede6311b80 1 -- 172.21.15.82:0/3773995104 >> 172.21.15.82:0/3773995104 conn(0x55f85449f0e0 msgr2=0x55f85452e210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:04:26.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.182+0000 7fede6311b80 1 -- 172.21.15.82:0/3773995104 shutdown_connections 2023-09-23T09:04:26.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.182+0000 7fede6311b80 1 -- 172.21.15.82:0/3773995104 wait complete. 2023-09-23T09:04:26.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.182+0000 7fede6311b80 20 client.25844 trim_cache size 0 max 16384 2023-09-23T09:04:26.191 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:04:26.191 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "IDLE (waiting for more scrubs)", 2023-09-23T09:04:26.191 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:04:26.191 INFO:teuthology.orchestra.run.smithi082.stdout: "6f0fe3a6-7212-425d-a0a6-f38e8b42ec13": { 2023-09-23T09:04:26.191 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:04:26.191 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "6f0fe3a6-7212-425d-a0a6-f38e8b42ec13", 2023-09-23T09:04:26.191 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:04:26.191 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:04:26.191 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:04:26.191 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:04:26.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.183+0000 7fedd179d700 1 -- 172.21.15.82:0/3160027800 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fedb40a01e0 msgr2=0x7fedb40a26a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:04:26.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.183+0000 7fedd179d700 1 --2- 172.21.15.82:0/3160027800 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fedb40a01e0 0x7fedb40a26a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fedbc011550 tx=0x7fedbc009260 comp rx=0 tx=0).stop 2023-09-23T09:04:26.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.183+0000 7fedd179d700 1 -- 172.21.15.82:0/3160027800 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fedcc068440 msgr2=0x7fedcc196b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:04:26.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.183+0000 7fedd179d700 1 --2- 172.21.15.82:0/3160027800 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fedcc068440 0x7fedcc196b60 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fedc0005910 tx=0x7fedc0004730 comp rx=0 tx=0).stop 2023-09-23T09:04:26.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.183+0000 7fedd179d700 1 -- 172.21.15.82:0/3160027800 shutdown_connections 2023-09-23T09:04:26.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.183+0000 7fedd179d700 1 --2- 172.21.15.82:0/3160027800 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fedb40a01e0 0x7fedb40a26a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:04:26.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.183+0000 7fedd179d700 1 --2- 172.21.15.82:0/3160027800 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fedcc106780 0x7fedcc19afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:04:26.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.183+0000 7fedd179d700 1 --2- 172.21.15.82:0/3160027800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fedcc067a80 0x7fedcc196620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:04:26.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.183+0000 7fedd179d700 1 --2- 172.21.15.82:0/3160027800 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fedcc068440 0x7fedcc196b60 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:04:26.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.183+0000 7fedd179d700 1 -- 172.21.15.82:0/3160027800 >> 172.21.15.82:0/3160027800 conn(0x7fedcc0750e0 msgr2=0x7fedcc0fe340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:04:26.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.183+0000 7fedd179d700 1 -- 172.21.15.82:0/3160027800 shutdown_connections 2023-09-23T09:04:26.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:26.183+0000 7fedd179d700 1 -- 172.21.15.82:0/3160027800 wait complete. 2023-09-23T09:04:26.206 INFO:tasks.cephfs.filesystem:scrub status for tag:6f0fe3a6-7212-425d-a0a6-f38e8b42ec13 - {'path': '/', 'tag': '6f0fe3a6-7212-425d-a0a6-f38e8b42ec13', 'options': 'recursive,force'} 2023-09-23T09:04:26.451 INFO:teuthology.orchestra.run.smithi082.stderr:30700000 of 50000000 tuples (61%) done (elapsed 421.19 s, remaining 264.79 s) 2023-09-23T09:04:27.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:04:26 smithi135 ceph-mon[99205]: pgmap v233: 97 pgs: 97 active+clean; 7.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 20 MiB/s wr, 61 op/s 2023-09-23T09:04:27.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:04:26 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:04:27.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:04:26 smithi082 ceph-mon[97694]: pgmap v233: 97 pgs: 97 active+clean; 7.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 20 MiB/s wr, 61 op/s 2023-09-23T09:04:27.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:04:26 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:04:27.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:04:26 smithi161 ceph-mon[99580]: pgmap v233: 97 pgs: 97 active+clean; 7.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 20 MiB/s wr, 61 op/s 2023-09-23T09:04:27.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:04:26 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:04:27.686 INFO:teuthology.orchestra.run.smithi082.stderr:30800000 of 50000000 tuples (61%) done (elapsed 422.43 s, remaining 263.33 s) 2023-09-23T09:04:28.982 INFO:teuthology.orchestra.run.smithi082.stderr:30900000 of 50000000 tuples (61%) done (elapsed 423.72 s, remaining 261.91 s) 2023-09-23T09:04:29.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:04:28 smithi135 ceph-mon[99205]: pgmap v234: 97 pgs: 97 active+clean; 7.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 19 MiB/s wr, 57 op/s 2023-09-23T09:04:29.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:04:28 smithi082 ceph-mon[97694]: pgmap v234: 97 pgs: 97 active+clean; 7.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 19 MiB/s wr, 57 op/s 2023-09-23T09:04:29.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:04:28 smithi161 ceph-mon[99580]: pgmap v234: 97 pgs: 97 active+clean; 7.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 19 MiB/s wr, 57 op/s 2023-09-23T09:04:30.174 INFO:teuthology.orchestra.run.smithi082.stderr:31000000 of 50000000 tuples (62%) done (elapsed 424.92 s, remaining 260.43 s) 2023-09-23T09:04:31.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:04:30 smithi135 ceph-mon[99205]: pgmap v235: 97 pgs: 97 active+clean; 7.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 24 MiB/s wr, 88 op/s 2023-09-23T09:04:31.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:04:30 smithi082 ceph-mon[97694]: pgmap v235: 97 pgs: 97 active+clean; 7.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 24 MiB/s wr, 88 op/s 2023-09-23T09:04:31.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:04:30 smithi161 ceph-mon[99580]: pgmap v235: 97 pgs: 97 active+clean; 7.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 24 MiB/s wr, 88 op/s 2023-09-23T09:04:31.398 INFO:teuthology.orchestra.run.smithi082.stderr:31100000 of 50000000 tuples (62%) done (elapsed 426.14 s, remaining 258.97 s) 2023-09-23T09:04:32.693 INFO:teuthology.orchestra.run.smithi082.stderr:31200000 of 50000000 tuples (62%) done (elapsed 427.43 s, remaining 257.56 s) 2023-09-23T09:04:33.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:04:32 smithi135 ceph-mon[99205]: pgmap v236: 97 pgs: 97 active+clean; 7.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 16 MiB/s wr, 66 op/s 2023-09-23T09:04:33.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:04:32 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:04:33.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:04:32 smithi082 ceph-mon[97694]: pgmap v236: 97 pgs: 97 active+clean; 7.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 16 MiB/s wr, 66 op/s 2023-09-23T09:04:33.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:04:32 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:04:33.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:04:32 smithi161 ceph-mon[99580]: pgmap v236: 97 pgs: 97 active+clean; 7.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 16 MiB/s wr, 66 op/s 2023-09-23T09:04:33.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:04:32 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:04:33.911 INFO:teuthology.orchestra.run.smithi082.stderr:31300000 of 50000000 tuples (62%) done (elapsed 428.65 s, remaining 256.10 s) 2023-09-23T09:04:34.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:04:33 smithi135 ceph-mon[99205]: pgmap v237: 97 pgs: 97 active+clean; 7.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 15 MiB/s wr, 61 op/s 2023-09-23T09:04:34.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:04:33 smithi082 ceph-mon[97694]: pgmap v237: 97 pgs: 97 active+clean; 7.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 15 MiB/s wr, 61 op/s 2023-09-23T09:04:34.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:04:33 smithi161 ceph-mon[99580]: pgmap v237: 97 pgs: 97 active+clean; 7.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 15 MiB/s wr, 61 op/s 2023-09-23T09:04:35.111 INFO:teuthology.orchestra.run.smithi082.stderr:31400000 of 50000000 tuples (62%) done (elapsed 429.85 s, remaining 254.63 s) 2023-09-23T09:04:36.324 INFO:teuthology.orchestra.run.smithi082.stderr:31500000 of 50000000 tuples (63%) done (elapsed 431.07 s, remaining 253.17 s) 2023-09-23T09:04:36.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:04:36 smithi135 ceph-mon[99205]: pgmap v238: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 27 MiB/s wr, 98 op/s 2023-09-23T09:04:36.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:04:36 smithi082 ceph-mon[97694]: pgmap v238: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 27 MiB/s wr, 98 op/s 2023-09-23T09:04:36.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:04:36 smithi161 ceph-mon[99580]: pgmap v238: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 27 MiB/s wr, 98 op/s 2023-09-23T09:04:37.624 INFO:teuthology.orchestra.run.smithi082.stderr:31600000 of 50000000 tuples (63%) done (elapsed 432.37 s, remaining 251.76 s) 2023-09-23T09:04:38.846 INFO:teuthology.orchestra.run.smithi082.stderr:31700000 of 50000000 tuples (63%) done (elapsed 433.59 s, remaining 250.30 s) 2023-09-23T09:04:38.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:04:38 smithi082 ceph-mon[97694]: pgmap v239: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 22 MiB/s wr, 79 op/s 2023-09-23T09:04:38.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:04:38 smithi161 ceph-mon[99580]: pgmap v239: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 22 MiB/s wr, 79 op/s 2023-09-23T09:04:39.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:04:38 smithi135 ceph-mon[99205]: pgmap v239: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 22 MiB/s wr, 79 op/s 2023-09-23T09:04:40.050 INFO:teuthology.orchestra.run.smithi082.stderr:31800000 of 50000000 tuples (63%) done (elapsed 434.79 s, remaining 248.84 s) 2023-09-23T09:04:40.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:04:40 smithi082 ceph-mon[97694]: pgmap v240: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 33 MiB/s wr, 102 op/s 2023-09-23T09:04:40.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:04:40 smithi161 ceph-mon[99580]: pgmap v240: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 33 MiB/s wr, 102 op/s 2023-09-23T09:04:41.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:04:40 smithi135 ceph-mon[99205]: pgmap v240: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 33 MiB/s wr, 102 op/s 2023-09-23T09:04:41.343 INFO:teuthology.orchestra.run.smithi082.stderr:31900000 of 50000000 tuples (63%) done (elapsed 436.09 s, remaining 247.43 s) 2023-09-23T09:04:42.580 INFO:teuthology.orchestra.run.smithi082.stderr:32000000 of 50000000 tuples (64%) done (elapsed 437.32 s, remaining 245.99 s) 2023-09-23T09:04:42.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:04:42 smithi082 ceph-mon[97694]: pgmap v241: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 26 MiB/s wr, 69 op/s 2023-09-23T09:04:42.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:04:42 smithi161 ceph-mon[99580]: pgmap v241: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 26 MiB/s wr, 69 op/s 2023-09-23T09:04:43.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:04:42 smithi135 ceph-mon[99205]: pgmap v241: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 26 MiB/s wr, 69 op/s 2023-09-23T09:04:43.794 INFO:teuthology.orchestra.run.smithi082.stderr:32100000 of 50000000 tuples (64%) done (elapsed 438.54 s, remaining 244.54 s) 2023-09-23T09:04:44.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:04:44 smithi082 ceph-mon[97694]: pgmap v242: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 MiB/s wr, 64 op/s 2023-09-23T09:04:44.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:04:44 smithi161 ceph-mon[99580]: pgmap v242: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 MiB/s wr, 64 op/s 2023-09-23T09:04:45.026 INFO:teuthology.orchestra.run.smithi082.stderr:32200000 of 50000000 tuples (64%) done (elapsed 439.77 s, remaining 243.10 s) 2023-09-23T09:04:45.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:04:44 smithi135 ceph-mon[99205]: pgmap v242: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 MiB/s wr, 64 op/s 2023-09-23T09:04:46.421 INFO:teuthology.orchestra.run.smithi082.stderr:32300000 of 50000000 tuples (64%) done (elapsed 441.16 s, remaining 241.75 s) 2023-09-23T09:04:46.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:04:46 smithi082 ceph-mon[97694]: pgmap v243: 97 pgs: 97 active+clean; 7.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 36 MiB/s wr, 92 op/s 2023-09-23T09:04:46.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:04:46 smithi161 ceph-mon[99580]: pgmap v243: 97 pgs: 97 active+clean; 7.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 36 MiB/s wr, 92 op/s 2023-09-23T09:04:47.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:04:46 smithi135 ceph-mon[99205]: pgmap v243: 97 pgs: 97 active+clean; 7.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 36 MiB/s wr, 92 op/s 2023-09-23T09:04:47.606 INFO:teuthology.orchestra.run.smithi082.stderr:32400000 of 50000000 tuples (64%) done (elapsed 442.35 s, remaining 240.29 s) 2023-09-23T09:04:48.769 INFO:teuthology.orchestra.run.smithi082.stderr:32500000 of 50000000 tuples (65%) done (elapsed 443.51 s, remaining 238.81 s) 2023-09-23T09:04:48.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:04:48 smithi082 ceph-mon[97694]: pgmap v244: 97 pgs: 97 active+clean; 7.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 24 MiB/s wr, 54 op/s 2023-09-23T09:04:48.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:04:48 smithi161 ceph-mon[99580]: pgmap v244: 97 pgs: 97 active+clean; 7.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 24 MiB/s wr, 54 op/s 2023-09-23T09:04:49.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:04:48 smithi135 ceph-mon[99205]: pgmap v244: 97 pgs: 97 active+clean; 7.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 24 MiB/s wr, 54 op/s 2023-09-23T09:04:49.992 INFO:teuthology.orchestra.run.smithi082.stderr:32600000 of 50000000 tuples (65%) done (elapsed 444.73 s, remaining 237.37 s) 2023-09-23T09:04:50.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:04:50 smithi082 ceph-mon[97694]: pgmap v245: 97 pgs: 97 active+clean; 7.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 36 MiB/s wr, 77 op/s 2023-09-23T09:04:50.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:04:50 smithi161 ceph-mon[99580]: pgmap v245: 97 pgs: 97 active+clean; 7.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 36 MiB/s wr, 77 op/s 2023-09-23T09:04:51.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:04:50 smithi135 ceph-mon[99205]: pgmap v245: 97 pgs: 97 active+clean; 7.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 36 MiB/s wr, 77 op/s 2023-09-23T09:04:51.266 INFO:teuthology.orchestra.run.smithi082.stderr:32700000 of 50000000 tuples (65%) done (elapsed 446.01 s, remaining 235.96 s) 2023-09-23T09:04:52.537 INFO:teuthology.orchestra.run.smithi082.stderr:32800000 of 50000000 tuples (65%) done (elapsed 447.28 s, remaining 234.55 s) 2023-09-23T09:04:52.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:04:52 smithi082 ceph-mon[97694]: pgmap v246: 97 pgs: 97 active+clean; 7.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 25 MiB/s wr, 57 op/s 2023-09-23T09:04:52.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:04:52 smithi161 ceph-mon[99580]: pgmap v246: 97 pgs: 97 active+clean; 7.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 25 MiB/s wr, 57 op/s 2023-09-23T09:04:53.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:04:52 smithi135 ceph-mon[99205]: pgmap v246: 97 pgs: 97 active+clean; 7.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 25 MiB/s wr, 57 op/s 2023-09-23T09:04:53.748 INFO:teuthology.orchestra.run.smithi082.stderr:32900000 of 50000000 tuples (65%) done (elapsed 448.49 s, remaining 233.11 s) 2023-09-23T09:04:54.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:04:54 smithi082 ceph-mon[97694]: pgmap v247: 97 pgs: 97 active+clean; 7.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 24 MiB/s wr, 53 op/s 2023-09-23T09:04:54.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:04:54 smithi161 ceph-mon[99580]: pgmap v247: 97 pgs: 97 active+clean; 7.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 24 MiB/s wr, 53 op/s 2023-09-23T09:04:55.027 INFO:teuthology.orchestra.run.smithi082.stderr:33000000 of 50000000 tuples (66%) done (elapsed 449.77 s, remaining 231.70 s) 2023-09-23T09:04:55.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:04:54 smithi135 ceph-mon[99205]: pgmap v247: 97 pgs: 97 active+clean; 7.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 24 MiB/s wr, 53 op/s 2023-09-23T09:04:56.207 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:04:56.247 INFO:teuthology.orchestra.run.smithi082.stderr:33100000 of 50000000 tuples (66%) done (elapsed 450.99 s, remaining 230.26 s) 2023-09-23T09:04:56.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.431+0000 7f4db33ff700 1 -- 172.21.15.82:0/1900129513 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4dac1023b0 msgr2=0x7f4dac10a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:04:56.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.431+0000 7f4db33ff700 1 --2- 172.21.15.82:0/1900129513 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4dac1023b0 0x7f4dac10a890 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c009990 tx=0x7f4d9c009ca0 comp rx=0 tx=0).stop 2023-09-23T09:04:56.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.431+0000 7f4db33ff700 1 -- 172.21.15.82:0/1900129513 shutdown_connections 2023-09-23T09:04:56.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.431+0000 7f4db33ff700 1 --2- 172.21.15.82:0/1900129513 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4dac10ae60 0x7f4dac10d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:04:56.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.431+0000 7f4db33ff700 1 --2- 172.21.15.82:0/1900129513 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4dac101a90 0x7f4dac101e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:04:56.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.431+0000 7f4db33ff700 1 --2- 172.21.15.82:0/1900129513 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4dac1023b0 0x7f4dac10a890 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:04:56.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.431+0000 7f4db33ff700 1 -- 172.21.15.82:0/1900129513 >> 172.21.15.82:0/1900129513 conn(0x7f4dac0fb270 msgr2=0x7f4dac0fd690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:04:56.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.431+0000 7f4db33ff700 1 -- 172.21.15.82:0/1900129513 shutdown_connections 2023-09-23T09:04:56.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.431+0000 7f4db33ff700 1 -- 172.21.15.82:0/1900129513 wait complete. 2023-09-23T09:04:56.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.433+0000 7f4db33ff700 1 Processor -- start 2023-09-23T09:04:56.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.433+0000 7f4db33ff700 1 -- start start 2023-09-23T09:04:56.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.434+0000 7f4db33ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4dac101a90 0x7f4dac19c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:04:56.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.434+0000 7f4db33ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4dac1023b0 0x7f4dac19cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:04:56.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.434+0000 7f4db33ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4dac10ae60 0x7f4dac196740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:04:56.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.434+0000 7f4db33ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dac196db0 con 0x7f4dac101a90 2023-09-23T09:04:56.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.434+0000 7f4db33ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dac196f20 con 0x7f4dac10ae60 2023-09-23T09:04:56.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.434+0000 7f4db33ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dac1970e0 con 0x7f4dac1023b0 2023-09-23T09:04:56.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.434+0000 7f4db119b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4dac101a90 0x7f4dac19c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:04:56.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.434+0000 7f4db119b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4dac101a90 0x7f4dac19c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39840/0 (socket says 172.21.15.82:39840) 2023-09-23T09:04:56.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.434+0000 7f4db099a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4dac1023b0 0x7f4dac19cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:04:56.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.434+0000 7f4db119b700 1 -- 172.21.15.82:0/1274358304 learned_addr learned my addr 172.21.15.82:0/1274358304 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:04:56.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.434+0000 7f4db199c700 1 --2- 172.21.15.82:0/1274358304 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4dac10ae60 0x7f4dac196740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:04:56.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.434+0000 7f4db119b700 1 -- 172.21.15.82:0/1274358304 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4dac1023b0 msgr2=0x7f4dac19cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:04:56.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.434+0000 7f4db119b700 1 --2- 172.21.15.82:0/1274358304 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4dac1023b0 0x7f4dac19cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:04:56.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.434+0000 7f4db119b700 1 -- 172.21.15.82:0/1274358304 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4dac10ae60 msgr2=0x7f4dac196740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:04:56.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.434+0000 7f4db119b700 1 --2- 172.21.15.82:0/1274358304 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4dac10ae60 0x7f4dac196740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:04:56.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.434+0000 7f4db119b700 1 -- 172.21.15.82:0/1274358304 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d9c0095f0 con 0x7f4dac101a90 2023-09-23T09:04:56.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.435+0000 7f4db119b700 1 --2- 172.21.15.82:0/1274358304 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4dac101a90 0x7f4dac19c6d0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f4da800e9a0 tx=0x7f4da800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:04:56.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.435+0000 7f4da27fc700 1 -- 172.21.15.82:0/1274358304 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da8009790 con 0x7f4dac101a90 2023-09-23T09:04:56.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.435+0000 7f4da27fc700 1 -- 172.21.15.82:0/1274358304 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4da8010430 con 0x7f4dac101a90 2023-09-23T09:04:56.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.435+0000 7f4db33ff700 1 -- 172.21.15.82:0/1274358304 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dac1973c0 con 0x7f4dac101a90 2023-09-23T09:04:56.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.435+0000 7f4da27fc700 1 -- 172.21.15.82:0/1274358304 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da800cea0 con 0x7f4dac101a90 2023-09-23T09:04:56.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.435+0000 7f4db33ff700 1 -- 172.21.15.82:0/1274358304 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dac1a36c0 con 0x7f4dac101a90 2023-09-23T09:04:56.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.438+0000 7f4da27fc700 1 -- 172.21.15.82:0/1274358304 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f4da80105a0 con 0x7f4dac101a90 2023-09-23T09:04:56.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.440+0000 7f4da27fc700 1 --2- 172.21.15.82:0/1274358304 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f4d980a0140 0x7f4d980a2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:04:56.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.440+0000 7f4da27fc700 1 -- 172.21.15.82:0/1274358304 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f4da8014070 con 0x7f4dac101a90 2023-09-23T09:04:56.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.440+0000 7f4db099a700 1 --2- 172.21.15.82:0/1274358304 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f4d980a0140 0x7f4d980a2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:04:56.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.440+0000 7f4dc6d02b80 1 Processor -- start 2023-09-23T09:04:56.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.441+0000 7f4dc6d02b80 1 -- start start 2023-09-23T09:04:56.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.441+0000 7f4db099a700 1 --2- 172.21.15.82:0/1274358304 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f4d980a0140 0x7f4d980a2600 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c006010 tx=0x7f4d9c005960 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:04:56.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.441+0000 7f4dc6d02b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555738a40790 0x555738a40b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:04:56.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.441+0000 7f4dc6d02b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555738a410b0 0x555738a3ab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:04:56.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.441+0000 7f4dc6d02b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555738a3b050 0x555738a3b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:04:56.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.441+0000 7f4dc6d02b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55573899e7b0 con 0x555738a40790 2023-09-23T09:04:56.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.441+0000 7f4dc6d02b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55573898f780 con 0x555738a3b050 2023-09-23T09:04:56.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.441+0000 7f4dc6d02b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55573898d0a0 con 0x555738a410b0 2023-09-23T09:04:56.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.441+0000 7f4db119b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555738a40790 0x555738a40b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:04:56.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.441+0000 7f4db099a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555738a410b0 0x555738a3ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:04:56.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.442+0000 7f4db119b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555738a40790 0x555738a40b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39850/0 (socket says 172.21.15.82:39850) 2023-09-23T09:04:56.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.442+0000 7f4db119b700 1 -- 172.21.15.82:0/1634768084 learned_addr learned my addr 172.21.15.82:0/1634768084 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:04:56.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.442+0000 7f4db199c700 1 --2- 172.21.15.82:0/1634768084 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555738a3b050 0x555738a3b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:04:56.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.442+0000 7f4db119b700 1 -- 172.21.15.82:0/1634768084 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555738a410b0 msgr2=0x555738a3ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:04:56.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.442+0000 7f4db119b700 1 --2- 172.21.15.82:0/1634768084 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555738a410b0 0x555738a3ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:04:56.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.442+0000 7f4db119b700 1 -- 172.21.15.82:0/1634768084 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555738a3b050 msgr2=0x555738a3b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:04:56.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.442+0000 7f4db119b700 1 --2- 172.21.15.82:0/1634768084 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555738a3b050 0x555738a3b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:04:56.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.442+0000 7f4db119b700 1 -- 172.21.15.82:0/1634768084 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555738808630 con 0x555738a40790 2023-09-23T09:04:56.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.442+0000 7f4db119b700 1 --2- 172.21.15.82:0/1634768084 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555738a40790 0x555738a40b70 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f4da80958c0 tx=0x7f4da8098aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17708acedd906688 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:04:56.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.442+0000 7f4d977fe700 1 -- 172.21.15.82:0/1634768084 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da809cc80 con 0x555738a40790 2023-09-23T09:04:56.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.442+0000 7f4d977fe700 1 -- 172.21.15.82:0/1634768084 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4da80a0c60 con 0x555738a40790 2023-09-23T09:04:56.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.442+0000 7f4d977fe700 1 -- 172.21.15.82:0/1634768084 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da80b8070 con 0x555738a40790 2023-09-23T09:04:56.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.443+0000 7f4dc6d02b80 1 -- 172.21.15.82:0/1634768084 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555738a40790 msgr2=0x555738a40b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:04:56.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.443+0000 7f4dc6d02b80 1 --2- 172.21.15.82:0/1634768084 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555738a40790 0x555738a40b70 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f4da80958c0 tx=0x7f4da8098aa0 comp rx=0 tx=0).stop 2023-09-23T09:04:56.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.443+0000 7f4dc6d02b80 1 -- 172.21.15.82:0/1634768084 shutdown_connections 2023-09-23T09:04:56.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.443+0000 7f4dc6d02b80 1 --2- 172.21.15.82:0/1634768084 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555738a3b050 0x555738a3b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:04:56.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.443+0000 7f4dc6d02b80 1 --2- 172.21.15.82:0/1634768084 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555738a40790 0x555738a40b70 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:04:56.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.443+0000 7f4dc6d02b80 1 --2- 172.21.15.82:0/1634768084 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555738a410b0 0x555738a3ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:04:56.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.443+0000 7f4dc6d02b80 1 -- 172.21.15.82:0/1634768084 >> 172.21.15.82:0/1634768084 conn(0x5557389ab0e0 msgr2=0x555738a31410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:04:56.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.443+0000 7f4dc6d02b80 1 -- 172.21.15.82:0/1634768084 shutdown_connections 2023-09-23T09:04:56.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.443+0000 7f4dc6d02b80 1 -- 172.21.15.82:0/1634768084 wait complete. 2023-09-23T09:04:56.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.444+0000 7f4dc6d02b80 1 -- start start 2023-09-23T09:04:56.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.444+0000 7f4dc6d02b80 1 Processor -- start 2023-09-23T09:04:56.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.445+0000 7f4dc6d02b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555738a3b050 0x555738a470e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:04:56.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.445+0000 7f4dc6d02b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555738a40790 0x555738a443d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:04:56.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.445+0000 7f4dc6d02b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555738a410b0 0x555738a44b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:04:56.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.445+0000 7f4dc6d02b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x555738988990 con 0x555738a410b0 2023-09-23T09:04:56.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.445+0000 7f4dc6d02b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x555738926bb0 con 0x555738a3b050 2023-09-23T09:04:56.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.445+0000 7f4dc6d02b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557389268b0 con 0x555738a40790 2023-09-23T09:04:56.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.445+0000 7f4dc6d02b80 10 client.0 _ll_register_callbacks cb 0x555738870a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:04:56.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.445+0000 7f4db119b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555738a3b050 0x555738a470e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:04:56.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.445+0000 7f4db099a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555738a40790 0x555738a443d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:04:56.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.445+0000 7f4db119b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555738a3b050 0x555738a470e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:57090/0 (socket says 172.21.15.82:57090) 2023-09-23T09:04:56.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.445+0000 7f4db119b700 1 -- 172.21.15.82:0/673808435 learned_addr learned my addr 172.21.15.82:0/673808435 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:04:56.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.445+0000 7f4db199c700 1 --2- 172.21.15.82:0/673808435 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555738a410b0 0x555738a44b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:04:56.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.445+0000 7f4db119b700 1 -- 172.21.15.82:0/673808435 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555738a40790 msgr2=0x555738a443d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:04:56.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.445+0000 7f4db119b700 1 --2- 172.21.15.82:0/673808435 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555738a40790 0x555738a443d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:04:56.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.445+0000 7f4db119b700 1 -- 172.21.15.82:0/673808435 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555738a410b0 msgr2=0x555738a44b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:04:56.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.445+0000 7f4db119b700 1 --2- 172.21.15.82:0/673808435 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555738a410b0 0x555738a44b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:04:56.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.446+0000 7f4db119b700 1 -- 172.21.15.82:0/673808435 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dac1a36c0 con 0x555738a3b050 2023-09-23T09:04:56.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.446+0000 7f4db099a700 1 --2- 172.21.15.82:0/673808435 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555738a40790 0x555738a443d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:04:56.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.446+0000 7f4db119b700 1 --2- 172.21.15.82:0/673808435 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555738a3b050 0x555738a470e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4da8009230 tx=0x7f4da8099470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e2004cd17b7f30d server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:04:56.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.446+0000 7f4d94ff9700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-09-23T09:04:56.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.446+0000 7f4d94ff9700 1 -- 172.21.15.82:0/673808435 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da80a0c60 con 0x555738a3b050 2023-09-23T09:04:56.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.446+0000 7f4dc6d02b80 1 -- 172.21.15.82:0/673808435 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555738a061c0 con 0x555738a3b050 2023-09-23T09:04:56.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.446+0000 7f4d94ff9700 1 -- 172.21.15.82:0/673808435 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f4da80b6e40 con 0x555738a3b050 2023-09-23T09:04:56.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.446+0000 7f4d94ff9700 1 -- 172.21.15.82:0/673808435 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4da80b8300 con 0x555738a3b050 2023-09-23T09:04:56.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.446+0000 7f4dc6d02b80 10 client.25856 fetch_fsmap learned FSMap version 49 2023-09-23T09:04:56.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.446+0000 7f4dc6d02b80 1 -- 172.21.15.82:0/673808435 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) v3 -- 0x5557387b4de0 con 0x555738a3b050 2023-09-23T09:04:56.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.447+0000 7f4d94ff9700 1 -- 172.21.15.82:0/673808435 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4da80c7070 con 0x555738a3b050 2023-09-23T09:04:56.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.447+0000 7f4d94ff9700 1 -- 172.21.15.82:0/673808435 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 49) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f4da8094c40 con 0x555738a3b050 2023-09-23T09:04:56.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.447+0000 7f4dc6d02b80 10 client.25856 fetch_fsmap finished waiting for FSMap version 49 2023-09-23T09:04:56.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.447+0000 7f4dc6d02b80 10 client.25856 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:04:56.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.447+0000 7f4dc6d02b80 20 client.25856 populate_metadata read hostname 'smithi082' 2023-09-23T09:04:56.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.447+0000 7f4dc6d02b80 1 --2- 172.21.15.82:0/673808435 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x555738a54850 0x555738a56c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:04:56.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.447+0000 7f4dc6d02b80 4 client.25856 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:04:56.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.447+0000 7f4dc6d02b80 1 -- 172.21.15.82:0/673808435 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55573892eba0 con 0x555738a54850 2023-09-23T09:04:56.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.447+0000 7f4db099a700 1 --2- 172.21.15.82:0/673808435 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x555738a54850 0x555738a56c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:04:56.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.448+0000 7f4db099a700 1 --2- 172.21.15.82:0/673808435 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x555738a54850 0x555738a56c40 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a4693794ddddc442 server_cookie=5e19d00ce8ee31e1 in_seq=0 out_seq=0 2023-09-23T09:04:56.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.448+0000 7f4d94ff9700 10 client.25856 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:04:56.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.449+0000 7f4d94ff9700 1 -- 172.21.15.82:0/673808435 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55573892eba0 con 0x555738a54850 2023-09-23T09:04:56.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.449+0000 7f4d94ff9700 10 client.25856 handle_command_reply: tid=0 2023-09-23T09:04:56.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.449+0000 7f4dc6d02b80 1 client.25856 shutdown 2023-09-23T09:04:56.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.449+0000 7f4dc6d02b80 1 -- 172.21.15.82:0/673808435 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555738a3b050 msgr2=0x555738a470e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:04:56.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.449+0000 7f4dc6d02b80 1 --2- 172.21.15.82:0/673808435 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555738a3b050 0x555738a470e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4da8009230 tx=0x7f4da8099470 comp rx=0 tx=0).stop 2023-09-23T09:04:56.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.449+0000 7f4dc6d02b80 1 -- 172.21.15.82:0/673808435 shutdown_connections 2023-09-23T09:04:56.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.449+0000 7f4dc6d02b80 1 --2- 172.21.15.82:0/673808435 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x555738a54850 0x555738a56c40 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:04:56.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.449+0000 7f4dc6d02b80 1 --2- 172.21.15.82:0/673808435 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555738a410b0 0x555738a44b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:04:56.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.449+0000 7f4dc6d02b80 1 --2- 172.21.15.82:0/673808435 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555738a3b050 0x555738a470e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:04:56.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.449+0000 7f4d94ff9700 0 client.25856 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:04:56.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.449+0000 7f4dc6d02b80 1 --2- 172.21.15.82:0/673808435 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555738a40790 0x555738a443d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:04:56.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.449+0000 7f4dc6d02b80 1 -- 172.21.15.82:0/673808435 >> 172.21.15.82:0/673808435 conn(0x5557389ab0e0 msgr2=0x555738a2bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:04:56.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.449+0000 7f4dc6d02b80 1 -- 172.21.15.82:0/673808435 shutdown_connections 2023-09-23T09:04:56.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.449+0000 7f4dc6d02b80 1 -- 172.21.15.82:0/673808435 wait complete. 2023-09-23T09:04:56.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.450+0000 7f4dc6d02b80 20 client.25856 trim_cache size 0 max 16384 2023-09-23T09:04:56.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.468+0000 7f4dc6d02b80 1 Processor -- start 2023-09-23T09:04:56.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.469+0000 7f4dc6d02b80 1 -- start start 2023-09-23T09:04:56.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.469+0000 7f4dc6d02b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555738a3b050 0x555738a3ab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:04:56.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.469+0000 7f4dc6d02b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555738a40790 0x555738a46c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:04:56.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.469+0000 7f4dc6d02b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555738a410b0 0x555738a43990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:04:56.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.469+0000 7f4dc6d02b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55573880a920 con 0x555738a40790 2023-09-23T09:04:56.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.469+0000 7f4dc6d02b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x555738a45350 con 0x555738a410b0 2023-09-23T09:04:56.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.469+0000 7f4dc6d02b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x555738a2d810 con 0x555738a3b050 2023-09-23T09:04:56.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.469+0000 7f4db099a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555738a40790 0x555738a46c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:04:56.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.469+0000 7f4db119b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555738a3b050 0x555738a3ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:04:56.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.469+0000 7f4db119b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555738a3b050 0x555738a3ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:54148/0 (socket says 172.21.15.82:54148) 2023-09-23T09:04:56.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.469+0000 7f4db119b700 1 -- 172.21.15.82:0/150007922 learned_addr learned my addr 172.21.15.82:0/150007922 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:04:56.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.469+0000 7f4db099a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555738a40790 0x555738a46c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39876/0 (socket says 172.21.15.82:39876) 2023-09-23T09:04:56.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.469+0000 7f4db199c700 1 --2- 172.21.15.82:0/150007922 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555738a410b0 0x555738a43990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:04:56.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.470+0000 7f4db119b700 1 -- 172.21.15.82:0/150007922 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555738a410b0 msgr2=0x555738a43990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:04:56.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.470+0000 7f4db119b700 1 --2- 172.21.15.82:0/150007922 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555738a410b0 0x555738a43990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:04:56.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.470+0000 7f4db119b700 1 -- 172.21.15.82:0/150007922 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555738a40790 msgr2=0x555738a46c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:04:56.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.470+0000 7f4db119b700 1 --2- 172.21.15.82:0/150007922 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555738a40790 0x555738a46c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:04:56.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.470+0000 7f4db119b700 1 -- 172.21.15.82:0/150007922 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55573879dc60 con 0x555738a3b050 2023-09-23T09:04:56.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.470+0000 7f4db119b700 1 --2- 172.21.15.82:0/150007922 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555738a3b050 0x555738a3ab10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4da8098de0 tx=0x7f4da8098860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f09580840bfe7b12 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:04:56.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.470+0000 7f4d97fff700 1 -- 172.21.15.82:0/150007922 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da80a0c60 con 0x555738a3b050 2023-09-23T09:04:56.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.470+0000 7f4d97fff700 1 -- 172.21.15.82:0/150007922 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4da80c7070 con 0x555738a3b050 2023-09-23T09:04:56.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.470+0000 7f4d97fff700 1 -- 172.21.15.82:0/150007922 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da8094c40 con 0x555738a3b050 2023-09-23T09:04:56.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.471+0000 7f4dc6d02b80 1 -- 172.21.15.82:0/150007922 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555738a3b050 msgr2=0x555738a3ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:04:56.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.471+0000 7f4dc6d02b80 1 --2- 172.21.15.82:0/150007922 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555738a3b050 0x555738a3ab10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4da8098de0 tx=0x7f4da8098860 comp rx=0 tx=0).stop 2023-09-23T09:04:56.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.471+0000 7f4dc6d02b80 1 -- 172.21.15.82:0/150007922 shutdown_connections 2023-09-23T09:04:56.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.471+0000 7f4dc6d02b80 1 --2- 172.21.15.82:0/150007922 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555738a410b0 0x555738a43990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:04:56.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.471+0000 7f4dc6d02b80 1 --2- 172.21.15.82:0/150007922 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555738a3b050 0x555738a3ab10 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:04:56.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.471+0000 7f4dc6d02b80 1 --2- 172.21.15.82:0/150007922 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555738a40790 0x555738a46c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:04:56.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.471+0000 7f4dc6d02b80 1 -- 172.21.15.82:0/150007922 >> 172.21.15.82:0/150007922 conn(0x5557389ab0e0 msgr2=0x555738a502a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:04:56.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.471+0000 7f4dc6d02b80 1 -- 172.21.15.82:0/150007922 shutdown_connections 2023-09-23T09:04:56.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.471+0000 7f4dc6d02b80 1 -- 172.21.15.82:0/150007922 wait complete. 2023-09-23T09:04:56.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.472+0000 7f4dc6d02b80 1 -- start start 2023-09-23T09:04:56.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.472+0000 7f4dc6d02b80 1 Processor -- start 2023-09-23T09:04:56.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.472+0000 7f4dc6d02b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555738a3b050 0x555738a49d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:04:56.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.472+0000 7f4dc6d02b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555738a40790 0x555738a4a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:04:56.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.472+0000 7f4dc6d02b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555738a410b0 0x555738aa7630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:04:56.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.472+0000 7f4dc6d02b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x555738aa7b70 con 0x555738a3b050 2023-09-23T09:04:56.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.472+0000 7f4dc6d02b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x555738aa7cb0 con 0x555738a40790 2023-09-23T09:04:56.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.472+0000 7f4dc6d02b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x555738aa7df0 con 0x555738a410b0 2023-09-23T09:04:56.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.473+0000 7f4dc6d02b80 10 client.0 _ll_register_callbacks cb 0x7f4da4009f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:04:56.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.473+0000 7f4db119b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555738a3b050 0x555738a49d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:04:56.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.473+0000 7f4db119b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555738a3b050 0x555738a49d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39886/0 (socket says 172.21.15.82:39886) 2023-09-23T09:04:56.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.473+0000 7f4db099a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555738a40790 0x555738a4a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:04:56.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.473+0000 7f4db119b700 1 -- 172.21.15.82:0/1028670633 learned_addr learned my addr 172.21.15.82:0/1028670633 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:04:56.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.473+0000 7f4db199c700 1 --2- 172.21.15.82:0/1028670633 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555738a410b0 0x555738aa7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:04:56.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.473+0000 7f4db119b700 1 -- 172.21.15.82:0/1028670633 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555738a410b0 msgr2=0x555738aa7630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:04:56.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.473+0000 7f4db119b700 1 --2- 172.21.15.82:0/1028670633 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555738a410b0 0x555738aa7630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:04:56.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.473+0000 7f4db119b700 1 -- 172.21.15.82:0/1028670633 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555738a40790 msgr2=0x555738a4a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:04:56.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.473+0000 7f4db119b700 1 --2- 172.21.15.82:0/1028670633 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555738a40790 0x555738a4a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:04:56.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.473+0000 7f4db119b700 1 -- 172.21.15.82:0/1028670633 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5557387b4de0 con 0x555738a3b050 2023-09-23T09:04:56.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.473+0000 7f4db119b700 1 --2- 172.21.15.82:0/1028670633 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555738a3b050 0x555738a49d20 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f4da80958c0 tx=0x7f4da8097e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c62818bccc42f7bc server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:04:56.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.473+0000 7f4d94ff9700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:04:56.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.474+0000 7f4d94ff9700 1 -- 172.21.15.82:0/1028670633 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da80a0c60 con 0x555738a3b050 2023-09-23T09:04:56.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.474+0000 7f4d94ff9700 1 -- 172.21.15.82:0/1028670633 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f4da80b6e40 con 0x555738a3b050 2023-09-23T09:04:56.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.474+0000 7f4dc6d02b80 1 -- 172.21.15.82:0/1028670633 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555738a298b0 con 0x555738a3b050 2023-09-23T09:04:56.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.474+0000 7f4d94ff9700 1 -- 172.21.15.82:0/1028670633 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4da80b8300 con 0x555738a3b050 2023-09-23T09:04:56.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.474+0000 7f4dc6d02b80 10 client.16170 fetch_fsmap learned FSMap version 49 2023-09-23T09:04:56.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.474+0000 7f4dc6d02b80 1 -- 172.21.15.82:0/1028670633 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) v3 -- 0x5557387db250 con 0x555738a3b050 2023-09-23T09:04:56.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.474+0000 7f4d94ff9700 1 -- 172.21.15.82:0/1028670633 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x555738a298b0 con 0x555738a3b050 2023-09-23T09:04:56.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.474+0000 7f4d94ff9700 1 -- 172.21.15.82:0/1028670633 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 49) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f4da807d020 con 0x555738a3b050 2023-09-23T09:04:56.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.474+0000 7f4dc6d02b80 10 client.16170 fetch_fsmap finished waiting for FSMap version 49 2023-09-23T09:04:56.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.474+0000 7f4dc6d02b80 10 client.16170 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:04:56.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.474+0000 7f4dc6d02b80 20 client.16170 populate_metadata read hostname 'smithi082' 2023-09-23T09:04:56.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.474+0000 7f4dc6d02b80 1 --2- 172.21.15.82:0/1028670633 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x555738aa8f80 0x555738aab370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:04:56.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.475+0000 7f4dc6d02b80 4 client.16170 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:04:56.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.475+0000 7f4dc6d02b80 1 -- 172.21.15.82:0/1028670633 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x555738981970 con 0x555738aa8f80 2023-09-23T09:04:56.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.475+0000 7f4db099a700 1 --2- 172.21.15.82:0/1028670633 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x555738aa8f80 0x555738aab370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:04:56.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.476+0000 7f4db099a700 1 --2- 172.21.15.82:0/1028670633 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x555738aa8f80 0x555738aab370 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f784eb2c90e1354 server_cookie=7d7ed4b8ad85f173 in_seq=0 out_seq=0 2023-09-23T09:04:56.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.476+0000 7f4d94ff9700 10 client.16170 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:04:56.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.476+0000 7f4d94ff9700 1 -- 172.21.15.82:0/1028670633 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x555738981970 con 0x555738aa8f80 2023-09-23T09:04:56.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.476+0000 7f4d94ff9700 10 client.16170 handle_command_reply: tid=0 2023-09-23T09:04:56.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.476+0000 7f4dc6d02b80 1 client.16170 shutdown 2023-09-23T09:04:56.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.476+0000 7f4dc6d02b80 1 -- 172.21.15.82:0/1028670633 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555738a3b050 msgr2=0x555738a49d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:04:56.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.476+0000 7f4dc6d02b80 1 --2- 172.21.15.82:0/1028670633 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555738a3b050 0x555738a49d20 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f4da80958c0 tx=0x7f4da8097e30 comp rx=0 tx=0).stop 2023-09-23T09:04:56.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.476+0000 7f4dc6d02b80 1 -- 172.21.15.82:0/1028670633 shutdown_connections 2023-09-23T09:04:56.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.476+0000 7f4dc6d02b80 1 --2- 172.21.15.82:0/1028670633 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555738a410b0 0x555738aa7630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:04:56.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.476+0000 7f4dc6d02b80 1 --2- 172.21.15.82:0/1028670633 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x555738aa8f80 0x555738aab370 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:04:56.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.476+0000 7f4dc6d02b80 1 --2- 172.21.15.82:0/1028670633 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555738a3b050 0x555738a49d20 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:04:56.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.476+0000 7f4dc6d02b80 1 --2- 172.21.15.82:0/1028670633 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555738a40790 0x555738a4a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:04:56.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.476+0000 7f4d94ff9700 0 client.16170 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:04:56.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.476+0000 7f4dc6d02b80 1 -- 172.21.15.82:0/1028670633 >> 172.21.15.82:0/1028670633 conn(0x5557389ab0e0 msgr2=0x555738a3e560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:04:56.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.476+0000 7f4dc6d02b80 1 -- 172.21.15.82:0/1028670633 shutdown_connections 2023-09-23T09:04:56.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.476+0000 7f4dc6d02b80 1 -- 172.21.15.82:0/1028670633 wait complete. 2023-09-23T09:04:56.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.477+0000 7f4dc6d02b80 20 client.16170 trim_cache size 0 max 16384 2023-09-23T09:04:56.483 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:04:56.483 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "IDLE (waiting for more scrubs)", 2023-09-23T09:04:56.483 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:04:56.484 INFO:teuthology.orchestra.run.smithi082.stdout: "6f0fe3a6-7212-425d-a0a6-f38e8b42ec13": { 2023-09-23T09:04:56.484 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:04:56.484 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "6f0fe3a6-7212-425d-a0a6-f38e8b42ec13", 2023-09-23T09:04:56.484 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:04:56.484 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:04:56.484 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:04:56.484 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:04:56.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.478+0000 7f4db33ff700 1 -- 172.21.15.82:0/1274358304 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f4d980a0140 msgr2=0x7f4d980a2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:04:56.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.478+0000 7f4db33ff700 1 --2- 172.21.15.82:0/1274358304 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f4d980a0140 0x7f4d980a2600 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c006010 tx=0x7f4d9c005960 comp rx=0 tx=0).stop 2023-09-23T09:04:56.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.478+0000 7f4db33ff700 1 -- 172.21.15.82:0/1274358304 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4dac101a90 msgr2=0x7f4dac19c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:04:56.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.478+0000 7f4db33ff700 1 --2- 172.21.15.82:0/1274358304 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4dac101a90 0x7f4dac19c6d0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f4da800e9a0 tx=0x7f4da800ecb0 comp rx=0 tx=0).stop 2023-09-23T09:04:56.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.478+0000 7f4db33ff700 1 -- 172.21.15.82:0/1274358304 shutdown_connections 2023-09-23T09:04:56.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.478+0000 7f4db33ff700 1 --2- 172.21.15.82:0/1274358304 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f4d980a0140 0x7f4d980a2600 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:04:56.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.478+0000 7f4db33ff700 1 --2- 172.21.15.82:0/1274358304 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4dac10ae60 0x7f4dac196740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:04:56.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.478+0000 7f4db33ff700 1 --2- 172.21.15.82:0/1274358304 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4dac101a90 0x7f4dac19c6d0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:04:56.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.478+0000 7f4db33ff700 1 --2- 172.21.15.82:0/1274358304 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4dac1023b0 0x7f4dac19cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:04:56.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.478+0000 7f4db33ff700 1 -- 172.21.15.82:0/1274358304 >> 172.21.15.82:0/1274358304 conn(0x7f4dac0fb270 msgr2=0x7f4dac0fbee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:04:56.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.478+0000 7f4db33ff700 1 -- 172.21.15.82:0/1274358304 shutdown_connections 2023-09-23T09:04:56.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:04:56.478+0000 7f4db33ff700 1 -- 172.21.15.82:0/1274358304 wait complete. 2023-09-23T09:04:56.499 INFO:tasks.cephfs.filesystem:scrub status for tag:6f0fe3a6-7212-425d-a0a6-f38e8b42ec13 - {'path': '/', 'tag': '6f0fe3a6-7212-425d-a0a6-f38e8b42ec13', 'options': 'recursive,force'} 2023-09-23T09:04:56.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:04:56 smithi082 ceph-mon[97694]: pgmap v248: 97 pgs: 97 active+clean; 7.6 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 36 MiB/s wr, 79 op/s 2023-09-23T09:04:56.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:04:56 smithi161 ceph-mon[99580]: pgmap v248: 97 pgs: 97 active+clean; 7.6 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 36 MiB/s wr, 79 op/s 2023-09-23T09:04:57.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:04:56 smithi135 ceph-mon[99205]: pgmap v248: 97 pgs: 97 active+clean; 7.6 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 36 MiB/s wr, 79 op/s 2023-09-23T09:04:57.502 INFO:teuthology.orchestra.run.smithi082.stderr:33200000 of 50000000 tuples (66%) done (elapsed 452.24 s, remaining 228.85 s) 2023-09-23T09:04:58.816 INFO:teuthology.orchestra.run.smithi082.stderr:33300000 of 50000000 tuples (66%) done (elapsed 453.56 s, remaining 227.46 s) 2023-09-23T09:04:58.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:04:58 smithi082 ceph-mon[97694]: pgmap v249: 97 pgs: 97 active+clean; 7.6 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 24 MiB/s wr, 52 op/s 2023-09-23T09:04:58.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:04:58 smithi161 ceph-mon[99580]: pgmap v249: 97 pgs: 97 active+clean; 7.6 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 24 MiB/s wr, 52 op/s 2023-09-23T09:04:59.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:04:58 smithi135 ceph-mon[99205]: pgmap v249: 97 pgs: 97 active+clean; 7.6 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 24 MiB/s wr, 52 op/s 2023-09-23T09:05:00.020 INFO:teuthology.orchestra.run.smithi082.stderr:33400000 of 50000000 tuples (66%) done (elapsed 454.76 s, remaining 226.02 s) 2023-09-23T09:05:00.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:05:00 smithi082 ceph-mon[97694]: pgmap v250: 97 pgs: 97 active+clean; 7.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 35 MiB/s wr, 80 op/s 2023-09-23T09:05:00.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:05:00 smithi161 ceph-mon[99580]: pgmap v250: 97 pgs: 97 active+clean; 7.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 35 MiB/s wr, 80 op/s 2023-09-23T09:05:01.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:05:00 smithi135 ceph-mon[99205]: pgmap v250: 97 pgs: 97 active+clean; 7.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 35 MiB/s wr, 80 op/s 2023-09-23T09:05:02.648 INFO:teuthology.orchestra.run.smithi082.stderr:33500000 of 50000000 tuples (67%) done (elapsed 457.39 s, remaining 225.28 s) 2023-09-23T09:05:02.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:05:02 smithi082 ceph-mon[97694]: pgmap v251: 97 pgs: 97 active+clean; 7.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 24 MiB/s wr, 64 op/s 2023-09-23T09:05:02.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:05:02 smithi161 ceph-mon[99580]: pgmap v251: 97 pgs: 97 active+clean; 7.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 24 MiB/s wr, 64 op/s 2023-09-23T09:05:03.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:05:02 smithi135 ceph-mon[99205]: pgmap v251: 97 pgs: 97 active+clean; 7.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 24 MiB/s wr, 64 op/s 2023-09-23T09:05:03.929 INFO:teuthology.orchestra.run.smithi082.stderr:33600000 of 50000000 tuples (67%) done (elapsed 458.67 s, remaining 223.88 s) 2023-09-23T09:05:04.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:05:04 smithi082 ceph-mon[97694]: pgmap v252: 97 pgs: 97 active+clean; 7.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 24 MiB/s wr, 61 op/s 2023-09-23T09:05:04.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:05:04 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:05:04.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:05:04 smithi082 ceph-mon[97694]: scrub summary: active paths [/] 2023-09-23T09:05:04.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:05:04 smithi082 ceph-mon[97694]: scrub summary: idle+waiting paths [/] 2023-09-23T09:05:04.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:05:04 smithi161 ceph-mon[99580]: pgmap v252: 97 pgs: 97 active+clean; 7.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 24 MiB/s wr, 61 op/s 2023-09-23T09:05:04.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:05:04 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:05:04.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:05:04 smithi161 ceph-mon[99580]: scrub summary: active paths [/] 2023-09-23T09:05:04.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:05:04 smithi161 ceph-mon[99580]: scrub summary: idle+waiting paths [/] 2023-09-23T09:05:05.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:05:04 smithi135 ceph-mon[99205]: pgmap v252: 97 pgs: 97 active+clean; 7.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 24 MiB/s wr, 61 op/s 2023-09-23T09:05:05.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:05:04 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:05:05.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:05:04 smithi135 ceph-mon[99205]: scrub summary: active paths [/] 2023-09-23T09:05:05.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:05:04 smithi135 ceph-mon[99205]: scrub summary: idle+waiting paths [/] 2023-09-23T09:05:05.235 INFO:teuthology.orchestra.run.smithi082.stderr:33700000 of 50000000 tuples (67%) done (elapsed 459.98 s, remaining 222.48 s) 2023-09-23T09:05:06.469 INFO:teuthology.orchestra.run.smithi082.stderr:33800000 of 50000000 tuples (67%) done (elapsed 461.21 s, remaining 221.05 s) 2023-09-23T09:05:06.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:05:06 smithi082 ceph-mon[97694]: pgmap v253: 97 pgs: 97 active+clean; 7.7 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 33 MiB/s wr, 95 op/s 2023-09-23T09:05:06.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:05:06 smithi161 ceph-mon[99580]: pgmap v253: 97 pgs: 97 active+clean; 7.7 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 33 MiB/s wr, 95 op/s 2023-09-23T09:05:07.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:05:06 smithi135 ceph-mon[99205]: pgmap v253: 97 pgs: 97 active+clean; 7.7 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 33 MiB/s wr, 95 op/s 2023-09-23T09:05:07.703 INFO:teuthology.orchestra.run.smithi082.stderr:33900000 of 50000000 tuples (67%) done (elapsed 462.45 s, remaining 219.63 s) 2023-09-23T09:05:08.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:05:08 smithi161 ceph-mon[99580]: pgmap v254: 97 pgs: 97 active+clean; 7.7 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 21 MiB/s wr, 69 op/s 2023-09-23T09:05:09.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:05:08 smithi135 ceph-mon[99205]: pgmap v254: 97 pgs: 97 active+clean; 7.7 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 21 MiB/s wr, 69 op/s 2023-09-23T09:05:09.073 INFO:teuthology.orchestra.run.smithi082.stderr:34000000 of 50000000 tuples (68%) done (elapsed 463.82 s, remaining 218.27 s) 2023-09-23T09:05:09.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:05:08 smithi082 ceph-mon[97694]: pgmap v254: 97 pgs: 97 active+clean; 7.7 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 21 MiB/s wr, 69 op/s 2023-09-23T09:05:09.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:05:09 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:05:10.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:05:09 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:05:10.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:05:09 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:05:10.324 INFO:teuthology.orchestra.run.smithi082.stderr:34100000 of 50000000 tuples (68%) done (elapsed 465.07 s, remaining 216.85 s) 2023-09-23T09:05:10.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:05:10 smithi161 ceph-mon[99580]: pgmap v255: 97 pgs: 97 active+clean; 7.8 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 31 MiB/s wr, 103 op/s 2023-09-23T09:05:11.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:05:10 smithi135 ceph-mon[99205]: pgmap v255: 97 pgs: 97 active+clean; 7.8 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 31 MiB/s wr, 103 op/s 2023-09-23T09:05:11.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:05:10 smithi082 ceph-mon[97694]: pgmap v255: 97 pgs: 97 active+clean; 7.8 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 31 MiB/s wr, 103 op/s 2023-09-23T09:05:11.560 INFO:teuthology.orchestra.run.smithi082.stderr:34200000 of 50000000 tuples (68%) done (elapsed 466.30 s, remaining 215.43 s) 2023-09-23T09:05:12.837 INFO:teuthology.orchestra.run.smithi082.stderr:34300000 of 50000000 tuples (68%) done (elapsed 467.58 s, remaining 214.02 s) 2023-09-23T09:05:12.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:05:12 smithi161 ceph-mon[99580]: pgmap v256: 97 pgs: 97 active+clean; 7.8 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 21 MiB/s wr, 76 op/s 2023-09-23T09:05:12.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:05:12 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:05:13.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:05:12 smithi135 ceph-mon[99205]: pgmap v256: 97 pgs: 97 active+clean; 7.8 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 21 MiB/s wr, 76 op/s 2023-09-23T09:05:13.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:05:12 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:05:13.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:05:12 smithi082 ceph-mon[97694]: pgmap v256: 97 pgs: 97 active+clean; 7.8 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 21 MiB/s wr, 76 op/s 2023-09-23T09:05:13.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:05:12 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:05:13.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:05:13 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:05:13.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:05:13 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:05:13.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:05:13 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:05:14.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:05:13 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:05:14.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:05:13 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:05:14.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:05:13 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:05:14.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:05:13 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:05:14.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:05:13 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:05:14.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:05:13 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:05:14.181 INFO:teuthology.orchestra.run.smithi082.stderr:34400000 of 50000000 tuples (68%) done (elapsed 468.92 s, remaining 212.65 s) 2023-09-23T09:05:14.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:05:14 smithi161 ceph-mon[99580]: pgmap v257: 97 pgs: 97 active+clean; 7.8 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 21 MiB/s wr, 69 op/s 2023-09-23T09:05:15.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:05:14 smithi135 ceph-mon[99205]: pgmap v257: 97 pgs: 97 active+clean; 7.8 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 21 MiB/s wr, 69 op/s 2023-09-23T09:05:15.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:05:14 smithi082 ceph-mon[97694]: pgmap v257: 97 pgs: 97 active+clean; 7.8 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 21 MiB/s wr, 69 op/s 2023-09-23T09:05:15.384 INFO:teuthology.orchestra.run.smithi082.stderr:34500000 of 50000000 tuples (69%) done (elapsed 470.13 s, remaining 211.22 s) 2023-09-23T09:05:16.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:05:16 smithi161 ceph-mon[99580]: pgmap v258: 97 pgs: 97 active+clean; 7.9 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 32 MiB/s wr, 92 op/s 2023-09-23T09:05:17.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:05:16 smithi135 ceph-mon[99205]: pgmap v258: 97 pgs: 97 active+clean; 7.9 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 32 MiB/s wr, 92 op/s 2023-09-23T09:05:17.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:05:16 smithi082 ceph-mon[97694]: pgmap v258: 97 pgs: 97 active+clean; 7.9 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 32 MiB/s wr, 92 op/s 2023-09-23T09:05:18.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:05:17 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:05:18.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:05:17 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:05:18.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:05:17 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:05:19.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:05:18 smithi135 ceph-mon[99205]: pgmap v259: 97 pgs: 97 active+clean; 7.9 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 23 MiB/s wr, 58 op/s 2023-09-23T09:05:19.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:05:18 smithi082 ceph-mon[97694]: pgmap v259: 97 pgs: 97 active+clean; 7.9 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 23 MiB/s wr, 58 op/s 2023-09-23T09:05:19.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:05:18 smithi161 ceph-mon[99580]: pgmap v259: 97 pgs: 97 active+clean; 7.9 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 23 MiB/s wr, 58 op/s 2023-09-23T09:05:19.471 INFO:teuthology.orchestra.run.smithi082.stderr:34600000 of 50000000 tuples (69%) done (elapsed 474.21 s, remaining 211.07 s) 2023-09-23T09:05:20.715 INFO:teuthology.orchestra.run.smithi082.stderr:34700000 of 50000000 tuples (69%) done (elapsed 475.46 s, remaining 209.64 s) 2023-09-23T09:05:21.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:05:20 smithi135 ceph-mon[99205]: pgmap v260: 97 pgs: 97 active+clean; 8.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 28 MiB/s wr, 75 op/s 2023-09-23T09:05:21.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:05:20 smithi082 ceph-mon[97694]: pgmap v260: 97 pgs: 97 active+clean; 8.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 28 MiB/s wr, 75 op/s 2023-09-23T09:05:21.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:05:20 smithi161 ceph-mon[99580]: pgmap v260: 97 pgs: 97 active+clean; 8.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 28 MiB/s wr, 75 op/s 2023-09-23T09:05:22.042 INFO:teuthology.orchestra.run.smithi082.stderr:34800000 of 50000000 tuples (69%) done (elapsed 476.78 s, remaining 208.25 s) 2023-09-23T09:05:23.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:05:22 smithi135 ceph-mon[99205]: pgmap v261: 97 pgs: 97 active+clean; 8.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 18 MiB/s wr, 46 op/s 2023-09-23T09:05:23.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:05:22 smithi082 ceph-mon[97694]: pgmap v261: 97 pgs: 97 active+clean; 8.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 18 MiB/s wr, 46 op/s 2023-09-23T09:05:23.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:05:22 smithi161 ceph-mon[99580]: pgmap v261: 97 pgs: 97 active+clean; 8.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 18 MiB/s wr, 46 op/s 2023-09-23T09:05:23.305 INFO:teuthology.orchestra.run.smithi082.stderr:34900000 of 50000000 tuples (69%) done (elapsed 478.05 s, remaining 206.83 s) 2023-09-23T09:05:24.552 INFO:teuthology.orchestra.run.smithi082.stderr:35000000 of 50000000 tuples (70%) done (elapsed 479.29 s, remaining 205.41 s) 2023-09-23T09:05:25.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:05:24 smithi135 ceph-mon[99205]: pgmap v262: 97 pgs: 97 active+clean; 8.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 17 MiB/s wr, 44 op/s 2023-09-23T09:05:25.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:05:24 smithi082 ceph-mon[97694]: pgmap v262: 97 pgs: 97 active+clean; 8.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 17 MiB/s wr, 44 op/s 2023-09-23T09:05:25.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:05:24 smithi161 ceph-mon[99580]: pgmap v262: 97 pgs: 97 active+clean; 8.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 17 MiB/s wr, 44 op/s 2023-09-23T09:05:25.950 INFO:teuthology.orchestra.run.smithi082.stderr:35100000 of 50000000 tuples (70%) done (elapsed 480.69 s, remaining 204.05 s) 2023-09-23T09:05:26.500 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:05:26.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.744+0000 7fe5b97ff700 1 -- 172.21.15.82:0/1699979253 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe5b4101a30 msgr2=0x7fe5b4101e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:05:26.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.744+0000 7fe5b97ff700 1 --2- 172.21.15.82:0/1699979253 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe5b4101a30 0x7fe5b4101e10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe5a4009990 tx=0x7fe5a4009ca0 comp rx=0 tx=0).stop 2023-09-23T09:05:26.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.744+0000 7fe5b97ff700 1 -- 172.21.15.82:0/1699979253 shutdown_connections 2023-09-23T09:05:26.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.744+0000 7fe5b97ff700 1 --2- 172.21.15.82:0/1699979253 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe5b410ae50 0x7fe5b410d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:26.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.744+0000 7fe5b97ff700 1 --2- 172.21.15.82:0/1699979253 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe5b4101a30 0x7fe5b4101e10 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:26.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.744+0000 7fe5b97ff700 1 --2- 172.21.15.82:0/1699979253 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5b4102350 0x7fe5b410a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:26.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.744+0000 7fe5b97ff700 1 -- 172.21.15.82:0/1699979253 >> 172.21.15.82:0/1699979253 conn(0x7fe5b40fb270 msgr2=0x7fe5b40fd690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:05:26.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.744+0000 7fe5b97ff700 1 -- 172.21.15.82:0/1699979253 shutdown_connections 2023-09-23T09:05:26.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.744+0000 7fe5b97ff700 1 -- 172.21.15.82:0/1699979253 wait complete. 2023-09-23T09:05:26.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.745+0000 7fe5b97ff700 1 Processor -- start 2023-09-23T09:05:26.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.745+0000 7fe5b97ff700 1 -- start start 2023-09-23T09:05:26.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.746+0000 7fe5b97ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5b4101a30 0x7fe5b419e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:26.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.746+0000 7fe5b97ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe5b4102350 0x7fe5b419ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:26.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.746+0000 7fe5b97ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe5b410ae50 0x7fe5b4198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:26.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.746+0000 7fe5b97ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b4198fd0 con 0x7fe5b4101a30 2023-09-23T09:05:26.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.746+0000 7fe5b97ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b4199140 con 0x7fe5b4102350 2023-09-23T09:05:26.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.746+0000 7fe5b97ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b4199300 con 0x7fe5b410ae50 2023-09-23T09:05:26.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.746+0000 7fe5b2ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5b4101a30 0x7fe5b419e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:26.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.746+0000 7fe5b2ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5b4101a30 0x7fe5b419e8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58800/0 (socket says 172.21.15.82:58800) 2023-09-23T09:05:26.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.746+0000 7fe5b2ffd700 1 -- 172.21.15.82:0/1929942805 learned_addr learned my addr 172.21.15.82:0/1929942805 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:05:26.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.746+0000 7fe5b37fe700 1 --2- 172.21.15.82:0/1929942805 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe5b410ae50 0x7fe5b4198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:26.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.746+0000 7fe5b27fc700 1 --2- 172.21.15.82:0/1929942805 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe5b4102350 0x7fe5b419ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:26.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.747+0000 7fe5b2ffd700 1 -- 172.21.15.82:0/1929942805 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe5b410ae50 msgr2=0x7fe5b4198960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:05:26.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.747+0000 7fe5b2ffd700 1 --2- 172.21.15.82:0/1929942805 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe5b410ae50 0x7fe5b4198960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:26.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.747+0000 7fe5b2ffd700 1 -- 172.21.15.82:0/1929942805 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe5b4102350 msgr2=0x7fe5b419ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:05:26.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.747+0000 7fe5b2ffd700 1 --2- 172.21.15.82:0/1929942805 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe5b4102350 0x7fe5b419ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:26.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.747+0000 7fe5b2ffd700 1 -- 172.21.15.82:0/1929942805 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5a40095f0 con 0x7fe5b4101a30 2023-09-23T09:05:26.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.747+0000 7fe5b37fe700 1 --2- 172.21.15.82:0/1929942805 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe5b410ae50 0x7fe5b4198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:05:26.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.747+0000 7fe5b2ffd700 1 --2- 172.21.15.82:0/1929942805 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5b4101a30 0x7fe5b419e8f0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fe5a4000c00 tx=0x7fe5a4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:05:26.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.747+0000 7fe59bfff700 1 -- 172.21.15.82:0/1929942805 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a401d070 con 0x7fe5b4101a30 2023-09-23T09:05:26.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.747+0000 7fe5b97ff700 1 -- 172.21.15.82:0/1929942805 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5b4199580 con 0x7fe5b4101a30 2023-09-23T09:05:26.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.747+0000 7fe59bfff700 1 -- 172.21.15.82:0/1929942805 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe5a4022470 con 0x7fe5b4101a30 2023-09-23T09:05:26.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.747+0000 7fe59bfff700 1 -- 172.21.15.82:0/1929942805 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a4017650 con 0x7fe5b4101a30 2023-09-23T09:05:26.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.747+0000 7fe5b97ff700 1 -- 172.21.15.82:0/1929942805 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5b41a58e0 con 0x7fe5b4101a30 2023-09-23T09:05:26.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.752+0000 7fe59bfff700 1 -- 172.21.15.82:0/1929942805 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7fe5a40225e0 con 0x7fe5b4101a30 2023-09-23T09:05:26.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.754+0000 7fe5cd0b5b80 1 Processor -- start 2023-09-23T09:05:26.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.754+0000 7fe5cd0b5b80 1 -- start start 2023-09-23T09:05:26.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.754+0000 7fe59bfff700 1 --2- 172.21.15.82:0/1929942805 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fe59c0a00c0 0x7fe59c0a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:26.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.754+0000 7fe5cd0b5b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560b1a8b0b90 0x560b1a8b0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:26.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.754+0000 7fe5cd0b5b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560b1a8b14b0 0x560b1a8aaf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:26.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.755+0000 7fe5cd0b5b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b1a8ab450 0x560b1a8ab8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:26.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.755+0000 7fe5cd0b5b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b1a80a7b0 con 0x560b1a8ab450 2023-09-23T09:05:26.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.755+0000 7fe59bfff700 1 -- 172.21.15.82:0/1929942805 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fe5a40cc9d0 con 0x7fe5b4101a30 2023-09-23T09:05:26.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.755+0000 7fe5cd0b5b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b1a7fb780 con 0x560b1a8b0b90 2023-09-23T09:05:26.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.755+0000 7fe5cd0b5b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b1a7f90a0 con 0x560b1a8b14b0 2023-09-23T09:05:26.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.755+0000 7fe5b37fe700 1 --2- 172.21.15.82:0/1929942805 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fe59c0a00c0 0x7fe59c0a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:26.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.755+0000 7fe5b27fc700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560b1a8b14b0 0x560b1a8aaf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:26.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.755+0000 7fe5b27fc700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560b1a8b14b0 0x560b1a8aaf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:55854/0 (socket says 172.21.15.82:55854) 2023-09-23T09:05:26.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.755+0000 7fe5b27fc700 1 -- 172.21.15.82:0/2008704908 learned_addr learned my addr 172.21.15.82:0/2008704908 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:05:26.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.755+0000 7fe5b37fe700 1 --2- 172.21.15.82:0/2008704908 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b1a8ab450 0x560b1a8ab8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:26.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.755+0000 7fe5b2ffd700 1 --2- 172.21.15.82:0/2008704908 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560b1a8b0b90 0x560b1a8b0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:26.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.755+0000 7fe5b27fc700 1 -- 172.21.15.82:0/2008704908 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560b1a8b0b90 msgr2=0x560b1a8b0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:05:26.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.755+0000 7fe5b27fc700 1 --2- 172.21.15.82:0/2008704908 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560b1a8b0b90 0x560b1a8b0f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:26.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.756+0000 7fe5b27fc700 1 -- 172.21.15.82:0/2008704908 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b1a8ab450 msgr2=0x560b1a8ab8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:05:26.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.756+0000 7fe5b27fc700 1 --2- 172.21.15.82:0/2008704908 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b1a8ab450 0x560b1a8ab8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:26.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.756+0000 7fe5b27fc700 1 -- 172.21.15.82:0/2008704908 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560b1a674630 con 0x560b1a8b14b0 2023-09-23T09:05:26.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.756+0000 7fe5b2ffd700 1 --2- 172.21.15.82:0/2008704908 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560b1a8b0b90 0x560b1a8b0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:05:26.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.756+0000 7fe5b37fe700 1 --2- 172.21.15.82:0/1929942805 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fe59c0a00c0 0x7fe59c0a2580 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe5ac009ec0 tx=0x7fe5ac00e780 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:05:26.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.756+0000 7fe5b27fc700 1 --2- 172.21.15.82:0/2008704908 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560b1a8b14b0 0x560b1a8aaf10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe5a8009d10 tx=0x7fe5a8011720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=285306e4a4879836 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:05:26.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.756+0000 7fe5997fa700 1 -- 172.21.15.82:0/2008704908 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a8019630 con 0x560b1a8b14b0 2023-09-23T09:05:26.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.756+0000 7fe5997fa700 1 -- 172.21.15.82:0/2008704908 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe5a8019c20 con 0x560b1a8b14b0 2023-09-23T09:05:26.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.756+0000 7fe5997fa700 1 -- 172.21.15.82:0/2008704908 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a800ea20 con 0x560b1a8b14b0 2023-09-23T09:05:26.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.757+0000 7fe5cd0b5b80 1 -- 172.21.15.82:0/2008704908 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560b1a8b14b0 msgr2=0x560b1a8aaf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:05:26.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.757+0000 7fe5cd0b5b80 1 --2- 172.21.15.82:0/2008704908 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560b1a8b14b0 0x560b1a8aaf10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe5a8009d10 tx=0x7fe5a8011720 comp rx=0 tx=0).stop 2023-09-23T09:05:26.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.758+0000 7fe5cd0b5b80 1 -- 172.21.15.82:0/2008704908 shutdown_connections 2023-09-23T09:05:26.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.758+0000 7fe5cd0b5b80 1 --2- 172.21.15.82:0/2008704908 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b1a8ab450 0x560b1a8ab8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:26.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.758+0000 7fe5cd0b5b80 1 --2- 172.21.15.82:0/2008704908 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560b1a8b0b90 0x560b1a8b0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:26.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.758+0000 7fe5cd0b5b80 1 --2- 172.21.15.82:0/2008704908 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560b1a8b14b0 0x560b1a8aaf10 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:26.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.758+0000 7fe5cd0b5b80 1 -- 172.21.15.82:0/2008704908 >> 172.21.15.82:0/2008704908 conn(0x560b1a8170e0 msgr2=0x560b1a89d410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:05:26.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.758+0000 7fe5cd0b5b80 1 -- 172.21.15.82:0/2008704908 shutdown_connections 2023-09-23T09:05:26.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.758+0000 7fe5cd0b5b80 1 -- 172.21.15.82:0/2008704908 wait complete. 2023-09-23T09:05:26.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.758+0000 7fe5cd0b5b80 1 -- start start 2023-09-23T09:05:26.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.759+0000 7fe5cd0b5b80 1 Processor -- start 2023-09-23T09:05:26.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.760+0000 7fe5cd0b5b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560b1a8ab450 0x560b1a8b7490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:26.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.760+0000 7fe5cd0b5b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b1a8b0b90 0x560b1a8b4710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:26.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.760+0000 7fe5cd0b5b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560b1a8b14b0 0x560b1a8b4e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:26.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.760+0000 7fe5cd0b5b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b1a7f4990 con 0x560b1a8b0b90 2023-09-23T09:05:26.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.760+0000 7fe5cd0b5b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b1a792bb0 con 0x560b1a8ab450 2023-09-23T09:05:26.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.760+0000 7fe5cd0b5b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b1a7928b0 con 0x560b1a8b14b0 2023-09-23T09:05:26.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.760+0000 7fe5cd0b5b80 10 client.0 _ll_register_callbacks cb 0x560b1a6dca80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:05:26.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.760+0000 7fe5b2ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560b1a8ab450 0x560b1a8b7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:26.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.760+0000 7fe5b2ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560b1a8ab450 0x560b1a8b7490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:57244/0 (socket says 172.21.15.82:57244) 2023-09-23T09:05:26.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.760+0000 7fe5b2ffd700 1 -- 172.21.15.82:0/3587269750 learned_addr learned my addr 172.21.15.82:0/3587269750 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:05:26.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.760+0000 7fe5b27fc700 1 --2- 172.21.15.82:0/3587269750 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b1a8b0b90 0x560b1a8b4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:26.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.760+0000 7fe5b2ffd700 1 -- 172.21.15.82:0/3587269750 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560b1a8b14b0 msgr2=0x560b1a8b4e00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-23T09:05:26.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.760+0000 7fe5b37fe700 1 --2- 172.21.15.82:0/3587269750 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560b1a8b14b0 0x560b1a8b4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:26.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.760+0000 7fe5b2ffd700 1 --2- 172.21.15.82:0/3587269750 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560b1a8b14b0 0x560b1a8b4e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:26.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.760+0000 7fe5b2ffd700 1 -- 172.21.15.82:0/3587269750 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b1a8b0b90 msgr2=0x560b1a8b4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:05:26.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.760+0000 7fe5b2ffd700 1 --2- 172.21.15.82:0/3587269750 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b1a8b0b90 0x560b1a8b4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:26.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.761+0000 7fe5b2ffd700 1 -- 172.21.15.82:0/3587269750 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5a8009970 con 0x560b1a8ab450 2023-09-23T09:05:26.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.761+0000 7fe5b27fc700 1 --2- 172.21.15.82:0/3587269750 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b1a8b0b90 0x560b1a8b4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:05:26.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.761+0000 7fe5b37fe700 1 --2- 172.21.15.82:0/3587269750 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560b1a8b14b0 0x560b1a8b4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T09:05:26.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.761+0000 7fe5b2ffd700 1 --2- 172.21.15.82:0/3587269750 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560b1a8ab450 0x560b1a8b7490 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe5a40ca1d0 tx=0x7fe5a4099f00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e9af15f024eb9b0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:05:26.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.761+0000 7fe596ff5700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-09-23T09:05:26.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.761+0000 7fe596ff5700 1 -- 172.21.15.82:0/3587269750 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a40b1070 con 0x560b1a8ab450 2023-09-23T09:05:26.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.761+0000 7fe5cd0b5b80 1 -- 172.21.15.82:0/3587269750 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560b1a8721c0 con 0x560b1a8ab450 2023-09-23T09:05:26.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.761+0000 7fe596ff5700 1 -- 172.21.15.82:0/3587269750 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fe5a409a990 con 0x560b1a8ab450 2023-09-23T09:05:26.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.761+0000 7fe596ff5700 1 -- 172.21.15.82:0/3587269750 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe5a4094ea0 con 0x560b1a8ab450 2023-09-23T09:05:26.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.761+0000 7fe5cd0b5b80 10 client.25874 fetch_fsmap learned FSMap version 52 2023-09-23T09:05:26.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.761+0000 7fe5cd0b5b80 1 -- 172.21.15.82:0/3587269750 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) v3 -- 0x560b1a620de0 con 0x560b1a8ab450 2023-09-23T09:05:26.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.762+0000 7fe596ff5700 1 -- 172.21.15.82:0/3587269750 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe5a4064080 con 0x560b1a8ab450 2023-09-23T09:05:26.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.762+0000 7fe596ff5700 1 -- 172.21.15.82:0/3587269750 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 52) v1 ==== 7914+0+0 (secure 0 0 0) 0x7fe5a40b2260 con 0x560b1a8ab450 2023-09-23T09:05:26.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.762+0000 7fe5cd0b5b80 10 client.25874 fetch_fsmap finished waiting for FSMap version 52 2023-09-23T09:05:26.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.762+0000 7fe5cd0b5b80 10 client.25874 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:05:26.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.762+0000 7fe5cd0b5b80 20 client.25874 populate_metadata read hostname 'smithi082' 2023-09-23T09:05:26.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.762+0000 7fe5cd0b5b80 1 --2- 172.21.15.82:0/3587269750 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x560b1a8c4ab0 0x560b1a8c6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:26.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.762+0000 7fe5cd0b5b80 4 client.25874 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:05:26.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.762+0000 7fe5cd0b5b80 1 -- 172.21.15.82:0/3587269750 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560b1a79aba0 con 0x560b1a8c4ab0 2023-09-23T09:05:26.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.762+0000 7fe5b27fc700 1 --2- 172.21.15.82:0/3587269750 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x560b1a8c4ab0 0x560b1a8c6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:26.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.763+0000 7fe5b27fc700 1 --2- 172.21.15.82:0/3587269750 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x560b1a8c4ab0 0x560b1a8c6ea0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d389acd71941649f server_cookie=ad39af2e1753ec2c in_seq=0 out_seq=0 2023-09-23T09:05:26.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.763+0000 7fe596ff5700 10 client.25874 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:05:26.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.764+0000 7fe596ff5700 1 -- 172.21.15.82:0/3587269750 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x560b1a79aba0 con 0x560b1a8c4ab0 2023-09-23T09:05:26.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.764+0000 7fe596ff5700 10 client.25874 handle_command_reply: tid=0 2023-09-23T09:05:26.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.764+0000 7fe5cd0b5b80 1 client.25874 shutdown 2023-09-23T09:05:26.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.764+0000 7fe5cd0b5b80 1 -- 172.21.15.82:0/3587269750 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560b1a8ab450 msgr2=0x560b1a8b7490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:05:26.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.764+0000 7fe5cd0b5b80 1 --2- 172.21.15.82:0/3587269750 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560b1a8ab450 0x560b1a8b7490 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe5a40ca1d0 tx=0x7fe5a4099f00 comp rx=0 tx=0).stop 2023-09-23T09:05:26.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.765+0000 7fe5cd0b5b80 1 -- 172.21.15.82:0/3587269750 shutdown_connections 2023-09-23T09:05:26.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.765+0000 7fe5cd0b5b80 1 --2- 172.21.15.82:0/3587269750 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560b1a8b14b0 0x560b1a8b4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:26.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.765+0000 7fe5cd0b5b80 1 --2- 172.21.15.82:0/3587269750 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560b1a8ab450 0x560b1a8b7490 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:26.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.765+0000 7fe5cd0b5b80 1 --2- 172.21.15.82:0/3587269750 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x560b1a8c4ab0 0x560b1a8c6ea0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:26.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.765+0000 7fe5cd0b5b80 1 --2- 172.21.15.82:0/3587269750 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b1a8b0b90 0x560b1a8b4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:26.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.765+0000 7fe5cd0b5b80 1 -- 172.21.15.82:0/3587269750 >> 172.21.15.82:0/3587269750 conn(0x560b1a8170e0 msgr2=0x560b1a897b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:05:26.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.765+0000 7fe596ff5700 0 client.25874 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:05:26.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.765+0000 7fe5cd0b5b80 1 -- 172.21.15.82:0/3587269750 shutdown_connections 2023-09-23T09:05:26.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.765+0000 7fe5cd0b5b80 1 -- 172.21.15.82:0/3587269750 wait complete. 2023-09-23T09:05:26.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.765+0000 7fe5cd0b5b80 20 client.25874 trim_cache size 0 max 16384 2023-09-23T09:05:26.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.790+0000 7fe5cd0b5b80 1 Processor -- start 2023-09-23T09:05:26.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.790+0000 7fe5cd0b5b80 1 -- start start 2023-09-23T09:05:26.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.790+0000 7fe5cd0b5b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560b1a8ab450 0x560b1a8aaf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:26.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.790+0000 7fe5cd0b5b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560b1a8b0b90 0x560b1a8b6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:26.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.790+0000 7fe5cd0b5b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b1a8b14b0 0x560b1a8ae8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:26.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.790+0000 7fe5cd0b5b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b1a676920 con 0x560b1a8b14b0 2023-09-23T09:05:26.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.790+0000 7fe5cd0b5b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b1a8af410 con 0x560b1a8ab450 2023-09-23T09:05:26.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.790+0000 7fe5cd0b5b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b1a8c0e10 con 0x560b1a8b0b90 2023-09-23T09:05:26.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.791+0000 7fe5b2ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560b1a8ab450 0x560b1a8aaf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:26.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.791+0000 7fe5b27fc700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560b1a8b0b90 0x560b1a8b6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:26.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.791+0000 7fe5b37fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b1a8b14b0 0x560b1a8ae8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:26.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.791+0000 7fe5b27fc700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560b1a8b0b90 0x560b1a8b6fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:55870/0 (socket says 172.21.15.82:55870) 2023-09-23T09:05:26.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.791+0000 7fe5b27fc700 1 -- 172.21.15.82:0/4112788664 learned_addr learned my addr 172.21.15.82:0/4112788664 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:05:26.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.791+0000 7fe5b2ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560b1a8ab450 0x560b1a8aaf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:57256/0 (socket says 172.21.15.82:57256) 2023-09-23T09:05:26.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.791+0000 7fe5b2ffd700 1 -- 172.21.15.82:0/4112788664 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560b1a8b0b90 msgr2=0x560b1a8b6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:05:26.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.791+0000 7fe5b2ffd700 1 --2- 172.21.15.82:0/4112788664 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560b1a8b0b90 0x560b1a8b6fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:26.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.791+0000 7fe5b2ffd700 1 -- 172.21.15.82:0/4112788664 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b1a8b14b0 msgr2=0x560b1a8ae8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:05:26.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.791+0000 7fe5b2ffd700 1 --2- 172.21.15.82:0/4112788664 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b1a8b14b0 0x560b1a8ae8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:26.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.791+0000 7fe5b2ffd700 1 -- 172.21.15.82:0/4112788664 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560b1a609c60 con 0x560b1a8ab450 2023-09-23T09:05:26.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.791+0000 7fe5b27fc700 1 --2- 172.21.15.82:0/4112788664 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560b1a8b0b90 0x560b1a8b6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:05:26.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.792+0000 7fe5b2ffd700 1 --2- 172.21.15.82:0/4112788664 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560b1a8ab450 0x560b1a8aaf10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe5a40985e0 tx=0x7fe5a4009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2759a8c141463673 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:05:26.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.792+0000 7fe599ffb700 1 -- 172.21.15.82:0/4112788664 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a40b1070 con 0x560b1a8ab450 2023-09-23T09:05:26.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.792+0000 7fe599ffb700 1 -- 172.21.15.82:0/4112788664 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x560b1a8721c0 con 0x560b1a8ab450 2023-09-23T09:05:26.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.792+0000 7fe599ffb700 1 -- 172.21.15.82:0/4112788664 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a4094ea0 con 0x560b1a8ab450 2023-09-23T09:05:26.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.792+0000 7fe5cd0b5b80 1 -- 172.21.15.82:0/4112788664 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560b1a8ab450 msgr2=0x560b1a8aaf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:05:26.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.792+0000 7fe5cd0b5b80 1 --2- 172.21.15.82:0/4112788664 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560b1a8ab450 0x560b1a8aaf10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe5a40985e0 tx=0x7fe5a4009ca0 comp rx=0 tx=0).stop 2023-09-23T09:05:26.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.793+0000 7fe5cd0b5b80 1 -- 172.21.15.82:0/4112788664 shutdown_connections 2023-09-23T09:05:26.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.793+0000 7fe5cd0b5b80 1 --2- 172.21.15.82:0/4112788664 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b1a8b14b0 0x560b1a8ae8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:26.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.793+0000 7fe5cd0b5b80 1 --2- 172.21.15.82:0/4112788664 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560b1a8ab450 0x560b1a8aaf10 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:26.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.793+0000 7fe5cd0b5b80 1 --2- 172.21.15.82:0/4112788664 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560b1a8b0b90 0x560b1a8b6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:26.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.793+0000 7fe5cd0b5b80 1 -- 172.21.15.82:0/4112788664 >> 172.21.15.82:0/4112788664 conn(0x560b1a8170e0 msgr2=0x560b1a8c0700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:05:26.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.793+0000 7fe5cd0b5b80 1 -- 172.21.15.82:0/4112788664 shutdown_connections 2023-09-23T09:05:26.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.793+0000 7fe5cd0b5b80 1 -- 172.21.15.82:0/4112788664 wait complete. 2023-09-23T09:05:26.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.793+0000 7fe5cd0b5b80 1 -- start start 2023-09-23T09:05:26.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.793+0000 7fe5cd0b5b80 1 Processor -- start 2023-09-23T09:05:26.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.794+0000 7fe5cd0b5b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560b1a8ab450 0x560b1a8bbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:26.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.794+0000 7fe5cd0b5b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560b1a8b0b90 0x560b1a8aca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:26.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.794+0000 7fe5cd0b5b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b1a8b14b0 0x560b1a8acf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:26.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.794+0000 7fe5cd0b5b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b1a8ad6a0 con 0x560b1a8b14b0 2023-09-23T09:05:26.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.794+0000 7fe5cd0b5b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b1a8ad810 con 0x560b1a8b0b90 2023-09-23T09:05:26.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.794+0000 7fe5cd0b5b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b1a9188b0 con 0x560b1a8ab450 2023-09-23T09:05:26.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.794+0000 7fe5cd0b5b80 10 client.0 _ll_register_callbacks cb 0x7fe5a40966a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:05:26.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.794+0000 7fe5b2ffd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560b1a8ab450 0x560b1a8bbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:26.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.794+0000 7fe5b2ffd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560b1a8ab450 0x560b1a8bbfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:55876/0 (socket says 172.21.15.82:55876) 2023-09-23T09:05:26.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.794+0000 7fe5b2ffd700 1 -- 172.21.15.82:0/2823907257 learned_addr learned my addr 172.21.15.82:0/2823907257 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:05:26.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.794+0000 7fe5b37fe700 1 --2- 172.21.15.82:0/2823907257 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b1a8b14b0 0x560b1a8acf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:26.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.794+0000 7fe5b27fc700 1 --2- 172.21.15.82:0/2823907257 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560b1a8b0b90 0x560b1a8aca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:26.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.795+0000 7fe5b2ffd700 1 -- 172.21.15.82:0/2823907257 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560b1a8b0b90 msgr2=0x560b1a8aca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:05:26.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.795+0000 7fe5b2ffd700 1 --2- 172.21.15.82:0/2823907257 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560b1a8b0b90 0x560b1a8aca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:26.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.795+0000 7fe5b2ffd700 1 -- 172.21.15.82:0/2823907257 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b1a8b14b0 msgr2=0x560b1a8acf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:05:26.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.795+0000 7fe5b2ffd700 1 --2- 172.21.15.82:0/2823907257 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b1a8b14b0 0x560b1a8acf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:26.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.795+0000 7fe5b2ffd700 1 -- 172.21.15.82:0/2823907257 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560b1a674630 con 0x560b1a8ab450 2023-09-23T09:05:26.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.795+0000 7fe5b37fe700 1 --2- 172.21.15.82:0/2823907257 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b1a8b14b0 0x560b1a8acf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:05:26.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.795+0000 7fe5b2ffd700 1 --2- 172.21.15.82:0/2823907257 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560b1a8ab450 0x560b1a8bbfb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe5a409a220 tx=0x7fe5a40962b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e24e957ba13ec6c server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:05:26.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.795+0000 7fe596ff5700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T09:05:26.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.795+0000 7fe596ff5700 1 -- 172.21.15.82:0/2823907257 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a4094ea0 con 0x560b1a8ab450 2023-09-23T09:05:26.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.795+0000 7fe596ff5700 1 -- 172.21.15.82:0/2823907257 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fe5a409a990 con 0x560b1a8ab450 2023-09-23T09:05:26.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.795+0000 7fe5cd0b5b80 1 -- 172.21.15.82:0/2823907257 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560b1a8958b0 con 0x560b1a8ab450 2023-09-23T09:05:26.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.796+0000 7fe596ff5700 1 -- 172.21.15.82:0/2823907257 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe5a40b1040 con 0x560b1a8ab450 2023-09-23T09:05:26.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.796+0000 7fe5cd0b5b80 10 client.25921 fetch_fsmap learned FSMap version 52 2023-09-23T09:05:26.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.796+0000 7fe5cd0b5b80 1 -- 172.21.15.82:0/2823907257 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) v3 -- 0x560b1a620de0 con 0x560b1a8ab450 2023-09-23T09:05:26.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.796+0000 7fe596ff5700 1 -- 172.21.15.82:0/2823907257 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x560b1a8958b0 con 0x560b1a8ab450 2023-09-23T09:05:26.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.796+0000 7fe596ff5700 1 -- 172.21.15.82:0/2823907257 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 52) v1 ==== 7914+0+0 (secure 0 0 0) 0x7fe5a40991f0 con 0x560b1a8ab450 2023-09-23T09:05:26.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.796+0000 7fe5cd0b5b80 10 client.25921 fetch_fsmap finished waiting for FSMap version 52 2023-09-23T09:05:26.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.796+0000 7fe5cd0b5b80 10 client.25921 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:05:26.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.796+0000 7fe5cd0b5b80 20 client.25921 populate_metadata read hostname 'smithi082' 2023-09-23T09:05:26.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.796+0000 7fe5cd0b5b80 1 --2- 172.21.15.82:0/2823907257 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x560b1a919a40 0x560b1a91be30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:26.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.796+0000 7fe5cd0b5b80 4 client.25921 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:05:26.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.796+0000 7fe5cd0b5b80 1 -- 172.21.15.82:0/2823907257 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x560b1a7ed970 con 0x560b1a919a40 2023-09-23T09:05:26.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.796+0000 7fe5b27fc700 1 --2- 172.21.15.82:0/2823907257 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x560b1a919a40 0x560b1a91be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:26.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.797+0000 7fe5b27fc700 1 --2- 172.21.15.82:0/2823907257 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x560b1a919a40 0x560b1a91be30 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=704b072eda5edc04 server_cookie=573cef296600be94 in_seq=0 out_seq=0 2023-09-23T09:05:26.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.797+0000 7fe596ff5700 10 client.25921 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:05:26.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.797+0000 7fe596ff5700 1 -- 172.21.15.82:0/2823907257 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x560b1a7ed970 con 0x560b1a919a40 2023-09-23T09:05:26.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.797+0000 7fe596ff5700 10 client.25921 handle_command_reply: tid=0 2023-09-23T09:05:26.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.797+0000 7fe5cd0b5b80 1 client.25921 shutdown 2023-09-23T09:05:26.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.797+0000 7fe5cd0b5b80 1 -- 172.21.15.82:0/2823907257 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560b1a8ab450 msgr2=0x560b1a8bbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:05:26.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.797+0000 7fe5cd0b5b80 1 --2- 172.21.15.82:0/2823907257 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560b1a8ab450 0x560b1a8bbfb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe5a409a220 tx=0x7fe5a40962b0 comp rx=0 tx=0).stop 2023-09-23T09:05:26.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.797+0000 7fe5cd0b5b80 1 -- 172.21.15.82:0/2823907257 shutdown_connections 2023-09-23T09:05:26.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.797+0000 7fe5cd0b5b80 1 --2- 172.21.15.82:0/2823907257 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x560b1a919a40 0x560b1a91be30 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:26.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.798+0000 7fe5cd0b5b80 1 --2- 172.21.15.82:0/2823907257 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b1a8b14b0 0x560b1a8acf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:26.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.798+0000 7fe5cd0b5b80 1 --2- 172.21.15.82:0/2823907257 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560b1a8ab450 0x560b1a8bbfb0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:26.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.798+0000 7fe5cd0b5b80 1 --2- 172.21.15.82:0/2823907257 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560b1a8b0b90 0x560b1a8aca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:26.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.798+0000 7fe5cd0b5b80 1 -- 172.21.15.82:0/2823907257 >> 172.21.15.82:0/2823907257 conn(0x560b1a8170e0 msgr2=0x560b1a8ae8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:05:26.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.798+0000 7fe596ff5700 0 client.25921 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:05:26.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.798+0000 7fe5cd0b5b80 1 -- 172.21.15.82:0/2823907257 shutdown_connections 2023-09-23T09:05:26.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.798+0000 7fe5cd0b5b80 1 -- 172.21.15.82:0/2823907257 wait complete. 2023-09-23T09:05:26.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.798+0000 7fe5cd0b5b80 20 client.25921 trim_cache size 0 max 16384 2023-09-23T09:05:26.805 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:05:26.805 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-23T09:05:26.805 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:05:26.805 INFO:teuthology.orchestra.run.smithi082.stdout: "6f0fe3a6-7212-425d-a0a6-f38e8b42ec13": { 2023-09-23T09:05:26.805 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:05:26.805 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "6f0fe3a6-7212-425d-a0a6-f38e8b42ec13", 2023-09-23T09:05:26.805 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:05:26.806 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:05:26.806 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:05:26.806 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:05:26.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.799+0000 7fe5b97ff700 1 -- 172.21.15.82:0/1929942805 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fe59c0a00c0 msgr2=0x7fe59c0a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:05:26.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.799+0000 7fe5b97ff700 1 --2- 172.21.15.82:0/1929942805 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fe59c0a00c0 0x7fe59c0a2580 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe5ac009ec0 tx=0x7fe5ac00e780 comp rx=0 tx=0).stop 2023-09-23T09:05:26.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.799+0000 7fe5b97ff700 1 -- 172.21.15.82:0/1929942805 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5b4101a30 msgr2=0x7fe5b419e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:05:26.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.799+0000 7fe5b97ff700 1 --2- 172.21.15.82:0/1929942805 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5b4101a30 0x7fe5b419e8f0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fe5a4000c00 tx=0x7fe5a4004730 comp rx=0 tx=0).stop 2023-09-23T09:05:26.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.799+0000 7fe5b97ff700 1 -- 172.21.15.82:0/1929942805 shutdown_connections 2023-09-23T09:05:26.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.799+0000 7fe5b97ff700 1 --2- 172.21.15.82:0/1929942805 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fe59c0a00c0 0x7fe59c0a2580 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:26.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.799+0000 7fe5b97ff700 1 --2- 172.21.15.82:0/1929942805 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe5b410ae50 0x7fe5b4198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:26.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.799+0000 7fe5b97ff700 1 --2- 172.21.15.82:0/1929942805 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5b4101a30 0x7fe5b419e8f0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:26.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.799+0000 7fe5b97ff700 1 --2- 172.21.15.82:0/1929942805 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe5b4102350 0x7fe5b419ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:26.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.799+0000 7fe5b97ff700 1 -- 172.21.15.82:0/1929942805 >> 172.21.15.82:0/1929942805 conn(0x7fe5b40fb270 msgr2=0x7fe5b40fd660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:05:26.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.799+0000 7fe5b97ff700 1 -- 172.21.15.82:0/1929942805 shutdown_connections 2023-09-23T09:05:26.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:26.799+0000 7fe5b97ff700 1 -- 172.21.15.82:0/1929942805 wait complete. 2023-09-23T09:05:26.819 INFO:tasks.cephfs.filesystem:scrub status for tag:6f0fe3a6-7212-425d-a0a6-f38e8b42ec13 - {'path': '/', 'tag': '6f0fe3a6-7212-425d-a0a6-f38e8b42ec13', 'options': 'recursive,force'} 2023-09-23T09:05:26.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:05:26 smithi082 ceph-mon[97694]: pgmap v263: 97 pgs: 97 active+clean; 8.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 28 MiB/s wr, 82 op/s 2023-09-23T09:05:27.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:05:26 smithi135 ceph-mon[99205]: pgmap v263: 97 pgs: 97 active+clean; 8.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 28 MiB/s wr, 82 op/s 2023-09-23T09:05:27.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:05:26 smithi161 ceph-mon[99580]: pgmap v263: 97 pgs: 97 active+clean; 8.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 28 MiB/s wr, 82 op/s 2023-09-23T09:05:27.474 INFO:teuthology.orchestra.run.smithi082.stderr:35200000 of 50000000 tuples (70%) done (elapsed 482.22 s, remaining 202.75 s) 2023-09-23T09:05:28.676 INFO:teuthology.orchestra.run.smithi082.stderr:35300000 of 50000000 tuples (70%) done (elapsed 483.42 s, remaining 201.31 s) 2023-09-23T09:05:29.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:05:28 smithi135 ceph-mon[99205]: pgmap v264: 97 pgs: 97 active+clean; 8.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 17 MiB/s wr, 59 op/s 2023-09-23T09:05:29.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:05:28 smithi082 ceph-mon[97694]: pgmap v264: 97 pgs: 97 active+clean; 8.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 17 MiB/s wr, 59 op/s 2023-09-23T09:05:29.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:05:28 smithi161 ceph-mon[99580]: pgmap v264: 97 pgs: 97 active+clean; 8.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 17 MiB/s wr, 59 op/s 2023-09-23T09:05:29.991 INFO:teuthology.orchestra.run.smithi082.stderr:35400000 of 50000000 tuples (70%) done (elapsed 484.73 s, remaining 199.92 s) 2023-09-23T09:05:31.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:05:30 smithi135 ceph-mon[99205]: pgmap v265: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 28 MiB/s wr, 102 op/s 2023-09-23T09:05:31.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:05:30 smithi082 ceph-mon[97694]: pgmap v265: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 28 MiB/s wr, 102 op/s 2023-09-23T09:05:31.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:05:30 smithi161 ceph-mon[99580]: pgmap v265: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 28 MiB/s wr, 102 op/s 2023-09-23T09:05:31.208 INFO:teuthology.orchestra.run.smithi082.stderr:35500000 of 50000000 tuples (71%) done (elapsed 485.95 s, remaining 198.49 s) 2023-09-23T09:05:32.442 INFO:teuthology.orchestra.run.smithi082.stderr:35600000 of 50000000 tuples (71%) done (elapsed 487.18 s, remaining 197.06 s) 2023-09-23T09:05:33.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:05:32 smithi135 ceph-mon[99205]: pgmap v266: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 24 MiB/s wr, 91 op/s 2023-09-23T09:05:33.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:05:32 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:05:33.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:05:32 smithi135 ceph-mon[99205]: scrub summary: active paths [/] 2023-09-23T09:05:33.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:05:32 smithi135 ceph-mon[99205]: scrub summary: idle+waiting paths [/] 2023-09-23T09:05:33.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:05:32 smithi135 ceph-mon[99205]: scrub summary: idle+waiting paths [/] 2023-09-23T09:05:33.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:05:32 smithi082 ceph-mon[97694]: pgmap v266: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 24 MiB/s wr, 91 op/s 2023-09-23T09:05:33.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:05:32 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:05:33.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:05:32 smithi082 ceph-mon[97694]: scrub summary: active paths [/] 2023-09-23T09:05:33.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:05:32 smithi082 ceph-mon[97694]: scrub summary: idle+waiting paths [/] 2023-09-23T09:05:33.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:05:32 smithi082 ceph-mon[97694]: scrub summary: idle+waiting paths [/] 2023-09-23T09:05:33.150 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:05:32 smithi161 ceph-mon[99580]: pgmap v266: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 24 MiB/s wr, 91 op/s 2023-09-23T09:05:33.150 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:05:32 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:05:33.150 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:05:32 smithi161 ceph-mon[99580]: scrub summary: active paths [/] 2023-09-23T09:05:33.150 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:05:32 smithi161 ceph-mon[99580]: scrub summary: idle+waiting paths [/] 2023-09-23T09:05:33.150 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:05:32 smithi161 ceph-mon[99580]: scrub summary: idle+waiting paths [/] 2023-09-23T09:05:33.806 INFO:teuthology.orchestra.run.smithi082.stderr:35700000 of 50000000 tuples (71%) done (elapsed 488.55 s, remaining 195.69 s) 2023-09-23T09:05:35.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:05:34 smithi135 ceph-mon[99205]: pgmap v267: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 23 MiB/s wr, 86 op/s 2023-09-23T09:05:35.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:05:34 smithi082 ceph-mon[97694]: pgmap v267: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 23 MiB/s wr, 86 op/s 2023-09-23T09:05:35.135 INFO:teuthology.orchestra.run.smithi082.stderr:35800000 of 50000000 tuples (71%) done (elapsed 489.88 s, remaining 194.31 s) 2023-09-23T09:05:35.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:05:34 smithi161 ceph-mon[99580]: pgmap v267: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 23 MiB/s wr, 86 op/s 2023-09-23T09:05:36.344 INFO:teuthology.orchestra.run.smithi082.stderr:35900000 of 50000000 tuples (71%) done (elapsed 491.09 s, remaining 192.88 s) 2023-09-23T09:05:37.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:05:36 smithi135 ceph-mon[99205]: pgmap v268: 97 pgs: 97 active+clean; 8.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 35 MiB/s wr, 121 op/s 2023-09-23T09:05:37.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:05:36 smithi082 ceph-mon[97694]: pgmap v268: 97 pgs: 97 active+clean; 8.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 35 MiB/s wr, 121 op/s 2023-09-23T09:05:37.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:05:36 smithi161 ceph-mon[99580]: pgmap v268: 97 pgs: 97 active+clean; 8.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 35 MiB/s wr, 121 op/s 2023-09-23T09:05:37.557 INFO:teuthology.orchestra.run.smithi082.stderr:36000000 of 50000000 tuples (72%) done (elapsed 492.30 s, remaining 191.45 s) 2023-09-23T09:05:38.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:05:37 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:05:38.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:05:37 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:05:38.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:05:37 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:05:38.868 INFO:teuthology.orchestra.run.smithi082.stderr:36100000 of 50000000 tuples (72%) done (elapsed 493.61 s, remaining 190.06 s) 2023-09-23T09:05:39.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:05:38 smithi135 ceph-mon[99205]: pgmap v269: 97 pgs: 97 active+clean; 8.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 23 MiB/s wr, 83 op/s 2023-09-23T09:05:39.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:05:38 smithi082 ceph-mon[97694]: pgmap v269: 97 pgs: 97 active+clean; 8.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 23 MiB/s wr, 83 op/s 2023-09-23T09:05:39.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:05:38 smithi161 ceph-mon[99580]: pgmap v269: 97 pgs: 97 active+clean; 8.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 23 MiB/s wr, 83 op/s 2023-09-23T09:05:40.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:05:39 smithi135 ceph-mon[99205]: pgmap v270: 97 pgs: 97 active+clean; 8.3 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 35 MiB/s wr, 120 op/s 2023-09-23T09:05:40.079 INFO:teuthology.orchestra.run.smithi082.stderr:36200000 of 50000000 tuples (72%) done (elapsed 494.82 s, remaining 188.63 s) 2023-09-23T09:05:40.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:05:39 smithi082 ceph-mon[97694]: pgmap v270: 97 pgs: 97 active+clean; 8.3 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 35 MiB/s wr, 120 op/s 2023-09-23T09:05:40.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:05:39 smithi161 ceph-mon[99580]: pgmap v270: 97 pgs: 97 active+clean; 8.3 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 35 MiB/s wr, 120 op/s 2023-09-23T09:05:41.279 INFO:teuthology.orchestra.run.smithi082.stderr:36300000 of 50000000 tuples (72%) done (elapsed 496.02 s, remaining 187.20 s) 2023-09-23T09:05:41.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:05:41 smithi135 ceph-mon[99205]: scrub summary: idle 2023-09-23T09:05:41.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:05:41 smithi082 ceph-mon[97694]: scrub summary: idle 2023-09-23T09:05:41.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:05:41 smithi161 ceph-mon[99580]: scrub summary: idle 2023-09-23T09:05:42.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:05:42 smithi135 ceph-mon[99205]: scrub summary: idle 2023-09-23T09:05:42.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:05:42 smithi135 ceph-mon[99205]: scrub summary: idle 2023-09-23T09:05:42.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:05:42 smithi135 ceph-mon[99205]: scrub summary: idle 2023-09-23T09:05:42.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:05:42 smithi135 ceph-mon[99205]: scrub summary: idle 2023-09-23T09:05:42.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:05:42 smithi135 ceph-mon[99205]: pgmap v271: 97 pgs: 97 active+clean; 8.3 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 24 MiB/s wr, 78 op/s 2023-09-23T09:05:42.593 INFO:teuthology.orchestra.run.smithi082.stderr:36400000 of 50000000 tuples (72%) done (elapsed 497.34 s, remaining 185.82 s) 2023-09-23T09:05:42.629 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:05:42 smithi082 ceph-mon[97694]: scrub summary: idle 2023-09-23T09:05:42.629 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:05:42 smithi082 ceph-mon[97694]: scrub summary: idle 2023-09-23T09:05:42.629 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:05:42 smithi082 ceph-mon[97694]: scrub summary: idle 2023-09-23T09:05:42.629 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:05:42 smithi082 ceph-mon[97694]: scrub summary: idle 2023-09-23T09:05:42.629 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:05:42 smithi082 ceph-mon[97694]: pgmap v271: 97 pgs: 97 active+clean; 8.3 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 24 MiB/s wr, 78 op/s 2023-09-23T09:05:42.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:05:42 smithi161 ceph-mon[99580]: scrub summary: idle 2023-09-23T09:05:42.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:05:42 smithi161 ceph-mon[99580]: scrub summary: idle 2023-09-23T09:05:42.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:05:42 smithi161 ceph-mon[99580]: scrub summary: idle 2023-09-23T09:05:42.650 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:05:42 smithi161 ceph-mon[99580]: scrub summary: idle 2023-09-23T09:05:42.650 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:05:42 smithi161 ceph-mon[99580]: pgmap v271: 97 pgs: 97 active+clean; 8.3 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 24 MiB/s wr, 78 op/s 2023-09-23T09:05:43.819 INFO:teuthology.orchestra.run.smithi082.stderr:36500000 of 50000000 tuples (73%) done (elapsed 498.56 s, remaining 184.40 s) 2023-09-23T09:05:44.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:05:44 smithi135 ceph-mon[99205]: pgmap v272: 97 pgs: 97 active+clean; 8.3 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 23 MiB/s wr, 72 op/s 2023-09-23T09:05:44.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:05:44 smithi082 ceph-mon[97694]: pgmap v272: 97 pgs: 97 active+clean; 8.3 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 23 MiB/s wr, 72 op/s 2023-09-23T09:05:44.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:05:44 smithi161 ceph-mon[99580]: pgmap v272: 97 pgs: 97 active+clean; 8.3 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 23 MiB/s wr, 72 op/s 2023-09-23T09:05:45.058 INFO:teuthology.orchestra.run.smithi082.stderr:36600000 of 50000000 tuples (73%) done (elapsed 499.80 s, remaining 182.99 s) 2023-09-23T09:05:46.315 INFO:teuthology.orchestra.run.smithi082.stderr:36700000 of 50000000 tuples (73%) done (elapsed 501.06 s, remaining 181.58 s) 2023-09-23T09:05:46.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:05:46 smithi135 ceph-mon[99205]: pgmap v273: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 36 MiB/s wr, 99 op/s 2023-09-23T09:05:46.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:05:46 smithi082 ceph-mon[97694]: pgmap v273: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 36 MiB/s wr, 99 op/s 2023-09-23T09:05:46.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:05:46 smithi161 ceph-mon[99580]: pgmap v273: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 36 MiB/s wr, 99 op/s 2023-09-23T09:05:47.893 INFO:teuthology.orchestra.run.smithi082.stderr:36800000 of 50000000 tuples (73%) done (elapsed 502.63 s, remaining 180.29 s) 2023-09-23T09:05:48.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:05:48 smithi082 ceph-mon[97694]: pgmap v274: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 MiB/s wr, 63 op/s 2023-09-23T09:05:48.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:05:48 smithi161 ceph-mon[99580]: pgmap v274: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 MiB/s wr, 63 op/s 2023-09-23T09:05:49.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:05:48 smithi135 ceph-mon[99205]: pgmap v274: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 MiB/s wr, 63 op/s 2023-09-23T09:05:49.065 INFO:teuthology.orchestra.run.smithi082.stderr:36900000 of 50000000 tuples (73%) done (elapsed 503.81 s, remaining 178.86 s) 2023-09-23T09:05:50.275 INFO:teuthology.orchestra.run.smithi082.stderr:37000000 of 50000000 tuples (74%) done (elapsed 505.02 s, remaining 177.44 s) 2023-09-23T09:05:50.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:05:50 smithi082 ceph-mon[97694]: pgmap v275: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 35 MiB/s wr, 90 op/s 2023-09-23T09:05:50.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:05:50 smithi161 ceph-mon[99580]: pgmap v275: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 35 MiB/s wr, 90 op/s 2023-09-23T09:05:51.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:05:50 smithi135 ceph-mon[99205]: pgmap v275: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 35 MiB/s wr, 90 op/s 2023-09-23T09:05:51.495 INFO:teuthology.orchestra.run.smithi082.stderr:37100000 of 50000000 tuples (74%) done (elapsed 506.24 s, remaining 176.02 s) 2023-09-23T09:05:52.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:05:52 smithi082 ceph-mon[97694]: pgmap v276: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 24 MiB/s wr, 57 op/s 2023-09-23T09:05:52.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:05:52 smithi161 ceph-mon[99580]: pgmap v276: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 24 MiB/s wr, 57 op/s 2023-09-23T09:05:53.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:05:52 smithi135 ceph-mon[99205]: pgmap v276: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 24 MiB/s wr, 57 op/s 2023-09-23T09:05:54.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:05:54 smithi082 ceph-mon[97694]: pgmap v277: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 24 MiB/s wr, 56 op/s 2023-09-23T09:05:54.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:05:54 smithi161 ceph-mon[99580]: pgmap v277: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 24 MiB/s wr, 56 op/s 2023-09-23T09:05:55.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:05:54 smithi135 ceph-mon[99205]: pgmap v277: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 24 MiB/s wr, 56 op/s 2023-09-23T09:05:56.820 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:05:56.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:05:56 smithi082 ceph-mon[97694]: pgmap v278: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 31 MiB/s wr, 146 op/s 2023-09-23T09:05:56.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:05:56 smithi161 ceph-mon[99580]: pgmap v278: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 31 MiB/s wr, 146 op/s 2023-09-23T09:05:57.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.056+0000 7fc5ecbff700 1 -- 172.21.15.82:0/1490798111 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5e8100870 msgr2=0x7fc5e8100cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:05:57.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.056+0000 7fc5ecbff700 1 --2- 172.21.15.82:0/1490798111 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5e8100870 0x7fc5e8100cf0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc009990 tx=0x7fc5dc009ca0 comp rx=0 tx=0).stop 2023-09-23T09:05:57.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.056+0000 7fc5ecbff700 1 -- 172.21.15.82:0/1490798111 shutdown_connections 2023-09-23T09:05:57.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.056+0000 7fc5ecbff700 1 --2- 172.21.15.82:0/1490798111 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5e8101230 0x7fc5e810d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:57.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.056+0000 7fc5ecbff700 1 --2- 172.21.15.82:0/1490798111 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc5e8106880 0x7fc5e8106c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:57.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.056+0000 7fc5ecbff700 1 --2- 172.21.15.82:0/1490798111 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5e8100870 0x7fc5e8100cf0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:57.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.056+0000 7fc5ecbff700 1 -- 172.21.15.82:0/1490798111 >> 172.21.15.82:0/1490798111 conn(0x7fc5e80fc3a0 msgr2=0x7fc5e80fe7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:05:57.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.056+0000 7fc5ecbff700 1 -- 172.21.15.82:0/1490798111 shutdown_connections 2023-09-23T09:05:57.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.056+0000 7fc5ecbff700 1 -- 172.21.15.82:0/1490798111 wait complete. 2023-09-23T09:05:57.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.057+0000 7fc5ecbff700 1 Processor -- start 2023-09-23T09:05:57.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.058+0000 7fc5ecbff700 1 -- start start 2023-09-23T09:05:57.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.058+0000 7fc5ecbff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5e8100870 0x7fc5e810c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:57.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.058+0000 7fc5ecbff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5e8101230 0x7fc5e810cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:57.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.058+0000 7fc5ecbff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc5e8106880 0x7fc5e81a1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:57.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.058+0000 7fc5ecbff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e81a1e50 con 0x7fc5e8101230 2023-09-23T09:05:57.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.058+0000 7fc5ecbff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e81a1fc0 con 0x7fc5e8100870 2023-09-23T09:05:57.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.058+0000 7fc5ecbff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e81a2180 con 0x7fc5e8106880 2023-09-23T09:05:57.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.058+0000 7fc5e5d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5e8101230 0x7fc5e810cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:57.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.058+0000 7fc5e659c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5e8100870 0x7fc5e810c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:57.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.058+0000 7fc5e5d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5e8101230 0x7fc5e810cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58700/0 (socket says 172.21.15.82:58700) 2023-09-23T09:05:57.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.058+0000 7fc5e5d9b700 1 -- 172.21.15.82:0/3127315969 learned_addr learned my addr 172.21.15.82:0/3127315969 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:05:57.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.058+0000 7fc5e6d9d700 1 --2- 172.21.15.82:0/3127315969 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc5e8106880 0x7fc5e81a1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:57.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.059+0000 7fc5e5d9b700 1 -- 172.21.15.82:0/3127315969 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc5e8106880 msgr2=0x7fc5e81a1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:05:57.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.059+0000 7fc5e5d9b700 1 --2- 172.21.15.82:0/3127315969 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc5e8106880 0x7fc5e81a1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:57.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.059+0000 7fc5e5d9b700 1 -- 172.21.15.82:0/3127315969 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5e8100870 msgr2=0x7fc5e810c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:05:57.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.059+0000 7fc5e5d9b700 1 --2- 172.21.15.82:0/3127315969 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5e8100870 0x7fc5e810c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:57.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.059+0000 7fc5e5d9b700 1 -- 172.21.15.82:0/3127315969 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5dc0095f0 con 0x7fc5e8101230 2023-09-23T09:05:57.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.059+0000 7fc5e5d9b700 1 --2- 172.21.15.82:0/3127315969 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5e8101230 0x7fc5e810cbe0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc005770 tx=0x7fc5dc0057a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:05:57.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.059+0000 7fc5d77fe700 1 -- 172.21.15.82:0/3127315969 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5dc01d070 con 0x7fc5e8101230 2023-09-23T09:05:57.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.059+0000 7fc5d77fe700 1 -- 172.21.15.82:0/3127315969 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc5dc021410 con 0x7fc5e8101230 2023-09-23T09:05:57.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.059+0000 7fc5ecbff700 1 -- 172.21.15.82:0/3127315969 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5e81a2460 con 0x7fc5e8101230 2023-09-23T09:05:57.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.059+0000 7fc5d77fe700 1 -- 172.21.15.82:0/3127315969 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5dc017650 con 0x7fc5e8101230 2023-09-23T09:05:57.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.059+0000 7fc5ecbff700 1 -- 172.21.15.82:0/3127315969 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5e81a9ca0 con 0x7fc5e8101230 2023-09-23T09:05:57.065 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:05:56 smithi135 ceph-mon[99205]: pgmap v278: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 31 MiB/s wr, 146 op/s 2023-09-23T09:05:57.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.063+0000 7fc5d77fe700 1 -- 172.21.15.82:0/3127315969 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7fc5dc0217f0 con 0x7fc5e8101230 2023-09-23T09:05:57.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.065+0000 7fc600486b80 1 Processor -- start 2023-09-23T09:05:57.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.065+0000 7fc600486b80 1 -- start start 2023-09-23T09:05:57.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.065+0000 7fc5d77fe700 1 --2- 172.21.15.82:0/3127315969 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fc5d00a00c0 0x7fc5d00a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:57.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.065+0000 7fc5d77fe700 1 -- 172.21.15.82:0/3127315969 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fc5dc0cca50 con 0x7fc5e8101230 2023-09-23T09:05:57.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.065+0000 7fc600486b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad9cfc8380 0x55ad9cfc8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:57.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.065+0000 7fc600486b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ad9cfc8ca0 0x55ad9cfc2700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:57.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.065+0000 7fc600486b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ad9cfc2c40 0x55ad9cfc30a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:57.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.065+0000 7fc600486b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad9cf2a7b0 con 0x55ad9cfc8ca0 2023-09-23T09:05:57.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.065+0000 7fc600486b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad9cf1b780 con 0x55ad9cfc8380 2023-09-23T09:05:57.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.065+0000 7fc600486b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad9cf190a0 con 0x55ad9cfc2c40 2023-09-23T09:05:57.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.066+0000 7fc5e6d9d700 1 --2- 172.21.15.82:0/3127315969 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fc5d00a00c0 0x7fc5d00a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:57.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.066+0000 7fc5e659c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad9cfc8380 0x55ad9cfc8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:57.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.066+0000 7fc5e659c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad9cfc8380 0x55ad9cfc8760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:60620/0 (socket says 172.21.15.82:60620) 2023-09-23T09:05:57.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.066+0000 7fc5e659c700 1 -- 172.21.15.82:0/3977760512 learned_addr learned my addr 172.21.15.82:0/3977760512 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:05:57.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.066+0000 7fc5e6d9d700 1 --2- 172.21.15.82:0/3977760512 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ad9cfc2c40 0x55ad9cfc30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:57.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.066+0000 7fc5e5d9b700 1 --2- 172.21.15.82:0/3977760512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ad9cfc8ca0 0x55ad9cfc2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:57.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.066+0000 7fc5e659c700 1 -- 172.21.15.82:0/3977760512 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ad9cfc2c40 msgr2=0x55ad9cfc30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:05:57.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.066+0000 7fc5e659c700 1 --2- 172.21.15.82:0/3977760512 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ad9cfc2c40 0x55ad9cfc30a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:57.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.066+0000 7fc5e659c700 1 -- 172.21.15.82:0/3977760512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ad9cfc8ca0 msgr2=0x55ad9cfc2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:05:57.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.066+0000 7fc5e659c700 1 --2- 172.21.15.82:0/3977760512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ad9cfc8ca0 0x55ad9cfc2700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:57.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.066+0000 7fc5e659c700 1 -- 172.21.15.82:0/3977760512 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ad9cd94630 con 0x55ad9cfc8380 2023-09-23T09:05:57.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.066+0000 7fc5e5d9b700 1 --2- 172.21.15.82:0/3977760512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ad9cfc8ca0 0x55ad9cfc2700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:05:57.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.067+0000 7fc5e6d9d700 1 --2- 172.21.15.82:0/3127315969 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fc5d00a00c0 0x7fc5d00a2580 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc5e0009ec0 tx=0x7fc5e00134a0 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:05:57.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.067+0000 7fc5e659c700 1 --2- 172.21.15.82:0/3977760512 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad9cfc8380 0x55ad9cfc8760 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc5d8009d00 tx=0x7fc5d8011720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22ccd7c8e1a5f5f server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:05:57.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.067+0000 7fc5d4ff9700 1 -- 172.21.15.82:0/3977760512 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d8019630 con 0x55ad9cfc8380 2023-09-23T09:05:57.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.067+0000 7fc5d4ff9700 1 -- 172.21.15.82:0/3977760512 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc5d8019c20 con 0x55ad9cfc8380 2023-09-23T09:05:57.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.067+0000 7fc5d4ff9700 1 -- 172.21.15.82:0/3977760512 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d800ea50 con 0x55ad9cfc8380 2023-09-23T09:05:57.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.068+0000 7fc600486b80 1 -- 172.21.15.82:0/3977760512 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad9cfc8380 msgr2=0x55ad9cfc8760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:05:57.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.068+0000 7fc600486b80 1 --2- 172.21.15.82:0/3977760512 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad9cfc8380 0x55ad9cfc8760 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc5d8009d00 tx=0x7fc5d8011720 comp rx=0 tx=0).stop 2023-09-23T09:05:57.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.068+0000 7fc600486b80 1 -- 172.21.15.82:0/3977760512 shutdown_connections 2023-09-23T09:05:57.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.068+0000 7fc600486b80 1 --2- 172.21.15.82:0/3977760512 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ad9cfc2c40 0x55ad9cfc30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:57.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.068+0000 7fc600486b80 1 --2- 172.21.15.82:0/3977760512 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad9cfc8380 0x55ad9cfc8760 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:57.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.068+0000 7fc600486b80 1 --2- 172.21.15.82:0/3977760512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ad9cfc8ca0 0x55ad9cfc2700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:57.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.068+0000 7fc600486b80 1 -- 172.21.15.82:0/3977760512 >> 172.21.15.82:0/3977760512 conn(0x55ad9cf370e0 msgr2=0x55ad9cfbd410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:05:57.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.068+0000 7fc600486b80 1 -- 172.21.15.82:0/3977760512 shutdown_connections 2023-09-23T09:05:57.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.068+0000 7fc600486b80 1 -- 172.21.15.82:0/3977760512 wait complete. 2023-09-23T09:05:57.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.069+0000 7fc600486b80 1 -- start start 2023-09-23T09:05:57.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.069+0000 7fc600486b80 1 Processor -- start 2023-09-23T09:05:57.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.070+0000 7fc600486b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ad9cfc2c40 0x55ad9cfcec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:57.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.070+0000 7fc600486b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad9cfc8380 0x55ad9cfcbec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:57.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.070+0000 7fc600486b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ad9cfc8ca0 0x55ad9cfcc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:57.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.070+0000 7fc600486b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad9cf14990 con 0x55ad9cfc2c40 2023-09-23T09:05:57.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.070+0000 7fc600486b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad9ceb2bb0 con 0x55ad9cfc8380 2023-09-23T09:05:57.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.070+0000 7fc600486b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad9ceb28b0 con 0x55ad9cfc8ca0 2023-09-23T09:05:57.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.070+0000 7fc600486b80 10 client.0 _ll_register_callbacks cb 0x55ad9cdfca80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:05:57.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.070+0000 7fc5e659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ad9cfc2c40 0x55ad9cfcec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:57.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.070+0000 7fc5e5d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad9cfc8380 0x55ad9cfcbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:57.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.070+0000 7fc5e5d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad9cfc8380 0x55ad9cfcbec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:60628/0 (socket says 172.21.15.82:60628) 2023-09-23T09:05:57.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.070+0000 7fc5e5d9b700 1 -- 172.21.15.82:0/3150689413 learned_addr learned my addr 172.21.15.82:0/3150689413 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:05:57.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.070+0000 7fc5e6d9d700 1 --2- 172.21.15.82:0/3150689413 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ad9cfc8ca0 0x55ad9cfcc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:57.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.070+0000 7fc5e5d9b700 1 -- 172.21.15.82:0/3150689413 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ad9cfc8ca0 msgr2=0x55ad9cfcc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:05:57.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.070+0000 7fc5e5d9b700 1 --2- 172.21.15.82:0/3150689413 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ad9cfc8ca0 0x55ad9cfcc600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:57.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.070+0000 7fc5e5d9b700 1 -- 172.21.15.82:0/3150689413 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ad9cfc2c40 msgr2=0x55ad9cfcec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:05:57.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.070+0000 7fc5e5d9b700 1 --2- 172.21.15.82:0/3150689413 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ad9cfc2c40 0x55ad9cfcec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:57.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.070+0000 7fc5e5d9b700 1 -- 172.21.15.82:0/3150689413 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5e81a9ca0 con 0x55ad9cfc8380 2023-09-23T09:05:57.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.070+0000 7fc5e6d9d700 1 --2- 172.21.15.82:0/3150689413 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ad9cfc8ca0 0x55ad9cfcc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T09:05:57.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.071+0000 7fc5e5d9b700 1 --2- 172.21.15.82:0/3150689413 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad9cfc8380 0x55ad9cfcbec0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc09a120 tx=0x7fc5dc09a070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ea7c24814ea5817 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:05:57.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.071+0000 7fc5cdffb700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-09-23T09:05:57.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.071+0000 7fc5cdffb700 1 -- 172.21.15.82:0/3150689413 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5dc0b1070 con 0x55ad9cfc8380 2023-09-23T09:05:57.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.071+0000 7fc600486b80 1 -- 172.21.15.82:0/3150689413 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ad9cf921c0 con 0x55ad9cfc8380 2023-09-23T09:05:57.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.071+0000 7fc5cdffb700 1 -- 172.21.15.82:0/3150689413 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fc5dc09dfc0 con 0x55ad9cfc8380 2023-09-23T09:05:57.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.071+0000 7fc5cdffb700 1 -- 172.21.15.82:0/3150689413 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc5dc0a1f10 con 0x55ad9cfc8380 2023-09-23T09:05:57.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.071+0000 7fc600486b80 10 client.25892 fetch_fsmap learned FSMap version 54 2023-09-23T09:05:57.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.071+0000 7fc600486b80 1 -- 172.21.15.82:0/3150689413 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) v3 -- 0x7fc5d8009960 con 0x55ad9cfc8380 2023-09-23T09:05:57.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.072+0000 7fc5cdffb700 1 -- 172.21.15.82:0/3150689413 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc5dc064020 con 0x55ad9cfc8380 2023-09-23T09:05:57.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.072+0000 7fc5cdffb700 1 -- 172.21.15.82:0/3150689413 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 54) v1 ==== 7930+0+0 (secure 0 0 0) 0x7fc5dc0a1a80 con 0x55ad9cfc8380 2023-09-23T09:05:57.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.072+0000 7fc600486b80 10 client.25892 fetch_fsmap finished waiting for FSMap version 54 2023-09-23T09:05:57.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.072+0000 7fc600486b80 10 client.25892 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:05:57.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.072+0000 7fc600486b80 20 client.25892 populate_metadata read hostname 'smithi082' 2023-09-23T09:05:57.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.072+0000 7fc600486b80 1 --2- 172.21.15.82:0/3150689413 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55ad9cfdc480 0x55ad9cfde8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:57.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.072+0000 7fc600486b80 4 client.25892 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:05:57.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.072+0000 7fc600486b80 1 -- 172.21.15.82:0/3150689413 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ad9cebaba0 con 0x55ad9cfdc480 2023-09-23T09:05:57.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.073+0000 7fc5e659c700 1 --2- 172.21.15.82:0/3150689413 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55ad9cfdc480 0x55ad9cfde8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:57.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.073+0000 7fc5cdffb700 10 client.25892 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:05:57.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.073+0000 7fc5e659c700 1 --2- 172.21.15.82:0/3150689413 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55ad9cfdc480 0x55ad9cfde8a0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d764e665e51438ea server_cookie=ad5b5826da862f49 in_seq=0 out_seq=0 2023-09-23T09:05:57.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.075+0000 7fc5cdffb700 1 -- 172.21.15.82:0/3150689413 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55ad9cebaba0 con 0x55ad9cfdc480 2023-09-23T09:05:57.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.075+0000 7fc5cdffb700 10 client.25892 handle_command_reply: tid=0 2023-09-23T09:05:57.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.075+0000 7fc600486b80 1 client.25892 shutdown 2023-09-23T09:05:57.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.075+0000 7fc600486b80 1 -- 172.21.15.82:0/3150689413 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad9cfc8380 msgr2=0x55ad9cfcbec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:05:57.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.075+0000 7fc600486b80 1 --2- 172.21.15.82:0/3150689413 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad9cfc8380 0x55ad9cfcbec0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc09a120 tx=0x7fc5dc09a070 comp rx=0 tx=0).stop 2023-09-23T09:05:57.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.075+0000 7fc600486b80 1 -- 172.21.15.82:0/3150689413 shutdown_connections 2023-09-23T09:05:57.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.075+0000 7fc600486b80 1 --2- 172.21.15.82:0/3150689413 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ad9cfc8ca0 0x55ad9cfcc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:57.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.075+0000 7fc600486b80 1 --2- 172.21.15.82:0/3150689413 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55ad9cfdc480 0x55ad9cfde8a0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:57.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.075+0000 7fc600486b80 1 --2- 172.21.15.82:0/3150689413 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ad9cfc2c40 0x55ad9cfcec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:57.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.075+0000 7fc600486b80 1 --2- 172.21.15.82:0/3150689413 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad9cfc8380 0x55ad9cfcbec0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:57.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.075+0000 7fc5cdffb700 0 client.25892 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:05:57.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.075+0000 7fc600486b80 1 -- 172.21.15.82:0/3150689413 >> 172.21.15.82:0/3150689413 conn(0x55ad9cf370e0 msgr2=0x55ad9cfb7b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:05:57.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.075+0000 7fc600486b80 1 -- 172.21.15.82:0/3150689413 shutdown_connections 2023-09-23T09:05:57.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.075+0000 7fc600486b80 1 -- 172.21.15.82:0/3150689413 wait complete. 2023-09-23T09:05:57.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.076+0000 7fc600486b80 20 client.25892 trim_cache size 0 max 16384 2023-09-23T09:05:57.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.099+0000 7fc600486b80 1 Processor -- start 2023-09-23T09:05:57.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.099+0000 7fc600486b80 1 -- start start 2023-09-23T09:05:57.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.099+0000 7fc600486b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ad9cfc2c40 0x55ad9cfc7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:57.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.099+0000 7fc600486b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad9cfc8380 0x55ad9cfce7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:57.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.099+0000 7fc600486b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ad9cfc8ca0 0x55ad9cfcb680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:57.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.099+0000 7fc600486b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad9cfd9140 con 0x55ad9cfc8ca0 2023-09-23T09:05:57.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.099+0000 7fc600486b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad9cd96920 con 0x55ad9cfc8380 2023-09-23T09:05:57.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.099+0000 7fc600486b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad9cfb5770 con 0x55ad9cfc2c40 2023-09-23T09:05:57.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.099+0000 7fc5e6d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ad9cfc8ca0 0x55ad9cfcb680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:57.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.099+0000 7fc5e5d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad9cfc8380 0x55ad9cfce7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:57.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.100+0000 7fc5e5d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad9cfc8380 0x55ad9cfce7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:60632/0 (socket says 172.21.15.82:60632) 2023-09-23T09:05:57.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.100+0000 7fc5e5d9b700 1 -- 172.21.15.82:0/1529578040 learned_addr learned my addr 172.21.15.82:0/1529578040 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:05:57.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.100+0000 7fc5e659c700 1 --2- 172.21.15.82:0/1529578040 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ad9cfc2c40 0x55ad9cfc7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:57.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.100+0000 7fc5e5d9b700 1 -- 172.21.15.82:0/1529578040 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ad9cfc2c40 msgr2=0x55ad9cfc7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:05:57.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.100+0000 7fc5e5d9b700 1 --2- 172.21.15.82:0/1529578040 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ad9cfc2c40 0x55ad9cfc7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:57.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.100+0000 7fc5e5d9b700 1 -- 172.21.15.82:0/1529578040 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ad9cfc8ca0 msgr2=0x55ad9cfcb680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:05:57.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.100+0000 7fc5e5d9b700 1 --2- 172.21.15.82:0/1529578040 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ad9cfc8ca0 0x55ad9cfcb680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:57.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.100+0000 7fc5e5d9b700 1 -- 172.21.15.82:0/1529578040 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ad9cd40de0 con 0x55ad9cfc8380 2023-09-23T09:05:57.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.100+0000 7fc5e5d9b700 1 --2- 172.21.15.82:0/1529578040 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad9cfc8380 0x55ad9cfce7e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc096c00 tx=0x7fc5dc098740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8577b699d70da951 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:05:57.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.100+0000 7fc5d57fa700 1 -- 172.21.15.82:0/1529578040 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5dc0b1030 con 0x55ad9cfc8380 2023-09-23T09:05:57.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.100+0000 7fc5d57fa700 1 -- 172.21.15.82:0/1529578040 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc5dc064070 con 0x55ad9cfc8380 2023-09-23T09:05:57.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.100+0000 7fc5d57fa700 1 -- 172.21.15.82:0/1529578040 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5dc099680 con 0x55ad9cfc8380 2023-09-23T09:05:57.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.101+0000 7fc600486b80 1 -- 172.21.15.82:0/1529578040 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad9cfc8380 msgr2=0x55ad9cfce7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:05:57.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.101+0000 7fc600486b80 1 --2- 172.21.15.82:0/1529578040 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad9cfc8380 0x55ad9cfce7e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc096c00 tx=0x7fc5dc098740 comp rx=0 tx=0).stop 2023-09-23T09:05:57.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.101+0000 7fc600486b80 1 -- 172.21.15.82:0/1529578040 shutdown_connections 2023-09-23T09:05:57.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.101+0000 7fc600486b80 1 --2- 172.21.15.82:0/1529578040 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ad9cfc8ca0 0x55ad9cfcb680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:57.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.101+0000 7fc600486b80 1 --2- 172.21.15.82:0/1529578040 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ad9cfc2c40 0x55ad9cfc7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:57.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.101+0000 7fc600486b80 1 --2- 172.21.15.82:0/1529578040 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad9cfc8380 0x55ad9cfce7e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:57.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.101+0000 7fc600486b80 1 -- 172.21.15.82:0/1529578040 >> 172.21.15.82:0/1529578040 conn(0x55ad9cf370e0 msgr2=0x55ad9cfc6f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:05:57.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.101+0000 7fc600486b80 1 -- 172.21.15.82:0/1529578040 shutdown_connections 2023-09-23T09:05:57.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.101+0000 7fc600486b80 1 -- 172.21.15.82:0/1529578040 wait complete. 2023-09-23T09:05:57.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.102+0000 7fc600486b80 1 -- start start 2023-09-23T09:05:57.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.102+0000 7fc600486b80 1 Processor -- start 2023-09-23T09:05:57.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.103+0000 7fc600486b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad9cfc2c40 0x55ad9cfc53b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:57.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.103+0000 7fc600486b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ad9cfc8380 0x55ad9cfc3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:57.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.103+0000 7fc600486b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ad9cfc8ca0 0x55ad9cfc4340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:57.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.103+0000 7fc600486b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad9cfc5a50 con 0x55ad9cfc8ca0 2023-09-23T09:05:57.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.103+0000 7fc600486b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad9cfc4880 con 0x55ad9cfc2c40 2023-09-23T09:05:57.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.103+0000 7fc600486b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad9cfc4a40 con 0x55ad9cfc8380 2023-09-23T09:05:57.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.103+0000 7fc600486b80 10 client.0 _ll_register_callbacks cb 0x55ad9cdfca80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:05:57.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.103+0000 7fc5e659c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad9cfc2c40 0x55ad9cfc53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:57.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.103+0000 7fc5e5d9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ad9cfc8380 0x55ad9cfc3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:57.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.103+0000 7fc5e659c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad9cfc2c40 0x55ad9cfc53b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:60648/0 (socket says 172.21.15.82:60648) 2023-09-23T09:05:57.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.103+0000 7fc5e5d9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ad9cfc8380 0x55ad9cfc3e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:49344/0 (socket says 172.21.15.82:49344) 2023-09-23T09:05:57.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.103+0000 7fc5e659c700 1 -- 172.21.15.82:0/4206106172 learned_addr learned my addr 172.21.15.82:0/4206106172 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:05:57.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.103+0000 7fc5e6d9d700 1 --2- 172.21.15.82:0/4206106172 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ad9cfc8ca0 0x55ad9cfc4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:57.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.104+0000 7fc5e659c700 1 -- 172.21.15.82:0/4206106172 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ad9cfc8380 msgr2=0x55ad9cfc3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:05:57.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.104+0000 7fc5e659c700 1 --2- 172.21.15.82:0/4206106172 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ad9cfc8380 0x55ad9cfc3e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:57.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.104+0000 7fc5e659c700 1 -- 172.21.15.82:0/4206106172 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ad9cfc8ca0 msgr2=0x55ad9cfc4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:05:57.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.104+0000 7fc5e659c700 1 --2- 172.21.15.82:0/4206106172 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ad9cfc8ca0 0x55ad9cfc4340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:57.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.104+0000 7fc5e659c700 1 -- 172.21.15.82:0/4206106172 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5d8009960 con 0x55ad9cfc2c40 2023-09-23T09:05:57.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.104+0000 7fc5e659c700 1 --2- 172.21.15.82:0/4206106172 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad9cfc2c40 0x55ad9cfc53b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc5d8009d00 tx=0x7fc5d80092f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=193cb5da5c9bbc33 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:05:57.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.104+0000 7fc5cdffb700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-09-23T09:05:57.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.104+0000 7fc5cdffb700 1 -- 172.21.15.82:0/4206106172 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d8005ce0 con 0x55ad9cfc2c40 2023-09-23T09:05:57.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.104+0000 7fc5cdffb700 1 -- 172.21.15.82:0/4206106172 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fc5d80270b0 con 0x55ad9cfc2c40 2023-09-23T09:05:57.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.104+0000 7fc600486b80 1 -- 172.21.15.82:0/4206106172 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ad9cfb58b0 con 0x55ad9cfc2c40 2023-09-23T09:05:57.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.105+0000 7fc5cdffb700 1 -- 172.21.15.82:0/4206106172 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc5d80272b0 con 0x55ad9cfc2c40 2023-09-23T09:05:57.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.105+0000 7fc600486b80 10 client.25898 fetch_fsmap learned FSMap version 54 2023-09-23T09:05:57.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.105+0000 7fc600486b80 1 -- 172.21.15.82:0/4206106172 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) v3 -- 0x55ad9cd29c60 con 0x55ad9cfc2c40 2023-09-23T09:05:57.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.105+0000 7fc5cdffb700 1 -- 172.21.15.82:0/4206106172 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55ad9cfb58b0 con 0x55ad9cfc2c40 2023-09-23T09:05:57.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.105+0000 7fc5cdffb700 1 -- 172.21.15.82:0/4206106172 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 54) v1 ==== 7930+0+0 (secure 0 0 0) 0x7fc5d800e6a0 con 0x55ad9cfc2c40 2023-09-23T09:05:57.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.105+0000 7fc600486b80 10 client.25898 fetch_fsmap finished waiting for FSMap version 54 2023-09-23T09:05:57.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.105+0000 7fc600486b80 10 client.25898 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:05:57.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.105+0000 7fc600486b80 20 client.25898 populate_metadata read hostname 'smithi082' 2023-09-23T09:05:57.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.105+0000 7fc600486b80 1 --2- 172.21.15.82:0/4206106172 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55ad9d031530 0x55ad9d033950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:57.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.105+0000 7fc600486b80 4 client.25898 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:05:57.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.105+0000 7fc600486b80 1 -- 172.21.15.82:0/4206106172 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55ad9cf0d970 con 0x55ad9d031530 2023-09-23T09:05:57.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.106+0000 7fc5e5d9b700 1 --2- 172.21.15.82:0/4206106172 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55ad9d031530 0x55ad9d033950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:57.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.106+0000 7fc5cdffb700 10 client.25898 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:05:57.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.106+0000 7fc5e5d9b700 1 --2- 172.21.15.82:0/4206106172 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55ad9d031530 0x55ad9d033950 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7efb256f38c5bf1 server_cookie=bb64e53f4c7c9044 in_seq=0 out_seq=0 2023-09-23T09:05:57.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.106+0000 7fc5cdffb700 1 -- 172.21.15.82:0/4206106172 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55ad9cf0d970 con 0x55ad9d031530 2023-09-23T09:05:57.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.106+0000 7fc5cdffb700 10 client.25898 handle_command_reply: tid=0 2023-09-23T09:05:57.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.106+0000 7fc600486b80 1 client.25898 shutdown 2023-09-23T09:05:57.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.107+0000 7fc600486b80 1 -- 172.21.15.82:0/4206106172 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad9cfc2c40 msgr2=0x55ad9cfc53b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:05:57.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.107+0000 7fc600486b80 1 --2- 172.21.15.82:0/4206106172 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad9cfc2c40 0x55ad9cfc53b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc5d8009d00 tx=0x7fc5d80092f0 comp rx=0 tx=0).stop 2023-09-23T09:05:57.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.107+0000 7fc600486b80 1 -- 172.21.15.82:0/4206106172 shutdown_connections 2023-09-23T09:05:57.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.107+0000 7fc600486b80 1 --2- 172.21.15.82:0/4206106172 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55ad9d031530 0x55ad9d033950 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:57.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.107+0000 7fc600486b80 1 --2- 172.21.15.82:0/4206106172 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ad9cfc8ca0 0x55ad9cfc4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:57.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.107+0000 7fc600486b80 1 --2- 172.21.15.82:0/4206106172 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad9cfc2c40 0x55ad9cfc53b0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:57.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.107+0000 7fc5cdffb700 0 client.25898 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:05:57.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.107+0000 7fc600486b80 1 --2- 172.21.15.82:0/4206106172 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ad9cfc8380 0x55ad9cfc3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:57.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.107+0000 7fc600486b80 1 -- 172.21.15.82:0/4206106172 >> 172.21.15.82:0/4206106172 conn(0x55ad9cf370e0 msgr2=0x55ad9cfb7b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:05:57.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.107+0000 7fc600486b80 1 -- 172.21.15.82:0/4206106172 shutdown_connections 2023-09-23T09:05:57.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.107+0000 7fc600486b80 1 -- 172.21.15.82:0/4206106172 wait complete. 2023-09-23T09:05:57.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.107+0000 7fc600486b80 20 client.25898 trim_cache size 0 max 16384 2023-09-23T09:05:57.114 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:05:57.114 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "no active scrubs running", 2023-09-23T09:05:57.114 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": {} 2023-09-23T09:05:57.114 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:05:57.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.108+0000 7fc5ecbff700 1 -- 172.21.15.82:0/3127315969 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fc5d00a00c0 msgr2=0x7fc5d00a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:05:57.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.108+0000 7fc5ecbff700 1 --2- 172.21.15.82:0/3127315969 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fc5d00a00c0 0x7fc5d00a2580 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc5e0009ec0 tx=0x7fc5e00134a0 comp rx=0 tx=0).stop 2023-09-23T09:05:57.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.108+0000 7fc5ecbff700 1 -- 172.21.15.82:0/3127315969 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5e8101230 msgr2=0x7fc5e810cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:05:57.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.108+0000 7fc5ecbff700 1 --2- 172.21.15.82:0/3127315969 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5e8101230 0x7fc5e810cbe0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc005770 tx=0x7fc5dc0057a0 comp rx=0 tx=0).stop 2023-09-23T09:05:57.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.108+0000 7fc5ecbff700 1 -- 172.21.15.82:0/3127315969 shutdown_connections 2023-09-23T09:05:57.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.108+0000 7fc5ecbff700 1 --2- 172.21.15.82:0/3127315969 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fc5d00a00c0 0x7fc5d00a2580 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:57.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.108+0000 7fc5ecbff700 1 --2- 172.21.15.82:0/3127315969 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc5e8106880 0x7fc5e81a1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:57.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.108+0000 7fc5ecbff700 1 --2- 172.21.15.82:0/3127315969 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5e8100870 0x7fc5e810c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:57.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.108+0000 7fc5ecbff700 1 --2- 172.21.15.82:0/3127315969 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5e8101230 0x7fc5e810cbe0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:57.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.108+0000 7fc5ecbff700 1 -- 172.21.15.82:0/3127315969 >> 172.21.15.82:0/3127315969 conn(0x7fc5e80fc3a0 msgr2=0x7fc5e80fca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:05:57.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.108+0000 7fc5ecbff700 1 -- 172.21.15.82:0/3127315969 shutdown_connections 2023-09-23T09:05:57.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.108+0000 7fc5ecbff700 1 -- 172.21.15.82:0/3127315969 wait complete. 2023-09-23T09:05:57.134 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-09-23T09:05:57.134 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-23T09:05:57.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.371+0000 7f93309ff700 1 -- 172.21.15.82:0/3520701942 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f932c101260 msgr2=0x7f932c10d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:05:57.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.371+0000 7f93309ff700 1 --2- 172.21.15.82:0/3520701942 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f932c101260 0x7f932c10d770 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9324009f90 tx=0x7f932400b330 comp rx=0 tx=0).stop 2023-09-23T09:05:57.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.371+0000 7f93309ff700 1 -- 172.21.15.82:0/3520701942 shutdown_connections 2023-09-23T09:05:57.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.371+0000 7f93309ff700 1 --2- 172.21.15.82:0/3520701942 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f932c101260 0x7f932c10d770 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:57.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.371+0000 7f93309ff700 1 --2- 172.21.15.82:0/3520701942 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f932c1068b0 0x7f932c106c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:57.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.371+0000 7f93309ff700 1 --2- 172.21.15.82:0/3520701942 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f932c1008a0 0x7f932c100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:57.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.371+0000 7f93309ff700 1 -- 172.21.15.82:0/3520701942 >> 172.21.15.82:0/3520701942 conn(0x7f932c0fc3d0 msgr2=0x7f932c0fe7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:05:57.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.371+0000 7f93309ff700 1 -- 172.21.15.82:0/3520701942 shutdown_connections 2023-09-23T09:05:57.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.371+0000 7f93309ff700 1 -- 172.21.15.82:0/3520701942 wait complete. 2023-09-23T09:05:57.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.373+0000 7f93309ff700 1 Processor -- start 2023-09-23T09:05:57.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.373+0000 7f93309ff700 1 -- start start 2023-09-23T09:05:57.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.373+0000 7f93309ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f932c1008a0 0x7f932c19e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:57.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.373+0000 7f93309ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f932c101260 0x7f932c19ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:57.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.373+0000 7f93309ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f932c1068b0 0x7f932c198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:57.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.374+0000 7f93309ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f932c198ff0 con 0x7f932c1008a0 2023-09-23T09:05:57.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.374+0000 7f93309ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f932c199160 con 0x7f932c1068b0 2023-09-23T09:05:57.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.374+0000 7f93309ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f932c199320 con 0x7f932c101260 2023-09-23T09:05:57.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.374+0000 7f932ad9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f932c1068b0 0x7f932c198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:57.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.374+0000 7f932a59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f932c1008a0 0x7f932c19e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:57.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.374+0000 7f9329d9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f932c101260 0x7f932c19ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:57.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.374+0000 7f932ad9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f932c1068b0 0x7f932c198980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:60662/0 (socket says 172.21.15.82:60662) 2023-09-23T09:05:57.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.374+0000 7f932ad9d700 1 -- 172.21.15.82:0/3562921637 learned_addr learned my addr 172.21.15.82:0/3562921637 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:05:57.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.374+0000 7f932ad9d700 1 -- 172.21.15.82:0/3562921637 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f932c101260 msgr2=0x7f932c19ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:05:57.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.374+0000 7f932ad9d700 1 --2- 172.21.15.82:0/3562921637 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f932c101260 0x7f932c19ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:57.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.374+0000 7f932ad9d700 1 -- 172.21.15.82:0/3562921637 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f932c1008a0 msgr2=0x7f932c19e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:05:57.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.374+0000 7f932ad9d700 1 --2- 172.21.15.82:0/3562921637 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f932c1008a0 0x7f932c19e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:57.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.374+0000 7f932ad9d700 1 -- 172.21.15.82:0/3562921637 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f931c0095f0 con 0x7f932c1068b0 2023-09-23T09:05:57.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.374+0000 7f932a59c700 1 --2- 172.21.15.82:0/3562921637 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f932c1008a0 0x7f932c19e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:05:57.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.375+0000 7f932ad9d700 1 --2- 172.21.15.82:0/3562921637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f932c1068b0 0x7f932c198980 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9324009790 tx=0x7f9324007f50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:05:57.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.375+0000 7f931b7fe700 1 -- 172.21.15.82:0/3562921637 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f932400e040 con 0x7f932c1068b0 2023-09-23T09:05:57.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.375+0000 7f931b7fe700 1 -- 172.21.15.82:0/3562921637 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9324007890 con 0x7f932c1068b0 2023-09-23T09:05:57.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.375+0000 7f931b7fe700 1 -- 172.21.15.82:0/3562921637 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f932401b450 con 0x7f932c1068b0 2023-09-23T09:05:57.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.375+0000 7f93309ff700 1 -- 172.21.15.82:0/3562921637 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9324009c40 con 0x7f932c1068b0 2023-09-23T09:05:57.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.375+0000 7f93309ff700 1 -- 172.21.15.82:0/3562921637 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f932c1a5720 con 0x7f932c1068b0 2023-09-23T09:05:57.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.377+0000 7f93309ff700 1 -- 172.21.15.82:0/3562921637 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f932c067710 con 0x7f932c1068b0 2023-09-23T09:05:57.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.378+0000 7f931b7fe700 1 -- 172.21.15.82:0/3562921637 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f932401d480 con 0x7f932c1068b0 2023-09-23T09:05:57.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.380+0000 7f931b7fe700 1 --2- 172.21.15.82:0/3562921637 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f93140a0180 0x7f93140a2640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:57.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.380+0000 7f931b7fe700 1 -- 172.21.15.82:0/3562921637 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f93240cce30 con 0x7f932c1068b0 2023-09-23T09:05:57.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.380+0000 7f932a59c700 1 --2- 172.21.15.82:0/3562921637 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f93140a0180 0x7f93140a2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:57.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.381+0000 7f932a59c700 1 --2- 172.21.15.82:0/3562921637 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f93140a0180 0x7f93140a2640 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f931c005fd0 tx=0x7f931c009310 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:05:57.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.384+0000 7f931b7fe700 1 -- 172.21.15.82:0/3562921637 <== mon.2 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f93240968b0 con 0x7f932c1068b0 2023-09-23T09:05:57.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.677+0000 7f93309ff700 1 -- 172.21.15.82:0/3562921637 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f932c199e90 con 0x7f932c1068b0 2023-09-23T09:05:57.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.678+0000 7f931b7fe700 1 -- 172.21.15.82:0/3562921637 <== mon.2 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+11345 (secure 0 0 0) 0x7f9324099ed0 con 0x7f932c1068b0 2023-09-23T09:05:57.681 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T09:05:57.681 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":55,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/1237857359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1237857359},{"type":"v1","addr":"172.21.15.82:6835","nonce":1237857359}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/1335102362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":1335102362},{"type":"v1","addr":"172.21.15.82:6837","nonce":1335102362}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":55,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-23T08:54:52.600479+0000","modified":"2023-09-23T09:05:56.933032+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24557,"mds_1":24550,"mds_2":24526,"mds_3":24515,"mds_4":24514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/3645331700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3645331700},{"type":"v1","addr":"172.21.15.135:6835","nonce":3645331700}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14658":{"gid":14658,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6839/205725278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":205725278},{"type":"v1","addr":"172.21.15.82:6839","nonce":205725278}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14670":{"gid":14670,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6841/2659297867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":2659297867},{"type":"v1","addr":"172.21.15.82:6841","nonce":2659297867}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24461":{"gid":24461,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/503886037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":503886037},{"type":"v1","addr":"172.21.15.135:6833","nonce":503886037}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24463":{"gid":24463,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.161:6833/471569125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":471569125},{"type":"v1","addr":"172.21.15.161:6833","nonce":471569125}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24514":{"gid":24514,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":10,"addr":"172.21.15.161:6835/2237964162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":2237964162},{"type":"v1","addr":"172.21.15.161:6835","nonce":2237964162}]},"join_fscid":-1,"export_targets":[0],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24515":{"gid":24515,"name":"h","rank":3,"incarnation":22,"state":"up:active","state_seq":8,"addr":"172.21.15.135:6837/2655304858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2655304858},{"type":"v1","addr":"172.21.15.135:6837","nonce":2655304858}]},"join_fscid":-1,"export_targets":[0,1,2,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24526":{"gid":24526,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.161:6837/43639843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":43639843},{"type":"v1","addr":"172.21.15.161:6837","nonce":43639843}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24550":{"gid":24550,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.161:6839/758982817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6838","nonce":758982817},{"type":"v1","addr":"172.21.15.161:6839","nonce":758982817}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24557":{"gid":24557,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6839/2508669274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2508669274},{"type":"v1","addr":"172.21.15.135:6839","nonce":2508669274}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-23T09:05:57.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.680+0000 7f93309ff700 1 -- 172.21.15.82:0/3562921637 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f93140a0180 msgr2=0x7f93140a2640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:05:57.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.680+0000 7f93309ff700 1 --2- 172.21.15.82:0/3562921637 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f93140a0180 0x7f93140a2640 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f931c005fd0 tx=0x7f931c009310 comp rx=0 tx=0).stop 2023-09-23T09:05:57.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.681+0000 7f93309ff700 1 -- 172.21.15.82:0/3562921637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f932c1068b0 msgr2=0x7f932c198980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:05:57.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.681+0000 7f93309ff700 1 --2- 172.21.15.82:0/3562921637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f932c1068b0 0x7f932c198980 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9324009790 tx=0x7f9324007f50 comp rx=0 tx=0).stop 2023-09-23T09:05:57.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.681+0000 7f93309ff700 1 -- 172.21.15.82:0/3562921637 shutdown_connections 2023-09-23T09:05:57.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.681+0000 7f93309ff700 1 --2- 172.21.15.82:0/3562921637 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f93140a0180 0x7f93140a2640 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:57.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.681+0000 7f93309ff700 1 --2- 172.21.15.82:0/3562921637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f932c1068b0 0x7f932c198980 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:57.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.681+0000 7f93309ff700 1 --2- 172.21.15.82:0/3562921637 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f932c1008a0 0x7f932c19e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:57.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.681+0000 7f93309ff700 1 --2- 172.21.15.82:0/3562921637 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f932c101260 0x7f932c19ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:57.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.681+0000 7f93309ff700 1 -- 172.21.15.82:0/3562921637 >> 172.21.15.82:0/3562921637 conn(0x7f932c0fc3d0 msgr2=0x7f932c10bcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:05:57.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.681+0000 7f93309ff700 1 -- 172.21.15.82:0/3562921637 shutdown_connections 2023-09-23T09:05:57.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.681+0000 7f93309ff700 1 -- 172.21.15.82:0/3562921637 wait complete. 2023-09-23T09:05:57.686 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 55 2023-09-23T09:05:57.705 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-09-23T09:05:57.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.924+0000 7fcf4519d700 1 -- 172.21.15.82:0/693722418 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf4010cf50 msgr2=0x7fcf4010f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:05:57.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.924+0000 7fcf4519d700 1 --2- 172.21.15.82:0/693722418 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf4010cf50 0x7fcf4010f3c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fcf3800b0a0 tx=0x7fcf3800b3b0 comp rx=0 tx=0).stop 2023-09-23T09:05:57.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.924+0000 7fcf4519d700 1 -- 172.21.15.82:0/693722418 shutdown_connections 2023-09-23T09:05:57.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.924+0000 7fcf4519d700 1 --2- 172.21.15.82:0/693722418 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf4010cf50 0x7fcf4010f3c0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:57.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.924+0000 7fcf4519d700 1 --2- 172.21.15.82:0/693722418 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf40072d50 0x7fcf40073130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:57.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.924+0000 7fcf4519d700 1 --2- 172.21.15.82:0/693722418 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcf40073670 0x7fcf4010ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:57.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.924+0000 7fcf4519d700 1 -- 172.21.15.82:0/693722418 >> 172.21.15.82:0/693722418 conn(0x7fcf400fc1e0 msgr2=0x7fcf400fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:05:57.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.924+0000 7fcf4519d700 1 -- 172.21.15.82:0/693722418 shutdown_connections 2023-09-23T09:05:57.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.924+0000 7fcf4519d700 1 -- 172.21.15.82:0/693722418 wait complete. 2023-09-23T09:05:57.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.925+0000 7fcf4519d700 1 Processor -- start 2023-09-23T09:05:57.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.925+0000 7fcf4519d700 1 -- start start 2023-09-23T09:05:57.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.925+0000 7fcf4519d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf40072d50 0x7fcf4019e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:57.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.926+0000 7fcf4519d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf40073670 0x7fcf4019ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:57.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.926+0000 7fcf4519d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcf4010cf50 0x7fcf40198760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:57.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.926+0000 7fcf4519d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf40198dd0 con 0x7fcf40073670 2023-09-23T09:05:57.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.926+0000 7fcf4519d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf40198f40 con 0x7fcf40072d50 2023-09-23T09:05:57.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.926+0000 7fcf4519d700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf40199100 con 0x7fcf4010cf50 2023-09-23T09:05:57.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.926+0000 7fcf3ffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf40072d50 0x7fcf4019e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:57.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.926+0000 7fcf3f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf40073670 0x7fcf4019ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:57.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.926+0000 7fcf3ffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf40072d50 0x7fcf4019e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:60684/0 (socket says 172.21.15.82:60684) 2023-09-23T09:05:57.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.926+0000 7fcf3ffff700 1 -- 172.21.15.82:0/3030533644 learned_addr learned my addr 172.21.15.82:0/3030533644 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:05:57.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.926+0000 7fcf4499c700 1 --2- 172.21.15.82:0/3030533644 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcf4010cf50 0x7fcf40198760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:57.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.926+0000 7fcf3ffff700 1 -- 172.21.15.82:0/3030533644 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcf4010cf50 msgr2=0x7fcf40198760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:05:57.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.926+0000 7fcf3ffff700 1 --2- 172.21.15.82:0/3030533644 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcf4010cf50 0x7fcf40198760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:57.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.926+0000 7fcf3ffff700 1 -- 172.21.15.82:0/3030533644 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf40073670 msgr2=0x7fcf4019ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:05:57.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.926+0000 7fcf3ffff700 1 --2- 172.21.15.82:0/3030533644 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf40073670 0x7fcf4019ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:57.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.926+0000 7fcf3ffff700 1 -- 172.21.15.82:0/3030533644 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf38009d00 con 0x7fcf40072d50 2023-09-23T09:05:57.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.926+0000 7fcf3f7fe700 1 --2- 172.21.15.82:0/3030533644 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf40073670 0x7fcf4019ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:05:57.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.927+0000 7fcf3ffff700 1 --2- 172.21.15.82:0/3030533644 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf40072d50 0x7fcf4019e6f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fcf3000e9a0 tx=0x7fcf3000ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:05:57.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.927+0000 7fcf3d7fa700 1 -- 172.21.15.82:0/3030533644 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf30009790 con 0x7fcf40072d50 2023-09-23T09:05:57.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.927+0000 7fcf4519d700 1 -- 172.21.15.82:0/3030533644 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf401993e0 con 0x7fcf40072d50 2023-09-23T09:05:57.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.927+0000 7fcf3d7fa700 1 -- 172.21.15.82:0/3030533644 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcf30010430 con 0x7fcf40072d50 2023-09-23T09:05:57.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.927+0000 7fcf3d7fa700 1 -- 172.21.15.82:0/3030533644 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf3000cea0 con 0x7fcf40072d50 2023-09-23T09:05:57.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.927+0000 7fcf4519d700 1 -- 172.21.15.82:0/3030533644 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf401a56e0 con 0x7fcf40072d50 2023-09-23T09:05:57.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.930+0000 7fcf3d7fa700 1 -- 172.21.15.82:0/3030533644 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7fcf300105a0 con 0x7fcf40072d50 2023-09-23T09:05:57.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.932+0000 7fcf59c4bb80 1 Processor -- start 2023-09-23T09:05:57.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.932+0000 7fcf59c4bb80 1 -- start start 2023-09-23T09:05:57.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.932+0000 7fcf59c4bb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56403815b500 0x56403815b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:57.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.932+0000 7fcf59c4bb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56403815be20 0x564038155700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:57.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.932+0000 7fcf59c4bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564038155c40 0x564038156080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:57.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.932+0000 7fcf59c4bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640380bd7b0 con 0x564038155c40 2023-09-23T09:05:57.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.932+0000 7fcf59c4bb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640380ae780 con 0x56403815be20 2023-09-23T09:05:57.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.932+0000 7fcf59c4bb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640380ac0a0 con 0x56403815b500 2023-09-23T09:05:57.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.932+0000 7fcf3d7fa700 1 --2- 172.21.15.82:0/3030533644 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fcf280a01e0 0x7fcf280a26a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:57.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.933+0000 7fcf4499c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56403815b500 0x56403815b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:57.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.933+0000 7fcf3d7fa700 1 -- 172.21.15.82:0/3030533644 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fcf30014070 con 0x7fcf40072d50 2023-09-23T09:05:57.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.933+0000 7fcf3ffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56403815be20 0x564038155700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:57.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.933+0000 7fcf3ffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56403815be20 0x564038155700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:60700/0 (socket says 172.21.15.82:60700) 2023-09-23T09:05:57.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.933+0000 7fcf3ffff700 1 -- 172.21.15.82:0/1562584404 learned_addr learned my addr 172.21.15.82:0/1562584404 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:05:57.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.933+0000 7fcf3f7fe700 1 --2- 172.21.15.82:0/1562584404 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564038155c40 0x564038156080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:57.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.933+0000 7fcf4499c700 1 --2- 172.21.15.82:0/3030533644 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fcf280a01e0 0x7fcf280a26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:57.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.933+0000 7fcf3ffff700 1 -- 172.21.15.82:0/1562584404 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56403815b500 msgr2=0x56403815b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:05:57.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.933+0000 7fcf3ffff700 1 --2- 172.21.15.82:0/1562584404 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56403815b500 0x56403815b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:57.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.933+0000 7fcf3ffff700 1 -- 172.21.15.82:0/1562584404 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564038155c40 msgr2=0x564038156080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:05:57.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.933+0000 7fcf3ffff700 1 --2- 172.21.15.82:0/1562584404 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564038155c40 0x564038156080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:57.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.933+0000 7fcf3ffff700 1 -- 172.21.15.82:0/1562584404 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564037f27630 con 0x56403815be20 2023-09-23T09:05:57.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.933+0000 7fcf3ffff700 1 --2- 172.21.15.82:0/1562584404 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56403815be20 0x564038155700 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fcf3000c2d0 tx=0x7fcf30098d60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a458a43addc26da server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:05:57.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.934+0000 7fcf4499c700 1 --2- 172.21.15.82:0/3030533644 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fcf280a01e0 0x7fcf280a26a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fcf38009040 tx=0x7fcf3800b720 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:05:57.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.934+0000 7fcf267fc700 1 -- 172.21.15.82:0/1562584404 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf30098e60 con 0x56403815be20 2023-09-23T09:05:57.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.934+0000 7fcf267fc700 1 -- 172.21.15.82:0/1562584404 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcf3009cc90 con 0x56403815be20 2023-09-23T09:05:57.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.934+0000 7fcf267fc700 1 -- 172.21.15.82:0/1562584404 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf300992e0 con 0x56403815be20 2023-09-23T09:05:57.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.934+0000 7fcf59c4bb80 1 -- 172.21.15.82:0/1562584404 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56403815be20 msgr2=0x564038155700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:05:57.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.934+0000 7fcf59c4bb80 1 --2- 172.21.15.82:0/1562584404 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56403815be20 0x564038155700 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fcf3000c2d0 tx=0x7fcf30098d60 comp rx=0 tx=0).stop 2023-09-23T09:05:57.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.934+0000 7fcf59c4bb80 1 -- 172.21.15.82:0/1562584404 shutdown_connections 2023-09-23T09:05:57.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.934+0000 7fcf59c4bb80 1 --2- 172.21.15.82:0/1562584404 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564038155c40 0x564038156080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:57.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.934+0000 7fcf59c4bb80 1 --2- 172.21.15.82:0/1562584404 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56403815b500 0x56403815b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:57.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.934+0000 7fcf59c4bb80 1 --2- 172.21.15.82:0/1562584404 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56403815be20 0x564038155700 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:57.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.934+0000 7fcf59c4bb80 1 -- 172.21.15.82:0/1562584404 >> 172.21.15.82:0/1562584404 conn(0x5640380ca0e0 msgr2=0x564038150940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:05:57.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.935+0000 7fcf59c4bb80 1 -- 172.21.15.82:0/1562584404 shutdown_connections 2023-09-23T09:05:57.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.935+0000 7fcf59c4bb80 1 -- 172.21.15.82:0/1562584404 wait complete. 2023-09-23T09:05:57.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.935+0000 7fcf59c4bb80 1 -- start start 2023-09-23T09:05:57.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.935+0000 7fcf59c4bb80 1 Processor -- start 2023-09-23T09:05:57.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.936+0000 7fcf59c4bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564038155c40 0x564038161e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:57.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.936+0000 7fcf59c4bb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56403815b500 0x56403815f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:57.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.936+0000 7fcf59c4bb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56403815be20 0x56403815f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:57.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.936+0000 7fcf59c4bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640380a7990 con 0x564038155c40 2023-09-23T09:05:57.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.936+0000 7fcf59c4bb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x564038045bb0 con 0x56403815be20 2023-09-23T09:05:57.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.936+0000 7fcf59c4bb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640380458b0 con 0x56403815b500 2023-09-23T09:05:57.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.936+0000 7fcf59c4bb80 10 client.0 _ll_register_callbacks cb 0x564037f8fa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:05:57.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.936+0000 7fcf3ffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564038155c40 0x564038161e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:57.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.936+0000 7fcf3ffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564038155c40 0x564038161e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58810/0 (socket says 172.21.15.82:58810) 2023-09-23T09:05:57.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.936+0000 7fcf3ffff700 1 -- 172.21.15.82:0/1615158341 learned_addr learned my addr 172.21.15.82:0/1615158341 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:05:57.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.936+0000 7fcf3f7fe700 1 --2- 172.21.15.82:0/1615158341 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56403815b500 0x56403815f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:57.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.936+0000 7fcf4499c700 1 --2- 172.21.15.82:0/1615158341 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56403815be20 0x56403815f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:57.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.937+0000 7fcf3ffff700 1 -- 172.21.15.82:0/1615158341 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56403815b500 msgr2=0x56403815f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:05:57.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.937+0000 7fcf3ffff700 1 --2- 172.21.15.82:0/1615158341 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56403815b500 0x56403815f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:57.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.937+0000 7fcf3ffff700 1 -- 172.21.15.82:0/1615158341 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56403815be20 msgr2=0x56403815f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:05:57.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.937+0000 7fcf3ffff700 1 --2- 172.21.15.82:0/1615158341 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56403815be20 0x56403815f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:57.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.937+0000 7fcf3ffff700 1 -- 172.21.15.82:0/1615158341 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf401a56e0 con 0x564038155c40 2023-09-23T09:05:57.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.937+0000 7fcf3ffff700 1 --2- 172.21.15.82:0/1615158341 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564038155c40 0x564038161e30 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fcf30095360 tx=0x7fcf30099370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74c1e7cd79ace9e9 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:05:57.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.937+0000 7fcf1f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:05:57.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.937+0000 7fcf1f7fe700 1 -- 172.21.15.82:0/1615158341 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf3009cc90 con 0x564038155c40 2023-09-23T09:05:57.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.937+0000 7fcf1f7fe700 1 -- 172.21.15.82:0/1615158341 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fcf300a0c70 con 0x564038155c40 2023-09-23T09:05:57.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.937+0000 7fcf59c4bb80 1 -- 172.21.15.82:0/1615158341 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5640381251c0 con 0x564038155c40 2023-09-23T09:05:57.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.937+0000 7fcf1f7fe700 1 -- 172.21.15.82:0/1615158341 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcf30098e60 con 0x564038155c40 2023-09-23T09:05:57.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.937+0000 7fcf59c4bb80 10 client.16224 fetch_fsmap learned FSMap version 55 2023-09-23T09:05:57.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.937+0000 7fcf59c4bb80 1 -- 172.21.15.82:0/1615158341 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x564037ed3de0 con 0x564038155c40 2023-09-23T09:05:57.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.938+0000 7fcf1f7fe700 1 -- 172.21.15.82:0/1615158341 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcf3007b080 con 0x564038155c40 2023-09-23T09:05:57.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.938+0000 7fcf1f7fe700 1 -- 172.21.15.82:0/1615158341 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 55) v1 ==== 7934+0+0 (secure 0 0 0) 0x7fcf300c8020 con 0x564038155c40 2023-09-23T09:05:57.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.938+0000 7fcf59c4bb80 10 client.16224 fetch_fsmap finished waiting for FSMap version 55 2023-09-23T09:05:57.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.938+0000 7fcf59c4bb80 10 client.16224 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2023-09-23T09:05:57.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.938+0000 7fcf59c4bb80 20 client.16224 populate_metadata read hostname 'smithi082' 2023-09-23T09:05:57.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.938+0000 7fcf59c4bb80 1 --2- 172.21.15.82:0/1615158341 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x56403816f6c0 0x564038171ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:57.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.938+0000 7fcf59c4bb80 4 client.16224 mds_command: new command op to 24514 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:05:57.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.938+0000 7fcf59c4bb80 1 -- 172.21.15.82:0/1615158341 --> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56403804dba0 con 0x56403816f6c0 2023-09-23T09:05:57.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.938+0000 7fcf3f7fe700 1 --2- 172.21.15.82:0/1615158341 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x56403816f6c0 0x564038171ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:57.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.939+0000 7fcf3f7fe700 1 --2- 172.21.15.82:0/1615158341 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x56403816f6c0 0x564038171ae0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=f950677bb6362fb7 server_cookie=c40b10b9d4c51bb3 in_seq=0 out_seq=0 2023-09-23T09:05:57.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.939+0000 7fcf1f7fe700 10 client.16224 ms_handle_connect on v2:172.21.15.161:6834/2237964162 2023-09-23T09:05:57.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.940+0000 7fcf1f7fe700 1 -- 172.21.15.82:0/1615158341 <== mds.4 v2:172.21.15.161:6834/2237964162 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56403804dba0 con 0x56403816f6c0 2023-09-23T09:05:57.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.940+0000 7fcf1f7fe700 10 client.16224 handle_command_reply: tid=0 2023-09-23T09:05:57.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.940+0000 7fcf59c4bb80 1 client.16224 shutdown 2023-09-23T09:05:57.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.940+0000 7fcf59c4bb80 1 -- 172.21.15.82:0/1615158341 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564038155c40 msgr2=0x564038161e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:05:57.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.940+0000 7fcf59c4bb80 1 --2- 172.21.15.82:0/1615158341 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564038155c40 0x564038161e30 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fcf30095360 tx=0x7fcf30099370 comp rx=0 tx=0).stop 2023-09-23T09:05:57.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.940+0000 7fcf59c4bb80 1 -- 172.21.15.82:0/1615158341 shutdown_connections 2023-09-23T09:05:57.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.940+0000 7fcf59c4bb80 1 --2- 172.21.15.82:0/1615158341 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x56403816f6c0 0x564038171ae0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:57.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.940+0000 7fcf59c4bb80 1 --2- 172.21.15.82:0/1615158341 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56403815be20 0x56403815f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:57.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.940+0000 7fcf59c4bb80 1 --2- 172.21.15.82:0/1615158341 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564038155c40 0x564038161e30 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:57.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.940+0000 7fcf59c4bb80 1 --2- 172.21.15.82:0/1615158341 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56403815b500 0x56403815f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:57.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.940+0000 7fcf59c4bb80 1 -- 172.21.15.82:0/1615158341 >> 172.21.15.82:0/1615158341 conn(0x5640380ca0e0 msgr2=0x5640381500a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:05:57.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.940+0000 7fcf1f7fe700 0 client.16224 ms_handle_reset on v2:172.21.15.161:6834/2237964162 2023-09-23T09:05:57.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.940+0000 7fcf59c4bb80 1 -- 172.21.15.82:0/1615158341 shutdown_connections 2023-09-23T09:05:57.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.940+0000 7fcf59c4bb80 1 -- 172.21.15.82:0/1615158341 wait complete. 2023-09-23T09:05:57.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.941+0000 7fcf59c4bb80 20 client.16224 trim_cache size 0 max 16384 2023-09-23T09:05:57.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.955+0000 7fcf59c4bb80 1 Processor -- start 2023-09-23T09:05:57.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.955+0000 7fcf59c4bb80 1 -- start start 2023-09-23T09:05:57.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.955+0000 7fcf59c4bb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564038155c40 0x5640381619d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:57.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.955+0000 7fcf59c4bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56403815b500 0x564038159210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:57.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.955+0000 7fcf59c4bb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56403815be20 0x564038159750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:57.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.955+0000 7fcf59c4bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x564037f29920 con 0x56403815b500 2023-09-23T09:05:57.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.955+0000 7fcf59c4bb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56403814c880 con 0x56403815be20 2023-09-23T09:05:57.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.955+0000 7fcf59c4bb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x564038155780 con 0x564038155c40 2023-09-23T09:05:57.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.956+0000 7fcf3f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56403815b500 0x564038159210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:57.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.956+0000 7fcf3ffff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564038155c40 0x5640381619d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:57.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.956+0000 7fcf4499c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56403815be20 0x564038159750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:57.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.956+0000 7fcf3ffff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564038155c40 0x5640381619d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:49418/0 (socket says 172.21.15.82:49418) 2023-09-23T09:05:57.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.956+0000 7fcf3ffff700 1 -- 172.21.15.82:0/2439734066 learned_addr learned my addr 172.21.15.82:0/2439734066 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:05:57.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.956+0000 7fcf3f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56403815b500 0x564038159210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58812/0 (socket says 172.21.15.82:58812) 2023-09-23T09:05:57.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.956+0000 7fcf4499c700 1 -- 172.21.15.82:0/2439734066 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564038155c40 msgr2=0x5640381619d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:05:57.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.956+0000 7fcf4499c700 1 --2- 172.21.15.82:0/2439734066 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564038155c40 0x5640381619d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:57.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.956+0000 7fcf4499c700 1 -- 172.21.15.82:0/2439734066 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56403815b500 msgr2=0x564038159210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:05:57.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.956+0000 7fcf4499c700 1 --2- 172.21.15.82:0/2439734066 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56403815b500 0x564038159210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:57.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.956+0000 7fcf4499c700 1 -- 172.21.15.82:0/2439734066 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564037ebcc60 con 0x56403815be20 2023-09-23T09:05:57.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.956+0000 7fcf4499c700 1 --2- 172.21.15.82:0/2439734066 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56403815be20 0x564038159750 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fcf38009fd0 tx=0x7fcf38021000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da466b94216b86d0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:05:57.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.957+0000 7fcf26ffd700 1 -- 172.21.15.82:0/2439734066 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf3800e040 con 0x56403815be20 2023-09-23T09:05:57.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.957+0000 7fcf26ffd700 1 -- 172.21.15.82:0/2439734066 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcf38003c00 con 0x56403815be20 2023-09-23T09:05:57.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.957+0000 7fcf26ffd700 1 -- 172.21.15.82:0/2439734066 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf380206b0 con 0x56403815be20 2023-09-23T09:05:57.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.957+0000 7fcf59c4bb80 1 -- 172.21.15.82:0/2439734066 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56403815be20 msgr2=0x564038159750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:05:57.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.957+0000 7fcf59c4bb80 1 --2- 172.21.15.82:0/2439734066 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56403815be20 0x564038159750 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fcf38009fd0 tx=0x7fcf38021000 comp rx=0 tx=0).stop 2023-09-23T09:05:57.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.957+0000 7fcf59c4bb80 1 -- 172.21.15.82:0/2439734066 shutdown_connections 2023-09-23T09:05:57.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.957+0000 7fcf59c4bb80 1 --2- 172.21.15.82:0/2439734066 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56403815be20 0x564038159750 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:57.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.957+0000 7fcf59c4bb80 1 --2- 172.21.15.82:0/2439734066 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564038155c40 0x5640381619d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:57.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.957+0000 7fcf59c4bb80 1 --2- 172.21.15.82:0/2439734066 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56403815b500 0x564038159210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:57.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.957+0000 7fcf59c4bb80 1 -- 172.21.15.82:0/2439734066 >> 172.21.15.82:0/2439734066 conn(0x5640380ca0e0 msgr2=0x5640381716d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:05:57.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.958+0000 7fcf59c4bb80 1 -- 172.21.15.82:0/2439734066 shutdown_connections 2023-09-23T09:05:57.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.958+0000 7fcf59c4bb80 1 -- 172.21.15.82:0/2439734066 wait complete. 2023-09-23T09:05:57.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.958+0000 7fcf59c4bb80 1 -- start start 2023-09-23T09:05:57.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.958+0000 7fcf59c4bb80 1 Processor -- start 2023-09-23T09:05:57.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.959+0000 7fcf59c4bb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564038155c40 0x564038158130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:57.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.959+0000 7fcf59c4bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56403815b500 0x564038158670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:57.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.959+0000 7fcf59c4bb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56403815be20 0x564038156f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:57.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.959+0000 7fcf59c4bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x564038158d70 con 0x56403815b500 2023-09-23T09:05:57.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.959+0000 7fcf59c4bb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640381574a0 con 0x564038155c40 2023-09-23T09:05:57.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.959+0000 7fcf59c4bb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x564038157630 con 0x56403815be20 2023-09-23T09:05:57.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.959+0000 7fcf59c4bb80 10 client.0 _ll_register_callbacks cb 0x7fcf30098a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:05:57.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.959+0000 7fcf3ffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564038155c40 0x564038158130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:57.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.959+0000 7fcf3ffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564038155c40 0x564038158130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:60726/0 (socket says 172.21.15.82:60726) 2023-09-23T09:05:57.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.959+0000 7fcf3ffff700 1 -- 172.21.15.82:0/3647436385 learned_addr learned my addr 172.21.15.82:0/3647436385 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:05:57.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.959+0000 7fcf4499c700 1 --2- 172.21.15.82:0/3647436385 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56403815be20 0x564038156f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:57.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.959+0000 7fcf3f7fe700 1 --2- 172.21.15.82:0/3647436385 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56403815b500 0x564038158670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:57.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.959+0000 7fcf3ffff700 1 -- 172.21.15.82:0/3647436385 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56403815be20 msgr2=0x564038156f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:05:57.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.959+0000 7fcf3ffff700 1 --2- 172.21.15.82:0/3647436385 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56403815be20 0x564038156f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:57.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.959+0000 7fcf3ffff700 1 -- 172.21.15.82:0/3647436385 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56403815b500 msgr2=0x564038158670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:05:57.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.959+0000 7fcf3ffff700 1 --2- 172.21.15.82:0/3647436385 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56403815b500 0x564038158670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:57.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.959+0000 7fcf3ffff700 1 -- 172.21.15.82:0/3647436385 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf40110080 con 0x564038155c40 2023-09-23T09:05:57.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.960+0000 7fcf3ffff700 1 --2- 172.21.15.82:0/3647436385 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564038155c40 0x564038158130 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fcf30009230 tx=0x7fcf30010b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d6bfac1c28821e9 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:05:57.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.960+0000 7fcf1f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-09-23T09:05:57.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.960+0000 7fcf1f7fe700 1 -- 172.21.15.82:0/3647436385 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf3009cc90 con 0x564038155c40 2023-09-23T09:05:57.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.960+0000 7fcf59c4bb80 1 -- 172.21.15.82:0/3647436385 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5640381488b0 con 0x564038155c40 2023-09-23T09:05:57.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.960+0000 7fcf1f7fe700 1 -- 172.21.15.82:0/3647436385 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fcf300b82f0 con 0x564038155c40 2023-09-23T09:05:57.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.960+0000 7fcf1f7fe700 1 -- 172.21.15.82:0/3647436385 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcf30094e90 con 0x564038155c40 2023-09-23T09:05:57.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.960+0000 7fcf59c4bb80 10 client.25922 fetch_fsmap learned FSMap version 55 2023-09-23T09:05:57.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.960+0000 7fcf59c4bb80 1 -- 172.21.15.82:0/3647436385 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x564037efa250 con 0x564038155c40 2023-09-23T09:05:57.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.961+0000 7fcf1f7fe700 1 -- 172.21.15.82:0/3647436385 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5640381488b0 con 0x564038155c40 2023-09-23T09:05:57.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.961+0000 7fcf1f7fe700 1 -- 172.21.15.82:0/3647436385 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 55) v1 ==== 7934+0+0 (secure 0 0 0) 0x7fcf30082250 con 0x564038155c40 2023-09-23T09:05:57.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.961+0000 7fcf59c4bb80 10 client.25922 fetch_fsmap finished waiting for FSMap version 55 2023-09-23T09:05:57.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.961+0000 7fcf59c4bb80 10 client.25922 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2023-09-23T09:05:57.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.961+0000 7fcf59c4bb80 20 client.25922 populate_metadata read hostname 'smithi082' 2023-09-23T09:05:57.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.961+0000 7fcf59c4bb80 1 --2- 172.21.15.82:0/3647436385 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x5640381c3cc0 0x5640381c60b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:57.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.961+0000 7fcf59c4bb80 4 client.25922 mds_command: new command op to 24514 tid=0[{"prefix": "damage ls"}] 2023-09-23T09:05:57.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.961+0000 7fcf59c4bb80 1 -- 172.21.15.82:0/3647436385 --> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5640380a0970 con 0x5640381c3cc0 2023-09-23T09:05:57.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.961+0000 7fcf3f7fe700 1 --2- 172.21.15.82:0/3647436385 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x5640381c3cc0 0x5640381c60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:57.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.962+0000 7fcf3f7fe700 1 --2- 172.21.15.82:0/3647436385 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x5640381c3cc0 0x5640381c60b0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=ed540d9c1d4688ab server_cookie=58f04c94aca7c3e6 in_seq=0 out_seq=0 2023-09-23T09:05:57.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.962+0000 7fcf1f7fe700 10 client.25922 ms_handle_connect on v2:172.21.15.161:6834/2237964162 2023-09-23T09:05:57.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.963+0000 7fcf1f7fe700 1 -- 172.21.15.82:0/3647436385 <== mds.4 v2:172.21.15.161:6834/2237964162 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5640380a0970 con 0x5640381c3cc0 2023-09-23T09:05:57.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.963+0000 7fcf1f7fe700 10 client.25922 handle_command_reply: tid=0 2023-09-23T09:05:57.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.963+0000 7fcf59c4bb80 1 client.25922 shutdown 2023-09-23T09:05:57.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.963+0000 7fcf59c4bb80 1 -- 172.21.15.82:0/3647436385 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564038155c40 msgr2=0x564038158130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:05:57.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.963+0000 7fcf59c4bb80 1 --2- 172.21.15.82:0/3647436385 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564038155c40 0x564038158130 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fcf30009230 tx=0x7fcf30010b80 comp rx=0 tx=0).stop 2023-09-23T09:05:57.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.963+0000 7fcf59c4bb80 1 -- 172.21.15.82:0/3647436385 shutdown_connections 2023-09-23T09:05:57.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.963+0000 7fcf59c4bb80 1 --2- 172.21.15.82:0/3647436385 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x5640381c3cc0 0x5640381c60b0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:57.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.963+0000 7fcf59c4bb80 1 --2- 172.21.15.82:0/3647436385 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56403815be20 0x564038156f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:57.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.963+0000 7fcf59c4bb80 1 --2- 172.21.15.82:0/3647436385 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564038155c40 0x564038158130 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:57.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.963+0000 7fcf59c4bb80 1 --2- 172.21.15.82:0/3647436385 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56403815b500 0x564038158670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:57.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.963+0000 7fcf1f7fe700 0 client.25922 ms_handle_reset on v2:172.21.15.161:6834/2237964162 2023-09-23T09:05:57.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.963+0000 7fcf59c4bb80 1 -- 172.21.15.82:0/3647436385 >> 172.21.15.82:0/3647436385 conn(0x5640380ca0e0 msgr2=0x564038159210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:05:57.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.963+0000 7fcf59c4bb80 1 -- 172.21.15.82:0/3647436385 shutdown_connections 2023-09-23T09:05:57.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.963+0000 7fcf59c4bb80 1 -- 172.21.15.82:0/3647436385 wait complete. 2023-09-23T09:05:57.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.963+0000 7fcf59c4bb80 20 client.25922 trim_cache size 0 max 16384 2023-09-23T09:05:57.972 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2023-09-23T09:05:57.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.964+0000 7fcf4519d700 1 -- 172.21.15.82:0/3030533644 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fcf280a01e0 msgr2=0x7fcf280a26a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:05:57.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.964+0000 7fcf4519d700 1 --2- 172.21.15.82:0/3030533644 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fcf280a01e0 0x7fcf280a26a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fcf38009040 tx=0x7fcf3800b720 comp rx=0 tx=0).stop 2023-09-23T09:05:57.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.964+0000 7fcf4519d700 1 -- 172.21.15.82:0/3030533644 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf40072d50 msgr2=0x7fcf4019e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:05:57.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.964+0000 7fcf4519d700 1 --2- 172.21.15.82:0/3030533644 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf40072d50 0x7fcf4019e6f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fcf3000e9a0 tx=0x7fcf3000ecb0 comp rx=0 tx=0).stop 2023-09-23T09:05:57.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.964+0000 7fcf4519d700 1 -- 172.21.15.82:0/3030533644 shutdown_connections 2023-09-23T09:05:57.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.964+0000 7fcf4519d700 1 --2- 172.21.15.82:0/3030533644 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fcf280a01e0 0x7fcf280a26a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:57.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.964+0000 7fcf4519d700 1 --2- 172.21.15.82:0/3030533644 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcf4010cf50 0x7fcf40198760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:57.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.964+0000 7fcf4519d700 1 --2- 172.21.15.82:0/3030533644 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf40072d50 0x7fcf4019e6f0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:57.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.964+0000 7fcf4519d700 1 --2- 172.21.15.82:0/3030533644 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf40073670 0x7fcf4019ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:57.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.964+0000 7fcf4519d700 1 -- 172.21.15.82:0/3030533644 >> 172.21.15.82:0/3030533644 conn(0x7fcf400fc1e0 msgr2=0x7fcf401049b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:05:57.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.964+0000 7fcf4519d700 1 -- 172.21.15.82:0/3030533644 shutdown_connections 2023-09-23T09:05:57.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:57.964+0000 7fcf4519d700 1 -- 172.21.15.82:0/3030533644 wait complete. 2023-09-23T09:05:57.987 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-09-23T09:05:58.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.207+0000 7f2bb23ff700 1 -- 172.21.15.82:0/1806494774 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bac072d50 msgr2=0x7f2bac073130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:05:58.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.207+0000 7f2bb23ff700 1 --2- 172.21.15.82:0/1806494774 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bac072d50 0x7f2bac073130 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c009990 tx=0x7f2b9c009ca0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.208+0000 7f2bb23ff700 1 -- 172.21.15.82:0/1806494774 shutdown_connections 2023-09-23T09:05:58.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.208+0000 7f2bb23ff700 1 --2- 172.21.15.82:0/1806494774 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2bac10d0d0 0x7f2bac10f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.208+0000 7f2bb23ff700 1 --2- 172.21.15.82:0/1806494774 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bac072d50 0x7f2bac073130 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.208+0000 7f2bb23ff700 1 --2- 172.21.15.82:0/1806494774 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2bac073670 0x7f2bac10cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.208+0000 7f2bb23ff700 1 -- 172.21.15.82:0/1806494774 >> 172.21.15.82:0/1806494774 conn(0x7f2bac0fc380 msgr2=0x7f2bac0fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:05:58.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.208+0000 7f2bb23ff700 1 -- 172.21.15.82:0/1806494774 shutdown_connections 2023-09-23T09:05:58.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.208+0000 7f2bb23ff700 1 -- 172.21.15.82:0/1806494774 wait complete. 2023-09-23T09:05:58.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.209+0000 7f2bb23ff700 1 Processor -- start 2023-09-23T09:05:58.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.209+0000 7f2bb23ff700 1 -- start start 2023-09-23T09:05:58.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.209+0000 7f2bb23ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bac072d50 0x7f2bac19e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:58.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.209+0000 7f2bb23ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2bac073670 0x7f2bac19ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:58.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.209+0000 7f2bb23ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2bac10d0d0 0x7f2bac198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:58.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.209+0000 7f2bb23ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bac198ff0 con 0x7f2bac072d50 2023-09-23T09:05:58.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.209+0000 7f2bb23ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bac199160 con 0x7f2bac10d0d0 2023-09-23T09:05:58.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.209+0000 7f2bb23ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bac199320 con 0x7f2bac073670 2023-09-23T09:05:58.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.210+0000 7f2babfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bac072d50 0x7f2bac19e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:58.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.210+0000 7f2babfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bac072d50 0x7f2bac19e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58830/0 (socket says 172.21.15.82:58830) 2023-09-23T09:05:58.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.210+0000 7f2bab7fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2bac073670 0x7f2bac19ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:58.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.210+0000 7f2babfff700 1 -- 172.21.15.82:0/897291475 learned_addr learned my addr 172.21.15.82:0/897291475 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:05:58.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.210+0000 7f2bb099c700 1 --2- 172.21.15.82:0/897291475 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2bac10d0d0 0x7f2bac198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:58.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.210+0000 7f2bab7fe700 1 -- 172.21.15.82:0/897291475 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2bac10d0d0 msgr2=0x7f2bac198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:05:58.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.210+0000 7f2bab7fe700 1 --2- 172.21.15.82:0/897291475 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2bac10d0d0 0x7f2bac198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.210+0000 7f2bab7fe700 1 -- 172.21.15.82:0/897291475 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bac072d50 msgr2=0x7f2bac19e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:05:58.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.210+0000 7f2bab7fe700 1 --2- 172.21.15.82:0/897291475 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bac072d50 0x7f2bac19e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.210+0000 7f2bab7fe700 1 -- 172.21.15.82:0/897291475 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b9c0095f0 con 0x7f2bac073670 2023-09-23T09:05:58.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.210+0000 7f2babfff700 1 --2- 172.21.15.82:0/897291475 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bac072d50 0x7f2bac19e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:05:58.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.210+0000 7f2bab7fe700 1 --2- 172.21.15.82:0/897291475 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2bac073670 0x7f2bac19ee50 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2ba000e9f0 tx=0x7f2ba000ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:05:58.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.211+0000 7f2ba97fa700 1 -- 172.21.15.82:0/897291475 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba000c9c0 con 0x7f2bac073670 2023-09-23T09:05:58.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.211+0000 7f2bb23ff700 1 -- 172.21.15.82:0/897291475 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bac199600 con 0x7f2bac073670 2023-09-23T09:05:58.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.211+0000 7f2ba97fa700 1 -- 172.21.15.82:0/897291475 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2ba0010430 con 0x7f2bac073670 2023-09-23T09:05:58.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.211+0000 7f2ba97fa700 1 -- 172.21.15.82:0/897291475 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba0018680 con 0x7f2bac073670 2023-09-23T09:05:58.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.211+0000 7f2bb23ff700 1 -- 172.21.15.82:0/897291475 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bac1a5900 con 0x7f2bac073670 2023-09-23T09:05:58.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.216+0000 7f2ba97fa700 1 -- 172.21.15.82:0/897291475 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f2ba00105a0 con 0x7f2bac073670 2023-09-23T09:05:58.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.216+0000 7f2bc5c5eb80 1 Processor -- start 2023-09-23T09:05:58.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.217+0000 7f2bc5c5eb80 1 -- start start 2023-09-23T09:05:58.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.217+0000 7f2bc5c5eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561872804380 0x561872804760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:58.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.217+0000 7f2bc5c5eb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561872804ca0 0x5618727fe700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:58.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.217+0000 7f2bc5c5eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5618727fec40 0x5618727ff0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:58.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.217+0000 7f2bc5c5eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618727667b0 con 0x561872804380 2023-09-23T09:05:58.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.217+0000 7f2bc5c5eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561872757780 con 0x5618727fec40 2023-09-23T09:05:58.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.217+0000 7f2bc5c5eb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618727550a0 con 0x561872804ca0 2023-09-23T09:05:58.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.218+0000 7f2bab7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5618727fec40 0x5618727ff0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:58.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.218+0000 7f2bb099c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561872804380 0x561872804760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:58.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.218+0000 7f2bab7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5618727fec40 0x5618727ff0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:60752/0 (socket says 172.21.15.82:60752) 2023-09-23T09:05:58.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.218+0000 7f2babfff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561872804ca0 0x5618727fe700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:58.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.218+0000 7f2bab7fe700 1 -- 172.21.15.82:0/1699849633 learned_addr learned my addr 172.21.15.82:0/1699849633 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:05:58.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.218+0000 7f2bb099c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561872804380 0x561872804760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58840/0 (socket says 172.21.15.82:58840) 2023-09-23T09:05:58.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.218+0000 7f2ba97fa700 1 --2- 172.21.15.82:0/897291475 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f2b940a0140 0x7f2b940a2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:58.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.218+0000 7f2ba97fa700 1 -- 172.21.15.82:0/897291475 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f2ba0014070 con 0x7f2bac073670 2023-09-23T09:05:58.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.218+0000 7f2bb099c700 1 --2- 172.21.15.82:0/897291475 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f2b940a0140 0x7f2b940a2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:58.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.218+0000 7f2bab7fe700 1 -- 172.21.15.82:0/1699849633 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561872804ca0 msgr2=0x5618727fe700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:05:58.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.218+0000 7f2bab7fe700 1 --2- 172.21.15.82:0/1699849633 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561872804ca0 0x5618727fe700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.218+0000 7f2bab7fe700 1 -- 172.21.15.82:0/1699849633 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561872804380 msgr2=0x561872804760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:05:58.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.218+0000 7f2bab7fe700 1 --2- 172.21.15.82:0/1699849633 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561872804380 0x561872804760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.218+0000 7f2bab7fe700 1 -- 172.21.15.82:0/1699849633 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5618725d0630 con 0x5618727fec40 2023-09-23T09:05:58.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.218+0000 7f2babfff700 1 --2- 172.21.15.82:0/1699849633 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561872804ca0 0x5618727fe700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:05:58.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.219+0000 7f2bab7fe700 1 --2- 172.21.15.82:0/1699849633 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5618727fec40 0x5618727ff0a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2ba00c8dc0 tx=0x7f2ba0009790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6d68aa802fbcb7b server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:05:58.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.219+0000 7f2b927fc700 1 -- 172.21.15.82:0/1699849633 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba0098bb0 con 0x5618727fec40 2023-09-23T09:05:58.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.219+0000 7f2b927fc700 1 -- 172.21.15.82:0/1699849633 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2ba0098920 con 0x5618727fec40 2023-09-23T09:05:58.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.219+0000 7f2b927fc700 1 -- 172.21.15.82:0/1699849633 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba0098de0 con 0x5618727fec40 2023-09-23T09:05:58.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.220+0000 7f2bc5c5eb80 1 -- 172.21.15.82:0/1699849633 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5618727fec40 msgr2=0x5618727ff0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:05:58.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.220+0000 7f2bc5c5eb80 1 --2- 172.21.15.82:0/1699849633 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5618727fec40 0x5618727ff0a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2ba00c8dc0 tx=0x7f2ba0009790 comp rx=0 tx=0).stop 2023-09-23T09:05:58.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.220+0000 7f2bb099c700 1 --2- 172.21.15.82:0/897291475 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f2b940a0140 0x7f2b940a2600 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2ba4009ec0 tx=0x7f2ba4004b40 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:05:58.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.220+0000 7f2bc5c5eb80 1 -- 172.21.15.82:0/1699849633 shutdown_connections 2023-09-23T09:05:58.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.220+0000 7f2bc5c5eb80 1 --2- 172.21.15.82:0/1699849633 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5618727fec40 0x5618727ff0a0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.220+0000 7f2bc5c5eb80 1 --2- 172.21.15.82:0/1699849633 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561872804380 0x561872804760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.220+0000 7f2bc5c5eb80 1 --2- 172.21.15.82:0/1699849633 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561872804ca0 0x5618727fe700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.220+0000 7f2bc5c5eb80 1 -- 172.21.15.82:0/1699849633 >> 172.21.15.82:0/1699849633 conn(0x5618727730e0 msgr2=0x5618727f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:05:58.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.220+0000 7f2bc5c5eb80 1 -- 172.21.15.82:0/1699849633 shutdown_connections 2023-09-23T09:05:58.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.220+0000 7f2bc5c5eb80 1 -- 172.21.15.82:0/1699849633 wait complete. 2023-09-23T09:05:58.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.220+0000 7f2bc5c5eb80 1 -- start start 2023-09-23T09:05:58.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.221+0000 7f2bc5c5eb80 1 Processor -- start 2023-09-23T09:05:58.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.221+0000 7f2bc5c5eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5618727fec40 0x56187280ac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:58.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.221+0000 7f2bc5c5eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561872804380 0x561872807f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:58.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.221+0000 7f2bc5c5eb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561872804ca0 0x5618728085f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:58.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.221+0000 7f2bc5c5eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561872750990 con 0x5618727fec40 2023-09-23T09:05:58.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.221+0000 7f2bc5c5eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618726eebb0 con 0x561872804380 2023-09-23T09:05:58.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.221+0000 7f2bc5c5eb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618726ee8b0 con 0x561872804ca0 2023-09-23T09:05:58.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.221+0000 7f2bc5c5eb80 10 client.0 _ll_register_callbacks cb 0x561872638a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:05:58.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.221+0000 7f2babfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5618727fec40 0x56187280ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:58.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.221+0000 7f2babfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5618727fec40 0x56187280ac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58844/0 (socket says 172.21.15.82:58844) 2023-09-23T09:05:58.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.221+0000 7f2babfff700 1 -- 172.21.15.82:0/198517810 learned_addr learned my addr 172.21.15.82:0/198517810 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:05:58.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.221+0000 7f2bab7fe700 1 --2- 172.21.15.82:0/198517810 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561872804380 0x561872807f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:58.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.221+0000 7f2bb099c700 1 --2- 172.21.15.82:0/198517810 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561872804ca0 0x5618728085f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:58.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.222+0000 7f2bab7fe700 1 -- 172.21.15.82:0/198517810 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561872804ca0 msgr2=0x5618728085f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:05:58.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.222+0000 7f2bab7fe700 1 --2- 172.21.15.82:0/198517810 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561872804ca0 0x5618728085f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.222+0000 7f2bab7fe700 1 -- 172.21.15.82:0/198517810 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5618727fec40 msgr2=0x56187280ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:05:58.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.222+0000 7f2bab7fe700 1 --2- 172.21.15.82:0/198517810 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5618727fec40 0x56187280ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.222+0000 7f2bab7fe700 1 -- 172.21.15.82:0/198517810 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bac1a5900 con 0x561872804380 2023-09-23T09:05:58.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.222+0000 7f2bab7fe700 1 --2- 172.21.15.82:0/198517810 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561872804380 0x561872807f00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2ba0098a90 tx=0x7f2ba0098c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f6506177552021d6 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:05:58.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.222+0000 7f2b8b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-09-23T09:05:58.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.222+0000 7f2b8b7fe700 1 -- 172.21.15.82:0/198517810 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba00994e0 con 0x561872804380 2023-09-23T09:05:58.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.222+0000 7f2bc5c5eb80 1 -- 172.21.15.82:0/198517810 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5618727ce1c0 con 0x561872804380 2023-09-23T09:05:58.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.222+0000 7f2b8b7fe700 1 -- 172.21.15.82:0/198517810 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f2ba0064d80 con 0x561872804380 2023-09-23T09:05:58.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.223+0000 7f2b8b7fe700 1 -- 172.21.15.82:0/198517810 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2ba009cc10 con 0x561872804380 2023-09-23T09:05:58.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.223+0000 7f2bc5c5eb80 10 client.25934 fetch_fsmap learned FSMap version 55 2023-09-23T09:05:58.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.223+0000 7f2bc5c5eb80 1 -- 172.21.15.82:0/198517810 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x56187257cde0 con 0x561872804380 2023-09-23T09:05:58.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.223+0000 7f2b8b7fe700 1 -- 172.21.15.82:0/198517810 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5618727ce1c0 con 0x561872804380 2023-09-23T09:05:58.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.223+0000 7f2b8b7fe700 1 -- 172.21.15.82:0/198517810 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 55) v1 ==== 7934+0+0 (secure 0 0 0) 0x7f2ba00982d0 con 0x561872804380 2023-09-23T09:05:58.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.223+0000 7f2bc5c5eb80 10 client.25934 fetch_fsmap finished waiting for FSMap version 55 2023-09-23T09:05:58.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.223+0000 7f2bc5c5eb80 10 client.25934 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2023-09-23T09:05:58.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.223+0000 7f2bc5c5eb80 20 client.25934 populate_metadata read hostname 'smithi082' 2023-09-23T09:05:58.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.223+0000 7f2bc5c5eb80 1 --2- 172.21.15.82:0/198517810 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x561872818360 0x56187281a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:58.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.223+0000 7f2bc5c5eb80 4 client.25934 mds_command: new command op to 24515 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:05:58.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.223+0000 7f2bc5c5eb80 1 -- 172.21.15.82:0/198517810 --> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5618726f6ba0 con 0x561872818360 2023-09-23T09:05:58.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.224+0000 7f2babfff700 1 --2- 172.21.15.82:0/198517810 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x561872818360 0x56187281a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:58.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.224+0000 7f2b8b7fe700 10 client.25934 ms_handle_connect on v2:172.21.15.135:6836/2655304858 2023-09-23T09:05:58.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.224+0000 7f2babfff700 1 --2- 172.21.15.82:0/198517810 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x561872818360 0x56187281a780 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=c290d66bdb9a55a3 server_cookie=1ff3dab38567b676 in_seq=0 out_seq=0 2023-09-23T09:05:58.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.225+0000 7f2b8b7fe700 1 -- 172.21.15.82:0/198517810 <== mds.3 v2:172.21.15.135:6836/2655304858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5618726f6ba0 con 0x561872818360 2023-09-23T09:05:58.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.225+0000 7f2b8b7fe700 10 client.25934 handle_command_reply: tid=0 2023-09-23T09:05:58.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.225+0000 7f2bc5c5eb80 1 client.25934 shutdown 2023-09-23T09:05:58.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.225+0000 7f2bc5c5eb80 1 -- 172.21.15.82:0/198517810 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561872804380 msgr2=0x561872807f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:05:58.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.225+0000 7f2bc5c5eb80 1 --2- 172.21.15.82:0/198517810 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561872804380 0x561872807f00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2ba0098a90 tx=0x7f2ba0098c30 comp rx=0 tx=0).stop 2023-09-23T09:05:58.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.225+0000 7f2bc5c5eb80 1 -- 172.21.15.82:0/198517810 shutdown_connections 2023-09-23T09:05:58.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.225+0000 7f2bc5c5eb80 1 --2- 172.21.15.82:0/198517810 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x561872818360 0x56187281a780 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.225+0000 7f2bc5c5eb80 1 --2- 172.21.15.82:0/198517810 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561872804ca0 0x5618728085f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.225+0000 7f2bc5c5eb80 1 --2- 172.21.15.82:0/198517810 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5618727fec40 0x56187280ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.225+0000 7f2b8b7fe700 0 client.25934 ms_handle_reset on v2:172.21.15.135:6836/2655304858 2023-09-23T09:05:58.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.225+0000 7f2bc5c5eb80 1 --2- 172.21.15.82:0/198517810 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561872804380 0x561872807f00 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.225+0000 7f2bc5c5eb80 1 -- 172.21.15.82:0/198517810 >> 172.21.15.82:0/198517810 conn(0x5618727730e0 msgr2=0x5618727f3b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:05:58.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.225+0000 7f2bc5c5eb80 1 -- 172.21.15.82:0/198517810 shutdown_connections 2023-09-23T09:05:58.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.225+0000 7f2bc5c5eb80 1 -- 172.21.15.82:0/198517810 wait complete. 2023-09-23T09:05:58.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.226+0000 7f2bc5c5eb80 20 client.25934 trim_cache size 0 max 16384 2023-09-23T09:05:58.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.240+0000 7f2bc5c5eb80 1 Processor -- start 2023-09-23T09:05:58.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.240+0000 7f2bc5c5eb80 1 -- start start 2023-09-23T09:05:58.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.240+0000 7f2bc5c5eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5618727fec40 0x5618727fe700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:58.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.240+0000 7f2bc5c5eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561872804380 0x56187280f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:58.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.240+0000 7f2bc5c5eb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561872804ca0 0x5618728020b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:58.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.240+0000 7f2bc5c5eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618725d2920 con 0x561872804380 2023-09-23T09:05:58.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.240+0000 7f2bc5c5eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618727f5c80 con 0x5618727fec40 2023-09-23T09:05:58.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.240+0000 7f2bc5c5eb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x56187280fc20 con 0x561872804ca0 2023-09-23T09:05:58.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.240+0000 7f2babfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5618727fec40 0x5618727fe700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:58.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.240+0000 7f2babfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5618727fec40 0x5618727fe700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:60774/0 (socket says 172.21.15.82:60774) 2023-09-23T09:05:58.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.240+0000 7f2babfff700 1 -- 172.21.15.82:0/2594220126 learned_addr learned my addr 172.21.15.82:0/2594220126 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:05:58.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.240+0000 7f2bab7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561872804380 0x56187280f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:58.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.241+0000 7f2bb099c700 1 --2- 172.21.15.82:0/2594220126 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561872804ca0 0x5618728020b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:58.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.241+0000 7f2babfff700 1 -- 172.21.15.82:0/2594220126 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561872804ca0 msgr2=0x5618728020b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:05:58.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.241+0000 7f2babfff700 1 --2- 172.21.15.82:0/2594220126 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561872804ca0 0x5618728020b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.241+0000 7f2babfff700 1 -- 172.21.15.82:0/2594220126 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561872804380 msgr2=0x56187280f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:05:58.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.241+0000 7f2babfff700 1 --2- 172.21.15.82:0/2594220126 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561872804380 0x56187280f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.241+0000 7f2babfff700 1 -- 172.21.15.82:0/2594220126 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56187281f3b0 con 0x5618727fec40 2023-09-23T09:05:58.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.241+0000 7f2babfff700 1 --2- 172.21.15.82:0/2594220126 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5618727fec40 0x5618727fe700 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c006010 tx=0x7f2b9c00b260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7006f1edf0068fd server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:05:58.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.242+0000 7f2b92ffd700 1 -- 172.21.15.82:0/2594220126 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9c01d040 con 0x5618727fec40 2023-09-23T09:05:58.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.242+0000 7f2b92ffd700 1 -- 172.21.15.82:0/2594220126 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2b9c01e040 con 0x5618727fec40 2023-09-23T09:05:58.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.242+0000 7f2b92ffd700 1 -- 172.21.15.82:0/2594220126 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9c0053c0 con 0x5618727fec40 2023-09-23T09:05:58.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.242+0000 7f2bc5c5eb80 1 -- 172.21.15.82:0/2594220126 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5618727fec40 msgr2=0x5618727fe700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:05:58.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.242+0000 7f2bc5c5eb80 1 --2- 172.21.15.82:0/2594220126 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5618727fec40 0x5618727fe700 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c006010 tx=0x7f2b9c00b260 comp rx=0 tx=0).stop 2023-09-23T09:05:58.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.242+0000 7f2bc5c5eb80 1 -- 172.21.15.82:0/2594220126 shutdown_connections 2023-09-23T09:05:58.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.242+0000 7f2bc5c5eb80 1 --2- 172.21.15.82:0/2594220126 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561872804ca0 0x5618728020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.242+0000 7f2bc5c5eb80 1 --2- 172.21.15.82:0/2594220126 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5618727fec40 0x5618727fe700 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.242+0000 7f2bc5c5eb80 1 --2- 172.21.15.82:0/2594220126 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561872804380 0x56187280f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.242+0000 7f2bc5c5eb80 1 -- 172.21.15.82:0/2594220126 >> 172.21.15.82:0/2594220126 conn(0x5618727730e0 msgr2=0x561872813e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:05:58.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.242+0000 7f2bc5c5eb80 1 -- 172.21.15.82:0/2594220126 shutdown_connections 2023-09-23T09:05:58.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.243+0000 7f2bc5c5eb80 1 -- 172.21.15.82:0/2594220126 wait complete. 2023-09-23T09:05:58.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.243+0000 7f2bc5c5eb80 1 -- start start 2023-09-23T09:05:58.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.243+0000 7f2bc5c5eb80 1 Processor -- start 2023-09-23T09:05:58.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.244+0000 7f2bc5c5eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5618727fec40 0x56187280da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:58.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.244+0000 7f2bc5c5eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561872804380 0x56187280dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:58.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.244+0000 7f2bc5c5eb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561872804ca0 0x56187280eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:58.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.244+0000 7f2bc5c5eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56187280f240 con 0x5618727fec40 2023-09-23T09:05:58.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.244+0000 7f2bc5c5eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56187280f3b0 con 0x561872804380 2023-09-23T09:05:58.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.244+0000 7f2bc5c5eb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x56187280f570 con 0x561872804ca0 2023-09-23T09:05:58.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.244+0000 7f2bc5c5eb80 10 client.0 _ll_register_callbacks cb 0x7f2ba0098920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:05:58.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.244+0000 7f2babfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5618727fec40 0x56187280da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:58.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.244+0000 7f2bab7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561872804380 0x56187280dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:58.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.244+0000 7f2babfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5618727fec40 0x56187280da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58858/0 (socket says 172.21.15.82:58858) 2023-09-23T09:05:58.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.244+0000 7f2babfff700 1 -- 172.21.15.82:0/179971657 learned_addr learned my addr 172.21.15.82:0/179971657 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:05:58.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.244+0000 7f2bb099c700 1 --2- 172.21.15.82:0/179971657 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561872804ca0 0x56187280eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:58.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.244+0000 7f2babfff700 1 -- 172.21.15.82:0/179971657 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561872804ca0 msgr2=0x56187280eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:05:58.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.244+0000 7f2babfff700 1 --2- 172.21.15.82:0/179971657 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561872804ca0 0x56187280eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.244+0000 7f2babfff700 1 -- 172.21.15.82:0/179971657 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561872804380 msgr2=0x56187280dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:05:58.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.244+0000 7f2babfff700 1 --2- 172.21.15.82:0/179971657 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561872804380 0x56187280dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.244+0000 7f2babfff700 1 -- 172.21.15.82:0/179971657 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bac110200 con 0x5618727fec40 2023-09-23T09:05:58.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.244+0000 7f2bb099c700 1 --2- 172.21.15.82:0/179971657 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561872804ca0 0x56187280eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:05:58.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.244+0000 7f2bab7fe700 1 --2- 172.21.15.82:0/179971657 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561872804380 0x56187280dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:05:58.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.245+0000 7f2babfff700 1 --2- 172.21.15.82:0/179971657 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5618727fec40 0x56187280da60 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c000c00 tx=0x7f2b9c00bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10e717f1a40dd34c server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:05:58.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.245+0000 7f2b8b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:05:58.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.245+0000 7f2b8b7fe700 1 -- 172.21.15.82:0/179971657 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9c01d030 con 0x5618727fec40 2023-09-23T09:05:58.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.245+0000 7f2bc5c5eb80 1 -- 172.21.15.82:0/179971657 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5618727f18b0 con 0x5618727fec40 2023-09-23T09:05:58.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.245+0000 7f2b8b7fe700 1 -- 172.21.15.82:0/179971657 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f2b9c028240 con 0x5618727fec40 2023-09-23T09:05:58.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.245+0000 7f2b8b7fe700 1 -- 172.21.15.82:0/179971657 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2b9c028400 con 0x5618727fec40 2023-09-23T09:05:58.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.245+0000 7f2bc5c5eb80 10 client.16248 fetch_fsmap learned FSMap version 55 2023-09-23T09:05:58.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.245+0000 7f2bc5c5eb80 1 -- 172.21.15.82:0/179971657 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x561872565c60 con 0x5618727fec40 2023-09-23T09:05:58.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.245+0000 7f2b8b7fe700 1 -- 172.21.15.82:0/179971657 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5618727f18b0 con 0x5618727fec40 2023-09-23T09:05:58.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.246+0000 7f2b8b7fe700 1 -- 172.21.15.82:0/179971657 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 55) v1 ==== 7934+0+0 (secure 0 0 0) 0x7f2b9c004ae0 con 0x5618727fec40 2023-09-23T09:05:58.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.246+0000 7f2bc5c5eb80 10 client.16248 fetch_fsmap finished waiting for FSMap version 55 2023-09-23T09:05:58.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.246+0000 7f2bc5c5eb80 10 client.16248 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2023-09-23T09:05:58.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.246+0000 7f2bc5c5eb80 20 client.16248 populate_metadata read hostname 'smithi082' 2023-09-23T09:05:58.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.246+0000 7f2bc5c5eb80 1 --2- 172.21.15.82:0/179971657 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x56187286cf90 0x56187286f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:58.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.246+0000 7f2bc5c5eb80 4 client.16248 mds_command: new command op to 24515 tid=0[{"prefix": "damage ls"}] 2023-09-23T09:05:58.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.246+0000 7f2bc5c5eb80 1 -- 172.21.15.82:0/179971657 --> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x561872749970 con 0x56187286cf90 2023-09-23T09:05:58.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.246+0000 7f2bab7fe700 1 --2- 172.21.15.82:0/179971657 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x56187286cf90 0x56187286f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:58.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.247+0000 7f2bab7fe700 1 --2- 172.21.15.82:0/179971657 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x56187286cf90 0x56187286f3b0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=67e86fc07a6181f9 server_cookie=2abe8c805cfb0dca in_seq=0 out_seq=0 2023-09-23T09:05:58.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.247+0000 7f2b8b7fe700 10 client.16248 ms_handle_connect on v2:172.21.15.135:6836/2655304858 2023-09-23T09:05:58.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.247+0000 7f2b8b7fe700 1 -- 172.21.15.82:0/179971657 <== mds.3 v2:172.21.15.135:6836/2655304858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x561872749970 con 0x56187286cf90 2023-09-23T09:05:58.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.247+0000 7f2b8b7fe700 10 client.16248 handle_command_reply: tid=0 2023-09-23T09:05:58.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.247+0000 7f2bc5c5eb80 1 client.16248 shutdown 2023-09-23T09:05:58.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.247+0000 7f2bc5c5eb80 1 -- 172.21.15.82:0/179971657 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5618727fec40 msgr2=0x56187280da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:05:58.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.247+0000 7f2bc5c5eb80 1 --2- 172.21.15.82:0/179971657 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5618727fec40 0x56187280da60 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c000c00 tx=0x7f2b9c00bf40 comp rx=0 tx=0).stop 2023-09-23T09:05:58.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.247+0000 7f2bc5c5eb80 1 -- 172.21.15.82:0/179971657 shutdown_connections 2023-09-23T09:05:58.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.247+0000 7f2bc5c5eb80 1 --2- 172.21.15.82:0/179971657 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x56187286cf90 0x56187286f3b0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.247+0000 7f2bc5c5eb80 1 --2- 172.21.15.82:0/179971657 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561872804ca0 0x56187280eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.247+0000 7f2bc5c5eb80 1 --2- 172.21.15.82:0/179971657 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5618727fec40 0x56187280da60 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.247+0000 7f2b8b7fe700 0 client.16248 ms_handle_reset on v2:172.21.15.135:6836/2655304858 2023-09-23T09:05:58.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.247+0000 7f2bc5c5eb80 1 --2- 172.21.15.82:0/179971657 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561872804380 0x56187280dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.247+0000 7f2bc5c5eb80 1 -- 172.21.15.82:0/179971657 >> 172.21.15.82:0/179971657 conn(0x5618727730e0 msgr2=0x5618728020b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:05:58.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.247+0000 7f2bc5c5eb80 1 -- 172.21.15.82:0/179971657 shutdown_connections 2023-09-23T09:05:58.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.247+0000 7f2bc5c5eb80 1 -- 172.21.15.82:0/179971657 wait complete. 2023-09-23T09:05:58.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.247+0000 7f2bc5c5eb80 20 client.16248 trim_cache size 0 max 16384 2023-09-23T09:05:58.256 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2023-09-23T09:05:58.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.248+0000 7f2bb23ff700 1 -- 172.21.15.82:0/897291475 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f2b940a0140 msgr2=0x7f2b940a2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:05:58.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.248+0000 7f2bb23ff700 1 --2- 172.21.15.82:0/897291475 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f2b940a0140 0x7f2b940a2600 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2ba4009ec0 tx=0x7f2ba4004b40 comp rx=0 tx=0).stop 2023-09-23T09:05:58.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.248+0000 7f2bb23ff700 1 -- 172.21.15.82:0/897291475 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2bac073670 msgr2=0x7f2bac19ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:05:58.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.248+0000 7f2bb23ff700 1 --2- 172.21.15.82:0/897291475 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2bac073670 0x7f2bac19ee50 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2ba000e9f0 tx=0x7f2ba000ed00 comp rx=0 tx=0).stop 2023-09-23T09:05:58.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.248+0000 7f2bb23ff700 1 -- 172.21.15.82:0/897291475 shutdown_connections 2023-09-23T09:05:58.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.248+0000 7f2bb23ff700 1 --2- 172.21.15.82:0/897291475 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f2b940a0140 0x7f2b940a2600 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.248+0000 7f2bb23ff700 1 --2- 172.21.15.82:0/897291475 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2bac10d0d0 0x7f2bac198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.248+0000 7f2bb23ff700 1 --2- 172.21.15.82:0/897291475 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bac072d50 0x7f2bac19e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.248+0000 7f2bb23ff700 1 --2- 172.21.15.82:0/897291475 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2bac073670 0x7f2bac19ee50 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.248+0000 7f2bb23ff700 1 -- 172.21.15.82:0/897291475 >> 172.21.15.82:0/897291475 conn(0x7f2bac0fc380 msgr2=0x7f2bac0fcff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:05:58.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.248+0000 7f2bb23ff700 1 -- 172.21.15.82:0/897291475 shutdown_connections 2023-09-23T09:05:58.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.248+0000 7f2bb23ff700 1 -- 172.21.15.82:0/897291475 wait complete. 2023-09-23T09:05:58.271 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-09-23T09:05:58.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.495+0000 7fef82bff700 1 -- 172.21.15.82:0/1352141716 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef7c10ae50 msgr2=0x7fef7c10d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:05:58.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.495+0000 7fef82bff700 1 --2- 172.21.15.82:0/1352141716 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef7c10ae50 0x7fef7c10d310 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fef7400b0a0 tx=0x7fef7400b3b0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.495+0000 7fef82bff700 1 -- 172.21.15.82:0/1352141716 shutdown_connections 2023-09-23T09:05:58.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.495+0000 7fef82bff700 1 --2- 172.21.15.82:0/1352141716 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef7c10ae50 0x7fef7c10d310 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.495+0000 7fef82bff700 1 --2- 172.21.15.82:0/1352141716 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fef7c101a30 0x7fef7c101e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.495+0000 7fef82bff700 1 --2- 172.21.15.82:0/1352141716 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef7c102350 0x7fef7c10a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.500 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.495+0000 7fef82bff700 1 -- 172.21.15.82:0/1352141716 >> 172.21.15.82:0/1352141716 conn(0x7fef7c0fb270 msgr2=0x7fef7c0fd690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:05:58.500 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.495+0000 7fef82bff700 1 -- 172.21.15.82:0/1352141716 shutdown_connections 2023-09-23T09:05:58.500 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.495+0000 7fef82bff700 1 -- 172.21.15.82:0/1352141716 wait complete. 2023-09-23T09:05:58.500 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.497+0000 7fef82bff700 1 Processor -- start 2023-09-23T09:05:58.500 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.497+0000 7fef82bff700 1 -- start start 2023-09-23T09:05:58.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.497+0000 7fef82bff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef7c101a30 0x7fef7c19e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:58.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.497+0000 7fef82bff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef7c102350 0x7fef7c19eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:58.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.497+0000 7fef82bff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fef7c10ae50 0x7fef7c1989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:58.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.497+0000 7fef82bff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef7c199060 con 0x7fef7c101a30 2023-09-23T09:05:58.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.497+0000 7fef82bff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef7c1991d0 con 0x7fef7c102350 2023-09-23T09:05:58.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.497+0000 7fef82bff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef7c199390 con 0x7fef7c10ae50 2023-09-23T09:05:58.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.498+0000 7fef8099b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef7c101a30 0x7fef7c19e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:58.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.498+0000 7fef7bfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef7c102350 0x7fef7c19eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:58.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.498+0000 7fef8099b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef7c101a30 0x7fef7c19e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58878/0 (socket says 172.21.15.82:58878) 2023-09-23T09:05:58.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.498+0000 7fef8099b700 1 -- 172.21.15.82:0/1417052684 learned_addr learned my addr 172.21.15.82:0/1417052684 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:05:58.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.498+0000 7fef8119c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fef7c10ae50 0x7fef7c1989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:58.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.498+0000 7fef7bfff700 1 -- 172.21.15.82:0/1417052684 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fef7c10ae50 msgr2=0x7fef7c1989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:05:58.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.498+0000 7fef7bfff700 1 --2- 172.21.15.82:0/1417052684 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fef7c10ae50 0x7fef7c1989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.498+0000 7fef7bfff700 1 -- 172.21.15.82:0/1417052684 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef7c101a30 msgr2=0x7fef7c19e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:05:58.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.498+0000 7fef7bfff700 1 --2- 172.21.15.82:0/1417052684 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef7c101a30 0x7fef7c19e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.498+0000 7fef7bfff700 1 -- 172.21.15.82:0/1417052684 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef74009d00 con 0x7fef7c102350 2023-09-23T09:05:58.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.498+0000 7fef8099b700 1 --2- 172.21.15.82:0/1417052684 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef7c101a30 0x7fef7c19e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:05:58.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.499+0000 7fef7bfff700 1 --2- 172.21.15.82:0/1417052684 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef7c102350 0x7fef7c19eec0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fef6800e9f0 tx=0x7fef6800ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:05:58.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.499+0000 7fef79ffb700 1 -- 172.21.15.82:0/1417052684 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef6800c9c0 con 0x7fef7c102350 2023-09-23T09:05:58.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.499+0000 7fef82bff700 1 -- 172.21.15.82:0/1417052684 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef7c199670 con 0x7fef7c102350 2023-09-23T09:05:58.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.499+0000 7fef79ffb700 1 -- 172.21.15.82:0/1417052684 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fef68010430 con 0x7fef7c102350 2023-09-23T09:05:58.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.499+0000 7fef79ffb700 1 -- 172.21.15.82:0/1417052684 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef68018680 con 0x7fef7c102350 2023-09-23T09:05:58.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.499+0000 7fef82bff700 1 -- 172.21.15.82:0/1417052684 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef7c1a5970 con 0x7fef7c102350 2023-09-23T09:05:58.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.503+0000 7fef79ffb700 1 -- 172.21.15.82:0/1417052684 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7fef680105a0 con 0x7fef7c102350 2023-09-23T09:05:58.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.504+0000 7fef9653db80 1 Processor -- start 2023-09-23T09:05:58.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.505+0000 7fef9653db80 1 -- start start 2023-09-23T09:05:58.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.505+0000 7fef9653db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591edd56380 0x5591edd56760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:58.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.505+0000 7fef9653db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591edd56ca0 0x5591edd50700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:58.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.505+0000 7fef9653db80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5591edd50c40 0x5591edd510a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:58.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.505+0000 7fef9653db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591edcb87b0 con 0x5591edd56ca0 2023-09-23T09:05:58.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.505+0000 7fef9653db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591edca9780 con 0x5591edd56380 2023-09-23T09:05:58.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.505+0000 7fef9653db80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591edca70a0 con 0x5591edd50c40 2023-09-23T09:05:58.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.505+0000 7fef79ffb700 1 --2- 172.21.15.82:0/1417052684 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fef6c0a00c0 0x7fef6c0a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:58.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.505+0000 7fef8119c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591edd56380 0x5591edd56760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:58.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.506+0000 7fef8119c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591edd56380 0x5591edd56760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:60812/0 (socket says 172.21.15.82:60812) 2023-09-23T09:05:58.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.506+0000 7fef8119c700 1 -- 172.21.15.82:0/3540302950 learned_addr learned my addr 172.21.15.82:0/3540302950 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:05:58.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.506+0000 7fef7bfff700 1 --2- 172.21.15.82:0/3540302950 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5591edd50c40 0x5591edd510a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:58.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.506+0000 7fef8099b700 1 --2- 172.21.15.82:0/3540302950 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591edd56ca0 0x5591edd50700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:58.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.506+0000 7fef79ffb700 1 -- 172.21.15.82:0/1417052684 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fef68014070 con 0x7fef7c102350 2023-09-23T09:05:58.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.506+0000 7fef8119c700 1 --2- 172.21.15.82:0/1417052684 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fef6c0a00c0 0x7fef6c0a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:58.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.506+0000 7fef7bfff700 1 -- 172.21.15.82:0/3540302950 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591edd56380 msgr2=0x5591edd56760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:05:58.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.506+0000 7fef7bfff700 1 --2- 172.21.15.82:0/3540302950 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591edd56380 0x5591edd56760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.506+0000 7fef7bfff700 1 -- 172.21.15.82:0/3540302950 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591edd56ca0 msgr2=0x5591edd50700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:05:58.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.506+0000 7fef7bfff700 1 --2- 172.21.15.82:0/3540302950 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591edd56ca0 0x5591edd50700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.506+0000 7fef7bfff700 1 -- 172.21.15.82:0/3540302950 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5591edb22630 con 0x5591edd50c40 2023-09-23T09:05:58.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.506+0000 7fef7bfff700 1 --2- 172.21.15.82:0/3540302950 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5591edd50c40 0x5591edd510a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fef680c8dd0 tx=0x7fef68064820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b2989371b3a74a7 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:05:58.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.507+0000 7fef66ffd700 1 -- 172.21.15.82:0/3540302950 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef680988d0 con 0x5591edd50c40 2023-09-23T09:05:58.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.507+0000 7fef66ffd700 1 -- 172.21.15.82:0/3540302950 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fef680986f0 con 0x5591edd50c40 2023-09-23T09:05:58.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.507+0000 7fef66ffd700 1 -- 172.21.15.82:0/3540302950 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef68098d90 con 0x5591edd50c40 2023-09-23T09:05:58.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.507+0000 7fef8119c700 1 --2- 172.21.15.82:0/1417052684 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fef6c0a00c0 0x7fef6c0a2580 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fef74009610 tx=0x7fef7400b3b0 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:05:58.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.507+0000 7fef9653db80 1 -- 172.21.15.82:0/3540302950 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5591edd50c40 msgr2=0x5591edd510a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:05:58.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.507+0000 7fef9653db80 1 --2- 172.21.15.82:0/3540302950 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5591edd50c40 0x5591edd510a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fef680c8dd0 tx=0x7fef68064820 comp rx=0 tx=0).stop 2023-09-23T09:05:58.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.508+0000 7fef9653db80 1 -- 172.21.15.82:0/3540302950 shutdown_connections 2023-09-23T09:05:58.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.508+0000 7fef9653db80 1 --2- 172.21.15.82:0/3540302950 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5591edd50c40 0x5591edd510a0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.508+0000 7fef9653db80 1 --2- 172.21.15.82:0/3540302950 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591edd56380 0x5591edd56760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.508+0000 7fef9653db80 1 --2- 172.21.15.82:0/3540302950 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591edd56ca0 0x5591edd50700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.508+0000 7fef9653db80 1 -- 172.21.15.82:0/3540302950 >> 172.21.15.82:0/3540302950 conn(0x5591edcc50e0 msgr2=0x5591edd4b410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:05:58.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.508+0000 7fef9653db80 1 -- 172.21.15.82:0/3540302950 shutdown_connections 2023-09-23T09:05:58.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.508+0000 7fef9653db80 1 -- 172.21.15.82:0/3540302950 wait complete. 2023-09-23T09:05:58.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.508+0000 7fef9653db80 1 -- start start 2023-09-23T09:05:58.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.508+0000 7fef9653db80 1 Processor -- start 2023-09-23T09:05:58.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.509+0000 7fef9653db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591edd50c40 0x5591edd59f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:58.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.509+0000 7fef9653db80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5591edd56380 0x5591edd5a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:58.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.509+0000 7fef9653db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591edd56ca0 0x5591edd5a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:58.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.509+0000 7fef9653db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591edca2990 con 0x5591edd56ca0 2023-09-23T09:05:58.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.509+0000 7fef9653db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591edc40bb0 con 0x5591edd50c40 2023-09-23T09:05:58.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.509+0000 7fef9653db80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591edc408b0 con 0x5591edd56380 2023-09-23T09:05:58.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.509+0000 7fef9653db80 10 client.0 _ll_register_callbacks cb 0x5591edb8aa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:05:58.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.509+0000 7fef8119c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591edd56ca0 0x5591edd5a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:58.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.509+0000 7fef7bfff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5591edd56380 0x5591edd5a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:58.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.509+0000 7fef8099b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591edd50c40 0x5591edd59f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:58.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.509+0000 7fef7bfff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5591edd56380 0x5591edd5a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:49498/0 (socket says 172.21.15.82:49498) 2023-09-23T09:05:58.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.509+0000 7fef7bfff700 1 -- 172.21.15.82:0/2390345706 learned_addr learned my addr 172.21.15.82:0/2390345706 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:05:58.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.510+0000 7fef8099b700 1 -- 172.21.15.82:0/2390345706 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5591edd56380 msgr2=0x5591edd5a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:05:58.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.510+0000 7fef8099b700 1 --2- 172.21.15.82:0/2390345706 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5591edd56380 0x5591edd5a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.510+0000 7fef8099b700 1 -- 172.21.15.82:0/2390345706 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591edd56ca0 msgr2=0x5591edd5a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:05:58.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.510+0000 7fef8099b700 1 --2- 172.21.15.82:0/2390345706 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591edd56ca0 0x5591edd5a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.510+0000 7fef8099b700 1 -- 172.21.15.82:0/2390345706 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef7c1a5970 con 0x5591edd50c40 2023-09-23T09:05:58.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.510+0000 7fef7bfff700 1 --2- 172.21.15.82:0/2390345706 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5591edd56380 0x5591edd5a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:05:58.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.510+0000 7fef8119c700 1 --2- 172.21.15.82:0/2390345706 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591edd56ca0 0x5591edd5a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:05:58.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.510+0000 7fef8099b700 1 --2- 172.21.15.82:0/2390345706 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591edd50c40 0x5591edd59f70 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fef700096b0 tx=0x7fef70009e10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a55d99d8b2ee9e1 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:05:58.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.510+0000 7fef5bfff700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-09-23T09:05:58.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.510+0000 7fef5bfff700 1 -- 172.21.15.82:0/2390345706 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef70017070 con 0x5591edd50c40 2023-09-23T09:05:58.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.510+0000 7fef5bfff700 1 -- 172.21.15.82:0/2390345706 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fef70004050 con 0x5591edd50c40 2023-09-23T09:05:58.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.510+0000 7fef9653db80 1 -- 172.21.15.82:0/2390345706 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5591edd201c0 con 0x5591edd50c40 2023-09-23T09:05:58.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.511+0000 7fef5bfff700 1 -- 172.21.15.82:0/2390345706 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7fef70004210 con 0x5591edd50c40 2023-09-23T09:05:58.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.511+0000 7fef9653db80 10 client.25952 fetch_fsmap learned FSMap version 55 2023-09-23T09:05:58.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.511+0000 7fef9653db80 1 -- 172.21.15.82:0/2390345706 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x5591edacede0 con 0x5591edd50c40 2023-09-23T09:05:58.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.511+0000 7fef5bfff700 1 -- 172.21.15.82:0/2390345706 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5591edd201c0 con 0x5591edd50c40 2023-09-23T09:05:58.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.511+0000 7fef5bfff700 1 -- 172.21.15.82:0/2390345706 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 55) v1 ==== 7934+0+0 (secure 0 0 0) 0x7fef70003730 con 0x5591edd50c40 2023-09-23T09:05:58.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.511+0000 7fef9653db80 10 client.25952 fetch_fsmap finished waiting for FSMap version 55 2023-09-23T09:05:58.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.511+0000 7fef9653db80 10 client.25952 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-09-23T09:05:58.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.511+0000 7fef9653db80 20 client.25952 populate_metadata read hostname 'smithi082' 2023-09-23T09:05:58.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.511+0000 7fef9653db80 1 --2- 172.21.15.82:0/2390345706 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x5591edd6a890 0x5591edd6ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:58.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.511+0000 7fef9653db80 4 client.25952 mds_command: new command op to 24526 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:05:58.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.511+0000 7fef9653db80 1 -- 172.21.15.82:0/2390345706 --> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5591edc48ba0 con 0x5591edd6a890 2023-09-23T09:05:58.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.512+0000 7fef7bfff700 1 --2- 172.21.15.82:0/2390345706 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x5591edd6a890 0x5591edd6ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:58.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.512+0000 7fef5bfff700 10 client.25952 ms_handle_connect on v2:172.21.15.161:6836/43639843 2023-09-23T09:05:58.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.512+0000 7fef7bfff700 1 --2- 172.21.15.82:0/2390345706 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x5591edd6a890 0x5591edd6ccb0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=385bb42bb7b555d4 server_cookie=50c79683fbb8679d in_seq=0 out_seq=0 2023-09-23T09:05:58.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.513+0000 7fef5bfff700 1 -- 172.21.15.82:0/2390345706 <== mds.2 v2:172.21.15.161:6836/43639843 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5591edc48ba0 con 0x5591edd6a890 2023-09-23T09:05:58.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.513+0000 7fef5bfff700 10 client.25952 handle_command_reply: tid=0 2023-09-23T09:05:58.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.513+0000 7fef9653db80 1 client.25952 shutdown 2023-09-23T09:05:58.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.513+0000 7fef9653db80 1 -- 172.21.15.82:0/2390345706 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591edd50c40 msgr2=0x5591edd59f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:05:58.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.513+0000 7fef9653db80 1 --2- 172.21.15.82:0/2390345706 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591edd50c40 0x5591edd59f70 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fef700096b0 tx=0x7fef70009e10 comp rx=0 tx=0).stop 2023-09-23T09:05:58.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.513+0000 7fef9653db80 1 -- 172.21.15.82:0/2390345706 shutdown_connections 2023-09-23T09:05:58.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.513+0000 7fef9653db80 1 --2- 172.21.15.82:0/2390345706 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x5591edd6a890 0x5591edd6ccb0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.513+0000 7fef9653db80 1 --2- 172.21.15.82:0/2390345706 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591edd56ca0 0x5591edd5a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.513+0000 7fef9653db80 1 --2- 172.21.15.82:0/2390345706 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591edd50c40 0x5591edd59f70 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.513+0000 7fef9653db80 1 --2- 172.21.15.82:0/2390345706 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5591edd56380 0x5591edd5a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.513+0000 7fef5bfff700 0 client.25952 ms_handle_reset on v2:172.21.15.161:6836/43639843 2023-09-23T09:05:58.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.513+0000 7fef9653db80 1 -- 172.21.15.82:0/2390345706 >> 172.21.15.82:0/2390345706 conn(0x5591edcc50e0 msgr2=0x5591edd45b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:05:58.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.513+0000 7fef9653db80 1 -- 172.21.15.82:0/2390345706 shutdown_connections 2023-09-23T09:05:58.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.513+0000 7fef9653db80 1 -- 172.21.15.82:0/2390345706 wait complete. 2023-09-23T09:05:58.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.514+0000 7fef9653db80 20 client.25952 trim_cache size 0 max 16384 2023-09-23T09:05:58.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.528+0000 7fef9653db80 1 Processor -- start 2023-09-23T09:05:58.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.528+0000 7fef9653db80 1 -- start start 2023-09-23T09:05:58.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.528+0000 7fef9653db80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5591edd50c40 0x5591edd50700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:58.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.528+0000 7fef9653db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591edd56380 0x5591edd61790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:58.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.528+0000 7fef9653db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591edd56ca0 0x5591edd59530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:58.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.528+0000 7fef9653db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591edb24920 con 0x5591edd56380 2023-09-23T09:05:58.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.528+0000 7fef9653db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591edd4c3b0 con 0x5591edd56ca0 2023-09-23T09:05:58.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.528+0000 7fef9653db80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591edd4b980 con 0x5591edd50c40 2023-09-23T09:05:58.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.529+0000 7fef7bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591edd56380 0x5591edd61790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:58.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.529+0000 7fef8119c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591edd56ca0 0x5591edd59530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:58.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.529+0000 7fef8099b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5591edd50c40 0x5591edd50700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:58.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.529+0000 7fef8099b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5591edd50c40 0x5591edd50700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:49510/0 (socket says 172.21.15.82:49510) 2023-09-23T09:05:58.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.529+0000 7fef8119c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591edd56ca0 0x5591edd59530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:60832/0 (socket says 172.21.15.82:60832) 2023-09-23T09:05:58.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.529+0000 7fef8099b700 1 -- 172.21.15.82:0/3830232408 learned_addr learned my addr 172.21.15.82:0/3830232408 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:05:58.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.529+0000 7fef8099b700 1 -- 172.21.15.82:0/3830232408 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591edd56ca0 msgr2=0x5591edd59530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:05:58.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.529+0000 7fef8099b700 1 --2- 172.21.15.82:0/3830232408 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591edd56ca0 0x5591edd59530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.529+0000 7fef8099b700 1 -- 172.21.15.82:0/3830232408 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591edd56380 msgr2=0x5591edd61790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:05:58.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.529+0000 7fef8099b700 1 --2- 172.21.15.82:0/3830232408 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591edd56380 0x5591edd61790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.529+0000 7fef8099b700 1 -- 172.21.15.82:0/3830232408 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5591edd718c0 con 0x5591edd50c40 2023-09-23T09:05:58.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.529+0000 7fef8119c700 1 --2- 172.21.15.82:0/3830232408 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591edd56ca0 0x5591edd59530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:05:58.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.530+0000 7fef8099b700 1 --2- 172.21.15.82:0/3830232408 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5591edd50c40 0x5591edd50700 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fef70010450 tx=0x7fef7000f720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=919f6e962daf1a46 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:05:58.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.530+0000 7fef677fe700 1 -- 172.21.15.82:0/3830232408 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef70017040 con 0x5591edd50c40 2023-09-23T09:05:58.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.530+0000 7fef677fe700 1 -- 172.21.15.82:0/3830232408 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fef70005560 con 0x5591edd50c40 2023-09-23T09:05:58.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.530+0000 7fef677fe700 1 -- 172.21.15.82:0/3830232408 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef70010480 con 0x5591edd50c40 2023-09-23T09:05:58.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.531+0000 7fef9653db80 1 -- 172.21.15.82:0/3830232408 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5591edd50c40 msgr2=0x5591edd50700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:05:58.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.531+0000 7fef9653db80 1 --2- 172.21.15.82:0/3830232408 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5591edd50c40 0x5591edd50700 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fef70010450 tx=0x7fef7000f720 comp rx=0 tx=0).stop 2023-09-23T09:05:58.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.531+0000 7fef9653db80 1 -- 172.21.15.82:0/3830232408 shutdown_connections 2023-09-23T09:05:58.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.531+0000 7fef9653db80 1 --2- 172.21.15.82:0/3830232408 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591edd56ca0 0x5591edd59530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.531+0000 7fef9653db80 1 --2- 172.21.15.82:0/3830232408 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5591edd50c40 0x5591edd50700 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.531+0000 7fef9653db80 1 --2- 172.21.15.82:0/3830232408 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591edd56380 0x5591edd61790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.531+0000 7fef9653db80 1 -- 172.21.15.82:0/3830232408 >> 172.21.15.82:0/3830232408 conn(0x5591edcc50e0 msgr2=0x5591edd54090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:05:58.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.531+0000 7fef9653db80 1 -- 172.21.15.82:0/3830232408 shutdown_connections 2023-09-23T09:05:58.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.531+0000 7fef9653db80 1 -- 172.21.15.82:0/3830232408 wait complete. 2023-09-23T09:05:58.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.531+0000 7fef9653db80 1 -- start start 2023-09-23T09:05:58.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.531+0000 7fef9653db80 1 Processor -- start 2023-09-23T09:05:58.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.532+0000 7fef9653db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591edd50c40 0x5591edd5d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:58.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.532+0000 7fef9653db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591edd56380 0x5591edd5dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:58.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.532+0000 7fef9653db80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5591edd56ca0 0x5591edd5e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:58.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.532+0000 7fef9653db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591eddbd690 con 0x5591edd50c40 2023-09-23T09:05:58.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.532+0000 7fef9653db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591eddbd7d0 con 0x5591edd56380 2023-09-23T09:05:58.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.532+0000 7fef9653db80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591eddbd960 con 0x5591edd56ca0 2023-09-23T09:05:58.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.532+0000 7fef9653db80 10 client.0 _ll_register_callbacks cb 0x5591edb8aa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:05:58.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.532+0000 7fef8099b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591edd50c40 0x5591edd5d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:58.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.532+0000 7fef7bfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591edd56380 0x5591edd5dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:58.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.532+0000 7fef8119c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5591edd56ca0 0x5591edd5e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:58.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.532+0000 7fef8099b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591edd50c40 0x5591edd5d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58922/0 (socket says 172.21.15.82:58922) 2023-09-23T09:05:58.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.532+0000 7fef7bfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591edd56380 0x5591edd5dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:60838/0 (socket says 172.21.15.82:60838) 2023-09-23T09:05:58.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.532+0000 7fef8099b700 1 -- 172.21.15.82:0/3519753210 learned_addr learned my addr 172.21.15.82:0/3519753210 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:05:58.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.533+0000 7fef7bfff700 1 -- 172.21.15.82:0/3519753210 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5591edd56ca0 msgr2=0x5591edd5e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:05:58.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.533+0000 7fef7bfff700 1 --2- 172.21.15.82:0/3519753210 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5591edd56ca0 0x5591edd5e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.533+0000 7fef7bfff700 1 -- 172.21.15.82:0/3519753210 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591edd50c40 msgr2=0x5591edd5d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:05:58.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.533+0000 7fef7bfff700 1 --2- 172.21.15.82:0/3519753210 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591edd50c40 0x5591edd5d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.533+0000 7fef7bfff700 1 -- 172.21.15.82:0/3519753210 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef7c10dfd0 con 0x5591edd56380 2023-09-23T09:05:58.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.533+0000 7fef7bfff700 1 --2- 172.21.15.82:0/3519753210 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591edd56380 0x5591edd5dcb0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fef6800c5b0 tx=0x7fef680c8d60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7e8c09d83dbb3fc server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:05:58.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.533+0000 7fef5bfff700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-09-23T09:05:58.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.533+0000 7fef5bfff700 1 -- 172.21.15.82:0/3519753210 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef680b6730 con 0x5591edd56380 2023-09-23T09:05:58.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.533+0000 7fef5bfff700 1 -- 172.21.15.82:0/3519753210 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fef68010880 con 0x5591edd56380 2023-09-23T09:05:58.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.533+0000 7fef9653db80 1 -- 172.21.15.82:0/3519753210 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5591edd438b0 con 0x5591edd56380 2023-09-23T09:05:58.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.533+0000 7fef5bfff700 1 -- 172.21.15.82:0/3519753210 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7fef68099490 con 0x5591edd56380 2023-09-23T09:05:58.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.533+0000 7fef9653db80 10 client.25958 fetch_fsmap learned FSMap version 55 2023-09-23T09:05:58.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.533+0000 7fef9653db80 1 -- 172.21.15.82:0/3519753210 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x5591edacede0 con 0x5591edd56380 2023-09-23T09:05:58.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.534+0000 7fef5bfff700 1 -- 172.21.15.82:0/3519753210 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5591edd438b0 con 0x5591edd56380 2023-09-23T09:05:58.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.534+0000 7fef5bfff700 1 -- 172.21.15.82:0/3519753210 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 55) v1 ==== 7934+0+0 (secure 0 0 0) 0x7fef68064890 con 0x5591edd56380 2023-09-23T09:05:58.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.534+0000 7fef9653db80 10 client.25958 fetch_fsmap finished waiting for FSMap version 55 2023-09-23T09:05:58.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.534+0000 7fef9653db80 10 client.25958 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-09-23T09:05:58.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.534+0000 7fef9653db80 20 client.25958 populate_metadata read hostname 'smithi082' 2023-09-23T09:05:58.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.534+0000 7fef9653db80 1 --2- 172.21.15.82:0/3519753210 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x5591eddbedd0 0x5591eddc11f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:58.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.534+0000 7fef9653db80 4 client.25958 mds_command: new command op to 24526 tid=0[{"prefix": "damage ls"}] 2023-09-23T09:05:58.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.534+0000 7fef9653db80 1 -- 172.21.15.82:0/3519753210 --> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5591edc9b970 con 0x5591eddbedd0 2023-09-23T09:05:58.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.534+0000 7fef8099b700 1 --2- 172.21.15.82:0/3519753210 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x5591eddbedd0 0x5591eddc11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:58.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.535+0000 7fef8099b700 1 --2- 172.21.15.82:0/3519753210 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x5591eddbedd0 0x5591eddc11f0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ca38cb77848c56f6 server_cookie=29243ae7ee9e6c90 in_seq=0 out_seq=0 2023-09-23T09:05:58.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.535+0000 7fef5bfff700 10 client.25958 ms_handle_connect on v2:172.21.15.161:6836/43639843 2023-09-23T09:05:58.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.535+0000 7fef5bfff700 1 -- 172.21.15.82:0/3519753210 <== mds.2 v2:172.21.15.161:6836/43639843 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5591edc9b970 con 0x5591eddbedd0 2023-09-23T09:05:58.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.535+0000 7fef5bfff700 10 client.25958 handle_command_reply: tid=0 2023-09-23T09:05:58.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.535+0000 7fef9653db80 1 client.25958 shutdown 2023-09-23T09:05:58.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.535+0000 7fef9653db80 1 -- 172.21.15.82:0/3519753210 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591edd56380 msgr2=0x5591edd5dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:05:58.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.535+0000 7fef9653db80 1 --2- 172.21.15.82:0/3519753210 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591edd56380 0x5591edd5dcb0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fef6800c5b0 tx=0x7fef680c8d60 comp rx=0 tx=0).stop 2023-09-23T09:05:58.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.535+0000 7fef9653db80 1 -- 172.21.15.82:0/3519753210 shutdown_connections 2023-09-23T09:05:58.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.535+0000 7fef9653db80 1 --2- 172.21.15.82:0/3519753210 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x5591eddbedd0 0x5591eddc11f0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.535+0000 7fef9653db80 1 --2- 172.21.15.82:0/3519753210 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5591edd56ca0 0x5591edd5e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.535+0000 7fef9653db80 1 --2- 172.21.15.82:0/3519753210 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591edd50c40 0x5591edd5d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.535+0000 7fef9653db80 1 --2- 172.21.15.82:0/3519753210 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591edd56380 0x5591edd5dcb0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.535+0000 7fef5bfff700 0 client.25958 ms_handle_reset on v2:172.21.15.161:6836/43639843 2023-09-23T09:05:58.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.535+0000 7fef9653db80 1 -- 172.21.15.82:0/3519753210 >> 172.21.15.82:0/3519753210 conn(0x5591edcc50e0 msgr2=0x5591edd5a530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:05:58.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.535+0000 7fef9653db80 1 -- 172.21.15.82:0/3519753210 shutdown_connections 2023-09-23T09:05:58.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.535+0000 7fef9653db80 1 -- 172.21.15.82:0/3519753210 wait complete. 2023-09-23T09:05:58.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.536+0000 7fef9653db80 20 client.25958 trim_cache size 0 max 16384 2023-09-23T09:05:58.546 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2023-09-23T09:05:58.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.536+0000 7fef82bff700 1 -- 172.21.15.82:0/1417052684 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fef6c0a00c0 msgr2=0x7fef6c0a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:05:58.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.536+0000 7fef82bff700 1 --2- 172.21.15.82:0/1417052684 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fef6c0a00c0 0x7fef6c0a2580 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fef74009610 tx=0x7fef7400b3b0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.536+0000 7fef82bff700 1 -- 172.21.15.82:0/1417052684 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef7c102350 msgr2=0x7fef7c19eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:05:58.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.536+0000 7fef82bff700 1 --2- 172.21.15.82:0/1417052684 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef7c102350 0x7fef7c19eec0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fef6800e9f0 tx=0x7fef6800ed00 comp rx=0 tx=0).stop 2023-09-23T09:05:58.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.536+0000 7fef82bff700 1 -- 172.21.15.82:0/1417052684 shutdown_connections 2023-09-23T09:05:58.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.536+0000 7fef82bff700 1 --2- 172.21.15.82:0/1417052684 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fef6c0a00c0 0x7fef6c0a2580 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.536+0000 7fef82bff700 1 --2- 172.21.15.82:0/1417052684 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fef7c10ae50 0x7fef7c1989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.536+0000 7fef82bff700 1 --2- 172.21.15.82:0/1417052684 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef7c101a30 0x7fef7c19e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.536+0000 7fef82bff700 1 --2- 172.21.15.82:0/1417052684 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef7c102350 0x7fef7c19eec0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.536+0000 7fef82bff700 1 -- 172.21.15.82:0/1417052684 >> 172.21.15.82:0/1417052684 conn(0x7fef7c0fb270 msgr2=0x7fef7c0fd660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:05:58.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.537+0000 7fef82bff700 1 -- 172.21.15.82:0/1417052684 shutdown_connections 2023-09-23T09:05:58.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.537+0000 7fef82bff700 1 -- 172.21.15.82:0/1417052684 wait complete. 2023-09-23T09:05:58.559 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-09-23T09:05:58.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.781+0000 7f82f07ff700 1 -- 172.21.15.82:0/656456989 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f82e8101250 msgr2=0x7f82e810d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:05:58.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.781+0000 7f82f07ff700 1 --2- 172.21.15.82:0/656456989 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f82e8101250 0x7f82e810d760 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f82e000b0a0 tx=0x7f82e000b3b0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.781+0000 7f82f07ff700 1 -- 172.21.15.82:0/656456989 shutdown_connections 2023-09-23T09:05:58.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.781+0000 7f82f07ff700 1 --2- 172.21.15.82:0/656456989 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f82e8101250 0x7f82e810d760 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.781+0000 7f82f07ff700 1 --2- 172.21.15.82:0/656456989 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82e81068a0 0x7f82e8106c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.781+0000 7f82f07ff700 1 --2- 172.21.15.82:0/656456989 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f82e8100890 0x7f82e8100d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.781+0000 7f82f07ff700 1 -- 172.21.15.82:0/656456989 >> 172.21.15.82:0/656456989 conn(0x7f82e80fc380 msgr2=0x7f82e80fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:05:58.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.781+0000 7f82f07ff700 1 -- 172.21.15.82:0/656456989 shutdown_connections 2023-09-23T09:05:58.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.781+0000 7f82f07ff700 1 -- 172.21.15.82:0/656456989 wait complete. 2023-09-23T09:05:58.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.782+0000 7f82f07ff700 1 Processor -- start 2023-09-23T09:05:58.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.782+0000 7f82f07ff700 1 -- start start 2023-09-23T09:05:58.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.783+0000 7f82f07ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f82e8100890 0x7f82e819c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:58.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.783+0000 7f82f07ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f82e8101250 0x7f82e819cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:58.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.783+0000 7f82f07ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82e81068a0 0x7f82e8196650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:58.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.783+0000 7f82f07ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e8196cc0 con 0x7f82e8100890 2023-09-23T09:05:58.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.783+0000 7f82f07ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e8196e30 con 0x7f82e81068a0 2023-09-23T09:05:58.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.783+0000 7f82f07ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e8196ff0 con 0x7f82e8101250 2023-09-23T09:05:58.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.783+0000 7f82ee59b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f82e8100890 0x7f82e819c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:58.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.783+0000 7f82edd9a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f82e8101250 0x7f82e819cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:58.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.783+0000 7f82eed9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82e81068a0 0x7f82e8196650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:58.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.783+0000 7f82edd9a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f82e8101250 0x7f82e819cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:49532/0 (socket says 172.21.15.82:49532) 2023-09-23T09:05:58.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.783+0000 7f82ee59b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f82e8100890 0x7f82e819c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58952/0 (socket says 172.21.15.82:58952) 2023-09-23T09:05:58.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.783+0000 7f82edd9a700 1 -- 172.21.15.82:0/2511086430 learned_addr learned my addr 172.21.15.82:0/2511086430 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:05:58.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.784+0000 7f82edd9a700 1 -- 172.21.15.82:0/2511086430 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82e81068a0 msgr2=0x7f82e8196650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:05:58.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.784+0000 7f82edd9a700 1 --2- 172.21.15.82:0/2511086430 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82e81068a0 0x7f82e8196650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.784+0000 7f82edd9a700 1 -- 172.21.15.82:0/2511086430 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f82e8100890 msgr2=0x7f82e819c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:05:58.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.784+0000 7f82edd9a700 1 --2- 172.21.15.82:0/2511086430 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f82e8100890 0x7f82e819c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.784+0000 7f82edd9a700 1 -- 172.21.15.82:0/2511086430 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82e0009d00 con 0x7f82e8101250 2023-09-23T09:05:58.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.784+0000 7f82edd9a700 1 --2- 172.21.15.82:0/2511086430 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f82e8101250 0x7f82e819cb20 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f82d800e9a0 tx=0x7f82d800ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:05:58.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.785+0000 7f82df7fe700 1 -- 172.21.15.82:0/2511086430 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d8009790 con 0x7f82e8101250 2023-09-23T09:05:58.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.785+0000 7f82f07ff700 1 -- 172.21.15.82:0/2511086430 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82e81972d0 con 0x7f82e8101250 2023-09-23T09:05:58.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.785+0000 7f82df7fe700 1 -- 172.21.15.82:0/2511086430 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f82d8010430 con 0x7f82e8101250 2023-09-23T09:05:58.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.785+0000 7f82df7fe700 1 -- 172.21.15.82:0/2511086430 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d800cea0 con 0x7f82e8101250 2023-09-23T09:05:58.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.785+0000 7f82f07ff700 1 -- 172.21.15.82:0/2511086430 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82e81a35d0 con 0x7f82e8101250 2023-09-23T09:05:58.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.788+0000 7f82df7fe700 1 -- 172.21.15.82:0/2511086430 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f82d80105a0 con 0x7f82e8101250 2023-09-23T09:05:58.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.790+0000 7f830411bb80 1 Processor -- start 2023-09-23T09:05:58.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.790+0000 7f82df7fe700 1 --2- 172.21.15.82:0/2511086430 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f82d40a00c0 0x7f82d40a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:58.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.790+0000 7f830411bb80 1 -- start start 2023-09-23T09:05:58.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.790+0000 7f82df7fe700 1 -- 172.21.15.82:0/2511086430 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f82d8014070 con 0x7f82e8101250 2023-09-23T09:05:58.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.790+0000 7f82eed9c700 1 --2- 172.21.15.82:0/2511086430 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f82d40a00c0 0x7f82d40a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:58.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.790+0000 7f830411bb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556da01c9380 0x556da01c9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:58.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.790+0000 7f830411bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556da01c9ca0 0x556da01c3700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:58.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.790+0000 7f830411bb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556da01c3c40 0x556da01c40a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:58.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.790+0000 7f830411bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x556da012b7b0 con 0x556da01c9ca0 2023-09-23T09:05:58.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.790+0000 7f830411bb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x556da011c780 con 0x556da01c9380 2023-09-23T09:05:58.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.790+0000 7f830411bb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x556da011a0a0 con 0x556da01c3c40 2023-09-23T09:05:58.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.791+0000 7f82ee59b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556da01c9380 0x556da01c9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:58.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.791+0000 7f82ee59b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556da01c9380 0x556da01c9760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:60866/0 (socket says 172.21.15.82:60866) 2023-09-23T09:05:58.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.791+0000 7f82ee59b700 1 -- 172.21.15.82:0/2330531635 learned_addr learned my addr 172.21.15.82:0/2330531635 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:05:58.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.791+0000 7f82eed9c700 1 --2- 172.21.15.82:0/2330531635 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556da01c3c40 0x556da01c40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:58.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.791+0000 7f82edd9a700 1 --2- 172.21.15.82:0/2330531635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556da01c9ca0 0x556da01c3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:58.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.791+0000 7f82ee59b700 1 -- 172.21.15.82:0/2330531635 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556da01c3c40 msgr2=0x556da01c40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:05:58.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.791+0000 7f82ee59b700 1 --2- 172.21.15.82:0/2330531635 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556da01c3c40 0x556da01c40a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.791+0000 7f82ee59b700 1 -- 172.21.15.82:0/2330531635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556da01c9ca0 msgr2=0x556da01c3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:05:58.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.791+0000 7f82ee59b700 1 --2- 172.21.15.82:0/2330531635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556da01c9ca0 0x556da01c3700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.791+0000 7f82ee59b700 1 -- 172.21.15.82:0/2330531635 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556d9ff95630 con 0x556da01c9380 2023-09-23T09:05:58.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.791+0000 7f82eed9c700 1 --2- 172.21.15.82:0/2511086430 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f82d40a00c0 0x7f82d40a2580 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f82e000b780 tx=0x7f82e000bc10 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:05:58.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.791+0000 7f82edd9a700 1 --2- 172.21.15.82:0/2330531635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556da01c9ca0 0x556da01c3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:05:58.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.791+0000 7f82ee59b700 1 --2- 172.21.15.82:0/2330531635 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556da01c9380 0x556da01c9760 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f82e400bcf0 tx=0x7f82e40103d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0ef6b57a9259079 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:05:58.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.792+0000 7f82dcff9700 1 -- 172.21.15.82:0/2330531635 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e4010d00 con 0x556da01c9380 2023-09-23T09:05:58.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.792+0000 7f82dcff9700 1 -- 172.21.15.82:0/2330531635 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f82e4015070 con 0x556da01c9380 2023-09-23T09:05:58.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.792+0000 7f82dcff9700 1 -- 172.21.15.82:0/2330531635 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e4005020 con 0x556da01c9380 2023-09-23T09:05:58.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.792+0000 7f830411bb80 1 -- 172.21.15.82:0/2330531635 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556da01c9380 msgr2=0x556da01c9760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:05:58.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.792+0000 7f830411bb80 1 --2- 172.21.15.82:0/2330531635 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556da01c9380 0x556da01c9760 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f82e400bcf0 tx=0x7f82e40103d0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.792+0000 7f830411bb80 1 -- 172.21.15.82:0/2330531635 shutdown_connections 2023-09-23T09:05:58.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.792+0000 7f830411bb80 1 --2- 172.21.15.82:0/2330531635 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556da01c3c40 0x556da01c40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.792+0000 7f830411bb80 1 --2- 172.21.15.82:0/2330531635 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556da01c9380 0x556da01c9760 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.792+0000 7f830411bb80 1 --2- 172.21.15.82:0/2330531635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556da01c9ca0 0x556da01c3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.792+0000 7f830411bb80 1 -- 172.21.15.82:0/2330531635 >> 172.21.15.82:0/2330531635 conn(0x556da01380e0 msgr2=0x556da01be410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:05:58.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.792+0000 7f830411bb80 1 -- 172.21.15.82:0/2330531635 shutdown_connections 2023-09-23T09:05:58.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.793+0000 7f830411bb80 1 -- 172.21.15.82:0/2330531635 wait complete. 2023-09-23T09:05:58.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.793+0000 7f830411bb80 1 -- start start 2023-09-23T09:05:58.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.793+0000 7f830411bb80 1 Processor -- start 2023-09-23T09:05:58.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.794+0000 7f830411bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556da01c3c40 0x556da01cfc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:58.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.794+0000 7f830411bb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556da01c9380 0x556da01ccee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:58.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.794+0000 7f830411bb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556da01c9ca0 0x556da01cd620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:58.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.794+0000 7f830411bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x556da0115990 con 0x556da01c3c40 2023-09-23T09:05:58.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.794+0000 7f830411bb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x556da00b3bb0 con 0x556da01c9ca0 2023-09-23T09:05:58.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.794+0000 7f830411bb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x556da00b38b0 con 0x556da01c9380 2023-09-23T09:05:58.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.794+0000 7f830411bb80 10 client.0 _ll_register_callbacks cb 0x556d9fffda80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:05:58.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.794+0000 7f82ee59b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556da01c3c40 0x556da01cfc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:58.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.794+0000 7f82ee59b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556da01c3c40 0x556da01cfc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58956/0 (socket says 172.21.15.82:58956) 2023-09-23T09:05:58.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.794+0000 7f82ee59b700 1 -- 172.21.15.82:0/942062284 learned_addr learned my addr 172.21.15.82:0/942062284 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:05:58.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.794+0000 7f82edd9a700 1 --2- 172.21.15.82:0/942062284 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556da01c9380 0x556da01ccee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:58.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.794+0000 7f82eed9c700 1 --2- 172.21.15.82:0/942062284 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556da01c9ca0 0x556da01cd620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:58.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.795+0000 7f82ee59b700 1 -- 172.21.15.82:0/942062284 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556da01c9380 msgr2=0x556da01ccee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:05:58.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.795+0000 7f82ee59b700 1 --2- 172.21.15.82:0/942062284 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556da01c9380 0x556da01ccee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.795+0000 7f82ee59b700 1 -- 172.21.15.82:0/942062284 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556da01c9ca0 msgr2=0x556da01cd620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:05:58.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.795+0000 7f82ee59b700 1 --2- 172.21.15.82:0/942062284 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556da01c9ca0 0x556da01cd620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.795+0000 7f82ee59b700 1 -- 172.21.15.82:0/942062284 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82e400b920 con 0x556da01c3c40 2023-09-23T09:05:58.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.795+0000 7f82eed9c700 1 --2- 172.21.15.82:0/942062284 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556da01c9ca0 0x556da01cd620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:05:58.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.795+0000 7f82ee59b700 1 --2- 172.21.15.82:0/942062284 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556da01c3c40 0x556da01cfc60 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f82e4010d30 tx=0x7f82e4010e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b649b28be7ae08a4 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:05:58.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.795+0000 7f82d1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:05:58.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.795+0000 7f82d1ffb700 1 -- 172.21.15.82:0/942062284 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e4020070 con 0x556da01c3c40 2023-09-23T09:05:58.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.795+0000 7f82d1ffb700 1 -- 172.21.15.82:0/942062284 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f82e4017070 con 0x556da01c3c40 2023-09-23T09:05:58.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.795+0000 7f830411bb80 1 -- 172.21.15.82:0/942062284 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556da01931c0 con 0x556da01c3c40 2023-09-23T09:05:58.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.796+0000 7f82d1ffb700 1 -- 172.21.15.82:0/942062284 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f82e4011650 con 0x556da01c3c40 2023-09-23T09:05:58.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.796+0000 7f830411bb80 10 client.16278 fetch_fsmap learned FSMap version 55 2023-09-23T09:05:58.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.796+0000 7f830411bb80 1 -- 172.21.15.82:0/942062284 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x556d9ff41de0 con 0x556da01c3c40 2023-09-23T09:05:58.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.796+0000 7f82d1ffb700 1 -- 172.21.15.82:0/942062284 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f82e4031080 con 0x556da01c3c40 2023-09-23T09:05:58.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.796+0000 7f82d1ffb700 1 -- 172.21.15.82:0/942062284 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 55) v1 ==== 7934+0+0 (secure 0 0 0) 0x7f82e402b030 con 0x556da01c3c40 2023-09-23T09:05:58.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.796+0000 7f830411bb80 10 client.16278 fetch_fsmap finished waiting for FSMap version 55 2023-09-23T09:05:58.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.796+0000 7f830411bb80 10 client.16278 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-23T09:05:58.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.796+0000 7f830411bb80 20 client.16278 populate_metadata read hostname 'smithi082' 2023-09-23T09:05:58.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.796+0000 7f830411bb80 1 --2- 172.21.15.82:0/942062284 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x556da01e1990 0x556da01e3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:58.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.796+0000 7f830411bb80 4 client.16278 mds_command: new command op to 24550 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:05:58.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.796+0000 7f830411bb80 1 -- 172.21.15.82:0/942062284 --> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556da00bbba0 con 0x556da01e1990 2023-09-23T09:05:58.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.797+0000 7f82edd9a700 1 --2- 172.21.15.82:0/942062284 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x556da01e1990 0x556da01e3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:58.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.797+0000 7f82edd9a700 1 --2- 172.21.15.82:0/942062284 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x556da01e1990 0x556da01e3db0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2af4887a8c86d245 server_cookie=32709333afde9e6c in_seq=0 out_seq=0 2023-09-23T09:05:58.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.797+0000 7f82d1ffb700 10 client.16278 ms_handle_connect on v2:172.21.15.161:6838/758982817 2023-09-23T09:05:58.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.798+0000 7f82d1ffb700 1 -- 172.21.15.82:0/942062284 <== mds.1 v2:172.21.15.161:6838/758982817 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x556da00bbba0 con 0x556da01e1990 2023-09-23T09:05:58.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.798+0000 7f82d1ffb700 10 client.16278 handle_command_reply: tid=0 2023-09-23T09:05:58.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.798+0000 7f830411bb80 1 client.16278 shutdown 2023-09-23T09:05:58.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.798+0000 7f830411bb80 1 -- 172.21.15.82:0/942062284 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556da01c3c40 msgr2=0x556da01cfc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:05:58.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.798+0000 7f830411bb80 1 --2- 172.21.15.82:0/942062284 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556da01c3c40 0x556da01cfc60 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f82e4010d30 tx=0x7f82e4010e10 comp rx=0 tx=0).stop 2023-09-23T09:05:58.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.798+0000 7f830411bb80 1 -- 172.21.15.82:0/942062284 shutdown_connections 2023-09-23T09:05:58.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.798+0000 7f830411bb80 1 --2- 172.21.15.82:0/942062284 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x556da01e1990 0x556da01e3db0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.798+0000 7f830411bb80 1 --2- 172.21.15.82:0/942062284 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556da01c9ca0 0x556da01cd620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.798+0000 7f830411bb80 1 --2- 172.21.15.82:0/942062284 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556da01c3c40 0x556da01cfc60 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.798+0000 7f82d1ffb700 0 client.16278 ms_handle_reset on v2:172.21.15.161:6838/758982817 2023-09-23T09:05:58.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.798+0000 7f830411bb80 1 --2- 172.21.15.82:0/942062284 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556da01c9380 0x556da01ccee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.798+0000 7f830411bb80 1 -- 172.21.15.82:0/942062284 >> 172.21.15.82:0/942062284 conn(0x556da01380e0 msgr2=0x556da01b8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:05:58.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.798+0000 7f830411bb80 1 -- 172.21.15.82:0/942062284 shutdown_connections 2023-09-23T09:05:58.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.799+0000 7f830411bb80 1 -- 172.21.15.82:0/942062284 wait complete. 2023-09-23T09:05:58.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.799+0000 7f830411bb80 20 client.16278 trim_cache size 0 max 16384 2023-09-23T09:05:58.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.815+0000 7f830411bb80 1 Processor -- start 2023-09-23T09:05:58.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.815+0000 7f830411bb80 1 -- start start 2023-09-23T09:05:58.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.815+0000 7f830411bb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556da01c3c40 0x556da01cd600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:58.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.815+0000 7f830411bb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556da01c9380 0x556da01dde20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:58.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.815+0000 7f830411bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556da01c9ca0 0x556da01cf790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:58.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.815+0000 7f830411bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d9ff97920 con 0x556da01c9ca0 2023-09-23T09:05:58.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.815+0000 7f830411bb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x556da01bf150 con 0x556da01c9380 2023-09-23T09:05:58.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.815+0000 7f830411bb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x556da01c0190 con 0x556da01c3c40 2023-09-23T09:05:58.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.815+0000 7f82edd9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556da01c9380 0x556da01dde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:58.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.815+0000 7f82eed9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556da01c9ca0 0x556da01cf790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:58.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.816+0000 7f82edd9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556da01c9380 0x556da01dde20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:60874/0 (socket says 172.21.15.82:60874) 2023-09-23T09:05:58.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.816+0000 7f82edd9a700 1 -- 172.21.15.82:0/2305443259 learned_addr learned my addr 172.21.15.82:0/2305443259 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:05:58.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.816+0000 7f82ee59b700 1 --2- 172.21.15.82:0/2305443259 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556da01c3c40 0x556da01cd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:58.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.816+0000 7f82edd9a700 1 -- 172.21.15.82:0/2305443259 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556da01c3c40 msgr2=0x556da01cd600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:05:58.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.816+0000 7f82edd9a700 1 --2- 172.21.15.82:0/2305443259 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556da01c3c40 0x556da01cd600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.816+0000 7f82edd9a700 1 -- 172.21.15.82:0/2305443259 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556da01c9ca0 msgr2=0x556da01cf790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:05:58.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.816+0000 7f82edd9a700 1 --2- 172.21.15.82:0/2305443259 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556da01c9ca0 0x556da01cf790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.816+0000 7f82edd9a700 1 -- 172.21.15.82:0/2305443259 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556d9ff2ac60 con 0x556da01c9380 2023-09-23T09:05:58.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.816+0000 7f82edd9a700 1 --2- 172.21.15.82:0/2305443259 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556da01c9380 0x556da01dde20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f82d800c2d0 tx=0x7f82d80b8040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89909634c0aaa153 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:05:58.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.816+0000 7f82dd7fa700 1 -- 172.21.15.82:0/2305443259 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d80b0070 con 0x556da01c9380 2023-09-23T09:05:58.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.816+0000 7f82dd7fa700 1 -- 172.21.15.82:0/2305443259 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f82d8098f10 con 0x556da01c9380 2023-09-23T09:05:58.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.816+0000 7f82dd7fa700 1 -- 172.21.15.82:0/2305443259 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d80973d0 con 0x556da01c9380 2023-09-23T09:05:58.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.817+0000 7f830411bb80 1 -- 172.21.15.82:0/2305443259 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556da01c9380 msgr2=0x556da01dde20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:05:58.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.817+0000 7f830411bb80 1 --2- 172.21.15.82:0/2305443259 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556da01c9380 0x556da01dde20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f82d800c2d0 tx=0x7f82d80b8040 comp rx=0 tx=0).stop 2023-09-23T09:05:58.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.817+0000 7f830411bb80 1 -- 172.21.15.82:0/2305443259 shutdown_connections 2023-09-23T09:05:58.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.817+0000 7f830411bb80 1 --2- 172.21.15.82:0/2305443259 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556da01c9ca0 0x556da01cf790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.817+0000 7f830411bb80 1 --2- 172.21.15.82:0/2305443259 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556da01c3c40 0x556da01cd600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.817+0000 7f830411bb80 1 --2- 172.21.15.82:0/2305443259 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556da01c9380 0x556da01dde20 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.817+0000 7f830411bb80 1 -- 172.21.15.82:0/2305443259 >> 172.21.15.82:0/2305443259 conn(0x556da01380e0 msgr2=0x556da01be1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:05:58.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.817+0000 7f830411bb80 1 -- 172.21.15.82:0/2305443259 shutdown_connections 2023-09-23T09:05:58.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.817+0000 7f830411bb80 1 -- 172.21.15.82:0/2305443259 wait complete. 2023-09-23T09:05:58.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.818+0000 7f830411bb80 1 -- start start 2023-09-23T09:05:58.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.818+0000 7f830411bb80 1 Processor -- start 2023-09-23T09:05:58.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.818+0000 7f830411bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556da01c3c40 0x556da01cc950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:58.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.818+0000 7f830411bb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556da01c9380 0x556da01cce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:58.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.818+0000 7f830411bb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556da01c9ca0 0x556da01cb490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:58.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.818+0000 7f830411bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x556da01cbab0 con 0x556da01c3c40 2023-09-23T09:05:58.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.818+0000 7f830411bb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x556da01cbc20 con 0x556da01c9380 2023-09-23T09:05:58.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.818+0000 7f830411bb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x556da01cbde0 con 0x556da01c9ca0 2023-09-23T09:05:58.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.819+0000 7f830411bb80 10 client.0 _ll_register_callbacks cb 0x7f82e400bb40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:05:58.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.819+0000 7f82ee59b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556da01c3c40 0x556da01cc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:58.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.819+0000 7f82ee59b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556da01c3c40 0x556da01cc950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58966/0 (socket says 172.21.15.82:58966) 2023-09-23T09:05:58.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.819+0000 7f82ee59b700 1 -- 172.21.15.82:0/2116195899 learned_addr learned my addr 172.21.15.82:0/2116195899 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:05:58.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.819+0000 7f82edd9a700 1 --2- 172.21.15.82:0/2116195899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556da01c9380 0x556da01cce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:58.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.819+0000 7f82eed9c700 1 --2- 172.21.15.82:0/2116195899 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556da01c9ca0 0x556da01cb490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:58.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.819+0000 7f82ee59b700 1 -- 172.21.15.82:0/2116195899 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556da01c9ca0 msgr2=0x556da01cb490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:05:58.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.819+0000 7f82ee59b700 1 --2- 172.21.15.82:0/2116195899 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556da01c9ca0 0x556da01cb490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.819+0000 7f82ee59b700 1 -- 172.21.15.82:0/2116195899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556da01c9380 msgr2=0x556da01cce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:05:58.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.819+0000 7f82ee59b700 1 --2- 172.21.15.82:0/2116195899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556da01c9380 0x556da01cce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.819+0000 7f82ee59b700 1 -- 172.21.15.82:0/2116195899 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82e81a35d0 con 0x556da01c3c40 2023-09-23T09:05:58.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.819+0000 7f82ee59b700 1 --2- 172.21.15.82:0/2116195899 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556da01c3c40 0x556da01cc950 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f82e40107d0 tx=0x7f82e4025650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=179602e094d6103d server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:05:58.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.819+0000 7f82d1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:05:58.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.820+0000 7f82d1ffb700 1 -- 172.21.15.82:0/2116195899 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e4020070 con 0x556da01c3c40 2023-09-23T09:05:58.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.820+0000 7f830411bb80 1 -- 172.21.15.82:0/2116195899 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556da01b68b0 con 0x556da01c3c40 2023-09-23T09:05:58.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.820+0000 7f82d1ffb700 1 -- 172.21.15.82:0/2116195899 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f82e4000e40 con 0x556da01c3c40 2023-09-23T09:05:58.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.820+0000 7f82d1ffb700 1 -- 172.21.15.82:0/2116195899 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f82e4004740 con 0x556da01c3c40 2023-09-23T09:05:58.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.820+0000 7f830411bb80 10 client.16284 fetch_fsmap learned FSMap version 55 2023-09-23T09:05:58.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.820+0000 7f830411bb80 1 -- 172.21.15.82:0/2116195899 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x556d9ff68250 con 0x556da01c3c40 2023-09-23T09:05:58.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.820+0000 7f82d1ffb700 1 -- 172.21.15.82:0/2116195899 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x556da01b68b0 con 0x556da01c3c40 2023-09-23T09:05:58.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.820+0000 7f82d1ffb700 1 -- 172.21.15.82:0/2116195899 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 55) v1 ==== 7934+0+0 (secure 0 0 0) 0x7f82e402d820 con 0x556da01c3c40 2023-09-23T09:05:58.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.821+0000 7f830411bb80 10 client.16284 fetch_fsmap finished waiting for FSMap version 55 2023-09-23T09:05:58.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.821+0000 7f830411bb80 10 client.16284 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-23T09:05:58.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.821+0000 7f830411bb80 20 client.16284 populate_metadata read hostname 'smithi082' 2023-09-23T09:05:58.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.821+0000 7f830411bb80 1 --2- 172.21.15.82:0/2116195899 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x556da02365d0 0x556da02389f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:58.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.821+0000 7f830411bb80 4 client.16284 mds_command: new command op to 24550 tid=0[{"prefix": "damage ls"}] 2023-09-23T09:05:58.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.821+0000 7f830411bb80 1 -- 172.21.15.82:0/2116195899 --> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x556da010e970 con 0x556da02365d0 2023-09-23T09:05:58.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.821+0000 7f82edd9a700 1 --2- 172.21.15.82:0/2116195899 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x556da02365d0 0x556da02389f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:58.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.822+0000 7f82edd9a700 1 --2- 172.21.15.82:0/2116195899 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x556da02365d0 0x556da02389f0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9c500a7fa484f4e2 server_cookie=b4f85cf1e75d7ac6 in_seq=0 out_seq=0 2023-09-23T09:05:58.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.822+0000 7f82d1ffb700 10 client.16284 ms_handle_connect on v2:172.21.15.161:6838/758982817 2023-09-23T09:05:58.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.822+0000 7f82d1ffb700 1 -- 172.21.15.82:0/2116195899 <== mds.1 v2:172.21.15.161:6838/758982817 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x556da010e970 con 0x556da02365d0 2023-09-23T09:05:58.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.822+0000 7f82d1ffb700 10 client.16284 handle_command_reply: tid=0 2023-09-23T09:05:58.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.822+0000 7f830411bb80 1 client.16284 shutdown 2023-09-23T09:05:58.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.822+0000 7f830411bb80 1 -- 172.21.15.82:0/2116195899 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556da01c3c40 msgr2=0x556da01cc950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:05:58.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.822+0000 7f830411bb80 1 --2- 172.21.15.82:0/2116195899 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556da01c3c40 0x556da01cc950 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f82e40107d0 tx=0x7f82e4025650 comp rx=0 tx=0).stop 2023-09-23T09:05:58.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.822+0000 7f830411bb80 1 -- 172.21.15.82:0/2116195899 shutdown_connections 2023-09-23T09:05:58.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.822+0000 7f830411bb80 1 --2- 172.21.15.82:0/2116195899 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x556da02365d0 0x556da02389f0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.822+0000 7f830411bb80 1 --2- 172.21.15.82:0/2116195899 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556da01c9ca0 0x556da01cb490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.822+0000 7f830411bb80 1 --2- 172.21.15.82:0/2116195899 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556da01c3c40 0x556da01cc950 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.822+0000 7f82d1ffb700 0 client.16284 ms_handle_reset on v2:172.21.15.161:6838/758982817 2023-09-23T09:05:58.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.822+0000 7f830411bb80 1 --2- 172.21.15.82:0/2116195899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556da01c9380 0x556da01cce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.822+0000 7f830411bb80 1 -- 172.21.15.82:0/2116195899 >> 172.21.15.82:0/2116195899 conn(0x556da01380e0 msgr2=0x556da01dde20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:05:58.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.823+0000 7f830411bb80 1 -- 172.21.15.82:0/2116195899 shutdown_connections 2023-09-23T09:05:58.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.823+0000 7f830411bb80 1 -- 172.21.15.82:0/2116195899 wait complete. 2023-09-23T09:05:58.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.823+0000 7f830411bb80 20 client.16284 trim_cache size 0 max 16384 2023-09-23T09:05:58.830 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2023-09-23T09:05:58.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.823+0000 7f82f07ff700 1 -- 172.21.15.82:0/2511086430 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f82d40a00c0 msgr2=0x7f82d40a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:05:58.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.823+0000 7f82f07ff700 1 --2- 172.21.15.82:0/2511086430 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f82d40a00c0 0x7f82d40a2580 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f82e000b780 tx=0x7f82e000bc10 comp rx=0 tx=0).stop 2023-09-23T09:05:58.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.823+0000 7f82f07ff700 1 -- 172.21.15.82:0/2511086430 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f82e8101250 msgr2=0x7f82e819cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:05:58.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.823+0000 7f82f07ff700 1 --2- 172.21.15.82:0/2511086430 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f82e8101250 0x7f82e819cb20 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f82d800e9a0 tx=0x7f82d800ecb0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.824+0000 7f82f07ff700 1 -- 172.21.15.82:0/2511086430 shutdown_connections 2023-09-23T09:05:58.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.824+0000 7f82f07ff700 1 --2- 172.21.15.82:0/2511086430 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f82d40a00c0 0x7f82d40a2580 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.824+0000 7f82f07ff700 1 --2- 172.21.15.82:0/2511086430 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82e81068a0 0x7f82e8196650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.824+0000 7f82f07ff700 1 --2- 172.21.15.82:0/2511086430 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f82e8100890 0x7f82e819c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.824+0000 7f82f07ff700 1 --2- 172.21.15.82:0/2511086430 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f82e8101250 0x7f82e819cb20 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:58.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.824+0000 7f82f07ff700 1 -- 172.21.15.82:0/2511086430 >> 172.21.15.82:0/2511086430 conn(0x7f82e80fc380 msgr2=0x7f82e81043a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:05:58.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.824+0000 7f82f07ff700 1 -- 172.21.15.82:0/2511086430 shutdown_connections 2023-09-23T09:05:58.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:58.824+0000 7f82f07ff700 1 -- 172.21.15.82:0/2511086430 wait complete. 2023-09-23T09:05:58.844 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:05:58 smithi082 ceph-mon[97694]: pgmap v279: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 19 MiB/s wr, 119 op/s 2023-09-23T09:05:58.844 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:05:58 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:05:58.844 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:05:58 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/3562921637' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T09:05:58.846 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-09-23T09:05:58.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:05:58 smithi161 ceph-mon[99580]: pgmap v279: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 19 MiB/s wr, 119 op/s 2023-09-23T09:05:58.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:05:58 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:05:58.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:05:58 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/3562921637' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T09:05:59.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:05:58 smithi135 ceph-mon[99205]: pgmap v279: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 19 MiB/s wr, 119 op/s 2023-09-23T09:05:59.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:05:58 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:05:59.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:05:58 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/3562921637' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T09:05:59.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.064+0000 7f85e6fff700 1 -- 172.21.15.82:0/4113920352 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85e0101a30 msgr2=0x7f85e0101e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:05:59.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.064+0000 7f85e6fff700 1 --2- 172.21.15.82:0/4113920352 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85e0101a30 0x7f85e0101e10 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f85d4009990 tx=0x7f85d4009ca0 comp rx=0 tx=0).stop 2023-09-23T09:05:59.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.064+0000 7f85e6fff700 1 -- 172.21.15.82:0/4113920352 shutdown_connections 2023-09-23T09:05:59.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.064+0000 7f85e6fff700 1 --2- 172.21.15.82:0/4113920352 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85e010ae50 0x7f85e010d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:59.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.064+0000 7f85e6fff700 1 --2- 172.21.15.82:0/4113920352 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85e0101a30 0x7f85e0101e10 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:59.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.064+0000 7f85e6fff700 1 --2- 172.21.15.82:0/4113920352 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f85e0102350 0x7f85e010a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:59.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.064+0000 7f85e6fff700 1 -- 172.21.15.82:0/4113920352 >> 172.21.15.82:0/4113920352 conn(0x7f85e00fb270 msgr2=0x7f85e00fd690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:05:59.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.064+0000 7f85e6fff700 1 -- 172.21.15.82:0/4113920352 shutdown_connections 2023-09-23T09:05:59.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.064+0000 7f85e6fff700 1 -- 172.21.15.82:0/4113920352 wait complete. 2023-09-23T09:05:59.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.066+0000 7f85e6fff700 1 Processor -- start 2023-09-23T09:05:59.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.066+0000 7f85e6fff700 1 -- start start 2023-09-23T09:05:59.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.066+0000 7f85e6fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85e0101a30 0x7f85e019c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:59.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.067+0000 7f85e6fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85e0102350 0x7f85e019cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:59.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.067+0000 7f85e6fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f85e010ae50 0x7f85e0196790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:59.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.067+0000 7f85e6fff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e0196e00 con 0x7f85e0102350 2023-09-23T09:05:59.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.067+0000 7f85e6fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e0196f70 con 0x7f85e0101a30 2023-09-23T09:05:59.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.067+0000 7f85e6fff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e0197130 con 0x7f85e010ae50 2023-09-23T09:05:59.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.067+0000 7f85e4d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85e0101a30 0x7f85e019c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:59.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.067+0000 7f85e4d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85e0101a30 0x7f85e019c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:60902/0 (socket says 172.21.15.82:60902) 2023-09-23T09:05:59.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.067+0000 7f85e4d9b700 1 -- 172.21.15.82:0/2126869194 learned_addr learned my addr 172.21.15.82:0/2126869194 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:05:59.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.067+0000 7f85dffff700 1 --2- 172.21.15.82:0/2126869194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85e0102350 0x7f85e019cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:59.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.067+0000 7f85e559c700 1 --2- 172.21.15.82:0/2126869194 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f85e010ae50 0x7f85e0196790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:59.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.067+0000 7f85dffff700 1 -- 172.21.15.82:0/2126869194 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f85e010ae50 msgr2=0x7f85e0196790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:05:59.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.067+0000 7f85dffff700 1 --2- 172.21.15.82:0/2126869194 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f85e010ae50 0x7f85e0196790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:59.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.067+0000 7f85dffff700 1 -- 172.21.15.82:0/2126869194 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85e0101a30 msgr2=0x7f85e019c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:05:59.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.067+0000 7f85dffff700 1 --2- 172.21.15.82:0/2126869194 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85e0101a30 0x7f85e019c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:59.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.067+0000 7f85dffff700 1 -- 172.21.15.82:0/2126869194 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85d40095f0 con 0x7f85e0102350 2023-09-23T09:05:59.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.068+0000 7f85dffff700 1 --2- 172.21.15.82:0/2126869194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85e0102350 0x7f85e019cc60 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f85cc00e9f0 tx=0x7f85cc00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:05:59.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.068+0000 7f85ddffb700 1 -- 172.21.15.82:0/2126869194 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85cc00c9c0 con 0x7f85e0102350 2023-09-23T09:05:59.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.068+0000 7f85e6fff700 1 -- 172.21.15.82:0/2126869194 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85e0197410 con 0x7f85e0102350 2023-09-23T09:05:59.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.068+0000 7f85ddffb700 1 -- 172.21.15.82:0/2126869194 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f85cc010430 con 0x7f85e0102350 2023-09-23T09:05:59.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.068+0000 7f85ddffb700 1 -- 172.21.15.82:0/2126869194 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85cc018680 con 0x7f85e0102350 2023-09-23T09:05:59.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.068+0000 7f85e6fff700 1 -- 172.21.15.82:0/2126869194 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85e01a3710 con 0x7f85e0102350 2023-09-23T09:05:59.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.071+0000 7f85ddffb700 1 -- 172.21.15.82:0/2126869194 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f85cc0105a0 con 0x7f85e0102350 2023-09-23T09:05:59.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.073+0000 7f85ddffb700 1 --2- 172.21.15.82:0/2126869194 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f85d00a00c0 0x7f85d00a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:59.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.073+0000 7f85ddffb700 1 -- 172.21.15.82:0/2126869194 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f85cc014070 con 0x7f85e0102350 2023-09-23T09:05:59.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.073+0000 7f85fa8edb80 1 Processor -- start 2023-09-23T09:05:59.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.073+0000 7f85e4d9b700 1 --2- 172.21.15.82:0/2126869194 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f85d00a00c0 0x7f85d00a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:59.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.073+0000 7f85fa8edb80 1 -- start start 2023-09-23T09:05:59.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.074+0000 7f85fa8edb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5638e7f28380 0x5638e7f28760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:59.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.074+0000 7f85fa8edb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638e7f28ca0 0x5638e7f22700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:59.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.074+0000 7f85fa8edb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5638e7f22c40 0x5638e7f230a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:59.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.074+0000 7f85fa8edb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638e7e8a7b0 con 0x5638e7f28380 2023-09-23T09:05:59.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.074+0000 7f85fa8edb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638e7e7b780 con 0x5638e7f28ca0 2023-09-23T09:05:59.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.074+0000 7f85fa8edb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638e7e790a0 con 0x5638e7f22c40 2023-09-23T09:05:59.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.074+0000 7f85e559c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5638e7f22c40 0x5638e7f230a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:59.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.074+0000 7f85dffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638e7f28ca0 0x5638e7f22700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:59.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.074+0000 7f85e559c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5638e7f22c40 0x5638e7f230a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:49610/0 (socket says 172.21.15.82:49610) 2023-09-23T09:05:59.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.074+0000 7f85e559c700 1 -- 172.21.15.82:0/2610464106 learned_addr learned my addr 172.21.15.82:0/2610464106 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:05:59.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.074+0000 7f85e4d9b700 1 --2- 172.21.15.82:0/2610464106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5638e7f28380 0x5638e7f28760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:59.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.074+0000 7f85e4d9b700 1 --2- 172.21.15.82:0/2126869194 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f85d00a00c0 0x7f85d00a2580 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f85d4006010 tx=0x7f85d400b260 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:05:59.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.074+0000 7f85e559c700 1 -- 172.21.15.82:0/2610464106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638e7f28ca0 msgr2=0x5638e7f22700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:05:59.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.074+0000 7f85e559c700 1 --2- 172.21.15.82:0/2610464106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638e7f28ca0 0x5638e7f22700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:59.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.074+0000 7f85e559c700 1 -- 172.21.15.82:0/2610464106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5638e7f28380 msgr2=0x5638e7f28760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:05:59.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.075+0000 7f85e559c700 1 --2- 172.21.15.82:0/2610464106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5638e7f28380 0x5638e7f28760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:59.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.075+0000 7f85e559c700 1 -- 172.21.15.82:0/2610464106 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5638e7cf4630 con 0x5638e7f22c40 2023-09-23T09:05:59.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.075+0000 7f85dffff700 1 --2- 172.21.15.82:0/2610464106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638e7f28ca0 0x5638e7f22700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:05:59.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.075+0000 7f85e4d9b700 1 --2- 172.21.15.82:0/2610464106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5638e7f28380 0x5638e7f28760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:05:59.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.075+0000 7f85e559c700 1 --2- 172.21.15.82:0/2610464106 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5638e7f22c40 0x5638e7f230a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f85d8003f40 tx=0x7f85d8009ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e58db739dfbda41 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:05:59.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.075+0000 7f85caffd700 1 -- 172.21.15.82:0/2610464106 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d8019070 con 0x5638e7f22c40 2023-09-23T09:05:59.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.075+0000 7f85caffd700 1 -- 172.21.15.82:0/2610464106 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f85d800f040 con 0x5638e7f22c40 2023-09-23T09:05:59.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.075+0000 7f85caffd700 1 -- 172.21.15.82:0/2610464106 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d80078e0 con 0x5638e7f22c40 2023-09-23T09:05:59.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.076+0000 7f85fa8edb80 1 -- 172.21.15.82:0/2610464106 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5638e7f22c40 msgr2=0x5638e7f230a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:05:59.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.076+0000 7f85fa8edb80 1 --2- 172.21.15.82:0/2610464106 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5638e7f22c40 0x5638e7f230a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f85d8003f40 tx=0x7f85d8009ba0 comp rx=0 tx=0).stop 2023-09-23T09:05:59.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.076+0000 7f85fa8edb80 1 -- 172.21.15.82:0/2610464106 shutdown_connections 2023-09-23T09:05:59.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.076+0000 7f85fa8edb80 1 --2- 172.21.15.82:0/2610464106 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5638e7f22c40 0x5638e7f230a0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:59.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.076+0000 7f85fa8edb80 1 --2- 172.21.15.82:0/2610464106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5638e7f28380 0x5638e7f28760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:59.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.076+0000 7f85fa8edb80 1 --2- 172.21.15.82:0/2610464106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638e7f28ca0 0x5638e7f22700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:59.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.076+0000 7f85fa8edb80 1 -- 172.21.15.82:0/2610464106 >> 172.21.15.82:0/2610464106 conn(0x5638e7e970e0 msgr2=0x5638e7f1d410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:05:59.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.076+0000 7f85fa8edb80 1 -- 172.21.15.82:0/2610464106 shutdown_connections 2023-09-23T09:05:59.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.076+0000 7f85fa8edb80 1 -- 172.21.15.82:0/2610464106 wait complete. 2023-09-23T09:05:59.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.077+0000 7f85fa8edb80 1 -- start start 2023-09-23T09:05:59.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.077+0000 7f85fa8edb80 1 Processor -- start 2023-09-23T09:05:59.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.078+0000 7f85fa8edb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638e7f22c40 0x5638e7f2ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:59.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.078+0000 7f85fa8edb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5638e7f28380 0x5638e7f2bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:59.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.078+0000 7f85fa8edb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5638e7f28ca0 0x5638e7f2c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:59.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.078+0000 7f85fa8edb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638e7e74990 con 0x5638e7f28ca0 2023-09-23T09:05:59.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.078+0000 7f85fa8edb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638e7e12bb0 con 0x5638e7f22c40 2023-09-23T09:05:59.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.078+0000 7f85fa8edb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638e7e128b0 con 0x5638e7f28380 2023-09-23T09:05:59.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.078+0000 7f85fa8edb80 10 client.0 _ll_register_callbacks cb 0x5638e7d5ca80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:05:59.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.078+0000 7f85e559c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5638e7f28ca0 0x5638e7f2c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:59.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.078+0000 7f85e4d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638e7f22c40 0x5638e7f2ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:59.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.078+0000 7f85e559c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5638e7f28ca0 0x5638e7f2c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58994/0 (socket says 172.21.15.82:58994) 2023-09-23T09:05:59.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.078+0000 7f85e4d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638e7f22c40 0x5638e7f2ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:60928/0 (socket says 172.21.15.82:60928) 2023-09-23T09:05:59.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.078+0000 7f85e559c700 1 -- 172.21.15.82:0/2918575101 learned_addr learned my addr 172.21.15.82:0/2918575101 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:05:59.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.078+0000 7f85dffff700 1 --2- 172.21.15.82:0/2918575101 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5638e7f28380 0x5638e7f2bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:59.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.078+0000 7f85e559c700 1 -- 172.21.15.82:0/2918575101 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5638e7f28380 msgr2=0x5638e7f2bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:05:59.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.078+0000 7f85e559c700 1 --2- 172.21.15.82:0/2918575101 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5638e7f28380 0x5638e7f2bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:59.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.078+0000 7f85e559c700 1 -- 172.21.15.82:0/2918575101 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638e7f22c40 msgr2=0x5638e7f2ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:05:59.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.078+0000 7f85e559c700 1 --2- 172.21.15.82:0/2918575101 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638e7f22c40 0x5638e7f2ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:59.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.078+0000 7f85e559c700 1 -- 172.21.15.82:0/2918575101 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85e01a3710 con 0x5638e7f28ca0 2023-09-23T09:05:59.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.078+0000 7f85dffff700 1 --2- 172.21.15.82:0/2918575101 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5638e7f28380 0x5638e7f2bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:05:59.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.079+0000 7f85e559c700 1 --2- 172.21.15.82:0/2918575101 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5638e7f28ca0 0x5638e7f2c610 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f85d80093b0 tx=0x7f85d8004d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8286f49eca6da13 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:05:59.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.079+0000 7f85bffff700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:05:59.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.079+0000 7f85bffff700 1 -- 172.21.15.82:0/2918575101 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d8019030 con 0x5638e7f28ca0 2023-09-23T09:05:59.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.079+0000 7f85bffff700 1 -- 172.21.15.82:0/2918575101 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f85d801a070 con 0x5638e7f28ca0 2023-09-23T09:05:59.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.079+0000 7f85fa8edb80 1 -- 172.21.15.82:0/2918575101 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5638e7ef21c0 con 0x5638e7f28ca0 2023-09-23T09:05:59.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.080+0000 7f85bffff700 1 -- 172.21.15.82:0/2918575101 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f85d8009480 con 0x5638e7f28ca0 2023-09-23T09:05:59.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.080+0000 7f85fa8edb80 10 client.16296 fetch_fsmap learned FSMap version 55 2023-09-23T09:05:59.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.080+0000 7f85fa8edb80 1 -- 172.21.15.82:0/2918575101 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x7f85d8003b70 con 0x5638e7f28ca0 2023-09-23T09:05:59.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.080+0000 7f85bffff700 1 -- 172.21.15.82:0/2918575101 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5638e7ef21c0 con 0x5638e7f28ca0 2023-09-23T09:05:59.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.080+0000 7f85bffff700 1 -- 172.21.15.82:0/2918575101 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 55) v1 ==== 7934+0+0 (secure 0 0 0) 0x7f85d80158b0 con 0x5638e7f28ca0 2023-09-23T09:05:59.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.080+0000 7f85fa8edb80 10 client.16296 fetch_fsmap finished waiting for FSMap version 55 2023-09-23T09:05:59.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.080+0000 7f85fa8edb80 10 client.16296 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:05:59.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.080+0000 7f85fa8edb80 20 client.16296 populate_metadata read hostname 'smithi082' 2023-09-23T09:05:59.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.080+0000 7f85fa8edb80 1 --2- 172.21.15.82:0/2918575101 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5638e7f44fa0 0x5638e7f473c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:59.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.080+0000 7f85fa8edb80 4 client.16296 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:05:59.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.080+0000 7f85fa8edb80 1 -- 172.21.15.82:0/2918575101 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5638e7e1aba0 con 0x5638e7f44fa0 2023-09-23T09:05:59.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.081+0000 7f85e4d9b700 1 --2- 172.21.15.82:0/2918575101 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5638e7f44fa0 0x5638e7f473c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:59.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.081+0000 7f85e4d9b700 1 --2- 172.21.15.82:0/2918575101 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5638e7f44fa0 0x5638e7f473c0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5067751aaed5c23b server_cookie=fce18fd485d12674 in_seq=0 out_seq=0 2023-09-23T09:05:59.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.081+0000 7f85bffff700 10 client.16296 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:05:59.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.082+0000 7f85bffff700 1 -- 172.21.15.82:0/2918575101 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5638e7e1aba0 con 0x5638e7f44fa0 2023-09-23T09:05:59.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.082+0000 7f85bffff700 10 client.16296 handle_command_reply: tid=0 2023-09-23T09:05:59.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.082+0000 7f85fa8edb80 1 client.16296 shutdown 2023-09-23T09:05:59.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.082+0000 7f85fa8edb80 1 -- 172.21.15.82:0/2918575101 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5638e7f28ca0 msgr2=0x5638e7f2c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:05:59.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.082+0000 7f85fa8edb80 1 --2- 172.21.15.82:0/2918575101 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5638e7f28ca0 0x5638e7f2c610 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f85d80093b0 tx=0x7f85d8004d00 comp rx=0 tx=0).stop 2023-09-23T09:05:59.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.082+0000 7f85fa8edb80 1 -- 172.21.15.82:0/2918575101 shutdown_connections 2023-09-23T09:05:59.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.082+0000 7f85fa8edb80 1 --2- 172.21.15.82:0/2918575101 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5638e7f44fa0 0x5638e7f473c0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:59.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.082+0000 7f85fa8edb80 1 --2- 172.21.15.82:0/2918575101 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5638e7f28ca0 0x5638e7f2c610 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:59.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.082+0000 7f85fa8edb80 1 --2- 172.21.15.82:0/2918575101 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638e7f22c40 0x5638e7f2ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:59.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.082+0000 7f85bffff700 0 client.16296 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:05:59.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.082+0000 7f85fa8edb80 1 --2- 172.21.15.82:0/2918575101 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5638e7f28380 0x5638e7f2bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:59.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.082+0000 7f85fa8edb80 1 -- 172.21.15.82:0/2918575101 >> 172.21.15.82:0/2918575101 conn(0x5638e7e970e0 msgr2=0x5638e7f17b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:05:59.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.082+0000 7f85fa8edb80 1 -- 172.21.15.82:0/2918575101 shutdown_connections 2023-09-23T09:05:59.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.082+0000 7f85fa8edb80 1 -- 172.21.15.82:0/2918575101 wait complete. 2023-09-23T09:05:59.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.083+0000 7f85fa8edb80 20 client.16296 trim_cache size 0 max 16384 2023-09-23T09:05:59.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.099+0000 7f85fa8edb80 1 Processor -- start 2023-09-23T09:05:59.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.099+0000 7f85fa8edb80 1 -- start start 2023-09-23T09:05:59.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.099+0000 7f85fa8edb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5638e7f22c40 0x5638e7f22700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:59.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.099+0000 7f85fa8edb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5638e7f28380 0x5638e7f23020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:59.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.099+0000 7f85fa8edb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638e7f28ca0 0x5638e7f27860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:59.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.099+0000 7f85fa8edb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638e7cf6920 con 0x5638e7f22c40 2023-09-23T09:05:59.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.099+0000 7f85fa8edb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638e7f2d4e0 con 0x5638e7f28ca0 2023-09-23T09:05:59.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.099+0000 7f85fa8edb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638e7f2cc70 con 0x5638e7f28380 2023-09-23T09:05:59.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.100+0000 7f85e4d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5638e7f22c40 0x5638e7f22700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:59.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.100+0000 7f85dffff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5638e7f28380 0x5638e7f23020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:59.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.100+0000 7f85e4d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5638e7f22c40 0x5638e7f22700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59000/0 (socket says 172.21.15.82:59000) 2023-09-23T09:05:59.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.100+0000 7f85dffff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5638e7f28380 0x5638e7f23020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:49630/0 (socket says 172.21.15.82:49630) 2023-09-23T09:05:59.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.100+0000 7f85e4d9b700 1 -- 172.21.15.82:0/589893749 learned_addr learned my addr 172.21.15.82:0/589893749 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:05:59.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.100+0000 7f85e559c700 1 --2- 172.21.15.82:0/589893749 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638e7f28ca0 0x5638e7f27860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:59.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.100+0000 7f85e4d9b700 1 -- 172.21.15.82:0/589893749 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5638e7f28380 msgr2=0x5638e7f23020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:05:59.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.100+0000 7f85e4d9b700 1 --2- 172.21.15.82:0/589893749 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5638e7f28380 0x5638e7f23020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:59.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.100+0000 7f85e4d9b700 1 -- 172.21.15.82:0/589893749 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638e7f28ca0 msgr2=0x5638e7f27860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:05:59.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.100+0000 7f85e4d9b700 1 --2- 172.21.15.82:0/589893749 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638e7f28ca0 0x5638e7f27860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:59.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.100+0000 7f85e4d9b700 1 -- 172.21.15.82:0/589893749 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5638e7ca0de0 con 0x5638e7f22c40 2023-09-23T09:05:59.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.100+0000 7f85e559c700 1 --2- 172.21.15.82:0/589893749 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638e7f28ca0 0x5638e7f27860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T09:05:59.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.100+0000 7f85dffff700 1 --2- 172.21.15.82:0/589893749 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5638e7f28380 0x5638e7f23020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:05:59.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.100+0000 7f85e4d9b700 1 --2- 172.21.15.82:0/589893749 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5638e7f22c40 0x5638e7f22700 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f85d4005910 tx=0x7f85d4022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8d3b32301e02004 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:05:59.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.101+0000 7f85cb7fe700 1 -- 172.21.15.82:0/589893749 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d400bee0 con 0x5638e7f22c40 2023-09-23T09:05:59.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.101+0000 7f85cb7fe700 1 -- 172.21.15.82:0/589893749 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f85d402a040 con 0x5638e7f22c40 2023-09-23T09:05:59.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.101+0000 7f85cb7fe700 1 -- 172.21.15.82:0/589893749 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d4004a50 con 0x5638e7f22c40 2023-09-23T09:05:59.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.101+0000 7f85fa8edb80 1 -- 172.21.15.82:0/589893749 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5638e7f22c40 msgr2=0x5638e7f22700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:05:59.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.101+0000 7f85fa8edb80 1 --2- 172.21.15.82:0/589893749 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5638e7f22c40 0x5638e7f22700 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f85d4005910 tx=0x7f85d4022000 comp rx=0 tx=0).stop 2023-09-23T09:05:59.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.101+0000 7f85fa8edb80 1 -- 172.21.15.82:0/589893749 shutdown_connections 2023-09-23T09:05:59.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.101+0000 7f85fa8edb80 1 --2- 172.21.15.82:0/589893749 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638e7f28ca0 0x5638e7f27860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:59.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.101+0000 7f85fa8edb80 1 --2- 172.21.15.82:0/589893749 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5638e7f22c40 0x5638e7f22700 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:59.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.101+0000 7f85fa8edb80 1 --2- 172.21.15.82:0/589893749 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5638e7f28380 0x5638e7f23020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:59.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.101+0000 7f85fa8edb80 1 -- 172.21.15.82:0/589893749 >> 172.21.15.82:0/589893749 conn(0x5638e7e970e0 msgr2=0x5638e7f16b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:05:59.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.102+0000 7f85fa8edb80 1 -- 172.21.15.82:0/589893749 shutdown_connections 2023-09-23T09:05:59.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.102+0000 7f85fa8edb80 1 -- 172.21.15.82:0/589893749 wait complete. 2023-09-23T09:05:59.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.102+0000 7f85fa8edb80 1 -- start start 2023-09-23T09:05:59.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.102+0000 7f85fa8edb80 1 Processor -- start 2023-09-23T09:05:59.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.103+0000 7f85fa8edb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5638e7f22c40 0x5638e7f41450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:59.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.103+0000 7f85fa8edb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5638e7f28380 0x5638e7f41990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:59.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.103+0000 7f85fa8edb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638e7f28ca0 0x5638e7f41ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:59.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.103+0000 7f85fa8edb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638e7f2e110 con 0x5638e7f22c40 2023-09-23T09:05:59.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.103+0000 7f85fa8edb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638e7f2e250 con 0x5638e7f28ca0 2023-09-23T09:05:59.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.103+0000 7f85fa8edb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638e7f2e410 con 0x5638e7f28380 2023-09-23T09:05:59.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.103+0000 7f85fa8edb80 10 client.0 _ll_register_callbacks cb 0x7f85cc009680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:05:59.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.103+0000 7f85e4d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5638e7f22c40 0x5638e7f41450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:59.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.103+0000 7f85e4d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5638e7f22c40 0x5638e7f41450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59010/0 (socket says 172.21.15.82:59010) 2023-09-23T09:05:59.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.103+0000 7f85e4d9b700 1 -- 172.21.15.82:0/1493588942 learned_addr learned my addr 172.21.15.82:0/1493588942 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:05:59.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.103+0000 7f85dffff700 1 --2- 172.21.15.82:0/1493588942 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5638e7f28380 0x5638e7f41990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:59.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.103+0000 7f85e559c700 1 --2- 172.21.15.82:0/1493588942 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638e7f28ca0 0x5638e7f41ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:59.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.103+0000 7f85e4d9b700 1 -- 172.21.15.82:0/1493588942 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5638e7f28380 msgr2=0x5638e7f41990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:05:59.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.103+0000 7f85e4d9b700 1 --2- 172.21.15.82:0/1493588942 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5638e7f28380 0x5638e7f41990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:59.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.103+0000 7f85e4d9b700 1 -- 172.21.15.82:0/1493588942 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638e7f28ca0 msgr2=0x5638e7f41ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:05:59.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.103+0000 7f85e4d9b700 1 --2- 172.21.15.82:0/1493588942 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638e7f28ca0 0x5638e7f41ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:59.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.103+0000 7f85e4d9b700 1 -- 172.21.15.82:0/1493588942 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85e0197410 con 0x5638e7f22c40 2023-09-23T09:05:59.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.104+0000 7f85e4d9b700 1 --2- 172.21.15.82:0/1493588942 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5638e7f22c40 0x5638e7f41450 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f85d4009320 tx=0x7f85d4004500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=995261b6f9d34cb6 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:05:59.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.104+0000 7f85bffff700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:05:59.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.104+0000 7f85bffff700 1 -- 172.21.15.82:0/1493588942 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d4034c90 con 0x5638e7f22c40 2023-09-23T09:05:59.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.104+0000 7f85bffff700 1 -- 172.21.15.82:0/1493588942 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f85d40340f0 con 0x5638e7f22c40 2023-09-23T09:05:59.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.104+0000 7f85fa8edb80 1 -- 172.21.15.82:0/1493588942 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5638e7f158b0 con 0x5638e7f22c40 2023-09-23T09:05:59.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.104+0000 7f85bffff700 1 -- 172.21.15.82:0/1493588942 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f85d40342b0 con 0x5638e7f22c40 2023-09-23T09:05:59.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.105+0000 7f85fa8edb80 10 client.16302 fetch_fsmap learned FSMap version 55 2023-09-23T09:05:59.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.105+0000 7f85fa8edb80 1 -- 172.21.15.82:0/1493588942 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x7f85e010dfd0 con 0x5638e7f22c40 2023-09-23T09:05:59.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.105+0000 7f85bffff700 1 -- 172.21.15.82:0/1493588942 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5638e7f158b0 con 0x5638e7f22c40 2023-09-23T09:05:59.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.105+0000 7f85bffff700 1 -- 172.21.15.82:0/1493588942 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 55) v1 ==== 7934+0+0 (secure 0 0 0) 0x7f85d404f480 con 0x5638e7f22c40 2023-09-23T09:05:59.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.105+0000 7f85fa8edb80 10 client.16302 fetch_fsmap finished waiting for FSMap version 55 2023-09-23T09:05:59.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.105+0000 7f85fa8edb80 10 client.16302 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:05:59.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.105+0000 7f85fa8edb80 20 client.16302 populate_metadata read hostname 'smithi082' 2023-09-23T09:05:59.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.105+0000 7f85fa8edb80 1 --2- 172.21.15.82:0/1493588942 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5638e7f99380 0x5638e7f9b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:05:59.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.105+0000 7f85fa8edb80 4 client.16302 mds_command: new command op to 24557 tid=0[{"prefix": "damage ls"}] 2023-09-23T09:05:59.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.105+0000 7f85fa8edb80 1 -- 172.21.15.82:0/1493588942 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5638e7e6d970 con 0x5638e7f99380 2023-09-23T09:05:59.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.105+0000 7f85dffff700 1 --2- 172.21.15.82:0/1493588942 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5638e7f99380 0x5638e7f9b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:05:59.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.106+0000 7f85bffff700 10 client.16302 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:05:59.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.106+0000 7f85dffff700 1 --2- 172.21.15.82:0/1493588942 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5638e7f99380 0x5638e7f9b7a0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e3b66d182ccd47 server_cookie=fbc3739ecaad9d58 in_seq=0 out_seq=0 2023-09-23T09:05:59.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.106+0000 7f85bffff700 1 -- 172.21.15.82:0/1493588942 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5638e7e6d970 con 0x5638e7f99380 2023-09-23T09:05:59.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.106+0000 7f85bffff700 10 client.16302 handle_command_reply: tid=0 2023-09-23T09:05:59.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.106+0000 7f85fa8edb80 1 client.16302 shutdown 2023-09-23T09:05:59.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.106+0000 7f85fa8edb80 1 -- 172.21.15.82:0/1493588942 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5638e7f22c40 msgr2=0x5638e7f41450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:05:59.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.106+0000 7f85fa8edb80 1 --2- 172.21.15.82:0/1493588942 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5638e7f22c40 0x5638e7f41450 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f85d4009320 tx=0x7f85d4004500 comp rx=0 tx=0).stop 2023-09-23T09:05:59.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.106+0000 7f85fa8edb80 1 -- 172.21.15.82:0/1493588942 shutdown_connections 2023-09-23T09:05:59.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.106+0000 7f85fa8edb80 1 --2- 172.21.15.82:0/1493588942 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638e7f28ca0 0x5638e7f41ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:59.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.107+0000 7f85fa8edb80 1 --2- 172.21.15.82:0/1493588942 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5638e7f99380 0x5638e7f9b7a0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:59.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.107+0000 7f85fa8edb80 1 --2- 172.21.15.82:0/1493588942 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5638e7f22c40 0x5638e7f41450 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:59.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.107+0000 7f85fa8edb80 1 --2- 172.21.15.82:0/1493588942 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5638e7f28380 0x5638e7f41990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:59.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.107+0000 7f85fa8edb80 1 -- 172.21.15.82:0/1493588942 >> 172.21.15.82:0/1493588942 conn(0x5638e7e970e0 msgr2=0x5638e7f1d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:05:59.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.107+0000 7f85bffff700 0 client.16302 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:05:59.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.107+0000 7f85fa8edb80 1 -- 172.21.15.82:0/1493588942 shutdown_connections 2023-09-23T09:05:59.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.107+0000 7f85fa8edb80 1 -- 172.21.15.82:0/1493588942 wait complete. 2023-09-23T09:05:59.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.107+0000 7f85fa8edb80 20 client.16302 trim_cache size 0 max 16384 2023-09-23T09:05:59.115 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2023-09-23T09:05:59.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.107+0000 7f85e6fff700 1 -- 172.21.15.82:0/2126869194 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f85d00a00c0 msgr2=0x7f85d00a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:05:59.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.107+0000 7f85e6fff700 1 --2- 172.21.15.82:0/2126869194 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f85d00a00c0 0x7f85d00a2580 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f85d4006010 tx=0x7f85d400b260 comp rx=0 tx=0).stop 2023-09-23T09:05:59.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.107+0000 7f85e6fff700 1 -- 172.21.15.82:0/2126869194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85e0102350 msgr2=0x7f85e019cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:05:59.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.107+0000 7f85e6fff700 1 --2- 172.21.15.82:0/2126869194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85e0102350 0x7f85e019cc60 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f85cc00e9f0 tx=0x7f85cc00ed00 comp rx=0 tx=0).stop 2023-09-23T09:05:59.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.108+0000 7f85e6fff700 1 -- 172.21.15.82:0/2126869194 shutdown_connections 2023-09-23T09:05:59.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.108+0000 7f85e6fff700 1 --2- 172.21.15.82:0/2126869194 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f85d00a00c0 0x7f85d00a2580 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:59.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.108+0000 7f85e6fff700 1 --2- 172.21.15.82:0/2126869194 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f85e010ae50 0x7f85e0196790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:59.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.108+0000 7f85e6fff700 1 --2- 172.21.15.82:0/2126869194 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85e0101a30 0x7f85e019c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:59.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.108+0000 7f85e6fff700 1 --2- 172.21.15.82:0/2126869194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85e0102350 0x7f85e019cc60 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:05:59.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.108+0000 7f85e6fff700 1 -- 172.21.15.82:0/2126869194 >> 172.21.15.82:0/2126869194 conn(0x7f85e00fb270 msgr2=0x7f85e00fbee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:05:59.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.108+0000 7f85e6fff700 1 -- 172.21.15.82:0/2126869194 shutdown_connections 2023-09-23T09:05:59.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:05:59.108+0000 7f85e6fff700 1 -- 172.21.15.82:0/2126869194 wait complete. 2023-09-23T09:06:00.131 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-09-23T09:06:00.132 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-09-23T09:06:00.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.352+0000 7f93113ff700 1 -- 172.21.15.82:0/584926980 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f930c100870 msgr2=0x7f930c100cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:06:00.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.352+0000 7f93113ff700 1 --2- 172.21.15.82:0/584926980 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f930c100870 0x7f930c100cf0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f9300009990 tx=0x7f9300009ca0 comp rx=0 tx=0).stop 2023-09-23T09:06:00.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.352+0000 7f93113ff700 1 -- 172.21.15.82:0/584926980 shutdown_connections 2023-09-23T09:06:00.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.352+0000 7f93113ff700 1 --2- 172.21.15.82:0/584926980 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f930c101230 0x7f930c10d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:00.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.352+0000 7f93113ff700 1 --2- 172.21.15.82:0/584926980 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f930c106880 0x7f930c106c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:00.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.352+0000 7f93113ff700 1 --2- 172.21.15.82:0/584926980 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f930c100870 0x7f930c100cf0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:00.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.352+0000 7f93113ff700 1 -- 172.21.15.82:0/584926980 >> 172.21.15.82:0/584926980 conn(0x7f930c0fc3a0 msgr2=0x7f930c0fe7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:06:00.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.352+0000 7f93113ff700 1 -- 172.21.15.82:0/584926980 shutdown_connections 2023-09-23T09:06:00.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.352+0000 7f93113ff700 1 -- 172.21.15.82:0/584926980 wait complete. 2023-09-23T09:06:00.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.354+0000 7f93113ff700 1 Processor -- start 2023-09-23T09:06:00.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.354+0000 7f93113ff700 1 -- start start 2023-09-23T09:06:00.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.354+0000 7f93113ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f930c100870 0x7f930c072c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:06:00.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.354+0000 7f93113ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f930c101230 0x7f930c073160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:06:00.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.354+0000 7f93113ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f930c106880 0x7f930c0736a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:06:00.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.354+0000 7f93113ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f930c1a4d20 con 0x7f930c101230 2023-09-23T09:06:00.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.354+0000 7f93113ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f930c1a4e90 con 0x7f930c100870 2023-09-23T09:06:00.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.355+0000 7f93113ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f930c1a5050 con 0x7f930c106880 2023-09-23T09:06:00.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.355+0000 7f930affd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f930c100870 0x7f930c072c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:06:00.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.355+0000 7f930a7fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f930c101230 0x7f930c073160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:06:00.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.355+0000 7f930affd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f930c100870 0x7f930c072c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:60960/0 (socket says 172.21.15.82:60960) 2023-09-23T09:06:00.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.355+0000 7f930affd700 1 -- 172.21.15.82:0/1443661169 learned_addr learned my addr 172.21.15.82:0/1443661169 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:06:00.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.355+0000 7f930b7fe700 1 --2- 172.21.15.82:0/1443661169 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f930c106880 0x7f930c0736a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:06:00.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.355+0000 7f930a7fc700 1 -- 172.21.15.82:0/1443661169 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f930c106880 msgr2=0x7f930c0736a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:06:00.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.355+0000 7f930a7fc700 1 --2- 172.21.15.82:0/1443661169 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f930c106880 0x7f930c0736a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:00.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.355+0000 7f930a7fc700 1 -- 172.21.15.82:0/1443661169 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f930c100870 msgr2=0x7f930c072c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:06:00.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.355+0000 7f930a7fc700 1 --2- 172.21.15.82:0/1443661169 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f930c100870 0x7f930c072c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:00.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.355+0000 7f930a7fc700 1 -- 172.21.15.82:0/1443661169 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93000095f0 con 0x7f930c101230 2023-09-23T09:06:00.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.355+0000 7f930affd700 1 --2- 172.21.15.82:0/1443661169 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f930c100870 0x7f930c072c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:06:00.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.355+0000 7f930a7fc700 1 --2- 172.21.15.82:0/1443661169 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f930c101230 0x7f930c073160 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f9300005910 tx=0x7f9300005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:06:00.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.356+0000 7f92f3fff700 1 -- 172.21.15.82:0/1443661169 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f930001d070 con 0x7f930c101230 2023-09-23T09:06:00.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.356+0000 7f92f3fff700 1 -- 172.21.15.82:0/1443661169 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9300022470 con 0x7f930c101230 2023-09-23T09:06:00.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.356+0000 7f92f3fff700 1 -- 172.21.15.82:0/1443661169 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9300017650 con 0x7f930c101230 2023-09-23T09:06:00.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.356+0000 7f93113ff700 1 -- 172.21.15.82:0/1443661169 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f930c1a52d0 con 0x7f930c101230 2023-09-23T09:06:00.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.356+0000 7f93113ff700 1 -- 172.21.15.82:0/1443661169 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f930c1a5760 con 0x7f930c101230 2023-09-23T09:06:00.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.359+0000 7f92f3fff700 1 -- 172.21.15.82:0/1443661169 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f93000225e0 con 0x7f930c101230 2023-09-23T09:06:00.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.361+0000 7f9324dacb80 1 Processor -- start 2023-09-23T09:06:00.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.361+0000 7f9324dacb80 1 -- start start 2023-09-23T09:06:00.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.361+0000 7f92f3fff700 1 --2- 172.21.15.82:0/1443661169 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f92f40a0140 0x7f92f40a2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:06:00.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.361+0000 7f9324dacb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555d5bd76400 0x555d5bd767e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:06:00.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.361+0000 7f92f3fff700 1 -- 172.21.15.82:0/1443661169 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f93000cc920 con 0x7f930c101230 2023-09-23T09:06:00.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.361+0000 7f9324dacb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d5bd76d20 0x555d5bd70780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:06:00.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.361+0000 7f9324dacb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555d5bd70cc0 0x555d5bd71120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:06:00.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.361+0000 7f9324dacb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d5bcd8830 con 0x555d5bd76d20 2023-09-23T09:06:00.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.361+0000 7f9324dacb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d5bcc9800 con 0x555d5bd76400 2023-09-23T09:06:00.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.361+0000 7f9324dacb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d5bcc7120 con 0x555d5bd70cc0 2023-09-23T09:06:00.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.362+0000 7f930b7fe700 1 --2- 172.21.15.82:0/1443661169 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f92f40a0140 0x7f92f40a2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:06:00.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.362+0000 7f930affd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555d5bd76400 0x555d5bd767e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:06:00.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.362+0000 7f930a7fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d5bd76d20 0x555d5bd70780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:06:00.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.362+0000 7f930affd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555d5bd76400 0x555d5bd767e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:60974/0 (socket says 172.21.15.82:60974) 2023-09-23T09:06:00.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.362+0000 7f930affd700 1 -- 172.21.15.82:0/3493869206 learned_addr learned my addr 172.21.15.82:0/3493869206 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:06:00.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.362+0000 7f930b7fe700 1 --2- 172.21.15.82:0/3493869206 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555d5bd70cc0 0x555d5bd71120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:06:00.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.362+0000 7f930affd700 1 -- 172.21.15.82:0/3493869206 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555d5bd70cc0 msgr2=0x555d5bd71120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:06:00.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.362+0000 7f930affd700 1 --2- 172.21.15.82:0/3493869206 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555d5bd70cc0 0x555d5bd71120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:00.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.362+0000 7f930affd700 1 -- 172.21.15.82:0/3493869206 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d5bd76d20 msgr2=0x555d5bd70780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:06:00.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.362+0000 7f930affd700 1 --2- 172.21.15.82:0/3493869206 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d5bd76d20 0x555d5bd70780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:00.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.362+0000 7f930affd700 1 -- 172.21.15.82:0/3493869206 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555d5bb426b0 con 0x555d5bd76400 2023-09-23T09:06:00.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.362+0000 7f930b7fe700 1 --2- 172.21.15.82:0/1443661169 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f92f40a0140 0x7f92f40a2600 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9304009ec0 tx=0x7f93040092f0 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:06:00.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.362+0000 7f930affd700 1 --2- 172.21.15.82:0/3493869206 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555d5bd76400 0x555d5bd767e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f92fc011650 tx=0x7f92fc011960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d82354760e723a4d server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:06:00.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.363+0000 7f92f17fa700 1 -- 172.21.15.82:0/3493869206 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92fc019630 con 0x555d5bd76400 2023-09-23T09:06:00.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.363+0000 7f92f17fa700 1 -- 172.21.15.82:0/3493869206 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f92fc019c20 con 0x555d5bd76400 2023-09-23T09:06:00.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.363+0000 7f92f17fa700 1 -- 172.21.15.82:0/3493869206 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92fc00ea60 con 0x555d5bd76400 2023-09-23T09:06:00.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.363+0000 7f9324dacb80 1 -- 172.21.15.82:0/3493869206 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555d5bd76400 msgr2=0x555d5bd767e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:06:00.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.363+0000 7f9324dacb80 1 --2- 172.21.15.82:0/3493869206 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555d5bd76400 0x555d5bd767e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f92fc011650 tx=0x7f92fc011960 comp rx=0 tx=0).stop 2023-09-23T09:06:00.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.364+0000 7f9324dacb80 1 -- 172.21.15.82:0/3493869206 shutdown_connections 2023-09-23T09:06:00.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.364+0000 7f9324dacb80 1 --2- 172.21.15.82:0/3493869206 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555d5bd70cc0 0x555d5bd71120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:00.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.364+0000 7f9324dacb80 1 --2- 172.21.15.82:0/3493869206 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555d5bd76400 0x555d5bd767e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:00.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.364+0000 7f9324dacb80 1 --2- 172.21.15.82:0/3493869206 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d5bd76d20 0x555d5bd70780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:00.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.364+0000 7f9324dacb80 1 -- 172.21.15.82:0/3493869206 >> 172.21.15.82:0/3493869206 conn(0x555d5bce5160 msgr2=0x555d5bd6b490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:06:00.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.364+0000 7f9324dacb80 1 -- 172.21.15.82:0/3493869206 shutdown_connections 2023-09-23T09:06:00.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.364+0000 7f9324dacb80 1 -- 172.21.15.82:0/3493869206 wait complete. 2023-09-23T09:06:00.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.364+0000 7f9324dacb80 1 -- start start 2023-09-23T09:06:00.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.365+0000 7f9324dacb80 1 Processor -- start 2023-09-23T09:06:00.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.365+0000 7f9324dacb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555d5bd70cc0 0x555d5bd7ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:06:00.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.365+0000 7f9324dacb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555d5bd76400 0x555d5bd79f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:06:00.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.365+0000 7f9324dacb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d5bd76d20 0x555d5bd7a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:06:00.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.366+0000 7f9324dacb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d5bcc2a10 con 0x555d5bd76d20 2023-09-23T09:06:00.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.366+0000 7f9324dacb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d5bc60c30 con 0x555d5bd70cc0 2023-09-23T09:06:00.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.366+0000 7f9324dacb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d5bc60930 con 0x555d5bd76400 2023-09-23T09:06:00.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.366+0000 7f9324dacb80 10 client.0 _ll_register_callbacks cb 0x555d5bbaab00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:06:00.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.366+0000 7f930affd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555d5bd70cc0 0x555d5bd7ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:06:00.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.366+0000 7f930affd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555d5bd70cc0 0x555d5bd7ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:60990/0 (socket says 172.21.15.82:60990) 2023-09-23T09:06:00.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.366+0000 7f930affd700 1 -- 172.21.15.82:0/181491639 learned_addr learned my addr 172.21.15.82:0/181491639 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:06:00.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.366+0000 7f930a7fc700 1 --2- 172.21.15.82:0/181491639 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555d5bd76400 0x555d5bd79f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:06:00.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.366+0000 7f930b7fe700 1 --2- 172.21.15.82:0/181491639 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d5bd76d20 0x555d5bd7a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:06:00.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.366+0000 7f930affd700 1 -- 172.21.15.82:0/181491639 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555d5bd76400 msgr2=0x555d5bd79f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:06:00.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.366+0000 7f930affd700 1 --2- 172.21.15.82:0/181491639 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555d5bd76400 0x555d5bd79f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:00.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.366+0000 7f930affd700 1 -- 172.21.15.82:0/181491639 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d5bd76d20 msgr2=0x555d5bd7a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:06:00.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.366+0000 7f930affd700 1 --2- 172.21.15.82:0/181491639 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d5bd76d20 0x555d5bd7a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:00.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.366+0000 7f930affd700 1 -- 172.21.15.82:0/181491639 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92fc009e10 con 0x555d5bd70cc0 2023-09-23T09:06:00.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.367+0000 7f930affd700 1 --2- 172.21.15.82:0/181491639 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555d5bd70cc0 0x555d5bd7ccc0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f92fc00e680 tx=0x7f92fc0056a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4fc00ba6537aea08 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:06:00.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.367+0000 7f92eeff5700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-09-23T09:06:00.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.367+0000 7f92eeff5700 1 -- 172.21.15.82:0/181491639 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92fc004b60 con 0x555d5bd70cc0 2023-09-23T09:06:00.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.367+0000 7f9324dacb80 1 -- 172.21.15.82:0/181491639 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555d5bd40240 con 0x555d5bd70cc0 2023-09-23T09:06:00.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.367+0000 7f92eeff5700 1 -- 172.21.15.82:0/181491639 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f92fc005ce0 con 0x555d5bd70cc0 2023-09-23T09:06:00.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.367+0000 7f92eeff5700 1 -- 172.21.15.82:0/181491639 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f92fc004cc0 con 0x555d5bd70cc0 2023-09-23T09:06:00.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.367+0000 7f9324dacb80 10 client.26003 fetch_fsmap learned FSMap version 55 2023-09-23T09:06:00.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.367+0000 7f9324dacb80 1 -- 172.21.15.82:0/181491639 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x555d5baeee60 con 0x555d5bd70cc0 2023-09-23T09:06:00.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.367+0000 7f92eeff5700 1 -- 172.21.15.82:0/181491639 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x555d5bd40240 con 0x555d5bd70cc0 2023-09-23T09:06:00.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.368+0000 7f92eeff5700 1 -- 172.21.15.82:0/181491639 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 55) v1 ==== 7934+0+0 (secure 0 0 0) 0x7f92fc00eaf0 con 0x555d5bd70cc0 2023-09-23T09:06:00.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.368+0000 7f9324dacb80 10 client.26003 fetch_fsmap finished waiting for FSMap version 55 2023-09-23T09:06:00.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.368+0000 7f9324dacb80 10 client.26003 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:06:00.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.368+0000 7f9324dacb80 20 client.26003 populate_metadata read hostname 'smithi082' 2023-09-23T09:06:00.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.368+0000 7f9324dacb80 1 --2- 172.21.15.82:0/181491639 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x555d5bd8a6b0 0x555d5bd8cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:06:00.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.368+0000 7f9324dacb80 4 client.26003 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:06:00.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.368+0000 7f9324dacb80 1 -- 172.21.15.82:0/181491639 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555d5bc68c20 con 0x555d5bd8a6b0 2023-09-23T09:06:00.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.368+0000 7f930a7fc700 1 --2- 172.21.15.82:0/181491639 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x555d5bd8a6b0 0x555d5bd8cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:06:00.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.369+0000 7f930a7fc700 1 --2- 172.21.15.82:0/181491639 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x555d5bd8a6b0 0x555d5bd8cad0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=995fb0facd3c026c server_cookie=9332e89199bc1117 in_seq=0 out_seq=0 2023-09-23T09:06:00.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.369+0000 7f92eeff5700 10 client.26003 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:06:00.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.369+0000 7f92eeff5700 1 -- 172.21.15.82:0/181491639 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x555d5bc68c20 con 0x555d5bd8a6b0 2023-09-23T09:06:00.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.369+0000 7f92eeff5700 10 client.26003 handle_command_reply: tid=0 2023-09-23T09:06:00.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.369+0000 7f9324dacb80 1 client.26003 shutdown 2023-09-23T09:06:00.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.370+0000 7f9324dacb80 1 -- 172.21.15.82:0/181491639 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555d5bd70cc0 msgr2=0x555d5bd7ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:06:00.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.370+0000 7f9324dacb80 1 --2- 172.21.15.82:0/181491639 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555d5bd70cc0 0x555d5bd7ccc0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f92fc00e680 tx=0x7f92fc0056a0 comp rx=0 tx=0).stop 2023-09-23T09:06:00.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.370+0000 7f9324dacb80 1 -- 172.21.15.82:0/181491639 shutdown_connections 2023-09-23T09:06:00.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.370+0000 7f9324dacb80 1 --2- 172.21.15.82:0/181491639 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x555d5bd8a6b0 0x555d5bd8cad0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:00.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.370+0000 7f9324dacb80 1 --2- 172.21.15.82:0/181491639 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d5bd76d20 0x555d5bd7a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:00.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.370+0000 7f9324dacb80 1 --2- 172.21.15.82:0/181491639 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555d5bd70cc0 0x555d5bd7ccc0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:00.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.370+0000 7f92eeff5700 0 client.26003 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:06:00.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.370+0000 7f9324dacb80 1 --2- 172.21.15.82:0/181491639 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555d5bd76400 0x555d5bd79f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:00.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.370+0000 7f9324dacb80 1 -- 172.21.15.82:0/181491639 >> 172.21.15.82:0/181491639 conn(0x555d5bce5160 msgr2=0x555d5bd65bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:06:00.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.370+0000 7f9324dacb80 1 -- 172.21.15.82:0/181491639 shutdown_connections 2023-09-23T09:06:00.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.370+0000 7f9324dacb80 1 -- 172.21.15.82:0/181491639 wait complete. 2023-09-23T09:06:00.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.370+0000 7f9324dacb80 20 client.26003 trim_cache size 0 max 16384 2023-09-23T09:06:00.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.388+0000 7f9324dacb80 1 Processor -- start 2023-09-23T09:06:00.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.388+0000 7f9324dacb80 1 -- start start 2023-09-23T09:06:00.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.389+0000 7f9324dacb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555d5bd70cc0 0x555d5bd75860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:06:00.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.389+0000 7f9324dacb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555d5bd76400 0x555d5bd65a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:06:00.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.389+0000 7f9324dacb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d5bd76d20 0x555d5bd7c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:06:00.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.389+0000 7f9324dacb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d5bb449a0 con 0x555d5bd76d20 2023-09-23T09:06:00.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.389+0000 7f9324dacb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d5bd67890 con 0x555d5bd76400 2023-09-23T09:06:00.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.389+0000 7f9324dacb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d5bd6c600 con 0x555d5bd70cc0 2023-09-23T09:06:00.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.389+0000 7f930b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d5bd76d20 0x555d5bd7c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:06:00.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.389+0000 7f930affd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555d5bd70cc0 0x555d5bd75860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:06:00.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.389+0000 7f930a7fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555d5bd76400 0x555d5bd65a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:06:00.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.389+0000 7f930affd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555d5bd70cc0 0x555d5bd75860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:49678/0 (socket says 172.21.15.82:49678) 2023-09-23T09:06:00.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.389+0000 7f930affd700 1 -- 172.21.15.82:0/1302866180 learned_addr learned my addr 172.21.15.82:0/1302866180 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:06:00.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.389+0000 7f930b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d5bd76d20 0x555d5bd7c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59068/0 (socket says 172.21.15.82:59068) 2023-09-23T09:06:00.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.390+0000 7f930b7fe700 1 -- 172.21.15.82:0/1302866180 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555d5bd70cc0 msgr2=0x555d5bd75860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:06:00.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.390+0000 7f930b7fe700 1 --2- 172.21.15.82:0/1302866180 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555d5bd70cc0 0x555d5bd75860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:00.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.390+0000 7f930b7fe700 1 -- 172.21.15.82:0/1302866180 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555d5bd76400 msgr2=0x555d5bd65a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:06:00.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.390+0000 7f930b7fe700 1 --2- 172.21.15.82:0/1302866180 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555d5bd76400 0x555d5bd65a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:00.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.390+0000 7f930b7fe700 1 -- 172.21.15.82:0/1302866180 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555d5bad7ce0 con 0x555d5bd76d20 2023-09-23T09:06:00.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.390+0000 7f930affd700 1 --2- 172.21.15.82:0/1302866180 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555d5bd70cc0 0x555d5bd75860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:06:00.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.390+0000 7f930a7fc700 1 --2- 172.21.15.82:0/1302866180 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555d5bd76400 0x555d5bd65a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:06:00.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.390+0000 7f930b7fe700 1 --2- 172.21.15.82:0/1302866180 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d5bd76d20 0x555d5bd7c860 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f9304009fd0 tx=0x7f930401d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88cbfefa6e743bc6 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:06:00.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.390+0000 7f92f1ffb700 1 -- 172.21.15.82:0/1302866180 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f930400e070 con 0x555d5bd76d20 2023-09-23T09:06:00.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.390+0000 7f92f1ffb700 1 -- 172.21.15.82:0/1302866180 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f930400f040 con 0x555d5bd76d20 2023-09-23T09:06:00.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.390+0000 7f92f1ffb700 1 -- 172.21.15.82:0/1302866180 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9304004020 con 0x555d5bd76d20 2023-09-23T09:06:00.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.391+0000 7f9324dacb80 1 -- 172.21.15.82:0/1302866180 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d5bd76d20 msgr2=0x555d5bd7c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:06:00.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.391+0000 7f9324dacb80 1 --2- 172.21.15.82:0/1302866180 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d5bd76d20 0x555d5bd7c860 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f9304009fd0 tx=0x7f930401d000 comp rx=0 tx=0).stop 2023-09-23T09:06:00.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.391+0000 7f9324dacb80 1 -- 172.21.15.82:0/1302866180 shutdown_connections 2023-09-23T09:06:00.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.391+0000 7f9324dacb80 1 --2- 172.21.15.82:0/1302866180 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d5bd76d20 0x555d5bd7c860 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:00.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.391+0000 7f9324dacb80 1 --2- 172.21.15.82:0/1302866180 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555d5bd70cc0 0x555d5bd75860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:00.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.391+0000 7f9324dacb80 1 --2- 172.21.15.82:0/1302866180 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555d5bd76400 0x555d5bd65a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:00.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.391+0000 7f9324dacb80 1 -- 172.21.15.82:0/1302866180 >> 172.21.15.82:0/1302866180 conn(0x555d5bce5160 msgr2=0x555d5bd65330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:06:00.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.391+0000 7f9324dacb80 1 -- 172.21.15.82:0/1302866180 shutdown_connections 2023-09-23T09:06:00.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.391+0000 7f9324dacb80 1 -- 172.21.15.82:0/1302866180 wait complete. 2023-09-23T09:06:00.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.392+0000 7f9324dacb80 1 -- start start 2023-09-23T09:06:00.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.392+0000 7f9324dacb80 1 Processor -- start 2023-09-23T09:06:00.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.392+0000 7f9324dacb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555d5bd70cc0 0x555d5bd79340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:06:00.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.392+0000 7f9324dacb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555d5bd76400 0x555d5bd79880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:06:00.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.392+0000 7f9324dacb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d5bd76d20 0x555d5bdd8570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:06:00.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.392+0000 7f9324dacb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d5bdd8ab0 con 0x555d5bd76d20 2023-09-23T09:06:00.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.392+0000 7f9324dacb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d5bdd8c20 con 0x555d5bd70cc0 2023-09-23T09:06:00.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.392+0000 7f9324dacb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d5bdd8de0 con 0x555d5bd76400 2023-09-23T09:06:00.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.392+0000 7f9324dacb80 10 client.0 _ll_register_callbacks cb 0x7f9300005c00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:06:00.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.393+0000 7f930affd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555d5bd70cc0 0x555d5bd79340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:06:00.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.393+0000 7f930affd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555d5bd70cc0 0x555d5bd79340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:32772/0 (socket says 172.21.15.82:32772) 2023-09-23T09:06:00.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.393+0000 7f930affd700 1 -- 172.21.15.82:0/819978674 learned_addr learned my addr 172.21.15.82:0/819978674 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:06:00.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.393+0000 7f930b7fe700 1 --2- 172.21.15.82:0/819978674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d5bd76d20 0x555d5bdd8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:06:00.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.393+0000 7f930a7fc700 1 --2- 172.21.15.82:0/819978674 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555d5bd76400 0x555d5bd79880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:06:00.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.393+0000 7f930affd700 1 -- 172.21.15.82:0/819978674 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555d5bd76400 msgr2=0x555d5bd79880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:06:00.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.393+0000 7f930affd700 1 --2- 172.21.15.82:0/819978674 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555d5bd76400 0x555d5bd79880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:00.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.393+0000 7f930affd700 1 -- 172.21.15.82:0/819978674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d5bd76d20 msgr2=0x555d5bdd8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:06:00.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.393+0000 7f930affd700 1 --2- 172.21.15.82:0/819978674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d5bd76d20 0x555d5bdd8570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:00.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.393+0000 7f930affd700 1 -- 172.21.15.82:0/819978674 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555d5baeee60 con 0x555d5bd70cc0 2023-09-23T09:06:00.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.393+0000 7f930b7fe700 1 --2- 172.21.15.82:0/819978674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d5bd76d20 0x555d5bdd8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:06:00.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.393+0000 7f930affd700 1 --2- 172.21.15.82:0/819978674 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555d5bd70cc0 0x555d5bd79340 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f92fc00ee80 tx=0x7f92fc011ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8385087317c99cb1 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:06:00.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.393+0000 7f92eeff5700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-09-23T09:06:00.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.394+0000 7f92eeff5700 1 -- 172.21.15.82:0/819978674 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92fc00e640 con 0x555d5bd70cc0 2023-09-23T09:06:00.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.394+0000 7f92eeff5700 1 -- 172.21.15.82:0/819978674 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f92fc005ce0 con 0x555d5bd70cc0 2023-09-23T09:06:00.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.394+0000 7f9324dacb80 1 -- 172.21.15.82:0/819978674 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555d5bd63930 con 0x555d5bd70cc0 2023-09-23T09:06:00.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.394+0000 7f92eeff5700 1 -- 172.21.15.82:0/819978674 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f92fc00e7a0 con 0x555d5bd70cc0 2023-09-23T09:06:00.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.394+0000 7f9324dacb80 10 client.26009 fetch_fsmap learned FSMap version 55 2023-09-23T09:06:00.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.394+0000 7f9324dacb80 1 -- 172.21.15.82:0/819978674 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x7f930c1a5760 con 0x555d5bd70cc0 2023-09-23T09:06:00.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.394+0000 7f92eeff5700 1 -- 172.21.15.82:0/819978674 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x555d5bd63930 con 0x555d5bd70cc0 2023-09-23T09:06:00.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.395+0000 7f92eeff5700 1 -- 172.21.15.82:0/819978674 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 55) v1 ==== 7934+0+0 (secure 0 0 0) 0x7f92fc03f9b0 con 0x555d5bd70cc0 2023-09-23T09:06:00.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.395+0000 7f9324dacb80 10 client.26009 fetch_fsmap finished waiting for FSMap version 55 2023-09-23T09:06:00.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.395+0000 7f9324dacb80 10 client.26009 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:06:00.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.395+0000 7f9324dacb80 20 client.26009 populate_metadata read hostname 'smithi082' 2023-09-23T09:06:00.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.395+0000 7f9324dacb80 1 --2- 172.21.15.82:0/819978674 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x555d5bde0240 0x555d5bde2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:06:00.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.395+0000 7f9324dacb80 4 client.26009 mds_command: new command op to 24557 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-09-23T09:06:00.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.395+0000 7f9324dacb80 1 -- 172.21.15.82:0/819978674 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x555d5bcbb9f0 con 0x555d5bde0240 2023-09-23T09:06:00.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.395+0000 7f930a7fc700 1 --2- 172.21.15.82:0/819978674 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x555d5bde0240 0x555d5bde2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:06:00.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.395+0000 7f930a7fc700 1 --2- 172.21.15.82:0/819978674 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x555d5bde0240 0x555d5bde2660 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e4d3b51c7ae7c70 server_cookie=cc27aa454f9c2a7e in_seq=0 out_seq=0 2023-09-23T09:06:00.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.395+0000 7f92eeff5700 10 client.26009 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:06:00.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.397+0000 7f92eeff5700 1 -- 172.21.15.82:0/819978674 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x555d5bcbb9f0 con 0x555d5bde0240 2023-09-23T09:06:00.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.397+0000 7f92eeff5700 10 client.26009 handle_command_reply: tid=0 2023-09-23T09:06:00.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.397+0000 7f9324dacb80 1 client.26009 shutdown 2023-09-23T09:06:00.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.397+0000 7f9324dacb80 1 -- 172.21.15.82:0/819978674 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555d5bd70cc0 msgr2=0x555d5bd79340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:06:00.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.397+0000 7f9324dacb80 1 --2- 172.21.15.82:0/819978674 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555d5bd70cc0 0x555d5bd79340 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f92fc00ee80 tx=0x7f92fc011ce0 comp rx=0 tx=0).stop 2023-09-23T09:06:00.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.397+0000 7f9324dacb80 1 -- 172.21.15.82:0/819978674 shutdown_connections 2023-09-23T09:06:00.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.397+0000 7f9324dacb80 1 --2- 172.21.15.82:0/819978674 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x555d5bde0240 0x555d5bde2660 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:00.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.397+0000 7f9324dacb80 1 --2- 172.21.15.82:0/819978674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d5bd76d20 0x555d5bdd8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:00.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.397+0000 7f9324dacb80 1 --2- 172.21.15.82:0/819978674 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555d5bd70cc0 0x555d5bd79340 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:00.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.397+0000 7f9324dacb80 1 --2- 172.21.15.82:0/819978674 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555d5bd76400 0x555d5bd79880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:00.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.397+0000 7f92eeff5700 0 client.26009 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:06:00.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.397+0000 7f9324dacb80 1 -- 172.21.15.82:0/819978674 >> 172.21.15.82:0/819978674 conn(0x555d5bce5160 msgr2=0x555d5bd756d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:06:00.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.397+0000 7f9324dacb80 1 -- 172.21.15.82:0/819978674 shutdown_connections 2023-09-23T09:06:00.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.397+0000 7f9324dacb80 1 -- 172.21.15.82:0/819978674 wait complete. 2023-09-23T09:06:00.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.397+0000 7f9324dacb80 20 client.26009 trim_cache size 0 max 16384 2023-09-23T09:06:00.404 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:06:00.404 INFO:teuthology.orchestra.run.smithi082.stdout: "return_code": 0, 2023-09-23T09:06:00.405 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_tag": "cba46b77-20dd-437c-a60a-ac01b400e1b8", 2023-09-23T09:06:00.405 INFO:teuthology.orchestra.run.smithi082.stdout: "mode": "asynchronous" 2023-09-23T09:06:00.405 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:06:00.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.398+0000 7f93113ff700 1 -- 172.21.15.82:0/1443661169 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f92f40a0140 msgr2=0x7f92f40a2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:06:00.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.398+0000 7f93113ff700 1 --2- 172.21.15.82:0/1443661169 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f92f40a0140 0x7f92f40a2600 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9304009ec0 tx=0x7f93040092f0 comp rx=0 tx=0).stop 2023-09-23T09:06:00.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.398+0000 7f93113ff700 1 -- 172.21.15.82:0/1443661169 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f930c101230 msgr2=0x7f930c073160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:06:00.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.398+0000 7f93113ff700 1 --2- 172.21.15.82:0/1443661169 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f930c101230 0x7f930c073160 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f9300005910 tx=0x7f9300005740 comp rx=0 tx=0).stop 2023-09-23T09:06:00.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.398+0000 7f93113ff700 1 -- 172.21.15.82:0/1443661169 shutdown_connections 2023-09-23T09:06:00.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.398+0000 7f93113ff700 1 --2- 172.21.15.82:0/1443661169 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f92f40a0140 0x7f92f40a2600 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:00.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.398+0000 7f93113ff700 1 --2- 172.21.15.82:0/1443661169 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f930c106880 0x7f930c0736a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:00.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.398+0000 7f93113ff700 1 --2- 172.21.15.82:0/1443661169 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f930c100870 0x7f930c072c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:00.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.398+0000 7f93113ff700 1 --2- 172.21.15.82:0/1443661169 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f930c101230 0x7f930c073160 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:00.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.398+0000 7f93113ff700 1 -- 172.21.15.82:0/1443661169 >> 172.21.15.82:0/1443661169 conn(0x7f930c0fc3a0 msgr2=0x7f930c0fcb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:06:00.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.398+0000 7f93113ff700 1 -- 172.21.15.82:0/1443661169 shutdown_connections 2023-09-23T09:06:00.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.398+0000 7f93113ff700 1 -- 172.21.15.82:0/1443661169 wait complete. 2023-09-23T09:06:00.422 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:06:00.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.689+0000 7fd96b3ff700 1 -- 172.21.15.82:0/4209058571 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd964102aa0 msgr2=0x7fd964102f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:06:00.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.689+0000 7fd96b3ff700 1 --2- 172.21.15.82:0/4209058571 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd964102aa0 0x7fd964102f20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd954009990 tx=0x7fd954009ca0 comp rx=0 tx=0).stop 2023-09-23T09:06:00.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.689+0000 7fd96b3ff700 1 -- 172.21.15.82:0/4209058571 shutdown_connections 2023-09-23T09:06:00.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.689+0000 7fd96b3ff700 1 --2- 172.21.15.82:0/4209058571 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd964103460 0x7fd96410f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:00.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.689+0000 7fd96b3ff700 1 --2- 172.21.15.82:0/4209058571 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd964108ab0 0x7fd964108e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:00.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.689+0000 7fd96b3ff700 1 --2- 172.21.15.82:0/4209058571 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd964102aa0 0x7fd964102f20 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:00.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.689+0000 7fd96b3ff700 1 -- 172.21.15.82:0/4209058571 >> 172.21.15.82:0/4209058571 conn(0x7fd9640fe590 msgr2=0x7fd9641009b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:06:00.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.689+0000 7fd96b3ff700 1 -- 172.21.15.82:0/4209058571 shutdown_connections 2023-09-23T09:06:00.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.689+0000 7fd96b3ff700 1 -- 172.21.15.82:0/4209058571 wait complete. 2023-09-23T09:06:00.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.691+0000 7fd96b3ff700 1 Processor -- start 2023-09-23T09:06:00.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.691+0000 7fd96b3ff700 1 -- start start 2023-09-23T09:06:00.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.691+0000 7fd96b3ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd964102aa0 0x7fd96419e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:06:00.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.691+0000 7fd96b3ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd964103460 0x7fd96419ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:06:00.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.691+0000 7fd96b3ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd964108ab0 0x7fd964198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:06:00.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.691+0000 7fd96b3ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd964198fb0 con 0x7fd964103460 2023-09-23T09:06:00.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.691+0000 7fd96b3ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd964199120 con 0x7fd964102aa0 2023-09-23T09:06:00.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.691+0000 7fd96b3ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9641992e0 con 0x7fd964108ab0 2023-09-23T09:06:00.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.692+0000 7fd96999c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd964108ab0 0x7fd964198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:06:00.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.692+0000 7fd96919b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd964102aa0 0x7fd96419e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:06:00.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.692+0000 7fd96999c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd964108ab0 0x7fd964198940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:49706/0 (socket says 172.21.15.82:49706) 2023-09-23T09:06:00.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.692+0000 7fd96899a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd964103460 0x7fd96419ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:06:00.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.692+0000 7fd96999c700 1 -- 172.21.15.82:0/835336541 learned_addr learned my addr 172.21.15.82:0/835336541 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:06:00.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.692+0000 7fd96999c700 1 -- 172.21.15.82:0/835336541 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd964102aa0 msgr2=0x7fd96419e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:06:00.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.692+0000 7fd96999c700 1 --2- 172.21.15.82:0/835336541 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd964102aa0 0x7fd96419e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:00.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.692+0000 7fd96999c700 1 -- 172.21.15.82:0/835336541 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd964103460 msgr2=0x7fd96419ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:06:00.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.692+0000 7fd96999c700 1 --2- 172.21.15.82:0/835336541 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd964103460 0x7fd96419ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:00.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.692+0000 7fd96999c700 1 -- 172.21.15.82:0/835336541 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd960009520 con 0x7fd964108ab0 2023-09-23T09:06:00.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.692+0000 7fd96899a700 1 --2- 172.21.15.82:0/835336541 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd964103460 0x7fd96419ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:06:00.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.693+0000 7fd96999c700 1 --2- 172.21.15.82:0/835336541 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd964108ab0 0x7fd964198940 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd95c00ef30 tx=0x7fd95c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:06:00.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.693+0000 7fd95a7fc700 1 -- 172.21.15.82:0/835336541 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95c018070 con 0x7fd964108ab0 2023-09-23T09:06:00.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.693+0000 7fd95a7fc700 1 -- 172.21.15.82:0/835336541 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd95c00f040 con 0x7fd964108ab0 2023-09-23T09:06:00.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.693+0000 7fd96b3ff700 1 -- 172.21.15.82:0/835336541 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9540095f0 con 0x7fd964108ab0 2023-09-23T09:06:00.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.693+0000 7fd95a7fc700 1 -- 172.21.15.82:0/835336541 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95c00cbc0 con 0x7fd964108ab0 2023-09-23T09:06:00.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.693+0000 7fd96b3ff700 1 -- 172.21.15.82:0/835336541 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9641a56e0 con 0x7fd964108ab0 2023-09-23T09:06:00.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.697+0000 7fd95a7fc700 1 -- 172.21.15.82:0/835336541 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7fd95c007500 con 0x7fd964108ab0 2023-09-23T09:06:00.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.698+0000 7fd95a7fc700 1 --2- 172.21.15.82:0/835336541 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fd9500a0140 0x7fd9500a2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:06:00.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.698+0000 7fd95a7fc700 1 -- 172.21.15.82:0/835336541 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fd95c0cb110 con 0x7fd964108ab0 2023-09-23T09:06:00.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.698+0000 7fd97ec40b80 1 Processor -- start 2023-09-23T09:06:00.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.699+0000 7fd97ec40b80 1 -- start start 2023-09-23T09:06:00.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.699+0000 7fd96919b700 1 --2- 172.21.15.82:0/835336541 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fd9500a0140 0x7fd9500a2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:06:00.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.699+0000 7fd97ec40b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f7547d380 0x559f7547d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:06:00.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.699+0000 7fd97ec40b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f7547dca0 0x559f75477700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:06:00.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.699+0000 7fd97ec40b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559f75477c40 0x559f754780a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:06:00.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.699+0000 7fd97ec40b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f753df7b0 con 0x559f7547dca0 2023-09-23T09:06:00.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.699+0000 7fd97ec40b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f753d0780 con 0x559f7547d380 2023-09-23T09:06:00.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.699+0000 7fd97ec40b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f753ce0a0 con 0x559f75477c40 2023-09-23T09:06:00.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.699+0000 7fd96919b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f7547d380 0x559f7547d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:06:00.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.700+0000 7fd96899a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f7547dca0 0x559f75477700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:06:00.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.700+0000 7fd96919b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f7547d380 0x559f7547d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:32792/0 (socket says 172.21.15.82:32792) 2023-09-23T09:06:00.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.700+0000 7fd96919b700 1 -- 172.21.15.82:0/3425001254 learned_addr learned my addr 172.21.15.82:0/3425001254 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:06:00.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.700+0000 7fd96919b700 1 --2- 172.21.15.82:0/835336541 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fd9500a0140 0x7fd9500a2600 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd960009dc0 tx=0x7fd960009260 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:06:00.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.700+0000 7fd96999c700 1 --2- 172.21.15.82:0/3425001254 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559f75477c40 0x559f754780a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:06:00.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.700+0000 7fd96899a700 1 -- 172.21.15.82:0/3425001254 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559f75477c40 msgr2=0x559f754780a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:06:00.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.700+0000 7fd96899a700 1 --2- 172.21.15.82:0/3425001254 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559f75477c40 0x559f754780a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:00.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.700+0000 7fd96899a700 1 -- 172.21.15.82:0/3425001254 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f7547d380 msgr2=0x559f7547d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:06:00.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.700+0000 7fd96899a700 1 --2- 172.21.15.82:0/3425001254 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f7547d380 0x559f7547d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:00.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.700+0000 7fd96899a700 1 -- 172.21.15.82:0/3425001254 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559f75249630 con 0x559f7547dca0 2023-09-23T09:06:00.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.700+0000 7fd96919b700 1 --2- 172.21.15.82:0/3425001254 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f7547d380 0x559f7547d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:06:00.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.700+0000 7fd96899a700 1 --2- 172.21.15.82:0/3425001254 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f7547dca0 0x559f75477700 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fd954005910 tx=0x7fd954005f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecd2bedacc98bfb7 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:06:00.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.701+0000 7fd94f7fe700 1 -- 172.21.15.82:0/3425001254 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95401d070 con 0x559f7547dca0 2023-09-23T09:06:00.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.701+0000 7fd94f7fe700 1 -- 172.21.15.82:0/3425001254 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd95401e040 con 0x559f7547dca0 2023-09-23T09:06:00.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.701+0000 7fd94f7fe700 1 -- 172.21.15.82:0/3425001254 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd954004c10 con 0x559f7547dca0 2023-09-23T09:06:00.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.701+0000 7fd97ec40b80 1 -- 172.21.15.82:0/3425001254 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f7547dca0 msgr2=0x559f75477700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:06:00.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.701+0000 7fd97ec40b80 1 --2- 172.21.15.82:0/3425001254 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f7547dca0 0x559f75477700 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fd954005910 tx=0x7fd954005f00 comp rx=0 tx=0).stop 2023-09-23T09:06:00.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.702+0000 7fd97ec40b80 1 -- 172.21.15.82:0/3425001254 shutdown_connections 2023-09-23T09:06:00.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.702+0000 7fd97ec40b80 1 --2- 172.21.15.82:0/3425001254 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559f75477c40 0x559f754780a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:00.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.702+0000 7fd97ec40b80 1 --2- 172.21.15.82:0/3425001254 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f7547d380 0x559f7547d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:00.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.702+0000 7fd97ec40b80 1 --2- 172.21.15.82:0/3425001254 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f7547dca0 0x559f75477700 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:00.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.702+0000 7fd97ec40b80 1 -- 172.21.15.82:0/3425001254 >> 172.21.15.82:0/3425001254 conn(0x559f753ec0e0 msgr2=0x559f75472410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:06:00.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.702+0000 7fd97ec40b80 1 -- 172.21.15.82:0/3425001254 shutdown_connections 2023-09-23T09:06:00.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.702+0000 7fd97ec40b80 1 -- 172.21.15.82:0/3425001254 wait complete. 2023-09-23T09:06:00.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.702+0000 7fd97ec40b80 1 -- start start 2023-09-23T09:06:00.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.703+0000 7fd97ec40b80 1 Processor -- start 2023-09-23T09:06:00.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.703+0000 7fd97ec40b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559f75477c40 0x559f75483cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:06:00.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.703+0000 7fd97ec40b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f7547d380 0x559f75480f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:06:00.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.703+0000 7fd97ec40b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f7547dca0 0x559f75481670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:06:00.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.703+0000 7fd97ec40b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f753c9990 con 0x559f7547dca0 2023-09-23T09:06:00.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.703+0000 7fd97ec40b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f75367bb0 con 0x559f7547d380 2023-09-23T09:06:00.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.703+0000 7fd97ec40b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f753678b0 con 0x559f75477c40 2023-09-23T09:06:00.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.703+0000 7fd97ec40b80 10 client.0 _ll_register_callbacks cb 0x559f752b1a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:06:00.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.704+0000 7fd96899a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f7547d380 0x559f75480f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:06:00.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.704+0000 7fd96899a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f7547d380 0x559f75480f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:32806/0 (socket says 172.21.15.82:32806) 2023-09-23T09:06:00.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.704+0000 7fd96899a700 1 -- 172.21.15.82:0/2152251617 learned_addr learned my addr 172.21.15.82:0/2152251617 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:06:00.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.704+0000 7fd96999c700 1 --2- 172.21.15.82:0/2152251617 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f7547dca0 0x559f75481670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:06:00.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.704+0000 7fd96919b700 1 --2- 172.21.15.82:0/2152251617 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559f75477c40 0x559f75483cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:06:00.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.704+0000 7fd96899a700 1 -- 172.21.15.82:0/2152251617 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559f75477c40 msgr2=0x559f75483cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:06:00.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.704+0000 7fd96899a700 1 --2- 172.21.15.82:0/2152251617 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559f75477c40 0x559f75483cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:00.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.704+0000 7fd96899a700 1 -- 172.21.15.82:0/2152251617 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f7547dca0 msgr2=0x559f75481670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:06:00.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.704+0000 7fd96899a700 1 --2- 172.21.15.82:0/2152251617 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f7547dca0 0x559f75481670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:00.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.704+0000 7fd96899a700 1 -- 172.21.15.82:0/2152251617 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd960017050 con 0x559f7547d380 2023-09-23T09:06:00.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.704+0000 7fd96899a700 1 --2- 172.21.15.82:0/2152251617 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f7547d380 0x559f75480f30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd954005fe0 tx=0x7fd9540229f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e84aa76459404f50 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:06:00.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.704+0000 7fd94cff9700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-09-23T09:06:00.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.705+0000 7fd94cff9700 1 -- 172.21.15.82:0/2152251617 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd954031070 con 0x559f7547d380 2023-09-23T09:06:00.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.705+0000 7fd97ec40b80 1 -- 172.21.15.82:0/2152251617 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559f754471c0 con 0x559f7547d380 2023-09-23T09:06:00.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.705+0000 7fd94cff9700 1 -- 172.21.15.82:0/2152251617 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fd954022bd0 con 0x559f7547d380 2023-09-23T09:06:00.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.705+0000 7fd94cff9700 1 -- 172.21.15.82:0/2152251617 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd95401d040 con 0x559f7547d380 2023-09-23T09:06:00.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.705+0000 7fd97ec40b80 10 client.26021 fetch_fsmap learned FSMap version 55 2023-09-23T09:06:00.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.705+0000 7fd97ec40b80 1 -- 172.21.15.82:0/2152251617 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x7fd964110270 con 0x559f7547d380 2023-09-23T09:06:00.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.705+0000 7fd94cff9700 1 -- 172.21.15.82:0/2152251617 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x559f754471c0 con 0x559f7547d380 2023-09-23T09:06:00.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.705+0000 7fd94cff9700 1 -- 172.21.15.82:0/2152251617 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 55) v1 ==== 7934+0+0 (secure 0 0 0) 0x7fd954034020 con 0x559f7547d380 2023-09-23T09:06:00.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.706+0000 7fd97ec40b80 10 client.26021 fetch_fsmap finished waiting for FSMap version 55 2023-09-23T09:06:00.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.706+0000 7fd97ec40b80 10 client.26021 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:06:00.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.706+0000 7fd97ec40b80 20 client.26021 populate_metadata read hostname 'smithi082' 2023-09-23T09:06:00.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.706+0000 7fd97ec40b80 1 --2- 172.21.15.82:0/2152251617 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x559f75491300 0x559f75493720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:06:00.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.706+0000 7fd97ec40b80 4 client.26021 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:06:00.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.706+0000 7fd97ec40b80 1 -- 172.21.15.82:0/2152251617 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559f7536fba0 con 0x559f75491300 2023-09-23T09:06:00.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.706+0000 7fd96919b700 1 --2- 172.21.15.82:0/2152251617 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x559f75491300 0x559f75493720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:06:00.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.707+0000 7fd96919b700 1 --2- 172.21.15.82:0/2152251617 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x559f75491300 0x559f75493720 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=818b35eeaed8f2dd server_cookie=398d9b431962e8b3 in_seq=0 out_seq=0 2023-09-23T09:06:00.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.707+0000 7fd94cff9700 10 client.26021 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:06:00.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.707+0000 7fd94cff9700 1 -- 172.21.15.82:0/2152251617 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x559f7536fba0 con 0x559f75491300 2023-09-23T09:06:00.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.707+0000 7fd94cff9700 10 client.26021 handle_command_reply: tid=0 2023-09-23T09:06:00.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.707+0000 7fd97ec40b80 1 client.26021 shutdown 2023-09-23T09:06:00.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.707+0000 7fd97ec40b80 1 -- 172.21.15.82:0/2152251617 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f7547d380 msgr2=0x559f75480f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:06:00.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.707+0000 7fd97ec40b80 1 --2- 172.21.15.82:0/2152251617 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f7547d380 0x559f75480f30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd954005fe0 tx=0x7fd9540229f0 comp rx=0 tx=0).stop 2023-09-23T09:06:00.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.707+0000 7fd97ec40b80 1 -- 172.21.15.82:0/2152251617 shutdown_connections 2023-09-23T09:06:00.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.708+0000 7fd97ec40b80 1 --2- 172.21.15.82:0/2152251617 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x559f75491300 0x559f75493720 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:00.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.708+0000 7fd97ec40b80 1 --2- 172.21.15.82:0/2152251617 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f7547dca0 0x559f75481670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:00.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.708+0000 7fd97ec40b80 1 --2- 172.21.15.82:0/2152251617 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559f75477c40 0x559f75483cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:00.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.708+0000 7fd97ec40b80 1 --2- 172.21.15.82:0/2152251617 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f7547d380 0x559f75480f30 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:00.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.708+0000 7fd97ec40b80 1 -- 172.21.15.82:0/2152251617 >> 172.21.15.82:0/2152251617 conn(0x559f753ec0e0 msgr2=0x559f7546cb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:06:00.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.708+0000 7fd94cff9700 0 client.26021 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:06:00.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.708+0000 7fd97ec40b80 1 -- 172.21.15.82:0/2152251617 shutdown_connections 2023-09-23T09:06:00.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.708+0000 7fd97ec40b80 1 -- 172.21.15.82:0/2152251617 wait complete. 2023-09-23T09:06:00.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.708+0000 7fd97ec40b80 20 client.26021 trim_cache size 0 max 16384 2023-09-23T09:06:00.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.727+0000 7fd97ec40b80 1 Processor -- start 2023-09-23T09:06:00.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.727+0000 7fd97ec40b80 1 -- start start 2023-09-23T09:06:00.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.727+0000 7fd97ec40b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f75477c40 0x559f754837e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:06:00.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.727+0000 7fd97ec40b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f7547d380 0x559f7547b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:06:00.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.727+0000 7fd97ec40b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559f7547dca0 0x559f7547b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:06:00.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.727+0000 7fd97ec40b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f7524b920 con 0x559f75477c40 2023-09-23T09:06:00.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.727+0000 7fd97ec40b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f754471c0 con 0x559f7547d380 2023-09-23T09:06:00.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.727+0000 7fd97ec40b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f7546e880 con 0x559f7547dca0 2023-09-23T09:06:00.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.728+0000 7fd96919b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f75477c40 0x559f754837e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:06:00.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.728+0000 7fd96919b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f75477c40 0x559f754837e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59134/0 (socket says 172.21.15.82:59134) 2023-09-23T09:06:00.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.728+0000 7fd96919b700 1 -- 172.21.15.82:0/2446906498 learned_addr learned my addr 172.21.15.82:0/2446906498 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:06:00.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.728+0000 7fd96899a700 1 --2- 172.21.15.82:0/2446906498 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f7547d380 0x559f7547b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:06:00.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.728+0000 7fd96999c700 1 --2- 172.21.15.82:0/2446906498 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559f7547dca0 0x559f7547b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:06:00.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.728+0000 7fd96919b700 1 -- 172.21.15.82:0/2446906498 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559f7547dca0 msgr2=0x559f7547b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:06:00.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.728+0000 7fd96919b700 1 --2- 172.21.15.82:0/2446906498 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559f7547dca0 0x559f7547b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:00.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.728+0000 7fd96919b700 1 -- 172.21.15.82:0/2446906498 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f7547d380 msgr2=0x559f7547b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:06:00.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.728+0000 7fd96919b700 1 --2- 172.21.15.82:0/2446906498 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f7547d380 0x559f7547b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:00.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.728+0000 7fd96919b700 1 -- 172.21.15.82:0/2446906498 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559f751f5de0 con 0x559f75477c40 2023-09-23T09:06:00.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.728+0000 7fd96919b700 1 --2- 172.21.15.82:0/2446906498 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f75477c40 0x559f754837e0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fd960009490 tx=0x7fd960019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8bb9cc827795a43 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:06:00.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.729+0000 7fd94ffff700 1 -- 172.21.15.82:0/2446906498 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd960021040 con 0x559f75477c40 2023-09-23T09:06:00.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.729+0000 7fd94ffff700 1 -- 172.21.15.82:0/2446906498 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd960022040 con 0x559f75477c40 2023-09-23T09:06:00.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.729+0000 7fd94ffff700 1 -- 172.21.15.82:0/2446906498 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd960003d90 con 0x559f75477c40 2023-09-23T09:06:00.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.729+0000 7fd97ec40b80 1 -- 172.21.15.82:0/2446906498 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f75477c40 msgr2=0x559f754837e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:06:00.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.729+0000 7fd97ec40b80 1 --2- 172.21.15.82:0/2446906498 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f75477c40 0x559f754837e0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fd960009490 tx=0x7fd960019000 comp rx=0 tx=0).stop 2023-09-23T09:06:00.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.730+0000 7fd97ec40b80 1 -- 172.21.15.82:0/2446906498 shutdown_connections 2023-09-23T09:06:00.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.730+0000 7fd97ec40b80 1 --2- 172.21.15.82:0/2446906498 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559f7547dca0 0x559f7547b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:00.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.730+0000 7fd97ec40b80 1 --2- 172.21.15.82:0/2446906498 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f75477c40 0x559f754837e0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:00.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.730+0000 7fd97ec40b80 1 --2- 172.21.15.82:0/2446906498 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f7547d380 0x559f7547b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:00.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.730+0000 7fd97ec40b80 1 -- 172.21.15.82:0/2446906498 >> 172.21.15.82:0/2446906498 conn(0x559f753ec0e0 msgr2=0x559f7548d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:06:00.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.730+0000 7fd97ec40b80 1 -- 172.21.15.82:0/2446906498 shutdown_connections 2023-09-23T09:06:00.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.730+0000 7fd97ec40b80 1 -- 172.21.15.82:0/2446906498 wait complete. 2023-09-23T09:06:00.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.730+0000 7fd97ec40b80 1 -- start start 2023-09-23T09:06:00.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.730+0000 7fd97ec40b80 1 Processor -- start 2023-09-23T09:06:00.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.731+0000 7fd97ec40b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f75477c40 0x559f75486910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:06:00.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.731+0000 7fd97ec40b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f7547d380 0x559f75486e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:06:00.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.731+0000 7fd97ec40b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559f7547dca0 0x559f754e40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:06:00.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.731+0000 7fd97ec40b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f754e4630 con 0x559f7547d380 2023-09-23T09:06:00.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.731+0000 7fd97ec40b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f754e4770 con 0x559f75477c40 2023-09-23T09:06:00.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.731+0000 7fd97ec40b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f754e4900 con 0x559f7547dca0 2023-09-23T09:06:00.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.731+0000 7fd97ec40b80 10 client.0 _ll_register_callbacks cb 0x7fd960009a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:06:00.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.731+0000 7fd96899a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f7547d380 0x559f75486e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:06:00.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.731+0000 7fd96919b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f75477c40 0x559f75486910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:06:00.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.731+0000 7fd96899a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f7547d380 0x559f75486e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59150/0 (socket says 172.21.15.82:59150) 2023-09-23T09:06:00.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.731+0000 7fd96899a700 1 -- 172.21.15.82:0/2676531726 learned_addr learned my addr 172.21.15.82:0/2676531726 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:06:00.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.731+0000 7fd96999c700 1 --2- 172.21.15.82:0/2676531726 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559f7547dca0 0x559f754e40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:06:00.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.731+0000 7fd96899a700 1 -- 172.21.15.82:0/2676531726 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559f7547dca0 msgr2=0x559f754e40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:06:00.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.731+0000 7fd96899a700 1 --2- 172.21.15.82:0/2676531726 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559f7547dca0 0x559f754e40f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:00.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.731+0000 7fd96899a700 1 -- 172.21.15.82:0/2676531726 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f75477c40 msgr2=0x559f75486910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:06:00.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.731+0000 7fd96899a700 1 --2- 172.21.15.82:0/2676531726 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f75477c40 0x559f75486910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:00.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.731+0000 7fd96899a700 1 -- 172.21.15.82:0/2676531726 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559f751dec60 con 0x559f7547d380 2023-09-23T09:06:00.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.732+0000 7fd96899a700 1 --2- 172.21.15.82:0/2676531726 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f7547d380 0x559f75486e50 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x559f754807f0 tx=0x7fd954022c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8362b0ff7b5735d server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:06:00.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.732+0000 7fd94cff9700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:06:00.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.732+0000 7fd94cff9700 1 -- 172.21.15.82:0/2676531726 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd954031030 con 0x559f7547d380 2023-09-23T09:06:00.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.732+0000 7fd97ec40b80 1 -- 172.21.15.82:0/2676531726 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559f7546a8b0 con 0x559f7547d380 2023-09-23T09:06:00.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.732+0000 7fd94cff9700 1 -- 172.21.15.82:0/2676531726 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fd954032070 con 0x559f7547d380 2023-09-23T09:06:00.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.732+0000 7fd94cff9700 1 -- 172.21.15.82:0/2676531726 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd95401d040 con 0x559f7547d380 2023-09-23T09:06:00.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.732+0000 7fd97ec40b80 10 client.16338 fetch_fsmap learned FSMap version 55 2023-09-23T09:06:00.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.732+0000 7fd97ec40b80 1 -- 172.21.15.82:0/2676531726 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x559f7521c250 con 0x559f7547d380 2023-09-23T09:06:00.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.732+0000 7fd94cff9700 1 -- 172.21.15.82:0/2676531726 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x559f7546a8b0 con 0x559f7547d380 2023-09-23T09:06:00.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.733+0000 7fd94cff9700 1 -- 172.21.15.82:0/2676531726 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 55) v1 ==== 7934+0+0 (secure 0 0 0) 0x7fd954034070 con 0x559f7547d380 2023-09-23T09:06:00.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.733+0000 7fd97ec40b80 10 client.16338 fetch_fsmap finished waiting for FSMap version 55 2023-09-23T09:06:00.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.733+0000 7fd97ec40b80 10 client.16338 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:06:00.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.733+0000 7fd97ec40b80 20 client.16338 populate_metadata read hostname 'smithi082' 2023-09-23T09:06:00.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.733+0000 7fd97ec40b80 1 --2- 172.21.15.82:0/2676531726 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x559f754e5d30 0x559f754e8150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:06:00.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.733+0000 7fd97ec40b80 4 client.16338 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:06:00.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.733+0000 7fd97ec40b80 1 -- 172.21.15.82:0/2676531726 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x559f753c2970 con 0x559f754e5d30 2023-09-23T09:06:00.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.733+0000 7fd96919b700 1 --2- 172.21.15.82:0/2676531726 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x559f754e5d30 0x559f754e8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:06:00.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.734+0000 7fd94cff9700 10 client.16338 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:06:00.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.734+0000 7fd96919b700 1 --2- 172.21.15.82:0/2676531726 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x559f754e5d30 0x559f754e8150 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=829e2b4db1e37e6d server_cookie=56731740622c196b in_seq=0 out_seq=0 2023-09-23T09:06:00.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.734+0000 7fd94cff9700 1 -- 172.21.15.82:0/2676531726 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x559f753c2970 con 0x559f754e5d30 2023-09-23T09:06:00.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.734+0000 7fd94cff9700 10 client.16338 handle_command_reply: tid=0 2023-09-23T09:06:00.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.734+0000 7fd97ec40b80 1 client.16338 shutdown 2023-09-23T09:06:00.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.734+0000 7fd97ec40b80 1 -- 172.21.15.82:0/2676531726 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f7547d380 msgr2=0x559f75486e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:06:00.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.734+0000 7fd97ec40b80 1 --2- 172.21.15.82:0/2676531726 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f7547d380 0x559f75486e50 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x559f754807f0 tx=0x7fd954022c90 comp rx=0 tx=0).stop 2023-09-23T09:06:00.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.734+0000 7fd97ec40b80 1 -- 172.21.15.82:0/2676531726 shutdown_connections 2023-09-23T09:06:00.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.734+0000 7fd97ec40b80 1 --2- 172.21.15.82:0/2676531726 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559f7547dca0 0x559f754e40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:00.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.734+0000 7fd97ec40b80 1 --2- 172.21.15.82:0/2676531726 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f75477c40 0x559f75486910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:00.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.734+0000 7fd97ec40b80 1 --2- 172.21.15.82:0/2676531726 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x559f754e5d30 0x559f754e8150 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:00.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.734+0000 7fd97ec40b80 1 --2- 172.21.15.82:0/2676531726 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f7547d380 0x559f75486e50 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:00.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.734+0000 7fd97ec40b80 1 -- 172.21.15.82:0/2676531726 >> 172.21.15.82:0/2676531726 conn(0x559f753ec0e0 msgr2=0x559f7547b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:06:00.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.734+0000 7fd94cff9700 0 client.16338 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:06:00.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.734+0000 7fd97ec40b80 1 -- 172.21.15.82:0/2676531726 shutdown_connections 2023-09-23T09:06:00.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.734+0000 7fd97ec40b80 1 -- 172.21.15.82:0/2676531726 wait complete. 2023-09-23T09:06:00.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.735+0000 7fd97ec40b80 20 client.16338 trim_cache size 0 max 16384 2023-09-23T09:06:00.742 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:06:00.742 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "IDLE (waiting for more scrubs)", 2023-09-23T09:06:00.742 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:06:00.742 INFO:teuthology.orchestra.run.smithi082.stdout: "cba46b77-20dd-437c-a60a-ac01b400e1b8": { 2023-09-23T09:06:00.743 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:06:00.743 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "cba46b77-20dd-437c-a60a-ac01b400e1b8", 2023-09-23T09:06:00.743 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:06:00.743 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:06:00.743 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:06:00.743 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:06:00.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.735+0000 7fd96b3ff700 1 -- 172.21.15.82:0/835336541 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fd9500a0140 msgr2=0x7fd9500a2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:06:00.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.735+0000 7fd96b3ff700 1 --2- 172.21.15.82:0/835336541 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fd9500a0140 0x7fd9500a2600 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd960009dc0 tx=0x7fd960009260 comp rx=0 tx=0).stop 2023-09-23T09:06:00.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.735+0000 7fd96b3ff700 1 -- 172.21.15.82:0/835336541 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd964108ab0 msgr2=0x7fd964198940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:06:00.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.735+0000 7fd96b3ff700 1 --2- 172.21.15.82:0/835336541 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd964108ab0 0x7fd964198940 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd95c00ef30 tx=0x7fd95c00c3a0 comp rx=0 tx=0).stop 2023-09-23T09:06:00.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.735+0000 7fd96b3ff700 1 -- 172.21.15.82:0/835336541 shutdown_connections 2023-09-23T09:06:00.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.735+0000 7fd96b3ff700 1 --2- 172.21.15.82:0/835336541 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fd9500a0140 0x7fd9500a2600 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:00.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.735+0000 7fd96b3ff700 1 --2- 172.21.15.82:0/835336541 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd964108ab0 0x7fd964198940 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:00.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.735+0000 7fd96b3ff700 1 --2- 172.21.15.82:0/835336541 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd964102aa0 0x7fd96419e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:00.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.735+0000 7fd96b3ff700 1 --2- 172.21.15.82:0/835336541 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd964103460 0x7fd96419ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:00.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.735+0000 7fd96b3ff700 1 -- 172.21.15.82:0/835336541 >> 172.21.15.82:0/835336541 conn(0x7fd9640fe590 msgr2=0x7fd9640fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:06:00.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.735+0000 7fd96b3ff700 1 -- 172.21.15.82:0/835336541 shutdown_connections 2023-09-23T09:06:00.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:00.735+0000 7fd96b3ff700 1 -- 172.21.15.82:0/835336541 wait complete. 2023-09-23T09:06:00.755 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:06:00 smithi082 ceph-mon[97694]: pgmap v280: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 20 MiB/s wr, 234 op/s 2023-09-23T09:06:00.755 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:06:00 smithi082 ceph-mon[97694]: scrub summary: active paths [/] 2023-09-23T09:06:00.755 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:06:00 smithi082 ceph-mon[97694]: scrub summary: idle+waiting paths [/] 2023-09-23T09:06:00.757 INFO:tasks.cephfs.filesystem:scrub status for tag:cba46b77-20dd-437c-a60a-ac01b400e1b8 - {'path': '/', 'tag': 'cba46b77-20dd-437c-a60a-ac01b400e1b8', 'options': 'recursive,force'} 2023-09-23T09:06:00.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:06:00 smithi161 ceph-mon[99580]: pgmap v280: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 20 MiB/s wr, 234 op/s 2023-09-23T09:06:00.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:06:00 smithi161 ceph-mon[99580]: scrub summary: active paths [/] 2023-09-23T09:06:00.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:06:00 smithi161 ceph-mon[99580]: scrub summary: idle+waiting paths [/] 2023-09-23T09:06:01.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:06:00 smithi135 ceph-mon[99205]: pgmap v280: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 20 MiB/s wr, 234 op/s 2023-09-23T09:06:01.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:06:00 smithi135 ceph-mon[99205]: scrub summary: active paths [/] 2023-09-23T09:06:01.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:06:00 smithi135 ceph-mon[99205]: scrub summary: idle+waiting paths [/] 2023-09-23T09:06:01.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:06:01 smithi161 ceph-mon[99580]: scrub queued for path: / 2023-09-23T09:06:01.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:06:01 smithi161 ceph-mon[99580]: scrub summary: idle+waiting paths [/] 2023-09-23T09:06:01.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:06:01 smithi161 ceph-mon[99580]: scrub summary: active paths [/] 2023-09-23T09:06:01.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:06:01 smithi161 ceph-mon[99580]: scrub summary: active paths [/] 2023-09-23T09:06:01.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:06:01 smithi161 ceph-mon[99580]: scrub summary: active paths [/] 2023-09-23T09:06:01.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:06:01 smithi161 ceph-mon[99580]: scrub summary: idle+waiting paths [/] 2023-09-23T09:06:01.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:06:01 smithi161 ceph-mon[99580]: scrub summary: active paths [/] 2023-09-23T09:06:01.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:06:01 smithi161 ceph-mon[99580]: scrub summary: idle+waiting paths [/] 2023-09-23T09:06:01.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:06:01 smithi161 ceph-mon[99580]: scrub summary: active paths [/] 2023-09-23T09:06:01.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:06:01 smithi161 ceph-mon[99580]: scrub summary: active paths [/] 2023-09-23T09:06:01.900 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:06:01 smithi161 ceph-mon[99580]: scrub summary: idle+waiting paths [/] 2023-09-23T09:06:01.900 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:06:01 smithi161 ceph-mon[99580]: scrub summary: idle+waiting paths [/] 2023-09-23T09:06:01.900 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:06:01 smithi161 ceph-mon[99580]: scrub summary: idle+waiting paths [/] 2023-09-23T09:06:02.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:06:01 smithi135 ceph-mon[99205]: scrub queued for path: / 2023-09-23T09:06:02.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:06:01 smithi135 ceph-mon[99205]: scrub summary: idle+waiting paths [/] 2023-09-23T09:06:02.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:06:01 smithi135 ceph-mon[99205]: scrub summary: active paths [/] 2023-09-23T09:06:02.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:06:01 smithi135 ceph-mon[99205]: scrub summary: active paths [/] 2023-09-23T09:06:02.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:06:01 smithi135 ceph-mon[99205]: scrub summary: active paths [/] 2023-09-23T09:06:02.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:06:01 smithi135 ceph-mon[99205]: scrub summary: idle+waiting paths [/] 2023-09-23T09:06:02.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:06:01 smithi135 ceph-mon[99205]: scrub summary: active paths [/] 2023-09-23T09:06:02.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:06:01 smithi135 ceph-mon[99205]: scrub summary: idle+waiting paths [/] 2023-09-23T09:06:02.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:06:01 smithi135 ceph-mon[99205]: scrub summary: active paths [/] 2023-09-23T09:06:02.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:06:01 smithi135 ceph-mon[99205]: scrub summary: active paths [/] 2023-09-23T09:06:02.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:06:01 smithi135 ceph-mon[99205]: scrub summary: idle+waiting paths [/] 2023-09-23T09:06:02.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:06:01 smithi135 ceph-mon[99205]: scrub summary: idle+waiting paths [/] 2023-09-23T09:06:02.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:06:01 smithi135 ceph-mon[99205]: scrub summary: idle+waiting paths [/] 2023-09-23T09:06:02.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:06:01 smithi082 ceph-mon[97694]: scrub queued for path: / 2023-09-23T09:06:02.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:06:01 smithi082 ceph-mon[97694]: scrub summary: idle+waiting paths [/] 2023-09-23T09:06:02.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:06:01 smithi082 ceph-mon[97694]: scrub summary: active paths [/] 2023-09-23T09:06:02.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:06:01 smithi082 ceph-mon[97694]: scrub summary: active paths [/] 2023-09-23T09:06:02.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:06:01 smithi082 ceph-mon[97694]: scrub summary: active paths [/] 2023-09-23T09:06:02.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:06:01 smithi082 ceph-mon[97694]: scrub summary: idle+waiting paths [/] 2023-09-23T09:06:02.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:06:01 smithi082 ceph-mon[97694]: scrub summary: active paths [/] 2023-09-23T09:06:02.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:06:01 smithi082 ceph-mon[97694]: scrub summary: idle+waiting paths [/] 2023-09-23T09:06:02.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:06:01 smithi082 ceph-mon[97694]: scrub summary: active paths [/] 2023-09-23T09:06:02.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:06:01 smithi082 ceph-mon[97694]: scrub summary: active paths [/] 2023-09-23T09:06:02.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:06:01 smithi082 ceph-mon[97694]: scrub summary: idle+waiting paths [/] 2023-09-23T09:06:02.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:06:01 smithi082 ceph-mon[97694]: scrub summary: idle+waiting paths [/] 2023-09-23T09:06:02.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:06:01 smithi082 ceph-mon[97694]: scrub summary: idle+waiting paths [/] 2023-09-23T09:06:02.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:06:02 smithi161 ceph-mon[99580]: pgmap v281: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 563 KiB/s rd, 9.3 MiB/s wr, 260 op/s 2023-09-23T09:06:03.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:06:02 smithi135 ceph-mon[99205]: pgmap v281: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 563 KiB/s rd, 9.3 MiB/s wr, 260 op/s 2023-09-23T09:06:03.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:06:02 smithi082 ceph-mon[97694]: pgmap v281: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 563 KiB/s rd, 9.3 MiB/s wr, 260 op/s 2023-09-23T09:06:03.423 INFO:teuthology.orchestra.run.smithi082.stderr:37200000 of 50000000 tuples (74%) done (elapsed 518.17 s, remaining 178.29 s) 2023-09-23T09:06:03.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:06:03 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:06:04.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:06:03 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:06:04.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:06:03 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:06:04.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:06:04 smithi161 ceph-mon[99580]: pgmap v282: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 562 KiB/s rd, 9.0 MiB/s wr, 257 op/s 2023-09-23T09:06:05.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:06:04 smithi135 ceph-mon[99205]: pgmap v282: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 562 KiB/s rd, 9.0 MiB/s wr, 257 op/s 2023-09-23T09:06:05.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:06:04 smithi082 ceph-mon[97694]: pgmap v282: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 562 KiB/s rd, 9.0 MiB/s wr, 257 op/s 2023-09-23T09:06:07.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:06:06 smithi135 ceph-mon[99205]: pgmap v283: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 965 KiB/s rd, 11 MiB/s wr, 434 op/s 2023-09-23T09:06:07.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:06:06 smithi082 ceph-mon[97694]: pgmap v283: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 965 KiB/s rd, 11 MiB/s wr, 434 op/s 2023-09-23T09:06:07.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:06:06 smithi161 ceph-mon[99580]: pgmap v283: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 965 KiB/s rd, 11 MiB/s wr, 434 op/s 2023-09-23T09:06:08.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:06:07 smithi135 ceph-mon[99205]: osdmap e94: 12 total, 12 up, 12 in 2023-09-23T09:06:08.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:06:07 smithi082 ceph-mon[97694]: osdmap e94: 12 total, 12 up, 12 in 2023-09-23T09:06:08.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:06:07 smithi161 ceph-mon[99580]: osdmap e94: 12 total, 12 up, 12 in 2023-09-23T09:06:09.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:06:08 smithi135 ceph-mon[99205]: pgmap v285: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 956 KiB/s rd, 3.7 MiB/s wr, 413 op/s 2023-09-23T09:06:09.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:06:08 smithi082 ceph-mon[97694]: pgmap v285: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 956 KiB/s rd, 3.7 MiB/s wr, 413 op/s 2023-09-23T09:06:09.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:06:08 smithi161 ceph-mon[99580]: pgmap v285: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 956 KiB/s rd, 3.7 MiB/s wr, 413 op/s 2023-09-23T09:06:11.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:06:10 smithi135 ceph-mon[99205]: pgmap v286: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.0 MiB/s wr, 462 op/s 2023-09-23T09:06:11.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:06:10 smithi082 ceph-mon[97694]: pgmap v286: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.0 MiB/s wr, 462 op/s 2023-09-23T09:06:11.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:06:10 smithi161 ceph-mon[99580]: pgmap v286: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.0 MiB/s wr, 462 op/s 2023-09-23T09:06:13.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:06:12 smithi135 ceph-mon[99205]: pgmap v287: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 870 KiB/s rd, 3.6 MiB/s wr, 401 op/s 2023-09-23T09:06:13.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:06:12 smithi082 ceph-mon[97694]: pgmap v287: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 870 KiB/s rd, 3.6 MiB/s wr, 401 op/s 2023-09-23T09:06:13.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:06:12 smithi161 ceph-mon[99580]: pgmap v287: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 870 KiB/s rd, 3.6 MiB/s wr, 401 op/s 2023-09-23T09:06:14.068 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:06:13 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:06:14.124 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:06:13 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:06:14.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:06:13 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:06:15.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:06:14 smithi135 ceph-mon[99205]: pgmap v288: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 870 KiB/s rd, 3.6 MiB/s wr, 401 op/s 2023-09-23T09:06:15.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:06:14 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:06:15.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:06:14 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:06:15.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:06:14 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:06:15.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:06:14 smithi082 ceph-mon[97694]: pgmap v288: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 870 KiB/s rd, 3.6 MiB/s wr, 401 op/s 2023-09-23T09:06:15.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:06:14 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:06:15.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:06:14 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:06:15.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:06:14 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:06:15.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:06:14 smithi161 ceph-mon[99580]: pgmap v288: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 870 KiB/s rd, 3.6 MiB/s wr, 401 op/s 2023-09-23T09:06:15.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:06:14 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:06:15.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:06:14 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:06:15.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:06:14 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:06:17.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:06:16 smithi135 ceph-mon[99205]: pgmap v289: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 846 KiB/s rd, 3.4 MiB/s wr, 373 op/s 2023-09-23T09:06:17.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:06:16 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:06:17.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:06:16 smithi135 ceph-mon[99205]: osdmap e95: 12 total, 12 up, 12 in 2023-09-23T09:06:17.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:06:16 smithi082 ceph-mon[97694]: pgmap v289: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 846 KiB/s rd, 3.4 MiB/s wr, 373 op/s 2023-09-23T09:06:17.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:06:16 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:06:17.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:06:16 smithi082 ceph-mon[97694]: osdmap e95: 12 total, 12 up, 12 in 2023-09-23T09:06:17.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:06:16 smithi161 ceph-mon[99580]: pgmap v289: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 846 KiB/s rd, 3.4 MiB/s wr, 373 op/s 2023-09-23T09:06:17.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:06:16 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:06:17.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:06:16 smithi161 ceph-mon[99580]: osdmap e95: 12 total, 12 up, 12 in 2023-09-23T09:06:17.625 INFO:teuthology.orchestra.run.smithi082.stderr:37300000 of 50000000 tuples (74%) done (elapsed 532.37 s, remaining 181.26 s) 2023-09-23T09:06:19.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:06:18 smithi135 ceph-mon[99205]: pgmap v291: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 846 KiB/s rd, 3.4 MiB/s wr, 373 op/s 2023-09-23T09:06:19.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:06:18 smithi082 ceph-mon[97694]: pgmap v291: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 846 KiB/s rd, 3.4 MiB/s wr, 373 op/s 2023-09-23T09:06:19.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:06:18 smithi161 ceph-mon[99580]: pgmap v291: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 846 KiB/s rd, 3.4 MiB/s wr, 373 op/s 2023-09-23T09:06:21.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:06:20 smithi135 ceph-mon[99205]: pgmap v292: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 926 KiB/s rd, 3.4 MiB/s wr, 368 op/s 2023-09-23T09:06:21.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:06:20 smithi082 ceph-mon[97694]: pgmap v292: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 926 KiB/s rd, 3.4 MiB/s wr, 368 op/s 2023-09-23T09:06:21.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:06:20 smithi161 ceph-mon[99580]: pgmap v292: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 926 KiB/s rd, 3.4 MiB/s wr, 368 op/s 2023-09-23T09:06:23.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:06:22 smithi135 ceph-mon[99205]: pgmap v293: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 931 KiB/s rd, 3.4 MiB/s wr, 368 op/s 2023-09-23T09:06:23.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:06:22 smithi082 ceph-mon[97694]: pgmap v293: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 931 KiB/s rd, 3.4 MiB/s wr, 368 op/s 2023-09-23T09:06:23.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:06:22 smithi161 ceph-mon[99580]: pgmap v293: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 931 KiB/s rd, 3.4 MiB/s wr, 368 op/s 2023-09-23T09:06:25.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:06:24 smithi135 ceph-mon[99205]: pgmap v294: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 931 KiB/s rd, 3.4 MiB/s wr, 368 op/s 2023-09-23T09:06:25.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:06:24 smithi082 ceph-mon[97694]: pgmap v294: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 931 KiB/s rd, 3.4 MiB/s wr, 368 op/s 2023-09-23T09:06:25.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:06:24 smithi161 ceph-mon[99580]: pgmap v294: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 931 KiB/s rd, 3.4 MiB/s wr, 368 op/s 2023-09-23T09:06:27.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:06:26 smithi135 ceph-mon[99205]: pgmap v295: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 1015 KiB/s rd, 3.5 MiB/s wr, 388 op/s 2023-09-23T09:06:27.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:06:26 smithi082 ceph-mon[97694]: pgmap v295: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 1015 KiB/s rd, 3.5 MiB/s wr, 388 op/s 2023-09-23T09:06:27.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:06:26 smithi161 ceph-mon[99580]: pgmap v295: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 1015 KiB/s rd, 3.5 MiB/s wr, 388 op/s 2023-09-23T09:06:29.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:06:28 smithi135 ceph-mon[99205]: pgmap v296: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 954 KiB/s rd, 3.3 MiB/s wr, 365 op/s 2023-09-23T09:06:29.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:06:28 smithi082 ceph-mon[97694]: pgmap v296: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 954 KiB/s rd, 3.3 MiB/s wr, 365 op/s 2023-09-23T09:06:29.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:06:28 smithi161 ceph-mon[99580]: pgmap v296: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 954 KiB/s rd, 3.3 MiB/s wr, 365 op/s 2023-09-23T09:06:30.758 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:06:30.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:30.993+0000 7f67c31ff700 1 -- 172.21.15.82:0/86511727 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67bc101250 msgr2=0x7f67bc10d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:06:30.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:30.993+0000 7f67c31ff700 1 --2- 172.21.15.82:0/86511727 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67bc101250 0x7f67bc10d760 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f67b400b0a0 tx=0x7f67b400b3b0 comp rx=0 tx=0).stop 2023-09-23T09:06:30.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:30.993+0000 7f67c31ff700 1 -- 172.21.15.82:0/86511727 shutdown_connections 2023-09-23T09:06:30.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:30.993+0000 7f67c31ff700 1 --2- 172.21.15.82:0/86511727 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67bc101250 0x7f67bc10d760 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:30.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:30.993+0000 7f67c31ff700 1 --2- 172.21.15.82:0/86511727 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67bc1068a0 0x7f67bc106c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:30.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:30.993+0000 7f67c31ff700 1 --2- 172.21.15.82:0/86511727 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f67bc100890 0x7f67bc100d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:30.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:30.993+0000 7f67c31ff700 1 -- 172.21.15.82:0/86511727 >> 172.21.15.82:0/86511727 conn(0x7f67bc0fc380 msgr2=0x7f67bc0fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:06:30.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:30.993+0000 7f67c31ff700 1 -- 172.21.15.82:0/86511727 shutdown_connections 2023-09-23T09:06:30.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:30.993+0000 7f67c31ff700 1 -- 172.21.15.82:0/86511727 wait complete. 2023-09-23T09:06:30.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:30.994+0000 7f67c31ff700 1 Processor -- start 2023-09-23T09:06:30.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:30.994+0000 7f67c31ff700 1 -- start start 2023-09-23T09:06:30.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:30.995+0000 7f67c31ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f67bc100890 0x7f67bc19e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:06:30.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:30.995+0000 7f67c31ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67bc101250 0x7f67bc19ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:06:30.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:30.995+0000 7f67c31ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67bc1068a0 0x7f67bc198830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:06:30.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:30.995+0000 7f67c31ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67bc198ea0 con 0x7f67bc101250 2023-09-23T09:06:30.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:30.995+0000 7f67c31ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67bc199010 con 0x7f67bc1068a0 2023-09-23T09:06:30.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:30.995+0000 7f67c31ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67bc1991d0 con 0x7f67bc100890 2023-09-23T09:06:30.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:30.995+0000 7f67bbfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67bc101250 0x7f67bc19ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:06:30.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:30.995+0000 7f67c179c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67bc1068a0 0x7f67bc198830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:06:30.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:30.995+0000 7f67bbfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67bc101250 0x7f67bc19ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59678/0 (socket says 172.21.15.82:59678) 2023-09-23T09:06:30.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:30.995+0000 7f67bbfff700 1 -- 172.21.15.82:0/3859952681 learned_addr learned my addr 172.21.15.82:0/3859952681 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:06:30.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:30.995+0000 7f67c0f9b700 1 --2- 172.21.15.82:0/3859952681 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f67bc100890 0x7f67bc19e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:06:31.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:30.995+0000 7f67bbfff700 1 -- 172.21.15.82:0/3859952681 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f67bc100890 msgr2=0x7f67bc19e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:06:31.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:30.995+0000 7f67bbfff700 1 --2- 172.21.15.82:0/3859952681 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f67bc100890 0x7f67bc19e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:31.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:30.995+0000 7f67bbfff700 1 -- 172.21.15.82:0/3859952681 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67bc1068a0 msgr2=0x7f67bc198830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:06:31.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:30.995+0000 7f67bbfff700 1 --2- 172.21.15.82:0/3859952681 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67bc1068a0 0x7f67bc198830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:31.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:30.995+0000 7f67bbfff700 1 -- 172.21.15.82:0/3859952681 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67b4009d00 con 0x7f67bc101250 2023-09-23T09:06:31.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:30.995+0000 7f67c179c700 1 --2- 172.21.15.82:0/3859952681 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67bc1068a0 0x7f67bc198830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:06:31.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:30.996+0000 7f67bbfff700 1 --2- 172.21.15.82:0/3859952681 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67bc101250 0x7f67bc19ed00 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f67a800e9a0 tx=0x7f67a800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:06:31.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:30.996+0000 7f67b9ffb700 1 -- 172.21.15.82:0/3859952681 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67a8009790 con 0x7f67bc101250 2023-09-23T09:06:31.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:30.996+0000 7f67b9ffb700 1 -- 172.21.15.82:0/3859952681 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f67a8010430 con 0x7f67bc101250 2023-09-23T09:06:31.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:30.996+0000 7f67c31ff700 1 -- 172.21.15.82:0/3859952681 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67bc1994b0 con 0x7f67bc101250 2023-09-23T09:06:31.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:30.996+0000 7f67b9ffb700 1 -- 172.21.15.82:0/3859952681 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67a800cea0 con 0x7f67bc101250 2023-09-23T09:06:31.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:30.996+0000 7f67c31ff700 1 -- 172.21.15.82:0/3859952681 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67bc1a57b0 con 0x7f67bc101250 2023-09-23T09:06:31.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:30.999+0000 7f67b9ffb700 1 -- 172.21.15.82:0/3859952681 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f67a80105a0 con 0x7f67bc101250 2023-09-23T09:06:31.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.001+0000 7f67b9ffb700 1 --2- 172.21.15.82:0/3859952681 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f67ac0a00c0 0x7f67ac0a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:06:31.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.001+0000 7f67d6bddb80 1 Processor -- start 2023-09-23T09:06:31.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.001+0000 7f67b9ffb700 1 -- 172.21.15.82:0/3859952681 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f67a8014070 con 0x7f67bc101250 2023-09-23T09:06:31.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.001+0000 7f67d6bddb80 1 -- start start 2023-09-23T09:06:31.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.001+0000 7f67c0f9b700 1 --2- 172.21.15.82:0/3859952681 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f67ac0a00c0 0x7f67ac0a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:06:31.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.002+0000 7f67d6bddb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0cf2ff380 0x55d0cf2ff760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:06:31.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.002+0000 7f67d6bddb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d0cf2ffca0 0x55d0cf2f9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:06:31.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.002+0000 7f67d6bddb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d0cf2f9c40 0x55d0cf2fa0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:06:31.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.002+0000 7f67d6bddb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0cf2617b0 con 0x55d0cf2ffca0 2023-09-23T09:06:31.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.002+0000 7f67d6bddb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0cf252780 con 0x55d0cf2ff380 2023-09-23T09:06:31.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.002+0000 7f67d6bddb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0cf2500a0 con 0x55d0cf2f9c40 2023-09-23T09:06:31.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.002+0000 7f67c0f9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0cf2ff380 0x55d0cf2ff760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:06:31.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.002+0000 7f67bbfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d0cf2ffca0 0x55d0cf2f9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:06:31.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.002+0000 7f67bbfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d0cf2ffca0 0x55d0cf2f9700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59686/0 (socket says 172.21.15.82:59686) 2023-09-23T09:06:31.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.002+0000 7f67bbfff700 1 -- 172.21.15.82:0/177207058 learned_addr learned my addr 172.21.15.82:0/177207058 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:06:31.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.002+0000 7f67c179c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d0cf2f9c40 0x55d0cf2fa0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:06:31.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.002+0000 7f67c0f9b700 1 --2- 172.21.15.82:0/3859952681 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f67ac0a00c0 0x7f67ac0a2580 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f67b0009c30 tx=0x7f67b0009260 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:06:31.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.002+0000 7f67bbfff700 1 -- 172.21.15.82:0/177207058 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d0cf2f9c40 msgr2=0x55d0cf2fa0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:06:31.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.002+0000 7f67bbfff700 1 --2- 172.21.15.82:0/177207058 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d0cf2f9c40 0x55d0cf2fa0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:31.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.002+0000 7f67bbfff700 1 -- 172.21.15.82:0/177207058 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0cf2ff380 msgr2=0x55d0cf2ff760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:06:31.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.002+0000 7f67bbfff700 1 --2- 172.21.15.82:0/177207058 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0cf2ff380 0x55d0cf2ff760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:31.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.002+0000 7f67bbfff700 1 -- 172.21.15.82:0/177207058 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d0cf0cb630 con 0x55d0cf2ffca0 2023-09-23T09:06:31.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.003+0000 7f67bbfff700 1 --2- 172.21.15.82:0/177207058 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d0cf2ffca0 0x55d0cf2f9700 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f67a8095980 tx=0x7f67a8098b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe47d028404abc2c server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:06:31.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.003+0000 7f67a6ffd700 1 -- 172.21.15.82:0/177207058 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67a809cd40 con 0x55d0cf2ffca0 2023-09-23T09:06:31.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.003+0000 7f67a6ffd700 1 -- 172.21.15.82:0/177207058 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f67a80a0d20 con 0x55d0cf2ffca0 2023-09-23T09:06:31.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.003+0000 7f67a6ffd700 1 -- 172.21.15.82:0/177207058 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67a80a0890 con 0x55d0cf2ffca0 2023-09-23T09:06:31.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.003+0000 7f67d6bddb80 1 -- 172.21.15.82:0/177207058 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d0cf2ffca0 msgr2=0x55d0cf2f9700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:06:31.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.003+0000 7f67d6bddb80 1 --2- 172.21.15.82:0/177207058 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d0cf2ffca0 0x55d0cf2f9700 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f67a8095980 tx=0x7f67a8098b60 comp rx=0 tx=0).stop 2023-09-23T09:06:31.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.004+0000 7f67d6bddb80 1 -- 172.21.15.82:0/177207058 shutdown_connections 2023-09-23T09:06:31.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.004+0000 7f67d6bddb80 1 --2- 172.21.15.82:0/177207058 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d0cf2f9c40 0x55d0cf2fa0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:31.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.004+0000 7f67d6bddb80 1 --2- 172.21.15.82:0/177207058 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0cf2ff380 0x55d0cf2ff760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:31.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.004+0000 7f67d6bddb80 1 --2- 172.21.15.82:0/177207058 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d0cf2ffca0 0x55d0cf2f9700 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:31.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.004+0000 7f67d6bddb80 1 -- 172.21.15.82:0/177207058 >> 172.21.15.82:0/177207058 conn(0x55d0cf26e0e0 msgr2=0x55d0cf2f4410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:06:31.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.004+0000 7f67d6bddb80 1 -- 172.21.15.82:0/177207058 shutdown_connections 2023-09-23T09:06:31.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.004+0000 7f67d6bddb80 1 -- 172.21.15.82:0/177207058 wait complete. 2023-09-23T09:06:31.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.004+0000 7f67d6bddb80 1 -- start start 2023-09-23T09:06:31.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.004+0000 7f67d6bddb80 1 Processor -- start 2023-09-23T09:06:31.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.005+0000 7f67d6bddb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0cf2f9c40 0x55d0cf305cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:06:31.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.005+0000 7f67d6bddb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d0cf2ff380 0x55d0cf302ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:06:31.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.005+0000 7f67d6bddb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d0cf2ffca0 0x55d0cf303620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:06:31.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.005+0000 7f67d6bddb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0cf24b990 con 0x55d0cf2ffca0 2023-09-23T09:06:31.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.005+0000 7f67d6bddb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0cf1e9bb0 con 0x55d0cf2f9c40 2023-09-23T09:06:31.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.005+0000 7f67d6bddb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0cf1e98b0 con 0x55d0cf2ff380 2023-09-23T09:06:31.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.005+0000 7f67d6bddb80 10 client.0 _ll_register_callbacks cb 0x55d0cf133a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:06:31.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.005+0000 7f67c0f9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0cf2f9c40 0x55d0cf305cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:06:31.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.005+0000 7f67c179c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d0cf2ffca0 0x55d0cf303620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:06:31.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.005+0000 7f67c0f9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0cf2f9c40 0x55d0cf305cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:51524/0 (socket says 172.21.15.82:51524) 2023-09-23T09:06:31.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.005+0000 7f67c0f9b700 1 -- 172.21.15.82:0/2957723499 learned_addr learned my addr 172.21.15.82:0/2957723499 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:06:31.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.005+0000 7f67bbfff700 1 --2- 172.21.15.82:0/2957723499 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d0cf2ff380 0x55d0cf302ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:06:31.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.006+0000 7f67c0f9b700 1 -- 172.21.15.82:0/2957723499 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d0cf2ff380 msgr2=0x55d0cf302ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:06:31.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.006+0000 7f67c0f9b700 1 --2- 172.21.15.82:0/2957723499 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d0cf2ff380 0x55d0cf302ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:31.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.006+0000 7f67c0f9b700 1 -- 172.21.15.82:0/2957723499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d0cf2ffca0 msgr2=0x55d0cf303620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:06:31.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.006+0000 7f67c0f9b700 1 --2- 172.21.15.82:0/2957723499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d0cf2ffca0 0x55d0cf303620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:31.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.006+0000 7f67c0f9b700 1 -- 172.21.15.82:0/2957723499 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67bc1a57b0 con 0x55d0cf2f9c40 2023-09-23T09:06:31.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.006+0000 7f67c179c700 1 --2- 172.21.15.82:0/2957723499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d0cf2ffca0 0x55d0cf303620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:06:31.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.006+0000 7f67c0f9b700 1 --2- 172.21.15.82:0/2957723499 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0cf2f9c40 0x55d0cf305cd0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f67b001c6e0 tx=0x7f67b00047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f20ecf9f8c8a6d08 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:06:31.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.006+0000 7f679bfff700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-09-23T09:06:31.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.006+0000 7f679bfff700 1 -- 172.21.15.82:0/2957723499 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67b0021070 con 0x55d0cf2f9c40 2023-09-23T09:06:31.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.006+0000 7f67d6bddb80 1 -- 172.21.15.82:0/2957723499 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d0cf2c91c0 con 0x55d0cf2f9c40 2023-09-23T09:06:31.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.006+0000 7f679bfff700 1 -- 172.21.15.82:0/2957723499 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f67b0011c50 con 0x55d0cf2f9c40 2023-09-23T09:06:31.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.007+0000 7f679bfff700 1 -- 172.21.15.82:0/2957723499 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=57) v2 ==== 24+0+0 (secure 0 0 0) 0x7f67b0011e10 con 0x55d0cf2f9c40 2023-09-23T09:06:31.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.007+0000 7f67d6bddb80 10 client.26039 fetch_fsmap learned FSMap version 57 2023-09-23T09:06:31.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.007+0000 7f67d6bddb80 1 -- 172.21.15.82:0/2957723499 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=57,monmap=4+}) v3 -- 0x55d0cf077de0 con 0x55d0cf2f9c40 2023-09-23T09:06:31.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.007+0000 7f679bfff700 1 -- 172.21.15.82:0/2957723499 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d0cf2c91c0 con 0x55d0cf2f9c40 2023-09-23T09:06:31.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.007+0000 7f679bfff700 1 -- 172.21.15.82:0/2957723499 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 57) v1 ==== 7934+0+0 (secure 0 0 0) 0x7f67b0012030 con 0x55d0cf2f9c40 2023-09-23T09:06:31.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.007+0000 7f67d6bddb80 10 client.26039 fetch_fsmap finished waiting for FSMap version 57 2023-09-23T09:06:31.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.007+0000 7f67d6bddb80 10 client.26039 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:06:31.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.007+0000 7f67d6bddb80 20 client.26039 populate_metadata read hostname 'smithi082' 2023-09-23T09:06:31.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.007+0000 7f67d6bddb80 1 --2- 172.21.15.82:0/2957723499 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55d0cf313730 0x55d0cf315b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:06:31.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.007+0000 7f67d6bddb80 4 client.26039 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:06:31.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.007+0000 7f67d6bddb80 1 -- 172.21.15.82:0/2957723499 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d0cf1f1ba0 con 0x55d0cf313730 2023-09-23T09:06:31.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.008+0000 7f67bbfff700 1 --2- 172.21.15.82:0/2957723499 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55d0cf313730 0x55d0cf315b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:06:31.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.008+0000 7f67bbfff700 1 --2- 172.21.15.82:0/2957723499 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55d0cf313730 0x55d0cf315b50 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=70232374654e9872 server_cookie=ad0b4414491aa878 in_seq=0 out_seq=0 2023-09-23T09:06:31.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.008+0000 7f679bfff700 10 client.26039 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:06:31.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.009+0000 7f679bfff700 1 -- 172.21.15.82:0/2957723499 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55d0cf1f1ba0 con 0x55d0cf313730 2023-09-23T09:06:31.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.009+0000 7f679bfff700 10 client.26039 handle_command_reply: tid=0 2023-09-23T09:06:31.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.009+0000 7f67d6bddb80 1 client.26039 shutdown 2023-09-23T09:06:31.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.009+0000 7f67d6bddb80 1 -- 172.21.15.82:0/2957723499 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0cf2f9c40 msgr2=0x55d0cf305cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:06:31.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.009+0000 7f67d6bddb80 1 --2- 172.21.15.82:0/2957723499 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0cf2f9c40 0x55d0cf305cd0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f67b001c6e0 tx=0x7f67b00047c0 comp rx=0 tx=0).stop 2023-09-23T09:06:31.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.009+0000 7f67d6bddb80 1 -- 172.21.15.82:0/2957723499 shutdown_connections 2023-09-23T09:06:31.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.009+0000 7f67d6bddb80 1 --2- 172.21.15.82:0/2957723499 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55d0cf313730 0x55d0cf315b50 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:31.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.009+0000 7f67d6bddb80 1 --2- 172.21.15.82:0/2957723499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d0cf2ffca0 0x55d0cf303620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:31.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.009+0000 7f67d6bddb80 1 --2- 172.21.15.82:0/2957723499 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0cf2f9c40 0x55d0cf305cd0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:31.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.009+0000 7f67d6bddb80 1 --2- 172.21.15.82:0/2957723499 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d0cf2ff380 0x55d0cf302ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:31.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.009+0000 7f67d6bddb80 1 -- 172.21.15.82:0/2957723499 >> 172.21.15.82:0/2957723499 conn(0x55d0cf26e0e0 msgr2=0x55d0cf2eeb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:06:31.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.009+0000 7f679bfff700 0 client.26039 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:06:31.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.009+0000 7f67d6bddb80 1 -- 172.21.15.82:0/2957723499 shutdown_connections 2023-09-23T09:06:31.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.009+0000 7f67d6bddb80 1 -- 172.21.15.82:0/2957723499 wait complete. 2023-09-23T09:06:31.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.010+0000 7f67d6bddb80 20 client.26039 trim_cache size 0 max 16384 2023-09-23T09:06:31.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.028+0000 7f67d6bddb80 1 Processor -- start 2023-09-23T09:06:31.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.029+0000 7f67d6bddb80 1 -- start start 2023-09-23T09:06:31.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.029+0000 7f67d6bddb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d0cf2f9c40 0x55d0cf30a740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:06:31.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.029+0000 7f67d6bddb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d0cf2ff380 0x55d0cf305800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:06:31.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.029+0000 7f67d6bddb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0cf2ffca0 0x55d0cf2fdf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:06:31.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.029+0000 7f67d6bddb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0cf0cd920 con 0x55d0cf2ff380 2023-09-23T09:06:31.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.029+0000 7f67d6bddb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0cf2f53d0 con 0x55d0cf2ffca0 2023-09-23T09:06:31.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.029+0000 7f67d6bddb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0cf30ac80 con 0x55d0cf2f9c40 2023-09-23T09:06:31.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.029+0000 7f67bbfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d0cf2ff380 0x55d0cf305800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:06:31.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.029+0000 7f67c0f9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d0cf2f9c40 0x55d0cf30a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:06:31.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.029+0000 7f67c0f9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d0cf2f9c40 0x55d0cf30a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:35710/0 (socket says 172.21.15.82:35710) 2023-09-23T09:06:31.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.029+0000 7f67c0f9b700 1 -- 172.21.15.82:0/2440569614 learned_addr learned my addr 172.21.15.82:0/2440569614 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:06:31.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.029+0000 7f67c179c700 1 --2- 172.21.15.82:0/2440569614 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0cf2ffca0 0x55d0cf2fdf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:06:31.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.030+0000 7f67c0f9b700 1 -- 172.21.15.82:0/2440569614 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0cf2ffca0 msgr2=0x55d0cf2fdf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:06:31.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.030+0000 7f67c0f9b700 1 --2- 172.21.15.82:0/2440569614 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0cf2ffca0 0x55d0cf2fdf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:31.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.030+0000 7f67c0f9b700 1 -- 172.21.15.82:0/2440569614 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d0cf2ff380 msgr2=0x55d0cf305800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:06:31.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.030+0000 7f67c0f9b700 1 --2- 172.21.15.82:0/2440569614 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d0cf2ff380 0x55d0cf305800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:31.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.030+0000 7f67c0f9b700 1 -- 172.21.15.82:0/2440569614 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d0cf060c60 con 0x55d0cf2f9c40 2023-09-23T09:06:31.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.030+0000 7f67c179c700 1 --2- 172.21.15.82:0/2440569614 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0cf2ffca0 0x55d0cf2fdf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:06:31.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.030+0000 7f67c0f9b700 1 --2- 172.21.15.82:0/2440569614 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d0cf2f9c40 0x55d0cf30a740 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f67b0013000 tx=0x7f67b0009370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0eae798f86d51f4 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:06:31.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.030+0000 7f67a77fe700 1 -- 172.21.15.82:0/2440569614 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67b0021040 con 0x55d0cf2f9c40 2023-09-23T09:06:31.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.030+0000 7f67a77fe700 1 -- 172.21.15.82:0/2440569614 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f67b00044b0 con 0x55d0cf2f9c40 2023-09-23T09:06:31.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.030+0000 7f67a77fe700 1 -- 172.21.15.82:0/2440569614 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67b0003680 con 0x55d0cf2f9c40 2023-09-23T09:06:31.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.031+0000 7f67d6bddb80 1 -- 172.21.15.82:0/2440569614 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d0cf2f9c40 msgr2=0x55d0cf30a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:06:31.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.031+0000 7f67d6bddb80 1 --2- 172.21.15.82:0/2440569614 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d0cf2f9c40 0x55d0cf30a740 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f67b0013000 tx=0x7f67b0009370 comp rx=0 tx=0).stop 2023-09-23T09:06:31.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.031+0000 7f67d6bddb80 1 -- 172.21.15.82:0/2440569614 shutdown_connections 2023-09-23T09:06:31.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.031+0000 7f67d6bddb80 1 --2- 172.21.15.82:0/2440569614 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0cf2ffca0 0x55d0cf2fdf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:31.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.031+0000 7f67d6bddb80 1 --2- 172.21.15.82:0/2440569614 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d0cf2f9c40 0x55d0cf30a740 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:31.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.031+0000 7f67d6bddb80 1 --2- 172.21.15.82:0/2440569614 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d0cf2ff380 0x55d0cf305800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:31.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.031+0000 7f67d6bddb80 1 -- 172.21.15.82:0/2440569614 >> 172.21.15.82:0/2440569614 conn(0x55d0cf26e0e0 msgr2=0x55d0cf2fd010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:06:31.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.031+0000 7f67d6bddb80 1 -- 172.21.15.82:0/2440569614 shutdown_connections 2023-09-23T09:06:31.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.031+0000 7f67d6bddb80 1 -- 172.21.15.82:0/2440569614 wait complete. 2023-09-23T09:06:31.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.032+0000 7f67d6bddb80 1 -- start start 2023-09-23T09:06:31.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.032+0000 7f67d6bddb80 1 Processor -- start 2023-09-23T09:06:31.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.033+0000 7f67d6bddb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d0cf2f9c40 0x55d0cf308910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:06:31.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.033+0000 7f67d6bddb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0cf2ff380 0x55d0cf308e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:06:31.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.033+0000 7f67d6bddb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d0cf2ffca0 0x55d0cf366520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:06:31.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.033+0000 7f67d6bddb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0cf309540 con 0x55d0cf2ffca0 2023-09-23T09:06:31.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.033+0000 7f67d6bddb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0cf366a60 con 0x55d0cf2ff380 2023-09-23T09:06:31.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.033+0000 7f67d6bddb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0cf366ba0 con 0x55d0cf2f9c40 2023-09-23T09:06:31.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.033+0000 7f67d6bddb80 10 client.0 _ll_register_callbacks cb 0x7f67b001c4d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:06:31.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.033+0000 7f67c0f9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d0cf2f9c40 0x55d0cf308910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:06:31.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.033+0000 7f67c0f9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d0cf2f9c40 0x55d0cf308910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:35724/0 (socket says 172.21.15.82:35724) 2023-09-23T09:06:31.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.033+0000 7f67bbfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0cf2ff380 0x55d0cf308e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:06:31.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.033+0000 7f67c0f9b700 1 -- 172.21.15.82:0/411883170 learned_addr learned my addr 172.21.15.82:0/411883170 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:06:31.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.033+0000 7f67c179c700 1 --2- 172.21.15.82:0/411883170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d0cf2ffca0 0x55d0cf366520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:06:31.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.033+0000 7f67c0f9b700 1 -- 172.21.15.82:0/411883170 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0cf2ff380 msgr2=0x55d0cf308e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:06:31.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.033+0000 7f67c0f9b700 1 --2- 172.21.15.82:0/411883170 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0cf2ff380 0x55d0cf308e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:31.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.033+0000 7f67c0f9b700 1 -- 172.21.15.82:0/411883170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d0cf2ffca0 msgr2=0x55d0cf366520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:06:31.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.033+0000 7f67c0f9b700 1 --2- 172.21.15.82:0/411883170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d0cf2ffca0 0x55d0cf366520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:31.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.033+0000 7f67c0f9b700 1 -- 172.21.15.82:0/411883170 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d0cf077de0 con 0x55d0cf2f9c40 2023-09-23T09:06:31.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.033+0000 7f67bbfff700 1 --2- 172.21.15.82:0/411883170 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0cf2ff380 0x55d0cf308e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:06:31.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.034+0000 7f67c0f9b700 1 --2- 172.21.15.82:0/411883170 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d0cf2f9c40 0x55d0cf308910 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f67b00129b0 tx=0x7f67b0004250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4710deb32cd7483c server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:06:31.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.034+0000 7f679bfff700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T09:06:31.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.034+0000 7f679bfff700 1 -- 172.21.15.82:0/411883170 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67b0021040 con 0x55d0cf2f9c40 2023-09-23T09:06:31.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.034+0000 7f67d6bddb80 1 -- 172.21.15.82:0/411883170 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d0cf2ec8b0 con 0x55d0cf2f9c40 2023-09-23T09:06:31.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.034+0000 7f679bfff700 1 -- 172.21.15.82:0/411883170 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f67b00120a0 con 0x55d0cf2f9c40 2023-09-23T09:06:31.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.034+0000 7f679bfff700 1 -- 172.21.15.82:0/411883170 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=57) v2 ==== 24+0+0 (secure 0 0 0) 0x7f67b0011c50 con 0x55d0cf2f9c40 2023-09-23T09:06:31.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.034+0000 7f67d6bddb80 10 client.26086 fetch_fsmap learned FSMap version 57 2023-09-23T09:06:31.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.034+0000 7f67d6bddb80 1 -- 172.21.15.82:0/411883170 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=57,monmap=4+}) v3 -- 0x55d0cf09e250 con 0x55d0cf2f9c40 2023-09-23T09:06:31.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.035+0000 7f679bfff700 1 -- 172.21.15.82:0/411883170 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d0cf2ec8b0 con 0x55d0cf2f9c40 2023-09-23T09:06:31.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.035+0000 7f679bfff700 1 -- 172.21.15.82:0/411883170 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 57) v1 ==== 7934+0+0 (secure 0 0 0) 0x7f67b0026500 con 0x55d0cf2f9c40 2023-09-23T09:06:31.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.035+0000 7f67d6bddb80 10 client.26086 fetch_fsmap finished waiting for FSMap version 57 2023-09-23T09:06:31.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.035+0000 7f67d6bddb80 10 client.26086 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:06:31.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.035+0000 7f67d6bddb80 20 client.26086 populate_metadata read hostname 'smithi082' 2023-09-23T09:06:31.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.035+0000 7f67d6bddb80 1 --2- 172.21.15.82:0/411883170 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55d0cf367f00 0x55d0cf36a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:06:31.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.035+0000 7f67d6bddb80 4 client.26086 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:06:31.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.035+0000 7f67d6bddb80 1 -- 172.21.15.82:0/411883170 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55d0cf244970 con 0x55d0cf367f00 2023-09-23T09:06:31.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.035+0000 7f67bbfff700 1 --2- 172.21.15.82:0/411883170 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55d0cf367f00 0x55d0cf36a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:06:31.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.036+0000 7f679bfff700 10 client.26086 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:06:31.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.036+0000 7f67bbfff700 1 --2- 172.21.15.82:0/411883170 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55d0cf367f00 0x55d0cf36a320 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=511f663804638dff server_cookie=722eeec005bf00de in_seq=0 out_seq=0 2023-09-23T09:06:31.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.036+0000 7f679bfff700 1 -- 172.21.15.82:0/411883170 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55d0cf244970 con 0x55d0cf367f00 2023-09-23T09:06:31.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.036+0000 7f679bfff700 10 client.26086 handle_command_reply: tid=0 2023-09-23T09:06:31.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.036+0000 7f67d6bddb80 1 client.26086 shutdown 2023-09-23T09:06:31.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.036+0000 7f67d6bddb80 1 -- 172.21.15.82:0/411883170 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d0cf2f9c40 msgr2=0x55d0cf308910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:06:31.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.036+0000 7f67d6bddb80 1 --2- 172.21.15.82:0/411883170 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d0cf2f9c40 0x55d0cf308910 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f67b00129b0 tx=0x7f67b0004250 comp rx=0 tx=0).stop 2023-09-23T09:06:31.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.036+0000 7f67d6bddb80 1 -- 172.21.15.82:0/411883170 shutdown_connections 2023-09-23T09:06:31.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.036+0000 7f67d6bddb80 1 --2- 172.21.15.82:0/411883170 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55d0cf367f00 0x55d0cf36a320 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:31.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.036+0000 7f67d6bddb80 1 --2- 172.21.15.82:0/411883170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d0cf2ffca0 0x55d0cf366520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:31.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.036+0000 7f67d6bddb80 1 --2- 172.21.15.82:0/411883170 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d0cf2f9c40 0x55d0cf308910 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:31.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.036+0000 7f67d6bddb80 1 --2- 172.21.15.82:0/411883170 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0cf2ff380 0x55d0cf308e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:31.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.036+0000 7f679bfff700 0 client.26086 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:06:31.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.036+0000 7f67d6bddb80 1 -- 172.21.15.82:0/411883170 >> 172.21.15.82:0/411883170 conn(0x55d0cf26e0e0 msgr2=0x55d0cf2fdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:06:31.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.037+0000 7f67d6bddb80 1 -- 172.21.15.82:0/411883170 shutdown_connections 2023-09-23T09:06:31.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.037+0000 7f67d6bddb80 1 -- 172.21.15.82:0/411883170 wait complete. 2023-09-23T09:06:31.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.037+0000 7f67d6bddb80 20 client.26086 trim_cache size 0 max 16384 2023-09-23T09:06:31.046 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:06:31.046 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "IDLE (waiting for more scrubs)", 2023-09-23T09:06:31.046 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:06:31.046 INFO:teuthology.orchestra.run.smithi082.stdout: "cba46b77-20dd-437c-a60a-ac01b400e1b8": { 2023-09-23T09:06:31.046 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:06:31.046 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "cba46b77-20dd-437c-a60a-ac01b400e1b8", 2023-09-23T09:06:31.046 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:06:31.047 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:06:31.047 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:06:31.047 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:06:31.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.037+0000 7f67c31ff700 1 -- 172.21.15.82:0/3859952681 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f67ac0a00c0 msgr2=0x7f67ac0a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:06:31.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.037+0000 7f67c31ff700 1 --2- 172.21.15.82:0/3859952681 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f67ac0a00c0 0x7f67ac0a2580 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f67b0009c30 tx=0x7f67b0009260 comp rx=0 tx=0).stop 2023-09-23T09:06:31.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.037+0000 7f67c31ff700 1 -- 172.21.15.82:0/3859952681 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67bc101250 msgr2=0x7f67bc19ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:06:31.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.037+0000 7f67c31ff700 1 --2- 172.21.15.82:0/3859952681 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67bc101250 0x7f67bc19ed00 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f67a800e9a0 tx=0x7f67a800ecb0 comp rx=0 tx=0).stop 2023-09-23T09:06:31.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.038+0000 7f67c31ff700 1 -- 172.21.15.82:0/3859952681 shutdown_connections 2023-09-23T09:06:31.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.038+0000 7f67c31ff700 1 --2- 172.21.15.82:0/3859952681 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f67ac0a00c0 0x7f67ac0a2580 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:31.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.038+0000 7f67c31ff700 1 --2- 172.21.15.82:0/3859952681 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67bc1068a0 0x7f67bc198830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:31.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.038+0000 7f67c31ff700 1 --2- 172.21.15.82:0/3859952681 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f67bc100890 0x7f67bc19e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:31.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.038+0000 7f67c31ff700 1 --2- 172.21.15.82:0/3859952681 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67bc101250 0x7f67bc19ed00 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:06:31.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.038+0000 7f67c31ff700 1 -- 172.21.15.82:0/3859952681 >> 172.21.15.82:0/3859952681 conn(0x7f67bc0fc380 msgr2=0x7f67bc0fc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:06:31.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.038+0000 7f67c31ff700 1 -- 172.21.15.82:0/3859952681 shutdown_connections 2023-09-23T09:06:31.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:06:31.038+0000 7f67c31ff700 1 -- 172.21.15.82:0/3859952681 wait complete. 2023-09-23T09:06:31.055 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:06:30 smithi082 ceph-mon[97694]: pgmap v297: 97 pgs: 97 active+clean; 8.6 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.5 MiB/s wr, 487 op/s 2023-09-23T09:06:31.058 INFO:tasks.cephfs.filesystem:scrub status for tag:cba46b77-20dd-437c-a60a-ac01b400e1b8 - {'path': '/', 'tag': 'cba46b77-20dd-437c-a60a-ac01b400e1b8', 'options': 'recursive,force'} 2023-09-23T09:06:31.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:06:30 smithi135 ceph-mon[99205]: pgmap v297: 97 pgs: 97 active+clean; 8.6 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.5 MiB/s wr, 487 op/s 2023-09-23T09:06:31.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:06:30 smithi161 ceph-mon[99580]: pgmap v297: 97 pgs: 97 active+clean; 8.6 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.5 MiB/s wr, 487 op/s 2023-09-23T09:06:31.191 INFO:teuthology.orchestra.run.smithi082.stderr:37400000 of 50000000 tuples (74%) done (elapsed 545.93 s, remaining 183.92 s) 2023-09-23T09:06:33.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:06:32 smithi135 ceph-mon[99205]: pgmap v298: 97 pgs: 97 active+clean; 8.6 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 874 KiB/s rd, 3.1 MiB/s wr, 336 op/s 2023-09-23T09:06:33.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:06:32 smithi082 ceph-mon[97694]: pgmap v298: 97 pgs: 97 active+clean; 8.6 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 874 KiB/s rd, 3.1 MiB/s wr, 336 op/s 2023-09-23T09:06:33.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:06:32 smithi161 ceph-mon[99580]: pgmap v298: 97 pgs: 97 active+clean; 8.6 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 874 KiB/s rd, 3.1 MiB/s wr, 336 op/s 2023-09-23T09:06:35.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:06:34 smithi135 ceph-mon[99205]: pgmap v299: 97 pgs: 97 active+clean; 8.6 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 869 KiB/s rd, 3.1 MiB/s wr, 335 op/s 2023-09-23T09:06:35.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:06:34 smithi082 ceph-mon[97694]: pgmap v299: 97 pgs: 97 active+clean; 8.6 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 869 KiB/s rd, 3.1 MiB/s wr, 335 op/s 2023-09-23T09:06:35.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:06:34 smithi161 ceph-mon[99580]: pgmap v299: 97 pgs: 97 active+clean; 8.6 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 869 KiB/s rd, 3.1 MiB/s wr, 335 op/s 2023-09-23T09:06:37.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:06:36 smithi135 ceph-mon[99205]: pgmap v300: 97 pgs: 97 active+clean; 8.6 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.4 MiB/s wr, 477 op/s 2023-09-23T09:06:37.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:06:36 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:06:37.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:06:36 smithi082 ceph-mon[97694]: pgmap v300: 97 pgs: 97 active+clean; 8.6 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.4 MiB/s wr, 477 op/s 2023-09-23T09:06:37.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:06:36 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:06:37.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:06:36 smithi161 ceph-mon[99580]: pgmap v300: 97 pgs: 97 active+clean; 8.6 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.4 MiB/s wr, 477 op/s 2023-09-23T09:06:37.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:06:36 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:06:38.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:06:37 smithi135 ceph-mon[99205]: pgmap v301: 97 pgs: 97 active+clean; 8.6 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 760 KiB/s rd, 2.8 MiB/s wr, 306 op/s 2023-09-23T09:06:38.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:06:37 smithi082 ceph-mon[97694]: pgmap v301: 97 pgs: 97 active+clean; 8.6 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 760 KiB/s rd, 2.8 MiB/s wr, 306 op/s 2023-09-23T09:06:38.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:06:37 smithi161 ceph-mon[99580]: pgmap v301: 97 pgs: 97 active+clean; 8.6 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 760 KiB/s rd, 2.8 MiB/s wr, 306 op/s 2023-09-23T09:06:40.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:06:40 smithi135 ceph-mon[99205]: pgmap v302: 97 pgs: 97 active+clean; 8.6 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.3 MiB/s wr, 459 op/s 2023-09-23T09:06:40.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:06:40 smithi082 ceph-mon[97694]: pgmap v302: 97 pgs: 97 active+clean; 8.6 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.3 MiB/s wr, 459 op/s 2023-09-23T09:06:40.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:06:40 smithi161 ceph-mon[99580]: pgmap v302: 97 pgs: 97 active+clean; 8.6 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.3 MiB/s wr, 459 op/s 2023-09-23T09:06:42.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:06:42 smithi082 ceph-mon[97694]: pgmap v303: 97 pgs: 97 active+clean; 8.6 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 723 KiB/s rd, 2.7 MiB/s wr, 296 op/s 2023-09-23T09:06:42.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:06:42 smithi161 ceph-mon[99580]: pgmap v303: 97 pgs: 97 active+clean; 8.6 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 723 KiB/s rd, 2.7 MiB/s wr, 296 op/s 2023-09-23T09:06:43.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:06:42 smithi135 ceph-mon[99205]: pgmap v303: 97 pgs: 97 active+clean; 8.6 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 723 KiB/s rd, 2.7 MiB/s wr, 296 op/s 2023-09-23T09:06:44.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:06:44 smithi082 ceph-mon[97694]: pgmap v304: 97 pgs: 97 active+clean; 8.6 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 723 KiB/s rd, 2.7 MiB/s wr, 295 op/s 2023-09-23T09:06:44.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:06:44 smithi161 ceph-mon[99580]: pgmap v304: 97 pgs: 97 active+clean; 8.6 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 723 KiB/s rd, 2.7 MiB/s wr, 295 op/s 2023-09-23T09:06:45.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:06:44 smithi135 ceph-mon[99205]: pgmap v304: 97 pgs: 97 active+clean; 8.6 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 723 KiB/s rd, 2.7 MiB/s wr, 295 op/s 2023-09-23T09:06:46.225 INFO:teuthology.orchestra.run.smithi082.stderr:37500000 of 50000000 tuples (75%) done (elapsed 560.97 s, remaining 186.99 s) 2023-09-23T09:06:46.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:06:46 smithi082 ceph-mon[97694]: pgmap v305: 97 pgs: 97 active+clean; 8.6 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.2 MiB/s wr, 456 op/s 2023-09-23T09:06:46.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:06:46 smithi161 ceph-mon[99580]: pgmap v305: 97 pgs: 97 active+clean; 8.6 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.2 MiB/s wr, 456 op/s 2023-09-23T09:06:47.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:06:46 smithi135 ceph-mon[99205]: pgmap v305: 97 pgs: 97 active+clean; 8.6 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.2 MiB/s wr, 456 op/s 2023-09-23T09:06:48.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:06:48 smithi082 ceph-mon[97694]: pgmap v306: 97 pgs: 97 active+clean; 8.6 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 769 KiB/s rd, 2.9 MiB/s wr, 314 op/s 2023-09-23T09:06:48.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:06:48 smithi161 ceph-mon[99580]: pgmap v306: 97 pgs: 97 active+clean; 8.6 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 769 KiB/s rd, 2.9 MiB/s wr, 314 op/s 2023-09-23T09:06:49.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:06:48 smithi135 ceph-mon[99205]: pgmap v306: 97 pgs: 97 active+clean; 8.6 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 769 KiB/s rd, 2.9 MiB/s wr, 314 op/s 2023-09-23T09:06:50.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:06:50 smithi082 ceph-mon[97694]: pgmap v307: 97 pgs: 97 active+clean; 8.7 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.4 MiB/s wr, 471 op/s 2023-09-23T09:06:50.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:06:50 smithi161 ceph-mon[99580]: pgmap v307: 97 pgs: 97 active+clean; 8.7 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.4 MiB/s wr, 471 op/s 2023-09-23T09:06:51.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:06:50 smithi135 ceph-mon[99205]: pgmap v307: 97 pgs: 97 active+clean; 8.7 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.4 MiB/s wr, 471 op/s 2023-09-23T09:06:52.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:06:52 smithi161 ceph-mon[99580]: pgmap v308: 97 pgs: 97 active+clean; 8.7 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 776 KiB/s rd, 3.0 MiB/s wr, 318 op/s 2023-09-23T09:06:53.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:06:52 smithi135 ceph-mon[99205]: pgmap v308: 97 pgs: 97 active+clean; 8.7 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 776 KiB/s rd, 3.0 MiB/s wr, 318 op/s 2023-09-23T09:06:53.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:06:52 smithi082 ceph-mon[97694]: pgmap v308: 97 pgs: 97 active+clean; 8.7 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 776 KiB/s rd, 3.0 MiB/s wr, 318 op/s 2023-09-23T09:06:54.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:06:54 smithi161 ceph-mon[99580]: pgmap v309: 97 pgs: 97 active+clean; 8.7 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 776 KiB/s rd, 3.0 MiB/s wr, 317 op/s 2023-09-23T09:06:55.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:06:54 smithi135 ceph-mon[99205]: pgmap v309: 97 pgs: 97 active+clean; 8.7 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 776 KiB/s rd, 3.0 MiB/s wr, 317 op/s 2023-09-23T09:06:55.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:06:54 smithi082 ceph-mon[97694]: pgmap v309: 97 pgs: 97 active+clean; 8.7 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 776 KiB/s rd, 3.0 MiB/s wr, 317 op/s 2023-09-23T09:06:56.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:06:56 smithi161 ceph-mon[99580]: pgmap v310: 97 pgs: 97 active+clean; 8.7 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.2 MiB/s wr, 446 op/s 2023-09-23T09:06:57.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:06:56 smithi135 ceph-mon[99205]: pgmap v310: 97 pgs: 97 active+clean; 8.7 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.2 MiB/s wr, 446 op/s 2023-09-23T09:06:57.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:06:56 smithi082 ceph-mon[97694]: pgmap v310: 97 pgs: 97 active+clean; 8.7 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.2 MiB/s wr, 446 op/s 2023-09-23T09:06:58.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:06:58 smithi161 ceph-mon[99580]: pgmap v311: 97 pgs: 97 active+clean; 8.7 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 696 KiB/s rd, 2.7 MiB/s wr, 286 op/s 2023-09-23T09:06:59.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:06:58 smithi135 ceph-mon[99205]: pgmap v311: 97 pgs: 97 active+clean; 8.7 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 696 KiB/s rd, 2.7 MiB/s wr, 286 op/s 2023-09-23T09:06:59.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:06:58 smithi082 ceph-mon[97694]: pgmap v311: 97 pgs: 97 active+clean; 8.7 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 696 KiB/s rd, 2.7 MiB/s wr, 286 op/s 2023-09-23T09:06:59.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:06:59 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:07:00.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:06:59 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:07:00.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:06:59 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:07:00.877 INFO:teuthology.orchestra.run.smithi082.stderr:37600000 of 50000000 tuples (75%) done (elapsed 575.62 s, remaining 189.83 s) 2023-09-23T09:07:00.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:07:00 smithi161 ceph-mon[99580]: pgmap v312: 97 pgs: 97 active+clean; 8.7 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 995 KiB/s rd, 4.1 MiB/s wr, 438 op/s 2023-09-23T09:07:01.059 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:07:01.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:07:00 smithi135 ceph-mon[99205]: pgmap v312: 97 pgs: 97 active+clean; 8.7 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 995 KiB/s rd, 4.1 MiB/s wr, 438 op/s 2023-09-23T09:07:01.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:07:00 smithi082 ceph-mon[97694]: pgmap v312: 97 pgs: 97 active+clean; 8.7 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 995 KiB/s rd, 4.1 MiB/s wr, 438 op/s 2023-09-23T09:07:01.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.280+0000 7f6e749ff700 1 -- 172.21.15.82:0/119119873 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6e70102350 msgr2=0x7f6e7010a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:07:01.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.280+0000 7f6e749ff700 1 --2- 172.21.15.82:0/119119873 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6e70102350 0x7f6e7010a830 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6e64009990 tx=0x7f6e64009ca0 comp rx=0 tx=0).stop 2023-09-23T09:07:01.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.280+0000 7f6e749ff700 1 -- 172.21.15.82:0/119119873 shutdown_connections 2023-09-23T09:07:01.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.280+0000 7f6e749ff700 1 --2- 172.21.15.82:0/119119873 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e7010ae50 0x7f6e7010d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:07:01.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.280+0000 7f6e749ff700 1 --2- 172.21.15.82:0/119119873 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e70101a30 0x7f6e70101e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:07:01.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.280+0000 7f6e749ff700 1 --2- 172.21.15.82:0/119119873 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6e70102350 0x7f6e7010a830 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:07:01.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.280+0000 7f6e749ff700 1 -- 172.21.15.82:0/119119873 >> 172.21.15.82:0/119119873 conn(0x7f6e700fb270 msgr2=0x7f6e700fd690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:07:01.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.280+0000 7f6e749ff700 1 -- 172.21.15.82:0/119119873 shutdown_connections 2023-09-23T09:07:01.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.280+0000 7f6e749ff700 1 -- 172.21.15.82:0/119119873 wait complete. 2023-09-23T09:07:01.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.281+0000 7f6e749ff700 1 Processor -- start 2023-09-23T09:07:01.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.281+0000 7f6e749ff700 1 -- start start 2023-09-23T09:07:01.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.282+0000 7f6e749ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6e70101a30 0x7f6e700ff680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:07:01.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.282+0000 7f6e749ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e70102350 0x7f6e700ffbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:07:01.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.282+0000 7f6e749ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e7010ae50 0x7f6e701a4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:07:01.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.282+0000 7f6e749ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e701003f0 con 0x7f6e70102350 2023-09-23T09:07:01.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.282+0000 7f6e749ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e701a5020 con 0x7f6e7010ae50 2023-09-23T09:07:01.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.282+0000 7f6e749ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e701a5160 con 0x7f6e70101a30 2023-09-23T09:07:01.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.282+0000 7f6e6ed9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e7010ae50 0x7f6e701a4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:07:01.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.282+0000 7f6e6e59c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6e70101a30 0x7f6e700ff680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:07:01.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.282+0000 7f6e6ed9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e7010ae50 0x7f6e701a4ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:54602/0 (socket says 172.21.15.82:54602) 2023-09-23T09:07:01.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.282+0000 7f6e6dd9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e70102350 0x7f6e700ffbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:07:01.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.282+0000 7f6e6ed9d700 1 -- 172.21.15.82:0/2614665584 learned_addr learned my addr 172.21.15.82:0/2614665584 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:07:01.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.283+0000 7f6e6e59c700 1 -- 172.21.15.82:0/2614665584 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e7010ae50 msgr2=0x7f6e701a4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:07:01.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.283+0000 7f6e6e59c700 1 --2- 172.21.15.82:0/2614665584 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e7010ae50 0x7f6e701a4ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:07:01.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.283+0000 7f6e6e59c700 1 -- 172.21.15.82:0/2614665584 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e70102350 msgr2=0x7f6e700ffbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:07:01.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.283+0000 7f6e6e59c700 1 --2- 172.21.15.82:0/2614665584 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e70102350 0x7f6e700ffbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:07:01.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.283+0000 7f6e6e59c700 1 -- 172.21.15.82:0/2614665584 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e640095f0 con 0x7f6e70101a30 2023-09-23T09:07:01.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.283+0000 7f6e6e59c700 1 --2- 172.21.15.82:0/2614665584 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6e70101a30 0x7f6e700ff680 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6e6000e9f0 tx=0x7f6e6000ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:07:01.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.283+0000 7f6e5f7fe700 1 -- 172.21.15.82:0/2614665584 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e6000c9c0 con 0x7f6e70101a30 2023-09-23T09:07:01.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.283+0000 7f6e749ff700 1 -- 172.21.15.82:0/2614665584 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e701a53c0 con 0x7f6e70101a30 2023-09-23T09:07:01.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.283+0000 7f6e5f7fe700 1 -- 172.21.15.82:0/2614665584 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6e60010430 con 0x7f6e70101a30 2023-09-23T09:07:01.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.283+0000 7f6e5f7fe700 1 -- 172.21.15.82:0/2614665584 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e60018680 con 0x7f6e70101a30 2023-09-23T09:07:01.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.283+0000 7f6e749ff700 1 -- 172.21.15.82:0/2614665584 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e701a58f0 con 0x7f6e70101a30 2023-09-23T09:07:01.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.287+0000 7f6e5f7fe700 1 -- 172.21.15.82:0/2614665584 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f6e600105a0 con 0x7f6e70101a30 2023-09-23T09:07:01.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.288+0000 7f6e883d4b80 1 Processor -- start 2023-09-23T09:07:01.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.288+0000 7f6e5f7fe700 1 --2- 172.21.15.82:0/2614665584 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f6e580a00c0 0x7f6e580a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:07:01.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.288+0000 7f6e883d4b80 1 -- start start 2023-09-23T09:07:01.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.288+0000 7f6e5f7fe700 1 -- 172.21.15.82:0/2614665584 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f6e60014070 con 0x7f6e70101a30 2023-09-23T09:07:01.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.289+0000 7f6e6ed9d700 1 --2- 172.21.15.82:0/2614665584 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f6e580a00c0 0x7f6e580a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:07:01.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.289+0000 7f6e883d4b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56365bd65380 0x56365bd65760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:07:01.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.289+0000 7f6e883d4b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56365bd65ca0 0x56365bd5f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:07:01.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.289+0000 7f6e883d4b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56365bd5fc40 0x56365bd600a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:07:01.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.289+0000 7f6e883d4b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56365bcc77b0 con 0x56365bd65380 2023-09-23T09:07:01.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.289+0000 7f6e883d4b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56365bcb8780 con 0x56365bd5fc40 2023-09-23T09:07:01.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.289+0000 7f6e883d4b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x56365bcb60a0 con 0x56365bd65ca0 2023-09-23T09:07:01.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.289+0000 7f6e6e59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56365bd65380 0x56365bd65760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:07:01.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.289+0000 7f6e6dd9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56365bd65ca0 0x56365bd5f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:07:01.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.289+0000 7f6e6e59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56365bd65380 0x56365bd65760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36794/0 (socket says 172.21.15.82:36794) 2023-09-23T09:07:01.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.289+0000 7f6e6e59c700 1 -- 172.21.15.82:0/876802329 learned_addr learned my addr 172.21.15.82:0/876802329 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:07:01.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.289+0000 7f6e6ed9d700 1 --2- 172.21.15.82:0/876802329 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56365bd5fc40 0x56365bd600a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:07:01.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.290+0000 7f6e6e59c700 1 -- 172.21.15.82:0/876802329 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56365bd65ca0 msgr2=0x56365bd5f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:07:01.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.290+0000 7f6e6e59c700 1 --2- 172.21.15.82:0/876802329 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56365bd65ca0 0x56365bd5f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:07:01.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.290+0000 7f6e6e59c700 1 -- 172.21.15.82:0/876802329 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56365bd5fc40 msgr2=0x56365bd600a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:07:01.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.290+0000 7f6e6e59c700 1 --2- 172.21.15.82:0/876802329 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56365bd5fc40 0x56365bd600a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:07:01.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.290+0000 7f6e6e59c700 1 -- 172.21.15.82:0/876802329 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56365bb31630 con 0x56365bd65380 2023-09-23T09:07:01.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.290+0000 7f6e6dd9b700 1 --2- 172.21.15.82:0/876802329 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56365bd65ca0 0x56365bd5f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:07:01.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.290+0000 7f6e6ed9d700 1 --2- 172.21.15.82:0/2614665584 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f6e580a00c0 0x7f6e580a2580 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6e70101790 tx=0x7f6e6800b040 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:07:01.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.290+0000 7f6e6e59c700 1 --2- 172.21.15.82:0/876802329 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56365bd65380 0x56365bd65760 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f6e60009800 tx=0x7f6e600987f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=359c32ee6d37c07 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:07:01.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.290+0000 7f6e5cff9700 1 -- 172.21.15.82:0/876802329 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e60099ea0 con 0x56365bd65380 2023-09-23T09:07:01.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.290+0000 7f6e5cff9700 1 -- 172.21.15.82:0/876802329 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6e60098e90 con 0x56365bd65380 2023-09-23T09:07:01.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.290+0000 7f6e5cff9700 1 -- 172.21.15.82:0/876802329 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e60098380 con 0x56365bd65380 2023-09-23T09:07:01.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.291+0000 7f6e883d4b80 1 -- 172.21.15.82:0/876802329 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56365bd65380 msgr2=0x56365bd65760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:07:01.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.291+0000 7f6e883d4b80 1 --2- 172.21.15.82:0/876802329 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56365bd65380 0x56365bd65760 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f6e60009800 tx=0x7f6e600987f0 comp rx=0 tx=0).stop 2023-09-23T09:07:01.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.291+0000 7f6e883d4b80 1 -- 172.21.15.82:0/876802329 shutdown_connections 2023-09-23T09:07:01.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.291+0000 7f6e883d4b80 1 --2- 172.21.15.82:0/876802329 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56365bd5fc40 0x56365bd600a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:07:01.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.291+0000 7f6e883d4b80 1 --2- 172.21.15.82:0/876802329 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56365bd65380 0x56365bd65760 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:07:01.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.291+0000 7f6e883d4b80 1 --2- 172.21.15.82:0/876802329 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56365bd65ca0 0x56365bd5f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:07:01.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.291+0000 7f6e883d4b80 1 -- 172.21.15.82:0/876802329 >> 172.21.15.82:0/876802329 conn(0x56365bcd40e0 msgr2=0x56365bd5a410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:07:01.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.291+0000 7f6e883d4b80 1 -- 172.21.15.82:0/876802329 shutdown_connections 2023-09-23T09:07:01.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.291+0000 7f6e883d4b80 1 -- 172.21.15.82:0/876802329 wait complete. 2023-09-23T09:07:01.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.292+0000 7f6e883d4b80 1 -- start start 2023-09-23T09:07:01.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.292+0000 7f6e883d4b80 1 Processor -- start 2023-09-23T09:07:01.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.292+0000 7f6e883d4b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56365bd5fc40 0x56365bd6bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:07:01.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.292+0000 7f6e883d4b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56365bd65380 0x56365bd68f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:07:01.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.292+0000 7f6e883d4b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56365bd65ca0 0x56365bd69690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:07:01.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.292+0000 7f6e883d4b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56365bcb1990 con 0x56365bd65ca0 2023-09-23T09:07:01.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.292+0000 7f6e883d4b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56365bc4fbb0 con 0x56365bd65380 2023-09-23T09:07:01.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.292+0000 7f6e883d4b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x56365bc4f8b0 con 0x56365bd5fc40 2023-09-23T09:07:01.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.293+0000 7f6e883d4b80 10 client.0 _ll_register_callbacks cb 0x56365bb99a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:07:01.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.293+0000 7f6e6e59c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56365bd5fc40 0x56365bd6bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:07:01.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.293+0000 7f6e6dd9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56365bd65380 0x56365bd68f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:07:01.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.293+0000 7f6e6dd9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56365bd65380 0x56365bd68f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:54616/0 (socket says 172.21.15.82:54616) 2023-09-23T09:07:01.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.293+0000 7f6e6dd9b700 1 -- 172.21.15.82:0/1561061732 learned_addr learned my addr 172.21.15.82:0/1561061732 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:07:01.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.293+0000 7f6e6ed9d700 1 --2- 172.21.15.82:0/1561061732 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56365bd65ca0 0x56365bd69690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:07:01.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.293+0000 7f6e6dd9b700 1 -- 172.21.15.82:0/1561061732 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56365bd5fc40 msgr2=0x56365bd6bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:07:01.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.293+0000 7f6e6dd9b700 1 --2- 172.21.15.82:0/1561061732 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56365bd5fc40 0x56365bd6bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:07:01.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.293+0000 7f6e6dd9b700 1 -- 172.21.15.82:0/1561061732 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56365bd65ca0 msgr2=0x56365bd69690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:07:01.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.293+0000 7f6e6dd9b700 1 --2- 172.21.15.82:0/1561061732 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56365bd65ca0 0x56365bd69690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:07:01.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.293+0000 7f6e6dd9b700 1 -- 172.21.15.82:0/1561061732 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e7010dfd0 con 0x56365bd65380 2023-09-23T09:07:01.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.293+0000 7f6e6e59c700 1 --2- 172.21.15.82:0/1561061732 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56365bd5fc40 0x56365bd6bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:07:01.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.294+0000 7f6e6dd9b700 1 --2- 172.21.15.82:0/1561061732 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56365bd65380 0x56365bd68f50 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6e64009990 tx=0x7f6e64005750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=81c3a7ff21885d5c server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:07:01.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.294+0000 7f6e55ffb700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-09-23T09:07:01.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.294+0000 7f6e55ffb700 1 -- 172.21.15.82:0/1561061732 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e6401d070 con 0x56365bd65380 2023-09-23T09:07:01.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.294+0000 7f6e883d4b80 1 -- 172.21.15.82:0/1561061732 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56365bd2f1c0 con 0x56365bd65380 2023-09-23T09:07:01.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.294+0000 7f6e55ffb700 1 -- 172.21.15.82:0/1561061732 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f6e64004500 con 0x56365bd65380 2023-09-23T09:07:01.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.294+0000 7f6e55ffb700 1 -- 172.21.15.82:0/1561061732 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6e640046c0 con 0x56365bd65380 2023-09-23T09:07:01.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.294+0000 7f6e883d4b80 10 client.26057 fetch_fsmap learned FSMap version 59 2023-09-23T09:07:01.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.294+0000 7f6e883d4b80 1 -- 172.21.15.82:0/1561061732 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=4+}) v3 -- 0x7f6e701a58f0 con 0x56365bd65380 2023-09-23T09:07:01.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.295+0000 7f6e55ffb700 1 -- 172.21.15.82:0/1561061732 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56365bd2f1c0 con 0x56365bd65380 2023-09-23T09:07:01.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.295+0000 7f6e55ffb700 1 -- 172.21.15.82:0/1561061732 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 59) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f6e6400f600 con 0x56365bd65380 2023-09-23T09:07:01.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.295+0000 7f6e883d4b80 10 client.26057 fetch_fsmap finished waiting for FSMap version 59 2023-09-23T09:07:01.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.295+0000 7f6e883d4b80 10 client.26057 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:07:01.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.295+0000 7f6e883d4b80 20 client.26057 populate_metadata read hostname 'smithi082' 2023-09-23T09:07:01.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.295+0000 7f6e883d4b80 1 --2- 172.21.15.82:0/1561061732 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56365bd79810 0x56365bd7bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:07:01.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.295+0000 7f6e883d4b80 4 client.26057 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:07:01.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.295+0000 7f6e883d4b80 1 -- 172.21.15.82:0/1561061732 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56365bc57ba0 con 0x56365bd79810 2023-09-23T09:07:01.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.296+0000 7f6e6e59c700 1 --2- 172.21.15.82:0/1561061732 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56365bd79810 0x56365bd7bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:07:01.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.296+0000 7f6e6e59c700 1 --2- 172.21.15.82:0/1561061732 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56365bd79810 0x56365bd7bc30 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=203d9d9ed9784faf server_cookie=c5839d347180a9c4 in_seq=0 out_seq=0 2023-09-23T09:07:01.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.296+0000 7f6e55ffb700 10 client.26057 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:07:01.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.297+0000 7f6e55ffb700 1 -- 172.21.15.82:0/1561061732 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56365bc57ba0 con 0x56365bd79810 2023-09-23T09:07:01.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.297+0000 7f6e55ffb700 10 client.26057 handle_command_reply: tid=0 2023-09-23T09:07:01.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.297+0000 7f6e883d4b80 1 client.26057 shutdown 2023-09-23T09:07:01.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.298+0000 7f6e883d4b80 1 -- 172.21.15.82:0/1561061732 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56365bd65380 msgr2=0x56365bd68f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:07:01.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.298+0000 7f6e883d4b80 1 --2- 172.21.15.82:0/1561061732 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56365bd65380 0x56365bd68f50 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6e64009990 tx=0x7f6e64005750 comp rx=0 tx=0).stop 2023-09-23T09:07:01.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.298+0000 7f6e883d4b80 1 -- 172.21.15.82:0/1561061732 shutdown_connections 2023-09-23T09:07:01.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.298+0000 7f6e883d4b80 1 --2- 172.21.15.82:0/1561061732 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56365bd79810 0x56365bd7bc30 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:07:01.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.298+0000 7f6e883d4b80 1 --2- 172.21.15.82:0/1561061732 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56365bd65ca0 0x56365bd69690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:07:01.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.298+0000 7f6e883d4b80 1 --2- 172.21.15.82:0/1561061732 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56365bd5fc40 0x56365bd6bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:07:01.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.298+0000 7f6e883d4b80 1 --2- 172.21.15.82:0/1561061732 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56365bd65380 0x56365bd68f50 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:07:01.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.298+0000 7f6e55ffb700 0 client.26057 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:07:01.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.298+0000 7f6e883d4b80 1 -- 172.21.15.82:0/1561061732 >> 172.21.15.82:0/1561061732 conn(0x56365bcd40e0 msgr2=0x56365bd54b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:07:01.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.298+0000 7f6e883d4b80 1 -- 172.21.15.82:0/1561061732 shutdown_connections 2023-09-23T09:07:01.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.298+0000 7f6e883d4b80 1 -- 172.21.15.82:0/1561061732 wait complete. 2023-09-23T09:07:01.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.298+0000 7f6e883d4b80 20 client.26057 trim_cache size 0 max 16384 2023-09-23T09:07:01.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.317+0000 7f6e883d4b80 1 Processor -- start 2023-09-23T09:07:01.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.317+0000 7f6e883d4b80 1 -- start start 2023-09-23T09:07:01.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.317+0000 7f6e883d4b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56365bd5fc40 0x56365bd70740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:07:01.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.317+0000 7f6e883d4b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56365bd65380 0x56365bd75a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:07:01.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.317+0000 7f6e883d4b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56365bd65ca0 0x56365bd63130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:07:01.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.317+0000 7f6e883d4b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56365bb33920 con 0x56365bd65380 2023-09-23T09:07:01.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.317+0000 7f6e883d4b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56365bc57bd0 con 0x56365bd5fc40 2023-09-23T09:07:01.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.317+0000 7f6e883d4b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x56365bd56a40 con 0x56365bd65ca0 2023-09-23T09:07:01.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.317+0000 7f6e6dd9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56365bd65380 0x56365bd75a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:07:01.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.317+0000 7f6e6e59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56365bd5fc40 0x56365bd70740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:07:01.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.317+0000 7f6e6ed9d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56365bd65ca0 0x56365bd63130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:07:01.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.318+0000 7f6e6dd9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56365bd65380 0x56365bd75a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36808/0 (socket says 172.21.15.82:36808) 2023-09-23T09:07:01.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.318+0000 7f6e6dd9b700 1 -- 172.21.15.82:0/994254807 learned_addr learned my addr 172.21.15.82:0/994254807 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:07:01.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.318+0000 7f6e6dd9b700 1 -- 172.21.15.82:0/994254807 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56365bd65ca0 msgr2=0x56365bd63130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:07:01.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.318+0000 7f6e6dd9b700 1 --2- 172.21.15.82:0/994254807 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56365bd65ca0 0x56365bd63130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:07:01.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.318+0000 7f6e6dd9b700 1 -- 172.21.15.82:0/994254807 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56365bd5fc40 msgr2=0x56365bd70740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:07:01.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.318+0000 7f6e6dd9b700 1 --2- 172.21.15.82:0/994254807 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56365bd5fc40 0x56365bd70740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:07:01.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.318+0000 7f6e6dd9b700 1 -- 172.21.15.82:0/994254807 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56365bd80820 con 0x56365bd65380 2023-09-23T09:07:01.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.318+0000 7f6e6dd9b700 1 --2- 172.21.15.82:0/994254807 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56365bd65380 0x56365bd75a70 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f6e640098e0 tx=0x7f6e6400b410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=906622a801445c39 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:07:01.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.318+0000 7f6e5d7fa700 1 -- 172.21.15.82:0/994254807 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e6401d070 con 0x56365bd65380 2023-09-23T09:07:01.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.318+0000 7f6e5d7fa700 1 -- 172.21.15.82:0/994254807 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6e6401e040 con 0x56365bd65380 2023-09-23T09:07:01.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.318+0000 7f6e5d7fa700 1 -- 172.21.15.82:0/994254807 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e64004760 con 0x56365bd65380 2023-09-23T09:07:01.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.319+0000 7f6e883d4b80 1 -- 172.21.15.82:0/994254807 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56365bd65380 msgr2=0x56365bd75a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:07:01.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.319+0000 7f6e883d4b80 1 --2- 172.21.15.82:0/994254807 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56365bd65380 0x56365bd75a70 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f6e640098e0 tx=0x7f6e6400b410 comp rx=0 tx=0).stop 2023-09-23T09:07:01.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.319+0000 7f6e883d4b80 1 -- 172.21.15.82:0/994254807 shutdown_connections 2023-09-23T09:07:01.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.319+0000 7f6e883d4b80 1 --2- 172.21.15.82:0/994254807 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56365bd65ca0 0x56365bd63130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:07:01.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.319+0000 7f6e883d4b80 1 --2- 172.21.15.82:0/994254807 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56365bd5fc40 0x56365bd70740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:07:01.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.319+0000 7f6e883d4b80 1 --2- 172.21.15.82:0/994254807 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56365bd65380 0x56365bd75a70 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:07:01.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.319+0000 7f6e883d4b80 1 -- 172.21.15.82:0/994254807 >> 172.21.15.82:0/994254807 conn(0x56365bcd40e0 msgr2=0x56365bd5a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:07:01.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.319+0000 7f6e883d4b80 1 -- 172.21.15.82:0/994254807 shutdown_connections 2023-09-23T09:07:01.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.319+0000 7f6e883d4b80 1 -- 172.21.15.82:0/994254807 wait complete. 2023-09-23T09:07:01.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.320+0000 7f6e883d4b80 1 -- start start 2023-09-23T09:07:01.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.320+0000 7f6e883d4b80 1 Processor -- start 2023-09-23T09:07:01.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.321+0000 7f6e883d4b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56365bd5fc40 0x56365bd70930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:07:01.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.321+0000 7f6e883d4b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56365bd65380 0x56365bd6e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:07:01.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.321+0000 7f6e883d4b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56365bd65ca0 0x56365bd6ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:07:01.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.321+0000 7f6e883d4b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56365bd6f540 con 0x56365bd5fc40 2023-09-23T09:07:01.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.321+0000 7f6e883d4b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56365bdcc600 con 0x56365bd65380 2023-09-23T09:07:01.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.321+0000 7f6e883d4b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x56365bdcc740 con 0x56365bd65ca0 2023-09-23T09:07:01.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.321+0000 7f6e883d4b80 10 client.0 _ll_register_callbacks cb 0x7f6e64009810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:07:01.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.321+0000 7f6e6e59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56365bd5fc40 0x56365bd70930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:07:01.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.321+0000 7f6e6dd9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56365bd65380 0x56365bd6e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:07:01.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.321+0000 7f6e6e59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56365bd5fc40 0x56365bd70930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36824/0 (socket says 172.21.15.82:36824) 2023-09-23T09:07:01.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.321+0000 7f6e6e59c700 1 -- 172.21.15.82:0/2595708731 learned_addr learned my addr 172.21.15.82:0/2595708731 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:07:01.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.321+0000 7f6e6ed9d700 1 --2- 172.21.15.82:0/2595708731 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56365bd65ca0 0x56365bd6ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:07:01.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.321+0000 7f6e6e59c700 1 -- 172.21.15.82:0/2595708731 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56365bd65ca0 msgr2=0x56365bd6ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:07:01.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.321+0000 7f6e6e59c700 1 --2- 172.21.15.82:0/2595708731 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56365bd65ca0 0x56365bd6ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:07:01.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.321+0000 7f6e6e59c700 1 -- 172.21.15.82:0/2595708731 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56365bd65380 msgr2=0x56365bd6e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:07:01.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.321+0000 7f6e6e59c700 1 --2- 172.21.15.82:0/2595708731 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56365bd65380 0x56365bd6e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:07:01.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.321+0000 7f6e6e59c700 1 -- 172.21.15.82:0/2595708731 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e701a58f0 con 0x56365bd5fc40 2023-09-23T09:07:01.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.322+0000 7f6e6e59c700 1 --2- 172.21.15.82:0/2595708731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56365bd5fc40 0x56365bd70930 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f6e600097d0 tx=0x7f6e60098c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=495db00426283f02 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:07:01.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.322+0000 7f6e55ffb700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:07:01.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.322+0000 7f6e55ffb700 1 -- 172.21.15.82:0/2595708731 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e60099ea0 con 0x56365bd5fc40 2023-09-23T09:07:01.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.322+0000 7f6e55ffb700 1 -- 172.21.15.82:0/2595708731 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f6e600a0ca0 con 0x56365bd5fc40 2023-09-23T09:07:01.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.322+0000 7f6e883d4b80 1 -- 172.21.15.82:0/2595708731 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56365bd528b0 con 0x56365bd5fc40 2023-09-23T09:07:01.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.322+0000 7f6e55ffb700 1 -- 172.21.15.82:0/2595708731 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6e6009ccc0 con 0x56365bd5fc40 2023-09-23T09:07:01.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.322+0000 7f6e883d4b80 10 client.16374 fetch_fsmap learned FSMap version 59 2023-09-23T09:07:01.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.322+0000 7f6e883d4b80 1 -- 172.21.15.82:0/2595708731 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=4+}) v3 -- 0x56365baddde0 con 0x56365bd5fc40 2023-09-23T09:07:01.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.322+0000 7f6e55ffb700 1 -- 172.21.15.82:0/2595708731 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56365bd528b0 con 0x56365bd5fc40 2023-09-23T09:07:01.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.322+0000 7f6e55ffb700 1 -- 172.21.15.82:0/2595708731 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 59) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f6e600a0810 con 0x56365bd5fc40 2023-09-23T09:07:01.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.323+0000 7f6e883d4b80 10 client.16374 fetch_fsmap finished waiting for FSMap version 59 2023-09-23T09:07:01.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.323+0000 7f6e883d4b80 10 client.16374 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:07:01.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.323+0000 7f6e883d4b80 20 client.16374 populate_metadata read hostname 'smithi082' 2023-09-23T09:07:01.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.323+0000 7f6e883d4b80 1 --2- 172.21.15.82:0/2595708731 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56365bdcdc70 0x56365bdd0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:07:01.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.323+0000 7f6e883d4b80 4 client.16374 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:07:01.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.323+0000 7f6e883d4b80 1 -- 172.21.15.82:0/2595708731 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x56365bcaa970 con 0x56365bdcdc70 2023-09-23T09:07:01.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.323+0000 7f6e6dd9b700 1 --2- 172.21.15.82:0/2595708731 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56365bdcdc70 0x56365bdd0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:07:01.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.324+0000 7f6e6dd9b700 1 --2- 172.21.15.82:0/2595708731 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56365bdcdc70 0x56365bdd0090 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7af4342781491048 server_cookie=a38b8a872e3bd4f8 in_seq=0 out_seq=0 2023-09-23T09:07:01.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.324+0000 7f6e55ffb700 10 client.16374 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:07:01.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.324+0000 7f6e55ffb700 1 -- 172.21.15.82:0/2595708731 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x56365bcaa970 con 0x56365bdcdc70 2023-09-23T09:07:01.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.324+0000 7f6e55ffb700 10 client.16374 handle_command_reply: tid=0 2023-09-23T09:07:01.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.324+0000 7f6e883d4b80 1 client.16374 shutdown 2023-09-23T09:07:01.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.324+0000 7f6e883d4b80 1 -- 172.21.15.82:0/2595708731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56365bd5fc40 msgr2=0x56365bd70930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:07:01.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.324+0000 7f6e883d4b80 1 --2- 172.21.15.82:0/2595708731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56365bd5fc40 0x56365bd70930 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f6e600097d0 tx=0x7f6e60098c60 comp rx=0 tx=0).stop 2023-09-23T09:07:01.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.324+0000 7f6e883d4b80 1 -- 172.21.15.82:0/2595708731 shutdown_connections 2023-09-23T09:07:01.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.324+0000 7f6e883d4b80 1 --2- 172.21.15.82:0/2595708731 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56365bd65ca0 0x56365bd6ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:07:01.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.324+0000 7f6e883d4b80 1 --2- 172.21.15.82:0/2595708731 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56365bdcdc70 0x56365bdd0090 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:07:01.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.324+0000 7f6e883d4b80 1 --2- 172.21.15.82:0/2595708731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56365bd5fc40 0x56365bd70930 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:07:01.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.324+0000 7f6e883d4b80 1 --2- 172.21.15.82:0/2595708731 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56365bd65380 0x56365bd6e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:07:01.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.324+0000 7f6e883d4b80 1 -- 172.21.15.82:0/2595708731 >> 172.21.15.82:0/2595708731 conn(0x56365bcd40e0 msgr2=0x56365bd74e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:07:01.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.324+0000 7f6e55ffb700 0 client.16374 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:07:01.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.324+0000 7f6e883d4b80 1 -- 172.21.15.82:0/2595708731 shutdown_connections 2023-09-23T09:07:01.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.324+0000 7f6e883d4b80 1 -- 172.21.15.82:0/2595708731 wait complete. 2023-09-23T09:07:01.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.325+0000 7f6e883d4b80 20 client.16374 trim_cache size 0 max 16384 2023-09-23T09:07:01.331 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:07:01.332 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "IDLE (waiting for more scrubs)", 2023-09-23T09:07:01.332 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:07:01.332 INFO:teuthology.orchestra.run.smithi082.stdout: "cba46b77-20dd-437c-a60a-ac01b400e1b8": { 2023-09-23T09:07:01.332 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:07:01.332 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "cba46b77-20dd-437c-a60a-ac01b400e1b8", 2023-09-23T09:07:01.332 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:07:01.332 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:07:01.332 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:07:01.332 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:07:01.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.325+0000 7f6e749ff700 1 -- 172.21.15.82:0/2614665584 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f6e580a00c0 msgr2=0x7f6e580a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:07:01.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.325+0000 7f6e749ff700 1 --2- 172.21.15.82:0/2614665584 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f6e580a00c0 0x7f6e580a2580 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6e70101790 tx=0x7f6e6800b040 comp rx=0 tx=0).stop 2023-09-23T09:07:01.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.325+0000 7f6e749ff700 1 -- 172.21.15.82:0/2614665584 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6e70101a30 msgr2=0x7f6e700ff680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:07:01.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.325+0000 7f6e749ff700 1 --2- 172.21.15.82:0/2614665584 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6e70101a30 0x7f6e700ff680 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6e6000e9f0 tx=0x7f6e6000ed00 comp rx=0 tx=0).stop 2023-09-23T09:07:01.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.325+0000 7f6e749ff700 1 -- 172.21.15.82:0/2614665584 shutdown_connections 2023-09-23T09:07:01.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.325+0000 7f6e749ff700 1 --2- 172.21.15.82:0/2614665584 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f6e580a00c0 0x7f6e580a2580 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:07:01.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.325+0000 7f6e749ff700 1 --2- 172.21.15.82:0/2614665584 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e7010ae50 0x7f6e701a4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:07:01.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.325+0000 7f6e749ff700 1 --2- 172.21.15.82:0/2614665584 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6e70101a30 0x7f6e700ff680 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:07:01.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.325+0000 7f6e749ff700 1 --2- 172.21.15.82:0/2614665584 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e70102350 0x7f6e700ffbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:07:01.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.325+0000 7f6e749ff700 1 -- 172.21.15.82:0/2614665584 >> 172.21.15.82:0/2614665584 conn(0x7f6e700fb270 msgr2=0x7f6e700fbee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:07:01.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.325+0000 7f6e749ff700 1 -- 172.21.15.82:0/2614665584 shutdown_connections 2023-09-23T09:07:01.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:01.325+0000 7f6e749ff700 1 -- 172.21.15.82:0/2614665584 wait complete. 2023-09-23T09:07:01.346 INFO:tasks.cephfs.filesystem:scrub status for tag:cba46b77-20dd-437c-a60a-ac01b400e1b8 - {'path': '/', 'tag': 'cba46b77-20dd-437c-a60a-ac01b400e1b8', 'options': 'recursive,force'} 2023-09-23T09:07:02.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:07:02 smithi161 ceph-mon[99580]: pgmap v313: 97 pgs: 97 active+clean; 8.7 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 610 KiB/s rd, 2.6 MiB/s wr, 281 op/s 2023-09-23T09:07:03.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:07:02 smithi135 ceph-mon[99205]: pgmap v313: 97 pgs: 97 active+clean; 8.7 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 610 KiB/s rd, 2.6 MiB/s wr, 281 op/s 2023-09-23T09:07:03.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:07:02 smithi082 ceph-mon[97694]: pgmap v313: 97 pgs: 97 active+clean; 8.7 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 610 KiB/s rd, 2.6 MiB/s wr, 281 op/s 2023-09-23T09:07:04.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:07:04 smithi161 ceph-mon[99580]: pgmap v314: 97 pgs: 97 active+clean; 8.7 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 610 KiB/s rd, 2.6 MiB/s wr, 281 op/s 2023-09-23T09:07:05.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:07:04 smithi135 ceph-mon[99205]: pgmap v314: 97 pgs: 97 active+clean; 8.7 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 610 KiB/s rd, 2.6 MiB/s wr, 281 op/s 2023-09-23T09:07:05.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:07:04 smithi082 ceph-mon[97694]: pgmap v314: 97 pgs: 97 active+clean; 8.7 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 610 KiB/s rd, 2.6 MiB/s wr, 281 op/s 2023-09-23T09:07:07.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:07:06 smithi135 ceph-mon[99205]: pgmap v315: 97 pgs: 97 active+clean; 8.7 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 1021 KiB/s rd, 4.2 MiB/s wr, 451 op/s 2023-09-23T09:07:07.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:07:06 smithi082 ceph-mon[97694]: pgmap v315: 97 pgs: 97 active+clean; 8.7 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 1021 KiB/s rd, 4.2 MiB/s wr, 451 op/s 2023-09-23T09:07:07.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:07:06 smithi161 ceph-mon[99580]: pgmap v315: 97 pgs: 97 active+clean; 8.7 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 1021 KiB/s rd, 4.2 MiB/s wr, 451 op/s 2023-09-23T09:07:08.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:07:07 smithi135 ceph-mon[99205]: osdmap e96: 12 total, 12 up, 12 in 2023-09-23T09:07:08.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:07:07 smithi082 ceph-mon[97694]: osdmap e96: 12 total, 12 up, 12 in 2023-09-23T09:07:08.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:07:07 smithi161 ceph-mon[99580]: osdmap e96: 12 total, 12 up, 12 in 2023-09-23T09:07:09.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:07:08 smithi135 ceph-mon[99205]: pgmap v317: 97 pgs: 97 active+clean; 8.7 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 852 KiB/s rd, 3.6 MiB/s wr, 386 op/s 2023-09-23T09:07:09.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:07:08 smithi082 ceph-mon[97694]: pgmap v317: 97 pgs: 97 active+clean; 8.7 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 852 KiB/s rd, 3.6 MiB/s wr, 386 op/s 2023-09-23T09:07:09.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:07:08 smithi161 ceph-mon[99580]: pgmap v317: 97 pgs: 97 active+clean; 8.7 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 852 KiB/s rd, 3.6 MiB/s wr, 386 op/s 2023-09-23T09:07:11.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:07:10 smithi135 ceph-mon[99205]: pgmap v318: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 998 KiB/s rd, 3.6 MiB/s wr, 386 op/s 2023-09-23T09:07:11.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:07:10 smithi082 ceph-mon[97694]: pgmap v318: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 998 KiB/s rd, 3.6 MiB/s wr, 386 op/s 2023-09-23T09:07:11.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:07:10 smithi161 ceph-mon[99580]: pgmap v318: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 998 KiB/s rd, 3.6 MiB/s wr, 386 op/s 2023-09-23T09:07:12.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:07:12 smithi082 ceph-mon[97694]: pgmap v319: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 998 KiB/s rd, 3.6 MiB/s wr, 386 op/s 2023-09-23T09:07:12.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:07:12 smithi082 ceph-mon[97694]: osdmap e97: 12 total, 12 up, 12 in 2023-09-23T09:07:12.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:07:12 smithi161 ceph-mon[99580]: pgmap v319: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 998 KiB/s rd, 3.6 MiB/s wr, 386 op/s 2023-09-23T09:07:12.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:07:12 smithi161 ceph-mon[99580]: osdmap e97: 12 total, 12 up, 12 in 2023-09-23T09:07:13.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:07:12 smithi135 ceph-mon[99205]: pgmap v319: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 998 KiB/s rd, 3.6 MiB/s wr, 386 op/s 2023-09-23T09:07:13.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:07:12 smithi135 ceph-mon[99205]: osdmap e97: 12 total, 12 up, 12 in 2023-09-23T09:07:14.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:07:14 smithi082 ceph-mon[97694]: pgmap v321: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 631 KiB/s rd, 2.2 MiB/s wr, 227 op/s 2023-09-23T09:07:14.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:07:14 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:07:14.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:07:14 smithi161 ceph-mon[99580]: pgmap v321: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 631 KiB/s rd, 2.2 MiB/s wr, 227 op/s 2023-09-23T09:07:14.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:07:14 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:07:14.946 INFO:teuthology.orchestra.run.smithi082.stderr:37700000 of 50000000 tuples (75%) done (elapsed 589.69 s, remaining 192.39 s) 2023-09-23T09:07:15.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:07:14 smithi135 ceph-mon[99205]: pgmap v321: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 631 KiB/s rd, 2.2 MiB/s wr, 227 op/s 2023-09-23T09:07:15.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:07:14 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:07:16.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:07:16 smithi161 ceph-mon[99580]: pgmap v322: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.0 MiB/s wr, 417 op/s 2023-09-23T09:07:17.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:07:16 smithi135 ceph-mon[99205]: pgmap v322: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.0 MiB/s wr, 417 op/s 2023-09-23T09:07:17.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:07:16 smithi082 ceph-mon[97694]: pgmap v322: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.0 MiB/s wr, 417 op/s 2023-09-23T09:07:18.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:07:18 smithi161 ceph-mon[99580]: pgmap v323: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 989 KiB/s rd, 3.5 MiB/s wr, 358 op/s 2023-09-23T09:07:18.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:07:18 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:07:18.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:07:18 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:07:18.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:07:18 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:07:18.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:07:18 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:07:18.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:07:18 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:07:18.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:07:18 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:07:19.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:07:18 smithi135 ceph-mon[99205]: pgmap v323: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 989 KiB/s rd, 3.5 MiB/s wr, 358 op/s 2023-09-23T09:07:19.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:07:18 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:07:19.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:07:18 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:07:19.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:07:18 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:07:19.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:07:18 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:07:19.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:07:18 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:07:19.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:07:18 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:07:19.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:07:18 smithi082 ceph-mon[97694]: pgmap v323: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 989 KiB/s rd, 3.5 MiB/s wr, 358 op/s 2023-09-23T09:07:19.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:07:18 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:07:19.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:07:18 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:07:19.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:07:18 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:07:19.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:07:18 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:07:19.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:07:18 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:07:19.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:07:18 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:07:19.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:07:19 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:07:19.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:07:19 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:07:19.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:07:19 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:07:19.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:07:19 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:07:19.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:07:19 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:07:19.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:07:19 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:07:19.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:07:19 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:07:19.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:07:19 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:07:19.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:07:19 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:07:19.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:07:19 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:07:19.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:07:19 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:07:19.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:07:19 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:07:19.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:07:19 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:07:19.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:07:19 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:07:19.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:07:19 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:07:20.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:07:19 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:07:20.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:07:19 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:07:20.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:07:19 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:07:20.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:07:19 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:07:20.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:07:19 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:07:20.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:07:19 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:07:20.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:07:19 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:07:20.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:07:19 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:07:20.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:07:19 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:07:20.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:07:19 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:07:20.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:07:19 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:07:20.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:07:19 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:07:20.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:07:19 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:07:20.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:07:19 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:07:20.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:07:19 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:07:20.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:07:19 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:07:20.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:07:19 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:07:20.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:07:19 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:07:20.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:07:19 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:07:20.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:07:19 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:07:20.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:07:19 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:07:20.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:07:19 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:07:20.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:07:19 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:07:20.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:07:19 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:07:20.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:07:19 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:07:20.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:07:19 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:07:20.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:07:19 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:07:20.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:07:19 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:07:20.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:07:19 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:07:20.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:07:19 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:07:20.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:07:20 smithi161 ceph-mon[99580]: Adjusting osd_memory_target on smithi082 to 220.9M 2023-09-23T09:07:20.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:07:20 smithi161 ceph-mon[99580]: Unable to set osd_memory_target on smithi082 to 231651840: error parsing value: Value '231651840' is below minimum 939524096 2023-09-23T09:07:20.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:07:20 smithi161 ceph-mon[99580]: pgmap v324: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 947 KiB/s rd, 3.3 MiB/s wr, 343 op/s 2023-09-23T09:07:20.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:07:20 smithi161 ceph-mon[99580]: Adjusting osd_memory_target on smithi135 to 220.9M 2023-09-23T09:07:20.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:07:20 smithi161 ceph-mon[99580]: Adjusting osd_memory_target on smithi161 to 220.9M 2023-09-23T09:07:20.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:07:20 smithi161 ceph-mon[99580]: Unable to set osd_memory_target on smithi135 to 231659008: error parsing value: Value '231659008' is below minimum 939524096 2023-09-23T09:07:20.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:07:20 smithi161 ceph-mon[99580]: Unable to set osd_memory_target on smithi161 to 231676211: error parsing value: Value '231676211' is below minimum 939524096 2023-09-23T09:07:21.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:07:20 smithi135 ceph-mon[99205]: Adjusting osd_memory_target on smithi082 to 220.9M 2023-09-23T09:07:21.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:07:20 smithi135 ceph-mon[99205]: Unable to set osd_memory_target on smithi082 to 231651840: error parsing value: Value '231651840' is below minimum 939524096 2023-09-23T09:07:21.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:07:20 smithi135 ceph-mon[99205]: pgmap v324: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 947 KiB/s rd, 3.3 MiB/s wr, 343 op/s 2023-09-23T09:07:21.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:07:20 smithi135 ceph-mon[99205]: Adjusting osd_memory_target on smithi135 to 220.9M 2023-09-23T09:07:21.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:07:20 smithi135 ceph-mon[99205]: Adjusting osd_memory_target on smithi161 to 220.9M 2023-09-23T09:07:21.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:07:20 smithi135 ceph-mon[99205]: Unable to set osd_memory_target on smithi135 to 231659008: error parsing value: Value '231659008' is below minimum 939524096 2023-09-23T09:07:21.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:07:20 smithi135 ceph-mon[99205]: Unable to set osd_memory_target on smithi161 to 231676211: error parsing value: Value '231676211' is below minimum 939524096 2023-09-23T09:07:21.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:07:20 smithi082 ceph-mon[97694]: Adjusting osd_memory_target on smithi082 to 220.9M 2023-09-23T09:07:21.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:07:20 smithi082 ceph-mon[97694]: Unable to set osd_memory_target on smithi082 to 231651840: error parsing value: Value '231651840' is below minimum 939524096 2023-09-23T09:07:21.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:07:20 smithi082 ceph-mon[97694]: pgmap v324: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 947 KiB/s rd, 3.3 MiB/s wr, 343 op/s 2023-09-23T09:07:21.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:07:20 smithi082 ceph-mon[97694]: Adjusting osd_memory_target on smithi135 to 220.9M 2023-09-23T09:07:21.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:07:20 smithi082 ceph-mon[97694]: Adjusting osd_memory_target on smithi161 to 220.9M 2023-09-23T09:07:21.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:07:20 smithi082 ceph-mon[97694]: Unable to set osd_memory_target on smithi135 to 231659008: error parsing value: Value '231659008' is below minimum 939524096 2023-09-23T09:07:21.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:07:20 smithi082 ceph-mon[97694]: Unable to set osd_memory_target on smithi161 to 231676211: error parsing value: Value '231676211' is below minimum 939524096 2023-09-23T09:07:22.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:07:22 smithi161 ceph-mon[99580]: pgmap v325: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 947 KiB/s rd, 3.3 MiB/s wr, 343 op/s 2023-09-23T09:07:23.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:07:22 smithi135 ceph-mon[99205]: pgmap v325: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 947 KiB/s rd, 3.3 MiB/s wr, 343 op/s 2023-09-23T09:07:23.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:07:22 smithi082 ceph-mon[97694]: pgmap v325: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 947 KiB/s rd, 3.3 MiB/s wr, 343 op/s 2023-09-23T09:07:24.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:07:24 smithi161 ceph-mon[99580]: pgmap v326: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 814 KiB/s rd, 2.9 MiB/s wr, 295 op/s 2023-09-23T09:07:25.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:07:24 smithi135 ceph-mon[99205]: pgmap v326: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 814 KiB/s rd, 2.9 MiB/s wr, 295 op/s 2023-09-23T09:07:25.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:07:24 smithi082 ceph-mon[97694]: pgmap v326: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 814 KiB/s rd, 2.9 MiB/s wr, 295 op/s 2023-09-23T09:07:26.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:07:26 smithi161 ceph-mon[99580]: pgmap v327: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.3 MiB/s wr, 442 op/s 2023-09-23T09:07:27.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:07:26 smithi135 ceph-mon[99205]: pgmap v327: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.3 MiB/s wr, 442 op/s 2023-09-23T09:07:27.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:07:26 smithi082 ceph-mon[97694]: pgmap v327: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.3 MiB/s wr, 442 op/s 2023-09-23T09:07:28.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:07:27 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:07:28.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:07:27 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:07:28.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:07:27 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:07:29.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:07:28 smithi135 ceph-mon[99205]: pgmap v328: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 807 KiB/s rd, 2.9 MiB/s wr, 295 op/s 2023-09-23T09:07:29.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:07:28 smithi082 ceph-mon[97694]: pgmap v328: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 807 KiB/s rd, 2.9 MiB/s wr, 295 op/s 2023-09-23T09:07:29.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:07:28 smithi161 ceph-mon[99580]: pgmap v328: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 807 KiB/s rd, 2.9 MiB/s wr, 295 op/s 2023-09-23T09:07:30.113 INFO:teuthology.orchestra.run.smithi082.stderr:37800000 of 50000000 tuples (75%) done (elapsed 604.85 s, remaining 195.22 s) 2023-09-23T09:07:31.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:07:30 smithi135 ceph-mon[99205]: pgmap v329: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.4 MiB/s wr, 453 op/s 2023-09-23T09:07:31.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:07:30 smithi082 ceph-mon[97694]: pgmap v329: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.4 MiB/s wr, 453 op/s 2023-09-23T09:07:31.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:07:30 smithi161 ceph-mon[99580]: pgmap v329: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.4 MiB/s wr, 453 op/s 2023-09-23T09:07:31.346 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:07:31.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.578+0000 7f68a5fff700 1 -- 172.21.15.82:0/3237012432 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68a0100870 msgr2=0x7f68a0100cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:07:31.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.578+0000 7f68a5fff700 1 --2- 172.21.15.82:0/3237012432 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68a0100870 0x7f68a0100cf0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f6894009990 tx=0x7f6894009ca0 comp rx=0 tx=0).stop 2023-09-23T09:07:31.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.578+0000 7f68a5fff700 1 -- 172.21.15.82:0/3237012432 shutdown_connections 2023-09-23T09:07:31.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.578+0000 7f68a5fff700 1 --2- 172.21.15.82:0/3237012432 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68a0101230 0x7f68a010d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:07:31.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.578+0000 7f68a5fff700 1 --2- 172.21.15.82:0/3237012432 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68a0106880 0x7f68a0106c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:07:31.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.578+0000 7f68a5fff700 1 --2- 172.21.15.82:0/3237012432 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68a0100870 0x7f68a0100cf0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:07:31.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.578+0000 7f68a5fff700 1 -- 172.21.15.82:0/3237012432 >> 172.21.15.82:0/3237012432 conn(0x7f68a00fc3a0 msgr2=0x7f68a00fe7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:07:31.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.578+0000 7f68a5fff700 1 -- 172.21.15.82:0/3237012432 shutdown_connections 2023-09-23T09:07:31.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.578+0000 7f68a5fff700 1 -- 172.21.15.82:0/3237012432 wait complete. 2023-09-23T09:07:31.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.579+0000 7f68a5fff700 1 Processor -- start 2023-09-23T09:07:31.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.580+0000 7f68a5fff700 1 -- start start 2023-09-23T09:07:31.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.580+0000 7f68a5fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68a0100870 0x7f68a019e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:07:31.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.580+0000 7f68a5fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68a0101230 0x7f68a019ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:07:31.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.580+0000 7f68a5fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68a0106880 0x7f68a01988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:07:31.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.580+0000 7f68a5fff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68a0198f20 con 0x7f68a0100870 2023-09-23T09:07:31.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.580+0000 7f68a5fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68a0199090 con 0x7f68a0106880 2023-09-23T09:07:31.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.580+0000 7f68a5fff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68a0199250 con 0x7f68a0101230 2023-09-23T09:07:31.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.580+0000 7f689f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68a0100870 0x7f68a019e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:07:31.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.580+0000 7f689f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68a0100870 0x7f68a019e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47114/0 (socket says 172.21.15.82:47114) 2023-09-23T09:07:31.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.580+0000 7f689f7fe700 1 -- 172.21.15.82:0/4050875173 learned_addr learned my addr 172.21.15.82:0/4050875173 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:07:31.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.580+0000 7f689ffff700 1 --2- 172.21.15.82:0/4050875173 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68a0106880 0x7f68a01988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:07:31.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.580+0000 7f689effd700 1 --2- 172.21.15.82:0/4050875173 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68a0101230 0x7f68a019ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:07:31.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.581+0000 7f689f7fe700 1 -- 172.21.15.82:0/4050875173 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68a0101230 msgr2=0x7f68a019ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:07:31.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.581+0000 7f689f7fe700 1 --2- 172.21.15.82:0/4050875173 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68a0101230 0x7f68a019ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:07:31.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.581+0000 7f689f7fe700 1 -- 172.21.15.82:0/4050875173 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68a0106880 msgr2=0x7f68a01988b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:07:31.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.581+0000 7f689f7fe700 1 --2- 172.21.15.82:0/4050875173 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68a0106880 0x7f68a01988b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:07:31.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.581+0000 7f689f7fe700 1 -- 172.21.15.82:0/4050875173 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68940095f0 con 0x7f68a0100870 2023-09-23T09:07:31.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.581+0000 7f689f7fe700 1 --2- 172.21.15.82:0/4050875173 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68a0100870 0x7f68a019e840 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f689000e9a0 tx=0x7f689000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:07:31.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.581+0000 7f689cff9700 1 -- 172.21.15.82:0/4050875173 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6890009790 con 0x7f68a0100870 2023-09-23T09:07:31.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.581+0000 7f68a5fff700 1 -- 172.21.15.82:0/4050875173 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68a0199530 con 0x7f68a0100870 2023-09-23T09:07:31.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.581+0000 7f689cff9700 1 -- 172.21.15.82:0/4050875173 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6890010430 con 0x7f68a0100870 2023-09-23T09:07:31.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.581+0000 7f689cff9700 1 -- 172.21.15.82:0/4050875173 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f689000cea0 con 0x7f68a0100870 2023-09-23T09:07:31.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.581+0000 7f68a5fff700 1 -- 172.21.15.82:0/4050875173 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68a01a5830 con 0x7f68a0100870 2023-09-23T09:07:31.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.585+0000 7f689cff9700 1 -- 172.21.15.82:0/4050875173 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f68900105a0 con 0x7f68a0100870 2023-09-23T09:07:31.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.586+0000 7f68b987fb80 1 Processor -- start 2023-09-23T09:07:31.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.586+0000 7f68b987fb80 1 -- start start 2023-09-23T09:07:31.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.586+0000 7f68b987fb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558dce6ca380 0x558dce6ca760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:07:31.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.586+0000 7f68b987fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558dce6caca0 0x558dce6c4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:07:31.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.586+0000 7f689cff9700 1 --2- 172.21.15.82:0/4050875173 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f68880a00c0 0x7f68880a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:07:31.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.586+0000 7f68b987fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558dce6c4c40 0x558dce6c50a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:07:31.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.586+0000 7f68b987fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x558dce62c7b0 con 0x558dce6caca0 2023-09-23T09:07:31.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.586+0000 7f68b987fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x558dce61d780 con 0x558dce6c4c40 2023-09-23T09:07:31.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.586+0000 7f68b987fb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x558dce61b0a0 con 0x558dce6ca380 2023-09-23T09:07:31.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.587+0000 7f689cff9700 1 -- 172.21.15.82:0/4050875173 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f6890014070 con 0x7f68a0100870 2023-09-23T09:07:31.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.587+0000 7f689ffff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558dce6ca380 0x558dce6ca760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:07:31.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.587+0000 7f689ffff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558dce6ca380 0x558dce6ca760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:53822/0 (socket says 172.21.15.82:53822) 2023-09-23T09:07:31.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.587+0000 7f689ffff700 1 -- 172.21.15.82:0/1554175897 learned_addr learned my addr 172.21.15.82:0/1554175897 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:07:31.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.587+0000 7f689f7fe700 1 --2- 172.21.15.82:0/1554175897 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558dce6caca0 0x558dce6c4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:07:31.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.587+0000 7f689ffff700 1 --2- 172.21.15.82:0/1554175897 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558dce6c4c40 0x558dce6c50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:07:31.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.587+0000 7f689effd700 1 --2- 172.21.15.82:0/4050875173 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f68880a00c0 0x7f68880a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:07:31.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.587+0000 7f689ffff700 1 -- 172.21.15.82:0/1554175897 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558dce6c4c40 msgr2=0x558dce6c50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:07:31.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.587+0000 7f689ffff700 1 --2- 172.21.15.82:0/1554175897 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558dce6c4c40 0x558dce6c50a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:07:31.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.587+0000 7f689ffff700 1 -- 172.21.15.82:0/1554175897 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558dce6caca0 msgr2=0x558dce6c4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:07:31.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.587+0000 7f689ffff700 1 --2- 172.21.15.82:0/1554175897 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558dce6caca0 0x558dce6c4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:07:31.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.587+0000 7f689ffff700 1 -- 172.21.15.82:0/1554175897 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558dce496630 con 0x558dce6ca380 2023-09-23T09:07:31.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.588+0000 7f689ffff700 1 --2- 172.21.15.82:0/1554175897 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558dce6ca380 0x558dce6ca760 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6898008c60 tx=0x7f6898009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef8e94fab57707c5 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:07:31.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.588+0000 7f6885ffb700 1 -- 172.21.15.82:0/1554175897 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f689800e070 con 0x558dce6ca380 2023-09-23T09:07:31.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.588+0000 7f6885ffb700 1 -- 172.21.15.82:0/1554175897 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f689800f040 con 0x558dce6ca380 2023-09-23T09:07:31.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.588+0000 7f689effd700 1 --2- 172.21.15.82:0/4050875173 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f68880a00c0 0x7f68880a2580 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6894006010 tx=0x7f6894005960 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:07:31.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.588+0000 7f6885ffb700 1 -- 172.21.15.82:0/1554175897 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6898018af0 con 0x558dce6ca380 2023-09-23T09:07:31.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.589+0000 7f68b987fb80 1 -- 172.21.15.82:0/1554175897 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558dce6ca380 msgr2=0x558dce6ca760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:07:31.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.589+0000 7f68b987fb80 1 --2- 172.21.15.82:0/1554175897 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558dce6ca380 0x558dce6ca760 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6898008c60 tx=0x7f6898009920 comp rx=0 tx=0).stop 2023-09-23T09:07:31.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.589+0000 7f68b987fb80 1 -- 172.21.15.82:0/1554175897 shutdown_connections 2023-09-23T09:07:31.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.589+0000 7f68b987fb80 1 --2- 172.21.15.82:0/1554175897 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558dce6c4c40 0x558dce6c50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:07:31.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.589+0000 7f68b987fb80 1 --2- 172.21.15.82:0/1554175897 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558dce6ca380 0x558dce6ca760 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:07:31.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.589+0000 7f68b987fb80 1 --2- 172.21.15.82:0/1554175897 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558dce6caca0 0x558dce6c4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:07:31.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.589+0000 7f68b987fb80 1 -- 172.21.15.82:0/1554175897 >> 172.21.15.82:0/1554175897 conn(0x558dce6390e0 msgr2=0x558dce6bf410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:07:31.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.589+0000 7f68b987fb80 1 -- 172.21.15.82:0/1554175897 shutdown_connections 2023-09-23T09:07:31.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.589+0000 7f68b987fb80 1 -- 172.21.15.82:0/1554175897 wait complete. 2023-09-23T09:07:31.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.590+0000 7f68b987fb80 1 -- start start 2023-09-23T09:07:31.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.590+0000 7f68b987fb80 1 Processor -- start 2023-09-23T09:07:31.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.590+0000 7f68b987fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558dce6c4c40 0x558dce6d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:07:31.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.590+0000 7f68b987fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558dce6ca380 0x558dce6cded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:07:31.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.591+0000 7f68b987fb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558dce6caca0 0x558dce6ce610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:07:31.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.591+0000 7f68b987fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x558dce616990 con 0x558dce6ca380 2023-09-23T09:07:31.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.591+0000 7f68b987fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x558dce5b4bb0 con 0x558dce6c4c40 2023-09-23T09:07:31.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.591+0000 7f68b987fb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x558dce5b48b0 con 0x558dce6caca0 2023-09-23T09:07:31.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.591+0000 7f68b987fb80 10 client.0 _ll_register_callbacks cb 0x558dce4fea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:07:31.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.591+0000 7f689ffff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558dce6caca0 0x558dce6ce610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:07:31.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.591+0000 7f689ffff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558dce6caca0 0x558dce6ce610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:53830/0 (socket says 172.21.15.82:53830) 2023-09-23T09:07:31.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.591+0000 7f689ffff700 1 -- 172.21.15.82:0/190656250 learned_addr learned my addr 172.21.15.82:0/190656250 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:07:31.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.591+0000 7f689effd700 1 --2- 172.21.15.82:0/190656250 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558dce6ca380 0x558dce6cded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:07:31.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.591+0000 7f689ffff700 1 -- 172.21.15.82:0/190656250 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558dce6c4c40 msgr2=0x558dce6d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:07:31.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.591+0000 7f689ffff700 1 --2- 172.21.15.82:0/190656250 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558dce6c4c40 0x558dce6d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:07:31.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.591+0000 7f689ffff700 1 -- 172.21.15.82:0/190656250 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558dce6ca380 msgr2=0x558dce6cded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:07:31.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.591+0000 7f689ffff700 1 --2- 172.21.15.82:0/190656250 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558dce6ca380 0x558dce6cded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:07:31.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.591+0000 7f689ffff700 1 -- 172.21.15.82:0/190656250 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6898008910 con 0x558dce6caca0 2023-09-23T09:07:31.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.592+0000 7f689ffff700 1 --2- 172.21.15.82:0/190656250 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558dce6caca0 0x558dce6ce610 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6898009420 tx=0x7f68980088a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44ba6cba4387e8dc server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:07:31.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.592+0000 7f687effd700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T09:07:31.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.592+0000 7f687effd700 1 -- 172.21.15.82:0/190656250 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f689800e040 con 0x558dce6caca0 2023-09-23T09:07:31.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.592+0000 7f68b987fb80 1 -- 172.21.15.82:0/190656250 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558dce6941c0 con 0x558dce6caca0 2023-09-23T09:07:31.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.592+0000 7f687effd700 1 -- 172.21.15.82:0/190656250 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f6898004cd0 con 0x558dce6caca0 2023-09-23T09:07:31.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.592+0000 7f687effd700 1 -- 172.21.15.82:0/190656250 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6898006000 con 0x558dce6caca0 2023-09-23T09:07:31.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.592+0000 7f68b987fb80 10 client.26116 fetch_fsmap learned FSMap version 60 2023-09-23T09:07:31.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.592+0000 7f68b987fb80 1 -- 172.21.15.82:0/190656250 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) v3 -- 0x558dce442de0 con 0x558dce6caca0 2023-09-23T09:07:31.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.593+0000 7f687effd700 1 -- 172.21.15.82:0/190656250 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6898031020 con 0x558dce6caca0 2023-09-23T09:07:31.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.593+0000 7f687effd700 1 -- 172.21.15.82:0/190656250 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 60) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f6898004160 con 0x558dce6caca0 2023-09-23T09:07:31.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.593+0000 7f68b987fb80 10 client.26116 fetch_fsmap finished waiting for FSMap version 60 2023-09-23T09:07:31.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.593+0000 7f68b987fb80 10 client.26116 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:07:31.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.593+0000 7f68b987fb80 20 client.26116 populate_metadata read hostname 'smithi082' 2023-09-23T09:07:31.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.593+0000 7f68b987fb80 1 --2- 172.21.15.82:0/190656250 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x558dce6de510 0x558dce6e0930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:07:31.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.593+0000 7f68b987fb80 4 client.26116 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:07:31.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.593+0000 7f68b987fb80 1 -- 172.21.15.82:0/190656250 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558dce5bcba0 con 0x558dce6de510 2023-09-23T09:07:31.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.593+0000 7f689f7fe700 1 --2- 172.21.15.82:0/190656250 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x558dce6de510 0x558dce6e0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:07:31.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.594+0000 7f689f7fe700 1 --2- 172.21.15.82:0/190656250 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x558dce6de510 0x558dce6e0930 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4bf16088782d1574 server_cookie=c74e2a0e9c20f09e in_seq=0 out_seq=0 2023-09-23T09:07:31.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.594+0000 7f687effd700 10 client.26116 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:07:31.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.595+0000 7f687effd700 1 -- 172.21.15.82:0/190656250 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558dce5bcba0 con 0x558dce6de510 2023-09-23T09:07:31.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.595+0000 7f687effd700 10 client.26116 handle_command_reply: tid=0 2023-09-23T09:07:31.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.595+0000 7f68b987fb80 1 client.26116 shutdown 2023-09-23T09:07:31.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.595+0000 7f68b987fb80 1 -- 172.21.15.82:0/190656250 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558dce6caca0 msgr2=0x558dce6ce610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:07:31.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.595+0000 7f68b987fb80 1 --2- 172.21.15.82:0/190656250 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558dce6caca0 0x558dce6ce610 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6898009420 tx=0x7f68980088a0 comp rx=0 tx=0).stop 2023-09-23T09:07:31.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.595+0000 7f68b987fb80 1 -- 172.21.15.82:0/190656250 shutdown_connections 2023-09-23T09:07:31.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.595+0000 7f68b987fb80 1 --2- 172.21.15.82:0/190656250 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558dce6caca0 0x558dce6ce610 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:07:31.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.595+0000 7f68b987fb80 1 --2- 172.21.15.82:0/190656250 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558dce6c4c40 0x558dce6d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:07:31.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.595+0000 7f68b987fb80 1 --2- 172.21.15.82:0/190656250 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x558dce6de510 0x558dce6e0930 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:07:31.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.595+0000 7f68b987fb80 1 --2- 172.21.15.82:0/190656250 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558dce6ca380 0x558dce6cded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:07:31.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.595+0000 7f68b987fb80 1 -- 172.21.15.82:0/190656250 >> 172.21.15.82:0/190656250 conn(0x558dce6390e0 msgr2=0x558dce6b9b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:07:31.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.595+0000 7f687effd700 0 client.26116 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:07:31.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.595+0000 7f68b987fb80 1 -- 172.21.15.82:0/190656250 shutdown_connections 2023-09-23T09:07:31.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.595+0000 7f68b987fb80 1 -- 172.21.15.82:0/190656250 wait complete. 2023-09-23T09:07:31.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.595+0000 7f68b987fb80 20 client.26116 trim_cache size 0 max 16384 2023-09-23T09:07:31.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.617+0000 7f68b987fb80 1 Processor -- start 2023-09-23T09:07:31.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.618+0000 7f68b987fb80 1 -- start start 2023-09-23T09:07:31.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.618+0000 7f68b987fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558dce6c4c40 0x558dce6d07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:07:31.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.618+0000 7f68b987fb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558dce6ca380 0x558dce6c8090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:07:31.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.618+0000 7f68b987fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558dce6caca0 0x558dce6c85d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:07:31.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.618+0000 7f68b987fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x558dce498920 con 0x558dce6caca0 2023-09-23T09:07:31.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.618+0000 7f68b987fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x558dce6bbc80 con 0x558dce6c4c40 2023-09-23T09:07:31.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.618+0000 7f68b987fb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x558dce6bb810 con 0x558dce6ca380 2023-09-23T09:07:31.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.618+0000 7f689effd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558dce6ca380 0x558dce6c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:07:31.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.618+0000 7f689ffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558dce6caca0 0x558dce6c85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:07:31.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.618+0000 7f689f7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558dce6c4c40 0x558dce6d07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:07:31.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.618+0000 7f689f7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558dce6c4c40 0x558dce6d07f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:56802/0 (socket says 172.21.15.82:56802) 2023-09-23T09:07:31.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.618+0000 7f689effd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558dce6ca380 0x558dce6c8090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:53836/0 (socket says 172.21.15.82:53836) 2023-09-23T09:07:31.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.618+0000 7f689f7fe700 1 -- 172.21.15.82:0/878962717 learned_addr learned my addr 172.21.15.82:0/878962717 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:07:31.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.619+0000 7f689f7fe700 1 -- 172.21.15.82:0/878962717 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558dce6ca380 msgr2=0x558dce6c8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:07:31.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.619+0000 7f689f7fe700 1 --2- 172.21.15.82:0/878962717 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558dce6ca380 0x558dce6c8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:07:31.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.619+0000 7f689f7fe700 1 -- 172.21.15.82:0/878962717 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558dce6caca0 msgr2=0x558dce6c85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:07:31.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.619+0000 7f689f7fe700 1 --2- 172.21.15.82:0/878962717 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558dce6caca0 0x558dce6c85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:07:31.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.619+0000 7f689f7fe700 1 -- 172.21.15.82:0/878962717 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558dce42bc60 con 0x558dce6c4c40 2023-09-23T09:07:31.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.619+0000 7f689f7fe700 1 --2- 172.21.15.82:0/878962717 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558dce6c4c40 0x558dce6d07f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f68900c8f20 tx=0x7f689000c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1aa93b6fce55db60 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:07:31.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.619+0000 7f68867fc700 1 -- 172.21.15.82:0/878962717 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f689009ccb0 con 0x558dce6c4c40 2023-09-23T09:07:31.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.619+0000 7f68867fc700 1 -- 172.21.15.82:0/878962717 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6890099e90 con 0x558dce6c4c40 2023-09-23T09:07:31.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.619+0000 7f68867fc700 1 -- 172.21.15.82:0/878962717 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6890099340 con 0x558dce6c4c40 2023-09-23T09:07:31.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.620+0000 7f68b987fb80 1 -- 172.21.15.82:0/878962717 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558dce6c4c40 msgr2=0x558dce6d07f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:07:31.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.620+0000 7f68b987fb80 1 --2- 172.21.15.82:0/878962717 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558dce6c4c40 0x558dce6d07f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f68900c8f20 tx=0x7f689000c480 comp rx=0 tx=0).stop 2023-09-23T09:07:31.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.620+0000 7f68b987fb80 1 -- 172.21.15.82:0/878962717 shutdown_connections 2023-09-23T09:07:31.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.620+0000 7f68b987fb80 1 --2- 172.21.15.82:0/878962717 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558dce6caca0 0x558dce6c85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:07:31.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.620+0000 7f68b987fb80 1 --2- 172.21.15.82:0/878962717 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558dce6c4c40 0x558dce6d07f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:07:31.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.620+0000 7f68b987fb80 1 --2- 172.21.15.82:0/878962717 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558dce6ca380 0x558dce6c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:07:31.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.620+0000 7f68b987fb80 1 -- 172.21.15.82:0/878962717 >> 172.21.15.82:0/878962717 conn(0x558dce6390e0 msgr2=0x558dce6daa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:07:31.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.620+0000 7f68b987fb80 1 -- 172.21.15.82:0/878962717 shutdown_connections 2023-09-23T09:07:31.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.620+0000 7f68b987fb80 1 -- 172.21.15.82:0/878962717 wait complete. 2023-09-23T09:07:31.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.621+0000 7f68b987fb80 1 -- start start 2023-09-23T09:07:31.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.621+0000 7f68b987fb80 1 Processor -- start 2023-09-23T09:07:31.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.622+0000 7f68b987fb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558dce6c4c40 0x558dce6d57a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:07:31.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.622+0000 7f68b987fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558dce6ca380 0x558dce6c6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:07:31.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.622+0000 7f68b987fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558dce6caca0 0x558dce6c6580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:07:31.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.622+0000 7f68b987fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x558dce6c6c50 con 0x558dce6ca380 2023-09-23T09:07:31.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.622+0000 7f68b987fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x558dce6c6dc0 con 0x558dce6caca0 2023-09-23T09:07:31.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.622+0000 7f68b987fb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x558dce732340 con 0x558dce6c4c40 2023-09-23T09:07:31.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.622+0000 7f68b987fb80 10 client.0 _ll_register_callbacks cb 0x7f68900951c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:07:31.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.622+0000 7f689effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558dce6ca380 0x558dce6c6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:07:31.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.622+0000 7f689f7fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558dce6c4c40 0x558dce6d57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:07:31.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.622+0000 7f689effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558dce6ca380 0x558dce6c6040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47150/0 (socket says 172.21.15.82:47150) 2023-09-23T09:07:31.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.622+0000 7f689effd700 1 -- 172.21.15.82:0/3001607268 learned_addr learned my addr 172.21.15.82:0/3001607268 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:07:31.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.622+0000 7f689ffff700 1 --2- 172.21.15.82:0/3001607268 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558dce6caca0 0x558dce6c6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:07:31.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.622+0000 7f689effd700 1 -- 172.21.15.82:0/3001607268 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558dce6c4c40 msgr2=0x558dce6d57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:07:31.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.622+0000 7f689effd700 1 --2- 172.21.15.82:0/3001607268 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558dce6c4c40 0x558dce6d57a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:07:31.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.622+0000 7f689effd700 1 -- 172.21.15.82:0/3001607268 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558dce6caca0 msgr2=0x558dce6c6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:07:31.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.622+0000 7f689effd700 1 --2- 172.21.15.82:0/3001607268 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558dce6caca0 0x558dce6c6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:07:31.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.622+0000 7f689effd700 1 -- 172.21.15.82:0/3001607268 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68900b6e70 con 0x558dce6ca380 2023-09-23T09:07:31.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.622+0000 7f689f7fe700 1 --2- 172.21.15.82:0/3001607268 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558dce6c4c40 0x558dce6d57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:07:31.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.623+0000 7f689effd700 1 --2- 172.21.15.82:0/3001607268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558dce6ca380 0x558dce6c6040 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f68940098e0 tx=0x7f6894009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27f114546917ca32 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:07:31.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.623+0000 7f687effd700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:07:31.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.623+0000 7f687effd700 1 -- 172.21.15.82:0/3001607268 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f689400be80 con 0x558dce6ca380 2023-09-23T09:07:31.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.623+0000 7f68b987fb80 1 -- 172.21.15.82:0/3001607268 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558dce6b78b0 con 0x558dce6ca380 2023-09-23T09:07:31.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.623+0000 7f687effd700 1 -- 172.21.15.82:0/3001607268 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f6894004e40 con 0x558dce6ca380 2023-09-23T09:07:31.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.623+0000 7f687effd700 1 -- 172.21.15.82:0/3001607268 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7f689400f670 con 0x558dce6ca380 2023-09-23T09:07:31.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.623+0000 7f68b987fb80 10 client.16392 fetch_fsmap learned FSMap version 60 2023-09-23T09:07:31.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.623+0000 7f68b987fb80 1 -- 172.21.15.82:0/3001607268 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) v3 -- 0x558dce469250 con 0x558dce6ca380 2023-09-23T09:07:31.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.624+0000 7f687effd700 1 -- 172.21.15.82:0/3001607268 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x558dce6b78b0 con 0x558dce6ca380 2023-09-23T09:07:31.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.624+0000 7f687effd700 1 -- 172.21.15.82:0/3001607268 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 60) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f689402f070 con 0x558dce6ca380 2023-09-23T09:07:31.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.624+0000 7f68b987fb80 10 client.16392 fetch_fsmap finished waiting for FSMap version 60 2023-09-23T09:07:31.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.624+0000 7f68b987fb80 10 client.16392 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:07:31.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.624+0000 7f68b987fb80 20 client.16392 populate_metadata read hostname 'smithi082' 2023-09-23T09:07:31.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.624+0000 7f68b987fb80 1 --2- 172.21.15.82:0/3001607268 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x558dce733a00 0x558dce735e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:07:31.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.624+0000 7f68b987fb80 4 client.16392 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:07:31.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.624+0000 7f68b987fb80 1 -- 172.21.15.82:0/3001607268 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x558dce60f970 con 0x558dce733a00 2023-09-23T09:07:31.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.624+0000 7f689f7fe700 1 --2- 172.21.15.82:0/3001607268 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x558dce733a00 0x558dce735e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:07:31.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.625+0000 7f687effd700 10 client.16392 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:07:31.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.625+0000 7f689f7fe700 1 --2- 172.21.15.82:0/3001607268 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x558dce733a00 0x558dce735e20 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=694daf6231358c96 server_cookie=700fe2f705bdbb97 in_seq=0 out_seq=0 2023-09-23T09:07:31.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.625+0000 7f687effd700 1 -- 172.21.15.82:0/3001607268 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x558dce60f970 con 0x558dce733a00 2023-09-23T09:07:31.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.625+0000 7f687effd700 10 client.16392 handle_command_reply: tid=0 2023-09-23T09:07:31.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.625+0000 7f68b987fb80 1 client.16392 shutdown 2023-09-23T09:07:31.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.625+0000 7f68b987fb80 1 -- 172.21.15.82:0/3001607268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558dce6ca380 msgr2=0x558dce6c6040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:07:31.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.625+0000 7f68b987fb80 1 --2- 172.21.15.82:0/3001607268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558dce6ca380 0x558dce6c6040 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f68940098e0 tx=0x7f6894009ca0 comp rx=0 tx=0).stop 2023-09-23T09:07:31.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.625+0000 7f68b987fb80 1 -- 172.21.15.82:0/3001607268 shutdown_connections 2023-09-23T09:07:31.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.625+0000 7f68b987fb80 1 --2- 172.21.15.82:0/3001607268 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558dce6caca0 0x558dce6c6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:07:31.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.625+0000 7f68b987fb80 1 --2- 172.21.15.82:0/3001607268 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558dce6c4c40 0x558dce6d57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:07:31.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.625+0000 7f68b987fb80 1 --2- 172.21.15.82:0/3001607268 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x558dce733a00 0x558dce735e20 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:07:31.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.625+0000 7f68b987fb80 1 --2- 172.21.15.82:0/3001607268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558dce6ca380 0x558dce6c6040 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:07:31.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.625+0000 7f68b987fb80 1 -- 172.21.15.82:0/3001607268 >> 172.21.15.82:0/3001607268 conn(0x558dce6390e0 msgr2=0x558dce6c8090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:07:31.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.625+0000 7f687effd700 0 client.16392 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:07:31.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.626+0000 7f68b987fb80 1 -- 172.21.15.82:0/3001607268 shutdown_connections 2023-09-23T09:07:31.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.626+0000 7f68b987fb80 1 -- 172.21.15.82:0/3001607268 wait complete. 2023-09-23T09:07:31.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.626+0000 7f68b987fb80 20 client.16392 trim_cache size 0 max 16384 2023-09-23T09:07:31.633 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:07:31.633 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "IDLE (waiting for more scrubs)", 2023-09-23T09:07:31.633 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:07:31.633 INFO:teuthology.orchestra.run.smithi082.stdout: "cba46b77-20dd-437c-a60a-ac01b400e1b8": { 2023-09-23T09:07:31.633 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:07:31.633 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "cba46b77-20dd-437c-a60a-ac01b400e1b8", 2023-09-23T09:07:31.633 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:07:31.633 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:07:31.633 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:07:31.633 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:07:31.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.626+0000 7f68a5fff700 1 -- 172.21.15.82:0/4050875173 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f68880a00c0 msgr2=0x7f68880a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:07:31.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.626+0000 7f68a5fff700 1 --2- 172.21.15.82:0/4050875173 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f68880a00c0 0x7f68880a2580 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6894006010 tx=0x7f6894005960 comp rx=0 tx=0).stop 2023-09-23T09:07:31.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.626+0000 7f68a5fff700 1 -- 172.21.15.82:0/4050875173 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68a0100870 msgr2=0x7f68a019e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:07:31.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.626+0000 7f68a5fff700 1 --2- 172.21.15.82:0/4050875173 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68a0100870 0x7f68a019e840 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f689000e9a0 tx=0x7f689000ecb0 comp rx=0 tx=0).stop 2023-09-23T09:07:31.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.627+0000 7f68a5fff700 1 -- 172.21.15.82:0/4050875173 shutdown_connections 2023-09-23T09:07:31.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.627+0000 7f68a5fff700 1 --2- 172.21.15.82:0/4050875173 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f68880a00c0 0x7f68880a2580 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:07:31.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.627+0000 7f68a5fff700 1 --2- 172.21.15.82:0/4050875173 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68a0106880 0x7f68a01988b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:07:31.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.627+0000 7f68a5fff700 1 --2- 172.21.15.82:0/4050875173 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68a0100870 0x7f68a019e840 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:07:31.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.627+0000 7f68a5fff700 1 --2- 172.21.15.82:0/4050875173 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68a0101230 0x7f68a019ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:07:31.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.627+0000 7f68a5fff700 1 -- 172.21.15.82:0/4050875173 >> 172.21.15.82:0/4050875173 conn(0x7f68a00fc3a0 msgr2=0x7f68a010bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:07:31.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.627+0000 7f68a5fff700 1 -- 172.21.15.82:0/4050875173 shutdown_connections 2023-09-23T09:07:31.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:07:31.627+0000 7f68a5fff700 1 -- 172.21.15.82:0/4050875173 wait complete. 2023-09-23T09:07:31.648 INFO:tasks.cephfs.filesystem:scrub status for tag:cba46b77-20dd-437c-a60a-ac01b400e1b8 - {'path': '/', 'tag': 'cba46b77-20dd-437c-a60a-ac01b400e1b8', 'options': 'recursive,force'} 2023-09-23T09:07:33.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:07:32 smithi135 ceph-mon[99205]: pgmap v330: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 869 KiB/s rd, 3.0 MiB/s wr, 314 op/s 2023-09-23T09:07:33.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:07:32 smithi082 ceph-mon[97694]: pgmap v330: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 869 KiB/s rd, 3.0 MiB/s wr, 314 op/s 2023-09-23T09:07:33.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:07:32 smithi161 ceph-mon[99580]: pgmap v330: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 869 KiB/s rd, 3.0 MiB/s wr, 314 op/s 2023-09-23T09:07:35.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:07:34 smithi135 ceph-mon[99205]: pgmap v331: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 869 KiB/s rd, 3.0 MiB/s wr, 314 op/s 2023-09-23T09:07:35.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:07:34 smithi082 ceph-mon[97694]: pgmap v331: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 869 KiB/s rd, 3.0 MiB/s wr, 314 op/s 2023-09-23T09:07:35.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:07:34 smithi161 ceph-mon[99580]: pgmap v331: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 869 KiB/s rd, 3.0 MiB/s wr, 314 op/s 2023-09-23T09:07:37.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:07:36 smithi135 ceph-mon[99205]: pgmap v332: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.5 MiB/s wr, 460 op/s 2023-09-23T09:07:37.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:07:36 smithi082 ceph-mon[97694]: pgmap v332: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.5 MiB/s wr, 460 op/s 2023-09-23T09:07:37.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:07:36 smithi161 ceph-mon[99580]: pgmap v332: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.5 MiB/s wr, 460 op/s 2023-09-23T09:07:39.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:07:38 smithi135 ceph-mon[99205]: pgmap v333: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 858 KiB/s rd, 3.0 MiB/s wr, 304 op/s 2023-09-23T09:07:39.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:07:38 smithi082 ceph-mon[97694]: pgmap v333: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 858 KiB/s rd, 3.0 MiB/s wr, 304 op/s 2023-09-23T09:07:39.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:07:38 smithi161 ceph-mon[99580]: pgmap v333: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 858 KiB/s rd, 3.0 MiB/s wr, 304 op/s 2023-09-23T09:07:41.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:07:40 smithi135 ceph-mon[99205]: pgmap v334: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.5 MiB/s wr, 463 op/s 2023-09-23T09:07:41.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:07:40 smithi082 ceph-mon[97694]: pgmap v334: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.5 MiB/s wr, 463 op/s 2023-09-23T09:07:41.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:07:40 smithi161 ceph-mon[99580]: pgmap v334: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.5 MiB/s wr, 463 op/s 2023-09-23T09:07:43.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:07:42 smithi135 ceph-mon[99205]: pgmap v335: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 842 KiB/s rd, 3.0 MiB/s wr, 305 op/s 2023-09-23T09:07:43.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:07:42 smithi082 ceph-mon[97694]: pgmap v335: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 842 KiB/s rd, 3.0 MiB/s wr, 305 op/s 2023-09-23T09:07:43.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:07:42 smithi161 ceph-mon[99580]: pgmap v335: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 842 KiB/s rd, 3.0 MiB/s wr, 305 op/s 2023-09-23T09:07:43.925 INFO:teuthology.orchestra.run.smithi082.stderr:37900000 of 50000000 tuples (75%) done (elapsed 618.67 s, remaining 197.52 s) 2023-09-23T09:07:45.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:07:44 smithi135 ceph-mon[99205]: pgmap v336: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 842 KiB/s rd, 3.0 MiB/s wr, 305 op/s 2023-09-23T09:07:45.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:07:44 smithi082 ceph-mon[97694]: pgmap v336: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 842 KiB/s rd, 3.0 MiB/s wr, 305 op/s 2023-09-23T09:07:45.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:07:44 smithi161 ceph-mon[99580]: pgmap v336: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 842 KiB/s rd, 3.0 MiB/s wr, 305 op/s 2023-09-23T09:07:47.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:07:46 smithi135 ceph-mon[99205]: pgmap v337: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.5 MiB/s wr, 460 op/s 2023-09-23T09:07:47.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:07:46 smithi082 ceph-mon[97694]: pgmap v337: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.5 MiB/s wr, 460 op/s 2023-09-23T09:07:47.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:07:46 smithi161 ceph-mon[99580]: pgmap v337: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.5 MiB/s wr, 460 op/s 2023-09-23T09:07:49.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:07:48 smithi135 ceph-mon[99205]: pgmap v338: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 860 KiB/s rd, 3.0 MiB/s wr, 313 op/s 2023-09-23T09:07:49.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:07:48 smithi082 ceph-mon[97694]: pgmap v338: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 860 KiB/s rd, 3.0 MiB/s wr, 313 op/s 2023-09-23T09:07:49.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:07:48 smithi161 ceph-mon[99580]: pgmap v338: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 860 KiB/s rd, 3.0 MiB/s wr, 313 op/s 2023-09-23T09:07:50.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:07:49 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:07:50.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:07:49 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:07:50.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:07:49 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:07:51.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:07:50 smithi135 ceph-mon[99205]: pgmap v339: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.4 MiB/s wr, 459 op/s 2023-09-23T09:07:51.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:07:50 smithi082 ceph-mon[97694]: pgmap v339: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.4 MiB/s wr, 459 op/s 2023-09-23T09:07:51.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:07:50 smithi161 ceph-mon[99580]: pgmap v339: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.4 MiB/s wr, 459 op/s 2023-09-23T09:07:53.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:07:52 smithi135 ceph-mon[99205]: pgmap v340: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 824 KiB/s rd, 2.9 MiB/s wr, 299 op/s 2023-09-23T09:07:53.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:07:52 smithi082 ceph-mon[97694]: pgmap v340: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 824 KiB/s rd, 2.9 MiB/s wr, 299 op/s 2023-09-23T09:07:53.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:07:52 smithi161 ceph-mon[99580]: pgmap v340: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 824 KiB/s rd, 2.9 MiB/s wr, 299 op/s 2023-09-23T09:07:55.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:07:54 smithi135 ceph-mon[99205]: pgmap v341: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 824 KiB/s rd, 2.9 MiB/s wr, 299 op/s 2023-09-23T09:07:55.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:07:54 smithi082 ceph-mon[97694]: pgmap v341: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 824 KiB/s rd, 2.9 MiB/s wr, 299 op/s 2023-09-23T09:07:55.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:07:54 smithi161 ceph-mon[99580]: pgmap v341: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 824 KiB/s rd, 2.9 MiB/s wr, 299 op/s 2023-09-23T09:07:57.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:07:56 smithi135 ceph-mon[99205]: pgmap v342: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.3 MiB/s wr, 451 op/s 2023-09-23T09:07:57.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:07:56 smithi082 ceph-mon[97694]: pgmap v342: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.3 MiB/s wr, 451 op/s 2023-09-23T09:07:57.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:07:56 smithi161 ceph-mon[99580]: pgmap v342: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.3 MiB/s wr, 451 op/s 2023-09-23T09:07:58.182 INFO:teuthology.orchestra.run.smithi082.stderr:38000000 of 50000000 tuples (76%) done (elapsed 632.92 s, remaining 199.87 s) 2023-09-23T09:07:59.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:07:58 smithi135 ceph-mon[99205]: pgmap v343: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 806 KiB/s rd, 2.8 MiB/s wr, 297 op/s 2023-09-23T09:07:59.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:07:58 smithi082 ceph-mon[97694]: pgmap v343: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 806 KiB/s rd, 2.8 MiB/s wr, 297 op/s 2023-09-23T09:07:59.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:07:58 smithi161 ceph-mon[99580]: pgmap v343: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 806 KiB/s rd, 2.8 MiB/s wr, 297 op/s 2023-09-23T09:08:01.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:08:00 smithi135 ceph-mon[99205]: pgmap v344: 97 pgs: 97 active+clean; 8.5 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.3 MiB/s wr, 451 op/s 2023-09-23T09:08:01.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:08:00 smithi082 ceph-mon[97694]: pgmap v344: 97 pgs: 97 active+clean; 8.5 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.3 MiB/s wr, 451 op/s 2023-09-23T09:08:01.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:08:00 smithi161 ceph-mon[99580]: pgmap v344: 97 pgs: 97 active+clean; 8.5 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.3 MiB/s wr, 451 op/s 2023-09-23T09:08:01.650 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:08:01.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.873+0000 7fe9bc9fe700 1 -- 172.21.15.82:0/1807289723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9b8100710 msgr2=0x7fe9b8100b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:08:01.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.873+0000 7fe9bc9fe700 1 --2- 172.21.15.82:0/1807289723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9b8100710 0x7fe9b8100b90 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac009990 tx=0x7fe9ac009ca0 comp rx=0 tx=0).stop 2023-09-23T09:08:01.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.873+0000 7fe9bc9fe700 1 -- 172.21.15.82:0/1807289723 shutdown_connections 2023-09-23T09:08:01.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.873+0000 7fe9bc9fe700 1 --2- 172.21.15.82:0/1807289723 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9b81010d0 0x7fe9b810d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:08:01.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.873+0000 7fe9bc9fe700 1 --2- 172.21.15.82:0/1807289723 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe9b8106720 0x7fe9b8106b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:08:01.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.873+0000 7fe9bc9fe700 1 --2- 172.21.15.82:0/1807289723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9b8100710 0x7fe9b8100b90 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:08:01.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.873+0000 7fe9bc9fe700 1 -- 172.21.15.82:0/1807289723 >> 172.21.15.82:0/1807289723 conn(0x7fe9b80fc1e0 msgr2=0x7fe9b80fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:08:01.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.873+0000 7fe9bc9fe700 1 -- 172.21.15.82:0/1807289723 shutdown_connections 2023-09-23T09:08:01.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.873+0000 7fe9bc9fe700 1 -- 172.21.15.82:0/1807289723 wait complete. 2023-09-23T09:08:01.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.874+0000 7fe9bc9fe700 1 Processor -- start 2023-09-23T09:08:01.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.874+0000 7fe9bc9fe700 1 -- start start 2023-09-23T09:08:01.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.875+0000 7fe9bc9fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9b8100710 0x7fe9b819e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:08:01.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.875+0000 7fe9bc9fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9b81010d0 0x7fe9b819ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:08:01.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.875+0000 7fe9bc9fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe9b8106720 0x7fe9b81985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:08:01.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.875+0000 7fe9bc9fe700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b8198c10 con 0x7fe9b81010d0 2023-09-23T09:08:01.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.875+0000 7fe9bc9fe700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b8198d80 con 0x7fe9b8100710 2023-09-23T09:08:01.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.875+0000 7fe9bc9fe700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b8198f40 con 0x7fe9b8106720 2023-09-23T09:08:01.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.875+0000 7fe9b6d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9b8100710 0x7fe9b819e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:08:01.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.875+0000 7fe9b659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9b81010d0 0x7fe9b819ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:08:01.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.875+0000 7fe9b6d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9b8100710 0x7fe9b819e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:58980/0 (socket says 172.21.15.82:58980) 2023-09-23T09:08:01.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.875+0000 7fe9b6d9d700 1 -- 172.21.15.82:0/3151160005 learned_addr learned my addr 172.21.15.82:0/3151160005 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:08:01.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.875+0000 7fe9b759e700 1 --2- 172.21.15.82:0/3151160005 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe9b8106720 0x7fe9b81985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:08:01.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.876+0000 7fe9b6d9d700 1 -- 172.21.15.82:0/3151160005 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe9b8106720 msgr2=0x7fe9b81985a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:08:01.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.876+0000 7fe9b6d9d700 1 --2- 172.21.15.82:0/3151160005 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe9b8106720 0x7fe9b81985a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:08:01.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.876+0000 7fe9b6d9d700 1 -- 172.21.15.82:0/3151160005 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9b81010d0 msgr2=0x7fe9b819ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:08:01.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.876+0000 7fe9b6d9d700 1 --2- 172.21.15.82:0/3151160005 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9b81010d0 0x7fe9b819ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:08:01.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.876+0000 7fe9b6d9d700 1 -- 172.21.15.82:0/3151160005 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9ac0095f0 con 0x7fe9b8100710 2023-09-23T09:08:01.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.876+0000 7fe9b659c700 1 --2- 172.21.15.82:0/3151160005 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9b81010d0 0x7fe9b819ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:08:01.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.876+0000 7fe9b6d9d700 1 --2- 172.21.15.82:0/3151160005 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9b8100710 0x7fe9b819e530 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe9a800e9a0 tx=0x7fe9a800ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:08:01.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.876+0000 7fe99ffff700 1 -- 172.21.15.82:0/3151160005 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9a8009790 con 0x7fe9b8100710 2023-09-23T09:08:01.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.876+0000 7fe99ffff700 1 -- 172.21.15.82:0/3151160005 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe9a8010430 con 0x7fe9b8100710 2023-09-23T09:08:01.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.876+0000 7fe9bc9fe700 1 -- 172.21.15.82:0/3151160005 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9b8199220 con 0x7fe9b8100710 2023-09-23T09:08:01.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.876+0000 7fe99ffff700 1 -- 172.21.15.82:0/3151160005 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9a800cea0 con 0x7fe9b8100710 2023-09-23T09:08:01.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.876+0000 7fe9bc9fe700 1 -- 172.21.15.82:0/3151160005 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9b81a5520 con 0x7fe9b8100710 2023-09-23T09:08:01.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.880+0000 7fe99ffff700 1 -- 172.21.15.82:0/3151160005 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7fe9a80105a0 con 0x7fe9b8100710 2023-09-23T09:08:01.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.882+0000 7fe9d0be0b80 1 Processor -- start 2023-09-23T09:08:01.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.882+0000 7fe99ffff700 1 --2- 172.21.15.82:0/3151160005 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fe9a00a0160 0x7fe9a00a2620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:08:01.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.882+0000 7fe9d0be0b80 1 -- start start 2023-09-23T09:08:01.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.882+0000 7fe99ffff700 1 -- 172.21.15.82:0/3151160005 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fe9a8014070 con 0x7fe9b8100710 2023-09-23T09:08:01.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.882+0000 7fe9d0be0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a4db80500 0x562a4db808e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:08:01.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.882+0000 7fe9d0be0b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562a4db80e20 0x562a4db7a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:08:01.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.882+0000 7fe9d0be0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a4db7ac40 0x562a4db7b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:08:01.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.882+0000 7fe9d0be0b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a4dae27b0 con 0x562a4db7ac40 2023-09-23T09:08:01.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.882+0000 7fe9d0be0b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a4dad3780 con 0x562a4db80500 2023-09-23T09:08:01.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.882+0000 7fe9d0be0b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a4dad10a0 con 0x562a4db80e20 2023-09-23T09:08:01.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.883+0000 7fe9b759e700 1 --2- 172.21.15.82:0/3151160005 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fe9a00a0160 0x7fe9a00a2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:08:01.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.883+0000 7fe9b6d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a4db80500 0x562a4db808e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:08:01.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.883+0000 7fe9b6d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a4db80500 0x562a4db808e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:58992/0 (socket says 172.21.15.82:58992) 2023-09-23T09:08:01.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.883+0000 7fe9b6d9d700 1 -- 172.21.15.82:0/4111003345 learned_addr learned my addr 172.21.15.82:0/4111003345 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:08:01.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.883+0000 7fe9b659c700 1 --2- 172.21.15.82:0/4111003345 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562a4db80e20 0x562a4db7a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:08:01.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.883+0000 7fe9b759e700 1 --2- 172.21.15.82:0/4111003345 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a4db7ac40 0x562a4db7b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:08:01.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.883+0000 7fe9b6d9d700 1 -- 172.21.15.82:0/4111003345 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562a4db80e20 msgr2=0x562a4db7a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:08:01.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.883+0000 7fe9b6d9d700 1 --2- 172.21.15.82:0/4111003345 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562a4db80e20 0x562a4db7a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:08:01.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.883+0000 7fe9b6d9d700 1 -- 172.21.15.82:0/4111003345 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a4db7ac40 msgr2=0x562a4db7b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:08:01.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.883+0000 7fe9b6d9d700 1 --2- 172.21.15.82:0/4111003345 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a4db7ac40 0x562a4db7b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:08:01.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.883+0000 7fe9b6d9d700 1 -- 172.21.15.82:0/4111003345 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562a4d94c630 con 0x562a4db80500 2023-09-23T09:08:01.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.884+0000 7fe9b759e700 1 --2- 172.21.15.82:0/3151160005 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fe9a00a0160 0x7fe9a00a2620 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe9b819f230 tx=0x7fe9b0011be0 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:08:01.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.884+0000 7fe9b6d9d700 1 --2- 172.21.15.82:0/4111003345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a4db80500 0x562a4db808e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe9a80a0750 tx=0x7fe9a8098ac0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7aa74ee091bb7473 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:08:01.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.884+0000 7fe99d7fa700 1 -- 172.21.15.82:0/4111003345 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9a809cca0 con 0x562a4db80500 2023-09-23T09:08:01.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.884+0000 7fe99d7fa700 1 -- 172.21.15.82:0/4111003345 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe9a80a0c80 con 0x562a4db80500 2023-09-23T09:08:01.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.884+0000 7fe99d7fa700 1 -- 172.21.15.82:0/4111003345 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9a80985c0 con 0x562a4db80500 2023-09-23T09:08:01.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.885+0000 7fe9d0be0b80 1 -- 172.21.15.82:0/4111003345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a4db80500 msgr2=0x562a4db808e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:08:01.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.885+0000 7fe9d0be0b80 1 --2- 172.21.15.82:0/4111003345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a4db80500 0x562a4db808e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe9a80a0750 tx=0x7fe9a8098ac0 comp rx=0 tx=0).stop 2023-09-23T09:08:01.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.885+0000 7fe9d0be0b80 1 -- 172.21.15.82:0/4111003345 shutdown_connections 2023-09-23T09:08:01.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.885+0000 7fe9d0be0b80 1 --2- 172.21.15.82:0/4111003345 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a4db7ac40 0x562a4db7b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:08:01.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.885+0000 7fe9d0be0b80 1 --2- 172.21.15.82:0/4111003345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a4db80500 0x562a4db808e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:08:01.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.885+0000 7fe9d0be0b80 1 --2- 172.21.15.82:0/4111003345 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562a4db80e20 0x562a4db7a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:08:01.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.885+0000 7fe9d0be0b80 1 -- 172.21.15.82:0/4111003345 >> 172.21.15.82:0/4111003345 conn(0x562a4daef0e0 msgr2=0x562a4db75940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:08:01.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.885+0000 7fe9d0be0b80 1 -- 172.21.15.82:0/4111003345 shutdown_connections 2023-09-23T09:08:01.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.885+0000 7fe9d0be0b80 1 -- 172.21.15.82:0/4111003345 wait complete. 2023-09-23T09:08:01.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.886+0000 7fe9d0be0b80 1 -- start start 2023-09-23T09:08:01.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.886+0000 7fe9d0be0b80 1 Processor -- start 2023-09-23T09:08:01.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.886+0000 7fe9d0be0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a4db7ac40 0x562a4db86df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:08:01.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.886+0000 7fe9d0be0b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562a4db80500 0x562a4db840e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:08:01.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.886+0000 7fe9d0be0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a4db80e20 0x562a4db84820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:08:01.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.886+0000 7fe9d0be0b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a4dacc990 con 0x562a4db80e20 2023-09-23T09:08:01.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.886+0000 7fe9d0be0b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a4da6abb0 con 0x562a4db7ac40 2023-09-23T09:08:01.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.886+0000 7fe9d0be0b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a4da6a8b0 con 0x562a4db80500 2023-09-23T09:08:01.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.886+0000 7fe9d0be0b80 10 client.0 _ll_register_callbacks cb 0x562a4d9b4a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:08:01.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.887+0000 7fe9b6d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a4db7ac40 0x562a4db86df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:08:01.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.887+0000 7fe9b6d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a4db7ac40 0x562a4db86df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:59008/0 (socket says 172.21.15.82:59008) 2023-09-23T09:08:01.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.887+0000 7fe9b6d9d700 1 -- 172.21.15.82:0/4244115905 learned_addr learned my addr 172.21.15.82:0/4244115905 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:08:01.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.887+0000 7fe9b659c700 1 --2- 172.21.15.82:0/4244115905 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562a4db80500 0x562a4db840e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:08:01.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.887+0000 7fe9b759e700 1 --2- 172.21.15.82:0/4244115905 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a4db80e20 0x562a4db84820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:08:01.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.887+0000 7fe9b6d9d700 1 -- 172.21.15.82:0/4244115905 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562a4db80500 msgr2=0x562a4db840e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:08:01.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.887+0000 7fe9b6d9d700 1 --2- 172.21.15.82:0/4244115905 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562a4db80500 0x562a4db840e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:08:01.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.887+0000 7fe9b6d9d700 1 -- 172.21.15.82:0/4244115905 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a4db80e20 msgr2=0x562a4db84820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:08:01.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.887+0000 7fe9b6d9d700 1 --2- 172.21.15.82:0/4244115905 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a4db80e20 0x562a4db84820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:08:01.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.887+0000 7fe9b6d9d700 1 -- 172.21.15.82:0/4244115905 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9b81a5520 con 0x562a4db7ac40 2023-09-23T09:08:01.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.887+0000 7fe9b6d9d700 1 --2- 172.21.15.82:0/4244115905 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a4db7ac40 0x562a4db86df0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe9a8009230 tx=0x7fe9a8099360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14101a158a00e0f2 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:08:01.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.887+0000 7fe99aff5700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-09-23T09:08:01.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.887+0000 7fe99aff5700 1 -- 172.21.15.82:0/4244115905 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9a80a0c80 con 0x562a4db7ac40 2023-09-23T09:08:01.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.888+0000 7fe9d0be0b80 1 -- 172.21.15.82:0/4244115905 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562a4db4a1c0 con 0x562a4db7ac40 2023-09-23T09:08:01.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.888+0000 7fe99aff5700 1 -- 172.21.15.82:0/4244115905 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fe9a809cca0 con 0x562a4db7ac40 2023-09-23T09:08:01.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.888+0000 7fe99aff5700 1 -- 172.21.15.82:0/4244115905 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe9a80b82d0 con 0x562a4db7ac40 2023-09-23T09:08:01.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.888+0000 7fe9d0be0b80 10 client.26087 fetch_fsmap learned FSMap version 61 2023-09-23T09:08:01.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.888+0000 7fe9d0be0b80 1 -- 172.21.15.82:0/4244115905 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) v3 -- 0x562a4d8f8de0 con 0x562a4db7ac40 2023-09-23T09:08:01.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.888+0000 7fe99aff5700 1 -- 172.21.15.82:0/4244115905 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562a4db4a1c0 con 0x562a4db7ac40 2023-09-23T09:08:01.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.888+0000 7fe99aff5700 1 -- 172.21.15.82:0/4244115905 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 61) v1 ==== 7902+0+0 (secure 0 0 0) 0x7fe9a80b3020 con 0x562a4db7ac40 2023-09-23T09:08:01.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.888+0000 7fe9d0be0b80 10 client.26087 fetch_fsmap finished waiting for FSMap version 61 2023-09-23T09:08:01.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.888+0000 7fe9d0be0b80 10 client.26087 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:08:01.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.888+0000 7fe9d0be0b80 20 client.26087 populate_metadata read hostname 'smithi082' 2023-09-23T09:08:01.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.888+0000 7fe9d0be0b80 1 --2- 172.21.15.82:0/4244115905 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x562a4db944d0 0x562a4db968f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:08:01.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.888+0000 7fe9d0be0b80 4 client.26087 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:08:01.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.888+0000 7fe9d0be0b80 1 -- 172.21.15.82:0/4244115905 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562a4da72ba0 con 0x562a4db944d0 2023-09-23T09:08:01.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.889+0000 7fe9b659c700 1 --2- 172.21.15.82:0/4244115905 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x562a4db944d0 0x562a4db968f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:08:01.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.889+0000 7fe99aff5700 10 client.26087 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:08:01.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.889+0000 7fe9b659c700 1 --2- 172.21.15.82:0/4244115905 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x562a4db944d0 0x562a4db968f0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d9e521d93ca7d4d server_cookie=76c71481b50c35a9 in_seq=0 out_seq=0 2023-09-23T09:08:01.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.890+0000 7fe99aff5700 1 -- 172.21.15.82:0/4244115905 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x562a4da72ba0 con 0x562a4db944d0 2023-09-23T09:08:01.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.890+0000 7fe99aff5700 10 client.26087 handle_command_reply: tid=0 2023-09-23T09:08:01.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.890+0000 7fe9d0be0b80 1 client.26087 shutdown 2023-09-23T09:08:01.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.890+0000 7fe9d0be0b80 1 -- 172.21.15.82:0/4244115905 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a4db7ac40 msgr2=0x562a4db86df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:08:01.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.890+0000 7fe9d0be0b80 1 --2- 172.21.15.82:0/4244115905 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a4db7ac40 0x562a4db86df0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe9a8009230 tx=0x7fe9a8099360 comp rx=0 tx=0).stop 2023-09-23T09:08:01.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.890+0000 7fe9d0be0b80 1 -- 172.21.15.82:0/4244115905 shutdown_connections 2023-09-23T09:08:01.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.890+0000 7fe9d0be0b80 1 --2- 172.21.15.82:0/4244115905 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x562a4db944d0 0x562a4db968f0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:08:01.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.890+0000 7fe9d0be0b80 1 --2- 172.21.15.82:0/4244115905 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a4db80e20 0x562a4db84820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:08:01.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.890+0000 7fe99aff5700 0 client.26087 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:08:01.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.890+0000 7fe9d0be0b80 1 --2- 172.21.15.82:0/4244115905 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a4db7ac40 0x562a4db86df0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:08:01.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.890+0000 7fe9d0be0b80 1 --2- 172.21.15.82:0/4244115905 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562a4db80500 0x562a4db840e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:08:01.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.890+0000 7fe9d0be0b80 1 -- 172.21.15.82:0/4244115905 >> 172.21.15.82:0/4244115905 conn(0x562a4daef0e0 msgr2=0x562a4db754d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:08:01.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.890+0000 7fe9d0be0b80 1 -- 172.21.15.82:0/4244115905 shutdown_connections 2023-09-23T09:08:01.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.891+0000 7fe9d0be0b80 1 -- 172.21.15.82:0/4244115905 wait complete. 2023-09-23T09:08:01.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.891+0000 7fe9d0be0b80 20 client.26087 trim_cache size 0 max 16384 2023-09-23T09:08:01.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.911+0000 7fe9d0be0b80 1 Processor -- start 2023-09-23T09:08:01.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.911+0000 7fe9d0be0b80 1 -- start start 2023-09-23T09:08:01.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.912+0000 7fe9d0be0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a4db7ac40 0x562a4db90090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:08:01.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.912+0000 7fe9d0be0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a4db80500 0x562a4db86990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:08:01.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.912+0000 7fe9d0be0b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562a4db80e20 0x562a4db83670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:08:01.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.912+0000 7fe9d0be0b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a4d94e920 con 0x562a4db7ac40 2023-09-23T09:08:01.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.912+0000 7fe9d0be0b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a4db71c40 con 0x562a4db80500 2023-09-23T09:08:01.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.912+0000 7fe9d0be0b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a4db87440 con 0x562a4db80e20 2023-09-23T09:08:01.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.912+0000 7fe9b6d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a4db7ac40 0x562a4db90090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:08:01.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.912+0000 7fe9b659c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a4db80500 0x562a4db86990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:08:01.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.912+0000 7fe9b659c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a4db80500 0x562a4db86990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:59020/0 (socket says 172.21.15.82:59020) 2023-09-23T09:08:01.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.912+0000 7fe9b659c700 1 -- 172.21.15.82:0/1688199867 learned_addr learned my addr 172.21.15.82:0/1688199867 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:08:01.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.912+0000 7fe9b759e700 1 --2- 172.21.15.82:0/1688199867 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562a4db80e20 0x562a4db83670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:08:01.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.913+0000 7fe9b6d9d700 1 -- 172.21.15.82:0/1688199867 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562a4db80e20 msgr2=0x562a4db83670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:08:01.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.913+0000 7fe9b6d9d700 1 --2- 172.21.15.82:0/1688199867 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562a4db80e20 0x562a4db83670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:08:01.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.913+0000 7fe9b6d9d700 1 -- 172.21.15.82:0/1688199867 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a4db80500 msgr2=0x562a4db86990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:08:01.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.913+0000 7fe9b6d9d700 1 --2- 172.21.15.82:0/1688199867 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a4db80500 0x562a4db86990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:08:01.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.913+0000 7fe9b6d9d700 1 -- 172.21.15.82:0/1688199867 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562a4d8e1c60 con 0x562a4db7ac40 2023-09-23T09:08:01.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.913+0000 7fe9b659c700 1 --2- 172.21.15.82:0/1688199867 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a4db80500 0x562a4db86990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:08:01.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.913+0000 7fe9b6d9d700 1 --2- 172.21.15.82:0/1688199867 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a4db7ac40 0x562a4db90090 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fe9a80988c0 tx=0x7fe9a8094f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80315fb652421ba5 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:08:01.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.913+0000 7fe99dffb700 1 -- 172.21.15.82:0/1688199867 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9a80a0c80 con 0x562a4db7ac40 2023-09-23T09:08:01.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.913+0000 7fe99dffb700 1 -- 172.21.15.82:0/1688199867 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe9a8099e80 con 0x562a4db7ac40 2023-09-23T09:08:01.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.913+0000 7fe99dffb700 1 -- 172.21.15.82:0/1688199867 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9a80b8360 con 0x562a4db7ac40 2023-09-23T09:08:01.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.914+0000 7fe9d0be0b80 1 -- 172.21.15.82:0/1688199867 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a4db7ac40 msgr2=0x562a4db90090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:08:01.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.914+0000 7fe9d0be0b80 1 --2- 172.21.15.82:0/1688199867 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a4db7ac40 0x562a4db90090 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fe9a80988c0 tx=0x7fe9a8094f10 comp rx=0 tx=0).stop 2023-09-23T09:08:01.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.914+0000 7fe9d0be0b80 1 -- 172.21.15.82:0/1688199867 shutdown_connections 2023-09-23T09:08:01.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.914+0000 7fe9d0be0b80 1 --2- 172.21.15.82:0/1688199867 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562a4db80e20 0x562a4db83670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:08:01.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.914+0000 7fe9d0be0b80 1 --2- 172.21.15.82:0/1688199867 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a4db7ac40 0x562a4db90090 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:08:01.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.914+0000 7fe9d0be0b80 1 --2- 172.21.15.82:0/1688199867 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a4db80500 0x562a4db86990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:08:01.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.914+0000 7fe9d0be0b80 1 -- 172.21.15.82:0/1688199867 >> 172.21.15.82:0/1688199867 conn(0x562a4daef0e0 msgr2=0x562a4db90c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:08:01.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.914+0000 7fe9d0be0b80 1 -- 172.21.15.82:0/1688199867 shutdown_connections 2023-09-23T09:08:01.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.914+0000 7fe9d0be0b80 1 -- 172.21.15.82:0/1688199867 wait complete. 2023-09-23T09:08:01.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.915+0000 7fe9d0be0b80 1 -- start start 2023-09-23T09:08:01.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.915+0000 7fe9d0be0b80 1 Processor -- start 2023-09-23T09:08:01.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.915+0000 7fe9d0be0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a4db7ac40 0x562a4db7d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:08:01.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.915+0000 7fe9d0be0b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562a4db80500 0x562a4db7c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:08:01.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.915+0000 7fe9d0be0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a4db80e20 0x562a4db7c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:08:01.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.915+0000 7fe9d0be0b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a4db7caa0 con 0x562a4db7ac40 2023-09-23T09:08:01.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.915+0000 7fe9d0be0b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a4db7cc10 con 0x562a4db80e20 2023-09-23T09:08:01.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.915+0000 7fe9d0be0b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a4db7cdd0 con 0x562a4db80500 2023-09-23T09:08:01.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.916+0000 7fe9d0be0b80 10 client.0 _ll_register_callbacks cb 0x7fe9a8005ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:08:01.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.916+0000 7fe9b6d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a4db7ac40 0x562a4db7d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:08:01.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.916+0000 7fe9b759e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a4db80e20 0x562a4db7c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:08:01.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.916+0000 7fe9b659c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562a4db80500 0x562a4db7c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:08:01.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.916+0000 7fe9b759e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a4db80e20 0x562a4db7c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:59036/0 (socket says 172.21.15.82:59036) 2023-09-23T09:08:01.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.916+0000 7fe9b659c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562a4db80500 0x562a4db7c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:59270/0 (socket says 172.21.15.82:59270) 2023-09-23T09:08:01.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.916+0000 7fe9b759e700 1 -- 172.21.15.82:0/1837543204 learned_addr learned my addr 172.21.15.82:0/1837543204 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:08:01.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.916+0000 7fe9b659c700 1 -- 172.21.15.82:0/1837543204 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a4db80e20 msgr2=0x562a4db7c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:08:01.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.916+0000 7fe9b659c700 1 --2- 172.21.15.82:0/1837543204 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a4db80e20 0x562a4db7c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:08:01.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.916+0000 7fe9b659c700 1 -- 172.21.15.82:0/1837543204 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a4db7ac40 msgr2=0x562a4db7d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:08:01.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.916+0000 7fe9b659c700 1 --2- 172.21.15.82:0/1837543204 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a4db7ac40 0x562a4db7d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:08:01.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.916+0000 7fe9b659c700 1 -- 172.21.15.82:0/1837543204 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9b810dee0 con 0x562a4db80500 2023-09-23T09:08:01.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.917+0000 7fe9b659c700 1 --2- 172.21.15.82:0/1837543204 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562a4db80500 0x562a4db7c020 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x562a4db822d0 tx=0x7fe9ac005960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7c658141e6b8212 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:08:01.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.917+0000 7fe99aff5700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T09:08:01.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.917+0000 7fe99aff5700 1 -- 172.21.15.82:0/1837543204 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9ac01d040 con 0x562a4db80500 2023-09-23T09:08:01.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.917+0000 7fe9d0be0b80 1 -- 172.21.15.82:0/1837543204 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562a4dac5970 con 0x562a4db80500 2023-09-23T09:08:01.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.917+0000 7fe99aff5700 1 -- 172.21.15.82:0/1837543204 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fe9ac004500 con 0x562a4db80500 2023-09-23T09:08:01.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.917+0000 7fe99aff5700 1 -- 172.21.15.82:0/1837543204 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe9ac0046c0 con 0x562a4db80500 2023-09-23T09:08:01.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.917+0000 7fe9d0be0b80 10 client.26140 fetch_fsmap learned FSMap version 61 2023-09-23T09:08:01.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.917+0000 7fe9d0be0b80 1 -- 172.21.15.82:0/1837543204 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) v3 -- 0x562a4d8f8de0 con 0x562a4db80500 2023-09-23T09:08:01.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.918+0000 7fe99aff5700 1 -- 172.21.15.82:0/1837543204 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe9ac03c080 con 0x562a4db80500 2023-09-23T09:08:01.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.918+0000 7fe99aff5700 1 -- 172.21.15.82:0/1837543204 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 61) v1 ==== 7902+0+0 (secure 0 0 0) 0x7fe9ac00f720 con 0x562a4db80500 2023-09-23T09:08:01.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.918+0000 7fe9d0be0b80 10 client.26140 fetch_fsmap finished waiting for FSMap version 61 2023-09-23T09:08:01.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.918+0000 7fe9d0be0b80 10 client.26140 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:08:01.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.918+0000 7fe9d0be0b80 20 client.26140 populate_metadata read hostname 'smithi082' 2023-09-23T09:08:01.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.918+0000 7fe9d0be0b80 1 --2- 172.21.15.82:0/1837543204 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x562a4dbe97d0 0x562a4dbebbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:08:01.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.918+0000 7fe9d0be0b80 4 client.26140 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:08:01.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.918+0000 7fe9d0be0b80 1 -- 172.21.15.82:0/1837543204 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x562a4da86050 con 0x562a4dbe97d0 2023-09-23T09:08:01.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.918+0000 7fe9b6d9d700 1 --2- 172.21.15.82:0/1837543204 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x562a4dbe97d0 0x562a4dbebbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:08:01.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.919+0000 7fe9b6d9d700 1 --2- 172.21.15.82:0/1837543204 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x562a4dbe97d0 0x562a4dbebbf0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=16816a48bacc6cd7 server_cookie=e500aab1898de8d8 in_seq=0 out_seq=0 2023-09-23T09:08:01.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.919+0000 7fe99aff5700 10 client.26140 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:08:01.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.919+0000 7fe99aff5700 1 -- 172.21.15.82:0/1837543204 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x562a4da86050 con 0x562a4dbe97d0 2023-09-23T09:08:01.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.919+0000 7fe99aff5700 10 client.26140 handle_command_reply: tid=0 2023-09-23T09:08:01.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.919+0000 7fe9d0be0b80 1 client.26140 shutdown 2023-09-23T09:08:01.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.919+0000 7fe9d0be0b80 1 -- 172.21.15.82:0/1837543204 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562a4db80500 msgr2=0x562a4db7c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:08:01.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.919+0000 7fe9d0be0b80 1 --2- 172.21.15.82:0/1837543204 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562a4db80500 0x562a4db7c020 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x562a4db822d0 tx=0x7fe9ac005960 comp rx=0 tx=0).stop 2023-09-23T09:08:01.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.919+0000 7fe9d0be0b80 1 -- 172.21.15.82:0/1837543204 shutdown_connections 2023-09-23T09:08:01.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.919+0000 7fe9d0be0b80 1 --2- 172.21.15.82:0/1837543204 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a4db80e20 0x562a4db7c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:08:01.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.919+0000 7fe9d0be0b80 1 --2- 172.21.15.82:0/1837543204 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x562a4dbe97d0 0x562a4dbebbf0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:08:01.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.919+0000 7fe9d0be0b80 1 --2- 172.21.15.82:0/1837543204 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a4db7ac40 0x562a4db7d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:08:01.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.919+0000 7fe9d0be0b80 1 --2- 172.21.15.82:0/1837543204 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562a4db80500 0x562a4db7c020 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:08:01.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.919+0000 7fe99aff5700 0 client.26140 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:08:01.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.919+0000 7fe9d0be0b80 1 -- 172.21.15.82:0/1837543204 >> 172.21.15.82:0/1837543204 conn(0x562a4daef0e0 msgr2=0x562a4db90090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:08:01.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.919+0000 7fe9d0be0b80 1 -- 172.21.15.82:0/1837543204 shutdown_connections 2023-09-23T09:08:01.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.919+0000 7fe9d0be0b80 1 -- 172.21.15.82:0/1837543204 wait complete. 2023-09-23T09:08:01.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.919+0000 7fe9d0be0b80 20 client.26140 trim_cache size 0 max 16384 2023-09-23T09:08:01.930 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:08:01.930 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "IDLE (waiting for more scrubs)", 2023-09-23T09:08:01.930 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:08:01.930 INFO:teuthology.orchestra.run.smithi082.stdout: "cba46b77-20dd-437c-a60a-ac01b400e1b8": { 2023-09-23T09:08:01.931 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:08:01.931 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "cba46b77-20dd-437c-a60a-ac01b400e1b8", 2023-09-23T09:08:01.931 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:08:01.931 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:08:01.931 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:08:01.931 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:08:01.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.920+0000 7fe9bc9fe700 1 -- 172.21.15.82:0/3151160005 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fe9a00a0160 msgr2=0x7fe9a00a2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:08:01.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.920+0000 7fe9bc9fe700 1 --2- 172.21.15.82:0/3151160005 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fe9a00a0160 0x7fe9a00a2620 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe9b819f230 tx=0x7fe9b0011be0 comp rx=0 tx=0).stop 2023-09-23T09:08:01.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.920+0000 7fe9bc9fe700 1 -- 172.21.15.82:0/3151160005 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9b8100710 msgr2=0x7fe9b819e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:08:01.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.920+0000 7fe9bc9fe700 1 --2- 172.21.15.82:0/3151160005 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9b8100710 0x7fe9b819e530 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe9a800e9a0 tx=0x7fe9a800ecb0 comp rx=0 tx=0).stop 2023-09-23T09:08:01.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.920+0000 7fe9bc9fe700 1 -- 172.21.15.82:0/3151160005 shutdown_connections 2023-09-23T09:08:01.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.920+0000 7fe9bc9fe700 1 --2- 172.21.15.82:0/3151160005 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fe9a00a0160 0x7fe9a00a2620 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:08:01.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.920+0000 7fe9bc9fe700 1 --2- 172.21.15.82:0/3151160005 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe9b8106720 0x7fe9b81985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:08:01.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.920+0000 7fe9bc9fe700 1 --2- 172.21.15.82:0/3151160005 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9b8100710 0x7fe9b819e530 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:08:01.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.920+0000 7fe9bc9fe700 1 --2- 172.21.15.82:0/3151160005 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9b81010d0 0x7fe9b819ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:08:01.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.920+0000 7fe9bc9fe700 1 -- 172.21.15.82:0/3151160005 >> 172.21.15.82:0/3151160005 conn(0x7fe9b80fc1e0 msgr2=0x7fe9b810baa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:08:01.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.920+0000 7fe9bc9fe700 1 -- 172.21.15.82:0/3151160005 shutdown_connections 2023-09-23T09:08:01.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:01.920+0000 7fe9bc9fe700 1 -- 172.21.15.82:0/3151160005 wait complete. 2023-09-23T09:08:01.941 INFO:tasks.cephfs.filesystem:scrub status for tag:cba46b77-20dd-437c-a60a-ac01b400e1b8 - {'path': '/', 'tag': 'cba46b77-20dd-437c-a60a-ac01b400e1b8', 'options': 'recursive,force'} 2023-09-23T09:08:02.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:08:02 smithi135 ceph-mon[99205]: pgmap v345: 97 pgs: 97 active+clean; 8.5 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 745 KiB/s rd, 2.9 MiB/s wr, 305 op/s 2023-09-23T09:08:03.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:08:02 smithi082 ceph-mon[97694]: pgmap v345: 97 pgs: 97 active+clean; 8.5 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 745 KiB/s rd, 2.9 MiB/s wr, 305 op/s 2023-09-23T09:08:03.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:08:02 smithi161 ceph-mon[99580]: pgmap v345: 97 pgs: 97 active+clean; 8.5 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 745 KiB/s rd, 2.9 MiB/s wr, 305 op/s 2023-09-23T09:08:05.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:08:04 smithi135 ceph-mon[99205]: pgmap v346: 97 pgs: 97 active+clean; 8.5 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 745 KiB/s rd, 2.9 MiB/s wr, 305 op/s 2023-09-23T09:08:05.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:08:04 smithi082 ceph-mon[97694]: pgmap v346: 97 pgs: 97 active+clean; 8.5 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 745 KiB/s rd, 2.9 MiB/s wr, 305 op/s 2023-09-23T09:08:05.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:08:04 smithi161 ceph-mon[99580]: pgmap v346: 97 pgs: 97 active+clean; 8.5 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 745 KiB/s rd, 2.9 MiB/s wr, 305 op/s 2023-09-23T09:08:07.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:08:06 smithi135 ceph-mon[99205]: pgmap v347: 97 pgs: 97 active+clean; 8.5 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.4 MiB/s wr, 466 op/s 2023-09-23T09:08:07.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:08:06 smithi082 ceph-mon[97694]: pgmap v347: 97 pgs: 97 active+clean; 8.5 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.4 MiB/s wr, 466 op/s 2023-09-23T09:08:07.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:08:06 smithi161 ceph-mon[99580]: pgmap v347: 97 pgs: 97 active+clean; 8.5 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.4 MiB/s wr, 466 op/s 2023-09-23T09:08:08.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:08:07 smithi135 ceph-mon[99205]: osdmap e98: 12 total, 12 up, 12 in 2023-09-23T09:08:08.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:08:07 smithi135 ceph-mon[99205]: pgmap v349: 97 pgs: 97 active+clean; 8.5 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 922 KiB/s rd, 3.5 MiB/s wr, 377 op/s 2023-09-23T09:08:08.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:08:07 smithi082 ceph-mon[97694]: osdmap e98: 12 total, 12 up, 12 in 2023-09-23T09:08:08.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:08:07 smithi082 ceph-mon[97694]: pgmap v349: 97 pgs: 97 active+clean; 8.5 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 922 KiB/s rd, 3.5 MiB/s wr, 377 op/s 2023-09-23T09:08:08.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:08:07 smithi161 ceph-mon[99580]: osdmap e98: 12 total, 12 up, 12 in 2023-09-23T09:08:08.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:08:07 smithi161 ceph-mon[99580]: pgmap v349: 97 pgs: 97 active+clean; 8.5 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 922 KiB/s rd, 3.5 MiB/s wr, 377 op/s 2023-09-23T09:08:08.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:08:08 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:08:09.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:08:08 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:08:09.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:08:08 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:08:10.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:08:09 smithi135 ceph-mon[99205]: pgmap v350: 97 pgs: 97 active+clean; 8.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 3.3 MiB/s wr, 353 op/s 2023-09-23T09:08:10.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:08:09 smithi082 ceph-mon[97694]: pgmap v350: 97 pgs: 97 active+clean; 8.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 3.3 MiB/s wr, 353 op/s 2023-09-23T09:08:10.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:08:09 smithi161 ceph-mon[99580]: pgmap v350: 97 pgs: 97 active+clean; 8.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 3.3 MiB/s wr, 353 op/s 2023-09-23T09:08:12.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:08:12 smithi161 ceph-mon[99580]: pgmap v351: 97 pgs: 97 active+clean; 8.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 3.3 MiB/s wr, 353 op/s 2023-09-23T09:08:12.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:08:12 smithi161 ceph-mon[99580]: osdmap e99: 12 total, 12 up, 12 in 2023-09-23T09:08:13.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:08:12 smithi135 ceph-mon[99205]: pgmap v351: 97 pgs: 97 active+clean; 8.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 3.3 MiB/s wr, 353 op/s 2023-09-23T09:08:13.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:08:12 smithi135 ceph-mon[99205]: osdmap e99: 12 total, 12 up, 12 in 2023-09-23T09:08:13.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:08:12 smithi082 ceph-mon[97694]: pgmap v351: 97 pgs: 97 active+clean; 8.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 3.3 MiB/s wr, 353 op/s 2023-09-23T09:08:13.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:08:12 smithi082 ceph-mon[97694]: osdmap e99: 12 total, 12 up, 12 in 2023-09-23T09:08:13.319 INFO:teuthology.orchestra.run.smithi082.stderr:38100000 of 50000000 tuples (76%) done (elapsed 648.06 s, remaining 202.41 s) 2023-09-23T09:08:14.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:08:14 smithi161 ceph-mon[99580]: pgmap v353: 97 pgs: 97 active+clean; 8.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 634 KiB/s rd, 2.0 MiB/s wr, 201 op/s 2023-09-23T09:08:15.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:08:14 smithi135 ceph-mon[99205]: pgmap v353: 97 pgs: 97 active+clean; 8.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 634 KiB/s rd, 2.0 MiB/s wr, 201 op/s 2023-09-23T09:08:15.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:08:14 smithi082 ceph-mon[97694]: pgmap v353: 97 pgs: 97 active+clean; 8.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 634 KiB/s rd, 2.0 MiB/s wr, 201 op/s 2023-09-23T09:08:16.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:08:16 smithi161 ceph-mon[99580]: pgmap v354: 97 pgs: 97 active+clean; 8.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.9 MiB/s wr, 392 op/s 2023-09-23T09:08:17.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:08:16 smithi135 ceph-mon[99205]: pgmap v354: 97 pgs: 97 active+clean; 8.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.9 MiB/s wr, 392 op/s 2023-09-23T09:08:17.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:08:16 smithi082 ceph-mon[97694]: pgmap v354: 97 pgs: 97 active+clean; 8.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.9 MiB/s wr, 392 op/s 2023-09-23T09:08:17.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:08:17 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:08:18.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:08:17 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:08:18.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:08:17 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:08:19.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:08:18 smithi135 ceph-mon[99205]: pgmap v355: 97 pgs: 97 active+clean; 8.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 3.3 MiB/s wr, 335 op/s 2023-09-23T09:08:19.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:08:18 smithi082 ceph-mon[97694]: pgmap v355: 97 pgs: 97 active+clean; 8.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 3.3 MiB/s wr, 335 op/s 2023-09-23T09:08:19.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:08:18 smithi161 ceph-mon[99580]: pgmap v355: 97 pgs: 97 active+clean; 8.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 3.3 MiB/s wr, 335 op/s 2023-09-23T09:08:21.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:08:20 smithi135 ceph-mon[99205]: pgmap v356: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 3.5 MiB/s wr, 354 op/s 2023-09-23T09:08:21.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:08:20 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:08:21.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:08:20 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:08:21.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:08:20 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:08:21.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:08:20 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:08:21.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:08:20 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:08:21.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:08:20 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:08:21.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:08:20 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:08:21.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:08:20 smithi082 ceph-mon[97694]: pgmap v356: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 3.5 MiB/s wr, 354 op/s 2023-09-23T09:08:21.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:08:20 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:08:21.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:08:20 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:08:21.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:08:20 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:08:21.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:08:20 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:08:21.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:08:20 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:08:21.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:08:20 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:08:21.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:08:20 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:08:21.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:08:20 smithi161 ceph-mon[99580]: pgmap v356: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 3.5 MiB/s wr, 354 op/s 2023-09-23T09:08:21.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:08:20 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:08:21.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:08:20 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:08:21.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:08:20 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:08:21.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:08:20 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:08:21.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:08:20 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:08:21.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:08:20 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:08:21.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:08:20 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:08:22.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:08:21 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:08:22.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:08:21 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:08:22.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:08:21 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:08:22.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:08:21 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:08:22.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:08:21 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:08:22.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:08:21 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:08:22.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:08:21 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:08:22.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:08:21 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:08:22.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:08:21 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:08:23.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:08:22 smithi135 ceph-mon[99205]: pgmap v357: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 3.5 MiB/s wr, 354 op/s 2023-09-23T09:08:23.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:08:22 smithi082 ceph-mon[97694]: pgmap v357: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 3.5 MiB/s wr, 354 op/s 2023-09-23T09:08:23.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:08:22 smithi161 ceph-mon[99580]: pgmap v357: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 3.5 MiB/s wr, 354 op/s 2023-09-23T09:08:25.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:08:24 smithi135 ceph-mon[99205]: pgmap v358: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 916 KiB/s rd, 3.0 MiB/s wr, 304 op/s 2023-09-23T09:08:25.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:08:24 smithi082 ceph-mon[97694]: pgmap v358: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 916 KiB/s rd, 3.0 MiB/s wr, 304 op/s 2023-09-23T09:08:25.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:08:24 smithi161 ceph-mon[99580]: pgmap v358: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 916 KiB/s rd, 3.0 MiB/s wr, 304 op/s 2023-09-23T09:08:27.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:08:26 smithi135 ceph-mon[99205]: pgmap v359: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.3 MiB/s wr, 437 op/s 2023-09-23T09:08:27.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:08:26 smithi082 ceph-mon[97694]: pgmap v359: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.3 MiB/s wr, 437 op/s 2023-09-23T09:08:27.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:08:26 smithi161 ceph-mon[99580]: pgmap v359: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.3 MiB/s wr, 437 op/s 2023-09-23T09:08:28.852 INFO:teuthology.orchestra.run.smithi082.stderr:38200000 of 50000000 tuples (76%) done (elapsed 663.59 s, remaining 204.98 s) 2023-09-23T09:08:29.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:08:28 smithi135 ceph-mon[99205]: pgmap v360: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 877 KiB/s rd, 2.9 MiB/s wr, 292 op/s 2023-09-23T09:08:29.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:08:28 smithi082 ceph-mon[97694]: pgmap v360: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 877 KiB/s rd, 2.9 MiB/s wr, 292 op/s 2023-09-23T09:08:29.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:08:28 smithi161 ceph-mon[99580]: pgmap v360: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 877 KiB/s rd, 2.9 MiB/s wr, 292 op/s 2023-09-23T09:08:31.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:08:30 smithi135 ceph-mon[99205]: pgmap v361: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.4 MiB/s wr, 450 op/s 2023-09-23T09:08:31.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:08:30 smithi082 ceph-mon[97694]: pgmap v361: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.4 MiB/s wr, 450 op/s 2023-09-23T09:08:31.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:08:30 smithi161 ceph-mon[99580]: pgmap v361: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.4 MiB/s wr, 450 op/s 2023-09-23T09:08:31.941 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:08:32.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.158+0000 7f3930bff700 1 -- 172.21.15.82:0/646986360 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f392c1068a0 msgr2=0x7f392c106c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:08:32.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.158+0000 7f3930bff700 1 --2- 172.21.15.82:0/646986360 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f392c1068a0 0x7f392c106c80 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f391c009990 tx=0x7f391c009ca0 comp rx=0 tx=0).stop 2023-09-23T09:08:32.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.158+0000 7f3930bff700 1 -- 172.21.15.82:0/646986360 shutdown_connections 2023-09-23T09:08:32.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.158+0000 7f3930bff700 1 --2- 172.21.15.82:0/646986360 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f392c101250 0x7f392c10d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:08:32.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.158+0000 7f3930bff700 1 --2- 172.21.15.82:0/646986360 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f392c1068a0 0x7f392c106c80 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:08:32.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.158+0000 7f3930bff700 1 --2- 172.21.15.82:0/646986360 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f392c100890 0x7f392c100d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:08:32.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.158+0000 7f3930bff700 1 -- 172.21.15.82:0/646986360 >> 172.21.15.82:0/646986360 conn(0x7f392c0fc380 msgr2=0x7f392c0fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:08:32.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.158+0000 7f3930bff700 1 -- 172.21.15.82:0/646986360 shutdown_connections 2023-09-23T09:08:32.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.158+0000 7f3930bff700 1 -- 172.21.15.82:0/646986360 wait complete. 2023-09-23T09:08:32.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.159+0000 7f3930bff700 1 Processor -- start 2023-09-23T09:08:32.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.160+0000 7f3930bff700 1 -- start start 2023-09-23T09:08:32.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.160+0000 7f3930bff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f392c100890 0x7f392c19c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:08:32.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.160+0000 7f3930bff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f392c101250 0x7f392c19cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:08:32.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.160+0000 7f3930bff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f392c1068a0 0x7f392c1966f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:08:32.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.160+0000 7f3930bff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f392c196d60 con 0x7f392c100890 2023-09-23T09:08:32.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.160+0000 7f3930bff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f392c196ed0 con 0x7f392c101250 2023-09-23T09:08:32.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.160+0000 7f3930bff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f392c197090 con 0x7f392c1068a0 2023-09-23T09:08:32.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.160+0000 7f392a59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f392c100890 0x7f392c19c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:08:32.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.160+0000 7f3929d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f392c101250 0x7f392c19cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:08:32.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.160+0000 7f392a59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f392c100890 0x7f392c19c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36004/0 (socket says 172.21.15.82:36004) 2023-09-23T09:08:32.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.160+0000 7f392ad9d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f392c1068a0 0x7f392c1966f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:08:32.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.160+0000 7f392a59c700 1 -- 172.21.15.82:0/3204864043 learned_addr learned my addr 172.21.15.82:0/3204864043 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:08:32.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.161+0000 7f3929d9b700 1 -- 172.21.15.82:0/3204864043 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f392c1068a0 msgr2=0x7f392c1966f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:08:32.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.161+0000 7f3929d9b700 1 --2- 172.21.15.82:0/3204864043 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f392c1068a0 0x7f392c1966f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:08:32.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.161+0000 7f3929d9b700 1 -- 172.21.15.82:0/3204864043 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f392c100890 msgr2=0x7f392c19c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:08:32.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.161+0000 7f3929d9b700 1 --2- 172.21.15.82:0/3204864043 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f392c100890 0x7f392c19c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:08:32.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.161+0000 7f3929d9b700 1 -- 172.21.15.82:0/3204864043 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3924009c40 con 0x7f392c101250 2023-09-23T09:08:32.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.161+0000 7f3929d9b700 1 --2- 172.21.15.82:0/3204864043 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f392c101250 0x7f392c19cbc0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f392000e9f0 tx=0x7f392000ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:08:32.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.161+0000 7f391b7fe700 1 -- 172.21.15.82:0/3204864043 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f392000c9c0 con 0x7f392c101250 2023-09-23T09:08:32.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.161+0000 7f3930bff700 1 -- 172.21.15.82:0/3204864043 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f391c0095f0 con 0x7f392c101250 2023-09-23T09:08:32.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.161+0000 7f391b7fe700 1 -- 172.21.15.82:0/3204864043 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3920010430 con 0x7f392c101250 2023-09-23T09:08:32.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.161+0000 7f391b7fe700 1 -- 172.21.15.82:0/3204864043 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3920018680 con 0x7f392c101250 2023-09-23T09:08:32.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.162+0000 7f3930bff700 1 -- 172.21.15.82:0/3204864043 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f392c197560 con 0x7f392c101250 2023-09-23T09:08:32.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.165+0000 7f391b7fe700 1 -- 172.21.15.82:0/3204864043 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f39200105a0 con 0x7f392c101250 2023-09-23T09:08:32.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.166+0000 7f3944596b80 1 Processor -- start 2023-09-23T09:08:32.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.167+0000 7f391b7fe700 1 --2- 172.21.15.82:0/3204864043 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f39140a00c0 0x7f39140a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:08:32.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.167+0000 7f3944596b80 1 -- start start 2023-09-23T09:08:32.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.167+0000 7f391b7fe700 1 -- 172.21.15.82:0/3204864043 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f3920014070 con 0x7f392c101250 2023-09-23T09:08:32.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.167+0000 7f392ad9d700 1 --2- 172.21.15.82:0/3204864043 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f39140a00c0 0x7f39140a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:08:32.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.167+0000 7f3944596b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e37cdbf7d0 0x55e37cdbfbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:08:32.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.167+0000 7f3944596b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e37cdc00f0 0x55e37cdb9b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:08:32.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.167+0000 7f3944596b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e37cdba050 0x55e37cdba4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:08:32.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.167+0000 7f3944596b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e37cd1d7b0 con 0x55e37cdc00f0 2023-09-23T09:08:32.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.167+0000 7f3944596b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e37cd0e780 con 0x55e37cdba050 2023-09-23T09:08:32.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.167+0000 7f3944596b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e37cd0c0a0 con 0x55e37cdbf7d0 2023-09-23T09:08:32.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.168+0000 7f392a59c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e37cdbf7d0 0x55e37cdbfbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:08:32.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.168+0000 7f392ad9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e37cdba050 0x55e37cdba4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:08:32.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.168+0000 7f392a59c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e37cdbf7d0 0x55e37cdbfbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:41722/0 (socket says 172.21.15.82:41722) 2023-09-23T09:08:32.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.168+0000 7f392a59c700 1 -- 172.21.15.82:0/1895919866 learned_addr learned my addr 172.21.15.82:0/1895919866 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:08:32.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.168+0000 7f3929d9b700 1 --2- 172.21.15.82:0/1895919866 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e37cdc00f0 0x55e37cdb9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:08:32.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.168+0000 7f392ad9d700 1 --2- 172.21.15.82:0/3204864043 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f39140a00c0 0x7f39140a2580 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f392c19d380 tx=0x7f392400b040 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:08:32.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.168+0000 7f392a59c700 1 -- 172.21.15.82:0/1895919866 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e37cdba050 msgr2=0x55e37cdba4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:08:32.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.168+0000 7f392a59c700 1 --2- 172.21.15.82:0/1895919866 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e37cdba050 0x55e37cdba4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:08:32.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.168+0000 7f392a59c700 1 -- 172.21.15.82:0/1895919866 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e37cdc00f0 msgr2=0x55e37cdb9b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:08:32.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.168+0000 7f392a59c700 1 --2- 172.21.15.82:0/1895919866 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e37cdc00f0 0x55e37cdb9b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:08:32.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.168+0000 7f392a59c700 1 -- 172.21.15.82:0/1895919866 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e37cb87630 con 0x55e37cdbf7d0 2023-09-23T09:08:32.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.168+0000 7f392ad9d700 1 --2- 172.21.15.82:0/1895919866 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e37cdba050 0x55e37cdba4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:08:32.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.168+0000 7f392a59c700 1 --2- 172.21.15.82:0/1895919866 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e37cdbf7d0 0x55e37cdbfbb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f391c005f40 tx=0x7f391c005040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e7b76f1a58e42b55 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:08:32.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.169+0000 7f3918ff9700 1 -- 172.21.15.82:0/1895919866 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391c01d070 con 0x55e37cdbf7d0 2023-09-23T09:08:32.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.169+0000 7f3918ff9700 1 -- 172.21.15.82:0/1895919866 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f391c01e040 con 0x55e37cdbf7d0 2023-09-23T09:08:32.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.169+0000 7f3918ff9700 1 -- 172.21.15.82:0/1895919866 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391c004960 con 0x55e37cdbf7d0 2023-09-23T09:08:32.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.169+0000 7f3944596b80 1 -- 172.21.15.82:0/1895919866 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e37cdbf7d0 msgr2=0x55e37cdbfbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:08:32.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.169+0000 7f3944596b80 1 --2- 172.21.15.82:0/1895919866 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e37cdbf7d0 0x55e37cdbfbb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f391c005f40 tx=0x7f391c005040 comp rx=0 tx=0).stop 2023-09-23T09:08:32.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.170+0000 7f3944596b80 1 -- 172.21.15.82:0/1895919866 shutdown_connections 2023-09-23T09:08:32.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.170+0000 7f3944596b80 1 --2- 172.21.15.82:0/1895919866 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e37cdba050 0x55e37cdba4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:08:32.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.170+0000 7f3944596b80 1 --2- 172.21.15.82:0/1895919866 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e37cdbf7d0 0x55e37cdbfbb0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:08:32.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.170+0000 7f3944596b80 1 --2- 172.21.15.82:0/1895919866 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e37cdc00f0 0x55e37cdb9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:08:32.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.170+0000 7f3944596b80 1 -- 172.21.15.82:0/1895919866 >> 172.21.15.82:0/1895919866 conn(0x55e37cd2a0e0 msgr2=0x55e37cdb0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:08:32.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.170+0000 7f3944596b80 1 -- 172.21.15.82:0/1895919866 shutdown_connections 2023-09-23T09:08:32.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.170+0000 7f3944596b80 1 -- 172.21.15.82:0/1895919866 wait complete. 2023-09-23T09:08:32.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.170+0000 7f3944596b80 1 -- start start 2023-09-23T09:08:32.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.171+0000 7f3944596b80 1 Processor -- start 2023-09-23T09:08:32.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.171+0000 7f3944596b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e37cdba050 0x55e37cdc6030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:08:32.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.171+0000 7f3944596b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e37cdbf7d0 0x55e37cdc32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:08:32.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.171+0000 7f3944596b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e37cdc00f0 0x55e37cdc39f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:08:32.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.172+0000 7f3944596b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e37cd07990 con 0x55e37cdc00f0 2023-09-23T09:08:32.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.172+0000 7f3944596b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e37cca5bb0 con 0x55e37cdbf7d0 2023-09-23T09:08:32.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.172+0000 7f3944596b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e37cca58b0 con 0x55e37cdba050 2023-09-23T09:08:32.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.172+0000 7f3944596b80 10 client.0 _ll_register_callbacks cb 0x55e37cbefa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:08:32.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.172+0000 7f392a59c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e37cdba050 0x55e37cdc6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:08:32.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.172+0000 7f3929d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e37cdbf7d0 0x55e37cdc32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:08:32.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.172+0000 7f392ad9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e37cdc00f0 0x55e37cdc39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:08:32.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.172+0000 7f392a59c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e37cdba050 0x55e37cdc6030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:41730/0 (socket says 172.21.15.82:41730) 2023-09-23T09:08:32.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.172+0000 7f3929d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e37cdbf7d0 0x55e37cdc32b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:60872/0 (socket says 172.21.15.82:60872) 2023-09-23T09:08:32.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.172+0000 7f392a59c700 1 -- 172.21.15.82:0/1489674146 learned_addr learned my addr 172.21.15.82:0/1489674146 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:08:32.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.172+0000 7f3929d9b700 1 -- 172.21.15.82:0/1489674146 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e37cdba050 msgr2=0x55e37cdc6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:08:32.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.172+0000 7f3929d9b700 1 --2- 172.21.15.82:0/1489674146 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e37cdba050 0x55e37cdc6030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:08:32.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.172+0000 7f3929d9b700 1 -- 172.21.15.82:0/1489674146 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e37cdc00f0 msgr2=0x55e37cdc39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:08:32.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.172+0000 7f3929d9b700 1 --2- 172.21.15.82:0/1489674146 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e37cdc00f0 0x55e37cdc39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:08:32.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.172+0000 7f3929d9b700 1 -- 172.21.15.82:0/1489674146 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3924017490 con 0x55e37cdbf7d0 2023-09-23T09:08:32.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.172+0000 7f392a59c700 1 --2- 172.21.15.82:0/1489674146 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e37cdba050 0x55e37cdc6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:08:32.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.172+0000 7f3929d9b700 1 --2- 172.21.15.82:0/1489674146 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e37cdbf7d0 0x55e37cdc32b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f39200c8f40 tx=0x7f39200988d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=adcba663f306045e server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:08:32.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.173+0000 7f3911ffb700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-09-23T09:08:32.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.173+0000 7f3911ffb700 1 -- 172.21.15.82:0/1489674146 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3920099600 con 0x55e37cdbf7d0 2023-09-23T09:08:32.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.173+0000 7f3911ffb700 1 -- 172.21.15.82:0/1489674146 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(99..99 src has 1..99) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f3920098f00 con 0x55e37cdbf7d0 2023-09-23T09:08:32.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.173+0000 7f3944596b80 1 -- 172.21.15.82:0/1489674146 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e37cd851c0 con 0x55e37cdbf7d0 2023-09-23T09:08:32.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.173+0000 7f3911ffb700 1 -- 172.21.15.82:0/1489674146 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7f392009cd30 con 0x55e37cdbf7d0 2023-09-23T09:08:32.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.173+0000 7f3944596b80 10 client.26105 fetch_fsmap learned FSMap version 63 2023-09-23T09:08:32.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.173+0000 7f3944596b80 1 -- 172.21.15.82:0/1489674146 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) v3 -- 0x7f392c10e060 con 0x55e37cdbf7d0 2023-09-23T09:08:32.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.173+0000 7f3911ffb700 1 -- 172.21.15.82:0/1489674146 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55e37cd851c0 con 0x55e37cdbf7d0 2023-09-23T09:08:32.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.174+0000 7f3911ffb700 1 -- 172.21.15.82:0/1489674146 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 63) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f39200b80b0 con 0x55e37cdbf7d0 2023-09-23T09:08:32.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.174+0000 7f3944596b80 10 client.26105 fetch_fsmap finished waiting for FSMap version 63 2023-09-23T09:08:32.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.174+0000 7f3944596b80 10 client.26105 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:08:32.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.174+0000 7f3944596b80 20 client.26105 populate_metadata read hostname 'smithi082' 2023-09-23T09:08:32.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.174+0000 7f3944596b80 1 --2- 172.21.15.82:0/1489674146 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55e37cdd3b30 0x55e37cdd5f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:08:32.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.174+0000 7f3944596b80 4 client.26105 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:08:32.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.174+0000 7f3944596b80 1 -- 172.21.15.82:0/1489674146 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e37ccadba0 con 0x55e37cdd3b30 2023-09-23T09:08:32.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.174+0000 7f392a59c700 1 --2- 172.21.15.82:0/1489674146 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55e37cdd3b30 0x55e37cdd5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:08:32.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.175+0000 7f3911ffb700 10 client.26105 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:08:32.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.175+0000 7f392a59c700 1 --2- 172.21.15.82:0/1489674146 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55e37cdd3b30 0x55e37cdd5f50 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb692c8b7e3616d8 server_cookie=c767cf2ac307fed0 in_seq=0 out_seq=0 2023-09-23T09:08:32.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.175+0000 7f3911ffb700 1 -- 172.21.15.82:0/1489674146 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e37ccadba0 con 0x55e37cdd3b30 2023-09-23T09:08:32.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.175+0000 7f3911ffb700 10 client.26105 handle_command_reply: tid=0 2023-09-23T09:08:32.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.175+0000 7f3944596b80 1 client.26105 shutdown 2023-09-23T09:08:32.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.176+0000 7f3944596b80 1 -- 172.21.15.82:0/1489674146 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e37cdbf7d0 msgr2=0x55e37cdc32b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:08:32.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.176+0000 7f3944596b80 1 --2- 172.21.15.82:0/1489674146 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e37cdbf7d0 0x55e37cdc32b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f39200c8f40 tx=0x7f39200988d0 comp rx=0 tx=0).stop 2023-09-23T09:08:32.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.176+0000 7f3944596b80 1 -- 172.21.15.82:0/1489674146 shutdown_connections 2023-09-23T09:08:32.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.176+0000 7f3944596b80 1 --2- 172.21.15.82:0/1489674146 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55e37cdd3b30 0x55e37cdd5f50 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:08:32.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.176+0000 7f3944596b80 1 --2- 172.21.15.82:0/1489674146 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e37cdc00f0 0x55e37cdc39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:08:32.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.176+0000 7f3944596b80 1 --2- 172.21.15.82:0/1489674146 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e37cdba050 0x55e37cdc6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:08:32.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.176+0000 7f3944596b80 1 --2- 172.21.15.82:0/1489674146 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e37cdbf7d0 0x55e37cdc32b0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:08:32.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.176+0000 7f3911ffb700 0 client.26105 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:08:32.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.176+0000 7f3944596b80 1 -- 172.21.15.82:0/1489674146 >> 172.21.15.82:0/1489674146 conn(0x55e37cd2a0e0 msgr2=0x55e37cdaab40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:08:32.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.176+0000 7f3944596b80 1 -- 172.21.15.82:0/1489674146 shutdown_connections 2023-09-23T09:08:32.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.176+0000 7f3944596b80 1 -- 172.21.15.82:0/1489674146 wait complete. 2023-09-23T09:08:32.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.176+0000 7f3944596b80 20 client.26105 trim_cache size 0 max 16384 2023-09-23T09:08:32.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.196+0000 7f3944596b80 1 Processor -- start 2023-09-23T09:08:32.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.196+0000 7f3944596b80 1 -- start start 2023-09-23T09:08:32.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.197+0000 7f3944596b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e37cdba050 0x55e37cdc5b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:08:32.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.197+0000 7f3944596b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e37cdbf7d0 0x55e37cdbd4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:08:32.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.197+0000 7f3944596b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e37cdc00f0 0x55e37cdbd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:08:32.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.197+0000 7f3944596b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e37cb89920 con 0x55e37cdba050 2023-09-23T09:08:32.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.197+0000 7f3944596b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e37cdb15e0 con 0x55e37cdc00f0 2023-09-23T09:08:32.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.197+0000 7f3944596b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e37cdb1e50 con 0x55e37cdbf7d0 2023-09-23T09:08:32.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.197+0000 7f3929d9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e37cdbf7d0 0x55e37cdbd4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:08:32.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.197+0000 7f392ad9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e37cdc00f0 0x55e37cdbd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:08:32.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.197+0000 7f3929d9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e37cdbf7d0 0x55e37cdbd4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:41738/0 (socket says 172.21.15.82:41738) 2023-09-23T09:08:32.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.197+0000 7f392ad9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e37cdc00f0 0x55e37cdbd9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:60876/0 (socket says 172.21.15.82:60876) 2023-09-23T09:08:32.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.197+0000 7f3929d9b700 1 -- 172.21.15.82:0/3200716619 learned_addr learned my addr 172.21.15.82:0/3200716619 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:08:32.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.197+0000 7f392a59c700 1 --2- 172.21.15.82:0/3200716619 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e37cdba050 0x55e37cdc5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:08:32.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.198+0000 7f3929d9b700 1 -- 172.21.15.82:0/3200716619 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e37cdc00f0 msgr2=0x55e37cdbd9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:08:32.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.198+0000 7f3929d9b700 1 --2- 172.21.15.82:0/3200716619 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e37cdc00f0 0x55e37cdbd9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:08:32.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.198+0000 7f3929d9b700 1 -- 172.21.15.82:0/3200716619 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e37cdba050 msgr2=0x55e37cdc5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:08:32.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.198+0000 7f3929d9b700 1 --2- 172.21.15.82:0/3200716619 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e37cdba050 0x55e37cdc5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:08:32.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.198+0000 7f3929d9b700 1 -- 172.21.15.82:0/3200716619 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e37cb33de0 con 0x55e37cdbf7d0 2023-09-23T09:08:32.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.198+0000 7f392ad9d700 1 --2- 172.21.15.82:0/3200716619 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e37cdc00f0 0x55e37cdbd9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:08:32.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.198+0000 7f3929d9b700 1 --2- 172.21.15.82:0/3200716619 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e37cdbf7d0 0x55e37cdbd4b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f39200b8520 tx=0x7f3920095370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df4c6c3a277cadf3 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:08:32.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.198+0000 7f39197fa700 1 -- 172.21.15.82:0/3200716619 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3920093bb0 con 0x55e37cdbf7d0 2023-09-23T09:08:32.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.198+0000 7f39197fa700 1 -- 172.21.15.82:0/3200716619 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3920099600 con 0x55e37cdbf7d0 2023-09-23T09:08:32.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.198+0000 7f39197fa700 1 -- 172.21.15.82:0/3200716619 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39200a0ae0 con 0x55e37cdbf7d0 2023-09-23T09:08:32.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.199+0000 7f3944596b80 1 -- 172.21.15.82:0/3200716619 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e37cdbf7d0 msgr2=0x55e37cdbd4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:08:32.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.199+0000 7f3944596b80 1 --2- 172.21.15.82:0/3200716619 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e37cdbf7d0 0x55e37cdbd4b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f39200b8520 tx=0x7f3920095370 comp rx=0 tx=0).stop 2023-09-23T09:08:32.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.199+0000 7f3944596b80 1 -- 172.21.15.82:0/3200716619 shutdown_connections 2023-09-23T09:08:32.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.199+0000 7f3944596b80 1 --2- 172.21.15.82:0/3200716619 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e37cdc00f0 0x55e37cdbd9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:08:32.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.199+0000 7f3944596b80 1 --2- 172.21.15.82:0/3200716619 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e37cdba050 0x55e37cdc5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:08:32.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.199+0000 7f3944596b80 1 --2- 172.21.15.82:0/3200716619 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e37cdbf7d0 0x55e37cdbd4b0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:08:32.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.199+0000 7f3944596b80 1 -- 172.21.15.82:0/3200716619 >> 172.21.15.82:0/3200716619 conn(0x55e37cd2a0e0 msgr2=0x55e37cdb00a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:08:32.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.199+0000 7f3944596b80 1 -- 172.21.15.82:0/3200716619 shutdown_connections 2023-09-23T09:08:32.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.199+0000 7f3944596b80 1 -- 172.21.15.82:0/3200716619 wait complete. 2023-09-23T09:08:32.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.200+0000 7f3944596b80 1 -- start start 2023-09-23T09:08:32.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.200+0000 7f3944596b80 1 Processor -- start 2023-09-23T09:08:32.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.200+0000 7f3944596b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e37cdba050 0x55e37cdc2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:08:32.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.200+0000 7f3944596b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e37cdbf7d0 0x55e37cdc2f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:08:32.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.200+0000 7f3944596b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e37cdc00f0 0x55e37cdc1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:08:32.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.201+0000 7f3944596b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e37cdc35a0 con 0x55e37cdba050 2023-09-23T09:08:32.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.201+0000 7f3944596b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e37cdc1d50 con 0x55e37cdbf7d0 2023-09-23T09:08:32.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.201+0000 7f3944596b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e37cdc1f10 con 0x55e37cdc00f0 2023-09-23T09:08:32.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.201+0000 7f3944596b80 10 client.0 _ll_register_callbacks cb 0x7f3920005b40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:08:32.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.201+0000 7f392a59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e37cdba050 0x55e37cdc2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:08:32.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.201+0000 7f392a59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e37cdba050 0x55e37cdc2a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36042/0 (socket says 172.21.15.82:36042) 2023-09-23T09:08:32.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.201+0000 7f392a59c700 1 -- 172.21.15.82:0/2111854687 learned_addr learned my addr 172.21.15.82:0/2111854687 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:08:32.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.201+0000 7f392ad9d700 1 --2- 172.21.15.82:0/2111854687 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e37cdc00f0 0x55e37cdc1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:08:32.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.201+0000 7f3929d9b700 1 --2- 172.21.15.82:0/2111854687 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e37cdbf7d0 0x55e37cdc2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:08:32.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.201+0000 7f392a59c700 1 -- 172.21.15.82:0/2111854687 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e37cdc00f0 msgr2=0x55e37cdc1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:08:32.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.201+0000 7f392a59c700 1 --2- 172.21.15.82:0/2111854687 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e37cdc00f0 0x55e37cdc1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:08:32.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.201+0000 7f392a59c700 1 -- 172.21.15.82:0/2111854687 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e37cdbf7d0 msgr2=0x55e37cdc2f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:08:32.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.201+0000 7f392a59c700 1 --2- 172.21.15.82:0/2111854687 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e37cdbf7d0 0x55e37cdc2f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:08:32.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.201+0000 7f392a59c700 1 -- 172.21.15.82:0/2111854687 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3924009170 con 0x55e37cdba050 2023-09-23T09:08:32.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.201+0000 7f392ad9d700 1 --2- 172.21.15.82:0/2111854687 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e37cdc00f0 0x55e37cdc1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:08:32.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.201+0000 7f392a59c700 1 --2- 172.21.15.82:0/2111854687 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e37cdba050 0x55e37cdc2a50 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f391c005850 tx=0x7f391c0094b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae3d790852b715e0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:08:32.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.201+0000 7f3911ffb700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:08:32.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.202+0000 7f3911ffb700 1 -- 172.21.15.82:0/2111854687 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391c032040 con 0x55e37cdba050 2023-09-23T09:08:32.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.202+0000 7f3944596b80 1 -- 172.21.15.82:0/2111854687 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e37cda88b0 con 0x55e37cdba050 2023-09-23T09:08:32.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.202+0000 7f3911ffb700 1 -- 172.21.15.82:0/2111854687 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(99..99 src has 1..99) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f391c00b930 con 0x55e37cdba050 2023-09-23T09:08:32.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.202+0000 7f3911ffb700 1 -- 172.21.15.82:0/2111854687 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7f391c01d040 con 0x55e37cdba050 2023-09-23T09:08:32.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.202+0000 7f3944596b80 10 client.16428 fetch_fsmap learned FSMap version 63 2023-09-23T09:08:32.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.202+0000 7f3944596b80 1 -- 172.21.15.82:0/2111854687 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) v3 -- 0x7f392c10e060 con 0x55e37cdba050 2023-09-23T09:08:32.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.202+0000 7f3911ffb700 1 -- 172.21.15.82:0/2111854687 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55e37cda88b0 con 0x55e37cdba050 2023-09-23T09:08:32.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.202+0000 7f3911ffb700 1 -- 172.21.15.82:0/2111854687 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 63) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f391c004570 con 0x55e37cdba050 2023-09-23T09:08:32.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.202+0000 7f3944596b80 10 client.16428 fetch_fsmap finished waiting for FSMap version 63 2023-09-23T09:08:32.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.202+0000 7f3944596b80 10 client.16428 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:08:32.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.202+0000 7f3944596b80 20 client.16428 populate_metadata read hostname 'smithi082' 2023-09-23T09:08:32.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.203+0000 7f3944596b80 1 --2- 172.21.15.82:0/2111854687 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55e37ce28280 0x55e37ce2a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:08:32.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.203+0000 7f3944596b80 4 client.16428 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:08:32.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.203+0000 7f3944596b80 1 -- 172.21.15.82:0/2111854687 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55e37cd00970 con 0x55e37ce28280 2023-09-23T09:08:32.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.203+0000 7f3929d9b700 1 --2- 172.21.15.82:0/2111854687 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55e37ce28280 0x55e37ce2a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:08:32.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.203+0000 7f3911ffb700 10 client.16428 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:08:32.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.203+0000 7f3929d9b700 1 --2- 172.21.15.82:0/2111854687 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55e37ce28280 0x55e37ce2a6a0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=baa0a9caa956c24e server_cookie=7d30857c0457978 in_seq=0 out_seq=0 2023-09-23T09:08:32.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.204+0000 7f3911ffb700 1 -- 172.21.15.82:0/2111854687 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55e37cd00970 con 0x55e37ce28280 2023-09-23T09:08:32.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.204+0000 7f3911ffb700 10 client.16428 handle_command_reply: tid=0 2023-09-23T09:08:32.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.204+0000 7f3944596b80 1 client.16428 shutdown 2023-09-23T09:08:32.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.204+0000 7f3944596b80 1 -- 172.21.15.82:0/2111854687 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e37cdba050 msgr2=0x55e37cdc2a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:08:32.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.204+0000 7f3944596b80 1 --2- 172.21.15.82:0/2111854687 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e37cdba050 0x55e37cdc2a50 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f391c005850 tx=0x7f391c0094b0 comp rx=0 tx=0).stop 2023-09-23T09:08:32.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.204+0000 7f3944596b80 1 -- 172.21.15.82:0/2111854687 shutdown_connections 2023-09-23T09:08:32.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.204+0000 7f3944596b80 1 --2- 172.21.15.82:0/2111854687 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e37cdc00f0 0x55e37cdc1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:08:32.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.204+0000 7f3944596b80 1 --2- 172.21.15.82:0/2111854687 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55e37ce28280 0x55e37ce2a6a0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:08:32.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.204+0000 7f3944596b80 1 --2- 172.21.15.82:0/2111854687 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e37cdba050 0x55e37cdc2a50 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:08:32.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.204+0000 7f3944596b80 1 --2- 172.21.15.82:0/2111854687 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e37cdbf7d0 0x55e37cdc2f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:08:32.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.204+0000 7f3944596b80 1 -- 172.21.15.82:0/2111854687 >> 172.21.15.82:0/2111854687 conn(0x55e37cd2a0e0 msgr2=0x55e37cdbd4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:08:32.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.204+0000 7f3911ffb700 0 client.16428 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:08:32.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.204+0000 7f3944596b80 1 -- 172.21.15.82:0/2111854687 shutdown_connections 2023-09-23T09:08:32.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.204+0000 7f3944596b80 1 -- 172.21.15.82:0/2111854687 wait complete. 2023-09-23T09:08:32.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.204+0000 7f3944596b80 20 client.16428 trim_cache size 0 max 16384 2023-09-23T09:08:32.212 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:08:32.212 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "IDLE (waiting for more scrubs)", 2023-09-23T09:08:32.212 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:08:32.212 INFO:teuthology.orchestra.run.smithi082.stdout: "cba46b77-20dd-437c-a60a-ac01b400e1b8": { 2023-09-23T09:08:32.213 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:08:32.213 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "cba46b77-20dd-437c-a60a-ac01b400e1b8", 2023-09-23T09:08:32.213 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:08:32.213 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:08:32.213 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:08:32.213 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:08:32.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.205+0000 7f3930bff700 1 -- 172.21.15.82:0/3204864043 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f39140a00c0 msgr2=0x7f39140a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:08:32.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.205+0000 7f3930bff700 1 --2- 172.21.15.82:0/3204864043 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f39140a00c0 0x7f39140a2580 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f392c19d380 tx=0x7f392400b040 comp rx=0 tx=0).stop 2023-09-23T09:08:32.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.205+0000 7f3930bff700 1 -- 172.21.15.82:0/3204864043 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f392c101250 msgr2=0x7f392c19cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:08:32.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.205+0000 7f3930bff700 1 --2- 172.21.15.82:0/3204864043 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f392c101250 0x7f392c19cbc0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f392000e9f0 tx=0x7f392000ed00 comp rx=0 tx=0).stop 2023-09-23T09:08:32.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.205+0000 7f3930bff700 1 -- 172.21.15.82:0/3204864043 shutdown_connections 2023-09-23T09:08:32.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.205+0000 7f3930bff700 1 --2- 172.21.15.82:0/3204864043 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f39140a00c0 0x7f39140a2580 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:08:32.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.205+0000 7f3930bff700 1 --2- 172.21.15.82:0/3204864043 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f392c1068a0 0x7f392c1966f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:08:32.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.205+0000 7f3930bff700 1 --2- 172.21.15.82:0/3204864043 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f392c100890 0x7f392c19c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:08:32.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.205+0000 7f3930bff700 1 --2- 172.21.15.82:0/3204864043 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f392c101250 0x7f392c19cbc0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:08:32.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.205+0000 7f3930bff700 1 -- 172.21.15.82:0/3204864043 >> 172.21.15.82:0/3204864043 conn(0x7f392c0fc380 msgr2=0x7f392c0fca50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:08:32.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.205+0000 7f3930bff700 1 -- 172.21.15.82:0/3204864043 shutdown_connections 2023-09-23T09:08:32.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:08:32.205+0000 7f3930bff700 1 -- 172.21.15.82:0/3204864043 wait complete. 2023-09-23T09:08:32.227 INFO:tasks.cephfs.filesystem:scrub status for tag:cba46b77-20dd-437c-a60a-ac01b400e1b8 - {'path': '/', 'tag': 'cba46b77-20dd-437c-a60a-ac01b400e1b8', 'options': 'recursive,force'} 2023-09-23T09:08:33.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:08:32 smithi135 ceph-mon[99205]: pgmap v362: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 915 KiB/s rd, 3.0 MiB/s wr, 301 op/s 2023-09-23T09:08:33.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:08:32 smithi082 ceph-mon[97694]: pgmap v362: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 915 KiB/s rd, 3.0 MiB/s wr, 301 op/s 2023-09-23T09:08:33.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:08:32 smithi161 ceph-mon[99580]: pgmap v362: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 915 KiB/s rd, 3.0 MiB/s wr, 301 op/s 2023-09-23T09:08:34.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:08:33 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:08:34.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:08:33 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:08:34.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:08:33 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:08:35.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:08:34 smithi135 ceph-mon[99205]: pgmap v363: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 915 KiB/s rd, 3.0 MiB/s wr, 301 op/s 2023-09-23T09:08:35.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:08:34 smithi082 ceph-mon[97694]: pgmap v363: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 915 KiB/s rd, 3.0 MiB/s wr, 301 op/s 2023-09-23T09:08:35.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:08:34 smithi161 ceph-mon[99580]: pgmap v363: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 915 KiB/s rd, 3.0 MiB/s wr, 301 op/s 2023-09-23T09:08:37.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:08:36 smithi135 ceph-mon[99205]: pgmap v364: 97 pgs: 97 active+clean; 8.1 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.5 MiB/s wr, 455 op/s 2023-09-23T09:08:37.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:08:36 smithi082 ceph-mon[97694]: pgmap v364: 97 pgs: 97 active+clean; 8.1 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.5 MiB/s wr, 455 op/s 2023-09-23T09:08:37.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:08:36 smithi161 ceph-mon[99580]: pgmap v364: 97 pgs: 97 active+clean; 8.1 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.5 MiB/s wr, 455 op/s 2023-09-23T09:08:39.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:08:38 smithi135 ceph-mon[99205]: pgmap v365: 97 pgs: 97 active+clean; 8.1 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 956 KiB/s rd, 3.1 MiB/s wr, 313 op/s 2023-09-23T09:08:39.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:08:38 smithi082 ceph-mon[97694]: pgmap v365: 97 pgs: 97 active+clean; 8.1 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 956 KiB/s rd, 3.1 MiB/s wr, 313 op/s 2023-09-23T09:08:39.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:08:38 smithi161 ceph-mon[99580]: pgmap v365: 97 pgs: 97 active+clean; 8.1 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 956 KiB/s rd, 3.1 MiB/s wr, 313 op/s 2023-09-23T09:08:41.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:08:40 smithi135 ceph-mon[99205]: pgmap v366: 97 pgs: 97 active+clean; 8.1 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.5 MiB/s wr, 454 op/s 2023-09-23T09:08:41.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:08:40 smithi082 ceph-mon[97694]: pgmap v366: 97 pgs: 97 active+clean; 8.1 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.5 MiB/s wr, 454 op/s 2023-09-23T09:08:41.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:08:40 smithi161 ceph-mon[99580]: pgmap v366: 97 pgs: 97 active+clean; 8.1 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.5 MiB/s wr, 454 op/s 2023-09-23T09:08:43.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:08:42 smithi135 ceph-mon[99205]: pgmap v367: 97 pgs: 97 active+clean; 8.1 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 893 KiB/s rd, 2.9 MiB/s wr, 296 op/s 2023-09-23T09:08:43.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:08:42 smithi082 ceph-mon[97694]: pgmap v367: 97 pgs: 97 active+clean; 8.1 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 893 KiB/s rd, 2.9 MiB/s wr, 296 op/s 2023-09-23T09:08:43.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:08:42 smithi161 ceph-mon[99580]: pgmap v367: 97 pgs: 97 active+clean; 8.1 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 893 KiB/s rd, 2.9 MiB/s wr, 296 op/s 2023-09-23T09:08:43.652 INFO:teuthology.orchestra.run.smithi082.stderr:38300000 of 50000000 tuples (76%) done (elapsed 678.39 s, remaining 207.24 s) 2023-09-23T09:08:45.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:08:44 smithi135 ceph-mon[99205]: pgmap v368: 97 pgs: 97 active+clean; 8.1 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 893 KiB/s rd, 2.9 MiB/s wr, 296 op/s 2023-09-23T09:08:45.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:08:44 smithi082 ceph-mon[97694]: pgmap v368: 97 pgs: 97 active+clean; 8.1 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 893 KiB/s rd, 2.9 MiB/s wr, 296 op/s 2023-09-23T09:08:45.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:08:44 smithi161 ceph-mon[99580]: pgmap v368: 97 pgs: 97 active+clean; 8.1 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 893 KiB/s rd, 2.9 MiB/s wr, 296 op/s 2023-09-23T09:08:47.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:08:46 smithi135 ceph-mon[99205]: pgmap v369: 97 pgs: 97 active+clean; 8.1 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.3 MiB/s wr, 439 op/s 2023-09-23T09:08:47.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:08:46 smithi082 ceph-mon[97694]: pgmap v369: 97 pgs: 97 active+clean; 8.1 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.3 MiB/s wr, 439 op/s 2023-09-23T09:08:47.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:08:46 smithi161 ceph-mon[99580]: pgmap v369: 97 pgs: 97 active+clean; 8.1 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.3 MiB/s wr, 439 op/s 2023-09-23T09:08:49.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:08:48 smithi135 ceph-mon[99205]: pgmap v370: 97 pgs: 97 active+clean; 8.1 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 768 KiB/s rd, 2.8 MiB/s wr, 285 op/s 2023-09-23T09:08:49.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:08:48 smithi082 ceph-mon[97694]: pgmap v370: 97 pgs: 97 active+clean; 8.1 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 768 KiB/s rd, 2.8 MiB/s wr, 285 op/s 2023-09-23T09:08:49.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:08:48 smithi161 ceph-mon[99580]: pgmap v370: 97 pgs: 97 active+clean; 8.1 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 768 KiB/s rd, 2.8 MiB/s wr, 285 op/s 2023-09-23T09:08:51.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:08:50 smithi135 ceph-mon[99205]: pgmap v371: 97 pgs: 97 active+clean; 8.1 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.2 MiB/s wr, 424 op/s 2023-09-23T09:08:51.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:08:50 smithi082 ceph-mon[97694]: pgmap v371: 97 pgs: 97 active+clean; 8.1 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.2 MiB/s wr, 424 op/s 2023-09-23T09:08:51.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:08:50 smithi161 ceph-mon[99580]: pgmap v371: 97 pgs: 97 active+clean; 8.1 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.2 MiB/s wr, 424 op/s 2023-09-23T09:08:53.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:08:52 smithi135 ceph-mon[99205]: pgmap v372: 97 pgs: 97 active+clean; 8.1 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 759 KiB/s rd, 2.8 MiB/s wr, 282 op/s 2023-09-23T09:08:53.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:08:52 smithi082 ceph-mon[97694]: pgmap v372: 97 pgs: 97 active+clean; 8.1 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 759 KiB/s rd, 2.8 MiB/s wr, 282 op/s 2023-09-23T09:08:53.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:08:52 smithi161 ceph-mon[99580]: pgmap v372: 97 pgs: 97 active+clean; 8.1 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 759 KiB/s rd, 2.8 MiB/s wr, 282 op/s 2023-09-23T09:08:55.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:08:54 smithi135 ceph-mon[99205]: pgmap v373: 97 pgs: 97 active+clean; 8.1 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 759 KiB/s rd, 2.8 MiB/s wr, 282 op/s 2023-09-23T09:08:55.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:08:54 smithi082 ceph-mon[97694]: pgmap v373: 97 pgs: 97 active+clean; 8.1 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 759 KiB/s rd, 2.8 MiB/s wr, 282 op/s 2023-09-23T09:08:55.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:08:54 smithi161 ceph-mon[99580]: pgmap v373: 97 pgs: 97 active+clean; 8.1 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 759 KiB/s rd, 2.8 MiB/s wr, 282 op/s 2023-09-23T09:08:57.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:08:56 smithi135 ceph-mon[99205]: pgmap v374: 97 pgs: 97 active+clean; 8.1 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.3 MiB/s wr, 432 op/s 2023-09-23T09:08:57.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:08:56 smithi082 ceph-mon[97694]: pgmap v374: 97 pgs: 97 active+clean; 8.1 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.3 MiB/s wr, 432 op/s 2023-09-23T09:08:57.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:08:56 smithi161 ceph-mon[99580]: pgmap v374: 97 pgs: 97 active+clean; 8.1 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.3 MiB/s wr, 432 op/s 2023-09-23T09:08:58.889 INFO:teuthology.orchestra.run.smithi082.stderr:38400000 of 50000000 tuples (76%) done (elapsed 693.63 s, remaining 209.53 s) 2023-09-23T09:08:59.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:08:58 smithi135 ceph-mon[99205]: pgmap v375: 97 pgs: 97 active+clean; 8.1 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 869 KiB/s rd, 2.8 MiB/s wr, 288 op/s 2023-09-23T09:08:59.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:08:58 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:08:59.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:08:58 smithi082 ceph-mon[97694]: pgmap v375: 97 pgs: 97 active+clean; 8.1 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 869 KiB/s rd, 2.8 MiB/s wr, 288 op/s 2023-09-23T09:08:59.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:08:58 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:08:59.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:08:58 smithi161 ceph-mon[99580]: pgmap v375: 97 pgs: 97 active+clean; 8.1 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 869 KiB/s rd, 2.8 MiB/s wr, 288 op/s 2023-09-23T09:08:59.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:08:58 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:09:00.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:08:59 smithi135 ceph-mon[99205]: pgmap v376: 97 pgs: 97 active+clean; 8.2 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.2 MiB/s wr, 424 op/s 2023-09-23T09:09:00.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:08:59 smithi082 ceph-mon[97694]: pgmap v376: 97 pgs: 97 active+clean; 8.2 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.2 MiB/s wr, 424 op/s 2023-09-23T09:09:00.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:08:59 smithi161 ceph-mon[99580]: pgmap v376: 97 pgs: 97 active+clean; 8.2 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.2 MiB/s wr, 424 op/s 2023-09-23T09:09:02.227 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:09:02.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.455+0000 7f56f49fe700 1 -- 172.21.15.82:0/253770225 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56f0100710 msgr2=0x7f56f0100b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:09:02.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.455+0000 7f56f49fe700 1 --2- 172.21.15.82:0/253770225 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56f0100710 0x7f56f0100b90 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f56e4009990 tx=0x7f56e4009ca0 comp rx=0 tx=0).stop 2023-09-23T09:09:02.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.455+0000 7f56f49fe700 1 -- 172.21.15.82:0/253770225 shutdown_connections 2023-09-23T09:09:02.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.455+0000 7f56f49fe700 1 --2- 172.21.15.82:0/253770225 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f56f01010d0 0x7f56f010d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:09:02.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.455+0000 7f56f49fe700 1 --2- 172.21.15.82:0/253770225 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f56f0106720 0x7f56f0106b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:09:02.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.455+0000 7f56f49fe700 1 --2- 172.21.15.82:0/253770225 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56f0100710 0x7f56f0100b90 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:09:02.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.455+0000 7f56f49fe700 1 -- 172.21.15.82:0/253770225 >> 172.21.15.82:0/253770225 conn(0x7f56f00fc1e0 msgr2=0x7f56f00fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:09:02.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.455+0000 7f56f49fe700 1 -- 172.21.15.82:0/253770225 shutdown_connections 2023-09-23T09:09:02.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.455+0000 7f56f49fe700 1 -- 172.21.15.82:0/253770225 wait complete. 2023-09-23T09:09:02.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.456+0000 7f56f49fe700 1 Processor -- start 2023-09-23T09:09:02.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.456+0000 7f56f49fe700 1 -- start start 2023-09-23T09:09:02.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.457+0000 7f56f49fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f56f0100710 0x7f56f019e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:09:02.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.457+0000 7f56f49fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56f01010d0 0x7f56f019eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:09:02.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.457+0000 7f56f49fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f56f0106720 0x7f56f0198690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:09:02.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.457+0000 7f56f49fe700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56f0198d00 con 0x7f56f01010d0 2023-09-23T09:09:02.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.457+0000 7f56f49fe700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56f0198e70 con 0x7f56f0100710 2023-09-23T09:09:02.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.457+0000 7f56f49fe700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56f0199030 con 0x7f56f0106720 2023-09-23T09:09:02.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.457+0000 7f56eed9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f56f0100710 0x7f56f019e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:09:02.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.457+0000 7f56ee59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56f01010d0 0x7f56f019eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:09:02.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.457+0000 7f56eed9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f56f0100710 0x7f56f019e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:54170/0 (socket says 172.21.15.82:54170) 2023-09-23T09:09:02.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.457+0000 7f56eed9d700 1 -- 172.21.15.82:0/1966685855 learned_addr learned my addr 172.21.15.82:0/1966685855 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:09:02.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.457+0000 7f56ef59e700 1 --2- 172.21.15.82:0/1966685855 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f56f0106720 0x7f56f0198690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:09:02.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.458+0000 7f56eed9d700 1 -- 172.21.15.82:0/1966685855 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f56f0106720 msgr2=0x7f56f0198690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:09:02.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.458+0000 7f56eed9d700 1 --2- 172.21.15.82:0/1966685855 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f56f0106720 0x7f56f0198690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:09:02.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.458+0000 7f56eed9d700 1 -- 172.21.15.82:0/1966685855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56f01010d0 msgr2=0x7f56f019eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:09:02.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.458+0000 7f56eed9d700 1 --2- 172.21.15.82:0/1966685855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56f01010d0 0x7f56f019eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:09:02.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.458+0000 7f56eed9d700 1 -- 172.21.15.82:0/1966685855 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56e40095f0 con 0x7f56f0100710 2023-09-23T09:09:02.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.458+0000 7f56ee59c700 1 --2- 172.21.15.82:0/1966685855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56f01010d0 0x7f56f019eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:09:02.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.458+0000 7f56ef59e700 1 --2- 172.21.15.82:0/1966685855 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f56f0106720 0x7f56f0198690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:09:02.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.458+0000 7f56eed9d700 1 --2- 172.21.15.82:0/1966685855 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f56f0100710 0x7f56f019e5d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f56e000e9a0 tx=0x7f56e000ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:09:02.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.458+0000 7f56d7fff700 1 -- 172.21.15.82:0/1966685855 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e0009790 con 0x7f56f0100710 2023-09-23T09:09:02.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.458+0000 7f56d7fff700 1 -- 172.21.15.82:0/1966685855 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f56e0010430 con 0x7f56f0100710 2023-09-23T09:09:02.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.458+0000 7f56f49fe700 1 -- 172.21.15.82:0/1966685855 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56f0199310 con 0x7f56f0100710 2023-09-23T09:09:02.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.458+0000 7f56d7fff700 1 -- 172.21.15.82:0/1966685855 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e000cea0 con 0x7f56f0100710 2023-09-23T09:09:02.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.459+0000 7f56f49fe700 1 -- 172.21.15.82:0/1966685855 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56f01a55c0 con 0x7f56f0100710 2023-09-23T09:09:02.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.462+0000 7f56d7fff700 1 -- 172.21.15.82:0/1966685855 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f56e00105a0 con 0x7f56f0100710 2023-09-23T09:09:02.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.463+0000 7f5708b61b80 1 Processor -- start 2023-09-23T09:09:02.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.463+0000 7f5708b61b80 1 -- start start 2023-09-23T09:09:02.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.464+0000 7f5708b61b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561718761500 0x5617187618e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:09:02.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.464+0000 7f5708b61b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561718761e20 0x56171875b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:09:02.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.464+0000 7f5708b61b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56171875bc40 0x56171875c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:09:02.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.464+0000 7f5708b61b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617186c37b0 con 0x561718761500 2023-09-23T09:09:02.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.464+0000 7f5708b61b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617186b4780 con 0x56171875bc40 2023-09-23T09:09:02.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.464+0000 7f5708b61b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617186b20a0 con 0x561718761e20 2023-09-23T09:09:02.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.464+0000 7f56d7fff700 1 --2- 172.21.15.82:0/1966685855 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f56d80a0160 0x7f56d80a2620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:09:02.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.464+0000 7f56ef59e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561718761500 0x5617187618e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:09:02.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.464+0000 7f56ef59e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561718761500 0x5617187618e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54426/0 (socket says 172.21.15.82:54426) 2023-09-23T09:09:02.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.464+0000 7f56ee59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56171875bc40 0x56171875c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:09:02.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.464+0000 7f56ef59e700 1 -- 172.21.15.82:0/3689564666 learned_addr learned my addr 172.21.15.82:0/3689564666 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:09:02.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.464+0000 7f56eed9d700 1 --2- 172.21.15.82:0/3689564666 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561718761e20 0x56171875b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:09:02.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.464+0000 7f56d7fff700 1 -- 172.21.15.82:0/1966685855 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f56e0014070 con 0x7f56f0100710 2023-09-23T09:09:02.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.465+0000 7f56ee59c700 1 -- 172.21.15.82:0/3689564666 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561718761e20 msgr2=0x56171875b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:09:02.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.465+0000 7f56ee59c700 1 --2- 172.21.15.82:0/3689564666 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561718761e20 0x56171875b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:09:02.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.465+0000 7f56ee59c700 1 -- 172.21.15.82:0/3689564666 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561718761500 msgr2=0x5617187618e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:09:02.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.465+0000 7f56ef59e700 1 --2- 172.21.15.82:0/1966685855 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f56d80a0160 0x7f56d80a2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:09:02.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.465+0000 7f56ee59c700 1 --2- 172.21.15.82:0/3689564666 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561718761500 0x5617187618e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:09:02.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.465+0000 7f56ee59c700 1 -- 172.21.15.82:0/3689564666 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56171852d630 con 0x56171875bc40 2023-09-23T09:09:02.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.465+0000 7f56ee59c700 1 --2- 172.21.15.82:0/3689564666 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56171875bc40 0x56171875c080 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f56e40059d0 tx=0x7f56e4005c40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8d7c6d87924eae server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:09:02.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.465+0000 7f56ef59e700 1 --2- 172.21.15.82:0/1966685855 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f56d80a0160 0x7f56d80a2620 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f56e8009ec0 tx=0x7f56e8004b40 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:09:02.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.465+0000 7f56d57fa700 1 -- 172.21.15.82:0/3689564666 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e401d070 con 0x56171875bc40 2023-09-23T09:09:02.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.465+0000 7f56d57fa700 1 -- 172.21.15.82:0/3689564666 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f56e401e040 con 0x56171875bc40 2023-09-23T09:09:02.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.465+0000 7f56d57fa700 1 -- 172.21.15.82:0/3689564666 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e4004c80 con 0x56171875bc40 2023-09-23T09:09:02.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.466+0000 7f5708b61b80 1 -- 172.21.15.82:0/3689564666 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56171875bc40 msgr2=0x56171875c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:09:02.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.466+0000 7f5708b61b80 1 --2- 172.21.15.82:0/3689564666 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56171875bc40 0x56171875c080 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f56e40059d0 tx=0x7f56e4005c40 comp rx=0 tx=0).stop 2023-09-23T09:09:02.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.466+0000 7f5708b61b80 1 -- 172.21.15.82:0/3689564666 shutdown_connections 2023-09-23T09:09:02.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.466+0000 7f5708b61b80 1 --2- 172.21.15.82:0/3689564666 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56171875bc40 0x56171875c080 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:09:02.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.466+0000 7f5708b61b80 1 --2- 172.21.15.82:0/3689564666 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561718761500 0x5617187618e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:09:02.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.466+0000 7f5708b61b80 1 --2- 172.21.15.82:0/3689564666 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561718761e20 0x56171875b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:09:02.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.466+0000 7f5708b61b80 1 -- 172.21.15.82:0/3689564666 >> 172.21.15.82:0/3689564666 conn(0x5617186d00e0 msgr2=0x561718756940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:09:02.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.466+0000 7f5708b61b80 1 -- 172.21.15.82:0/3689564666 shutdown_connections 2023-09-23T09:09:02.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.466+0000 7f5708b61b80 1 -- 172.21.15.82:0/3689564666 wait complete. 2023-09-23T09:09:02.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.467+0000 7f5708b61b80 1 -- start start 2023-09-23T09:09:02.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.467+0000 7f5708b61b80 1 Processor -- start 2023-09-23T09:09:02.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.468+0000 7f5708b61b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56171875bc40 0x5617187650b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:09:02.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.468+0000 7f5708b61b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561718761500 0x5617187655f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:09:02.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.468+0000 7f5708b61b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561718761e20 0x561718765b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:09:02.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.468+0000 7f5708b61b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617186ad990 con 0x561718761e20 2023-09-23T09:09:02.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.468+0000 7f5708b61b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56171864bbb0 con 0x56171875bc40 2023-09-23T09:09:02.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.468+0000 7f5708b61b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x56171864b8b0 con 0x561718761500 2023-09-23T09:09:02.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.468+0000 7f5708b61b80 10 client.0 _ll_register_callbacks cb 0x561718595a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:09:02.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.468+0000 7f56eed9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56171875bc40 0x5617187650b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:09:02.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.468+0000 7f56ef59e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561718761e20 0x561718765b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:09:02.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.468+0000 7f56eed9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56171875bc40 0x5617187650b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:54182/0 (socket says 172.21.15.82:54182) 2023-09-23T09:09:02.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.468+0000 7f56eed9d700 1 -- 172.21.15.82:0/3269157795 learned_addr learned my addr 172.21.15.82:0/3269157795 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:09:02.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.468+0000 7f56ee59c700 1 --2- 172.21.15.82:0/3269157795 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561718761500 0x5617187655f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:09:02.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.469+0000 7f56eed9d700 1 -- 172.21.15.82:0/3269157795 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561718761500 msgr2=0x5617187655f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:09:02.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.469+0000 7f56eed9d700 1 --2- 172.21.15.82:0/3269157795 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561718761500 0x5617187655f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:09:02.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.469+0000 7f56eed9d700 1 -- 172.21.15.82:0/3269157795 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561718761e20 msgr2=0x561718765b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:09:02.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.469+0000 7f56eed9d700 1 --2- 172.21.15.82:0/3269157795 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561718761e20 0x561718765b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:09:02.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.469+0000 7f56eed9d700 1 -- 172.21.15.82:0/3269157795 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56f010dee0 con 0x56171875bc40 2023-09-23T09:09:02.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.469+0000 7f56eed9d700 1 --2- 172.21.15.82:0/3269157795 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56171875bc40 0x5617187650b0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f56e0098e00 tx=0x7f56e0064da0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb26fe0d0d49ea83 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:09:02.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.469+0000 7f56d2ff5700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-09-23T09:09:02.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.469+0000 7f56d2ff5700 1 -- 172.21.15.82:0/3269157795 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e00992d0 con 0x56171875bc40 2023-09-23T09:09:02.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.469+0000 7f5708b61b80 1 -- 172.21.15.82:0/3269157795 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56171872b1c0 con 0x56171875bc40 2023-09-23T09:09:02.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.470+0000 7f56d2ff5700 1 -- 172.21.15.82:0/3269157795 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(99..99 src has 1..99) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f56e0064e10 con 0x56171875bc40 2023-09-23T09:09:02.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.470+0000 7f56d2ff5700 1 -- 172.21.15.82:0/3269157795 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) v2 ==== 24+0+0 (secure 0 0 0) 0x7f56e0099570 con 0x56171875bc40 2023-09-23T09:09:02.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.470+0000 7f5708b61b80 10 client.26123 fetch_fsmap learned FSMap version 65 2023-09-23T09:09:02.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.470+0000 7f5708b61b80 1 -- 172.21.15.82:0/3269157795 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=4+}) v3 -- 0x5617184d9de0 con 0x56171875bc40 2023-09-23T09:09:02.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.470+0000 7f56d2ff5700 1 -- 172.21.15.82:0/3269157795 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56171872b1c0 con 0x56171875bc40 2023-09-23T09:09:02.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.470+0000 7f56d2ff5700 1 -- 172.21.15.82:0/3269157795 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 65) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f56e0098360 con 0x56171875bc40 2023-09-23T09:09:02.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.470+0000 7f5708b61b80 10 client.26123 fetch_fsmap finished waiting for FSMap version 65 2023-09-23T09:09:02.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.470+0000 7f5708b61b80 10 client.26123 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:09:02.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.470+0000 7f5708b61b80 20 client.26123 populate_metadata read hostname 'smithi082' 2023-09-23T09:09:02.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.470+0000 7f5708b61b80 1 --2- 172.21.15.82:0/3269157795 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x561718775860 0x561718777c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:09:02.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.470+0000 7f5708b61b80 4 client.26123 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:09:02.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.470+0000 7f5708b61b80 1 -- 172.21.15.82:0/3269157795 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561718653ba0 con 0x561718775860 2023-09-23T09:09:02.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.471+0000 7f56ee59c700 1 --2- 172.21.15.82:0/3269157795 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x561718775860 0x561718777c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:09:02.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.471+0000 7f56d2ff5700 10 client.26123 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:09:02.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.471+0000 7f56ee59c700 1 --2- 172.21.15.82:0/3269157795 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x561718775860 0x561718777c80 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7fd2813aaafc576a server_cookie=e84eb3196c69924c in_seq=0 out_seq=0 2023-09-23T09:09:02.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.472+0000 7f56d2ff5700 1 -- 172.21.15.82:0/3269157795 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x561718653ba0 con 0x561718775860 2023-09-23T09:09:02.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.472+0000 7f56d2ff5700 10 client.26123 handle_command_reply: tid=0 2023-09-23T09:09:02.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.472+0000 7f5708b61b80 1 client.26123 shutdown 2023-09-23T09:09:02.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.472+0000 7f5708b61b80 1 -- 172.21.15.82:0/3269157795 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56171875bc40 msgr2=0x5617187650b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:09:02.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.472+0000 7f5708b61b80 1 --2- 172.21.15.82:0/3269157795 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56171875bc40 0x5617187650b0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f56e0098e00 tx=0x7f56e0064da0 comp rx=0 tx=0).stop 2023-09-23T09:09:02.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.472+0000 7f5708b61b80 1 -- 172.21.15.82:0/3269157795 shutdown_connections 2023-09-23T09:09:02.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.472+0000 7f5708b61b80 1 --2- 172.21.15.82:0/3269157795 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x561718775860 0x561718777c80 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:09:02.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.472+0000 7f5708b61b80 1 --2- 172.21.15.82:0/3269157795 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561718761e20 0x561718765b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:09:02.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.472+0000 7f5708b61b80 1 --2- 172.21.15.82:0/3269157795 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56171875bc40 0x5617187650b0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:09:02.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.472+0000 7f56d2ff5700 0 client.26123 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:09:02.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.472+0000 7f5708b61b80 1 --2- 172.21.15.82:0/3269157795 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561718761500 0x5617187655f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:09:02.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.472+0000 7f5708b61b80 1 -- 172.21.15.82:0/3269157795 >> 172.21.15.82:0/3269157795 conn(0x5617186d00e0 msgr2=0x56171875a6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:09:02.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.473+0000 7f5708b61b80 1 -- 172.21.15.82:0/3269157795 shutdown_connections 2023-09-23T09:09:02.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.473+0000 7f5708b61b80 1 -- 172.21.15.82:0/3269157795 wait complete. 2023-09-23T09:09:02.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.473+0000 7f5708b61b80 20 client.26123 trim_cache size 0 max 16384 2023-09-23T09:09:02.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.492+0000 7f5708b61b80 1 Processor -- start 2023-09-23T09:09:02.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.493+0000 7f5708b61b80 1 -- start start 2023-09-23T09:09:02.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.493+0000 7f5708b61b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56171875bc40 0x56171876c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:09:02.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.493+0000 7f5708b61b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561718761500 0x561718765960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:09:02.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.493+0000 7f5708b61b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561718761e20 0x5617187560a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:09:02.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.493+0000 7f5708b61b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56171852f920 con 0x561718761500 2023-09-23T09:09:02.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.493+0000 7f5708b61b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56171875baa0 con 0x56171875bc40 2023-09-23T09:09:02.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.493+0000 7f5708b61b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x561718775640 con 0x561718761e20 2023-09-23T09:09:02.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.493+0000 7f56ee59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561718761500 0x561718765960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:09:02.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.493+0000 7f56ee59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561718761500 0x561718765960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54444/0 (socket says 172.21.15.82:54444) 2023-09-23T09:09:02.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.493+0000 7f56eed9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56171875bc40 0x56171876c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:09:02.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.493+0000 7f56ee59c700 1 -- 172.21.15.82:0/3620057954 learned_addr learned my addr 172.21.15.82:0/3620057954 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:09:02.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.493+0000 7f56ef59e700 1 --2- 172.21.15.82:0/3620057954 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561718761e20 0x5617187560a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:09:02.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.494+0000 7f56ee59c700 1 -- 172.21.15.82:0/3620057954 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561718761e20 msgr2=0x5617187560a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:09:02.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.494+0000 7f56ee59c700 1 --2- 172.21.15.82:0/3620057954 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561718761e20 0x5617187560a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:09:02.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.494+0000 7f56ee59c700 1 -- 172.21.15.82:0/3620057954 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56171875bc40 msgr2=0x56171876c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:09:02.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.494+0000 7f56ee59c700 1 --2- 172.21.15.82:0/3620057954 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56171875bc40 0x56171876c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:09:02.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.494+0000 7f56ee59c700 1 -- 172.21.15.82:0/3620057954 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5617184c2c60 con 0x561718761500 2023-09-23T09:09:02.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.494+0000 7f56ee59c700 1 --2- 172.21.15.82:0/3620057954 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561718761500 0x561718765960 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f56e4005910 tx=0x7f56e4005960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95310bebb9499acc server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:09:02.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.494+0000 7f56d5ffb700 1 -- 172.21.15.82:0/3620057954 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e401d040 con 0x561718761500 2023-09-23T09:09:02.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.494+0000 7f56d5ffb700 1 -- 172.21.15.82:0/3620057954 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f56e4033ca0 con 0x561718761500 2023-09-23T09:09:02.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.494+0000 7f56d5ffb700 1 -- 172.21.15.82:0/3620057954 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e400f7e0 con 0x561718761500 2023-09-23T09:09:02.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.495+0000 7f5708b61b80 1 -- 172.21.15.82:0/3620057954 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561718761500 msgr2=0x561718765960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:09:02.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.495+0000 7f5708b61b80 1 --2- 172.21.15.82:0/3620057954 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561718761500 0x561718765960 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f56e4005910 tx=0x7f56e4005960 comp rx=0 tx=0).stop 2023-09-23T09:09:02.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.495+0000 7f5708b61b80 1 -- 172.21.15.82:0/3620057954 shutdown_connections 2023-09-23T09:09:02.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.495+0000 7f5708b61b80 1 --2- 172.21.15.82:0/3620057954 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561718761e20 0x5617187560a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:09:02.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.495+0000 7f5708b61b80 1 --2- 172.21.15.82:0/3620057954 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56171875bc40 0x56171876c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:09:02.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.495+0000 7f5708b61b80 1 --2- 172.21.15.82:0/3620057954 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561718761500 0x561718765960 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:09:02.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.495+0000 7f5708b61b80 1 -- 172.21.15.82:0/3620057954 >> 172.21.15.82:0/3620057954 conn(0x5617186d00e0 msgr2=0x561718771bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:09:02.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.495+0000 7f5708b61b80 1 -- 172.21.15.82:0/3620057954 shutdown_connections 2023-09-23T09:09:02.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.495+0000 7f5708b61b80 1 -- 172.21.15.82:0/3620057954 wait complete. 2023-09-23T09:09:02.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.496+0000 7f5708b61b80 1 -- start start 2023-09-23T09:09:02.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.496+0000 7f5708b61b80 1 Processor -- start 2023-09-23T09:09:02.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.497+0000 7f5708b61b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56171875bc40 0x56171876ab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:09:02.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.497+0000 7f5708b61b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561718761500 0x56171876b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:09:02.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.497+0000 7f5708b61b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561718761e20 0x5617187c8690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:09:02.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.497+0000 7f5708b61b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617187c8bd0 con 0x56171875bc40 2023-09-23T09:09:02.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.497+0000 7f5708b61b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617187c8d10 con 0x561718761500 2023-09-23T09:09:02.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.497+0000 7f5708b61b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617187c8e50 con 0x561718761e20 2023-09-23T09:09:02.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.497+0000 7f5708b61b80 10 client.0 _ll_register_callbacks cb 0x7f56e00987d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:09:02.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.497+0000 7f56eed9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56171875bc40 0x56171876ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:09:02.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.497+0000 7f56eed9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56171875bc40 0x56171876ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54458/0 (socket says 172.21.15.82:54458) 2023-09-23T09:09:02.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.497+0000 7f56eed9d700 1 -- 172.21.15.82:0/3077389171 learned_addr learned my addr 172.21.15.82:0/3077389171 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:09:02.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.497+0000 7f56ef59e700 1 --2- 172.21.15.82:0/3077389171 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561718761e20 0x5617187c8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:09:02.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.497+0000 7f56ee59c700 1 --2- 172.21.15.82:0/3077389171 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561718761500 0x56171876b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:09:02.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.497+0000 7f56eed9d700 1 -- 172.21.15.82:0/3077389171 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561718761e20 msgr2=0x5617187c8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:09:02.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.497+0000 7f56eed9d700 1 --2- 172.21.15.82:0/3077389171 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561718761e20 0x5617187c8690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:09:02.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.497+0000 7f56eed9d700 1 -- 172.21.15.82:0/3077389171 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561718761500 msgr2=0x56171876b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:09:02.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.497+0000 7f56eed9d700 1 --2- 172.21.15.82:0/3077389171 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561718761500 0x56171876b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:09:02.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.497+0000 7f56eed9d700 1 -- 172.21.15.82:0/3077389171 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56171852d630 con 0x56171875bc40 2023-09-23T09:09:02.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.498+0000 7f56eed9d700 1 --2- 172.21.15.82:0/3077389171 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56171875bc40 0x56171876ab10 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f56e0005bf0 tx=0x7f56e00b8340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d9ba83ab6173f44 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:09:02.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.498+0000 7f56d2ff5700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:09:02.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.498+0000 7f56d2ff5700 1 -- 172.21.15.82:0/3077389171 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e000cc10 con 0x56171875bc40 2023-09-23T09:09:02.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.498+0000 7f5708b61b80 1 -- 172.21.15.82:0/3077389171 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56171874e8b0 con 0x56171875bc40 2023-09-23T09:09:02.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.498+0000 7f56d2ff5700 1 -- 172.21.15.82:0/3077389171 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(99..99 src has 1..99) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f56e0064e10 con 0x56171875bc40 2023-09-23T09:09:02.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.498+0000 7f56d2ff5700 1 -- 172.21.15.82:0/3077389171 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) v2 ==== 24+0+0 (secure 0 0 0) 0x7f56e0099570 con 0x56171875bc40 2023-09-23T09:09:02.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.498+0000 7f5708b61b80 10 client.16446 fetch_fsmap learned FSMap version 65 2023-09-23T09:09:02.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.498+0000 7f5708b61b80 1 -- 172.21.15.82:0/3077389171 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=4+}) v3 -- 0x561718500250 con 0x56171875bc40 2023-09-23T09:09:02.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.498+0000 7f56d2ff5700 1 -- 172.21.15.82:0/3077389171 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56171874e8b0 con 0x56171875bc40 2023-09-23T09:09:02.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.498+0000 7f56d2ff5700 1 -- 172.21.15.82:0/3077389171 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 65) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f56e0097dd0 con 0x56171875bc40 2023-09-23T09:09:02.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.498+0000 7f5708b61b80 10 client.16446 fetch_fsmap finished waiting for FSMap version 65 2023-09-23T09:09:02.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.498+0000 7f5708b61b80 10 client.16446 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:09:02.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.498+0000 7f5708b61b80 20 client.16446 populate_metadata read hostname 'smithi082' 2023-09-23T09:09:02.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.498+0000 7f5708b61b80 1 --2- 172.21.15.82:0/3077389171 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5617187ca2f0 0x5617187cc710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:09:02.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.498+0000 7f5708b61b80 4 client.16446 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:09:02.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.498+0000 7f5708b61b80 1 -- 172.21.15.82:0/3077389171 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5617186a6970 con 0x5617187ca2f0 2023-09-23T09:09:02.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.499+0000 7f56ee59c700 1 --2- 172.21.15.82:0/3077389171 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5617187ca2f0 0x5617187cc710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:09:02.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.499+0000 7f56ee59c700 1 --2- 172.21.15.82:0/3077389171 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5617187ca2f0 0x5617187cc710 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2cc2fe04b85a6c03 server_cookie=65c009d42e8c03e5 in_seq=0 out_seq=0 2023-09-23T09:09:02.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.499+0000 7f56d2ff5700 10 client.16446 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:09:02.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.500+0000 7f56d2ff5700 1 -- 172.21.15.82:0/3077389171 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5617186a6970 con 0x5617187ca2f0 2023-09-23T09:09:02.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.500+0000 7f56d2ff5700 10 client.16446 handle_command_reply: tid=0 2023-09-23T09:09:02.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.500+0000 7f5708b61b80 1 client.16446 shutdown 2023-09-23T09:09:02.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.500+0000 7f5708b61b80 1 -- 172.21.15.82:0/3077389171 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56171875bc40 msgr2=0x56171876ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:09:02.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.500+0000 7f5708b61b80 1 --2- 172.21.15.82:0/3077389171 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56171875bc40 0x56171876ab10 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f56e0005bf0 tx=0x7f56e00b8340 comp rx=0 tx=0).stop 2023-09-23T09:09:02.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.500+0000 7f5708b61b80 1 -- 172.21.15.82:0/3077389171 shutdown_connections 2023-09-23T09:09:02.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.500+0000 7f5708b61b80 1 --2- 172.21.15.82:0/3077389171 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561718761e20 0x5617187c8690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:09:02.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.500+0000 7f5708b61b80 1 --2- 172.21.15.82:0/3077389171 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5617187ca2f0 0x5617187cc710 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:09:02.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.500+0000 7f5708b61b80 1 --2- 172.21.15.82:0/3077389171 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56171875bc40 0x56171876ab10 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:09:02.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.500+0000 7f5708b61b80 1 --2- 172.21.15.82:0/3077389171 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561718761500 0x56171876b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:09:02.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.500+0000 7f5708b61b80 1 -- 172.21.15.82:0/3077389171 >> 172.21.15.82:0/3077389171 conn(0x5617186d00e0 msgr2=0x5617187560a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:09:02.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.500+0000 7f56d2ff5700 0 client.16446 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:09:02.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.500+0000 7f5708b61b80 1 -- 172.21.15.82:0/3077389171 shutdown_connections 2023-09-23T09:09:02.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.500+0000 7f5708b61b80 1 -- 172.21.15.82:0/3077389171 wait complete. 2023-09-23T09:09:02.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.500+0000 7f5708b61b80 20 client.16446 trim_cache size 0 max 16384 2023-09-23T09:09:02.507 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:09:02.507 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "IDLE (waiting for more scrubs)", 2023-09-23T09:09:02.507 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:09:02.507 INFO:teuthology.orchestra.run.smithi082.stdout: "cba46b77-20dd-437c-a60a-ac01b400e1b8": { 2023-09-23T09:09:02.507 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:09:02.508 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "cba46b77-20dd-437c-a60a-ac01b400e1b8", 2023-09-23T09:09:02.508 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:09:02.508 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:09:02.508 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:09:02.508 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:09:02.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.501+0000 7f56f49fe700 1 -- 172.21.15.82:0/1966685855 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f56d80a0160 msgr2=0x7f56d80a2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:09:02.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.501+0000 7f56f49fe700 1 --2- 172.21.15.82:0/1966685855 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f56d80a0160 0x7f56d80a2620 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f56e8009ec0 tx=0x7f56e8004b40 comp rx=0 tx=0).stop 2023-09-23T09:09:02.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.501+0000 7f56f49fe700 1 -- 172.21.15.82:0/1966685855 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f56f0100710 msgr2=0x7f56f019e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:09:02.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.501+0000 7f56f49fe700 1 --2- 172.21.15.82:0/1966685855 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f56f0100710 0x7f56f019e5d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f56e000e9a0 tx=0x7f56e000ecb0 comp rx=0 tx=0).stop 2023-09-23T09:09:02.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.501+0000 7f56f49fe700 1 -- 172.21.15.82:0/1966685855 shutdown_connections 2023-09-23T09:09:02.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.501+0000 7f56f49fe700 1 --2- 172.21.15.82:0/1966685855 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f56d80a0160 0x7f56d80a2620 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:09:02.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.501+0000 7f56f49fe700 1 --2- 172.21.15.82:0/1966685855 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f56f0106720 0x7f56f0198690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:09:02.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.501+0000 7f56f49fe700 1 --2- 172.21.15.82:0/1966685855 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f56f0100710 0x7f56f019e5d0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:09:02.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.501+0000 7f56f49fe700 1 --2- 172.21.15.82:0/1966685855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56f01010d0 0x7f56f019eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:09:02.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.501+0000 7f56f49fe700 1 -- 172.21.15.82:0/1966685855 >> 172.21.15.82:0/1966685855 conn(0x7f56f00fc1e0 msgr2=0x7f56f010bae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:09:02.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.501+0000 7f56f49fe700 1 -- 172.21.15.82:0/1966685855 shutdown_connections 2023-09-23T09:09:02.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:02.501+0000 7f56f49fe700 1 -- 172.21.15.82:0/1966685855 wait complete. 2023-09-23T09:09:02.522 INFO:tasks.cephfs.filesystem:scrub status for tag:cba46b77-20dd-437c-a60a-ac01b400e1b8 - {'path': '/', 'tag': 'cba46b77-20dd-437c-a60a-ac01b400e1b8', 'options': 'recursive,force'} 2023-09-23T09:09:02.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:09:02 smithi161 ceph-mon[99580]: pgmap v377: 97 pgs: 97 active+clean; 8.2 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 859 KiB/s rd, 2.8 MiB/s wr, 285 op/s 2023-09-23T09:09:03.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:09:02 smithi135 ceph-mon[99205]: pgmap v377: 97 pgs: 97 active+clean; 8.2 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 859 KiB/s rd, 2.8 MiB/s wr, 285 op/s 2023-09-23T09:09:03.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:09:02 smithi082 ceph-mon[97694]: pgmap v377: 97 pgs: 97 active+clean; 8.2 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 859 KiB/s rd, 2.8 MiB/s wr, 285 op/s 2023-09-23T09:09:04.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:09:04 smithi161 ceph-mon[99580]: pgmap v378: 97 pgs: 97 active+clean; 8.2 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 859 KiB/s rd, 2.8 MiB/s wr, 285 op/s 2023-09-23T09:09:05.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:09:04 smithi135 ceph-mon[99205]: pgmap v378: 97 pgs: 97 active+clean; 8.2 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 859 KiB/s rd, 2.8 MiB/s wr, 285 op/s 2023-09-23T09:09:05.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:09:04 smithi082 ceph-mon[97694]: pgmap v378: 97 pgs: 97 active+clean; 8.2 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 859 KiB/s rd, 2.8 MiB/s wr, 285 op/s 2023-09-23T09:09:06.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:09:06 smithi161 ceph-mon[99580]: pgmap v379: 97 pgs: 97 active+clean; 8.2 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.2 MiB/s wr, 432 op/s 2023-09-23T09:09:07.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:09:06 smithi135 ceph-mon[99205]: pgmap v379: 97 pgs: 97 active+clean; 8.2 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.2 MiB/s wr, 432 op/s 2023-09-23T09:09:07.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:09:06 smithi082 ceph-mon[97694]: pgmap v379: 97 pgs: 97 active+clean; 8.2 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.2 MiB/s wr, 432 op/s 2023-09-23T09:09:08.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:09:07 smithi135 ceph-mon[99205]: osdmap e100: 12 total, 12 up, 12 in 2023-09-23T09:09:08.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:09:07 smithi082 ceph-mon[97694]: osdmap e100: 12 total, 12 up, 12 in 2023-09-23T09:09:08.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:09:07 smithi161 ceph-mon[99580]: osdmap e100: 12 total, 12 up, 12 in 2023-09-23T09:09:09.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:09:08 smithi135 ceph-mon[99205]: pgmap v381: 97 pgs: 97 active+clean; 8.2 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 1004 KiB/s rd, 3.3 MiB/s wr, 339 op/s 2023-09-23T09:09:09.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:09:08 smithi082 ceph-mon[97694]: pgmap v381: 97 pgs: 97 active+clean; 8.2 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 1004 KiB/s rd, 3.3 MiB/s wr, 339 op/s 2023-09-23T09:09:09.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:09:08 smithi161 ceph-mon[99580]: pgmap v381: 97 pgs: 97 active+clean; 8.2 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 1004 KiB/s rd, 3.3 MiB/s wr, 339 op/s 2023-09-23T09:09:11.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:09:10 smithi135 ceph-mon[99205]: pgmap v382: 97 pgs: 97 active+clean; 7.7 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 3.3 MiB/s wr, 340 op/s 2023-09-23T09:09:11.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:09:10 smithi082 ceph-mon[97694]: pgmap v382: 97 pgs: 97 active+clean; 7.7 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 3.3 MiB/s wr, 340 op/s 2023-09-23T09:09:11.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:09:10 smithi161 ceph-mon[99580]: pgmap v382: 97 pgs: 97 active+clean; 7.7 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 3.3 MiB/s wr, 340 op/s 2023-09-23T09:09:12.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:09:12 smithi161 ceph-mon[99580]: pgmap v383: 97 pgs: 97 active+clean; 7.7 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 3.3 MiB/s wr, 340 op/s 2023-09-23T09:09:12.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:09:12 smithi161 ceph-mon[99580]: osdmap e101: 12 total, 12 up, 12 in 2023-09-23T09:09:13.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:09:12 smithi135 ceph-mon[99205]: pgmap v383: 97 pgs: 97 active+clean; 7.7 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 3.3 MiB/s wr, 340 op/s 2023-09-23T09:09:13.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:09:12 smithi135 ceph-mon[99205]: osdmap e101: 12 total, 12 up, 12 in 2023-09-23T09:09:13.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:09:12 smithi082 ceph-mon[97694]: pgmap v383: 97 pgs: 97 active+clean; 7.7 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 3.3 MiB/s wr, 340 op/s 2023-09-23T09:09:13.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:09:12 smithi082 ceph-mon[97694]: osdmap e101: 12 total, 12 up, 12 in 2023-09-23T09:09:14.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:09:14 smithi161 ceph-mon[99580]: pgmap v385: 97 pgs: 97 active+clean; 7.7 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 665 KiB/s rd, 2.1 MiB/s wr, 204 op/s 2023-09-23T09:09:15.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:09:14 smithi135 ceph-mon[99205]: pgmap v385: 97 pgs: 97 active+clean; 7.7 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 665 KiB/s rd, 2.1 MiB/s wr, 204 op/s 2023-09-23T09:09:15.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:09:14 smithi082 ceph-mon[97694]: pgmap v385: 97 pgs: 97 active+clean; 7.7 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 665 KiB/s rd, 2.1 MiB/s wr, 204 op/s 2023-09-23T09:09:15.506 INFO:teuthology.orchestra.run.smithi082.stderr:38500000 of 50000000 tuples (77%) done (elapsed 710.25 s, remaining 212.15 s) 2023-09-23T09:09:17.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:09:16 smithi135 ceph-mon[99205]: pgmap v386: 97 pgs: 97 active+clean; 7.7 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.0 MiB/s wr, 396 op/s 2023-09-23T09:09:17.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:09:16 smithi082 ceph-mon[97694]: pgmap v386: 97 pgs: 97 active+clean; 7.7 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.0 MiB/s wr, 396 op/s 2023-09-23T09:09:17.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:09:16 smithi161 ceph-mon[99580]: pgmap v386: 97 pgs: 97 active+clean; 7.7 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.0 MiB/s wr, 396 op/s 2023-09-23T09:09:19.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:09:18 smithi135 ceph-mon[99205]: pgmap v387: 97 pgs: 97 active+clean; 7.7 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.5 MiB/s wr, 341 op/s 2023-09-23T09:09:19.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:09:18 smithi082 ceph-mon[97694]: pgmap v387: 97 pgs: 97 active+clean; 7.7 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.5 MiB/s wr, 341 op/s 2023-09-23T09:09:19.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:09:18 smithi161 ceph-mon[99580]: pgmap v387: 97 pgs: 97 active+clean; 7.7 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.5 MiB/s wr, 341 op/s 2023-09-23T09:09:21.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:09:20 smithi135 ceph-mon[99205]: pgmap v388: 97 pgs: 97 active+clean; 7.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.6 MiB/s wr, 348 op/s 2023-09-23T09:09:21.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:09:20 smithi082 ceph-mon[97694]: pgmap v388: 97 pgs: 97 active+clean; 7.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.6 MiB/s wr, 348 op/s 2023-09-23T09:09:21.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:09:20 smithi161 ceph-mon[99580]: pgmap v388: 97 pgs: 97 active+clean; 7.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.6 MiB/s wr, 348 op/s 2023-09-23T09:09:23.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:09:22 smithi135 ceph-mon[99205]: pgmap v389: 97 pgs: 97 active+clean; 7.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.6 MiB/s wr, 348 op/s 2023-09-23T09:09:23.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:09:22 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:09:23.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:09:22 smithi082 ceph-mon[97694]: pgmap v389: 97 pgs: 97 active+clean; 7.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.6 MiB/s wr, 348 op/s 2023-09-23T09:09:23.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:09:22 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:09:23.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:09:22 smithi161 ceph-mon[99580]: pgmap v389: 97 pgs: 97 active+clean; 7.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.6 MiB/s wr, 348 op/s 2023-09-23T09:09:23.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:09:22 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:09:24.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:09:23 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:09:24.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:09:23 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:09:24.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:09:23 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:09:24.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:09:23 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:09:24.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:09:23 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:09:24.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:09:23 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:09:24.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:09:23 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:09:24.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:09:23 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:09:24.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:09:23 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:09:25.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:09:24 smithi135 ceph-mon[99205]: pgmap v390: 97 pgs: 97 active+clean; 7.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 988 KiB/s rd, 3.1 MiB/s wr, 299 op/s 2023-09-23T09:09:25.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:09:24 smithi082 ceph-mon[97694]: pgmap v390: 97 pgs: 97 active+clean; 7.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 988 KiB/s rd, 3.1 MiB/s wr, 299 op/s 2023-09-23T09:09:25.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:09:24 smithi161 ceph-mon[99580]: pgmap v390: 97 pgs: 97 active+clean; 7.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 988 KiB/s rd, 3.1 MiB/s wr, 299 op/s 2023-09-23T09:09:27.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:09:26 smithi135 ceph-mon[99205]: pgmap v391: 97 pgs: 97 active+clean; 7.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.2 MiB/s wr, 417 op/s 2023-09-23T09:09:27.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:09:26 smithi082 ceph-mon[97694]: pgmap v391: 97 pgs: 97 active+clean; 7.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.2 MiB/s wr, 417 op/s 2023-09-23T09:09:27.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:09:26 smithi161 ceph-mon[99580]: pgmap v391: 97 pgs: 97 active+clean; 7.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.2 MiB/s wr, 417 op/s 2023-09-23T09:09:29.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:09:28 smithi135 ceph-mon[99205]: pgmap v392: 97 pgs: 97 active+clean; 7.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 837 KiB/s rd, 2.7 MiB/s wr, 269 op/s 2023-09-23T09:09:29.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:09:28 smithi082 ceph-mon[97694]: pgmap v392: 97 pgs: 97 active+clean; 7.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 837 KiB/s rd, 2.7 MiB/s wr, 269 op/s 2023-09-23T09:09:29.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:09:28 smithi161 ceph-mon[99580]: pgmap v392: 97 pgs: 97 active+clean; 7.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 837 KiB/s rd, 2.7 MiB/s wr, 269 op/s 2023-09-23T09:09:31.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:09:30 smithi135 ceph-mon[99205]: pgmap v393: 97 pgs: 97 active+clean; 7.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.1 MiB/s wr, 408 op/s 2023-09-23T09:09:31.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:09:30 smithi082 ceph-mon[97694]: pgmap v393: 97 pgs: 97 active+clean; 7.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.1 MiB/s wr, 408 op/s 2023-09-23T09:09:31.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:09:30 smithi161 ceph-mon[99580]: pgmap v393: 97 pgs: 97 active+clean; 7.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.1 MiB/s wr, 408 op/s 2023-09-23T09:09:31.235 INFO:teuthology.orchestra.run.smithi082.stderr:38600000 of 50000000 tuples (77%) done (elapsed 725.98 s, remaining 214.41 s) 2023-09-23T09:09:32.523 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:09:32.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.742+0000 7f5bf75ff700 1 -- 172.21.15.82:0/2498156233 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5bf0101a30 msgr2=0x7f5bf0101e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:09:32.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.742+0000 7f5bf75ff700 1 --2- 172.21.15.82:0/2498156233 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5bf0101a30 0x7f5bf0101e10 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f5bec009990 tx=0x7f5bec009ca0 comp rx=0 tx=0).stop 2023-09-23T09:09:32.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.742+0000 7f5bf75ff700 1 -- 172.21.15.82:0/2498156233 shutdown_connections 2023-09-23T09:09:32.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.742+0000 7f5bf75ff700 1 --2- 172.21.15.82:0/2498156233 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5bf010ae50 0x7f5bf010d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:09:32.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.742+0000 7f5bf75ff700 1 --2- 172.21.15.82:0/2498156233 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5bf0101a30 0x7f5bf0101e10 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:09:32.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.742+0000 7f5bf75ff700 1 --2- 172.21.15.82:0/2498156233 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5bf0102350 0x7f5bf010a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:09:32.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.742+0000 7f5bf75ff700 1 -- 172.21.15.82:0/2498156233 >> 172.21.15.82:0/2498156233 conn(0x7f5bf00fb270 msgr2=0x7f5bf00fd690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:09:32.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.742+0000 7f5bf75ff700 1 -- 172.21.15.82:0/2498156233 shutdown_connections 2023-09-23T09:09:32.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.742+0000 7f5bf75ff700 1 -- 172.21.15.82:0/2498156233 wait complete. 2023-09-23T09:09:32.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.744+0000 7f5bf75ff700 1 Processor -- start 2023-09-23T09:09:32.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.744+0000 7f5bf75ff700 1 -- start start 2023-09-23T09:09:32.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.744+0000 7f5bf75ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5bf0101a30 0x7f5bf00ff680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:09:32.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.744+0000 7f5bf75ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5bf0102350 0x7f5bf00ffbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:09:32.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.744+0000 7f5bf75ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5bf010ae50 0x7f5bf01a4b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:09:32.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.744+0000 7f5bf75ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf0100460 con 0x7f5bf0102350 2023-09-23T09:09:32.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.744+0000 7f5bf75ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf01a5070 con 0x7f5bf010ae50 2023-09-23T09:09:32.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.744+0000 7f5bf75ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf01a51b0 con 0x7f5bf0101a30 2023-09-23T09:09:32.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.744+0000 7f5bf4b9a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5bf0102350 0x7f5bf00ffbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:09:32.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.744+0000 7f5bf539b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5bf0101a30 0x7f5bf00ff680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:09:32.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.744+0000 7f5bf539b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5bf0101a30 0x7f5bf00ff680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:42756/0 (socket says 172.21.15.82:42756) 2023-09-23T09:09:32.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.744+0000 7f5bf539b700 1 -- 172.21.15.82:0/3050844131 learned_addr learned my addr 172.21.15.82:0/3050844131 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:09:32.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.745+0000 7f5bf5b9c700 1 --2- 172.21.15.82:0/3050844131 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5bf010ae50 0x7f5bf01a4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:09:32.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.745+0000 7f5bf4b9a700 1 -- 172.21.15.82:0/3050844131 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5bf0101a30 msgr2=0x7f5bf00ff680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:09:32.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.745+0000 7f5bf4b9a700 1 --2- 172.21.15.82:0/3050844131 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5bf0101a30 0x7f5bf00ff680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:09:32.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.745+0000 7f5bf4b9a700 1 -- 172.21.15.82:0/3050844131 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5bf010ae50 msgr2=0x7f5bf01a4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:09:32.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.745+0000 7f5bf4b9a700 1 --2- 172.21.15.82:0/3050844131 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5bf010ae50 0x7f5bf01a4b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:09:32.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.745+0000 7f5bf4b9a700 1 -- 172.21.15.82:0/3050844131 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bec0095f0 con 0x7f5bf0102350 2023-09-23T09:09:32.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.745+0000 7f5bf4b9a700 1 --2- 172.21.15.82:0/3050844131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5bf0102350 0x7f5bf00ffbc0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f5be000ea20 tx=0x7f5be000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:09:32.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.745+0000 7f5be67fc700 1 -- 172.21.15.82:0/3050844131 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be000c9c0 con 0x7f5bf0102350 2023-09-23T09:09:32.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.745+0000 7f5bf75ff700 1 -- 172.21.15.82:0/3050844131 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bf01a5460 con 0x7f5bf0102350 2023-09-23T09:09:32.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.745+0000 7f5be67fc700 1 -- 172.21.15.82:0/3050844131 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5be0010430 con 0x7f5bf0102350 2023-09-23T09:09:32.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.745+0000 7f5be67fc700 1 -- 172.21.15.82:0/3050844131 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be0018680 con 0x7f5bf0102350 2023-09-23T09:09:32.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.746+0000 7f5bf75ff700 1 -- 172.21.15.82:0/3050844131 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bf01a5970 con 0x7f5bf0102350 2023-09-23T09:09:32.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.749+0000 7f5be67fc700 1 -- 172.21.15.82:0/3050844131 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f5be00105a0 con 0x7f5bf0102350 2023-09-23T09:09:32.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.750+0000 7f5c0afccb80 1 Processor -- start 2023-09-23T09:09:32.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.750+0000 7f5be67fc700 1 --2- 172.21.15.82:0/3050844131 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f5bdc0a00c0 0x7f5bdc0a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:09:32.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.751+0000 7f5be67fc700 1 -- 172.21.15.82:0/3050844131 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f5be0014070 con 0x7f5bf0102350 2023-09-23T09:09:32.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.751+0000 7f5c0afccb80 1 -- start start 2023-09-23T09:09:32.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.751+0000 7f5bf5b9c700 1 --2- 172.21.15.82:0/3050844131 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f5bdc0a00c0 0x7f5bdc0a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:09:32.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.751+0000 7f5c0afccb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f8befa7380 0x55f8befa7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:09:32.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.751+0000 7f5c0afccb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8befa7ca0 0x55f8befa1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:09:32.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.751+0000 7f5c0afccb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f8befa1c40 0x55f8befa20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:09:32.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.751+0000 7f5c0afccb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8bef097b0 con 0x55f8befa7ca0 2023-09-23T09:09:32.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.751+0000 7f5c0afccb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8beefa780 con 0x55f8befa7380 2023-09-23T09:09:32.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.751+0000 7f5c0afccb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8beef80a0 con 0x55f8befa1c40 2023-09-23T09:09:32.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.751+0000 7f5bf539b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f8befa7380 0x55f8befa7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:09:32.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.751+0000 7f5bf4b9a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8befa7ca0 0x55f8befa1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:09:32.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.751+0000 7f5bf539b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f8befa7380 0x55f8befa7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:58928/0 (socket says 172.21.15.82:58928) 2023-09-23T09:09:32.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.751+0000 7f5bf539b700 1 -- 172.21.15.82:0/3535672599 learned_addr learned my addr 172.21.15.82:0/3535672599 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:09:32.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.751+0000 7f5bf4b9a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8befa7ca0 0x55f8befa1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35202/0 (socket says 172.21.15.82:35202) 2023-09-23T09:09:32.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.752+0000 7f5bf5b9c700 1 --2- 172.21.15.82:0/3535672599 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f8befa1c40 0x55f8befa20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:09:32.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.752+0000 7f5bf5b9c700 1 --2- 172.21.15.82:0/3050844131 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f5bdc0a00c0 0x7f5bdc0a2580 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5be800f590 tx=0x7f5be800b040 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:09:32.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.752+0000 7f5bf4b9a700 1 -- 172.21.15.82:0/3535672599 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f8befa1c40 msgr2=0x55f8befa20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:09:32.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.752+0000 7f5bf4b9a700 1 --2- 172.21.15.82:0/3535672599 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f8befa1c40 0x55f8befa20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:09:32.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.752+0000 7f5bf4b9a700 1 -- 172.21.15.82:0/3535672599 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f8befa7380 msgr2=0x55f8befa7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:09:32.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.752+0000 7f5bf4b9a700 1 --2- 172.21.15.82:0/3535672599 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f8befa7380 0x55f8befa7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:09:32.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.752+0000 7f5bf4b9a700 1 -- 172.21.15.82:0/3535672599 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f8bed73630 con 0x55f8befa7ca0 2023-09-23T09:09:32.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.752+0000 7f5bf539b700 1 --2- 172.21.15.82:0/3535672599 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f8befa7380 0x55f8befa7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:09:32.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.752+0000 7f5bf4b9a700 1 --2- 172.21.15.82:0/3535672599 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8befa7ca0 0x55f8befa1700 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f5be00c8df0 tx=0x7f5be0098a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27e6fcadbc127ee1 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:09:32.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.752+0000 7f5bdb7fe700 1 -- 172.21.15.82:0/3535672599 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be00994b0 con 0x55f8befa7ca0 2023-09-23T09:09:32.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.752+0000 7f5bdb7fe700 1 -- 172.21.15.82:0/3535672599 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5be0098db0 con 0x55f8befa7ca0 2023-09-23T09:09:32.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.752+0000 7f5bdb7fe700 1 -- 172.21.15.82:0/3535672599 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be0099270 con 0x55f8befa7ca0 2023-09-23T09:09:32.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.753+0000 7f5c0afccb80 1 -- 172.21.15.82:0/3535672599 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8befa7ca0 msgr2=0x55f8befa1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:09:32.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.753+0000 7f5c0afccb80 1 --2- 172.21.15.82:0/3535672599 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8befa7ca0 0x55f8befa1700 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f5be00c8df0 tx=0x7f5be0098a10 comp rx=0 tx=0).stop 2023-09-23T09:09:32.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.753+0000 7f5c0afccb80 1 -- 172.21.15.82:0/3535672599 shutdown_connections 2023-09-23T09:09:32.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.753+0000 7f5c0afccb80 1 --2- 172.21.15.82:0/3535672599 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f8befa1c40 0x55f8befa20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:09:32.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.753+0000 7f5c0afccb80 1 --2- 172.21.15.82:0/3535672599 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f8befa7380 0x55f8befa7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:09:32.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.753+0000 7f5c0afccb80 1 --2- 172.21.15.82:0/3535672599 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8befa7ca0 0x55f8befa1700 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:09:32.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.753+0000 7f5c0afccb80 1 -- 172.21.15.82:0/3535672599 >> 172.21.15.82:0/3535672599 conn(0x55f8bef160e0 msgr2=0x55f8bef9c410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:09:32.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.753+0000 7f5c0afccb80 1 -- 172.21.15.82:0/3535672599 shutdown_connections 2023-09-23T09:09:32.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.753+0000 7f5c0afccb80 1 -- 172.21.15.82:0/3535672599 wait complete. 2023-09-23T09:09:32.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.754+0000 7f5c0afccb80 1 -- start start 2023-09-23T09:09:32.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.754+0000 7f5c0afccb80 1 Processor -- start 2023-09-23T09:09:32.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.755+0000 7f5c0afccb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8befa1c40 0x55f8befadc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:09:32.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.755+0000 7f5c0afccb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f8befa7380 0x55f8befaaf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:09:32.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.755+0000 7f5c0afccb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f8befa7ca0 0x55f8befab670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:09:32.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.755+0000 7f5c0afccb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8beef3990 con 0x55f8befa1c40 2023-09-23T09:09:32.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.755+0000 7f5c0afccb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8bee91bb0 con 0x55f8befa7380 2023-09-23T09:09:32.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.755+0000 7f5c0afccb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8bee918b0 con 0x55f8befa7ca0 2023-09-23T09:09:32.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.755+0000 7f5c0afccb80 10 client.0 _ll_register_callbacks cb 0x55f8beddba80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:09:32.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.755+0000 7f5bf539b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8befa1c40 0x55f8befadc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:09:32.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.755+0000 7f5bf5b9c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f8befa7ca0 0x55f8befab670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:09:32.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.755+0000 7f5bf4b9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f8befa7380 0x55f8befaaf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:09:32.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.755+0000 7f5bf4b9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f8befa7380 0x55f8befaaf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:58936/0 (socket says 172.21.15.82:58936) 2023-09-23T09:09:32.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.755+0000 7f5bf539b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8befa1c40 0x55f8befadc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35216/0 (socket says 172.21.15.82:35216) 2023-09-23T09:09:32.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.755+0000 7f5bf4b9a700 1 -- 172.21.15.82:0/593310328 learned_addr learned my addr 172.21.15.82:0/593310328 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:09:32.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.755+0000 7f5bf5b9c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f8befa7ca0 0x55f8befab670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:42780/0 (socket says 172.21.15.82:42780) 2023-09-23T09:09:32.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.755+0000 7f5bf5b9c700 1 -- 172.21.15.82:0/593310328 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f8befa7380 msgr2=0x55f8befaaf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:09:32.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.755+0000 7f5bf5b9c700 1 --2- 172.21.15.82:0/593310328 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f8befa7380 0x55f8befaaf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:09:32.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.755+0000 7f5bf5b9c700 1 -- 172.21.15.82:0/593310328 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8befa1c40 msgr2=0x55f8befadc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:09:32.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.755+0000 7f5bf5b9c700 1 --2- 172.21.15.82:0/593310328 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8befa1c40 0x55f8befadc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:09:32.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.755+0000 7f5bf5b9c700 1 -- 172.21.15.82:0/593310328 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bf010dfd0 con 0x55f8befa7ca0 2023-09-23T09:09:32.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.755+0000 7f5bf539b700 1 --2- 172.21.15.82:0/593310328 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8befa1c40 0x55f8befadc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:09:32.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.756+0000 7f5bf5b9c700 1 --2- 172.21.15.82:0/593310328 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f8befa7ca0 0x55f8befab670 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5be8009fd0 tx=0x7f5be8004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=117ae4a2f085d3b3 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:09:32.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.756+0000 7f5bd8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T09:09:32.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.756+0000 7f5bd8ff9700 1 -- 172.21.15.82:0/593310328 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be800e040 con 0x55f8befa7ca0 2023-09-23T09:09:32.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.756+0000 7f5bd8ff9700 1 -- 172.21.15.82:0/593310328 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f5be801c040 con 0x55f8befa7ca0 2023-09-23T09:09:32.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.756+0000 7f5c0afccb80 1 -- 172.21.15.82:0/593310328 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f8bef711c0 con 0x55f8befa7ca0 2023-09-23T09:09:32.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.756+0000 7f5bd8ff9700 1 -- 172.21.15.82:0/593310328 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5be8015d60 con 0x55f8befa7ca0 2023-09-23T09:09:32.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.756+0000 7f5c0afccb80 10 client.26188 fetch_fsmap learned FSMap version 65 2023-09-23T09:09:32.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.756+0000 7f5c0afccb80 1 -- 172.21.15.82:0/593310328 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=4+}) v3 -- 0x7f5bf01a5970 con 0x55f8befa7ca0 2023-09-23T09:09:32.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.757+0000 7f5bd8ff9700 1 -- 172.21.15.82:0/593310328 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f8bef711c0 con 0x55f8befa7ca0 2023-09-23T09:09:32.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.757+0000 7f5bd8ff9700 1 -- 172.21.15.82:0/593310328 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 65) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f5be80044a0 con 0x55f8befa7ca0 2023-09-23T09:09:32.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.757+0000 7f5c0afccb80 10 client.26188 fetch_fsmap finished waiting for FSMap version 65 2023-09-23T09:09:32.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.757+0000 7f5c0afccb80 10 client.26188 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:09:32.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.757+0000 7f5c0afccb80 20 client.26188 populate_metadata read hostname 'smithi082' 2023-09-23T09:09:32.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.757+0000 7f5c0afccb80 1 --2- 172.21.15.82:0/593310328 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55f8befbb730 0x55f8befbdb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:09:32.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.757+0000 7f5c0afccb80 4 client.26188 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:09:32.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.757+0000 7f5c0afccb80 1 -- 172.21.15.82:0/593310328 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f8bee99ba0 con 0x55f8befbb730 2023-09-23T09:09:32.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.758+0000 7f5bf539b700 1 --2- 172.21.15.82:0/593310328 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55f8befbb730 0x55f8befbdb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:09:32.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.758+0000 7f5bd8ff9700 10 client.26188 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:09:32.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.758+0000 7f5bf539b700 1 --2- 172.21.15.82:0/593310328 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55f8befbb730 0x55f8befbdb50 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6068189522d4417 server_cookie=c4d15f0488281f2d in_seq=0 out_seq=0 2023-09-23T09:09:32.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.759+0000 7f5bd8ff9700 1 -- 172.21.15.82:0/593310328 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f8bee99ba0 con 0x55f8befbb730 2023-09-23T09:09:32.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.759+0000 7f5bd8ff9700 10 client.26188 handle_command_reply: tid=0 2023-09-23T09:09:32.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.759+0000 7f5c0afccb80 1 client.26188 shutdown 2023-09-23T09:09:32.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.759+0000 7f5c0afccb80 1 -- 172.21.15.82:0/593310328 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f8befa7ca0 msgr2=0x55f8befab670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:09:32.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.759+0000 7f5c0afccb80 1 --2- 172.21.15.82:0/593310328 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f8befa7ca0 0x55f8befab670 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5be8009fd0 tx=0x7f5be8004ad0 comp rx=0 tx=0).stop 2023-09-23T09:09:32.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.759+0000 7f5c0afccb80 1 -- 172.21.15.82:0/593310328 shutdown_connections 2023-09-23T09:09:32.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.759+0000 7f5c0afccb80 1 --2- 172.21.15.82:0/593310328 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f8befa7ca0 0x55f8befab670 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:09:32.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.759+0000 7f5c0afccb80 1 --2- 172.21.15.82:0/593310328 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55f8befbb730 0x55f8befbdb50 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:09:32.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.759+0000 7f5c0afccb80 1 --2- 172.21.15.82:0/593310328 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8befa1c40 0x55f8befadc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:09:32.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.759+0000 7f5c0afccb80 1 --2- 172.21.15.82:0/593310328 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f8befa7380 0x55f8befaaf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:09:32.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.759+0000 7f5bd8ff9700 0 client.26188 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:09:32.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.759+0000 7f5c0afccb80 1 -- 172.21.15.82:0/593310328 >> 172.21.15.82:0/593310328 conn(0x55f8bef160e0 msgr2=0x55f8bef96b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:09:32.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.759+0000 7f5c0afccb80 1 -- 172.21.15.82:0/593310328 shutdown_connections 2023-09-23T09:09:32.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.759+0000 7f5c0afccb80 1 -- 172.21.15.82:0/593310328 wait complete. 2023-09-23T09:09:32.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.760+0000 7f5c0afccb80 20 client.26188 trim_cache size 0 max 16384 2023-09-23T09:09:32.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.779+0000 7f5c0afccb80 1 Processor -- start 2023-09-23T09:09:32.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.779+0000 7f5c0afccb80 1 -- start start 2023-09-23T09:09:32.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.779+0000 7f5c0afccb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8befa1c40 0x55f8befa1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:09:32.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.779+0000 7f5c0afccb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f8befa7380 0x55f8befad830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:09:32.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.779+0000 7f5c0afccb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f8befa7ca0 0x55f8befa5190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:09:32.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.779+0000 7f5c0afccb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8bed75920 con 0x55f8befa1c40 2023-09-23T09:09:32.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.779+0000 7f5c0afccb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8befb8e10 con 0x55f8befa7ca0 2023-09-23T09:09:32.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.779+0000 7f5c0afccb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8bef9dd40 con 0x55f8befa7380 2023-09-23T09:09:32.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.780+0000 7f5bf539b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8befa1c40 0x55f8befa1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:09:32.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.780+0000 7f5bf539b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8befa1c40 0x55f8befa1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35226/0 (socket says 172.21.15.82:35226) 2023-09-23T09:09:32.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.780+0000 7f5bf539b700 1 -- 172.21.15.82:0/3805457494 learned_addr learned my addr 172.21.15.82:0/3805457494 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:09:32.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.780+0000 7f5bf5b9c700 1 --2- 172.21.15.82:0/3805457494 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f8befa7ca0 0x55f8befa5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:09:32.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.780+0000 7f5bf4b9a700 1 --2- 172.21.15.82:0/3805457494 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f8befa7380 0x55f8befad830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:09:32.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.780+0000 7f5bf539b700 1 -- 172.21.15.82:0/3805457494 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f8befa7380 msgr2=0x55f8befad830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:09:32.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.780+0000 7f5bf539b700 1 --2- 172.21.15.82:0/3805457494 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f8befa7380 0x55f8befad830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:09:32.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.780+0000 7f5bf539b700 1 -- 172.21.15.82:0/3805457494 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f8befa7ca0 msgr2=0x55f8befa5190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:09:32.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.780+0000 7f5bf539b700 1 --2- 172.21.15.82:0/3805457494 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f8befa7ca0 0x55f8befa5190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:09:32.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.780+0000 7f5bf539b700 1 -- 172.21.15.82:0/3805457494 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f8bed1fde0 con 0x55f8befa1c40 2023-09-23T09:09:32.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.780+0000 7f5bf539b700 1 --2- 172.21.15.82:0/3805457494 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8befa1c40 0x55f8befa1700 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f5bec005930 tx=0x7f5bec009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66d8f2883ed3650d server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:09:32.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.780+0000 7f5bdbfff700 1 -- 172.21.15.82:0/3805457494 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bec01d070 con 0x55f8befa1c40 2023-09-23T09:09:32.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.781+0000 7f5bdbfff700 1 -- 172.21.15.82:0/3805457494 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5bec01e040 con 0x55f8befa1c40 2023-09-23T09:09:32.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.781+0000 7f5bdbfff700 1 -- 172.21.15.82:0/3805457494 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bec00f460 con 0x55f8befa1c40 2023-09-23T09:09:32.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.781+0000 7f5c0afccb80 1 -- 172.21.15.82:0/3805457494 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8befa1c40 msgr2=0x55f8befa1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:09:32.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.781+0000 7f5c0afccb80 1 --2- 172.21.15.82:0/3805457494 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8befa1c40 0x55f8befa1700 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f5bec005930 tx=0x7f5bec009310 comp rx=0 tx=0).stop 2023-09-23T09:09:32.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.781+0000 7f5c0afccb80 1 -- 172.21.15.82:0/3805457494 shutdown_connections 2023-09-23T09:09:32.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.781+0000 7f5c0afccb80 1 --2- 172.21.15.82:0/3805457494 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f8befa7ca0 0x55f8befa5190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:09:32.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.781+0000 7f5c0afccb80 1 --2- 172.21.15.82:0/3805457494 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8befa1c40 0x55f8befa1700 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:09:32.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.781+0000 7f5c0afccb80 1 --2- 172.21.15.82:0/3805457494 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f8befa7380 0x55f8befad830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:09:32.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.781+0000 7f5c0afccb80 1 -- 172.21.15.82:0/3805457494 >> 172.21.15.82:0/3805457494 conn(0x55f8bef160e0 msgr2=0x55f8befb7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:09:32.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.781+0000 7f5c0afccb80 1 -- 172.21.15.82:0/3805457494 shutdown_connections 2023-09-23T09:09:32.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.781+0000 7f5c0afccb80 1 -- 172.21.15.82:0/3805457494 wait complete. 2023-09-23T09:09:32.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.782+0000 7f5c0afccb80 1 -- start start 2023-09-23T09:09:32.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.782+0000 7f5c0afccb80 1 Processor -- start 2023-09-23T09:09:32.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.782+0000 7f5c0afccb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8befa1c40 0x55f8befb0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:09:32.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.782+0000 7f5c0afccb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f8befa7380 0x55f8befb0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:09:32.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.783+0000 7f5c0afccb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f8befa7ca0 0x55f8bf00e560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:09:32.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.783+0000 7f5c0afccb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8bf00eaa0 con 0x55f8befa1c40 2023-09-23T09:09:32.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.783+0000 7f5c0afccb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8bf00ebe0 con 0x55f8befa7380 2023-09-23T09:09:32.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.783+0000 7f5c0afccb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8bf00ed50 con 0x55f8befa7ca0 2023-09-23T09:09:32.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.783+0000 7f5c0afccb80 10 client.0 _ll_register_callbacks cb 0x7f5be8017b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:09:32.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.783+0000 7f5bf539b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8befa1c40 0x55f8befb0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:09:32.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.783+0000 7f5bf539b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8befa1c40 0x55f8befb0910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35238/0 (socket says 172.21.15.82:35238) 2023-09-23T09:09:32.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.783+0000 7f5bf539b700 1 -- 172.21.15.82:0/1211473847 learned_addr learned my addr 172.21.15.82:0/1211473847 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:09:32.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.783+0000 7f5bf4b9a700 1 --2- 172.21.15.82:0/1211473847 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f8befa7380 0x55f8befb0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:09:32.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.783+0000 7f5bf5b9c700 1 --2- 172.21.15.82:0/1211473847 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f8befa7ca0 0x55f8bf00e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:09:32.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.783+0000 7f5bf539b700 1 -- 172.21.15.82:0/1211473847 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f8befa7ca0 msgr2=0x55f8bf00e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:09:32.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.783+0000 7f5bf539b700 1 --2- 172.21.15.82:0/1211473847 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f8befa7ca0 0x55f8bf00e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:09:32.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.783+0000 7f5bf539b700 1 -- 172.21.15.82:0/1211473847 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f8befa7380 msgr2=0x55f8befb0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:09:32.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.783+0000 7f5bf539b700 1 --2- 172.21.15.82:0/1211473847 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f8befa7380 0x55f8befb0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:09:32.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.783+0000 7f5bf539b700 1 -- 172.21.15.82:0/1211473847 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bec005470 con 0x55f8befa1c40 2023-09-23T09:09:32.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.783+0000 7f5bf5b9c700 1 --2- 172.21.15.82:0/1211473847 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f8befa7ca0 0x55f8bf00e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:09:32.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.783+0000 7f5bf4b9a700 1 --2- 172.21.15.82:0/1211473847 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f8befa7380 0x55f8befb0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:09:32.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.783+0000 7f5bf539b700 1 --2- 172.21.15.82:0/1211473847 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8befa1c40 0x55f8befb0910 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f5bec02e040 tx=0x7f5bec005cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae7dcf04514fe4fa server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:09:32.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.783+0000 7f5bd8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:09:32.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.784+0000 7f5bd8ff9700 1 -- 172.21.15.82:0/1211473847 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bec01d070 con 0x55f8befa1c40 2023-09-23T09:09:32.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.784+0000 7f5c0afccb80 1 -- 172.21.15.82:0/1211473847 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f8bef948b0 con 0x55f8befa1c40 2023-09-23T09:09:32.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.784+0000 7f5bd8ff9700 1 -- 172.21.15.82:0/1211473847 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f5bec004700 con 0x55f8befa1c40 2023-09-23T09:09:32.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.784+0000 7f5bd8ff9700 1 -- 172.21.15.82:0/1211473847 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5bec0048c0 con 0x55f8befa1c40 2023-09-23T09:09:32.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.784+0000 7f5c0afccb80 10 client.16464 fetch_fsmap learned FSMap version 65 2023-09-23T09:09:32.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.784+0000 7f5c0afccb80 1 -- 172.21.15.82:0/1211473847 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=4+}) v3 -- 0x55f8bed08c60 con 0x55f8befa1c40 2023-09-23T09:09:32.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.784+0000 7f5bd8ff9700 1 -- 172.21.15.82:0/1211473847 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5bec040080 con 0x55f8befa1c40 2023-09-23T09:09:32.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.784+0000 7f5bd8ff9700 1 -- 172.21.15.82:0/1211473847 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 65) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f5bec03a030 con 0x55f8befa1c40 2023-09-23T09:09:32.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.784+0000 7f5c0afccb80 10 client.16464 fetch_fsmap finished waiting for FSMap version 65 2023-09-23T09:09:32.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.784+0000 7f5c0afccb80 10 client.16464 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:09:32.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.784+0000 7f5c0afccb80 20 client.16464 populate_metadata read hostname 'smithi082' 2023-09-23T09:09:32.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.784+0000 7f5c0afccb80 1 --2- 172.21.15.82:0/1211473847 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55f8bf0100b0 0x55f8bf0124d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:09:32.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.784+0000 7f5c0afccb80 4 client.16464 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:09:32.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.784+0000 7f5c0afccb80 1 -- 172.21.15.82:0/1211473847 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55f8beeec970 con 0x55f8bf0100b0 2023-09-23T09:09:32.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.785+0000 7f5bf4b9a700 1 --2- 172.21.15.82:0/1211473847 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55f8bf0100b0 0x55f8bf0124d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:09:32.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.785+0000 7f5bf4b9a700 1 --2- 172.21.15.82:0/1211473847 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55f8bf0100b0 0x55f8bf0124d0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7da34146db99fca4 server_cookie=95d5e56dc43e0109 in_seq=0 out_seq=0 2023-09-23T09:09:32.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.785+0000 7f5bd8ff9700 10 client.16464 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:09:32.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.785+0000 7f5bd8ff9700 1 -- 172.21.15.82:0/1211473847 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55f8beeec970 con 0x55f8bf0100b0 2023-09-23T09:09:32.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.785+0000 7f5bd8ff9700 10 client.16464 handle_command_reply: tid=0 2023-09-23T09:09:32.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.785+0000 7f5c0afccb80 1 client.16464 shutdown 2023-09-23T09:09:32.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.786+0000 7f5c0afccb80 1 -- 172.21.15.82:0/1211473847 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8befa1c40 msgr2=0x55f8befb0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:09:32.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.786+0000 7f5c0afccb80 1 --2- 172.21.15.82:0/1211473847 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8befa1c40 0x55f8befb0910 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f5bec02e040 tx=0x7f5bec005cd0 comp rx=0 tx=0).stop 2023-09-23T09:09:32.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.786+0000 7f5c0afccb80 1 -- 172.21.15.82:0/1211473847 shutdown_connections 2023-09-23T09:09:32.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.786+0000 7f5c0afccb80 1 --2- 172.21.15.82:0/1211473847 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f8befa7ca0 0x55f8bf00e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:09:32.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.786+0000 7f5c0afccb80 1 --2- 172.21.15.82:0/1211473847 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55f8bf0100b0 0x55f8bf0124d0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:09:32.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.786+0000 7f5c0afccb80 1 --2- 172.21.15.82:0/1211473847 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8befa1c40 0x55f8befb0910 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:09:32.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.786+0000 7f5c0afccb80 1 --2- 172.21.15.82:0/1211473847 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f8befa7380 0x55f8befb0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:09:32.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.786+0000 7f5c0afccb80 1 -- 172.21.15.82:0/1211473847 >> 172.21.15.82:0/1211473847 conn(0x55f8bef160e0 msgr2=0x55f8befa5190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:09:32.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.786+0000 7f5bd8ff9700 0 client.16464 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:09:32.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.786+0000 7f5c0afccb80 1 -- 172.21.15.82:0/1211473847 shutdown_connections 2023-09-23T09:09:32.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.786+0000 7f5c0afccb80 1 -- 172.21.15.82:0/1211473847 wait complete. 2023-09-23T09:09:32.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.786+0000 7f5c0afccb80 20 client.16464 trim_cache size 0 max 16384 2023-09-23T09:09:32.794 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:09:32.794 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "IDLE (waiting for more scrubs)", 2023-09-23T09:09:32.794 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:09:32.794 INFO:teuthology.orchestra.run.smithi082.stdout: "cba46b77-20dd-437c-a60a-ac01b400e1b8": { 2023-09-23T09:09:32.794 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:09:32.795 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "cba46b77-20dd-437c-a60a-ac01b400e1b8", 2023-09-23T09:09:32.795 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:09:32.795 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:09:32.795 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:09:32.795 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:09:32.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.787+0000 7f5bf75ff700 1 -- 172.21.15.82:0/3050844131 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f5bdc0a00c0 msgr2=0x7f5bdc0a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:09:32.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.787+0000 7f5bf75ff700 1 --2- 172.21.15.82:0/3050844131 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f5bdc0a00c0 0x7f5bdc0a2580 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5be800f590 tx=0x7f5be800b040 comp rx=0 tx=0).stop 2023-09-23T09:09:32.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.787+0000 7f5bf75ff700 1 -- 172.21.15.82:0/3050844131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5bf0102350 msgr2=0x7f5bf00ffbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:09:32.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.787+0000 7f5bf75ff700 1 --2- 172.21.15.82:0/3050844131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5bf0102350 0x7f5bf00ffbc0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f5be000ea20 tx=0x7f5be000ed30 comp rx=0 tx=0).stop 2023-09-23T09:09:32.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.787+0000 7f5bf75ff700 1 -- 172.21.15.82:0/3050844131 shutdown_connections 2023-09-23T09:09:32.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.787+0000 7f5bf75ff700 1 --2- 172.21.15.82:0/3050844131 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f5bdc0a00c0 0x7f5bdc0a2580 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:09:32.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.787+0000 7f5bf75ff700 1 --2- 172.21.15.82:0/3050844131 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5bf010ae50 0x7f5bf01a4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:09:32.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.787+0000 7f5bf75ff700 1 --2- 172.21.15.82:0/3050844131 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5bf0101a30 0x7f5bf00ff680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:09:32.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.787+0000 7f5bf75ff700 1 --2- 172.21.15.82:0/3050844131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5bf0102350 0x7f5bf00ffbc0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:09:32.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.787+0000 7f5bf75ff700 1 -- 172.21.15.82:0/3050844131 >> 172.21.15.82:0/3050844131 conn(0x7f5bf00fb270 msgr2=0x7f5bf00fbf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:09:32.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.787+0000 7f5bf75ff700 1 -- 172.21.15.82:0/3050844131 shutdown_connections 2023-09-23T09:09:32.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:09:32.787+0000 7f5bf75ff700 1 -- 172.21.15.82:0/3050844131 wait complete. 2023-09-23T09:09:32.807 INFO:tasks.cephfs.filesystem:scrub status for tag:cba46b77-20dd-437c-a60a-ac01b400e1b8 - {'path': '/', 'tag': 'cba46b77-20dd-437c-a60a-ac01b400e1b8', 'options': 'recursive,force'} 2023-09-23T09:09:32.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:09:32 smithi082 ceph-mon[97694]: pgmap v394: 97 pgs: 97 active+clean; 7.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 821 KiB/s rd, 2.7 MiB/s wr, 266 op/s 2023-09-23T09:09:33.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:09:32 smithi135 ceph-mon[99205]: pgmap v394: 97 pgs: 97 active+clean; 7.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 821 KiB/s rd, 2.7 MiB/s wr, 266 op/s 2023-09-23T09:09:33.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:09:32 smithi161 ceph-mon[99580]: pgmap v394: 97 pgs: 97 active+clean; 7.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 821 KiB/s rd, 2.7 MiB/s wr, 266 op/s 2023-09-23T09:09:35.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:09:34 smithi135 ceph-mon[99205]: pgmap v395: 97 pgs: 97 active+clean; 7.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 821 KiB/s rd, 2.7 MiB/s wr, 266 op/s 2023-09-23T09:09:35.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:09:34 smithi082 ceph-mon[97694]: pgmap v395: 97 pgs: 97 active+clean; 7.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 821 KiB/s rd, 2.7 MiB/s wr, 266 op/s 2023-09-23T09:09:35.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:09:34 smithi161 ceph-mon[99580]: pgmap v395: 97 pgs: 97 active+clean; 7.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 821 KiB/s rd, 2.7 MiB/s wr, 266 op/s 2023-09-23T09:09:37.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:09:36 smithi135 ceph-mon[99205]: pgmap v396: 97 pgs: 97 active+clean; 7.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.2 MiB/s wr, 417 op/s 2023-09-23T09:09:37.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:09:36 smithi082 ceph-mon[97694]: pgmap v396: 97 pgs: 97 active+clean; 7.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.2 MiB/s wr, 417 op/s 2023-09-23T09:09:37.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:09:36 smithi161 ceph-mon[99580]: pgmap v396: 97 pgs: 97 active+clean; 7.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.2 MiB/s wr, 417 op/s 2023-09-23T09:09:39.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:09:38 smithi135 ceph-mon[99205]: pgmap v397: 97 pgs: 97 active+clean; 7.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 961 KiB/s rd, 2.9 MiB/s wr, 291 op/s 2023-09-23T09:09:39.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:09:38 smithi082 ceph-mon[97694]: pgmap v397: 97 pgs: 97 active+clean; 7.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 961 KiB/s rd, 2.9 MiB/s wr, 291 op/s 2023-09-23T09:09:39.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:09:38 smithi161 ceph-mon[99580]: pgmap v397: 97 pgs: 97 active+clean; 7.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 961 KiB/s rd, 2.9 MiB/s wr, 291 op/s 2023-09-23T09:09:41.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:09:40 smithi135 ceph-mon[99205]: pgmap v398: 97 pgs: 97 active+clean; 7.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.5 MiB/s wr, 444 op/s 2023-09-23T09:09:41.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:09:40 smithi082 ceph-mon[97694]: pgmap v398: 97 pgs: 97 active+clean; 7.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.5 MiB/s wr, 444 op/s 2023-09-23T09:09:41.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:09:40 smithi161 ceph-mon[99580]: pgmap v398: 97 pgs: 97 active+clean; 7.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.5 MiB/s wr, 444 op/s 2023-09-23T09:09:43.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:09:42 smithi135 ceph-mon[99205]: pgmap v399: 97 pgs: 97 active+clean; 7.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1012 KiB/s rd, 3.1 MiB/s wr, 304 op/s 2023-09-23T09:09:43.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:09:42 smithi082 ceph-mon[97694]: pgmap v399: 97 pgs: 97 active+clean; 7.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1012 KiB/s rd, 3.1 MiB/s wr, 304 op/s 2023-09-23T09:09:43.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:09:42 smithi161 ceph-mon[99580]: pgmap v399: 97 pgs: 97 active+clean; 7.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1012 KiB/s rd, 3.1 MiB/s wr, 304 op/s 2023-09-23T09:09:45.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:09:44 smithi135 ceph-mon[99205]: pgmap v400: 97 pgs: 97 active+clean; 7.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1012 KiB/s rd, 3.1 MiB/s wr, 304 op/s 2023-09-23T09:09:45.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:09:44 smithi082 ceph-mon[97694]: pgmap v400: 97 pgs: 97 active+clean; 7.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1012 KiB/s rd, 3.1 MiB/s wr, 304 op/s 2023-09-23T09:09:45.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:09:44 smithi161 ceph-mon[99580]: pgmap v400: 97 pgs: 97 active+clean; 7.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1012 KiB/s rd, 3.1 MiB/s wr, 304 op/s 2023-09-23T09:09:45.873 INFO:teuthology.orchestra.run.smithi082.stderr:38700000 of 50000000 tuples (77%) done (elapsed 740.62 s, remaining 216.25 s) 2023-09-23T09:09:46.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:09:45 smithi135 ceph-mon[99205]: pgmap v401: 97 pgs: 97 active+clean; 7.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.6 MiB/s wr, 449 op/s 2023-09-23T09:09:46.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:09:45 smithi082 ceph-mon[97694]: pgmap v401: 97 pgs: 97 active+clean; 7.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.6 MiB/s wr, 449 op/s 2023-09-23T09:09:46.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:09:45 smithi161 ceph-mon[99580]: pgmap v401: 97 pgs: 97 active+clean; 7.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.6 MiB/s wr, 449 op/s 2023-09-23T09:09:49.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:09:48 smithi135 ceph-mon[99205]: pgmap v402: 97 pgs: 97 active+clean; 7.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 987 KiB/s rd, 3.0 MiB/s wr, 298 op/s 2023-09-23T09:09:49.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:09:48 smithi082 ceph-mon[97694]: pgmap v402: 97 pgs: 97 active+clean; 7.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 987 KiB/s rd, 3.0 MiB/s wr, 298 op/s 2023-09-23T09:09:49.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:09:48 smithi161 ceph-mon[99580]: pgmap v402: 97 pgs: 97 active+clean; 7.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 987 KiB/s rd, 3.0 MiB/s wr, 298 op/s 2023-09-23T09:09:51.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:09:50 smithi135 ceph-mon[99205]: pgmap v403: 97 pgs: 97 active+clean; 7.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.5 MiB/s wr, 443 op/s 2023-09-23T09:09:51.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:09:50 smithi082 ceph-mon[97694]: pgmap v403: 97 pgs: 97 active+clean; 7.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.5 MiB/s wr, 443 op/s 2023-09-23T09:09:51.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:09:50 smithi161 ceph-mon[99580]: pgmap v403: 97 pgs: 97 active+clean; 7.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.5 MiB/s wr, 443 op/s 2023-09-23T09:09:53.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:09:52 smithi135 ceph-mon[99205]: pgmap v404: 97 pgs: 97 active+clean; 7.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 957 KiB/s rd, 3.0 MiB/s wr, 290 op/s 2023-09-23T09:09:53.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:09:52 smithi082 ceph-mon[97694]: pgmap v404: 97 pgs: 97 active+clean; 7.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 957 KiB/s rd, 3.0 MiB/s wr, 290 op/s 2023-09-23T09:09:53.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:09:52 smithi161 ceph-mon[99580]: pgmap v404: 97 pgs: 97 active+clean; 7.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 957 KiB/s rd, 3.0 MiB/s wr, 290 op/s 2023-09-23T09:09:55.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:09:54 smithi135 ceph-mon[99205]: pgmap v405: 97 pgs: 97 active+clean; 7.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 957 KiB/s rd, 3.0 MiB/s wr, 290 op/s 2023-09-23T09:09:55.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:09:54 smithi082 ceph-mon[97694]: pgmap v405: 97 pgs: 97 active+clean; 7.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 957 KiB/s rd, 3.0 MiB/s wr, 290 op/s 2023-09-23T09:09:55.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:09:54 smithi161 ceph-mon[99580]: pgmap v405: 97 pgs: 97 active+clean; 7.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 957 KiB/s rd, 3.0 MiB/s wr, 290 op/s 2023-09-23T09:09:57.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:09:56 smithi135 ceph-mon[99205]: pgmap v406: 97 pgs: 97 active+clean; 7.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.4 MiB/s wr, 436 op/s 2023-09-23T09:09:57.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:09:56 smithi082 ceph-mon[97694]: pgmap v406: 97 pgs: 97 active+clean; 7.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.4 MiB/s wr, 436 op/s 2023-09-23T09:09:57.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:09:56 smithi161 ceph-mon[99580]: pgmap v406: 97 pgs: 97 active+clean; 7.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.4 MiB/s wr, 436 op/s 2023-09-23T09:09:59.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:09:58 smithi135 ceph-mon[99205]: pgmap v407: 97 pgs: 97 active+clean; 7.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 957 KiB/s rd, 3.0 MiB/s wr, 291 op/s 2023-09-23T09:09:59.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:09:58 smithi082 ceph-mon[97694]: pgmap v407: 97 pgs: 97 active+clean; 7.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 957 KiB/s rd, 3.0 MiB/s wr, 291 op/s 2023-09-23T09:09:59.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:09:58 smithi161 ceph-mon[99580]: pgmap v407: 97 pgs: 97 active+clean; 7.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 957 KiB/s rd, 3.0 MiB/s wr, 291 op/s 2023-09-23T09:10:00.621 INFO:teuthology.orchestra.run.smithi082.stderr:38800000 of 50000000 tuples (77%) done (elapsed 755.36 s, remaining 218.04 s) 2023-09-23T09:10:01.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:10:00 smithi135 ceph-mon[99205]: pgmap v408: 97 pgs: 97 active+clean; 7.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.4 MiB/s wr, 436 op/s 2023-09-23T09:10:01.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:10:00 smithi135 ceph-mon[99205]: overall HEALTH_OK 2023-09-23T09:10:01.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:10:00 smithi082 ceph-mon[97694]: pgmap v408: 97 pgs: 97 active+clean; 7.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.4 MiB/s wr, 436 op/s 2023-09-23T09:10:01.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:10:00 smithi082 ceph-mon[97694]: overall HEALTH_OK 2023-09-23T09:10:01.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:10:00 smithi161 ceph-mon[99580]: pgmap v408: 97 pgs: 97 active+clean; 7.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.4 MiB/s wr, 436 op/s 2023-09-23T09:10:01.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:10:00 smithi161 ceph-mon[99580]: overall HEALTH_OK 2023-09-23T09:10:02.809 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:10:03.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.027+0000 7f224a7ff700 1 -- 172.21.15.82:0/3942940695 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2244073610 msgr2=0x7f224410cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:10:03.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.027+0000 7f224a7ff700 1 --2- 172.21.15.82:0/3942940695 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2244073610 0x7f224410cbf0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2238009990 tx=0x7f2238009ca0 comp rx=0 tx=0).stop 2023-09-23T09:10:03.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.027+0000 7f224a7ff700 1 -- 172.21.15.82:0/3942940695 shutdown_connections 2023-09-23T09:10:03.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.027+0000 7f224a7ff700 1 --2- 172.21.15.82:0/3942940695 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f224410d130 0x7f224410f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:10:03.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.027+0000 7f224a7ff700 1 --2- 172.21.15.82:0/3942940695 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2244072cf0 0x7f22440730d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:10:03.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.027+0000 7f224a7ff700 1 --2- 172.21.15.82:0/3942940695 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2244073610 0x7f224410cbf0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:10:03.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.027+0000 7f224a7ff700 1 -- 172.21.15.82:0/3942940695 >> 172.21.15.82:0/3942940695 conn(0x7f22440fc380 msgr2=0x7f22440fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:10:03.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.027+0000 7f224a7ff700 1 -- 172.21.15.82:0/3942940695 shutdown_connections 2023-09-23T09:10:03.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.027+0000 7f224a7ff700 1 -- 172.21.15.82:0/3942940695 wait complete. 2023-09-23T09:10:03.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.028+0000 7f224a7ff700 1 Processor -- start 2023-09-23T09:10:03.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.028+0000 7f224a7ff700 1 -- start start 2023-09-23T09:10:03.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.028+0000 7f224a7ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2244072cf0 0x7f224419e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:10:03.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.028+0000 7f224a7ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2244073610 0x7f224419ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:10:03.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.028+0000 7f224a7ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f224410d130 0x7f2244198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:10:03.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.028+0000 7f224a7ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2244198fb0 con 0x7f2244073610 2023-09-23T09:10:03.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.028+0000 7f224a7ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2244199120 con 0x7f2244072cf0 2023-09-23T09:10:03.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.028+0000 7f224a7ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22441992e0 con 0x7f224410d130 2023-09-23T09:10:03.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.029+0000 7f2243fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2244072cf0 0x7f224419e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:10:03.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.029+0000 7f22437fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2244073610 0x7f224419ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:10:03.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.029+0000 7f2243fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2244072cf0 0x7f224419e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:58736/0 (socket says 172.21.15.82:58736) 2023-09-23T09:10:03.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.029+0000 7f2243fff700 1 -- 172.21.15.82:0/2347265373 learned_addr learned my addr 172.21.15.82:0/2347265373 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:10:03.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.029+0000 7f2248d9c700 1 --2- 172.21.15.82:0/2347265373 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f224410d130 0x7f2244198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:10:03.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.029+0000 7f2243fff700 1 -- 172.21.15.82:0/2347265373 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f224410d130 msgr2=0x7f2244198940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:10:03.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.029+0000 7f2243fff700 1 --2- 172.21.15.82:0/2347265373 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f224410d130 0x7f2244198940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:10:03.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.029+0000 7f2243fff700 1 -- 172.21.15.82:0/2347265373 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2244073610 msgr2=0x7f224419ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:10:03.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.029+0000 7f2243fff700 1 --2- 172.21.15.82:0/2347265373 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2244073610 0x7f224419ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:10:03.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.029+0000 7f2243fff700 1 -- 172.21.15.82:0/2347265373 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2234009520 con 0x7f2244072cf0 2023-09-23T09:10:03.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.030+0000 7f2243fff700 1 --2- 172.21.15.82:0/2347265373 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2244072cf0 0x7f224419e8d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f223400eb30 tx=0x7f223400ee40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:10:03.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.030+0000 7f22417fa700 1 -- 172.21.15.82:0/2347265373 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2234009880 con 0x7f2244072cf0 2023-09-23T09:10:03.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.030+0000 7f22417fa700 1 -- 172.21.15.82:0/2347265373 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f22340044b0 con 0x7f2244072cf0 2023-09-23T09:10:03.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.030+0000 7f224a7ff700 1 -- 172.21.15.82:0/2347265373 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f223c009c40 con 0x7f2244072cf0 2023-09-23T09:10:03.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.030+0000 7f22417fa700 1 -- 172.21.15.82:0/2347265373 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2234003ce0 con 0x7f2244072cf0 2023-09-23T09:10:03.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.030+0000 7f224a7ff700 1 -- 172.21.15.82:0/2347265373 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22380095f0 con 0x7f2244072cf0 2023-09-23T09:10:03.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.034+0000 7f22417fa700 1 -- 172.21.15.82:0/2347265373 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f2234003e40 con 0x7f2244072cf0 2023-09-23T09:10:03.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.035+0000 7f225e13fb80 1 Processor -- start 2023-09-23T09:10:03.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.035+0000 7f225e13fb80 1 -- start start 2023-09-23T09:10:03.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.035+0000 7f22417fa700 1 --2- 172.21.15.82:0/2347265373 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f222c0a00c0 0x7f222c0a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:10:03.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.035+0000 7f225e13fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c85d8f7380 0x55c85d8f7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:10:03.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.035+0000 7f225e13fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c85d8f7ca0 0x55c85d8f1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:10:03.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.036+0000 7f225e13fb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c85d8f1c40 0x55c85d8f20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:10:03.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.036+0000 7f225e13fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c85d8597b0 con 0x55c85d8f7380 2023-09-23T09:10:03.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.036+0000 7f225e13fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c85d84a780 con 0x55c85d8f7ca0 2023-09-23T09:10:03.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.036+0000 7f225e13fb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c85d8480a0 con 0x55c85d8f1c40 2023-09-23T09:10:03.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.036+0000 7f22417fa700 1 -- 172.21.15.82:0/2347265373 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f2234014070 con 0x7f2244072cf0 2023-09-23T09:10:03.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.036+0000 7f2243fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c85d8f7380 0x55c85d8f7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:10:03.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.036+0000 7f2243fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c85d8f7380 0x55c85d8f7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41238/0 (socket says 172.21.15.82:41238) 2023-09-23T09:10:03.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.036+0000 7f2243fff700 1 -- 172.21.15.82:0/3947478445 learned_addr learned my addr 172.21.15.82:0/3947478445 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:10:03.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.036+0000 7f2248d9c700 1 --2- 172.21.15.82:0/2347265373 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f222c0a00c0 0x7f222c0a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:10:03.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.036+0000 7f22437fe700 1 --2- 172.21.15.82:0/3947478445 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c85d8f7ca0 0x55c85d8f1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:10:03.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.036+0000 7f2248d9c700 1 --2- 172.21.15.82:0/3947478445 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c85d8f1c40 0x55c85d8f20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:10:03.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.036+0000 7f2243fff700 1 -- 172.21.15.82:0/3947478445 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c85d8f1c40 msgr2=0x55c85d8f20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:10:03.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.036+0000 7f2243fff700 1 --2- 172.21.15.82:0/3947478445 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c85d8f1c40 0x55c85d8f20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:10:03.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.036+0000 7f2243fff700 1 -- 172.21.15.82:0/3947478445 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c85d8f7ca0 msgr2=0x55c85d8f1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:10:03.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.036+0000 7f2243fff700 1 --2- 172.21.15.82:0/3947478445 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c85d8f7ca0 0x55c85d8f1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:10:03.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.036+0000 7f2243fff700 1 -- 172.21.15.82:0/3947478445 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c85d6c3630 con 0x55c85d8f7380 2023-09-23T09:10:03.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.037+0000 7f2243fff700 1 --2- 172.21.15.82:0/3947478445 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c85d8f7380 0x55c85d8f7760 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f2234095b60 tx=0x7f2234098ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5e3f387f9866933 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:10:03.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.037+0000 7f2248d9c700 1 --2- 172.21.15.82:0/2347265373 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f222c0a00c0 0x7f222c0a2580 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f224419f5d0 tx=0x7f223c009920 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:10:03.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.037+0000 7f222a7fc700 1 -- 172.21.15.82:0/3947478445 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22340c3110 con 0x55c85d8f7380 2023-09-23T09:10:03.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.037+0000 7f222a7fc700 1 -- 172.21.15.82:0/3947478445 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f22340997f0 con 0x55c85d8f7380 2023-09-23T09:10:03.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.037+0000 7f222a7fc700 1 -- 172.21.15.82:0/3947478445 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2234097490 con 0x55c85d8f7380 2023-09-23T09:10:03.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.038+0000 7f225e13fb80 1 -- 172.21.15.82:0/3947478445 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c85d8f7380 msgr2=0x55c85d8f7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:10:03.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.038+0000 7f225e13fb80 1 --2- 172.21.15.82:0/3947478445 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c85d8f7380 0x55c85d8f7760 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f2234095b60 tx=0x7f2234098ff0 comp rx=0 tx=0).stop 2023-09-23T09:10:03.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.038+0000 7f225e13fb80 1 -- 172.21.15.82:0/3947478445 shutdown_connections 2023-09-23T09:10:03.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.038+0000 7f225e13fb80 1 --2- 172.21.15.82:0/3947478445 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c85d8f1c40 0x55c85d8f20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:10:03.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.038+0000 7f225e13fb80 1 --2- 172.21.15.82:0/3947478445 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c85d8f7380 0x55c85d8f7760 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:10:03.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.038+0000 7f225e13fb80 1 --2- 172.21.15.82:0/3947478445 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c85d8f7ca0 0x55c85d8f1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:10:03.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.038+0000 7f225e13fb80 1 -- 172.21.15.82:0/3947478445 >> 172.21.15.82:0/3947478445 conn(0x55c85d8660e0 msgr2=0x55c85d8ec410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:10:03.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.038+0000 7f225e13fb80 1 -- 172.21.15.82:0/3947478445 shutdown_connections 2023-09-23T09:10:03.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.038+0000 7f225e13fb80 1 -- 172.21.15.82:0/3947478445 wait complete. 2023-09-23T09:10:03.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.038+0000 7f225e13fb80 1 -- start start 2023-09-23T09:10:03.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.039+0000 7f225e13fb80 1 Processor -- start 2023-09-23T09:10:03.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.039+0000 7f225e13fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c85d8f1c40 0x55c85d8fdc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:10:03.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.040+0000 7f225e13fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c85d8f7380 0x55c85d8faea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:10:03.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.040+0000 7f225e13fb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c85d8f7ca0 0x55c85d8fb540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:10:03.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.040+0000 7f225e13fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c85d843990 con 0x55c85d8f7380 2023-09-23T09:10:03.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.040+0000 7f225e13fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c85d7e1bb0 con 0x55c85d8f1c40 2023-09-23T09:10:03.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.040+0000 7f225e13fb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c85d7e18b0 con 0x55c85d8f7ca0 2023-09-23T09:10:03.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.040+0000 7f225e13fb80 10 client.0 _ll_register_callbacks cb 0x55c85d72ba80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:10:03.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.040+0000 7f22437fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c85d8f7380 0x55c85d8faea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:10:03.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.040+0000 7f2243fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c85d8f1c40 0x55c85d8fdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:10:03.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.040+0000 7f2243fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c85d8f1c40 0x55c85d8fdc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:58754/0 (socket says 172.21.15.82:58754) 2023-09-23T09:10:03.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.040+0000 7f2243fff700 1 -- 172.21.15.82:0/4253124026 learned_addr learned my addr 172.21.15.82:0/4253124026 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:10:03.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.040+0000 7f2248d9c700 1 --2- 172.21.15.82:0/4253124026 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c85d8f7ca0 0x55c85d8fb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:10:03.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.040+0000 7f22437fe700 1 -- 172.21.15.82:0/4253124026 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c85d8f7ca0 msgr2=0x55c85d8fb540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:10:03.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.040+0000 7f22437fe700 1 --2- 172.21.15.82:0/4253124026 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c85d8f7ca0 0x55c85d8fb540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:10:03.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.040+0000 7f22437fe700 1 -- 172.21.15.82:0/4253124026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c85d8f1c40 msgr2=0x55c85d8fdc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:10:03.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.040+0000 7f22437fe700 1 --2- 172.21.15.82:0/4253124026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c85d8f1c40 0x55c85d8fdc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:10:03.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.040+0000 7f22437fe700 1 -- 172.21.15.82:0/4253124026 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22380095f0 con 0x55c85d8f7380 2023-09-23T09:10:03.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.041+0000 7f22437fe700 1 --2- 172.21.15.82:0/4253124026 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c85d8f7380 0x55c85d8faea0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f22380059d0 tx=0x7f2238005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13ffb6a3a260cbed server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:10:03.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.041+0000 7f22237fe700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:10:03.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.041+0000 7f22237fe700 1 -- 172.21.15.82:0/4253124026 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f223801d070 con 0x55c85d8f7380 2023-09-23T09:10:03.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.041+0000 7f225e13fb80 1 -- 172.21.15.82:0/4253124026 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c85d8c11c0 con 0x55c85d8f7380 2023-09-23T09:10:03.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.041+0000 7f22237fe700 1 -- 172.21.15.82:0/4253124026 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f2238004500 con 0x55c85d8f7380 2023-09-23T09:10:03.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.041+0000 7f22237fe700 1 -- 172.21.15.82:0/4253124026 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) v2 ==== 24+0+0 (secure 0 0 0) 0x7f22380046c0 con 0x55c85d8f7380 2023-09-23T09:10:03.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.041+0000 7f225e13fb80 10 client.16476 fetch_fsmap learned FSMap version 65 2023-09-23T09:10:03.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.041+0000 7f225e13fb80 1 -- 172.21.15.82:0/4253124026 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=4+}) v3 -- 0x55c85d66fde0 con 0x55c85d8f7380 2023-09-23T09:10:03.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.042+0000 7f22237fe700 1 -- 172.21.15.82:0/4253124026 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55c85d8c11c0 con 0x55c85d8f7380 2023-09-23T09:10:03.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.042+0000 7f22237fe700 1 -- 172.21.15.82:0/4253124026 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 65) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f223800f8e0 con 0x55c85d8f7380 2023-09-23T09:10:03.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.042+0000 7f225e13fb80 10 client.16476 fetch_fsmap finished waiting for FSMap version 65 2023-09-23T09:10:03.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.042+0000 7f225e13fb80 10 client.16476 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:10:03.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.042+0000 7f225e13fb80 20 client.16476 populate_metadata read hostname 'smithi082' 2023-09-23T09:10:03.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.042+0000 7f225e13fb80 1 --2- 172.21.15.82:0/4253124026 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55c85d90b5c0 0x55c85d90d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:10:03.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.042+0000 7f225e13fb80 4 client.16476 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:10:03.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.042+0000 7f225e13fb80 1 -- 172.21.15.82:0/4253124026 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c85d7e9ba0 con 0x55c85d90b5c0 2023-09-23T09:10:03.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.042+0000 7f2243fff700 1 --2- 172.21.15.82:0/4253124026 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55c85d90b5c0 0x55c85d90d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:10:03.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.043+0000 7f2243fff700 1 --2- 172.21.15.82:0/4253124026 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55c85d90b5c0 0x55c85d90d9e0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=479fa9b267feb52a server_cookie=5e2ffab6c72b851c in_seq=0 out_seq=0 2023-09-23T09:10:03.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.043+0000 7f22237fe700 10 client.16476 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:10:03.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.044+0000 7f22237fe700 1 -- 172.21.15.82:0/4253124026 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c85d7e9ba0 con 0x55c85d90b5c0 2023-09-23T09:10:03.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.044+0000 7f22237fe700 10 client.16476 handle_command_reply: tid=0 2023-09-23T09:10:03.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.044+0000 7f225e13fb80 1 client.16476 shutdown 2023-09-23T09:10:03.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.044+0000 7f225e13fb80 1 -- 172.21.15.82:0/4253124026 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c85d8f7380 msgr2=0x55c85d8faea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:10:03.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.044+0000 7f225e13fb80 1 --2- 172.21.15.82:0/4253124026 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c85d8f7380 0x55c85d8faea0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f22380059d0 tx=0x7f2238005800 comp rx=0 tx=0).stop 2023-09-23T09:10:03.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.044+0000 7f225e13fb80 1 -- 172.21.15.82:0/4253124026 shutdown_connections 2023-09-23T09:10:03.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.044+0000 7f225e13fb80 1 --2- 172.21.15.82:0/4253124026 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c85d8f7ca0 0x55c85d8fb540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:10:03.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.044+0000 7f225e13fb80 1 --2- 172.21.15.82:0/4253124026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c85d8f1c40 0x55c85d8fdc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:10:03.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.044+0000 7f225e13fb80 1 --2- 172.21.15.82:0/4253124026 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55c85d90b5c0 0x55c85d90d9e0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:10:03.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.044+0000 7f225e13fb80 1 --2- 172.21.15.82:0/4253124026 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c85d8f7380 0x55c85d8faea0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:10:03.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.044+0000 7f22237fe700 0 client.16476 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:10:03.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.044+0000 7f225e13fb80 1 -- 172.21.15.82:0/4253124026 >> 172.21.15.82:0/4253124026 conn(0x55c85d8660e0 msgr2=0x55c85d8e6b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:10:03.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.044+0000 7f225e13fb80 1 -- 172.21.15.82:0/4253124026 shutdown_connections 2023-09-23T09:10:03.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.044+0000 7f225e13fb80 1 -- 172.21.15.82:0/4253124026 wait complete. 2023-09-23T09:10:03.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.045+0000 7f225e13fb80 20 client.16476 trim_cache size 0 max 16384 2023-09-23T09:10:03.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:10:02 smithi135 ceph-mon[99205]: pgmap v409: 97 pgs: 97 active+clean; 7.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 960 KiB/s rd, 3.0 MiB/s wr, 291 op/s 2023-09-23T09:10:03.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.062+0000 7f225e13fb80 1 Processor -- start 2023-09-23T09:10:03.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.062+0000 7f225e13fb80 1 -- start start 2023-09-23T09:10:03.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.063+0000 7f225e13fb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c85d8f1c40 0x55c85d8f5010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:10:03.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.063+0000 7f225e13fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c85d8f7380 0x55c85d8f5550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:10:03.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.063+0000 7f225e13fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c85d8f7ca0 0x55c85d8fa660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:10:03.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.063+0000 7f225e13fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c85d6c5920 con 0x55c85d8f7ca0 2023-09-23T09:10:03.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.063+0000 7f225e13fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c85d8fe2a0 con 0x55c85d8f7380 2023-09-23T09:10:03.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.063+0000 7f225e13fb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c85d908050 con 0x55c85d8f1c40 2023-09-23T09:10:03.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.063+0000 7f2243fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c85d8f1c40 0x55c85d8f5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:10:03.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.063+0000 7f2243fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c85d8f1c40 0x55c85d8f5010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:57340/0 (socket says 172.21.15.82:57340) 2023-09-23T09:10:03.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.063+0000 7f22437fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c85d8f7380 0x55c85d8f5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:10:03.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.063+0000 7f2243fff700 1 -- 172.21.15.82:0/2053690808 learned_addr learned my addr 172.21.15.82:0/2053690808 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:10:03.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.063+0000 7f2248d9c700 1 --2- 172.21.15.82:0/2053690808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c85d8f7ca0 0x55c85d8fa660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:10:03.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.064+0000 7f22437fe700 1 -- 172.21.15.82:0/2053690808 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c85d8f1c40 msgr2=0x55c85d8f5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:10:03.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.064+0000 7f22437fe700 1 --2- 172.21.15.82:0/2053690808 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c85d8f1c40 0x55c85d8f5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:10:03.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.064+0000 7f22437fe700 1 -- 172.21.15.82:0/2053690808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c85d8f7ca0 msgr2=0x55c85d8fa660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:10:03.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.064+0000 7f22437fe700 1 --2- 172.21.15.82:0/2053690808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c85d8f7ca0 0x55c85d8fa660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:10:03.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.064+0000 7f22437fe700 1 -- 172.21.15.82:0/2053690808 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c85d658c60 con 0x55c85d8f7380 2023-09-23T09:10:03.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.064+0000 7f2243fff700 1 --2- 172.21.15.82:0/2053690808 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c85d8f1c40 0x55c85d8f5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:10:03.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.064+0000 7f22437fe700 1 --2- 172.21.15.82:0/2053690808 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c85d8f7380 0x55c85d8f5550 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2238000c00 tx=0x7f223800b260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d875a3e4c4e7182 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:10:03.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.064+0000 7f222affd700 1 -- 172.21.15.82:0/2053690808 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f223801d070 con 0x55c85d8f7380 2023-09-23T09:10:03.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.064+0000 7f222affd700 1 -- 172.21.15.82:0/2053690808 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f223801e040 con 0x55c85d8f7380 2023-09-23T09:10:03.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.064+0000 7f222affd700 1 -- 172.21.15.82:0/2053690808 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22380249e0 con 0x55c85d8f7380 2023-09-23T09:10:03.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.065+0000 7f225e13fb80 1 -- 172.21.15.82:0/2053690808 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c85d8f7380 msgr2=0x55c85d8f5550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:10:03.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.065+0000 7f225e13fb80 1 --2- 172.21.15.82:0/2053690808 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c85d8f7380 0x55c85d8f5550 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2238000c00 tx=0x7f223800b260 comp rx=0 tx=0).stop 2023-09-23T09:10:03.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.065+0000 7f225e13fb80 1 -- 172.21.15.82:0/2053690808 shutdown_connections 2023-09-23T09:10:03.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.065+0000 7f225e13fb80 1 --2- 172.21.15.82:0/2053690808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c85d8f7ca0 0x55c85d8fa660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:10:03.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.065+0000 7f225e13fb80 1 --2- 172.21.15.82:0/2053690808 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c85d8f1c40 0x55c85d8f5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:10:03.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.065+0000 7f225e13fb80 1 --2- 172.21.15.82:0/2053690808 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c85d8f7380 0x55c85d8f5550 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:10:03.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.065+0000 7f225e13fb80 1 -- 172.21.15.82:0/2053690808 >> 172.21.15.82:0/2053690808 conn(0x55c85d8660e0 msgr2=0x55c85d906e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:10:03.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.065+0000 7f225e13fb80 1 -- 172.21.15.82:0/2053690808 shutdown_connections 2023-09-23T09:10:03.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.065+0000 7f225e13fb80 1 -- 172.21.15.82:0/2053690808 wait complete. 2023-09-23T09:10:03.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.066+0000 7f225e13fb80 1 -- start start 2023-09-23T09:10:03.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.066+0000 7f225e13fb80 1 Processor -- start 2023-09-23T09:10:03.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.066+0000 7f225e13fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c85d8f1c40 0x55c85d902740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:10:03.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.066+0000 7f225e13fb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c85d8f7380 0x55c85d8f2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:10:03.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.066+0000 7f225e13fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c85d8f7ca0 0x55c85d8f3340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:10:03.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.066+0000 7f225e13fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c85d8f3880 con 0x55c85d8f7ca0 2023-09-23T09:10:03.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.066+0000 7f225e13fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c85d8f39f0 con 0x55c85d8f1c40 2023-09-23T09:10:03.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.066+0000 7f225e13fb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c85d8f3bb0 con 0x55c85d8f7380 2023-09-23T09:10:03.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.066+0000 7f225e13fb80 10 client.0 _ll_register_callbacks cb 0x7f2238005350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:10:03.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.066+0000 7f2248d9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c85d8f7ca0 0x55c85d8f3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:10:03.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.067+0000 7f2243fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c85d8f1c40 0x55c85d902740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:10:03.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.067+0000 7f2248d9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c85d8f7ca0 0x55c85d8f3340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41268/0 (socket says 172.21.15.82:41268) 2023-09-23T09:10:03.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.067+0000 7f2248d9c700 1 -- 172.21.15.82:0/2864181168 learned_addr learned my addr 172.21.15.82:0/2864181168 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:10:03.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.067+0000 7f22437fe700 1 --2- 172.21.15.82:0/2864181168 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c85d8f7380 0x55c85d8f2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:10:03.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.067+0000 7f2248d9c700 1 -- 172.21.15.82:0/2864181168 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c85d8f7380 msgr2=0x55c85d8f2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:10:03.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.067+0000 7f2248d9c700 1 --2- 172.21.15.82:0/2864181168 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c85d8f7380 0x55c85d8f2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:10:03.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.067+0000 7f2248d9c700 1 -- 172.21.15.82:0/2864181168 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c85d8f1c40 msgr2=0x55c85d902740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:10:03.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.067+0000 7f2248d9c700 1 --2- 172.21.15.82:0/2864181168 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c85d8f1c40 0x55c85d902740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:10:03.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.067+0000 7f2248d9c700 1 -- 172.21.15.82:0/2864181168 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c85d6c3630 con 0x55c85d8f7ca0 2023-09-23T09:10:03.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.067+0000 7f22437fe700 1 --2- 172.21.15.82:0/2864181168 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c85d8f7380 0x55c85d8f2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:10:03.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.067+0000 7f2248d9c700 1 --2- 172.21.15.82:0/2864181168 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c85d8f7ca0 0x55c85d8f3340 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f223c018c80 tx=0x7f223c004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a35c6fab85e6281 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:10:03.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.067+0000 7f22237fe700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:10:03.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.068+0000 7f22237fe700 1 -- 172.21.15.82:0/2864181168 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f223c00e070 con 0x55c85d8f7ca0 2023-09-23T09:10:03.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.068+0000 7f225e13fb80 1 -- 172.21.15.82:0/2864181168 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c85d8e48b0 con 0x55c85d8f7ca0 2023-09-23T09:10:03.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.068+0000 7f22237fe700 1 -- 172.21.15.82:0/2864181168 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f223c01b660 con 0x55c85d8f7ca0 2023-09-23T09:10:03.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.068+0000 7f22237fe700 1 -- 172.21.15.82:0/2864181168 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) v2 ==== 24+0+0 (secure 0 0 0) 0x7f223c01b820 con 0x55c85d8f7ca0 2023-09-23T09:10:03.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.068+0000 7f225e13fb80 10 client.16482 fetch_fsmap learned FSMap version 65 2023-09-23T09:10:03.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.068+0000 7f225e13fb80 1 -- 172.21.15.82:0/2864181168 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=4+}) v3 -- 0x55c85d66fde0 con 0x55c85d8f7ca0 2023-09-23T09:10:03.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.068+0000 7f22237fe700 1 -- 172.21.15.82:0/2864181168 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55c85d8e48b0 con 0x55c85d8f7ca0 2023-09-23T09:10:03.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.068+0000 7f22237fe700 1 -- 172.21.15.82:0/2864181168 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 65) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f223c01a850 con 0x55c85d8f7ca0 2023-09-23T09:10:03.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.069+0000 7f225e13fb80 10 client.16482 fetch_fsmap finished waiting for FSMap version 65 2023-09-23T09:10:03.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.069+0000 7f225e13fb80 10 client.16482 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:10:03.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.069+0000 7f225e13fb80 20 client.16482 populate_metadata read hostname 'smithi082' 2023-09-23T09:10:03.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.069+0000 7f225e13fb80 1 --2- 172.21.15.82:0/2864181168 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55c85d960900 0x55c85d962d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:10:03.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.069+0000 7f225e13fb80 4 client.16482 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:10:03.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.069+0000 7f225e13fb80 1 -- 172.21.15.82:0/2864181168 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55c85d83c970 con 0x55c85d960900 2023-09-23T09:10:03.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.069+0000 7f2243fff700 1 --2- 172.21.15.82:0/2864181168 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55c85d960900 0x55c85d962d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:10:03.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.069+0000 7f2243fff700 1 --2- 172.21.15.82:0/2864181168 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55c85d960900 0x55c85d962d20 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=78ee674df3c88ad6 server_cookie=742ea387732b5b16 in_seq=0 out_seq=0 2023-09-23T09:10:03.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.069+0000 7f22237fe700 10 client.16482 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:10:03.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.070+0000 7f22237fe700 1 -- 172.21.15.82:0/2864181168 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55c85d83c970 con 0x55c85d960900 2023-09-23T09:10:03.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.070+0000 7f22237fe700 10 client.16482 handle_command_reply: tid=0 2023-09-23T09:10:03.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.070+0000 7f225e13fb80 1 client.16482 shutdown 2023-09-23T09:10:03.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.070+0000 7f225e13fb80 1 -- 172.21.15.82:0/2864181168 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c85d8f7ca0 msgr2=0x55c85d8f3340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:10:03.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.070+0000 7f225e13fb80 1 --2- 172.21.15.82:0/2864181168 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c85d8f7ca0 0x55c85d8f3340 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f223c018c80 tx=0x7f223c004b40 comp rx=0 tx=0).stop 2023-09-23T09:10:03.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.070+0000 7f225e13fb80 1 -- 172.21.15.82:0/2864181168 shutdown_connections 2023-09-23T09:10:03.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.070+0000 7f225e13fb80 1 --2- 172.21.15.82:0/2864181168 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55c85d960900 0x55c85d962d20 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:10:03.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.070+0000 7f225e13fb80 1 --2- 172.21.15.82:0/2864181168 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c85d8f7ca0 0x55c85d8f3340 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:10:03.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.070+0000 7f225e13fb80 1 --2- 172.21.15.82:0/2864181168 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c85d8f1c40 0x55c85d902740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:10:03.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.070+0000 7f225e13fb80 1 --2- 172.21.15.82:0/2864181168 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c85d8f7380 0x55c85d8f2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:10:03.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.070+0000 7f22237fe700 0 client.16482 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:10:03.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.070+0000 7f225e13fb80 1 -- 172.21.15.82:0/2864181168 >> 172.21.15.82:0/2864181168 conn(0x55c85d8660e0 msgr2=0x55c85d8f5010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:10:03.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.070+0000 7f225e13fb80 1 -- 172.21.15.82:0/2864181168 shutdown_connections 2023-09-23T09:10:03.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.070+0000 7f225e13fb80 1 -- 172.21.15.82:0/2864181168 wait complete. 2023-09-23T09:10:03.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.070+0000 7f225e13fb80 20 client.16482 trim_cache size 0 max 16384 2023-09-23T09:10:03.077 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:10:03.078 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "IDLE (waiting for more scrubs)", 2023-09-23T09:10:03.078 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:10:03.078 INFO:teuthology.orchestra.run.smithi082.stdout: "cba46b77-20dd-437c-a60a-ac01b400e1b8": { 2023-09-23T09:10:03.078 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:10:03.078 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "cba46b77-20dd-437c-a60a-ac01b400e1b8", 2023-09-23T09:10:03.078 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:10:03.078 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:10:03.078 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:10:03.078 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:10:03.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.071+0000 7f224a7ff700 1 -- 172.21.15.82:0/2347265373 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f222c0a00c0 msgr2=0x7f222c0a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:10:03.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.071+0000 7f224a7ff700 1 --2- 172.21.15.82:0/2347265373 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f222c0a00c0 0x7f222c0a2580 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f224419f5d0 tx=0x7f223c009920 comp rx=0 tx=0).stop 2023-09-23T09:10:03.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.071+0000 7f224a7ff700 1 -- 172.21.15.82:0/2347265373 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2244072cf0 msgr2=0x7f224419e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:10:03.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.071+0000 7f224a7ff700 1 --2- 172.21.15.82:0/2347265373 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2244072cf0 0x7f224419e8d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f223400eb30 tx=0x7f223400ee40 comp rx=0 tx=0).stop 2023-09-23T09:10:03.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.071+0000 7f224a7ff700 1 -- 172.21.15.82:0/2347265373 shutdown_connections 2023-09-23T09:10:03.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.071+0000 7f224a7ff700 1 --2- 172.21.15.82:0/2347265373 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f222c0a00c0 0x7f222c0a2580 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:10:03.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.071+0000 7f224a7ff700 1 --2- 172.21.15.82:0/2347265373 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f224410d130 0x7f2244198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:10:03.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.071+0000 7f224a7ff700 1 --2- 172.21.15.82:0/2347265373 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2244072cf0 0x7f224419e8d0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:10:03.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.071+0000 7f224a7ff700 1 --2- 172.21.15.82:0/2347265373 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2244073610 0x7f224419ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:10:03.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.071+0000 7f224a7ff700 1 -- 172.21.15.82:0/2347265373 >> 172.21.15.82:0/2347265373 conn(0x7f22440fc380 msgr2=0x7f224410f2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:10:03.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.071+0000 7f224a7ff700 1 -- 172.21.15.82:0/2347265373 shutdown_connections 2023-09-23T09:10:03.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:03.071+0000 7f224a7ff700 1 -- 172.21.15.82:0/2347265373 wait complete. 2023-09-23T09:10:03.090 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:10:02 smithi082 ceph-mon[97694]: pgmap v409: 97 pgs: 97 active+clean; 7.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 960 KiB/s rd, 3.0 MiB/s wr, 291 op/s 2023-09-23T09:10:03.093 INFO:tasks.cephfs.filesystem:scrub status for tag:cba46b77-20dd-437c-a60a-ac01b400e1b8 - {'path': '/', 'tag': 'cba46b77-20dd-437c-a60a-ac01b400e1b8', 'options': 'recursive,force'} 2023-09-23T09:10:03.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:10:02 smithi161 ceph-mon[99580]: pgmap v409: 97 pgs: 97 active+clean; 7.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 960 KiB/s rd, 3.0 MiB/s wr, 291 op/s 2023-09-23T09:10:05.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:10:04 smithi135 ceph-mon[99205]: pgmap v410: 97 pgs: 97 active+clean; 7.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 960 KiB/s rd, 3.0 MiB/s wr, 291 op/s 2023-09-23T09:10:05.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:10:04 smithi082 ceph-mon[97694]: pgmap v410: 97 pgs: 97 active+clean; 7.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 960 KiB/s rd, 3.0 MiB/s wr, 291 op/s 2023-09-23T09:10:05.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:10:04 smithi161 ceph-mon[99580]: pgmap v410: 97 pgs: 97 active+clean; 7.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 960 KiB/s rd, 3.0 MiB/s wr, 291 op/s 2023-09-23T09:10:07.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:10:06 smithi135 ceph-mon[99205]: pgmap v411: 97 pgs: 97 active+clean; 7.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.4 MiB/s wr, 439 op/s 2023-09-23T09:10:07.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:10:06 smithi082 ceph-mon[97694]: pgmap v411: 97 pgs: 97 active+clean; 7.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.4 MiB/s wr, 439 op/s 2023-09-23T09:10:07.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:10:06 smithi161 ceph-mon[99580]: pgmap v411: 97 pgs: 97 active+clean; 7.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.4 MiB/s wr, 439 op/s 2023-09-23T09:10:09.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:10:08 smithi135 ceph-mon[99205]: pgmap v412: 97 pgs: 97 active+clean; 7.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 953 KiB/s rd, 2.9 MiB/s wr, 293 op/s 2023-09-23T09:10:09.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:10:08 smithi082 ceph-mon[97694]: pgmap v412: 97 pgs: 97 active+clean; 7.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 953 KiB/s rd, 2.9 MiB/s wr, 293 op/s 2023-09-23T09:10:09.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:10:08 smithi161 ceph-mon[99580]: pgmap v412: 97 pgs: 97 active+clean; 7.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 953 KiB/s rd, 2.9 MiB/s wr, 293 op/s 2023-09-23T09:10:11.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:10:10 smithi135 ceph-mon[99205]: pgmap v413: 97 pgs: 97 active+clean; 7.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.3 MiB/s wr, 422 op/s 2023-09-23T09:10:11.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:10:10 smithi082 ceph-mon[97694]: pgmap v413: 97 pgs: 97 active+clean; 7.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.3 MiB/s wr, 422 op/s 2023-09-23T09:10:11.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:10:10 smithi161 ceph-mon[99580]: pgmap v413: 97 pgs: 97 active+clean; 7.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.3 MiB/s wr, 422 op/s 2023-09-23T09:10:13.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:10:12 smithi135 ceph-mon[99205]: pgmap v414: 97 pgs: 97 active+clean; 7.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 941 KiB/s rd, 2.8 MiB/s wr, 277 op/s 2023-09-23T09:10:13.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:10:12 smithi135 ceph-mon[99205]: osdmap e102: 12 total, 12 up, 12 in 2023-09-23T09:10:13.124 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:10:12 smithi082 ceph-mon[97694]: pgmap v414: 97 pgs: 97 active+clean; 7.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 941 KiB/s rd, 2.8 MiB/s wr, 277 op/s 2023-09-23T09:10:13.124 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:10:12 smithi082 ceph-mon[97694]: osdmap e102: 12 total, 12 up, 12 in 2023-09-23T09:10:13.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:10:12 smithi161 ceph-mon[99580]: pgmap v414: 97 pgs: 97 active+clean; 7.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 941 KiB/s rd, 2.8 MiB/s wr, 277 op/s 2023-09-23T09:10:13.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:10:12 smithi161 ceph-mon[99580]: osdmap e102: 12 total, 12 up, 12 in 2023-09-23T09:10:15.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:10:14 smithi135 ceph-mon[99205]: pgmap v416: 97 pgs: 97 active+clean; 7.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.3 MiB/s wr, 332 op/s 2023-09-23T09:10:15.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:10:14 smithi082 ceph-mon[97694]: pgmap v416: 97 pgs: 97 active+clean; 7.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.3 MiB/s wr, 332 op/s 2023-09-23T09:10:15.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:10:14 smithi161 ceph-mon[99580]: pgmap v416: 97 pgs: 97 active+clean; 7.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.3 MiB/s wr, 332 op/s 2023-09-23T09:10:17.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:10:16 smithi135 ceph-mon[99205]: pgmap v417: 97 pgs: 97 active+clean; 7.4 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.5 MiB/s wr, 333 op/s 2023-09-23T09:10:17.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:10:16 smithi135 ceph-mon[99205]: osdmap e103: 12 total, 12 up, 12 in 2023-09-23T09:10:17.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:10:16 smithi082 ceph-mon[97694]: pgmap v417: 97 pgs: 97 active+clean; 7.4 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.5 MiB/s wr, 333 op/s 2023-09-23T09:10:17.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:10:16 smithi082 ceph-mon[97694]: osdmap e103: 12 total, 12 up, 12 in 2023-09-23T09:10:17.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:10:16 smithi161 ceph-mon[99580]: pgmap v417: 97 pgs: 97 active+clean; 7.4 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.5 MiB/s wr, 333 op/s 2023-09-23T09:10:17.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:10:16 smithi161 ceph-mon[99580]: osdmap e103: 12 total, 12 up, 12 in 2023-09-23T09:10:17.689 INFO:teuthology.orchestra.run.smithi082.stderr:38900000 of 50000000 tuples (77%) done (elapsed 772.43 s, remaining 220.41 s) 2023-09-23T09:10:19.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:10:18 smithi135 ceph-mon[99205]: pgmap v419: 97 pgs: 97 active+clean; 7.4 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 797 KiB/s rd, 2.3 MiB/s wr, 224 op/s 2023-09-23T09:10:19.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:10:18 smithi082 ceph-mon[97694]: pgmap v419: 97 pgs: 97 active+clean; 7.4 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 797 KiB/s rd, 2.3 MiB/s wr, 224 op/s 2023-09-23T09:10:19.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:10:18 smithi161 ceph-mon[99580]: pgmap v419: 97 pgs: 97 active+clean; 7.4 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 797 KiB/s rd, 2.3 MiB/s wr, 224 op/s 2023-09-23T09:10:21.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:10:20 smithi135 ceph-mon[99205]: pgmap v420: 97 pgs: 97 active+clean; 7.5 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.5 MiB/s wr, 427 op/s 2023-09-23T09:10:21.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:10:20 smithi082 ceph-mon[97694]: pgmap v420: 97 pgs: 97 active+clean; 7.5 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.5 MiB/s wr, 427 op/s 2023-09-23T09:10:21.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:10:20 smithi161 ceph-mon[99580]: pgmap v420: 97 pgs: 97 active+clean; 7.5 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.5 MiB/s wr, 427 op/s 2023-09-23T09:10:23.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:10:22 smithi135 ceph-mon[99205]: pgmap v421: 97 pgs: 97 active+clean; 7.5 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.7 MiB/s wr, 355 op/s 2023-09-23T09:10:23.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:10:22 smithi082 ceph-mon[97694]: pgmap v421: 97 pgs: 97 active+clean; 7.5 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.7 MiB/s wr, 355 op/s 2023-09-23T09:10:23.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:10:22 smithi161 ceph-mon[99580]: pgmap v421: 97 pgs: 97 active+clean; 7.5 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.7 MiB/s wr, 355 op/s 2023-09-23T09:10:24.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:10:23 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:10:24.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:10:23 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:10:24.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:10:23 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:10:25.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:10:24 smithi135 ceph-mon[99205]: pgmap v422: 97 pgs: 97 active+clean; 7.5 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.6 MiB/s wr, 341 op/s 2023-09-23T09:10:25.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:10:24 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:10:25.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:10:24 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:10:25.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:10:24 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:10:25.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:10:24 smithi082 ceph-mon[97694]: pgmap v422: 97 pgs: 97 active+clean; 7.5 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.6 MiB/s wr, 341 op/s 2023-09-23T09:10:25.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:10:24 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:10:25.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:10:24 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:10:25.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:10:24 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:10:25.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:10:24 smithi161 ceph-mon[99580]: pgmap v422: 97 pgs: 97 active+clean; 7.5 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.6 MiB/s wr, 341 op/s 2023-09-23T09:10:25.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:10:24 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:10:25.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:10:24 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:10:25.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:10:24 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:10:27.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:10:26 smithi135 ceph-mon[99205]: pgmap v423: 97 pgs: 97 active+clean; 7.5 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 3.4 MiB/s wr, 326 op/s 2023-09-23T09:10:27.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:10:26 smithi082 ceph-mon[97694]: pgmap v423: 97 pgs: 97 active+clean; 7.5 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 3.4 MiB/s wr, 326 op/s 2023-09-23T09:10:27.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:10:26 smithi161 ceph-mon[99580]: pgmap v423: 97 pgs: 97 active+clean; 7.5 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 3.4 MiB/s wr, 326 op/s 2023-09-23T09:10:29.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:10:28 smithi135 ceph-mon[99205]: pgmap v424: 97 pgs: 97 active+clean; 7.5 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1001 KiB/s rd, 3.2 MiB/s wr, 307 op/s 2023-09-23T09:10:29.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:10:28 smithi082 ceph-mon[97694]: pgmap v424: 97 pgs: 97 active+clean; 7.5 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1001 KiB/s rd, 3.2 MiB/s wr, 307 op/s 2023-09-23T09:10:29.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:10:28 smithi161 ceph-mon[99580]: pgmap v424: 97 pgs: 97 active+clean; 7.5 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1001 KiB/s rd, 3.2 MiB/s wr, 307 op/s 2023-09-23T09:10:31.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:10:30 smithi135 ceph-mon[99205]: pgmap v425: 97 pgs: 97 active+clean; 7.5 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.3 MiB/s wr, 407 op/s 2023-09-23T09:10:31.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:10:30 smithi082 ceph-mon[97694]: pgmap v425: 97 pgs: 97 active+clean; 7.5 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.3 MiB/s wr, 407 op/s 2023-09-23T09:10:31.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:10:30 smithi161 ceph-mon[99580]: pgmap v425: 97 pgs: 97 active+clean; 7.5 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.3 MiB/s wr, 407 op/s 2023-09-23T09:10:33.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:10:32 smithi135 ceph-mon[99205]: pgmap v426: 97 pgs: 97 active+clean; 7.5 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 892 KiB/s rd, 2.8 MiB/s wr, 272 op/s 2023-09-23T09:10:33.094 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:10:33.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:10:32 smithi082 ceph-mon[97694]: pgmap v426: 97 pgs: 97 active+clean; 7.5 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 892 KiB/s rd, 2.8 MiB/s wr, 272 op/s 2023-09-23T09:10:33.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:10:32 smithi161 ceph-mon[99580]: pgmap v426: 97 pgs: 97 active+clean; 7.5 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 892 KiB/s rd, 2.8 MiB/s wr, 272 op/s 2023-09-23T09:10:33.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.297+0000 7f22e93ff700 1 -- 172.21.15.82:0/2604041944 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22e4106880 msgr2=0x7f22e4106c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:10:33.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.297+0000 7f22e93ff700 1 --2- 172.21.15.82:0/2604041944 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22e4106880 0x7f22e4106c60 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f22d4009990 tx=0x7f22d4009ca0 comp rx=0 tx=0).stop 2023-09-23T09:10:33.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.297+0000 7f22e93ff700 1 -- 172.21.15.82:0/2604041944 shutdown_connections 2023-09-23T09:10:33.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.297+0000 7f22e93ff700 1 --2- 172.21.15.82:0/2604041944 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22e4101230 0x7f22e410d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:10:33.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.297+0000 7f22e93ff700 1 --2- 172.21.15.82:0/2604041944 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22e4106880 0x7f22e4106c60 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:10:33.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.297+0000 7f22e93ff700 1 --2- 172.21.15.82:0/2604041944 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f22e4100870 0x7f22e4100cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:10:33.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.297+0000 7f22e93ff700 1 -- 172.21.15.82:0/2604041944 >> 172.21.15.82:0/2604041944 conn(0x7f22e40fc3a0 msgr2=0x7f22e40fe7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:10:33.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.297+0000 7f22e93ff700 1 -- 172.21.15.82:0/2604041944 shutdown_connections 2023-09-23T09:10:33.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.297+0000 7f22e93ff700 1 -- 172.21.15.82:0/2604041944 wait complete. 2023-09-23T09:10:33.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.298+0000 7f22e93ff700 1 Processor -- start 2023-09-23T09:10:33.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.298+0000 7f22e93ff700 1 -- start start 2023-09-23T09:10:33.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.299+0000 7f22e93ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22e4100870 0x7f22e41a1b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:10:33.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.299+0000 7f22e93ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f22e4101230 0x7f22e41a20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:10:33.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.299+0000 7f22e93ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22e4106880 0x7f22e410c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:10:33.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.299+0000 7f22e93ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22e410cbf0 con 0x7f22e4100870 2023-09-23T09:10:33.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.299+0000 7f22e93ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22e410cd60 con 0x7f22e4106880 2023-09-23T09:10:33.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.299+0000 7f22e93ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22e410cf20 con 0x7f22e4101230 2023-09-23T09:10:33.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.299+0000 7f22e2ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22e4100870 0x7f22e41a1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:10:33.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.299+0000 7f22e2ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22e4100870 0x7f22e41a1b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36076/0 (socket says 172.21.15.82:36076) 2023-09-23T09:10:33.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.299+0000 7f22e2ffd700 1 -- 172.21.15.82:0/3757785123 learned_addr learned my addr 172.21.15.82:0/3757785123 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:10:33.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.299+0000 7f22dbfff700 1 --2- 172.21.15.82:0/3757785123 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f22e4101230 0x7f22e41a20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:10:33.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.299+0000 7f22e37fe700 1 --2- 172.21.15.82:0/3757785123 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22e4106880 0x7f22e410c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:10:33.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.299+0000 7f22e2ffd700 1 -- 172.21.15.82:0/3757785123 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f22e4101230 msgr2=0x7f22e41a20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:10:33.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.299+0000 7f22e2ffd700 1 --2- 172.21.15.82:0/3757785123 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f22e4101230 0x7f22e41a20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:10:33.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.299+0000 7f22e2ffd700 1 -- 172.21.15.82:0/3757785123 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22e4106880 msgr2=0x7f22e410c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:10:33.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.299+0000 7f22e2ffd700 1 --2- 172.21.15.82:0/3757785123 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22e4106880 0x7f22e410c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:10:33.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.299+0000 7f22e2ffd700 1 -- 172.21.15.82:0/3757785123 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22d40095f0 con 0x7f22e4100870 2023-09-23T09:10:33.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.299+0000 7f22e37fe700 1 --2- 172.21.15.82:0/3757785123 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22e4106880 0x7f22e410c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:10:33.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.300+0000 7f22e2ffd700 1 --2- 172.21.15.82:0/3757785123 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22e4100870 0x7f22e41a1b60 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f22d4005770 tx=0x7f22d40057a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:10:33.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.300+0000 7f22e0ff9700 1 -- 172.21.15.82:0/3757785123 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d401d070 con 0x7f22e4100870 2023-09-23T09:10:33.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.300+0000 7f22e93ff700 1 -- 172.21.15.82:0/3757785123 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22e410d1a0 con 0x7f22e4100870 2023-09-23T09:10:33.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.300+0000 7f22e0ff9700 1 -- 172.21.15.82:0/3757785123 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f22d400fbb0 con 0x7f22e4100870 2023-09-23T09:10:33.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.300+0000 7f22e0ff9700 1 -- 172.21.15.82:0/3757785123 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d40173f0 con 0x7f22e4100870 2023-09-23T09:10:33.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.300+0000 7f22e93ff700 1 -- 172.21.15.82:0/3757785123 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22e41a9c60 con 0x7f22e4100870 2023-09-23T09:10:33.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.303+0000 7f22e0ff9700 1 -- 172.21.15.82:0/3757785123 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f22d4021410 con 0x7f22e4100870 2023-09-23T09:10:33.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.304+0000 7f22e0ff9700 1 --2- 172.21.15.82:0/3757785123 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f22d00a00c0 0x7f22d00a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:10:33.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.305+0000 7f22fcc43b80 1 Processor -- start 2023-09-23T09:10:33.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.305+0000 7f22e0ff9700 1 -- 172.21.15.82:0/3757785123 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f22d40ccb00 con 0x7f22e4100870 2023-09-23T09:10:33.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.305+0000 7f22dbfff700 1 --2- 172.21.15.82:0/3757785123 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f22d00a00c0 0x7f22d00a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:10:33.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.305+0000 7f22fcc43b80 1 -- start start 2023-09-23T09:10:33.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.305+0000 7f22fcc43b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fd5bc2380 0x560fd5bc2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:10:33.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.305+0000 7f22fcc43b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560fd5bc2ca0 0x560fd5bbc700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:10:33.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.305+0000 7f22fcc43b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560fd5bbcc40 0x560fd5bbd0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:10:33.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.305+0000 7f22fcc43b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fd5b247b0 con 0x560fd5bbcc40 2023-09-23T09:10:33.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.305+0000 7f22fcc43b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fd5b15780 con 0x560fd5bc2380 2023-09-23T09:10:33.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.305+0000 7f22fcc43b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fd5b130a0 con 0x560fd5bc2ca0 2023-09-23T09:10:33.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.305+0000 7f22dbfff700 1 --2- 172.21.15.82:0/3757785123 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f22d00a00c0 0x7f22d00a2580 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f22e410d5d0 tx=0x7f22cc00b410 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:10:33.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.306+0000 7f22e2ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fd5bc2380 0x560fd5bc2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:10:33.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.306+0000 7f22e37fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560fd5bbcc40 0x560fd5bbd0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:10:33.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.306+0000 7f22e2ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fd5bc2380 0x560fd5bc2760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:32990/0 (socket says 172.21.15.82:32990) 2023-09-23T09:10:33.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.306+0000 7f22e2ffd700 1 -- 172.21.15.82:0/2088736083 learned_addr learned my addr 172.21.15.82:0/2088736083 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:10:33.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.306+0000 7f22dbfff700 1 --2- 172.21.15.82:0/2088736083 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560fd5bc2ca0 0x560fd5bbc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:10:33.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.306+0000 7f22e2ffd700 1 -- 172.21.15.82:0/2088736083 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560fd5bc2ca0 msgr2=0x560fd5bbc700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:10:33.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.306+0000 7f22e2ffd700 1 --2- 172.21.15.82:0/2088736083 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560fd5bc2ca0 0x560fd5bbc700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:10:33.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.306+0000 7f22e2ffd700 1 -- 172.21.15.82:0/2088736083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560fd5bbcc40 msgr2=0x560fd5bbd0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:10:33.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.306+0000 7f22e2ffd700 1 --2- 172.21.15.82:0/2088736083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560fd5bbcc40 0x560fd5bbd0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:10:33.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.306+0000 7f22e2ffd700 1 -- 172.21.15.82:0/2088736083 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560fd598e630 con 0x560fd5bc2380 2023-09-23T09:10:33.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.306+0000 7f22dbfff700 1 --2- 172.21.15.82:0/2088736083 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560fd5bc2ca0 0x560fd5bbc700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:10:33.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.306+0000 7f22e37fe700 1 --2- 172.21.15.82:0/2088736083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560fd5bbcc40 0x560fd5bbd0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:10:33.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.306+0000 7f22e2ffd700 1 --2- 172.21.15.82:0/2088736083 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fd5bc2380 0x560fd5bc2760 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f22d4006010 tx=0x7f22d4099c70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17b2a2c2c2ed2f54 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:10:33.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.307+0000 7f22d97fa700 1 -- 172.21.15.82:0/2088736083 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d409e070 con 0x560fd5bc2380 2023-09-23T09:10:33.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.307+0000 7f22d97fa700 1 -- 172.21.15.82:0/2088736083 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f22d40a1fc0 con 0x560fd5bc2380 2023-09-23T09:10:33.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.307+0000 7f22d97fa700 1 -- 172.21.15.82:0/2088736083 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d409a700 con 0x560fd5bc2380 2023-09-23T09:10:33.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.307+0000 7f22fcc43b80 1 -- 172.21.15.82:0/2088736083 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fd5bc2380 msgr2=0x560fd5bc2760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:10:33.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.307+0000 7f22fcc43b80 1 --2- 172.21.15.82:0/2088736083 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fd5bc2380 0x560fd5bc2760 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f22d4006010 tx=0x7f22d4099c70 comp rx=0 tx=0).stop 2023-09-23T09:10:33.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.307+0000 7f22fcc43b80 1 -- 172.21.15.82:0/2088736083 shutdown_connections 2023-09-23T09:10:33.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.307+0000 7f22fcc43b80 1 --2- 172.21.15.82:0/2088736083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560fd5bbcc40 0x560fd5bbd0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:10:33.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.307+0000 7f22fcc43b80 1 --2- 172.21.15.82:0/2088736083 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fd5bc2380 0x560fd5bc2760 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:10:33.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.307+0000 7f22fcc43b80 1 --2- 172.21.15.82:0/2088736083 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560fd5bc2ca0 0x560fd5bbc700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:10:33.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.307+0000 7f22fcc43b80 1 -- 172.21.15.82:0/2088736083 >> 172.21.15.82:0/2088736083 conn(0x560fd5b310e0 msgr2=0x560fd5bb7410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:10:33.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.307+0000 7f22fcc43b80 1 -- 172.21.15.82:0/2088736083 shutdown_connections 2023-09-23T09:10:33.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.308+0000 7f22fcc43b80 1 -- 172.21.15.82:0/2088736083 wait complete. 2023-09-23T09:10:33.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.308+0000 7f22fcc43b80 1 -- start start 2023-09-23T09:10:33.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.308+0000 7f22fcc43b80 1 Processor -- start 2023-09-23T09:10:33.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.309+0000 7f22fcc43b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fd5bbcc40 0x560fd5bc8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:10:33.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.309+0000 7f22fcc43b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560fd5bc2380 0x560fd5bc5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:10:33.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.309+0000 7f22fcc43b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560fd5bc2ca0 0x560fd5bc6680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:10:33.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.309+0000 7f22fcc43b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fd5b0e990 con 0x560fd5bc2ca0 2023-09-23T09:10:33.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.309+0000 7f22fcc43b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fd5aacbb0 con 0x560fd5bbcc40 2023-09-23T09:10:33.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.309+0000 7f22fcc43b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fd5aac8b0 con 0x560fd5bc2380 2023-09-23T09:10:33.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.309+0000 7f22fcc43b80 10 client.0 _ll_register_callbacks cb 0x560fd59f6a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:10:33.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.309+0000 7f22e37fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560fd5bc2ca0 0x560fd5bc6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:10:33.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.309+0000 7f22e37fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560fd5bc2ca0 0x560fd5bc6680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36082/0 (socket says 172.21.15.82:36082) 2023-09-23T09:10:33.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.309+0000 7f22e37fe700 1 -- 172.21.15.82:0/949133511 learned_addr learned my addr 172.21.15.82:0/949133511 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:10:33.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.309+0000 7f22dbfff700 1 --2- 172.21.15.82:0/949133511 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560fd5bc2380 0x560fd5bc5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:10:33.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.309+0000 7f22e37fe700 1 -- 172.21.15.82:0/949133511 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560fd5bc2380 msgr2=0x560fd5bc5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:10:33.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.309+0000 7f22e37fe700 1 --2- 172.21.15.82:0/949133511 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560fd5bc2380 0x560fd5bc5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:10:33.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.309+0000 7f22e2ffd700 1 --2- 172.21.15.82:0/949133511 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fd5bbcc40 0x560fd5bc8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:10:33.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.309+0000 7f22e37fe700 1 -- 172.21.15.82:0/949133511 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fd5bbcc40 msgr2=0x560fd5bc8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:10:33.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.309+0000 7f22e37fe700 1 --2- 172.21.15.82:0/949133511 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fd5bbcc40 0x560fd5bc8cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:10:33.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.309+0000 7f22e37fe700 1 -- 172.21.15.82:0/949133511 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22dc009050 con 0x560fd5bc2ca0 2023-09-23T09:10:33.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.309+0000 7f22e2ffd700 1 --2- 172.21.15.82:0/949133511 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fd5bbcc40 0x560fd5bc8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T09:10:33.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.310+0000 7f22e37fe700 1 --2- 172.21.15.82:0/949133511 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560fd5bc2ca0 0x560fd5bc6680 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f22dc007f70 tx=0x7f22dc009390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d51e0137f567884 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:10:33.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.310+0000 7f22ca7fc700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:10:33.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.310+0000 7f22ca7fc700 1 -- 172.21.15.82:0/949133511 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22dc00e050 con 0x560fd5bc2ca0 2023-09-23T09:10:33.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.310+0000 7f22fcc43b80 1 -- 172.21.15.82:0/949133511 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560fd5b8c1c0 con 0x560fd5bc2ca0 2023-09-23T09:10:33.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.310+0000 7f22ca7fc700 1 -- 172.21.15.82:0/949133511 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f22dc013b90 con 0x560fd5bc2ca0 2023-09-23T09:10:33.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.310+0000 7f22ca7fc700 1 -- 172.21.15.82:0/949133511 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) v2 ==== 24+0+0 (secure 0 0 0) 0x7f22dc013d50 con 0x560fd5bc2ca0 2023-09-23T09:10:33.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.310+0000 7f22fcc43b80 10 client.16494 fetch_fsmap learned FSMap version 65 2023-09-23T09:10:33.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.310+0000 7f22fcc43b80 1 -- 172.21.15.82:0/949133511 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=4+}) v3 -- 0x7f22e41a9c60 con 0x560fd5bc2ca0 2023-09-23T09:10:33.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.310+0000 7f22ca7fc700 1 -- 172.21.15.82:0/949133511 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x560fd5b8c1c0 con 0x560fd5bc2ca0 2023-09-23T09:10:33.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.310+0000 7f22ca7fc700 1 -- 172.21.15.82:0/949133511 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 65) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f22dc015390 con 0x560fd5bc2ca0 2023-09-23T09:10:33.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.311+0000 7f22fcc43b80 10 client.16494 fetch_fsmap finished waiting for FSMap version 65 2023-09-23T09:10:33.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.311+0000 7f22fcc43b80 10 client.16494 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:10:33.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.311+0000 7f22fcc43b80 20 client.16494 populate_metadata read hostname 'smithi082' 2023-09-23T09:10:33.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.311+0000 7f22fcc43b80 1 --2- 172.21.15.82:0/949133511 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x560fd5bd64b0 0x560fd5bd88d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:10:33.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.311+0000 7f22fcc43b80 4 client.16494 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:10:33.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.311+0000 7f22fcc43b80 1 -- 172.21.15.82:0/949133511 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560fd5ab4ba0 con 0x560fd5bd64b0 2023-09-23T09:10:33.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.311+0000 7f22e2ffd700 1 --2- 172.21.15.82:0/949133511 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x560fd5bd64b0 0x560fd5bd88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:10:33.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.311+0000 7f22ca7fc700 10 client.16494 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:10:33.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.311+0000 7f22e2ffd700 1 --2- 172.21.15.82:0/949133511 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x560fd5bd64b0 0x560fd5bd88d0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=576fcd2c7c5074a6 server_cookie=50d90a30eef55eb1 in_seq=0 out_seq=0 2023-09-23T09:10:33.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.312+0000 7f22ca7fc700 1 -- 172.21.15.82:0/949133511 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x560fd5ab4ba0 con 0x560fd5bd64b0 2023-09-23T09:10:33.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.312+0000 7f22ca7fc700 10 client.16494 handle_command_reply: tid=0 2023-09-23T09:10:33.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.312+0000 7f22fcc43b80 1 client.16494 shutdown 2023-09-23T09:10:33.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.312+0000 7f22fcc43b80 1 -- 172.21.15.82:0/949133511 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560fd5bc2ca0 msgr2=0x560fd5bc6680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:10:33.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.312+0000 7f22fcc43b80 1 --2- 172.21.15.82:0/949133511 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560fd5bc2ca0 0x560fd5bc6680 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f22dc007f70 tx=0x7f22dc009390 comp rx=0 tx=0).stop 2023-09-23T09:10:33.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.312+0000 7f22fcc43b80 1 -- 172.21.15.82:0/949133511 shutdown_connections 2023-09-23T09:10:33.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.312+0000 7f22fcc43b80 1 --2- 172.21.15.82:0/949133511 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x560fd5bd64b0 0x560fd5bd88d0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:10:33.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.312+0000 7f22fcc43b80 1 --2- 172.21.15.82:0/949133511 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560fd5bc2ca0 0x560fd5bc6680 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:10:33.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.312+0000 7f22fcc43b80 1 --2- 172.21.15.82:0/949133511 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fd5bbcc40 0x560fd5bc8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:10:33.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.312+0000 7f22fcc43b80 1 --2- 172.21.15.82:0/949133511 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560fd5bc2380 0x560fd5bc5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:10:33.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.312+0000 7f22ca7fc700 0 client.16494 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:10:33.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.312+0000 7f22fcc43b80 1 -- 172.21.15.82:0/949133511 >> 172.21.15.82:0/949133511 conn(0x560fd5b310e0 msgr2=0x560fd5bb1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:10:33.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.313+0000 7f22fcc43b80 1 -- 172.21.15.82:0/949133511 shutdown_connections 2023-09-23T09:10:33.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.313+0000 7f22fcc43b80 1 -- 172.21.15.82:0/949133511 wait complete. 2023-09-23T09:10:33.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.313+0000 7f22fcc43b80 20 client.16494 trim_cache size 0 max 16384 2023-09-23T09:10:33.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.331+0000 7f22fcc43b80 1 Processor -- start 2023-09-23T09:10:33.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.331+0000 7f22fcc43b80 1 -- start start 2023-09-23T09:10:33.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.331+0000 7f22fcc43b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560fd5bbcc40 0x560fd5bc87f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:10:33.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.331+0000 7f22fcc43b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560fd5bc2380 0x560fd5bc0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:10:33.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.331+0000 7f22fcc43b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fd5bc2ca0 0x560fd5bc1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:10:33.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.331+0000 7f22fcc43b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fd5990920 con 0x560fd5bc2380 2023-09-23T09:10:33.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.331+0000 7f22fcc43b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fd5bb79a0 con 0x560fd5bc2ca0 2023-09-23T09:10:33.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.331+0000 7f22fcc43b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fd5bd3af0 con 0x560fd5bbcc40 2023-09-23T09:10:33.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.331+0000 7f22dbfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560fd5bc2380 0x560fd5bc0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:10:33.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.331+0000 7f22dbfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560fd5bc2380 0x560fd5bc0fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36094/0 (socket says 172.21.15.82:36094) 2023-09-23T09:10:33.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.331+0000 7f22dbfff700 1 -- 172.21.15.82:0/4024486310 learned_addr learned my addr 172.21.15.82:0/4024486310 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:10:33.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.331+0000 7f22e2ffd700 1 --2- 172.21.15.82:0/4024486310 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560fd5bbcc40 0x560fd5bc87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:10:33.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.331+0000 7f22e37fe700 1 --2- 172.21.15.82:0/4024486310 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fd5bc2ca0 0x560fd5bc1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:10:33.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.332+0000 7f22dbfff700 1 -- 172.21.15.82:0/4024486310 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560fd5bbcc40 msgr2=0x560fd5bc87f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:10:33.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.332+0000 7f22dbfff700 1 --2- 172.21.15.82:0/4024486310 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560fd5bbcc40 0x560fd5bc87f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:10:33.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.332+0000 7f22dbfff700 1 -- 172.21.15.82:0/4024486310 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fd5bc2ca0 msgr2=0x560fd5bc1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:10:33.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.332+0000 7f22dbfff700 1 --2- 172.21.15.82:0/4024486310 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fd5bc2ca0 0x560fd5bc1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:10:33.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.332+0000 7f22dbfff700 1 -- 172.21.15.82:0/4024486310 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560fd593ade0 con 0x560fd5bc2380 2023-09-23T09:10:33.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.332+0000 7f22e37fe700 1 --2- 172.21.15.82:0/4024486310 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fd5bc2ca0 0x560fd5bc1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:10:33.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.332+0000 7f22dbfff700 1 --2- 172.21.15.82:0/4024486310 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560fd5bc2380 0x560fd5bc0fe0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f22cc010ff0 tx=0x7f22cc013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83980df8d91c85db server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:10:33.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.332+0000 7f22d9ffb700 1 -- 172.21.15.82:0/4024486310 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22cc020db0 con 0x560fd5bc2380 2023-09-23T09:10:33.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.332+0000 7f22d9ffb700 1 -- 172.21.15.82:0/4024486310 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f22cc015070 con 0x560fd5bc2380 2023-09-23T09:10:33.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.332+0000 7f22d9ffb700 1 -- 172.21.15.82:0/4024486310 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22cc011440 con 0x560fd5bc2380 2023-09-23T09:10:33.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.333+0000 7f22fcc43b80 1 -- 172.21.15.82:0/4024486310 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560fd5bc2380 msgr2=0x560fd5bc0fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:10:33.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.333+0000 7f22fcc43b80 1 --2- 172.21.15.82:0/4024486310 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560fd5bc2380 0x560fd5bc0fe0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f22cc010ff0 tx=0x7f22cc013000 comp rx=0 tx=0).stop 2023-09-23T09:10:33.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.333+0000 7f22fcc43b80 1 -- 172.21.15.82:0/4024486310 shutdown_connections 2023-09-23T09:10:33.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.333+0000 7f22fcc43b80 1 --2- 172.21.15.82:0/4024486310 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fd5bc2ca0 0x560fd5bc1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:10:33.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.333+0000 7f22fcc43b80 1 --2- 172.21.15.82:0/4024486310 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560fd5bbcc40 0x560fd5bc87f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:10:33.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.333+0000 7f22fcc43b80 1 --2- 172.21.15.82:0/4024486310 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560fd5bc2380 0x560fd5bc0fe0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:10:33.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.333+0000 7f22fcc43b80 1 -- 172.21.15.82:0/4024486310 >> 172.21.15.82:0/4024486310 conn(0x560fd5b310e0 msgr2=0x560fd5bc0090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:10:33.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.333+0000 7f22fcc43b80 1 -- 172.21.15.82:0/4024486310 shutdown_connections 2023-09-23T09:10:33.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.333+0000 7f22fcc43b80 1 -- 172.21.15.82:0/4024486310 wait complete. 2023-09-23T09:10:33.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.333+0000 7f22fcc43b80 1 -- start start 2023-09-23T09:10:33.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.334+0000 7f22fcc43b80 1 Processor -- start 2023-09-23T09:10:33.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.334+0000 7f22fcc43b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560fd5bbcc40 0x560fd5bcd680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:10:33.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.334+0000 7f22fcc43b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560fd5bc2380 0x560fd5bc48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:10:33.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.334+0000 7f22fcc43b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fd5bc2ca0 0x560fd5bc5030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:10:33.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.334+0000 7f22fcc43b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fd5bc5700 con 0x560fd5bc2380 2023-09-23T09:10:33.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.335+0000 7f22fcc43b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fd5c2a2a0 con 0x560fd5bc2ca0 2023-09-23T09:10:33.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.335+0000 7f22fcc43b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fd5c2a3e0 con 0x560fd5bbcc40 2023-09-23T09:10:33.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.335+0000 7f22fcc43b80 10 client.0 _ll_register_callbacks cb 0x7f22dc0078a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:10:33.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.335+0000 7f22dbfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560fd5bc2380 0x560fd5bc48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:10:33.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.335+0000 7f22dbfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560fd5bc2380 0x560fd5bc48f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36102/0 (socket says 172.21.15.82:36102) 2023-09-23T09:10:33.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.335+0000 7f22dbfff700 1 -- 172.21.15.82:0/1819702958 learned_addr learned my addr 172.21.15.82:0/1819702958 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:10:33.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.335+0000 7f22e37fe700 1 --2- 172.21.15.82:0/1819702958 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fd5bc2ca0 0x560fd5bc5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:10:33.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.335+0000 7f22e2ffd700 1 --2- 172.21.15.82:0/1819702958 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560fd5bbcc40 0x560fd5bcd680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:10:33.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.335+0000 7f22dbfff700 1 -- 172.21.15.82:0/1819702958 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560fd5bbcc40 msgr2=0x560fd5bcd680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:10:33.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.335+0000 7f22dbfff700 1 --2- 172.21.15.82:0/1819702958 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560fd5bbcc40 0x560fd5bcd680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:10:33.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.335+0000 7f22dbfff700 1 -- 172.21.15.82:0/1819702958 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fd5bc2ca0 msgr2=0x560fd5bc5030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:10:33.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.335+0000 7f22dbfff700 1 --2- 172.21.15.82:0/1819702958 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fd5bc2ca0 0x560fd5bc5030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:10:33.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.335+0000 7f22dbfff700 1 -- 172.21.15.82:0/1819702958 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22cc010c20 con 0x560fd5bc2380 2023-09-23T09:10:33.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.335+0000 7f22dbfff700 1 --2- 172.21.15.82:0/1819702958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560fd5bc2380 0x560fd5bc48f0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f22cc005950 tx=0x7f22cc00bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb6bd3f5faa58842 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:10:33.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.335+0000 7f22ca7fc700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:10:33.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.336+0000 7f22ca7fc700 1 -- 172.21.15.82:0/1819702958 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22cc0056a0 con 0x560fd5bc2380 2023-09-23T09:10:33.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.336+0000 7f22fcc43b80 1 -- 172.21.15.82:0/1819702958 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560fd5baf8b0 con 0x560fd5bc2380 2023-09-23T09:10:33.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.336+0000 7f22ca7fc700 1 -- 172.21.15.82:0/1819702958 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f22cc017070 con 0x560fd5bc2380 2023-09-23T09:10:33.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.336+0000 7f22ca7fc700 1 -- 172.21.15.82:0/1819702958 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) v2 ==== 24+0+0 (secure 0 0 0) 0x7f22cc004690 con 0x560fd5bc2380 2023-09-23T09:10:33.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.336+0000 7f22fcc43b80 10 client.16500 fetch_fsmap learned FSMap version 65 2023-09-23T09:10:33.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.336+0000 7f22fcc43b80 1 -- 172.21.15.82:0/1819702958 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=4+}) v3 -- 0x560fd5923c60 con 0x560fd5bc2380 2023-09-23T09:10:33.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.336+0000 7f22ca7fc700 1 -- 172.21.15.82:0/1819702958 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x560fd5baf8b0 con 0x560fd5bc2380 2023-09-23T09:10:33.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.336+0000 7f22ca7fc700 1 -- 172.21.15.82:0/1819702958 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 65) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f22cc02f070 con 0x560fd5bc2380 2023-09-23T09:10:33.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.336+0000 7f22fcc43b80 10 client.16500 fetch_fsmap finished waiting for FSMap version 65 2023-09-23T09:10:33.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.336+0000 7f22fcc43b80 10 client.16500 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:10:33.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.336+0000 7f22fcc43b80 20 client.16500 populate_metadata read hostname 'smithi082' 2023-09-23T09:10:33.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.336+0000 7f22fcc43b80 1 --2- 172.21.15.82:0/1819702958 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x560fd5c2ba00 0x560fd5c2de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:10:33.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.336+0000 7f22fcc43b80 4 client.16500 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:10:33.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.336+0000 7f22fcc43b80 1 -- 172.21.15.82:0/1819702958 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x560fd5b07970 con 0x560fd5c2ba00 2023-09-23T09:10:33.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.337+0000 7f22e2ffd700 1 --2- 172.21.15.82:0/1819702958 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x560fd5c2ba00 0x560fd5c2de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:10:33.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.337+0000 7f22ca7fc700 10 client.16500 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:10:33.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.337+0000 7f22e2ffd700 1 --2- 172.21.15.82:0/1819702958 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x560fd5c2ba00 0x560fd5c2de20 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc4e08e15d1cc407 server_cookie=25fb45aa8f4b5bf in_seq=0 out_seq=0 2023-09-23T09:10:33.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.338+0000 7f22ca7fc700 1 -- 172.21.15.82:0/1819702958 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x560fd5b07970 con 0x560fd5c2ba00 2023-09-23T09:10:33.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.338+0000 7f22ca7fc700 10 client.16500 handle_command_reply: tid=0 2023-09-23T09:10:33.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.338+0000 7f22fcc43b80 1 client.16500 shutdown 2023-09-23T09:10:33.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.338+0000 7f22fcc43b80 1 -- 172.21.15.82:0/1819702958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560fd5bc2380 msgr2=0x560fd5bc48f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:10:33.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.338+0000 7f22fcc43b80 1 --2- 172.21.15.82:0/1819702958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560fd5bc2380 0x560fd5bc48f0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f22cc005950 tx=0x7f22cc00bfd0 comp rx=0 tx=0).stop 2023-09-23T09:10:33.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.338+0000 7f22fcc43b80 1 -- 172.21.15.82:0/1819702958 shutdown_connections 2023-09-23T09:10:33.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.338+0000 7f22fcc43b80 1 --2- 172.21.15.82:0/1819702958 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fd5bc2ca0 0x560fd5bc5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:10:33.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.338+0000 7f22fcc43b80 1 --2- 172.21.15.82:0/1819702958 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560fd5bbcc40 0x560fd5bcd680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:10:33.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.338+0000 7f22fcc43b80 1 --2- 172.21.15.82:0/1819702958 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x560fd5c2ba00 0x560fd5c2de20 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:10:33.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.338+0000 7f22fcc43b80 1 --2- 172.21.15.82:0/1819702958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560fd5bc2380 0x560fd5bc48f0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:10:33.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.338+0000 7f22ca7fc700 0 client.16500 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:10:33.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.338+0000 7f22fcc43b80 1 -- 172.21.15.82:0/1819702958 >> 172.21.15.82:0/1819702958 conn(0x560fd5b310e0 msgr2=0x560fd5bc0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:10:33.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.338+0000 7f22fcc43b80 1 -- 172.21.15.82:0/1819702958 shutdown_connections 2023-09-23T09:10:33.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.338+0000 7f22fcc43b80 1 -- 172.21.15.82:0/1819702958 wait complete. 2023-09-23T09:10:33.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.338+0000 7f22fcc43b80 20 client.16500 trim_cache size 0 max 16384 2023-09-23T09:10:33.345 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:10:33.346 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "IDLE (waiting for more scrubs)", 2023-09-23T09:10:33.346 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:10:33.346 INFO:teuthology.orchestra.run.smithi082.stdout: "cba46b77-20dd-437c-a60a-ac01b400e1b8": { 2023-09-23T09:10:33.346 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:10:33.346 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "cba46b77-20dd-437c-a60a-ac01b400e1b8", 2023-09-23T09:10:33.346 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:10:33.346 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:10:33.346 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:10:33.346 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:10:33.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.339+0000 7f22e93ff700 1 -- 172.21.15.82:0/3757785123 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f22d00a00c0 msgr2=0x7f22d00a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:10:33.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.339+0000 7f22e93ff700 1 --2- 172.21.15.82:0/3757785123 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f22d00a00c0 0x7f22d00a2580 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f22e410d5d0 tx=0x7f22cc00b410 comp rx=0 tx=0).stop 2023-09-23T09:10:33.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.339+0000 7f22e93ff700 1 -- 172.21.15.82:0/3757785123 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22e4100870 msgr2=0x7f22e41a1b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:10:33.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.339+0000 7f22e93ff700 1 --2- 172.21.15.82:0/3757785123 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22e4100870 0x7f22e41a1b60 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f22d4005770 tx=0x7f22d40057a0 comp rx=0 tx=0).stop 2023-09-23T09:10:33.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.339+0000 7f22e93ff700 1 -- 172.21.15.82:0/3757785123 shutdown_connections 2023-09-23T09:10:33.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.339+0000 7f22e93ff700 1 --2- 172.21.15.82:0/3757785123 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f22d00a00c0 0x7f22d00a2580 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:10:33.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.339+0000 7f22e93ff700 1 --2- 172.21.15.82:0/3757785123 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22e4106880 0x7f22e410c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:10:33.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.339+0000 7f22e93ff700 1 --2- 172.21.15.82:0/3757785123 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22e4100870 0x7f22e41a1b60 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:10:33.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.339+0000 7f22e93ff700 1 --2- 172.21.15.82:0/3757785123 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f22e4101230 0x7f22e41a20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:10:33.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.339+0000 7f22e93ff700 1 -- 172.21.15.82:0/3757785123 >> 172.21.15.82:0/3757785123 conn(0x7f22e40fc3a0 msgr2=0x7f22e40fca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:10:33.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.339+0000 7f22e93ff700 1 -- 172.21.15.82:0/3757785123 shutdown_connections 2023-09-23T09:10:33.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:10:33.339+0000 7f22e93ff700 1 -- 172.21.15.82:0/3757785123 wait complete. 2023-09-23T09:10:33.359 INFO:tasks.cephfs.filesystem:scrub status for tag:cba46b77-20dd-437c-a60a-ac01b400e1b8 - {'path': '/', 'tag': 'cba46b77-20dd-437c-a60a-ac01b400e1b8', 'options': 'recursive,force'} 2023-09-23T09:10:34.036 INFO:teuthology.orchestra.run.smithi082.stderr:39000000 of 50000000 tuples (78%) done (elapsed 788.78 s, remaining 222.48 s) 2023-09-23T09:10:35.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:10:34 smithi135 ceph-mon[99205]: pgmap v427: 97 pgs: 97 active+clean; 7.5 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 892 KiB/s rd, 2.8 MiB/s wr, 272 op/s 2023-09-23T09:10:35.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:10:34 smithi082 ceph-mon[97694]: pgmap v427: 97 pgs: 97 active+clean; 7.5 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 892 KiB/s rd, 2.8 MiB/s wr, 272 op/s 2023-09-23T09:10:35.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:10:34 smithi161 ceph-mon[99580]: pgmap v427: 97 pgs: 97 active+clean; 7.5 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 892 KiB/s rd, 2.8 MiB/s wr, 272 op/s 2023-09-23T09:10:37.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:10:36 smithi135 ceph-mon[99205]: pgmap v428: 97 pgs: 97 active+clean; 7.5 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.2 MiB/s wr, 402 op/s 2023-09-23T09:10:37.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:10:36 smithi082 ceph-mon[97694]: pgmap v428: 97 pgs: 97 active+clean; 7.5 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.2 MiB/s wr, 402 op/s 2023-09-23T09:10:37.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:10:36 smithi161 ceph-mon[99580]: pgmap v428: 97 pgs: 97 active+clean; 7.5 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.2 MiB/s wr, 402 op/s 2023-09-23T09:10:39.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:10:38 smithi135 ceph-mon[99205]: pgmap v429: 97 pgs: 97 active+clean; 7.5 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 965 KiB/s rd, 2.8 MiB/s wr, 265 op/s 2023-09-23T09:10:39.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:10:38 smithi082 ceph-mon[97694]: pgmap v429: 97 pgs: 97 active+clean; 7.5 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 965 KiB/s rd, 2.8 MiB/s wr, 265 op/s 2023-09-23T09:10:39.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:10:38 smithi161 ceph-mon[99580]: pgmap v429: 97 pgs: 97 active+clean; 7.5 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 965 KiB/s rd, 2.8 MiB/s wr, 265 op/s 2023-09-23T09:10:41.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:10:40 smithi135 ceph-mon[99205]: pgmap v430: 97 pgs: 97 active+clean; 7.5 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.1 MiB/s wr, 398 op/s 2023-09-23T09:10:41.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:10:40 smithi082 ceph-mon[97694]: pgmap v430: 97 pgs: 97 active+clean; 7.5 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.1 MiB/s wr, 398 op/s 2023-09-23T09:10:41.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:10:40 smithi161 ceph-mon[99580]: pgmap v430: 97 pgs: 97 active+clean; 7.5 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.1 MiB/s wr, 398 op/s 2023-09-23T09:10:43.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:10:42 smithi135 ceph-mon[99205]: pgmap v431: 97 pgs: 97 active+clean; 7.5 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 952 KiB/s rd, 2.8 MiB/s wr, 263 op/s 2023-09-23T09:10:43.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:10:42 smithi082 ceph-mon[97694]: pgmap v431: 97 pgs: 97 active+clean; 7.5 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 952 KiB/s rd, 2.8 MiB/s wr, 263 op/s 2023-09-23T09:10:43.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:10:42 smithi161 ceph-mon[99580]: pgmap v431: 97 pgs: 97 active+clean; 7.5 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 952 KiB/s rd, 2.8 MiB/s wr, 263 op/s 2023-09-23T09:10:45.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:10:44 smithi135 ceph-mon[99205]: pgmap v432: 97 pgs: 97 active+clean; 7.5 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 952 KiB/s rd, 2.8 MiB/s wr, 263 op/s 2023-09-23T09:10:45.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:10:44 smithi082 ceph-mon[97694]: pgmap v432: 97 pgs: 97 active+clean; 7.5 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 952 KiB/s rd, 2.8 MiB/s wr, 263 op/s 2023-09-23T09:10:45.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:10:44 smithi161 ceph-mon[99580]: pgmap v432: 97 pgs: 97 active+clean; 7.5 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 952 KiB/s rd, 2.8 MiB/s wr, 263 op/s 2023-09-23T09:10:47.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:10:46 smithi135 ceph-mon[99205]: pgmap v433: 97 pgs: 97 active+clean; 7.5 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.1 MiB/s wr, 387 op/s 2023-09-23T09:10:47.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:10:46 smithi082 ceph-mon[97694]: pgmap v433: 97 pgs: 97 active+clean; 7.5 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.1 MiB/s wr, 387 op/s 2023-09-23T09:10:47.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:10:46 smithi161 ceph-mon[99580]: pgmap v433: 97 pgs: 97 active+clean; 7.5 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.1 MiB/s wr, 387 op/s 2023-09-23T09:10:48.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:10:47 smithi135 ceph-mon[99205]: pgmap v434: 97 pgs: 97 active+clean; 7.5 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 935 KiB/s rd, 2.7 MiB/s wr, 256 op/s 2023-09-23T09:10:48.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:10:47 smithi082 ceph-mon[97694]: pgmap v434: 97 pgs: 97 active+clean; 7.5 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 935 KiB/s rd, 2.7 MiB/s wr, 256 op/s 2023-09-23T09:10:48.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:10:47 smithi161 ceph-mon[99580]: pgmap v434: 97 pgs: 97 active+clean; 7.5 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 935 KiB/s rd, 2.7 MiB/s wr, 256 op/s 2023-09-23T09:10:50.520 INFO:teuthology.orchestra.run.smithi082.stderr:39100000 of 50000000 tuples (78%) done (elapsed 805.26 s, remaining 224.48 s) 2023-09-23T09:10:50.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:10:50 smithi082 ceph-mon[97694]: pgmap v435: 97 pgs: 97 active+clean; 7.5 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.1 MiB/s wr, 387 op/s 2023-09-23T09:10:50.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:10:50 smithi161 ceph-mon[99580]: pgmap v435: 97 pgs: 97 active+clean; 7.5 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.1 MiB/s wr, 387 op/s 2023-09-23T09:10:50.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:10:50 smithi135 ceph-mon[99205]: pgmap v435: 97 pgs: 97 active+clean; 7.5 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.1 MiB/s wr, 387 op/s 2023-09-23T09:10:53.065 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:10:52 smithi135 ceph-mon[99205]: pgmap v436: 97 pgs: 97 active+clean; 7.5 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 916 KiB/s rd, 2.7 MiB/s wr, 254 op/s 2023-09-23T09:10:53.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:10:52 smithi082 ceph-mon[97694]: pgmap v436: 97 pgs: 97 active+clean; 7.5 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 916 KiB/s rd, 2.7 MiB/s wr, 254 op/s 2023-09-23T09:10:53.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:10:52 smithi161 ceph-mon[99580]: pgmap v436: 97 pgs: 97 active+clean; 7.5 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 916 KiB/s rd, 2.7 MiB/s wr, 254 op/s 2023-09-23T09:10:55.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:10:54 smithi135 ceph-mon[99205]: pgmap v437: 97 pgs: 97 active+clean; 7.5 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 916 KiB/s rd, 2.7 MiB/s wr, 254 op/s 2023-09-23T09:10:55.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:10:54 smithi082 ceph-mon[97694]: pgmap v437: 97 pgs: 97 active+clean; 7.5 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 916 KiB/s rd, 2.7 MiB/s wr, 254 op/s 2023-09-23T09:10:55.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:10:54 smithi161 ceph-mon[99580]: pgmap v437: 97 pgs: 97 active+clean; 7.5 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 916 KiB/s rd, 2.7 MiB/s wr, 254 op/s 2023-09-23T09:10:57.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:10:56 smithi135 ceph-mon[99205]: pgmap v438: 97 pgs: 97 active+clean; 7.6 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.1 MiB/s wr, 394 op/s 2023-09-23T09:10:57.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:10:56 smithi082 ceph-mon[97694]: pgmap v438: 97 pgs: 97 active+clean; 7.6 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.1 MiB/s wr, 394 op/s 2023-09-23T09:10:57.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:10:56 smithi161 ceph-mon[99580]: pgmap v438: 97 pgs: 97 active+clean; 7.6 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.1 MiB/s wr, 394 op/s 2023-09-23T09:10:59.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:10:58 smithi135 ceph-mon[99205]: pgmap v439: 97 pgs: 97 active+clean; 7.6 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 963 KiB/s rd, 2.8 MiB/s wr, 270 op/s 2023-09-23T09:10:59.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:10:58 smithi082 ceph-mon[97694]: pgmap v439: 97 pgs: 97 active+clean; 7.6 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 963 KiB/s rd, 2.8 MiB/s wr, 270 op/s 2023-09-23T09:10:59.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:10:58 smithi161 ceph-mon[99580]: pgmap v439: 97 pgs: 97 active+clean; 7.6 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 963 KiB/s rd, 2.8 MiB/s wr, 270 op/s 2023-09-23T09:11:01.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:11:00 smithi135 ceph-mon[99205]: pgmap v440: 97 pgs: 97 active+clean; 7.6 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.3 MiB/s wr, 406 op/s 2023-09-23T09:11:01.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:11:00 smithi082 ceph-mon[97694]: pgmap v440: 97 pgs: 97 active+clean; 7.6 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.3 MiB/s wr, 406 op/s 2023-09-23T09:11:01.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:11:00 smithi161 ceph-mon[99580]: pgmap v440: 97 pgs: 97 active+clean; 7.6 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.3 MiB/s wr, 406 op/s 2023-09-23T09:11:03.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:11:02 smithi135 ceph-mon[99205]: pgmap v441: 97 pgs: 97 active+clean; 7.6 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 994 KiB/s rd, 2.9 MiB/s wr, 276 op/s 2023-09-23T09:11:03.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:11:02 smithi082 ceph-mon[97694]: pgmap v441: 97 pgs: 97 active+clean; 7.6 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 994 KiB/s rd, 2.9 MiB/s wr, 276 op/s 2023-09-23T09:11:03.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:11:02 smithi161 ceph-mon[99580]: pgmap v441: 97 pgs: 97 active+clean; 7.6 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 994 KiB/s rd, 2.9 MiB/s wr, 276 op/s 2023-09-23T09:11:03.360 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:11:03.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.574+0000 7f2227fff700 1 -- 172.21.15.82:0/3407531274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2220072cf0 msgr2=0x7f22200730d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:11:03.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.574+0000 7f2227fff700 1 --2- 172.21.15.82:0/3407531274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2220072cf0 0x7f22200730d0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f221c009990 tx=0x7f221c009ca0 comp rx=0 tx=0).stop 2023-09-23T09:11:03.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.574+0000 7f2227fff700 1 -- 172.21.15.82:0/3407531274 shutdown_connections 2023-09-23T09:11:03.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.574+0000 7f2227fff700 1 --2- 172.21.15.82:0/3407531274 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f222010d140 0x7f222010f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:11:03.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.574+0000 7f2227fff700 1 --2- 172.21.15.82:0/3407531274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2220072cf0 0x7f22200730d0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:11:03.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.574+0000 7f2227fff700 1 --2- 172.21.15.82:0/3407531274 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2220073610 0x7f222010cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:11:03.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.574+0000 7f2227fff700 1 -- 172.21.15.82:0/3407531274 >> 172.21.15.82:0/3407531274 conn(0x7f22200fc390 msgr2=0x7f22200fe7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:11:03.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.574+0000 7f2227fff700 1 -- 172.21.15.82:0/3407531274 shutdown_connections 2023-09-23T09:11:03.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.574+0000 7f2227fff700 1 -- 172.21.15.82:0/3407531274 wait complete. 2023-09-23T09:11:03.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.575+0000 7f2227fff700 1 Processor -- start 2023-09-23T09:11:03.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.575+0000 7f2227fff700 1 -- start start 2023-09-23T09:11:03.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.576+0000 7f2227fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2220072cf0 0x7f222019e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:11:03.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.576+0000 7f2227fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2220073610 0x7f222019ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:11:03.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.576+0000 7f2227fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f222010d140 0x7f2220198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:11:03.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.576+0000 7f2227fff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2220198ff0 con 0x7f222010d140 2023-09-23T09:11:03.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.576+0000 7f2227fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2220199160 con 0x7f2220072cf0 2023-09-23T09:11:03.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.576+0000 7f2227fff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2220199320 con 0x7f2220073610 2023-09-23T09:11:03.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.576+0000 7f222659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f222010d140 0x7f2220198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:11:03.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.576+0000 7f222659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f222010d140 0x7f2220198980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55608/0 (socket says 172.21.15.82:55608) 2023-09-23T09:11:03.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.576+0000 7f222659c700 1 -- 172.21.15.82:0/3536454856 learned_addr learned my addr 172.21.15.82:0/3536454856 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:11:03.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.576+0000 7f222559a700 1 --2- 172.21.15.82:0/3536454856 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2220073610 0x7f222019ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:11:03.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.576+0000 7f2225d9b700 1 --2- 172.21.15.82:0/3536454856 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2220072cf0 0x7f222019e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:11:03.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.576+0000 7f222659c700 1 -- 172.21.15.82:0/3536454856 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2220073610 msgr2=0x7f222019ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:11:03.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.576+0000 7f222659c700 1 --2- 172.21.15.82:0/3536454856 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2220073610 0x7f222019ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:11:03.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.576+0000 7f222659c700 1 -- 172.21.15.82:0/3536454856 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2220072cf0 msgr2=0x7f222019e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:11:03.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.576+0000 7f222659c700 1 --2- 172.21.15.82:0/3536454856 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2220072cf0 0x7f222019e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:11:03.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.576+0000 7f222659c700 1 -- 172.21.15.82:0/3536454856 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f221c0095f0 con 0x7f222010d140 2023-09-23T09:11:03.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.577+0000 7f222659c700 1 --2- 172.21.15.82:0/3536454856 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f222010d140 0x7f2220198980 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f221800ef90 tx=0x7f221800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:11:03.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.577+0000 7f2216ffd700 1 -- 172.21.15.82:0/3536454856 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2218018070 con 0x7f222010d140 2023-09-23T09:11:03.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.577+0000 7f2227fff700 1 -- 172.21.15.82:0/3536454856 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22201995a0 con 0x7f222010d140 2023-09-23T09:11:03.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.577+0000 7f2216ffd700 1 -- 172.21.15.82:0/3536454856 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f221800f040 con 0x7f222010d140 2023-09-23T09:11:03.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.577+0000 7f2216ffd700 1 -- 172.21.15.82:0/3536454856 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f221800cc40 con 0x7f222010d140 2023-09-23T09:11:03.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.577+0000 7f2227fff700 1 -- 172.21.15.82:0/3536454856 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22201a5900 con 0x7f222010d140 2023-09-23T09:11:03.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.581+0000 7f2216ffd700 1 -- 172.21.15.82:0/3536454856 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f2218003a00 con 0x7f222010d140 2023-09-23T09:11:03.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.582+0000 7f223b8a8b80 1 Processor -- start 2023-09-23T09:11:03.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.582+0000 7f223b8a8b80 1 -- start start 2023-09-23T09:11:03.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.582+0000 7f223b8a8b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a21c3e7380 0x55a21c3e7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:11:03.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.582+0000 7f223b8a8b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a21c3e7ca0 0x55a21c3e1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:11:03.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.582+0000 7f223b8a8b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a21c3e1c40 0x55a21c3e20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:11:03.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.582+0000 7f223b8a8b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a21c3497b0 con 0x55a21c3e7380 2023-09-23T09:11:03.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.582+0000 7f2216ffd700 1 --2- 172.21.15.82:0/3536454856 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f220c0a00c0 0x7f220c0a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:11:03.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.582+0000 7f223b8a8b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a21c33a780 con 0x55a21c3e7ca0 2023-09-23T09:11:03.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.582+0000 7f223b8a8b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a21c3380a0 con 0x55a21c3e1c40 2023-09-23T09:11:03.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.582+0000 7f2216ffd700 1 -- 172.21.15.82:0/3536454856 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f22180cb180 con 0x7f222010d140 2023-09-23T09:11:03.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.583+0000 7f222559a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a21c3e7380 0x55a21c3e7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:11:03.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.583+0000 7f222659c700 1 --2- 172.21.15.82:0/3536454856 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f220c0a00c0 0x7f220c0a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:11:03.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.583+0000 7f222559a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a21c3e7380 0x55a21c3e7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55622/0 (socket says 172.21.15.82:55622) 2023-09-23T09:11:03.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.583+0000 7f222559a700 1 -- 172.21.15.82:0/178993519 learned_addr learned my addr 172.21.15.82:0/178993519 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:11:03.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.583+0000 7f2225d9b700 1 --2- 172.21.15.82:0/178993519 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a21c3e7ca0 0x55a21c3e1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:11:03.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.583+0000 7f222559a700 1 --2- 172.21.15.82:0/178993519 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a21c3e1c40 0x55a21c3e20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:11:03.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.583+0000 7f2225d9b700 1 -- 172.21.15.82:0/178993519 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a21c3e1c40 msgr2=0x55a21c3e20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:11:03.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.583+0000 7f2225d9b700 1 --2- 172.21.15.82:0/178993519 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a21c3e1c40 0x55a21c3e20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:11:03.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.583+0000 7f2225d9b700 1 -- 172.21.15.82:0/178993519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a21c3e7380 msgr2=0x55a21c3e7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:11:03.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.583+0000 7f2225d9b700 1 --2- 172.21.15.82:0/178993519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a21c3e7380 0x55a21c3e7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:11:03.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.583+0000 7f222659c700 1 --2- 172.21.15.82:0/3536454856 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f220c0a00c0 0x7f220c0a2580 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f22180a0170 tx=0x7f221800c820 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:11:03.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.583+0000 7f2225d9b700 1 -- 172.21.15.82:0/178993519 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a21c1b3630 con 0x55a21c3e7ca0 2023-09-23T09:11:03.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.583+0000 7f222559a700 1 --2- 172.21.15.82:0/178993519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a21c3e7380 0x55a21c3e7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:11:03.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.584+0000 7f2225d9b700 1 --2- 172.21.15.82:0/178993519 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a21c3e7ca0 0x55a21c3e1700 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f221c005910 tx=0x7f221c005bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=85b9c83e392df0a2 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:11:03.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.584+0000 7f220bfff700 1 -- 172.21.15.82:0/178993519 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f221c01d070 con 0x55a21c3e7ca0 2023-09-23T09:11:03.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.584+0000 7f220bfff700 1 -- 172.21.15.82:0/178993519 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f221c01e040 con 0x55a21c3e7ca0 2023-09-23T09:11:03.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.584+0000 7f220bfff700 1 -- 172.21.15.82:0/178993519 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f221c004760 con 0x55a21c3e7ca0 2023-09-23T09:11:03.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.585+0000 7f223b8a8b80 1 -- 172.21.15.82:0/178993519 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a21c3e7ca0 msgr2=0x55a21c3e1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:11:03.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.585+0000 7f223b8a8b80 1 --2- 172.21.15.82:0/178993519 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a21c3e7ca0 0x55a21c3e1700 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f221c005910 tx=0x7f221c005bc0 comp rx=0 tx=0).stop 2023-09-23T09:11:03.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.585+0000 7f223b8a8b80 1 -- 172.21.15.82:0/178993519 shutdown_connections 2023-09-23T09:11:03.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.585+0000 7f223b8a8b80 1 --2- 172.21.15.82:0/178993519 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a21c3e1c40 0x55a21c3e20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:11:03.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.585+0000 7f223b8a8b80 1 --2- 172.21.15.82:0/178993519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a21c3e7380 0x55a21c3e7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:11:03.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.585+0000 7f223b8a8b80 1 --2- 172.21.15.82:0/178993519 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a21c3e7ca0 0x55a21c3e1700 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:11:03.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.585+0000 7f223b8a8b80 1 -- 172.21.15.82:0/178993519 >> 172.21.15.82:0/178993519 conn(0x55a21c3560e0 msgr2=0x55a21c3dc410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:11:03.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.585+0000 7f223b8a8b80 1 -- 172.21.15.82:0/178993519 shutdown_connections 2023-09-23T09:11:03.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.585+0000 7f223b8a8b80 1 -- 172.21.15.82:0/178993519 wait complete. 2023-09-23T09:11:03.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.585+0000 7f223b8a8b80 1 -- start start 2023-09-23T09:11:03.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.586+0000 7f223b8a8b80 1 Processor -- start 2023-09-23T09:11:03.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.586+0000 7f223b8a8b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a21c3e1c40 0x55a21c3edc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:11:03.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.586+0000 7f223b8a8b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a21c3e7380 0x55a21c3eaf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:11:03.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.586+0000 7f223b8a8b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a21c3e7ca0 0x55a21c3eb660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:11:03.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.586+0000 7f223b8a8b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a21c333990 con 0x55a21c3e1c40 2023-09-23T09:11:03.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.586+0000 7f223b8a8b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a21c2d1bb0 con 0x55a21c3e7ca0 2023-09-23T09:11:03.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.586+0000 7f223b8a8b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a21c2d18b0 con 0x55a21c3e7380 2023-09-23T09:11:03.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.586+0000 7f223b8a8b80 10 client.0 _ll_register_callbacks cb 0x55a21c21ba80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:11:03.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.586+0000 7f222559a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a21c3e1c40 0x55a21c3edc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:11:03.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.586+0000 7f222559a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a21c3e1c40 0x55a21c3edc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55626/0 (socket says 172.21.15.82:55626) 2023-09-23T09:11:03.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.586+0000 7f222559a700 1 -- 172.21.15.82:0/2230729955 learned_addr learned my addr 172.21.15.82:0/2230729955 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:11:03.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.586+0000 7f2225d9b700 1 --2- 172.21.15.82:0/2230729955 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a21c3e7380 0x55a21c3eaf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:11:03.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.586+0000 7f222559a700 1 --2- 172.21.15.82:0/2230729955 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a21c3e7ca0 0x55a21c3eb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:11:03.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.587+0000 7f222559a700 1 -- 172.21.15.82:0/2230729955 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a21c3e7380 msgr2=0x55a21c3eaf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:11:03.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.587+0000 7f222559a700 1 --2- 172.21.15.82:0/2230729955 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a21c3e7380 0x55a21c3eaf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:11:03.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.587+0000 7f222559a700 1 -- 172.21.15.82:0/2230729955 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a21c3e7ca0 msgr2=0x55a21c3eb660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:11:03.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.587+0000 7f222559a700 1 --2- 172.21.15.82:0/2230729955 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a21c3e7ca0 0x55a21c3eb660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:11:03.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.587+0000 7f222559a700 1 -- 172.21.15.82:0/2230729955 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f221001b040 con 0x55a21c3e1c40 2023-09-23T09:11:03.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.587+0000 7f2225d9b700 1 --2- 172.21.15.82:0/2230729955 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a21c3e7380 0x55a21c3eaf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:11:03.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.587+0000 7f222559a700 1 --2- 172.21.15.82:0/2230729955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a21c3e1c40 0x55a21c3edc80 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f2210009720 tx=0x7f2210009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8924fea79303ab23 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:11:03.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.587+0000 7f22097fa700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:11:03.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.587+0000 7f22097fa700 1 -- 172.21.15.82:0/2230729955 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22100129f0 con 0x55a21c3e1c40 2023-09-23T09:11:03.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.587+0000 7f223b8a8b80 1 -- 172.21.15.82:0/2230729955 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a21c3b11c0 con 0x55a21c3e1c40 2023-09-23T09:11:03.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.587+0000 7f22097fa700 1 -- 172.21.15.82:0/2230729955 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f2210012b50 con 0x55a21c3e1c40 2023-09-23T09:11:03.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.588+0000 7f22097fa700 1 -- 172.21.15.82:0/2230729955 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2210012d10 con 0x55a21c3e1c40 2023-09-23T09:11:03.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.588+0000 7f223b8a8b80 10 client.16512 fetch_fsmap learned FSMap version 65 2023-09-23T09:11:03.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.588+0000 7f223b8a8b80 1 -- 172.21.15.82:0/2230729955 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=4+}) v3 -- 0x7f2220110280 con 0x55a21c3e1c40 2023-09-23T09:11:03.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.588+0000 7f22097fa700 1 -- 172.21.15.82:0/2230729955 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55a21c3b11c0 con 0x55a21c3e1c40 2023-09-23T09:11:03.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.588+0000 7f22097fa700 1 -- 172.21.15.82:0/2230729955 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 65) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f221001f070 con 0x55a21c3e1c40 2023-09-23T09:11:03.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.588+0000 7f223b8a8b80 10 client.16512 fetch_fsmap finished waiting for FSMap version 65 2023-09-23T09:11:03.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.588+0000 7f223b8a8b80 10 client.16512 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:11:03.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.588+0000 7f223b8a8b80 20 client.16512 populate_metadata read hostname 'smithi082' 2023-09-23T09:11:03.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.588+0000 7f223b8a8b80 1 --2- 172.21.15.82:0/2230729955 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55a21c3fb640 0x55a21c3fda60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:11:03.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.588+0000 7f223b8a8b80 4 client.16512 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:11:03.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.588+0000 7f223b8a8b80 1 -- 172.21.15.82:0/2230729955 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a21c2d9ba0 con 0x55a21c3fb640 2023-09-23T09:11:03.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.589+0000 7f2225d9b700 1 --2- 172.21.15.82:0/2230729955 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55a21c3fb640 0x55a21c3fda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:11:03.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.589+0000 7f22097fa700 10 client.16512 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:11:03.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.589+0000 7f2225d9b700 1 --2- 172.21.15.82:0/2230729955 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55a21c3fb640 0x55a21c3fda60 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e47be77d739231 server_cookie=9f25346a8a9656b8 in_seq=0 out_seq=0 2023-09-23T09:11:03.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.590+0000 7f22097fa700 1 -- 172.21.15.82:0/2230729955 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a21c2d9ba0 con 0x55a21c3fb640 2023-09-23T09:11:03.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.590+0000 7f22097fa700 10 client.16512 handle_command_reply: tid=0 2023-09-23T09:11:03.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.590+0000 7f223b8a8b80 1 client.16512 shutdown 2023-09-23T09:11:03.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.590+0000 7f223b8a8b80 1 -- 172.21.15.82:0/2230729955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a21c3e1c40 msgr2=0x55a21c3edc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:11:03.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.590+0000 7f223b8a8b80 1 --2- 172.21.15.82:0/2230729955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a21c3e1c40 0x55a21c3edc80 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f2210009720 tx=0x7f2210009260 comp rx=0 tx=0).stop 2023-09-23T09:11:03.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.590+0000 7f223b8a8b80 1 -- 172.21.15.82:0/2230729955 shutdown_connections 2023-09-23T09:11:03.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.590+0000 7f223b8a8b80 1 --2- 172.21.15.82:0/2230729955 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a21c3e7ca0 0x55a21c3eb660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:11:03.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.590+0000 7f223b8a8b80 1 --2- 172.21.15.82:0/2230729955 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55a21c3fb640 0x55a21c3fda60 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:11:03.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.590+0000 7f223b8a8b80 1 --2- 172.21.15.82:0/2230729955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a21c3e1c40 0x55a21c3edc80 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:11:03.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.590+0000 7f223b8a8b80 1 --2- 172.21.15.82:0/2230729955 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a21c3e7380 0x55a21c3eaf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:11:03.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.590+0000 7f223b8a8b80 1 -- 172.21.15.82:0/2230729955 >> 172.21.15.82:0/2230729955 conn(0x55a21c3560e0 msgr2=0x55a21c3d6b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:11:03.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.590+0000 7f22097fa700 0 client.16512 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:11:03.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.590+0000 7f223b8a8b80 1 -- 172.21.15.82:0/2230729955 shutdown_connections 2023-09-23T09:11:03.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.590+0000 7f223b8a8b80 1 -- 172.21.15.82:0/2230729955 wait complete. 2023-09-23T09:11:03.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.591+0000 7f223b8a8b80 20 client.16512 trim_cache size 0 max 16384 2023-09-23T09:11:03.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.611+0000 7f223b8a8b80 1 Processor -- start 2023-09-23T09:11:03.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.611+0000 7f223b8a8b80 1 -- start start 2023-09-23T09:11:03.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.611+0000 7f223b8a8b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a21c3e1c40 0x55a21c3e2020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:11:03.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.611+0000 7f223b8a8b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a21c3e7380 0x55a21c3ea8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:11:03.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.611+0000 7f223b8a8b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a21c3e7ca0 0x55a21c3f2730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:11:03.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.611+0000 7f223b8a8b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a21c1b5920 con 0x55a21c3e7ca0 2023-09-23T09:11:03.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.611+0000 7f223b8a8b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a21c3f8e10 con 0x55a21c3e7380 2023-09-23T09:11:03.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.611+0000 7f223b8a8b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a21c3d8a40 con 0x55a21c3e1c40 2023-09-23T09:11:03.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.611+0000 7f222559a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a21c3e7ca0 0x55a21c3f2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:11:03.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.611+0000 7f222559a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a21c3e7ca0 0x55a21c3f2730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55642/0 (socket says 172.21.15.82:55642) 2023-09-23T09:11:03.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.611+0000 7f222559a700 1 -- 172.21.15.82:0/2337857467 learned_addr learned my addr 172.21.15.82:0/2337857467 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:11:03.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.611+0000 7f2225d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a21c3e7380 0x55a21c3ea8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:11:03.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.611+0000 7f222559a700 1 --2- 172.21.15.82:0/2337857467 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a21c3e1c40 0x55a21c3e2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:11:03.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.612+0000 7f222559a700 1 -- 172.21.15.82:0/2337857467 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a21c3e1c40 msgr2=0x55a21c3e2020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:11:03.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.612+0000 7f222559a700 1 --2- 172.21.15.82:0/2337857467 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a21c3e1c40 0x55a21c3e2020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:11:03.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.612+0000 7f222559a700 1 -- 172.21.15.82:0/2337857467 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a21c3e7380 msgr2=0x55a21c3ea8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:11:03.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.612+0000 7f222559a700 1 --2- 172.21.15.82:0/2337857467 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a21c3e7380 0x55a21c3ea8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:11:03.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.612+0000 7f222559a700 1 -- 172.21.15.82:0/2337857467 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a21c15fde0 con 0x55a21c3e7ca0 2023-09-23T09:11:03.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.612+0000 7f2225d9b700 1 --2- 172.21.15.82:0/2337857467 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a21c3e7380 0x55a21c3ea8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:11:03.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.612+0000 7f222559a700 1 --2- 172.21.15.82:0/2337857467 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a21c3e7ca0 0x55a21c3f2730 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f2210001eb0 tx=0x7f2210009830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de38a723b9eb30d7 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:11:03.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.612+0000 7f2214ff9700 1 -- 172.21.15.82:0/2337857467 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22100129f0 con 0x55a21c3e7ca0 2023-09-23T09:11:03.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.612+0000 7f2214ff9700 1 -- 172.21.15.82:0/2337857467 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2210004030 con 0x55a21c3e7ca0 2023-09-23T09:11:03.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.612+0000 7f2214ff9700 1 -- 172.21.15.82:0/2337857467 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f221002c6c0 con 0x55a21c3e7ca0 2023-09-23T09:11:03.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.613+0000 7f223b8a8b80 1 -- 172.21.15.82:0/2337857467 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a21c3e7ca0 msgr2=0x55a21c3f2730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:11:03.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.613+0000 7f223b8a8b80 1 --2- 172.21.15.82:0/2337857467 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a21c3e7ca0 0x55a21c3f2730 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f2210001eb0 tx=0x7f2210009830 comp rx=0 tx=0).stop 2023-09-23T09:11:03.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.613+0000 7f223b8a8b80 1 -- 172.21.15.82:0/2337857467 shutdown_connections 2023-09-23T09:11:03.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.613+0000 7f223b8a8b80 1 --2- 172.21.15.82:0/2337857467 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a21c3e7ca0 0x55a21c3f2730 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:11:03.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.613+0000 7f223b8a8b80 1 --2- 172.21.15.82:0/2337857467 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a21c3e1c40 0x55a21c3e2020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:11:03.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.613+0000 7f223b8a8b80 1 --2- 172.21.15.82:0/2337857467 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a21c3e7380 0x55a21c3ea8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:11:03.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.613+0000 7f223b8a8b80 1 -- 172.21.15.82:0/2337857467 >> 172.21.15.82:0/2337857467 conn(0x55a21c3560e0 msgr2=0x55a21c3dc1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:11:03.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.613+0000 7f223b8a8b80 1 -- 172.21.15.82:0/2337857467 shutdown_connections 2023-09-23T09:11:03.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.613+0000 7f223b8a8b80 1 -- 172.21.15.82:0/2337857467 wait complete. 2023-09-23T09:11:03.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.614+0000 7f223b8a8b80 1 -- start start 2023-09-23T09:11:03.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.614+0000 7f223b8a8b80 1 Processor -- start 2023-09-23T09:11:03.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.614+0000 7f223b8a8b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a21c3e1c40 0x55a21c3e41e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:11:03.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.614+0000 7f223b8a8b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a21c3e7380 0x55a21c3e4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:11:03.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.614+0000 7f223b8a8b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a21c3e7ca0 0x55a21c3e2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:11:03.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.614+0000 7f223b8a8b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a21c3e3340 con 0x55a21c3e7ca0 2023-09-23T09:11:03.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.614+0000 7f223b8a8b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a21c3e34b0 con 0x55a21c3e7380 2023-09-23T09:11:03.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.614+0000 7f223b8a8b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a21c3e3670 con 0x55a21c3e1c40 2023-09-23T09:11:03.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.614+0000 7f223b8a8b80 10 client.0 _ll_register_callbacks cb 0x7f22100137f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:11:03.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.615+0000 7f2225d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a21c3e7380 0x55a21c3e4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:11:03.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.615+0000 7f222559a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a21c3e7ca0 0x55a21c3e2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:11:03.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.615+0000 7f2225d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a21c3e7380 0x55a21c3e4720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:55420/0 (socket says 172.21.15.82:55420) 2023-09-23T09:11:03.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.615+0000 7f2225d9b700 1 -- 172.21.15.82:0/712499211 learned_addr learned my addr 172.21.15.82:0/712499211 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:11:03.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.615+0000 7f222559a700 1 --2- 172.21.15.82:0/712499211 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a21c3e1c40 0x55a21c3e41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:11:03.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.615+0000 7f2225d9b700 1 -- 172.21.15.82:0/712499211 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a21c3e1c40 msgr2=0x55a21c3e41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:11:03.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.615+0000 7f2225d9b700 1 --2- 172.21.15.82:0/712499211 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a21c3e1c40 0x55a21c3e41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:11:03.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.615+0000 7f2225d9b700 1 -- 172.21.15.82:0/712499211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a21c3e7ca0 msgr2=0x55a21c3e2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:11:03.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.615+0000 7f2225d9b700 1 --2- 172.21.15.82:0/712499211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a21c3e7ca0 0x55a21c3e2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:11:03.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.615+0000 7f2225d9b700 1 -- 172.21.15.82:0/712499211 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a21c1b3630 con 0x55a21c3e7380 2023-09-23T09:11:03.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.615+0000 7f2225d9b700 1 --2- 172.21.15.82:0/712499211 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a21c3e7380 0x55a21c3e4720 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f221c009990 tx=0x7f221c0055c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8855c0c3ca701a66 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:11:03.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.615+0000 7f22097fa700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-09-23T09:11:03.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.616+0000 7f22097fa700 1 -- 172.21.15.82:0/712499211 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f221c035070 con 0x55a21c3e7380 2023-09-23T09:11:03.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.616+0000 7f223b8a8b80 1 -- 172.21.15.82:0/712499211 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a21c3d48b0 con 0x55a21c3e7380 2023-09-23T09:11:03.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.616+0000 7f22097fa700 1 -- 172.21.15.82:0/712499211 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f221c00ba20 con 0x55a21c3e7380 2023-09-23T09:11:03.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.616+0000 7f22097fa700 1 -- 172.21.15.82:0/712499211 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) v2 ==== 24+0+0 (secure 0 0 0) 0x7f221c01d040 con 0x55a21c3e7380 2023-09-23T09:11:03.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.616+0000 7f223b8a8b80 10 client.26198 fetch_fsmap learned FSMap version 65 2023-09-23T09:11:03.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.616+0000 7f223b8a8b80 1 -- 172.21.15.82:0/712499211 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=4+}) v3 -- 0x7f2220110280 con 0x55a21c3e7380 2023-09-23T09:11:03.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.616+0000 7f22097fa700 1 -- 172.21.15.82:0/712499211 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55a21c3d48b0 con 0x55a21c3e7380 2023-09-23T09:11:03.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.616+0000 7f22097fa700 1 -- 172.21.15.82:0/712499211 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 65) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f221c004c70 con 0x55a21c3e7380 2023-09-23T09:11:03.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.616+0000 7f223b8a8b80 10 client.26198 fetch_fsmap finished waiting for FSMap version 65 2023-09-23T09:11:03.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.616+0000 7f223b8a8b80 10 client.26198 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:11:03.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.616+0000 7f223b8a8b80 20 client.26198 populate_metadata read hostname 'smithi082' 2023-09-23T09:11:03.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.617+0000 7f223b8a8b80 1 --2- 172.21.15.82:0/712499211 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55a21c44ff30 0x55a21c452350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:11:03.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.617+0000 7f223b8a8b80 4 client.26198 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:11:03.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.617+0000 7f223b8a8b80 1 -- 172.21.15.82:0/712499211 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55a21c32c970 con 0x55a21c44ff30 2023-09-23T09:11:03.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.617+0000 7f222559a700 1 --2- 172.21.15.82:0/712499211 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55a21c44ff30 0x55a21c452350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:11:03.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.617+0000 7f222559a700 1 --2- 172.21.15.82:0/712499211 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55a21c44ff30 0x55a21c452350 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=986388a17bb28b0a server_cookie=49017514d956a6e8 in_seq=0 out_seq=0 2023-09-23T09:11:03.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.617+0000 7f22097fa700 10 client.26198 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:11:03.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.618+0000 7f22097fa700 1 -- 172.21.15.82:0/712499211 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55a21c32c970 con 0x55a21c44ff30 2023-09-23T09:11:03.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.618+0000 7f22097fa700 10 client.26198 handle_command_reply: tid=0 2023-09-23T09:11:03.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.618+0000 7f223b8a8b80 1 client.26198 shutdown 2023-09-23T09:11:03.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.618+0000 7f223b8a8b80 1 -- 172.21.15.82:0/712499211 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a21c3e7380 msgr2=0x55a21c3e4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:11:03.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.618+0000 7f223b8a8b80 1 --2- 172.21.15.82:0/712499211 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a21c3e7380 0x55a21c3e4720 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f221c009990 tx=0x7f221c0055c0 comp rx=0 tx=0).stop 2023-09-23T09:11:03.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.618+0000 7f223b8a8b80 1 -- 172.21.15.82:0/712499211 shutdown_connections 2023-09-23T09:11:03.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.618+0000 7f223b8a8b80 1 --2- 172.21.15.82:0/712499211 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55a21c44ff30 0x55a21c452350 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:11:03.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.618+0000 7f223b8a8b80 1 --2- 172.21.15.82:0/712499211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a21c3e7ca0 0x55a21c3e2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:11:03.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.618+0000 7f223b8a8b80 1 --2- 172.21.15.82:0/712499211 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a21c3e1c40 0x55a21c3e41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:11:03.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.618+0000 7f22097fa700 0 client.26198 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:11:03.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.618+0000 7f223b8a8b80 1 --2- 172.21.15.82:0/712499211 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a21c3e7380 0x55a21c3e4720 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:11:03.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.618+0000 7f223b8a8b80 1 -- 172.21.15.82:0/712499211 >> 172.21.15.82:0/712499211 conn(0x55a21c3560e0 msgr2=0x55a21c3e50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:11:03.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.618+0000 7f223b8a8b80 1 -- 172.21.15.82:0/712499211 shutdown_connections 2023-09-23T09:11:03.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.618+0000 7f223b8a8b80 1 -- 172.21.15.82:0/712499211 wait complete. 2023-09-23T09:11:03.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.618+0000 7f223b8a8b80 20 client.26198 trim_cache size 0 max 16384 2023-09-23T09:11:03.625 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:11:03.625 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "IDLE (waiting for more scrubs)", 2023-09-23T09:11:03.625 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:11:03.625 INFO:teuthology.orchestra.run.smithi082.stdout: "cba46b77-20dd-437c-a60a-ac01b400e1b8": { 2023-09-23T09:11:03.625 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:11:03.625 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "cba46b77-20dd-437c-a60a-ac01b400e1b8", 2023-09-23T09:11:03.625 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:11:03.625 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:11:03.626 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:11:03.626 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:11:03.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.619+0000 7f2227fff700 1 -- 172.21.15.82:0/3536454856 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f220c0a00c0 msgr2=0x7f220c0a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:11:03.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.619+0000 7f2227fff700 1 --2- 172.21.15.82:0/3536454856 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f220c0a00c0 0x7f220c0a2580 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f22180a0170 tx=0x7f221800c820 comp rx=0 tx=0).stop 2023-09-23T09:11:03.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.619+0000 7f2227fff700 1 -- 172.21.15.82:0/3536454856 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f222010d140 msgr2=0x7f2220198980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:11:03.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.619+0000 7f2227fff700 1 --2- 172.21.15.82:0/3536454856 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f222010d140 0x7f2220198980 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f221800ef90 tx=0x7f221800c3a0 comp rx=0 tx=0).stop 2023-09-23T09:11:03.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.619+0000 7f2227fff700 1 -- 172.21.15.82:0/3536454856 shutdown_connections 2023-09-23T09:11:03.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.619+0000 7f2227fff700 1 --2- 172.21.15.82:0/3536454856 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f220c0a00c0 0x7f220c0a2580 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:11:03.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.619+0000 7f2227fff700 1 --2- 172.21.15.82:0/3536454856 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f222010d140 0x7f2220198980 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:11:03.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.619+0000 7f2227fff700 1 --2- 172.21.15.82:0/3536454856 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2220072cf0 0x7f222019e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:11:03.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.619+0000 7f2227fff700 1 --2- 172.21.15.82:0/3536454856 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2220073610 0x7f222019ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:11:03.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.619+0000 7f2227fff700 1 -- 172.21.15.82:0/3536454856 >> 172.21.15.82:0/3536454856 conn(0x7f22200fc390 msgr2=0x7f22200fd000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:11:03.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.619+0000 7f2227fff700 1 -- 172.21.15.82:0/3536454856 shutdown_connections 2023-09-23T09:11:03.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:03.619+0000 7f2227fff700 1 -- 172.21.15.82:0/3536454856 wait complete. 2023-09-23T09:11:03.640 INFO:tasks.cephfs.filesystem:scrub status for tag:cba46b77-20dd-437c-a60a-ac01b400e1b8 - {'path': '/', 'tag': 'cba46b77-20dd-437c-a60a-ac01b400e1b8', 'options': 'recursive,force'} 2023-09-23T09:11:05.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:11:04 smithi135 ceph-mon[99205]: pgmap v442: 97 pgs: 97 active+clean; 7.6 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 994 KiB/s rd, 2.9 MiB/s wr, 276 op/s 2023-09-23T09:11:05.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:11:04 smithi082 ceph-mon[97694]: pgmap v442: 97 pgs: 97 active+clean; 7.6 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 994 KiB/s rd, 2.9 MiB/s wr, 276 op/s 2023-09-23T09:11:05.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:11:04 smithi161 ceph-mon[99580]: pgmap v442: 97 pgs: 97 active+clean; 7.6 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 994 KiB/s rd, 2.9 MiB/s wr, 276 op/s 2023-09-23T09:11:06.759 INFO:teuthology.orchestra.run.smithi082.stderr:39200000 of 50000000 tuples (78%) done (elapsed 821.50 s, remaining 226.33 s) 2023-09-23T09:11:07.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:11:06 smithi135 ceph-mon[99205]: pgmap v443: 97 pgs: 97 active+clean; 7.6 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.3 MiB/s wr, 422 op/s 2023-09-23T09:11:07.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:11:06 smithi082 ceph-mon[97694]: pgmap v443: 97 pgs: 97 active+clean; 7.6 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.3 MiB/s wr, 422 op/s 2023-09-23T09:11:07.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:11:06 smithi161 ceph-mon[99580]: pgmap v443: 97 pgs: 97 active+clean; 7.6 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.3 MiB/s wr, 422 op/s 2023-09-23T09:11:09.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:11:08 smithi135 ceph-mon[99205]: pgmap v444: 97 pgs: 97 active+clean; 7.6 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 997 KiB/s rd, 2.9 MiB/s wr, 282 op/s 2023-09-23T09:11:09.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:11:08 smithi082 ceph-mon[97694]: pgmap v444: 97 pgs: 97 active+clean; 7.6 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 997 KiB/s rd, 2.9 MiB/s wr, 282 op/s 2023-09-23T09:11:09.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:11:08 smithi161 ceph-mon[99580]: pgmap v444: 97 pgs: 97 active+clean; 7.6 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 997 KiB/s rd, 2.9 MiB/s wr, 282 op/s 2023-09-23T09:11:11.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:11:10 smithi135 ceph-mon[99205]: pgmap v445: 97 pgs: 97 active+clean; 7.6 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.1 MiB/s wr, 393 op/s 2023-09-23T09:11:11.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:11:10 smithi082 ceph-mon[97694]: pgmap v445: 97 pgs: 97 active+clean; 7.6 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.1 MiB/s wr, 393 op/s 2023-09-23T09:11:11.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:11:10 smithi161 ceph-mon[99580]: pgmap v445: 97 pgs: 97 active+clean; 7.6 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.1 MiB/s wr, 393 op/s 2023-09-23T09:11:13.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:11:12 smithi135 ceph-mon[99205]: pgmap v446: 97 pgs: 97 active+clean; 7.6 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 937 KiB/s rd, 2.6 MiB/s wr, 256 op/s 2023-09-23T09:11:13.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:11:12 smithi135 ceph-mon[99205]: osdmap e104: 12 total, 12 up, 12 in 2023-09-23T09:11:13.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:11:12 smithi082 ceph-mon[97694]: pgmap v446: 97 pgs: 97 active+clean; 7.6 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 937 KiB/s rd, 2.6 MiB/s wr, 256 op/s 2023-09-23T09:11:13.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:11:12 smithi082 ceph-mon[97694]: osdmap e104: 12 total, 12 up, 12 in 2023-09-23T09:11:13.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:11:12 smithi161 ceph-mon[99580]: pgmap v446: 97 pgs: 97 active+clean; 7.6 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 937 KiB/s rd, 2.6 MiB/s wr, 256 op/s 2023-09-23T09:11:13.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:11:12 smithi161 ceph-mon[99580]: osdmap e104: 12 total, 12 up, 12 in 2023-09-23T09:11:15.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:11:14 smithi135 ceph-mon[99205]: pgmap v448: 97 pgs: 97 active+clean; 7.6 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.1 MiB/s wr, 308 op/s 2023-09-23T09:11:15.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:11:14 smithi082 ceph-mon[97694]: pgmap v448: 97 pgs: 97 active+clean; 7.6 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.1 MiB/s wr, 308 op/s 2023-09-23T09:11:15.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:11:14 smithi161 ceph-mon[99580]: pgmap v448: 97 pgs: 97 active+clean; 7.6 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.1 MiB/s wr, 308 op/s 2023-09-23T09:11:17.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:11:16 smithi135 ceph-mon[99205]: pgmap v449: 97 pgs: 97 active+clean; 7.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.1 MiB/s wr, 294 op/s 2023-09-23T09:11:17.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:11:16 smithi135 ceph-mon[99205]: osdmap e105: 12 total, 12 up, 12 in 2023-09-23T09:11:17.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:11:16 smithi082 ceph-mon[97694]: pgmap v449: 97 pgs: 97 active+clean; 7.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.1 MiB/s wr, 294 op/s 2023-09-23T09:11:17.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:11:16 smithi082 ceph-mon[97694]: osdmap e105: 12 total, 12 up, 12 in 2023-09-23T09:11:17.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:11:16 smithi161 ceph-mon[99580]: pgmap v449: 97 pgs: 97 active+clean; 7.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.1 MiB/s wr, 294 op/s 2023-09-23T09:11:17.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:11:16 smithi161 ceph-mon[99580]: osdmap e105: 12 total, 12 up, 12 in 2023-09-23T09:11:19.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:11:18 smithi135 ceph-mon[99205]: pgmap v451: 97 pgs: 97 active+clean; 7.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 758 KiB/s rd, 2.2 MiB/s wr, 201 op/s 2023-09-23T09:11:19.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:11:18 smithi082 ceph-mon[97694]: pgmap v451: 97 pgs: 97 active+clean; 7.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 758 KiB/s rd, 2.2 MiB/s wr, 201 op/s 2023-09-23T09:11:19.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:11:18 smithi161 ceph-mon[99580]: pgmap v451: 97 pgs: 97 active+clean; 7.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 758 KiB/s rd, 2.2 MiB/s wr, 201 op/s 2023-09-23T09:11:21.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:11:20 smithi135 ceph-mon[99205]: pgmap v452: 97 pgs: 97 active+clean; 7.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.5 MiB/s wr, 413 op/s 2023-09-23T09:11:21.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:11:20 smithi082 ceph-mon[97694]: pgmap v452: 97 pgs: 97 active+clean; 7.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.5 MiB/s wr, 413 op/s 2023-09-23T09:11:21.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:11:20 smithi161 ceph-mon[99580]: pgmap v452: 97 pgs: 97 active+clean; 7.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.5 MiB/s wr, 413 op/s 2023-09-23T09:11:23.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:11:22 smithi135 ceph-mon[99205]: pgmap v453: 97 pgs: 97 active+clean; 7.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.7 MiB/s wr, 344 op/s 2023-09-23T09:11:23.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:11:22 smithi082 ceph-mon[97694]: pgmap v453: 97 pgs: 97 active+clean; 7.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.7 MiB/s wr, 344 op/s 2023-09-23T09:11:23.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:11:22 smithi161 ceph-mon[99580]: pgmap v453: 97 pgs: 97 active+clean; 7.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.7 MiB/s wr, 344 op/s 2023-09-23T09:11:24.353 INFO:teuthology.orchestra.run.smithi082.stderr:39300000 of 50000000 tuples (78%) done (elapsed 839.10 s, remaining 228.46 s) 2023-09-23T09:11:25.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:11:24 smithi135 ceph-mon[99205]: pgmap v454: 97 pgs: 97 active+clean; 7.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.6 MiB/s wr, 330 op/s 2023-09-23T09:11:25.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:11:24 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:11:25.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:11:24 smithi082 ceph-mon[97694]: pgmap v454: 97 pgs: 97 active+clean; 7.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.6 MiB/s wr, 330 op/s 2023-09-23T09:11:25.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:11:24 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:11:25.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:11:24 smithi161 ceph-mon[99580]: pgmap v454: 97 pgs: 97 active+clean; 7.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.6 MiB/s wr, 330 op/s 2023-09-23T09:11:25.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:11:24 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:11:26.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:11:25 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:11:26.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:11:25 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:11:26.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:11:25 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:11:26.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:11:25 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:11:26.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:11:25 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:11:26.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:11:25 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:11:26.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:11:25 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:11:26.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:11:25 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:11:26.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:11:25 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:11:27.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:11:26 smithi135 ceph-mon[99205]: pgmap v455: 97 pgs: 97 active+clean; 7.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.6 MiB/s wr, 333 op/s 2023-09-23T09:11:27.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:11:26 smithi082 ceph-mon[97694]: pgmap v455: 97 pgs: 97 active+clean; 7.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.6 MiB/s wr, 333 op/s 2023-09-23T09:11:27.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:11:26 smithi161 ceph-mon[99580]: pgmap v455: 97 pgs: 97 active+clean; 7.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.6 MiB/s wr, 333 op/s 2023-09-23T09:11:29.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:11:28 smithi135 ceph-mon[99205]: pgmap v456: 97 pgs: 97 active+clean; 7.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.4 MiB/s wr, 313 op/s 2023-09-23T09:11:29.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:11:28 smithi082 ceph-mon[97694]: pgmap v456: 97 pgs: 97 active+clean; 7.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.4 MiB/s wr, 313 op/s 2023-09-23T09:11:29.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:11:28 smithi161 ceph-mon[99580]: pgmap v456: 97 pgs: 97 active+clean; 7.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.4 MiB/s wr, 313 op/s 2023-09-23T09:11:31.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:11:30 smithi135 ceph-mon[99205]: pgmap v457: 97 pgs: 97 active+clean; 7.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.4 MiB/s wr, 406 op/s 2023-09-23T09:11:31.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:11:30 smithi082 ceph-mon[97694]: pgmap v457: 97 pgs: 97 active+clean; 7.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.4 MiB/s wr, 406 op/s 2023-09-23T09:11:31.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:11:30 smithi161 ceph-mon[99580]: pgmap v457: 97 pgs: 97 active+clean; 7.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.4 MiB/s wr, 406 op/s 2023-09-23T09:11:33.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:11:32 smithi135 ceph-mon[99205]: pgmap v458: 97 pgs: 97 active+clean; 7.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.8 MiB/s wr, 265 op/s 2023-09-23T09:11:33.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:11:32 smithi082 ceph-mon[97694]: pgmap v458: 97 pgs: 97 active+clean; 7.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.8 MiB/s wr, 265 op/s 2023-09-23T09:11:33.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:11:32 smithi161 ceph-mon[99580]: pgmap v458: 97 pgs: 97 active+clean; 7.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.8 MiB/s wr, 265 op/s 2023-09-23T09:11:33.641 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:11:33.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.887+0000 7f63df7ff700 1 -- 172.21.15.82:0/1676040633 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63d8072d10 msgr2=0x7f63d80730f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:11:33.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.887+0000 7f63df7ff700 1 --2- 172.21.15.82:0/1676040633 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63d8072d10 0x7f63d80730f0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f63d4009990 tx=0x7f63d4009ca0 comp rx=0 tx=0).stop 2023-09-23T09:11:33.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.888+0000 7f63df7ff700 1 -- 172.21.15.82:0/1676040633 shutdown_connections 2023-09-23T09:11:33.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.888+0000 7f63df7ff700 1 --2- 172.21.15.82:0/1676040633 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63d810d120 0x7f63d810f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:11:33.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.888+0000 7f63df7ff700 1 --2- 172.21.15.82:0/1676040633 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63d8072d10 0x7f63d80730f0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:11:33.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.888+0000 7f63df7ff700 1 --2- 172.21.15.82:0/1676040633 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f63d8073630 0x7f63d810cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:11:33.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.888+0000 7f63df7ff700 1 -- 172.21.15.82:0/1676040633 >> 172.21.15.82:0/1676040633 conn(0x7f63d80fc390 msgr2=0x7f63d80fe7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:11:33.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.888+0000 7f63df7ff700 1 -- 172.21.15.82:0/1676040633 shutdown_connections 2023-09-23T09:11:33.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.888+0000 7f63df7ff700 1 -- 172.21.15.82:0/1676040633 wait complete. 2023-09-23T09:11:33.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.889+0000 7f63df7ff700 1 Processor -- start 2023-09-23T09:11:33.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.889+0000 7f63df7ff700 1 -- start start 2023-09-23T09:11:33.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.890+0000 7f63df7ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63d8072d10 0x7f63d819e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:11:33.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.890+0000 7f63df7ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f63d8073630 0x7f63d819ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:11:33.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.890+0000 7f63df7ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63d810d120 0x7f63d8198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:11:33.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.890+0000 7f63df7ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63d81990a0 con 0x7f63d8072d10 2023-09-23T09:11:33.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.890+0000 7f63df7ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63d8199210 con 0x7f63d8073630 2023-09-23T09:11:33.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.890+0000 7f63df7ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63d81993d0 con 0x7f63d810d120 2023-09-23T09:11:33.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.890+0000 7f63dd59b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63d8072d10 0x7f63d819e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:11:33.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.890+0000 7f63dcd9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f63d8073630 0x7f63d819ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:11:33.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.890+0000 7f63dcd9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f63d8073630 0x7f63d819ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:55442/0 (socket says 172.21.15.82:55442) 2023-09-23T09:11:33.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.890+0000 7f63dcd9a700 1 -- 172.21.15.82:0/522088664 learned_addr learned my addr 172.21.15.82:0/522088664 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:11:33.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.890+0000 7f63dd59b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63d8072d10 0x7f63d819e9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38616/0 (socket says 172.21.15.82:38616) 2023-09-23T09:11:33.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.890+0000 7f63ddd9c700 1 --2- 172.21.15.82:0/522088664 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63d810d120 0x7f63d8198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:11:33.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.891+0000 7f63dd59b700 1 -- 172.21.15.82:0/522088664 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63d810d120 msgr2=0x7f63d8198a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:11:33.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.891+0000 7f63dd59b700 1 --2- 172.21.15.82:0/522088664 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63d810d120 0x7f63d8198a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:11:33.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.891+0000 7f63dd59b700 1 -- 172.21.15.82:0/522088664 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f63d8073630 msgr2=0x7f63d819ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:11:33.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.891+0000 7f63dd59b700 1 --2- 172.21.15.82:0/522088664 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f63d8073630 0x7f63d819ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:11:33.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.891+0000 7f63dd59b700 1 -- 172.21.15.82:0/522088664 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63d40095f0 con 0x7f63d8072d10 2023-09-23T09:11:33.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.891+0000 7f63dcd9a700 1 --2- 172.21.15.82:0/522088664 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f63d8073630 0x7f63d819ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:11:33.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.891+0000 7f63ddd9c700 1 --2- 172.21.15.82:0/522088664 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63d810d120 0x7f63d8198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:11:33.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.891+0000 7f63dd59b700 1 --2- 172.21.15.82:0/522088664 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63d8072d10 0x7f63d819e9c0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f63d4005910 tx=0x7f63d4005720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:11:33.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.891+0000 7f63ce7fc700 1 -- 172.21.15.82:0/522088664 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d401d070 con 0x7f63d8072d10 2023-09-23T09:11:33.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.891+0000 7f63df7ff700 1 -- 172.21.15.82:0/522088664 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63d8199650 con 0x7f63d8072d10 2023-09-23T09:11:33.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.891+0000 7f63ce7fc700 1 -- 172.21.15.82:0/522088664 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f63d4022470 con 0x7f63d8072d10 2023-09-23T09:11:33.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.891+0000 7f63ce7fc700 1 -- 172.21.15.82:0/522088664 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d4017650 con 0x7f63d8072d10 2023-09-23T09:11:33.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.892+0000 7f63df7ff700 1 -- 172.21.15.82:0/522088664 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63d8100950 con 0x7f63d8072d10 2023-09-23T09:11:33.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.896+0000 7f63ce7fc700 1 -- 172.21.15.82:0/522088664 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f63d40225e0 con 0x7f63d8072d10 2023-09-23T09:11:33.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.897+0000 7f63f3186b80 1 Processor -- start 2023-09-23T09:11:33.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.897+0000 7f63f3186b80 1 -- start start 2023-09-23T09:11:33.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.897+0000 7f63ce7fc700 1 --2- 172.21.15.82:0/522088664 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f63c40a00c0 0x7f63c40a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:11:33.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.897+0000 7f63ce7fc700 1 -- 172.21.15.82:0/522088664 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f63d40cc950 con 0x7f63d8072d10 2023-09-23T09:11:33.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.897+0000 7f63f3186b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648c6133380 0x5648c6133760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:11:33.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.897+0000 7f63f3186b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5648c6133ca0 0x5648c612d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:11:33.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.897+0000 7f63f3186b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648c612dc40 0x5648c612e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:11:33.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.897+0000 7f63f3186b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648c60957b0 con 0x5648c612dc40 2023-09-23T09:11:33.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.897+0000 7f63f3186b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648c6086780 con 0x5648c6133380 2023-09-23T09:11:33.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.897+0000 7f63f3186b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648c60840a0 con 0x5648c6133ca0 2023-09-23T09:11:33.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.898+0000 7f63ddd9c700 1 --2- 172.21.15.82:0/522088664 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f63c40a00c0 0x7f63c40a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:11:33.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.898+0000 7f63dd59b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648c6133380 0x5648c6133760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:11:33.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.898+0000 7f63dd59b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648c6133380 0x5648c6133760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:55452/0 (socket says 172.21.15.82:55452) 2023-09-23T09:11:33.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.898+0000 7f63dd59b700 1 -- 172.21.15.82:0/3943758854 learned_addr learned my addr 172.21.15.82:0/3943758854 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:11:33.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.898+0000 7f63ddd9c700 1 --2- 172.21.15.82:0/3943758854 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648c612dc40 0x5648c612e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:11:33.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.898+0000 7f63dcd9a700 1 --2- 172.21.15.82:0/3943758854 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5648c6133ca0 0x5648c612d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:11:33.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.898+0000 7f63dd59b700 1 -- 172.21.15.82:0/3943758854 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5648c6133ca0 msgr2=0x5648c612d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:11:33.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.898+0000 7f63dd59b700 1 --2- 172.21.15.82:0/3943758854 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5648c6133ca0 0x5648c612d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:11:33.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.898+0000 7f63dd59b700 1 -- 172.21.15.82:0/3943758854 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648c612dc40 msgr2=0x5648c612e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:11:33.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.898+0000 7f63dd59b700 1 --2- 172.21.15.82:0/3943758854 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648c612dc40 0x5648c612e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:11:33.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.898+0000 7f63dd59b700 1 -- 172.21.15.82:0/3943758854 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5648c5eff630 con 0x5648c6133380 2023-09-23T09:11:33.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.898+0000 7f63dd59b700 1 --2- 172.21.15.82:0/3943758854 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648c6133380 0x5648c6133760 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f63d4096710 tx=0x7f63d4096550 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d54c357ba769137a server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:11:33.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.898+0000 7f63ddd9c700 1 --2- 172.21.15.82:0/522088664 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f63c40a00c0 0x7f63c40a2580 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f63d819f6c0 tx=0x7f63d0013860 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:11:33.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.899+0000 7f63c37fe700 1 -- 172.21.15.82:0/3943758854 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d40b1070 con 0x5648c6133380 2023-09-23T09:11:33.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.899+0000 7f63c37fe700 1 -- 172.21.15.82:0/3943758854 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f63d4099d50 con 0x5648c6133380 2023-09-23T09:11:33.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.899+0000 7f63c37fe700 1 -- 172.21.15.82:0/3943758854 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d40a1f90 con 0x5648c6133380 2023-09-23T09:11:33.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.899+0000 7f63f3186b80 1 -- 172.21.15.82:0/3943758854 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648c6133380 msgr2=0x5648c6133760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:11:33.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.899+0000 7f63f3186b80 1 --2- 172.21.15.82:0/3943758854 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648c6133380 0x5648c6133760 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f63d4096710 tx=0x7f63d4096550 comp rx=0 tx=0).stop 2023-09-23T09:11:33.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.899+0000 7f63f3186b80 1 -- 172.21.15.82:0/3943758854 shutdown_connections 2023-09-23T09:11:33.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.899+0000 7f63f3186b80 1 --2- 172.21.15.82:0/3943758854 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648c612dc40 0x5648c612e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:11:33.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.899+0000 7f63f3186b80 1 --2- 172.21.15.82:0/3943758854 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648c6133380 0x5648c6133760 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:11:33.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.899+0000 7f63f3186b80 1 --2- 172.21.15.82:0/3943758854 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5648c6133ca0 0x5648c612d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:11:33.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.899+0000 7f63f3186b80 1 -- 172.21.15.82:0/3943758854 >> 172.21.15.82:0/3943758854 conn(0x5648c60a20e0 msgr2=0x5648c6128410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:11:33.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.900+0000 7f63f3186b80 1 -- 172.21.15.82:0/3943758854 shutdown_connections 2023-09-23T09:11:33.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.900+0000 7f63f3186b80 1 -- 172.21.15.82:0/3943758854 wait complete. 2023-09-23T09:11:33.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.900+0000 7f63f3186b80 1 -- start start 2023-09-23T09:11:33.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.901+0000 7f63f3186b80 1 Processor -- start 2023-09-23T09:11:33.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.901+0000 7f63f3186b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5648c612dc40 0x5648c6139bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:11:33.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.901+0000 7f63f3186b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648c6133380 0x5648c6136ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:11:33.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.901+0000 7f63f3186b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648c6133ca0 0x5648c6137540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:11:33.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.901+0000 7f63f3186b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648c607f990 con 0x5648c6133ca0 2023-09-23T09:11:33.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.901+0000 7f63f3186b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648c601dbb0 con 0x5648c6133380 2023-09-23T09:11:33.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.901+0000 7f63f3186b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648c601d8b0 con 0x5648c612dc40 2023-09-23T09:11:33.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.901+0000 7f63f3186b80 10 client.0 _ll_register_callbacks cb 0x5648c5f67a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:11:33.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.901+0000 7f63dcd9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648c6133380 0x5648c6136ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:11:33.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.901+0000 7f63dd59b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5648c612dc40 0x5648c6139bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:11:33.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.901+0000 7f63dcd9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648c6133380 0x5648c6136ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:55458/0 (socket says 172.21.15.82:55458) 2023-09-23T09:11:33.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.901+0000 7f63dcd9a700 1 -- 172.21.15.82:0/578465614 learned_addr learned my addr 172.21.15.82:0/578465614 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:11:33.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.901+0000 7f63ddd9c700 1 --2- 172.21.15.82:0/578465614 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648c6133ca0 0x5648c6137540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:11:33.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.902+0000 7f63dd59b700 1 -- 172.21.15.82:0/578465614 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648c6133380 msgr2=0x5648c6136ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:11:33.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.902+0000 7f63dd59b700 1 --2- 172.21.15.82:0/578465614 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648c6133380 0x5648c6136ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:11:33.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.902+0000 7f63dd59b700 1 -- 172.21.15.82:0/578465614 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648c6133ca0 msgr2=0x5648c6137540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:11:33.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.902+0000 7f63dd59b700 1 --2- 172.21.15.82:0/578465614 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648c6133ca0 0x5648c6137540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:11:33.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.902+0000 7f63dd59b700 1 -- 172.21.15.82:0/578465614 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63d8100950 con 0x5648c612dc40 2023-09-23T09:11:33.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.902+0000 7f63dcd9a700 1 --2- 172.21.15.82:0/578465614 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648c6133380 0x5648c6136ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:11:33.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.902+0000 7f63ddd9c700 1 --2- 172.21.15.82:0/578465614 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648c6133ca0 0x5648c6137540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:11:33.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.902+0000 7f63dd59b700 1 --2- 172.21.15.82:0/578465614 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5648c612dc40 0x5648c6139bf0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f63d4096c80 tx=0x7f63d4005c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=86d0513991ca3cf3 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:11:33.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.902+0000 7f63c0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T09:11:33.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.902+0000 7f63c0ff9700 1 -- 172.21.15.82:0/578465614 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d40b1040 con 0x5648c612dc40 2023-09-23T09:11:33.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.902+0000 7f63c0ff9700 1 -- 172.21.15.82:0/578465614 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(105..105 src has 1..105) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f63d409a910 con 0x5648c612dc40 2023-09-23T09:11:33.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.902+0000 7f63f3186b80 1 -- 172.21.15.82:0/578465614 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5648c60fd1c0 con 0x5648c612dc40 2023-09-23T09:11:33.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.903+0000 7f63c0ff9700 1 -- 172.21.15.82:0/578465614 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) v2 ==== 24+0+0 (secure 0 0 0) 0x7f63d4099b70 con 0x5648c612dc40 2023-09-23T09:11:33.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.903+0000 7f63f3186b80 10 client.26260 fetch_fsmap learned FSMap version 65 2023-09-23T09:11:33.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.903+0000 7f63f3186b80 1 -- 172.21.15.82:0/578465614 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=4+}) v3 -- 0x5648c5eabde0 con 0x5648c612dc40 2023-09-23T09:11:33.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.903+0000 7f63c0ff9700 1 -- 172.21.15.82:0/578465614 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5648c60fd1c0 con 0x5648c612dc40 2023-09-23T09:11:33.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.903+0000 7f63c0ff9700 1 -- 172.21.15.82:0/578465614 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 65) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f63d40c6070 con 0x5648c612dc40 2023-09-23T09:11:33.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.903+0000 7f63f3186b80 10 client.26260 fetch_fsmap finished waiting for FSMap version 65 2023-09-23T09:11:33.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.903+0000 7f63f3186b80 10 client.26260 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:11:33.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.903+0000 7f63f3186b80 20 client.26260 populate_metadata read hostname 'smithi082' 2023-09-23T09:11:33.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.903+0000 7f63f3186b80 1 --2- 172.21.15.82:0/578465614 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5648c6146ee0 0x5648c61492d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:11:33.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.903+0000 7f63f3186b80 4 client.26260 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:11:33.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.903+0000 7f63f3186b80 1 -- 172.21.15.82:0/578465614 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5648c6025ba0 con 0x5648c6146ee0 2023-09-23T09:11:33.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.904+0000 7f63dcd9a700 1 --2- 172.21.15.82:0/578465614 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5648c6146ee0 0x5648c61492d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:11:33.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.904+0000 7f63c0ff9700 10 client.26260 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:11:33.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.904+0000 7f63dcd9a700 1 --2- 172.21.15.82:0/578465614 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5648c6146ee0 0x5648c61492d0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f7eb9edd3c7e0f0 server_cookie=b726b88941a27d4e in_seq=0 out_seq=0 2023-09-23T09:11:33.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.905+0000 7f63c0ff9700 1 -- 172.21.15.82:0/578465614 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5648c6025ba0 con 0x5648c6146ee0 2023-09-23T09:11:33.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.905+0000 7f63c0ff9700 10 client.26260 handle_command_reply: tid=0 2023-09-23T09:11:33.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.905+0000 7f63f3186b80 1 client.26260 shutdown 2023-09-23T09:11:33.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.905+0000 7f63f3186b80 1 -- 172.21.15.82:0/578465614 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5648c612dc40 msgr2=0x5648c6139bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:11:33.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.905+0000 7f63f3186b80 1 --2- 172.21.15.82:0/578465614 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5648c612dc40 0x5648c6139bf0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f63d4096c80 tx=0x7f63d4005c00 comp rx=0 tx=0).stop 2023-09-23T09:11:33.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.905+0000 7f63f3186b80 1 -- 172.21.15.82:0/578465614 shutdown_connections 2023-09-23T09:11:33.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.905+0000 7f63f3186b80 1 --2- 172.21.15.82:0/578465614 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5648c6146ee0 0x5648c61492d0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:11:33.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.905+0000 7f63f3186b80 1 --2- 172.21.15.82:0/578465614 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648c6133ca0 0x5648c6137540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:11:33.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.905+0000 7f63f3186b80 1 --2- 172.21.15.82:0/578465614 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5648c612dc40 0x5648c6139bf0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:11:33.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.905+0000 7f63f3186b80 1 --2- 172.21.15.82:0/578465614 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648c6133380 0x5648c6136ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:11:33.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.905+0000 7f63f3186b80 1 -- 172.21.15.82:0/578465614 >> 172.21.15.82:0/578465614 conn(0x5648c60a20e0 msgr2=0x5648c6122b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:11:33.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.905+0000 7f63c0ff9700 0 client.26260 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:11:33.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.906+0000 7f63f3186b80 1 -- 172.21.15.82:0/578465614 shutdown_connections 2023-09-23T09:11:33.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.906+0000 7f63f3186b80 1 -- 172.21.15.82:0/578465614 wait complete. 2023-09-23T09:11:33.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.906+0000 7f63f3186b80 20 client.26260 trim_cache size 0 max 16384 2023-09-23T09:11:33.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.926+0000 7f63f3186b80 1 Processor -- start 2023-09-23T09:11:33.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.926+0000 7f63f3186b80 1 -- start start 2023-09-23T09:11:33.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.926+0000 7f63f3186b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5648c612dc40 0x5648c612d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:11:33.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.926+0000 7f63f3186b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648c6133380 0x5648c61366a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:11:33.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.926+0000 7f63f3186b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648c6133ca0 0x5648c6139790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:11:33.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.926+0000 7f63f3186b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648c5f01920 con 0x5648c6133ca0 2023-09-23T09:11:33.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.926+0000 7f63f3186b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648c6120670 con 0x5648c6133380 2023-09-23T09:11:33.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.926+0000 7f63f3186b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648c6132f90 con 0x5648c612dc40 2023-09-23T09:11:33.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.927+0000 7f63dcd9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648c6133380 0x5648c61366a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:11:33.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.927+0000 7f63dcd9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648c6133380 0x5648c61366a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:55470/0 (socket says 172.21.15.82:55470) 2023-09-23T09:11:33.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.927+0000 7f63dcd9a700 1 -- 172.21.15.82:0/191479315 learned_addr learned my addr 172.21.15.82:0/191479315 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:11:33.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.927+0000 7f63ddd9c700 1 --2- 172.21.15.82:0/191479315 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648c6133ca0 0x5648c6139790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:11:33.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.927+0000 7f63dd59b700 1 --2- 172.21.15.82:0/191479315 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5648c612dc40 0x5648c612d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:11:33.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.927+0000 7f63dcd9a700 1 -- 172.21.15.82:0/191479315 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5648c612dc40 msgr2=0x5648c612d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:11:33.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.927+0000 7f63dcd9a700 1 --2- 172.21.15.82:0/191479315 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5648c612dc40 0x5648c612d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:11:33.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.927+0000 7f63dcd9a700 1 -- 172.21.15.82:0/191479315 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648c6133ca0 msgr2=0x5648c6139790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:11:33.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.927+0000 7f63dcd9a700 1 --2- 172.21.15.82:0/191479315 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648c6133ca0 0x5648c6139790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:11:33.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.927+0000 7f63dcd9a700 1 -- 172.21.15.82:0/191479315 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5648c614df00 con 0x5648c6133380 2023-09-23T09:11:33.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.928+0000 7f63dcd9a700 1 --2- 172.21.15.82:0/191479315 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648c6133380 0x5648c61366a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f63c8000c00 tx=0x7f63c8009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bded4ff556868d79 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:11:33.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.928+0000 7f63c3fff700 1 -- 172.21.15.82:0/191479315 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c8016030 con 0x5648c6133380 2023-09-23T09:11:33.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.928+0000 7f63c3fff700 1 -- 172.21.15.82:0/191479315 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f63c8017040 con 0x5648c6133380 2023-09-23T09:11:33.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.928+0000 7f63c3fff700 1 -- 172.21.15.82:0/191479315 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c80205c0 con 0x5648c6133380 2023-09-23T09:11:33.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.928+0000 7f63f3186b80 1 -- 172.21.15.82:0/191479315 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648c6133380 msgr2=0x5648c61366a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:11:33.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.928+0000 7f63f3186b80 1 --2- 172.21.15.82:0/191479315 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648c6133380 0x5648c61366a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f63c8000c00 tx=0x7f63c8009260 comp rx=0 tx=0).stop 2023-09-23T09:11:33.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.929+0000 7f63f3186b80 1 -- 172.21.15.82:0/191479315 shutdown_connections 2023-09-23T09:11:33.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.929+0000 7f63f3186b80 1 --2- 172.21.15.82:0/191479315 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648c6133ca0 0x5648c6139790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:11:33.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.929+0000 7f63f3186b80 1 --2- 172.21.15.82:0/191479315 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5648c612dc40 0x5648c612d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:11:33.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.929+0000 7f63f3186b80 1 --2- 172.21.15.82:0/191479315 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648c6133380 0x5648c61366a0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:11:33.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.929+0000 7f63f3186b80 1 -- 172.21.15.82:0/191479315 >> 172.21.15.82:0/191479315 conn(0x5648c60a20e0 msgr2=0x5648c6128110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:11:33.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.929+0000 7f63f3186b80 1 -- 172.21.15.82:0/191479315 shutdown_connections 2023-09-23T09:11:33.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.929+0000 7f63f3186b80 1 -- 172.21.15.82:0/191479315 wait complete. 2023-09-23T09:11:33.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.929+0000 7f63f3186b80 1 -- start start 2023-09-23T09:11:33.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.929+0000 7f63f3186b80 1 Processor -- start 2023-09-23T09:11:33.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.930+0000 7f63f3186b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5648c612dc40 0x5648c6130400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:11:33.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.930+0000 7f63f3186b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648c6133380 0x5648c612ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:11:33.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.930+0000 7f63f3186b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648c6133ca0 0x5648c612f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:11:33.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.930+0000 7f63f3186b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648c6130a90 con 0x5648c6133380 2023-09-23T09:11:33.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.930+0000 7f63f3186b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648c612f880 con 0x5648c6133ca0 2023-09-23T09:11:33.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.930+0000 7f63f3186b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648c612fa40 con 0x5648c612dc40 2023-09-23T09:11:33.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.930+0000 7f63f3186b80 10 client.0 _ll_register_callbacks cb 0x5648c5f67a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:11:33.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.930+0000 7f63dcd9a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648c6133380 0x5648c612ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:11:33.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.930+0000 7f63dd59b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5648c612dc40 0x5648c6130400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:11:33.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.930+0000 7f63dcd9a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648c6133380 0x5648c612ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38660/0 (socket says 172.21.15.82:38660) 2023-09-23T09:11:33.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.930+0000 7f63dcd9a700 1 -- 172.21.15.82:0/2084406315 learned_addr learned my addr 172.21.15.82:0/2084406315 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:11:33.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.930+0000 7f63ddd9c700 1 --2- 172.21.15.82:0/2084406315 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648c6133ca0 0x5648c612f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:11:33.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.931+0000 7f63dd59b700 1 -- 172.21.15.82:0/2084406315 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648c6133ca0 msgr2=0x5648c612f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:11:33.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.931+0000 7f63dd59b700 1 --2- 172.21.15.82:0/2084406315 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648c6133ca0 0x5648c612f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:11:33.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.931+0000 7f63dd59b700 1 -- 172.21.15.82:0/2084406315 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648c6133380 msgr2=0x5648c612ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:11:33.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.931+0000 7f63dd59b700 1 --2- 172.21.15.82:0/2084406315 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648c6133380 0x5648c612ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:11:33.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.931+0000 7f63dd59b700 1 -- 172.21.15.82:0/2084406315 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63c8009e80 con 0x5648c612dc40 2023-09-23T09:11:33.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.931+0000 7f63ddd9c700 1 --2- 172.21.15.82:0/2084406315 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648c6133ca0 0x5648c612f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:11:33.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.931+0000 7f63dcd9a700 1 --2- 172.21.15.82:0/2084406315 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648c6133380 0x5648c612ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:11:33.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.931+0000 7f63dd59b700 1 --2- 172.21.15.82:0/2084406315 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5648c612dc40 0x5648c6130400 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f63d4098560 tx=0x7f63d4005820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bdea8dc86c5d6574 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:11:33.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.931+0000 7f63c0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T09:11:33.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.931+0000 7f63c0ff9700 1 -- 172.21.15.82:0/2084406315 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d40b1040 con 0x5648c612dc40 2023-09-23T09:11:33.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.931+0000 7f63c0ff9700 1 -- 172.21.15.82:0/2084406315 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(105..105 src has 1..105) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f63d409a910 con 0x5648c612dc40 2023-09-23T09:11:33.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.931+0000 7f63f3186b80 1 -- 172.21.15.82:0/2084406315 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5648c61208b0 con 0x5648c612dc40 2023-09-23T09:11:33.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.931+0000 7f63c0ff9700 1 -- 172.21.15.82:0/2084406315 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) v2 ==== 24+0+0 (secure 0 0 0) 0x7f63d4099b70 con 0x5648c612dc40 2023-09-23T09:11:33.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.931+0000 7f63f3186b80 10 client.26266 fetch_fsmap learned FSMap version 65 2023-09-23T09:11:33.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.931+0000 7f63f3186b80 1 -- 172.21.15.82:0/2084406315 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=4+}) v3 -- 0x5648c5e94c60 con 0x5648c612dc40 2023-09-23T09:11:33.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.932+0000 7f63c0ff9700 1 -- 172.21.15.82:0/2084406315 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5648c61208b0 con 0x5648c612dc40 2023-09-23T09:11:33.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.932+0000 7f63c0ff9700 1 -- 172.21.15.82:0/2084406315 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 65) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f63d4096920 con 0x5648c612dc40 2023-09-23T09:11:33.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.932+0000 7f63f3186b80 10 client.26266 fetch_fsmap finished waiting for FSMap version 65 2023-09-23T09:11:33.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.932+0000 7f63f3186b80 10 client.26266 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:11:33.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.932+0000 7f63f3186b80 20 client.26266 populate_metadata read hostname 'smithi082' 2023-09-23T09:11:33.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.932+0000 7f63f3186b80 1 --2- 172.21.15.82:0/2084406315 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5648c619ba10 0x5648c619de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:11:33.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.932+0000 7f63f3186b80 4 client.26266 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:11:33.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.932+0000 7f63f3186b80 1 -- 172.21.15.82:0/2084406315 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5648c6078970 con 0x5648c619ba10 2023-09-23T09:11:33.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.932+0000 7f63dcd9a700 1 --2- 172.21.15.82:0/2084406315 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5648c619ba10 0x5648c619de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:11:33.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.933+0000 7f63dcd9a700 1 --2- 172.21.15.82:0/2084406315 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5648c619ba10 0x5648c619de00 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4af00728fd0d6051 server_cookie=cb5bdd04caaa91e2 in_seq=0 out_seq=0 2023-09-23T09:11:33.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.933+0000 7f63c0ff9700 10 client.26266 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:11:33.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.933+0000 7f63c0ff9700 1 -- 172.21.15.82:0/2084406315 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5648c6078970 con 0x5648c619ba10 2023-09-23T09:11:33.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.933+0000 7f63c0ff9700 10 client.26266 handle_command_reply: tid=0 2023-09-23T09:11:33.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.933+0000 7f63f3186b80 1 client.26266 shutdown 2023-09-23T09:11:33.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.933+0000 7f63f3186b80 1 -- 172.21.15.82:0/2084406315 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5648c612dc40 msgr2=0x5648c6130400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:11:33.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.933+0000 7f63f3186b80 1 --2- 172.21.15.82:0/2084406315 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5648c612dc40 0x5648c6130400 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f63d4098560 tx=0x7f63d4005820 comp rx=0 tx=0).stop 2023-09-23T09:11:33.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.933+0000 7f63f3186b80 1 -- 172.21.15.82:0/2084406315 shutdown_connections 2023-09-23T09:11:33.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.933+0000 7f63f3186b80 1 --2- 172.21.15.82:0/2084406315 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648c6133ca0 0x5648c612f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:11:33.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.933+0000 7f63f3186b80 1 --2- 172.21.15.82:0/2084406315 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5648c612dc40 0x5648c6130400 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:11:33.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.933+0000 7f63f3186b80 1 --2- 172.21.15.82:0/2084406315 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5648c619ba10 0x5648c619de00 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:11:33.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.933+0000 7f63f3186b80 1 --2- 172.21.15.82:0/2084406315 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648c6133380 0x5648c612ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:11:33.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.933+0000 7f63c0ff9700 0 client.26266 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:11:33.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.933+0000 7f63f3186b80 1 -- 172.21.15.82:0/2084406315 >> 172.21.15.82:0/2084406315 conn(0x5648c60a20e0 msgr2=0x5648c6131010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:11:33.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.934+0000 7f63f3186b80 1 -- 172.21.15.82:0/2084406315 shutdown_connections 2023-09-23T09:11:33.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.934+0000 7f63f3186b80 1 -- 172.21.15.82:0/2084406315 wait complete. 2023-09-23T09:11:33.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.934+0000 7f63f3186b80 20 client.26266 trim_cache size 0 max 16384 2023-09-23T09:11:33.942 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:11:33.943 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "IDLE (waiting for more scrubs)", 2023-09-23T09:11:33.943 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:11:33.943 INFO:teuthology.orchestra.run.smithi082.stdout: "cba46b77-20dd-437c-a60a-ac01b400e1b8": { 2023-09-23T09:11:33.943 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:11:33.943 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "cba46b77-20dd-437c-a60a-ac01b400e1b8", 2023-09-23T09:11:33.943 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:11:33.943 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:11:33.943 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:11:33.943 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:11:33.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.934+0000 7f63df7ff700 1 -- 172.21.15.82:0/522088664 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f63c40a00c0 msgr2=0x7f63c40a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:11:33.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.934+0000 7f63df7ff700 1 --2- 172.21.15.82:0/522088664 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f63c40a00c0 0x7f63c40a2580 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f63d819f6c0 tx=0x7f63d0013860 comp rx=0 tx=0).stop 2023-09-23T09:11:33.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.934+0000 7f63df7ff700 1 -- 172.21.15.82:0/522088664 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63d8072d10 msgr2=0x7f63d819e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:11:33.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.934+0000 7f63df7ff700 1 --2- 172.21.15.82:0/522088664 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63d8072d10 0x7f63d819e9c0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f63d4005910 tx=0x7f63d4005720 comp rx=0 tx=0).stop 2023-09-23T09:11:33.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.935+0000 7f63df7ff700 1 -- 172.21.15.82:0/522088664 shutdown_connections 2023-09-23T09:11:33.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.935+0000 7f63df7ff700 1 --2- 172.21.15.82:0/522088664 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f63c40a00c0 0x7f63c40a2580 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:11:33.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.935+0000 7f63df7ff700 1 --2- 172.21.15.82:0/522088664 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63d810d120 0x7f63d8198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:11:33.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.935+0000 7f63df7ff700 1 --2- 172.21.15.82:0/522088664 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63d8072d10 0x7f63d819e9c0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:11:33.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.935+0000 7f63df7ff700 1 --2- 172.21.15.82:0/522088664 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f63d8073630 0x7f63d819ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:11:33.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.935+0000 7f63df7ff700 1 -- 172.21.15.82:0/522088664 >> 172.21.15.82:0/522088664 conn(0x7f63d80fc390 msgr2=0x7f63d80fd000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:11:33.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.935+0000 7f63df7ff700 1 -- 172.21.15.82:0/522088664 shutdown_connections 2023-09-23T09:11:33.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:11:33.935+0000 7f63df7ff700 1 -- 172.21.15.82:0/522088664 wait complete. 2023-09-23T09:11:33.957 INFO:tasks.cephfs.filesystem:scrub status for tag:cba46b77-20dd-437c-a60a-ac01b400e1b8 - {'path': '/', 'tag': 'cba46b77-20dd-437c-a60a-ac01b400e1b8', 'options': 'recursive,force'} 2023-09-23T09:11:35.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:11:34 smithi135 ceph-mon[99205]: pgmap v459: 97 pgs: 97 active+clean; 7.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.8 MiB/s wr, 265 op/s 2023-09-23T09:11:35.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:11:34 smithi082 ceph-mon[97694]: pgmap v459: 97 pgs: 97 active+clean; 7.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.8 MiB/s wr, 265 op/s 2023-09-23T09:11:35.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:11:34 smithi161 ceph-mon[99580]: pgmap v459: 97 pgs: 97 active+clean; 7.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.8 MiB/s wr, 265 op/s 2023-09-23T09:11:37.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:11:36 smithi135 ceph-mon[99205]: pgmap v460: 97 pgs: 97 active+clean; 7.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.4 MiB/s wr, 408 op/s 2023-09-23T09:11:37.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:11:36 smithi082 ceph-mon[97694]: pgmap v460: 97 pgs: 97 active+clean; 7.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.4 MiB/s wr, 408 op/s 2023-09-23T09:11:37.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:11:36 smithi161 ceph-mon[99580]: pgmap v460: 97 pgs: 97 active+clean; 7.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.4 MiB/s wr, 408 op/s 2023-09-23T09:11:39.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:11:38 smithi135 ceph-mon[99205]: pgmap v461: 97 pgs: 97 active+clean; 7.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.9 MiB/s wr, 271 op/s 2023-09-23T09:11:39.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:11:38 smithi082 ceph-mon[97694]: pgmap v461: 97 pgs: 97 active+clean; 7.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.9 MiB/s wr, 271 op/s 2023-09-23T09:11:39.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:11:38 smithi161 ceph-mon[99580]: pgmap v461: 97 pgs: 97 active+clean; 7.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.9 MiB/s wr, 271 op/s 2023-09-23T09:11:40.345 INFO:teuthology.orchestra.run.smithi082.stderr:39400000 of 50000000 tuples (78%) done (elapsed 855.09 s, remaining 230.05 s) 2023-09-23T09:11:41.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:11:40 smithi135 ceph-mon[99205]: pgmap v462: 97 pgs: 97 active+clean; 7.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.4 MiB/s wr, 407 op/s 2023-09-23T09:11:41.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:11:40 smithi082 ceph-mon[97694]: pgmap v462: 97 pgs: 97 active+clean; 7.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.4 MiB/s wr, 407 op/s 2023-09-23T09:11:41.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:11:40 smithi161 ceph-mon[99580]: pgmap v462: 97 pgs: 97 active+clean; 7.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.4 MiB/s wr, 407 op/s 2023-09-23T09:11:43.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:11:42 smithi135 ceph-mon[99205]: pgmap v463: 97 pgs: 97 active+clean; 7.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.0 MiB/s wr, 279 op/s 2023-09-23T09:11:43.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:11:42 smithi082 ceph-mon[97694]: pgmap v463: 97 pgs: 97 active+clean; 7.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.0 MiB/s wr, 279 op/s 2023-09-23T09:11:43.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:11:42 smithi161 ceph-mon[99580]: pgmap v463: 97 pgs: 97 active+clean; 7.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.0 MiB/s wr, 279 op/s 2023-09-23T09:11:45.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:11:44 smithi135 ceph-mon[99205]: pgmap v464: 97 pgs: 97 active+clean; 7.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.0 MiB/s wr, 279 op/s 2023-09-23T09:11:45.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:11:44 smithi082 ceph-mon[97694]: pgmap v464: 97 pgs: 97 active+clean; 7.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.0 MiB/s wr, 279 op/s 2023-09-23T09:11:45.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:11:44 smithi161 ceph-mon[99580]: pgmap v464: 97 pgs: 97 active+clean; 7.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.0 MiB/s wr, 279 op/s 2023-09-23T09:11:47.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:11:46 smithi135 ceph-mon[99205]: pgmap v465: 97 pgs: 97 active+clean; 7.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.4 MiB/s wr, 408 op/s 2023-09-23T09:11:47.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:11:46 smithi082 ceph-mon[97694]: pgmap v465: 97 pgs: 97 active+clean; 7.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.4 MiB/s wr, 408 op/s 2023-09-23T09:11:47.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:11:46 smithi161 ceph-mon[99580]: pgmap v465: 97 pgs: 97 active+clean; 7.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.4 MiB/s wr, 408 op/s 2023-09-23T09:11:48.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:11:47 smithi135 ceph-mon[99205]: pgmap v466: 97 pgs: 97 active+clean; 7.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.9 MiB/s wr, 265 op/s 2023-09-23T09:11:48.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:11:47 smithi082 ceph-mon[97694]: pgmap v466: 97 pgs: 97 active+clean; 7.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.9 MiB/s wr, 265 op/s 2023-09-23T09:11:48.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:11:47 smithi161 ceph-mon[99580]: pgmap v466: 97 pgs: 97 active+clean; 7.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.9 MiB/s wr, 265 op/s 2023-09-23T09:11:50.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:11:50 smithi082 ceph-mon[97694]: pgmap v467: 97 pgs: 97 active+clean; 7.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.3 MiB/s wr, 397 op/s 2023-09-23T09:11:50.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:11:50 smithi161 ceph-mon[99580]: pgmap v467: 97 pgs: 97 active+clean; 7.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.3 MiB/s wr, 397 op/s 2023-09-23T09:11:50.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:11:50 smithi135 ceph-mon[99205]: pgmap v467: 97 pgs: 97 active+clean; 7.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.3 MiB/s wr, 397 op/s 2023-09-23T09:11:53.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:11:52 smithi135 ceph-mon[99205]: pgmap v468: 97 pgs: 97 active+clean; 7.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.8 MiB/s wr, 261 op/s 2023-09-23T09:11:53.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:11:52 smithi082 ceph-mon[97694]: pgmap v468: 97 pgs: 97 active+clean; 7.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.8 MiB/s wr, 261 op/s 2023-09-23T09:11:53.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:11:52 smithi161 ceph-mon[99580]: pgmap v468: 97 pgs: 97 active+clean; 7.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.8 MiB/s wr, 261 op/s 2023-09-23T09:11:55.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:11:54 smithi135 ceph-mon[99205]: pgmap v469: 97 pgs: 97 active+clean; 7.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.8 MiB/s wr, 261 op/s 2023-09-23T09:11:55.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:11:54 smithi082 ceph-mon[97694]: pgmap v469: 97 pgs: 97 active+clean; 7.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.8 MiB/s wr, 261 op/s 2023-09-23T09:11:55.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:11:54 smithi161 ceph-mon[99580]: pgmap v469: 97 pgs: 97 active+clean; 7.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.8 MiB/s wr, 261 op/s 2023-09-23T09:11:56.147 INFO:teuthology.orchestra.run.smithi082.stderr:39500000 of 50000000 tuples (79%) done (elapsed 870.89 s, remaining 231.50 s) 2023-09-23T09:11:57.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:11:56 smithi135 ceph-mon[99205]: pgmap v470: 97 pgs: 97 active+clean; 7.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.3 MiB/s wr, 399 op/s 2023-09-23T09:11:57.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:11:56 smithi082 ceph-mon[97694]: pgmap v470: 97 pgs: 97 active+clean; 7.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.3 MiB/s wr, 399 op/s 2023-09-23T09:11:57.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:11:56 smithi161 ceph-mon[99580]: pgmap v470: 97 pgs: 97 active+clean; 7.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.3 MiB/s wr, 399 op/s 2023-09-23T09:11:59.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:11:58 smithi135 ceph-mon[99205]: pgmap v471: 97 pgs: 97 active+clean; 7.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1014 KiB/s rd, 2.9 MiB/s wr, 269 op/s 2023-09-23T09:11:59.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:11:58 smithi082 ceph-mon[97694]: pgmap v471: 97 pgs: 97 active+clean; 7.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1014 KiB/s rd, 2.9 MiB/s wr, 269 op/s 2023-09-23T09:11:59.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:11:58 smithi161 ceph-mon[99580]: pgmap v471: 97 pgs: 97 active+clean; 7.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1014 KiB/s rd, 2.9 MiB/s wr, 269 op/s 2023-09-23T09:12:01.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:12:00 smithi135 ceph-mon[99205]: pgmap v472: 97 pgs: 97 active+clean; 7.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.6 MiB/s wr, 423 op/s 2023-09-23T09:12:01.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:12:00 smithi082 ceph-mon[97694]: pgmap v472: 97 pgs: 97 active+clean; 7.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.6 MiB/s wr, 423 op/s 2023-09-23T09:12:01.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:12:00 smithi161 ceph-mon[99580]: pgmap v472: 97 pgs: 97 active+clean; 7.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.6 MiB/s wr, 423 op/s 2023-09-23T09:12:02.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:12:02 smithi082 ceph-mon[97694]: pgmap v473: 97 pgs: 97 active+clean; 7.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.1 MiB/s wr, 291 op/s 2023-09-23T09:12:03.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:12:02 smithi135 ceph-mon[99205]: pgmap v473: 97 pgs: 97 active+clean; 7.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.1 MiB/s wr, 291 op/s 2023-09-23T09:12:03.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:12:02 smithi161 ceph-mon[99580]: pgmap v473: 97 pgs: 97 active+clean; 7.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.1 MiB/s wr, 291 op/s 2023-09-23T09:12:03.958 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:12:04.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.193+0000 7fb806bff700 1 -- 172.21.15.82:0/359957046 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb800102350 msgr2=0x7fb80010a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:12:04.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.193+0000 7fb806bff700 1 --2- 172.21.15.82:0/359957046 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb800102350 0x7fb80010a830 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec009990 tx=0x7fb7ec009ca0 comp rx=0 tx=0).stop 2023-09-23T09:12:04.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.194+0000 7fb806bff700 1 -- 172.21.15.82:0/359957046 shutdown_connections 2023-09-23T09:12:04.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.194+0000 7fb806bff700 1 --2- 172.21.15.82:0/359957046 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb80010ae50 0x7fb80010d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:12:04.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.194+0000 7fb806bff700 1 --2- 172.21.15.82:0/359957046 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb800101a30 0x7fb800101e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:12:04.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.194+0000 7fb806bff700 1 --2- 172.21.15.82:0/359957046 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb800102350 0x7fb80010a830 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:12:04.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.194+0000 7fb806bff700 1 -- 172.21.15.82:0/359957046 >> 172.21.15.82:0/359957046 conn(0x7fb8000fb270 msgr2=0x7fb8000fd690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:12:04.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.194+0000 7fb806bff700 1 -- 172.21.15.82:0/359957046 shutdown_connections 2023-09-23T09:12:04.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.194+0000 7fb806bff700 1 -- 172.21.15.82:0/359957046 wait complete. 2023-09-23T09:12:04.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.195+0000 7fb806bff700 1 Processor -- start 2023-09-23T09:12:04.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.195+0000 7fb806bff700 1 -- start start 2023-09-23T09:12:04.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.196+0000 7fb806bff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb800101a30 0x7fb80019c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:12:04.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.196+0000 7fb806bff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb800102350 0x7fb80019cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:12:04.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.196+0000 7fb806bff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb80010ae50 0x7fb800196710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:12:04.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.196+0000 7fb806bff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb800196d80 con 0x7fb800102350 2023-09-23T09:12:04.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.196+0000 7fb806bff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb800196ef0 con 0x7fb80010ae50 2023-09-23T09:12:04.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.196+0000 7fb806bff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8001970b0 con 0x7fb800101a30 2023-09-23T09:12:04.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.196+0000 7fb80499b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb800101a30 0x7fb80019c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:12:04.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.196+0000 7fb7fffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb800102350 0x7fb80019cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:12:04.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.196+0000 7fb80499b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb800101a30 0x7fb80019c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:52870/0 (socket says 172.21.15.82:52870) 2023-09-23T09:12:04.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.196+0000 7fb80499b700 1 -- 172.21.15.82:0/2545993196 learned_addr learned my addr 172.21.15.82:0/2545993196 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:12:04.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.196+0000 7fb80519c700 1 --2- 172.21.15.82:0/2545993196 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb80010ae50 0x7fb800196710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:12:04.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.196+0000 7fb7fffff700 1 -- 172.21.15.82:0/2545993196 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb800101a30 msgr2=0x7fb80019c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:12:04.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.196+0000 7fb7fffff700 1 --2- 172.21.15.82:0/2545993196 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb800101a30 0x7fb80019c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:12:04.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.196+0000 7fb7fffff700 1 -- 172.21.15.82:0/2545993196 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb80010ae50 msgr2=0x7fb800196710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:12:04.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.196+0000 7fb7fffff700 1 --2- 172.21.15.82:0/2545993196 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb80010ae50 0x7fb800196710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:12:04.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.196+0000 7fb7fffff700 1 -- 172.21.15.82:0/2545993196 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7ec0095f0 con 0x7fb800102350 2023-09-23T09:12:04.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.197+0000 7fb7fffff700 1 --2- 172.21.15.82:0/2545993196 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb800102350 0x7fb80019cbe0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec005910 tx=0x7fb7ec004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:12:04.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.197+0000 7fb7fdffb700 1 -- 172.21.15.82:0/2545993196 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec01d070 con 0x7fb800102350 2023-09-23T09:12:04.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.197+0000 7fb806bff700 1 -- 172.21.15.82:0/2545993196 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb800197330 con 0x7fb800102350 2023-09-23T09:12:04.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.197+0000 7fb7fdffb700 1 -- 172.21.15.82:0/2545993196 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb7ec022470 con 0x7fb800102350 2023-09-23T09:12:04.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.197+0000 7fb7fdffb700 1 -- 172.21.15.82:0/2545993196 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec00bee0 con 0x7fb800102350 2023-09-23T09:12:04.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.197+0000 7fb806bff700 1 -- 172.21.15.82:0/2545993196 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8001a3690 con 0x7fb800102350 2023-09-23T09:12:04.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.202+0000 7fb81a590b80 1 Processor -- start 2023-09-23T09:12:04.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.202+0000 7fb7fdffb700 1 -- 172.21.15.82:0/2545993196 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7fb7ec0225e0 con 0x7fb800102350 2023-09-23T09:12:04.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.203+0000 7fb81a590b80 1 -- start start 2023-09-23T09:12:04.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.203+0000 7fb81a590b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f2e56b380 0x555f2e56b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:12:04.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.203+0000 7fb81a590b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f2e56bca0 0x555f2e565700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:12:04.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.203+0000 7fb81a590b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555f2e565c40 0x555f2e5660a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:12:04.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.203+0000 7fb81a590b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f2e4cd7b0 con 0x555f2e56b380 2023-09-23T09:12:04.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.203+0000 7fb81a590b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f2e4be780 con 0x555f2e56bca0 2023-09-23T09:12:04.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.203+0000 7fb81a590b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f2e4bc0a0 con 0x555f2e565c40 2023-09-23T09:12:04.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.203+0000 7fb80519c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f2e56b380 0x555f2e56b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:12:04.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.203+0000 7fb80499b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f2e56bca0 0x555f2e565700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:12:04.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.203+0000 7fb80499b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f2e56bca0 0x555f2e565700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:35186/0 (socket says 172.21.15.82:35186) 2023-09-23T09:12:04.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.203+0000 7fb80499b700 1 -- 172.21.15.82:0/2385307047 learned_addr learned my addr 172.21.15.82:0/2385307047 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:12:04.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.203+0000 7fb7fffff700 1 --2- 172.21.15.82:0/2385307047 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555f2e565c40 0x555f2e5660a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:12:04.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.204+0000 7fb80519c700 1 -- 172.21.15.82:0/2385307047 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555f2e565c40 msgr2=0x555f2e5660a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:12:04.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.204+0000 7fb80519c700 1 --2- 172.21.15.82:0/2385307047 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555f2e565c40 0x555f2e5660a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:12:04.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.204+0000 7fb80519c700 1 -- 172.21.15.82:0/2385307047 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f2e56bca0 msgr2=0x555f2e565700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:12:04.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.204+0000 7fb80519c700 1 --2- 172.21.15.82:0/2385307047 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f2e56bca0 0x555f2e565700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:12:04.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.204+0000 7fb80519c700 1 -- 172.21.15.82:0/2385307047 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555f2e337630 con 0x555f2e56b380 2023-09-23T09:12:04.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.204+0000 7fb80499b700 1 --2- 172.21.15.82:0/2385307047 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f2e56bca0 0x555f2e565700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:12:04.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.204+0000 7fb80519c700 1 --2- 172.21.15.82:0/2385307047 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f2e56b380 0x555f2e56b760 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fb7f8011550 tx=0x7fb7f8009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1439cda46cf0f573 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:12:04.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.204+0000 7fb7fdffb700 1 --2- 172.21.15.82:0/2545993196 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fb7f00a0140 0x7fb7f00a2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:12:04.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.204+0000 7fb7eaffd700 1 -- 172.21.15.82:0/2385307047 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f800e040 con 0x555f2e56b380 2023-09-23T09:12:04.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.205+0000 7fb7eaffd700 1 -- 172.21.15.82:0/2385307047 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb7f800f040 con 0x555f2e56b380 2023-09-23T09:12:04.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.205+0000 7fb7eaffd700 1 -- 172.21.15.82:0/2385307047 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f8004290 con 0x555f2e56b380 2023-09-23T09:12:04.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.205+0000 7fb7fdffb700 1 -- 172.21.15.82:0/2545993196 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fb7ec0cc400 con 0x7fb800102350 2023-09-23T09:12:04.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.205+0000 7fb80499b700 1 --2- 172.21.15.82:0/2545993196 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fb7f00a0140 0x7fb7f00a2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:12:04.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.205+0000 7fb81a590b80 1 -- 172.21.15.82:0/2385307047 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f2e56b380 msgr2=0x555f2e56b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:12:04.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.205+0000 7fb80499b700 1 --2- 172.21.15.82:0/2545993196 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fb7f00a0140 0x7fb7f00a2600 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb7f4009fd0 tx=0x7fb7f4009260 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:12:04.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.205+0000 7fb81a590b80 1 --2- 172.21.15.82:0/2385307047 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f2e56b380 0x555f2e56b760 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fb7f8011550 tx=0x7fb7f8009920 comp rx=0 tx=0).stop 2023-09-23T09:12:04.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.206+0000 7fb81a590b80 1 -- 172.21.15.82:0/2385307047 shutdown_connections 2023-09-23T09:12:04.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.206+0000 7fb81a590b80 1 --2- 172.21.15.82:0/2385307047 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555f2e565c40 0x555f2e5660a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:12:04.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.206+0000 7fb81a590b80 1 --2- 172.21.15.82:0/2385307047 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f2e56b380 0x555f2e56b760 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:12:04.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.206+0000 7fb81a590b80 1 --2- 172.21.15.82:0/2385307047 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f2e56bca0 0x555f2e565700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:12:04.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.206+0000 7fb81a590b80 1 -- 172.21.15.82:0/2385307047 >> 172.21.15.82:0/2385307047 conn(0x555f2e4da0e0 msgr2=0x555f2e560410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:12:04.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.206+0000 7fb81a590b80 1 -- 172.21.15.82:0/2385307047 shutdown_connections 2023-09-23T09:12:04.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.206+0000 7fb81a590b80 1 -- 172.21.15.82:0/2385307047 wait complete. 2023-09-23T09:12:04.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.206+0000 7fb81a590b80 1 -- start start 2023-09-23T09:12:04.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.207+0000 7fb81a590b80 1 Processor -- start 2023-09-23T09:12:04.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.208+0000 7fb81a590b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f2e565c40 0x555f2e571c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:12:04.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.208+0000 7fb81a590b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f2e56b380 0x555f2e56eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:12:04.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.208+0000 7fb81a590b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555f2e56bca0 0x555f2e56f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:12:04.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.208+0000 7fb81a590b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f2e4b7990 con 0x555f2e565c40 2023-09-23T09:12:04.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.208+0000 7fb81a590b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f2e455bb0 con 0x555f2e56b380 2023-09-23T09:12:04.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.208+0000 7fb81a590b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f2e4558b0 con 0x555f2e56bca0 2023-09-23T09:12:04.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.208+0000 7fb81a590b80 10 client.0 _ll_register_callbacks cb 0x555f2e39fa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:12:04.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.208+0000 7fb7fffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f2e56b380 0x555f2e56eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:12:04.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.208+0000 7fb80519c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555f2e56bca0 0x555f2e56f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:12:04.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.208+0000 7fb7fffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f2e56b380 0x555f2e56eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:35200/0 (socket says 172.21.15.82:35200) 2023-09-23T09:12:04.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.208+0000 7fb7fffff700 1 -- 172.21.15.82:0/1317193167 learned_addr learned my addr 172.21.15.82:0/1317193167 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:12:04.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.208+0000 7fb7fffff700 1 -- 172.21.15.82:0/1317193167 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555f2e56bca0 msgr2=0x555f2e56f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:12:04.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.208+0000 7fb7fffff700 1 --2- 172.21.15.82:0/1317193167 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555f2e56bca0 0x555f2e56f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:12:04.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.208+0000 7fb7fffff700 1 -- 172.21.15.82:0/1317193167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f2e565c40 msgr2=0x555f2e571c70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-23T09:12:04.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.208+0000 7fb7fffff700 1 --2- 172.21.15.82:0/1317193167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f2e565c40 0x555f2e571c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:12:04.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.208+0000 7fb7fffff700 1 -- 172.21.15.82:0/1317193167 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7f4009a80 con 0x555f2e56b380 2023-09-23T09:12:04.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.209+0000 7fb7fffff700 1 --2- 172.21.15.82:0/1317193167 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f2e56b380 0x555f2e56eef0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec000c00 tx=0x7fb7ec095f60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1a5bb06a89f26ca server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:12:04.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.209+0000 7fb7dffff700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-09-23T09:12:04.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.209+0000 7fb7dffff700 1 -- 172.21.15.82:0/1317193167 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec09a000 con 0x555f2e56b380 2023-09-23T09:12:04.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.209+0000 7fb7dffff700 1 -- 172.21.15.82:0/1317193167 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(105..105 src has 1..105) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fb7ec09a2a0 con 0x555f2e56b380 2023-09-23T09:12:04.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.209+0000 7fb81a590b80 1 -- 172.21.15.82:0/1317193167 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555f2e5351c0 con 0x555f2e56b380 2023-09-23T09:12:04.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.209+0000 7fb7dffff700 1 -- 172.21.15.82:0/1317193167 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb7ec099500 con 0x555f2e56b380 2023-09-23T09:12:04.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.209+0000 7fb81a590b80 10 client.26228 fetch_fsmap learned FSMap version 65 2023-09-23T09:12:04.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.209+0000 7fb81a590b80 1 -- 172.21.15.82:0/1317193167 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=4+}) v3 -- 0x7fb7f8011230 con 0x555f2e56b380 2023-09-23T09:12:04.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.210+0000 7fb7dffff700 1 -- 172.21.15.82:0/1317193167 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x555f2e5351c0 con 0x555f2e56b380 2023-09-23T09:12:04.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.210+0000 7fb7dffff700 1 -- 172.21.15.82:0/1317193167 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 65) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fb7ec099090 con 0x555f2e56b380 2023-09-23T09:12:04.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.210+0000 7fb81a590b80 10 client.26228 fetch_fsmap finished waiting for FSMap version 65 2023-09-23T09:12:04.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.210+0000 7fb81a590b80 10 client.26228 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:12:04.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.210+0000 7fb81a590b80 20 client.26228 populate_metadata read hostname 'smithi082' 2023-09-23T09:12:04.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.210+0000 7fb81a590b80 1 --2- 172.21.15.82:0/1317193167 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x555f2e57f330 0x555f2e581750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:12:04.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.210+0000 7fb81a590b80 4 client.26228 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:12:04.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.210+0000 7fb81a590b80 1 -- 172.21.15.82:0/1317193167 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555f2e45dba0 con 0x555f2e57f330 2023-09-23T09:12:04.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.211+0000 7fb80499b700 1 --2- 172.21.15.82:0/1317193167 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x555f2e57f330 0x555f2e581750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:12:04.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.211+0000 7fb7dffff700 10 client.26228 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:12:04.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.211+0000 7fb80499b700 1 --2- 172.21.15.82:0/1317193167 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x555f2e57f330 0x555f2e581750 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5537ab2d9eb121a9 server_cookie=a816f275d4b6f012 in_seq=0 out_seq=0 2023-09-23T09:12:04.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.212+0000 7fb7dffff700 1 -- 172.21.15.82:0/1317193167 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x555f2e45dba0 con 0x555f2e57f330 2023-09-23T09:12:04.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.212+0000 7fb7dffff700 10 client.26228 handle_command_reply: tid=0 2023-09-23T09:12:04.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.212+0000 7fb81a590b80 1 client.26228 shutdown 2023-09-23T09:12:04.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.213+0000 7fb81a590b80 1 -- 172.21.15.82:0/1317193167 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f2e56b380 msgr2=0x555f2e56eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:12:04.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.213+0000 7fb81a590b80 1 --2- 172.21.15.82:0/1317193167 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f2e56b380 0x555f2e56eef0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec000c00 tx=0x7fb7ec095f60 comp rx=0 tx=0).stop 2023-09-23T09:12:04.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.213+0000 7fb81a590b80 1 -- 172.21.15.82:0/1317193167 shutdown_connections 2023-09-23T09:12:04.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.213+0000 7fb81a590b80 1 --2- 172.21.15.82:0/1317193167 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555f2e56bca0 0x555f2e56f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:12:04.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.213+0000 7fb81a590b80 1 --2- 172.21.15.82:0/1317193167 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x555f2e57f330 0x555f2e581750 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:12:04.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.213+0000 7fb81a590b80 1 --2- 172.21.15.82:0/1317193167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f2e565c40 0x555f2e571c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:12:04.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.213+0000 7fb81a590b80 1 --2- 172.21.15.82:0/1317193167 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f2e56b380 0x555f2e56eef0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:12:04.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.213+0000 7fb7dffff700 0 client.26228 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:12:04.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.213+0000 7fb81a590b80 1 -- 172.21.15.82:0/1317193167 >> 172.21.15.82:0/1317193167 conn(0x555f2e4da0e0 msgr2=0x555f2e55ab40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:12:04.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.213+0000 7fb81a590b80 1 -- 172.21.15.82:0/1317193167 shutdown_connections 2023-09-23T09:12:04.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.213+0000 7fb81a590b80 1 -- 172.21.15.82:0/1317193167 wait complete. 2023-09-23T09:12:04.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.213+0000 7fb81a590b80 20 client.26228 trim_cache size 0 max 16384 2023-09-23T09:12:04.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.233+0000 7fb81a590b80 1 Processor -- start 2023-09-23T09:12:04.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.233+0000 7fb81a590b80 1 -- start start 2023-09-23T09:12:04.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.234+0000 7fb81a590b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f2e565c40 0x555f2e56e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:12:04.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.234+0000 7fb81a590b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555f2e56b380 0x555f2e571810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:12:04.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.234+0000 7fb81a590b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f2e56bca0 0x555f2e569010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:12:04.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.234+0000 7fb81a590b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f2e339920 con 0x555f2e56bca0 2023-09-23T09:12:04.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.234+0000 7fb81a590b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f2e5704d0 con 0x555f2e565c40 2023-09-23T09:12:04.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.234+0000 7fb81a590b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f2e55ccb0 con 0x555f2e56b380 2023-09-23T09:12:04.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.234+0000 7fb80519c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f2e56bca0 0x555f2e569010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:12:04.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.234+0000 7fb80499b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f2e565c40 0x555f2e56e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:12:04.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.234+0000 7fb7fffff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555f2e56b380 0x555f2e571810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:12:04.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.234+0000 7fb80499b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f2e565c40 0x555f2e56e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:35206/0 (socket says 172.21.15.82:35206) 2023-09-23T09:12:04.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.234+0000 7fb7fffff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555f2e56b380 0x555f2e571810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:52886/0 (socket says 172.21.15.82:52886) 2023-09-23T09:12:04.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.234+0000 7fb80499b700 1 -- 172.21.15.82:0/2217218164 learned_addr learned my addr 172.21.15.82:0/2217218164 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:12:04.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.235+0000 7fb80519c700 1 -- 172.21.15.82:0/2217218164 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555f2e56b380 msgr2=0x555f2e571810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:12:04.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.235+0000 7fb80519c700 1 --2- 172.21.15.82:0/2217218164 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555f2e56b380 0x555f2e571810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:12:04.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.235+0000 7fb80519c700 1 -- 172.21.15.82:0/2217218164 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f2e565c40 msgr2=0x555f2e56e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:12:04.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.235+0000 7fb80519c700 1 --2- 172.21.15.82:0/2217218164 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f2e565c40 0x555f2e56e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:12:04.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.235+0000 7fb80519c700 1 -- 172.21.15.82:0/2217218164 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555f2e2e3de0 con 0x555f2e56bca0 2023-09-23T09:12:04.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.235+0000 7fb80499b700 1 --2- 172.21.15.82:0/2217218164 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f2e565c40 0x555f2e56e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:12:04.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.235+0000 7fb7fffff700 1 --2- 172.21.15.82:0/2217218164 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555f2e56b380 0x555f2e571810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:12:04.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.235+0000 7fb80519c700 1 --2- 172.21.15.82:0/2217218164 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f2e56bca0 0x555f2e569010 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fb7f8009ec0 tx=0x7fb7f80060e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=173e608d2370aae6 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:12:04.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.235+0000 7fb7eb7fe700 1 -- 172.21.15.82:0/2217218164 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f800e040 con 0x555f2e56bca0 2023-09-23T09:12:04.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.235+0000 7fb7eb7fe700 1 -- 172.21.15.82:0/2217218164 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb7f8003c00 con 0x555f2e56bca0 2023-09-23T09:12:04.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.235+0000 7fb7eb7fe700 1 -- 172.21.15.82:0/2217218164 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f80050c0 con 0x555f2e56bca0 2023-09-23T09:12:04.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.236+0000 7fb81a590b80 1 -- 172.21.15.82:0/2217218164 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f2e56bca0 msgr2=0x555f2e569010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:12:04.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.236+0000 7fb81a590b80 1 --2- 172.21.15.82:0/2217218164 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f2e56bca0 0x555f2e569010 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fb7f8009ec0 tx=0x7fb7f80060e0 comp rx=0 tx=0).stop 2023-09-23T09:12:04.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.236+0000 7fb81a590b80 1 -- 172.21.15.82:0/2217218164 shutdown_connections 2023-09-23T09:12:04.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.236+0000 7fb81a590b80 1 --2- 172.21.15.82:0/2217218164 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f2e56bca0 0x555f2e569010 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:12:04.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.236+0000 7fb81a590b80 1 --2- 172.21.15.82:0/2217218164 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f2e565c40 0x555f2e56e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:12:04.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.236+0000 7fb81a590b80 1 --2- 172.21.15.82:0/2217218164 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555f2e56b380 0x555f2e571810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:12:04.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.236+0000 7fb81a590b80 1 -- 172.21.15.82:0/2217218164 >> 172.21.15.82:0/2217218164 conn(0x555f2e4da0e0 msgr2=0x555f2e57ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:12:04.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.236+0000 7fb81a590b80 1 -- 172.21.15.82:0/2217218164 shutdown_connections 2023-09-23T09:12:04.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.236+0000 7fb81a590b80 1 -- 172.21.15.82:0/2217218164 wait complete. 2023-09-23T09:12:04.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.237+0000 7fb81a590b80 1 -- start start 2023-09-23T09:12:04.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.237+0000 7fb81a590b80 1 Processor -- start 2023-09-23T09:12:04.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.238+0000 7fb81a590b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f2e565c40 0x555f2e568540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:12:04.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.238+0000 7fb81a590b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555f2e56b380 0x555f2e566e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:12:04.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.238+0000 7fb81a590b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f2e56bca0 0x555f2e567340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:12:04.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.238+0000 7fb81a590b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f2e567880 con 0x555f2e565c40 2023-09-23T09:12:04.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.238+0000 7fb81a590b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f2e5679f0 con 0x555f2e56bca0 2023-09-23T09:12:04.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.238+0000 7fb81a590b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f2e567bb0 con 0x555f2e56b380 2023-09-23T09:12:04.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.238+0000 7fb81a590b80 10 client.0 _ll_register_callbacks cb 0x555f2e39fa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:12:04.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.238+0000 7fb80499b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f2e565c40 0x555f2e568540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:12:04.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.238+0000 7fb80499b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f2e565c40 0x555f2e568540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60372/0 (socket says 172.21.15.82:60372) 2023-09-23T09:12:04.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.238+0000 7fb80499b700 1 -- 172.21.15.82:0/3596368059 learned_addr learned my addr 172.21.15.82:0/3596368059 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:12:04.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.238+0000 7fb7fffff700 1 --2- 172.21.15.82:0/3596368059 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555f2e56b380 0x555f2e566e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:12:04.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.238+0000 7fb80519c700 1 --2- 172.21.15.82:0/3596368059 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f2e56bca0 0x555f2e567340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:12:04.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.239+0000 7fb80499b700 1 -- 172.21.15.82:0/3596368059 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555f2e56b380 msgr2=0x555f2e566e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:12:04.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.239+0000 7fb80499b700 1 --2- 172.21.15.82:0/3596368059 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555f2e56b380 0x555f2e566e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:12:04.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.239+0000 7fb80499b700 1 -- 172.21.15.82:0/3596368059 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f2e56bca0 msgr2=0x555f2e567340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:12:04.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.239+0000 7fb80499b700 1 --2- 172.21.15.82:0/3596368059 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f2e56bca0 0x555f2e567340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:12:04.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.239+0000 7fb80499b700 1 -- 172.21.15.82:0/3596368059 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7f4004200 con 0x555f2e565c40 2023-09-23T09:12:04.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.239+0000 7fb80499b700 1 --2- 172.21.15.82:0/3596368059 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f2e565c40 0x555f2e568540 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x555f2e56c100 tx=0x7fb7f4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72f95415521b0ce5 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:12:04.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.239+0000 7fb7dffff700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:12:04.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.239+0000 7fb7dffff700 1 -- 172.21.15.82:0/3596368059 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f4024070 con 0x555f2e565c40 2023-09-23T09:12:04.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.239+0000 7fb7dffff700 1 -- 172.21.15.82:0/3596368059 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(105..105 src has 1..105) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fb7f4004550 con 0x555f2e565c40 2023-09-23T09:12:04.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.239+0000 7fb81a590b80 1 -- 172.21.15.82:0/3596368059 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555f2e5588b0 con 0x555f2e565c40 2023-09-23T09:12:04.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.240+0000 7fb7dffff700 1 -- 172.21.15.82:0/3596368059 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb7f4017070 con 0x555f2e565c40 2023-09-23T09:12:04.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.240+0000 7fb81a590b80 10 client.16551 fetch_fsmap learned FSMap version 65 2023-09-23T09:12:04.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.240+0000 7fb81a590b80 1 -- 172.21.15.82:0/3596368059 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=4+}) v3 -- 0x7fb7f8011230 con 0x555f2e565c40 2023-09-23T09:12:04.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.240+0000 7fb7dffff700 1 -- 172.21.15.82:0/3596368059 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb7f403c020 con 0x555f2e565c40 2023-09-23T09:12:04.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.240+0000 7fb7dffff700 1 -- 172.21.15.82:0/3596368059 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 65) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fb7f4003ca0 con 0x555f2e565c40 2023-09-23T09:12:04.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.240+0000 7fb81a590b80 10 client.16551 fetch_fsmap finished waiting for FSMap version 65 2023-09-23T09:12:04.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.240+0000 7fb81a590b80 10 client.16551 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:12:04.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.241+0000 7fb81a590b80 20 client.16551 populate_metadata read hostname 'smithi082' 2023-09-23T09:12:04.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.241+0000 7fb81a590b80 1 --2- 172.21.15.82:0/3596368059 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x555f2e5dcde0 0x555f2e5df200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:12:04.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.241+0000 7fb81a590b80 4 client.16551 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:12:04.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.241+0000 7fb81a590b80 1 -- 172.21.15.82:0/3596368059 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x555f2e4b0970 con 0x555f2e5dcde0 2023-09-23T09:12:04.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.241+0000 7fb7fffff700 1 --2- 172.21.15.82:0/3596368059 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x555f2e5dcde0 0x555f2e5df200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:12:04.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.241+0000 7fb7dffff700 10 client.16551 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:12:04.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.241+0000 7fb7fffff700 1 --2- 172.21.15.82:0/3596368059 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x555f2e5dcde0 0x555f2e5df200 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b65b3d1ee6a95034 server_cookie=4a3a14a1ad59edeb in_seq=0 out_seq=0 2023-09-23T09:12:04.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.242+0000 7fb7dffff700 1 -- 172.21.15.82:0/3596368059 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x555f2e4b0970 con 0x555f2e5dcde0 2023-09-23T09:12:04.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.242+0000 7fb7dffff700 10 client.16551 handle_command_reply: tid=0 2023-09-23T09:12:04.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.242+0000 7fb81a590b80 1 client.16551 shutdown 2023-09-23T09:12:04.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.242+0000 7fb81a590b80 1 -- 172.21.15.82:0/3596368059 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f2e565c40 msgr2=0x555f2e568540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:12:04.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.242+0000 7fb81a590b80 1 --2- 172.21.15.82:0/3596368059 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f2e565c40 0x555f2e568540 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x555f2e56c100 tx=0x7fb7f4004750 comp rx=0 tx=0).stop 2023-09-23T09:12:04.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.242+0000 7fb81a590b80 1 -- 172.21.15.82:0/3596368059 shutdown_connections 2023-09-23T09:12:04.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.242+0000 7fb81a590b80 1 --2- 172.21.15.82:0/3596368059 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f2e56bca0 0x555f2e567340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:12:04.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.242+0000 7fb81a590b80 1 --2- 172.21.15.82:0/3596368059 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x555f2e5dcde0 0x555f2e5df200 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:12:04.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.242+0000 7fb81a590b80 1 --2- 172.21.15.82:0/3596368059 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f2e565c40 0x555f2e568540 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:12:04.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.242+0000 7fb81a590b80 1 --2- 172.21.15.82:0/3596368059 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555f2e56b380 0x555f2e566e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:12:04.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.242+0000 7fb7dffff700 0 client.16551 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:12:04.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.242+0000 7fb81a590b80 1 -- 172.21.15.82:0/3596368059 >> 172.21.15.82:0/3596368059 conn(0x555f2e4da0e0 msgr2=0x555f2e569010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:12:04.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.242+0000 7fb81a590b80 1 -- 172.21.15.82:0/3596368059 shutdown_connections 2023-09-23T09:12:04.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.242+0000 7fb81a590b80 1 -- 172.21.15.82:0/3596368059 wait complete. 2023-09-23T09:12:04.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.242+0000 7fb81a590b80 20 client.16551 trim_cache size 0 max 16384 2023-09-23T09:12:04.247 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:12:04.248 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "IDLE (waiting for more scrubs)", 2023-09-23T09:12:04.248 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:12:04.248 INFO:teuthology.orchestra.run.smithi082.stdout: "cba46b77-20dd-437c-a60a-ac01b400e1b8": { 2023-09-23T09:12:04.248 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:12:04.248 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "cba46b77-20dd-437c-a60a-ac01b400e1b8", 2023-09-23T09:12:04.248 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:12:04.248 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:12:04.248 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:12:04.248 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:12:04.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.243+0000 7fb806bff700 1 -- 172.21.15.82:0/2545993196 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fb7f00a0140 msgr2=0x7fb7f00a2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:12:04.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.243+0000 7fb806bff700 1 --2- 172.21.15.82:0/2545993196 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fb7f00a0140 0x7fb7f00a2600 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb7f4009fd0 tx=0x7fb7f4009260 comp rx=0 tx=0).stop 2023-09-23T09:12:04.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.243+0000 7fb806bff700 1 -- 172.21.15.82:0/2545993196 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb800102350 msgr2=0x7fb80019cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:12:04.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.243+0000 7fb806bff700 1 --2- 172.21.15.82:0/2545993196 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb800102350 0x7fb80019cbe0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec005910 tx=0x7fb7ec004730 comp rx=0 tx=0).stop 2023-09-23T09:12:04.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.243+0000 7fb806bff700 1 -- 172.21.15.82:0/2545993196 shutdown_connections 2023-09-23T09:12:04.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.243+0000 7fb806bff700 1 --2- 172.21.15.82:0/2545993196 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fb7f00a0140 0x7fb7f00a2600 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:12:04.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.243+0000 7fb806bff700 1 --2- 172.21.15.82:0/2545993196 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb80010ae50 0x7fb800196710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:12:04.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.243+0000 7fb806bff700 1 --2- 172.21.15.82:0/2545993196 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb800101a30 0x7fb80019c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:12:04.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.243+0000 7fb806bff700 1 --2- 172.21.15.82:0/2545993196 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb800102350 0x7fb80019cbe0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:12:04.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.243+0000 7fb806bff700 1 -- 172.21.15.82:0/2545993196 >> 172.21.15.82:0/2545993196 conn(0x7fb8000fb270 msgr2=0x7fb8000fbee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:12:04.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.243+0000 7fb806bff700 1 -- 172.21.15.82:0/2545993196 shutdown_connections 2023-09-23T09:12:04.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:04.244+0000 7fb806bff700 1 -- 172.21.15.82:0/2545993196 wait complete. 2023-09-23T09:12:04.265 INFO:tasks.cephfs.filesystem:scrub status for tag:cba46b77-20dd-437c-a60a-ac01b400e1b8 - {'path': '/', 'tag': 'cba46b77-20dd-437c-a60a-ac01b400e1b8', 'options': 'recursive,force'} 2023-09-23T09:12:04.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:12:04 smithi082 ceph-mon[97694]: pgmap v474: 97 pgs: 97 active+clean; 7.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.1 MiB/s wr, 291 op/s 2023-09-23T09:12:05.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:12:04 smithi135 ceph-mon[99205]: pgmap v474: 97 pgs: 97 active+clean; 7.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.1 MiB/s wr, 291 op/s 2023-09-23T09:12:05.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:12:04 smithi161 ceph-mon[99580]: pgmap v474: 97 pgs: 97 active+clean; 7.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.1 MiB/s wr, 291 op/s 2023-09-23T09:12:07.041 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:12:06 smithi082 ceph-mon[97694]: pgmap v475: 97 pgs: 97 active+clean; 7.4 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.7 MiB/s wr, 445 op/s 2023-09-23T09:12:07.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:12:06 smithi135 ceph-mon[99205]: pgmap v475: 97 pgs: 97 active+clean; 7.4 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.7 MiB/s wr, 445 op/s 2023-09-23T09:12:07.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:12:06 smithi161 ceph-mon[99580]: pgmap v475: 97 pgs: 97 active+clean; 7.4 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.7 MiB/s wr, 445 op/s 2023-09-23T09:12:08.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:12:07 smithi135 ceph-mon[99205]: osdmap e106: 12 total, 12 up, 12 in 2023-09-23T09:12:08.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:12:07 smithi082 ceph-mon[97694]: osdmap e106: 12 total, 12 up, 12 in 2023-09-23T09:12:08.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:12:07 smithi161 ceph-mon[99580]: osdmap e106: 12 total, 12 up, 12 in 2023-09-23T09:12:09.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:12:08 smithi135 ceph-mon[99205]: pgmap v477: 97 pgs: 97 active+clean; 7.4 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.9 MiB/s wr, 369 op/s 2023-09-23T09:12:09.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:12:08 smithi082 ceph-mon[97694]: pgmap v477: 97 pgs: 97 active+clean; 7.4 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.9 MiB/s wr, 369 op/s 2023-09-23T09:12:09.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:12:08 smithi161 ceph-mon[99580]: pgmap v477: 97 pgs: 97 active+clean; 7.4 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.9 MiB/s wr, 369 op/s 2023-09-23T09:12:11.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:12:10 smithi135 ceph-mon[99205]: pgmap v478: 97 pgs: 97 active+clean; 7.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.5 MiB/s wr, 330 op/s 2023-09-23T09:12:11.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:12:10 smithi082 ceph-mon[97694]: pgmap v478: 97 pgs: 97 active+clean; 7.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.5 MiB/s wr, 330 op/s 2023-09-23T09:12:11.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:12:10 smithi161 ceph-mon[99580]: pgmap v478: 97 pgs: 97 active+clean; 7.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.5 MiB/s wr, 330 op/s 2023-09-23T09:12:13.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:12:12 smithi135 ceph-mon[99205]: pgmap v479: 97 pgs: 97 active+clean; 7.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.5 MiB/s wr, 330 op/s 2023-09-23T09:12:13.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:12:12 smithi135 ceph-mon[99205]: osdmap e107: 12 total, 12 up, 12 in 2023-09-23T09:12:13.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:12:12 smithi082 ceph-mon[97694]: pgmap v479: 97 pgs: 97 active+clean; 7.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.5 MiB/s wr, 330 op/s 2023-09-23T09:12:13.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:12:12 smithi082 ceph-mon[97694]: osdmap e107: 12 total, 12 up, 12 in 2023-09-23T09:12:13.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:12:12 smithi161 ceph-mon[99580]: pgmap v479: 97 pgs: 97 active+clean; 7.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.5 MiB/s wr, 330 op/s 2023-09-23T09:12:13.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:12:12 smithi161 ceph-mon[99580]: osdmap e107: 12 total, 12 up, 12 in 2023-09-23T09:12:13.862 INFO:teuthology.orchestra.run.smithi082.stderr:39600000 of 50000000 tuples (79%) done (elapsed 888.60 s, remaining 233.37 s) 2023-09-23T09:12:15.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:12:14 smithi135 ceph-mon[99205]: pgmap v481: 97 pgs: 97 active+clean; 7.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 749 KiB/s rd, 2.0 MiB/s wr, 180 op/s 2023-09-23T09:12:15.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:12:14 smithi082 ceph-mon[97694]: pgmap v481: 97 pgs: 97 active+clean; 7.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 749 KiB/s rd, 2.0 MiB/s wr, 180 op/s 2023-09-23T09:12:15.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:12:14 smithi161 ceph-mon[99580]: pgmap v481: 97 pgs: 97 active+clean; 7.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 749 KiB/s rd, 2.0 MiB/s wr, 180 op/s 2023-09-23T09:12:17.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:12:16 smithi135 ceph-mon[99205]: pgmap v482: 97 pgs: 97 active+clean; 7.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.7 MiB/s wr, 333 op/s 2023-09-23T09:12:17.073 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:12:16 smithi082 ceph-mon[97694]: pgmap v482: 97 pgs: 97 active+clean; 7.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.7 MiB/s wr, 333 op/s 2023-09-23T09:12:17.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:12:16 smithi161 ceph-mon[99580]: pgmap v482: 97 pgs: 97 active+clean; 7.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.7 MiB/s wr, 333 op/s 2023-09-23T09:12:19.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:12:18 smithi135 ceph-mon[99205]: pgmap v483: 97 pgs: 97 active+clean; 7.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.2 MiB/s wr, 287 op/s 2023-09-23T09:12:19.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:12:18 smithi082 ceph-mon[97694]: pgmap v483: 97 pgs: 97 active+clean; 7.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.2 MiB/s wr, 287 op/s 2023-09-23T09:12:19.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:12:18 smithi161 ceph-mon[99580]: pgmap v483: 97 pgs: 97 active+clean; 7.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.2 MiB/s wr, 287 op/s 2023-09-23T09:12:21.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:12:20 smithi135 ceph-mon[99205]: pgmap v484: 97 pgs: 97 active+clean; 7.3 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.5 MiB/s wr, 320 op/s 2023-09-23T09:12:21.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:12:20 smithi082 ceph-mon[97694]: pgmap v484: 97 pgs: 97 active+clean; 7.3 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.5 MiB/s wr, 320 op/s 2023-09-23T09:12:21.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:12:20 smithi161 ceph-mon[99580]: pgmap v484: 97 pgs: 97 active+clean; 7.3 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.5 MiB/s wr, 320 op/s 2023-09-23T09:12:23.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:12:22 smithi135 ceph-mon[99205]: pgmap v485: 97 pgs: 97 active+clean; 7.3 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.5 MiB/s wr, 320 op/s 2023-09-23T09:12:23.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:12:22 smithi082 ceph-mon[97694]: pgmap v485: 97 pgs: 97 active+clean; 7.3 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.5 MiB/s wr, 320 op/s 2023-09-23T09:12:23.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:12:22 smithi161 ceph-mon[99580]: pgmap v485: 97 pgs: 97 active+clean; 7.3 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.5 MiB/s wr, 320 op/s 2023-09-23T09:12:25.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:12:24 smithi135 ceph-mon[99205]: pgmap v486: 97 pgs: 97 active+clean; 7.3 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 3.0 MiB/s wr, 275 op/s 2023-09-23T09:12:25.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:12:24 smithi082 ceph-mon[97694]: pgmap v486: 97 pgs: 97 active+clean; 7.3 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 3.0 MiB/s wr, 275 op/s 2023-09-23T09:12:25.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:12:24 smithi161 ceph-mon[99580]: pgmap v486: 97 pgs: 97 active+clean; 7.3 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 3.0 MiB/s wr, 275 op/s 2023-09-23T09:12:27.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:12:26 smithi135 ceph-mon[99205]: pgmap v487: 97 pgs: 97 active+clean; 7.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.4 MiB/s wr, 396 op/s 2023-09-23T09:12:27.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:12:26 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:12:27.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:12:26 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:12:27.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:12:26 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:12:27.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:12:26 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:12:27.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:12:26 smithi082 ceph-mon[97694]: pgmap v487: 97 pgs: 97 active+clean; 7.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.4 MiB/s wr, 396 op/s 2023-09-23T09:12:27.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:12:26 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:12:27.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:12:26 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:12:27.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:12:26 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:12:27.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:12:26 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:12:27.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:12:26 smithi161 ceph-mon[99580]: pgmap v487: 97 pgs: 97 active+clean; 7.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.4 MiB/s wr, 396 op/s 2023-09-23T09:12:27.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:12:26 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:12:27.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:12:26 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:12:27.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:12:26 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:12:27.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:12:26 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:12:29.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:12:28 smithi135 ceph-mon[99205]: pgmap v488: 97 pgs: 97 active+clean; 7.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.1 MiB/s wr, 277 op/s 2023-09-23T09:12:29.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:12:28 smithi082 ceph-mon[97694]: pgmap v488: 97 pgs: 97 active+clean; 7.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.1 MiB/s wr, 277 op/s 2023-09-23T09:12:29.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:12:28 smithi161 ceph-mon[99580]: pgmap v488: 97 pgs: 97 active+clean; 7.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.1 MiB/s wr, 277 op/s 2023-09-23T09:12:29.601 INFO:teuthology.orchestra.run.smithi082.stderr:39700000 of 50000000 tuples (79%) done (elapsed 904.34 s, remaining 234.63 s) 2023-09-23T09:12:31.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:12:30 smithi135 ceph-mon[99205]: pgmap v489: 97 pgs: 97 active+clean; 7.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.6 MiB/s wr, 415 op/s 2023-09-23T09:12:31.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:12:30 smithi082 ceph-mon[97694]: pgmap v489: 97 pgs: 97 active+clean; 7.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.6 MiB/s wr, 415 op/s 2023-09-23T09:12:31.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:12:30 smithi161 ceph-mon[99580]: pgmap v489: 97 pgs: 97 active+clean; 7.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.6 MiB/s wr, 415 op/s 2023-09-23T09:12:33.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:12:32 smithi135 ceph-mon[99205]: pgmap v490: 97 pgs: 97 active+clean; 7.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.9 MiB/s wr, 267 op/s 2023-09-23T09:12:33.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:12:32 smithi082 ceph-mon[97694]: pgmap v490: 97 pgs: 97 active+clean; 7.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.9 MiB/s wr, 267 op/s 2023-09-23T09:12:33.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:12:32 smithi161 ceph-mon[99580]: pgmap v490: 97 pgs: 97 active+clean; 7.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.9 MiB/s wr, 267 op/s 2023-09-23T09:12:34.266 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:12:34.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.490+0000 7fefb31ff700 1 -- 172.21.15.82:0/3443411441 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fefac100890 msgr2=0x7fefac100d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:12:34.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.490+0000 7fefb31ff700 1 --2- 172.21.15.82:0/3443411441 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fefac100890 0x7fefac100d10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fef98009990 tx=0x7fef98009ca0 comp rx=0 tx=0).stop 2023-09-23T09:12:34.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.490+0000 7fefb31ff700 1 -- 172.21.15.82:0/3443411441 shutdown_connections 2023-09-23T09:12:34.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.490+0000 7fefb31ff700 1 --2- 172.21.15.82:0/3443411441 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fefac101250 0x7fefac10d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:12:34.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.490+0000 7fefb31ff700 1 --2- 172.21.15.82:0/3443411441 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefac1068a0 0x7fefac106c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:12:34.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.490+0000 7fefb31ff700 1 --2- 172.21.15.82:0/3443411441 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fefac100890 0x7fefac100d10 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:12:34.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.490+0000 7fefb31ff700 1 -- 172.21.15.82:0/3443411441 >> 172.21.15.82:0/3443411441 conn(0x7fefac0fc380 msgr2=0x7fefac0fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:12:34.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.490+0000 7fefb31ff700 1 -- 172.21.15.82:0/3443411441 shutdown_connections 2023-09-23T09:12:34.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.490+0000 7fefb31ff700 1 -- 172.21.15.82:0/3443411441 wait complete. 2023-09-23T09:12:34.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.491+0000 7fefb31ff700 1 Processor -- start 2023-09-23T09:12:34.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.491+0000 7fefb31ff700 1 -- start start 2023-09-23T09:12:34.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.492+0000 7fefb31ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefac100890 0x7fefac072c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:12:34.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.492+0000 7fefb31ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fefac101250 0x7fefac073160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:12:34.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.492+0000 7fefb31ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fefac1068a0 0x7fefac1a4a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:12:34.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.492+0000 7fefb31ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefac073990 con 0x7fefac100890 2023-09-23T09:12:34.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.492+0000 7fefb31ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefac1a4fb0 con 0x7fefac101250 2023-09-23T09:12:34.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.492+0000 7fefb31ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefac1a50f0 con 0x7fefac1068a0 2023-09-23T09:12:34.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.492+0000 7fefb0f9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefac100890 0x7fefac072c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:12:34.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.492+0000 7fefb0f9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefac100890 0x7fefac072c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44056/0 (socket says 172.21.15.82:44056) 2023-09-23T09:12:34.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.492+0000 7fefb0f9b700 1 -- 172.21.15.82:0/463231724 learned_addr learned my addr 172.21.15.82:0/463231724 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:12:34.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.492+0000 7fefb179c700 1 --2- 172.21.15.82:0/463231724 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fefac1068a0 0x7fefac1a4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:12:34.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.492+0000 7fefabfff700 1 --2- 172.21.15.82:0/463231724 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fefac101250 0x7fefac073160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:12:34.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.492+0000 7fefb0f9b700 1 -- 172.21.15.82:0/463231724 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fefac1068a0 msgr2=0x7fefac1a4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:12:34.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.492+0000 7fefb0f9b700 1 --2- 172.21.15.82:0/463231724 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fefac1068a0 0x7fefac1a4a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:12:34.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.492+0000 7fefb0f9b700 1 -- 172.21.15.82:0/463231724 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fefac101250 msgr2=0x7fefac073160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:12:34.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.492+0000 7fefb0f9b700 1 --2- 172.21.15.82:0/463231724 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fefac101250 0x7fefac073160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:12:34.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.492+0000 7fefb0f9b700 1 -- 172.21.15.82:0/463231724 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefa0009520 con 0x7fefac100890 2023-09-23T09:12:34.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.493+0000 7fefb0f9b700 1 --2- 172.21.15.82:0/463231724 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefac100890 0x7fefac072c20 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fefa000eb30 tx=0x7fefa000ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:12:34.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.493+0000 7fefa9ffb700 1 -- 172.21.15.82:0/463231724 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa0009880 con 0x7fefac100890 2023-09-23T09:12:34.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.493+0000 7fefa9ffb700 1 -- 172.21.15.82:0/463231724 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fefa00044b0 con 0x7fefac100890 2023-09-23T09:12:34.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.493+0000 7fefb31ff700 1 -- 172.21.15.82:0/463231724 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef980095f0 con 0x7fefac100890 2023-09-23T09:12:34.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.493+0000 7fefa9ffb700 1 -- 172.21.15.82:0/463231724 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa0003ce0 con 0x7fefac100890 2023-09-23T09:12:34.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.493+0000 7fefb31ff700 1 -- 172.21.15.82:0/463231724 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefac1a56f0 con 0x7fefac100890 2023-09-23T09:12:34.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.496+0000 7fefa9ffb700 1 -- 172.21.15.82:0/463231724 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7fefa0003e40 con 0x7fefac100890 2023-09-23T09:12:34.500 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.498+0000 7fefc6a45b80 1 Processor -- start 2023-09-23T09:12:34.500 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.498+0000 7fefc6a45b80 1 -- start start 2023-09-23T09:12:34.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.498+0000 7fefa9ffb700 1 --2- 172.21.15.82:0/463231724 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fef9c0a0140 0x7fef9c0a2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:12:34.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.498+0000 7fefc6a45b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559be66ab380 0x559be66ab760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:12:34.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.498+0000 7fefc6a45b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559be66abca0 0x559be66a5700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:12:34.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.499+0000 7fefc6a45b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559be66a5c40 0x559be66a60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:12:34.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.499+0000 7fefc6a45b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x559be660d7b0 con 0x559be66a5c40 2023-09-23T09:12:34.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.499+0000 7fefc6a45b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x559be65fe780 con 0x559be66abca0 2023-09-23T09:12:34.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.499+0000 7fefa9ffb700 1 -- 172.21.15.82:0/463231724 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fefa0014070 con 0x7fefac100890 2023-09-23T09:12:34.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.499+0000 7fefc6a45b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x559be65fc0a0 con 0x559be66ab380 2023-09-23T09:12:34.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.499+0000 7fefb0f9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559be66ab380 0x559be66ab760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:12:34.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.499+0000 7fefb0f9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559be66ab380 0x559be66ab760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:42958/0 (socket says 172.21.15.82:42958) 2023-09-23T09:12:34.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.499+0000 7fefb0f9b700 1 -- 172.21.15.82:0/3639542943 learned_addr learned my addr 172.21.15.82:0/3639542943 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:12:34.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.499+0000 7fefb179c700 1 --2- 172.21.15.82:0/463231724 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fef9c0a0140 0x7fef9c0a2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:12:34.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.499+0000 7fefb179c700 1 --2- 172.21.15.82:0/3639542943 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559be66a5c40 0x559be66a60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:12:34.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.499+0000 7fefabfff700 1 --2- 172.21.15.82:0/3639542943 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559be66abca0 0x559be66a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:12:34.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.499+0000 7fefb0f9b700 1 -- 172.21.15.82:0/3639542943 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559be66abca0 msgr2=0x559be66a5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:12:34.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.499+0000 7fefb0f9b700 1 --2- 172.21.15.82:0/3639542943 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559be66abca0 0x559be66a5700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:12:34.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.499+0000 7fefb0f9b700 1 -- 172.21.15.82:0/3639542943 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559be66a5c40 msgr2=0x559be66a60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:12:34.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.499+0000 7fefb0f9b700 1 --2- 172.21.15.82:0/3639542943 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559be66a5c40 0x559be66a60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:12:34.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.499+0000 7fefb0f9b700 1 -- 172.21.15.82:0/3639542943 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559be6477630 con 0x559be66ab380 2023-09-23T09:12:34.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.499+0000 7fefabfff700 1 --2- 172.21.15.82:0/3639542943 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559be66abca0 0x559be66a5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T09:12:34.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.500+0000 7fefb0f9b700 1 --2- 172.21.15.82:0/3639542943 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559be66ab380 0x559be66ab760 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fefa0095b80 tx=0x7fefa0019a50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9de645e07a7e904 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:12:34.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.500+0000 7fefb179c700 1 --2- 172.21.15.82:0/463231724 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fef9c0a0140 0x7fef9c0a2600 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fefa4009ec0 tx=0x7fefa4009920 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:12:34.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.500+0000 7fef96ffd700 1 -- 172.21.15.82:0/3639542943 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa000cbd0 con 0x559be66ab380 2023-09-23T09:12:34.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.500+0000 7fef96ffd700 1 -- 172.21.15.82:0/3639542943 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fefa001ba50 con 0x559be66ab380 2023-09-23T09:12:34.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.500+0000 7fef96ffd700 1 -- 172.21.15.82:0/3639542943 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa0004750 con 0x559be66ab380 2023-09-23T09:12:34.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.501+0000 7fefc6a45b80 1 -- 172.21.15.82:0/3639542943 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559be66ab380 msgr2=0x559be66ab760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:12:34.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.501+0000 7fefc6a45b80 1 --2- 172.21.15.82:0/3639542943 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559be66ab380 0x559be66ab760 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fefa0095b80 tx=0x7fefa0019a50 comp rx=0 tx=0).stop 2023-09-23T09:12:34.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.501+0000 7fefc6a45b80 1 -- 172.21.15.82:0/3639542943 shutdown_connections 2023-09-23T09:12:34.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.501+0000 7fefc6a45b80 1 --2- 172.21.15.82:0/3639542943 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559be66a5c40 0x559be66a60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:12:34.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.501+0000 7fefc6a45b80 1 --2- 172.21.15.82:0/3639542943 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559be66ab380 0x559be66ab760 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:12:34.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.501+0000 7fefc6a45b80 1 --2- 172.21.15.82:0/3639542943 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559be66abca0 0x559be66a5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:12:34.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.501+0000 7fefc6a45b80 1 -- 172.21.15.82:0/3639542943 >> 172.21.15.82:0/3639542943 conn(0x559be661a0e0 msgr2=0x559be66a0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:12:34.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.501+0000 7fefc6a45b80 1 -- 172.21.15.82:0/3639542943 shutdown_connections 2023-09-23T09:12:34.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.501+0000 7fefc6a45b80 1 -- 172.21.15.82:0/3639542943 wait complete. 2023-09-23T09:12:34.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.501+0000 7fefc6a45b80 1 -- start start 2023-09-23T09:12:34.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.502+0000 7fefc6a45b80 1 Processor -- start 2023-09-23T09:12:34.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.502+0000 7fefc6a45b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559be66a5c40 0x559be66b1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:12:34.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.502+0000 7fefc6a45b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559be66ab380 0x559be66aeed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:12:34.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.502+0000 7fefc6a45b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559be66abca0 0x559be66af610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:12:34.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.502+0000 7fefc6a45b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x559be65f7990 con 0x559be66ab380 2023-09-23T09:12:34.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.502+0000 7fefc6a45b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x559be6595bb0 con 0x559be66abca0 2023-09-23T09:12:34.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.502+0000 7fefc6a45b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x559be65958b0 con 0x559be66a5c40 2023-09-23T09:12:34.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.502+0000 7fefc6a45b80 10 client.0 _ll_register_callbacks cb 0x559be64dfa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:12:34.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.503+0000 7fefb0f9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559be66a5c40 0x559be66b1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:12:34.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.503+0000 7fefb0f9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559be66a5c40 0x559be66b1cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:42960/0 (socket says 172.21.15.82:42960) 2023-09-23T09:12:34.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.503+0000 7fefb0f9b700 1 -- 172.21.15.82:0/2288687500 learned_addr learned my addr 172.21.15.82:0/2288687500 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:12:34.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.503+0000 7fefb179c700 1 --2- 172.21.15.82:0/2288687500 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559be66abca0 0x559be66af610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:12:34.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.503+0000 7fefabfff700 1 --2- 172.21.15.82:0/2288687500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559be66ab380 0x559be66aeed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:12:34.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.503+0000 7fefb0f9b700 1 -- 172.21.15.82:0/2288687500 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559be66abca0 msgr2=0x559be66af610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:12:34.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.503+0000 7fefb0f9b700 1 --2- 172.21.15.82:0/2288687500 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559be66abca0 0x559be66af610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:12:34.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.503+0000 7fefb0f9b700 1 -- 172.21.15.82:0/2288687500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559be66ab380 msgr2=0x559be66aeed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:12:34.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.503+0000 7fefb0f9b700 1 --2- 172.21.15.82:0/2288687500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559be66ab380 0x559be66aeed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:12:34.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.503+0000 7fefb0f9b700 1 -- 172.21.15.82:0/2288687500 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefac1a56f0 con 0x559be66a5c40 2023-09-23T09:12:34.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.503+0000 7fefb0f9b700 1 --2- 172.21.15.82:0/2288687500 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559be66a5c40 0x559be66b1cc0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fefa0098e10 tx=0x7fefa0005b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ebf8a5f672d0e0f0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:12:34.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.503+0000 7fef8bfff700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T09:12:34.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.504+0000 7fef8bfff700 1 -- 172.21.15.82:0/2288687500 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa001ba50 con 0x559be66a5c40 2023-09-23T09:12:34.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.504+0000 7fef8bfff700 1 -- 172.21.15.82:0/2288687500 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fefa009cf40 con 0x559be66a5c40 2023-09-23T09:12:34.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.504+0000 7fefc6a45b80 1 -- 172.21.15.82:0/2288687500 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559be66751c0 con 0x559be66a5c40 2023-09-23T09:12:34.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.504+0000 7fef8bfff700 1 -- 172.21.15.82:0/2288687500 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) v2 ==== 24+0+0 (secure 0 0 0) 0x7fefa0099110 con 0x559be66a5c40 2023-09-23T09:12:34.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.504+0000 7fefc6a45b80 10 client.26296 fetch_fsmap learned FSMap version 65 2023-09-23T09:12:34.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.504+0000 7fefc6a45b80 1 -- 172.21.15.82:0/2288687500 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=4+}) v3 -- 0x559be6423de0 con 0x559be66a5c40 2023-09-23T09:12:34.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.504+0000 7fef8bfff700 1 -- 172.21.15.82:0/2288687500 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x559be66751c0 con 0x559be66a5c40 2023-09-23T09:12:34.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.504+0000 7fef8bfff700 1 -- 172.21.15.82:0/2288687500 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 65) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fefa00c93d0 con 0x559be66a5c40 2023-09-23T09:12:34.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.504+0000 7fefc6a45b80 10 client.26296 fetch_fsmap finished waiting for FSMap version 65 2023-09-23T09:12:34.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.504+0000 7fefc6a45b80 10 client.26296 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:12:34.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.505+0000 7fefc6a45b80 20 client.26296 populate_metadata read hostname 'smithi082' 2023-09-23T09:12:34.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.505+0000 7fefc6a45b80 1 --2- 172.21.15.82:0/2288687500 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x559be66bf260 0x559be66c1650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:12:34.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.505+0000 7fefc6a45b80 4 client.26296 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:12:34.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.505+0000 7fefc6a45b80 1 -- 172.21.15.82:0/2288687500 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559be659dba0 con 0x559be66bf260 2023-09-23T09:12:34.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.505+0000 7fefabfff700 1 --2- 172.21.15.82:0/2288687500 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x559be66bf260 0x559be66c1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:12:34.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.506+0000 7fefabfff700 1 --2- 172.21.15.82:0/2288687500 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x559be66bf260 0x559be66c1650 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7457f35422f211dd server_cookie=3a0feb566e08095c in_seq=0 out_seq=0 2023-09-23T09:12:34.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.506+0000 7fef8bfff700 10 client.26296 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:12:34.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.506+0000 7fef8bfff700 1 -- 172.21.15.82:0/2288687500 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x559be659dba0 con 0x559be66bf260 2023-09-23T09:12:34.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.506+0000 7fef8bfff700 10 client.26296 handle_command_reply: tid=0 2023-09-23T09:12:34.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.506+0000 7fefc6a45b80 1 client.26296 shutdown 2023-09-23T09:12:34.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.507+0000 7fefc6a45b80 1 -- 172.21.15.82:0/2288687500 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559be66a5c40 msgr2=0x559be66b1cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:12:34.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.507+0000 7fefc6a45b80 1 --2- 172.21.15.82:0/2288687500 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559be66a5c40 0x559be66b1cc0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fefa0098e10 tx=0x7fefa0005b80 comp rx=0 tx=0).stop 2023-09-23T09:12:34.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.507+0000 7fefc6a45b80 1 -- 172.21.15.82:0/2288687500 shutdown_connections 2023-09-23T09:12:34.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.507+0000 7fefc6a45b80 1 --2- 172.21.15.82:0/2288687500 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559be66abca0 0x559be66af610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:12:34.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.507+0000 7fefc6a45b80 1 --2- 172.21.15.82:0/2288687500 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559be66a5c40 0x559be66b1cc0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:12:34.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.507+0000 7fefc6a45b80 1 --2- 172.21.15.82:0/2288687500 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x559be66bf260 0x559be66c1650 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:12:34.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.507+0000 7fefc6a45b80 1 --2- 172.21.15.82:0/2288687500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559be66ab380 0x559be66aeed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:12:34.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.507+0000 7fefc6a45b80 1 -- 172.21.15.82:0/2288687500 >> 172.21.15.82:0/2288687500 conn(0x559be661a0e0 msgr2=0x559be669ab40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:12:34.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.507+0000 7fef8bfff700 0 client.26296 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:12:34.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.507+0000 7fefc6a45b80 1 -- 172.21.15.82:0/2288687500 shutdown_connections 2023-09-23T09:12:34.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.507+0000 7fefc6a45b80 1 -- 172.21.15.82:0/2288687500 wait complete. 2023-09-23T09:12:34.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.507+0000 7fefc6a45b80 20 client.26296 trim_cache size 0 max 16384 2023-09-23T09:12:34.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.528+0000 7fefc6a45b80 1 Processor -- start 2023-09-23T09:12:34.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.528+0000 7fefc6a45b80 1 -- start start 2023-09-23T09:12:34.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.528+0000 7fefc6a45b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559be66a5c40 0x559be66a5700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:12:34.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.528+0000 7fefc6a45b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559be66ab380 0x559be66b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:12:34.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.529+0000 7fefc6a45b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559be66abca0 0x559be66a9010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:12:34.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.529+0000 7fefc6a45b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x559be6479920 con 0x559be66a5c40 2023-09-23T09:12:34.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.529+0000 7fefc6a45b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x559be6698660 con 0x559be66abca0 2023-09-23T09:12:34.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.529+0000 7fefc6a45b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x559be66b6ce0 con 0x559be66ab380 2023-09-23T09:12:34.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.529+0000 7fefb0f9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559be66a5c40 0x559be66a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:12:34.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.529+0000 7fefabfff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559be66ab380 0x559be66b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:12:34.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.529+0000 7fefabfff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559be66ab380 0x559be66b67a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:42974/0 (socket says 172.21.15.82:42974) 2023-09-23T09:12:34.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.529+0000 7fefb0f9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559be66a5c40 0x559be66a5700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44078/0 (socket says 172.21.15.82:44078) 2023-09-23T09:12:34.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.529+0000 7fefabfff700 1 -- 172.21.15.82:0/1137278502 learned_addr learned my addr 172.21.15.82:0/1137278502 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:12:34.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.529+0000 7fefb179c700 1 --2- 172.21.15.82:0/1137278502 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559be66abca0 0x559be66a9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:12:34.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.529+0000 7fefabfff700 1 -- 172.21.15.82:0/1137278502 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559be66abca0 msgr2=0x559be66a9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:12:34.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.529+0000 7fefabfff700 1 --2- 172.21.15.82:0/1137278502 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559be66abca0 0x559be66a9010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:12:34.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.529+0000 7fefabfff700 1 -- 172.21.15.82:0/1137278502 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559be66a5c40 msgr2=0x559be66a5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:12:34.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.529+0000 7fefabfff700 1 --2- 172.21.15.82:0/1137278502 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559be66a5c40 0x559be66a5700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:12:34.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.529+0000 7fefabfff700 1 -- 172.21.15.82:0/1137278502 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559be66ae360 con 0x559be66ab380 2023-09-23T09:12:34.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.529+0000 7fefb0f9b700 1 --2- 172.21.15.82:0/1137278502 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559be66a5c40 0x559be66a5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:12:34.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.530+0000 7fefabfff700 1 --2- 172.21.15.82:0/1137278502 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559be66ab380 0x559be66b67a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fef98009990 tx=0x7fef9800b260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=112d403f9ef56420 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:12:34.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.530+0000 7fef977fe700 1 -- 172.21.15.82:0/1137278502 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef98005480 con 0x559be66ab380 2023-09-23T09:12:34.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.530+0000 7fef977fe700 1 -- 172.21.15.82:0/1137278502 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fef9802c070 con 0x559be66ab380 2023-09-23T09:12:34.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.530+0000 7fef977fe700 1 -- 172.21.15.82:0/1137278502 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef9800b970 con 0x559be66ab380 2023-09-23T09:12:34.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.531+0000 7fefc6a45b80 1 -- 172.21.15.82:0/1137278502 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559be66ab380 msgr2=0x559be66b67a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:12:34.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.531+0000 7fefc6a45b80 1 --2- 172.21.15.82:0/1137278502 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559be66ab380 0x559be66b67a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fef98009990 tx=0x7fef9800b260 comp rx=0 tx=0).stop 2023-09-23T09:12:34.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.531+0000 7fefc6a45b80 1 -- 172.21.15.82:0/1137278502 shutdown_connections 2023-09-23T09:12:34.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.531+0000 7fefc6a45b80 1 --2- 172.21.15.82:0/1137278502 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559be66abca0 0x559be66a9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:12:34.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.531+0000 7fefc6a45b80 1 --2- 172.21.15.82:0/1137278502 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559be66a5c40 0x559be66a5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:12:34.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.531+0000 7fefc6a45b80 1 --2- 172.21.15.82:0/1137278502 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559be66ab380 0x559be66b67a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:12:34.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.531+0000 7fefc6a45b80 1 -- 172.21.15.82:0/1137278502 >> 172.21.15.82:0/1137278502 conn(0x559be661a0e0 msgr2=0x559be66bba70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:12:34.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.531+0000 7fefc6a45b80 1 -- 172.21.15.82:0/1137278502 shutdown_connections 2023-09-23T09:12:34.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.531+0000 7fefc6a45b80 1 -- 172.21.15.82:0/1137278502 wait complete. 2023-09-23T09:12:34.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.531+0000 7fefc6a45b80 1 -- start start 2023-09-23T09:12:34.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.532+0000 7fefc6a45b80 1 Processor -- start 2023-09-23T09:12:34.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.532+0000 7fefc6a45b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559be66a5c40 0x559be66b5f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:12:34.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.532+0000 7fefc6a45b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559be66ab380 0x559be66b6460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:12:34.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.532+0000 7fefc6a45b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559be66abca0 0x559be66b4780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:12:34.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.532+0000 7fefc6a45b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x559be66b4e60 con 0x559be66ab380 2023-09-23T09:12:34.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.532+0000 7fefc6a45b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x559be66b4fd0 con 0x559be66abca0 2023-09-23T09:12:34.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.532+0000 7fefc6a45b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x559be66b5190 con 0x559be66a5c40 2023-09-23T09:12:34.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.532+0000 7fefc6a45b80 10 client.0 _ll_register_callbacks cb 0x559be64dfa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:12:34.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.533+0000 7fefb0f9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559be66a5c40 0x559be66b5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:12:34.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.533+0000 7fefb0f9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559be66a5c40 0x559be66b5f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:42976/0 (socket says 172.21.15.82:42976) 2023-09-23T09:12:34.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.533+0000 7fefb0f9b700 1 -- 172.21.15.82:0/2900649612 learned_addr learned my addr 172.21.15.82:0/2900649612 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:12:34.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.533+0000 7fefb179c700 1 --2- 172.21.15.82:0/2900649612 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559be66abca0 0x559be66b4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:12:34.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.533+0000 7fefabfff700 1 --2- 172.21.15.82:0/2900649612 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559be66ab380 0x559be66b6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:12:34.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.533+0000 7fefb0f9b700 1 -- 172.21.15.82:0/2900649612 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559be66abca0 msgr2=0x559be66b4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:12:34.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.533+0000 7fefb0f9b700 1 --2- 172.21.15.82:0/2900649612 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559be66abca0 0x559be66b4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:12:34.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.533+0000 7fefb0f9b700 1 -- 172.21.15.82:0/2900649612 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559be66ab380 msgr2=0x559be66b6460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:12:34.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.533+0000 7fefb0f9b700 1 --2- 172.21.15.82:0/2900649612 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559be66ab380 0x559be66b6460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:12:34.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.533+0000 7fefb0f9b700 1 -- 172.21.15.82:0/2900649612 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559be6423de0 con 0x559be66a5c40 2023-09-23T09:12:34.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.533+0000 7fefb179c700 1 --2- 172.21.15.82:0/2900649612 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559be66abca0 0x559be66b4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:12:34.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.533+0000 7fefb0f9b700 1 --2- 172.21.15.82:0/2900649612 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559be66a5c40 0x559be66b5f20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fefa00a09f0 tx=0x7fefa000cc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf0c15a0e89274b2 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:12:34.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.533+0000 7fef8bfff700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T09:12:34.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.534+0000 7fef8bfff700 1 -- 172.21.15.82:0/2900649612 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa009cf40 con 0x559be66a5c40 2023-09-23T09:12:34.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.534+0000 7fef8bfff700 1 -- 172.21.15.82:0/2900649612 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fefa0099110 con 0x559be66a5c40 2023-09-23T09:12:34.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.534+0000 7fefc6a45b80 1 -- 172.21.15.82:0/2900649612 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559be66988b0 con 0x559be66a5c40 2023-09-23T09:12:34.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.534+0000 7fef8bfff700 1 -- 172.21.15.82:0/2900649612 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) v2 ==== 24+0+0 (secure 0 0 0) 0x7fefa0004140 con 0x559be66a5c40 2023-09-23T09:12:34.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.534+0000 7fefc6a45b80 10 client.26302 fetch_fsmap learned FSMap version 65 2023-09-23T09:12:34.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.534+0000 7fefc6a45b80 1 -- 172.21.15.82:0/2900649612 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=4+}) v3 -- 0x7fefac10e060 con 0x559be66a5c40 2023-09-23T09:12:34.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.534+0000 7fef8bfff700 1 -- 172.21.15.82:0/2900649612 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x559be66988b0 con 0x559be66a5c40 2023-09-23T09:12:34.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.534+0000 7fef8bfff700 1 -- 172.21.15.82:0/2900649612 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 65) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fefa0098690 con 0x559be66a5c40 2023-09-23T09:12:34.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.534+0000 7fefc6a45b80 10 client.26302 fetch_fsmap finished waiting for FSMap version 65 2023-09-23T09:12:34.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.534+0000 7fefc6a45b80 10 client.26302 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:12:34.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.534+0000 7fefc6a45b80 20 client.26302 populate_metadata read hostname 'smithi082' 2023-09-23T09:12:34.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.535+0000 7fefc6a45b80 1 --2- 172.21.15.82:0/2900649612 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x559be6713c70 0x559be6716060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:12:34.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.535+0000 7fefc6a45b80 4 client.26302 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:12:34.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.535+0000 7fefc6a45b80 1 -- 172.21.15.82:0/2900649612 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x559be65f0970 con 0x559be6713c70 2023-09-23T09:12:34.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.535+0000 7fefabfff700 1 --2- 172.21.15.82:0/2900649612 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x559be6713c70 0x559be6716060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:12:34.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.535+0000 7fefabfff700 1 --2- 172.21.15.82:0/2900649612 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x559be6713c70 0x559be6716060 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1410c4e861c7d33 server_cookie=45ff91490339a880 in_seq=0 out_seq=0 2023-09-23T09:12:34.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.535+0000 7fef8bfff700 10 client.26302 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:12:34.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.536+0000 7fef8bfff700 1 -- 172.21.15.82:0/2900649612 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x559be65f0970 con 0x559be6713c70 2023-09-23T09:12:34.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.536+0000 7fef8bfff700 10 client.26302 handle_command_reply: tid=0 2023-09-23T09:12:34.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.536+0000 7fefc6a45b80 1 client.26302 shutdown 2023-09-23T09:12:34.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.536+0000 7fefc6a45b80 1 -- 172.21.15.82:0/2900649612 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559be66a5c40 msgr2=0x559be66b5f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:12:34.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.536+0000 7fefc6a45b80 1 --2- 172.21.15.82:0/2900649612 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559be66a5c40 0x559be66b5f20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fefa00a09f0 tx=0x7fefa000cc90 comp rx=0 tx=0).stop 2023-09-23T09:12:34.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.536+0000 7fefc6a45b80 1 -- 172.21.15.82:0/2900649612 shutdown_connections 2023-09-23T09:12:34.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.536+0000 7fefc6a45b80 1 --2- 172.21.15.82:0/2900649612 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559be66abca0 0x559be66b4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:12:34.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.536+0000 7fefc6a45b80 1 --2- 172.21.15.82:0/2900649612 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559be66a5c40 0x559be66b5f20 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:12:34.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.536+0000 7fefc6a45b80 1 --2- 172.21.15.82:0/2900649612 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x559be6713c70 0x559be6716060 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:12:34.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.536+0000 7fefc6a45b80 1 --2- 172.21.15.82:0/2900649612 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559be66ab380 0x559be66b6460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:12:34.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.536+0000 7fef8bfff700 0 client.26302 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:12:34.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.536+0000 7fefc6a45b80 1 -- 172.21.15.82:0/2900649612 >> 172.21.15.82:0/2900649612 conn(0x559be661a0e0 msgr2=0x559be66a9010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:12:34.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.536+0000 7fefc6a45b80 1 -- 172.21.15.82:0/2900649612 shutdown_connections 2023-09-23T09:12:34.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.536+0000 7fefc6a45b80 1 -- 172.21.15.82:0/2900649612 wait complete. 2023-09-23T09:12:34.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.536+0000 7fefc6a45b80 20 client.26302 trim_cache size 0 max 16384 2023-09-23T09:12:34.543 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:12:34.543 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "IDLE (waiting for more scrubs)", 2023-09-23T09:12:34.543 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:12:34.543 INFO:teuthology.orchestra.run.smithi082.stdout: "cba46b77-20dd-437c-a60a-ac01b400e1b8": { 2023-09-23T09:12:34.543 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:12:34.543 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "cba46b77-20dd-437c-a60a-ac01b400e1b8", 2023-09-23T09:12:34.544 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:12:34.544 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:12:34.544 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:12:34.544 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:12:34.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.537+0000 7fefb31ff700 1 -- 172.21.15.82:0/463231724 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fef9c0a0140 msgr2=0x7fef9c0a2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:12:34.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.537+0000 7fefb31ff700 1 --2- 172.21.15.82:0/463231724 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fef9c0a0140 0x7fef9c0a2600 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fefa4009ec0 tx=0x7fefa4009920 comp rx=0 tx=0).stop 2023-09-23T09:12:34.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.537+0000 7fefb31ff700 1 -- 172.21.15.82:0/463231724 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefac100890 msgr2=0x7fefac072c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:12:34.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.537+0000 7fefb31ff700 1 --2- 172.21.15.82:0/463231724 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefac100890 0x7fefac072c20 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fefa000eb30 tx=0x7fefa000ee40 comp rx=0 tx=0).stop 2023-09-23T09:12:34.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.537+0000 7fefb31ff700 1 -- 172.21.15.82:0/463231724 shutdown_connections 2023-09-23T09:12:34.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.537+0000 7fefb31ff700 1 --2- 172.21.15.82:0/463231724 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fef9c0a0140 0x7fef9c0a2600 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:12:34.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.537+0000 7fefb31ff700 1 --2- 172.21.15.82:0/463231724 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fefac1068a0 0x7fefac1a4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:12:34.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.537+0000 7fefb31ff700 1 --2- 172.21.15.82:0/463231724 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefac100890 0x7fefac072c20 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:12:34.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.537+0000 7fefb31ff700 1 --2- 172.21.15.82:0/463231724 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fefac101250 0x7fefac073160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:12:34.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.537+0000 7fefb31ff700 1 -- 172.21.15.82:0/463231724 >> 172.21.15.82:0/463231724 conn(0x7fefac0fc380 msgr2=0x7fefac0fc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:12:34.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.537+0000 7fefb31ff700 1 -- 172.21.15.82:0/463231724 shutdown_connections 2023-09-23T09:12:34.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:12:34.537+0000 7fefb31ff700 1 -- 172.21.15.82:0/463231724 wait complete. 2023-09-23T09:12:34.559 INFO:tasks.cephfs.filesystem:scrub status for tag:cba46b77-20dd-437c-a60a-ac01b400e1b8 - {'path': '/', 'tag': 'cba46b77-20dd-437c-a60a-ac01b400e1b8', 'options': 'recursive,force'} 2023-09-23T09:12:35.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:12:34 smithi135 ceph-mon[99205]: pgmap v491: 97 pgs: 97 active+clean; 7.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.9 MiB/s wr, 267 op/s 2023-09-23T09:12:35.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:12:34 smithi082 ceph-mon[97694]: pgmap v491: 97 pgs: 97 active+clean; 7.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.9 MiB/s wr, 267 op/s 2023-09-23T09:12:35.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:12:34 smithi161 ceph-mon[99580]: pgmap v491: 97 pgs: 97 active+clean; 7.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.9 MiB/s wr, 267 op/s 2023-09-23T09:12:37.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:12:36 smithi135 ceph-mon[99205]: pgmap v492: 97 pgs: 97 active+clean; 7.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.4 MiB/s wr, 400 op/s 2023-09-23T09:12:37.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:12:36 smithi082 ceph-mon[97694]: pgmap v492: 97 pgs: 97 active+clean; 7.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.4 MiB/s wr, 400 op/s 2023-09-23T09:12:37.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:12:36 smithi161 ceph-mon[99580]: pgmap v492: 97 pgs: 97 active+clean; 7.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.4 MiB/s wr, 400 op/s 2023-09-23T09:12:39.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:12:38 smithi135 ceph-mon[99205]: pgmap v493: 97 pgs: 97 active+clean; 7.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.0 MiB/s wr, 271 op/s 2023-09-23T09:12:39.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:12:38 smithi082 ceph-mon[97694]: pgmap v493: 97 pgs: 97 active+clean; 7.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.0 MiB/s wr, 271 op/s 2023-09-23T09:12:39.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:12:38 smithi161 ceph-mon[99580]: pgmap v493: 97 pgs: 97 active+clean; 7.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.0 MiB/s wr, 271 op/s 2023-09-23T09:12:41.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:12:40 smithi135 ceph-mon[99205]: pgmap v494: 97 pgs: 97 active+clean; 7.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.5 MiB/s wr, 411 op/s 2023-09-23T09:12:41.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:12:40 smithi082 ceph-mon[97694]: pgmap v494: 97 pgs: 97 active+clean; 7.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.5 MiB/s wr, 411 op/s 2023-09-23T09:12:41.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:12:40 smithi161 ceph-mon[99580]: pgmap v494: 97 pgs: 97 active+clean; 7.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.5 MiB/s wr, 411 op/s 2023-09-23T09:12:43.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:12:42 smithi135 ceph-mon[99205]: pgmap v495: 97 pgs: 97 active+clean; 7.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.0 MiB/s wr, 273 op/s 2023-09-23T09:12:43.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:12:42 smithi082 ceph-mon[97694]: pgmap v495: 97 pgs: 97 active+clean; 7.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.0 MiB/s wr, 273 op/s 2023-09-23T09:12:43.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:12:42 smithi161 ceph-mon[99580]: pgmap v495: 97 pgs: 97 active+clean; 7.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.0 MiB/s wr, 273 op/s 2023-09-23T09:12:45.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:12:44 smithi135 ceph-mon[99205]: pgmap v496: 97 pgs: 97 active+clean; 7.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.0 MiB/s wr, 273 op/s 2023-09-23T09:12:45.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:12:44 smithi082 ceph-mon[97694]: pgmap v496: 97 pgs: 97 active+clean; 7.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.0 MiB/s wr, 273 op/s 2023-09-23T09:12:45.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:12:44 smithi161 ceph-mon[99580]: pgmap v496: 97 pgs: 97 active+clean; 7.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.0 MiB/s wr, 273 op/s 2023-09-23T09:12:45.974 INFO:teuthology.orchestra.run.smithi082.stderr:39800000 of 50000000 tuples (79%) done (elapsed 920.72 s, remaining 235.96 s) 2023-09-23T09:12:47.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:12:46 smithi135 ceph-mon[99205]: pgmap v497: 97 pgs: 97 active+clean; 7.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.4 MiB/s wr, 396 op/s 2023-09-23T09:12:47.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:12:46 smithi082 ceph-mon[97694]: pgmap v497: 97 pgs: 97 active+clean; 7.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.4 MiB/s wr, 396 op/s 2023-09-23T09:12:47.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:12:46 smithi161 ceph-mon[99580]: pgmap v497: 97 pgs: 97 active+clean; 7.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.4 MiB/s wr, 396 op/s 2023-09-23T09:12:49.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:12:48 smithi135 ceph-mon[99205]: pgmap v498: 97 pgs: 97 active+clean; 7.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.9 MiB/s wr, 263 op/s 2023-09-23T09:12:49.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:12:48 smithi082 ceph-mon[97694]: pgmap v498: 97 pgs: 97 active+clean; 7.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.9 MiB/s wr, 263 op/s 2023-09-23T09:12:49.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:12:48 smithi161 ceph-mon[99580]: pgmap v498: 97 pgs: 97 active+clean; 7.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.9 MiB/s wr, 263 op/s 2023-09-23T09:12:51.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:12:50 smithi135 ceph-mon[99205]: pgmap v499: 97 pgs: 97 active+clean; 7.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.5 MiB/s wr, 407 op/s 2023-09-23T09:12:51.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:12:50 smithi082 ceph-mon[97694]: pgmap v499: 97 pgs: 97 active+clean; 7.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.5 MiB/s wr, 407 op/s 2023-09-23T09:12:51.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:12:50 smithi161 ceph-mon[99580]: pgmap v499: 97 pgs: 97 active+clean; 7.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.5 MiB/s wr, 407 op/s 2023-09-23T09:12:53.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:12:52 smithi135 ceph-mon[99205]: pgmap v500: 97 pgs: 97 active+clean; 7.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.0 MiB/s wr, 266 op/s 2023-09-23T09:12:53.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:12:52 smithi082 ceph-mon[97694]: pgmap v500: 97 pgs: 97 active+clean; 7.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.0 MiB/s wr, 266 op/s 2023-09-23T09:12:53.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:12:52 smithi161 ceph-mon[99580]: pgmap v500: 97 pgs: 97 active+clean; 7.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.0 MiB/s wr, 266 op/s 2023-09-23T09:12:55.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:12:54 smithi135 ceph-mon[99205]: pgmap v501: 97 pgs: 97 active+clean; 7.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.0 MiB/s wr, 266 op/s 2023-09-23T09:12:55.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:12:54 smithi082 ceph-mon[97694]: pgmap v501: 97 pgs: 97 active+clean; 7.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.0 MiB/s wr, 266 op/s 2023-09-23T09:12:55.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:12:54 smithi161 ceph-mon[99580]: pgmap v501: 97 pgs: 97 active+clean; 7.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.0 MiB/s wr, 266 op/s 2023-09-23T09:12:57.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:12:56 smithi135 ceph-mon[99205]: pgmap v502: 97 pgs: 97 active+clean; 7.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.5 MiB/s wr, 406 op/s 2023-09-23T09:12:57.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:12:56 smithi082 ceph-mon[97694]: pgmap v502: 97 pgs: 97 active+clean; 7.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.5 MiB/s wr, 406 op/s 2023-09-23T09:12:57.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:12:56 smithi161 ceph-mon[99580]: pgmap v502: 97 pgs: 97 active+clean; 7.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.5 MiB/s wr, 406 op/s 2023-09-23T09:12:59.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:12:58 smithi135 ceph-mon[99205]: pgmap v503: 97 pgs: 97 active+clean; 7.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.1 MiB/s wr, 283 op/s 2023-09-23T09:12:59.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:12:58 smithi082 ceph-mon[97694]: pgmap v503: 97 pgs: 97 active+clean; 7.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.1 MiB/s wr, 283 op/s 2023-09-23T09:12:59.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:12:58 smithi161 ceph-mon[99580]: pgmap v503: 97 pgs: 97 active+clean; 7.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.1 MiB/s wr, 283 op/s 2023-09-23T09:13:01.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:13:00 smithi135 ceph-mon[99205]: pgmap v504: 97 pgs: 97 active+clean; 7.5 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.6 MiB/s wr, 421 op/s 2023-09-23T09:13:01.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:13:00 smithi082 ceph-mon[97694]: pgmap v504: 97 pgs: 97 active+clean; 7.5 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.6 MiB/s wr, 421 op/s 2023-09-23T09:13:01.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:13:00 smithi161 ceph-mon[99580]: pgmap v504: 97 pgs: 97 active+clean; 7.5 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.6 MiB/s wr, 421 op/s 2023-09-23T09:13:03.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:13:02 smithi135 ceph-mon[99205]: pgmap v505: 97 pgs: 97 active+clean; 7.5 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.0 MiB/s wr, 277 op/s 2023-09-23T09:13:03.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:13:02 smithi082 ceph-mon[97694]: pgmap v505: 97 pgs: 97 active+clean; 7.5 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.0 MiB/s wr, 277 op/s 2023-09-23T09:13:03.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:13:02 smithi161 ceph-mon[99580]: pgmap v505: 97 pgs: 97 active+clean; 7.5 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.0 MiB/s wr, 277 op/s 2023-09-23T09:13:03.356 INFO:teuthology.orchestra.run.smithi082.stderr:39900000 of 50000000 tuples (79%) done (elapsed 938.10 s, remaining 237.46 s) 2023-09-23T09:13:04.560 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:13:04.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.786+0000 7f98fa1ff700 1 -- 172.21.15.82:0/583561457 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98f4100870 msgr2=0x7f98f4100cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:13:04.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.786+0000 7f98fa1ff700 1 --2- 172.21.15.82:0/583561457 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98f4100870 0x7f98f4100cf0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f98e8009990 tx=0x7f98e8009ca0 comp rx=0 tx=0).stop 2023-09-23T09:13:04.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.787+0000 7f98fa1ff700 1 -- 172.21.15.82:0/583561457 shutdown_connections 2023-09-23T09:13:04.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.787+0000 7f98fa1ff700 1 --2- 172.21.15.82:0/583561457 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f98f4101230 0x7f98f410d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:13:04.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.787+0000 7f98fa1ff700 1 --2- 172.21.15.82:0/583561457 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98f4106880 0x7f98f4106c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:13:04.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.787+0000 7f98fa1ff700 1 --2- 172.21.15.82:0/583561457 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98f4100870 0x7f98f4100cf0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:13:04.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.787+0000 7f98fa1ff700 1 -- 172.21.15.82:0/583561457 >> 172.21.15.82:0/583561457 conn(0x7f98f40fc3a0 msgr2=0x7f98f40fe7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:13:04.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.787+0000 7f98fa1ff700 1 -- 172.21.15.82:0/583561457 shutdown_connections 2023-09-23T09:13:04.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.787+0000 7f98fa1ff700 1 -- 172.21.15.82:0/583561457 wait complete. 2023-09-23T09:13:04.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.788+0000 7f98fa1ff700 1 Processor -- start 2023-09-23T09:13:04.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.788+0000 7f98fa1ff700 1 -- start start 2023-09-23T09:13:04.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.788+0000 7f98fa1ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f98f4100870 0x7f98f419e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:13:04.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.788+0000 7f98fa1ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98f4101230 0x7f98f419ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:13:04.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.788+0000 7f98fa1ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98f4106880 0x7f98f4198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:13:04.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.788+0000 7f98fa1ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98f4198ef0 con 0x7f98f4106880 2023-09-23T09:13:04.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.788+0000 7f98fa1ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98f4199060 con 0x7f98f4101230 2023-09-23T09:13:04.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.788+0000 7f98fa1ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98f4199220 con 0x7f98f4100870 2023-09-23T09:13:04.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.789+0000 7f98f37fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f98f4100870 0x7f98f419e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:13:04.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.789+0000 7f98f2ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98f4101230 0x7f98f419ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:13:04.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.789+0000 7f98f3fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98f4106880 0x7f98f4198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:13:04.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.789+0000 7f98f2ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98f4101230 0x7f98f419ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:56522/0 (socket says 172.21.15.82:56522) 2023-09-23T09:13:04.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.789+0000 7f98f37fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f98f4100870 0x7f98f419e810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:35324/0 (socket says 172.21.15.82:35324) 2023-09-23T09:13:04.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.789+0000 7f98f2ffd700 1 -- 172.21.15.82:0/1963270018 learned_addr learned my addr 172.21.15.82:0/1963270018 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:13:04.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.789+0000 7f98f2ffd700 1 -- 172.21.15.82:0/1963270018 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f98f4100870 msgr2=0x7f98f419e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:13:04.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.789+0000 7f98f2ffd700 1 --2- 172.21.15.82:0/1963270018 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f98f4100870 0x7f98f419e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:13:04.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.789+0000 7f98f2ffd700 1 -- 172.21.15.82:0/1963270018 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98f4106880 msgr2=0x7f98f4198880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:13:04.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.789+0000 7f98f2ffd700 1 --2- 172.21.15.82:0/1963270018 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98f4106880 0x7f98f4198880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:13:04.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.789+0000 7f98f2ffd700 1 -- 172.21.15.82:0/1963270018 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98e80095f0 con 0x7f98f4101230 2023-09-23T09:13:04.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.789+0000 7f98f3fff700 1 --2- 172.21.15.82:0/1963270018 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98f4106880 0x7f98f4198880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:13:04.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.789+0000 7f98f2ffd700 1 --2- 172.21.15.82:0/1963270018 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98f4101230 0x7f98f419ed50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f98e8005910 tx=0x7f98e80047b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:13:04.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.790+0000 7f98f0ff9700 1 -- 172.21.15.82:0/1963270018 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e801d070 con 0x7f98f4101230 2023-09-23T09:13:04.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.790+0000 7f98f0ff9700 1 -- 172.21.15.82:0/1963270018 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f98e8021410 con 0x7f98f4101230 2023-09-23T09:13:04.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.790+0000 7f98fa1ff700 1 -- 172.21.15.82:0/1963270018 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98f4199500 con 0x7f98f4101230 2023-09-23T09:13:04.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.790+0000 7f98f0ff9700 1 -- 172.21.15.82:0/1963270018 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e8017650 con 0x7f98f4101230 2023-09-23T09:13:04.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.790+0000 7f98fa1ff700 1 -- 172.21.15.82:0/1963270018 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98f41a5800 con 0x7f98f4101230 2023-09-23T09:13:04.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.793+0000 7f98f0ff9700 1 -- 172.21.15.82:0/1963270018 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f98e8021580 con 0x7f98f4101230 2023-09-23T09:13:04.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.795+0000 7f98f0ff9700 1 --2- 172.21.15.82:0/1963270018 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f98dc0a00c0 0x7f98dc0a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:13:04.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.795+0000 7f990dc03b80 1 Processor -- start 2023-09-23T09:13:04.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.795+0000 7f990dc03b80 1 -- start start 2023-09-23T09:13:04.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.795+0000 7f98f0ff9700 1 -- 172.21.15.82:0/1963270018 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f98e80cc870 con 0x7f98f4101230 2023-09-23T09:13:04.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.795+0000 7f98f37fe700 1 --2- 172.21.15.82:0/1963270018 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f98dc0a00c0 0x7f98dc0a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:13:04.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.795+0000 7f990dc03b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572fd825380 0x5572fd825760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:13:04.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.795+0000 7f990dc03b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5572fd825ca0 0x5572fd81f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:13:04.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.795+0000 7f990dc03b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5572fd81fc40 0x5572fd8200a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:13:04.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.795+0000 7f990dc03b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572fd7877b0 con 0x5572fd81fc40 2023-09-23T09:13:04.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.795+0000 7f990dc03b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572fd778780 con 0x5572fd825380 2023-09-23T09:13:04.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.795+0000 7f990dc03b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572fd7760a0 con 0x5572fd825ca0 2023-09-23T09:13:04.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.796+0000 7f98f37fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572fd825380 0x5572fd825760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:13:04.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.796+0000 7f98f2ffd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5572fd825ca0 0x5572fd81f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:13:04.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.796+0000 7f98f3fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5572fd81fc40 0x5572fd8200a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:13:04.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.796+0000 7f98f2ffd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5572fd825ca0 0x5572fd81f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:35340/0 (socket says 172.21.15.82:35340) 2023-09-23T09:13:04.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.796+0000 7f98f37fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572fd825380 0x5572fd825760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:56530/0 (socket says 172.21.15.82:56530) 2023-09-23T09:13:04.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.796+0000 7f98f2ffd700 1 -- 172.21.15.82:0/2408252763 learned_addr learned my addr 172.21.15.82:0/2408252763 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:13:04.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.796+0000 7f98f37fe700 1 --2- 172.21.15.82:0/1963270018 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f98dc0a00c0 0x7f98dc0a2580 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f98e4009c30 tx=0x7f98e4009260 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:13:04.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.796+0000 7f98f3fff700 1 -- 172.21.15.82:0/2408252763 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5572fd825ca0 msgr2=0x5572fd81f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:13:04.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.796+0000 7f98f3fff700 1 --2- 172.21.15.82:0/2408252763 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5572fd825ca0 0x5572fd81f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:13:04.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.796+0000 7f98f3fff700 1 -- 172.21.15.82:0/2408252763 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572fd825380 msgr2=0x5572fd825760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:13:04.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.796+0000 7f98f3fff700 1 --2- 172.21.15.82:0/2408252763 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572fd825380 0x5572fd825760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:13:04.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.796+0000 7f98f3fff700 1 -- 172.21.15.82:0/2408252763 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5572fd5f1630 con 0x5572fd81fc40 2023-09-23T09:13:04.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.796+0000 7f98f2ffd700 1 --2- 172.21.15.82:0/2408252763 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5572fd825ca0 0x5572fd81f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:13:04.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.797+0000 7f98f3fff700 1 --2- 172.21.15.82:0/2408252763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5572fd81fc40 0x5572fd8200a0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f98ec003da0 tx=0x7f98ec009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6d503789a5d172f server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:13:04.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.797+0000 7f98d9ffb700 1 -- 172.21.15.82:0/2408252763 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98ec0092d0 con 0x5572fd81fc40 2023-09-23T09:13:04.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.797+0000 7f98d9ffb700 1 -- 172.21.15.82:0/2408252763 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f98ec00f040 con 0x5572fd81fc40 2023-09-23T09:13:04.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.797+0000 7f98d9ffb700 1 -- 172.21.15.82:0/2408252763 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98ec007ea0 con 0x5572fd81fc40 2023-09-23T09:13:04.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.797+0000 7f990dc03b80 1 -- 172.21.15.82:0/2408252763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5572fd81fc40 msgr2=0x5572fd8200a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:13:04.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.797+0000 7f990dc03b80 1 --2- 172.21.15.82:0/2408252763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5572fd81fc40 0x5572fd8200a0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f98ec003da0 tx=0x7f98ec009920 comp rx=0 tx=0).stop 2023-09-23T09:13:04.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.798+0000 7f990dc03b80 1 -- 172.21.15.82:0/2408252763 shutdown_connections 2023-09-23T09:13:04.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.798+0000 7f990dc03b80 1 --2- 172.21.15.82:0/2408252763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5572fd81fc40 0x5572fd8200a0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:13:04.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.798+0000 7f990dc03b80 1 --2- 172.21.15.82:0/2408252763 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572fd825380 0x5572fd825760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:13:04.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.798+0000 7f990dc03b80 1 --2- 172.21.15.82:0/2408252763 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5572fd825ca0 0x5572fd81f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:13:04.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.798+0000 7f990dc03b80 1 -- 172.21.15.82:0/2408252763 >> 172.21.15.82:0/2408252763 conn(0x5572fd7940e0 msgr2=0x5572fd81a410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:13:04.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.798+0000 7f990dc03b80 1 -- 172.21.15.82:0/2408252763 shutdown_connections 2023-09-23T09:13:04.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.798+0000 7f990dc03b80 1 -- 172.21.15.82:0/2408252763 wait complete. 2023-09-23T09:13:04.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.798+0000 7f990dc03b80 1 -- start start 2023-09-23T09:13:04.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.798+0000 7f990dc03b80 1 Processor -- start 2023-09-23T09:13:04.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.799+0000 7f990dc03b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5572fd81fc40 0x5572fd82bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:13:04.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.799+0000 7f990dc03b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572fd825380 0x5572fd828e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:13:04.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.799+0000 7f990dc03b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5572fd825ca0 0x5572fd829430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:13:04.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.799+0000 7f990dc03b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572fd771990 con 0x5572fd81fc40 2023-09-23T09:13:04.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.799+0000 7f990dc03b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572fd70fbb0 con 0x5572fd825380 2023-09-23T09:13:04.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.799+0000 7f990dc03b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572fd70f8b0 con 0x5572fd825ca0 2023-09-23T09:13:04.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.799+0000 7f990dc03b80 10 client.0 _ll_register_callbacks cb 0x5572fd659a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:13:04.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.799+0000 7f98f37fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5572fd81fc40 0x5572fd82bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:13:04.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.799+0000 7f98f37fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5572fd81fc40 0x5572fd82bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51516/0 (socket says 172.21.15.82:51516) 2023-09-23T09:13:04.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.799+0000 7f98f37fe700 1 -- 172.21.15.82:0/2867362010 learned_addr learned my addr 172.21.15.82:0/2867362010 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:13:04.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.799+0000 7f98f2ffd700 1 --2- 172.21.15.82:0/2867362010 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572fd825380 0x5572fd828e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:13:04.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.799+0000 7f98f3fff700 1 --2- 172.21.15.82:0/2867362010 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5572fd825ca0 0x5572fd829430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:13:04.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.800+0000 7f98f37fe700 1 -- 172.21.15.82:0/2867362010 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5572fd825ca0 msgr2=0x5572fd829430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:13:04.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.800+0000 7f98f37fe700 1 --2- 172.21.15.82:0/2867362010 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5572fd825ca0 0x5572fd829430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:13:04.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.800+0000 7f98f37fe700 1 -- 172.21.15.82:0/2867362010 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572fd825380 msgr2=0x5572fd828e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:13:04.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.800+0000 7f98f37fe700 1 --2- 172.21.15.82:0/2867362010 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572fd825380 0x5572fd828e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:13:04.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.800+0000 7f98f37fe700 1 -- 172.21.15.82:0/2867362010 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98f41a5800 con 0x5572fd81fc40 2023-09-23T09:13:04.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.800+0000 7f98f37fe700 1 --2- 172.21.15.82:0/2867362010 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5572fd81fc40 0x5572fd82bba0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f98e401c570 tx=0x7f98e40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88da7c7fdcdfd4ec server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:13:04.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.800+0000 7f98d2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:13:04.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.800+0000 7f98d2ffd700 1 -- 172.21.15.82:0/2867362010 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e4029070 con 0x5572fd81fc40 2023-09-23T09:13:04.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.800+0000 7f990dc03b80 1 -- 172.21.15.82:0/2867362010 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5572fd7ef1c0 con 0x5572fd81fc40 2023-09-23T09:13:04.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.800+0000 7f98d2ffd700 1 -- 172.21.15.82:0/2867362010 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f98e4004830 con 0x5572fd81fc40 2023-09-23T09:13:04.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.801+0000 7f98d2ffd700 1 -- 172.21.15.82:0/2867362010 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) v2 ==== 24+0+0 (secure 0 0 0) 0x7f98e40049f0 con 0x5572fd81fc40 2023-09-23T09:13:04.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.801+0000 7f990dc03b80 10 client.16581 fetch_fsmap learned FSMap version 65 2023-09-23T09:13:04.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.801+0000 7f990dc03b80 1 -- 172.21.15.82:0/2867362010 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=4+}) v3 -- 0x7f98ec003a80 con 0x5572fd81fc40 2023-09-23T09:13:04.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.801+0000 7f98d2ffd700 1 -- 172.21.15.82:0/2867362010 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5572fd7ef1c0 con 0x5572fd81fc40 2023-09-23T09:13:04.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.801+0000 7f98d2ffd700 1 -- 172.21.15.82:0/2867362010 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 65) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f98e402c020 con 0x5572fd81fc40 2023-09-23T09:13:04.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.801+0000 7f990dc03b80 10 client.16581 fetch_fsmap finished waiting for FSMap version 65 2023-09-23T09:13:04.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.801+0000 7f990dc03b80 10 client.16581 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:13:04.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.801+0000 7f990dc03b80 20 client.16581 populate_metadata read hostname 'smithi082' 2023-09-23T09:13:04.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.801+0000 7f990dc03b80 1 --2- 172.21.15.82:0/2867362010 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5572fd839770 0x5572fd83bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:13:04.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.801+0000 7f990dc03b80 4 client.16581 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:13:04.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.801+0000 7f990dc03b80 1 -- 172.21.15.82:0/2867362010 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5572fd717ba0 con 0x5572fd839770 2023-09-23T09:13:04.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.802+0000 7f98f2ffd700 1 --2- 172.21.15.82:0/2867362010 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5572fd839770 0x5572fd83bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:13:04.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.802+0000 7f98f2ffd700 1 --2- 172.21.15.82:0/2867362010 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5572fd839770 0x5572fd83bb90 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a862594d802332d0 server_cookie=5d4a5a7383c8a62d in_seq=0 out_seq=0 2023-09-23T09:13:04.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.802+0000 7f98d2ffd700 10 client.16581 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:13:04.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.803+0000 7f98d2ffd700 1 -- 172.21.15.82:0/2867362010 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5572fd717ba0 con 0x5572fd839770 2023-09-23T09:13:04.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.803+0000 7f98d2ffd700 10 client.16581 handle_command_reply: tid=0 2023-09-23T09:13:04.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.803+0000 7f990dc03b80 1 client.16581 shutdown 2023-09-23T09:13:04.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.803+0000 7f990dc03b80 1 -- 172.21.15.82:0/2867362010 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5572fd81fc40 msgr2=0x5572fd82bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:13:04.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.803+0000 7f990dc03b80 1 --2- 172.21.15.82:0/2867362010 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5572fd81fc40 0x5572fd82bba0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f98e401c570 tx=0x7f98e40047c0 comp rx=0 tx=0).stop 2023-09-23T09:13:04.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.803+0000 7f990dc03b80 1 -- 172.21.15.82:0/2867362010 shutdown_connections 2023-09-23T09:13:04.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.803+0000 7f990dc03b80 1 --2- 172.21.15.82:0/2867362010 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5572fd825ca0 0x5572fd829430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:13:04.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.803+0000 7f990dc03b80 1 --2- 172.21.15.82:0/2867362010 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5572fd839770 0x5572fd83bb90 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:13:04.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.803+0000 7f990dc03b80 1 --2- 172.21.15.82:0/2867362010 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5572fd81fc40 0x5572fd82bba0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:13:04.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.803+0000 7f990dc03b80 1 --2- 172.21.15.82:0/2867362010 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572fd825380 0x5572fd828e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:13:04.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.803+0000 7f990dc03b80 1 -- 172.21.15.82:0/2867362010 >> 172.21.15.82:0/2867362010 conn(0x5572fd7940e0 msgr2=0x5572fd814b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:13:04.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.803+0000 7f98d2ffd700 0 client.16581 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:13:04.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.803+0000 7f990dc03b80 1 -- 172.21.15.82:0/2867362010 shutdown_connections 2023-09-23T09:13:04.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.804+0000 7f990dc03b80 1 -- 172.21.15.82:0/2867362010 wait complete. 2023-09-23T09:13:04.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.804+0000 7f990dc03b80 20 client.16581 trim_cache size 0 max 16384 2023-09-23T09:13:04.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.824+0000 7f990dc03b80 1 Processor -- start 2023-09-23T09:13:04.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.824+0000 7f990dc03b80 1 -- start start 2023-09-23T09:13:04.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.824+0000 7f990dc03b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5572fd81fc40 0x5572fd82b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:13:04.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.825+0000 7f990dc03b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572fd825380 0x5572fd828620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:13:04.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.825+0000 7f990dc03b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5572fd825ca0 0x5572fd828b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:13:04.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.825+0000 7f990dc03b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572fd5f3920 con 0x5572fd825ca0 2023-09-23T09:13:04.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.825+0000 7f990dc03b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572fd839550 con 0x5572fd825380 2023-09-23T09:13:04.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.825+0000 7f990dc03b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572fd816c80 con 0x5572fd81fc40 2023-09-23T09:13:04.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.825+0000 7f98f2ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572fd825380 0x5572fd828620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:13:04.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.825+0000 7f98f37fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5572fd81fc40 0x5572fd82b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:13:04.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.825+0000 7f98f2ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572fd825380 0x5572fd828620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:56548/0 (socket says 172.21.15.82:56548) 2023-09-23T09:13:04.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.825+0000 7f98f37fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5572fd81fc40 0x5572fd82b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:35360/0 (socket says 172.21.15.82:35360) 2023-09-23T09:13:04.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.825+0000 7f98f2ffd700 1 -- 172.21.15.82:0/2992361269 learned_addr learned my addr 172.21.15.82:0/2992361269 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:13:04.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.825+0000 7f98f3fff700 1 --2- 172.21.15.82:0/2992361269 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5572fd825ca0 0x5572fd828b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:13:04.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.825+0000 7f98f37fe700 1 -- 172.21.15.82:0/2992361269 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572fd825380 msgr2=0x5572fd828620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:13:04.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.825+0000 7f98f37fe700 1 --2- 172.21.15.82:0/2992361269 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572fd825380 0x5572fd828620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:13:04.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.825+0000 7f98f37fe700 1 -- 172.21.15.82:0/2992361269 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5572fd825ca0 msgr2=0x5572fd828b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:13:04.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.825+0000 7f98f37fe700 1 --2- 172.21.15.82:0/2992361269 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5572fd825ca0 0x5572fd828b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:13:04.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.825+0000 7f98f37fe700 1 -- 172.21.15.82:0/2992361269 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5572fd59dde0 con 0x5572fd81fc40 2023-09-23T09:13:04.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.826+0000 7f98f37fe700 1 --2- 172.21.15.82:0/2992361269 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5572fd81fc40 0x5572fd82b740 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f98e4013010 tx=0x7f98e4009350 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f851fdd1bc99a58e server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:13:04.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.826+0000 7f98da7fc700 1 -- 172.21.15.82:0/2992361269 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e4029070 con 0x5572fd81fc40 2023-09-23T09:13:04.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.826+0000 7f98da7fc700 1 -- 172.21.15.82:0/2992361269 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f98e40044b0 con 0x5572fd81fc40 2023-09-23T09:13:04.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.826+0000 7f98da7fc700 1 -- 172.21.15.82:0/2992361269 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e4025ca0 con 0x5572fd81fc40 2023-09-23T09:13:04.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.827+0000 7f990dc03b80 1 -- 172.21.15.82:0/2992361269 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5572fd81fc40 msgr2=0x5572fd82b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:13:04.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.827+0000 7f990dc03b80 1 --2- 172.21.15.82:0/2992361269 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5572fd81fc40 0x5572fd82b740 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f98e4013010 tx=0x7f98e4009350 comp rx=0 tx=0).stop 2023-09-23T09:13:04.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.827+0000 7f990dc03b80 1 -- 172.21.15.82:0/2992361269 shutdown_connections 2023-09-23T09:13:04.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.827+0000 7f990dc03b80 1 --2- 172.21.15.82:0/2992361269 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5572fd825ca0 0x5572fd828b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:13:04.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.827+0000 7f990dc03b80 1 --2- 172.21.15.82:0/2992361269 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5572fd81fc40 0x5572fd82b740 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:13:04.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.827+0000 7f990dc03b80 1 --2- 172.21.15.82:0/2992361269 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572fd825380 0x5572fd828620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:13:04.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.827+0000 7f990dc03b80 1 -- 172.21.15.82:0/2992361269 >> 172.21.15.82:0/2992361269 conn(0x5572fd7940e0 msgr2=0x5572fd822ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:13:04.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.827+0000 7f990dc03b80 1 -- 172.21.15.82:0/2992361269 shutdown_connections 2023-09-23T09:13:04.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.827+0000 7f990dc03b80 1 -- 172.21.15.82:0/2992361269 wait complete. 2023-09-23T09:13:04.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.827+0000 7f990dc03b80 1 -- start start 2023-09-23T09:13:04.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.828+0000 7f990dc03b80 1 Processor -- start 2023-09-23T09:13:04.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.828+0000 7f990dc03b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5572fd81fc40 0x5572fd822220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:13:04.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.828+0000 7f990dc03b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5572fd825380 0x5572fd822760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:13:04.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.828+0000 7f990dc03b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572fd825ca0 0x5572fd820e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:13:04.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.828+0000 7f990dc03b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572fd821420 con 0x5572fd81fc40 2023-09-23T09:13:04.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.828+0000 7f990dc03b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572fd821590 con 0x5572fd825ca0 2023-09-23T09:13:04.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.828+0000 7f990dc03b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572fd821750 con 0x5572fd825380 2023-09-23T09:13:04.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.828+0000 7f990dc03b80 10 client.0 _ll_register_callbacks cb 0x7f98e4011f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:13:04.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.828+0000 7f98f37fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5572fd81fc40 0x5572fd822220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:13:04.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.828+0000 7f98f37fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5572fd81fc40 0x5572fd822220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51538/0 (socket says 172.21.15.82:51538) 2023-09-23T09:13:04.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.828+0000 7f98f37fe700 1 -- 172.21.15.82:0/1593091246 learned_addr learned my addr 172.21.15.82:0/1593091246 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:13:04.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.828+0000 7f98f2ffd700 1 --2- 172.21.15.82:0/1593091246 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5572fd825380 0x5572fd822760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:13:04.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.828+0000 7f98f3fff700 1 --2- 172.21.15.82:0/1593091246 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572fd825ca0 0x5572fd820e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:13:04.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.829+0000 7f98f37fe700 1 -- 172.21.15.82:0/1593091246 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5572fd825380 msgr2=0x5572fd822760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:13:04.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.829+0000 7f98f37fe700 1 --2- 172.21.15.82:0/1593091246 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5572fd825380 0x5572fd822760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:13:04.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.829+0000 7f98f37fe700 1 -- 172.21.15.82:0/1593091246 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572fd825ca0 msgr2=0x5572fd820e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:13:04.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.829+0000 7f98f37fe700 1 --2- 172.21.15.82:0/1593091246 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572fd825ca0 0x5572fd820e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:13:04.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.829+0000 7f98f37fe700 1 -- 172.21.15.82:0/1593091246 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98ec003a80 con 0x5572fd81fc40 2023-09-23T09:13:04.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.829+0000 7f98f37fe700 1 --2- 172.21.15.82:0/1593091246 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5572fd81fc40 0x5572fd822220 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f98e4038040 tx=0x7f98e4005a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4da40f28652f7172 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:13:04.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.829+0000 7f98d2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:13:04.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.829+0000 7f98d2ffd700 1 -- 172.21.15.82:0/1593091246 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e4029040 con 0x5572fd81fc40 2023-09-23T09:13:04.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.829+0000 7f990dc03b80 1 -- 172.21.15.82:0/1593091246 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5572fd8128b0 con 0x5572fd81fc40 2023-09-23T09:13:04.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.829+0000 7f98d2ffd700 1 -- 172.21.15.82:0/1593091246 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f98e4025a40 con 0x5572fd81fc40 2023-09-23T09:13:04.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.830+0000 7f98d2ffd700 1 -- 172.21.15.82:0/1593091246 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) v2 ==== 24+0+0 (secure 0 0 0) 0x7f98e4025c00 con 0x5572fd81fc40 2023-09-23T09:13:04.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.830+0000 7f990dc03b80 10 client.16587 fetch_fsmap learned FSMap version 65 2023-09-23T09:13:04.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.830+0000 7f990dc03b80 1 -- 172.21.15.82:0/1593091246 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=4+}) v3 -- 0x5572fd586c60 con 0x5572fd81fc40 2023-09-23T09:13:04.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.830+0000 7f98d2ffd700 1 -- 172.21.15.82:0/1593091246 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f98e404d020 con 0x5572fd81fc40 2023-09-23T09:13:04.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.830+0000 7f98d2ffd700 1 -- 172.21.15.82:0/1593091246 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 65) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f98e401c5a0 con 0x5572fd81fc40 2023-09-23T09:13:04.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.830+0000 7f990dc03b80 10 client.16587 fetch_fsmap finished waiting for FSMap version 65 2023-09-23T09:13:04.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.830+0000 7f990dc03b80 10 client.16587 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:13:04.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.830+0000 7f990dc03b80 20 client.16587 populate_metadata read hostname 'smithi082' 2023-09-23T09:13:04.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.830+0000 7f990dc03b80 1 --2- 172.21.15.82:0/1593091246 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5572fd88e2c0 0x5572fd8906e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:13:04.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.830+0000 7f990dc03b80 4 client.16587 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:13:04.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.830+0000 7f990dc03b80 1 -- 172.21.15.82:0/1593091246 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5572fd76a970 con 0x5572fd88e2c0 2023-09-23T09:13:04.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.831+0000 7f98f2ffd700 1 --2- 172.21.15.82:0/1593091246 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5572fd88e2c0 0x5572fd8906e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:13:04.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.831+0000 7f98f2ffd700 1 --2- 172.21.15.82:0/1593091246 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5572fd88e2c0 0x5572fd8906e0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e681cc328d069cad server_cookie=c949c1b2ed73f5b4 in_seq=0 out_seq=0 2023-09-23T09:13:04.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.831+0000 7f98d2ffd700 10 client.16587 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:13:04.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.831+0000 7f98d2ffd700 1 -- 172.21.15.82:0/1593091246 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5572fd76a970 con 0x5572fd88e2c0 2023-09-23T09:13:04.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.831+0000 7f98d2ffd700 10 client.16587 handle_command_reply: tid=0 2023-09-23T09:13:04.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.831+0000 7f990dc03b80 1 client.16587 shutdown 2023-09-23T09:13:04.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.831+0000 7f990dc03b80 1 -- 172.21.15.82:0/1593091246 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5572fd81fc40 msgr2=0x5572fd822220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:13:04.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.831+0000 7f990dc03b80 1 --2- 172.21.15.82:0/1593091246 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5572fd81fc40 0x5572fd822220 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f98e4038040 tx=0x7f98e4005a00 comp rx=0 tx=0).stop 2023-09-23T09:13:04.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.831+0000 7f990dc03b80 1 -- 172.21.15.82:0/1593091246 shutdown_connections 2023-09-23T09:13:04.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.831+0000 7f990dc03b80 1 --2- 172.21.15.82:0/1593091246 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572fd825ca0 0x5572fd820e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:13:04.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.831+0000 7f990dc03b80 1 --2- 172.21.15.82:0/1593091246 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5572fd88e2c0 0x5572fd8906e0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:13:04.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.831+0000 7f990dc03b80 1 --2- 172.21.15.82:0/1593091246 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5572fd81fc40 0x5572fd822220 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:13:04.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.831+0000 7f990dc03b80 1 --2- 172.21.15.82:0/1593091246 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5572fd825380 0x5572fd822760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:13:04.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.831+0000 7f98d2ffd700 0 client.16587 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:13:04.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.831+0000 7f990dc03b80 1 -- 172.21.15.82:0/1593091246 >> 172.21.15.82:0/1593091246 conn(0x5572fd7940e0 msgr2=0x5572fd8142b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:13:04.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.832+0000 7f990dc03b80 1 -- 172.21.15.82:0/1593091246 shutdown_connections 2023-09-23T09:13:04.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.832+0000 7f990dc03b80 1 -- 172.21.15.82:0/1593091246 wait complete. 2023-09-23T09:13:04.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.832+0000 7f990dc03b80 20 client.16587 trim_cache size 0 max 16384 2023-09-23T09:13:04.839 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:13:04.839 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "IDLE (waiting for more scrubs)", 2023-09-23T09:13:04.839 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:13:04.839 INFO:teuthology.orchestra.run.smithi082.stdout: "cba46b77-20dd-437c-a60a-ac01b400e1b8": { 2023-09-23T09:13:04.839 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:13:04.840 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "cba46b77-20dd-437c-a60a-ac01b400e1b8", 2023-09-23T09:13:04.840 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:13:04.840 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:13:04.840 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:13:04.840 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:13:04.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.832+0000 7f98fa1ff700 1 -- 172.21.15.82:0/1963270018 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f98dc0a00c0 msgr2=0x7f98dc0a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:13:04.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.832+0000 7f98fa1ff700 1 --2- 172.21.15.82:0/1963270018 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f98dc0a00c0 0x7f98dc0a2580 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f98e4009c30 tx=0x7f98e4009260 comp rx=0 tx=0).stop 2023-09-23T09:13:04.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.832+0000 7f98fa1ff700 1 -- 172.21.15.82:0/1963270018 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98f4101230 msgr2=0x7f98f419ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:13:04.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.832+0000 7f98fa1ff700 1 --2- 172.21.15.82:0/1963270018 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98f4101230 0x7f98f419ed50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f98e8005910 tx=0x7f98e80047b0 comp rx=0 tx=0).stop 2023-09-23T09:13:04.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.833+0000 7f98fa1ff700 1 -- 172.21.15.82:0/1963270018 shutdown_connections 2023-09-23T09:13:04.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.833+0000 7f98fa1ff700 1 --2- 172.21.15.82:0/1963270018 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f98dc0a00c0 0x7f98dc0a2580 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:13:04.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.833+0000 7f98fa1ff700 1 --2- 172.21.15.82:0/1963270018 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98f4106880 0x7f98f4198880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:13:04.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.833+0000 7f98fa1ff700 1 --2- 172.21.15.82:0/1963270018 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f98f4100870 0x7f98f419e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:13:04.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.833+0000 7f98fa1ff700 1 --2- 172.21.15.82:0/1963270018 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98f4101230 0x7f98f419ed50 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:13:04.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.833+0000 7f98fa1ff700 1 -- 172.21.15.82:0/1963270018 >> 172.21.15.82:0/1963270018 conn(0x7f98f40fc3a0 msgr2=0x7f98f410bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:13:04.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.833+0000 7f98fa1ff700 1 -- 172.21.15.82:0/1963270018 shutdown_connections 2023-09-23T09:13:04.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:04.833+0000 7f98fa1ff700 1 -- 172.21.15.82:0/1963270018 wait complete. 2023-09-23T09:13:04.853 INFO:tasks.cephfs.filesystem:scrub status for tag:cba46b77-20dd-437c-a60a-ac01b400e1b8 - {'path': '/', 'tag': 'cba46b77-20dd-437c-a60a-ac01b400e1b8', 'options': 'recursive,force'} 2023-09-23T09:13:05.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:13:04 smithi135 ceph-mon[99205]: pgmap v506: 97 pgs: 97 active+clean; 7.5 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.0 MiB/s wr, 277 op/s 2023-09-23T09:13:05.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:13:04 smithi082 ceph-mon[97694]: pgmap v506: 97 pgs: 97 active+clean; 7.5 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.0 MiB/s wr, 277 op/s 2023-09-23T09:13:05.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:13:04 smithi161 ceph-mon[99580]: pgmap v506: 97 pgs: 97 active+clean; 7.5 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.0 MiB/s wr, 277 op/s 2023-09-23T09:13:06.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:13:05 smithi135 ceph-mon[99205]: pgmap v507: 97 pgs: 97 active+clean; 7.5 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.5 MiB/s wr, 417 op/s 2023-09-23T09:13:06.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:13:05 smithi082 ceph-mon[97694]: pgmap v507: 97 pgs: 97 active+clean; 7.5 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.5 MiB/s wr, 417 op/s 2023-09-23T09:13:06.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:13:05 smithi161 ceph-mon[99580]: pgmap v507: 97 pgs: 97 active+clean; 7.5 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.5 MiB/s wr, 417 op/s 2023-09-23T09:13:08.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:13:07 smithi082 ceph-mon[97694]: osdmap e108: 12 total, 12 up, 12 in 2023-09-23T09:13:08.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:13:07 smithi082 ceph-mon[97694]: pgmap v509: 97 pgs: 97 active+clean; 7.5 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.5 MiB/s wr, 333 op/s 2023-09-23T09:13:08.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:13:07 smithi161 ceph-mon[99580]: osdmap e108: 12 total, 12 up, 12 in 2023-09-23T09:13:08.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:13:07 smithi161 ceph-mon[99580]: pgmap v509: 97 pgs: 97 active+clean; 7.5 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.5 MiB/s wr, 333 op/s 2023-09-23T09:13:08.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:13:07 smithi135 ceph-mon[99205]: osdmap e108: 12 total, 12 up, 12 in 2023-09-23T09:13:08.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:13:07 smithi135 ceph-mon[99205]: pgmap v509: 97 pgs: 97 active+clean; 7.5 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.5 MiB/s wr, 333 op/s 2023-09-23T09:13:10.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:13:10 smithi161 ceph-mon[99580]: pgmap v510: 97 pgs: 97 active+clean; 7.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.5 MiB/s wr, 334 op/s 2023-09-23T09:13:10.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:13:10 smithi135 ceph-mon[99205]: pgmap v510: 97 pgs: 97 active+clean; 7.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.5 MiB/s wr, 334 op/s 2023-09-23T09:13:10.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:13:10 smithi082 ceph-mon[97694]: pgmap v510: 97 pgs: 97 active+clean; 7.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.5 MiB/s wr, 334 op/s 2023-09-23T09:13:13.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:13:12 smithi135 ceph-mon[99205]: pgmap v511: 97 pgs: 97 active+clean; 7.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.5 MiB/s wr, 334 op/s 2023-09-23T09:13:13.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:13:12 smithi135 ceph-mon[99205]: osdmap e109: 12 total, 12 up, 12 in 2023-09-23T09:13:13.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:13:12 smithi082 ceph-mon[97694]: pgmap v511: 97 pgs: 97 active+clean; 7.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.5 MiB/s wr, 334 op/s 2023-09-23T09:13:13.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:13:12 smithi082 ceph-mon[97694]: osdmap e109: 12 total, 12 up, 12 in 2023-09-23T09:13:13.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:13:12 smithi161 ceph-mon[99580]: pgmap v511: 97 pgs: 97 active+clean; 7.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.5 MiB/s wr, 334 op/s 2023-09-23T09:13:13.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:13:12 smithi161 ceph-mon[99580]: osdmap e109: 12 total, 12 up, 12 in 2023-09-23T09:13:15.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:13:14 smithi135 ceph-mon[99205]: pgmap v513: 97 pgs: 97 active+clean; 7.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 775 KiB/s rd, 2.2 MiB/s wr, 208 op/s 2023-09-23T09:13:15.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:13:14 smithi082 ceph-mon[97694]: pgmap v513: 97 pgs: 97 active+clean; 7.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 775 KiB/s rd, 2.2 MiB/s wr, 208 op/s 2023-09-23T09:13:15.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:13:14 smithi161 ceph-mon[99580]: pgmap v513: 97 pgs: 97 active+clean; 7.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 775 KiB/s rd, 2.2 MiB/s wr, 208 op/s 2023-09-23T09:13:17.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:13:16 smithi135 ceph-mon[99205]: pgmap v514: 97 pgs: 97 active+clean; 7.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.3 MiB/s wr, 389 op/s 2023-09-23T09:13:17.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:13:16 smithi082 ceph-mon[97694]: pgmap v514: 97 pgs: 97 active+clean; 7.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.3 MiB/s wr, 389 op/s 2023-09-23T09:13:17.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:13:16 smithi161 ceph-mon[99580]: pgmap v514: 97 pgs: 97 active+clean; 7.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.3 MiB/s wr, 389 op/s 2023-09-23T09:13:17.401 INFO:teuthology.orchestra.run.smithi082.stderr:40000000 of 50000000 tuples (80%) done (elapsed 952.14 s, remaining 238.04 s) 2023-09-23T09:13:19.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:13:18 smithi135 ceph-mon[99205]: pgmap v515: 97 pgs: 97 active+clean; 7.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.6 MiB/s wr, 331 op/s 2023-09-23T09:13:19.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:13:18 smithi082 ceph-mon[97694]: pgmap v515: 97 pgs: 97 active+clean; 7.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.6 MiB/s wr, 331 op/s 2023-09-23T09:13:19.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:13:18 smithi161 ceph-mon[99580]: pgmap v515: 97 pgs: 97 active+clean; 7.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.6 MiB/s wr, 331 op/s 2023-09-23T09:13:21.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:13:20 smithi135 ceph-mon[99205]: pgmap v516: 97 pgs: 97 active+clean; 7.5 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.1 MiB/s wr, 356 op/s 2023-09-23T09:13:21.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:13:20 smithi082 ceph-mon[97694]: pgmap v516: 97 pgs: 97 active+clean; 7.5 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.1 MiB/s wr, 356 op/s 2023-09-23T09:13:21.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:13:20 smithi161 ceph-mon[99580]: pgmap v516: 97 pgs: 97 active+clean; 7.5 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.1 MiB/s wr, 356 op/s 2023-09-23T09:13:21.771 INFO:teuthology.orchestra.run.smithi082.stderr:40100000 of 50000000 tuples (80%) done (elapsed 956.51 s, remaining 236.15 s) 2023-09-23T09:13:23.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:13:22 smithi135 ceph-mon[99205]: pgmap v517: 97 pgs: 97 active+clean; 7.5 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.1 MiB/s wr, 356 op/s 2023-09-23T09:13:23.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:13:22 smithi082 ceph-mon[97694]: pgmap v517: 97 pgs: 97 active+clean; 7.5 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.1 MiB/s wr, 356 op/s 2023-09-23T09:13:23.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:13:22 smithi161 ceph-mon[99580]: pgmap v517: 97 pgs: 97 active+clean; 7.5 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.1 MiB/s wr, 356 op/s 2023-09-23T09:13:25.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:13:24 smithi135 ceph-mon[99205]: pgmap v518: 97 pgs: 97 active+clean; 7.5 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.5 MiB/s wr, 306 op/s 2023-09-23T09:13:25.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:13:24 smithi082 ceph-mon[97694]: pgmap v518: 97 pgs: 97 active+clean; 7.5 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.5 MiB/s wr, 306 op/s 2023-09-23T09:13:25.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:13:24 smithi161 ceph-mon[99580]: pgmap v518: 97 pgs: 97 active+clean; 7.5 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.5 MiB/s wr, 306 op/s 2023-09-23T09:13:26.159 INFO:teuthology.orchestra.run.smithi082.stderr:40200000 of 50000000 tuples (80%) done (elapsed 960.90 s, remaining 234.25 s) 2023-09-23T09:13:27.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:13:26 smithi135 ceph-mon[99205]: pgmap v519: 97 pgs: 97 active+clean; 7.5 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 5.9 MiB/s wr, 400 op/s 2023-09-23T09:13:27.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:13:26 smithi082 ceph-mon[97694]: pgmap v519: 97 pgs: 97 active+clean; 7.5 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 5.9 MiB/s wr, 400 op/s 2023-09-23T09:13:27.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:13:26 smithi161 ceph-mon[99580]: pgmap v519: 97 pgs: 97 active+clean; 7.5 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 5.9 MiB/s wr, 400 op/s 2023-09-23T09:13:27.456 INFO:teuthology.orchestra.run.smithi082.stderr:40300000 of 50000000 tuples (80%) done (elapsed 962.20 s, remaining 231.60 s) 2023-09-23T09:13:28.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:13:27 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:13:28.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:13:27 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:13:28.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:13:27 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:13:28.725 INFO:teuthology.orchestra.run.smithi082.stderr:40400000 of 50000000 tuples (80%) done (elapsed 963.47 s, remaining 228.94 s) 2023-09-23T09:13:29.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:13:28 smithi135 ceph-mon[99205]: pgmap v520: 97 pgs: 97 active+clean; 7.5 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 460 KiB/s rd, 4.4 MiB/s wr, 262 op/s 2023-09-23T09:13:29.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:13:28 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:13:29.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:13:28 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:13:29.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:13:28 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:13:29.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:13:28 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:13:29.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:13:28 smithi082 ceph-mon[97694]: pgmap v520: 97 pgs: 97 active+clean; 7.5 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 460 KiB/s rd, 4.4 MiB/s wr, 262 op/s 2023-09-23T09:13:29.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:13:28 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:13:29.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:13:28 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:13:29.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:13:28 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:13:29.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:13:28 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:13:29.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:13:28 smithi161 ceph-mon[99580]: pgmap v520: 97 pgs: 97 active+clean; 7.5 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 460 KiB/s rd, 4.4 MiB/s wr, 262 op/s 2023-09-23T09:13:29.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:13:28 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:13:29.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:13:28 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:13:29.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:13:28 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:13:29.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:13:28 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:13:29.924 INFO:teuthology.orchestra.run.smithi082.stderr:40500000 of 50000000 tuples (81%) done (elapsed 964.67 s, remaining 226.28 s) 2023-09-23T09:13:31.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:13:30 smithi135 ceph-mon[99205]: pgmap v521: 97 pgs: 97 active+clean; 7.6 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 581 KiB/s rd, 14 MiB/s wr, 297 op/s 2023-09-23T09:13:31.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:13:30 smithi082 ceph-mon[97694]: pgmap v521: 97 pgs: 97 active+clean; 7.6 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 581 KiB/s rd, 14 MiB/s wr, 297 op/s 2023-09-23T09:13:31.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:13:30 smithi161 ceph-mon[99580]: pgmap v521: 97 pgs: 97 active+clean; 7.6 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 581 KiB/s rd, 14 MiB/s wr, 297 op/s 2023-09-23T09:13:31.173 INFO:teuthology.orchestra.run.smithi082.stderr:40600000 of 50000000 tuples (81%) done (elapsed 965.92 s, remaining 223.64 s) 2023-09-23T09:13:32.393 INFO:teuthology.orchestra.run.smithi082.stderr:40700000 of 50000000 tuples (81%) done (elapsed 967.14 s, remaining 220.99 s) 2023-09-23T09:13:33.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:13:32 smithi135 ceph-mon[99205]: pgmap v522: 97 pgs: 97 active+clean; 7.6 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 12 MiB/s wr, 138 op/s 2023-09-23T09:13:33.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:13:32 smithi082 ceph-mon[97694]: pgmap v522: 97 pgs: 97 active+clean; 7.6 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 12 MiB/s wr, 138 op/s 2023-09-23T09:13:33.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:13:32 smithi161 ceph-mon[99580]: pgmap v522: 97 pgs: 97 active+clean; 7.6 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 12 MiB/s wr, 138 op/s 2023-09-23T09:13:33.642 INFO:teuthology.orchestra.run.smithi082.stderr:40800000 of 50000000 tuples (81%) done (elapsed 968.39 s, remaining 218.36 s) 2023-09-23T09:13:34.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:13:33 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:13:34.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:13:33 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:13:34.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:13:33 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:13:34.854 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:13:34.964 INFO:teuthology.orchestra.run.smithi082.stderr:40900000 of 50000000 tuples (81%) done (elapsed 969.71 s, remaining 215.75 s) 2023-09-23T09:13:35.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:13:34 smithi135 ceph-mon[99205]: pgmap v523: 97 pgs: 97 active+clean; 7.6 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 12 MiB/s wr, 138 op/s 2023-09-23T09:13:35.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.083+0000 7f4682f9d700 1 -- 172.21.15.82:0/553308630 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f467c1010b0 msgr2=0x7f467c10d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:13:35.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.083+0000 7f4682f9d700 1 --2- 172.21.15.82:0/553308630 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f467c1010b0 0x7f467c10d5c0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f467400b0a0 tx=0x7f467400b3b0 comp rx=0 tx=0).stop 2023-09-23T09:13:35.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.083+0000 7f4682f9d700 1 -- 172.21.15.82:0/553308630 shutdown_connections 2023-09-23T09:13:35.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.083+0000 7f4682f9d700 1 --2- 172.21.15.82:0/553308630 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f467c1010b0 0x7f467c10d5c0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:13:35.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.083+0000 7f4682f9d700 1 --2- 172.21.15.82:0/553308630 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f467c106700 0x7f467c106ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:13:35.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.083+0000 7f4682f9d700 1 --2- 172.21.15.82:0/553308630 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f467c1006f0 0x7f467c100b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:13:35.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.083+0000 7f4682f9d700 1 -- 172.21.15.82:0/553308630 >> 172.21.15.82:0/553308630 conn(0x7f467c0fc1c0 msgr2=0x7f467c0fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:13:35.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.083+0000 7f4682f9d700 1 -- 172.21.15.82:0/553308630 shutdown_connections 2023-09-23T09:13:35.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.083+0000 7f4682f9d700 1 -- 172.21.15.82:0/553308630 wait complete. 2023-09-23T09:13:35.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.085+0000 7f4682f9d700 1 Processor -- start 2023-09-23T09:13:35.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.085+0000 7f4682f9d700 1 -- start start 2023-09-23T09:13:35.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.085+0000 7f4682f9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f467c1006f0 0x7f467c19e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:13:35.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.085+0000 7f4682f9d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f467c1010b0 0x7f467c19ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:13:35.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.085+0000 7f4682f9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f467c106700 0x7f467c198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:13:35.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.085+0000 7f4682f9d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f467c198d40 con 0x7f467c1006f0 2023-09-23T09:13:35.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.085+0000 7f4682f9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f467c198eb0 con 0x7f467c106700 2023-09-23T09:13:35.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.085+0000 7f4682f9d700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f467c199070 con 0x7f467c1010b0 2023-09-23T09:13:35.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.086+0000 7f4681f9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f467c1006f0 0x7f467c19e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:13:35.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.086+0000 7f468179a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f467c1010b0 0x7f467c19ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:13:35.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.086+0000 7f468279c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f467c106700 0x7f467c198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:13:35.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.086+0000 7f468179a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f467c1010b0 0x7f467c19ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:50048/0 (socket says 172.21.15.82:50048) 2023-09-23T09:13:35.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.086+0000 7f4681f9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f467c1006f0 0x7f467c19e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47118/0 (socket says 172.21.15.82:47118) 2023-09-23T09:13:35.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.086+0000 7f468179a700 1 -- 172.21.15.82:0/4056246804 learned_addr learned my addr 172.21.15.82:0/4056246804 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:13:35.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.086+0000 7f468179a700 1 -- 172.21.15.82:0/4056246804 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f467c106700 msgr2=0x7f467c198570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:13:35.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.086+0000 7f468179a700 1 --2- 172.21.15.82:0/4056246804 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f467c106700 0x7f467c198570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:13:35.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.086+0000 7f468179a700 1 -- 172.21.15.82:0/4056246804 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f467c1006f0 msgr2=0x7f467c19e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:13:35.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.086+0000 7f468179a700 1 --2- 172.21.15.82:0/4056246804 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f467c1006f0 0x7f467c19e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:13:35.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.086+0000 7f468179a700 1 -- 172.21.15.82:0/4056246804 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4674009d00 con 0x7f467c1010b0 2023-09-23T09:13:35.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.086+0000 7f4681f9b700 1 --2- 172.21.15.82:0/4056246804 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f467c1006f0 0x7f467c19e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:13:35.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.086+0000 7f468279c700 1 --2- 172.21.15.82:0/4056246804 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f467c106700 0x7f467c198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:13:35.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.086+0000 7f468179a700 1 --2- 172.21.15.82:0/4056246804 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f467c1010b0 0x7f467c19ead0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f466c00e9a0 tx=0x7f466c00ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:13:35.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.087+0000 7f4672ffd700 1 -- 172.21.15.82:0/4056246804 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f466c009790 con 0x7f467c1010b0 2023-09-23T09:13:35.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.087+0000 7f4682f9d700 1 -- 172.21.15.82:0/4056246804 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f467c199350 con 0x7f467c1010b0 2023-09-23T09:13:35.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.087+0000 7f4672ffd700 1 -- 172.21.15.82:0/4056246804 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f466c010430 con 0x7f467c1010b0 2023-09-23T09:13:35.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.087+0000 7f4672ffd700 1 -- 172.21.15.82:0/4056246804 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f466c00cea0 con 0x7f467c1010b0 2023-09-23T09:13:35.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.087+0000 7f4682f9d700 1 -- 172.21.15.82:0/4056246804 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f467c1a5560 con 0x7f467c1010b0 2023-09-23T09:13:35.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.090+0000 7f4672ffd700 1 -- 172.21.15.82:0/4056246804 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f466c0105a0 con 0x7f467c1010b0 2023-09-23T09:13:35.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.092+0000 7f4697a7eb80 1 Processor -- start 2023-09-23T09:13:35.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.092+0000 7f4697a7eb80 1 -- start start 2023-09-23T09:13:35.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.093+0000 7f4672ffd700 1 --2- 172.21.15.82:0/4056246804 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f46680a01e0 0x7f46680a26a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:13:35.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.093+0000 7f4697a7eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562ecc2f3500 0x562ecc2f38e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:13:35.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.093+0000 7f4697a7eb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562ecc2f3e20 0x562ecc2ed700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:13:35.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.093+0000 7f4697a7eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562ecc2edc40 0x562ecc2ee080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:13:35.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.093+0000 7f4697a7eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ecc2557b0 con 0x562ecc2edc40 2023-09-23T09:13:35.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.093+0000 7f4697a7eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ecc246780 con 0x562ecc2f3500 2023-09-23T09:13:35.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.093+0000 7f4697a7eb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ecc2440a0 con 0x562ecc2f3e20 2023-09-23T09:13:35.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.093+0000 7f4672ffd700 1 -- 172.21.15.82:0/4056246804 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f466c014070 con 0x7f467c1010b0 2023-09-23T09:13:35.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.093+0000 7f468279c700 1 --2- 172.21.15.82:0/4056246804 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f46680a01e0 0x7f46680a26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:13:35.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.093+0000 7f468179a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562ecc2f3e20 0x562ecc2ed700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:13:35.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.093+0000 7f4681f9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562ecc2f3500 0x562ecc2f38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:13:35.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.093+0000 7f468179a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562ecc2f3e20 0x562ecc2ed700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:50052/0 (socket says 172.21.15.82:50052) 2023-09-23T09:13:35.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.093+0000 7f468179a700 1 -- 172.21.15.82:0/1836101900 learned_addr learned my addr 172.21.15.82:0/1836101900 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:13:35.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.093+0000 7f468279c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562ecc2edc40 0x562ecc2ee080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:13:35.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.094+0000 7f468179a700 1 -- 172.21.15.82:0/1836101900 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562ecc2f3500 msgr2=0x562ecc2f38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:13:35.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.094+0000 7f468179a700 1 --2- 172.21.15.82:0/1836101900 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562ecc2f3500 0x562ecc2f38e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:13:35.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.094+0000 7f468179a700 1 -- 172.21.15.82:0/1836101900 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562ecc2edc40 msgr2=0x562ecc2ee080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:13:35.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.094+0000 7f468179a700 1 --2- 172.21.15.82:0/1836101900 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562ecc2edc40 0x562ecc2ee080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:13:35.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.094+0000 7f468179a700 1 -- 172.21.15.82:0/1836101900 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562ecc0bf630 con 0x562ecc2f3e20 2023-09-23T09:13:35.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.094+0000 7f4681f9b700 1 --2- 172.21.15.82:0/1836101900 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562ecc2f3500 0x562ecc2f38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:13:35.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.094+0000 7f468179a700 1 --2- 172.21.15.82:0/1836101900 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562ecc2f3e20 0x562ecc2ed700 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f466c0958c0 tx=0x7f466c011f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9fb34e546aec5148 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:13:35.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.094+0000 7f468279c700 1 --2- 172.21.15.82:0/4056246804 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f46680a01e0 0x7f46680a26a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f467c19f220 tx=0x7f467400bab0 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:13:35.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.094+0000 7f4667fff700 1 -- 172.21.15.82:0/1836101900 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f466c07f160 con 0x562ecc2f3e20 2023-09-23T09:13:35.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.094+0000 7f4667fff700 1 -- 172.21.15.82:0/1836101900 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f466c099550 con 0x562ecc2f3e20 2023-09-23T09:13:35.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.094+0000 7f4667fff700 1 -- 172.21.15.82:0/1836101900 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f466c0971f0 con 0x562ecc2f3e20 2023-09-23T09:13:35.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.095+0000 7f4697a7eb80 1 -- 172.21.15.82:0/1836101900 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562ecc2f3e20 msgr2=0x562ecc2ed700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:13:35.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.095+0000 7f4697a7eb80 1 --2- 172.21.15.82:0/1836101900 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562ecc2f3e20 0x562ecc2ed700 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f466c0958c0 tx=0x7f466c011f90 comp rx=0 tx=0).stop 2023-09-23T09:13:35.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.095+0000 7f4697a7eb80 1 -- 172.21.15.82:0/1836101900 shutdown_connections 2023-09-23T09:13:35.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.095+0000 7f4697a7eb80 1 --2- 172.21.15.82:0/1836101900 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562ecc2edc40 0x562ecc2ee080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:13:35.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.095+0000 7f4697a7eb80 1 --2- 172.21.15.82:0/1836101900 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562ecc2f3500 0x562ecc2f38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:13:35.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.095+0000 7f4697a7eb80 1 --2- 172.21.15.82:0/1836101900 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562ecc2f3e20 0x562ecc2ed700 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:13:35.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.095+0000 7f4697a7eb80 1 -- 172.21.15.82:0/1836101900 >> 172.21.15.82:0/1836101900 conn(0x562ecc2620e0 msgr2=0x562ecc2e8940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:13:35.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.095+0000 7f4697a7eb80 1 -- 172.21.15.82:0/1836101900 shutdown_connections 2023-09-23T09:13:35.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.095+0000 7f4697a7eb80 1 -- 172.21.15.82:0/1836101900 wait complete. 2023-09-23T09:13:35.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.096+0000 7f4697a7eb80 1 -- start start 2023-09-23T09:13:35.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.096+0000 7f4697a7eb80 1 Processor -- start 2023-09-23T09:13:35.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.096+0000 7f4697a7eb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562ecc2edc40 0x562ecc2f7120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:13:35.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.096+0000 7f4697a7eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562ecc2f3500 0x562ecc2f7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:13:35.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.096+0000 7f4697a7eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562ecc2f3e20 0x562ecc2f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:13:35.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.096+0000 7f4697a7eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ecc23f990 con 0x562ecc2f3500 2023-09-23T09:13:35.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.096+0000 7f4697a7eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ecc1ddbb0 con 0x562ecc2f3e20 2023-09-23T09:13:35.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.096+0000 7f4697a7eb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ecc1dd8b0 con 0x562ecc2edc40 2023-09-23T09:13:35.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.096+0000 7f4697a7eb80 10 client.0 _ll_register_callbacks cb 0x562ecc127a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:13:35.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.097+0000 7f4681f9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562ecc2edc40 0x562ecc2f7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:13:35.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.097+0000 7f468179a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562ecc2f3500 0x562ecc2f7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:13:35.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.097+0000 7f4681f9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562ecc2edc40 0x562ecc2f7120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:50060/0 (socket says 172.21.15.82:50060) 2023-09-23T09:13:35.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.097+0000 7f4681f9b700 1 -- 172.21.15.82:0/2478063357 learned_addr learned my addr 172.21.15.82:0/2478063357 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:13:35.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.097+0000 7f468279c700 1 --2- 172.21.15.82:0/2478063357 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562ecc2f3e20 0x562ecc2f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:13:35.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.097+0000 7f468179a700 1 -- 172.21.15.82:0/2478063357 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562ecc2edc40 msgr2=0x562ecc2f7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:13:35.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.097+0000 7f468179a700 1 --2- 172.21.15.82:0/2478063357 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562ecc2edc40 0x562ecc2f7120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:13:35.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.097+0000 7f468179a700 1 -- 172.21.15.82:0/2478063357 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562ecc2f3e20 msgr2=0x562ecc2f7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:13:35.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.097+0000 7f468179a700 1 --2- 172.21.15.82:0/2478063357 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562ecc2f3e20 0x562ecc2f7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:13:35.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.097+0000 7f468179a700 1 -- 172.21.15.82:0/2478063357 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4678009c90 con 0x562ecc2f3500 2023-09-23T09:13:35.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.097+0000 7f468179a700 1 --2- 172.21.15.82:0/2478063357 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562ecc2f3500 0x562ecc2f7660 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f466c09ce40 tx=0x7f466c098d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52cb0f32d77ad944 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:13:35.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.097+0000 7f46657fa700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:13:35.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.097+0000 7f46657fa700 1 -- 172.21.15.82:0/2478063357 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f466c0992b0 con 0x562ecc2f3500 2023-09-23T09:13:35.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.097+0000 7f4697a7eb80 1 -- 172.21.15.82:0/2478063357 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562ecc2bd1c0 con 0x562ecc2f3500 2023-09-23T09:13:35.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.097+0000 7f46657fa700 1 -- 172.21.15.82:0/2478063357 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f466c0b6e40 con 0x562ecc2f3500 2023-09-23T09:13:35.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.098+0000 7f46657fa700 1 -- 172.21.15.82:0/2478063357 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=67) v2 ==== 24+0+0 (secure 0 0 0) 0x7f466c0c9320 con 0x562ecc2f3500 2023-09-23T09:13:35.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.098+0000 7f4697a7eb80 10 client.16599 fetch_fsmap learned FSMap version 67 2023-09-23T09:13:35.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.098+0000 7f4697a7eb80 1 -- 172.21.15.82:0/2478063357 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=67,monmap=4+}) v3 -- 0x7f467c1a5560 con 0x562ecc2f3500 2023-09-23T09:13:35.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.098+0000 7f46657fa700 1 -- 172.21.15.82:0/2478063357 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562ecc2bd1c0 con 0x562ecc2f3500 2023-09-23T09:13:35.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.098+0000 7f46657fa700 1 -- 172.21.15.82:0/2478063357 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 67) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f466c077d20 con 0x562ecc2f3500 2023-09-23T09:13:35.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.098+0000 7f4697a7eb80 10 client.16599 fetch_fsmap finished waiting for FSMap version 67 2023-09-23T09:13:35.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.098+0000 7f4697a7eb80 10 client.16599 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:13:35.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.098+0000 7f4697a7eb80 20 client.16599 populate_metadata read hostname 'smithi082' 2023-09-23T09:13:35.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.098+0000 7f4697a7eb80 1 --2- 172.21.15.82:0/2478063357 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x562ecc3074a0 0x562ecc309890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:13:35.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.098+0000 7f4697a7eb80 4 client.16599 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:13:35.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.098+0000 7f4697a7eb80 1 -- 172.21.15.82:0/2478063357 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562ecc1e5ba0 con 0x562ecc3074a0 2023-09-23T09:13:35.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.099+0000 7f4681f9b700 1 --2- 172.21.15.82:0/2478063357 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x562ecc3074a0 0x562ecc309890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:13:35.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.099+0000 7f46657fa700 10 client.16599 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:13:35.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.099+0000 7f4681f9b700 1 --2- 172.21.15.82:0/2478063357 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x562ecc3074a0 0x562ecc309890 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e84dba72ed05101 server_cookie=e1bfb5d0db77f977 in_seq=0 out_seq=0 2023-09-23T09:13:35.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.100+0000 7f46657fa700 1 -- 172.21.15.82:0/2478063357 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x562ecc1e5ba0 con 0x562ecc3074a0 2023-09-23T09:13:35.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.100+0000 7f46657fa700 10 client.16599 handle_command_reply: tid=0 2023-09-23T09:13:35.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.100+0000 7f4697a7eb80 1 client.16599 shutdown 2023-09-23T09:13:35.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.100+0000 7f4697a7eb80 1 -- 172.21.15.82:0/2478063357 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562ecc2f3500 msgr2=0x562ecc2f7660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:13:35.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.100+0000 7f4697a7eb80 1 --2- 172.21.15.82:0/2478063357 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562ecc2f3500 0x562ecc2f7660 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f466c09ce40 tx=0x7f466c098d50 comp rx=0 tx=0).stop 2023-09-23T09:13:35.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.101+0000 7f4697a7eb80 1 -- 172.21.15.82:0/2478063357 shutdown_connections 2023-09-23T09:13:35.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.101+0000 7f4697a7eb80 1 --2- 172.21.15.82:0/2478063357 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562ecc2f3e20 0x562ecc2f7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:13:35.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.101+0000 7f4697a7eb80 1 --2- 172.21.15.82:0/2478063357 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562ecc2edc40 0x562ecc2f7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:13:35.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.101+0000 7f4697a7eb80 1 --2- 172.21.15.82:0/2478063357 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x562ecc3074a0 0x562ecc309890 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:13:35.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.101+0000 7f4697a7eb80 1 --2- 172.21.15.82:0/2478063357 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562ecc2f3500 0x562ecc2f7660 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:13:35.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.101+0000 7f4697a7eb80 1 -- 172.21.15.82:0/2478063357 >> 172.21.15.82:0/2478063357 conn(0x562ecc2620e0 msgr2=0x562ecc2e84d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:13:35.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.101+0000 7f46657fa700 0 client.16599 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:13:35.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.101+0000 7f4697a7eb80 1 -- 172.21.15.82:0/2478063357 shutdown_connections 2023-09-23T09:13:35.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.101+0000 7f4697a7eb80 1 -- 172.21.15.82:0/2478063357 wait complete. 2023-09-23T09:13:35.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.101+0000 7f4697a7eb80 20 client.16599 trim_cache size 0 max 16384 2023-09-23T09:13:35.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:13:34 smithi082 ceph-mon[97694]: pgmap v523: 97 pgs: 97 active+clean; 7.6 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 12 MiB/s wr, 138 op/s 2023-09-23T09:13:35.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.119+0000 7f4697a7eb80 1 Processor -- start 2023-09-23T09:13:35.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.119+0000 7f4697a7eb80 1 -- start start 2023-09-23T09:13:35.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.119+0000 7f4697a7eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562ecc2edc40 0x562ecc2ed700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:13:35.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.119+0000 7f4697a7eb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562ecc2f3500 0x562ecc2fe9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:13:35.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.119+0000 7f4697a7eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562ecc2f3e20 0x562ecc2ee020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:13:35.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.119+0000 7f4697a7eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ecc0c1920 con 0x562ecc2edc40 2023-09-23T09:13:35.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.119+0000 7f4697a7eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ecc2f9d20 con 0x562ecc2f3e20 2023-09-23T09:13:35.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.119+0000 7f4697a7eb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ecc2e95d0 con 0x562ecc2f3500 2023-09-23T09:13:35.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.120+0000 7f4681f9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562ecc2edc40 0x562ecc2ed700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:13:35.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.120+0000 7f468179a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562ecc2f3500 0x562ecc2fe9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:13:35.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.120+0000 7f4681f9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562ecc2edc40 0x562ecc2ed700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47148/0 (socket says 172.21.15.82:47148) 2023-09-23T09:13:35.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.120+0000 7f4681f9b700 1 -- 172.21.15.82:0/2091718017 learned_addr learned my addr 172.21.15.82:0/2091718017 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:13:35.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.120+0000 7f468279c700 1 --2- 172.21.15.82:0/2091718017 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562ecc2f3e20 0x562ecc2ee020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:13:35.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.120+0000 7f4681f9b700 1 -- 172.21.15.82:0/2091718017 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562ecc2f3500 msgr2=0x562ecc2fe9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:13:35.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.120+0000 7f4681f9b700 1 --2- 172.21.15.82:0/2091718017 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562ecc2f3500 0x562ecc2fe9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:13:35.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.120+0000 7f4681f9b700 1 -- 172.21.15.82:0/2091718017 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562ecc2f3e20 msgr2=0x562ecc2ee020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:13:35.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.120+0000 7f4681f9b700 1 --2- 172.21.15.82:0/2091718017 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562ecc2f3e20 0x562ecc2ee020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:13:35.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.120+0000 7f4681f9b700 1 -- 172.21.15.82:0/2091718017 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562ecc06bde0 con 0x562ecc2edc40 2023-09-23T09:13:35.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.120+0000 7f468179a700 1 --2- 172.21.15.82:0/2091718017 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562ecc2f3500 0x562ecc2fe9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:13:35.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.120+0000 7f4681f9b700 1 --2- 172.21.15.82:0/2091718017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562ecc2edc40 0x562ecc2ed700 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f4678009fc0 tx=0x7f4678009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3acfba11cc43bed4 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:13:35.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.121+0000 7f4670ff9700 1 -- 172.21.15.82:0/2091718017 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4678017040 con 0x562ecc2edc40 2023-09-23T09:13:35.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.121+0000 7f4670ff9700 1 -- 172.21.15.82:0/2091718017 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4678010e60 con 0x562ecc2edc40 2023-09-23T09:13:35.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.121+0000 7f4670ff9700 1 -- 172.21.15.82:0/2091718017 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4678003970 con 0x562ecc2edc40 2023-09-23T09:13:35.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.121+0000 7f4697a7eb80 1 -- 172.21.15.82:0/2091718017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562ecc2edc40 msgr2=0x562ecc2ed700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:13:35.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.121+0000 7f4697a7eb80 1 --2- 172.21.15.82:0/2091718017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562ecc2edc40 0x562ecc2ed700 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f4678009fc0 tx=0x7f4678009260 comp rx=0 tx=0).stop 2023-09-23T09:13:35.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.122+0000 7f4697a7eb80 1 -- 172.21.15.82:0/2091718017 shutdown_connections 2023-09-23T09:13:35.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.122+0000 7f4697a7eb80 1 --2- 172.21.15.82:0/2091718017 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562ecc2f3e20 0x562ecc2ee020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:13:35.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.122+0000 7f4697a7eb80 1 --2- 172.21.15.82:0/2091718017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562ecc2edc40 0x562ecc2ed700 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:13:35.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.122+0000 7f4697a7eb80 1 --2- 172.21.15.82:0/2091718017 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562ecc2f3500 0x562ecc2fe9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:13:35.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.122+0000 7f4697a7eb80 1 -- 172.21.15.82:0/2091718017 >> 172.21.15.82:0/2091718017 conn(0x562ecc2620e0 msgr2=0x562ecc2f12f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:13:35.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.122+0000 7f4697a7eb80 1 -- 172.21.15.82:0/2091718017 shutdown_connections 2023-09-23T09:13:35.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.122+0000 7f4697a7eb80 1 -- 172.21.15.82:0/2091718017 wait complete. 2023-09-23T09:13:35.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.122+0000 7f4697a7eb80 1 -- start start 2023-09-23T09:13:35.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.122+0000 7f4697a7eb80 1 Processor -- start 2023-09-23T09:13:35.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.123+0000 7f4697a7eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562ecc2edc40 0x562ecc2fc980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:13:35.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.123+0000 7f4697a7eb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562ecc2f3500 0x562ecc2fcec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:13:35.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.123+0000 7f4697a7eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562ecc2f3e20 0x562ecc35a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:13:35.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.123+0000 7f4697a7eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ecc2fd6d0 con 0x562ecc2f3e20 2023-09-23T09:13:35.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.123+0000 7f4697a7eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ecc2fd840 con 0x562ecc2edc40 2023-09-23T09:13:35.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.123+0000 7f4697a7eb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ecc35a770 con 0x562ecc2f3500 2023-09-23T09:13:35.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.123+0000 7f4697a7eb80 10 client.0 _ll_register_callbacks cb 0x7f466c005ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:13:35.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.123+0000 7f468179a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562ecc2f3500 0x562ecc2fcec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:13:35.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.123+0000 7f468279c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562ecc2f3e20 0x562ecc35a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:13:35.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.123+0000 7f468179a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562ecc2f3500 0x562ecc2fcec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:50072/0 (socket says 172.21.15.82:50072) 2023-09-23T09:13:35.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.123+0000 7f468179a700 1 -- 172.21.15.82:0/1953404871 learned_addr learned my addr 172.21.15.82:0/1953404871 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:13:35.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.123+0000 7f4681f9b700 1 --2- 172.21.15.82:0/1953404871 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562ecc2edc40 0x562ecc2fc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:13:35.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.124+0000 7f468179a700 1 -- 172.21.15.82:0/1953404871 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562ecc2edc40 msgr2=0x562ecc2fc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:13:35.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.124+0000 7f468179a700 1 --2- 172.21.15.82:0/1953404871 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562ecc2edc40 0x562ecc2fc980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:13:35.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.124+0000 7f468179a700 1 -- 172.21.15.82:0/1953404871 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562ecc2f3e20 msgr2=0x562ecc35a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:13:35.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.124+0000 7f468179a700 1 --2- 172.21.15.82:0/1953404871 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562ecc2f3e20 0x562ecc35a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:13:35.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.124+0000 7f468179a700 1 -- 172.21.15.82:0/1953404871 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f467c1a5560 con 0x562ecc2f3500 2023-09-23T09:13:35.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.124+0000 7f468179a700 1 --2- 172.21.15.82:0/1953404871 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562ecc2f3500 0x562ecc2fcec0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f466c0958c0 tx=0x7f466c099360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e87c7020615ccb81 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:13:35.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.124+0000 7f46657fa700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T09:13:35.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.124+0000 7f46657fa700 1 -- 172.21.15.82:0/1953404871 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f466c0c9320 con 0x562ecc2f3500 2023-09-23T09:13:35.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.124+0000 7f46657fa700 1 -- 172.21.15.82:0/1953404871 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f466c0b6e40 con 0x562ecc2f3500 2023-09-23T09:13:35.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.124+0000 7f4697a7eb80 1 -- 172.21.15.82:0/1953404871 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562ecc2e08b0 con 0x562ecc2f3500 2023-09-23T09:13:35.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.124+0000 7f46657fa700 1 -- 172.21.15.82:0/1953404871 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=67) v2 ==== 24+0+0 (secure 0 0 0) 0x7f466c0987b0 con 0x562ecc2f3500 2023-09-23T09:13:35.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.124+0000 7f4697a7eb80 10 client.26338 fetch_fsmap learned FSMap version 67 2023-09-23T09:13:35.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.124+0000 7f4697a7eb80 1 -- 172.21.15.82:0/1953404871 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=67,monmap=4+}) v3 -- 0x562ecc054c60 con 0x562ecc2f3500 2023-09-23T09:13:35.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.125+0000 7f46657fa700 1 -- 172.21.15.82:0/1953404871 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562ecc2e08b0 con 0x562ecc2f3500 2023-09-23T09:13:35.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.125+0000 7f46657fa700 1 -- 172.21.15.82:0/1953404871 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 67) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f466c077d20 con 0x562ecc2f3500 2023-09-23T09:13:35.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.125+0000 7f4697a7eb80 10 client.26338 fetch_fsmap finished waiting for FSMap version 67 2023-09-23T09:13:35.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.125+0000 7f4697a7eb80 10 client.26338 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:13:35.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.125+0000 7f4697a7eb80 20 client.26338 populate_metadata read hostname 'smithi082' 2023-09-23T09:13:35.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.125+0000 7f4697a7eb80 1 --2- 172.21.15.82:0/1953404871 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x562ecc35bad0 0x562ecc35def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:13:35.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.125+0000 7f4697a7eb80 4 client.26338 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:13:35.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.125+0000 7f4697a7eb80 1 -- 172.21.15.82:0/1953404871 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x562ecc238970 con 0x562ecc35bad0 2023-09-23T09:13:35.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.125+0000 7f4681f9b700 1 --2- 172.21.15.82:0/1953404871 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x562ecc35bad0 0x562ecc35def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:13:35.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.126+0000 7f4681f9b700 1 --2- 172.21.15.82:0/1953404871 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x562ecc35bad0 0x562ecc35def0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=941023ca0efd19cf server_cookie=9f0a9477e30ac15e in_seq=0 out_seq=0 2023-09-23T09:13:35.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.126+0000 7f46657fa700 10 client.26338 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:13:35.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.126+0000 7f46657fa700 1 -- 172.21.15.82:0/1953404871 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x562ecc238970 con 0x562ecc35bad0 2023-09-23T09:13:35.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.126+0000 7f46657fa700 10 client.26338 handle_command_reply: tid=0 2023-09-23T09:13:35.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.126+0000 7f4697a7eb80 1 client.26338 shutdown 2023-09-23T09:13:35.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.126+0000 7f4697a7eb80 1 -- 172.21.15.82:0/1953404871 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562ecc2f3500 msgr2=0x562ecc2fcec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:13:35.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.126+0000 7f4697a7eb80 1 --2- 172.21.15.82:0/1953404871 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562ecc2f3500 0x562ecc2fcec0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f466c0958c0 tx=0x7f466c099360 comp rx=0 tx=0).stop 2023-09-23T09:13:35.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.126+0000 7f4697a7eb80 1 -- 172.21.15.82:0/1953404871 shutdown_connections 2023-09-23T09:13:35.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.126+0000 7f4697a7eb80 1 --2- 172.21.15.82:0/1953404871 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x562ecc35bad0 0x562ecc35def0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:13:35.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.126+0000 7f4697a7eb80 1 --2- 172.21.15.82:0/1953404871 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562ecc2f3e20 0x562ecc35a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:13:35.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.126+0000 7f46657fa700 0 client.26338 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:13:35.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.126+0000 7f4697a7eb80 1 --2- 172.21.15.82:0/1953404871 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562ecc2edc40 0x562ecc2fc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:13:35.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.126+0000 7f4697a7eb80 1 --2- 172.21.15.82:0/1953404871 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562ecc2f3500 0x562ecc2fcec0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:13:35.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.126+0000 7f4697a7eb80 1 -- 172.21.15.82:0/1953404871 >> 172.21.15.82:0/1953404871 conn(0x562ecc2620e0 msgr2=0x562ecc2ee020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:13:35.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.126+0000 7f4697a7eb80 1 -- 172.21.15.82:0/1953404871 shutdown_connections 2023-09-23T09:13:35.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.127+0000 7f4697a7eb80 1 -- 172.21.15.82:0/1953404871 wait complete. 2023-09-23T09:13:35.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.127+0000 7f4697a7eb80 20 client.26338 trim_cache size 0 max 16384 2023-09-23T09:13:35.135 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:13:35.135 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "IDLE (waiting for more scrubs)", 2023-09-23T09:13:35.135 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:13:35.135 INFO:teuthology.orchestra.run.smithi082.stdout: "cba46b77-20dd-437c-a60a-ac01b400e1b8": { 2023-09-23T09:13:35.135 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:13:35.135 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "cba46b77-20dd-437c-a60a-ac01b400e1b8", 2023-09-23T09:13:35.135 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:13:35.135 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:13:35.135 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:13:35.135 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:13:35.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.127+0000 7f4682f9d700 1 -- 172.21.15.82:0/4056246804 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f46680a01e0 msgr2=0x7f46680a26a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:13:35.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.127+0000 7f4682f9d700 1 --2- 172.21.15.82:0/4056246804 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f46680a01e0 0x7f46680a26a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f467c19f220 tx=0x7f467400bab0 comp rx=0 tx=0).stop 2023-09-23T09:13:35.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.127+0000 7f4682f9d700 1 -- 172.21.15.82:0/4056246804 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f467c1010b0 msgr2=0x7f467c19ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:13:35.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.127+0000 7f4682f9d700 1 --2- 172.21.15.82:0/4056246804 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f467c1010b0 0x7f467c19ead0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f466c00e9a0 tx=0x7f466c00ecb0 comp rx=0 tx=0).stop 2023-09-23T09:13:35.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.127+0000 7f4682f9d700 1 -- 172.21.15.82:0/4056246804 shutdown_connections 2023-09-23T09:13:35.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.127+0000 7f4682f9d700 1 --2- 172.21.15.82:0/4056246804 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f46680a01e0 0x7f46680a26a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:13:35.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.127+0000 7f4682f9d700 1 --2- 172.21.15.82:0/4056246804 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f467c106700 0x7f467c198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:13:35.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.127+0000 7f4682f9d700 1 --2- 172.21.15.82:0/4056246804 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f467c1006f0 0x7f467c19e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:13:35.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.127+0000 7f4682f9d700 1 --2- 172.21.15.82:0/4056246804 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f467c1010b0 0x7f467c19ead0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:13:35.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.127+0000 7f4682f9d700 1 -- 172.21.15.82:0/4056246804 >> 172.21.15.82:0/4056246804 conn(0x7f467c0fc1c0 msgr2=0x7f467c10bac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:13:35.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.128+0000 7f4682f9d700 1 -- 172.21.15.82:0/4056246804 shutdown_connections 2023-09-23T09:13:35.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:13:35.128+0000 7f4682f9d700 1 -- 172.21.15.82:0/4056246804 wait complete. 2023-09-23T09:13:35.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:13:34 smithi161 ceph-mon[99580]: pgmap v523: 97 pgs: 97 active+clean; 7.6 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 12 MiB/s wr, 138 op/s 2023-09-23T09:13:35.151 INFO:tasks.cephfs.filesystem:scrub status for tag:cba46b77-20dd-437c-a60a-ac01b400e1b8 - {'path': '/', 'tag': 'cba46b77-20dd-437c-a60a-ac01b400e1b8', 'options': 'recursive,force'} 2023-09-23T09:13:36.174 INFO:teuthology.orchestra.run.smithi082.stderr:41000000 of 50000000 tuples (82%) done (elapsed 970.92 s, remaining 213.13 s) 2023-09-23T09:13:37.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:13:36 smithi135 ceph-mon[99205]: pgmap v524: 97 pgs: 97 active+clean; 7.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 24 MiB/s wr, 166 op/s 2023-09-23T09:13:37.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:13:36 smithi082 ceph-mon[97694]: pgmap v524: 97 pgs: 97 active+clean; 7.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 24 MiB/s wr, 166 op/s 2023-09-23T09:13:37.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:13:36 smithi161 ceph-mon[99580]: pgmap v524: 97 pgs: 97 active+clean; 7.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 24 MiB/s wr, 166 op/s 2023-09-23T09:13:37.373 INFO:teuthology.orchestra.run.smithi082.stderr:41100000 of 50000000 tuples (82%) done (elapsed 972.12 s, remaining 210.51 s) 2023-09-23T09:13:38.550 INFO:teuthology.orchestra.run.smithi082.stderr:41200000 of 50000000 tuples (82%) done (elapsed 973.29 s, remaining 207.89 s) 2023-09-23T09:13:39.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:13:38 smithi135 ceph-mon[99205]: pgmap v525: 97 pgs: 97 active+clean; 7.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 22 MiB/s wr, 63 op/s 2023-09-23T09:13:39.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:13:38 smithi082 ceph-mon[97694]: pgmap v525: 97 pgs: 97 active+clean; 7.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 22 MiB/s wr, 63 op/s 2023-09-23T09:13:39.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:13:38 smithi161 ceph-mon[99580]: pgmap v525: 97 pgs: 97 active+clean; 7.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 22 MiB/s wr, 63 op/s 2023-09-23T09:13:39.727 INFO:teuthology.orchestra.run.smithi082.stderr:41300000 of 50000000 tuples (82%) done (elapsed 974.47 s, remaining 205.28 s) 2023-09-23T09:13:41.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:13:40 smithi135 ceph-mon[99205]: pgmap v526: 97 pgs: 97 active+clean; 7.7 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 34 MiB/s wr, 90 op/s 2023-09-23T09:13:41.063 INFO:teuthology.orchestra.run.smithi082.stderr:41400000 of 50000000 tuples (82%) done (elapsed 975.81 s, remaining 202.70 s) 2023-09-23T09:13:41.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:13:40 smithi082 ceph-mon[97694]: pgmap v526: 97 pgs: 97 active+clean; 7.7 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 34 MiB/s wr, 90 op/s 2023-09-23T09:13:41.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:13:40 smithi161 ceph-mon[99580]: pgmap v526: 97 pgs: 97 active+clean; 7.7 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 34 MiB/s wr, 90 op/s 2023-09-23T09:13:42.310 INFO:teuthology.orchestra.run.smithi082.stderr:41500000 of 50000000 tuples (83%) done (elapsed 977.05 s, remaining 200.12 s) 2023-09-23T09:13:43.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:13:42 smithi135 ceph-mon[99205]: pgmap v527: 97 pgs: 97 active+clean; 7.7 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 24 MiB/s wr, 56 op/s 2023-09-23T09:13:43.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:13:42 smithi082 ceph-mon[97694]: pgmap v527: 97 pgs: 97 active+clean; 7.7 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 24 MiB/s wr, 56 op/s 2023-09-23T09:13:43.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:13:42 smithi161 ceph-mon[99580]: pgmap v527: 97 pgs: 97 active+clean; 7.7 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 24 MiB/s wr, 56 op/s 2023-09-23T09:13:43.506 INFO:teuthology.orchestra.run.smithi082.stderr:41600000 of 50000000 tuples (83%) done (elapsed 978.25 s, remaining 197.53 s) 2023-09-23T09:13:44.806 INFO:teuthology.orchestra.run.smithi082.stderr:41700000 of 50000000 tuples (83%) done (elapsed 979.55 s, remaining 194.97 s) 2023-09-23T09:13:45.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:13:44 smithi135 ceph-mon[99205]: pgmap v528: 97 pgs: 97 active+clean; 7.7 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 24 MiB/s wr, 56 op/s 2023-09-23T09:13:45.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:13:44 smithi082 ceph-mon[97694]: pgmap v528: 97 pgs: 97 active+clean; 7.7 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 24 MiB/s wr, 56 op/s 2023-09-23T09:13:45.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:13:44 smithi161 ceph-mon[99580]: pgmap v528: 97 pgs: 97 active+clean; 7.7 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 24 MiB/s wr, 56 op/s 2023-09-23T09:13:45.994 INFO:teuthology.orchestra.run.smithi082.stderr:41800000 of 50000000 tuples (83%) done (elapsed 980.74 s, remaining 192.39 s) 2023-09-23T09:13:47.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:13:46 smithi135 ceph-mon[99205]: pgmap v529: 97 pgs: 97 active+clean; 7.8 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 36 MiB/s wr, 93 op/s 2023-09-23T09:13:47.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:13:46 smithi082 ceph-mon[97694]: pgmap v529: 97 pgs: 97 active+clean; 7.8 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 36 MiB/s wr, 93 op/s 2023-09-23T09:13:47.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:13:46 smithi161 ceph-mon[99580]: pgmap v529: 97 pgs: 97 active+clean; 7.8 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 36 MiB/s wr, 93 op/s 2023-09-23T09:13:47.230 INFO:teuthology.orchestra.run.smithi082.stderr:41900000 of 50000000 tuples (83%) done (elapsed 981.97 s, remaining 189.83 s) 2023-09-23T09:13:48.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:13:47 smithi082 ceph-mon[97694]: pgmap v530: 97 pgs: 97 active+clean; 7.8 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 24 MiB/s wr, 64 op/s 2023-09-23T09:13:48.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:13:47 smithi161 ceph-mon[99580]: pgmap v530: 97 pgs: 97 active+clean; 7.8 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 24 MiB/s wr, 64 op/s 2023-09-23T09:13:48.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:13:47 smithi135 ceph-mon[99205]: pgmap v530: 97 pgs: 97 active+clean; 7.8 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 24 MiB/s wr, 64 op/s 2023-09-23T09:13:48.593 INFO:teuthology.orchestra.run.smithi082.stderr:42000000 of 50000000 tuples (84%) done (elapsed 983.34 s, remaining 187.30 s) 2023-09-23T09:13:49.813 INFO:teuthology.orchestra.run.smithi082.stderr:42100000 of 50000000 tuples (84%) done (elapsed 984.56 s, remaining 184.75 s) 2023-09-23T09:13:50.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:13:50 smithi161 ceph-mon[99580]: pgmap v531: 97 pgs: 97 active+clean; 7.9 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 36 MiB/s wr, 101 op/s 2023-09-23T09:13:50.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:13:50 smithi135 ceph-mon[99205]: pgmap v531: 97 pgs: 97 active+clean; 7.9 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 36 MiB/s wr, 101 op/s 2023-09-23T09:13:50.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:13:50 smithi082 ceph-mon[97694]: pgmap v531: 97 pgs: 97 active+clean; 7.9 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 36 MiB/s wr, 101 op/s 2023-09-23T09:13:51.305 INFO:teuthology.orchestra.run.smithi082.stderr:42200000 of 50000000 tuples (84%) done (elapsed 986.05 s, remaining 182.26 s) 2023-09-23T09:13:52.596 INFO:teuthology.orchestra.run.smithi082.stderr:42300000 of 50000000 tuples (84%) done (elapsed 987.34 s, remaining 179.73 s) 2023-09-23T09:13:53.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:13:52 smithi135 ceph-mon[99205]: pgmap v532: 97 pgs: 97 active+clean; 7.9 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 24 MiB/s wr, 74 op/s 2023-09-23T09:13:53.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:13:52 smithi082 ceph-mon[97694]: pgmap v532: 97 pgs: 97 active+clean; 7.9 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 24 MiB/s wr, 74 op/s 2023-09-23T09:13:53.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:13:52 smithi161 ceph-mon[99580]: pgmap v532: 97 pgs: 97 active+clean; 7.9 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 24 MiB/s wr, 74 op/s 2023-09-23T09:13:53.826 INFO:teuthology.orchestra.run.smithi082.stderr:42400000 of 50000000 tuples (84%) done (elapsed 988.57 s, remaining 177.20 s) 2023-09-23T09:13:55.015 INFO:teuthology.orchestra.run.smithi082.stderr:42500000 of 50000000 tuples (85%) done (elapsed 989.76 s, remaining 174.66 s) 2023-09-23T09:13:55.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:13:54 smithi135 ceph-mon[99205]: pgmap v533: 97 pgs: 97 active+clean; 7.9 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 24 MiB/s wr, 74 op/s 2023-09-23T09:13:55.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:13:54 smithi082 ceph-mon[97694]: pgmap v533: 97 pgs: 97 active+clean; 7.9 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 24 MiB/s wr, 74 op/s 2023-09-23T09:13:55.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:13:54 smithi161 ceph-mon[99580]: pgmap v533: 97 pgs: 97 active+clean; 7.9 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 24 MiB/s wr, 74 op/s 2023-09-23T09:13:56.209 INFO:teuthology.orchestra.run.smithi082.stderr:42600000 of 50000000 tuples (85%) done (elapsed 990.95 s, remaining 172.14 s) 2023-09-23T09:13:57.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:13:56 smithi135 ceph-mon[99205]: pgmap v534: 97 pgs: 97 active+clean; 8.0 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 35 MiB/s wr, 109 op/s 2023-09-23T09:13:57.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:13:56 smithi082 ceph-mon[97694]: pgmap v534: 97 pgs: 97 active+clean; 8.0 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 35 MiB/s wr, 109 op/s 2023-09-23T09:13:57.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:13:56 smithi161 ceph-mon[99580]: pgmap v534: 97 pgs: 97 active+clean; 8.0 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 35 MiB/s wr, 109 op/s 2023-09-23T09:13:57.498 INFO:teuthology.orchestra.run.smithi082.stderr:42700000 of 50000000 tuples (85%) done (elapsed 992.24 s, remaining 169.63 s) 2023-09-23T09:13:58.712 INFO:teuthology.orchestra.run.smithi082.stderr:42800000 of 50000000 tuples (85%) done (elapsed 993.45 s, remaining 167.12 s) 2023-09-23T09:13:59.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:13:58 smithi135 ceph-mon[99205]: pgmap v535: 97 pgs: 97 active+clean; 8.0 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 23 MiB/s wr, 72 op/s 2023-09-23T09:13:59.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:13:58 smithi082 ceph-mon[97694]: pgmap v535: 97 pgs: 97 active+clean; 8.0 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 23 MiB/s wr, 72 op/s 2023-09-23T09:13:59.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:13:58 smithi161 ceph-mon[99580]: pgmap v535: 97 pgs: 97 active+clean; 8.0 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 23 MiB/s wr, 72 op/s 2023-09-23T09:13:59.937 INFO:teuthology.orchestra.run.smithi082.stderr:42900000 of 50000000 tuples (85%) done (elapsed 994.68 s, remaining 164.62 s) 2023-09-23T09:14:01.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:14:00 smithi135 ceph-mon[99205]: pgmap v536: 97 pgs: 97 active+clean; 8.1 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 35 MiB/s wr, 98 op/s 2023-09-23T09:14:01.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:14:00 smithi082 ceph-mon[97694]: pgmap v536: 97 pgs: 97 active+clean; 8.1 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 35 MiB/s wr, 98 op/s 2023-09-23T09:14:01.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:14:00 smithi161 ceph-mon[99580]: pgmap v536: 97 pgs: 97 active+clean; 8.1 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 35 MiB/s wr, 98 op/s 2023-09-23T09:14:01.253 INFO:teuthology.orchestra.run.smithi082.stderr:43000000 of 50000000 tuples (86%) done (elapsed 996.00 s, remaining 162.14 s) 2023-09-23T09:14:02.473 INFO:teuthology.orchestra.run.smithi082.stderr:43100000 of 50000000 tuples (86%) done (elapsed 997.22 s, remaining 159.65 s) 2023-09-23T09:14:02.882 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:14:02 smithi161 ceph-mon[99580]: pgmap v537: 97 pgs: 97 active+clean; 8.1 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 23 MiB/s wr, 62 op/s 2023-09-23T09:14:03.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:14:02 smithi135 ceph-mon[99205]: pgmap v537: 97 pgs: 97 active+clean; 8.1 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 23 MiB/s wr, 62 op/s 2023-09-23T09:14:03.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:14:02 smithi082 ceph-mon[97694]: pgmap v537: 97 pgs: 97 active+clean; 8.1 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 23 MiB/s wr, 62 op/s 2023-09-23T09:14:03.666 INFO:teuthology.orchestra.run.smithi082.stderr:43200000 of 50000000 tuples (86%) done (elapsed 998.41 s, remaining 157.16 s) 2023-09-23T09:14:04.893 INFO:teuthology.orchestra.run.smithi082.stderr:43300000 of 50000000 tuples (86%) done (elapsed 999.64 s, remaining 154.68 s) 2023-09-23T09:14:05.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:14:04 smithi135 ceph-mon[99205]: pgmap v538: 97 pgs: 97 active+clean; 8.1 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 23 MiB/s wr, 62 op/s 2023-09-23T09:14:05.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:14:04 smithi082 ceph-mon[97694]: pgmap v538: 97 pgs: 97 active+clean; 8.1 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 23 MiB/s wr, 62 op/s 2023-09-23T09:14:05.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:14:04 smithi161 ceph-mon[99580]: pgmap v538: 97 pgs: 97 active+clean; 8.1 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 23 MiB/s wr, 62 op/s 2023-09-23T09:14:05.152 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:14:05.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.374+0000 7f37253ff700 1 -- 172.21.15.82:0/2433760745 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3720108ad0 msgr2=0x7f3720108eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:14:05.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.374+0000 7f37253ff700 1 --2- 172.21.15.82:0/2433760745 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3720108ad0 0x7f3720108eb0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f3710009990 tx=0x7f3710009ca0 comp rx=0 tx=0).stop 2023-09-23T09:14:05.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.374+0000 7f37253ff700 1 -- 172.21.15.82:0/2433760745 shutdown_connections 2023-09-23T09:14:05.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.374+0000 7f37253ff700 1 --2- 172.21.15.82:0/2433760745 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3720103480 0x7f372010f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:14:05.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.374+0000 7f37253ff700 1 --2- 172.21.15.82:0/2433760745 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3720108ad0 0x7f3720108eb0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:14:05.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.374+0000 7f37253ff700 1 --2- 172.21.15.82:0/2433760745 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3720102ac0 0x7f3720102f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:14:05.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.374+0000 7f37253ff700 1 -- 172.21.15.82:0/2433760745 >> 172.21.15.82:0/2433760745 conn(0x7f37200fe570 msgr2=0x7f3720100990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:14:05.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.374+0000 7f37253ff700 1 -- 172.21.15.82:0/2433760745 shutdown_connections 2023-09-23T09:14:05.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.374+0000 7f37253ff700 1 -- 172.21.15.82:0/2433760745 wait complete. 2023-09-23T09:14:05.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.375+0000 7f37253ff700 1 Processor -- start 2023-09-23T09:14:05.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.375+0000 7f37253ff700 1 -- start start 2023-09-23T09:14:05.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.376+0000 7f37253ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3720102ac0 0x7f372019e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:14:05.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.376+0000 7f37253ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3720103480 0x7f372019edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:14:05.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.376+0000 7f37253ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3720108ad0 0x7f3720198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:14:05.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.376+0000 7f37253ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3720198f90 con 0x7f3720102ac0 2023-09-23T09:14:05.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.376+0000 7f37253ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3720199100 con 0x7f3720103480 2023-09-23T09:14:05.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.376+0000 7f37253ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37201992c0 con 0x7f3720108ad0 2023-09-23T09:14:05.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.376+0000 7f371effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3720102ac0 0x7f372019e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:14:05.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.376+0000 7f371effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3720102ac0 0x7f372019e8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58326/0 (socket says 172.21.15.82:58326) 2023-09-23T09:14:05.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.376+0000 7f371effd700 1 -- 172.21.15.82:0/661769551 learned_addr learned my addr 172.21.15.82:0/661769551 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:14:05.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.376+0000 7f371e7fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3720103480 0x7f372019edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:14:05.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.376+0000 7f371f7fe700 1 --2- 172.21.15.82:0/661769551 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3720108ad0 0x7f3720198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:14:05.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.376+0000 7f371effd700 1 -- 172.21.15.82:0/661769551 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3720108ad0 msgr2=0x7f3720198920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:14:05.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.376+0000 7f371effd700 1 --2- 172.21.15.82:0/661769551 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3720108ad0 0x7f3720198920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:14:05.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.376+0000 7f371effd700 1 -- 172.21.15.82:0/661769551 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3720103480 msgr2=0x7f372019edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:14:05.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.376+0000 7f371effd700 1 --2- 172.21.15.82:0/661769551 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3720103480 0x7f372019edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:14:05.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.376+0000 7f371effd700 1 -- 172.21.15.82:0/661769551 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37100095f0 con 0x7f3720102ac0 2023-09-23T09:14:05.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.376+0000 7f371f7fe700 1 --2- 172.21.15.82:0/661769551 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3720108ad0 0x7f3720198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:14:05.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.377+0000 7f371effd700 1 --2- 172.21.15.82:0/661769551 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3720102ac0 0x7f372019e8b0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f3710005740 tx=0x7f3710005770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:14:05.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.377+0000 7f3707fff700 1 -- 172.21.15.82:0/661769551 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f371001d070 con 0x7f3720102ac0 2023-09-23T09:14:05.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.377+0000 7f3707fff700 1 -- 172.21.15.82:0/661769551 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3710022470 con 0x7f3720102ac0 2023-09-23T09:14:05.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.377+0000 7f3707fff700 1 -- 172.21.15.82:0/661769551 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3710017650 con 0x7f3720102ac0 2023-09-23T09:14:05.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.377+0000 7f37253ff700 1 -- 172.21.15.82:0/661769551 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3720199540 con 0x7f3720102ac0 2023-09-23T09:14:05.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.377+0000 7f37253ff700 1 -- 172.21.15.82:0/661769551 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37201a58a0 con 0x7f3720102ac0 2023-09-23T09:14:05.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.381+0000 7f3707fff700 1 -- 172.21.15.82:0/661769551 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f371000fb00 con 0x7f3720102ac0 2023-09-23T09:14:05.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.382+0000 7f3738cf6b80 1 Processor -- start 2023-09-23T09:14:05.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.382+0000 7f3738cf6b80 1 -- start start 2023-09-23T09:14:05.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.382+0000 7f3707fff700 1 --2- 172.21.15.82:0/661769551 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f37080a00c0 0x7f37080a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:14:05.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.382+0000 7f3738cf6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561686ca1380 0x561686ca1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:14:05.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.382+0000 7f3738cf6b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561686ca1ca0 0x561686c9b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:14:05.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.382+0000 7f3738cf6b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561686c9bc40 0x561686c9c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:14:05.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.382+0000 7f3738cf6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561686c037b0 con 0x561686ca1380 2023-09-23T09:14:05.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.382+0000 7f3738cf6b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561686bf4780 con 0x561686ca1ca0 2023-09-23T09:14:05.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.382+0000 7f3738cf6b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x561686bf20a0 con 0x561686c9bc40 2023-09-23T09:14:05.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.382+0000 7f3707fff700 1 -- 172.21.15.82:0/661769551 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f37100ccb30 con 0x7f3720102ac0 2023-09-23T09:14:05.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.383+0000 7f371e7fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561686ca1ca0 0x561686c9b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:14:05.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.383+0000 7f371e7fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561686ca1ca0 0x561686c9b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:42124/0 (socket says 172.21.15.82:42124) 2023-09-23T09:14:05.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.383+0000 7f371e7fc700 1 -- 172.21.15.82:0/1203019687 learned_addr learned my addr 172.21.15.82:0/1203019687 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:14:05.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.383+0000 7f371f7fe700 1 --2- 172.21.15.82:0/661769551 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f37080a00c0 0x7f37080a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:14:05.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.383+0000 7f371effd700 1 --2- 172.21.15.82:0/1203019687 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561686ca1380 0x561686ca1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:14:05.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.383+0000 7f371f7fe700 1 --2- 172.21.15.82:0/1203019687 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561686c9bc40 0x561686c9c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:14:05.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.383+0000 7f371e7fc700 1 -- 172.21.15.82:0/1203019687 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561686c9bc40 msgr2=0x561686c9c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:14:05.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.383+0000 7f371e7fc700 1 --2- 172.21.15.82:0/1203019687 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561686c9bc40 0x561686c9c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:14:05.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.383+0000 7f371e7fc700 1 -- 172.21.15.82:0/1203019687 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561686ca1380 msgr2=0x561686ca1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:14:05.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.383+0000 7f371e7fc700 1 --2- 172.21.15.82:0/1203019687 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561686ca1380 0x561686ca1760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:14:05.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.383+0000 7f371e7fc700 1 -- 172.21.15.82:0/1203019687 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561686a6d630 con 0x561686ca1ca0 2023-09-23T09:14:05.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.383+0000 7f371effd700 1 --2- 172.21.15.82:0/1203019687 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561686ca1380 0x561686ca1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:14:05.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.384+0000 7f371f7fe700 1 --2- 172.21.15.82:0/661769551 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f37080a00c0 0x7f37080a2580 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f372019f5b0 tx=0x7f3718015420 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:14:05.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.384+0000 7f371e7fc700 1 --2- 172.21.15.82:0/1203019687 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561686ca1ca0 0x561686c9b700 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3714009d20 tx=0x7f3714011720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ff0f9d12b7fe47b server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:14:05.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.384+0000 7f37057fa700 1 -- 172.21.15.82:0/1203019687 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3714019630 con 0x561686ca1ca0 2023-09-23T09:14:05.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.384+0000 7f37057fa700 1 -- 172.21.15.82:0/1203019687 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3714019c20 con 0x561686ca1ca0 2023-09-23T09:14:05.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.384+0000 7f37057fa700 1 -- 172.21.15.82:0/1203019687 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f371400eaa0 con 0x561686ca1ca0 2023-09-23T09:14:05.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.385+0000 7f3738cf6b80 1 -- 172.21.15.82:0/1203019687 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561686ca1ca0 msgr2=0x561686c9b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:14:05.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.385+0000 7f3738cf6b80 1 --2- 172.21.15.82:0/1203019687 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561686ca1ca0 0x561686c9b700 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3714009d20 tx=0x7f3714011720 comp rx=0 tx=0).stop 2023-09-23T09:14:05.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.385+0000 7f3738cf6b80 1 -- 172.21.15.82:0/1203019687 shutdown_connections 2023-09-23T09:14:05.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.385+0000 7f3738cf6b80 1 --2- 172.21.15.82:0/1203019687 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561686c9bc40 0x561686c9c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:14:05.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.385+0000 7f3738cf6b80 1 --2- 172.21.15.82:0/1203019687 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561686ca1380 0x561686ca1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:14:05.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.385+0000 7f3738cf6b80 1 --2- 172.21.15.82:0/1203019687 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561686ca1ca0 0x561686c9b700 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:14:05.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.385+0000 7f3738cf6b80 1 -- 172.21.15.82:0/1203019687 >> 172.21.15.82:0/1203019687 conn(0x561686c100e0 msgr2=0x561686c96410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:14:05.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.385+0000 7f3738cf6b80 1 -- 172.21.15.82:0/1203019687 shutdown_connections 2023-09-23T09:14:05.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.385+0000 7f3738cf6b80 1 -- 172.21.15.82:0/1203019687 wait complete. 2023-09-23T09:14:05.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.385+0000 7f3738cf6b80 1 -- start start 2023-09-23T09:14:05.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.386+0000 7f3738cf6b80 1 Processor -- start 2023-09-23T09:14:05.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.386+0000 7f3738cf6b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561686c9bc40 0x561686ca7c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:14:05.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.386+0000 7f3738cf6b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561686ca1380 0x561686ca4e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:14:05.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.386+0000 7f3738cf6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561686ca1ca0 0x561686ca5500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:14:05.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.386+0000 7f3738cf6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561686bed990 con 0x561686ca1ca0 2023-09-23T09:14:05.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.386+0000 7f3738cf6b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561686b8bbb0 con 0x561686c9bc40 2023-09-23T09:14:05.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.386+0000 7f3738cf6b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x561686b8b8b0 con 0x561686ca1380 2023-09-23T09:14:05.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.386+0000 7f3738cf6b80 10 client.0 _ll_register_callbacks cb 0x561686ad5a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:14:05.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.387+0000 7f371effd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561686c9bc40 0x561686ca7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:14:05.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.387+0000 7f371f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561686ca1ca0 0x561686ca5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:14:05.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.387+0000 7f371e7fc700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561686ca1380 0x561686ca4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:14:05.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.387+0000 7f371effd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561686c9bc40 0x561686ca7c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:42140/0 (socket says 172.21.15.82:42140) 2023-09-23T09:14:05.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.387+0000 7f371effd700 1 -- 172.21.15.82:0/3011105210 learned_addr learned my addr 172.21.15.82:0/3011105210 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:14:05.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.387+0000 7f371f7fe700 1 -- 172.21.15.82:0/3011105210 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561686ca1380 msgr2=0x561686ca4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:14:05.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.387+0000 7f371f7fe700 1 --2- 172.21.15.82:0/3011105210 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561686ca1380 0x561686ca4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:14:05.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.387+0000 7f371f7fe700 1 -- 172.21.15.82:0/3011105210 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561686c9bc40 msgr2=0x561686ca7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:14:05.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.387+0000 7f371f7fe700 1 --2- 172.21.15.82:0/3011105210 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561686c9bc40 0x561686ca7c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:14:05.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.387+0000 7f371f7fe700 1 -- 172.21.15.82:0/3011105210 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37201a58a0 con 0x561686ca1ca0 2023-09-23T09:14:05.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.387+0000 7f371e7fc700 1 --2- 172.21.15.82:0/3011105210 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561686ca1380 0x561686ca4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:14:05.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.387+0000 7f371f7fe700 1 --2- 172.21.15.82:0/3011105210 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561686ca1ca0 0x561686ca5500 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f3718007730 tx=0x7f371800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=145f853244c5aea6 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:14:05.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.388+0000 7f3702ff5700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:14:05.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.388+0000 7f3702ff5700 1 -- 172.21.15.82:0/3011105210 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f371800e040 con 0x561686ca1ca0 2023-09-23T09:14:05.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.388+0000 7f3738cf6b80 1 -- 172.21.15.82:0/3011105210 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561686c6b1c0 con 0x561686ca1ca0 2023-09-23T09:14:05.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.388+0000 7f3702ff5700 1 -- 172.21.15.82:0/3011105210 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f3718020030 con 0x561686ca1ca0 2023-09-23T09:14:05.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.388+0000 7f3702ff5700 1 -- 172.21.15.82:0/3011105210 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=67) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3718019ed0 con 0x561686ca1ca0 2023-09-23T09:14:05.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.388+0000 7f3738cf6b80 10 client.16617 fetch_fsmap learned FSMap version 67 2023-09-23T09:14:05.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.388+0000 7f3738cf6b80 1 -- 172.21.15.82:0/3011105210 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=67,monmap=4+}) v3 -- 0x7f3714009980 con 0x561686ca1ca0 2023-09-23T09:14:05.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.388+0000 7f3702ff5700 1 -- 172.21.15.82:0/3011105210 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3718032080 con 0x561686ca1ca0 2023-09-23T09:14:05.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.389+0000 7f3702ff5700 1 -- 172.21.15.82:0/3011105210 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 67) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f3718004660 con 0x561686ca1ca0 2023-09-23T09:14:05.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.389+0000 7f3738cf6b80 10 client.16617 fetch_fsmap finished waiting for FSMap version 67 2023-09-23T09:14:05.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.389+0000 7f3738cf6b80 10 client.16617 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:14:05.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.389+0000 7f3738cf6b80 20 client.16617 populate_metadata read hostname 'smithi082' 2023-09-23T09:14:05.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.389+0000 7f3738cf6b80 1 --2- 172.21.15.82:0/3011105210 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x561686cb5800 0x561686cb7c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:14:05.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.389+0000 7f3738cf6b80 4 client.16617 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:14:05.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.389+0000 7f3738cf6b80 1 -- 172.21.15.82:0/3011105210 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561686b93ba0 con 0x561686cb5800 2023-09-23T09:14:05.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.389+0000 7f371effd700 1 --2- 172.21.15.82:0/3011105210 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x561686cb5800 0x561686cb7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:14:05.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.390+0000 7f3702ff5700 10 client.16617 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:14:05.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.390+0000 7f371effd700 1 --2- 172.21.15.82:0/3011105210 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x561686cb5800 0x561686cb7c20 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc5693843e86402e server_cookie=182f7df04b2cd37b in_seq=0 out_seq=0 2023-09-23T09:14:05.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.390+0000 7f3702ff5700 1 -- 172.21.15.82:0/3011105210 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x561686b93ba0 con 0x561686cb5800 2023-09-23T09:14:05.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.390+0000 7f3702ff5700 10 client.16617 handle_command_reply: tid=0 2023-09-23T09:14:05.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.390+0000 7f3738cf6b80 1 client.16617 shutdown 2023-09-23T09:14:05.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.391+0000 7f3738cf6b80 1 -- 172.21.15.82:0/3011105210 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561686ca1ca0 msgr2=0x561686ca5500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:14:05.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.391+0000 7f3738cf6b80 1 --2- 172.21.15.82:0/3011105210 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561686ca1ca0 0x561686ca5500 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f3718007730 tx=0x7f371800b040 comp rx=0 tx=0).stop 2023-09-23T09:14:05.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.391+0000 7f3738cf6b80 1 -- 172.21.15.82:0/3011105210 shutdown_connections 2023-09-23T09:14:05.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.391+0000 7f3738cf6b80 1 --2- 172.21.15.82:0/3011105210 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x561686cb5800 0x561686cb7c20 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:14:05.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.391+0000 7f3738cf6b80 1 --2- 172.21.15.82:0/3011105210 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561686ca1ca0 0x561686ca5500 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:14:05.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.391+0000 7f3702ff5700 0 client.16617 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:14:05.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.391+0000 7f3738cf6b80 1 --2- 172.21.15.82:0/3011105210 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561686c9bc40 0x561686ca7c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:14:05.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.391+0000 7f3738cf6b80 1 --2- 172.21.15.82:0/3011105210 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561686ca1380 0x561686ca4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:14:05.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.391+0000 7f3738cf6b80 1 -- 172.21.15.82:0/3011105210 >> 172.21.15.82:0/3011105210 conn(0x561686c100e0 msgr2=0x561686c902b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:14:05.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.391+0000 7f3738cf6b80 1 -- 172.21.15.82:0/3011105210 shutdown_connections 2023-09-23T09:14:05.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.391+0000 7f3738cf6b80 1 -- 172.21.15.82:0/3011105210 wait complete. 2023-09-23T09:14:05.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.391+0000 7f3738cf6b80 20 client.16617 trim_cache size 0 max 16384 2023-09-23T09:14:05.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.412+0000 7f3738cf6b80 1 Processor -- start 2023-09-23T09:14:05.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.413+0000 7f3738cf6b80 1 -- start start 2023-09-23T09:14:05.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.413+0000 7f3738cf6b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561686c9bc40 0x561686c9b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:14:05.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.413+0000 7f3738cf6b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561686ca1380 0x561686ca4640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:14:05.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.413+0000 7f3738cf6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561686ca1ca0 0x561686ca4b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:14:05.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.413+0000 7f3738cf6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561686a6f920 con 0x561686ca1ca0 2023-09-23T09:14:05.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.413+0000 7f3738cf6b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561686c9c800 con 0x561686ca1380 2023-09-23T09:14:05.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.413+0000 7f3738cf6b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x561686ca1760 con 0x561686c9bc40 2023-09-23T09:14:05.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.413+0000 7f371effd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561686c9bc40 0x561686c9b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:14:05.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.413+0000 7f371f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561686ca1ca0 0x561686ca4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:14:05.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.413+0000 7f371e7fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561686ca1380 0x561686ca4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:14:05.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.413+0000 7f371effd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561686c9bc40 0x561686c9b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:50634/0 (socket says 172.21.15.82:50634) 2023-09-23T09:14:05.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.413+0000 7f371effd700 1 -- 172.21.15.82:0/3933247844 learned_addr learned my addr 172.21.15.82:0/3933247844 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:14:05.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.414+0000 7f371effd700 1 -- 172.21.15.82:0/3933247844 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561686ca1380 msgr2=0x561686ca4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:14:05.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.414+0000 7f371effd700 1 --2- 172.21.15.82:0/3933247844 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561686ca1380 0x561686ca4640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:14:05.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.414+0000 7f371effd700 1 -- 172.21.15.82:0/3933247844 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561686ca1ca0 msgr2=0x561686ca4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:14:05.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.414+0000 7f371effd700 1 --2- 172.21.15.82:0/3933247844 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561686ca1ca0 0x561686ca4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:14:05.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.414+0000 7f371effd700 1 -- 172.21.15.82:0/3933247844 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561686a19de0 con 0x561686c9bc40 2023-09-23T09:14:05.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.414+0000 7f371effd700 1 --2- 172.21.15.82:0/3933247844 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561686c9bc40 0x561686c9b700 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f37100095c0 tx=0x7f3710085040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9b585db71fbc5d0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:14:05.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.414+0000 7f3705ffb700 1 -- 172.21.15.82:0/3933247844 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f371009a9d0 con 0x561686c9bc40 2023-09-23T09:14:05.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.414+0000 7f3705ffb700 1 -- 172.21.15.82:0/3933247844 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f371009a2d0 con 0x561686c9bc40 2023-09-23T09:14:05.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.414+0000 7f3705ffb700 1 -- 172.21.15.82:0/3933247844 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3710022670 con 0x561686c9bc40 2023-09-23T09:14:05.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.415+0000 7f3738cf6b80 1 -- 172.21.15.82:0/3933247844 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561686c9bc40 msgr2=0x561686c9b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:14:05.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.415+0000 7f3738cf6b80 1 --2- 172.21.15.82:0/3933247844 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561686c9bc40 0x561686c9b700 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f37100095c0 tx=0x7f3710085040 comp rx=0 tx=0).stop 2023-09-23T09:14:05.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.415+0000 7f3738cf6b80 1 -- 172.21.15.82:0/3933247844 shutdown_connections 2023-09-23T09:14:05.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.415+0000 7f3738cf6b80 1 --2- 172.21.15.82:0/3933247844 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561686ca1ca0 0x561686ca4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:14:05.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.415+0000 7f3738cf6b80 1 --2- 172.21.15.82:0/3933247844 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561686c9bc40 0x561686c9b700 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:14:05.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.415+0000 7f3738cf6b80 1 --2- 172.21.15.82:0/3933247844 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561686ca1380 0x561686ca4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:14:05.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.415+0000 7f3738cf6b80 1 -- 172.21.15.82:0/3933247844 >> 172.21.15.82:0/3933247844 conn(0x561686c100e0 msgr2=0x561686c9efb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:14:05.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.415+0000 7f3738cf6b80 1 -- 172.21.15.82:0/3933247844 shutdown_connections 2023-09-23T09:14:05.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.415+0000 7f3738cf6b80 1 -- 172.21.15.82:0/3933247844 wait complete. 2023-09-23T09:14:05.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.416+0000 7f3738cf6b80 1 -- start start 2023-09-23T09:14:05.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.416+0000 7f3738cf6b80 1 Processor -- start 2023-09-23T09:14:05.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.416+0000 7f3738cf6b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561686c9bc40 0x561686c9e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:14:05.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.416+0000 7f3738cf6b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561686ca1380 0x561686c9ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:14:05.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.416+0000 7f3738cf6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561686ca1ca0 0x561686c9d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:14:05.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.416+0000 7f3738cf6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561686c9ea50 con 0x561686ca1ca0 2023-09-23T09:14:05.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.416+0000 7f3738cf6b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561686c9d880 con 0x561686c9bc40 2023-09-23T09:14:05.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.416+0000 7f3738cf6b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x561686c9da40 con 0x561686ca1380 2023-09-23T09:14:05.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.416+0000 7f3738cf6b80 10 client.0 _ll_register_callbacks cb 0x561686ad5a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:14:05.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.417+0000 7f371effd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561686c9bc40 0x561686c9e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:14:05.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.417+0000 7f371e7fc700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561686ca1380 0x561686c9ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:14:05.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.417+0000 7f371effd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561686c9bc40 0x561686c9e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:42150/0 (socket says 172.21.15.82:42150) 2023-09-23T09:14:05.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.417+0000 7f371effd700 1 -- 172.21.15.82:0/3041091327 learned_addr learned my addr 172.21.15.82:0/3041091327 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:14:05.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.417+0000 7f371f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561686ca1ca0 0x561686c9d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:14:05.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.417+0000 7f371e7fc700 1 -- 172.21.15.82:0/3041091327 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561686c9bc40 msgr2=0x561686c9e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:14:05.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.417+0000 7f371e7fc700 1 --2- 172.21.15.82:0/3041091327 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561686c9bc40 0x561686c9e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:14:05.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.417+0000 7f371e7fc700 1 -- 172.21.15.82:0/3041091327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561686ca1ca0 msgr2=0x561686c9d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:14:05.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.417+0000 7f371e7fc700 1 --2- 172.21.15.82:0/3041091327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561686ca1ca0 0x561686c9d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:14:05.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.417+0000 7f371e7fc700 1 -- 172.21.15.82:0/3041091327 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3720199540 con 0x561686ca1380 2023-09-23T09:14:05.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.417+0000 7f371f7fe700 1 --2- 172.21.15.82:0/3041091327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561686ca1ca0 0x561686c9d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:14:05.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.417+0000 7f371e7fc700 1 --2- 172.21.15.82:0/3041091327 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561686ca1380 0x561686c9ce00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3714009310 tx=0x7f37140038b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9276c3911ca34c5 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:14:05.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.417+0000 7f3702ff5700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T09:14:05.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.418+0000 7f3702ff5700 1 -- 172.21.15.82:0/3041091327 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3714003db0 con 0x561686ca1380 2023-09-23T09:14:05.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.418+0000 7f3738cf6b80 1 -- 172.21.15.82:0/3041091327 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561686c8e8b0 con 0x561686ca1380 2023-09-23T09:14:05.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.418+0000 7f3702ff5700 1 -- 172.21.15.82:0/3041091327 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f3714009e70 con 0x561686ca1380 2023-09-23T09:14:05.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.418+0000 7f3702ff5700 1 -- 172.21.15.82:0/3041091327 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=67) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3714005b00 con 0x561686ca1380 2023-09-23T09:14:05.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.418+0000 7f3738cf6b80 10 client.26356 fetch_fsmap learned FSMap version 67 2023-09-23T09:14:05.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.418+0000 7f3738cf6b80 1 -- 172.21.15.82:0/3041091327 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=67,monmap=4+}) v3 -- 0x561686a02c60 con 0x561686ca1380 2023-09-23T09:14:05.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.418+0000 7f3702ff5700 1 -- 172.21.15.82:0/3041091327 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x561686c8e8b0 con 0x561686ca1380 2023-09-23T09:14:05.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.419+0000 7f3702ff5700 1 -- 172.21.15.82:0/3041091327 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 67) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f3714019430 con 0x561686ca1380 2023-09-23T09:14:05.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.419+0000 7f3738cf6b80 10 client.26356 fetch_fsmap finished waiting for FSMap version 67 2023-09-23T09:14:05.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.419+0000 7f3738cf6b80 10 client.26356 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:14:05.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.419+0000 7f3738cf6b80 20 client.26356 populate_metadata read hostname 'smithi082' 2023-09-23T09:14:05.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.419+0000 7f3738cf6b80 1 --2- 172.21.15.82:0/3041091327 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x561686d0a6e0 0x561686d0cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:14:05.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.419+0000 7f3738cf6b80 4 client.26356 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:14:05.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.419+0000 7f3738cf6b80 1 -- 172.21.15.82:0/3041091327 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x561686be6970 con 0x561686d0a6e0 2023-09-23T09:14:05.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.419+0000 7f371effd700 1 --2- 172.21.15.82:0/3041091327 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x561686d0a6e0 0x561686d0cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:14:05.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.420+0000 7f371effd700 1 --2- 172.21.15.82:0/3041091327 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x561686d0a6e0 0x561686d0cb00 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7abce52ea3e312bb server_cookie=a26d0047baa95ef7 in_seq=0 out_seq=0 2023-09-23T09:14:05.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.420+0000 7f3702ff5700 10 client.26356 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:14:05.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.420+0000 7f3702ff5700 1 -- 172.21.15.82:0/3041091327 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x561686be6970 con 0x561686d0a6e0 2023-09-23T09:14:05.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.420+0000 7f3702ff5700 10 client.26356 handle_command_reply: tid=0 2023-09-23T09:14:05.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.420+0000 7f3738cf6b80 1 client.26356 shutdown 2023-09-23T09:14:05.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.420+0000 7f3738cf6b80 1 -- 172.21.15.82:0/3041091327 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561686ca1380 msgr2=0x561686c9ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:14:05.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.420+0000 7f3738cf6b80 1 --2- 172.21.15.82:0/3041091327 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561686ca1380 0x561686c9ce00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3714009310 tx=0x7f37140038b0 comp rx=0 tx=0).stop 2023-09-23T09:14:05.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.420+0000 7f3738cf6b80 1 -- 172.21.15.82:0/3041091327 shutdown_connections 2023-09-23T09:14:05.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.420+0000 7f3738cf6b80 1 --2- 172.21.15.82:0/3041091327 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x561686d0a6e0 0x561686d0cb00 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:14:05.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.420+0000 7f3738cf6b80 1 --2- 172.21.15.82:0/3041091327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561686ca1ca0 0x561686c9d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:14:05.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.420+0000 7f3738cf6b80 1 --2- 172.21.15.82:0/3041091327 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561686c9bc40 0x561686c9e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:14:05.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.420+0000 7f3702ff5700 0 client.26356 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:14:05.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.420+0000 7f3738cf6b80 1 --2- 172.21.15.82:0/3041091327 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561686ca1380 0x561686c9ce00 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:14:05.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.420+0000 7f3738cf6b80 1 -- 172.21.15.82:0/3041091327 >> 172.21.15.82:0/3041091327 conn(0x561686c100e0 msgr2=0x561686ca2130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:14:05.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.420+0000 7f3738cf6b80 1 -- 172.21.15.82:0/3041091327 shutdown_connections 2023-09-23T09:14:05.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.420+0000 7f3738cf6b80 1 -- 172.21.15.82:0/3041091327 wait complete. 2023-09-23T09:14:05.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.420+0000 7f3738cf6b80 20 client.26356 trim_cache size 0 max 16384 2023-09-23T09:14:05.427 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:14:05.427 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "IDLE (waiting for more scrubs)", 2023-09-23T09:14:05.427 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:14:05.427 INFO:teuthology.orchestra.run.smithi082.stdout: "cba46b77-20dd-437c-a60a-ac01b400e1b8": { 2023-09-23T09:14:05.427 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:14:05.427 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "cba46b77-20dd-437c-a60a-ac01b400e1b8", 2023-09-23T09:14:05.427 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:14:05.427 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:14:05.428 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:14:05.428 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:14:05.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.421+0000 7f37253ff700 1 -- 172.21.15.82:0/661769551 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f37080a00c0 msgr2=0x7f37080a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:14:05.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.421+0000 7f37253ff700 1 --2- 172.21.15.82:0/661769551 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f37080a00c0 0x7f37080a2580 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f372019f5b0 tx=0x7f3718015420 comp rx=0 tx=0).stop 2023-09-23T09:14:05.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.421+0000 7f37253ff700 1 -- 172.21.15.82:0/661769551 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3720102ac0 msgr2=0x7f372019e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:14:05.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.421+0000 7f37253ff700 1 --2- 172.21.15.82:0/661769551 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3720102ac0 0x7f372019e8b0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f3710005740 tx=0x7f3710005770 comp rx=0 tx=0).stop 2023-09-23T09:14:05.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.421+0000 7f37253ff700 1 -- 172.21.15.82:0/661769551 shutdown_connections 2023-09-23T09:14:05.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.421+0000 7f37253ff700 1 --2- 172.21.15.82:0/661769551 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f37080a00c0 0x7f37080a2580 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:14:05.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.421+0000 7f37253ff700 1 --2- 172.21.15.82:0/661769551 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3720108ad0 0x7f3720198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:14:05.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.421+0000 7f37253ff700 1 --2- 172.21.15.82:0/661769551 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3720102ac0 0x7f372019e8b0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:14:05.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.421+0000 7f37253ff700 1 --2- 172.21.15.82:0/661769551 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3720103480 0x7f372019edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:14:05.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.421+0000 7f37253ff700 1 -- 172.21.15.82:0/661769551 >> 172.21.15.82:0/661769551 conn(0x7f37200fe570 msgr2=0x7f37200fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:14:05.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.421+0000 7f37253ff700 1 -- 172.21.15.82:0/661769551 shutdown_connections 2023-09-23T09:14:05.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:05.421+0000 7f37253ff700 1 -- 172.21.15.82:0/661769551 wait complete. 2023-09-23T09:14:05.445 INFO:tasks.cephfs.filesystem:scrub status for tag:cba46b77-20dd-437c-a60a-ac01b400e1b8 - {'path': '/', 'tag': 'cba46b77-20dd-437c-a60a-ac01b400e1b8', 'options': 'recursive,force'} 2023-09-23T09:14:06.227 INFO:teuthology.orchestra.run.smithi082.stderr:43400000 of 50000000 tuples (86%) done (elapsed 1000.97 s, remaining 152.22 s) 2023-09-23T09:14:06.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:14:06 smithi161 ceph-mon[99580]: pgmap v539: 97 pgs: 97 active+clean; 8.2 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 36 MiB/s wr, 104 op/s 2023-09-23T09:14:07.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:14:06 smithi135 ceph-mon[99205]: pgmap v539: 97 pgs: 97 active+clean; 8.2 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 36 MiB/s wr, 104 op/s 2023-09-23T09:14:07.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:14:06 smithi082 ceph-mon[97694]: pgmap v539: 97 pgs: 97 active+clean; 8.2 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 36 MiB/s wr, 104 op/s 2023-09-23T09:14:07.523 INFO:teuthology.orchestra.run.smithi082.stderr:43500000 of 50000000 tuples (87%) done (elapsed 1002.27 s, remaining 149.76 s) 2023-09-23T09:14:08.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:14:07 smithi135 ceph-mon[99205]: osdmap e110: 12 total, 12 up, 12 in 2023-09-23T09:14:08.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:14:07 smithi082 ceph-mon[97694]: osdmap e110: 12 total, 12 up, 12 in 2023-09-23T09:14:08.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:14:07 smithi161 ceph-mon[99580]: osdmap e110: 12 total, 12 up, 12 in 2023-09-23T09:14:08.749 INFO:teuthology.orchestra.run.smithi082.stderr:43600000 of 50000000 tuples (87%) done (elapsed 1003.49 s, remaining 147.30 s) 2023-09-23T09:14:08.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:14:08 smithi161 ceph-mon[99580]: pgmap v541: 97 pgs: 97 active+clean; 8.2 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 29 MiB/s wr, 82 op/s 2023-09-23T09:14:09.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:14:08 smithi135 ceph-mon[99205]: pgmap v541: 97 pgs: 97 active+clean; 8.2 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 29 MiB/s wr, 82 op/s 2023-09-23T09:14:09.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:14:08 smithi082 ceph-mon[97694]: pgmap v541: 97 pgs: 97 active+clean; 8.2 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 29 MiB/s wr, 82 op/s 2023-09-23T09:14:10.035 INFO:teuthology.orchestra.run.smithi082.stderr:43700000 of 50000000 tuples (87%) done (elapsed 1004.78 s, remaining 144.85 s) 2023-09-23T09:14:11.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:14:10 smithi135 ceph-mon[99205]: pgmap v542: 97 pgs: 97 active+clean; 8.2 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 28 MiB/s wr, 92 op/s 2023-09-23T09:14:11.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:14:10 smithi082 ceph-mon[97694]: pgmap v542: 97 pgs: 97 active+clean; 8.2 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 28 MiB/s wr, 92 op/s 2023-09-23T09:14:11.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:14:10 smithi161 ceph-mon[99580]: pgmap v542: 97 pgs: 97 active+clean; 8.2 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 28 MiB/s wr, 92 op/s 2023-09-23T09:14:11.376 INFO:teuthology.orchestra.run.smithi082.stderr:43800000 of 50000000 tuples (87%) done (elapsed 1006.12 s, remaining 142.42 s) 2023-09-23T09:14:12.604 INFO:teuthology.orchestra.run.smithi082.stderr:43900000 of 50000000 tuples (87%) done (elapsed 1007.35 s, remaining 139.97 s) 2023-09-23T09:14:13.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:14:12 smithi135 ceph-mon[99205]: pgmap v543: 97 pgs: 97 active+clean; 8.2 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 28 MiB/s wr, 92 op/s 2023-09-23T09:14:13.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:14:12 smithi135 ceph-mon[99205]: osdmap e111: 12 total, 12 up, 12 in 2023-09-23T09:14:13.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:14:12 smithi082 ceph-mon[97694]: pgmap v543: 97 pgs: 97 active+clean; 8.2 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 28 MiB/s wr, 92 op/s 2023-09-23T09:14:13.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:14:12 smithi082 ceph-mon[97694]: osdmap e111: 12 total, 12 up, 12 in 2023-09-23T09:14:13.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:14:12 smithi161 ceph-mon[99580]: pgmap v543: 97 pgs: 97 active+clean; 8.2 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 28 MiB/s wr, 92 op/s 2023-09-23T09:14:13.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:14:12 smithi161 ceph-mon[99580]: osdmap e111: 12 total, 12 up, 12 in 2023-09-23T09:14:13.818 INFO:teuthology.orchestra.run.smithi082.stderr:44000000 of 50000000 tuples (88%) done (elapsed 1008.56 s, remaining 137.53 s) 2023-09-23T09:14:15.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:14:14 smithi135 ceph-mon[99205]: pgmap v545: 97 pgs: 97 active+clean; 8.2 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 17 MiB/s wr, 51 op/s 2023-09-23T09:14:15.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:14:14 smithi082 ceph-mon[97694]: pgmap v545: 97 pgs: 97 active+clean; 8.2 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 17 MiB/s wr, 51 op/s 2023-09-23T09:14:15.133 INFO:teuthology.orchestra.run.smithi082.stderr:44100000 of 50000000 tuples (88%) done (elapsed 1009.88 s, remaining 135.11 s) 2023-09-23T09:14:15.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:14:14 smithi161 ceph-mon[99580]: pgmap v545: 97 pgs: 97 active+clean; 8.2 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 17 MiB/s wr, 51 op/s 2023-09-23T09:14:16.424 INFO:teuthology.orchestra.run.smithi082.stderr:44200000 of 50000000 tuples (88%) done (elapsed 1011.17 s, remaining 132.69 s) 2023-09-23T09:14:17.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:14:16 smithi135 ceph-mon[99205]: pgmap v546: 97 pgs: 97 active+clean; 8.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 33 MiB/s wr, 99 op/s 2023-09-23T09:14:17.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:14:16 smithi082 ceph-mon[97694]: pgmap v546: 97 pgs: 97 active+clean; 8.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 33 MiB/s wr, 99 op/s 2023-09-23T09:14:17.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:14:16 smithi161 ceph-mon[99580]: pgmap v546: 97 pgs: 97 active+clean; 8.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 33 MiB/s wr, 99 op/s 2023-09-23T09:14:17.675 INFO:teuthology.orchestra.run.smithi082.stderr:44300000 of 50000000 tuples (88%) done (elapsed 1012.42 s, remaining 130.27 s) 2023-09-23T09:14:18.977 INFO:teuthology.orchestra.run.smithi082.stderr:44400000 of 50000000 tuples (88%) done (elapsed 1013.72 s, remaining 127.86 s) 2023-09-23T09:14:19.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:14:18 smithi135 ceph-mon[99205]: pgmap v547: 97 pgs: 97 active+clean; 8.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 28 MiB/s wr, 85 op/s 2023-09-23T09:14:19.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:14:18 smithi082 ceph-mon[97694]: pgmap v547: 97 pgs: 97 active+clean; 8.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 28 MiB/s wr, 85 op/s 2023-09-23T09:14:19.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:14:18 smithi161 ceph-mon[99580]: pgmap v547: 97 pgs: 97 active+clean; 8.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 28 MiB/s wr, 85 op/s 2023-09-23T09:14:20.168 INFO:teuthology.orchestra.run.smithi082.stderr:44500000 of 50000000 tuples (89%) done (elapsed 1014.91 s, remaining 125.44 s) 2023-09-23T09:14:21.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:14:20 smithi135 ceph-mon[99205]: pgmap v548: 97 pgs: 97 active+clean; 8.4 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 29 MiB/s wr, 79 op/s 2023-09-23T09:14:21.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:14:20 smithi082 ceph-mon[97694]: pgmap v548: 97 pgs: 97 active+clean; 8.4 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 29 MiB/s wr, 79 op/s 2023-09-23T09:14:21.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:14:20 smithi161 ceph-mon[99580]: pgmap v548: 97 pgs: 97 active+clean; 8.4 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 29 MiB/s wr, 79 op/s 2023-09-23T09:14:21.333 INFO:teuthology.orchestra.run.smithi082.stderr:44600000 of 50000000 tuples (89%) done (elapsed 1016.08 s, remaining 123.02 s) 2023-09-23T09:14:22.526 INFO:teuthology.orchestra.run.smithi082.stderr:44700000 of 50000000 tuples (89%) done (elapsed 1017.27 s, remaining 120.62 s) 2023-09-23T09:14:23.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:14:22 smithi135 ceph-mon[99205]: pgmap v549: 97 pgs: 97 active+clean; 8.4 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 29 MiB/s wr, 79 op/s 2023-09-23T09:14:23.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:14:22 smithi082 ceph-mon[97694]: pgmap v549: 97 pgs: 97 active+clean; 8.4 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 29 MiB/s wr, 79 op/s 2023-09-23T09:14:23.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:14:22 smithi161 ceph-mon[99580]: pgmap v549: 97 pgs: 97 active+clean; 8.4 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 29 MiB/s wr, 79 op/s 2023-09-23T09:14:23.864 INFO:teuthology.orchestra.run.smithi082.stderr:44800000 of 50000000 tuples (89%) done (elapsed 1018.61 s, remaining 118.23 s) 2023-09-23T09:14:25.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:14:24 smithi135 ceph-mon[99205]: pgmap v550: 97 pgs: 97 active+clean; 8.4 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 25 MiB/s wr, 68 op/s 2023-09-23T09:14:25.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:14:24 smithi082 ceph-mon[97694]: pgmap v550: 97 pgs: 97 active+clean; 8.4 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 25 MiB/s wr, 68 op/s 2023-09-23T09:14:25.142 INFO:teuthology.orchestra.run.smithi082.stderr:44900000 of 50000000 tuples (89%) done (elapsed 1019.88 s, remaining 115.84 s) 2023-09-23T09:14:25.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:14:24 smithi161 ceph-mon[99580]: pgmap v550: 97 pgs: 97 active+clean; 8.4 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 25 MiB/s wr, 68 op/s 2023-09-23T09:14:26.451 INFO:teuthology.orchestra.run.smithi082.stderr:45000000 of 50000000 tuples (90%) done (elapsed 1021.19 s, remaining 113.47 s) 2023-09-23T09:14:27.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:14:26 smithi135 ceph-mon[99205]: pgmap v551: 97 pgs: 97 active+clean; 8.5 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 36 MiB/s wr, 87 op/s 2023-09-23T09:14:27.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:14:26 smithi082 ceph-mon[97694]: pgmap v551: 97 pgs: 97 active+clean; 8.5 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 36 MiB/s wr, 87 op/s 2023-09-23T09:14:27.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:14:26 smithi161 ceph-mon[99580]: pgmap v551: 97 pgs: 97 active+clean; 8.5 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 36 MiB/s wr, 87 op/s 2023-09-23T09:14:27.757 INFO:teuthology.orchestra.run.smithi082.stderr:45100000 of 50000000 tuples (90%) done (elapsed 1022.50 s, remaining 111.09 s) 2023-09-23T09:14:29.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:14:28 smithi135 ceph-mon[99205]: pgmap v552: 97 pgs: 97 active+clean; 8.5 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 24 MiB/s wr, 50 op/s 2023-09-23T09:14:29.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:14:28 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:14:29.089 INFO:teuthology.orchestra.run.smithi082.stderr:45200000 of 50000000 tuples (90%) done (elapsed 1023.83 s, remaining 108.73 s) 2023-09-23T09:14:29.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:14:28 smithi082 ceph-mon[97694]: pgmap v552: 97 pgs: 97 active+clean; 8.5 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 24 MiB/s wr, 50 op/s 2023-09-23T09:14:29.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:14:28 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:14:29.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:14:28 smithi161 ceph-mon[99580]: pgmap v552: 97 pgs: 97 active+clean; 8.5 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 24 MiB/s wr, 50 op/s 2023-09-23T09:14:29.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:14:28 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:14:30.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:14:29 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:14:30.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:14:29 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:14:30.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:14:29 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:14:30.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:14:29 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:14:30.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:14:29 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:14:30.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:14:29 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:14:30.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:14:29 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:14:30.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:14:29 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:14:30.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:14:29 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:14:30.340 INFO:teuthology.orchestra.run.smithi082.stderr:45300000 of 50000000 tuples (90%) done (elapsed 1025.08 s, remaining 106.36 s) 2023-09-23T09:14:31.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:14:30 smithi135 ceph-mon[99205]: pgmap v553: 97 pgs: 97 active+clean; 8.6 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 35 MiB/s wr, 100 op/s 2023-09-23T09:14:31.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:14:30 smithi082 ceph-mon[97694]: pgmap v553: 97 pgs: 97 active+clean; 8.6 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 35 MiB/s wr, 100 op/s 2023-09-23T09:14:31.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:14:30 smithi161 ceph-mon[99580]: pgmap v553: 97 pgs: 97 active+clean; 8.6 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 35 MiB/s wr, 100 op/s 2023-09-23T09:14:31.572 INFO:teuthology.orchestra.run.smithi082.stderr:45400000 of 50000000 tuples (90%) done (elapsed 1026.31 s, remaining 103.99 s) 2023-09-23T09:14:32.905 INFO:teuthology.orchestra.run.smithi082.stderr:45500000 of 50000000 tuples (91%) done (elapsed 1027.65 s, remaining 101.64 s) 2023-09-23T09:14:33.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:14:32 smithi135 ceph-mon[99205]: pgmap v554: 97 pgs: 97 active+clean; 8.6 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 24 MiB/s wr, 71 op/s 2023-09-23T09:14:33.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:14:32 smithi082 ceph-mon[97694]: pgmap v554: 97 pgs: 97 active+clean; 8.6 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 24 MiB/s wr, 71 op/s 2023-09-23T09:14:33.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:14:32 smithi161 ceph-mon[99580]: pgmap v554: 97 pgs: 97 active+clean; 8.6 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 24 MiB/s wr, 71 op/s 2023-09-23T09:14:35.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:14:34 smithi135 ceph-mon[99205]: pgmap v555: 97 pgs: 97 active+clean; 8.6 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 24 MiB/s wr, 71 op/s 2023-09-23T09:14:35.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:14:34 smithi082 ceph-mon[97694]: pgmap v555: 97 pgs: 97 active+clean; 8.6 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 24 MiB/s wr, 71 op/s 2023-09-23T09:14:35.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:14:34 smithi161 ceph-mon[99580]: pgmap v555: 97 pgs: 97 active+clean; 8.6 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 24 MiB/s wr, 71 op/s 2023-09-23T09:14:35.446 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:14:35.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.654+0000 7fa75a3ff700 1 -- 172.21.15.82:0/1139557258 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa754108aa0 msgr2=0x7fa754108e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:14:35.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.654+0000 7fa75a3ff700 1 --2- 172.21.15.82:0/1139557258 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa754108aa0 0x7fa754108e80 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fa744009990 tx=0x7fa744009ca0 comp rx=0 tx=0).stop 2023-09-23T09:14:35.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.655+0000 7fa75a3ff700 1 -- 172.21.15.82:0/1139557258 shutdown_connections 2023-09-23T09:14:35.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.655+0000 7fa75a3ff700 1 --2- 172.21.15.82:0/1139557258 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa754103450 0x7fa75410f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:14:35.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.655+0000 7fa75a3ff700 1 --2- 172.21.15.82:0/1139557258 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa754108aa0 0x7fa754108e80 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:14:35.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.655+0000 7fa75a3ff700 1 --2- 172.21.15.82:0/1139557258 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa754102a90 0x7fa754102f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:14:35.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.655+0000 7fa75a3ff700 1 -- 172.21.15.82:0/1139557258 >> 172.21.15.82:0/1139557258 conn(0x7fa7540fe580 msgr2=0x7fa7541009a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:14:35.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.655+0000 7fa75a3ff700 1 -- 172.21.15.82:0/1139557258 shutdown_connections 2023-09-23T09:14:35.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.655+0000 7fa75a3ff700 1 -- 172.21.15.82:0/1139557258 wait complete. 2023-09-23T09:14:35.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.656+0000 7fa75a3ff700 1 Processor -- start 2023-09-23T09:14:35.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.656+0000 7fa75a3ff700 1 -- start start 2023-09-23T09:14:35.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.656+0000 7fa75a3ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa754102a90 0x7fa75419e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:14:35.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.656+0000 7fa75a3ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa754103450 0x7fa75419ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:14:35.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.656+0000 7fa75a3ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa754108aa0 0x7fa754198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:14:35.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.656+0000 7fa75a3ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa754199000 con 0x7fa754102a90 2023-09-23T09:14:35.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.656+0000 7fa75a3ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa754199170 con 0x7fa754108aa0 2023-09-23T09:14:35.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.656+0000 7fa75a3ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa754199330 con 0x7fa754103450 2023-09-23T09:14:35.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.657+0000 7fa753fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa754102a90 0x7fa75419e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:14:35.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.657+0000 7fa753fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa754102a90 0x7fa75419e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57174/0 (socket says 172.21.15.82:57174) 2023-09-23T09:14:35.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.657+0000 7fa7537fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa754103450 0x7fa75419ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:14:35.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.657+0000 7fa753fff700 1 -- 172.21.15.82:0/3772481895 learned_addr learned my addr 172.21.15.82:0/3772481895 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:14:35.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.657+0000 7fa75899c700 1 --2- 172.21.15.82:0/3772481895 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa754108aa0 0x7fa754198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:14:35.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.657+0000 7fa753fff700 1 -- 172.21.15.82:0/3772481895 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa754103450 msgr2=0x7fa75419ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:14:35.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.657+0000 7fa753fff700 1 --2- 172.21.15.82:0/3772481895 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa754103450 0x7fa75419ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:14:35.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.657+0000 7fa753fff700 1 -- 172.21.15.82:0/3772481895 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa754108aa0 msgr2=0x7fa754198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:14:35.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.657+0000 7fa753fff700 1 --2- 172.21.15.82:0/3772481895 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa754108aa0 0x7fa754198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:14:35.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.657+0000 7fa753fff700 1 -- 172.21.15.82:0/3772481895 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7440095f0 con 0x7fa754102a90 2023-09-23T09:14:35.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.657+0000 7fa753fff700 1 --2- 172.21.15.82:0/3772481895 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa754102a90 0x7fa75419e8d0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fa7440036c0 tx=0x7fa744005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:14:35.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.657+0000 7fa7517fa700 1 -- 172.21.15.82:0/3772481895 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74401d070 con 0x7fa754102a90 2023-09-23T09:14:35.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.658+0000 7fa7517fa700 1 -- 172.21.15.82:0/3772481895 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa744003ec0 con 0x7fa754102a90 2023-09-23T09:14:35.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.658+0000 7fa75a3ff700 1 -- 172.21.15.82:0/3772481895 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7541995b0 con 0x7fa754102a90 2023-09-23T09:14:35.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.658+0000 7fa7517fa700 1 -- 172.21.15.82:0/3772481895 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa744022b00 con 0x7fa754102a90 2023-09-23T09:14:35.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.658+0000 7fa75a3ff700 1 -- 172.21.15.82:0/3772481895 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7541a58c0 con 0x7fa754102a90 2023-09-23T09:14:35.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.661+0000 7fa7517fa700 1 -- 172.21.15.82:0/3772481895 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7fa744004030 con 0x7fa754102a90 2023-09-23T09:14:35.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.662+0000 7fa7517fa700 1 --2- 172.21.15.82:0/3772481895 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fa73c0a0140 0x7fa73c0a2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:14:35.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.662+0000 7fa76dd8bb80 1 Processor -- start 2023-09-23T09:14:35.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.662+0000 7fa7517fa700 1 -- 172.21.15.82:0/3772481895 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fa7440ccb90 con 0x7fa754102a90 2023-09-23T09:14:35.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.662+0000 7fa76dd8bb80 1 -- start start 2023-09-23T09:14:35.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.662+0000 7fa7537fe700 1 --2- 172.21.15.82:0/3772481895 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fa73c0a0140 0x7fa73c0a2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:14:35.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.662+0000 7fa76dd8bb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b62f226380 0x55b62f226760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:14:35.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.663+0000 7fa76dd8bb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b62f226ca0 0x55b62f220700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:14:35.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.663+0000 7fa76dd8bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b62f220c40 0x55b62f2210a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:14:35.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.663+0000 7fa76dd8bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b62f1887b0 con 0x55b62f220c40 2023-09-23T09:14:35.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.663+0000 7fa76dd8bb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b62f179780 con 0x55b62f226380 2023-09-23T09:14:35.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.663+0000 7fa76dd8bb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b62f1770a0 con 0x55b62f226ca0 2023-09-23T09:14:35.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.663+0000 7fa753fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b62f226380 0x55b62f226760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:14:35.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.663+0000 7fa7537fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b62f226ca0 0x55b62f220700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:14:35.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.663+0000 7fa753fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b62f226380 0x55b62f226760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:60938/0 (socket says 172.21.15.82:60938) 2023-09-23T09:14:35.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.663+0000 7fa7537fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b62f226ca0 0x55b62f220700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:47904/0 (socket says 172.21.15.82:47904) 2023-09-23T09:14:35.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.663+0000 7fa753fff700 1 -- 172.21.15.82:0/877504192 learned_addr learned my addr 172.21.15.82:0/877504192 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:14:35.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.663+0000 7fa7537fe700 1 --2- 172.21.15.82:0/3772481895 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fa73c0a0140 0x7fa73c0a2600 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa754100f60 tx=0x7fa74800b410 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:14:35.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.663+0000 7fa75899c700 1 --2- 172.21.15.82:0/877504192 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b62f220c40 0x55b62f2210a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:14:35.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.663+0000 7fa753fff700 1 -- 172.21.15.82:0/877504192 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b62f226ca0 msgr2=0x55b62f220700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:14:35.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.663+0000 7fa753fff700 1 --2- 172.21.15.82:0/877504192 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b62f226ca0 0x55b62f220700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:14:35.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.663+0000 7fa753fff700 1 -- 172.21.15.82:0/877504192 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b62f220c40 msgr2=0x55b62f2210a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:14:35.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.663+0000 7fa753fff700 1 --2- 172.21.15.82:0/877504192 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b62f220c40 0x55b62f2210a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:14:35.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.663+0000 7fa753fff700 1 -- 172.21.15.82:0/877504192 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b62eff2630 con 0x55b62f226380 2023-09-23T09:14:35.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.664+0000 7fa753fff700 1 --2- 172.21.15.82:0/877504192 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b62f226380 0x55b62f226760 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa744096d40 tx=0x7fa744009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d63ce8df18ebb9f server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:14:35.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.664+0000 7fa73a7fc700 1 -- 172.21.15.82:0/877504192 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74409e100 con 0x55b62f226380 2023-09-23T09:14:35.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.664+0000 7fa73a7fc700 1 -- 172.21.15.82:0/877504192 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa7440a2050 con 0x55b62f226380 2023-09-23T09:14:35.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.664+0000 7fa73a7fc700 1 -- 172.21.15.82:0/877504192 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74409a750 con 0x55b62f226380 2023-09-23T09:14:35.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.664+0000 7fa76dd8bb80 1 -- 172.21.15.82:0/877504192 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b62f226380 msgr2=0x55b62f226760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:14:35.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.664+0000 7fa76dd8bb80 1 --2- 172.21.15.82:0/877504192 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b62f226380 0x55b62f226760 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa744096d40 tx=0x7fa744009310 comp rx=0 tx=0).stop 2023-09-23T09:14:35.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.665+0000 7fa76dd8bb80 1 -- 172.21.15.82:0/877504192 shutdown_connections 2023-09-23T09:14:35.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.665+0000 7fa76dd8bb80 1 --2- 172.21.15.82:0/877504192 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b62f220c40 0x55b62f2210a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:14:35.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.665+0000 7fa76dd8bb80 1 --2- 172.21.15.82:0/877504192 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b62f226380 0x55b62f226760 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:14:35.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.665+0000 7fa76dd8bb80 1 --2- 172.21.15.82:0/877504192 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b62f226ca0 0x55b62f220700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:14:35.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.665+0000 7fa76dd8bb80 1 -- 172.21.15.82:0/877504192 >> 172.21.15.82:0/877504192 conn(0x55b62f1950e0 msgr2=0x55b62f21b410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:14:35.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.665+0000 7fa76dd8bb80 1 -- 172.21.15.82:0/877504192 shutdown_connections 2023-09-23T09:14:35.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.665+0000 7fa76dd8bb80 1 -- 172.21.15.82:0/877504192 wait complete. 2023-09-23T09:14:35.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.665+0000 7fa76dd8bb80 1 -- start start 2023-09-23T09:14:35.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.665+0000 7fa76dd8bb80 1 Processor -- start 2023-09-23T09:14:35.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.666+0000 7fa76dd8bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b62f220c40 0x55b62f22cc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:14:35.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.666+0000 7fa76dd8bb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b62f226380 0x55b62f229e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:14:35.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.666+0000 7fa76dd8bb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b62f226ca0 0x55b62f22a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:14:35.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.666+0000 7fa76dd8bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b62f172990 con 0x55b62f220c40 2023-09-23T09:14:35.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.666+0000 7fa76dd8bb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b62f110bb0 con 0x55b62f226380 2023-09-23T09:14:35.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.666+0000 7fa76dd8bb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b62f1108b0 con 0x55b62f226ca0 2023-09-23T09:14:35.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.666+0000 7fa76dd8bb80 10 client.0 _ll_register_callbacks cb 0x55b62f05aa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:14:35.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.666+0000 7fa753fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b62f220c40 0x55b62f22cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:14:35.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.666+0000 7fa7537fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b62f226380 0x55b62f229e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:14:35.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.666+0000 7fa75899c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b62f226ca0 0x55b62f22a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:14:35.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.666+0000 7fa753fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b62f220c40 0x55b62f22cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57186/0 (socket says 172.21.15.82:57186) 2023-09-23T09:14:35.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.666+0000 7fa7537fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b62f226380 0x55b62f229e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:60944/0 (socket says 172.21.15.82:60944) 2023-09-23T09:14:35.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.666+0000 7fa753fff700 1 -- 172.21.15.82:0/4081900653 learned_addr learned my addr 172.21.15.82:0/4081900653 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:14:35.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.666+0000 7fa753fff700 1 -- 172.21.15.82:0/4081900653 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b62f226ca0 msgr2=0x55b62f22a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:14:35.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.666+0000 7fa753fff700 1 --2- 172.21.15.82:0/4081900653 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b62f226ca0 0x55b62f22a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:14:35.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.666+0000 7fa753fff700 1 -- 172.21.15.82:0/4081900653 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b62f226380 msgr2=0x55b62f229e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:14:35.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.666+0000 7fa753fff700 1 --2- 172.21.15.82:0/4081900653 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b62f226380 0x55b62f229e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:14:35.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.667+0000 7fa753fff700 1 -- 172.21.15.82:0/4081900653 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7541a58c0 con 0x55b62f220c40 2023-09-23T09:14:35.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.667+0000 7fa753fff700 1 --2- 172.21.15.82:0/4081900653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b62f220c40 0x55b62f22cc00 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fa744096050 tx=0x7fa744096740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=943fb02ff193e17c server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:14:35.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.667+0000 7fa7337fe700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:14:35.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.667+0000 7fa7337fe700 1 -- 172.21.15.82:0/4081900653 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7440a2050 con 0x55b62f220c40 2023-09-23T09:14:35.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.667+0000 7fa7337fe700 1 -- 172.21.15.82:0/4081900653 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(111..111 src has 1..111) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fa74409e100 con 0x55b62f220c40 2023-09-23T09:14:35.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.667+0000 7fa76dd8bb80 1 -- 172.21.15.82:0/4081900653 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b62f1f01c0 con 0x55b62f220c40 2023-09-23T09:14:35.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.667+0000 7fa7337fe700 1 -- 172.21.15.82:0/4081900653 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=67) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa744066250 con 0x55b62f220c40 2023-09-23T09:14:35.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.667+0000 7fa76dd8bb80 10 client.16635 fetch_fsmap learned FSMap version 67 2023-09-23T09:14:35.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.667+0000 7fa76dd8bb80 1 -- 172.21.15.82:0/4081900653 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=67,monmap=4+}) v3 -- 0x55b62ef9ede0 con 0x55b62f220c40 2023-09-23T09:14:35.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.667+0000 7fa7337fe700 1 -- 172.21.15.82:0/4081900653 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa7440ca020 con 0x55b62f220c40 2023-09-23T09:14:35.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.668+0000 7fa7337fe700 1 -- 172.21.15.82:0/4081900653 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 67) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fa7440998c0 con 0x55b62f220c40 2023-09-23T09:14:35.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.668+0000 7fa76dd8bb80 10 client.16635 fetch_fsmap finished waiting for FSMap version 67 2023-09-23T09:14:35.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.668+0000 7fa76dd8bb80 10 client.16635 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:14:35.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.668+0000 7fa76dd8bb80 20 client.16635 populate_metadata read hostname 'smithi082' 2023-09-23T09:14:35.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.668+0000 7fa76dd8bb80 1 --2- 172.21.15.82:0/4081900653 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55b62f239fb0 0x55b62f23c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:14:35.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.668+0000 7fa76dd8bb80 4 client.16635 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:14:35.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.668+0000 7fa76dd8bb80 1 -- 172.21.15.82:0/4081900653 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b62f118ba0 con 0x55b62f239fb0 2023-09-23T09:14:35.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.668+0000 7fa7537fe700 1 --2- 172.21.15.82:0/4081900653 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55b62f239fb0 0x55b62f23c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:14:35.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.669+0000 7fa7537fe700 1 --2- 172.21.15.82:0/4081900653 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55b62f239fb0 0x55b62f23c3d0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fafbe8ca74f4bd9e server_cookie=eb4b4d5e0c5f3aa9 in_seq=0 out_seq=0 2023-09-23T09:14:35.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.669+0000 7fa7337fe700 10 client.16635 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:14:35.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.669+0000 7fa7337fe700 1 -- 172.21.15.82:0/4081900653 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b62f118ba0 con 0x55b62f239fb0 2023-09-23T09:14:35.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.669+0000 7fa7337fe700 10 client.16635 handle_command_reply: tid=0 2023-09-23T09:14:35.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.669+0000 7fa76dd8bb80 1 client.16635 shutdown 2023-09-23T09:14:35.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.670+0000 7fa76dd8bb80 1 -- 172.21.15.82:0/4081900653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b62f220c40 msgr2=0x55b62f22cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:14:35.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.670+0000 7fa76dd8bb80 1 --2- 172.21.15.82:0/4081900653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b62f220c40 0x55b62f22cc00 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fa744096050 tx=0x7fa744096740 comp rx=0 tx=0).stop 2023-09-23T09:14:35.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.670+0000 7fa76dd8bb80 1 -- 172.21.15.82:0/4081900653 shutdown_connections 2023-09-23T09:14:35.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.670+0000 7fa76dd8bb80 1 --2- 172.21.15.82:0/4081900653 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b62f226ca0 0x55b62f22a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:14:35.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.670+0000 7fa76dd8bb80 1 --2- 172.21.15.82:0/4081900653 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55b62f239fb0 0x55b62f23c3d0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:14:35.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.670+0000 7fa76dd8bb80 1 --2- 172.21.15.82:0/4081900653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b62f220c40 0x55b62f22cc00 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:14:35.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.670+0000 7fa76dd8bb80 1 --2- 172.21.15.82:0/4081900653 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b62f226380 0x55b62f229e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:14:35.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.670+0000 7fa7337fe700 0 client.16635 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:14:35.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.670+0000 7fa76dd8bb80 1 -- 172.21.15.82:0/4081900653 >> 172.21.15.82:0/4081900653 conn(0x55b62f1950e0 msgr2=0x55b62f215b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:14:35.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.670+0000 7fa76dd8bb80 1 -- 172.21.15.82:0/4081900653 shutdown_connections 2023-09-23T09:14:35.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.670+0000 7fa76dd8bb80 1 -- 172.21.15.82:0/4081900653 wait complete. 2023-09-23T09:14:35.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.670+0000 7fa76dd8bb80 20 client.16635 trim_cache size 0 max 16384 2023-09-23T09:14:35.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.687+0000 7fa76dd8bb80 1 Processor -- start 2023-09-23T09:14:35.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.687+0000 7fa76dd8bb80 1 -- start start 2023-09-23T09:14:35.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.687+0000 7fa76dd8bb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b62f220c40 0x55b62f22c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:14:35.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.687+0000 7fa76dd8bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b62f226380 0x55b62f229640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:14:35.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.688+0000 7fa76dd8bb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b62f226ca0 0x55b62f229b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:14:35.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.688+0000 7fa76dd8bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b62eff4920 con 0x55b62f226380 2023-09-23T09:14:35.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.688+0000 7fa76dd8bb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b62f22b460 con 0x55b62f220c40 2023-09-23T09:14:35.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.688+0000 7fa76dd8bb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b62f217c80 con 0x55b62f226ca0 2023-09-23T09:14:35.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.688+0000 7fa7537fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b62f226380 0x55b62f229640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:14:35.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.688+0000 7fa753fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b62f220c40 0x55b62f22c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:14:35.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.688+0000 7fa7537fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b62f226380 0x55b62f229640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57202/0 (socket says 172.21.15.82:57202) 2023-09-23T09:14:35.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.688+0000 7fa7537fe700 1 -- 172.21.15.82:0/2219078498 learned_addr learned my addr 172.21.15.82:0/2219078498 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:14:35.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.688+0000 7fa75899c700 1 --2- 172.21.15.82:0/2219078498 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b62f226ca0 0x55b62f229b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:14:35.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.688+0000 7fa7537fe700 1 -- 172.21.15.82:0/2219078498 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b62f226ca0 msgr2=0x55b62f229b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:14:35.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.688+0000 7fa7537fe700 1 --2- 172.21.15.82:0/2219078498 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b62f226ca0 0x55b62f229b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:14:35.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.688+0000 7fa7537fe700 1 -- 172.21.15.82:0/2219078498 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b62f220c40 msgr2=0x55b62f22c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:14:35.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.688+0000 7fa7537fe700 1 --2- 172.21.15.82:0/2219078498 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b62f220c40 0x55b62f22c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:14:35.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.688+0000 7fa7537fe700 1 -- 172.21.15.82:0/2219078498 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b62f241000 con 0x55b62f226380 2023-09-23T09:14:35.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.688+0000 7fa753fff700 1 --2- 172.21.15.82:0/2219078498 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b62f220c40 0x55b62f22c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:14:35.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.688+0000 7fa7537fe700 1 --2- 172.21.15.82:0/2219078498 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b62f226380 0x55b62f229640 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fa748005950 tx=0x7fa748013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84e38e35db8ecfd1 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:14:35.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.689+0000 7fa73affd700 1 -- 172.21.15.82:0/2219078498 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa748024040 con 0x55b62f226380 2023-09-23T09:14:35.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.689+0000 7fa73affd700 1 -- 172.21.15.82:0/2219078498 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa748015070 con 0x55b62f226380 2023-09-23T09:14:35.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.689+0000 7fa73affd700 1 -- 172.21.15.82:0/2219078498 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74801e6f0 con 0x55b62f226380 2023-09-23T09:14:35.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.689+0000 7fa76dd8bb80 1 -- 172.21.15.82:0/2219078498 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b62f226380 msgr2=0x55b62f229640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:14:35.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.689+0000 7fa76dd8bb80 1 --2- 172.21.15.82:0/2219078498 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b62f226380 0x55b62f229640 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fa748005950 tx=0x7fa748013000 comp rx=0 tx=0).stop 2023-09-23T09:14:35.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.689+0000 7fa76dd8bb80 1 -- 172.21.15.82:0/2219078498 shutdown_connections 2023-09-23T09:14:35.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.689+0000 7fa76dd8bb80 1 --2- 172.21.15.82:0/2219078498 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b62f226ca0 0x55b62f229b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:14:35.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.689+0000 7fa76dd8bb80 1 --2- 172.21.15.82:0/2219078498 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b62f220c40 0x55b62f22c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:14:35.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.689+0000 7fa76dd8bb80 1 --2- 172.21.15.82:0/2219078498 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b62f226380 0x55b62f229640 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:14:35.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.689+0000 7fa76dd8bb80 1 -- 172.21.15.82:0/2219078498 >> 172.21.15.82:0/2219078498 conn(0x55b62f1950e0 msgr2=0x55b62f236640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:14:35.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.689+0000 7fa76dd8bb80 1 -- 172.21.15.82:0/2219078498 shutdown_connections 2023-09-23T09:14:35.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.689+0000 7fa76dd8bb80 1 -- 172.21.15.82:0/2219078498 wait complete. 2023-09-23T09:14:35.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.690+0000 7fa76dd8bb80 1 -- start start 2023-09-23T09:14:35.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.690+0000 7fa76dd8bb80 1 Processor -- start 2023-09-23T09:14:35.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.690+0000 7fa76dd8bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b62f220c40 0x55b62f223470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:14:35.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.690+0000 7fa76dd8bb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b62f226380 0x55b62f221e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:14:35.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.691+0000 7fa76dd8bb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b62f226ca0 0x55b62f222340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:14:35.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.691+0000 7fa76dd8bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b62f223af0 con 0x55b62f220c40 2023-09-23T09:14:35.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.691+0000 7fa76dd8bb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b62f222880 con 0x55b62f226ca0 2023-09-23T09:14:35.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.691+0000 7fa76dd8bb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b62f222a40 con 0x55b62f226380 2023-09-23T09:14:35.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.691+0000 7fa76dd8bb80 10 client.0 _ll_register_callbacks cb 0x7fa74c009620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:14:35.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.691+0000 7fa753fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b62f220c40 0x55b62f223470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:14:35.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.691+0000 7fa753fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b62f220c40 0x55b62f223470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57206/0 (socket says 172.21.15.82:57206) 2023-09-23T09:14:35.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.691+0000 7fa753fff700 1 -- 172.21.15.82:0/4083026081 learned_addr learned my addr 172.21.15.82:0/4083026081 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:14:35.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.691+0000 7fa7537fe700 1 --2- 172.21.15.82:0/4083026081 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b62f226380 0x55b62f221e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:14:35.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.691+0000 7fa75899c700 1 --2- 172.21.15.82:0/4083026081 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b62f226ca0 0x55b62f222340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:14:35.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.691+0000 7fa753fff700 1 -- 172.21.15.82:0/4083026081 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b62f226380 msgr2=0x55b62f221e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:14:35.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.691+0000 7fa753fff700 1 --2- 172.21.15.82:0/4083026081 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b62f226380 0x55b62f221e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:14:35.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.691+0000 7fa753fff700 1 -- 172.21.15.82:0/4083026081 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b62f226ca0 msgr2=0x55b62f222340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:14:35.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.691+0000 7fa753fff700 1 --2- 172.21.15.82:0/4083026081 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b62f226ca0 0x55b62f222340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:14:35.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.691+0000 7fa753fff700 1 -- 172.21.15.82:0/4083026081 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b62ef9ede0 con 0x55b62f220c40 2023-09-23T09:14:35.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.691+0000 7fa753fff700 1 --2- 172.21.15.82:0/4083026081 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b62f220c40 0x55b62f223470 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fa74409a260 tx=0x7fa7440094b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b09b83fe2181e3c4 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:14:35.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.691+0000 7fa7337fe700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:14:35.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.692+0000 7fa7337fe700 1 -- 172.21.15.82:0/4083026081 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7440a2050 con 0x55b62f220c40 2023-09-23T09:14:35.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.692+0000 7fa7337fe700 1 -- 172.21.15.82:0/4083026081 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(111..111 src has 1..111) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fa74409e100 con 0x55b62f220c40 2023-09-23T09:14:35.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.692+0000 7fa76dd8bb80 1 -- 172.21.15.82:0/4083026081 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b62f2138b0 con 0x55b62f220c40 2023-09-23T09:14:35.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.692+0000 7fa7337fe700 1 -- 172.21.15.82:0/4083026081 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=67) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa74409a9d0 con 0x55b62f220c40 2023-09-23T09:14:35.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.692+0000 7fa76dd8bb80 10 client.16641 fetch_fsmap learned FSMap version 67 2023-09-23T09:14:35.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.692+0000 7fa76dd8bb80 1 -- 172.21.15.82:0/4083026081 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=67,monmap=4+}) v3 -- 0x7fa748011440 con 0x55b62f220c40 2023-09-23T09:14:35.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.692+0000 7fa7337fe700 1 -- 172.21.15.82:0/4083026081 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b62f2138b0 con 0x55b62f220c40 2023-09-23T09:14:35.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.692+0000 7fa7337fe700 1 -- 172.21.15.82:0/4083026081 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 67) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fa744099850 con 0x55b62f220c40 2023-09-23T09:14:35.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.692+0000 7fa76dd8bb80 10 client.16641 fetch_fsmap finished waiting for FSMap version 67 2023-09-23T09:14:35.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.692+0000 7fa76dd8bb80 10 client.16641 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:14:35.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.692+0000 7fa76dd8bb80 20 client.16641 populate_metadata read hostname 'smithi082' 2023-09-23T09:14:35.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.692+0000 7fa76dd8bb80 1 --2- 172.21.15.82:0/4083026081 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55b62f28ecc0 0x55b62f2910e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:14:35.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.692+0000 7fa76dd8bb80 4 client.16641 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:14:35.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.692+0000 7fa76dd8bb80 1 -- 172.21.15.82:0/4083026081 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55b62f16b970 con 0x55b62f28ecc0 2023-09-23T09:14:35.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.692+0000 7fa7537fe700 1 --2- 172.21.15.82:0/4083026081 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55b62f28ecc0 0x55b62f2910e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:14:35.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.693+0000 7fa7337fe700 10 client.16641 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:14:35.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.693+0000 7fa7537fe700 1 --2- 172.21.15.82:0/4083026081 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55b62f28ecc0 0x55b62f2910e0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7528b725b37ee1d server_cookie=5ebe10c52587515f in_seq=0 out_seq=0 2023-09-23T09:14:35.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.694+0000 7fa7337fe700 1 -- 172.21.15.82:0/4083026081 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55b62f16b970 con 0x55b62f28ecc0 2023-09-23T09:14:35.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.694+0000 7fa7337fe700 10 client.16641 handle_command_reply: tid=0 2023-09-23T09:14:35.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.694+0000 7fa76dd8bb80 1 client.16641 shutdown 2023-09-23T09:14:35.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.694+0000 7fa76dd8bb80 1 -- 172.21.15.82:0/4083026081 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b62f220c40 msgr2=0x55b62f223470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:14:35.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.694+0000 7fa76dd8bb80 1 --2- 172.21.15.82:0/4083026081 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b62f220c40 0x55b62f223470 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fa74409a260 tx=0x7fa7440094b0 comp rx=0 tx=0).stop 2023-09-23T09:14:35.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.694+0000 7fa76dd8bb80 1 -- 172.21.15.82:0/4083026081 shutdown_connections 2023-09-23T09:14:35.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.694+0000 7fa76dd8bb80 1 --2- 172.21.15.82:0/4083026081 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b62f226ca0 0x55b62f222340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:14:35.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.694+0000 7fa76dd8bb80 1 --2- 172.21.15.82:0/4083026081 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55b62f28ecc0 0x55b62f2910e0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:14:35.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.694+0000 7fa76dd8bb80 1 --2- 172.21.15.82:0/4083026081 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b62f220c40 0x55b62f223470 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:14:35.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.694+0000 7fa7337fe700 0 client.16641 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:14:35.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.694+0000 7fa76dd8bb80 1 --2- 172.21.15.82:0/4083026081 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b62f226380 0x55b62f221e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:14:35.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.694+0000 7fa76dd8bb80 1 -- 172.21.15.82:0/4083026081 >> 172.21.15.82:0/4083026081 conn(0x55b62f1950e0 msgr2=0x55b62f2152b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:14:35.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.694+0000 7fa76dd8bb80 1 -- 172.21.15.82:0/4083026081 shutdown_connections 2023-09-23T09:14:35.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.694+0000 7fa76dd8bb80 1 -- 172.21.15.82:0/4083026081 wait complete. 2023-09-23T09:14:35.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.694+0000 7fa76dd8bb80 20 client.16641 trim_cache size 0 max 16384 2023-09-23T09:14:35.704 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:14:35.704 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "IDLE (waiting for more scrubs)", 2023-09-23T09:14:35.704 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:14:35.704 INFO:teuthology.orchestra.run.smithi082.stdout: "cba46b77-20dd-437c-a60a-ac01b400e1b8": { 2023-09-23T09:14:35.704 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:14:35.704 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "cba46b77-20dd-437c-a60a-ac01b400e1b8", 2023-09-23T09:14:35.704 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:14:35.704 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:14:35.704 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:14:35.705 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:14:35.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.695+0000 7fa75a3ff700 1 -- 172.21.15.82:0/3772481895 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fa73c0a0140 msgr2=0x7fa73c0a2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:14:35.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.695+0000 7fa75a3ff700 1 --2- 172.21.15.82:0/3772481895 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fa73c0a0140 0x7fa73c0a2600 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa754100f60 tx=0x7fa74800b410 comp rx=0 tx=0).stop 2023-09-23T09:14:35.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.695+0000 7fa75a3ff700 1 -- 172.21.15.82:0/3772481895 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa754102a90 msgr2=0x7fa75419e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:14:35.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.695+0000 7fa75a3ff700 1 --2- 172.21.15.82:0/3772481895 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa754102a90 0x7fa75419e8d0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fa7440036c0 tx=0x7fa744005740 comp rx=0 tx=0).stop 2023-09-23T09:14:35.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.695+0000 7fa75a3ff700 1 -- 172.21.15.82:0/3772481895 shutdown_connections 2023-09-23T09:14:35.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.695+0000 7fa75a3ff700 1 --2- 172.21.15.82:0/3772481895 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fa73c0a0140 0x7fa73c0a2600 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:14:35.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.695+0000 7fa75a3ff700 1 --2- 172.21.15.82:0/3772481895 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa754108aa0 0x7fa754198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:14:35.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.695+0000 7fa75a3ff700 1 --2- 172.21.15.82:0/3772481895 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa754102a90 0x7fa75419e8d0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:14:35.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.695+0000 7fa75a3ff700 1 --2- 172.21.15.82:0/3772481895 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa754103450 0x7fa75419ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:14:35.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.695+0000 7fa75a3ff700 1 -- 172.21.15.82:0/3772481895 >> 172.21.15.82:0/3772481895 conn(0x7fa7540fe580 msgr2=0x7fa7540fed70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:14:35.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.695+0000 7fa75a3ff700 1 -- 172.21.15.82:0/3772481895 shutdown_connections 2023-09-23T09:14:35.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:14:35.695+0000 7fa75a3ff700 1 -- 172.21.15.82:0/3772481895 wait complete. 2023-09-23T09:14:35.715 INFO:tasks.cephfs.filesystem:scrub status for tag:cba46b77-20dd-437c-a60a-ac01b400e1b8 - {'path': '/', 'tag': 'cba46b77-20dd-437c-a60a-ac01b400e1b8', 'options': 'recursive,force'} 2023-09-23T09:14:36.001 INFO:teuthology.orchestra.run.smithi082.stderr:45600000 of 50000000 tuples (91%) done (elapsed 1030.74 s, remaining 99.46 s) 2023-09-23T09:14:37.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:14:36 smithi135 ceph-mon[99205]: pgmap v556: 97 pgs: 97 active+clean; 8.7 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 215 KiB/s rd, 35 MiB/s wr, 106 op/s 2023-09-23T09:14:37.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:14:36 smithi082 ceph-mon[97694]: pgmap v556: 97 pgs: 97 active+clean; 8.7 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 215 KiB/s rd, 35 MiB/s wr, 106 op/s 2023-09-23T09:14:37.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:14:36 smithi161 ceph-mon[99580]: pgmap v556: 97 pgs: 97 active+clean; 8.7 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 215 KiB/s rd, 35 MiB/s wr, 106 op/s 2023-09-23T09:14:37.275 INFO:teuthology.orchestra.run.smithi082.stderr:45700000 of 50000000 tuples (91%) done (elapsed 1032.02 s, remaining 97.10 s) 2023-09-23T09:14:38.509 INFO:teuthology.orchestra.run.smithi082.stderr:45800000 of 50000000 tuples (91%) done (elapsed 1033.25 s, remaining 94.75 s) 2023-09-23T09:14:39.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:14:38 smithi135 ceph-mon[99205]: pgmap v557: 97 pgs: 97 active+clean; 8.7 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 23 MiB/s wr, 85 op/s 2023-09-23T09:14:39.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:14:38 smithi082 ceph-mon[97694]: pgmap v557: 97 pgs: 97 active+clean; 8.7 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 23 MiB/s wr, 85 op/s 2023-09-23T09:14:39.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:14:38 smithi161 ceph-mon[99580]: pgmap v557: 97 pgs: 97 active+clean; 8.7 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 23 MiB/s wr, 85 op/s 2023-09-23T09:14:39.827 INFO:teuthology.orchestra.run.smithi082.stderr:45900000 of 50000000 tuples (91%) done (elapsed 1034.57 s, remaining 92.41 s) 2023-09-23T09:14:41.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:14:40 smithi135 ceph-mon[99205]: pgmap v558: 97 pgs: 97 active+clean; 8.7 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 31 MiB/s wr, 117 op/s 2023-09-23T09:14:41.088 INFO:teuthology.orchestra.run.smithi082.stderr:46000000 of 50000000 tuples (92%) done (elapsed 1035.83 s, remaining 90.07 s) 2023-09-23T09:14:41.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:14:40 smithi082 ceph-mon[97694]: pgmap v558: 97 pgs: 97 active+clean; 8.7 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 31 MiB/s wr, 117 op/s 2023-09-23T09:14:41.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:14:40 smithi161 ceph-mon[99580]: pgmap v558: 97 pgs: 97 active+clean; 8.7 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 31 MiB/s wr, 117 op/s 2023-09-23T09:14:42.347 INFO:teuthology.orchestra.run.smithi082.stderr:46100000 of 50000000 tuples (92%) done (elapsed 1037.09 s, remaining 87.74 s) 2023-09-23T09:14:43.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:14:42 smithi135 ceph-mon[99205]: pgmap v559: 97 pgs: 97 active+clean; 8.7 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 19 MiB/s wr, 67 op/s 2023-09-23T09:14:43.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:14:42 smithi082 ceph-mon[97694]: pgmap v559: 97 pgs: 97 active+clean; 8.7 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 19 MiB/s wr, 67 op/s 2023-09-23T09:14:43.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:14:42 smithi161 ceph-mon[99580]: pgmap v559: 97 pgs: 97 active+clean; 8.7 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 19 MiB/s wr, 67 op/s 2023-09-23T09:14:43.661 INFO:teuthology.orchestra.run.smithi082.stderr:46200000 of 50000000 tuples (92%) done (elapsed 1038.40 s, remaining 85.41 s) 2023-09-23T09:14:44.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:14:43 smithi082 ceph-mon[97694]: pgmap v560: 97 pgs: 97 active+clean; 8.7 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 19 MiB/s wr, 67 op/s 2023-09-23T09:14:44.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:14:43 smithi161 ceph-mon[99580]: pgmap v560: 97 pgs: 97 active+clean; 8.7 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 19 MiB/s wr, 67 op/s 2023-09-23T09:14:44.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:14:43 smithi135 ceph-mon[99205]: pgmap v560: 97 pgs: 97 active+clean; 8.7 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 19 MiB/s wr, 67 op/s 2023-09-23T09:14:44.925 INFO:teuthology.orchestra.run.smithi082.stderr:46300000 of 50000000 tuples (92%) done (elapsed 1039.67 s, remaining 83.08 s) 2023-09-23T09:14:46.284 INFO:teuthology.orchestra.run.smithi082.stderr:46400000 of 50000000 tuples (92%) done (elapsed 1041.03 s, remaining 80.77 s) 2023-09-23T09:14:46.752 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:14:46 smithi082 ceph-mon[97694]: pgmap v561: 97 pgs: 97 active+clean; 8.8 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 31 MiB/s wr, 111 op/s 2023-09-23T09:14:46.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:14:46 smithi135 ceph-mon[99205]: pgmap v561: 97 pgs: 97 active+clean; 8.8 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 31 MiB/s wr, 111 op/s 2023-09-23T09:14:46.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:14:46 smithi161 ceph-mon[99580]: pgmap v561: 97 pgs: 97 active+clean; 8.8 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 31 MiB/s wr, 111 op/s 2023-09-23T09:14:47.814 INFO:teuthology.orchestra.run.smithi082.stderr:46500000 of 50000000 tuples (93%) done (elapsed 1042.56 s, remaining 78.47 s) 2023-09-23T09:14:49.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:14:48 smithi135 ceph-mon[99205]: pgmap v562: 97 pgs: 97 active+clean; 8.8 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 20 MiB/s wr, 76 op/s 2023-09-23T09:14:49.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:14:48 smithi082 ceph-mon[97694]: pgmap v562: 97 pgs: 97 active+clean; 8.8 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 20 MiB/s wr, 76 op/s 2023-09-23T09:14:49.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:14:48 smithi161 ceph-mon[99580]: pgmap v562: 97 pgs: 97 active+clean; 8.8 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 20 MiB/s wr, 76 op/s 2023-09-23T09:14:49.197 INFO:teuthology.orchestra.run.smithi082.stderr:46600000 of 50000000 tuples (93%) done (elapsed 1043.94 s, remaining 76.17 s) 2023-09-23T09:14:50.484 INFO:teuthology.orchestra.run.smithi082.stderr:46700000 of 50000000 tuples (93%) done (elapsed 1045.23 s, remaining 73.86 s) 2023-09-23T09:14:51.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:14:50 smithi135 ceph-mon[99205]: pgmap v563: 97 pgs: 97 active+clean; 8.9 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 30 MiB/s wr, 117 op/s 2023-09-23T09:14:51.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:14:50 smithi082 ceph-mon[97694]: pgmap v563: 97 pgs: 97 active+clean; 8.9 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 30 MiB/s wr, 117 op/s 2023-09-23T09:14:51.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:14:50 smithi161 ceph-mon[99580]: pgmap v563: 97 pgs: 97 active+clean; 8.9 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 30 MiB/s wr, 117 op/s 2023-09-23T09:14:51.703 INFO:teuthology.orchestra.run.smithi082.stderr:46800000 of 50000000 tuples (93%) done (elapsed 1046.45 s, remaining 71.55 s) 2023-09-23T09:14:53.018 INFO:teuthology.orchestra.run.smithi082.stderr:46900000 of 50000000 tuples (93%) done (elapsed 1047.76 s, remaining 69.25 s) 2023-09-23T09:14:53.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:14:52 smithi135 ceph-mon[99205]: pgmap v564: 97 pgs: 97 active+clean; 8.9 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 23 MiB/s wr, 85 op/s 2023-09-23T09:14:53.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:14:52 smithi082 ceph-mon[97694]: pgmap v564: 97 pgs: 97 active+clean; 8.9 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 23 MiB/s wr, 85 op/s 2023-09-23T09:14:53.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:14:52 smithi161 ceph-mon[99580]: pgmap v564: 97 pgs: 97 active+clean; 8.9 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 23 MiB/s wr, 85 op/s 2023-09-23T09:14:54.265 INFO:teuthology.orchestra.run.smithi082.stderr:47000000 of 50000000 tuples (94%) done (elapsed 1049.01 s, remaining 66.96 s) 2023-09-23T09:14:55.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:14:54 smithi135 ceph-mon[99205]: pgmap v565: 97 pgs: 97 active+clean; 8.9 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 23 MiB/s wr, 85 op/s 2023-09-23T09:14:55.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:14:54 smithi082 ceph-mon[97694]: pgmap v565: 97 pgs: 97 active+clean; 8.9 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 23 MiB/s wr, 85 op/s 2023-09-23T09:14:55.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:14:54 smithi161 ceph-mon[99580]: pgmap v565: 97 pgs: 97 active+clean; 8.9 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 23 MiB/s wr, 85 op/s 2023-09-23T09:14:55.518 INFO:teuthology.orchestra.run.smithi082.stderr:47100000 of 50000000 tuples (94%) done (elapsed 1050.26 s, remaining 64.67 s) 2023-09-23T09:14:57.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:14:56 smithi135 ceph-mon[99205]: pgmap v566: 97 pgs: 97 active+clean; 9.0 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 34 MiB/s wr, 101 op/s 2023-09-23T09:14:57.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:14:56 smithi082 ceph-mon[97694]: pgmap v566: 97 pgs: 97 active+clean; 9.0 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 34 MiB/s wr, 101 op/s 2023-09-23T09:14:57.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:14:56 smithi161 ceph-mon[99580]: pgmap v566: 97 pgs: 97 active+clean; 9.0 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 34 MiB/s wr, 101 op/s 2023-09-23T09:14:57.242 INFO:teuthology.orchestra.run.smithi082.stderr:47200000 of 50000000 tuples (94%) done (elapsed 1051.98 s, remaining 62.41 s) 2023-09-23T09:14:58.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:14:57 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:14:58.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:14:57 smithi135 ceph-mon[99205]: scrub summary: idle+waiting paths [/] 2023-09-23T09:14:58.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:14:57 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:14:58.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:14:57 smithi082 ceph-mon[97694]: scrub summary: idle+waiting paths [/] 2023-09-23T09:14:58.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:14:57 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:14:58.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:14:57 smithi161 ceph-mon[99580]: scrub summary: idle+waiting paths [/] 2023-09-23T09:14:58.510 INFO:teuthology.orchestra.run.smithi082.stderr:47300000 of 50000000 tuples (94%) done (elapsed 1053.25 s, remaining 60.12 s) 2023-09-23T09:14:59.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:14:58 smithi135 ceph-mon[99205]: pgmap v567: 97 pgs: 97 active+clean; 9.0 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 22 MiB/s wr, 56 op/s 2023-09-23T09:14:59.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:14:58 smithi082 ceph-mon[97694]: pgmap v567: 97 pgs: 97 active+clean; 9.0 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 22 MiB/s wr, 56 op/s 2023-09-23T09:14:59.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:14:58 smithi161 ceph-mon[99580]: pgmap v567: 97 pgs: 97 active+clean; 9.0 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 22 MiB/s wr, 56 op/s 2023-09-23T09:14:59.773 INFO:teuthology.orchestra.run.smithi082.stderr:47400000 of 50000000 tuples (94%) done (elapsed 1054.52 s, remaining 57.84 s) 2023-09-23T09:15:01.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:15:00 smithi135 ceph-mon[99205]: pgmap v568: 97 pgs: 97 active+clean; 9.1 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 33 MiB/s wr, 91 op/s 2023-09-23T09:15:01.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:15:00 smithi082 ceph-mon[97694]: pgmap v568: 97 pgs: 97 active+clean; 9.1 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 33 MiB/s wr, 91 op/s 2023-09-23T09:15:01.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:15:00 smithi161 ceph-mon[99580]: pgmap v568: 97 pgs: 97 active+clean; 9.1 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 33 MiB/s wr, 91 op/s 2023-09-23T09:15:01.186 INFO:teuthology.orchestra.run.smithi082.stderr:47500000 of 50000000 tuples (95%) done (elapsed 1055.93 s, remaining 55.58 s) 2023-09-23T09:15:02.454 INFO:teuthology.orchestra.run.smithi082.stderr:47600000 of 50000000 tuples (95%) done (elapsed 1057.20 s, remaining 53.30 s) 2023-09-23T09:15:03.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:15:02 smithi135 ceph-mon[99205]: pgmap v569: 97 pgs: 97 active+clean; 9.1 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 22 MiB/s wr, 51 op/s 2023-09-23T09:15:03.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:15:02 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:15:03.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:15:02 smithi082 ceph-mon[97694]: pgmap v569: 97 pgs: 97 active+clean; 9.1 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 22 MiB/s wr, 51 op/s 2023-09-23T09:15:03.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:15:02 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:15:03.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:15:02 smithi161 ceph-mon[99580]: pgmap v569: 97 pgs: 97 active+clean; 9.1 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 22 MiB/s wr, 51 op/s 2023-09-23T09:15:03.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:15:02 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:15:03.726 INFO:teuthology.orchestra.run.smithi082.stderr:47700000 of 50000000 tuples (95%) done (elapsed 1058.47 s, remaining 51.04 s) 2023-09-23T09:15:04.974 INFO:teuthology.orchestra.run.smithi082.stderr:47800000 of 50000000 tuples (95%) done (elapsed 1059.72 s, remaining 48.77 s) 2023-09-23T09:15:05.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:15:04 smithi135 ceph-mon[99205]: pgmap v570: 97 pgs: 97 active+clean; 9.1 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 22 MiB/s wr, 51 op/s 2023-09-23T09:15:05.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:15:04 smithi082 ceph-mon[97694]: pgmap v570: 97 pgs: 97 active+clean; 9.1 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 22 MiB/s wr, 51 op/s 2023-09-23T09:15:05.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:15:04 smithi161 ceph-mon[99580]: pgmap v570: 97 pgs: 97 active+clean; 9.1 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 22 MiB/s wr, 51 op/s 2023-09-23T09:15:05.717 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:15:05.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.956+0000 7fb681fff700 1 -- 172.21.15.82:0/1036452160 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb67c10ae50 msgr2=0x7fb67c10d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:15:05.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.956+0000 7fb681fff700 1 --2- 172.21.15.82:0/1036452160 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb67c10ae50 0x7fb67c10d310 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fb67400b0a0 tx=0x7fb67400b3b0 comp rx=0 tx=0).stop 2023-09-23T09:15:05.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.957+0000 7fb681fff700 1 -- 172.21.15.82:0/1036452160 shutdown_connections 2023-09-23T09:15:05.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.957+0000 7fb681fff700 1 --2- 172.21.15.82:0/1036452160 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb67c10ae50 0x7fb67c10d310 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:05.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.957+0000 7fb681fff700 1 --2- 172.21.15.82:0/1036452160 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb67c101a30 0x7fb67c101e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:05.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.957+0000 7fb681fff700 1 --2- 172.21.15.82:0/1036452160 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb67c102350 0x7fb67c10a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:05.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.957+0000 7fb681fff700 1 -- 172.21.15.82:0/1036452160 >> 172.21.15.82:0/1036452160 conn(0x7fb67c0fb270 msgr2=0x7fb67c0fd690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:15:05.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.957+0000 7fb681fff700 1 -- 172.21.15.82:0/1036452160 shutdown_connections 2023-09-23T09:15:05.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.957+0000 7fb681fff700 1 -- 172.21.15.82:0/1036452160 wait complete. 2023-09-23T09:15:05.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.958+0000 7fb681fff700 1 Processor -- start 2023-09-23T09:15:05.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.958+0000 7fb681fff700 1 -- start start 2023-09-23T09:15:05.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.959+0000 7fb681fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb67c101a30 0x7fb67c196980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:05.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.959+0000 7fb681fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb67c102350 0x7fb67c196ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:05.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.959+0000 7fb681fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb67c10ae50 0x7fb67c19b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:05.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.959+0000 7fb681fff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb67c19b920 con 0x7fb67c10ae50 2023-09-23T09:15:05.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.959+0000 7fb681fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb67c19ba90 con 0x7fb67c102350 2023-09-23T09:15:05.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.959+0000 7fb681fff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb67c19bc50 con 0x7fb67c101a30 2023-09-23T09:15:05.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.959+0000 7fb67b7fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb67c101a30 0x7fb67c196980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:05.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.959+0000 7fb67bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb67c10ae50 0x7fb67c19b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:05.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.959+0000 7fb67b7fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb67c101a30 0x7fb67c196980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:55174/0 (socket says 172.21.15.82:55174) 2023-09-23T09:15:05.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.959+0000 7fb67b7fe700 1 -- 172.21.15.82:0/3212829314 learned_addr learned my addr 172.21.15.82:0/3212829314 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:15:05.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.959+0000 7fb67affd700 1 --2- 172.21.15.82:0/3212829314 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb67c102350 0x7fb67c196ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:05.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.959+0000 7fb67bfff700 1 -- 172.21.15.82:0/3212829314 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb67c101a30 msgr2=0x7fb67c196980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:15:05.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.959+0000 7fb67bfff700 1 --2- 172.21.15.82:0/3212829314 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb67c101a30 0x7fb67c196980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:05.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.959+0000 7fb67bfff700 1 -- 172.21.15.82:0/3212829314 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb67c102350 msgr2=0x7fb67c196ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:15:05.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.960+0000 7fb67bfff700 1 --2- 172.21.15.82:0/3212829314 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb67c102350 0x7fb67c196ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:05.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.960+0000 7fb67bfff700 1 -- 172.21.15.82:0/3212829314 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb674009d00 con 0x7fb67c10ae50 2023-09-23T09:15:05.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.960+0000 7fb67affd700 1 --2- 172.21.15.82:0/3212829314 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb67c102350 0x7fb67c196ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T09:15:05.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.960+0000 7fb67bfff700 1 --2- 172.21.15.82:0/3212829314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb67c10ae50 0x7fb67c19b350 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fb67400b0a0 tx=0x7fb674008ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:15:05.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.960+0000 7fb678ff9700 1 -- 172.21.15.82:0/3212829314 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67400e040 con 0x7fb67c10ae50 2023-09-23T09:15:05.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.960+0000 7fb678ff9700 1 -- 172.21.15.82:0/3212829314 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb67400be40 con 0x7fb67c10ae50 2023-09-23T09:15:05.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.960+0000 7fb681fff700 1 -- 172.21.15.82:0/3212829314 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb67c19bed0 con 0x7fb67c10ae50 2023-09-23T09:15:05.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.960+0000 7fb678ff9700 1 -- 172.21.15.82:0/3212829314 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb674005040 con 0x7fb67c10ae50 2023-09-23T09:15:05.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.960+0000 7fb681fff700 1 -- 172.21.15.82:0/3212829314 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb67c1a37e0 con 0x7fb67c10ae50 2023-09-23T09:15:05.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.964+0000 7fb678ff9700 1 -- 172.21.15.82:0/3212829314 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7fb67401d470 con 0x7fb67c10ae50 2023-09-23T09:15:05.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.966+0000 7fb69586db80 1 Processor -- start 2023-09-23T09:15:05.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.966+0000 7fb678ff9700 1 --2- 172.21.15.82:0/3212829314 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fb6640a0140 0x7fb6640a2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:05.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.966+0000 7fb69586db80 1 -- start start 2023-09-23T09:15:05.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.966+0000 7fb678ff9700 1 -- 172.21.15.82:0/3212829314 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fb6740cc970 con 0x7fb67c10ae50 2023-09-23T09:15:05.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.966+0000 7fb67affd700 1 --2- 172.21.15.82:0/3212829314 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fb6640a0140 0x7fb6640a2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:05.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.966+0000 7fb69586db80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e821da1380 0x55e821da1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:05.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.966+0000 7fb69586db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e821da1ca0 0x55e821d9b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:05.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.966+0000 7fb69586db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e821d9bc40 0x55e821d9c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:05.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.966+0000 7fb69586db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e821d037b0 con 0x55e821da1ca0 2023-09-23T09:15:05.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.966+0000 7fb69586db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e821cf4780 con 0x55e821d9bc40 2023-09-23T09:15:05.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.966+0000 7fb69586db80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e821cf20a0 con 0x55e821da1380 2023-09-23T09:15:05.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.967+0000 7fb67affd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e821da1ca0 0x55e821d9b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:05.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.967+0000 7fb67affd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e821da1ca0 0x55e821d9b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49522/0 (socket says 172.21.15.82:49522) 2023-09-23T09:15:05.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.967+0000 7fb67affd700 1 -- 172.21.15.82:0/274532894 learned_addr learned my addr 172.21.15.82:0/274532894 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:15:05.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.967+0000 7fb67b7fe700 1 --2- 172.21.15.82:0/274532894 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e821da1380 0x55e821da1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:05.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.967+0000 7fb67bfff700 1 --2- 172.21.15.82:0/274532894 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e821d9bc40 0x55e821d9c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:05.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.967+0000 7fb67affd700 1 --2- 172.21.15.82:0/3212829314 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fb6640a0140 0x7fb6640a2600 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb6700135f0 tx=0x7fb670013900 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:15:05.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.967+0000 7fb67b7fe700 1 -- 172.21.15.82:0/274532894 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e821d9bc40 msgr2=0x55e821d9c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:15:05.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.967+0000 7fb67b7fe700 1 --2- 172.21.15.82:0/274532894 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e821d9bc40 0x55e821d9c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:05.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.967+0000 7fb67b7fe700 1 -- 172.21.15.82:0/274532894 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e821da1ca0 msgr2=0x55e821d9b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:15:05.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.967+0000 7fb67b7fe700 1 --2- 172.21.15.82:0/274532894 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e821da1ca0 0x55e821d9b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:05.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.967+0000 7fb67b7fe700 1 -- 172.21.15.82:0/274532894 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e821b6d630 con 0x55e821da1380 2023-09-23T09:15:05.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.967+0000 7fb67affd700 1 --2- 172.21.15.82:0/274532894 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e821da1ca0 0x55e821d9b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:15:05.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.967+0000 7fb67bfff700 1 --2- 172.21.15.82:0/274532894 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e821d9bc40 0x55e821d9c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:15:05.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.968+0000 7fb67b7fe700 1 --2- 172.21.15.82:0/274532894 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e821da1380 0x55e821da1760 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb66c009d10 tx=0x7fb66c011720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6c7ccef33a2e679 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:15:05.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.968+0000 7fb661ffb700 1 -- 172.21.15.82:0/274532894 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb66c004250 con 0x55e821da1380 2023-09-23T09:15:05.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.968+0000 7fb661ffb700 1 -- 172.21.15.82:0/274532894 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb66c009e60 con 0x55e821da1380 2023-09-23T09:15:05.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.968+0000 7fb661ffb700 1 -- 172.21.15.82:0/274532894 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb66c0053e0 con 0x55e821da1380 2023-09-23T09:15:05.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.969+0000 7fb69586db80 1 -- 172.21.15.82:0/274532894 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e821da1380 msgr2=0x55e821da1760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:15:05.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.969+0000 7fb69586db80 1 --2- 172.21.15.82:0/274532894 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e821da1380 0x55e821da1760 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb66c009d10 tx=0x7fb66c011720 comp rx=0 tx=0).stop 2023-09-23T09:15:05.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.969+0000 7fb69586db80 1 -- 172.21.15.82:0/274532894 shutdown_connections 2023-09-23T09:15:05.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.969+0000 7fb69586db80 1 --2- 172.21.15.82:0/274532894 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e821d9bc40 0x55e821d9c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:05.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.969+0000 7fb69586db80 1 --2- 172.21.15.82:0/274532894 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e821da1380 0x55e821da1760 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:05.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.969+0000 7fb69586db80 1 --2- 172.21.15.82:0/274532894 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e821da1ca0 0x55e821d9b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:05.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.969+0000 7fb69586db80 1 -- 172.21.15.82:0/274532894 >> 172.21.15.82:0/274532894 conn(0x55e821d100e0 msgr2=0x55e821d96410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:15:05.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.969+0000 7fb69586db80 1 -- 172.21.15.82:0/274532894 shutdown_connections 2023-09-23T09:15:05.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.969+0000 7fb69586db80 1 -- 172.21.15.82:0/274532894 wait complete. 2023-09-23T09:15:05.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.969+0000 7fb69586db80 1 -- start start 2023-09-23T09:15:05.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.970+0000 7fb69586db80 1 Processor -- start 2023-09-23T09:15:05.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.970+0000 7fb69586db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e821d9bc40 0x55e821da7c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:05.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.970+0000 7fb69586db80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e821da1380 0x55e821da4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:05.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.970+0000 7fb69586db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e821da1ca0 0x55e821da5600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:05.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.970+0000 7fb69586db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e821ced990 con 0x55e821d9bc40 2023-09-23T09:15:05.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.970+0000 7fb69586db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e821c8bbb0 con 0x55e821da1ca0 2023-09-23T09:15:05.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.970+0000 7fb69586db80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e821c8b8b0 con 0x55e821da1380 2023-09-23T09:15:05.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.970+0000 7fb69586db80 10 client.0 _ll_register_callbacks cb 0x55e821bd5a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:15:05.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.971+0000 7fb67b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e821d9bc40 0x55e821da7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:05.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.971+0000 7fb67b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e821d9bc40 0x55e821da7c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49526/0 (socket says 172.21.15.82:49526) 2023-09-23T09:15:05.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.971+0000 7fb67b7fe700 1 -- 172.21.15.82:0/98737646 learned_addr learned my addr 172.21.15.82:0/98737646 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:15:05.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.971+0000 7fb67affd700 1 --2- 172.21.15.82:0/98737646 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e821da1380 0x55e821da4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:05.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.971+0000 7fb67bfff700 1 --2- 172.21.15.82:0/98737646 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e821da1ca0 0x55e821da5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:05.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.971+0000 7fb67b7fe700 1 -- 172.21.15.82:0/98737646 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e821da1380 msgr2=0x55e821da4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:15:05.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.971+0000 7fb67b7fe700 1 --2- 172.21.15.82:0/98737646 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e821da1380 0x55e821da4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:05.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.971+0000 7fb67b7fe700 1 -- 172.21.15.82:0/98737646 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e821da1ca0 msgr2=0x55e821da5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:15:05.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.971+0000 7fb67b7fe700 1 --2- 172.21.15.82:0/98737646 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e821da1ca0 0x55e821da5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:05.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.971+0000 7fb67b7fe700 1 -- 172.21.15.82:0/98737646 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb670011380 con 0x55e821d9bc40 2023-09-23T09:15:05.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.971+0000 7fb67b7fe700 1 --2- 172.21.15.82:0/98737646 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e821d9bc40 0x55e821da7c90 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fb66c004460 tx=0x7fb66c005d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55a7dcc3a87f3978 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:15:05.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.972+0000 7fb65affd700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:15:05.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.972+0000 7fb65affd700 1 -- 172.21.15.82:0/98737646 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb66c004ad0 con 0x55e821d9bc40 2023-09-23T09:15:05.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.972+0000 7fb65affd700 1 -- 172.21.15.82:0/98737646 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(111..111 src has 1..111) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fb66c004c30 con 0x55e821d9bc40 2023-09-23T09:15:05.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.972+0000 7fb69586db80 1 -- 172.21.15.82:0/98737646 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e821d6b1c0 con 0x55e821d9bc40 2023-09-23T09:15:05.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.972+0000 7fb65affd700 1 -- 172.21.15.82:0/98737646 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb66c004df0 con 0x55e821d9bc40 2023-09-23T09:15:05.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.972+0000 7fb69586db80 10 client.16653 fetch_fsmap learned FSMap version 69 2023-09-23T09:15:05.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.972+0000 7fb69586db80 1 -- 172.21.15.82:0/98737646 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=4+}) v3 -- 0x7fb66c009970 con 0x55e821d9bc40 2023-09-23T09:15:05.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.972+0000 7fb65affd700 1 -- 172.21.15.82:0/98737646 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55e821d6b1c0 con 0x55e821d9bc40 2023-09-23T09:15:05.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.973+0000 7fb65affd700 1 -- 172.21.15.82:0/98737646 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 69) v1 ==== 7906+0+0 (secure 0 0 0) 0x7fb66c003a20 con 0x55e821d9bc40 2023-09-23T09:15:05.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.973+0000 7fb69586db80 10 client.16653 fetch_fsmap finished waiting for FSMap version 69 2023-09-23T09:15:05.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.973+0000 7fb69586db80 10 client.16653 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:15:05.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.973+0000 7fb69586db80 20 client.16653 populate_metadata read hostname 'smithi082' 2023-09-23T09:15:05.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.973+0000 7fb69586db80 1 --2- 172.21.15.82:0/98737646 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55e821db9b40 0x55e821dbbf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:05.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.973+0000 7fb69586db80 4 client.16653 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:15:05.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.973+0000 7fb69586db80 1 -- 172.21.15.82:0/98737646 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e821c93ba0 con 0x55e821db9b40 2023-09-23T09:15:05.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.973+0000 7fb67affd700 1 --2- 172.21.15.82:0/98737646 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55e821db9b40 0x55e821dbbf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:05.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.974+0000 7fb67affd700 1 --2- 172.21.15.82:0/98737646 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55e821db9b40 0x55e821dbbf60 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=313aa4633d13250f server_cookie=1895435cfc9e6ac0 in_seq=0 out_seq=0 2023-09-23T09:15:05.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.974+0000 7fb65affd700 10 client.16653 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:15:05.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.975+0000 7fb65affd700 1 -- 172.21.15.82:0/98737646 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e821c93ba0 con 0x55e821db9b40 2023-09-23T09:15:05.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.975+0000 7fb65affd700 10 client.16653 handle_command_reply: tid=0 2023-09-23T09:15:05.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.975+0000 7fb69586db80 1 client.16653 shutdown 2023-09-23T09:15:05.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.975+0000 7fb69586db80 1 -- 172.21.15.82:0/98737646 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e821d9bc40 msgr2=0x55e821da7c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:15:05.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.975+0000 7fb69586db80 1 --2- 172.21.15.82:0/98737646 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e821d9bc40 0x55e821da7c90 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fb66c004460 tx=0x7fb66c005d90 comp rx=0 tx=0).stop 2023-09-23T09:15:05.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.975+0000 7fb69586db80 1 -- 172.21.15.82:0/98737646 shutdown_connections 2023-09-23T09:15:05.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.975+0000 7fb69586db80 1 --2- 172.21.15.82:0/98737646 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e821da1ca0 0x55e821da5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:05.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.975+0000 7fb69586db80 1 --2- 172.21.15.82:0/98737646 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55e821db9b40 0x55e821dbbf60 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:05.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.975+0000 7fb69586db80 1 --2- 172.21.15.82:0/98737646 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e821d9bc40 0x55e821da7c90 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:05.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.975+0000 7fb69586db80 1 --2- 172.21.15.82:0/98737646 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e821da1380 0x55e821da4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:05.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.975+0000 7fb65affd700 0 client.16653 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:15:05.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.975+0000 7fb69586db80 1 -- 172.21.15.82:0/98737646 >> 172.21.15.82:0/98737646 conn(0x55e821d100e0 msgr2=0x55e821d90b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:15:05.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.975+0000 7fb69586db80 1 -- 172.21.15.82:0/98737646 shutdown_connections 2023-09-23T09:15:05.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.975+0000 7fb69586db80 1 -- 172.21.15.82:0/98737646 wait complete. 2023-09-23T09:15:05.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:05.975+0000 7fb69586db80 20 client.16653 trim_cache size 0 max 16384 2023-09-23T09:15:06.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.000+0000 7fb69586db80 1 Processor -- start 2023-09-23T09:15:06.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.000+0000 7fb69586db80 1 -- start start 2023-09-23T09:15:06.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.000+0000 7fb69586db80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e821d9bc40 0x55e821da41d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:06.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.000+0000 7fb69586db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e821da1380 0x55e821da77c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:06.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.000+0000 7fb69586db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e821da1ca0 0x55e821da47b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:06.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.000+0000 7fb69586db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e821b6f920 con 0x55e821da1ca0 2023-09-23T09:15:06.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.000+0000 7fb69586db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e821d97150 con 0x55e821da1380 2023-09-23T09:15:06.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.000+0000 7fb69586db80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e821d98190 con 0x55e821d9bc40 2023-09-23T09:15:06.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.001+0000 7fb67bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e821da1ca0 0x55e821da47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:06.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.001+0000 7fb67b7fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e821d9bc40 0x55e821da41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:06.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.001+0000 7fb67bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e821da1ca0 0x55e821da47b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49536/0 (socket says 172.21.15.82:49536) 2023-09-23T09:15:06.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.001+0000 7fb67bfff700 1 -- 172.21.15.82:0/2138335263 learned_addr learned my addr 172.21.15.82:0/2138335263 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:15:06.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.001+0000 7fb67affd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e821da1380 0x55e821da77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:06.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.001+0000 7fb67affd700 1 -- 172.21.15.82:0/2138335263 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e821d9bc40 msgr2=0x55e821da41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:15:06.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.001+0000 7fb67affd700 1 --2- 172.21.15.82:0/2138335263 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e821d9bc40 0x55e821da41d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:06.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.001+0000 7fb67affd700 1 -- 172.21.15.82:0/2138335263 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e821da1ca0 msgr2=0x55e821da47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:15:06.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.001+0000 7fb67affd700 1 --2- 172.21.15.82:0/2138335263 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e821da1ca0 0x55e821da47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:06.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.001+0000 7fb67affd700 1 -- 172.21.15.82:0/2138335263 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e821b19de0 con 0x55e821da1380 2023-09-23T09:15:06.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.001+0000 7fb67b7fe700 1 --2- 172.21.15.82:0/2138335263 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e821d9bc40 0x55e821da41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:15:06.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.001+0000 7fb67bfff700 1 --2- 172.21.15.82:0/2138335263 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e821da1ca0 0x55e821da47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:15:06.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.002+0000 7fb67affd700 1 --2- 172.21.15.82:0/2138335263 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e821da1380 0x55e821da77c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x55e821da6550 tx=0x7fb67001c000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8f07a582421c40a server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:15:06.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.002+0000 7fb6627fc700 1 -- 172.21.15.82:0/2138335263 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb670024040 con 0x55e821da1380 2023-09-23T09:15:06.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.002+0000 7fb6627fc700 1 -- 172.21.15.82:0/2138335263 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb670026040 con 0x55e821da1380 2023-09-23T09:15:06.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.002+0000 7fb6627fc700 1 -- 172.21.15.82:0/2138335263 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6700038e0 con 0x55e821da1380 2023-09-23T09:15:06.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.003+0000 7fb69586db80 1 -- 172.21.15.82:0/2138335263 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e821da1380 msgr2=0x55e821da77c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:15:06.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.003+0000 7fb69586db80 1 --2- 172.21.15.82:0/2138335263 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e821da1380 0x55e821da77c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x55e821da6550 tx=0x7fb67001c000 comp rx=0 tx=0).stop 2023-09-23T09:15:06.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.003+0000 7fb69586db80 1 -- 172.21.15.82:0/2138335263 shutdown_connections 2023-09-23T09:15:06.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.003+0000 7fb69586db80 1 --2- 172.21.15.82:0/2138335263 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e821da1ca0 0x55e821da47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:06.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.003+0000 7fb69586db80 1 --2- 172.21.15.82:0/2138335263 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e821d9bc40 0x55e821da41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:06.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.003+0000 7fb69586db80 1 --2- 172.21.15.82:0/2138335263 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e821da1380 0x55e821da77c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:06.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.003+0000 7fb69586db80 1 -- 172.21.15.82:0/2138335263 >> 172.21.15.82:0/2138335263 conn(0x55e821d100e0 msgr2=0x55e821d9f050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:15:06.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.003+0000 7fb69586db80 1 -- 172.21.15.82:0/2138335263 shutdown_connections 2023-09-23T09:15:06.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.003+0000 7fb69586db80 1 -- 172.21.15.82:0/2138335263 wait complete. 2023-09-23T09:15:06.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.003+0000 7fb69586db80 1 -- start start 2023-09-23T09:15:06.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.004+0000 7fb69586db80 1 Processor -- start 2023-09-23T09:15:06.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.004+0000 7fb69586db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e821d9bc40 0x55e821db0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:06.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.004+0000 7fb69586db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e821da1380 0x55e821d9d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:06.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.004+0000 7fb69586db80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e821da1ca0 0x55e821d9db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:06.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.004+0000 7fb69586db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e821d9e1f0 con 0x55e821da1380 2023-09-23T09:15:06.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.004+0000 7fb69586db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e821e0d930 con 0x55e821d9bc40 2023-09-23T09:15:06.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.004+0000 7fb69586db80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e821e0da70 con 0x55e821da1ca0 2023-09-23T09:15:06.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.004+0000 7fb69586db80 10 client.0 _ll_register_callbacks cb 0x7fb670009620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:15:06.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.004+0000 7fb67affd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e821da1380 0x55e821d9d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:06.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.005+0000 7fb67affd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e821da1380 0x55e821d9d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49552/0 (socket says 172.21.15.82:49552) 2023-09-23T09:15:06.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.005+0000 7fb67affd700 1 -- 172.21.15.82:0/3826046221 learned_addr learned my addr 172.21.15.82:0/3826046221 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:15:06.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.005+0000 7fb67b7fe700 1 --2- 172.21.15.82:0/3826046221 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e821d9bc40 0x55e821db0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:06.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.005+0000 7fb67bfff700 1 --2- 172.21.15.82:0/3826046221 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e821da1ca0 0x55e821d9db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:06.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.005+0000 7fb67affd700 1 -- 172.21.15.82:0/3826046221 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e821da1ca0 msgr2=0x55e821d9db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:15:06.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.005+0000 7fb67affd700 1 --2- 172.21.15.82:0/3826046221 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e821da1ca0 0x55e821d9db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:06.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.005+0000 7fb67affd700 1 -- 172.21.15.82:0/3826046221 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e821d9bc40 msgr2=0x55e821db0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:15:06.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.005+0000 7fb67affd700 1 --2- 172.21.15.82:0/3826046221 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e821d9bc40 0x55e821db0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:06.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.005+0000 7fb67affd700 1 -- 172.21.15.82:0/3826046221 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb66c009970 con 0x55e821da1380 2023-09-23T09:15:06.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.005+0000 7fb67affd700 1 --2- 172.21.15.82:0/3826046221 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e821da1380 0x55e821d9d3e0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x55e821dbc830 tx=0x7fb670009b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e80cd679a57a6f2 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:15:06.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.005+0000 7fb65affd700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:15:06.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.005+0000 7fb65affd700 1 -- 172.21.15.82:0/3826046221 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb670024040 con 0x55e821da1380 2023-09-23T09:15:06.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.005+0000 7fb69586db80 1 -- 172.21.15.82:0/3826046221 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e821d8e8b0 con 0x55e821da1380 2023-09-23T09:15:06.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.006+0000 7fb65affd700 1 -- 172.21.15.82:0/3826046221 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(111..111 src has 1..111) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fb670005250 con 0x55e821da1380 2023-09-23T09:15:06.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.006+0000 7fb65affd700 1 -- 172.21.15.82:0/3826046221 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb670005450 con 0x55e821da1380 2023-09-23T09:15:06.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.006+0000 7fb69586db80 10 client.16659 fetch_fsmap learned FSMap version 69 2023-09-23T09:15:06.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.006+0000 7fb69586db80 1 -- 172.21.15.82:0/3826046221 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=4+}) v3 -- 0x7fb67c19bed0 con 0x55e821da1380 2023-09-23T09:15:06.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.006+0000 7fb65affd700 1 -- 172.21.15.82:0/3826046221 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55e821d8e8b0 con 0x55e821da1380 2023-09-23T09:15:06.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.006+0000 7fb65affd700 1 -- 172.21.15.82:0/3826046221 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 69) v1 ==== 7906+0+0 (secure 0 0 0) 0x7fb670011510 con 0x55e821da1380 2023-09-23T09:15:06.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.006+0000 7fb69586db80 10 client.16659 fetch_fsmap finished waiting for FSMap version 69 2023-09-23T09:15:06.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.006+0000 7fb69586db80 10 client.16659 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:15:06.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.006+0000 7fb69586db80 20 client.16659 populate_metadata read hostname 'smithi082' 2023-09-23T09:15:06.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.006+0000 7fb69586db80 1 --2- 172.21.15.82:0/3826046221 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55e821e0f2c0 0x55e821e116e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:06.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.006+0000 7fb69586db80 4 client.16659 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:15:06.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.006+0000 7fb69586db80 1 -- 172.21.15.82:0/3826046221 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55e821ce6970 con 0x55e821e0f2c0 2023-09-23T09:15:06.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.007+0000 7fb67b7fe700 1 --2- 172.21.15.82:0/3826046221 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55e821e0f2c0 0x55e821e116e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:06.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.007+0000 7fb67b7fe700 1 --2- 172.21.15.82:0/3826046221 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55e821e0f2c0 0x55e821e116e0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df1f0ecc639061f8 server_cookie=aa32a55b1d441913 in_seq=0 out_seq=0 2023-09-23T09:15:06.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.007+0000 7fb65affd700 10 client.16659 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:15:06.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.008+0000 7fb65affd700 1 -- 172.21.15.82:0/3826046221 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55e821ce6970 con 0x55e821e0f2c0 2023-09-23T09:15:06.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.008+0000 7fb65affd700 10 client.16659 handle_command_reply: tid=0 2023-09-23T09:15:06.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.008+0000 7fb69586db80 1 client.16659 shutdown 2023-09-23T09:15:06.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.008+0000 7fb69586db80 1 -- 172.21.15.82:0/3826046221 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e821da1380 msgr2=0x55e821d9d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:15:06.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.008+0000 7fb69586db80 1 --2- 172.21.15.82:0/3826046221 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e821da1380 0x55e821d9d3e0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x55e821dbc830 tx=0x7fb670009b10 comp rx=0 tx=0).stop 2023-09-23T09:15:06.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.008+0000 7fb69586db80 1 -- 172.21.15.82:0/3826046221 shutdown_connections 2023-09-23T09:15:06.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.008+0000 7fb69586db80 1 --2- 172.21.15.82:0/3826046221 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e821da1ca0 0x55e821d9db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:06.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.008+0000 7fb69586db80 1 --2- 172.21.15.82:0/3826046221 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e821d9bc40 0x55e821db0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:06.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.008+0000 7fb69586db80 1 --2- 172.21.15.82:0/3826046221 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55e821e0f2c0 0x55e821e116e0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:06.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.008+0000 7fb69586db80 1 --2- 172.21.15.82:0/3826046221 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e821da1380 0x55e821d9d3e0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:06.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.008+0000 7fb65affd700 0 client.16659 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:15:06.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.008+0000 7fb69586db80 1 -- 172.21.15.82:0/3826046221 >> 172.21.15.82:0/3826046221 conn(0x55e821d100e0 msgr2=0x55e821da47b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:15:06.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.008+0000 7fb69586db80 1 -- 172.21.15.82:0/3826046221 shutdown_connections 2023-09-23T09:15:06.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.008+0000 7fb69586db80 1 -- 172.21.15.82:0/3826046221 wait complete. 2023-09-23T09:15:06.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.008+0000 7fb69586db80 20 client.16659 trim_cache size 0 max 16384 2023-09-23T09:15:06.017 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:15:06.017 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "IDLE (waiting for more scrubs)", 2023-09-23T09:15:06.017 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:15:06.017 INFO:teuthology.orchestra.run.smithi082.stdout: "cba46b77-20dd-437c-a60a-ac01b400e1b8": { 2023-09-23T09:15:06.018 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:15:06.018 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "cba46b77-20dd-437c-a60a-ac01b400e1b8", 2023-09-23T09:15:06.018 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:15:06.018 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:15:06.018 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:15:06.018 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:15:06.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.009+0000 7fb681fff700 1 -- 172.21.15.82:0/3212829314 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fb6640a0140 msgr2=0x7fb6640a2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:15:06.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.009+0000 7fb681fff700 1 --2- 172.21.15.82:0/3212829314 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fb6640a0140 0x7fb6640a2600 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb6700135f0 tx=0x7fb670013900 comp rx=0 tx=0).stop 2023-09-23T09:15:06.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.009+0000 7fb681fff700 1 -- 172.21.15.82:0/3212829314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb67c10ae50 msgr2=0x7fb67c19b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:15:06.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.009+0000 7fb681fff700 1 --2- 172.21.15.82:0/3212829314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb67c10ae50 0x7fb67c19b350 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fb67400b0a0 tx=0x7fb674008ea0 comp rx=0 tx=0).stop 2023-09-23T09:15:06.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.009+0000 7fb681fff700 1 -- 172.21.15.82:0/3212829314 shutdown_connections 2023-09-23T09:15:06.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.009+0000 7fb681fff700 1 --2- 172.21.15.82:0/3212829314 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fb6640a0140 0x7fb6640a2600 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:06.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.009+0000 7fb681fff700 1 --2- 172.21.15.82:0/3212829314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb67c10ae50 0x7fb67c19b350 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:06.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.009+0000 7fb681fff700 1 --2- 172.21.15.82:0/3212829314 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb67c101a30 0x7fb67c196980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:06.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.009+0000 7fb681fff700 1 --2- 172.21.15.82:0/3212829314 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb67c102350 0x7fb67c196ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:06.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.009+0000 7fb681fff700 1 -- 172.21.15.82:0/3212829314 >> 172.21.15.82:0/3212829314 conn(0x7fb67c0fb270 msgr2=0x7fb67c0fbee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:15:06.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.009+0000 7fb681fff700 1 -- 172.21.15.82:0/3212829314 shutdown_connections 2023-09-23T09:15:06.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:06.009+0000 7fb681fff700 1 -- 172.21.15.82:0/3212829314 wait complete. 2023-09-23T09:15:06.029 INFO:tasks.cephfs.filesystem:scrub status for tag:cba46b77-20dd-437c-a60a-ac01b400e1b8 - {'path': '/', 'tag': 'cba46b77-20dd-437c-a60a-ac01b400e1b8', 'options': 'recursive,force'} 2023-09-23T09:15:06.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:15:05 smithi135 ceph-mon[99205]: pgmap v571: 97 pgs: 97 active+clean; 9.2 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 34 MiB/s wr, 102 op/s 2023-09-23T09:15:06.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:15:05 smithi082 ceph-mon[97694]: pgmap v571: 97 pgs: 97 active+clean; 9.2 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 34 MiB/s wr, 102 op/s 2023-09-23T09:15:06.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:15:05 smithi161 ceph-mon[99580]: pgmap v571: 97 pgs: 97 active+clean; 9.2 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 34 MiB/s wr, 102 op/s 2023-09-23T09:15:06.223 INFO:teuthology.orchestra.run.smithi082.stderr:47900000 of 50000000 tuples (95%) done (elapsed 1060.97 s, remaining 46.51 s) 2023-09-23T09:15:07.594 INFO:teuthology.orchestra.run.smithi082.stderr:48000000 of 50000000 tuples (96%) done (elapsed 1062.34 s, remaining 44.26 s) 2023-09-23T09:15:08.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:15:07 smithi135 ceph-mon[99205]: osdmap e112: 12 total, 12 up, 12 in 2023-09-23T09:15:08.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:15:07 smithi135 ceph-mon[99205]: pgmap v573: 97 pgs: 97 active+clean; 9.2 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 27 MiB/s wr, 103 op/s 2023-09-23T09:15:08.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:15:07 smithi082 ceph-mon[97694]: osdmap e112: 12 total, 12 up, 12 in 2023-09-23T09:15:08.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:15:07 smithi082 ceph-mon[97694]: pgmap v573: 97 pgs: 97 active+clean; 9.2 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 27 MiB/s wr, 103 op/s 2023-09-23T09:15:08.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:15:07 smithi161 ceph-mon[99580]: osdmap e112: 12 total, 12 up, 12 in 2023-09-23T09:15:08.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:15:07 smithi161 ceph-mon[99580]: pgmap v573: 97 pgs: 97 active+clean; 9.2 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 27 MiB/s wr, 103 op/s 2023-09-23T09:15:08.800 INFO:teuthology.orchestra.run.smithi082.stderr:48100000 of 50000000 tuples (96%) done (elapsed 1063.54 s, remaining 42.01 s) 2023-09-23T09:15:10.015 INFO:teuthology.orchestra.run.smithi082.stderr:48200000 of 50000000 tuples (96%) done (elapsed 1064.76 s, remaining 39.76 s) 2023-09-23T09:15:10.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:15:10 smithi135 ceph-mon[99205]: pgmap v574: 97 pgs: 97 active+clean; 9.2 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 28 MiB/s wr, 105 op/s 2023-09-23T09:15:10.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:15:10 smithi082 ceph-mon[97694]: pgmap v574: 97 pgs: 97 active+clean; 9.2 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 28 MiB/s wr, 105 op/s 2023-09-23T09:15:10.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:15:10 smithi161 ceph-mon[99580]: pgmap v574: 97 pgs: 97 active+clean; 9.2 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 28 MiB/s wr, 105 op/s 2023-09-23T09:15:11.330 INFO:teuthology.orchestra.run.smithi082.stderr:48300000 of 50000000 tuples (96%) done (elapsed 1066.07 s, remaining 37.52 s) 2023-09-23T09:15:11.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:15:11 smithi135 ceph-mon[99205]: scrub summary: idle 2023-09-23T09:15:11.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:15:11 smithi135 ceph-mon[99205]: scrub summary: idle 2023-09-23T09:15:11.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:15:11 smithi135 ceph-mon[99205]: scrub summary: idle 2023-09-23T09:15:11.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:15:11 smithi135 ceph-mon[99205]: scrub summary: idle 2023-09-23T09:15:11.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:15:11 smithi082 ceph-mon[97694]: scrub summary: idle 2023-09-23T09:15:11.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:15:11 smithi082 ceph-mon[97694]: scrub summary: idle 2023-09-23T09:15:11.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:15:11 smithi082 ceph-mon[97694]: scrub summary: idle 2023-09-23T09:15:11.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:15:11 smithi082 ceph-mon[97694]: scrub summary: idle 2023-09-23T09:15:11.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:15:11 smithi161 ceph-mon[99580]: scrub summary: idle 2023-09-23T09:15:11.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:15:11 smithi161 ceph-mon[99580]: scrub summary: idle 2023-09-23T09:15:11.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:15:11 smithi161 ceph-mon[99580]: scrub summary: idle 2023-09-23T09:15:11.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:15:11 smithi161 ceph-mon[99580]: scrub summary: idle 2023-09-23T09:15:12.550 INFO:teuthology.orchestra.run.smithi082.stderr:48400000 of 50000000 tuples (96%) done (elapsed 1067.29 s, remaining 35.28 s) 2023-09-23T09:15:12.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:15:12 smithi135 ceph-mon[99205]: scrub summary: idle 2023-09-23T09:15:12.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:15:12 smithi135 ceph-mon[99205]: pgmap v575: 97 pgs: 97 active+clean; 9.2 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 28 MiB/s wr, 105 op/s 2023-09-23T09:15:12.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:15:12 smithi135 ceph-mon[99205]: osdmap e113: 12 total, 12 up, 12 in 2023-09-23T09:15:12.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:15:12 smithi082 ceph-mon[97694]: scrub summary: idle 2023-09-23T09:15:12.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:15:12 smithi082 ceph-mon[97694]: pgmap v575: 97 pgs: 97 active+clean; 9.2 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 28 MiB/s wr, 105 op/s 2023-09-23T09:15:12.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:15:12 smithi082 ceph-mon[97694]: osdmap e113: 12 total, 12 up, 12 in 2023-09-23T09:15:12.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:15:12 smithi161 ceph-mon[99580]: scrub summary: idle 2023-09-23T09:15:12.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:15:12 smithi161 ceph-mon[99580]: pgmap v575: 97 pgs: 97 active+clean; 9.2 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 28 MiB/s wr, 105 op/s 2023-09-23T09:15:12.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:15:12 smithi161 ceph-mon[99580]: osdmap e113: 12 total, 12 up, 12 in 2023-09-23T09:15:13.738 INFO:teuthology.orchestra.run.smithi082.stderr:48500000 of 50000000 tuples (97%) done (elapsed 1068.48 s, remaining 33.05 s) 2023-09-23T09:15:14.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:15:14 smithi135 ceph-mon[99205]: pgmap v577: 97 pgs: 97 active+clean; 9.2 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 18 MiB/s wr, 55 op/s 2023-09-23T09:15:14.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:15:14 smithi082 ceph-mon[97694]: pgmap v577: 97 pgs: 97 active+clean; 9.2 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 18 MiB/s wr, 55 op/s 2023-09-23T09:15:14.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:15:14 smithi161 ceph-mon[99580]: pgmap v577: 97 pgs: 97 active+clean; 9.2 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 18 MiB/s wr, 55 op/s 2023-09-23T09:15:15.035 INFO:teuthology.orchestra.run.smithi082.stderr:48600000 of 50000000 tuples (97%) done (elapsed 1069.78 s, remaining 30.82 s) 2023-09-23T09:15:16.288 INFO:teuthology.orchestra.run.smithi082.stderr:48700000 of 50000000 tuples (97%) done (elapsed 1071.03 s, remaining 28.59 s) 2023-09-23T09:15:16.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:15:16 smithi135 ceph-mon[99205]: pgmap v578: 97 pgs: 97 active+clean; 9.3 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 34 MiB/s wr, 90 op/s 2023-09-23T09:15:16.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:15:16 smithi082 ceph-mon[97694]: pgmap v578: 97 pgs: 97 active+clean; 9.3 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 34 MiB/s wr, 90 op/s 2023-09-23T09:15:16.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:15:16 smithi161 ceph-mon[99580]: pgmap v578: 97 pgs: 97 active+clean; 9.3 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 34 MiB/s wr, 90 op/s 2023-09-23T09:15:17.567 INFO:teuthology.orchestra.run.smithi082.stderr:48800000 of 50000000 tuples (97%) done (elapsed 1072.31 s, remaining 26.37 s) 2023-09-23T09:15:18.901 INFO:teuthology.orchestra.run.smithi082.stderr:48900000 of 50000000 tuples (97%) done (elapsed 1073.64 s, remaining 24.15 s) 2023-09-23T09:15:19.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:15:18 smithi135 ceph-mon[99205]: pgmap v579: 97 pgs: 97 active+clean; 9.3 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 29 MiB/s wr, 77 op/s 2023-09-23T09:15:19.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:15:18 smithi082 ceph-mon[97694]: pgmap v579: 97 pgs: 97 active+clean; 9.3 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 29 MiB/s wr, 77 op/s 2023-09-23T09:15:19.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:15:18 smithi161 ceph-mon[99580]: pgmap v579: 97 pgs: 97 active+clean; 9.3 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 29 MiB/s wr, 77 op/s 2023-09-23T09:15:20.142 INFO:teuthology.orchestra.run.smithi082.stderr:49000000 of 50000000 tuples (98%) done (elapsed 1074.89 s, remaining 21.94 s) 2023-09-23T09:15:21.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:15:20 smithi135 ceph-mon[99205]: pgmap v580: 97 pgs: 97 active+clean; 9.4 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 29 MiB/s wr, 76 op/s 2023-09-23T09:15:21.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:15:20 smithi082 ceph-mon[97694]: pgmap v580: 97 pgs: 97 active+clean; 9.4 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 29 MiB/s wr, 76 op/s 2023-09-23T09:15:21.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:15:20 smithi161 ceph-mon[99580]: pgmap v580: 97 pgs: 97 active+clean; 9.4 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 29 MiB/s wr, 76 op/s 2023-09-23T09:15:21.382 INFO:teuthology.orchestra.run.smithi082.stderr:49100000 of 50000000 tuples (98%) done (elapsed 1076.12 s, remaining 19.73 s) 2023-09-23T09:15:22.699 INFO:teuthology.orchestra.run.smithi082.stderr:49200000 of 50000000 tuples (98%) done (elapsed 1077.44 s, remaining 17.52 s) 2023-09-23T09:15:23.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:15:22 smithi135 ceph-mon[99205]: pgmap v581: 97 pgs: 97 active+clean; 9.4 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 29 MiB/s wr, 76 op/s 2023-09-23T09:15:23.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:15:22 smithi082 ceph-mon[97694]: pgmap v581: 97 pgs: 97 active+clean; 9.4 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 29 MiB/s wr, 76 op/s 2023-09-23T09:15:23.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:15:22 smithi161 ceph-mon[99580]: pgmap v581: 97 pgs: 97 active+clean; 9.4 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 29 MiB/s wr, 76 op/s 2023-09-23T09:15:24.056 INFO:teuthology.orchestra.run.smithi082.stderr:49300000 of 50000000 tuples (98%) done (elapsed 1078.80 s, remaining 15.32 s) 2023-09-23T09:15:24.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:15:23 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:15:24.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:15:23 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:15:24.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:15:23 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:15:25.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:15:24 smithi135 ceph-mon[99205]: pgmap v582: 97 pgs: 97 active+clean; 9.4 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 25 MiB/s wr, 65 op/s 2023-09-23T09:15:25.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:15:24 smithi082 ceph-mon[97694]: pgmap v582: 97 pgs: 97 active+clean; 9.4 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 25 MiB/s wr, 65 op/s 2023-09-23T09:15:25.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:15:24 smithi161 ceph-mon[99580]: pgmap v582: 97 pgs: 97 active+clean; 9.4 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 25 MiB/s wr, 65 op/s 2023-09-23T09:15:25.312 INFO:teuthology.orchestra.run.smithi082.stderr:49400000 of 50000000 tuples (98%) done (elapsed 1080.05 s, remaining 13.12 s) 2023-09-23T09:15:26.592 INFO:teuthology.orchestra.run.smithi082.stderr:49500000 of 50000000 tuples (99%) done (elapsed 1081.33 s, remaining 10.92 s) 2023-09-23T09:15:27.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:15:26 smithi135 ceph-mon[99205]: pgmap v583: 97 pgs: 97 active+clean; 9.5 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 36 MiB/s wr, 106 op/s 2023-09-23T09:15:27.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:15:26 smithi082 ceph-mon[97694]: pgmap v583: 97 pgs: 97 active+clean; 9.5 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 36 MiB/s wr, 106 op/s 2023-09-23T09:15:27.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:15:26 smithi161 ceph-mon[99580]: pgmap v583: 97 pgs: 97 active+clean; 9.5 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 36 MiB/s wr, 106 op/s 2023-09-23T09:15:27.890 INFO:teuthology.orchestra.run.smithi082.stderr:49600000 of 50000000 tuples (99%) done (elapsed 1082.63 s, remaining 8.73 s) 2023-09-23T09:15:29.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:15:28 smithi135 ceph-mon[99205]: pgmap v584: 97 pgs: 97 active+clean; 9.5 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 23 MiB/s wr, 78 op/s 2023-09-23T09:15:29.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:15:28 smithi082 ceph-mon[97694]: pgmap v584: 97 pgs: 97 active+clean; 9.5 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 23 MiB/s wr, 78 op/s 2023-09-23T09:15:29.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:15:28 smithi161 ceph-mon[99580]: pgmap v584: 97 pgs: 97 active+clean; 9.5 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 23 MiB/s wr, 78 op/s 2023-09-23T09:15:30.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:15:29 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:15:30.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:15:29 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:15:30.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:15:29 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:15:31.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:15:30 smithi135 ceph-mon[99205]: pgmap v585: 97 pgs: 97 active+clean; 9.6 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 223 KiB/s rd, 33 MiB/s wr, 114 op/s 2023-09-23T09:15:31.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:15:30 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:15:31.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:15:30 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:15:31.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:15:30 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:15:31.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:15:30 smithi082 ceph-mon[97694]: pgmap v585: 97 pgs: 97 active+clean; 9.6 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 223 KiB/s rd, 33 MiB/s wr, 114 op/s 2023-09-23T09:15:31.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:15:30 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:15:31.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:15:30 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:15:31.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:15:30 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:15:31.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:15:30 smithi161 ceph-mon[99580]: pgmap v585: 97 pgs: 97 active+clean; 9.6 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 223 KiB/s rd, 33 MiB/s wr, 114 op/s 2023-09-23T09:15:31.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:15:30 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:15:31.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:15:30 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:15:31.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:15:30 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:15:32.616 INFO:teuthology.orchestra.run.smithi082.stderr:49700000 of 50000000 tuples (99%) done (elapsed 1087.36 s, remaining 6.56 s) 2023-09-23T09:15:33.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:15:32 smithi135 ceph-mon[99205]: pgmap v586: 97 pgs: 97 active+clean; 9.6 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 22 MiB/s wr, 78 op/s 2023-09-23T09:15:33.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:15:32 smithi082 ceph-mon[97694]: pgmap v586: 97 pgs: 97 active+clean; 9.6 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 22 MiB/s wr, 78 op/s 2023-09-23T09:15:33.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:15:32 smithi161 ceph-mon[99580]: pgmap v586: 97 pgs: 97 active+clean; 9.6 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 22 MiB/s wr, 78 op/s 2023-09-23T09:15:33.851 INFO:teuthology.orchestra.run.smithi082.stderr:49800000 of 50000000 tuples (99%) done (elapsed 1088.59 s, remaining 4.37 s) 2023-09-23T09:15:34.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:15:33 smithi082 ceph-mon[97694]: pgmap v587: 97 pgs: 97 active+clean; 9.6 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 22 MiB/s wr, 78 op/s 2023-09-23T09:15:34.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:15:33 smithi161 ceph-mon[99580]: pgmap v587: 97 pgs: 97 active+clean; 9.6 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 22 MiB/s wr, 78 op/s 2023-09-23T09:15:34.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:15:33 smithi135 ceph-mon[99205]: pgmap v587: 97 pgs: 97 active+clean; 9.6 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 22 MiB/s wr, 78 op/s 2023-09-23T09:15:35.095 INFO:teuthology.orchestra.run.smithi082.stderr:49900000 of 50000000 tuples (99%) done (elapsed 1089.84 s, remaining 2.18 s) 2023-09-23T09:15:36.031 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:15:36.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.265+0000 7f1b86dff700 1 -- 172.21.15.82:0/105891930 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b80073670 msgr2=0x7f1b8010cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:15:36.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.265+0000 7f1b86dff700 1 --2- 172.21.15.82:0/105891930 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b80073670 0x7f1b8010cb70 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c009990 tx=0x7f1b6c009ca0 comp rx=0 tx=0).stop 2023-09-23T09:15:36.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.266+0000 7f1b86dff700 1 -- 172.21.15.82:0/105891930 shutdown_connections 2023-09-23T09:15:36.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.266+0000 7f1b86dff700 1 --2- 172.21.15.82:0/105891930 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1b8010d0b0 0x7f1b8010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:36.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.266+0000 7f1b86dff700 1 --2- 172.21.15.82:0/105891930 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b80072d50 0x7f1b80073130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:36.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.266+0000 7f1b86dff700 1 --2- 172.21.15.82:0/105891930 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b80073670 0x7f1b8010cb70 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:36.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.266+0000 7f1b86dff700 1 -- 172.21.15.82:0/105891930 >> 172.21.15.82:0/105891930 conn(0x7f1b800fc3a0 msgr2=0x7f1b800fe7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:15:36.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.266+0000 7f1b86dff700 1 -- 172.21.15.82:0/105891930 shutdown_connections 2023-09-23T09:15:36.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.266+0000 7f1b86dff700 1 -- 172.21.15.82:0/105891930 wait complete. 2023-09-23T09:15:36.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.267+0000 7f1b86dff700 1 Processor -- start 2023-09-23T09:15:36.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.267+0000 7f1b86dff700 1 -- start start 2023-09-23T09:15:36.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.267+0000 7f1b86dff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b80072d50 0x7f1b8019e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:36.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.267+0000 7f1b86dff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1b80073670 0x7f1b8019ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:36.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.268+0000 7f1b86dff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b8010d0b0 0x7f1b80198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:36.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.268+0000 7f1b86dff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b80198fd0 con 0x7f1b80072d50 2023-09-23T09:15:36.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.268+0000 7f1b86dff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b80199140 con 0x7f1b8010d0b0 2023-09-23T09:15:36.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.268+0000 7f1b86dff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b80199300 con 0x7f1b80073670 2023-09-23T09:15:36.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.268+0000 7f1b84b9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b80072d50 0x7f1b8019e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:36.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.268+0000 7f1b84b9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b80072d50 0x7f1b8019e8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47816/0 (socket says 172.21.15.82:47816) 2023-09-23T09:15:36.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.268+0000 7f1b84b9b700 1 -- 172.21.15.82:0/659340612 learned_addr learned my addr 172.21.15.82:0/659340612 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:15:36.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.268+0000 7f1b8539c700 1 --2- 172.21.15.82:0/659340612 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b8010d0b0 0x7f1b80198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:36.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.268+0000 7f1b7ffff700 1 --2- 172.21.15.82:0/659340612 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1b80073670 0x7f1b8019ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:36.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.268+0000 7f1b84b9b700 1 -- 172.21.15.82:0/659340612 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1b80073670 msgr2=0x7f1b8019ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:15:36.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.268+0000 7f1b84b9b700 1 --2- 172.21.15.82:0/659340612 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1b80073670 0x7f1b8019ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:36.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.268+0000 7f1b84b9b700 1 -- 172.21.15.82:0/659340612 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b8010d0b0 msgr2=0x7f1b80198960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:15:36.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.268+0000 7f1b84b9b700 1 --2- 172.21.15.82:0/659340612 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b8010d0b0 0x7f1b80198960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:36.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.268+0000 7f1b84b9b700 1 -- 172.21.15.82:0/659340612 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b6c0095f0 con 0x7f1b80072d50 2023-09-23T09:15:36.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.268+0000 7f1b7ffff700 1 --2- 172.21.15.82:0/659340612 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1b80073670 0x7f1b8019ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:15:36.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.269+0000 7f1b84b9b700 1 --2- 172.21.15.82:0/659340612 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b80072d50 0x7f1b8019e8f0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f1b7400e9a0 tx=0x7f1b7400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:15:36.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.269+0000 7f1b7dffb700 1 -- 172.21.15.82:0/659340612 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b74009790 con 0x7f1b80072d50 2023-09-23T09:15:36.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.269+0000 7f1b7dffb700 1 -- 172.21.15.82:0/659340612 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1b7400cbd0 con 0x7f1b80072d50 2023-09-23T09:15:36.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.269+0000 7f1b86dff700 1 -- 172.21.15.82:0/659340612 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b801995e0 con 0x7f1b80072d50 2023-09-23T09:15:36.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.269+0000 7f1b7dffb700 1 -- 172.21.15.82:0/659340612 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b74018680 con 0x7f1b80072d50 2023-09-23T09:15:36.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.269+0000 7f1b86dff700 1 -- 172.21.15.82:0/659340612 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b801a58e0 con 0x7f1b80072d50 2023-09-23T09:15:36.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.272+0000 7f1b7dffb700 1 -- 172.21.15.82:0/659340612 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f1b7400cd40 con 0x7f1b80072d50 2023-09-23T09:15:36.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.274+0000 7f1b9a805b80 1 Processor -- start 2023-09-23T09:15:36.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.274+0000 7f1b9a805b80 1 -- start start 2023-09-23T09:15:36.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.274+0000 7f1b7dffb700 1 --2- 172.21.15.82:0/659340612 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f1b700a0140 0x7f1b700a2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:36.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.274+0000 7f1b9a805b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d7b464d380 0x55d7b464d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:36.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.274+0000 7f1b9a805b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d7b464dca0 0x55d7b4647700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:36.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.274+0000 7f1b9a805b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d7b4647c40 0x55d7b46480a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:36.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.274+0000 7f1b9a805b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7b45af7b0 con 0x55d7b4647c40 2023-09-23T09:15:36.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.274+0000 7f1b9a805b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7b45a0780 con 0x55d7b464d380 2023-09-23T09:15:36.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.274+0000 7f1b9a805b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7b459e0a0 con 0x55d7b464dca0 2023-09-23T09:15:36.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.274+0000 7f1b7dffb700 1 -- 172.21.15.82:0/659340612 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f1b74014070 con 0x7f1b80072d50 2023-09-23T09:15:36.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.275+0000 7f1b8539c700 1 --2- 172.21.15.82:0/659340612 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f1b700a0140 0x7f1b700a2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:36.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.275+0000 7f1b84b9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d7b464d380 0x55d7b464d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:36.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.275+0000 7f1b84b9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d7b464d380 0x55d7b464d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:38686/0 (socket says 172.21.15.82:38686) 2023-09-23T09:15:36.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.275+0000 7f1b84b9b700 1 -- 172.21.15.82:0/1823810761 learned_addr learned my addr 172.21.15.82:0/1823810761 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:15:36.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.275+0000 7f1b7ffff700 1 --2- 172.21.15.82:0/1823810761 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d7b464dca0 0x55d7b4647700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:36.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.275+0000 7f1b8539c700 1 --2- 172.21.15.82:0/1823810761 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d7b4647c40 0x55d7b46480a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:36.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.275+0000 7f1b84b9b700 1 -- 172.21.15.82:0/1823810761 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d7b464dca0 msgr2=0x55d7b4647700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:15:36.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.275+0000 7f1b84b9b700 1 --2- 172.21.15.82:0/1823810761 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d7b464dca0 0x55d7b4647700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:36.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.275+0000 7f1b84b9b700 1 -- 172.21.15.82:0/1823810761 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d7b4647c40 msgr2=0x55d7b46480a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:15:36.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.275+0000 7f1b84b9b700 1 --2- 172.21.15.82:0/1823810761 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d7b4647c40 0x55d7b46480a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:36.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.275+0000 7f1b84b9b700 1 -- 172.21.15.82:0/1823810761 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d7b4419630 con 0x55d7b464d380 2023-09-23T09:15:36.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.276+0000 7f1b84b9b700 1 --2- 172.21.15.82:0/1823810761 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d7b464d380 0x55d7b464d760 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1b74095a00 tx=0x7f1b74098ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8cf80ebdaf7771a server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:15:36.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.276+0000 7f1b8539c700 1 --2- 172.21.15.82:0/659340612 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f1b700a0140 0x7f1b700a2600 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1b78009ec0 tx=0x7f1b780092f0 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:15:36.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.276+0000 7f1b6affd700 1 -- 172.21.15.82:0/1823810761 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b74098f90 con 0x55d7b464d380 2023-09-23T09:15:36.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.276+0000 7f1b6affd700 1 -- 172.21.15.82:0/1823810761 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1b7409cdc0 con 0x55d7b464d380 2023-09-23T09:15:36.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.276+0000 7f1b6affd700 1 -- 172.21.15.82:0/1823810761 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b740c9250 con 0x55d7b464d380 2023-09-23T09:15:36.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.277+0000 7f1b9a805b80 1 -- 172.21.15.82:0/1823810761 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d7b464d380 msgr2=0x55d7b464d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:15:36.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.277+0000 7f1b9a805b80 1 --2- 172.21.15.82:0/1823810761 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d7b464d380 0x55d7b464d760 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1b74095a00 tx=0x7f1b74098ad0 comp rx=0 tx=0).stop 2023-09-23T09:15:36.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.277+0000 7f1b9a805b80 1 -- 172.21.15.82:0/1823810761 shutdown_connections 2023-09-23T09:15:36.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.277+0000 7f1b9a805b80 1 --2- 172.21.15.82:0/1823810761 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d7b4647c40 0x55d7b46480a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:36.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.277+0000 7f1b9a805b80 1 --2- 172.21.15.82:0/1823810761 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d7b464d380 0x55d7b464d760 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:36.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.277+0000 7f1b9a805b80 1 --2- 172.21.15.82:0/1823810761 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d7b464dca0 0x55d7b4647700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:36.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.277+0000 7f1b9a805b80 1 -- 172.21.15.82:0/1823810761 >> 172.21.15.82:0/1823810761 conn(0x55d7b45bc0e0 msgr2=0x55d7b4642410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:15:36.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.277+0000 7f1b9a805b80 1 -- 172.21.15.82:0/1823810761 shutdown_connections 2023-09-23T09:15:36.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.277+0000 7f1b9a805b80 1 -- 172.21.15.82:0/1823810761 wait complete. 2023-09-23T09:15:36.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.277+0000 7f1b9a805b80 1 -- start start 2023-09-23T09:15:36.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.278+0000 7f1b9a805b80 1 Processor -- start 2023-09-23T09:15:36.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.278+0000 7f1b9a805b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d7b4647c40 0x55d7b4650f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:36.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.278+0000 7f1b9a805b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d7b464d380 0x55d7b46514d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:36.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.278+0000 7f1b9a805b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d7b464dca0 0x55d7b4651a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:36.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.278+0000 7f1b9a805b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7b4599990 con 0x55d7b464d380 2023-09-23T09:15:36.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.278+0000 7f1b9a805b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7b4537bb0 con 0x55d7b464dca0 2023-09-23T09:15:36.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.278+0000 7f1b9a805b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7b45378b0 con 0x55d7b4647c40 2023-09-23T09:15:36.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.278+0000 7f1b9a805b80 10 client.0 _ll_register_callbacks cb 0x55d7b4481a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:15:36.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.279+0000 7f1b7ffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d7b464d380 0x55d7b46514d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:36.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.279+0000 7f1b7ffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d7b464d380 0x55d7b46514d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47836/0 (socket says 172.21.15.82:47836) 2023-09-23T09:15:36.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.279+0000 7f1b7ffff700 1 -- 172.21.15.82:0/856709580 learned_addr learned my addr 172.21.15.82:0/856709580 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:15:36.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.279+0000 7f1b84b9b700 1 --2- 172.21.15.82:0/856709580 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d7b4647c40 0x55d7b4650f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:36.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.279+0000 7f1b8539c700 1 --2- 172.21.15.82:0/856709580 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d7b464dca0 0x55d7b4651a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:36.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.279+0000 7f1b7ffff700 1 -- 172.21.15.82:0/856709580 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d7b4647c40 msgr2=0x55d7b4650f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:15:36.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.279+0000 7f1b7ffff700 1 --2- 172.21.15.82:0/856709580 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d7b4647c40 0x55d7b4650f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:36.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.279+0000 7f1b7ffff700 1 -- 172.21.15.82:0/856709580 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d7b464dca0 msgr2=0x55d7b4651a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:15:36.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.279+0000 7f1b7ffff700 1 --2- 172.21.15.82:0/856709580 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d7b464dca0 0x55d7b4651a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:36.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.279+0000 7f1b7ffff700 1 -- 172.21.15.82:0/856709580 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b801a58e0 con 0x55d7b464d380 2023-09-23T09:15:36.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.279+0000 7f1b7ffff700 1 --2- 172.21.15.82:0/856709580 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d7b464d380 0x55d7b46514d0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c005b40 tx=0x7f1b6c005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb4769922dae4fbc server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:15:36.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.279+0000 7f1b5ffff700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:15:36.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.280+0000 7f1b5ffff700 1 -- 172.21.15.82:0/856709580 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b6c004700 con 0x55d7b464d380 2023-09-23T09:15:36.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.280+0000 7f1b9a805b80 1 -- 172.21.15.82:0/856709580 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d7b46171c0 con 0x55d7b464d380 2023-09-23T09:15:36.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.280+0000 7f1b5ffff700 1 -- 172.21.15.82:0/856709580 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f1b6c004860 con 0x55d7b464d380 2023-09-23T09:15:36.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.280+0000 7f1b5ffff700 1 -- 172.21.15.82:0/856709580 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1b6c004a20 con 0x55d7b464d380 2023-09-23T09:15:36.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.280+0000 7f1b9a805b80 10 client.16671 fetch_fsmap learned FSMap version 70 2023-09-23T09:15:36.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.280+0000 7f1b9a805b80 1 -- 172.21.15.82:0/856709580 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) v3 -- 0x55d7b43c5de0 con 0x55d7b464d380 2023-09-23T09:15:36.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.280+0000 7f1b5ffff700 1 -- 172.21.15.82:0/856709580 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d7b46171c0 con 0x55d7b464d380 2023-09-23T09:15:36.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.280+0000 7f1b5ffff700 1 -- 172.21.15.82:0/856709580 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 70) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f1b6c00fb50 con 0x55d7b464d380 2023-09-23T09:15:36.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.281+0000 7f1b9a805b80 10 client.16671 fetch_fsmap finished waiting for FSMap version 70 2023-09-23T09:15:36.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.281+0000 7f1b9a805b80 10 client.16671 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:15:36.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.281+0000 7f1b9a805b80 20 client.16671 populate_metadata read hostname 'smithi082' 2023-09-23T09:15:36.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.281+0000 7f1b9a805b80 1 --2- 172.21.15.82:0/856709580 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55d7b46618e0 0x55d7b4663d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:36.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.281+0000 7f1b9a805b80 4 client.16671 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:15:36.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.281+0000 7f1b9a805b80 1 -- 172.21.15.82:0/856709580 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d7b453fba0 con 0x55d7b46618e0 2023-09-23T09:15:36.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.281+0000 7f1b84b9b700 1 --2- 172.21.15.82:0/856709580 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55d7b46618e0 0x55d7b4663d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:36.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.282+0000 7f1b84b9b700 1 --2- 172.21.15.82:0/856709580 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55d7b46618e0 0x55d7b4663d00 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=629ff66cdd586e45 server_cookie=1fcae67c8498f966 in_seq=0 out_seq=0 2023-09-23T09:15:36.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.282+0000 7f1b5ffff700 10 client.16671 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:15:36.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.282+0000 7f1b5ffff700 1 -- 172.21.15.82:0/856709580 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55d7b453fba0 con 0x55d7b46618e0 2023-09-23T09:15:36.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.282+0000 7f1b5ffff700 10 client.16671 handle_command_reply: tid=0 2023-09-23T09:15:36.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.282+0000 7f1b9a805b80 1 client.16671 shutdown 2023-09-23T09:15:36.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.283+0000 7f1b9a805b80 1 -- 172.21.15.82:0/856709580 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d7b464d380 msgr2=0x55d7b46514d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:15:36.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.283+0000 7f1b9a805b80 1 --2- 172.21.15.82:0/856709580 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d7b464d380 0x55d7b46514d0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c005b40 tx=0x7f1b6c005c00 comp rx=0 tx=0).stop 2023-09-23T09:15:36.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.283+0000 7f1b9a805b80 1 -- 172.21.15.82:0/856709580 shutdown_connections 2023-09-23T09:15:36.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.283+0000 7f1b9a805b80 1 --2- 172.21.15.82:0/856709580 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d7b464dca0 0x55d7b4651a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:36.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.283+0000 7f1b9a805b80 1 --2- 172.21.15.82:0/856709580 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d7b4647c40 0x55d7b4650f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:36.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.283+0000 7f1b9a805b80 1 --2- 172.21.15.82:0/856709580 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55d7b46618e0 0x55d7b4663d00 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:36.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.283+0000 7f1b9a805b80 1 --2- 172.21.15.82:0/856709580 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d7b464d380 0x55d7b46514d0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:36.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.283+0000 7f1b5ffff700 0 client.16671 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:15:36.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.283+0000 7f1b9a805b80 1 -- 172.21.15.82:0/856709580 >> 172.21.15.82:0/856709580 conn(0x55d7b45bc0e0 msgr2=0x55d7b463cb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:15:36.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.283+0000 7f1b9a805b80 1 -- 172.21.15.82:0/856709580 shutdown_connections 2023-09-23T09:15:36.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.283+0000 7f1b9a805b80 1 -- 172.21.15.82:0/856709580 wait complete. 2023-09-23T09:15:36.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.283+0000 7f1b9a805b80 20 client.16671 trim_cache size 0 max 16384 2023-09-23T09:15:36.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.300+0000 7f1b9a805b80 1 Processor -- start 2023-09-23T09:15:36.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.300+0000 7f1b9a805b80 1 -- start start 2023-09-23T09:15:36.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.301+0000 7f1b9a805b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d7b4647c40 0x55d7b4647700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:36.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.301+0000 7f1b9a805b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d7b464d380 0x55d7b46587a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:36.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.301+0000 7f1b9a805b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d7b464dca0 0x55d7b464b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:36.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.301+0000 7f1b9a805b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7b441b920 con 0x55d7b4647c40 2023-09-23T09:15:36.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.301+0000 7f1b9a805b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7b4643630 con 0x55d7b464dca0 2023-09-23T09:15:36.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.301+0000 7f1b9a805b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7b463a770 con 0x55d7b464d380 2023-09-23T09:15:36.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.301+0000 7f1b84b9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d7b4647c40 0x55d7b4647700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:36.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.301+0000 7f1b84b9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d7b4647c40 0x55d7b4647700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47840/0 (socket says 172.21.15.82:47840) 2023-09-23T09:15:36.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.301+0000 7f1b84b9b700 1 -- 172.21.15.82:0/1529568753 learned_addr learned my addr 172.21.15.82:0/1529568753 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:15:36.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.301+0000 7f1b7ffff700 1 --2- 172.21.15.82:0/1529568753 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d7b464d380 0x55d7b46587a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:36.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.301+0000 7f1b8539c700 1 --2- 172.21.15.82:0/1529568753 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d7b464dca0 0x55d7b464b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:36.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.301+0000 7f1b84b9b700 1 -- 172.21.15.82:0/1529568753 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d7b464d380 msgr2=0x55d7b46587a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:15:36.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.301+0000 7f1b84b9b700 1 --2- 172.21.15.82:0/1529568753 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d7b464d380 0x55d7b46587a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:36.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.302+0000 7f1b84b9b700 1 -- 172.21.15.82:0/1529568753 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d7b464dca0 msgr2=0x55d7b464b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:15:36.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.302+0000 7f1b84b9b700 1 --2- 172.21.15.82:0/1529568753 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d7b464dca0 0x55d7b464b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:36.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.302+0000 7f1b84b9b700 1 -- 172.21.15.82:0/1529568753 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d7b43aec60 con 0x55d7b4647c40 2023-09-23T09:15:36.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.302+0000 7f1b84b9b700 1 --2- 172.21.15.82:0/1529568753 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d7b4647c40 0x55d7b4647700 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f1b74095490 tx=0x7f1b740092d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50552b22cdb4441 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:15:36.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.302+0000 7f1b6b7fe700 1 -- 172.21.15.82:0/1529568753 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b740a0da0 con 0x55d7b4647c40 2023-09-23T09:15:36.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.302+0000 7f1b6b7fe700 1 -- 172.21.15.82:0/1529568753 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1b74097330 con 0x55d7b4647c40 2023-09-23T09:15:36.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.302+0000 7f1b6b7fe700 1 -- 172.21.15.82:0/1529568753 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b74098480 con 0x55d7b4647c40 2023-09-23T09:15:36.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.303+0000 7f1b9a805b80 1 -- 172.21.15.82:0/1529568753 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d7b4647c40 msgr2=0x55d7b4647700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:15:36.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.303+0000 7f1b9a805b80 1 --2- 172.21.15.82:0/1529568753 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d7b4647c40 0x55d7b4647700 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f1b74095490 tx=0x7f1b740092d0 comp rx=0 tx=0).stop 2023-09-23T09:15:36.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.303+0000 7f1b9a805b80 1 -- 172.21.15.82:0/1529568753 shutdown_connections 2023-09-23T09:15:36.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.303+0000 7f1b9a805b80 1 --2- 172.21.15.82:0/1529568753 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d7b464dca0 0x55d7b464b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:36.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.303+0000 7f1b9a805b80 1 --2- 172.21.15.82:0/1529568753 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d7b4647c40 0x55d7b4647700 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:36.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.303+0000 7f1b9a805b80 1 --2- 172.21.15.82:0/1529568753 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d7b464d380 0x55d7b46587a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:36.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.303+0000 7f1b9a805b80 1 -- 172.21.15.82:0/1529568753 >> 172.21.15.82:0/1529568753 conn(0x55d7b45bc0e0 msgr2=0x55d7b465db30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:15:36.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.303+0000 7f1b9a805b80 1 -- 172.21.15.82:0/1529568753 shutdown_connections 2023-09-23T09:15:36.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.303+0000 7f1b9a805b80 1 -- 172.21.15.82:0/1529568753 wait complete. 2023-09-23T09:15:36.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.303+0000 7f1b9a805b80 1 -- start start 2023-09-23T09:15:36.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.304+0000 7f1b9a805b80 1 Processor -- start 2023-09-23T09:15:36.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.304+0000 7f1b9a805b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d7b4647c40 0x55d7b46580d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:36.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.304+0000 7f1b9a805b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d7b464d380 0x55d7b4658610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:36.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.304+0000 7f1b9a805b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d7b464dca0 0x55d7b4656780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:36.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.304+0000 7f1b9a805b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7b4656d50 con 0x55d7b464d380 2023-09-23T09:15:36.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.304+0000 7f1b9a805b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7b4656ec0 con 0x55d7b4647c40 2023-09-23T09:15:36.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.304+0000 7f1b9a805b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7b4657080 con 0x55d7b464dca0 2023-09-23T09:15:36.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.304+0000 7f1b9a805b80 10 client.0 _ll_register_callbacks cb 0x7f1b6c009810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:15:36.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.304+0000 7f1b7ffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d7b464d380 0x55d7b4658610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:36.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.305+0000 7f1b7ffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d7b464d380 0x55d7b4658610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47852/0 (socket says 172.21.15.82:47852) 2023-09-23T09:15:36.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.305+0000 7f1b7ffff700 1 -- 172.21.15.82:0/2401663366 learned_addr learned my addr 172.21.15.82:0/2401663366 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:15:36.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.305+0000 7f1b8539c700 1 --2- 172.21.15.82:0/2401663366 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d7b464dca0 0x55d7b4656780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:36.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.305+0000 7f1b84b9b700 1 --2- 172.21.15.82:0/2401663366 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d7b4647c40 0x55d7b46580d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:36.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.305+0000 7f1b7ffff700 1 -- 172.21.15.82:0/2401663366 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d7b464dca0 msgr2=0x55d7b4656780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:15:36.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.305+0000 7f1b7ffff700 1 --2- 172.21.15.82:0/2401663366 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d7b464dca0 0x55d7b4656780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:36.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.305+0000 7f1b7ffff700 1 -- 172.21.15.82:0/2401663366 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d7b4647c40 msgr2=0x55d7b46580d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:15:36.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.305+0000 7f1b7ffff700 1 --2- 172.21.15.82:0/2401663366 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d7b4647c40 0x55d7b46580d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:36.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.305+0000 7f1b7ffff700 1 -- 172.21.15.82:0/2401663366 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d7b4419630 con 0x55d7b464d380 2023-09-23T09:15:36.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.305+0000 7f1b7ffff700 1 --2- 172.21.15.82:0/2401663366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d7b464d380 0x55d7b4658610 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c005950 tx=0x7f1b6c024e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=160cec14fc8b5557 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:15:36.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.305+0000 7f1b5ffff700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:15:36.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.305+0000 7f1b5ffff700 1 -- 172.21.15.82:0/2401663366 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b6c00f870 con 0x55d7b464d380 2023-09-23T09:15:36.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.306+0000 7f1b9a805b80 1 -- 172.21.15.82:0/2401663366 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d7b463a8b0 con 0x55d7b464d380 2023-09-23T09:15:36.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.306+0000 7f1b5ffff700 1 -- 172.21.15.82:0/2401663366 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f1b6c000e40 con 0x55d7b464d380 2023-09-23T09:15:36.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.306+0000 7f1b5ffff700 1 -- 172.21.15.82:0/2401663366 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1b6c024650 con 0x55d7b464d380 2023-09-23T09:15:36.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.306+0000 7f1b9a805b80 10 client.16677 fetch_fsmap learned FSMap version 70 2023-09-23T09:15:36.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.306+0000 7f1b9a805b80 1 -- 172.21.15.82:0/2401663366 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) v3 -- 0x55d7b43ec250 con 0x55d7b464d380 2023-09-23T09:15:36.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.306+0000 7f1b5ffff700 1 -- 172.21.15.82:0/2401663366 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1b6c043080 con 0x55d7b464d380 2023-09-23T09:15:36.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.306+0000 7f1b5ffff700 1 -- 172.21.15.82:0/2401663366 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 70) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f1b6c004850 con 0x55d7b464d380 2023-09-23T09:15:36.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.306+0000 7f1b9a805b80 10 client.16677 fetch_fsmap finished waiting for FSMap version 70 2023-09-23T09:15:36.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.306+0000 7f1b9a805b80 10 client.16677 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:15:36.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.306+0000 7f1b9a805b80 20 client.16677 populate_metadata read hostname 'smithi082' 2023-09-23T09:15:36.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.306+0000 7f1b9a805b80 1 --2- 172.21.15.82:0/2401663366 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55d7b46b6580 0x55d7b46b89a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:36.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.306+0000 7f1b9a805b80 4 client.16677 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:15:36.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.306+0000 7f1b9a805b80 1 -- 172.21.15.82:0/2401663366 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55d7b4592970 con 0x55d7b46b6580 2023-09-23T09:15:36.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.307+0000 7f1b84b9b700 1 --2- 172.21.15.82:0/2401663366 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55d7b46b6580 0x55d7b46b89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:36.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.307+0000 7f1b84b9b700 1 --2- 172.21.15.82:0/2401663366 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55d7b46b6580 0x55d7b46b89a0 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=10700b8f164dd6d9 server_cookie=f195fe3c96783cee in_seq=0 out_seq=0 2023-09-23T09:15:36.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.307+0000 7f1b5ffff700 10 client.16677 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:15:36.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.308+0000 7f1b5ffff700 1 -- 172.21.15.82:0/2401663366 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55d7b4592970 con 0x55d7b46b6580 2023-09-23T09:15:36.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.308+0000 7f1b5ffff700 10 client.16677 handle_command_reply: tid=0 2023-09-23T09:15:36.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.308+0000 7f1b9a805b80 1 client.16677 shutdown 2023-09-23T09:15:36.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.308+0000 7f1b9a805b80 1 -- 172.21.15.82:0/2401663366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d7b464d380 msgr2=0x55d7b4658610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:15:36.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.308+0000 7f1b9a805b80 1 --2- 172.21.15.82:0/2401663366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d7b464d380 0x55d7b4658610 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c005950 tx=0x7f1b6c024e60 comp rx=0 tx=0).stop 2023-09-23T09:15:36.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.308+0000 7f1b9a805b80 1 -- 172.21.15.82:0/2401663366 shutdown_connections 2023-09-23T09:15:36.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.308+0000 7f1b9a805b80 1 --2- 172.21.15.82:0/2401663366 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d7b464dca0 0x55d7b4656780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:36.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.308+0000 7f1b9a805b80 1 --2- 172.21.15.82:0/2401663366 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d7b4647c40 0x55d7b46580d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:36.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.308+0000 7f1b9a805b80 1 --2- 172.21.15.82:0/2401663366 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55d7b46b6580 0x55d7b46b89a0 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:36.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.308+0000 7f1b9a805b80 1 --2- 172.21.15.82:0/2401663366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d7b464d380 0x55d7b4658610 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:36.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.308+0000 7f1b5ffff700 0 client.16677 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:15:36.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.308+0000 7f1b9a805b80 1 -- 172.21.15.82:0/2401663366 >> 172.21.15.82:0/2401663366 conn(0x55d7b45bc0e0 msgr2=0x55d7b464b0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:15:36.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.308+0000 7f1b9a805b80 1 -- 172.21.15.82:0/2401663366 shutdown_connections 2023-09-23T09:15:36.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.308+0000 7f1b9a805b80 1 -- 172.21.15.82:0/2401663366 wait complete. 2023-09-23T09:15:36.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.308+0000 7f1b9a805b80 20 client.16677 trim_cache size 0 max 16384 2023-09-23T09:15:36.316 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:15:36.316 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "no active scrubs running", 2023-09-23T09:15:36.316 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": {} 2023-09-23T09:15:36.316 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:15:36.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.309+0000 7f1b86dff700 1 -- 172.21.15.82:0/659340612 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f1b700a0140 msgr2=0x7f1b700a2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:15:36.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.309+0000 7f1b86dff700 1 --2- 172.21.15.82:0/659340612 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f1b700a0140 0x7f1b700a2600 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1b78009ec0 tx=0x7f1b780092f0 comp rx=0 tx=0).stop 2023-09-23T09:15:36.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.309+0000 7f1b86dff700 1 -- 172.21.15.82:0/659340612 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b80072d50 msgr2=0x7f1b8019e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:15:36.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.309+0000 7f1b86dff700 1 --2- 172.21.15.82:0/659340612 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b80072d50 0x7f1b8019e8f0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f1b7400e9a0 tx=0x7f1b7400ecb0 comp rx=0 tx=0).stop 2023-09-23T09:15:36.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.309+0000 7f1b86dff700 1 -- 172.21.15.82:0/659340612 shutdown_connections 2023-09-23T09:15:36.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.309+0000 7f1b86dff700 1 --2- 172.21.15.82:0/659340612 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f1b700a0140 0x7f1b700a2600 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:36.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.309+0000 7f1b86dff700 1 --2- 172.21.15.82:0/659340612 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b8010d0b0 0x7f1b80198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:36.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.309+0000 7f1b86dff700 1 --2- 172.21.15.82:0/659340612 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b80072d50 0x7f1b8019e8f0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:36.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.309+0000 7f1b86dff700 1 --2- 172.21.15.82:0/659340612 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1b80073670 0x7f1b8019ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:36.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.309+0000 7f1b86dff700 1 -- 172.21.15.82:0/659340612 >> 172.21.15.82:0/659340612 conn(0x7f1b800fc3a0 msgr2=0x7f1b8010f330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:15:36.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.309+0000 7f1b86dff700 1 -- 172.21.15.82:0/659340612 shutdown_connections 2023-09-23T09:15:36.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.309+0000 7f1b86dff700 1 -- 172.21.15.82:0/659340612 wait complete. 2023-09-23T09:15:36.331 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-09-23T09:15:36.331 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-23T09:15:36.459 INFO:teuthology.orchestra.run.smithi082.stderr:50000000 of 50000000 tuples (100%) done (elapsed 1091.20 s, remaining 0.00 s) 2023-09-23T09:15:36.557 INFO:teuthology.orchestra.run.smithi082.stderr:vacuum... 2023-09-23T09:15:36.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.579+0000 7f7c8b7ff700 1 -- 172.21.15.82:0/2245323127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c84101a30 msgr2=0x7f7c84101e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:15:36.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.579+0000 7f7c8b7ff700 1 --2- 172.21.15.82:0/2245323127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c84101a30 0x7f7c84101e10 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f7c80009990 tx=0x7f7c80009ca0 comp rx=0 tx=0).stop 2023-09-23T09:15:36.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.579+0000 7f7c8b7ff700 1 -- 172.21.15.82:0/2245323127 shutdown_connections 2023-09-23T09:15:36.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.579+0000 7f7c8b7ff700 1 --2- 172.21.15.82:0/2245323127 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7c8410ae50 0x7f7c8410d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:36.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.579+0000 7f7c8b7ff700 1 --2- 172.21.15.82:0/2245323127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c84101a30 0x7f7c84101e10 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:36.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.579+0000 7f7c8b7ff700 1 --2- 172.21.15.82:0/2245323127 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c84102350 0x7f7c8410a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:36.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.579+0000 7f7c8b7ff700 1 -- 172.21.15.82:0/2245323127 >> 172.21.15.82:0/2245323127 conn(0x7f7c840fb230 msgr2=0x7f7c840fd650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:15:36.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.579+0000 7f7c8b7ff700 1 -- 172.21.15.82:0/2245323127 shutdown_connections 2023-09-23T09:15:36.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.579+0000 7f7c8b7ff700 1 -- 172.21.15.82:0/2245323127 wait complete. 2023-09-23T09:15:36.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.580+0000 7f7c8b7ff700 1 Processor -- start 2023-09-23T09:15:36.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.580+0000 7f7c8b7ff700 1 -- start start 2023-09-23T09:15:36.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.581+0000 7f7c8b7ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c84101a30 0x7f7c840ff680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:36.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.581+0000 7f7c8b7ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7c84102350 0x7f7c840ffbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:36.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.581+0000 7f7c8b7ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c8410ae50 0x7f7c841a4b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:36.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.581+0000 7f7c8b7ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c841003f0 con 0x7f7c84101a30 2023-09-23T09:15:36.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.581+0000 7f7c8b7ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c841a5070 con 0x7f7c8410ae50 2023-09-23T09:15:36.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.581+0000 7f7c8b7ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c841a51b0 con 0x7f7c84102350 2023-09-23T09:15:36.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.581+0000 7f7c8959b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c84101a30 0x7f7c840ff680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:36.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.581+0000 7f7c8959b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c84101a30 0x7f7c840ff680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47866/0 (socket says 172.21.15.82:47866) 2023-09-23T09:15:36.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.581+0000 7f7c8959b700 1 -- 172.21.15.82:0/1926665793 learned_addr learned my addr 172.21.15.82:0/1926665793 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:15:36.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.581+0000 7f7c89d9c700 1 --2- 172.21.15.82:0/1926665793 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c8410ae50 0x7f7c841a4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:36.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.581+0000 7f7c88d9a700 1 --2- 172.21.15.82:0/1926665793 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7c84102350 0x7f7c840ffbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:36.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.582+0000 7f7c8959b700 1 -- 172.21.15.82:0/1926665793 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7c84102350 msgr2=0x7f7c840ffbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:15:36.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.582+0000 7f7c8959b700 1 --2- 172.21.15.82:0/1926665793 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7c84102350 0x7f7c840ffbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:36.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.582+0000 7f7c8959b700 1 -- 172.21.15.82:0/1926665793 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c8410ae50 msgr2=0x7f7c841a4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:15:36.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.582+0000 7f7c8959b700 1 --2- 172.21.15.82:0/1926665793 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c8410ae50 0x7f7c841a4b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:36.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.582+0000 7f7c8959b700 1 -- 172.21.15.82:0/1926665793 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c800095f0 con 0x7f7c84101a30 2023-09-23T09:15:36.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.582+0000 7f7c8959b700 1 --2- 172.21.15.82:0/1926665793 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c84101a30 0x7f7c840ff680 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f7c80005770 tx=0x7f7c800057a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:15:36.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.582+0000 7f7c7a7fc700 1 -- 172.21.15.82:0/1926665793 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c8001d070 con 0x7f7c84101a30 2023-09-23T09:15:36.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.582+0000 7f7c7a7fc700 1 -- 172.21.15.82:0/1926665793 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7c80021410 con 0x7f7c84101a30 2023-09-23T09:15:36.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.582+0000 7f7c7a7fc700 1 -- 172.21.15.82:0/1926665793 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c800173f0 con 0x7f7c84101a30 2023-09-23T09:15:36.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.582+0000 7f7c8b7ff700 1 -- 172.21.15.82:0/1926665793 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c841a53b0 con 0x7f7c84101a30 2023-09-23T09:15:36.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.582+0000 7f7c8b7ff700 1 -- 172.21.15.82:0/1926665793 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c841a5830 con 0x7f7c84101a30 2023-09-23T09:15:36.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.584+0000 7f7c8b7ff700 1 -- 172.21.15.82:0/1926665793 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c84067710 con 0x7f7c84101a30 2023-09-23T09:15:36.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.586+0000 7f7c7a7fc700 1 -- 172.21.15.82:0/1926665793 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f7c8000fac0 con 0x7f7c84101a30 2023-09-23T09:15:36.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.587+0000 7f7c7a7fc700 1 --2- 172.21.15.82:0/1926665793 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f7c700a0180 0x7f7c700a2640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:36.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.587+0000 7f7c7a7fc700 1 -- 172.21.15.82:0/1926665793 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f7c800cc750 con 0x7f7c84101a30 2023-09-23T09:15:36.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.588+0000 7f7c88d9a700 1 --2- 172.21.15.82:0/1926665793 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f7c700a0180 0x7f7c700a2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:36.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.588+0000 7f7c88d9a700 1 --2- 172.21.15.82:0/1926665793 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f7c700a0180 0x7f7c700a2640 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7c84100e70 tx=0x7f7c74009260 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:15:36.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.592+0000 7f7c7a7fc700 1 -- 172.21.15.82:0/1926665793 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f7c800961d0 con 0x7f7c84101a30 2023-09-23T09:15:36.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:15:36 smithi135 ceph-mon[99205]: pgmap v588: 97 pgs: 97 active+clean; 9.6 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 27 MiB/s wr, 102 op/s 2023-09-23T09:15:36.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:15:36 smithi082 ceph-mon[97694]: pgmap v588: 97 pgs: 97 active+clean; 9.6 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 27 MiB/s wr, 102 op/s 2023-09-23T09:15:36.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:15:36 smithi161 ceph-mon[99580]: pgmap v588: 97 pgs: 97 active+clean; 9.6 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 27 MiB/s wr, 102 op/s 2023-09-23T09:15:36.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.916+0000 7f7c8b7ff700 1 -- 172.21.15.82:0/1926665793 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7c84100bb0 con 0x7f7c84101a30 2023-09-23T09:15:36.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.917+0000 7f7c7a7fc700 1 -- 172.21.15.82:0/1926665793 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+11331 (secure 0 0 0) 0x7f7c800997f0 con 0x7f7c84101a30 2023-09-23T09:15:36.919 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T09:15:36.919 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":70,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/1237857359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1237857359},{"type":"v1","addr":"172.21.15.82:6835","nonce":1237857359}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/1335102362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":1335102362},{"type":"v1","addr":"172.21.15.82:6837","nonce":1335102362}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":70,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-23T08:54:52.600479+0000","modified":"2023-09-23T09:15:21.947248+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24557,"mds_1":24550,"mds_2":24526,"mds_3":24515,"mds_4":24514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/3645331700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3645331700},{"type":"v1","addr":"172.21.15.135:6835","nonce":3645331700}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14658":{"gid":14658,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6839/205725278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":205725278},{"type":"v1","addr":"172.21.15.82:6839","nonce":205725278}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14670":{"gid":14670,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6841/2659297867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":2659297867},{"type":"v1","addr":"172.21.15.82:6841","nonce":2659297867}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24461":{"gid":24461,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/503886037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":503886037},{"type":"v1","addr":"172.21.15.135:6833","nonce":503886037}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24463":{"gid":24463,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.161:6833/471569125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":471569125},{"type":"v1","addr":"172.21.15.161:6833","nonce":471569125}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24514":{"gid":24514,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":10,"addr":"172.21.15.161:6835/2237964162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":2237964162},{"type":"v1","addr":"172.21.15.161:6835","nonce":2237964162}]},"join_fscid":-1,"export_targets":[0],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24515":{"gid":24515,"name":"h","rank":3,"incarnation":22,"state":"up:active","state_seq":8,"addr":"172.21.15.135:6837/2655304858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2655304858},{"type":"v1","addr":"172.21.15.135:6837","nonce":2655304858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24526":{"gid":24526,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.161:6837/43639843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":43639843},{"type":"v1","addr":"172.21.15.161:6837","nonce":43639843}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24550":{"gid":24550,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.161:6839/758982817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6838","nonce":758982817},{"type":"v1","addr":"172.21.15.161:6839","nonce":758982817}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24557":{"gid":24557,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6839/2508669274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2508669274},{"type":"v1","addr":"172.21.15.135:6839","nonce":2508669274}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-23T09:15:36.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.919+0000 7f7c8b7ff700 1 -- 172.21.15.82:0/1926665793 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f7c700a0180 msgr2=0x7f7c700a2640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:15:36.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.919+0000 7f7c8b7ff700 1 --2- 172.21.15.82:0/1926665793 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f7c700a0180 0x7f7c700a2640 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7c84100e70 tx=0x7f7c74009260 comp rx=0 tx=0).stop 2023-09-23T09:15:36.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.919+0000 7f7c8b7ff700 1 -- 172.21.15.82:0/1926665793 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c84101a30 msgr2=0x7f7c840ff680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:15:36.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.919+0000 7f7c8b7ff700 1 --2- 172.21.15.82:0/1926665793 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c84101a30 0x7f7c840ff680 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f7c80005770 tx=0x7f7c800057a0 comp rx=0 tx=0).stop 2023-09-23T09:15:36.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.919+0000 7f7c8b7ff700 1 -- 172.21.15.82:0/1926665793 shutdown_connections 2023-09-23T09:15:36.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.919+0000 7f7c8b7ff700 1 --2- 172.21.15.82:0/1926665793 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f7c700a0180 0x7f7c700a2640 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:36.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.919+0000 7f7c8b7ff700 1 --2- 172.21.15.82:0/1926665793 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c8410ae50 0x7f7c841a4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:36.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.919+0000 7f7c8b7ff700 1 --2- 172.21.15.82:0/1926665793 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c84101a30 0x7f7c840ff680 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:36.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.919+0000 7f7c8b7ff700 1 --2- 172.21.15.82:0/1926665793 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7c84102350 0x7f7c840ffbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:36.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.919+0000 7f7c8b7ff700 1 -- 172.21.15.82:0/1926665793 >> 172.21.15.82:0/1926665793 conn(0x7f7c840fb230 msgr2=0x7f7c8410d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:15:36.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.919+0000 7f7c8b7ff700 1 -- 172.21.15.82:0/1926665793 shutdown_connections 2023-09-23T09:15:36.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:36.920+0000 7f7c8b7ff700 1 -- 172.21.15.82:0/1926665793 wait complete. 2023-09-23T09:15:36.923 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 70 2023-09-23T09:15:36.943 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-09-23T09:15:37.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.201+0000 7f2f56dff700 1 -- 172.21.15.82:0/1018636727 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f50106880 msgr2=0x7f2f50106c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:15:37.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.201+0000 7f2f56dff700 1 --2- 172.21.15.82:0/1018636727 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f50106880 0x7f2f50106c60 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f2f44009990 tx=0x7f2f44009ca0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.201+0000 7f2f56dff700 1 -- 172.21.15.82:0/1018636727 shutdown_connections 2023-09-23T09:15:37.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.201+0000 7f2f56dff700 1 --2- 172.21.15.82:0/1018636727 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f50101230 0x7f2f5010d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.201+0000 7f2f56dff700 1 --2- 172.21.15.82:0/1018636727 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f50106880 0x7f2f50106c60 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.201+0000 7f2f56dff700 1 --2- 172.21.15.82:0/1018636727 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2f50100870 0x7f2f50100cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.201+0000 7f2f56dff700 1 -- 172.21.15.82:0/1018636727 >> 172.21.15.82:0/1018636727 conn(0x7f2f500fc3a0 msgr2=0x7f2f500fe7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:15:37.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.201+0000 7f2f56dff700 1 -- 172.21.15.82:0/1018636727 shutdown_connections 2023-09-23T09:15:37.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.201+0000 7f2f56dff700 1 -- 172.21.15.82:0/1018636727 wait complete. 2023-09-23T09:15:37.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.202+0000 7f2f56dff700 1 Processor -- start 2023-09-23T09:15:37.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.202+0000 7f2f56dff700 1 -- start start 2023-09-23T09:15:37.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.203+0000 7f2f56dff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f50100870 0x7f2f5019c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:37.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.203+0000 7f2f56dff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f50101230 0x7f2f5019cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:37.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.203+0000 7f2f56dff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2f50106880 0x7f2f501966d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:37.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.203+0000 7f2f56dff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f50196d40 con 0x7f2f50101230 2023-09-23T09:15:37.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.203+0000 7f2f56dff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f50196eb0 con 0x7f2f50100870 2023-09-23T09:15:37.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.203+0000 7f2f56dff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f50197070 con 0x7f2f50106880 2023-09-23T09:15:37.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.203+0000 7f2f4ffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f50101230 0x7f2f5019cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:37.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.203+0000 7f2f4ffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f50101230 0x7f2f5019cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47882/0 (socket says 172.21.15.82:47882) 2023-09-23T09:15:37.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.203+0000 7f2f4ffff700 1 -- 172.21.15.82:0/1703638426 learned_addr learned my addr 172.21.15.82:0/1703638426 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:15:37.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.203+0000 7f2f5539c700 1 --2- 172.21.15.82:0/1703638426 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2f50106880 0x7f2f501966d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:37.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.203+0000 7f2f54b9b700 1 --2- 172.21.15.82:0/1703638426 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f50100870 0x7f2f5019c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:37.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.204+0000 7f2f4ffff700 1 -- 172.21.15.82:0/1703638426 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2f50106880 msgr2=0x7f2f501966d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:15:37.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.204+0000 7f2f4ffff700 1 --2- 172.21.15.82:0/1703638426 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2f50106880 0x7f2f501966d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.204+0000 7f2f4ffff700 1 -- 172.21.15.82:0/1703638426 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f50100870 msgr2=0x7f2f5019c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:15:37.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.204+0000 7f2f4ffff700 1 --2- 172.21.15.82:0/1703638426 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f50100870 0x7f2f5019c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.204+0000 7f2f4ffff700 1 -- 172.21.15.82:0/1703638426 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f440095f0 con 0x7f2f50101230 2023-09-23T09:15:37.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.204+0000 7f2f4ffff700 1 --2- 172.21.15.82:0/1703638426 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f50101230 0x7f2f5019cba0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c00e9a0 tx=0x7f2f3c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:15:37.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.204+0000 7f2f4dffb700 1 -- 172.21.15.82:0/1703638426 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3c009790 con 0x7f2f50101230 2023-09-23T09:15:37.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.204+0000 7f2f4dffb700 1 -- 172.21.15.82:0/1703638426 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2f3c010430 con 0x7f2f50101230 2023-09-23T09:15:37.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.204+0000 7f2f4dffb700 1 -- 172.21.15.82:0/1703638426 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3c00cea0 con 0x7f2f50101230 2023-09-23T09:15:37.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.204+0000 7f2f56dff700 1 -- 172.21.15.82:0/1703638426 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f50197350 con 0x7f2f50101230 2023-09-23T09:15:37.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.204+0000 7f2f56dff700 1 -- 172.21.15.82:0/1703638426 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f501a3650 con 0x7f2f50101230 2023-09-23T09:15:37.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.208+0000 7f2f4dffb700 1 -- 172.21.15.82:0/1703638426 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f2f3c0105a0 con 0x7f2f50101230 2023-09-23T09:15:37.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.210+0000 7f2f6a722b80 1 Processor -- start 2023-09-23T09:15:37.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.210+0000 7f2f6a722b80 1 -- start start 2023-09-23T09:15:37.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.210+0000 7f2f4dffb700 1 --2- 172.21.15.82:0/1703638426 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f2f400a0140 0x7f2f400a2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:37.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.210+0000 7f2f4dffb700 1 -- 172.21.15.82:0/1703638426 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f2f3c014070 con 0x7f2f50101230 2023-09-23T09:15:37.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.210+0000 7f2f6a722b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575cd375780 0x5575cd375b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:37.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.210+0000 7f2f6a722b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575cd3760a0 0x5575cd36fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:37.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.210+0000 7f2f6a722b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575cd370050 0x5575cd370470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:37.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.210+0000 7f2f6a722b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575cd2d37b0 con 0x5575cd3760a0 2023-09-23T09:15:37.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.210+0000 7f2f6a722b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575cd2c4780 con 0x5575cd375780 2023-09-23T09:15:37.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.210+0000 7f2f6a722b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575cd2c20a0 con 0x5575cd370050 2023-09-23T09:15:37.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.210+0000 7f2f5539c700 1 --2- 172.21.15.82:0/1703638426 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f2f400a0140 0x7f2f400a2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:37.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.211+0000 7f2f4ffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575cd3760a0 0x5575cd36fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:37.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.211+0000 7f2f4ffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575cd3760a0 0x5575cd36fb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47894/0 (socket says 172.21.15.82:47894) 2023-09-23T09:15:37.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.211+0000 7f2f4ffff700 1 -- 172.21.15.82:0/3594722691 learned_addr learned my addr 172.21.15.82:0/3594722691 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:15:37.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.211+0000 7f2f54b9b700 1 --2- 172.21.15.82:0/3594722691 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575cd375780 0x5575cd375b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:37.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.211+0000 7f2f5539c700 1 --2- 172.21.15.82:0/3594722691 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575cd370050 0x5575cd370470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:37.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.211+0000 7f2f4ffff700 1 -- 172.21.15.82:0/3594722691 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575cd370050 msgr2=0x5575cd370470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:15:37.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.211+0000 7f2f4ffff700 1 --2- 172.21.15.82:0/3594722691 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575cd370050 0x5575cd370470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.211+0000 7f2f4ffff700 1 -- 172.21.15.82:0/3594722691 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575cd375780 msgr2=0x5575cd375b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:15:37.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.211+0000 7f2f4ffff700 1 --2- 172.21.15.82:0/3594722691 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575cd375780 0x5575cd375b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.211+0000 7f2f4ffff700 1 -- 172.21.15.82:0/3594722691 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5575cd13d630 con 0x5575cd3760a0 2023-09-23T09:15:37.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.211+0000 7f2f5539c700 1 --2- 172.21.15.82:0/3594722691 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575cd370050 0x5575cd370470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T09:15:37.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.211+0000 7f2f54b9b700 1 --2- 172.21.15.82:0/3594722691 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575cd375780 0x5575cd375b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:15:37.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.211+0000 7f2f5539c700 1 --2- 172.21.15.82:0/1703638426 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f2f400a0140 0x7f2f400a2600 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2f5019d360 tx=0x7f2f48009920 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:15:37.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.211+0000 7f2f4ffff700 1 --2- 172.21.15.82:0/3594722691 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575cd3760a0 0x5575cd36fb10 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c0958d0 tx=0x7f2f3c098ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce68ada2bb1fbcaf server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:15:37.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.212+0000 7f2f3affd700 1 -- 172.21.15.82:0/3594722691 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3c09cc90 con 0x5575cd3760a0 2023-09-23T09:15:37.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.212+0000 7f2f3affd700 1 -- 172.21.15.82:0/3594722691 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2f3c0a0c70 con 0x5575cd3760a0 2023-09-23T09:15:37.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.212+0000 7f2f3affd700 1 -- 172.21.15.82:0/3594722691 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3c0a07e0 con 0x5575cd3760a0 2023-09-23T09:15:37.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.212+0000 7f2f6a722b80 1 -- 172.21.15.82:0/3594722691 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575cd3760a0 msgr2=0x5575cd36fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:15:37.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.212+0000 7f2f6a722b80 1 --2- 172.21.15.82:0/3594722691 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575cd3760a0 0x5575cd36fb10 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c0958d0 tx=0x7f2f3c098ab0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.213+0000 7f2f6a722b80 1 -- 172.21.15.82:0/3594722691 shutdown_connections 2023-09-23T09:15:37.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.213+0000 7f2f6a722b80 1 --2- 172.21.15.82:0/3594722691 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575cd370050 0x5575cd370470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.213+0000 7f2f6a722b80 1 --2- 172.21.15.82:0/3594722691 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575cd375780 0x5575cd375b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.213+0000 7f2f6a722b80 1 --2- 172.21.15.82:0/3594722691 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575cd3760a0 0x5575cd36fb10 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.213+0000 7f2f6a722b80 1 -- 172.21.15.82:0/3594722691 >> 172.21.15.82:0/3594722691 conn(0x5575cd2e00e0 msgr2=0x5575cd366410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:15:37.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.213+0000 7f2f6a722b80 1 -- 172.21.15.82:0/3594722691 shutdown_connections 2023-09-23T09:15:37.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.213+0000 7f2f6a722b80 1 -- 172.21.15.82:0/3594722691 wait complete. 2023-09-23T09:15:37.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.213+0000 7f2f6a722b80 1 -- start start 2023-09-23T09:15:37.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.214+0000 7f2f6a722b80 1 Processor -- start 2023-09-23T09:15:37.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.214+0000 7f2f6a722b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575cd370050 0x5575cd37c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:37.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.214+0000 7f2f6a722b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575cd375780 0x5575cd379300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:37.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.214+0000 7f2f6a722b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575cd3760a0 0x5575cd379980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:37.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.214+0000 7f2f6a722b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575cd2bd990 con 0x5575cd375780 2023-09-23T09:15:37.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.214+0000 7f2f6a722b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575cd25bbb0 con 0x5575cd3760a0 2023-09-23T09:15:37.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.214+0000 7f2f6a722b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575cd25b8b0 con 0x5575cd370050 2023-09-23T09:15:37.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.214+0000 7f2f6a722b80 10 client.0 _ll_register_callbacks cb 0x5575cd1a5a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:15:37.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.215+0000 7f2f54b9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575cd370050 0x5575cd37c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:37.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.215+0000 7f2f4ffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575cd375780 0x5575cd379300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:37.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.215+0000 7f2f54b9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575cd370050 0x5575cd37c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:38114/0 (socket says 172.21.15.82:38114) 2023-09-23T09:15:37.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.215+0000 7f2f54b9b700 1 -- 172.21.15.82:0/1815943569 learned_addr learned my addr 172.21.15.82:0/1815943569 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:15:37.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.215+0000 7f2f5539c700 1 --2- 172.21.15.82:0/1815943569 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575cd3760a0 0x5575cd379980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:37.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.215+0000 7f2f5539c700 1 -- 172.21.15.82:0/1815943569 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575cd370050 msgr2=0x5575cd37c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:15:37.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.215+0000 7f2f5539c700 1 --2- 172.21.15.82:0/1815943569 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575cd370050 0x5575cd37c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.215+0000 7f2f5539c700 1 -- 172.21.15.82:0/1815943569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575cd375780 msgr2=0x5575cd379300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:15:37.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.215+0000 7f2f5539c700 1 --2- 172.21.15.82:0/1815943569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575cd375780 0x5575cd379300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.215+0000 7f2f5539c700 1 -- 172.21.15.82:0/1815943569 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f5010e040 con 0x5575cd3760a0 2023-09-23T09:15:37.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.215+0000 7f2f4ffff700 1 --2- 172.21.15.82:0/1815943569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575cd375780 0x5575cd379300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:15:37.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.215+0000 7f2f5539c700 1 --2- 172.21.15.82:0/1815943569 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575cd3760a0 0x5575cd379980 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2f4800fc60 tx=0x7f2f48004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ab65f300b6e7785 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:15:37.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.215+0000 7f2f2ffff700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-09-23T09:15:37.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.216+0000 7f2f2ffff700 1 -- 172.21.15.82:0/1815943569 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f48027070 con 0x5575cd3760a0 2023-09-23T09:15:37.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.216+0000 7f2f6a722b80 1 -- 172.21.15.82:0/1815943569 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5575cd33b1c0 con 0x5575cd3760a0 2023-09-23T09:15:37.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.216+0000 7f2f2ffff700 1 -- 172.21.15.82:0/1815943569 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f2f4800fe30 con 0x5575cd3760a0 2023-09-23T09:15:37.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.216+0000 7f2f2ffff700 1 -- 172.21.15.82:0/1815943569 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2f4800e040 con 0x5575cd3760a0 2023-09-23T09:15:37.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.216+0000 7f2f6a722b80 10 client.26369 fetch_fsmap learned FSMap version 70 2023-09-23T09:15:37.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.216+0000 7f2f6a722b80 1 -- 172.21.15.82:0/1815943569 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) v3 -- 0x7f2f501a3650 con 0x5575cd3760a0 2023-09-23T09:15:37.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.216+0000 7f2f2ffff700 1 -- 172.21.15.82:0/1815943569 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5575cd33b1c0 con 0x5575cd3760a0 2023-09-23T09:15:37.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.217+0000 7f2f2ffff700 1 -- 172.21.15.82:0/1815943569 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 70) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f2f4802a020 con 0x5575cd3760a0 2023-09-23T09:15:37.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.217+0000 7f2f6a722b80 10 client.26369 fetch_fsmap finished waiting for FSMap version 70 2023-09-23T09:15:37.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.217+0000 7f2f6a722b80 10 client.26369 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2023-09-23T09:15:37.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.217+0000 7f2f6a722b80 20 client.26369 populate_metadata read hostname 'smithi082' 2023-09-23T09:15:37.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.217+0000 7f2f6a722b80 1 --2- 172.21.15.82:0/1815943569 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x5575cd389a60 0x5575cd38be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:37.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.217+0000 7f2f6a722b80 4 client.26369 mds_command: new command op to 24514 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:15:37.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.217+0000 7f2f6a722b80 1 -- 172.21.15.82:0/1815943569 --> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5575cd263ba0 con 0x5575cd389a60 2023-09-23T09:15:37.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.217+0000 7f2f54b9b700 1 --2- 172.21.15.82:0/1815943569 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x5575cd389a60 0x5575cd38be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:37.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.218+0000 7f2f54b9b700 1 --2- 172.21.15.82:0/1815943569 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x5575cd389a60 0x5575cd38be80 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=ea324e74f0b44f2f server_cookie=fa4b391057f5c325 in_seq=0 out_seq=0 2023-09-23T09:15:37.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.218+0000 7f2f2ffff700 10 client.26369 ms_handle_connect on v2:172.21.15.161:6834/2237964162 2023-09-23T09:15:37.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.219+0000 7f2f2ffff700 1 -- 172.21.15.82:0/1815943569 <== mds.4 v2:172.21.15.161:6834/2237964162 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5575cd263ba0 con 0x5575cd389a60 2023-09-23T09:15:37.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.219+0000 7f2f2ffff700 10 client.26369 handle_command_reply: tid=0 2023-09-23T09:15:37.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.219+0000 7f2f6a722b80 1 client.26369 shutdown 2023-09-23T09:15:37.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.219+0000 7f2f6a722b80 1 -- 172.21.15.82:0/1815943569 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575cd3760a0 msgr2=0x5575cd379980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:15:37.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.219+0000 7f2f6a722b80 1 --2- 172.21.15.82:0/1815943569 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575cd3760a0 0x5575cd379980 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2f4800fc60 tx=0x7f2f48004b40 comp rx=0 tx=0).stop 2023-09-23T09:15:37.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.219+0000 7f2f6a722b80 1 -- 172.21.15.82:0/1815943569 shutdown_connections 2023-09-23T09:15:37.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.219+0000 7f2f6a722b80 1 --2- 172.21.15.82:0/1815943569 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x5575cd389a60 0x5575cd38be80 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.219+0000 7f2f6a722b80 1 --2- 172.21.15.82:0/1815943569 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575cd3760a0 0x5575cd379980 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.219+0000 7f2f6a722b80 1 --2- 172.21.15.82:0/1815943569 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575cd370050 0x5575cd37c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.219+0000 7f2f2ffff700 0 client.26369 ms_handle_reset on v2:172.21.15.161:6834/2237964162 2023-09-23T09:15:37.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.219+0000 7f2f6a722b80 1 --2- 172.21.15.82:0/1815943569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575cd375780 0x5575cd379300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.219+0000 7f2f6a722b80 1 -- 172.21.15.82:0/1815943569 >> 172.21.15.82:0/1815943569 conn(0x5575cd2e00e0 msgr2=0x5575cd360b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:15:37.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.219+0000 7f2f6a722b80 1 -- 172.21.15.82:0/1815943569 shutdown_connections 2023-09-23T09:15:37.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.219+0000 7f2f6a722b80 1 -- 172.21.15.82:0/1815943569 wait complete. 2023-09-23T09:15:37.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.219+0000 7f2f6a722b80 20 client.26369 trim_cache size 0 max 16384 2023-09-23T09:15:37.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.235+0000 7f2f6a722b80 1 Processor -- start 2023-09-23T09:15:37.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.235+0000 7f2f6a722b80 1 -- start start 2023-09-23T09:15:37.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.235+0000 7f2f6a722b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575cd370050 0x5575cd380ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:37.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.235+0000 7f2f6a722b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575cd375780 0x5575cd373510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:37.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.235+0000 7f2f6a722b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575cd3760a0 0x5575cd373a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:37.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.235+0000 7f2f6a722b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575cd13f920 con 0x5575cd375780 2023-09-23T09:15:37.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.235+0000 7f2f6a722b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575cd362a20 con 0x5575cd3760a0 2023-09-23T09:15:37.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.235+0000 7f2f6a722b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575cd3864b0 con 0x5575cd370050 2023-09-23T09:15:37.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.236+0000 7f2f4ffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575cd375780 0x5575cd373510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:37.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.236+0000 7f2f4ffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575cd375780 0x5575cd373510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47908/0 (socket says 172.21.15.82:47908) 2023-09-23T09:15:37.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.236+0000 7f2f54b9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575cd370050 0x5575cd380ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:37.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.236+0000 7f2f4ffff700 1 -- 172.21.15.82:0/2348882350 learned_addr learned my addr 172.21.15.82:0/2348882350 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:15:37.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.236+0000 7f2f5539c700 1 --2- 172.21.15.82:0/2348882350 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575cd3760a0 0x5575cd373a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:37.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.236+0000 7f2f54b9b700 1 -- 172.21.15.82:0/2348882350 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575cd3760a0 msgr2=0x5575cd373a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:15:37.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.236+0000 7f2f54b9b700 1 --2- 172.21.15.82:0/2348882350 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575cd3760a0 0x5575cd373a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.236+0000 7f2f54b9b700 1 -- 172.21.15.82:0/2348882350 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575cd375780 msgr2=0x5575cd373510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:15:37.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.236+0000 7f2f54b9b700 1 --2- 172.21.15.82:0/2348882350 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575cd375780 0x5575cd373510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.236+0000 7f2f54b9b700 1 -- 172.21.15.82:0/2348882350 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5575cd0e9de0 con 0x5575cd370050 2023-09-23T09:15:37.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.236+0000 7f2f4ffff700 1 --2- 172.21.15.82:0/2348882350 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575cd375780 0x5575cd373510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:15:37.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.237+0000 7f2f54b9b700 1 --2- 172.21.15.82:0/2348882350 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575cd370050 0x5575cd380ba0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x5575cd389e40 tx=0x7f2f4400b260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe482c7eefa5b0ad server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:15:37.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.237+0000 7f2f3b7fe700 1 -- 172.21.15.82:0/2348882350 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f4402a070 con 0x5575cd370050 2023-09-23T09:15:37.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.237+0000 7f2f3b7fe700 1 -- 172.21.15.82:0/2348882350 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2f4401e040 con 0x5575cd370050 2023-09-23T09:15:37.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.237+0000 7f2f3b7fe700 1 -- 172.21.15.82:0/2348882350 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f4401d040 con 0x5575cd370050 2023-09-23T09:15:37.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.238+0000 7f2f6a722b80 1 -- 172.21.15.82:0/2348882350 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575cd370050 msgr2=0x5575cd380ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:15:37.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.238+0000 7f2f6a722b80 1 --2- 172.21.15.82:0/2348882350 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575cd370050 0x5575cd380ba0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x5575cd389e40 tx=0x7f2f4400b260 comp rx=0 tx=0).stop 2023-09-23T09:15:37.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.238+0000 7f2f6a722b80 1 -- 172.21.15.82:0/2348882350 shutdown_connections 2023-09-23T09:15:37.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.238+0000 7f2f6a722b80 1 --2- 172.21.15.82:0/2348882350 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575cd3760a0 0x5575cd373a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.238+0000 7f2f6a722b80 1 --2- 172.21.15.82:0/2348882350 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575cd370050 0x5575cd380ba0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.238+0000 7f2f6a722b80 1 --2- 172.21.15.82:0/2348882350 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575cd375780 0x5575cd373510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.238+0000 7f2f6a722b80 1 -- 172.21.15.82:0/2348882350 >> 172.21.15.82:0/2348882350 conn(0x5575cd2e00e0 msgr2=0x5575cd366190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:15:37.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.238+0000 7f2f6a722b80 1 -- 172.21.15.82:0/2348882350 shutdown_connections 2023-09-23T09:15:37.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.238+0000 7f2f6a722b80 1 -- 172.21.15.82:0/2348882350 wait complete. 2023-09-23T09:15:37.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.238+0000 7f2f6a722b80 1 -- start start 2023-09-23T09:15:37.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.239+0000 7f2f6a722b80 1 Processor -- start 2023-09-23T09:15:37.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.239+0000 7f2f6a722b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575cd370050 0x5575cd380560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:37.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.239+0000 7f2f6a722b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575cd375780 0x5575cd380aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:37.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.239+0000 7f2f6a722b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575cd3760a0 0x5575cd37eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:37.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.239+0000 7f2f6a722b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575cd37f290 con 0x5575cd3760a0 2023-09-23T09:15:37.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.239+0000 7f2f6a722b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575cd37f400 con 0x5575cd375780 2023-09-23T09:15:37.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.239+0000 7f2f6a722b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575cd37f5c0 con 0x5575cd370050 2023-09-23T09:15:37.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.239+0000 7f2f6a722b80 10 client.0 _ll_register_callbacks cb 0x7f2f48019800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:15:37.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.240+0000 7f2f54b9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575cd370050 0x5575cd380560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:37.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.240+0000 7f2f4ffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575cd375780 0x5575cd380aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:37.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.240+0000 7f2f54b9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575cd370050 0x5575cd380560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:38140/0 (socket says 172.21.15.82:38140) 2023-09-23T09:15:37.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.240+0000 7f2f54b9b700 1 -- 172.21.15.82:0/674145764 learned_addr learned my addr 172.21.15.82:0/674145764 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:15:37.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.240+0000 7f2f4ffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575cd375780 0x5575cd380aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:38760/0 (socket says 172.21.15.82:38760) 2023-09-23T09:15:37.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.240+0000 7f2f5539c700 1 --2- 172.21.15.82:0/674145764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575cd3760a0 0x5575cd37eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:37.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.240+0000 7f2f54b9b700 1 -- 172.21.15.82:0/674145764 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575cd375780 msgr2=0x5575cd380aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:15:37.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.240+0000 7f2f54b9b700 1 --2- 172.21.15.82:0/674145764 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575cd375780 0x5575cd380aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.240+0000 7f2f54b9b700 1 -- 172.21.15.82:0/674145764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575cd3760a0 msgr2=0x5575cd37eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:15:37.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.240+0000 7f2f54b9b700 1 --2- 172.21.15.82:0/674145764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575cd3760a0 0x5575cd37eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.240+0000 7f2f54b9b700 1 -- 172.21.15.82:0/674145764 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5575cd13d630 con 0x5575cd370050 2023-09-23T09:15:37.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.240+0000 7f2f5539c700 1 --2- 172.21.15.82:0/674145764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575cd3760a0 0x5575cd37eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:15:37.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.240+0000 7f2f54b9b700 1 --2- 172.21.15.82:0/674145764 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575cd370050 0x5575cd380560 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2f44000c00 tx=0x7f2f44005cd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9752d2d61fd6da9f server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:15:37.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.240+0000 7f2f2ffff700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T09:15:37.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.241+0000 7f2f2ffff700 1 -- 172.21.15.82:0/674145764 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f4402a040 con 0x5575cd370050 2023-09-23T09:15:37.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.241+0000 7f2f2ffff700 1 -- 172.21.15.82:0/674145764 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f2f4400bbe0 con 0x5575cd370050 2023-09-23T09:15:37.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.241+0000 7f2f6a722b80 1 -- 172.21.15.82:0/674145764 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5575cd35e8b0 con 0x5575cd370050 2023-09-23T09:15:37.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.241+0000 7f2f2ffff700 1 -- 172.21.15.82:0/674145764 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2f4401d040 con 0x5575cd370050 2023-09-23T09:15:37.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.241+0000 7f2f6a722b80 10 client.26431 fetch_fsmap learned FSMap version 70 2023-09-23T09:15:37.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.241+0000 7f2f6a722b80 1 -- 172.21.15.82:0/674145764 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) v3 -- 0x7f2f440053c0 con 0x5575cd370050 2023-09-23T09:15:37.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.241+0000 7f2f2ffff700 1 -- 172.21.15.82:0/674145764 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5575cd35e8b0 con 0x5575cd370050 2023-09-23T09:15:37.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.241+0000 7f2f2ffff700 1 -- 172.21.15.82:0/674145764 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 70) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f2f44035070 con 0x5575cd370050 2023-09-23T09:15:37.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.241+0000 7f2f6a722b80 10 client.26431 fetch_fsmap finished waiting for FSMap version 70 2023-09-23T09:15:37.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.241+0000 7f2f6a722b80 10 client.26431 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2023-09-23T09:15:37.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.241+0000 7f2f6a722b80 20 client.26431 populate_metadata read hostname 'smithi082' 2023-09-23T09:15:37.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.241+0000 7f2f6a722b80 1 --2- 172.21.15.82:0/674145764 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x5575cd3de4b0 0x5575cd3e08d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:37.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.242+0000 7f2f6a722b80 4 client.26431 mds_command: new command op to 24514 tid=0[{"prefix": "damage ls"}] 2023-09-23T09:15:37.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.242+0000 7f2f6a722b80 1 -- 172.21.15.82:0/674145764 --> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5575cd2b6970 con 0x5575cd3de4b0 2023-09-23T09:15:37.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.242+0000 7f2f4ffff700 1 --2- 172.21.15.82:0/674145764 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x5575cd3de4b0 0x5575cd3e08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:37.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.242+0000 7f2f2ffff700 10 client.26431 ms_handle_connect on v2:172.21.15.161:6834/2237964162 2023-09-23T09:15:37.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.242+0000 7f2f4ffff700 1 --2- 172.21.15.82:0/674145764 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x5575cd3de4b0 0x5575cd3e08d0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=a47c2eef17ec93ff server_cookie=bff7bffb44de034d in_seq=0 out_seq=0 2023-09-23T09:15:37.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.243+0000 7f2f2ffff700 1 -- 172.21.15.82:0/674145764 <== mds.4 v2:172.21.15.161:6834/2237964162 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5575cd2b6970 con 0x5575cd3de4b0 2023-09-23T09:15:37.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.243+0000 7f2f2ffff700 10 client.26431 handle_command_reply: tid=0 2023-09-23T09:15:37.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.243+0000 7f2f6a722b80 1 client.26431 shutdown 2023-09-23T09:15:37.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.243+0000 7f2f6a722b80 1 -- 172.21.15.82:0/674145764 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575cd370050 msgr2=0x5575cd380560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:15:37.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.243+0000 7f2f6a722b80 1 --2- 172.21.15.82:0/674145764 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575cd370050 0x5575cd380560 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2f44000c00 tx=0x7f2f44005cd0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.243+0000 7f2f6a722b80 1 -- 172.21.15.82:0/674145764 shutdown_connections 2023-09-23T09:15:37.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.243+0000 7f2f6a722b80 1 --2- 172.21.15.82:0/674145764 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x5575cd3de4b0 0x5575cd3e08d0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.243+0000 7f2f6a722b80 1 --2- 172.21.15.82:0/674145764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575cd3760a0 0x5575cd37eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.243+0000 7f2f6a722b80 1 --2- 172.21.15.82:0/674145764 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575cd370050 0x5575cd380560 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.243+0000 7f2f2ffff700 0 client.26431 ms_handle_reset on v2:172.21.15.161:6834/2237964162 2023-09-23T09:15:37.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.243+0000 7f2f6a722b80 1 --2- 172.21.15.82:0/674145764 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575cd375780 0x5575cd380aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.243+0000 7f2f6a722b80 1 -- 172.21.15.82:0/674145764 >> 172.21.15.82:0/674145764 conn(0x5575cd2e00e0 msgr2=0x5575cd373510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:15:37.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.243+0000 7f2f6a722b80 1 -- 172.21.15.82:0/674145764 shutdown_connections 2023-09-23T09:15:37.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.243+0000 7f2f6a722b80 1 -- 172.21.15.82:0/674145764 wait complete. 2023-09-23T09:15:37.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.243+0000 7f2f6a722b80 20 client.26431 trim_cache size 0 max 16384 2023-09-23T09:15:37.251 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2023-09-23T09:15:37.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.244+0000 7f2f56dff700 1 -- 172.21.15.82:0/1703638426 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f2f400a0140 msgr2=0x7f2f400a2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:15:37.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.244+0000 7f2f56dff700 1 --2- 172.21.15.82:0/1703638426 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f2f400a0140 0x7f2f400a2600 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2f5019d360 tx=0x7f2f48009920 comp rx=0 tx=0).stop 2023-09-23T09:15:37.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.244+0000 7f2f56dff700 1 -- 172.21.15.82:0/1703638426 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f50101230 msgr2=0x7f2f5019cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:15:37.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.244+0000 7f2f56dff700 1 --2- 172.21.15.82:0/1703638426 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f50101230 0x7f2f5019cba0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c00e9a0 tx=0x7f2f3c00ecb0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.244+0000 7f2f56dff700 1 -- 172.21.15.82:0/1703638426 shutdown_connections 2023-09-23T09:15:37.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.244+0000 7f2f56dff700 1 --2- 172.21.15.82:0/1703638426 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f2f400a0140 0x7f2f400a2600 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.244+0000 7f2f56dff700 1 --2- 172.21.15.82:0/1703638426 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2f50106880 0x7f2f501966d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.244+0000 7f2f56dff700 1 --2- 172.21.15.82:0/1703638426 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f50100870 0x7f2f5019c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.244+0000 7f2f56dff700 1 --2- 172.21.15.82:0/1703638426 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f50101230 0x7f2f5019cba0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.244+0000 7f2f56dff700 1 -- 172.21.15.82:0/1703638426 >> 172.21.15.82:0/1703638426 conn(0x7f2f500fc3a0 msgr2=0x7f2f500fca50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:15:37.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.244+0000 7f2f56dff700 1 -- 172.21.15.82:0/1703638426 shutdown_connections 2023-09-23T09:15:37.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.244+0000 7f2f56dff700 1 -- 172.21.15.82:0/1703638426 wait complete. 2023-09-23T09:15:37.265 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-09-23T09:15:37.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.497+0000 7ff45759e700 1 -- 172.21.15.82:0/1036300666 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff458106700 msgr2=0x7ff458106ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:15:37.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.497+0000 7ff45759e700 1 --2- 172.21.15.82:0/1036300666 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff458106700 0x7ff458106ae0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7ff448009990 tx=0x7ff448009ca0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.500 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.497+0000 7ff45759e700 1 -- 172.21.15.82:0/1036300666 shutdown_connections 2023-09-23T09:15:37.500 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.497+0000 7ff45759e700 1 --2- 172.21.15.82:0/1036300666 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4581010b0 0x7ff45810d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.500 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.497+0000 7ff45759e700 1 --2- 172.21.15.82:0/1036300666 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff458106700 0x7ff458106ae0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.500 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.497+0000 7ff45759e700 1 --2- 172.21.15.82:0/1036300666 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4581006f0 0x7ff458100b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.500 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.497+0000 7ff45759e700 1 -- 172.21.15.82:0/1036300666 >> 172.21.15.82:0/1036300666 conn(0x7ff4580fc1c0 msgr2=0x7ff4580fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:15:37.500 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.497+0000 7ff45759e700 1 -- 172.21.15.82:0/1036300666 shutdown_connections 2023-09-23T09:15:37.500 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.497+0000 7ff45759e700 1 -- 172.21.15.82:0/1036300666 wait complete. 2023-09-23T09:15:37.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.498+0000 7ff45759e700 1 Processor -- start 2023-09-23T09:15:37.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.498+0000 7ff45759e700 1 -- start start 2023-09-23T09:15:37.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.499+0000 7ff45759e700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4581006f0 0x7ff458072c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:37.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.499+0000 7ff45759e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4581010b0 0x7ff458073160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:37.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.499+0000 7ff45759e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff458106700 0x7ff4581a4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:37.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.499+0000 7ff45759e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff458073990 con 0x7ff458106700 2023-09-23T09:15:37.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.499+0000 7ff45759e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4581a4cc0 con 0x7ff4581010b0 2023-09-23T09:15:37.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.499+0000 7ff45759e700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4581a4e00 con 0x7ff4581006f0 2023-09-23T09:15:37.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.499+0000 7ff45659c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4581006f0 0x7ff458072c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:37.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.499+0000 7ff45659c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4581006f0 0x7ff458072c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:38172/0 (socket says 172.21.15.82:38172) 2023-09-23T09:15:37.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.499+0000 7ff455d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4581010b0 0x7ff458073160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:37.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.499+0000 7ff456d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff458106700 0x7ff4581a4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:37.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.499+0000 7ff45659c700 1 -- 172.21.15.82:0/2389390967 learned_addr learned my addr 172.21.15.82:0/2389390967 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:15:37.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.500+0000 7ff455d9b700 1 -- 172.21.15.82:0/2389390967 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4581006f0 msgr2=0x7ff458072c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:15:37.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.500+0000 7ff455d9b700 1 --2- 172.21.15.82:0/2389390967 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4581006f0 0x7ff458072c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.500+0000 7ff455d9b700 1 -- 172.21.15.82:0/2389390967 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff458106700 msgr2=0x7ff4581a4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:15:37.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.500+0000 7ff455d9b700 1 --2- 172.21.15.82:0/2389390967 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff458106700 0x7ff4581a4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.500+0000 7ff455d9b700 1 -- 172.21.15.82:0/2389390967 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4480095f0 con 0x7ff4581010b0 2023-09-23T09:15:37.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.500+0000 7ff45659c700 1 --2- 172.21.15.82:0/2389390967 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4581006f0 0x7ff458072c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:15:37.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.500+0000 7ff455d9b700 1 --2- 172.21.15.82:0/2389390967 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4581010b0 0x7ff458073160 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff44c00e9f0 tx=0x7ff44c00ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:15:37.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.500+0000 7ff4477fe700 1 -- 172.21.15.82:0/2389390967 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff44c00c9c0 con 0x7ff4581010b0 2023-09-23T09:15:37.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.500+0000 7ff45759e700 1 -- 172.21.15.82:0/2389390967 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4581a5060 con 0x7ff4581010b0 2023-09-23T09:15:37.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.500+0000 7ff4477fe700 1 -- 172.21.15.82:0/2389390967 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff44c010430 con 0x7ff4581010b0 2023-09-23T09:15:37.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.500+0000 7ff4477fe700 1 -- 172.21.15.82:0/2389390967 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff44c018680 con 0x7ff4581010b0 2023-09-23T09:15:37.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.501+0000 7ff45759e700 1 -- 172.21.15.82:0/2389390967 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4581a5590 con 0x7ff4581010b0 2023-09-23T09:15:37.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.505+0000 7ff4477fe700 1 -- 172.21.15.82:0/2389390967 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7ff44c0105a0 con 0x7ff4581010b0 2023-09-23T09:15:37.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.506+0000 7ff47099ab80 1 Processor -- start 2023-09-23T09:15:37.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.507+0000 7ff47099ab80 1 -- start start 2023-09-23T09:15:37.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.507+0000 7ff47099ab80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564671b61500 0x564671b618e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:37.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.507+0000 7ff47099ab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564671b61e20 0x564671b5b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:37.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.507+0000 7ff47099ab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564671b5bc40 0x564671b5c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:37.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.507+0000 7ff47099ab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x564671ac37b0 con 0x564671b61e20 2023-09-23T09:15:37.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.507+0000 7ff47099ab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x564671ab4780 con 0x564671b5bc40 2023-09-23T09:15:37.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.507+0000 7ff47099ab80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x564671ab20a0 con 0x564671b61500 2023-09-23T09:15:37.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.508+0000 7ff4477fe700 1 --2- 172.21.15.82:0/2389390967 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7ff4400a0160 0x7ff4400a2620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:37.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.508+0000 7ff455d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564671b5bc40 0x564671b5c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:37.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.508+0000 7ff45659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564671b61e20 0x564671b5b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:37.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.508+0000 7ff455d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564671b5bc40 0x564671b5c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:38790/0 (socket says 172.21.15.82:38790) 2023-09-23T09:15:37.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.508+0000 7ff455d9b700 1 -- 172.21.15.82:0/1526799221 learned_addr learned my addr 172.21.15.82:0/1526799221 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:15:37.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.508+0000 7ff456d9d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564671b61500 0x564671b618e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:37.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.508+0000 7ff4477fe700 1 -- 172.21.15.82:0/2389390967 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 8513+0+0 (secure 0 0 0) 0x7ff44c014070 con 0x7ff4581010b0 2023-09-23T09:15:37.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.508+0000 7ff456d9d700 1 --2- 172.21.15.82:0/2389390967 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7ff4400a0160 0x7ff4400a2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:37.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.508+0000 7ff455d9b700 1 -- 172.21.15.82:0/1526799221 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564671b61500 msgr2=0x564671b618e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:15:37.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.508+0000 7ff455d9b700 1 --2- 172.21.15.82:0/1526799221 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564671b61500 0x564671b618e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.508+0000 7ff455d9b700 1 -- 172.21.15.82:0/1526799221 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564671b61e20 msgr2=0x564671b5b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:15:37.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.508+0000 7ff455d9b700 1 --2- 172.21.15.82:0/1526799221 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564671b61e20 0x564671b5b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.508+0000 7ff455d9b700 1 -- 172.21.15.82:0/1526799221 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56467192d630 con 0x564671b5bc40 2023-09-23T09:15:37.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.508+0000 7ff45659c700 1 --2- 172.21.15.82:0/1526799221 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564671b61e20 0x564671b5b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:15:37.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.509+0000 7ff455d9b700 1 --2- 172.21.15.82:0/1526799221 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564671b5bc40 0x564671b5c080 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff44c098b90 tx=0x7ff44c06af00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f947473188125ef server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:15:37.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.509+0000 7ff456d9d700 1 --2- 172.21.15.82:0/2389390967 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7ff4400a0160 0x7ff4400a2620 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff458074d30 tx=0x7ff450009100 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:15:37.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.509+0000 7ff444ff9700 1 -- 172.21.15.82:0/1526799221 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff44c0987f0 con 0x564671b5bc40 2023-09-23T09:15:37.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.509+0000 7ff444ff9700 1 -- 172.21.15.82:0/1526799221 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff44c010880 con 0x564671b5bc40 2023-09-23T09:15:37.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.509+0000 7ff444ff9700 1 -- 172.21.15.82:0/1526799221 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff44c0b80d0 con 0x564671b5bc40 2023-09-23T09:15:37.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.509+0000 7ff47099ab80 1 -- 172.21.15.82:0/1526799221 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564671b5bc40 msgr2=0x564671b5c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:15:37.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.509+0000 7ff47099ab80 1 --2- 172.21.15.82:0/1526799221 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564671b5bc40 0x564671b5c080 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff44c098b90 tx=0x7ff44c06af00 comp rx=0 tx=0).stop 2023-09-23T09:15:37.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.510+0000 7ff47099ab80 1 -- 172.21.15.82:0/1526799221 shutdown_connections 2023-09-23T09:15:37.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.510+0000 7ff47099ab80 1 --2- 172.21.15.82:0/1526799221 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564671b5bc40 0x564671b5c080 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.510+0000 7ff47099ab80 1 --2- 172.21.15.82:0/1526799221 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564671b61500 0x564671b618e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.510+0000 7ff47099ab80 1 --2- 172.21.15.82:0/1526799221 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564671b61e20 0x564671b5b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.510+0000 7ff47099ab80 1 -- 172.21.15.82:0/1526799221 >> 172.21.15.82:0/1526799221 conn(0x564671ad00e0 msgr2=0x564671b56940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:15:37.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.510+0000 7ff47099ab80 1 -- 172.21.15.82:0/1526799221 shutdown_connections 2023-09-23T09:15:37.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.510+0000 7ff47099ab80 1 -- 172.21.15.82:0/1526799221 wait complete. 2023-09-23T09:15:37.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.510+0000 7ff47099ab80 1 -- start start 2023-09-23T09:15:37.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.511+0000 7ff47099ab80 1 Processor -- start 2023-09-23T09:15:37.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.511+0000 7ff47099ab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564671b5bc40 0x564671b67e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:37.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.511+0000 7ff47099ab80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564671b61500 0x564671b65120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:37.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.511+0000 7ff47099ab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564671b61e20 0x564671b65810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:37.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.511+0000 7ff47099ab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x564671aad990 con 0x564671b5bc40 2023-09-23T09:15:37.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.511+0000 7ff47099ab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x564671a4bbb0 con 0x564671b61e20 2023-09-23T09:15:37.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.511+0000 7ff47099ab80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x564671a4b8b0 con 0x564671b61500 2023-09-23T09:15:37.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.511+0000 7ff47099ab80 10 client.0 _ll_register_callbacks cb 0x564671995a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:15:37.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.512+0000 7ff45659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564671b5bc40 0x564671b67e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:37.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.512+0000 7ff45659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564671b5bc40 0x564671b67e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47950/0 (socket says 172.21.15.82:47950) 2023-09-23T09:15:37.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.512+0000 7ff45659c700 1 -- 172.21.15.82:0/3195373106 learned_addr learned my addr 172.21.15.82:0/3195373106 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:15:37.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.512+0000 7ff456d9d700 1 --2- 172.21.15.82:0/3195373106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564671b61e20 0x564671b65810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:37.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.512+0000 7ff455d9b700 1 --2- 172.21.15.82:0/3195373106 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564671b61500 0x564671b65120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:37.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.512+0000 7ff45659c700 1 -- 172.21.15.82:0/3195373106 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564671b61500 msgr2=0x564671b65120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:15:37.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.512+0000 7ff45659c700 1 --2- 172.21.15.82:0/3195373106 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564671b61500 0x564671b65120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.512+0000 7ff45659c700 1 -- 172.21.15.82:0/3195373106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564671b61e20 msgr2=0x564671b65810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:15:37.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.512+0000 7ff45659c700 1 --2- 172.21.15.82:0/3195373106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564671b61e20 0x564671b65810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.512+0000 7ff45659c700 1 -- 172.21.15.82:0/3195373106 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff45810dec0 con 0x564671b5bc40 2023-09-23T09:15:37.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.513+0000 7ff45659c700 1 --2- 172.21.15.82:0/3195373106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564671b5bc40 0x564671b67e30 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7ff4480052e0 tx=0x7ff448005310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ce72fb92840176c server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:15:37.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.513+0000 7ff43dffb700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:15:37.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.513+0000 7ff43dffb700 1 -- 172.21.15.82:0/3195373106 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff44801d070 con 0x564671b5bc40 2023-09-23T09:15:37.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.513+0000 7ff43dffb700 1 -- 172.21.15.82:0/3195373106 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 8513+0+0 (secure 0 0 0) 0x7ff448004990 con 0x564671b5bc40 2023-09-23T09:15:37.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.513+0000 7ff47099ab80 1 -- 172.21.15.82:0/3195373106 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564671b2b1c0 con 0x564671b5bc40 2023-09-23T09:15:37.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.514+0000 7ff43dffb700 1 -- 172.21.15.82:0/3195373106 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff448004b50 con 0x564671b5bc40 2023-09-23T09:15:37.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.514+0000 7ff47099ab80 10 client.16713 fetch_fsmap learned FSMap version 70 2023-09-23T09:15:37.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.514+0000 7ff47099ab80 1 -- 172.21.15.82:0/3195373106 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) v3 -- 0x7ff4581a5590 con 0x564671b5bc40 2023-09-23T09:15:37.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.514+0000 7ff43dffb700 1 -- 172.21.15.82:0/3195373106 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x564671b2b1c0 con 0x564671b5bc40 2023-09-23T09:15:37.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.514+0000 7ff43dffb700 1 -- 172.21.15.82:0/3195373106 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 70) v1 ==== 7902+0+0 (secure 0 0 0) 0x7ff44800fd10 con 0x564671b5bc40 2023-09-23T09:15:37.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.514+0000 7ff47099ab80 10 client.16713 fetch_fsmap finished waiting for FSMap version 70 2023-09-23T09:15:37.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.514+0000 7ff47099ab80 10 client.16713 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2023-09-23T09:15:37.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.514+0000 7ff47099ab80 20 client.16713 populate_metadata read hostname 'smithi082' 2023-09-23T09:15:37.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.515+0000 7ff47099ab80 1 --2- 172.21.15.82:0/3195373106 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x564671b75990 0x564671b77db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:37.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.515+0000 7ff47099ab80 4 client.16713 mds_command: new command op to 24515 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:15:37.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.515+0000 7ff47099ab80 1 -- 172.21.15.82:0/3195373106 --> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564671a53ba0 con 0x564671b75990 2023-09-23T09:15:37.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.515+0000 7ff455d9b700 1 --2- 172.21.15.82:0/3195373106 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x564671b75990 0x564671b77db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:37.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.516+0000 7ff455d9b700 1 --2- 172.21.15.82:0/3195373106 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x564671b75990 0x564671b77db0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=b54d526779878f94 server_cookie=cc40abf8a2b54155 in_seq=0 out_seq=0 2023-09-23T09:15:37.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.516+0000 7ff43dffb700 10 client.16713 ms_handle_connect on v2:172.21.15.135:6836/2655304858 2023-09-23T09:15:37.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.516+0000 7ff43dffb700 1 -- 172.21.15.82:0/3195373106 <== mds.3 v2:172.21.15.135:6836/2655304858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x564671a53ba0 con 0x564671b75990 2023-09-23T09:15:37.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.516+0000 7ff43dffb700 10 client.16713 handle_command_reply: tid=0 2023-09-23T09:15:37.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.516+0000 7ff47099ab80 1 client.16713 shutdown 2023-09-23T09:15:37.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.516+0000 7ff47099ab80 1 -- 172.21.15.82:0/3195373106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564671b5bc40 msgr2=0x564671b67e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:15:37.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.516+0000 7ff47099ab80 1 --2- 172.21.15.82:0/3195373106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564671b5bc40 0x564671b67e30 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7ff4480052e0 tx=0x7ff448005310 comp rx=0 tx=0).stop 2023-09-23T09:15:37.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.517+0000 7ff47099ab80 1 -- 172.21.15.82:0/3195373106 shutdown_connections 2023-09-23T09:15:37.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.517+0000 7ff47099ab80 1 --2- 172.21.15.82:0/3195373106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564671b61e20 0x564671b65810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.517+0000 7ff47099ab80 1 --2- 172.21.15.82:0/3195373106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564671b5bc40 0x564671b67e30 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.517+0000 7ff47099ab80 1 --2- 172.21.15.82:0/3195373106 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x564671b75990 0x564671b77db0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.517+0000 7ff47099ab80 1 --2- 172.21.15.82:0/3195373106 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564671b61500 0x564671b65120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.517+0000 7ff43dffb700 0 client.16713 ms_handle_reset on v2:172.21.15.135:6836/2655304858 2023-09-23T09:15:37.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.517+0000 7ff47099ab80 1 -- 172.21.15.82:0/3195373106 >> 172.21.15.82:0/3195373106 conn(0x564671ad00e0 msgr2=0x564671b5a6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:15:37.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.517+0000 7ff47099ab80 1 -- 172.21.15.82:0/3195373106 shutdown_connections 2023-09-23T09:15:37.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.517+0000 7ff47099ab80 1 -- 172.21.15.82:0/3195373106 wait complete. 2023-09-23T09:15:37.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.517+0000 7ff47099ab80 20 client.16713 trim_cache size 0 max 16384 2023-09-23T09:15:37.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.535+0000 7ff47099ab80 1 Processor -- start 2023-09-23T09:15:37.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.535+0000 7ff47099ab80 1 -- start start 2023-09-23T09:15:37.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.535+0000 7ff47099ab80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564671b5bc40 0x564671b6c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:37.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.536+0000 7ff47099ab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564671b61500 0x564671b5f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:37.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.536+0000 7ff47099ab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564671b61e20 0x564671b679d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:37.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.536+0000 7ff47099ab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56467192f920 con 0x564671b61e20 2023-09-23T09:15:37.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.536+0000 7ff47099ab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x564671b5c990 con 0x564671b61500 2023-09-23T09:15:37.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.536+0000 7ff47099ab80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x564671b66670 con 0x564671b5bc40 2023-09-23T09:15:37.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.536+0000 7ff456d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564671b61e20 0x564671b679d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:37.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.536+0000 7ff456d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564671b61e20 0x564671b679d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47966/0 (socket says 172.21.15.82:47966) 2023-09-23T09:15:37.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.536+0000 7ff456d9d700 1 -- 172.21.15.82:0/2727417561 learned_addr learned my addr 172.21.15.82:0/2727417561 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:15:37.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.536+0000 7ff455d9b700 1 --2- 172.21.15.82:0/2727417561 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564671b61500 0x564671b5f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:37.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.536+0000 7ff45659c700 1 --2- 172.21.15.82:0/2727417561 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564671b5bc40 0x564671b6c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:37.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.536+0000 7ff456d9d700 1 -- 172.21.15.82:0/2727417561 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564671b5bc40 msgr2=0x564671b6c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:15:37.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.536+0000 7ff456d9d700 1 --2- 172.21.15.82:0/2727417561 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564671b5bc40 0x564671b6c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.536+0000 7ff456d9d700 1 -- 172.21.15.82:0/2727417561 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564671b61500 msgr2=0x564671b5f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:15:37.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.536+0000 7ff456d9d700 1 --2- 172.21.15.82:0/2727417561 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564671b61500 0x564671b5f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.536+0000 7ff456d9d700 1 -- 172.21.15.82:0/2727417561 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5646718d9de0 con 0x564671b61e20 2023-09-23T09:15:37.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.537+0000 7ff456d9d700 1 --2- 172.21.15.82:0/2727417561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564671b61e20 0x564671b679d0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7ff450003a30 tx=0x7ff45000d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37b1d1ec17d32ea5 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:15:37.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.537+0000 7ff4457fa700 1 -- 172.21.15.82:0/2727417561 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff45002b070 con 0x564671b61e20 2023-09-23T09:15:37.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.537+0000 7ff4457fa700 1 -- 172.21.15.82:0/2727417561 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff450023040 con 0x564671b61e20 2023-09-23T09:15:37.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.537+0000 7ff4457fa700 1 -- 172.21.15.82:0/2727417561 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff450022050 con 0x564671b61e20 2023-09-23T09:15:37.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.538+0000 7ff47099ab80 1 -- 172.21.15.82:0/2727417561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564671b61e20 msgr2=0x564671b679d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:15:37.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.538+0000 7ff47099ab80 1 --2- 172.21.15.82:0/2727417561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564671b61e20 0x564671b679d0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7ff450003a30 tx=0x7ff45000d000 comp rx=0 tx=0).stop 2023-09-23T09:15:37.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.538+0000 7ff47099ab80 1 -- 172.21.15.82:0/2727417561 shutdown_connections 2023-09-23T09:15:37.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.538+0000 7ff47099ab80 1 --2- 172.21.15.82:0/2727417561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564671b61e20 0x564671b679d0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.538+0000 7ff47099ab80 1 --2- 172.21.15.82:0/2727417561 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564671b5bc40 0x564671b6c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.538+0000 7ff47099ab80 1 --2- 172.21.15.82:0/2727417561 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564671b61500 0x564671b5f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.538+0000 7ff47099ab80 1 -- 172.21.15.82:0/2727417561 >> 172.21.15.82:0/2727417561 conn(0x564671ad00e0 msgr2=0x564671b5ef70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:15:37.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.538+0000 7ff47099ab80 1 -- 172.21.15.82:0/2727417561 shutdown_connections 2023-09-23T09:15:37.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.538+0000 7ff47099ab80 1 -- 172.21.15.82:0/2727417561 wait complete. 2023-09-23T09:15:37.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.539+0000 7ff47099ab80 1 -- start start 2023-09-23T09:15:37.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.539+0000 7ff47099ab80 1 Processor -- start 2023-09-23T09:15:37.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.539+0000 7ff47099ab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564671b5bc40 0x564671b6c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:37.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.539+0000 7ff47099ab80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564671b61500 0x564671b6ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:37.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.539+0000 7ff47099ab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564671b61e20 0x564671b6aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:37.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.539+0000 7ff47099ab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x564671b6b120 con 0x564671b5bc40 2023-09-23T09:15:37.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.539+0000 7ff47099ab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x564671b6b290 con 0x564671b61e20 2023-09-23T09:15:37.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.539+0000 7ff47099ab80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x564671b6b450 con 0x564671b61500 2023-09-23T09:15:37.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.540+0000 7ff47099ab80 10 client.0 _ll_register_callbacks cb 0x7ff44800bf10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:15:37.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.540+0000 7ff45659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564671b5bc40 0x564671b6c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:37.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.540+0000 7ff455d9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564671b61500 0x564671b6ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:37.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.540+0000 7ff45659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564671b5bc40 0x564671b6c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47976/0 (socket says 172.21.15.82:47976) 2023-09-23T09:15:37.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.540+0000 7ff45659c700 1 -- 172.21.15.82:0/920381539 learned_addr learned my addr 172.21.15.82:0/920381539 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:15:37.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.540+0000 7ff456d9d700 1 --2- 172.21.15.82:0/920381539 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564671b61e20 0x564671b6aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:37.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.540+0000 7ff45659c700 1 -- 172.21.15.82:0/920381539 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564671b61500 msgr2=0x564671b6ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:15:37.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.540+0000 7ff45659c700 1 --2- 172.21.15.82:0/920381539 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564671b61500 0x564671b6ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.540+0000 7ff45659c700 1 -- 172.21.15.82:0/920381539 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564671b61e20 msgr2=0x564671b6aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:15:37.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.540+0000 7ff45659c700 1 --2- 172.21.15.82:0/920381539 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564671b61e20 0x564671b6aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.540+0000 7ff45659c700 1 -- 172.21.15.82:0/920381539 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff450011040 con 0x564671b5bc40 2023-09-23T09:15:37.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.540+0000 7ff456d9d700 1 --2- 172.21.15.82:0/920381539 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564671b61e20 0x564671b6aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:15:37.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.540+0000 7ff455d9b700 1 --2- 172.21.15.82:0/920381539 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564671b61500 0x564671b6ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:15:37.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.541+0000 7ff45659c700 1 --2- 172.21.15.82:0/920381539 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564671b5bc40 0x564671b6c540 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7ff448024780 tx=0x7ff448024c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ff1cbfc9747e0f7 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:15:37.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.541+0000 7ff43dffb700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:15:37.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.541+0000 7ff43dffb700 1 -- 172.21.15.82:0/920381539 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff44801d040 con 0x564671b5bc40 2023-09-23T09:15:37.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.541+0000 7ff47099ab80 1 -- 172.21.15.82:0/920381539 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564671b4e8b0 con 0x564671b5bc40 2023-09-23T09:15:37.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.541+0000 7ff43dffb700 1 -- 172.21.15.82:0/920381539 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 8513+0+0 (secure 0 0 0) 0x7ff44802e7c0 con 0x564671b5bc40 2023-09-23T09:15:37.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.541+0000 7ff43dffb700 1 -- 172.21.15.82:0/920381539 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff448009290 con 0x564671b5bc40 2023-09-23T09:15:37.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.541+0000 7ff47099ab80 10 client.16719 fetch_fsmap learned FSMap version 70 2023-09-23T09:15:37.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.541+0000 7ff47099ab80 1 -- 172.21.15.82:0/920381539 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) v3 -- 0x5646718c2c60 con 0x564671b5bc40 2023-09-23T09:15:37.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.541+0000 7ff43dffb700 1 -- 172.21.15.82:0/920381539 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x564671b4e8b0 con 0x564671b5bc40 2023-09-23T09:15:37.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.542+0000 7ff43dffb700 1 -- 172.21.15.82:0/920381539 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 70) v1 ==== 7902+0+0 (secure 0 0 0) 0x7ff44802e980 con 0x564671b5bc40 2023-09-23T09:15:37.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.542+0000 7ff47099ab80 10 client.16719 fetch_fsmap finished waiting for FSMap version 70 2023-09-23T09:15:37.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.542+0000 7ff47099ab80 10 client.16719 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2023-09-23T09:15:37.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.542+0000 7ff47099ab80 20 client.16719 populate_metadata read hostname 'smithi082' 2023-09-23T09:15:37.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.542+0000 7ff47099ab80 1 --2- 172.21.15.82:0/920381539 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x564671bca610 0x564671bcca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:37.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.542+0000 7ff47099ab80 4 client.16719 mds_command: new command op to 24515 tid=0[{"prefix": "damage ls"}] 2023-09-23T09:15:37.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.542+0000 7ff47099ab80 1 -- 172.21.15.82:0/920381539 --> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x564671aa6970 con 0x564671bca610 2023-09-23T09:15:37.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.542+0000 7ff455d9b700 1 --2- 172.21.15.82:0/920381539 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x564671bca610 0x564671bcca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:37.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.543+0000 7ff455d9b700 1 --2- 172.21.15.82:0/920381539 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x564671bca610 0x564671bcca30 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=f99135b7f27a8151 server_cookie=f2ec3520977ac835 in_seq=0 out_seq=0 2023-09-23T09:15:37.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.543+0000 7ff43dffb700 10 client.16719 ms_handle_connect on v2:172.21.15.135:6836/2655304858 2023-09-23T09:15:37.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.543+0000 7ff43dffb700 1 -- 172.21.15.82:0/920381539 <== mds.3 v2:172.21.15.135:6836/2655304858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x564671aa6970 con 0x564671bca610 2023-09-23T09:15:37.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.543+0000 7ff43dffb700 10 client.16719 handle_command_reply: tid=0 2023-09-23T09:15:37.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.543+0000 7ff47099ab80 1 client.16719 shutdown 2023-09-23T09:15:37.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.543+0000 7ff47099ab80 1 -- 172.21.15.82:0/920381539 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564671b5bc40 msgr2=0x564671b6c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:15:37.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.543+0000 7ff47099ab80 1 --2- 172.21.15.82:0/920381539 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564671b5bc40 0x564671b6c540 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7ff448024780 tx=0x7ff448024c50 comp rx=0 tx=0).stop 2023-09-23T09:15:37.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.543+0000 7ff47099ab80 1 -- 172.21.15.82:0/920381539 shutdown_connections 2023-09-23T09:15:37.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.543+0000 7ff47099ab80 1 --2- 172.21.15.82:0/920381539 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564671b61e20 0x564671b6aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.543+0000 7ff47099ab80 1 --2- 172.21.15.82:0/920381539 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564671b5bc40 0x564671b6c540 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.543+0000 7ff47099ab80 1 --2- 172.21.15.82:0/920381539 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x564671bca610 0x564671bcca30 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.543+0000 7ff47099ab80 1 --2- 172.21.15.82:0/920381539 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564671b61500 0x564671b6ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.543+0000 7ff47099ab80 1 -- 172.21.15.82:0/920381539 >> 172.21.15.82:0/920381539 conn(0x564671ad00e0 msgr2=0x564671b60220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:15:37.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.543+0000 7ff43dffb700 0 client.16719 ms_handle_reset on v2:172.21.15.135:6836/2655304858 2023-09-23T09:15:37.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.543+0000 7ff47099ab80 1 -- 172.21.15.82:0/920381539 shutdown_connections 2023-09-23T09:15:37.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.543+0000 7ff47099ab80 1 -- 172.21.15.82:0/920381539 wait complete. 2023-09-23T09:15:37.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.544+0000 7ff47099ab80 20 client.16719 trim_cache size 0 max 16384 2023-09-23T09:15:37.554 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2023-09-23T09:15:37.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.544+0000 7ff45759e700 1 -- 172.21.15.82:0/2389390967 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7ff4400a0160 msgr2=0x7ff4400a2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:15:37.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.544+0000 7ff45759e700 1 --2- 172.21.15.82:0/2389390967 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7ff4400a0160 0x7ff4400a2620 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff458074d30 tx=0x7ff450009100 comp rx=0 tx=0).stop 2023-09-23T09:15:37.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.544+0000 7ff45759e700 1 -- 172.21.15.82:0/2389390967 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4581010b0 msgr2=0x7ff458073160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:15:37.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.544+0000 7ff45759e700 1 --2- 172.21.15.82:0/2389390967 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4581010b0 0x7ff458073160 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff44c00e9f0 tx=0x7ff44c00ed00 comp rx=0 tx=0).stop 2023-09-23T09:15:37.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.544+0000 7ff45759e700 1 -- 172.21.15.82:0/2389390967 shutdown_connections 2023-09-23T09:15:37.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.544+0000 7ff45759e700 1 --2- 172.21.15.82:0/2389390967 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7ff4400a0160 0x7ff4400a2620 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.544+0000 7ff45759e700 1 --2- 172.21.15.82:0/2389390967 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff458106700 0x7ff4581a4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.544+0000 7ff45759e700 1 --2- 172.21.15.82:0/2389390967 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4581006f0 0x7ff458072c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.544+0000 7ff45759e700 1 --2- 172.21.15.82:0/2389390967 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4581010b0 0x7ff458073160 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.544+0000 7ff45759e700 1 -- 172.21.15.82:0/2389390967 >> 172.21.15.82:0/2389390967 conn(0x7ff4580fc1c0 msgr2=0x7ff4580fc880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:15:37.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.544+0000 7ff45759e700 1 -- 172.21.15.82:0/2389390967 shutdown_connections 2023-09-23T09:15:37.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.545+0000 7ff45759e700 1 -- 172.21.15.82:0/2389390967 wait complete. 2023-09-23T09:15:37.566 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-09-23T09:15:37.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.797+0000 7f821a5ff700 1 -- 172.21.15.82:0/372881255 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8214101a40 msgr2=0x7f8214101e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:15:37.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.797+0000 7f821a5ff700 1 --2- 172.21.15.82:0/372881255 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8214101a40 0x7f8214101e20 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f8204009990 tx=0x7f8204009ca0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.797+0000 7f821a5ff700 1 -- 172.21.15.82:0/372881255 shutdown_connections 2023-09-23T09:15:37.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.797+0000 7f821a5ff700 1 --2- 172.21.15.82:0/372881255 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f821410ae60 0x7f821410d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.797+0000 7f821a5ff700 1 --2- 172.21.15.82:0/372881255 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8214101a40 0x7f8214101e20 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.797+0000 7f821a5ff700 1 --2- 172.21.15.82:0/372881255 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8214102360 0x7f821410a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.797+0000 7f821a5ff700 1 -- 172.21.15.82:0/372881255 >> 172.21.15.82:0/372881255 conn(0x7f82140fb260 msgr2=0x7f82140fd680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:15:37.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.797+0000 7f821a5ff700 1 -- 172.21.15.82:0/372881255 shutdown_connections 2023-09-23T09:15:37.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.797+0000 7f821a5ff700 1 -- 172.21.15.82:0/372881255 wait complete. 2023-09-23T09:15:37.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.799+0000 7f821a5ff700 1 Processor -- start 2023-09-23T09:15:37.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.799+0000 7f821a5ff700 1 -- start start 2023-09-23T09:15:37.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.800+0000 7f821a5ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8214101a40 0x7f821419e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:37.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.800+0000 7f821a5ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8214102360 0x7f821419eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:37.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.800+0000 7f821a5ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f821410ae60 0x7f82141989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:37.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.800+0000 7f821a5ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8214199040 con 0x7f8214102360 2023-09-23T09:15:37.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.800+0000 7f821a5ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82141991b0 con 0x7f821410ae60 2023-09-23T09:15:37.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.800+0000 7f821a5ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8214199370 con 0x7f8214101a40 2023-09-23T09:15:37.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.800+0000 7f82137fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8214102360 0x7f821419eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:37.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.800+0000 7f82137fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8214102360 0x7f821419eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48000/0 (socket says 172.21.15.82:48000) 2023-09-23T09:15:37.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.800+0000 7f82137fe700 1 -- 172.21.15.82:0/3385218877 learned_addr learned my addr 172.21.15.82:0/3385218877 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:15:37.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.800+0000 7f8213fff700 1 --2- 172.21.15.82:0/3385218877 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8214101a40 0x7f821419e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:37.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.800+0000 7f8218b9c700 1 --2- 172.21.15.82:0/3385218877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f821410ae60 0x7f82141989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:37.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.801+0000 7f82137fe700 1 -- 172.21.15.82:0/3385218877 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8214101a40 msgr2=0x7f821419e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:15:37.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.801+0000 7f82137fe700 1 --2- 172.21.15.82:0/3385218877 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8214101a40 0x7f821419e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.801+0000 7f82137fe700 1 -- 172.21.15.82:0/3385218877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f821410ae60 msgr2=0x7f82141989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:15:37.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.801+0000 7f82137fe700 1 --2- 172.21.15.82:0/3385218877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f821410ae60 0x7f82141989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.801+0000 7f82137fe700 1 -- 172.21.15.82:0/3385218877 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82040095f0 con 0x7f8214102360 2023-09-23T09:15:37.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.801+0000 7f82137fe700 1 --2- 172.21.15.82:0/3385218877 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8214102360 0x7f821419eea0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f820800e9f0 tx=0x7f820800ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:15:37.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.801+0000 7f82117fa700 1 -- 172.21.15.82:0/3385218877 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820800c9c0 con 0x7f8214102360 2023-09-23T09:15:37.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.801+0000 7f82117fa700 1 -- 172.21.15.82:0/3385218877 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8208010430 con 0x7f8214102360 2023-09-23T09:15:37.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.801+0000 7f821a5ff700 1 -- 172.21.15.82:0/3385218877 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8214199650 con 0x7f8214102360 2023-09-23T09:15:37.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.801+0000 7f82117fa700 1 -- 172.21.15.82:0/3385218877 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8208018680 con 0x7f8214102360 2023-09-23T09:15:37.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.801+0000 7f821a5ff700 1 -- 172.21.15.82:0/3385218877 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82141a5950 con 0x7f8214102360 2023-09-23T09:15:37.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.805+0000 7f82117fa700 1 -- 172.21.15.82:0/3385218877 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f82080105a0 con 0x7f8214102360 2023-09-23T09:15:37.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.807+0000 7f822dedfb80 1 Processor -- start 2023-09-23T09:15:37.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.807+0000 7f822dedfb80 1 -- start start 2023-09-23T09:15:37.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.807+0000 7f82117fa700 1 --2- 172.21.15.82:0/3385218877 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f81fc0a0140 0x7f81fc0a2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:37.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.807+0000 7f822dedfb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d11aad380 0x560d11aad760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:37.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.807+0000 7f822dedfb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560d11aadca0 0x560d11aa7700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:37.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.807+0000 7f822dedfb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d11aa7c40 0x560d11aa80a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:37.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.807+0000 7f822dedfb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d11a0f7b0 con 0x560d11aad380 2023-09-23T09:15:37.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.807+0000 7f822dedfb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d11a00780 con 0x560d11aa7c40 2023-09-23T09:15:37.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.807+0000 7f822dedfb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d119fe0a0 con 0x560d11aadca0 2023-09-23T09:15:37.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.808+0000 7f82117fa700 1 -- 172.21.15.82:0/3385218877 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f8208014070 con 0x7f8214102360 2023-09-23T09:15:37.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.808+0000 7f8218b9c700 1 --2- 172.21.15.82:0/3385218877 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f81fc0a0140 0x7f81fc0a2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:37.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.808+0000 7f82137fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560d11aadca0 0x560d11aa7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:37.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.808+0000 7f82137fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560d11aadca0 0x560d11aa7700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:38244/0 (socket says 172.21.15.82:38244) 2023-09-23T09:15:37.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.808+0000 7f82137fe700 1 -- 172.21.15.82:0/2076152121 learned_addr learned my addr 172.21.15.82:0/2076152121 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:15:37.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.808+0000 7f8218b9c700 1 --2- 172.21.15.82:0/2076152121 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d11aa7c40 0x560d11aa80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:37.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.808+0000 7f8213fff700 1 --2- 172.21.15.82:0/2076152121 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d11aad380 0x560d11aad760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:37.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.808+0000 7f82137fe700 1 -- 172.21.15.82:0/2076152121 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d11aa7c40 msgr2=0x560d11aa80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:15:37.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.808+0000 7f82137fe700 1 --2- 172.21.15.82:0/2076152121 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d11aa7c40 0x560d11aa80a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.808+0000 7f82137fe700 1 -- 172.21.15.82:0/2076152121 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d11aad380 msgr2=0x560d11aad760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:15:37.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.808+0000 7f82137fe700 1 --2- 172.21.15.82:0/2076152121 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d11aad380 0x560d11aad760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.808+0000 7f82137fe700 1 -- 172.21.15.82:0/2076152121 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560d11879630 con 0x560d11aadca0 2023-09-23T09:15:37.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.809+0000 7f82137fe700 1 --2- 172.21.15.82:0/2076152121 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560d11aadca0 0x560d11aa7700 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f82080958a0 tx=0x7f82080989f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e842fe116b6ad0d server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:15:37.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.809+0000 7f8218b9c700 1 --2- 172.21.15.82:0/3385218877 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f81fc0a0140 0x7f81fc0a2600 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f820c009550 tx=0x7f820c003e50 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:15:37.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.809+0000 7f81fa7fc700 1 -- 172.21.15.82:0/2076152121 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82080b8270 con 0x560d11aadca0 2023-09-23T09:15:37.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.809+0000 7f81fa7fc700 1 -- 172.21.15.82:0/2076152121 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8208099530 con 0x560d11aadca0 2023-09-23T09:15:37.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.809+0000 7f81fa7fc700 1 -- 172.21.15.82:0/2076152121 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8208098320 con 0x560d11aadca0 2023-09-23T09:15:37.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.810+0000 7f822dedfb80 1 -- 172.21.15.82:0/2076152121 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560d11aadca0 msgr2=0x560d11aa7700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:15:37.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.810+0000 7f822dedfb80 1 --2- 172.21.15.82:0/2076152121 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560d11aadca0 0x560d11aa7700 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f82080958a0 tx=0x7f82080989f0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.810+0000 7f822dedfb80 1 -- 172.21.15.82:0/2076152121 shutdown_connections 2023-09-23T09:15:37.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.810+0000 7f822dedfb80 1 --2- 172.21.15.82:0/2076152121 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d11aa7c40 0x560d11aa80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.810+0000 7f822dedfb80 1 --2- 172.21.15.82:0/2076152121 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d11aad380 0x560d11aad760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.810+0000 7f822dedfb80 1 --2- 172.21.15.82:0/2076152121 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560d11aadca0 0x560d11aa7700 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.810+0000 7f822dedfb80 1 -- 172.21.15.82:0/2076152121 >> 172.21.15.82:0/2076152121 conn(0x560d11a1c0e0 msgr2=0x560d11aa2410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:15:37.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.810+0000 7f822dedfb80 1 -- 172.21.15.82:0/2076152121 shutdown_connections 2023-09-23T09:15:37.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.810+0000 7f822dedfb80 1 -- 172.21.15.82:0/2076152121 wait complete. 2023-09-23T09:15:37.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.811+0000 7f822dedfb80 1 -- start start 2023-09-23T09:15:37.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.811+0000 7f822dedfb80 1 Processor -- start 2023-09-23T09:15:37.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.812+0000 7f822dedfb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d11aa7c40 0x560d11ab3c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:37.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.812+0000 7f822dedfb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560d11aad380 0x560d11ab0e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:37.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.812+0000 7f822dedfb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d11aadca0 0x560d11ab1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:37.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.812+0000 7f822dedfb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d119f9990 con 0x560d11aa7c40 2023-09-23T09:15:37.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.812+0000 7f822dedfb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d11997bb0 con 0x560d11aadca0 2023-09-23T09:15:37.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.812+0000 7f822dedfb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d119978b0 con 0x560d11aad380 2023-09-23T09:15:37.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.812+0000 7f822dedfb80 10 client.0 _ll_register_callbacks cb 0x560d118e1a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:15:37.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.812+0000 7f8213fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d11aa7c40 0x560d11ab3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:37.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.812+0000 7f82137fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560d11aad380 0x560d11ab0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:37.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.812+0000 7f8213fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d11aa7c40 0x560d11ab3c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48014/0 (socket says 172.21.15.82:48014) 2023-09-23T09:15:37.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.812+0000 7f82137fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560d11aad380 0x560d11ab0e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:38256/0 (socket says 172.21.15.82:38256) 2023-09-23T09:15:37.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.812+0000 7f8213fff700 1 -- 172.21.15.82:0/4252075140 learned_addr learned my addr 172.21.15.82:0/4252075140 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:15:37.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.812+0000 7f8218b9c700 1 --2- 172.21.15.82:0/4252075140 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d11aadca0 0x560d11ab1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:37.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.812+0000 7f8218b9c700 1 -- 172.21.15.82:0/4252075140 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560d11aad380 msgr2=0x560d11ab0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:15:37.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.813+0000 7f8218b9c700 1 --2- 172.21.15.82:0/4252075140 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560d11aad380 0x560d11ab0e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.813+0000 7f8218b9c700 1 -- 172.21.15.82:0/4252075140 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d11aa7c40 msgr2=0x560d11ab3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:15:37.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.813+0000 7f8218b9c700 1 --2- 172.21.15.82:0/4252075140 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d11aa7c40 0x560d11ab3c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.813+0000 7f8218b9c700 1 -- 172.21.15.82:0/4252075140 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82141a5950 con 0x560d11aadca0 2023-09-23T09:15:37.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.813+0000 7f82137fe700 1 --2- 172.21.15.82:0/4252075140 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560d11aad380 0x560d11ab0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:15:37.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.813+0000 7f8218b9c700 1 --2- 172.21.15.82:0/4252075140 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d11aadca0 0x560d11ab1510 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f820c007b80 tx=0x7f820c004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2c2afc66c3c797f server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:15:37.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.813+0000 7f81f37fe700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-09-23T09:15:37.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.813+0000 7f81f37fe700 1 -- 172.21.15.82:0/4252075140 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820c007e90 con 0x560d11aadca0 2023-09-23T09:15:37.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.813+0000 7f81f37fe700 1 -- 172.21.15.82:0/4252075140 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f820c021070 con 0x560d11aadca0 2023-09-23T09:15:37.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.813+0000 7f822dedfb80 1 -- 172.21.15.82:0/4252075140 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560d11a771c0 con 0x560d11aadca0 2023-09-23T09:15:37.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.813+0000 7f81f37fe700 1 -- 172.21.15.82:0/4252075140 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7f820c01baf0 con 0x560d11aadca0 2023-09-23T09:15:37.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.813+0000 7f822dedfb80 10 client.26405 fetch_fsmap learned FSMap version 70 2023-09-23T09:15:37.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.813+0000 7f822dedfb80 1 -- 172.21.15.82:0/4252075140 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) v3 -- 0x560d11825de0 con 0x560d11aadca0 2023-09-23T09:15:37.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.814+0000 7f81f37fe700 1 -- 172.21.15.82:0/4252075140 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f820c032020 con 0x560d11aadca0 2023-09-23T09:15:37.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.814+0000 7f81f37fe700 1 -- 172.21.15.82:0/4252075140 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 70) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f820c025a20 con 0x560d11aadca0 2023-09-23T09:15:37.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.814+0000 7f822dedfb80 10 client.26405 fetch_fsmap finished waiting for FSMap version 70 2023-09-23T09:15:37.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.814+0000 7f822dedfb80 10 client.26405 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-09-23T09:15:37.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.814+0000 7f822dedfb80 20 client.26405 populate_metadata read hostname 'smithi082' 2023-09-23T09:15:37.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.814+0000 7f822dedfb80 1 --2- 172.21.15.82:0/4252075140 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x560d11ac16a0 0x560d11ac3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:37.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.814+0000 7f822dedfb80 4 client.26405 mds_command: new command op to 24526 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:15:37.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.814+0000 7f822dedfb80 1 -- 172.21.15.82:0/4252075140 --> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560d1199fba0 con 0x560d11ac16a0 2023-09-23T09:15:37.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.815+0000 7f8213fff700 1 --2- 172.21.15.82:0/4252075140 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x560d11ac16a0 0x560d11ac3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:37.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.815+0000 7f8213fff700 1 --2- 172.21.15.82:0/4252075140 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x560d11ac16a0 0x560d11ac3ac0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=91287d6eade62de1 server_cookie=12efb10a20e19ff7 in_seq=0 out_seq=0 2023-09-23T09:15:37.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.815+0000 7f81f37fe700 10 client.26405 ms_handle_connect on v2:172.21.15.161:6836/43639843 2023-09-23T09:15:37.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.816+0000 7f81f37fe700 1 -- 172.21.15.82:0/4252075140 <== mds.2 v2:172.21.15.161:6836/43639843 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x560d1199fba0 con 0x560d11ac16a0 2023-09-23T09:15:37.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.816+0000 7f81f37fe700 10 client.26405 handle_command_reply: tid=0 2023-09-23T09:15:37.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.816+0000 7f822dedfb80 1 client.26405 shutdown 2023-09-23T09:15:37.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.816+0000 7f822dedfb80 1 -- 172.21.15.82:0/4252075140 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d11aadca0 msgr2=0x560d11ab1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:15:37.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.816+0000 7f822dedfb80 1 --2- 172.21.15.82:0/4252075140 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d11aadca0 0x560d11ab1510 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f820c007b80 tx=0x7f820c004b40 comp rx=0 tx=0).stop 2023-09-23T09:15:37.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.816+0000 7f822dedfb80 1 -- 172.21.15.82:0/4252075140 shutdown_connections 2023-09-23T09:15:37.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.816+0000 7f822dedfb80 1 --2- 172.21.15.82:0/4252075140 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x560d11ac16a0 0x560d11ac3ac0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.816+0000 7f822dedfb80 1 --2- 172.21.15.82:0/4252075140 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d11aadca0 0x560d11ab1510 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.816+0000 7f822dedfb80 1 --2- 172.21.15.82:0/4252075140 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d11aa7c40 0x560d11ab3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.816+0000 7f822dedfb80 1 --2- 172.21.15.82:0/4252075140 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560d11aad380 0x560d11ab0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.816+0000 7f81f37fe700 0 client.26405 ms_handle_reset on v2:172.21.15.161:6836/43639843 2023-09-23T09:15:37.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.816+0000 7f822dedfb80 1 -- 172.21.15.82:0/4252075140 >> 172.21.15.82:0/4252075140 conn(0x560d11a1c0e0 msgr2=0x560d11a9cb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:15:37.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.816+0000 7f822dedfb80 1 -- 172.21.15.82:0/4252075140 shutdown_connections 2023-09-23T09:15:37.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.817+0000 7f822dedfb80 1 -- 172.21.15.82:0/4252075140 wait complete. 2023-09-23T09:15:37.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.817+0000 7f822dedfb80 20 client.26405 trim_cache size 0 max 16384 2023-09-23T09:15:37.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.831+0000 7f822dedfb80 1 Processor -- start 2023-09-23T09:15:37.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.831+0000 7f822dedfb80 1 -- start start 2023-09-23T09:15:37.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.831+0000 7f822dedfb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d11aa7c40 0x560d11aa7700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:37.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.831+0000 7f822dedfb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d11aad380 0x560d11ab0780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:37.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.831+0000 7f822dedfb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560d11aadca0 0x560d11abce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:37.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.831+0000 7f822dedfb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d1187b920 con 0x560d11aad380 2023-09-23T09:15:37.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.831+0000 7f822dedfb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d11a9ec80 con 0x560d11aa7c40 2023-09-23T09:15:37.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.831+0000 7f822dedfb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d11ab1e20 con 0x560d11aadca0 2023-09-23T09:15:37.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.832+0000 7f82137fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d11aad380 0x560d11ab0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:37.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.832+0000 7f82137fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d11aad380 0x560d11ab0780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48020/0 (socket says 172.21.15.82:48020) 2023-09-23T09:15:37.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.832+0000 7f82137fe700 1 -- 172.21.15.82:0/3915101469 learned_addr learned my addr 172.21.15.82:0/3915101469 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:15:37.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.832+0000 7f8213fff700 1 --2- 172.21.15.82:0/3915101469 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d11aa7c40 0x560d11aa7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:37.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.832+0000 7f8218b9c700 1 --2- 172.21.15.82:0/3915101469 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560d11aadca0 0x560d11abce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:37.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.832+0000 7f82137fe700 1 -- 172.21.15.82:0/3915101469 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560d11aadca0 msgr2=0x560d11abce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:15:37.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.832+0000 7f82137fe700 1 --2- 172.21.15.82:0/3915101469 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560d11aadca0 0x560d11abce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.832+0000 7f82137fe700 1 -- 172.21.15.82:0/3915101469 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d11aa7c40 msgr2=0x560d11aa7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:15:37.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.832+0000 7f82137fe700 1 --2- 172.21.15.82:0/3915101469 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d11aa7c40 0x560d11aa7700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.832+0000 7f82137fe700 1 -- 172.21.15.82:0/3915101469 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560d1180ec60 con 0x560d11aad380 2023-09-23T09:15:37.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.832+0000 7f82137fe700 1 --2- 172.21.15.82:0/3915101469 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d11aad380 0x560d11ab0780 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f8208098ae0 tx=0x7f82080109a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f082366aa780031f server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:15:37.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.833+0000 7f81faffd700 1 -- 172.21.15.82:0/3915101469 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8208098e30 con 0x560d11aad380 2023-09-23T09:15:37.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.833+0000 7f81faffd700 1 -- 172.21.15.82:0/3915101469 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8208099530 con 0x560d11aad380 2023-09-23T09:15:37.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.833+0000 7f81faffd700 1 -- 172.21.15.82:0/3915101469 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82080b8300 con 0x560d11aad380 2023-09-23T09:15:37.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.833+0000 7f822dedfb80 1 -- 172.21.15.82:0/3915101469 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d11aad380 msgr2=0x560d11ab0780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:15:37.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.833+0000 7f822dedfb80 1 --2- 172.21.15.82:0/3915101469 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d11aad380 0x560d11ab0780 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f8208098ae0 tx=0x7f82080109a0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.833+0000 7f822dedfb80 1 -- 172.21.15.82:0/3915101469 shutdown_connections 2023-09-23T09:15:37.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.833+0000 7f822dedfb80 1 --2- 172.21.15.82:0/3915101469 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560d11aadca0 0x560d11abce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.833+0000 7f822dedfb80 1 --2- 172.21.15.82:0/3915101469 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d11aa7c40 0x560d11aa7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.833+0000 7f822dedfb80 1 --2- 172.21.15.82:0/3915101469 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d11aad380 0x560d11ab0780 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.833+0000 7f822dedfb80 1 -- 172.21.15.82:0/3915101469 >> 172.21.15.82:0/3915101469 conn(0x560d11a1c0e0 msgr2=0x560d11abd970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:15:37.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.834+0000 7f822dedfb80 1 -- 172.21.15.82:0/3915101469 shutdown_connections 2023-09-23T09:15:37.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.834+0000 7f822dedfb80 1 -- 172.21.15.82:0/3915101469 wait complete. 2023-09-23T09:15:37.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.834+0000 7f822dedfb80 1 -- start start 2023-09-23T09:15:37.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.834+0000 7f822dedfb80 1 Processor -- start 2023-09-23T09:15:37.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.835+0000 7f822dedfb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d11aa7c40 0x560d11ab8740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:37.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.835+0000 7f822dedfb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560d11aad380 0x560d11aa9270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:37.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.835+0000 7f822dedfb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d11aadca0 0x560d11aa97b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:37.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.835+0000 7f822dedfb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d11aa9ef0 con 0x560d11aa7c40 2023-09-23T09:15:37.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.835+0000 7f822dedfb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d11aaa060 con 0x560d11aadca0 2023-09-23T09:15:37.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.835+0000 7f822dedfb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d11b154d0 con 0x560d11aad380 2023-09-23T09:15:37.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.835+0000 7f822dedfb80 10 client.0 _ll_register_callbacks cb 0x7f820c01e040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:15:37.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.835+0000 7f8213fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d11aa7c40 0x560d11ab8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:37.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.835+0000 7f82137fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560d11aad380 0x560d11aa9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:37.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.835+0000 7f8213fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d11aa7c40 0x560d11ab8740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48032/0 (socket says 172.21.15.82:48032) 2023-09-23T09:15:37.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.835+0000 7f8213fff700 1 -- 172.21.15.82:0/3384247530 learned_addr learned my addr 172.21.15.82:0/3384247530 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:15:37.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.835+0000 7f8218b9c700 1 --2- 172.21.15.82:0/3384247530 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d11aadca0 0x560d11aa97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:37.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.836+0000 7f8218b9c700 1 -- 172.21.15.82:0/3384247530 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560d11aad380 msgr2=0x560d11aa9270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:15:37.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.836+0000 7f8218b9c700 1 --2- 172.21.15.82:0/3384247530 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560d11aad380 0x560d11aa9270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.836+0000 7f8218b9c700 1 -- 172.21.15.82:0/3384247530 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d11aa7c40 msgr2=0x560d11ab8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:15:37.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.836+0000 7f8218b9c700 1 --2- 172.21.15.82:0/3384247530 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d11aa7c40 0x560d11ab8740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.836+0000 7f8218b9c700 1 -- 172.21.15.82:0/3384247530 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560d11879630 con 0x560d11aadca0 2023-09-23T09:15:37.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.836+0000 7f8213fff700 1 --2- 172.21.15.82:0/3384247530 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d11aa7c40 0x560d11ab8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:15:37.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.836+0000 7f82137fe700 1 --2- 172.21.15.82:0/3384247530 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560d11aad380 0x560d11aa9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:15:37.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.836+0000 7f8218b9c700 1 --2- 172.21.15.82:0/3384247530 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d11aadca0 0x560d11aa97b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f820c006070 tx=0x7f820c009660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b381ac0f3e8cbf3 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:15:37.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.836+0000 7f81f37fe700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-09-23T09:15:37.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.836+0000 7f81f37fe700 1 -- 172.21.15.82:0/3384247530 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820c009ea0 con 0x560d11aadca0 2023-09-23T09:15:37.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.836+0000 7f822dedfb80 1 -- 172.21.15.82:0/3384247530 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560d11a9a8b0 con 0x560d11aadca0 2023-09-23T09:15:37.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.837+0000 7f81f37fe700 1 -- 172.21.15.82:0/3384247530 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f820c021040 con 0x560d11aadca0 2023-09-23T09:15:37.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.837+0000 7f81f37fe700 1 -- 172.21.15.82:0/3384247530 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7f820c003a00 con 0x560d11aadca0 2023-09-23T09:15:37.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.837+0000 7f822dedfb80 10 client.26411 fetch_fsmap learned FSMap version 70 2023-09-23T09:15:37.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.837+0000 7f822dedfb80 1 -- 172.21.15.82:0/3384247530 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) v3 -- 0x560d1184c250 con 0x560d11aadca0 2023-09-23T09:15:37.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.837+0000 7f81f37fe700 1 -- 172.21.15.82:0/3384247530 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f820c043080 con 0x560d11aadca0 2023-09-23T09:15:37.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.838+0000 7f81f37fe700 1 -- 172.21.15.82:0/3384247530 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 70) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f820c01a610 con 0x560d11aadca0 2023-09-23T09:15:37.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.838+0000 7f822dedfb80 10 client.26411 fetch_fsmap finished waiting for FSMap version 70 2023-09-23T09:15:37.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.838+0000 7f822dedfb80 10 client.26411 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-09-23T09:15:37.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.838+0000 7f822dedfb80 20 client.26411 populate_metadata read hostname 'smithi082' 2023-09-23T09:15:37.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.838+0000 7f822dedfb80 1 --2- 172.21.15.82:0/3384247530 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x560d11b16a10 0x560d11b18e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:37.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.838+0000 7f822dedfb80 4 client.26411 mds_command: new command op to 24526 tid=0[{"prefix": "damage ls"}] 2023-09-23T09:15:37.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.838+0000 7f822dedfb80 1 -- 172.21.15.82:0/3384247530 --> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x560d119f2970 con 0x560d11b16a10 2023-09-23T09:15:37.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.838+0000 7f8213fff700 1 --2- 172.21.15.82:0/3384247530 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x560d11b16a10 0x560d11b18e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:37.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.839+0000 7f8213fff700 1 --2- 172.21.15.82:0/3384247530 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x560d11b16a10 0x560d11b18e00 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6e71bf9321eb5306 server_cookie=24f090eec7b499a1 in_seq=0 out_seq=0 2023-09-23T09:15:37.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.839+0000 7f81f37fe700 10 client.26411 ms_handle_connect on v2:172.21.15.161:6836/43639843 2023-09-23T09:15:37.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.839+0000 7f81f37fe700 1 -- 172.21.15.82:0/3384247530 <== mds.2 v2:172.21.15.161:6836/43639843 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x560d119f2970 con 0x560d11b16a10 2023-09-23T09:15:37.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.839+0000 7f81f37fe700 10 client.26411 handle_command_reply: tid=0 2023-09-23T09:15:37.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.839+0000 7f822dedfb80 1 client.26411 shutdown 2023-09-23T09:15:37.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.839+0000 7f822dedfb80 1 -- 172.21.15.82:0/3384247530 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d11aadca0 msgr2=0x560d11aa97b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:15:37.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.839+0000 7f822dedfb80 1 --2- 172.21.15.82:0/3384247530 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d11aadca0 0x560d11aa97b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f820c006070 tx=0x7f820c009660 comp rx=0 tx=0).stop 2023-09-23T09:15:37.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.839+0000 7f822dedfb80 1 -- 172.21.15.82:0/3384247530 shutdown_connections 2023-09-23T09:15:37.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.839+0000 7f822dedfb80 1 --2- 172.21.15.82:0/3384247530 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x560d11b16a10 0x560d11b18e00 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.839+0000 7f822dedfb80 1 --2- 172.21.15.82:0/3384247530 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d11aadca0 0x560d11aa97b0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.839+0000 7f822dedfb80 1 --2- 172.21.15.82:0/3384247530 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d11aa7c40 0x560d11ab8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.839+0000 7f81f37fe700 0 client.26411 ms_handle_reset on v2:172.21.15.161:6836/43639843 2023-09-23T09:15:37.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.839+0000 7f822dedfb80 1 --2- 172.21.15.82:0/3384247530 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x560d11aad380 0x560d11aa9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.839+0000 7f822dedfb80 1 -- 172.21.15.82:0/3384247530 >> 172.21.15.82:0/3384247530 conn(0x560d11a1c0e0 msgr2=0x560d11aab090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:15:37.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.839+0000 7f822dedfb80 1 -- 172.21.15.82:0/3384247530 shutdown_connections 2023-09-23T09:15:37.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.839+0000 7f822dedfb80 1 -- 172.21.15.82:0/3384247530 wait complete. 2023-09-23T09:15:37.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.839+0000 7f822dedfb80 20 client.26411 trim_cache size 0 max 16384 2023-09-23T09:15:37.846 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2023-09-23T09:15:37.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.840+0000 7f821a5ff700 1 -- 172.21.15.82:0/3385218877 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f81fc0a0140 msgr2=0x7f81fc0a2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:15:37.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.840+0000 7f821a5ff700 1 --2- 172.21.15.82:0/3385218877 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f81fc0a0140 0x7f81fc0a2600 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f820c009550 tx=0x7f820c003e50 comp rx=0 tx=0).stop 2023-09-23T09:15:37.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.840+0000 7f821a5ff700 1 -- 172.21.15.82:0/3385218877 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8214102360 msgr2=0x7f821419eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:15:37.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.840+0000 7f821a5ff700 1 --2- 172.21.15.82:0/3385218877 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8214102360 0x7f821419eea0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f820800e9f0 tx=0x7f820800ed00 comp rx=0 tx=0).stop 2023-09-23T09:15:37.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.840+0000 7f821a5ff700 1 -- 172.21.15.82:0/3385218877 shutdown_connections 2023-09-23T09:15:37.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.840+0000 7f821a5ff700 1 --2- 172.21.15.82:0/3385218877 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f81fc0a0140 0x7f81fc0a2600 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.840+0000 7f821a5ff700 1 --2- 172.21.15.82:0/3385218877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f821410ae60 0x7f82141989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.840+0000 7f821a5ff700 1 --2- 172.21.15.82:0/3385218877 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8214101a40 0x7f821419e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.840+0000 7f821a5ff700 1 --2- 172.21.15.82:0/3385218877 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8214102360 0x7f821419eea0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:37.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.840+0000 7f821a5ff700 1 -- 172.21.15.82:0/3385218877 >> 172.21.15.82:0/3385218877 conn(0x7f82140fb260 msgr2=0x7f82140fd650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:15:37.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.840+0000 7f821a5ff700 1 -- 172.21.15.82:0/3385218877 shutdown_connections 2023-09-23T09:15:37.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:37.840+0000 7f821a5ff700 1 -- 172.21.15.82:0/3385218877 wait complete. 2023-09-23T09:15:37.859 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:15:37 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/1926665793' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T09:15:37.862 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-09-23T09:15:38.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:15:37 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/1926665793' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T09:15:38.094 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.092+0000 7f59605ff700 1 -- 172.21.15.82:0/1908531750 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f595810ae50 msgr2=0x7f595810d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:15:38.094 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.092+0000 7f59605ff700 1 --2- 172.21.15.82:0/1908531750 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f595810ae50 0x7f595810d310 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f595000b0a0 tx=0x7f595000b3b0 comp rx=0 tx=0).stop 2023-09-23T09:15:38.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.092+0000 7f59605ff700 1 -- 172.21.15.82:0/1908531750 shutdown_connections 2023-09-23T09:15:38.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.092+0000 7f59605ff700 1 --2- 172.21.15.82:0/1908531750 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f595810ae50 0x7f595810d310 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:38.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.092+0000 7f59605ff700 1 --2- 172.21.15.82:0/1908531750 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5958101a30 0x7f5958101e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:38.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.092+0000 7f59605ff700 1 --2- 172.21.15.82:0/1908531750 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5958102350 0x7f595810a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:38.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.092+0000 7f59605ff700 1 -- 172.21.15.82:0/1908531750 >> 172.21.15.82:0/1908531750 conn(0x7f59580fb270 msgr2=0x7f59580fd690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:15:38.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.092+0000 7f59605ff700 1 -- 172.21.15.82:0/1908531750 shutdown_connections 2023-09-23T09:15:38.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.092+0000 7f59605ff700 1 -- 172.21.15.82:0/1908531750 wait complete. 2023-09-23T09:15:38.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.093+0000 7f59605ff700 1 Processor -- start 2023-09-23T09:15:38.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.094+0000 7f59605ff700 1 -- start start 2023-09-23T09:15:38.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.094+0000 7f59605ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5958101a30 0x7f59580ff680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:38.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.094+0000 7f59605ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5958102350 0x7f59580ffbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:38.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.094+0000 7f59605ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f595810ae50 0x7f59581a4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:38.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.094+0000 7f59605ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59581003f0 con 0x7f5958102350 2023-09-23T09:15:38.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.094+0000 7f59605ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59581a51b0 con 0x7f5958101a30 2023-09-23T09:15:38.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.094+0000 7f59605ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59581a52f0 con 0x7f595810ae50 2023-09-23T09:15:38.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.094+0000 7f595db9a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5958102350 0x7f59580ffbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:38.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.094+0000 7f595e39b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5958101a30 0x7f59580ff680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:38.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.094+0000 7f595db9a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5958102350 0x7f59580ffbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48062/0 (socket says 172.21.15.82:48062) 2023-09-23T09:15:38.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.094+0000 7f595db9a700 1 -- 172.21.15.82:0/2362944069 learned_addr learned my addr 172.21.15.82:0/2362944069 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:15:38.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.095+0000 7f595eb9c700 1 --2- 172.21.15.82:0/2362944069 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f595810ae50 0x7f59581a4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:38.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.095+0000 7f595db9a700 1 -- 172.21.15.82:0/2362944069 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f595810ae50 msgr2=0x7f59581a4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:15:38.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.095+0000 7f595db9a700 1 --2- 172.21.15.82:0/2362944069 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f595810ae50 0x7f59581a4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:38.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.095+0000 7f595db9a700 1 -- 172.21.15.82:0/2362944069 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5958101a30 msgr2=0x7f59580ff680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:15:38.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.095+0000 7f595db9a700 1 --2- 172.21.15.82:0/2362944069 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5958101a30 0x7f59580ff680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:38.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.095+0000 7f595db9a700 1 -- 172.21.15.82:0/2362944069 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5950009d00 con 0x7f5958102350 2023-09-23T09:15:38.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.095+0000 7f595eb9c700 1 --2- 172.21.15.82:0/2362944069 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f595810ae50 0x7f59581a4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:15:38.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.095+0000 7f595e39b700 1 --2- 172.21.15.82:0/2362944069 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5958101a30 0x7f59580ff680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:15:38.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.095+0000 7f595db9a700 1 --2- 172.21.15.82:0/2362944069 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5958102350 0x7f59580ffbc0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f594800c900 tx=0x7f594800cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:15:38.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.095+0000 7f594f7fe700 1 -- 172.21.15.82:0/2362944069 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5948007b00 con 0x7f5958102350 2023-09-23T09:15:38.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.095+0000 7f594f7fe700 1 -- 172.21.15.82:0/2362944069 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f594800ce50 con 0x7f5958102350 2023-09-23T09:15:38.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.095+0000 7f594f7fe700 1 -- 172.21.15.82:0/2362944069 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5948018420 con 0x7f5958102350 2023-09-23T09:15:38.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.096+0000 7f59605ff700 1 -- 172.21.15.82:0/2362944069 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59581a5550 con 0x7f5958102350 2023-09-23T09:15:38.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.096+0000 7f59605ff700 1 -- 172.21.15.82:0/2362944069 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59581a59e0 con 0x7f5958102350 2023-09-23T09:15:38.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.100+0000 7f594f7fe700 1 -- 172.21.15.82:0/2362944069 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f594800f450 con 0x7f5958102350 2023-09-23T09:15:38.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.101+0000 7f5973ef3b80 1 Processor -- start 2023-09-23T09:15:38.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.101+0000 7f5973ef3b80 1 -- start start 2023-09-23T09:15:38.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.101+0000 7f5973ef3b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561dac0b2380 0x561dac0b2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:38.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.101+0000 7f5973ef3b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561dac0b2ca0 0x561dac0ac700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:38.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.101+0000 7f5973ef3b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561dac0acc40 0x561dac0ad0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:38.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.101+0000 7f5973ef3b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561dac0147b0 con 0x561dac0b2380 2023-09-23T09:15:38.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.101+0000 7f5973ef3b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561dac005780 con 0x561dac0b2ca0 2023-09-23T09:15:38.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.101+0000 7f5973ef3b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x561dac0030a0 con 0x561dac0acc40 2023-09-23T09:15:38.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.102+0000 7f595e39b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561dac0b2ca0 0x561dac0ac700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:38.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.102+0000 7f595eb9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561dac0b2380 0x561dac0b2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:38.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.102+0000 7f594f7fe700 1 --2- 172.21.15.82:0/2362944069 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f59440a00c0 0x7f59440a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:38.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.102+0000 7f595e39b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561dac0b2ca0 0x561dac0ac700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:38898/0 (socket says 172.21.15.82:38898) 2023-09-23T09:15:38.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.102+0000 7f595e39b700 1 -- 172.21.15.82:0/90608717 learned_addr learned my addr 172.21.15.82:0/90608717 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:15:38.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.102+0000 7f594f7fe700 1 -- 172.21.15.82:0/2362944069 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f59480cb5a0 con 0x7f5958102350 2023-09-23T09:15:38.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.102+0000 7f595db9a700 1 --2- 172.21.15.82:0/90608717 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561dac0acc40 0x561dac0ad0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:38.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.102+0000 7f595e39b700 1 -- 172.21.15.82:0/90608717 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561dac0acc40 msgr2=0x561dac0ad0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:15:38.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.102+0000 7f595e39b700 1 --2- 172.21.15.82:0/90608717 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561dac0acc40 0x561dac0ad0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:38.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.102+0000 7f595eb9c700 1 --2- 172.21.15.82:0/2362944069 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f59440a00c0 0x7f59440a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:38.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.102+0000 7f595e39b700 1 -- 172.21.15.82:0/90608717 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561dac0b2380 msgr2=0x561dac0b2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:15:38.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.102+0000 7f595e39b700 1 --2- 172.21.15.82:0/90608717 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561dac0b2380 0x561dac0b2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:38.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.102+0000 7f595e39b700 1 -- 172.21.15.82:0/90608717 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561dabe7e630 con 0x561dac0b2ca0 2023-09-23T09:15:38.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.102+0000 7f595db9a700 1 --2- 172.21.15.82:0/90608717 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561dac0acc40 0x561dac0ad0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:15:38.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.103+0000 7f595e39b700 1 --2- 172.21.15.82:0/90608717 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561dac0b2ca0 0x561dac0ac700 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f595400f4f0 tx=0x7f595400f800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec7a48f8eeb447ae server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:15:38.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.103+0000 7f594cbfe700 1 -- 172.21.15.82:0/90608717 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5954004a30 con 0x561dac0b2ca0 2023-09-23T09:15:38.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.103+0000 7f594cbfe700 1 -- 172.21.15.82:0/90608717 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f595400fe80 con 0x561dac0b2ca0 2023-09-23T09:15:38.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.103+0000 7f594cbfe700 1 -- 172.21.15.82:0/90608717 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59540108a0 con 0x561dac0b2ca0 2023-09-23T09:15:38.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.104+0000 7f5973ef3b80 1 -- 172.21.15.82:0/90608717 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561dac0b2ca0 msgr2=0x561dac0ac700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:15:38.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.104+0000 7f595eb9c700 1 --2- 172.21.15.82:0/2362944069 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f59440a00c0 0x7f59440a2580 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f595000b830 tx=0x7f595000b3b0 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:15:38.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.104+0000 7f5973ef3b80 1 --2- 172.21.15.82:0/90608717 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561dac0b2ca0 0x561dac0ac700 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f595400f4f0 tx=0x7f595400f800 comp rx=0 tx=0).stop 2023-09-23T09:15:38.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.104+0000 7f5973ef3b80 1 -- 172.21.15.82:0/90608717 shutdown_connections 2023-09-23T09:15:38.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.104+0000 7f5973ef3b80 1 --2- 172.21.15.82:0/90608717 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561dac0acc40 0x561dac0ad0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:38.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.104+0000 7f5973ef3b80 1 --2- 172.21.15.82:0/90608717 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561dac0b2380 0x561dac0b2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:38.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.104+0000 7f5973ef3b80 1 --2- 172.21.15.82:0/90608717 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561dac0b2ca0 0x561dac0ac700 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:38.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.104+0000 7f5973ef3b80 1 -- 172.21.15.82:0/90608717 >> 172.21.15.82:0/90608717 conn(0x561dac0210e0 msgr2=0x561dac0a7410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:15:38.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.104+0000 7f5973ef3b80 1 -- 172.21.15.82:0/90608717 shutdown_connections 2023-09-23T09:15:38.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.104+0000 7f5973ef3b80 1 -- 172.21.15.82:0/90608717 wait complete. 2023-09-23T09:15:38.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.104+0000 7f5973ef3b80 1 -- start start 2023-09-23T09:15:38.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.105+0000 7f5973ef3b80 1 Processor -- start 2023-09-23T09:15:38.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.105+0000 7f5973ef3b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561dac0acc40 0x561dac0b8c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:38.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.105+0000 7f5973ef3b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561dac0b2380 0x561dac0b5f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:38.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.105+0000 7f5973ef3b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561dac0b2ca0 0x561dac0b65c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:38.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.105+0000 7f5973ef3b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561dabffe990 con 0x561dac0b2380 2023-09-23T09:15:38.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.105+0000 7f5973ef3b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561dabf9cbb0 con 0x561dac0acc40 2023-09-23T09:15:38.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.105+0000 7f5973ef3b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x561dabf9c8b0 con 0x561dac0b2ca0 2023-09-23T09:15:38.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.105+0000 7f5973ef3b80 10 client.0 _ll_register_callbacks cb 0x561dabee6a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:15:38.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.106+0000 7f595e39b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561dac0acc40 0x561dac0b8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:38.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.106+0000 7f595e39b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561dac0acc40 0x561dac0b8c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:38904/0 (socket says 172.21.15.82:38904) 2023-09-23T09:15:38.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.106+0000 7f595e39b700 1 -- 172.21.15.82:0/2724795237 learned_addr learned my addr 172.21.15.82:0/2724795237 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:15:38.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.106+0000 7f595db9a700 1 --2- 172.21.15.82:0/2724795237 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561dac0b2380 0x561dac0b5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:38.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.106+0000 7f595eb9c700 1 --2- 172.21.15.82:0/2724795237 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561dac0b2ca0 0x561dac0b65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:38.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.106+0000 7f595e39b700 1 -- 172.21.15.82:0/2724795237 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561dac0b2ca0 msgr2=0x561dac0b65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:15:38.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.106+0000 7f595e39b700 1 --2- 172.21.15.82:0/2724795237 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561dac0b2ca0 0x561dac0b65c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:38.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.106+0000 7f595e39b700 1 -- 172.21.15.82:0/2724795237 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561dac0b2380 msgr2=0x561dac0b5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:15:38.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.106+0000 7f595e39b700 1 --2- 172.21.15.82:0/2724795237 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561dac0b2380 0x561dac0b5f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:38.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.106+0000 7f595e39b700 1 -- 172.21.15.82:0/2724795237 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f595400ad60 con 0x561dac0acc40 2023-09-23T09:15:38.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.106+0000 7f595e39b700 1 --2- 172.21.15.82:0/2724795237 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561dac0acc40 0x561dac0b8c30 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5954000c00 tx=0x7f5954010900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=617029b60fc5dccd server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:15:38.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.106+0000 7f5941ffb700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-09-23T09:15:38.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.107+0000 7f5941ffb700 1 -- 172.21.15.82:0/2724795237 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5954005df0 con 0x561dac0acc40 2023-09-23T09:15:38.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.107+0000 7f5973ef3b80 1 -- 172.21.15.82:0/2724795237 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561dac07c1c0 con 0x561dac0acc40 2023-09-23T09:15:38.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.107+0000 7f5941ffb700 1 -- 172.21.15.82:0/2724795237 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f5954004dd0 con 0x561dac0acc40 2023-09-23T09:15:38.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.107+0000 7f5941ffb700 1 -- 172.21.15.82:0/2724795237 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5954004f90 con 0x561dac0acc40 2023-09-23T09:15:38.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.107+0000 7f5973ef3b80 10 client.26420 fetch_fsmap learned FSMap version 70 2023-09-23T09:15:38.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.107+0000 7f5973ef3b80 1 -- 172.21.15.82:0/2724795237 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) v3 -- 0x561dabe2ade0 con 0x561dac0acc40 2023-09-23T09:15:38.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.108+0000 7f5941ffb700 1 -- 172.21.15.82:0/2724795237 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x561dac07c1c0 con 0x561dac0acc40 2023-09-23T09:15:38.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.108+0000 7f5941ffb700 1 -- 172.21.15.82:0/2724795237 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 70) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f5954020040 con 0x561dac0acc40 2023-09-23T09:15:38.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.108+0000 7f5973ef3b80 10 client.26420 fetch_fsmap finished waiting for FSMap version 70 2023-09-23T09:15:38.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.108+0000 7f5973ef3b80 10 client.26420 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-23T09:15:38.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.108+0000 7f5973ef3b80 20 client.26420 populate_metadata read hostname 'smithi082' 2023-09-23T09:15:38.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.108+0000 7f5973ef3b80 1 --2- 172.21.15.82:0/2724795237 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x561dac0c6510 0x561dac0c8930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:38.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.108+0000 7f5973ef3b80 4 client.26420 mds_command: new command op to 24550 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:15:38.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.108+0000 7f5973ef3b80 1 -- 172.21.15.82:0/2724795237 --> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561dabfa4ba0 con 0x561dac0c6510 2023-09-23T09:15:38.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.108+0000 7f595db9a700 1 --2- 172.21.15.82:0/2724795237 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x561dac0c6510 0x561dac0c8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:38.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.109+0000 7f595db9a700 1 --2- 172.21.15.82:0/2724795237 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x561dac0c6510 0x561dac0c8930 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ee66d7a18a15bfdc server_cookie=419409b2b5c26ef6 in_seq=0 out_seq=0 2023-09-23T09:15:38.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.109+0000 7f5941ffb700 10 client.26420 ms_handle_connect on v2:172.21.15.161:6838/758982817 2023-09-23T09:15:38.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.110+0000 7f5941ffb700 1 -- 172.21.15.82:0/2724795237 <== mds.1 v2:172.21.15.161:6838/758982817 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x561dabfa4ba0 con 0x561dac0c6510 2023-09-23T09:15:38.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.110+0000 7f5941ffb700 10 client.26420 handle_command_reply: tid=0 2023-09-23T09:15:38.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.110+0000 7f5973ef3b80 1 client.26420 shutdown 2023-09-23T09:15:38.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.110+0000 7f5973ef3b80 1 -- 172.21.15.82:0/2724795237 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561dac0acc40 msgr2=0x561dac0b8c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:15:38.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.110+0000 7f5973ef3b80 1 --2- 172.21.15.82:0/2724795237 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561dac0acc40 0x561dac0b8c30 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5954000c00 tx=0x7f5954010900 comp rx=0 tx=0).stop 2023-09-23T09:15:38.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.110+0000 7f5973ef3b80 1 -- 172.21.15.82:0/2724795237 shutdown_connections 2023-09-23T09:15:38.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.110+0000 7f5973ef3b80 1 --2- 172.21.15.82:0/2724795237 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x561dac0c6510 0x561dac0c8930 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:38.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.110+0000 7f5973ef3b80 1 --2- 172.21.15.82:0/2724795237 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561dac0b2ca0 0x561dac0b65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:38.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.110+0000 7f5941ffb700 0 client.26420 ms_handle_reset on v2:172.21.15.161:6838/758982817 2023-09-23T09:15:38.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.110+0000 7f5973ef3b80 1 --2- 172.21.15.82:0/2724795237 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561dac0acc40 0x561dac0b8c30 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:38.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.110+0000 7f5973ef3b80 1 --2- 172.21.15.82:0/2724795237 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561dac0b2380 0x561dac0b5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:38.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.110+0000 7f5973ef3b80 1 -- 172.21.15.82:0/2724795237 >> 172.21.15.82:0/2724795237 conn(0x561dac0210e0 msgr2=0x561dac0a1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:15:38.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.110+0000 7f5973ef3b80 1 -- 172.21.15.82:0/2724795237 shutdown_connections 2023-09-23T09:15:38.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.110+0000 7f5973ef3b80 1 -- 172.21.15.82:0/2724795237 wait complete. 2023-09-23T09:15:38.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.110+0000 7f5973ef3b80 20 client.26420 trim_cache size 0 max 16384 2023-09-23T09:15:38.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.129+0000 7f5973ef3b80 1 Processor -- start 2023-09-23T09:15:38.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.130+0000 7f5973ef3b80 1 -- start start 2023-09-23T09:15:38.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.130+0000 7f5973ef3b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561dac0acc40 0x561dac0b87d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:38.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.130+0000 7f5973ef3b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561dac0b2380 0x561dac0b0050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:38.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.130+0000 7f5973ef3b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561dac0b2ca0 0x561dac0b0590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:38.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.130+0000 7f5973ef3b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561dabe80920 con 0x561dac0b2380 2023-09-23T09:15:38.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.130+0000 7f5973ef3b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561dac0b1f90 con 0x561dac0acc40 2023-09-23T09:15:38.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.130+0000 7f5973ef3b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x561dac0b4480 con 0x561dac0b2ca0 2023-09-23T09:15:38.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.130+0000 7f595db9a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561dac0b2380 0x561dac0b0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:38.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.130+0000 7f595db9a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561dac0b2380 0x561dac0b0050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48088/0 (socket says 172.21.15.82:48088) 2023-09-23T09:15:38.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.130+0000 7f595db9a700 1 -- 172.21.15.82:0/3510700027 learned_addr learned my addr 172.21.15.82:0/3510700027 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:15:38.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.130+0000 7f595e39b700 1 --2- 172.21.15.82:0/3510700027 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561dac0acc40 0x561dac0b87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:38.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.130+0000 7f595eb9c700 1 --2- 172.21.15.82:0/3510700027 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561dac0b2ca0 0x561dac0b0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:38.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.131+0000 7f595e39b700 1 -- 172.21.15.82:0/3510700027 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561dac0b2ca0 msgr2=0x561dac0b0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:15:38.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.131+0000 7f595e39b700 1 --2- 172.21.15.82:0/3510700027 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561dac0b2ca0 0x561dac0b0590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:38.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.131+0000 7f595e39b700 1 -- 172.21.15.82:0/3510700027 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561dac0b2380 msgr2=0x561dac0b0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:15:38.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.131+0000 7f595e39b700 1 --2- 172.21.15.82:0/3510700027 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561dac0b2380 0x561dac0b0050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:38.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.131+0000 7f595e39b700 1 -- 172.21.15.82:0/3510700027 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561dabe13c60 con 0x561dac0acc40 2023-09-23T09:15:38.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.131+0000 7f595db9a700 1 --2- 172.21.15.82:0/3510700027 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561dac0b2380 0x561dac0b0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:15:38.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.131+0000 7f595e39b700 1 --2- 172.21.15.82:0/3510700027 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561dac0acc40 0x561dac0b87d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5954000c00 tx=0x7f595400f470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0d0760ca8ad3742 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:15:38.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.131+0000 7f594d3ff700 1 -- 172.21.15.82:0/3510700027 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5954010a20 con 0x561dac0acc40 2023-09-23T09:15:38.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.131+0000 7f594d3ff700 1 -- 172.21.15.82:0/3510700027 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5954005d70 con 0x561dac0acc40 2023-09-23T09:15:38.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.131+0000 7f594d3ff700 1 -- 172.21.15.82:0/3510700027 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f595402bd70 con 0x561dac0acc40 2023-09-23T09:15:38.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.132+0000 7f5973ef3b80 1 -- 172.21.15.82:0/3510700027 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561dac0acc40 msgr2=0x561dac0b87d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:15:38.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.132+0000 7f5973ef3b80 1 --2- 172.21.15.82:0/3510700027 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561dac0acc40 0x561dac0b87d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5954000c00 tx=0x7f595400f470 comp rx=0 tx=0).stop 2023-09-23T09:15:38.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.132+0000 7f5973ef3b80 1 -- 172.21.15.82:0/3510700027 shutdown_connections 2023-09-23T09:15:38.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.132+0000 7f5973ef3b80 1 --2- 172.21.15.82:0/3510700027 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561dac0b2ca0 0x561dac0b0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:38.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.132+0000 7f5973ef3b80 1 --2- 172.21.15.82:0/3510700027 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561dac0acc40 0x561dac0b87d0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:38.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.132+0000 7f5973ef3b80 1 --2- 172.21.15.82:0/3510700027 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561dac0b2380 0x561dac0b0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:38.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.132+0000 7f5973ef3b80 1 -- 172.21.15.82:0/3510700027 >> 172.21.15.82:0/3510700027 conn(0x561dac0210e0 msgr2=0x561dac0c2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:15:38.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.132+0000 7f5973ef3b80 1 -- 172.21.15.82:0/3510700027 shutdown_connections 2023-09-23T09:15:38.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.132+0000 7f5973ef3b80 1 -- 172.21.15.82:0/3510700027 wait complete. 2023-09-23T09:15:38.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.133+0000 7f5973ef3b80 1 -- start start 2023-09-23T09:15:38.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.133+0000 7f5973ef3b80 1 Processor -- start 2023-09-23T09:15:38.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.134+0000 7f5973ef3b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561dac0acc40 0x561dac0ade00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:38.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.134+0000 7f5973ef3b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561dac0b2380 0x561dac0ae340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:38.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.134+0000 7f5973ef3b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561dac0b2ca0 0x561dac0ae880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:38.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.134+0000 7f5973ef3b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561dac0aedc0 con 0x561dac0b2ca0 2023-09-23T09:15:38.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.134+0000 7f5973ef3b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561dac0aef30 con 0x561dac0b2380 2023-09-23T09:15:38.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.134+0000 7f5973ef3b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x561dac0af0f0 con 0x561dac0acc40 2023-09-23T09:15:38.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.134+0000 7f5973ef3b80 10 client.0 _ll_register_callbacks cb 0x7f595000b420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:15:38.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.134+0000 7f595eb9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561dac0b2ca0 0x561dac0ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:38.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.134+0000 7f595e39b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561dac0acc40 0x561dac0ade00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:38.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.134+0000 7f595eb9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561dac0b2ca0 0x561dac0ae880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48100/0 (socket says 172.21.15.82:48100) 2023-09-23T09:15:38.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.134+0000 7f595eb9c700 1 -- 172.21.15.82:0/1545733630 learned_addr learned my addr 172.21.15.82:0/1545733630 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:15:38.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.134+0000 7f595db9a700 1 --2- 172.21.15.82:0/1545733630 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561dac0b2380 0x561dac0ae340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:38.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.134+0000 7f595e39b700 1 -- 172.21.15.82:0/1545733630 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561dac0b2380 msgr2=0x561dac0ae340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:15:38.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.134+0000 7f595e39b700 1 --2- 172.21.15.82:0/1545733630 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561dac0b2380 0x561dac0ae340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:38.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.134+0000 7f595e39b700 1 -- 172.21.15.82:0/1545733630 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561dac0b2ca0 msgr2=0x561dac0ae880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:15:38.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.134+0000 7f595e39b700 1 --2- 172.21.15.82:0/1545733630 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561dac0b2ca0 0x561dac0ae880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:38.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.134+0000 7f595e39b700 1 -- 172.21.15.82:0/1545733630 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59581a59e0 con 0x561dac0acc40 2023-09-23T09:15:38.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.135+0000 7f595db9a700 1 --2- 172.21.15.82:0/1545733630 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561dac0b2380 0x561dac0ae340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:15:38.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.135+0000 7f595eb9c700 1 --2- 172.21.15.82:0/1545733630 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561dac0b2ca0 0x561dac0ae880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:15:38.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.135+0000 7f595e39b700 1 --2- 172.21.15.82:0/1545733630 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561dac0acc40 0x561dac0ade00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5954018900 tx=0x7f595400ffd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=37ea09b26c9de1c0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:15:38.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.135+0000 7f5941ffb700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T09:15:38.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.135+0000 7f5941ffb700 1 -- 172.21.15.82:0/1545733630 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f595402b640 con 0x561dac0acc40 2023-09-23T09:15:38.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.135+0000 7f5941ffb700 1 -- 172.21.15.82:0/1545733630 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f5954000e40 con 0x561dac0acc40 2023-09-23T09:15:38.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.135+0000 7f5973ef3b80 1 -- 172.21.15.82:0/1545733630 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561dac09f8b0 con 0x561dac0acc40 2023-09-23T09:15:38.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.136+0000 7f5941ffb700 1 -- 172.21.15.82:0/1545733630 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5954010a20 con 0x561dac0acc40 2023-09-23T09:15:38.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.136+0000 7f5973ef3b80 10 client.26482 fetch_fsmap learned FSMap version 70 2023-09-23T09:15:38.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.136+0000 7f5973ef3b80 1 -- 172.21.15.82:0/1545733630 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) v3 -- 0x561dabe2ade0 con 0x561dac0acc40 2023-09-23T09:15:38.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.136+0000 7f5941ffb700 1 -- 172.21.15.82:0/1545733630 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f595404b020 con 0x561dac0acc40 2023-09-23T09:15:38.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.136+0000 7f5941ffb700 1 -- 172.21.15.82:0/1545733630 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 70) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f595400f870 con 0x561dac0acc40 2023-09-23T09:15:38.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.136+0000 7f5973ef3b80 10 client.26482 fetch_fsmap finished waiting for FSMap version 70 2023-09-23T09:15:38.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.136+0000 7f5973ef3b80 10 client.26482 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-23T09:15:38.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.136+0000 7f5973ef3b80 20 client.26482 populate_metadata read hostname 'smithi082' 2023-09-23T09:15:38.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.136+0000 7f5973ef3b80 1 --2- 172.21.15.82:0/1545733630 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x561dac11a8d0 0x561dac11ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:38.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.136+0000 7f5973ef3b80 4 client.26482 mds_command: new command op to 24550 tid=0[{"prefix": "damage ls"}] 2023-09-23T09:15:38.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.136+0000 7f5973ef3b80 1 -- 172.21.15.82:0/1545733630 --> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x561dabff7970 con 0x561dac11a8d0 2023-09-23T09:15:38.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.137+0000 7f595db9a700 1 --2- 172.21.15.82:0/1545733630 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x561dac11a8d0 0x561dac11ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:38.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.137+0000 7f595db9a700 1 --2- 172.21.15.82:0/1545733630 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x561dac11a8d0 0x561dac11ccf0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8bd9862d3c8c2b00 server_cookie=509992fe629e1257 in_seq=0 out_seq=0 2023-09-23T09:15:38.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.137+0000 7f5941ffb700 10 client.26482 ms_handle_connect on v2:172.21.15.161:6838/758982817 2023-09-23T09:15:38.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.138+0000 7f5941ffb700 1 -- 172.21.15.82:0/1545733630 <== mds.1 v2:172.21.15.161:6838/758982817 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x561dabff7970 con 0x561dac11a8d0 2023-09-23T09:15:38.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.138+0000 7f5941ffb700 10 client.26482 handle_command_reply: tid=0 2023-09-23T09:15:38.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.138+0000 7f5973ef3b80 1 client.26482 shutdown 2023-09-23T09:15:38.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.138+0000 7f5973ef3b80 1 -- 172.21.15.82:0/1545733630 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561dac0acc40 msgr2=0x561dac0ade00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:15:38.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.138+0000 7f5973ef3b80 1 --2- 172.21.15.82:0/1545733630 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561dac0acc40 0x561dac0ade00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5954018900 tx=0x7f595400ffd0 comp rx=0 tx=0).stop 2023-09-23T09:15:38.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.138+0000 7f5973ef3b80 1 -- 172.21.15.82:0/1545733630 shutdown_connections 2023-09-23T09:15:38.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.138+0000 7f5973ef3b80 1 --2- 172.21.15.82:0/1545733630 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x561dac11a8d0 0x561dac11ccf0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:38.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.138+0000 7f5973ef3b80 1 --2- 172.21.15.82:0/1545733630 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561dac0b2ca0 0x561dac0ae880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:38.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.138+0000 7f5973ef3b80 1 --2- 172.21.15.82:0/1545733630 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561dac0acc40 0x561dac0ade00 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:38.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.138+0000 7f5973ef3b80 1 --2- 172.21.15.82:0/1545733630 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561dac0b2380 0x561dac0ae340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:38.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.138+0000 7f5941ffb700 0 client.26482 ms_handle_reset on v2:172.21.15.161:6838/758982817 2023-09-23T09:15:38.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.138+0000 7f5973ef3b80 1 -- 172.21.15.82:0/1545733630 >> 172.21.15.82:0/1545733630 conn(0x561dac0210e0 msgr2=0x561dac0b0050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:15:38.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.138+0000 7f5973ef3b80 1 -- 172.21.15.82:0/1545733630 shutdown_connections 2023-09-23T09:15:38.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.138+0000 7f5973ef3b80 1 -- 172.21.15.82:0/1545733630 wait complete. 2023-09-23T09:15:38.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.138+0000 7f5973ef3b80 20 client.26482 trim_cache size 0 max 16384 2023-09-23T09:15:38.146 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2023-09-23T09:15:38.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.139+0000 7f59605ff700 1 -- 172.21.15.82:0/2362944069 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f59440a00c0 msgr2=0x7f59440a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:15:38.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.139+0000 7f59605ff700 1 --2- 172.21.15.82:0/2362944069 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f59440a00c0 0x7f59440a2580 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f595000b830 tx=0x7f595000b3b0 comp rx=0 tx=0).stop 2023-09-23T09:15:38.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.139+0000 7f59605ff700 1 -- 172.21.15.82:0/2362944069 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5958102350 msgr2=0x7f59580ffbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:15:38.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.139+0000 7f59605ff700 1 --2- 172.21.15.82:0/2362944069 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5958102350 0x7f59580ffbc0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f594800c900 tx=0x7f594800cc10 comp rx=0 tx=0).stop 2023-09-23T09:15:38.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.139+0000 7f59605ff700 1 -- 172.21.15.82:0/2362944069 shutdown_connections 2023-09-23T09:15:38.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.139+0000 7f59605ff700 1 --2- 172.21.15.82:0/2362944069 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f59440a00c0 0x7f59440a2580 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:38.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.139+0000 7f59605ff700 1 --2- 172.21.15.82:0/2362944069 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f595810ae50 0x7f59581a4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:38.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.139+0000 7f59605ff700 1 --2- 172.21.15.82:0/2362944069 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5958101a30 0x7f59580ff680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:38.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.139+0000 7f59605ff700 1 --2- 172.21.15.82:0/2362944069 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5958102350 0x7f59580ffbc0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:38.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.139+0000 7f59605ff700 1 -- 172.21.15.82:0/2362944069 >> 172.21.15.82:0/2362944069 conn(0x7f59580fb270 msgr2=0x7f595810d010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:15:38.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.139+0000 7f59605ff700 1 -- 172.21.15.82:0/2362944069 shutdown_connections 2023-09-23T09:15:38.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.139+0000 7f59605ff700 1 -- 172.21.15.82:0/2362944069 wait complete. 2023-09-23T09:15:38.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:15:37 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/1926665793' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T09:15:38.160 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-09-23T09:15:38.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.404+0000 7f14433ff700 1 -- 172.21.15.82:0/1469480184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f143c1068b0 msgr2=0x7f143c106c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:15:38.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.404+0000 7f14433ff700 1 --2- 172.21.15.82:0/1469480184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f143c1068b0 0x7f143c106c90 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f142c0098f0 tx=0x7f142c009c00 comp rx=0 tx=0).stop 2023-09-23T09:15:38.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.404+0000 7f14433ff700 1 -- 172.21.15.82:0/1469480184 shutdown_connections 2023-09-23T09:15:38.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.404+0000 7f14433ff700 1 --2- 172.21.15.82:0/1469480184 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f143c101260 0x7f143c10d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:38.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.404+0000 7f14433ff700 1 --2- 172.21.15.82:0/1469480184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f143c1068b0 0x7f143c106c90 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:38.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.404+0000 7f14433ff700 1 --2- 172.21.15.82:0/1469480184 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f143c1008a0 0x7f143c100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:38.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.404+0000 7f14433ff700 1 -- 172.21.15.82:0/1469480184 >> 172.21.15.82:0/1469480184 conn(0x7f143c0fc3f0 msgr2=0x7f143c0fe810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:15:38.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.405+0000 7f14433ff700 1 -- 172.21.15.82:0/1469480184 shutdown_connections 2023-09-23T09:15:38.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.405+0000 7f14433ff700 1 -- 172.21.15.82:0/1469480184 wait complete. 2023-09-23T09:15:38.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.406+0000 7f14433ff700 1 Processor -- start 2023-09-23T09:15:38.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.406+0000 7f14433ff700 1 -- start start 2023-09-23T09:15:38.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.407+0000 7f14433ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f143c1008a0 0x7f143c1a1c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:38.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.407+0000 7f14433ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f143c101260 0x7f143c1a2140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:38.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.407+0000 7f14433ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f143c1068b0 0x7f143c10b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:38.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.407+0000 7f14433ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f143c10baf0 con 0x7f143c1008a0 2023-09-23T09:15:38.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.407+0000 7f14433ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f143c10bc60 con 0x7f143c1068b0 2023-09-23T09:15:38.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.407+0000 7f14433ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f143c10be20 con 0x7f143c101260 2023-09-23T09:15:38.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.407+0000 7f144119b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f143c1008a0 0x7f143c1a1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:38.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.407+0000 7f144099a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f143c101260 0x7f143c1a2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:38.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.407+0000 7f144119b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f143c1008a0 0x7f143c1a1c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48116/0 (socket says 172.21.15.82:48116) 2023-09-23T09:15:38.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.407+0000 7f144119b700 1 -- 172.21.15.82:0/718297828 learned_addr learned my addr 172.21.15.82:0/718297828 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:15:38.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.407+0000 7f144199c700 1 --2- 172.21.15.82:0/718297828 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f143c1068b0 0x7f143c10b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:38.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.408+0000 7f144119b700 1 -- 172.21.15.82:0/718297828 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f143c101260 msgr2=0x7f143c1a2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:15:38.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.408+0000 7f144119b700 1 --2- 172.21.15.82:0/718297828 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f143c101260 0x7f143c1a2140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:38.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.408+0000 7f144119b700 1 -- 172.21.15.82:0/718297828 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f143c1068b0 msgr2=0x7f143c10b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:15:38.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.408+0000 7f144119b700 1 --2- 172.21.15.82:0/718297828 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f143c1068b0 0x7f143c10b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:38.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.408+0000 7f144119b700 1 -- 172.21.15.82:0/718297828 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f142c009520 con 0x7f143c1008a0 2023-09-23T09:15:38.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.408+0000 7f144199c700 1 --2- 172.21.15.82:0/718297828 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f143c1068b0 0x7f143c10b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:15:38.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.408+0000 7f144119b700 1 --2- 172.21.15.82:0/718297828 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f143c1008a0 0x7f143c1a1c00 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f142c009230 tx=0x7f142c00b560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:15:38.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.409+0000 7f143a7fc700 1 -- 172.21.15.82:0/718297828 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142c01c070 con 0x7f143c1008a0 2023-09-23T09:15:38.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.409+0000 7f143a7fc700 1 -- 172.21.15.82:0/718297828 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f142c0058e0 con 0x7f143c1008a0 2023-09-23T09:15:38.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.409+0000 7f143a7fc700 1 -- 172.21.15.82:0/718297828 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142c0038e0 con 0x7f143c1008a0 2023-09-23T09:15:38.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.409+0000 7f14433ff700 1 -- 172.21.15.82:0/718297828 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f143c10c100 con 0x7f143c1008a0 2023-09-23T09:15:38.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.409+0000 7f14433ff700 1 -- 172.21.15.82:0/718297828 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f143c1a9d60 con 0x7f143c1008a0 2023-09-23T09:15:38.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.414+0000 7f143a7fc700 1 -- 172.21.15.82:0/718297828 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f142c020030 con 0x7f143c1008a0 2023-09-23T09:15:38.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.416+0000 7f143a7fc700 1 --2- 172.21.15.82:0/718297828 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f14240a0210 0x7f14240a26d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:38.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.416+0000 7f143a7fc700 1 -- 172.21.15.82:0/718297828 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f142c0cc520 con 0x7f143c1008a0 2023-09-23T09:15:38.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.416+0000 7f144099a700 1 --2- 172.21.15.82:0/718297828 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f14240a0210 0x7f14240a26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:38.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.416+0000 7f1456dddb80 1 Processor -- start 2023-09-23T09:15:38.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.417+0000 7f1456dddb80 1 -- start start 2023-09-23T09:15:38.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.417+0000 7f1456dddb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a92087380 0x564a92087760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:38.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.417+0000 7f1456dddb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564a92087ca0 0x564a92081700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:38.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.417+0000 7f144099a700 1 --2- 172.21.15.82:0/718297828 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f14240a0210 0x7f14240a26d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f143c19e600 tx=0x7f143000b040 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:15:38.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.417+0000 7f1456dddb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a92081c40 0x564a920820a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:38.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.417+0000 7f1456dddb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a91fe97b0 con 0x564a92087380 2023-09-23T09:15:38.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.417+0000 7f1456dddb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a91fda780 con 0x564a92081c40 2023-09-23T09:15:38.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.417+0000 7f1456dddb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a91fd80a0 con 0x564a92087ca0 2023-09-23T09:15:38.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.418+0000 7f144119b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a92087380 0x564a92087760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:38.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.418+0000 7f144199c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a92081c40 0x564a920820a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:38.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.418+0000 7f144199c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a92081c40 0x564a920820a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:38950/0 (socket says 172.21.15.82:38950) 2023-09-23T09:15:38.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.418+0000 7f144199c700 1 -- 172.21.15.82:0/763003966 learned_addr learned my addr 172.21.15.82:0/763003966 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:15:38.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.418+0000 7f144119b700 1 --2- 172.21.15.82:0/763003966 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a92087380 0x564a92087760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48126/0 (socket says 172.21.15.82:48126) 2023-09-23T09:15:38.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.418+0000 7f144099a700 1 --2- 172.21.15.82:0/763003966 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564a92087ca0 0x564a92081700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:38.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.418+0000 7f144199c700 1 -- 172.21.15.82:0/763003966 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564a92087ca0 msgr2=0x564a92081700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:15:38.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.418+0000 7f144199c700 1 --2- 172.21.15.82:0/763003966 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564a92087ca0 0x564a92081700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:38.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.418+0000 7f144199c700 1 -- 172.21.15.82:0/763003966 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a92087380 msgr2=0x564a92087760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:15:38.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.418+0000 7f144199c700 1 --2- 172.21.15.82:0/763003966 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a92087380 0x564a92087760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:38.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.418+0000 7f144199c700 1 -- 172.21.15.82:0/763003966 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564a91e53630 con 0x564a92081c40 2023-09-23T09:15:38.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.418+0000 7f144099a700 1 --2- 172.21.15.82:0/763003966 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564a92087ca0 0x564a92081700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:15:38.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.419+0000 7f144199c700 1 --2- 172.21.15.82:0/763003966 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a92081c40 0x564a920820a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f14340103d0 tx=0x7f14340106e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8efabf6924706d8e server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:15:38.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.419+0000 7f14237fe700 1 -- 172.21.15.82:0/763003966 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1434011440 con 0x564a92081c40 2023-09-23T09:15:38.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.419+0000 7f14237fe700 1 -- 172.21.15.82:0/763003966 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1434015070 con 0x564a92081c40 2023-09-23T09:15:38.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.419+0000 7f14237fe700 1 -- 172.21.15.82:0/763003966 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1434019750 con 0x564a92081c40 2023-09-23T09:15:38.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.420+0000 7f1456dddb80 1 -- 172.21.15.82:0/763003966 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a92081c40 msgr2=0x564a920820a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:15:38.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.420+0000 7f1456dddb80 1 --2- 172.21.15.82:0/763003966 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a92081c40 0x564a920820a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f14340103d0 tx=0x7f14340106e0 comp rx=0 tx=0).stop 2023-09-23T09:15:38.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.420+0000 7f1456dddb80 1 -- 172.21.15.82:0/763003966 shutdown_connections 2023-09-23T09:15:38.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.420+0000 7f1456dddb80 1 --2- 172.21.15.82:0/763003966 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a92081c40 0x564a920820a0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:38.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.420+0000 7f1456dddb80 1 --2- 172.21.15.82:0/763003966 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a92087380 0x564a92087760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:38.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.420+0000 7f1456dddb80 1 --2- 172.21.15.82:0/763003966 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564a92087ca0 0x564a92081700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:38.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.420+0000 7f1456dddb80 1 -- 172.21.15.82:0/763003966 >> 172.21.15.82:0/763003966 conn(0x564a91ff60e0 msgr2=0x564a9207c410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:15:38.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.420+0000 7f1456dddb80 1 -- 172.21.15.82:0/763003966 shutdown_connections 2023-09-23T09:15:38.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.420+0000 7f1456dddb80 1 -- 172.21.15.82:0/763003966 wait complete. 2023-09-23T09:15:38.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.421+0000 7f1456dddb80 1 -- start start 2023-09-23T09:15:38.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.421+0000 7f1456dddb80 1 Processor -- start 2023-09-23T09:15:38.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.422+0000 7f1456dddb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a92081c40 0x564a9208dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:38.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.422+0000 7f1456dddb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564a92087380 0x564a9208af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:38.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.422+0000 7f1456dddb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a92087ca0 0x564a9208b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:38.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.422+0000 7f1456dddb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a91fd3990 con 0x564a92081c40 2023-09-23T09:15:38.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.422+0000 7f1456dddb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a91f71bb0 con 0x564a92087ca0 2023-09-23T09:15:38.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.422+0000 7f1456dddb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a91f718b0 con 0x564a92087380 2023-09-23T09:15:38.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.422+0000 7f1456dddb80 10 client.0 _ll_register_callbacks cb 0x564a91ebba80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:15:38.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.422+0000 7f144099a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564a92087380 0x564a9208af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:38.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.422+0000 7f144099a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564a92087380 0x564a9208af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:38336/0 (socket says 172.21.15.82:38336) 2023-09-23T09:15:38.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.422+0000 7f144099a700 1 -- 172.21.15.82:0/2215958843 learned_addr learned my addr 172.21.15.82:0/2215958843 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:15:38.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.422+0000 7f144119b700 1 --2- 172.21.15.82:0/2215958843 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a92081c40 0x564a9208dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:38.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.423+0000 7f144199c700 1 --2- 172.21.15.82:0/2215958843 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a92087ca0 0x564a9208b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:38.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.423+0000 7f144099a700 1 -- 172.21.15.82:0/2215958843 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a92087ca0 msgr2=0x564a9208b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:15:38.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.423+0000 7f144099a700 1 --2- 172.21.15.82:0/2215958843 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a92087ca0 0x564a9208b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:38.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.423+0000 7f144099a700 1 -- 172.21.15.82:0/2215958843 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a92081c40 msgr2=0x564a9208dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:15:38.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.423+0000 7f144099a700 1 --2- 172.21.15.82:0/2215958843 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a92081c40 0x564a9208dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:38.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.423+0000 7f144099a700 1 -- 172.21.15.82:0/2215958843 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1434007cc0 con 0x564a92087380 2023-09-23T09:15:38.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.423+0000 7f144099a700 1 --2- 172.21.15.82:0/2215958843 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564a92087380 0x564a9208af60 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1430004640 tx=0x7f1430004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=561991f7f91a8c7 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:15:38.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.423+0000 7f1420ff9700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T09:15:38.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.423+0000 7f1420ff9700 1 -- 172.21.15.82:0/2215958843 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f143001c040 con 0x564a92087380 2023-09-23T09:15:38.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.423+0000 7f1456dddb80 1 -- 172.21.15.82:0/2215958843 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564a920511c0 con 0x564a92087380 2023-09-23T09:15:38.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.424+0000 7f1420ff9700 1 -- 172.21.15.82:0/2215958843 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f1430004bb0 con 0x564a92087380 2023-09-23T09:15:38.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.424+0000 7f1420ff9700 1 -- 172.21.15.82:0/2215958843 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7f143000e040 con 0x564a92087380 2023-09-23T09:15:38.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.424+0000 7f1456dddb80 10 client.26494 fetch_fsmap learned FSMap version 70 2023-09-23T09:15:38.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.424+0000 7f1456dddb80 1 -- 172.21.15.82:0/2215958843 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) v3 -- 0x564a91dffde0 con 0x564a92087380 2023-09-23T09:15:38.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.424+0000 7f1420ff9700 1 -- 172.21.15.82:0/2215958843 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1430030030 con 0x564a92087380 2023-09-23T09:15:38.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.425+0000 7f1420ff9700 1 -- 172.21.15.82:0/2215958843 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 70) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f14300238d0 con 0x564a92087380 2023-09-23T09:15:38.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.425+0000 7f1456dddb80 10 client.26494 fetch_fsmap finished waiting for FSMap version 70 2023-09-23T09:15:38.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.425+0000 7f1456dddb80 10 client.26494 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:15:38.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.425+0000 7f1456dddb80 20 client.26494 populate_metadata read hostname 'smithi082' 2023-09-23T09:15:38.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.425+0000 7f1456dddb80 1 --2- 172.21.15.82:0/2215958843 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x564a9209b870 0x564a9209dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:38.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.425+0000 7f1456dddb80 4 client.26494 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:15:38.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.425+0000 7f1456dddb80 1 -- 172.21.15.82:0/2215958843 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564a91f79ba0 con 0x564a9209b870 2023-09-23T09:15:38.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.425+0000 7f144119b700 1 --2- 172.21.15.82:0/2215958843 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x564a9209b870 0x564a9209dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:38.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.426+0000 7f1420ff9700 10 client.26494 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:15:38.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.426+0000 7f144119b700 1 --2- 172.21.15.82:0/2215958843 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x564a9209b870 0x564a9209dc90 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a621fe226ae1d513 server_cookie=5a43d05a4b39ecd9 in_seq=0 out_seq=0 2023-09-23T09:15:38.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.427+0000 7f1420ff9700 1 -- 172.21.15.82:0/2215958843 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x564a91f79ba0 con 0x564a9209b870 2023-09-23T09:15:38.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.427+0000 7f1420ff9700 10 client.26494 handle_command_reply: tid=0 2023-09-23T09:15:38.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.427+0000 7f1456dddb80 1 client.26494 shutdown 2023-09-23T09:15:38.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.427+0000 7f1456dddb80 1 -- 172.21.15.82:0/2215958843 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564a92087380 msgr2=0x564a9208af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:15:38.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.427+0000 7f1456dddb80 1 --2- 172.21.15.82:0/2215958843 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564a92087380 0x564a9208af60 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1430004640 tx=0x7f1430004ad0 comp rx=0 tx=0).stop 2023-09-23T09:15:38.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.427+0000 7f1456dddb80 1 -- 172.21.15.82:0/2215958843 shutdown_connections 2023-09-23T09:15:38.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.427+0000 7f1456dddb80 1 --2- 172.21.15.82:0/2215958843 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a92087ca0 0x564a9208b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:38.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.427+0000 7f1456dddb80 1 --2- 172.21.15.82:0/2215958843 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x564a9209b870 0x564a9209dc90 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:38.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.427+0000 7f1456dddb80 1 --2- 172.21.15.82:0/2215958843 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a92081c40 0x564a9208dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:38.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.427+0000 7f1456dddb80 1 --2- 172.21.15.82:0/2215958843 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564a92087380 0x564a9208af60 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:38.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.427+0000 7f1420ff9700 0 client.26494 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:15:38.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.427+0000 7f1456dddb80 1 -- 172.21.15.82:0/2215958843 >> 172.21.15.82:0/2215958843 conn(0x564a91ff60e0 msgr2=0x564a92076b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:15:38.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.427+0000 7f1456dddb80 1 -- 172.21.15.82:0/2215958843 shutdown_connections 2023-09-23T09:15:38.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.427+0000 7f1456dddb80 1 -- 172.21.15.82:0/2215958843 wait complete. 2023-09-23T09:15:38.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.427+0000 7f1456dddb80 20 client.26494 trim_cache size 0 max 16384 2023-09-23T09:15:38.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.444+0000 7f1456dddb80 1 Processor -- start 2023-09-23T09:15:38.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.444+0000 7f1456dddb80 1 -- start start 2023-09-23T09:15:38.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.444+0000 7f1456dddb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564a92081c40 0x564a9209dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:38.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.444+0000 7f1456dddb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a92087380 0x564a9208a720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:38.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.444+0000 7f1456dddb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a92087ca0 0x564a9208d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:38.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.444+0000 7f1456dddb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a91e55920 con 0x564a92087380 2023-09-23T09:15:38.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.444+0000 7f1456dddb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a92078cc0 con 0x564a92087ca0 2023-09-23T09:15:38.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.444+0000 7f1456dddb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a920894c0 con 0x564a92081c40 2023-09-23T09:15:38.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.444+0000 7f144119b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564a92081c40 0x564a9209dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:38.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.444+0000 7f144119b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564a92081c40 0x564a9209dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:38338/0 (socket says 172.21.15.82:38338) 2023-09-23T09:15:38.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.444+0000 7f144119b700 1 -- 172.21.15.82:0/529807404 learned_addr learned my addr 172.21.15.82:0/529807404 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:15:38.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.445+0000 7f144199c700 1 --2- 172.21.15.82:0/529807404 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a92087ca0 0x564a9208d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:38.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.445+0000 7f144099a700 1 --2- 172.21.15.82:0/529807404 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a92087380 0x564a9208a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:38.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.445+0000 7f144119b700 1 -- 172.21.15.82:0/529807404 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a92087ca0 msgr2=0x564a9208d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:15:38.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.445+0000 7f144119b700 1 --2- 172.21.15.82:0/529807404 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a92087ca0 0x564a9208d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:38.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.445+0000 7f144119b700 1 -- 172.21.15.82:0/529807404 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a92087380 msgr2=0x564a9208a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:15:38.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.445+0000 7f144119b700 1 --2- 172.21.15.82:0/529807404 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a92087380 0x564a9208a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:38.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.445+0000 7f144119b700 1 -- 172.21.15.82:0/529807404 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564a91de8c60 con 0x564a92081c40 2023-09-23T09:15:38.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.445+0000 7f144119b700 1 --2- 172.21.15.82:0/529807404 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564a92081c40 0x564a9209dc60 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f142c0999c0 tx=0x7f142c019040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c42ac35a9678361 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:15:38.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.446+0000 7f1423fff700 1 -- 172.21.15.82:0/529807404 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142c09a3c0 con 0x564a92081c40 2023-09-23T09:15:38.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.446+0000 7f1423fff700 1 -- 172.21.15.82:0/529807404 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f142c099cc0 con 0x564a92081c40 2023-09-23T09:15:38.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.446+0000 7f1423fff700 1 -- 172.21.15.82:0/529807404 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142c0c9ef0 con 0x564a92081c40 2023-09-23T09:15:38.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.446+0000 7f1456dddb80 1 -- 172.21.15.82:0/529807404 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564a92081c40 msgr2=0x564a9209dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:15:38.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.446+0000 7f1456dddb80 1 --2- 172.21.15.82:0/529807404 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564a92081c40 0x564a9209dc60 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f142c0999c0 tx=0x7f142c019040 comp rx=0 tx=0).stop 2023-09-23T09:15:38.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.447+0000 7f1456dddb80 1 -- 172.21.15.82:0/529807404 shutdown_connections 2023-09-23T09:15:38.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.447+0000 7f1456dddb80 1 --2- 172.21.15.82:0/529807404 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a92087ca0 0x564a9208d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:38.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.447+0000 7f1456dddb80 1 --2- 172.21.15.82:0/529807404 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564a92081c40 0x564a9209dc60 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:38.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.447+0000 7f1456dddb80 1 --2- 172.21.15.82:0/529807404 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a92087380 0x564a9208a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:38.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.447+0000 7f1456dddb80 1 -- 172.21.15.82:0/529807404 >> 172.21.15.82:0/529807404 conn(0x564a91ff60e0 msgr2=0x564a92097ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:15:38.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.447+0000 7f1456dddb80 1 -- 172.21.15.82:0/529807404 shutdown_connections 2023-09-23T09:15:38.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.447+0000 7f1456dddb80 1 -- 172.21.15.82:0/529807404 wait complete. 2023-09-23T09:15:38.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.447+0000 7f1456dddb80 1 -- start start 2023-09-23T09:15:38.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.447+0000 7f1456dddb80 1 Processor -- start 2023-09-23T09:15:38.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.448+0000 7f1456dddb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a92081c40 0x564a92084360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:38.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.448+0000 7f1456dddb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564a92087380 0x564a92082e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:38.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.448+0000 7f1456dddb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a92087ca0 0x564a92083340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:38.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.448+0000 7f1456dddb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a92084aa0 con 0x564a92087ca0 2023-09-23T09:15:38.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.448+0000 7f1456dddb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a92084c10 con 0x564a92081c40 2023-09-23T09:15:38.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.448+0000 7f1456dddb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a92083880 con 0x564a92087380 2023-09-23T09:15:38.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.448+0000 7f1456dddb80 10 client.0 _ll_register_callbacks cb 0x7f1430003e20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:15:38.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.448+0000 7f144099a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564a92087380 0x564a92082e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:38.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.448+0000 7f144099a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564a92087380 0x564a92082e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:38342/0 (socket says 172.21.15.82:38342) 2023-09-23T09:15:38.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.448+0000 7f144099a700 1 -- 172.21.15.82:0/1432591078 learned_addr learned my addr 172.21.15.82:0/1432591078 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:15:38.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.449+0000 7f144199c700 1 --2- 172.21.15.82:0/1432591078 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a92087ca0 0x564a92083340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:38.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.449+0000 7f144119b700 1 --2- 172.21.15.82:0/1432591078 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a92081c40 0x564a92084360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:38.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.449+0000 7f144099a700 1 -- 172.21.15.82:0/1432591078 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a92081c40 msgr2=0x564a92084360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:15:38.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.449+0000 7f144099a700 1 --2- 172.21.15.82:0/1432591078 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a92081c40 0x564a92084360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:38.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.449+0000 7f144099a700 1 -- 172.21.15.82:0/1432591078 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a92087ca0 msgr2=0x564a92083340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:15:38.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.449+0000 7f144099a700 1 --2- 172.21.15.82:0/1432591078 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a92087ca0 0x564a92083340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:38.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.449+0000 7f144099a700 1 -- 172.21.15.82:0/1432591078 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f143c1a9d60 con 0x564a92087380 2023-09-23T09:15:38.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.449+0000 7f144119b700 1 --2- 172.21.15.82:0/1432591078 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a92081c40 0x564a92084360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:15:38.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.449+0000 7f144099a700 1 --2- 172.21.15.82:0/1432591078 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564a92087380 0x564a92082e00 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1430023c50 tx=0x7f1430023680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=30afbf8581cf6254 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:15:38.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.449+0000 7f1420ff9700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T09:15:38.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.450+0000 7f1420ff9700 1 -- 172.21.15.82:0/1432591078 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f143000e040 con 0x564a92087380 2023-09-23T09:15:38.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.450+0000 7f1456dddb80 1 -- 172.21.15.82:0/1432591078 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564a920748b0 con 0x564a92087380 2023-09-23T09:15:38.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.450+0000 7f1420ff9700 1 -- 172.21.15.82:0/1432591078 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f1430015410 con 0x564a92087380 2023-09-23T09:15:38.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.450+0000 7f1420ff9700 1 -- 172.21.15.82:0/1432591078 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1430023a30 con 0x564a92087380 2023-09-23T09:15:38.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.450+0000 7f1456dddb80 10 client.26500 fetch_fsmap learned FSMap version 70 2023-09-23T09:15:38.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.450+0000 7f1456dddb80 1 -- 172.21.15.82:0/1432591078 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) v3 -- 0x564a91e26250 con 0x564a92087380 2023-09-23T09:15:38.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.450+0000 7f1420ff9700 1 -- 172.21.15.82:0/1432591078 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x564a920748b0 con 0x564a92087380 2023-09-23T09:15:38.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.451+0000 7f1420ff9700 1 -- 172.21.15.82:0/1432591078 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 70) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f1430015a00 con 0x564a92087380 2023-09-23T09:15:38.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.451+0000 7f1456dddb80 10 client.26500 fetch_fsmap finished waiting for FSMap version 70 2023-09-23T09:15:38.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.451+0000 7f1456dddb80 10 client.26500 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:15:38.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.451+0000 7f1456dddb80 20 client.26500 populate_metadata read hostname 'smithi082' 2023-09-23T09:15:38.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.451+0000 7f1456dddb80 1 --2- 172.21.15.82:0/1432591078 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x564a920f0710 0x564a920f2b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:38.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.451+0000 7f1456dddb80 4 client.26500 mds_command: new command op to 24557 tid=0[{"prefix": "damage ls"}] 2023-09-23T09:15:38.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.451+0000 7f1456dddb80 1 -- 172.21.15.82:0/1432591078 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x564a91fcc970 con 0x564a920f0710 2023-09-23T09:15:38.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.451+0000 7f144119b700 1 --2- 172.21.15.82:0/1432591078 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x564a920f0710 0x564a920f2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:38.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.452+0000 7f144119b700 1 --2- 172.21.15.82:0/1432591078 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x564a920f0710 0x564a920f2b30 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5669a77d8b410203 server_cookie=79cda782f22c3a0d in_seq=0 out_seq=0 2023-09-23T09:15:38.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.452+0000 7f1420ff9700 10 client.26500 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:15:38.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.452+0000 7f1420ff9700 1 -- 172.21.15.82:0/1432591078 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x564a91fcc970 con 0x564a920f0710 2023-09-23T09:15:38.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.452+0000 7f1420ff9700 10 client.26500 handle_command_reply: tid=0 2023-09-23T09:15:38.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.452+0000 7f1456dddb80 1 client.26500 shutdown 2023-09-23T09:15:38.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.452+0000 7f1456dddb80 1 -- 172.21.15.82:0/1432591078 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564a92087380 msgr2=0x564a92082e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:15:38.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.452+0000 7f1456dddb80 1 --2- 172.21.15.82:0/1432591078 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564a92087380 0x564a92082e00 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1430023c50 tx=0x7f1430023680 comp rx=0 tx=0).stop 2023-09-23T09:15:38.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.452+0000 7f1456dddb80 1 -- 172.21.15.82:0/1432591078 shutdown_connections 2023-09-23T09:15:38.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.452+0000 7f1456dddb80 1 --2- 172.21.15.82:0/1432591078 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x564a920f0710 0x564a920f2b30 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:38.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.452+0000 7f1456dddb80 1 --2- 172.21.15.82:0/1432591078 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a92087ca0 0x564a92083340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:38.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.452+0000 7f1456dddb80 1 --2- 172.21.15.82:0/1432591078 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a92081c40 0x564a92084360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:38.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.452+0000 7f1420ff9700 0 client.26500 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:15:38.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.452+0000 7f1456dddb80 1 --2- 172.21.15.82:0/1432591078 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564a92087380 0x564a92082e00 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:38.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.452+0000 7f1456dddb80 1 -- 172.21.15.82:0/1432591078 >> 172.21.15.82:0/1432591078 conn(0x564a91ff60e0 msgr2=0x564a920850b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:15:38.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.452+0000 7f1456dddb80 1 -- 172.21.15.82:0/1432591078 shutdown_connections 2023-09-23T09:15:38.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.453+0000 7f1456dddb80 1 -- 172.21.15.82:0/1432591078 wait complete. 2023-09-23T09:15:38.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.453+0000 7f1456dddb80 20 client.26500 trim_cache size 0 max 16384 2023-09-23T09:15:38.458 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2023-09-23T09:15:38.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.453+0000 7f14433ff700 1 -- 172.21.15.82:0/718297828 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f14240a0210 msgr2=0x7f14240a26d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:15:38.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.453+0000 7f14433ff700 1 --2- 172.21.15.82:0/718297828 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f14240a0210 0x7f14240a26d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f143c19e600 tx=0x7f143000b040 comp rx=0 tx=0).stop 2023-09-23T09:15:38.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.453+0000 7f14433ff700 1 -- 172.21.15.82:0/718297828 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f143c1008a0 msgr2=0x7f143c1a1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:15:38.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.453+0000 7f14433ff700 1 --2- 172.21.15.82:0/718297828 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f143c1008a0 0x7f143c1a1c00 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f142c009230 tx=0x7f142c00b560 comp rx=0 tx=0).stop 2023-09-23T09:15:38.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.453+0000 7f14433ff700 1 -- 172.21.15.82:0/718297828 shutdown_connections 2023-09-23T09:15:38.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.453+0000 7f14433ff700 1 --2- 172.21.15.82:0/718297828 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f14240a0210 0x7f14240a26d0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:38.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.453+0000 7f14433ff700 1 --2- 172.21.15.82:0/718297828 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f143c1068b0 0x7f143c10b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:38.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.453+0000 7f14433ff700 1 --2- 172.21.15.82:0/718297828 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f143c1008a0 0x7f143c1a1c00 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:38.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.453+0000 7f14433ff700 1 --2- 172.21.15.82:0/718297828 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f143c101260 0x7f143c1a2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:38.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.453+0000 7f14433ff700 1 -- 172.21.15.82:0/718297828 >> 172.21.15.82:0/718297828 conn(0x7f143c0fc3f0 msgr2=0x7f143c072b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:15:38.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.454+0000 7f14433ff700 1 -- 172.21.15.82:0/718297828 shutdown_connections 2023-09-23T09:15:38.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:38.454+0000 7f14433ff700 1 -- 172.21.15.82:0/718297828 wait complete. 2023-09-23T09:15:39.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:15:38 smithi135 ceph-mon[99205]: pgmap v589: 97 pgs: 97 active+clean; 9.6 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 15 MiB/s wr, 60 op/s 2023-09-23T09:15:39.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:15:38 smithi082 ceph-mon[97694]: pgmap v589: 97 pgs: 97 active+clean; 9.6 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 15 MiB/s wr, 60 op/s 2023-09-23T09:15:39.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:15:38 smithi161 ceph-mon[99580]: pgmap v589: 97 pgs: 97 active+clean; 9.6 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 15 MiB/s wr, 60 op/s 2023-09-23T09:15:39.477 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-09-23T09:15:39.478 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-09-23T09:15:39.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.723+0000 7fc4ed3ff700 1 -- 172.21.15.82:0/3583592765 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4e8100890 msgr2=0x7fc4e8100d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:15:39.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.723+0000 7fc4ed3ff700 1 --2- 172.21.15.82:0/3583592765 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4e8100890 0x7fc4e8100d10 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc0098f0 tx=0x7fc4dc009c00 comp rx=0 tx=0).stop 2023-09-23T09:15:39.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.723+0000 7fc4ed3ff700 1 -- 172.21.15.82:0/3583592765 shutdown_connections 2023-09-23T09:15:39.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.723+0000 7fc4ed3ff700 1 --2- 172.21.15.82:0/3583592765 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc4e8101250 0x7fc4e810d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:39.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.724+0000 7fc4ed3ff700 1 --2- 172.21.15.82:0/3583592765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4e81068a0 0x7fc4e8106c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:39.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.724+0000 7fc4ed3ff700 1 --2- 172.21.15.82:0/3583592765 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4e8100890 0x7fc4e8100d10 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:39.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.724+0000 7fc4ed3ff700 1 -- 172.21.15.82:0/3583592765 >> 172.21.15.82:0/3583592765 conn(0x7fc4e80fc380 msgr2=0x7fc4e80fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:15:39.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.724+0000 7fc4ed3ff700 1 -- 172.21.15.82:0/3583592765 shutdown_connections 2023-09-23T09:15:39.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.724+0000 7fc4ed3ff700 1 -- 172.21.15.82:0/3583592765 wait complete. 2023-09-23T09:15:39.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.725+0000 7fc4ed3ff700 1 Processor -- start 2023-09-23T09:15:39.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.725+0000 7fc4ed3ff700 1 -- start start 2023-09-23T09:15:39.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.726+0000 7fc4ed3ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc4e8100890 0x7fc4e819e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:39.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.726+0000 7fc4ed3ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4e8101250 0x7fc4e819ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:39.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.726+0000 7fc4ed3ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4e81068a0 0x7fc4e81989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:39.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.726+0000 7fc4ed3ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e8199180 con 0x7fc4e81068a0 2023-09-23T09:15:39.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.726+0000 7fc4ed3ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e81992f0 con 0x7fc4e8101250 2023-09-23T09:15:39.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.726+0000 7fc4ed3ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e81994b0 con 0x7fc4e8100890 2023-09-23T09:15:39.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.726+0000 7fc4e67fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4e8101250 0x7fc4e819ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:39.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.726+0000 7fc4e77fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4e81068a0 0x7fc4e81989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:39.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.726+0000 7fc4e67fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4e8101250 0x7fc4e819ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:39000/0 (socket says 172.21.15.82:39000) 2023-09-23T09:15:39.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.726+0000 7fc4e67fc700 1 -- 172.21.15.82:0/1126092621 learned_addr learned my addr 172.21.15.82:0/1126092621 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:15:39.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.726+0000 7fc4e6ffd700 1 --2- 172.21.15.82:0/1126092621 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc4e8100890 0x7fc4e819e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:39.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.727+0000 7fc4e67fc700 1 -- 172.21.15.82:0/1126092621 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc4e8100890 msgr2=0x7fc4e819e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:15:39.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.727+0000 7fc4e67fc700 1 --2- 172.21.15.82:0/1126092621 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc4e8100890 0x7fc4e819e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:39.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.727+0000 7fc4e67fc700 1 -- 172.21.15.82:0/1126092621 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4e81068a0 msgr2=0x7fc4e81989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:15:39.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.727+0000 7fc4e67fc700 1 --2- 172.21.15.82:0/1126092621 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4e81068a0 0x7fc4e81989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:39.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.727+0000 7fc4e67fc700 1 -- 172.21.15.82:0/1126092621 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4d80095f0 con 0x7fc4e8101250 2023-09-23T09:15:39.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.727+0000 7fc4e6ffd700 1 --2- 172.21.15.82:0/1126092621 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc4e8100890 0x7fc4e819e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:15:39.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.727+0000 7fc4e67fc700 1 --2- 172.21.15.82:0/1126092621 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4e8101250 0x7fc4e819ef10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc009810 tx=0x7fc4dc00fa00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:15:39.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.727+0000 7fc4cffff700 1 -- 172.21.15.82:0/1126092621 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4dc01c070 con 0x7fc4e8101250 2023-09-23T09:15:39.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.728+0000 7fc4cffff700 1 -- 172.21.15.82:0/1126092621 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc4dc00bb70 con 0x7fc4e8101250 2023-09-23T09:15:39.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.728+0000 7fc4ed3ff700 1 -- 172.21.15.82:0/1126092621 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4dc009520 con 0x7fc4e8101250 2023-09-23T09:15:39.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.728+0000 7fc4cffff700 1 -- 172.21.15.82:0/1126092621 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4dc004930 con 0x7fc4e8101250 2023-09-23T09:15:39.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.728+0000 7fc4ed3ff700 1 -- 172.21.15.82:0/1126092621 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4e81a5770 con 0x7fc4e8101250 2023-09-23T09:15:39.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.732+0000 7fc4cffff700 1 -- 172.21.15.82:0/1126092621 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7fc4dc020070 con 0x7fc4e8101250 2023-09-23T09:15:39.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.733+0000 7fc500ca5b80 1 Processor -- start 2023-09-23T09:15:39.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.733+0000 7fc500ca5b80 1 -- start start 2023-09-23T09:15:39.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.734+0000 7fc500ca5b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55bfdfd22400 0x55bfdfd227e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:39.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.734+0000 7fc500ca5b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bfdfd22d20 0x55bfdfd1c780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:39.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.734+0000 7fc500ca5b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bfdfd1ccc0 0x55bfdfd1d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:39.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.734+0000 7fc500ca5b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfdfc84830 con 0x55bfdfd1ccc0 2023-09-23T09:15:39.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.734+0000 7fc500ca5b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfdfc75800 con 0x55bfdfd22d20 2023-09-23T09:15:39.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.734+0000 7fc500ca5b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfdfc73120 con 0x55bfdfd22400 2023-09-23T09:15:39.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.734+0000 7fc4cffff700 1 --2- 172.21.15.82:0/1126092621 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fc4d00a00c0 0x7fc4d00a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:39.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.734+0000 7fc4cffff700 1 -- 172.21.15.82:0/1126092621 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fc4dc0cc2b0 con 0x7fc4e8101250 2023-09-23T09:15:39.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.734+0000 7fc4e6ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bfdfd22d20 0x55bfdfd1c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:39.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.734+0000 7fc4e77fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55bfdfd22400 0x55bfdfd227e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:39.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.734+0000 7fc4e6ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bfdfd22d20 0x55bfdfd1c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:39004/0 (socket says 172.21.15.82:39004) 2023-09-23T09:15:39.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.734+0000 7fc4e6ffd700 1 -- 172.21.15.82:0/2615989623 learned_addr learned my addr 172.21.15.82:0/2615989623 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:15:39.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.734+0000 7fc4e67fc700 1 --2- 172.21.15.82:0/2615989623 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bfdfd1ccc0 0x55bfdfd1d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:39.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.735+0000 7fc4e77fe700 1 --2- 172.21.15.82:0/1126092621 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fc4d00a00c0 0x7fc4d00a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:39.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.735+0000 7fc4e6ffd700 1 -- 172.21.15.82:0/2615989623 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55bfdfd22400 msgr2=0x55bfdfd227e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:15:39.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.735+0000 7fc4e6ffd700 1 --2- 172.21.15.82:0/2615989623 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55bfdfd22400 0x55bfdfd227e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:39.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.735+0000 7fc4e6ffd700 1 -- 172.21.15.82:0/2615989623 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bfdfd1ccc0 msgr2=0x55bfdfd1d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:15:39.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.735+0000 7fc4e6ffd700 1 --2- 172.21.15.82:0/2615989623 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bfdfd1ccc0 0x55bfdfd1d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:39.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.735+0000 7fc4e6ffd700 1 -- 172.21.15.82:0/2615989623 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bfdfaee6b0 con 0x55bfdfd22d20 2023-09-23T09:15:39.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.735+0000 7fc4e6ffd700 1 --2- 172.21.15.82:0/2615989623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bfdfd22d20 0x55bfdfd1c780 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc4d8009f70 tx=0x7fc4d80116c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d09652d037d7c692 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:15:39.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.735+0000 7fc4e77fe700 1 --2- 172.21.15.82:0/1126092621 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fc4d00a00c0 0x7fc4d00a2580 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc4e0009ec0 tx=0x7fc4e000b040 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:15:39.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.735+0000 7fc4cd7fa700 1 -- 172.21.15.82:0/2615989623 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4d8011e20 con 0x55bfdfd22d20 2023-09-23T09:15:39.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.736+0000 7fc4cd7fa700 1 -- 172.21.15.82:0/2615989623 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc4d8004cc0 con 0x55bfdfd22d20 2023-09-23T09:15:39.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.736+0000 7fc4cd7fa700 1 -- 172.21.15.82:0/2615989623 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4d80126b0 con 0x55bfdfd22d20 2023-09-23T09:15:39.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.736+0000 7fc500ca5b80 1 -- 172.21.15.82:0/2615989623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bfdfd22d20 msgr2=0x55bfdfd1c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:15:39.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.736+0000 7fc500ca5b80 1 --2- 172.21.15.82:0/2615989623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bfdfd22d20 0x55bfdfd1c780 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc4d8009f70 tx=0x7fc4d80116c0 comp rx=0 tx=0).stop 2023-09-23T09:15:39.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.736+0000 7fc500ca5b80 1 -- 172.21.15.82:0/2615989623 shutdown_connections 2023-09-23T09:15:39.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.736+0000 7fc500ca5b80 1 --2- 172.21.15.82:0/2615989623 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bfdfd1ccc0 0x55bfdfd1d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:39.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.736+0000 7fc500ca5b80 1 --2- 172.21.15.82:0/2615989623 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55bfdfd22400 0x55bfdfd227e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:39.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.736+0000 7fc500ca5b80 1 --2- 172.21.15.82:0/2615989623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bfdfd22d20 0x55bfdfd1c780 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:39.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.736+0000 7fc500ca5b80 1 -- 172.21.15.82:0/2615989623 >> 172.21.15.82:0/2615989623 conn(0x55bfdfc91160 msgr2=0x55bfdfd17490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:15:39.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.737+0000 7fc500ca5b80 1 -- 172.21.15.82:0/2615989623 shutdown_connections 2023-09-23T09:15:39.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.737+0000 7fc500ca5b80 1 -- 172.21.15.82:0/2615989623 wait complete. 2023-09-23T09:15:39.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.737+0000 7fc500ca5b80 1 -- start start 2023-09-23T09:15:39.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.738+0000 7fc500ca5b80 1 Processor -- start 2023-09-23T09:15:39.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.738+0000 7fc500ca5b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bfdfd1ccc0 0x55bfdfd28c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:39.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.738+0000 7fc500ca5b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bfdfd22400 0x55bfdfd25f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:39.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.738+0000 7fc500ca5b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55bfdfd22d20 0x55bfdfd265d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:39.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.738+0000 7fc500ca5b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfdfc6ea10 con 0x55bfdfd1ccc0 2023-09-23T09:15:39.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.738+0000 7fc500ca5b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfdfc0cc30 con 0x55bfdfd22400 2023-09-23T09:15:39.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.738+0000 7fc500ca5b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfdfc0c930 con 0x55bfdfd22d20 2023-09-23T09:15:39.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.738+0000 7fc500ca5b80 10 client.0 _ll_register_callbacks cb 0x55bfdfb56b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:15:39.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.739+0000 7fc4e6ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bfdfd1ccc0 0x55bfdfd28c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:39.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.739+0000 7fc4e77fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55bfdfd22d20 0x55bfdfd265d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:39.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.739+0000 7fc4e6ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bfdfd1ccc0 0x55bfdfd28c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48180/0 (socket says 172.21.15.82:48180) 2023-09-23T09:15:39.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.739+0000 7fc4e6ffd700 1 -- 172.21.15.82:0/1361762255 learned_addr learned my addr 172.21.15.82:0/1361762255 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:15:39.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.739+0000 7fc4e67fc700 1 --2- 172.21.15.82:0/1361762255 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bfdfd22400 0x55bfdfd25f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:39.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.739+0000 7fc4e6ffd700 1 -- 172.21.15.82:0/1361762255 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55bfdfd22d20 msgr2=0x55bfdfd265d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:15:39.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.739+0000 7fc4e6ffd700 1 --2- 172.21.15.82:0/1361762255 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55bfdfd22d20 0x55bfdfd265d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:39.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.739+0000 7fc4e6ffd700 1 -- 172.21.15.82:0/1361762255 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bfdfd22400 msgr2=0x55bfdfd25f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:15:39.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.739+0000 7fc4e6ffd700 1 --2- 172.21.15.82:0/1361762255 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bfdfd22400 0x55bfdfd25f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:39.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.739+0000 7fc4e6ffd700 1 -- 172.21.15.82:0/1361762255 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4d8009bd0 con 0x55bfdfd1ccc0 2023-09-23T09:15:39.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.739+0000 7fc4e67fc700 1 --2- 172.21.15.82:0/1361762255 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bfdfd22400 0x55bfdfd25f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:15:39.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.740+0000 7fc4e6ffd700 1 --2- 172.21.15.82:0/1361762255 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bfdfd1ccc0 0x55bfdfd28c60 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fc4d8005b30 tx=0x7fc4d80050b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3232e935900e80c1 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:15:39.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.740+0000 7fc4caff5700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:15:39.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.740+0000 7fc4caff5700 1 -- 172.21.15.82:0/1361762255 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4d8011eb0 con 0x55bfdfd1ccc0 2023-09-23T09:15:39.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.740+0000 7fc500ca5b80 1 -- 172.21.15.82:0/1361762255 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bfdfcec240 con 0x55bfdfd1ccc0 2023-09-23T09:15:39.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.740+0000 7fc4caff5700 1 -- 172.21.15.82:0/1361762255 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fc4d8004030 con 0x55bfdfd1ccc0 2023-09-23T09:15:39.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.740+0000 7fc4caff5700 1 -- 172.21.15.82:0/1361762255 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc4d80041f0 con 0x55bfdfd1ccc0 2023-09-23T09:15:39.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.740+0000 7fc500ca5b80 10 client.16785 fetch_fsmap learned FSMap version 70 2023-09-23T09:15:39.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.740+0000 7fc500ca5b80 1 -- 172.21.15.82:0/1361762255 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) v3 -- 0x55bfdfa9ae60 con 0x55bfdfd1ccc0 2023-09-23T09:15:39.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.740+0000 7fc4caff5700 1 -- 172.21.15.82:0/1361762255 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55bfdfcec240 con 0x55bfdfd1ccc0 2023-09-23T09:15:39.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.741+0000 7fc4caff5700 1 -- 172.21.15.82:0/1361762255 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 70) v1 ==== 7902+0+0 (secure 0 0 0) 0x7fc4d80037a0 con 0x55bfdfd1ccc0 2023-09-23T09:15:39.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.741+0000 7fc500ca5b80 10 client.16785 fetch_fsmap finished waiting for FSMap version 70 2023-09-23T09:15:39.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.741+0000 7fc500ca5b80 10 client.16785 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:15:39.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.741+0000 7fc500ca5b80 20 client.16785 populate_metadata read hostname 'smithi082' 2023-09-23T09:15:39.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.741+0000 7fc500ca5b80 1 --2- 172.21.15.82:0/1361762255 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55bfdfd36750 0x55bfdfd38b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:39.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.741+0000 7fc500ca5b80 4 client.16785 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:15:39.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.741+0000 7fc500ca5b80 1 -- 172.21.15.82:0/1361762255 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bfdfc14c20 con 0x55bfdfd36750 2023-09-23T09:15:39.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.741+0000 7fc4e67fc700 1 --2- 172.21.15.82:0/1361762255 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55bfdfd36750 0x55bfdfd38b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:39.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.742+0000 7fc4caff5700 10 client.16785 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:15:39.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.742+0000 7fc4e67fc700 1 --2- 172.21.15.82:0/1361762255 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55bfdfd36750 0x55bfdfd38b70 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c026b7d35b457194 server_cookie=24a190a343b7e0fd in_seq=0 out_seq=0 2023-09-23T09:15:39.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.743+0000 7fc4caff5700 1 -- 172.21.15.82:0/1361762255 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55bfdfc14c20 con 0x55bfdfd36750 2023-09-23T09:15:39.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.743+0000 7fc4caff5700 10 client.16785 handle_command_reply: tid=0 2023-09-23T09:15:39.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.743+0000 7fc500ca5b80 1 client.16785 shutdown 2023-09-23T09:15:39.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.743+0000 7fc500ca5b80 1 -- 172.21.15.82:0/1361762255 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bfdfd1ccc0 msgr2=0x55bfdfd28c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:15:39.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.743+0000 7fc500ca5b80 1 --2- 172.21.15.82:0/1361762255 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bfdfd1ccc0 0x55bfdfd28c60 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fc4d8005b30 tx=0x7fc4d80050b0 comp rx=0 tx=0).stop 2023-09-23T09:15:39.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.743+0000 7fc500ca5b80 1 -- 172.21.15.82:0/1361762255 shutdown_connections 2023-09-23T09:15:39.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.743+0000 7fc500ca5b80 1 --2- 172.21.15.82:0/1361762255 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55bfdfd22d20 0x55bfdfd265d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:39.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.743+0000 7fc500ca5b80 1 --2- 172.21.15.82:0/1361762255 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55bfdfd36750 0x55bfdfd38b70 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:39.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.743+0000 7fc500ca5b80 1 --2- 172.21.15.82:0/1361762255 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bfdfd1ccc0 0x55bfdfd28c60 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:39.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.743+0000 7fc500ca5b80 1 --2- 172.21.15.82:0/1361762255 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bfdfd22400 0x55bfdfd25f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:39.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.743+0000 7fc500ca5b80 1 -- 172.21.15.82:0/1361762255 >> 172.21.15.82:0/1361762255 conn(0x55bfdfc91160 msgr2=0x55bfdfd11bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:15:39.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.743+0000 7fc4caff5700 0 client.16785 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:15:39.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.744+0000 7fc500ca5b80 1 -- 172.21.15.82:0/1361762255 shutdown_connections 2023-09-23T09:15:39.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.744+0000 7fc500ca5b80 1 -- 172.21.15.82:0/1361762255 wait complete. 2023-09-23T09:15:39.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.744+0000 7fc500ca5b80 20 client.16785 trim_cache size 0 max 16384 2023-09-23T09:15:39.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.769+0000 7fc500ca5b80 1 Processor -- start 2023-09-23T09:15:39.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.769+0000 7fc500ca5b80 1 -- start start 2023-09-23T09:15:39.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.769+0000 7fc500ca5b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55bfdfd1ccc0 0x55bfdfd2d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:39.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.769+0000 7fc500ca5b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bfdfd22400 0x55bfdfd21700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:39.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.769+0000 7fc500ca5b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bfdfd22d20 0x55bfdfd28800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:39.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.769+0000 7fc500ca5b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfdfaf09a0 con 0x55bfdfd22400 2023-09-23T09:15:39.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.769+0000 7fc500ca5b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfdfd26eb0 con 0x55bfdfd22d20 2023-09-23T09:15:39.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.769+0000 7fc500ca5b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfdfd27490 con 0x55bfdfd1ccc0 2023-09-23T09:15:39.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.769+0000 7fc4e67fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bfdfd22400 0x55bfdfd21700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:39.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.770+0000 7fc4e6ffd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55bfdfd1ccc0 0x55bfdfd2d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:39.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.770+0000 7fc4e6ffd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55bfdfd1ccc0 0x55bfdfd2d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:38392/0 (socket says 172.21.15.82:38392) 2023-09-23T09:15:39.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.770+0000 7fc4e67fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bfdfd22400 0x55bfdfd21700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48186/0 (socket says 172.21.15.82:48186) 2023-09-23T09:15:39.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.770+0000 7fc4e6ffd700 1 -- 172.21.15.82:0/1903221943 learned_addr learned my addr 172.21.15.82:0/1903221943 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:15:39.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.770+0000 7fc4e77fe700 1 --2- 172.21.15.82:0/1903221943 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bfdfd22d20 0x55bfdfd28800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:39.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.770+0000 7fc4e6ffd700 1 -- 172.21.15.82:0/1903221943 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bfdfd22d20 msgr2=0x55bfdfd28800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:15:39.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.770+0000 7fc4e6ffd700 1 --2- 172.21.15.82:0/1903221943 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bfdfd22d20 0x55bfdfd28800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:39.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.770+0000 7fc4e6ffd700 1 -- 172.21.15.82:0/1903221943 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bfdfd22400 msgr2=0x55bfdfd21700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:15:39.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.770+0000 7fc4e6ffd700 1 --2- 172.21.15.82:0/1903221943 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bfdfd22400 0x55bfdfd21700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:39.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.770+0000 7fc4e6ffd700 1 -- 172.21.15.82:0/1903221943 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bfdfd3d7a0 con 0x55bfdfd1ccc0 2023-09-23T09:15:39.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.770+0000 7fc4e67fc700 1 --2- 172.21.15.82:0/1903221943 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bfdfd22400 0x55bfdfd21700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:15:39.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.770+0000 7fc4e6ffd700 1 --2- 172.21.15.82:0/1903221943 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55bfdfd1ccc0 0x55bfdfd2d850 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc4d8011a90 tx=0x7fc4d80053a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8aa36ec3b4ee68c3 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:15:39.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.771+0000 7fc4cdffb700 1 -- 172.21.15.82:0/1903221943 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4d80059c0 con 0x55bfdfd1ccc0 2023-09-23T09:15:39.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.771+0000 7fc4cdffb700 1 -- 172.21.15.82:0/1903221943 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc4d8011eb0 con 0x55bfdfd1ccc0 2023-09-23T09:15:39.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.771+0000 7fc4cdffb700 1 -- 172.21.15.82:0/1903221943 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4d8004520 con 0x55bfdfd1ccc0 2023-09-23T09:15:39.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.771+0000 7fc500ca5b80 1 -- 172.21.15.82:0/1903221943 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55bfdfd1ccc0 msgr2=0x55bfdfd2d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:15:39.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.771+0000 7fc500ca5b80 1 --2- 172.21.15.82:0/1903221943 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55bfdfd1ccc0 0x55bfdfd2d850 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc4d8011a90 tx=0x7fc4d80053a0 comp rx=0 tx=0).stop 2023-09-23T09:15:39.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.771+0000 7fc500ca5b80 1 -- 172.21.15.82:0/1903221943 shutdown_connections 2023-09-23T09:15:39.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.771+0000 7fc500ca5b80 1 --2- 172.21.15.82:0/1903221943 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bfdfd22d20 0x55bfdfd28800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:39.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.771+0000 7fc500ca5b80 1 --2- 172.21.15.82:0/1903221943 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55bfdfd1ccc0 0x55bfdfd2d850 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:39.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.771+0000 7fc500ca5b80 1 --2- 172.21.15.82:0/1903221943 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bfdfd22400 0x55bfdfd21700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:39.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.771+0000 7fc500ca5b80 1 -- 172.21.15.82:0/1903221943 >> 172.21.15.82:0/1903221943 conn(0x55bfdfc91160 msgr2=0x55bfdfd20ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:15:39.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.771+0000 7fc500ca5b80 1 -- 172.21.15.82:0/1903221943 shutdown_connections 2023-09-23T09:15:39.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.772+0000 7fc500ca5b80 1 -- 172.21.15.82:0/1903221943 wait complete. 2023-09-23T09:15:39.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.772+0000 7fc500ca5b80 1 -- start start 2023-09-23T09:15:39.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.772+0000 7fc500ca5b80 1 Processor -- start 2023-09-23T09:15:39.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.773+0000 7fc500ca5b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55bfdfd1ccc0 0x55bfdfd2d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:39.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.773+0000 7fc500ca5b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bfdfd22400 0x55bfdfd2bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:39.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.773+0000 7fc500ca5b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bfdfd22d20 0x55bfdfd2c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:39.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.773+0000 7fc500ca5b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfdfd2c950 con 0x55bfdfd22d20 2023-09-23T09:15:39.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.773+0000 7fc500ca5b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfdfd2cac0 con 0x55bfdfd22400 2023-09-23T09:15:39.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.773+0000 7fc500ca5b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfdfd8a590 con 0x55bfdfd1ccc0 2023-09-23T09:15:39.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.773+0000 7fc500ca5b80 10 client.0 _ll_register_callbacks cb 0x7fc4e0009f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:15:39.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.773+0000 7fc4e77fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bfdfd22d20 0x55bfdfd2c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:39.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.773+0000 7fc4e77fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bfdfd22d20 0x55bfdfd2c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48194/0 (socket says 172.21.15.82:48194) 2023-09-23T09:15:39.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.773+0000 7fc4e77fe700 1 -- 172.21.15.82:0/2442791906 learned_addr learned my addr 172.21.15.82:0/2442791906 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:15:39.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.773+0000 7fc4e67fc700 1 --2- 172.21.15.82:0/2442791906 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bfdfd22400 0x55bfdfd2bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:39.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.773+0000 7fc4e6ffd700 1 --2- 172.21.15.82:0/2442791906 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55bfdfd1ccc0 0x55bfdfd2d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:39.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.774+0000 7fc4e67fc700 1 -- 172.21.15.82:0/2442791906 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55bfdfd1ccc0 msgr2=0x55bfdfd2d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:15:39.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.774+0000 7fc4e67fc700 1 --2- 172.21.15.82:0/2442791906 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55bfdfd1ccc0 0x55bfdfd2d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:39.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.774+0000 7fc4e67fc700 1 -- 172.21.15.82:0/2442791906 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bfdfd22d20 msgr2=0x55bfdfd2c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:15:39.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.774+0000 7fc4e67fc700 1 --2- 172.21.15.82:0/2442791906 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bfdfd22d20 0x55bfdfd2c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:39.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.774+0000 7fc4e67fc700 1 -- 172.21.15.82:0/2442791906 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4e81a5770 con 0x55bfdfd22400 2023-09-23T09:15:39.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.774+0000 7fc4e77fe700 1 --2- 172.21.15.82:0/2442791906 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bfdfd22d20 0x55bfdfd2c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:15:39.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.774+0000 7fc4e6ffd700 1 --2- 172.21.15.82:0/2442791906 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55bfdfd1ccc0 0x55bfdfd2d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:15:39.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.774+0000 7fc4e67fc700 1 --2- 172.21.15.82:0/2442791906 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bfdfd22400 0x55bfdfd2bc80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc0c9a00 tx=0x7fc4dc06bac0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=266265a7727a9c6 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:15:39.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.774+0000 7fc4caff5700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-09-23T09:15:39.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.774+0000 7fc4caff5700 1 -- 172.21.15.82:0/2442791906 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4dc09d880 con 0x55bfdfd22400 2023-09-23T09:15:39.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.774+0000 7fc4caff5700 1 -- 172.21.15.82:0/2442791906 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fc4dc0a17d0 con 0x55bfdfd22400 2023-09-23T09:15:39.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.774+0000 7fc500ca5b80 1 -- 172.21.15.82:0/2442791906 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bfdfd0f930 con 0x55bfdfd22400 2023-09-23T09:15:39.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.775+0000 7fc4caff5700 1 -- 172.21.15.82:0/2442791906 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc4dc005240 con 0x55bfdfd22400 2023-09-23T09:15:39.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.775+0000 7fc500ca5b80 10 client.26462 fetch_fsmap learned FSMap version 70 2023-09-23T09:15:39.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.775+0000 7fc500ca5b80 1 -- 172.21.15.82:0/2442791906 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) v3 -- 0x55bfdfa9ae60 con 0x55bfdfd22400 2023-09-23T09:15:39.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.775+0000 7fc4caff5700 1 -- 172.21.15.82:0/2442791906 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc4dc0b5030 con 0x55bfdfd22400 2023-09-23T09:15:39.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.775+0000 7fc4caff5700 1 -- 172.21.15.82:0/2442791906 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 70) v1 ==== 7902+0+0 (secure 0 0 0) 0x7fc4dc098f40 con 0x55bfdfd22400 2023-09-23T09:15:39.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.775+0000 7fc500ca5b80 10 client.26462 fetch_fsmap finished waiting for FSMap version 70 2023-09-23T09:15:39.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.775+0000 7fc500ca5b80 10 client.26462 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:15:39.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.775+0000 7fc500ca5b80 20 client.26462 populate_metadata read hostname 'smithi082' 2023-09-23T09:15:39.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.775+0000 7fc500ca5b80 1 --2- 172.21.15.82:0/2442791906 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55bfdfd8baf0 0x55bfdfd8df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:39.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.775+0000 7fc500ca5b80 4 client.26462 mds_command: new command op to 24557 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-09-23T09:15:39.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.775+0000 7fc500ca5b80 1 -- 172.21.15.82:0/2442791906 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55bfdfc679f0 con 0x55bfdfd8baf0 2023-09-23T09:15:39.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.775+0000 7fc4e6ffd700 1 --2- 172.21.15.82:0/2442791906 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55bfdfd8baf0 0x55bfdfd8df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:39.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.776+0000 7fc4caff5700 10 client.26462 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:15:39.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.776+0000 7fc4e6ffd700 1 --2- 172.21.15.82:0/2442791906 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55bfdfd8baf0 0x55bfdfd8df10 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cbf91e9d70b0d3be server_cookie=1b0b87f237e6c0fe in_seq=0 out_seq=0 2023-09-23T09:15:39.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.777+0000 7fc4caff5700 1 -- 172.21.15.82:0/2442791906 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55bfdfc679f0 con 0x55bfdfd8baf0 2023-09-23T09:15:39.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.777+0000 7fc4caff5700 10 client.26462 handle_command_reply: tid=0 2023-09-23T09:15:39.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.777+0000 7fc500ca5b80 1 client.26462 shutdown 2023-09-23T09:15:39.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.777+0000 7fc500ca5b80 1 -- 172.21.15.82:0/2442791906 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bfdfd22400 msgr2=0x55bfdfd2bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:15:39.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.777+0000 7fc500ca5b80 1 --2- 172.21.15.82:0/2442791906 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bfdfd22400 0x55bfdfd2bc80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc0c9a00 tx=0x7fc4dc06bac0 comp rx=0 tx=0).stop 2023-09-23T09:15:39.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.777+0000 7fc500ca5b80 1 -- 172.21.15.82:0/2442791906 shutdown_connections 2023-09-23T09:15:39.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.777+0000 7fc500ca5b80 1 --2- 172.21.15.82:0/2442791906 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55bfdfd8baf0 0x55bfdfd8df10 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:39.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.777+0000 7fc500ca5b80 1 --2- 172.21.15.82:0/2442791906 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bfdfd22d20 0x55bfdfd2c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:39.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.777+0000 7fc4caff5700 0 client.26462 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:15:39.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.777+0000 7fc500ca5b80 1 --2- 172.21.15.82:0/2442791906 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55bfdfd1ccc0 0x55bfdfd2d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:39.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.777+0000 7fc500ca5b80 1 --2- 172.21.15.82:0/2442791906 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bfdfd22400 0x55bfdfd2bc80 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:39.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.777+0000 7fc500ca5b80 1 -- 172.21.15.82:0/2442791906 >> 172.21.15.82:0/2442791906 conn(0x55bfdfc91160 msgr2=0x55bfdfd21880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:15:39.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.778+0000 7fc500ca5b80 1 -- 172.21.15.82:0/2442791906 shutdown_connections 2023-09-23T09:15:39.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.778+0000 7fc500ca5b80 1 -- 172.21.15.82:0/2442791906 wait complete. 2023-09-23T09:15:39.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.778+0000 7fc500ca5b80 20 client.26462 trim_cache size 0 max 16384 2023-09-23T09:15:39.784 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:15:39.784 INFO:teuthology.orchestra.run.smithi082.stdout: "return_code": 0, 2023-09-23T09:15:39.784 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_tag": "047cbc72-e254-4787-b038-382de9c1a9a4", 2023-09-23T09:15:39.784 INFO:teuthology.orchestra.run.smithi082.stdout: "mode": "asynchronous" 2023-09-23T09:15:39.784 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:15:39.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.778+0000 7fc4ed3ff700 1 -- 172.21.15.82:0/1126092621 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fc4d00a00c0 msgr2=0x7fc4d00a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:15:39.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.778+0000 7fc4ed3ff700 1 --2- 172.21.15.82:0/1126092621 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fc4d00a00c0 0x7fc4d00a2580 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc4e0009ec0 tx=0x7fc4e000b040 comp rx=0 tx=0).stop 2023-09-23T09:15:39.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.778+0000 7fc4ed3ff700 1 -- 172.21.15.82:0/1126092621 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4e8101250 msgr2=0x7fc4e819ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:15:39.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.778+0000 7fc4ed3ff700 1 --2- 172.21.15.82:0/1126092621 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4e8101250 0x7fc4e819ef10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc009810 tx=0x7fc4dc00fa00 comp rx=0 tx=0).stop 2023-09-23T09:15:39.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.779+0000 7fc4ed3ff700 1 -- 172.21.15.82:0/1126092621 shutdown_connections 2023-09-23T09:15:39.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.779+0000 7fc4ed3ff700 1 --2- 172.21.15.82:0/1126092621 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fc4d00a00c0 0x7fc4d00a2580 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:39.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.779+0000 7fc4ed3ff700 1 --2- 172.21.15.82:0/1126092621 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4e81068a0 0x7fc4e81989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:39.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.779+0000 7fc4ed3ff700 1 --2- 172.21.15.82:0/1126092621 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc4e8100890 0x7fc4e819e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:39.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.779+0000 7fc4ed3ff700 1 --2- 172.21.15.82:0/1126092621 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4e8101250 0x7fc4e819ef10 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:39.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.779+0000 7fc4ed3ff700 1 -- 172.21.15.82:0/1126092621 >> 172.21.15.82:0/1126092621 conn(0x7fc4e80fc380 msgr2=0x7fc4e810bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:15:39.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.779+0000 7fc4ed3ff700 1 -- 172.21.15.82:0/1126092621 shutdown_connections 2023-09-23T09:15:39.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:39.779+0000 7fc4ed3ff700 1 -- 172.21.15.82:0/1126092621 wait complete. 2023-09-23T09:15:39.803 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:15:40.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.055+0000 7fa2139ff700 1 -- 172.21.15.82:0/4076086533 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa20c101a30 msgr2=0x7fa20c101e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:15:40.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.055+0000 7fa2139ff700 1 --2- 172.21.15.82:0/4076086533 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa20c101a30 0x7fa20c101e10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa2080098f0 tx=0x7fa208009c00 comp rx=0 tx=0).stop 2023-09-23T09:15:40.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.055+0000 7fa2139ff700 1 -- 172.21.15.82:0/4076086533 shutdown_connections 2023-09-23T09:15:40.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.055+0000 7fa2139ff700 1 --2- 172.21.15.82:0/4076086533 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa20c10ae50 0x7fa20c10d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:40.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.055+0000 7fa2139ff700 1 --2- 172.21.15.82:0/4076086533 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa20c101a30 0x7fa20c101e10 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:40.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.055+0000 7fa2139ff700 1 --2- 172.21.15.82:0/4076086533 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa20c102350 0x7fa20c10a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:40.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.055+0000 7fa2139ff700 1 -- 172.21.15.82:0/4076086533 >> 172.21.15.82:0/4076086533 conn(0x7fa20c0fb270 msgr2=0x7fa20c0fd690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:15:40.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.056+0000 7fa2139ff700 1 -- 172.21.15.82:0/4076086533 shutdown_connections 2023-09-23T09:15:40.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.056+0000 7fa2139ff700 1 -- 172.21.15.82:0/4076086533 wait complete. 2023-09-23T09:15:40.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.057+0000 7fa2139ff700 1 Processor -- start 2023-09-23T09:15:40.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.057+0000 7fa2139ff700 1 -- start start 2023-09-23T09:15:40.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.058+0000 7fa2139ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa20c101a30 0x7fa20c0ff680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:40.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.058+0000 7fa2139ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa20c102350 0x7fa20c0ffbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:40.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.058+0000 7fa2139ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa20c10ae50 0x7fa20c1a4b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:40.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.058+0000 7fa2139ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa20c1003f0 con 0x7fa20c10ae50 2023-09-23T09:15:40.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.058+0000 7fa2139ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa20c1a50c0 con 0x7fa20c101a30 2023-09-23T09:15:40.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.058+0000 7fa2139ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa20c1a5200 con 0x7fa20c102350 2023-09-23T09:15:40.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.058+0000 7fa21179b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa20c101a30 0x7fa20c0ff680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:40.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.058+0000 7fa211f9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa20c10ae50 0x7fa20c1a4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:40.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.058+0000 7fa21179b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa20c101a30 0x7fa20c0ff680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:39056/0 (socket says 172.21.15.82:39056) 2023-09-23T09:15:40.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.058+0000 7fa21179b700 1 -- 172.21.15.82:0/3239023355 learned_addr learned my addr 172.21.15.82:0/3239023355 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:15:40.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.058+0000 7fa210f9a700 1 --2- 172.21.15.82:0/3239023355 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa20c102350 0x7fa20c0ffbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:40.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.059+0000 7fa21179b700 1 -- 172.21.15.82:0/3239023355 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa20c102350 msgr2=0x7fa20c0ffbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:15:40.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.059+0000 7fa21179b700 1 --2- 172.21.15.82:0/3239023355 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa20c102350 0x7fa20c0ffbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:40.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.059+0000 7fa21179b700 1 -- 172.21.15.82:0/3239023355 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa20c10ae50 msgr2=0x7fa20c1a4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:15:40.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.059+0000 7fa21179b700 1 --2- 172.21.15.82:0/3239023355 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa20c10ae50 0x7fa20c1a4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:40.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.059+0000 7fa21179b700 1 -- 172.21.15.82:0/3239023355 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa208009520 con 0x7fa20c101a30 2023-09-23T09:15:40.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.059+0000 7fa21179b700 1 --2- 172.21.15.82:0/3239023355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa20c101a30 0x7fa20c0ff680 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa208009810 tx=0x7fa20800fa00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:15:40.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.059+0000 7fa2027fc700 1 -- 172.21.15.82:0/3239023355 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa20801c070 con 0x7fa20c101a30 2023-09-23T09:15:40.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.059+0000 7fa2027fc700 1 -- 172.21.15.82:0/3239023355 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa20800ba70 con 0x7fa20c101a30 2023-09-23T09:15:40.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.059+0000 7fa2139ff700 1 -- 172.21.15.82:0/3239023355 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa20c196700 con 0x7fa20c101a30 2023-09-23T09:15:40.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.059+0000 7fa2027fc700 1 -- 172.21.15.82:0/3239023355 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa208004930 con 0x7fa20c101a30 2023-09-23T09:15:40.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.059+0000 7fa2139ff700 1 -- 172.21.15.82:0/3239023355 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa20c196bd0 con 0x7fa20c101a30 2023-09-23T09:15:40.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.064+0000 7fa2272cab80 1 Processor -- start 2023-09-23T09:15:40.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.064+0000 7fa2027fc700 1 -- 172.21.15.82:0/3239023355 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7fa208020070 con 0x7fa20c101a30 2023-09-23T09:15:40.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.064+0000 7fa2272cab80 1 -- start start 2023-09-23T09:15:40.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.064+0000 7fa2272cab80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564b3ad05380 0x564b3ad05760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:40.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.064+0000 7fa2272cab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564b3ad05ca0 0x564b3acff700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:40.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.065+0000 7fa2272cab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b3acffc40 0x564b3ad000a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:40.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.065+0000 7fa2272cab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b3ac677b0 con 0x564b3acffc40 2023-09-23T09:15:40.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.065+0000 7fa2272cab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b3ac58780 con 0x564b3ad05ca0 2023-09-23T09:15:40.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.065+0000 7fa2272cab80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b3ac560a0 con 0x564b3ad05380 2023-09-23T09:15:40.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.065+0000 7fa211f9c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564b3ad05380 0x564b3ad05760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:40.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.065+0000 7fa21179b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564b3ad05ca0 0x564b3acff700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:40.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.065+0000 7fa211f9c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564b3ad05380 0x564b3ad05760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:38436/0 (socket says 172.21.15.82:38436) 2023-09-23T09:15:40.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.065+0000 7fa211f9c700 1 -- 172.21.15.82:0/853608244 learned_addr learned my addr 172.21.15.82:0/853608244 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:15:40.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.065+0000 7fa210f9a700 1 --2- 172.21.15.82:0/853608244 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b3acffc40 0x564b3ad000a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:40.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.065+0000 7fa211f9c700 1 -- 172.21.15.82:0/853608244 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564b3ad05ca0 msgr2=0x564b3acff700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:15:40.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.065+0000 7fa211f9c700 1 --2- 172.21.15.82:0/853608244 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564b3ad05ca0 0x564b3acff700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:40.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.065+0000 7fa211f9c700 1 -- 172.21.15.82:0/853608244 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b3acffc40 msgr2=0x564b3ad000a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:15:40.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.065+0000 7fa211f9c700 1 --2- 172.21.15.82:0/853608244 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b3acffc40 0x564b3ad000a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:40.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.065+0000 7fa211f9c700 1 -- 172.21.15.82:0/853608244 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564b3aad1630 con 0x564b3ad05380 2023-09-23T09:15:40.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.066+0000 7fa211f9c700 1 --2- 172.21.15.82:0/853608244 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564b3ad05380 0x564b3ad05760 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa204014c20 tx=0x7fa20400b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=61620257cd891fed server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:15:40.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.066+0000 7fa1f77fe700 1 -- 172.21.15.82:0/853608244 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa204003c00 con 0x564b3ad05380 2023-09-23T09:15:40.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.066+0000 7fa1f77fe700 1 -- 172.21.15.82:0/853608244 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa20401a040 con 0x564b3ad05380 2023-09-23T09:15:40.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.066+0000 7fa1f77fe700 1 -- 172.21.15.82:0/853608244 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa204004280 con 0x564b3ad05380 2023-09-23T09:15:40.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.066+0000 7fa2027fc700 1 --2- 172.21.15.82:0/3239023355 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fa1f80a0140 0x7fa1f80a2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:40.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.066+0000 7fa2027fc700 1 -- 172.21.15.82:0/3239023355 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fa2080cc1d0 con 0x7fa20c101a30 2023-09-23T09:15:40.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.066+0000 7fa21179b700 1 --2- 172.21.15.82:0/3239023355 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fa1f80a0140 0x7fa1f80a2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:40.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.067+0000 7fa2272cab80 1 -- 172.21.15.82:0/853608244 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564b3ad05380 msgr2=0x564b3ad05760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:15:40.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.067+0000 7fa2272cab80 1 --2- 172.21.15.82:0/853608244 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564b3ad05380 0x564b3ad05760 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa204014c20 tx=0x7fa20400b040 comp rx=0 tx=0).stop 2023-09-23T09:15:40.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.067+0000 7fa21179b700 1 --2- 172.21.15.82:0/3239023355 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fa1f80a0140 0x7fa1f80a2600 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa2080c99d0 tx=0x7fa2080cfce0 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:15:40.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.067+0000 7fa2272cab80 1 -- 172.21.15.82:0/853608244 shutdown_connections 2023-09-23T09:15:40.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.067+0000 7fa2272cab80 1 --2- 172.21.15.82:0/853608244 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b3acffc40 0x564b3ad000a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:40.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.067+0000 7fa2272cab80 1 --2- 172.21.15.82:0/853608244 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564b3ad05380 0x564b3ad05760 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:40.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.067+0000 7fa2272cab80 1 --2- 172.21.15.82:0/853608244 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564b3ad05ca0 0x564b3acff700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:40.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.067+0000 7fa2272cab80 1 -- 172.21.15.82:0/853608244 >> 172.21.15.82:0/853608244 conn(0x564b3ac740e0 msgr2=0x564b3acfa410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:15:40.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.067+0000 7fa2272cab80 1 -- 172.21.15.82:0/853608244 shutdown_connections 2023-09-23T09:15:40.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.067+0000 7fa2272cab80 1 -- 172.21.15.82:0/853608244 wait complete. 2023-09-23T09:15:40.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.068+0000 7fa2272cab80 1 -- start start 2023-09-23T09:15:40.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.068+0000 7fa2272cab80 1 Processor -- start 2023-09-23T09:15:40.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.068+0000 7fa2272cab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564b3acffc40 0x564b3ad0bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:40.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.068+0000 7fa2272cab80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564b3ad05380 0x564b3ad08f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:40.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.069+0000 7fa2272cab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b3ad05ca0 0x564b3ad095f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:40.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.069+0000 7fa2272cab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b3ac51990 con 0x564b3ad05ca0 2023-09-23T09:15:40.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.069+0000 7fa2272cab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b3abefbb0 con 0x564b3acffc40 2023-09-23T09:15:40.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.069+0000 7fa2272cab80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b3abef8b0 con 0x564b3ad05380 2023-09-23T09:15:40.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.069+0000 7fa2272cab80 10 client.0 _ll_register_callbacks cb 0x564b3ab39a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:15:40.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.069+0000 7fa210f9a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564b3ad05380 0x564b3ad08f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:40.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.069+0000 7fa210f9a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564b3ad05380 0x564b3ad08f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:38450/0 (socket says 172.21.15.82:38450) 2023-09-23T09:15:40.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.069+0000 7fa210f9a700 1 -- 172.21.15.82:0/1418328127 learned_addr learned my addr 172.21.15.82:0/1418328127 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:15:40.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.069+0000 7fa211f9c700 1 --2- 172.21.15.82:0/1418328127 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564b3acffc40 0x564b3ad0bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:40.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.069+0000 7fa211f9c700 1 --2- 172.21.15.82:0/1418328127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b3ad05ca0 0x564b3ad095f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:40.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.069+0000 7fa210f9a700 1 -- 172.21.15.82:0/1418328127 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564b3acffc40 msgr2=0x564b3ad0bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:15:40.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.069+0000 7fa210f9a700 1 --2- 172.21.15.82:0/1418328127 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564b3acffc40 0x564b3ad0bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:40.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.069+0000 7fa210f9a700 1 -- 172.21.15.82:0/1418328127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b3ad05ca0 msgr2=0x564b3ad095f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:15:40.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.069+0000 7fa210f9a700 1 --2- 172.21.15.82:0/1418328127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b3ad05ca0 0x564b3ad095f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:40.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.069+0000 7fa210f9a700 1 -- 172.21.15.82:0/1418328127 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2040148d0 con 0x564b3ad05380 2023-09-23T09:15:40.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.069+0000 7fa211f9c700 1 --2- 172.21.15.82:0/1418328127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b3ad05ca0 0x564b3ad095f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:15:40.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.070+0000 7fa210f9a700 1 --2- 172.21.15.82:0/1418328127 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564b3ad05380 0x564b3ad08f00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc012750 tx=0x7fa1fc012b10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dcdf1ac983364dcb server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:15:40.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.070+0000 7fa1f4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T09:15:40.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.070+0000 7fa1f4ff9700 1 -- 172.21.15.82:0/1418328127 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1fc017070 con 0x564b3ad05380 2023-09-23T09:15:40.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.070+0000 7fa1f4ff9700 1 -- 172.21.15.82:0/1418328127 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fa1fc004830 con 0x564b3ad05380 2023-09-23T09:15:40.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.070+0000 7fa2272cab80 1 -- 172.21.15.82:0/1418328127 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564b3accf1c0 con 0x564b3ad05380 2023-09-23T09:15:40.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.070+0000 7fa1f4ff9700 1 -- 172.21.15.82:0/1418328127 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa1fc0049f0 con 0x564b3ad05380 2023-09-23T09:15:40.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.070+0000 7fa2272cab80 10 client.26530 fetch_fsmap learned FSMap version 70 2023-09-23T09:15:40.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.070+0000 7fa2272cab80 1 -- 172.21.15.82:0/1418328127 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) v3 -- 0x564b3aa7dde0 con 0x564b3ad05380 2023-09-23T09:15:40.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.070+0000 7fa1f4ff9700 1 -- 172.21.15.82:0/1418328127 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x564b3accf1c0 con 0x564b3ad05380 2023-09-23T09:15:40.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.071+0000 7fa1f4ff9700 1 -- 172.21.15.82:0/1418328127 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 70) v1 ==== 7902+0+0 (secure 0 0 0) 0x7fa1fc01c6a0 con 0x564b3ad05380 2023-09-23T09:15:40.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.071+0000 7fa2272cab80 10 client.26530 fetch_fsmap finished waiting for FSMap version 70 2023-09-23T09:15:40.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.071+0000 7fa2272cab80 10 client.26530 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:15:40.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.071+0000 7fa2272cab80 20 client.26530 populate_metadata read hostname 'smithi082' 2023-09-23T09:15:40.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.071+0000 7fa2272cab80 1 --2- 172.21.15.82:0/1418328127 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x564b3ad19840 0x564b3ad1bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:40.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.071+0000 7fa2272cab80 4 client.26530 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:15:40.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.071+0000 7fa2272cab80 1 -- 172.21.15.82:0/1418328127 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564b3abf7ba0 con 0x564b3ad19840 2023-09-23T09:15:40.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.071+0000 7fa211f9c700 1 --2- 172.21.15.82:0/1418328127 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x564b3ad19840 0x564b3ad1bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:40.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.072+0000 7fa211f9c700 1 --2- 172.21.15.82:0/1418328127 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x564b3ad19840 0x564b3ad1bc60 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d93b5ad22aaaca5 server_cookie=cf41f5eca9ec80f2 in_seq=0 out_seq=0 2023-09-23T09:15:40.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.072+0000 7fa1f4ff9700 10 client.26530 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:15:40.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.072+0000 7fa1f4ff9700 1 -- 172.21.15.82:0/1418328127 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x564b3abf7ba0 con 0x564b3ad19840 2023-09-23T09:15:40.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.072+0000 7fa1f4ff9700 10 client.26530 handle_command_reply: tid=0 2023-09-23T09:15:40.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.073+0000 7fa2272cab80 1 client.26530 shutdown 2023-09-23T09:15:40.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.073+0000 7fa2272cab80 1 -- 172.21.15.82:0/1418328127 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564b3ad05380 msgr2=0x564b3ad08f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:15:40.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.073+0000 7fa2272cab80 1 --2- 172.21.15.82:0/1418328127 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564b3ad05380 0x564b3ad08f00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc012750 tx=0x7fa1fc012b10 comp rx=0 tx=0).stop 2023-09-23T09:15:40.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.073+0000 7fa2272cab80 1 -- 172.21.15.82:0/1418328127 shutdown_connections 2023-09-23T09:15:40.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.073+0000 7fa2272cab80 1 --2- 172.21.15.82:0/1418328127 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x564b3ad19840 0x564b3ad1bc60 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:40.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.073+0000 7fa2272cab80 1 --2- 172.21.15.82:0/1418328127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b3ad05ca0 0x564b3ad095f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:40.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.073+0000 7fa2272cab80 1 --2- 172.21.15.82:0/1418328127 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564b3acffc40 0x564b3ad0bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:40.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.073+0000 7fa2272cab80 1 --2- 172.21.15.82:0/1418328127 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564b3ad05380 0x564b3ad08f00 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:40.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.073+0000 7fa1f4ff9700 0 client.26530 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:15:40.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.073+0000 7fa2272cab80 1 -- 172.21.15.82:0/1418328127 >> 172.21.15.82:0/1418328127 conn(0x564b3ac740e0 msgr2=0x564b3acf4b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:15:40.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.073+0000 7fa2272cab80 1 -- 172.21.15.82:0/1418328127 shutdown_connections 2023-09-23T09:15:40.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.073+0000 7fa2272cab80 1 -- 172.21.15.82:0/1418328127 wait complete. 2023-09-23T09:15:40.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.073+0000 7fa2272cab80 20 client.26530 trim_cache size 0 max 16384 2023-09-23T09:15:40.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.098+0000 7fa2272cab80 1 Processor -- start 2023-09-23T09:15:40.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.098+0000 7fa2272cab80 1 -- start start 2023-09-23T09:15:40.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.098+0000 7fa2272cab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b3acffc40 0x564b3acff700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:40.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.099+0000 7fa2272cab80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564b3ad05380 0x564b3ad087f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:40.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.099+0000 7fa2272cab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564b3ad05ca0 0x564b3ad15a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:40.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.099+0000 7fa2272cab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b3aad3920 con 0x564b3acffc40 2023-09-23T09:15:40.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.099+0000 7fa2272cab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b3acf26d0 con 0x564b3ad05ca0 2023-09-23T09:15:40.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.099+0000 7fa2272cab80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b3ad0c2a0 con 0x564b3ad05380 2023-09-23T09:15:40.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.099+0000 7fa211f9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b3acffc40 0x564b3acff700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:40.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.099+0000 7fa211f9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b3acffc40 0x564b3acff700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48214/0 (socket says 172.21.15.82:48214) 2023-09-23T09:15:40.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.099+0000 7fa211f9c700 1 -- 172.21.15.82:0/2655139419 learned_addr learned my addr 172.21.15.82:0/2655139419 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:15:40.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.099+0000 7fa210f9a700 1 --2- 172.21.15.82:0/2655139419 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564b3ad05380 0x564b3ad087f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:40.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.099+0000 7fa211f9c700 1 --2- 172.21.15.82:0/2655139419 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564b3ad05ca0 0x564b3ad15a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:40.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.099+0000 7fa211f9c700 1 -- 172.21.15.82:0/2655139419 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564b3ad05380 msgr2=0x564b3ad087f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:15:40.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.099+0000 7fa211f9c700 1 --2- 172.21.15.82:0/2655139419 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564b3ad05380 0x564b3ad087f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:40.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.099+0000 7fa211f9c700 1 -- 172.21.15.82:0/2655139419 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564b3ad05ca0 msgr2=0x564b3ad15a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:15:40.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.099+0000 7fa211f9c700 1 --2- 172.21.15.82:0/2655139419 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564b3ad05ca0 0x564b3ad15a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:40.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.099+0000 7fa211f9c700 1 -- 172.21.15.82:0/2655139419 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564b3aa66c60 con 0x564b3acffc40 2023-09-23T09:15:40.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.100+0000 7fa211f9c700 1 --2- 172.21.15.82:0/2655139419 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b3acffc40 0x564b3acff700 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fa204019420 tx=0x7fa204009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4aa0120b7bc03a4 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:15:40.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.100+0000 7fa1f7fff700 1 -- 172.21.15.82:0/2655139419 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa204019ea0 con 0x564b3acffc40 2023-09-23T09:15:40.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.100+0000 7fa1f7fff700 1 -- 172.21.15.82:0/2655139419 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa204030de0 con 0x564b3acffc40 2023-09-23T09:15:40.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.100+0000 7fa1f7fff700 1 -- 172.21.15.82:0/2655139419 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa204030340 con 0x564b3acffc40 2023-09-23T09:15:40.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.101+0000 7fa2272cab80 1 -- 172.21.15.82:0/2655139419 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b3acffc40 msgr2=0x564b3acff700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:15:40.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.101+0000 7fa2272cab80 1 --2- 172.21.15.82:0/2655139419 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b3acffc40 0x564b3acff700 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fa204019420 tx=0x7fa204009920 comp rx=0 tx=0).stop 2023-09-23T09:15:40.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.101+0000 7fa2272cab80 1 -- 172.21.15.82:0/2655139419 shutdown_connections 2023-09-23T09:15:40.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.101+0000 7fa2272cab80 1 --2- 172.21.15.82:0/2655139419 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564b3ad05ca0 0x564b3ad15a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:40.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.101+0000 7fa2272cab80 1 --2- 172.21.15.82:0/2655139419 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b3acffc40 0x564b3acff700 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:40.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.101+0000 7fa2272cab80 1 --2- 172.21.15.82:0/2655139419 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564b3ad05380 0x564b3ad087f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:40.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.101+0000 7fa2272cab80 1 -- 172.21.15.82:0/2655139419 >> 172.21.15.82:0/2655139419 conn(0x564b3ac740e0 msgr2=0x564b3ad00020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:15:40.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.101+0000 7fa2272cab80 1 -- 172.21.15.82:0/2655139419 shutdown_connections 2023-09-23T09:15:40.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.101+0000 7fa2272cab80 1 -- 172.21.15.82:0/2655139419 wait complete. 2023-09-23T09:15:40.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.101+0000 7fa2272cab80 1 -- start start 2023-09-23T09:15:40.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.102+0000 7fa2272cab80 1 Processor -- start 2023-09-23T09:15:40.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.102+0000 7fa2272cab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b3acffc40 0x564b3ad02550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:40.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.102+0000 7fa2272cab80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564b3ad05380 0x564b3ad00e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:40.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.102+0000 7fa2272cab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564b3ad05ca0 0x564b3ad01340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:40.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.103+0000 7fa2272cab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b3ad10ce0 con 0x564b3acffc40 2023-09-23T09:15:40.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.103+0000 7fa2272cab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b3ad01880 con 0x564b3ad05ca0 2023-09-23T09:15:40.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.103+0000 7fa2272cab80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b3ad01a40 con 0x564b3ad05380 2023-09-23T09:15:40.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.103+0000 7fa2272cab80 10 client.0 _ll_register_callbacks cb 0x7fa1fc009f10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:15:40.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.103+0000 7fa211f9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b3acffc40 0x564b3ad02550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:40.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.103+0000 7fa211f9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b3acffc40 0x564b3ad02550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48220/0 (socket says 172.21.15.82:48220) 2023-09-23T09:15:40.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.103+0000 7fa211f9c700 1 -- 172.21.15.82:0/3457824723 learned_addr learned my addr 172.21.15.82:0/3457824723 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:15:40.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.103+0000 7fa210f9a700 1 --2- 172.21.15.82:0/3457824723 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564b3ad05380 0x564b3ad00e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:40.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.103+0000 7fa211f9c700 1 --2- 172.21.15.82:0/3457824723 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564b3ad05ca0 0x564b3ad01340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:40.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.103+0000 7fa211f9c700 1 -- 172.21.15.82:0/3457824723 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564b3ad05380 msgr2=0x564b3ad00e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:15:40.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.103+0000 7fa211f9c700 1 --2- 172.21.15.82:0/3457824723 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564b3ad05380 0x564b3ad00e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:40.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.103+0000 7fa211f9c700 1 -- 172.21.15.82:0/3457824723 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564b3ad05ca0 msgr2=0x564b3ad01340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:15:40.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.103+0000 7fa211f9c700 1 --2- 172.21.15.82:0/3457824723 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564b3ad05ca0 0x564b3ad01340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:40.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.103+0000 7fa211f9c700 1 -- 172.21.15.82:0/3457824723 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564b3aad1630 con 0x564b3acffc40 2023-09-23T09:15:40.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.103+0000 7fa210f9a700 1 --2- 172.21.15.82:0/3457824723 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564b3ad05380 0x564b3ad00e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:15:40.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.104+0000 7fa211f9c700 1 --2- 172.21.15.82:0/3457824723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b3acffc40 0x564b3ad02550 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fa204009670 tx=0x7fa2040095e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c60081ab7e8399aa server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:15:40.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.104+0000 7fa1f4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:15:40.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.104+0000 7fa1f4ff9700 1 -- 172.21.15.82:0/3457824723 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa204019670 con 0x564b3acffc40 2023-09-23T09:15:40.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.104+0000 7fa2272cab80 1 -- 172.21.15.82:0/3457824723 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564b3acf28b0 con 0x564b3acffc40 2023-09-23T09:15:40.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.104+0000 7fa1f4ff9700 1 -- 172.21.15.82:0/3457824723 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fa2040300b0 con 0x564b3acffc40 2023-09-23T09:15:40.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.104+0000 7fa1f4ff9700 1 -- 172.21.15.82:0/3457824723 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa2040197d0 con 0x564b3acffc40 2023-09-23T09:15:40.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.104+0000 7fa2272cab80 10 client.16809 fetch_fsmap learned FSMap version 70 2023-09-23T09:15:40.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.104+0000 7fa2272cab80 1 -- 172.21.15.82:0/3457824723 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) v3 -- 0x564b3aaa4250 con 0x564b3acffc40 2023-09-23T09:15:40.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.105+0000 7fa1f4ff9700 1 -- 172.21.15.82:0/3457824723 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x564b3acf28b0 con 0x564b3acffc40 2023-09-23T09:15:40.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.105+0000 7fa1f4ff9700 1 -- 172.21.15.82:0/3457824723 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 70) v1 ==== 7902+0+0 (secure 0 0 0) 0x7fa204038030 con 0x564b3acffc40 2023-09-23T09:15:40.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.105+0000 7fa2272cab80 10 client.16809 fetch_fsmap finished waiting for FSMap version 70 2023-09-23T09:15:40.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.105+0000 7fa2272cab80 10 client.16809 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:15:40.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.105+0000 7fa2272cab80 20 client.16809 populate_metadata read hostname 'smithi082' 2023-09-23T09:15:40.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.105+0000 7fa2272cab80 1 --2- 172.21.15.82:0/3457824723 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x564b3ad6e6f0 0x564b3ad70b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:15:40.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.105+0000 7fa2272cab80 4 client.16809 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:15:40.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.105+0000 7fa2272cab80 1 -- 172.21.15.82:0/3457824723 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x564b3ac4a970 con 0x564b3ad6e6f0 2023-09-23T09:15:40.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.105+0000 7fa210f9a700 1 --2- 172.21.15.82:0/3457824723 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x564b3ad6e6f0 0x564b3ad70b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:15:40.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.106+0000 7fa1f4ff9700 10 client.16809 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:15:40.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.106+0000 7fa210f9a700 1 --2- 172.21.15.82:0/3457824723 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x564b3ad6e6f0 0x564b3ad70b10 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb5cf4a29a11a208 server_cookie=bc651c53b2bbfab8 in_seq=0 out_seq=0 2023-09-23T09:15:40.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.106+0000 7fa1f4ff9700 1 -- 172.21.15.82:0/3457824723 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x564b3ac4a970 con 0x564b3ad6e6f0 2023-09-23T09:15:40.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.106+0000 7fa1f4ff9700 10 client.16809 handle_command_reply: tid=0 2023-09-23T09:15:40.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.106+0000 7fa2272cab80 1 client.16809 shutdown 2023-09-23T09:15:40.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.106+0000 7fa2272cab80 1 -- 172.21.15.82:0/3457824723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b3acffc40 msgr2=0x564b3ad02550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:15:40.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.106+0000 7fa2272cab80 1 --2- 172.21.15.82:0/3457824723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b3acffc40 0x564b3ad02550 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fa204009670 tx=0x7fa2040095e0 comp rx=0 tx=0).stop 2023-09-23T09:15:40.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.106+0000 7fa2272cab80 1 -- 172.21.15.82:0/3457824723 shutdown_connections 2023-09-23T09:15:40.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.106+0000 7fa2272cab80 1 --2- 172.21.15.82:0/3457824723 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564b3ad05ca0 0x564b3ad01340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:40.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.106+0000 7fa2272cab80 1 --2- 172.21.15.82:0/3457824723 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x564b3ad6e6f0 0x564b3ad70b10 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:40.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.106+0000 7fa2272cab80 1 --2- 172.21.15.82:0/3457824723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b3acffc40 0x564b3ad02550 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:40.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.106+0000 7fa2272cab80 1 --2- 172.21.15.82:0/3457824723 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564b3ad05380 0x564b3ad00e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:40.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.106+0000 7fa1f4ff9700 0 client.16809 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:15:40.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.106+0000 7fa2272cab80 1 -- 172.21.15.82:0/3457824723 >> 172.21.15.82:0/3457824723 conn(0x564b3ac740e0 msgr2=0x564b3ad14e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:15:40.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.106+0000 7fa2272cab80 1 -- 172.21.15.82:0/3457824723 shutdown_connections 2023-09-23T09:15:40.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.107+0000 7fa2272cab80 1 -- 172.21.15.82:0/3457824723 wait complete. 2023-09-23T09:15:40.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.107+0000 7fa2272cab80 20 client.16809 trim_cache size 0 max 16384 2023-09-23T09:15:40.113 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:15:40.113 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-23T09:15:40.113 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:15:40.113 INFO:teuthology.orchestra.run.smithi082.stdout: "047cbc72-e254-4787-b038-382de9c1a9a4": { 2023-09-23T09:15:40.113 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:15:40.113 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "047cbc72-e254-4787-b038-382de9c1a9a4", 2023-09-23T09:15:40.113 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:15:40.113 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:15:40.114 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:15:40.114 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:15:40.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.107+0000 7fa2139ff700 1 -- 172.21.15.82:0/3239023355 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fa1f80a0140 msgr2=0x7fa1f80a2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:15:40.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.107+0000 7fa2139ff700 1 --2- 172.21.15.82:0/3239023355 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fa1f80a0140 0x7fa1f80a2600 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa2080c99d0 tx=0x7fa2080cfce0 comp rx=0 tx=0).stop 2023-09-23T09:15:40.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.107+0000 7fa2139ff700 1 -- 172.21.15.82:0/3239023355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa20c101a30 msgr2=0x7fa20c0ff680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:15:40.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.107+0000 7fa2139ff700 1 --2- 172.21.15.82:0/3239023355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa20c101a30 0x7fa20c0ff680 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa208009810 tx=0x7fa20800fa00 comp rx=0 tx=0).stop 2023-09-23T09:15:40.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.107+0000 7fa2139ff700 1 -- 172.21.15.82:0/3239023355 shutdown_connections 2023-09-23T09:15:40.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.107+0000 7fa2139ff700 1 --2- 172.21.15.82:0/3239023355 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fa1f80a0140 0x7fa1f80a2600 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:40.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.107+0000 7fa2139ff700 1 --2- 172.21.15.82:0/3239023355 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa20c10ae50 0x7fa20c1a4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:40.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.107+0000 7fa2139ff700 1 --2- 172.21.15.82:0/3239023355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa20c101a30 0x7fa20c0ff680 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:40.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.107+0000 7fa2139ff700 1 --2- 172.21.15.82:0/3239023355 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa20c102350 0x7fa20c0ffbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:15:40.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.107+0000 7fa2139ff700 1 -- 172.21.15.82:0/3239023355 >> 172.21.15.82:0/3239023355 conn(0x7fa20c0fb270 msgr2=0x7fa20c0fbee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:15:40.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.107+0000 7fa2139ff700 1 -- 172.21.15.82:0/3239023355 shutdown_connections 2023-09-23T09:15:40.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:15:40.108+0000 7fa2139ff700 1 -- 172.21.15.82:0/3239023355 wait complete. 2023-09-23T09:15:40.130 INFO:tasks.cephfs.filesystem:scrub status for tag:047cbc72-e254-4787-b038-382de9c1a9a4 - {'path': '/', 'tag': '047cbc72-e254-4787-b038-382de9c1a9a4', 'options': 'recursive,force'} 2023-09-23T09:15:41.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:15:40 smithi135 ceph-mon[99205]: pgmap v590: 97 pgs: 97 active+clean; 9.7 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 27 MiB/s wr, 98 op/s 2023-09-23T09:15:41.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:15:40 smithi135 ceph-mon[99205]: scrub queued for path: / 2023-09-23T09:15:41.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:15:40 smithi135 ceph-mon[99205]: scrub summary: idle+waiting paths [/] 2023-09-23T09:15:41.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:15:40 smithi135 ceph-mon[99205]: scrub summary: active paths [/] 2023-09-23T09:15:41.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:15:40 smithi135 ceph-mon[99205]: scrub summary: active paths [/] 2023-09-23T09:15:41.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:15:40 smithi135 ceph-mon[99205]: scrub summary: active paths [/] 2023-09-23T09:15:41.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:15:40 smithi135 ceph-mon[99205]: scrub summary: idle+waiting paths [/] 2023-09-23T09:15:41.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:15:40 smithi135 ceph-mon[99205]: scrub summary: active paths [/] 2023-09-23T09:15:41.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:15:40 smithi135 ceph-mon[99205]: scrub summary: active paths [/] 2023-09-23T09:15:41.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:15:40 smithi135 ceph-mon[99205]: scrub summary: active paths [/] 2023-09-23T09:15:41.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:15:40 smithi135 ceph-mon[99205]: scrub summary: idle+waiting paths [/] 2023-09-23T09:15:41.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:15:40 smithi135 ceph-mon[99205]: scrub summary: idle+waiting paths [/] 2023-09-23T09:15:41.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:15:40 smithi135 ceph-mon[99205]: scrub summary: idle+waiting paths [/] 2023-09-23T09:15:41.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:15:40 smithi135 ceph-mon[99205]: scrub summary: idle+waiting paths [/] 2023-09-23T09:15:41.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:15:40 smithi082 ceph-mon[97694]: pgmap v590: 97 pgs: 97 active+clean; 9.7 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 27 MiB/s wr, 98 op/s 2023-09-23T09:15:41.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:15:40 smithi082 ceph-mon[97694]: scrub queued for path: / 2023-09-23T09:15:41.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:15:40 smithi082 ceph-mon[97694]: scrub summary: idle+waiting paths [/] 2023-09-23T09:15:41.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:15:40 smithi082 ceph-mon[97694]: scrub summary: active paths [/] 2023-09-23T09:15:41.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:15:40 smithi082 ceph-mon[97694]: scrub summary: active paths [/] 2023-09-23T09:15:41.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:15:40 smithi082 ceph-mon[97694]: scrub summary: active paths [/] 2023-09-23T09:15:41.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:15:40 smithi082 ceph-mon[97694]: scrub summary: idle+waiting paths [/] 2023-09-23T09:15:41.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:15:40 smithi082 ceph-mon[97694]: scrub summary: active paths [/] 2023-09-23T09:15:41.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:15:40 smithi082 ceph-mon[97694]: scrub summary: active paths [/] 2023-09-23T09:15:41.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:15:40 smithi082 ceph-mon[97694]: scrub summary: active paths [/] 2023-09-23T09:15:41.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:15:40 smithi082 ceph-mon[97694]: scrub summary: idle+waiting paths [/] 2023-09-23T09:15:41.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:15:40 smithi082 ceph-mon[97694]: scrub summary: idle+waiting paths [/] 2023-09-23T09:15:41.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:15:40 smithi082 ceph-mon[97694]: scrub summary: idle+waiting paths [/] 2023-09-23T09:15:41.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:15:40 smithi082 ceph-mon[97694]: scrub summary: idle+waiting paths [/] 2023-09-23T09:15:41.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:15:40 smithi161 ceph-mon[99580]: pgmap v590: 97 pgs: 97 active+clean; 9.7 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 27 MiB/s wr, 98 op/s 2023-09-23T09:15:41.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:15:40 smithi161 ceph-mon[99580]: scrub queued for path: / 2023-09-23T09:15:41.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:15:40 smithi161 ceph-mon[99580]: scrub summary: idle+waiting paths [/] 2023-09-23T09:15:41.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:15:40 smithi161 ceph-mon[99580]: scrub summary: active paths [/] 2023-09-23T09:15:41.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:15:40 smithi161 ceph-mon[99580]: scrub summary: active paths [/] 2023-09-23T09:15:41.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:15:40 smithi161 ceph-mon[99580]: scrub summary: active paths [/] 2023-09-23T09:15:41.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:15:40 smithi161 ceph-mon[99580]: scrub summary: idle+waiting paths [/] 2023-09-23T09:15:41.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:15:40 smithi161 ceph-mon[99580]: scrub summary: active paths [/] 2023-09-23T09:15:41.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:15:40 smithi161 ceph-mon[99580]: scrub summary: active paths [/] 2023-09-23T09:15:41.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:15:40 smithi161 ceph-mon[99580]: scrub summary: active paths [/] 2023-09-23T09:15:41.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:15:40 smithi161 ceph-mon[99580]: scrub summary: idle+waiting paths [/] 2023-09-23T09:15:41.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:15:40 smithi161 ceph-mon[99580]: scrub summary: idle+waiting paths [/] 2023-09-23T09:15:41.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:15:40 smithi161 ceph-mon[99580]: scrub summary: idle+waiting paths [/] 2023-09-23T09:15:41.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:15:40 smithi161 ceph-mon[99580]: scrub summary: idle+waiting paths [/] 2023-09-23T09:15:43.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:15:42 smithi135 ceph-mon[99205]: pgmap v591: 97 pgs: 97 active+clean; 9.7 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 17 MiB/s wr, 63 op/s 2023-09-23T09:15:43.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:15:42 smithi082 ceph-mon[97694]: pgmap v591: 97 pgs: 97 active+clean; 9.7 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 17 MiB/s wr, 63 op/s 2023-09-23T09:15:43.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:15:42 smithi161 ceph-mon[99580]: pgmap v591: 97 pgs: 97 active+clean; 9.7 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 17 MiB/s wr, 63 op/s 2023-09-23T09:15:44.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:15:43 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:15:44.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:15:43 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:15:44.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:15:43 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:15:45.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:15:44 smithi135 ceph-mon[99205]: pgmap v592: 97 pgs: 97 active+clean; 9.7 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 17 MiB/s wr, 63 op/s 2023-09-23T09:15:45.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:15:44 smithi082 ceph-mon[97694]: pgmap v592: 97 pgs: 97 active+clean; 9.7 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 17 MiB/s wr, 63 op/s 2023-09-23T09:15:45.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:15:44 smithi161 ceph-mon[99580]: pgmap v592: 97 pgs: 97 active+clean; 9.7 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 17 MiB/s wr, 63 op/s 2023-09-23T09:15:47.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:15:46 smithi135 ceph-mon[99205]: pgmap v593: 97 pgs: 97 active+clean; 9.9 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 223 KiB/s rd, 30 MiB/s wr, 77 op/s 2023-09-23T09:15:47.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:15:46 smithi082 ceph-mon[97694]: pgmap v593: 97 pgs: 97 active+clean; 9.9 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 223 KiB/s rd, 30 MiB/s wr, 77 op/s 2023-09-23T09:15:47.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:15:46 smithi161 ceph-mon[99580]: pgmap v593: 97 pgs: 97 active+clean; 9.9 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 223 KiB/s rd, 30 MiB/s wr, 77 op/s 2023-09-23T09:15:48.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:15:47 smithi082 ceph-mon[97694]: pgmap v594: 97 pgs: 97 active+clean; 9.9 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 24 MiB/s wr, 52 op/s 2023-09-23T09:15:48.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:15:47 smithi161 ceph-mon[99580]: pgmap v594: 97 pgs: 97 active+clean; 9.9 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 24 MiB/s wr, 52 op/s 2023-09-23T09:15:48.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:15:47 smithi135 ceph-mon[99205]: pgmap v594: 97 pgs: 97 active+clean; 9.9 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 24 MiB/s wr, 52 op/s 2023-09-23T09:15:50.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:15:49 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:15:50.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:15:49 smithi082 ceph-mon[97694]: pgmap v595: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 37 MiB/s wr, 65 op/s 2023-09-23T09:15:50.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:15:49 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:15:50.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:15:49 smithi161 ceph-mon[99580]: pgmap v595: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 37 MiB/s wr, 65 op/s 2023-09-23T09:15:50.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:15:49 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:15:50.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:15:49 smithi135 ceph-mon[99205]: pgmap v595: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 37 MiB/s wr, 65 op/s 2023-09-23T09:15:53.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:15:52 smithi135 ceph-mon[99205]: pgmap v596: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 26 MiB/s wr, 27 op/s 2023-09-23T09:15:53.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:15:52 smithi082 ceph-mon[97694]: pgmap v596: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 26 MiB/s wr, 27 op/s 2023-09-23T09:15:53.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:15:52 smithi161 ceph-mon[99580]: pgmap v596: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 26 MiB/s wr, 27 op/s 2023-09-23T09:15:55.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:15:54 smithi135 ceph-mon[99205]: pgmap v597: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 26 MiB/s wr, 27 op/s 2023-09-23T09:15:55.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:15:54 smithi082 ceph-mon[97694]: pgmap v597: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 26 MiB/s wr, 27 op/s 2023-09-23T09:15:55.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:15:54 smithi161 ceph-mon[99580]: pgmap v597: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 26 MiB/s wr, 27 op/s 2023-09-23T09:15:57.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:15:56 smithi135 ceph-mon[99205]: pgmap v598: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 39 MiB/s wr, 41 op/s 2023-09-23T09:15:57.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:15:56 smithi082 ceph-mon[97694]: pgmap v598: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 39 MiB/s wr, 41 op/s 2023-09-23T09:15:57.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:15:56 smithi161 ceph-mon[99580]: pgmap v598: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 39 MiB/s wr, 41 op/s 2023-09-23T09:15:59.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:15:58 smithi135 ceph-mon[99205]: pgmap v599: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 26 MiB/s wr, 26 op/s 2023-09-23T09:15:59.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:15:58 smithi082 ceph-mon[97694]: pgmap v599: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 26 MiB/s wr, 26 op/s 2023-09-23T09:15:59.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:15:58 smithi161 ceph-mon[99580]: pgmap v599: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 26 MiB/s wr, 26 op/s 2023-09-23T09:16:01.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:16:00 smithi135 ceph-mon[99205]: pgmap v600: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 39 MiB/s wr, 39 op/s 2023-09-23T09:16:01.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:16:00 smithi082 ceph-mon[97694]: pgmap v600: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 39 MiB/s wr, 39 op/s 2023-09-23T09:16:01.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:16:00 smithi161 ceph-mon[99580]: pgmap v600: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 39 MiB/s wr, 39 op/s 2023-09-23T09:16:03.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:16:02 smithi135 ceph-mon[99205]: pgmap v601: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 26 MiB/s wr, 27 op/s 2023-09-23T09:16:03.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:16:02 smithi082 ceph-mon[97694]: pgmap v601: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 26 MiB/s wr, 27 op/s 2023-09-23T09:16:03.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:16:02 smithi161 ceph-mon[99580]: pgmap v601: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 26 MiB/s wr, 27 op/s 2023-09-23T09:16:05.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:16:04 smithi135 ceph-mon[99205]: pgmap v602: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 26 MiB/s wr, 27 op/s 2023-09-23T09:16:05.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:16:04 smithi082 ceph-mon[97694]: pgmap v602: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 26 MiB/s wr, 27 op/s 2023-09-23T09:16:05.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:16:04 smithi161 ceph-mon[99580]: pgmap v602: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 26 MiB/s wr, 27 op/s 2023-09-23T09:16:07.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:16:06 smithi135 ceph-mon[99205]: pgmap v603: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 39 MiB/s wr, 56 op/s 2023-09-23T09:16:07.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:16:06 smithi082 ceph-mon[97694]: pgmap v603: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 39 MiB/s wr, 56 op/s 2023-09-23T09:16:07.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:16:06 smithi161 ceph-mon[99580]: pgmap v603: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 39 MiB/s wr, 56 op/s 2023-09-23T09:16:08.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:16:07 smithi135 ceph-mon[99205]: osdmap e114: 12 total, 12 up, 12 in 2023-09-23T09:16:08.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:16:07 smithi082 ceph-mon[97694]: osdmap e114: 12 total, 12 up, 12 in 2023-09-23T09:16:08.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:16:07 smithi161 ceph-mon[99580]: osdmap e114: 12 total, 12 up, 12 in 2023-09-23T09:16:09.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:16:08 smithi135 ceph-mon[99205]: pgmap v605: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 32 MiB/s wr, 50 op/s 2023-09-23T09:16:09.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:16:08 smithi082 ceph-mon[97694]: pgmap v605: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 32 MiB/s wr, 50 op/s 2023-09-23T09:16:09.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:16:08 smithi161 ceph-mon[99580]: pgmap v605: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 32 MiB/s wr, 50 op/s 2023-09-23T09:16:10.130 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:16:10.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.359+0000 7f6bd17ff700 1 -- 172.21.15.82:0/645594225 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6bcc1068a0 msgr2=0x7f6bcc106c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:16:10.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.359+0000 7f6bd17ff700 1 --2- 172.21.15.82:0/645594225 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6bcc1068a0 0x7f6bcc106c80 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc009990 tx=0x7f6bbc009ca0 comp rx=0 tx=0).stop 2023-09-23T09:16:10.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.359+0000 7f6bd17ff700 1 -- 172.21.15.82:0/645594225 shutdown_connections 2023-09-23T09:16:10.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.359+0000 7f6bd17ff700 1 --2- 172.21.15.82:0/645594225 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6bcc101250 0x7f6bcc10d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:16:10.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.359+0000 7f6bd17ff700 1 --2- 172.21.15.82:0/645594225 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6bcc1068a0 0x7f6bcc106c80 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:16:10.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.359+0000 7f6bd17ff700 1 --2- 172.21.15.82:0/645594225 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6bcc100890 0x7f6bcc100d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:16:10.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.359+0000 7f6bd17ff700 1 -- 172.21.15.82:0/645594225 >> 172.21.15.82:0/645594225 conn(0x7f6bcc0fc380 msgr2=0x7f6bcc0fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:16:10.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.359+0000 7f6bd17ff700 1 -- 172.21.15.82:0/645594225 shutdown_connections 2023-09-23T09:16:10.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.359+0000 7f6bd17ff700 1 -- 172.21.15.82:0/645594225 wait complete. 2023-09-23T09:16:10.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.360+0000 7f6bd17ff700 1 Processor -- start 2023-09-23T09:16:10.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.360+0000 7f6bd17ff700 1 -- start start 2023-09-23T09:16:10.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.360+0000 7f6bd17ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6bcc100890 0x7f6bcc19c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:16:10.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.361+0000 7f6bd17ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6bcc101250 0x7f6bcc19cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:16:10.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.361+0000 7f6bd17ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6bcc1068a0 0x7f6bcc196710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:16:10.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.361+0000 7f6bd17ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bcc196d80 con 0x7f6bcc1068a0 2023-09-23T09:16:10.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.361+0000 7f6bd17ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bcc196ef0 con 0x7f6bcc100890 2023-09-23T09:16:10.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.361+0000 7f6bd17ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bcc1970b0 con 0x7f6bcc101250 2023-09-23T09:16:10.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.361+0000 7f6bca7fc700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6bcc101250 0x7f6bcc19cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:16:10.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.361+0000 7f6bcb7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6bcc1068a0 0x7f6bcc196710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:16:10.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.361+0000 7f6bcaffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6bcc100890 0x7f6bcc19c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:16:10.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.361+0000 7f6bca7fc700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6bcc101250 0x7f6bcc19cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:43788/0 (socket says 172.21.15.82:43788) 2023-09-23T09:16:10.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.361+0000 7f6bca7fc700 1 -- 172.21.15.82:0/3983036369 learned_addr learned my addr 172.21.15.82:0/3983036369 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:16:10.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.361+0000 7f6bca7fc700 1 -- 172.21.15.82:0/3983036369 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6bcc100890 msgr2=0x7f6bcc19c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:16:10.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.361+0000 7f6bca7fc700 1 --2- 172.21.15.82:0/3983036369 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6bcc100890 0x7f6bcc19c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:16:10.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.361+0000 7f6bca7fc700 1 -- 172.21.15.82:0/3983036369 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6bcc1068a0 msgr2=0x7f6bcc196710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:16:10.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.361+0000 7f6bca7fc700 1 --2- 172.21.15.82:0/3983036369 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6bcc1068a0 0x7f6bcc196710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:16:10.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.361+0000 7f6bca7fc700 1 -- 172.21.15.82:0/3983036369 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bc0009520 con 0x7f6bcc101250 2023-09-23T09:16:10.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.361+0000 7f6bcaffd700 1 --2- 172.21.15.82:0/3983036369 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6bcc100890 0x7f6bcc19c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:16:10.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.362+0000 7f6bca7fc700 1 --2- 172.21.15.82:0/3983036369 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6bcc101250 0x7f6bcc19cb90 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6bc000eb30 tx=0x7f6bc000ee40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:16:10.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.362+0000 7f6bb3fff700 1 -- 172.21.15.82:0/3983036369 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc0009880 con 0x7f6bcc101250 2023-09-23T09:16:10.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.362+0000 7f6bd17ff700 1 -- 172.21.15.82:0/3983036369 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bbc0095f0 con 0x7f6bcc101250 2023-09-23T09:16:10.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.362+0000 7f6bb3fff700 1 -- 172.21.15.82:0/3983036369 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6bc00044b0 con 0x7f6bcc101250 2023-09-23T09:16:10.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.362+0000 7f6bb3fff700 1 -- 172.21.15.82:0/3983036369 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc0003ce0 con 0x7f6bcc101250 2023-09-23T09:16:10.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.362+0000 7f6bd17ff700 1 -- 172.21.15.82:0/3983036369 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bcc197580 con 0x7f6bcc101250 2023-09-23T09:16:10.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.365+0000 7f6bb3fff700 1 -- 172.21.15.82:0/3983036369 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f6bc0003e40 con 0x7f6bcc101250 2023-09-23T09:16:10.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.367+0000 7f6be521fb80 1 Processor -- start 2023-09-23T09:16:10.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.367+0000 7f6be521fb80 1 -- start start 2023-09-23T09:16:10.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.367+0000 7f6be521fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56146afdc380 0x56146afdc760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:16:10.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.367+0000 7f6be521fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56146afdcca0 0x56146afd6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:16:10.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.367+0000 7f6be521fb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56146afd6c40 0x56146afd70a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:16:10.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.368+0000 7f6be521fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56146af3e7b0 con 0x56146afdc380 2023-09-23T09:16:10.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.368+0000 7f6be521fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56146af2f780 con 0x56146afdcca0 2023-09-23T09:16:10.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.368+0000 7f6be521fb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x56146af2d0a0 con 0x56146afd6c40 2023-09-23T09:16:10.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.368+0000 7f6bcb7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56146afdc380 0x56146afdc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:16:10.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.368+0000 7f6bb3fff700 1 --2- 172.21.15.82:0/3983036369 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f6bb40a00c0 0x7f6bb40a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:16:10.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.368+0000 7f6bcb7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56146afdc380 0x56146afdc760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34350/0 (socket says 172.21.15.82:34350) 2023-09-23T09:16:10.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.368+0000 7f6bcb7fe700 1 -- 172.21.15.82:0/420272467 learned_addr learned my addr 172.21.15.82:0/420272467 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:16:10.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.368+0000 7f6bcaffd700 1 --2- 172.21.15.82:0/420272467 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56146afdcca0 0x56146afd6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:16:10.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.368+0000 7f6bca7fc700 1 --2- 172.21.15.82:0/420272467 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56146afd6c40 0x56146afd70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:16:10.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.368+0000 7f6bb3fff700 1 -- 172.21.15.82:0/3983036369 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 8557+0+0 (secure 0 0 0) 0x7f6bc0014070 con 0x7f6bcc101250 2023-09-23T09:16:10.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.368+0000 7f6bcaffd700 1 -- 172.21.15.82:0/420272467 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56146afd6c40 msgr2=0x56146afd70a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:16:10.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.368+0000 7f6bcaffd700 1 --2- 172.21.15.82:0/420272467 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56146afd6c40 0x56146afd70a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:16:10.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.368+0000 7f6bcaffd700 1 -- 172.21.15.82:0/420272467 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56146afdc380 msgr2=0x56146afdc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:16:10.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.368+0000 7f6bcaffd700 1 --2- 172.21.15.82:0/420272467 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56146afdc380 0x56146afdc760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:16:10.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.368+0000 7f6bcb7fe700 1 --2- 172.21.15.82:0/3983036369 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f6bb40a00c0 0x7f6bb40a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:16:10.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.368+0000 7f6bcaffd700 1 -- 172.21.15.82:0/420272467 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56146ada8630 con 0x56146afdcca0 2023-09-23T09:16:10.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.369+0000 7f6bcaffd700 1 --2- 172.21.15.82:0/420272467 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56146afdcca0 0x56146afd6700 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc005910 tx=0x7f6bbc005f00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=455da507f8861a10 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:16:10.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.369+0000 7f6bb17fa700 1 -- 172.21.15.82:0/420272467 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bbc01d050 con 0x56146afdcca0 2023-09-23T09:16:10.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.369+0000 7f6bb17fa700 1 -- 172.21.15.82:0/420272467 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6bbc01e040 con 0x56146afdcca0 2023-09-23T09:16:10.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.369+0000 7f6bb17fa700 1 -- 172.21.15.82:0/420272467 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bbc0053b0 con 0x56146afdcca0 2023-09-23T09:16:10.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.369+0000 7f6bcb7fe700 1 --2- 172.21.15.82:0/3983036369 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f6bb40a00c0 0x7f6bb40a2580 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6bc40060b0 tx=0x7f6bc4004b40 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:16:10.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.370+0000 7f6be521fb80 1 -- 172.21.15.82:0/420272467 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56146afdcca0 msgr2=0x56146afd6700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:16:10.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.370+0000 7f6be521fb80 1 --2- 172.21.15.82:0/420272467 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56146afdcca0 0x56146afd6700 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc005910 tx=0x7f6bbc005f00 comp rx=0 tx=0).stop 2023-09-23T09:16:10.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.370+0000 7f6be521fb80 1 -- 172.21.15.82:0/420272467 shutdown_connections 2023-09-23T09:16:10.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.370+0000 7f6be521fb80 1 --2- 172.21.15.82:0/420272467 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56146afd6c40 0x56146afd70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:16:10.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.370+0000 7f6be521fb80 1 --2- 172.21.15.82:0/420272467 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56146afdc380 0x56146afdc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:16:10.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.370+0000 7f6be521fb80 1 --2- 172.21.15.82:0/420272467 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56146afdcca0 0x56146afd6700 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:16:10.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.370+0000 7f6be521fb80 1 -- 172.21.15.82:0/420272467 >> 172.21.15.82:0/420272467 conn(0x56146af4b0e0 msgr2=0x56146afd1410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:16:10.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.370+0000 7f6be521fb80 1 -- 172.21.15.82:0/420272467 shutdown_connections 2023-09-23T09:16:10.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.370+0000 7f6be521fb80 1 -- 172.21.15.82:0/420272467 wait complete. 2023-09-23T09:16:10.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.371+0000 7f6be521fb80 1 -- start start 2023-09-23T09:16:10.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.371+0000 7f6be521fb80 1 Processor -- start 2023-09-23T09:16:10.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.371+0000 7f6be521fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56146afd6c40 0x56146afe2c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:16:10.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.371+0000 7f6be521fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56146afdc380 0x56146afdff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:16:10.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.371+0000 7f6be521fb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56146afdcca0 0x56146afe0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:16:10.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.371+0000 7f6be521fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56146af28990 con 0x56146afd6c40 2023-09-23T09:16:10.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.371+0000 7f6be521fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56146aec6bb0 con 0x56146afdc380 2023-09-23T09:16:10.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.371+0000 7f6be521fb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x56146aec68b0 con 0x56146afdcca0 2023-09-23T09:16:10.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.371+0000 7f6be521fb80 10 client.0 _ll_register_callbacks cb 0x56146ae10a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:16:10.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.372+0000 7f6bcaffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56146afd6c40 0x56146afe2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:16:10.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.372+0000 7f6bcaffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56146afd6c40 0x56146afe2c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34356/0 (socket says 172.21.15.82:34356) 2023-09-23T09:16:10.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.372+0000 7f6bcaffd700 1 -- 172.21.15.82:0/175301556 learned_addr learned my addr 172.21.15.82:0/175301556 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:16:10.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.372+0000 7f6bcb7fe700 1 --2- 172.21.15.82:0/175301556 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56146afdcca0 0x56146afe0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:16:10.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.372+0000 7f6bca7fc700 1 --2- 172.21.15.82:0/175301556 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56146afdc380 0x56146afdff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:16:10.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.372+0000 7f6bcb7fe700 1 -- 172.21.15.82:0/175301556 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56146afdc380 msgr2=0x56146afdff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:16:10.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.372+0000 7f6bcb7fe700 1 --2- 172.21.15.82:0/175301556 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56146afdc380 0x56146afdff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:16:10.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.372+0000 7f6bcb7fe700 1 -- 172.21.15.82:0/175301556 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56146afd6c40 msgr2=0x56146afe2c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:16:10.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.372+0000 7f6bcb7fe700 1 --2- 172.21.15.82:0/175301556 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56146afd6c40 0x56146afe2c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:16:10.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.372+0000 7f6bcb7fe700 1 -- 172.21.15.82:0/175301556 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bcc10e060 con 0x56146afdcca0 2023-09-23T09:16:10.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.372+0000 7f6bcaffd700 1 --2- 172.21.15.82:0/175301556 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56146afd6c40 0x56146afe2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:16:10.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.372+0000 7f6bcb7fe700 1 --2- 172.21.15.82:0/175301556 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56146afdcca0 0x56146afe0670 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6bc40077e0 tx=0x7f6bc4004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=61ad1bf0d157d174 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:16:10.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.372+0000 7f6baeff5700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T09:16:10.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.373+0000 7f6baeff5700 1 -- 172.21.15.82:0/175301556 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc400e040 con 0x56146afdcca0 2023-09-23T09:16:10.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.373+0000 7f6be521fb80 1 -- 172.21.15.82:0/175301556 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56146afa61c0 con 0x56146afdcca0 2023-09-23T09:16:10.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.373+0000 7f6baeff5700 1 -- 172.21.15.82:0/175301556 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(114..114 src has 1..114) v4 ==== 8557+0+0 (secure 0 0 0) 0x7f6bc4007e10 con 0x56146afdcca0 2023-09-23T09:16:10.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.373+0000 7f6baeff5700 1 -- 172.21.15.82:0/175301556 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6bc4003a00 con 0x56146afdcca0 2023-09-23T09:16:10.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.373+0000 7f6be521fb80 10 client.26548 fetch_fsmap learned FSMap version 72 2023-09-23T09:16:10.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.373+0000 7f6be521fb80 1 -- 172.21.15.82:0/175301556 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=4+}) v3 -- 0x56146ad54de0 con 0x56146afdcca0 2023-09-23T09:16:10.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.373+0000 7f6baeff5700 1 -- 172.21.15.82:0/175301556 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56146afa61c0 con 0x56146afdcca0 2023-09-23T09:16:10.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.373+0000 7f6baeff5700 1 -- 172.21.15.82:0/175301556 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 72) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f6bc4027420 con 0x56146afdcca0 2023-09-23T09:16:10.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.374+0000 7f6be521fb80 10 client.26548 fetch_fsmap finished waiting for FSMap version 72 2023-09-23T09:16:10.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.374+0000 7f6be521fb80 10 client.26548 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:16:10.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.374+0000 7f6be521fb80 20 client.26548 populate_metadata read hostname 'smithi082' 2023-09-23T09:16:10.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.374+0000 7f6be521fb80 1 --2- 172.21.15.82:0/175301556 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56146aff07c0 0x56146aff2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:16:10.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.374+0000 7f6be521fb80 4 client.26548 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:16:10.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.374+0000 7f6be521fb80 1 -- 172.21.15.82:0/175301556 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56146aeceba0 con 0x56146aff07c0 2023-09-23T09:16:10.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.374+0000 7f6bcaffd700 1 --2- 172.21.15.82:0/175301556 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56146aff07c0 0x56146aff2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:16:10.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.375+0000 7f6bcaffd700 1 --2- 172.21.15.82:0/175301556 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56146aff07c0 0x56146aff2be0 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=751fa6da8d89cb0b server_cookie=720252cda50cd517 in_seq=0 out_seq=0 2023-09-23T09:16:10.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.375+0000 7f6baeff5700 10 client.26548 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:16:10.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.375+0000 7f6baeff5700 1 -- 172.21.15.82:0/175301556 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56146aeceba0 con 0x56146aff07c0 2023-09-23T09:16:10.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.375+0000 7f6baeff5700 10 client.26548 handle_command_reply: tid=0 2023-09-23T09:16:10.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.375+0000 7f6be521fb80 1 client.26548 shutdown 2023-09-23T09:16:10.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.375+0000 7f6be521fb80 1 -- 172.21.15.82:0/175301556 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56146afdcca0 msgr2=0x56146afe0670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:16:10.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.375+0000 7f6be521fb80 1 --2- 172.21.15.82:0/175301556 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56146afdcca0 0x56146afe0670 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6bc40077e0 tx=0x7f6bc4004ad0 comp rx=0 tx=0).stop 2023-09-23T09:16:10.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.376+0000 7f6be521fb80 1 -- 172.21.15.82:0/175301556 shutdown_connections 2023-09-23T09:16:10.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.376+0000 7f6be521fb80 1 --2- 172.21.15.82:0/175301556 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56146afdcca0 0x56146afe0670 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:16:10.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.376+0000 7f6be521fb80 1 --2- 172.21.15.82:0/175301556 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56146aff07c0 0x56146aff2be0 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:16:10.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.376+0000 7f6be521fb80 1 --2- 172.21.15.82:0/175301556 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56146afd6c40 0x56146afe2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:16:10.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.376+0000 7f6be521fb80 1 --2- 172.21.15.82:0/175301556 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56146afdc380 0x56146afdff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:16:10.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.376+0000 7f6be521fb80 1 -- 172.21.15.82:0/175301556 >> 172.21.15.82:0/175301556 conn(0x56146af4b0e0 msgr2=0x56146afcbb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:16:10.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.376+0000 7f6baeff5700 0 client.26548 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:16:10.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.376+0000 7f6be521fb80 1 -- 172.21.15.82:0/175301556 shutdown_connections 2023-09-23T09:16:10.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.376+0000 7f6be521fb80 1 -- 172.21.15.82:0/175301556 wait complete. 2023-09-23T09:16:10.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.376+0000 7f6be521fb80 20 client.26548 trim_cache size 0 max 16384 2023-09-23T09:16:10.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.395+0000 7f6be521fb80 1 Processor -- start 2023-09-23T09:16:10.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.395+0000 7f6be521fb80 1 -- start start 2023-09-23T09:16:10.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.395+0000 7f6be521fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56146afd6c40 0x56146afe27e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:16:10.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.395+0000 7f6be521fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56146afdc380 0x56146afdf6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:16:10.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.395+0000 7f6be521fb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56146afdcca0 0x56146afdfc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:16:10.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.395+0000 7f6be521fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56146adaa920 con 0x56146afd6c40 2023-09-23T09:16:10.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.395+0000 7f6be521fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56146afdcaa0 con 0x56146afdc380 2023-09-23T09:16:10.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.395+0000 7f6be521fb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x56146afde490 con 0x56146afdcca0 2023-09-23T09:16:10.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.396+0000 7f6bcaffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56146afd6c40 0x56146afe27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:16:10.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.396+0000 7f6bca7fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56146afdc380 0x56146afdf6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:16:10.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.396+0000 7f6bcb7fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56146afdcca0 0x56146afdfc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:16:10.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.396+0000 7f6bcaffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56146afd6c40 0x56146afe27e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34360/0 (socket says 172.21.15.82:34360) 2023-09-23T09:16:10.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.396+0000 7f6bca7fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56146afdc380 0x56146afdf6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:51244/0 (socket says 172.21.15.82:51244) 2023-09-23T09:16:10.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.396+0000 7f6bcaffd700 1 -- 172.21.15.82:0/411157255 learned_addr learned my addr 172.21.15.82:0/411157255 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:16:10.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.396+0000 7f6bcb7fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56146afdcca0 0x56146afdfc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:43820/0 (socket says 172.21.15.82:43820) 2023-09-23T09:16:10.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.396+0000 7f6bcb7fe700 1 -- 172.21.15.82:0/411157255 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56146afdc380 msgr2=0x56146afdf6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:16:10.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.396+0000 7f6bcb7fe700 1 --2- 172.21.15.82:0/411157255 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56146afdc380 0x56146afdf6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:16:10.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.396+0000 7f6bcb7fe700 1 -- 172.21.15.82:0/411157255 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56146afd6c40 msgr2=0x56146afe27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:16:10.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.396+0000 7f6bcb7fe700 1 --2- 172.21.15.82:0/411157255 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56146afd6c40 0x56146afe27e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:16:10.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.396+0000 7f6bcb7fe700 1 -- 172.21.15.82:0/411157255 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56146afcadf0 con 0x56146afdcca0 2023-09-23T09:16:10.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.396+0000 7f6bcb7fe700 1 --2- 172.21.15.82:0/411157255 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56146afdcca0 0x56146afdfc30 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6bc4009550 tx=0x7f6bc40073e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca1fdcffbb50002c server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:16:10.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.396+0000 7f6bb1ffb700 1 -- 172.21.15.82:0/411157255 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc400e040 con 0x56146afdcca0 2023-09-23T09:16:10.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.397+0000 7f6bb1ffb700 1 -- 172.21.15.82:0/411157255 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6bc400f040 con 0x56146afdcca0 2023-09-23T09:16:10.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.397+0000 7f6bb1ffb700 1 -- 172.21.15.82:0/411157255 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc4027bb0 con 0x56146afdcca0 2023-09-23T09:16:10.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.397+0000 7f6be521fb80 1 -- 172.21.15.82:0/411157255 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56146afdcca0 msgr2=0x56146afdfc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:16:10.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.397+0000 7f6be521fb80 1 --2- 172.21.15.82:0/411157255 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56146afdcca0 0x56146afdfc30 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6bc4009550 tx=0x7f6bc40073e0 comp rx=0 tx=0).stop 2023-09-23T09:16:10.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.397+0000 7f6be521fb80 1 -- 172.21.15.82:0/411157255 shutdown_connections 2023-09-23T09:16:10.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.397+0000 7f6be521fb80 1 --2- 172.21.15.82:0/411157255 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56146afdcca0 0x56146afdfc30 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:16:10.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.397+0000 7f6be521fb80 1 --2- 172.21.15.82:0/411157255 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56146afd6c40 0x56146afe27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:16:10.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.397+0000 7f6be521fb80 1 --2- 172.21.15.82:0/411157255 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56146afdc380 0x56146afdf6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:16:10.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.397+0000 7f6be521fb80 1 -- 172.21.15.82:0/411157255 >> 172.21.15.82:0/411157255 conn(0x56146af4b0e0 msgr2=0x56146afda0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:16:10.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.397+0000 7f6be521fb80 1 -- 172.21.15.82:0/411157255 shutdown_connections 2023-09-23T09:16:10.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.397+0000 7f6be521fb80 1 -- 172.21.15.82:0/411157255 wait complete. 2023-09-23T09:16:10.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.398+0000 7f6be521fb80 1 -- start start 2023-09-23T09:16:10.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.398+0000 7f6be521fb80 1 Processor -- start 2023-09-23T09:16:10.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.398+0000 7f6be521fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56146afd6c40 0x56146afd9550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:16:10.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.398+0000 7f6be521fb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56146afdc380 0x56146afd7e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:16:10.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.399+0000 7f6be521fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56146afdcca0 0x56146afd8340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:16:10.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.399+0000 7f6be521fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56146afd9ba0 con 0x56146afd6c40 2023-09-23T09:16:10.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.399+0000 7f6be521fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56146afd8880 con 0x56146afdcca0 2023-09-23T09:16:10.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.399+0000 7f6be521fb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x56146afd8a40 con 0x56146afdc380 2023-09-23T09:16:10.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.399+0000 7f6be521fb80 10 client.0 _ll_register_callbacks cb 0x56146ae10a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:16:10.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.399+0000 7f6bcaffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56146afd6c40 0x56146afd9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:16:10.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.399+0000 7f6bca7fc700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56146afdc380 0x56146afd7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:16:10.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.399+0000 7f6bca7fc700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56146afdc380 0x56146afd7e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:43822/0 (socket says 172.21.15.82:43822) 2023-09-23T09:16:10.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.399+0000 7f6bcaffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56146afd6c40 0x56146afd9550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34362/0 (socket says 172.21.15.82:34362) 2023-09-23T09:16:10.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.399+0000 7f6bcaffd700 1 -- 172.21.15.82:0/3491571747 learned_addr learned my addr 172.21.15.82:0/3491571747 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:16:10.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.399+0000 7f6bcb7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56146afdcca0 0x56146afd8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:16:10.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.399+0000 7f6bca7fc700 1 -- 172.21.15.82:0/3491571747 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56146afdcca0 msgr2=0x56146afd8340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:16:10.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.399+0000 7f6bca7fc700 1 --2- 172.21.15.82:0/3491571747 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56146afdcca0 0x56146afd8340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:16:10.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.399+0000 7f6bca7fc700 1 -- 172.21.15.82:0/3491571747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56146afd6c40 msgr2=0x56146afd9550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:16:10.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.399+0000 7f6bca7fc700 1 --2- 172.21.15.82:0/3491571747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56146afd6c40 0x56146afd9550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:16:10.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.399+0000 7f6bca7fc700 1 -- 172.21.15.82:0/3491571747 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56146ad54de0 con 0x56146afdc380 2023-09-23T09:16:10.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.399+0000 7f6bcaffd700 1 --2- 172.21.15.82:0/3491571747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56146afd6c40 0x56146afd9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:16:10.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.399+0000 7f6bcb7fe700 1 --2- 172.21.15.82:0/3491571747 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56146afdcca0 0x56146afd8340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:16:10.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.400+0000 7f6bca7fc700 1 --2- 172.21.15.82:0/3491571747 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56146afdc380 0x56146afd7e00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6bc00c90c0 tx=0x7f6bc000cea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bec4aad84848fcf4 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:16:10.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.400+0000 7f6baeff5700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T09:16:10.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.400+0000 7f6baeff5700 1 -- 172.21.15.82:0/3491571747 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc009c070 con 0x56146afdc380 2023-09-23T09:16:10.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.400+0000 7f6baeff5700 1 -- 172.21.15.82:0/3491571747 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(114..114 src has 1..114) v4 ==== 8557+0+0 (secure 0 0 0) 0x7f6bc000cbd0 con 0x56146afdc380 2023-09-23T09:16:10.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.400+0000 7f6be521fb80 1 -- 172.21.15.82:0/3491571747 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56146afc98b0 con 0x56146afdc380 2023-09-23T09:16:10.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.400+0000 7f6baeff5700 1 -- 172.21.15.82:0/3491571747 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6bc0004300 con 0x56146afdc380 2023-09-23T09:16:10.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.400+0000 7f6be521fb80 10 client.26554 fetch_fsmap learned FSMap version 72 2023-09-23T09:16:10.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.400+0000 7f6be521fb80 1 -- 172.21.15.82:0/3491571747 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=4+}) v3 -- 0x56146ad3dc60 con 0x56146afdc380 2023-09-23T09:16:10.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.400+0000 7f6baeff5700 1 -- 172.21.15.82:0/3491571747 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56146afc98b0 con 0x56146afdc380 2023-09-23T09:16:10.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.400+0000 7f6baeff5700 1 -- 172.21.15.82:0/3491571747 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 72) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f6bc00992e0 con 0x56146afdc380 2023-09-23T09:16:10.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.401+0000 7f6be521fb80 10 client.26554 fetch_fsmap finished waiting for FSMap version 72 2023-09-23T09:16:10.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.401+0000 7f6be521fb80 10 client.26554 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:16:10.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.401+0000 7f6be521fb80 20 client.26554 populate_metadata read hostname 'smithi082' 2023-09-23T09:16:10.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.401+0000 7f6be521fb80 1 --2- 172.21.15.82:0/3491571747 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56146b045a50 0x56146b047e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:16:10.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.401+0000 7f6be521fb80 4 client.26554 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:16:10.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.401+0000 7f6be521fb80 1 -- 172.21.15.82:0/3491571747 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x56146af21970 con 0x56146b045a50 2023-09-23T09:16:10.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.401+0000 7f6bcaffd700 1 --2- 172.21.15.82:0/3491571747 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56146b045a50 0x56146b047e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:16:10.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.401+0000 7f6bcaffd700 1 --2- 172.21.15.82:0/3491571747 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56146b045a50 0x56146b047e70 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26c7162915e40ded server_cookie=bc7149adf17624c8 in_seq=0 out_seq=0 2023-09-23T09:16:10.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.401+0000 7f6baeff5700 10 client.26554 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:16:10.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.402+0000 7f6baeff5700 1 -- 172.21.15.82:0/3491571747 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x56146af21970 con 0x56146b045a50 2023-09-23T09:16:10.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.402+0000 7f6baeff5700 10 client.26554 handle_command_reply: tid=0 2023-09-23T09:16:10.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.402+0000 7f6be521fb80 1 client.26554 shutdown 2023-09-23T09:16:10.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.402+0000 7f6be521fb80 1 -- 172.21.15.82:0/3491571747 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56146afdc380 msgr2=0x56146afd7e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:16:10.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.402+0000 7f6be521fb80 1 --2- 172.21.15.82:0/3491571747 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56146afdc380 0x56146afd7e00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6bc00c90c0 tx=0x7f6bc000cea0 comp rx=0 tx=0).stop 2023-09-23T09:16:10.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.402+0000 7f6be521fb80 1 -- 172.21.15.82:0/3491571747 shutdown_connections 2023-09-23T09:16:10.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.402+0000 7f6be521fb80 1 --2- 172.21.15.82:0/3491571747 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56146afdcca0 0x56146afd8340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:16:10.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.402+0000 7f6be521fb80 1 --2- 172.21.15.82:0/3491571747 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56146b045a50 0x56146b047e70 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:16:10.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.402+0000 7f6be521fb80 1 --2- 172.21.15.82:0/3491571747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56146afd6c40 0x56146afd9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:16:10.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.402+0000 7f6be521fb80 1 --2- 172.21.15.82:0/3491571747 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56146afdc380 0x56146afd7e00 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:16:10.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.402+0000 7f6be521fb80 1 -- 172.21.15.82:0/3491571747 >> 172.21.15.82:0/3491571747 conn(0x56146af4b0e0 msgr2=0x56146afdafd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:16:10.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.402+0000 7f6baeff5700 0 client.26554 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:16:10.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.402+0000 7f6be521fb80 1 -- 172.21.15.82:0/3491571747 shutdown_connections 2023-09-23T09:16:10.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.402+0000 7f6be521fb80 1 -- 172.21.15.82:0/3491571747 wait complete. 2023-09-23T09:16:10.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.402+0000 7f6be521fb80 20 client.26554 trim_cache size 0 max 16384 2023-09-23T09:16:10.410 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:16:10.410 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-23T09:16:10.410 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:16:10.410 INFO:teuthology.orchestra.run.smithi082.stdout: "047cbc72-e254-4787-b038-382de9c1a9a4": { 2023-09-23T09:16:10.410 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:16:10.410 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "047cbc72-e254-4787-b038-382de9c1a9a4", 2023-09-23T09:16:10.410 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:16:10.410 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:16:10.411 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:16:10.411 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:16:10.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.403+0000 7f6bd17ff700 1 -- 172.21.15.82:0/3983036369 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f6bb40a00c0 msgr2=0x7f6bb40a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:16:10.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.403+0000 7f6bd17ff700 1 --2- 172.21.15.82:0/3983036369 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f6bb40a00c0 0x7f6bb40a2580 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6bc40060b0 tx=0x7f6bc4004b40 comp rx=0 tx=0).stop 2023-09-23T09:16:10.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.403+0000 7f6bd17ff700 1 -- 172.21.15.82:0/3983036369 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6bcc101250 msgr2=0x7f6bcc19cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:16:10.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.403+0000 7f6bd17ff700 1 --2- 172.21.15.82:0/3983036369 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6bcc101250 0x7f6bcc19cb90 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6bc000eb30 tx=0x7f6bc000ee40 comp rx=0 tx=0).stop 2023-09-23T09:16:10.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.403+0000 7f6bd17ff700 1 -- 172.21.15.82:0/3983036369 shutdown_connections 2023-09-23T09:16:10.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.403+0000 7f6bd17ff700 1 --2- 172.21.15.82:0/3983036369 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f6bb40a00c0 0x7f6bb40a2580 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:16:10.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.403+0000 7f6bd17ff700 1 --2- 172.21.15.82:0/3983036369 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6bcc1068a0 0x7f6bcc196710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:16:10.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.403+0000 7f6bd17ff700 1 --2- 172.21.15.82:0/3983036369 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6bcc100890 0x7f6bcc19c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:16:10.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.403+0000 7f6bd17ff700 1 --2- 172.21.15.82:0/3983036369 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6bcc101250 0x7f6bcc19cb90 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:16:10.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.403+0000 7f6bd17ff700 1 -- 172.21.15.82:0/3983036369 >> 172.21.15.82:0/3983036369 conn(0x7f6bcc0fc380 msgr2=0x7f6bcc0fcb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:16:10.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.403+0000 7f6bd17ff700 1 -- 172.21.15.82:0/3983036369 shutdown_connections 2023-09-23T09:16:10.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:10.403+0000 7f6bd17ff700 1 -- 172.21.15.82:0/3983036369 wait complete. 2023-09-23T09:16:10.423 INFO:tasks.cephfs.filesystem:scrub status for tag:047cbc72-e254-4787-b038-382de9c1a9a4 - {'path': '/', 'tag': '047cbc72-e254-4787-b038-382de9c1a9a4', 'options': 'recursive,force'} 2023-09-23T09:16:11.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:16:10 smithi135 ceph-mon[99205]: pgmap v606: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 32 MiB/s wr, 48 op/s 2023-09-23T09:16:11.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:16:10 smithi082 ceph-mon[97694]: pgmap v606: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 32 MiB/s wr, 48 op/s 2023-09-23T09:16:11.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:16:10 smithi161 ceph-mon[99580]: pgmap v606: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 32 MiB/s wr, 48 op/s 2023-09-23T09:16:13.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:16:12 smithi135 ceph-mon[99205]: pgmap v607: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 32 MiB/s wr, 48 op/s 2023-09-23T09:16:13.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:16:12 smithi135 ceph-mon[99205]: osdmap e115: 12 total, 12 up, 12 in 2023-09-23T09:16:13.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:16:12 smithi082 ceph-mon[97694]: pgmap v607: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 32 MiB/s wr, 48 op/s 2023-09-23T09:16:13.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:16:12 smithi082 ceph-mon[97694]: osdmap e115: 12 total, 12 up, 12 in 2023-09-23T09:16:13.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:16:12 smithi161 ceph-mon[99580]: pgmap v607: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 32 MiB/s wr, 48 op/s 2023-09-23T09:16:13.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:16:12 smithi161 ceph-mon[99580]: osdmap e115: 12 total, 12 up, 12 in 2023-09-23T09:16:15.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:16:14 smithi135 ceph-mon[99205]: pgmap v609: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 20 MiB/s wr, 17 op/s 2023-09-23T09:16:15.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:16:14 smithi082 ceph-mon[97694]: pgmap v609: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 20 MiB/s wr, 17 op/s 2023-09-23T09:16:15.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:16:14 smithi161 ceph-mon[99580]: pgmap v609: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 20 MiB/s wr, 17 op/s 2023-09-23T09:16:17.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:16:16 smithi135 ceph-mon[99205]: pgmap v610: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 37 MiB/s wr, 31 op/s 2023-09-23T09:16:17.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:16:16 smithi082 ceph-mon[97694]: pgmap v610: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 37 MiB/s wr, 31 op/s 2023-09-23T09:16:17.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:16:16 smithi161 ceph-mon[99580]: pgmap v610: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 37 MiB/s wr, 31 op/s 2023-09-23T09:16:19.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:16:18 smithi135 ceph-mon[99205]: pgmap v611: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 32 MiB/s wr, 27 op/s 2023-09-23T09:16:19.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:16:18 smithi082 ceph-mon[97694]: pgmap v611: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 32 MiB/s wr, 27 op/s 2023-09-23T09:16:19.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:16:18 smithi161 ceph-mon[99580]: pgmap v611: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 32 MiB/s wr, 27 op/s 2023-09-23T09:16:21.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:16:20 smithi135 ceph-mon[99205]: pgmap v612: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 32 MiB/s wr, 26 op/s 2023-09-23T09:16:21.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:16:20 smithi082 ceph-mon[97694]: pgmap v612: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 32 MiB/s wr, 26 op/s 2023-09-23T09:16:21.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:16:20 smithi161 ceph-mon[99580]: pgmap v612: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 32 MiB/s wr, 26 op/s 2023-09-23T09:16:23.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:16:22 smithi135 ceph-mon[99205]: pgmap v613: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 32 MiB/s wr, 26 op/s 2023-09-23T09:16:23.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:16:22 smithi082 ceph-mon[97694]: pgmap v613: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 32 MiB/s wr, 26 op/s 2023-09-23T09:16:23.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:16:22 smithi161 ceph-mon[99580]: pgmap v613: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 32 MiB/s wr, 26 op/s 2023-09-23T09:16:25.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:16:24 smithi135 ceph-mon[99205]: pgmap v614: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 28 MiB/s wr, 23 op/s 2023-09-23T09:16:25.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:16:24 smithi082 ceph-mon[97694]: pgmap v614: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 28 MiB/s wr, 23 op/s 2023-09-23T09:16:25.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:16:24 smithi161 ceph-mon[99580]: pgmap v614: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 28 MiB/s wr, 23 op/s 2023-09-23T09:16:27.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:16:26 smithi135 ceph-mon[99205]: pgmap v615: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 40 MiB/s wr, 33 op/s 2023-09-23T09:16:27.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:16:26 smithi082 ceph-mon[97694]: pgmap v615: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 40 MiB/s wr, 33 op/s 2023-09-23T09:16:27.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:16:26 smithi161 ceph-mon[99580]: pgmap v615: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 40 MiB/s wr, 33 op/s 2023-09-23T09:16:29.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:16:28 smithi135 ceph-mon[99205]: pgmap v616: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 27 MiB/s wr, 22 op/s 2023-09-23T09:16:29.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:16:28 smithi082 ceph-mon[97694]: pgmap v616: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 27 MiB/s wr, 22 op/s 2023-09-23T09:16:29.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:16:28 smithi161 ceph-mon[99580]: pgmap v616: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 27 MiB/s wr, 22 op/s 2023-09-23T09:16:31.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:16:30 smithi135 ceph-mon[99205]: pgmap v617: 97 pgs: 97 active+clean; 11 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 40 MiB/s wr, 38 op/s 2023-09-23T09:16:31.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:16:30 smithi082 ceph-mon[97694]: pgmap v617: 97 pgs: 97 active+clean; 11 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 40 MiB/s wr, 38 op/s 2023-09-23T09:16:31.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:16:30 smithi161 ceph-mon[99580]: pgmap v617: 97 pgs: 97 active+clean; 11 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 40 MiB/s wr, 38 op/s 2023-09-23T09:16:32.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:16:31 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:16:32.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:16:31 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:16:32.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:16:31 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:16:33.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:16:32 smithi135 ceph-mon[99205]: pgmap v618: 97 pgs: 97 active+clean; 11 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 27 MiB/s wr, 27 op/s 2023-09-23T09:16:33.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:16:32 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:16:33.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:16:32 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:16:33.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:16:32 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:16:33.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:16:32 smithi082 ceph-mon[97694]: pgmap v618: 97 pgs: 97 active+clean; 11 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 27 MiB/s wr, 27 op/s 2023-09-23T09:16:33.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:16:32 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:16:33.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:16:32 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:16:33.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:16:32 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:16:33.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:16:32 smithi161 ceph-mon[99580]: pgmap v618: 97 pgs: 97 active+clean; 11 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 27 MiB/s wr, 27 op/s 2023-09-23T09:16:33.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:16:32 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:16:33.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:16:32 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:16:33.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:16:32 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:16:34.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:16:33 smithi082 ceph-mon[97694]: pgmap v619: 97 pgs: 97 active+clean; 11 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 27 MiB/s wr, 27 op/s 2023-09-23T09:16:34.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:16:33 smithi161 ceph-mon[99580]: pgmap v619: 97 pgs: 97 active+clean; 11 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 27 MiB/s wr, 27 op/s 2023-09-23T09:16:34.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:16:33 smithi135 ceph-mon[99205]: pgmap v619: 97 pgs: 97 active+clean; 11 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 27 MiB/s wr, 27 op/s 2023-09-23T09:16:36.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:16:36 smithi135 ceph-mon[99205]: pgmap v620: 97 pgs: 97 active+clean; 11 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 40 MiB/s wr, 37 op/s 2023-09-23T09:16:36.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:16:36 smithi082 ceph-mon[97694]: pgmap v620: 97 pgs: 97 active+clean; 11 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 40 MiB/s wr, 37 op/s 2023-09-23T09:16:36.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:16:36 smithi161 ceph-mon[99580]: pgmap v620: 97 pgs: 97 active+clean; 11 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 40 MiB/s wr, 37 op/s 2023-09-23T09:16:39.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:16:38 smithi135 ceph-mon[99205]: pgmap v621: 97 pgs: 97 active+clean; 11 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 27 MiB/s wr, 27 op/s 2023-09-23T09:16:39.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:16:38 smithi082 ceph-mon[97694]: pgmap v621: 97 pgs: 97 active+clean; 11 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 27 MiB/s wr, 27 op/s 2023-09-23T09:16:39.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:16:38 smithi161 ceph-mon[99580]: pgmap v621: 97 pgs: 97 active+clean; 11 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 27 MiB/s wr, 27 op/s 2023-09-23T09:16:40.425 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:16:40.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.669+0000 7f8dd21ff700 1 -- 172.21.15.82:0/3040105952 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8dcc072cc0 msgr2=0x7f8dcc0730a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:16:40.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.669+0000 7f8dd21ff700 1 --2- 172.21.15.82:0/3040105952 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8dcc072cc0 0x7f8dcc0730a0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc009990 tx=0x7f8dbc009ca0 comp rx=0 tx=0).stop 2023-09-23T09:16:40.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.669+0000 7f8dd21ff700 1 -- 172.21.15.82:0/3040105952 shutdown_connections 2023-09-23T09:16:40.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.669+0000 7f8dd21ff700 1 --2- 172.21.15.82:0/3040105952 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8dcc111880 0x7f8dcc113c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:16:40.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.669+0000 7f8dd21ff700 1 --2- 172.21.15.82:0/3040105952 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8dcc072cc0 0x7f8dcc0730a0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:16:40.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.669+0000 7f8dd21ff700 1 --2- 172.21.15.82:0/3040105952 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8dcc0735e0 0x7f8dcc111340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:16:40.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.669+0000 7f8dd21ff700 1 -- 172.21.15.82:0/3040105952 >> 172.21.15.82:0/3040105952 conn(0x7f8dcc0fc3a0 msgr2=0x7f8dcc0fe7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:16:40.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.669+0000 7f8dd21ff700 1 -- 172.21.15.82:0/3040105952 shutdown_connections 2023-09-23T09:16:40.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.669+0000 7f8dd21ff700 1 -- 172.21.15.82:0/3040105952 wait complete. 2023-09-23T09:16:40.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.670+0000 7f8dd21ff700 1 Processor -- start 2023-09-23T09:16:40.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.670+0000 7f8dd21ff700 1 -- start start 2023-09-23T09:16:40.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.671+0000 7f8dd21ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8dcc072cc0 0x7f8dcc19cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:16:40.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.671+0000 7f8dd21ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8dcc0735e0 0x7f8dcc19d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:16:40.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.671+0000 7f8dd21ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8dcc111880 0x7f8dcc1a1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:16:40.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.671+0000 7f8dd21ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dcc1a1f50 con 0x7f8dcc111880 2023-09-23T09:16:40.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.671+0000 7f8dd21ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dcc1a20c0 con 0x7f8dcc072cc0 2023-09-23T09:16:40.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.671+0000 7f8dd21ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dcc1a2280 con 0x7f8dcc0735e0 2023-09-23T09:16:40.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.671+0000 7f8dcb7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8dcc072cc0 0x7f8dcc19cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:16:40.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.671+0000 7f8dcbfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8dcc111880 0x7f8dcc1a1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:16:40.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.671+0000 7f8dcaffd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8dcc0735e0 0x7f8dcc19d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:16:40.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.671+0000 7f8dcb7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8dcc072cc0 0x7f8dcc19cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:54404/0 (socket says 172.21.15.82:54404) 2023-09-23T09:16:40.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.671+0000 7f8dcb7fe700 1 -- 172.21.15.82:0/2316621542 learned_addr learned my addr 172.21.15.82:0/2316621542 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:16:40.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.671+0000 7f8dcb7fe700 1 -- 172.21.15.82:0/2316621542 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8dcc0735e0 msgr2=0x7f8dcc19d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:16:40.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.671+0000 7f8dcb7fe700 1 --2- 172.21.15.82:0/2316621542 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8dcc0735e0 0x7f8dcc19d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:16:40.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.671+0000 7f8dcb7fe700 1 -- 172.21.15.82:0/2316621542 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8dcc111880 msgr2=0x7f8dcc1a1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:16:40.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.671+0000 7f8dcb7fe700 1 --2- 172.21.15.82:0/2316621542 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8dcc111880 0x7f8dcc1a1910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:16:40.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.671+0000 7f8dcb7fe700 1 -- 172.21.15.82:0/2316621542 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dbc0095f0 con 0x7f8dcc072cc0 2023-09-23T09:16:40.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.671+0000 7f8dcbfff700 1 --2- 172.21.15.82:0/2316621542 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8dcc111880 0x7f8dcc1a1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:16:40.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.672+0000 7f8dcb7fe700 1 --2- 172.21.15.82:0/2316621542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8dcc072cc0 0x7f8dcc19cf70 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc000c00 tx=0x7f8dbc004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:16:40.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.672+0000 7f8dc8ff9700 1 -- 172.21.15.82:0/2316621542 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dbc01d070 con 0x7f8dcc072cc0 2023-09-23T09:16:40.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.672+0000 7f8dd21ff700 1 -- 172.21.15.82:0/2316621542 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dcc1a2500 con 0x7f8dcc072cc0 2023-09-23T09:16:40.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.672+0000 7f8dc8ff9700 1 -- 172.21.15.82:0/2316621542 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8dbc022470 con 0x7f8dcc072cc0 2023-09-23T09:16:40.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.672+0000 7f8dc8ff9700 1 -- 172.21.15.82:0/2316621542 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dbc017650 con 0x7f8dcc072cc0 2023-09-23T09:16:40.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.672+0000 7f8dd21ff700 1 -- 172.21.15.82:0/2316621542 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dcc1a9da0 con 0x7f8dcc072cc0 2023-09-23T09:16:40.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.675+0000 7f8dc8ff9700 1 -- 172.21.15.82:0/2316621542 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f8dbc0225e0 con 0x7f8dcc072cc0 2023-09-23T09:16:40.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.678+0000 7f8dc8ff9700 1 --2- 172.21.15.82:0/2316621542 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f8db40a00c0 0x7f8db40a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:16:40.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.678+0000 7f8dc8ff9700 1 -- 172.21.15.82:0/2316621542 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f8dbc0cca30 con 0x7f8dcc072cc0 2023-09-23T09:16:40.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.678+0000 7f8de5b55b80 1 Processor -- start 2023-09-23T09:16:40.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.678+0000 7f8dcaffd700 1 --2- 172.21.15.82:0/2316621542 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f8db40a00c0 0x7f8db40a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:16:40.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.678+0000 7f8de5b55b80 1 -- start start 2023-09-23T09:16:40.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.679+0000 7f8de5b55b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56059c20a380 0x56059c20a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:16:40.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.679+0000 7f8de5b55b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56059c20aca0 0x56059c204700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:16:40.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.679+0000 7f8de5b55b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56059c204c40 0x56059c2050a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:16:40.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.679+0000 7f8de5b55b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56059c16c7b0 con 0x56059c204c40 2023-09-23T09:16:40.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.679+0000 7f8de5b55b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56059c15d780 con 0x56059c20a380 2023-09-23T09:16:40.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.679+0000 7f8de5b55b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x56059c15b0a0 con 0x56059c20aca0 2023-09-23T09:16:40.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.679+0000 7f8dcaffd700 1 --2- 172.21.15.82:0/2316621542 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f8db40a00c0 0x7f8db40a2580 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8dcc19e580 tx=0x7f8dc0009260 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:16:40.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.679+0000 7f8dcaffd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56059c20aca0 0x56059c204700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:16:40.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.679+0000 7f8dcaffd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56059c20aca0 0x56059c204700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:59262/0 (socket says 172.21.15.82:59262) 2023-09-23T09:16:40.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.679+0000 7f8dcaffd700 1 -- 172.21.15.82:0/1729996024 learned_addr learned my addr 172.21.15.82:0/1729996024 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:16:40.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.679+0000 7f8dcb7fe700 1 --2- 172.21.15.82:0/1729996024 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56059c20a380 0x56059c20a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:16:40.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.679+0000 7f8dcbfff700 1 --2- 172.21.15.82:0/1729996024 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56059c204c40 0x56059c2050a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:16:40.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.679+0000 7f8dcaffd700 1 -- 172.21.15.82:0/1729996024 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56059c20a380 msgr2=0x56059c20a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:16:40.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.679+0000 7f8dcaffd700 1 --2- 172.21.15.82:0/1729996024 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56059c20a380 0x56059c20a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:16:40.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.679+0000 7f8dcaffd700 1 -- 172.21.15.82:0/1729996024 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56059c204c40 msgr2=0x56059c2050a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:16:40.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.679+0000 7f8dcaffd700 1 --2- 172.21.15.82:0/1729996024 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56059c204c40 0x56059c2050a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:16:40.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.679+0000 7f8dcaffd700 1 -- 172.21.15.82:0/1729996024 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56059bfd6630 con 0x56059c20aca0 2023-09-23T09:16:40.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.680+0000 7f8dcaffd700 1 --2- 172.21.15.82:0/1729996024 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56059c20aca0 0x56059c204700 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8dc0011d20 tx=0x7f8dc0014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d0a9e91d438f8d5 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:16:40.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.680+0000 7f8db1ffb700 1 -- 172.21.15.82:0/1729996024 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc000eb20 con 0x56059c20aca0 2023-09-23T09:16:40.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.680+0000 7f8db1ffb700 1 -- 172.21.15.82:0/1729996024 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8dc0021070 con 0x56059c20aca0 2023-09-23T09:16:40.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.680+0000 7f8db1ffb700 1 -- 172.21.15.82:0/1729996024 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc00253d0 con 0x56059c20aca0 2023-09-23T09:16:40.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.681+0000 7f8de5b55b80 1 -- 172.21.15.82:0/1729996024 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56059c20aca0 msgr2=0x56059c204700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:16:40.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.681+0000 7f8de5b55b80 1 --2- 172.21.15.82:0/1729996024 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56059c20aca0 0x56059c204700 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8dc0011d20 tx=0x7f8dc0014000 comp rx=0 tx=0).stop 2023-09-23T09:16:40.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.681+0000 7f8de5b55b80 1 -- 172.21.15.82:0/1729996024 shutdown_connections 2023-09-23T09:16:40.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.681+0000 7f8de5b55b80 1 --2- 172.21.15.82:0/1729996024 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56059c204c40 0x56059c2050a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:16:40.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.681+0000 7f8de5b55b80 1 --2- 172.21.15.82:0/1729996024 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56059c20a380 0x56059c20a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:16:40.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.681+0000 7f8de5b55b80 1 --2- 172.21.15.82:0/1729996024 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56059c20aca0 0x56059c204700 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:16:40.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.681+0000 7f8de5b55b80 1 -- 172.21.15.82:0/1729996024 >> 172.21.15.82:0/1729996024 conn(0x56059c1790e0 msgr2=0x56059c1ff410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:16:40.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.681+0000 7f8de5b55b80 1 -- 172.21.15.82:0/1729996024 shutdown_connections 2023-09-23T09:16:40.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.681+0000 7f8de5b55b80 1 -- 172.21.15.82:0/1729996024 wait complete. 2023-09-23T09:16:40.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.682+0000 7f8de5b55b80 1 -- start start 2023-09-23T09:16:40.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.682+0000 7f8de5b55b80 1 Processor -- start 2023-09-23T09:16:40.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.682+0000 7f8de5b55b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56059c204c40 0x56059c210c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:16:40.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.682+0000 7f8de5b55b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56059c20a380 0x56059c20dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:16:40.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.682+0000 7f8de5b55b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56059c20aca0 0x56059c20e620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:16:40.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.682+0000 7f8de5b55b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56059c156990 con 0x56059c20aca0 2023-09-23T09:16:40.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.682+0000 7f8de5b55b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56059c0f4bb0 con 0x56059c204c40 2023-09-23T09:16:40.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.682+0000 7f8de5b55b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x56059c0f48b0 con 0x56059c20a380 2023-09-23T09:16:40.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.683+0000 7f8de5b55b80 10 client.0 _ll_register_callbacks cb 0x56059c03ea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:16:40.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.683+0000 7f8dcb7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56059c204c40 0x56059c210c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:16:40.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.683+0000 7f8dcaffd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56059c20a380 0x56059c20dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:16:40.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.683+0000 7f8dcbfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56059c20aca0 0x56059c20e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:16:40.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.683+0000 7f8dcb7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56059c204c40 0x56059c210c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:54416/0 (socket says 172.21.15.82:54416) 2023-09-23T09:16:40.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.683+0000 7f8dcb7fe700 1 -- 172.21.15.82:0/1763962797 learned_addr learned my addr 172.21.15.82:0/1763962797 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:16:40.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.683+0000 7f8dcb7fe700 1 -- 172.21.15.82:0/1763962797 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56059c20a380 msgr2=0x56059c20dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:16:40.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.683+0000 7f8dcb7fe700 1 --2- 172.21.15.82:0/1763962797 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56059c20a380 0x56059c20dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:16:40.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.683+0000 7f8dcb7fe700 1 -- 172.21.15.82:0/1763962797 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56059c20aca0 msgr2=0x56059c20e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:16:40.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.683+0000 7f8dcb7fe700 1 --2- 172.21.15.82:0/1763962797 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56059c20aca0 0x56059c20e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:16:40.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.683+0000 7f8dcb7fe700 1 -- 172.21.15.82:0/1763962797 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dc0017070 con 0x56059c204c40 2023-09-23T09:16:40.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.683+0000 7f8dcb7fe700 1 --2- 172.21.15.82:0/1763962797 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56059c204c40 0x56059c210c60 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc096d00 tx=0x7f8dbc099ec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a377bc3b85fd1ac server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:16:40.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.683+0000 7f8daaffd700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-09-23T09:16:40.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.684+0000 7f8daaffd700 1 -- 172.21.15.82:0/1763962797 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dbc0b1070 con 0x56059c204c40 2023-09-23T09:16:40.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.684+0000 7f8daaffd700 1 -- 172.21.15.82:0/1763962797 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(115..115 src has 1..115) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f8dbc09a990 con 0x56059c204c40 2023-09-23T09:16:40.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.684+0000 7f8de5b55b80 1 -- 172.21.15.82:0/1763962797 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56059c1d41c0 con 0x56059c204c40 2023-09-23T09:16:40.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.684+0000 7f8daaffd700 1 -- 172.21.15.82:0/1763962797 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8dbc094ea0 con 0x56059c204c40 2023-09-23T09:16:40.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.684+0000 7f8de5b55b80 10 client.26510 fetch_fsmap learned FSMap version 72 2023-09-23T09:16:40.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.684+0000 7f8de5b55b80 1 -- 172.21.15.82:0/1763962797 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=4+}) v3 -- 0x56059bf82de0 con 0x56059c204c40 2023-09-23T09:16:40.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.684+0000 7f8daaffd700 1 -- 172.21.15.82:0/1763962797 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8dbc064080 con 0x56059c204c40 2023-09-23T09:16:40.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.684+0000 7f8daaffd700 1 -- 172.21.15.82:0/1763962797 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 72) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f8dbc0b2260 con 0x56059c204c40 2023-09-23T09:16:40.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.684+0000 7f8de5b55b80 10 client.26510 fetch_fsmap finished waiting for FSMap version 72 2023-09-23T09:16:40.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.684+0000 7f8de5b55b80 10 client.26510 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:16:40.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.684+0000 7f8de5b55b80 20 client.26510 populate_metadata read hostname 'smithi082' 2023-09-23T09:16:40.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.684+0000 7f8de5b55b80 1 --2- 172.21.15.82:0/1763962797 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56059c21e460 0x56059c220880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:16:40.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.685+0000 7f8de5b55b80 4 client.26510 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:16:40.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.685+0000 7f8de5b55b80 1 -- 172.21.15.82:0/1763962797 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56059c0fcba0 con 0x56059c21e460 2023-09-23T09:16:40.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.685+0000 7f8dcaffd700 1 --2- 172.21.15.82:0/1763962797 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56059c21e460 0x56059c220880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:16:40.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.686+0000 7f8daaffd700 10 client.26510 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:16:40.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.686+0000 7f8dcaffd700 1 --2- 172.21.15.82:0/1763962797 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56059c21e460 0x56059c220880 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f743da33324ee17 server_cookie=962c6f9325f2df13 in_seq=0 out_seq=0 2023-09-23T09:16:40.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.686+0000 7f8daaffd700 1 -- 172.21.15.82:0/1763962797 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56059c0fcba0 con 0x56059c21e460 2023-09-23T09:16:40.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.686+0000 7f8daaffd700 10 client.26510 handle_command_reply: tid=0 2023-09-23T09:16:40.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.686+0000 7f8de5b55b80 1 client.26510 shutdown 2023-09-23T09:16:40.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.686+0000 7f8de5b55b80 1 -- 172.21.15.82:0/1763962797 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56059c204c40 msgr2=0x56059c210c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:16:40.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.686+0000 7f8de5b55b80 1 --2- 172.21.15.82:0/1763962797 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56059c204c40 0x56059c210c60 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc096d00 tx=0x7f8dbc099ec0 comp rx=0 tx=0).stop 2023-09-23T09:16:40.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.687+0000 7f8de5b55b80 1 -- 172.21.15.82:0/1763962797 shutdown_connections 2023-09-23T09:16:40.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.687+0000 7f8de5b55b80 1 --2- 172.21.15.82:0/1763962797 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56059c21e460 0x56059c220880 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:16:40.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.687+0000 7f8de5b55b80 1 --2- 172.21.15.82:0/1763962797 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56059c20aca0 0x56059c20e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:16:40.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.687+0000 7f8de5b55b80 1 --2- 172.21.15.82:0/1763962797 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56059c204c40 0x56059c210c60 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:16:40.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.687+0000 7f8daaffd700 0 client.26510 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:16:40.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.687+0000 7f8de5b55b80 1 --2- 172.21.15.82:0/1763962797 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56059c20a380 0x56059c20dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:16:40.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.687+0000 7f8de5b55b80 1 -- 172.21.15.82:0/1763962797 >> 172.21.15.82:0/1763962797 conn(0x56059c1790e0 msgr2=0x56059c1f9b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:16:40.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.687+0000 7f8de5b55b80 1 -- 172.21.15.82:0/1763962797 shutdown_connections 2023-09-23T09:16:40.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.687+0000 7f8de5b55b80 1 -- 172.21.15.82:0/1763962797 wait complete. 2023-09-23T09:16:40.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.687+0000 7f8de5b55b80 20 client.26510 trim_cache size 0 max 16384 2023-09-23T09:16:40.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.705+0000 7f8de5b55b80 1 Processor -- start 2023-09-23T09:16:40.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.705+0000 7f8de5b55b80 1 -- start start 2023-09-23T09:16:40.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.706+0000 7f8de5b55b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56059c204c40 0x56059c20d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:16:40.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.706+0000 7f8de5b55b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56059c20a380 0x56059c21aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:16:40.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.706+0000 7f8de5b55b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56059c20aca0 0x56059c210800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:16:40.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.706+0000 7f8de5b55b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56059bfd8920 con 0x56059c20aca0 2023-09-23T09:16:40.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.706+0000 7f8de5b55b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56059c20ee90 con 0x56059c204c40 2023-09-23T09:16:40.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.706+0000 7f8de5b55b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x56059c1fba20 con 0x56059c20a380 2023-09-23T09:16:40.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.706+0000 7f8dcaffd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56059c20a380 0x56059c21aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:16:40.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.706+0000 7f8dcaffd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56059c20a380 0x56059c21aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:59290/0 (socket says 172.21.15.82:59290) 2023-09-23T09:16:40.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.706+0000 7f8dcaffd700 1 -- 172.21.15.82:0/566988296 learned_addr learned my addr 172.21.15.82:0/566988296 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:16:40.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.706+0000 7f8dcbfff700 1 --2- 172.21.15.82:0/566988296 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56059c20aca0 0x56059c210800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:16:40.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.707+0000 7f8dcb7fe700 1 --2- 172.21.15.82:0/566988296 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56059c204c40 0x56059c20d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:16:40.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.707+0000 7f8dcbfff700 1 -- 172.21.15.82:0/566988296 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56059c20a380 msgr2=0x56059c21aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:16:40.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.707+0000 7f8dcbfff700 1 --2- 172.21.15.82:0/566988296 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56059c20a380 0x56059c21aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:16:40.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.707+0000 7f8dcbfff700 1 -- 172.21.15.82:0/566988296 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56059c204c40 msgr2=0x56059c20d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:16:40.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.707+0000 7f8dcbfff700 1 --2- 172.21.15.82:0/566988296 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56059c204c40 0x56059c20d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:16:40.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.707+0000 7f8dcbfff700 1 -- 172.21.15.82:0/566988296 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56059bf6bc60 con 0x56059c20aca0 2023-09-23T09:16:40.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.707+0000 7f8dcbfff700 1 --2- 172.21.15.82:0/566988296 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56059c20aca0 0x56059c210800 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f8dc4003ab0 tx=0x7f8dc4009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ca1660bbde0b706 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:16:40.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.707+0000 7f8db27fc700 1 -- 172.21.15.82:0/566988296 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc4004db0 con 0x56059c20aca0 2023-09-23T09:16:40.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.708+0000 7f8db27fc700 1 -- 172.21.15.82:0/566988296 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8dc400f040 con 0x56059c20aca0 2023-09-23T09:16:40.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.708+0000 7f8db27fc700 1 -- 172.21.15.82:0/566988296 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc4007bd0 con 0x56059c20aca0 2023-09-23T09:16:40.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.708+0000 7f8de5b55b80 1 -- 172.21.15.82:0/566988296 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56059c20aca0 msgr2=0x56059c210800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:16:40.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.708+0000 7f8de5b55b80 1 --2- 172.21.15.82:0/566988296 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56059c20aca0 0x56059c210800 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f8dc4003ab0 tx=0x7f8dc4009920 comp rx=0 tx=0).stop 2023-09-23T09:16:40.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.708+0000 7f8de5b55b80 1 -- 172.21.15.82:0/566988296 shutdown_connections 2023-09-23T09:16:40.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.708+0000 7f8de5b55b80 1 --2- 172.21.15.82:0/566988296 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56059c20aca0 0x56059c210800 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:16:40.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.708+0000 7f8de5b55b80 1 --2- 172.21.15.82:0/566988296 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56059c204c40 0x56059c20d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:16:40.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.708+0000 7f8de5b55b80 1 --2- 172.21.15.82:0/566988296 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56059c20a380 0x56059c21aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:16:40.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.708+0000 7f8de5b55b80 1 -- 172.21.15.82:0/566988296 >> 172.21.15.82:0/566988296 conn(0x56059c1790e0 msgr2=0x56059c1ff110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:16:40.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.709+0000 7f8de5b55b80 1 -- 172.21.15.82:0/566988296 shutdown_connections 2023-09-23T09:16:40.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.709+0000 7f8de5b55b80 1 -- 172.21.15.82:0/566988296 wait complete. 2023-09-23T09:16:40.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.709+0000 7f8de5b55b80 1 -- start start 2023-09-23T09:16:40.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.709+0000 7f8de5b55b80 1 Processor -- start 2023-09-23T09:16:40.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.710+0000 7f8de5b55b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56059c204c40 0x56059c2157a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:16:40.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.710+0000 7f8de5b55b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56059c20a380 0x56059c205f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:16:40.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.710+0000 7f8de5b55b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56059c20aca0 0x56059c2064a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:16:40.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.710+0000 7f8de5b55b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56059c206a70 con 0x56059c204c40 2023-09-23T09:16:40.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.710+0000 7f8de5b55b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56059c206bb0 con 0x56059c20a380 2023-09-23T09:16:40.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.710+0000 7f8de5b55b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x56059c206d70 con 0x56059c20aca0 2023-09-23T09:16:40.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.710+0000 7f8de5b55b80 10 client.0 _ll_register_callbacks cb 0x7f8dbc09a060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:16:40.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.710+0000 7f8dcb7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56059c204c40 0x56059c2157a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:16:40.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.710+0000 7f8dcb7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56059c204c40 0x56059c2157a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59364/0 (socket says 172.21.15.82:59364) 2023-09-23T09:16:40.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.710+0000 7f8dcb7fe700 1 -- 172.21.15.82:0/3368719440 learned_addr learned my addr 172.21.15.82:0/3368719440 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:16:40.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.711+0000 7f8dcaffd700 1 --2- 172.21.15.82:0/3368719440 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56059c20a380 0x56059c205f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:16:40.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.711+0000 7f8dcbfff700 1 --2- 172.21.15.82:0/3368719440 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56059c20aca0 0x56059c2064a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:16:40.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.711+0000 7f8dcb7fe700 1 -- 172.21.15.82:0/3368719440 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56059c20aca0 msgr2=0x56059c2064a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:16:40.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.711+0000 7f8dcb7fe700 1 --2- 172.21.15.82:0/3368719440 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56059c20aca0 0x56059c2064a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:16:40.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.711+0000 7f8dcb7fe700 1 -- 172.21.15.82:0/3368719440 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56059c20a380 msgr2=0x56059c205f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:16:40.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.711+0000 7f8dcb7fe700 1 --2- 172.21.15.82:0/3368719440 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56059c20a380 0x56059c205f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:16:40.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.711+0000 7f8dcb7fe700 1 -- 172.21.15.82:0/3368719440 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dc40092f0 con 0x56059c204c40 2023-09-23T09:16:40.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.711+0000 7f8dcb7fe700 1 --2- 172.21.15.82:0/3368719440 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56059c204c40 0x56059c2157a0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc00f740 tx=0x7f8dbc0056b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dc97189f1553291 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:16:40.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.711+0000 7f8daaffd700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:16:40.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.711+0000 7f8daaffd700 1 -- 172.21.15.82:0/3368719440 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dbc094ea0 con 0x56059c204c40 2023-09-23T09:16:40.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.711+0000 7f8daaffd700 1 -- 172.21.15.82:0/3368719440 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(115..115 src has 1..115) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f8dbc066370 con 0x56059c204c40 2023-09-23T09:16:40.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.711+0000 7f8de5b55b80 1 -- 172.21.15.82:0/3368719440 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56059c1f78b0 con 0x56059c204c40 2023-09-23T09:16:40.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.712+0000 7f8daaffd700 1 -- 172.21.15.82:0/3368719440 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8dbc0ca050 con 0x56059c204c40 2023-09-23T09:16:40.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.712+0000 7f8de5b55b80 10 client.16845 fetch_fsmap learned FSMap version 72 2023-09-23T09:16:40.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.712+0000 7f8de5b55b80 1 -- 172.21.15.82:0/3368719440 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=4+}) v3 -- 0x56059bfa9250 con 0x56059c204c40 2023-09-23T09:16:40.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.712+0000 7f8daaffd700 1 -- 172.21.15.82:0/3368719440 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56059c1f78b0 con 0x56059c204c40 2023-09-23T09:16:40.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.712+0000 7f8daaffd700 1 -- 172.21.15.82:0/3368719440 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 72) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f8dbc00fac0 con 0x56059c204c40 2023-09-23T09:16:40.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.712+0000 7f8de5b55b80 10 client.16845 fetch_fsmap finished waiting for FSMap version 72 2023-09-23T09:16:40.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.712+0000 7f8de5b55b80 10 client.16845 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:16:40.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.712+0000 7f8de5b55b80 20 client.16845 populate_metadata read hostname 'smithi082' 2023-09-23T09:16:40.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.712+0000 7f8de5b55b80 1 --2- 172.21.15.82:0/3368719440 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56059c273360 0x56059c275780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:16:40.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.712+0000 7f8de5b55b80 4 client.16845 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:16:40.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.712+0000 7f8de5b55b80 1 -- 172.21.15.82:0/3368719440 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x56059c14f970 con 0x56059c273360 2023-09-23T09:16:40.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.713+0000 7f8dcaffd700 1 --2- 172.21.15.82:0/3368719440 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56059c273360 0x56059c275780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:16:40.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.714+0000 7f8daaffd700 10 client.16845 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:16:40.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.714+0000 7f8dcaffd700 1 --2- 172.21.15.82:0/3368719440 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56059c273360 0x56059c275780 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3da57f878219f633 server_cookie=9764bc854f9935ed in_seq=0 out_seq=0 2023-09-23T09:16:40.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.714+0000 7f8daaffd700 1 -- 172.21.15.82:0/3368719440 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x56059c14f970 con 0x56059c273360 2023-09-23T09:16:40.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.714+0000 7f8daaffd700 10 client.16845 handle_command_reply: tid=0 2023-09-23T09:16:40.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.714+0000 7f8de5b55b80 1 client.16845 shutdown 2023-09-23T09:16:40.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.714+0000 7f8de5b55b80 1 -- 172.21.15.82:0/3368719440 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56059c204c40 msgr2=0x56059c2157a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:16:40.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.714+0000 7f8de5b55b80 1 --2- 172.21.15.82:0/3368719440 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56059c204c40 0x56059c2157a0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc00f740 tx=0x7f8dbc0056b0 comp rx=0 tx=0).stop 2023-09-23T09:16:40.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.714+0000 7f8de5b55b80 1 -- 172.21.15.82:0/3368719440 shutdown_connections 2023-09-23T09:16:40.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.714+0000 7f8de5b55b80 1 --2- 172.21.15.82:0/3368719440 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56059c20aca0 0x56059c2064a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:16:40.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.714+0000 7f8de5b55b80 1 --2- 172.21.15.82:0/3368719440 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56059c273360 0x56059c275780 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:16:40.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.714+0000 7f8de5b55b80 1 --2- 172.21.15.82:0/3368719440 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56059c204c40 0x56059c2157a0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:16:40.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.714+0000 7f8de5b55b80 1 --2- 172.21.15.82:0/3368719440 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56059c20a380 0x56059c205f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:16:40.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.714+0000 7f8de5b55b80 1 -- 172.21.15.82:0/3368719440 >> 172.21.15.82:0/3368719440 conn(0x56059c1790e0 msgr2=0x56059c208050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:16:40.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.714+0000 7f8daaffd700 0 client.16845 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:16:40.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.715+0000 7f8de5b55b80 1 -- 172.21.15.82:0/3368719440 shutdown_connections 2023-09-23T09:16:40.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.715+0000 7f8de5b55b80 1 -- 172.21.15.82:0/3368719440 wait complete. 2023-09-23T09:16:40.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.715+0000 7f8de5b55b80 20 client.16845 trim_cache size 0 max 16384 2023-09-23T09:16:40.723 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:16:40.723 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-23T09:16:40.723 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:16:40.723 INFO:teuthology.orchestra.run.smithi082.stdout: "047cbc72-e254-4787-b038-382de9c1a9a4": { 2023-09-23T09:16:40.723 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:16:40.723 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "047cbc72-e254-4787-b038-382de9c1a9a4", 2023-09-23T09:16:40.723 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:16:40.723 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:16:40.724 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:16:40.724 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:16:40.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.715+0000 7f8dd21ff700 1 -- 172.21.15.82:0/2316621542 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f8db40a00c0 msgr2=0x7f8db40a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:16:40.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.715+0000 7f8dd21ff700 1 --2- 172.21.15.82:0/2316621542 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f8db40a00c0 0x7f8db40a2580 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8dcc19e580 tx=0x7f8dc0009260 comp rx=0 tx=0).stop 2023-09-23T09:16:40.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.715+0000 7f8dd21ff700 1 -- 172.21.15.82:0/2316621542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8dcc072cc0 msgr2=0x7f8dcc19cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:16:40.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.715+0000 7f8dd21ff700 1 --2- 172.21.15.82:0/2316621542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8dcc072cc0 0x7f8dcc19cf70 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc000c00 tx=0x7f8dbc004730 comp rx=0 tx=0).stop 2023-09-23T09:16:40.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.716+0000 7f8dd21ff700 1 -- 172.21.15.82:0/2316621542 shutdown_connections 2023-09-23T09:16:40.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.716+0000 7f8dd21ff700 1 --2- 172.21.15.82:0/2316621542 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f8db40a00c0 0x7f8db40a2580 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:16:40.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.716+0000 7f8dd21ff700 1 --2- 172.21.15.82:0/2316621542 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8dcc111880 0x7f8dcc1a1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:16:40.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.716+0000 7f8dd21ff700 1 --2- 172.21.15.82:0/2316621542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8dcc072cc0 0x7f8dcc19cf70 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:16:40.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.716+0000 7f8dd21ff700 1 --2- 172.21.15.82:0/2316621542 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8dcc0735e0 0x7f8dcc19d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:16:40.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.716+0000 7f8dd21ff700 1 -- 172.21.15.82:0/2316621542 >> 172.21.15.82:0/2316621542 conn(0x7f8dcc0fc3a0 msgr2=0x7f8dcc0fd010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:16:40.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.716+0000 7f8dd21ff700 1 -- 172.21.15.82:0/2316621542 shutdown_connections 2023-09-23T09:16:40.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:16:40.716+0000 7f8dd21ff700 1 -- 172.21.15.82:0/2316621542 wait complete. 2023-09-23T09:16:40.739 INFO:tasks.cephfs.filesystem:scrub status for tag:047cbc72-e254-4787-b038-382de9c1a9a4 - {'path': '/', 'tag': '047cbc72-e254-4787-b038-382de9c1a9a4', 'options': 'recursive,force'} 2023-09-23T09:16:40.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:16:40 smithi082 ceph-mon[97694]: pgmap v622: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 40 MiB/s wr, 37 op/s 2023-09-23T09:16:41.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:16:40 smithi135 ceph-mon[99205]: pgmap v622: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 40 MiB/s wr, 37 op/s 2023-09-23T09:16:41.491 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:16:40 smithi161 ceph-mon[99580]: pgmap v622: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 40 MiB/s wr, 37 op/s 2023-09-23T09:16:43.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:16:42 smithi135 ceph-mon[99205]: pgmap v623: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 27 MiB/s wr, 21 op/s 2023-09-23T09:16:43.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:16:42 smithi082 ceph-mon[97694]: pgmap v623: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 27 MiB/s wr, 21 op/s 2023-09-23T09:16:43.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:16:42 smithi161 ceph-mon[99580]: pgmap v623: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 27 MiB/s wr, 21 op/s 2023-09-23T09:16:45.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:16:44 smithi135 ceph-mon[99205]: pgmap v624: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 27 MiB/s wr, 21 op/s 2023-09-23T09:16:45.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:16:44 smithi082 ceph-mon[97694]: pgmap v624: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 27 MiB/s wr, 21 op/s 2023-09-23T09:16:45.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:16:44 smithi161 ceph-mon[99580]: pgmap v624: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 27 MiB/s wr, 21 op/s 2023-09-23T09:16:47.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:16:46 smithi135 ceph-mon[99205]: pgmap v625: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 40 MiB/s wr, 31 op/s 2023-09-23T09:16:47.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:16:46 smithi082 ceph-mon[97694]: pgmap v625: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 40 MiB/s wr, 31 op/s 2023-09-23T09:16:47.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:16:46 smithi161 ceph-mon[99580]: pgmap v625: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 40 MiB/s wr, 31 op/s 2023-09-23T09:16:49.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:16:48 smithi135 ceph-mon[99205]: pgmap v626: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 MiB/s wr, 21 op/s 2023-09-23T09:16:49.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:16:48 smithi082 ceph-mon[97694]: pgmap v626: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 MiB/s wr, 21 op/s 2023-09-23T09:16:49.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:16:48 smithi161 ceph-mon[99580]: pgmap v626: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 MiB/s wr, 21 op/s 2023-09-23T09:16:51.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:16:50 smithi135 ceph-mon[99205]: pgmap v627: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 40 MiB/s wr, 31 op/s 2023-09-23T09:16:51.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:16:50 smithi082 ceph-mon[97694]: pgmap v627: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 40 MiB/s wr, 31 op/s 2023-09-23T09:16:51.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:16:50 smithi161 ceph-mon[99580]: pgmap v627: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 40 MiB/s wr, 31 op/s 2023-09-23T09:16:53.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:16:52 smithi135 ceph-mon[99205]: pgmap v628: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 MiB/s wr, 20 op/s 2023-09-23T09:16:53.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:16:52 smithi082 ceph-mon[97694]: pgmap v628: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 MiB/s wr, 20 op/s 2023-09-23T09:16:53.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:16:52 smithi161 ceph-mon[99580]: pgmap v628: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 MiB/s wr, 20 op/s 2023-09-23T09:16:55.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:16:54 smithi135 ceph-mon[99205]: pgmap v629: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 MiB/s wr, 20 op/s 2023-09-23T09:16:55.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:16:54 smithi082 ceph-mon[97694]: pgmap v629: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 MiB/s wr, 20 op/s 2023-09-23T09:16:55.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:16:54 smithi161 ceph-mon[99580]: pgmap v629: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 MiB/s wr, 20 op/s 2023-09-23T09:16:56.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:16:55 smithi082 ceph-mon[97694]: pgmap v630: 97 pgs: 97 active+clean; 12 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 40 MiB/s wr, 30 op/s 2023-09-23T09:16:56.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:16:55 smithi161 ceph-mon[99580]: pgmap v630: 97 pgs: 97 active+clean; 12 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 40 MiB/s wr, 30 op/s 2023-09-23T09:16:56.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:16:55 smithi135 ceph-mon[99205]: pgmap v630: 97 pgs: 97 active+clean; 12 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 40 MiB/s wr, 30 op/s 2023-09-23T09:16:59.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:16:58 smithi135 ceph-mon[99205]: pgmap v631: 97 pgs: 97 active+clean; 12 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 MiB/s wr, 20 op/s 2023-09-23T09:16:59.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:16:58 smithi082 ceph-mon[97694]: pgmap v631: 97 pgs: 97 active+clean; 12 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 MiB/s wr, 20 op/s 2023-09-23T09:16:59.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:16:58 smithi161 ceph-mon[99580]: pgmap v631: 97 pgs: 97 active+clean; 12 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 MiB/s wr, 20 op/s 2023-09-23T09:17:01.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:17:00 smithi135 ceph-mon[99205]: pgmap v632: 97 pgs: 97 active+clean; 12 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 40 MiB/s wr, 31 op/s 2023-09-23T09:17:01.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:17:00 smithi082 ceph-mon[97694]: pgmap v632: 97 pgs: 97 active+clean; 12 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 40 MiB/s wr, 31 op/s 2023-09-23T09:17:01.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:17:00 smithi161 ceph-mon[99580]: pgmap v632: 97 pgs: 97 active+clean; 12 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 40 MiB/s wr, 31 op/s 2023-09-23T09:17:03.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:17:02 smithi135 ceph-mon[99205]: pgmap v633: 97 pgs: 97 active+clean; 12 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 MiB/s wr, 20 op/s 2023-09-23T09:17:03.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:17:02 smithi082 ceph-mon[97694]: pgmap v633: 97 pgs: 97 active+clean; 12 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 MiB/s wr, 20 op/s 2023-09-23T09:17:03.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:17:02 smithi161 ceph-mon[99580]: pgmap v633: 97 pgs: 97 active+clean; 12 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 MiB/s wr, 20 op/s 2023-09-23T09:17:05.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:17:04 smithi135 ceph-mon[99205]: pgmap v634: 97 pgs: 97 active+clean; 12 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 MiB/s wr, 20 op/s 2023-09-23T09:17:05.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:17:04 smithi082 ceph-mon[97694]: pgmap v634: 97 pgs: 97 active+clean; 12 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 MiB/s wr, 20 op/s 2023-09-23T09:17:05.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:17:04 smithi161 ceph-mon[99580]: pgmap v634: 97 pgs: 97 active+clean; 12 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 MiB/s wr, 20 op/s 2023-09-23T09:17:07.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:17:06 smithi135 ceph-mon[99205]: pgmap v635: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 40 MiB/s wr, 45 op/s 2023-09-23T09:17:07.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:17:06 smithi082 ceph-mon[97694]: pgmap v635: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 40 MiB/s wr, 45 op/s 2023-09-23T09:17:07.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:17:06 smithi161 ceph-mon[99580]: pgmap v635: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 40 MiB/s wr, 45 op/s 2023-09-23T09:17:08.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:17:07 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:17:08.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:17:07 smithi135 ceph-mon[99205]: osdmap e116: 12 total, 12 up, 12 in 2023-09-23T09:17:08.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:17:07 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:17:08.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:17:07 smithi082 ceph-mon[97694]: osdmap e116: 12 total, 12 up, 12 in 2023-09-23T09:17:08.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:17:07 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:17:08.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:17:07 smithi161 ceph-mon[99580]: osdmap e116: 12 total, 12 up, 12 in 2023-09-23T09:17:09.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:17:08 smithi135 ceph-mon[99205]: pgmap v637: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 32 MiB/s wr, 42 op/s 2023-09-23T09:17:09.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:17:08 smithi082 ceph-mon[97694]: pgmap v637: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 32 MiB/s wr, 42 op/s 2023-09-23T09:17:09.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:17:08 smithi161 ceph-mon[99580]: pgmap v637: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 32 MiB/s wr, 42 op/s 2023-09-23T09:17:10.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:17:09 smithi135 ceph-mon[99205]: pgmap v638: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 30 MiB/s wr, 42 op/s 2023-09-23T09:17:10.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:17:09 smithi082 ceph-mon[97694]: pgmap v638: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 30 MiB/s wr, 42 op/s 2023-09-23T09:17:10.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:17:09 smithi161 ceph-mon[99580]: pgmap v638: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 30 MiB/s wr, 42 op/s 2023-09-23T09:17:10.740 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:17:10.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.977+0000 7f8f6bdff700 1 -- 172.21.15.82:0/341645129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f64103480 msgr2=0x7f8f6410f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:17:10.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.977+0000 7f8f6bdff700 1 --2- 172.21.15.82:0/341645129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f64103480 0x7f8f6410f990 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c00b0a0 tx=0x7f8f5c00b3b0 comp rx=0 tx=0).stop 2023-09-23T09:17:10.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.977+0000 7f8f6bdff700 1 -- 172.21.15.82:0/341645129 shutdown_connections 2023-09-23T09:17:10.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.977+0000 7f8f6bdff700 1 --2- 172.21.15.82:0/341645129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f64103480 0x7f8f6410f990 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:17:10.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.977+0000 7f8f6bdff700 1 --2- 172.21.15.82:0/341645129 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8f64108ad0 0x7f8f64108eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:17:10.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.977+0000 7f8f6bdff700 1 --2- 172.21.15.82:0/341645129 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f64102ac0 0x7f8f64102f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:17:10.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.977+0000 7f8f6bdff700 1 -- 172.21.15.82:0/341645129 >> 172.21.15.82:0/341645129 conn(0x7f8f640fe570 msgr2=0x7f8f64100990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:17:10.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.977+0000 7f8f6bdff700 1 -- 172.21.15.82:0/341645129 shutdown_connections 2023-09-23T09:17:10.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.977+0000 7f8f6bdff700 1 -- 172.21.15.82:0/341645129 wait complete. 2023-09-23T09:17:10.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.978+0000 7f8f6bdff700 1 Processor -- start 2023-09-23T09:17:10.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.979+0000 7f8f6bdff700 1 -- start start 2023-09-23T09:17:10.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.979+0000 7f8f6bdff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f64102ac0 0x7f8f6419e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:17:10.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.979+0000 7f8f6bdff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f64103480 0x7f8f6419ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:17:10.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.979+0000 7f8f6bdff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8f64108ad0 0x7f8f641988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:17:10.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.979+0000 7f8f6bdff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f64198f30 con 0x7f8f64102ac0 2023-09-23T09:17:10.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.979+0000 7f8f6bdff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f641990a0 con 0x7f8f64103480 2023-09-23T09:17:10.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.979+0000 7f8f6bdff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f64199260 con 0x7f8f64108ad0 2023-09-23T09:17:10.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.979+0000 7f8f6939a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f64103480 0x7f8f6419ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:17:10.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.979+0000 7f8f69b9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f64102ac0 0x7f8f6419e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:17:10.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.979+0000 7f8f6939a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f64103480 0x7f8f6419ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:40058/0 (socket says 172.21.15.82:40058) 2023-09-23T09:17:10.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.979+0000 7f8f6939a700 1 -- 172.21.15.82:0/565213513 learned_addr learned my addr 172.21.15.82:0/565213513 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:17:10.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.980+0000 7f8f6a39c700 1 --2- 172.21.15.82:0/565213513 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8f64108ad0 0x7f8f641988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:17:10.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.980+0000 7f8f6939a700 1 -- 172.21.15.82:0/565213513 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8f64108ad0 msgr2=0x7f8f641988c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:17:10.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.980+0000 7f8f6939a700 1 --2- 172.21.15.82:0/565213513 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8f64108ad0 0x7f8f641988c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:17:10.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.980+0000 7f8f6939a700 1 -- 172.21.15.82:0/565213513 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f64102ac0 msgr2=0x7f8f6419e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:17:10.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.980+0000 7f8f6939a700 1 --2- 172.21.15.82:0/565213513 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f64102ac0 0x7f8f6419e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:17:10.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.980+0000 7f8f6939a700 1 -- 172.21.15.82:0/565213513 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f5c009d00 con 0x7f8f64103480 2023-09-23T09:17:10.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.980+0000 7f8f6939a700 1 --2- 172.21.15.82:0/565213513 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f64103480 0x7f8f6419ed90 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8f5400d980 tx=0x7f8f5400dc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:17:10.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.980+0000 7f8f5affd700 1 -- 172.21.15.82:0/565213513 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f54004220 con 0x7f8f64103480 2023-09-23T09:17:10.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.981+0000 7f8f5affd700 1 -- 172.21.15.82:0/565213513 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8f54007640 con 0x7f8f64103480 2023-09-23T09:17:10.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.981+0000 7f8f6bdff700 1 -- 172.21.15.82:0/565213513 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f64199540 con 0x7f8f64103480 2023-09-23T09:17:10.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.981+0000 7f8f5affd700 1 -- 172.21.15.82:0/565213513 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f54005660 con 0x7f8f64103480 2023-09-23T09:17:10.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.981+0000 7f8f6bdff700 1 -- 172.21.15.82:0/565213513 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f641a5840 con 0x7f8f64103480 2023-09-23T09:17:10.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.985+0000 7f8f5affd700 1 -- 172.21.15.82:0/565213513 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f8f54004750 con 0x7f8f64103480 2023-09-23T09:17:10.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.986+0000 7f8f7f79fb80 1 Processor -- start 2023-09-23T09:17:10.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.986+0000 7f8f7f79fb80 1 -- start start 2023-09-23T09:17:10.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.986+0000 7f8f5affd700 1 --2- 172.21.15.82:0/565213513 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f8f500a0140 0x7f8f500a2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:17:10.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.986+0000 7f8f5affd700 1 -- 172.21.15.82:0/565213513 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 8557+0+0 (secure 0 0 0) 0x7f8f540cb330 con 0x7f8f64103480 2023-09-23T09:17:10.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.986+0000 7f8f7f79fb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b1e3e53380 0x55b1e3e53760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:17:10.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.986+0000 7f8f7f79fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b1e3e53ca0 0x55b1e3e4d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:17:10.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.986+0000 7f8f7f79fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b1e3e4dc40 0x55b1e3e4e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:17:10.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.987+0000 7f8f7f79fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1e3db57b0 con 0x55b1e3e53ca0 2023-09-23T09:17:10.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.987+0000 7f8f7f79fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1e3da6780 con 0x55b1e3e4dc40 2023-09-23T09:17:10.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.987+0000 7f8f7f79fb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1e3da40a0 con 0x55b1e3e53380 2023-09-23T09:17:10.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.987+0000 7f8f6a39c700 1 --2- 172.21.15.82:0/565213513 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f8f500a0140 0x7f8f500a2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:17:10.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.987+0000 7f8f69b9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b1e3e53380 0x55b1e3e53760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:17:10.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.987+0000 7f8f69b9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b1e3e53380 0x55b1e3e53760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:42072/0 (socket says 172.21.15.82:42072) 2023-09-23T09:17:10.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.987+0000 7f8f69b9b700 1 -- 172.21.15.82:0/3317070118 learned_addr learned my addr 172.21.15.82:0/3317070118 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:17:10.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.987+0000 7f8f6939a700 1 --2- 172.21.15.82:0/3317070118 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b1e3e53ca0 0x55b1e3e4d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:17:10.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.987+0000 7f8f6a39c700 1 --2- 172.21.15.82:0/3317070118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b1e3e4dc40 0x55b1e3e4e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:17:10.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.987+0000 7f8f69b9b700 1 -- 172.21.15.82:0/3317070118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b1e3e4dc40 msgr2=0x55b1e3e4e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:17:10.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.987+0000 7f8f69b9b700 1 --2- 172.21.15.82:0/3317070118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b1e3e4dc40 0x55b1e3e4e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:17:10.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.987+0000 7f8f69b9b700 1 -- 172.21.15.82:0/3317070118 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b1e3e53ca0 msgr2=0x55b1e3e4d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:17:10.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.987+0000 7f8f69b9b700 1 --2- 172.21.15.82:0/3317070118 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b1e3e53ca0 0x55b1e3e4d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:17:10.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.987+0000 7f8f69b9b700 1 -- 172.21.15.82:0/3317070118 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b1e3c1f630 con 0x55b1e3e53380 2023-09-23T09:17:10.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.988+0000 7f8f6a39c700 1 --2- 172.21.15.82:0/565213513 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f8f500a0140 0x7f8f500a2600 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c00b780 tx=0x7f8f5c00bee0 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:17:10.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.988+0000 7f8f69b9b700 1 --2- 172.21.15.82:0/3317070118 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b1e3e53380 0x55b1e3e53760 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8f60009d00 tx=0x7f8f60011720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7881d339449f3efa server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:17:10.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.988+0000 7f8f4ffff700 1 -- 172.21.15.82:0/3317070118 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f60019630 con 0x55b1e3e53380 2023-09-23T09:17:10.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.988+0000 7f8f4ffff700 1 -- 172.21.15.82:0/3317070118 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8f60019c20 con 0x55b1e3e53380 2023-09-23T09:17:10.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.988+0000 7f8f4ffff700 1 -- 172.21.15.82:0/3317070118 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f6000eab0 con 0x55b1e3e53380 2023-09-23T09:17:10.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.989+0000 7f8f7f79fb80 1 -- 172.21.15.82:0/3317070118 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b1e3e53380 msgr2=0x55b1e3e53760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:17:10.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.989+0000 7f8f7f79fb80 1 --2- 172.21.15.82:0/3317070118 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b1e3e53380 0x55b1e3e53760 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8f60009d00 tx=0x7f8f60011720 comp rx=0 tx=0).stop 2023-09-23T09:17:10.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.989+0000 7f8f7f79fb80 1 -- 172.21.15.82:0/3317070118 shutdown_connections 2023-09-23T09:17:10.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.989+0000 7f8f7f79fb80 1 --2- 172.21.15.82:0/3317070118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b1e3e4dc40 0x55b1e3e4e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:17:10.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.989+0000 7f8f7f79fb80 1 --2- 172.21.15.82:0/3317070118 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b1e3e53380 0x55b1e3e53760 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:17:10.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.989+0000 7f8f7f79fb80 1 --2- 172.21.15.82:0/3317070118 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b1e3e53ca0 0x55b1e3e4d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:17:10.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.989+0000 7f8f7f79fb80 1 -- 172.21.15.82:0/3317070118 >> 172.21.15.82:0/3317070118 conn(0x55b1e3dc20e0 msgr2=0x55b1e3e48410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:17:10.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.989+0000 7f8f7f79fb80 1 -- 172.21.15.82:0/3317070118 shutdown_connections 2023-09-23T09:17:10.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.989+0000 7f8f7f79fb80 1 -- 172.21.15.82:0/3317070118 wait complete. 2023-09-23T09:17:10.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.989+0000 7f8f7f79fb80 1 -- start start 2023-09-23T09:17:10.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.990+0000 7f8f7f79fb80 1 Processor -- start 2023-09-23T09:17:10.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.990+0000 7f8f7f79fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b1e3e4dc40 0x55b1e3e59c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:17:10.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.990+0000 7f8f7f79fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b1e3e53380 0x55b1e3e56ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:17:10.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.990+0000 7f8f7f79fb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b1e3e53ca0 0x55b1e3e57600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:17:10.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.990+0000 7f8f7f79fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1e3d9f990 con 0x55b1e3e53380 2023-09-23T09:17:10.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.990+0000 7f8f7f79fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1e3d3dbb0 con 0x55b1e3e4dc40 2023-09-23T09:17:10.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.990+0000 7f8f7f79fb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1e3d3d8b0 con 0x55b1e3e53ca0 2023-09-23T09:17:10.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.990+0000 7f8f7f79fb80 10 client.0 _ll_register_callbacks cb 0x55b1e3c87a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:17:10.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.991+0000 7f8f69b9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b1e3e4dc40 0x55b1e3e59c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:17:10.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.991+0000 7f8f6a39c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b1e3e53ca0 0x55b1e3e57600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:17:10.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.991+0000 7f8f69b9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b1e3e4dc40 0x55b1e3e59c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:40072/0 (socket says 172.21.15.82:40072) 2023-09-23T09:17:10.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.991+0000 7f8f6a39c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b1e3e53ca0 0x55b1e3e57600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:42084/0 (socket says 172.21.15.82:42084) 2023-09-23T09:17:10.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.991+0000 7f8f69b9b700 1 -- 172.21.15.82:0/2550443977 learned_addr learned my addr 172.21.15.82:0/2550443977 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:17:10.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.991+0000 7f8f6939a700 1 --2- 172.21.15.82:0/2550443977 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b1e3e53380 0x55b1e3e56ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:17:10.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.991+0000 7f8f6a39c700 1 -- 172.21.15.82:0/2550443977 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b1e3e4dc40 msgr2=0x55b1e3e59c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:17:10.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.991+0000 7f8f6a39c700 1 --2- 172.21.15.82:0/2550443977 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b1e3e4dc40 0x55b1e3e59c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:17:10.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.991+0000 7f8f6a39c700 1 -- 172.21.15.82:0/2550443977 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b1e3e53380 msgr2=0x55b1e3e56ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:17:10.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.991+0000 7f8f6a39c700 1 --2- 172.21.15.82:0/2550443977 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b1e3e53380 0x55b1e3e56ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:17:10.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.991+0000 7f8f6a39c700 1 -- 172.21.15.82:0/2550443977 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f60009960 con 0x55b1e3e53ca0 2023-09-23T09:17:10.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.991+0000 7f8f69b9b700 1 --2- 172.21.15.82:0/2550443977 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b1e3e4dc40 0x55b1e3e59c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:17:10.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.991+0000 7f8f6939a700 1 --2- 172.21.15.82:0/2550443977 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b1e3e53380 0x55b1e3e56ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:17:10.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.991+0000 7f8f6a39c700 1 --2- 172.21.15.82:0/2550443977 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b1e3e53ca0 0x55b1e3e57600 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c0062a0 tx=0x7f8f5c00b3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c63138127a0afc5 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:17:10.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.991+0000 7f8f4d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T09:17:10.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.992+0000 7f8f4d7fa700 1 -- 172.21.15.82:0/2550443977 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f5c00e040 con 0x55b1e3e53ca0 2023-09-23T09:17:10.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.992+0000 7f8f7f79fb80 1 -- 172.21.15.82:0/2550443977 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b1e3e1d1c0 con 0x55b1e3e53ca0 2023-09-23T09:17:10.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.992+0000 7f8f4d7fa700 1 -- 172.21.15.82:0/2550443977 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(116..116 src has 1..116) v4 ==== 8557+0+0 (secure 0 0 0) 0x7f8f5c01fa50 con 0x55b1e3e53ca0 2023-09-23T09:17:10.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.992+0000 7f8f4d7fa700 1 -- 172.21.15.82:0/2550443977 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8f5c01fc10 con 0x55b1e3e53ca0 2023-09-23T09:17:10.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.992+0000 7f8f7f79fb80 10 client.26584 fetch_fsmap learned FSMap version 73 2023-09-23T09:17:10.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.992+0000 7f8f7f79fb80 1 -- 172.21.15.82:0/2550443977 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=4+}) v3 -- 0x55b1e3bcbde0 con 0x55b1e3e53ca0 2023-09-23T09:17:11.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.992+0000 7f8f4d7fa700 1 -- 172.21.15.82:0/2550443977 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8f5c039020 con 0x55b1e3e53ca0 2023-09-23T09:17:11.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.992+0000 7f8f4d7fa700 1 -- 172.21.15.82:0/2550443977 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 73) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f8f5c02c430 con 0x55b1e3e53ca0 2023-09-23T09:17:11.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.993+0000 7f8f7f79fb80 10 client.26584 fetch_fsmap finished waiting for FSMap version 73 2023-09-23T09:17:11.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.993+0000 7f8f7f79fb80 10 client.26584 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:17:11.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.993+0000 7f8f7f79fb80 20 client.26584 populate_metadata read hostname 'smithi082' 2023-09-23T09:17:11.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.993+0000 7f8f7f79fb80 1 --2- 172.21.15.82:0/2550443977 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55b1e3e67780 0x55b1e3e69ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:17:11.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.993+0000 7f8f7f79fb80 4 client.26584 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:17:11.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.993+0000 7f8f7f79fb80 1 -- 172.21.15.82:0/2550443977 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b1e3d45ba0 con 0x55b1e3e67780 2023-09-23T09:17:11.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.993+0000 7f8f69b9b700 1 --2- 172.21.15.82:0/2550443977 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55b1e3e67780 0x55b1e3e69ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:17:11.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.994+0000 7f8f4d7fa700 10 client.26584 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:17:11.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.994+0000 7f8f69b9b700 1 --2- 172.21.15.82:0/2550443977 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55b1e3e67780 0x55b1e3e69ba0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9118f92038b5c3a0 server_cookie=5b63a7fb69c5a58a in_seq=0 out_seq=0 2023-09-23T09:17:11.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.994+0000 7f8f4d7fa700 1 -- 172.21.15.82:0/2550443977 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b1e3d45ba0 con 0x55b1e3e67780 2023-09-23T09:17:11.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.994+0000 7f8f4d7fa700 10 client.26584 handle_command_reply: tid=0 2023-09-23T09:17:11.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.994+0000 7f8f7f79fb80 1 client.26584 shutdown 2023-09-23T09:17:11.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.995+0000 7f8f7f79fb80 1 -- 172.21.15.82:0/2550443977 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b1e3e53ca0 msgr2=0x55b1e3e57600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:17:11.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.995+0000 7f8f7f79fb80 1 --2- 172.21.15.82:0/2550443977 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b1e3e53ca0 0x55b1e3e57600 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c0062a0 tx=0x7f8f5c00b3b0 comp rx=0 tx=0).stop 2023-09-23T09:17:11.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.995+0000 7f8f7f79fb80 1 -- 172.21.15.82:0/2550443977 shutdown_connections 2023-09-23T09:17:11.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.995+0000 7f8f7f79fb80 1 --2- 172.21.15.82:0/2550443977 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b1e3e53ca0 0x55b1e3e57600 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:17:11.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.995+0000 7f8f7f79fb80 1 --2- 172.21.15.82:0/2550443977 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b1e3e4dc40 0x55b1e3e59c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:17:11.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.995+0000 7f8f7f79fb80 1 --2- 172.21.15.82:0/2550443977 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55b1e3e67780 0x55b1e3e69ba0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:17:11.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.995+0000 7f8f7f79fb80 1 --2- 172.21.15.82:0/2550443977 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b1e3e53380 0x55b1e3e56ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:17:11.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.995+0000 7f8f4d7fa700 0 client.26584 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:17:11.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.995+0000 7f8f7f79fb80 1 -- 172.21.15.82:0/2550443977 >> 172.21.15.82:0/2550443977 conn(0x55b1e3dc20e0 msgr2=0x55b1e3e42b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:17:11.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.995+0000 7f8f7f79fb80 1 -- 172.21.15.82:0/2550443977 shutdown_connections 2023-09-23T09:17:11.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.995+0000 7f8f7f79fb80 1 -- 172.21.15.82:0/2550443977 wait complete. 2023-09-23T09:17:11.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:10.995+0000 7f8f7f79fb80 20 client.26584 trim_cache size 0 max 16384 2023-09-23T09:17:11.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.014+0000 7f8f7f79fb80 1 Processor -- start 2023-09-23T09:17:11.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.014+0000 7f8f7f79fb80 1 -- start start 2023-09-23T09:17:11.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.014+0000 7f8f7f79fb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b1e3e4dc40 0x55b1e3e4d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:17:11.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.014+0000 7f8f7f79fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b1e3e53380 0x55b1e3e50fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:17:11.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.015+0000 7f8f7f79fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b1e3e53ca0 0x55b1e3e514f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:17:11.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.015+0000 7f8f7f79fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1e3c21920 con 0x55b1e3e53380 2023-09-23T09:17:11.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.015+0000 7f8f7f79fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1e3e44a40 con 0x55b1e3e53ca0 2023-09-23T09:17:11.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.015+0000 7f8f7f79fb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1e3e490c0 con 0x55b1e3e4dc40 2023-09-23T09:17:11.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.015+0000 7f8f6939a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b1e3e53380 0x55b1e3e50fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:17:11.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.015+0000 7f8f69b9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b1e3e4dc40 0x55b1e3e4d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:17:11.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.015+0000 7f8f69b9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b1e3e4dc40 0x55b1e3e4d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:42092/0 (socket says 172.21.15.82:42092) 2023-09-23T09:17:11.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.015+0000 7f8f69b9b700 1 -- 172.21.15.82:0/2882040604 learned_addr learned my addr 172.21.15.82:0/2882040604 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:17:11.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.015+0000 7f8f6939a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b1e3e53380 0x55b1e3e50fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37072/0 (socket says 172.21.15.82:37072) 2023-09-23T09:17:11.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.015+0000 7f8f6a39c700 1 --2- 172.21.15.82:0/2882040604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b1e3e53ca0 0x55b1e3e514f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:17:11.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.015+0000 7f8f6939a700 1 -- 172.21.15.82:0/2882040604 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b1e3e4dc40 msgr2=0x55b1e3e4d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:17:11.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.015+0000 7f8f6939a700 1 --2- 172.21.15.82:0/2882040604 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b1e3e4dc40 0x55b1e3e4d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:17:11.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.015+0000 7f8f6939a700 1 -- 172.21.15.82:0/2882040604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b1e3e53ca0 msgr2=0x55b1e3e514f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:17:11.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.015+0000 7f8f6939a700 1 --2- 172.21.15.82:0/2882040604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b1e3e53ca0 0x55b1e3e514f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:17:11.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.015+0000 7f8f6939a700 1 -- 172.21.15.82:0/2882040604 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b1e3bb4c60 con 0x55b1e3e53380 2023-09-23T09:17:11.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.015+0000 7f8f69b9b700 1 --2- 172.21.15.82:0/2882040604 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b1e3e4dc40 0x55b1e3e4d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:17:11.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.016+0000 7f8f6939a700 1 --2- 172.21.15.82:0/2882040604 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b1e3e53380 0x55b1e3e50fb0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f8f540c8a60 tx=0x7f8f54019eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7440d5bfc820c8fe server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:17:11.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.016+0000 7f8f58bff700 1 -- 172.21.15.82:0/2882040604 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f54098a20 con 0x55b1e3e53380 2023-09-23T09:17:11.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.016+0000 7f8f58bff700 1 -- 172.21.15.82:0/2882040604 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8f5409c850 con 0x55b1e3e53380 2023-09-23T09:17:11.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.016+0000 7f8f58bff700 1 -- 172.21.15.82:0/2882040604 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f54097f10 con 0x55b1e3e53380 2023-09-23T09:17:11.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.017+0000 7f8f7f79fb80 1 -- 172.21.15.82:0/2882040604 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b1e3e53380 msgr2=0x55b1e3e50fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:17:11.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.017+0000 7f8f7f79fb80 1 --2- 172.21.15.82:0/2882040604 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b1e3e53380 0x55b1e3e50fb0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f8f540c8a60 tx=0x7f8f54019eb0 comp rx=0 tx=0).stop 2023-09-23T09:17:11.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.017+0000 7f8f7f79fb80 1 -- 172.21.15.82:0/2882040604 shutdown_connections 2023-09-23T09:17:11.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.017+0000 7f8f7f79fb80 1 --2- 172.21.15.82:0/2882040604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b1e3e53ca0 0x55b1e3e514f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:17:11.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.017+0000 7f8f7f79fb80 1 --2- 172.21.15.82:0/2882040604 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b1e3e4dc40 0x55b1e3e4d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:17:11.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.017+0000 7f8f7f79fb80 1 --2- 172.21.15.82:0/2882040604 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b1e3e53380 0x55b1e3e50fb0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:17:11.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.017+0000 7f8f7f79fb80 1 -- 172.21.15.82:0/2882040604 >> 172.21.15.82:0/2882040604 conn(0x55b1e3dc20e0 msgr2=0x55b1e3e62ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:17:11.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.017+0000 7f8f7f79fb80 1 -- 172.21.15.82:0/2882040604 shutdown_connections 2023-09-23T09:17:11.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.017+0000 7f8f7f79fb80 1 -- 172.21.15.82:0/2882040604 wait complete. 2023-09-23T09:17:11.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.017+0000 7f8f7f79fb80 1 -- start start 2023-09-23T09:17:11.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.018+0000 7f8f7f79fb80 1 Processor -- start 2023-09-23T09:17:11.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.018+0000 7f8f7f79fb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b1e3e4dc40 0x55b1e3e4ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:17:11.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.018+0000 7f8f7f79fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b1e3e53380 0x55b1e3e50510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:17:11.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.018+0000 7f8f7f79fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b1e3e53ca0 0x55b1e3e4ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:17:11.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.018+0000 7f8f7f79fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1e3e4f340 con 0x55b1e3e53ca0 2023-09-23T09:17:11.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.018+0000 7f8f7f79fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1e3e4f4b0 con 0x55b1e3e53380 2023-09-23T09:17:11.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.018+0000 7f8f7f79fb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1e3e4f670 con 0x55b1e3e4dc40 2023-09-23T09:17:11.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.018+0000 7f8f7f79fb80 10 client.0 _ll_register_callbacks cb 0x7f8f5c004ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:17:11.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.018+0000 7f8f69b9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b1e3e4dc40 0x55b1e3e4ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:17:11.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.018+0000 7f8f69b9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b1e3e4dc40 0x55b1e3e4ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:42108/0 (socket says 172.21.15.82:42108) 2023-09-23T09:17:11.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.018+0000 7f8f69b9b700 1 -- 172.21.15.82:0/3930986731 learned_addr learned my addr 172.21.15.82:0/3930986731 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:17:11.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.018+0000 7f8f6939a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b1e3e53380 0x55b1e3e50510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:17:11.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.019+0000 7f8f6a39c700 1 --2- 172.21.15.82:0/3930986731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b1e3e53ca0 0x55b1e3e4ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:17:11.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.019+0000 7f8f69b9b700 1 -- 172.21.15.82:0/3930986731 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b1e3e53380 msgr2=0x55b1e3e50510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:17:11.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.019+0000 7f8f69b9b700 1 --2- 172.21.15.82:0/3930986731 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b1e3e53380 0x55b1e3e50510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:17:11.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.019+0000 7f8f69b9b700 1 -- 172.21.15.82:0/3930986731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b1e3e53ca0 msgr2=0x55b1e3e4ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:17:11.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.019+0000 7f8f69b9b700 1 --2- 172.21.15.82:0/3930986731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b1e3e53ca0 0x55b1e3e4ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:17:11.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.019+0000 7f8f69b9b700 1 -- 172.21.15.82:0/3930986731 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b1e3c1f630 con 0x55b1e3e4dc40 2023-09-23T09:17:11.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.019+0000 7f8f6a39c700 1 --2- 172.21.15.82:0/3930986731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b1e3e53ca0 0x55b1e3e4ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:17:11.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.019+0000 7f8f6939a700 1 --2- 172.21.15.82:0/3930986731 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b1e3e53380 0x55b1e3e50510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:17:11.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.019+0000 7f8f69b9b700 1 --2- 172.21.15.82:0/3930986731 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b1e3e4dc40 0x55b1e3e4ffd0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8f60009f50 tx=0x7f8f60011ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6f32db1b2b0c8d7 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:17:11.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.019+0000 7f8f4d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T09:17:11.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.020+0000 7f8f4d7fa700 1 -- 172.21.15.82:0/3930986731 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f60005450 con 0x55b1e3e4dc40 2023-09-23T09:17:11.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.020+0000 7f8f4d7fa700 1 -- 172.21.15.82:0/3930986731 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(116..116 src has 1..116) v4 ==== 8557+0+0 (secure 0 0 0) 0x7f8f600055b0 con 0x55b1e3e4dc40 2023-09-23T09:17:11.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.020+0000 7f8f7f79fb80 1 -- 172.21.15.82:0/3930986731 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b1e3e408b0 con 0x55b1e3e4dc40 2023-09-23T09:17:11.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.020+0000 7f8f4d7fa700 1 -- 172.21.15.82:0/3930986731 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8f6000e680 con 0x55b1e3e4dc40 2023-09-23T09:17:11.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.020+0000 7f8f7f79fb80 10 client.26590 fetch_fsmap learned FSMap version 73 2023-09-23T09:17:11.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.020+0000 7f8f7f79fb80 1 -- 172.21.15.82:0/3930986731 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=4+}) v3 -- 0x7f8f641a5840 con 0x55b1e3e4dc40 2023-09-23T09:17:11.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.020+0000 7f8f4d7fa700 1 -- 172.21.15.82:0/3930986731 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8f6003a080 con 0x55b1e3e4dc40 2023-09-23T09:17:11.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.020+0000 7f8f4d7fa700 1 -- 172.21.15.82:0/3930986731 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 73) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f8f60003820 con 0x55b1e3e4dc40 2023-09-23T09:17:11.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.020+0000 7f8f7f79fb80 10 client.26590 fetch_fsmap finished waiting for FSMap version 73 2023-09-23T09:17:11.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.020+0000 7f8f7f79fb80 10 client.26590 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:17:11.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.020+0000 7f8f7f79fb80 20 client.26590 populate_metadata read hostname 'smithi082' 2023-09-23T09:17:11.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.020+0000 7f8f7f79fb80 1 --2- 172.21.15.82:0/3930986731 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55b1e3ebc450 0x55b1e3ebe870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:17:11.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.020+0000 7f8f7f79fb80 4 client.26590 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:17:11.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.020+0000 7f8f7f79fb80 1 -- 172.21.15.82:0/3930986731 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55b1e3d98970 con 0x55b1e3ebc450 2023-09-23T09:17:11.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.021+0000 7f8f6939a700 1 --2- 172.21.15.82:0/3930986731 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55b1e3ebc450 0x55b1e3ebe870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:17:11.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.021+0000 7f8f4d7fa700 10 client.26590 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:17:11.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.021+0000 7f8f6939a700 1 --2- 172.21.15.82:0/3930986731 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55b1e3ebc450 0x55b1e3ebe870 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7cc00228509d216a server_cookie=d79c19bc344e53a4 in_seq=0 out_seq=0 2023-09-23T09:17:11.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.021+0000 7f8f4d7fa700 1 -- 172.21.15.82:0/3930986731 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55b1e3d98970 con 0x55b1e3ebc450 2023-09-23T09:17:11.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.021+0000 7f8f4d7fa700 10 client.26590 handle_command_reply: tid=0 2023-09-23T09:17:11.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.022+0000 7f8f7f79fb80 1 client.26590 shutdown 2023-09-23T09:17:11.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.022+0000 7f8f7f79fb80 1 -- 172.21.15.82:0/3930986731 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b1e3e4dc40 msgr2=0x55b1e3e4ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:17:11.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.022+0000 7f8f7f79fb80 1 --2- 172.21.15.82:0/3930986731 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b1e3e4dc40 0x55b1e3e4ffd0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8f60009f50 tx=0x7f8f60011ba0 comp rx=0 tx=0).stop 2023-09-23T09:17:11.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.022+0000 7f8f7f79fb80 1 -- 172.21.15.82:0/3930986731 shutdown_connections 2023-09-23T09:17:11.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.022+0000 7f8f7f79fb80 1 --2- 172.21.15.82:0/3930986731 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55b1e3ebc450 0x55b1e3ebe870 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:17:11.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.022+0000 7f8f7f79fb80 1 --2- 172.21.15.82:0/3930986731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b1e3e53ca0 0x55b1e3e4ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:17:11.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.022+0000 7f8f7f79fb80 1 --2- 172.21.15.82:0/3930986731 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b1e3e4dc40 0x55b1e3e4ffd0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:17:11.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.022+0000 7f8f7f79fb80 1 --2- 172.21.15.82:0/3930986731 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b1e3e53380 0x55b1e3e50510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:17:11.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.022+0000 7f8f7f79fb80 1 -- 172.21.15.82:0/3930986731 >> 172.21.15.82:0/3930986731 conn(0x55b1e3dc20e0 msgr2=0x55b1e3e50fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:17:11.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.022+0000 7f8f4d7fa700 0 client.26590 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:17:11.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.022+0000 7f8f7f79fb80 1 -- 172.21.15.82:0/3930986731 shutdown_connections 2023-09-23T09:17:11.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.022+0000 7f8f7f79fb80 1 -- 172.21.15.82:0/3930986731 wait complete. 2023-09-23T09:17:11.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.022+0000 7f8f7f79fb80 20 client.26590 trim_cache size 0 max 16384 2023-09-23T09:17:11.029 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:17:11.029 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-23T09:17:11.029 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:17:11.029 INFO:teuthology.orchestra.run.smithi082.stdout: "047cbc72-e254-4787-b038-382de9c1a9a4": { 2023-09-23T09:17:11.030 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:17:11.030 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "047cbc72-e254-4787-b038-382de9c1a9a4", 2023-09-23T09:17:11.030 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:17:11.030 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:17:11.030 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:17:11.030 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:17:11.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.023+0000 7f8f6bdff700 1 -- 172.21.15.82:0/565213513 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f8f500a0140 msgr2=0x7f8f500a2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:17:11.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.023+0000 7f8f6bdff700 1 --2- 172.21.15.82:0/565213513 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f8f500a0140 0x7f8f500a2600 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c00b780 tx=0x7f8f5c00bee0 comp rx=0 tx=0).stop 2023-09-23T09:17:11.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.023+0000 7f8f6bdff700 1 -- 172.21.15.82:0/565213513 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f64103480 msgr2=0x7f8f6419ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:17:11.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.023+0000 7f8f6bdff700 1 --2- 172.21.15.82:0/565213513 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f64103480 0x7f8f6419ed90 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8f5400d980 tx=0x7f8f5400dc90 comp rx=0 tx=0).stop 2023-09-23T09:17:11.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.023+0000 7f8f6bdff700 1 -- 172.21.15.82:0/565213513 shutdown_connections 2023-09-23T09:17:11.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.023+0000 7f8f6bdff700 1 --2- 172.21.15.82:0/565213513 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f8f500a0140 0x7f8f500a2600 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:17:11.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.023+0000 7f8f6bdff700 1 --2- 172.21.15.82:0/565213513 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8f64108ad0 0x7f8f641988c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:17:11.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.023+0000 7f8f6bdff700 1 --2- 172.21.15.82:0/565213513 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f64102ac0 0x7f8f6419e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:17:11.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.023+0000 7f8f6bdff700 1 --2- 172.21.15.82:0/565213513 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f64103480 0x7f8f6419ed90 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:17:11.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.023+0000 7f8f6bdff700 1 -- 172.21.15.82:0/565213513 >> 172.21.15.82:0/565213513 conn(0x7f8f640fe570 msgr2=0x7f8f640feb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:17:11.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.023+0000 7f8f6bdff700 1 -- 172.21.15.82:0/565213513 shutdown_connections 2023-09-23T09:17:11.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:11.023+0000 7f8f6bdff700 1 -- 172.21.15.82:0/565213513 wait complete. 2023-09-23T09:17:11.045 INFO:tasks.cephfs.filesystem:scrub status for tag:047cbc72-e254-4787-b038-382de9c1a9a4 - {'path': '/', 'tag': '047cbc72-e254-4787-b038-382de9c1a9a4', 'options': 'recursive,force'} 2023-09-23T09:17:13.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:17:12 smithi135 ceph-mon[99205]: pgmap v639: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 30 MiB/s wr, 42 op/s 2023-09-23T09:17:13.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:17:12 smithi135 ceph-mon[99205]: osdmap e117: 12 total, 12 up, 12 in 2023-09-23T09:17:13.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:17:12 smithi082 ceph-mon[97694]: pgmap v639: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 30 MiB/s wr, 42 op/s 2023-09-23T09:17:13.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:17:12 smithi082 ceph-mon[97694]: osdmap e117: 12 total, 12 up, 12 in 2023-09-23T09:17:13.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:17:12 smithi161 ceph-mon[99580]: pgmap v639: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 30 MiB/s wr, 42 op/s 2023-09-23T09:17:13.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:17:12 smithi161 ceph-mon[99580]: osdmap e117: 12 total, 12 up, 12 in 2023-09-23T09:17:15.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:17:14 smithi135 ceph-mon[99205]: pgmap v641: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 18 MiB/s wr, 15 op/s 2023-09-23T09:17:15.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:17:14 smithi082 ceph-mon[97694]: pgmap v641: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 18 MiB/s wr, 15 op/s 2023-09-23T09:17:15.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:17:14 smithi161 ceph-mon[99580]: pgmap v641: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 18 MiB/s wr, 15 op/s 2023-09-23T09:17:17.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:17:16 smithi135 ceph-mon[99205]: pgmap v642: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 35 MiB/s wr, 29 op/s 2023-09-23T09:17:17.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:17:16 smithi082 ceph-mon[97694]: pgmap v642: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 35 MiB/s wr, 29 op/s 2023-09-23T09:17:17.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:17:16 smithi161 ceph-mon[99580]: pgmap v642: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 35 MiB/s wr, 29 op/s 2023-09-23T09:17:18.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:17:17 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:17:18.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:17:17 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:17:18.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:17:17 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:17:19.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:17:18 smithi135 ceph-mon[99205]: pgmap v643: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 30 MiB/s wr, 25 op/s 2023-09-23T09:17:19.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:17:18 smithi082 ceph-mon[97694]: pgmap v643: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 30 MiB/s wr, 25 op/s 2023-09-23T09:17:19.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:17:18 smithi161 ceph-mon[99580]: pgmap v643: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 30 MiB/s wr, 25 op/s 2023-09-23T09:17:20.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:17:19 smithi135 ceph-mon[99205]: pgmap v644: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 32 MiB/s wr, 25 op/s 2023-09-23T09:17:20.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:17:19 smithi082 ceph-mon[97694]: pgmap v644: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 32 MiB/s wr, 25 op/s 2023-09-23T09:17:20.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:17:19 smithi161 ceph-mon[99580]: pgmap v644: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 32 MiB/s wr, 25 op/s 2023-09-23T09:17:23.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:17:22 smithi135 ceph-mon[99205]: pgmap v645: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 32 MiB/s wr, 25 op/s 2023-09-23T09:17:23.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:17:22 smithi082 ceph-mon[97694]: pgmap v645: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 32 MiB/s wr, 25 op/s 2023-09-23T09:17:23.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:17:22 smithi161 ceph-mon[99580]: pgmap v645: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 32 MiB/s wr, 25 op/s 2023-09-23T09:17:25.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:17:24 smithi135 ceph-mon[99205]: pgmap v646: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 27 MiB/s wr, 22 op/s 2023-09-23T09:17:25.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:17:24 smithi082 ceph-mon[97694]: pgmap v646: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 27 MiB/s wr, 22 op/s 2023-09-23T09:17:25.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:17:24 smithi161 ceph-mon[99580]: pgmap v646: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 27 MiB/s wr, 22 op/s 2023-09-23T09:17:27.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:17:26 smithi135 ceph-mon[99205]: pgmap v647: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 40 MiB/s wr, 32 op/s 2023-09-23T09:17:27.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:17:26 smithi082 ceph-mon[97694]: pgmap v647: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 40 MiB/s wr, 32 op/s 2023-09-23T09:17:27.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:17:26 smithi161 ceph-mon[99580]: pgmap v647: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 40 MiB/s wr, 32 op/s 2023-09-23T09:17:29.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:17:28 smithi135 ceph-mon[99205]: pgmap v648: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 27 MiB/s wr, 22 op/s 2023-09-23T09:17:29.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:17:28 smithi082 ceph-mon[97694]: pgmap v648: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 27 MiB/s wr, 22 op/s 2023-09-23T09:17:29.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:17:28 smithi161 ceph-mon[99580]: pgmap v648: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 27 MiB/s wr, 22 op/s 2023-09-23T09:17:30.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:17:29 smithi082 ceph-mon[97694]: pgmap v649: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 40 MiB/s wr, 38 op/s 2023-09-23T09:17:30.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:17:29 smithi161 ceph-mon[99580]: pgmap v649: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 40 MiB/s wr, 38 op/s 2023-09-23T09:17:30.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:17:29 smithi135 ceph-mon[99205]: pgmap v649: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 40 MiB/s wr, 38 op/s 2023-09-23T09:17:33.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:17:32 smithi135 ceph-mon[99205]: pgmap v650: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 27 MiB/s wr, 27 op/s 2023-09-23T09:17:33.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:17:32 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:17:33.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:17:32 smithi082 ceph-mon[97694]: pgmap v650: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 27 MiB/s wr, 27 op/s 2023-09-23T09:17:33.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:17:32 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:17:33.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:17:32 smithi161 ceph-mon[99580]: pgmap v650: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 27 MiB/s wr, 27 op/s 2023-09-23T09:17:33.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:17:32 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:17:35.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:17:34 smithi135 ceph-mon[99205]: pgmap v651: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 27 MiB/s wr, 27 op/s 2023-09-23T09:17:35.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:17:34 smithi082 ceph-mon[97694]: pgmap v651: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 27 MiB/s wr, 27 op/s 2023-09-23T09:17:35.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:17:34 smithi161 ceph-mon[99580]: pgmap v651: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 27 MiB/s wr, 27 op/s 2023-09-23T09:17:37.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:17:36 smithi135 ceph-mon[99205]: pgmap v652: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 40 MiB/s wr, 38 op/s 2023-09-23T09:17:37.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:17:36 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:17:37.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:17:36 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:17:37.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:17:36 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:17:37.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:17:36 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:17:37.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:17:36 smithi082 ceph-mon[97694]: pgmap v652: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 40 MiB/s wr, 38 op/s 2023-09-23T09:17:37.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:17:36 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:17:37.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:17:36 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:17:37.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:17:36 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:17:37.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:17:36 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:17:37.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:17:36 smithi161 ceph-mon[99580]: pgmap v652: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 40 MiB/s wr, 38 op/s 2023-09-23T09:17:37.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:17:36 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:17:37.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:17:36 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:17:37.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:17:36 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:17:37.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:17:36 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:17:38.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:17:37 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:17:38.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:17:37 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:17:38.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:17:37 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:17:38.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:17:37 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:17:38.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:17:37 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:17:38.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:17:37 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:17:38.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:17:37 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:17:38.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:17:37 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:17:38.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:17:37 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:17:38.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:17:37 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:17:38.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:17:37 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:17:38.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:17:37 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:17:38.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:17:37 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:17:38.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:17:37 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:17:38.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:17:37 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:17:38.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:17:37 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:17:38.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:17:37 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:17:38.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:17:37 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:17:38.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:17:37 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:17:38.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:17:37 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:17:38.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:17:37 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:17:38.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:17:37 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:17:38.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:17:37 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:17:38.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:17:37 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:17:39.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:17:38 smithi135 ceph-mon[99205]: Adjusting osd_memory_target on smithi161 to 220.9M 2023-09-23T09:17:39.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:17:38 smithi135 ceph-mon[99205]: Unable to set osd_memory_target on smithi161 to 231676211: error parsing value: Value '231676211' is below minimum 939524096 2023-09-23T09:17:39.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:17:38 smithi135 ceph-mon[99205]: Adjusting osd_memory_target on smithi082 to 220.9M 2023-09-23T09:17:39.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:17:38 smithi135 ceph-mon[99205]: Unable to set osd_memory_target on smithi082 to 231651840: error parsing value: Value '231651840' is below minimum 939524096 2023-09-23T09:17:39.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:17:38 smithi135 ceph-mon[99205]: pgmap v653: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 27 MiB/s wr, 27 op/s 2023-09-23T09:17:39.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:17:38 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:17:39.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:17:38 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:17:39.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:17:38 smithi082 ceph-mon[97694]: Adjusting osd_memory_target on smithi161 to 220.9M 2023-09-23T09:17:39.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:17:38 smithi082 ceph-mon[97694]: Unable to set osd_memory_target on smithi161 to 231676211: error parsing value: Value '231676211' is below minimum 939524096 2023-09-23T09:17:39.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:17:38 smithi082 ceph-mon[97694]: Adjusting osd_memory_target on smithi082 to 220.9M 2023-09-23T09:17:39.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:17:38 smithi082 ceph-mon[97694]: Unable to set osd_memory_target on smithi082 to 231651840: error parsing value: Value '231651840' is below minimum 939524096 2023-09-23T09:17:39.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:17:38 smithi082 ceph-mon[97694]: pgmap v653: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 27 MiB/s wr, 27 op/s 2023-09-23T09:17:39.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:17:38 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:17:39.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:17:38 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:17:39.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:17:38 smithi161 ceph-mon[99580]: Adjusting osd_memory_target on smithi161 to 220.9M 2023-09-23T09:17:39.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:17:38 smithi161 ceph-mon[99580]: Unable to set osd_memory_target on smithi161 to 231676211: error parsing value: Value '231676211' is below minimum 939524096 2023-09-23T09:17:39.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:17:38 smithi161 ceph-mon[99580]: Adjusting osd_memory_target on smithi082 to 220.9M 2023-09-23T09:17:39.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:17:38 smithi161 ceph-mon[99580]: Unable to set osd_memory_target on smithi082 to 231651840: error parsing value: Value '231651840' is below minimum 939524096 2023-09-23T09:17:39.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:17:38 smithi161 ceph-mon[99580]: pgmap v653: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 27 MiB/s wr, 27 op/s 2023-09-23T09:17:39.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:17:38 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:17:39.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:17:38 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:17:40.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:17:39 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:17:40.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:17:39 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:17:40.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:17:39 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:17:40.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:17:39 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:17:40.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:17:39 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:17:40.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:17:39 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:17:40.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:17:39 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:17:40.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:17:39 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:17:40.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:17:39 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:17:40.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:17:39 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:17:40.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:17:39 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:17:40.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:17:39 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:17:40.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:17:39 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:17:40.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:17:39 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:17:40.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:17:39 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:17:40.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:17:39 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:17:40.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:17:39 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:17:40.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:17:39 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:17:40.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:17:39 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:17:40.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:17:39 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:17:40.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:17:39 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:17:41.046 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:17:41.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:17:40 smithi135 ceph-mon[99205]: Adjusting osd_memory_target on smithi135 to 220.9M 2023-09-23T09:17:41.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:17:40 smithi135 ceph-mon[99205]: Unable to set osd_memory_target on smithi135 to 231659008: error parsing value: Value '231659008' is below minimum 939524096 2023-09-23T09:17:41.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:17:40 smithi135 ceph-mon[99205]: pgmap v654: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 39 MiB/s wr, 38 op/s 2023-09-23T09:17:41.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:17:40 smithi082 ceph-mon[97694]: Adjusting osd_memory_target on smithi135 to 220.9M 2023-09-23T09:17:41.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:17:40 smithi082 ceph-mon[97694]: Unable to set osd_memory_target on smithi135 to 231659008: error parsing value: Value '231659008' is below minimum 939524096 2023-09-23T09:17:41.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:17:40 smithi082 ceph-mon[97694]: pgmap v654: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 39 MiB/s wr, 38 op/s 2023-09-23T09:17:41.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:17:40 smithi161 ceph-mon[99580]: Adjusting osd_memory_target on smithi135 to 220.9M 2023-09-23T09:17:41.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:17:40 smithi161 ceph-mon[99580]: Unable to set osd_memory_target on smithi135 to 231659008: error parsing value: Value '231659008' is below minimum 939524096 2023-09-23T09:17:41.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:17:40 smithi161 ceph-mon[99580]: pgmap v654: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 39 MiB/s wr, 38 op/s 2023-09-23T09:17:41.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.267+0000 7f11f1dff700 1 -- 172.21.15.82:0/225841933 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11ec073670 msgr2=0x7f11ec10cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:17:41.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.267+0000 7f11f1dff700 1 --2- 172.21.15.82:0/225841933 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11ec073670 0x7f11ec10cb90 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f11e0009990 tx=0x7f11e0009ca0 comp rx=0 tx=0).stop 2023-09-23T09:17:41.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.267+0000 7f11f1dff700 1 -- 172.21.15.82:0/225841933 shutdown_connections 2023-09-23T09:17:41.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.267+0000 7f11f1dff700 1 --2- 172.21.15.82:0/225841933 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f11ec10d0d0 0x7f11ec10f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:17:41.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.267+0000 7f11f1dff700 1 --2- 172.21.15.82:0/225841933 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f11ec072d50 0x7f11ec073130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:17:41.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.267+0000 7f11f1dff700 1 --2- 172.21.15.82:0/225841933 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11ec073670 0x7f11ec10cb90 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:17:41.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.267+0000 7f11f1dff700 1 -- 172.21.15.82:0/225841933 >> 172.21.15.82:0/225841933 conn(0x7f11ec0fc380 msgr2=0x7f11ec0fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:17:41.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.267+0000 7f11f1dff700 1 -- 172.21.15.82:0/225841933 shutdown_connections 2023-09-23T09:17:41.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.267+0000 7f11f1dff700 1 -- 172.21.15.82:0/225841933 wait complete. 2023-09-23T09:17:41.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.268+0000 7f11f1dff700 1 Processor -- start 2023-09-23T09:17:41.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.268+0000 7f11f1dff700 1 -- start start 2023-09-23T09:17:41.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.268+0000 7f11f1dff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f11ec072d50 0x7f11ec19e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:17:41.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.268+0000 7f11f1dff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11ec073670 0x7f11ec19edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:17:41.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.268+0000 7f11f1dff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f11ec10d0d0 0x7f11ec198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:17:41.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.268+0000 7f11f1dff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11ec198f90 con 0x7f11ec072d50 2023-09-23T09:17:41.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.268+0000 7f11f1dff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11ec199100 con 0x7f11ec073670 2023-09-23T09:17:41.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.268+0000 7f11f1dff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11ec1992c0 con 0x7f11ec10d0d0 2023-09-23T09:17:41.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.269+0000 7f11eb7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f11ec072d50 0x7f11ec19e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:17:41.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.269+0000 7f11eaffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11ec073670 0x7f11ec19edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:17:41.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.269+0000 7f11eaffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11ec073670 0x7f11ec19edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:51524/0 (socket says 172.21.15.82:51524) 2023-09-23T09:17:41.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.269+0000 7f11eaffd700 1 -- 172.21.15.82:0/2584425665 learned_addr learned my addr 172.21.15.82:0/2584425665 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:17:41.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.269+0000 7f11ebfff700 1 --2- 172.21.15.82:0/2584425665 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f11ec10d0d0 0x7f11ec198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:17:41.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.269+0000 7f11eb7fe700 1 -- 172.21.15.82:0/2584425665 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f11ec10d0d0 msgr2=0x7f11ec198920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:17:41.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.269+0000 7f11eb7fe700 1 --2- 172.21.15.82:0/2584425665 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f11ec10d0d0 0x7f11ec198920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:17:41.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.269+0000 7f11eb7fe700 1 -- 172.21.15.82:0/2584425665 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11ec073670 msgr2=0x7f11ec19edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:17:41.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.269+0000 7f11eb7fe700 1 --2- 172.21.15.82:0/2584425665 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11ec073670 0x7f11ec19edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:17:41.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.269+0000 7f11eb7fe700 1 -- 172.21.15.82:0/2584425665 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11e00095f0 con 0x7f11ec072d50 2023-09-23T09:17:41.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.269+0000 7f11eaffd700 1 --2- 172.21.15.82:0/2584425665 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11ec073670 0x7f11ec19edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:17:41.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.269+0000 7f11eb7fe700 1 --2- 172.21.15.82:0/2584425665 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f11ec072d50 0x7f11ec19e8b0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f11dc00e9f0 tx=0x7f11dc00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:17:41.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.270+0000 7f11e8ff9700 1 -- 172.21.15.82:0/2584425665 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11dc00c9c0 con 0x7f11ec072d50 2023-09-23T09:17:41.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.270+0000 7f11e8ff9700 1 -- 172.21.15.82:0/2584425665 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f11dc010430 con 0x7f11ec072d50 2023-09-23T09:17:41.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.270+0000 7f11f1dff700 1 -- 172.21.15.82:0/2584425665 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11ec1995a0 con 0x7f11ec072d50 2023-09-23T09:17:41.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.270+0000 7f11e8ff9700 1 -- 172.21.15.82:0/2584425665 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11dc018680 con 0x7f11ec072d50 2023-09-23T09:17:41.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.270+0000 7f11f1dff700 1 -- 172.21.15.82:0/2584425665 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11ec1a58a0 con 0x7f11ec072d50 2023-09-23T09:17:41.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.273+0000 7f11e8ff9700 1 -- 172.21.15.82:0/2584425665 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f11dc0105a0 con 0x7f11ec072d50 2023-09-23T09:17:41.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.274+0000 7f120574bb80 1 Processor -- start 2023-09-23T09:17:41.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.274+0000 7f11e8ff9700 1 --2- 172.21.15.82:0/2584425665 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f11d40a00c0 0x7f11d40a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:17:41.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.274+0000 7f120574bb80 1 -- start start 2023-09-23T09:17:41.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.274+0000 7f11e8ff9700 1 -- 172.21.15.82:0/2584425665 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f11dc014070 con 0x7f11ec072d50 2023-09-23T09:17:41.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.275+0000 7f120574bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dab7792380 0x55dab7792760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:17:41.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.275+0000 7f11ebfff700 1 --2- 172.21.15.82:0/2584425665 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f11d40a00c0 0x7f11d40a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:17:41.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.275+0000 7f120574bb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55dab7792ca0 0x55dab778c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:17:41.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.275+0000 7f120574bb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dab778cc40 0x55dab778d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:17:41.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.275+0000 7f120574bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dab76f47b0 con 0x55dab7792380 2023-09-23T09:17:41.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.275+0000 7f120574bb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dab76e5780 con 0x55dab778cc40 2023-09-23T09:17:41.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.275+0000 7f120574bb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dab76e30a0 con 0x55dab7792ca0 2023-09-23T09:17:41.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.275+0000 7f11eb7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dab7792380 0x55dab7792760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:17:41.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.275+0000 7f11eb7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dab7792380 0x55dab7792760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40370/0 (socket says 172.21.15.82:40370) 2023-09-23T09:17:41.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.275+0000 7f11eb7fe700 1 -- 172.21.15.82:0/2645294502 learned_addr learned my addr 172.21.15.82:0/2645294502 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:17:41.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.275+0000 7f11eaffd700 1 --2- 172.21.15.82:0/2645294502 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55dab7792ca0 0x55dab778c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:17:41.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.275+0000 7f11ebfff700 1 --2- 172.21.15.82:0/2645294502 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dab778cc40 0x55dab778d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:17:41.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.275+0000 7f11eb7fe700 1 -- 172.21.15.82:0/2645294502 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55dab7792ca0 msgr2=0x55dab778c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:17:41.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.275+0000 7f11eb7fe700 1 --2- 172.21.15.82:0/2645294502 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55dab7792ca0 0x55dab778c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:17:41.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.275+0000 7f11eb7fe700 1 -- 172.21.15.82:0/2645294502 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dab778cc40 msgr2=0x55dab778d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:17:41.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.275+0000 7f11eb7fe700 1 --2- 172.21.15.82:0/2645294502 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dab778cc40 0x55dab778d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:17:41.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.275+0000 7f11eb7fe700 1 -- 172.21.15.82:0/2645294502 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dab755e630 con 0x55dab7792380 2023-09-23T09:17:41.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.275+0000 7f11ebfff700 1 --2- 172.21.15.82:0/2584425665 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f11d40a00c0 0x7f11d40a2580 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f11ec19f5b0 tx=0x7f11e4009920 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:17:41.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.276+0000 7f11eb7fe700 1 --2- 172.21.15.82:0/2645294502 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dab7792380 0x55dab7792760 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f11dc009800 tx=0x7f11dc011fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aad345a17dd37be server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:17:41.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.276+0000 7f11d1ffb700 1 -- 172.21.15.82:0/2645294502 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11dc099ea0 con 0x55dab7792380 2023-09-23T09:17:41.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.276+0000 7f11d1ffb700 1 -- 172.21.15.82:0/2645294502 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f11dc099590 con 0x55dab7792380 2023-09-23T09:17:41.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.276+0000 7f11d1ffb700 1 -- 172.21.15.82:0/2645294502 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11dc098380 con 0x55dab7792380 2023-09-23T09:17:41.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.276+0000 7f120574bb80 1 -- 172.21.15.82:0/2645294502 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dab7792380 msgr2=0x55dab7792760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:17:41.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.276+0000 7f120574bb80 1 --2- 172.21.15.82:0/2645294502 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dab7792380 0x55dab7792760 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f11dc009800 tx=0x7f11dc011fe0 comp rx=0 tx=0).stop 2023-09-23T09:17:41.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.277+0000 7f120574bb80 1 -- 172.21.15.82:0/2645294502 shutdown_connections 2023-09-23T09:17:41.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.277+0000 7f120574bb80 1 --2- 172.21.15.82:0/2645294502 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dab778cc40 0x55dab778d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:17:41.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.277+0000 7f120574bb80 1 --2- 172.21.15.82:0/2645294502 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dab7792380 0x55dab7792760 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:17:41.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.277+0000 7f120574bb80 1 --2- 172.21.15.82:0/2645294502 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55dab7792ca0 0x55dab778c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:17:41.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.277+0000 7f120574bb80 1 -- 172.21.15.82:0/2645294502 >> 172.21.15.82:0/2645294502 conn(0x55dab77010e0 msgr2=0x55dab7787410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:17:41.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.277+0000 7f120574bb80 1 -- 172.21.15.82:0/2645294502 shutdown_connections 2023-09-23T09:17:41.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.277+0000 7f120574bb80 1 -- 172.21.15.82:0/2645294502 wait complete. 2023-09-23T09:17:41.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.277+0000 7f120574bb80 1 -- start start 2023-09-23T09:17:41.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.277+0000 7f120574bb80 1 Processor -- start 2023-09-23T09:17:41.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.278+0000 7f120574bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dab778cc40 0x55dab7798c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:17:41.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.278+0000 7f120574bb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dab7792380 0x55dab7795ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:17:41.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.278+0000 7f120574bb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55dab7792ca0 0x55dab7796600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:17:41.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.278+0000 7f120574bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dab76de990 con 0x55dab778cc40 2023-09-23T09:17:41.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.278+0000 7f120574bb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dab767cbb0 con 0x55dab7792380 2023-09-23T09:17:41.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.278+0000 7f120574bb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dab767c8b0 con 0x55dab7792ca0 2023-09-23T09:17:41.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.278+0000 7f120574bb80 10 client.0 _ll_register_callbacks cb 0x55dab75c6a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:17:41.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.278+0000 7f11eb7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dab778cc40 0x55dab7798c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:17:41.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.278+0000 7f11eb7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dab778cc40 0x55dab7798c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40380/0 (socket says 172.21.15.82:40380) 2023-09-23T09:17:41.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.278+0000 7f11eb7fe700 1 -- 172.21.15.82:0/2470422534 learned_addr learned my addr 172.21.15.82:0/2470422534 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:17:41.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.278+0000 7f11eaffd700 1 --2- 172.21.15.82:0/2470422534 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dab7792380 0x55dab7795ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:17:41.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.278+0000 7f11ebfff700 1 --2- 172.21.15.82:0/2470422534 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55dab7792ca0 0x55dab7796600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:17:41.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.278+0000 7f11eb7fe700 1 -- 172.21.15.82:0/2470422534 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55dab7792ca0 msgr2=0x55dab7796600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:17:41.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.279+0000 7f11eb7fe700 1 --2- 172.21.15.82:0/2470422534 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55dab7792ca0 0x55dab7796600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:17:41.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.279+0000 7f11eb7fe700 1 -- 172.21.15.82:0/2470422534 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dab7792380 msgr2=0x55dab7795ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:17:41.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.279+0000 7f11eb7fe700 1 --2- 172.21.15.82:0/2470422534 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dab7792380 0x55dab7795ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:17:41.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.279+0000 7f11eb7fe700 1 -- 172.21.15.82:0/2470422534 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11ec1a58a0 con 0x55dab778cc40 2023-09-23T09:17:41.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.279+0000 7f11ebfff700 1 --2- 172.21.15.82:0/2470422534 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55dab7792ca0 0x55dab7796600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:17:41.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.279+0000 7f11eb7fe700 1 --2- 172.21.15.82:0/2470422534 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dab778cc40 0x55dab7798c40 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f11dc000c00 tx=0x7f11dc098590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56f28fe6c1c22d8f server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:17:41.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.279+0000 7f11caffd700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:17:41.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.279+0000 7f11caffd700 1 -- 172.21.15.82:0/2470422534 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11dc099ea0 con 0x55dab778cc40 2023-09-23T09:17:41.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.279+0000 7f11caffd700 1 -- 172.21.15.82:0/2470422534 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(117..117 src has 1..117) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f11dc099590 con 0x55dab778cc40 2023-09-23T09:17:41.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.279+0000 7f120574bb80 1 -- 172.21.15.82:0/2470422534 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dab775c1c0 con 0x55dab778cc40 2023-09-23T09:17:41.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.279+0000 7f11caffd700 1 -- 172.21.15.82:0/2470422534 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (secure 0 0 0) 0x7f11dc098e90 con 0x55dab778cc40 2023-09-23T09:17:41.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.279+0000 7f120574bb80 10 client.16875 fetch_fsmap learned FSMap version 74 2023-09-23T09:17:41.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.279+0000 7f120574bb80 1 -- 172.21.15.82:0/2470422534 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=4+}) v3 -- 0x55dab750ade0 con 0x55dab778cc40 2023-09-23T09:17:41.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.279+0000 7f11caffd700 1 -- 172.21.15.82:0/2470422534 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55dab775c1c0 con 0x55dab778cc40 2023-09-23T09:17:41.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.279+0000 7f11caffd700 1 -- 172.21.15.82:0/2470422534 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 74) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f11dc0a0930 con 0x55dab778cc40 2023-09-23T09:17:41.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.280+0000 7f120574bb80 10 client.16875 fetch_fsmap finished waiting for FSMap version 74 2023-09-23T09:17:41.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.280+0000 7f120574bb80 10 client.16875 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:17:41.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.280+0000 7f120574bb80 20 client.16875 populate_metadata read hostname 'smithi082' 2023-09-23T09:17:41.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.280+0000 7f120574bb80 1 --2- 172.21.15.82:0/2470422534 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55dab77a6310 0x55dab77a8730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:17:41.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.280+0000 7f120574bb80 4 client.16875 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:17:41.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.280+0000 7f120574bb80 1 -- 172.21.15.82:0/2470422534 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55dab7684ba0 con 0x55dab77a6310 2023-09-23T09:17:41.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.280+0000 7f11eaffd700 1 --2- 172.21.15.82:0/2470422534 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55dab77a6310 0x55dab77a8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:17:41.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.280+0000 7f11eaffd700 1 --2- 172.21.15.82:0/2470422534 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55dab77a6310 0x55dab77a8730 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=61e4aef351a297e6 server_cookie=40dccea9bd95c2a0 in_seq=0 out_seq=0 2023-09-23T09:17:41.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.280+0000 7f11caffd700 10 client.16875 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:17:41.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.281+0000 7f11caffd700 1 -- 172.21.15.82:0/2470422534 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55dab7684ba0 con 0x55dab77a6310 2023-09-23T09:17:41.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.281+0000 7f11caffd700 10 client.16875 handle_command_reply: tid=0 2023-09-23T09:17:41.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.281+0000 7f120574bb80 1 client.16875 shutdown 2023-09-23T09:17:41.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.281+0000 7f120574bb80 1 -- 172.21.15.82:0/2470422534 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dab778cc40 msgr2=0x55dab7798c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:17:41.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.281+0000 7f120574bb80 1 --2- 172.21.15.82:0/2470422534 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dab778cc40 0x55dab7798c40 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f11dc000c00 tx=0x7f11dc098590 comp rx=0 tx=0).stop 2023-09-23T09:17:41.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.281+0000 7f120574bb80 1 -- 172.21.15.82:0/2470422534 shutdown_connections 2023-09-23T09:17:41.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.281+0000 7f120574bb80 1 --2- 172.21.15.82:0/2470422534 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55dab7792ca0 0x55dab7796600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:17:41.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.281+0000 7f120574bb80 1 --2- 172.21.15.82:0/2470422534 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55dab77a6310 0x55dab77a8730 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:17:41.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.281+0000 7f120574bb80 1 --2- 172.21.15.82:0/2470422534 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dab778cc40 0x55dab7798c40 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:17:41.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.281+0000 7f120574bb80 1 --2- 172.21.15.82:0/2470422534 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dab7792380 0x55dab7795ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:17:41.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.281+0000 7f11caffd700 0 client.16875 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:17:41.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.281+0000 7f120574bb80 1 -- 172.21.15.82:0/2470422534 >> 172.21.15.82:0/2470422534 conn(0x55dab77010e0 msgr2=0x55dab7781b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:17:41.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.282+0000 7f120574bb80 1 -- 172.21.15.82:0/2470422534 shutdown_connections 2023-09-23T09:17:41.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.282+0000 7f120574bb80 1 -- 172.21.15.82:0/2470422534 wait complete. 2023-09-23T09:17:41.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.282+0000 7f120574bb80 20 client.16875 trim_cache size 0 max 16384 2023-09-23T09:17:41.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.299+0000 7f120574bb80 1 Processor -- start 2023-09-23T09:17:41.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.299+0000 7f120574bb80 1 -- start start 2023-09-23T09:17:41.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.299+0000 7f120574bb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55dab778cc40 0x55dab7795680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:17:41.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.299+0000 7f120574bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dab7792380 0x55dab77987e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:17:41.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.299+0000 7f120574bb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dab7792ca0 0x55dab7790010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:17:41.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.299+0000 7f120574bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dab7560920 con 0x55dab7792380 2023-09-23T09:17:41.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.299+0000 7f120574bb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dab7788600 con 0x55dab7792ca0 2023-09-23T09:17:41.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.299+0000 7f120574bb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dab77974a0 con 0x55dab778cc40 2023-09-23T09:17:41.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.299+0000 7f11eaffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dab7792380 0x55dab77987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:17:41.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.299+0000 7f11eb7fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55dab778cc40 0x55dab7795680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:17:41.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.299+0000 7f11eb7fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55dab778cc40 0x55dab7795680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:51688/0 (socket says 172.21.15.82:51688) 2023-09-23T09:17:41.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.299+0000 7f11eb7fe700 1 -- 172.21.15.82:0/3160458510 learned_addr learned my addr 172.21.15.82:0/3160458510 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:17:41.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.299+0000 7f11eaffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dab7792380 0x55dab77987e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40390/0 (socket says 172.21.15.82:40390) 2023-09-23T09:17:41.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.299+0000 7f11ebfff700 1 --2- 172.21.15.82:0/3160458510 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dab7792ca0 0x55dab7790010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:17:41.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.300+0000 7f11eb7fe700 1 -- 172.21.15.82:0/3160458510 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dab7792ca0 msgr2=0x55dab7790010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:17:41.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.300+0000 7f11eb7fe700 1 --2- 172.21.15.82:0/3160458510 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dab7792ca0 0x55dab7790010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:17:41.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.300+0000 7f11eb7fe700 1 -- 172.21.15.82:0/3160458510 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dab7792380 msgr2=0x55dab77987e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:17:41.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.300+0000 7f11eb7fe700 1 --2- 172.21.15.82:0/3160458510 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dab7792380 0x55dab77987e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:17:41.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.300+0000 7f11eb7fe700 1 -- 172.21.15.82:0/3160458510 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dab74f3c60 con 0x55dab778cc40 2023-09-23T09:17:41.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.300+0000 7f11eaffd700 1 --2- 172.21.15.82:0/3160458510 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dab7792380 0x55dab77987e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:17:41.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.300+0000 7f11eb7fe700 1 --2- 172.21.15.82:0/3160458510 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55dab778cc40 0x55dab7795680 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f11dc095900 tx=0x7f11dc011fe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c82d8797a98f161d server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:17:41.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.300+0000 7f11d27fc700 1 -- 172.21.15.82:0/3160458510 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11dc099ea0 con 0x55dab778cc40 2023-09-23T09:17:41.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.300+0000 7f11d27fc700 1 -- 172.21.15.82:0/3160458510 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f11dc0a0ca0 con 0x55dab778cc40 2023-09-23T09:17:41.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.300+0000 7f11d27fc700 1 -- 172.21.15.82:0/3160458510 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11dc098e90 con 0x55dab778cc40 2023-09-23T09:17:41.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.301+0000 7f120574bb80 1 -- 172.21.15.82:0/3160458510 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55dab778cc40 msgr2=0x55dab7795680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:17:41.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.301+0000 7f120574bb80 1 --2- 172.21.15.82:0/3160458510 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55dab778cc40 0x55dab7795680 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f11dc095900 tx=0x7f11dc011fe0 comp rx=0 tx=0).stop 2023-09-23T09:17:41.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.301+0000 7f120574bb80 1 -- 172.21.15.82:0/3160458510 shutdown_connections 2023-09-23T09:17:41.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.301+0000 7f120574bb80 1 --2- 172.21.15.82:0/3160458510 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dab7792ca0 0x55dab7790010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:17:41.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.301+0000 7f120574bb80 1 --2- 172.21.15.82:0/3160458510 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55dab778cc40 0x55dab7795680 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:17:41.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.301+0000 7f120574bb80 1 --2- 172.21.15.82:0/3160458510 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dab7792380 0x55dab77987e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:17:41.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.301+0000 7f120574bb80 1 -- 172.21.15.82:0/3160458510 >> 172.21.15.82:0/3160458510 conn(0x55dab77010e0 msgr2=0x55dab77a29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:17:41.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.301+0000 7f120574bb80 1 -- 172.21.15.82:0/3160458510 shutdown_connections 2023-09-23T09:17:41.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.301+0000 7f120574bb80 1 -- 172.21.15.82:0/3160458510 wait complete. 2023-09-23T09:17:41.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.301+0000 7f120574bb80 1 -- start start 2023-09-23T09:17:41.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.302+0000 7f120574bb80 1 Processor -- start 2023-09-23T09:17:41.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.302+0000 7f120574bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dab778cc40 0x55dab778f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:17:41.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.302+0000 7f120574bb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dab7792380 0x55dab778f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:17:41.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.302+0000 7f120574bb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55dab7792ca0 0x55dab778dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:17:41.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.302+0000 7f120574bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dab778e2e0 con 0x55dab778cc40 2023-09-23T09:17:41.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.302+0000 7f120574bb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dab778e450 con 0x55dab7792380 2023-09-23T09:17:41.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.302+0000 7f120574bb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dab778e610 con 0x55dab7792ca0 2023-09-23T09:17:41.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.302+0000 7f120574bb80 10 client.0 _ll_register_callbacks cb 0x7f11e40097c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:17:41.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.302+0000 7f11eb7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dab778cc40 0x55dab778f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:17:41.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.302+0000 7f11eb7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dab778cc40 0x55dab778f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40392/0 (socket says 172.21.15.82:40392) 2023-09-23T09:17:41.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.302+0000 7f11eb7fe700 1 -- 172.21.15.82:0/3003266219 learned_addr learned my addr 172.21.15.82:0/3003266219 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:17:41.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.302+0000 7f11eaffd700 1 --2- 172.21.15.82:0/3003266219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dab7792380 0x55dab778f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:17:41.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.302+0000 7f11ebfff700 1 --2- 172.21.15.82:0/3003266219 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55dab7792ca0 0x55dab778dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:17:41.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.303+0000 7f11eb7fe700 1 -- 172.21.15.82:0/3003266219 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55dab7792ca0 msgr2=0x55dab778dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:17:41.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.303+0000 7f11eb7fe700 1 --2- 172.21.15.82:0/3003266219 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55dab7792ca0 0x55dab778dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:17:41.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.303+0000 7f11eb7fe700 1 -- 172.21.15.82:0/3003266219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dab7792380 msgr2=0x55dab778f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:17:41.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.303+0000 7f11eb7fe700 1 --2- 172.21.15.82:0/3003266219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dab7792380 0x55dab778f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:17:41.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.303+0000 7f11eb7fe700 1 -- 172.21.15.82:0/3003266219 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11ec110200 con 0x55dab778cc40 2023-09-23T09:17:41.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.303+0000 7f11eb7fe700 1 --2- 172.21.15.82:0/3003266219 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dab778cc40 0x55dab778f0f0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f11dc098b90 tx=0x7f11dc0c9430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a08ce53202058854 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:17:41.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.303+0000 7f11caffd700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:17:41.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.303+0000 7f11caffd700 1 -- 172.21.15.82:0/3003266219 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11dc099ea0 con 0x55dab778cc40 2023-09-23T09:17:41.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.303+0000 7f11caffd700 1 -- 172.21.15.82:0/3003266219 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(117..117 src has 1..117) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f11dc099590 con 0x55dab778cc40 2023-09-23T09:17:41.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.303+0000 7f120574bb80 1 -- 172.21.15.82:0/3003266219 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dab777f8b0 con 0x55dab778cc40 2023-09-23T09:17:41.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.304+0000 7f11caffd700 1 -- 172.21.15.82:0/3003266219 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (secure 0 0 0) 0x7f11dc094e20 con 0x55dab778cc40 2023-09-23T09:17:41.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.304+0000 7f120574bb80 10 client.16881 fetch_fsmap learned FSMap version 74 2023-09-23T09:17:41.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.304+0000 7f120574bb80 1 -- 172.21.15.82:0/3003266219 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=4+}) v3 -- 0x55dab750ade0 con 0x55dab778cc40 2023-09-23T09:17:41.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.304+0000 7f11caffd700 1 -- 172.21.15.82:0/3003266219 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55dab777f8b0 con 0x55dab778cc40 2023-09-23T09:17:41.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.304+0000 7f11caffd700 1 -- 172.21.15.82:0/3003266219 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 74) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f11dc093bc0 con 0x55dab778cc40 2023-09-23T09:17:41.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.304+0000 7f120574bb80 10 client.16881 fetch_fsmap finished waiting for FSMap version 74 2023-09-23T09:17:41.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.304+0000 7f120574bb80 10 client.16881 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:17:41.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.304+0000 7f120574bb80 20 client.16881 populate_metadata read hostname 'smithi082' 2023-09-23T09:17:41.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.304+0000 7f120574bb80 1 --2- 172.21.15.82:0/3003266219 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55dab77fabc0 0x55dab77fcfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:17:41.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.304+0000 7f120574bb80 4 client.16881 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:17:41.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.304+0000 7f120574bb80 1 -- 172.21.15.82:0/3003266219 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55dab76d7970 con 0x55dab77fabc0 2023-09-23T09:17:41.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.304+0000 7f11eaffd700 1 --2- 172.21.15.82:0/3003266219 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55dab77fabc0 0x55dab77fcfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:17:41.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.305+0000 7f11caffd700 10 client.16881 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:17:41.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.305+0000 7f11eaffd700 1 --2- 172.21.15.82:0/3003266219 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55dab77fabc0 0x55dab77fcfe0 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e980fe9001910747 server_cookie=93a197a1dd501dce in_seq=0 out_seq=0 2023-09-23T09:17:41.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.305+0000 7f11caffd700 1 -- 172.21.15.82:0/3003266219 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55dab76d7970 con 0x55dab77fabc0 2023-09-23T09:17:41.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.305+0000 7f11caffd700 10 client.16881 handle_command_reply: tid=0 2023-09-23T09:17:41.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.305+0000 7f120574bb80 1 client.16881 shutdown 2023-09-23T09:17:41.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.305+0000 7f120574bb80 1 -- 172.21.15.82:0/3003266219 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dab778cc40 msgr2=0x55dab778f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:17:41.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.305+0000 7f120574bb80 1 --2- 172.21.15.82:0/3003266219 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dab778cc40 0x55dab778f0f0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f11dc098b90 tx=0x7f11dc0c9430 comp rx=0 tx=0).stop 2023-09-23T09:17:41.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.305+0000 7f120574bb80 1 -- 172.21.15.82:0/3003266219 shutdown_connections 2023-09-23T09:17:41.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.305+0000 7f120574bb80 1 --2- 172.21.15.82:0/3003266219 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55dab7792ca0 0x55dab778dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:17:41.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.305+0000 7f120574bb80 1 --2- 172.21.15.82:0/3003266219 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55dab77fabc0 0x55dab77fcfe0 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:17:41.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.305+0000 7f120574bb80 1 --2- 172.21.15.82:0/3003266219 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dab778cc40 0x55dab778f0f0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:17:41.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.305+0000 7f120574bb80 1 --2- 172.21.15.82:0/3003266219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dab7792380 0x55dab778f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:17:41.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.305+0000 7f11caffd700 0 client.16881 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:17:41.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.305+0000 7f120574bb80 1 -- 172.21.15.82:0/3003266219 >> 172.21.15.82:0/3003266219 conn(0x55dab77010e0 msgr2=0x55dab7790010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:17:41.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.306+0000 7f120574bb80 1 -- 172.21.15.82:0/3003266219 shutdown_connections 2023-09-23T09:17:41.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.306+0000 7f120574bb80 1 -- 172.21.15.82:0/3003266219 wait complete. 2023-09-23T09:17:41.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.306+0000 7f120574bb80 20 client.16881 trim_cache size 0 max 16384 2023-09-23T09:17:41.313 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:17:41.313 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-23T09:17:41.313 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:17:41.314 INFO:teuthology.orchestra.run.smithi082.stdout: "047cbc72-e254-4787-b038-382de9c1a9a4": { 2023-09-23T09:17:41.314 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:17:41.314 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "047cbc72-e254-4787-b038-382de9c1a9a4", 2023-09-23T09:17:41.314 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:17:41.314 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:17:41.314 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:17:41.314 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:17:41.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.306+0000 7f11f1dff700 1 -- 172.21.15.82:0/2584425665 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f11d40a00c0 msgr2=0x7f11d40a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:17:41.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.306+0000 7f11f1dff700 1 --2- 172.21.15.82:0/2584425665 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f11d40a00c0 0x7f11d40a2580 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f11ec19f5b0 tx=0x7f11e4009920 comp rx=0 tx=0).stop 2023-09-23T09:17:41.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.306+0000 7f11f1dff700 1 -- 172.21.15.82:0/2584425665 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f11ec072d50 msgr2=0x7f11ec19e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:17:41.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.306+0000 7f11f1dff700 1 --2- 172.21.15.82:0/2584425665 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f11ec072d50 0x7f11ec19e8b0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f11dc00e9f0 tx=0x7f11dc00ed00 comp rx=0 tx=0).stop 2023-09-23T09:17:41.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.306+0000 7f11f1dff700 1 -- 172.21.15.82:0/2584425665 shutdown_connections 2023-09-23T09:17:41.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.306+0000 7f11f1dff700 1 --2- 172.21.15.82:0/2584425665 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f11d40a00c0 0x7f11d40a2580 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:17:41.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.306+0000 7f11f1dff700 1 --2- 172.21.15.82:0/2584425665 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f11ec10d0d0 0x7f11ec198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:17:41.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.306+0000 7f11f1dff700 1 --2- 172.21.15.82:0/2584425665 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f11ec072d50 0x7f11ec19e8b0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:17:41.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.306+0000 7f11f1dff700 1 --2- 172.21.15.82:0/2584425665 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11ec073670 0x7f11ec19edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:17:41.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.306+0000 7f11f1dff700 1 -- 172.21.15.82:0/2584425665 >> 172.21.15.82:0/2584425665 conn(0x7f11ec0fc380 msgr2=0x7f11ec10f2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:17:41.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.306+0000 7f11f1dff700 1 -- 172.21.15.82:0/2584425665 shutdown_connections 2023-09-23T09:17:41.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:17:41.306+0000 7f11f1dff700 1 -- 172.21.15.82:0/2584425665 wait complete. 2023-09-23T09:17:41.326 INFO:tasks.cephfs.filesystem:scrub status for tag:047cbc72-e254-4787-b038-382de9c1a9a4 - {'path': '/', 'tag': '047cbc72-e254-4787-b038-382de9c1a9a4', 'options': 'recursive,force'} 2023-09-23T09:17:43.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:17:42 smithi135 ceph-mon[99205]: pgmap v655: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 26 MiB/s wr, 21 op/s 2023-09-23T09:17:43.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:17:42 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:17:43.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:17:42 smithi082 ceph-mon[97694]: pgmap v655: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 26 MiB/s wr, 21 op/s 2023-09-23T09:17:43.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:17:42 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:17:43.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:17:42 smithi161 ceph-mon[99580]: pgmap v655: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 26 MiB/s wr, 21 op/s 2023-09-23T09:17:43.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:17:42 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:17:45.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:17:44 smithi135 ceph-mon[99205]: pgmap v656: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 26 MiB/s wr, 21 op/s 2023-09-23T09:17:45.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:17:44 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:17:45.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:17:44 smithi082 ceph-mon[97694]: pgmap v656: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 26 MiB/s wr, 21 op/s 2023-09-23T09:17:45.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:17:44 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:17:45.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:17:44 smithi161 ceph-mon[99580]: pgmap v656: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 26 MiB/s wr, 21 op/s 2023-09-23T09:17:45.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:17:44 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:17:47.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:17:46 smithi135 ceph-mon[99205]: pgmap v657: 97 pgs: 97 active+clean; 14 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 39 MiB/s wr, 32 op/s 2023-09-23T09:17:47.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:17:46 smithi082 ceph-mon[97694]: pgmap v657: 97 pgs: 97 active+clean; 14 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 39 MiB/s wr, 32 op/s 2023-09-23T09:17:47.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:17:46 smithi161 ceph-mon[99580]: pgmap v657: 97 pgs: 97 active+clean; 14 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 39 MiB/s wr, 32 op/s 2023-09-23T09:17:49.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:17:48 smithi135 ceph-mon[99205]: pgmap v658: 97 pgs: 97 active+clean; 14 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 26 MiB/s wr, 21 op/s 2023-09-23T09:17:49.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:17:48 smithi082 ceph-mon[97694]: pgmap v658: 97 pgs: 97 active+clean; 14 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 26 MiB/s wr, 21 op/s 2023-09-23T09:17:49.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:17:48 smithi161 ceph-mon[99580]: pgmap v658: 97 pgs: 97 active+clean; 14 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 26 MiB/s wr, 21 op/s 2023-09-23T09:17:51.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:17:50 smithi135 ceph-mon[99205]: pgmap v659: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 641 KiB/s rd, 35 MiB/s wr, 104 op/s 2023-09-23T09:17:51.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:17:50 smithi082 ceph-mon[97694]: pgmap v659: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 641 KiB/s rd, 35 MiB/s wr, 104 op/s 2023-09-23T09:17:51.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:17:50 smithi161 ceph-mon[99580]: pgmap v659: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 641 KiB/s rd, 35 MiB/s wr, 104 op/s 2023-09-23T09:17:53.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:17:52 smithi135 ceph-mon[99205]: pgmap v660: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 614 KiB/s rd, 22 MiB/s wr, 93 op/s 2023-09-23T09:17:53.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:17:52 smithi082 ceph-mon[97694]: pgmap v660: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 614 KiB/s rd, 22 MiB/s wr, 93 op/s 2023-09-23T09:17:53.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:17:52 smithi161 ceph-mon[99580]: pgmap v660: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 614 KiB/s rd, 22 MiB/s wr, 93 op/s 2023-09-23T09:17:55.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:17:54 smithi135 ceph-mon[99205]: pgmap v661: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 614 KiB/s rd, 22 MiB/s wr, 93 op/s 2023-09-23T09:17:55.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:17:54 smithi082 ceph-mon[97694]: pgmap v661: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 614 KiB/s rd, 22 MiB/s wr, 93 op/s 2023-09-23T09:17:55.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:17:54 smithi161 ceph-mon[99580]: pgmap v661: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 614 KiB/s rd, 22 MiB/s wr, 93 op/s 2023-09-23T09:17:56.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:17:55 smithi082 ceph-mon[97694]: pgmap v662: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 24 MiB/s wr, 308 op/s 2023-09-23T09:17:56.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:17:55 smithi161 ceph-mon[99580]: pgmap v662: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 24 MiB/s wr, 308 op/s 2023-09-23T09:17:56.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:17:55 smithi135 ceph-mon[99205]: pgmap v662: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 24 MiB/s wr, 308 op/s 2023-09-23T09:17:59.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:17:58 smithi135 ceph-mon[99205]: pgmap v663: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 12 MiB/s wr, 297 op/s 2023-09-23T09:17:59.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:17:58 smithi082 ceph-mon[97694]: pgmap v663: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 12 MiB/s wr, 297 op/s 2023-09-23T09:17:59.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:17:58 smithi161 ceph-mon[99580]: pgmap v663: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 12 MiB/s wr, 297 op/s 2023-09-23T09:18:01.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:18:00 smithi135 ceph-mon[99205]: pgmap v664: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 13 MiB/s wr, 491 op/s 2023-09-23T09:18:01.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:18:00 smithi082 ceph-mon[97694]: pgmap v664: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 13 MiB/s wr, 491 op/s 2023-09-23T09:18:01.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:18:00 smithi161 ceph-mon[99580]: pgmap v664: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 13 MiB/s wr, 491 op/s 2023-09-23T09:18:03.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:18:02 smithi135 ceph-mon[99205]: pgmap v665: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.3 MiB/s wr, 408 op/s 2023-09-23T09:18:03.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:18:02 smithi082 ceph-mon[97694]: pgmap v665: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.3 MiB/s wr, 408 op/s 2023-09-23T09:18:03.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:18:02 smithi161 ceph-mon[99580]: pgmap v665: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.3 MiB/s wr, 408 op/s 2023-09-23T09:18:05.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:18:04 smithi135 ceph-mon[99205]: pgmap v666: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.3 MiB/s wr, 408 op/s 2023-09-23T09:18:05.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:18:04 smithi082 ceph-mon[97694]: pgmap v666: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.3 MiB/s wr, 408 op/s 2023-09-23T09:18:05.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:18:04 smithi161 ceph-mon[99580]: pgmap v666: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.3 MiB/s wr, 408 op/s 2023-09-23T09:18:07.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:18:06 smithi135 ceph-mon[99205]: pgmap v667: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.7 MiB/s wr, 617 op/s 2023-09-23T09:18:07.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:18:06 smithi082 ceph-mon[97694]: pgmap v667: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.7 MiB/s wr, 617 op/s 2023-09-23T09:18:07.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:18:06 smithi161 ceph-mon[99580]: pgmap v667: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.7 MiB/s wr, 617 op/s 2023-09-23T09:18:08.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:18:07 smithi135 ceph-mon[99205]: osdmap e118: 12 total, 12 up, 12 in 2023-09-23T09:18:08.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:18:07 smithi135 ceph-mon[99205]: pgmap v669: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.4 MiB/s wr, 483 op/s 2023-09-23T09:18:08.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:18:07 smithi082 ceph-mon[97694]: osdmap e118: 12 total, 12 up, 12 in 2023-09-23T09:18:08.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:18:07 smithi082 ceph-mon[97694]: pgmap v669: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.4 MiB/s wr, 483 op/s 2023-09-23T09:18:08.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:18:07 smithi161 ceph-mon[99580]: osdmap e118: 12 total, 12 up, 12 in 2023-09-23T09:18:08.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:18:07 smithi161 ceph-mon[99580]: pgmap v669: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.4 MiB/s wr, 483 op/s 2023-09-23T09:18:10.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:18:10 smithi135 ceph-mon[99205]: pgmap v670: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.4 MiB/s wr, 476 op/s 2023-09-23T09:18:10.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:18:10 smithi082 ceph-mon[97694]: pgmap v670: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.4 MiB/s wr, 476 op/s 2023-09-23T09:18:10.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:18:10 smithi161 ceph-mon[99580]: pgmap v670: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.4 MiB/s wr, 476 op/s 2023-09-23T09:18:11.326 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:18:11.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.577+0000 7f57c45ff700 1 -- 172.21.15.82:0/3173232791 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57bc108ad0 msgr2=0x7f57bc108eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:18:11.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.577+0000 7f57c45ff700 1 --2- 172.21.15.82:0/3173232791 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57bc108ad0 0x7f57bc108eb0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f57b8009990 tx=0x7f57b8009ca0 comp rx=0 tx=0).stop 2023-09-23T09:18:11.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.577+0000 7f57c45ff700 1 -- 172.21.15.82:0/3173232791 shutdown_connections 2023-09-23T09:18:11.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.577+0000 7f57c45ff700 1 --2- 172.21.15.82:0/3173232791 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57bc103480 0x7f57bc10f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:18:11.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.577+0000 7f57c45ff700 1 --2- 172.21.15.82:0/3173232791 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57bc108ad0 0x7f57bc108eb0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:18:11.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.577+0000 7f57c45ff700 1 --2- 172.21.15.82:0/3173232791 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57bc102ac0 0x7f57bc102f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:18:11.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.577+0000 7f57c45ff700 1 -- 172.21.15.82:0/3173232791 >> 172.21.15.82:0/3173232791 conn(0x7f57bc0fe570 msgr2=0x7f57bc100990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:18:11.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.577+0000 7f57c45ff700 1 -- 172.21.15.82:0/3173232791 shutdown_connections 2023-09-23T09:18:11.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.578+0000 7f57c45ff700 1 -- 172.21.15.82:0/3173232791 wait complete. 2023-09-23T09:18:11.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.579+0000 7f57c45ff700 1 Processor -- start 2023-09-23T09:18:11.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.579+0000 7f57c45ff700 1 -- start start 2023-09-23T09:18:11.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.579+0000 7f57c45ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57bc102ac0 0x7f57bc19e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:18:11.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.579+0000 7f57c45ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57bc103480 0x7f57bc19ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:18:11.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.579+0000 7f57c45ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57bc108ad0 0x7f57bc198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:18:11.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.579+0000 7f57c45ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57bc198fb0 con 0x7f57bc102ac0 2023-09-23T09:18:11.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.579+0000 7f57c45ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57bc199120 con 0x7f57bc108ad0 2023-09-23T09:18:11.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.579+0000 7f57c45ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57bc1992e0 con 0x7f57bc103480 2023-09-23T09:18:11.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.580+0000 7f57c239b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57bc102ac0 0x7f57bc19e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:18:11.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.580+0000 7f57c2b9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57bc108ad0 0x7f57bc198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:18:11.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.580+0000 7f57c1b9a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57bc103480 0x7f57bc19ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:18:11.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.580+0000 7f57c2b9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57bc108ad0 0x7f57bc198940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:60160/0 (socket says 172.21.15.82:60160) 2023-09-23T09:18:11.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.580+0000 7f57c2b9c700 1 -- 172.21.15.82:0/807745201 learned_addr learned my addr 172.21.15.82:0/807745201 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:18:11.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.580+0000 7f57c2b9c700 1 -- 172.21.15.82:0/807745201 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57bc103480 msgr2=0x7f57bc19ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:18:11.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.580+0000 7f57c2b9c700 1 --2- 172.21.15.82:0/807745201 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57bc103480 0x7f57bc19ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:18:11.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.580+0000 7f57c2b9c700 1 -- 172.21.15.82:0/807745201 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57bc102ac0 msgr2=0x7f57bc19e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:18:11.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.580+0000 7f57c2b9c700 1 --2- 172.21.15.82:0/807745201 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57bc102ac0 0x7f57bc19e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:18:11.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.580+0000 7f57c2b9c700 1 -- 172.21.15.82:0/807745201 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57b4009c40 con 0x7f57bc108ad0 2023-09-23T09:18:11.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.580+0000 7f57c239b700 1 --2- 172.21.15.82:0/807745201 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57bc102ac0 0x7f57bc19e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:18:11.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.581+0000 7f57c2b9c700 1 --2- 172.21.15.82:0/807745201 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57bc108ad0 0x7f57bc198940 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f57b400c370 tx=0x7f57b400c680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:18:11.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.581+0000 7f57b37fe700 1 -- 172.21.15.82:0/807745201 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b4017070 con 0x7f57bc108ad0 2023-09-23T09:18:11.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.581+0000 7f57c45ff700 1 -- 172.21.15.82:0/807745201 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57b80095f0 con 0x7f57bc108ad0 2023-09-23T09:18:11.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.581+0000 7f57b37fe700 1 -- 172.21.15.82:0/807745201 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f57b400f040 con 0x7f57bc108ad0 2023-09-23T09:18:11.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.581+0000 7f57b37fe700 1 -- 172.21.15.82:0/807745201 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b400e050 con 0x7f57bc108ad0 2023-09-23T09:18:11.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.581+0000 7f57c45ff700 1 -- 172.21.15.82:0/807745201 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57bc1a56e0 con 0x7f57bc108ad0 2023-09-23T09:18:11.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.586+0000 7f57b37fe700 1 -- 172.21.15.82:0/807745201 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f57b400cb60 con 0x7f57bc108ad0 2023-09-23T09:18:11.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.587+0000 7f57d7e43b80 1 Processor -- start 2023-09-23T09:18:11.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.587+0000 7f57d7e43b80 1 -- start start 2023-09-23T09:18:11.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.587+0000 7f57b37fe700 1 --2- 172.21.15.82:0/807745201 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f57a80a00c0 0x7f57a80a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:18:11.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.588+0000 7f57d7e43b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b05bab4380 0x55b05bab4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:18:11.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.588+0000 7f57b37fe700 1 -- 172.21.15.82:0/807745201 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 8557+0+0 (secure 0 0 0) 0x7f57b40caf80 con 0x7f57bc108ad0 2023-09-23T09:18:11.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.588+0000 7f57d7e43b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b05bab4ca0 0x55b05baae700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:18:11.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.588+0000 7f57d7e43b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b05baaec40 0x55b05baaf0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:18:11.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.588+0000 7f57d7e43b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b05ba167b0 con 0x55b05bab4380 2023-09-23T09:18:11.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.588+0000 7f57d7e43b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b05ba07780 con 0x55b05baaec40 2023-09-23T09:18:11.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.588+0000 7f57d7e43b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b05ba050a0 con 0x55b05bab4ca0 2023-09-23T09:18:11.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.588+0000 7f57c239b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b05bab4380 0x55b05bab4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:18:11.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.588+0000 7f57c2b9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b05baaec40 0x55b05baaf0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:18:11.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.588+0000 7f57c2b9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b05baaec40 0x55b05baaf0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:60162/0 (socket says 172.21.15.82:60162) 2023-09-23T09:18:11.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.588+0000 7f57c239b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b05bab4380 0x55b05bab4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40634/0 (socket says 172.21.15.82:40634) 2023-09-23T09:18:11.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.588+0000 7f57c2b9c700 1 -- 172.21.15.82:0/3954268680 learned_addr learned my addr 172.21.15.82:0/3954268680 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:18:11.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.588+0000 7f57c1b9a700 1 --2- 172.21.15.82:0/807745201 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f57a80a00c0 0x7f57a80a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:18:11.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.588+0000 7f57c1b9a700 1 --2- 172.21.15.82:0/3954268680 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b05bab4ca0 0x55b05baae700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:18:11.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.588+0000 7f57c2b9c700 1 -- 172.21.15.82:0/3954268680 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b05bab4ca0 msgr2=0x55b05baae700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:18:11.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.588+0000 7f57c2b9c700 1 --2- 172.21.15.82:0/3954268680 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b05bab4ca0 0x55b05baae700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:18:11.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.588+0000 7f57c2b9c700 1 -- 172.21.15.82:0/3954268680 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b05bab4380 msgr2=0x55b05bab4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:18:11.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.588+0000 7f57c2b9c700 1 --2- 172.21.15.82:0/3954268680 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b05bab4380 0x55b05bab4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:18:11.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.588+0000 7f57c2b9c700 1 -- 172.21.15.82:0/3954268680 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b05b880630 con 0x55b05baaec40 2023-09-23T09:18:11.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.589+0000 7f57c2b9c700 1 --2- 172.21.15.82:0/3954268680 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b05baaec40 0x55b05baaf0a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f57b400f010 tx=0x7f57b4098230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d3154dcaeb10513 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:18:11.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.589+0000 7f57c1b9a700 1 --2- 172.21.15.82:0/807745201 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f57a80a00c0 0x7f57a80a2580 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x55b05bab5100 tx=0x7f57ac0099b0 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:18:11.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.589+0000 7f57b0bfe700 1 -- 172.21.15.82:0/3954268680 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b40192c0 con 0x55b05baaec40 2023-09-23T09:18:11.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.589+0000 7f57b0bfe700 1 -- 172.21.15.82:0/3954268680 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f57b400ce10 con 0x55b05baaec40 2023-09-23T09:18:11.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.589+0000 7f57b0bfe700 1 -- 172.21.15.82:0/3954268680 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b40a0480 con 0x55b05baaec40 2023-09-23T09:18:11.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.590+0000 7f57d7e43b80 1 -- 172.21.15.82:0/3954268680 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b05baaec40 msgr2=0x55b05baaf0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:18:11.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.590+0000 7f57d7e43b80 1 --2- 172.21.15.82:0/3954268680 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b05baaec40 0x55b05baaf0a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f57b400f010 tx=0x7f57b4098230 comp rx=0 tx=0).stop 2023-09-23T09:18:11.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.590+0000 7f57d7e43b80 1 -- 172.21.15.82:0/3954268680 shutdown_connections 2023-09-23T09:18:11.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.590+0000 7f57d7e43b80 1 --2- 172.21.15.82:0/3954268680 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b05baaec40 0x55b05baaf0a0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:18:11.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.590+0000 7f57d7e43b80 1 --2- 172.21.15.82:0/3954268680 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b05bab4380 0x55b05bab4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:18:11.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.590+0000 7f57d7e43b80 1 --2- 172.21.15.82:0/3954268680 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b05bab4ca0 0x55b05baae700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:18:11.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.590+0000 7f57d7e43b80 1 -- 172.21.15.82:0/3954268680 >> 172.21.15.82:0/3954268680 conn(0x55b05ba230e0 msgr2=0x55b05baa9410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:18:11.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.590+0000 7f57d7e43b80 1 -- 172.21.15.82:0/3954268680 shutdown_connections 2023-09-23T09:18:11.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.590+0000 7f57d7e43b80 1 -- 172.21.15.82:0/3954268680 wait complete. 2023-09-23T09:18:11.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.591+0000 7f57d7e43b80 1 -- start start 2023-09-23T09:18:11.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.591+0000 7f57d7e43b80 1 Processor -- start 2023-09-23T09:18:11.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.592+0000 7f57d7e43b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b05baaec40 0x55b05babac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:18:11.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.592+0000 7f57d7e43b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b05bab4380 0x55b05bab7f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:18:11.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.592+0000 7f57d7e43b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b05bab4ca0 0x55b05bab8670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:18:11.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.592+0000 7f57d7e43b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b05ba00990 con 0x55b05bab4ca0 2023-09-23T09:18:11.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.592+0000 7f57d7e43b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b05b99ebb0 con 0x55b05bab4380 2023-09-23T09:18:11.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.592+0000 7f57d7e43b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b05b99e8b0 con 0x55b05baaec40 2023-09-23T09:18:11.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.592+0000 7f57d7e43b80 10 client.0 _ll_register_callbacks cb 0x55b05b8e8a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:18:11.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.592+0000 7f57c239b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b05baaec40 0x55b05babac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:18:11.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.592+0000 7f57c239b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b05baaec40 0x55b05babac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:55054/0 (socket says 172.21.15.82:55054) 2023-09-23T09:18:11.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.592+0000 7f57c239b700 1 -- 172.21.15.82:0/2045018979 learned_addr learned my addr 172.21.15.82:0/2045018979 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:18:11.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.592+0000 7f57c1b9a700 1 --2- 172.21.15.82:0/2045018979 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b05bab4380 0x55b05bab7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:18:11.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.592+0000 7f57c2b9c700 1 --2- 172.21.15.82:0/2045018979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b05bab4ca0 0x55b05bab8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:18:11.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.593+0000 7f57c239b700 1 -- 172.21.15.82:0/2045018979 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b05bab4380 msgr2=0x55b05bab7f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:18:11.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.593+0000 7f57c239b700 1 --2- 172.21.15.82:0/2045018979 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b05bab4380 0x55b05bab7f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:18:11.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.593+0000 7f57c239b700 1 -- 172.21.15.82:0/2045018979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b05bab4ca0 msgr2=0x55b05bab8670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:18:11.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.593+0000 7f57c239b700 1 --2- 172.21.15.82:0/2045018979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b05bab4ca0 0x55b05bab8670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:18:11.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.593+0000 7f57c239b700 1 -- 172.21.15.82:0/2045018979 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57bc1a56e0 con 0x55b05baaec40 2023-09-23T09:18:11.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.593+0000 7f57c239b700 1 --2- 172.21.15.82:0/2045018979 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b05baaec40 0x55b05babac40 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f57b8015000 tx=0x7f57b8005270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5565fd02dff50a10 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:18:11.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.593+0000 7f57a5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T09:18:11.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.594+0000 7f57a5ffb700 1 -- 172.21.15.82:0/2045018979 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b801d070 con 0x55b05baaec40 2023-09-23T09:18:11.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.594+0000 7f57a5ffb700 1 -- 172.21.15.82:0/2045018979 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(118..118 src has 1..118) v4 ==== 8557+0+0 (secure 0 0 0) 0x7f57b8004910 con 0x55b05baaec40 2023-09-23T09:18:11.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.594+0000 7f57d7e43b80 1 -- 172.21.15.82:0/2045018979 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b05ba7e1c0 con 0x55b05baaec40 2023-09-23T09:18:11.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.594+0000 7f57a5ffb700 1 -- 172.21.15.82:0/2045018979 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=76) v2 ==== 24+0+0 (secure 0 0 0) 0x7f57b8004ad0 con 0x55b05baaec40 2023-09-23T09:18:11.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.594+0000 7f57d7e43b80 10 client.26620 fetch_fsmap learned FSMap version 76 2023-09-23T09:18:11.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.595+0000 7f57d7e43b80 1 -- 172.21.15.82:0/2045018979 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=76,monmap=4+}) v3 -- 0x55b05b82cde0 con 0x55b05baaec40 2023-09-23T09:18:11.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.595+0000 7f57a5ffb700 1 -- 172.21.15.82:0/2045018979 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b05ba7e1c0 con 0x55b05baaec40 2023-09-23T09:18:11.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.595+0000 7f57a5ffb700 1 -- 172.21.15.82:0/2045018979 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 76) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f57b802e070 con 0x55b05baaec40 2023-09-23T09:18:11.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.595+0000 7f57d7e43b80 10 client.26620 fetch_fsmap finished waiting for FSMap version 76 2023-09-23T09:18:11.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.595+0000 7f57d7e43b80 10 client.26620 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:18:11.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.595+0000 7f57d7e43b80 20 client.26620 populate_metadata read hostname 'smithi082' 2023-09-23T09:18:11.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.595+0000 7f57d7e43b80 1 --2- 172.21.15.82:0/2045018979 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55b05bac87a0 0x55b05bacabc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:18:11.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.595+0000 7f57d7e43b80 4 client.26620 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:18:11.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.595+0000 7f57d7e43b80 1 -- 172.21.15.82:0/2045018979 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b05b9a6ba0 con 0x55b05bac87a0 2023-09-23T09:18:11.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.596+0000 7f57c1b9a700 1 --2- 172.21.15.82:0/2045018979 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55b05bac87a0 0x55b05bacabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:18:11.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.596+0000 7f57a5ffb700 10 client.26620 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:18:11.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.596+0000 7f57c1b9a700 1 --2- 172.21.15.82:0/2045018979 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55b05bac87a0 0x55b05bacabc0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b17740a65290a6db server_cookie=1cb8476799cf3b2d in_seq=0 out_seq=0 2023-09-23T09:18:11.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.597+0000 7f57a5ffb700 1 -- 172.21.15.82:0/2045018979 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b05b9a6ba0 con 0x55b05bac87a0 2023-09-23T09:18:11.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.597+0000 7f57a5ffb700 10 client.26620 handle_command_reply: tid=0 2023-09-23T09:18:11.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.597+0000 7f57d7e43b80 1 client.26620 shutdown 2023-09-23T09:18:11.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.598+0000 7f57d7e43b80 1 -- 172.21.15.82:0/2045018979 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b05baaec40 msgr2=0x55b05babac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:18:11.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.598+0000 7f57d7e43b80 1 --2- 172.21.15.82:0/2045018979 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b05baaec40 0x55b05babac40 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f57b8015000 tx=0x7f57b8005270 comp rx=0 tx=0).stop 2023-09-23T09:18:11.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.598+0000 7f57d7e43b80 1 -- 172.21.15.82:0/2045018979 shutdown_connections 2023-09-23T09:18:11.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.598+0000 7f57d7e43b80 1 --2- 172.21.15.82:0/2045018979 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55b05bac87a0 0x55b05bacabc0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:18:11.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.598+0000 7f57d7e43b80 1 --2- 172.21.15.82:0/2045018979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b05bab4ca0 0x55b05bab8670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:18:11.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.598+0000 7f57d7e43b80 1 --2- 172.21.15.82:0/2045018979 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b05baaec40 0x55b05babac40 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:18:11.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.598+0000 7f57d7e43b80 1 --2- 172.21.15.82:0/2045018979 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b05bab4380 0x55b05bab7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:18:11.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.598+0000 7f57d7e43b80 1 -- 172.21.15.82:0/2045018979 >> 172.21.15.82:0/2045018979 conn(0x55b05ba230e0 msgr2=0x55b05baa3b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:18:11.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.598+0000 7f57a5ffb700 0 client.26620 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:18:11.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.598+0000 7f57d7e43b80 1 -- 172.21.15.82:0/2045018979 shutdown_connections 2023-09-23T09:18:11.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.598+0000 7f57d7e43b80 1 -- 172.21.15.82:0/2045018979 wait complete. 2023-09-23T09:18:11.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.598+0000 7f57d7e43b80 20 client.26620 trim_cache size 0 max 16384 2023-09-23T09:18:11.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.621+0000 7f57d7e43b80 1 Processor -- start 2023-09-23T09:18:11.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.621+0000 7f57d7e43b80 1 -- start start 2023-09-23T09:18:11.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.621+0000 7f57d7e43b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b05baaec40 0x55b05bab7740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:18:11.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.621+0000 7f57d7e43b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b05bab4380 0x55b05bab3730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:18:11.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.621+0000 7f57d7e43b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b05bab4ca0 0x55b05baba7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:18:11.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.621+0000 7f57d7e43b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b05bac5140 con 0x55b05bab4380 2023-09-23T09:18:11.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.621+0000 7f57d7e43b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b05b882920 con 0x55b05bab4ca0 2023-09-23T09:18:11.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.621+0000 7f57d7e43b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b05bab4ad0 con 0x55b05baaec40 2023-09-23T09:18:11.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.622+0000 7f57c2b9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b05bab4ca0 0x55b05baba7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:18:11.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.622+0000 7f57c239b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b05baaec40 0x55b05bab7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:18:11.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.622+0000 7f57c2b9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b05bab4ca0 0x55b05baba7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:60166/0 (socket says 172.21.15.82:60166) 2023-09-23T09:18:11.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.622+0000 7f57c2b9c700 1 -- 172.21.15.82:0/941765171 learned_addr learned my addr 172.21.15.82:0/941765171 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:18:11.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.622+0000 7f57c1b9a700 1 --2- 172.21.15.82:0/941765171 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b05bab4380 0x55b05bab3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:18:11.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.622+0000 7f57c239b700 1 -- 172.21.15.82:0/941765171 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b05bab4ca0 msgr2=0x55b05baba7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:18:11.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.622+0000 7f57c239b700 1 --2- 172.21.15.82:0/941765171 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b05bab4ca0 0x55b05baba7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:18:11.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.622+0000 7f57c239b700 1 -- 172.21.15.82:0/941765171 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b05bab4380 msgr2=0x55b05bab3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:18:11.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.622+0000 7f57c239b700 1 --2- 172.21.15.82:0/941765171 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b05bab4380 0x55b05bab3730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:18:11.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.622+0000 7f57c239b700 1 -- 172.21.15.82:0/941765171 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b05bacf7d0 con 0x55b05baaec40 2023-09-23T09:18:11.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.622+0000 7f57c1b9a700 1 --2- 172.21.15.82:0/941765171 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b05bab4380 0x55b05bab3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:18:11.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.622+0000 7f57c239b700 1 --2- 172.21.15.82:0/941765171 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b05baaec40 0x55b05bab7740 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f57b80167b0 tx=0x7f57b800fe60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c1a76d40a750ed46 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:18:11.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.623+0000 7f57b13ff700 1 -- 172.21.15.82:0/941765171 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b801d070 con 0x55b05baaec40 2023-09-23T09:18:11.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.623+0000 7f57b13ff700 1 -- 172.21.15.82:0/941765171 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f57b801e040 con 0x55b05baaec40 2023-09-23T09:18:11.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.623+0000 7f57b13ff700 1 -- 172.21.15.82:0/941765171 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b800f6c0 con 0x55b05baaec40 2023-09-23T09:18:11.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.623+0000 7f57d7e43b80 1 -- 172.21.15.82:0/941765171 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b05baaec40 msgr2=0x55b05bab7740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:18:11.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.623+0000 7f57d7e43b80 1 --2- 172.21.15.82:0/941765171 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b05baaec40 0x55b05bab7740 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f57b80167b0 tx=0x7f57b800fe60 comp rx=0 tx=0).stop 2023-09-23T09:18:11.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.624+0000 7f57d7e43b80 1 -- 172.21.15.82:0/941765171 shutdown_connections 2023-09-23T09:18:11.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.624+0000 7f57d7e43b80 1 --2- 172.21.15.82:0/941765171 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b05bab4ca0 0x55b05baba7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:18:11.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.624+0000 7f57d7e43b80 1 --2- 172.21.15.82:0/941765171 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b05baaec40 0x55b05bab7740 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:18:11.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.624+0000 7f57d7e43b80 1 --2- 172.21.15.82:0/941765171 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b05bab4380 0x55b05bab3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:18:11.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.624+0000 7f57d7e43b80 1 -- 172.21.15.82:0/941765171 >> 172.21.15.82:0/941765171 conn(0x55b05ba230e0 msgr2=0x55b05bab3020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:18:11.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.624+0000 7f57d7e43b80 1 -- 172.21.15.82:0/941765171 shutdown_connections 2023-09-23T09:18:11.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.624+0000 7f57d7e43b80 1 -- 172.21.15.82:0/941765171 wait complete. 2023-09-23T09:18:11.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.624+0000 7f57d7e43b80 1 -- start start 2023-09-23T09:18:11.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.624+0000 7f57d7e43b80 1 Processor -- start 2023-09-23T09:18:11.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.625+0000 7f57d7e43b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b05baaec40 0x55b05babf990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:18:11.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.625+0000 7f57d7e43b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b05bab4380 0x55b05bab0230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:18:11.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.625+0000 7f57d7e43b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b05bab4ca0 0x55b05bab0770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:18:11.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.625+0000 7f57d7e43b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b05bab0e30 con 0x55b05bab4380 2023-09-23T09:18:11.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.625+0000 7f57d7e43b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b05bab0fa0 con 0x55b05baaec40 2023-09-23T09:18:11.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.625+0000 7f57d7e43b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b05bb1c5b0 con 0x55b05bab4ca0 2023-09-23T09:18:11.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.625+0000 7f57d7e43b80 10 client.0 _ll_register_callbacks cb 0x7f57b800bdd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:18:11.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.626+0000 7f57c239b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b05baaec40 0x55b05babf990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:18:11.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.626+0000 7f57c2b9c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b05bab4ca0 0x55b05bab0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:18:11.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.626+0000 7f57c239b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b05baaec40 0x55b05babf990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:60174/0 (socket says 172.21.15.82:60174) 2023-09-23T09:18:11.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.626+0000 7f57c239b700 1 -- 172.21.15.82:0/1428221935 learned_addr learned my addr 172.21.15.82:0/1428221935 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:18:11.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.626+0000 7f57c1b9a700 1 --2- 172.21.15.82:0/1428221935 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b05bab4380 0x55b05bab0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:18:11.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.626+0000 7f57c2b9c700 1 -- 172.21.15.82:0/1428221935 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b05baaec40 msgr2=0x55b05babf990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:18:11.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.626+0000 7f57c2b9c700 1 --2- 172.21.15.82:0/1428221935 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b05baaec40 0x55b05babf990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:18:11.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.626+0000 7f57c2b9c700 1 -- 172.21.15.82:0/1428221935 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b05bab4380 msgr2=0x55b05bab0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:18:11.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.626+0000 7f57c2b9c700 1 --2- 172.21.15.82:0/1428221935 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b05bab4380 0x55b05bab0230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:18:11.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.626+0000 7f57c2b9c700 1 -- 172.21.15.82:0/1428221935 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b05b82cde0 con 0x55b05bab4ca0 2023-09-23T09:18:11.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.626+0000 7f57c2b9c700 1 --2- 172.21.15.82:0/1428221935 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b05bab4ca0 0x55b05bab0770 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f57b40c8cb0 tx=0x7f57b4098050 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6747e34fa44f660 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:18:11.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.626+0000 7f57a5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T09:18:11.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.627+0000 7f57a5ffb700 1 -- 172.21.15.82:0/1428221935 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b40192c0 con 0x55b05bab4ca0 2023-09-23T09:18:11.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.627+0000 7f57a5ffb700 1 -- 172.21.15.82:0/1428221935 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(118..118 src has 1..118) v4 ==== 8557+0+0 (secure 0 0 0) 0x7f57b40a0480 con 0x55b05bab4ca0 2023-09-23T09:18:11.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.627+0000 7f57d7e43b80 1 -- 172.21.15.82:0/1428221935 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b05baa18b0 con 0x55b05bab4ca0 2023-09-23T09:18:11.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.627+0000 7f57a5ffb700 1 -- 172.21.15.82:0/1428221935 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=76) v2 ==== 24+0+0 (secure 0 0 0) 0x7f57b4098670 con 0x55b05bab4ca0 2023-09-23T09:18:11.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.627+0000 7f57d7e43b80 10 client.26626 fetch_fsmap learned FSMap version 76 2023-09-23T09:18:11.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.627+0000 7f57d7e43b80 1 -- 172.21.15.82:0/1428221935 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=76,monmap=4+}) v3 -- 0x55b05b815c60 con 0x55b05bab4ca0 2023-09-23T09:18:11.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.627+0000 7f57a5ffb700 1 -- 172.21.15.82:0/1428221935 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b05baa18b0 con 0x55b05bab4ca0 2023-09-23T09:18:11.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.628+0000 7f57a5ffb700 1 -- 172.21.15.82:0/1428221935 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 76) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f57b40831e0 con 0x55b05bab4ca0 2023-09-23T09:18:11.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.628+0000 7f57d7e43b80 10 client.26626 fetch_fsmap finished waiting for FSMap version 76 2023-09-23T09:18:11.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.628+0000 7f57d7e43b80 10 client.26626 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:18:11.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.628+0000 7f57d7e43b80 20 client.26626 populate_metadata read hostname 'smithi082' 2023-09-23T09:18:11.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.628+0000 7f57d7e43b80 1 --2- 172.21.15.82:0/1428221935 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55b05bb1d8d0 0x55b05bb1fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:18:11.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.628+0000 7f57d7e43b80 4 client.26626 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:18:11.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.628+0000 7f57d7e43b80 1 -- 172.21.15.82:0/1428221935 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55b05b9f9970 con 0x55b05bb1d8d0 2023-09-23T09:18:11.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.628+0000 7f57c239b700 1 --2- 172.21.15.82:0/1428221935 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55b05bb1d8d0 0x55b05bb1fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:18:11.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.629+0000 7f57a5ffb700 10 client.26626 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:18:11.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.629+0000 7f57c239b700 1 --2- 172.21.15.82:0/1428221935 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55b05bb1d8d0 0x55b05bb1fcf0 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=71e28c08d926d2aa server_cookie=3995a95fbaefd41e in_seq=0 out_seq=0 2023-09-23T09:18:11.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.629+0000 7f57a5ffb700 1 -- 172.21.15.82:0/1428221935 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55b05b9f9970 con 0x55b05bb1d8d0 2023-09-23T09:18:11.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.629+0000 7f57a5ffb700 10 client.26626 handle_command_reply: tid=0 2023-09-23T09:18:11.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.629+0000 7f57d7e43b80 1 client.26626 shutdown 2023-09-23T09:18:11.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.629+0000 7f57d7e43b80 1 -- 172.21.15.82:0/1428221935 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b05bab4ca0 msgr2=0x55b05bab0770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:18:11.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.629+0000 7f57d7e43b80 1 --2- 172.21.15.82:0/1428221935 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b05bab4ca0 0x55b05bab0770 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f57b40c8cb0 tx=0x7f57b4098050 comp rx=0 tx=0).stop 2023-09-23T09:18:11.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.630+0000 7f57d7e43b80 1 -- 172.21.15.82:0/1428221935 shutdown_connections 2023-09-23T09:18:11.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.630+0000 7f57d7e43b80 1 --2- 172.21.15.82:0/1428221935 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b05bab4ca0 0x55b05bab0770 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:18:11.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.630+0000 7f57d7e43b80 1 --2- 172.21.15.82:0/1428221935 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b05baaec40 0x55b05babf990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:18:11.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.630+0000 7f57d7e43b80 1 --2- 172.21.15.82:0/1428221935 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55b05bb1d8d0 0x55b05bb1fcf0 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:18:11.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.630+0000 7f57d7e43b80 1 --2- 172.21.15.82:0/1428221935 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b05bab4380 0x55b05bab0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:18:11.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.630+0000 7f57d7e43b80 1 -- 172.21.15.82:0/1428221935 >> 172.21.15.82:0/1428221935 conn(0x55b05ba230e0 msgr2=0x55b05baa32b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:18:11.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.630+0000 7f57a5ffb700 0 client.26626 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:18:11.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.630+0000 7f57d7e43b80 1 -- 172.21.15.82:0/1428221935 shutdown_connections 2023-09-23T09:18:11.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.630+0000 7f57d7e43b80 1 -- 172.21.15.82:0/1428221935 wait complete. 2023-09-23T09:18:11.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.630+0000 7f57d7e43b80 20 client.26626 trim_cache size 0 max 16384 2023-09-23T09:18:11.635 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:18:11.636 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-23T09:18:11.636 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:18:11.636 INFO:teuthology.orchestra.run.smithi082.stdout: "047cbc72-e254-4787-b038-382de9c1a9a4": { 2023-09-23T09:18:11.636 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:18:11.636 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "047cbc72-e254-4787-b038-382de9c1a9a4", 2023-09-23T09:18:11.636 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:18:11.636 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:18:11.636 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:18:11.636 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:18:11.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.631+0000 7f57c45ff700 1 -- 172.21.15.82:0/807745201 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f57a80a00c0 msgr2=0x7f57a80a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:18:11.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.631+0000 7f57c45ff700 1 --2- 172.21.15.82:0/807745201 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f57a80a00c0 0x7f57a80a2580 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x55b05bab5100 tx=0x7f57ac0099b0 comp rx=0 tx=0).stop 2023-09-23T09:18:11.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.631+0000 7f57c45ff700 1 -- 172.21.15.82:0/807745201 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57bc108ad0 msgr2=0x7f57bc198940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:18:11.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.631+0000 7f57c45ff700 1 --2- 172.21.15.82:0/807745201 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57bc108ad0 0x7f57bc198940 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f57b400c370 tx=0x7f57b400c680 comp rx=0 tx=0).stop 2023-09-23T09:18:11.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.631+0000 7f57c45ff700 1 -- 172.21.15.82:0/807745201 shutdown_connections 2023-09-23T09:18:11.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.631+0000 7f57c45ff700 1 --2- 172.21.15.82:0/807745201 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f57a80a00c0 0x7f57a80a2580 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:18:11.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.631+0000 7f57c45ff700 1 --2- 172.21.15.82:0/807745201 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57bc108ad0 0x7f57bc198940 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:18:11.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.631+0000 7f57c45ff700 1 --2- 172.21.15.82:0/807745201 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57bc102ac0 0x7f57bc19e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:18:11.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.631+0000 7f57c45ff700 1 --2- 172.21.15.82:0/807745201 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57bc103480 0x7f57bc19ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:18:11.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.631+0000 7f57c45ff700 1 -- 172.21.15.82:0/807745201 >> 172.21.15.82:0/807745201 conn(0x7f57bc0fe570 msgr2=0x7f57bc0fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:18:11.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.631+0000 7f57c45ff700 1 -- 172.21.15.82:0/807745201 shutdown_connections 2023-09-23T09:18:11.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:11.631+0000 7f57c45ff700 1 -- 172.21.15.82:0/807745201 wait complete. 2023-09-23T09:18:11.654 INFO:tasks.cephfs.filesystem:scrub status for tag:047cbc72-e254-4787-b038-382de9c1a9a4 - {'path': '/', 'tag': '047cbc72-e254-4787-b038-382de9c1a9a4', 'options': 'recursive,force'} 2023-09-23T09:18:13.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:18:12 smithi135 ceph-mon[99205]: pgmap v671: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.4 MiB/s wr, 476 op/s 2023-09-23T09:18:13.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:18:12 smithi135 ceph-mon[99205]: osdmap e119: 12 total, 12 up, 12 in 2023-09-23T09:18:13.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:18:12 smithi082 ceph-mon[97694]: pgmap v671: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.4 MiB/s wr, 476 op/s 2023-09-23T09:18:13.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:18:12 smithi082 ceph-mon[97694]: osdmap e119: 12 total, 12 up, 12 in 2023-09-23T09:18:13.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:18:12 smithi161 ceph-mon[99580]: pgmap v671: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.4 MiB/s wr, 476 op/s 2023-09-23T09:18:13.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:18:12 smithi161 ceph-mon[99580]: osdmap e119: 12 total, 12 up, 12 in 2023-09-23T09:18:15.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:18:14 smithi135 ceph-mon[99205]: pgmap v673: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 283 op/s 2023-09-23T09:18:15.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:18:14 smithi082 ceph-mon[97694]: pgmap v673: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 283 op/s 2023-09-23T09:18:15.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:18:14 smithi161 ceph-mon[99580]: pgmap v673: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 283 op/s 2023-09-23T09:18:17.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:18:16 smithi135 ceph-mon[99205]: pgmap v674: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.9 MiB/s wr, 540 op/s 2023-09-23T09:18:17.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:18:16 smithi082 ceph-mon[97694]: pgmap v674: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.9 MiB/s wr, 540 op/s 2023-09-23T09:18:17.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:18:16 smithi161 ceph-mon[99580]: pgmap v674: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.9 MiB/s wr, 540 op/s 2023-09-23T09:18:19.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:18:18 smithi135 ceph-mon[99205]: pgmap v675: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.4 MiB/s wr, 465 op/s 2023-09-23T09:18:19.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:18:18 smithi082 ceph-mon[97694]: pgmap v675: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.4 MiB/s wr, 465 op/s 2023-09-23T09:18:19.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:18:18 smithi161 ceph-mon[99580]: pgmap v675: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.4 MiB/s wr, 465 op/s 2023-09-23T09:18:21.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:18:20 smithi135 ceph-mon[99205]: pgmap v676: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.5 MiB/s wr, 489 op/s 2023-09-23T09:18:21.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:18:20 smithi082 ceph-mon[97694]: pgmap v676: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.5 MiB/s wr, 489 op/s 2023-09-23T09:18:21.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:18:20 smithi161 ceph-mon[99580]: pgmap v676: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.5 MiB/s wr, 489 op/s 2023-09-23T09:18:23.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:18:22 smithi135 ceph-mon[99205]: pgmap v677: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.5 MiB/s wr, 489 op/s 2023-09-23T09:18:23.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:18:22 smithi082 ceph-mon[97694]: pgmap v677: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.5 MiB/s wr, 489 op/s 2023-09-23T09:18:23.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:18:22 smithi161 ceph-mon[99580]: pgmap v677: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.5 MiB/s wr, 489 op/s 2023-09-23T09:18:25.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:18:24 smithi135 ceph-mon[99205]: pgmap v678: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.0 MiB/s wr, 421 op/s 2023-09-23T09:18:25.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:18:24 smithi082 ceph-mon[97694]: pgmap v678: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.0 MiB/s wr, 421 op/s 2023-09-23T09:18:25.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:18:24 smithi161 ceph-mon[99580]: pgmap v678: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.0 MiB/s wr, 421 op/s 2023-09-23T09:18:26.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:18:25 smithi082 ceph-mon[97694]: pgmap v679: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.3 MiB/s wr, 597 op/s 2023-09-23T09:18:26.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:18:25 smithi161 ceph-mon[99580]: pgmap v679: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.3 MiB/s wr, 597 op/s 2023-09-23T09:18:26.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:18:25 smithi135 ceph-mon[99205]: pgmap v679: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.3 MiB/s wr, 597 op/s 2023-09-23T09:18:29.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:18:28 smithi135 ceph-mon[99205]: pgmap v680: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.9 MiB/s wr, 398 op/s 2023-09-23T09:18:29.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:18:28 smithi082 ceph-mon[97694]: pgmap v680: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.9 MiB/s wr, 398 op/s 2023-09-23T09:18:29.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:18:28 smithi161 ceph-mon[99580]: pgmap v680: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.9 MiB/s wr, 398 op/s 2023-09-23T09:18:31.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:18:30 smithi135 ceph-mon[99205]: pgmap v681: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.3 MiB/s wr, 590 op/s 2023-09-23T09:18:31.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:18:30 smithi082 ceph-mon[97694]: pgmap v681: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.3 MiB/s wr, 590 op/s 2023-09-23T09:18:31.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:18:30 smithi161 ceph-mon[99580]: pgmap v681: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.3 MiB/s wr, 590 op/s 2023-09-23T09:18:33.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:18:32 smithi135 ceph-mon[99205]: pgmap v682: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.8 MiB/s wr, 381 op/s 2023-09-23T09:18:33.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:18:32 smithi082 ceph-mon[97694]: pgmap v682: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.8 MiB/s wr, 381 op/s 2023-09-23T09:18:33.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:18:32 smithi161 ceph-mon[99580]: pgmap v682: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.8 MiB/s wr, 381 op/s 2023-09-23T09:18:35.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:18:34 smithi135 ceph-mon[99205]: pgmap v683: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.8 MiB/s wr, 381 op/s 2023-09-23T09:18:35.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:18:34 smithi082 ceph-mon[97694]: pgmap v683: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.8 MiB/s wr, 381 op/s 2023-09-23T09:18:35.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:18:34 smithi161 ceph-mon[99580]: pgmap v683: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.8 MiB/s wr, 381 op/s 2023-09-23T09:18:36.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:18:35 smithi135 ceph-mon[99205]: pgmap v684: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.1 MiB/s wr, 573 op/s 2023-09-23T09:18:36.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:18:35 smithi082 ceph-mon[97694]: pgmap v684: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.1 MiB/s wr, 573 op/s 2023-09-23T09:18:36.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:18:35 smithi161 ceph-mon[99580]: pgmap v684: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.1 MiB/s wr, 573 op/s 2023-09-23T09:18:39.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:18:38 smithi135 ceph-mon[99205]: pgmap v685: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.8 MiB/s wr, 383 op/s 2023-09-23T09:18:39.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:18:38 smithi082 ceph-mon[97694]: pgmap v685: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.8 MiB/s wr, 383 op/s 2023-09-23T09:18:39.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:18:38 smithi161 ceph-mon[99580]: pgmap v685: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.8 MiB/s wr, 383 op/s 2023-09-23T09:18:40.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:18:39 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:18:40.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:18:39 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:18:40.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:18:39 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:18:41.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:18:40 smithi135 ceph-mon[99205]: pgmap v686: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.0 MiB/s wr, 553 op/s 2023-09-23T09:18:41.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:18:40 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:18:41.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:18:40 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:18:41.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:18:40 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:18:41.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:18:40 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:18:41.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:18:40 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:18:41.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:18:40 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:18:41.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:18:40 smithi082 ceph-mon[97694]: pgmap v686: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.0 MiB/s wr, 553 op/s 2023-09-23T09:18:41.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:18:40 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:18:41.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:18:40 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:18:41.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:18:40 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:18:41.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:18:40 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:18:41.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:18:40 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:18:41.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:18:40 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:18:41.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:18:40 smithi161 ceph-mon[99580]: pgmap v686: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.0 MiB/s wr, 553 op/s 2023-09-23T09:18:41.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:18:40 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:18:41.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:18:40 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:18:41.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:18:40 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:18:41.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:18:40 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:18:41.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:18:40 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:18:41.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:18:40 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:18:41.655 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:18:41.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.879+0000 7f297adff700 1 -- 172.21.15.82:0/2119681192 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29741068b0 msgr2=0x7f2974106c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:18:41.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.879+0000 7f297adff700 1 --2- 172.21.15.82:0/2119681192 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29741068b0 0x7f2974106c90 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f2968009990 tx=0x7f2968009ca0 comp rx=0 tx=0).stop 2023-09-23T09:18:41.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.879+0000 7f297adff700 1 -- 172.21.15.82:0/2119681192 shutdown_connections 2023-09-23T09:18:41.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.879+0000 7f297adff700 1 --2- 172.21.15.82:0/2119681192 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2974101260 0x7f297410d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:18:41.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.879+0000 7f297adff700 1 --2- 172.21.15.82:0/2119681192 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29741068b0 0x7f2974106c90 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:18:41.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.879+0000 7f297adff700 1 --2- 172.21.15.82:0/2119681192 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f29741008a0 0x7f2974100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:18:41.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.879+0000 7f297adff700 1 -- 172.21.15.82:0/2119681192 >> 172.21.15.82:0/2119681192 conn(0x7f29740fc390 msgr2=0x7f29740fe7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:18:41.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.880+0000 7f297adff700 1 -- 172.21.15.82:0/2119681192 shutdown_connections 2023-09-23T09:18:41.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.880+0000 7f297adff700 1 -- 172.21.15.82:0/2119681192 wait complete. 2023-09-23T09:18:41.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.881+0000 7f297adff700 1 Processor -- start 2023-09-23T09:18:41.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.881+0000 7f297adff700 1 -- start start 2023-09-23T09:18:41.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.881+0000 7f297adff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29741008a0 0x7f297419e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:18:41.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.881+0000 7f297adff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2974101260 0x7f297419eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:18:41.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.882+0000 7f297adff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f29741068b0 0x7f2974198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:18:41.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.882+0000 7f297adff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2974199150 con 0x7f29741008a0 2023-09-23T09:18:41.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.882+0000 7f297adff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29741992c0 con 0x7f29741068b0 2023-09-23T09:18:41.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.882+0000 7f297adff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2974199480 con 0x7f2974101260 2023-09-23T09:18:41.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.882+0000 7f2978b9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29741008a0 0x7f297419e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:18:41.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.882+0000 7f2978b9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29741008a0 0x7f297419e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48220/0 (socket says 172.21.15.82:48220) 2023-09-23T09:18:41.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.882+0000 7f2978b9b700 1 -- 172.21.15.82:0/3169382794 learned_addr learned my addr 172.21.15.82:0/3169382794 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:18:41.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.882+0000 7f2973fff700 1 --2- 172.21.15.82:0/3169382794 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2974101260 0x7f297419eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:18:41.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.882+0000 7f297939c700 1 --2- 172.21.15.82:0/3169382794 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f29741068b0 0x7f2974198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:18:41.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.882+0000 7f297939c700 1 -- 172.21.15.82:0/3169382794 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2974101260 msgr2=0x7f297419eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:18:41.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.882+0000 7f297939c700 1 --2- 172.21.15.82:0/3169382794 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2974101260 0x7f297419eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:18:41.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.882+0000 7f297939c700 1 -- 172.21.15.82:0/3169382794 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29741008a0 msgr2=0x7f297419e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:18:41.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.882+0000 7f297939c700 1 --2- 172.21.15.82:0/3169382794 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29741008a0 0x7f297419e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:18:41.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.882+0000 7f297939c700 1 -- 172.21.15.82:0/3169382794 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29680095f0 con 0x7f29741068b0 2023-09-23T09:18:41.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.882+0000 7f2978b9b700 1 --2- 172.21.15.82:0/3169382794 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29741008a0 0x7f297419e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:18:41.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.883+0000 7f297939c700 1 --2- 172.21.15.82:0/3169382794 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f29741068b0 0x7f2974198980 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f296c00efc0 tx=0x7f296c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:18:41.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.883+0000 7f2971ffb700 1 -- 172.21.15.82:0/3169382794 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f296c018070 con 0x7f29741068b0 2023-09-23T09:18:41.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.883+0000 7f297adff700 1 -- 172.21.15.82:0/3169382794 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2974199700 con 0x7f29741068b0 2023-09-23T09:18:41.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.883+0000 7f2971ffb700 1 -- 172.21.15.82:0/3169382794 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f296c00f040 con 0x7f29741068b0 2023-09-23T09:18:41.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.883+0000 7f2971ffb700 1 -- 172.21.15.82:0/3169382794 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f296c00cba0 con 0x7f29741068b0 2023-09-23T09:18:41.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.883+0000 7f297adff700 1 -- 172.21.15.82:0/3169382794 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29741a5920 con 0x7f29741068b0 2023-09-23T09:18:41.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.888+0000 7f2971ffb700 1 -- 172.21.15.82:0/3169382794 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f296c003a00 con 0x7f29741068b0 2023-09-23T09:18:41.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.889+0000 7f298e7e5b80 1 Processor -- start 2023-09-23T09:18:41.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.889+0000 7f298e7e5b80 1 -- start start 2023-09-23T09:18:41.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.889+0000 7f298e7e5b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a956da380 0x562a956da760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:18:41.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.889+0000 7f298e7e5b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562a956daca0 0x562a956d4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:18:41.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.889+0000 7f298e7e5b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a956d4c40 0x562a956d50a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:18:41.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.889+0000 7f298e7e5b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a9563c7b0 con 0x562a956d4c40 2023-09-23T09:18:41.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.889+0000 7f298e7e5b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a9562d780 con 0x562a956da380 2023-09-23T09:18:41.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.889+0000 7f298e7e5b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a9562b0a0 con 0x562a956daca0 2023-09-23T09:18:41.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.890+0000 7f2973fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a956da380 0x562a956da760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:18:41.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.890+0000 7f2978b9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562a956daca0 0x562a956d4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:18:41.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.890+0000 7f2978b9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562a956daca0 0x562a956d4700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:49626/0 (socket says 172.21.15.82:49626) 2023-09-23T09:18:41.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.890+0000 7f2978b9b700 1 -- 172.21.15.82:0/2562109038 learned_addr learned my addr 172.21.15.82:0/2562109038 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:18:41.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.890+0000 7f2973fff700 1 --2- 172.21.15.82:0/2562109038 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a956d4c40 0x562a956d50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:18:41.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.890+0000 7f2978b9b700 1 -- 172.21.15.82:0/2562109038 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a956da380 msgr2=0x562a956da760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:18:41.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.890+0000 7f2978b9b700 1 --2- 172.21.15.82:0/2562109038 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a956da380 0x562a956da760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:18:41.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.890+0000 7f2978b9b700 1 -- 172.21.15.82:0/2562109038 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a956d4c40 msgr2=0x562a956d50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:18:41.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.890+0000 7f2978b9b700 1 --2- 172.21.15.82:0/2562109038 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a956d4c40 0x562a956d50a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:18:41.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.890+0000 7f2971ffb700 1 --2- 172.21.15.82:0/3169382794 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f29640a00c0 0x7f29640a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:18:41.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.890+0000 7f2978b9b700 1 -- 172.21.15.82:0/2562109038 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562a954a6630 con 0x562a956daca0 2023-09-23T09:18:41.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.890+0000 7f2973fff700 1 --2- 172.21.15.82:0/2562109038 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a956d4c40 0x562a956d50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:18:41.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.890+0000 7f2971ffb700 1 -- 172.21.15.82:0/3169382794 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f296c0cb0c0 con 0x7f29741068b0 2023-09-23T09:18:41.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.890+0000 7f297939c700 1 --2- 172.21.15.82:0/3169382794 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f29640a00c0 0x7f29640a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:18:41.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.890+0000 7f2978b9b700 1 --2- 172.21.15.82:0/2562109038 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562a956daca0 0x562a956d4700 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2968005c70 tx=0x7f2968004500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2007450b7a6f3a54 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:18:41.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.891+0000 7f295effd700 1 -- 172.21.15.82:0/2562109038 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f296801d050 con 0x562a956daca0 2023-09-23T09:18:41.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.891+0000 7f295effd700 1 -- 172.21.15.82:0/2562109038 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f296801e040 con 0x562a956daca0 2023-09-23T09:18:41.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.891+0000 7f297939c700 1 --2- 172.21.15.82:0/3169382794 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f29640a00c0 0x7f29640a2580 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f296c0c88c0 tx=0x7f296c004c50 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:18:41.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.891+0000 7f295effd700 1 -- 172.21.15.82:0/2562109038 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2968004c90 con 0x562a956daca0 2023-09-23T09:18:41.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.892+0000 7f298e7e5b80 1 -- 172.21.15.82:0/2562109038 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562a956daca0 msgr2=0x562a956d4700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:18:41.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.892+0000 7f298e7e5b80 1 --2- 172.21.15.82:0/2562109038 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562a956daca0 0x562a956d4700 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2968005c70 tx=0x7f2968004500 comp rx=0 tx=0).stop 2023-09-23T09:18:41.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.892+0000 7f298e7e5b80 1 -- 172.21.15.82:0/2562109038 shutdown_connections 2023-09-23T09:18:41.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.892+0000 7f298e7e5b80 1 --2- 172.21.15.82:0/2562109038 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a956d4c40 0x562a956d50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:18:41.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.892+0000 7f298e7e5b80 1 --2- 172.21.15.82:0/2562109038 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a956da380 0x562a956da760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:18:41.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.892+0000 7f298e7e5b80 1 --2- 172.21.15.82:0/2562109038 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562a956daca0 0x562a956d4700 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:18:41.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.892+0000 7f298e7e5b80 1 -- 172.21.15.82:0/2562109038 >> 172.21.15.82:0/2562109038 conn(0x562a956490e0 msgr2=0x562a956cf410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:18:41.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.892+0000 7f298e7e5b80 1 -- 172.21.15.82:0/2562109038 shutdown_connections 2023-09-23T09:18:41.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.892+0000 7f298e7e5b80 1 -- 172.21.15.82:0/2562109038 wait complete. 2023-09-23T09:18:41.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.892+0000 7f298e7e5b80 1 -- start start 2023-09-23T09:18:41.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.893+0000 7f298e7e5b80 1 Processor -- start 2023-09-23T09:18:41.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.893+0000 7f298e7e5b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562a956d4c40 0x562a956e0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:18:41.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.893+0000 7f298e7e5b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a956da380 0x562a956ddf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:18:41.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.893+0000 7f298e7e5b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a956daca0 0x562a956de5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:18:41.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.893+0000 7f298e7e5b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a95626990 con 0x562a956daca0 2023-09-23T09:18:41.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.893+0000 7f298e7e5b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a955c4bb0 con 0x562a956da380 2023-09-23T09:18:41.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.893+0000 7f298e7e5b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a955c48b0 con 0x562a956d4c40 2023-09-23T09:18:41.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.893+0000 7f298e7e5b80 10 client.0 _ll_register_callbacks cb 0x562a9550ea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:18:41.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.894+0000 7f2973fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562a956d4c40 0x562a956e0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:18:41.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.894+0000 7f2973fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562a956d4c40 0x562a956e0c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:49638/0 (socket says 172.21.15.82:49638) 2023-09-23T09:18:41.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.894+0000 7f2973fff700 1 -- 172.21.15.82:0/4010553219 learned_addr learned my addr 172.21.15.82:0/4010553219 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:18:41.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.894+0000 7f2973fff700 1 --2- 172.21.15.82:0/4010553219 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a956daca0 0x562a956de5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:18:41.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.894+0000 7f2978b9b700 1 --2- 172.21.15.82:0/4010553219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a956da380 0x562a956ddf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:18:41.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.894+0000 7f2973fff700 1 -- 172.21.15.82:0/4010553219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a956da380 msgr2=0x562a956ddf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:18:41.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.894+0000 7f2973fff700 1 --2- 172.21.15.82:0/4010553219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a956da380 0x562a956ddf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:18:41.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.894+0000 7f2973fff700 1 -- 172.21.15.82:0/4010553219 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a956daca0 msgr2=0x562a956de5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:18:41.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.894+0000 7f2973fff700 1 --2- 172.21.15.82:0/4010553219 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a956daca0 0x562a956de5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:18:41.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.894+0000 7f2973fff700 1 -- 172.21.15.82:0/4010553219 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2960010620 con 0x562a956d4c40 2023-09-23T09:18:41.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.894+0000 7f2978b9b700 1 --2- 172.21.15.82:0/4010553219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a956da380 0x562a956ddf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:18:41.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.894+0000 7f2973fff700 1 --2- 172.21.15.82:0/4010553219 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562a956d4c40 0x562a956e0c80 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f296000f410 tx=0x7f2960009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c69c3eeedd6198a7 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:18:41.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.894+0000 7f2953fff700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T09:18:41.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.895+0000 7f2953fff700 1 -- 172.21.15.82:0/4010553219 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2960004a30 con 0x562a956d4c40 2023-09-23T09:18:41.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.895+0000 7f2953fff700 1 -- 172.21.15.82:0/4010553219 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(119..119 src has 1..119) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f296000fe70 con 0x562a956d4c40 2023-09-23T09:18:41.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.895+0000 7f298e7e5b80 1 -- 172.21.15.82:0/4010553219 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562a956a41c0 con 0x562a956d4c40 2023-09-23T09:18:41.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.895+0000 7f2953fff700 1 -- 172.21.15.82:0/4010553219 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=76) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2960004b90 con 0x562a956d4c40 2023-09-23T09:18:41.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.895+0000 7f298e7e5b80 10 client.26638 fetch_fsmap learned FSMap version 76 2023-09-23T09:18:41.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.895+0000 7f298e7e5b80 1 -- 172.21.15.82:0/4010553219 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=76,monmap=4+}) v3 -- 0x7f297410e070 con 0x562a956d4c40 2023-09-23T09:18:41.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.895+0000 7f2953fff700 1 -- 172.21.15.82:0/4010553219 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562a956a41c0 con 0x562a956d4c40 2023-09-23T09:18:41.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.895+0000 7f2953fff700 1 -- 172.21.15.82:0/4010553219 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 76) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f2960021470 con 0x562a956d4c40 2023-09-23T09:18:41.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.895+0000 7f298e7e5b80 10 client.26638 fetch_fsmap finished waiting for FSMap version 76 2023-09-23T09:18:41.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.895+0000 7f298e7e5b80 10 client.26638 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:18:41.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.896+0000 7f298e7e5b80 20 client.26638 populate_metadata read hostname 'smithi082' 2023-09-23T09:18:41.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.896+0000 7f298e7e5b80 1 --2- 172.21.15.82:0/4010553219 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x562a956ee710 0x562a956f0b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:18:41.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.896+0000 7f298e7e5b80 4 client.26638 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:18:41.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.896+0000 7f298e7e5b80 1 -- 172.21.15.82:0/4010553219 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562a955ccba0 con 0x562a956ee710 2023-09-23T09:18:41.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.896+0000 7f2978b9b700 1 --2- 172.21.15.82:0/4010553219 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x562a956ee710 0x562a956f0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:18:41.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.897+0000 7f2978b9b700 1 --2- 172.21.15.82:0/4010553219 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x562a956ee710 0x562a956f0b30 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c5500986fe0f6c4 server_cookie=7d839ff922eab39d in_seq=0 out_seq=0 2023-09-23T09:18:41.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.897+0000 7f2953fff700 10 client.26638 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:18:41.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.897+0000 7f2953fff700 1 -- 172.21.15.82:0/4010553219 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x562a955ccba0 con 0x562a956ee710 2023-09-23T09:18:41.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.897+0000 7f2953fff700 10 client.26638 handle_command_reply: tid=0 2023-09-23T09:18:41.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.897+0000 7f298e7e5b80 1 client.26638 shutdown 2023-09-23T09:18:41.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.898+0000 7f298e7e5b80 1 -- 172.21.15.82:0/4010553219 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562a956d4c40 msgr2=0x562a956e0c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:18:41.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.898+0000 7f298e7e5b80 1 --2- 172.21.15.82:0/4010553219 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562a956d4c40 0x562a956e0c80 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f296000f410 tx=0x7f2960009bd0 comp rx=0 tx=0).stop 2023-09-23T09:18:41.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.898+0000 7f298e7e5b80 1 -- 172.21.15.82:0/4010553219 shutdown_connections 2023-09-23T09:18:41.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.898+0000 7f298e7e5b80 1 --2- 172.21.15.82:0/4010553219 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x562a956ee710 0x562a956f0b30 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:18:41.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.898+0000 7f298e7e5b80 1 --2- 172.21.15.82:0/4010553219 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a956daca0 0x562a956de5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:18:41.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.898+0000 7f298e7e5b80 1 --2- 172.21.15.82:0/4010553219 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562a956d4c40 0x562a956e0c80 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:18:41.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.898+0000 7f2953fff700 0 client.26638 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:18:41.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.898+0000 7f298e7e5b80 1 --2- 172.21.15.82:0/4010553219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a956da380 0x562a956ddf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:18:41.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.898+0000 7f298e7e5b80 1 -- 172.21.15.82:0/4010553219 >> 172.21.15.82:0/4010553219 conn(0x562a956490e0 msgr2=0x562a956c9b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:18:41.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.898+0000 7f298e7e5b80 1 -- 172.21.15.82:0/4010553219 shutdown_connections 2023-09-23T09:18:41.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.898+0000 7f298e7e5b80 1 -- 172.21.15.82:0/4010553219 wait complete. 2023-09-23T09:18:41.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.898+0000 7f298e7e5b80 20 client.26638 trim_cache size 0 max 16384 2023-09-23T09:18:41.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.916+0000 7f298e7e5b80 1 Processor -- start 2023-09-23T09:18:41.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.916+0000 7f298e7e5b80 1 -- start start 2023-09-23T09:18:41.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.916+0000 7f298e7e5b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562a956d4c40 0x562a956e07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:18:41.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.916+0000 7f298e7e5b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a956da380 0x562a956d8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:18:41.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.916+0000 7f298e7e5b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a956daca0 0x562a956d9520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:18:41.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.916+0000 7f298e7e5b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a954a8920 con 0x562a956da380 2023-09-23T09:18:41.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.916+0000 7f298e7e5b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a956cba20 con 0x562a956daca0 2023-09-23T09:18:41.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.916+0000 7f298e7e5b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a956cf810 con 0x562a956d4c40 2023-09-23T09:18:41.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.917+0000 7f2978b9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a956da380 0x562a956d8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:18:41.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.917+0000 7f2973fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562a956d4c40 0x562a956e07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:18:41.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.917+0000 7f2973fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562a956d4c40 0x562a956e07b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:49646/0 (socket says 172.21.15.82:49646) 2023-09-23T09:18:41.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.917+0000 7f2978b9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a956da380 0x562a956d8fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48256/0 (socket says 172.21.15.82:48256) 2023-09-23T09:18:41.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.917+0000 7f2973fff700 1 -- 172.21.15.82:0/4113672489 learned_addr learned my addr 172.21.15.82:0/4113672489 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:18:41.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.917+0000 7f2973fff700 1 --2- 172.21.15.82:0/4113672489 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a956daca0 0x562a956d9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:18:41.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.917+0000 7f2978b9b700 1 -- 172.21.15.82:0/4113672489 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562a956d4c40 msgr2=0x562a956e07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:18:41.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.917+0000 7f2978b9b700 1 --2- 172.21.15.82:0/4113672489 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562a956d4c40 0x562a956e07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:18:41.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.917+0000 7f2978b9b700 1 -- 172.21.15.82:0/4113672489 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a956daca0 msgr2=0x562a956d9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:18:41.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.917+0000 7f2978b9b700 1 --2- 172.21.15.82:0/4113672489 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a956daca0 0x562a956d9520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:18:41.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.917+0000 7f2978b9b700 1 -- 172.21.15.82:0/4113672489 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562a95452de0 con 0x562a956da380 2023-09-23T09:18:41.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.917+0000 7f2973fff700 1 --2- 172.21.15.82:0/4113672489 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a956daca0 0x562a956d9520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:18:41.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.917+0000 7f2978b9b700 1 --2- 172.21.15.82:0/4113672489 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a956da380 0x562a956d8fe0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f2968005c40 tx=0x7f296801a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfba0221dadf79ce server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:18:41.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.918+0000 7f295f7fe700 1 -- 172.21.15.82:0/4113672489 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f296801d030 con 0x562a956da380 2023-09-23T09:18:41.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.918+0000 7f295f7fe700 1 -- 172.21.15.82:0/4113672489 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2968030050 con 0x562a956da380 2023-09-23T09:18:41.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.918+0000 7f295f7fe700 1 -- 172.21.15.82:0/4113672489 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2968004b00 con 0x562a956da380 2023-09-23T09:18:41.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.918+0000 7f298e7e5b80 1 -- 172.21.15.82:0/4113672489 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a956da380 msgr2=0x562a956d8fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:18:41.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.918+0000 7f298e7e5b80 1 --2- 172.21.15.82:0/4113672489 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a956da380 0x562a956d8fe0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f2968005c40 tx=0x7f296801a040 comp rx=0 tx=0).stop 2023-09-23T09:18:41.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.918+0000 7f298e7e5b80 1 -- 172.21.15.82:0/4113672489 shutdown_connections 2023-09-23T09:18:41.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.918+0000 7f298e7e5b80 1 --2- 172.21.15.82:0/4113672489 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a956daca0 0x562a956d9520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:18:41.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.918+0000 7f298e7e5b80 1 --2- 172.21.15.82:0/4113672489 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562a956d4c40 0x562a956e07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:18:41.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.918+0000 7f298e7e5b80 1 --2- 172.21.15.82:0/4113672489 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a956da380 0x562a956d8fe0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:18:41.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.918+0000 7f298e7e5b80 1 -- 172.21.15.82:0/4113672489 >> 172.21.15.82:0/4113672489 conn(0x562a956490e0 msgr2=0x562a956d8090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:18:41.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.919+0000 7f298e7e5b80 1 -- 172.21.15.82:0/4113672489 shutdown_connections 2023-09-23T09:18:41.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.919+0000 7f298e7e5b80 1 -- 172.21.15.82:0/4113672489 wait complete. 2023-09-23T09:18:41.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.919+0000 7f298e7e5b80 1 -- start start 2023-09-23T09:18:41.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.919+0000 7f298e7e5b80 1 Processor -- start 2023-09-23T09:18:41.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.920+0000 7f298e7e5b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a956d4c40 0x562a956dd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:18:41.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.920+0000 7f298e7e5b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562a956da380 0x562a956ddb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:18:41.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.920+0000 7f298e7e5b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a956daca0 0x562a956dc480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:18:41.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.920+0000 7f298e7e5b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a956de170 con 0x562a956daca0 2023-09-23T09:18:41.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.920+0000 7f298e7e5b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a956de2e0 con 0x562a956d4c40 2023-09-23T09:18:41.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.920+0000 7f298e7e5b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a956dca40 con 0x562a956da380 2023-09-23T09:18:41.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.920+0000 7f298e7e5b80 10 client.0 _ll_register_callbacks cb 0x562a9550ea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:18:41.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.920+0000 7f2978b9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562a956da380 0x562a956ddb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:18:41.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.920+0000 7f2973fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a956d4c40 0x562a956dd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:18:41.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.920+0000 7f2978b9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562a956da380 0x562a956ddb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:49648/0 (socket says 172.21.15.82:49648) 2023-09-23T09:18:41.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.920+0000 7f2978b9b700 1 -- 172.21.15.82:0/309303649 learned_addr learned my addr 172.21.15.82:0/309303649 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:18:41.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.920+0000 7f2973fff700 1 --2- 172.21.15.82:0/309303649 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a956daca0 0x562a956dc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:18:41.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.921+0000 7f2978b9b700 1 -- 172.21.15.82:0/309303649 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a956d4c40 msgr2=0x562a956dd5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:18:41.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.921+0000 7f2978b9b700 1 --2- 172.21.15.82:0/309303649 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a956d4c40 0x562a956dd5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:18:41.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.921+0000 7f2978b9b700 1 -- 172.21.15.82:0/309303649 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a956daca0 msgr2=0x562a956dc480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:18:41.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.921+0000 7f2978b9b700 1 --2- 172.21.15.82:0/309303649 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a956daca0 0x562a956dc480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:18:41.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.921+0000 7f2978b9b700 1 -- 172.21.15.82:0/309303649 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562a954a6630 con 0x562a956da380 2023-09-23T09:18:41.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.921+0000 7f2978b9b700 1 --2- 172.21.15.82:0/309303649 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562a956da380 0x562a956ddb20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f29680093f0 tx=0x7f29680059c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=710d900c1ea383ad server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:18:41.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.921+0000 7f2953fff700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T09:18:41.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.922+0000 7f2953fff700 1 -- 172.21.15.82:0/309303649 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f296801d040 con 0x562a956da380 2023-09-23T09:18:41.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.922+0000 7f298e7e5b80 1 -- 172.21.15.82:0/309303649 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562a956c78b0 con 0x562a956da380 2023-09-23T09:18:41.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.922+0000 7f2953fff700 1 -- 172.21.15.82:0/309303649 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(119..119 src has 1..119) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f2968030a60 con 0x562a956da380 2023-09-23T09:18:41.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.922+0000 7f2953fff700 1 -- 172.21.15.82:0/309303649 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=76) v2 ==== 24+0+0 (secure 0 0 0) 0x7f29680048d0 con 0x562a956da380 2023-09-23T09:18:41.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.922+0000 7f298e7e5b80 10 client.26644 fetch_fsmap learned FSMap version 76 2023-09-23T09:18:41.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.922+0000 7f298e7e5b80 1 -- 172.21.15.82:0/309303649 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=76,monmap=4+}) v3 -- 0x562a9543bc60 con 0x562a956da380 2023-09-23T09:18:41.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.922+0000 7f2953fff700 1 -- 172.21.15.82:0/309303649 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2968047020 con 0x562a956da380 2023-09-23T09:18:41.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.922+0000 7f2953fff700 1 -- 172.21.15.82:0/309303649 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 76) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f2968005160 con 0x562a956da380 2023-09-23T09:18:41.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.922+0000 7f298e7e5b80 10 client.26644 fetch_fsmap finished waiting for FSMap version 76 2023-09-23T09:18:41.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.922+0000 7f298e7e5b80 10 client.26644 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:18:41.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.922+0000 7f298e7e5b80 20 client.26644 populate_metadata read hostname 'smithi082' 2023-09-23T09:18:41.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.922+0000 7f298e7e5b80 1 --2- 172.21.15.82:0/309303649 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x562a95742d10 0x562a95745100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:18:41.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.922+0000 7f298e7e5b80 4 client.26644 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:18:41.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.922+0000 7f298e7e5b80 1 -- 172.21.15.82:0/309303649 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x562a9561f970 con 0x562a95742d10 2023-09-23T09:18:41.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.923+0000 7f2973fff700 1 --2- 172.21.15.82:0/309303649 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x562a95742d10 0x562a95745100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:18:41.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.923+0000 7f2973fff700 1 --2- 172.21.15.82:0/309303649 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x562a95742d10 0x562a95745100 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3cbd4e486dc87c0f server_cookie=100ac045a37f76b2 in_seq=0 out_seq=0 2023-09-23T09:18:41.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.923+0000 7f2953fff700 10 client.26644 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:18:41.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.924+0000 7f2953fff700 1 -- 172.21.15.82:0/309303649 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x562a9561f970 con 0x562a95742d10 2023-09-23T09:18:41.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.924+0000 7f2953fff700 10 client.26644 handle_command_reply: tid=0 2023-09-23T09:18:41.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.924+0000 7f298e7e5b80 1 client.26644 shutdown 2023-09-23T09:18:41.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.924+0000 7f298e7e5b80 1 -- 172.21.15.82:0/309303649 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562a956da380 msgr2=0x562a956ddb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:18:41.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.924+0000 7f298e7e5b80 1 --2- 172.21.15.82:0/309303649 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562a956da380 0x562a956ddb20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f29680093f0 tx=0x7f29680059c0 comp rx=0 tx=0).stop 2023-09-23T09:18:41.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.924+0000 7f298e7e5b80 1 -- 172.21.15.82:0/309303649 shutdown_connections 2023-09-23T09:18:41.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.924+0000 7f298e7e5b80 1 --2- 172.21.15.82:0/309303649 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x562a95742d10 0x562a95745100 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:18:41.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.924+0000 7f298e7e5b80 1 --2- 172.21.15.82:0/309303649 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a956daca0 0x562a956dc480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:18:41.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.924+0000 7f298e7e5b80 1 --2- 172.21.15.82:0/309303649 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a956d4c40 0x562a956dd5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:18:41.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.924+0000 7f298e7e5b80 1 --2- 172.21.15.82:0/309303649 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562a956da380 0x562a956ddb20 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:18:41.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.924+0000 7f2953fff700 0 client.26644 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:18:41.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.924+0000 7f298e7e5b80 1 -- 172.21.15.82:0/309303649 >> 172.21.15.82:0/309303649 conn(0x562a956490e0 msgr2=0x562a956d8fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:18:41.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.924+0000 7f298e7e5b80 1 -- 172.21.15.82:0/309303649 shutdown_connections 2023-09-23T09:18:41.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.924+0000 7f298e7e5b80 1 -- 172.21.15.82:0/309303649 wait complete. 2023-09-23T09:18:41.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.924+0000 7f298e7e5b80 20 client.26644 trim_cache size 0 max 16384 2023-09-23T09:18:41.933 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:18:41.933 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-23T09:18:41.933 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:18:41.933 INFO:teuthology.orchestra.run.smithi082.stdout: "047cbc72-e254-4787-b038-382de9c1a9a4": { 2023-09-23T09:18:41.933 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:18:41.933 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "047cbc72-e254-4787-b038-382de9c1a9a4", 2023-09-23T09:18:41.933 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:18:41.933 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:18:41.933 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:18:41.933 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:18:41.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.925+0000 7f297adff700 1 -- 172.21.15.82:0/3169382794 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f29640a00c0 msgr2=0x7f29640a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:18:41.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.925+0000 7f297adff700 1 --2- 172.21.15.82:0/3169382794 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f29640a00c0 0x7f29640a2580 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f296c0c88c0 tx=0x7f296c004c50 comp rx=0 tx=0).stop 2023-09-23T09:18:41.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.925+0000 7f297adff700 1 -- 172.21.15.82:0/3169382794 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f29741068b0 msgr2=0x7f2974198980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:18:41.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.925+0000 7f297adff700 1 --2- 172.21.15.82:0/3169382794 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f29741068b0 0x7f2974198980 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f296c00efc0 tx=0x7f296c00c3a0 comp rx=0 tx=0).stop 2023-09-23T09:18:41.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.925+0000 7f297adff700 1 -- 172.21.15.82:0/3169382794 shutdown_connections 2023-09-23T09:18:41.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.925+0000 7f297adff700 1 --2- 172.21.15.82:0/3169382794 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f29640a00c0 0x7f29640a2580 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:18:41.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.925+0000 7f297adff700 1 --2- 172.21.15.82:0/3169382794 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f29741068b0 0x7f2974198980 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:18:41.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.925+0000 7f297adff700 1 --2- 172.21.15.82:0/3169382794 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29741008a0 0x7f297419e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:18:41.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.925+0000 7f297adff700 1 --2- 172.21.15.82:0/3169382794 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2974101260 0x7f297419eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:18:41.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.925+0000 7f297adff700 1 -- 172.21.15.82:0/3169382794 >> 172.21.15.82:0/3169382794 conn(0x7f29740fc390 msgr2=0x7f297410bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:18:41.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.925+0000 7f297adff700 1 -- 172.21.15.82:0/3169382794 shutdown_connections 2023-09-23T09:18:41.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:18:41.925+0000 7f297adff700 1 -- 172.21.15.82:0/3169382794 wait complete. 2023-09-23T09:18:41.946 INFO:tasks.cephfs.filesystem:scrub status for tag:047cbc72-e254-4787-b038-382de9c1a9a4 - {'path': '/', 'tag': '047cbc72-e254-4787-b038-382de9c1a9a4', 'options': 'recursive,force'} 2023-09-23T09:18:42.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:18:41 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:18:42.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:18:41 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:18:42.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:18:41 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:18:42.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:18:41 smithi135 ceph-mon[99205]: pgmap v687: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 361 op/s 2023-09-23T09:18:42.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:18:41 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:18:42.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:18:41 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:18:42.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:18:41 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:18:42.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:18:41 smithi082 ceph-mon[97694]: pgmap v687: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 361 op/s 2023-09-23T09:18:42.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:18:41 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:18:42.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:18:41 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:18:42.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:18:41 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:18:42.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:18:41 smithi161 ceph-mon[99580]: pgmap v687: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 361 op/s 2023-09-23T09:18:44.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:18:44 smithi135 ceph-mon[99205]: pgmap v688: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 361 op/s 2023-09-23T09:18:44.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:18:44 smithi082 ceph-mon[97694]: pgmap v688: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 361 op/s 2023-09-23T09:18:44.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:18:44 smithi161 ceph-mon[99580]: pgmap v688: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 361 op/s 2023-09-23T09:18:46.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:18:46 smithi135 ceph-mon[99205]: pgmap v689: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.9 MiB/s wr, 541 op/s 2023-09-23T09:18:46.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:18:46 smithi082 ceph-mon[97694]: pgmap v689: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.9 MiB/s wr, 541 op/s 2023-09-23T09:18:46.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:18:46 smithi161 ceph-mon[99580]: pgmap v689: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.9 MiB/s wr, 541 op/s 2023-09-23T09:18:49.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:18:48 smithi135 ceph-mon[99205]: pgmap v690: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 349 op/s 2023-09-23T09:18:49.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:18:48 smithi082 ceph-mon[97694]: pgmap v690: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 349 op/s 2023-09-23T09:18:49.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:18:48 smithi161 ceph-mon[99580]: pgmap v690: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 349 op/s 2023-09-23T09:18:51.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:18:50 smithi135 ceph-mon[99205]: pgmap v691: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.9 MiB/s wr, 543 op/s 2023-09-23T09:18:51.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:18:50 smithi082 ceph-mon[97694]: pgmap v691: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.9 MiB/s wr, 543 op/s 2023-09-23T09:18:51.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:18:50 smithi161 ceph-mon[99580]: pgmap v691: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.9 MiB/s wr, 543 op/s 2023-09-23T09:18:53.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:18:52 smithi135 ceph-mon[99205]: pgmap v692: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 374 op/s 2023-09-23T09:18:53.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:18:52 smithi082 ceph-mon[97694]: pgmap v692: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 374 op/s 2023-09-23T09:18:53.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:18:52 smithi161 ceph-mon[99580]: pgmap v692: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 374 op/s 2023-09-23T09:18:55.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:18:54 smithi135 ceph-mon[99205]: pgmap v693: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 374 op/s 2023-09-23T09:18:55.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:18:54 smithi082 ceph-mon[97694]: pgmap v693: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 374 op/s 2023-09-23T09:18:55.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:18:54 smithi161 ceph-mon[99580]: pgmap v693: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 374 op/s 2023-09-23T09:18:57.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:18:56 smithi135 ceph-mon[99205]: pgmap v694: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.0 MiB/s wr, 560 op/s 2023-09-23T09:18:57.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:18:56 smithi082 ceph-mon[97694]: pgmap v694: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.0 MiB/s wr, 560 op/s 2023-09-23T09:18:57.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:18:56 smithi161 ceph-mon[99580]: pgmap v694: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.0 MiB/s wr, 560 op/s 2023-09-23T09:18:58.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:18:57 smithi135 ceph-mon[99205]: pgmap v695: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 379 op/s 2023-09-23T09:18:58.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:18:57 smithi082 ceph-mon[97694]: pgmap v695: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 379 op/s 2023-09-23T09:18:58.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:18:57 smithi161 ceph-mon[99580]: pgmap v695: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 379 op/s 2023-09-23T09:19:00.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:19:00 smithi135 ceph-mon[99205]: pgmap v696: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.0 MiB/s wr, 552 op/s 2023-09-23T09:19:00.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:19:00 smithi082 ceph-mon[97694]: pgmap v696: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.0 MiB/s wr, 552 op/s 2023-09-23T09:19:00.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:19:00 smithi161 ceph-mon[99580]: pgmap v696: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.0 MiB/s wr, 552 op/s 2023-09-23T09:19:03.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:19:02 smithi135 ceph-mon[99205]: pgmap v697: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 358 op/s 2023-09-23T09:19:03.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:19:02 smithi082 ceph-mon[97694]: pgmap v697: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 358 op/s 2023-09-23T09:19:03.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:19:02 smithi161 ceph-mon[99580]: pgmap v697: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 358 op/s 2023-09-23T09:19:05.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:19:04 smithi135 ceph-mon[99205]: pgmap v698: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 358 op/s 2023-09-23T09:19:05.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:19:04 smithi082 ceph-mon[97694]: pgmap v698: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 358 op/s 2023-09-23T09:19:05.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:19:04 smithi161 ceph-mon[99580]: pgmap v698: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 358 op/s 2023-09-23T09:19:06.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:19:05 smithi082 ceph-mon[97694]: pgmap v699: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.9 MiB/s wr, 549 op/s 2023-09-23T09:19:06.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:19:05 smithi161 ceph-mon[99580]: pgmap v699: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.9 MiB/s wr, 549 op/s 2023-09-23T09:19:06.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:19:05 smithi135 ceph-mon[99205]: pgmap v699: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.9 MiB/s wr, 549 op/s 2023-09-23T09:19:08.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:19:07 smithi135 ceph-mon[99205]: osdmap e120: 12 total, 12 up, 12 in 2023-09-23T09:19:08.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:19:07 smithi135 ceph-mon[99205]: pgmap v701: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.1 MiB/s wr, 436 op/s 2023-09-23T09:19:08.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:19:07 smithi082 ceph-mon[97694]: osdmap e120: 12 total, 12 up, 12 in 2023-09-23T09:19:08.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:19:07 smithi082 ceph-mon[97694]: pgmap v701: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.1 MiB/s wr, 436 op/s 2023-09-23T09:19:08.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:19:07 smithi161 ceph-mon[99580]: osdmap e120: 12 total, 12 up, 12 in 2023-09-23T09:19:08.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:19:07 smithi161 ceph-mon[99580]: pgmap v701: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.1 MiB/s wr, 436 op/s 2023-09-23T09:19:10.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:19:10 smithi135 ceph-mon[99205]: pgmap v702: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.2 MiB/s wr, 454 op/s 2023-09-23T09:19:10.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:19:10 smithi082 ceph-mon[97694]: pgmap v702: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.2 MiB/s wr, 454 op/s 2023-09-23T09:19:10.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:19:10 smithi161 ceph-mon[99580]: pgmap v702: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.2 MiB/s wr, 454 op/s 2023-09-23T09:19:11.947 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:19:12.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.170+0000 7fafc71ff700 1 -- 172.21.15.82:0/4250993002 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fafc0106880 msgr2=0x7fafc0106c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:19:12.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.170+0000 7fafc71ff700 1 --2- 172.21.15.82:0/4250993002 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fafc0106880 0x7fafc0106c60 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fafbc009990 tx=0x7fafbc009ca0 comp rx=0 tx=0).stop 2023-09-23T09:19:12.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.170+0000 7fafc71ff700 1 -- 172.21.15.82:0/4250993002 shutdown_connections 2023-09-23T09:19:12.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.170+0000 7fafc71ff700 1 --2- 172.21.15.82:0/4250993002 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fafc0101230 0x7fafc010d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:19:12.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.170+0000 7fafc71ff700 1 --2- 172.21.15.82:0/4250993002 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fafc0106880 0x7fafc0106c60 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:19:12.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.170+0000 7fafc71ff700 1 --2- 172.21.15.82:0/4250993002 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fafc0100870 0x7fafc0100cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:19:12.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.170+0000 7fafc71ff700 1 -- 172.21.15.82:0/4250993002 >> 172.21.15.82:0/4250993002 conn(0x7fafc00fc3a0 msgr2=0x7fafc00fe7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:19:12.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.170+0000 7fafc71ff700 1 -- 172.21.15.82:0/4250993002 shutdown_connections 2023-09-23T09:19:12.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.170+0000 7fafc71ff700 1 -- 172.21.15.82:0/4250993002 wait complete. 2023-09-23T09:19:12.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.171+0000 7fafc71ff700 1 Processor -- start 2023-09-23T09:19:12.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.171+0000 7fafc71ff700 1 -- start start 2023-09-23T09:19:12.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.172+0000 7fafc71ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fafc0100870 0x7fafc0194690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:19:12.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.172+0000 7fafc71ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fafc0101230 0x7fafc0194bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:19:12.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.172+0000 7fafc71ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fafc0106880 0x7fafc0197f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:19:12.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.172+0000 7fafc71ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafc0198580 con 0x7fafc0101230 2023-09-23T09:19:12.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.172+0000 7fafc71ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafc01986f0 con 0x7fafc0106880 2023-09-23T09:19:12.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.172+0000 7fafc71ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafc01988b0 con 0x7fafc0100870 2023-09-23T09:19:12.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.172+0000 7fafb7fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fafc0101230 0x7fafc0194bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:19:12.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.172+0000 7fafc579c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fafc0106880 0x7fafc0197f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:19:12.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.172+0000 7fafb7fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fafc0101230 0x7fafc0194bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40814/0 (socket says 172.21.15.82:40814) 2023-09-23T09:19:12.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.172+0000 7fafc4f9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fafc0100870 0x7fafc0194690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:19:12.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.172+0000 7fafb7fff700 1 -- 172.21.15.82:0/1842063504 learned_addr learned my addr 172.21.15.82:0/1842063504 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:19:12.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.172+0000 7fafc579c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fafc0106880 0x7fafc0197f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:49158/0 (socket says 172.21.15.82:49158) 2023-09-23T09:19:12.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.172+0000 7fafb7fff700 1 -- 172.21.15.82:0/1842063504 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fafc0100870 msgr2=0x7fafc0194690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:19:12.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.172+0000 7fafb7fff700 1 --2- 172.21.15.82:0/1842063504 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fafc0100870 0x7fafc0194690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:19:12.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.172+0000 7fafb7fff700 1 -- 172.21.15.82:0/1842063504 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fafc0106880 msgr2=0x7fafc0197f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:19:12.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.172+0000 7fafb7fff700 1 --2- 172.21.15.82:0/1842063504 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fafc0106880 0x7fafc0197f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:19:12.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.172+0000 7fafb7fff700 1 -- 172.21.15.82:0/1842063504 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafbc0095f0 con 0x7fafc0101230 2023-09-23T09:19:12.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.173+0000 7fafb7fff700 1 --2- 172.21.15.82:0/1842063504 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fafc0101230 0x7fafc0194bd0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fafb0012fc0 tx=0x7fafb00100c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:19:12.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.173+0000 7fafb5ffb700 1 -- 172.21.15.82:0/1842063504 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb000dba0 con 0x7fafc0101230 2023-09-23T09:19:12.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.173+0000 7fafb5ffb700 1 -- 172.21.15.82:0/1842063504 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fafb0013040 con 0x7fafc0101230 2023-09-23T09:19:12.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.173+0000 7fafc71ff700 1 -- 172.21.15.82:0/1842063504 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafc0198b30 con 0x7fafc0101230 2023-09-23T09:19:12.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.173+0000 7fafb5ffb700 1 -- 172.21.15.82:0/1842063504 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb000bc10 con 0x7fafc0101230 2023-09-23T09:19:12.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.173+0000 7fafc71ff700 1 -- 172.21.15.82:0/1842063504 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafc01a14f0 con 0x7fafc0101230 2023-09-23T09:19:12.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.177+0000 7fafb5ffb700 1 -- 172.21.15.82:0/1842063504 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7fafb0010740 con 0x7fafc0101230 2023-09-23T09:19:12.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.178+0000 7fafdaa34b80 1 Processor -- start 2023-09-23T09:19:12.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.178+0000 7fafdaa34b80 1 -- start start 2023-09-23T09:19:12.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.179+0000 7fafb5ffb700 1 --2- 172.21.15.82:0/1842063504 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fafa80a0140 0x7fafa80a2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:19:12.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.179+0000 7fafb5ffb700 1 -- 172.21.15.82:0/1842063504 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fafb00cf5e0 con 0x7fafc0101230 2023-09-23T09:19:12.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.179+0000 7fafdaa34b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558aa140d380 0x558aa140d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:19:12.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.179+0000 7fafdaa34b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558aa140dca0 0x558aa1407700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:19:12.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.179+0000 7fafdaa34b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558aa1407c40 0x558aa14080a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:19:12.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.179+0000 7fafdaa34b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x558aa136f7b0 con 0x558aa140dca0 2023-09-23T09:19:12.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.179+0000 7fafdaa34b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x558aa1360780 con 0x558aa1407c40 2023-09-23T09:19:12.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.179+0000 7fafdaa34b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x558aa135e0a0 con 0x558aa140d380 2023-09-23T09:19:12.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.179+0000 7fafc579c700 1 --2- 172.21.15.82:0/1842063504 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fafa80a0140 0x7fafa80a2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:19:12.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.179+0000 7fafc579c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558aa1407c40 0x558aa14080a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:19:12.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.179+0000 7fafc4f9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558aa140d380 0x558aa140d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:19:12.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.179+0000 7fafc579c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558aa1407c40 0x558aa14080a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:49164/0 (socket says 172.21.15.82:49164) 2023-09-23T09:19:12.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.179+0000 7fafc579c700 1 -- 172.21.15.82:0/761330122 learned_addr learned my addr 172.21.15.82:0/761330122 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:19:12.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.179+0000 7fafb7fff700 1 --2- 172.21.15.82:0/761330122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558aa140dca0 0x558aa1407700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:19:12.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.180+0000 7fafc579c700 1 -- 172.21.15.82:0/761330122 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558aa140d380 msgr2=0x558aa140d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:19:12.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.180+0000 7fafc579c700 1 --2- 172.21.15.82:0/761330122 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558aa140d380 0x558aa140d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:19:12.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.180+0000 7fafc579c700 1 -- 172.21.15.82:0/761330122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558aa140dca0 msgr2=0x558aa1407700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:19:12.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.180+0000 7fafc579c700 1 --2- 172.21.15.82:0/761330122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558aa140dca0 0x558aa1407700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:19:12.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.180+0000 7fafc579c700 1 -- 172.21.15.82:0/761330122 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558aa11d9630 con 0x558aa1407c40 2023-09-23T09:19:12.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.180+0000 7fafc579c700 1 --2- 172.21.15.82:0/1842063504 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fafa80a0140 0x7fafa80a2600 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fafb8013e30 tx=0x7fafb80134b0 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:19:12.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.180+0000 7fafc579c700 1 --2- 172.21.15.82:0/761330122 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558aa1407c40 0x558aa14080a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fafb801aa50 tx=0x7fafb801d000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=965eea250943037b server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:19:12.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.180+0000 7fafa6ffd700 1 -- 172.21.15.82:0/761330122 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb800e040 con 0x558aa1407c40 2023-09-23T09:19:12.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.180+0000 7fafa6ffd700 1 -- 172.21.15.82:0/761330122 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fafb800f040 con 0x558aa1407c40 2023-09-23T09:19:12.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.180+0000 7fafa6ffd700 1 -- 172.21.15.82:0/761330122 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb8003c60 con 0x558aa1407c40 2023-09-23T09:19:12.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.181+0000 7fafdaa34b80 1 -- 172.21.15.82:0/761330122 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558aa1407c40 msgr2=0x558aa14080a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:19:12.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.181+0000 7fafdaa34b80 1 --2- 172.21.15.82:0/761330122 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558aa1407c40 0x558aa14080a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fafb801aa50 tx=0x7fafb801d000 comp rx=0 tx=0).stop 2023-09-23T09:19:12.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.181+0000 7fafdaa34b80 1 -- 172.21.15.82:0/761330122 shutdown_connections 2023-09-23T09:19:12.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.181+0000 7fafdaa34b80 1 --2- 172.21.15.82:0/761330122 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558aa1407c40 0x558aa14080a0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:19:12.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.181+0000 7fafdaa34b80 1 --2- 172.21.15.82:0/761330122 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558aa140d380 0x558aa140d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:19:12.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.181+0000 7fafdaa34b80 1 --2- 172.21.15.82:0/761330122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558aa140dca0 0x558aa1407700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:19:12.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.181+0000 7fafdaa34b80 1 -- 172.21.15.82:0/761330122 >> 172.21.15.82:0/761330122 conn(0x558aa137c0e0 msgr2=0x558aa1402410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:19:12.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.182+0000 7fafdaa34b80 1 -- 172.21.15.82:0/761330122 shutdown_connections 2023-09-23T09:19:12.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.182+0000 7fafdaa34b80 1 -- 172.21.15.82:0/761330122 wait complete. 2023-09-23T09:19:12.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.182+0000 7fafdaa34b80 1 -- start start 2023-09-23T09:19:12.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.182+0000 7fafdaa34b80 1 Processor -- start 2023-09-23T09:19:12.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.183+0000 7fafdaa34b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558aa1407c40 0x558aa1413c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:19:12.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.183+0000 7fafdaa34b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558aa140d380 0x558aa1410ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:19:12.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.183+0000 7fafdaa34b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558aa140dca0 0x558aa1411610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:19:12.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.183+0000 7fafdaa34b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x558aa1359990 con 0x558aa140d380 2023-09-23T09:19:12.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.183+0000 7fafdaa34b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x558aa12f7bb0 con 0x558aa140dca0 2023-09-23T09:19:12.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.183+0000 7fafdaa34b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x558aa12f78b0 con 0x558aa1407c40 2023-09-23T09:19:12.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.183+0000 7fafdaa34b80 10 client.0 _ll_register_callbacks cb 0x558aa1241a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:19:12.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.183+0000 7fafc4f9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558aa1407c40 0x558aa1413c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:19:12.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.183+0000 7fafc4f9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558aa1407c40 0x558aa1413c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:36478/0 (socket says 172.21.15.82:36478) 2023-09-23T09:19:12.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.183+0000 7fafc4f9b700 1 -- 172.21.15.82:0/4002432755 learned_addr learned my addr 172.21.15.82:0/4002432755 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:19:12.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.183+0000 7fafb7fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558aa140d380 0x558aa1410ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:19:12.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.183+0000 7fafc579c700 1 --2- 172.21.15.82:0/4002432755 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558aa140dca0 0x558aa1411610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:19:12.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.184+0000 7fafc4f9b700 1 -- 172.21.15.82:0/4002432755 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558aa140dca0 msgr2=0x558aa1411610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:19:12.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.184+0000 7fafc4f9b700 1 --2- 172.21.15.82:0/4002432755 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558aa140dca0 0x558aa1411610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:19:12.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.184+0000 7fafc4f9b700 1 -- 172.21.15.82:0/4002432755 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558aa140d380 msgr2=0x558aa1410ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:19:12.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.184+0000 7fafc4f9b700 1 --2- 172.21.15.82:0/4002432755 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558aa140d380 0x558aa1410ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:19:12.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.184+0000 7fafc4f9b700 1 -- 172.21.15.82:0/4002432755 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafb801abe0 con 0x558aa1407c40 2023-09-23T09:19:12.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.184+0000 7fafc579c700 1 --2- 172.21.15.82:0/4002432755 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558aa140dca0 0x558aa1411610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:19:12.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.184+0000 7fafc4f9b700 1 --2- 172.21.15.82:0/4002432755 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558aa1407c40 0x558aa1413c50 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fafbc009990 tx=0x7fafbc005800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ece5f6be27c0520e server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:19:12.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.184+0000 7faf9ffff700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T09:19:12.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.184+0000 7faf9ffff700 1 -- 172.21.15.82:0/4002432755 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafbc01d070 con 0x558aa1407c40 2023-09-23T09:19:12.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.184+0000 7fafdaa34b80 1 -- 172.21.15.82:0/4002432755 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558aa13d71c0 con 0x558aa1407c40 2023-09-23T09:19:12.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.184+0000 7faf9ffff700 1 -- 172.21.15.82:0/4002432755 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(121..121 src has 1..121) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fafbc004500 con 0x558aa1407c40 2023-09-23T09:19:12.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.185+0000 7faf9ffff700 1 -- 172.21.15.82:0/4002432755 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=76) v2 ==== 24+0+0 (secure 0 0 0) 0x7fafbc0046c0 con 0x558aa1407c40 2023-09-23T09:19:12.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.185+0000 7fafdaa34b80 10 client.26656 fetch_fsmap learned FSMap version 76 2023-09-23T09:19:12.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.185+0000 7fafdaa34b80 1 -- 172.21.15.82:0/4002432755 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=76,monmap=4+}) v3 -- 0x558aa1185de0 con 0x558aa1407c40 2023-09-23T09:19:12.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.185+0000 7faf9ffff700 1 -- 172.21.15.82:0/4002432755 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x558aa13d71c0 con 0x558aa1407c40 2023-09-23T09:19:12.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.185+0000 7faf9ffff700 1 -- 172.21.15.82:0/4002432755 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 76) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fafbc00f810 con 0x558aa1407c40 2023-09-23T09:19:12.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.185+0000 7fafdaa34b80 10 client.26656 fetch_fsmap finished waiting for FSMap version 76 2023-09-23T09:19:12.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.185+0000 7fafdaa34b80 10 client.26656 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:19:12.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.185+0000 7fafdaa34b80 20 client.26656 populate_metadata read hostname 'smithi082' 2023-09-23T09:19:12.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.185+0000 7fafdaa34b80 1 --2- 172.21.15.82:0/4002432755 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x558aa14216b0 0x558aa1423ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:19:12.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.185+0000 7fafdaa34b80 4 client.26656 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:19:12.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.185+0000 7fafdaa34b80 1 -- 172.21.15.82:0/4002432755 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558aa12ffba0 con 0x558aa14216b0 2023-09-23T09:19:12.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.186+0000 7fafb7fff700 1 --2- 172.21.15.82:0/4002432755 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x558aa14216b0 0x558aa1423ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:19:12.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.186+0000 7faf9ffff700 10 client.26656 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:19:12.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.186+0000 7fafb7fff700 1 --2- 172.21.15.82:0/4002432755 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x558aa14216b0 0x558aa1423ad0 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e7b6fc679e143cc server_cookie=9075188ead6c6469 in_seq=0 out_seq=0 2023-09-23T09:19:12.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.187+0000 7faf9ffff700 1 -- 172.21.15.82:0/4002432755 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558aa12ffba0 con 0x558aa14216b0 2023-09-23T09:19:12.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.187+0000 7faf9ffff700 10 client.26656 handle_command_reply: tid=0 2023-09-23T09:19:12.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.187+0000 7fafdaa34b80 1 client.26656 shutdown 2023-09-23T09:19:12.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.187+0000 7fafdaa34b80 1 -- 172.21.15.82:0/4002432755 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558aa1407c40 msgr2=0x558aa1413c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:19:12.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.187+0000 7fafdaa34b80 1 --2- 172.21.15.82:0/4002432755 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558aa1407c40 0x558aa1413c50 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fafbc009990 tx=0x7fafbc005800 comp rx=0 tx=0).stop 2023-09-23T09:19:12.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.188+0000 7fafdaa34b80 1 -- 172.21.15.82:0/4002432755 shutdown_connections 2023-09-23T09:19:12.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.188+0000 7fafdaa34b80 1 --2- 172.21.15.82:0/4002432755 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558aa140dca0 0x558aa1411610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:19:12.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.188+0000 7fafdaa34b80 1 --2- 172.21.15.82:0/4002432755 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558aa1407c40 0x558aa1413c50 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:19:12.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.188+0000 7fafdaa34b80 1 --2- 172.21.15.82:0/4002432755 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x558aa14216b0 0x558aa1423ad0 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:19:12.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.188+0000 7fafdaa34b80 1 --2- 172.21.15.82:0/4002432755 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558aa140d380 0x558aa1410ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:19:12.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.188+0000 7fafdaa34b80 1 -- 172.21.15.82:0/4002432755 >> 172.21.15.82:0/4002432755 conn(0x558aa137c0e0 msgr2=0x558aa13fcb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:19:12.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.188+0000 7faf9ffff700 0 client.26656 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:19:12.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.188+0000 7fafdaa34b80 1 -- 172.21.15.82:0/4002432755 shutdown_connections 2023-09-23T09:19:12.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.188+0000 7fafdaa34b80 1 -- 172.21.15.82:0/4002432755 wait complete. 2023-09-23T09:19:12.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.188+0000 7fafdaa34b80 20 client.26656 trim_cache size 0 max 16384 2023-09-23T09:19:12.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.206+0000 7fafdaa34b80 1 Processor -- start 2023-09-23T09:19:12.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.206+0000 7fafdaa34b80 1 -- start start 2023-09-23T09:19:12.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.206+0000 7fafdaa34b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558aa1407c40 0x558aa14137f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:19:12.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.206+0000 7fafdaa34b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558aa140d380 0x558aa14106e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:19:12.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.206+0000 7fafdaa34b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558aa140dca0 0x558aa1410c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:19:12.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.206+0000 7fafdaa34b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x558aa11db920 con 0x558aa140d380 2023-09-23T09:19:12.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.206+0000 7fafdaa34b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x558aa14142a0 con 0x558aa1407c40 2023-09-23T09:19:12.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.206+0000 7fafdaa34b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x558aa13fec80 con 0x558aa140dca0 2023-09-23T09:19:12.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.207+0000 7fafc4f9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558aa1407c40 0x558aa14137f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:19:12.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.207+0000 7fafc4f9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558aa1407c40 0x558aa14137f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:49182/0 (socket says 172.21.15.82:49182) 2023-09-23T09:19:12.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.207+0000 7fafc4f9b700 1 -- 172.21.15.82:0/823148089 learned_addr learned my addr 172.21.15.82:0/823148089 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:19:12.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.207+0000 7fafb7fff700 1 --2- 172.21.15.82:0/823148089 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558aa140d380 0x558aa14106e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:19:12.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.207+0000 7fafc579c700 1 --2- 172.21.15.82:0/823148089 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558aa140dca0 0x558aa1410c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:19:12.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.207+0000 7fafc4f9b700 1 -- 172.21.15.82:0/823148089 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558aa140dca0 msgr2=0x558aa1410c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:19:12.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.207+0000 7fafc4f9b700 1 --2- 172.21.15.82:0/823148089 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558aa140dca0 0x558aa1410c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:19:12.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.207+0000 7fafc4f9b700 1 -- 172.21.15.82:0/823148089 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558aa140d380 msgr2=0x558aa14106e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:19:12.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.207+0000 7fafc4f9b700 1 --2- 172.21.15.82:0/823148089 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558aa140d380 0x558aa14106e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:19:12.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.207+0000 7fafc4f9b700 1 -- 172.21.15.82:0/823148089 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558aa116ec60 con 0x558aa1407c40 2023-09-23T09:19:12.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.207+0000 7fafc4f9b700 1 --2- 172.21.15.82:0/823148089 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558aa1407c40 0x558aa14137f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fafbc005930 tx=0x7fafbc009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac8b9d29d1caaa52 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:19:12.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.208+0000 7fafa77fe700 1 -- 172.21.15.82:0/823148089 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafbc01d070 con 0x558aa1407c40 2023-09-23T09:19:12.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.208+0000 7fafa77fe700 1 -- 172.21.15.82:0/823148089 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fafbc01e040 con 0x558aa1407c40 2023-09-23T09:19:12.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.208+0000 7fafa77fe700 1 -- 172.21.15.82:0/823148089 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafbc024cb0 con 0x558aa1407c40 2023-09-23T09:19:12.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.209+0000 7fafdaa34b80 1 -- 172.21.15.82:0/823148089 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558aa1407c40 msgr2=0x558aa14137f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:19:12.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.209+0000 7fafdaa34b80 1 --2- 172.21.15.82:0/823148089 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558aa1407c40 0x558aa14137f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fafbc005930 tx=0x7fafbc009310 comp rx=0 tx=0).stop 2023-09-23T09:19:12.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.209+0000 7fafdaa34b80 1 -- 172.21.15.82:0/823148089 shutdown_connections 2023-09-23T09:19:12.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.209+0000 7fafdaa34b80 1 --2- 172.21.15.82:0/823148089 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558aa140dca0 0x558aa1410c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:19:12.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.209+0000 7fafdaa34b80 1 --2- 172.21.15.82:0/823148089 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558aa1407c40 0x558aa14137f0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:19:12.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.209+0000 7fafdaa34b80 1 --2- 172.21.15.82:0/823148089 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558aa140d380 0x558aa14106e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:19:12.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.209+0000 7fafdaa34b80 1 -- 172.21.15.82:0/823148089 >> 172.21.15.82:0/823148089 conn(0x558aa137c0e0 msgr2=0x558aa140b050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:19:12.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.209+0000 7fafdaa34b80 1 -- 172.21.15.82:0/823148089 shutdown_connections 2023-09-23T09:19:12.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.209+0000 7fafdaa34b80 1 -- 172.21.15.82:0/823148089 wait complete. 2023-09-23T09:19:12.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.209+0000 7fafdaa34b80 1 -- start start 2023-09-23T09:19:12.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.209+0000 7fafdaa34b80 1 Processor -- start 2023-09-23T09:19:12.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.210+0000 7fafdaa34b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558aa1407c40 0x558aa140a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:19:12.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.210+0000 7fafdaa34b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558aa140d380 0x558aa140a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:19:12.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.210+0000 7fafdaa34b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558aa140dca0 0x558aa1408da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:19:12.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.210+0000 7fafdaa34b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x558aa14092e0 con 0x558aa140d380 2023-09-23T09:19:12.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.210+0000 7fafdaa34b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x558aa1409450 con 0x558aa140dca0 2023-09-23T09:19:12.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.210+0000 7fafdaa34b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x558aa1409610 con 0x558aa1407c40 2023-09-23T09:19:12.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.210+0000 7fafdaa34b80 10 client.0 _ll_register_callbacks cb 0x7fafbc005350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:19:12.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.210+0000 7fafb7fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558aa140d380 0x558aa140a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:19:12.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.210+0000 7fafb7fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558aa140d380 0x558aa140a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40858/0 (socket says 172.21.15.82:40858) 2023-09-23T09:19:12.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.210+0000 7fafb7fff700 1 -- 172.21.15.82:0/3203745476 learned_addr learned my addr 172.21.15.82:0/3203745476 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:19:12.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.210+0000 7fafc4f9b700 1 --2- 172.21.15.82:0/3203745476 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558aa1407c40 0x558aa140a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:19:12.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.210+0000 7fafc579c700 1 --2- 172.21.15.82:0/3203745476 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558aa140dca0 0x558aa1408da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:19:12.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.211+0000 7fafb7fff700 1 -- 172.21.15.82:0/3203745476 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558aa1407c40 msgr2=0x558aa140a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:19:12.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.211+0000 7fafb7fff700 1 --2- 172.21.15.82:0/3203745476 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558aa1407c40 0x558aa140a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:19:12.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.211+0000 7fafb7fff700 1 -- 172.21.15.82:0/3203745476 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558aa140dca0 msgr2=0x558aa1408da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:19:12.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.211+0000 7fafb7fff700 1 --2- 172.21.15.82:0/3203745476 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558aa140dca0 0x558aa1408da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:19:12.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.211+0000 7fafb7fff700 1 -- 172.21.15.82:0/3203745476 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558aa1185de0 con 0x558aa140d380 2023-09-23T09:19:12.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.211+0000 7fafc579c700 1 --2- 172.21.15.82:0/3203745476 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558aa140dca0 0x558aa1408da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:19:12.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.211+0000 7fafb7fff700 1 --2- 172.21.15.82:0/3203745476 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558aa140d380 0x558aa140a660 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fafb00ccd70 tx=0x7fafb00cf040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c6da2c4f1fc8cd1 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:19:12.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.211+0000 7faf9ffff700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:19:12.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.211+0000 7faf9ffff700 1 -- 172.21.15.82:0/3203745476 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb009b070 con 0x558aa140d380 2023-09-23T09:19:12.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.211+0000 7faf9ffff700 1 -- 172.21.15.82:0/3203745476 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(121..121 src has 1..121) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fafb000bd70 con 0x558aa140d380 2023-09-23T09:19:12.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.211+0000 7fafdaa34b80 1 -- 172.21.15.82:0/3203745476 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558aa13fa8b0 con 0x558aa140d380 2023-09-23T09:19:12.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.212+0000 7faf9ffff700 1 -- 172.21.15.82:0/3203745476 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=76) v2 ==== 24+0+0 (secure 0 0 0) 0x7fafb00109f0 con 0x558aa140d380 2023-09-23T09:19:12.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.212+0000 7fafdaa34b80 10 client.16935 fetch_fsmap learned FSMap version 76 2023-09-23T09:19:12.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.212+0000 7fafdaa34b80 1 -- 172.21.15.82:0/3203745476 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=76,monmap=4+}) v3 -- 0x558aa11ac250 con 0x558aa140d380 2023-09-23T09:19:12.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.212+0000 7faf9ffff700 1 -- 172.21.15.82:0/3203745476 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x558aa13fa8b0 con 0x558aa140d380 2023-09-23T09:19:12.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.212+0000 7faf9ffff700 1 -- 172.21.15.82:0/3203745476 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 76) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fafb00ba020 con 0x558aa140d380 2023-09-23T09:19:12.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.212+0000 7fafdaa34b80 10 client.16935 fetch_fsmap finished waiting for FSMap version 76 2023-09-23T09:19:12.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.212+0000 7fafdaa34b80 10 client.16935 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:19:12.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.212+0000 7fafdaa34b80 20 client.16935 populate_metadata read hostname 'smithi082' 2023-09-23T09:19:12.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.212+0000 7fafdaa34b80 1 --2- 172.21.15.82:0/3203745476 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x558aa1476440 0x558aa1478860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:19:12.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.212+0000 7fafdaa34b80 4 client.16935 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:19:12.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.212+0000 7fafdaa34b80 1 -- 172.21.15.82:0/3203745476 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x558aa1352970 con 0x558aa1476440 2023-09-23T09:19:12.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.213+0000 7fafc4f9b700 1 --2- 172.21.15.82:0/3203745476 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x558aa1476440 0x558aa1478860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:19:12.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.213+0000 7fafc4f9b700 1 --2- 172.21.15.82:0/3203745476 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x558aa1476440 0x558aa1478860 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4dc7bfc6b2e15942 server_cookie=1d4908aad68c621f in_seq=0 out_seq=0 2023-09-23T09:19:12.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.213+0000 7faf9ffff700 10 client.16935 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:19:12.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.213+0000 7faf9ffff700 1 -- 172.21.15.82:0/3203745476 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x558aa1352970 con 0x558aa1476440 2023-09-23T09:19:12.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.213+0000 7faf9ffff700 10 client.16935 handle_command_reply: tid=0 2023-09-23T09:19:12.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.213+0000 7fafdaa34b80 1 client.16935 shutdown 2023-09-23T09:19:12.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.214+0000 7fafdaa34b80 1 -- 172.21.15.82:0/3203745476 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558aa140d380 msgr2=0x558aa140a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:19:12.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.214+0000 7fafdaa34b80 1 --2- 172.21.15.82:0/3203745476 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558aa140d380 0x558aa140a660 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fafb00ccd70 tx=0x7fafb00cf040 comp rx=0 tx=0).stop 2023-09-23T09:19:12.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.214+0000 7fafdaa34b80 1 -- 172.21.15.82:0/3203745476 shutdown_connections 2023-09-23T09:19:12.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.214+0000 7fafdaa34b80 1 --2- 172.21.15.82:0/3203745476 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558aa140dca0 0x558aa1408da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:19:12.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.214+0000 7fafdaa34b80 1 --2- 172.21.15.82:0/3203745476 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558aa1407c40 0x558aa140a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:19:12.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.214+0000 7fafdaa34b80 1 --2- 172.21.15.82:0/3203745476 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x558aa1476440 0x558aa1478860 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:19:12.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.214+0000 7fafdaa34b80 1 --2- 172.21.15.82:0/3203745476 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558aa140d380 0x558aa140a660 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:19:12.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.214+0000 7faf9ffff700 0 client.16935 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:19:12.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.214+0000 7fafdaa34b80 1 -- 172.21.15.82:0/3203745476 >> 172.21.15.82:0/3203745476 conn(0x558aa137c0e0 msgr2=0x558aa140bf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:19:12.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.214+0000 7fafdaa34b80 1 -- 172.21.15.82:0/3203745476 shutdown_connections 2023-09-23T09:19:12.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.214+0000 7fafdaa34b80 1 -- 172.21.15.82:0/3203745476 wait complete. 2023-09-23T09:19:12.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.214+0000 7fafdaa34b80 20 client.16935 trim_cache size 0 max 16384 2023-09-23T09:19:12.221 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:19:12.221 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-23T09:19:12.221 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:19:12.221 INFO:teuthology.orchestra.run.smithi082.stdout: "047cbc72-e254-4787-b038-382de9c1a9a4": { 2023-09-23T09:19:12.221 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:19:12.221 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "047cbc72-e254-4787-b038-382de9c1a9a4", 2023-09-23T09:19:12.221 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:19:12.221 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:19:12.221 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:19:12.222 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:19:12.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.215+0000 7fafc71ff700 1 -- 172.21.15.82:0/1842063504 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fafa80a0140 msgr2=0x7fafa80a2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:19:12.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.215+0000 7fafc71ff700 1 --2- 172.21.15.82:0/1842063504 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fafa80a0140 0x7fafa80a2600 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fafb8013e30 tx=0x7fafb80134b0 comp rx=0 tx=0).stop 2023-09-23T09:19:12.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.215+0000 7fafc71ff700 1 -- 172.21.15.82:0/1842063504 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fafc0101230 msgr2=0x7fafc0194bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:19:12.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.215+0000 7fafc71ff700 1 --2- 172.21.15.82:0/1842063504 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fafc0101230 0x7fafc0194bd0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fafb0012fc0 tx=0x7fafb00100c0 comp rx=0 tx=0).stop 2023-09-23T09:19:12.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.215+0000 7fafc71ff700 1 -- 172.21.15.82:0/1842063504 shutdown_connections 2023-09-23T09:19:12.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.215+0000 7fafc71ff700 1 --2- 172.21.15.82:0/1842063504 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fafa80a0140 0x7fafa80a2600 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:19:12.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.215+0000 7fafc71ff700 1 --2- 172.21.15.82:0/1842063504 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fafc0106880 0x7fafc0197f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:19:12.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.215+0000 7fafc71ff700 1 --2- 172.21.15.82:0/1842063504 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fafc0100870 0x7fafc0194690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:19:12.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.215+0000 7fafc71ff700 1 --2- 172.21.15.82:0/1842063504 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fafc0101230 0x7fafc0194bd0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:19:12.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.215+0000 7fafc71ff700 1 -- 172.21.15.82:0/1842063504 >> 172.21.15.82:0/1842063504 conn(0x7fafc00fc3a0 msgr2=0x7fafc00fcad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:19:12.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.215+0000 7fafc71ff700 1 -- 172.21.15.82:0/1842063504 shutdown_connections 2023-09-23T09:19:12.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:12.215+0000 7fafc71ff700 1 -- 172.21.15.82:0/1842063504 wait complete. 2023-09-23T09:19:12.236 INFO:tasks.cephfs.filesystem:scrub status for tag:047cbc72-e254-4787-b038-382de9c1a9a4 - {'path': '/', 'tag': '047cbc72-e254-4787-b038-382de9c1a9a4', 'options': 'recursive,force'} 2023-09-23T09:19:13.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:19:12 smithi135 ceph-mon[99205]: pgmap v703: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.2 MiB/s wr, 454 op/s 2023-09-23T09:19:13.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:19:12 smithi135 ceph-mon[99205]: osdmap e121: 12 total, 12 up, 12 in 2023-09-23T09:19:13.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:19:12 smithi082 ceph-mon[97694]: pgmap v703: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.2 MiB/s wr, 454 op/s 2023-09-23T09:19:13.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:19:12 smithi082 ceph-mon[97694]: osdmap e121: 12 total, 12 up, 12 in 2023-09-23T09:19:13.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:19:12 smithi161 ceph-mon[99580]: pgmap v703: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.2 MiB/s wr, 454 op/s 2023-09-23T09:19:13.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:19:12 smithi161 ceph-mon[99580]: osdmap e121: 12 total, 12 up, 12 in 2023-09-23T09:19:15.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:19:14 smithi135 ceph-mon[99205]: pgmap v705: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 282 op/s 2023-09-23T09:19:15.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:19:14 smithi082 ceph-mon[97694]: pgmap v705: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 282 op/s 2023-09-23T09:19:15.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:19:14 smithi161 ceph-mon[99580]: pgmap v705: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 282 op/s 2023-09-23T09:19:16.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:19:15 smithi082 ceph-mon[97694]: pgmap v706: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.7 MiB/s wr, 512 op/s 2023-09-23T09:19:16.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:19:15 smithi161 ceph-mon[99580]: pgmap v706: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.7 MiB/s wr, 512 op/s 2023-09-23T09:19:16.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:19:15 smithi135 ceph-mon[99205]: pgmap v706: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.7 MiB/s wr, 512 op/s 2023-09-23T09:19:18.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:19:17 smithi135 ceph-mon[99205]: pgmap v707: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.2 MiB/s wr, 441 op/s 2023-09-23T09:19:18.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:19:17 smithi082 ceph-mon[97694]: pgmap v707: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.2 MiB/s wr, 441 op/s 2023-09-23T09:19:18.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:19:17 smithi161 ceph-mon[99580]: pgmap v707: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.2 MiB/s wr, 441 op/s 2023-09-23T09:19:20.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:19:20 smithi135 ceph-mon[99205]: pgmap v708: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.1 MiB/s wr, 430 op/s 2023-09-23T09:19:20.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:19:20 smithi082 ceph-mon[97694]: pgmap v708: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.1 MiB/s wr, 430 op/s 2023-09-23T09:19:20.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:19:20 smithi161 ceph-mon[99580]: pgmap v708: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.1 MiB/s wr, 430 op/s 2023-09-23T09:19:23.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:19:22 smithi135 ceph-mon[99205]: pgmap v709: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.1 MiB/s wr, 430 op/s 2023-09-23T09:19:23.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:19:22 smithi082 ceph-mon[97694]: pgmap v709: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.1 MiB/s wr, 430 op/s 2023-09-23T09:19:23.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:19:22 smithi161 ceph-mon[99580]: pgmap v709: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.1 MiB/s wr, 430 op/s 2023-09-23T09:19:24.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:19:23 smithi082 ceph-mon[97694]: pgmap v710: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 371 op/s 2023-09-23T09:19:24.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:19:23 smithi161 ceph-mon[99580]: pgmap v710: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 371 op/s 2023-09-23T09:19:24.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:19:23 smithi135 ceph-mon[99205]: pgmap v710: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 371 op/s 2023-09-23T09:19:26.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:19:26 smithi135 ceph-mon[99205]: pgmap v711: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.8 MiB/s wr, 525 op/s 2023-09-23T09:19:26.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:19:26 smithi082 ceph-mon[97694]: pgmap v711: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.8 MiB/s wr, 525 op/s 2023-09-23T09:19:26.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:19:26 smithi161 ceph-mon[99580]: pgmap v711: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.8 MiB/s wr, 525 op/s 2023-09-23T09:19:28.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:19:27 smithi082 ceph-mon[97694]: pgmap v712: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 346 op/s 2023-09-23T09:19:28.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:19:27 smithi161 ceph-mon[99580]: pgmap v712: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 346 op/s 2023-09-23T09:19:28.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:19:27 smithi135 ceph-mon[99205]: pgmap v712: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 346 op/s 2023-09-23T09:19:30.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:19:30 smithi135 ceph-mon[99205]: pgmap v713: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.8 MiB/s wr, 525 op/s 2023-09-23T09:19:30.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:19:30 smithi082 ceph-mon[97694]: pgmap v713: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.8 MiB/s wr, 525 op/s 2023-09-23T09:19:30.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:19:30 smithi161 ceph-mon[99580]: pgmap v713: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.8 MiB/s wr, 525 op/s 2023-09-23T09:19:33.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:19:32 smithi135 ceph-mon[99205]: pgmap v714: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 346 op/s 2023-09-23T09:19:33.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:19:32 smithi082 ceph-mon[97694]: pgmap v714: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 346 op/s 2023-09-23T09:19:33.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:19:32 smithi161 ceph-mon[99580]: pgmap v714: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 346 op/s 2023-09-23T09:19:34.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:19:33 smithi135 ceph-mon[99205]: pgmap v715: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 346 op/s 2023-09-23T09:19:34.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:19:33 smithi082 ceph-mon[97694]: pgmap v715: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 346 op/s 2023-09-23T09:19:34.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:19:33 smithi161 ceph-mon[99580]: pgmap v715: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 346 op/s 2023-09-23T09:19:36.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:19:36 smithi135 ceph-mon[99205]: pgmap v716: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.7 MiB/s wr, 515 op/s 2023-09-23T09:19:36.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:19:36 smithi082 ceph-mon[97694]: pgmap v716: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.7 MiB/s wr, 515 op/s 2023-09-23T09:19:36.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:19:36 smithi161 ceph-mon[99580]: pgmap v716: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.7 MiB/s wr, 515 op/s 2023-09-23T09:19:38.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:19:37 smithi082 ceph-mon[97694]: pgmap v717: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 348 op/s 2023-09-23T09:19:38.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:19:37 smithi161 ceph-mon[99580]: pgmap v717: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 348 op/s 2023-09-23T09:19:38.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:19:37 smithi135 ceph-mon[99205]: pgmap v717: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 348 op/s 2023-09-23T09:19:40.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:19:40 smithi135 ceph-mon[99205]: pgmap v718: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.8 MiB/s wr, 527 op/s 2023-09-23T09:19:40.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:19:40 smithi082 ceph-mon[97694]: pgmap v718: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.8 MiB/s wr, 527 op/s 2023-09-23T09:19:40.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:19:40 smithi161 ceph-mon[99580]: pgmap v718: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.8 MiB/s wr, 527 op/s 2023-09-23T09:19:41.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:19:41 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:19:41.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:19:41 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:19:41.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:19:41 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:19:42.237 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:19:42.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.551+0000 7fe4891ff700 1 -- 172.21.15.82:0/3653261909 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4840735e0 msgr2=0x7fe484111330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:19:42.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.551+0000 7fe4891ff700 1 --2- 172.21.15.82:0/3653261909 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4840735e0 0x7fe484111330 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fe478009990 tx=0x7fe478009ca0 comp rx=0 tx=0).stop 2023-09-23T09:19:42.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.552+0000 7fe4891ff700 1 -- 172.21.15.82:0/3653261909 shutdown_connections 2023-09-23T09:19:42.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.552+0000 7fe4891ff700 1 --2- 172.21.15.82:0/3653261909 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe484111870 0x7fe484113c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:19:42.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.552+0000 7fe4891ff700 1 --2- 172.21.15.82:0/3653261909 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe484072cc0 0x7fe4840730a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:19:42.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.552+0000 7fe4891ff700 1 --2- 172.21.15.82:0/3653261909 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4840735e0 0x7fe484111330 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:19:42.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.552+0000 7fe4891ff700 1 -- 172.21.15.82:0/3653261909 >> 172.21.15.82:0/3653261909 conn(0x7fe4840fc390 msgr2=0x7fe4840fe7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:19:42.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.552+0000 7fe4891ff700 1 -- 172.21.15.82:0/3653261909 shutdown_connections 2023-09-23T09:19:42.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.552+0000 7fe4891ff700 1 -- 172.21.15.82:0/3653261909 wait complete. 2023-09-23T09:19:42.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.553+0000 7fe4891ff700 1 Processor -- start 2023-09-23T09:19:42.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.553+0000 7fe4891ff700 1 -- start start 2023-09-23T09:19:42.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.554+0000 7fe4891ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe484072cc0 0x7fe48419cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:19:42.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.554+0000 7fe4891ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4840735e0 0x7fe48419d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:19:42.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.554+0000 7fe4891ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe484111870 0x7fe4841a1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:19:42.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.554+0000 7fe4891ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4841a1f60 con 0x7fe484111870 2023-09-23T09:19:42.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.554+0000 7fe4891ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4841a20d0 con 0x7fe4840735e0 2023-09-23T09:19:42.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.554+0000 7fe4891ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4841a2290 con 0x7fe484072cc0 2023-09-23T09:19:42.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.554+0000 7fe482d9d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe484072cc0 0x7fe48419cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:19:42.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.554+0000 7fe482d9d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe484072cc0 0x7fe48419cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:57186/0 (socket says 172.21.15.82:57186) 2023-09-23T09:19:42.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.554+0000 7fe482d9d700 1 -- 172.21.15.82:0/1124314856 learned_addr learned my addr 172.21.15.82:0/1124314856 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:19:42.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.554+0000 7fe48359e700 1 --2- 172.21.15.82:0/1124314856 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe484111870 0x7fe4841a1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:19:42.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.555+0000 7fe48259c700 1 --2- 172.21.15.82:0/1124314856 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4840735e0 0x7fe48419d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:19:42.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.555+0000 7fe482d9d700 1 -- 172.21.15.82:0/1124314856 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4840735e0 msgr2=0x7fe48419d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:19:42.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.555+0000 7fe482d9d700 1 --2- 172.21.15.82:0/1124314856 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4840735e0 0x7fe48419d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:19:42.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.555+0000 7fe482d9d700 1 -- 172.21.15.82:0/1124314856 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe484111870 msgr2=0x7fe4841a1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:19:42.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.555+0000 7fe482d9d700 1 --2- 172.21.15.82:0/1124314856 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe484111870 0x7fe4841a1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:19:42.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.555+0000 7fe482d9d700 1 -- 172.21.15.82:0/1124314856 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4780095f0 con 0x7fe484072cc0 2023-09-23T09:19:42.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.555+0000 7fe482d9d700 1 --2- 172.21.15.82:0/1124314856 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe484072cc0 0x7fe48419cf80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe47400e9a0 tx=0x7fe47400ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:19:42.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.555+0000 7fe46bfff700 1 -- 172.21.15.82:0/1124314856 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe474009790 con 0x7fe484072cc0 2023-09-23T09:19:42.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.555+0000 7fe4891ff700 1 -- 172.21.15.82:0/1124314856 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4841a2570 con 0x7fe484072cc0 2023-09-23T09:19:42.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.555+0000 7fe46bfff700 1 -- 172.21.15.82:0/1124314856 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe47400cbd0 con 0x7fe484072cc0 2023-09-23T09:19:42.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.555+0000 7fe46bfff700 1 -- 172.21.15.82:0/1124314856 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe474018680 con 0x7fe484072cc0 2023-09-23T09:19:42.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.556+0000 7fe4891ff700 1 -- 172.21.15.82:0/1124314856 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4841a9db0 con 0x7fe484072cc0 2023-09-23T09:19:42.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.560+0000 7fe46bfff700 1 -- 172.21.15.82:0/1124314856 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7fe47400cd40 con 0x7fe484072cc0 2023-09-23T09:19:42.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.561+0000 7fe49cb05b80 1 Processor -- start 2023-09-23T09:19:42.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.561+0000 7fe49cb05b80 1 -- start start 2023-09-23T09:19:42.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.562+0000 7fe49cb05b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600ace0a380 0x5600ace0a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:19:42.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.562+0000 7fe49cb05b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600ace0aca0 0x5600ace04700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:19:42.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.562+0000 7fe49cb05b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5600ace04c40 0x5600ace050a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:19:42.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.562+0000 7fe49cb05b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600acd6c7b0 con 0x5600ace0a380 2023-09-23T09:19:42.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.562+0000 7fe49cb05b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600acd5d780 con 0x5600ace0aca0 2023-09-23T09:19:42.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.562+0000 7fe49cb05b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600acd5b0a0 con 0x5600ace04c40 2023-09-23T09:19:42.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.562+0000 7fe48359e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600ace0a380 0x5600ace0a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:19:42.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.562+0000 7fe482d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600ace0aca0 0x5600ace04700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:19:42.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.562+0000 7fe48359e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600ace0a380 0x5600ace0a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51196/0 (socket says 172.21.15.82:51196) 2023-09-23T09:19:42.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.562+0000 7fe48359e700 1 -- 172.21.15.82:0/1501616748 learned_addr learned my addr 172.21.15.82:0/1501616748 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:19:42.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.562+0000 7fe46bfff700 1 --2- 172.21.15.82:0/1124314856 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fe46c0a0140 0x7fe46c0a2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:19:42.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.562+0000 7fe48259c700 1 --2- 172.21.15.82:0/1501616748 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5600ace04c40 0x5600ace050a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:19:42.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.562+0000 7fe46bfff700 1 -- 172.21.15.82:0/1124314856 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fe474014070 con 0x7fe484072cc0 2023-09-23T09:19:42.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.563+0000 7fe48359e700 1 --2- 172.21.15.82:0/1124314856 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fe46c0a0140 0x7fe46c0a2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:19:42.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.563+0000 7fe482d9d700 1 -- 172.21.15.82:0/1501616748 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5600ace04c40 msgr2=0x5600ace050a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:19:42.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.563+0000 7fe482d9d700 1 --2- 172.21.15.82:0/1501616748 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5600ace04c40 0x5600ace050a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:19:42.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.563+0000 7fe482d9d700 1 -- 172.21.15.82:0/1501616748 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600ace0a380 msgr2=0x5600ace0a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:19:42.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.563+0000 7fe482d9d700 1 --2- 172.21.15.82:0/1501616748 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600ace0a380 0x5600ace0a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:19:42.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.563+0000 7fe482d9d700 1 -- 172.21.15.82:0/1501616748 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5600acbd6630 con 0x5600ace0aca0 2023-09-23T09:19:42.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.563+0000 7fe48359e700 1 --2- 172.21.15.82:0/1501616748 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600ace0a380 0x5600ace0a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:19:42.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.563+0000 7fe482d9d700 1 --2- 172.21.15.82:0/1501616748 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600ace0aca0 0x5600ace04700 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe4740c8f30 tx=0x7fe474098a30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f6d1e21d3f644457 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:19:42.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.563+0000 7fe4697fa700 1 -- 172.21.15.82:0/1501616748 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4740d1020 con 0x5600ace0aca0 2023-09-23T09:19:42.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.563+0000 7fe48359e700 1 --2- 172.21.15.82:0/1124314856 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fe46c0a0140 0x7fe46c0a2600 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe47c0060b0 tx=0x7fe47c004b40 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:19:42.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.563+0000 7fe4697fa700 1 -- 172.21.15.82:0/1501616748 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe474098ef0 con 0x5600ace0aca0 2023-09-23T09:19:42.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.563+0000 7fe4697fa700 1 -- 172.21.15.82:0/1501616748 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe474098640 con 0x5600ace0aca0 2023-09-23T09:19:42.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.564+0000 7fe49cb05b80 1 -- 172.21.15.82:0/1501616748 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600ace0aca0 msgr2=0x5600ace04700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:19:42.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.564+0000 7fe49cb05b80 1 --2- 172.21.15.82:0/1501616748 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600ace0aca0 0x5600ace04700 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe4740c8f30 tx=0x7fe474098a30 comp rx=0 tx=0).stop 2023-09-23T09:19:42.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.564+0000 7fe49cb05b80 1 -- 172.21.15.82:0/1501616748 shutdown_connections 2023-09-23T09:19:42.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.564+0000 7fe49cb05b80 1 --2- 172.21.15.82:0/1501616748 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5600ace04c40 0x5600ace050a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:19:42.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.564+0000 7fe49cb05b80 1 --2- 172.21.15.82:0/1501616748 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600ace0a380 0x5600ace0a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:19:42.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.564+0000 7fe49cb05b80 1 --2- 172.21.15.82:0/1501616748 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600ace0aca0 0x5600ace04700 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:19:42.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.564+0000 7fe49cb05b80 1 -- 172.21.15.82:0/1501616748 >> 172.21.15.82:0/1501616748 conn(0x5600acd790e0 msgr2=0x5600acdff410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:19:42.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.564+0000 7fe49cb05b80 1 -- 172.21.15.82:0/1501616748 shutdown_connections 2023-09-23T09:19:42.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.564+0000 7fe49cb05b80 1 -- 172.21.15.82:0/1501616748 wait complete. 2023-09-23T09:19:42.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.565+0000 7fe49cb05b80 1 -- start start 2023-09-23T09:19:42.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.565+0000 7fe49cb05b80 1 Processor -- start 2023-09-23T09:19:42.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.566+0000 7fe49cb05b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600ace04c40 0x5600ace10c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:19:42.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.566+0000 7fe49cb05b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5600ace0a380 0x5600ace0dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:19:42.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.566+0000 7fe49cb05b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600ace0aca0 0x5600ace0e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:19:42.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.566+0000 7fe49cb05b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600acd56990 con 0x5600ace04c40 2023-09-23T09:19:42.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.566+0000 7fe49cb05b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600accf4bb0 con 0x5600ace0aca0 2023-09-23T09:19:42.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.566+0000 7fe49cb05b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600accf48b0 con 0x5600ace0a380 2023-09-23T09:19:42.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.566+0000 7fe49cb05b80 10 client.0 _ll_register_callbacks cb 0x5600acc3ea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:19:42.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.566+0000 7fe482d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600ace04c40 0x5600ace10c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:19:42.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.566+0000 7fe482d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600ace04c40 0x5600ace10c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51204/0 (socket says 172.21.15.82:51204) 2023-09-23T09:19:42.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.566+0000 7fe482d9d700 1 -- 172.21.15.82:0/900186606 learned_addr learned my addr 172.21.15.82:0/900186606 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:19:42.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.566+0000 7fe48259c700 1 --2- 172.21.15.82:0/900186606 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5600ace0a380 0x5600ace0dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:19:42.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.566+0000 7fe48359e700 1 --2- 172.21.15.82:0/900186606 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600ace0aca0 0x5600ace0e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:19:42.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.567+0000 7fe482d9d700 1 -- 172.21.15.82:0/900186606 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5600ace0a380 msgr2=0x5600ace0dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:19:42.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.567+0000 7fe482d9d700 1 --2- 172.21.15.82:0/900186606 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5600ace0a380 0x5600ace0dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:19:42.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.567+0000 7fe482d9d700 1 -- 172.21.15.82:0/900186606 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600ace0aca0 msgr2=0x5600ace0e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:19:42.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.567+0000 7fe482d9d700 1 --2- 172.21.15.82:0/900186606 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600ace0aca0 0x5600ace0e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:19:42.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.567+0000 7fe482d9d700 1 -- 172.21.15.82:0/900186606 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe47c013850 con 0x5600ace04c40 2023-09-23T09:19:42.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.567+0000 7fe48359e700 1 --2- 172.21.15.82:0/900186606 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600ace0aca0 0x5600ace0e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:19:42.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.567+0000 7fe482d9d700 1 --2- 172.21.15.82:0/900186606 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600ace04c40 0x5600ace10c40 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fe4740c9530 tx=0x7fe474099380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cec8f5f39bf6177c server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:19:42.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.567+0000 7fe466ff5700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:19:42.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.567+0000 7fe466ff5700 1 -- 172.21.15.82:0/900186606 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe47409cd20 con 0x5600ace04c40 2023-09-23T09:19:42.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.567+0000 7fe466ff5700 1 -- 172.21.15.82:0/900186606 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(121..121 src has 1..121) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fe4740a0d00 con 0x5600ace04c40 2023-09-23T09:19:42.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.567+0000 7fe49cb05b80 1 -- 172.21.15.82:0/900186606 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5600acdd41c0 con 0x5600ace04c40 2023-09-23T09:19:42.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.567+0000 7fe466ff5700 1 -- 172.21.15.82:0/900186606 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=76) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe4740a0a80 con 0x5600ace04c40 2023-09-23T09:19:42.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.568+0000 7fe49cb05b80 10 client.16947 fetch_fsmap learned FSMap version 76 2023-09-23T09:19:42.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.568+0000 7fe49cb05b80 1 -- 172.21.15.82:0/900186606 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=76,monmap=4+}) v3 -- 0x7fe4841a9db0 con 0x5600ace04c40 2023-09-23T09:19:42.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.568+0000 7fe466ff5700 1 -- 172.21.15.82:0/900186606 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5600acdd41c0 con 0x5600ace04c40 2023-09-23T09:19:42.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.568+0000 7fe466ff5700 1 -- 172.21.15.82:0/900186606 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 76) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fe474094ce0 con 0x5600ace04c40 2023-09-23T09:19:42.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.568+0000 7fe49cb05b80 10 client.16947 fetch_fsmap finished waiting for FSMap version 76 2023-09-23T09:19:42.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.568+0000 7fe49cb05b80 10 client.16947 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:19:42.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.568+0000 7fe49cb05b80 20 client.16947 populate_metadata read hostname 'smithi082' 2023-09-23T09:19:42.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.568+0000 7fe49cb05b80 1 --2- 172.21.15.82:0/900186606 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5600ace1e270 0x5600ace20660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:19:42.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.568+0000 7fe49cb05b80 4 client.16947 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:19:42.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.568+0000 7fe49cb05b80 1 -- 172.21.15.82:0/900186606 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5600accfcba0 con 0x5600ace1e270 2023-09-23T09:19:42.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.569+0000 7fe48259c700 1 --2- 172.21.15.82:0/900186606 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5600ace1e270 0x5600ace20660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:19:42.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.569+0000 7fe466ff5700 10 client.16947 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:19:42.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.569+0000 7fe48259c700 1 --2- 172.21.15.82:0/900186606 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5600ace1e270 0x5600ace20660 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1591b995ce17bf23 server_cookie=7d74dfd2925374ed in_seq=0 out_seq=0 2023-09-23T09:19:42.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.570+0000 7fe466ff5700 1 -- 172.21.15.82:0/900186606 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5600accfcba0 con 0x5600ace1e270 2023-09-23T09:19:42.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.570+0000 7fe466ff5700 10 client.16947 handle_command_reply: tid=0 2023-09-23T09:19:42.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.570+0000 7fe49cb05b80 1 client.16947 shutdown 2023-09-23T09:19:42.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.570+0000 7fe49cb05b80 1 -- 172.21.15.82:0/900186606 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600ace04c40 msgr2=0x5600ace10c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:19:42.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.570+0000 7fe49cb05b80 1 --2- 172.21.15.82:0/900186606 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600ace04c40 0x5600ace10c40 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fe4740c9530 tx=0x7fe474099380 comp rx=0 tx=0).stop 2023-09-23T09:19:42.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.570+0000 7fe49cb05b80 1 -- 172.21.15.82:0/900186606 shutdown_connections 2023-09-23T09:19:42.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.570+0000 7fe49cb05b80 1 --2- 172.21.15.82:0/900186606 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600ace0aca0 0x5600ace0e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:19:42.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.570+0000 7fe49cb05b80 1 --2- 172.21.15.82:0/900186606 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5600ace1e270 0x5600ace20660 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:19:42.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.570+0000 7fe49cb05b80 1 --2- 172.21.15.82:0/900186606 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600ace04c40 0x5600ace10c40 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:19:42.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.570+0000 7fe49cb05b80 1 --2- 172.21.15.82:0/900186606 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5600ace0a380 0x5600ace0dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:19:42.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.570+0000 7fe49cb05b80 1 -- 172.21.15.82:0/900186606 >> 172.21.15.82:0/900186606 conn(0x5600acd790e0 msgr2=0x5600acdf92b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:19:42.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.570+0000 7fe466ff5700 0 client.16947 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:19:42.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.570+0000 7fe49cb05b80 1 -- 172.21.15.82:0/900186606 shutdown_connections 2023-09-23T09:19:42.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.570+0000 7fe49cb05b80 1 -- 172.21.15.82:0/900186606 wait complete. 2023-09-23T09:19:42.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.571+0000 7fe49cb05b80 20 client.16947 trim_cache size 0 max 16384 2023-09-23T09:19:42.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.588+0000 7fe49cb05b80 1 Processor -- start 2023-09-23T09:19:42.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.588+0000 7fe49cb05b80 1 -- start start 2023-09-23T09:19:42.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.589+0000 7fe49cb05b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5600ace04c40 0x5600ace107e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:19:42.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.589+0000 7fe49cb05b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600ace0a380 0x5600ace08f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:19:42.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.589+0000 7fe49cb05b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600ace0aca0 0x5600ace09490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:19:42.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.589+0000 7fe49cb05b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600acbd8920 con 0x5600ace0a380 2023-09-23T09:19:42.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.589+0000 7fe49cb05b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600ace0f4a0 con 0x5600ace0aca0 2023-09-23T09:19:42.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.589+0000 7fe49cb05b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600ace112a0 con 0x5600ace04c40 2023-09-23T09:19:42.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.589+0000 7fe482d9d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5600ace04c40 0x5600ace107e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:19:42.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.589+0000 7fe48259c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600ace0a380 0x5600ace08f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:19:42.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.589+0000 7fe48359e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600ace0aca0 0x5600ace09490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:19:42.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.589+0000 7fe482d9d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5600ace04c40 0x5600ace107e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:57214/0 (socket says 172.21.15.82:57214) 2023-09-23T09:19:42.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.589+0000 7fe482d9d700 1 -- 172.21.15.82:0/1421280991 learned_addr learned my addr 172.21.15.82:0/1421280991 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:19:42.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.590+0000 7fe482d9d700 1 -- 172.21.15.82:0/1421280991 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600ace0aca0 msgr2=0x5600ace09490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:19:42.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.590+0000 7fe482d9d700 1 --2- 172.21.15.82:0/1421280991 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600ace0aca0 0x5600ace09490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:19:42.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.590+0000 7fe482d9d700 1 -- 172.21.15.82:0/1421280991 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600ace0a380 msgr2=0x5600ace08f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:19:42.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.590+0000 7fe482d9d700 1 --2- 172.21.15.82:0/1421280991 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600ace0a380 0x5600ace08f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:19:42.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.590+0000 7fe482d9d700 1 -- 172.21.15.82:0/1421280991 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5600acb82de0 con 0x5600ace04c40 2023-09-23T09:19:42.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.590+0000 7fe482d9d700 1 --2- 172.21.15.82:0/1421280991 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5600ace04c40 0x5600ace107e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe474097240 tx=0x7fe474098fb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ab551fae15f7d61 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:19:42.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.590+0000 7fe469ffb700 1 -- 172.21.15.82:0/1421280991 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4740b83a0 con 0x5600ace04c40 2023-09-23T09:19:42.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.590+0000 7fe469ffb700 1 -- 172.21.15.82:0/1421280991 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe474098a30 con 0x5600ace04c40 2023-09-23T09:19:42.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.590+0000 7fe469ffb700 1 -- 172.21.15.82:0/1421280991 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe474093b00 con 0x5600ace04c40 2023-09-23T09:19:42.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.591+0000 7fe49cb05b80 1 -- 172.21.15.82:0/1421280991 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5600ace04c40 msgr2=0x5600ace107e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:19:42.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.591+0000 7fe49cb05b80 1 --2- 172.21.15.82:0/1421280991 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5600ace04c40 0x5600ace107e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe474097240 tx=0x7fe474098fb0 comp rx=0 tx=0).stop 2023-09-23T09:19:42.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.591+0000 7fe49cb05b80 1 -- 172.21.15.82:0/1421280991 shutdown_connections 2023-09-23T09:19:42.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.591+0000 7fe49cb05b80 1 --2- 172.21.15.82:0/1421280991 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600ace0aca0 0x5600ace09490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:19:42.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.591+0000 7fe49cb05b80 1 --2- 172.21.15.82:0/1421280991 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5600ace04c40 0x5600ace107e0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:19:42.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.591+0000 7fe49cb05b80 1 --2- 172.21.15.82:0/1421280991 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600ace0a380 0x5600ace08f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:19:42.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.591+0000 7fe49cb05b80 1 -- 172.21.15.82:0/1421280991 >> 172.21.15.82:0/1421280991 conn(0x5600acd790e0 msgr2=0x5600ace08090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:19:42.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.591+0000 7fe49cb05b80 1 -- 172.21.15.82:0/1421280991 shutdown_connections 2023-09-23T09:19:42.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.591+0000 7fe49cb05b80 1 -- 172.21.15.82:0/1421280991 wait complete. 2023-09-23T09:19:42.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.592+0000 7fe49cb05b80 1 -- start start 2023-09-23T09:19:42.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.592+0000 7fe49cb05b80 1 Processor -- start 2023-09-23T09:19:42.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.592+0000 7fe49cb05b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600ace04c40 0x5600ace05da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:19:42.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.592+0000 7fe49cb05b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5600ace0a380 0x5600ace062e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:19:42.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.593+0000 7fe49cb05b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600ace0aca0 0x5600ace06820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:19:42.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.593+0000 7fe49cb05b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600ace06f20 con 0x5600ace0aca0 2023-09-23T09:19:42.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.593+0000 7fe49cb05b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600ace07090 con 0x5600ace04c40 2023-09-23T09:19:42.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.593+0000 7fe49cb05b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600ace07250 con 0x5600ace0a380 2023-09-23T09:19:42.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.593+0000 7fe49cb05b80 10 client.0 _ll_register_callbacks cb 0x7fe47c009f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:19:42.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.593+0000 7fe48359e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600ace0aca0 0x5600ace06820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:19:42.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.593+0000 7fe482d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600ace04c40 0x5600ace05da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:19:42.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.593+0000 7fe48259c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5600ace0a380 0x5600ace062e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:19:42.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.593+0000 7fe48259c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5600ace0a380 0x5600ace062e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:57226/0 (socket says 172.21.15.82:57226) 2023-09-23T09:19:42.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.593+0000 7fe482d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600ace04c40 0x5600ace05da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:50994/0 (socket says 172.21.15.82:50994) 2023-09-23T09:19:42.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.593+0000 7fe48259c700 1 -- 172.21.15.82:0/1766461171 learned_addr learned my addr 172.21.15.82:0/1766461171 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:19:42.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.593+0000 7fe48359e700 1 -- 172.21.15.82:0/1766461171 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5600ace0a380 msgr2=0x5600ace062e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:19:42.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.593+0000 7fe48359e700 1 --2- 172.21.15.82:0/1766461171 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5600ace0a380 0x5600ace062e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:19:42.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.593+0000 7fe48359e700 1 -- 172.21.15.82:0/1766461171 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600ace04c40 msgr2=0x5600ace05da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:19:42.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.593+0000 7fe48359e700 1 --2- 172.21.15.82:0/1766461171 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600ace04c40 0x5600ace05da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:19:42.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.593+0000 7fe48359e700 1 -- 172.21.15.82:0/1766461171 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4841a9db0 con 0x5600ace0aca0 2023-09-23T09:19:42.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.594+0000 7fe48359e700 1 --2- 172.21.15.82:0/1766461171 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600ace0aca0 0x5600ace06820 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x5600ace0ec80 tx=0x7fe47c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aef5d4705ec7baad server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:19:42.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.594+0000 7fe466ff5700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:19:42.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.594+0000 7fe466ff5700 1 -- 172.21.15.82:0/1766461171 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe47c02c070 con 0x5600ace0aca0 2023-09-23T09:19:42.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.594+0000 7fe49cb05b80 1 -- 172.21.15.82:0/1766461171 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5600acdf78b0 con 0x5600ace0aca0 2023-09-23T09:19:42.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.594+0000 7fe466ff5700 1 -- 172.21.15.82:0/1766461171 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(121..121 src has 1..121) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fe47c0093b0 con 0x5600ace0aca0 2023-09-23T09:19:42.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.594+0000 7fe466ff5700 1 -- 172.21.15.82:0/1766461171 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=76) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe47c00e040 con 0x5600ace0aca0 2023-09-23T09:19:42.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.594+0000 7fe49cb05b80 10 client.16953 fetch_fsmap learned FSMap version 76 2023-09-23T09:19:42.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.594+0000 7fe49cb05b80 1 -- 172.21.15.82:0/1766461171 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=76,monmap=4+}) v3 -- 0x5600acb6bc60 con 0x5600ace0aca0 2023-09-23T09:19:42.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.594+0000 7fe466ff5700 1 -- 172.21.15.82:0/1766461171 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5600acdf78b0 con 0x5600ace0aca0 2023-09-23T09:19:42.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.595+0000 7fe466ff5700 1 -- 172.21.15.82:0/1766461171 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 76) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fe47c02f020 con 0x5600ace0aca0 2023-09-23T09:19:42.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.595+0000 7fe49cb05b80 10 client.16953 fetch_fsmap finished waiting for FSMap version 76 2023-09-23T09:19:42.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.595+0000 7fe49cb05b80 10 client.16953 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:19:42.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.595+0000 7fe49cb05b80 20 client.16953 populate_metadata read hostname 'smithi082' 2023-09-23T09:19:42.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.595+0000 7fe49cb05b80 1 --2- 172.21.15.82:0/1766461171 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5600ace72be0 0x5600ace75000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:19:42.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.595+0000 7fe49cb05b80 4 client.16953 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:19:42.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.595+0000 7fe49cb05b80 1 -- 172.21.15.82:0/1766461171 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5600acd4f970 con 0x5600ace72be0 2023-09-23T09:19:42.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.595+0000 7fe482d9d700 1 --2- 172.21.15.82:0/1766461171 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5600ace72be0 0x5600ace75000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:19:42.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.595+0000 7fe482d9d700 1 --2- 172.21.15.82:0/1766461171 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5600ace72be0 0x5600ace75000 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a5d0df5450ab418e server_cookie=8edf5c5798d3d5e3 in_seq=0 out_seq=0 2023-09-23T09:19:42.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.595+0000 7fe466ff5700 10 client.16953 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:19:42.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.596+0000 7fe466ff5700 1 -- 172.21.15.82:0/1766461171 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x5600acd4f970 con 0x5600ace72be0 2023-09-23T09:19:42.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.596+0000 7fe466ff5700 10 client.16953 handle_command_reply: tid=0 2023-09-23T09:19:42.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.596+0000 7fe49cb05b80 1 client.16953 shutdown 2023-09-23T09:19:42.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.596+0000 7fe49cb05b80 1 -- 172.21.15.82:0/1766461171 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600ace0aca0 msgr2=0x5600ace06820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:19:42.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.596+0000 7fe49cb05b80 1 --2- 172.21.15.82:0/1766461171 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600ace0aca0 0x5600ace06820 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x5600ace0ec80 tx=0x7fe47c004ad0 comp rx=0 tx=0).stop 2023-09-23T09:19:42.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.596+0000 7fe49cb05b80 1 -- 172.21.15.82:0/1766461171 shutdown_connections 2023-09-23T09:19:42.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.596+0000 7fe49cb05b80 1 --2- 172.21.15.82:0/1766461171 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5600ace72be0 0x5600ace75000 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:19:42.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.596+0000 7fe49cb05b80 1 --2- 172.21.15.82:0/1766461171 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600ace0aca0 0x5600ace06820 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:19:42.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.596+0000 7fe466ff5700 0 client.16953 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:19:42.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.596+0000 7fe49cb05b80 1 --2- 172.21.15.82:0/1766461171 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600ace04c40 0x5600ace05da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:19:42.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.596+0000 7fe49cb05b80 1 --2- 172.21.15.82:0/1766461171 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5600ace0a380 0x5600ace062e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:19:42.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.596+0000 7fe49cb05b80 1 -- 172.21.15.82:0/1766461171 >> 172.21.15.82:0/1766461171 conn(0x5600acd790e0 msgr2=0x5600acdf92b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:19:42.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.596+0000 7fe49cb05b80 1 -- 172.21.15.82:0/1766461171 shutdown_connections 2023-09-23T09:19:42.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.596+0000 7fe49cb05b80 1 -- 172.21.15.82:0/1766461171 wait complete. 2023-09-23T09:19:42.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.596+0000 7fe49cb05b80 20 client.16953 trim_cache size 0 max 16384 2023-09-23T09:19:42.603 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:19:42.603 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-23T09:19:42.603 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:19:42.603 INFO:teuthology.orchestra.run.smithi082.stdout: "047cbc72-e254-4787-b038-382de9c1a9a4": { 2023-09-23T09:19:42.603 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:19:42.603 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "047cbc72-e254-4787-b038-382de9c1a9a4", 2023-09-23T09:19:42.604 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:19:42.604 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:19:42.604 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:19:42.604 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:19:42.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.597+0000 7fe4891ff700 1 -- 172.21.15.82:0/1124314856 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fe46c0a0140 msgr2=0x7fe46c0a2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:19:42.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.597+0000 7fe4891ff700 1 --2- 172.21.15.82:0/1124314856 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fe46c0a0140 0x7fe46c0a2600 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe47c0060b0 tx=0x7fe47c004b40 comp rx=0 tx=0).stop 2023-09-23T09:19:42.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.597+0000 7fe4891ff700 1 -- 172.21.15.82:0/1124314856 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe484072cc0 msgr2=0x7fe48419cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:19:42.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.597+0000 7fe4891ff700 1 --2- 172.21.15.82:0/1124314856 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe484072cc0 0x7fe48419cf80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe47400e9a0 tx=0x7fe47400ecb0 comp rx=0 tx=0).stop 2023-09-23T09:19:42.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.597+0000 7fe4891ff700 1 -- 172.21.15.82:0/1124314856 shutdown_connections 2023-09-23T09:19:42.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.597+0000 7fe4891ff700 1 --2- 172.21.15.82:0/1124314856 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fe46c0a0140 0x7fe46c0a2600 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:19:42.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.597+0000 7fe4891ff700 1 --2- 172.21.15.82:0/1124314856 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe484111870 0x7fe4841a1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:19:42.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.597+0000 7fe4891ff700 1 --2- 172.21.15.82:0/1124314856 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe484072cc0 0x7fe48419cf80 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:19:42.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.597+0000 7fe4891ff700 1 --2- 172.21.15.82:0/1124314856 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4840735e0 0x7fe48419d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:19:42.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.597+0000 7fe4891ff700 1 -- 172.21.15.82:0/1124314856 >> 172.21.15.82:0/1124314856 conn(0x7fe4840fc390 msgr2=0x7fe4840fd000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:19:42.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.597+0000 7fe4891ff700 1 -- 172.21.15.82:0/1124314856 shutdown_connections 2023-09-23T09:19:42.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:19:42.597+0000 7fe4891ff700 1 -- 172.21.15.82:0/1124314856 wait complete. 2023-09-23T09:19:42.614 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:19:42 smithi082 ceph-mon[97694]: pgmap v719: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 347 op/s 2023-09-23T09:19:42.617 INFO:tasks.cephfs.filesystem:scrub status for tag:047cbc72-e254-4787-b038-382de9c1a9a4 - {'path': '/', 'tag': '047cbc72-e254-4787-b038-382de9c1a9a4', 'options': 'recursive,force'} 2023-09-23T09:19:42.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:19:42 smithi135 ceph-mon[99205]: pgmap v719: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 347 op/s 2023-09-23T09:19:42.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:19:42 smithi161 ceph-mon[99580]: pgmap v719: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 347 op/s 2023-09-23T09:19:43.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:19:43 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:19:43.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:19:43 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:19:43.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:19:43 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:19:43.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:19:43 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:19:43.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:19:43 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:19:43.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:19:43 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:19:43.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:19:43 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:19:43.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:19:43 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:19:43.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:19:43 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:19:44.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:19:44 smithi135 ceph-mon[99205]: pgmap v720: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 347 op/s 2023-09-23T09:19:44.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:19:44 smithi082 ceph-mon[97694]: pgmap v720: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 347 op/s 2023-09-23T09:19:44.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:19:44 smithi161 ceph-mon[99580]: pgmap v720: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 347 op/s 2023-09-23T09:19:46.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:19:46 smithi135 ceph-mon[99205]: pgmap v721: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.9 MiB/s wr, 535 op/s 2023-09-23T09:19:46.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:19:46 smithi161 ceph-mon[99580]: pgmap v721: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.9 MiB/s wr, 535 op/s 2023-09-23T09:19:46.954 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:19:46 smithi082 ceph-mon[97694]: pgmap v721: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.9 MiB/s wr, 535 op/s 2023-09-23T09:19:48.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:19:47 smithi135 ceph-mon[99205]: pgmap v722: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 366 op/s 2023-09-23T09:19:48.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:19:47 smithi082 ceph-mon[97694]: pgmap v722: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 366 op/s 2023-09-23T09:19:48.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:19:47 smithi161 ceph-mon[99580]: pgmap v722: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 366 op/s 2023-09-23T09:19:50.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:19:50 smithi135 ceph-mon[99205]: pgmap v723: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.0 MiB/s wr, 552 op/s 2023-09-23T09:19:50.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:19:50 smithi082 ceph-mon[97694]: pgmap v723: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.0 MiB/s wr, 552 op/s 2023-09-23T09:19:50.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:19:50 smithi161 ceph-mon[99580]: pgmap v723: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.0 MiB/s wr, 552 op/s 2023-09-23T09:19:52.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:19:52 smithi135 ceph-mon[99205]: pgmap v724: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 373 op/s 2023-09-23T09:19:52.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:19:52 smithi082 ceph-mon[97694]: pgmap v724: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 373 op/s 2023-09-23T09:19:52.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:19:52 smithi161 ceph-mon[99580]: pgmap v724: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 373 op/s 2023-09-23T09:19:54.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:19:54 smithi135 ceph-mon[99205]: pgmap v725: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 373 op/s 2023-09-23T09:19:54.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:19:54 smithi082 ceph-mon[97694]: pgmap v725: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 373 op/s 2023-09-23T09:19:54.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:19:54 smithi161 ceph-mon[99580]: pgmap v725: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 373 op/s 2023-09-23T09:19:56.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:19:56 smithi135 ceph-mon[99205]: pgmap v726: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.8 MiB/s wr, 531 op/s 2023-09-23T09:19:56.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:19:56 smithi082 ceph-mon[97694]: pgmap v726: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.8 MiB/s wr, 531 op/s 2023-09-23T09:19:56.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:19:56 smithi161 ceph-mon[99580]: pgmap v726: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.8 MiB/s wr, 531 op/s 2023-09-23T09:19:58.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:19:57 smithi082 ceph-mon[97694]: pgmap v727: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 343 op/s 2023-09-23T09:19:58.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:19:57 smithi161 ceph-mon[99580]: pgmap v727: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 343 op/s 2023-09-23T09:19:58.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:19:57 smithi135 ceph-mon[99205]: pgmap v727: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 343 op/s 2023-09-23T09:20:00.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:20:00 smithi135 ceph-mon[99205]: pgmap v728: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.8 MiB/s wr, 524 op/s 2023-09-23T09:20:00.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:20:00 smithi135 ceph-mon[99205]: overall HEALTH_OK 2023-09-23T09:20:00.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:20:00 smithi082 ceph-mon[97694]: pgmap v728: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.8 MiB/s wr, 524 op/s 2023-09-23T09:20:00.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:20:00 smithi082 ceph-mon[97694]: overall HEALTH_OK 2023-09-23T09:20:00.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:20:00 smithi161 ceph-mon[99580]: pgmap v728: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.8 MiB/s wr, 524 op/s 2023-09-23T09:20:00.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:20:00 smithi161 ceph-mon[99580]: overall HEALTH_OK 2023-09-23T09:20:02.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:20:02 smithi135 ceph-mon[99205]: pgmap v729: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 339 op/s 2023-09-23T09:20:02.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:20:02 smithi082 ceph-mon[97694]: pgmap v729: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 339 op/s 2023-09-23T09:20:02.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:20:02 smithi161 ceph-mon[99580]: pgmap v729: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 339 op/s 2023-09-23T09:20:04.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:20:04 smithi135 ceph-mon[99205]: pgmap v730: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 339 op/s 2023-09-23T09:20:04.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:20:04 smithi082 ceph-mon[97694]: pgmap v730: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 339 op/s 2023-09-23T09:20:04.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:20:04 smithi161 ceph-mon[99580]: pgmap v730: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 339 op/s 2023-09-23T09:20:06.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:20:06 smithi135 ceph-mon[99205]: pgmap v731: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.0 MiB/s wr, 539 op/s 2023-09-23T09:20:06.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:20:06 smithi082 ceph-mon[97694]: pgmap v731: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.0 MiB/s wr, 539 op/s 2023-09-23T09:20:06.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:20:06 smithi161 ceph-mon[99580]: pgmap v731: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.0 MiB/s wr, 539 op/s 2023-09-23T09:20:07.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:20:07 smithi135 ceph-mon[99205]: osdmap e122: 12 total, 12 up, 12 in 2023-09-23T09:20:07.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:20:07 smithi082 ceph-mon[97694]: osdmap e122: 12 total, 12 up, 12 in 2023-09-23T09:20:07.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:20:07 smithi161 ceph-mon[99580]: osdmap e122: 12 total, 12 up, 12 in 2023-09-23T09:20:08.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:20:08 smithi135 ceph-mon[99205]: pgmap v733: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.4 MiB/s wr, 456 op/s 2023-09-23T09:20:08.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:20:08 smithi082 ceph-mon[97694]: pgmap v733: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.4 MiB/s wr, 456 op/s 2023-09-23T09:20:08.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:20:08 smithi161 ceph-mon[99580]: pgmap v733: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.4 MiB/s wr, 456 op/s 2023-09-23T09:20:10.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:20:10 smithi135 ceph-mon[99205]: pgmap v734: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.4 MiB/s wr, 464 op/s 2023-09-23T09:20:10.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:20:10 smithi082 ceph-mon[97694]: pgmap v734: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.4 MiB/s wr, 464 op/s 2023-09-23T09:20:10.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:20:10 smithi161 ceph-mon[99580]: pgmap v734: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.4 MiB/s wr, 464 op/s 2023-09-23T09:20:12.618 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:20:12.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:20:12 smithi135 ceph-mon[99205]: pgmap v735: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.4 MiB/s wr, 464 op/s 2023-09-23T09:20:12.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:20:12 smithi135 ceph-mon[99205]: osdmap e123: 12 total, 12 up, 12 in 2023-09-23T09:20:12.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:20:12 smithi161 ceph-mon[99580]: pgmap v735: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.4 MiB/s wr, 464 op/s 2023-09-23T09:20:12.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:20:12 smithi161 ceph-mon[99580]: osdmap e123: 12 total, 12 up, 12 in 2023-09-23T09:20:13.081 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:20:12 smithi082 ceph-mon[97694]: pgmap v735: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.4 MiB/s wr, 464 op/s 2023-09-23T09:20:13.081 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:20:12 smithi082 ceph-mon[97694]: osdmap e123: 12 total, 12 up, 12 in 2023-09-23T09:20:13.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.709+0000 7f2a619ff700 1 -- 172.21.15.82:0/2821732907 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a5c1068a0 msgr2=0x7f2a5c106c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:20:13.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.709+0000 7f2a619ff700 1 --2- 172.21.15.82:0/2821732907 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a5c1068a0 0x7f2a5c106c80 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c0098f0 tx=0x7f2a4c009c00 comp rx=0 tx=0).stop 2023-09-23T09:20:13.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.709+0000 7f2a619ff700 1 -- 172.21.15.82:0/2821732907 shutdown_connections 2023-09-23T09:20:13.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.709+0000 7f2a619ff700 1 --2- 172.21.15.82:0/2821732907 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2a5c101250 0x7f2a5c10d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:20:13.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.709+0000 7f2a619ff700 1 --2- 172.21.15.82:0/2821732907 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a5c1068a0 0x7f2a5c106c80 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:20:13.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.709+0000 7f2a619ff700 1 --2- 172.21.15.82:0/2821732907 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2a5c100890 0x7f2a5c100d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:20:13.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.709+0000 7f2a619ff700 1 -- 172.21.15.82:0/2821732907 >> 172.21.15.82:0/2821732907 conn(0x7f2a5c0fc380 msgr2=0x7f2a5c0fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:20:13.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.709+0000 7f2a619ff700 1 -- 172.21.15.82:0/2821732907 shutdown_connections 2023-09-23T09:20:13.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.710+0000 7f2a619ff700 1 -- 172.21.15.82:0/2821732907 wait complete. 2023-09-23T09:20:13.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.711+0000 7f2a619ff700 1 Processor -- start 2023-09-23T09:20:13.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.711+0000 7f2a619ff700 1 -- start start 2023-09-23T09:20:13.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.711+0000 7f2a619ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2a5c100890 0x7f2a5c19e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:20:13.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.711+0000 7f2a619ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2a5c101250 0x7f2a5c19eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:20:13.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.711+0000 7f2a619ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a5c1068a0 0x7f2a5c198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:20:13.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.711+0000 7f2a619ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a5c199160 con 0x7f2a5c1068a0 2023-09-23T09:20:13.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.711+0000 7f2a619ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a5c1992d0 con 0x7f2a5c101250 2023-09-23T09:20:13.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.711+0000 7f2a619ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a5c199490 con 0x7f2a5c100890 2023-09-23T09:20:13.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.711+0000 7f2a5b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a5c1068a0 0x7f2a5c198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:20:13.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.711+0000 7f2a5affd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2a5c100890 0x7f2a5c19e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:20:13.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.711+0000 7f2a5affd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2a5c100890 0x7f2a5c19e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:46556/0 (socket says 172.21.15.82:46556) 2023-09-23T09:20:13.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.711+0000 7f2a5b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a5c1068a0 0x7f2a5c198990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59634/0 (socket says 172.21.15.82:59634) 2023-09-23T09:20:13.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.712+0000 7f2a5affd700 1 -- 172.21.15.82:0/161591193 learned_addr learned my addr 172.21.15.82:0/161591193 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:20:13.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.712+0000 7f2a5a7fc700 1 --2- 172.21.15.82:0/161591193 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2a5c101250 0x7f2a5c19eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:20:13.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.712+0000 7f2a5b7fe700 1 -- 172.21.15.82:0/161591193 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2a5c100890 msgr2=0x7f2a5c19e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:20:13.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.712+0000 7f2a5b7fe700 1 --2- 172.21.15.82:0/161591193 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2a5c100890 0x7f2a5c19e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:20:13.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.712+0000 7f2a5b7fe700 1 -- 172.21.15.82:0/161591193 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2a5c101250 msgr2=0x7f2a5c19eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:20:13.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.712+0000 7f2a5b7fe700 1 --2- 172.21.15.82:0/161591193 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2a5c101250 0x7f2a5c19eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:20:13.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.712+0000 7f2a5b7fe700 1 -- 172.21.15.82:0/161591193 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a54009d00 con 0x7f2a5c1068a0 2023-09-23T09:20:13.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.712+0000 7f2a5b7fe700 1 --2- 172.21.15.82:0/161591193 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a5c1068a0 0x7f2a5c198990 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f2a54009cd0 tx=0x7f2a5400c620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:20:13.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.712+0000 7f2a609fd700 1 -- 172.21.15.82:0/161591193 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a54017070 con 0x7f2a5c1068a0 2023-09-23T09:20:13.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.712+0000 7f2a619ff700 1 -- 172.21.15.82:0/161591193 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a4c009520 con 0x7f2a5c1068a0 2023-09-23T09:20:13.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.712+0000 7f2a609fd700 1 -- 172.21.15.82:0/161591193 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2a5400f040 con 0x7f2a5c1068a0 2023-09-23T09:20:13.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.712+0000 7f2a609fd700 1 -- 172.21.15.82:0/161591193 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a5400e050 con 0x7f2a5c1068a0 2023-09-23T09:20:13.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.713+0000 7f2a619ff700 1 -- 172.21.15.82:0/161591193 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a5c1a5930 con 0x7f2a5c1068a0 2023-09-23T09:20:13.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.715+0000 7f2a609fd700 1 -- 172.21.15.82:0/161591193 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f2a5400cd10 con 0x7f2a5c1068a0 2023-09-23T09:20:13.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.717+0000 7f2a609fd700 1 --2- 172.21.15.82:0/161591193 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f2a440a0140 0x7f2a440a2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:20:13.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.717+0000 7f2a609fd700 1 -- 172.21.15.82:0/161591193 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f2a540caf10 con 0x7f2a5c1068a0 2023-09-23T09:20:13.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.717+0000 7f2a5affd700 1 --2- 172.21.15.82:0/161591193 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f2a440a0140 0x7f2a440a2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:20:13.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.718+0000 7f2a5affd700 1 --2- 172.21.15.82:0/161591193 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f2a440a0140 0x7f2a440a2600 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c009fd0 tx=0x7f2a4c019040 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:20:13.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.747+0000 7f2a7532cb80 1 Processor -- start 2023-09-23T09:20:13.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.747+0000 7f2a7532cb80 1 -- start start 2023-09-23T09:20:13.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.748+0000 7f2a7532cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55684198d380 0x55684198d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:20:13.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.748+0000 7f2a7532cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55684198dca0 0x556841987700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:20:13.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.748+0000 7f2a7532cb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556841987c40 0x5568419880a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:20:13.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.748+0000 7f2a7532cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568418ef7b0 con 0x55684198d380 2023-09-23T09:20:13.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.748+0000 7f2a7532cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568418e0780 con 0x55684198dca0 2023-09-23T09:20:13.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.748+0000 7f2a7532cb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568418de0a0 con 0x556841987c40 2023-09-23T09:20:13.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.748+0000 7f2a5affd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55684198d380 0x55684198d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:20:13.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.748+0000 7f2a5a7fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55684198dca0 0x556841987700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:20:13.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.748+0000 7f2a5affd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55684198d380 0x55684198d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59638/0 (socket says 172.21.15.82:59638) 2023-09-23T09:20:13.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.748+0000 7f2a5affd700 1 -- 172.21.15.82:0/3108483302 learned_addr learned my addr 172.21.15.82:0/3108483302 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:20:13.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.748+0000 7f2a5b7fe700 1 --2- 172.21.15.82:0/3108483302 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556841987c40 0x5568419880a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:20:13.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.748+0000 7f2a5affd700 1 -- 172.21.15.82:0/3108483302 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556841987c40 msgr2=0x5568419880a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:20:13.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.748+0000 7f2a5affd700 1 --2- 172.21.15.82:0/3108483302 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556841987c40 0x5568419880a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:20:13.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.749+0000 7f2a5affd700 1 -- 172.21.15.82:0/3108483302 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55684198dca0 msgr2=0x556841987700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:20:13.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.749+0000 7f2a5affd700 1 --2- 172.21.15.82:0/3108483302 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55684198dca0 0x556841987700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:20:13.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.749+0000 7f2a5affd700 1 -- 172.21.15.82:0/3108483302 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556841759630 con 0x55684198d380 2023-09-23T09:20:13.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.749+0000 7f2a5b7fe700 1 --2- 172.21.15.82:0/3108483302 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556841987c40 0x5568419880a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:20:13.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.749+0000 7f2a5affd700 1 --2- 172.21.15.82:0/3108483302 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55684198d380 0x55684198d760 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c00ff40 tx=0x7f2a4c01e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=287b35bfc01f34ad server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:20:13.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.749+0000 7f2a41ffb700 1 -- 172.21.15.82:0/3108483302 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4c00f760 con 0x55684198d380 2023-09-23T09:20:13.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.749+0000 7f2a41ffb700 1 -- 172.21.15.82:0/3108483302 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2a4c01d040 con 0x55684198d380 2023-09-23T09:20:13.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.749+0000 7f2a41ffb700 1 -- 172.21.15.82:0/3108483302 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4c005660 con 0x55684198d380 2023-09-23T09:20:13.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.750+0000 7f2a7532cb80 1 -- 172.21.15.82:0/3108483302 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55684198d380 msgr2=0x55684198d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:20:13.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.750+0000 7f2a7532cb80 1 --2- 172.21.15.82:0/3108483302 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55684198d380 0x55684198d760 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c00ff40 tx=0x7f2a4c01e000 comp rx=0 tx=0).stop 2023-09-23T09:20:13.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.750+0000 7f2a7532cb80 1 -- 172.21.15.82:0/3108483302 shutdown_connections 2023-09-23T09:20:13.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.750+0000 7f2a7532cb80 1 --2- 172.21.15.82:0/3108483302 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556841987c40 0x5568419880a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:20:13.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.750+0000 7f2a7532cb80 1 --2- 172.21.15.82:0/3108483302 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55684198d380 0x55684198d760 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:20:13.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.750+0000 7f2a7532cb80 1 --2- 172.21.15.82:0/3108483302 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55684198dca0 0x556841987700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:20:13.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.750+0000 7f2a7532cb80 1 -- 172.21.15.82:0/3108483302 >> 172.21.15.82:0/3108483302 conn(0x5568418fc0e0 msgr2=0x556841982410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:20:13.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.750+0000 7f2a7532cb80 1 -- 172.21.15.82:0/3108483302 shutdown_connections 2023-09-23T09:20:13.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.750+0000 7f2a7532cb80 1 -- 172.21.15.82:0/3108483302 wait complete. 2023-09-23T09:20:13.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.751+0000 7f2a7532cb80 1 -- start start 2023-09-23T09:20:13.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.751+0000 7f2a7532cb80 1 Processor -- start 2023-09-23T09:20:13.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.751+0000 7f2a7532cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556841987c40 0x556841993c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:20:13.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.751+0000 7f2a7532cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55684198d380 0x556841990ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:20:13.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.751+0000 7f2a7532cb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55684198dca0 0x556841991610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:20:13.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.751+0000 7f2a7532cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568418d9990 con 0x556841987c40 2023-09-23T09:20:13.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.751+0000 7f2a7532cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x556841877bb0 con 0x55684198d380 2023-09-23T09:20:13.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.751+0000 7f2a7532cb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568418778b0 con 0x55684198dca0 2023-09-23T09:20:13.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.751+0000 7f2a7532cb80 10 client.0 _ll_register_callbacks cb 0x5568417c1a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:20:13.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.752+0000 7f2a5a7fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55684198d380 0x556841990ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:20:13.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.752+0000 7f2a5affd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556841987c40 0x556841993c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:20:13.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.752+0000 7f2a5a7fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55684198d380 0x556841990ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:41294/0 (socket says 172.21.15.82:41294) 2023-09-23T09:20:13.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.752+0000 7f2a5a7fc700 1 -- 172.21.15.82:0/1457657810 learned_addr learned my addr 172.21.15.82:0/1457657810 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:20:13.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.752+0000 7f2a5b7fe700 1 --2- 172.21.15.82:0/1457657810 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55684198dca0 0x556841991610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:20:13.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.752+0000 7f2a5affd700 1 -- 172.21.15.82:0/1457657810 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55684198dca0 msgr2=0x556841991610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:20:13.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.752+0000 7f2a5affd700 1 --2- 172.21.15.82:0/1457657810 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55684198dca0 0x556841991610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:20:13.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.752+0000 7f2a5affd700 1 -- 172.21.15.82:0/1457657810 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55684198d380 msgr2=0x556841990ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:20:13.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.752+0000 7f2a5affd700 1 --2- 172.21.15.82:0/1457657810 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55684198d380 0x556841990ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:20:13.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.752+0000 7f2a5affd700 1 -- 172.21.15.82:0/1457657810 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a5c1a5930 con 0x556841987c40 2023-09-23T09:20:13.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.752+0000 7f2a5affd700 1 --2- 172.21.15.82:0/1457657810 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556841987c40 0x556841993c50 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c0098c0 tx=0x7f2a4c005490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5680a188d402b70 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:20:13.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.752+0000 7f2a3affd700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:20:13.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.753+0000 7f2a3affd700 1 -- 172.21.15.82:0/1457657810 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4c00b770 con 0x556841987c40 2023-09-23T09:20:13.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.753+0000 7f2a7532cb80 1 -- 172.21.15.82:0/1457657810 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5568419571c0 con 0x556841987c40 2023-09-23T09:20:13.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.753+0000 7f2a3affd700 1 -- 172.21.15.82:0/1457657810 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(123..123 src has 1..123) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f2a4c00b8d0 con 0x556841987c40 2023-09-23T09:20:13.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.753+0000 7f2a3affd700 1 -- 172.21.15.82:0/1457657810 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=76) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2a4c00ba90 con 0x556841987c40 2023-09-23T09:20:13.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.753+0000 7f2a7532cb80 10 client.16965 fetch_fsmap learned FSMap version 76 2023-09-23T09:20:13.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.753+0000 7f2a7532cb80 1 -- 172.21.15.82:0/1457657810 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=76,monmap=4+}) v3 -- 0x7f2a5c10e060 con 0x556841987c40 2023-09-23T09:20:13.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.753+0000 7f2a3affd700 1 -- 172.21.15.82:0/1457657810 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5568419571c0 con 0x556841987c40 2023-09-23T09:20:13.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.753+0000 7f2a3affd700 1 -- 172.21.15.82:0/1457657810 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 76) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f2a4c036030 con 0x556841987c40 2023-09-23T09:20:13.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.754+0000 7f2a7532cb80 10 client.16965 fetch_fsmap finished waiting for FSMap version 76 2023-09-23T09:20:13.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.754+0000 7f2a7532cb80 10 client.16965 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:20:13.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.754+0000 7f2a7532cb80 20 client.16965 populate_metadata read hostname 'smithi082' 2023-09-23T09:20:13.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.754+0000 7f2a7532cb80 1 --2- 172.21.15.82:0/1457657810 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5568419a11f0 0x5568419a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:20:13.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.754+0000 7f2a7532cb80 4 client.16965 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:20:13.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.754+0000 7f2a7532cb80 1 -- 172.21.15.82:0/1457657810 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55684187fba0 con 0x5568419a11f0 2023-09-23T09:20:13.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.754+0000 7f2a5a7fc700 1 --2- 172.21.15.82:0/1457657810 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5568419a11f0 0x5568419a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:20:13.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.754+0000 7f2a3affd700 10 client.16965 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:20:13.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.754+0000 7f2a5a7fc700 1 --2- 172.21.15.82:0/1457657810 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5568419a11f0 0x5568419a35e0 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d2183c4ea1e1022f server_cookie=7e63f6a8b01f91be in_seq=0 out_seq=0 2023-09-23T09:20:13.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.755+0000 7f2a3affd700 1 -- 172.21.15.82:0/1457657810 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55684187fba0 con 0x5568419a11f0 2023-09-23T09:20:13.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.755+0000 7f2a3affd700 10 client.16965 handle_command_reply: tid=0 2023-09-23T09:20:13.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.755+0000 7f2a7532cb80 1 client.16965 shutdown 2023-09-23T09:20:13.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.756+0000 7f2a7532cb80 1 -- 172.21.15.82:0/1457657810 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556841987c40 msgr2=0x556841993c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:20:13.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.756+0000 7f2a7532cb80 1 --2- 172.21.15.82:0/1457657810 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556841987c40 0x556841993c50 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c0098c0 tx=0x7f2a4c005490 comp rx=0 tx=0).stop 2023-09-23T09:20:13.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.756+0000 7f2a7532cb80 1 -- 172.21.15.82:0/1457657810 shutdown_connections 2023-09-23T09:20:13.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.756+0000 7f2a7532cb80 1 --2- 172.21.15.82:0/1457657810 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55684198dca0 0x556841991610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:20:13.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.756+0000 7f2a7532cb80 1 --2- 172.21.15.82:0/1457657810 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5568419a11f0 0x5568419a35e0 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:20:13.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.756+0000 7f2a7532cb80 1 --2- 172.21.15.82:0/1457657810 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556841987c40 0x556841993c50 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:20:13.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.756+0000 7f2a7532cb80 1 --2- 172.21.15.82:0/1457657810 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55684198d380 0x556841990ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:20:13.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.756+0000 7f2a3affd700 0 client.16965 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:20:13.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.756+0000 7f2a7532cb80 1 -- 172.21.15.82:0/1457657810 >> 172.21.15.82:0/1457657810 conn(0x5568418fc0e0 msgr2=0x55684197cb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:20:13.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.756+0000 7f2a7532cb80 1 -- 172.21.15.82:0/1457657810 shutdown_connections 2023-09-23T09:20:13.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.756+0000 7f2a7532cb80 1 -- 172.21.15.82:0/1457657810 wait complete. 2023-09-23T09:20:13.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.756+0000 7f2a7532cb80 20 client.16965 trim_cache size 0 max 16384 2023-09-23T09:20:13.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.774+0000 7f2a7532cb80 1 Processor -- start 2023-09-23T09:20:13.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.774+0000 7f2a7532cb80 1 -- start start 2023-09-23T09:20:13.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.774+0000 7f2a7532cb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556841987c40 0x5568419937f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:20:13.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.775+0000 7f2a7532cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55684198d380 0x55684198b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:20:13.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.775+0000 7f2a7532cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55684198dca0 0x55684198b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:20:13.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.775+0000 7f2a7532cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55684175b920 con 0x55684198d380 2023-09-23T09:20:13.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.775+0000 7f2a7532cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568419924b0 con 0x55684198dca0 2023-09-23T09:20:13.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.775+0000 7f2a7532cb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55684197ec80 con 0x556841987c40 2023-09-23T09:20:13.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.775+0000 7f2a5a7fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55684198d380 0x55684198b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:20:13.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.775+0000 7f2a5a7fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55684198d380 0x55684198b010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59658/0 (socket says 172.21.15.82:59658) 2023-09-23T09:20:13.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.775+0000 7f2a5a7fc700 1 -- 172.21.15.82:0/1429221337 learned_addr learned my addr 172.21.15.82:0/1429221337 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:20:13.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.775+0000 7f2a5affd700 1 --2- 172.21.15.82:0/1429221337 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556841987c40 0x5568419937f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:20:13.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.775+0000 7f2a5b7fe700 1 --2- 172.21.15.82:0/1429221337 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55684198dca0 0x55684198b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:20:13.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.775+0000 7f2a5a7fc700 1 -- 172.21.15.82:0/1429221337 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556841987c40 msgr2=0x5568419937f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:20:13.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.775+0000 7f2a5a7fc700 1 --2- 172.21.15.82:0/1429221337 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556841987c40 0x5568419937f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:20:13.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.775+0000 7f2a5a7fc700 1 -- 172.21.15.82:0/1429221337 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55684198dca0 msgr2=0x55684198b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:20:13.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.775+0000 7f2a5a7fc700 1 --2- 172.21.15.82:0/1429221337 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55684198dca0 0x55684198b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:20:13.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.775+0000 7f2a5a7fc700 1 -- 172.21.15.82:0/1429221337 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556841705de0 con 0x55684198d380 2023-09-23T09:20:13.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.775+0000 7f2a5a7fc700 1 --2- 172.21.15.82:0/1429221337 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55684198d380 0x55684198b010 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x5568419a3ef0 tx=0x7f2a50009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c043c9a4c3caccc1 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:20:13.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.776+0000 7f2a427fc700 1 -- 172.21.15.82:0/1429221337 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a50017070 con 0x55684198d380 2023-09-23T09:20:13.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.776+0000 7f2a427fc700 1 -- 172.21.15.82:0/1429221337 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2a50018040 con 0x55684198d380 2023-09-23T09:20:13.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.776+0000 7f2a427fc700 1 -- 172.21.15.82:0/1429221337 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a50010690 con 0x55684198d380 2023-09-23T09:20:13.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.776+0000 7f2a7532cb80 1 -- 172.21.15.82:0/1429221337 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55684198d380 msgr2=0x55684198b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:20:13.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.776+0000 7f2a7532cb80 1 --2- 172.21.15.82:0/1429221337 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55684198d380 0x55684198b010 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x5568419a3ef0 tx=0x7f2a50009260 comp rx=0 tx=0).stop 2023-09-23T09:20:13.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.776+0000 7f2a7532cb80 1 -- 172.21.15.82:0/1429221337 shutdown_connections 2023-09-23T09:20:13.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.776+0000 7f2a7532cb80 1 --2- 172.21.15.82:0/1429221337 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55684198dca0 0x55684198b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:20:13.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.776+0000 7f2a7532cb80 1 --2- 172.21.15.82:0/1429221337 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556841987c40 0x5568419937f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:20:13.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.776+0000 7f2a7532cb80 1 --2- 172.21.15.82:0/1429221337 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55684198d380 0x55684198b010 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:20:13.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.776+0000 7f2a7532cb80 1 -- 172.21.15.82:0/1429221337 >> 172.21.15.82:0/1429221337 conn(0x5568418fc0e0 msgr2=0x55684199da70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:20:13.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.777+0000 7f2a7532cb80 1 -- 172.21.15.82:0/1429221337 shutdown_connections 2023-09-23T09:20:13.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.777+0000 7f2a7532cb80 1 -- 172.21.15.82:0/1429221337 wait complete. 2023-09-23T09:20:13.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.777+0000 7f2a7532cb80 1 -- start start 2023-09-23T09:20:13.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.777+0000 7f2a7532cb80 1 Processor -- start 2023-09-23T09:20:13.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.778+0000 7f2a7532cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556841987c40 0x55684198a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:20:13.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.778+0000 7f2a7532cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55684198d380 0x556841988e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:20:13.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.778+0000 7f2a7532cb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55684198dca0 0x556841989340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:20:13.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.778+0000 7f2a7532cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x556841989880 con 0x556841987c40 2023-09-23T09:20:13.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.778+0000 7f2a7532cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568419899f0 con 0x55684198d380 2023-09-23T09:20:13.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.778+0000 7f2a7532cb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x556841989bb0 con 0x55684198dca0 2023-09-23T09:20:13.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.778+0000 7f2a7532cb80 10 client.0 _ll_register_callbacks cb 0x7f2a50009830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:20:13.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.778+0000 7f2a5a7fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55684198d380 0x556841988e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:20:13.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.778+0000 7f2a5affd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556841987c40 0x55684198a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:20:13.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.778+0000 7f2a5a7fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55684198d380 0x556841988e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:41304/0 (socket says 172.21.15.82:41304) 2023-09-23T09:20:13.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.778+0000 7f2a5a7fc700 1 -- 172.21.15.82:0/2166879672 learned_addr learned my addr 172.21.15.82:0/2166879672 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:20:13.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.778+0000 7f2a5b7fe700 1 --2- 172.21.15.82:0/2166879672 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55684198dca0 0x556841989340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:20:13.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.778+0000 7f2a5affd700 1 -- 172.21.15.82:0/2166879672 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55684198dca0 msgr2=0x556841989340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:20:13.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.778+0000 7f2a5affd700 1 --2- 172.21.15.82:0/2166879672 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55684198dca0 0x556841989340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:20:13.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.778+0000 7f2a5affd700 1 -- 172.21.15.82:0/2166879672 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55684198d380 msgr2=0x556841988e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:20:13.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.778+0000 7f2a5affd700 1 --2- 172.21.15.82:0/2166879672 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55684198d380 0x556841988e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:20:13.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.778+0000 7f2a5affd700 1 -- 172.21.15.82:0/2166879672 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a50009b70 con 0x556841987c40 2023-09-23T09:20:13.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.778+0000 7f2a5a7fc700 1 --2- 172.21.15.82:0/2166879672 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55684198d380 0x556841988e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:20:13.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.779+0000 7f2a5affd700 1 --2- 172.21.15.82:0/2166879672 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556841987c40 0x55684198a5c0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c009810 tx=0x7f2a4c0418c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88687680e2d89bc1 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:20:13.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.779+0000 7f2a3affd700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:20:13.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.779+0000 7f2a3affd700 1 -- 172.21.15.82:0/2166879672 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4c029070 con 0x556841987c40 2023-09-23T09:20:13.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.779+0000 7f2a3affd700 1 -- 172.21.15.82:0/2166879672 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(123..123 src has 1..123) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f2a4c041c70 con 0x556841987c40 2023-09-23T09:20:13.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.779+0000 7f2a7532cb80 1 -- 172.21.15.82:0/2166879672 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55684197a8b0 con 0x556841987c40 2023-09-23T09:20:13.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.779+0000 7f2a3affd700 1 -- 172.21.15.82:0/2166879672 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=76) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2a4c041e30 con 0x556841987c40 2023-09-23T09:20:13.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.779+0000 7f2a7532cb80 10 client.16971 fetch_fsmap learned FSMap version 76 2023-09-23T09:20:13.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.779+0000 7f2a7532cb80 1 -- 172.21.15.82:0/2166879672 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=76,monmap=4+}) v3 -- 0x5568416eec60 con 0x556841987c40 2023-09-23T09:20:13.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.779+0000 7f2a3affd700 1 -- 172.21.15.82:0/2166879672 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2a4c04e020 con 0x556841987c40 2023-09-23T09:20:13.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.780+0000 7f2a3affd700 1 -- 172.21.15.82:0/2166879672 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 76) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f2a4c015020 con 0x556841987c40 2023-09-23T09:20:13.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.780+0000 7f2a7532cb80 10 client.16971 fetch_fsmap finished waiting for FSMap version 76 2023-09-23T09:20:13.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.780+0000 7f2a7532cb80 10 client.16971 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:20:13.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.780+0000 7f2a7532cb80 20 client.16971 populate_metadata read hostname 'smithi082' 2023-09-23T09:20:13.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.780+0000 7f2a7532cb80 1 --2- 172.21.15.82:0/2166879672 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5568419f5ff0 0x5568419f8410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:20:13.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.780+0000 7f2a7532cb80 4 client.16971 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:20:13.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.780+0000 7f2a7532cb80 1 -- 172.21.15.82:0/2166879672 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5568418d2970 con 0x5568419f5ff0 2023-09-23T09:20:13.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.780+0000 7f2a5a7fc700 1 --2- 172.21.15.82:0/2166879672 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5568419f5ff0 0x5568419f8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:20:13.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.781+0000 7f2a5a7fc700 1 --2- 172.21.15.82:0/2166879672 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5568419f5ff0 0x5568419f8410 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9cc2035197ca580b server_cookie=909027f38e1f86b7 in_seq=0 out_seq=0 2023-09-23T09:20:13.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.781+0000 7f2a3affd700 10 client.16971 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:20:13.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.781+0000 7f2a3affd700 1 -- 172.21.15.82:0/2166879672 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x5568418d2970 con 0x5568419f5ff0 2023-09-23T09:20:13.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.781+0000 7f2a3affd700 10 client.16971 handle_command_reply: tid=0 2023-09-23T09:20:13.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.781+0000 7f2a7532cb80 1 client.16971 shutdown 2023-09-23T09:20:13.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.781+0000 7f2a7532cb80 1 -- 172.21.15.82:0/2166879672 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556841987c40 msgr2=0x55684198a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:20:13.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.781+0000 7f2a7532cb80 1 --2- 172.21.15.82:0/2166879672 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556841987c40 0x55684198a5c0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c009810 tx=0x7f2a4c0418c0 comp rx=0 tx=0).stop 2023-09-23T09:20:13.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.781+0000 7f2a7532cb80 1 -- 172.21.15.82:0/2166879672 shutdown_connections 2023-09-23T09:20:13.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.781+0000 7f2a7532cb80 1 --2- 172.21.15.82:0/2166879672 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55684198dca0 0x556841989340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:20:13.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.781+0000 7f2a7532cb80 1 --2- 172.21.15.82:0/2166879672 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5568419f5ff0 0x5568419f8410 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:20:13.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.781+0000 7f2a7532cb80 1 --2- 172.21.15.82:0/2166879672 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556841987c40 0x55684198a5c0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:20:13.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.781+0000 7f2a7532cb80 1 --2- 172.21.15.82:0/2166879672 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55684198d380 0x556841988e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:20:13.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.781+0000 7f2a3affd700 0 client.16971 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:20:13.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.781+0000 7f2a7532cb80 1 -- 172.21.15.82:0/2166879672 >> 172.21.15.82:0/2166879672 conn(0x5568418fc0e0 msgr2=0x55684198b010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:20:13.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.781+0000 7f2a7532cb80 1 -- 172.21.15.82:0/2166879672 shutdown_connections 2023-09-23T09:20:13.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.781+0000 7f2a7532cb80 1 -- 172.21.15.82:0/2166879672 wait complete. 2023-09-23T09:20:13.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.781+0000 7f2a7532cb80 20 client.16971 trim_cache size 0 max 16384 2023-09-23T09:20:13.791 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:20:13.791 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-23T09:20:13.791 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:20:13.791 INFO:teuthology.orchestra.run.smithi082.stdout: "047cbc72-e254-4787-b038-382de9c1a9a4": { 2023-09-23T09:20:13.791 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:20:13.791 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "047cbc72-e254-4787-b038-382de9c1a9a4", 2023-09-23T09:20:13.792 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:20:13.792 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:20:13.792 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:20:13.792 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:20:13.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.782+0000 7f2a619ff700 1 -- 172.21.15.82:0/161591193 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f2a440a0140 msgr2=0x7f2a440a2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:20:13.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.782+0000 7f2a619ff700 1 --2- 172.21.15.82:0/161591193 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f2a440a0140 0x7f2a440a2600 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c009fd0 tx=0x7f2a4c019040 comp rx=0 tx=0).stop 2023-09-23T09:20:13.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.782+0000 7f2a619ff700 1 -- 172.21.15.82:0/161591193 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a5c1068a0 msgr2=0x7f2a5c198990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:20:13.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.782+0000 7f2a619ff700 1 --2- 172.21.15.82:0/161591193 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a5c1068a0 0x7f2a5c198990 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f2a54009cd0 tx=0x7f2a5400c620 comp rx=0 tx=0).stop 2023-09-23T09:20:13.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.782+0000 7f2a619ff700 1 -- 172.21.15.82:0/161591193 shutdown_connections 2023-09-23T09:20:13.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.782+0000 7f2a619ff700 1 --2- 172.21.15.82:0/161591193 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f2a440a0140 0x7f2a440a2600 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:20:13.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.782+0000 7f2a619ff700 1 --2- 172.21.15.82:0/161591193 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a5c1068a0 0x7f2a5c198990 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:20:13.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.782+0000 7f2a619ff700 1 --2- 172.21.15.82:0/161591193 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2a5c100890 0x7f2a5c19e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:20:13.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.782+0000 7f2a619ff700 1 --2- 172.21.15.82:0/161591193 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2a5c101250 0x7f2a5c19eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:20:13.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.782+0000 7f2a619ff700 1 -- 172.21.15.82:0/161591193 >> 172.21.15.82:0/161591193 conn(0x7f2a5c0fc380 msgr2=0x7f2a5c10bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:20:13.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.782+0000 7f2a619ff700 1 -- 172.21.15.82:0/161591193 shutdown_connections 2023-09-23T09:20:13.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:13.782+0000 7f2a619ff700 1 -- 172.21.15.82:0/161591193 wait complete. 2023-09-23T09:20:13.803 INFO:tasks.cephfs.filesystem:scrub status for tag:047cbc72-e254-4787-b038-382de9c1a9a4 - {'path': '/', 'tag': '047cbc72-e254-4787-b038-382de9c1a9a4', 'options': 'recursive,force'} 2023-09-23T09:20:14.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:20:14 smithi135 ceph-mon[99205]: pgmap v737: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 281 op/s 2023-09-23T09:20:14.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:20:14 smithi082 ceph-mon[97694]: pgmap v737: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 281 op/s 2023-09-23T09:20:14.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:20:14 smithi161 ceph-mon[99580]: pgmap v737: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 281 op/s 2023-09-23T09:20:16.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:20:16 smithi135 ceph-mon[99205]: pgmap v738: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.6 MiB/s wr, 500 op/s 2023-09-23T09:20:16.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:20:16 smithi082 ceph-mon[97694]: pgmap v738: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.6 MiB/s wr, 500 op/s 2023-09-23T09:20:16.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:20:16 smithi161 ceph-mon[99580]: pgmap v738: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.6 MiB/s wr, 500 op/s 2023-09-23T09:20:18.144 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:20:17 smithi082 ceph-mon[97694]: pgmap v739: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.3 MiB/s wr, 447 op/s 2023-09-23T09:20:18.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:20:17 smithi161 ceph-mon[99580]: pgmap v739: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.3 MiB/s wr, 447 op/s 2023-09-23T09:20:18.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:20:17 smithi135 ceph-mon[99205]: pgmap v739: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.3 MiB/s wr, 447 op/s 2023-09-23T09:20:20.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:20:20 smithi135 ceph-mon[99205]: pgmap v740: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.4 MiB/s wr, 463 op/s 2023-09-23T09:20:20.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:20:20 smithi082 ceph-mon[97694]: pgmap v740: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.4 MiB/s wr, 463 op/s 2023-09-23T09:20:20.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:20:20 smithi161 ceph-mon[99580]: pgmap v740: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.4 MiB/s wr, 463 op/s 2023-09-23T09:20:22.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:20:22 smithi135 ceph-mon[99205]: pgmap v741: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.4 MiB/s wr, 463 op/s 2023-09-23T09:20:22.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:20:22 smithi082 ceph-mon[97694]: pgmap v741: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.4 MiB/s wr, 463 op/s 2023-09-23T09:20:22.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:20:22 smithi161 ceph-mon[99580]: pgmap v741: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.4 MiB/s wr, 463 op/s 2023-09-23T09:20:24.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:20:24 smithi135 ceph-mon[99205]: pgmap v742: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.9 MiB/s wr, 399 op/s 2023-09-23T09:20:24.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:20:24 smithi082 ceph-mon[97694]: pgmap v742: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.9 MiB/s wr, 399 op/s 2023-09-23T09:20:24.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:20:24 smithi161 ceph-mon[99580]: pgmap v742: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.9 MiB/s wr, 399 op/s 2023-09-23T09:20:26.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:20:26 smithi135 ceph-mon[99205]: pgmap v743: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.9 MiB/s wr, 543 op/s 2023-09-23T09:20:26.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:20:26 smithi082 ceph-mon[97694]: pgmap v743: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.9 MiB/s wr, 543 op/s 2023-09-23T09:20:26.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:20:26 smithi161 ceph-mon[99580]: pgmap v743: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.9 MiB/s wr, 543 op/s 2023-09-23T09:20:28.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:20:27 smithi082 ceph-mon[97694]: pgmap v744: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 358 op/s 2023-09-23T09:20:28.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:20:27 smithi161 ceph-mon[99580]: pgmap v744: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 358 op/s 2023-09-23T09:20:28.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:20:27 smithi135 ceph-mon[99205]: pgmap v744: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 358 op/s 2023-09-23T09:20:30.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:20:30 smithi135 ceph-mon[99205]: pgmap v745: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.8 MiB/s wr, 525 op/s 2023-09-23T09:20:30.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:20:30 smithi082 ceph-mon[97694]: pgmap v745: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.8 MiB/s wr, 525 op/s 2023-09-23T09:20:30.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:20:30 smithi161 ceph-mon[99580]: pgmap v745: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.8 MiB/s wr, 525 op/s 2023-09-23T09:20:32.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:20:32 smithi135 ceph-mon[99205]: pgmap v746: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 323 op/s 2023-09-23T09:20:32.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:20:32 smithi082 ceph-mon[97694]: pgmap v746: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 323 op/s 2023-09-23T09:20:32.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:20:32 smithi161 ceph-mon[99580]: pgmap v746: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 323 op/s 2023-09-23T09:20:34.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:20:34 smithi135 ceph-mon[99205]: pgmap v747: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 323 op/s 2023-09-23T09:20:34.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:20:34 smithi082 ceph-mon[97694]: pgmap v747: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 323 op/s 2023-09-23T09:20:34.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:20:34 smithi161 ceph-mon[99580]: pgmap v747: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 323 op/s 2023-09-23T09:20:36.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:20:36 smithi135 ceph-mon[99205]: pgmap v748: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.5 MiB/s wr, 485 op/s 2023-09-23T09:20:36.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:20:36 smithi082 ceph-mon[97694]: pgmap v748: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.5 MiB/s wr, 485 op/s 2023-09-23T09:20:36.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:20:36 smithi161 ceph-mon[99580]: pgmap v748: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.5 MiB/s wr, 485 op/s 2023-09-23T09:20:38.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:20:37 smithi082 ceph-mon[97694]: pgmap v749: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 328 op/s 2023-09-23T09:20:38.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:20:37 smithi161 ceph-mon[99580]: pgmap v749: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 328 op/s 2023-09-23T09:20:38.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:20:37 smithi135 ceph-mon[99205]: pgmap v749: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 328 op/s 2023-09-23T09:20:40.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:20:40 smithi135 ceph-mon[99205]: pgmap v750: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.7 MiB/s wr, 477 op/s 2023-09-23T09:20:40.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:20:40 smithi082 ceph-mon[97694]: pgmap v750: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.7 MiB/s wr, 477 op/s 2023-09-23T09:20:40.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:20:40 smithi161 ceph-mon[99580]: pgmap v750: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.7 MiB/s wr, 477 op/s 2023-09-23T09:20:42.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:20:42 smithi135 ceph-mon[99205]: pgmap v751: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.5 MiB/s wr, 310 op/s 2023-09-23T09:20:42.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:20:42 smithi082 ceph-mon[97694]: pgmap v751: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.5 MiB/s wr, 310 op/s 2023-09-23T09:20:42.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:20:42 smithi161 ceph-mon[99580]: pgmap v751: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.5 MiB/s wr, 310 op/s 2023-09-23T09:20:43.804 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:20:43.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:20:43 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:20:43.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:20:43 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:20:43.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:20:43 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:20:44.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.065+0000 7fc7de9ff700 1 -- 172.21.15.82:0/1964703916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7d81068a0 msgr2=0x7fc7d8106c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:20:44.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.065+0000 7fc7de9ff700 1 --2- 172.21.15.82:0/1964703916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7d81068a0 0x7fc7d8106c80 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fc7c8009990 tx=0x7fc7c8009ca0 comp rx=0 tx=0).stop 2023-09-23T09:20:44.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.065+0000 7fc7de9ff700 1 -- 172.21.15.82:0/1964703916 shutdown_connections 2023-09-23T09:20:44.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.065+0000 7fc7de9ff700 1 --2- 172.21.15.82:0/1964703916 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7d8101250 0x7fc7d810d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:20:44.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.065+0000 7fc7de9ff700 1 --2- 172.21.15.82:0/1964703916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7d81068a0 0x7fc7d8106c80 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:20:44.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.065+0000 7fc7de9ff700 1 --2- 172.21.15.82:0/1964703916 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7d8100890 0x7fc7d8100d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:20:44.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.065+0000 7fc7de9ff700 1 -- 172.21.15.82:0/1964703916 >> 172.21.15.82:0/1964703916 conn(0x7fc7d80fc380 msgr2=0x7fc7d80fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:20:44.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.066+0000 7fc7de9ff700 1 -- 172.21.15.82:0/1964703916 shutdown_connections 2023-09-23T09:20:44.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.066+0000 7fc7de9ff700 1 -- 172.21.15.82:0/1964703916 wait complete. 2023-09-23T09:20:44.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.066+0000 7fc7de9ff700 1 Processor -- start 2023-09-23T09:20:44.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.067+0000 7fc7de9ff700 1 -- start start 2023-09-23T09:20:44.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.067+0000 7fc7de9ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7d8100890 0x7fc7d819e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:20:44.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.067+0000 7fc7de9ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7d8101250 0x7fc7d819eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:20:44.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.067+0000 7fc7de9ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7d81068a0 0x7fc7d81988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:20:44.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.067+0000 7fc7de9ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d8198f40 con 0x7fc7d8101250 2023-09-23T09:20:44.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.067+0000 7fc7de9ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d81990b0 con 0x7fc7d81068a0 2023-09-23T09:20:44.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.067+0000 7fc7de9ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d8199270 con 0x7fc7d8100890 2023-09-23T09:20:44.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.067+0000 7fc7d77fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7d8101250 0x7fc7d819eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:20:44.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.067+0000 7fc7d77fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7d8101250 0x7fc7d819eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45402/0 (socket says 172.21.15.82:45402) 2023-09-23T09:20:44.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.067+0000 7fc7d77fe700 1 -- 172.21.15.82:0/2052592485 learned_addr learned my addr 172.21.15.82:0/2052592485 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:20:44.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.067+0000 7fc7d7fff700 1 --2- 172.21.15.82:0/2052592485 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7d8100890 0x7fc7d819e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:20:44.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.067+0000 7fc7dcf9c700 1 --2- 172.21.15.82:0/2052592485 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7d81068a0 0x7fc7d81988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:20:44.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.068+0000 7fc7d77fe700 1 -- 172.21.15.82:0/2052592485 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7d8100890 msgr2=0x7fc7d819e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:20:44.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.068+0000 7fc7d77fe700 1 --2- 172.21.15.82:0/2052592485 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7d8100890 0x7fc7d819e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:20:44.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.068+0000 7fc7d77fe700 1 -- 172.21.15.82:0/2052592485 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7d81068a0 msgr2=0x7fc7d81988d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:20:44.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.068+0000 7fc7d77fe700 1 --2- 172.21.15.82:0/2052592485 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7d81068a0 0x7fc7d81988d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:20:44.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.068+0000 7fc7d77fe700 1 -- 172.21.15.82:0/2052592485 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7c80095f0 con 0x7fc7d8101250 2023-09-23T09:20:44.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.068+0000 7fc7d77fe700 1 --2- 172.21.15.82:0/2052592485 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7d8101250 0x7fc7d819eda0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc00d950 tx=0x7fc7cc00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:20:44.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.068+0000 7fc7d57fa700 1 -- 172.21.15.82:0/2052592485 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7cc00f890 con 0x7fc7d8101250 2023-09-23T09:20:44.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.068+0000 7fc7d57fa700 1 -- 172.21.15.82:0/2052592485 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc7cc00fe80 con 0x7fc7d8101250 2023-09-23T09:20:44.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.068+0000 7fc7de9ff700 1 -- 172.21.15.82:0/2052592485 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7d8199550 con 0x7fc7d8101250 2023-09-23T09:20:44.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.068+0000 7fc7d57fa700 1 -- 172.21.15.82:0/2052592485 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7cc00e3b0 con 0x7fc7d8101250 2023-09-23T09:20:44.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.068+0000 7fc7de9ff700 1 -- 172.21.15.82:0/2052592485 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7d81a5850 con 0x7fc7d8101250 2023-09-23T09:20:44.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.072+0000 7fc7d57fa700 1 -- 172.21.15.82:0/2052592485 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7fc7cc010460 con 0x7fc7d8101250 2023-09-23T09:20:44.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.073+0000 7fc7d57fa700 1 --2- 172.21.15.82:0/2052592485 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fc7c00a0140 0x7fc7c00a2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:20:44.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.073+0000 7fc7f2251b80 1 Processor -- start 2023-09-23T09:20:44.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.073+0000 7fc7d57fa700 1 -- 172.21.15.82:0/2052592485 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fc7cc0cb3c0 con 0x7fc7d8101250 2023-09-23T09:20:44.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.073+0000 7fc7f2251b80 1 -- start start 2023-09-23T09:20:44.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.073+0000 7fc7d7fff700 1 --2- 172.21.15.82:0/2052592485 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fc7c00a0140 0x7fc7c00a2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:20:44.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.074+0000 7fc7f2251b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555c0f052380 0x555c0f052760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:20:44.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.074+0000 7fc7f2251b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c0f052ca0 0x555c0f04c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:20:44.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.074+0000 7fc7f2251b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555c0f04cc40 0x555c0f04d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:20:44.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.074+0000 7fc7f2251b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c0efb47b0 con 0x555c0f052ca0 2023-09-23T09:20:44.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.074+0000 7fc7f2251b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c0efa5780 con 0x555c0f04cc40 2023-09-23T09:20:44.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.074+0000 7fc7f2251b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c0efa30a0 con 0x555c0f052380 2023-09-23T09:20:44.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.074+0000 7fc7d77fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c0f052ca0 0x555c0f04c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:20:44.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.074+0000 7fc7dcf9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555c0f04cc40 0x555c0f04d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:20:44.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.074+0000 7fc7d77fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c0f052ca0 0x555c0f04c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45406/0 (socket says 172.21.15.82:45406) 2023-09-23T09:20:44.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.074+0000 7fc7d77fe700 1 -- 172.21.15.82:0/1256808333 learned_addr learned my addr 172.21.15.82:0/1256808333 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:20:44.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.074+0000 7fc7d7fff700 1 --2- 172.21.15.82:0/1256808333 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555c0f052380 0x555c0f052760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:20:44.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.074+0000 7fc7d7fff700 1 --2- 172.21.15.82:0/2052592485 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fc7c00a0140 0x7fc7c00a2600 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc7c8006010 tx=0x7fc7c800b260 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:20:44.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.074+0000 7fc7d77fe700 1 -- 172.21.15.82:0/1256808333 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555c0f052380 msgr2=0x555c0f052760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:20:44.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.074+0000 7fc7d77fe700 1 --2- 172.21.15.82:0/1256808333 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555c0f052380 0x555c0f052760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:20:44.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.074+0000 7fc7d77fe700 1 -- 172.21.15.82:0/1256808333 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555c0f04cc40 msgr2=0x555c0f04d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:20:44.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.074+0000 7fc7d77fe700 1 --2- 172.21.15.82:0/1256808333 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555c0f04cc40 0x555c0f04d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:20:44.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.074+0000 7fc7d77fe700 1 -- 172.21.15.82:0/1256808333 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555c0ee1e630 con 0x555c0f052ca0 2023-09-23T09:20:44.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.074+0000 7fc7dcf9c700 1 --2- 172.21.15.82:0/1256808333 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555c0f04cc40 0x555c0f04d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:20:44.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.075+0000 7fc7d77fe700 1 --2- 172.21.15.82:0/1256808333 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c0f052ca0 0x555c0f04c700 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc0954e0 tx=0x7fc7cc0984d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7241e2253dc64cc9 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:20:44.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.075+0000 7fc7be7fc700 1 -- 172.21.15.82:0/1256808333 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7cc0ad070 con 0x555c0f052ca0 2023-09-23T09:20:44.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.075+0000 7fc7be7fc700 1 -- 172.21.15.82:0/1256808333 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc7cc098a70 con 0x555c0f052ca0 2023-09-23T09:20:44.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.075+0000 7fc7be7fc700 1 -- 172.21.15.82:0/1256808333 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7cc0981c0 con 0x555c0f052ca0 2023-09-23T09:20:44.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.076+0000 7fc7f2251b80 1 -- 172.21.15.82:0/1256808333 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c0f052ca0 msgr2=0x555c0f04c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:20:44.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.076+0000 7fc7f2251b80 1 --2- 172.21.15.82:0/1256808333 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c0f052ca0 0x555c0f04c700 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc0954e0 tx=0x7fc7cc0984d0 comp rx=0 tx=0).stop 2023-09-23T09:20:44.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.076+0000 7fc7f2251b80 1 -- 172.21.15.82:0/1256808333 shutdown_connections 2023-09-23T09:20:44.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.076+0000 7fc7f2251b80 1 --2- 172.21.15.82:0/1256808333 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555c0f04cc40 0x555c0f04d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:20:44.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.076+0000 7fc7f2251b80 1 --2- 172.21.15.82:0/1256808333 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555c0f052380 0x555c0f052760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:20:44.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.076+0000 7fc7f2251b80 1 --2- 172.21.15.82:0/1256808333 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c0f052ca0 0x555c0f04c700 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:20:44.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.076+0000 7fc7f2251b80 1 -- 172.21.15.82:0/1256808333 >> 172.21.15.82:0/1256808333 conn(0x555c0efc10e0 msgr2=0x555c0f047410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:20:44.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.076+0000 7fc7f2251b80 1 -- 172.21.15.82:0/1256808333 shutdown_connections 2023-09-23T09:20:44.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.076+0000 7fc7f2251b80 1 -- 172.21.15.82:0/1256808333 wait complete. 2023-09-23T09:20:44.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.076+0000 7fc7f2251b80 1 -- start start 2023-09-23T09:20:44.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.076+0000 7fc7f2251b80 1 Processor -- start 2023-09-23T09:20:44.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.077+0000 7fc7f2251b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c0f04cc40 0x555c0f058cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:20:44.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.077+0000 7fc7f2251b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555c0f052380 0x555c0f055f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:20:44.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.077+0000 7fc7f2251b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555c0f052ca0 0x555c0f056690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:20:44.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.077+0000 7fc7f2251b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c0ef9e990 con 0x555c0f04cc40 2023-09-23T09:20:44.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.077+0000 7fc7f2251b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c0ef3cbb0 con 0x555c0f052ca0 2023-09-23T09:20:44.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.077+0000 7fc7f2251b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c0ef3c8b0 con 0x555c0f052380 2023-09-23T09:20:44.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.077+0000 7fc7f2251b80 10 client.0 _ll_register_callbacks cb 0x555c0ee86a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:20:44.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.077+0000 7fc7d7fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c0f04cc40 0x555c0f058cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:20:44.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.077+0000 7fc7d7fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c0f04cc40 0x555c0f058cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45408/0 (socket says 172.21.15.82:45408) 2023-09-23T09:20:44.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.077+0000 7fc7d7fff700 1 -- 172.21.15.82:0/3421842776 learned_addr learned my addr 172.21.15.82:0/3421842776 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:20:44.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.077+0000 7fc7d77fe700 1 --2- 172.21.15.82:0/3421842776 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555c0f052380 0x555c0f055f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:20:44.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.077+0000 7fc7dcf9c700 1 --2- 172.21.15.82:0/3421842776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555c0f052ca0 0x555c0f056690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:20:44.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.078+0000 7fc7d7fff700 1 -- 172.21.15.82:0/3421842776 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555c0f052380 msgr2=0x555c0f055f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:20:44.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.078+0000 7fc7d7fff700 1 --2- 172.21.15.82:0/3421842776 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555c0f052380 0x555c0f055f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:20:44.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.078+0000 7fc7d7fff700 1 -- 172.21.15.82:0/3421842776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555c0f052ca0 msgr2=0x555c0f056690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:20:44.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.078+0000 7fc7d7fff700 1 --2- 172.21.15.82:0/3421842776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555c0f052ca0 0x555c0f056690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:20:44.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.078+0000 7fc7d7fff700 1 -- 172.21.15.82:0/3421842776 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7d0011230 con 0x555c0f04cc40 2023-09-23T09:20:44.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.078+0000 7fc7d77fe700 1 --2- 172.21.15.82:0/3421842776 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555c0f052380 0x555c0f055f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:20:44.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.078+0000 7fc7d7fff700 1 --2- 172.21.15.82:0/3421842776 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c0f04cc40 0x555c0f058cd0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fc7c8015000 tx=0x7fc7c8009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c15fe9fdfa9e5e6 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:20:44.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.078+0000 7fc7b77fe700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:20:44.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.078+0000 7fc7b77fe700 1 -- 172.21.15.82:0/3421842776 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c8004e00 con 0x555c0f04cc40 2023-09-23T09:20:44.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.078+0000 7fc7f2251b80 1 -- 172.21.15.82:0/3421842776 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555c0f01c1c0 con 0x555c0f04cc40 2023-09-23T09:20:44.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.078+0000 7fc7b77fe700 1 -- 172.21.15.82:0/3421842776 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(123..123 src has 1..123) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fc7c800f460 con 0x555c0f04cc40 2023-09-23T09:20:44.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.079+0000 7fc7b77fe700 1 -- 172.21.15.82:0/3421842776 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=76) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc7c800f620 con 0x555c0f04cc40 2023-09-23T09:20:44.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.079+0000 7fc7f2251b80 10 client.16983 fetch_fsmap learned FSMap version 76 2023-09-23T09:20:44.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.079+0000 7fc7f2251b80 1 -- 172.21.15.82:0/3421842776 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=76,monmap=4+}) v3 -- 0x7fc7d81a5850 con 0x555c0f04cc40 2023-09-23T09:20:44.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.079+0000 7fc7b77fe700 1 -- 172.21.15.82:0/3421842776 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc7c803d020 con 0x555c0f04cc40 2023-09-23T09:20:44.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.079+0000 7fc7b77fe700 1 -- 172.21.15.82:0/3421842776 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 76) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fc7c8030690 con 0x555c0f04cc40 2023-09-23T09:20:44.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.079+0000 7fc7f2251b80 10 client.16983 fetch_fsmap finished waiting for FSMap version 76 2023-09-23T09:20:44.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.079+0000 7fc7f2251b80 10 client.16983 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:20:44.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.079+0000 7fc7f2251b80 20 client.16983 populate_metadata read hostname 'smithi082' 2023-09-23T09:20:44.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.079+0000 7fc7f2251b80 1 --2- 172.21.15.82:0/3421842776 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x555c0f066870 0x555c0f068c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:20:44.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.079+0000 7fc7f2251b80 4 client.16983 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:20:44.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.079+0000 7fc7f2251b80 1 -- 172.21.15.82:0/3421842776 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555c0ef44ba0 con 0x555c0f066870 2023-09-23T09:20:44.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.079+0000 7fc7d77fe700 1 --2- 172.21.15.82:0/3421842776 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x555c0f066870 0x555c0f068c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:20:44.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.080+0000 7fc7d77fe700 1 --2- 172.21.15.82:0/3421842776 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x555c0f066870 0x555c0f068c90 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2403471916550077 server_cookie=c3d863a2d78c4dd9 in_seq=0 out_seq=0 2023-09-23T09:20:44.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.080+0000 7fc7b77fe700 10 client.16983 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:20:44.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.081+0000 7fc7b77fe700 1 -- 172.21.15.82:0/3421842776 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x555c0ef44ba0 con 0x555c0f066870 2023-09-23T09:20:44.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.081+0000 7fc7b77fe700 10 client.16983 handle_command_reply: tid=0 2023-09-23T09:20:44.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.081+0000 7fc7f2251b80 1 client.16983 shutdown 2023-09-23T09:20:44.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.081+0000 7fc7f2251b80 1 -- 172.21.15.82:0/3421842776 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c0f04cc40 msgr2=0x555c0f058cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:20:44.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.081+0000 7fc7f2251b80 1 --2- 172.21.15.82:0/3421842776 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c0f04cc40 0x555c0f058cd0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fc7c8015000 tx=0x7fc7c8009ca0 comp rx=0 tx=0).stop 2023-09-23T09:20:44.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.081+0000 7fc7f2251b80 1 -- 172.21.15.82:0/3421842776 shutdown_connections 2023-09-23T09:20:44.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.081+0000 7fc7f2251b80 1 --2- 172.21.15.82:0/3421842776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555c0f052ca0 0x555c0f056690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:20:44.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.081+0000 7fc7f2251b80 1 --2- 172.21.15.82:0/3421842776 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x555c0f066870 0x555c0f068c90 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:20:44.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.081+0000 7fc7f2251b80 1 --2- 172.21.15.82:0/3421842776 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c0f04cc40 0x555c0f058cd0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:20:44.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.081+0000 7fc7f2251b80 1 --2- 172.21.15.82:0/3421842776 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555c0f052380 0x555c0f055f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:20:44.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.081+0000 7fc7b77fe700 0 client.16983 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:20:44.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.081+0000 7fc7f2251b80 1 -- 172.21.15.82:0/3421842776 >> 172.21.15.82:0/3421842776 conn(0x555c0efc10e0 msgr2=0x555c0f041b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:20:44.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.081+0000 7fc7f2251b80 1 -- 172.21.15.82:0/3421842776 shutdown_connections 2023-09-23T09:20:44.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.081+0000 7fc7f2251b80 1 -- 172.21.15.82:0/3421842776 wait complete. 2023-09-23T09:20:44.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.081+0000 7fc7f2251b80 20 client.16983 trim_cache size 0 max 16384 2023-09-23T09:20:44.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.099+0000 7fc7f2251b80 1 Processor -- start 2023-09-23T09:20:44.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.099+0000 7fc7f2251b80 1 -- start start 2023-09-23T09:20:44.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.099+0000 7fc7f2251b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c0f04cc40 0x555c0f05d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:20:44.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.099+0000 7fc7f2251b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555c0f052380 0x555c0f058870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:20:44.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.100+0000 7fc7f2251b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555c0f052ca0 0x555c0f050130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:20:44.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.100+0000 7fc7f2251b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c0ee20920 con 0x555c0f04cc40 2023-09-23T09:20:44.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.100+0000 7fc7f2251b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c0f057530 con 0x555c0f052ca0 2023-09-23T09:20:44.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.100+0000 7fc7f2251b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c0f043c80 con 0x555c0f052380 2023-09-23T09:20:44.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.100+0000 7fc7d7fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c0f04cc40 0x555c0f05d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:20:44.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.100+0000 7fc7dcf9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555c0f052ca0 0x555c0f050130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:20:44.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.100+0000 7fc7d7fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c0f04cc40 0x555c0f05d7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45422/0 (socket says 172.21.15.82:45422) 2023-09-23T09:20:44.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.100+0000 7fc7dcf9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555c0f052ca0 0x555c0f050130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:55888/0 (socket says 172.21.15.82:55888) 2023-09-23T09:20:44.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.100+0000 7fc7d7fff700 1 -- 172.21.15.82:0/2133333773 learned_addr learned my addr 172.21.15.82:0/2133333773 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:20:44.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.100+0000 7fc7d77fe700 1 --2- 172.21.15.82:0/2133333773 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555c0f052380 0x555c0f058870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:20:44.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.100+0000 7fc7dcf9c700 1 -- 172.21.15.82:0/2133333773 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555c0f052380 msgr2=0x555c0f058870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:20:44.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.100+0000 7fc7dcf9c700 1 --2- 172.21.15.82:0/2133333773 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555c0f052380 0x555c0f058870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:20:44.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.100+0000 7fc7dcf9c700 1 -- 172.21.15.82:0/2133333773 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c0f04cc40 msgr2=0x555c0f05d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:20:44.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.100+0000 7fc7dcf9c700 1 --2- 172.21.15.82:0/2133333773 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c0f04cc40 0x555c0f05d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:20:44.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.100+0000 7fc7dcf9c700 1 -- 172.21.15.82:0/2133333773 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555c0edcade0 con 0x555c0f052ca0 2023-09-23T09:20:44.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.100+0000 7fc7d7fff700 1 --2- 172.21.15.82:0/2133333773 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c0f04cc40 0x555c0f05d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:20:44.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.101+0000 7fc7dcf9c700 1 --2- 172.21.15.82:0/2133333773 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555c0f052ca0 0x555c0f050130 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc7d0003a50 tx=0x7fc7d0009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=613d35956e1e680e server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:20:44.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.101+0000 7fc7beffd700 1 -- 172.21.15.82:0/2133333773 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d000e040 con 0x555c0f052ca0 2023-09-23T09:20:44.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.101+0000 7fc7beffd700 1 -- 172.21.15.82:0/2133333773 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc7d000f040 con 0x555c0f052ca0 2023-09-23T09:20:44.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.101+0000 7fc7beffd700 1 -- 172.21.15.82:0/2133333773 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d0007cc0 con 0x555c0f052ca0 2023-09-23T09:20:44.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.102+0000 7fc7f2251b80 1 -- 172.21.15.82:0/2133333773 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555c0f052ca0 msgr2=0x555c0f050130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:20:44.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.102+0000 7fc7f2251b80 1 --2- 172.21.15.82:0/2133333773 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555c0f052ca0 0x555c0f050130 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc7d0003a50 tx=0x7fc7d0009920 comp rx=0 tx=0).stop 2023-09-23T09:20:44.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.102+0000 7fc7f2251b80 1 -- 172.21.15.82:0/2133333773 shutdown_connections 2023-09-23T09:20:44.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.102+0000 7fc7f2251b80 1 --2- 172.21.15.82:0/2133333773 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555c0f052ca0 0x555c0f050130 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:20:44.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.102+0000 7fc7f2251b80 1 --2- 172.21.15.82:0/2133333773 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c0f04cc40 0x555c0f05d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:20:44.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.102+0000 7fc7f2251b80 1 --2- 172.21.15.82:0/2133333773 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555c0f052380 0x555c0f058870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:20:44.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.102+0000 7fc7f2251b80 1 -- 172.21.15.82:0/2133333773 >> 172.21.15.82:0/2133333773 conn(0x555c0efc10e0 msgr2=0x555c0f0471b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:20:44.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.102+0000 7fc7f2251b80 1 -- 172.21.15.82:0/2133333773 shutdown_connections 2023-09-23T09:20:44.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.102+0000 7fc7f2251b80 1 -- 172.21.15.82:0/2133333773 wait complete. 2023-09-23T09:20:44.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.103+0000 7fc7f2251b80 1 -- start start 2023-09-23T09:20:44.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.103+0000 7fc7f2251b80 1 Processor -- start 2023-09-23T09:20:44.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.103+0000 7fc7f2251b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c0f04cc40 0x555c0f05d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:20:44.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.103+0000 7fc7f2251b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555c0f052380 0x555c0f05d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:20:44.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.103+0000 7fc7f2251b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555c0f052ca0 0x555c0f05b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:20:44.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.103+0000 7fc7f2251b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c0f05c090 con 0x555c0f04cc40 2023-09-23T09:20:44.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.103+0000 7fc7f2251b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c0f05c200 con 0x555c0f052380 2023-09-23T09:20:44.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.103+0000 7fc7f2251b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c0f05c3c0 con 0x555c0f052ca0 2023-09-23T09:20:44.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.103+0000 7fc7f2251b80 10 client.0 _ll_register_callbacks cb 0x7fc7c800bad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:20:44.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.104+0000 7fc7d7fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c0f04cc40 0x555c0f05d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:20:44.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.104+0000 7fc7d7fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c0f04cc40 0x555c0f05d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45432/0 (socket says 172.21.15.82:45432) 2023-09-23T09:20:44.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.104+0000 7fc7d77fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555c0f052380 0x555c0f05d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:20:44.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.104+0000 7fc7d7fff700 1 -- 172.21.15.82:0/2831964787 learned_addr learned my addr 172.21.15.82:0/2831964787 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:20:44.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.104+0000 7fc7dcf9c700 1 --2- 172.21.15.82:0/2831964787 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555c0f052ca0 0x555c0f05b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:20:44.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.104+0000 7fc7d7fff700 1 -- 172.21.15.82:0/2831964787 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555c0f052ca0 msgr2=0x555c0f05b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:20:44.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.104+0000 7fc7d7fff700 1 --2- 172.21.15.82:0/2831964787 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555c0f052ca0 0x555c0f05b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:20:44.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.104+0000 7fc7d7fff700 1 -- 172.21.15.82:0/2831964787 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555c0f052380 msgr2=0x555c0f05d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:20:44.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.104+0000 7fc7d7fff700 1 --2- 172.21.15.82:0/2831964787 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555c0f052380 0x555c0f05d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:20:44.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.104+0000 7fc7d7fff700 1 -- 172.21.15.82:0/2831964787 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7d81a5850 con 0x555c0f04cc40 2023-09-23T09:20:44.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.104+0000 7fc7d77fe700 1 --2- 172.21.15.82:0/2831964787 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555c0f052380 0x555c0f05d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:20:44.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.104+0000 7fc7d7fff700 1 --2- 172.21.15.82:0/2831964787 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c0f04cc40 0x555c0f05d1d0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fc7c8030ac0 tx=0x7fc7c8004b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e07f5e241205b6e server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:20:44.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.104+0000 7fc7b77fe700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:20:44.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.105+0000 7fc7b77fe700 1 -- 172.21.15.82:0/2831964787 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c8030420 con 0x555c0f04cc40 2023-09-23T09:20:44.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.105+0000 7fc7f2251b80 1 -- 172.21.15.82:0/2831964787 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555c0f03f8b0 con 0x555c0f04cc40 2023-09-23T09:20:44.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.105+0000 7fc7b77fe700 1 -- 172.21.15.82:0/2831964787 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(123..123 src has 1..123) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fc7c803e080 con 0x555c0f04cc40 2023-09-23T09:20:44.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.105+0000 7fc7b77fe700 1 -- 172.21.15.82:0/2831964787 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=76) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc7c8030580 con 0x555c0f04cc40 2023-09-23T09:20:44.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.105+0000 7fc7f2251b80 10 client.16989 fetch_fsmap learned FSMap version 76 2023-09-23T09:20:44.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.105+0000 7fc7f2251b80 1 -- 172.21.15.82:0/2831964787 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=76,monmap=4+}) v3 -- 0x7fc7d0009310 con 0x555c0f04cc40 2023-09-23T09:20:44.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.105+0000 7fc7b77fe700 1 -- 172.21.15.82:0/2831964787 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x555c0f03f8b0 con 0x555c0f04cc40 2023-09-23T09:20:44.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.105+0000 7fc7b77fe700 1 -- 172.21.15.82:0/2831964787 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 76) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fc7c800fc60 con 0x555c0f04cc40 2023-09-23T09:20:44.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.105+0000 7fc7f2251b80 10 client.16989 fetch_fsmap finished waiting for FSMap version 76 2023-09-23T09:20:44.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.105+0000 7fc7f2251b80 10 client.16989 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:20:44.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.105+0000 7fc7f2251b80 20 client.16989 populate_metadata read hostname 'smithi082' 2023-09-23T09:20:44.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.105+0000 7fc7f2251b80 1 --2- 172.21.15.82:0/2831964787 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x555c0f0bb4e0 0x555c0f0bd8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:20:44.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.105+0000 7fc7f2251b80 4 client.16989 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:20:44.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.105+0000 7fc7f2251b80 1 -- 172.21.15.82:0/2831964787 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x555c0ef97970 con 0x555c0f0bb4e0 2023-09-23T09:20:44.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.106+0000 7fc7d77fe700 1 --2- 172.21.15.82:0/2831964787 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x555c0f0bb4e0 0x555c0f0bd8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:20:44.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.106+0000 7fc7d77fe700 1 --2- 172.21.15.82:0/2831964787 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x555c0f0bb4e0 0x555c0f0bd8d0 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e3299cabf53708de server_cookie=618d58ef876303e in_seq=0 out_seq=0 2023-09-23T09:20:44.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.106+0000 7fc7b77fe700 10 client.16989 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:20:44.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.106+0000 7fc7b77fe700 1 -- 172.21.15.82:0/2831964787 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x555c0ef97970 con 0x555c0f0bb4e0 2023-09-23T09:20:44.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.106+0000 7fc7b77fe700 10 client.16989 handle_command_reply: tid=0 2023-09-23T09:20:44.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.106+0000 7fc7f2251b80 1 client.16989 shutdown 2023-09-23T09:20:44.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.107+0000 7fc7f2251b80 1 -- 172.21.15.82:0/2831964787 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c0f04cc40 msgr2=0x555c0f05d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:20:44.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.107+0000 7fc7f2251b80 1 --2- 172.21.15.82:0/2831964787 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c0f04cc40 0x555c0f05d1d0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fc7c8030ac0 tx=0x7fc7c8004b80 comp rx=0 tx=0).stop 2023-09-23T09:20:44.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.107+0000 7fc7f2251b80 1 -- 172.21.15.82:0/2831964787 shutdown_connections 2023-09-23T09:20:44.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.107+0000 7fc7f2251b80 1 --2- 172.21.15.82:0/2831964787 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555c0f052ca0 0x555c0f05b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:20:44.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.107+0000 7fc7f2251b80 1 --2- 172.21.15.82:0/2831964787 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x555c0f0bb4e0 0x555c0f0bd8d0 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:20:44.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.107+0000 7fc7f2251b80 1 --2- 172.21.15.82:0/2831964787 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c0f04cc40 0x555c0f05d1d0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:20:44.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.107+0000 7fc7b77fe700 0 client.16989 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:20:44.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.107+0000 7fc7f2251b80 1 --2- 172.21.15.82:0/2831964787 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555c0f052380 0x555c0f05d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:20:44.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.107+0000 7fc7f2251b80 1 -- 172.21.15.82:0/2831964787 >> 172.21.15.82:0/2831964787 conn(0x555c0efc10e0 msgr2=0x555c0f050130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:20:44.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.107+0000 7fc7f2251b80 1 -- 172.21.15.82:0/2831964787 shutdown_connections 2023-09-23T09:20:44.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.107+0000 7fc7f2251b80 1 -- 172.21.15.82:0/2831964787 wait complete. 2023-09-23T09:20:44.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.107+0000 7fc7f2251b80 20 client.16989 trim_cache size 0 max 16384 2023-09-23T09:20:44.115 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:20:44.115 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-23T09:20:44.115 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:20:44.115 INFO:teuthology.orchestra.run.smithi082.stdout: "047cbc72-e254-4787-b038-382de9c1a9a4": { 2023-09-23T09:20:44.115 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:20:44.115 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "047cbc72-e254-4787-b038-382de9c1a9a4", 2023-09-23T09:20:44.115 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:20:44.115 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:20:44.115 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:20:44.115 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:20:44.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.108+0000 7fc7de9ff700 1 -- 172.21.15.82:0/2052592485 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fc7c00a0140 msgr2=0x7fc7c00a2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:20:44.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.108+0000 7fc7de9ff700 1 --2- 172.21.15.82:0/2052592485 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fc7c00a0140 0x7fc7c00a2600 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc7c8006010 tx=0x7fc7c800b260 comp rx=0 tx=0).stop 2023-09-23T09:20:44.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.108+0000 7fc7de9ff700 1 -- 172.21.15.82:0/2052592485 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7d8101250 msgr2=0x7fc7d819eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:20:44.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.108+0000 7fc7de9ff700 1 --2- 172.21.15.82:0/2052592485 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7d8101250 0x7fc7d819eda0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc00d950 tx=0x7fc7cc00dc60 comp rx=0 tx=0).stop 2023-09-23T09:20:44.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.108+0000 7fc7de9ff700 1 -- 172.21.15.82:0/2052592485 shutdown_connections 2023-09-23T09:20:44.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.108+0000 7fc7de9ff700 1 --2- 172.21.15.82:0/2052592485 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fc7c00a0140 0x7fc7c00a2600 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:20:44.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.108+0000 7fc7de9ff700 1 --2- 172.21.15.82:0/2052592485 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7d81068a0 0x7fc7d81988d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:20:44.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.108+0000 7fc7de9ff700 1 --2- 172.21.15.82:0/2052592485 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7d8100890 0x7fc7d819e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:20:44.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.108+0000 7fc7de9ff700 1 --2- 172.21.15.82:0/2052592485 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7d8101250 0x7fc7d819eda0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:20:44.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.108+0000 7fc7de9ff700 1 -- 172.21.15.82:0/2052592485 >> 172.21.15.82:0/2052592485 conn(0x7fc7d80fc380 msgr2=0x7fc7d810bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:20:44.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.108+0000 7fc7de9ff700 1 -- 172.21.15.82:0/2052592485 shutdown_connections 2023-09-23T09:20:44.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:20:44.108+0000 7fc7de9ff700 1 -- 172.21.15.82:0/2052592485 wait complete. 2023-09-23T09:20:44.130 INFO:tasks.cephfs.filesystem:scrub status for tag:047cbc72-e254-4787-b038-382de9c1a9a4 - {'path': '/', 'tag': '047cbc72-e254-4787-b038-382de9c1a9a4', 'options': 'recursive,force'} 2023-09-23T09:20:44.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:20:44 smithi135 ceph-mon[99205]: pgmap v752: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.5 MiB/s wr, 310 op/s 2023-09-23T09:20:44.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:20:44 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:20:44.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:20:44 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:20:44.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:20:44 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:20:44.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:20:44 smithi082 ceph-mon[97694]: pgmap v752: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.5 MiB/s wr, 310 op/s 2023-09-23T09:20:44.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:20:44 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:20:44.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:20:44 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:20:44.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:20:44 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:20:44.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:20:44 smithi161 ceph-mon[99580]: pgmap v752: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.5 MiB/s wr, 310 op/s 2023-09-23T09:20:44.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:20:44 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:20:44.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:20:44 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:20:44.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:20:44 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:20:46.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:20:46 smithi135 ceph-mon[99205]: pgmap v753: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.6 MiB/s wr, 464 op/s 2023-09-23T09:20:46.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:20:46 smithi082 ceph-mon[97694]: pgmap v753: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.6 MiB/s wr, 464 op/s 2023-09-23T09:20:46.915 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:20:46 smithi161 ceph-mon[99580]: pgmap v753: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.6 MiB/s wr, 464 op/s 2023-09-23T09:20:48.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:20:47 smithi082 ceph-mon[97694]: pgmap v754: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.5 MiB/s wr, 303 op/s 2023-09-23T09:20:48.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:20:47 smithi161 ceph-mon[99580]: pgmap v754: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.5 MiB/s wr, 303 op/s 2023-09-23T09:20:48.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:20:47 smithi135 ceph-mon[99205]: pgmap v754: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.5 MiB/s wr, 303 op/s 2023-09-23T09:20:50.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:20:50 smithi135 ceph-mon[99205]: pgmap v755: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.6 MiB/s wr, 464 op/s 2023-09-23T09:20:50.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:20:50 smithi082 ceph-mon[97694]: pgmap v755: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.6 MiB/s wr, 464 op/s 2023-09-23T09:20:50.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:20:50 smithi161 ceph-mon[99580]: pgmap v755: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.6 MiB/s wr, 464 op/s 2023-09-23T09:20:52.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:20:52 smithi135 ceph-mon[99205]: pgmap v756: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 315 op/s 2023-09-23T09:20:52.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:20:52 smithi082 ceph-mon[97694]: pgmap v756: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 315 op/s 2023-09-23T09:20:52.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:20:52 smithi161 ceph-mon[99580]: pgmap v756: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 315 op/s 2023-09-23T09:20:54.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:20:54 smithi135 ceph-mon[99205]: pgmap v757: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 315 op/s 2023-09-23T09:20:54.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:20:54 smithi082 ceph-mon[97694]: pgmap v757: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 315 op/s 2023-09-23T09:20:54.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:20:54 smithi161 ceph-mon[99580]: pgmap v757: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 315 op/s 2023-09-23T09:20:56.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:20:56 smithi135 ceph-mon[99205]: pgmap v758: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.7 MiB/s wr, 515 op/s 2023-09-23T09:20:56.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:20:56 smithi082 ceph-mon[97694]: pgmap v758: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.7 MiB/s wr, 515 op/s 2023-09-23T09:20:56.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:20:56 smithi161 ceph-mon[99580]: pgmap v758: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.7 MiB/s wr, 515 op/s 2023-09-23T09:20:58.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:20:57 smithi082 ceph-mon[97694]: pgmap v759: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 361 op/s 2023-09-23T09:20:58.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:20:57 smithi161 ceph-mon[99580]: pgmap v759: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 361 op/s 2023-09-23T09:20:58.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:20:57 smithi135 ceph-mon[99205]: pgmap v759: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 361 op/s 2023-09-23T09:21:00.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:21:00 smithi135 ceph-mon[99205]: pgmap v760: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.9 MiB/s wr, 548 op/s 2023-09-23T09:21:00.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:21:00 smithi082 ceph-mon[97694]: pgmap v760: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.9 MiB/s wr, 548 op/s 2023-09-23T09:21:00.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:21:00 smithi161 ceph-mon[99580]: pgmap v760: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.9 MiB/s wr, 548 op/s 2023-09-23T09:21:02.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:21:02 smithi135 ceph-mon[99205]: pgmap v761: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.8 MiB/s wr, 386 op/s 2023-09-23T09:21:02.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:21:02 smithi082 ceph-mon[97694]: pgmap v761: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.8 MiB/s wr, 386 op/s 2023-09-23T09:21:02.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:21:02 smithi161 ceph-mon[99580]: pgmap v761: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.8 MiB/s wr, 386 op/s 2023-09-23T09:21:04.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:21:04 smithi135 ceph-mon[99205]: pgmap v762: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.8 MiB/s wr, 387 op/s 2023-09-23T09:21:04.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:21:04 smithi082 ceph-mon[97694]: pgmap v762: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.8 MiB/s wr, 387 op/s 2023-09-23T09:21:04.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:21:04 smithi161 ceph-mon[99580]: pgmap v762: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.8 MiB/s wr, 387 op/s 2023-09-23T09:21:06.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:21:06 smithi135 ceph-mon[99205]: pgmap v763: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.4 MiB/s wr, 576 op/s 2023-09-23T09:21:06.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:21:06 smithi082 ceph-mon[97694]: pgmap v763: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.4 MiB/s wr, 576 op/s 2023-09-23T09:21:06.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:21:06 smithi161 ceph-mon[99580]: pgmap v763: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.4 MiB/s wr, 576 op/s 2023-09-23T09:21:08.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:21:07 smithi082 ceph-mon[97694]: pgmap v764: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.9 MiB/s wr, 375 op/s 2023-09-23T09:21:08.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:21:07 smithi161 ceph-mon[99580]: pgmap v764: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.9 MiB/s wr, 375 op/s 2023-09-23T09:21:08.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:21:07 smithi135 ceph-mon[99205]: pgmap v764: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.9 MiB/s wr, 375 op/s 2023-09-23T09:21:10.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:21:10 smithi135 ceph-mon[99205]: pgmap v765: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.1 MiB/s wr, 540 op/s 2023-09-23T09:21:10.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:21:10 smithi082 ceph-mon[97694]: pgmap v765: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.1 MiB/s wr, 540 op/s 2023-09-23T09:21:10.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:21:10 smithi161 ceph-mon[99580]: pgmap v765: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.1 MiB/s wr, 540 op/s 2023-09-23T09:21:12.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:21:12 smithi135 ceph-mon[99205]: pgmap v766: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.8 MiB/s wr, 354 op/s 2023-09-23T09:21:12.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:21:12 smithi135 ceph-mon[99205]: osdmap e124: 12 total, 12 up, 12 in 2023-09-23T09:21:12.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:21:12 smithi082 ceph-mon[97694]: pgmap v766: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.8 MiB/s wr, 354 op/s 2023-09-23T09:21:12.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:21:12 smithi082 ceph-mon[97694]: osdmap e124: 12 total, 12 up, 12 in 2023-09-23T09:21:12.901 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:21:12 smithi161 ceph-mon[99580]: pgmap v766: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.8 MiB/s wr, 354 op/s 2023-09-23T09:21:12.901 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:21:12 smithi161 ceph-mon[99580]: osdmap e124: 12 total, 12 up, 12 in 2023-09-23T09:21:14.131 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:21:14.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.737+0000 7f279f5ff700 1 -- 172.21.15.82:0/2195735919 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2798100890 msgr2=0x7f2798100d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:21:14.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.737+0000 7f279f5ff700 1 --2- 172.21.15.82:0/2195735919 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2798100890 0x7f2798100d10 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f2788009990 tx=0x7f2788009ca0 comp rx=0 tx=0).stop 2023-09-23T09:21:14.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.737+0000 7f279f5ff700 1 -- 172.21.15.82:0/2195735919 shutdown_connections 2023-09-23T09:21:14.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.737+0000 7f279f5ff700 1 --2- 172.21.15.82:0/2195735919 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2798101250 0x7f279810d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:21:14.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.737+0000 7f279f5ff700 1 --2- 172.21.15.82:0/2195735919 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27981068a0 0x7f2798106c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:21:14.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.737+0000 7f279f5ff700 1 --2- 172.21.15.82:0/2195735919 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2798100890 0x7f2798100d10 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:21:14.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.737+0000 7f279f5ff700 1 -- 172.21.15.82:0/2195735919 >> 172.21.15.82:0/2195735919 conn(0x7f27980fc380 msgr2=0x7f27980fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:21:14.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.737+0000 7f279f5ff700 1 -- 172.21.15.82:0/2195735919 shutdown_connections 2023-09-23T09:21:14.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.737+0000 7f279f5ff700 1 -- 172.21.15.82:0/2195735919 wait complete. 2023-09-23T09:21:14.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.739+0000 7f279f5ff700 1 Processor -- start 2023-09-23T09:21:14.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.739+0000 7f279f5ff700 1 -- start start 2023-09-23T09:21:14.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.740+0000 7f279f5ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2798100890 0x7f279819e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:21:14.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.740+0000 7f279f5ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2798101250 0x7f279819ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:21:14.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.740+0000 7f279f5ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27981068a0 0x7f27981988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:21:14.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.740+0000 7f279f5ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27981990b0 con 0x7f27981068a0 2023-09-23T09:21:14.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.740+0000 7f279f5ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2798199220 con 0x7f2798100890 2023-09-23T09:21:14.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.740+0000 7f279f5ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27981993e0 con 0x7f2798101250 2023-09-23T09:21:14.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.740+0000 7f279db9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27981068a0 0x7f27981988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:21:14.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.740+0000 7f279cb9a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2798101250 0x7f279819ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:21:14.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.740+0000 7f279d39b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2798100890 0x7f279819e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:21:14.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.740+0000 7f279cb9a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2798101250 0x7f279819ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:49516/0 (socket says 172.21.15.82:49516) 2023-09-23T09:21:14.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.740+0000 7f279cb9a700 1 -- 172.21.15.82:0/42931928 learned_addr learned my addr 172.21.15.82:0/42931928 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:21:14.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.740+0000 7f279db9c700 1 -- 172.21.15.82:0/42931928 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2798101250 msgr2=0x7f279819ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:21:14.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.740+0000 7f279db9c700 1 --2- 172.21.15.82:0/42931928 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2798101250 0x7f279819ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:21:14.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.740+0000 7f279db9c700 1 -- 172.21.15.82:0/42931928 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2798100890 msgr2=0x7f279819e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:21:14.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.740+0000 7f279db9c700 1 --2- 172.21.15.82:0/42931928 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2798100890 0x7f279819e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:21:14.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.741+0000 7f279db9c700 1 -- 172.21.15.82:0/42931928 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27880095f0 con 0x7f27981068a0 2023-09-23T09:21:14.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.741+0000 7f279cb9a700 1 --2- 172.21.15.82:0/42931928 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2798101250 0x7f279819ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:21:14.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.741+0000 7f279db9c700 1 --2- 172.21.15.82:0/42931928 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27981068a0 0x7f27981988e0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f279000efc0 tx=0x7f279000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:21:14.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.741+0000 7f278e7fc700 1 -- 172.21.15.82:0/42931928 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2790018070 con 0x7f27981068a0 2023-09-23T09:21:14.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.741+0000 7f278e7fc700 1 -- 172.21.15.82:0/42931928 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f279000f040 con 0x7f27981068a0 2023-09-23T09:21:14.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.741+0000 7f278e7fc700 1 -- 172.21.15.82:0/42931928 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f279000cba0 con 0x7f27981068a0 2023-09-23T09:21:14.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.741+0000 7f279f5ff700 1 -- 172.21.15.82:0/42931928 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2798199660 con 0x7f27981068a0 2023-09-23T09:21:14.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.742+0000 7f279f5ff700 1 -- 172.21.15.82:0/42931928 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27981a5880 con 0x7f27981068a0 2023-09-23T09:21:14.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.746+0000 7f278e7fc700 1 -- 172.21.15.82:0/42931928 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f2790003a00 con 0x7f27981068a0 2023-09-23T09:21:14.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.748+0000 7f27b2fa2b80 1 Processor -- start 2023-09-23T09:21:14.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.748+0000 7f27b2fa2b80 1 -- start start 2023-09-23T09:21:14.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.748+0000 7f278e7fc700 1 --2- 172.21.15.82:0/42931928 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f27840a00c0 0x7f27840a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:21:14.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.748+0000 7f278e7fc700 1 -- 172.21.15.82:0/42931928 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 8557+0+0 (secure 0 0 0) 0x7f27900cada0 con 0x7f27981068a0 2023-09-23T09:21:14.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.749+0000 7f27b2fa2b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec9925fb90 0x55ec9925ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:21:14.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.749+0000 7f27b2fa2b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ec992604b0 0x55ec99259f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:21:14.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.749+0000 7f27b2fa2b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec9925a450 0x55ec9925a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:21:14.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.749+0000 7f27b2fa2b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec991b97b0 con 0x55ec9925a450 2023-09-23T09:21:14.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.749+0000 7f27b2fa2b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec991aa780 con 0x55ec9925fb90 2023-09-23T09:21:14.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.749+0000 7f27b2fa2b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec991a80a0 con 0x55ec992604b0 2023-09-23T09:21:14.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.749+0000 7f279cb9a700 1 --2- 172.21.15.82:0/42931928 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f27840a00c0 0x7f27840a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:21:14.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.749+0000 7f279cb9a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ec992604b0 0x55ec99259f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:21:14.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.749+0000 7f279cb9a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ec992604b0 0x55ec99259f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:49520/0 (socket says 172.21.15.82:49520) 2023-09-23T09:21:14.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.749+0000 7f279cb9a700 1 -- 172.21.15.82:0/3717089346 learned_addr learned my addr 172.21.15.82:0/3717089346 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:21:14.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.749+0000 7f279db9c700 1 --2- 172.21.15.82:0/3717089346 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec9925a450 0x55ec9925a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:21:14.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.749+0000 7f279d39b700 1 --2- 172.21.15.82:0/3717089346 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec9925fb90 0x55ec9925ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:21:14.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.750+0000 7f279db9c700 1 -- 172.21.15.82:0/3717089346 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ec992604b0 msgr2=0x55ec99259f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:21:14.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.750+0000 7f279db9c700 1 --2- 172.21.15.82:0/3717089346 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ec992604b0 0x55ec99259f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:21:14.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.750+0000 7f279db9c700 1 -- 172.21.15.82:0/3717089346 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec9925fb90 msgr2=0x55ec9925ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:21:14.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.750+0000 7f279db9c700 1 --2- 172.21.15.82:0/3717089346 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec9925fb90 0x55ec9925ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:21:14.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.750+0000 7f279db9c700 1 -- 172.21.15.82:0/3717089346 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ec99023630 con 0x55ec9925a450 2023-09-23T09:21:14.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.750+0000 7f279d39b700 1 --2- 172.21.15.82:0/3717089346 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec9925fb90 0x55ec9925ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:21:14.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.750+0000 7f279db9c700 1 --2- 172.21.15.82:0/3717089346 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec9925a450 0x55ec9925a8b0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f27900c84d0 tx=0x7f2790098160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b74c656514006bb server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:21:14.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.750+0000 7f279cb9a700 1 --2- 172.21.15.82:0/42931928 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f27840a00c0 0x7f27840a2580 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f278800c010 tx=0x7f278800bb80 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:21:14.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.750+0000 7f27837fe700 1 -- 172.21.15.82:0/3717089346 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f279009c170 con 0x55ec9925a450 2023-09-23T09:21:14.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.750+0000 7f27837fe700 1 -- 172.21.15.82:0/3717089346 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2790098c20 con 0x55ec9925a450 2023-09-23T09:21:14.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.750+0000 7f27837fe700 1 -- 172.21.15.82:0/3717089346 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27900a02a0 con 0x55ec9925a450 2023-09-23T09:21:14.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.751+0000 7f27b2fa2b80 1 -- 172.21.15.82:0/3717089346 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec9925a450 msgr2=0x55ec9925a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:21:14.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.751+0000 7f27b2fa2b80 1 --2- 172.21.15.82:0/3717089346 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec9925a450 0x55ec9925a8b0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f27900c84d0 tx=0x7f2790098160 comp rx=0 tx=0).stop 2023-09-23T09:21:14.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.751+0000 7f27b2fa2b80 1 -- 172.21.15.82:0/3717089346 shutdown_connections 2023-09-23T09:21:14.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.751+0000 7f27b2fa2b80 1 --2- 172.21.15.82:0/3717089346 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec9925a450 0x55ec9925a8b0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:21:14.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.751+0000 7f27b2fa2b80 1 --2- 172.21.15.82:0/3717089346 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec9925fb90 0x55ec9925ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:21:14.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.751+0000 7f27b2fa2b80 1 --2- 172.21.15.82:0/3717089346 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ec992604b0 0x55ec99259f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:21:14.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.751+0000 7f27b2fa2b80 1 -- 172.21.15.82:0/3717089346 >> 172.21.15.82:0/3717089346 conn(0x55ec991c60e0 msgr2=0x55ec9924c410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:21:14.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.752+0000 7f27b2fa2b80 1 -- 172.21.15.82:0/3717089346 shutdown_connections 2023-09-23T09:21:14.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.752+0000 7f27b2fa2b80 1 -- 172.21.15.82:0/3717089346 wait complete. 2023-09-23T09:21:14.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.752+0000 7f27b2fa2b80 1 -- start start 2023-09-23T09:21:14.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.752+0000 7f27b2fa2b80 1 Processor -- start 2023-09-23T09:21:14.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.753+0000 7f27b2fa2b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec9925a450 0x55ec99263790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:21:14.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.753+0000 7f27b2fa2b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec9925fb90 0x55ec99263cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:21:14.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.753+0000 7f27b2fa2b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ec992604b0 0x55ec99264210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:21:14.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.753+0000 7f27b2fa2b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec991a3990 con 0x55ec9925fb90 2023-09-23T09:21:14.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.753+0000 7f27b2fa2b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec99141bb0 con 0x55ec9925a450 2023-09-23T09:21:14.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.753+0000 7f27b2fa2b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec991418b0 con 0x55ec992604b0 2023-09-23T09:21:14.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.753+0000 7f27b2fa2b80 10 client.0 _ll_register_callbacks cb 0x55ec9908ba80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:21:14.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.753+0000 7f279cb9a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec9925fb90 0x55ec99263cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:21:14.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.753+0000 7f279cb9a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec9925fb90 0x55ec99263cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54962/0 (socket says 172.21.15.82:54962) 2023-09-23T09:21:14.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.753+0000 7f279cb9a700 1 -- 172.21.15.82:0/4009808894 learned_addr learned my addr 172.21.15.82:0/4009808894 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:21:14.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.753+0000 7f279d39b700 1 --2- 172.21.15.82:0/4009808894 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec9925a450 0x55ec99263790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:21:14.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.754+0000 7f279db9c700 1 --2- 172.21.15.82:0/4009808894 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ec992604b0 0x55ec99264210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:21:14.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.754+0000 7f279cb9a700 1 -- 172.21.15.82:0/4009808894 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ec992604b0 msgr2=0x55ec99264210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:21:14.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.754+0000 7f279cb9a700 1 --2- 172.21.15.82:0/4009808894 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ec992604b0 0x55ec99264210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:21:14.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.754+0000 7f279cb9a700 1 -- 172.21.15.82:0/4009808894 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec9925a450 msgr2=0x55ec99263790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:21:14.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.754+0000 7f279cb9a700 1 --2- 172.21.15.82:0/4009808894 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec9925a450 0x55ec99263790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:21:14.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.754+0000 7f279cb9a700 1 -- 172.21.15.82:0/4009808894 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27940098e0 con 0x55ec9925fb90 2023-09-23T09:21:14.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.754+0000 7f279d39b700 1 --2- 172.21.15.82:0/4009808894 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec9925a450 0x55ec99263790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:21:14.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.754+0000 7f279db9c700 1 --2- 172.21.15.82:0/4009808894 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ec992604b0 0x55ec99264210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:21:14.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.754+0000 7f279cb9a700 1 --2- 172.21.15.82:0/4009808894 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec9925fb90 0x55ec99263cd0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f2788005110 tx=0x7f2788009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1042ea13f120381d server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:21:14.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.754+0000 7f2780ff9700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:21:14.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.755+0000 7f2780ff9700 1 -- 172.21.15.82:0/4009808894 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f278801d070 con 0x55ec9925fb90 2023-09-23T09:21:14.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.755+0000 7f27b2fa2b80 1 -- 172.21.15.82:0/4009808894 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ec992211c0 con 0x55ec9925fb90 2023-09-23T09:21:14.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.755+0000 7f2780ff9700 1 -- 172.21.15.82:0/4009808894 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(124..124 src has 1..124) v4 ==== 8557+0+0 (secure 0 0 0) 0x7f2788029470 con 0x55ec9925fb90 2023-09-23T09:21:14.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.755+0000 7f2780ff9700 1 -- 172.21.15.82:0/4009808894 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=76) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2788029630 con 0x55ec9925fb90 2023-09-23T09:21:14.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.755+0000 7f27b2fa2b80 10 client.17001 fetch_fsmap learned FSMap version 76 2023-09-23T09:21:14.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.755+0000 7f27b2fa2b80 1 -- 172.21.15.82:0/4009808894 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=76,monmap=4+}) v3 -- 0x7f27981a5880 con 0x55ec9925fb90 2023-09-23T09:21:14.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.755+0000 7f2780ff9700 1 -- 172.21.15.82:0/4009808894 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f278803f080 con 0x55ec9925fb90 2023-09-23T09:21:14.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.756+0000 7f2780ff9700 1 -- 172.21.15.82:0/4009808894 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 76) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f2788031070 con 0x55ec9925fb90 2023-09-23T09:21:14.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.756+0000 7f27b2fa2b80 10 client.17001 fetch_fsmap finished waiting for FSMap version 76 2023-09-23T09:21:14.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.756+0000 7f27b2fa2b80 10 client.17001 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:21:14.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.756+0000 7f27b2fa2b80 20 client.17001 populate_metadata read hostname 'smithi082' 2023-09-23T09:21:14.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.756+0000 7f27b2fa2b80 1 --2- 172.21.15.82:0/4009808894 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55ec99273e50 0x55ec99276270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:21:14.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.756+0000 7f27b2fa2b80 4 client.17001 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:21:14.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.756+0000 7f27b2fa2b80 1 -- 172.21.15.82:0/4009808894 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ec99149ba0 con 0x55ec99273e50 2023-09-23T09:21:14.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.756+0000 7f279d39b700 1 --2- 172.21.15.82:0/4009808894 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55ec99273e50 0x55ec99276270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:21:14.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.757+0000 7f279d39b700 1 --2- 172.21.15.82:0/4009808894 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55ec99273e50 0x55ec99276270 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0eddfb9de419c71 server_cookie=98b9508779c905de in_seq=0 out_seq=0 2023-09-23T09:21:14.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.757+0000 7f2780ff9700 10 client.17001 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:21:14.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.758+0000 7f2780ff9700 1 -- 172.21.15.82:0/4009808894 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55ec99149ba0 con 0x55ec99273e50 2023-09-23T09:21:14.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.758+0000 7f2780ff9700 10 client.17001 handle_command_reply: tid=0 2023-09-23T09:21:14.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.758+0000 7f27b2fa2b80 1 client.17001 shutdown 2023-09-23T09:21:14.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.758+0000 7f27b2fa2b80 1 -- 172.21.15.82:0/4009808894 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec9925fb90 msgr2=0x55ec99263cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:21:14.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.758+0000 7f27b2fa2b80 1 --2- 172.21.15.82:0/4009808894 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec9925fb90 0x55ec99263cd0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f2788005110 tx=0x7f2788009ca0 comp rx=0 tx=0).stop 2023-09-23T09:21:14.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.758+0000 7f27b2fa2b80 1 -- 172.21.15.82:0/4009808894 shutdown_connections 2023-09-23T09:21:14.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.758+0000 7f27b2fa2b80 1 --2- 172.21.15.82:0/4009808894 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ec992604b0 0x55ec99264210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:21:14.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.758+0000 7f27b2fa2b80 1 --2- 172.21.15.82:0/4009808894 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec9925a450 0x55ec99263790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:21:14.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.758+0000 7f27b2fa2b80 1 --2- 172.21.15.82:0/4009808894 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55ec99273e50 0x55ec99276270 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:21:14.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.758+0000 7f27b2fa2b80 1 --2- 172.21.15.82:0/4009808894 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec9925fb90 0x55ec99263cd0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:21:14.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.758+0000 7f2780ff9700 0 client.17001 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:21:14.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.758+0000 7f27b2fa2b80 1 -- 172.21.15.82:0/4009808894 >> 172.21.15.82:0/4009808894 conn(0x55ec991c60e0 msgr2=0x55ec99246b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:21:14.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.758+0000 7f27b2fa2b80 1 -- 172.21.15.82:0/4009808894 shutdown_connections 2023-09-23T09:21:14.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.759+0000 7f27b2fa2b80 1 -- 172.21.15.82:0/4009808894 wait complete. 2023-09-23T09:21:14.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.759+0000 7f27b2fa2b80 20 client.17001 trim_cache size 0 max 16384 2023-09-23T09:21:14.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.779+0000 7f27b2fa2b80 1 Processor -- start 2023-09-23T09:21:14.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.779+0000 7f27b2fa2b80 1 -- start start 2023-09-23T09:21:14.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.780+0000 7f27b2fa2b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec9925a450 0x55ec99259f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:21:14.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.780+0000 7f27b2fa2b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec9925fb90 0x55ec9926aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:21:14.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.780+0000 7f27b2fa2b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ec992604b0 0x55ec9925ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:21:14.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.780+0000 7f27b2fa2b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec99025920 con 0x55ec9925a450 2023-09-23T09:21:14.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.780+0000 7f27b2fa2b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec9924d150 con 0x55ec9925fb90 2023-09-23T09:21:14.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.780+0000 7f27b2fa2b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec99248c80 con 0x55ec992604b0 2023-09-23T09:21:14.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.780+0000 7f279cb9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec9925fb90 0x55ec9926aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:21:14.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.780+0000 7f279cb9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec9925fb90 0x55ec9926aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:40602/0 (socket says 172.21.15.82:40602) 2023-09-23T09:21:14.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.780+0000 7f279cb9a700 1 -- 172.21.15.82:0/2181021167 learned_addr learned my addr 172.21.15.82:0/2181021167 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:21:14.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.780+0000 7f279db9c700 1 --2- 172.21.15.82:0/2181021167 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ec992604b0 0x55ec9925ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:21:14.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.780+0000 7f279d39b700 1 --2- 172.21.15.82:0/2181021167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec9925a450 0x55ec99259f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:21:14.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.781+0000 7f279db9c700 1 -- 172.21.15.82:0/2181021167 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec9925fb90 msgr2=0x55ec9926aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:21:14.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.781+0000 7f279db9c700 1 --2- 172.21.15.82:0/2181021167 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec9925fb90 0x55ec9926aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:21:14.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.781+0000 7f279db9c700 1 -- 172.21.15.82:0/2181021167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec9925a450 msgr2=0x55ec99259f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:21:14.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.781+0000 7f279db9c700 1 --2- 172.21.15.82:0/2181021167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec9925a450 0x55ec99259f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:21:14.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.781+0000 7f279db9c700 1 -- 172.21.15.82:0/2181021167 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ec98fcfde0 con 0x55ec992604b0 2023-09-23T09:21:14.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.781+0000 7f279db9c700 1 --2- 172.21.15.82:0/2181021167 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ec992604b0 0x55ec9925ef60 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2790094f90 tx=0x7f2790098420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=663dcb72acfa17b7 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:21:14.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.781+0000 7f2783fff700 1 -- 172.21.15.82:0/2181021167 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f279009c350 con 0x55ec992604b0 2023-09-23T09:21:14.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.781+0000 7f2783fff700 1 -- 172.21.15.82:0/2181021167 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f279009c170 con 0x55ec992604b0 2023-09-23T09:21:14.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.781+0000 7f2783fff700 1 -- 172.21.15.82:0/2181021167 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f279009e0b0 con 0x55ec992604b0 2023-09-23T09:21:14.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.782+0000 7f27b2fa2b80 1 -- 172.21.15.82:0/2181021167 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ec992604b0 msgr2=0x55ec9925ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:21:14.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.782+0000 7f27b2fa2b80 1 --2- 172.21.15.82:0/2181021167 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ec992604b0 0x55ec9925ef60 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2790094f90 tx=0x7f2790098420 comp rx=0 tx=0).stop 2023-09-23T09:21:14.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.782+0000 7f27b2fa2b80 1 -- 172.21.15.82:0/2181021167 shutdown_connections 2023-09-23T09:21:14.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.782+0000 7f27b2fa2b80 1 --2- 172.21.15.82:0/2181021167 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ec992604b0 0x55ec9925ef60 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:21:14.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.782+0000 7f27b2fa2b80 1 --2- 172.21.15.82:0/2181021167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec9925a450 0x55ec99259f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:21:14.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.782+0000 7f27b2fa2b80 1 --2- 172.21.15.82:0/2181021167 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec9925fb90 0x55ec9926aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:21:14.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.782+0000 7f27b2fa2b80 1 -- 172.21.15.82:0/2181021167 >> 172.21.15.82:0/2181021167 conn(0x55ec991c60e0 msgr2=0x55ec9925e850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:21:14.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.782+0000 7f27b2fa2b80 1 -- 172.21.15.82:0/2181021167 shutdown_connections 2023-09-23T09:21:14.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.782+0000 7f27b2fa2b80 1 -- 172.21.15.82:0/2181021167 wait complete. 2023-09-23T09:21:14.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.783+0000 7f27b2fa2b80 1 -- start start 2023-09-23T09:21:14.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.783+0000 7f27b2fa2b80 1 Processor -- start 2023-09-23T09:21:14.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.783+0000 7f27b2fa2b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec9925a450 0x55ec992c1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:21:14.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.784+0000 7f27b2fa2b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ec9925fb90 0x55ec992c1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:21:14.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.784+0000 7f27b2fa2b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec992604b0 0x55ec992bbc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:21:14.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.784+0000 7f27b2fa2b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec992bc320 con 0x55ec9925a450 2023-09-23T09:21:14.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.784+0000 7f27b2fa2b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec992bc490 con 0x55ec992604b0 2023-09-23T09:21:14.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.784+0000 7f27b2fa2b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec992bc650 con 0x55ec9925fb90 2023-09-23T09:21:14.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.784+0000 7f27b2fa2b80 10 client.0 _ll_register_callbacks cb 0x7f278800bdf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:21:14.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.784+0000 7f279d39b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec9925a450 0x55ec992c1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:21:14.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.784+0000 7f279d39b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec9925a450 0x55ec992c1580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54982/0 (socket says 172.21.15.82:54982) 2023-09-23T09:21:14.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.784+0000 7f279d39b700 1 -- 172.21.15.82:0/726722222 learned_addr learned my addr 172.21.15.82:0/726722222 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:21:14.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.784+0000 7f279db9c700 1 --2- 172.21.15.82:0/726722222 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec992604b0 0x55ec992bbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:21:14.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.784+0000 7f279cb9a700 1 --2- 172.21.15.82:0/726722222 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ec9925fb90 0x55ec992c1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:21:14.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.784+0000 7f279d39b700 1 -- 172.21.15.82:0/726722222 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ec9925fb90 msgr2=0x55ec992c1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:21:14.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.784+0000 7f279d39b700 1 --2- 172.21.15.82:0/726722222 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ec9925fb90 0x55ec992c1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:21:14.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.784+0000 7f279d39b700 1 -- 172.21.15.82:0/726722222 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec992604b0 msgr2=0x55ec992bbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:21:14.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.784+0000 7f279d39b700 1 --2- 172.21.15.82:0/726722222 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec992604b0 0x55ec992bbc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:21:14.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.784+0000 7f279d39b700 1 -- 172.21.15.82:0/726722222 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ec99023630 con 0x55ec9925a450 2023-09-23T09:21:14.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.785+0000 7f279d39b700 1 --2- 172.21.15.82:0/726722222 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec9925a450 0x55ec992c1580 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x55ec99276b50 tx=0x7f2794004460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59a445e3794100cf server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:21:14.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.785+0000 7f2780ff9700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:21:14.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.785+0000 7f2780ff9700 1 -- 172.21.15.82:0/726722222 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2794016070 con 0x55ec9925a450 2023-09-23T09:21:14.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.785+0000 7f27b2fa2b80 1 -- 172.21.15.82:0/726722222 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ec992448b0 con 0x55ec9925a450 2023-09-23T09:21:14.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.785+0000 7f2780ff9700 1 -- 172.21.15.82:0/726722222 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(124..124 src has 1..124) v4 ==== 8557+0+0 (secure 0 0 0) 0x7f2794010d60 con 0x55ec9925a450 2023-09-23T09:21:14.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.785+0000 7f2780ff9700 1 -- 172.21.15.82:0/726722222 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=76) v2 ==== 24+0+0 (secure 0 0 0) 0x7f279401d5a0 con 0x55ec9925a450 2023-09-23T09:21:14.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.785+0000 7f27b2fa2b80 10 client.17007 fetch_fsmap learned FSMap version 76 2023-09-23T09:21:14.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.785+0000 7f27b2fa2b80 1 -- 172.21.15.82:0/726722222 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=76,monmap=4+}) v3 -- 0x55ec98fb8c60 con 0x55ec9925a450 2023-09-23T09:21:14.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.786+0000 7f2780ff9700 1 -- 172.21.15.82:0/726722222 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55ec992448b0 con 0x55ec9925a450 2023-09-23T09:21:14.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.786+0000 7f2780ff9700 1 -- 172.21.15.82:0/726722222 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 76) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f2794023030 con 0x55ec9925a450 2023-09-23T09:21:14.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.786+0000 7f27b2fa2b80 10 client.17007 fetch_fsmap finished waiting for FSMap version 76 2023-09-23T09:21:14.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.786+0000 7f27b2fa2b80 10 client.17007 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:21:14.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.786+0000 7f27b2fa2b80 20 client.17007 populate_metadata read hostname 'smithi082' 2023-09-23T09:21:14.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.786+0000 7f27b2fa2b80 1 --2- 172.21.15.82:0/726722222 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55ec992c94d0 0x55ec992cb8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:21:14.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.786+0000 7f27b2fa2b80 4 client.17007 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:21:14.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.786+0000 7f27b2fa2b80 1 -- 172.21.15.82:0/726722222 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55ec9919c970 con 0x55ec992c94d0 2023-09-23T09:21:14.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.786+0000 7f279cb9a700 1 --2- 172.21.15.82:0/726722222 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55ec992c94d0 0x55ec992cb8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:21:14.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.787+0000 7f2780ff9700 10 client.17007 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:21:14.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.787+0000 7f279cb9a700 1 --2- 172.21.15.82:0/726722222 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55ec992c94d0 0x55ec992cb8f0 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=69fe6129cf420776 server_cookie=9df5cd64712a3a1f in_seq=0 out_seq=0 2023-09-23T09:21:14.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.787+0000 7f2780ff9700 1 -- 172.21.15.82:0/726722222 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55ec9919c970 con 0x55ec992c94d0 2023-09-23T09:21:14.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.787+0000 7f2780ff9700 10 client.17007 handle_command_reply: tid=0 2023-09-23T09:21:14.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.787+0000 7f27b2fa2b80 1 client.17007 shutdown 2023-09-23T09:21:14.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.787+0000 7f27b2fa2b80 1 -- 172.21.15.82:0/726722222 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec9925a450 msgr2=0x55ec992c1580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:21:14.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.787+0000 7f27b2fa2b80 1 --2- 172.21.15.82:0/726722222 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec9925a450 0x55ec992c1580 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x55ec99276b50 tx=0x7f2794004460 comp rx=0 tx=0).stop 2023-09-23T09:21:14.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.787+0000 7f27b2fa2b80 1 -- 172.21.15.82:0/726722222 shutdown_connections 2023-09-23T09:21:14.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.787+0000 7f27b2fa2b80 1 --2- 172.21.15.82:0/726722222 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec992604b0 0x55ec992bbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:21:14.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.787+0000 7f27b2fa2b80 1 --2- 172.21.15.82:0/726722222 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55ec992c94d0 0x55ec992cb8f0 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:21:14.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.787+0000 7f27b2fa2b80 1 --2- 172.21.15.82:0/726722222 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec9925a450 0x55ec992c1580 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:21:14.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.787+0000 7f27b2fa2b80 1 --2- 172.21.15.82:0/726722222 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ec9925fb90 0x55ec992c1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:21:14.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.787+0000 7f27b2fa2b80 1 -- 172.21.15.82:0/726722222 >> 172.21.15.82:0/726722222 conn(0x55ec991c60e0 msgr2=0x55ec992462b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:21:14.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.787+0000 7f2780ff9700 0 client.17007 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:21:14.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.788+0000 7f27b2fa2b80 1 -- 172.21.15.82:0/726722222 shutdown_connections 2023-09-23T09:21:14.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.788+0000 7f27b2fa2b80 1 -- 172.21.15.82:0/726722222 wait complete. 2023-09-23T09:21:14.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.788+0000 7f27b2fa2b80 20 client.17007 trim_cache size 0 max 16384 2023-09-23T09:21:14.794 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:21:14.794 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-23T09:21:14.794 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:21:14.794 INFO:teuthology.orchestra.run.smithi082.stdout: "047cbc72-e254-4787-b038-382de9c1a9a4": { 2023-09-23T09:21:14.794 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:21:14.794 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "047cbc72-e254-4787-b038-382de9c1a9a4", 2023-09-23T09:21:14.794 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:21:14.794 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:21:14.794 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:21:14.795 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:21:14.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.788+0000 7f279f5ff700 1 -- 172.21.15.82:0/42931928 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f27840a00c0 msgr2=0x7f27840a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:21:14.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.788+0000 7f279f5ff700 1 --2- 172.21.15.82:0/42931928 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f27840a00c0 0x7f27840a2580 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f278800c010 tx=0x7f278800bb80 comp rx=0 tx=0).stop 2023-09-23T09:21:14.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.788+0000 7f279f5ff700 1 -- 172.21.15.82:0/42931928 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27981068a0 msgr2=0x7f27981988e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:21:14.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.788+0000 7f279f5ff700 1 --2- 172.21.15.82:0/42931928 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27981068a0 0x7f27981988e0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f279000efc0 tx=0x7f279000c3a0 comp rx=0 tx=0).stop 2023-09-23T09:21:14.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.789+0000 7f279f5ff700 1 -- 172.21.15.82:0/42931928 shutdown_connections 2023-09-23T09:21:14.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.789+0000 7f279f5ff700 1 --2- 172.21.15.82:0/42931928 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f27840a00c0 0x7f27840a2580 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:21:14.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.789+0000 7f279f5ff700 1 --2- 172.21.15.82:0/42931928 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27981068a0 0x7f27981988e0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:21:14.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.789+0000 7f279f5ff700 1 --2- 172.21.15.82:0/42931928 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2798100890 0x7f279819e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:21:14.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.789+0000 7f279f5ff700 1 --2- 172.21.15.82:0/42931928 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2798101250 0x7f279819ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:21:14.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.789+0000 7f279f5ff700 1 -- 172.21.15.82:0/42931928 >> 172.21.15.82:0/42931928 conn(0x7f27980fc380 msgr2=0x7f279810bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:21:14.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.789+0000 7f279f5ff700 1 -- 172.21.15.82:0/42931928 shutdown_connections 2023-09-23T09:21:14.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:14.789+0000 7f279f5ff700 1 -- 172.21.15.82:0/42931928 wait complete. 2023-09-23T09:21:14.809 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:21:14 smithi082 ceph-mon[97694]: pgmap v768: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.3 MiB/s wr, 425 op/s 2023-09-23T09:21:14.811 INFO:tasks.cephfs.filesystem:scrub status for tag:047cbc72-e254-4787-b038-382de9c1a9a4 - {'path': '/', 'tag': '047cbc72-e254-4787-b038-382de9c1a9a4', 'options': 'recursive,force'} 2023-09-23T09:21:14.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:21:14 smithi135 ceph-mon[99205]: pgmap v768: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.3 MiB/s wr, 425 op/s 2023-09-23T09:21:14.916 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:21:14 smithi161 ceph-mon[99580]: pgmap v768: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.3 MiB/s wr, 425 op/s 2023-09-23T09:21:16.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:21:16 smithi135 ceph-mon[99205]: pgmap v769: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.0 MiB/s wr, 404 op/s 2023-09-23T09:21:16.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:21:16 smithi082 ceph-mon[97694]: pgmap v769: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.0 MiB/s wr, 404 op/s 2023-09-23T09:21:16.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:21:16 smithi161 ceph-mon[99580]: pgmap v769: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.0 MiB/s wr, 404 op/s 2023-09-23T09:21:18.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:21:17 smithi082 ceph-mon[97694]: osdmap e125: 12 total, 12 up, 12 in 2023-09-23T09:21:18.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:21:17 smithi082 ceph-mon[97694]: pgmap v771: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 257 op/s 2023-09-23T09:21:18.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:21:17 smithi161 ceph-mon[99580]: osdmap e125: 12 total, 12 up, 12 in 2023-09-23T09:21:18.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:21:17 smithi161 ceph-mon[99580]: pgmap v771: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 257 op/s 2023-09-23T09:21:18.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:21:17 smithi135 ceph-mon[99205]: osdmap e125: 12 total, 12 up, 12 in 2023-09-23T09:21:18.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:21:17 smithi135 ceph-mon[99205]: pgmap v771: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 257 op/s 2023-09-23T09:21:20.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:21:20 smithi135 ceph-mon[99205]: pgmap v772: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.7 MiB/s wr, 499 op/s 2023-09-23T09:21:20.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:21:20 smithi082 ceph-mon[97694]: pgmap v772: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.7 MiB/s wr, 499 op/s 2023-09-23T09:21:20.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:21:20 smithi161 ceph-mon[99580]: pgmap v772: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.7 MiB/s wr, 499 op/s 2023-09-23T09:21:22.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:21:22 smithi135 ceph-mon[99205]: pgmap v773: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.0 MiB/s wr, 401 op/s 2023-09-23T09:21:22.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:21:22 smithi082 ceph-mon[97694]: pgmap v773: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.0 MiB/s wr, 401 op/s 2023-09-23T09:21:22.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:21:22 smithi161 ceph-mon[99580]: pgmap v773: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.0 MiB/s wr, 401 op/s 2023-09-23T09:21:24.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:21:24 smithi135 ceph-mon[99205]: pgmap v774: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.0 MiB/s wr, 399 op/s 2023-09-23T09:21:24.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:21:24 smithi082 ceph-mon[97694]: pgmap v774: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.0 MiB/s wr, 399 op/s 2023-09-23T09:21:24.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:21:24 smithi161 ceph-mon[99580]: pgmap v774: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.0 MiB/s wr, 399 op/s 2023-09-23T09:21:26.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:21:26 smithi135 ceph-mon[99205]: pgmap v775: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 2.7 MiB/s wr, 360 op/s 2023-09-23T09:21:26.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:21:26 smithi082 ceph-mon[97694]: pgmap v775: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 2.7 MiB/s wr, 360 op/s 2023-09-23T09:21:26.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:21:26 smithi161 ceph-mon[99580]: pgmap v775: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 2.7 MiB/s wr, 360 op/s 2023-09-23T09:21:28.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:21:27 smithi082 ceph-mon[97694]: pgmap v776: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 526 KiB/s rd, 2.6 MiB/s wr, 339 op/s 2023-09-23T09:21:28.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:21:27 smithi161 ceph-mon[99580]: pgmap v776: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 526 KiB/s rd, 2.6 MiB/s wr, 339 op/s 2023-09-23T09:21:28.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:21:27 smithi135 ceph-mon[99205]: pgmap v776: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 526 KiB/s rd, 2.6 MiB/s wr, 339 op/s 2023-09-23T09:21:30.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:21:30 smithi135 ceph-mon[99205]: pgmap v777: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 3.5 MiB/s wr, 464 op/s 2023-09-23T09:21:30.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:21:30 smithi082 ceph-mon[97694]: pgmap v777: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 3.5 MiB/s wr, 464 op/s 2023-09-23T09:21:30.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:21:30 smithi161 ceph-mon[99580]: pgmap v777: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 3.5 MiB/s wr, 464 op/s 2023-09-23T09:21:32.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:21:32 smithi135 ceph-mon[99205]: pgmap v778: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 2.3 MiB/s wr, 303 op/s 2023-09-23T09:21:32.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:21:32 smithi082 ceph-mon[97694]: pgmap v778: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 2.3 MiB/s wr, 303 op/s 2023-09-23T09:21:32.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:21:32 smithi161 ceph-mon[99580]: pgmap v778: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 2.3 MiB/s wr, 303 op/s 2023-09-23T09:21:34.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:21:34 smithi135 ceph-mon[99205]: pgmap v779: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 2.3 MiB/s wr, 303 op/s 2023-09-23T09:21:34.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:21:34 smithi082 ceph-mon[97694]: pgmap v779: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 2.3 MiB/s wr, 303 op/s 2023-09-23T09:21:34.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:21:34 smithi161 ceph-mon[99580]: pgmap v779: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 2.3 MiB/s wr, 303 op/s 2023-09-23T09:21:36.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:21:36 smithi135 ceph-mon[99205]: pgmap v780: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 3.3 MiB/s wr, 436 op/s 2023-09-23T09:21:36.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:21:36 smithi082 ceph-mon[97694]: pgmap v780: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 3.3 MiB/s wr, 436 op/s 2023-09-23T09:21:36.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:21:36 smithi161 ceph-mon[99580]: pgmap v780: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 3.3 MiB/s wr, 436 op/s 2023-09-23T09:21:38.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:21:37 smithi082 ceph-mon[97694]: pgmap v781: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 2.3 MiB/s wr, 297 op/s 2023-09-23T09:21:38.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:21:37 smithi161 ceph-mon[99580]: pgmap v781: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 2.3 MiB/s wr, 297 op/s 2023-09-23T09:21:38.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:21:37 smithi135 ceph-mon[99205]: pgmap v781: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 2.3 MiB/s wr, 297 op/s 2023-09-23T09:21:40.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:21:40 smithi135 ceph-mon[99205]: pgmap v782: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 3.2 MiB/s wr, 419 op/s 2023-09-23T09:21:40.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:21:40 smithi082 ceph-mon[97694]: pgmap v782: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 3.2 MiB/s wr, 419 op/s 2023-09-23T09:21:40.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:21:40 smithi161 ceph-mon[99580]: pgmap v782: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 3.2 MiB/s wr, 419 op/s 2023-09-23T09:21:42.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:21:42 smithi135 ceph-mon[99205]: pgmap v783: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 1.9 MiB/s wr, 255 op/s 2023-09-23T09:21:42.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:21:42 smithi082 ceph-mon[97694]: pgmap v783: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 1.9 MiB/s wr, 255 op/s 2023-09-23T09:21:42.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:21:42 smithi161 ceph-mon[99580]: pgmap v783: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 1.9 MiB/s wr, 255 op/s 2023-09-23T09:21:44.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:21:44 smithi135 ceph-mon[99205]: pgmap v784: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 1.9 MiB/s wr, 255 op/s 2023-09-23T09:21:44.811 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:21:44.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:21:44 smithi082 ceph-mon[97694]: pgmap v784: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 1.9 MiB/s wr, 255 op/s 2023-09-23T09:21:44.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:21:44 smithi161 ceph-mon[99580]: pgmap v784: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 1.9 MiB/s wr, 255 op/s 2023-09-23T09:21:45.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.039+0000 7f61e7fff700 1 -- 172.21.15.82:0/540854038 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61e0102360 msgr2=0x7f61e010a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:21:45.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.039+0000 7f61e7fff700 1 --2- 172.21.15.82:0/540854038 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61e0102360 0x7f61e010a840 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f61d0009990 tx=0x7f61d0009ca0 comp rx=0 tx=0).stop 2023-09-23T09:21:45.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.039+0000 7f61e7fff700 1 -- 172.21.15.82:0/540854038 shutdown_connections 2023-09-23T09:21:45.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.039+0000 7f61e7fff700 1 --2- 172.21.15.82:0/540854038 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f61e010ae60 0x7f61e010d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:21:45.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.039+0000 7f61e7fff700 1 --2- 172.21.15.82:0/540854038 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61e0101a40 0x7f61e0101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:21:45.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.039+0000 7f61e7fff700 1 --2- 172.21.15.82:0/540854038 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61e0102360 0x7f61e010a840 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:21:45.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.039+0000 7f61e7fff700 1 -- 172.21.15.82:0/540854038 >> 172.21.15.82:0/540854038 conn(0x7f61e00fb260 msgr2=0x7f61e00fd680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:21:45.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.040+0000 7f61e7fff700 1 -- 172.21.15.82:0/540854038 shutdown_connections 2023-09-23T09:21:45.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.040+0000 7f61e7fff700 1 -- 172.21.15.82:0/540854038 wait complete. 2023-09-23T09:21:45.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.041+0000 7f61e7fff700 1 Processor -- start 2023-09-23T09:21:45.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.042+0000 7f61e7fff700 1 -- start start 2023-09-23T09:21:45.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.042+0000 7f61e7fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f61e0101a40 0x7f61e019e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:21:45.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.042+0000 7f61e7fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61e0102360 0x7f61e019eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:21:45.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.042+0000 7f61e7fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61e010ae60 0x7f61e0198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:21:45.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.042+0000 7f61e7fff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61e0199080 con 0x7f61e010ae60 2023-09-23T09:21:45.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.042+0000 7f61e7fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61e01991f0 con 0x7f61e0102360 2023-09-23T09:21:45.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.042+0000 7f61e7fff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61e01993b0 con 0x7f61e0101a40 2023-09-23T09:21:45.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.042+0000 7f61e659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61e010ae60 0x7f61e0198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:21:45.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.043+0000 7f61e5d9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f61e0101a40 0x7f61e019e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:21:45.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.043+0000 7f61e5d9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f61e0101a40 0x7f61e019e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:50470/0 (socket says 172.21.15.82:50470) 2023-09-23T09:21:45.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.043+0000 7f61e659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61e010ae60 0x7f61e0198a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35342/0 (socket says 172.21.15.82:35342) 2023-09-23T09:21:45.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.043+0000 7f61e5d9b700 1 -- 172.21.15.82:0/2383369302 learned_addr learned my addr 172.21.15.82:0/2383369302 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:21:45.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.043+0000 7f61e559a700 1 --2- 172.21.15.82:0/2383369302 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61e0102360 0x7f61e019eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:21:45.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.043+0000 7f61e659c700 1 -- 172.21.15.82:0/2383369302 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f61e0101a40 msgr2=0x7f61e019e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:21:45.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.043+0000 7f61e659c700 1 --2- 172.21.15.82:0/2383369302 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f61e0101a40 0x7f61e019e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:21:45.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.043+0000 7f61e659c700 1 -- 172.21.15.82:0/2383369302 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61e0102360 msgr2=0x7f61e019eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:21:45.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.043+0000 7f61e659c700 1 --2- 172.21.15.82:0/2383369302 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61e0102360 0x7f61e019eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:21:45.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.043+0000 7f61e659c700 1 -- 172.21.15.82:0/2383369302 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61d00095f0 con 0x7f61e010ae60 2023-09-23T09:21:45.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.043+0000 7f61e5d9b700 1 --2- 172.21.15.82:0/2383369302 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f61e0101a40 0x7f61e019e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:21:45.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.043+0000 7f61e659c700 1 --2- 172.21.15.82:0/2383369302 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61e010ae60 0x7f61e0198a20 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f61d800efc0 tx=0x7f61d800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:21:45.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.043+0000 7f61d6ffd700 1 -- 172.21.15.82:0/2383369302 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d8018070 con 0x7f61e010ae60 2023-09-23T09:21:45.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.043+0000 7f61d6ffd700 1 -- 172.21.15.82:0/2383369302 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f61d800f040 con 0x7f61e010ae60 2023-09-23T09:21:45.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.043+0000 7f61e7fff700 1 -- 172.21.15.82:0/2383369302 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61e0199630 con 0x7f61e010ae60 2023-09-23T09:21:45.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.043+0000 7f61d6ffd700 1 -- 172.21.15.82:0/2383369302 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d800cba0 con 0x7f61e010ae60 2023-09-23T09:21:45.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.044+0000 7f61e7fff700 1 -- 172.21.15.82:0/2383369302 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61e01a59a0 con 0x7f61e010ae60 2023-09-23T09:21:45.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.047+0000 7f61d6ffd700 1 -- 172.21.15.82:0/2383369302 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f61d8003a00 con 0x7f61e010ae60 2023-09-23T09:21:45.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.048+0000 7f61fb874b80 1 Processor -- start 2023-09-23T09:21:45.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.048+0000 7f61fb874b80 1 -- start start 2023-09-23T09:21:45.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.048+0000 7f61fb874b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f60ba35380 0x55f60ba35760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:21:45.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.049+0000 7f61fb874b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f60ba35ca0 0x55f60ba2f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:21:45.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.049+0000 7f61fb874b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f60ba2fc40 0x55f60ba300a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:21:45.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.049+0000 7f61fb874b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f60b9977b0 con 0x55f60ba35380 2023-09-23T09:21:45.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.049+0000 7f61fb874b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f60b988780 con 0x55f60ba35ca0 2023-09-23T09:21:45.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.049+0000 7f61fb874b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f60b9860a0 con 0x55f60ba2fc40 2023-09-23T09:21:45.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.049+0000 7f61e559a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f60ba35380 0x55f60ba35760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:21:45.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.049+0000 7f61e559a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f60ba35380 0x55f60ba35760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35356/0 (socket says 172.21.15.82:35356) 2023-09-23T09:21:45.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.049+0000 7f61e559a700 1 -- 172.21.15.82:0/2927394366 learned_addr learned my addr 172.21.15.82:0/2927394366 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:21:45.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.049+0000 7f61e5d9b700 1 --2- 172.21.15.82:0/2927394366 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f60ba35ca0 0x55f60ba2f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:21:45.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.049+0000 7f61e559a700 1 --2- 172.21.15.82:0/2927394366 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f60ba2fc40 0x55f60ba300a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:21:45.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.049+0000 7f61d6ffd700 1 --2- 172.21.15.82:0/2383369302 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f61cc0a0140 0x7f61cc0a2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:21:45.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.049+0000 7f61d6ffd700 1 -- 172.21.15.82:0/2383369302 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f61d80cb0d0 con 0x7f61e010ae60 2023-09-23T09:21:45.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.049+0000 7f61e559a700 1 -- 172.21.15.82:0/2927394366 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f60ba2fc40 msgr2=0x55f60ba300a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:21:45.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.049+0000 7f61e559a700 1 --2- 172.21.15.82:0/2927394366 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f60ba2fc40 0x55f60ba300a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:21:45.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.049+0000 7f61e559a700 1 -- 172.21.15.82:0/2927394366 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f60ba35ca0 msgr2=0x55f60ba2f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:21:45.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.049+0000 7f61e559a700 1 --2- 172.21.15.82:0/2927394366 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f60ba35ca0 0x55f60ba2f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:21:45.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.049+0000 7f61e659c700 1 --2- 172.21.15.82:0/2383369302 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f61cc0a0140 0x7f61cc0a2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:21:45.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.050+0000 7f61e559a700 1 -- 172.21.15.82:0/2927394366 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f60b801630 con 0x55f60ba35380 2023-09-23T09:21:45.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.050+0000 7f61e559a700 1 --2- 172.21.15.82:0/2927394366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f60ba35380 0x55f60ba35760 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f61d0009990 tx=0x7f61d000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cd650574111c817 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:21:45.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.050+0000 7f61cbfff700 1 -- 172.21.15.82:0/2927394366 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d000b710 con 0x55f60ba35380 2023-09-23T09:21:45.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.050+0000 7f61cbfff700 1 -- 172.21.15.82:0/2927394366 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f61d000bd00 con 0x55f60ba35380 2023-09-23T09:21:45.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.050+0000 7f61cbfff700 1 -- 172.21.15.82:0/2927394366 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d0004a80 con 0x55f60ba35380 2023-09-23T09:21:45.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.051+0000 7f61e659c700 1 --2- 172.21.15.82:0/2383369302 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f61cc0a0140 0x7f61cc0a2600 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f61d80c8820 tx=0x7f61d8009040 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:21:45.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.051+0000 7f61fb874b80 1 -- 172.21.15.82:0/2927394366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f60ba35380 msgr2=0x55f60ba35760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:21:45.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.051+0000 7f61fb874b80 1 --2- 172.21.15.82:0/2927394366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f60ba35380 0x55f60ba35760 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f61d0009990 tx=0x7f61d000b260 comp rx=0 tx=0).stop 2023-09-23T09:21:45.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.051+0000 7f61fb874b80 1 -- 172.21.15.82:0/2927394366 shutdown_connections 2023-09-23T09:21:45.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.051+0000 7f61fb874b80 1 --2- 172.21.15.82:0/2927394366 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f60ba2fc40 0x55f60ba300a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:21:45.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.051+0000 7f61fb874b80 1 --2- 172.21.15.82:0/2927394366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f60ba35380 0x55f60ba35760 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:21:45.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.051+0000 7f61fb874b80 1 --2- 172.21.15.82:0/2927394366 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f60ba35ca0 0x55f60ba2f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:21:45.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.051+0000 7f61fb874b80 1 -- 172.21.15.82:0/2927394366 >> 172.21.15.82:0/2927394366 conn(0x55f60b9a40e0 msgr2=0x55f60ba2a410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:21:45.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.051+0000 7f61fb874b80 1 -- 172.21.15.82:0/2927394366 shutdown_connections 2023-09-23T09:21:45.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.051+0000 7f61fb874b80 1 -- 172.21.15.82:0/2927394366 wait complete. 2023-09-23T09:21:45.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.052+0000 7f61fb874b80 1 -- start start 2023-09-23T09:21:45.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.052+0000 7f61fb874b80 1 Processor -- start 2023-09-23T09:21:45.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.053+0000 7f61fb874b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f60ba2fc40 0x55f60ba3bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:21:45.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.053+0000 7f61fb874b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f60ba35380 0x55f60ba38f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:21:45.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.053+0000 7f61fb874b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f60ba35ca0 0x55f60ba39660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:21:45.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.053+0000 7f61fb874b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f60b981990 con 0x55f60ba35ca0 2023-09-23T09:21:45.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.053+0000 7f61fb874b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f60b91fbb0 con 0x55f60ba35380 2023-09-23T09:21:45.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.053+0000 7f61fb874b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f60b91f8b0 con 0x55f60ba2fc40 2023-09-23T09:21:45.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.053+0000 7f61fb874b80 10 client.0 _ll_register_callbacks cb 0x55f60b869a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:21:45.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.053+0000 7f61e559a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f60ba2fc40 0x55f60ba3bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:21:45.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.053+0000 7f61e559a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f60ba2fc40 0x55f60ba3bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:50488/0 (socket says 172.21.15.82:50488) 2023-09-23T09:21:45.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.053+0000 7f61e559a700 1 -- 172.21.15.82:0/98980010 learned_addr learned my addr 172.21.15.82:0/98980010 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:21:45.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.053+0000 7f61e559a700 1 --2- 172.21.15.82:0/98980010 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f60ba35ca0 0x55f60ba39660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:21:45.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.053+0000 7f61e5d9b700 1 --2- 172.21.15.82:0/98980010 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f60ba35380 0x55f60ba38f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:21:45.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.054+0000 7f61e559a700 1 -- 172.21.15.82:0/98980010 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f60ba35380 msgr2=0x55f60ba38f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:21:45.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.054+0000 7f61e559a700 1 --2- 172.21.15.82:0/98980010 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f60ba35380 0x55f60ba38f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:21:45.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.054+0000 7f61e559a700 1 -- 172.21.15.82:0/98980010 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f60ba35ca0 msgr2=0x55f60ba39660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:21:45.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.054+0000 7f61e559a700 1 --2- 172.21.15.82:0/98980010 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f60ba35ca0 0x55f60ba39660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:21:45.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.054+0000 7f61e559a700 1 -- 172.21.15.82:0/98980010 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61d0020040 con 0x55f60ba2fc40 2023-09-23T09:21:45.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.054+0000 7f61e559a700 1 --2- 172.21.15.82:0/98980010 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f60ba2fc40 0x55f60ba3bc80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f61d00059d0 tx=0x7f61d00057e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b12b87ce7d2af26 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:21:45.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.054+0000 7f61c97fa700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T09:21:45.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.054+0000 7f61c97fa700 1 -- 172.21.15.82:0/98980010 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d000bc70 con 0x55f60ba2fc40 2023-09-23T09:21:45.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.054+0000 7f61fb874b80 1 -- 172.21.15.82:0/98980010 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f60b9ff1c0 con 0x55f60ba2fc40 2023-09-23T09:21:45.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.055+0000 7f61c97fa700 1 -- 172.21.15.82:0/98980010 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(125..125 src has 1..125) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f61d000bdd0 con 0x55f60ba2fc40 2023-09-23T09:21:45.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.055+0000 7f61c97fa700 1 -- 172.21.15.82:0/98980010 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=76) v2 ==== 24+0+0 (secure 0 0 0) 0x7f61d0004680 con 0x55f60ba2fc40 2023-09-23T09:21:45.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.055+0000 7f61fb874b80 10 client.26746 fetch_fsmap learned FSMap version 76 2023-09-23T09:21:45.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.055+0000 7f61fb874b80 1 -- 172.21.15.82:0/98980010 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=76,monmap=4+}) v3 -- 0x55f60b7adde0 con 0x55f60ba2fc40 2023-09-23T09:21:45.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.055+0000 7f61c97fa700 1 -- 172.21.15.82:0/98980010 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f60b9ff1c0 con 0x55f60ba2fc40 2023-09-23T09:21:45.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.055+0000 7f61c97fa700 1 -- 172.21.15.82:0/98980010 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 76) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f61d0042780 con 0x55f60ba2fc40 2023-09-23T09:21:45.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.055+0000 7f61fb874b80 10 client.26746 fetch_fsmap finished waiting for FSMap version 76 2023-09-23T09:21:45.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.055+0000 7f61fb874b80 10 client.26746 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:21:45.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.055+0000 7f61fb874b80 20 client.26746 populate_metadata read hostname 'smithi082' 2023-09-23T09:21:45.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.056+0000 7f61fb874b80 1 --2- 172.21.15.82:0/98980010 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55f60ba491d0 0x55f60ba4b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:21:45.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.056+0000 7f61fb874b80 4 client.26746 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:21:45.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.056+0000 7f61fb874b80 1 -- 172.21.15.82:0/98980010 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f60b927ba0 con 0x55f60ba491d0 2023-09-23T09:21:45.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.056+0000 7f61e5d9b700 1 --2- 172.21.15.82:0/98980010 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55f60ba491d0 0x55f60ba4b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:21:45.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.056+0000 7f61e5d9b700 1 --2- 172.21.15.82:0/98980010 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55f60ba491d0 0x55f60ba4b5c0 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=57258839e5906ec1 server_cookie=d81001e9a59eb9c2 in_seq=0 out_seq=0 2023-09-23T09:21:45.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.056+0000 7f61c97fa700 10 client.26746 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:21:45.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.057+0000 7f61c97fa700 1 -- 172.21.15.82:0/98980010 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f60b927ba0 con 0x55f60ba491d0 2023-09-23T09:21:45.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.057+0000 7f61c97fa700 10 client.26746 handle_command_reply: tid=0 2023-09-23T09:21:45.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.057+0000 7f61fb874b80 1 client.26746 shutdown 2023-09-23T09:21:45.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.057+0000 7f61fb874b80 1 -- 172.21.15.82:0/98980010 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f60ba2fc40 msgr2=0x55f60ba3bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:21:45.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.057+0000 7f61fb874b80 1 --2- 172.21.15.82:0/98980010 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f60ba2fc40 0x55f60ba3bc80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f61d00059d0 tx=0x7f61d00057e0 comp rx=0 tx=0).stop 2023-09-23T09:21:45.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.058+0000 7f61fb874b80 1 -- 172.21.15.82:0/98980010 shutdown_connections 2023-09-23T09:21:45.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.058+0000 7f61fb874b80 1 --2- 172.21.15.82:0/98980010 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55f60ba491d0 0x55f60ba4b5c0 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:21:45.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.058+0000 7f61fb874b80 1 --2- 172.21.15.82:0/98980010 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f60ba35ca0 0x55f60ba39660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:21:45.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.058+0000 7f61fb874b80 1 --2- 172.21.15.82:0/98980010 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f60ba2fc40 0x55f60ba3bc80 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:21:45.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.058+0000 7f61c97fa700 0 client.26746 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:21:45.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.058+0000 7f61fb874b80 1 --2- 172.21.15.82:0/98980010 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f60ba35380 0x55f60ba38f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:21:45.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.058+0000 7f61fb874b80 1 -- 172.21.15.82:0/98980010 >> 172.21.15.82:0/98980010 conn(0x55f60b9a40e0 msgr2=0x55f60ba24b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:21:45.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.058+0000 7f61fb874b80 1 -- 172.21.15.82:0/98980010 shutdown_connections 2023-09-23T09:21:45.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.058+0000 7f61fb874b80 1 -- 172.21.15.82:0/98980010 wait complete. 2023-09-23T09:21:45.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.058+0000 7f61fb874b80 20 client.26746 trim_cache size 0 max 16384 2023-09-23T09:21:45.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.081+0000 7f61fb874b80 1 Processor -- start 2023-09-23T09:21:45.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.081+0000 7f61fb874b80 1 -- start start 2023-09-23T09:21:45.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.082+0000 7f61fb874b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f60ba2fc40 0x55f60ba40740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:21:45.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.082+0000 7f61fb874b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f60ba35380 0x55f60ba3b820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:21:45.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.082+0000 7f61fb874b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f60ba35ca0 0x55f60ba38530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:21:45.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.082+0000 7f61fb874b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f60b803920 con 0x55f60ba35380 2023-09-23T09:21:45.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.082+0000 7f61fb874b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f60ba26c80 con 0x55f60ba35ca0 2023-09-23T09:21:45.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.082+0000 7f61fb874b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f60ba3a4e0 con 0x55f60ba2fc40 2023-09-23T09:21:45.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.082+0000 7f61e5d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f60ba35380 0x55f60ba3b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:21:45.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.082+0000 7f61e559a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f60ba2fc40 0x55f60ba40740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:21:45.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.082+0000 7f61e5d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f60ba35380 0x55f60ba3b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35362/0 (socket says 172.21.15.82:35362) 2023-09-23T09:21:45.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.082+0000 7f61e5d9b700 1 -- 172.21.15.82:0/1746517694 learned_addr learned my addr 172.21.15.82:0/1746517694 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:21:45.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.082+0000 7f61e559a700 1 --2- 172.21.15.82:0/1746517694 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f60ba2fc40 0x55f60ba40740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:50490/0 (socket says 172.21.15.82:50490) 2023-09-23T09:21:45.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.082+0000 7f61e559a700 1 --2- 172.21.15.82:0/1746517694 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f60ba35ca0 0x55f60ba38530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:21:45.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.082+0000 7f61e5d9b700 1 -- 172.21.15.82:0/1746517694 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f60ba2fc40 msgr2=0x55f60ba40740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:21:45.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.082+0000 7f61e5d9b700 1 --2- 172.21.15.82:0/1746517694 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f60ba2fc40 0x55f60ba40740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:21:45.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.082+0000 7f61e5d9b700 1 -- 172.21.15.82:0/1746517694 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f60ba35ca0 msgr2=0x55f60ba38530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:21:45.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.082+0000 7f61e5d9b700 1 --2- 172.21.15.82:0/1746517694 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f60ba35ca0 0x55f60ba38530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:21:45.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.082+0000 7f61e5d9b700 1 -- 172.21.15.82:0/1746517694 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f60ba500b0 con 0x55f60ba35380 2023-09-23T09:21:45.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.083+0000 7f61e5d9b700 1 --2- 172.21.15.82:0/1746517694 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f60ba35380 0x55f60ba3b820 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x55f60ba3c1e0 tx=0x7f61dc009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9dc6efda6872d53 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:21:45.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.083+0000 7f61d4ff9700 1 -- 172.21.15.82:0/1746517694 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61dc017040 con 0x55f60ba35380 2023-09-23T09:21:45.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.083+0000 7f61d4ff9700 1 -- 172.21.15.82:0/1746517694 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f61dc018040 con 0x55f60ba35380 2023-09-23T09:21:45.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.084+0000 7f61d4ff9700 1 -- 172.21.15.82:0/1746517694 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61dc004e70 con 0x55f60ba35380 2023-09-23T09:21:45.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.084+0000 7f61fb874b80 1 -- 172.21.15.82:0/1746517694 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f60ba35380 msgr2=0x55f60ba3b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:21:45.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.084+0000 7f61fb874b80 1 --2- 172.21.15.82:0/1746517694 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f60ba35380 0x55f60ba3b820 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x55f60ba3c1e0 tx=0x7f61dc009260 comp rx=0 tx=0).stop 2023-09-23T09:21:45.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.084+0000 7f61fb874b80 1 -- 172.21.15.82:0/1746517694 shutdown_connections 2023-09-23T09:21:45.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.084+0000 7f61fb874b80 1 --2- 172.21.15.82:0/1746517694 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f60ba35ca0 0x55f60ba38530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:21:45.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.084+0000 7f61fb874b80 1 --2- 172.21.15.82:0/1746517694 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f60ba2fc40 0x55f60ba40740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:21:45.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.084+0000 7f61fb874b80 1 --2- 172.21.15.82:0/1746517694 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f60ba35380 0x55f60ba3b820 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:21:45.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.084+0000 7f61fb874b80 1 -- 172.21.15.82:0/1746517694 >> 172.21.15.82:0/1746517694 conn(0x55f60b9a40e0 msgr2=0x55f60ba45a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:21:45.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.085+0000 7f61fb874b80 1 -- 172.21.15.82:0/1746517694 shutdown_connections 2023-09-23T09:21:45.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.085+0000 7f61fb874b80 1 -- 172.21.15.82:0/1746517694 wait complete. 2023-09-23T09:21:45.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.085+0000 7f61fb874b80 1 -- start start 2023-09-23T09:21:45.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.085+0000 7f61fb874b80 1 Processor -- start 2023-09-23T09:21:45.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.086+0000 7f61fb874b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f60ba2fc40 0x55f60ba403d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:21:45.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.086+0000 7f61fb874b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f60ba35380 0x55f60ba40910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:21:45.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.086+0000 7f61fb874b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f60ba35ca0 0x55f60ba3e900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:21:45.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.086+0000 7f61fb874b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f60ba3efd0 con 0x55f60ba2fc40 2023-09-23T09:21:45.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.086+0000 7f61fb874b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f60ba3f140 con 0x55f60ba35ca0 2023-09-23T09:21:45.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.086+0000 7f61fb874b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f60ba3f300 con 0x55f60ba35380 2023-09-23T09:21:45.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.086+0000 7f61fb874b80 10 client.0 _ll_register_callbacks cb 0x7f61d000b900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:21:45.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.086+0000 7f61e559a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f60ba2fc40 0x55f60ba403d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:21:45.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.086+0000 7f61e5d9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f60ba35380 0x55f60ba40910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:21:45.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.086+0000 7f61e5d9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f60ba35380 0x55f60ba40910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:50500/0 (socket says 172.21.15.82:50500) 2023-09-23T09:21:45.094 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.086+0000 7f61e5d9b700 1 -- 172.21.15.82:0/297622195 learned_addr learned my addr 172.21.15.82:0/297622195 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:21:45.094 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.086+0000 7f61e559a700 1 --2- 172.21.15.82:0/297622195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f60ba35ca0 0x55f60ba3e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:21:45.094 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.087+0000 7f61e559a700 1 -- 172.21.15.82:0/297622195 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f60ba35380 msgr2=0x55f60ba40910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:21:45.094 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.087+0000 7f61e559a700 1 --2- 172.21.15.82:0/297622195 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f60ba35380 0x55f60ba40910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:21:45.094 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.087+0000 7f61e559a700 1 -- 172.21.15.82:0/297622195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f60ba35ca0 msgr2=0x55f60ba3e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:21:45.094 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.087+0000 7f61e559a700 1 --2- 172.21.15.82:0/297622195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f60ba35ca0 0x55f60ba3e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:21:45.094 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.087+0000 7f61e559a700 1 -- 172.21.15.82:0/297622195 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f60b796c60 con 0x55f60ba2fc40 2023-09-23T09:21:45.094 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.087+0000 7f61e5d9b700 1 --2- 172.21.15.82:0/297622195 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f60ba35380 0x55f60ba40910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:21:45.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.087+0000 7f61e559a700 1 --2- 172.21.15.82:0/297622195 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f60ba2fc40 0x55f60ba403d0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f61d0009350 tx=0x7f61d00057e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2c544169edff691 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:21:45.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.087+0000 7f61c97fa700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:21:45.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.087+0000 7f61c97fa700 1 -- 172.21.15.82:0/297622195 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d000be00 con 0x55f60ba2fc40 2023-09-23T09:21:45.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.087+0000 7f61fb874b80 1 -- 172.21.15.82:0/297622195 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f60ba228b0 con 0x55f60ba2fc40 2023-09-23T09:21:45.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.087+0000 7f61c97fa700 1 -- 172.21.15.82:0/297622195 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(125..125 src has 1..125) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f61d0000e40 con 0x55f60ba2fc40 2023-09-23T09:21:45.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.088+0000 7f61c97fa700 1 -- 172.21.15.82:0/297622195 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=76) v2 ==== 24+0+0 (secure 0 0 0) 0x7f61d0042690 con 0x55f60ba2fc40 2023-09-23T09:21:45.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.088+0000 7f61fb874b80 10 client.17025 fetch_fsmap learned FSMap version 76 2023-09-23T09:21:45.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.088+0000 7f61fb874b80 1 -- 172.21.15.82:0/297622195 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=76,monmap=4+}) v3 -- 0x55f60b7d4250 con 0x55f60ba2fc40 2023-09-23T09:21:45.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.088+0000 7f61c97fa700 1 -- 172.21.15.82:0/297622195 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f60ba228b0 con 0x55f60ba2fc40 2023-09-23T09:21:45.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.088+0000 7f61c97fa700 1 -- 172.21.15.82:0/297622195 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 76) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f61d0029b30 con 0x55f60ba2fc40 2023-09-23T09:21:45.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.089+0000 7f61fb874b80 10 client.17025 fetch_fsmap finished waiting for FSMap version 76 2023-09-23T09:21:45.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.089+0000 7f61fb874b80 10 client.17025 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:21:45.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.089+0000 7f61fb874b80 20 client.17025 populate_metadata read hostname 'smithi082' 2023-09-23T09:21:45.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.089+0000 7f61fb874b80 1 --2- 172.21.15.82:0/297622195 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55f60ba9dd80 0x55f60baa0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:21:45.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.089+0000 7f61fb874b80 4 client.17025 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:21:45.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.089+0000 7f61fb874b80 1 -- 172.21.15.82:0/297622195 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55f60b97a970 con 0x55f60ba9dd80 2023-09-23T09:21:45.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.089+0000 7f61e5d9b700 1 --2- 172.21.15.82:0/297622195 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55f60ba9dd80 0x55f60baa0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:21:45.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.089+0000 7f61e5d9b700 1 --2- 172.21.15.82:0/297622195 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55f60ba9dd80 0x55f60baa0170 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f700e2915a35c20f server_cookie=cbf943ab83b1b3ca in_seq=0 out_seq=0 2023-09-23T09:21:45.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.089+0000 7f61c97fa700 10 client.17025 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:21:45.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.091+0000 7f61c97fa700 1 -- 172.21.15.82:0/297622195 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55f60b97a970 con 0x55f60ba9dd80 2023-09-23T09:21:45.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.091+0000 7f61c97fa700 10 client.17025 handle_command_reply: tid=0 2023-09-23T09:21:45.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.091+0000 7f61fb874b80 1 client.17025 shutdown 2023-09-23T09:21:45.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.091+0000 7f61fb874b80 1 -- 172.21.15.82:0/297622195 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f60ba2fc40 msgr2=0x55f60ba403d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:21:45.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.091+0000 7f61fb874b80 1 --2- 172.21.15.82:0/297622195 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f60ba2fc40 0x55f60ba403d0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f61d0009350 tx=0x7f61d00057e0 comp rx=0 tx=0).stop 2023-09-23T09:21:45.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.091+0000 7f61fb874b80 1 -- 172.21.15.82:0/297622195 shutdown_connections 2023-09-23T09:21:45.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.091+0000 7f61fb874b80 1 --2- 172.21.15.82:0/297622195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f60ba35ca0 0x55f60ba3e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:21:45.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.091+0000 7f61fb874b80 1 --2- 172.21.15.82:0/297622195 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55f60ba9dd80 0x55f60baa0170 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:21:45.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.091+0000 7f61fb874b80 1 --2- 172.21.15.82:0/297622195 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f60ba2fc40 0x55f60ba403d0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:21:45.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.091+0000 7f61fb874b80 1 --2- 172.21.15.82:0/297622195 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f60ba35380 0x55f60ba40910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:21:45.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.091+0000 7f61fb874b80 1 -- 172.21.15.82:0/297622195 >> 172.21.15.82:0/297622195 conn(0x55f60b9a40e0 msgr2=0x55f60ba330f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:21:45.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.091+0000 7f61c97fa700 0 client.17025 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:21:45.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.091+0000 7f61fb874b80 1 -- 172.21.15.82:0/297622195 shutdown_connections 2023-09-23T09:21:45.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.091+0000 7f61fb874b80 1 -- 172.21.15.82:0/297622195 wait complete. 2023-09-23T09:21:45.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.092+0000 7f61fb874b80 20 client.17025 trim_cache size 0 max 16384 2023-09-23T09:21:45.100 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:21:45.100 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-23T09:21:45.100 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:21:45.100 INFO:teuthology.orchestra.run.smithi082.stdout: "047cbc72-e254-4787-b038-382de9c1a9a4": { 2023-09-23T09:21:45.100 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:21:45.100 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "047cbc72-e254-4787-b038-382de9c1a9a4", 2023-09-23T09:21:45.100 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:21:45.100 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:21:45.101 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:21:45.101 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:21:45.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.092+0000 7f61e7fff700 1 -- 172.21.15.82:0/2383369302 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f61cc0a0140 msgr2=0x7f61cc0a2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:21:45.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.092+0000 7f61e7fff700 1 --2- 172.21.15.82:0/2383369302 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f61cc0a0140 0x7f61cc0a2600 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f61d80c8820 tx=0x7f61d8009040 comp rx=0 tx=0).stop 2023-09-23T09:21:45.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.092+0000 7f61e7fff700 1 -- 172.21.15.82:0/2383369302 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61e010ae60 msgr2=0x7f61e0198a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:21:45.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.092+0000 7f61e7fff700 1 --2- 172.21.15.82:0/2383369302 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61e010ae60 0x7f61e0198a20 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f61d800efc0 tx=0x7f61d800c3a0 comp rx=0 tx=0).stop 2023-09-23T09:21:45.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.092+0000 7f61e7fff700 1 -- 172.21.15.82:0/2383369302 shutdown_connections 2023-09-23T09:21:45.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.092+0000 7f61e7fff700 1 --2- 172.21.15.82:0/2383369302 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f61cc0a0140 0x7f61cc0a2600 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:21:45.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.092+0000 7f61e7fff700 1 --2- 172.21.15.82:0/2383369302 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61e010ae60 0x7f61e0198a20 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:21:45.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.092+0000 7f61e7fff700 1 --2- 172.21.15.82:0/2383369302 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f61e0101a40 0x7f61e019e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:21:45.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.092+0000 7f61e7fff700 1 --2- 172.21.15.82:0/2383369302 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61e0102360 0x7f61e019eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:21:45.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.092+0000 7f61e7fff700 1 -- 172.21.15.82:0/2383369302 >> 172.21.15.82:0/2383369302 conn(0x7f61e00fb260 msgr2=0x7f61e00fd650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:21:45.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.092+0000 7f61e7fff700 1 -- 172.21.15.82:0/2383369302 shutdown_connections 2023-09-23T09:21:45.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:21:45.093+0000 7f61e7fff700 1 -- 172.21.15.82:0/2383369302 wait complete. 2023-09-23T09:21:45.115 INFO:tasks.cephfs.filesystem:scrub status for tag:047cbc72-e254-4787-b038-382de9c1a9a4 - {'path': '/', 'tag': '047cbc72-e254-4787-b038-382de9c1a9a4', 'options': 'recursive,force'} 2023-09-23T09:21:45.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:21:45 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:21:45.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:21:45 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:21:45.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:21:45 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:21:46.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:21:46 smithi135 ceph-mon[99205]: pgmap v785: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 3.4 MiB/s wr, 403 op/s 2023-09-23T09:21:46.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:21:46 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:21:46.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:21:46 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:21:46.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:21:46 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:21:46.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:21:46 smithi082 ceph-mon[97694]: pgmap v785: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 3.4 MiB/s wr, 403 op/s 2023-09-23T09:21:46.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:21:46 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:21:46.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:21:46 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:21:46.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:21:46 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:21:46.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:21:46 smithi161 ceph-mon[99580]: pgmap v785: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 3.4 MiB/s wr, 403 op/s 2023-09-23T09:21:46.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:21:46 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:21:46.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:21:46 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:21:46.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:21:46 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:21:48.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:21:47 smithi082 ceph-mon[97694]: pgmap v786: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 2.4 MiB/s wr, 270 op/s 2023-09-23T09:21:48.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:21:47 smithi161 ceph-mon[99580]: pgmap v786: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 2.4 MiB/s wr, 270 op/s 2023-09-23T09:21:48.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:21:47 smithi135 ceph-mon[99205]: pgmap v786: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 2.4 MiB/s wr, 270 op/s 2023-09-23T09:21:50.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:21:50 smithi135 ceph-mon[99205]: pgmap v787: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 3.5 MiB/s wr, 419 op/s 2023-09-23T09:21:50.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:21:50 smithi082 ceph-mon[97694]: pgmap v787: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 3.5 MiB/s wr, 419 op/s 2023-09-23T09:21:50.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:21:50 smithi161 ceph-mon[99580]: pgmap v787: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 3.5 MiB/s wr, 419 op/s 2023-09-23T09:21:52.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:21:52 smithi135 ceph-mon[99205]: pgmap v788: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 2.6 MiB/s wr, 297 op/s 2023-09-23T09:21:52.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:21:52 smithi082 ceph-mon[97694]: pgmap v788: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 2.6 MiB/s wr, 297 op/s 2023-09-23T09:21:52.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:21:52 smithi161 ceph-mon[99580]: pgmap v788: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 2.6 MiB/s wr, 297 op/s 2023-09-23T09:21:54.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:21:54 smithi135 ceph-mon[99205]: pgmap v789: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 2.6 MiB/s wr, 297 op/s 2023-09-23T09:21:54.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:21:54 smithi082 ceph-mon[97694]: pgmap v789: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 2.6 MiB/s wr, 297 op/s 2023-09-23T09:21:54.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:21:54 smithi161 ceph-mon[99580]: pgmap v789: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 2.6 MiB/s wr, 297 op/s 2023-09-23T09:21:56.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:21:56 smithi135 ceph-mon[99205]: pgmap v790: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 3.7 MiB/s wr, 439 op/s 2023-09-23T09:21:56.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:21:56 smithi082 ceph-mon[97694]: pgmap v790: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 3.7 MiB/s wr, 439 op/s 2023-09-23T09:21:56.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:21:56 smithi161 ceph-mon[99580]: pgmap v790: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 3.7 MiB/s wr, 439 op/s 2023-09-23T09:21:58.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:21:57 smithi082 ceph-mon[97694]: pgmap v791: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 2.2 MiB/s wr, 292 op/s 2023-09-23T09:21:58.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:21:57 smithi161 ceph-mon[99580]: pgmap v791: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 2.2 MiB/s wr, 292 op/s 2023-09-23T09:21:58.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:21:57 smithi135 ceph-mon[99205]: pgmap v791: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 2.2 MiB/s wr, 292 op/s 2023-09-23T09:22:00.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:22:00 smithi135 ceph-mon[99205]: pgmap v792: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 3.3 MiB/s wr, 434 op/s 2023-09-23T09:22:00.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:22:00 smithi082 ceph-mon[97694]: pgmap v792: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 3.3 MiB/s wr, 434 op/s 2023-09-23T09:22:00.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:22:00 smithi161 ceph-mon[99580]: pgmap v792: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 3.3 MiB/s wr, 434 op/s 2023-09-23T09:22:02.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:22:02 smithi135 ceph-mon[99205]: pgmap v793: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 2.2 MiB/s wr, 284 op/s 2023-09-23T09:22:02.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:22:02 smithi082 ceph-mon[97694]: pgmap v793: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 2.2 MiB/s wr, 284 op/s 2023-09-23T09:22:02.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:22:02 smithi161 ceph-mon[99580]: pgmap v793: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 2.2 MiB/s wr, 284 op/s 2023-09-23T09:22:04.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:22:04 smithi135 ceph-mon[99205]: pgmap v794: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 2.2 MiB/s wr, 284 op/s 2023-09-23T09:22:04.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:22:04 smithi082 ceph-mon[97694]: pgmap v794: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 2.2 MiB/s wr, 284 op/s 2023-09-23T09:22:04.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:22:04 smithi161 ceph-mon[99580]: pgmap v794: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 2.2 MiB/s wr, 284 op/s 2023-09-23T09:22:06.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:22:06 smithi135 ceph-mon[99205]: pgmap v795: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 3.5 MiB/s wr, 441 op/s 2023-09-23T09:22:06.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:22:06 smithi082 ceph-mon[97694]: pgmap v795: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 3.5 MiB/s wr, 441 op/s 2023-09-23T09:22:06.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:22:06 smithi161 ceph-mon[99580]: pgmap v795: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 3.5 MiB/s wr, 441 op/s 2023-09-23T09:22:08.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:22:07 smithi082 ceph-mon[97694]: pgmap v796: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 2.4 MiB/s wr, 299 op/s 2023-09-23T09:22:08.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:22:07 smithi161 ceph-mon[99580]: pgmap v796: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 2.4 MiB/s wr, 299 op/s 2023-09-23T09:22:08.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:22:07 smithi135 ceph-mon[99205]: pgmap v796: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 2.4 MiB/s wr, 299 op/s 2023-09-23T09:22:10.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:22:10 smithi135 ceph-mon[99205]: pgmap v797: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 3.5 MiB/s wr, 442 op/s 2023-09-23T09:22:10.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:22:10 smithi082 ceph-mon[97694]: pgmap v797: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 3.5 MiB/s wr, 442 op/s 2023-09-23T09:22:10.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:22:10 smithi161 ceph-mon[99580]: pgmap v797: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 3.5 MiB/s wr, 442 op/s 2023-09-23T09:22:12.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:22:12 smithi135 ceph-mon[99205]: pgmap v798: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 2.4 MiB/s wr, 300 op/s 2023-09-23T09:22:12.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:22:12 smithi135 ceph-mon[99205]: osdmap e126: 12 total, 12 up, 12 in 2023-09-23T09:22:12.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:22:12 smithi082 ceph-mon[97694]: pgmap v798: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 2.4 MiB/s wr, 300 op/s 2023-09-23T09:22:12.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:22:12 smithi082 ceph-mon[97694]: osdmap e126: 12 total, 12 up, 12 in 2023-09-23T09:22:12.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:22:12 smithi161 ceph-mon[99580]: pgmap v798: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 2.4 MiB/s wr, 300 op/s 2023-09-23T09:22:12.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:22:12 smithi161 ceph-mon[99580]: osdmap e126: 12 total, 12 up, 12 in 2023-09-23T09:22:14.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:22:14 smithi135 ceph-mon[99205]: pgmap v800: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 2.9 MiB/s wr, 360 op/s 2023-09-23T09:22:14.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:22:14 smithi082 ceph-mon[97694]: pgmap v800: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 2.9 MiB/s wr, 360 op/s 2023-09-23T09:22:14.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:22:14 smithi161 ceph-mon[99580]: pgmap v800: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 2.9 MiB/s wr, 360 op/s 2023-09-23T09:22:15.116 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:22:15.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.361+0000 7f14321ff700 1 -- 172.21.15.82:0/86585054 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f142c101a30 msgr2=0x7f142c101e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:22:15.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.361+0000 7f14321ff700 1 --2- 172.21.15.82:0/86585054 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f142c101a30 0x7f142c101e10 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f141c009990 tx=0x7f141c009ca0 comp rx=0 tx=0).stop 2023-09-23T09:22:15.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.361+0000 7f14321ff700 1 -- 172.21.15.82:0/86585054 shutdown_connections 2023-09-23T09:22:15.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.361+0000 7f14321ff700 1 --2- 172.21.15.82:0/86585054 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f142c10ae50 0x7f142c10d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:22:15.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.361+0000 7f14321ff700 1 --2- 172.21.15.82:0/86585054 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f142c101a30 0x7f142c101e10 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:22:15.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.361+0000 7f14321ff700 1 --2- 172.21.15.82:0/86585054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f142c102350 0x7f142c10a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:22:15.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.361+0000 7f14321ff700 1 -- 172.21.15.82:0/86585054 >> 172.21.15.82:0/86585054 conn(0x7f142c0fb270 msgr2=0x7f142c0fd690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:22:15.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.361+0000 7f14321ff700 1 -- 172.21.15.82:0/86585054 shutdown_connections 2023-09-23T09:22:15.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.361+0000 7f14321ff700 1 -- 172.21.15.82:0/86585054 wait complete. 2023-09-23T09:22:15.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.362+0000 7f14321ff700 1 Processor -- start 2023-09-23T09:22:15.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.363+0000 7f14321ff700 1 -- start start 2023-09-23T09:22:15.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.363+0000 7f14321ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f142c101a30 0x7f142c0ff680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:22:15.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.363+0000 7f14321ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f142c102350 0x7f142c0ffbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:22:15.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.363+0000 7f14321ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f142c10ae50 0x7f142c1a4af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:22:15.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.363+0000 7f14321ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f142c1003f0 con 0x7f142c10ae50 2023-09-23T09:22:15.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.363+0000 7f14321ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f142c1a5030 con 0x7f142c101a30 2023-09-23T09:22:15.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.363+0000 7f14321ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f142c1a5170 con 0x7f142c102350 2023-09-23T09:22:15.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.363+0000 7f142b7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f142c101a30 0x7f142c0ff680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:22:15.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.363+0000 7f142affd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f142c102350 0x7f142c0ffbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:22:15.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.363+0000 7f142b7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f142c101a30 0x7f142c0ff680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:46386/0 (socket says 172.21.15.82:46386) 2023-09-23T09:22:15.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.363+0000 7f142b7fe700 1 -- 172.21.15.82:0/1770592647 learned_addr learned my addr 172.21.15.82:0/1770592647 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:22:15.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.363+0000 7f142bfff700 1 --2- 172.21.15.82:0/1770592647 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f142c10ae50 0x7f142c1a4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:22:15.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.364+0000 7f142b7fe700 1 -- 172.21.15.82:0/1770592647 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f142c102350 msgr2=0x7f142c0ffbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:22:15.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.364+0000 7f142b7fe700 1 --2- 172.21.15.82:0/1770592647 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f142c102350 0x7f142c0ffbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:22:15.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.364+0000 7f142b7fe700 1 -- 172.21.15.82:0/1770592647 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f142c10ae50 msgr2=0x7f142c1a4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:22:15.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.364+0000 7f142b7fe700 1 --2- 172.21.15.82:0/1770592647 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f142c10ae50 0x7f142c1a4af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:22:15.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.364+0000 7f142b7fe700 1 -- 172.21.15.82:0/1770592647 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f141c0095f0 con 0x7f142c101a30 2023-09-23T09:22:15.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.364+0000 7f142bfff700 1 --2- 172.21.15.82:0/1770592647 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f142c10ae50 0x7f142c1a4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:22:15.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.364+0000 7f142b7fe700 1 --2- 172.21.15.82:0/1770592647 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f142c101a30 0x7f142c0ff680 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f141c005770 tx=0x7f141c0057a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:22:15.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.364+0000 7f1428ff9700 1 -- 172.21.15.82:0/1770592647 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f141c01d070 con 0x7f142c101a30 2023-09-23T09:22:15.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.364+0000 7f1428ff9700 1 -- 172.21.15.82:0/1770592647 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f141c021410 con 0x7f142c101a30 2023-09-23T09:22:15.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.364+0000 7f14321ff700 1 -- 172.21.15.82:0/1770592647 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f142c1a5370 con 0x7f142c101a30 2023-09-23T09:22:15.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.364+0000 7f1428ff9700 1 -- 172.21.15.82:0/1770592647 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f141c0173f0 con 0x7f142c101a30 2023-09-23T09:22:15.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.365+0000 7f14321ff700 1 -- 172.21.15.82:0/1770592647 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f142c1a5840 con 0x7f142c101a30 2023-09-23T09:22:15.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.368+0000 7f1428ff9700 1 -- 172.21.15.82:0/1770592647 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f141c00fac0 con 0x7f142c101a30 2023-09-23T09:22:15.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.369+0000 7f1445b09b80 1 Processor -- start 2023-09-23T09:22:15.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.369+0000 7f1445b09b80 1 -- start start 2023-09-23T09:22:15.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.370+0000 7f1445b09b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5639901d5380 0x5639901d5760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:22:15.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.370+0000 7f1445b09b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639901d5ca0 0x5639901cf700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:22:15.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.370+0000 7f1445b09b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5639901cfc40 0x5639901d00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:22:15.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.370+0000 7f1445b09b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639901377b0 con 0x5639901cfc40 2023-09-23T09:22:15.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.370+0000 7f1445b09b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x563990128780 con 0x5639901d5ca0 2023-09-23T09:22:15.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.370+0000 7f1445b09b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639901260a0 con 0x5639901d5380 2023-09-23T09:22:15.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.370+0000 7f1428ff9700 1 --2- 172.21.15.82:0/1770592647 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f14140a0140 0x7f14140a2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:22:15.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.370+0000 7f142affd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5639901cfc40 0x5639901d00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:22:15.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.370+0000 7f142b7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639901d5ca0 0x5639901cf700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:22:15.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.370+0000 7f142affd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5639901cfc40 0x5639901d00a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58422/0 (socket says 172.21.15.82:58422) 2023-09-23T09:22:15.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.370+0000 7f142affd700 1 -- 172.21.15.82:0/2922815123 learned_addr learned my addr 172.21.15.82:0/2922815123 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:22:15.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.370+0000 7f142bfff700 1 --2- 172.21.15.82:0/2922815123 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5639901d5380 0x5639901d5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:22:15.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.370+0000 7f142bfff700 1 --2- 172.21.15.82:0/1770592647 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f14140a0140 0x7f14140a2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:22:15.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.371+0000 7f1428ff9700 1 -- 172.21.15.82:0/1770592647 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 8557+0+0 (secure 0 0 0) 0x7f141c0cc9f0 con 0x7f142c101a30 2023-09-23T09:22:15.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.371+0000 7f142b7fe700 1 -- 172.21.15.82:0/2922815123 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5639901d5380 msgr2=0x5639901d5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:22:15.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.371+0000 7f142b7fe700 1 --2- 172.21.15.82:0/2922815123 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5639901d5380 0x5639901d5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:22:15.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.371+0000 7f142b7fe700 1 -- 172.21.15.82:0/2922815123 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5639901cfc40 msgr2=0x5639901d00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:22:15.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.371+0000 7f142b7fe700 1 --2- 172.21.15.82:0/2922815123 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5639901cfc40 0x5639901d00a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:22:15.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.371+0000 7f142b7fe700 1 -- 172.21.15.82:0/2922815123 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56398ffa1630 con 0x5639901d5ca0 2023-09-23T09:22:15.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.371+0000 7f142affd700 1 --2- 172.21.15.82:0/2922815123 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5639901cfc40 0x5639901d00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:22:15.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.371+0000 7f142b7fe700 1 --2- 172.21.15.82:0/2922815123 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639901d5ca0 0x5639901cf700 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f141c0ca0c0 tx=0x7f141c06c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b973e103e7a6e293 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:22:15.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.371+0000 7f142bfff700 1 --2- 172.21.15.82:0/1770592647 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f14140a0140 0x7f14140a2600 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f142c101790 tx=0x7f1424009260 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:22:15.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.371+0000 7f1411ffb700 1 -- 172.21.15.82:0/2922815123 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f141c099b90 con 0x5639901d5ca0 2023-09-23T09:22:15.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.371+0000 7f1411ffb700 1 -- 172.21.15.82:0/2922815123 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f141c09a930 con 0x5639901d5ca0 2023-09-23T09:22:15.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.371+0000 7f1411ffb700 1 -- 172.21.15.82:0/2922815123 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f141c066160 con 0x5639901d5ca0 2023-09-23T09:22:15.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.372+0000 7f1445b09b80 1 -- 172.21.15.82:0/2922815123 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639901d5ca0 msgr2=0x5639901cf700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:22:15.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.372+0000 7f1445b09b80 1 --2- 172.21.15.82:0/2922815123 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639901d5ca0 0x5639901cf700 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f141c0ca0c0 tx=0x7f141c06c3c0 comp rx=0 tx=0).stop 2023-09-23T09:22:15.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.372+0000 7f1445b09b80 1 -- 172.21.15.82:0/2922815123 shutdown_connections 2023-09-23T09:22:15.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.372+0000 7f1445b09b80 1 --2- 172.21.15.82:0/2922815123 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5639901cfc40 0x5639901d00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:22:15.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.372+0000 7f1445b09b80 1 --2- 172.21.15.82:0/2922815123 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5639901d5380 0x5639901d5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:22:15.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.372+0000 7f1445b09b80 1 --2- 172.21.15.82:0/2922815123 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639901d5ca0 0x5639901cf700 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:22:15.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.372+0000 7f1445b09b80 1 -- 172.21.15.82:0/2922815123 >> 172.21.15.82:0/2922815123 conn(0x5639901440e0 msgr2=0x5639901ca410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:22:15.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.372+0000 7f1445b09b80 1 -- 172.21.15.82:0/2922815123 shutdown_connections 2023-09-23T09:22:15.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.373+0000 7f1445b09b80 1 -- 172.21.15.82:0/2922815123 wait complete. 2023-09-23T09:22:15.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.373+0000 7f1445b09b80 1 -- start start 2023-09-23T09:22:15.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.373+0000 7f1445b09b80 1 Processor -- start 2023-09-23T09:22:15.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.374+0000 7f1445b09b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5639901cfc40 0x5639901dbc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:22:15.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.374+0000 7f1445b09b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5639901d5380 0x5639901d8f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:22:15.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.374+0000 7f1445b09b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639901d5ca0 0x5639901d9690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:22:15.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.374+0000 7f1445b09b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x563990121990 con 0x5639901cfc40 2023-09-23T09:22:15.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.374+0000 7f1445b09b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639900bfbb0 con 0x5639901d5ca0 2023-09-23T09:22:15.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.374+0000 7f1445b09b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639900bf8b0 con 0x5639901d5380 2023-09-23T09:22:15.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.374+0000 7f1445b09b80 10 client.0 _ll_register_callbacks cb 0x563990009a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:22:15.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.374+0000 7f142b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5639901cfc40 0x5639901dbc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:22:15.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.374+0000 7f142bfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639901d5ca0 0x5639901d9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:22:15.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.374+0000 7f142affd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5639901d5380 0x5639901d8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:22:15.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.374+0000 7f142bfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639901d5ca0 0x5639901d9690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:46400/0 (socket says 172.21.15.82:46400) 2023-09-23T09:22:15.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.374+0000 7f142bfff700 1 -- 172.21.15.82:0/1034410902 learned_addr learned my addr 172.21.15.82:0/1034410902 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:22:15.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.374+0000 7f142b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5639901cfc40 0x5639901dbc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58426/0 (socket says 172.21.15.82:58426) 2023-09-23T09:22:15.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.374+0000 7f142affd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5639901d5380 0x5639901d8f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:59214/0 (socket says 172.21.15.82:59214) 2023-09-23T09:22:15.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.375+0000 7f142affd700 1 -- 172.21.15.82:0/1034410902 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639901d5ca0 msgr2=0x5639901d9690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:22:15.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.375+0000 7f142affd700 1 --2- 172.21.15.82:0/1034410902 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639901d5ca0 0x5639901d9690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:22:15.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.375+0000 7f142affd700 1 -- 172.21.15.82:0/1034410902 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5639901cfc40 msgr2=0x5639901dbc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:22:15.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.375+0000 7f142affd700 1 --2- 172.21.15.82:0/1034410902 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5639901cfc40 0x5639901dbc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:22:15.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.375+0000 7f142affd700 1 -- 172.21.15.82:0/1034410902 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14200112d0 con 0x5639901d5380 2023-09-23T09:22:15.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.375+0000 7f142affd700 1 --2- 172.21.15.82:0/1034410902 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5639901d5380 0x5639901d8f50 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1420011fe0 tx=0x7f1420014600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ec99bc9710182c1 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:22:15.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.375+0000 7f140affd700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T09:22:15.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.375+0000 7f140affd700 1 -- 172.21.15.82:0/1034410902 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142000e040 con 0x5639901d5380 2023-09-23T09:22:15.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.375+0000 7f1445b09b80 1 -- 172.21.15.82:0/1034410902 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56399019f1c0 con 0x5639901d5380 2023-09-23T09:22:15.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.375+0000 7f140affd700 1 -- 172.21.15.82:0/1034410902 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(126..126 src has 1..126) v4 ==== 8557+0+0 (secure 0 0 0) 0x7f1420004db0 con 0x5639901d5380 2023-09-23T09:22:15.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.376+0000 7f140affd700 1 -- 172.21.15.82:0/1034410902 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=76) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1420014e90 con 0x5639901d5380 2023-09-23T09:22:15.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.376+0000 7f1445b09b80 10 client.26764 fetch_fsmap learned FSMap version 76 2023-09-23T09:22:15.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.376+0000 7f1445b09b80 1 -- 172.21.15.82:0/1034410902 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=76,monmap=4+}) v3 -- 0x7f142c1a5840 con 0x5639901d5380 2023-09-23T09:22:15.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.376+0000 7f140affd700 1 -- 172.21.15.82:0/1034410902 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56399019f1c0 con 0x5639901d5380 2023-09-23T09:22:15.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.376+0000 7f140affd700 1 -- 172.21.15.82:0/1034410902 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 76) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f142001c030 con 0x5639901d5380 2023-09-23T09:22:15.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.376+0000 7f1445b09b80 10 client.26764 fetch_fsmap finished waiting for FSMap version 76 2023-09-23T09:22:15.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.376+0000 7f1445b09b80 10 client.26764 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:22:15.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.376+0000 7f1445b09b80 20 client.26764 populate_metadata read hostname 'smithi082' 2023-09-23T09:22:15.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.376+0000 7f1445b09b80 1 --2- 172.21.15.82:0/1034410902 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5639901e93f0 0x5639901eb810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:22:15.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.376+0000 7f1445b09b80 4 client.26764 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:22:15.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.376+0000 7f1445b09b80 1 -- 172.21.15.82:0/1034410902 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5639900c7ba0 con 0x5639901e93f0 2023-09-23T09:22:15.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.377+0000 7f142b7fe700 1 --2- 172.21.15.82:0/1034410902 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5639901e93f0 0x5639901eb810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:22:15.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.377+0000 7f142b7fe700 1 --2- 172.21.15.82:0/1034410902 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5639901e93f0 0x5639901eb810 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ef3e5e0c123fe09 server_cookie=876bb0ecc0ac8050 in_seq=0 out_seq=0 2023-09-23T09:22:15.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.377+0000 7f140affd700 10 client.26764 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:22:15.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.378+0000 7f140affd700 1 -- 172.21.15.82:0/1034410902 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5639900c7ba0 con 0x5639901e93f0 2023-09-23T09:22:15.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.378+0000 7f140affd700 10 client.26764 handle_command_reply: tid=0 2023-09-23T09:22:15.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.378+0000 7f1445b09b80 1 client.26764 shutdown 2023-09-23T09:22:15.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.378+0000 7f1445b09b80 1 -- 172.21.15.82:0/1034410902 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5639901d5380 msgr2=0x5639901d8f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:22:15.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.378+0000 7f1445b09b80 1 --2- 172.21.15.82:0/1034410902 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5639901d5380 0x5639901d8f50 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1420011fe0 tx=0x7f1420014600 comp rx=0 tx=0).stop 2023-09-23T09:22:15.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.378+0000 7f1445b09b80 1 -- 172.21.15.82:0/1034410902 shutdown_connections 2023-09-23T09:22:15.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.378+0000 7f1445b09b80 1 --2- 172.21.15.82:0/1034410902 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639901d5ca0 0x5639901d9690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:22:15.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.378+0000 7f1445b09b80 1 --2- 172.21.15.82:0/1034410902 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5639901e93f0 0x5639901eb810 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:22:15.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.378+0000 7f1445b09b80 1 --2- 172.21.15.82:0/1034410902 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5639901cfc40 0x5639901dbc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:22:15.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.378+0000 7f140affd700 0 client.26764 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:22:15.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.378+0000 7f1445b09b80 1 --2- 172.21.15.82:0/1034410902 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5639901d5380 0x5639901d8f50 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:22:15.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.378+0000 7f1445b09b80 1 -- 172.21.15.82:0/1034410902 >> 172.21.15.82:0/1034410902 conn(0x5639901440e0 msgr2=0x5639901c4b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:22:15.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.378+0000 7f1445b09b80 1 -- 172.21.15.82:0/1034410902 shutdown_connections 2023-09-23T09:22:15.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.378+0000 7f1445b09b80 1 -- 172.21.15.82:0/1034410902 wait complete. 2023-09-23T09:22:15.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.379+0000 7f1445b09b80 20 client.26764 trim_cache size 0 max 16384 2023-09-23T09:22:15.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.398+0000 7f1445b09b80 1 Processor -- start 2023-09-23T09:22:15.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.398+0000 7f1445b09b80 1 -- start start 2023-09-23T09:22:15.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.398+0000 7f1445b09b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639901cfc40 0x5639901cf700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:22:15.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.398+0000 7f1445b09b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5639901d5380 0x5639901d0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:22:15.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.398+0000 7f1445b09b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5639901d5ca0 0x5639901d8730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:22:15.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.399+0000 7f1445b09b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56398ffa3920 con 0x5639901d5380 2023-09-23T09:22:15.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.399+0000 7f1445b09b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56399019f1c0 con 0x5639901cfc40 2023-09-23T09:22:15.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.399+0000 7f1445b09b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639901cb150 con 0x5639901d5ca0 2023-09-23T09:22:15.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.399+0000 7f142bfff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5639901d5ca0 0x5639901d8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:22:15.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.399+0000 7f142b7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639901cfc40 0x5639901cf700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:22:15.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.399+0000 7f142b7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639901cfc40 0x5639901cf700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:46408/0 (socket says 172.21.15.82:46408) 2023-09-23T09:22:15.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.399+0000 7f142b7fe700 1 -- 172.21.15.82:0/3751934189 learned_addr learned my addr 172.21.15.82:0/3751934189 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:22:15.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.399+0000 7f142bfff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5639901d5ca0 0x5639901d8730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:59216/0 (socket says 172.21.15.82:59216) 2023-09-23T09:22:15.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.399+0000 7f142affd700 1 --2- 172.21.15.82:0/3751934189 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5639901d5380 0x5639901d0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:22:15.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.399+0000 7f142b7fe700 1 -- 172.21.15.82:0/3751934189 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5639901d5ca0 msgr2=0x5639901d8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:22:15.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.399+0000 7f142b7fe700 1 --2- 172.21.15.82:0/3751934189 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5639901d5ca0 0x5639901d8730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:22:15.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.399+0000 7f142b7fe700 1 -- 172.21.15.82:0/3751934189 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5639901d5380 msgr2=0x5639901d0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:22:15.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.399+0000 7f142b7fe700 1 --2- 172.21.15.82:0/3751934189 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5639901d5380 0x5639901d0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:22:15.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.399+0000 7f142b7fe700 1 -- 172.21.15.82:0/3751934189 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56398ff4dde0 con 0x5639901cfc40 2023-09-23T09:22:15.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.400+0000 7f142b7fe700 1 --2- 172.21.15.82:0/3751934189 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639901cfc40 0x5639901cf700 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f141c096ca0 tx=0x7f141c00ff90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c6b575944bb822e server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:22:15.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.400+0000 7f14127fc700 1 -- 172.21.15.82:0/3751934189 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f141c087070 con 0x5639901cfc40 2023-09-23T09:22:15.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.400+0000 7f14127fc700 1 -- 172.21.15.82:0/3751934189 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f141c09e060 con 0x5639901cfc40 2023-09-23T09:22:15.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.400+0000 7f14127fc700 1 -- 172.21.15.82:0/3751934189 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f141c0b2120 con 0x5639901cfc40 2023-09-23T09:22:15.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.401+0000 7f1445b09b80 1 -- 172.21.15.82:0/3751934189 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639901cfc40 msgr2=0x5639901cf700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:22:15.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.401+0000 7f1445b09b80 1 --2- 172.21.15.82:0/3751934189 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639901cfc40 0x5639901cf700 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f141c096ca0 tx=0x7f141c00ff90 comp rx=0 tx=0).stop 2023-09-23T09:22:15.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.401+0000 7f1445b09b80 1 -- 172.21.15.82:0/3751934189 shutdown_connections 2023-09-23T09:22:15.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.401+0000 7f1445b09b80 1 --2- 172.21.15.82:0/3751934189 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5639901d5ca0 0x5639901d8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:22:15.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.401+0000 7f1445b09b80 1 --2- 172.21.15.82:0/3751934189 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639901cfc40 0x5639901cf700 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:22:15.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.401+0000 7f1445b09b80 1 --2- 172.21.15.82:0/3751934189 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5639901d5380 0x5639901d0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:22:15.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.401+0000 7f1445b09b80 1 -- 172.21.15.82:0/3751934189 >> 172.21.15.82:0/3751934189 conn(0x5639901440e0 msgr2=0x5639901e5780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:22:15.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.401+0000 7f1445b09b80 1 -- 172.21.15.82:0/3751934189 shutdown_connections 2023-09-23T09:22:15.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.401+0000 7f1445b09b80 1 -- 172.21.15.82:0/3751934189 wait complete. 2023-09-23T09:22:15.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.401+0000 7f1445b09b80 1 -- start start 2023-09-23T09:22:15.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.402+0000 7f1445b09b80 1 Processor -- start 2023-09-23T09:22:15.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.402+0000 7f1445b09b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639901cfc40 0x5639901de660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:22:15.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.402+0000 7f1445b09b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5639901d5380 0x5639901deba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:22:15.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.402+0000 7f1445b09b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5639901d5ca0 0x56399023c240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:22:15.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.402+0000 7f1445b09b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56399023c780 con 0x5639901d5380 2023-09-23T09:22:15.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.402+0000 7f1445b09b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56399023c8c0 con 0x5639901cfc40 2023-09-23T09:22:15.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.402+0000 7f1445b09b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x56399023ca00 con 0x5639901d5ca0 2023-09-23T09:22:15.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.402+0000 7f1445b09b80 10 client.0 _ll_register_callbacks cb 0x7f1420011990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:22:15.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.402+0000 7f142b7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639901cfc40 0x5639901de660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:22:15.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.402+0000 7f142b7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639901cfc40 0x5639901de660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:46410/0 (socket says 172.21.15.82:46410) 2023-09-23T09:22:15.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.402+0000 7f142b7fe700 1 -- 172.21.15.82:0/3530936719 learned_addr learned my addr 172.21.15.82:0/3530936719 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:22:15.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.403+0000 7f142affd700 1 --2- 172.21.15.82:0/3530936719 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5639901d5380 0x5639901deba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:22:15.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.403+0000 7f142bfff700 1 --2- 172.21.15.82:0/3530936719 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5639901d5ca0 0x56399023c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:22:15.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.403+0000 7f142b7fe700 1 -- 172.21.15.82:0/3530936719 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5639901d5ca0 msgr2=0x56399023c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:22:15.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.403+0000 7f142b7fe700 1 --2- 172.21.15.82:0/3530936719 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5639901d5ca0 0x56399023c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:22:15.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.403+0000 7f142b7fe700 1 -- 172.21.15.82:0/3530936719 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5639901d5380 msgr2=0x5639901deba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:22:15.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.403+0000 7f142b7fe700 1 --2- 172.21.15.82:0/3530936719 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5639901d5380 0x5639901deba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:22:15.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.403+0000 7f142b7fe700 1 -- 172.21.15.82:0/3530936719 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56398ffa1630 con 0x5639901cfc40 2023-09-23T09:22:15.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.403+0000 7f142affd700 1 --2- 172.21.15.82:0/3530936719 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5639901d5380 0x5639901deba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:22:15.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.403+0000 7f142b7fe700 1 --2- 172.21.15.82:0/3530936719 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639901cfc40 0x5639901de660 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f141c096730 tx=0x7f141c0ccc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22273f03f499737 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:22:15.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.403+0000 7f140affd700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-09-23T09:22:15.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.403+0000 7f140affd700 1 -- 172.21.15.82:0/3530936719 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f141c087070 con 0x5639901cfc40 2023-09-23T09:22:15.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.404+0000 7f140affd700 1 -- 172.21.15.82:0/3530936719 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(126..126 src has 1..126) v4 ==== 8557+0+0 (secure 0 0 0) 0x7f141c094e40 con 0x5639901cfc40 2023-09-23T09:22:15.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.404+0000 7f1445b09b80 1 -- 172.21.15.82:0/3530936719 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5639901c28b0 con 0x5639901cfc40 2023-09-23T09:22:15.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.404+0000 7f140affd700 1 -- 172.21.15.82:0/3530936719 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=76) v2 ==== 24+0+0 (secure 0 0 0) 0x7f141c09a9b0 con 0x5639901cfc40 2023-09-23T09:22:15.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.404+0000 7f1445b09b80 10 client.26714 fetch_fsmap learned FSMap version 76 2023-09-23T09:22:15.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.404+0000 7f1445b09b80 1 -- 172.21.15.82:0/3530936719 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=76,monmap=4+}) v3 -- 0x56398ff36c60 con 0x5639901cfc40 2023-09-23T09:22:15.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.404+0000 7f140affd700 1 -- 172.21.15.82:0/3530936719 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5639901c28b0 con 0x5639901cfc40 2023-09-23T09:22:15.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.404+0000 7f140affd700 1 -- 172.21.15.82:0/3530936719 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 76) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f141c07b030 con 0x5639901cfc40 2023-09-23T09:22:15.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.404+0000 7f1445b09b80 10 client.26714 fetch_fsmap finished waiting for FSMap version 76 2023-09-23T09:22:15.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.404+0000 7f1445b09b80 10 client.26714 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:22:15.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.404+0000 7f1445b09b80 20 client.26714 populate_metadata read hostname 'smithi082' 2023-09-23T09:22:15.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.404+0000 7f1445b09b80 1 --2- 172.21.15.82:0/3530936719 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56399023dcc0 0x5639902400b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:22:15.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.404+0000 7f1445b09b80 4 client.26714 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:22:15.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.404+0000 7f1445b09b80 1 -- 172.21.15.82:0/3530936719 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x56399011a970 con 0x56399023dcc0 2023-09-23T09:22:15.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.405+0000 7f142affd700 1 --2- 172.21.15.82:0/3530936719 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56399023dcc0 0x5639902400b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:22:15.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.405+0000 7f140affd700 10 client.26714 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:22:15.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.405+0000 7f142affd700 1 --2- 172.21.15.82:0/3530936719 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56399023dcc0 0x5639902400b0 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=38dd769cc3b75e03 server_cookie=870d52f5db4ff189 in_seq=0 out_seq=0 2023-09-23T09:22:15.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.405+0000 7f140affd700 1 -- 172.21.15.82:0/3530936719 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x56399011a970 con 0x56399023dcc0 2023-09-23T09:22:15.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.405+0000 7f140affd700 10 client.26714 handle_command_reply: tid=0 2023-09-23T09:22:15.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.405+0000 7f1445b09b80 1 client.26714 shutdown 2023-09-23T09:22:15.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.406+0000 7f1445b09b80 1 -- 172.21.15.82:0/3530936719 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639901cfc40 msgr2=0x5639901de660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:22:15.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.406+0000 7f1445b09b80 1 --2- 172.21.15.82:0/3530936719 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639901cfc40 0x5639901de660 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f141c096730 tx=0x7f141c0ccc30 comp rx=0 tx=0).stop 2023-09-23T09:22:15.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.406+0000 7f1445b09b80 1 -- 172.21.15.82:0/3530936719 shutdown_connections 2023-09-23T09:22:15.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.406+0000 7f1445b09b80 1 --2- 172.21.15.82:0/3530936719 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5639901d5ca0 0x56399023c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:22:15.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.406+0000 7f1445b09b80 1 --2- 172.21.15.82:0/3530936719 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639901cfc40 0x5639901de660 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:22:15.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.406+0000 7f1445b09b80 1 --2- 172.21.15.82:0/3530936719 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56399023dcc0 0x5639902400b0 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:22:15.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.406+0000 7f1445b09b80 1 --2- 172.21.15.82:0/3530936719 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5639901d5380 0x5639901deba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:22:15.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.406+0000 7f140affd700 0 client.26714 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:22:15.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.406+0000 7f1445b09b80 1 -- 172.21.15.82:0/3530936719 >> 172.21.15.82:0/3530936719 conn(0x5639901440e0 msgr2=0x5639901d3130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:22:15.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.406+0000 7f1445b09b80 1 -- 172.21.15.82:0/3530936719 shutdown_connections 2023-09-23T09:22:15.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.406+0000 7f1445b09b80 1 -- 172.21.15.82:0/3530936719 wait complete. 2023-09-23T09:22:15.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.406+0000 7f1445b09b80 20 client.26714 trim_cache size 0 max 16384 2023-09-23T09:22:15.413 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:22:15.413 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-23T09:22:15.413 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:22:15.413 INFO:teuthology.orchestra.run.smithi082.stdout: "047cbc72-e254-4787-b038-382de9c1a9a4": { 2023-09-23T09:22:15.413 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:22:15.413 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "047cbc72-e254-4787-b038-382de9c1a9a4", 2023-09-23T09:22:15.413 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:22:15.413 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:22:15.413 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:22:15.413 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:22:15.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.407+0000 7f14321ff700 1 -- 172.21.15.82:0/1770592647 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f14140a0140 msgr2=0x7f14140a2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:22:15.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.407+0000 7f14321ff700 1 --2- 172.21.15.82:0/1770592647 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f14140a0140 0x7f14140a2600 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f142c101790 tx=0x7f1424009260 comp rx=0 tx=0).stop 2023-09-23T09:22:15.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.407+0000 7f14321ff700 1 -- 172.21.15.82:0/1770592647 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f142c101a30 msgr2=0x7f142c0ff680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:22:15.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.407+0000 7f14321ff700 1 --2- 172.21.15.82:0/1770592647 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f142c101a30 0x7f142c0ff680 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f141c005770 tx=0x7f141c0057a0 comp rx=0 tx=0).stop 2023-09-23T09:22:15.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.407+0000 7f14321ff700 1 -- 172.21.15.82:0/1770592647 shutdown_connections 2023-09-23T09:22:15.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.407+0000 7f14321ff700 1 --2- 172.21.15.82:0/1770592647 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f14140a0140 0x7f14140a2600 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:22:15.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.407+0000 7f14321ff700 1 --2- 172.21.15.82:0/1770592647 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f142c10ae50 0x7f142c1a4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:22:15.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.407+0000 7f14321ff700 1 --2- 172.21.15.82:0/1770592647 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f142c101a30 0x7f142c0ff680 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:22:15.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.407+0000 7f14321ff700 1 --2- 172.21.15.82:0/1770592647 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f142c102350 0x7f142c0ffbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:22:15.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.407+0000 7f14321ff700 1 -- 172.21.15.82:0/1770592647 >> 172.21.15.82:0/1770592647 conn(0x7f142c0fb270 msgr2=0x7f142c0fbee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:22:15.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.407+0000 7f14321ff700 1 -- 172.21.15.82:0/1770592647 shutdown_connections 2023-09-23T09:22:15.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:15.407+0000 7f14321ff700 1 -- 172.21.15.82:0/1770592647 wait complete. 2023-09-23T09:22:15.427 INFO:tasks.cephfs.filesystem:scrub status for tag:047cbc72-e254-4787-b038-382de9c1a9a4 - {'path': '/', 'tag': '047cbc72-e254-4787-b038-382de9c1a9a4', 'options': 'recursive,force'} 2023-09-23T09:22:16.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:22:16 smithi135 ceph-mon[99205]: pgmap v801: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 2.3 MiB/s wr, 306 op/s 2023-09-23T09:22:16.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:22:16 smithi082 ceph-mon[97694]: pgmap v801: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 2.3 MiB/s wr, 306 op/s 2023-09-23T09:22:16.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:22:16 smithi161 ceph-mon[99580]: pgmap v801: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 2.3 MiB/s wr, 306 op/s 2023-09-23T09:22:18.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:22:17 smithi082 ceph-mon[97694]: osdmap e127: 12 total, 12 up, 12 in 2023-09-23T09:22:18.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:22:17 smithi082 ceph-mon[97694]: pgmap v803: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.3 MiB/s wr, 168 op/s 2023-09-23T09:22:18.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:22:17 smithi161 ceph-mon[99580]: osdmap e127: 12 total, 12 up, 12 in 2023-09-23T09:22:18.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:22:17 smithi161 ceph-mon[99580]: pgmap v803: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.3 MiB/s wr, 168 op/s 2023-09-23T09:22:18.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:22:17 smithi135 ceph-mon[99205]: osdmap e127: 12 total, 12 up, 12 in 2023-09-23T09:22:18.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:22:17 smithi135 ceph-mon[99205]: pgmap v803: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.3 MiB/s wr, 168 op/s 2023-09-23T09:22:20.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:22:20 smithi135 ceph-mon[99205]: pgmap v804: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 3.0 MiB/s wr, 382 op/s 2023-09-23T09:22:20.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:22:20 smithi082 ceph-mon[97694]: pgmap v804: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 3.0 MiB/s wr, 382 op/s 2023-09-23T09:22:20.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:22:20 smithi161 ceph-mon[99580]: pgmap v804: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 3.0 MiB/s wr, 382 op/s 2023-09-23T09:22:22.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:22:22 smithi135 ceph-mon[99205]: pgmap v805: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 2.4 MiB/s wr, 307 op/s 2023-09-23T09:22:22.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:22:22 smithi082 ceph-mon[97694]: pgmap v805: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 2.4 MiB/s wr, 307 op/s 2023-09-23T09:22:22.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:22:22 smithi161 ceph-mon[99580]: pgmap v805: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 2.4 MiB/s wr, 307 op/s 2023-09-23T09:22:24.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:22:24 smithi135 ceph-mon[99205]: pgmap v806: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 2.4 MiB/s wr, 305 op/s 2023-09-23T09:22:24.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:22:24 smithi082 ceph-mon[97694]: pgmap v806: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 2.4 MiB/s wr, 305 op/s 2023-09-23T09:22:24.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:22:24 smithi161 ceph-mon[99580]: pgmap v806: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 2.4 MiB/s wr, 305 op/s 2023-09-23T09:22:26.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:22:26 smithi135 ceph-mon[99205]: pgmap v807: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 2.7 MiB/s wr, 325 op/s 2023-09-23T09:22:26.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:22:26 smithi082 ceph-mon[97694]: pgmap v807: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 2.7 MiB/s wr, 325 op/s 2023-09-23T09:22:26.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:22:26 smithi161 ceph-mon[99580]: pgmap v807: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 2.7 MiB/s wr, 325 op/s 2023-09-23T09:22:28.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:22:27 smithi082 ceph-mon[97694]: pgmap v808: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 2.6 MiB/s wr, 306 op/s 2023-09-23T09:22:28.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:22:27 smithi161 ceph-mon[99580]: pgmap v808: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 2.6 MiB/s wr, 306 op/s 2023-09-23T09:22:28.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:22:27 smithi135 ceph-mon[99205]: pgmap v808: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 2.6 MiB/s wr, 306 op/s 2023-09-23T09:22:30.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:22:30 smithi135 ceph-mon[99205]: pgmap v809: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 3.2 MiB/s wr, 397 op/s 2023-09-23T09:22:30.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:22:30 smithi082 ceph-mon[97694]: pgmap v809: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 3.2 MiB/s wr, 397 op/s 2023-09-23T09:22:30.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:22:30 smithi161 ceph-mon[99580]: pgmap v809: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 3.2 MiB/s wr, 397 op/s 2023-09-23T09:22:32.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:22:32 smithi135 ceph-mon[99205]: pgmap v810: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 2.1 MiB/s wr, 255 op/s 2023-09-23T09:22:32.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:22:32 smithi082 ceph-mon[97694]: pgmap v810: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 2.1 MiB/s wr, 255 op/s 2023-09-23T09:22:32.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:22:32 smithi161 ceph-mon[99580]: pgmap v810: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 2.1 MiB/s wr, 255 op/s 2023-09-23T09:22:34.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:22:34 smithi135 ceph-mon[99205]: pgmap v811: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 2.1 MiB/s wr, 255 op/s 2023-09-23T09:22:34.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:22:34 smithi082 ceph-mon[97694]: pgmap v811: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 2.1 MiB/s wr, 255 op/s 2023-09-23T09:22:34.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:22:34 smithi161 ceph-mon[99580]: pgmap v811: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 2.1 MiB/s wr, 255 op/s 2023-09-23T09:22:36.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:22:36 smithi135 ceph-mon[99205]: pgmap v812: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 3.0 MiB/s wr, 377 op/s 2023-09-23T09:22:36.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:22:36 smithi082 ceph-mon[97694]: pgmap v812: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 3.0 MiB/s wr, 377 op/s 2023-09-23T09:22:36.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:22:36 smithi161 ceph-mon[99580]: pgmap v812: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 3.0 MiB/s wr, 377 op/s 2023-09-23T09:22:38.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:22:37 smithi082 ceph-mon[97694]: pgmap v813: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 1.9 MiB/s wr, 248 op/s 2023-09-23T09:22:38.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:22:37 smithi161 ceph-mon[99580]: pgmap v813: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 1.9 MiB/s wr, 248 op/s 2023-09-23T09:22:38.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:22:37 smithi135 ceph-mon[99205]: pgmap v813: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 1.9 MiB/s wr, 248 op/s 2023-09-23T09:22:40.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:22:40 smithi135 ceph-mon[99205]: pgmap v814: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 2.9 MiB/s wr, 373 op/s 2023-09-23T09:22:40.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:22:40 smithi082 ceph-mon[97694]: pgmap v814: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 2.9 MiB/s wr, 373 op/s 2023-09-23T09:22:40.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:22:40 smithi161 ceph-mon[99580]: pgmap v814: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 2.9 MiB/s wr, 373 op/s 2023-09-23T09:22:42.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:22:42 smithi082 ceph-mon[97694]: pgmap v815: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 1.9 MiB/s wr, 247 op/s 2023-09-23T09:22:42.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:22:42 smithi161 ceph-mon[99580]: pgmap v815: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 1.9 MiB/s wr, 247 op/s 2023-09-23T09:22:44.366 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:22:42 smithi135 ceph-mon[99205]: pgmap v815: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 1.9 MiB/s wr, 247 op/s 2023-09-23T09:22:44.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:22:44 smithi135 ceph-mon[99205]: pgmap v816: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 1.9 MiB/s wr, 247 op/s 2023-09-23T09:22:44.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:22:44 smithi082 ceph-mon[97694]: pgmap v816: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 1.9 MiB/s wr, 247 op/s 2023-09-23T09:22:44.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:22:44 smithi161 ceph-mon[99580]: pgmap v816: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 1.9 MiB/s wr, 247 op/s 2023-09-23T09:22:45.427 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:22:45.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.645+0000 7f77cdfff700 1 -- 172.21.15.82:0/976939114 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77c8100890 msgr2=0x7f77c8100d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:22:45.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.645+0000 7f77cdfff700 1 --2- 172.21.15.82:0/976939114 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77c8100890 0x7f77c8100d10 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f77bc009990 tx=0x7f77bc009ca0 comp rx=0 tx=0).stop 2023-09-23T09:22:45.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.646+0000 7f77cdfff700 1 -- 172.21.15.82:0/976939114 shutdown_connections 2023-09-23T09:22:45.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.646+0000 7f77cdfff700 1 --2- 172.21.15.82:0/976939114 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77c8101250 0x7f77c810d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:22:45.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.646+0000 7f77cdfff700 1 --2- 172.21.15.82:0/976939114 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77c81068a0 0x7f77c8106c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:22:45.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.646+0000 7f77cdfff700 1 --2- 172.21.15.82:0/976939114 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77c8100890 0x7f77c8100d10 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:22:45.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.646+0000 7f77cdfff700 1 -- 172.21.15.82:0/976939114 >> 172.21.15.82:0/976939114 conn(0x7f77c80fc380 msgr2=0x7f77c80fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:22:45.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.646+0000 7f77cdfff700 1 -- 172.21.15.82:0/976939114 shutdown_connections 2023-09-23T09:22:45.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.646+0000 7f77cdfff700 1 -- 172.21.15.82:0/976939114 wait complete. 2023-09-23T09:22:45.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.647+0000 7f77cdfff700 1 Processor -- start 2023-09-23T09:22:45.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.647+0000 7f77cdfff700 1 -- start start 2023-09-23T09:22:45.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.647+0000 7f77cdfff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77c8100890 0x7f77c819e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:22:45.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.647+0000 7f77cdfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77c8101250 0x7f77c819edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:22:45.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.647+0000 7f77cdfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77c81068a0 0x7f77c81988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:22:45.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.647+0000 7f77cdfff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77c8198f50 con 0x7f77c8101250 2023-09-23T09:22:45.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.647+0000 7f77cdfff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77c81990c0 con 0x7f77c81068a0 2023-09-23T09:22:45.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.647+0000 7f77cdfff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77c8199280 con 0x7f77c8100890 2023-09-23T09:22:45.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.648+0000 7f77c6ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77c8101250 0x7f77c819edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:22:45.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.648+0000 7f77c77fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77c8100890 0x7f77c819e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:22:45.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.648+0000 7f77c7fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77c81068a0 0x7f77c81988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:22:45.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.648+0000 7f77c77fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77c8100890 0x7f77c819e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:48892/0 (socket says 172.21.15.82:48892) 2023-09-23T09:22:45.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.648+0000 7f77c7fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77c81068a0 0x7f77c81988e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:56308/0 (socket says 172.21.15.82:56308) 2023-09-23T09:22:45.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.648+0000 7f77c77fe700 1 -- 172.21.15.82:0/2621806285 learned_addr learned my addr 172.21.15.82:0/2621806285 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:22:45.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.648+0000 7f77c7fff700 1 -- 172.21.15.82:0/2621806285 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77c8100890 msgr2=0x7f77c819e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:22:45.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.648+0000 7f77c7fff700 1 --2- 172.21.15.82:0/2621806285 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77c8100890 0x7f77c819e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:22:45.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.648+0000 7f77c7fff700 1 -- 172.21.15.82:0/2621806285 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77c8101250 msgr2=0x7f77c819edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:22:45.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.648+0000 7f77c7fff700 1 --2- 172.21.15.82:0/2621806285 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77c8101250 0x7f77c819edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:22:45.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.648+0000 7f77c7fff700 1 -- 172.21.15.82:0/2621806285 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77bc0095f0 con 0x7f77c81068a0 2023-09-23T09:22:45.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.648+0000 7f77c77fe700 1 --2- 172.21.15.82:0/2621806285 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77c8100890 0x7f77c819e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:22:45.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.648+0000 7f77c6ffd700 1 --2- 172.21.15.82:0/2621806285 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77c8101250 0x7f77c819edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:22:45.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.648+0000 7f77c7fff700 1 --2- 172.21.15.82:0/2621806285 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77c81068a0 0x7f77c81988e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f77c000efc0 tx=0x7f77c000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:22:45.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.649+0000 7f77c4ff9700 1 -- 172.21.15.82:0/2621806285 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c0018070 con 0x7f77c81068a0 2023-09-23T09:22:45.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.649+0000 7f77cdfff700 1 -- 172.21.15.82:0/2621806285 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77c8199500 con 0x7f77c81068a0 2023-09-23T09:22:45.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.649+0000 7f77c4ff9700 1 -- 172.21.15.82:0/2621806285 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f77c000f040 con 0x7f77c81068a0 2023-09-23T09:22:45.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.649+0000 7f77c4ff9700 1 -- 172.21.15.82:0/2621806285 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c000cba0 con 0x7f77c81068a0 2023-09-23T09:22:45.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.649+0000 7f77cdfff700 1 -- 172.21.15.82:0/2621806285 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77c81a5860 con 0x7f77c81068a0 2023-09-23T09:22:45.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.653+0000 7f77c4ff9700 1 -- 172.21.15.82:0/2621806285 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f77c000cd00 con 0x7f77c81068a0 2023-09-23T09:22:45.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.653+0000 7f77e189db80 1 Processor -- start 2023-09-23T09:22:45.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.654+0000 7f77e189db80 1 -- start start 2023-09-23T09:22:45.657 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.654+0000 7f77e189db80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55de52a73380 0x55de52a73760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:22:45.657 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.654+0000 7f77e189db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55de52a73ca0 0x55de52a6d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:22:45.657 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.654+0000 7f77e189db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de52a6dc40 0x55de52a6e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:22:45.657 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.654+0000 7f77e189db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de529d57b0 con 0x55de52a6dc40 2023-09-23T09:22:45.657 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.654+0000 7f77e189db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de529c6780 con 0x55de52a73ca0 2023-09-23T09:22:45.657 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.654+0000 7f77e189db80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de529c40a0 con 0x55de52a73380 2023-09-23T09:22:45.657 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.654+0000 7f77c6ffd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55de52a73380 0x55de52a73760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:22:45.657 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.654+0000 7f77c77fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55de52a73ca0 0x55de52a6d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:22:45.657 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.654+0000 7f77c6ffd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55de52a73380 0x55de52a73760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:48906/0 (socket says 172.21.15.82:48906) 2023-09-23T09:22:45.657 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.654+0000 7f77c4ff9700 1 --2- 172.21.15.82:0/2621806285 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f77b00a00c0 0x7f77b00a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:22:45.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.654+0000 7f77c6ffd700 1 -- 172.21.15.82:0/426672732 learned_addr learned my addr 172.21.15.82:0/426672732 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:22:45.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.654+0000 7f77c77fe700 1 --2- 172.21.15.82:0/426672732 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55de52a73ca0 0x55de52a6d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:56310/0 (socket says 172.21.15.82:56310) 2023-09-23T09:22:45.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.654+0000 7f77c6ffd700 1 --2- 172.21.15.82:0/426672732 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de52a6dc40 0x55de52a6e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:22:45.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.655+0000 7f77c4ff9700 1 -- 172.21.15.82:0/2621806285 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f77c00caef0 con 0x7f77c81068a0 2023-09-23T09:22:45.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.655+0000 7f77c77fe700 1 -- 172.21.15.82:0/426672732 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55de52a73380 msgr2=0x55de52a73760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:22:45.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.655+0000 7f77c77fe700 1 --2- 172.21.15.82:0/426672732 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55de52a73380 0x55de52a73760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:22:45.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.655+0000 7f77c77fe700 1 -- 172.21.15.82:0/426672732 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de52a6dc40 msgr2=0x55de52a6e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:22:45.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.655+0000 7f77c77fe700 1 --2- 172.21.15.82:0/426672732 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de52a6dc40 0x55de52a6e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:22:45.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.655+0000 7f77c77fe700 1 -- 172.21.15.82:0/426672732 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55de5283f630 con 0x55de52a73ca0 2023-09-23T09:22:45.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.655+0000 7f77c6ffd700 1 --2- 172.21.15.82:0/426672732 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de52a6dc40 0x55de52a6e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:22:45.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.655+0000 7f77c7fff700 1 --2- 172.21.15.82:0/2621806285 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f77b00a00c0 0x7f77b00a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:22:45.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.655+0000 7f77c77fe700 1 --2- 172.21.15.82:0/426672732 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55de52a73ca0 0x55de52a6d700 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f77b80114c0 tx=0x7f77b80117d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=753e554849aa80f7 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:22:45.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.656+0000 7f77adffb700 1 -- 172.21.15.82:0/426672732 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b8004230 con 0x55de52a73ca0 2023-09-23T09:22:45.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.656+0000 7f77c7fff700 1 --2- 172.21.15.82:0/2621806285 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f77b00a00c0 0x7f77b00a2580 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f77c0095100 tx=0x7f77c0013f90 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:22:45.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.656+0000 7f77adffb700 1 -- 172.21.15.82:0/426672732 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f77b8004390 con 0x55de52a73ca0 2023-09-23T09:22:45.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.656+0000 7f77adffb700 1 -- 172.21.15.82:0/426672732 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b800e870 con 0x55de52a73ca0 2023-09-23T09:22:45.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.656+0000 7f77e189db80 1 -- 172.21.15.82:0/426672732 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55de52a73ca0 msgr2=0x55de52a6d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:22:45.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.656+0000 7f77e189db80 1 --2- 172.21.15.82:0/426672732 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55de52a73ca0 0x55de52a6d700 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f77b80114c0 tx=0x7f77b80117d0 comp rx=0 tx=0).stop 2023-09-23T09:22:45.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.657+0000 7f77e189db80 1 -- 172.21.15.82:0/426672732 shutdown_connections 2023-09-23T09:22:45.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.657+0000 7f77e189db80 1 --2- 172.21.15.82:0/426672732 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de52a6dc40 0x55de52a6e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:22:45.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.657+0000 7f77e189db80 1 --2- 172.21.15.82:0/426672732 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55de52a73380 0x55de52a73760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:22:45.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.657+0000 7f77e189db80 1 --2- 172.21.15.82:0/426672732 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55de52a73ca0 0x55de52a6d700 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:22:45.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.657+0000 7f77e189db80 1 -- 172.21.15.82:0/426672732 >> 172.21.15.82:0/426672732 conn(0x55de529e20e0 msgr2=0x55de52a68410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:22:45.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.657+0000 7f77e189db80 1 -- 172.21.15.82:0/426672732 shutdown_connections 2023-09-23T09:22:45.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.657+0000 7f77e189db80 1 -- 172.21.15.82:0/426672732 wait complete. 2023-09-23T09:22:45.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.657+0000 7f77e189db80 1 -- start start 2023-09-23T09:22:45.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.657+0000 7f77e189db80 1 Processor -- start 2023-09-23T09:22:45.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.658+0000 7f77e189db80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55de52a6dc40 0x55de52a76fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:22:45.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.658+0000 7f77e189db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de52a73380 0x55de52a77520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:22:45.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.658+0000 7f77e189db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55de52a73ca0 0x55de52a77a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:22:45.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.658+0000 7f77e189db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de529bf990 con 0x55de52a73380 2023-09-23T09:22:45.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.658+0000 7f77e189db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de5295dbb0 con 0x55de52a73ca0 2023-09-23T09:22:45.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.658+0000 7f77e189db80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de5295d8b0 con 0x55de52a6dc40 2023-09-23T09:22:45.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.658+0000 7f77e189db80 10 client.0 _ll_register_callbacks cb 0x55de528a7a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:22:45.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.658+0000 7f77c77fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de52a73380 0x55de52a77520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:22:45.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.658+0000 7f77c6ffd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55de52a6dc40 0x55de52a76fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:22:45.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.658+0000 7f77c77fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de52a73380 0x55de52a77520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42508/0 (socket says 172.21.15.82:42508) 2023-09-23T09:22:45.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.658+0000 7f77c6ffd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55de52a6dc40 0x55de52a76fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:48908/0 (socket says 172.21.15.82:48908) 2023-09-23T09:22:45.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.658+0000 7f77c77fe700 1 -- 172.21.15.82:0/1376984512 learned_addr learned my addr 172.21.15.82:0/1376984512 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:22:45.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.658+0000 7f77c6ffd700 1 --2- 172.21.15.82:0/1376984512 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55de52a73ca0 0x55de52a77a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:22:45.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.659+0000 7f77c77fe700 1 -- 172.21.15.82:0/1376984512 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55de52a6dc40 msgr2=0x55de52a76fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:22:45.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.659+0000 7f77c77fe700 1 --2- 172.21.15.82:0/1376984512 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55de52a6dc40 0x55de52a76fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:22:45.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.659+0000 7f77c77fe700 1 -- 172.21.15.82:0/1376984512 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55de52a73ca0 msgr2=0x55de52a77a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:22:45.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.659+0000 7f77c77fe700 1 --2- 172.21.15.82:0/1376984512 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55de52a73ca0 0x55de52a77a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:22:45.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.659+0000 7f77c77fe700 1 -- 172.21.15.82:0/1376984512 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77b8009ce0 con 0x55de52a73380 2023-09-23T09:22:45.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.659+0000 7f77c77fe700 1 --2- 172.21.15.82:0/1376984512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de52a73380 0x55de52a77520 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f77b801b040 tx=0x7f77b8005270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ac26a8e78bb7edb server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:22:45.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.659+0000 7f77a6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:22:45.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.659+0000 7f77a6ffd700 1 -- 172.21.15.82:0/1376984512 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b8004500 con 0x55de52a73380 2023-09-23T09:22:45.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.659+0000 7f77e189db80 1 -- 172.21.15.82:0/1376984512 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55de52a3d1c0 con 0x55de52a73380 2023-09-23T09:22:45.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.659+0000 7f77a6ffd700 1 -- 172.21.15.82:0/1376984512 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(127..127 src has 1..127) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f77b8004750 con 0x55de52a73380 2023-09-23T09:22:45.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.659+0000 7f77a6ffd700 1 -- 172.21.15.82:0/1376984512 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=76) v2 ==== 24+0+0 (secure 0 0 0) 0x7f77b8004910 con 0x55de52a73380 2023-09-23T09:22:45.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.660+0000 7f77e189db80 10 client.17055 fetch_fsmap learned FSMap version 76 2023-09-23T09:22:45.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.660+0000 7f77e189db80 1 -- 172.21.15.82:0/1376984512 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=76,monmap=4+}) v3 -- 0x55de527ebde0 con 0x55de52a73380 2023-09-23T09:22:45.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.660+0000 7f77a6ffd700 1 -- 172.21.15.82:0/1376984512 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55de52a3d1c0 con 0x55de52a73380 2023-09-23T09:22:45.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.660+0000 7f77a6ffd700 1 -- 172.21.15.82:0/1376984512 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 76) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f77b8028020 con 0x55de52a73380 2023-09-23T09:22:45.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.660+0000 7f77e189db80 10 client.17055 fetch_fsmap finished waiting for FSMap version 76 2023-09-23T09:22:45.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.660+0000 7f77e189db80 10 client.17055 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:22:45.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.660+0000 7f77e189db80 20 client.17055 populate_metadata read hostname 'smithi082' 2023-09-23T09:22:45.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.660+0000 7f77e189db80 1 --2- 172.21.15.82:0/1376984512 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55de52a877c0 0x55de52a89be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:22:45.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.660+0000 7f77e189db80 4 client.17055 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:22:45.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.660+0000 7f77e189db80 1 -- 172.21.15.82:0/1376984512 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55de52965ba0 con 0x55de52a877c0 2023-09-23T09:22:45.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.660+0000 7f77c6ffd700 1 --2- 172.21.15.82:0/1376984512 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55de52a877c0 0x55de52a89be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:22:45.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.661+0000 7f77a6ffd700 10 client.17055 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:22:45.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.661+0000 7f77c6ffd700 1 --2- 172.21.15.82:0/1376984512 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55de52a877c0 0x55de52a89be0 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d249ba5c83b5ff1 server_cookie=84156ab3a3cd056a in_seq=0 out_seq=0 2023-09-23T09:22:45.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.662+0000 7f77a6ffd700 1 -- 172.21.15.82:0/1376984512 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55de52965ba0 con 0x55de52a877c0 2023-09-23T09:22:45.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.662+0000 7f77a6ffd700 10 client.17055 handle_command_reply: tid=0 2023-09-23T09:22:45.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.662+0000 7f77e189db80 1 client.17055 shutdown 2023-09-23T09:22:45.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.662+0000 7f77e189db80 1 -- 172.21.15.82:0/1376984512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de52a73380 msgr2=0x55de52a77520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:22:45.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.662+0000 7f77e189db80 1 --2- 172.21.15.82:0/1376984512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de52a73380 0x55de52a77520 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f77b801b040 tx=0x7f77b8005270 comp rx=0 tx=0).stop 2023-09-23T09:22:45.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.662+0000 7f77e189db80 1 -- 172.21.15.82:0/1376984512 shutdown_connections 2023-09-23T09:22:45.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.662+0000 7f77e189db80 1 --2- 172.21.15.82:0/1376984512 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55de52a73ca0 0x55de52a77a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:22:45.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.662+0000 7f77e189db80 1 --2- 172.21.15.82:0/1376984512 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55de52a6dc40 0x55de52a76fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:22:45.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.662+0000 7f77e189db80 1 --2- 172.21.15.82:0/1376984512 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55de52a877c0 0x55de52a89be0 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:22:45.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.662+0000 7f77e189db80 1 --2- 172.21.15.82:0/1376984512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de52a73380 0x55de52a77520 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:22:45.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.662+0000 7f77a6ffd700 0 client.17055 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:22:45.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.662+0000 7f77e189db80 1 -- 172.21.15.82:0/1376984512 >> 172.21.15.82:0/1376984512 conn(0x55de529e20e0 msgr2=0x55de52a62b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:22:45.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.662+0000 7f77e189db80 1 -- 172.21.15.82:0/1376984512 shutdown_connections 2023-09-23T09:22:45.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.662+0000 7f77e189db80 1 -- 172.21.15.82:0/1376984512 wait complete. 2023-09-23T09:22:45.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.663+0000 7f77e189db80 20 client.17055 trim_cache size 0 max 16384 2023-09-23T09:22:45.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.681+0000 7f77e189db80 1 Processor -- start 2023-09-23T09:22:45.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.681+0000 7f77e189db80 1 -- start start 2023-09-23T09:22:45.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.681+0000 7f77e189db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55de52a6dc40 0x55de52a77890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:22:45.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.681+0000 7f77e189db80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55de52a73380 0x55de52a720b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:22:45.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.681+0000 7f77e189db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de52a73ca0 0x55de52a725f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:22:45.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.681+0000 7f77e189db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de52841920 con 0x55de52a73ca0 2023-09-23T09:22:45.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.681+0000 7f77e189db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de52a68860 con 0x55de52a6dc40 2023-09-23T09:22:45.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.681+0000 7f77e189db80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de52a7a080 con 0x55de52a73380 2023-09-23T09:22:45.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.681+0000 7f77c6ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de52a73ca0 0x55de52a725f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:22:45.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.681+0000 7f77c6ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de52a73ca0 0x55de52a725f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42524/0 (socket says 172.21.15.82:42524) 2023-09-23T09:22:45.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.681+0000 7f77c6ffd700 1 -- 172.21.15.82:0/2248163484 learned_addr learned my addr 172.21.15.82:0/2248163484 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:22:45.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.681+0000 7f77c77fe700 1 --2- 172.21.15.82:0/2248163484 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55de52a73380 0x55de52a720b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:22:45.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.681+0000 7f77c6ffd700 1 --2- 172.21.15.82:0/2248163484 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55de52a6dc40 0x55de52a77890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:22:45.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.682+0000 7f77c77fe700 1 -- 172.21.15.82:0/2248163484 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55de52a6dc40 msgr2=0x55de52a77890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:22:45.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.682+0000 7f77c77fe700 1 --2- 172.21.15.82:0/2248163484 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55de52a6dc40 0x55de52a77890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:22:45.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.682+0000 7f77c77fe700 1 -- 172.21.15.82:0/2248163484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de52a73ca0 msgr2=0x55de52a725f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:22:45.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.682+0000 7f77c77fe700 1 --2- 172.21.15.82:0/2248163484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de52a73ca0 0x55de52a725f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:22:45.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.682+0000 7f77c77fe700 1 -- 172.21.15.82:0/2248163484 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55de527d4c60 con 0x55de52a73380 2023-09-23T09:22:45.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.682+0000 7f77c6ffd700 1 --2- 172.21.15.82:0/2248163484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de52a73ca0 0x55de52a725f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:22:45.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.682+0000 7f77c77fe700 1 --2- 172.21.15.82:0/2248163484 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55de52a73380 0x55de52a720b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f77b80114c0 tx=0x7f77b8011b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ffb01dd80832427e server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:22:45.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.682+0000 7f77ae7fc700 1 -- 172.21.15.82:0/2248163484 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b80052e0 con 0x55de52a73380 2023-09-23T09:22:45.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.682+0000 7f77ae7fc700 1 -- 172.21.15.82:0/2248163484 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f77b800e5f0 con 0x55de52a73380 2023-09-23T09:22:45.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.682+0000 7f77ae7fc700 1 -- 172.21.15.82:0/2248163484 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b800eee0 con 0x55de52a73380 2023-09-23T09:22:45.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.683+0000 7f77e189db80 1 -- 172.21.15.82:0/2248163484 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55de52a73380 msgr2=0x55de52a720b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:22:45.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.683+0000 7f77e189db80 1 --2- 172.21.15.82:0/2248163484 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55de52a73380 0x55de52a720b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f77b80114c0 tx=0x7f77b8011b20 comp rx=0 tx=0).stop 2023-09-23T09:22:45.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.683+0000 7f77e189db80 1 -- 172.21.15.82:0/2248163484 shutdown_connections 2023-09-23T09:22:45.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.683+0000 7f77e189db80 1 --2- 172.21.15.82:0/2248163484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de52a73ca0 0x55de52a725f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:22:45.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.683+0000 7f77e189db80 1 --2- 172.21.15.82:0/2248163484 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55de52a6dc40 0x55de52a77890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:22:45.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.683+0000 7f77e189db80 1 --2- 172.21.15.82:0/2248163484 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55de52a73380 0x55de52a720b0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:22:45.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.683+0000 7f77e189db80 1 -- 172.21.15.82:0/2248163484 >> 172.21.15.82:0/2248163484 conn(0x55de529e20e0 msgr2=0x55de52a71130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:22:45.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.683+0000 7f77e189db80 1 -- 172.21.15.82:0/2248163484 shutdown_connections 2023-09-23T09:22:45.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.683+0000 7f77e189db80 1 -- 172.21.15.82:0/2248163484 wait complete. 2023-09-23T09:22:45.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.684+0000 7f77e189db80 1 -- start start 2023-09-23T09:22:45.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.684+0000 7f77e189db80 1 Processor -- start 2023-09-23T09:22:45.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.685+0000 7f77e189db80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55de52a6dc40 0x55de52a7c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:22:45.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.685+0000 7f77e189db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de52a73380 0x55de52a7ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:22:45.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.685+0000 7f77e189db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55de52a73ca0 0x55de52ad45f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:22:45.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.685+0000 7f77e189db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de52ad4b30 con 0x55de52a73380 2023-09-23T09:22:45.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.685+0000 7f77e189db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de52ad4ca0 con 0x55de52a73ca0 2023-09-23T09:22:45.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.685+0000 7f77e189db80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de52ad4e60 con 0x55de52a6dc40 2023-09-23T09:22:45.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.685+0000 7f77e189db80 10 client.0 _ll_register_callbacks cb 0x7f77c00097c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:22:45.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.685+0000 7f77c6ffd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55de52a6dc40 0x55de52a7c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:22:45.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.685+0000 7f77c6ffd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55de52a6dc40 0x55de52a7c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:48932/0 (socket says 172.21.15.82:48932) 2023-09-23T09:22:45.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.685+0000 7f77c6ffd700 1 -- 172.21.15.82:0/2927599787 learned_addr learned my addr 172.21.15.82:0/2927599787 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:22:45.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.685+0000 7f77c6ffd700 1 --2- 172.21.15.82:0/2927599787 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55de52a73ca0 0x55de52ad45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:22:45.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.685+0000 7f77c77fe700 1 --2- 172.21.15.82:0/2927599787 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de52a73380 0x55de52a7ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:22:45.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.685+0000 7f77c6ffd700 1 -- 172.21.15.82:0/2927599787 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55de52a73ca0 msgr2=0x55de52ad45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:22:45.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.685+0000 7f77c6ffd700 1 --2- 172.21.15.82:0/2927599787 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55de52a73ca0 0x55de52ad45f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:22:45.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.685+0000 7f77c6ffd700 1 -- 172.21.15.82:0/2927599787 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de52a73380 msgr2=0x55de52a7ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:22:45.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.685+0000 7f77c6ffd700 1 --2- 172.21.15.82:0/2927599787 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de52a73380 0x55de52a7ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:22:45.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.685+0000 7f77c6ffd700 1 -- 172.21.15.82:0/2927599787 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77bc020040 con 0x55de52a6dc40 2023-09-23T09:22:45.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.686+0000 7f77c6ffd700 1 --2- 172.21.15.82:0/2927599787 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55de52a6dc40 0x55de52a7c940 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f77bc0098e0 tx=0x7f77bc009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eaa244475bdc15fb server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:22:45.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.686+0000 7f77a6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T09:22:45.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.686+0000 7f77a6ffd700 1 -- 172.21.15.82:0/2927599787 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77bc01d040 con 0x55de52a6dc40 2023-09-23T09:22:45.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.686+0000 7f77e189db80 1 -- 172.21.15.82:0/2927599787 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55de52a608b0 con 0x55de52a6dc40 2023-09-23T09:22:45.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.686+0000 7f77a6ffd700 1 -- 172.21.15.82:0/2927599787 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(127..127 src has 1..127) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f77bc005050 con 0x55de52a6dc40 2023-09-23T09:22:45.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.686+0000 7f77a6ffd700 1 -- 172.21.15.82:0/2927599787 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=76) v2 ==== 24+0+0 (secure 0 0 0) 0x7f77bc005210 con 0x55de52a6dc40 2023-09-23T09:22:45.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.686+0000 7f77e189db80 10 client.26788 fetch_fsmap learned FSMap version 76 2023-09-23T09:22:45.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.686+0000 7f77e189db80 1 -- 172.21.15.82:0/2927599787 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=76,monmap=4+}) v3 -- 0x55de527ebde0 con 0x55de52a6dc40 2023-09-23T09:22:45.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.686+0000 7f77a6ffd700 1 -- 172.21.15.82:0/2927599787 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55de52a608b0 con 0x55de52a6dc40 2023-09-23T09:22:45.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.687+0000 7f77a6ffd700 1 -- 172.21.15.82:0/2927599787 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 76) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f77bc03a030 con 0x55de52a6dc40 2023-09-23T09:22:45.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.687+0000 7f77e189db80 10 client.26788 fetch_fsmap finished waiting for FSMap version 76 2023-09-23T09:22:45.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.687+0000 7f77e189db80 10 client.26788 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:22:45.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.687+0000 7f77e189db80 20 client.26788 populate_metadata read hostname 'smithi082' 2023-09-23T09:22:45.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.687+0000 7f77e189db80 1 --2- 172.21.15.82:0/2927599787 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55de52adc590 0x55de52ade980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:22:45.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.687+0000 7f77e189db80 4 client.26788 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:22:45.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.687+0000 7f77e189db80 1 -- 172.21.15.82:0/2927599787 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55de529b8970 con 0x55de52adc590 2023-09-23T09:22:45.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.687+0000 7f77c77fe700 1 --2- 172.21.15.82:0/2927599787 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55de52adc590 0x55de52ade980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:22:45.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.688+0000 7f77a6ffd700 10 client.26788 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:22:45.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.688+0000 7f77c77fe700 1 --2- 172.21.15.82:0/2927599787 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55de52adc590 0x55de52ade980 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6b3f76a37a0fac04 server_cookie=e679021d0b1331ed in_seq=0 out_seq=0 2023-09-23T09:22:45.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.688+0000 7f77a6ffd700 1 -- 172.21.15.82:0/2927599787 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55de529b8970 con 0x55de52adc590 2023-09-23T09:22:45.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.688+0000 7f77a6ffd700 10 client.26788 handle_command_reply: tid=0 2023-09-23T09:22:45.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.688+0000 7f77e189db80 1 client.26788 shutdown 2023-09-23T09:22:45.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.688+0000 7f77e189db80 1 -- 172.21.15.82:0/2927599787 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55de52a6dc40 msgr2=0x55de52a7c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:22:45.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.688+0000 7f77e189db80 1 --2- 172.21.15.82:0/2927599787 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55de52a6dc40 0x55de52a7c940 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f77bc0098e0 tx=0x7f77bc009310 comp rx=0 tx=0).stop 2023-09-23T09:22:45.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.688+0000 7f77e189db80 1 -- 172.21.15.82:0/2927599787 shutdown_connections 2023-09-23T09:22:45.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.688+0000 7f77e189db80 1 --2- 172.21.15.82:0/2927599787 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55de52a73ca0 0x55de52ad45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:22:45.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.688+0000 7f77e189db80 1 --2- 172.21.15.82:0/2927599787 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55de52a6dc40 0x55de52a7c940 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:22:45.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.688+0000 7f77e189db80 1 --2- 172.21.15.82:0/2927599787 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55de52adc590 0x55de52ade980 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:22:45.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.688+0000 7f77e189db80 1 --2- 172.21.15.82:0/2927599787 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de52a73380 0x55de52a7ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:22:45.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.688+0000 7f77a6ffd700 0 client.26788 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:22:45.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.688+0000 7f77e189db80 1 -- 172.21.15.82:0/2927599787 >> 172.21.15.82:0/2927599787 conn(0x55de529e20e0 msgr2=0x55de52a720b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:22:45.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.688+0000 7f77e189db80 1 -- 172.21.15.82:0/2927599787 shutdown_connections 2023-09-23T09:22:45.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.688+0000 7f77e189db80 1 -- 172.21.15.82:0/2927599787 wait complete. 2023-09-23T09:22:45.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.689+0000 7f77e189db80 20 client.26788 trim_cache size 0 max 16384 2023-09-23T09:22:45.695 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:22:45.695 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-23T09:22:45.695 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:22:45.695 INFO:teuthology.orchestra.run.smithi082.stdout: "047cbc72-e254-4787-b038-382de9c1a9a4": { 2023-09-23T09:22:45.695 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:22:45.695 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "047cbc72-e254-4787-b038-382de9c1a9a4", 2023-09-23T09:22:45.695 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:22:45.695 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:22:45.695 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:22:45.695 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:22:45.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.689+0000 7f77cdfff700 1 -- 172.21.15.82:0/2621806285 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f77b00a00c0 msgr2=0x7f77b00a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:22:45.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.689+0000 7f77cdfff700 1 --2- 172.21.15.82:0/2621806285 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f77b00a00c0 0x7f77b00a2580 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f77c0095100 tx=0x7f77c0013f90 comp rx=0 tx=0).stop 2023-09-23T09:22:45.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.689+0000 7f77cdfff700 1 -- 172.21.15.82:0/2621806285 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77c81068a0 msgr2=0x7f77c81988e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:22:45.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.689+0000 7f77cdfff700 1 --2- 172.21.15.82:0/2621806285 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77c81068a0 0x7f77c81988e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f77c000efc0 tx=0x7f77c000c3a0 comp rx=0 tx=0).stop 2023-09-23T09:22:45.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.689+0000 7f77cdfff700 1 -- 172.21.15.82:0/2621806285 shutdown_connections 2023-09-23T09:22:45.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.689+0000 7f77cdfff700 1 --2- 172.21.15.82:0/2621806285 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f77b00a00c0 0x7f77b00a2580 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:22:45.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.689+0000 7f77cdfff700 1 --2- 172.21.15.82:0/2621806285 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77c81068a0 0x7f77c81988e0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:22:45.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.689+0000 7f77cdfff700 1 --2- 172.21.15.82:0/2621806285 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77c8100890 0x7f77c819e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:22:45.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.689+0000 7f77cdfff700 1 --2- 172.21.15.82:0/2621806285 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77c8101250 0x7f77c819edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:22:45.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.689+0000 7f77cdfff700 1 -- 172.21.15.82:0/2621806285 >> 172.21.15.82:0/2621806285 conn(0x7f77c80fc380 msgr2=0x7f77c810bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:22:45.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.689+0000 7f77cdfff700 1 -- 172.21.15.82:0/2621806285 shutdown_connections 2023-09-23T09:22:45.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:22:45.689+0000 7f77cdfff700 1 -- 172.21.15.82:0/2621806285 wait complete. 2023-09-23T09:22:45.709 INFO:tasks.cephfs.filesystem:scrub status for tag:047cbc72-e254-4787-b038-382de9c1a9a4 - {'path': '/', 'tag': '047cbc72-e254-4787-b038-382de9c1a9a4', 'options': 'recursive,force'} 2023-09-23T09:22:46.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:22:46 smithi135 ceph-mon[99205]: pgmap v817: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 3.0 MiB/s wr, 397 op/s 2023-09-23T09:22:46.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:22:46 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:22:46.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:22:46 smithi082 ceph-mon[97694]: pgmap v817: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 3.0 MiB/s wr, 397 op/s 2023-09-23T09:22:46.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:22:46 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:22:46.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:22:46 smithi161 ceph-mon[99580]: pgmap v817: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 3.0 MiB/s wr, 397 op/s 2023-09-23T09:22:46.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:22:46 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:22:48.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:22:47 smithi082 ceph-mon[97694]: pgmap v818: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 2.1 MiB/s wr, 275 op/s 2023-09-23T09:22:48.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:22:47 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:22:48.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:22:47 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:22:48.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:22:47 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:22:48.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:22:47 smithi161 ceph-mon[99580]: pgmap v818: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 2.1 MiB/s wr, 275 op/s 2023-09-23T09:22:48.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:22:47 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:22:48.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:22:47 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:22:48.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:22:47 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:22:48.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:22:47 smithi135 ceph-mon[99205]: pgmap v818: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 2.1 MiB/s wr, 275 op/s 2023-09-23T09:22:48.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:22:47 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:22:48.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:22:47 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:22:48.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:22:47 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:22:50.831 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:22:50 smithi135 ceph-mon[99205]: pgmap v819: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 3.2 MiB/s wr, 412 op/s 2023-09-23T09:22:50.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:22:50 smithi082 ceph-mon[97694]: pgmap v819: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 3.2 MiB/s wr, 412 op/s 2023-09-23T09:22:50.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:22:50 smithi161 ceph-mon[99580]: pgmap v819: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 3.2 MiB/s wr, 412 op/s 2023-09-23T09:22:52.836 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:22:52 smithi135 ceph-mon[99205]: pgmap v820: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 2.2 MiB/s wr, 288 op/s 2023-09-23T09:22:52.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:22:52 smithi082 ceph-mon[97694]: pgmap v820: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 2.2 MiB/s wr, 288 op/s 2023-09-23T09:22:52.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:22:52 smithi161 ceph-mon[99580]: pgmap v820: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 2.2 MiB/s wr, 288 op/s 2023-09-23T09:22:54.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:22:54 smithi135 ceph-mon[99205]: pgmap v821: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 2.2 MiB/s wr, 288 op/s 2023-09-23T09:22:54.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:22:54 smithi082 ceph-mon[97694]: pgmap v821: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 2.2 MiB/s wr, 288 op/s 2023-09-23T09:22:54.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:22:54 smithi161 ceph-mon[99580]: pgmap v821: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 2.2 MiB/s wr, 288 op/s 2023-09-23T09:22:56.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:22:56 smithi135 ceph-mon[99205]: pgmap v822: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 3.4 MiB/s wr, 444 op/s 2023-09-23T09:22:56.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:22:56 smithi082 ceph-mon[97694]: pgmap v822: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 3.4 MiB/s wr, 444 op/s 2023-09-23T09:22:56.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:22:56 smithi161 ceph-mon[99580]: pgmap v822: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 3.4 MiB/s wr, 444 op/s 2023-09-23T09:22:58.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:22:57 smithi082 ceph-mon[97694]: pgmap v823: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 2.2 MiB/s wr, 294 op/s 2023-09-23T09:22:58.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:22:57 smithi161 ceph-mon[99580]: pgmap v823: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 2.2 MiB/s wr, 294 op/s 2023-09-23T09:22:58.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:22:57 smithi135 ceph-mon[99205]: pgmap v823: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 2.2 MiB/s wr, 294 op/s 2023-09-23T09:23:00.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:23:00 smithi135 ceph-mon[99205]: pgmap v824: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 3.2 MiB/s wr, 419 op/s 2023-09-23T09:23:00.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:23:00 smithi082 ceph-mon[97694]: pgmap v824: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 3.2 MiB/s wr, 419 op/s 2023-09-23T09:23:00.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:23:00 smithi161 ceph-mon[99580]: pgmap v824: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 3.2 MiB/s wr, 419 op/s 2023-09-23T09:23:02.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:23:02 smithi135 ceph-mon[99205]: pgmap v825: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 2.2 MiB/s wr, 282 op/s 2023-09-23T09:23:02.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:23:02 smithi135 ceph-mon[99205]: osdmap e128: 12 total, 12 up, 12 in 2023-09-23T09:23:02.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:23:02 smithi082 ceph-mon[97694]: pgmap v825: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 2.2 MiB/s wr, 282 op/s 2023-09-23T09:23:02.914 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:23:02 smithi082 ceph-mon[97694]: osdmap e128: 12 total, 12 up, 12 in 2023-09-23T09:23:02.915 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:23:02 smithi161 ceph-mon[99580]: pgmap v825: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 2.2 MiB/s wr, 282 op/s 2023-09-23T09:23:02.915 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:23:02 smithi161 ceph-mon[99580]: osdmap e128: 12 total, 12 up, 12 in 2023-09-23T09:23:04.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:23:04 smithi135 ceph-mon[99205]: pgmap v827: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 2.6 MiB/s wr, 338 op/s 2023-09-23T09:23:04.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:23:04 smithi082 ceph-mon[97694]: pgmap v827: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 2.6 MiB/s wr, 338 op/s 2023-09-23T09:23:04.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:23:04 smithi161 ceph-mon[99580]: pgmap v827: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 2.6 MiB/s wr, 338 op/s 2023-09-23T09:23:06.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:23:06 smithi135 ceph-mon[99205]: pgmap v828: 97 pgs: 97 active+clean; 10 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 2.2 MiB/s wr, 300 op/s 2023-09-23T09:23:06.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:23:06 smithi082 ceph-mon[97694]: pgmap v828: 97 pgs: 97 active+clean; 10 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 2.2 MiB/s wr, 300 op/s 2023-09-23T09:23:06.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:23:06 smithi161 ceph-mon[99580]: pgmap v828: 97 pgs: 97 active+clean; 10 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 2.2 MiB/s wr, 300 op/s 2023-09-23T09:23:08.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:23:07 smithi082 ceph-mon[97694]: osdmap e129: 12 total, 12 up, 12 in 2023-09-23T09:23:08.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:23:07 smithi082 ceph-mon[97694]: pgmap v830: 97 pgs: 97 active+clean; 10 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 1.3 MiB/s wr, 186 op/s 2023-09-23T09:23:08.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:23:07 smithi161 ceph-mon[99580]: osdmap e129: 12 total, 12 up, 12 in 2023-09-23T09:23:08.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:23:07 smithi161 ceph-mon[99580]: pgmap v830: 97 pgs: 97 active+clean; 10 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 1.3 MiB/s wr, 186 op/s 2023-09-23T09:23:08.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:23:07 smithi135 ceph-mon[99205]: osdmap e129: 12 total, 12 up, 12 in 2023-09-23T09:23:08.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:23:07 smithi135 ceph-mon[99205]: pgmap v830: 97 pgs: 97 active+clean; 10 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 1.3 MiB/s wr, 186 op/s 2023-09-23T09:23:10.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:23:10 smithi135 ceph-mon[99205]: pgmap v831: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 2.6 MiB/s wr, 343 op/s 2023-09-23T09:23:10.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:23:10 smithi082 ceph-mon[97694]: pgmap v831: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 2.6 MiB/s wr, 343 op/s 2023-09-23T09:23:10.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:23:10 smithi161 ceph-mon[99580]: pgmap v831: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 2.6 MiB/s wr, 343 op/s 2023-09-23T09:23:12.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:23:12 smithi135 ceph-mon[99205]: pgmap v832: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 218 KiB/s rd, 2.1 MiB/s wr, 276 op/s 2023-09-23T09:23:12.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:23:12 smithi082 ceph-mon[97694]: pgmap v832: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 218 KiB/s rd, 2.1 MiB/s wr, 276 op/s 2023-09-23T09:23:12.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:23:12 smithi161 ceph-mon[99580]: pgmap v832: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 218 KiB/s rd, 2.1 MiB/s wr, 276 op/s 2023-09-23T09:23:14.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:23:14 smithi135 ceph-mon[99205]: pgmap v833: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 2.1 MiB/s wr, 275 op/s 2023-09-23T09:23:14.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:23:14 smithi082 ceph-mon[97694]: pgmap v833: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 2.1 MiB/s wr, 275 op/s 2023-09-23T09:23:14.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:23:14 smithi161 ceph-mon[99580]: pgmap v833: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 2.1 MiB/s wr, 275 op/s 2023-09-23T09:23:15.710 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:23:16.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.036+0000 7f677f9ff700 1 -- 172.21.15.82:0/1131878819 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6778101250 msgr2=0x7f677810d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:23:16.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.036+0000 7f677f9ff700 1 --2- 172.21.15.82:0/1131878819 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6778101250 0x7f677810d760 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f677000b0a0 tx=0x7f677000b3b0 comp rx=0 tx=0).stop 2023-09-23T09:23:16.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.036+0000 7f677f9ff700 1 -- 172.21.15.82:0/1131878819 shutdown_connections 2023-09-23T09:23:16.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.036+0000 7f677f9ff700 1 --2- 172.21.15.82:0/1131878819 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6778101250 0x7f677810d760 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:23:16.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.036+0000 7f677f9ff700 1 --2- 172.21.15.82:0/1131878819 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f67781068a0 0x7f6778106c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:23:16.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.036+0000 7f677f9ff700 1 --2- 172.21.15.82:0/1131878819 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6778100890 0x7f6778100d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:23:16.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.036+0000 7f677f9ff700 1 -- 172.21.15.82:0/1131878819 >> 172.21.15.82:0/1131878819 conn(0x7f67780fc380 msgr2=0x7f67780fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:23:16.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.036+0000 7f677f9ff700 1 -- 172.21.15.82:0/1131878819 shutdown_connections 2023-09-23T09:23:16.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.036+0000 7f677f9ff700 1 -- 172.21.15.82:0/1131878819 wait complete. 2023-09-23T09:23:16.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.037+0000 7f677f9ff700 1 Processor -- start 2023-09-23T09:23:16.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.037+0000 7f677f9ff700 1 -- start start 2023-09-23T09:23:16.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.038+0000 7f677f9ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6778100890 0x7f6778072c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:23:16.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.038+0000 7f677f9ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6778101250 0x7f6778073160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:23:16.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.038+0000 7f677f9ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67781068a0 0x7f67781a4a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:23:16.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.038+0000 7f677f9ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6778073990 con 0x7f6778101250 2023-09-23T09:23:16.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.038+0000 7f677f9ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67781a4f80 con 0x7f67781068a0 2023-09-23T09:23:16.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.038+0000 7f677f9ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67781a50c0 con 0x7f6778100890 2023-09-23T09:23:16.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.038+0000 7f677cf9a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6778101250 0x7f6778073160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:23:16.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.038+0000 7f677d79b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6778100890 0x7f6778072c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:23:16.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.038+0000 7f677cf9a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6778101250 0x7f6778073160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40400/0 (socket says 172.21.15.82:40400) 2023-09-23T09:23:16.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.038+0000 7f677cf9a700 1 -- 172.21.15.82:0/2443308512 learned_addr learned my addr 172.21.15.82:0/2443308512 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:23:16.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.038+0000 7f677df9c700 1 --2- 172.21.15.82:0/2443308512 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67781068a0 0x7f67781a4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:23:16.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.039+0000 7f677d79b700 1 -- 172.21.15.82:0/2443308512 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67781068a0 msgr2=0x7f67781a4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:23:16.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.039+0000 7f677d79b700 1 --2- 172.21.15.82:0/2443308512 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67781068a0 0x7f67781a4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:23:16.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.039+0000 7f677d79b700 1 -- 172.21.15.82:0/2443308512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6778101250 msgr2=0x7f6778073160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:23:16.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.039+0000 7f677d79b700 1 --2- 172.21.15.82:0/2443308512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6778101250 0x7f6778073160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:23:16.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.039+0000 7f677d79b700 1 -- 172.21.15.82:0/2443308512 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6770009d00 con 0x7f6778100890 2023-09-23T09:23:16.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.039+0000 7f677cf9a700 1 --2- 172.21.15.82:0/2443308512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6778101250 0x7f6778073160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:23:16.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.039+0000 7f677d79b700 1 --2- 172.21.15.82:0/2443308512 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6778100890 0x7f6778072c20 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f677400e9f0 tx=0x7f677400ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:23:16.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.039+0000 7f676e7fc700 1 -- 172.21.15.82:0/2443308512 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f677400c9c0 con 0x7f6778100890 2023-09-23T09:23:16.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.039+0000 7f677f9ff700 1 -- 172.21.15.82:0/2443308512 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67781a5320 con 0x7f6778100890 2023-09-23T09:23:16.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.039+0000 7f676e7fc700 1 -- 172.21.15.82:0/2443308512 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6774010430 con 0x7f6778100890 2023-09-23T09:23:16.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.039+0000 7f676e7fc700 1 -- 172.21.15.82:0/2443308512 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6774018680 con 0x7f6778100890 2023-09-23T09:23:16.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.039+0000 7f677f9ff700 1 -- 172.21.15.82:0/2443308512 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67781a5850 con 0x7f6778100890 2023-09-23T09:23:16.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.042+0000 7f676e7fc700 1 -- 172.21.15.82:0/2443308512 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f6774010830 con 0x7f6778100890 2023-09-23T09:23:16.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.044+0000 7f6793408b80 1 Processor -- start 2023-09-23T09:23:16.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.044+0000 7f6793408b80 1 -- start start 2023-09-23T09:23:16.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.045+0000 7f6793408b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e0b5554380 0x55e0b5554760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:23:16.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.045+0000 7f6793408b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0b5554ca0 0x55e0b554e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:23:16.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.045+0000 7f6793408b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e0b554ec40 0x55e0b554f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:23:16.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.045+0000 7f6793408b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0b54b67b0 con 0x55e0b5554380 2023-09-23T09:23:16.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.045+0000 7f6793408b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0b54a7780 con 0x55e0b5554ca0 2023-09-23T09:23:16.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.045+0000 7f6793408b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0b54a50a0 con 0x55e0b554ec40 2023-09-23T09:23:16.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.045+0000 7f676e7fc700 1 --2- 172.21.15.82:0/2443308512 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f67640a00c0 0x7f67640a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:23:16.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.045+0000 7f677cf9a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e0b554ec40 0x55e0b554f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:23:16.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.045+0000 7f677d79b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0b5554ca0 0x55e0b554e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:23:16.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.045+0000 7f677df9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e0b5554380 0x55e0b5554760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:23:16.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.045+0000 7f677cf9a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e0b554ec40 0x55e0b554f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:42874/0 (socket says 172.21.15.82:42874) 2023-09-23T09:23:16.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.045+0000 7f677cf9a700 1 -- 172.21.15.82:0/2782370071 learned_addr learned my addr 172.21.15.82:0/2782370071 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:23:16.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.045+0000 7f676e7fc700 1 -- 172.21.15.82:0/2443308512 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f6774014070 con 0x7f6778100890 2023-09-23T09:23:16.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.045+0000 7f677df9c700 1 --2- 172.21.15.82:0/2443308512 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f67640a00c0 0x7f67640a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:23:16.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.046+0000 7f677cf9a700 1 -- 172.21.15.82:0/2782370071 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0b5554ca0 msgr2=0x55e0b554e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:23:16.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.046+0000 7f677cf9a700 1 --2- 172.21.15.82:0/2782370071 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0b5554ca0 0x55e0b554e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:23:16.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.046+0000 7f677cf9a700 1 -- 172.21.15.82:0/2782370071 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e0b5554380 msgr2=0x55e0b5554760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:23:16.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.046+0000 7f677cf9a700 1 --2- 172.21.15.82:0/2782370071 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e0b5554380 0x55e0b5554760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:23:16.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.046+0000 7f677cf9a700 1 -- 172.21.15.82:0/2782370071 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e0b5320630 con 0x55e0b554ec40 2023-09-23T09:23:16.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.046+0000 7f677cf9a700 1 --2- 172.21.15.82:0/2782370071 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e0b554ec40 0x55e0b554f0a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6768011680 tx=0x7f6768011990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ff8654b79a4a56c server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:23:16.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.046+0000 7f677df9c700 1 --2- 172.21.15.82:0/2443308512 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f67640a00c0 0x7f67640a2580 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6778074d30 tx=0x7f6770006230 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:23:16.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.046+0000 7f67637fe700 1 -- 172.21.15.82:0/2782370071 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6768004030 con 0x55e0b554ec40 2023-09-23T09:23:16.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.046+0000 7f67637fe700 1 -- 172.21.15.82:0/2782370071 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6768003680 con 0x55e0b554ec40 2023-09-23T09:23:16.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.046+0000 7f67637fe700 1 -- 172.21.15.82:0/2782370071 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67680196b0 con 0x55e0b554ec40 2023-09-23T09:23:16.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.047+0000 7f6793408b80 1 -- 172.21.15.82:0/2782370071 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e0b554ec40 msgr2=0x55e0b554f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:23:16.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.047+0000 7f6793408b80 1 --2- 172.21.15.82:0/2782370071 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e0b554ec40 0x55e0b554f0a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6768011680 tx=0x7f6768011990 comp rx=0 tx=0).stop 2023-09-23T09:23:16.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.047+0000 7f6793408b80 1 -- 172.21.15.82:0/2782370071 shutdown_connections 2023-09-23T09:23:16.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.047+0000 7f6793408b80 1 --2- 172.21.15.82:0/2782370071 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e0b554ec40 0x55e0b554f0a0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:23:16.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.047+0000 7f6793408b80 1 --2- 172.21.15.82:0/2782370071 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e0b5554380 0x55e0b5554760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:23:16.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.047+0000 7f6793408b80 1 --2- 172.21.15.82:0/2782370071 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0b5554ca0 0x55e0b554e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:23:16.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.047+0000 7f6793408b80 1 -- 172.21.15.82:0/2782370071 >> 172.21.15.82:0/2782370071 conn(0x55e0b54c30e0 msgr2=0x55e0b5549410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:23:16.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.047+0000 7f6793408b80 1 -- 172.21.15.82:0/2782370071 shutdown_connections 2023-09-23T09:23:16.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.047+0000 7f6793408b80 1 -- 172.21.15.82:0/2782370071 wait complete. 2023-09-23T09:23:16.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.048+0000 7f6793408b80 1 -- start start 2023-09-23T09:23:16.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.048+0000 7f6793408b80 1 Processor -- start 2023-09-23T09:23:16.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.048+0000 7f6793408b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e0b554ec40 0x55e0b555abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:23:16.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.048+0000 7f6793408b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0b5554380 0x55e0b5557ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:23:16.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.048+0000 7f6793408b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e0b5554ca0 0x55e0b5558540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:23:16.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.048+0000 7f6793408b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0b54a0990 con 0x55e0b554ec40 2023-09-23T09:23:16.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.048+0000 7f6793408b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0b543ebb0 con 0x55e0b5554380 2023-09-23T09:23:16.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.048+0000 7f6793408b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0b543e8b0 con 0x55e0b5554ca0 2023-09-23T09:23:16.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.048+0000 7f6793408b80 10 client.0 _ll_register_callbacks cb 0x55e0b5388a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:23:16.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.049+0000 7f677d79b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e0b554ec40 0x55e0b555abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:23:16.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.049+0000 7f677cf9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0b5554380 0x55e0b5557ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:23:16.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.049+0000 7f677cf9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0b5554380 0x55e0b5557ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:56786/0 (socket says 172.21.15.82:56786) 2023-09-23T09:23:16.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.049+0000 7f677cf9a700 1 -- 172.21.15.82:0/971869146 learned_addr learned my addr 172.21.15.82:0/971869146 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:23:16.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.049+0000 7f677df9c700 1 --2- 172.21.15.82:0/971869146 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e0b5554ca0 0x55e0b5558540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:23:16.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.049+0000 7f677d79b700 1 -- 172.21.15.82:0/971869146 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e0b5554ca0 msgr2=0x55e0b5558540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:23:16.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.049+0000 7f677d79b700 1 --2- 172.21.15.82:0/971869146 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e0b5554ca0 0x55e0b5558540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:23:16.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.049+0000 7f677d79b700 1 -- 172.21.15.82:0/971869146 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0b5554380 msgr2=0x55e0b5557ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:23:16.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.049+0000 7f677d79b700 1 --2- 172.21.15.82:0/971869146 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0b5554380 0x55e0b5557ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:23:16.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.049+0000 7f677d79b700 1 -- 172.21.15.82:0/971869146 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6768009e10 con 0x55e0b554ec40 2023-09-23T09:23:16.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.049+0000 7f677cf9a700 1 --2- 172.21.15.82:0/971869146 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0b5554380 0x55e0b5557ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:23:16.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.049+0000 7f677d79b700 1 --2- 172.21.15.82:0/971869146 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e0b554ec40 0x55e0b555abf0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f67740c8e30 tx=0x7f67740686b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec444ba8be78dcb1 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:23:16.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.049+0000 7f6760ff9700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:23:16.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.050+0000 7f6760ff9700 1 -- 172.21.15.82:0/971869146 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6774064af0 con 0x55e0b554ec40 2023-09-23T09:23:16.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.050+0000 7f6760ff9700 1 -- 172.21.15.82:0/971869146 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(129..129 src has 1..129) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f6774064d90 con 0x55e0b554ec40 2023-09-23T09:23:16.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.050+0000 7f6793408b80 1 -- 172.21.15.82:0/971869146 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e0b551e1c0 con 0x55e0b554ec40 2023-09-23T09:23:16.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.050+0000 7f6760ff9700 1 -- 172.21.15.82:0/971869146 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=76) v2 ==== 24+0+0 (secure 0 0 0) 0x7f67740994f0 con 0x55e0b554ec40 2023-09-23T09:23:16.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.050+0000 7f6793408b80 10 client.17073 fetch_fsmap learned FSMap version 76 2023-09-23T09:23:16.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.050+0000 7f6793408b80 1 -- 172.21.15.82:0/971869146 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=76,monmap=4+}) v3 -- 0x55e0b52ccde0 con 0x55e0b554ec40 2023-09-23T09:23:16.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.050+0000 7f6760ff9700 1 -- 172.21.15.82:0/971869146 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55e0b551e1c0 con 0x55e0b554ec40 2023-09-23T09:23:16.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.050+0000 7f6760ff9700 1 -- 172.21.15.82:0/971869146 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 76) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f67740982e0 con 0x55e0b554ec40 2023-09-23T09:23:16.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.050+0000 7f6793408b80 10 client.17073 fetch_fsmap finished waiting for FSMap version 76 2023-09-23T09:23:16.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.050+0000 7f6793408b80 10 client.17073 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:23:16.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.050+0000 7f6793408b80 20 client.17073 populate_metadata read hostname 'smithi082' 2023-09-23T09:23:16.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.050+0000 7f6793408b80 1 --2- 172.21.15.82:0/971869146 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55e0b5568680 0x55e0b556aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:23:16.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.050+0000 7f6793408b80 4 client.17073 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:23:16.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.050+0000 7f6793408b80 1 -- 172.21.15.82:0/971869146 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e0b5446ba0 con 0x55e0b5568680 2023-09-23T09:23:16.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.051+0000 7f677cf9a700 1 --2- 172.21.15.82:0/971869146 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55e0b5568680 0x55e0b556aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:23:16.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.051+0000 7f677cf9a700 1 --2- 172.21.15.82:0/971869146 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55e0b5568680 0x55e0b556aaa0 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=abe61fa872e5f2 server_cookie=ced0f70db6d6b708 in_seq=0 out_seq=0 2023-09-23T09:23:16.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.051+0000 7f6760ff9700 10 client.17073 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:23:16.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.052+0000 7f6760ff9700 1 -- 172.21.15.82:0/971869146 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e0b5446ba0 con 0x55e0b5568680 2023-09-23T09:23:16.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.052+0000 7f6760ff9700 10 client.17073 handle_command_reply: tid=0 2023-09-23T09:23:16.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.052+0000 7f6793408b80 1 client.17073 shutdown 2023-09-23T09:23:16.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.052+0000 7f6793408b80 1 -- 172.21.15.82:0/971869146 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e0b554ec40 msgr2=0x55e0b555abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:23:16.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.052+0000 7f6793408b80 1 --2- 172.21.15.82:0/971869146 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e0b554ec40 0x55e0b555abf0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f67740c8e30 tx=0x7f67740686b0 comp rx=0 tx=0).stop 2023-09-23T09:23:16.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.052+0000 7f6793408b80 1 -- 172.21.15.82:0/971869146 shutdown_connections 2023-09-23T09:23:16.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.052+0000 7f6793408b80 1 --2- 172.21.15.82:0/971869146 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e0b5554ca0 0x55e0b5558540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:23:16.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.052+0000 7f6793408b80 1 --2- 172.21.15.82:0/971869146 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55e0b5568680 0x55e0b556aaa0 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:23:16.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.052+0000 7f6793408b80 1 --2- 172.21.15.82:0/971869146 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e0b554ec40 0x55e0b555abf0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:23:16.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.052+0000 7f6793408b80 1 --2- 172.21.15.82:0/971869146 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0b5554380 0x55e0b5557ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:23:16.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.052+0000 7f6760ff9700 0 client.17073 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:23:16.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.052+0000 7f6793408b80 1 -- 172.21.15.82:0/971869146 >> 172.21.15.82:0/971869146 conn(0x55e0b54c30e0 msgr2=0x55e0b5543b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:23:16.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.053+0000 7f6793408b80 1 -- 172.21.15.82:0/971869146 shutdown_connections 2023-09-23T09:23:16.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.053+0000 7f6793408b80 1 -- 172.21.15.82:0/971869146 wait complete. 2023-09-23T09:23:16.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.053+0000 7f6793408b80 20 client.17073 trim_cache size 0 max 16384 2023-09-23T09:23:16.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.070+0000 7f6793408b80 1 Processor -- start 2023-09-23T09:23:16.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.070+0000 7f6793408b80 1 -- start start 2023-09-23T09:23:16.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.071+0000 7f6793408b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e0b554ec40 0x55e0b554e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:23:16.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.071+0000 7f6793408b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0b5554380 0x55e0b555a790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:23:16.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.071+0000 7f6793408b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e0b5554ca0 0x55e0b55576a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:23:16.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.071+0000 7f6793408b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0b5322920 con 0x55e0b5554ca0 2023-09-23T09:23:16.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.071+0000 7f6793408b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0b5545c80 con 0x55e0b5554380 2023-09-23T09:23:16.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.071+0000 7f6793408b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0b5545810 con 0x55e0b554ec40 2023-09-23T09:23:16.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.071+0000 7f677df9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e0b5554ca0 0x55e0b55576a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:23:16.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.071+0000 7f677d79b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e0b554ec40 0x55e0b554e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:23:16.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.071+0000 7f677df9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e0b5554ca0 0x55e0b55576a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40424/0 (socket says 172.21.15.82:40424) 2023-09-23T09:23:16.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.071+0000 7f677df9c700 1 -- 172.21.15.82:0/798590340 learned_addr learned my addr 172.21.15.82:0/798590340 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:23:16.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.071+0000 7f677d79b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e0b554ec40 0x55e0b554e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:42894/0 (socket says 172.21.15.82:42894) 2023-09-23T09:23:16.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.071+0000 7f677cf9a700 1 --2- 172.21.15.82:0/798590340 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0b5554380 0x55e0b555a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:23:16.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.071+0000 7f677df9c700 1 -- 172.21.15.82:0/798590340 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e0b554ec40 msgr2=0x55e0b554e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:23:16.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.071+0000 7f677df9c700 1 --2- 172.21.15.82:0/798590340 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e0b554ec40 0x55e0b554e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:23:16.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.072+0000 7f677df9c700 1 -- 172.21.15.82:0/798590340 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0b5554380 msgr2=0x55e0b555a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:23:16.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.072+0000 7f677df9c700 1 --2- 172.21.15.82:0/798590340 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0b5554380 0x55e0b555a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:23:16.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.072+0000 7f677df9c700 1 -- 172.21.15.82:0/798590340 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e0b5542df0 con 0x55e0b5554ca0 2023-09-23T09:23:16.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.072+0000 7f677d79b700 1 --2- 172.21.15.82:0/798590340 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e0b554ec40 0x55e0b554e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:23:16.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.072+0000 7f677df9c700 1 --2- 172.21.15.82:0/798590340 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e0b5554ca0 0x55e0b55576a0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f677000b0a0 tx=0x7f6770006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9d0ef5140deffea server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:23:16.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.072+0000 7f6763fff700 1 -- 172.21.15.82:0/798590340 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f677000e040 con 0x55e0b5554ca0 2023-09-23T09:23:16.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.072+0000 7f6763fff700 1 -- 172.21.15.82:0/798590340 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6770003c00 con 0x55e0b5554ca0 2023-09-23T09:23:16.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.072+0000 7f6763fff700 1 -- 172.21.15.82:0/798590340 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67700206b0 con 0x55e0b5554ca0 2023-09-23T09:23:16.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.073+0000 7f6793408b80 1 -- 172.21.15.82:0/798590340 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e0b5554ca0 msgr2=0x55e0b55576a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:23:16.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.073+0000 7f6793408b80 1 --2- 172.21.15.82:0/798590340 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e0b5554ca0 0x55e0b55576a0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f677000b0a0 tx=0x7f6770006000 comp rx=0 tx=0).stop 2023-09-23T09:23:16.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.073+0000 7f6793408b80 1 -- 172.21.15.82:0/798590340 shutdown_connections 2023-09-23T09:23:16.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.073+0000 7f6793408b80 1 --2- 172.21.15.82:0/798590340 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e0b5554ca0 0x55e0b55576a0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:23:16.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.073+0000 7f6793408b80 1 --2- 172.21.15.82:0/798590340 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e0b554ec40 0x55e0b554e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:23:16.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.073+0000 7f6793408b80 1 --2- 172.21.15.82:0/798590340 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0b5554380 0x55e0b555a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:23:16.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.073+0000 7f6793408b80 1 -- 172.21.15.82:0/798590340 >> 172.21.15.82:0/798590340 conn(0x55e0b54c30e0 msgr2=0x55e0b5552050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:23:16.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.073+0000 7f6793408b80 1 -- 172.21.15.82:0/798590340 shutdown_connections 2023-09-23T09:23:16.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.073+0000 7f6793408b80 1 -- 172.21.15.82:0/798590340 wait complete. 2023-09-23T09:23:16.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.073+0000 7f6793408b80 1 -- start start 2023-09-23T09:23:16.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.074+0000 7f6793408b80 1 Processor -- start 2023-09-23T09:23:16.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.074+0000 7f6793408b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e0b554ec40 0x55e0b5551270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:23:16.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.074+0000 7f6793408b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e0b5554380 0x55e0b55517b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:23:16.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.074+0000 7f6793408b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0b5554ca0 0x55e0b554fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:23:16.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.074+0000 7f6793408b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0b5550400 con 0x55e0b5554380 2023-09-23T09:23:16.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.074+0000 7f6793408b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0b5550570 con 0x55e0b5554ca0 2023-09-23T09:23:16.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.074+0000 7f6793408b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0b5550730 con 0x55e0b554ec40 2023-09-23T09:23:16.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.074+0000 7f6793408b80 10 client.0 _ll_register_callbacks cb 0x7f6774098bc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:23:16.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.075+0000 7f677cf9a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e0b5554380 0x55e0b55517b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:23:16.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.075+0000 7f677d79b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e0b554ec40 0x55e0b5551270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:23:16.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.075+0000 7f677cf9a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e0b5554380 0x55e0b55517b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40432/0 (socket says 172.21.15.82:40432) 2023-09-23T09:23:16.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.075+0000 7f677cf9a700 1 -- 172.21.15.82:0/3391019755 learned_addr learned my addr 172.21.15.82:0/3391019755 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:23:16.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.075+0000 7f677df9c700 1 --2- 172.21.15.82:0/3391019755 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0b5554ca0 0x55e0b554fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:23:16.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.075+0000 7f677cf9a700 1 -- 172.21.15.82:0/3391019755 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e0b554ec40 msgr2=0x55e0b5551270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:23:16.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.075+0000 7f677cf9a700 1 --2- 172.21.15.82:0/3391019755 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e0b554ec40 0x55e0b5551270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:23:16.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.075+0000 7f677cf9a700 1 -- 172.21.15.82:0/3391019755 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0b5554ca0 msgr2=0x55e0b554fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:23:16.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.075+0000 7f677cf9a700 1 --2- 172.21.15.82:0/3391019755 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0b5554ca0 0x55e0b554fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:23:16.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.075+0000 7f677cf9a700 1 -- 172.21.15.82:0/3391019755 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e0b52ccde0 con 0x55e0b5554380 2023-09-23T09:23:16.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.075+0000 7f677d79b700 1 --2- 172.21.15.82:0/3391019755 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e0b554ec40 0x55e0b5551270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:23:16.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.075+0000 7f677cf9a700 1 --2- 172.21.15.82:0/3391019755 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e0b5554380 0x55e0b55517b0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f6768011680 tx=0x7f6768005d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d11df90ac934964 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:23:16.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.075+0000 7f6760ff9700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:23:16.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.076+0000 7f6760ff9700 1 -- 172.21.15.82:0/3391019755 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6768003cb0 con 0x55e0b5554380 2023-09-23T09:23:16.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.076+0000 7f6793408b80 1 -- 172.21.15.82:0/3391019755 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e0b55418b0 con 0x55e0b5554380 2023-09-23T09:23:16.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.076+0000 7f6760ff9700 1 -- 172.21.15.82:0/3391019755 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(129..129 src has 1..129) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f6768029040 con 0x55e0b5554380 2023-09-23T09:23:16.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.076+0000 7f6760ff9700 1 -- 172.21.15.82:0/3391019755 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=76) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6768005370 con 0x55e0b5554380 2023-09-23T09:23:16.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.076+0000 7f6793408b80 10 client.17079 fetch_fsmap learned FSMap version 76 2023-09-23T09:23:16.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.076+0000 7f6793408b80 1 -- 172.21.15.82:0/3391019755 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=76,monmap=4+}) v3 -- 0x7f677810e060 con 0x55e0b5554380 2023-09-23T09:23:16.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.076+0000 7f6760ff9700 1 -- 172.21.15.82:0/3391019755 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55e0b55418b0 con 0x55e0b5554380 2023-09-23T09:23:16.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.076+0000 7f6760ff9700 1 -- 172.21.15.82:0/3391019755 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 76) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f676802dc10 con 0x55e0b5554380 2023-09-23T09:23:16.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.076+0000 7f6793408b80 10 client.17079 fetch_fsmap finished waiting for FSMap version 76 2023-09-23T09:23:16.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.076+0000 7f6793408b80 10 client.17079 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:23:16.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.076+0000 7f6793408b80 20 client.17079 populate_metadata read hostname 'smithi082' 2023-09-23T09:23:16.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.076+0000 7f6793408b80 1 --2- 172.21.15.82:0/3391019755 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55e0b55bd530 0x55e0b55bf950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:23:16.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.076+0000 7f6793408b80 4 client.17079 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:23:16.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.076+0000 7f6793408b80 1 -- 172.21.15.82:0/3391019755 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55e0b5499970 con 0x55e0b55bd530 2023-09-23T09:23:16.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.077+0000 7f677d79b700 1 --2- 172.21.15.82:0/3391019755 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55e0b55bd530 0x55e0b55bf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:23:16.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.077+0000 7f677d79b700 1 --2- 172.21.15.82:0/3391019755 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55e0b55bd530 0x55e0b55bf950 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5976dc1c2eff981b server_cookie=5fa0dc037516cc33 in_seq=0 out_seq=0 2023-09-23T09:23:16.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.077+0000 7f6760ff9700 10 client.17079 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:23:16.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.078+0000 7f6760ff9700 1 -- 172.21.15.82:0/3391019755 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55e0b5499970 con 0x55e0b55bd530 2023-09-23T09:23:16.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.078+0000 7f6760ff9700 10 client.17079 handle_command_reply: tid=0 2023-09-23T09:23:16.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.078+0000 7f6793408b80 1 client.17079 shutdown 2023-09-23T09:23:16.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.078+0000 7f6793408b80 1 -- 172.21.15.82:0/3391019755 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e0b5554380 msgr2=0x55e0b55517b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:23:16.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.078+0000 7f6793408b80 1 --2- 172.21.15.82:0/3391019755 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e0b5554380 0x55e0b55517b0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f6768011680 tx=0x7f6768005d90 comp rx=0 tx=0).stop 2023-09-23T09:23:16.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.078+0000 7f6793408b80 1 -- 172.21.15.82:0/3391019755 shutdown_connections 2023-09-23T09:23:16.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.078+0000 7f6793408b80 1 --2- 172.21.15.82:0/3391019755 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0b5554ca0 0x55e0b554fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:23:16.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.078+0000 7f6793408b80 1 --2- 172.21.15.82:0/3391019755 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e0b554ec40 0x55e0b5551270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:23:16.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.078+0000 7f6793408b80 1 --2- 172.21.15.82:0/3391019755 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55e0b55bd530 0x55e0b55bf950 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:23:16.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.078+0000 7f6793408b80 1 --2- 172.21.15.82:0/3391019755 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e0b5554380 0x55e0b55517b0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:23:16.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.078+0000 7f6793408b80 1 -- 172.21.15.82:0/3391019755 >> 172.21.15.82:0/3391019755 conn(0x55e0b54c30e0 msgr2=0x55e0b5552fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:23:16.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.078+0000 7f6760ff9700 0 client.17079 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:23:16.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.078+0000 7f6793408b80 1 -- 172.21.15.82:0/3391019755 shutdown_connections 2023-09-23T09:23:16.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.078+0000 7f6793408b80 1 -- 172.21.15.82:0/3391019755 wait complete. 2023-09-23T09:23:16.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.078+0000 7f6793408b80 20 client.17079 trim_cache size 0 max 16384 2023-09-23T09:23:16.085 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:23:16.085 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-23T09:23:16.085 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:23:16.085 INFO:teuthology.orchestra.run.smithi082.stdout: "047cbc72-e254-4787-b038-382de9c1a9a4": { 2023-09-23T09:23:16.085 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:23:16.085 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "047cbc72-e254-4787-b038-382de9c1a9a4", 2023-09-23T09:23:16.085 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:23:16.085 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:23:16.085 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:23:16.086 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:23:16.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.079+0000 7f677f9ff700 1 -- 172.21.15.82:0/2443308512 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f67640a00c0 msgr2=0x7f67640a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:23:16.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.079+0000 7f677f9ff700 1 --2- 172.21.15.82:0/2443308512 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f67640a00c0 0x7f67640a2580 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6778074d30 tx=0x7f6770006230 comp rx=0 tx=0).stop 2023-09-23T09:23:16.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.079+0000 7f677f9ff700 1 -- 172.21.15.82:0/2443308512 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6778100890 msgr2=0x7f6778072c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:23:16.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.079+0000 7f677f9ff700 1 --2- 172.21.15.82:0/2443308512 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6778100890 0x7f6778072c20 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f677400e9f0 tx=0x7f677400ed00 comp rx=0 tx=0).stop 2023-09-23T09:23:16.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.079+0000 7f677f9ff700 1 -- 172.21.15.82:0/2443308512 shutdown_connections 2023-09-23T09:23:16.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.079+0000 7f677f9ff700 1 --2- 172.21.15.82:0/2443308512 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f67640a00c0 0x7f67640a2580 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:23:16.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.079+0000 7f677f9ff700 1 --2- 172.21.15.82:0/2443308512 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67781068a0 0x7f67781a4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:23:16.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.079+0000 7f677f9ff700 1 --2- 172.21.15.82:0/2443308512 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6778100890 0x7f6778072c20 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:23:16.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.079+0000 7f677f9ff700 1 --2- 172.21.15.82:0/2443308512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6778101250 0x7f6778073160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:23:16.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.079+0000 7f677f9ff700 1 -- 172.21.15.82:0/2443308512 >> 172.21.15.82:0/2443308512 conn(0x7f67780fc380 msgr2=0x7f67781043a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:23:16.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.079+0000 7f677f9ff700 1 -- 172.21.15.82:0/2443308512 shutdown_connections 2023-09-23T09:23:16.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:16.079+0000 7f677f9ff700 1 -- 172.21.15.82:0/2443308512 wait complete. 2023-09-23T09:23:16.098 INFO:tasks.cephfs.filesystem:scrub status for tag:047cbc72-e254-4787-b038-382de9c1a9a4 - {'path': '/', 'tag': '047cbc72-e254-4787-b038-382de9c1a9a4', 'options': 'recursive,force'} 2023-09-23T09:23:16.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:23:16 smithi135 ceph-mon[99205]: pgmap v834: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 2.2 MiB/s wr, 286 op/s 2023-09-23T09:23:16.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:23:16 smithi082 ceph-mon[97694]: pgmap v834: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 2.2 MiB/s wr, 286 op/s 2023-09-23T09:23:16.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:23:16 smithi161 ceph-mon[99580]: pgmap v834: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 2.2 MiB/s wr, 286 op/s 2023-09-23T09:23:18.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:23:17 smithi161 ceph-mon[99580]: pgmap v835: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 2.1 MiB/s wr, 269 op/s 2023-09-23T09:23:18.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:23:17 smithi135 ceph-mon[99205]: pgmap v835: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 2.1 MiB/s wr, 269 op/s 2023-09-23T09:23:18.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:23:17 smithi082 ceph-mon[97694]: pgmap v835: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 2.1 MiB/s wr, 269 op/s 2023-09-23T09:23:20.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:23:20 smithi135 ceph-mon[99205]: pgmap v836: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 2.7 MiB/s wr, 359 op/s 2023-09-23T09:23:20.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:23:20 smithi082 ceph-mon[97694]: pgmap v836: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 2.7 MiB/s wr, 359 op/s 2023-09-23T09:23:20.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:23:20 smithi161 ceph-mon[99580]: pgmap v836: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 2.7 MiB/s wr, 359 op/s 2023-09-23T09:23:22.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:23:22 smithi135 ceph-mon[99205]: pgmap v837: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 1.9 MiB/s wr, 254 op/s 2023-09-23T09:23:22.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:23:22 smithi082 ceph-mon[97694]: pgmap v837: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 1.9 MiB/s wr, 254 op/s 2023-09-23T09:23:22.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:23:22 smithi161 ceph-mon[99580]: pgmap v837: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 1.9 MiB/s wr, 254 op/s 2023-09-23T09:23:24.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:23:24 smithi135 ceph-mon[99205]: pgmap v838: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 1.9 MiB/s wr, 254 op/s 2023-09-23T09:23:24.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:23:24 smithi082 ceph-mon[97694]: pgmap v838: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 1.9 MiB/s wr, 254 op/s 2023-09-23T09:23:24.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:23:24 smithi161 ceph-mon[99580]: pgmap v838: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 1.9 MiB/s wr, 254 op/s 2023-09-23T09:23:26.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:23:26 smithi135 ceph-mon[99205]: pgmap v839: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 3.1 MiB/s wr, 400 op/s 2023-09-23T09:23:26.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:23:26 smithi082 ceph-mon[97694]: pgmap v839: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 3.1 MiB/s wr, 400 op/s 2023-09-23T09:23:26.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:23:26 smithi161 ceph-mon[99580]: pgmap v839: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 3.1 MiB/s wr, 400 op/s 2023-09-23T09:23:28.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:23:27 smithi161 ceph-mon[99580]: pgmap v840: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 2.0 MiB/s wr, 267 op/s 2023-09-23T09:23:28.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:23:27 smithi135 ceph-mon[99205]: pgmap v840: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 2.0 MiB/s wr, 267 op/s 2023-09-23T09:23:28.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:23:27 smithi082 ceph-mon[97694]: pgmap v840: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 2.0 MiB/s wr, 267 op/s 2023-09-23T09:23:30.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:23:30 smithi135 ceph-mon[99205]: pgmap v841: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 3.0 MiB/s wr, 395 op/s 2023-09-23T09:23:30.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:23:30 smithi082 ceph-mon[97694]: pgmap v841: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 3.0 MiB/s wr, 395 op/s 2023-09-23T09:23:30.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:23:30 smithi161 ceph-mon[99580]: pgmap v841: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 3.0 MiB/s wr, 395 op/s 2023-09-23T09:23:32.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:23:32 smithi135 ceph-mon[99205]: pgmap v842: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 2.1 MiB/s wr, 275 op/s 2023-09-23T09:23:32.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:23:32 smithi082 ceph-mon[97694]: pgmap v842: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 2.1 MiB/s wr, 275 op/s 2023-09-23T09:23:32.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:23:32 smithi161 ceph-mon[99580]: pgmap v842: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 2.1 MiB/s wr, 275 op/s 2023-09-23T09:23:34.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:23:34 smithi135 ceph-mon[99205]: pgmap v843: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 2.1 MiB/s wr, 275 op/s 2023-09-23T09:23:34.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:23:34 smithi082 ceph-mon[97694]: pgmap v843: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 2.1 MiB/s wr, 275 op/s 2023-09-23T09:23:34.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:23:34 smithi161 ceph-mon[99580]: pgmap v843: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 2.1 MiB/s wr, 275 op/s 2023-09-23T09:23:36.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:23:36 smithi135 ceph-mon[99205]: pgmap v844: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 3.2 MiB/s wr, 418 op/s 2023-09-23T09:23:36.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:23:36 smithi082 ceph-mon[97694]: pgmap v844: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 3.2 MiB/s wr, 418 op/s 2023-09-23T09:23:36.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:23:36 smithi161 ceph-mon[99580]: pgmap v844: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 3.2 MiB/s wr, 418 op/s 2023-09-23T09:23:38.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:23:37 smithi161 ceph-mon[99580]: pgmap v845: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 2.1 MiB/s wr, 272 op/s 2023-09-23T09:23:38.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:23:37 smithi135 ceph-mon[99205]: pgmap v845: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 2.1 MiB/s wr, 272 op/s 2023-09-23T09:23:38.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:23:37 smithi082 ceph-mon[97694]: pgmap v845: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 2.1 MiB/s wr, 272 op/s 2023-09-23T09:23:40.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:23:40 smithi135 ceph-mon[99205]: pgmap v846: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 3.0 MiB/s wr, 395 op/s 2023-09-23T09:23:40.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:23:40 smithi082 ceph-mon[97694]: pgmap v846: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 3.0 MiB/s wr, 395 op/s 2023-09-23T09:23:40.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:23:40 smithi161 ceph-mon[99580]: pgmap v846: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 3.0 MiB/s wr, 395 op/s 2023-09-23T09:23:42.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:23:42 smithi135 ceph-mon[99205]: pgmap v847: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 2.0 MiB/s wr, 266 op/s 2023-09-23T09:23:42.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:23:42 smithi082 ceph-mon[97694]: pgmap v847: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 2.0 MiB/s wr, 266 op/s 2023-09-23T09:23:42.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:23:42 smithi161 ceph-mon[99580]: pgmap v847: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 2.0 MiB/s wr, 266 op/s 2023-09-23T09:23:44.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:23:44 smithi135 ceph-mon[99205]: pgmap v848: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 2.0 MiB/s wr, 266 op/s 2023-09-23T09:23:44.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:23:44 smithi082 ceph-mon[97694]: pgmap v848: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 2.0 MiB/s wr, 266 op/s 2023-09-23T09:23:44.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:23:44 smithi161 ceph-mon[99580]: pgmap v848: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 2.0 MiB/s wr, 266 op/s 2023-09-23T09:23:46.100 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:23:46.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.418+0000 7f83b9bff700 1 -- 172.21.15.82:0/3464821796 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83b4101a30 msgr2=0x7f83b4101e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:23:46.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.418+0000 7f83b9bff700 1 --2- 172.21.15.82:0/3464821796 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83b4101a30 0x7f83b4101e10 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f83a4009990 tx=0x7f83a4009ca0 comp rx=0 tx=0).stop 2023-09-23T09:23:46.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.418+0000 7f83b9bff700 1 -- 172.21.15.82:0/3464821796 shutdown_connections 2023-09-23T09:23:46.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.418+0000 7f83b9bff700 1 --2- 172.21.15.82:0/3464821796 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83b410ae50 0x7f83b410d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:23:46.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.418+0000 7f83b9bff700 1 --2- 172.21.15.82:0/3464821796 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83b4101a30 0x7f83b4101e10 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:23:46.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.418+0000 7f83b9bff700 1 --2- 172.21.15.82:0/3464821796 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83b4102350 0x7f83b410a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:23:46.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.418+0000 7f83b9bff700 1 -- 172.21.15.82:0/3464821796 >> 172.21.15.82:0/3464821796 conn(0x7f83b40fb270 msgr2=0x7f83b40fd690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:23:46.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.418+0000 7f83b9bff700 1 -- 172.21.15.82:0/3464821796 shutdown_connections 2023-09-23T09:23:46.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.418+0000 7f83b9bff700 1 -- 172.21.15.82:0/3464821796 wait complete. 2023-09-23T09:23:46.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.419+0000 7f83b9bff700 1 Processor -- start 2023-09-23T09:23:46.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.419+0000 7f83b9bff700 1 -- start start 2023-09-23T09:23:46.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.420+0000 7f83b9bff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83b4101a30 0x7f83b40ff680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:23:46.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.420+0000 7f83b9bff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83b4102350 0x7f83b40ffbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:23:46.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.420+0000 7f83b9bff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83b410ae50 0x7f83b41a4a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:23:46.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.420+0000 7f83b9bff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b41003f0 con 0x7f83b4101a30 2023-09-23T09:23:46.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.420+0000 7f83b9bff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b41a4fd0 con 0x7f83b4102350 2023-09-23T09:23:46.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.420+0000 7f83b9bff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b41a5110 con 0x7f83b410ae50 2023-09-23T09:23:46.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.420+0000 7f83b2ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83b4102350 0x7f83b40ffbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:23:46.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.420+0000 7f83b37fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83b4101a30 0x7f83b40ff680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:23:46.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.420+0000 7f83b2ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83b4102350 0x7f83b40ffbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:40312/0 (socket says 172.21.15.82:40312) 2023-09-23T09:23:46.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.420+0000 7f83b2ffd700 1 -- 172.21.15.82:0/835117728 learned_addr learned my addr 172.21.15.82:0/835117728 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:23:46.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.421+0000 7f83b3fff700 1 --2- 172.21.15.82:0/835117728 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83b410ae50 0x7f83b41a4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:23:46.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.421+0000 7f83b2ffd700 1 -- 172.21.15.82:0/835117728 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83b410ae50 msgr2=0x7f83b41a4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:23:46.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.421+0000 7f83b2ffd700 1 --2- 172.21.15.82:0/835117728 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83b410ae50 0x7f83b41a4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:23:46.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.421+0000 7f83b2ffd700 1 -- 172.21.15.82:0/835117728 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83b4101a30 msgr2=0x7f83b40ff680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:23:46.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.421+0000 7f83b2ffd700 1 --2- 172.21.15.82:0/835117728 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83b4101a30 0x7f83b40ff680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:23:46.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.421+0000 7f83b2ffd700 1 -- 172.21.15.82:0/835117728 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83a40095f0 con 0x7f83b4102350 2023-09-23T09:23:46.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.421+0000 7f83b37fe700 1 --2- 172.21.15.82:0/835117728 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83b4101a30 0x7f83b40ff680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:23:46.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.421+0000 7f83b2ffd700 1 --2- 172.21.15.82:0/835117728 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83b4102350 0x7f83b40ffbc0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f83a800e9f0 tx=0x7f83a800ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:23:46.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.421+0000 7f83b0ff9700 1 -- 172.21.15.82:0/835117728 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a800c9c0 con 0x7f83b4102350 2023-09-23T09:23:46.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.422+0000 7f83b0ff9700 1 -- 172.21.15.82:0/835117728 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f83a8010430 con 0x7f83b4102350 2023-09-23T09:23:46.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.422+0000 7f83b9bff700 1 -- 172.21.15.82:0/835117728 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83b41a5370 con 0x7f83b4102350 2023-09-23T09:23:46.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.422+0000 7f83b9bff700 1 -- 172.21.15.82:0/835117728 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83b41a58a0 con 0x7f83b4102350 2023-09-23T09:23:46.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.423+0000 7f83b0ff9700 1 -- 172.21.15.82:0/835117728 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a8018680 con 0x7f83b4102350 2023-09-23T09:23:46.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.427+0000 7f83b0ff9700 1 -- 172.21.15.82:0/835117728 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f83a800cb20 con 0x7f83b4102350 2023-09-23T09:23:46.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.428+0000 7f83cd56db80 1 Processor -- start 2023-09-23T09:23:46.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.428+0000 7f83cd56db80 1 -- start start 2023-09-23T09:23:46.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.429+0000 7f83cd56db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563a66f64380 0x563a66f64760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:23:46.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.429+0000 7f83cd56db80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563a66f64ca0 0x563a66f5e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:23:46.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.429+0000 7f83cd56db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a66f5ec40 0x563a66f5f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:23:46.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.429+0000 7f83cd56db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a66ec67b0 con 0x563a66f5ec40 2023-09-23T09:23:46.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.429+0000 7f83cd56db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a66eb7780 con 0x563a66f64380 2023-09-23T09:23:46.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.429+0000 7f83cd56db80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a66eb50a0 con 0x563a66f64ca0 2023-09-23T09:23:46.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.429+0000 7f83b3fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563a66f64380 0x563a66f64760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:23:46.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.429+0000 7f83b3fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563a66f64380 0x563a66f64760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:40324/0 (socket says 172.21.15.82:40324) 2023-09-23T09:23:46.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.429+0000 7f83b37fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563a66f64ca0 0x563a66f5e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:23:46.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.429+0000 7f83b3fff700 1 -- 172.21.15.82:0/1519835683 learned_addr learned my addr 172.21.15.82:0/1519835683 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:23:46.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.429+0000 7f83b0ff9700 1 --2- 172.21.15.82:0/835117728 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f839c0a0140 0x7f839c0a2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:23:46.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.429+0000 7f83b2ffd700 1 --2- 172.21.15.82:0/1519835683 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a66f5ec40 0x563a66f5f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:23:46.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.429+0000 7f83b37fe700 1 -- 172.21.15.82:0/1519835683 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563a66f64380 msgr2=0x563a66f64760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:23:46.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.429+0000 7f83b37fe700 1 --2- 172.21.15.82:0/1519835683 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563a66f64380 0x563a66f64760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:23:46.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.429+0000 7f83b37fe700 1 -- 172.21.15.82:0/1519835683 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a66f5ec40 msgr2=0x563a66f5f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:23:46.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.429+0000 7f83b37fe700 1 --2- 172.21.15.82:0/1519835683 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a66f5ec40 0x563a66f5f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:23:46.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.429+0000 7f83b37fe700 1 -- 172.21.15.82:0/1519835683 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563a66d30630 con 0x563a66f64ca0 2023-09-23T09:23:46.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.430+0000 7f83b3fff700 1 --2- 172.21.15.82:0/835117728 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f839c0a0140 0x7f839c0a2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:23:46.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.430+0000 7f83b0ff9700 1 -- 172.21.15.82:0/835117728 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f83a8014070 con 0x7f83b4102350 2023-09-23T09:23:46.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.430+0000 7f83b37fe700 1 --2- 172.21.15.82:0/1519835683 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563a66f64ca0 0x563a66f5e700 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f83a40059d0 tx=0x7f83a4005c40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=714a61accf7d7f76 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:23:46.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.430+0000 7f83b3fff700 1 --2- 172.21.15.82:0/835117728 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f839c0a0140 0x7f839c0a2600 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f83ac009550 tx=0x7f83ac009040 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:23:46.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.430+0000 7f8399ffb700 1 -- 172.21.15.82:0/1519835683 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a401d070 con 0x563a66f64ca0 2023-09-23T09:23:46.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.431+0000 7f8399ffb700 1 -- 172.21.15.82:0/1519835683 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f83a401e040 con 0x563a66f64ca0 2023-09-23T09:23:46.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.431+0000 7f8399ffb700 1 -- 172.21.15.82:0/1519835683 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a4004cf0 con 0x563a66f64ca0 2023-09-23T09:23:46.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.431+0000 7f83cd56db80 1 -- 172.21.15.82:0/1519835683 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563a66f64ca0 msgr2=0x563a66f5e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:23:46.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.431+0000 7f83cd56db80 1 --2- 172.21.15.82:0/1519835683 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563a66f64ca0 0x563a66f5e700 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f83a40059d0 tx=0x7f83a4005c40 comp rx=0 tx=0).stop 2023-09-23T09:23:46.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.432+0000 7f83cd56db80 1 -- 172.21.15.82:0/1519835683 shutdown_connections 2023-09-23T09:23:46.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.432+0000 7f83cd56db80 1 --2- 172.21.15.82:0/1519835683 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a66f5ec40 0x563a66f5f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:23:46.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.432+0000 7f83cd56db80 1 --2- 172.21.15.82:0/1519835683 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563a66f64380 0x563a66f64760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:23:46.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.432+0000 7f83cd56db80 1 --2- 172.21.15.82:0/1519835683 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563a66f64ca0 0x563a66f5e700 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:23:46.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.432+0000 7f83cd56db80 1 -- 172.21.15.82:0/1519835683 >> 172.21.15.82:0/1519835683 conn(0x563a66ed30e0 msgr2=0x563a66f59410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:23:46.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.432+0000 7f83cd56db80 1 -- 172.21.15.82:0/1519835683 shutdown_connections 2023-09-23T09:23:46.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.432+0000 7f83cd56db80 1 -- 172.21.15.82:0/1519835683 wait complete. 2023-09-23T09:23:46.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.432+0000 7f83cd56db80 1 -- start start 2023-09-23T09:23:46.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.433+0000 7f83cd56db80 1 Processor -- start 2023-09-23T09:23:46.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.433+0000 7f83cd56db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563a66f5ec40 0x563a66f6ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:23:46.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.433+0000 7f83cd56db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a66f64380 0x563a66f67e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:23:46.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.433+0000 7f83cd56db80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563a66f64ca0 0x563a66f685c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:23:46.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.433+0000 7f83cd56db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a66eb0990 con 0x563a66f64380 2023-09-23T09:23:46.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.433+0000 7f83cd56db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a66e4ebb0 con 0x563a66f5ec40 2023-09-23T09:23:46.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.433+0000 7f83cd56db80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a66e4e8b0 con 0x563a66f64ca0 2023-09-23T09:23:46.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.433+0000 7f83cd56db80 10 client.0 _ll_register_callbacks cb 0x563a66d98a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:23:46.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.434+0000 7f83b3fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563a66f64ca0 0x563a66f685c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:23:46.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.434+0000 7f83b3fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563a66f64ca0 0x563a66f685c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:50558/0 (socket says 172.21.15.82:50558) 2023-09-23T09:23:46.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.434+0000 7f83b3fff700 1 -- 172.21.15.82:0/3441650833 learned_addr learned my addr 172.21.15.82:0/3441650833 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:23:46.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.434+0000 7f83b2ffd700 1 --2- 172.21.15.82:0/3441650833 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a66f64380 0x563a66f67e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:23:46.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.434+0000 7f83b3fff700 1 -- 172.21.15.82:0/3441650833 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563a66f5ec40 msgr2=0x563a66f6ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:23:46.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.434+0000 7f83b3fff700 1 --2- 172.21.15.82:0/3441650833 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563a66f5ec40 0x563a66f6ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:23:46.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.434+0000 7f83b3fff700 1 -- 172.21.15.82:0/3441650833 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a66f64380 msgr2=0x563a66f67e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:23:46.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.434+0000 7f83b3fff700 1 --2- 172.21.15.82:0/3441650833 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a66f64380 0x563a66f67e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:23:46.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.434+0000 7f83b3fff700 1 -- 172.21.15.82:0/3441650833 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83b410dfd0 con 0x563a66f64ca0 2023-09-23T09:23:46.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.435+0000 7f83b3fff700 1 --2- 172.21.15.82:0/3441650833 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563a66f64ca0 0x563a66f685c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f83ac017ee0 tx=0x7f83ac004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e572a0867b4af7df server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:23:46.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.435+0000 7f8392ffd700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T09:23:46.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.435+0000 7f8392ffd700 1 -- 172.21.15.82:0/3441650833 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ac00e040 con 0x563a66f64ca0 2023-09-23T09:23:46.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.435+0000 7f83cd56db80 1 -- 172.21.15.82:0/3441650833 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563a66f2e1c0 con 0x563a66f64ca0 2023-09-23T09:23:46.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.435+0000 7f8392ffd700 1 -- 172.21.15.82:0/3441650833 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(129..129 src has 1..129) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f83ac003a00 con 0x563a66f64ca0 2023-09-23T09:23:46.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.435+0000 7f8392ffd700 1 -- 172.21.15.82:0/3441650833 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=76) v2 ==== 24+0+0 (secure 0 0 0) 0x7f83ac003bc0 con 0x563a66f64ca0 2023-09-23T09:23:46.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.435+0000 7f83cd56db80 10 client.26818 fetch_fsmap learned FSMap version 76 2023-09-23T09:23:46.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.435+0000 7f83cd56db80 1 -- 172.21.15.82:0/3441650833 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=76,monmap=4+}) v3 -- 0x563a66cdcde0 con 0x563a66f64ca0 2023-09-23T09:23:46.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.436+0000 7f8392ffd700 1 -- 172.21.15.82:0/3441650833 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f83ac030020 con 0x563a66f64ca0 2023-09-23T09:23:46.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.436+0000 7f8392ffd700 1 -- 172.21.15.82:0/3441650833 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 76) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f83ac02c460 con 0x563a66f64ca0 2023-09-23T09:23:46.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.436+0000 7f83cd56db80 10 client.26818 fetch_fsmap finished waiting for FSMap version 76 2023-09-23T09:23:46.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.436+0000 7f83cd56db80 10 client.26818 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:23:46.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.436+0000 7f83cd56db80 20 client.26818 populate_metadata read hostname 'smithi082' 2023-09-23T09:23:46.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.436+0000 7f83cd56db80 1 --2- 172.21.15.82:0/3441650833 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x563a66f78710 0x563a66f7ab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:23:46.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.436+0000 7f83cd56db80 4 client.26818 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:23:46.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.436+0000 7f83cd56db80 1 -- 172.21.15.82:0/3441650833 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563a66e56ba0 con 0x563a66f78710 2023-09-23T09:23:46.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.436+0000 7f83b37fe700 1 --2- 172.21.15.82:0/3441650833 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x563a66f78710 0x563a66f7ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:23:46.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.437+0000 7f83b37fe700 1 --2- 172.21.15.82:0/3441650833 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x563a66f78710 0x563a66f7ab30 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fbbd9253c6b11ca4 server_cookie=35e90cadd6dbf24 in_seq=0 out_seq=0 2023-09-23T09:23:46.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.437+0000 7f8392ffd700 10 client.26818 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:23:46.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.437+0000 7f8392ffd700 1 -- 172.21.15.82:0/3441650833 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x563a66e56ba0 con 0x563a66f78710 2023-09-23T09:23:46.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.437+0000 7f8392ffd700 10 client.26818 handle_command_reply: tid=0 2023-09-23T09:23:46.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.438+0000 7f83cd56db80 1 client.26818 shutdown 2023-09-23T09:23:46.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.438+0000 7f83cd56db80 1 -- 172.21.15.82:0/3441650833 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563a66f64ca0 msgr2=0x563a66f685c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:23:46.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.438+0000 7f83cd56db80 1 --2- 172.21.15.82:0/3441650833 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563a66f64ca0 0x563a66f685c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f83ac017ee0 tx=0x7f83ac004ad0 comp rx=0 tx=0).stop 2023-09-23T09:23:46.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.438+0000 7f83cd56db80 1 -- 172.21.15.82:0/3441650833 shutdown_connections 2023-09-23T09:23:46.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.438+0000 7f83cd56db80 1 --2- 172.21.15.82:0/3441650833 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563a66f64ca0 0x563a66f685c0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:23:46.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.438+0000 7f83cd56db80 1 --2- 172.21.15.82:0/3441650833 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563a66f5ec40 0x563a66f6ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:23:46.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.438+0000 7f83cd56db80 1 --2- 172.21.15.82:0/3441650833 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x563a66f78710 0x563a66f7ab30 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:23:46.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.438+0000 7f83cd56db80 1 --2- 172.21.15.82:0/3441650833 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a66f64380 0x563a66f67e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:23:46.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.438+0000 7f8392ffd700 0 client.26818 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:23:46.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.438+0000 7f83cd56db80 1 -- 172.21.15.82:0/3441650833 >> 172.21.15.82:0/3441650833 conn(0x563a66ed30e0 msgr2=0x563a66f53b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:23:46.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.438+0000 7f83cd56db80 1 -- 172.21.15.82:0/3441650833 shutdown_connections 2023-09-23T09:23:46.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.438+0000 7f83cd56db80 1 -- 172.21.15.82:0/3441650833 wait complete. 2023-09-23T09:23:46.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.439+0000 7f83cd56db80 20 client.26818 trim_cache size 0 max 16384 2023-09-23T09:23:46.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.459+0000 7f83cd56db80 1 Processor -- start 2023-09-23T09:23:46.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.459+0000 7f83cd56db80 1 -- start start 2023-09-23T09:23:46.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.460+0000 7f83cd56db80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563a66f5ec40 0x563a66f7ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:23:46.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.460+0000 7f83cd56db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563a66f64380 0x563a66f591f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:23:46.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.460+0000 7f83cd56db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a66f64ca0 0x563a66f74a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:23:46.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.460+0000 7f83cd56db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a66d32920 con 0x563a66f64ca0 2023-09-23T09:23:46.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.460+0000 7f83cd56db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a66f62b10 con 0x563a66f64380 2023-09-23T09:23:46.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.460+0000 7f83cd56db80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a66f628a0 con 0x563a66f5ec40 2023-09-23T09:23:46.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.460+0000 7f83b37fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563a66f5ec40 0x563a66f7ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:23:46.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.460+0000 7f83b3fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a66f64ca0 0x563a66f74a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:23:46.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.460+0000 7f83b2ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563a66f64380 0x563a66f591f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:23:46.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.460+0000 7f83b37fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563a66f5ec40 0x563a66f7ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:50562/0 (socket says 172.21.15.82:50562) 2023-09-23T09:23:46.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.460+0000 7f83b37fe700 1 -- 172.21.15.82:0/467484995 learned_addr learned my addr 172.21.15.82:0/467484995 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:23:46.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.460+0000 7f83b37fe700 1 -- 172.21.15.82:0/467484995 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563a66f64380 msgr2=0x563a66f591f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:23:46.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.460+0000 7f83b37fe700 1 --2- 172.21.15.82:0/467484995 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563a66f64380 0x563a66f591f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:23:46.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.460+0000 7f83b37fe700 1 -- 172.21.15.82:0/467484995 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a66f64ca0 msgr2=0x563a66f74a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:23:46.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.460+0000 7f83b37fe700 1 --2- 172.21.15.82:0/467484995 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a66f64ca0 0x563a66f74a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:23:46.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.460+0000 7f83b37fe700 1 -- 172.21.15.82:0/467484995 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563a66cc5c60 con 0x563a66f5ec40 2023-09-23T09:23:46.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.461+0000 7f83b37fe700 1 --2- 172.21.15.82:0/467484995 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563a66f5ec40 0x563a66f7ab00 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f83a40098e0 tx=0x7f83a4009ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9f2801477a6e310 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:23:46.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.461+0000 7f839a7fc700 1 -- 172.21.15.82:0/467484995 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a401d040 con 0x563a66f5ec40 2023-09-23T09:23:46.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.461+0000 7f839a7fc700 1 -- 172.21.15.82:0/467484995 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f83a40056c0 con 0x563a66f5ec40 2023-09-23T09:23:46.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.461+0000 7f839a7fc700 1 -- 172.21.15.82:0/467484995 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a4034470 con 0x563a66f5ec40 2023-09-23T09:23:46.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.462+0000 7f83cd56db80 1 -- 172.21.15.82:0/467484995 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563a66f5ec40 msgr2=0x563a66f7ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:23:46.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.462+0000 7f83cd56db80 1 --2- 172.21.15.82:0/467484995 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563a66f5ec40 0x563a66f7ab00 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f83a40098e0 tx=0x7f83a4009ca0 comp rx=0 tx=0).stop 2023-09-23T09:23:46.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.462+0000 7f83cd56db80 1 -- 172.21.15.82:0/467484995 shutdown_connections 2023-09-23T09:23:46.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.462+0000 7f83cd56db80 1 --2- 172.21.15.82:0/467484995 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a66f64ca0 0x563a66f74a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:23:46.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.462+0000 7f83cd56db80 1 --2- 172.21.15.82:0/467484995 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563a66f5ec40 0x563a66f7ab00 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:23:46.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.462+0000 7f83cd56db80 1 --2- 172.21.15.82:0/467484995 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563a66f64380 0x563a66f591f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:23:46.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.462+0000 7f83cd56db80 1 -- 172.21.15.82:0/467484995 >> 172.21.15.82:0/467484995 conn(0x563a66ed30e0 msgr2=0x563a66f52b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:23:46.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.462+0000 7f83cd56db80 1 -- 172.21.15.82:0/467484995 shutdown_connections 2023-09-23T09:23:46.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.462+0000 7f83cd56db80 1 -- 172.21.15.82:0/467484995 wait complete. 2023-09-23T09:23:46.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.462+0000 7f83cd56db80 1 -- start start 2023-09-23T09:23:46.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.463+0000 7f83cd56db80 1 Processor -- start 2023-09-23T09:23:46.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.463+0000 7f83cd56db80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563a66f5ec40 0x563a66f61040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:23:46.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.463+0000 7f83cd56db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563a66f64380 0x563a66f61580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:23:46.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.463+0000 7f83cd56db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a66f64ca0 0x563a66f5fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:23:46.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.463+0000 7f83cd56db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a66f60340 con 0x563a66f64ca0 2023-09-23T09:23:46.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.463+0000 7f83cd56db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a66f604b0 con 0x563a66f64380 2023-09-23T09:23:46.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.463+0000 7f83cd56db80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a66f60670 con 0x563a66f5ec40 2023-09-23T09:23:46.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.463+0000 7f83cd56db80 10 client.0 _ll_register_callbacks cb 0x7f83ac017880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:23:46.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.463+0000 7f83b2ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563a66f64380 0x563a66f61580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:23:46.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.464+0000 7f83b2ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563a66f64380 0x563a66f61580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:40356/0 (socket says 172.21.15.82:40356) 2023-09-23T09:23:46.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.464+0000 7f83b2ffd700 1 -- 172.21.15.82:0/3725211036 learned_addr learned my addr 172.21.15.82:0/3725211036 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:23:46.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.464+0000 7f83b3fff700 1 --2- 172.21.15.82:0/3725211036 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a66f64ca0 0x563a66f5fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:23:46.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.464+0000 7f83b37fe700 1 --2- 172.21.15.82:0/3725211036 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563a66f5ec40 0x563a66f61040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:23:46.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.464+0000 7f83b2ffd700 1 -- 172.21.15.82:0/3725211036 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563a66f5ec40 msgr2=0x563a66f61040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:23:46.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.464+0000 7f83b2ffd700 1 --2- 172.21.15.82:0/3725211036 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563a66f5ec40 0x563a66f61040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:23:46.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.464+0000 7f83b2ffd700 1 -- 172.21.15.82:0/3725211036 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a66f64ca0 msgr2=0x563a66f5fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:23:46.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.464+0000 7f83b2ffd700 1 --2- 172.21.15.82:0/3725211036 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a66f64ca0 0x563a66f5fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:23:46.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.464+0000 7f83b2ffd700 1 -- 172.21.15.82:0/3725211036 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563a66d30630 con 0x563a66f64380 2023-09-23T09:23:46.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.464+0000 7f83b37fe700 1 --2- 172.21.15.82:0/3725211036 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563a66f5ec40 0x563a66f61040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:23:46.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.464+0000 7f83b2ffd700 1 --2- 172.21.15.82:0/3725211036 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563a66f64380 0x563a66f61580 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f83a80989e0 tx=0x7f83a80986c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9bcca0ff3f8bb3b6 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:23:46.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.464+0000 7f8392ffd700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-09-23T09:23:46.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.464+0000 7f8392ffd700 1 -- 172.21.15.82:0/3725211036 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a8099140 con 0x563a66f64380 2023-09-23T09:23:46.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.465+0000 7f8392ffd700 1 -- 172.21.15.82:0/3725211036 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(129..129 src has 1..129) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f83a8098ce0 con 0x563a66f64380 2023-09-23T09:23:46.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.465+0000 7f83cd56db80 1 -- 172.21.15.82:0/3725211036 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563a66f518b0 con 0x563a66f64380 2023-09-23T09:23:46.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.465+0000 7f8392ffd700 1 -- 172.21.15.82:0/3725211036 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=76) v2 ==== 24+0+0 (secure 0 0 0) 0x7f83a809cb10 con 0x563a66f64380 2023-09-23T09:23:46.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.465+0000 7f83cd56db80 10 client.26765 fetch_fsmap learned FSMap version 76 2023-09-23T09:23:46.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.465+0000 7f83cd56db80 1 -- 172.21.15.82:0/3725211036 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=76,monmap=4+}) v3 -- 0x563a66d03250 con 0x563a66f64380 2023-09-23T09:23:46.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.465+0000 7f8392ffd700 1 -- 172.21.15.82:0/3725211036 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x563a66f518b0 con 0x563a66f64380 2023-09-23T09:23:46.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.465+0000 7f8392ffd700 1 -- 172.21.15.82:0/3725211036 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 76) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f83a80a0770 con 0x563a66f64380 2023-09-23T09:23:46.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.465+0000 7f83cd56db80 10 client.26765 fetch_fsmap finished waiting for FSMap version 76 2023-09-23T09:23:46.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.465+0000 7f83cd56db80 10 client.26765 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:23:46.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.465+0000 7f83cd56db80 20 client.26765 populate_metadata read hostname 'smithi082' 2023-09-23T09:23:46.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.465+0000 7f83cd56db80 1 --2- 172.21.15.82:0/3725211036 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x563a66fcd3f0 0x563a66fcf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:23:46.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.465+0000 7f83cd56db80 4 client.26765 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:23:46.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.465+0000 7f83cd56db80 1 -- 172.21.15.82:0/3725211036 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x563a66ea9970 con 0x563a66fcd3f0 2023-09-23T09:23:46.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.466+0000 7f83b37fe700 1 --2- 172.21.15.82:0/3725211036 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x563a66fcd3f0 0x563a66fcf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:23:46.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.466+0000 7f8392ffd700 10 client.26765 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:23:46.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.466+0000 7f83b37fe700 1 --2- 172.21.15.82:0/3725211036 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x563a66fcd3f0 0x563a66fcf810 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5771e1168d1af44c server_cookie=4819e26896583c43 in_seq=0 out_seq=0 2023-09-23T09:23:46.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.466+0000 7f8392ffd700 1 -- 172.21.15.82:0/3725211036 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x563a66ea9970 con 0x563a66fcd3f0 2023-09-23T09:23:46.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.466+0000 7f8392ffd700 10 client.26765 handle_command_reply: tid=0 2023-09-23T09:23:46.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.466+0000 7f83cd56db80 1 client.26765 shutdown 2023-09-23T09:23:46.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.467+0000 7f83cd56db80 1 -- 172.21.15.82:0/3725211036 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563a66f64380 msgr2=0x563a66f61580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:23:46.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.467+0000 7f83cd56db80 1 --2- 172.21.15.82:0/3725211036 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563a66f64380 0x563a66f61580 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f83a80989e0 tx=0x7f83a80986c0 comp rx=0 tx=0).stop 2023-09-23T09:23:46.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.467+0000 7f83cd56db80 1 -- 172.21.15.82:0/3725211036 shutdown_connections 2023-09-23T09:23:46.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.467+0000 7f83cd56db80 1 --2- 172.21.15.82:0/3725211036 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x563a66fcd3f0 0x563a66fcf810 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:23:46.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.467+0000 7f83cd56db80 1 --2- 172.21.15.82:0/3725211036 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a66f64ca0 0x563a66f5fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:23:46.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.467+0000 7f83cd56db80 1 --2- 172.21.15.82:0/3725211036 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563a66f5ec40 0x563a66f61040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:23:46.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.467+0000 7f83cd56db80 1 --2- 172.21.15.82:0/3725211036 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563a66f64380 0x563a66f61580 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:23:46.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.467+0000 7f83cd56db80 1 -- 172.21.15.82:0/3725211036 >> 172.21.15.82:0/3725211036 conn(0x563a66ed30e0 msgr2=0x563a66f74a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:23:46.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.467+0000 7f8392ffd700 0 client.26765 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:23:46.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.467+0000 7f83cd56db80 1 -- 172.21.15.82:0/3725211036 shutdown_connections 2023-09-23T09:23:46.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.467+0000 7f83cd56db80 1 -- 172.21.15.82:0/3725211036 wait complete. 2023-09-23T09:23:46.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.467+0000 7f83cd56db80 20 client.26765 trim_cache size 0 max 16384 2023-09-23T09:23:46.474 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:23:46.475 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-23T09:23:46.475 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:23:46.475 INFO:teuthology.orchestra.run.smithi082.stdout: "047cbc72-e254-4787-b038-382de9c1a9a4": { 2023-09-23T09:23:46.475 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:23:46.475 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "047cbc72-e254-4787-b038-382de9c1a9a4", 2023-09-23T09:23:46.475 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:23:46.475 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:23:46.475 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:23:46.475 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:23:46.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.468+0000 7f83b9bff700 1 -- 172.21.15.82:0/835117728 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f839c0a0140 msgr2=0x7f839c0a2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:23:46.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.468+0000 7f83b9bff700 1 --2- 172.21.15.82:0/835117728 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f839c0a0140 0x7f839c0a2600 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f83ac009550 tx=0x7f83ac009040 comp rx=0 tx=0).stop 2023-09-23T09:23:46.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.468+0000 7f83b9bff700 1 -- 172.21.15.82:0/835117728 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83b4102350 msgr2=0x7f83b40ffbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:23:46.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.468+0000 7f83b9bff700 1 --2- 172.21.15.82:0/835117728 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83b4102350 0x7f83b40ffbc0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f83a800e9f0 tx=0x7f83a800ed00 comp rx=0 tx=0).stop 2023-09-23T09:23:46.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.468+0000 7f83b9bff700 1 -- 172.21.15.82:0/835117728 shutdown_connections 2023-09-23T09:23:46.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.468+0000 7f83b9bff700 1 --2- 172.21.15.82:0/835117728 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f839c0a0140 0x7f839c0a2600 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:23:46.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.468+0000 7f83b9bff700 1 --2- 172.21.15.82:0/835117728 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83b410ae50 0x7f83b41a4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:23:46.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.468+0000 7f83b9bff700 1 --2- 172.21.15.82:0/835117728 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83b4101a30 0x7f83b40ff680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:23:46.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.468+0000 7f83b9bff700 1 --2- 172.21.15.82:0/835117728 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83b4102350 0x7f83b40ffbc0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:23:46.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.468+0000 7f83b9bff700 1 -- 172.21.15.82:0/835117728 >> 172.21.15.82:0/835117728 conn(0x7f83b40fb270 msgr2=0x7f83b40fbee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:23:46.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.468+0000 7f83b9bff700 1 -- 172.21.15.82:0/835117728 shutdown_connections 2023-09-23T09:23:46.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:23:46.468+0000 7f83b9bff700 1 -- 172.21.15.82:0/835117728 wait complete. 2023-09-23T09:23:46.490 INFO:tasks.cephfs.filesystem:scrub status for tag:047cbc72-e254-4787-b038-382de9c1a9a4 - {'path': '/', 'tag': '047cbc72-e254-4787-b038-382de9c1a9a4', 'options': 'recursive,force'} 2023-09-23T09:23:46.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:23:46 smithi135 ceph-mon[99205]: pgmap v849: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 3.0 MiB/s wr, 399 op/s 2023-09-23T09:23:46.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:23:46 smithi082 ceph-mon[97694]: pgmap v849: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 3.0 MiB/s wr, 399 op/s 2023-09-23T09:23:46.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:23:46 smithi161 ceph-mon[99580]: pgmap v849: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 3.0 MiB/s wr, 399 op/s 2023-09-23T09:23:48.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:23:47 smithi161 ceph-mon[99580]: pgmap v850: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 1.9 MiB/s wr, 256 op/s 2023-09-23T09:23:48.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:23:47 smithi135 ceph-mon[99205]: pgmap v850: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 1.9 MiB/s wr, 256 op/s 2023-09-23T09:23:48.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:23:47 smithi082 ceph-mon[97694]: pgmap v850: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 1.9 MiB/s wr, 256 op/s 2023-09-23T09:23:49.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:23:48 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:23:49.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:23:48 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:23:49.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:23:48 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:23:50.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:23:49 smithi161 ceph-mon[99580]: pgmap v851: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 3.0 MiB/s wr, 389 op/s 2023-09-23T09:23:50.167 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:23:49 smithi082 ceph-mon[97694]: pgmap v851: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 3.0 MiB/s wr, 389 op/s 2023-09-23T09:23:50.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:23:49 smithi135 ceph-mon[99205]: pgmap v851: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 3.0 MiB/s wr, 389 op/s 2023-09-23T09:23:52.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:23:52 smithi135 ceph-mon[99205]: pgmap v852: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 2.0 MiB/s wr, 266 op/s 2023-09-23T09:23:52.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:23:52 smithi082 ceph-mon[97694]: pgmap v852: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 2.0 MiB/s wr, 266 op/s 2023-09-23T09:23:52.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:23:52 smithi161 ceph-mon[99580]: pgmap v852: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 2.0 MiB/s wr, 266 op/s 2023-09-23T09:23:54.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:23:54 smithi161 ceph-mon[99580]: pgmap v853: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 2.0 MiB/s wr, 266 op/s 2023-09-23T09:23:54.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:23:54 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:23:54.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:23:54 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:23:55.009 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:23:54 smithi135 ceph-mon[99205]: pgmap v853: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 2.0 MiB/s wr, 266 op/s 2023-09-23T09:23:55.009 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:23:54 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:23:55.009 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:23:54 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:23:55.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:23:54 smithi082 ceph-mon[97694]: pgmap v853: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 2.0 MiB/s wr, 266 op/s 2023-09-23T09:23:55.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:23:54 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:23:55.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:23:54 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:23:56.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:23:56 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:23:56.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:23:56 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:23:56.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:23:56 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:23:56.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:23:56 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:23:56.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:23:56 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:23:56.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:23:56 smithi135 ceph-mon[99205]: pgmap v854: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 3.2 MiB/s wr, 417 op/s 2023-09-23T09:23:56.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:23:56 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:23:56.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:23:56 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:23:56.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:23:56 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:23:56.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:23:56 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:23:56.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:23:56 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:23:56.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:23:56 smithi082 ceph-mon[97694]: pgmap v854: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 3.2 MiB/s wr, 417 op/s 2023-09-23T09:23:56.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:23:56 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:23:56.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:23:56 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:23:56.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:23:56 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:23:56.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:23:56 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:23:56.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:23:56 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:23:56.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:23:56 smithi161 ceph-mon[99580]: pgmap v854: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 3.2 MiB/s wr, 417 op/s 2023-09-23T09:23:58.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:23:57 smithi135 ceph-mon[99205]: pgmap v855: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 2.2 MiB/s wr, 284 op/s 2023-09-23T09:23:58.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:23:57 smithi161 ceph-mon[99580]: pgmap v855: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 2.2 MiB/s wr, 284 op/s 2023-09-23T09:23:58.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:23:57 smithi082 ceph-mon[97694]: pgmap v855: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 2.2 MiB/s wr, 284 op/s 2023-09-23T09:24:00.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:24:00 smithi135 ceph-mon[99205]: pgmap v856: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 9.9 MiB/s wr, 341 op/s 2023-09-23T09:24:00.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:24:00 smithi082 ceph-mon[97694]: pgmap v856: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 9.9 MiB/s wr, 341 op/s 2023-09-23T09:24:00.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:24:00 smithi161 ceph-mon[99580]: pgmap v856: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 9.9 MiB/s wr, 341 op/s 2023-09-23T09:24:02.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:24:02 smithi135 ceph-mon[99205]: pgmap v857: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.9 MiB/s wr, 208 op/s 2023-09-23T09:24:02.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:24:02 smithi082 ceph-mon[97694]: pgmap v857: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.9 MiB/s wr, 208 op/s 2023-09-23T09:24:02.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:24:02 smithi161 ceph-mon[99580]: pgmap v857: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.9 MiB/s wr, 208 op/s 2023-09-23T09:24:04.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:24:04 smithi135 ceph-mon[99205]: pgmap v858: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.9 MiB/s wr, 208 op/s 2023-09-23T09:24:04.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:24:04 smithi082 ceph-mon[97694]: pgmap v858: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.9 MiB/s wr, 208 op/s 2023-09-23T09:24:04.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:24:04 smithi161 ceph-mon[99580]: pgmap v858: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.9 MiB/s wr, 208 op/s 2023-09-23T09:24:06.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:24:06 smithi135 ceph-mon[99205]: pgmap v859: 97 pgs: 97 active+clean; 11 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 22 MiB/s wr, 233 op/s 2023-09-23T09:24:06.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:24:06 smithi082 ceph-mon[97694]: pgmap v859: 97 pgs: 97 active+clean; 11 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 22 MiB/s wr, 233 op/s 2023-09-23T09:24:06.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:24:06 smithi161 ceph-mon[99580]: pgmap v859: 97 pgs: 97 active+clean; 11 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 22 MiB/s wr, 233 op/s 2023-09-23T09:24:07.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:24:07 smithi135 ceph-mon[99205]: osdmap e130: 12 total, 12 up, 12 in 2023-09-23T09:24:07.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:24:07 smithi082 ceph-mon[97694]: osdmap e130: 12 total, 12 up, 12 in 2023-09-23T09:24:07.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:24:07 smithi161 ceph-mon[99580]: osdmap e130: 12 total, 12 up, 12 in 2023-09-23T09:24:08.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:24:08 smithi135 ceph-mon[99205]: pgmap v861: 97 pgs: 97 active+clean; 11 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 25 MiB/s wr, 98 op/s 2023-09-23T09:24:08.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:24:08 smithi082 ceph-mon[97694]: pgmap v861: 97 pgs: 97 active+clean; 11 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 25 MiB/s wr, 98 op/s 2023-09-23T09:24:08.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:24:08 smithi161 ceph-mon[99580]: pgmap v861: 97 pgs: 97 active+clean; 11 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 25 MiB/s wr, 98 op/s 2023-09-23T09:24:10.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:24:10 smithi082 ceph-mon[97694]: pgmap v862: 97 pgs: 97 active+clean; 11 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 32 MiB/s wr, 44 op/s 2023-09-23T09:24:10.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:24:10 smithi161 ceph-mon[99580]: pgmap v862: 97 pgs: 97 active+clean; 11 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 32 MiB/s wr, 44 op/s 2023-09-23T09:24:11.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:24:10 smithi135 ceph-mon[99205]: pgmap v862: 97 pgs: 97 active+clean; 11 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 32 MiB/s wr, 44 op/s 2023-09-23T09:24:12.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:24:12 smithi082 ceph-mon[97694]: pgmap v863: 97 pgs: 97 active+clean; 11 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 32 MiB/s wr, 44 op/s 2023-09-23T09:24:12.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:24:12 smithi082 ceph-mon[97694]: osdmap e131: 12 total, 12 up, 12 in 2023-09-23T09:24:12.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:24:12 smithi161 ceph-mon[99580]: pgmap v863: 97 pgs: 97 active+clean; 11 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 32 MiB/s wr, 44 op/s 2023-09-23T09:24:12.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:24:12 smithi161 ceph-mon[99580]: osdmap e131: 12 total, 12 up, 12 in 2023-09-23T09:24:13.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:24:12 smithi135 ceph-mon[99205]: pgmap v863: 97 pgs: 97 active+clean; 11 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 32 MiB/s wr, 44 op/s 2023-09-23T09:24:13.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:24:12 smithi135 ceph-mon[99205]: osdmap e131: 12 total, 12 up, 12 in 2023-09-23T09:24:14.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:24:14 smithi082 ceph-mon[97694]: pgmap v865: 97 pgs: 97 active+clean; 11 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 20 MiB/s wr, 17 op/s 2023-09-23T09:24:14.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:24:14 smithi161 ceph-mon[99580]: pgmap v865: 97 pgs: 97 active+clean; 11 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 20 MiB/s wr, 17 op/s 2023-09-23T09:24:15.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:24:14 smithi135 ceph-mon[99205]: pgmap v865: 97 pgs: 97 active+clean; 11 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 20 MiB/s wr, 17 op/s 2023-09-23T09:24:16.492 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:24:16.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.744+0000 7fb8f27ff700 1 -- 172.21.15.82:0/3120305356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8ec101a30 msgr2=0x7fb8ec101e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:24:16.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.744+0000 7fb8f27ff700 1 --2- 172.21.15.82:0/3120305356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8ec101a30 0x7fb8ec101e10 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fb8dc009990 tx=0x7fb8dc009ca0 comp rx=0 tx=0).stop 2023-09-23T09:24:16.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.744+0000 7fb8f27ff700 1 -- 172.21.15.82:0/3120305356 shutdown_connections 2023-09-23T09:24:16.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.744+0000 7fb8f27ff700 1 --2- 172.21.15.82:0/3120305356 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8ec10ae50 0x7fb8ec10d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:24:16.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.744+0000 7fb8f27ff700 1 --2- 172.21.15.82:0/3120305356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8ec101a30 0x7fb8ec101e10 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:24:16.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.744+0000 7fb8f27ff700 1 --2- 172.21.15.82:0/3120305356 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8ec102350 0x7fb8ec10a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:24:16.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.744+0000 7fb8f27ff700 1 -- 172.21.15.82:0/3120305356 >> 172.21.15.82:0/3120305356 conn(0x7fb8ec0fb270 msgr2=0x7fb8ec0fd690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:24:16.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.744+0000 7fb8f27ff700 1 -- 172.21.15.82:0/3120305356 shutdown_connections 2023-09-23T09:24:16.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.744+0000 7fb8f27ff700 1 -- 172.21.15.82:0/3120305356 wait complete. 2023-09-23T09:24:16.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.745+0000 7fb8f27ff700 1 Processor -- start 2023-09-23T09:24:16.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.745+0000 7fb8f27ff700 1 -- start start 2023-09-23T09:24:16.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.746+0000 7fb8f27ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8ec101a30 0x7fb8ec19e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:24:16.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.746+0000 7fb8f27ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8ec102350 0x7fb8ec19eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:24:16.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.746+0000 7fb8f27ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8ec10ae50 0x7fb8ec198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:24:16.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.746+0000 7fb8f27ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ec199080 con 0x7fb8ec10ae50 2023-09-23T09:24:16.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.746+0000 7fb8f27ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ec1991f0 con 0x7fb8ec102350 2023-09-23T09:24:16.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.746+0000 7fb8f27ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ec1993b0 con 0x7fb8ec101a30 2023-09-23T09:24:16.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.746+0000 7fb8ebfff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8ec101a30 0x7fb8ec19e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:24:16.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.746+0000 7fb8ebfff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8ec101a30 0x7fb8ec19e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:41964/0 (socket says 172.21.15.82:41964) 2023-09-23T09:24:16.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.746+0000 7fb8eb7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8ec102350 0x7fb8ec19eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:24:16.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.746+0000 7fb8ebfff700 1 -- 172.21.15.82:0/2767662635 learned_addr learned my addr 172.21.15.82:0/2767662635 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:24:16.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.746+0000 7fb8f0d9c700 1 --2- 172.21.15.82:0/2767662635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8ec10ae50 0x7fb8ec198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:24:16.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.747+0000 7fb8ebfff700 1 -- 172.21.15.82:0/2767662635 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8ec102350 msgr2=0x7fb8ec19eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:24:16.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.747+0000 7fb8ebfff700 1 --2- 172.21.15.82:0/2767662635 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8ec102350 0x7fb8ec19eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:24:16.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.747+0000 7fb8ebfff700 1 -- 172.21.15.82:0/2767662635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8ec10ae50 msgr2=0x7fb8ec198a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:24:16.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.747+0000 7fb8ebfff700 1 --2- 172.21.15.82:0/2767662635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8ec10ae50 0x7fb8ec198a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:24:16.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.747+0000 7fb8ebfff700 1 -- 172.21.15.82:0/2767662635 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8dc0095f0 con 0x7fb8ec101a30 2023-09-23T09:24:16.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.747+0000 7fb8eb7fe700 1 --2- 172.21.15.82:0/2767662635 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8ec102350 0x7fb8ec19eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:24:16.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.747+0000 7fb8f0d9c700 1 --2- 172.21.15.82:0/2767662635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8ec10ae50 0x7fb8ec198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:24:16.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.747+0000 7fb8ebfff700 1 --2- 172.21.15.82:0/2767662635 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8ec101a30 0x7fb8ec19e9a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb8dc000c00 tx=0x7fb8dc004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:24:16.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.747+0000 7fb8e97fa700 1 -- 172.21.15.82:0/2767662635 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8dc01d070 con 0x7fb8ec101a30 2023-09-23T09:24:16.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.747+0000 7fb8f27ff700 1 -- 172.21.15.82:0/2767662635 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8ec199630 con 0x7fb8ec101a30 2023-09-23T09:24:16.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.747+0000 7fb8e97fa700 1 -- 172.21.15.82:0/2767662635 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb8dc022470 con 0x7fb8ec101a30 2023-09-23T09:24:16.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.747+0000 7fb8e97fa700 1 -- 172.21.15.82:0/2767662635 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8dc017650 con 0x7fb8ec101a30 2023-09-23T09:24:16.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.748+0000 7fb8f27ff700 1 -- 172.21.15.82:0/2767662635 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8ec1a5990 con 0x7fb8ec101a30 2023-09-23T09:24:16.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.752+0000 7fb8e97fa700 1 -- 172.21.15.82:0/2767662635 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7fb8dc0225e0 con 0x7fb8ec101a30 2023-09-23T09:24:16.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.753+0000 7fb9061f0b80 1 Processor -- start 2023-09-23T09:24:16.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.753+0000 7fb9061f0b80 1 -- start start 2023-09-23T09:24:16.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.753+0000 7fb9061f0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5630da732380 0x5630da732760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:24:16.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.754+0000 7fb9061f0b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5630da732ca0 0x5630da72c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:24:16.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.754+0000 7fb9061f0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5630da72cc40 0x5630da72d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:24:16.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.754+0000 7fb9061f0b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630da6947b0 con 0x5630da72cc40 2023-09-23T09:24:16.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.754+0000 7fb9061f0b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630da685780 con 0x5630da732380 2023-09-23T09:24:16.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.754+0000 7fb9061f0b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630da6830a0 con 0x5630da732ca0 2023-09-23T09:24:16.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.754+0000 7fb8ebfff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5630da732ca0 0x5630da72c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:24:16.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.754+0000 7fb8f0d9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5630da732380 0x5630da732760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:24:16.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.754+0000 7fb8f0d9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5630da732380 0x5630da732760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:49514/0 (socket says 172.21.15.82:49514) 2023-09-23T09:24:16.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.754+0000 7fb8f0d9c700 1 -- 172.21.15.82:0/3224859394 learned_addr learned my addr 172.21.15.82:0/3224859394 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:24:16.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.754+0000 7fb8e97fa700 1 --2- 172.21.15.82:0/2767662635 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fb8d40a00c0 0x7fb8d40a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:24:16.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.754+0000 7fb8eb7fe700 1 --2- 172.21.15.82:0/3224859394 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5630da72cc40 0x5630da72d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:24:16.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.754+0000 7fb8f0d9c700 1 --2- 172.21.15.82:0/2767662635 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fb8d40a00c0 0x7fb8d40a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:24:16.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.754+0000 7fb8e97fa700 1 -- 172.21.15.82:0/2767662635 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fb8dc0cc9d0 con 0x7fb8ec101a30 2023-09-23T09:24:16.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.754+0000 7fb8ebfff700 1 -- 172.21.15.82:0/3224859394 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5630da732380 msgr2=0x5630da732760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:24:16.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.754+0000 7fb8ebfff700 1 --2- 172.21.15.82:0/3224859394 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5630da732380 0x5630da732760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:24:16.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.754+0000 7fb8ebfff700 1 -- 172.21.15.82:0/3224859394 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5630da72cc40 msgr2=0x5630da72d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:24:16.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.754+0000 7fb8ebfff700 1 --2- 172.21.15.82:0/3224859394 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5630da72cc40 0x5630da72d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:24:16.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.754+0000 7fb8ebfff700 1 -- 172.21.15.82:0/3224859394 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5630da4fe630 con 0x5630da732ca0 2023-09-23T09:24:16.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.755+0000 7fb8ebfff700 1 --2- 172.21.15.82:0/3224859394 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5630da732ca0 0x5630da72c700 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb8dc0ca120 tx=0x7fb8dc009ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b14ef180a66953b5 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:24:16.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.755+0000 7fb8f0d9c700 1 --2- 172.21.15.82:0/2767662635 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fb8d40a00c0 0x7fb8d40a2580 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb8e4009ec0 tx=0x7fb8e4004b40 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:24:16.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.755+0000 7fb8d27fc700 1 -- 172.21.15.82:0/3224859394 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8dc099dd0 con 0x5630da732ca0 2023-09-23T09:24:16.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.755+0000 7fb8d27fc700 1 -- 172.21.15.82:0/3224859394 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb8dc099bf0 con 0x5630da732ca0 2023-09-23T09:24:16.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.755+0000 7fb8d27fc700 1 -- 172.21.15.82:0/3224859394 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8dc09a320 con 0x5630da732ca0 2023-09-23T09:24:16.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.756+0000 7fb9061f0b80 1 -- 172.21.15.82:0/3224859394 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5630da732ca0 msgr2=0x5630da72c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:24:16.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.756+0000 7fb9061f0b80 1 --2- 172.21.15.82:0/3224859394 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5630da732ca0 0x5630da72c700 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb8dc0ca120 tx=0x7fb8dc009ca0 comp rx=0 tx=0).stop 2023-09-23T09:24:16.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.756+0000 7fb9061f0b80 1 -- 172.21.15.82:0/3224859394 shutdown_connections 2023-09-23T09:24:16.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.756+0000 7fb9061f0b80 1 --2- 172.21.15.82:0/3224859394 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5630da72cc40 0x5630da72d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:24:16.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.756+0000 7fb9061f0b80 1 --2- 172.21.15.82:0/3224859394 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5630da732380 0x5630da732760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:24:16.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.756+0000 7fb9061f0b80 1 --2- 172.21.15.82:0/3224859394 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5630da732ca0 0x5630da72c700 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:24:16.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.756+0000 7fb9061f0b80 1 -- 172.21.15.82:0/3224859394 >> 172.21.15.82:0/3224859394 conn(0x5630da6a10e0 msgr2=0x5630da727410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:24:16.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.756+0000 7fb9061f0b80 1 -- 172.21.15.82:0/3224859394 shutdown_connections 2023-09-23T09:24:16.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.756+0000 7fb9061f0b80 1 -- 172.21.15.82:0/3224859394 wait complete. 2023-09-23T09:24:16.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.757+0000 7fb9061f0b80 1 -- start start 2023-09-23T09:24:16.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.757+0000 7fb9061f0b80 1 Processor -- start 2023-09-23T09:24:16.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.758+0000 7fb9061f0b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5630da72cc40 0x5630da738ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:24:16.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.758+0000 7fb9061f0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5630da732380 0x5630da735e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:24:16.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.758+0000 7fb9061f0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5630da732ca0 0x5630da736430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:24:16.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.758+0000 7fb9061f0b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630da67e990 con 0x5630da732380 2023-09-23T09:24:16.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.758+0000 7fb9061f0b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630da61cbb0 con 0x5630da732ca0 2023-09-23T09:24:16.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.758+0000 7fb9061f0b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630da61c8b0 con 0x5630da72cc40 2023-09-23T09:24:16.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.758+0000 7fb9061f0b80 10 client.0 _ll_register_callbacks cb 0x5630da566a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:24:16.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.758+0000 7fb8ebfff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5630da72cc40 0x5630da738ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:24:16.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.758+0000 7fb8ebfff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5630da72cc40 0x5630da738ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:41986/0 (socket says 172.21.15.82:41986) 2023-09-23T09:24:16.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.758+0000 7fb8ebfff700 1 -- 172.21.15.82:0/2464908252 learned_addr learned my addr 172.21.15.82:0/2464908252 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:24:16.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.758+0000 7fb8f0d9c700 1 --2- 172.21.15.82:0/2464908252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5630da732ca0 0x5630da736430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:24:16.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.758+0000 7fb8eb7fe700 1 --2- 172.21.15.82:0/2464908252 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5630da732380 0x5630da735e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:24:16.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.758+0000 7fb8ebfff700 1 -- 172.21.15.82:0/2464908252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5630da732ca0 msgr2=0x5630da736430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:24:16.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.758+0000 7fb8ebfff700 1 --2- 172.21.15.82:0/2464908252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5630da732ca0 0x5630da736430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:24:16.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.758+0000 7fb8ebfff700 1 -- 172.21.15.82:0/2464908252 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5630da732380 msgr2=0x5630da735e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:24:16.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.758+0000 7fb8ebfff700 1 --2- 172.21.15.82:0/2464908252 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5630da732380 0x5630da735e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:24:16.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.758+0000 7fb8ebfff700 1 -- 172.21.15.82:0/2464908252 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8ec1a5990 con 0x5630da72cc40 2023-09-23T09:24:16.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.759+0000 7fb8ebfff700 1 --2- 172.21.15.82:0/2464908252 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5630da72cc40 0x5630da738ba0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb8dc09a220 tx=0x7fb8dc099c70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d45481bc9ed39b6 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:24:16.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.759+0000 7fb8cb7fe700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T09:24:16.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.759+0000 7fb8cb7fe700 1 -- 172.21.15.82:0/2464908252 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8dc0228c0 con 0x5630da72cc40 2023-09-23T09:24:16.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.759+0000 7fb9061f0b80 1 -- 172.21.15.82:0/2464908252 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5630da6fc1c0 con 0x5630da72cc40 2023-09-23T09:24:16.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.759+0000 7fb8cb7fe700 1 -- 172.21.15.82:0/2464908252 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(131..131 src has 1..131) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fb8dc0cce40 con 0x5630da72cc40 2023-09-23T09:24:16.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.759+0000 7fb8cb7fe700 1 -- 172.21.15.82:0/2464908252 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=76) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb8dc09a990 con 0x5630da72cc40 2023-09-23T09:24:16.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.759+0000 7fb9061f0b80 10 client.26836 fetch_fsmap learned FSMap version 76 2023-09-23T09:24:16.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.759+0000 7fb9061f0b80 1 -- 172.21.15.82:0/2464908252 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=76,monmap=4+}) v3 -- 0x5630da4aade0 con 0x5630da72cc40 2023-09-23T09:24:16.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.760+0000 7fb8cb7fe700 1 -- 172.21.15.82:0/2464908252 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb8dc064080 con 0x5630da72cc40 2023-09-23T09:24:16.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.760+0000 7fb8cb7fe700 1 -- 172.21.15.82:0/2464908252 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 76) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fb8dc0b2200 con 0x5630da72cc40 2023-09-23T09:24:16.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.760+0000 7fb9061f0b80 10 client.26836 fetch_fsmap finished waiting for FSMap version 76 2023-09-23T09:24:16.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.760+0000 7fb9061f0b80 10 client.26836 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:24:16.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.760+0000 7fb9061f0b80 20 client.26836 populate_metadata read hostname 'smithi082' 2023-09-23T09:24:16.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.760+0000 7fb9061f0b80 1 --2- 172.21.15.82:0/2464908252 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5630da745e50 0x5630da748240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:24:16.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.760+0000 7fb9061f0b80 4 client.26836 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:24:16.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.760+0000 7fb9061f0b80 1 -- 172.21.15.82:0/2464908252 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5630da624ba0 con 0x5630da745e50 2023-09-23T09:24:16.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.760+0000 7fb8eb7fe700 1 --2- 172.21.15.82:0/2464908252 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5630da745e50 0x5630da748240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:24:16.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.761+0000 7fb8cb7fe700 10 client.26836 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:24:16.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.761+0000 7fb8eb7fe700 1 --2- 172.21.15.82:0/2464908252 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5630da745e50 0x5630da748240 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=40d785ce07c660a8 server_cookie=a4cb5d1fb372bfd5 in_seq=0 out_seq=0 2023-09-23T09:24:16.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.762+0000 7fb8cb7fe700 1 -- 172.21.15.82:0/2464908252 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5630da624ba0 con 0x5630da745e50 2023-09-23T09:24:16.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.762+0000 7fb8cb7fe700 10 client.26836 handle_command_reply: tid=0 2023-09-23T09:24:16.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.762+0000 7fb9061f0b80 1 client.26836 shutdown 2023-09-23T09:24:16.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.762+0000 7fb9061f0b80 1 -- 172.21.15.82:0/2464908252 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5630da72cc40 msgr2=0x5630da738ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:24:16.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.762+0000 7fb9061f0b80 1 --2- 172.21.15.82:0/2464908252 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5630da72cc40 0x5630da738ba0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb8dc09a220 tx=0x7fb8dc099c70 comp rx=0 tx=0).stop 2023-09-23T09:24:16.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.762+0000 7fb9061f0b80 1 -- 172.21.15.82:0/2464908252 shutdown_connections 2023-09-23T09:24:16.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.762+0000 7fb9061f0b80 1 --2- 172.21.15.82:0/2464908252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5630da732ca0 0x5630da736430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:24:16.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.762+0000 7fb9061f0b80 1 --2- 172.21.15.82:0/2464908252 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5630da72cc40 0x5630da738ba0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:24:16.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.762+0000 7fb9061f0b80 1 --2- 172.21.15.82:0/2464908252 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5630da745e50 0x5630da748240 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:24:16.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.762+0000 7fb9061f0b80 1 --2- 172.21.15.82:0/2464908252 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5630da732380 0x5630da735e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:24:16.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.762+0000 7fb9061f0b80 1 -- 172.21.15.82:0/2464908252 >> 172.21.15.82:0/2464908252 conn(0x5630da6a10e0 msgr2=0x5630da7212b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:24:16.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.762+0000 7fb8cb7fe700 0 client.26836 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:24:16.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.762+0000 7fb9061f0b80 1 -- 172.21.15.82:0/2464908252 shutdown_connections 2023-09-23T09:24:16.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.762+0000 7fb9061f0b80 1 -- 172.21.15.82:0/2464908252 wait complete. 2023-09-23T09:24:16.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.762+0000 7fb9061f0b80 20 client.26836 trim_cache size 0 max 16384 2023-09-23T09:24:16.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.781+0000 7fb9061f0b80 1 Processor -- start 2023-09-23T09:24:16.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.781+0000 7fb9061f0b80 1 -- start start 2023-09-23T09:24:16.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.782+0000 7fb9061f0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5630da72cc40 0x5630da738740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:24:16.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.782+0000 7fb9061f0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5630da732380 0x5630da72ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:24:16.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.782+0000 7fb9061f0b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5630da732ca0 0x5630da72f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:24:16.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.782+0000 7fb9061f0b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630da500920 con 0x5630da72cc40 2023-09-23T09:24:16.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.782+0000 7fb9061f0b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630da729250 con 0x5630da732380 2023-09-23T09:24:16.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.782+0000 7fb9061f0b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630da7327e0 con 0x5630da732ca0 2023-09-23T09:24:16.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.782+0000 7fb8ebfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5630da72cc40 0x5630da738740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:24:16.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.782+0000 7fb8eb7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5630da732380 0x5630da72ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:24:16.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.782+0000 7fb8ebfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5630da72cc40 0x5630da738740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39208/0 (socket says 172.21.15.82:39208) 2023-09-23T09:24:16.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.782+0000 7fb8eb7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5630da732380 0x5630da72ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:49546/0 (socket says 172.21.15.82:49546) 2023-09-23T09:24:16.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.782+0000 7fb8ebfff700 1 -- 172.21.15.82:0/3006529126 learned_addr learned my addr 172.21.15.82:0/3006529126 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:24:16.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.782+0000 7fb8f0d9c700 1 --2- 172.21.15.82:0/3006529126 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5630da732ca0 0x5630da72f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:24:16.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.782+0000 7fb8eb7fe700 1 -- 172.21.15.82:0/3006529126 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5630da732ca0 msgr2=0x5630da72f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:24:16.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.782+0000 7fb8eb7fe700 1 --2- 172.21.15.82:0/3006529126 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5630da732ca0 0x5630da72f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:24:16.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.782+0000 7fb8eb7fe700 1 -- 172.21.15.82:0/3006529126 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5630da72cc40 msgr2=0x5630da738740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:24:16.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.782+0000 7fb8eb7fe700 1 --2- 172.21.15.82:0/3006529126 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5630da72cc40 0x5630da738740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:24:16.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.782+0000 7fb8eb7fe700 1 -- 172.21.15.82:0/3006529126 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5630da493c60 con 0x5630da732380 2023-09-23T09:24:16.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.783+0000 7fb8ebfff700 1 --2- 172.21.15.82:0/3006529126 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5630da72cc40 0x5630da738740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:24:16.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.783+0000 7fb8eb7fe700 1 --2- 172.21.15.82:0/3006529126 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5630da732380 0x5630da72ee10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x5630da748ad0 tx=0x7fb8e0009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=289fe8ec126ac530 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:24:16.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.783+0000 7fb8d2ffd700 1 -- 172.21.15.82:0/3006529126 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e0017070 con 0x5630da732380 2023-09-23T09:24:16.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.783+0000 7fb8d2ffd700 1 -- 172.21.15.82:0/3006529126 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb8e0024070 con 0x5630da732380 2023-09-23T09:24:16.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.783+0000 7fb8d2ffd700 1 -- 172.21.15.82:0/3006529126 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e0004290 con 0x5630da732380 2023-09-23T09:24:16.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.784+0000 7fb9061f0b80 1 -- 172.21.15.82:0/3006529126 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5630da732380 msgr2=0x5630da72ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:24:16.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.784+0000 7fb9061f0b80 1 --2- 172.21.15.82:0/3006529126 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5630da732380 0x5630da72ee10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x5630da748ad0 tx=0x7fb8e0009260 comp rx=0 tx=0).stop 2023-09-23T09:24:16.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.784+0000 7fb9061f0b80 1 -- 172.21.15.82:0/3006529126 shutdown_connections 2023-09-23T09:24:16.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.784+0000 7fb9061f0b80 1 --2- 172.21.15.82:0/3006529126 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5630da732ca0 0x5630da72f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:24:16.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.784+0000 7fb9061f0b80 1 --2- 172.21.15.82:0/3006529126 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5630da72cc40 0x5630da738740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:24:16.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.784+0000 7fb9061f0b80 1 --2- 172.21.15.82:0/3006529126 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5630da732380 0x5630da72ee10 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:24:16.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.784+0000 7fb9061f0b80 1 -- 172.21.15.82:0/3006529126 >> 172.21.15.82:0/3006529126 conn(0x5630da6a10e0 msgr2=0x5630da72ff50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:24:16.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.784+0000 7fb9061f0b80 1 -- 172.21.15.82:0/3006529126 shutdown_connections 2023-09-23T09:24:16.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.784+0000 7fb9061f0b80 1 -- 172.21.15.82:0/3006529126 wait complete. 2023-09-23T09:24:16.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.784+0000 7fb9061f0b80 1 -- start start 2023-09-23T09:24:16.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.785+0000 7fb9061f0b80 1 Processor -- start 2023-09-23T09:24:16.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.785+0000 7fb9061f0b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5630da72cc40 0x5630da73d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:24:16.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.785+0000 7fb9061f0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5630da732380 0x5630da739480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:24:16.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.785+0000 7fb9061f0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5630da732ca0 0x5630da7399c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:24:16.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.785+0000 7fb9061f0b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630da739fc0 con 0x5630da732380 2023-09-23T09:24:16.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.785+0000 7fb9061f0b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630da73a130 con 0x5630da732ca0 2023-09-23T09:24:16.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.785+0000 7fb9061f0b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630da73a2f0 con 0x5630da72cc40 2023-09-23T09:24:16.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.785+0000 7fb9061f0b80 10 client.0 _ll_register_callbacks cb 0x7fb8e0009bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:24:16.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.786+0000 7fb8eb7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5630da732380 0x5630da739480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:24:16.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.786+0000 7fb8f0d9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5630da732ca0 0x5630da7399c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:24:16.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.786+0000 7fb8eb7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5630da732380 0x5630da739480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39210/0 (socket says 172.21.15.82:39210) 2023-09-23T09:24:16.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.786+0000 7fb8eb7fe700 1 -- 172.21.15.82:0/4117929525 learned_addr learned my addr 172.21.15.82:0/4117929525 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:24:16.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.786+0000 7fb8ebfff700 1 --2- 172.21.15.82:0/4117929525 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5630da72cc40 0x5630da73d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:24:16.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.786+0000 7fb8eb7fe700 1 -- 172.21.15.82:0/4117929525 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5630da72cc40 msgr2=0x5630da73d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:24:16.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.786+0000 7fb8eb7fe700 1 --2- 172.21.15.82:0/4117929525 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5630da72cc40 0x5630da73d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:24:16.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.786+0000 7fb8eb7fe700 1 -- 172.21.15.82:0/4117929525 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5630da732ca0 msgr2=0x5630da7399c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:24:16.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.786+0000 7fb8eb7fe700 1 --2- 172.21.15.82:0/4117929525 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5630da732ca0 0x5630da7399c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:24:16.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.786+0000 7fb8eb7fe700 1 -- 172.21.15.82:0/4117929525 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5630da4aade0 con 0x5630da732380 2023-09-23T09:24:16.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.786+0000 7fb8eb7fe700 1 --2- 172.21.15.82:0/4117929525 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5630da732380 0x5630da739480 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fb8e0000c00 tx=0x7fb8e0020e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53baf307de68b4cc server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:24:16.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.786+0000 7fb8cb7fe700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:24:16.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.787+0000 7fb8cb7fe700 1 -- 172.21.15.82:0/4117929525 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e0017040 con 0x5630da732380 2023-09-23T09:24:16.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.787+0000 7fb9061f0b80 1 -- 172.21.15.82:0/4117929525 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5630da71f8b0 con 0x5630da732380 2023-09-23T09:24:16.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.787+0000 7fb8cb7fe700 1 -- 172.21.15.82:0/4117929525 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(131..131 src has 1..131) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fb8e0004040 con 0x5630da732380 2023-09-23T09:24:16.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.787+0000 7fb8cb7fe700 1 -- 172.21.15.82:0/4117929525 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=76) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb8e0013ea0 con 0x5630da732380 2023-09-23T09:24:16.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.787+0000 7fb9061f0b80 10 client.17115 fetch_fsmap learned FSMap version 76 2023-09-23T09:24:16.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.787+0000 7fb9061f0b80 1 -- 172.21.15.82:0/4117929525 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=76,monmap=4+}) v3 -- 0x7fb8e0012170 con 0x5630da732380 2023-09-23T09:24:16.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.787+0000 7fb8cb7fe700 1 -- 172.21.15.82:0/4117929525 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5630da71f8b0 con 0x5630da732380 2023-09-23T09:24:16.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.787+0000 7fb8cb7fe700 1 -- 172.21.15.82:0/4117929525 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 76) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fb8e00050b0 con 0x5630da732380 2023-09-23T09:24:16.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.787+0000 7fb9061f0b80 10 client.17115 fetch_fsmap finished waiting for FSMap version 76 2023-09-23T09:24:16.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.787+0000 7fb9061f0b80 10 client.17115 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:24:16.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.788+0000 7fb9061f0b80 20 client.17115 populate_metadata read hostname 'smithi082' 2023-09-23T09:24:16.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.788+0000 7fb9061f0b80 1 --2- 172.21.15.82:0/4117929525 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5630da79b1d0 0x5630da79d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:24:16.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.788+0000 7fb9061f0b80 4 client.17115 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:24:16.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.788+0000 7fb9061f0b80 1 -- 172.21.15.82:0/4117929525 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5630da677970 con 0x5630da79b1d0 2023-09-23T09:24:16.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.788+0000 7fb8ebfff700 1 --2- 172.21.15.82:0/4117929525 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5630da79b1d0 0x5630da79d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:24:16.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.789+0000 7fb8ebfff700 1 --2- 172.21.15.82:0/4117929525 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5630da79b1d0 0x5630da79d5f0 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=57724df244eeffe5 server_cookie=b3db4c3535662da5 in_seq=0 out_seq=0 2023-09-23T09:24:16.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.789+0000 7fb8cb7fe700 10 client.17115 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:24:16.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.789+0000 7fb8cb7fe700 1 -- 172.21.15.82:0/4117929525 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x5630da677970 con 0x5630da79b1d0 2023-09-23T09:24:16.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.789+0000 7fb8cb7fe700 10 client.17115 handle_command_reply: tid=0 2023-09-23T09:24:16.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.789+0000 7fb9061f0b80 1 client.17115 shutdown 2023-09-23T09:24:16.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.789+0000 7fb9061f0b80 1 -- 172.21.15.82:0/4117929525 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5630da732380 msgr2=0x5630da739480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:24:16.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.789+0000 7fb9061f0b80 1 --2- 172.21.15.82:0/4117929525 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5630da732380 0x5630da739480 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fb8e0000c00 tx=0x7fb8e0020e70 comp rx=0 tx=0).stop 2023-09-23T09:24:16.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.789+0000 7fb9061f0b80 1 -- 172.21.15.82:0/4117929525 shutdown_connections 2023-09-23T09:24:16.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.789+0000 7fb9061f0b80 1 --2- 172.21.15.82:0/4117929525 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5630da732ca0 0x5630da7399c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:24:16.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.789+0000 7fb9061f0b80 1 --2- 172.21.15.82:0/4117929525 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5630da72cc40 0x5630da73d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:24:16.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.789+0000 7fb9061f0b80 1 --2- 172.21.15.82:0/4117929525 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5630da79b1d0 0x5630da79d5f0 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:24:16.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.789+0000 7fb9061f0b80 1 --2- 172.21.15.82:0/4117929525 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5630da732380 0x5630da739480 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:24:16.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.789+0000 7fb9061f0b80 1 -- 172.21.15.82:0/4117929525 >> 172.21.15.82:0/4117929525 conn(0x5630da6a10e0 msgr2=0x5630da7212b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:24:16.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.789+0000 7fb8cb7fe700 0 client.17115 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:24:16.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.789+0000 7fb9061f0b80 1 -- 172.21.15.82:0/4117929525 shutdown_connections 2023-09-23T09:24:16.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.789+0000 7fb9061f0b80 1 -- 172.21.15.82:0/4117929525 wait complete. 2023-09-23T09:24:16.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.790+0000 7fb9061f0b80 20 client.17115 trim_cache size 0 max 16384 2023-09-23T09:24:16.796 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:24:16.796 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-23T09:24:16.796 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:24:16.796 INFO:teuthology.orchestra.run.smithi082.stdout: "047cbc72-e254-4787-b038-382de9c1a9a4": { 2023-09-23T09:24:16.796 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:24:16.796 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "047cbc72-e254-4787-b038-382de9c1a9a4", 2023-09-23T09:24:16.796 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:24:16.796 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:24:16.796 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:24:16.796 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:24:16.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.790+0000 7fb8f27ff700 1 -- 172.21.15.82:0/2767662635 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fb8d40a00c0 msgr2=0x7fb8d40a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:24:16.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.790+0000 7fb8f27ff700 1 --2- 172.21.15.82:0/2767662635 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fb8d40a00c0 0x7fb8d40a2580 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb8e4009ec0 tx=0x7fb8e4004b40 comp rx=0 tx=0).stop 2023-09-23T09:24:16.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.790+0000 7fb8f27ff700 1 -- 172.21.15.82:0/2767662635 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8ec101a30 msgr2=0x7fb8ec19e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:24:16.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.790+0000 7fb8f27ff700 1 --2- 172.21.15.82:0/2767662635 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8ec101a30 0x7fb8ec19e9a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb8dc000c00 tx=0x7fb8dc004730 comp rx=0 tx=0).stop 2023-09-23T09:24:16.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.790+0000 7fb8f27ff700 1 -- 172.21.15.82:0/2767662635 shutdown_connections 2023-09-23T09:24:16.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.790+0000 7fb8f27ff700 1 --2- 172.21.15.82:0/2767662635 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fb8d40a00c0 0x7fb8d40a2580 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:24:16.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.790+0000 7fb8f27ff700 1 --2- 172.21.15.82:0/2767662635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8ec10ae50 0x7fb8ec198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:24:16.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.790+0000 7fb8f27ff700 1 --2- 172.21.15.82:0/2767662635 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8ec101a30 0x7fb8ec19e9a0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:24:16.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.790+0000 7fb8f27ff700 1 --2- 172.21.15.82:0/2767662635 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8ec102350 0x7fb8ec19eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:24:16.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.790+0000 7fb8f27ff700 1 -- 172.21.15.82:0/2767662635 >> 172.21.15.82:0/2767662635 conn(0x7fb8ec0fb270 msgr2=0x7fb8ec0fd660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:24:16.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.790+0000 7fb8f27ff700 1 -- 172.21.15.82:0/2767662635 shutdown_connections 2023-09-23T09:24:16.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:16.791+0000 7fb8f27ff700 1 -- 172.21.15.82:0/2767662635 wait complete. 2023-09-23T09:24:16.812 INFO:tasks.cephfs.filesystem:scrub status for tag:047cbc72-e254-4787-b038-382de9c1a9a4 - {'path': '/', 'tag': '047cbc72-e254-4787-b038-382de9c1a9a4', 'options': 'recursive,force'} 2023-09-23T09:24:16.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:24:16 smithi082 ceph-mon[97694]: pgmap v866: 97 pgs: 97 active+clean; 11 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 35 MiB/s wr, 30 op/s 2023-09-23T09:24:16.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:24:16 smithi161 ceph-mon[99580]: pgmap v866: 97 pgs: 97 active+clean; 11 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 35 MiB/s wr, 30 op/s 2023-09-23T09:24:17.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:24:16 smithi135 ceph-mon[99205]: pgmap v866: 97 pgs: 97 active+clean; 11 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 35 MiB/s wr, 30 op/s 2023-09-23T09:24:18.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:24:17 smithi161 ceph-mon[99580]: pgmap v867: 97 pgs: 97 active+clean; 11 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 32 MiB/s wr, 27 op/s 2023-09-23T09:24:18.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:24:17 smithi135 ceph-mon[99205]: pgmap v867: 97 pgs: 97 active+clean; 11 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 32 MiB/s wr, 27 op/s 2023-09-23T09:24:18.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:24:17 smithi082 ceph-mon[97694]: pgmap v867: 97 pgs: 97 active+clean; 11 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 32 MiB/s wr, 27 op/s 2023-09-23T09:24:20.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:24:20 smithi135 ceph-mon[99205]: pgmap v868: 97 pgs: 97 active+clean; 11 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 32 MiB/s wr, 27 op/s 2023-09-23T09:24:20.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:24:20 smithi082 ceph-mon[97694]: pgmap v868: 97 pgs: 97 active+clean; 11 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 32 MiB/s wr, 27 op/s 2023-09-23T09:24:20.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:24:20 smithi161 ceph-mon[99580]: pgmap v868: 97 pgs: 97 active+clean; 11 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 32 MiB/s wr, 27 op/s 2023-09-23T09:24:22.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:24:22 smithi135 ceph-mon[99205]: pgmap v869: 97 pgs: 97 active+clean; 11 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 32 MiB/s wr, 27 op/s 2023-09-23T09:24:22.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:24:22 smithi082 ceph-mon[97694]: pgmap v869: 97 pgs: 97 active+clean; 11 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 32 MiB/s wr, 27 op/s 2023-09-23T09:24:22.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:24:22 smithi161 ceph-mon[99580]: pgmap v869: 97 pgs: 97 active+clean; 11 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 32 MiB/s wr, 27 op/s 2023-09-23T09:24:24.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:24:24 smithi135 ceph-mon[99205]: pgmap v870: 97 pgs: 97 active+clean; 11 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 27 MiB/s wr, 23 op/s 2023-09-23T09:24:24.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:24:24 smithi082 ceph-mon[97694]: pgmap v870: 97 pgs: 97 active+clean; 11 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 27 MiB/s wr, 23 op/s 2023-09-23T09:24:24.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:24:24 smithi161 ceph-mon[99580]: pgmap v870: 97 pgs: 97 active+clean; 11 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 27 MiB/s wr, 23 op/s 2023-09-23T09:24:26.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:24:26 smithi135 ceph-mon[99205]: pgmap v871: 97 pgs: 97 active+clean; 11 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 40 MiB/s wr, 33 op/s 2023-09-23T09:24:26.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:24:26 smithi082 ceph-mon[97694]: pgmap v871: 97 pgs: 97 active+clean; 11 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 40 MiB/s wr, 33 op/s 2023-09-23T09:24:26.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:24:26 smithi161 ceph-mon[99580]: pgmap v871: 97 pgs: 97 active+clean; 11 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 40 MiB/s wr, 33 op/s 2023-09-23T09:24:28.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:24:27 smithi161 ceph-mon[99580]: pgmap v872: 97 pgs: 97 active+clean; 11 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 27 MiB/s wr, 22 op/s 2023-09-23T09:24:28.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:24:27 smithi135 ceph-mon[99205]: pgmap v872: 97 pgs: 97 active+clean; 11 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 27 MiB/s wr, 22 op/s 2023-09-23T09:24:28.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:24:27 smithi082 ceph-mon[97694]: pgmap v872: 97 pgs: 97 active+clean; 11 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 27 MiB/s wr, 22 op/s 2023-09-23T09:24:30.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:24:30 smithi135 ceph-mon[99205]: pgmap v873: 97 pgs: 97 active+clean; 11 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 40 MiB/s wr, 39 op/s 2023-09-23T09:24:30.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:24:30 smithi082 ceph-mon[97694]: pgmap v873: 97 pgs: 97 active+clean; 11 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 40 MiB/s wr, 39 op/s 2023-09-23T09:24:30.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:24:30 smithi161 ceph-mon[99580]: pgmap v873: 97 pgs: 97 active+clean; 11 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 40 MiB/s wr, 39 op/s 2023-09-23T09:24:32.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:24:32 smithi135 ceph-mon[99205]: pgmap v874: 97 pgs: 97 active+clean; 11 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 27 MiB/s wr, 27 op/s 2023-09-23T09:24:32.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:24:32 smithi082 ceph-mon[97694]: pgmap v874: 97 pgs: 97 active+clean; 11 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 27 MiB/s wr, 27 op/s 2023-09-23T09:24:32.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:24:32 smithi161 ceph-mon[99580]: pgmap v874: 97 pgs: 97 active+clean; 11 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 27 MiB/s wr, 27 op/s 2023-09-23T09:24:34.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:24:34 smithi135 ceph-mon[99205]: pgmap v875: 97 pgs: 97 active+clean; 11 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 27 MiB/s wr, 27 op/s 2023-09-23T09:24:34.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:24:34 smithi082 ceph-mon[97694]: pgmap v875: 97 pgs: 97 active+clean; 11 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 27 MiB/s wr, 27 op/s 2023-09-23T09:24:34.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:24:34 smithi161 ceph-mon[99580]: pgmap v875: 97 pgs: 97 active+clean; 11 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 27 MiB/s wr, 27 op/s 2023-09-23T09:24:36.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:24:36 smithi135 ceph-mon[99205]: pgmap v876: 97 pgs: 97 active+clean; 12 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 40 MiB/s wr, 38 op/s 2023-09-23T09:24:36.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:24:36 smithi082 ceph-mon[97694]: pgmap v876: 97 pgs: 97 active+clean; 12 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 40 MiB/s wr, 38 op/s 2023-09-23T09:24:36.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:24:36 smithi161 ceph-mon[99580]: pgmap v876: 97 pgs: 97 active+clean; 12 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 40 MiB/s wr, 38 op/s 2023-09-23T09:24:38.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:24:37 smithi161 ceph-mon[99580]: pgmap v877: 97 pgs: 97 active+clean; 12 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 27 MiB/s wr, 27 op/s 2023-09-23T09:24:38.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:24:37 smithi135 ceph-mon[99205]: pgmap v877: 97 pgs: 97 active+clean; 12 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 27 MiB/s wr, 27 op/s 2023-09-23T09:24:38.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:24:37 smithi082 ceph-mon[97694]: pgmap v877: 97 pgs: 97 active+clean; 12 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 27 MiB/s wr, 27 op/s 2023-09-23T09:24:38.886 INFO:teuthology.orchestra.run.smithi082.stderr:set primary keys... 2023-09-23T09:24:40.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:24:40 smithi135 ceph-mon[99205]: pgmap v878: 97 pgs: 97 active+clean; 12 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 33 MiB/s wr, 316 op/s 2023-09-23T09:24:40.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:24:40 smithi082 ceph-mon[97694]: pgmap v878: 97 pgs: 97 active+clean; 12 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 33 MiB/s wr, 316 op/s 2023-09-23T09:24:40.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:24:40 smithi161 ceph-mon[99580]: pgmap v878: 97 pgs: 97 active+clean; 12 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 33 MiB/s wr, 316 op/s 2023-09-23T09:24:42.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:24:42 smithi135 ceph-mon[99205]: pgmap v879: 97 pgs: 97 active+clean; 12 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 20 MiB/s wr, 300 op/s 2023-09-23T09:24:42.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:24:42 smithi082 ceph-mon[97694]: pgmap v879: 97 pgs: 97 active+clean; 12 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 20 MiB/s wr, 300 op/s 2023-09-23T09:24:42.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:24:42 smithi161 ceph-mon[99580]: pgmap v879: 97 pgs: 97 active+clean; 12 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 20 MiB/s wr, 300 op/s 2023-09-23T09:24:44.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:24:44 smithi135 ceph-mon[99205]: pgmap v880: 97 pgs: 97 active+clean; 12 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 20 MiB/s wr, 300 op/s 2023-09-23T09:24:44.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:24:44 smithi082 ceph-mon[97694]: pgmap v880: 97 pgs: 97 active+clean; 12 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 20 MiB/s wr, 300 op/s 2023-09-23T09:24:44.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:24:44 smithi161 ceph-mon[99580]: pgmap v880: 97 pgs: 97 active+clean; 12 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 20 MiB/s wr, 300 op/s 2023-09-23T09:24:46.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:24:46 smithi135 ceph-mon[99205]: pgmap v881: 97 pgs: 97 active+clean; 12 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 40 MiB/s rd, 25 MiB/s wr, 642 op/s 2023-09-23T09:24:46.812 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:24:46.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:24:46 smithi082 ceph-mon[97694]: pgmap v881: 97 pgs: 97 active+clean; 12 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 40 MiB/s rd, 25 MiB/s wr, 642 op/s 2023-09-23T09:24:46.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:24:46 smithi161 ceph-mon[99580]: pgmap v881: 97 pgs: 97 active+clean; 12 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 40 MiB/s rd, 25 MiB/s wr, 642 op/s 2023-09-23T09:24:48.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:24:47 smithi082 ceph-mon[97694]: pgmap v882: 97 pgs: 97 active+clean; 12 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 39 MiB/s rd, 12 MiB/s wr, 632 op/s 2023-09-23T09:24:48.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:24:47 smithi161 ceph-mon[99580]: pgmap v882: 97 pgs: 97 active+clean; 12 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 39 MiB/s rd, 12 MiB/s wr, 632 op/s 2023-09-23T09:24:48.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:24:47 smithi135 ceph-mon[99205]: pgmap v882: 97 pgs: 97 active+clean; 12 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 39 MiB/s rd, 12 MiB/s wr, 632 op/s 2023-09-23T09:24:48.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.672+0000 7f8a6cf9d700 1 -- 172.21.15.82:0/4065866370 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a681006f0 msgr2=0x7f8a68100b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:24:48.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.672+0000 7f8a6cf9d700 1 --2- 172.21.15.82:0/4065866370 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a681006f0 0x7f8a68100b70 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c009990 tx=0x7f8a5c009ca0 comp rx=0 tx=0).stop 2023-09-23T09:24:48.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.672+0000 7f8a6cf9d700 1 -- 172.21.15.82:0/4065866370 shutdown_connections 2023-09-23T09:24:48.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.672+0000 7f8a6cf9d700 1 --2- 172.21.15.82:0/4065866370 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8a681010b0 0x7f8a6810d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:24:48.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.672+0000 7f8a6cf9d700 1 --2- 172.21.15.82:0/4065866370 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a68106700 0x7f8a68106ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:24:48.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.672+0000 7f8a6cf9d700 1 --2- 172.21.15.82:0/4065866370 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a681006f0 0x7f8a68100b70 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:24:48.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.672+0000 7f8a6cf9d700 1 -- 172.21.15.82:0/4065866370 >> 172.21.15.82:0/4065866370 conn(0x7f8a680fc1c0 msgr2=0x7f8a680fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:24:48.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.672+0000 7f8a6cf9d700 1 -- 172.21.15.82:0/4065866370 shutdown_connections 2023-09-23T09:24:48.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.672+0000 7f8a6cf9d700 1 -- 172.21.15.82:0/4065866370 wait complete. 2023-09-23T09:24:48.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.673+0000 7f8a6cf9d700 1 Processor -- start 2023-09-23T09:24:48.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.674+0000 7f8a6cf9d700 1 -- start start 2023-09-23T09:24:48.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.674+0000 7f8a6cf9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a681006f0 0x7f8a6819e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:24:48.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.674+0000 7f8a6cf9d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8a681010b0 0x7f8a6819eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:24:48.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.674+0000 7f8a6cf9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a68106700 0x7f8a68198600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:24:48.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.674+0000 7f8a6cf9d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a68198dd0 con 0x7f8a68106700 2023-09-23T09:24:48.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.674+0000 7f8a6cf9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a68198f40 con 0x7f8a681006f0 2023-09-23T09:24:48.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.674+0000 7f8a6cf9d700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a68199100 con 0x7f8a681010b0 2023-09-23T09:24:48.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.674+0000 7f8a677fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a681006f0 0x7f8a6819e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:24:48.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.674+0000 7f8a677fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a681006f0 0x7f8a6819e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:38074/0 (socket says 172.21.15.82:38074) 2023-09-23T09:24:48.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.674+0000 7f8a67fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a68106700 0x7f8a68198600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:24:48.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.674+0000 7f8a677fe700 1 -- 172.21.15.82:0/416915992 learned_addr learned my addr 172.21.15.82:0/416915992 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:24:48.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.674+0000 7f8a66ffd700 1 --2- 172.21.15.82:0/416915992 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8a681010b0 0x7f8a6819eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:24:48.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.675+0000 7f8a677fe700 1 -- 172.21.15.82:0/416915992 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8a681010b0 msgr2=0x7f8a6819eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:24:48.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.675+0000 7f8a677fe700 1 --2- 172.21.15.82:0/416915992 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8a681010b0 0x7f8a6819eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:24:48.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.675+0000 7f8a677fe700 1 -- 172.21.15.82:0/416915992 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a68106700 msgr2=0x7f8a68198600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:24:48.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.675+0000 7f8a677fe700 1 --2- 172.21.15.82:0/416915992 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a68106700 0x7f8a68198600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:24:48.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.675+0000 7f8a677fe700 1 -- 172.21.15.82:0/416915992 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a5c0095f0 con 0x7f8a681006f0 2023-09-23T09:24:48.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.675+0000 7f8a677fe700 1 --2- 172.21.15.82:0/416915992 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a681006f0 0x7f8a6819e620 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8a5800e9a0 tx=0x7f8a5800ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:24:48.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.675+0000 7f8a64ff9700 1 -- 172.21.15.82:0/416915992 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a58009790 con 0x7f8a681006f0 2023-09-23T09:24:48.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.676+0000 7f8a6cf9d700 1 -- 172.21.15.82:0/416915992 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a681993e0 con 0x7f8a681006f0 2023-09-23T09:24:48.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.676+0000 7f8a64ff9700 1 -- 172.21.15.82:0/416915992 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8a58010430 con 0x7f8a681006f0 2023-09-23T09:24:48.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.676+0000 7f8a64ff9700 1 -- 172.21.15.82:0/416915992 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a5800cea0 con 0x7f8a681006f0 2023-09-23T09:24:48.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.676+0000 7f8a6cf9d700 1 -- 172.21.15.82:0/416915992 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a681a55f0 con 0x7f8a681006f0 2023-09-23T09:24:48.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.679+0000 7f8a64ff9700 1 -- 172.21.15.82:0/416915992 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f8a580105a0 con 0x7f8a681006f0 2023-09-23T09:24:48.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.681+0000 7f8a81a95b80 1 Processor -- start 2023-09-23T09:24:48.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.681+0000 7f8a81a95b80 1 -- start start 2023-09-23T09:24:48.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.681+0000 7f8a64ff9700 1 --2- 172.21.15.82:0/416915992 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f8a500a0160 0x7f8a500a2620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:24:48.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.681+0000 7f8a64ff9700 1 -- 172.21.15.82:0/416915992 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f8a58014070 con 0x7f8a681006f0 2023-09-23T09:24:48.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.681+0000 7f8a81a95b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55906e398500 0x55906e3988e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:24:48.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.681+0000 7f8a81a95b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55906e398e20 0x55906e392700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:24:48.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.681+0000 7f8a81a95b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55906e392c40 0x55906e393080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:24:48.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.681+0000 7f8a81a95b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55906e2fa7b0 con 0x55906e392c40 2023-09-23T09:24:48.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.681+0000 7f8a81a95b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55906e2eb780 con 0x55906e398500 2023-09-23T09:24:48.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.681+0000 7f8a81a95b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55906e2e90a0 con 0x55906e398e20 2023-09-23T09:24:48.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.682+0000 7f8a67fff700 1 --2- 172.21.15.82:0/416915992 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f8a500a0160 0x7f8a500a2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:24:48.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.682+0000 7f8a66ffd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55906e398e20 0x55906e392700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:24:48.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.682+0000 7f8a67fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55906e392c40 0x55906e393080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:24:48.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.682+0000 7f8a66ffd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55906e398e20 0x55906e392700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:33098/0 (socket says 172.21.15.82:33098) 2023-09-23T09:24:48.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.682+0000 7f8a66ffd700 1 -- 172.21.15.82:0/682064637 learned_addr learned my addr 172.21.15.82:0/682064637 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:24:48.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.682+0000 7f8a677fe700 1 --2- 172.21.15.82:0/682064637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55906e398500 0x55906e3988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:24:48.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.682+0000 7f8a66ffd700 1 -- 172.21.15.82:0/682064637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55906e398500 msgr2=0x55906e3988e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:24:48.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.682+0000 7f8a66ffd700 1 --2- 172.21.15.82:0/682064637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55906e398500 0x55906e3988e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:24:48.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.682+0000 7f8a66ffd700 1 -- 172.21.15.82:0/682064637 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55906e392c40 msgr2=0x55906e393080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:24:48.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.682+0000 7f8a66ffd700 1 --2- 172.21.15.82:0/682064637 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55906e392c40 0x55906e393080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:24:48.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.682+0000 7f8a66ffd700 1 -- 172.21.15.82:0/682064637 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55906e164630 con 0x55906e398e20 2023-09-23T09:24:48.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.682+0000 7f8a677fe700 1 --2- 172.21.15.82:0/682064637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55906e398500 0x55906e3988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:24:48.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.682+0000 7f8a67fff700 1 --2- 172.21.15.82:0/416915992 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f8a500a0160 0x7f8a500a2620 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8a60009ec0 tx=0x7f8a600092f0 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:24:48.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.683+0000 7f8a66ffd700 1 --2- 172.21.15.82:0/682064637 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55906e398e20 0x55906e392700 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c009990 tx=0x7f8a5c005f00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f2ff3494d5b13d76 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:24:48.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.683+0000 7f8a4dffb700 1 -- 172.21.15.82:0/682064637 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a5c01d070 con 0x55906e398e20 2023-09-23T09:24:48.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.683+0000 7f8a4dffb700 1 -- 172.21.15.82:0/682064637 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8a5c01e040 con 0x55906e398e20 2023-09-23T09:24:48.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.683+0000 7f8a4dffb700 1 -- 172.21.15.82:0/682064637 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a5c004760 con 0x55906e398e20 2023-09-23T09:24:48.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.684+0000 7f8a81a95b80 1 -- 172.21.15.82:0/682064637 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55906e398e20 msgr2=0x55906e392700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:24:48.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.684+0000 7f8a81a95b80 1 --2- 172.21.15.82:0/682064637 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55906e398e20 0x55906e392700 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c009990 tx=0x7f8a5c005f00 comp rx=0 tx=0).stop 2023-09-23T09:24:48.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.684+0000 7f8a81a95b80 1 -- 172.21.15.82:0/682064637 shutdown_connections 2023-09-23T09:24:48.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.684+0000 7f8a81a95b80 1 --2- 172.21.15.82:0/682064637 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55906e392c40 0x55906e393080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:24:48.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.684+0000 7f8a81a95b80 1 --2- 172.21.15.82:0/682064637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55906e398500 0x55906e3988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:24:48.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.684+0000 7f8a81a95b80 1 --2- 172.21.15.82:0/682064637 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55906e398e20 0x55906e392700 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:24:48.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.684+0000 7f8a81a95b80 1 -- 172.21.15.82:0/682064637 >> 172.21.15.82:0/682064637 conn(0x55906e3070e0 msgr2=0x55906e38d940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:24:48.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.684+0000 7f8a81a95b80 1 -- 172.21.15.82:0/682064637 shutdown_connections 2023-09-23T09:24:48.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.684+0000 7f8a81a95b80 1 -- 172.21.15.82:0/682064637 wait complete. 2023-09-23T09:24:48.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.685+0000 7f8a81a95b80 1 -- start start 2023-09-23T09:24:48.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.685+0000 7f8a81a95b80 1 Processor -- start 2023-09-23T09:24:48.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.685+0000 7f8a81a95b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55906e392c40 0x55906e39ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:24:48.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.685+0000 7f8a81a95b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55906e398500 0x55906e39bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:24:48.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.685+0000 7f8a81a95b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55906e398e20 0x55906e39c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:24:48.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.685+0000 7f8a81a95b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55906e2e4990 con 0x55906e392c40 2023-09-23T09:24:48.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.685+0000 7f8a81a95b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55906e282bb0 con 0x55906e398e20 2023-09-23T09:24:48.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.685+0000 7f8a81a95b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55906e2828b0 con 0x55906e398500 2023-09-23T09:24:48.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.686+0000 7f8a81a95b80 10 client.0 _ll_register_callbacks cb 0x55906e1cca80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:24:48.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.686+0000 7f8a677fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55906e392c40 0x55906e39ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:24:48.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.686+0000 7f8a677fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55906e392c40 0x55906e39ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56710/0 (socket says 172.21.15.82:56710) 2023-09-23T09:24:48.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.686+0000 7f8a677fe700 1 -- 172.21.15.82:0/471907107 learned_addr learned my addr 172.21.15.82:0/471907107 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:24:48.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.686+0000 7f8a66ffd700 1 --2- 172.21.15.82:0/471907107 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55906e398500 0x55906e39bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:24:48.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.686+0000 7f8a67fff700 1 --2- 172.21.15.82:0/471907107 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55906e398e20 0x55906e39c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:24:48.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.686+0000 7f8a677fe700 1 -- 172.21.15.82:0/471907107 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55906e398500 msgr2=0x55906e39bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:24:48.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.686+0000 7f8a677fe700 1 --2- 172.21.15.82:0/471907107 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55906e398500 0x55906e39bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:24:48.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.686+0000 7f8a677fe700 1 -- 172.21.15.82:0/471907107 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55906e398e20 msgr2=0x55906e39c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:24:48.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.686+0000 7f8a677fe700 1 --2- 172.21.15.82:0/471907107 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55906e398e20 0x55906e39c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:24:48.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.686+0000 7f8a677fe700 1 -- 172.21.15.82:0/471907107 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a6810dec0 con 0x55906e392c40 2023-09-23T09:24:48.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.686+0000 7f8a67fff700 1 --2- 172.21.15.82:0/471907107 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55906e398e20 0x55906e39c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:24:48.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.686+0000 7f8a677fe700 1 --2- 172.21.15.82:0/471907107 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55906e392c40 0x55906e39ed70 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f8a5800c2d0 tx=0x7f8a580988d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a3a97d5f0a4bf31 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:24:48.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.686+0000 7f8a46ffd700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:24:48.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.687+0000 7f8a46ffd700 1 -- 172.21.15.82:0/471907107 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a58098e80 con 0x55906e392c40 2023-09-23T09:24:48.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.687+0000 7f8a46ffd700 1 -- 172.21.15.82:0/471907107 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(131..131 src has 1..131) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f8a5809ccb0 con 0x55906e392c40 2023-09-23T09:24:48.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.687+0000 7f8a81a95b80 1 -- 172.21.15.82:0/471907107 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55906e3621c0 con 0x55906e392c40 2023-09-23T09:24:48.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.687+0000 7f8a46ffd700 1 -- 172.21.15.82:0/471907107 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=76) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8a580a0c90 con 0x55906e392c40 2023-09-23T09:24:48.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.687+0000 7f8a81a95b80 10 client.17127 fetch_fsmap learned FSMap version 76 2023-09-23T09:24:48.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.687+0000 7f8a81a95b80 1 -- 172.21.15.82:0/471907107 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=76,monmap=4+}) v3 -- 0x55906e110de0 con 0x55906e392c40 2023-09-23T09:24:48.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.687+0000 7f8a46ffd700 1 -- 172.21.15.82:0/471907107 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55906e3621c0 con 0x55906e392c40 2023-09-23T09:24:48.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.687+0000 7f8a46ffd700 1 -- 172.21.15.82:0/471907107 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 76) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f8a580b80e0 con 0x55906e392c40 2023-09-23T09:24:48.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.687+0000 7f8a81a95b80 10 client.17127 fetch_fsmap finished waiting for FSMap version 76 2023-09-23T09:24:48.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.687+0000 7f8a81a95b80 10 client.17127 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:24:48.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.687+0000 7f8a81a95b80 20 client.17127 populate_metadata read hostname 'smithi082' 2023-09-23T09:24:48.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.687+0000 7f8a81a95b80 1 --2- 172.21.15.82:0/471907107 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55906e3ac8a0 0x55906e3aec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:24:48.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.687+0000 7f8a81a95b80 4 client.17127 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:24:48.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.687+0000 7f8a81a95b80 1 -- 172.21.15.82:0/471907107 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55906e28aba0 con 0x55906e3ac8a0 2023-09-23T09:24:48.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.688+0000 7f8a66ffd700 1 --2- 172.21.15.82:0/471907107 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55906e3ac8a0 0x55906e3aec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:24:48.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.688+0000 7f8a46ffd700 10 client.17127 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:24:48.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.688+0000 7f8a66ffd700 1 --2- 172.21.15.82:0/471907107 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55906e3ac8a0 0x55906e3aec90 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c100807c8be82ff3 server_cookie=e11b4e490af7b524 in_seq=0 out_seq=0 2023-09-23T09:24:48.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.689+0000 7f8a46ffd700 1 -- 172.21.15.82:0/471907107 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55906e28aba0 con 0x55906e3ac8a0 2023-09-23T09:24:48.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.689+0000 7f8a46ffd700 10 client.17127 handle_command_reply: tid=0 2023-09-23T09:24:48.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.689+0000 7f8a81a95b80 1 client.17127 shutdown 2023-09-23T09:24:48.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.689+0000 7f8a81a95b80 1 -- 172.21.15.82:0/471907107 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55906e392c40 msgr2=0x55906e39ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:24:48.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.689+0000 7f8a81a95b80 1 --2- 172.21.15.82:0/471907107 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55906e392c40 0x55906e39ed70 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f8a5800c2d0 tx=0x7f8a580988d0 comp rx=0 tx=0).stop 2023-09-23T09:24:48.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.690+0000 7f8a81a95b80 1 -- 172.21.15.82:0/471907107 shutdown_connections 2023-09-23T09:24:48.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.690+0000 7f8a81a95b80 1 --2- 172.21.15.82:0/471907107 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55906e398e20 0x55906e39c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:24:48.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.690+0000 7f8a81a95b80 1 --2- 172.21.15.82:0/471907107 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55906e3ac8a0 0x55906e3aec90 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:24:48.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.690+0000 7f8a81a95b80 1 --2- 172.21.15.82:0/471907107 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55906e392c40 0x55906e39ed70 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:24:48.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.690+0000 7f8a81a95b80 1 --2- 172.21.15.82:0/471907107 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55906e398500 0x55906e39bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:24:48.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.690+0000 7f8a46ffd700 0 client.17127 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:24:48.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.690+0000 7f8a81a95b80 1 -- 172.21.15.82:0/471907107 >> 172.21.15.82:0/471907107 conn(0x55906e3070e0 msgr2=0x55906e38d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:24:48.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.690+0000 7f8a81a95b80 1 -- 172.21.15.82:0/471907107 shutdown_connections 2023-09-23T09:24:48.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.690+0000 7f8a81a95b80 1 -- 172.21.15.82:0/471907107 wait complete. 2023-09-23T09:24:48.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.690+0000 7f8a81a95b80 20 client.17127 trim_cache size 0 max 16384 2023-09-23T09:24:48.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.712+0000 7f8a81a95b80 1 Processor -- start 2023-09-23T09:24:48.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.712+0000 7f8a81a95b80 1 -- start start 2023-09-23T09:24:48.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.712+0000 7f8a81a95b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55906e392c40 0x55906e39e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:24:48.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.713+0000 7f8a81a95b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55906e398500 0x55906e3961d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:24:48.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.713+0000 7f8a81a95b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55906e398e20 0x55906e38d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:24:48.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.713+0000 7f8a81a95b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55906e166920 con 0x55906e398500 2023-09-23T09:24:48.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.713+0000 7f8a81a95b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55906e3a9f80 con 0x55906e398e20 2023-09-23T09:24:48.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.713+0000 7f8a81a95b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55906e393990 con 0x55906e392c40 2023-09-23T09:24:48.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.713+0000 7f8a66ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55906e398500 0x55906e3961d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:24:48.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.713+0000 7f8a677fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55906e392c40 0x55906e39e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:24:48.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.713+0000 7f8a677fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55906e392c40 0x55906e39e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:33120/0 (socket says 172.21.15.82:33120) 2023-09-23T09:24:48.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.713+0000 7f8a677fe700 1 -- 172.21.15.82:0/1879597312 learned_addr learned my addr 172.21.15.82:0/1879597312 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:24:48.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.713+0000 7f8a66ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55906e398500 0x55906e3961d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56712/0 (socket says 172.21.15.82:56712) 2023-09-23T09:24:48.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.713+0000 7f8a67fff700 1 --2- 172.21.15.82:0/1879597312 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55906e398e20 0x55906e38d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:24:48.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.713+0000 7f8a677fe700 1 -- 172.21.15.82:0/1879597312 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55906e398e20 msgr2=0x55906e38d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:24:48.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.713+0000 7f8a677fe700 1 --2- 172.21.15.82:0/1879597312 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55906e398e20 0x55906e38d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:24:48.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.713+0000 7f8a677fe700 1 -- 172.21.15.82:0/1879597312 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55906e398500 msgr2=0x55906e3961d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:24:48.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.713+0000 7f8a677fe700 1 --2- 172.21.15.82:0/1879597312 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55906e398500 0x55906e3961d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:24:48.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.713+0000 7f8a677fe700 1 -- 172.21.15.82:0/1879597312 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55906e0f9c60 con 0x55906e392c40 2023-09-23T09:24:48.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.713+0000 7f8a66ffd700 1 --2- 172.21.15.82:0/1879597312 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55906e398500 0x55906e3961d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:24:48.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.714+0000 7f8a677fe700 1 --2- 172.21.15.82:0/1879597312 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55906e392c40 0x55906e39e910 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8a580c94c0 tx=0x7f8a580952f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2108ab4efc2b9705 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:24:48.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.714+0000 7f8a4e7fc700 1 -- 172.21.15.82:0/1879597312 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a5809ccb0 con 0x55906e392c40 2023-09-23T09:24:48.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.714+0000 7f8a4e7fc700 1 -- 172.21.15.82:0/1879597312 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8a58099e90 con 0x55906e392c40 2023-09-23T09:24:48.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.714+0000 7f8a4e7fc700 1 -- 172.21.15.82:0/1879597312 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a580cb4f0 con 0x55906e392c40 2023-09-23T09:24:48.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.715+0000 7f8a81a95b80 1 -- 172.21.15.82:0/1879597312 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55906e392c40 msgr2=0x55906e39e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:24:48.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.715+0000 7f8a81a95b80 1 --2- 172.21.15.82:0/1879597312 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55906e392c40 0x55906e39e910 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8a580c94c0 tx=0x7f8a580952f0 comp rx=0 tx=0).stop 2023-09-23T09:24:48.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.715+0000 7f8a81a95b80 1 -- 172.21.15.82:0/1879597312 shutdown_connections 2023-09-23T09:24:48.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.715+0000 7f8a81a95b80 1 --2- 172.21.15.82:0/1879597312 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55906e398e20 0x55906e38d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:24:48.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.715+0000 7f8a81a95b80 1 --2- 172.21.15.82:0/1879597312 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55906e392c40 0x55906e39e910 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:24:48.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.715+0000 7f8a81a95b80 1 --2- 172.21.15.82:0/1879597312 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55906e398500 0x55906e3961d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:24:48.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.715+0000 7f8a81a95b80 1 -- 172.21.15.82:0/1879597312 >> 172.21.15.82:0/1879597312 conn(0x55906e3070e0 msgr2=0x55906e3a8090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:24:48.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.715+0000 7f8a81a95b80 1 -- 172.21.15.82:0/1879597312 shutdown_connections 2023-09-23T09:24:48.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.715+0000 7f8a81a95b80 1 -- 172.21.15.82:0/1879597312 wait complete. 2023-09-23T09:24:48.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.715+0000 7f8a81a95b80 1 -- start start 2023-09-23T09:24:48.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.715+0000 7f8a81a95b80 1 Processor -- start 2023-09-23T09:24:48.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.716+0000 7f8a81a95b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55906e392c40 0x55906e3950c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:24:48.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.716+0000 7f8a81a95b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55906e398500 0x55906e395600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:24:48.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.716+0000 7f8a81a95b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55906e398e20 0x55906e393f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:24:48.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.716+0000 7f8a81a95b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55906e395d40 con 0x55906e392c40 2023-09-23T09:24:48.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.716+0000 7f8a81a95b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55906e3944a0 con 0x55906e398e20 2023-09-23T09:24:48.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.716+0000 7f8a81a95b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55906e394660 con 0x55906e398500 2023-09-23T09:24:48.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.716+0000 7f8a81a95b80 10 client.0 _ll_register_callbacks cb 0x7f8a580989c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:24:48.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.716+0000 7f8a677fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55906e392c40 0x55906e3950c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:24:48.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.716+0000 7f8a66ffd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55906e398500 0x55906e395600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:24:48.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.716+0000 7f8a677fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55906e392c40 0x55906e3950c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56716/0 (socket says 172.21.15.82:56716) 2023-09-23T09:24:48.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.716+0000 7f8a677fe700 1 -- 172.21.15.82:0/4086313018 learned_addr learned my addr 172.21.15.82:0/4086313018 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:24:48.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.716+0000 7f8a67fff700 1 --2- 172.21.15.82:0/4086313018 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55906e398e20 0x55906e393f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:24:48.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.717+0000 7f8a66ffd700 1 -- 172.21.15.82:0/4086313018 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55906e398e20 msgr2=0x55906e393f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:24:48.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.717+0000 7f8a66ffd700 1 --2- 172.21.15.82:0/4086313018 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55906e398e20 0x55906e393f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:24:48.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.717+0000 7f8a66ffd700 1 -- 172.21.15.82:0/4086313018 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55906e392c40 msgr2=0x55906e3950c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:24:48.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.717+0000 7f8a66ffd700 1 --2- 172.21.15.82:0/4086313018 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55906e392c40 0x55906e3950c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:24:48.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.717+0000 7f8a66ffd700 1 -- 172.21.15.82:0/4086313018 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55906e164630 con 0x55906e398500 2023-09-23T09:24:48.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.717+0000 7f8a677fe700 1 --2- 172.21.15.82:0/4086313018 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55906e392c40 0x55906e3950c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:24:48.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.717+0000 7f8a66ffd700 1 --2- 172.21.15.82:0/4086313018 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55906e398500 0x55906e395600 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c0098e0 tx=0x7f8a5c00bd90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=33e7441e58b6469 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:24:48.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.717+0000 7f8a46ffd700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T09:24:48.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.717+0000 7f8a46ffd700 1 -- 172.21.15.82:0/4086313018 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a5c031040 con 0x55906e398500 2023-09-23T09:24:48.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.717+0000 7f8a81a95b80 1 -- 172.21.15.82:0/4086313018 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55906e3858b0 con 0x55906e398500 2023-09-23T09:24:48.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.717+0000 7f8a46ffd700 1 -- 172.21.15.82:0/4086313018 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(131..131 src has 1..131) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f8a5c034320 con 0x55906e398500 2023-09-23T09:24:48.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.718+0000 7f8a46ffd700 1 -- 172.21.15.82:0/4086313018 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=76) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8a5c01d040 con 0x55906e398500 2023-09-23T09:24:48.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.718+0000 7f8a81a95b80 10 client.26860 fetch_fsmap learned FSMap version 76 2023-09-23T09:24:48.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.718+0000 7f8a81a95b80 1 -- 172.21.15.82:0/4086313018 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=76,monmap=4+}) v3 -- 0x55906e110de0 con 0x55906e398500 2023-09-23T09:24:48.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.718+0000 7f8a46ffd700 1 -- 172.21.15.82:0/4086313018 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55906e3858b0 con 0x55906e398500 2023-09-23T09:24:48.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.718+0000 7f8a46ffd700 1 -- 172.21.15.82:0/4086313018 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 76) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f8a5c034bd0 con 0x55906e398500 2023-09-23T09:24:48.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.718+0000 7f8a81a95b80 10 client.26860 fetch_fsmap finished waiting for FSMap version 76 2023-09-23T09:24:48.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.718+0000 7f8a81a95b80 10 client.26860 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:24:48.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.718+0000 7f8a81a95b80 20 client.26860 populate_metadata read hostname 'smithi082' 2023-09-23T09:24:48.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.718+0000 7f8a81a95b80 1 --2- 172.21.15.82:0/4086313018 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55906e400f20 0x55906e403310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:24:48.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.718+0000 7f8a81a95b80 4 client.26860 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:24:48.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.718+0000 7f8a81a95b80 1 -- 172.21.15.82:0/4086313018 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55906e2dd970 con 0x55906e400f20 2023-09-23T09:24:48.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.719+0000 7f8a677fe700 1 --2- 172.21.15.82:0/4086313018 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55906e400f20 0x55906e403310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:24:48.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.719+0000 7f8a46ffd700 10 client.26860 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:24:48.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.719+0000 7f8a677fe700 1 --2- 172.21.15.82:0/4086313018 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55906e400f20 0x55906e403310 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7bc3a0d461db021f server_cookie=7cf71e4713ef1f99 in_seq=0 out_seq=0 2023-09-23T09:24:48.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.719+0000 7f8a46ffd700 1 -- 172.21.15.82:0/4086313018 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55906e2dd970 con 0x55906e400f20 2023-09-23T09:24:48.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.719+0000 7f8a46ffd700 10 client.26860 handle_command_reply: tid=0 2023-09-23T09:24:48.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.719+0000 7f8a81a95b80 1 client.26860 shutdown 2023-09-23T09:24:48.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.720+0000 7f8a81a95b80 1 -- 172.21.15.82:0/4086313018 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55906e398500 msgr2=0x55906e395600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:24:48.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.720+0000 7f8a81a95b80 1 --2- 172.21.15.82:0/4086313018 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55906e398500 0x55906e395600 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c0098e0 tx=0x7f8a5c00bd90 comp rx=0 tx=0).stop 2023-09-23T09:24:48.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.720+0000 7f8a81a95b80 1 -- 172.21.15.82:0/4086313018 shutdown_connections 2023-09-23T09:24:48.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.720+0000 7f8a81a95b80 1 --2- 172.21.15.82:0/4086313018 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55906e398e20 0x55906e393f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:24:48.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.720+0000 7f8a81a95b80 1 --2- 172.21.15.82:0/4086313018 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55906e400f20 0x55906e403310 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:24:48.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.720+0000 7f8a81a95b80 1 --2- 172.21.15.82:0/4086313018 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55906e392c40 0x55906e3950c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:24:48.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.720+0000 7f8a81a95b80 1 --2- 172.21.15.82:0/4086313018 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55906e398500 0x55906e395600 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:24:48.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.720+0000 7f8a46ffd700 0 client.26860 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:24:48.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.720+0000 7f8a81a95b80 1 -- 172.21.15.82:0/4086313018 >> 172.21.15.82:0/4086313018 conn(0x55906e3070e0 msgr2=0x55906e3961d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:24:48.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.720+0000 7f8a81a95b80 1 -- 172.21.15.82:0/4086313018 shutdown_connections 2023-09-23T09:24:48.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.720+0000 7f8a81a95b80 1 -- 172.21.15.82:0/4086313018 wait complete. 2023-09-23T09:24:48.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.720+0000 7f8a81a95b80 20 client.26860 trim_cache size 0 max 16384 2023-09-23T09:24:48.726 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:24:48.726 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-23T09:24:48.727 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:24:48.727 INFO:teuthology.orchestra.run.smithi082.stdout: "047cbc72-e254-4787-b038-382de9c1a9a4": { 2023-09-23T09:24:48.727 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:24:48.727 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "047cbc72-e254-4787-b038-382de9c1a9a4", 2023-09-23T09:24:48.727 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:24:48.727 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:24:48.727 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:24:48.727 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:24:48.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.721+0000 7f8a6cf9d700 1 -- 172.21.15.82:0/416915992 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f8a500a0160 msgr2=0x7f8a500a2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:24:48.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.721+0000 7f8a6cf9d700 1 --2- 172.21.15.82:0/416915992 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f8a500a0160 0x7f8a500a2620 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8a60009ec0 tx=0x7f8a600092f0 comp rx=0 tx=0).stop 2023-09-23T09:24:48.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.721+0000 7f8a6cf9d700 1 -- 172.21.15.82:0/416915992 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a681006f0 msgr2=0x7f8a6819e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:24:48.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.721+0000 7f8a6cf9d700 1 --2- 172.21.15.82:0/416915992 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a681006f0 0x7f8a6819e620 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8a5800e9a0 tx=0x7f8a5800ecb0 comp rx=0 tx=0).stop 2023-09-23T09:24:48.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.721+0000 7f8a6cf9d700 1 -- 172.21.15.82:0/416915992 shutdown_connections 2023-09-23T09:24:48.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.721+0000 7f8a6cf9d700 1 --2- 172.21.15.82:0/416915992 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f8a500a0160 0x7f8a500a2620 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:24:48.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.721+0000 7f8a6cf9d700 1 --2- 172.21.15.82:0/416915992 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a68106700 0x7f8a68198600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:24:48.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.721+0000 7f8a6cf9d700 1 --2- 172.21.15.82:0/416915992 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a681006f0 0x7f8a6819e620 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:24:48.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.721+0000 7f8a6cf9d700 1 --2- 172.21.15.82:0/416915992 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8a681010b0 0x7f8a6819eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:24:48.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.721+0000 7f8a6cf9d700 1 -- 172.21.15.82:0/416915992 >> 172.21.15.82:0/416915992 conn(0x7f8a680fc1c0 msgr2=0x7f8a6810bac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:24:48.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.721+0000 7f8a6cf9d700 1 -- 172.21.15.82:0/416915992 shutdown_connections 2023-09-23T09:24:48.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:24:48.721+0000 7f8a6cf9d700 1 -- 172.21.15.82:0/416915992 wait complete. 2023-09-23T09:24:48.740 INFO:tasks.cephfs.filesystem:scrub status for tag:047cbc72-e254-4787-b038-382de9c1a9a4 - {'path': '/', 'tag': '047cbc72-e254-4787-b038-382de9c1a9a4', 'options': 'recursive,force'} 2023-09-23T09:24:50.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:24:50 smithi135 ceph-mon[99205]: pgmap v883: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 69 MiB/s rd, 17 MiB/s wr, 930 op/s 2023-09-23T09:24:50.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:24:50 smithi082 ceph-mon[97694]: pgmap v883: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 69 MiB/s rd, 17 MiB/s wr, 930 op/s 2023-09-23T09:24:50.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:24:50 smithi161 ceph-mon[99580]: pgmap v883: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 69 MiB/s rd, 17 MiB/s wr, 930 op/s 2023-09-23T09:24:52.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:24:52 smithi135 ceph-mon[99205]: pgmap v884: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 63 MiB/s rd, 10 MiB/s wr, 641 op/s 2023-09-23T09:24:52.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:24:52 smithi082 ceph-mon[97694]: pgmap v884: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 63 MiB/s rd, 10 MiB/s wr, 641 op/s 2023-09-23T09:24:52.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:24:52 smithi161 ceph-mon[99580]: pgmap v884: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 63 MiB/s rd, 10 MiB/s wr, 641 op/s 2023-09-23T09:24:54.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:24:54 smithi135 ceph-mon[99205]: pgmap v885: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 63 MiB/s rd, 10 MiB/s wr, 641 op/s 2023-09-23T09:24:54.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:24:54 smithi082 ceph-mon[97694]: pgmap v885: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 63 MiB/s rd, 10 MiB/s wr, 641 op/s 2023-09-23T09:24:54.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:24:54 smithi161 ceph-mon[99580]: pgmap v885: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 63 MiB/s rd, 10 MiB/s wr, 641 op/s 2023-09-23T09:24:55.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:24:55 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:24:55.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:24:55 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:24:55.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:24:55 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:24:56.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:24:56 smithi135 ceph-mon[99205]: pgmap v886: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 63 MiB/s rd, 20 MiB/s wr, 651 op/s 2023-09-23T09:24:56.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:24:56 smithi082 ceph-mon[97694]: pgmap v886: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 63 MiB/s rd, 20 MiB/s wr, 651 op/s 2023-09-23T09:24:56.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:24:56 smithi161 ceph-mon[99580]: pgmap v886: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 63 MiB/s rd, 20 MiB/s wr, 651 op/s 2023-09-23T09:24:58.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:24:57 smithi161 ceph-mon[99580]: pgmap v887: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 30 MiB/s rd, 15 MiB/s wr, 308 op/s 2023-09-23T09:24:58.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:24:57 smithi135 ceph-mon[99205]: pgmap v887: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 30 MiB/s rd, 15 MiB/s wr, 308 op/s 2023-09-23T09:24:58.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:24:57 smithi082 ceph-mon[97694]: pgmap v887: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 30 MiB/s rd, 15 MiB/s wr, 308 op/s 2023-09-23T09:25:00.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:25:00 smithi135 ceph-mon[99205]: pgmap v888: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 30 MiB/s rd, 24 MiB/s wr, 318 op/s 2023-09-23T09:25:00.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:25:00 smithi082 ceph-mon[97694]: pgmap v888: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 30 MiB/s rd, 24 MiB/s wr, 318 op/s 2023-09-23T09:25:00.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:25:00 smithi161 ceph-mon[99580]: pgmap v888: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 30 MiB/s rd, 24 MiB/s wr, 318 op/s 2023-09-23T09:25:03.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:25:02 smithi135 ceph-mon[99205]: pgmap v889: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 19 MiB/s wr, 19 op/s 2023-09-23T09:25:03.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:25:02 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:25:03.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:25:02 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:25:03.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:25:02 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:25:03.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:25:02 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:25:03.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:25:02 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:25:03.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:25:02 smithi082 ceph-mon[97694]: pgmap v889: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 19 MiB/s wr, 19 op/s 2023-09-23T09:25:03.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:25:02 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:25:03.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:25:02 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:25:03.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:25:02 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:25:03.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:25:02 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:25:03.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:25:02 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:25:03.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:25:02 smithi161 ceph-mon[99580]: pgmap v889: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 19 MiB/s wr, 19 op/s 2023-09-23T09:25:03.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:25:02 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:25:03.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:25:02 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:25:03.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:25:02 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:25:03.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:25:02 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:25:03.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:25:02 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:25:05.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:25:04 smithi135 ceph-mon[99205]: pgmap v890: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 19 MiB/s wr, 19 op/s 2023-09-23T09:25:05.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:25:04 smithi082 ceph-mon[97694]: pgmap v890: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 19 MiB/s wr, 19 op/s 2023-09-23T09:25:05.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:25:04 smithi161 ceph-mon[99580]: pgmap v890: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 19 MiB/s wr, 19 op/s 2023-09-23T09:25:07.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:25:06 smithi135 ceph-mon[99205]: pgmap v891: 97 pgs: 97 active+clean; 12 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 29 MiB/s wr, 43 op/s 2023-09-23T09:25:07.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:25:06 smithi082 ceph-mon[97694]: pgmap v891: 97 pgs: 97 active+clean; 12 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 29 MiB/s wr, 43 op/s 2023-09-23T09:25:07.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:25:06 smithi161 ceph-mon[99580]: pgmap v891: 97 pgs: 97 active+clean; 12 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 29 MiB/s wr, 43 op/s 2023-09-23T09:25:08.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:25:07 smithi135 ceph-mon[99205]: osdmap e132: 12 total, 12 up, 12 in 2023-09-23T09:25:08.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:25:07 smithi082 ceph-mon[97694]: osdmap e132: 12 total, 12 up, 12 in 2023-09-23T09:25:08.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:25:07 smithi161 ceph-mon[99580]: osdmap e132: 12 total, 12 up, 12 in 2023-09-23T09:25:09.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:25:08 smithi135 ceph-mon[99205]: pgmap v893: 97 pgs: 97 active+clean; 12 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 23 MiB/s wr, 39 op/s 2023-09-23T09:25:09.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:25:08 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:25:09.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:25:08 smithi082 ceph-mon[97694]: pgmap v893: 97 pgs: 97 active+clean; 12 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 23 MiB/s wr, 39 op/s 2023-09-23T09:25:09.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:25:08 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:25:09.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:25:08 smithi161 ceph-mon[99580]: pgmap v893: 97 pgs: 97 active+clean; 12 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 23 MiB/s wr, 39 op/s 2023-09-23T09:25:09.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:25:08 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:25:11.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:25:10 smithi135 ceph-mon[99205]: pgmap v894: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 255 KiB/s rd, 23 MiB/s wr, 38 op/s 2023-09-23T09:25:11.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:25:10 smithi082 ceph-mon[97694]: pgmap v894: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 255 KiB/s rd, 23 MiB/s wr, 38 op/s 2023-09-23T09:25:11.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:25:10 smithi161 ceph-mon[99580]: pgmap v894: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 255 KiB/s rd, 23 MiB/s wr, 38 op/s 2023-09-23T09:25:13.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:25:12 smithi135 ceph-mon[99205]: pgmap v895: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 255 KiB/s rd, 23 MiB/s wr, 38 op/s 2023-09-23T09:25:13.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:25:12 smithi135 ceph-mon[99205]: osdmap e133: 12 total, 12 up, 12 in 2023-09-23T09:25:13.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:25:12 smithi082 ceph-mon[97694]: pgmap v895: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 255 KiB/s rd, 23 MiB/s wr, 38 op/s 2023-09-23T09:25:13.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:25:12 smithi082 ceph-mon[97694]: osdmap e133: 12 total, 12 up, 12 in 2023-09-23T09:25:13.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:25:12 smithi161 ceph-mon[99580]: pgmap v895: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 255 KiB/s rd, 23 MiB/s wr, 38 op/s 2023-09-23T09:25:13.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:25:12 smithi161 ceph-mon[99580]: osdmap e133: 12 total, 12 up, 12 in 2023-09-23T09:25:14.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:25:13 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:25:14.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:25:13 smithi135 ceph-mon[99205]: pgmap v897: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 14 MiB/s wr, 13 op/s 2023-09-23T09:25:14.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:25:13 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:25:14.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:25:13 smithi082 ceph-mon[97694]: pgmap v897: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 14 MiB/s wr, 13 op/s 2023-09-23T09:25:14.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:25:13 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:25:14.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:25:13 smithi161 ceph-mon[99580]: pgmap v897: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 14 MiB/s wr, 13 op/s 2023-09-23T09:25:16.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:25:16 smithi135 ceph-mon[99205]: pgmap v898: 97 pgs: 97 active+clean; 12 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 25 MiB/s wr, 23 op/s 2023-09-23T09:25:16.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:25:16 smithi082 ceph-mon[97694]: pgmap v898: 97 pgs: 97 active+clean; 12 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 25 MiB/s wr, 23 op/s 2023-09-23T09:25:16.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:25:16 smithi161 ceph-mon[99580]: pgmap v898: 97 pgs: 97 active+clean; 12 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 25 MiB/s wr, 23 op/s 2023-09-23T09:25:18.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:25:17 smithi135 ceph-mon[99205]: pgmap v899: 97 pgs: 97 active+clean; 12 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 22 MiB/s wr, 20 op/s 2023-09-23T09:25:18.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:25:17 smithi082 ceph-mon[97694]: pgmap v899: 97 pgs: 97 active+clean; 12 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 22 MiB/s wr, 20 op/s 2023-09-23T09:25:18.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:25:17 smithi161 ceph-mon[99580]: pgmap v899: 97 pgs: 97 active+clean; 12 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 22 MiB/s wr, 20 op/s 2023-09-23T09:25:18.741 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:25:18.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:18.995+0000 7fae9e19d700 1 -- 172.21.15.82:0/1527169090 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fae98106740 msgr2=0x7fae98106b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:25:18.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:18.995+0000 7fae9e19d700 1 --2- 172.21.15.82:0/1527169090 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fae98106740 0x7fae98106b20 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fae94009990 tx=0x7fae94009ca0 comp rx=0 tx=0).stop 2023-09-23T09:25:18.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:18.995+0000 7fae9e19d700 1 -- 172.21.15.82:0/1527169090 shutdown_connections 2023-09-23T09:25:18.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:18.995+0000 7fae9e19d700 1 --2- 172.21.15.82:0/1527169090 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae981010f0 0x7fae9810d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:25:18.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:18.995+0000 7fae9e19d700 1 --2- 172.21.15.82:0/1527169090 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fae98106740 0x7fae98106b20 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:25:18.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:18.995+0000 7fae9e19d700 1 --2- 172.21.15.82:0/1527169090 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae98100730 0x7fae98100bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:25:18.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:18.995+0000 7fae9e19d700 1 -- 172.21.15.82:0/1527169090 >> 172.21.15.82:0/1527169090 conn(0x7fae980fc240 msgr2=0x7fae980fe660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:25:18.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:18.995+0000 7fae9e19d700 1 -- 172.21.15.82:0/1527169090 shutdown_connections 2023-09-23T09:25:18.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:18.995+0000 7fae9e19d700 1 -- 172.21.15.82:0/1527169090 wait complete. 2023-09-23T09:25:18.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:18.996+0000 7fae9e19d700 1 Processor -- start 2023-09-23T09:25:18.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:18.996+0000 7fae9e19d700 1 -- start start 2023-09-23T09:25:18.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:18.996+0000 7fae9e19d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae98100730 0x7fae98072c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:25:18.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:18.997+0000 7fae9e19d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fae981010f0 0x7fae98073160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:25:19.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:18.997+0000 7fae9e19d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae98106740 0x7fae981a4830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:25:19.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:18.997+0000 7fae9e19d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae98073990 con 0x7fae98106740 2023-09-23T09:25:19.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:18.997+0000 7fae9e19d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae981a4d70 con 0x7fae98100730 2023-09-23T09:25:19.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:18.997+0000 7fae9e19d700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae981a4eb0 con 0x7fae981010f0 2023-09-23T09:25:19.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:18.997+0000 7fae9d19b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae98100730 0x7fae98072c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:25:19.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:18.997+0000 7fae9d19b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae98100730 0x7fae98072c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:40846/0 (socket says 172.21.15.82:40846) 2023-09-23T09:25:19.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:18.997+0000 7fae9d19b700 1 -- 172.21.15.82:0/1159942634 learned_addr learned my addr 172.21.15.82:0/1159942634 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:25:19.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:18.997+0000 7fae9c99a700 1 --2- 172.21.15.82:0/1159942634 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fae981010f0 0x7fae98073160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:25:19.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:18.997+0000 7fae9d99c700 1 --2- 172.21.15.82:0/1159942634 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae98106740 0x7fae981a4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:25:19.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:18.997+0000 7fae9d19b700 1 -- 172.21.15.82:0/1159942634 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fae981010f0 msgr2=0x7fae98073160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:25:19.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:18.997+0000 7fae9d19b700 1 --2- 172.21.15.82:0/1159942634 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fae981010f0 0x7fae98073160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:25:19.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:18.997+0000 7fae9d19b700 1 -- 172.21.15.82:0/1159942634 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae98106740 msgr2=0x7fae981a4830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:25:19.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:18.997+0000 7fae9d19b700 1 --2- 172.21.15.82:0/1159942634 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae98106740 0x7fae981a4830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:25:19.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:18.997+0000 7fae9d19b700 1 -- 172.21.15.82:0/1159942634 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae940095f0 con 0x7fae98100730 2023-09-23T09:25:19.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:18.997+0000 7fae9c99a700 1 --2- 172.21.15.82:0/1159942634 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fae981010f0 0x7fae98073160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:25:19.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:18.998+0000 7fae9d19b700 1 --2- 172.21.15.82:0/1159942634 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae98100730 0x7fae98072c20 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fae94005740 tx=0x7fae94005770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:25:19.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:18.998+0000 7fae8e7fc700 1 -- 172.21.15.82:0/1159942634 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae9401d070 con 0x7fae98100730 2023-09-23T09:25:19.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:18.998+0000 7fae8e7fc700 1 -- 172.21.15.82:0/1159942634 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fae94022470 con 0x7fae98100730 2023-09-23T09:25:19.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:18.998+0000 7fae9e19d700 1 -- 172.21.15.82:0/1159942634 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae981a50b0 con 0x7fae98100730 2023-09-23T09:25:19.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:18.998+0000 7fae8e7fc700 1 -- 172.21.15.82:0/1159942634 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae94017650 con 0x7fae98100730 2023-09-23T09:25:19.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:18.998+0000 7fae9e19d700 1 -- 172.21.15.82:0/1159942634 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae981a5590 con 0x7fae98100730 2023-09-23T09:25:19.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.002+0000 7fae8e7fc700 1 -- 172.21.15.82:0/1159942634 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7fae940225e0 con 0x7fae98100730 2023-09-23T09:25:19.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.003+0000 7faeb2dfab80 1 Processor -- start 2023-09-23T09:25:19.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.003+0000 7faeb2dfab80 1 -- start start 2023-09-23T09:25:19.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.003+0000 7faeb2dfab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d57cbc3500 0x55d57cbc38e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:25:19.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.003+0000 7faeb2dfab80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d57cbc3e20 0x55d57cbbd700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:25:19.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.003+0000 7faeb2dfab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d57cbbdc40 0x55d57cbbe080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:25:19.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.003+0000 7faeb2dfab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d57cb257b0 con 0x55d57cbc3500 2023-09-23T09:25:19.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.003+0000 7faeb2dfab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d57cb16780 con 0x55d57cbbdc40 2023-09-23T09:25:19.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.003+0000 7faeb2dfab80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d57cb140a0 con 0x55d57cbc3e20 2023-09-23T09:25:19.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.004+0000 7fae9d99c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d57cbc3500 0x55d57cbc38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:25:19.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.004+0000 7fae9d19b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d57cbc3e20 0x55d57cbbd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:25:19.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.004+0000 7fae9c99a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d57cbbdc40 0x55d57cbbe080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:25:19.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.004+0000 7fae9d19b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d57cbc3e20 0x55d57cbbd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:58212/0 (socket says 172.21.15.82:58212) 2023-09-23T09:25:19.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.004+0000 7fae9c99a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d57cbbdc40 0x55d57cbbe080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:40860/0 (socket says 172.21.15.82:40860) 2023-09-23T09:25:19.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.004+0000 7fae9d99c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d57cbc3500 0x55d57cbc38e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39944/0 (socket says 172.21.15.82:39944) 2023-09-23T09:25:19.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.004+0000 7fae9d19b700 1 -- 172.21.15.82:0/3575580319 learned_addr learned my addr 172.21.15.82:0/3575580319 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:25:19.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.004+0000 7fae8e7fc700 1 --2- 172.21.15.82:0/1159942634 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fae840a0160 0x7fae840a2620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:25:19.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.004+0000 7fae9d19b700 1 -- 172.21.15.82:0/3575580319 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d57cbbdc40 msgr2=0x55d57cbbe080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:25:19.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.004+0000 7fae9d19b700 1 --2- 172.21.15.82:0/3575580319 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d57cbbdc40 0x55d57cbbe080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:25:19.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.004+0000 7fae9d19b700 1 -- 172.21.15.82:0/3575580319 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d57cbc3500 msgr2=0x55d57cbc38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:25:19.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.004+0000 7fae9d19b700 1 --2- 172.21.15.82:0/3575580319 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d57cbc3500 0x55d57cbc38e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:25:19.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.004+0000 7fae9d19b700 1 -- 172.21.15.82:0/3575580319 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d57c98f630 con 0x55d57cbc3e20 2023-09-23T09:25:19.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.004+0000 7fae8e7fc700 1 -- 172.21.15.82:0/1159942634 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fae940cc990 con 0x7fae98100730 2023-09-23T09:25:19.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.005+0000 7fae9d99c700 1 --2- 172.21.15.82:0/1159942634 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fae840a0160 0x7fae840a2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:25:19.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.005+0000 7fae9d19b700 1 --2- 172.21.15.82:0/3575580319 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d57cbc3e20 0x55d57cbbd700 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fae940c9fc0 tx=0x7fae94005910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db64efd411e9bd9 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:25:19.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.005+0000 7fae837fe700 1 -- 172.21.15.82:0/3575580319 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae94099ea0 con 0x55d57cbc3e20 2023-09-23T09:25:19.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.005+0000 7fae837fe700 1 -- 172.21.15.82:0/3575580319 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fae94099c10 con 0x55d57cbc3e20 2023-09-23T09:25:19.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.005+0000 7fae837fe700 1 -- 172.21.15.82:0/3575580319 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae9409a0d0 con 0x55d57cbc3e20 2023-09-23T09:25:19.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.006+0000 7faeb2dfab80 1 -- 172.21.15.82:0/3575580319 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d57cbc3e20 msgr2=0x55d57cbbd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:25:19.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.006+0000 7faeb2dfab80 1 --2- 172.21.15.82:0/3575580319 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d57cbc3e20 0x55d57cbbd700 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fae940c9fc0 tx=0x7fae94005910 comp rx=0 tx=0).stop 2023-09-23T09:25:19.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.006+0000 7fae9d99c700 1 --2- 172.21.15.82:0/1159942634 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fae840a0160 0x7fae840a2620 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fae98074d30 tx=0x7fae90009040 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:25:19.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.006+0000 7faeb2dfab80 1 -- 172.21.15.82:0/3575580319 shutdown_connections 2023-09-23T09:25:19.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.006+0000 7faeb2dfab80 1 --2- 172.21.15.82:0/3575580319 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d57cbbdc40 0x55d57cbbe080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:25:19.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.006+0000 7faeb2dfab80 1 --2- 172.21.15.82:0/3575580319 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d57cbc3500 0x55d57cbc38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:25:19.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.006+0000 7faeb2dfab80 1 --2- 172.21.15.82:0/3575580319 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d57cbc3e20 0x55d57cbbd700 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:25:19.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.006+0000 7faeb2dfab80 1 -- 172.21.15.82:0/3575580319 >> 172.21.15.82:0/3575580319 conn(0x55d57cb320e0 msgr2=0x55d57cbb8940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:25:19.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.006+0000 7faeb2dfab80 1 -- 172.21.15.82:0/3575580319 shutdown_connections 2023-09-23T09:25:19.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.006+0000 7faeb2dfab80 1 -- 172.21.15.82:0/3575580319 wait complete. 2023-09-23T09:25:19.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.007+0000 7faeb2dfab80 1 -- start start 2023-09-23T09:25:19.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.007+0000 7faeb2dfab80 1 Processor -- start 2023-09-23T09:25:19.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.007+0000 7faeb2dfab80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d57cbbdc40 0x55d57cbc9e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:25:19.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.008+0000 7faeb2dfab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d57cbc3500 0x55d57cbc70b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:25:19.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.008+0000 7faeb2dfab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d57cbc3e20 0x55d57cbc77a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:25:19.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.008+0000 7faeb2dfab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d57cb0f990 con 0x55d57cbc3500 2023-09-23T09:25:19.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.008+0000 7faeb2dfab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d57caadbb0 con 0x55d57cbc3e20 2023-09-23T09:25:19.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.008+0000 7faeb2dfab80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d57caad8b0 con 0x55d57cbbdc40 2023-09-23T09:25:19.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.008+0000 7faeb2dfab80 10 client.0 _ll_register_callbacks cb 0x55d57c9f7a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:25:19.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.008+0000 7fae9d19b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d57cbbdc40 0x55d57cbc9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:25:19.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.008+0000 7fae9d19b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d57cbbdc40 0x55d57cbc9e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:58226/0 (socket says 172.21.15.82:58226) 2023-09-23T09:25:19.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.008+0000 7fae9d19b700 1 -- 172.21.15.82:0/1370384178 learned_addr learned my addr 172.21.15.82:0/1370384178 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:25:19.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.008+0000 7fae9d99c700 1 --2- 172.21.15.82:0/1370384178 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d57cbc3e20 0x55d57cbc77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:25:19.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.008+0000 7fae9c99a700 1 --2- 172.21.15.82:0/1370384178 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d57cbc3500 0x55d57cbc70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:25:19.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.008+0000 7fae9d19b700 1 -- 172.21.15.82:0/1370384178 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d57cbc3e20 msgr2=0x55d57cbc77a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:25:19.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.008+0000 7fae9d19b700 1 --2- 172.21.15.82:0/1370384178 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d57cbc3e20 0x55d57cbc77a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:25:19.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.008+0000 7fae9d19b700 1 -- 172.21.15.82:0/1370384178 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d57cbc3500 msgr2=0x55d57cbc70b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:25:19.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.008+0000 7fae9d19b700 1 --2- 172.21.15.82:0/1370384178 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d57cbc3500 0x55d57cbc70b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:25:19.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.008+0000 7fae9d19b700 1 -- 172.21.15.82:0/1370384178 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae981a5590 con 0x55d57cbbdc40 2023-09-23T09:25:19.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.008+0000 7fae9c99a700 1 --2- 172.21.15.82:0/1370384178 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d57cbc3500 0x55d57cbc70b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:25:19.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.009+0000 7fae9d19b700 1 --2- 172.21.15.82:0/1370384178 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d57cbbdc40 0x55d57cbc9e30 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fae94009350 tx=0x7fae940962c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca3324ea9eb04ce server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:25:19.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.009+0000 7fae80ff9700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T09:25:19.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.009+0000 7fae80ff9700 1 -- 172.21.15.82:0/1370384178 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae94099a30 con 0x55d57cbbdc40 2023-09-23T09:25:19.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.009+0000 7faeb2dfab80 1 -- 172.21.15.82:0/1370384178 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d57cb8d1c0 con 0x55d57cbbdc40 2023-09-23T09:25:19.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.009+0000 7fae80ff9700 1 -- 172.21.15.82:0/1370384178 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(133..133 src has 1..133) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fae9409a7d0 con 0x55d57cbbdc40 2023-09-23T09:25:19.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.009+0000 7fae80ff9700 1 -- 172.21.15.82:0/1370384178 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7fae94022ac0 con 0x55d57cbbdc40 2023-09-23T09:25:19.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.009+0000 7faeb2dfab80 10 client.26872 fetch_fsmap learned FSMap version 78 2023-09-23T09:25:19.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.009+0000 7faeb2dfab80 1 -- 172.21.15.82:0/1370384178 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=78,monmap=4+}) v3 -- 0x55d57c93bde0 con 0x55d57cbbdc40 2023-09-23T09:25:19.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.009+0000 7fae80ff9700 1 -- 172.21.15.82:0/1370384178 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fae940b1070 con 0x55d57cbbdc40 2023-09-23T09:25:19.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.009+0000 7fae80ff9700 1 -- 172.21.15.82:0/1370384178 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 78) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fae9409a330 con 0x55d57cbbdc40 2023-09-23T09:25:19.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.010+0000 7faeb2dfab80 10 client.26872 fetch_fsmap finished waiting for FSMap version 78 2023-09-23T09:25:19.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.010+0000 7faeb2dfab80 10 client.26872 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:25:19.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.010+0000 7faeb2dfab80 20 client.26872 populate_metadata read hostname 'smithi082' 2023-09-23T09:25:19.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.010+0000 7faeb2dfab80 1 --2- 172.21.15.82:0/1370384178 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55d57cbd7070 0x55d57cbd9490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:25:19.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.010+0000 7faeb2dfab80 4 client.26872 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:25:19.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.010+0000 7faeb2dfab80 1 -- 172.21.15.82:0/1370384178 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d57cab5ba0 con 0x55d57cbd7070 2023-09-23T09:25:19.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.010+0000 7fae9c99a700 1 --2- 172.21.15.82:0/1370384178 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55d57cbd7070 0x55d57cbd9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:25:19.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.011+0000 7fae9c99a700 1 --2- 172.21.15.82:0/1370384178 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55d57cbd7070 0x55d57cbd9490 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5382633f5c7b8b1d server_cookie=bb250d7a0e9e206b in_seq=0 out_seq=0 2023-09-23T09:25:19.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.011+0000 7fae80ff9700 10 client.26872 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:25:19.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.011+0000 7fae80ff9700 1 -- 172.21.15.82:0/1370384178 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55d57cab5ba0 con 0x55d57cbd7070 2023-09-23T09:25:19.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.011+0000 7fae80ff9700 10 client.26872 handle_command_reply: tid=0 2023-09-23T09:25:19.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.011+0000 7faeb2dfab80 1 client.26872 shutdown 2023-09-23T09:25:19.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.011+0000 7faeb2dfab80 1 -- 172.21.15.82:0/1370384178 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d57cbbdc40 msgr2=0x55d57cbc9e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:25:19.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.011+0000 7faeb2dfab80 1 --2- 172.21.15.82:0/1370384178 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d57cbbdc40 0x55d57cbc9e30 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fae94009350 tx=0x7fae940962c0 comp rx=0 tx=0).stop 2023-09-23T09:25:19.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.012+0000 7faeb2dfab80 1 -- 172.21.15.82:0/1370384178 shutdown_connections 2023-09-23T09:25:19.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.012+0000 7faeb2dfab80 1 --2- 172.21.15.82:0/1370384178 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d57cbc3e20 0x55d57cbc77a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:25:19.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.012+0000 7faeb2dfab80 1 --2- 172.21.15.82:0/1370384178 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d57cbbdc40 0x55d57cbc9e30 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:25:19.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.012+0000 7faeb2dfab80 1 --2- 172.21.15.82:0/1370384178 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55d57cbd7070 0x55d57cbd9490 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:25:19.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.012+0000 7faeb2dfab80 1 --2- 172.21.15.82:0/1370384178 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d57cbc3500 0x55d57cbc70b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:25:19.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.012+0000 7faeb2dfab80 1 -- 172.21.15.82:0/1370384178 >> 172.21.15.82:0/1370384178 conn(0x55d57cb320e0 msgr2=0x55d57cbb84d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:25:19.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.012+0000 7fae80ff9700 0 client.26872 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:25:19.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.012+0000 7faeb2dfab80 1 -- 172.21.15.82:0/1370384178 shutdown_connections 2023-09-23T09:25:19.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.012+0000 7faeb2dfab80 1 -- 172.21.15.82:0/1370384178 wait complete. 2023-09-23T09:25:19.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.012+0000 7faeb2dfab80 20 client.26872 trim_cache size 0 max 16384 2023-09-23T09:25:19.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.033+0000 7faeb2dfab80 1 Processor -- start 2023-09-23T09:25:19.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.033+0000 7faeb2dfab80 1 -- start start 2023-09-23T09:25:19.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.033+0000 7faeb2dfab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d57cbbdc40 0x55d57cbbd700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:25:19.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.033+0000 7faeb2dfab80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d57cbc3500 0x55d57cbc9960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:25:19.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.033+0000 7faeb2dfab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d57cbc3e20 0x55d57cbc11d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:25:19.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.033+0000 7faeb2dfab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d57c991920 con 0x55d57cbc3e20 2023-09-23T09:25:19.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.033+0000 7faeb2dfab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d57cbc8540 con 0x55d57cbbdc40 2023-09-23T09:25:19.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.033+0000 7faeb2dfab80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d57cbbe6a0 con 0x55d57cbc3500 2023-09-23T09:25:19.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.034+0000 7fae9d19b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d57cbbdc40 0x55d57cbbd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:25:19.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.034+0000 7fae9d19b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d57cbbdc40 0x55d57cbbd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:40878/0 (socket says 172.21.15.82:40878) 2023-09-23T09:25:19.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.034+0000 7fae9d19b700 1 -- 172.21.15.82:0/31323055 learned_addr learned my addr 172.21.15.82:0/31323055 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:25:19.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.034+0000 7fae9c99a700 1 --2- 172.21.15.82:0/31323055 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d57cbc3500 0x55d57cbc9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:25:19.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.034+0000 7fae9d99c700 1 --2- 172.21.15.82:0/31323055 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d57cbc3e20 0x55d57cbc11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:25:19.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.034+0000 7fae9d19b700 1 -- 172.21.15.82:0/31323055 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d57cbc3500 msgr2=0x55d57cbc9960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:25:19.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.034+0000 7fae9d19b700 1 --2- 172.21.15.82:0/31323055 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d57cbc3500 0x55d57cbc9960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:25:19.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.034+0000 7fae9d19b700 1 -- 172.21.15.82:0/31323055 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d57cbc3e20 msgr2=0x55d57cbc11d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:25:19.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.034+0000 7fae9d19b700 1 --2- 172.21.15.82:0/31323055 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d57cbc3e20 0x55d57cbc11d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:25:19.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.034+0000 7fae9d19b700 1 -- 172.21.15.82:0/31323055 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d57c924c60 con 0x55d57cbbdc40 2023-09-23T09:25:19.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.034+0000 7fae9d19b700 1 --2- 172.21.15.82:0/31323055 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d57cbbdc40 0x55d57cbbd700 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fae94099dd0 tx=0x7fae9400b490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=19eff422c94ad760 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:25:19.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.035+0000 7fae83fff700 1 -- 172.21.15.82:0/31323055 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae940d24b0 con 0x55d57cbbdc40 2023-09-23T09:25:19.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.035+0000 7fae83fff700 1 -- 172.21.15.82:0/31323055 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fae940b1070 con 0x55d57cbbdc40 2023-09-23T09:25:19.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.035+0000 7fae83fff700 1 -- 172.21.15.82:0/31323055 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae94099a30 con 0x55d57cbbdc40 2023-09-23T09:25:19.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.035+0000 7faeb2dfab80 1 -- 172.21.15.82:0/31323055 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d57cbbdc40 msgr2=0x55d57cbbd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:25:19.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.035+0000 7faeb2dfab80 1 --2- 172.21.15.82:0/31323055 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d57cbbdc40 0x55d57cbbd700 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fae94099dd0 tx=0x7fae9400b490 comp rx=0 tx=0).stop 2023-09-23T09:25:19.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.035+0000 7faeb2dfab80 1 -- 172.21.15.82:0/31323055 shutdown_connections 2023-09-23T09:25:19.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.035+0000 7faeb2dfab80 1 --2- 172.21.15.82:0/31323055 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d57cbc3e20 0x55d57cbc11d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:25:19.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.035+0000 7faeb2dfab80 1 --2- 172.21.15.82:0/31323055 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d57cbbdc40 0x55d57cbbd700 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:25:19.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.035+0000 7faeb2dfab80 1 --2- 172.21.15.82:0/31323055 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d57cbc3500 0x55d57cbc9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:25:19.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.035+0000 7faeb2dfab80 1 -- 172.21.15.82:0/31323055 >> 172.21.15.82:0/31323055 conn(0x55d57cb320e0 msgr2=0x55d57cbb22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:25:19.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.036+0000 7faeb2dfab80 1 -- 172.21.15.82:0/31323055 shutdown_connections 2023-09-23T09:25:19.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.036+0000 7faeb2dfab80 1 -- 172.21.15.82:0/31323055 wait complete. 2023-09-23T09:25:19.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.036+0000 7faeb2dfab80 1 -- start start 2023-09-23T09:25:19.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.036+0000 7faeb2dfab80 1 Processor -- start 2023-09-23T09:25:19.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.037+0000 7faeb2dfab80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d57cbbdc40 0x55d57cbc04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:25:19.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.037+0000 7faeb2dfab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d57cbc3500 0x55d57cbbef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:25:19.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.037+0000 7faeb2dfab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d57cbc3e20 0x55d57cbbf4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:25:19.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.037+0000 7faeb2dfab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d57cbc0bb0 con 0x55d57cbc3e20 2023-09-23T09:25:19.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.037+0000 7faeb2dfab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d57cbc0d20 con 0x55d57cbc3500 2023-09-23T09:25:19.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.037+0000 7faeb2dfab80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d57cbbf9e0 con 0x55d57cbbdc40 2023-09-23T09:25:19.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.037+0000 7faeb2dfab80 10 client.0 _ll_register_callbacks cb 0x7fae90009f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:25:19.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.037+0000 7fae9d19b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d57cbbdc40 0x55d57cbc04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:25:19.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.037+0000 7fae9d19b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d57cbbdc40 0x55d57cbc04a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:58252/0 (socket says 172.21.15.82:58252) 2023-09-23T09:25:19.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.037+0000 7fae9d19b700 1 -- 172.21.15.82:0/2764629950 learned_addr learned my addr 172.21.15.82:0/2764629950 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:25:19.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.037+0000 7fae9d99c700 1 --2- 172.21.15.82:0/2764629950 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d57cbc3e20 0x55d57cbbf4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:25:19.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.037+0000 7fae9c99a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d57cbc3500 0x55d57cbbef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:25:19.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.037+0000 7fae9d19b700 1 -- 172.21.15.82:0/2764629950 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d57cbc3500 msgr2=0x55d57cbbef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:25:19.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.037+0000 7fae9d19b700 1 --2- 172.21.15.82:0/2764629950 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d57cbc3500 0x55d57cbbef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:25:19.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.037+0000 7fae9d19b700 1 -- 172.21.15.82:0/2764629950 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d57cbc3e20 msgr2=0x55d57cbbf4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:25:19.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.037+0000 7fae9d19b700 1 --2- 172.21.15.82:0/2764629950 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d57cbc3e20 0x55d57cbbf4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:25:19.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.037+0000 7fae9d19b700 1 -- 172.21.15.82:0/2764629950 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d57c93bde0 con 0x55d57cbbdc40 2023-09-23T09:25:19.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.037+0000 7fae9c99a700 1 --2- 172.21.15.82:0/2764629950 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d57cbc3500 0x55d57cbbef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:25:19.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.038+0000 7fae9d19b700 1 --2- 172.21.15.82:0/2764629950 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d57cbbdc40 0x55d57cbc04a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fae940d1040 tx=0x7fae940962c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9dfd7b0c617be9c server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:25:19.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.038+0000 7fae80ff9700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T09:25:19.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.038+0000 7fae80ff9700 1 -- 172.21.15.82:0/2764629950 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae940d24b0 con 0x55d57cbbdc40 2023-09-23T09:25:19.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.038+0000 7fae80ff9700 1 -- 172.21.15.82:0/2764629950 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(133..133 src has 1..133) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fae9409d050 con 0x55d57cbbdc40 2023-09-23T09:25:19.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.038+0000 7faeb2dfab80 1 -- 172.21.15.82:0/2764629950 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d57cbb08b0 con 0x55d57cbbdc40 2023-09-23T09:25:19.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.038+0000 7fae80ff9700 1 -- 172.21.15.82:0/2764629950 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7fae94022ad0 con 0x55d57cbbdc40 2023-09-23T09:25:19.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.038+0000 7faeb2dfab80 10 client.26878 fetch_fsmap learned FSMap version 78 2023-09-23T09:25:19.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.038+0000 7faeb2dfab80 1 -- 172.21.15.82:0/2764629950 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=78,monmap=4+}) v3 -- 0x55d57c962250 con 0x55d57cbbdc40 2023-09-23T09:25:19.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.039+0000 7fae80ff9700 1 -- 172.21.15.82:0/2764629950 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fae94066020 con 0x55d57cbbdc40 2023-09-23T09:25:19.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.039+0000 7fae80ff9700 1 -- 172.21.15.82:0/2764629950 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 78) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fae94099030 con 0x55d57cbbdc40 2023-09-23T09:25:19.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.039+0000 7faeb2dfab80 10 client.26878 fetch_fsmap finished waiting for FSMap version 78 2023-09-23T09:25:19.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.039+0000 7faeb2dfab80 10 client.26878 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:25:19.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.039+0000 7faeb2dfab80 20 client.26878 populate_metadata read hostname 'smithi082' 2023-09-23T09:25:19.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.039+0000 7faeb2dfab80 1 --2- 172.21.15.82:0/2764629950 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55d57cc2bac0 0x55d57cc2deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:25:19.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.039+0000 7faeb2dfab80 4 client.26878 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:25:19.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.039+0000 7faeb2dfab80 1 -- 172.21.15.82:0/2764629950 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55d57cb08970 con 0x55d57cc2bac0 2023-09-23T09:25:19.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.039+0000 7fae9c99a700 1 --2- 172.21.15.82:0/2764629950 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55d57cc2bac0 0x55d57cc2deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:25:19.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.040+0000 7fae9c99a700 1 --2- 172.21.15.82:0/2764629950 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55d57cc2bac0 0x55d57cc2deb0 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c97915d4332f2a6e server_cookie=79f36d9a5175837f in_seq=0 out_seq=0 2023-09-23T09:25:19.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.040+0000 7fae80ff9700 10 client.26878 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:25:19.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.040+0000 7fae80ff9700 1 -- 172.21.15.82:0/2764629950 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55d57cb08970 con 0x55d57cc2bac0 2023-09-23T09:25:19.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.040+0000 7fae80ff9700 10 client.26878 handle_command_reply: tid=0 2023-09-23T09:25:19.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.040+0000 7faeb2dfab80 1 client.26878 shutdown 2023-09-23T09:25:19.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.040+0000 7faeb2dfab80 1 -- 172.21.15.82:0/2764629950 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d57cbbdc40 msgr2=0x55d57cbc04a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:25:19.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.040+0000 7faeb2dfab80 1 --2- 172.21.15.82:0/2764629950 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d57cbbdc40 0x55d57cbc04a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fae940d1040 tx=0x7fae940962c0 comp rx=0 tx=0).stop 2023-09-23T09:25:19.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.040+0000 7faeb2dfab80 1 -- 172.21.15.82:0/2764629950 shutdown_connections 2023-09-23T09:25:19.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.040+0000 7faeb2dfab80 1 --2- 172.21.15.82:0/2764629950 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55d57cc2bac0 0x55d57cc2deb0 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:25:19.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.040+0000 7faeb2dfab80 1 --2- 172.21.15.82:0/2764629950 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d57cbc3e20 0x55d57cbbf4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:25:19.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.040+0000 7faeb2dfab80 1 --2- 172.21.15.82:0/2764629950 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d57cbbdc40 0x55d57cbc04a0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:25:19.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.040+0000 7fae80ff9700 0 client.26878 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:25:19.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.040+0000 7faeb2dfab80 1 --2- 172.21.15.82:0/2764629950 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d57cbc3500 0x55d57cbbef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:25:19.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.040+0000 7faeb2dfab80 1 -- 172.21.15.82:0/2764629950 >> 172.21.15.82:0/2764629950 conn(0x55d57cb320e0 msgr2=0x55d57cbc11d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:25:19.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.040+0000 7faeb2dfab80 1 -- 172.21.15.82:0/2764629950 shutdown_connections 2023-09-23T09:25:19.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.040+0000 7faeb2dfab80 1 -- 172.21.15.82:0/2764629950 wait complete. 2023-09-23T09:25:19.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.041+0000 7faeb2dfab80 20 client.26878 trim_cache size 0 max 16384 2023-09-23T09:25:19.047 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:25:19.047 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-23T09:25:19.047 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:25:19.048 INFO:teuthology.orchestra.run.smithi082.stdout: "047cbc72-e254-4787-b038-382de9c1a9a4": { 2023-09-23T09:25:19.048 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:25:19.048 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "047cbc72-e254-4787-b038-382de9c1a9a4", 2023-09-23T09:25:19.048 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:25:19.048 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:25:19.048 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:25:19.048 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:25:19.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.041+0000 7fae9e19d700 1 -- 172.21.15.82:0/1159942634 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fae840a0160 msgr2=0x7fae840a2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:25:19.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.041+0000 7fae9e19d700 1 --2- 172.21.15.82:0/1159942634 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fae840a0160 0x7fae840a2620 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fae98074d30 tx=0x7fae90009040 comp rx=0 tx=0).stop 2023-09-23T09:25:19.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.041+0000 7fae9e19d700 1 -- 172.21.15.82:0/1159942634 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae98100730 msgr2=0x7fae98072c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:25:19.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.041+0000 7fae9e19d700 1 --2- 172.21.15.82:0/1159942634 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae98100730 0x7fae98072c20 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fae94005740 tx=0x7fae94005770 comp rx=0 tx=0).stop 2023-09-23T09:25:19.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.041+0000 7fae9e19d700 1 -- 172.21.15.82:0/1159942634 shutdown_connections 2023-09-23T09:25:19.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.041+0000 7fae9e19d700 1 --2- 172.21.15.82:0/1159942634 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fae840a0160 0x7fae840a2620 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:25:19.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.041+0000 7fae9e19d700 1 --2- 172.21.15.82:0/1159942634 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae98106740 0x7fae981a4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:25:19.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.041+0000 7fae9e19d700 1 --2- 172.21.15.82:0/1159942634 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae98100730 0x7fae98072c20 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:25:19.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.041+0000 7fae9e19d700 1 --2- 172.21.15.82:0/1159942634 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fae981010f0 0x7fae98073160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:25:19.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.041+0000 7fae9e19d700 1 -- 172.21.15.82:0/1159942634 >> 172.21.15.82:0/1159942634 conn(0x7fae980fc240 msgr2=0x7fae98104240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:25:19.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.041+0000 7fae9e19d700 1 -- 172.21.15.82:0/1159942634 shutdown_connections 2023-09-23T09:25:19.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:19.041+0000 7fae9e19d700 1 -- 172.21.15.82:0/1159942634 wait complete. 2023-09-23T09:25:19.064 INFO:tasks.cephfs.filesystem:scrub status for tag:047cbc72-e254-4787-b038-382de9c1a9a4 - {'path': '/', 'tag': '047cbc72-e254-4787-b038-382de9c1a9a4', 'options': 'recursive,force'} 2023-09-23T09:25:20.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:25:20 smithi135 ceph-mon[99205]: pgmap v900: 97 pgs: 97 active+clean; 12 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 22 MiB/s wr, 22 op/s 2023-09-23T09:25:20.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:25:20 smithi082 ceph-mon[97694]: pgmap v900: 97 pgs: 97 active+clean; 12 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 22 MiB/s wr, 22 op/s 2023-09-23T09:25:20.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:25:20 smithi161 ceph-mon[99580]: pgmap v900: 97 pgs: 97 active+clean; 12 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 22 MiB/s wr, 22 op/s 2023-09-23T09:25:22.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:25:22 smithi135 ceph-mon[99205]: pgmap v901: 97 pgs: 97 active+clean; 12 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 22 MiB/s wr, 22 op/s 2023-09-23T09:25:22.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:25:22 smithi082 ceph-mon[97694]: pgmap v901: 97 pgs: 97 active+clean; 12 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 22 MiB/s wr, 22 op/s 2023-09-23T09:25:22.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:25:22 smithi161 ceph-mon[99580]: pgmap v901: 97 pgs: 97 active+clean; 12 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 22 MiB/s wr, 22 op/s 2023-09-23T09:25:24.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:25:24 smithi135 ceph-mon[99205]: pgmap v902: 97 pgs: 97 active+clean; 12 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 19 MiB/s wr, 19 op/s 2023-09-23T09:25:24.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:25:24 smithi082 ceph-mon[97694]: pgmap v902: 97 pgs: 97 active+clean; 12 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 19 MiB/s wr, 19 op/s 2023-09-23T09:25:24.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:25:24 smithi161 ceph-mon[99580]: pgmap v902: 97 pgs: 97 active+clean; 12 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 19 MiB/s wr, 19 op/s 2023-09-23T09:25:26.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:25:26 smithi135 ceph-mon[99205]: pgmap v903: 97 pgs: 97 active+clean; 12 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 28 MiB/s wr, 25 op/s 2023-09-23T09:25:26.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:25:26 smithi082 ceph-mon[97694]: pgmap v903: 97 pgs: 97 active+clean; 12 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 28 MiB/s wr, 25 op/s 2023-09-23T09:25:26.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:25:26 smithi161 ceph-mon[99580]: pgmap v903: 97 pgs: 97 active+clean; 12 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 28 MiB/s wr, 25 op/s 2023-09-23T09:25:28.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:25:27 smithi135 ceph-mon[99205]: pgmap v904: 97 pgs: 97 active+clean; 12 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 18 MiB/s wr, 17 op/s 2023-09-23T09:25:28.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:25:27 smithi082 ceph-mon[97694]: pgmap v904: 97 pgs: 97 active+clean; 12 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 18 MiB/s wr, 17 op/s 2023-09-23T09:25:28.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:25:27 smithi161 ceph-mon[99580]: pgmap v904: 97 pgs: 97 active+clean; 12 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 18 MiB/s wr, 17 op/s 2023-09-23T09:25:30.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:25:30 smithi135 ceph-mon[99205]: pgmap v905: 97 pgs: 97 active+clean; 12 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 24 MiB/s wr, 93 op/s 2023-09-23T09:25:30.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:25:30 smithi082 ceph-mon[97694]: pgmap v905: 97 pgs: 97 active+clean; 12 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 24 MiB/s wr, 93 op/s 2023-09-23T09:25:30.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:25:30 smithi161 ceph-mon[99580]: pgmap v905: 97 pgs: 97 active+clean; 12 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 24 MiB/s wr, 93 op/s 2023-09-23T09:25:32.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:25:32 smithi135 ceph-mon[99205]: pgmap v906: 97 pgs: 97 active+clean; 12 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 15 MiB/s wr, 84 op/s 2023-09-23T09:25:32.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:25:32 smithi082 ceph-mon[97694]: pgmap v906: 97 pgs: 97 active+clean; 12 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 15 MiB/s wr, 84 op/s 2023-09-23T09:25:32.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:25:32 smithi161 ceph-mon[99580]: pgmap v906: 97 pgs: 97 active+clean; 12 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 15 MiB/s wr, 84 op/s 2023-09-23T09:25:34.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:25:34 smithi135 ceph-mon[99205]: pgmap v907: 97 pgs: 97 active+clean; 12 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 15 MiB/s wr, 84 op/s 2023-09-23T09:25:34.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:25:34 smithi082 ceph-mon[97694]: pgmap v907: 97 pgs: 97 active+clean; 12 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 15 MiB/s wr, 84 op/s 2023-09-23T09:25:34.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:25:34 smithi161 ceph-mon[99580]: pgmap v907: 97 pgs: 97 active+clean; 12 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 15 MiB/s wr, 84 op/s 2023-09-23T09:25:36.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:25:36 smithi135 ceph-mon[99205]: pgmap v908: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 25 MiB/s wr, 159 op/s 2023-09-23T09:25:36.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:25:36 smithi082 ceph-mon[97694]: pgmap v908: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 25 MiB/s wr, 159 op/s 2023-09-23T09:25:36.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:25:36 smithi161 ceph-mon[99580]: pgmap v908: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 25 MiB/s wr, 159 op/s 2023-09-23T09:25:38.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:25:37 smithi135 ceph-mon[99205]: pgmap v909: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 16 MiB/s wr, 152 op/s 2023-09-23T09:25:38.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:25:37 smithi082 ceph-mon[97694]: pgmap v909: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 16 MiB/s wr, 152 op/s 2023-09-23T09:25:38.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:25:37 smithi161 ceph-mon[99580]: pgmap v909: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 16 MiB/s wr, 152 op/s 2023-09-23T09:25:40.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:25:40 smithi135 ceph-mon[99205]: pgmap v910: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 27 MiB/s wr, 218 op/s 2023-09-23T09:25:40.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:25:40 smithi082 ceph-mon[97694]: pgmap v910: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 27 MiB/s wr, 218 op/s 2023-09-23T09:25:40.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:25:40 smithi161 ceph-mon[99580]: pgmap v910: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 27 MiB/s wr, 218 op/s 2023-09-23T09:25:42.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:25:42 smithi135 ceph-mon[99205]: pgmap v911: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 22 MiB/s wr, 141 op/s 2023-09-23T09:25:42.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:25:42 smithi082 ceph-mon[97694]: pgmap v911: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 22 MiB/s wr, 141 op/s 2023-09-23T09:25:42.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:25:42 smithi161 ceph-mon[99580]: pgmap v911: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 22 MiB/s wr, 141 op/s 2023-09-23T09:25:44.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:25:44 smithi135 ceph-mon[99205]: pgmap v912: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 22 MiB/s wr, 141 op/s 2023-09-23T09:25:44.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:25:44 smithi082 ceph-mon[97694]: pgmap v912: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 22 MiB/s wr, 141 op/s 2023-09-23T09:25:44.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:25:44 smithi161 ceph-mon[99580]: pgmap v912: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 22 MiB/s wr, 141 op/s 2023-09-23T09:25:46.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:25:46 smithi082 ceph-mon[97694]: pgmap v913: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 34 MiB/s wr, 207 op/s 2023-09-23T09:25:46.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:25:46 smithi161 ceph-mon[99580]: pgmap v913: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 34 MiB/s wr, 207 op/s 2023-09-23T09:25:47.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:25:46 smithi135 ceph-mon[99205]: pgmap v913: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 34 MiB/s wr, 207 op/s 2023-09-23T09:25:48.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:25:47 smithi135 ceph-mon[99205]: pgmap v914: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 23 MiB/s wr, 132 op/s 2023-09-23T09:25:48.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:25:47 smithi082 ceph-mon[97694]: pgmap v914: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 23 MiB/s wr, 132 op/s 2023-09-23T09:25:48.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:25:47 smithi161 ceph-mon[99580]: pgmap v914: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 23 MiB/s wr, 132 op/s 2023-09-23T09:25:49.065 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:25:49.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.332+0000 7f55753ff700 1 -- 172.21.15.82:0/2736593832 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f557010d130 msgr2=0x7f557010f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:25:49.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.332+0000 7f55753ff700 1 --2- 172.21.15.82:0/2736593832 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f557010d130 0x7f557010f560 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f5568009f90 tx=0x7f556800b330 comp rx=0 tx=0).stop 2023-09-23T09:25:49.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.332+0000 7f55753ff700 1 -- 172.21.15.82:0/2736593832 shutdown_connections 2023-09-23T09:25:49.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.332+0000 7f55753ff700 1 --2- 172.21.15.82:0/2736593832 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f557010d130 0x7f557010f560 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:25:49.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.332+0000 7f55753ff700 1 --2- 172.21.15.82:0/2736593832 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5570072cf0 0x7f55700730d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:25:49.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.332+0000 7f55753ff700 1 --2- 172.21.15.82:0/2736593832 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5570073610 0x7f557010cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:25:49.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.332+0000 7f55753ff700 1 -- 172.21.15.82:0/2736593832 >> 172.21.15.82:0/2736593832 conn(0x7f55700fc380 msgr2=0x7f55700fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:25:49.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.332+0000 7f55753ff700 1 -- 172.21.15.82:0/2736593832 shutdown_connections 2023-09-23T09:25:49.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.332+0000 7f55753ff700 1 -- 172.21.15.82:0/2736593832 wait complete. 2023-09-23T09:25:49.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.333+0000 7f55753ff700 1 Processor -- start 2023-09-23T09:25:49.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.334+0000 7f55753ff700 1 -- start start 2023-09-23T09:25:49.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.334+0000 7f55753ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5570072cf0 0x7f5570198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:25:49.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.334+0000 7f55753ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5570073610 0x7f5570199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:25:49.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.334+0000 7f55753ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f557010d130 0x7f557019d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:25:49.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.334+0000 7f55753ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f557019dd00 con 0x7f5570072cf0 2023-09-23T09:25:49.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.334+0000 7f55753ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f557019de70 con 0x7f5570073610 2023-09-23T09:25:49.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.334+0000 7f55753ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f557019e030 con 0x7f557010d130 2023-09-23T09:25:49.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.334+0000 7f556effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5570072cf0 0x7f5570198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:25:49.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.334+0000 7f556effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5570072cf0 0x7f5570198d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41278/0 (socket says 172.21.15.82:41278) 2023-09-23T09:25:49.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.334+0000 7f556effd700 1 -- 172.21.15.82:0/419876474 learned_addr learned my addr 172.21.15.82:0/419876474 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:25:49.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.334+0000 7f556e7fc700 1 --2- 172.21.15.82:0/419876474 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5570073610 0x7f5570199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:25:49.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.335+0000 7f556f7fe700 1 --2- 172.21.15.82:0/419876474 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f557010d130 0x7f557019d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:25:49.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.335+0000 7f556effd700 1 -- 172.21.15.82:0/419876474 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f557010d130 msgr2=0x7f557019d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:25:49.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.335+0000 7f556effd700 1 --2- 172.21.15.82:0/419876474 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f557010d130 0x7f557019d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:25:49.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.335+0000 7f556effd700 1 -- 172.21.15.82:0/419876474 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5570073610 msgr2=0x7f5570199260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:25:49.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.335+0000 7f556effd700 1 --2- 172.21.15.82:0/419876474 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5570073610 0x7f5570199260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:25:49.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.335+0000 7f556effd700 1 -- 172.21.15.82:0/419876474 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5568009c40 con 0x7f5570072cf0 2023-09-23T09:25:49.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.335+0000 7f556effd700 1 --2- 172.21.15.82:0/419876474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5570072cf0 0x7f5570198d20 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f556000e9c0 tx=0x7f556000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:25:49.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.335+0000 7f5557fff700 1 -- 172.21.15.82:0/419876474 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5560004a30 con 0x7f5570072cf0 2023-09-23T09:25:49.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.335+0000 7f5557fff700 1 -- 172.21.15.82:0/419876474 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f556000cc50 con 0x7f5570072cf0 2023-09-23T09:25:49.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.335+0000 7f55753ff700 1 -- 172.21.15.82:0/419876474 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f557019e310 con 0x7f5570072cf0 2023-09-23T09:25:49.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.335+0000 7f5557fff700 1 -- 172.21.15.82:0/419876474 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5560005410 con 0x7f5570072cf0 2023-09-23T09:25:49.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.336+0000 7f55753ff700 1 -- 172.21.15.82:0/419876474 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55701a5b50 con 0x7f5570072cf0 2023-09-23T09:25:49.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.339+0000 7f5557fff700 1 -- 172.21.15.82:0/419876474 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f5560005570 con 0x7f5570072cf0 2023-09-23T09:25:49.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.340+0000 7f5588c2bb80 1 Processor -- start 2023-09-23T09:25:49.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.341+0000 7f5588c2bb80 1 -- start start 2023-09-23T09:25:49.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.341+0000 7f5588c2bb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad629ea380 0x55ad629ea760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:25:49.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.341+0000 7f5557fff700 1 --2- 172.21.15.82:0/419876474 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f55580a00c0 0x7f55580a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:25:49.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.341+0000 7f5588c2bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ad629eaca0 0x55ad629e4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:25:49.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.341+0000 7f5588c2bb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ad629e4c40 0x55ad629e50a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:25:49.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.341+0000 7f5588c2bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad6294c7b0 con 0x55ad629eaca0 2023-09-23T09:25:49.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.341+0000 7f5588c2bb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad6293d780 con 0x55ad629ea380 2023-09-23T09:25:49.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.341+0000 7f5588c2bb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad6293b0a0 con 0x55ad629e4c40 2023-09-23T09:25:49.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.341+0000 7f5557fff700 1 -- 172.21.15.82:0/419876474 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f5560014070 con 0x7f5570072cf0 2023-09-23T09:25:49.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.341+0000 7f556e7fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ad629eaca0 0x55ad629e4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:25:49.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.341+0000 7f556e7fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ad629eaca0 0x55ad629e4700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41286/0 (socket says 172.21.15.82:41286) 2023-09-23T09:25:49.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.341+0000 7f556effd700 1 --2- 172.21.15.82:0/419876474 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f55580a00c0 0x7f55580a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:25:49.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.341+0000 7f556e7fc700 1 -- 172.21.15.82:0/1797730828 learned_addr learned my addr 172.21.15.82:0/1797730828 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:25:49.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.341+0000 7f556f7fe700 1 --2- 172.21.15.82:0/1797730828 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad629ea380 0x55ad629ea760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:25:49.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.341+0000 7f556f7fe700 1 --2- 172.21.15.82:0/1797730828 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ad629e4c40 0x55ad629e50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:25:49.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.342+0000 7f556e7fc700 1 -- 172.21.15.82:0/1797730828 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ad629e4c40 msgr2=0x55ad629e50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:25:49.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.342+0000 7f556e7fc700 1 --2- 172.21.15.82:0/1797730828 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ad629e4c40 0x55ad629e50a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:25:49.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.342+0000 7f556e7fc700 1 -- 172.21.15.82:0/1797730828 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad629ea380 msgr2=0x55ad629ea760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:25:49.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.342+0000 7f556e7fc700 1 --2- 172.21.15.82:0/1797730828 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad629ea380 0x55ad629ea760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:25:49.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.342+0000 7f556e7fc700 1 -- 172.21.15.82:0/1797730828 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ad627b6630 con 0x55ad629eaca0 2023-09-23T09:25:49.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.342+0000 7f556f7fe700 1 --2- 172.21.15.82:0/1797730828 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad629ea380 0x55ad629ea760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:25:49.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.342+0000 7f556effd700 1 --2- 172.21.15.82:0/419876474 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f55580a00c0 0x7f55580a2580 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5560000c00 tx=0x7f5560005820 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:25:49.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.342+0000 7f556e7fc700 1 --2- 172.21.15.82:0/1797730828 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ad629eaca0 0x55ad629e4700 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f5564009ca0 tx=0x7f5564011440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc51cced4b859383 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:25:49.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.342+0000 7f55557fa700 1 -- 172.21.15.82:0/1797730828 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5564011d80 con 0x55ad629eaca0 2023-09-23T09:25:49.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.342+0000 7f55557fa700 1 -- 172.21.15.82:0/1797730828 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5564004cc0 con 0x55ad629eaca0 2023-09-23T09:25:49.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.343+0000 7f55557fa700 1 -- 172.21.15.82:0/1797730828 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5564019430 con 0x55ad629eaca0 2023-09-23T09:25:49.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.343+0000 7f5588c2bb80 1 -- 172.21.15.82:0/1797730828 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ad629eaca0 msgr2=0x55ad629e4700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:25:49.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.343+0000 7f5588c2bb80 1 --2- 172.21.15.82:0/1797730828 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ad629eaca0 0x55ad629e4700 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f5564009ca0 tx=0x7f5564011440 comp rx=0 tx=0).stop 2023-09-23T09:25:49.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.343+0000 7f5588c2bb80 1 -- 172.21.15.82:0/1797730828 shutdown_connections 2023-09-23T09:25:49.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.343+0000 7f5588c2bb80 1 --2- 172.21.15.82:0/1797730828 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ad629e4c40 0x55ad629e50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:25:49.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.343+0000 7f5588c2bb80 1 --2- 172.21.15.82:0/1797730828 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad629ea380 0x55ad629ea760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:25:49.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.343+0000 7f5588c2bb80 1 --2- 172.21.15.82:0/1797730828 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ad629eaca0 0x55ad629e4700 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:25:49.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.343+0000 7f5588c2bb80 1 -- 172.21.15.82:0/1797730828 >> 172.21.15.82:0/1797730828 conn(0x55ad629590e0 msgr2=0x55ad629df410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:25:49.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.344+0000 7f5588c2bb80 1 -- 172.21.15.82:0/1797730828 shutdown_connections 2023-09-23T09:25:49.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.344+0000 7f5588c2bb80 1 -- 172.21.15.82:0/1797730828 wait complete. 2023-09-23T09:25:49.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.344+0000 7f5588c2bb80 1 -- start start 2023-09-23T09:25:49.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.344+0000 7f5588c2bb80 1 Processor -- start 2023-09-23T09:25:49.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.345+0000 7f5588c2bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ad629e4c40 0x55ad629f0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:25:49.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.345+0000 7f5588c2bb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ad629ea380 0x55ad629eded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:25:49.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.345+0000 7f5588c2bb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad629eaca0 0x55ad629ee610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:25:49.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.345+0000 7f5588c2bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad62936990 con 0x55ad629e4c40 2023-09-23T09:25:49.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.345+0000 7f5588c2bb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad628d4bb0 con 0x55ad629eaca0 2023-09-23T09:25:49.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.345+0000 7f5588c2bb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad628d48b0 con 0x55ad629ea380 2023-09-23T09:25:49.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.345+0000 7f5588c2bb80 10 client.0 _ll_register_callbacks cb 0x55ad6281ea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:25:49.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.345+0000 7f556f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ad629e4c40 0x55ad629f0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:25:49.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.345+0000 7f556f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ad629e4c40 0x55ad629f0c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41298/0 (socket says 172.21.15.82:41298) 2023-09-23T09:25:49.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.345+0000 7f556f7fe700 1 -- 172.21.15.82:0/2050483186 learned_addr learned my addr 172.21.15.82:0/2050483186 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:25:49.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.345+0000 7f556e7fc700 1 --2- 172.21.15.82:0/2050483186 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ad629ea380 0x55ad629eded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:25:49.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.345+0000 7f556f7fe700 1 --2- 172.21.15.82:0/2050483186 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad629eaca0 0x55ad629ee610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:25:49.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.346+0000 7f556f7fe700 1 -- 172.21.15.82:0/2050483186 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ad629ea380 msgr2=0x55ad629eded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:25:49.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.346+0000 7f556f7fe700 1 --2- 172.21.15.82:0/2050483186 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ad629ea380 0x55ad629eded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:25:49.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.346+0000 7f556f7fe700 1 -- 172.21.15.82:0/2050483186 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad629eaca0 msgr2=0x55ad629ee610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:25:49.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.346+0000 7f556f7fe700 1 --2- 172.21.15.82:0/2050483186 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad629eaca0 0x55ad629ee610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:25:49.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.346+0000 7f556f7fe700 1 -- 172.21.15.82:0/2050483186 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5570110270 con 0x55ad629e4c40 2023-09-23T09:25:49.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.346+0000 7f556f7fe700 1 --2- 172.21.15.82:0/2050483186 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ad629e4c40 0x55ad629f0c50 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f55680094d0 tx=0x7f556800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c17a42f17d9d0a4 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:25:49.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.346+0000 7f5552ff5700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:25:49.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.346+0000 7f5552ff5700 1 -- 172.21.15.82:0/2050483186 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f556800e040 con 0x55ad629e4c40 2023-09-23T09:25:49.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.347+0000 7f5588c2bb80 1 -- 172.21.15.82:0/2050483186 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ad629b41c0 con 0x55ad629e4c40 2023-09-23T09:25:49.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.347+0000 7f5552ff5700 1 -- 172.21.15.82:0/2050483186 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(133..133 src has 1..133) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f556800be30 con 0x55ad629e4c40 2023-09-23T09:25:49.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.347+0000 7f5552ff5700 1 -- 172.21.15.82:0/2050483186 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5568003c00 con 0x55ad629e4c40 2023-09-23T09:25:49.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.347+0000 7f5588c2bb80 10 client.17163 fetch_fsmap learned FSMap version 78 2023-09-23T09:25:49.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.347+0000 7f5588c2bb80 1 -- 172.21.15.82:0/2050483186 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=78,monmap=4+}) v3 -- 0x7f5564009900 con 0x55ad629e4c40 2023-09-23T09:25:49.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.347+0000 7f5552ff5700 1 -- 172.21.15.82:0/2050483186 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5568030080 con 0x55ad629e4c40 2023-09-23T09:25:49.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.347+0000 7f5552ff5700 1 -- 172.21.15.82:0/2050483186 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 78) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f5568019040 con 0x55ad629e4c40 2023-09-23T09:25:49.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.347+0000 7f5588c2bb80 10 client.17163 fetch_fsmap finished waiting for FSMap version 78 2023-09-23T09:25:49.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.347+0000 7f5588c2bb80 10 client.17163 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:25:49.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.347+0000 7f5588c2bb80 20 client.17163 populate_metadata read hostname 'smithi082' 2023-09-23T09:25:49.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.347+0000 7f5588c2bb80 1 --2- 172.21.15.82:0/2050483186 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55ad629fe680 0x55ad62a00aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:25:49.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.347+0000 7f5588c2bb80 4 client.17163 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:25:49.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.347+0000 7f5588c2bb80 1 -- 172.21.15.82:0/2050483186 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ad628dcba0 con 0x55ad629fe680 2023-09-23T09:25:49.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.348+0000 7f556e7fc700 1 --2- 172.21.15.82:0/2050483186 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55ad629fe680 0x55ad62a00aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:25:49.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.348+0000 7f556e7fc700 1 --2- 172.21.15.82:0/2050483186 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55ad629fe680 0x55ad62a00aa0 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a952be334941ce9d server_cookie=c3ff472f493afa1e in_seq=0 out_seq=0 2023-09-23T09:25:49.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.348+0000 7f5552ff5700 10 client.17163 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:25:49.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.349+0000 7f5552ff5700 1 -- 172.21.15.82:0/2050483186 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55ad628dcba0 con 0x55ad629fe680 2023-09-23T09:25:49.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.349+0000 7f5552ff5700 10 client.17163 handle_command_reply: tid=0 2023-09-23T09:25:49.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.349+0000 7f5588c2bb80 1 client.17163 shutdown 2023-09-23T09:25:49.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.349+0000 7f5588c2bb80 1 -- 172.21.15.82:0/2050483186 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ad629e4c40 msgr2=0x55ad629f0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:25:49.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.349+0000 7f5588c2bb80 1 --2- 172.21.15.82:0/2050483186 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ad629e4c40 0x55ad629f0c50 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f55680094d0 tx=0x7f556800b330 comp rx=0 tx=0).stop 2023-09-23T09:25:49.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.349+0000 7f5588c2bb80 1 -- 172.21.15.82:0/2050483186 shutdown_connections 2023-09-23T09:25:49.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.349+0000 7f5588c2bb80 1 --2- 172.21.15.82:0/2050483186 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad629eaca0 0x55ad629ee610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:25:49.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.349+0000 7f5588c2bb80 1 --2- 172.21.15.82:0/2050483186 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55ad629fe680 0x55ad62a00aa0 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:25:49.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.349+0000 7f5588c2bb80 1 --2- 172.21.15.82:0/2050483186 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ad629e4c40 0x55ad629f0c50 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:25:49.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.349+0000 7f5588c2bb80 1 --2- 172.21.15.82:0/2050483186 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ad629ea380 0x55ad629eded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:25:49.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.349+0000 7f5552ff5700 0 client.17163 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:25:49.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.349+0000 7f5588c2bb80 1 -- 172.21.15.82:0/2050483186 >> 172.21.15.82:0/2050483186 conn(0x55ad629590e0 msgr2=0x55ad629d9b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:25:49.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.350+0000 7f5588c2bb80 1 -- 172.21.15.82:0/2050483186 shutdown_connections 2023-09-23T09:25:49.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.350+0000 7f5588c2bb80 1 -- 172.21.15.82:0/2050483186 wait complete. 2023-09-23T09:25:49.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.350+0000 7f5588c2bb80 20 client.17163 trim_cache size 0 max 16384 2023-09-23T09:25:49.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.370+0000 7f5588c2bb80 1 Processor -- start 2023-09-23T09:25:49.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.370+0000 7f5588c2bb80 1 -- start start 2023-09-23T09:25:49.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.370+0000 7f5588c2bb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ad629e4c40 0x55ad62a00a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:25:49.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.370+0000 7f5588c2bb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad629ea380 0x55ad629df1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:25:49.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.371+0000 7f5588c2bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ad629eaca0 0x55ad629f0780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:25:49.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.371+0000 7f5588c2bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad627b8920 con 0x55ad629eaca0 2023-09-23T09:25:49.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.371+0000 7f5588c2bb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad629ea020 con 0x55ad629ea380 2023-09-23T09:25:49.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.371+0000 7f5588c2bb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad629e4750 con 0x55ad629e4c40 2023-09-23T09:25:49.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.371+0000 7f556f7fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ad629e4c40 0x55ad62a00a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:25:49.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.371+0000 7f556f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ad629eaca0 0x55ad629f0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:25:49.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.371+0000 7f556f7fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ad629e4c40 0x55ad62a00a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:50356/0 (socket says 172.21.15.82:50356) 2023-09-23T09:25:49.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.371+0000 7f556f7fe700 1 -- 172.21.15.82:0/2461472127 learned_addr learned my addr 172.21.15.82:0/2461472127 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:25:49.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.371+0000 7f556e7fc700 1 --2- 172.21.15.82:0/2461472127 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad629ea380 0x55ad629df1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:25:49.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.371+0000 7f556f7fe700 1 -- 172.21.15.82:0/2461472127 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad629ea380 msgr2=0x55ad629df1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:25:49.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.371+0000 7f556f7fe700 1 --2- 172.21.15.82:0/2461472127 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad629ea380 0x55ad629df1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:25:49.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.371+0000 7f556f7fe700 1 -- 172.21.15.82:0/2461472127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ad629eaca0 msgr2=0x55ad629f0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:25:49.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.371+0000 7f556f7fe700 1 --2- 172.21.15.82:0/2461472127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ad629eaca0 0x55ad629f0780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:25:49.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.371+0000 7f556f7fe700 1 -- 172.21.15.82:0/2461472127 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ad62762de0 con 0x55ad629e4c40 2023-09-23T09:25:49.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.372+0000 7f556f7fe700 1 --2- 172.21.15.82:0/2461472127 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ad629e4c40 0x55ad62a00a70 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5568009f90 tx=0x7f5568009ac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0c6ffda4e75351f server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:25:49.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.372+0000 7f5555ffb700 1 -- 172.21.15.82:0/2461472127 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f556800e040 con 0x55ad629e4c40 2023-09-23T09:25:49.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.372+0000 7f5555ffb700 1 -- 172.21.15.82:0/2461472127 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55ad629b41c0 con 0x55ad629e4c40 2023-09-23T09:25:49.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.372+0000 7f5555ffb700 1 -- 172.21.15.82:0/2461472127 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5568005110 con 0x55ad629e4c40 2023-09-23T09:25:49.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.373+0000 7f5588c2bb80 1 -- 172.21.15.82:0/2461472127 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ad629e4c40 msgr2=0x55ad62a00a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:25:49.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.373+0000 7f5588c2bb80 1 --2- 172.21.15.82:0/2461472127 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ad629e4c40 0x55ad62a00a70 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5568009f90 tx=0x7f5568009ac0 comp rx=0 tx=0).stop 2023-09-23T09:25:49.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.373+0000 7f5588c2bb80 1 -- 172.21.15.82:0/2461472127 shutdown_connections 2023-09-23T09:25:49.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.373+0000 7f5588c2bb80 1 --2- 172.21.15.82:0/2461472127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ad629eaca0 0x55ad629f0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:25:49.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.373+0000 7f5588c2bb80 1 --2- 172.21.15.82:0/2461472127 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ad629e4c40 0x55ad62a00a70 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:25:49.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.373+0000 7f5588c2bb80 1 --2- 172.21.15.82:0/2461472127 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad629ea380 0x55ad629df1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:25:49.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.373+0000 7f5588c2bb80 1 -- 172.21.15.82:0/2461472127 >> 172.21.15.82:0/2461472127 conn(0x55ad629590e0 msgr2=0x55ad629d8b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:25:49.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.373+0000 7f5588c2bb80 1 -- 172.21.15.82:0/2461472127 shutdown_connections 2023-09-23T09:25:49.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.373+0000 7f5588c2bb80 1 -- 172.21.15.82:0/2461472127 wait complete. 2023-09-23T09:25:49.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.373+0000 7f5588c2bb80 1 -- start start 2023-09-23T09:25:49.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.373+0000 7f5588c2bb80 1 Processor -- start 2023-09-23T09:25:49.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.374+0000 7f5588c2bb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad629e4c40 0x55ad629e7410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:25:49.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.374+0000 7f5588c2bb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ad629ea380 0x55ad629e5e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:25:49.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.374+0000 7f5588c2bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ad629eaca0 0x55ad629e6340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:25:49.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.374+0000 7f5588c2bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad629e7b20 con 0x55ad629eaca0 2023-09-23T09:25:49.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.374+0000 7f5588c2bb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad629e6880 con 0x55ad629e4c40 2023-09-23T09:25:49.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.374+0000 7f5588c2bb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad629e6a40 con 0x55ad629ea380 2023-09-23T09:25:49.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.374+0000 7f5588c2bb80 10 client.0 _ll_register_callbacks cb 0x55ad6281ea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:25:49.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.375+0000 7f556e7fc700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ad629ea380 0x55ad629e5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:25:49.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.375+0000 7f556f7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad629e4c40 0x55ad629e7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:25:49.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.375+0000 7f556e7fc700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ad629ea380 0x55ad629e5e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:50370/0 (socket says 172.21.15.82:50370) 2023-09-23T09:25:49.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.375+0000 7f556f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ad629eaca0 0x55ad629e6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:25:49.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.375+0000 7f556e7fc700 1 -- 172.21.15.82:0/706764318 learned_addr learned my addr 172.21.15.82:0/706764318 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:25:49.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.375+0000 7f556e7fc700 1 -- 172.21.15.82:0/706764318 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad629e4c40 msgr2=0x55ad629e7410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:25:49.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.375+0000 7f556e7fc700 1 --2- 172.21.15.82:0/706764318 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad629e4c40 0x55ad629e7410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:25:49.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.375+0000 7f556e7fc700 1 -- 172.21.15.82:0/706764318 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ad629eaca0 msgr2=0x55ad629e6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:25:49.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.375+0000 7f556e7fc700 1 --2- 172.21.15.82:0/706764318 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ad629eaca0 0x55ad629e6340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:25:49.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.375+0000 7f556e7fc700 1 -- 172.21.15.82:0/706764318 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5564009900 con 0x55ad629ea380 2023-09-23T09:25:49.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.375+0000 7f556e7fc700 1 --2- 172.21.15.82:0/706764318 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ad629ea380 0x55ad629e5e00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x55ad629eb100 tx=0x7f55640058e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=abb298ce05d766b server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:25:49.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.375+0000 7f5552ff5700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T09:25:49.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.376+0000 7f5552ff5700 1 -- 172.21.15.82:0/706764318 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55640055b0 con 0x55ad629ea380 2023-09-23T09:25:49.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.376+0000 7f5588c2bb80 1 -- 172.21.15.82:0/706764318 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ad629d78b0 con 0x55ad629ea380 2023-09-23T09:25:49.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.376+0000 7f5552ff5700 1 -- 172.21.15.82:0/706764318 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(133..133 src has 1..133) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f5564003680 con 0x55ad629ea380 2023-09-23T09:25:49.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.376+0000 7f5552ff5700 1 -- 172.21.15.82:0/706764318 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5564005710 con 0x55ad629ea380 2023-09-23T09:25:49.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.376+0000 7f5588c2bb80 10 client.26896 fetch_fsmap learned FSMap version 78 2023-09-23T09:25:49.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.376+0000 7f5588c2bb80 1 -- 172.21.15.82:0/706764318 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=78,monmap=4+}) v3 -- 0x55ad6274bc60 con 0x55ad629ea380 2023-09-23T09:25:49.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.376+0000 7f5552ff5700 1 -- 172.21.15.82:0/706764318 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f556403e020 con 0x55ad629ea380 2023-09-23T09:25:49.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.377+0000 7f5552ff5700 1 -- 172.21.15.82:0/706764318 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 78) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f5564009cd0 con 0x55ad629ea380 2023-09-23T09:25:49.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.377+0000 7f5588c2bb80 10 client.26896 fetch_fsmap finished waiting for FSMap version 78 2023-09-23T09:25:49.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.377+0000 7f5588c2bb80 10 client.26896 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:25:49.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.377+0000 7f5588c2bb80 20 client.26896 populate_metadata read hostname 'smithi082' 2023-09-23T09:25:49.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.377+0000 7f5588c2bb80 1 --2- 172.21.15.82:0/706764318 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55ad62a53730 0x55ad62a55b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:25:49.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.377+0000 7f5588c2bb80 4 client.26896 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:25:49.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.377+0000 7f5588c2bb80 1 -- 172.21.15.82:0/706764318 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55ad6292f970 con 0x55ad62a53730 2023-09-23T09:25:49.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.377+0000 7f556f7fe700 1 --2- 172.21.15.82:0/706764318 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55ad62a53730 0x55ad62a55b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:25:49.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.378+0000 7f556f7fe700 1 --2- 172.21.15.82:0/706764318 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55ad62a53730 0x55ad62a55b50 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fbc315831a6a56e5 server_cookie=5ce812f09cc83290 in_seq=0 out_seq=0 2023-09-23T09:25:49.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.378+0000 7f5552ff5700 10 client.26896 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:25:49.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.378+0000 7f5552ff5700 1 -- 172.21.15.82:0/706764318 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55ad6292f970 con 0x55ad62a53730 2023-09-23T09:25:49.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.378+0000 7f5552ff5700 10 client.26896 handle_command_reply: tid=0 2023-09-23T09:25:49.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.378+0000 7f5588c2bb80 1 client.26896 shutdown 2023-09-23T09:25:49.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.378+0000 7f5588c2bb80 1 -- 172.21.15.82:0/706764318 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ad629ea380 msgr2=0x55ad629e5e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:25:49.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.378+0000 7f5588c2bb80 1 --2- 172.21.15.82:0/706764318 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ad629ea380 0x55ad629e5e00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x55ad629eb100 tx=0x7f55640058e0 comp rx=0 tx=0).stop 2023-09-23T09:25:49.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.378+0000 7f5588c2bb80 1 -- 172.21.15.82:0/706764318 shutdown_connections 2023-09-23T09:25:49.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.378+0000 7f5588c2bb80 1 --2- 172.21.15.82:0/706764318 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55ad62a53730 0x55ad62a55b50 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:25:49.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.378+0000 7f5588c2bb80 1 --2- 172.21.15.82:0/706764318 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ad629eaca0 0x55ad629e6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:25:49.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.378+0000 7f5588c2bb80 1 --2- 172.21.15.82:0/706764318 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad629e4c40 0x55ad629e7410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:25:49.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.378+0000 7f5552ff5700 0 client.26896 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:25:49.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.378+0000 7f5588c2bb80 1 --2- 172.21.15.82:0/706764318 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ad629ea380 0x55ad629e5e00 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:25:49.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.378+0000 7f5588c2bb80 1 -- 172.21.15.82:0/706764318 >> 172.21.15.82:0/706764318 conn(0x55ad629590e0 msgr2=0x55ad629df0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:25:49.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.378+0000 7f5588c2bb80 1 -- 172.21.15.82:0/706764318 shutdown_connections 2023-09-23T09:25:49.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.378+0000 7f5588c2bb80 1 -- 172.21.15.82:0/706764318 wait complete. 2023-09-23T09:25:49.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.378+0000 7f5588c2bb80 20 client.26896 trim_cache size 0 max 16384 2023-09-23T09:25:49.385 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:25:49.385 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-23T09:25:49.386 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:25:49.386 INFO:teuthology.orchestra.run.smithi082.stdout: "047cbc72-e254-4787-b038-382de9c1a9a4": { 2023-09-23T09:25:49.386 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:25:49.386 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "047cbc72-e254-4787-b038-382de9c1a9a4", 2023-09-23T09:25:49.386 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:25:49.386 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:25:49.386 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:25:49.386 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:25:49.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.379+0000 7f55753ff700 1 -- 172.21.15.82:0/419876474 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f55580a00c0 msgr2=0x7f55580a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:25:49.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.379+0000 7f55753ff700 1 --2- 172.21.15.82:0/419876474 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f55580a00c0 0x7f55580a2580 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5560000c00 tx=0x7f5560005820 comp rx=0 tx=0).stop 2023-09-23T09:25:49.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.379+0000 7f55753ff700 1 -- 172.21.15.82:0/419876474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5570072cf0 msgr2=0x7f5570198d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:25:49.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.379+0000 7f55753ff700 1 --2- 172.21.15.82:0/419876474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5570072cf0 0x7f5570198d20 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f556000e9c0 tx=0x7f556000ecd0 comp rx=0 tx=0).stop 2023-09-23T09:25:49.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.379+0000 7f55753ff700 1 -- 172.21.15.82:0/419876474 shutdown_connections 2023-09-23T09:25:49.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.379+0000 7f55753ff700 1 --2- 172.21.15.82:0/419876474 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f55580a00c0 0x7f55580a2580 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:25:49.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.379+0000 7f55753ff700 1 --2- 172.21.15.82:0/419876474 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f557010d130 0x7f557019d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:25:49.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.379+0000 7f55753ff700 1 --2- 172.21.15.82:0/419876474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5570072cf0 0x7f5570198d20 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:25:49.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.379+0000 7f55753ff700 1 --2- 172.21.15.82:0/419876474 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5570073610 0x7f5570199260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:25:49.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.379+0000 7f55753ff700 1 -- 172.21.15.82:0/419876474 >> 172.21.15.82:0/419876474 conn(0x7f55700fc380 msgr2=0x7f557010f2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:25:49.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.379+0000 7f55753ff700 1 -- 172.21.15.82:0/419876474 shutdown_connections 2023-09-23T09:25:49.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:25:49.379+0000 7f55753ff700 1 -- 172.21.15.82:0/419876474 wait complete. 2023-09-23T09:25:49.403 INFO:tasks.cephfs.filesystem:scrub status for tag:047cbc72-e254-4787-b038-382de9c1a9a4 - {'path': '/', 'tag': '047cbc72-e254-4787-b038-382de9c1a9a4', 'options': 'recursive,force'} 2023-09-23T09:25:50.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:25:50 smithi135 ceph-mon[99205]: pgmap v915: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 35 MiB/s wr, 204 op/s 2023-09-23T09:25:50.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:25:50 smithi082 ceph-mon[97694]: pgmap v915: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 35 MiB/s wr, 204 op/s 2023-09-23T09:25:50.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:25:50 smithi161 ceph-mon[99580]: pgmap v915: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 35 MiB/s wr, 204 op/s 2023-09-23T09:25:52.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:25:52 smithi135 ceph-mon[99205]: pgmap v916: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 23 MiB/s wr, 137 op/s 2023-09-23T09:25:52.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:25:52 smithi082 ceph-mon[97694]: pgmap v916: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 23 MiB/s wr, 137 op/s 2023-09-23T09:25:52.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:25:52 smithi161 ceph-mon[99580]: pgmap v916: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 23 MiB/s wr, 137 op/s 2023-09-23T09:25:54.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:25:54 smithi082 ceph-mon[97694]: pgmap v917: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 23 MiB/s wr, 137 op/s 2023-09-23T09:25:54.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:25:54 smithi161 ceph-mon[99580]: pgmap v917: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 23 MiB/s wr, 137 op/s 2023-09-23T09:25:55.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:25:54 smithi135 ceph-mon[99205]: pgmap v917: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 23 MiB/s wr, 137 op/s 2023-09-23T09:25:56.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:25:56 smithi082 ceph-mon[97694]: pgmap v918: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 27 MiB/s wr, 164 op/s 2023-09-23T09:25:56.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:25:56 smithi161 ceph-mon[99580]: pgmap v918: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 27 MiB/s wr, 164 op/s 2023-09-23T09:25:57.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:25:56 smithi135 ceph-mon[99205]: pgmap v918: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 27 MiB/s wr, 164 op/s 2023-09-23T09:25:58.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:25:57 smithi135 ceph-mon[99205]: pgmap v919: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 15 MiB/s wr, 98 op/s 2023-09-23T09:25:58.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:25:57 smithi082 ceph-mon[97694]: pgmap v919: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 15 MiB/s wr, 98 op/s 2023-09-23T09:25:58.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:25:57 smithi161 ceph-mon[99580]: pgmap v919: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 15 MiB/s wr, 98 op/s 2023-09-23T09:26:00.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:26:00 smithi135 ceph-mon[99205]: pgmap v920: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 19 MiB/s wr, 132 op/s 2023-09-23T09:26:00.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:26:00 smithi082 ceph-mon[97694]: pgmap v920: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 19 MiB/s wr, 132 op/s 2023-09-23T09:26:00.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:26:00 smithi161 ceph-mon[99580]: pgmap v920: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 19 MiB/s wr, 132 op/s 2023-09-23T09:26:02.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:26:02 smithi082 ceph-mon[97694]: pgmap v921: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 7.5 MiB/s wr, 60 op/s 2023-09-23T09:26:02.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:26:02 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:26:02.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:26:02 smithi161 ceph-mon[99580]: pgmap v921: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 7.5 MiB/s wr, 60 op/s 2023-09-23T09:26:02.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:26:02 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:26:03.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:26:02 smithi135 ceph-mon[99205]: pgmap v921: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 7.5 MiB/s wr, 60 op/s 2023-09-23T09:26:03.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:26:02 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:26:03.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:26:03 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:26:03.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:26:03 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:26:03.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:26:03 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:26:03.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:26:03 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:26:03.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:26:03 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:26:03.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:26:03 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:26:04.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:26:03 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:26:04.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:26:03 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:26:04.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:26:03 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:26:04.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:26:04 smithi082 ceph-mon[97694]: pgmap v922: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 7.5 MiB/s wr, 60 op/s 2023-09-23T09:26:04.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:26:04 smithi161 ceph-mon[99580]: pgmap v922: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 7.5 MiB/s wr, 60 op/s 2023-09-23T09:26:05.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:26:04 smithi135 ceph-mon[99205]: pgmap v922: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 7.5 MiB/s wr, 60 op/s 2023-09-23T09:26:06.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:26:06 smithi082 ceph-mon[97694]: pgmap v923: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 12 MiB/s wr, 110 op/s 2023-09-23T09:26:06.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:26:06 smithi161 ceph-mon[99580]: pgmap v923: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 12 MiB/s wr, 110 op/s 2023-09-23T09:26:07.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:26:06 smithi135 ceph-mon[99205]: pgmap v923: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 12 MiB/s wr, 110 op/s 2023-09-23T09:26:07.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:26:07 smithi082 ceph-mon[97694]: osdmap e134: 12 total, 12 up, 12 in 2023-09-23T09:26:07.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:26:07 smithi161 ceph-mon[99580]: osdmap e134: 12 total, 12 up, 12 in 2023-09-23T09:26:08.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:26:07 smithi135 ceph-mon[99205]: osdmap e134: 12 total, 12 up, 12 in 2023-09-23T09:26:08.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:26:08 smithi082 ceph-mon[97694]: pgmap v925: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 9.8 MiB/s wr, 100 op/s 2023-09-23T09:26:08.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:26:08 smithi161 ceph-mon[99580]: pgmap v925: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 9.8 MiB/s wr, 100 op/s 2023-09-23T09:26:09.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:26:08 smithi135 ceph-mon[99205]: pgmap v925: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 9.8 MiB/s wr, 100 op/s 2023-09-23T09:26:10.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:26:10 smithi082 ceph-mon[97694]: pgmap v926: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 13 MiB/s wr, 108 op/s 2023-09-23T09:26:10.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:26:10 smithi161 ceph-mon[99580]: pgmap v926: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 13 MiB/s wr, 108 op/s 2023-09-23T09:26:11.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:26:10 smithi135 ceph-mon[99205]: pgmap v926: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 13 MiB/s wr, 108 op/s 2023-09-23T09:26:12.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:26:12 smithi082 ceph-mon[97694]: pgmap v927: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 13 MiB/s wr, 108 op/s 2023-09-23T09:26:12.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:26:12 smithi082 ceph-mon[97694]: osdmap e135: 12 total, 12 up, 12 in 2023-09-23T09:26:12.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:26:12 smithi161 ceph-mon[99580]: pgmap v927: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 13 MiB/s wr, 108 op/s 2023-09-23T09:26:12.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:26:12 smithi161 ceph-mon[99580]: osdmap e135: 12 total, 12 up, 12 in 2023-09-23T09:26:13.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:26:12 smithi135 ceph-mon[99205]: pgmap v927: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 13 MiB/s wr, 108 op/s 2023-09-23T09:26:13.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:26:12 smithi135 ceph-mon[99205]: osdmap e135: 12 total, 12 up, 12 in 2023-09-23T09:26:14.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:26:14 smithi082 ceph-mon[97694]: pgmap v929: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 9.1 MiB/s wr, 60 op/s 2023-09-23T09:26:14.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:26:14 smithi161 ceph-mon[99580]: pgmap v929: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 9.1 MiB/s wr, 60 op/s 2023-09-23T09:26:15.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:26:14 smithi135 ceph-mon[99205]: pgmap v929: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 9.1 MiB/s wr, 60 op/s 2023-09-23T09:26:16.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:26:16 smithi082 ceph-mon[97694]: pgmap v930: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 12 MiB/s wr, 84 op/s 2023-09-23T09:26:16.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:26:16 smithi161 ceph-mon[99580]: pgmap v930: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 12 MiB/s wr, 84 op/s 2023-09-23T09:26:17.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:26:16 smithi135 ceph-mon[99205]: pgmap v930: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 12 MiB/s wr, 84 op/s 2023-09-23T09:26:18.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:26:17 smithi135 ceph-mon[99205]: pgmap v931: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 11 MiB/s wr, 75 op/s 2023-09-23T09:26:18.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:26:17 smithi082 ceph-mon[97694]: pgmap v931: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 11 MiB/s wr, 75 op/s 2023-09-23T09:26:18.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:26:17 smithi161 ceph-mon[99580]: pgmap v931: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 11 MiB/s wr, 75 op/s 2023-09-23T09:26:19.404 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:26:19.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.664+0000 7f66397ff700 1 -- 172.21.15.82:0/820498787 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6634102350 msgr2=0x7f663410a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:26:19.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.664+0000 7f66397ff700 1 --2- 172.21.15.82:0/820498787 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6634102350 0x7f663410a830 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f6628009990 tx=0x7f6628009ca0 comp rx=0 tx=0).stop 2023-09-23T09:26:19.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.664+0000 7f66397ff700 1 -- 172.21.15.82:0/820498787 shutdown_connections 2023-09-23T09:26:19.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.664+0000 7f66397ff700 1 --2- 172.21.15.82:0/820498787 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f663410ae50 0x7f663410d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:26:19.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.664+0000 7f66397ff700 1 --2- 172.21.15.82:0/820498787 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6634101a30 0x7f6634101e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:26:19.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.664+0000 7f66397ff700 1 --2- 172.21.15.82:0/820498787 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6634102350 0x7f663410a830 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:26:19.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.664+0000 7f66397ff700 1 -- 172.21.15.82:0/820498787 >> 172.21.15.82:0/820498787 conn(0x7f66340fb270 msgr2=0x7f66340fd690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:26:19.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.664+0000 7f66397ff700 1 -- 172.21.15.82:0/820498787 shutdown_connections 2023-09-23T09:26:19.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.664+0000 7f66397ff700 1 -- 172.21.15.82:0/820498787 wait complete. 2023-09-23T09:26:19.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.665+0000 7f66397ff700 1 Processor -- start 2023-09-23T09:26:19.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.666+0000 7f66397ff700 1 -- start start 2023-09-23T09:26:19.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.666+0000 7f66397ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6634101a30 0x7f663419e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:26:19.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.666+0000 7f66397ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6634102350 0x7f663419edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:26:19.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.666+0000 7f66397ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f663410ae50 0x7f6634198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:26:19.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.666+0000 7f66397ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6634198f90 con 0x7f6634101a30 2023-09-23T09:26:19.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.666+0000 7f66397ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6634199100 con 0x7f663410ae50 2023-09-23T09:26:19.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.666+0000 7f66397ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66341992c0 con 0x7f6634102350 2023-09-23T09:26:19.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.666+0000 7f6632ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6634101a30 0x7f663419e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:26:19.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.666+0000 7f66327fc700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6634102350 0x7f663419edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:26:19.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.666+0000 7f6632ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6634101a30 0x7f663419e8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40272/0 (socket says 172.21.15.82:40272) 2023-09-23T09:26:19.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.666+0000 7f6632ffd700 1 -- 172.21.15.82:0/1049904232 learned_addr learned my addr 172.21.15.82:0/1049904232 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:26:19.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.666+0000 7f66337fe700 1 --2- 172.21.15.82:0/1049904232 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f663410ae50 0x7f6634198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:26:19.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.667+0000 7f6632ffd700 1 -- 172.21.15.82:0/1049904232 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6634102350 msgr2=0x7f663419edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:26:19.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.667+0000 7f6632ffd700 1 --2- 172.21.15.82:0/1049904232 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6634102350 0x7f663419edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:26:19.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.667+0000 7f6632ffd700 1 -- 172.21.15.82:0/1049904232 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f663410ae50 msgr2=0x7f6634198920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:26:19.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.667+0000 7f6632ffd700 1 --2- 172.21.15.82:0/1049904232 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f663410ae50 0x7f6634198920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:26:19.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.667+0000 7f6632ffd700 1 -- 172.21.15.82:0/1049904232 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66280095f0 con 0x7f6634101a30 2023-09-23T09:26:19.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.667+0000 7f6632ffd700 1 --2- 172.21.15.82:0/1049904232 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6634101a30 0x7f663419e8b0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f662400e9a0 tx=0x7f662400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:26:19.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.667+0000 7f661bfff700 1 -- 172.21.15.82:0/1049904232 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6624009790 con 0x7f6634101a30 2023-09-23T09:26:19.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.667+0000 7f661bfff700 1 -- 172.21.15.82:0/1049904232 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6624010430 con 0x7f6634101a30 2023-09-23T09:26:19.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.667+0000 7f66397ff700 1 -- 172.21.15.82:0/1049904232 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66341995a0 con 0x7f6634101a30 2023-09-23T09:26:19.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.667+0000 7f661bfff700 1 -- 172.21.15.82:0/1049904232 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f662400cea0 con 0x7f6634101a30 2023-09-23T09:26:19.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.668+0000 7f66397ff700 1 -- 172.21.15.82:0/1049904232 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66341a58a0 con 0x7f6634101a30 2023-09-23T09:26:19.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.671+0000 7f661bfff700 1 -- 172.21.15.82:0/1049904232 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f66240105a0 con 0x7f6634101a30 2023-09-23T09:26:19.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.672+0000 7f664d1a6b80 1 Processor -- start 2023-09-23T09:26:19.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.673+0000 7f664d1a6b80 1 -- start start 2023-09-23T09:26:19.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.673+0000 7f664d1a6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575fd948380 0x5575fd948760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:26:19.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.673+0000 7f664d1a6b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575fd948ca0 0x5575fd942700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:26:19.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.673+0000 7f664d1a6b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575fd942c40 0x5575fd9430a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:26:19.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.673+0000 7f664d1a6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575fd8aa7b0 con 0x5575fd948380 2023-09-23T09:26:19.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.673+0000 7f664d1a6b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575fd89b780 con 0x5575fd942c40 2023-09-23T09:26:19.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.673+0000 7f664d1a6b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575fd8990a0 con 0x5575fd948ca0 2023-09-23T09:26:19.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.673+0000 7f66337fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575fd948380 0x5575fd948760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:26:19.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.673+0000 7f6632ffd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575fd948ca0 0x5575fd942700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:26:19.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.673+0000 7f66337fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575fd948380 0x5575fd948760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40286/0 (socket says 172.21.15.82:40286) 2023-09-23T09:26:19.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.673+0000 7f66337fe700 1 -- 172.21.15.82:0/397187714 learned_addr learned my addr 172.21.15.82:0/397187714 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:26:19.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.674+0000 7f66327fc700 1 --2- 172.21.15.82:0/397187714 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575fd942c40 0x5575fd9430a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:26:19.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.674+0000 7f66337fe700 1 -- 172.21.15.82:0/397187714 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575fd948ca0 msgr2=0x5575fd942700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:26:19.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.674+0000 7f66337fe700 1 --2- 172.21.15.82:0/397187714 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575fd948ca0 0x5575fd942700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:26:19.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.674+0000 7f66337fe700 1 -- 172.21.15.82:0/397187714 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575fd942c40 msgr2=0x5575fd9430a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:26:19.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.674+0000 7f66337fe700 1 --2- 172.21.15.82:0/397187714 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575fd942c40 0x5575fd9430a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:26:19.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.674+0000 7f66337fe700 1 -- 172.21.15.82:0/397187714 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5575fd714630 con 0x5575fd948380 2023-09-23T09:26:19.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.674+0000 7f661bfff700 1 --2- 172.21.15.82:0/1049904232 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f661c0a0140 0x7f661c0a2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:26:19.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.674+0000 7f66337fe700 1 --2- 172.21.15.82:0/397187714 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575fd948380 0x5575fd948760 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f662c011600 tx=0x7f662c009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18b6cc7baf7aead9 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:26:19.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.674+0000 7f661bfff700 1 -- 172.21.15.82:0/1049904232 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f6624014070 con 0x7f6634101a30 2023-09-23T09:26:19.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.674+0000 7f6632ffd700 1 --2- 172.21.15.82:0/1049904232 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f661c0a0140 0x7f661c0a2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:26:19.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.675+0000 7f66197fa700 1 -- 172.21.15.82:0/397187714 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f662c00e040 con 0x5575fd948380 2023-09-23T09:26:19.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.675+0000 7f66197fa700 1 -- 172.21.15.82:0/397187714 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f662c00f040 con 0x5575fd948380 2023-09-23T09:26:19.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.675+0000 7f66197fa700 1 -- 172.21.15.82:0/397187714 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f662c004630 con 0x5575fd948380 2023-09-23T09:26:19.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.675+0000 7f6632ffd700 1 --2- 172.21.15.82:0/1049904232 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f661c0a0140 0x7f661c0a2600 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f66240c8f40 tx=0x7f66240d1110 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:26:19.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.675+0000 7f664d1a6b80 1 -- 172.21.15.82:0/397187714 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575fd948380 msgr2=0x5575fd948760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:26:19.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.675+0000 7f664d1a6b80 1 --2- 172.21.15.82:0/397187714 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575fd948380 0x5575fd948760 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f662c011600 tx=0x7f662c009920 comp rx=0 tx=0).stop 2023-09-23T09:26:19.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.676+0000 7f664d1a6b80 1 -- 172.21.15.82:0/397187714 shutdown_connections 2023-09-23T09:26:19.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.676+0000 7f664d1a6b80 1 --2- 172.21.15.82:0/397187714 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575fd942c40 0x5575fd9430a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:26:19.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.676+0000 7f664d1a6b80 1 --2- 172.21.15.82:0/397187714 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575fd948380 0x5575fd948760 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:26:19.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.676+0000 7f664d1a6b80 1 --2- 172.21.15.82:0/397187714 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575fd948ca0 0x5575fd942700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:26:19.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.676+0000 7f664d1a6b80 1 -- 172.21.15.82:0/397187714 >> 172.21.15.82:0/397187714 conn(0x5575fd8b70e0 msgr2=0x5575fd93d410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:26:19.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.676+0000 7f664d1a6b80 1 -- 172.21.15.82:0/397187714 shutdown_connections 2023-09-23T09:26:19.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.676+0000 7f664d1a6b80 1 -- 172.21.15.82:0/397187714 wait complete. 2023-09-23T09:26:19.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.676+0000 7f664d1a6b80 1 -- start start 2023-09-23T09:26:19.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.677+0000 7f664d1a6b80 1 Processor -- start 2023-09-23T09:26:19.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.678+0000 7f664d1a6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575fd942c40 0x5575fd94ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:26:19.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.678+0000 7f664d1a6b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575fd948380 0x5575fd94bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:26:19.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.678+0000 7f664d1a6b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575fd948ca0 0x5575fd94c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:26:19.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.678+0000 7f664d1a6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575fd894990 con 0x5575fd942c40 2023-09-23T09:26:19.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.678+0000 7f664d1a6b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575fd832bb0 con 0x5575fd948ca0 2023-09-23T09:26:19.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.678+0000 7f664d1a6b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575fd8328b0 con 0x5575fd948380 2023-09-23T09:26:19.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.678+0000 7f664d1a6b80 10 client.0 _ll_register_callbacks cb 0x5575fd77ca80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:26:19.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.678+0000 7f66337fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575fd942c40 0x5575fd94ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:26:19.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.678+0000 7f66327fc700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575fd948380 0x5575fd94bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:26:19.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.678+0000 7f66327fc700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575fd948380 0x5575fd94bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:40990/0 (socket says 172.21.15.82:40990) 2023-09-23T09:26:19.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.678+0000 7f66327fc700 1 -- 172.21.15.82:0/2737609752 learned_addr learned my addr 172.21.15.82:0/2737609752 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:26:19.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.678+0000 7f66337fe700 1 --2- 172.21.15.82:0/2737609752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575fd948ca0 0x5575fd94c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:26:19.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.679+0000 7f66337fe700 1 -- 172.21.15.82:0/2737609752 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575fd948380 msgr2=0x5575fd94bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:26:19.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.679+0000 7f66337fe700 1 --2- 172.21.15.82:0/2737609752 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575fd948380 0x5575fd94bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:26:19.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.679+0000 7f66337fe700 1 -- 172.21.15.82:0/2737609752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575fd948ca0 msgr2=0x5575fd94c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:26:19.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.679+0000 7f66337fe700 1 --2- 172.21.15.82:0/2737609752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575fd948ca0 0x5575fd94c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:26:19.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.679+0000 7f66337fe700 1 -- 172.21.15.82:0/2737609752 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f662c0112b0 con 0x5575fd942c40 2023-09-23T09:26:19.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.679+0000 7f66337fe700 1 --2- 172.21.15.82:0/2737609752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575fd942c40 0x5575fd94ec50 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f662c006080 tx=0x7f662c009470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26a0ad146303eeb3 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:26:19.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.679+0000 7f6616ff5700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:26:19.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.679+0000 7f6616ff5700 1 -- 172.21.15.82:0/2737609752 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f662c00e070 con 0x5575fd942c40 2023-09-23T09:26:19.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.679+0000 7f664d1a6b80 1 -- 172.21.15.82:0/2737609752 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5575fd9121c0 con 0x5575fd942c40 2023-09-23T09:26:19.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.679+0000 7f6616ff5700 1 -- 172.21.15.82:0/2737609752 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(135..135 src has 1..135) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f662c004670 con 0x5575fd942c40 2023-09-23T09:26:19.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.680+0000 7f6616ff5700 1 -- 172.21.15.82:0/2737609752 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7f662c004830 con 0x5575fd942c40 2023-09-23T09:26:19.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.680+0000 7f664d1a6b80 10 client.17181 fetch_fsmap learned FSMap version 78 2023-09-23T09:26:19.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.680+0000 7f664d1a6b80 1 -- 172.21.15.82:0/2737609752 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=78,monmap=4+}) v3 -- 0x5575fd6c0de0 con 0x5575fd942c40 2023-09-23T09:26:19.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.680+0000 7f6616ff5700 1 -- 172.21.15.82:0/2737609752 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5575fd9121c0 con 0x5575fd942c40 2023-09-23T09:26:19.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.680+0000 7f6616ff5700 1 -- 172.21.15.82:0/2737609752 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 78) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f662c007bd0 con 0x5575fd942c40 2023-09-23T09:26:19.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.681+0000 7f664d1a6b80 10 client.17181 fetch_fsmap finished waiting for FSMap version 78 2023-09-23T09:26:19.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.681+0000 7f664d1a6b80 10 client.17181 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:26:19.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.681+0000 7f664d1a6b80 20 client.17181 populate_metadata read hostname 'smithi082' 2023-09-23T09:26:19.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.681+0000 7f664d1a6b80 1 --2- 172.21.15.82:0/2737609752 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5575fd95c640 0x5575fd95ea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:26:19.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.681+0000 7f664d1a6b80 4 client.17181 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:26:19.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.681+0000 7f664d1a6b80 1 -- 172.21.15.82:0/2737609752 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5575fd83aba0 con 0x5575fd95c640 2023-09-23T09:26:19.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.681+0000 7f66327fc700 1 --2- 172.21.15.82:0/2737609752 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5575fd95c640 0x5575fd95ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:26:19.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.682+0000 7f66327fc700 1 --2- 172.21.15.82:0/2737609752 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5575fd95c640 0x5575fd95ea60 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d6b3234cbadc07fa server_cookie=9f5bb36d7d555528 in_seq=0 out_seq=0 2023-09-23T09:26:19.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.682+0000 7f6616ff5700 10 client.17181 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:26:19.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.682+0000 7f6616ff5700 1 -- 172.21.15.82:0/2737609752 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5575fd83aba0 con 0x5575fd95c640 2023-09-23T09:26:19.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.682+0000 7f6616ff5700 10 client.17181 handle_command_reply: tid=0 2023-09-23T09:26:19.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.683+0000 7f664d1a6b80 1 client.17181 shutdown 2023-09-23T09:26:19.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.683+0000 7f664d1a6b80 1 -- 172.21.15.82:0/2737609752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575fd942c40 msgr2=0x5575fd94ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:26:19.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.683+0000 7f664d1a6b80 1 --2- 172.21.15.82:0/2737609752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575fd942c40 0x5575fd94ec50 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f662c006080 tx=0x7f662c009470 comp rx=0 tx=0).stop 2023-09-23T09:26:19.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.683+0000 7f664d1a6b80 1 -- 172.21.15.82:0/2737609752 shutdown_connections 2023-09-23T09:26:19.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.683+0000 7f664d1a6b80 1 --2- 172.21.15.82:0/2737609752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575fd948ca0 0x5575fd94c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:26:19.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.683+0000 7f664d1a6b80 1 --2- 172.21.15.82:0/2737609752 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5575fd95c640 0x5575fd95ea60 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:26:19.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.683+0000 7f664d1a6b80 1 --2- 172.21.15.82:0/2737609752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575fd942c40 0x5575fd94ec50 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:26:19.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.683+0000 7f664d1a6b80 1 --2- 172.21.15.82:0/2737609752 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575fd948380 0x5575fd94bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:26:19.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.683+0000 7f664d1a6b80 1 -- 172.21.15.82:0/2737609752 >> 172.21.15.82:0/2737609752 conn(0x5575fd8b70e0 msgr2=0x5575fd937b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:26:19.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.683+0000 7f6616ff5700 0 client.17181 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:26:19.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.683+0000 7f664d1a6b80 1 -- 172.21.15.82:0/2737609752 shutdown_connections 2023-09-23T09:26:19.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.683+0000 7f664d1a6b80 1 -- 172.21.15.82:0/2737609752 wait complete. 2023-09-23T09:26:19.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.683+0000 7f664d1a6b80 20 client.17181 trim_cache size 0 max 16384 2023-09-23T09:26:19.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.705+0000 7f664d1a6b80 1 Processor -- start 2023-09-23T09:26:19.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.705+0000 7f664d1a6b80 1 -- start start 2023-09-23T09:26:19.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.706+0000 7f664d1a6b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575fd942c40 0x5575fd94b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:26:19.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.706+0000 7f664d1a6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575fd948380 0x5575fd94e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:26:19.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.706+0000 7f664d1a6b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575fd948ca0 0x5575fd947030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:26:19.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.706+0000 7f664d1a6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575fd716920 con 0x5575fd948380 2023-09-23T09:26:19.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.706+0000 7f664d1a6b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575fd939840 con 0x5575fd942c40 2023-09-23T09:26:19.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.706+0000 7f664d1a6b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575fd9590c0 con 0x5575fd948ca0 2023-09-23T09:26:19.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.706+0000 7f66337fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575fd942c40 0x5575fd94b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:26:19.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.706+0000 7f66327fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575fd948380 0x5575fd94e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:26:19.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.706+0000 7f66337fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575fd942c40 0x5575fd94b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:49462/0 (socket says 172.21.15.82:49462) 2023-09-23T09:26:19.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.706+0000 7f66337fe700 1 -- 172.21.15.82:0/843030064 learned_addr learned my addr 172.21.15.82:0/843030064 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:26:19.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.706+0000 7f66337fe700 1 --2- 172.21.15.82:0/843030064 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575fd948ca0 0x5575fd947030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:26:19.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.707+0000 7f66337fe700 1 -- 172.21.15.82:0/843030064 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575fd948ca0 msgr2=0x5575fd947030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:26:19.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.707+0000 7f66337fe700 1 --2- 172.21.15.82:0/843030064 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575fd948ca0 0x5575fd947030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:26:19.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.707+0000 7f66337fe700 1 -- 172.21.15.82:0/843030064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575fd948380 msgr2=0x5575fd94e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:26:19.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.707+0000 7f66337fe700 1 --2- 172.21.15.82:0/843030064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575fd948380 0x5575fd94e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:26:19.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.707+0000 7f66337fe700 1 -- 172.21.15.82:0/843030064 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5575fd963650 con 0x5575fd942c40 2023-09-23T09:26:19.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.707+0000 7f66337fe700 1 --2- 172.21.15.82:0/843030064 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575fd942c40 0x5575fd94b750 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f662c0061e0 tx=0x7f662c021040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9c9905df92734a5 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:26:19.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.707+0000 7f6619ffb700 1 -- 172.21.15.82:0/843030064 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f662c00e030 con 0x5575fd942c40 2023-09-23T09:26:19.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.708+0000 7f6619ffb700 1 -- 172.21.15.82:0/843030064 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f662c0092e0 con 0x5575fd942c40 2023-09-23T09:26:19.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.708+0000 7f6619ffb700 1 -- 172.21.15.82:0/843030064 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f662c0047a0 con 0x5575fd942c40 2023-09-23T09:26:19.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.708+0000 7f664d1a6b80 1 -- 172.21.15.82:0/843030064 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575fd942c40 msgr2=0x5575fd94b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:26:19.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.708+0000 7f664d1a6b80 1 --2- 172.21.15.82:0/843030064 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575fd942c40 0x5575fd94b750 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f662c0061e0 tx=0x7f662c021040 comp rx=0 tx=0).stop 2023-09-23T09:26:19.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.708+0000 7f664d1a6b80 1 -- 172.21.15.82:0/843030064 shutdown_connections 2023-09-23T09:26:19.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.708+0000 7f664d1a6b80 1 --2- 172.21.15.82:0/843030064 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575fd948ca0 0x5575fd947030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:26:19.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.708+0000 7f664d1a6b80 1 --2- 172.21.15.82:0/843030064 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575fd942c40 0x5575fd94b750 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:26:19.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.708+0000 7f664d1a6b80 1 --2- 172.21.15.82:0/843030064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575fd948380 0x5575fd94e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:26:19.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.708+0000 7f664d1a6b80 1 -- 172.21.15.82:0/843030064 >> 172.21.15.82:0/843030064 conn(0x5575fd8b70e0 msgr2=0x5575fd946090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:26:19.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.709+0000 7f664d1a6b80 1 -- 172.21.15.82:0/843030064 shutdown_connections 2023-09-23T09:26:19.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.709+0000 7f664d1a6b80 1 -- 172.21.15.82:0/843030064 wait complete. 2023-09-23T09:26:19.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.709+0000 7f664d1a6b80 1 -- start start 2023-09-23T09:26:19.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.709+0000 7f664d1a6b80 1 Processor -- start 2023-09-23T09:26:19.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.710+0000 7f664d1a6b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575fd942c40 0x5575fd9537a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:26:19.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.710+0000 7f664d1a6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575fd948380 0x5575fd943ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:26:19.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.710+0000 7f664d1a6b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575fd948ca0 0x5575fd944420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:26:19.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.710+0000 7f664d1a6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575fd944960 con 0x5575fd948380 2023-09-23T09:26:19.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.710+0000 7f664d1a6b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575fd944ad0 con 0x5575fd942c40 2023-09-23T09:26:19.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.710+0000 7f664d1a6b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575fd944c90 con 0x5575fd948ca0 2023-09-23T09:26:19.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.710+0000 7f664d1a6b80 10 client.0 _ll_register_callbacks cb 0x7f662c003f10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:26:19.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.710+0000 7f66327fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575fd948380 0x5575fd943ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:26:19.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.710+0000 7f66327fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575fd948380 0x5575fd943ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40316/0 (socket says 172.21.15.82:40316) 2023-09-23T09:26:19.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.710+0000 7f66327fc700 1 -- 172.21.15.82:0/2948954966 learned_addr learned my addr 172.21.15.82:0/2948954966 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:26:19.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.710+0000 7f66337fe700 1 --2- 172.21.15.82:0/2948954966 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575fd942c40 0x5575fd9537a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:26:19.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.710+0000 7f66337fe700 1 --2- 172.21.15.82:0/2948954966 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575fd948ca0 0x5575fd944420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:26:19.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.711+0000 7f66327fc700 1 -- 172.21.15.82:0/2948954966 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575fd948ca0 msgr2=0x5575fd944420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:26:19.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.711+0000 7f66327fc700 1 --2- 172.21.15.82:0/2948954966 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575fd948ca0 0x5575fd944420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:26:19.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.711+0000 7f66327fc700 1 -- 172.21.15.82:0/2948954966 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575fd942c40 msgr2=0x5575fd9537a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:26:19.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.711+0000 7f66327fc700 1 --2- 172.21.15.82:0/2948954966 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575fd942c40 0x5575fd9537a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:26:19.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.711+0000 7f66327fc700 1 -- 172.21.15.82:0/2948954966 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5575fd6c0de0 con 0x5575fd948380 2023-09-23T09:26:19.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.711+0000 7f66337fe700 1 --2- 172.21.15.82:0/2948954966 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575fd942c40 0x5575fd9537a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:26:19.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.711+0000 7f66327fc700 1 --2- 172.21.15.82:0/2948954966 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575fd948380 0x5575fd943ee0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f6628006010 tx=0x7f6628005170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4b822ecd71cda9b server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:26:19.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.711+0000 7f6616ff5700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:26:19.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.711+0000 7f6616ff5700 1 -- 172.21.15.82:0/2948954966 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f662802fb80 con 0x5575fd948380 2023-09-23T09:26:19.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.711+0000 7f664d1a6b80 1 -- 172.21.15.82:0/2948954966 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5575fd9358b0 con 0x5575fd948380 2023-09-23T09:26:19.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.711+0000 7f6616ff5700 1 -- 172.21.15.82:0/2948954966 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(135..135 src has 1..135) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f662802fce0 con 0x5575fd948380 2023-09-23T09:26:19.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.712+0000 7f6616ff5700 1 -- 172.21.15.82:0/2948954966 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7f662802fea0 con 0x5575fd948380 2023-09-23T09:26:19.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.712+0000 7f664d1a6b80 10 client.17187 fetch_fsmap learned FSMap version 78 2023-09-23T09:26:19.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.712+0000 7f664d1a6b80 1 -- 172.21.15.82:0/2948954966 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=78,monmap=4+}) v3 -- 0x5575fd6a9c60 con 0x5575fd948380 2023-09-23T09:26:19.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.712+0000 7f6616ff5700 1 -- 172.21.15.82:0/2948954966 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f662803c020 con 0x5575fd948380 2023-09-23T09:26:19.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.712+0000 7f6616ff5700 1 -- 172.21.15.82:0/2948954966 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 78) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f662800bc40 con 0x5575fd948380 2023-09-23T09:26:19.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.712+0000 7f664d1a6b80 10 client.17187 fetch_fsmap finished waiting for FSMap version 78 2023-09-23T09:26:19.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.712+0000 7f664d1a6b80 10 client.17187 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:26:19.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.712+0000 7f664d1a6b80 20 client.17187 populate_metadata read hostname 'smithi082' 2023-09-23T09:26:19.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.712+0000 7f664d1a6b80 1 --2- 172.21.15.82:0/2948954966 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5575fd9b18e0 0x5575fd9b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:26:19.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.712+0000 7f664d1a6b80 4 client.17187 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:26:19.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.712+0000 7f664d1a6b80 1 -- 172.21.15.82:0/2948954966 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5575fd88d970 con 0x5575fd9b18e0 2023-09-23T09:26:19.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.713+0000 7f66337fe700 1 --2- 172.21.15.82:0/2948954966 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5575fd9b18e0 0x5575fd9b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:26:19.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.713+0000 7f66337fe700 1 --2- 172.21.15.82:0/2948954966 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5575fd9b18e0 0x5575fd9b3d00 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=664d4b3f1fdaae64 server_cookie=cf7b79a428f37ab8 in_seq=0 out_seq=0 2023-09-23T09:26:19.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.713+0000 7f6616ff5700 10 client.17187 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:26:19.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.713+0000 7f6616ff5700 1 -- 172.21.15.82:0/2948954966 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x5575fd88d970 con 0x5575fd9b18e0 2023-09-23T09:26:19.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.713+0000 7f6616ff5700 10 client.17187 handle_command_reply: tid=0 2023-09-23T09:26:19.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.713+0000 7f664d1a6b80 1 client.17187 shutdown 2023-09-23T09:26:19.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.714+0000 7f664d1a6b80 1 -- 172.21.15.82:0/2948954966 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575fd948380 msgr2=0x5575fd943ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:26:19.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.714+0000 7f664d1a6b80 1 --2- 172.21.15.82:0/2948954966 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575fd948380 0x5575fd943ee0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f6628006010 tx=0x7f6628005170 comp rx=0 tx=0).stop 2023-09-23T09:26:19.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.714+0000 7f664d1a6b80 1 -- 172.21.15.82:0/2948954966 shutdown_connections 2023-09-23T09:26:19.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.714+0000 7f664d1a6b80 1 --2- 172.21.15.82:0/2948954966 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575fd948ca0 0x5575fd944420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:26:19.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.714+0000 7f664d1a6b80 1 --2- 172.21.15.82:0/2948954966 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575fd942c40 0x5575fd9537a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:26:19.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.714+0000 7f664d1a6b80 1 --2- 172.21.15.82:0/2948954966 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5575fd9b18e0 0x5575fd9b3d00 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:26:19.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.714+0000 7f664d1a6b80 1 --2- 172.21.15.82:0/2948954966 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575fd948380 0x5575fd943ee0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:26:19.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.714+0000 7f6616ff5700 0 client.17187 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:26:19.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.714+0000 7f664d1a6b80 1 -- 172.21.15.82:0/2948954966 >> 172.21.15.82:0/2948954966 conn(0x5575fd8b70e0 msgr2=0x5575fd9372b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:26:19.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.714+0000 7f664d1a6b80 1 -- 172.21.15.82:0/2948954966 shutdown_connections 2023-09-23T09:26:19.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.714+0000 7f664d1a6b80 1 -- 172.21.15.82:0/2948954966 wait complete. 2023-09-23T09:26:19.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.714+0000 7f664d1a6b80 20 client.17187 trim_cache size 0 max 16384 2023-09-23T09:26:19.719 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:26:19.719 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-23T09:26:19.719 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:26:19.719 INFO:teuthology.orchestra.run.smithi082.stdout: "047cbc72-e254-4787-b038-382de9c1a9a4": { 2023-09-23T09:26:19.719 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:26:19.720 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "047cbc72-e254-4787-b038-382de9c1a9a4", 2023-09-23T09:26:19.720 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:26:19.720 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:26:19.720 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:26:19.720 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:26:19.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.715+0000 7f66397ff700 1 -- 172.21.15.82:0/1049904232 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f661c0a0140 msgr2=0x7f661c0a2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:26:19.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.715+0000 7f66397ff700 1 --2- 172.21.15.82:0/1049904232 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f661c0a0140 0x7f661c0a2600 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f66240c8f40 tx=0x7f66240d1110 comp rx=0 tx=0).stop 2023-09-23T09:26:19.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.715+0000 7f66397ff700 1 -- 172.21.15.82:0/1049904232 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6634101a30 msgr2=0x7f663419e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:26:19.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.715+0000 7f66397ff700 1 --2- 172.21.15.82:0/1049904232 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6634101a30 0x7f663419e8b0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f662400e9a0 tx=0x7f662400ecb0 comp rx=0 tx=0).stop 2023-09-23T09:26:19.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.715+0000 7f66397ff700 1 -- 172.21.15.82:0/1049904232 shutdown_connections 2023-09-23T09:26:19.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.715+0000 7f66397ff700 1 --2- 172.21.15.82:0/1049904232 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f661c0a0140 0x7f661c0a2600 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:26:19.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.715+0000 7f66397ff700 1 --2- 172.21.15.82:0/1049904232 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f663410ae50 0x7f6634198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:26:19.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.715+0000 7f66397ff700 1 --2- 172.21.15.82:0/1049904232 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6634101a30 0x7f663419e8b0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:26:19.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.715+0000 7f66397ff700 1 --2- 172.21.15.82:0/1049904232 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6634102350 0x7f663419edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:26:19.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.715+0000 7f66397ff700 1 -- 172.21.15.82:0/1049904232 >> 172.21.15.82:0/1049904232 conn(0x7f66340fb270 msgr2=0x7f66340fbee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:26:19.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.715+0000 7f66397ff700 1 -- 172.21.15.82:0/1049904232 shutdown_connections 2023-09-23T09:26:19.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:19.715+0000 7f66397ff700 1 -- 172.21.15.82:0/1049904232 wait complete. 2023-09-23T09:26:19.737 INFO:tasks.cephfs.filesystem:scrub status for tag:047cbc72-e254-4787-b038-382de9c1a9a4 - {'path': '/', 'tag': '047cbc72-e254-4787-b038-382de9c1a9a4', 'options': 'recursive,force'} 2023-09-23T09:26:20.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:26:20 smithi082 ceph-mon[97694]: pgmap v932: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 11 MiB/s wr, 85 op/s 2023-09-23T09:26:20.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:26:20 smithi161 ceph-mon[99580]: pgmap v932: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 11 MiB/s wr, 85 op/s 2023-09-23T09:26:21.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:26:20 smithi135 ceph-mon[99205]: pgmap v932: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 11 MiB/s wr, 85 op/s 2023-09-23T09:26:22.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:26:22 smithi082 ceph-mon[97694]: pgmap v933: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 11 MiB/s wr, 85 op/s 2023-09-23T09:26:22.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:26:22 smithi161 ceph-mon[99580]: pgmap v933: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 11 MiB/s wr, 85 op/s 2023-09-23T09:26:23.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:26:22 smithi135 ceph-mon[99205]: pgmap v933: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 11 MiB/s wr, 85 op/s 2023-09-23T09:26:24.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:26:24 smithi082 ceph-mon[97694]: pgmap v934: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 9.5 MiB/s wr, 73 op/s 2023-09-23T09:26:24.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:26:24 smithi161 ceph-mon[99580]: pgmap v934: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 9.5 MiB/s wr, 73 op/s 2023-09-23T09:26:25.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:26:24 smithi135 ceph-mon[99205]: pgmap v934: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 9.5 MiB/s wr, 73 op/s 2023-09-23T09:26:26.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:26:26 smithi082 ceph-mon[97694]: pgmap v935: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 17 MiB/s wr, 118 op/s 2023-09-23T09:26:26.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:26:26 smithi161 ceph-mon[99580]: pgmap v935: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 17 MiB/s wr, 118 op/s 2023-09-23T09:26:27.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:26:26 smithi135 ceph-mon[99205]: pgmap v935: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 17 MiB/s wr, 118 op/s 2023-09-23T09:26:28.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:26:27 smithi135 ceph-mon[99205]: pgmap v936: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 14 MiB/s wr, 96 op/s 2023-09-23T09:26:28.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:26:27 smithi082 ceph-mon[97694]: pgmap v936: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 14 MiB/s wr, 96 op/s 2023-09-23T09:26:28.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:26:27 smithi161 ceph-mon[99580]: pgmap v936: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 14 MiB/s wr, 96 op/s 2023-09-23T09:26:30.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:26:30 smithi082 ceph-mon[97694]: pgmap v937: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 21 MiB/s wr, 143 op/s 2023-09-23T09:26:30.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:26:30 smithi161 ceph-mon[99580]: pgmap v937: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 21 MiB/s wr, 143 op/s 2023-09-23T09:26:31.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:26:30 smithi135 ceph-mon[99205]: pgmap v937: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 21 MiB/s wr, 143 op/s 2023-09-23T09:26:32.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:26:32 smithi082 ceph-mon[97694]: pgmap v938: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 14 MiB/s wr, 95 op/s 2023-09-23T09:26:32.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:26:32 smithi161 ceph-mon[99580]: pgmap v938: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 14 MiB/s wr, 95 op/s 2023-09-23T09:26:33.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:26:32 smithi135 ceph-mon[99205]: pgmap v938: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 14 MiB/s wr, 95 op/s 2023-09-23T09:26:34.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:26:34 smithi082 ceph-mon[97694]: pgmap v939: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 14 MiB/s wr, 95 op/s 2023-09-23T09:26:34.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:26:34 smithi161 ceph-mon[99580]: pgmap v939: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 14 MiB/s wr, 95 op/s 2023-09-23T09:26:35.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:26:34 smithi135 ceph-mon[99205]: pgmap v939: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 14 MiB/s wr, 95 op/s 2023-09-23T09:26:36.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:26:36 smithi082 ceph-mon[97694]: pgmap v940: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 223 KiB/s rd, 20 MiB/s wr, 137 op/s 2023-09-23T09:26:36.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:26:36 smithi161 ceph-mon[99580]: pgmap v940: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 223 KiB/s rd, 20 MiB/s wr, 137 op/s 2023-09-23T09:26:37.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:26:36 smithi135 ceph-mon[99205]: pgmap v940: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 223 KiB/s rd, 20 MiB/s wr, 137 op/s 2023-09-23T09:26:38.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:26:37 smithi135 ceph-mon[99205]: pgmap v941: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 12 MiB/s wr, 89 op/s 2023-09-23T09:26:38.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:26:37 smithi082 ceph-mon[97694]: pgmap v941: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 12 MiB/s wr, 89 op/s 2023-09-23T09:26:38.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:26:37 smithi161 ceph-mon[99580]: pgmap v941: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 12 MiB/s wr, 89 op/s 2023-09-23T09:26:40.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:26:40 smithi082 ceph-mon[97694]: pgmap v942: 97 pgs: 97 active+clean; 13 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 24 MiB/s wr, 153 op/s 2023-09-23T09:26:40.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:26:40 smithi161 ceph-mon[99580]: pgmap v942: 97 pgs: 97 active+clean; 13 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 24 MiB/s wr, 153 op/s 2023-09-23T09:26:41.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:26:40 smithi135 ceph-mon[99205]: pgmap v942: 97 pgs: 97 active+clean; 13 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 24 MiB/s wr, 153 op/s 2023-09-23T09:26:42.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:26:42 smithi082 ceph-mon[97694]: pgmap v943: 97 pgs: 97 active+clean; 13 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 17 MiB/s wr, 106 op/s 2023-09-23T09:26:42.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:26:42 smithi161 ceph-mon[99580]: pgmap v943: 97 pgs: 97 active+clean; 13 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 17 MiB/s wr, 106 op/s 2023-09-23T09:26:43.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:26:42 smithi135 ceph-mon[99205]: pgmap v943: 97 pgs: 97 active+clean; 13 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 17 MiB/s wr, 106 op/s 2023-09-23T09:26:44.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:26:44 smithi082 ceph-mon[97694]: pgmap v944: 97 pgs: 97 active+clean; 13 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 17 MiB/s wr, 106 op/s 2023-09-23T09:26:44.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:26:44 smithi161 ceph-mon[99580]: pgmap v944: 97 pgs: 97 active+clean; 13 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 17 MiB/s wr, 106 op/s 2023-09-23T09:26:45.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:26:44 smithi135 ceph-mon[99205]: pgmap v944: 97 pgs: 97 active+clean; 13 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 17 MiB/s wr, 106 op/s 2023-09-23T09:26:46.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:26:46 smithi082 ceph-mon[97694]: pgmap v945: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 28 MiB/s wr, 162 op/s 2023-09-23T09:26:46.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:26:46 smithi161 ceph-mon[99580]: pgmap v945: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 28 MiB/s wr, 162 op/s 2023-09-23T09:26:47.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:26:46 smithi135 ceph-mon[99205]: pgmap v945: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 28 MiB/s wr, 162 op/s 2023-09-23T09:26:48.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:26:47 smithi135 ceph-mon[99205]: pgmap v946: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 22 MiB/s wr, 120 op/s 2023-09-23T09:26:48.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:26:47 smithi082 ceph-mon[97694]: pgmap v946: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 22 MiB/s wr, 120 op/s 2023-09-23T09:26:48.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:26:47 smithi161 ceph-mon[99580]: pgmap v946: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 22 MiB/s wr, 120 op/s 2023-09-23T09:26:49.738 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:26:49.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.971+0000 7f28dddff700 1 -- 172.21.15.82:0/1985525418 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f28d8100870 msgr2=0x7f28d8100cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:26:49.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.971+0000 7f28dddff700 1 --2- 172.21.15.82:0/1985525418 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f28d8100870 0x7f28d8100cf0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f28cc0098f0 tx=0x7f28cc009c00 comp rx=0 tx=0).stop 2023-09-23T09:26:49.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.972+0000 7f28dddff700 1 -- 172.21.15.82:0/1985525418 shutdown_connections 2023-09-23T09:26:49.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.972+0000 7f28dddff700 1 --2- 172.21.15.82:0/1985525418 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28d8101230 0x7f28d810d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:26:49.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.972+0000 7f28dddff700 1 --2- 172.21.15.82:0/1985525418 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f28d8106880 0x7f28d8106c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:26:49.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.972+0000 7f28dddff700 1 --2- 172.21.15.82:0/1985525418 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f28d8100870 0x7f28d8100cf0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:26:49.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.972+0000 7f28dddff700 1 -- 172.21.15.82:0/1985525418 >> 172.21.15.82:0/1985525418 conn(0x7f28d80fc3a0 msgr2=0x7f28d80fe7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:26:49.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.972+0000 7f28dddff700 1 -- 172.21.15.82:0/1985525418 shutdown_connections 2023-09-23T09:26:49.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.972+0000 7f28dddff700 1 -- 172.21.15.82:0/1985525418 wait complete. 2023-09-23T09:26:49.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.973+0000 7f28dddff700 1 Processor -- start 2023-09-23T09:26:49.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.973+0000 7f28dddff700 1 -- start start 2023-09-23T09:26:49.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.974+0000 7f28dddff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f28d8100870 0x7f28d819e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:26:49.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.974+0000 7f28dddff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28d8101230 0x7f28d819eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:26:49.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.974+0000 7f28dddff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f28d8106880 0x7f28d8198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:26:49.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.974+0000 7f28dddff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d8199160 con 0x7f28d8100870 2023-09-23T09:26:49.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.974+0000 7f28dddff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d81992d0 con 0x7f28d8101230 2023-09-23T09:26:49.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.974+0000 7f28dddff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d8199490 con 0x7f28d8106880 2023-09-23T09:26:49.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.974+0000 7f28d77fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f28d8100870 0x7f28d819e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:26:49.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.974+0000 7f28d77fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f28d8100870 0x7f28d819e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40824/0 (socket says 172.21.15.82:40824) 2023-09-23T09:26:49.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.974+0000 7f28d77fe700 1 -- 172.21.15.82:0/1847347463 learned_addr learned my addr 172.21.15.82:0/1847347463 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:26:49.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.974+0000 7f28d6ffd700 1 --2- 172.21.15.82:0/1847347463 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28d8101230 0x7f28d819eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:26:49.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.974+0000 7f28d7fff700 1 --2- 172.21.15.82:0/1847347463 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f28d8106880 0x7f28d8198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:26:49.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.975+0000 7f28d6ffd700 1 -- 172.21.15.82:0/1847347463 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f28d8106880 msgr2=0x7f28d8198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:26:49.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.975+0000 7f28d6ffd700 1 --2- 172.21.15.82:0/1847347463 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f28d8106880 0x7f28d8198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:26:49.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.975+0000 7f28d6ffd700 1 -- 172.21.15.82:0/1847347463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f28d8100870 msgr2=0x7f28d819e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:26:49.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.975+0000 7f28d6ffd700 1 --2- 172.21.15.82:0/1847347463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f28d8100870 0x7f28d819e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:26:49.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.975+0000 7f28d6ffd700 1 -- 172.21.15.82:0/1847347463 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28cc009520 con 0x7f28d8101230 2023-09-23T09:26:49.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.975+0000 7f28d77fe700 1 --2- 172.21.15.82:0/1847347463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f28d8100870 0x7f28d819e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:26:49.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.975+0000 7f28d6ffd700 1 --2- 172.21.15.82:0/1847347463 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28d8101230 0x7f28d819eef0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f28cc009810 tx=0x7f28cc00fa00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:26:49.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.975+0000 7f28d4ff9700 1 -- 172.21.15.82:0/1847347463 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28cc01c070 con 0x7f28d8101230 2023-09-23T09:26:49.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.975+0000 7f28dddff700 1 -- 172.21.15.82:0/1847347463 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28d8199710 con 0x7f28d8101230 2023-09-23T09:26:49.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.975+0000 7f28d4ff9700 1 -- 172.21.15.82:0/1847347463 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f28cc00ba70 con 0x7f28d8101230 2023-09-23T09:26:49.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.975+0000 7f28d4ff9700 1 -- 172.21.15.82:0/1847347463 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28cc0038e0 con 0x7f28d8101230 2023-09-23T09:26:49.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.976+0000 7f28dddff700 1 -- 172.21.15.82:0/1847347463 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28d81a5930 con 0x7f28d8101230 2023-09-23T09:26:49.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.980+0000 7f28d4ff9700 1 -- 172.21.15.82:0/1847347463 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f28cc020030 con 0x7f28d8101230 2023-09-23T09:26:49.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.981+0000 7f28f17a9b80 1 Processor -- start 2023-09-23T09:26:49.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.981+0000 7f28f17a9b80 1 -- start start 2023-09-23T09:26:49.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.982+0000 7f28f17a9b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562d36213380 0x562d36213760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:26:49.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.982+0000 7f28f17a9b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562d36213ca0 0x562d3620d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:26:49.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.982+0000 7f28f17a9b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562d3620dc40 0x562d3620e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:26:49.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.982+0000 7f28f17a9b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d361757b0 con 0x562d36213ca0 2023-09-23T09:26:49.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.982+0000 7f28f17a9b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d36166780 con 0x562d36213380 2023-09-23T09:26:49.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.982+0000 7f28f17a9b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d361640a0 con 0x562d3620dc40 2023-09-23T09:26:49.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.982+0000 7f28d4ff9700 1 --2- 172.21.15.82:0/1847347463 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f28c00a00c0 0x7f28c00a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:26:49.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.982+0000 7f28d6ffd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562d3620dc40 0x562d3620e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:26:49.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.982+0000 7f28d7fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562d36213380 0x562d36213760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:26:49.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.982+0000 7f28d7fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562d36213380 0x562d36213760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:54624/0 (socket says 172.21.15.82:54624) 2023-09-23T09:26:49.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.982+0000 7f28d7fff700 1 -- 172.21.15.82:0/395314495 learned_addr learned my addr 172.21.15.82:0/395314495 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:26:49.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.982+0000 7f28d4ff9700 1 -- 172.21.15.82:0/1847347463 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f28cc0cc350 con 0x7f28d8101230 2023-09-23T09:26:49.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.982+0000 7f28d77fe700 1 --2- 172.21.15.82:0/395314495 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562d36213ca0 0x562d3620d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:26:49.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.982+0000 7f28d7fff700 1 --2- 172.21.15.82:0/1847347463 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f28c00a00c0 0x7f28c00a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:26:49.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.983+0000 7f28d6ffd700 1 -- 172.21.15.82:0/395314495 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562d36213380 msgr2=0x562d36213760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:26:49.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.983+0000 7f28d6ffd700 1 --2- 172.21.15.82:0/395314495 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562d36213380 0x562d36213760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:26:49.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.983+0000 7f28d6ffd700 1 -- 172.21.15.82:0/395314495 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562d36213ca0 msgr2=0x562d3620d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:26:49.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.983+0000 7f28d6ffd700 1 --2- 172.21.15.82:0/395314495 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562d36213ca0 0x562d3620d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:26:49.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.983+0000 7f28d6ffd700 1 -- 172.21.15.82:0/395314495 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562d35fdf630 con 0x562d3620dc40 2023-09-23T09:26:49.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.983+0000 7f28d6ffd700 1 --2- 172.21.15.82:0/395314495 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562d3620dc40 0x562d3620e0a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f28cc0c9aa0 tx=0x7f28cc009f50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9979f48e456805aa server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:26:49.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.983+0000 7f28d7fff700 1 --2- 172.21.15.82:0/1847347463 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f28c00a00c0 0x7f28c00a2580 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f28d0009fd0 tx=0x7f28d000b040 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:26:49.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.983+0000 7f28bdffb700 1 -- 172.21.15.82:0/395314495 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28cc065a90 con 0x562d3620dc40 2023-09-23T09:26:49.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.983+0000 7f28bdffb700 1 -- 172.21.15.82:0/395314495 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f28cc09a1f0 con 0x562d3620dc40 2023-09-23T09:26:49.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.983+0000 7f28bdffb700 1 -- 172.21.15.82:0/395314495 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28cc0c9d20 con 0x562d3620dc40 2023-09-23T09:26:49.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.984+0000 7f28f17a9b80 1 -- 172.21.15.82:0/395314495 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562d3620dc40 msgr2=0x562d3620e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:26:49.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.984+0000 7f28f17a9b80 1 --2- 172.21.15.82:0/395314495 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562d3620dc40 0x562d3620e0a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f28cc0c9aa0 tx=0x7f28cc009f50 comp rx=0 tx=0).stop 2023-09-23T09:26:49.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.984+0000 7f28f17a9b80 1 -- 172.21.15.82:0/395314495 shutdown_connections 2023-09-23T09:26:49.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.984+0000 7f28f17a9b80 1 --2- 172.21.15.82:0/395314495 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562d3620dc40 0x562d3620e0a0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:26:49.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.984+0000 7f28f17a9b80 1 --2- 172.21.15.82:0/395314495 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562d36213380 0x562d36213760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:26:49.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.984+0000 7f28f17a9b80 1 --2- 172.21.15.82:0/395314495 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562d36213ca0 0x562d3620d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:26:49.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.984+0000 7f28f17a9b80 1 -- 172.21.15.82:0/395314495 >> 172.21.15.82:0/395314495 conn(0x562d361820e0 msgr2=0x562d36208410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:26:49.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.984+0000 7f28f17a9b80 1 -- 172.21.15.82:0/395314495 shutdown_connections 2023-09-23T09:26:49.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.984+0000 7f28f17a9b80 1 -- 172.21.15.82:0/395314495 wait complete. 2023-09-23T09:26:49.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.985+0000 7f28f17a9b80 1 -- start start 2023-09-23T09:26:49.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.985+0000 7f28f17a9b80 1 Processor -- start 2023-09-23T09:26:49.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.986+0000 7f28f17a9b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562d3620dc40 0x562d36219c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:26:49.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.986+0000 7f28f17a9b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562d36213380 0x562d36216e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:26:49.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.986+0000 7f28f17a9b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562d36213ca0 0x562d36217470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:26:49.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.986+0000 7f28f17a9b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d3615f990 con 0x562d3620dc40 2023-09-23T09:26:49.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.986+0000 7f28f17a9b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d360fdbb0 con 0x562d36213380 2023-09-23T09:26:49.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.986+0000 7f28f17a9b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d360fd8b0 con 0x562d36213ca0 2023-09-23T09:26:49.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.986+0000 7f28f17a9b80 10 client.0 _ll_register_callbacks cb 0x562d36047a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:26:49.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.986+0000 7f28d77fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562d3620dc40 0x562d36219c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:26:49.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.986+0000 7f28d77fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562d3620dc40 0x562d36219c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40840/0 (socket says 172.21.15.82:40840) 2023-09-23T09:26:49.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.986+0000 7f28d77fe700 1 -- 172.21.15.82:0/3403364829 learned_addr learned my addr 172.21.15.82:0/3403364829 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:26:49.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.986+0000 7f28d7fff700 1 --2- 172.21.15.82:0/3403364829 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562d36213ca0 0x562d36217470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:26:49.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.986+0000 7f28d6ffd700 1 --2- 172.21.15.82:0/3403364829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562d36213380 0x562d36216e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:26:49.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.986+0000 7f28d77fe700 1 -- 172.21.15.82:0/3403364829 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562d36213ca0 msgr2=0x562d36217470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:26:49.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.986+0000 7f28d77fe700 1 --2- 172.21.15.82:0/3403364829 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562d36213ca0 0x562d36217470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:26:49.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.986+0000 7f28d77fe700 1 -- 172.21.15.82:0/3403364829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562d36213380 msgr2=0x562d36216e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:26:50.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.986+0000 7f28d77fe700 1 --2- 172.21.15.82:0/3403364829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562d36213380 0x562d36216e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:26:50.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.986+0000 7f28d77fe700 1 -- 172.21.15.82:0/3403364829 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28d81a5930 con 0x562d3620dc40 2023-09-23T09:26:50.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.987+0000 7f28d77fe700 1 --2- 172.21.15.82:0/3403364829 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562d3620dc40 0x562d36219c30 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f28c8012d20 tx=0x7f28c800f6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad5c7a0aef31a732 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:26:50.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.987+0000 7f28b6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:26:50.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.987+0000 7f28b6ffd700 1 -- 172.21.15.82:0/3403364829 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c8017070 con 0x562d3620dc40 2023-09-23T09:26:50.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.987+0000 7f28f17a9b80 1 -- 172.21.15.82:0/3403364829 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562d361dd1c0 con 0x562d3620dc40 2023-09-23T09:26:50.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.987+0000 7f28b6ffd700 1 -- 172.21.15.82:0/3403364829 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(135..135 src has 1..135) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f28c800fc30 con 0x562d3620dc40 2023-09-23T09:26:50.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.987+0000 7f28b6ffd700 1 -- 172.21.15.82:0/3403364829 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7f28c80122e0 con 0x562d3620dc40 2023-09-23T09:26:50.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.987+0000 7f28f17a9b80 10 client.17199 fetch_fsmap learned FSMap version 78 2023-09-23T09:26:50.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.987+0000 7f28f17a9b80 1 -- 172.21.15.82:0/3403364829 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=78,monmap=4+}) v3 -- 0x562d35f8bde0 con 0x562d3620dc40 2023-09-23T09:26:50.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.988+0000 7f28b6ffd700 1 -- 172.21.15.82:0/3403364829 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562d361dd1c0 con 0x562d3620dc40 2023-09-23T09:26:50.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.988+0000 7f28b6ffd700 1 -- 172.21.15.82:0/3403364829 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 78) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f28c8022030 con 0x562d3620dc40 2023-09-23T09:26:50.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.988+0000 7f28f17a9b80 10 client.17199 fetch_fsmap finished waiting for FSMap version 78 2023-09-23T09:26:50.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.988+0000 7f28f17a9b80 10 client.17199 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:26:50.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.988+0000 7f28f17a9b80 20 client.17199 populate_metadata read hostname 'smithi082' 2023-09-23T09:26:50.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.988+0000 7f28f17a9b80 1 --2- 172.21.15.82:0/3403364829 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x562d362273e0 0x562d36229800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:26:50.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.988+0000 7f28f17a9b80 4 client.17199 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:26:50.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.988+0000 7f28f17a9b80 1 -- 172.21.15.82:0/3403364829 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562d36105ba0 con 0x562d362273e0 2023-09-23T09:26:50.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.988+0000 7f28d6ffd700 1 --2- 172.21.15.82:0/3403364829 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x562d362273e0 0x562d36229800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:26:50.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.989+0000 7f28d6ffd700 1 --2- 172.21.15.82:0/3403364829 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x562d362273e0 0x562d36229800 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=16924b9a62fa42f7 server_cookie=c9fd022fdb44918e in_seq=0 out_seq=0 2023-09-23T09:26:50.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.989+0000 7f28b6ffd700 10 client.17199 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:26:50.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.989+0000 7f28b6ffd700 1 -- 172.21.15.82:0/3403364829 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x562d36105ba0 con 0x562d362273e0 2023-09-23T09:26:50.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.989+0000 7f28b6ffd700 10 client.17199 handle_command_reply: tid=0 2023-09-23T09:26:50.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.990+0000 7f28f17a9b80 1 client.17199 shutdown 2023-09-23T09:26:50.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.990+0000 7f28f17a9b80 1 -- 172.21.15.82:0/3403364829 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562d3620dc40 msgr2=0x562d36219c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:26:50.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.990+0000 7f28f17a9b80 1 --2- 172.21.15.82:0/3403364829 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562d3620dc40 0x562d36219c30 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f28c8012d20 tx=0x7f28c800f6a0 comp rx=0 tx=0).stop 2023-09-23T09:26:50.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.990+0000 7f28f17a9b80 1 -- 172.21.15.82:0/3403364829 shutdown_connections 2023-09-23T09:26:50.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.990+0000 7f28f17a9b80 1 --2- 172.21.15.82:0/3403364829 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562d36213ca0 0x562d36217470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:26:50.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.990+0000 7f28f17a9b80 1 --2- 172.21.15.82:0/3403364829 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x562d362273e0 0x562d36229800 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:26:50.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.990+0000 7f28f17a9b80 1 --2- 172.21.15.82:0/3403364829 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562d3620dc40 0x562d36219c30 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:26:50.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.990+0000 7f28f17a9b80 1 --2- 172.21.15.82:0/3403364829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562d36213380 0x562d36216e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:26:50.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.990+0000 7f28f17a9b80 1 -- 172.21.15.82:0/3403364829 >> 172.21.15.82:0/3403364829 conn(0x562d361820e0 msgr2=0x562d36202b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:26:50.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.990+0000 7f28b6ffd700 0 client.17199 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:26:50.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.990+0000 7f28f17a9b80 1 -- 172.21.15.82:0/3403364829 shutdown_connections 2023-09-23T09:26:50.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.990+0000 7f28f17a9b80 1 -- 172.21.15.82:0/3403364829 wait complete. 2023-09-23T09:26:50.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:49.990+0000 7f28f17a9b80 20 client.17199 trim_cache size 0 max 16384 2023-09-23T09:26:50.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.016+0000 7f28f17a9b80 1 Processor -- start 2023-09-23T09:26:50.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.016+0000 7f28f17a9b80 1 -- start start 2023-09-23T09:26:50.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.016+0000 7f28f17a9b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562d3620dc40 0x562d3620d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:26:50.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.016+0000 7f28f17a9b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562d36213380 0x562d36219760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:26:50.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.016+0000 7f28f17a9b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562d36213ca0 0x562d362080a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:26:50.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.016+0000 7f28f17a9b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d35fe1920 con 0x562d36213380 2023-09-23T09:26:50.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.016+0000 7f28f17a9b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d36224a80 con 0x562d36213ca0 2023-09-23T09:26:50.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.016+0000 7f28f17a9b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d362153a0 con 0x562d3620dc40 2023-09-23T09:26:50.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.017+0000 7f28d6ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562d36213380 0x562d36219760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:26:50.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.017+0000 7f28d6ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562d36213380 0x562d36219760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40856/0 (socket says 172.21.15.82:40856) 2023-09-23T09:26:50.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.017+0000 7f28d6ffd700 1 -- 172.21.15.82:0/2306620808 learned_addr learned my addr 172.21.15.82:0/2306620808 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:26:50.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.017+0000 7f28d7fff700 1 --2- 172.21.15.82:0/2306620808 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562d36213ca0 0x562d362080a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:26:50.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.017+0000 7f28d77fe700 1 --2- 172.21.15.82:0/2306620808 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562d3620dc40 0x562d3620d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:26:50.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.017+0000 7f28d6ffd700 1 -- 172.21.15.82:0/2306620808 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562d3620dc40 msgr2=0x562d3620d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:26:50.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.017+0000 7f28d6ffd700 1 --2- 172.21.15.82:0/2306620808 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562d3620dc40 0x562d3620d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:26:50.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.017+0000 7f28d6ffd700 1 -- 172.21.15.82:0/2306620808 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562d36213ca0 msgr2=0x562d362080a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:26:50.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.017+0000 7f28d6ffd700 1 --2- 172.21.15.82:0/2306620808 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562d36213ca0 0x562d362080a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:26:50.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.017+0000 7f28d6ffd700 1 -- 172.21.15.82:0/2306620808 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562d35f74c60 con 0x562d36213380 2023-09-23T09:26:50.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.017+0000 7f28d6ffd700 1 --2- 172.21.15.82:0/2306620808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562d36213380 0x562d36219760 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f28cc0c9b00 tx=0x7f28cc065a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cc92512201e4290 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:26:50.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.018+0000 7f28be7fc700 1 -- 172.21.15.82:0/2306620808 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28cc099af0 con 0x562d36213380 2023-09-23T09:26:50.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.018+0000 7f28be7fc700 1 -- 172.21.15.82:0/2306620808 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f28cc09d920 con 0x562d36213380 2023-09-23T09:26:50.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.018+0000 7f28be7fc700 1 -- 172.21.15.82:0/2306620808 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28cc097f90 con 0x562d36213380 2023-09-23T09:26:50.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.018+0000 7f28f17a9b80 1 -- 172.21.15.82:0/2306620808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562d36213380 msgr2=0x562d36219760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:26:50.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.018+0000 7f28f17a9b80 1 --2- 172.21.15.82:0/2306620808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562d36213380 0x562d36219760 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f28cc0c9b00 tx=0x7f28cc065a20 comp rx=0 tx=0).stop 2023-09-23T09:26:50.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.018+0000 7f28f17a9b80 1 -- 172.21.15.82:0/2306620808 shutdown_connections 2023-09-23T09:26:50.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.018+0000 7f28f17a9b80 1 --2- 172.21.15.82:0/2306620808 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562d36213ca0 0x562d362080a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:26:50.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.019+0000 7f28f17a9b80 1 --2- 172.21.15.82:0/2306620808 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562d3620dc40 0x562d3620d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:26:50.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.019+0000 7f28f17a9b80 1 --2- 172.21.15.82:0/2306620808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562d36213380 0x562d36219760 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:26:50.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.019+0000 7f28f17a9b80 1 -- 172.21.15.82:0/2306620808 >> 172.21.15.82:0/2306620808 conn(0x562d361820e0 msgr2=0x562d36222be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:26:50.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.019+0000 7f28f17a9b80 1 -- 172.21.15.82:0/2306620808 shutdown_connections 2023-09-23T09:26:50.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.019+0000 7f28f17a9b80 1 -- 172.21.15.82:0/2306620808 wait complete. 2023-09-23T09:26:50.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.019+0000 7f28f17a9b80 1 -- start start 2023-09-23T09:26:50.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.019+0000 7f28f17a9b80 1 Processor -- start 2023-09-23T09:26:50.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.020+0000 7f28f17a9b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562d3620dc40 0x562d36210240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:26:50.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.020+0000 7f28f17a9b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562d36213380 0x562d3620ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:26:50.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.020+0000 7f28f17a9b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562d36213ca0 0x562d3620f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:26:50.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.020+0000 7f28f17a9b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d36210950 con 0x562d36213ca0 2023-09-23T09:26:50.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.020+0000 7f28f17a9b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d36210ac0 con 0x562d3620dc40 2023-09-23T09:26:50.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.020+0000 7f28f17a9b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d3620f880 con 0x562d36213380 2023-09-23T09:26:50.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.020+0000 7f28f17a9b80 10 client.0 _ll_register_callbacks cb 0x562d36047a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:26:50.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.020+0000 7f28d77fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562d3620dc40 0x562d36210240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:26:50.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.020+0000 7f28d77fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562d3620dc40 0x562d36210240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:54650/0 (socket says 172.21.15.82:54650) 2023-09-23T09:26:50.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.020+0000 7f28d7fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562d36213ca0 0x562d3620f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:26:50.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.020+0000 7f28d77fe700 1 -- 172.21.15.82:0/379770197 learned_addr learned my addr 172.21.15.82:0/379770197 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:26:50.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.020+0000 7f28d6ffd700 1 --2- 172.21.15.82:0/379770197 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562d36213380 0x562d3620ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:26:50.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.020+0000 7f28d77fe700 1 -- 172.21.15.82:0/379770197 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562d36213380 msgr2=0x562d3620ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:26:50.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.020+0000 7f28d77fe700 1 --2- 172.21.15.82:0/379770197 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562d36213380 0x562d3620ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:26:50.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.020+0000 7f28d77fe700 1 -- 172.21.15.82:0/379770197 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562d36213ca0 msgr2=0x562d3620f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:26:50.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.020+0000 7f28d77fe700 1 --2- 172.21.15.82:0/379770197 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562d36213ca0 0x562d3620f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:26:50.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.020+0000 7f28d77fe700 1 -- 172.21.15.82:0/379770197 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562d35fdf630 con 0x562d3620dc40 2023-09-23T09:26:50.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.021+0000 7f28d7fff700 1 --2- 172.21.15.82:0/379770197 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562d36213ca0 0x562d3620f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:26:50.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.021+0000 7f28d77fe700 1 --2- 172.21.15.82:0/379770197 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562d3620dc40 0x562d36210240 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f28c8010e50 tx=0x7f28c800fe60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b627622d4ea271b0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:26:50.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.021+0000 7f28b6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-09-23T09:26:50.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.021+0000 7f28b6ffd700 1 -- 172.21.15.82:0/379770197 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c8017040 con 0x562d3620dc40 2023-09-23T09:26:50.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.021+0000 7f28f17a9b80 1 -- 172.21.15.82:0/379770197 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562d362008b0 con 0x562d3620dc40 2023-09-23T09:26:50.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.021+0000 7f28b6ffd700 1 -- 172.21.15.82:0/379770197 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(135..135 src has 1..135) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f28c801ccb0 con 0x562d3620dc40 2023-09-23T09:26:50.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.021+0000 7f28b6ffd700 1 -- 172.21.15.82:0/379770197 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7f28c8005da0 con 0x562d3620dc40 2023-09-23T09:26:50.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.021+0000 7f28f17a9b80 10 client.26873 fetch_fsmap learned FSMap version 78 2023-09-23T09:26:50.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.021+0000 7f28f17a9b80 1 -- 172.21.15.82:0/379770197 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=78,monmap=4+}) v3 -- 0x562d35fb2250 con 0x562d3620dc40 2023-09-23T09:26:50.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.022+0000 7f28b6ffd700 1 -- 172.21.15.82:0/379770197 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562d362008b0 con 0x562d3620dc40 2023-09-23T09:26:50.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.022+0000 7f28b6ffd700 1 -- 172.21.15.82:0/379770197 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 78) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f28c8010430 con 0x562d3620dc40 2023-09-23T09:26:50.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.022+0000 7f28f17a9b80 10 client.26873 fetch_fsmap finished waiting for FSMap version 78 2023-09-23T09:26:50.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.022+0000 7f28f17a9b80 10 client.26873 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:26:50.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.022+0000 7f28f17a9b80 20 client.26873 populate_metadata read hostname 'smithi082' 2023-09-23T09:26:50.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.022+0000 7f28f17a9b80 1 --2- 172.21.15.82:0/379770197 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x562d3627c2f0 0x562d3627e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:26:50.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.022+0000 7f28f17a9b80 4 client.26873 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:26:50.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.022+0000 7f28f17a9b80 1 -- 172.21.15.82:0/379770197 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x562d36158970 con 0x562d3627c2f0 2023-09-23T09:26:50.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.022+0000 7f28d6ffd700 1 --2- 172.21.15.82:0/379770197 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x562d3627c2f0 0x562d3627e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:26:50.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.023+0000 7f28b6ffd700 10 client.26873 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:26:50.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.023+0000 7f28d6ffd700 1 --2- 172.21.15.82:0/379770197 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x562d3627c2f0 0x562d3627e710 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=66001c658a91d6b6 server_cookie=dad0df7fa2c28bf1 in_seq=0 out_seq=0 2023-09-23T09:26:50.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.023+0000 7f28b6ffd700 1 -- 172.21.15.82:0/379770197 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x562d36158970 con 0x562d3627c2f0 2023-09-23T09:26:50.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.023+0000 7f28b6ffd700 10 client.26873 handle_command_reply: tid=0 2023-09-23T09:26:50.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.023+0000 7f28f17a9b80 1 client.26873 shutdown 2023-09-23T09:26:50.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.023+0000 7f28f17a9b80 1 -- 172.21.15.82:0/379770197 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562d3620dc40 msgr2=0x562d36210240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:26:50.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.023+0000 7f28f17a9b80 1 --2- 172.21.15.82:0/379770197 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562d3620dc40 0x562d36210240 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f28c8010e50 tx=0x7f28c800fe60 comp rx=0 tx=0).stop 2023-09-23T09:26:50.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.023+0000 7f28f17a9b80 1 -- 172.21.15.82:0/379770197 shutdown_connections 2023-09-23T09:26:50.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.023+0000 7f28f17a9b80 1 --2- 172.21.15.82:0/379770197 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x562d3627c2f0 0x562d3627e710 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:26:50.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.023+0000 7f28f17a9b80 1 --2- 172.21.15.82:0/379770197 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562d36213ca0 0x562d3620f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:26:50.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.023+0000 7f28f17a9b80 1 --2- 172.21.15.82:0/379770197 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562d3620dc40 0x562d36210240 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:26:50.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.023+0000 7f28b6ffd700 0 client.26873 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:26:50.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.023+0000 7f28f17a9b80 1 --2- 172.21.15.82:0/379770197 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562d36213380 0x562d3620ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:26:50.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.023+0000 7f28f17a9b80 1 -- 172.21.15.82:0/379770197 >> 172.21.15.82:0/379770197 conn(0x562d361820e0 msgr2=0x562d362080a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:26:50.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.023+0000 7f28f17a9b80 1 -- 172.21.15.82:0/379770197 shutdown_connections 2023-09-23T09:26:50.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.024+0000 7f28f17a9b80 1 -- 172.21.15.82:0/379770197 wait complete. 2023-09-23T09:26:50.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.024+0000 7f28f17a9b80 20 client.26873 trim_cache size 0 max 16384 2023-09-23T09:26:50.031 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:26:50.031 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-23T09:26:50.031 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:26:50.031 INFO:teuthology.orchestra.run.smithi082.stdout: "047cbc72-e254-4787-b038-382de9c1a9a4": { 2023-09-23T09:26:50.031 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:26:50.032 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "047cbc72-e254-4787-b038-382de9c1a9a4", 2023-09-23T09:26:50.032 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:26:50.032 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:26:50.032 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:26:50.032 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:26:50.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.024+0000 7f28dddff700 1 -- 172.21.15.82:0/1847347463 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f28c00a00c0 msgr2=0x7f28c00a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:26:50.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.024+0000 7f28dddff700 1 --2- 172.21.15.82:0/1847347463 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f28c00a00c0 0x7f28c00a2580 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f28d0009fd0 tx=0x7f28d000b040 comp rx=0 tx=0).stop 2023-09-23T09:26:50.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.024+0000 7f28dddff700 1 -- 172.21.15.82:0/1847347463 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28d8101230 msgr2=0x7f28d819eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:26:50.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.024+0000 7f28dddff700 1 --2- 172.21.15.82:0/1847347463 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28d8101230 0x7f28d819eef0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f28cc009810 tx=0x7f28cc00fa00 comp rx=0 tx=0).stop 2023-09-23T09:26:50.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.024+0000 7f28dddff700 1 -- 172.21.15.82:0/1847347463 shutdown_connections 2023-09-23T09:26:50.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.024+0000 7f28dddff700 1 --2- 172.21.15.82:0/1847347463 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f28c00a00c0 0x7f28c00a2580 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:26:50.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.024+0000 7f28dddff700 1 --2- 172.21.15.82:0/1847347463 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f28d8106880 0x7f28d8198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:26:50.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.024+0000 7f28dddff700 1 --2- 172.21.15.82:0/1847347463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f28d8100870 0x7f28d819e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:26:50.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.024+0000 7f28dddff700 1 --2- 172.21.15.82:0/1847347463 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28d8101230 0x7f28d819eef0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:26:50.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.024+0000 7f28dddff700 1 -- 172.21.15.82:0/1847347463 >> 172.21.15.82:0/1847347463 conn(0x7f28d80fc3a0 msgr2=0x7f28d810bd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:26:50.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.025+0000 7f28dddff700 1 -- 172.21.15.82:0/1847347463 shutdown_connections 2023-09-23T09:26:50.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:26:50.025+0000 7f28dddff700 1 -- 172.21.15.82:0/1847347463 wait complete. 2023-09-23T09:26:50.048 INFO:tasks.cephfs.filesystem:scrub status for tag:047cbc72-e254-4787-b038-382de9c1a9a4 - {'path': '/', 'tag': '047cbc72-e254-4787-b038-382de9c1a9a4', 'options': 'recursive,force'} 2023-09-23T09:26:50.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:26:50 smithi082 ceph-mon[97694]: pgmap v947: 97 pgs: 97 active+clean; 14 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 33 MiB/s wr, 186 op/s 2023-09-23T09:26:50.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:26:50 smithi161 ceph-mon[99580]: pgmap v947: 97 pgs: 97 active+clean; 14 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 33 MiB/s wr, 186 op/s 2023-09-23T09:26:51.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:26:50 smithi135 ceph-mon[99205]: pgmap v947: 97 pgs: 97 active+clean; 14 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 33 MiB/s wr, 186 op/s 2023-09-23T09:26:52.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:26:52 smithi082 ceph-mon[97694]: pgmap v948: 97 pgs: 97 active+clean; 14 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 22 MiB/s wr, 121 op/s 2023-09-23T09:26:52.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:26:52 smithi161 ceph-mon[99580]: pgmap v948: 97 pgs: 97 active+clean; 14 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 22 MiB/s wr, 121 op/s 2023-09-23T09:26:53.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:26:52 smithi135 ceph-mon[99205]: pgmap v948: 97 pgs: 97 active+clean; 14 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 22 MiB/s wr, 121 op/s 2023-09-23T09:26:54.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:26:54 smithi082 ceph-mon[97694]: pgmap v949: 97 pgs: 97 active+clean; 14 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 22 MiB/s wr, 121 op/s 2023-09-23T09:26:54.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:26:54 smithi161 ceph-mon[99580]: pgmap v949: 97 pgs: 97 active+clean; 14 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 22 MiB/s wr, 121 op/s 2023-09-23T09:26:55.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:26:54 smithi135 ceph-mon[99205]: pgmap v949: 97 pgs: 97 active+clean; 14 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 22 MiB/s wr, 121 op/s 2023-09-23T09:26:56.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:26:56 smithi082 ceph-mon[97694]: pgmap v950: 97 pgs: 97 active+clean; 14 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 33 MiB/s wr, 188 op/s 2023-09-23T09:26:56.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:26:56 smithi161 ceph-mon[99580]: pgmap v950: 97 pgs: 97 active+clean; 14 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 33 MiB/s wr, 188 op/s 2023-09-23T09:26:57.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:26:56 smithi135 ceph-mon[99205]: pgmap v950: 97 pgs: 97 active+clean; 14 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 33 MiB/s wr, 188 op/s 2023-09-23T09:26:58.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:26:57 smithi135 ceph-mon[99205]: pgmap v951: 97 pgs: 97 active+clean; 14 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 22 MiB/s wr, 131 op/s 2023-09-23T09:26:58.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:26:57 smithi082 ceph-mon[97694]: pgmap v951: 97 pgs: 97 active+clean; 14 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 22 MiB/s wr, 131 op/s 2023-09-23T09:26:58.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:26:57 smithi161 ceph-mon[99580]: pgmap v951: 97 pgs: 97 active+clean; 14 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 22 MiB/s wr, 131 op/s 2023-09-23T09:27:00.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:27:00 smithi082 ceph-mon[97694]: pgmap v952: 97 pgs: 97 active+clean; 14 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 33 MiB/s wr, 198 op/s 2023-09-23T09:27:00.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:27:00 smithi161 ceph-mon[99580]: pgmap v952: 97 pgs: 97 active+clean; 14 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 33 MiB/s wr, 198 op/s 2023-09-23T09:27:01.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:27:00 smithi135 ceph-mon[99205]: pgmap v952: 97 pgs: 97 active+clean; 14 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 33 MiB/s wr, 198 op/s 2023-09-23T09:27:02.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:27:02 smithi082 ceph-mon[97694]: pgmap v953: 97 pgs: 97 active+clean; 14 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 22 MiB/s wr, 132 op/s 2023-09-23T09:27:02.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:27:02 smithi161 ceph-mon[99580]: pgmap v953: 97 pgs: 97 active+clean; 14 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 22 MiB/s wr, 132 op/s 2023-09-23T09:27:03.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:27:02 smithi135 ceph-mon[99205]: pgmap v953: 97 pgs: 97 active+clean; 14 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 22 MiB/s wr, 132 op/s 2023-09-23T09:27:03.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:27:03 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:27:03.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:27:03 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:27:04.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:27:03 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:27:04.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:27:04 smithi082 ceph-mon[97694]: pgmap v954: 97 pgs: 97 active+clean; 14 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 22 MiB/s wr, 132 op/s 2023-09-23T09:27:04.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:27:04 smithi161 ceph-mon[99580]: pgmap v954: 97 pgs: 97 active+clean; 14 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 22 MiB/s wr, 132 op/s 2023-09-23T09:27:05.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:27:04 smithi135 ceph-mon[99205]: pgmap v954: 97 pgs: 97 active+clean; 14 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 22 MiB/s wr, 132 op/s 2023-09-23T09:27:06.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:27:05 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:27:06.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:27:05 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:27:06.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:27:05 smithi135 ceph-mon[99205]: pgmap v955: 97 pgs: 97 active+clean; 14 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 32 MiB/s wr, 216 op/s 2023-09-23T09:27:06.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:27:05 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:27:06.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:27:05 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:27:06.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:27:05 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:27:06.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:27:05 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:27:06.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:27:05 smithi082 ceph-mon[97694]: pgmap v955: 97 pgs: 97 active+clean; 14 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 32 MiB/s wr, 216 op/s 2023-09-23T09:27:06.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:27:05 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:27:06.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:27:05 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:27:06.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:27:05 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:27:06.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:27:05 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:27:06.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:27:05 smithi161 ceph-mon[99580]: pgmap v955: 97 pgs: 97 active+clean; 14 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 32 MiB/s wr, 216 op/s 2023-09-23T09:27:06.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:27:05 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:27:06.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:27:05 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:27:07.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:27:07 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:27:07.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:27:07 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:27:07.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:27:07 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:27:07.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:27:07 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:27:07.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:27:07 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:27:07.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:27:07 smithi135 ceph-mon[99205]: osdmap e136: 12 total, 12 up, 12 in 2023-09-23T09:27:07.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:27:07 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:27:07.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:27:07 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:27:07.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:27:07 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:27:07.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:27:07 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:27:07.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:27:07 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:27:07.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:27:07 smithi082 ceph-mon[97694]: osdmap e136: 12 total, 12 up, 12 in 2023-09-23T09:27:07.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:27:07 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:27:07.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:27:07 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:27:07.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:27:07 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:27:07.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:27:07 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:27:07.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:27:07 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:27:07.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:27:07 smithi161 ceph-mon[99580]: osdmap e136: 12 total, 12 up, 12 in 2023-09-23T09:27:08.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:27:08 smithi135 ceph-mon[99205]: pgmap v957: 97 pgs: 97 active+clean; 14 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 26 MiB/s wr, 179 op/s 2023-09-23T09:27:08.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:27:08 smithi082 ceph-mon[97694]: pgmap v957: 97 pgs: 97 active+clean; 14 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 26 MiB/s wr, 179 op/s 2023-09-23T09:27:08.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:27:08 smithi161 ceph-mon[99580]: pgmap v957: 97 pgs: 97 active+clean; 14 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 26 MiB/s wr, 179 op/s 2023-09-23T09:27:10.400 INFO:teuthology.orchestra.run.smithi082.stderr:done. 2023-09-23T09:27:10.423 DEBUG:teuthology.orchestra.run.smithi082:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- pgbench -c 100 -j 4 --progress=5 --time=900' 2023-09-23T09:27:10.826 INFO:teuthology.orchestra.run.smithi082.stderr:starting vacuum...end. 2023-09-23T09:27:10.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:27:10 smithi082 ceph-mon[97694]: pgmap v958: 97 pgs: 97 active+clean; 14 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 25 MiB/s wr, 152 op/s 2023-09-23T09:27:10.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:27:10 smithi161 ceph-mon[99580]: pgmap v958: 97 pgs: 97 active+clean; 14 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 25 MiB/s wr, 152 op/s 2023-09-23T09:27:11.064 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:27:10 smithi135 ceph-mon[99205]: pgmap v958: 97 pgs: 97 active+clean; 14 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 25 MiB/s wr, 152 op/s 2023-09-23T09:27:12.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:27:12 smithi082 ceph-mon[97694]: pgmap v959: 97 pgs: 97 active+clean; 14 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 25 MiB/s wr, 152 op/s 2023-09-23T09:27:12.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:27:12 smithi082 ceph-mon[97694]: osdmap e137: 12 total, 12 up, 12 in 2023-09-23T09:27:12.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:27:12 smithi161 ceph-mon[99580]: pgmap v959: 97 pgs: 97 active+clean; 14 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 25 MiB/s wr, 152 op/s 2023-09-23T09:27:12.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:27:12 smithi161 ceph-mon[99580]: osdmap e137: 12 total, 12 up, 12 in 2023-09-23T09:27:13.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:27:12 smithi135 ceph-mon[99205]: pgmap v959: 97 pgs: 97 active+clean; 14 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 25 MiB/s wr, 152 op/s 2023-09-23T09:27:13.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:27:12 smithi135 ceph-mon[99205]: osdmap e137: 12 total, 12 up, 12 in 2023-09-23T09:27:14.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:27:14 smithi082 ceph-mon[97694]: pgmap v961: 97 pgs: 97 active+clean; 14 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 16 MiB/s wr, 65 op/s 2023-09-23T09:27:14.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:27:14 smithi161 ceph-mon[99580]: pgmap v961: 97 pgs: 97 active+clean; 14 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 16 MiB/s wr, 65 op/s 2023-09-23T09:27:15.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:27:14 smithi135 ceph-mon[99205]: pgmap v961: 97 pgs: 97 active+clean; 14 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 16 MiB/s wr, 65 op/s 2023-09-23T09:27:15.827 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 5.0 s, 828.8 tps, lat 104.684 ms stddev 137.539 2023-09-23T09:27:16.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:27:16 smithi082 ceph-mon[97694]: pgmap v962: 97 pgs: 97 active+clean; 14 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 568 KiB/s rd, 23 MiB/s wr, 181 op/s 2023-09-23T09:27:16.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:27:16 smithi161 ceph-mon[99580]: pgmap v962: 97 pgs: 97 active+clean; 14 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 568 KiB/s rd, 23 MiB/s wr, 181 op/s 2023-09-23T09:27:17.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:27:16 smithi135 ceph-mon[99205]: pgmap v962: 97 pgs: 97 active+clean; 14 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 568 KiB/s rd, 23 MiB/s wr, 181 op/s 2023-09-23T09:27:18.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:27:17 smithi135 ceph-mon[99205]: pgmap v963: 97 pgs: 97 active+clean; 14 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 20 MiB/s wr, 161 op/s 2023-09-23T09:27:18.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:27:17 smithi082 ceph-mon[97694]: pgmap v963: 97 pgs: 97 active+clean; 14 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 20 MiB/s wr, 161 op/s 2023-09-23T09:27:18.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:27:17 smithi161 ceph-mon[99580]: pgmap v963: 97 pgs: 97 active+clean; 14 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 20 MiB/s wr, 161 op/s 2023-09-23T09:27:20.050 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:27:20.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.425+0000 7fd2aa5ff700 1 -- 172.21.15.82:0/1752786692 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2a4100140 msgr2=0x7fd2a4104600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:27:20.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.425+0000 7fd2aa5ff700 1 --2- 172.21.15.82:0/1752786692 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2a4100140 0x7fd2a4104600 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fd294009990 tx=0x7fd294009ca0 comp rx=0 tx=0).stop 2023-09-23T09:27:20.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.426+0000 7fd2aa5ff700 1 -- 172.21.15.82:0/1752786692 shutdown_connections 2023-09-23T09:27:20.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.426+0000 7fd2aa5ff700 1 --2- 172.21.15.82:0/1752786692 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2a4104c20 0x7fd2a41050d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:27:20.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.426+0000 7fd2aa5ff700 1 --2- 172.21.15.82:0/1752786692 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd2a40ff820 0x7fd2a40ffc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:27:20.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.426+0000 7fd2aa5ff700 1 --2- 172.21.15.82:0/1752786692 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2a4100140 0x7fd2a4104600 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:27:20.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.426+0000 7fd2aa5ff700 1 -- 172.21.15.82:0/1752786692 >> 172.21.15.82:0/1752786692 conn(0x7fd2a40fb270 msgr2=0x7fd2a40fd690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:27:20.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.431+0000 7fd2aa5ff700 1 -- 172.21.15.82:0/1752786692 shutdown_connections 2023-09-23T09:27:20.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.431+0000 7fd2aa5ff700 1 -- 172.21.15.82:0/1752786692 wait complete. 2023-09-23T09:27:20.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.437+0000 7fd2aa5ff700 1 Processor -- start 2023-09-23T09:27:20.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.443+0000 7fd2aa5ff700 1 -- start start 2023-09-23T09:27:20.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.443+0000 7fd2aa5ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2a4100140 0x7fd2a41136e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:27:20.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.443+0000 7fd2aa5ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2a4104c20 0x7fd2a4113c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:27:20.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.443+0000 7fd2aa5ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd2a410c6f0 0x7fd2a410cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:27:20.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.443+0000 7fd2aa5ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a410d280 con 0x7fd2a4100140 2023-09-23T09:27:20.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.443+0000 7fd2aa5ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a410d3f0 con 0x7fd2a4104c20 2023-09-23T09:27:20.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.443+0000 7fd2aa5ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a410d5b0 con 0x7fd2a410c6f0 2023-09-23T09:27:20.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.444+0000 7fd2a8b9c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd2a410c6f0 0x7fd2a410cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:27:20.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.444+0000 7fd2a3fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2a4100140 0x7fd2a41136e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:27:20.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.444+0000 7fd2a3fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2a4100140 0x7fd2a41136e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48404/0 (socket says 172.21.15.82:48404) 2023-09-23T09:27:20.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.444+0000 7fd2a8b9c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd2a410c6f0 0x7fd2a410cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:45612/0 (socket says 172.21.15.82:45612) 2023-09-23T09:27:20.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.444+0000 7fd2a3fff700 1 -- 172.21.15.82:0/1795656947 learned_addr learned my addr 172.21.15.82:0/1795656947 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:27:20.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.444+0000 7fd2a37fe700 1 --2- 172.21.15.82:0/1795656947 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2a4104c20 0x7fd2a4113c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:27:20.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.444+0000 7fd2a3fff700 1 -- 172.21.15.82:0/1795656947 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd2a410c6f0 msgr2=0x7fd2a410cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:27:20.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.444+0000 7fd2a3fff700 1 --2- 172.21.15.82:0/1795656947 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd2a410c6f0 0x7fd2a410cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:27:20.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.444+0000 7fd2a3fff700 1 -- 172.21.15.82:0/1795656947 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2a4104c20 msgr2=0x7fd2a4113c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:27:20.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.444+0000 7fd2a3fff700 1 --2- 172.21.15.82:0/1795656947 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2a4104c20 0x7fd2a4113c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:27:20.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.444+0000 7fd2a3fff700 1 -- 172.21.15.82:0/1795656947 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2940095f0 con 0x7fd2a4100140 2023-09-23T09:27:20.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.445+0000 7fd2a3fff700 1 --2- 172.21.15.82:0/1795656947 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2a4100140 0x7fd2a41136e0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fd29c0094f0 tx=0x7fd29c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:27:20.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.445+0000 7fd2a17fa700 1 -- 172.21.15.82:0/1795656947 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd29c00dd20 con 0x7fd2a4100140 2023-09-23T09:27:20.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.445+0000 7fd2a17fa700 1 -- 172.21.15.82:0/1795656947 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd29c00de80 con 0x7fd2a4100140 2023-09-23T09:27:20.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.445+0000 7fd2a17fa700 1 -- 172.21.15.82:0/1795656947 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd29c023600 con 0x7fd2a4100140 2023-09-23T09:27:20.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.446+0000 7fd2aa5ff700 1 -- 172.21.15.82:0/1795656947 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2a4111410 con 0x7fd2a4100140 2023-09-23T09:27:20.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.446+0000 7fd2aa5ff700 1 -- 172.21.15.82:0/1795656947 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2a41118d0 con 0x7fd2a4100140 2023-09-23T09:27:20.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.454+0000 7fd2a17fa700 1 -- 172.21.15.82:0/1795656947 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7fd29c023760 con 0x7fd2a4100140 2023-09-23T09:27:20.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.456+0000 7fd2bde53b80 1 Processor -- start 2023-09-23T09:27:20.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.456+0000 7fd2bde53b80 1 -- start start 2023-09-23T09:27:20.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.457+0000 7fd2bde53b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f6ced02380 0x55f6ced02760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:27:20.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.457+0000 7fd2bde53b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f6ced02ca0 0x55f6cecfc700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:27:20.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.457+0000 7fd2bde53b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f6cecfcc40 0x55f6cecfd0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:27:20.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.457+0000 7fd2bde53b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6cec647b0 con 0x55f6ced02ca0 2023-09-23T09:27:20.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.457+0000 7fd2bde53b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6cec55780 con 0x55f6ced02380 2023-09-23T09:27:20.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.457+0000 7fd2bde53b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6cec530a0 con 0x55f6cecfcc40 2023-09-23T09:27:20.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.457+0000 7fd2a17fa700 1 --2- 172.21.15.82:0/1795656947 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fd28c0a0290 0x7fd28c0a2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:27:20.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.458+0000 7fd2a17fa700 1 -- 172.21.15.82:0/1795656947 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fd29c0dced0 con 0x7fd2a4100140 2023-09-23T09:27:20.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.458+0000 7fd2a8b9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f6ced02380 0x55f6ced02760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:27:20.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.458+0000 7fd2a8b9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f6ced02380 0x55f6ced02760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:42150/0 (socket says 172.21.15.82:42150) 2023-09-23T09:27:20.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.458+0000 7fd2a8b9c700 1 -- 172.21.15.82:0/3523313817 learned_addr learned my addr 172.21.15.82:0/3523313817 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:27:20.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.458+0000 7fd2a37fe700 1 --2- 172.21.15.82:0/3523313817 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f6cecfcc40 0x55f6cecfd0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:27:20.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.459+0000 7fd2a8b9c700 1 -- 172.21.15.82:0/3523313817 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f6cecfcc40 msgr2=0x55f6cecfd0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:27:20.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.459+0000 7fd2a8b9c700 1 --2- 172.21.15.82:0/3523313817 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f6cecfcc40 0x55f6cecfd0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:27:20.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.459+0000 7fd2a8b9c700 1 -- 172.21.15.82:0/3523313817 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f6ced02ca0 msgr2=0x55f6cecfc700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:27:20.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.459+0000 7fd2a8b9c700 1 --2- 172.21.15.82:0/3523313817 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f6ced02ca0 0x55f6cecfc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:27:20.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.459+0000 7fd2a8b9c700 1 -- 172.21.15.82:0/3523313817 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f6ceace630 con 0x55f6ced02380 2023-09-23T09:27:20.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.459+0000 7fd2a8b9c700 1 --2- 172.21.15.82:0/1795656947 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fd28c0a0290 0x7fd28c0a2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:27:20.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.460+0000 7fd2a8b9c700 1 --2- 172.21.15.82:0/3523313817 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f6ced02380 0x55f6ced02760 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd298009e30 tx=0x7fd298011720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=825be56934f75c9c server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:27:20.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.460+0000 7fd2a8b9c700 1 --2- 172.21.15.82:0/1795656947 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fd28c0a0290 0x7fd28c0a2750 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd298023000 tx=0x7fd298020000 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:27:20.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.460+0000 7fd28a7fc700 1 -- 172.21.15.82:0/3523313817 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd298016070 con 0x55f6ced02380 2023-09-23T09:27:20.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.460+0000 7fd28a7fc700 1 -- 172.21.15.82:0/3523313817 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd298026440 con 0x55f6ced02380 2023-09-23T09:27:20.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.460+0000 7fd28a7fc700 1 -- 172.21.15.82:0/3523313817 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd29800e620 con 0x55f6ced02380 2023-09-23T09:27:20.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.461+0000 7fd2bde53b80 1 -- 172.21.15.82:0/3523313817 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f6ced02380 msgr2=0x55f6ced02760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:27:20.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.461+0000 7fd2bde53b80 1 --2- 172.21.15.82:0/3523313817 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f6ced02380 0x55f6ced02760 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd298009e30 tx=0x7fd298011720 comp rx=0 tx=0).stop 2023-09-23T09:27:20.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.462+0000 7fd2bde53b80 1 -- 172.21.15.82:0/3523313817 shutdown_connections 2023-09-23T09:27:20.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.462+0000 7fd2bde53b80 1 --2- 172.21.15.82:0/3523313817 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f6cecfcc40 0x55f6cecfd0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:27:20.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.462+0000 7fd2bde53b80 1 --2- 172.21.15.82:0/3523313817 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f6ced02380 0x55f6ced02760 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:27:20.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.462+0000 7fd2bde53b80 1 --2- 172.21.15.82:0/3523313817 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f6ced02ca0 0x55f6cecfc700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:27:20.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.462+0000 7fd2bde53b80 1 -- 172.21.15.82:0/3523313817 >> 172.21.15.82:0/3523313817 conn(0x55f6cec710e0 msgr2=0x55f6cecf7410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:27:20.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.462+0000 7fd2bde53b80 1 -- 172.21.15.82:0/3523313817 shutdown_connections 2023-09-23T09:27:20.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.462+0000 7fd2bde53b80 1 -- 172.21.15.82:0/3523313817 wait complete. 2023-09-23T09:27:20.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.463+0000 7fd2bde53b80 1 -- start start 2023-09-23T09:27:20.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.463+0000 7fd2bde53b80 1 Processor -- start 2023-09-23T09:27:20.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.464+0000 7fd2bde53b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f6cecfcc40 0x55f6ced08cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:27:20.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.464+0000 7fd2bde53b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f6ced02380 0x55f6ced05ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:27:20.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.464+0000 7fd2bde53b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f6ced02ca0 0x55f6ced06620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:27:20.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.464+0000 7fd2bde53b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6cec4e990 con 0x55f6ced02ca0 2023-09-23T09:27:20.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.464+0000 7fd2bde53b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6cebecbb0 con 0x55f6ced02380 2023-09-23T09:27:20.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.464+0000 7fd2bde53b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6cebec8b0 con 0x55f6cecfcc40 2023-09-23T09:27:20.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.464+0000 7fd2bde53b80 10 client.0 _ll_register_callbacks cb 0x55f6ceb36a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:27:20.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.465+0000 7fd2a8b9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f6ced02ca0 0x55f6ced06620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:27:20.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.465+0000 7fd2a8b9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f6ced02ca0 0x55f6ced06620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48426/0 (socket says 172.21.15.82:48426) 2023-09-23T09:27:20.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.465+0000 7fd2a8b9c700 1 -- 172.21.15.82:0/1238751891 learned_addr learned my addr 172.21.15.82:0/1238751891 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:27:20.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.465+0000 7fd2a3fff700 1 --2- 172.21.15.82:0/1238751891 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f6cecfcc40 0x55f6ced08cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:27:20.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.466+0000 7fd2a3fff700 1 -- 172.21.15.82:0/1238751891 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f6ced02380 msgr2=0x55f6ced05ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:27:20.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.466+0000 7fd2a3fff700 1 --2- 172.21.15.82:0/1238751891 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f6ced02380 0x55f6ced05ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:27:20.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.466+0000 7fd2a3fff700 1 -- 172.21.15.82:0/1238751891 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f6ced02ca0 msgr2=0x55f6ced06620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:27:20.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.466+0000 7fd2a3fff700 1 --2- 172.21.15.82:0/1238751891 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f6ced02ca0 0x55f6ced06620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:27:20.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.466+0000 7fd2a3fff700 1 -- 172.21.15.82:0/1238751891 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd298009b10 con 0x55f6cecfcc40 2023-09-23T09:27:20.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.468+0000 7fd2a3fff700 1 --2- 172.21.15.82:0/1238751891 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f6cecfcc40 0x55f6ced08cd0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd29c0da5c0 tx=0x7fd29c0a1780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=19620262fd8db54e server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:27:20.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.468+0000 7fd2837fe700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T09:27:20.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.468+0000 7fd2837fe700 1 -- 172.21.15.82:0/1238751891 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd29c0aa580 con 0x55f6cecfcc40 2023-09-23T09:27:20.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.468+0000 7fd2837fe700 1 -- 172.21.15.82:0/1238751891 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(137..137 src has 1..137) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fd29c0ae3b0 con 0x55f6cecfcc40 2023-09-23T09:27:20.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.469+0000 7fd2bde53b80 1 -- 172.21.15.82:0/1238751891 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f6ceccc1c0 con 0x55f6cecfcc40 2023-09-23T09:27:20.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.470+0000 7fd2837fe700 1 -- 172.21.15.82:0/1238751891 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd29c0b2390 con 0x55f6cecfcc40 2023-09-23T09:27:20.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.470+0000 7fd2bde53b80 10 client.26944 fetch_fsmap learned FSMap version 78 2023-09-23T09:27:20.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.470+0000 7fd2bde53b80 1 -- 172.21.15.82:0/1238751891 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=78,monmap=4+}) v3 -- 0x55f6cea7ade0 con 0x55f6cecfcc40 2023-09-23T09:27:20.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.470+0000 7fd2837fe700 1 -- 172.21.15.82:0/1238751891 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f6ceccc1c0 con 0x55f6cecfcc40 2023-09-23T09:27:20.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.471+0000 7fd2837fe700 1 -- 172.21.15.82:0/1238751891 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 78) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fd29c0b1f00 con 0x55f6cecfcc40 2023-09-23T09:27:20.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.471+0000 7fd2bde53b80 10 client.26944 fetch_fsmap finished waiting for FSMap version 78 2023-09-23T09:27:20.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.471+0000 7fd2bde53b80 10 client.26944 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:27:20.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.471+0000 7fd2bde53b80 20 client.26944 populate_metadata read hostname 'smithi082' 2023-09-23T09:27:20.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.472+0000 7fd2bde53b80 1 --2- 172.21.15.82:0/1238751891 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55f6ced16760 0x55f6ced18b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:27:20.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.472+0000 7fd2bde53b80 4 client.26944 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:27:20.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.472+0000 7fd2bde53b80 1 -- 172.21.15.82:0/1238751891 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f6cebf4ba0 con 0x55f6ced16760 2023-09-23T09:27:20.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.472+0000 7fd2a37fe700 1 --2- 172.21.15.82:0/1238751891 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55f6ced16760 0x55f6ced18b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:27:20.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.473+0000 7fd2a37fe700 1 --2- 172.21.15.82:0/1238751891 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55f6ced16760 0x55f6ced18b80 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=431d908f8786836c server_cookie=88de2728be436324 in_seq=0 out_seq=0 2023-09-23T09:27:20.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.473+0000 7fd2837fe700 10 client.26944 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:27:20.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.476+0000 7fd2837fe700 1 -- 172.21.15.82:0/1238751891 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f6cebf4ba0 con 0x55f6ced16760 2023-09-23T09:27:20.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.476+0000 7fd2837fe700 10 client.26944 handle_command_reply: tid=0 2023-09-23T09:27:20.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.476+0000 7fd2bde53b80 1 client.26944 shutdown 2023-09-23T09:27:20.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.477+0000 7fd2bde53b80 1 -- 172.21.15.82:0/1238751891 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f6cecfcc40 msgr2=0x55f6ced08cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:27:20.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.477+0000 7fd2bde53b80 1 --2- 172.21.15.82:0/1238751891 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f6cecfcc40 0x55f6ced08cd0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd29c0da5c0 tx=0x7fd29c0a1780 comp rx=0 tx=0).stop 2023-09-23T09:27:20.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.484+0000 7fd2bde53b80 1 -- 172.21.15.82:0/1238751891 shutdown_connections 2023-09-23T09:27:20.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.484+0000 7fd2bde53b80 1 --2- 172.21.15.82:0/1238751891 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55f6ced16760 0x55f6ced18b80 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:27:20.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.484+0000 7fd2bde53b80 1 --2- 172.21.15.82:0/1238751891 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f6ced02ca0 0x55f6ced06620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:27:20.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.484+0000 7fd2bde53b80 1 --2- 172.21.15.82:0/1238751891 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f6cecfcc40 0x55f6ced08cd0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:27:20.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.484+0000 7fd2bde53b80 1 --2- 172.21.15.82:0/1238751891 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f6ced02380 0x55f6ced05ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:27:20.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.484+0000 7fd2bde53b80 1 -- 172.21.15.82:0/1238751891 >> 172.21.15.82:0/1238751891 conn(0x55f6cec710e0 msgr2=0x55f6cecf12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:27:20.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.484+0000 7fd2837fe700 0 client.26944 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:27:20.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.485+0000 7fd2bde53b80 1 -- 172.21.15.82:0/1238751891 shutdown_connections 2023-09-23T09:27:20.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.485+0000 7fd2bde53b80 1 -- 172.21.15.82:0/1238751891 wait complete. 2023-09-23T09:27:20.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.486+0000 7fd2bde53b80 20 client.26944 trim_cache size 0 max 16384 2023-09-23T09:27:20.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.516+0000 7fd2bde53b80 1 Processor -- start 2023-09-23T09:27:20.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.516+0000 7fd2bde53b80 1 -- start start 2023-09-23T09:27:20.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.517+0000 7fd2bde53b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f6cecfcc40 0x55f6cecfc700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:27:20.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.517+0000 7fd2bde53b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f6ced02380 0x55f6ced0d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:27:20.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.517+0000 7fd2bde53b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f6ced02ca0 0x55f6ced00050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:27:20.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.517+0000 7fd2bde53b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6cead0920 con 0x55f6cecfcc40 2023-09-23T09:27:20.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.517+0000 7fd2bde53b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6ced0ddd0 con 0x55f6ced02ca0 2023-09-23T09:27:20.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.517+0000 7fd2bde53b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6cecf83e0 con 0x55f6ced02380 2023-09-23T09:27:20.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.517+0000 7fd2a37fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f6ced02380 0x55f6ced0d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:27:20.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.518+0000 7fd2a37fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f6ced02380 0x55f6ced0d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:45644/0 (socket says 172.21.15.82:45644) 2023-09-23T09:27:20.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.518+0000 7fd2a37fe700 1 -- 172.21.15.82:0/748246118 learned_addr learned my addr 172.21.15.82:0/748246118 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:27:20.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.518+0000 7fd2a8b9c700 1 --2- 172.21.15.82:0/748246118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f6ced02ca0 0x55f6ced00050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:27:20.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.518+0000 7fd2a3fff700 1 --2- 172.21.15.82:0/748246118 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f6cecfcc40 0x55f6cecfc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:27:20.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.518+0000 7fd2a37fe700 1 -- 172.21.15.82:0/748246118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f6ced02ca0 msgr2=0x55f6ced00050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:27:20.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.518+0000 7fd2a37fe700 1 --2- 172.21.15.82:0/748246118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f6ced02ca0 0x55f6ced00050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:27:20.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.518+0000 7fd2a37fe700 1 -- 172.21.15.82:0/748246118 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f6cecfcc40 msgr2=0x55f6cecfc700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:27:20.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.518+0000 7fd2a37fe700 1 --2- 172.21.15.82:0/748246118 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f6cecfcc40 0x55f6cecfc700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:27:20.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.518+0000 7fd2a37fe700 1 -- 172.21.15.82:0/748246118 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f6ced05360 con 0x55f6ced02380 2023-09-23T09:27:20.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.519+0000 7fd2a3fff700 1 --2- 172.21.15.82:0/748246118 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f6cecfcc40 0x55f6cecfc700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T09:27:20.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.519+0000 7fd2a37fe700 1 --2- 172.21.15.82:0/748246118 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f6ced02380 0x55f6ced0d830 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd294009990 tx=0x7fd294005c70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f84fe85e2b0557a9 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:27:20.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.519+0000 7fd28affd700 1 -- 172.21.15.82:0/748246118 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd29401d040 con 0x55f6ced02380 2023-09-23T09:27:20.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.519+0000 7fd28affd700 1 -- 172.21.15.82:0/748246118 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd29402b070 con 0x55f6ced02380 2023-09-23T09:27:20.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.519+0000 7fd28affd700 1 -- 172.21.15.82:0/748246118 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd29400bb70 con 0x55f6ced02380 2023-09-23T09:27:20.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.521+0000 7fd2bde53b80 1 -- 172.21.15.82:0/748246118 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f6ced02380 msgr2=0x55f6ced0d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:27:20.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.521+0000 7fd2bde53b80 1 --2- 172.21.15.82:0/748246118 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f6ced02380 0x55f6ced0d830 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd294009990 tx=0x7fd294005c70 comp rx=0 tx=0).stop 2023-09-23T09:27:20.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.521+0000 7fd2bde53b80 1 -- 172.21.15.82:0/748246118 shutdown_connections 2023-09-23T09:27:20.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.521+0000 7fd2bde53b80 1 --2- 172.21.15.82:0/748246118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f6ced02ca0 0x55f6ced00050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:27:20.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.521+0000 7fd2bde53b80 1 --2- 172.21.15.82:0/748246118 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f6cecfcc40 0x55f6cecfc700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:27:20.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.521+0000 7fd2bde53b80 1 --2- 172.21.15.82:0/748246118 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f6ced02380 0x55f6ced0d830 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:27:20.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.521+0000 7fd2bde53b80 1 -- 172.21.15.82:0/748246118 >> 172.21.15.82:0/748246118 conn(0x55f6cec710e0 msgr2=0x55f6cecf7160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:27:20.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.525+0000 7fd2bde53b80 1 -- 172.21.15.82:0/748246118 shutdown_connections 2023-09-23T09:27:20.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.526+0000 7fd2bde53b80 1 -- 172.21.15.82:0/748246118 wait complete. 2023-09-23T09:27:20.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.527+0000 7fd2bde53b80 1 -- start start 2023-09-23T09:27:20.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.527+0000 7fd2bde53b80 1 Processor -- start 2023-09-23T09:27:20.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.528+0000 7fd2bde53b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f6cecfcc40 0x55f6ced0d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:27:20.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.528+0000 7fd2bde53b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f6ced02380 0x55f6ced0d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:27:20.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.528+0000 7fd2bde53b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f6ced02ca0 0x55f6ced0b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:27:20.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.528+0000 7fd2bde53b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6ced0bf00 con 0x55f6ced02380 2023-09-23T09:27:20.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.528+0000 7fd2bde53b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6ced0c070 con 0x55f6ced02ca0 2023-09-23T09:27:20.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.528+0000 7fd2bde53b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6ced0c230 con 0x55f6cecfcc40 2023-09-23T09:27:20.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.528+0000 7fd2bde53b80 10 client.0 _ll_register_callbacks cb 0x7fd29c0aa1b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:27:20.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.528+0000 7fd2a8b9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f6ced02ca0 0x55f6ced0b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:27:20.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.528+0000 7fd2a8b9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f6ced02ca0 0x55f6ced0b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:42186/0 (socket says 172.21.15.82:42186) 2023-09-23T09:27:20.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.528+0000 7fd2a8b9c700 1 -- 172.21.15.82:0/536234537 learned_addr learned my addr 172.21.15.82:0/536234537 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:27:20.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.529+0000 7fd2a37fe700 1 --2- 172.21.15.82:0/536234537 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f6ced02380 0x55f6ced0d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:27:20.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.529+0000 7fd2a8b9c700 1 -- 172.21.15.82:0/536234537 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f6cecfcc40 msgr2=0x55f6ced0d0f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-23T09:27:20.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.529+0000 7fd2a8b9c700 1 --2- 172.21.15.82:0/536234537 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f6cecfcc40 0x55f6ced0d0f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:27:20.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.529+0000 7fd2a8b9c700 1 -- 172.21.15.82:0/536234537 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f6ced02380 msgr2=0x55f6ced0d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:27:20.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.529+0000 7fd2a8b9c700 1 --2- 172.21.15.82:0/536234537 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f6ced02380 0x55f6ced0d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:27:20.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.529+0000 7fd2a8b9c700 1 -- 172.21.15.82:0/536234537 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2a41145d0 con 0x55f6ced02ca0 2023-09-23T09:27:20.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.529+0000 7fd2a37fe700 1 --2- 172.21.15.82:0/536234537 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f6ced02380 0x55f6ced0d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T09:27:20.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.530+0000 7fd2a8b9c700 1 --2- 172.21.15.82:0/536234537 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f6ced02ca0 0x55f6ced0b810 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd298005310 tx=0x7fd2980053f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4eb6df9fd54cdb97 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:27:20.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.530+0000 7fd2837fe700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-09-23T09:27:20.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.530+0000 7fd2837fe700 1 -- 172.21.15.82:0/536234537 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd298016040 con 0x55f6ced02ca0 2023-09-23T09:27:20.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.530+0000 7fd2bde53b80 1 -- 172.21.15.82:0/536234537 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f6cecef8b0 con 0x55f6ced02ca0 2023-09-23T09:27:20.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.530+0000 7fd2837fe700 1 -- 172.21.15.82:0/536234537 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(137..137 src has 1..137) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fd298003680 con 0x55f6ced02ca0 2023-09-23T09:27:20.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.531+0000 7fd2837fe700 1 -- 172.21.15.82:0/536234537 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd298003840 con 0x55f6ced02ca0 2023-09-23T09:27:20.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.531+0000 7fd2bde53b80 10 client.26888 fetch_fsmap learned FSMap version 78 2023-09-23T09:27:20.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.531+0000 7fd2bde53b80 1 -- 172.21.15.82:0/536234537 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=78,monmap=4+}) v3 -- 0x55f6cea63c60 con 0x55f6ced02ca0 2023-09-23T09:27:20.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.531+0000 7fd2837fe700 1 -- 172.21.15.82:0/536234537 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd29803b080 con 0x55f6ced02ca0 2023-09-23T09:27:20.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.531+0000 7fd2837fe700 1 -- 172.21.15.82:0/536234537 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 78) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fd298026870 con 0x55f6ced02ca0 2023-09-23T09:27:20.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.532+0000 7fd2bde53b80 10 client.26888 fetch_fsmap finished waiting for FSMap version 78 2023-09-23T09:27:20.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.532+0000 7fd2bde53b80 10 client.26888 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:27:20.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.532+0000 7fd2bde53b80 20 client.26888 populate_metadata read hostname 'smithi082' 2023-09-23T09:27:20.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.532+0000 7fd2bde53b80 1 --2- 172.21.15.82:0/536234537 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55f6ced6b720 0x55f6ced6db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:27:20.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.532+0000 7fd2bde53b80 4 client.26888 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:27:20.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.532+0000 7fd2bde53b80 1 -- 172.21.15.82:0/536234537 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55f6cec47970 con 0x55f6ced6b720 2023-09-23T09:27:20.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.532+0000 7fd2a3fff700 1 --2- 172.21.15.82:0/536234537 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55f6ced6b720 0x55f6ced6db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:27:20.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.533+0000 7fd2a3fff700 1 --2- 172.21.15.82:0/536234537 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55f6ced6b720 0x55f6ced6db60 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75fd4e84ba6882b8 server_cookie=727866b4b35e4eb in_seq=0 out_seq=0 2023-09-23T09:27:20.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.533+0000 7fd2837fe700 10 client.26888 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:27:20.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.533+0000 7fd2837fe700 1 -- 172.21.15.82:0/536234537 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55f6cec47970 con 0x55f6ced6b720 2023-09-23T09:27:20.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.533+0000 7fd2837fe700 10 client.26888 handle_command_reply: tid=0 2023-09-23T09:27:20.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.533+0000 7fd2bde53b80 1 client.26888 shutdown 2023-09-23T09:27:20.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.534+0000 7fd2bde53b80 1 -- 172.21.15.82:0/536234537 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f6ced02ca0 msgr2=0x55f6ced0b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:27:20.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.534+0000 7fd2bde53b80 1 --2- 172.21.15.82:0/536234537 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f6ced02ca0 0x55f6ced0b810 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd298005310 tx=0x7fd2980053f0 comp rx=0 tx=0).stop 2023-09-23T09:27:20.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.534+0000 7fd2bde53b80 1 -- 172.21.15.82:0/536234537 shutdown_connections 2023-09-23T09:27:20.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.534+0000 7fd2bde53b80 1 --2- 172.21.15.82:0/536234537 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f6ced02ca0 0x55f6ced0b810 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:27:20.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.534+0000 7fd2bde53b80 1 --2- 172.21.15.82:0/536234537 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f6cecfcc40 0x55f6ced0d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:27:20.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.534+0000 7fd2bde53b80 1 --2- 172.21.15.82:0/536234537 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55f6ced6b720 0x55f6ced6db60 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:27:20.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.534+0000 7fd2bde53b80 1 --2- 172.21.15.82:0/536234537 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f6ced02380 0x55f6ced0d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:27:20.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.534+0000 7fd2bde53b80 1 -- 172.21.15.82:0/536234537 >> 172.21.15.82:0/536234537 conn(0x55f6cec710e0 msgr2=0x55f6ced00050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:27:20.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.534+0000 7fd2837fe700 0 client.26888 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:27:20.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.534+0000 7fd2bde53b80 1 -- 172.21.15.82:0/536234537 shutdown_connections 2023-09-23T09:27:20.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.535+0000 7fd2bde53b80 1 -- 172.21.15.82:0/536234537 wait complete. 2023-09-23T09:27:20.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.536+0000 7fd2bde53b80 20 client.26888 trim_cache size 0 max 16384 2023-09-23T09:27:20.540 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:27:20.540 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-23T09:27:20.540 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:27:20.540 INFO:teuthology.orchestra.run.smithi082.stdout: "047cbc72-e254-4787-b038-382de9c1a9a4": { 2023-09-23T09:27:20.541 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:27:20.541 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "047cbc72-e254-4787-b038-382de9c1a9a4", 2023-09-23T09:27:20.541 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:27:20.541 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:27:20.541 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:27:20.541 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:27:20.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.538+0000 7fd2aa5ff700 1 -- 172.21.15.82:0/1795656947 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fd28c0a0290 msgr2=0x7fd28c0a2750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:27:20.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.538+0000 7fd2aa5ff700 1 --2- 172.21.15.82:0/1795656947 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fd28c0a0290 0x7fd28c0a2750 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd298023000 tx=0x7fd298020000 comp rx=0 tx=0).stop 2023-09-23T09:27:20.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.538+0000 7fd2aa5ff700 1 -- 172.21.15.82:0/1795656947 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2a4100140 msgr2=0x7fd2a41136e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:27:20.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.538+0000 7fd2aa5ff700 1 --2- 172.21.15.82:0/1795656947 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2a4100140 0x7fd2a41136e0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fd29c0094f0 tx=0x7fd29c00d3b0 comp rx=0 tx=0).stop 2023-09-23T09:27:20.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.539+0000 7fd2aa5ff700 1 -- 172.21.15.82:0/1795656947 shutdown_connections 2023-09-23T09:27:20.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.539+0000 7fd2aa5ff700 1 --2- 172.21.15.82:0/1795656947 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fd28c0a0290 0x7fd28c0a2750 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:27:20.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.539+0000 7fd2aa5ff700 1 --2- 172.21.15.82:0/1795656947 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd2a410c6f0 0x7fd2a410cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:27:20.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.539+0000 7fd2aa5ff700 1 --2- 172.21.15.82:0/1795656947 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2a4100140 0x7fd2a41136e0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:27:20.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.539+0000 7fd2aa5ff700 1 --2- 172.21.15.82:0/1795656947 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2a4104c20 0x7fd2a4113c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:27:20.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.539+0000 7fd2aa5ff700 1 -- 172.21.15.82:0/1795656947 >> 172.21.15.82:0/1795656947 conn(0x7fd2a40fb270 msgr2=0x7fd2a4102720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:27:20.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.539+0000 7fd2aa5ff700 1 -- 172.21.15.82:0/1795656947 shutdown_connections 2023-09-23T09:27:20.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:20.539+0000 7fd2aa5ff700 1 -- 172.21.15.82:0/1795656947 wait complete. 2023-09-23T09:27:20.575 INFO:tasks.cephfs.filesystem:scrub status for tag:047cbc72-e254-4787-b038-382de9c1a9a4 - {'path': '/', 'tag': '047cbc72-e254-4787-b038-382de9c1a9a4', 'options': 'recursive,force'} 2023-09-23T09:27:20.828 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 10.0 s, 928.0 tps, lat 106.655 ms stddev 65.977 2023-09-23T09:27:20.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:27:20 smithi082 ceph-mon[97694]: pgmap v964: 97 pgs: 97 active+clean; 14 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 847 KiB/s rd, 17 MiB/s wr, 250 op/s 2023-09-23T09:27:20.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:27:20 smithi161 ceph-mon[99580]: pgmap v964: 97 pgs: 97 active+clean; 14 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 847 KiB/s rd, 17 MiB/s wr, 250 op/s 2023-09-23T09:27:21.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:27:20 smithi135 ceph-mon[99205]: pgmap v964: 97 pgs: 97 active+clean; 14 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 847 KiB/s rd, 17 MiB/s wr, 250 op/s 2023-09-23T09:27:22.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:27:22 smithi082 ceph-mon[97694]: pgmap v965: 97 pgs: 97 active+clean; 14 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 847 KiB/s rd, 17 MiB/s wr, 250 op/s 2023-09-23T09:27:22.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:27:22 smithi161 ceph-mon[99580]: pgmap v965: 97 pgs: 97 active+clean; 14 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 847 KiB/s rd, 17 MiB/s wr, 250 op/s 2023-09-23T09:27:23.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:27:22 smithi135 ceph-mon[99205]: pgmap v965: 97 pgs: 97 active+clean; 14 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 847 KiB/s rd, 17 MiB/s wr, 250 op/s 2023-09-23T09:27:24.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:27:24 smithi082 ceph-mon[97694]: pgmap v966: 97 pgs: 97 active+clean; 14 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 730 KiB/s rd, 15 MiB/s wr, 215 op/s 2023-09-23T09:27:24.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:27:24 smithi161 ceph-mon[99580]: pgmap v966: 97 pgs: 97 active+clean; 14 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 730 KiB/s rd, 15 MiB/s wr, 215 op/s 2023-09-23T09:27:25.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:27:24 smithi135 ceph-mon[99205]: pgmap v966: 97 pgs: 97 active+clean; 14 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 730 KiB/s rd, 15 MiB/s wr, 215 op/s 2023-09-23T09:27:25.827 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 15.0 s, 551.3 tps, lat 166.386 ms stddev 60.354 2023-09-23T09:27:26.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:27:26 smithi161 ceph-mon[99580]: pgmap v967: 97 pgs: 97 active+clean; 14 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 918 KiB/s rd, 21 MiB/s wr, 751 op/s 2023-09-23T09:27:27.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:27:26 smithi135 ceph-mon[99205]: pgmap v967: 97 pgs: 97 active+clean; 14 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 918 KiB/s rd, 21 MiB/s wr, 751 op/s 2023-09-23T09:27:27.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:27:26 smithi082 ceph-mon[97694]: pgmap v967: 97 pgs: 97 active+clean; 14 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 918 KiB/s rd, 21 MiB/s wr, 751 op/s 2023-09-23T09:27:28.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:27:27 smithi135 ceph-mon[99205]: pgmap v968: 97 pgs: 97 active+clean; 14 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 593 KiB/s rd, 15 MiB/s wr, 660 op/s 2023-09-23T09:27:28.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:27:27 smithi082 ceph-mon[97694]: pgmap v968: 97 pgs: 97 active+clean; 14 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 593 KiB/s rd, 15 MiB/s wr, 660 op/s 2023-09-23T09:27:28.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:27:27 smithi161 ceph-mon[99580]: pgmap v968: 97 pgs: 97 active+clean; 14 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 593 KiB/s rd, 15 MiB/s wr, 660 op/s 2023-09-23T09:27:30.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:27:29 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:27:30.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:27:29 smithi135 ceph-mon[99205]: pgmap v969: 97 pgs: 97 active+clean; 14 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 995 KiB/s rd, 23 MiB/s wr, 1.20k op/s 2023-09-23T09:27:30.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:27:29 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:27:30.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:27:29 smithi082 ceph-mon[97694]: pgmap v969: 97 pgs: 97 active+clean; 14 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 995 KiB/s rd, 23 MiB/s wr, 1.20k op/s 2023-09-23T09:27:30.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:27:29 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:27:30.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:27:29 smithi161 ceph-mon[99580]: pgmap v969: 97 pgs: 97 active+clean; 14 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 995 KiB/s rd, 23 MiB/s wr, 1.20k op/s 2023-09-23T09:27:30.827 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 20.0 s, 642.4 tps, lat 129.603 ms stddev 43.828 2023-09-23T09:27:32.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:27:32 smithi082 ceph-mon[97694]: pgmap v970: 97 pgs: 97 active+clean; 14 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 614 KiB/s rd, 15 MiB/s wr, 1.08k op/s 2023-09-23T09:27:32.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:27:32 smithi161 ceph-mon[99580]: pgmap v970: 97 pgs: 97 active+clean; 14 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 614 KiB/s rd, 15 MiB/s wr, 1.08k op/s 2023-09-23T09:27:33.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:27:32 smithi135 ceph-mon[99205]: pgmap v970: 97 pgs: 97 active+clean; 14 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 614 KiB/s rd, 15 MiB/s wr, 1.08k op/s 2023-09-23T09:27:34.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:27:33 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:27:34.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:27:33 smithi135 ceph-mon[99205]: pgmap v971: 97 pgs: 97 active+clean; 14 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 614 KiB/s rd, 15 MiB/s wr, 1.08k op/s 2023-09-23T09:27:34.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:27:33 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:27:34.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:27:33 smithi082 ceph-mon[97694]: pgmap v971: 97 pgs: 97 active+clean; 14 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 614 KiB/s rd, 15 MiB/s wr, 1.08k op/s 2023-09-23T09:27:34.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:27:33 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:27:34.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:27:33 smithi161 ceph-mon[99580]: pgmap v971: 97 pgs: 97 active+clean; 14 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 614 KiB/s rd, 15 MiB/s wr, 1.08k op/s 2023-09-23T09:27:35.827 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 25.0 s, 522.6 tps, lat 237.752 ms stddev 857.812 2023-09-23T09:27:36.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:27:36 smithi082 ceph-mon[97694]: pgmap v972: 97 pgs: 97 active+clean; 14 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 872 KiB/s rd, 22 MiB/s wr, 1.59k op/s 2023-09-23T09:27:36.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:27:36 smithi161 ceph-mon[99580]: pgmap v972: 97 pgs: 97 active+clean; 14 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 872 KiB/s rd, 22 MiB/s wr, 1.59k op/s 2023-09-23T09:27:37.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:27:36 smithi135 ceph-mon[99205]: pgmap v972: 97 pgs: 97 active+clean; 14 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 872 KiB/s rd, 22 MiB/s wr, 1.59k op/s 2023-09-23T09:27:37.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:27:37 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:27:37.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:27:37 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:27:38.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:27:37 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:27:38.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:27:38 smithi082 ceph-mon[97694]: pgmap v973: 97 pgs: 97 active+clean; 14 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 661 KiB/s rd, 15 MiB/s wr, 1.05k op/s 2023-09-23T09:27:38.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:27:38 smithi161 ceph-mon[99580]: pgmap v973: 97 pgs: 97 active+clean; 14 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 661 KiB/s rd, 15 MiB/s wr, 1.05k op/s 2023-09-23T09:27:39.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:27:38 smithi135 ceph-mon[99205]: pgmap v973: 97 pgs: 97 active+clean; 14 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 661 KiB/s rd, 15 MiB/s wr, 1.05k op/s 2023-09-23T09:27:40.828 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 30.0 s, 648.0 tps, lat 154.921 ms stddev 42.758 2023-09-23T09:27:40.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:27:40 smithi161 ceph-mon[99580]: pgmap v974: 97 pgs: 97 active+clean; 15 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 900 KiB/s rd, 23 MiB/s wr, 1.63k op/s 2023-09-23T09:27:41.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:27:40 smithi135 ceph-mon[99205]: pgmap v974: 97 pgs: 97 active+clean; 15 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 900 KiB/s rd, 23 MiB/s wr, 1.63k op/s 2023-09-23T09:27:41.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:27:40 smithi082 ceph-mon[97694]: pgmap v974: 97 pgs: 97 active+clean; 15 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 900 KiB/s rd, 23 MiB/s wr, 1.63k op/s 2023-09-23T09:27:42.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:27:42 smithi161 ceph-mon[99580]: pgmap v975: 97 pgs: 97 active+clean; 15 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 15 MiB/s wr, 1.09k op/s 2023-09-23T09:27:42.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:27:42 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:27:43.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:27:42 smithi135 ceph-mon[99205]: pgmap v975: 97 pgs: 97 active+clean; 15 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 15 MiB/s wr, 1.09k op/s 2023-09-23T09:27:43.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:27:42 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:27:43.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:27:42 smithi082 ceph-mon[97694]: pgmap v975: 97 pgs: 97 active+clean; 15 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 15 MiB/s wr, 1.09k op/s 2023-09-23T09:27:43.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:27:42 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:27:44.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:27:44 smithi161 ceph-mon[99580]: pgmap v976: 97 pgs: 97 active+clean; 15 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 15 MiB/s wr, 1.09k op/s 2023-09-23T09:27:45.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:27:44 smithi135 ceph-mon[99205]: pgmap v976: 97 pgs: 97 active+clean; 15 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 15 MiB/s wr, 1.09k op/s 2023-09-23T09:27:45.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:27:44 smithi082 ceph-mon[97694]: pgmap v976: 97 pgs: 97 active+clean; 15 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 15 MiB/s wr, 1.09k op/s 2023-09-23T09:27:45.830 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 35.0 s, 602.9 tps, lat 166.748 ms stddev 80.148 2023-09-23T09:27:47.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:27:46 smithi135 ceph-mon[99205]: pgmap v977: 97 pgs: 97 active+clean; 15 GiB data, 49 GiB used, 1024 GiB / 1.0 TiB avail; 671 KiB/s rd, 23 MiB/s wr, 1.62k op/s 2023-09-23T09:27:47.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:27:46 smithi082 ceph-mon[97694]: pgmap v977: 97 pgs: 97 active+clean; 15 GiB data, 49 GiB used, 1024 GiB / 1.0 TiB avail; 671 KiB/s rd, 23 MiB/s wr, 1.62k op/s 2023-09-23T09:27:47.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:27:46 smithi161 ceph-mon[99580]: pgmap v977: 97 pgs: 97 active+clean; 15 GiB data, 49 GiB used, 1024 GiB / 1.0 TiB avail; 671 KiB/s rd, 23 MiB/s wr, 1.62k op/s 2023-09-23T09:27:48.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:27:47 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:27:48.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:27:47 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:27:48.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:27:47 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:27:49.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:27:48 smithi135 ceph-mon[99205]: pgmap v978: 97 pgs: 97 active+clean; 15 GiB data, 49 GiB used, 1024 GiB / 1.0 TiB avail; 413 KiB/s rd, 16 MiB/s wr, 1.11k op/s 2023-09-23T09:27:49.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:27:48 smithi082 ceph-mon[97694]: pgmap v978: 97 pgs: 97 active+clean; 15 GiB data, 49 GiB used, 1024 GiB / 1.0 TiB avail; 413 KiB/s rd, 16 MiB/s wr, 1.11k op/s 2023-09-23T09:27:49.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:27:48 smithi161 ceph-mon[99580]: pgmap v978: 97 pgs: 97 active+clean; 15 GiB data, 49 GiB used, 1024 GiB / 1.0 TiB avail; 413 KiB/s rd, 16 MiB/s wr, 1.11k op/s 2023-09-23T09:27:50.576 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:27:50.827 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 40.0 s, 603.0 tps, lat 165.191 ms stddev 66.181 2023-09-23T09:27:51.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:27:50 smithi135 ceph-mon[99205]: pgmap v979: 97 pgs: 97 active+clean; 15 GiB data, 49 GiB used, 1024 GiB / 1.0 TiB avail; 582 KiB/s rd, 24 MiB/s wr, 1.73k op/s 2023-09-23T09:27:51.077 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:27:50 smithi082 ceph-mon[97694]: pgmap v979: 97 pgs: 97 active+clean; 15 GiB data, 49 GiB used, 1024 GiB / 1.0 TiB avail; 582 KiB/s rd, 24 MiB/s wr, 1.73k op/s 2023-09-23T09:27:51.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:27:50 smithi161 ceph-mon[99580]: pgmap v979: 97 pgs: 97 active+clean; 15 GiB data, 49 GiB used, 1024 GiB / 1.0 TiB avail; 582 KiB/s rd, 24 MiB/s wr, 1.73k op/s 2023-09-23T09:27:51.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.342+0000 7fe9f01ff700 1 -- 172.21.15.82:0/657216101 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9e8111880 msgr2=0x7fe9e8113c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:27:51.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.342+0000 7fe9f01ff700 1 --2- 172.21.15.82:0/657216101 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9e8111880 0x7fe9e8113c70 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe9e001c0d0 tx=0x7fe9e001c3e0 comp rx=0 tx=0).stop 2023-09-23T09:27:51.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.343+0000 7fe9f01ff700 1 -- 172.21.15.82:0/657216101 shutdown_connections 2023-09-23T09:27:51.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.343+0000 7fe9f01ff700 1 --2- 172.21.15.82:0/657216101 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9e8111880 0x7fe9e8113c70 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:27:51.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.343+0000 7fe9f01ff700 1 --2- 172.21.15.82:0/657216101 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe9e8072cc0 0x7fe9e80730a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:27:51.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.343+0000 7fe9f01ff700 1 --2- 172.21.15.82:0/657216101 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9e80735e0 0x7fe9e8111340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:27:51.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.343+0000 7fe9f01ff700 1 -- 172.21.15.82:0/657216101 >> 172.21.15.82:0/657216101 conn(0x7fe9e80fc3a0 msgr2=0x7fe9e80fe7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:27:51.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.345+0000 7fe9f01ff700 1 -- 172.21.15.82:0/657216101 shutdown_connections 2023-09-23T09:27:51.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.345+0000 7fe9f01ff700 1 -- 172.21.15.82:0/657216101 wait complete. 2023-09-23T09:27:51.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.346+0000 7fe9f01ff700 1 Processor -- start 2023-09-23T09:27:51.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.348+0000 7fe9f01ff700 1 -- start start 2023-09-23T09:27:51.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.349+0000 7fe9f01ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9e8072cc0 0x7fe9e80724d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:27:51.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.349+0000 7fe9f01ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9e80735e0 0x7fe9e806f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:27:51.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.349+0000 7fe9f01ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe9e8111880 0x7fe9e806fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:27:51.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.349+0000 7fe9f01ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e80701b0 con 0x7fe9e8072cc0 2023-09-23T09:27:51.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.349+0000 7fe9f01ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e8070320 con 0x7fe9e80735e0 2023-09-23T09:27:51.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.349+0000 7fe9f01ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e8110980 con 0x7fe9e8111880 2023-09-23T09:27:51.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.350+0000 7fe9ed79a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9e80735e0 0x7fe9e806f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:27:51.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.350+0000 7fe9ed79a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9e80735e0 0x7fe9e806f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:33210/0 (socket says 172.21.15.82:33210) 2023-09-23T09:27:51.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.350+0000 7fe9ed79a700 1 -- 172.21.15.82:0/460069524 learned_addr learned my addr 172.21.15.82:0/460069524 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:27:51.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.350+0000 7fe9ee79c700 1 --2- 172.21.15.82:0/460069524 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe9e8111880 0x7fe9e806fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:27:51.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.351+0000 7fe9ed79a700 1 -- 172.21.15.82:0/460069524 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe9e8111880 msgr2=0x7fe9e806fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:27:51.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.351+0000 7fe9ed79a700 1 --2- 172.21.15.82:0/460069524 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe9e8111880 0x7fe9e806fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:27:51.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.351+0000 7fe9ed79a700 1 -- 172.21.15.82:0/460069524 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9e8072cc0 msgr2=0x7fe9e80724d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:27:51.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.351+0000 7fe9ed79a700 1 --2- 172.21.15.82:0/460069524 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9e8072cc0 0x7fe9e80724d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:27:51.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.351+0000 7fe9ed79a700 1 -- 172.21.15.82:0/460069524 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9e001ad10 con 0x7fe9e80735e0 2023-09-23T09:27:51.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.352+0000 7fe9ed79a700 1 --2- 172.21.15.82:0/460069524 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9e80735e0 0x7fe9e806f4e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe9d800d950 tx=0x7fe9d800dc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:27:51.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.353+0000 7fe9deffd700 1 -- 172.21.15.82:0/460069524 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d8009940 con 0x7fe9e80735e0 2023-09-23T09:27:51.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.353+0000 7fe9deffd700 1 -- 172.21.15.82:0/460069524 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe9d8010460 con 0x7fe9e80735e0 2023-09-23T09:27:51.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.353+0000 7fe9deffd700 1 -- 172.21.15.82:0/460069524 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d800f620 con 0x7fe9e80735e0 2023-09-23T09:27:51.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.353+0000 7fe9f01ff700 1 -- 172.21.15.82:0/460069524 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9e8110c60 con 0x7fe9e80735e0 2023-09-23T09:27:51.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.353+0000 7fe9f01ff700 1 -- 172.21.15.82:0/460069524 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9e8111120 con 0x7fe9e80735e0 2023-09-23T09:27:51.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.360+0000 7fe9deffd700 1 -- 172.21.15.82:0/460069524 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7fe9d80105d0 con 0x7fe9e80735e0 2023-09-23T09:27:51.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.361+0000 7fea03b52b80 1 Processor -- start 2023-09-23T09:27:51.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.361+0000 7fea03b52b80 1 -- start start 2023-09-23T09:27:51.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.362+0000 7fea03b52b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d93f908380 0x55d93f908760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:27:51.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.362+0000 7fea03b52b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d93f908ca0 0x55d93f902700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:27:51.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.362+0000 7fea03b52b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d93f902c40 0x55d93f9030a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:27:51.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.362+0000 7fea03b52b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d93f86a7b0 con 0x55d93f902c40 2023-09-23T09:27:51.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.362+0000 7fea03b52b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d93f85b780 con 0x55d93f908380 2023-09-23T09:27:51.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.362+0000 7fea03b52b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d93f8590a0 con 0x55d93f908ca0 2023-09-23T09:27:51.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.362+0000 7fe9edf9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d93f908ca0 0x55d93f902700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:27:51.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.362+0000 7fe9edf9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d93f908ca0 0x55d93f902700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:49904/0 (socket says 172.21.15.82:49904) 2023-09-23T09:27:51.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.362+0000 7fe9edf9b700 1 -- 172.21.15.82:0/866444148 learned_addr learned my addr 172.21.15.82:0/866444148 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:27:51.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.362+0000 7fe9ee79c700 1 --2- 172.21.15.82:0/866444148 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d93f908380 0x55d93f908760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:27:51.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.363+0000 7fe9edf9b700 1 -- 172.21.15.82:0/866444148 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d93f908380 msgr2=0x55d93f908760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:27:51.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.363+0000 7fe9edf9b700 1 --2- 172.21.15.82:0/866444148 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d93f908380 0x55d93f908760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:27:51.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.363+0000 7fe9edf9b700 1 -- 172.21.15.82:0/866444148 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d93f902c40 msgr2=0x55d93f9030a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-23T09:27:51.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.363+0000 7fe9edf9b700 1 --2- 172.21.15.82:0/866444148 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d93f902c40 0x55d93f9030a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:27:51.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.363+0000 7fe9edf9b700 1 -- 172.21.15.82:0/866444148 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d93f6d4630 con 0x55d93f908ca0 2023-09-23T09:27:51.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.364+0000 7fe9edf9b700 1 --2- 172.21.15.82:0/866444148 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d93f908ca0 0x55d93f902700 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe9e400bb90 tx=0x7fe9e400bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb32dff2c5513484 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:27:51.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.365+0000 7fe9d3fff700 1 -- 172.21.15.82:0/866444148 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e400d890 con 0x55d93f908ca0 2023-09-23T09:27:51.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.365+0000 7fe9deffd700 1 --2- 172.21.15.82:0/460069524 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fe9d40a02d0 0x7fe9d40a2790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:27:51.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.365+0000 7fe9d3fff700 1 -- 172.21.15.82:0/866444148 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe9e400de80 con 0x55d93f908ca0 2023-09-23T09:27:51.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.365+0000 7fe9d3fff700 1 -- 172.21.15.82:0/866444148 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e4005280 con 0x55d93f908ca0 2023-09-23T09:27:51.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.365+0000 7fe9deffd700 1 -- 172.21.15.82:0/460069524 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fe9d80cb360 con 0x7fe9e80735e0 2023-09-23T09:27:51.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.366+0000 7fea03b52b80 1 -- 172.21.15.82:0/866444148 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d93f908ca0 msgr2=0x55d93f902700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:27:51.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.366+0000 7fea03b52b80 1 --2- 172.21.15.82:0/866444148 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d93f908ca0 0x55d93f902700 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe9e400bb90 tx=0x7fe9e400bea0 comp rx=0 tx=0).stop 2023-09-23T09:27:51.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.367+0000 7fea03b52b80 1 -- 172.21.15.82:0/866444148 shutdown_connections 2023-09-23T09:27:51.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.367+0000 7fea03b52b80 1 --2- 172.21.15.82:0/866444148 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d93f902c40 0x55d93f9030a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:27:51.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.367+0000 7fea03b52b80 1 --2- 172.21.15.82:0/866444148 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d93f908380 0x55d93f908760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:27:51.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.367+0000 7fea03b52b80 1 --2- 172.21.15.82:0/866444148 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d93f908ca0 0x55d93f902700 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:27:51.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.367+0000 7fea03b52b80 1 -- 172.21.15.82:0/866444148 >> 172.21.15.82:0/866444148 conn(0x55d93f8770e0 msgr2=0x55d93f8fd410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:27:51.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.367+0000 7fe9ee79c700 1 --2- 172.21.15.82:0/460069524 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fe9d40a02d0 0x7fe9d40a2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:27:51.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.367+0000 7fea03b52b80 1 -- 172.21.15.82:0/866444148 shutdown_connections 2023-09-23T09:27:51.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.367+0000 7fea03b52b80 1 -- 172.21.15.82:0/866444148 wait complete. 2023-09-23T09:27:51.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.368+0000 7fea03b52b80 1 -- start start 2023-09-23T09:27:51.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.368+0000 7fea03b52b80 1 Processor -- start 2023-09-23T09:27:51.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.369+0000 7fe9ee79c700 1 --2- 172.21.15.82:0/460069524 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fe9d40a02d0 0x7fe9d40a2790 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe9e001c860 tx=0x7fe9e001c040 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:27:51.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.370+0000 7fea03b52b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d93f902c40 0x55d93f90bf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:27:51.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.370+0000 7fea03b52b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d93f908380 0x55d93f90c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:27:51.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.370+0000 7fea03b52b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d93f908ca0 0x55d93f90ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:27:51.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.370+0000 7fea03b52b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d93f854990 con 0x55d93f902c40 2023-09-23T09:27:51.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.370+0000 7fea03b52b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d93f7f2bb0 con 0x55d93f908380 2023-09-23T09:27:51.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.370+0000 7fea03b52b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d93f7f28b0 con 0x55d93f908ca0 2023-09-23T09:27:51.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.370+0000 7fea03b52b80 10 client.0 _ll_register_callbacks cb 0x55d93f73ca80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:27:51.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.371+0000 7fe9edf9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d93f902c40 0x55d93f90bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:27:51.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.371+0000 7fe9edf9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d93f902c40 0x55d93f90bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60186/0 (socket says 172.21.15.82:60186) 2023-09-23T09:27:51.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.371+0000 7fe9edf9b700 1 -- 172.21.15.82:0/171603541 learned_addr learned my addr 172.21.15.82:0/171603541 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:27:51.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.371+0000 7fe9ee79c700 1 --2- 172.21.15.82:0/171603541 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d93f908ca0 0x55d93f90ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:27:51.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.371+0000 7fe9edf9b700 1 -- 172.21.15.82:0/171603541 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d93f908ca0 msgr2=0x55d93f90ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:27:51.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.371+0000 7fe9edf9b700 1 --2- 172.21.15.82:0/171603541 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d93f908ca0 0x55d93f90ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:27:51.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.371+0000 7fe9edf9b700 1 -- 172.21.15.82:0/171603541 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d93f908380 msgr2=0x55d93f90c4c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-23T09:27:51.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.371+0000 7fe9edf9b700 1 --2- 172.21.15.82:0/171603541 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d93f908380 0x55d93f90c4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:27:51.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.372+0000 7fe9edf9b700 1 -- 172.21.15.82:0/171603541 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9e400b7c0 con 0x55d93f902c40 2023-09-23T09:27:51.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.372+0000 7fe9edf9b700 1 --2- 172.21.15.82:0/171603541 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d93f902c40 0x55d93f90bf80 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fe9e4005910 tx=0x7fe9e4004f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50c2bf0a800ef1f9 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:27:51.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.372+0000 7fe9d17fa700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:27:51.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.373+0000 7fe9d17fa700 1 -- 172.21.15.82:0/171603541 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e4004ae0 con 0x55d93f902c40 2023-09-23T09:27:51.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.373+0000 7fe9d17fa700 1 -- 172.21.15.82:0/171603541 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(137..137 src has 1..137) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fe9e400d890 con 0x55d93f902c40 2023-09-23T09:27:51.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.373+0000 7fea03b52b80 1 -- 172.21.15.82:0/171603541 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d93f8d21c0 con 0x55d93f902c40 2023-09-23T09:27:51.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.373+0000 7fe9d17fa700 1 -- 172.21.15.82:0/171603541 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe9e400da50 con 0x55d93f902c40 2023-09-23T09:27:51.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.373+0000 7fea03b52b80 10 client.17220 fetch_fsmap learned FSMap version 83 2023-09-23T09:27:51.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.374+0000 7fea03b52b80 1 -- 172.21.15.82:0/171603541 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=83,monmap=4+}) v3 -- 0x55d93f680de0 con 0x55d93f902c40 2023-09-23T09:27:51.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.374+0000 7fe9d17fa700 1 -- 172.21.15.82:0/171603541 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d93f8d21c0 con 0x55d93f902c40 2023-09-23T09:27:51.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.374+0000 7fe9d17fa700 1 -- 172.21.15.82:0/171603541 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 83) v1 ==== 7910+0+0 (secure 0 0 0) 0x7fe9e4050540 con 0x55d93f902c40 2023-09-23T09:27:51.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.374+0000 7fea03b52b80 10 client.17220 fetch_fsmap finished waiting for FSMap version 83 2023-09-23T09:27:51.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.374+0000 7fea03b52b80 10 client.17220 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:27:51.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.374+0000 7fea03b52b80 20 client.17220 populate_metadata read hostname 'smithi082' 2023-09-23T09:27:51.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.374+0000 7fea03b52b80 1 --2- 172.21.15.82:0/171603541 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55d93f91c6d0 0x55d93f91eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:27:51.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.374+0000 7fea03b52b80 4 client.17220 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:27:51.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.374+0000 7fea03b52b80 1 -- 172.21.15.82:0/171603541 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d93f7faba0 con 0x55d93f91c6d0 2023-09-23T09:27:51.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.376+0000 7fe9ed79a700 1 --2- 172.21.15.82:0/171603541 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55d93f91c6d0 0x55d93f91eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:27:51.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.379+0000 7fe9ed79a700 1 --2- 172.21.15.82:0/171603541 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55d93f91c6d0 0x55d93f91eaf0 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7773ec48596d293b server_cookie=b11941b31deedcf in_seq=0 out_seq=0 2023-09-23T09:27:51.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.379+0000 7fe9d17fa700 10 client.17220 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:27:51.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.381+0000 7fe9d17fa700 1 -- 172.21.15.82:0/171603541 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55d93f7faba0 con 0x55d93f91c6d0 2023-09-23T09:27:51.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.381+0000 7fe9d17fa700 10 client.17220 handle_command_reply: tid=0 2023-09-23T09:27:51.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.381+0000 7fea03b52b80 1 client.17220 shutdown 2023-09-23T09:27:51.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.383+0000 7fea03b52b80 1 -- 172.21.15.82:0/171603541 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d93f902c40 msgr2=0x55d93f90bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:27:51.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.383+0000 7fea03b52b80 1 --2- 172.21.15.82:0/171603541 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d93f902c40 0x55d93f90bf80 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fe9e4005910 tx=0x7fe9e4004f90 comp rx=0 tx=0).stop 2023-09-23T09:27:51.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.384+0000 7fea03b52b80 1 -- 172.21.15.82:0/171603541 shutdown_connections 2023-09-23T09:27:51.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.384+0000 7fea03b52b80 1 --2- 172.21.15.82:0/171603541 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d93f908ca0 0x55d93f90ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:27:51.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.384+0000 7fea03b52b80 1 --2- 172.21.15.82:0/171603541 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55d93f91c6d0 0x55d93f91eaf0 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:27:51.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.384+0000 7fea03b52b80 1 --2- 172.21.15.82:0/171603541 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d93f902c40 0x55d93f90bf80 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:27:51.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.384+0000 7fea03b52b80 1 --2- 172.21.15.82:0/171603541 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d93f908380 0x55d93f90c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:27:51.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.384+0000 7fea03b52b80 1 -- 172.21.15.82:0/171603541 >> 172.21.15.82:0/171603541 conn(0x55d93f8770e0 msgr2=0x55d93f8f7b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:27:51.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.384+0000 7fe9d17fa700 0 client.17220 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:27:51.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.384+0000 7fea03b52b80 1 -- 172.21.15.82:0/171603541 shutdown_connections 2023-09-23T09:27:51.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.384+0000 7fea03b52b80 1 -- 172.21.15.82:0/171603541 wait complete. 2023-09-23T09:27:51.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.385+0000 7fea03b52b80 20 client.17220 trim_cache size 0 max 16384 2023-09-23T09:27:51.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.420+0000 7fea03b52b80 1 Processor -- start 2023-09-23T09:27:51.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.420+0000 7fea03b52b80 1 -- start start 2023-09-23T09:27:51.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.420+0000 7fea03b52b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d93f902c40 0x55d93f913800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:27:51.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.420+0000 7fea03b52b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d93f908380 0x55d93f906170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:27:51.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.420+0000 7fea03b52b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d93f908ca0 0x55d93f9066b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:27:51.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.420+0000 7fea03b52b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d93f6d6920 con 0x55d93f902c40 2023-09-23T09:27:51.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.420+0000 7fea03b52b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d93f913d40 con 0x55d93f908380 2023-09-23T09:27:51.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.420+0000 7fea03b52b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d93f8fedf0 con 0x55d93f908ca0 2023-09-23T09:27:51.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.421+0000 7fe9edf9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d93f902c40 0x55d93f913800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:27:51.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.421+0000 7fe9ed79a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d93f908380 0x55d93f906170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:27:51.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.421+0000 7fe9ed79a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d93f908380 0x55d93f906170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:33234/0 (socket says 172.21.15.82:33234) 2023-09-23T09:27:51.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.421+0000 7fe9ed79a700 1 -- 172.21.15.82:0/710946739 learned_addr learned my addr 172.21.15.82:0/710946739 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:27:51.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.421+0000 7fe9ee79c700 1 --2- 172.21.15.82:0/710946739 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d93f908ca0 0x55d93f9066b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:27:51.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.422+0000 7fe9ed79a700 1 -- 172.21.15.82:0/710946739 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d93f908ca0 msgr2=0x55d93f9066b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:27:51.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.422+0000 7fe9ed79a700 1 --2- 172.21.15.82:0/710946739 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d93f908ca0 0x55d93f9066b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:27:51.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.422+0000 7fe9ed79a700 1 -- 172.21.15.82:0/710946739 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d93f902c40 msgr2=0x55d93f913800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:27:51.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.422+0000 7fe9ed79a700 1 --2- 172.21.15.82:0/710946739 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d93f902c40 0x55d93f913800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:27:51.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.422+0000 7fe9ed79a700 1 -- 172.21.15.82:0/710946739 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d93f669c60 con 0x55d93f908380 2023-09-23T09:27:51.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.422+0000 7fe9ed79a700 1 --2- 172.21.15.82:0/710946739 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d93f908380 0x55d93f906170 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe9d8009520 tx=0x7fe9d800bf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa4214c287bc438e server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:27:51.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.422+0000 7fe9dcff9700 1 -- 172.21.15.82:0/710946739 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d8098a10 con 0x55d93f908380 2023-09-23T09:27:51.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.422+0000 7fe9dcff9700 1 -- 172.21.15.82:0/710946739 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe9d809c840 con 0x55d93f908380 2023-09-23T09:27:51.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.422+0000 7fe9dcff9700 1 -- 172.21.15.82:0/710946739 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d8098ed0 con 0x55d93f908380 2023-09-23T09:27:51.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.423+0000 7fea03b52b80 1 -- 172.21.15.82:0/710946739 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d93f908380 msgr2=0x55d93f906170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:27:51.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.423+0000 7fea03b52b80 1 --2- 172.21.15.82:0/710946739 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d93f908380 0x55d93f906170 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe9d8009520 tx=0x7fe9d800bf20 comp rx=0 tx=0).stop 2023-09-23T09:27:51.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.426+0000 7fea03b52b80 1 -- 172.21.15.82:0/710946739 shutdown_connections 2023-09-23T09:27:51.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.426+0000 7fea03b52b80 1 --2- 172.21.15.82:0/710946739 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d93f908ca0 0x55d93f9066b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:27:51.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.426+0000 7fea03b52b80 1 --2- 172.21.15.82:0/710946739 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d93f902c40 0x55d93f913800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:27:51.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.426+0000 7fea03b52b80 1 --2- 172.21.15.82:0/710946739 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d93f908380 0x55d93f906170 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:27:51.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.426+0000 7fea03b52b80 1 -- 172.21.15.82:0/710946739 >> 172.21.15.82:0/710946739 conn(0x55d93f8770e0 msgr2=0x55d93f8fd1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:27:51.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.427+0000 7fea03b52b80 1 -- 172.21.15.82:0/710946739 shutdown_connections 2023-09-23T09:27:51.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.427+0000 7fea03b52b80 1 -- 172.21.15.82:0/710946739 wait complete. 2023-09-23T09:27:51.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.428+0000 7fea03b52b80 1 -- start start 2023-09-23T09:27:51.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.428+0000 7fea03b52b80 1 Processor -- start 2023-09-23T09:27:51.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.429+0000 7fea03b52b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d93f902c40 0x55d93f969700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:27:51.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.429+0000 7fea03b52b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d93f908380 0x55d93f969c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:27:51.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.429+0000 7fea03b52b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d93f908ca0 0x55d93f968490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:27:51.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.429+0000 7fea03b52b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d93f968a00 con 0x55d93f902c40 2023-09-23T09:27:51.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.429+0000 7fea03b52b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d93f968b70 con 0x55d93f908380 2023-09-23T09:27:51.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.429+0000 7fea03b52b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d93f968d30 con 0x55d93f908ca0 2023-09-23T09:27:51.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.429+0000 7fea03b52b80 10 client.0 _ll_register_callbacks cb 0x55d93f73ca80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:27:51.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.430+0000 7fe9ed79a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d93f908380 0x55d93f969c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:27:51.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.430+0000 7fe9edf9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d93f902c40 0x55d93f969700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:27:51.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.430+0000 7fe9edf9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d93f902c40 0x55d93f969700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60202/0 (socket says 172.21.15.82:60202) 2023-09-23T09:27:51.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.430+0000 7fe9edf9b700 1 -- 172.21.15.82:0/1114087103 learned_addr learned my addr 172.21.15.82:0/1114087103 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:27:51.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.431+0000 7fe9ed79a700 1 -- 172.21.15.82:0/1114087103 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d93f908ca0 msgr2=0x55d93f968490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:27:51.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.431+0000 7fe9ed79a700 1 --2- 172.21.15.82:0/1114087103 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d93f908ca0 0x55d93f968490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:27:51.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.431+0000 7fe9ed79a700 1 -- 172.21.15.82:0/1114087103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d93f902c40 msgr2=0x55d93f969700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:27:51.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.431+0000 7fe9ed79a700 1 --2- 172.21.15.82:0/1114087103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d93f902c40 0x55d93f969700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:27:51.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.431+0000 7fe9ed79a700 1 -- 172.21.15.82:0/1114087103 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9e8111120 con 0x55d93f908380 2023-09-23T09:27:51.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.431+0000 7fe9ed79a700 1 --2- 172.21.15.82:0/1114087103 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d93f908380 0x55d93f969c40 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fe9d8009520 tx=0x7fe9d8000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=213fd6ba4755e52b server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:27:51.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.432+0000 7fe9d17fa700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-09-23T09:27:51.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.432+0000 7fe9d17fa700 1 -- 172.21.15.82:0/1114087103 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d8098100 con 0x55d93f908380 2023-09-23T09:27:51.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.432+0000 7fe9d17fa700 1 -- 172.21.15.82:0/1114087103 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(137..137 src has 1..137) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fe9d80108d0 con 0x55d93f908380 2023-09-23T09:27:51.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.432+0000 7fea03b52b80 1 -- 172.21.15.82:0/1114087103 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d93f8f58b0 con 0x55d93f908380 2023-09-23T09:27:51.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.432+0000 7fe9d17fa700 1 -- 172.21.15.82:0/1114087103 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe9d8098c70 con 0x55d93f908380 2023-09-23T09:27:51.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.432+0000 7fea03b52b80 10 client.26903 fetch_fsmap learned FSMap version 83 2023-09-23T09:27:51.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.432+0000 7fea03b52b80 1 -- 172.21.15.82:0/1114087103 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=83,monmap=4+}) v3 -- 0x55d93f6a7250 con 0x55d93f908380 2023-09-23T09:27:51.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.433+0000 7fe9d17fa700 1 -- 172.21.15.82:0/1114087103 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d93f8f58b0 con 0x55d93f908380 2023-09-23T09:27:51.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.433+0000 7fe9d17fa700 1 -- 172.21.15.82:0/1114087103 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 83) v1 ==== 7910+0+0 (secure 0 0 0) 0x7fe9d8097970 con 0x55d93f908380 2023-09-23T09:27:51.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.434+0000 7fea03b52b80 10 client.26903 fetch_fsmap finished waiting for FSMap version 83 2023-09-23T09:27:51.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.434+0000 7fea03b52b80 10 client.26903 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:27:51.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.434+0000 7fea03b52b80 20 client.26903 populate_metadata read hostname 'smithi082' 2023-09-23T09:27:51.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.434+0000 7fea03b52b80 1 --2- 172.21.15.82:0/1114087103 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55d93f971320 0x55d93f973740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:27:51.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.434+0000 7fea03b52b80 4 client.26903 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:27:51.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.434+0000 7fea03b52b80 1 -- 172.21.15.82:0/1114087103 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55d93f84d970 con 0x55d93f971320 2023-09-23T09:27:51.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.434+0000 7fe9edf9b700 1 --2- 172.21.15.82:0/1114087103 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55d93f971320 0x55d93f973740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:27:51.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.436+0000 7fe9edf9b700 1 --2- 172.21.15.82:0/1114087103 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55d93f971320 0x55d93f973740 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc65ca57abfaa5f1 server_cookie=e96e967110f7113e in_seq=0 out_seq=0 2023-09-23T09:27:51.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.436+0000 7fe9d17fa700 10 client.26903 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:27:51.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.436+0000 7fe9d17fa700 1 -- 172.21.15.82:0/1114087103 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55d93f84d970 con 0x55d93f971320 2023-09-23T09:27:51.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.436+0000 7fe9d17fa700 10 client.26903 handle_command_reply: tid=0 2023-09-23T09:27:51.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.436+0000 7fea03b52b80 1 client.26903 shutdown 2023-09-23T09:27:51.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.437+0000 7fea03b52b80 1 -- 172.21.15.82:0/1114087103 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d93f908380 msgr2=0x55d93f969c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:27:51.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.437+0000 7fea03b52b80 1 --2- 172.21.15.82:0/1114087103 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d93f908380 0x55d93f969c40 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fe9d8009520 tx=0x7fe9d8000bc0 comp rx=0 tx=0).stop 2023-09-23T09:27:51.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.437+0000 7fea03b52b80 1 -- 172.21.15.82:0/1114087103 shutdown_connections 2023-09-23T09:27:51.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.437+0000 7fea03b52b80 1 --2- 172.21.15.82:0/1114087103 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d93f908ca0 0x55d93f968490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:27:51.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.437+0000 7fea03b52b80 1 --2- 172.21.15.82:0/1114087103 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55d93f971320 0x55d93f973740 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:27:51.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.437+0000 7fea03b52b80 1 --2- 172.21.15.82:0/1114087103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d93f902c40 0x55d93f969700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:27:51.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.437+0000 7fea03b52b80 1 --2- 172.21.15.82:0/1114087103 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d93f908380 0x55d93f969c40 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:27:51.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.437+0000 7fe9d17fa700 0 client.26903 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:27:51.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.437+0000 7fea03b52b80 1 -- 172.21.15.82:0/1114087103 >> 172.21.15.82:0/1114087103 conn(0x55d93f8770e0 msgr2=0x55d93f906170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:27:51.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.439+0000 7fea03b52b80 1 -- 172.21.15.82:0/1114087103 shutdown_connections 2023-09-23T09:27:51.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.440+0000 7fea03b52b80 1 -- 172.21.15.82:0/1114087103 wait complete. 2023-09-23T09:27:51.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.440+0000 7fea03b52b80 20 client.26903 trim_cache size 0 max 16384 2023-09-23T09:27:51.442 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:27:51.442 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-23T09:27:51.442 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:27:51.442 INFO:teuthology.orchestra.run.smithi082.stdout: "047cbc72-e254-4787-b038-382de9c1a9a4": { 2023-09-23T09:27:51.442 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:27:51.443 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "047cbc72-e254-4787-b038-382de9c1a9a4", 2023-09-23T09:27:51.443 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:27:51.443 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:27:51.443 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:27:51.443 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:27:51.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.446+0000 7fe9f01ff700 1 -- 172.21.15.82:0/460069524 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fe9d40a02d0 msgr2=0x7fe9d40a2790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:27:51.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.446+0000 7fe9f01ff700 1 --2- 172.21.15.82:0/460069524 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fe9d40a02d0 0x7fe9d40a2790 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe9e001c860 tx=0x7fe9e001c040 comp rx=0 tx=0).stop 2023-09-23T09:27:51.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.446+0000 7fe9f01ff700 1 -- 172.21.15.82:0/460069524 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9e80735e0 msgr2=0x7fe9e806f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:27:51.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.446+0000 7fe9f01ff700 1 --2- 172.21.15.82:0/460069524 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9e80735e0 0x7fe9e806f4e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe9d800d950 tx=0x7fe9d800dc60 comp rx=0 tx=0).stop 2023-09-23T09:27:51.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.446+0000 7fe9f01ff700 1 -- 172.21.15.82:0/460069524 shutdown_connections 2023-09-23T09:27:51.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.446+0000 7fe9f01ff700 1 --2- 172.21.15.82:0/460069524 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fe9d40a02d0 0x7fe9d40a2790 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:27:51.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.446+0000 7fe9f01ff700 1 --2- 172.21.15.82:0/460069524 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe9e8111880 0x7fe9e806fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:27:51.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.446+0000 7fe9f01ff700 1 --2- 172.21.15.82:0/460069524 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9e8072cc0 0x7fe9e80724d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:27:51.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.446+0000 7fe9f01ff700 1 --2- 172.21.15.82:0/460069524 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9e80735e0 0x7fe9e806f4e0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:27:51.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.446+0000 7fe9f01ff700 1 -- 172.21.15.82:0/460069524 >> 172.21.15.82:0/460069524 conn(0x7fe9e80fc3a0 msgr2=0x7fe9e80fd010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:27:51.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.453+0000 7fe9f01ff700 1 -- 172.21.15.82:0/460069524 shutdown_connections 2023-09-23T09:27:51.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:27:51.458+0000 7fe9f01ff700 1 -- 172.21.15.82:0/460069524 wait complete. 2023-09-23T09:27:51.488 INFO:tasks.cephfs.filesystem:scrub status for tag:047cbc72-e254-4787-b038-382de9c1a9a4 - {'path': '/', 'tag': '047cbc72-e254-4787-b038-382de9c1a9a4', 'options': 'recursive,force'} 2023-09-23T09:27:53.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:27:52 smithi135 ceph-mon[99205]: pgmap v980: 97 pgs: 97 active+clean; 15 GiB data, 49 GiB used, 1024 GiB / 1.0 TiB avail; 342 KiB/s rd, 16 MiB/s wr, 1.15k op/s 2023-09-23T09:27:53.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:27:52 smithi082 ceph-mon[97694]: pgmap v980: 97 pgs: 97 active+clean; 15 GiB data, 49 GiB used, 1024 GiB / 1.0 TiB avail; 342 KiB/s rd, 16 MiB/s wr, 1.15k op/s 2023-09-23T09:27:53.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:27:52 smithi161 ceph-mon[99580]: pgmap v980: 97 pgs: 97 active+clean; 15 GiB data, 49 GiB used, 1024 GiB / 1.0 TiB avail; 342 KiB/s rd, 16 MiB/s wr, 1.15k op/s 2023-09-23T09:27:54.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:27:53 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:27:54.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:27:53 smithi135 ceph-mon[99205]: pgmap v981: 97 pgs: 97 active+clean; 15 GiB data, 49 GiB used, 1024 GiB / 1.0 TiB avail; 342 KiB/s rd, 16 MiB/s wr, 1.15k op/s 2023-09-23T09:27:54.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:27:53 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:27:54.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:27:53 smithi082 ceph-mon[97694]: pgmap v981: 97 pgs: 97 active+clean; 15 GiB data, 49 GiB used, 1024 GiB / 1.0 TiB avail; 342 KiB/s rd, 16 MiB/s wr, 1.15k op/s 2023-09-23T09:27:54.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:27:53 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:27:54.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:27:53 smithi161 ceph-mon[99580]: pgmap v981: 97 pgs: 97 active+clean; 15 GiB data, 49 GiB used, 1024 GiB / 1.0 TiB avail; 342 KiB/s rd, 16 MiB/s wr, 1.15k op/s 2023-09-23T09:27:55.827 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 45.0 s, 726.3 tps, lat 138.305 ms stddev 38.311 2023-09-23T09:27:56.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:27:56 smithi082 ceph-mon[97694]: pgmap v982: 97 pgs: 97 active+clean; 15 GiB data, 49 GiB used, 1023 GiB / 1.0 TiB avail; 584 KiB/s rd, 24 MiB/s wr, 1.71k op/s 2023-09-23T09:27:56.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:27:56 smithi161 ceph-mon[99580]: pgmap v982: 97 pgs: 97 active+clean; 15 GiB data, 49 GiB used, 1023 GiB / 1.0 TiB avail; 584 KiB/s rd, 24 MiB/s wr, 1.71k op/s 2023-09-23T09:27:57.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:27:56 smithi135 ceph-mon[99205]: pgmap v982: 97 pgs: 97 active+clean; 15 GiB data, 49 GiB used, 1023 GiB / 1.0 TiB avail; 584 KiB/s rd, 24 MiB/s wr, 1.71k op/s 2023-09-23T09:27:58.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:27:57 smithi135 ceph-mon[99205]: pgmap v983: 97 pgs: 97 active+clean; 15 GiB data, 49 GiB used, 1023 GiB / 1.0 TiB avail; 411 KiB/s rd, 17 MiB/s wr, 1.18k op/s 2023-09-23T09:27:58.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:27:57 smithi082 ceph-mon[97694]: pgmap v983: 97 pgs: 97 active+clean; 15 GiB data, 49 GiB used, 1023 GiB / 1.0 TiB avail; 411 KiB/s rd, 17 MiB/s wr, 1.18k op/s 2023-09-23T09:27:58.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:27:57 smithi161 ceph-mon[99580]: pgmap v983: 97 pgs: 97 active+clean; 15 GiB data, 49 GiB used, 1023 GiB / 1.0 TiB avail; 411 KiB/s rd, 17 MiB/s wr, 1.18k op/s 2023-09-23T09:28:00.829 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 50.0 s, 581.2 tps, lat 123.167 ms stddev 55.877 2023-09-23T09:28:01.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:28:00 smithi135 ceph-mon[99205]: pgmap v984: 97 pgs: 97 active+clean; 15 GiB data, 50 GiB used, 1023 GiB / 1.0 TiB avail; 592 KiB/s rd, 25 MiB/s wr, 1.76k op/s 2023-09-23T09:28:01.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:28:00 smithi082 ceph-mon[97694]: pgmap v984: 97 pgs: 97 active+clean; 15 GiB data, 50 GiB used, 1023 GiB / 1.0 TiB avail; 592 KiB/s rd, 25 MiB/s wr, 1.76k op/s 2023-09-23T09:28:01.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:28:00 smithi161 ceph-mon[99580]: pgmap v984: 97 pgs: 97 active+clean; 15 GiB data, 50 GiB used, 1023 GiB / 1.0 TiB avail; 592 KiB/s rd, 25 MiB/s wr, 1.76k op/s 2023-09-23T09:28:03.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:28:02 smithi135 ceph-mon[99205]: pgmap v985: 97 pgs: 97 active+clean; 15 GiB data, 50 GiB used, 1023 GiB / 1.0 TiB avail; 423 KiB/s rd, 17 MiB/s wr, 1.14k op/s 2023-09-23T09:28:03.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:28:02 smithi082 ceph-mon[97694]: pgmap v985: 97 pgs: 97 active+clean; 15 GiB data, 50 GiB used, 1023 GiB / 1.0 TiB avail; 423 KiB/s rd, 17 MiB/s wr, 1.14k op/s 2023-09-23T09:28:03.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:28:02 smithi161 ceph-mon[99580]: pgmap v985: 97 pgs: 97 active+clean; 15 GiB data, 50 GiB used, 1023 GiB / 1.0 TiB avail; 423 KiB/s rd, 17 MiB/s wr, 1.14k op/s 2023-09-23T09:28:05.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:28:04 smithi135 ceph-mon[99205]: pgmap v986: 97 pgs: 97 active+clean; 15 GiB data, 50 GiB used, 1023 GiB / 1.0 TiB avail; 423 KiB/s rd, 17 MiB/s wr, 1.14k op/s 2023-09-23T09:28:05.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:28:04 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:28:05.131 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:28:04 smithi082 ceph-mon[97694]: pgmap v986: 97 pgs: 97 active+clean; 15 GiB data, 50 GiB used, 1023 GiB / 1.0 TiB avail; 423 KiB/s rd, 17 MiB/s wr, 1.14k op/s 2023-09-23T09:28:05.132 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:28:04 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:28:05.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:28:04 smithi161 ceph-mon[99580]: pgmap v986: 97 pgs: 97 active+clean; 15 GiB data, 50 GiB used, 1023 GiB / 1.0 TiB avail; 423 KiB/s rd, 17 MiB/s wr, 1.14k op/s 2023-09-23T09:28:05.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:28:04 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:28:05.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 55.0 s, 555.6 tps, lat 227.415 ms stddev 490.510 2023-09-23T09:28:07.065 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:28:06 smithi135 ceph-mon[99205]: pgmap v987: 97 pgs: 97 active+clean; 15 GiB data, 50 GiB used, 1023 GiB / 1.0 TiB avail; 645 KiB/s rd, 24 MiB/s wr, 1.66k op/s 2023-09-23T09:28:07.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:28:06 smithi082 ceph-mon[97694]: pgmap v987: 97 pgs: 97 active+clean; 15 GiB data, 50 GiB used, 1023 GiB / 1.0 TiB avail; 645 KiB/s rd, 24 MiB/s wr, 1.66k op/s 2023-09-23T09:28:07.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:28:06 smithi161 ceph-mon[99580]: pgmap v987: 97 pgs: 97 active+clean; 15 GiB data, 50 GiB used, 1023 GiB / 1.0 TiB avail; 645 KiB/s rd, 24 MiB/s wr, 1.66k op/s 2023-09-23T09:28:08.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:28:07 smithi135 ceph-mon[99205]: osdmap e138: 12 total, 12 up, 12 in 2023-09-23T09:28:08.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:28:07 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:28:08.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:28:07 smithi082 ceph-mon[97694]: osdmap e138: 12 total, 12 up, 12 in 2023-09-23T09:28:08.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:28:07 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:28:08.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:28:07 smithi161 ceph-mon[99580]: osdmap e138: 12 total, 12 up, 12 in 2023-09-23T09:28:08.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:28:07 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:28:09.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:28:08 smithi135 ceph-mon[99205]: pgmap v989: 97 pgs: 97 active+clean; 15 GiB data, 50 GiB used, 1023 GiB / 1.0 TiB avail; 484 KiB/s rd, 19 MiB/s wr, 1.33k op/s 2023-09-23T09:28:09.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:28:08 smithi082 ceph-mon[97694]: pgmap v989: 97 pgs: 97 active+clean; 15 GiB data, 50 GiB used, 1023 GiB / 1.0 TiB avail; 484 KiB/s rd, 19 MiB/s wr, 1.33k op/s 2023-09-23T09:28:09.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:28:08 smithi161 ceph-mon[99580]: pgmap v989: 97 pgs: 97 active+clean; 15 GiB data, 50 GiB used, 1023 GiB / 1.0 TiB avail; 484 KiB/s rd, 19 MiB/s wr, 1.33k op/s 2023-09-23T09:28:10.827 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 60.0 s, 350.6 tps, lat 290.881 ms stddev 253.489 2023-09-23T09:28:11.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:28:10 smithi135 ceph-mon[99205]: pgmap v990: 97 pgs: 97 active+clean; 15 GiB data, 50 GiB used, 1023 GiB / 1.0 TiB avail; 638 KiB/s rd, 14 MiB/s wr, 1.02k op/s 2023-09-23T09:28:11.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:28:10 smithi082 ceph-mon[97694]: pgmap v990: 97 pgs: 97 active+clean; 15 GiB data, 50 GiB used, 1023 GiB / 1.0 TiB avail; 638 KiB/s rd, 14 MiB/s wr, 1.02k op/s 2023-09-23T09:28:11.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:28:10 smithi161 ceph-mon[99580]: pgmap v990: 97 pgs: 97 active+clean; 15 GiB data, 50 GiB used, 1023 GiB / 1.0 TiB avail; 638 KiB/s rd, 14 MiB/s wr, 1.02k op/s 2023-09-23T09:28:12.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:28:12 smithi082 ceph-mon[97694]: pgmap v991: 97 pgs: 97 active+clean; 15 GiB data, 50 GiB used, 1023 GiB / 1.0 TiB avail; 639 KiB/s rd, 14 MiB/s wr, 1.02k op/s 2023-09-23T09:28:12.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:28:12 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:28:12.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:28:12 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:28:12.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:28:12 smithi082 ceph-mon[97694]: osdmap e139: 12 total, 12 up, 12 in 2023-09-23T09:28:12.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:28:12 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:28:12.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:28:12 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:28:12.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:28:12 smithi161 ceph-mon[99580]: pgmap v991: 97 pgs: 97 active+clean; 15 GiB data, 50 GiB used, 1023 GiB / 1.0 TiB avail; 639 KiB/s rd, 14 MiB/s wr, 1.02k op/s 2023-09-23T09:28:12.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:28:12 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:28:12.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:28:12 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:28:12.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:28:12 smithi161 ceph-mon[99580]: osdmap e139: 12 total, 12 up, 12 in 2023-09-23T09:28:12.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:28:12 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:28:12.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:28:12 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:28:13.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:28:12 smithi135 ceph-mon[99205]: pgmap v991: 97 pgs: 97 active+clean; 15 GiB data, 50 GiB used, 1023 GiB / 1.0 TiB avail; 639 KiB/s rd, 14 MiB/s wr, 1.02k op/s 2023-09-23T09:28:13.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:28:12 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:28:13.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:28:12 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:28:13.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:28:12 smithi135 ceph-mon[99205]: osdmap e139: 12 total, 12 up, 12 in 2023-09-23T09:28:13.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:28:12 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:28:13.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:28:12 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:28:13.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:28:13 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:28:13.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:28:13 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:28:13.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:28:13 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:28:13.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:28:13 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:28:13.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:28:13 smithi082 ceph-mon[97694]: Adjusting osd_memory_target on smithi135 to 220.9M 2023-09-23T09:28:13.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:28:13 smithi082 ceph-mon[97694]: Unable to set osd_memory_target on smithi135 to 231659008: error parsing value: Value '231659008' is below minimum 939524096 2023-09-23T09:28:13.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:28:13 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:28:13.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:28:13 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:28:13.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:28:13 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:28:13.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:28:13 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:28:13.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:28:13 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:28:13.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:28:13 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:28:13.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:28:13 smithi161 ceph-mon[99580]: Adjusting osd_memory_target on smithi135 to 220.9M 2023-09-23T09:28:13.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:28:13 smithi161 ceph-mon[99580]: Unable to set osd_memory_target on smithi135 to 231659008: error parsing value: Value '231659008' is below minimum 939524096 2023-09-23T09:28:13.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:28:13 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:28:13.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:28:13 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:28:14.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:28:13 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:28:14.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:28:13 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:28:14.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:28:13 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:28:14.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:28:13 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:28:14.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:28:13 smithi135 ceph-mon[99205]: Adjusting osd_memory_target on smithi135 to 220.9M 2023-09-23T09:28:14.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:28:13 smithi135 ceph-mon[99205]: Unable to set osd_memory_target on smithi135 to 231659008: error parsing value: Value '231659008' is below minimum 939524096 2023-09-23T09:28:14.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:28:13 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:28:14.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:28:13 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:28:14.873 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:28:14 smithi082 ceph-mon[97694]: pgmap v993: 97 pgs: 97 active+clean; 15 GiB data, 50 GiB used, 1023 GiB / 1.0 TiB avail; 466 KiB/s rd, 6.5 MiB/s wr, 492 op/s 2023-09-23T09:28:14.873 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:28:14 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:28:14.873 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:28:14 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:28:14.873 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:28:14 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:28:14.873 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:28:14 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:28:14.873 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:28:14 smithi082 ceph-mon[97694]: Adjusting osd_memory_target on smithi161 to 220.9M 2023-09-23T09:28:14.873 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:28:14 smithi082 ceph-mon[97694]: Unable to set osd_memory_target on smithi161 to 231676211: error parsing value: Value '231676211' is below minimum 939524096 2023-09-23T09:28:14.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:28:14 smithi161 ceph-mon[99580]: pgmap v993: 97 pgs: 97 active+clean; 15 GiB data, 50 GiB used, 1023 GiB / 1.0 TiB avail; 466 KiB/s rd, 6.5 MiB/s wr, 492 op/s 2023-09-23T09:28:14.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:28:14 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:28:14.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:28:14 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:28:14.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:28:14 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:28:14.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:28:14 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:28:14.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:28:14 smithi161 ceph-mon[99580]: Adjusting osd_memory_target on smithi161 to 220.9M 2023-09-23T09:28:14.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:28:14 smithi161 ceph-mon[99580]: Unable to set osd_memory_target on smithi161 to 231676211: error parsing value: Value '231676211' is below minimum 939524096 2023-09-23T09:28:15.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:28:14 smithi135 ceph-mon[99205]: pgmap v993: 97 pgs: 97 active+clean; 15 GiB data, 50 GiB used, 1023 GiB / 1.0 TiB avail; 466 KiB/s rd, 6.5 MiB/s wr, 492 op/s 2023-09-23T09:28:15.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:28:14 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:28:15.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:28:14 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:28:15.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:28:14 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:28:15.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:28:14 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:28:15.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:28:14 smithi135 ceph-mon[99205]: Adjusting osd_memory_target on smithi161 to 220.9M 2023-09-23T09:28:15.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:28:14 smithi135 ceph-mon[99205]: Unable to set osd_memory_target on smithi161 to 231676211: error parsing value: Value '231676211' is below minimum 939524096 2023-09-23T09:28:15.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 65.0 s, 549.0 tps, lat 179.214 ms stddev 52.060 2023-09-23T09:28:15.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:28:15 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:28:15.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:28:15 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:28:15.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:28:15 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:28:15.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:28:15 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:28:15.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:28:15 smithi082 ceph-mon[97694]: Adjusting osd_memory_target on smithi082 to 220.9M 2023-09-23T09:28:15.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:28:15 smithi082 ceph-mon[97694]: Unable to set osd_memory_target on smithi082 to 231651840: error parsing value: Value '231651840' is below minimum 939524096 2023-09-23T09:28:15.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:28:15 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:28:15.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:28:15 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:28:15.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:28:15 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:28:15.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:28:15 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:28:15.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:28:15 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:28:15.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:28:15 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:28:15.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:28:15 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:28:15.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:28:15 smithi161 ceph-mon[99580]: Adjusting osd_memory_target on smithi082 to 220.9M 2023-09-23T09:28:15.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:28:15 smithi161 ceph-mon[99580]: Unable to set osd_memory_target on smithi082 to 231651840: error parsing value: Value '231651840' is below minimum 939524096 2023-09-23T09:28:15.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:28:15 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:28:15.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:28:15 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:28:15.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:28:15 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:28:16.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:28:15 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:28:16.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:28:15 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:28:16.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:28:15 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:28:16.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:28:15 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:28:16.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:28:15 smithi135 ceph-mon[99205]: Adjusting osd_memory_target on smithi082 to 220.9M 2023-09-23T09:28:16.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:28:15 smithi135 ceph-mon[99205]: Unable to set osd_memory_target on smithi082 to 231651840: error parsing value: Value '231651840' is below minimum 939524096 2023-09-23T09:28:16.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:28:15 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:28:16.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:28:15 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:28:16.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:28:15 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:28:17.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:28:16 smithi135 ceph-mon[99205]: pgmap v994: 97 pgs: 97 active+clean; 15 GiB data, 50 GiB used, 1022 GiB / 1.0 TiB avail; 808 KiB/s rd, 15 MiB/s wr, 1.10k op/s 2023-09-23T09:28:17.129 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:28:16 smithi082 ceph-mon[97694]: pgmap v994: 97 pgs: 97 active+clean; 15 GiB data, 50 GiB used, 1022 GiB / 1.0 TiB avail; 808 KiB/s rd, 15 MiB/s wr, 1.10k op/s 2023-09-23T09:28:17.151 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:28:16 smithi161 ceph-mon[99580]: pgmap v994: 97 pgs: 97 active+clean; 15 GiB data, 50 GiB used, 1022 GiB / 1.0 TiB avail; 808 KiB/s rd, 15 MiB/s wr, 1.10k op/s 2023-09-23T09:28:18.315 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:28:17 smithi135 ceph-mon[99205]: pgmap v995: 97 pgs: 97 active+clean; 15 GiB data, 50 GiB used, 1022 GiB / 1.0 TiB avail; 714 KiB/s rd, 13 MiB/s wr, 972 op/s 2023-09-23T09:28:18.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:28:17 smithi082 ceph-mon[97694]: pgmap v995: 97 pgs: 97 active+clean; 15 GiB data, 50 GiB used, 1022 GiB / 1.0 TiB avail; 714 KiB/s rd, 13 MiB/s wr, 972 op/s 2023-09-23T09:28:18.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:28:17 smithi161 ceph-mon[99580]: pgmap v995: 97 pgs: 97 active+clean; 15 GiB data, 50 GiB used, 1022 GiB / 1.0 TiB avail; 714 KiB/s rd, 13 MiB/s wr, 972 op/s 2023-09-23T09:28:19.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:28:18 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:28:19.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:28:18 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:28:19.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:28:18 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:28:20.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:28:20 smithi135 ceph-mon[99205]: pgmap v996: 97 pgs: 97 active+clean; 15 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 725 KiB/s rd, 17 MiB/s wr, 1.24k op/s 2023-09-23T09:28:20.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:28:20 smithi082 ceph-mon[97694]: pgmap v996: 97 pgs: 97 active+clean; 15 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 725 KiB/s rd, 17 MiB/s wr, 1.24k op/s 2023-09-23T09:28:20.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:28:20 smithi161 ceph-mon[99580]: pgmap v996: 97 pgs: 97 active+clean; 15 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 725 KiB/s rd, 17 MiB/s wr, 1.24k op/s 2023-09-23T09:28:20.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 70.0 s, 613.2 tps, lat 165.915 ms stddev 66.351 2023-09-23T09:28:21.489 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:28:21.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.836+0000 7f4d25dff700 1 -- 172.21.15.82:0/3470748444 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4d20072cc0 msgr2=0x7f4d200730a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:28:21.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.836+0000 7f4d25dff700 1 --2- 172.21.15.82:0/3470748444 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4d20072cc0 0x7f4d200730a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f4d100098f0 tx=0x7f4d10009c00 comp rx=0 tx=0).stop 2023-09-23T09:28:21.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.837+0000 7f4d25dff700 1 -- 172.21.15.82:0/3470748444 shutdown_connections 2023-09-23T09:28:21.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.837+0000 7f4d25dff700 1 --2- 172.21.15.82:0/3470748444 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d20111880 0x7f4d20113c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:21.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.837+0000 7f4d25dff700 1 --2- 172.21.15.82:0/3470748444 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4d20072cc0 0x7f4d200730a0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:21.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.837+0000 7f4d25dff700 1 --2- 172.21.15.82:0/3470748444 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d200735e0 0x7f4d20111340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:21.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.837+0000 7f4d25dff700 1 -- 172.21.15.82:0/3470748444 >> 172.21.15.82:0/3470748444 conn(0x7f4d200fc3a0 msgr2=0x7f4d200fe7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:28:21.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.837+0000 7f4d25dff700 1 -- 172.21.15.82:0/3470748444 shutdown_connections 2023-09-23T09:28:21.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.837+0000 7f4d25dff700 1 -- 172.21.15.82:0/3470748444 wait complete. 2023-09-23T09:28:21.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.839+0000 7f4d25dff700 1 Processor -- start 2023-09-23T09:28:21.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.839+0000 7f4d25dff700 1 -- start start 2023-09-23T09:28:21.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.840+0000 7f4d25dff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d20072cc0 0x7f4d2010e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:21.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.840+0000 7f4d25dff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d200735e0 0x7f4d2010eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:21.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.840+0000 7f4d25dff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4d20111880 0x7f4d20109ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:21.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.840+0000 7f4d25dff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2010a1e0 con 0x7f4d200735e0 2023-09-23T09:28:21.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.840+0000 7f4d25dff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2010a350 con 0x7f4d20072cc0 2023-09-23T09:28:21.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.840+0000 7f4d25dff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2010a510 con 0x7f4d20111880 2023-09-23T09:28:21.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.840+0000 7f4d1ffff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4d20111880 0x7f4d20109ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:21.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.840+0000 7f4d1ffff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4d20111880 0x7f4d20109ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:40004/0 (socket says 172.21.15.82:40004) 2023-09-23T09:28:21.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.840+0000 7f4d1ffff700 1 -- 172.21.15.82:0/3906993569 learned_addr learned my addr 172.21.15.82:0/3906993569 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:28:21.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.840+0000 7f4d1effd700 1 --2- 172.21.15.82:0/3906993569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d200735e0 0x7f4d2010eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:21.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.841+0000 7f4d1f7fe700 1 --2- 172.21.15.82:0/3906993569 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d20072cc0 0x7f4d2010e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:21.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.841+0000 7f4d1ffff700 1 -- 172.21.15.82:0/3906993569 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d20072cc0 msgr2=0x7f4d2010e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:28:21.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.841+0000 7f4d1ffff700 1 --2- 172.21.15.82:0/3906993569 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d20072cc0 0x7f4d2010e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:21.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.841+0000 7f4d1ffff700 1 -- 172.21.15.82:0/3906993569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d200735e0 msgr2=0x7f4d2010eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:28:21.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.841+0000 7f4d1ffff700 1 --2- 172.21.15.82:0/3906993569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d200735e0 0x7f4d2010eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:21.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.841+0000 7f4d1ffff700 1 -- 172.21.15.82:0/3906993569 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d10009520 con 0x7f4d20111880 2023-09-23T09:28:21.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.842+0000 7f4d1ffff700 1 --2- 172.21.15.82:0/3906993569 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4d20111880 0x7f4d20109ad0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4d1800ef90 tx=0x7f4d1800c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:28:21.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.842+0000 7f4d1cff9700 1 -- 172.21.15.82:0/3906993569 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d18018070 con 0x7f4d20111880 2023-09-23T09:28:21.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.842+0000 7f4d1cff9700 1 -- 172.21.15.82:0/3906993569 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4d1800f040 con 0x7f4d20111880 2023-09-23T09:28:21.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.842+0000 7f4d1cff9700 1 -- 172.21.15.82:0/3906993569 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d18003de0 con 0x7f4d20111880 2023-09-23T09:28:21.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.842+0000 7f4d25dff700 1 -- 172.21.15.82:0/3906993569 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d2010a790 con 0x7f4d20111880 2023-09-23T09:28:21.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.842+0000 7f4d25dff700 1 -- 172.21.15.82:0/3906993569 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d2010d890 con 0x7f4d20111880 2023-09-23T09:28:21.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.849+0000 7f4d39764b80 1 Processor -- start 2023-09-23T09:28:21.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.849+0000 7f4d1cff9700 1 -- 172.21.15.82:0/3906993569 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f4d1800cb00 con 0x7f4d20111880 2023-09-23T09:28:21.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.850+0000 7f4d39764b80 1 -- start start 2023-09-23T09:28:21.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.850+0000 7f4d39764b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aac02ca380 0x55aac02ca760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:21.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.850+0000 7f4d39764b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aac02caca0 0x55aac02c4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:21.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.850+0000 7f4d39764b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55aac02c4c40 0x55aac02c50a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:21.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.850+0000 7f4d39764b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aac022c7b0 con 0x55aac02caca0 2023-09-23T09:28:21.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.850+0000 7f4d39764b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aac021d780 con 0x55aac02ca380 2023-09-23T09:28:21.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.850+0000 7f4d39764b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aac021b0a0 con 0x55aac02c4c40 2023-09-23T09:28:21.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.851+0000 7f4d1effd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aac02ca380 0x55aac02ca760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:21.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.851+0000 7f4d1effd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aac02ca380 0x55aac02ca760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:38622/0 (socket says 172.21.15.82:38622) 2023-09-23T09:28:21.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.851+0000 7f4d1effd700 1 -- 172.21.15.82:0/4271835809 learned_addr learned my addr 172.21.15.82:0/4271835809 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:28:21.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.851+0000 7f4d1effd700 1 --2- 172.21.15.82:0/4271835809 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55aac02c4c40 0x55aac02c50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:21.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.852+0000 7f4d1effd700 1 -- 172.21.15.82:0/4271835809 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55aac02c4c40 msgr2=0x55aac02c50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:28:21.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.852+0000 7f4d1effd700 1 --2- 172.21.15.82:0/4271835809 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55aac02c4c40 0x55aac02c50a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:21.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.852+0000 7f4d1effd700 1 -- 172.21.15.82:0/4271835809 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aac02caca0 msgr2=0x55aac02c4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:28:21.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.852+0000 7f4d1effd700 1 --2- 172.21.15.82:0/4271835809 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aac02caca0 0x55aac02c4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:21.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.852+0000 7f4d1effd700 1 -- 172.21.15.82:0/4271835809 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aac0096630 con 0x55aac02ca380 2023-09-23T09:28:21.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.852+0000 7f4d1effd700 1 --2- 172.21.15.82:0/4271835809 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aac02ca380 0x55aac02ca760 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4d08013780 tx=0x7f4d080096f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e62785a2c0f87ab server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:28:21.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.852+0000 7f4d1cff9700 1 --2- 172.21.15.82:0/3906993569 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f4d0c0a0290 0x7f4d0c0a2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:21.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.853+0000 7f4d1cff9700 1 -- 172.21.15.82:0/3906993569 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f4d180cb150 con 0x7f4d20111880 2023-09-23T09:28:21.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.853+0000 7f4d15ffb700 1 -- 172.21.15.82:0/4271835809 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d08013da0 con 0x55aac02ca380 2023-09-23T09:28:21.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.853+0000 7f4d15ffb700 1 -- 172.21.15.82:0/4271835809 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4d080130d0 con 0x55aac02ca380 2023-09-23T09:28:21.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.853+0000 7f4d15ffb700 1 -- 172.21.15.82:0/4271835809 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d0800f440 con 0x55aac02ca380 2023-09-23T09:28:21.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.854+0000 7f4d1f7fe700 1 --2- 172.21.15.82:0/3906993569 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f4d0c0a0290 0x7f4d0c0a2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:21.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.854+0000 7f4d39764b80 1 -- 172.21.15.82:0/4271835809 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aac02ca380 msgr2=0x55aac02ca760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:28:21.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.854+0000 7f4d39764b80 1 --2- 172.21.15.82:0/4271835809 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aac02ca380 0x55aac02ca760 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4d08013780 tx=0x7f4d080096f0 comp rx=0 tx=0).stop 2023-09-23T09:28:21.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.854+0000 7f4d39764b80 1 -- 172.21.15.82:0/4271835809 shutdown_connections 2023-09-23T09:28:21.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.854+0000 7f4d39764b80 1 --2- 172.21.15.82:0/4271835809 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55aac02c4c40 0x55aac02c50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:21.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.854+0000 7f4d39764b80 1 --2- 172.21.15.82:0/4271835809 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aac02ca380 0x55aac02ca760 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:21.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.854+0000 7f4d39764b80 1 --2- 172.21.15.82:0/4271835809 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aac02caca0 0x55aac02c4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:21.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.854+0000 7f4d39764b80 1 -- 172.21.15.82:0/4271835809 >> 172.21.15.82:0/4271835809 conn(0x55aac02390e0 msgr2=0x55aac02bf410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:28:21.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.855+0000 7f4d39764b80 1 -- 172.21.15.82:0/4271835809 shutdown_connections 2023-09-23T09:28:21.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.855+0000 7f4d1f7fe700 1 --2- 172.21.15.82:0/3906993569 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f4d0c0a0290 0x7f4d0c0a2750 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x55aac02cb100 tx=0x7f4d10019040 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:28:21.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.855+0000 7f4d39764b80 1 -- 172.21.15.82:0/4271835809 wait complete. 2023-09-23T09:28:21.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.855+0000 7f4d39764b80 1 -- start start 2023-09-23T09:28:21.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.856+0000 7f4d39764b80 1 Processor -- start 2023-09-23T09:28:21.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.856+0000 7f4d39764b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aac02c4c40 0x55aac02d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:21.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.856+0000 7f4d39764b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55aac02ca380 0x55aac02cde60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:21.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.856+0000 7f4d39764b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aac02caca0 0x55aac02ce5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:21.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.856+0000 7f4d39764b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aac0216990 con 0x55aac02caca0 2023-09-23T09:28:21.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.856+0000 7f4d39764b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aac01b4bb0 con 0x55aac02c4c40 2023-09-23T09:28:21.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.856+0000 7f4d39764b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aac01b48b0 con 0x55aac02ca380 2023-09-23T09:28:21.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.856+0000 7f4d39764b80 10 client.0 _ll_register_callbacks cb 0x55aac00fea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:28:21.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.857+0000 7f4d1ffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aac02caca0 0x55aac02ce5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:21.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.857+0000 7f4d1ffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aac02caca0 0x55aac02ce5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35692/0 (socket says 172.21.15.82:35692) 2023-09-23T09:28:21.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.857+0000 7f4d1ffff700 1 -- 172.21.15.82:0/1672609223 learned_addr learned my addr 172.21.15.82:0/1672609223 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:28:21.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.857+0000 7f4d1effd700 1 --2- 172.21.15.82:0/1672609223 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55aac02ca380 0x55aac02cde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:21.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.857+0000 7f4d1f7fe700 1 --2- 172.21.15.82:0/1672609223 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aac02c4c40 0x55aac02d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:21.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.858+0000 7f4d1ffff700 1 -- 172.21.15.82:0/1672609223 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55aac02ca380 msgr2=0x55aac02cde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:28:21.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.858+0000 7f4d1ffff700 1 --2- 172.21.15.82:0/1672609223 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55aac02ca380 0x55aac02cde60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:21.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.858+0000 7f4d1ffff700 1 -- 172.21.15.82:0/1672609223 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aac02c4c40 msgr2=0x55aac02d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:28:21.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.858+0000 7f4d1ffff700 1 --2- 172.21.15.82:0/1672609223 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aac02c4c40 0x55aac02d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:21.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.858+0000 7f4d1ffff700 1 -- 172.21.15.82:0/1672609223 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d0801b040 con 0x55aac02caca0 2023-09-23T09:28:21.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.858+0000 7f4d1ffff700 1 --2- 172.21.15.82:0/1672609223 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aac02caca0 0x55aac02ce5a0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f4d180090a0 tx=0x7f4d18004e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=256ada6f7eaadc69 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:28:21.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.858+0000 7f4cfeffd700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:28:21.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.858+0000 7f4cfeffd700 1 -- 172.21.15.82:0/1672609223 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d180092e0 con 0x55aac02caca0 2023-09-23T09:28:21.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.859+0000 7f4cfeffd700 1 -- 172.21.15.82:0/1672609223 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(139..139 src has 1..139) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f4d18098890 con 0x55aac02caca0 2023-09-23T09:28:21.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.859+0000 7f4d39764b80 1 -- 172.21.15.82:0/1672609223 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55aac02941c0 con 0x55aac02caca0 2023-09-23T09:28:21.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.859+0000 7f4cfeffd700 1 -- 172.21.15.82:0/1672609223 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4d1809c6c0 con 0x55aac02caca0 2023-09-23T09:28:21.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.859+0000 7f4d39764b80 10 client.17232 fetch_fsmap learned FSMap version 86 2023-09-23T09:28:21.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.859+0000 7f4d39764b80 1 -- 172.21.15.82:0/1672609223 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=86,monmap=4+}) v3 -- 0x55aac0042de0 con 0x55aac02caca0 2023-09-23T09:28:21.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.860+0000 7f4cfeffd700 1 -- 172.21.15.82:0/1672609223 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55aac02941c0 con 0x55aac02caca0 2023-09-23T09:28:21.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.860+0000 7f4cfeffd700 1 -- 172.21.15.82:0/1672609223 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 86) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f4d18094680 con 0x55aac02caca0 2023-09-23T09:28:21.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.860+0000 7f4d39764b80 10 client.17232 fetch_fsmap finished waiting for FSMap version 86 2023-09-23T09:28:21.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.860+0000 7f4d39764b80 10 client.17232 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:28:21.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.860+0000 7f4d39764b80 20 client.17232 populate_metadata read hostname 'smithi082' 2023-09-23T09:28:21.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.860+0000 7f4d39764b80 1 --2- 172.21.15.82:0/1672609223 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55aac02de4d0 0x55aac02e08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:21.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.860+0000 7f4d39764b80 4 client.17232 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:28:21.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.860+0000 7f4d39764b80 1 -- 172.21.15.82:0/1672609223 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55aac01bcba0 con 0x55aac02de4d0 2023-09-23T09:28:21.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.860+0000 7f4d1f7fe700 1 --2- 172.21.15.82:0/1672609223 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55aac02de4d0 0x55aac02e08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:21.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.861+0000 7f4d1f7fe700 1 --2- 172.21.15.82:0/1672609223 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55aac02de4d0 0x55aac02e08f0 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a8efe2251613082c server_cookie=9aec909b5663c9e8 in_seq=0 out_seq=0 2023-09-23T09:28:21.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.861+0000 7f4cfeffd700 10 client.17232 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:28:21.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.862+0000 7f4cfeffd700 1 -- 172.21.15.82:0/1672609223 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55aac01bcba0 con 0x55aac02de4d0 2023-09-23T09:28:21.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.862+0000 7f4cfeffd700 10 client.17232 handle_command_reply: tid=0 2023-09-23T09:28:21.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.863+0000 7f4d39764b80 1 client.17232 shutdown 2023-09-23T09:28:21.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.863+0000 7f4d39764b80 1 -- 172.21.15.82:0/1672609223 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aac02caca0 msgr2=0x55aac02ce5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:28:21.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.863+0000 7f4d39764b80 1 --2- 172.21.15.82:0/1672609223 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aac02caca0 0x55aac02ce5a0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f4d180090a0 tx=0x7f4d18004e30 comp rx=0 tx=0).stop 2023-09-23T09:28:21.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.863+0000 7f4d39764b80 1 -- 172.21.15.82:0/1672609223 shutdown_connections 2023-09-23T09:28:21.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.863+0000 7f4d39764b80 1 --2- 172.21.15.82:0/1672609223 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55aac02de4d0 0x55aac02e08f0 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:21.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.863+0000 7f4d39764b80 1 --2- 172.21.15.82:0/1672609223 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aac02caca0 0x55aac02ce5a0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:21.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.863+0000 7f4d39764b80 1 --2- 172.21.15.82:0/1672609223 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aac02c4c40 0x55aac02d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:21.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.863+0000 7f4d39764b80 1 --2- 172.21.15.82:0/1672609223 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55aac02ca380 0x55aac02cde60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:21.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.863+0000 7f4d39764b80 1 -- 172.21.15.82:0/1672609223 >> 172.21.15.82:0/1672609223 conn(0x55aac02390e0 msgr2=0x55aac02b9b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:28:21.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.863+0000 7f4cfeffd700 0 client.17232 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:28:21.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.864+0000 7f4d39764b80 1 -- 172.21.15.82:0/1672609223 shutdown_connections 2023-09-23T09:28:21.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.864+0000 7f4d39764b80 1 -- 172.21.15.82:0/1672609223 wait complete. 2023-09-23T09:28:21.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.864+0000 7f4d39764b80 20 client.17232 trim_cache size 0 max 16384 2023-09-23T09:28:21.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.895+0000 7f4d39764b80 1 Processor -- start 2023-09-23T09:28:21.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.895+0000 7f4d39764b80 1 -- start start 2023-09-23T09:28:21.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.896+0000 7f4d39764b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55aac02c4c40 0x55aac02c4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:21.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.896+0000 7f4d39764b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aac02ca380 0x55aac02d0780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:21.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.896+0000 7f4d39764b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aac02caca0 0x55aac02cd700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:21.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.896+0000 7f4d39764b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aac0098920 con 0x55aac02caca0 2023-09-23T09:28:21.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.896+0000 7f4d39764b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aac02db0c0 con 0x55aac02ca380 2023-09-23T09:28:21.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.896+0000 7f4d39764b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aac02bba20 con 0x55aac02c4c40 2023-09-23T09:28:21.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.896+0000 7f4d1effd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aac02ca380 0x55aac02d0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:21.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.896+0000 7f4d1effd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aac02ca380 0x55aac02d0780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:38634/0 (socket says 172.21.15.82:38634) 2023-09-23T09:28:21.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.896+0000 7f4d1effd700 1 -- 172.21.15.82:0/1110720094 learned_addr learned my addr 172.21.15.82:0/1110720094 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:28:21.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.897+0000 7f4d1f7fe700 1 --2- 172.21.15.82:0/1110720094 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55aac02c4c40 0x55aac02c4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:21.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.897+0000 7f4d1ffff700 1 --2- 172.21.15.82:0/1110720094 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aac02caca0 0x55aac02cd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:21.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.897+0000 7f4d1effd700 1 -- 172.21.15.82:0/1110720094 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55aac02c4c40 msgr2=0x55aac02c4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:28:21.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.897+0000 7f4d1effd700 1 --2- 172.21.15.82:0/1110720094 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55aac02c4c40 0x55aac02c4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:21.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.897+0000 7f4d1effd700 1 -- 172.21.15.82:0/1110720094 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aac02caca0 msgr2=0x55aac02cd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:28:21.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.897+0000 7f4d1effd700 1 --2- 172.21.15.82:0/1110720094 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aac02caca0 0x55aac02cd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:21.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.897+0000 7f4d1effd700 1 -- 172.21.15.82:0/1110720094 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aac002bc60 con 0x55aac02ca380 2023-09-23T09:28:21.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.898+0000 7f4d1effd700 1 --2- 172.21.15.82:0/1110720094 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aac02ca380 0x55aac02d0780 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4d08005950 tx=0x7f4d080094d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=478a4ca9f336771f server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:28:21.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.901+0000 7f4d167fc700 1 -- 172.21.15.82:0/1110720094 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d08013e30 con 0x55aac02ca380 2023-09-23T09:28:21.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.901+0000 7f4d167fc700 1 -- 172.21.15.82:0/1110720094 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4d08005550 con 0x55aac02ca380 2023-09-23T09:28:21.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.901+0000 7f4d167fc700 1 -- 172.21.15.82:0/1110720094 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d08003bc0 con 0x55aac02ca380 2023-09-23T09:28:21.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.902+0000 7f4d39764b80 1 -- 172.21.15.82:0/1110720094 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aac02ca380 msgr2=0x55aac02d0780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:28:21.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.902+0000 7f4d39764b80 1 --2- 172.21.15.82:0/1110720094 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aac02ca380 0x55aac02d0780 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4d08005950 tx=0x7f4d080094d0 comp rx=0 tx=0).stop 2023-09-23T09:28:21.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.902+0000 7f4d39764b80 1 -- 172.21.15.82:0/1110720094 shutdown_connections 2023-09-23T09:28:21.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.902+0000 7f4d39764b80 1 --2- 172.21.15.82:0/1110720094 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aac02caca0 0x55aac02cd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:21.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.902+0000 7f4d39764b80 1 --2- 172.21.15.82:0/1110720094 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55aac02c4c40 0x55aac02c4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:21.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.902+0000 7f4d39764b80 1 --2- 172.21.15.82:0/1110720094 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aac02ca380 0x55aac02d0780 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:21.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.902+0000 7f4d39764b80 1 -- 172.21.15.82:0/1110720094 >> 172.21.15.82:0/1110720094 conn(0x55aac02390e0 msgr2=0x55aac02c7fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:28:21.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.902+0000 7f4d39764b80 1 -- 172.21.15.82:0/1110720094 shutdown_connections 2023-09-23T09:28:21.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.902+0000 7f4d39764b80 1 -- 172.21.15.82:0/1110720094 wait complete. 2023-09-23T09:28:21.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.903+0000 7f4d39764b80 1 -- start start 2023-09-23T09:28:21.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.903+0000 7f4d39764b80 1 Processor -- start 2023-09-23T09:28:21.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.904+0000 7f4d39764b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aac02c4c40 0x55aac02c7210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:21.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.904+0000 7f4d39764b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aac02ca380 0x55aac02c7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:21.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.904+0000 7f4d39764b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55aac02caca0 0x55aac02c5e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:21.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.904+0000 7f4d39764b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aac02c6450 con 0x55aac02ca380 2023-09-23T09:28:21.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.904+0000 7f4d39764b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aac02c65c0 con 0x55aac02c4c40 2023-09-23T09:28:21.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.904+0000 7f4d39764b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aac02c6780 con 0x55aac02caca0 2023-09-23T09:28:21.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.904+0000 7f4d39764b80 10 client.0 _ll_register_callbacks cb 0x7f4d180982a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:28:21.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.904+0000 7f4d1f7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aac02c4c40 0x55aac02c7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:21.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.904+0000 7f4d1f7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aac02c4c40 0x55aac02c7210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:38644/0 (socket says 172.21.15.82:38644) 2023-09-23T09:28:21.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.904+0000 7f4d1f7fe700 1 -- 172.21.15.82:0/490810880 learned_addr learned my addr 172.21.15.82:0/490810880 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:28:21.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.904+0000 7f4d1ffff700 1 --2- 172.21.15.82:0/490810880 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55aac02caca0 0x55aac02c5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:21.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.905+0000 7f4d1effd700 1 --2- 172.21.15.82:0/490810880 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aac02ca380 0x55aac02c7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:21.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.905+0000 7f4d1ffff700 1 -- 172.21.15.82:0/490810880 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aac02c4c40 msgr2=0x55aac02c7210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:28:21.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.905+0000 7f4d1ffff700 1 --2- 172.21.15.82:0/490810880 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aac02c4c40 0x55aac02c7210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:21.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.905+0000 7f4d1ffff700 1 -- 172.21.15.82:0/490810880 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aac02ca380 msgr2=0x55aac02c7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:28:21.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.905+0000 7f4d1ffff700 1 --2- 172.21.15.82:0/490810880 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aac02ca380 0x55aac02c7750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:21.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.905+0000 7f4d1ffff700 1 -- 172.21.15.82:0/490810880 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55aac0096630 con 0x55aac02caca0 2023-09-23T09:28:21.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.905+0000 7f4d1ffff700 1 --2- 172.21.15.82:0/490810880 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55aac02caca0 0x55aac02c5e00 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f4d18009fd0 tx=0x7f4d180a04c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee52d59bc74459b1 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:28:21.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.905+0000 7f4cfeffd700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T09:28:21.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.906+0000 7f4cfeffd700 1 -- 172.21.15.82:0/490810880 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d180092e0 con 0x55aac02caca0 2023-09-23T09:28:21.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.906+0000 7f4cfeffd700 1 -- 172.21.15.82:0/490810880 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(139..139 src has 1..139) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f4d18098890 con 0x55aac02caca0 2023-09-23T09:28:21.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.906+0000 7f4d39764b80 1 -- 172.21.15.82:0/490810880 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55aac02b78b0 con 0x55aac02caca0 2023-09-23T09:28:21.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.906+0000 7f4cfeffd700 1 -- 172.21.15.82:0/490810880 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4d1809c6c0 con 0x55aac02caca0 2023-09-23T09:28:21.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.906+0000 7f4d39764b80 10 client.26980 fetch_fsmap learned FSMap version 86 2023-09-23T09:28:21.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.906+0000 7f4d39764b80 1 -- 172.21.15.82:0/490810880 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=86,monmap=4+}) v3 -- 0x55aac0069250 con 0x55aac02caca0 2023-09-23T09:28:21.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.907+0000 7f4cfeffd700 1 -- 172.21.15.82:0/490810880 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55aac02b78b0 con 0x55aac02caca0 2023-09-23T09:28:21.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.907+0000 7f4cfeffd700 1 -- 172.21.15.82:0/490810880 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 86) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f4d180978e0 con 0x55aac02caca0 2023-09-23T09:28:21.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.907+0000 7f4d39764b80 10 client.26980 fetch_fsmap finished waiting for FSMap version 86 2023-09-23T09:28:21.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.907+0000 7f4d39764b80 10 client.26980 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:28:21.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.907+0000 7f4d39764b80 20 client.26980 populate_metadata read hostname 'smithi082' 2023-09-23T09:28:21.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.907+0000 7f4d39764b80 1 --2- 172.21.15.82:0/490810880 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55aac0332fd0 0x55aac03353f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:21.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.907+0000 7f4d39764b80 4 client.26980 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:28:21.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.907+0000 7f4d39764b80 1 -- 172.21.15.82:0/490810880 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55aac020f970 con 0x55aac0332fd0 2023-09-23T09:28:21.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.908+0000 7f4d1f7fe700 1 --2- 172.21.15.82:0/490810880 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55aac0332fd0 0x55aac03353f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:21.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.909+0000 7f4cfeffd700 10 client.26980 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:28:21.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.909+0000 7f4d1f7fe700 1 --2- 172.21.15.82:0/490810880 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55aac0332fd0 0x55aac03353f0 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ff31f7ec565cc32 server_cookie=ba6a26a4b478671a in_seq=0 out_seq=0 2023-09-23T09:28:21.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.909+0000 7f4cfeffd700 1 -- 172.21.15.82:0/490810880 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55aac020f970 con 0x55aac0332fd0 2023-09-23T09:28:21.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.909+0000 7f4cfeffd700 10 client.26980 handle_command_reply: tid=0 2023-09-23T09:28:21.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.909+0000 7f4d39764b80 1 client.26980 shutdown 2023-09-23T09:28:21.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.909+0000 7f4d39764b80 1 -- 172.21.15.82:0/490810880 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55aac02caca0 msgr2=0x55aac02c5e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:28:21.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.909+0000 7f4d39764b80 1 --2- 172.21.15.82:0/490810880 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55aac02caca0 0x55aac02c5e00 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f4d18009fd0 tx=0x7f4d180a04c0 comp rx=0 tx=0).stop 2023-09-23T09:28:21.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.909+0000 7f4d39764b80 1 -- 172.21.15.82:0/490810880 shutdown_connections 2023-09-23T09:28:21.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.909+0000 7f4d39764b80 1 --2- 172.21.15.82:0/490810880 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55aac02caca0 0x55aac02c5e00 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:21.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.909+0000 7f4d39764b80 1 --2- 172.21.15.82:0/490810880 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aac02c4c40 0x55aac02c7210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:21.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.909+0000 7f4d39764b80 1 --2- 172.21.15.82:0/490810880 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55aac0332fd0 0x55aac03353f0 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:21.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.909+0000 7f4d39764b80 1 --2- 172.21.15.82:0/490810880 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aac02ca380 0x55aac02c7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:21.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.909+0000 7f4d39764b80 1 -- 172.21.15.82:0/490810880 >> 172.21.15.82:0/490810880 conn(0x55aac02390e0 msgr2=0x55aac02cd700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:28:21.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.909+0000 7f4cfeffd700 0 client.26980 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:28:21.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.910+0000 7f4d39764b80 1 -- 172.21.15.82:0/490810880 shutdown_connections 2023-09-23T09:28:21.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.910+0000 7f4d39764b80 1 -- 172.21.15.82:0/490810880 wait complete. 2023-09-23T09:28:21.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.910+0000 7f4d39764b80 20 client.26980 trim_cache size 0 max 16384 2023-09-23T09:28:21.914 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:28:21.914 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-23T09:28:21.914 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:28:21.914 INFO:teuthology.orchestra.run.smithi082.stdout: "047cbc72-e254-4787-b038-382de9c1a9a4": { 2023-09-23T09:28:21.914 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:28:21.914 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "047cbc72-e254-4787-b038-382de9c1a9a4", 2023-09-23T09:28:21.914 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:28:21.914 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:28:21.914 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:28:21.914 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:28:21.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.911+0000 7f4d25dff700 1 -- 172.21.15.82:0/3906993569 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f4d0c0a0290 msgr2=0x7f4d0c0a2750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:28:21.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.911+0000 7f4d25dff700 1 --2- 172.21.15.82:0/3906993569 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f4d0c0a0290 0x7f4d0c0a2750 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x55aac02cb100 tx=0x7f4d10019040 comp rx=0 tx=0).stop 2023-09-23T09:28:21.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.911+0000 7f4d25dff700 1 -- 172.21.15.82:0/3906993569 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4d20111880 msgr2=0x7f4d20109ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:28:21.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.911+0000 7f4d25dff700 1 --2- 172.21.15.82:0/3906993569 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4d20111880 0x7f4d20109ad0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4d1800ef90 tx=0x7f4d1800c450 comp rx=0 tx=0).stop 2023-09-23T09:28:21.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.911+0000 7f4d25dff700 1 -- 172.21.15.82:0/3906993569 shutdown_connections 2023-09-23T09:28:21.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.911+0000 7f4d25dff700 1 --2- 172.21.15.82:0/3906993569 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f4d0c0a0290 0x7f4d0c0a2750 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:21.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.911+0000 7f4d25dff700 1 --2- 172.21.15.82:0/3906993569 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4d20111880 0x7f4d20109ad0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:21.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.911+0000 7f4d25dff700 1 --2- 172.21.15.82:0/3906993569 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d20072cc0 0x7f4d2010e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:21.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.911+0000 7f4d25dff700 1 --2- 172.21.15.82:0/3906993569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d200735e0 0x7f4d2010eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:21.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.911+0000 7f4d25dff700 1 -- 172.21.15.82:0/3906993569 >> 172.21.15.82:0/3906993569 conn(0x7f4d200fc3a0 msgr2=0x7f4d200fd010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:28:21.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.911+0000 7f4d25dff700 1 -- 172.21.15.82:0/3906993569 shutdown_connections 2023-09-23T09:28:21.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:21.912+0000 7f4d25dff700 1 -- 172.21.15.82:0/3906993569 wait complete. 2023-09-23T09:28:21.942 INFO:tasks.cephfs.filesystem:scrub status for tag:047cbc72-e254-4787-b038-382de9c1a9a4 - {'path': '/', 'tag': '047cbc72-e254-4787-b038-382de9c1a9a4', 'options': 'recursive,force'} 2023-09-23T09:28:22.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:28:22 smithi082 ceph-mon[97694]: pgmap v997: 97 pgs: 97 active+clean; 15 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 725 KiB/s rd, 17 MiB/s wr, 1.24k op/s 2023-09-23T09:28:22.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:28:22 smithi161 ceph-mon[99580]: pgmap v997: 97 pgs: 97 active+clean; 15 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 725 KiB/s rd, 17 MiB/s wr, 1.24k op/s 2023-09-23T09:28:23.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:28:22 smithi135 ceph-mon[99205]: pgmap v997: 97 pgs: 97 active+clean; 15 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 725 KiB/s rd, 17 MiB/s wr, 1.24k op/s 2023-09-23T09:28:24.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:28:24 smithi161 ceph-mon[99580]: pgmap v998: 97 pgs: 97 active+clean; 15 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 626 KiB/s rd, 15 MiB/s wr, 1.07k op/s 2023-09-23T09:28:25.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:28:24 smithi135 ceph-mon[99205]: pgmap v998: 97 pgs: 97 active+clean; 15 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 626 KiB/s rd, 15 MiB/s wr, 1.07k op/s 2023-09-23T09:28:25.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:28:24 smithi082 ceph-mon[97694]: pgmap v998: 97 pgs: 97 active+clean; 15 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 626 KiB/s rd, 15 MiB/s wr, 1.07k op/s 2023-09-23T09:28:25.830 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 75.0 s, 621.4 tps, lat 160.814 ms stddev 50.635 2023-09-23T09:28:26.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:28:26 smithi161 ceph-mon[99580]: pgmap v999: 97 pgs: 97 active+clean; 15 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 851 KiB/s rd, 22 MiB/s wr, 1.59k op/s 2023-09-23T09:28:27.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:28:26 smithi135 ceph-mon[99205]: pgmap v999: 97 pgs: 97 active+clean; 15 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 851 KiB/s rd, 22 MiB/s wr, 1.59k op/s 2023-09-23T09:28:27.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:28:26 smithi082 ceph-mon[97694]: pgmap v999: 97 pgs: 97 active+clean; 15 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 851 KiB/s rd, 22 MiB/s wr, 1.59k op/s 2023-09-23T09:28:28.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:28:27 smithi135 ceph-mon[99205]: pgmap v1000: 97 pgs: 97 active+clean; 15 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 566 KiB/s rd, 15 MiB/s wr, 1.10k op/s 2023-09-23T09:28:28.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:28:27 smithi082 ceph-mon[97694]: pgmap v1000: 97 pgs: 97 active+clean; 15 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 566 KiB/s rd, 15 MiB/s wr, 1.10k op/s 2023-09-23T09:28:28.400 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:28:27 smithi161 ceph-mon[99580]: pgmap v1000: 97 pgs: 97 active+clean; 15 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 566 KiB/s rd, 15 MiB/s wr, 1.10k op/s 2023-09-23T09:28:30.830 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 80.0 s, 509.2 tps, lat 197.300 ms stddev 62.716 2023-09-23T09:28:30.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:28:30 smithi161 ceph-mon[99580]: pgmap v1001: 97 pgs: 97 active+clean; 15 GiB data, 51 GiB used, 1021 GiB / 1.0 TiB avail; 1.0 MiB/s rd, 22 MiB/s wr, 1.65k op/s 2023-09-23T09:28:31.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:28:30 smithi135 ceph-mon[99205]: pgmap v1001: 97 pgs: 97 active+clean; 15 GiB data, 51 GiB used, 1021 GiB / 1.0 TiB avail; 1.0 MiB/s rd, 22 MiB/s wr, 1.65k op/s 2023-09-23T09:28:31.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:28:30 smithi082 ceph-mon[97694]: pgmap v1001: 97 pgs: 97 active+clean; 15 GiB data, 51 GiB used, 1021 GiB / 1.0 TiB avail; 1.0 MiB/s rd, 22 MiB/s wr, 1.65k op/s 2023-09-23T09:28:32.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:28:32 smithi161 ceph-mon[99580]: pgmap v1002: 97 pgs: 97 active+clean; 15 GiB data, 51 GiB used, 1021 GiB / 1.0 TiB avail; 744 KiB/s rd, 15 MiB/s wr, 1.09k op/s 2023-09-23T09:28:33.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:28:32 smithi135 ceph-mon[99205]: pgmap v1002: 97 pgs: 97 active+clean; 15 GiB data, 51 GiB used, 1021 GiB / 1.0 TiB avail; 744 KiB/s rd, 15 MiB/s wr, 1.09k op/s 2023-09-23T09:28:33.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:28:32 smithi082 ceph-mon[97694]: pgmap v1002: 97 pgs: 97 active+clean; 15 GiB data, 51 GiB used, 1021 GiB / 1.0 TiB avail; 744 KiB/s rd, 15 MiB/s wr, 1.09k op/s 2023-09-23T09:28:33.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:28:33 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:28:34.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:28:33 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:28:34.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:28:33 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:28:35.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:28:34 smithi135 ceph-mon[99205]: pgmap v1003: 97 pgs: 97 active+clean; 15 GiB data, 51 GiB used, 1021 GiB / 1.0 TiB avail; 744 KiB/s rd, 15 MiB/s wr, 1.09k op/s 2023-09-23T09:28:35.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:28:34 smithi082 ceph-mon[97694]: pgmap v1003: 97 pgs: 97 active+clean; 15 GiB data, 51 GiB used, 1021 GiB / 1.0 TiB avail; 744 KiB/s rd, 15 MiB/s wr, 1.09k op/s 2023-09-23T09:28:35.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:28:34 smithi161 ceph-mon[99580]: pgmap v1003: 97 pgs: 97 active+clean; 15 GiB data, 51 GiB used, 1021 GiB / 1.0 TiB avail; 744 KiB/s rd, 15 MiB/s wr, 1.09k op/s 2023-09-23T09:28:35.830 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 85.0 s, 156.5 tps, lat 165.666 ms stddev 49.322 2023-09-23T09:28:37.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:28:36 smithi135 ceph-mon[99205]: pgmap v1004: 97 pgs: 97 active+clean; 15 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 1.1 MiB/s rd, 20 MiB/s wr, 1.46k op/s 2023-09-23T09:28:37.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:28:36 smithi082 ceph-mon[97694]: pgmap v1004: 97 pgs: 97 active+clean; 15 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 1.1 MiB/s rd, 20 MiB/s wr, 1.46k op/s 2023-09-23T09:28:37.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:28:36 smithi161 ceph-mon[99580]: pgmap v1004: 97 pgs: 97 active+clean; 15 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 1.1 MiB/s rd, 20 MiB/s wr, 1.46k op/s 2023-09-23T09:28:38.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:28:37 smithi135 ceph-mon[99205]: pgmap v1005: 97 pgs: 97 active+clean; 15 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 841 KiB/s rd, 12 MiB/s wr, 909 op/s 2023-09-23T09:28:38.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:28:37 smithi082 ceph-mon[97694]: pgmap v1005: 97 pgs: 97 active+clean; 15 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 841 KiB/s rd, 12 MiB/s wr, 909 op/s 2023-09-23T09:28:38.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:28:37 smithi161 ceph-mon[99580]: pgmap v1005: 97 pgs: 97 active+clean; 15 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 841 KiB/s rd, 12 MiB/s wr, 909 op/s 2023-09-23T09:28:40.827 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 90.0 s, 595.0 tps, lat 289.304 ms stddev 670.280 2023-09-23T09:28:40.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:28:40 smithi161 ceph-mon[99580]: pgmap v1006: 97 pgs: 97 active+clean; 15 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 1.1 MiB/s rd, 17 MiB/s wr, 1.20k op/s 2023-09-23T09:28:41.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:28:40 smithi135 ceph-mon[99205]: pgmap v1006: 97 pgs: 97 active+clean; 15 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 1.1 MiB/s rd, 17 MiB/s wr, 1.20k op/s 2023-09-23T09:28:41.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:28:40 smithi082 ceph-mon[97694]: pgmap v1006: 97 pgs: 97 active+clean; 15 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 1.1 MiB/s rd, 17 MiB/s wr, 1.20k op/s 2023-09-23T09:28:42.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:28:42 smithi161 ceph-mon[99580]: pgmap v1007: 97 pgs: 97 active+clean; 15 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 667 KiB/s rd, 9.6 MiB/s wr, 660 op/s 2023-09-23T09:28:43.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:28:42 smithi135 ceph-mon[99205]: pgmap v1007: 97 pgs: 97 active+clean; 15 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 667 KiB/s rd, 9.6 MiB/s wr, 660 op/s 2023-09-23T09:28:43.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:28:42 smithi082 ceph-mon[97694]: pgmap v1007: 97 pgs: 97 active+clean; 15 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 667 KiB/s rd, 9.6 MiB/s wr, 660 op/s 2023-09-23T09:28:44.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:28:43 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:28:44.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:28:43 smithi135 ceph-mon[99205]: scrub summary: active paths [/] 2023-09-23T09:28:44.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:28:43 smithi135 ceph-mon[99205]: scrub summary: active paths [/] 2023-09-23T09:28:44.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:28:43 smithi135 ceph-mon[99205]: scrub summary: idle+waiting paths [/] 2023-09-23T09:28:44.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:28:43 smithi135 ceph-mon[99205]: scrub summary: idle+waiting paths [/] 2023-09-23T09:28:44.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:28:43 smithi135 ceph-mon[99205]: scrub summary: idle+waiting paths [/] 2023-09-23T09:28:44.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:28:43 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:28:44.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:28:43 smithi082 ceph-mon[97694]: scrub summary: active paths [/] 2023-09-23T09:28:44.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:28:43 smithi082 ceph-mon[97694]: scrub summary: active paths [/] 2023-09-23T09:28:44.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:28:43 smithi082 ceph-mon[97694]: scrub summary: idle+waiting paths [/] 2023-09-23T09:28:44.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:28:43 smithi082 ceph-mon[97694]: scrub summary: idle+waiting paths [/] 2023-09-23T09:28:44.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:28:43 smithi082 ceph-mon[97694]: scrub summary: idle+waiting paths [/] 2023-09-23T09:28:44.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:28:43 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:28:44.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:28:43 smithi161 ceph-mon[99580]: scrub summary: active paths [/] 2023-09-23T09:28:44.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:28:43 smithi161 ceph-mon[99580]: scrub summary: active paths [/] 2023-09-23T09:28:44.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:28:43 smithi161 ceph-mon[99580]: scrub summary: idle+waiting paths [/] 2023-09-23T09:28:44.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:28:43 smithi161 ceph-mon[99580]: scrub summary: idle+waiting paths [/] 2023-09-23T09:28:44.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:28:43 smithi161 ceph-mon[99580]: scrub summary: idle+waiting paths [/] 2023-09-23T09:28:45.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:28:44 smithi135 ceph-mon[99205]: pgmap v1008: 97 pgs: 97 active+clean; 15 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 667 KiB/s rd, 9.6 MiB/s wr, 660 op/s 2023-09-23T09:28:45.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:28:44 smithi082 ceph-mon[97694]: pgmap v1008: 97 pgs: 97 active+clean; 15 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 667 KiB/s rd, 9.6 MiB/s wr, 660 op/s 2023-09-23T09:28:45.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:28:44 smithi161 ceph-mon[99580]: pgmap v1008: 97 pgs: 97 active+clean; 15 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 667 KiB/s rd, 9.6 MiB/s wr, 660 op/s 2023-09-23T09:28:45.827 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 95.0 s, 497.6 tps, lat 201.946 ms stddev 242.784 2023-09-23T09:28:47.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:28:46 smithi135 ceph-mon[99205]: pgmap v1009: 97 pgs: 97 active+clean; 15 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 951 KiB/s rd, 17 MiB/s wr, 1.28k op/s 2023-09-23T09:28:47.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:28:46 smithi082 ceph-mon[97694]: pgmap v1009: 97 pgs: 97 active+clean; 15 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 951 KiB/s rd, 17 MiB/s wr, 1.28k op/s 2023-09-23T09:28:47.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:28:46 smithi161 ceph-mon[99580]: pgmap v1009: 97 pgs: 97 active+clean; 15 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 951 KiB/s rd, 17 MiB/s wr, 1.28k op/s 2023-09-23T09:28:48.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:28:47 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:28:48.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:28:47 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:28:48.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:28:47 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:28:49.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:28:48 smithi135 ceph-mon[99205]: pgmap v1010: 97 pgs: 97 active+clean; 15 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 607 KiB/s rd, 13 MiB/s wr, 914 op/s 2023-09-23T09:28:49.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:28:48 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:28:49.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:28:48 smithi082 ceph-mon[97694]: pgmap v1010: 97 pgs: 97 active+clean; 15 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 607 KiB/s rd, 13 MiB/s wr, 914 op/s 2023-09-23T09:28:49.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:28:48 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:28:49.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:28:48 smithi161 ceph-mon[99580]: pgmap v1010: 97 pgs: 97 active+clean; 15 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 607 KiB/s rd, 13 MiB/s wr, 914 op/s 2023-09-23T09:28:49.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:28:48 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:28:50.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 100.0 s, 643.6 tps, lat 128.282 ms stddev 58.101 2023-09-23T09:28:51.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:28:50 smithi135 ceph-mon[99205]: pgmap v1011: 97 pgs: 97 active+clean; 16 GiB data, 52 GiB used, 1020 GiB / 1.0 TiB avail; 1.0 MiB/s rd, 20 MiB/s wr, 1.37k op/s 2023-09-23T09:28:51.123 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:28:50 smithi082 ceph-mon[97694]: pgmap v1011: 97 pgs: 97 active+clean; 16 GiB data, 52 GiB used, 1020 GiB / 1.0 TiB avail; 1.0 MiB/s rd, 20 MiB/s wr, 1.37k op/s 2023-09-23T09:28:51.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:28:50 smithi161 ceph-mon[99580]: pgmap v1011: 97 pgs: 97 active+clean; 16 GiB data, 52 GiB used, 1020 GiB / 1.0 TiB avail; 1.0 MiB/s rd, 20 MiB/s wr, 1.37k op/s 2023-09-23T09:28:51.943 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:28:52.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:28:51 smithi135 ceph-mon[99205]: scrub summary: idle 2023-09-23T09:28:52.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:28:51 smithi135 ceph-mon[99205]: scrub summary: idle 2023-09-23T09:28:52.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:28:51 smithi135 ceph-mon[99205]: scrub summary: idle 2023-09-23T09:28:52.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:28:51 smithi135 ceph-mon[99205]: scrub summary: idle 2023-09-23T09:28:52.078 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:28:51 smithi082 ceph-mon[97694]: scrub summary: idle 2023-09-23T09:28:52.078 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:28:51 smithi082 ceph-mon[97694]: scrub summary: idle 2023-09-23T09:28:52.078 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:28:51 smithi082 ceph-mon[97694]: scrub summary: idle 2023-09-23T09:28:52.078 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:28:51 smithi082 ceph-mon[97694]: scrub summary: idle 2023-09-23T09:28:52.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:28:51 smithi161 ceph-mon[99580]: scrub summary: idle 2023-09-23T09:28:52.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:28:51 smithi161 ceph-mon[99580]: scrub summary: idle 2023-09-23T09:28:52.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:28:51 smithi161 ceph-mon[99580]: scrub summary: idle 2023-09-23T09:28:52.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:28:51 smithi161 ceph-mon[99580]: scrub summary: idle 2023-09-23T09:28:52.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.314+0000 7f3b1afff700 1 -- 172.21.15.82:0/3768106025 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3b14108ab0 msgr2=0x7f3b14108e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:28:52.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.314+0000 7f3b1afff700 1 --2- 172.21.15.82:0/3768106025 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3b14108ab0 0x7f3b14108e90 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3b0800b0a0 tx=0x7f3b0800b3b0 comp rx=0 tx=0).stop 2023-09-23T09:28:52.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.314+0000 7f3b1afff700 1 -- 172.21.15.82:0/3768106025 shutdown_connections 2023-09-23T09:28:52.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.314+0000 7f3b1afff700 1 --2- 172.21.15.82:0/3768106025 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b14103460 0x7f3b1410f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:52.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.314+0000 7f3b1afff700 1 --2- 172.21.15.82:0/3768106025 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3b14108ab0 0x7f3b14108e90 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:52.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.314+0000 7f3b1afff700 1 --2- 172.21.15.82:0/3768106025 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b14102aa0 0x7f3b14102f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:52.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.314+0000 7f3b1afff700 1 -- 172.21.15.82:0/3768106025 >> 172.21.15.82:0/3768106025 conn(0x7f3b140fe590 msgr2=0x7f3b141009b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:28:52.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.314+0000 7f3b1afff700 1 -- 172.21.15.82:0/3768106025 shutdown_connections 2023-09-23T09:28:52.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.315+0000 7f3b1afff700 1 -- 172.21.15.82:0/3768106025 wait complete. 2023-09-23T09:28:52.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.316+0000 7f3b1afff700 1 Processor -- start 2023-09-23T09:28:52.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.316+0000 7f3b1afff700 1 -- start start 2023-09-23T09:28:52.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.317+0000 7f3b1afff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b14102aa0 0x7f3b14074e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:52.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.317+0000 7f3b1afff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b14103460 0x7f3b14075370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:52.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.317+0000 7f3b1afff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3b14108ab0 0x7f3b140758b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:52.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.317+0000 7f3b1afff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b14070d30 con 0x7f3b14102aa0 2023-09-23T09:28:52.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.317+0000 7f3b1afff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b14070e70 con 0x7f3b14103460 2023-09-23T09:28:52.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.317+0000 7f3b1afff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b14070fe0 con 0x7f3b14108ab0 2023-09-23T09:28:52.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.317+0000 7f3b18d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b14102aa0 0x7f3b14074e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:52.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.318+0000 7f3b18d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b14102aa0 0x7f3b14074e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43714/0 (socket says 172.21.15.82:43714) 2023-09-23T09:28:52.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.318+0000 7f3b18d9b700 1 -- 172.21.15.82:0/3808588850 learned_addr learned my addr 172.21.15.82:0/3808588850 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:28:52.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.318+0000 7f3b1959c700 1 --2- 172.21.15.82:0/3808588850 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3b14108ab0 0x7f3b140758b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:52.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.318+0000 7f3b13fff700 1 --2- 172.21.15.82:0/3808588850 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b14103460 0x7f3b14075370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:52.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.318+0000 7f3b18d9b700 1 -- 172.21.15.82:0/3808588850 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3b14108ab0 msgr2=0x7f3b140758b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:28:52.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.318+0000 7f3b18d9b700 1 --2- 172.21.15.82:0/3808588850 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3b14108ab0 0x7f3b140758b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:52.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.318+0000 7f3b18d9b700 1 -- 172.21.15.82:0/3808588850 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b14103460 msgr2=0x7f3b14075370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:28:52.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.318+0000 7f3b18d9b700 1 --2- 172.21.15.82:0/3808588850 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b14103460 0x7f3b14075370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:52.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.318+0000 7f3b18d9b700 1 -- 172.21.15.82:0/3808588850 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b08009d00 con 0x7f3b14102aa0 2023-09-23T09:28:52.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.319+0000 7f3b18d9b700 1 --2- 172.21.15.82:0/3808588850 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b14102aa0 0x7f3b14074e30 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f3b080062a0 tx=0x7f3b0800bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:28:52.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.320+0000 7f3b11ffb700 1 -- 172.21.15.82:0/3808588850 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b0800e040 con 0x7f3b14102aa0 2023-09-23T09:28:52.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.320+0000 7f3b11ffb700 1 -- 172.21.15.82:0/3808588850 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3b08007930 con 0x7f3b14102aa0 2023-09-23T09:28:52.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.320+0000 7f3b11ffb700 1 -- 172.21.15.82:0/3808588850 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b0801b460 con 0x7f3b14102aa0 2023-09-23T09:28:52.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.322+0000 7f3b1afff700 1 -- 172.21.15.82:0/3808588850 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b14071260 con 0x7f3b14102aa0 2023-09-23T09:28:52.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.323+0000 7f3b1afff700 1 -- 172.21.15.82:0/3808588850 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b140716f0 con 0x7f3b14102aa0 2023-09-23T09:28:52.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.329+0000 7f3b2e85eb80 1 Processor -- start 2023-09-23T09:28:52.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.330+0000 7f3b2e85eb80 1 -- start start 2023-09-23T09:28:52.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.330+0000 7f3b2e85eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56530ae0d380 0x56530ae0d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:52.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.330+0000 7f3b2e85eb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56530ae0dca0 0x56530ae07700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:52.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.330+0000 7f3b2e85eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56530ae07c40 0x56530ae080a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:52.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.330+0000 7f3b2e85eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56530ad6f7b0 con 0x56530ae0d380 2023-09-23T09:28:52.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.330+0000 7f3b2e85eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56530ad60780 con 0x56530ae07c40 2023-09-23T09:28:52.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.330+0000 7f3b2e85eb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x56530ad5e0a0 con 0x56530ae0dca0 2023-09-23T09:28:52.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.333+0000 7f3b1959c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56530ae0d380 0x56530ae0d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:52.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.333+0000 7f3b1959c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56530ae0d380 0x56530ae0d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43720/0 (socket says 172.21.15.82:43720) 2023-09-23T09:28:52.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.333+0000 7f3b1959c700 1 -- 172.21.15.82:0/3990461613 learned_addr learned my addr 172.21.15.82:0/3990461613 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:28:52.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.333+0000 7f3b1959c700 1 -- 172.21.15.82:0/3990461613 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56530ae0dca0 msgr2=0x56530ae07700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:28:52.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.333+0000 7f3b1959c700 1 --2- 172.21.15.82:0/3990461613 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56530ae0dca0 0x56530ae07700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:52.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.333+0000 7f3b1959c700 1 -- 172.21.15.82:0/3990461613 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56530ae07c40 msgr2=0x56530ae080a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-23T09:28:52.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.333+0000 7f3b1959c700 1 --2- 172.21.15.82:0/3990461613 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56530ae07c40 0x56530ae080a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:52.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.333+0000 7f3b1959c700 1 -- 172.21.15.82:0/3990461613 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56530abd9630 con 0x56530ae0d380 2023-09-23T09:28:52.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.334+0000 7f3b1959c700 1 --2- 172.21.15.82:0/3990461613 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56530ae0d380 0x56530ae0d760 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c009c80 tx=0x7f3b0c009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c46ddfca814aaa03 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:28:52.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.334+0000 7f3afeffd700 1 -- 172.21.15.82:0/3990461613 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b0c010c90 con 0x56530ae0d380 2023-09-23T09:28:52.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.334+0000 7f3afeffd700 1 -- 172.21.15.82:0/3990461613 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3b0c015070 con 0x56530ae0d380 2023-09-23T09:28:52.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.334+0000 7f3afeffd700 1 -- 172.21.15.82:0/3990461613 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b0c0116a0 con 0x56530ae0d380 2023-09-23T09:28:52.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.335+0000 7f3b2e85eb80 1 -- 172.21.15.82:0/3990461613 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56530ae0d380 msgr2=0x56530ae0d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:28:52.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.335+0000 7f3b2e85eb80 1 --2- 172.21.15.82:0/3990461613 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56530ae0d380 0x56530ae0d760 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c009c80 tx=0x7f3b0c009f90 comp rx=0 tx=0).stop 2023-09-23T09:28:52.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.337+0000 7f3b11ffb700 1 -- 172.21.15.82:0/3808588850 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f3b0801d470 con 0x7f3b14102aa0 2023-09-23T09:28:52.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.339+0000 7f3b11ffb700 1 --2- 172.21.15.82:0/3808588850 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f3b040a02d0 0x7f3b040a2790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:52.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.339+0000 7f3b11ffb700 1 -- 172.21.15.82:0/3808588850 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f3b080ce280 con 0x7f3b14102aa0 2023-09-23T09:28:52.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.340+0000 7f3b2e85eb80 1 -- 172.21.15.82:0/3990461613 shutdown_connections 2023-09-23T09:28:52.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.340+0000 7f3b2e85eb80 1 --2- 172.21.15.82:0/3990461613 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56530ae07c40 0x56530ae080a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:52.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.340+0000 7f3b2e85eb80 1 --2- 172.21.15.82:0/3990461613 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56530ae0d380 0x56530ae0d760 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:52.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.340+0000 7f3b2e85eb80 1 --2- 172.21.15.82:0/3990461613 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56530ae0dca0 0x56530ae07700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:52.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.340+0000 7f3b2e85eb80 1 -- 172.21.15.82:0/3990461613 >> 172.21.15.82:0/3990461613 conn(0x56530ad7c0e0 msgr2=0x56530ae02410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:28:52.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.340+0000 7f3b1959c700 1 --2- 172.21.15.82:0/3808588850 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f3b040a02d0 0x7f3b040a2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:52.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.340+0000 7f3b2e85eb80 1 -- 172.21.15.82:0/3990461613 shutdown_connections 2023-09-23T09:28:52.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.341+0000 7f3b2e85eb80 1 -- 172.21.15.82:0/3990461613 wait complete. 2023-09-23T09:28:52.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.341+0000 7f3b2e85eb80 1 -- start start 2023-09-23T09:28:52.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.342+0000 7f3b2e85eb80 1 Processor -- start 2023-09-23T09:28:52.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.342+0000 7f3b2e85eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56530ae07c40 0x56530ae13c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:52.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.342+0000 7f3b2e85eb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56530ae0d380 0x56530ae10e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:52.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.342+0000 7f3b2e85eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56530ae0dca0 0x56530ae115c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:52.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.342+0000 7f3b2e85eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56530ad59990 con 0x56530ae0dca0 2023-09-23T09:28:52.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.342+0000 7f3b2e85eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56530acf7bb0 con 0x56530ae07c40 2023-09-23T09:28:52.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.342+0000 7f3b2e85eb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x56530acf78b0 con 0x56530ae0d380 2023-09-23T09:28:52.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.342+0000 7f3b2e85eb80 10 client.0 _ll_register_callbacks cb 0x56530ac41a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:28:52.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.343+0000 7f3b13fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56530ae0d380 0x56530ae10e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:52.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.343+0000 7f3b13fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56530ae0d380 0x56530ae10e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:36640/0 (socket says 172.21.15.82:36640) 2023-09-23T09:28:52.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.343+0000 7f3b13fff700 1 -- 172.21.15.82:0/4010661027 learned_addr learned my addr 172.21.15.82:0/4010661027 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:28:52.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.343+0000 7f3b1959c700 1 --2- 172.21.15.82:0/3808588850 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f3b040a02d0 0x7f3b040a2790 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c000c00 tx=0x7f3b0c01cd20 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:28:52.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.343+0000 7f3b1959c700 1 --2- 172.21.15.82:0/4010661027 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56530ae0dca0 0x56530ae115c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:52.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.343+0000 7f3b18d9b700 1 --2- 172.21.15.82:0/4010661027 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56530ae07c40 0x56530ae13c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:52.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.344+0000 7f3b18d9b700 1 -- 172.21.15.82:0/4010661027 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56530ae0d380 msgr2=0x56530ae10e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:28:52.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.344+0000 7f3b18d9b700 1 --2- 172.21.15.82:0/4010661027 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56530ae0d380 0x56530ae10e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:52.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.344+0000 7f3b18d9b700 1 -- 172.21.15.82:0/4010661027 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56530ae0dca0 msgr2=0x56530ae115c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:28:52.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.344+0000 7f3b18d9b700 1 --2- 172.21.15.82:0/4010661027 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56530ae0dca0 0x56530ae115c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:52.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.344+0000 7f3b18d9b700 1 -- 172.21.15.82:0/4010661027 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b0c009930 con 0x56530ae07c40 2023-09-23T09:28:52.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.344+0000 7f3b1959c700 1 --2- 172.21.15.82:0/4010661027 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56530ae0dca0 0x56530ae115c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:28:52.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.344+0000 7f3b13fff700 1 --2- 172.21.15.82:0/4010661027 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56530ae0d380 0x56530ae10e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:28:52.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.344+0000 7f3b18d9b700 1 --2- 172.21.15.82:0/4010661027 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56530ae07c40 0x56530ae13c70 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3b080cb970 tx=0x7f3b0809b3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=182215636acc73ab server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:28:52.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.345+0000 7f3af3fff700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-09-23T09:28:52.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.345+0000 7f3af3fff700 1 -- 172.21.15.82:0/4010661027 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b0809be20 con 0x56530ae07c40 2023-09-23T09:28:52.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.345+0000 7f3af3fff700 1 -- 172.21.15.82:0/4010661027 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(139..139 src has 1..139) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f3b0809b9c0 con 0x56530ae07c40 2023-09-23T09:28:52.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.345+0000 7f3b2e85eb80 1 -- 172.21.15.82:0/4010661027 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56530add71c0 con 0x56530ae07c40 2023-09-23T09:28:52.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.345+0000 7f3af3fff700 1 -- 172.21.15.82:0/4010661027 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3b080cbe00 con 0x56530ae07c40 2023-09-23T09:28:52.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.345+0000 7f3b2e85eb80 10 client.26930 fetch_fsmap learned FSMap version 91 2023-09-23T09:28:52.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.345+0000 7f3b2e85eb80 1 -- 172.21.15.82:0/4010661027 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=4+}) v3 -- 0x56530ab85de0 con 0x56530ae07c40 2023-09-23T09:28:52.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.345+0000 7f3af3fff700 1 -- 172.21.15.82:0/4010661027 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56530add71c0 con 0x56530ae07c40 2023-09-23T09:28:52.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.346+0000 7f3af3fff700 1 -- 172.21.15.82:0/4010661027 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 91) v1 ==== 7930+0+0 (secure 0 0 0) 0x7f3b080a32b0 con 0x56530ae07c40 2023-09-23T09:28:52.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.346+0000 7f3b2e85eb80 10 client.26930 fetch_fsmap finished waiting for FSMap version 91 2023-09-23T09:28:52.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.346+0000 7f3b2e85eb80 10 client.26930 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:28:52.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.346+0000 7f3b2e85eb80 20 client.26930 populate_metadata read hostname 'smithi082' 2023-09-23T09:28:52.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.347+0000 7f3b2e85eb80 1 --2- 172.21.15.82:0/4010661027 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56530ae215c0 0x56530ae239e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:52.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.347+0000 7f3b2e85eb80 4 client.26930 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:28:52.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.347+0000 7f3b2e85eb80 1 -- 172.21.15.82:0/4010661027 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56530acffba0 con 0x56530ae215c0 2023-09-23T09:28:52.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.347+0000 7f3b13fff700 1 --2- 172.21.15.82:0/4010661027 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56530ae215c0 0x56530ae239e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:52.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.348+0000 7f3b13fff700 1 --2- 172.21.15.82:0/4010661027 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56530ae215c0 0x56530ae239e0 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c73e114a5ad3e52 server_cookie=259e6dbd71f45b2a in_seq=0 out_seq=0 2023-09-23T09:28:52.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.349+0000 7f3af3fff700 10 client.26930 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:28:52.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.349+0000 7f3af3fff700 1 -- 172.21.15.82:0/4010661027 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56530acffba0 con 0x56530ae215c0 2023-09-23T09:28:52.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.349+0000 7f3af3fff700 10 client.26930 handle_command_reply: tid=0 2023-09-23T09:28:52.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.349+0000 7f3b2e85eb80 1 client.26930 shutdown 2023-09-23T09:28:52.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.350+0000 7f3b2e85eb80 1 -- 172.21.15.82:0/4010661027 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56530ae07c40 msgr2=0x56530ae13c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:28:52.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.350+0000 7f3b2e85eb80 1 --2- 172.21.15.82:0/4010661027 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56530ae07c40 0x56530ae13c70 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3b080cb970 tx=0x7f3b0809b3a0 comp rx=0 tx=0).stop 2023-09-23T09:28:52.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.350+0000 7f3b2e85eb80 1 -- 172.21.15.82:0/4010661027 shutdown_connections 2023-09-23T09:28:52.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.350+0000 7f3b2e85eb80 1 --2- 172.21.15.82:0/4010661027 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56530ae215c0 0x56530ae239e0 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:52.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.350+0000 7f3b2e85eb80 1 --2- 172.21.15.82:0/4010661027 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56530ae0dca0 0x56530ae115c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:52.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.350+0000 7f3b2e85eb80 1 --2- 172.21.15.82:0/4010661027 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56530ae07c40 0x56530ae13c70 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:52.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.350+0000 7f3b2e85eb80 1 --2- 172.21.15.82:0/4010661027 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56530ae0d380 0x56530ae10e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:52.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.350+0000 7f3b2e85eb80 1 -- 172.21.15.82:0/4010661027 >> 172.21.15.82:0/4010661027 conn(0x56530ad7c0e0 msgr2=0x56530adfcb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:28:52.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.350+0000 7f3af3fff700 0 client.26930 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:28:52.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.350+0000 7f3b2e85eb80 1 -- 172.21.15.82:0/4010661027 shutdown_connections 2023-09-23T09:28:52.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.350+0000 7f3b2e85eb80 1 -- 172.21.15.82:0/4010661027 wait complete. 2023-09-23T09:28:52.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.351+0000 7f3b2e85eb80 20 client.26930 trim_cache size 0 max 16384 2023-09-23T09:28:52.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.380+0000 7f3b2e85eb80 1 Processor -- start 2023-09-23T09:28:52.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.380+0000 7f3b2e85eb80 1 -- start start 2023-09-23T09:28:52.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.381+0000 7f3b2e85eb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56530ae07c40 0x56530ae07700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:52.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.381+0000 7f3b2e85eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56530ae0d380 0x56530ae137a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:52.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.381+0000 7f3b2e85eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56530ae0dca0 0x56530ae10720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:52.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.381+0000 7f3b2e85eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56530abdb920 con 0x56530ae0d380 2023-09-23T09:28:52.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.381+0000 7f3b2e85eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56530adfec80 con 0x56530ae0dca0 2023-09-23T09:28:52.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.381+0000 7f3b2e85eb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x56530ae1e100 con 0x56530ae07c40 2023-09-23T09:28:52.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.381+0000 7f3b1959c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56530ae0dca0 0x56530ae10720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:52.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.381+0000 7f3b18d9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56530ae07c40 0x56530ae07700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:52.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.381+0000 7f3b1959c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56530ae0dca0 0x56530ae10720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:60364/0 (socket says 172.21.15.82:60364) 2023-09-23T09:28:52.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.381+0000 7f3b1959c700 1 -- 172.21.15.82:0/402262399 learned_addr learned my addr 172.21.15.82:0/402262399 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:28:52.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.381+0000 7f3b13fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56530ae0d380 0x56530ae137a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:52.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.382+0000 7f3b1959c700 1 -- 172.21.15.82:0/402262399 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56530ae07c40 msgr2=0x56530ae07700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:28:52.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.382+0000 7f3b1959c700 1 --2- 172.21.15.82:0/402262399 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56530ae07c40 0x56530ae07700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:52.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.382+0000 7f3b1959c700 1 -- 172.21.15.82:0/402262399 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56530ae0d380 msgr2=0x56530ae137a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:28:52.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.382+0000 7f3b1959c700 1 --2- 172.21.15.82:0/402262399 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56530ae0d380 0x56530ae137a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:52.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.382+0000 7f3b1959c700 1 -- 172.21.15.82:0/402262399 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56530ab6ec60 con 0x56530ae0dca0 2023-09-23T09:28:52.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.382+0000 7f3b1959c700 1 --2- 172.21.15.82:0/402262399 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56530ae0dca0 0x56530ae10720 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c01ccf0 tx=0x7f3b0c020000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26e4e1da5dbf12c server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:28:52.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.382+0000 7f3aff7fe700 1 -- 172.21.15.82:0/402262399 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b0c020070 con 0x56530ae0dca0 2023-09-23T09:28:52.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.382+0000 7f3aff7fe700 1 -- 172.21.15.82:0/402262399 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3b0c02c040 con 0x56530ae0dca0 2023-09-23T09:28:52.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.382+0000 7f3aff7fe700 1 -- 172.21.15.82:0/402262399 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b0c004bd0 con 0x56530ae0dca0 2023-09-23T09:28:52.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.383+0000 7f3b2e85eb80 1 -- 172.21.15.82:0/402262399 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56530ae0dca0 msgr2=0x56530ae10720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:28:52.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.383+0000 7f3b2e85eb80 1 --2- 172.21.15.82:0/402262399 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56530ae0dca0 0x56530ae10720 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c01ccf0 tx=0x7f3b0c020000 comp rx=0 tx=0).stop 2023-09-23T09:28:52.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.383+0000 7f3b2e85eb80 1 -- 172.21.15.82:0/402262399 shutdown_connections 2023-09-23T09:28:52.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.383+0000 7f3b2e85eb80 1 --2- 172.21.15.82:0/402262399 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56530ae0dca0 0x56530ae10720 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:52.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.383+0000 7f3b2e85eb80 1 --2- 172.21.15.82:0/402262399 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56530ae07c40 0x56530ae07700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:52.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.383+0000 7f3b2e85eb80 1 --2- 172.21.15.82:0/402262399 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56530ae0d380 0x56530ae137a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:52.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.383+0000 7f3b2e85eb80 1 -- 172.21.15.82:0/402262399 >> 172.21.15.82:0/402262399 conn(0x56530ad7c0e0 msgr2=0x56530ae0aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:28:52.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.384+0000 7f3b2e85eb80 1 -- 172.21.15.82:0/402262399 shutdown_connections 2023-09-23T09:28:52.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.384+0000 7f3b2e85eb80 1 -- 172.21.15.82:0/402262399 wait complete. 2023-09-23T09:28:52.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.384+0000 7f3b2e85eb80 1 -- start start 2023-09-23T09:28:52.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.384+0000 7f3b2e85eb80 1 Processor -- start 2023-09-23T09:28:52.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.385+0000 7f3b2e85eb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56530ae07c40 0x56530ae10780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:52.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.385+0000 7f3b2e85eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56530ae0d380 0x56530ae10cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:52.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.385+0000 7f3b2e85eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56530ae0dca0 0x56530ae0f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:52.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.385+0000 7f3b2e85eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56530ae0f940 con 0x56530ae0d380 2023-09-23T09:28:52.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.385+0000 7f3b2e85eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56530ae0fab0 con 0x56530ae0dca0 2023-09-23T09:28:52.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.385+0000 7f3b2e85eb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x56530ae0fc70 con 0x56530ae07c40 2023-09-23T09:28:52.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.385+0000 7f3b2e85eb80 10 client.0 _ll_register_callbacks cb 0x7f3b0809b880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:28:52.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.386+0000 7f3b1959c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56530ae0dca0 0x56530ae0f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:52.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.386+0000 7f3b1959c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56530ae0dca0 0x56530ae0f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:60372/0 (socket says 172.21.15.82:60372) 2023-09-23T09:28:52.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.386+0000 7f3b1959c700 1 -- 172.21.15.82:0/1772351330 learned_addr learned my addr 172.21.15.82:0/1772351330 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:28:52.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.386+0000 7f3b13fff700 1 --2- 172.21.15.82:0/1772351330 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56530ae0d380 0x56530ae10cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:52.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.386+0000 7f3b18d9b700 1 --2- 172.21.15.82:0/1772351330 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56530ae07c40 0x56530ae10780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:52.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.386+0000 7f3b13fff700 1 -- 172.21.15.82:0/1772351330 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56530ae07c40 msgr2=0x56530ae10780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:28:52.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.386+0000 7f3b13fff700 1 --2- 172.21.15.82:0/1772351330 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56530ae07c40 0x56530ae10780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:52.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.386+0000 7f3b13fff700 1 -- 172.21.15.82:0/1772351330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56530ae0dca0 msgr2=0x56530ae0f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:28:52.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.386+0000 7f3b13fff700 1 --2- 172.21.15.82:0/1772351330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56530ae0dca0 0x56530ae0f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:52.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.386+0000 7f3b13fff700 1 -- 172.21.15.82:0/1772351330 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56530abd9630 con 0x56530ae0d380 2023-09-23T09:28:52.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.386+0000 7f3b13fff700 1 --2- 172.21.15.82:0/1772351330 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56530ae0d380 0x56530ae10cc0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f3b08099d10 tx=0x7f3b00012470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a741aabcf35cca63 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:28:52.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.386+0000 7f3af3fff700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:28:52.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.387+0000 7f3af3fff700 1 -- 172.21.15.82:0/1772351330 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b00017040 con 0x56530ae0d380 2023-09-23T09:28:52.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.387+0000 7f3af3fff700 1 -- 172.21.15.82:0/1772351330 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(139..139 src has 1..139) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f3b00004540 con 0x56530ae0d380 2023-09-23T09:28:52.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.387+0000 7f3b2e85eb80 1 -- 172.21.15.82:0/1772351330 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56530adfa8b0 con 0x56530ae0d380 2023-09-23T09:28:52.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.387+0000 7f3af3fff700 1 -- 172.21.15.82:0/1772351330 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3b0001c5b0 con 0x56530ae0d380 2023-09-23T09:28:52.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.387+0000 7f3b2e85eb80 10 client.17256 fetch_fsmap learned FSMap version 91 2023-09-23T09:28:52.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.387+0000 7f3b2e85eb80 1 -- 172.21.15.82:0/1772351330 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=4+}) v3 -- 0x56530abac250 con 0x56530ae0d380 2023-09-23T09:28:52.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.388+0000 7f3af3fff700 1 -- 172.21.15.82:0/1772351330 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56530adfa8b0 con 0x56530ae0d380 2023-09-23T09:28:52.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.388+0000 7f3af3fff700 1 -- 172.21.15.82:0/1772351330 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 91) v1 ==== 7930+0+0 (secure 0 0 0) 0x7f3b000125b0 con 0x56530ae0d380 2023-09-23T09:28:52.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.388+0000 7f3b2e85eb80 10 client.17256 fetch_fsmap finished waiting for FSMap version 91 2023-09-23T09:28:52.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.388+0000 7f3b2e85eb80 10 client.17256 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:28:52.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.388+0000 7f3b2e85eb80 20 client.17256 populate_metadata read hostname 'smithi082' 2023-09-23T09:28:52.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.388+0000 7f3b2e85eb80 1 --2- 172.21.15.82:0/1772351330 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56530ae763b0 0x56530ae787d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:52.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.388+0000 7f3b2e85eb80 4 client.17256 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:28:52.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.388+0000 7f3b2e85eb80 1 -- 172.21.15.82:0/1772351330 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x56530ad52970 con 0x56530ae763b0 2023-09-23T09:28:52.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.388+0000 7f3b18d9b700 1 --2- 172.21.15.82:0/1772351330 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56530ae763b0 0x56530ae787d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:52.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.390+0000 7f3b18d9b700 1 --2- 172.21.15.82:0/1772351330 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56530ae763b0 0x56530ae787d0 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c929b5227dc2624e server_cookie=ca682f18d23a86b0 in_seq=0 out_seq=0 2023-09-23T09:28:52.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.390+0000 7f3af3fff700 10 client.17256 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:28:52.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.390+0000 7f3af3fff700 1 -- 172.21.15.82:0/1772351330 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x56530ad52970 con 0x56530ae763b0 2023-09-23T09:28:52.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.390+0000 7f3af3fff700 10 client.17256 handle_command_reply: tid=0 2023-09-23T09:28:52.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.390+0000 7f3b2e85eb80 1 client.17256 shutdown 2023-09-23T09:28:52.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.393+0000 7f3b2e85eb80 1 -- 172.21.15.82:0/1772351330 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56530ae0d380 msgr2=0x56530ae10cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:28:52.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.393+0000 7f3b2e85eb80 1 --2- 172.21.15.82:0/1772351330 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56530ae0d380 0x56530ae10cc0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f3b08099d10 tx=0x7f3b00012470 comp rx=0 tx=0).stop 2023-09-23T09:28:52.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.396+0000 7f3b2e85eb80 1 -- 172.21.15.82:0/1772351330 shutdown_connections 2023-09-23T09:28:52.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.396+0000 7f3b2e85eb80 1 --2- 172.21.15.82:0/1772351330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56530ae0dca0 0x56530ae0f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:52.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.396+0000 7f3b2e85eb80 1 --2- 172.21.15.82:0/1772351330 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56530ae07c40 0x56530ae10780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:52.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.396+0000 7f3b2e85eb80 1 --2- 172.21.15.82:0/1772351330 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56530ae763b0 0x56530ae787d0 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:52.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.396+0000 7f3b2e85eb80 1 --2- 172.21.15.82:0/1772351330 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56530ae0d380 0x56530ae10cc0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:52.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.396+0000 7f3b2e85eb80 1 -- 172.21.15.82:0/1772351330 >> 172.21.15.82:0/1772351330 conn(0x56530ad7c0e0 msgr2=0x56530adfc2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:28:52.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.396+0000 7f3af3fff700 0 client.17256 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:28:52.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.399+0000 7f3b2e85eb80 1 -- 172.21.15.82:0/1772351330 shutdown_connections 2023-09-23T09:28:52.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.400+0000 7f3b2e85eb80 1 -- 172.21.15.82:0/1772351330 wait complete. 2023-09-23T09:28:52.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.400+0000 7f3b2e85eb80 20 client.17256 trim_cache size 0 max 16384 2023-09-23T09:28:52.402 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:28:52.402 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "no active scrubs running", 2023-09-23T09:28:52.402 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": {} 2023-09-23T09:28:52.402 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:28:52.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.401+0000 7f3b1afff700 1 -- 172.21.15.82:0/3808588850 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f3b040a02d0 msgr2=0x7f3b040a2790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:28:52.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.401+0000 7f3b1afff700 1 --2- 172.21.15.82:0/3808588850 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f3b040a02d0 0x7f3b040a2790 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c000c00 tx=0x7f3b0c01cd20 comp rx=0 tx=0).stop 2023-09-23T09:28:52.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.401+0000 7f3b1afff700 1 -- 172.21.15.82:0/3808588850 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b14102aa0 msgr2=0x7f3b14074e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:28:52.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.401+0000 7f3b1afff700 1 --2- 172.21.15.82:0/3808588850 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b14102aa0 0x7f3b14074e30 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f3b080062a0 tx=0x7f3b0800bce0 comp rx=0 tx=0).stop 2023-09-23T09:28:52.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.401+0000 7f3b1afff700 1 -- 172.21.15.82:0/3808588850 shutdown_connections 2023-09-23T09:28:52.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.401+0000 7f3b1afff700 1 --2- 172.21.15.82:0/3808588850 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f3b040a02d0 0x7f3b040a2790 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:52.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.401+0000 7f3b1afff700 1 --2- 172.21.15.82:0/3808588850 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3b14108ab0 0x7f3b140758b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:52.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.401+0000 7f3b1afff700 1 --2- 172.21.15.82:0/3808588850 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b14102aa0 0x7f3b14074e30 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:52.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.401+0000 7f3b1afff700 1 --2- 172.21.15.82:0/3808588850 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b14103460 0x7f3b14075370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:52.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.401+0000 7f3b1afff700 1 -- 172.21.15.82:0/3808588850 >> 172.21.15.82:0/3808588850 conn(0x7f3b140fe590 msgr2=0x7f3b140fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:28:52.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.401+0000 7f3b1afff700 1 -- 172.21.15.82:0/3808588850 shutdown_connections 2023-09-23T09:28:52.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.402+0000 7f3b1afff700 1 -- 172.21.15.82:0/3808588850 wait complete. 2023-09-23T09:28:52.432 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-09-23T09:28:52.433 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-23T09:28:52.760 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:28:52 smithi082 ceph-mon[97694]: scrub summary: idle 2023-09-23T09:28:52.761 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:28:52 smithi082 ceph-mon[97694]: pgmap v1012: 97 pgs: 97 active+clean; 16 GiB data, 52 GiB used, 1020 GiB / 1.0 TiB avail; 713 KiB/s rd, 15 MiB/s wr, 1.07k op/s 2023-09-23T09:28:52.761 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:28:52 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:28:52.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.870+0000 7fa407fff700 1 -- 172.21.15.82:0/1624972031 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa40810cdb0 msgr2=0x7fa40810d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:28:52.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.870+0000 7fa407fff700 1 --2- 172.21.15.82:0/1624972031 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa40810cdb0 0x7fa40810d190 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fa3f0009990 tx=0x7fa3f0009ca0 comp rx=0 tx=0).stop 2023-09-23T09:28:52.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.872+0000 7fa407fff700 1 -- 172.21.15.82:0/1624972031 shutdown_connections 2023-09-23T09:28:52.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.872+0000 7fa407fff700 1 --2- 172.21.15.82:0/1624972031 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa408107800 0x7fa408113be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:52.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.872+0000 7fa407fff700 1 --2- 172.21.15.82:0/1624972031 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa40810cdb0 0x7fa40810d190 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:52.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.872+0000 7fa407fff700 1 --2- 172.21.15.82:0/1624972031 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa408106e60 0x7fa4081072c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:52.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.872+0000 7fa407fff700 1 -- 172.21.15.82:0/1624972031 >> 172.21.15.82:0/1624972031 conn(0x7fa408076740 msgr2=0x7fa408105740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:28:52.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.873+0000 7fa407fff700 1 -- 172.21.15.82:0/1624972031 shutdown_connections 2023-09-23T09:28:52.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.873+0000 7fa407fff700 1 -- 172.21.15.82:0/1624972031 wait complete. 2023-09-23T09:28:52.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.875+0000 7fa407fff700 1 Processor -- start 2023-09-23T09:28:52.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.875+0000 7fa407fff700 1 -- start start 2023-09-23T09:28:52.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.876+0000 7fa407fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa408106e60 0x7fa408079c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:52.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.876+0000 7fa407fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa408107800 0x7fa40807a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:52.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.876+0000 7fa407fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa40810cdb0 0x7fa4081b12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:52.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.876+0000 7fa407fff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4081b1880 con 0x7fa408107800 2023-09-23T09:28:52.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.876+0000 7fa407fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa40806a370 con 0x7fa40810cdb0 2023-09-23T09:28:52.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.876+0000 7fa407fff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa40806a530 con 0x7fa408106e60 2023-09-23T09:28:52.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.876+0000 7fa4067fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa408107800 0x7fa40807a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:52.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.876+0000 7fa4067fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa408107800 0x7fa40807a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43780/0 (socket says 172.21.15.82:43780) 2023-09-23T09:28:52.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.876+0000 7fa4067fc700 1 -- 172.21.15.82:0/994710162 learned_addr learned my addr 172.21.15.82:0/994710162 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:28:52.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.877+0000 7fa4067fc700 1 -- 172.21.15.82:0/994710162 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa408106e60 msgr2=0x7fa408079c90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-09-23T09:28:52.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.877+0000 7fa4067fc700 1 --2- 172.21.15.82:0/994710162 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa408106e60 0x7fa408079c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:52.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.877+0000 7fa4067fc700 1 -- 172.21.15.82:0/994710162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa40810cdb0 msgr2=0x7fa4081b12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:28:52.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.877+0000 7fa4077fe700 1 --2- 172.21.15.82:0/994710162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa40810cdb0 0x7fa4081b12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:52.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.877+0000 7fa4067fc700 1 --2- 172.21.15.82:0/994710162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa40810cdb0 0x7fa4081b12b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:52.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.877+0000 7fa4067fc700 1 -- 172.21.15.82:0/994710162 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3f00095f0 con 0x7fa408107800 2023-09-23T09:28:52.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.877+0000 7fa4077fe700 1 --2- 172.21.15.82:0/994710162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa40810cdb0 0x7fa4081b12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T09:28:52.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.877+0000 7fa4067fc700 1 --2- 172.21.15.82:0/994710162 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa408107800 0x7fa40807a1d0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fa3f800b530 tx=0x7fa3f800b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:28:52.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.878+0000 7fa3fffff700 1 -- 172.21.15.82:0/994710162 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f8011830 con 0x7fa408107800 2023-09-23T09:28:52.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.878+0000 7fa3fffff700 1 -- 172.21.15.82:0/994710162 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa3f8011e20 con 0x7fa408107800 2023-09-23T09:28:52.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.878+0000 7fa3fffff700 1 -- 172.21.15.82:0/994710162 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f8010dd0 con 0x7fa408107800 2023-09-23T09:28:52.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.881+0000 7fa407fff700 1 -- 172.21.15.82:0/994710162 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa40806a810 con 0x7fa408107800 2023-09-23T09:28:52.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.881+0000 7fa407fff700 1 -- 172.21.15.82:0/994710162 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa40806aca0 con 0x7fa408107800 2023-09-23T09:28:52.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.883+0000 7fa407fff700 1 -- 172.21.15.82:0/994710162 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa408067a80 con 0x7fa408107800 2023-09-23T09:28:52.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.886+0000 7fa3fffff700 1 -- 172.21.15.82:0/994710162 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7fa3f8011990 con 0x7fa408107800 2023-09-23T09:28:52.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.889+0000 7fa3fffff700 1 --2- 172.21.15.82:0/994710162 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fa3f40a02b0 0x7fa3f40a2770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:52.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.889+0000 7fa3fffff700 1 -- 172.21.15.82:0/994710162 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fa3f80cadf0 con 0x7fa408107800 2023-09-23T09:28:52.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.890+0000 7fa406ffd700 1 --2- 172.21.15.82:0/994710162 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fa3f40a02b0 0x7fa3f40a2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:52.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.892+0000 7fa406ffd700 1 --2- 172.21.15.82:0/994710162 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fa3f40a02b0 0x7fa3f40a2770 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa3f000b5c0 tx=0x7fa3f0000bc0 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:28:52.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:52.896+0000 7fa3fffff700 1 -- 172.21.15.82:0/994710162 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7fa3f80948f0 con 0x7fa408107800 2023-09-23T09:28:53.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:28:52 smithi135 ceph-mon[99205]: scrub summary: idle 2023-09-23T09:28:53.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:28:52 smithi135 ceph-mon[99205]: pgmap v1012: 97 pgs: 97 active+clean; 16 GiB data, 52 GiB used, 1020 GiB / 1.0 TiB avail; 713 KiB/s rd, 15 MiB/s wr, 1.07k op/s 2023-09-23T09:28:53.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:28:52 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:28:53.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:28:52 smithi161 ceph-mon[99580]: scrub summary: idle 2023-09-23T09:28:53.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:28:52 smithi161 ceph-mon[99580]: pgmap v1012: 97 pgs: 97 active+clean; 16 GiB data, 52 GiB used, 1020 GiB / 1.0 TiB avail; 713 KiB/s rd, 15 MiB/s wr, 1.07k op/s 2023-09-23T09:28:53.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:28:52 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:28:53.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.380+0000 7fa407fff700 1 -- 172.21.15.82:0/994710162 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa40807afe0 con 0x7fa408107800 2023-09-23T09:28:53.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.381+0000 7fa3fffff700 1 -- 172.21.15.82:0/994710162 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) v1 ==== 94+0+11343 (secure 0 0 0) 0x7fa3f8097f10 con 0x7fa408107800 2023-09-23T09:28:53.386 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T09:28:53.386 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":91,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/1237857359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1237857359},{"type":"v1","addr":"172.21.15.82:6835","nonce":1237857359}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/1335102362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":1335102362},{"type":"v1","addr":"172.21.15.82:6837","nonce":1335102362}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":91,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-23T08:54:52.600479+0000","modified":"2023-09-23T09:28:50.856028+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24557,"mds_1":24550,"mds_2":24526,"mds_3":24515,"mds_4":24514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/3645331700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3645331700},{"type":"v1","addr":"172.21.15.135:6835","nonce":3645331700}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14658":{"gid":14658,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6839/205725278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":205725278},{"type":"v1","addr":"172.21.15.82:6839","nonce":205725278}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14670":{"gid":14670,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6841/2659297867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":2659297867},{"type":"v1","addr":"172.21.15.82:6841","nonce":2659297867}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24461":{"gid":24461,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/503886037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":503886037},{"type":"v1","addr":"172.21.15.135:6833","nonce":503886037}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24463":{"gid":24463,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.161:6833/471569125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":471569125},{"type":"v1","addr":"172.21.15.161:6833","nonce":471569125}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24514":{"gid":24514,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":10,"addr":"172.21.15.161:6835/2237964162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":2237964162},{"type":"v1","addr":"172.21.15.161:6835","nonce":2237964162}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24515":{"gid":24515,"name":"h","rank":3,"incarnation":22,"state":"up:active","state_seq":8,"addr":"172.21.15.135:6837/2655304858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2655304858},{"type":"v1","addr":"172.21.15.135:6837","nonce":2655304858}]},"join_fscid":-1,"export_targets":[0,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24526":{"gid":24526,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.161:6837/43639843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":43639843},{"type":"v1","addr":"172.21.15.161:6837","nonce":43639843}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24550":{"gid":24550,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.161:6839/758982817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6838","nonce":758982817},{"type":"v1","addr":"172.21.15.161:6839","nonce":758982817}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24557":{"gid":24557,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6839/2508669274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2508669274},{"type":"v1","addr":"172.21.15.135:6839","nonce":2508669274}]},"join_fscid":-1,"export_targets":[1,3],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-23T09:28:53.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.392+0000 7fa407fff700 1 -- 172.21.15.82:0/994710162 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fa3f40a02b0 msgr2=0x7fa3f40a2770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:28:53.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.392+0000 7fa407fff700 1 --2- 172.21.15.82:0/994710162 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fa3f40a02b0 0x7fa3f40a2770 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa3f000b5c0 tx=0x7fa3f0000bc0 comp rx=0 tx=0).stop 2023-09-23T09:28:53.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.392+0000 7fa407fff700 1 -- 172.21.15.82:0/994710162 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa408107800 msgr2=0x7fa40807a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:28:53.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.392+0000 7fa407fff700 1 --2- 172.21.15.82:0/994710162 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa408107800 0x7fa40807a1d0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fa3f800b530 tx=0x7fa3f800b8f0 comp rx=0 tx=0).stop 2023-09-23T09:28:53.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.401+0000 7fa407fff700 1 -- 172.21.15.82:0/994710162 shutdown_connections 2023-09-23T09:28:53.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.401+0000 7fa407fff700 1 --2- 172.21.15.82:0/994710162 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fa3f40a02b0 0x7fa3f40a2770 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:53.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.401+0000 7fa407fff700 1 --2- 172.21.15.82:0/994710162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa40810cdb0 0x7fa4081b12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:53.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.401+0000 7fa407fff700 1 --2- 172.21.15.82:0/994710162 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa408106e60 0x7fa408079c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:53.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.401+0000 7fa407fff700 1 --2- 172.21.15.82:0/994710162 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa408107800 0x7fa40807a1d0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:53.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.401+0000 7fa407fff700 1 -- 172.21.15.82:0/994710162 >> 172.21.15.82:0/994710162 conn(0x7fa408076740 msgr2=0x7fa4080776c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:28:53.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.402+0000 7fa407fff700 1 -- 172.21.15.82:0/994710162 shutdown_connections 2023-09-23T09:28:53.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.402+0000 7fa407fff700 1 -- 172.21.15.82:0/994710162 wait complete. 2023-09-23T09:28:53.408 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 91 2023-09-23T09:28:53.439 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-09-23T09:28:53.774 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:28:53 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/994710162' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T09:28:53.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.862+0000 7fa2681ff700 1 -- 172.21.15.82:0/1913138961 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa26010efd0 msgr2=0x7fa26010cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:28:53.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.862+0000 7fa2681ff700 1 --2- 172.21.15.82:0/1913138961 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa26010efd0 0x7fa26010cb60 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa25c01a9a0 tx=0x7fa25c01acb0 comp rx=0 tx=0).stop 2023-09-23T09:28:53.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.862+0000 7fa2681ff700 1 -- 172.21.15.82:0/1913138961 shutdown_connections 2023-09-23T09:28:53.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.862+0000 7fa2681ff700 1 --2- 172.21.15.82:0/1913138961 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa26011a100 0x7fa26011c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:53.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.862+0000 7fa2681ff700 1 --2- 172.21.15.82:0/1913138961 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa26010efd0 0x7fa26010cb60 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:53.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.862+0000 7fa2681ff700 1 --2- 172.21.15.82:0/1913138961 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa26010f440 0x7fa26010d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:53.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.862+0000 7fa2681ff700 1 -- 172.21.15.82:0/1913138961 >> 172.21.15.82:0/1913138961 conn(0x7fa26006cbe0 msgr2=0x7fa26006cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:28:53.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.863+0000 7fa2681ff700 1 -- 172.21.15.82:0/1913138961 shutdown_connections 2023-09-23T09:28:53.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.864+0000 7fa2681ff700 1 -- 172.21.15.82:0/1913138961 wait complete. 2023-09-23T09:28:53.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.865+0000 7fa2681ff700 1 Processor -- start 2023-09-23T09:28:53.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.866+0000 7fa2681ff700 1 -- start start 2023-09-23T09:28:53.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.866+0000 7fa2681ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa26010efd0 0x7fa2601153c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:53.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.866+0000 7fa2681ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa26010f440 0x7fa260115900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:53.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.866+0000 7fa2681ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa26011a100 0x7fa2601cada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:53.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.866+0000 7fa2681ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2601cb2e0 con 0x7fa26011a100 2023-09-23T09:28:53.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.866+0000 7fa2681ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2601cb420 con 0x7fa26010efd0 2023-09-23T09:28:53.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.866+0000 7fa2681ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2601cb560 con 0x7fa26010f440 2023-09-23T09:28:53.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.867+0000 7fa26579a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa26010f440 0x7fa260115900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:53.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.867+0000 7fa26579a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa26010f440 0x7fa260115900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:36702/0 (socket says 172.21.15.82:36702) 2023-09-23T09:28:53.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.867+0000 7fa26579a700 1 -- 172.21.15.82:0/1018385906 learned_addr learned my addr 172.21.15.82:0/1018385906 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:28:53.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.867+0000 7fa265f9b700 1 --2- 172.21.15.82:0/1018385906 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa26010efd0 0x7fa2601153c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:53.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.867+0000 7fa265f9b700 1 -- 172.21.15.82:0/1018385906 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa26010f440 msgr2=0x7fa260115900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:28:53.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.868+0000 7fa265f9b700 1 --2- 172.21.15.82:0/1018385906 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa26010f440 0x7fa260115900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:53.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.868+0000 7fa265f9b700 1 -- 172.21.15.82:0/1018385906 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa26011a100 msgr2=0x7fa2601cada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:28:53.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.868+0000 7fa265f9b700 1 --2- 172.21.15.82:0/1018385906 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa26011a100 0x7fa2601cada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:53.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.868+0000 7fa265f9b700 1 -- 172.21.15.82:0/1018385906 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa25c01a600 con 0x7fa26010efd0 2023-09-23T09:28:53.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.868+0000 7fa265f9b700 1 --2- 172.21.15.82:0/1018385906 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa26010efd0 0x7fa2601153c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa25c005950 tx=0x7fa25c01f620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:28:53.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.868+0000 7fa256ffd700 1 -- 172.21.15.82:0/1018385906 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa25c01fc50 con 0x7fa26010efd0 2023-09-23T09:28:53.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.868+0000 7fa2681ff700 1 -- 172.21.15.82:0/1018385906 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2601cb7b0 con 0x7fa26010efd0 2023-09-23T09:28:53.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.868+0000 7fa2681ff700 1 -- 172.21.15.82:0/1018385906 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2601cbc30 con 0x7fa26010efd0 2023-09-23T09:28:53.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.869+0000 7fa256ffd700 1 -- 172.21.15.82:0/1018385906 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa25c00f910 con 0x7fa26010efd0 2023-09-23T09:28:53.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.869+0000 7fa256ffd700 1 -- 172.21.15.82:0/1018385906 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa25c00e870 con 0x7fa26010efd0 2023-09-23T09:28:53.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.873+0000 7fa256ffd700 1 -- 172.21.15.82:0/1018385906 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7fa25c00e9d0 con 0x7fa26010efd0 2023-09-23T09:28:53.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.875+0000 7fa27ba93b80 1 Processor -- start 2023-09-23T09:28:53.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.876+0000 7fa27ba93b80 1 -- start start 2023-09-23T09:28:53.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.876+0000 7fa27ba93b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a2bd59f380 0x55a2bd59f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:53.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.876+0000 7fa27ba93b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a2bd59fca0 0x55a2bd599700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:53.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.876+0000 7fa27ba93b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2bd599c40 0x55a2bd59a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:53.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.877+0000 7fa27ba93b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2bd5017b0 con 0x55a2bd59fca0 2023-09-23T09:28:53.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.877+0000 7fa27ba93b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2bd4f2780 con 0x55a2bd599c40 2023-09-23T09:28:53.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.877+0000 7fa27ba93b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2bd4f00a0 con 0x55a2bd59f380 2023-09-23T09:28:53.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.877+0000 7fa256ffd700 1 --2- 172.21.15.82:0/1018385906 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fa24c0a0200 0x7fa24c0a26c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:53.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.877+0000 7fa256ffd700 1 -- 172.21.15.82:0/1018385906 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fa25c0cc9e0 con 0x7fa26010efd0 2023-09-23T09:28:53.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.877+0000 7fa26679c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a2bd59f380 0x55a2bd59f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:53.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.877+0000 7fa26679c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a2bd59f380 0x55a2bd59f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:36712/0 (socket says 172.21.15.82:36712) 2023-09-23T09:28:53.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.877+0000 7fa26679c700 1 -- 172.21.15.82:0/921161067 learned_addr learned my addr 172.21.15.82:0/921161067 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:28:53.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.878+0000 7fa26579a700 1 --2- 172.21.15.82:0/921161067 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2bd599c40 0x55a2bd59a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:53.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.878+0000 7fa265f9b700 1 --2- 172.21.15.82:0/921161067 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a2bd59fca0 0x55a2bd599700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:53.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.878+0000 7fa26679c700 1 -- 172.21.15.82:0/921161067 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2bd599c40 msgr2=0x55a2bd59a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:28:53.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.878+0000 7fa26679c700 1 --2- 172.21.15.82:0/921161067 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2bd599c40 0x55a2bd59a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:53.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.878+0000 7fa26679c700 1 -- 172.21.15.82:0/921161067 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a2bd59fca0 msgr2=0x55a2bd599700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:28:53.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.878+0000 7fa26679c700 1 --2- 172.21.15.82:0/921161067 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a2bd59fca0 0x55a2bd599700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:53.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.878+0000 7fa26679c700 1 -- 172.21.15.82:0/921161067 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a2bd36b630 con 0x55a2bd59f380 2023-09-23T09:28:53.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.878+0000 7fa265f9b700 1 --2- 172.21.15.82:0/921161067 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a2bd59fca0 0x55a2bd599700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:28:53.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.878+0000 7fa26679c700 1 --2- 172.21.15.82:0/1018385906 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fa24c0a0200 0x7fa24c0a26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:53.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.879+0000 7fa26679c700 1 --2- 172.21.15.82:0/921161067 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a2bd59f380 0x55a2bd59f760 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa258009d10 tx=0x7fa25800e4f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5206936e13594288 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:28:53.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.880+0000 7fa24bfff700 1 -- 172.21.15.82:0/921161067 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa258012610 con 0x55a2bd59f380 2023-09-23T09:28:53.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.880+0000 7fa24bfff700 1 -- 172.21.15.82:0/921161067 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa25800ee20 con 0x55a2bd59f380 2023-09-23T09:28:53.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.880+0000 7fa24bfff700 1 -- 172.21.15.82:0/921161067 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa25801cc00 con 0x55a2bd59f380 2023-09-23T09:28:53.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.881+0000 7fa27ba93b80 1 -- 172.21.15.82:0/921161067 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a2bd59f380 msgr2=0x55a2bd59f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:28:53.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.881+0000 7fa27ba93b80 1 --2- 172.21.15.82:0/921161067 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a2bd59f380 0x55a2bd59f760 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa258009d10 tx=0x7fa25800e4f0 comp rx=0 tx=0).stop 2023-09-23T09:28:53.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.882+0000 7fa26679c700 1 --2- 172.21.15.82:0/1018385906 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fa24c0a0200 0x7fa24c0a26c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa25801d000 tx=0x7fa258011670 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:28:53.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.882+0000 7fa27ba93b80 1 -- 172.21.15.82:0/921161067 shutdown_connections 2023-09-23T09:28:53.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.882+0000 7fa27ba93b80 1 --2- 172.21.15.82:0/921161067 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2bd599c40 0x55a2bd59a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:53.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.882+0000 7fa27ba93b80 1 --2- 172.21.15.82:0/921161067 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a2bd59f380 0x55a2bd59f760 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:53.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.882+0000 7fa27ba93b80 1 --2- 172.21.15.82:0/921161067 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a2bd59fca0 0x55a2bd599700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:53.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.882+0000 7fa27ba93b80 1 -- 172.21.15.82:0/921161067 >> 172.21.15.82:0/921161067 conn(0x55a2bd50e0e0 msgr2=0x55a2bd594410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:28:53.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.883+0000 7fa27ba93b80 1 -- 172.21.15.82:0/921161067 shutdown_connections 2023-09-23T09:28:53.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.883+0000 7fa27ba93b80 1 -- 172.21.15.82:0/921161067 wait complete. 2023-09-23T09:28:53.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.884+0000 7fa27ba93b80 1 -- start start 2023-09-23T09:28:53.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.884+0000 7fa27ba93b80 1 Processor -- start 2023-09-23T09:28:53.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.885+0000 7fa27ba93b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a2bd599c40 0x55a2bd5a5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:53.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.885+0000 7fa27ba93b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2bd59f380 0x55a2bd5a2f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:53.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.885+0000 7fa27ba93b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a2bd59fca0 0x55a2bd5a3680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:53.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.885+0000 7fa27ba93b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2bd4eb990 con 0x55a2bd599c40 2023-09-23T09:28:53.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.885+0000 7fa27ba93b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2bd489bb0 con 0x55a2bd59f380 2023-09-23T09:28:53.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.885+0000 7fa27ba93b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2bd4898b0 con 0x55a2bd59fca0 2023-09-23T09:28:53.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.885+0000 7fa27ba93b80 10 client.0 _ll_register_callbacks cb 0x55a2bd3d3a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:28:53.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.886+0000 7fa265f9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a2bd599c40 0x55a2bd5a5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:53.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.886+0000 7fa265f9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a2bd599c40 0x55a2bd5a5cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43830/0 (socket says 172.21.15.82:43830) 2023-09-23T09:28:53.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.886+0000 7fa265f9b700 1 -- 172.21.15.82:0/146995844 learned_addr learned my addr 172.21.15.82:0/146995844 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:28:53.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.886+0000 7fa26579a700 1 --2- 172.21.15.82:0/146995844 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2bd59f380 0x55a2bd5a2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:53.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.886+0000 7fa265f9b700 1 -- 172.21.15.82:0/146995844 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a2bd59fca0 msgr2=0x55a2bd5a3680 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-23T09:28:53.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.886+0000 7fa265f9b700 1 --2- 172.21.15.82:0/146995844 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a2bd59fca0 0x55a2bd5a3680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:53.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.886+0000 7fa265f9b700 1 -- 172.21.15.82:0/146995844 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2bd59f380 msgr2=0x55a2bd5a2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:28:53.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.886+0000 7fa265f9b700 1 --2- 172.21.15.82:0/146995844 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2bd59f380 0x55a2bd5a2f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:53.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.886+0000 7fa265f9b700 1 -- 172.21.15.82:0/146995844 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa258009940 con 0x55a2bd599c40 2023-09-23T09:28:53.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.886+0000 7fa265f9b700 1 --2- 172.21.15.82:0/146995844 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a2bd599c40 0x55a2bd5a5cc0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fa25c0ca1c0 tx=0x7fa25c005870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f5ec3720f68786e server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:28:53.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.886+0000 7fa2497fa700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:28:53.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.887+0000 7fa2497fa700 1 -- 172.21.15.82:0/146995844 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa25c00ee80 con 0x55a2bd599c40 2023-09-23T09:28:53.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.887+0000 7fa2497fa700 1 -- 172.21.15.82:0/146995844 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(139..139 src has 1..139) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fa25c09b1a0 con 0x55a2bd599c40 2023-09-23T09:28:53.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.887+0000 7fa27ba93b80 1 -- 172.21.15.82:0/146995844 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a2bd5691c0 con 0x55a2bd599c40 2023-09-23T09:28:53.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.887+0000 7fa2497fa700 1 -- 172.21.15.82:0/146995844 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa25c09efd0 con 0x55a2bd599c40 2023-09-23T09:28:53.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.887+0000 7fa27ba93b80 10 client.17265 fetch_fsmap learned FSMap version 91 2023-09-23T09:28:53.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.887+0000 7fa27ba93b80 1 -- 172.21.15.82:0/146995844 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=4+}) v3 -- 0x55a2bd317de0 con 0x55a2bd599c40 2023-09-23T09:28:53.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.888+0000 7fa2497fa700 1 -- 172.21.15.82:0/146995844 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55a2bd5691c0 con 0x55a2bd599c40 2023-09-23T09:28:53.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.888+0000 7fa2497fa700 1 -- 172.21.15.82:0/146995844 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 91) v1 ==== 7930+0+0 (secure 0 0 0) 0x7fa25c09a690 con 0x55a2bd599c40 2023-09-23T09:28:53.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.888+0000 7fa27ba93b80 10 client.17265 fetch_fsmap finished waiting for FSMap version 91 2023-09-23T09:28:53.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.888+0000 7fa27ba93b80 10 client.17265 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2023-09-23T09:28:53.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.888+0000 7fa27ba93b80 20 client.17265 populate_metadata read hostname 'smithi082' 2023-09-23T09:28:53.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.888+0000 7fa27ba93b80 1 --2- 172.21.15.82:0/146995844 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x55a2bd5b3470 0x55a2bd5b5930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:53.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.888+0000 7fa27ba93b80 4 client.17265 mds_command: new command op to 24514 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:28:53.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.888+0000 7fa27ba93b80 1 -- 172.21.15.82:0/146995844 --> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a2bd491ba0 con 0x55a2bd5b3470 2023-09-23T09:28:53.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.889+0000 7fa26579a700 1 --2- 172.21.15.82:0/146995844 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2bd59f380 0x55a2bd5a2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T09:28:53.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.889+0000 7fa26579a700 1 --2- 172.21.15.82:0/146995844 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x55a2bd5b3470 0x55a2bd5b5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:53.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.890+0000 7fa26579a700 1 --2- 172.21.15.82:0/146995844 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x55a2bd5b3470 0x55a2bd5b5930 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=b1b71ede13bd49a7 server_cookie=ceb330fc71e0c300 in_seq=0 out_seq=0 2023-09-23T09:28:53.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.890+0000 7fa2497fa700 10 client.17265 ms_handle_connect on v2:172.21.15.161:6834/2237964162 2023-09-23T09:28:53.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.891+0000 7fa2497fa700 1 -- 172.21.15.82:0/146995844 <== mds.4 v2:172.21.15.161:6834/2237964162 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a2bd491ba0 con 0x55a2bd5b3470 2023-09-23T09:28:53.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.891+0000 7fa2497fa700 10 client.17265 handle_command_reply: tid=0 2023-09-23T09:28:53.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.891+0000 7fa27ba93b80 1 client.17265 shutdown 2023-09-23T09:28:53.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.892+0000 7fa27ba93b80 1 -- 172.21.15.82:0/146995844 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a2bd599c40 msgr2=0x55a2bd5a5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:28:53.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.892+0000 7fa27ba93b80 1 --2- 172.21.15.82:0/146995844 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a2bd599c40 0x55a2bd5a5cc0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fa25c0ca1c0 tx=0x7fa25c005870 comp rx=0 tx=0).stop 2023-09-23T09:28:53.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.892+0000 7fa27ba93b80 1 -- 172.21.15.82:0/146995844 shutdown_connections 2023-09-23T09:28:53.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.892+0000 7fa27ba93b80 1 --2- 172.21.15.82:0/146995844 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x55a2bd5b3470 0x55a2bd5b5930 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:53.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.892+0000 7fa27ba93b80 1 --2- 172.21.15.82:0/146995844 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a2bd59fca0 0x55a2bd5a3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:53.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.892+0000 7fa27ba93b80 1 --2- 172.21.15.82:0/146995844 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a2bd599c40 0x55a2bd5a5cc0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:53.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.892+0000 7fa27ba93b80 1 --2- 172.21.15.82:0/146995844 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2bd59f380 0x55a2bd5a2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:53.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.892+0000 7fa27ba93b80 1 -- 172.21.15.82:0/146995844 >> 172.21.15.82:0/146995844 conn(0x55a2bd50e0e0 msgr2=0x55a2bd58eb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:28:53.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.892+0000 7fa2497fa700 0 client.17265 ms_handle_reset on v2:172.21.15.161:6834/2237964162 2023-09-23T09:28:53.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.893+0000 7fa27ba93b80 1 -- 172.21.15.82:0/146995844 shutdown_connections 2023-09-23T09:28:53.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.893+0000 7fa27ba93b80 1 -- 172.21.15.82:0/146995844 wait complete. 2023-09-23T09:28:53.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.893+0000 7fa27ba93b80 20 client.17265 trim_cache size 0 max 16384 2023-09-23T09:28:53.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.911+0000 7fa27ba93b80 1 Processor -- start 2023-09-23T09:28:53.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.911+0000 7fa27ba93b80 1 -- start start 2023-09-23T09:28:53.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.912+0000 7fa27ba93b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a2bd599c40 0x55a2bd5a57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:53.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.912+0000 7fa27ba93b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a2bd59f380 0x55a2bd5a24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:53.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.912+0000 7fa27ba93b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2bd59fca0 0x55a2bd59d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:53.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.912+0000 7fa27ba93b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2bd36d920 con 0x55a2bd599c40 2023-09-23T09:28:53.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.912+0000 7fa27ba93b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2bd590a70 con 0x55a2bd59fca0 2023-09-23T09:28:53.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.912+0000 7fa27ba93b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2bd5b01e0 con 0x55a2bd59f380 2023-09-23T09:28:53.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.912+0000 7fa265f9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a2bd599c40 0x55a2bd5a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:53.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.912+0000 7fa265f9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a2bd599c40 0x55a2bd5a57f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43840/0 (socket says 172.21.15.82:43840) 2023-09-23T09:28:53.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.912+0000 7fa265f9b700 1 -- 172.21.15.82:0/1048994935 learned_addr learned my addr 172.21.15.82:0/1048994935 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:28:53.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.912+0000 7fa26579a700 1 --2- 172.21.15.82:0/1048994935 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a2bd59f380 0x55a2bd5a24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:53.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.913+0000 7fa26679c700 1 --2- 172.21.15.82:0/1048994935 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2bd59fca0 0x55a2bd59d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:53.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.913+0000 7fa26579a700 1 -- 172.21.15.82:0/1048994935 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2bd59fca0 msgr2=0x55a2bd59d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:28:53.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.913+0000 7fa26579a700 1 --2- 172.21.15.82:0/1048994935 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2bd59fca0 0x55a2bd59d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:53.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.913+0000 7fa26579a700 1 -- 172.21.15.82:0/1048994935 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a2bd599c40 msgr2=0x55a2bd5a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:28:53.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.913+0000 7fa26579a700 1 --2- 172.21.15.82:0/1048994935 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a2bd599c40 0x55a2bd5a57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:53.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.913+0000 7fa26579a700 1 -- 172.21.15.82:0/1048994935 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a2bd300c60 con 0x55a2bd59f380 2023-09-23T09:28:53.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.914+0000 7fa26579a700 1 --2- 172.21.15.82:0/1048994935 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a2bd59f380 0x55a2bd5a24b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x55a2bd5b6250 tx=0x7fa250009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d73c9472378d991 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:28:53.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.915+0000 7fa254ff9700 1 -- 172.21.15.82:0/1048994935 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa250018040 con 0x55a2bd59f380 2023-09-23T09:28:53.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.915+0000 7fa254ff9700 1 -- 172.21.15.82:0/1048994935 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa25001a570 con 0x55a2bd59f380 2023-09-23T09:28:53.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.915+0000 7fa254ff9700 1 -- 172.21.15.82:0/1048994935 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa250003e10 con 0x55a2bd59f380 2023-09-23T09:28:53.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.916+0000 7fa27ba93b80 1 -- 172.21.15.82:0/1048994935 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a2bd59f380 msgr2=0x55a2bd5a24b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:28:53.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.916+0000 7fa27ba93b80 1 --2- 172.21.15.82:0/1048994935 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a2bd59f380 0x55a2bd5a24b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x55a2bd5b6250 tx=0x7fa250009260 comp rx=0 tx=0).stop 2023-09-23T09:28:53.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.916+0000 7fa27ba93b80 1 -- 172.21.15.82:0/1048994935 shutdown_connections 2023-09-23T09:28:53.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.916+0000 7fa27ba93b80 1 --2- 172.21.15.82:0/1048994935 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2bd59fca0 0x55a2bd59d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:53.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.916+0000 7fa27ba93b80 1 --2- 172.21.15.82:0/1048994935 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a2bd599c40 0x55a2bd5a57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:53.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.916+0000 7fa27ba93b80 1 --2- 172.21.15.82:0/1048994935 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a2bd59f380 0x55a2bd5a24b0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:53.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.916+0000 7fa27ba93b80 1 -- 172.21.15.82:0/1048994935 >> 172.21.15.82:0/1048994935 conn(0x55a2bd50e0e0 msgr2=0x55a2bd5afad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:28:53.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.916+0000 7fa27ba93b80 1 -- 172.21.15.82:0/1048994935 shutdown_connections 2023-09-23T09:28:53.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.916+0000 7fa27ba93b80 1 -- 172.21.15.82:0/1048994935 wait complete. 2023-09-23T09:28:53.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.917+0000 7fa27ba93b80 1 -- start start 2023-09-23T09:28:53.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.917+0000 7fa27ba93b80 1 Processor -- start 2023-09-23T09:28:53.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.918+0000 7fa27ba93b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2bd599c40 0x55a2bd59ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:53.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.918+0000 7fa27ba93b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a2bd59f380 0x55a2bd59b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:53.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.918+0000 7fa27ba93b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a2bd59fca0 0x55a2bd59b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:53.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.918+0000 7fa27ba93b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2bd59bf90 con 0x55a2bd59f380 2023-09-23T09:28:53.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.918+0000 7fa27ba93b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2bd59c100 con 0x55a2bd599c40 2023-09-23T09:28:53.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.918+0000 7fa27ba93b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2bd59c2c0 con 0x55a2bd59fca0 2023-09-23T09:28:53.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.918+0000 7fa27ba93b80 10 client.0 _ll_register_callbacks cb 0x7fa25c09ad90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:28:53.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.919+0000 7fa265f9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2bd599c40 0x55a2bd59ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:53.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.919+0000 7fa265f9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2bd599c40 0x55a2bd59ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:60446/0 (socket says 172.21.15.82:60446) 2023-09-23T09:28:53.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.919+0000 7fa265f9b700 1 -- 172.21.15.82:0/709576473 learned_addr learned my addr 172.21.15.82:0/709576473 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:28:53.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.919+0000 7fa26679c700 1 --2- 172.21.15.82:0/709576473 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a2bd59fca0 0x55a2bd59b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:53.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.920+0000 7fa26579a700 1 --2- 172.21.15.82:0/709576473 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a2bd59f380 0x55a2bd59b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:53.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.920+0000 7fa26679c700 1 -- 172.21.15.82:0/709576473 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2bd599c40 msgr2=0x55a2bd59ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:28:53.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.920+0000 7fa26679c700 1 --2- 172.21.15.82:0/709576473 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2bd599c40 0x55a2bd59ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:53.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.920+0000 7fa26679c700 1 -- 172.21.15.82:0/709576473 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a2bd59f380 msgr2=0x55a2bd59b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:28:53.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.920+0000 7fa26679c700 1 --2- 172.21.15.82:0/709576473 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a2bd59f380 0x55a2bd59b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:53.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.920+0000 7fa26679c700 1 -- 172.21.15.82:0/709576473 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2500042b0 con 0x55a2bd59fca0 2023-09-23T09:28:53.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.920+0000 7fa26579a700 1 --2- 172.21.15.82:0/709576473 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a2bd59f380 0x55a2bd59b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T09:28:53.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.921+0000 7fa26679c700 1 --2- 172.21.15.82:0/709576473 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a2bd59fca0 0x55a2bd59b880 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x55a2bd569300 tx=0x7fa258013000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98946a560d5326e9 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:28:53.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.921+0000 7fa2497fa700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T09:28:53.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.922+0000 7fa2497fa700 1 -- 172.21.15.82:0/709576473 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa25802c070 con 0x55a2bd59fca0 2023-09-23T09:28:53.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.922+0000 7fa2497fa700 1 -- 172.21.15.82:0/709576473 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(139..139 src has 1..139) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fa25800d040 con 0x55a2bd59fca0 2023-09-23T09:28:53.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.923+0000 7fa27ba93b80 1 -- 172.21.15.82:0/709576473 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a2bd58c8b0 con 0x55a2bd59fca0 2023-09-23T09:28:53.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.924+0000 7fa2497fa700 1 -- 172.21.15.82:0/709576473 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa258009230 con 0x55a2bd59fca0 2023-09-23T09:28:53.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.925+0000 7fa27ba93b80 10 client.27010 fetch_fsmap learned FSMap version 91 2023-09-23T09:28:53.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.925+0000 7fa27ba93b80 1 -- 172.21.15.82:0/709576473 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=4+}) v3 -- 0x55a2bd33e250 con 0x55a2bd59fca0 2023-09-23T09:28:53.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.926+0000 7fa2497fa700 1 -- 172.21.15.82:0/709576473 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55a2bd58c8b0 con 0x55a2bd59fca0 2023-09-23T09:28:53.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.926+0000 7fa2497fa700 1 -- 172.21.15.82:0/709576473 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 91) v1 ==== 7930+0+0 (secure 0 0 0) 0x7fa258004370 con 0x55a2bd59fca0 2023-09-23T09:28:53.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.927+0000 7fa27ba93b80 10 client.27010 fetch_fsmap finished waiting for FSMap version 91 2023-09-23T09:28:53.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.927+0000 7fa27ba93b80 10 client.27010 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2023-09-23T09:28:53.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.927+0000 7fa27ba93b80 20 client.27010 populate_metadata read hostname 'smithi082' 2023-09-23T09:28:53.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.927+0000 7fa27ba93b80 1 --2- 172.21.15.82:0/709576473 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x55a2bd607e80 0x55a2bd60a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:53.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.927+0000 7fa27ba93b80 4 client.27010 mds_command: new command op to 24514 tid=0[{"prefix": "damage ls"}] 2023-09-23T09:28:53.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.928+0000 7fa27ba93b80 1 -- 172.21.15.82:0/709576473 --> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55a2bd4e4970 con 0x55a2bd607e80 2023-09-23T09:28:53.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.929+0000 7fa265f9b700 1 --2- 172.21.15.82:0/709576473 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x55a2bd607e80 0x55a2bd60a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:53.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.931+0000 7fa265f9b700 1 --2- 172.21.15.82:0/709576473 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x55a2bd607e80 0x55a2bd60a2a0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=e40908a18a0adf3a server_cookie=8f130c529ad225a6 in_seq=0 out_seq=0 2023-09-23T09:28:53.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.931+0000 7fa2497fa700 10 client.27010 ms_handle_connect on v2:172.21.15.161:6834/2237964162 2023-09-23T09:28:53.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.931+0000 7fa2497fa700 1 -- 172.21.15.82:0/709576473 <== mds.4 v2:172.21.15.161:6834/2237964162 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55a2bd4e4970 con 0x55a2bd607e80 2023-09-23T09:28:53.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.931+0000 7fa2497fa700 10 client.27010 handle_command_reply: tid=0 2023-09-23T09:28:53.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.931+0000 7fa27ba93b80 1 client.27010 shutdown 2023-09-23T09:28:53.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.932+0000 7fa27ba93b80 1 -- 172.21.15.82:0/709576473 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a2bd59fca0 msgr2=0x55a2bd59b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:28:53.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.932+0000 7fa27ba93b80 1 --2- 172.21.15.82:0/709576473 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a2bd59fca0 0x55a2bd59b880 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x55a2bd569300 tx=0x7fa258013000 comp rx=0 tx=0).stop 2023-09-23T09:28:53.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.932+0000 7fa27ba93b80 1 -- 172.21.15.82:0/709576473 shutdown_connections 2023-09-23T09:28:53.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.932+0000 7fa27ba93b80 1 --2- 172.21.15.82:0/709576473 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x55a2bd607e80 0x55a2bd60a2a0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:53.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.932+0000 7fa27ba93b80 1 --2- 172.21.15.82:0/709576473 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a2bd59fca0 0x55a2bd59b880 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:53.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.932+0000 7fa27ba93b80 1 --2- 172.21.15.82:0/709576473 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2bd599c40 0x55a2bd59ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:53.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.932+0000 7fa27ba93b80 1 --2- 172.21.15.82:0/709576473 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a2bd59f380 0x55a2bd59b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:53.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.932+0000 7fa27ba93b80 1 -- 172.21.15.82:0/709576473 >> 172.21.15.82:0/709576473 conn(0x55a2bd50e0e0 msgr2=0x55a2bd59d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:28:53.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.932+0000 7fa2497fa700 0 client.27010 ms_handle_reset on v2:172.21.15.161:6834/2237964162 2023-09-23T09:28:53.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.932+0000 7fa27ba93b80 1 -- 172.21.15.82:0/709576473 shutdown_connections 2023-09-23T09:28:53.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.932+0000 7fa27ba93b80 1 -- 172.21.15.82:0/709576473 wait complete. 2023-09-23T09:28:53.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.933+0000 7fa27ba93b80 20 client.27010 trim_cache size 0 max 16384 2023-09-23T09:28:53.935 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2023-09-23T09:28:53.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.933+0000 7fa2681ff700 1 -- 172.21.15.82:0/1018385906 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fa24c0a0200 msgr2=0x7fa24c0a26c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:28:53.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.933+0000 7fa2681ff700 1 --2- 172.21.15.82:0/1018385906 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fa24c0a0200 0x7fa24c0a26c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa25801d000 tx=0x7fa258011670 comp rx=0 tx=0).stop 2023-09-23T09:28:53.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.933+0000 7fa2681ff700 1 -- 172.21.15.82:0/1018385906 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa26010efd0 msgr2=0x7fa2601153c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:28:53.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.933+0000 7fa2681ff700 1 --2- 172.21.15.82:0/1018385906 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa26010efd0 0x7fa2601153c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa25c005950 tx=0x7fa25c01f620 comp rx=0 tx=0).stop 2023-09-23T09:28:53.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.934+0000 7fa2681ff700 1 -- 172.21.15.82:0/1018385906 shutdown_connections 2023-09-23T09:28:53.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.934+0000 7fa2681ff700 1 --2- 172.21.15.82:0/1018385906 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fa24c0a0200 0x7fa24c0a26c0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:53.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.934+0000 7fa2681ff700 1 --2- 172.21.15.82:0/1018385906 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa26011a100 0x7fa2601cada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:53.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.934+0000 7fa2681ff700 1 --2- 172.21.15.82:0/1018385906 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa26010efd0 0x7fa2601153c0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:53.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.934+0000 7fa2681ff700 1 --2- 172.21.15.82:0/1018385906 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa26010f440 0x7fa260115900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:53.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.934+0000 7fa2681ff700 1 -- 172.21.15.82:0/1018385906 >> 172.21.15.82:0/1018385906 conn(0x7fa26006cbe0 msgr2=0x7fa26011a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:28:53.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.934+0000 7fa2681ff700 1 -- 172.21.15.82:0/1018385906 shutdown_connections 2023-09-23T09:28:53.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:53.935+0000 7fa2681ff700 1 -- 172.21.15.82:0/1018385906 wait complete. 2023-09-23T09:28:53.970 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-09-23T09:28:54.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:28:53 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/994710162' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T09:28:54.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:28:53 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/994710162' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T09:28:54.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.350+0000 7f33dd1ff700 1 -- 172.21.15.82:0/432675884 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33d80ff640 msgr2=0x7f33d80ffa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:28:54.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.350+0000 7f33dd1ff700 1 --2- 172.21.15.82:0/432675884 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33d80ff640 0x7f33d80ffa20 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f33c800b1a0 tx=0x7f33c800b4b0 comp rx=0 tx=0).stop 2023-09-23T09:28:54.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.350+0000 7f33dd1ff700 1 -- 172.21.15.82:0/432675884 shutdown_connections 2023-09-23T09:28:54.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.350+0000 7f33dd1ff700 1 --2- 172.21.15.82:0/432675884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33d810d1f0 0x7f33d810f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:54.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.350+0000 7f33dd1ff700 1 --2- 172.21.15.82:0/432675884 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33d80ff640 0x7f33d80ffa20 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:54.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.350+0000 7f33dd1ff700 1 --2- 172.21.15.82:0/432675884 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f33d80ffff0 0x7f33d810cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:54.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.350+0000 7f33dd1ff700 1 -- 172.21.15.82:0/432675884 >> 172.21.15.82:0/432675884 conn(0x7f33d80fb270 msgr2=0x7f33d80fd690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:28:54.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.356+0000 7f33dd1ff700 1 -- 172.21.15.82:0/432675884 shutdown_connections 2023-09-23T09:28:54.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.357+0000 7f33dd1ff700 1 -- 172.21.15.82:0/432675884 wait complete. 2023-09-23T09:28:54.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.359+0000 7f33dd1ff700 1 Processor -- start 2023-09-23T09:28:54.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.359+0000 7f33dd1ff700 1 -- start start 2023-09-23T09:28:54.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.360+0000 7f33dd1ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33d80ff640 0x7f33d8108380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:54.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.360+0000 7f33dd1ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33d80ffff0 0x7f33d81088c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:54.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.360+0000 7f33dd1ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f33d810d1f0 0x7f33d819c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:54.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.360+0000 7f33dd1ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33d819c6d0 con 0x7f33d80ff640 2023-09-23T09:28:54.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.360+0000 7f33dd1ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33d819c810 con 0x7f33d80ffff0 2023-09-23T09:28:54.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.360+0000 7f33dd1ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33d819c950 con 0x7f33d810d1f0 2023-09-23T09:28:54.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.360+0000 7f33d6d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33d80ff640 0x7f33d8108380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:54.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.361+0000 7f33d6d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33d80ff640 0x7f33d8108380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43864/0 (socket says 172.21.15.82:43864) 2023-09-23T09:28:54.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.361+0000 7f33d6d9d700 1 -- 172.21.15.82:0/386090941 learned_addr learned my addr 172.21.15.82:0/386090941 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:28:54.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.361+0000 7f33d6d9d700 1 -- 172.21.15.82:0/386090941 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f33d810d1f0 msgr2=0x7f33d819c190 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-09-23T09:28:54.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.361+0000 7f33d6d9d700 1 --2- 172.21.15.82:0/386090941 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f33d810d1f0 0x7f33d819c190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:54.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.361+0000 7f33d6d9d700 1 -- 172.21.15.82:0/386090941 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33d80ffff0 msgr2=0x7f33d81088c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-09-23T09:28:54.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.361+0000 7f33d6d9d700 1 --2- 172.21.15.82:0/386090941 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33d80ffff0 0x7f33d81088c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:54.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.361+0000 7f33d6d9d700 1 -- 172.21.15.82:0/386090941 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33c8009d00 con 0x7f33d80ff640 2023-09-23T09:28:54.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.362+0000 7f33d6d9d700 1 --2- 172.21.15.82:0/386090941 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33d80ff640 0x7f33d8108380 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f33c800bd30 tx=0x7f33c800be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:28:54.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.362+0000 7f33d4d99700 1 -- 172.21.15.82:0/386090941 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c8004ca0 con 0x7f33d80ff640 2023-09-23T09:28:54.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.362+0000 7f33d4d99700 1 -- 172.21.15.82:0/386090941 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f33c8004e00 con 0x7f33d80ff640 2023-09-23T09:28:54.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.362+0000 7f33d4d99700 1 -- 172.21.15.82:0/386090941 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c8007940 con 0x7f33d80ff640 2023-09-23T09:28:54.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.363+0000 7f33dd1ff700 1 -- 172.21.15.82:0/386090941 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33d819cba0 con 0x7f33d80ff640 2023-09-23T09:28:54.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.363+0000 7f33dd1ff700 1 -- 172.21.15.82:0/386090941 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33d819cfd0 con 0x7f33d80ff640 2023-09-23T09:28:54.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.370+0000 7f33f0b77b80 1 Processor -- start 2023-09-23T09:28:54.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.370+0000 7f33d4d99700 1 -- 172.21.15.82:0/386090941 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f33c8007aa0 con 0x7f33d80ff640 2023-09-23T09:28:54.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.371+0000 7f33f0b77b80 1 -- start start 2023-09-23T09:28:54.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.371+0000 7f33f0b77b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556866bc9380 0x556866bc9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:54.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.371+0000 7f33f0b77b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556866bc9ca0 0x556866bc3700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:54.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.371+0000 7f33f0b77b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556866bc3c40 0x556866bc40a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:54.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.371+0000 7f33f0b77b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x556866b2b7b0 con 0x556866bc3c40 2023-09-23T09:28:54.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.371+0000 7f33f0b77b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x556866b1c780 con 0x556866bc9380 2023-09-23T09:28:54.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.371+0000 7f33f0b77b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x556866b1a0a0 con 0x556866bc9ca0 2023-09-23T09:28:54.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.372+0000 7f33d759e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556866bc9380 0x556866bc9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:54.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.372+0000 7f33d759e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556866bc9380 0x556866bc9760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:60470/0 (socket says 172.21.15.82:60470) 2023-09-23T09:28:54.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.372+0000 7f33d759e700 1 -- 172.21.15.82:0/372181842 learned_addr learned my addr 172.21.15.82:0/372181842 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:28:54.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.372+0000 7f33ce59c700 1 --2- 172.21.15.82:0/372181842 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556866bc3c40 0x556866bc40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:54.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.373+0000 7f33d759e700 1 -- 172.21.15.82:0/372181842 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556866bc9ca0 msgr2=0x556866bc3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:28:54.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.373+0000 7f33d759e700 1 --2- 172.21.15.82:0/372181842 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556866bc9ca0 0x556866bc3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:54.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.373+0000 7f33d759e700 1 -- 172.21.15.82:0/372181842 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556866bc3c40 msgr2=0x556866bc40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:28:54.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.373+0000 7f33d759e700 1 --2- 172.21.15.82:0/372181842 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556866bc3c40 0x556866bc40a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:54.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.373+0000 7f33d759e700 1 -- 172.21.15.82:0/372181842 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556866995630 con 0x556866bc9380 2023-09-23T09:28:54.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.373+0000 7f33d4d99700 1 --2- 172.21.15.82:0/386090941 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f33c40a0250 0x7f33c40a2710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:54.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.373+0000 7f33d4d99700 1 -- 172.21.15.82:0/386090941 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f33c80ddb50 con 0x7f33d80ff640 2023-09-23T09:28:54.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.374+0000 7f33d6d9d700 1 --2- 172.21.15.82:0/386090941 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f33c40a0250 0x7f33c40a2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:54.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.376+0000 7f33d6d9d700 1 --2- 172.21.15.82:0/386090941 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f33c40a0250 0x7f33c40a2710 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x556866bca100 tx=0x7f33c8009040 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:28:54.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.377+0000 7f33d759e700 1 --2- 172.21.15.82:0/372181842 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556866bc9380 0x556866bc9760 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f33d0009b20 tx=0x7f33d0009e30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21c753f44394c67a server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:28:54.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.377+0000 7f33cd59a700 1 -- 172.21.15.82:0/372181842 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d0004220 con 0x556866bc9380 2023-09-23T09:28:54.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.377+0000 7f33cd59a700 1 -- 172.21.15.82:0/372181842 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f33d000ed10 con 0x556866bc9380 2023-09-23T09:28:54.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.377+0000 7f33cd59a700 1 -- 172.21.15.82:0/372181842 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d0004e00 con 0x556866bc9380 2023-09-23T09:28:54.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.378+0000 7f33f0b77b80 1 -- 172.21.15.82:0/372181842 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556866bc9380 msgr2=0x556866bc9760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:28:54.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.378+0000 7f33f0b77b80 1 --2- 172.21.15.82:0/372181842 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556866bc9380 0x556866bc9760 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f33d0009b20 tx=0x7f33d0009e30 comp rx=0 tx=0).stop 2023-09-23T09:28:54.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.379+0000 7f33f0b77b80 1 -- 172.21.15.82:0/372181842 shutdown_connections 2023-09-23T09:28:54.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.379+0000 7f33f0b77b80 1 --2- 172.21.15.82:0/372181842 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556866bc3c40 0x556866bc40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:54.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.379+0000 7f33f0b77b80 1 --2- 172.21.15.82:0/372181842 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556866bc9380 0x556866bc9760 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:54.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.379+0000 7f33f0b77b80 1 --2- 172.21.15.82:0/372181842 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556866bc9ca0 0x556866bc3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:54.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.379+0000 7f33f0b77b80 1 -- 172.21.15.82:0/372181842 >> 172.21.15.82:0/372181842 conn(0x556866b380e0 msgr2=0x556866bbe410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:28:54.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.385+0000 7f33f0b77b80 1 -- 172.21.15.82:0/372181842 shutdown_connections 2023-09-23T09:28:54.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.385+0000 7f33f0b77b80 1 -- 172.21.15.82:0/372181842 wait complete. 2023-09-23T09:28:54.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.386+0000 7f33f0b77b80 1 -- start start 2023-09-23T09:28:54.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.386+0000 7f33f0b77b80 1 Processor -- start 2023-09-23T09:28:54.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.387+0000 7f33f0b77b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556866bc3c40 0x556866bcfc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:54.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.387+0000 7f33f0b77b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556866bc9380 0x556866bcce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:54.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.387+0000 7f33f0b77b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556866bc9ca0 0x556866bcd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:54.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.387+0000 7f33f0b77b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x556866b15990 con 0x556866bc3c40 2023-09-23T09:28:54.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.387+0000 7f33f0b77b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x556866ab3bb0 con 0x556866bc9380 2023-09-23T09:28:54.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.387+0000 7f33f0b77b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x556866ab38b0 con 0x556866bc9ca0 2023-09-23T09:28:54.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.387+0000 7f33f0b77b80 10 client.0 _ll_register_callbacks cb 0x5568669fda80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:28:54.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.388+0000 7f33ce59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556866bc9380 0x556866bcce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:54.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.388+0000 7f33ce59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556866bc9380 0x556866bcce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:60480/0 (socket says 172.21.15.82:60480) 2023-09-23T09:28:54.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.388+0000 7f33ce59c700 1 -- 172.21.15.82:0/1753810737 learned_addr learned my addr 172.21.15.82:0/1753810737 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:28:54.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.391+0000 7f33ce59c700 1 -- 172.21.15.82:0/1753810737 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556866bc9ca0 msgr2=0x556866bcd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:28:54.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.391+0000 7f33ce59c700 1 --2- 172.21.15.82:0/1753810737 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556866bc9ca0 0x556866bcd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:54.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.391+0000 7f33ce59c700 1 -- 172.21.15.82:0/1753810737 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556866bc3c40 msgr2=0x556866bcfc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:28:54.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.391+0000 7f33ce59c700 1 --2- 172.21.15.82:0/1753810737 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556866bc3c40 0x556866bcfc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:54.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.391+0000 7f33ce59c700 1 -- 172.21.15.82:0/1753810737 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33d00097d0 con 0x556866bc9380 2023-09-23T09:28:54.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.392+0000 7f33ce59c700 1 --2- 172.21.15.82:0/1753810737 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556866bc9380 0x556866bcce80 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f33c0010680 tx=0x7f33c0010a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1db09b65f4927d97 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:28:54.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.394+0000 7f33be7fc700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-09-23T09:28:54.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.394+0000 7f33be7fc700 1 -- 172.21.15.82:0/1753810737 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c0011850 con 0x556866bc9380 2023-09-23T09:28:54.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.394+0000 7f33be7fc700 1 -- 172.21.15.82:0/1753810737 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(139..139 src has 1..139) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f33c0017070 con 0x556866bc9380 2023-09-23T09:28:54.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.396+0000 7f33f0b77b80 1 -- 172.21.15.82:0/1753810737 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556866b931c0 con 0x556866bc9380 2023-09-23T09:28:54.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.399+0000 7f33be7fc700 1 -- 172.21.15.82:0/1753810737 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f33c00119b0 con 0x556866bc9380 2023-09-23T09:28:54.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.404+0000 7f33f0b77b80 10 client.26960 fetch_fsmap learned FSMap version 91 2023-09-23T09:28:54.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.404+0000 7f33f0b77b80 1 -- 172.21.15.82:0/1753810737 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=4+}) v3 -- 0x556866941de0 con 0x556866bc9380 2023-09-23T09:28:54.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.404+0000 7f33be7fc700 1 -- 172.21.15.82:0/1753810737 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x556866b931c0 con 0x556866bc9380 2023-09-23T09:28:54.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.404+0000 7f33be7fc700 1 -- 172.21.15.82:0/1753810737 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 91) v1 ==== 7930+0+0 (secure 0 0 0) 0x7f33c001cc50 con 0x556866bc9380 2023-09-23T09:28:54.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.404+0000 7f33f0b77b80 10 client.26960 fetch_fsmap finished waiting for FSMap version 91 2023-09-23T09:28:54.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.404+0000 7f33f0b77b80 10 client.26960 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2023-09-23T09:28:54.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.405+0000 7f33f0b77b80 20 client.26960 populate_metadata read hostname 'smithi082' 2023-09-23T09:28:54.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.405+0000 7f33f0b77b80 1 --2- 172.21.15.82:0/1753810737 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x556866be5f60 0x556866be8380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:54.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.405+0000 7f33f0b77b80 4 client.26960 mds_command: new command op to 24515 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:28:54.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.405+0000 7f33f0b77b80 1 -- 172.21.15.82:0/1753810737 --> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556866abbba0 con 0x556866be5f60 2023-09-23T09:28:54.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.406+0000 7f33d759e700 1 --2- 172.21.15.82:0/1753810737 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x556866be5f60 0x556866be8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:54.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.406+0000 7f33d759e700 1 --2- 172.21.15.82:0/1753810737 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x556866be5f60 0x556866be8380 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=5c20c8bce83422bb server_cookie=2c108495b09f8436 in_seq=0 out_seq=0 2023-09-23T09:28:54.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.407+0000 7f33be7fc700 10 client.26960 ms_handle_connect on v2:172.21.15.135:6836/2655304858 2023-09-23T09:28:54.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.407+0000 7f33be7fc700 1 -- 172.21.15.82:0/1753810737 <== mds.3 v2:172.21.15.135:6836/2655304858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x556866abbba0 con 0x556866be5f60 2023-09-23T09:28:54.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.407+0000 7f33be7fc700 10 client.26960 handle_command_reply: tid=0 2023-09-23T09:28:54.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.407+0000 7f33f0b77b80 1 client.26960 shutdown 2023-09-23T09:28:54.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.409+0000 7f33f0b77b80 1 -- 172.21.15.82:0/1753810737 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556866bc9380 msgr2=0x556866bcce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:28:54.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.409+0000 7f33f0b77b80 1 --2- 172.21.15.82:0/1753810737 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556866bc9380 0x556866bcce80 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f33c0010680 tx=0x7f33c0010a40 comp rx=0 tx=0).stop 2023-09-23T09:28:54.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.410+0000 7f33f0b77b80 1 -- 172.21.15.82:0/1753810737 shutdown_connections 2023-09-23T09:28:54.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.410+0000 7f33f0b77b80 1 --2- 172.21.15.82:0/1753810737 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x556866be5f60 0x556866be8380 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:54.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.410+0000 7f33f0b77b80 1 --2- 172.21.15.82:0/1753810737 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556866bc9ca0 0x556866bcd500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:54.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.410+0000 7f33f0b77b80 1 --2- 172.21.15.82:0/1753810737 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556866bc3c40 0x556866bcfc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:54.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.410+0000 7f33f0b77b80 1 --2- 172.21.15.82:0/1753810737 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556866bc9380 0x556866bcce80 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:54.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.410+0000 7f33f0b77b80 1 -- 172.21.15.82:0/1753810737 >> 172.21.15.82:0/1753810737 conn(0x556866b380e0 msgr2=0x556866bb8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:28:54.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.410+0000 7f33be7fc700 0 client.26960 ms_handle_reset on v2:172.21.15.135:6836/2655304858 2023-09-23T09:28:54.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.411+0000 7f33f0b77b80 1 -- 172.21.15.82:0/1753810737 shutdown_connections 2023-09-23T09:28:54.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.411+0000 7f33f0b77b80 1 -- 172.21.15.82:0/1753810737 wait complete. 2023-09-23T09:28:54.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.411+0000 7f33f0b77b80 20 client.26960 trim_cache size 0 max 16384 2023-09-23T09:28:54.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.437+0000 7f33f0b77b80 1 Processor -- start 2023-09-23T09:28:54.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.438+0000 7f33f0b77b80 1 -- start start 2023-09-23T09:28:54.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.438+0000 7f33f0b77b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556866bc3c40 0x556866bcf7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:54.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.438+0000 7f33f0b77b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556866bc9380 0x556866bc7010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:54.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.438+0000 7f33f0b77b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556866bc9ca0 0x556866bc7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:54.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.438+0000 7f33f0b77b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x556866997920 con 0x556866bc3c40 2023-09-23T09:28:54.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.438+0000 7f33f0b77b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x556866bcb470 con 0x556866bc9380 2023-09-23T09:28:54.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.438+0000 7f33f0b77b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x556866bc7b80 con 0x556866bc9ca0 2023-09-23T09:28:54.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.441+0000 7f33d759e700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556866bc9ca0 0x556866bc7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:54.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.441+0000 7f33d759e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556866bc3c40 0x556866bcf7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:54.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.441+0000 7f33d759e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556866bc3c40 0x556866bcf7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43888/0 (socket says 172.21.15.82:43888) 2023-09-23T09:28:54.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.441+0000 7f33d759e700 1 -- 172.21.15.82:0/4225427708 learned_addr learned my addr 172.21.15.82:0/4225427708 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:28:54.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.442+0000 7f33ce59c700 1 --2- 172.21.15.82:0/4225427708 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556866bc9380 0x556866bc7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:54.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.442+0000 7f33d759e700 1 -- 172.21.15.82:0/4225427708 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556866bc9380 msgr2=0x556866bc7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:28:54.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.442+0000 7f33d759e700 1 --2- 172.21.15.82:0/4225427708 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556866bc9380 0x556866bc7010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:54.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.442+0000 7f33d759e700 1 -- 172.21.15.82:0/4225427708 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556866bc3c40 msgr2=0x556866bcf7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:28:54.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.442+0000 7f33d759e700 1 --2- 172.21.15.82:0/4225427708 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556866bc3c40 0x556866bcf7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:54.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.442+0000 7f33d759e700 1 -- 172.21.15.82:0/4225427708 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556866becfd0 con 0x556866bc9ca0 2023-09-23T09:28:54.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.442+0000 7f33ce59c700 1 --2- 172.21.15.82:0/4225427708 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556866bc9380 0x556866bc7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:28:54.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.442+0000 7f33d759e700 1 --2- 172.21.15.82:0/4225427708 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556866bc9ca0 0x556866bc7550 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f33d000a010 tx=0x7f33d0000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd6769b16afdd567 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:28:54.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.443+0000 7f33cdd9b700 1 -- 172.21.15.82:0/4225427708 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d0026310 con 0x556866bc9ca0 2023-09-23T09:28:54.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.443+0000 7f33cdd9b700 1 -- 172.21.15.82:0/4225427708 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f33d004d070 con 0x556866bc9ca0 2023-09-23T09:28:54.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.443+0000 7f33cdd9b700 1 -- 172.21.15.82:0/4225427708 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d0003900 con 0x556866bc9ca0 2023-09-23T09:28:54.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.444+0000 7f33f0b77b80 1 -- 172.21.15.82:0/4225427708 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556866bc9ca0 msgr2=0x556866bc7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:28:54.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.444+0000 7f33f0b77b80 1 --2- 172.21.15.82:0/4225427708 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556866bc9ca0 0x556866bc7550 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f33d000a010 tx=0x7f33d0000bc0 comp rx=0 tx=0).stop 2023-09-23T09:28:54.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.449+0000 7f33f0b77b80 1 -- 172.21.15.82:0/4225427708 shutdown_connections 2023-09-23T09:28:54.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.449+0000 7f33f0b77b80 1 --2- 172.21.15.82:0/4225427708 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556866bc9ca0 0x556866bc7550 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:54.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.449+0000 7f33f0b77b80 1 --2- 172.21.15.82:0/4225427708 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556866bc3c40 0x556866bcf7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:54.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.449+0000 7f33f0b77b80 1 --2- 172.21.15.82:0/4225427708 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556866bc9380 0x556866bc7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:54.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.449+0000 7f33f0b77b80 1 -- 172.21.15.82:0/4225427708 >> 172.21.15.82:0/4225427708 conn(0x556866b380e0 msgr2=0x556866be2290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:28:54.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.449+0000 7f33f0b77b80 1 -- 172.21.15.82:0/4225427708 shutdown_connections 2023-09-23T09:28:54.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.450+0000 7f33f0b77b80 1 -- 172.21.15.82:0/4225427708 wait complete. 2023-09-23T09:28:54.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.450+0000 7f33f0b77b80 1 -- start start 2023-09-23T09:28:54.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.450+0000 7f33f0b77b80 1 Processor -- start 2023-09-23T09:28:54.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.453+0000 7f33f0b77b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556866bc3c40 0x556866bc6350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:54.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.454+0000 7f33f0b77b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556866bc9380 0x556866bc4da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:54.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.454+0000 7f33f0b77b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556866bc9ca0 0x556866bd84b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:54.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.454+0000 7f33f0b77b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x556866bc6890 con 0x556866bc9380 2023-09-23T09:28:54.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.454+0000 7f33f0b77b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x556866bc6a00 con 0x556866bc3c40 2023-09-23T09:28:54.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.454+0000 7f33f0b77b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x556866bc6bc0 con 0x556866bc9ca0 2023-09-23T09:28:54.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.454+0000 7f33f0b77b80 10 client.0 _ll_register_callbacks cb 0x7f33c0009bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:28:54.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.454+0000 7f33d759e700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556866bc9ca0 0x556866bd84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:54.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.454+0000 7f33d759e700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556866bc9ca0 0x556866bd84b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:36784/0 (socket says 172.21.15.82:36784) 2023-09-23T09:28:54.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.454+0000 7f33d759e700 1 -- 172.21.15.82:0/755309176 learned_addr learned my addr 172.21.15.82:0/755309176 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:28:54.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.454+0000 7f33d759e700 1 --2- 172.21.15.82:0/755309176 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556866bc3c40 0x556866bc6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:54.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.455+0000 7f33d759e700 1 -- 172.21.15.82:0/755309176 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556866bc3c40 msgr2=0x556866bc6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:28:54.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.455+0000 7f33d759e700 1 --2- 172.21.15.82:0/755309176 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556866bc3c40 0x556866bc6350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:54.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.455+0000 7f33d759e700 1 -- 172.21.15.82:0/755309176 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556866bc9380 msgr2=0x556866bc4da0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-23T09:28:54.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.456+0000 7f33d759e700 1 --2- 172.21.15.82:0/755309176 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556866bc9380 0x556866bc4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:54.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.456+0000 7f33d759e700 1 -- 172.21.15.82:0/755309176 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556866995630 con 0x556866bc9ca0 2023-09-23T09:28:54.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.456+0000 7f33d759e700 1 --2- 172.21.15.82:0/755309176 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556866bc9ca0 0x556866bd84b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f33d000e6b0 tx=0x7f33d0009230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7542cc8913fafb20 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:28:54.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.456+0000 7f33be7fc700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T09:28:54.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.456+0000 7f33be7fc700 1 -- 172.21.15.82:0/755309176 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d0026110 con 0x556866bc9ca0 2023-09-23T09:28:54.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.456+0000 7f33be7fc700 1 -- 172.21.15.82:0/755309176 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(139..139 src has 1..139) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f33d001d040 con 0x556866bc9ca0 2023-09-23T09:28:54.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.459+0000 7f33f0b77b80 1 -- 172.21.15.82:0/755309176 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556866bb68b0 con 0x556866bc9ca0 2023-09-23T09:28:54.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.459+0000 7f33be7fc700 1 -- 172.21.15.82:0/755309176 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f33d0026270 con 0x556866bc9ca0 2023-09-23T09:28:54.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.459+0000 7f33f0b77b80 10 client.27019 fetch_fsmap learned FSMap version 91 2023-09-23T09:28:54.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.459+0000 7f33f0b77b80 1 -- 172.21.15.82:0/755309176 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=4+}) v3 -- 0x55686692ac60 con 0x556866bc9ca0 2023-09-23T09:28:54.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.459+0000 7f33be7fc700 1 -- 172.21.15.82:0/755309176 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f33d0065030 con 0x556866bc9ca0 2023-09-23T09:28:54.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.460+0000 7f33be7fc700 1 -- 172.21.15.82:0/755309176 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 91) v1 ==== 7930+0+0 (secure 0 0 0) 0x7f33d00052a0 con 0x556866bc9ca0 2023-09-23T09:28:54.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.460+0000 7f33f0b77b80 10 client.27019 fetch_fsmap finished waiting for FSMap version 91 2023-09-23T09:28:54.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.460+0000 7f33f0b77b80 10 client.27019 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2023-09-23T09:28:54.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.460+0000 7f33f0b77b80 20 client.27019 populate_metadata read hostname 'smithi082' 2023-09-23T09:28:54.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.460+0000 7f33f0b77b80 1 --2- 172.21.15.82:0/755309176 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x556866c32440 0x556866c34860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:54.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.460+0000 7f33f0b77b80 4 client.27019 mds_command: new command op to 24515 tid=0[{"prefix": "damage ls"}] 2023-09-23T09:28:54.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.460+0000 7f33f0b77b80 1 -- 172.21.15.82:0/755309176 --> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x556866b0e970 con 0x556866c32440 2023-09-23T09:28:54.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.460+0000 7f33ce59c700 1 --2- 172.21.15.82:0/755309176 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x556866c32440 0x556866c34860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:54.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.461+0000 7f33ce59c700 1 --2- 172.21.15.82:0/755309176 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x556866c32440 0x556866c34860 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=2fd12703d96d0781 server_cookie=e1734dd52c2c37f6 in_seq=0 out_seq=0 2023-09-23T09:28:54.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.461+0000 7f33be7fc700 10 client.27019 ms_handle_connect on v2:172.21.15.135:6836/2655304858 2023-09-23T09:28:54.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.461+0000 7f33be7fc700 1 -- 172.21.15.82:0/755309176 <== mds.3 v2:172.21.15.135:6836/2655304858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x556866b0e970 con 0x556866c32440 2023-09-23T09:28:54.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.461+0000 7f33be7fc700 10 client.27019 handle_command_reply: tid=0 2023-09-23T09:28:54.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.461+0000 7f33f0b77b80 1 client.27019 shutdown 2023-09-23T09:28:54.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.462+0000 7f33f0b77b80 1 -- 172.21.15.82:0/755309176 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556866bc9ca0 msgr2=0x556866bd84b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:28:54.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.462+0000 7f33f0b77b80 1 --2- 172.21.15.82:0/755309176 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556866bc9ca0 0x556866bd84b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f33d000e6b0 tx=0x7f33d0009230 comp rx=0 tx=0).stop 2023-09-23T09:28:54.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.462+0000 7f33f0b77b80 1 -- 172.21.15.82:0/755309176 shutdown_connections 2023-09-23T09:28:54.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.462+0000 7f33f0b77b80 1 --2- 172.21.15.82:0/755309176 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x556866c32440 0x556866c34860 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:54.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.462+0000 7f33f0b77b80 1 --2- 172.21.15.82:0/755309176 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556866bc9ca0 0x556866bd84b0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:54.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.462+0000 7f33f0b77b80 1 --2- 172.21.15.82:0/755309176 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556866bc3c40 0x556866bc6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:54.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.462+0000 7f33f0b77b80 1 --2- 172.21.15.82:0/755309176 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556866bc9380 0x556866bc4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:54.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.462+0000 7f33f0b77b80 1 -- 172.21.15.82:0/755309176 >> 172.21.15.82:0/755309176 conn(0x556866b380e0 msgr2=0x556866bc7010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:28:54.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.462+0000 7f33be7fc700 0 client.27019 ms_handle_reset on v2:172.21.15.135:6836/2655304858 2023-09-23T09:28:54.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.462+0000 7f33f0b77b80 1 -- 172.21.15.82:0/755309176 shutdown_connections 2023-09-23T09:28:54.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.462+0000 7f33f0b77b80 1 -- 172.21.15.82:0/755309176 wait complete. 2023-09-23T09:28:54.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.463+0000 7f33f0b77b80 20 client.27019 trim_cache size 0 max 16384 2023-09-23T09:28:54.465 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2023-09-23T09:28:54.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.463+0000 7f33dd1ff700 1 -- 172.21.15.82:0/386090941 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f33c40a0250 msgr2=0x7f33c40a2710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:28:54.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.463+0000 7f33dd1ff700 1 --2- 172.21.15.82:0/386090941 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f33c40a0250 0x7f33c40a2710 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x556866bca100 tx=0x7f33c8009040 comp rx=0 tx=0).stop 2023-09-23T09:28:54.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.463+0000 7f33dd1ff700 1 -- 172.21.15.82:0/386090941 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33d80ff640 msgr2=0x7f33d8108380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:28:54.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.463+0000 7f33dd1ff700 1 --2- 172.21.15.82:0/386090941 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33d80ff640 0x7f33d8108380 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f33c800bd30 tx=0x7f33c800be10 comp rx=0 tx=0).stop 2023-09-23T09:28:54.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.464+0000 7f33dd1ff700 1 -- 172.21.15.82:0/386090941 shutdown_connections 2023-09-23T09:28:54.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.464+0000 7f33dd1ff700 1 --2- 172.21.15.82:0/386090941 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f33c40a0250 0x7f33c40a2710 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:54.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.464+0000 7f33dd1ff700 1 --2- 172.21.15.82:0/386090941 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f33d810d1f0 0x7f33d819c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:54.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.464+0000 7f33dd1ff700 1 --2- 172.21.15.82:0/386090941 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33d80ff640 0x7f33d8108380 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:54.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.464+0000 7f33dd1ff700 1 --2- 172.21.15.82:0/386090941 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33d80ffff0 0x7f33d81088c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:54.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.464+0000 7f33dd1ff700 1 -- 172.21.15.82:0/386090941 >> 172.21.15.82:0/386090941 conn(0x7f33d80fb270 msgr2=0x7f33d810f3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:28:54.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.464+0000 7f33dd1ff700 1 -- 172.21.15.82:0/386090941 shutdown_connections 2023-09-23T09:28:54.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.464+0000 7f33dd1ff700 1 -- 172.21.15.82:0/386090941 wait complete. 2023-09-23T09:28:54.492 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-09-23T09:28:54.778 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:28:54 smithi082 ceph-mon[97694]: pgmap v1013: 97 pgs: 97 active+clean; 16 GiB data, 52 GiB used, 1020 GiB / 1.0 TiB avail; 713 KiB/s rd, 15 MiB/s wr, 1.07k op/s 2023-09-23T09:28:54.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.888+0000 7fc9efbff700 1 -- 172.21.15.82:0/1702834884 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc9e810cfc0 msgr2=0x7fc9e810d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:28:54.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.888+0000 7fc9efbff700 1 --2- 172.21.15.82:0/1702834884 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc9e810cfc0 0x7fc9e810d3a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc9e4009990 tx=0x7fc9e4009ca0 comp rx=0 tx=0).stop 2023-09-23T09:28:54.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.888+0000 7fc9efbff700 1 -- 172.21.15.82:0/1702834884 shutdown_connections 2023-09-23T09:28:54.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.888+0000 7fc9efbff700 1 --2- 172.21.15.82:0/1702834884 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc9e8107a00 0x7fc9e8113d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:54.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.888+0000 7fc9efbff700 1 --2- 172.21.15.82:0/1702834884 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc9e810cfc0 0x7fc9e810d3a0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:54.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.888+0000 7fc9efbff700 1 --2- 172.21.15.82:0/1702834884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9e8107040 0x7fc9e81074c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:54.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.888+0000 7fc9efbff700 1 -- 172.21.15.82:0/1702834884 >> 172.21.15.82:0/1702834884 conn(0x7fc9e80767c0 msgr2=0x7fc9e8105740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:28:54.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.888+0000 7fc9efbff700 1 -- 172.21.15.82:0/1702834884 shutdown_connections 2023-09-23T09:28:54.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.889+0000 7fc9efbff700 1 -- 172.21.15.82:0/1702834884 wait complete. 2023-09-23T09:28:54.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.891+0000 7fc9efbff700 1 Processor -- start 2023-09-23T09:28:54.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.891+0000 7fc9efbff700 1 -- start start 2023-09-23T09:28:54.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.892+0000 7fc9efbff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc9e8107040 0x7fc9e807e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:54.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.892+0000 7fc9efbff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9e8107a00 0x7fc9e807ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:54.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.892+0000 7fc9efbff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc9e810cfc0 0x7fc9e8079b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:54.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.892+0000 7fc9efbff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e807a0e0 con 0x7fc9e8107a00 2023-09-23T09:28:54.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.892+0000 7fc9efbff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e807a250 con 0x7fc9e8107040 2023-09-23T09:28:54.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.892+0000 7fc9efbff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e807a410 con 0x7fc9e810cfc0 2023-09-23T09:28:54.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.893+0000 7fc9ed99b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc9e8107040 0x7fc9e807e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:54.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.893+0000 7fc9ed99b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc9e8107040 0x7fc9e807e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:60506/0 (socket says 172.21.15.82:60506) 2023-09-23T09:28:54.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.893+0000 7fc9ed99b700 1 -- 172.21.15.82:0/2988729069 learned_addr learned my addr 172.21.15.82:0/2988729069 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:28:54.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.893+0000 7fc9ee19c700 1 --2- 172.21.15.82:0/2988729069 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc9e810cfc0 0x7fc9e8079b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:54.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.894+0000 7fc9ed19a700 1 --2- 172.21.15.82:0/2988729069 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9e8107a00 0x7fc9e807ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:54.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.894+0000 7fc9ee19c700 1 -- 172.21.15.82:0/2988729069 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc9e8107040 msgr2=0x7fc9e807e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:28:54.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.894+0000 7fc9ee19c700 1 --2- 172.21.15.82:0/2988729069 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc9e8107040 0x7fc9e807e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:54.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.894+0000 7fc9ee19c700 1 -- 172.21.15.82:0/2988729069 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9e8107a00 msgr2=0x7fc9e807ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:28:54.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.894+0000 7fc9ee19c700 1 --2- 172.21.15.82:0/2988729069 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9e8107a00 0x7fc9e807ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:54.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.894+0000 7fc9ee19c700 1 -- 172.21.15.82:0/2988729069 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9e40095f0 con 0x7fc9e810cfc0 2023-09-23T09:28:54.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.894+0000 7fc9ed19a700 1 --2- 172.21.15.82:0/2988729069 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9e8107a00 0x7fc9e807ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T09:28:54.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.895+0000 7fc9ee19c700 1 --2- 172.21.15.82:0/2988729069 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc9e810cfc0 0x7fc9e8079b10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc9e000be00 tx=0x7fc9e000be30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:28:54.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.895+0000 7fc9deffd700 1 -- 172.21.15.82:0/2988729069 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e000cb30 con 0x7fc9e810cfc0 2023-09-23T09:28:54.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.895+0000 7fc9deffd700 1 -- 172.21.15.82:0/2988729069 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc9e000cc90 con 0x7fc9e810cfc0 2023-09-23T09:28:54.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.895+0000 7fc9deffd700 1 -- 172.21.15.82:0/2988729069 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e00125a0 con 0x7fc9e810cfc0 2023-09-23T09:28:54.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.897+0000 7fc9efbff700 1 -- 172.21.15.82:0/2988729069 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9e807a6f0 con 0x7fc9e810cfc0 2023-09-23T09:28:54.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.897+0000 7fc9efbff700 1 -- 172.21.15.82:0/2988729069 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9e807d860 con 0x7fc9e810cfc0 2023-09-23T09:28:54.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.902+0000 7fc9deffd700 1 -- 172.21.15.82:0/2988729069 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7fc9e0014440 con 0x7fc9e810cfc0 2023-09-23T09:28:54.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.904+0000 7fc9deffd700 1 --2- 172.21.15.82:0/2988729069 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fc9d40a0180 0x7fc9d40a2640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:54.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.905+0000 7fc9deffd700 1 -- 172.21.15.82:0/2988729069 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fc9e00cab30 con 0x7fc9e810cfc0 2023-09-23T09:28:54.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.905+0000 7fc9ed99b700 1 --2- 172.21.15.82:0/2988729069 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fc9d40a0180 0x7fc9d40a2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:54.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.907+0000 7fc9ed99b700 1 --2- 172.21.15.82:0/2988729069 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fc9d40a0180 0x7fc9d40a2640 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc9e400b5c0 tx=0x7fc9e4003680 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:28:54.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.909+0000 7fca034ccb80 1 Processor -- start 2023-09-23T09:28:54.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.910+0000 7fca034ccb80 1 -- start start 2023-09-23T09:28:54.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.910+0000 7fca034ccb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ba4651c380 0x55ba4651c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:54.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.910+0000 7fca034ccb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba4651cca0 0x55ba46516700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:54.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.910+0000 7fca034ccb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ba46516c40 0x55ba465170a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:54.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.910+0000 7fca034ccb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba4647e7b0 con 0x55ba4651cca0 2023-09-23T09:28:54.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.910+0000 7fca034ccb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba4646f780 con 0x55ba4651c380 2023-09-23T09:28:54.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.910+0000 7fca034ccb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba4646d0a0 con 0x55ba46516c40 2023-09-23T09:28:54.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.911+0000 7fc9ed99b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ba4651c380 0x55ba4651c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:54.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.911+0000 7fc9ed19a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba4651cca0 0x55ba46516700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:54.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.911+0000 7fc9ed99b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ba4651c380 0x55ba4651c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:60520/0 (socket says 172.21.15.82:60520) 2023-09-23T09:28:54.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.911+0000 7fc9ed99b700 1 -- 172.21.15.82:0/2855645287 learned_addr learned my addr 172.21.15.82:0/2855645287 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:28:54.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.911+0000 7fc9ee19c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ba46516c40 0x55ba465170a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:54.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.912+0000 7fc9ed99b700 1 -- 172.21.15.82:0/2855645287 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ba46516c40 msgr2=0x55ba465170a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:28:54.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.912+0000 7fc9ed99b700 1 --2- 172.21.15.82:0/2855645287 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ba46516c40 0x55ba465170a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:54.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.912+0000 7fc9ed99b700 1 -- 172.21.15.82:0/2855645287 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba4651cca0 msgr2=0x55ba46516700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:28:54.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.912+0000 7fc9ed99b700 1 --2- 172.21.15.82:0/2855645287 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba4651cca0 0x55ba46516700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:54.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.912+0000 7fc9ed99b700 1 -- 172.21.15.82:0/2855645287 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ba462e8630 con 0x55ba4651c380 2023-09-23T09:28:54.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.912+0000 7fc9ed99b700 1 --2- 172.21.15.82:0/2855645287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ba4651c380 0x55ba4651c760 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc9e40056a0 tx=0x7fc9e4020000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9dcc085d05442db server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:28:54.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.912+0000 7fc9d3fff700 1 -- 172.21.15.82:0/2855645287 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e402a070 con 0x55ba4651c380 2023-09-23T09:28:54.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.913+0000 7fc9d3fff700 1 -- 172.21.15.82:0/2855645287 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc9e401e040 con 0x55ba4651c380 2023-09-23T09:28:54.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.913+0000 7fc9d3fff700 1 -- 172.21.15.82:0/2855645287 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e4004500 con 0x55ba4651c380 2023-09-23T09:28:54.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.914+0000 7fca034ccb80 1 -- 172.21.15.82:0/2855645287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ba4651c380 msgr2=0x55ba4651c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:28:54.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.914+0000 7fca034ccb80 1 --2- 172.21.15.82:0/2855645287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ba4651c380 0x55ba4651c760 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc9e40056a0 tx=0x7fc9e4020000 comp rx=0 tx=0).stop 2023-09-23T09:28:54.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.914+0000 7fca034ccb80 1 -- 172.21.15.82:0/2855645287 shutdown_connections 2023-09-23T09:28:54.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.914+0000 7fca034ccb80 1 --2- 172.21.15.82:0/2855645287 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ba46516c40 0x55ba465170a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:54.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.914+0000 7fca034ccb80 1 --2- 172.21.15.82:0/2855645287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ba4651c380 0x55ba4651c760 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:54.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.914+0000 7fca034ccb80 1 --2- 172.21.15.82:0/2855645287 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba4651cca0 0x55ba46516700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:54.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.914+0000 7fca034ccb80 1 -- 172.21.15.82:0/2855645287 >> 172.21.15.82:0/2855645287 conn(0x55ba4648b0e0 msgr2=0x55ba46511410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:28:54.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.915+0000 7fca034ccb80 1 -- 172.21.15.82:0/2855645287 shutdown_connections 2023-09-23T09:28:54.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.915+0000 7fca034ccb80 1 -- 172.21.15.82:0/2855645287 wait complete. 2023-09-23T09:28:54.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.916+0000 7fca034ccb80 1 -- start start 2023-09-23T09:28:54.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.916+0000 7fca034ccb80 1 Processor -- start 2023-09-23T09:28:54.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.917+0000 7fca034ccb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ba46516c40 0x55ba46522c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:54.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.917+0000 7fca034ccb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba4651c380 0x55ba4651ff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:54.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.917+0000 7fca034ccb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ba4651cca0 0x55ba46520670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:54.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.917+0000 7fca034ccb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba46468990 con 0x55ba4651c380 2023-09-23T09:28:54.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.917+0000 7fca034ccb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba46406bb0 con 0x55ba4651cca0 2023-09-23T09:28:54.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.917+0000 7fca034ccb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba464068b0 con 0x55ba46516c40 2023-09-23T09:28:54.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.917+0000 7fca034ccb80 10 client.0 _ll_register_callbacks cb 0x55ba46350a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:28:54.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.918+0000 7fc9ee19c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ba4651cca0 0x55ba46520670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:54.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.918+0000 7fc9ee19c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ba4651cca0 0x55ba46520670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:60526/0 (socket says 172.21.15.82:60526) 2023-09-23T09:28:54.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.918+0000 7fc9ee19c700 1 -- 172.21.15.82:0/4013917265 learned_addr learned my addr 172.21.15.82:0/4013917265 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:28:54.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.918+0000 7fc9ed99b700 1 --2- 172.21.15.82:0/4013917265 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ba46516c40 0x55ba46522c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:54.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.918+0000 7fc9ee19c700 1 -- 172.21.15.82:0/4013917265 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ba46516c40 msgr2=0x55ba46522c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:28:54.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.918+0000 7fc9ee19c700 1 --2- 172.21.15.82:0/4013917265 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ba46516c40 0x55ba46522c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:54.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.918+0000 7fc9ee19c700 1 -- 172.21.15.82:0/4013917265 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba4651c380 msgr2=0x55ba4651ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:28:54.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.918+0000 7fc9ee19c700 1 --2- 172.21.15.82:0/4013917265 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba4651c380 0x55ba4651ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:54.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.918+0000 7fc9ee19c700 1 -- 172.21.15.82:0/4013917265 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9e8114650 con 0x55ba4651cca0 2023-09-23T09:28:54.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.919+0000 7fc9ee19c700 1 --2- 172.21.15.82:0/4013917265 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ba4651cca0 0x55ba46520670 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc9e00c8440 tx=0x7fc9e0098360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c045e1fb56ea82d server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:28:54.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.919+0000 7fc9d17fa700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-09-23T09:28:54.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.919+0000 7fc9d17fa700 1 -- 172.21.15.82:0/4013917265 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e00af070 con 0x55ba4651cca0 2023-09-23T09:28:54.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.919+0000 7fc9d17fa700 1 -- 172.21.15.82:0/4013917265 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(139..139 src has 1..139) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fc9e000ce00 con 0x55ba4651cca0 2023-09-23T09:28:54.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.919+0000 7fca034ccb80 1 -- 172.21.15.82:0/4013917265 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ba464e61c0 con 0x55ba4651cca0 2023-09-23T09:28:54.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.920+0000 7fc9d17fa700 1 -- 172.21.15.82:0/4013917265 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc9e0098720 con 0x55ba4651cca0 2023-09-23T09:28:54.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.926+0000 7fca034ccb80 10 client.26978 fetch_fsmap learned FSMap version 91 2023-09-23T09:28:54.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.926+0000 7fca034ccb80 1 -- 172.21.15.82:0/4013917265 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=4+}) v3 -- 0x55ba46294de0 con 0x55ba4651cca0 2023-09-23T09:28:54.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.927+0000 7fc9d17fa700 1 -- 172.21.15.82:0/4013917265 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55ba464e61c0 con 0x55ba4651cca0 2023-09-23T09:28:54.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.927+0000 7fc9d17fa700 1 -- 172.21.15.82:0/4013917265 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 91) v1 ==== 7930+0+0 (secure 0 0 0) 0x7fc9e00978b0 con 0x55ba4651cca0 2023-09-23T09:28:54.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.928+0000 7fca034ccb80 10 client.26978 fetch_fsmap finished waiting for FSMap version 91 2023-09-23T09:28:54.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.928+0000 7fca034ccb80 10 client.26978 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-09-23T09:28:54.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.928+0000 7fca034ccb80 20 client.26978 populate_metadata read hostname 'smithi082' 2023-09-23T09:28:54.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.928+0000 7fca034ccb80 1 --2- 172.21.15.82:0/4013917265 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x55ba46530700 0x55ba46532b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:54.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.928+0000 7fca034ccb80 4 client.26978 mds_command: new command op to 24526 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:28:54.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.928+0000 7fca034ccb80 1 -- 172.21.15.82:0/4013917265 --> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ba4640eba0 con 0x55ba46530700 2023-09-23T09:28:54.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.929+0000 7fc9ed99b700 1 --2- 172.21.15.82:0/4013917265 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x55ba46530700 0x55ba46532b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:54.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.930+0000 7fc9ed99b700 1 --2- 172.21.15.82:0/4013917265 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x55ba46530700 0x55ba46532b20 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=94b6f0e29a27ed0f server_cookie=76f2fa913876a4d1 in_seq=0 out_seq=0 2023-09-23T09:28:54.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.930+0000 7fc9d17fa700 10 client.26978 ms_handle_connect on v2:172.21.15.161:6836/43639843 2023-09-23T09:28:54.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.931+0000 7fc9d17fa700 1 -- 172.21.15.82:0/4013917265 <== mds.2 v2:172.21.15.161:6836/43639843 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55ba4640eba0 con 0x55ba46530700 2023-09-23T09:28:54.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.931+0000 7fc9d17fa700 10 client.26978 handle_command_reply: tid=0 2023-09-23T09:28:54.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.932+0000 7fca034ccb80 1 client.26978 shutdown 2023-09-23T09:28:54.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.932+0000 7fca034ccb80 1 -- 172.21.15.82:0/4013917265 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ba4651cca0 msgr2=0x55ba46520670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:28:54.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.932+0000 7fca034ccb80 1 --2- 172.21.15.82:0/4013917265 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ba4651cca0 0x55ba46520670 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc9e00c8440 tx=0x7fc9e0098360 comp rx=0 tx=0).stop 2023-09-23T09:28:54.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.933+0000 7fca034ccb80 1 -- 172.21.15.82:0/4013917265 shutdown_connections 2023-09-23T09:28:54.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.933+0000 7fca034ccb80 1 --2- 172.21.15.82:0/4013917265 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x55ba46530700 0x55ba46532b20 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:54.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.933+0000 7fca034ccb80 1 --2- 172.21.15.82:0/4013917265 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ba4651cca0 0x55ba46520670 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:54.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.933+0000 7fca034ccb80 1 --2- 172.21.15.82:0/4013917265 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ba46516c40 0x55ba46522c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:54.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.933+0000 7fca034ccb80 1 --2- 172.21.15.82:0/4013917265 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba4651c380 0x55ba4651ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:54.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.933+0000 7fca034ccb80 1 -- 172.21.15.82:0/4013917265 >> 172.21.15.82:0/4013917265 conn(0x55ba4648b0e0 msgr2=0x55ba4650bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:28:54.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.933+0000 7fc9d17fa700 0 client.26978 ms_handle_reset on v2:172.21.15.161:6836/43639843 2023-09-23T09:28:54.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.933+0000 7fca034ccb80 1 -- 172.21.15.82:0/4013917265 shutdown_connections 2023-09-23T09:28:54.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.934+0000 7fca034ccb80 1 -- 172.21.15.82:0/4013917265 wait complete. 2023-09-23T09:28:54.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.934+0000 7fca034ccb80 20 client.26978 trim_cache size 0 max 16384 2023-09-23T09:28:54.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.950+0000 7fca034ccb80 1 Processor -- start 2023-09-23T09:28:54.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.950+0000 7fca034ccb80 1 -- start start 2023-09-23T09:28:54.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.950+0000 7fca034ccb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ba46516c40 0x55ba46516700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:54.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.951+0000 7fca034ccb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba4651c380 0x55ba465110a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:54.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.951+0000 7fca034ccb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ba4651cca0 0x55ba4651a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:54.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.951+0000 7fca034ccb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba462ea920 con 0x55ba4651c380 2023-09-23T09:28:54.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.951+0000 7fca034ccb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba4650da40 con 0x55ba4651cca0 2023-09-23T09:28:54.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.951+0000 7fca034ccb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba4650dd00 con 0x55ba46516c40 2023-09-23T09:28:54.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.951+0000 7fc9ed19a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba4651c380 0x55ba465110a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:54.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.951+0000 7fc9ed19a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba4651c380 0x55ba465110a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43932/0 (socket says 172.21.15.82:43932) 2023-09-23T09:28:54.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.951+0000 7fc9ed19a700 1 -- 172.21.15.82:0/1038418721 learned_addr learned my addr 172.21.15.82:0/1038418721 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:28:54.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.951+0000 7fc9ed99b700 1 --2- 172.21.15.82:0/1038418721 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ba46516c40 0x55ba46516700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:54.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.951+0000 7fc9ee19c700 1 --2- 172.21.15.82:0/1038418721 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ba4651cca0 0x55ba4651a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:54.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.951+0000 7fc9ed99b700 1 -- 172.21.15.82:0/1038418721 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ba4651cca0 msgr2=0x55ba4651a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:28:54.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.951+0000 7fc9ed99b700 1 --2- 172.21.15.82:0/1038418721 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ba4651cca0 0x55ba4651a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:54.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.951+0000 7fc9ed99b700 1 -- 172.21.15.82:0/1038418721 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba4651c380 msgr2=0x55ba465110a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:28:54.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.951+0000 7fc9ed99b700 1 --2- 172.21.15.82:0/1038418721 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba4651c380 0x55ba465110a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:54.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.951+0000 7fc9ed99b700 1 -- 172.21.15.82:0/1038418721 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ba4627dc60 con 0x55ba46516c40 2023-09-23T09:28:54.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.952+0000 7fc9ed99b700 1 --2- 172.21.15.82:0/1038418721 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ba46516c40 0x55ba46516700 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc9e4005670 tx=0x7fc9e4027040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=66040b228edf905c server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:28:54.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.952+0000 7fc9dcbff700 1 -- 172.21.15.82:0/1038418721 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e402a040 con 0x55ba46516c40 2023-09-23T09:28:54.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.952+0000 7fc9dcbff700 1 -- 172.21.15.82:0/1038418721 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc9e401e040 con 0x55ba46516c40 2023-09-23T09:28:54.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.952+0000 7fc9dcbff700 1 -- 172.21.15.82:0/1038418721 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e40383c0 con 0x55ba46516c40 2023-09-23T09:28:54.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.953+0000 7fca034ccb80 1 -- 172.21.15.82:0/1038418721 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ba46516c40 msgr2=0x55ba46516700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:28:54.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.953+0000 7fca034ccb80 1 --2- 172.21.15.82:0/1038418721 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ba46516c40 0x55ba46516700 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc9e4005670 tx=0x7fc9e4027040 comp rx=0 tx=0).stop 2023-09-23T09:28:54.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.953+0000 7fca034ccb80 1 -- 172.21.15.82:0/1038418721 shutdown_connections 2023-09-23T09:28:54.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.953+0000 7fca034ccb80 1 --2- 172.21.15.82:0/1038418721 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ba4651cca0 0x55ba4651a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:54.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.953+0000 7fca034ccb80 1 --2- 172.21.15.82:0/1038418721 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ba46516c40 0x55ba46516700 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:54.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.953+0000 7fca034ccb80 1 --2- 172.21.15.82:0/1038418721 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba4651c380 0x55ba465110a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:54.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.953+0000 7fca034ccb80 1 -- 172.21.15.82:0/1038418721 >> 172.21.15.82:0/1038418721 conn(0x55ba4648b0e0 msgr2=0x55ba4652be90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:28:54.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.954+0000 7fca034ccb80 1 -- 172.21.15.82:0/1038418721 shutdown_connections 2023-09-23T09:28:54.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.954+0000 7fca034ccb80 1 -- 172.21.15.82:0/1038418721 wait complete. 2023-09-23T09:28:54.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.954+0000 7fca034ccb80 1 -- start start 2023-09-23T09:28:54.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.954+0000 7fca034ccb80 1 Processor -- start 2023-09-23T09:28:54.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.955+0000 7fca034ccb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ba46516c40 0x55ba46527740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:54.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.955+0000 7fca034ccb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ba4651c380 0x55ba46517e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:54.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.955+0000 7fca034ccb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba4651cca0 0x55ba46518340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:54.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.955+0000 7fca034ccb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba46518a10 con 0x55ba4651cca0 2023-09-23T09:28:54.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.955+0000 7fca034ccb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba46518b80 con 0x55ba46516c40 2023-09-23T09:28:54.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.955+0000 7fca034ccb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba46518d40 con 0x55ba4651c380 2023-09-23T09:28:54.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.955+0000 7fca034ccb80 10 client.0 _ll_register_callbacks cb 0x7fc9e0097ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:28:54.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.955+0000 7fc9ee19c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba4651cca0 0x55ba46518340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:54.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.955+0000 7fc9ee19c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba4651cca0 0x55ba46518340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43936/0 (socket says 172.21.15.82:43936) 2023-09-23T09:28:54.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.955+0000 7fc9ed19a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ba4651c380 0x55ba46517e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:54.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.955+0000 7fc9ee19c700 1 -- 172.21.15.82:0/3122680499 learned_addr learned my addr 172.21.15.82:0/3122680499 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:28:54.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.955+0000 7fc9ed99b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ba46516c40 0x55ba46527740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:54.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.956+0000 7fc9ee19c700 1 -- 172.21.15.82:0/3122680499 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ba4651c380 msgr2=0x55ba46517e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:28:54.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.956+0000 7fc9ee19c700 1 --2- 172.21.15.82:0/3122680499 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ba4651c380 0x55ba46517e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:54.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.956+0000 7fc9ee19c700 1 -- 172.21.15.82:0/3122680499 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ba46516c40 msgr2=0x55ba46527740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:28:54.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.956+0000 7fc9ee19c700 1 --2- 172.21.15.82:0/3122680499 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ba46516c40 0x55ba46527740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:54.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.956+0000 7fc9ee19c700 1 -- 172.21.15.82:0/3122680499 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ba462e8630 con 0x55ba4651cca0 2023-09-23T09:28:54.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.956+0000 7fc9ee19c700 1 --2- 172.21.15.82:0/3122680499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba4651cca0 0x55ba46518340 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fc9e0098240 tx=0x7fc9e0097ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5803df49ec62ca45 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:28:54.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.956+0000 7fc9d17fa700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:28:54.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.956+0000 7fc9d17fa700 1 -- 172.21.15.82:0/3122680499 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e00af070 con 0x55ba4651cca0 2023-09-23T09:28:54.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.956+0000 7fc9d17fa700 1 -- 172.21.15.82:0/3122680499 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(139..139 src has 1..139) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fc9e0098720 con 0x55ba4651cca0 2023-09-23T09:28:54.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.956+0000 7fca034ccb80 1 -- 172.21.15.82:0/3122680499 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ba465098b0 con 0x55ba4651cca0 2023-09-23T09:28:54.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.956+0000 7fc9d17fa700 1 -- 172.21.15.82:0/3122680499 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc9e009c0e0 con 0x55ba4651cca0 2023-09-23T09:28:54.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.956+0000 7fca034ccb80 10 client.17289 fetch_fsmap learned FSMap version 91 2023-09-23T09:28:54.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.956+0000 7fca034ccb80 1 -- 172.21.15.82:0/3122680499 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=4+}) v3 -- 0x55ba462bb250 con 0x55ba4651cca0 2023-09-23T09:28:54.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.957+0000 7fc9d17fa700 1 -- 172.21.15.82:0/3122680499 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc9e0080030 con 0x55ba4651cca0 2023-09-23T09:28:54.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.957+0000 7fc9d17fa700 1 -- 172.21.15.82:0/3122680499 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 91) v1 ==== 7930+0+0 (secure 0 0 0) 0x7fc9e00b01f0 con 0x55ba4651cca0 2023-09-23T09:28:54.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.957+0000 7fca034ccb80 10 client.17289 fetch_fsmap finished waiting for FSMap version 91 2023-09-23T09:28:54.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.957+0000 7fca034ccb80 10 client.17289 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-09-23T09:28:54.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.957+0000 7fca034ccb80 20 client.17289 populate_metadata read hostname 'smithi082' 2023-09-23T09:28:54.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.957+0000 7fca034ccb80 1 --2- 172.21.15.82:0/3122680499 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x55ba46595770 0x55ba46597b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:54.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.957+0000 7fca034ccb80 4 client.17289 mds_command: new command op to 24526 tid=0[{"prefix": "damage ls"}] 2023-09-23T09:28:54.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.957+0000 7fca034ccb80 1 -- 172.21.15.82:0/3122680499 --> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55ba46461970 con 0x55ba46595770 2023-09-23T09:28:54.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.957+0000 7fc9ed99b700 1 --2- 172.21.15.82:0/3122680499 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x55ba46595770 0x55ba46597b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:54.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.958+0000 7fc9d17fa700 10 client.17289 ms_handle_connect on v2:172.21.15.161:6836/43639843 2023-09-23T09:28:54.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.958+0000 7fc9ed99b700 1 --2- 172.21.15.82:0/3122680499 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x55ba46595770 0x55ba46597b60 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=89da8fe2b0d0d7eb server_cookie=4dfec36369a1bbdd in_seq=0 out_seq=0 2023-09-23T09:28:54.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.958+0000 7fc9d17fa700 1 -- 172.21.15.82:0/3122680499 <== mds.2 v2:172.21.15.161:6836/43639843 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55ba46461970 con 0x55ba46595770 2023-09-23T09:28:54.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.958+0000 7fc9d17fa700 10 client.17289 handle_command_reply: tid=0 2023-09-23T09:28:54.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.958+0000 7fca034ccb80 1 client.17289 shutdown 2023-09-23T09:28:54.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.958+0000 7fca034ccb80 1 -- 172.21.15.82:0/3122680499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba4651cca0 msgr2=0x55ba46518340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:28:54.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.958+0000 7fca034ccb80 1 --2- 172.21.15.82:0/3122680499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba4651cca0 0x55ba46518340 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fc9e0098240 tx=0x7fc9e0097ea0 comp rx=0 tx=0).stop 2023-09-23T09:28:54.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.959+0000 7fca034ccb80 1 -- 172.21.15.82:0/3122680499 shutdown_connections 2023-09-23T09:28:54.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.959+0000 7fca034ccb80 1 --2- 172.21.15.82:0/3122680499 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x55ba46595770 0x55ba46597b60 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:54.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.959+0000 7fca034ccb80 1 --2- 172.21.15.82:0/3122680499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba4651cca0 0x55ba46518340 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:54.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.959+0000 7fca034ccb80 1 --2- 172.21.15.82:0/3122680499 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ba46516c40 0x55ba46527740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:54.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.959+0000 7fc9d17fa700 0 client.17289 ms_handle_reset on v2:172.21.15.161:6836/43639843 2023-09-23T09:28:54.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.959+0000 7fca034ccb80 1 --2- 172.21.15.82:0/3122680499 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ba4651c380 0x55ba46517e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:54.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.959+0000 7fca034ccb80 1 -- 172.21.15.82:0/3122680499 >> 172.21.15.82:0/3122680499 conn(0x55ba4648b0e0 msgr2=0x55ba465110a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:28:54.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.959+0000 7fca034ccb80 1 -- 172.21.15.82:0/3122680499 shutdown_connections 2023-09-23T09:28:54.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.959+0000 7fca034ccb80 1 -- 172.21.15.82:0/3122680499 wait complete. 2023-09-23T09:28:54.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.960+0000 7fca034ccb80 20 client.17289 trim_cache size 0 max 16384 2023-09-23T09:28:54.964 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2023-09-23T09:28:54.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.960+0000 7fc9efbff700 1 -- 172.21.15.82:0/2988729069 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fc9d40a0180 msgr2=0x7fc9d40a2640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:28:54.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.960+0000 7fc9efbff700 1 --2- 172.21.15.82:0/2988729069 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fc9d40a0180 0x7fc9d40a2640 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc9e400b5c0 tx=0x7fc9e4003680 comp rx=0 tx=0).stop 2023-09-23T09:28:54.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.960+0000 7fc9efbff700 1 -- 172.21.15.82:0/2988729069 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc9e810cfc0 msgr2=0x7fc9e8079b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:28:54.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.960+0000 7fc9efbff700 1 --2- 172.21.15.82:0/2988729069 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc9e810cfc0 0x7fc9e8079b10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc9e000be00 tx=0x7fc9e000be30 comp rx=0 tx=0).stop 2023-09-23T09:28:54.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.961+0000 7fc9efbff700 1 -- 172.21.15.82:0/2988729069 shutdown_connections 2023-09-23T09:28:54.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.961+0000 7fc9efbff700 1 --2- 172.21.15.82:0/2988729069 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fc9d40a0180 0x7fc9d40a2640 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:54.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.961+0000 7fc9efbff700 1 --2- 172.21.15.82:0/2988729069 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc9e810cfc0 0x7fc9e8079b10 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:54.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.961+0000 7fc9efbff700 1 --2- 172.21.15.82:0/2988729069 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc9e8107040 0x7fc9e807e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:54.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.961+0000 7fc9efbff700 1 --2- 172.21.15.82:0/2988729069 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9e8107a00 0x7fc9e807ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:54.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.961+0000 7fc9efbff700 1 -- 172.21.15.82:0/2988729069 >> 172.21.15.82:0/2988729069 conn(0x7fc9e80767c0 msgr2=0x7fc9e8077720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:28:54.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.961+0000 7fc9efbff700 1 -- 172.21.15.82:0/2988729069 shutdown_connections 2023-09-23T09:28:54.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:54.961+0000 7fc9efbff700 1 -- 172.21.15.82:0/2988729069 wait complete. 2023-09-23T09:28:54.989 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-09-23T09:28:55.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:28:54 smithi135 ceph-mon[99205]: pgmap v1013: 97 pgs: 97 active+clean; 16 GiB data, 52 GiB used, 1020 GiB / 1.0 TiB avail; 713 KiB/s rd, 15 MiB/s wr, 1.07k op/s 2023-09-23T09:28:55.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:28:54 smithi161 ceph-mon[99580]: pgmap v1013: 97 pgs: 97 active+clean; 16 GiB data, 52 GiB used, 1020 GiB / 1.0 TiB avail; 713 KiB/s rd, 15 MiB/s wr, 1.07k op/s 2023-09-23T09:28:55.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.342+0000 7fa8e1dff700 1 -- 172.21.15.82:0/4140854148 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa8dc11a100 msgr2=0x7fa8dc11c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:28:55.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.342+0000 7fa8e1dff700 1 --2- 172.21.15.82:0/4140854148 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa8dc11a100 0x7fa8dc11c4f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa8d4009f90 tx=0x7fa8d400b330 comp rx=0 tx=0).stop 2023-09-23T09:28:55.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.344+0000 7fa8e1dff700 1 -- 172.21.15.82:0/4140854148 shutdown_connections 2023-09-23T09:28:55.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.344+0000 7fa8e1dff700 1 --2- 172.21.15.82:0/4140854148 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa8dc11a100 0x7fa8dc11c4f0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:55.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.344+0000 7fa8e1dff700 1 --2- 172.21.15.82:0/4140854148 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8dc10efd0 0x7fa8dc10cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:55.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.344+0000 7fa8e1dff700 1 --2- 172.21.15.82:0/4140854148 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8dc10f440 0x7fa8dc10d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:55.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.344+0000 7fa8e1dff700 1 -- 172.21.15.82:0/4140854148 >> 172.21.15.82:0/4140854148 conn(0x7fa8dc06cbe0 msgr2=0x7fa8dc06cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:28:55.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.345+0000 7fa8e1dff700 1 -- 172.21.15.82:0/4140854148 shutdown_connections 2023-09-23T09:28:55.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.345+0000 7fa8e1dff700 1 -- 172.21.15.82:0/4140854148 wait complete. 2023-09-23T09:28:55.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.346+0000 7fa8e1dff700 1 Processor -- start 2023-09-23T09:28:55.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.346+0000 7fa8e1dff700 1 -- start start 2023-09-23T09:28:55.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.347+0000 7fa8e1dff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8dc10efd0 0x7fa8dc1ab540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:55.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.347+0000 7fa8e1dff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8dc10f440 0x7fa8dc1aba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:55.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.347+0000 7fa8e1dff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa8dc11a100 0x7fa8dc1a55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:55.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.347+0000 7fa8e1dff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8dc1a5c20 con 0x7fa8dc10efd0 2023-09-23T09:28:55.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.347+0000 7fa8e1dff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8dc1a5d90 con 0x7fa8dc10f440 2023-09-23T09:28:55.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.347+0000 7fa8e1dff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8dc1a5f50 con 0x7fa8dc11a100 2023-09-23T09:28:55.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.348+0000 7fa8db7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8dc10efd0 0x7fa8dc1ab540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:55.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.348+0000 7fa8db7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8dc10efd0 0x7fa8dc1ab540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43964/0 (socket says 172.21.15.82:43964) 2023-09-23T09:28:55.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.348+0000 7fa8db7fe700 1 -- 172.21.15.82:0/2900222330 learned_addr learned my addr 172.21.15.82:0/2900222330 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:28:55.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.348+0000 7fa8dbfff700 1 --2- 172.21.15.82:0/2900222330 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa8dc11a100 0x7fa8dc1a55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:55.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.348+0000 7fa8db7fe700 1 -- 172.21.15.82:0/2900222330 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa8dc11a100 msgr2=0x7fa8dc1a55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:28:55.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.348+0000 7fa8db7fe700 1 --2- 172.21.15.82:0/2900222330 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa8dc11a100 0x7fa8dc1a55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:55.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.348+0000 7fa8db7fe700 1 -- 172.21.15.82:0/2900222330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8dc10f440 msgr2=0x7fa8dc1aba80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-23T09:28:55.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.348+0000 7fa8db7fe700 1 --2- 172.21.15.82:0/2900222330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8dc10f440 0x7fa8dc1aba80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:55.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.349+0000 7fa8db7fe700 1 -- 172.21.15.82:0/2900222330 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8d4009c40 con 0x7fa8dc10efd0 2023-09-23T09:28:55.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.349+0000 7fa8db7fe700 1 --2- 172.21.15.82:0/2900222330 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8dc10efd0 0x7fa8dc1ab540 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc00d980 tx=0x7fa8cc00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:28:55.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.350+0000 7fa8d8ff9700 1 -- 172.21.15.82:0/2900222330 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8cc009b40 con 0x7fa8dc10efd0 2023-09-23T09:28:55.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.350+0000 7fa8d8ff9700 1 -- 172.21.15.82:0/2900222330 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa8cc00de60 con 0x7fa8dc10efd0 2023-09-23T09:28:55.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.350+0000 7fa8d8ff9700 1 -- 172.21.15.82:0/2900222330 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8cc00f620 con 0x7fa8dc10efd0 2023-09-23T09:28:55.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.350+0000 7fa8e1dff700 1 -- 172.21.15.82:0/2900222330 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8dc1a6230 con 0x7fa8dc10efd0 2023-09-23T09:28:55.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.351+0000 7fa8e1dff700 1 -- 172.21.15.82:0/2900222330 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8dc10fac0 con 0x7fa8dc10efd0 2023-09-23T09:28:55.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.357+0000 7fa8f575eb80 1 Processor -- start 2023-09-23T09:28:55.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.360+0000 7fa8d8ff9700 1 -- 172.21.15.82:0/2900222330 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7fa8cc010460 con 0x7fa8dc10efd0 2023-09-23T09:28:55.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.365+0000 7fa8f575eb80 1 -- start start 2023-09-23T09:28:55.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.365+0000 7fa8f575eb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c3303b9380 0x55c3303b9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:55.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.365+0000 7fa8f575eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3303b9ca0 0x55c3303b3700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:55.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.365+0000 7fa8f575eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3303b3c40 0x55c3303b40a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:55.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.365+0000 7fa8f575eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c33031b7b0 con 0x55c3303b9ca0 2023-09-23T09:28:55.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.365+0000 7fa8f575eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c33030c780 con 0x55c3303b3c40 2023-09-23T09:28:55.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.365+0000 7fa8f575eb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c33030a0a0 con 0x55c3303b9380 2023-09-23T09:28:55.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.366+0000 7fa8daffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3303b3c40 0x55c3303b40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:55.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.366+0000 7fa8daffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3303b3c40 0x55c3303b40a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:60568/0 (socket says 172.21.15.82:60568) 2023-09-23T09:28:55.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.366+0000 7fa8daffd700 1 -- 172.21.15.82:0/1920077324 learned_addr learned my addr 172.21.15.82:0/1920077324 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:28:55.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.368+0000 7fa8d8ff9700 1 --2- 172.21.15.82:0/2900222330 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fa8c80a0210 0x7fa8c80a26d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:55.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.369+0000 7fa8d8ff9700 1 -- 172.21.15.82:0/2900222330 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fa8cc0cb400 con 0x7fa8dc10efd0 2023-09-23T09:28:55.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.370+0000 7fa8daffd700 1 -- 172.21.15.82:0/1920077324 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c3303b9380 msgr2=0x55c3303b9760 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-23T09:28:55.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.370+0000 7fa8daffd700 1 --2- 172.21.15.82:0/1920077324 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c3303b9380 0x55c3303b9760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:55.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.370+0000 7fa8daffd700 1 -- 172.21.15.82:0/1920077324 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3303b9ca0 msgr2=0x55c3303b3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:28:55.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.370+0000 7fa8daffd700 1 --2- 172.21.15.82:0/1920077324 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3303b9ca0 0x55c3303b3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:55.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.370+0000 7fa8daffd700 1 -- 172.21.15.82:0/1920077324 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c330185630 con 0x55c3303b3c40 2023-09-23T09:28:55.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.372+0000 7fa8daffd700 1 --2- 172.21.15.82:0/1920077324 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3303b3c40 0x55c3303b40a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa8c4009800 tx=0x7fa8c4009b10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46ac04a5f41b9913 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:28:55.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.372+0000 7fa8dbfff700 1 --2- 172.21.15.82:0/2900222330 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fa8c80a0210 0x7fa8c80a26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:55.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.373+0000 7fa8dbfff700 1 --2- 172.21.15.82:0/2900222330 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fa8c80a0210 0x7fa8c80a26d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc1ac240 tx=0x7fa8d40094f0 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:28:55.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.374+0000 7fa8d1ffb700 1 -- 172.21.15.82:0/1920077324 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c4011830 con 0x55c3303b3c40 2023-09-23T09:28:55.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.374+0000 7fa8d1ffb700 1 -- 172.21.15.82:0/1920077324 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa8c4011e20 con 0x55c3303b3c40 2023-09-23T09:28:55.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.374+0000 7fa8d1ffb700 1 -- 172.21.15.82:0/1920077324 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c400be00 con 0x55c3303b3c40 2023-09-23T09:28:55.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.375+0000 7fa8f575eb80 1 -- 172.21.15.82:0/1920077324 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3303b3c40 msgr2=0x55c3303b40a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:28:55.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.375+0000 7fa8f575eb80 1 --2- 172.21.15.82:0/1920077324 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3303b3c40 0x55c3303b40a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa8c4009800 tx=0x7fa8c4009b10 comp rx=0 tx=0).stop 2023-09-23T09:28:55.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.376+0000 7fa8f575eb80 1 -- 172.21.15.82:0/1920077324 shutdown_connections 2023-09-23T09:28:55.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.376+0000 7fa8f575eb80 1 --2- 172.21.15.82:0/1920077324 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3303b3c40 0x55c3303b40a0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:55.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.376+0000 7fa8f575eb80 1 --2- 172.21.15.82:0/1920077324 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c3303b9380 0x55c3303b9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:55.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.376+0000 7fa8f575eb80 1 --2- 172.21.15.82:0/1920077324 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3303b9ca0 0x55c3303b3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:55.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.376+0000 7fa8f575eb80 1 -- 172.21.15.82:0/1920077324 >> 172.21.15.82:0/1920077324 conn(0x55c3303280e0 msgr2=0x55c3303ae410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:28:55.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.376+0000 7fa8f575eb80 1 -- 172.21.15.82:0/1920077324 shutdown_connections 2023-09-23T09:28:55.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.376+0000 7fa8f575eb80 1 -- 172.21.15.82:0/1920077324 wait complete. 2023-09-23T09:28:55.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.377+0000 7fa8f575eb80 1 -- start start 2023-09-23T09:28:55.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.377+0000 7fa8f575eb80 1 Processor -- start 2023-09-23T09:28:55.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.378+0000 7fa8f575eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3303b3c40 0x55c3303bd000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:55.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.378+0000 7fa8f575eb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c3303b9380 0x55c3303bd540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:55.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.378+0000 7fa8f575eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3303b9ca0 0x55c3303bda80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:55.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.378+0000 7fa8f575eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c330305990 con 0x55c3303b9ca0 2023-09-23T09:28:55.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.378+0000 7fa8f575eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3302a3bb0 con 0x55c3303b3c40 2023-09-23T09:28:55.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.378+0000 7fa8f575eb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3302a38b0 con 0x55c3303b9380 2023-09-23T09:28:55.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.378+0000 7fa8f575eb80 10 client.0 _ll_register_callbacks cb 0x55c3301eda80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:28:55.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.378+0000 7fa8daffd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c3303b9380 0x55c3303bd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:55.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.378+0000 7fa8db7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3303b3c40 0x55c3303bd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:55.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.378+0000 7fa8db7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3303b3c40 0x55c3303bd000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:60574/0 (socket says 172.21.15.82:60574) 2023-09-23T09:28:55.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.378+0000 7fa8db7fe700 1 -- 172.21.15.82:0/1613103710 learned_addr learned my addr 172.21.15.82:0/1613103710 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:28:55.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.379+0000 7fa8dbfff700 1 --2- 172.21.15.82:0/1613103710 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3303b9ca0 0x55c3303bda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:55.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.379+0000 7fa8db7fe700 1 -- 172.21.15.82:0/1613103710 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c3303b9380 msgr2=0x55c3303bd540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:28:55.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.379+0000 7fa8db7fe700 1 --2- 172.21.15.82:0/1613103710 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c3303b9380 0x55c3303bd540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:55.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.379+0000 7fa8db7fe700 1 -- 172.21.15.82:0/1613103710 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3303b9ca0 msgr2=0x55c3303bda80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:28:55.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.379+0000 7fa8db7fe700 1 --2- 172.21.15.82:0/1613103710 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3303b9ca0 0x55c3303bda80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:55.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.379+0000 7fa8db7fe700 1 -- 172.21.15.82:0/1613103710 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8c4009430 con 0x55c3303b3c40 2023-09-23T09:28:55.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.379+0000 7fa8db7fe700 1 --2- 172.21.15.82:0/1613103710 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3303b3c40 0x55c3303bd000 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc0987b0 tx=0x7fa8cc098500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3335e4c9e1a83838 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:28:55.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.379+0000 7fa8baffd700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-09-23T09:28:55.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.380+0000 7fa8baffd700 1 -- 172.21.15.82:0/1613103710 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8cc010910 con 0x55c3303b3c40 2023-09-23T09:28:55.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.380+0000 7fa8baffd700 1 -- 172.21.15.82:0/1613103710 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(139..139 src has 1..139) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fa8cc09c8e0 con 0x55c3303b3c40 2023-09-23T09:28:55.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.380+0000 7fa8f575eb80 1 -- 172.21.15.82:0/1613103710 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c3303831c0 con 0x55c3303b3c40 2023-09-23T09:28:55.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.380+0000 7fa8baffd700 1 -- 172.21.15.82:0/1613103710 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa8cc0a08c0 con 0x55c3303b3c40 2023-09-23T09:28:55.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.380+0000 7fa8f575eb80 10 client.26993 fetch_fsmap learned FSMap version 91 2023-09-23T09:28:55.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.380+0000 7fa8f575eb80 1 -- 172.21.15.82:0/1613103710 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=4+}) v3 -- 0x55c330131de0 con 0x55c3303b3c40 2023-09-23T09:28:55.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.381+0000 7fa8baffd700 1 -- 172.21.15.82:0/1613103710 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55c3303831c0 con 0x55c3303b3c40 2023-09-23T09:28:55.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.381+0000 7fa8baffd700 1 -- 172.21.15.82:0/1613103710 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 91) v1 ==== 7930+0+0 (secure 0 0 0) 0x7fa8cc097fa0 con 0x55c3303b3c40 2023-09-23T09:28:55.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.381+0000 7fa8f575eb80 10 client.26993 fetch_fsmap finished waiting for FSMap version 91 2023-09-23T09:28:55.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.381+0000 7fa8f575eb80 10 client.26993 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-23T09:28:55.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.381+0000 7fa8f575eb80 20 client.26993 populate_metadata read hostname 'smithi082' 2023-09-23T09:28:55.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.381+0000 7fa8f575eb80 1 --2- 172.21.15.82:0/1613103710 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x55c3303cd850 0x55c3303cfc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:55.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.381+0000 7fa8f575eb80 4 client.26993 mds_command: new command op to 24550 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:28:55.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.381+0000 7fa8f575eb80 1 -- 172.21.15.82:0/1613103710 --> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c3302abba0 con 0x55c3303cd850 2023-09-23T09:28:55.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.382+0000 7fa8daffd700 1 --2- 172.21.15.82:0/1613103710 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x55c3303cd850 0x55c3303cfc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:55.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.384+0000 7fa8baffd700 10 client.26993 ms_handle_connect on v2:172.21.15.161:6838/758982817 2023-09-23T09:28:55.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.384+0000 7fa8daffd700 1 --2- 172.21.15.82:0/1613103710 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x55c3303cd850 0x55c3303cfc70 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3dc41d1eb5980a9e server_cookie=833448102dff56c0 in_seq=0 out_seq=0 2023-09-23T09:28:55.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.384+0000 7fa8baffd700 1 -- 172.21.15.82:0/1613103710 <== mds.1 v2:172.21.15.161:6838/758982817 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c3302abba0 con 0x55c3303cd850 2023-09-23T09:28:55.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.384+0000 7fa8baffd700 10 client.26993 handle_command_reply: tid=0 2023-09-23T09:28:55.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.385+0000 7fa8f575eb80 1 client.26993 shutdown 2023-09-23T09:28:55.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.386+0000 7fa8f575eb80 1 -- 172.21.15.82:0/1613103710 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3303b3c40 msgr2=0x55c3303bd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:28:55.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.386+0000 7fa8f575eb80 1 --2- 172.21.15.82:0/1613103710 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3303b3c40 0x55c3303bd000 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc0987b0 tx=0x7fa8cc098500 comp rx=0 tx=0).stop 2023-09-23T09:28:55.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.386+0000 7fa8f575eb80 1 -- 172.21.15.82:0/1613103710 shutdown_connections 2023-09-23T09:28:55.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.386+0000 7fa8f575eb80 1 --2- 172.21.15.82:0/1613103710 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x55c3303cd850 0x55c3303cfc70 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:55.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.386+0000 7fa8f575eb80 1 --2- 172.21.15.82:0/1613103710 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3303b9ca0 0x55c3303bda80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:55.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.386+0000 7fa8f575eb80 1 --2- 172.21.15.82:0/1613103710 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3303b3c40 0x55c3303bd000 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:55.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.386+0000 7fa8f575eb80 1 --2- 172.21.15.82:0/1613103710 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c3303b9380 0x55c3303bd540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:55.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.386+0000 7fa8baffd700 0 client.26993 ms_handle_reset on v2:172.21.15.161:6838/758982817 2023-09-23T09:28:55.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.386+0000 7fa8f575eb80 1 -- 172.21.15.82:0/1613103710 >> 172.21.15.82:0/1613103710 conn(0x55c3303280e0 msgr2=0x55c3303a8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:28:55.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.388+0000 7fa8f575eb80 1 -- 172.21.15.82:0/1613103710 shutdown_connections 2023-09-23T09:28:55.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.388+0000 7fa8f575eb80 1 -- 172.21.15.82:0/1613103710 wait complete. 2023-09-23T09:28:55.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.388+0000 7fa8f575eb80 20 client.26993 trim_cache size 0 max 16384 2023-09-23T09:28:55.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.414+0000 7fa8f575eb80 1 Processor -- start 2023-09-23T09:28:55.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.416+0000 7fa8f575eb80 1 -- start start 2023-09-23T09:28:55.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.416+0000 7fa8f575eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3303b3c40 0x55c3303b3700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:55.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.416+0000 7fa8f575eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3303b9380 0x55c3303c47a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:55.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.416+0000 7fa8f575eb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c3303b9ca0 0x55c3303b80e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:55.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.416+0000 7fa8f575eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c330187920 con 0x55c3303b3c40 2023-09-23T09:28:55.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.416+0000 7fa8f575eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3303cae60 con 0x55c3303b9380 2023-09-23T09:28:55.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.416+0000 7fa8f575eb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3303aac80 con 0x55c3303b9ca0 2023-09-23T09:28:55.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.417+0000 7fa8db7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3303b3c40 0x55c3303b3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:55.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.417+0000 7fa8db7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3303b3c40 0x55c3303b3700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44004/0 (socket says 172.21.15.82:44004) 2023-09-23T09:28:55.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.417+0000 7fa8db7fe700 1 -- 172.21.15.82:0/37243381 learned_addr learned my addr 172.21.15.82:0/37243381 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:28:55.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.417+0000 7fa8daffd700 1 --2- 172.21.15.82:0/37243381 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3303b9380 0x55c3303c47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:55.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.417+0000 7fa8dbfff700 1 --2- 172.21.15.82:0/37243381 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c3303b9ca0 0x55c3303b80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:55.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.417+0000 7fa8db7fe700 1 -- 172.21.15.82:0/37243381 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c3303b9ca0 msgr2=0x55c3303b80e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:28:55.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.417+0000 7fa8db7fe700 1 --2- 172.21.15.82:0/37243381 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c3303b9ca0 0x55c3303b80e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:55.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.417+0000 7fa8db7fe700 1 -- 172.21.15.82:0/37243381 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3303b9380 msgr2=0x55c3303c47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:28:55.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.417+0000 7fa8db7fe700 1 --2- 172.21.15.82:0/37243381 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3303b9380 0x55c3303c47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:55.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.417+0000 7fa8db7fe700 1 -- 172.21.15.82:0/37243381 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c3303d4860 con 0x55c3303b3c40 2023-09-23T09:28:55.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.418+0000 7fa8db7fe700 1 --2- 172.21.15.82:0/37243381 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3303b3c40 0x55c3303b3700 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc094fb0 tx=0x7fa8cc097060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82e824aea1e237c3 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:28:55.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.419+0000 7fa8d27fc700 1 -- 172.21.15.82:0/37243381 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8cc09c8e0 con 0x55c3303b3c40 2023-09-23T09:28:55.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.419+0000 7fa8d27fc700 1 -- 172.21.15.82:0/37243381 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa8cc0a08c0 con 0x55c3303b3c40 2023-09-23T09:28:55.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.419+0000 7fa8d27fc700 1 -- 172.21.15.82:0/37243381 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8cc0a0570 con 0x55c3303b3c40 2023-09-23T09:28:55.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.419+0000 7fa8f575eb80 1 -- 172.21.15.82:0/37243381 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3303b3c40 msgr2=0x55c3303b3700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:28:55.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.419+0000 7fa8f575eb80 1 --2- 172.21.15.82:0/37243381 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3303b3c40 0x55c3303b3700 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc094fb0 tx=0x7fa8cc097060 comp rx=0 tx=0).stop 2023-09-23T09:28:55.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.420+0000 7fa8f575eb80 1 -- 172.21.15.82:0/37243381 shutdown_connections 2023-09-23T09:28:55.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.420+0000 7fa8f575eb80 1 --2- 172.21.15.82:0/37243381 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c3303b9ca0 0x55c3303b80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:55.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.420+0000 7fa8f575eb80 1 --2- 172.21.15.82:0/37243381 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3303b3c40 0x55c3303b3700 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:55.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.420+0000 7fa8f575eb80 1 --2- 172.21.15.82:0/37243381 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3303b9380 0x55c3303c47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:55.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.420+0000 7fa8f575eb80 1 -- 172.21.15.82:0/37243381 >> 172.21.15.82:0/37243381 conn(0x55c3303280e0 msgr2=0x55c3303b7190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:28:55.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.420+0000 7fa8f575eb80 1 -- 172.21.15.82:0/37243381 shutdown_connections 2023-09-23T09:28:55.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.420+0000 7fa8f575eb80 1 -- 172.21.15.82:0/37243381 wait complete. 2023-09-23T09:28:55.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.420+0000 7fa8f575eb80 1 -- start start 2023-09-23T09:28:55.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.421+0000 7fa8f575eb80 1 Processor -- start 2023-09-23T09:28:55.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.421+0000 7fa8f575eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3303b3c40 0x55c33041a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:55.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.421+0000 7fa8f575eb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c3303b9380 0x55c33041a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:55.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.421+0000 7fa8f575eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3303b9ca0 0x55c3303c3d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:55.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.421+0000 7fa8f575eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3303c4310 con 0x55c3303b9ca0 2023-09-23T09:28:55.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.421+0000 7fa8f575eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3303c4480 con 0x55c3303b3c40 2023-09-23T09:28:55.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.421+0000 7fa8f575eb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3303c4640 con 0x55c3303b9380 2023-09-23T09:28:55.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.421+0000 7fa8f575eb80 10 client.0 _ll_register_callbacks cb 0x7fa8cc098970 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:28:55.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.422+0000 7fa8db7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3303b3c40 0x55c33041a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:55.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.422+0000 7fa8db7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3303b3c40 0x55c33041a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:60588/0 (socket says 172.21.15.82:60588) 2023-09-23T09:28:55.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.422+0000 7fa8db7fe700 1 -- 172.21.15.82:0/2934548113 learned_addr learned my addr 172.21.15.82:0/2934548113 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:28:55.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.422+0000 7fa8daffd700 1 --2- 172.21.15.82:0/2934548113 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c3303b9380 0x55c33041a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:55.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.422+0000 7fa8db7fe700 1 -- 172.21.15.82:0/2934548113 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c3303b9380 msgr2=0x55c33041a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:28:55.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.422+0000 7fa8dbfff700 1 --2- 172.21.15.82:0/2934548113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3303b9ca0 0x55c3303c3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:55.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.422+0000 7fa8db7fe700 1 --2- 172.21.15.82:0/2934548113 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c3303b9380 0x55c33041a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:55.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.422+0000 7fa8db7fe700 1 -- 172.21.15.82:0/2934548113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3303b9ca0 msgr2=0x55c3303c3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:28:55.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.422+0000 7fa8db7fe700 1 --2- 172.21.15.82:0/2934548113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3303b9ca0 0x55c3303c3d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:55.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.422+0000 7fa8db7fe700 1 -- 172.21.15.82:0/2934548113 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c330131de0 con 0x55c3303b3c40 2023-09-23T09:28:55.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.422+0000 7fa8daffd700 1 --2- 172.21.15.82:0/2934548113 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c3303b9380 0x55c33041a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T09:28:55.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.423+0000 7fa8dbfff700 1 --2- 172.21.15.82:0/2934548113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3303b9ca0 0x55c3303c3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T09:28:55.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.423+0000 7fa8db7fe700 1 --2- 172.21.15.82:0/2934548113 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3303b3c40 0x55c33041a090 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc095520 tx=0x7fa8cc00dfd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83b6e0c9a7e66965 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:28:55.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.423+0000 7fa8baffd700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-09-23T09:28:55.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.423+0000 7fa8baffd700 1 -- 172.21.15.82:0/2934548113 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8cc09c8e0 con 0x55c3303b3c40 2023-09-23T09:28:55.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.423+0000 7fa8baffd700 1 -- 172.21.15.82:0/2934548113 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(139..139 src has 1..139) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fa8cc0c2ca0 con 0x55c3303b3c40 2023-09-23T09:28:55.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.423+0000 7fa8f575eb80 1 -- 172.21.15.82:0/2934548113 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c3303a68b0 con 0x55c3303b3c40 2023-09-23T09:28:55.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.423+0000 7fa8baffd700 1 -- 172.21.15.82:0/2934548113 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa8cc0c2e60 con 0x55c3303b3c40 2023-09-23T09:28:55.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.423+0000 7fa8f575eb80 10 client.26999 fetch_fsmap learned FSMap version 91 2023-09-23T09:28:55.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.423+0000 7fa8f575eb80 1 -- 172.21.15.82:0/2934548113 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=4+}) v3 -- 0x55c33011ac60 con 0x55c3303b3c40 2023-09-23T09:28:55.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.424+0000 7fa8baffd700 1 -- 172.21.15.82:0/2934548113 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55c3303a68b0 con 0x55c3303b3c40 2023-09-23T09:28:55.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.424+0000 7fa8baffd700 1 -- 172.21.15.82:0/2934548113 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 91) v1 ==== 7930+0+0 (secure 0 0 0) 0x7fa8cc099ac0 con 0x55c3303b3c40 2023-09-23T09:28:55.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.424+0000 7fa8f575eb80 10 client.26999 fetch_fsmap finished waiting for FSMap version 91 2023-09-23T09:28:55.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.424+0000 7fa8f575eb80 10 client.26999 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-23T09:28:55.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.424+0000 7fa8f575eb80 20 client.26999 populate_metadata read hostname 'smithi082' 2023-09-23T09:28:55.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.424+0000 7fa8f575eb80 1 --2- 172.21.15.82:0/2934548113 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x55c330421ab0 0x55c330423ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:55.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.424+0000 7fa8f575eb80 4 client.26999 mds_command: new command op to 24550 tid=0[{"prefix": "damage ls"}] 2023-09-23T09:28:55.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.424+0000 7fa8f575eb80 1 -- 172.21.15.82:0/2934548113 --> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55c3302fe970 con 0x55c330421ab0 2023-09-23T09:28:55.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.425+0000 7fa8daffd700 1 --2- 172.21.15.82:0/2934548113 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x55c330421ab0 0x55c330423ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:55.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.429+0000 7fa8daffd700 1 --2- 172.21.15.82:0/2934548113 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x55c330421ab0 0x55c330423ed0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=74863dba6066072e server_cookie=90d22e7dea8e4a84 in_seq=0 out_seq=0 2023-09-23T09:28:55.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.429+0000 7fa8baffd700 10 client.26999 ms_handle_connect on v2:172.21.15.161:6838/758982817 2023-09-23T09:28:55.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.429+0000 7fa8baffd700 1 -- 172.21.15.82:0/2934548113 <== mds.1 v2:172.21.15.161:6838/758982817 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55c3302fe970 con 0x55c330421ab0 2023-09-23T09:28:55.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.429+0000 7fa8baffd700 10 client.26999 handle_command_reply: tid=0 2023-09-23T09:28:55.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.429+0000 7fa8f575eb80 1 client.26999 shutdown 2023-09-23T09:28:55.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.431+0000 7fa8f575eb80 1 -- 172.21.15.82:0/2934548113 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3303b3c40 msgr2=0x55c33041a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:28:55.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.431+0000 7fa8f575eb80 1 --2- 172.21.15.82:0/2934548113 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3303b3c40 0x55c33041a090 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc095520 tx=0x7fa8cc00dfd0 comp rx=0 tx=0).stop 2023-09-23T09:28:55.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.432+0000 7fa8f575eb80 1 -- 172.21.15.82:0/2934548113 shutdown_connections 2023-09-23T09:28:55.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.432+0000 7fa8f575eb80 1 --2- 172.21.15.82:0/2934548113 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x55c330421ab0 0x55c330423ed0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:55.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.432+0000 7fa8f575eb80 1 --2- 172.21.15.82:0/2934548113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3303b9ca0 0x55c3303c3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:55.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.432+0000 7fa8f575eb80 1 --2- 172.21.15.82:0/2934548113 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3303b3c40 0x55c33041a090 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:55.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.432+0000 7fa8f575eb80 1 --2- 172.21.15.82:0/2934548113 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c3303b9380 0x55c33041a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:55.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.432+0000 7fa8f575eb80 1 -- 172.21.15.82:0/2934548113 >> 172.21.15.82:0/2934548113 conn(0x55c3303280e0 msgr2=0x55c3303b80e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:28:55.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.432+0000 7fa8baffd700 0 client.26999 ms_handle_reset on v2:172.21.15.161:6838/758982817 2023-09-23T09:28:55.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.432+0000 7fa8f575eb80 1 -- 172.21.15.82:0/2934548113 shutdown_connections 2023-09-23T09:28:55.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.432+0000 7fa8f575eb80 1 -- 172.21.15.82:0/2934548113 wait complete. 2023-09-23T09:28:55.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.433+0000 7fa8f575eb80 20 client.26999 trim_cache size 0 max 16384 2023-09-23T09:28:55.435 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2023-09-23T09:28:55.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.435+0000 7fa8e1dff700 1 -- 172.21.15.82:0/2900222330 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fa8c80a0210 msgr2=0x7fa8c80a26d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:28:55.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.435+0000 7fa8e1dff700 1 --2- 172.21.15.82:0/2900222330 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fa8c80a0210 0x7fa8c80a26d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc1ac240 tx=0x7fa8d40094f0 comp rx=0 tx=0).stop 2023-09-23T09:28:55.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.435+0000 7fa8e1dff700 1 -- 172.21.15.82:0/2900222330 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8dc10efd0 msgr2=0x7fa8dc1ab540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:28:55.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.435+0000 7fa8e1dff700 1 --2- 172.21.15.82:0/2900222330 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8dc10efd0 0x7fa8dc1ab540 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc00d980 tx=0x7fa8cc00dd40 comp rx=0 tx=0).stop 2023-09-23T09:28:55.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.436+0000 7fa8e1dff700 1 -- 172.21.15.82:0/2900222330 shutdown_connections 2023-09-23T09:28:55.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.436+0000 7fa8e1dff700 1 --2- 172.21.15.82:0/2900222330 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fa8c80a0210 0x7fa8c80a26d0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:55.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.436+0000 7fa8e1dff700 1 --2- 172.21.15.82:0/2900222330 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa8dc11a100 0x7fa8dc1a55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:55.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.436+0000 7fa8e1dff700 1 --2- 172.21.15.82:0/2900222330 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8dc10efd0 0x7fa8dc1ab540 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:55.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.436+0000 7fa8e1dff700 1 --2- 172.21.15.82:0/2900222330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8dc10f440 0x7fa8dc1aba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:55.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.436+0000 7fa8e1dff700 1 -- 172.21.15.82:0/2900222330 >> 172.21.15.82:0/2900222330 conn(0x7fa8dc06cbe0 msgr2=0x7fa8dc1180f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:28:55.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.436+0000 7fa8e1dff700 1 -- 172.21.15.82:0/2900222330 shutdown_connections 2023-09-23T09:28:55.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.436+0000 7fa8e1dff700 1 -- 172.21.15.82:0/2900222330 wait complete. 2023-09-23T09:28:55.484 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-09-23T09:28:55.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 105.0 s, 489.0 tps, lat 241.748 ms stddev 594.515 2023-09-23T09:28:55.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.849+0000 7f585e1ff700 1 -- 172.21.15.82:0/1931211882 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5858103460 msgr2=0x7f585810f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:28:55.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.849+0000 7f585e1ff700 1 --2- 172.21.15.82:0/1931211882 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5858103460 0x7f585810f970 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f5848009990 tx=0x7f5848009ca0 comp rx=0 tx=0).stop 2023-09-23T09:28:55.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.849+0000 7f585e1ff700 1 -- 172.21.15.82:0/1931211882 shutdown_connections 2023-09-23T09:28:55.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.849+0000 7f585e1ff700 1 --2- 172.21.15.82:0/1931211882 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5858103460 0x7f585810f970 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:55.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.849+0000 7f585e1ff700 1 --2- 172.21.15.82:0/1931211882 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5858108ab0 0x7f5858108e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:55.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.849+0000 7f585e1ff700 1 --2- 172.21.15.82:0/1931211882 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5858102aa0 0x7f5858102f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:55.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.849+0000 7f585e1ff700 1 -- 172.21.15.82:0/1931211882 >> 172.21.15.82:0/1931211882 conn(0x7f58580fe590 msgr2=0x7f58581009b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:28:55.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.853+0000 7f585e1ff700 1 -- 172.21.15.82:0/1931211882 shutdown_connections 2023-09-23T09:28:55.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.855+0000 7f585e1ff700 1 -- 172.21.15.82:0/1931211882 wait complete. 2023-09-23T09:28:55.858 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.856+0000 7f585e1ff700 1 Processor -- start 2023-09-23T09:28:55.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.857+0000 7f585e1ff700 1 -- start start 2023-09-23T09:28:55.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.857+0000 7f585e1ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5858102aa0 0x7f585810f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:55.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.857+0000 7f585e1ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5858103460 0x7f585810d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:55.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.857+0000 7f585e1ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5858108ab0 0x7f585810dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:55.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.857+0000 7f585e1ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f585810e2f0 con 0x7f5858108ab0 2023-09-23T09:28:55.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.857+0000 7f585e1ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f585810e460 con 0x7f5858103460 2023-09-23T09:28:55.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.857+0000 7f585e1ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f585806a340 con 0x7f5858102aa0 2023-09-23T09:28:55.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.858+0000 7f5856ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5858103460 0x7f585810d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:55.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.858+0000 7f5856ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5858103460 0x7f585810d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:60614/0 (socket says 172.21.15.82:60614) 2023-09-23T09:28:55.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.858+0000 7f5856ffd700 1 -- 172.21.15.82:0/2791846199 learned_addr learned my addr 172.21.15.82:0/2791846199 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:28:55.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.858+0000 7f5857fff700 1 --2- 172.21.15.82:0/2791846199 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5858108ab0 0x7f585810dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:55.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.858+0000 7f58577fe700 1 --2- 172.21.15.82:0/2791846199 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5858102aa0 0x7f585810f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:55.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.858+0000 7f5856ffd700 1 -- 172.21.15.82:0/2791846199 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5858102aa0 msgr2=0x7f585810f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:28:55.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.858+0000 7f5856ffd700 1 --2- 172.21.15.82:0/2791846199 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5858102aa0 0x7f585810f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:55.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.858+0000 7f5856ffd700 1 -- 172.21.15.82:0/2791846199 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5858108ab0 msgr2=0x7f585810dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:28:55.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.858+0000 7f5856ffd700 1 --2- 172.21.15.82:0/2791846199 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5858108ab0 0x7f585810dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:55.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.858+0000 7f5856ffd700 1 -- 172.21.15.82:0/2791846199 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58480095f0 con 0x7f5858103460 2023-09-23T09:28:55.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.859+0000 7f5856ffd700 1 --2- 172.21.15.82:0/2791846199 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5858103460 0x7f585810d6d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f585000ef10 tx=0x7f585000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:28:55.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.859+0000 7f5854ff9700 1 -- 172.21.15.82:0/2791846199 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f585000ca70 con 0x7f5858103460 2023-09-23T09:28:55.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.860+0000 7f585e1ff700 1 -- 172.21.15.82:0/2791846199 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f585806a5c0 con 0x7f5858103460 2023-09-23T09:28:55.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.860+0000 7f585e1ff700 1 -- 172.21.15.82:0/2791846199 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f585806ab20 con 0x7f5858103460 2023-09-23T09:28:55.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.863+0000 7f5854ff9700 1 -- 172.21.15.82:0/2791846199 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f585000f040 con 0x7f5858103460 2023-09-23T09:28:55.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.863+0000 7f5854ff9700 1 -- 172.21.15.82:0/2791846199 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5850014480 con 0x7f5858103460 2023-09-23T09:28:55.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.866+0000 7f5871ac9b80 1 Processor -- start 2023-09-23T09:28:55.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.869+0000 7f5871ac9b80 1 -- start start 2023-09-23T09:28:55.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.869+0000 7f5871ac9b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5588e03a9380 0x5588e03a9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:55.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.869+0000 7f5871ac9b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5588e03a9ca0 0x5588e03a3700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:55.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.869+0000 7f5871ac9b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588e03a3c40 0x5588e03a40a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:55.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.870+0000 7f5871ac9b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588e030b7b0 con 0x5588e03a9ca0 2023-09-23T09:28:55.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.870+0000 7f5871ac9b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588e02fc780 con 0x5588e03a3c40 2023-09-23T09:28:55.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.870+0000 7f5871ac9b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588e02fa0a0 con 0x5588e03a9380 2023-09-23T09:28:55.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.870+0000 7f5857fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5588e03a9380 0x5588e03a9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:55.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.870+0000 7f5857fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5588e03a9380 0x5588e03a9760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:36890/0 (socket says 172.21.15.82:36890) 2023-09-23T09:28:55.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.870+0000 7f5857fff700 1 -- 172.21.15.82:0/2577451713 learned_addr learned my addr 172.21.15.82:0/2577451713 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:28:55.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.870+0000 7f58577fe700 1 --2- 172.21.15.82:0/2577451713 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5588e03a9ca0 0x5588e03a3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:55.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.871+0000 7f58577fe700 1 -- 172.21.15.82:0/2577451713 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5588e03a9380 msgr2=0x5588e03a9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:28:55.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.871+0000 7f58577fe700 1 --2- 172.21.15.82:0/2577451713 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5588e03a9380 0x5588e03a9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:55.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.871+0000 7f58577fe700 1 -- 172.21.15.82:0/2577451713 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588e03a3c40 msgr2=0x5588e03a40a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-23T09:28:55.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.871+0000 7f58577fe700 1 --2- 172.21.15.82:0/2577451713 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588e03a3c40 0x5588e03a40a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:55.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.871+0000 7f58577fe700 1 -- 172.21.15.82:0/2577451713 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5588e0175630 con 0x5588e03a9ca0 2023-09-23T09:28:55.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.871+0000 7f58577fe700 1 --2- 172.21.15.82:0/2577451713 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5588e03a9ca0 0x5588e03a3700 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f584c009c00 tx=0x7f584c009f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd9f4f6ff5b6a9c8 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:28:55.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.872+0000 7f583dffb700 1 -- 172.21.15.82:0/2577451713 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f584c004220 con 0x5588e03a9ca0 2023-09-23T09:28:55.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.872+0000 7f583dffb700 1 -- 172.21.15.82:0/2577451713 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f584c00fd80 con 0x5588e03a9ca0 2023-09-23T09:28:55.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.872+0000 7f583dffb700 1 -- 172.21.15.82:0/2577451713 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f584c003d00 con 0x5588e03a9ca0 2023-09-23T09:28:55.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.873+0000 7f5871ac9b80 1 -- 172.21.15.82:0/2577451713 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5588e03a9ca0 msgr2=0x5588e03a3700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:28:55.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.873+0000 7f5854ff9700 1 -- 172.21.15.82:0/2791846199 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f585000cbd0 con 0x7f5858103460 2023-09-23T09:28:55.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.873+0000 7f5871ac9b80 1 --2- 172.21.15.82:0/2577451713 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5588e03a9ca0 0x5588e03a3700 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f584c009c00 tx=0x7f584c009f10 comp rx=0 tx=0).stop 2023-09-23T09:28:55.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.873+0000 7f5871ac9b80 1 -- 172.21.15.82:0/2577451713 shutdown_connections 2023-09-23T09:28:55.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.873+0000 7f5871ac9b80 1 --2- 172.21.15.82:0/2577451713 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588e03a3c40 0x5588e03a40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:55.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.873+0000 7f5871ac9b80 1 --2- 172.21.15.82:0/2577451713 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5588e03a9380 0x5588e03a9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:55.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.873+0000 7f5871ac9b80 1 --2- 172.21.15.82:0/2577451713 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5588e03a9ca0 0x5588e03a3700 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:55.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.873+0000 7f5871ac9b80 1 -- 172.21.15.82:0/2577451713 >> 172.21.15.82:0/2577451713 conn(0x5588e03180e0 msgr2=0x5588e039e410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:28:55.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.874+0000 7f5871ac9b80 1 -- 172.21.15.82:0/2577451713 shutdown_connections 2023-09-23T09:28:55.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.874+0000 7f5871ac9b80 1 -- 172.21.15.82:0/2577451713 wait complete. 2023-09-23T09:28:55.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.875+0000 7f5871ac9b80 1 -- start start 2023-09-23T09:28:55.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.876+0000 7f5871ac9b80 1 Processor -- start 2023-09-23T09:28:55.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.876+0000 7f5854ff9700 1 --2- 172.21.15.82:0/2791846199 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f58400a00d0 0x7f58400a2590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:55.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.877+0000 7f5854ff9700 1 -- 172.21.15.82:0/2791846199 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f58500cb880 con 0x7f5858103460 2023-09-23T09:28:55.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.878+0000 7f5871ac9b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5588e03a3c40 0x5588e03afc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:55.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.878+0000 7f5871ac9b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588e03a9380 0x5588e03acf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:55.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.878+0000 7f5871ac9b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5588e03a9ca0 0x5588e03ad670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:55.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.878+0000 7f5871ac9b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588e02f5990 con 0x5588e03a9ca0 2023-09-23T09:28:55.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.878+0000 7f5871ac9b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588e0293bb0 con 0x5588e03a9380 2023-09-23T09:28:55.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.878+0000 7f5871ac9b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588e02938b0 con 0x5588e03a3c40 2023-09-23T09:28:55.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.878+0000 7f5871ac9b80 10 client.0 _ll_register_callbacks cb 0x5588e01dda80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:28:55.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.879+0000 7f5857fff700 1 --2- 172.21.15.82:0/2791846199 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f58400a00d0 0x7f58400a2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:55.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.879+0000 7f58577fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5588e03a3c40 0x5588e03afc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:55.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.879+0000 7f5857fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5588e03a9ca0 0x5588e03ad670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:55.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.879+0000 7f5857fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5588e03a9ca0 0x5588e03ad670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44054/0 (socket says 172.21.15.82:44054) 2023-09-23T09:28:55.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.879+0000 7f5857fff700 1 -- 172.21.15.82:0/3242428405 learned_addr learned my addr 172.21.15.82:0/3242428405 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:28:55.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.880+0000 7f5857fff700 1 -- 172.21.15.82:0/3242428405 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5588e03a3c40 msgr2=0x5588e03afc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:28:55.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.880+0000 7f5857fff700 1 --2- 172.21.15.82:0/3242428405 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5588e03a3c40 0x5588e03afc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:55.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.880+0000 7f5857fff700 1 -- 172.21.15.82:0/3242428405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588e03a9380 msgr2=0x5588e03acf30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-23T09:28:55.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.880+0000 7f5857fff700 1 --2- 172.21.15.82:0/3242428405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588e03a9380 0x5588e03acf30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:55.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.880+0000 7f5857fff700 1 -- 172.21.15.82:0/3242428405 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f584c009830 con 0x5588e03a9ca0 2023-09-23T09:28:55.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.881+0000 7f5857fff700 1 --2- 172.21.15.82:0/3242428405 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5588e03a9ca0 0x5588e03ad670 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f5848005570 tx=0x7f58480055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ef12aba3a94df56 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:28:55.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.881+0000 7f5836ffd700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:28:55.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.881+0000 7f5836ffd700 1 -- 172.21.15.82:0/3242428405 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5848003dd0 con 0x5588e03a9ca0 2023-09-23T09:28:55.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.881+0000 7f5836ffd700 1 -- 172.21.15.82:0/3242428405 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(139..139 src has 1..139) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f584800b9f0 con 0x5588e03a9ca0 2023-09-23T09:28:55.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.881+0000 7f5871ac9b80 1 -- 172.21.15.82:0/3242428405 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5588e03731c0 con 0x5588e03a9ca0 2023-09-23T09:28:55.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.882+0000 7f5857fff700 1 --2- 172.21.15.82:0/2791846199 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f58400a00d0 0x7f58400a2590 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5848030000 tx=0x7f584802d000 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:28:55.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.882+0000 7f5836ffd700 1 -- 172.21.15.82:0/3242428405 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f584801d030 con 0x5588e03a9ca0 2023-09-23T09:28:55.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.884+0000 7f5871ac9b80 10 client.17310 fetch_fsmap learned FSMap version 91 2023-09-23T09:28:55.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.884+0000 7f5871ac9b80 1 -- 172.21.15.82:0/3242428405 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=4+}) v3 -- 0x5588e0121de0 con 0x5588e03a9ca0 2023-09-23T09:28:55.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.884+0000 7f5836ffd700 1 -- 172.21.15.82:0/3242428405 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5588e03731c0 con 0x5588e03a9ca0 2023-09-23T09:28:55.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.884+0000 7f5836ffd700 1 -- 172.21.15.82:0/3242428405 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 91) v1 ==== 7930+0+0 (secure 0 0 0) 0x7f5848004c70 con 0x5588e03a9ca0 2023-09-23T09:28:55.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.885+0000 7f5871ac9b80 10 client.17310 fetch_fsmap finished waiting for FSMap version 91 2023-09-23T09:28:55.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.885+0000 7f5871ac9b80 10 client.17310 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:28:55.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.885+0000 7f5871ac9b80 20 client.17310 populate_metadata read hostname 'smithi082' 2023-09-23T09:28:55.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.885+0000 7f5871ac9b80 1 --2- 172.21.15.82:0/3242428405 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5588e03bd7a0 0x5588e03bfbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:55.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.885+0000 7f5871ac9b80 4 client.17310 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:28:55.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.885+0000 7f5871ac9b80 1 -- 172.21.15.82:0/3242428405 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5588e029bba0 con 0x5588e03bd7a0 2023-09-23T09:28:55.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.886+0000 7f58577fe700 1 --2- 172.21.15.82:0/3242428405 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5588e03bd7a0 0x5588e03bfbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:55.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.886+0000 7f5836ffd700 10 client.17310 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:28:55.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.887+0000 7f58577fe700 1 --2- 172.21.15.82:0/3242428405 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5588e03bd7a0 0x5588e03bfbc0 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=23e391b55358656e server_cookie=c9117a8d90c73423 in_seq=0 out_seq=0 2023-09-23T09:28:55.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.888+0000 7f5836ffd700 1 -- 172.21.15.82:0/3242428405 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5588e029bba0 con 0x5588e03bd7a0 2023-09-23T09:28:55.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.888+0000 7f5836ffd700 10 client.17310 handle_command_reply: tid=0 2023-09-23T09:28:55.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.888+0000 7f5871ac9b80 1 client.17310 shutdown 2023-09-23T09:28:55.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.888+0000 7f5871ac9b80 1 -- 172.21.15.82:0/3242428405 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5588e03a9ca0 msgr2=0x5588e03ad670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:28:55.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.888+0000 7f5871ac9b80 1 --2- 172.21.15.82:0/3242428405 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5588e03a9ca0 0x5588e03ad670 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f5848005570 tx=0x7f58480055a0 comp rx=0 tx=0).stop 2023-09-23T09:28:55.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.888+0000 7f5871ac9b80 1 -- 172.21.15.82:0/3242428405 shutdown_connections 2023-09-23T09:28:55.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.888+0000 7f5871ac9b80 1 --2- 172.21.15.82:0/3242428405 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5588e03bd7a0 0x5588e03bfbc0 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:55.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.888+0000 7f5871ac9b80 1 --2- 172.21.15.82:0/3242428405 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5588e03a9ca0 0x5588e03ad670 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:55.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.888+0000 7f5871ac9b80 1 --2- 172.21.15.82:0/3242428405 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5588e03a3c40 0x5588e03afc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:55.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.888+0000 7f5871ac9b80 1 --2- 172.21.15.82:0/3242428405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588e03a9380 0x5588e03acf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:55.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.888+0000 7f5871ac9b80 1 -- 172.21.15.82:0/3242428405 >> 172.21.15.82:0/3242428405 conn(0x5588e03180e0 msgr2=0x5588e0398b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:28:55.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.888+0000 7f5836ffd700 0 client.17310 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:28:55.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.889+0000 7f5871ac9b80 1 -- 172.21.15.82:0/3242428405 shutdown_connections 2023-09-23T09:28:55.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.889+0000 7f5871ac9b80 1 -- 172.21.15.82:0/3242428405 wait complete. 2023-09-23T09:28:55.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.889+0000 7f5871ac9b80 20 client.17310 trim_cache size 0 max 16384 2023-09-23T09:28:55.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.913+0000 7f5871ac9b80 1 Processor -- start 2023-09-23T09:28:55.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.913+0000 7f5871ac9b80 1 -- start start 2023-09-23T09:28:55.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.914+0000 7f5871ac9b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5588e03a3c40 0x5588e03ac760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:55.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.914+0000 7f5871ac9b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588e03a9380 0x5588e03af7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:55.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.914+0000 7f5871ac9b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5588e03a9ca0 0x5588e03a70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:55.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.914+0000 7f5871ac9b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588e0177920 con 0x5588e03a9ca0 2023-09-23T09:28:55.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.914+0000 7f5871ac9b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588e039fbd0 con 0x5588e03a9380 2023-09-23T09:28:55.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.914+0000 7f5871ac9b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588e03ae2d0 con 0x5588e03a3c40 2023-09-23T09:28:55.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.914+0000 7f5856ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588e03a9380 0x5588e03af7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:55.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.915+0000 7f58577fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5588e03a3c40 0x5588e03ac760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:55.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.915+0000 7f58577fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5588e03a3c40 0x5588e03ac760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:36904/0 (socket says 172.21.15.82:36904) 2023-09-23T09:28:55.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.915+0000 7f58577fe700 1 -- 172.21.15.82:0/3360097941 learned_addr learned my addr 172.21.15.82:0/3360097941 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:28:55.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.915+0000 7f5857fff700 1 --2- 172.21.15.82:0/3360097941 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5588e03a9ca0 0x5588e03a70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:55.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.915+0000 7f58577fe700 1 -- 172.21.15.82:0/3360097941 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588e03a9380 msgr2=0x5588e03af7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:28:55.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.915+0000 7f58577fe700 1 --2- 172.21.15.82:0/3360097941 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588e03a9380 0x5588e03af7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:55.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.915+0000 7f58577fe700 1 -- 172.21.15.82:0/3360097941 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5588e03a9ca0 msgr2=0x5588e03a70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:28:55.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.915+0000 7f58577fe700 1 --2- 172.21.15.82:0/3360097941 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5588e03a9ca0 0x5588e03a70d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:55.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.915+0000 7f58577fe700 1 -- 172.21.15.82:0/3360097941 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5588e03c47f0 con 0x5588e03a3c40 2023-09-23T09:28:55.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.916+0000 7f58577fe700 1 --2- 172.21.15.82:0/3360097941 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5588e03a3c40 0x5588e03ac760 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f584c009b20 tx=0x7f584c009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b01516653090ea00 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:28:55.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.916+0000 7f583e7fc700 1 -- 172.21.15.82:0/3360097941 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f584c021050 con 0x5588e03a3c40 2023-09-23T09:28:55.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.917+0000 7f583e7fc700 1 -- 172.21.15.82:0/3360097941 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f584c022040 con 0x5588e03a3c40 2023-09-23T09:28:55.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.917+0000 7f583e7fc700 1 -- 172.21.15.82:0/3360097941 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f584c028530 con 0x5588e03a3c40 2023-09-23T09:28:55.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.917+0000 7f5871ac9b80 1 -- 172.21.15.82:0/3360097941 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5588e03a3c40 msgr2=0x5588e03ac760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:28:55.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.917+0000 7f5871ac9b80 1 --2- 172.21.15.82:0/3360097941 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5588e03a3c40 0x5588e03ac760 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f584c009b20 tx=0x7f584c009260 comp rx=0 tx=0).stop 2023-09-23T09:28:55.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.919+0000 7f5871ac9b80 1 -- 172.21.15.82:0/3360097941 shutdown_connections 2023-09-23T09:28:55.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.919+0000 7f5871ac9b80 1 --2- 172.21.15.82:0/3360097941 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5588e03a9ca0 0x5588e03a70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:55.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.919+0000 7f5871ac9b80 1 --2- 172.21.15.82:0/3360097941 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5588e03a3c40 0x5588e03ac760 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:55.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.919+0000 7f5871ac9b80 1 --2- 172.21.15.82:0/3360097941 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588e03a9380 0x5588e03af7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:55.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.919+0000 7f5871ac9b80 1 -- 172.21.15.82:0/3360097941 >> 172.21.15.82:0/3360097941 conn(0x5588e03180e0 msgr2=0x5588e039e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:28:55.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.919+0000 7f5871ac9b80 1 -- 172.21.15.82:0/3360097941 shutdown_connections 2023-09-23T09:28:55.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.919+0000 7f5871ac9b80 1 -- 172.21.15.82:0/3360097941 wait complete. 2023-09-23T09:28:55.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.920+0000 7f5871ac9b80 1 -- start start 2023-09-23T09:28:55.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.920+0000 7f5871ac9b80 1 Processor -- start 2023-09-23T09:28:55.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.922+0000 7f5871ac9b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5588e03a3c40 0x5588e03a60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:55.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.922+0000 7f5871ac9b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5588e03a9380 0x5588e03a65e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:55.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.922+0000 7f5871ac9b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588e03a9ca0 0x5588e03a4e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:55.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.922+0000 7f5871ac9b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588e03a6c30 con 0x5588e03a3c40 2023-09-23T09:28:55.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.922+0000 7f5871ac9b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588e03a5340 con 0x5588e03a9ca0 2023-09-23T09:28:55.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.922+0000 7f5871ac9b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588e03a54d0 con 0x5588e03a9380 2023-09-23T09:28:55.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.922+0000 7f5871ac9b80 10 client.0 _ll_register_callbacks cb 0x7f5848005040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:28:55.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.923+0000 7f5856ffd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5588e03a9380 0x5588e03a65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:55.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.923+0000 7f58577fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5588e03a3c40 0x5588e03a60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:55.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.923+0000 7f5856ffd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5588e03a9380 0x5588e03a65e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:36914/0 (socket says 172.21.15.82:36914) 2023-09-23T09:28:55.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.923+0000 7f5856ffd700 1 -- 172.21.15.82:0/1680493611 learned_addr learned my addr 172.21.15.82:0/1680493611 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:28:55.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.923+0000 7f5857fff700 1 --2- 172.21.15.82:0/1680493611 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588e03a9ca0 0x5588e03a4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:55.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.924+0000 7f5856ffd700 1 -- 172.21.15.82:0/1680493611 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588e03a9ca0 msgr2=0x5588e03a4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:28:55.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.924+0000 7f5856ffd700 1 --2- 172.21.15.82:0/1680493611 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588e03a9ca0 0x5588e03a4e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:55.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.924+0000 7f5856ffd700 1 -- 172.21.15.82:0/1680493611 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5588e03a3c40 msgr2=0x5588e03a60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:28:55.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.924+0000 7f5856ffd700 1 --2- 172.21.15.82:0/1680493611 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5588e03a3c40 0x5588e03a60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:55.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.924+0000 7f5856ffd700 1 -- 172.21.15.82:0/1680493611 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5588e0175630 con 0x5588e03a9380 2023-09-23T09:28:55.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.924+0000 7f5856ffd700 1 --2- 172.21.15.82:0/1680493611 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5588e03a9380 0x5588e03a65e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f585000cfd0 tx=0x7f58500c94d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=569ae951ce2dc723 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:28:55.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.927+0000 7f5836ffd700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T09:28:55.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.927+0000 7f5836ffd700 1 -- 172.21.15.82:0/1680493611 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f585009cd60 con 0x5588e03a9380 2023-09-23T09:28:55.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.927+0000 7f5836ffd700 1 -- 172.21.15.82:0/1680493611 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(139..139 src has 1..139) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f58500a0d40 con 0x5588e03a9380 2023-09-23T09:28:55.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.927+0000 7f5871ac9b80 1 -- 172.21.15.82:0/1680493611 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5588e03968b0 con 0x5588e03a9380 2023-09-23T09:28:55.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.928+0000 7f5836ffd700 1 -- 172.21.15.82:0/1680493611 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f58500a08b0 con 0x5588e03a9380 2023-09-23T09:28:55.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.928+0000 7f5871ac9b80 10 client.27058 fetch_fsmap learned FSMap version 91 2023-09-23T09:28:55.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.928+0000 7f5871ac9b80 1 -- 172.21.15.82:0/1680493611 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=4+}) v3 -- 0x5588e010ac60 con 0x5588e03a9380 2023-09-23T09:28:55.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.928+0000 7f5836ffd700 1 -- 172.21.15.82:0/1680493611 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5588e03968b0 con 0x5588e03a9380 2023-09-23T09:28:55.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.929+0000 7f5836ffd700 1 -- 172.21.15.82:0/1680493611 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 91) v1 ==== 7930+0+0 (secure 0 0 0) 0x7f58500b8070 con 0x5588e03a9380 2023-09-23T09:28:55.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.929+0000 7f5871ac9b80 10 client.27058 fetch_fsmap finished waiting for FSMap version 91 2023-09-23T09:28:55.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.929+0000 7f5871ac9b80 10 client.27058 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:28:55.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.929+0000 7f5871ac9b80 20 client.27058 populate_metadata read hostname 'smithi082' 2023-09-23T09:28:55.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.929+0000 7f5871ac9b80 1 --2- 172.21.15.82:0/1680493611 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5588e0412420 0x5588e0414840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:55.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.929+0000 7f5871ac9b80 4 client.27058 mds_command: new command op to 24557 tid=0[{"prefix": "damage ls"}] 2023-09-23T09:28:55.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.929+0000 7f5871ac9b80 1 -- 172.21.15.82:0/1680493611 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5588e02ee970 con 0x5588e0412420 2023-09-23T09:28:55.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.930+0000 7f58577fe700 1 --2- 172.21.15.82:0/1680493611 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5588e0412420 0x5588e0414840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:55.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.931+0000 7f58577fe700 1 --2- 172.21.15.82:0/1680493611 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5588e0412420 0x5588e0414840 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d70a07b6cadc4cf7 server_cookie=24a8d9f68058cda8 in_seq=0 out_seq=0 2023-09-23T09:28:55.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.931+0000 7f5836ffd700 10 client.27058 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:28:55.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.931+0000 7f5836ffd700 1 -- 172.21.15.82:0/1680493611 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5588e02ee970 con 0x5588e0412420 2023-09-23T09:28:55.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.931+0000 7f5836ffd700 10 client.27058 handle_command_reply: tid=0 2023-09-23T09:28:55.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.931+0000 7f5871ac9b80 1 client.27058 shutdown 2023-09-23T09:28:55.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.931+0000 7f5871ac9b80 1 -- 172.21.15.82:0/1680493611 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5588e03a9380 msgr2=0x5588e03a65e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:28:55.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.931+0000 7f5871ac9b80 1 --2- 172.21.15.82:0/1680493611 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5588e03a9380 0x5588e03a65e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f585000cfd0 tx=0x7f58500c94d0 comp rx=0 tx=0).stop 2023-09-23T09:28:55.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.932+0000 7f5871ac9b80 1 -- 172.21.15.82:0/1680493611 shutdown_connections 2023-09-23T09:28:55.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.932+0000 7f5871ac9b80 1 --2- 172.21.15.82:0/1680493611 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588e03a9ca0 0x5588e03a4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:55.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.932+0000 7f5871ac9b80 1 --2- 172.21.15.82:0/1680493611 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5588e0412420 0x5588e0414840 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:55.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.932+0000 7f5871ac9b80 1 --2- 172.21.15.82:0/1680493611 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5588e03a3c40 0x5588e03a60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:55.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.932+0000 7f5871ac9b80 1 --2- 172.21.15.82:0/1680493611 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5588e03a9380 0x5588e03a65e0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:55.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.932+0000 7f5871ac9b80 1 -- 172.21.15.82:0/1680493611 >> 172.21.15.82:0/1680493611 conn(0x5588e03180e0 msgr2=0x5588e03a70d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:28:55.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.932+0000 7f5836ffd700 0 client.27058 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:28:55.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.932+0000 7f5871ac9b80 1 -- 172.21.15.82:0/1680493611 shutdown_connections 2023-09-23T09:28:55.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.933+0000 7f5871ac9b80 1 -- 172.21.15.82:0/1680493611 wait complete. 2023-09-23T09:28:55.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.933+0000 7f5871ac9b80 20 client.27058 trim_cache size 0 max 16384 2023-09-23T09:28:55.935 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2023-09-23T09:28:55.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.934+0000 7f585e1ff700 1 -- 172.21.15.82:0/2791846199 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f58400a00d0 msgr2=0x7f58400a2590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:28:55.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.934+0000 7f585e1ff700 1 --2- 172.21.15.82:0/2791846199 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f58400a00d0 0x7f58400a2590 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5848030000 tx=0x7f584802d000 comp rx=0 tx=0).stop 2023-09-23T09:28:55.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.934+0000 7f585e1ff700 1 -- 172.21.15.82:0/2791846199 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5858103460 msgr2=0x7f585810d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:28:55.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.934+0000 7f585e1ff700 1 --2- 172.21.15.82:0/2791846199 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5858103460 0x7f585810d6d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f585000ef10 tx=0x7f585000c3a0 comp rx=0 tx=0).stop 2023-09-23T09:28:55.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.934+0000 7f585e1ff700 1 -- 172.21.15.82:0/2791846199 shutdown_connections 2023-09-23T09:28:55.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.934+0000 7f585e1ff700 1 --2- 172.21.15.82:0/2791846199 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f58400a00d0 0x7f58400a2590 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:55.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.934+0000 7f585e1ff700 1 --2- 172.21.15.82:0/2791846199 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5858108ab0 0x7f585810dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:55.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.934+0000 7f585e1ff700 1 --2- 172.21.15.82:0/2791846199 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5858102aa0 0x7f585810f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:55.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.934+0000 7f585e1ff700 1 --2- 172.21.15.82:0/2791846199 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5858103460 0x7f585810d6d0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:55.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.934+0000 7f585e1ff700 1 -- 172.21.15.82:0/2791846199 >> 172.21.15.82:0/2791846199 conn(0x7f58580fe590 msgr2=0x7f58580fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:28:55.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.934+0000 7f585e1ff700 1 -- 172.21.15.82:0/2791846199 shutdown_connections 2023-09-23T09:28:55.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:55.935+0000 7f585e1ff700 1 -- 172.21.15.82:0/2791846199 wait complete. 2023-09-23T09:28:56.968 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-09-23T09:28:56.969 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-09-23T09:28:57.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:28:56 smithi135 ceph-mon[99205]: pgmap v1014: 97 pgs: 97 active+clean; 16 GiB data, 53 GiB used, 1020 GiB / 1.0 TiB avail; 1.0 MiB/s rd, 22 MiB/s wr, 1.60k op/s 2023-09-23T09:28:57.092 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:28:56 smithi082 ceph-mon[97694]: pgmap v1014: 97 pgs: 97 active+clean; 16 GiB data, 53 GiB used, 1020 GiB / 1.0 TiB avail; 1.0 MiB/s rd, 22 MiB/s wr, 1.60k op/s 2023-09-23T09:28:57.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:28:56 smithi161 ceph-mon[99580]: pgmap v1014: 97 pgs: 97 active+clean; 16 GiB data, 53 GiB used, 1020 GiB / 1.0 TiB avail; 1.0 MiB/s rd, 22 MiB/s wr, 1.60k op/s 2023-09-23T09:28:57.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.333+0000 7f710ddff700 1 -- 172.21.15.82:0/649190120 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7108107920 msgr2=0x7f7108107d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:28:57.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.333+0000 7f710ddff700 1 --2- 172.21.15.82:0/649190120 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7108107920 0x7f7108107d00 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f70f8009990 tx=0x7f70f8009ca0 comp rx=0 tx=0).stop 2023-09-23T09:28:57.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.333+0000 7f710ddff700 1 -- 172.21.15.82:0/649190120 shutdown_connections 2023-09-23T09:28:57.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.333+0000 7f710ddff700 1 --2- 172.21.15.82:0/649190120 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7108113a70 0x7f7108115e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:57.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.333+0000 7f710ddff700 1 --2- 172.21.15.82:0/649190120 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7108107920 0x7f7108107d00 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:57.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.334+0000 7f710ddff700 1 --2- 172.21.15.82:0/649190120 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7108108240 0x7f7108113530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:57.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.334+0000 7f710ddff700 1 -- 172.21.15.82:0/649190120 >> 172.21.15.82:0/649190120 conn(0x7f710806cbe0 msgr2=0x7f710806cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:28:57.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.334+0000 7f710ddff700 1 -- 172.21.15.82:0/649190120 shutdown_connections 2023-09-23T09:28:57.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.334+0000 7f710ddff700 1 -- 172.21.15.82:0/649190120 wait complete. 2023-09-23T09:28:57.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.336+0000 7f710ddff700 1 Processor -- start 2023-09-23T09:28:57.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.336+0000 7f710ddff700 1 -- start start 2023-09-23T09:28:57.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.337+0000 7f710ddff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7108107920 0x7f710810dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:57.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.337+0000 7f710ddff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7108108240 0x7f710810e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:57.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.337+0000 7f710ddff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7108113a70 0x7f71081a7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:57.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.337+0000 7f710ddff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71081a81b0 con 0x7f7108113a70 2023-09-23T09:28:57.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.337+0000 7f710ddff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71081a8320 con 0x7f7108108240 2023-09-23T09:28:57.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.337+0000 7f710ddff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71081a84e0 con 0x7f7108107920 2023-09-23T09:28:57.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.338+0000 7f7106ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7108108240 0x7f710810e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:57.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.338+0000 7f7107fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7108113a70 0x7f71081a7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:57.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.338+0000 7f7107fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7108113a70 0x7f71081a7bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44090/0 (socket says 172.21.15.82:44090) 2023-09-23T09:28:57.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.338+0000 7f7107fff700 1 -- 172.21.15.82:0/2742812600 learned_addr learned my addr 172.21.15.82:0/2742812600 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:28:57.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.338+0000 7f71077fe700 1 --2- 172.21.15.82:0/2742812600 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7108107920 0x7f710810dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:57.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.339+0000 7f7106ffd700 1 -- 172.21.15.82:0/2742812600 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7108107920 msgr2=0x7f710810dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:28:57.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.339+0000 7f7106ffd700 1 --2- 172.21.15.82:0/2742812600 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7108107920 0x7f710810dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:57.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.339+0000 7f7106ffd700 1 -- 172.21.15.82:0/2742812600 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7108113a70 msgr2=0x7f71081a7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:28:57.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.339+0000 7f7106ffd700 1 --2- 172.21.15.82:0/2742812600 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7108113a70 0x7f71081a7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:57.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.339+0000 7f7106ffd700 1 -- 172.21.15.82:0/2742812600 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70f80095f0 con 0x7f7108108240 2023-09-23T09:28:57.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.339+0000 7f7107fff700 1 --2- 172.21.15.82:0/2742812600 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7108113a70 0x7f71081a7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:28:57.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.339+0000 7f71077fe700 1 --2- 172.21.15.82:0/2742812600 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7108107920 0x7f710810dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:28:57.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.339+0000 7f7106ffd700 1 --2- 172.21.15.82:0/2742812600 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7108108240 0x7f710810e120 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f70f0007ec0 tx=0x7f70f000d3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:28:57.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.340+0000 7f7104ff9700 1 -- 172.21.15.82:0/2742812600 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f000dd20 con 0x7f7108108240 2023-09-23T09:28:57.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.340+0000 7f7104ff9700 1 -- 172.21.15.82:0/2742812600 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f70f000f040 con 0x7f7108108240 2023-09-23T09:28:57.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.340+0000 7f7104ff9700 1 -- 172.21.15.82:0/2742812600 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f0014600 con 0x7f7108108240 2023-09-23T09:28:57.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.340+0000 7f710ddff700 1 -- 172.21.15.82:0/2742812600 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71081a87c0 con 0x7f7108108240 2023-09-23T09:28:57.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.340+0000 7f710ddff700 1 -- 172.21.15.82:0/2742812600 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71081a8cd0 con 0x7f7108108240 2023-09-23T09:28:57.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.347+0000 7f7104ff9700 1 -- 172.21.15.82:0/2742812600 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f70f0004bb0 con 0x7f7108108240 2023-09-23T09:28:57.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.348+0000 7f7121792b80 1 Processor -- start 2023-09-23T09:28:57.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.348+0000 7f7121792b80 1 -- start start 2023-09-23T09:28:57.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.349+0000 7f7121792b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2ccc42400 0x55b2ccc427e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:57.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.349+0000 7f7121792b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2ccc42d20 0x55b2ccc3c780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:57.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.349+0000 7f7121792b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b2ccc3ccc0 0x55b2ccc3d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:57.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.349+0000 7f7121792b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2ccba4830 con 0x55b2ccc42d20 2023-09-23T09:28:57.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.349+0000 7f7121792b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2ccb95800 con 0x55b2ccc42400 2023-09-23T09:28:57.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.349+0000 7f7121792b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2ccb93120 con 0x55b2ccc3ccc0 2023-09-23T09:28:57.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.349+0000 7f7107fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2ccc42400 0x55b2ccc427e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:57.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.349+0000 7f7107fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2ccc42400 0x55b2ccc427e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:60666/0 (socket says 172.21.15.82:60666) 2023-09-23T09:28:57.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.349+0000 7f7107fff700 1 -- 172.21.15.82:0/1242418895 learned_addr learned my addr 172.21.15.82:0/1242418895 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:28:57.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.349+0000 7f71077fe700 1 --2- 172.21.15.82:0/1242418895 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2ccc42d20 0x55b2ccc3c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:57.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.350+0000 7f7106ffd700 1 --2- 172.21.15.82:0/1242418895 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b2ccc3ccc0 0x55b2ccc3d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:57.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.350+0000 7f71077fe700 1 -- 172.21.15.82:0/1242418895 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b2ccc3ccc0 msgr2=0x55b2ccc3d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:28:57.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.350+0000 7f71077fe700 1 --2- 172.21.15.82:0/1242418895 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b2ccc3ccc0 0x55b2ccc3d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:57.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.350+0000 7f71077fe700 1 -- 172.21.15.82:0/1242418895 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2ccc42400 msgr2=0x55b2ccc427e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:28:57.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.350+0000 7f71077fe700 1 --2- 172.21.15.82:0/1242418895 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2ccc42400 0x55b2ccc427e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:57.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.350+0000 7f71077fe700 1 -- 172.21.15.82:0/1242418895 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b2cca0e6b0 con 0x55b2ccc42d20 2023-09-23T09:28:57.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.351+0000 7f7104ff9700 1 --2- 172.21.15.82:0/2742812600 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f70e80a0290 0x7f70e80a2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:57.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.351+0000 7f7104ff9700 1 -- 172.21.15.82:0/2742812600 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f70f00caa80 con 0x7f7108108240 2023-09-23T09:28:57.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.351+0000 7f71077fe700 1 --2- 172.21.15.82:0/1242418895 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2ccc42d20 0x55b2ccc3c780 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f70f8000c00 tx=0x7f70f8009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=717c6c62f96fba45 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:28:57.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.351+0000 7f7107fff700 1 --2- 172.21.15.82:0/2742812600 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f70e80a0290 0x7f70e80a2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:57.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.352+0000 7f70fdffb700 1 -- 172.21.15.82:0/1242418895 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f801d070 con 0x55b2ccc42d20 2023-09-23T09:28:57.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.352+0000 7f70fdffb700 1 -- 172.21.15.82:0/1242418895 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f70f801e040 con 0x55b2ccc42d20 2023-09-23T09:28:57.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.352+0000 7f70fdffb700 1 -- 172.21.15.82:0/1242418895 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f80048f0 con 0x55b2ccc42d20 2023-09-23T09:28:57.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.353+0000 7f7121792b80 1 -- 172.21.15.82:0/1242418895 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2ccc42d20 msgr2=0x55b2ccc3c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:28:57.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.353+0000 7f7121792b80 1 --2- 172.21.15.82:0/1242418895 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2ccc42d20 0x55b2ccc3c780 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f70f8000c00 tx=0x7f70f8009f90 comp rx=0 tx=0).stop 2023-09-23T09:28:57.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.353+0000 7f7121792b80 1 -- 172.21.15.82:0/1242418895 shutdown_connections 2023-09-23T09:28:57.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.353+0000 7f7121792b80 1 --2- 172.21.15.82:0/1242418895 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b2ccc3ccc0 0x55b2ccc3d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:57.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.353+0000 7f7121792b80 1 --2- 172.21.15.82:0/1242418895 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2ccc42400 0x55b2ccc427e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:57.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.353+0000 7f7121792b80 1 --2- 172.21.15.82:0/1242418895 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2ccc42d20 0x55b2ccc3c780 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:57.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.353+0000 7f7121792b80 1 -- 172.21.15.82:0/1242418895 >> 172.21.15.82:0/1242418895 conn(0x55b2ccbb1160 msgr2=0x55b2ccc37490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:28:57.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.353+0000 7f7107fff700 1 --2- 172.21.15.82:0/2742812600 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f70e80a0290 0x7f70e80a2750 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f7100005d30 tx=0x7f7100007320 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:28:57.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.353+0000 7f7121792b80 1 -- 172.21.15.82:0/1242418895 shutdown_connections 2023-09-23T09:28:57.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.353+0000 7f7121792b80 1 -- 172.21.15.82:0/1242418895 wait complete. 2023-09-23T09:28:57.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.354+0000 7f7121792b80 1 -- start start 2023-09-23T09:28:57.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.354+0000 7f7121792b80 1 Processor -- start 2023-09-23T09:28:57.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.355+0000 7f7121792b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b2ccc3ccc0 0x55b2ccc48c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:57.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.356+0000 7f7121792b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2ccc42400 0x55b2ccc45f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:57.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.356+0000 7f7121792b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2ccc42d20 0x55b2ccc46530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:57.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.356+0000 7f7121792b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2ccb8ea10 con 0x55b2ccc42d20 2023-09-23T09:28:57.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.356+0000 7f7121792b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2ccb2cc30 con 0x55b2ccc42400 2023-09-23T09:28:57.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.356+0000 7f7121792b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2ccb2c930 con 0x55b2ccc3ccc0 2023-09-23T09:28:57.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.356+0000 7f7121792b80 10 client.0 _ll_register_callbacks cb 0x55b2cca76b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:28:57.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.356+0000 7f7106ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2ccc42400 0x55b2ccc45f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:57.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.356+0000 7f7106ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2ccc42400 0x55b2ccc45f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:60674/0 (socket says 172.21.15.82:60674) 2023-09-23T09:28:57.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.356+0000 7f7106ffd700 1 -- 172.21.15.82:0/409860548 learned_addr learned my addr 172.21.15.82:0/409860548 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:28:57.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.357+0000 7f71077fe700 1 --2- 172.21.15.82:0/409860548 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b2ccc3ccc0 0x55b2ccc48c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:57.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.357+0000 7f7106ffd700 1 -- 172.21.15.82:0/409860548 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b2ccc3ccc0 msgr2=0x55b2ccc48c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:28:57.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.357+0000 7f7106ffd700 1 --2- 172.21.15.82:0/409860548 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b2ccc3ccc0 0x55b2ccc48c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:57.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.357+0000 7f7106ffd700 1 -- 172.21.15.82:0/409860548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2ccc42d20 msgr2=0x55b2ccc46530 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-23T09:28:57.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.357+0000 7f7106ffd700 1 --2- 172.21.15.82:0/409860548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2ccc42d20 0x55b2ccc46530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:57.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.357+0000 7f7106ffd700 1 -- 172.21.15.82:0/409860548 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71081167e0 con 0x55b2ccc42400 2023-09-23T09:28:57.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.358+0000 7f7106ffd700 1 --2- 172.21.15.82:0/409860548 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2ccc42400 0x55b2ccc45f00 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f70f0094630 tx=0x7f70f0007490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=88fd9dfae129739e server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:28:57.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.358+0000 7f70f6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-09-23T09:28:57.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.358+0000 7f70f6ffd700 1 -- 172.21.15.82:0/409860548 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f0098590 con 0x55b2ccc42400 2023-09-23T09:28:57.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.358+0000 7f70f6ffd700 1 -- 172.21.15.82:0/409860548 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(139..139 src has 1..139) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f70f0098830 con 0x55b2ccc42400 2023-09-23T09:28:57.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.359+0000 7f7121792b80 1 -- 172.21.15.82:0/409860548 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b2ccc0c240 con 0x55b2ccc42400 2023-09-23T09:28:57.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.359+0000 7f70f6ffd700 1 -- 172.21.15.82:0/409860548 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f70f0097a90 con 0x55b2ccc42400 2023-09-23T09:28:57.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.359+0000 7f7121792b80 10 client.27023 fetch_fsmap learned FSMap version 91 2023-09-23T09:28:57.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.359+0000 7f7121792b80 1 -- 172.21.15.82:0/409860548 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=4+}) v3 -- 0x55b2cc9bae60 con 0x55b2ccc42400 2023-09-23T09:28:57.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.360+0000 7f70f6ffd700 1 -- 172.21.15.82:0/409860548 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b2ccc0c240 con 0x55b2ccc42400 2023-09-23T09:28:57.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.360+0000 7f70f6ffd700 1 -- 172.21.15.82:0/409860548 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 91) v1 ==== 7930+0+0 (secure 0 0 0) 0x7f70f0097620 con 0x55b2ccc42400 2023-09-23T09:28:57.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.360+0000 7f7121792b80 10 client.27023 fetch_fsmap finished waiting for FSMap version 91 2023-09-23T09:28:57.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.360+0000 7f7121792b80 10 client.27023 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:28:57.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.360+0000 7f7121792b80 20 client.27023 populate_metadata read hostname 'smithi082' 2023-09-23T09:28:57.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.360+0000 7f7121792b80 1 --2- 172.21.15.82:0/409860548 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55b2ccc56740 0x55b2ccc58b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:57.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.360+0000 7f7121792b80 4 client.27023 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:28:57.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.360+0000 7f7121792b80 1 -- 172.21.15.82:0/409860548 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b2ccb34c20 con 0x55b2ccc56740 2023-09-23T09:28:57.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.361+0000 7f71077fe700 1 --2- 172.21.15.82:0/409860548 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55b2ccc56740 0x55b2ccc58b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:57.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.362+0000 7f71077fe700 1 --2- 172.21.15.82:0/409860548 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55b2ccc56740 0x55b2ccc58b60 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d9abe775e32e71f server_cookie=db760d25d8ddb096 in_seq=0 out_seq=0 2023-09-23T09:28:57.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.362+0000 7f70f6ffd700 10 client.27023 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:28:57.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.363+0000 7f70f6ffd700 1 -- 172.21.15.82:0/409860548 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b2ccb34c20 con 0x55b2ccc56740 2023-09-23T09:28:57.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.363+0000 7f70f6ffd700 10 client.27023 handle_command_reply: tid=0 2023-09-23T09:28:57.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.364+0000 7f7121792b80 1 client.27023 shutdown 2023-09-23T09:28:57.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.365+0000 7f7121792b80 1 -- 172.21.15.82:0/409860548 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2ccc42400 msgr2=0x55b2ccc45f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:28:57.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.365+0000 7f7121792b80 1 --2- 172.21.15.82:0/409860548 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2ccc42400 0x55b2ccc45f00 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f70f0094630 tx=0x7f70f0007490 comp rx=0 tx=0).stop 2023-09-23T09:28:57.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.365+0000 7f7121792b80 1 -- 172.21.15.82:0/409860548 shutdown_connections 2023-09-23T09:28:57.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.365+0000 7f7121792b80 1 --2- 172.21.15.82:0/409860548 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55b2ccc56740 0x55b2ccc58b60 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:57.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.365+0000 7f7121792b80 1 --2- 172.21.15.82:0/409860548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2ccc42d20 0x55b2ccc46530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:57.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.365+0000 7f7121792b80 1 --2- 172.21.15.82:0/409860548 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b2ccc3ccc0 0x55b2ccc48c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:57.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.365+0000 7f7121792b80 1 --2- 172.21.15.82:0/409860548 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2ccc42400 0x55b2ccc45f00 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:57.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.365+0000 7f7121792b80 1 -- 172.21.15.82:0/409860548 >> 172.21.15.82:0/409860548 conn(0x55b2ccbb1160 msgr2=0x55b2ccc31bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:28:57.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.365+0000 7f70f6ffd700 0 client.27023 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:28:57.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.366+0000 7f7121792b80 1 -- 172.21.15.82:0/409860548 shutdown_connections 2023-09-23T09:28:57.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.366+0000 7f7121792b80 1 -- 172.21.15.82:0/409860548 wait complete. 2023-09-23T09:28:57.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.367+0000 7f7121792b80 20 client.27023 trim_cache size 0 max 16384 2023-09-23T09:28:57.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.403+0000 7f7121792b80 1 Processor -- start 2023-09-23T09:28:57.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.404+0000 7f7121792b80 1 -- start start 2023-09-23T09:28:57.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.404+0000 7f7121792b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b2ccc3ccc0 0x55b2ccc43a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:57.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.404+0000 7f7121792b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2ccc42400 0x55b2ccc31a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:57.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.404+0000 7f7121792b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2ccc42d20 0x55b2ccc487b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:57.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.404+0000 7f7121792b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2ccc531b0 con 0x55b2ccc42400 2023-09-23T09:28:57.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.404+0000 7f7121792b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2cca109a0 con 0x55b2ccc42d20 2023-09-23T09:28:57.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.404+0000 7f7121792b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2ccc472d0 con 0x55b2ccc3ccc0 2023-09-23T09:28:57.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.405+0000 7f7107fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2ccc42d20 0x55b2ccc487b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:57.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.405+0000 7f7107fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2ccc42d20 0x55b2ccc487b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:60688/0 (socket says 172.21.15.82:60688) 2023-09-23T09:28:57.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.405+0000 7f7107fff700 1 -- 172.21.15.82:0/1440891875 learned_addr learned my addr 172.21.15.82:0/1440891875 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:28:57.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.405+0000 7f7107fff700 1 -- 172.21.15.82:0/1440891875 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b2ccc3ccc0 msgr2=0x55b2ccc43a40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-23T09:28:57.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.405+0000 7f7107fff700 1 --2- 172.21.15.82:0/1440891875 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b2ccc3ccc0 0x55b2ccc43a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:57.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.405+0000 7f7107fff700 1 -- 172.21.15.82:0/1440891875 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2ccc42400 msgr2=0x55b2ccc31a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:28:57.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.405+0000 7f7106ffd700 1 --2- 172.21.15.82:0/1440891875 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2ccc42400 0x55b2ccc31a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:57.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.406+0000 7f7107fff700 1 --2- 172.21.15.82:0/1440891875 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2ccc42400 0x55b2ccc31a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:57.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.406+0000 7f7107fff700 1 -- 172.21.15.82:0/1440891875 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b2ccc5d790 con 0x55b2ccc42d20 2023-09-23T09:28:57.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.406+0000 7f7106ffd700 1 --2- 172.21.15.82:0/1440891875 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2ccc42400 0x55b2ccc31a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T09:28:57.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.409+0000 7f7107fff700 1 --2- 172.21.15.82:0/1440891875 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2ccc42d20 0x55b2ccc487b0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7100005db0 tx=0x7f7100016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1fd3f26ea88ae92 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:28:57.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.411+0000 7f70fe7fc700 1 -- 172.21.15.82:0/1440891875 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7100016070 con 0x55b2ccc42d20 2023-09-23T09:28:57.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.412+0000 7f70fe7fc700 1 -- 172.21.15.82:0/1440891875 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7100007e80 con 0x55b2ccc42d20 2023-09-23T09:28:57.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.412+0000 7f70fe7fc700 1 -- 172.21.15.82:0/1440891875 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7100010890 con 0x55b2ccc42d20 2023-09-23T09:28:57.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.412+0000 7f7121792b80 1 -- 172.21.15.82:0/1440891875 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2ccc42d20 msgr2=0x55b2ccc487b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:28:57.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.413+0000 7f7121792b80 1 --2- 172.21.15.82:0/1440891875 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2ccc42d20 0x55b2ccc487b0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7100005db0 tx=0x7f7100016000 comp rx=0 tx=0).stop 2023-09-23T09:28:57.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.414+0000 7f7121792b80 1 -- 172.21.15.82:0/1440891875 shutdown_connections 2023-09-23T09:28:57.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.414+0000 7f7121792b80 1 --2- 172.21.15.82:0/1440891875 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2ccc42d20 0x55b2ccc487b0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:57.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.414+0000 7f7121792b80 1 --2- 172.21.15.82:0/1440891875 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b2ccc3ccc0 0x55b2ccc43a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:57.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.414+0000 7f7121792b80 1 --2- 172.21.15.82:0/1440891875 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2ccc42400 0x55b2ccc31a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:57.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.414+0000 7f7121792b80 1 -- 172.21.15.82:0/1440891875 >> 172.21.15.82:0/1440891875 conn(0x55b2ccbb1160 msgr2=0x55b2ccc31330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:28:57.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.415+0000 7f7121792b80 1 -- 172.21.15.82:0/1440891875 shutdown_connections 2023-09-23T09:28:57.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.415+0000 7f7121792b80 1 -- 172.21.15.82:0/1440891875 wait complete. 2023-09-23T09:28:57.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.416+0000 7f7121792b80 1 -- start start 2023-09-23T09:28:57.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.416+0000 7f7121792b80 1 Processor -- start 2023-09-23T09:28:57.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.417+0000 7f7121792b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2ccc3ccc0 0x55b2ccc3f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:57.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.417+0000 7f7121792b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b2ccc42400 0x55b2ccc4b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:57.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.417+0000 7f7121792b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2ccc42d20 0x55b2ccc4bd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:57.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.417+0000 7f7121792b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2ccc4c2b0 con 0x55b2ccc42d20 2023-09-23T09:28:57.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.417+0000 7f7121792b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2ccc4c420 con 0x55b2ccc3ccc0 2023-09-23T09:28:57.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.417+0000 7f7121792b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2ccc4c5e0 con 0x55b2ccc42400 2023-09-23T09:28:57.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.417+0000 7f7121792b80 10 client.0 _ll_register_callbacks cb 0x55b2cca76b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:28:57.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.418+0000 7f7107fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2ccc42d20 0x55b2ccc4bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:57.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.418+0000 7f7107fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2ccc42d20 0x55b2ccc4bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44112/0 (socket says 172.21.15.82:44112) 2023-09-23T09:28:57.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.418+0000 7f7107fff700 1 -- 172.21.15.82:0/4035349477 learned_addr learned my addr 172.21.15.82:0/4035349477 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:28:57.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.418+0000 7f71077fe700 1 --2- 172.21.15.82:0/4035349477 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2ccc3ccc0 0x55b2ccc3f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:57.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.418+0000 7f7106ffd700 1 --2- 172.21.15.82:0/4035349477 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b2ccc42400 0x55b2ccc4b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:57.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.419+0000 7f71077fe700 1 -- 172.21.15.82:0/4035349477 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b2ccc42400 msgr2=0x55b2ccc4b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:28:57.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.419+0000 7f71077fe700 1 --2- 172.21.15.82:0/4035349477 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b2ccc42400 0x55b2ccc4b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:57.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.419+0000 7f71077fe700 1 -- 172.21.15.82:0/4035349477 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2ccc42d20 msgr2=0x55b2ccc4bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:28:57.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.419+0000 7f71077fe700 1 --2- 172.21.15.82:0/4035349477 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2ccc42d20 0x55b2ccc4bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:57.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.419+0000 7f71077fe700 1 -- 172.21.15.82:0/4035349477 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f710001f430 con 0x55b2ccc3ccc0 2023-09-23T09:28:57.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.419+0000 7f71077fe700 1 --2- 172.21.15.82:0/4035349477 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2ccc3ccc0 0x55b2ccc3f6b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f70f8009ce0 tx=0x7f70f800b680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55e6b5ff63d3b911 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:28:57.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.420+0000 7f70f6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-09-23T09:28:57.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.420+0000 7f70f6ffd700 1 -- 172.21.15.82:0/4035349477 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f801d040 con 0x55b2ccc3ccc0 2023-09-23T09:28:57.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.420+0000 7f70f6ffd700 1 -- 172.21.15.82:0/4035349477 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(139..139 src has 1..139) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f70f8005250 con 0x55b2ccc3ccc0 2023-09-23T09:28:57.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.420+0000 7f7121792b80 1 -- 172.21.15.82:0/4035349477 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b2ccb879f0 con 0x55b2ccc3ccc0 2023-09-23T09:28:57.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.421+0000 7f70f6ffd700 1 -- 172.21.15.82:0/4035349477 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f70f8005450 con 0x55b2ccc3ccc0 2023-09-23T09:28:57.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.421+0000 7f7121792b80 10 client.27029 fetch_fsmap learned FSMap version 91 2023-09-23T09:28:57.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.421+0000 7f7121792b80 1 -- 172.21.15.82:0/4035349477 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=4+}) v3 -- 0x55b2cc9a3ce0 con 0x55b2ccc3ccc0 2023-09-23T09:28:57.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.421+0000 7f70f6ffd700 1 -- 172.21.15.82:0/4035349477 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b2ccb879f0 con 0x55b2ccc3ccc0 2023-09-23T09:28:57.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.422+0000 7f70f6ffd700 1 -- 172.21.15.82:0/4035349477 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 91) v1 ==== 7930+0+0 (secure 0 0 0) 0x7f70f8003820 con 0x55b2ccc3ccc0 2023-09-23T09:28:57.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.422+0000 7f7121792b80 10 client.27029 fetch_fsmap finished waiting for FSMap version 91 2023-09-23T09:28:57.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.422+0000 7f7121792b80 10 client.27029 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:28:57.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.422+0000 7f7121792b80 20 client.27029 populate_metadata read hostname 'smithi082' 2023-09-23T09:28:57.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.422+0000 7f7121792b80 1 --2- 172.21.15.82:0/4035349477 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55b2cccac450 0x55b2cccae870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:57.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.422+0000 7f7121792b80 4 client.27029 mds_command: new command op to 24557 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-09-23T09:28:57.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.422+0000 7f7121792b80 1 -- 172.21.15.82:0/4035349477 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55b2ccb480d0 con 0x55b2cccac450 2023-09-23T09:28:57.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.422+0000 7f7106ffd700 1 --2- 172.21.15.82:0/4035349477 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55b2cccac450 0x55b2cccae870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:57.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.423+0000 7f7106ffd700 1 --2- 172.21.15.82:0/4035349477 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55b2cccac450 0x55b2cccae870 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8aad7348d858169 server_cookie=c77a826fda2c1fd5 in_seq=0 out_seq=0 2023-09-23T09:28:57.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.423+0000 7f70f6ffd700 10 client.27029 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:28:57.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.424+0000 7f70f6ffd700 1 -- 172.21.15.82:0/4035349477 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55b2ccb480d0 con 0x55b2cccac450 2023-09-23T09:28:57.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.424+0000 7f70f6ffd700 10 client.27029 handle_command_reply: tid=0 2023-09-23T09:28:57.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.424+0000 7f7121792b80 1 client.27029 shutdown 2023-09-23T09:28:57.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.425+0000 7f7121792b80 1 -- 172.21.15.82:0/4035349477 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2ccc3ccc0 msgr2=0x55b2ccc3f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:28:57.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.425+0000 7f7121792b80 1 --2- 172.21.15.82:0/4035349477 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2ccc3ccc0 0x55b2ccc3f6b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f70f8009ce0 tx=0x7f70f800b680 comp rx=0 tx=0).stop 2023-09-23T09:28:57.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.425+0000 7f7121792b80 1 -- 172.21.15.82:0/4035349477 shutdown_connections 2023-09-23T09:28:57.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.425+0000 7f7121792b80 1 --2- 172.21.15.82:0/4035349477 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55b2cccac450 0x55b2cccae870 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:57.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.425+0000 7f7121792b80 1 --2- 172.21.15.82:0/4035349477 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2ccc42d20 0x55b2ccc4bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:57.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.425+0000 7f7121792b80 1 --2- 172.21.15.82:0/4035349477 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2ccc3ccc0 0x55b2ccc3f6b0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:57.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.425+0000 7f7121792b80 1 --2- 172.21.15.82:0/4035349477 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b2ccc42400 0x55b2ccc4b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:57.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.425+0000 7f7121792b80 1 -- 172.21.15.82:0/4035349477 >> 172.21.15.82:0/4035349477 conn(0x55b2ccbb1160 msgr2=0x55b2ccc31330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:28:57.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.425+0000 7f70f6ffd700 0 client.27029 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:28:57.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.426+0000 7f7121792b80 1 -- 172.21.15.82:0/4035349477 shutdown_connections 2023-09-23T09:28:57.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.426+0000 7f7121792b80 1 -- 172.21.15.82:0/4035349477 wait complete. 2023-09-23T09:28:57.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.427+0000 7f7121792b80 20 client.27029 trim_cache size 0 max 16384 2023-09-23T09:28:57.429 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:28:57.429 INFO:teuthology.orchestra.run.smithi082.stdout: "return_code": 0, 2023-09-23T09:28:57.429 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_tag": "dd6816ff-aa22-49b6-9046-f6286df10648", 2023-09-23T09:28:57.429 INFO:teuthology.orchestra.run.smithi082.stdout: "mode": "asynchronous" 2023-09-23T09:28:57.429 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:28:57.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.428+0000 7f710ddff700 1 -- 172.21.15.82:0/2742812600 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f70e80a0290 msgr2=0x7f70e80a2750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:28:57.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.428+0000 7f710ddff700 1 --2- 172.21.15.82:0/2742812600 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f70e80a0290 0x7f70e80a2750 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f7100005d30 tx=0x7f7100007320 comp rx=0 tx=0).stop 2023-09-23T09:28:57.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.428+0000 7f710ddff700 1 -- 172.21.15.82:0/2742812600 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7108108240 msgr2=0x7f710810e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:28:57.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.428+0000 7f710ddff700 1 --2- 172.21.15.82:0/2742812600 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7108108240 0x7f710810e120 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f70f0007ec0 tx=0x7f70f000d3b0 comp rx=0 tx=0).stop 2023-09-23T09:28:57.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.428+0000 7f710ddff700 1 -- 172.21.15.82:0/2742812600 shutdown_connections 2023-09-23T09:28:57.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.428+0000 7f710ddff700 1 --2- 172.21.15.82:0/2742812600 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f70e80a0290 0x7f70e80a2750 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:57.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.428+0000 7f710ddff700 1 --2- 172.21.15.82:0/2742812600 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7108113a70 0x7f71081a7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:57.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.428+0000 7f710ddff700 1 --2- 172.21.15.82:0/2742812600 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7108107920 0x7f710810dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:57.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.428+0000 7f710ddff700 1 --2- 172.21.15.82:0/2742812600 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7108108240 0x7f710810e120 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:57.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.428+0000 7f710ddff700 1 -- 172.21.15.82:0/2742812600 >> 172.21.15.82:0/2742812600 conn(0x7f710806cbe0 msgr2=0x7f7108118a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:28:57.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.428+0000 7f710ddff700 1 -- 172.21.15.82:0/2742812600 shutdown_connections 2023-09-23T09:28:57.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.429+0000 7f710ddff700 1 -- 172.21.15.82:0/2742812600 wait complete. 2023-09-23T09:28:57.460 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:28:57.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.812+0000 7fa5f31ff700 1 -- 172.21.15.82:0/1225849450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5ec0ff260 msgr2=0x7fa5ec10d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:28:57.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.812+0000 7fa5f31ff700 1 --2- 172.21.15.82:0/1225849450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5ec0ff260 0x7fa5ec10d760 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fa5e400b0d0 tx=0x7fa5e400b3e0 comp rx=0 tx=0).stop 2023-09-23T09:28:57.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.812+0000 7fa5f31ff700 1 -- 172.21.15.82:0/1225849450 shutdown_connections 2023-09-23T09:28:57.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.812+0000 7fa5f31ff700 1 --2- 172.21.15.82:0/1225849450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5ec0ff260 0x7fa5ec10d760 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:57.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.812+0000 7fa5f31ff700 1 --2- 172.21.15.82:0/1225849450 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa5ec1058d0 0x7fa5ec105cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:57.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.812+0000 7fa5f31ff700 1 --2- 172.21.15.82:0/1225849450 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa5ec0fe8a0 0x7fa5ec0fed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:57.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.812+0000 7fa5f31ff700 1 -- 172.21.15.82:0/1225849450 >> 172.21.15.82:0/1225849450 conn(0x7fa5ec076910 msgr2=0x7fa5ec0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:28:57.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.812+0000 7fa5f31ff700 1 -- 172.21.15.82:0/1225849450 shutdown_connections 2023-09-23T09:28:57.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.813+0000 7fa5f31ff700 1 -- 172.21.15.82:0/1225849450 wait complete. 2023-09-23T09:28:57.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.814+0000 7fa5f31ff700 1 Processor -- start 2023-09-23T09:28:57.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.814+0000 7fa5f31ff700 1 -- start start 2023-09-23T09:28:57.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.815+0000 7fa5f31ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa5ec0fe8a0 0x7fa5ec199480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:57.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.815+0000 7fa5f31ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5ec0ff260 0x7fa5ec1999e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:57.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.815+0000 7fa5f31ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa5ec1058d0 0x7fa5ec10c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:57.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.815+0000 7fa5f31ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ec10cc10 con 0x7fa5ec0ff260 2023-09-23T09:28:57.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.815+0000 7fa5f31ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ec10cd80 con 0x7fa5ec1058d0 2023-09-23T09:28:57.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.815+0000 7fa5f31ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ec10cf40 con 0x7fa5ec0fe8a0 2023-09-23T09:28:57.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.815+0000 7fa5f0f9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa5ec0fe8a0 0x7fa5ec199480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:57.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.815+0000 7fa5f0f9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa5ec0fe8a0 0x7fa5ec199480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:37000/0 (socket says 172.21.15.82:37000) 2023-09-23T09:28:57.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.815+0000 7fa5f0f9b700 1 -- 172.21.15.82:0/2402268909 learned_addr learned my addr 172.21.15.82:0/2402268909 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:28:57.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.815+0000 7fa5f179c700 1 --2- 172.21.15.82:0/2402268909 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa5ec1058d0 0x7fa5ec10c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:57.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.816+0000 7fa5ebfff700 1 --2- 172.21.15.82:0/2402268909 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5ec0ff260 0x7fa5ec1999e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:57.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.816+0000 7fa5ebfff700 1 -- 172.21.15.82:0/2402268909 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa5ec0fe8a0 msgr2=0x7fa5ec199480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:28:57.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.816+0000 7fa5ebfff700 1 --2- 172.21.15.82:0/2402268909 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa5ec0fe8a0 0x7fa5ec199480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:57.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.816+0000 7fa5ebfff700 1 -- 172.21.15.82:0/2402268909 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa5ec1058d0 msgr2=0x7fa5ec10c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:28:57.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.816+0000 7fa5ebfff700 1 --2- 172.21.15.82:0/2402268909 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa5ec1058d0 0x7fa5ec10c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:57.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.816+0000 7fa5ebfff700 1 -- 172.21.15.82:0/2402268909 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5e4009d00 con 0x7fa5ec0ff260 2023-09-23T09:28:57.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.817+0000 7fa5f179c700 1 --2- 172.21.15.82:0/2402268909 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa5ec1058d0 0x7fa5ec10c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:28:57.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.817+0000 7fa5f0f9b700 1 --2- 172.21.15.82:0/2402268909 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa5ec0fe8a0 0x7fa5ec199480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:28:57.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.817+0000 7fa5ebfff700 1 --2- 172.21.15.82:0/2402268909 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5ec0ff260 0x7fa5ec1999e0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fa5d8030a00 tx=0x7fa5d8030d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:28:57.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.818+0000 7fa5e9ffb700 1 -- 172.21.15.82:0/2402268909 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d800c9d0 con 0x7fa5ec0ff260 2023-09-23T09:28:57.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.818+0000 7fa5e9ffb700 1 -- 172.21.15.82:0/2402268909 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa5d8032440 con 0x7fa5ec0ff260 2023-09-23T09:28:57.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.818+0000 7fa5e9ffb700 1 -- 172.21.15.82:0/2402268909 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d803a680 con 0x7fa5ec0ff260 2023-09-23T09:28:57.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.818+0000 7fa5f31ff700 1 -- 172.21.15.82:0/2402268909 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5ec10d220 con 0x7fa5ec0ff260 2023-09-23T09:28:57.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.818+0000 7fa5f31ff700 1 -- 172.21.15.82:0/2402268909 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5ec19d4c0 con 0x7fa5ec0ff260 2023-09-23T09:28:57.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.825+0000 7fa606b3fb80 1 Processor -- start 2023-09-23T09:28:57.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.825+0000 7fa606b3fb80 1 -- start start 2023-09-23T09:28:57.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.825+0000 7fa606b3fb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563ff6165380 0x563ff6165760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:57.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.826+0000 7fa606b3fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563ff6165ca0 0x563ff615f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:57.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.826+0000 7fa606b3fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ff615fc40 0x563ff61600a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:57.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.826+0000 7fa606b3fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ff60c77b0 con 0x563ff6165ca0 2023-09-23T09:28:57.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.826+0000 7fa606b3fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ff60b8780 con 0x563ff615fc40 2023-09-23T09:28:57.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.826+0000 7fa606b3fb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ff60b60a0 con 0x563ff6165380 2023-09-23T09:28:57.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.826+0000 7fa5e9ffb700 1 -- 172.21.15.82:0/2402268909 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7fa5d80325b0 con 0x7fa5ec0ff260 2023-09-23T09:28:57.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.829+0000 7fa5e9ffb700 1 --2- 172.21.15.82:0/2402268909 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fa5dc0a0210 0x7fa5dc0a26d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:57.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.829+0000 7fa5f0f9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563ff6165ca0 0x563ff615f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:57.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.829+0000 7fa5f0f9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563ff6165ca0 0x563ff615f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44144/0 (socket says 172.21.15.82:44144) 2023-09-23T09:28:57.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.829+0000 7fa5f0f9b700 1 -- 172.21.15.82:0/622824903 learned_addr learned my addr 172.21.15.82:0/622824903 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:28:57.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.829+0000 7fa5e9ffb700 1 -- 172.21.15.82:0/2402268909 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fa5d8036070 con 0x7fa5ec0ff260 2023-09-23T09:28:57.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.829+0000 7fa5ebfff700 1 --2- 172.21.15.82:0/622824903 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ff615fc40 0x563ff61600a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:57.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.830+0000 7fa5f179c700 1 --2- 172.21.15.82:0/622824903 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563ff6165380 0x563ff6165760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:57.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.830+0000 7fa5ebfff700 1 -- 172.21.15.82:0/622824903 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563ff6165380 msgr2=0x563ff6165760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:28:57.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.830+0000 7fa5ebfff700 1 --2- 172.21.15.82:0/622824903 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563ff6165380 0x563ff6165760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:57.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.830+0000 7fa5ebfff700 1 -- 172.21.15.82:0/622824903 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563ff6165ca0 msgr2=0x563ff615f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:28:57.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.830+0000 7fa5ebfff700 1 --2- 172.21.15.82:0/622824903 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563ff6165ca0 0x563ff615f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:57.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.830+0000 7fa5ebfff700 1 -- 172.21.15.82:0/622824903 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563ff5f31630 con 0x563ff615fc40 2023-09-23T09:28:57.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.830+0000 7fa5f179c700 1 --2- 172.21.15.82:0/622824903 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563ff6165380 0x563ff6165760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T09:28:57.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.831+0000 7fa5ebfff700 1 --2- 172.21.15.82:0/622824903 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ff615fc40 0x563ff61600a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa5d80eade0 tx=0x7fa5d80baca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4064a9681fca78b6 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:28:57.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.831+0000 7fa5f179c700 1 --2- 172.21.15.82:0/2402268909 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fa5dc0a0210 0x7fa5dc0a26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:57.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.831+0000 7fa5d6ffd700 1 -- 172.21.15.82:0/622824903 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d80bb4a0 con 0x563ff615fc40 2023-09-23T09:28:57.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.831+0000 7fa5d6ffd700 1 -- 172.21.15.82:0/622824903 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa5d80bada0 con 0x563ff615fc40 2023-09-23T09:28:57.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.831+0000 7fa5d6ffd700 1 -- 172.21.15.82:0/622824903 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d80bb260 con 0x563ff615fc40 2023-09-23T09:28:57.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.833+0000 7fa606b3fb80 1 -- 172.21.15.82:0/622824903 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ff615fc40 msgr2=0x563ff61600a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:28:57.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.833+0000 7fa606b3fb80 1 --2- 172.21.15.82:0/622824903 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ff615fc40 0x563ff61600a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa5d80eade0 tx=0x7fa5d80baca0 comp rx=0 tx=0).stop 2023-09-23T09:28:57.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.833+0000 7fa5f179c700 1 --2- 172.21.15.82:0/2402268909 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fa5dc0a0210 0x7fa5dc0a26d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa5e4007f80 tx=0x7fa5e40099e0 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:28:57.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.833+0000 7fa606b3fb80 1 -- 172.21.15.82:0/622824903 shutdown_connections 2023-09-23T09:28:57.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.833+0000 7fa606b3fb80 1 --2- 172.21.15.82:0/622824903 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ff615fc40 0x563ff61600a0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:57.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.833+0000 7fa606b3fb80 1 --2- 172.21.15.82:0/622824903 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563ff6165380 0x563ff6165760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:57.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.833+0000 7fa606b3fb80 1 --2- 172.21.15.82:0/622824903 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563ff6165ca0 0x563ff615f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:57.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.833+0000 7fa606b3fb80 1 -- 172.21.15.82:0/622824903 >> 172.21.15.82:0/622824903 conn(0x563ff60d40e0 msgr2=0x563ff615a410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:28:57.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.834+0000 7fa606b3fb80 1 -- 172.21.15.82:0/622824903 shutdown_connections 2023-09-23T09:28:57.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.834+0000 7fa606b3fb80 1 -- 172.21.15.82:0/622824903 wait complete. 2023-09-23T09:28:57.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.835+0000 7fa606b3fb80 1 -- start start 2023-09-23T09:28:57.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.835+0000 7fa606b3fb80 1 Processor -- start 2023-09-23T09:28:57.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.836+0000 7fa606b3fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ff615fc40 0x563ff6168fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:57.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.836+0000 7fa606b3fb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563ff6165380 0x563ff6169520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:57.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.836+0000 7fa606b3fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563ff6165ca0 0x563ff6169a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:57.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.836+0000 7fa606b3fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ff60b1990 con 0x563ff6165ca0 2023-09-23T09:28:57.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.836+0000 7fa606b3fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ff604fbb0 con 0x563ff615fc40 2023-09-23T09:28:57.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.836+0000 7fa606b3fb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ff604f8b0 con 0x563ff6165380 2023-09-23T09:28:57.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.836+0000 7fa606b3fb80 10 client.0 _ll_register_callbacks cb 0x563ff5f99a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:28:57.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.839+0000 7fa5f179c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563ff6165ca0 0x563ff6169a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:57.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.839+0000 7fa5f179c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563ff6165ca0 0x563ff6169a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44154/0 (socket says 172.21.15.82:44154) 2023-09-23T09:28:57.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.839+0000 7fa5f179c700 1 -- 172.21.15.82:0/2367327255 learned_addr learned my addr 172.21.15.82:0/2367327255 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:28:57.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.839+0000 7fa5f179c700 1 -- 172.21.15.82:0/2367327255 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563ff6165380 msgr2=0x563ff6169520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:28:57.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.839+0000 7fa5f179c700 1 --2- 172.21.15.82:0/2367327255 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563ff6165380 0x563ff6169520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:57.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.839+0000 7fa5f179c700 1 -- 172.21.15.82:0/2367327255 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ff615fc40 msgr2=0x563ff6168fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:28:57.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.839+0000 7fa5f179c700 1 --2- 172.21.15.82:0/2367327255 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ff615fc40 0x563ff6168fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:57.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.839+0000 7fa5f179c700 1 -- 172.21.15.82:0/2367327255 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5ec19d4c0 con 0x563ff6165ca0 2023-09-23T09:28:57.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.840+0000 7fa5f179c700 1 --2- 172.21.15.82:0/2367327255 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563ff6165ca0 0x563ff6169a60 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fa5e400b0d0 tx=0x7fa5e400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc2f2e2a0a46aaf4 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:28:57.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.840+0000 7fa5cbfff700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:28:57.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.841+0000 7fa5cbfff700 1 -- 172.21.15.82:0/2367327255 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e400e040 con 0x563ff6165ca0 2023-09-23T09:28:57.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.841+0000 7fa5cbfff700 1 -- 172.21.15.82:0/2367327255 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(139..139 src has 1..139) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fa5e40052f0 con 0x563ff6165ca0 2023-09-23T09:28:57.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.841+0000 7fa606b3fb80 1 -- 172.21.15.82:0/2367327255 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563ff612f1c0 con 0x563ff6165ca0 2023-09-23T09:28:57.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.841+0000 7fa5cbfff700 1 -- 172.21.15.82:0/2367327255 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa5e40054b0 con 0x563ff6165ca0 2023-09-23T09:28:57.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.843+0000 7fa606b3fb80 10 client.17340 fetch_fsmap learned FSMap version 91 2023-09-23T09:28:57.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.843+0000 7fa606b3fb80 1 -- 172.21.15.82:0/2367327255 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=4+}) v3 -- 0x563ff5eddde0 con 0x563ff6165ca0 2023-09-23T09:28:57.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.844+0000 7fa5cbfff700 1 -- 172.21.15.82:0/2367327255 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x563ff612f1c0 con 0x563ff6165ca0 2023-09-23T09:28:57.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.844+0000 7fa5cbfff700 1 -- 172.21.15.82:0/2367327255 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 91) v1 ==== 7930+0+0 (secure 0 0 0) 0x7fa5e401c410 con 0x563ff6165ca0 2023-09-23T09:28:57.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.844+0000 7fa606b3fb80 10 client.17340 fetch_fsmap finished waiting for FSMap version 91 2023-09-23T09:28:57.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.844+0000 7fa606b3fb80 10 client.17340 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:28:57.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.844+0000 7fa606b3fb80 20 client.17340 populate_metadata read hostname 'smithi082' 2023-09-23T09:28:57.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.844+0000 7fa606b3fb80 1 --2- 172.21.15.82:0/2367327255 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x563ff618a710 0x563ff618cb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:57.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.844+0000 7fa606b3fb80 4 client.17340 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:28:57.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.844+0000 7fa606b3fb80 1 -- 172.21.15.82:0/2367327255 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563ff6057ba0 con 0x563ff618a710 2023-09-23T09:28:57.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.845+0000 7fa5f0f9b700 1 --2- 172.21.15.82:0/2367327255 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x563ff618a710 0x563ff618cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:57.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.845+0000 7fa5cbfff700 10 client.17340 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:28:57.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.845+0000 7fa5f0f9b700 1 --2- 172.21.15.82:0/2367327255 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x563ff618a710 0x563ff618cb50 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=628534d3a48b2cf0 server_cookie=946398ca5bfc2dca in_seq=0 out_seq=0 2023-09-23T09:28:57.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.846+0000 7fa5cbfff700 1 -- 172.21.15.82:0/2367327255 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x563ff6057ba0 con 0x563ff618a710 2023-09-23T09:28:57.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.846+0000 7fa5cbfff700 10 client.17340 handle_command_reply: tid=0 2023-09-23T09:28:57.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.846+0000 7fa606b3fb80 1 client.17340 shutdown 2023-09-23T09:28:57.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.847+0000 7fa606b3fb80 1 -- 172.21.15.82:0/2367327255 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563ff6165ca0 msgr2=0x563ff6169a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:28:57.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.847+0000 7fa606b3fb80 1 --2- 172.21.15.82:0/2367327255 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563ff6165ca0 0x563ff6169a60 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fa5e400b0d0 tx=0x7fa5e400b040 comp rx=0 tx=0).stop 2023-09-23T09:28:57.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.848+0000 7fa606b3fb80 1 -- 172.21.15.82:0/2367327255 shutdown_connections 2023-09-23T09:28:57.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.848+0000 7fa606b3fb80 1 --2- 172.21.15.82:0/2367327255 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x563ff618a710 0x563ff618cb50 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:57.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.848+0000 7fa606b3fb80 1 --2- 172.21.15.82:0/2367327255 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563ff6165ca0 0x563ff6169a60 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:57.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.848+0000 7fa606b3fb80 1 --2- 172.21.15.82:0/2367327255 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ff615fc40 0x563ff6168fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:57.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.848+0000 7fa606b3fb80 1 --2- 172.21.15.82:0/2367327255 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563ff6165380 0x563ff6169520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:57.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.848+0000 7fa606b3fb80 1 -- 172.21.15.82:0/2367327255 >> 172.21.15.82:0/2367327255 conn(0x563ff60d40e0 msgr2=0x563ff6154b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:28:57.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.848+0000 7fa5cbfff700 0 client.17340 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:28:57.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.849+0000 7fa606b3fb80 1 -- 172.21.15.82:0/2367327255 shutdown_connections 2023-09-23T09:28:57.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.849+0000 7fa606b3fb80 1 -- 172.21.15.82:0/2367327255 wait complete. 2023-09-23T09:28:57.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.849+0000 7fa606b3fb80 20 client.17340 trim_cache size 0 max 16384 2023-09-23T09:28:57.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.884+0000 7fa606b3fb80 1 Processor -- start 2023-09-23T09:28:57.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.884+0000 7fa606b3fb80 1 -- start start 2023-09-23T09:28:57.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.884+0000 7fa606b3fb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563ff615fc40 0x563ff615f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:57.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.885+0000 7fa606b3fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ff6165380 0x563ff61816f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:57.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.885+0000 7fa606b3fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563ff6165ca0 0x563ff61542b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:57.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.885+0000 7fa606b3fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ff5f33920 con 0x563ff6165ca0 2023-09-23T09:28:57.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.885+0000 7fa606b3fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ff615bd80 con 0x563ff6165380 2023-09-23T09:28:57.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.885+0000 7fa606b3fb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ff6156c80 con 0x563ff615fc40 2023-09-23T09:28:57.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.885+0000 7fa5ebfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ff6165380 0x563ff61816f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:57.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.885+0000 7fa5ebfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ff6165380 0x563ff61816f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:60742/0 (socket says 172.21.15.82:60742) 2023-09-23T09:28:57.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.885+0000 7fa5ebfff700 1 -- 172.21.15.82:0/2077718792 learned_addr learned my addr 172.21.15.82:0/2077718792 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:28:57.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.885+0000 7fa5f0f9b700 1 --2- 172.21.15.82:0/2077718792 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563ff615fc40 0x563ff615f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:57.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.886+0000 7fa5ebfff700 1 -- 172.21.15.82:0/2077718792 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563ff615fc40 msgr2=0x563ff615f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:28:57.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.886+0000 7fa5ebfff700 1 --2- 172.21.15.82:0/2077718792 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563ff615fc40 0x563ff615f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:57.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.886+0000 7fa5ebfff700 1 -- 172.21.15.82:0/2077718792 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563ff6165ca0 msgr2=0x563ff61542b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:28:57.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.886+0000 7fa5ebfff700 1 --2- 172.21.15.82:0/2077718792 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563ff6165ca0 0x563ff61542b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:57.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.886+0000 7fa5ebfff700 1 -- 172.21.15.82:0/2077718792 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563ff61602f0 con 0x563ff6165380 2023-09-23T09:28:57.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.886+0000 7fa5ebfff700 1 --2- 172.21.15.82:0/2077718792 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ff6165380 0x563ff61816f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa5d80bad30 tx=0x7fa5d80ba820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb04b57e784005af server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:28:57.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.887+0000 7fa5d77fe700 1 -- 172.21.15.82:0/2077718792 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d80bada0 con 0x563ff6165380 2023-09-23T09:28:57.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.887+0000 7fa5d77fe700 1 -- 172.21.15.82:0/2077718792 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa5d80d4020 con 0x563ff6165380 2023-09-23T09:28:57.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.887+0000 7fa5d77fe700 1 -- 172.21.15.82:0/2077718792 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d80ba290 con 0x563ff6165380 2023-09-23T09:28:57.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.889+0000 7fa606b3fb80 1 -- 172.21.15.82:0/2077718792 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ff6165380 msgr2=0x563ff61816f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:28:57.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.889+0000 7fa606b3fb80 1 --2- 172.21.15.82:0/2077718792 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ff6165380 0x563ff61816f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa5d80bad30 tx=0x7fa5d80ba820 comp rx=0 tx=0).stop 2023-09-23T09:28:57.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.894+0000 7fa606b3fb80 1 -- 172.21.15.82:0/2077718792 shutdown_connections 2023-09-23T09:28:57.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.894+0000 7fa606b3fb80 1 --2- 172.21.15.82:0/2077718792 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563ff6165ca0 0x563ff61542b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:57.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.894+0000 7fa606b3fb80 1 --2- 172.21.15.82:0/2077718792 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563ff615fc40 0x563ff615f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:57.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.894+0000 7fa606b3fb80 1 --2- 172.21.15.82:0/2077718792 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ff6165380 0x563ff61816f0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:57.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.894+0000 7fa606b3fb80 1 -- 172.21.15.82:0/2077718792 >> 172.21.15.82:0/2077718792 conn(0x563ff60d40e0 msgr2=0x563ff6169570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:28:57.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.894+0000 7fa606b3fb80 1 -- 172.21.15.82:0/2077718792 shutdown_connections 2023-09-23T09:28:57.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.894+0000 7fa606b3fb80 1 -- 172.21.15.82:0/2077718792 wait complete. 2023-09-23T09:28:57.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.895+0000 7fa606b3fb80 1 -- start start 2023-09-23T09:28:57.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.895+0000 7fa606b3fb80 1 Processor -- start 2023-09-23T09:28:57.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.896+0000 7fa606b3fb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563ff615fc40 0x563ff61d7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:57.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.896+0000 7fa606b3fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ff6165380 0x563ff61d8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:57.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.896+0000 7fa606b3fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563ff6165ca0 0x563ff61d2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:57.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.896+0000 7fa606b3fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ff61d2b10 con 0x563ff6165ca0 2023-09-23T09:28:57.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.896+0000 7fa606b3fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ff61d2c80 con 0x563ff6165380 2023-09-23T09:28:57.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.896+0000 7fa606b3fb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ff61d2e40 con 0x563ff615fc40 2023-09-23T09:28:57.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.896+0000 7fa606b3fb80 10 client.0 _ll_register_callbacks cb 0x7fa5e40078f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:28:57.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.897+0000 7fa5f0f9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563ff615fc40 0x563ff61d7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:57.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.897+0000 7fa5f0f9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563ff615fc40 0x563ff61d7ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:37020/0 (socket says 172.21.15.82:37020) 2023-09-23T09:28:57.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.897+0000 7fa5f0f9b700 1 -- 172.21.15.82:0/2036193919 learned_addr learned my addr 172.21.15.82:0/2036193919 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:28:57.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.897+0000 7fa5f179c700 1 --2- 172.21.15.82:0/2036193919 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563ff6165ca0 0x563ff61d2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:57.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.898+0000 7fa5f0f9b700 1 -- 172.21.15.82:0/2036193919 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ff6165380 msgr2=0x563ff61d8220 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-23T09:28:57.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.898+0000 7fa5f0f9b700 1 --2- 172.21.15.82:0/2036193919 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ff6165380 0x563ff61d8220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:57.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.898+0000 7fa5f0f9b700 1 -- 172.21.15.82:0/2036193919 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563ff6165ca0 msgr2=0x563ff61d2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:28:57.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.898+0000 7fa5f0f9b700 1 --2- 172.21.15.82:0/2036193919 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563ff6165ca0 0x563ff61d2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:57.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.898+0000 7fa5f0f9b700 1 -- 172.21.15.82:0/2036193919 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563ff5f31630 con 0x563ff615fc40 2023-09-23T09:28:57.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.899+0000 7fa5f0f9b700 1 --2- 172.21.15.82:0/2036193919 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563ff615fc40 0x563ff61d7ce0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x563ff618d4a0 tx=0x7fa5e0011320 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b9ecac29da977e3 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:28:57.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.899+0000 7fa5cbfff700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T09:28:57.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.899+0000 7fa5cbfff700 1 -- 172.21.15.82:0/2036193919 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e0016040 con 0x563ff615fc40 2023-09-23T09:28:57.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.899+0000 7fa5cbfff700 1 -- 172.21.15.82:0/2036193919 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(139..139 src has 1..139) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fa5e001bb00 con 0x563ff615fc40 2023-09-23T09:28:57.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.899+0000 7fa606b3fb80 1 -- 172.21.15.82:0/2036193919 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563ff6187120 con 0x563ff615fc40 2023-09-23T09:28:57.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.900+0000 7fa5cbfff700 1 -- 172.21.15.82:0/2036193919 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa5e001bcc0 con 0x563ff615fc40 2023-09-23T09:28:57.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.900+0000 7fa606b3fb80 10 client.27085 fetch_fsmap learned FSMap version 91 2023-09-23T09:28:57.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.900+0000 7fa606b3fb80 1 -- 172.21.15.82:0/2036193919 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=4+}) v3 -- 0x563ff5ec6c60 con 0x563ff615fc40 2023-09-23T09:28:57.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.901+0000 7fa5cbfff700 1 -- 172.21.15.82:0/2036193919 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x563ff6187120 con 0x563ff615fc40 2023-09-23T09:28:57.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.901+0000 7fa5cbfff700 1 -- 172.21.15.82:0/2036193919 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 91) v1 ==== 7930+0+0 (secure 0 0 0) 0x7fa5e00115c0 con 0x563ff615fc40 2023-09-23T09:28:57.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.901+0000 7fa606b3fb80 10 client.27085 fetch_fsmap finished waiting for FSMap version 91 2023-09-23T09:28:57.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.901+0000 7fa606b3fb80 10 client.27085 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:28:57.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.901+0000 7fa606b3fb80 20 client.27085 populate_metadata read hostname 'smithi082' 2023-09-23T09:28:57.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.901+0000 7fa606b3fb80 1 --2- 172.21.15.82:0/2036193919 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x563ff61dfc40 0x563ff61e2060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:28:57.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.901+0000 7fa606b3fb80 4 client.27085 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:28:57.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.901+0000 7fa606b3fb80 1 -- 172.21.15.82:0/2036193919 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x563ff61528b0 con 0x563ff61dfc40 2023-09-23T09:28:57.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.903+0000 7fa5ebfff700 1 --2- 172.21.15.82:0/2036193919 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x563ff61dfc40 0x563ff61e2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:28:57.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.904+0000 7fa5ebfff700 1 --2- 172.21.15.82:0/2036193919 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x563ff61dfc40 0x563ff61e2060 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a258920e4073baa server_cookie=de788ff880893c05 in_seq=0 out_seq=0 2023-09-23T09:28:57.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.904+0000 7fa5cbfff700 10 client.27085 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:28:57.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.905+0000 7fa5cbfff700 1 -- 172.21.15.82:0/2036193919 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x563ff61528b0 con 0x563ff61dfc40 2023-09-23T09:28:57.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.905+0000 7fa5cbfff700 10 client.27085 handle_command_reply: tid=0 2023-09-23T09:28:57.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.905+0000 7fa606b3fb80 1 client.27085 shutdown 2023-09-23T09:28:57.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.906+0000 7fa606b3fb80 1 -- 172.21.15.82:0/2036193919 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563ff615fc40 msgr2=0x563ff61d7ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:28:57.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.906+0000 7fa606b3fb80 1 --2- 172.21.15.82:0/2036193919 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563ff615fc40 0x563ff61d7ce0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x563ff618d4a0 tx=0x7fa5e0011320 comp rx=0 tx=0).stop 2023-09-23T09:28:57.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.907+0000 7fa606b3fb80 1 -- 172.21.15.82:0/2036193919 shutdown_connections 2023-09-23T09:28:57.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.907+0000 7fa606b3fb80 1 --2- 172.21.15.82:0/2036193919 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x563ff61dfc40 0x563ff61e2060 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:57.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.907+0000 7fa606b3fb80 1 --2- 172.21.15.82:0/2036193919 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563ff6165ca0 0x563ff61d2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:57.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.907+0000 7fa606b3fb80 1 --2- 172.21.15.82:0/2036193919 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563ff615fc40 0x563ff61d7ce0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:57.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.907+0000 7fa606b3fb80 1 --2- 172.21.15.82:0/2036193919 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ff6165380 0x563ff61d8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:57.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.907+0000 7fa606b3fb80 1 -- 172.21.15.82:0/2036193919 >> 172.21.15.82:0/2036193919 conn(0x563ff60d40e0 msgr2=0x563ff61542b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:28:57.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.907+0000 7fa5cbfff700 0 client.27085 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:28:57.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.907+0000 7fa606b3fb80 1 -- 172.21.15.82:0/2036193919 shutdown_connections 2023-09-23T09:28:57.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.907+0000 7fa606b3fb80 1 -- 172.21.15.82:0/2036193919 wait complete. 2023-09-23T09:28:57.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.908+0000 7fa606b3fb80 20 client.27085 trim_cache size 0 max 16384 2023-09-23T09:28:57.911 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:28:57.911 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-23T09:28:57.911 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:28:57.911 INFO:teuthology.orchestra.run.smithi082.stdout: "dd6816ff-aa22-49b6-9046-f6286df10648": { 2023-09-23T09:28:57.911 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:28:57.911 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "dd6816ff-aa22-49b6-9046-f6286df10648", 2023-09-23T09:28:57.911 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:28:57.911 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:28:57.911 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:28:57.912 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:28:57.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.910+0000 7fa5f31ff700 1 -- 172.21.15.82:0/2402268909 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fa5dc0a0210 msgr2=0x7fa5dc0a26d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:28:57.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.910+0000 7fa5f31ff700 1 --2- 172.21.15.82:0/2402268909 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fa5dc0a0210 0x7fa5dc0a26d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa5e4007f80 tx=0x7fa5e40099e0 comp rx=0 tx=0).stop 2023-09-23T09:28:57.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.910+0000 7fa5f31ff700 1 -- 172.21.15.82:0/2402268909 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5ec0ff260 msgr2=0x7fa5ec1999e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:28:57.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.910+0000 7fa5f31ff700 1 --2- 172.21.15.82:0/2402268909 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5ec0ff260 0x7fa5ec1999e0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fa5d8030a00 tx=0x7fa5d8030d10 comp rx=0 tx=0).stop 2023-09-23T09:28:57.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.910+0000 7fa5f31ff700 1 -- 172.21.15.82:0/2402268909 shutdown_connections 2023-09-23T09:28:57.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.910+0000 7fa5f31ff700 1 --2- 172.21.15.82:0/2402268909 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fa5dc0a0210 0x7fa5dc0a26d0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:57.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.910+0000 7fa5f31ff700 1 --2- 172.21.15.82:0/2402268909 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa5ec1058d0 0x7fa5ec10c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:57.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.910+0000 7fa5f31ff700 1 --2- 172.21.15.82:0/2402268909 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa5ec0fe8a0 0x7fa5ec199480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:28:57.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.910+0000 7fa5f31ff700 1 --2- 172.21.15.82:0/2402268909 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5ec0ff260 0x7fa5ec1999e0 secure :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fa5d8030a00 tx=0x7fa5d8030d10 comp rx=0 tx=0).stop 2023-09-23T09:28:57.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.910+0000 7fa5f31ff700 1 -- 172.21.15.82:0/2402268909 >> 172.21.15.82:0/2402268909 conn(0x7fa5ec076910 msgr2=0x7fa5ec103a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:28:57.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.910+0000 7fa5f31ff700 1 -- 172.21.15.82:0/2402268909 shutdown_connections 2023-09-23T09:28:57.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:28:57.911+0000 7fa5f31ff700 1 -- 172.21.15.82:0/2402268909 wait complete. 2023-09-23T09:28:57.946 INFO:tasks.cephfs.filesystem:scrub status for tag:dd6816ff-aa22-49b6-9046-f6286df10648 - {'path': '/', 'tag': 'dd6816ff-aa22-49b6-9046-f6286df10648', 'options': 'recursive,force'} 2023-09-23T09:28:58.315 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:28:57 smithi135 ceph-mon[99205]: scrub summary: active paths [/] 2023-09-23T09:28:58.315 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:28:57 smithi135 ceph-mon[99205]: scrub summary: idle+waiting paths [/] 2023-09-23T09:28:58.315 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:28:57 smithi135 ceph-mon[99205]: scrub summary: active paths [/] 2023-09-23T09:28:58.315 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:28:57 smithi135 ceph-mon[99205]: scrub summary: active paths [/] 2023-09-23T09:28:58.315 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:28:57 smithi135 ceph-mon[99205]: scrub summary: idle+waiting paths [/] 2023-09-23T09:28:58.315 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:28:57 smithi135 ceph-mon[99205]: scrub summary: idle+waiting paths [/] 2023-09-23T09:28:58.315 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:28:57 smithi135 ceph-mon[99205]: pgmap v1015: 97 pgs: 97 active+clean; 16 GiB data, 53 GiB used, 1020 GiB / 1.0 TiB avail; 755 KiB/s rd, 14 MiB/s wr, 983 op/s 2023-09-23T09:28:58.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:28:57 smithi082 ceph-mon[97694]: scrub summary: active paths [/] 2023-09-23T09:28:58.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:28:57 smithi082 ceph-mon[97694]: scrub summary: idle+waiting paths [/] 2023-09-23T09:28:58.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:28:57 smithi082 ceph-mon[97694]: scrub summary: active paths [/] 2023-09-23T09:28:58.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:28:57 smithi082 ceph-mon[97694]: scrub summary: active paths [/] 2023-09-23T09:28:58.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:28:57 smithi082 ceph-mon[97694]: scrub summary: idle+waiting paths [/] 2023-09-23T09:28:58.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:28:57 smithi082 ceph-mon[97694]: scrub summary: idle+waiting paths [/] 2023-09-23T09:28:58.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:28:57 smithi082 ceph-mon[97694]: pgmap v1015: 97 pgs: 97 active+clean; 16 GiB data, 53 GiB used, 1020 GiB / 1.0 TiB avail; 755 KiB/s rd, 14 MiB/s wr, 983 op/s 2023-09-23T09:28:58.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:28:57 smithi161 ceph-mon[99580]: scrub summary: active paths [/] 2023-09-23T09:28:58.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:28:57 smithi161 ceph-mon[99580]: scrub summary: idle+waiting paths [/] 2023-09-23T09:28:58.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:28:57 smithi161 ceph-mon[99580]: scrub summary: active paths [/] 2023-09-23T09:28:58.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:28:57 smithi161 ceph-mon[99580]: scrub summary: active paths [/] 2023-09-23T09:28:58.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:28:57 smithi161 ceph-mon[99580]: scrub summary: idle+waiting paths [/] 2023-09-23T09:28:58.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:28:57 smithi161 ceph-mon[99580]: scrub summary: idle+waiting paths [/] 2023-09-23T09:28:58.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:28:57 smithi161 ceph-mon[99580]: pgmap v1015: 97 pgs: 97 active+clean; 16 GiB data, 53 GiB used, 1020 GiB / 1.0 TiB avail; 755 KiB/s rd, 14 MiB/s wr, 983 op/s 2023-09-23T09:28:59.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:28:58 smithi135 ceph-mon[99205]: scrub queued for path: / 2023-09-23T09:28:59.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:28:58 smithi135 ceph-mon[99205]: scrub summary: idle+waiting paths [/] 2023-09-23T09:28:59.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:28:58 smithi135 ceph-mon[99205]: scrub summary: active paths [/] 2023-09-23T09:28:59.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:28:58 smithi135 ceph-mon[99205]: scrub summary: active paths [/] 2023-09-23T09:28:59.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:28:58 smithi135 ceph-mon[99205]: scrub summary: active paths [/] 2023-09-23T09:28:59.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:28:58 smithi135 ceph-mon[99205]: scrub summary: idle+waiting paths [/] 2023-09-23T09:28:59.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:28:58 smithi135 ceph-mon[99205]: scrub summary: idle+waiting paths [/] 2023-09-23T09:28:59.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:28:58 smithi082 ceph-mon[97694]: scrub queued for path: / 2023-09-23T09:28:59.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:28:58 smithi082 ceph-mon[97694]: scrub summary: idle+waiting paths [/] 2023-09-23T09:28:59.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:28:58 smithi082 ceph-mon[97694]: scrub summary: active paths [/] 2023-09-23T09:28:59.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:28:58 smithi082 ceph-mon[97694]: scrub summary: active paths [/] 2023-09-23T09:28:59.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:28:58 smithi082 ceph-mon[97694]: scrub summary: active paths [/] 2023-09-23T09:28:59.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:28:58 smithi082 ceph-mon[97694]: scrub summary: idle+waiting paths [/] 2023-09-23T09:28:59.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:28:58 smithi082 ceph-mon[97694]: scrub summary: idle+waiting paths [/] 2023-09-23T09:28:59.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:28:59 smithi161 ceph-mon[99580]: scrub queued for path: / 2023-09-23T09:28:59.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:28:59 smithi161 ceph-mon[99580]: scrub summary: idle+waiting paths [/] 2023-09-23T09:28:59.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:28:59 smithi161 ceph-mon[99580]: scrub summary: active paths [/] 2023-09-23T09:28:59.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:28:59 smithi161 ceph-mon[99580]: scrub summary: active paths [/] 2023-09-23T09:28:59.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:28:59 smithi161 ceph-mon[99580]: scrub summary: active paths [/] 2023-09-23T09:28:59.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:28:59 smithi161 ceph-mon[99580]: scrub summary: idle+waiting paths [/] 2023-09-23T09:28:59.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:28:59 smithi161 ceph-mon[99580]: scrub summary: idle+waiting paths [/] 2023-09-23T09:29:00.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:29:00 smithi135 ceph-mon[99205]: pgmap v1016: 97 pgs: 97 active+clean; 16 GiB data, 53 GiB used, 1020 GiB / 1.0 TiB avail; 1.0 MiB/s rd, 21 MiB/s wr, 1.48k op/s 2023-09-23T09:29:00.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:29:00 smithi082 ceph-mon[97694]: pgmap v1016: 97 pgs: 97 active+clean; 16 GiB data, 53 GiB used, 1020 GiB / 1.0 TiB avail; 1.0 MiB/s rd, 21 MiB/s wr, 1.48k op/s 2023-09-23T09:29:00.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:29:00 smithi161 ceph-mon[99580]: pgmap v1016: 97 pgs: 97 active+clean; 16 GiB data, 53 GiB used, 1020 GiB / 1.0 TiB avail; 1.0 MiB/s rd, 21 MiB/s wr, 1.48k op/s 2023-09-23T09:29:00.827 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 110.0 s, 578.2 tps, lat 167.396 ms stddev 49.139 2023-09-23T09:29:02.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:29:02 smithi161 ceph-mon[99580]: pgmap v1017: 97 pgs: 97 active+clean; 16 GiB data, 53 GiB used, 1020 GiB / 1.0 TiB avail; 643 KiB/s rd, 14 MiB/s wr, 1.03k op/s 2023-09-23T09:29:03.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:29:02 smithi135 ceph-mon[99205]: pgmap v1017: 97 pgs: 97 active+clean; 16 GiB data, 53 GiB used, 1020 GiB / 1.0 TiB avail; 643 KiB/s rd, 14 MiB/s wr, 1.03k op/s 2023-09-23T09:29:03.122 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:29:02 smithi082 ceph-mon[97694]: pgmap v1017: 97 pgs: 97 active+clean; 16 GiB data, 53 GiB used, 1020 GiB / 1.0 TiB avail; 643 KiB/s rd, 14 MiB/s wr, 1.03k op/s 2023-09-23T09:29:04.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:29:04 smithi161 ceph-mon[99580]: pgmap v1018: 97 pgs: 97 active+clean; 16 GiB data, 53 GiB used, 1020 GiB / 1.0 TiB avail; 643 KiB/s rd, 14 MiB/s wr, 1.03k op/s 2023-09-23T09:29:05.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:29:04 smithi135 ceph-mon[99205]: pgmap v1018: 97 pgs: 97 active+clean; 16 GiB data, 53 GiB used, 1020 GiB / 1.0 TiB avail; 643 KiB/s rd, 14 MiB/s wr, 1.03k op/s 2023-09-23T09:29:05.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:29:04 smithi082 ceph-mon[97694]: pgmap v1018: 97 pgs: 97 active+clean; 16 GiB data, 53 GiB used, 1020 GiB / 1.0 TiB avail; 643 KiB/s rd, 14 MiB/s wr, 1.03k op/s 2023-09-23T09:29:05.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 115.0 s, 326.0 tps, lat 313.860 ms stddev 461.819 2023-09-23T09:29:06.899 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:29:06 smithi161 ceph-mon[99580]: pgmap v1019: 97 pgs: 97 active+clean; 16 GiB data, 53 GiB used, 1020 GiB / 1.0 TiB avail; 933 KiB/s rd, 20 MiB/s wr, 1.47k op/s 2023-09-23T09:29:07.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:29:06 smithi135 ceph-mon[99205]: pgmap v1019: 97 pgs: 97 active+clean; 16 GiB data, 53 GiB used, 1020 GiB / 1.0 TiB avail; 933 KiB/s rd, 20 MiB/s wr, 1.47k op/s 2023-09-23T09:29:07.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:29:06 smithi082 ceph-mon[97694]: pgmap v1019: 97 pgs: 97 active+clean; 16 GiB data, 53 GiB used, 1020 GiB / 1.0 TiB avail; 933 KiB/s rd, 20 MiB/s wr, 1.47k op/s 2023-09-23T09:29:08.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:29:07 smithi135 ceph-mon[99205]: osdmap e140: 12 total, 12 up, 12 in 2023-09-23T09:29:08.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:29:07 smithi082 ceph-mon[97694]: osdmap e140: 12 total, 12 up, 12 in 2023-09-23T09:29:08.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:29:07 smithi161 ceph-mon[99580]: osdmap e140: 12 total, 12 up, 12 in 2023-09-23T09:29:09.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:29:08 smithi135 ceph-mon[99205]: pgmap v1021: 97 pgs: 97 active+clean; 16 GiB data, 53 GiB used, 1020 GiB / 1.0 TiB avail; 729 KiB/s rd, 17 MiB/s wr, 1.12k op/s 2023-09-23T09:29:09.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:29:08 smithi135 ceph-mon[99205]: scrub summary: active paths [/] 2023-09-23T09:29:09.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:29:08 smithi135 ceph-mon[99205]: scrub summary: active paths [/] 2023-09-23T09:29:09.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:29:08 smithi135 ceph-mon[99205]: scrub summary: idle+waiting paths [/] 2023-09-23T09:29:09.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:29:08 smithi135 ceph-mon[99205]: scrub summary: idle+waiting paths [/] 2023-09-23T09:29:09.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:29:08 smithi082 ceph-mon[97694]: pgmap v1021: 97 pgs: 97 active+clean; 16 GiB data, 53 GiB used, 1020 GiB / 1.0 TiB avail; 729 KiB/s rd, 17 MiB/s wr, 1.12k op/s 2023-09-23T09:29:09.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:29:08 smithi082 ceph-mon[97694]: scrub summary: active paths [/] 2023-09-23T09:29:09.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:29:08 smithi082 ceph-mon[97694]: scrub summary: active paths [/] 2023-09-23T09:29:09.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:29:08 smithi082 ceph-mon[97694]: scrub summary: idle+waiting paths [/] 2023-09-23T09:29:09.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:29:08 smithi082 ceph-mon[97694]: scrub summary: idle+waiting paths [/] 2023-09-23T09:29:09.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:29:08 smithi161 ceph-mon[99580]: pgmap v1021: 97 pgs: 97 active+clean; 16 GiB data, 53 GiB used, 1020 GiB / 1.0 TiB avail; 729 KiB/s rd, 17 MiB/s wr, 1.12k op/s 2023-09-23T09:29:09.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:29:08 smithi161 ceph-mon[99580]: scrub summary: active paths [/] 2023-09-23T09:29:09.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:29:08 smithi161 ceph-mon[99580]: scrub summary: active paths [/] 2023-09-23T09:29:09.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:29:08 smithi161 ceph-mon[99580]: scrub summary: idle+waiting paths [/] 2023-09-23T09:29:09.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:29:08 smithi161 ceph-mon[99580]: scrub summary: idle+waiting paths [/] 2023-09-23T09:29:10.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:29:09 smithi135 ceph-mon[99205]: scrub summary: active paths [/] 2023-09-23T09:29:10.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:29:09 smithi135 ceph-mon[99205]: scrub summary: idle+waiting paths [/] 2023-09-23T09:29:10.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:29:09 smithi135 ceph-mon[99205]: scrub summary: idle+waiting paths [/] 2023-09-23T09:29:10.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:29:09 smithi082 ceph-mon[97694]: scrub summary: active paths [/] 2023-09-23T09:29:10.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:29:09 smithi082 ceph-mon[97694]: scrub summary: idle+waiting paths [/] 2023-09-23T09:29:10.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:29:09 smithi082 ceph-mon[97694]: scrub summary: idle+waiting paths [/] 2023-09-23T09:29:10.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:29:09 smithi161 ceph-mon[99580]: scrub summary: active paths [/] 2023-09-23T09:29:10.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:29:09 smithi161 ceph-mon[99580]: scrub summary: idle+waiting paths [/] 2023-09-23T09:29:10.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:29:09 smithi161 ceph-mon[99580]: scrub summary: idle+waiting paths [/] 2023-09-23T09:29:10.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 120.0 s, 285.0 tps, lat 355.693 ms stddev 706.191 2023-09-23T09:29:11.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:29:10 smithi135 ceph-mon[99205]: pgmap v1022: 97 pgs: 97 active+clean; 16 GiB data, 53 GiB used, 1020 GiB / 1.0 TiB avail; 625 KiB/s rd, 11 MiB/s wr, 742 op/s 2023-09-23T09:29:11.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:29:10 smithi082 ceph-mon[97694]: pgmap v1022: 97 pgs: 97 active+clean; 16 GiB data, 53 GiB used, 1020 GiB / 1.0 TiB avail; 625 KiB/s rd, 11 MiB/s wr, 742 op/s 2023-09-23T09:29:11.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:29:10 smithi161 ceph-mon[99580]: pgmap v1022: 97 pgs: 97 active+clean; 16 GiB data, 53 GiB used, 1020 GiB / 1.0 TiB avail; 625 KiB/s rd, 11 MiB/s wr, 742 op/s 2023-09-23T09:29:13.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:29:12 smithi135 ceph-mon[99205]: pgmap v1023: 97 pgs: 97 active+clean; 16 GiB data, 53 GiB used, 1020 GiB / 1.0 TiB avail; 660 KiB/s rd, 13 MiB/s wr, 779 op/s 2023-09-23T09:29:13.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:29:12 smithi135 ceph-mon[99205]: osdmap e141: 12 total, 12 up, 12 in 2023-09-23T09:29:13.122 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:29:12 smithi082 ceph-mon[97694]: pgmap v1023: 97 pgs: 97 active+clean; 16 GiB data, 53 GiB used, 1020 GiB / 1.0 TiB avail; 660 KiB/s rd, 13 MiB/s wr, 779 op/s 2023-09-23T09:29:13.122 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:29:12 smithi082 ceph-mon[97694]: osdmap e141: 12 total, 12 up, 12 in 2023-09-23T09:29:13.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:29:12 smithi161 ceph-mon[99580]: pgmap v1023: 97 pgs: 97 active+clean; 16 GiB data, 53 GiB used, 1020 GiB / 1.0 TiB avail; 660 KiB/s rd, 13 MiB/s wr, 779 op/s 2023-09-23T09:29:13.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:29:12 smithi161 ceph-mon[99580]: osdmap e141: 12 total, 12 up, 12 in 2023-09-23T09:29:15.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:29:14 smithi135 ceph-mon[99205]: pgmap v1025: 97 pgs: 97 active+clean; 16 GiB data, 53 GiB used, 1020 GiB / 1.0 TiB avail; 390 KiB/s rd, 5.7 MiB/s wr, 316 op/s 2023-09-23T09:29:15.123 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:29:14 smithi082 ceph-mon[97694]: pgmap v1025: 97 pgs: 97 active+clean; 16 GiB data, 53 GiB used, 1020 GiB / 1.0 TiB avail; 390 KiB/s rd, 5.7 MiB/s wr, 316 op/s 2023-09-23T09:29:15.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:29:14 smithi161 ceph-mon[99580]: pgmap v1025: 97 pgs: 97 active+clean; 16 GiB data, 53 GiB used, 1020 GiB / 1.0 TiB avail; 390 KiB/s rd, 5.7 MiB/s wr, 316 op/s 2023-09-23T09:29:15.827 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 125.0 s, 531.8 tps, lat 182.457 ms stddev 61.578 2023-09-23T09:29:16.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:29:15 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:29:16.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:29:15 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:29:16.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:29:15 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:29:17.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:29:16 smithi135 ceph-mon[99205]: pgmap v1026: 97 pgs: 97 active+clean; 16 GiB data, 53 GiB used, 1020 GiB / 1.0 TiB avail; 1.1 MiB/s rd, 14 MiB/s wr, 986 op/s 2023-09-23T09:29:17.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:29:16 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:29:17.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:29:16 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:29:17.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:29:16 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:29:17.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:29:16 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:29:17.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:29:16 smithi082 ceph-mon[97694]: pgmap v1026: 97 pgs: 97 active+clean; 16 GiB data, 53 GiB used, 1020 GiB / 1.0 TiB avail; 1.1 MiB/s rd, 14 MiB/s wr, 986 op/s 2023-09-23T09:29:17.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:29:16 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:29:17.122 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:29:16 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:29:17.122 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:29:16 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:29:17.122 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:29:16 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:29:17.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:29:16 smithi161 ceph-mon[99580]: pgmap v1026: 97 pgs: 97 active+clean; 16 GiB data, 53 GiB used, 1020 GiB / 1.0 TiB avail; 1.1 MiB/s rd, 14 MiB/s wr, 986 op/s 2023-09-23T09:29:17.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:29:16 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:29:17.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:29:16 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:29:17.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:29:16 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:29:17.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:29:16 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:29:18.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:29:18 smithi135 ceph-mon[99205]: pgmap v1027: 97 pgs: 97 active+clean; 16 GiB data, 53 GiB used, 1020 GiB / 1.0 TiB avail; 995 KiB/s rd, 13 MiB/s wr, 879 op/s 2023-09-23T09:29:18.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:29:18 smithi082 ceph-mon[97694]: pgmap v1027: 97 pgs: 97 active+clean; 16 GiB data, 53 GiB used, 1020 GiB / 1.0 TiB avail; 995 KiB/s rd, 13 MiB/s wr, 879 op/s 2023-09-23T09:29:18.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:29:18 smithi161 ceph-mon[99580]: pgmap v1027: 97 pgs: 97 active+clean; 16 GiB data, 53 GiB used, 1020 GiB / 1.0 TiB avail; 995 KiB/s rd, 13 MiB/s wr, 879 op/s 2023-09-23T09:29:19.374 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:29:19 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:29:19.374 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:29:19 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:29:19.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:29:19 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:29:19.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:29:19 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:29:19.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:29:19 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:29:19.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:29:19 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:29:20.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:29:20 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:29:20.372 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:29:20 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:29:20.372 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:29:20 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:29:20.372 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:29:20 smithi082 ceph-mon[97694]: pgmap v1028: 97 pgs: 97 active+clean; 16 GiB data, 54 GiB used, 1019 GiB / 1.0 TiB avail; 1.3 MiB/s rd, 17 MiB/s wr, 1.19k op/s 2023-09-23T09:29:20.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:29:20 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:29:20.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:29:20 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:29:20.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:29:20 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:29:20.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:29:20 smithi161 ceph-mon[99580]: pgmap v1028: 97 pgs: 97 active+clean; 16 GiB data, 54 GiB used, 1019 GiB / 1.0 TiB avail; 1.3 MiB/s rd, 17 MiB/s wr, 1.19k op/s 2023-09-23T09:29:20.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:29:20 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:29:20.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:29:20 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:29:20.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:29:20 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:29:20.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:29:20 smithi135 ceph-mon[99205]: pgmap v1028: 97 pgs: 97 active+clean; 16 GiB data, 54 GiB used, 1019 GiB / 1.0 TiB avail; 1.3 MiB/s rd, 17 MiB/s wr, 1.19k op/s 2023-09-23T09:29:20.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 130.0 s, 561.4 tps, lat 183.038 ms stddev 56.278 2023-09-23T09:29:21.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:29:21 smithi135 ceph-mon[99205]: scrub summary: idle 2023-09-23T09:29:21.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:29:21 smithi082 ceph-mon[97694]: scrub summary: idle 2023-09-23T09:29:21.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:29:21 smithi161 ceph-mon[99580]: scrub summary: idle 2023-09-23T09:29:22.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:29:22 smithi135 ceph-mon[99205]: scrub summary: idle 2023-09-23T09:29:22.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:29:22 smithi135 ceph-mon[99205]: scrub summary: idle 2023-09-23T09:29:22.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:29:22 smithi135 ceph-mon[99205]: scrub summary: idle 2023-09-23T09:29:22.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:29:22 smithi135 ceph-mon[99205]: scrub summary: idle 2023-09-23T09:29:22.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:29:22 smithi135 ceph-mon[99205]: pgmap v1029: 97 pgs: 97 active+clean; 16 GiB data, 54 GiB used, 1019 GiB / 1.0 TiB avail; 1.3 MiB/s rd, 16 MiB/s wr, 1.24k op/s 2023-09-23T09:29:22.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:29:22 smithi082 ceph-mon[97694]: scrub summary: idle 2023-09-23T09:29:22.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:29:22 smithi082 ceph-mon[97694]: scrub summary: idle 2023-09-23T09:29:22.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:29:22 smithi082 ceph-mon[97694]: scrub summary: idle 2023-09-23T09:29:22.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:29:22 smithi082 ceph-mon[97694]: scrub summary: idle 2023-09-23T09:29:22.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:29:22 smithi082 ceph-mon[97694]: pgmap v1029: 97 pgs: 97 active+clean; 16 GiB data, 54 GiB used, 1019 GiB / 1.0 TiB avail; 1.3 MiB/s rd, 16 MiB/s wr, 1.24k op/s 2023-09-23T09:29:22.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:29:22 smithi161 ceph-mon[99580]: scrub summary: idle 2023-09-23T09:29:22.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:29:22 smithi161 ceph-mon[99580]: scrub summary: idle 2023-09-23T09:29:22.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:29:22 smithi161 ceph-mon[99580]: scrub summary: idle 2023-09-23T09:29:22.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:29:22 smithi161 ceph-mon[99580]: scrub summary: idle 2023-09-23T09:29:22.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:29:22 smithi161 ceph-mon[99580]: pgmap v1029: 97 pgs: 97 active+clean; 16 GiB data, 54 GiB used, 1019 GiB / 1.0 TiB avail; 1.3 MiB/s rd, 16 MiB/s wr, 1.24k op/s 2023-09-23T09:29:24.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:29:24 smithi161 ceph-mon[99580]: pgmap v1030: 97 pgs: 97 active+clean; 16 GiB data, 54 GiB used, 1019 GiB / 1.0 TiB avail; 1.1 MiB/s rd, 14 MiB/s wr, 1.07k op/s 2023-09-23T09:29:25.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:29:24 smithi135 ceph-mon[99205]: pgmap v1030: 97 pgs: 97 active+clean; 16 GiB data, 54 GiB used, 1019 GiB / 1.0 TiB avail; 1.1 MiB/s rd, 14 MiB/s wr, 1.07k op/s 2023-09-23T09:29:25.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:29:24 smithi082 ceph-mon[97694]: pgmap v1030: 97 pgs: 97 active+clean; 16 GiB data, 54 GiB used, 1019 GiB / 1.0 TiB avail; 1.1 MiB/s rd, 14 MiB/s wr, 1.07k op/s 2023-09-23T09:29:25.829 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 135.0 s, 564.3 tps, lat 177.428 ms stddev 122.621 2023-09-23T09:29:27.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:29:26 smithi135 ceph-mon[99205]: pgmap v1031: 97 pgs: 97 active+clean; 16 GiB data, 54 GiB used, 1019 GiB / 1.0 TiB avail; 1.5 MiB/s rd, 20 MiB/s wr, 1.54k op/s 2023-09-23T09:29:27.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:29:26 smithi082 ceph-mon[97694]: pgmap v1031: 97 pgs: 97 active+clean; 16 GiB data, 54 GiB used, 1019 GiB / 1.0 TiB avail; 1.5 MiB/s rd, 20 MiB/s wr, 1.54k op/s 2023-09-23T09:29:27.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:29:26 smithi161 ceph-mon[99580]: pgmap v1031: 97 pgs: 97 active+clean; 16 GiB data, 54 GiB used, 1019 GiB / 1.0 TiB avail; 1.5 MiB/s rd, 20 MiB/s wr, 1.54k op/s 2023-09-23T09:29:27.947 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:29:28.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.296+0000 7f56d5dff700 1 -- 172.21.15.82:0/3381270672 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f56d0106850 msgr2=0x7f56d0106c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:29:28.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.296+0000 7f56d5dff700 1 --2- 172.21.15.82:0/3381270672 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f56d0106850 0x7f56d0106c30 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f56c00131e0 tx=0x7f56c0011f90 comp rx=0 tx=0).stop 2023-09-23T09:29:28.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.297+0000 7f56d5dff700 1 -- 172.21.15.82:0/3381270672 shutdown_connections 2023-09-23T09:29:28.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.297+0000 7f56d5dff700 1 --2- 172.21.15.82:0/3381270672 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56d0101200 0x7f56d010d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:28.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.297+0000 7f56d5dff700 1 --2- 172.21.15.82:0/3381270672 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f56d0106850 0x7f56d0106c30 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:28.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.297+0000 7f56d5dff700 1 --2- 172.21.15.82:0/3381270672 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f56d0100840 0x7f56d0100cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:28.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.297+0000 7f56d5dff700 1 -- 172.21.15.82:0/3381270672 >> 172.21.15.82:0/3381270672 conn(0x7f56d00fc330 msgr2=0x7f56d00fe750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:29:28.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.297+0000 7f56d5dff700 1 -- 172.21.15.82:0/3381270672 shutdown_connections 2023-09-23T09:29:28.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.297+0000 7f56d5dff700 1 -- 172.21.15.82:0/3381270672 wait complete. 2023-09-23T09:29:28.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.299+0000 7f56d5dff700 1 Processor -- start 2023-09-23T09:29:28.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.299+0000 7f56d5dff700 1 -- start start 2023-09-23T09:29:28.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.300+0000 7f56d5dff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56d0100840 0x7f56d019a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:28.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.300+0000 7f56d5dff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f56d0101200 0x7f56d019aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:28.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.300+0000 7f56d5dff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f56d0106850 0x7f56d0194590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:28.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.300+0000 7f56d5dff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56d0194c00 con 0x7f56d0100840 2023-09-23T09:29:28.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.300+0000 7f56d5dff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56d0194d70 con 0x7f56d0101200 2023-09-23T09:29:28.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.300+0000 7f56d5dff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56d0194f30 con 0x7f56d0106850 2023-09-23T09:29:28.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.300+0000 7f56ceffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f56d0101200 0x7f56d019aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:28.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.300+0000 7f56ceffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f56d0101200 0x7f56d019aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:44784/0 (socket says 172.21.15.82:44784) 2023-09-23T09:29:28.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.300+0000 7f56ceffd700 1 -- 172.21.15.82:0/2697109032 learned_addr learned my addr 172.21.15.82:0/2697109032 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:29:28.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.301+0000 7f56cffff700 1 --2- 172.21.15.82:0/2697109032 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f56d0106850 0x7f56d0194590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:28.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.301+0000 7f56ceffd700 1 -- 172.21.15.82:0/2697109032 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f56d0106850 msgr2=0x7f56d0194590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:29:28.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.301+0000 7f56ceffd700 1 --2- 172.21.15.82:0/2697109032 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f56d0106850 0x7f56d0194590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:28.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.301+0000 7f56ceffd700 1 -- 172.21.15.82:0/2697109032 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56d0100840 msgr2=0x7f56d019a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:29:28.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.301+0000 7f56ceffd700 1 --2- 172.21.15.82:0/2697109032 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56d0100840 0x7f56d019a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:28.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.301+0000 7f56ceffd700 1 -- 172.21.15.82:0/2697109032 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56c0011e00 con 0x7f56d0101200 2023-09-23T09:29:28.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.301+0000 7f56cffff700 1 --2- 172.21.15.82:0/2697109032 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f56d0106850 0x7f56d0194590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T09:29:28.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.302+0000 7f56ceffd700 1 --2- 172.21.15.82:0/2697109032 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f56d0101200 0x7f56d019aa60 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f56c400d950 tx=0x7f56c400dd10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:29:28.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.303+0000 7f56ccff9700 1 -- 172.21.15.82:0/2697109032 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c4009b40 con 0x7f56d0101200 2023-09-23T09:29:28.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.303+0000 7f56ccff9700 1 -- 172.21.15.82:0/2697109032 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f56c4009ca0 con 0x7f56d0101200 2023-09-23T09:29:28.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.303+0000 7f56d5dff700 1 -- 172.21.15.82:0/2697109032 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56d0195210 con 0x7f56d0101200 2023-09-23T09:29:28.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.303+0000 7f56ccff9700 1 -- 172.21.15.82:0/2697109032 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c400f620 con 0x7f56d0101200 2023-09-23T09:29:28.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.303+0000 7f56d5dff700 1 -- 172.21.15.82:0/2697109032 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56d01b2520 con 0x7f56d0101200 2023-09-23T09:29:28.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:29:28 smithi135 ceph-mon[99205]: pgmap v1032: 97 pgs: 97 active+clean; 16 GiB data, 54 GiB used, 1019 GiB / 1.0 TiB avail; 964 KiB/s rd, 13 MiB/s wr, 1.02k op/s 2023-09-23T09:29:28.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.309+0000 7f56ccff9700 1 -- 172.21.15.82:0/2697109032 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f56c4010460 con 0x7f56d0101200 2023-09-23T09:29:28.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.311+0000 7f56e9765b80 1 Processor -- start 2023-09-23T09:29:28.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.312+0000 7f56e9765b80 1 -- start start 2023-09-23T09:29:28.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.312+0000 7f56e9765b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55889ba1a380 0x55889ba1a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:28.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.312+0000 7f56e9765b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55889ba1aca0 0x55889ba14700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:28.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.312+0000 7f56e9765b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55889ba14c40 0x55889ba150a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:28.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.312+0000 7f56e9765b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55889b97c7b0 con 0x55889ba1a380 2023-09-23T09:29:28.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.312+0000 7f56e9765b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55889b96d780 con 0x55889ba14c40 2023-09-23T09:29:28.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.312+0000 7f56e9765b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55889b96b0a0 con 0x55889ba1aca0 2023-09-23T09:29:28.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.314+0000 7f56cffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55889ba1a380 0x55889ba1a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:28.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.314+0000 7f56cf7fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55889ba1aca0 0x55889ba14700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:28.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.314+0000 7f56cffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55889ba1a380 0x55889ba1a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42232/0 (socket says 172.21.15.82:42232) 2023-09-23T09:29:28.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.314+0000 7f56cffff700 1 -- 172.21.15.82:0/3088870831 learned_addr learned my addr 172.21.15.82:0/3088870831 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:29:28.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.314+0000 7f56cf7fe700 1 -- 172.21.15.82:0/3088870831 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55889ba14c40 msgr2=0x55889ba150a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-23T09:29:28.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.314+0000 7f56cf7fe700 1 --2- 172.21.15.82:0/3088870831 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55889ba14c40 0x55889ba150a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:28.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.314+0000 7f56cf7fe700 1 -- 172.21.15.82:0/3088870831 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55889ba1a380 msgr2=0x55889ba1a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:29:28.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.314+0000 7f56cf7fe700 1 --2- 172.21.15.82:0/3088870831 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55889ba1a380 0x55889ba1a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:28.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.314+0000 7f56cf7fe700 1 -- 172.21.15.82:0/3088870831 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55889b7e6630 con 0x55889ba1aca0 2023-09-23T09:29:28.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.315+0000 7f56cf7fe700 1 --2- 172.21.15.82:0/3088870831 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55889ba1aca0 0x55889ba14700 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f56c0015010 tx=0x7f56c0005da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fce8e6aec9621125 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:29:28.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.315+0000 7f56ccff9700 1 --2- 172.21.15.82:0/2697109032 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f56b80a0250 0x7f56b80a2710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:28.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.315+0000 7f56ccff9700 1 -- 172.21.15.82:0/2697109032 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f56c40ce170 con 0x7f56d0101200 2023-09-23T09:29:28.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.315+0000 7f56b5ffb700 1 -- 172.21.15.82:0/3088870831 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c0016040 con 0x55889ba1aca0 2023-09-23T09:29:28.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.315+0000 7f56b5ffb700 1 -- 172.21.15.82:0/3088870831 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f56c0013e40 con 0x55889ba1aca0 2023-09-23T09:29:28.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.315+0000 7f56b5ffb700 1 -- 172.21.15.82:0/3088870831 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c0004900 con 0x55889ba1aca0 2023-09-23T09:29:28.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.317+0000 7f56e9765b80 1 -- 172.21.15.82:0/3088870831 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55889ba1aca0 msgr2=0x55889ba14700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:29:28.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.317+0000 7f56e9765b80 1 --2- 172.21.15.82:0/3088870831 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55889ba1aca0 0x55889ba14700 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f56c0015010 tx=0x7f56c0005da0 comp rx=0 tx=0).stop 2023-09-23T09:29:28.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.317+0000 7f56cffff700 1 --2- 172.21.15.82:0/2697109032 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f56b80a0250 0x7f56b80a2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:28.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.317+0000 7f56e9765b80 1 -- 172.21.15.82:0/3088870831 shutdown_connections 2023-09-23T09:29:28.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.317+0000 7f56e9765b80 1 --2- 172.21.15.82:0/3088870831 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55889ba14c40 0x55889ba150a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:28.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.317+0000 7f56e9765b80 1 --2- 172.21.15.82:0/3088870831 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55889ba1a380 0x55889ba1a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:28.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.317+0000 7f56e9765b80 1 --2- 172.21.15.82:0/3088870831 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55889ba1aca0 0x55889ba14700 secure :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f56c0015010 tx=0x7f56c0005da0 comp rx=0 tx=0).stop 2023-09-23T09:29:28.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.317+0000 7f56e9765b80 1 -- 172.21.15.82:0/3088870831 >> 172.21.15.82:0/3088870831 conn(0x55889b9890e0 msgr2=0x55889ba0f410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:29:28.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.321+0000 7f56e9765b80 1 -- 172.21.15.82:0/3088870831 shutdown_connections 2023-09-23T09:29:28.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.321+0000 7f56cffff700 1 --2- 172.21.15.82:0/2697109032 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f56b80a0250 0x7f56b80a2710 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f56c8007fd0 tx=0x7f56c80077f0 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:29:28.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.321+0000 7f56e9765b80 1 -- 172.21.15.82:0/3088870831 wait complete. 2023-09-23T09:29:28.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.322+0000 7f56e9765b80 1 -- start start 2023-09-23T09:29:28.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.322+0000 7f56e9765b80 1 Processor -- start 2023-09-23T09:29:28.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.323+0000 7f56e9765b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55889ba1a380 0x55889ba1e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:28.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.323+0000 7f56e9765b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55889ba1e740 0x55889ba1ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:28.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.323+0000 7f56e9765b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55889ba287e0 0x55889ba2abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:28.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.323+0000 7f56e9765b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55889b966990 con 0x55889ba1e740 2023-09-23T09:29:28.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.323+0000 7f56e9765b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55889b904bb0 con 0x55889ba287e0 2023-09-23T09:29:28.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.323+0000 7f56e9765b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55889b9048b0 con 0x55889ba1a380 2023-09-23T09:29:28.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.323+0000 7f56e9765b80 10 client.0 _ll_register_callbacks cb 0x55889b84ea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:29:28.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.327+0000 7f56cffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55889ba287e0 0x55889ba2abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:28.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.328+0000 7f56cf7fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55889ba1a380 0x55889ba1e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:28.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.328+0000 7f56cf7fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55889ba1a380 0x55889ba1e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:45990/0 (socket says 172.21.15.82:45990) 2023-09-23T09:29:28.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.328+0000 7f56cf7fe700 1 -- 172.21.15.82:0/4220630840 learned_addr learned my addr 172.21.15.82:0/4220630840 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:29:28.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.329+0000 7f56ceffd700 1 --2- 172.21.15.82:0/4220630840 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55889ba1e740 0x55889ba1ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:28.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.329+0000 7f56cf7fe700 1 -- 172.21.15.82:0/4220630840 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55889ba287e0 msgr2=0x55889ba2abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:29:28.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.329+0000 7f56cf7fe700 1 --2- 172.21.15.82:0/4220630840 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55889ba287e0 0x55889ba2abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:28.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.330+0000 7f56cf7fe700 1 -- 172.21.15.82:0/4220630840 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55889ba1e740 msgr2=0x55889ba1ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:29:28.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.330+0000 7f56cf7fe700 1 --2- 172.21.15.82:0/4220630840 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55889ba1e740 0x55889ba1ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:28.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.330+0000 7f56cf7fe700 1 -- 172.21.15.82:0/4220630840 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56d0073010 con 0x55889ba1a380 2023-09-23T09:29:28.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.330+0000 7f56cf7fe700 1 --2- 172.21.15.82:0/4220630840 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55889ba1a380 0x55889ba1e200 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f56c00131b0 tx=0x7f56c00113b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8056fae19b89c2d server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:29:28.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.331+0000 7f56aeffd700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T09:29:28.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.331+0000 7f56aeffd700 1 -- 172.21.15.82:0/4220630840 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c0016040 con 0x55889ba1a380 2023-09-23T09:29:28.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.331+0000 7f56e9765b80 1 -- 172.21.15.82:0/4220630840 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55889b9e41c0 con 0x55889ba1a380 2023-09-23T09:29:28.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.331+0000 7f56aeffd700 1 -- 172.21.15.82:0/4220630840 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(141..141 src has 1..141) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f56c0005450 con 0x55889ba1a380 2023-09-23T09:29:28.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.331+0000 7f56aeffd700 1 -- 172.21.15.82:0/4220630840 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f56c0005610 con 0x55889ba1a380 2023-09-23T09:29:28.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.331+0000 7f56e9765b80 10 client.27094 fetch_fsmap learned FSMap version 91 2023-09-23T09:29:28.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.331+0000 7f56e9765b80 1 -- 172.21.15.82:0/4220630840 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=4+}) v3 -- 0x55889b792de0 con 0x55889ba1a380 2023-09-23T09:29:28.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.332+0000 7f56aeffd700 1 -- 172.21.15.82:0/4220630840 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55889b9e41c0 con 0x55889ba1a380 2023-09-23T09:29:28.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.334+0000 7f56aeffd700 1 -- 172.21.15.82:0/4220630840 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 91) v1 ==== 7930+0+0 (secure 0 0 0) 0x7f56c0033070 con 0x55889ba1a380 2023-09-23T09:29:28.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.334+0000 7f56e9765b80 10 client.27094 fetch_fsmap finished waiting for FSMap version 91 2023-09-23T09:29:28.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.334+0000 7f56e9765b80 10 client.27094 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:29:28.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.334+0000 7f56e9765b80 20 client.27094 populate_metadata read hostname 'smithi082' 2023-09-23T09:29:28.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.334+0000 7f56e9765b80 1 --2- 172.21.15.82:0/4220630840 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55889ba3fd70 0x55889ba42160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:28.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.334+0000 7f56e9765b80 4 client.27094 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:29:28.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.334+0000 7f56e9765b80 1 -- 172.21.15.82:0/4220630840 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55889b90cba0 con 0x55889ba3fd70 2023-09-23T09:29:28.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.335+0000 7f56ceffd700 1 --2- 172.21.15.82:0/4220630840 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55889ba3fd70 0x55889ba42160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:28.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.335+0000 7f56ceffd700 1 --2- 172.21.15.82:0/4220630840 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55889ba3fd70 0x55889ba42160 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e89991e3d2245e3 server_cookie=7b4088a626967a4d in_seq=0 out_seq=0 2023-09-23T09:29:28.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.335+0000 7f56aeffd700 10 client.27094 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:29:28.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.336+0000 7f56aeffd700 1 -- 172.21.15.82:0/4220630840 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55889b90cba0 con 0x55889ba3fd70 2023-09-23T09:29:28.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.336+0000 7f56aeffd700 10 client.27094 handle_command_reply: tid=0 2023-09-23T09:29:28.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.336+0000 7f56e9765b80 1 client.27094 shutdown 2023-09-23T09:29:28.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.337+0000 7f56e9765b80 1 -- 172.21.15.82:0/4220630840 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55889ba1a380 msgr2=0x55889ba1e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:29:28.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.337+0000 7f56e9765b80 1 --2- 172.21.15.82:0/4220630840 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55889ba1a380 0x55889ba1e200 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f56c00131b0 tx=0x7f56c00113b0 comp rx=0 tx=0).stop 2023-09-23T09:29:28.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.338+0000 7f56e9765b80 1 -- 172.21.15.82:0/4220630840 shutdown_connections 2023-09-23T09:29:28.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.338+0000 7f56e9765b80 1 --2- 172.21.15.82:0/4220630840 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55889ba287e0 0x55889ba2abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:28.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.338+0000 7f56e9765b80 1 --2- 172.21.15.82:0/4220630840 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55889ba1a380 0x55889ba1e200 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:28.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.338+0000 7f56e9765b80 1 --2- 172.21.15.82:0/4220630840 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55889ba3fd70 0x55889ba42160 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:28.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.338+0000 7f56e9765b80 1 --2- 172.21.15.82:0/4220630840 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55889ba1e740 0x55889ba1ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:28.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.338+0000 7f56e9765b80 1 -- 172.21.15.82:0/4220630840 >> 172.21.15.82:0/4220630840 conn(0x55889b9890e0 msgr2=0x55889ba09b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:29:28.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.338+0000 7f56aeffd700 0 client.27094 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:29:28.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.338+0000 7f56e9765b80 1 -- 172.21.15.82:0/4220630840 shutdown_connections 2023-09-23T09:29:28.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.338+0000 7f56e9765b80 1 -- 172.21.15.82:0/4220630840 wait complete. 2023-09-23T09:29:28.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.339+0000 7f56e9765b80 20 client.27094 trim_cache size 0 max 16384 2023-09-23T09:29:28.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:29:28 smithi082 ceph-mon[97694]: pgmap v1032: 97 pgs: 97 active+clean; 16 GiB data, 54 GiB used, 1019 GiB / 1.0 TiB avail; 964 KiB/s rd, 13 MiB/s wr, 1.02k op/s 2023-09-23T09:29:28.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.368+0000 7f56e9765b80 1 Processor -- start 2023-09-23T09:29:28.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.370+0000 7f56e9765b80 1 -- start start 2023-09-23T09:29:28.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.371+0000 7f56e9765b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55889ba1a380 0x55889ba14700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:28.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.371+0000 7f56e9765b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55889ba1e740 0x55889ba25740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:28.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.371+0000 7f56e9765b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55889ba287e0 0x55889ba1da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:28.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.371+0000 7f56e9765b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55889b7e8920 con 0x55889ba1e740 2023-09-23T09:29:28.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.371+0000 7f56e9765b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55889ba111f0 con 0x55889ba287e0 2023-09-23T09:29:28.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.371+0000 7f56e9765b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55889ba212a0 con 0x55889ba1a380 2023-09-23T09:29:28.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.372+0000 7f56ceffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55889ba1e740 0x55889ba25740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:28.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.372+0000 7f56ceffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55889ba1e740 0x55889ba25740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42238/0 (socket says 172.21.15.82:42238) 2023-09-23T09:29:28.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.372+0000 7f56ceffd700 1 -- 172.21.15.82:0/2985891125 learned_addr learned my addr 172.21.15.82:0/2985891125 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:29:28.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.372+0000 7f56ceffd700 1 -- 172.21.15.82:0/2985891125 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55889ba1a380 msgr2=0x55889ba14700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:29:28.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.372+0000 7f56ceffd700 1 --2- 172.21.15.82:0/2985891125 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55889ba1a380 0x55889ba14700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:28.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.372+0000 7f56ceffd700 1 -- 172.21.15.82:0/2985891125 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55889ba287e0 msgr2=0x55889ba1da00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-23T09:29:28.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.372+0000 7f56ceffd700 1 --2- 172.21.15.82:0/2985891125 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55889ba287e0 0x55889ba1da00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:28.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.372+0000 7f56ceffd700 1 -- 172.21.15.82:0/2985891125 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55889ba3cb90 con 0x55889ba1e740 2023-09-23T09:29:28.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.373+0000 7f56ceffd700 1 --2- 172.21.15.82:0/2985891125 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55889ba1e740 0x55889ba25740 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f56c4009520 tx=0x7f56c4009ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15b77ec32ceb143 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:29:28.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.375+0000 7f56b67fc700 1 -- 172.21.15.82:0/2985891125 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c4098810 con 0x55889ba1e740 2023-09-23T09:29:28.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.375+0000 7f56b67fc700 1 -- 172.21.15.82:0/2985891125 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f56c4098110 con 0x55889ba1e740 2023-09-23T09:29:28.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.375+0000 7f56b67fc700 1 -- 172.21.15.82:0/2985891125 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c40965c0 con 0x55889ba1e740 2023-09-23T09:29:28.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.376+0000 7f56e9765b80 1 -- 172.21.15.82:0/2985891125 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55889ba1e740 msgr2=0x55889ba25740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:29:28.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.376+0000 7f56e9765b80 1 --2- 172.21.15.82:0/2985891125 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55889ba1e740 0x55889ba25740 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f56c4009520 tx=0x7f56c4009ea0 comp rx=0 tx=0).stop 2023-09-23T09:29:28.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.376+0000 7f56e9765b80 1 -- 172.21.15.82:0/2985891125 shutdown_connections 2023-09-23T09:29:28.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.376+0000 7f56e9765b80 1 --2- 172.21.15.82:0/2985891125 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55889ba287e0 0x55889ba1da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:28.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.376+0000 7f56e9765b80 1 --2- 172.21.15.82:0/2985891125 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55889ba1a380 0x55889ba14700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:28.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.376+0000 7f56e9765b80 1 --2- 172.21.15.82:0/2985891125 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55889ba1e740 0x55889ba25740 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:28.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.376+0000 7f56e9765b80 1 -- 172.21.15.82:0/2985891125 >> 172.21.15.82:0/2985891125 conn(0x55889b9890e0 msgr2=0x55889ba18220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:29:28.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.376+0000 7f56e9765b80 1 -- 172.21.15.82:0/2985891125 shutdown_connections 2023-09-23T09:29:28.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.376+0000 7f56e9765b80 1 -- 172.21.15.82:0/2985891125 wait complete. 2023-09-23T09:29:28.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.377+0000 7f56e9765b80 1 -- start start 2023-09-23T09:29:28.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.377+0000 7f56e9765b80 1 Processor -- start 2023-09-23T09:29:28.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.378+0000 7f56e9765b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55889ba1a380 0x55889ba23910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:28.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.378+0000 7f56e9765b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55889ba1e740 0x55889ba23e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:28.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.378+0000 7f56e9765b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55889ba287e0 0x55889ba92b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:28.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.378+0000 7f56e9765b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55889ba930d0 con 0x55889ba1a380 2023-09-23T09:29:28.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.378+0000 7f56e9765b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55889ba93210 con 0x55889ba1e740 2023-09-23T09:29:28.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.378+0000 7f56e9765b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55889ba933d0 con 0x55889ba287e0 2023-09-23T09:29:28.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.378+0000 7f56e9765b80 10 client.0 _ll_register_callbacks cb 0x7f56c8007690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:29:28.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.379+0000 7f56cf7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55889ba1a380 0x55889ba23910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:28.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.379+0000 7f56ceffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55889ba1e740 0x55889ba23e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:28.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.379+0000 7f56cf7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55889ba1a380 0x55889ba23910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42254/0 (socket says 172.21.15.82:42254) 2023-09-23T09:29:28.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.379+0000 7f56cf7fe700 1 -- 172.21.15.82:0/2648398584 learned_addr learned my addr 172.21.15.82:0/2648398584 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:29:28.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.379+0000 7f56ceffd700 1 -- 172.21.15.82:0/2648398584 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55889ba287e0 msgr2=0x55889ba92b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:29:28.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.379+0000 7f56ceffd700 1 --2- 172.21.15.82:0/2648398584 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55889ba287e0 0x55889ba92b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:28.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.380+0000 7f56ceffd700 1 -- 172.21.15.82:0/2648398584 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55889ba1a380 msgr2=0x55889ba23910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:29:28.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.380+0000 7f56ceffd700 1 --2- 172.21.15.82:0/2648398584 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55889ba1a380 0x55889ba23910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:28.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.380+0000 7f56ceffd700 1 -- 172.21.15.82:0/2648398584 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56d01b2520 con 0x55889ba1e740 2023-09-23T09:29:28.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.380+0000 7f56ceffd700 1 --2- 172.21.15.82:0/2648398584 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55889ba1e740 0x55889ba23e50 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x55889ba1f1e0 tx=0x7f56c40c8120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a16c2a960311c421 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:29:28.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.381+0000 7f56aeffd700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-09-23T09:29:28.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.381+0000 7f56aeffd700 1 -- 172.21.15.82:0/2648398584 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c409ff20 con 0x55889ba1e740 2023-09-23T09:29:28.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.381+0000 7f56aeffd700 1 -- 172.21.15.82:0/2648398584 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(141..141 src has 1..141) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f56c409b040 con 0x55889ba1e740 2023-09-23T09:29:28.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.381+0000 7f56e9765b80 1 -- 172.21.15.82:0/2648398584 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55889ba078b0 con 0x55889ba1e740 2023-09-23T09:29:28.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.381+0000 7f56aeffd700 1 -- 172.21.15.82:0/2648398584 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f56c40b0260 con 0x55889ba1e740 2023-09-23T09:29:28.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.381+0000 7f56e9765b80 10 client.27050 fetch_fsmap learned FSMap version 91 2023-09-23T09:29:28.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.382+0000 7f56e9765b80 1 -- 172.21.15.82:0/2648398584 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=4+}) v3 -- 0x55889b77bc60 con 0x55889ba1e740 2023-09-23T09:29:28.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.382+0000 7f56aeffd700 1 -- 172.21.15.82:0/2648398584 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55889ba078b0 con 0x55889ba1e740 2023-09-23T09:29:28.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.382+0000 7f56aeffd700 1 -- 172.21.15.82:0/2648398584 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 91) v1 ==== 7930+0+0 (secure 0 0 0) 0x7f56c40bd020 con 0x55889ba1e740 2023-09-23T09:29:28.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.383+0000 7f56e9765b80 10 client.27050 fetch_fsmap finished waiting for FSMap version 91 2023-09-23T09:29:28.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.383+0000 7f56e9765b80 10 client.27050 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:29:28.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.383+0000 7f56e9765b80 20 client.27050 populate_metadata read hostname 'smithi082' 2023-09-23T09:29:28.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.383+0000 7f56e9765b80 1 --2- 172.21.15.82:0/2648398584 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55889ba94730 0x55889ba96b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:28.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.383+0000 7f56e9765b80 4 client.27050 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:29:28.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.383+0000 7f56e9765b80 1 -- 172.21.15.82:0/2648398584 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55889b95f970 con 0x55889ba94730 2023-09-23T09:29:28.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.387+0000 7f56cf7fe700 1 --2- 172.21.15.82:0/2648398584 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55889ba94730 0x55889ba96b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:28.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.389+0000 7f56aeffd700 10 client.27050 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:29:28.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.389+0000 7f56cf7fe700 1 --2- 172.21.15.82:0/2648398584 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55889ba94730 0x55889ba96b50 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=71dc7302b89584e8 server_cookie=375a673342f3b71 in_seq=0 out_seq=0 2023-09-23T09:29:28.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.391+0000 7f56aeffd700 1 -- 172.21.15.82:0/2648398584 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55889b95f970 con 0x55889ba94730 2023-09-23T09:29:28.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.391+0000 7f56aeffd700 10 client.27050 handle_command_reply: tid=0 2023-09-23T09:29:28.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.391+0000 7f56e9765b80 1 client.27050 shutdown 2023-09-23T09:29:28.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.392+0000 7f56e9765b80 1 -- 172.21.15.82:0/2648398584 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55889ba1e740 msgr2=0x55889ba23e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:29:28.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.392+0000 7f56e9765b80 1 --2- 172.21.15.82:0/2648398584 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55889ba1e740 0x55889ba23e50 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x55889ba1f1e0 tx=0x7f56c40c8120 comp rx=0 tx=0).stop 2023-09-23T09:29:28.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.394+0000 7f56e9765b80 1 -- 172.21.15.82:0/2648398584 shutdown_connections 2023-09-23T09:29:28.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.394+0000 7f56e9765b80 1 --2- 172.21.15.82:0/2648398584 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55889ba287e0 0x55889ba92b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:28.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.394+0000 7f56e9765b80 1 --2- 172.21.15.82:0/2648398584 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55889ba94730 0x55889ba96b50 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:28.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.394+0000 7f56e9765b80 1 --2- 172.21.15.82:0/2648398584 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55889ba1a380 0x55889ba23910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:28.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.394+0000 7f56e9765b80 1 --2- 172.21.15.82:0/2648398584 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55889ba1e740 0x55889ba23e50 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:28.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.394+0000 7f56e9765b80 1 -- 172.21.15.82:0/2648398584 >> 172.21.15.82:0/2648398584 conn(0x55889b9890e0 msgr2=0x55889ba192e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:29:28.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:29:28 smithi161 ceph-mon[99580]: pgmap v1032: 97 pgs: 97 active+clean; 16 GiB data, 54 GiB used, 1019 GiB / 1.0 TiB avail; 964 KiB/s rd, 13 MiB/s wr, 1.02k op/s 2023-09-23T09:29:28.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.395+0000 7f56aeffd700 0 client.27050 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:29:28.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.395+0000 7f56e9765b80 1 -- 172.21.15.82:0/2648398584 shutdown_connections 2023-09-23T09:29:28.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.395+0000 7f56e9765b80 1 -- 172.21.15.82:0/2648398584 wait complete. 2023-09-23T09:29:28.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.395+0000 7f56e9765b80 20 client.27050 trim_cache size 0 max 16384 2023-09-23T09:29:28.398 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:29:28.398 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "no active scrubs running", 2023-09-23T09:29:28.399 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": {} 2023-09-23T09:29:28.399 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:29:28.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.396+0000 7f56d5dff700 1 -- 172.21.15.82:0/2697109032 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f56b80a0250 msgr2=0x7f56b80a2710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:29:28.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.396+0000 7f56d5dff700 1 --2- 172.21.15.82:0/2697109032 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f56b80a0250 0x7f56b80a2710 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f56c8007fd0 tx=0x7f56c80077f0 comp rx=0 tx=0).stop 2023-09-23T09:29:28.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.396+0000 7f56d5dff700 1 -- 172.21.15.82:0/2697109032 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f56d0101200 msgr2=0x7f56d019aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:29:28.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.396+0000 7f56d5dff700 1 --2- 172.21.15.82:0/2697109032 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f56d0101200 0x7f56d019aa60 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f56c400d950 tx=0x7f56c400dd10 comp rx=0 tx=0).stop 2023-09-23T09:29:28.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.398+0000 7f56d5dff700 1 -- 172.21.15.82:0/2697109032 shutdown_connections 2023-09-23T09:29:28.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.398+0000 7f56d5dff700 1 --2- 172.21.15.82:0/2697109032 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f56b80a0250 0x7f56b80a2710 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:28.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.398+0000 7f56d5dff700 1 --2- 172.21.15.82:0/2697109032 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f56d0106850 0x7f56d0194590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:28.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.398+0000 7f56d5dff700 1 --2- 172.21.15.82:0/2697109032 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56d0100840 0x7f56d019a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:28.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.398+0000 7f56d5dff700 1 --2- 172.21.15.82:0/2697109032 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f56d0101200 0x7f56d019aa60 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:28.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.398+0000 7f56d5dff700 1 -- 172.21.15.82:0/2697109032 >> 172.21.15.82:0/2697109032 conn(0x7f56d00fc330 msgr2=0x7f56d00fca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:29:28.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.398+0000 7f56d5dff700 1 -- 172.21.15.82:0/2697109032 shutdown_connections 2023-09-23T09:29:28.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.398+0000 7f56d5dff700 1 -- 172.21.15.82:0/2697109032 wait complete. 2023-09-23T09:29:28.432 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-09-23T09:29:28.433 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-23T09:29:28.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.784+0000 7fdf96fff700 1 -- 172.21.15.82:0/4024720927 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf90107c60 msgr2=0x7fdf9010bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:29:28.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.784+0000 7fdf96fff700 1 --2- 172.21.15.82:0/4024720927 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf90107c60 0x7fdf9010bb40 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fdf840098f0 tx=0x7fdf84009c00 comp rx=0 tx=0).stop 2023-09-23T09:29:28.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.784+0000 7fdf96fff700 1 -- 172.21.15.82:0/4024720927 shutdown_connections 2023-09-23T09:29:28.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.784+0000 7fdf96fff700 1 --2- 172.21.15.82:0/4024720927 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf9010c270 0x7fdf90113df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:28.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.784+0000 7fdf96fff700 1 --2- 172.21.15.82:0/4024720927 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf901072b0 0x7fdf90107690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:28.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.784+0000 7fdf96fff700 1 --2- 172.21.15.82:0/4024720927 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf90107c60 0x7fdf9010bb40 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:28.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.784+0000 7fdf96fff700 1 -- 172.21.15.82:0/4024720927 >> 172.21.15.82:0/4024720927 conn(0x7fdf900767c0 msgr2=0x7fdf90105740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:29:28.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.786+0000 7fdf96fff700 1 -- 172.21.15.82:0/4024720927 shutdown_connections 2023-09-23T09:29:28.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.786+0000 7fdf96fff700 1 -- 172.21.15.82:0/4024720927 wait complete. 2023-09-23T09:29:28.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.788+0000 7fdf96fff700 1 Processor -- start 2023-09-23T09:29:28.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.788+0000 7fdf96fff700 1 -- start start 2023-09-23T09:29:28.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.788+0000 7fdf96fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf901072b0 0x7fdf9007e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:28.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.788+0000 7fdf96fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf9010c270 0x7fdf9007ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:28.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.788+0000 7fdf96fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf90079b40 0x7fdf90079ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:28.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.788+0000 7fdf96fff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf9007a5f0 con 0x7fdf901072b0 2023-09-23T09:29:28.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.788+0000 7fdf96fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf9007a760 con 0x7fdf9010c270 2023-09-23T09:29:28.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.788+0000 7fdf96fff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf9007a920 con 0x7fdf90079b40 2023-09-23T09:29:28.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.789+0000 7fdf8ffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf9010c270 0x7fdf9007ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:28.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.789+0000 7fdf8ffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf9010c270 0x7fdf9007ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:44836/0 (socket says 172.21.15.82:44836) 2023-09-23T09:29:28.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.789+0000 7fdf8ffff700 1 -- 172.21.15.82:0/3224855904 learned_addr learned my addr 172.21.15.82:0/3224855904 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:29:28.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.790+0000 7fdf9559c700 1 --2- 172.21.15.82:0/3224855904 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf90079b40 0x7fdf90079ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:28.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.790+0000 7fdf94d9b700 1 --2- 172.21.15.82:0/3224855904 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf901072b0 0x7fdf9007e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:28.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.790+0000 7fdf8ffff700 1 -- 172.21.15.82:0/3224855904 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf90079b40 msgr2=0x7fdf90079ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:29:28.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.790+0000 7fdf8ffff700 1 --2- 172.21.15.82:0/3224855904 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf90079b40 0x7fdf90079ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:28.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.790+0000 7fdf8ffff700 1 -- 172.21.15.82:0/3224855904 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf901072b0 msgr2=0x7fdf9007e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:29:28.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.790+0000 7fdf8ffff700 1 --2- 172.21.15.82:0/3224855904 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf901072b0 0x7fdf9007e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:28.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.790+0000 7fdf8ffff700 1 -- 172.21.15.82:0/3224855904 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf84009520 con 0x7fdf9010c270 2023-09-23T09:29:28.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.791+0000 7fdf8ffff700 1 --2- 172.21.15.82:0/3224855904 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf9010c270 0x7fdf9007ee90 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fdf84009fd0 tx=0x7fdf8400fa00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:29:28.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.791+0000 7fdf8dffb700 1 -- 172.21.15.82:0/3224855904 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf8401c070 con 0x7fdf9010c270 2023-09-23T09:29:28.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.791+0000 7fdf96fff700 1 -- 172.21.15.82:0/3224855904 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf9007d6b0 con 0x7fdf9010c270 2023-09-23T09:29:28.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.791+0000 7fdf8dffb700 1 -- 172.21.15.82:0/3224855904 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdf84005040 con 0x7fdf9010c270 2023-09-23T09:29:28.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.791+0000 7fdf8dffb700 1 -- 172.21.15.82:0/3224855904 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf840049c0 con 0x7fdf9010c270 2023-09-23T09:29:28.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.791+0000 7fdf96fff700 1 -- 172.21.15.82:0/3224855904 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf9007dc10 con 0x7fdf9010c270 2023-09-23T09:29:28.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.793+0000 7fdf7b7fe700 1 -- 172.21.15.82:0/3224855904 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf700052f0 con 0x7fdf9010c270 2023-09-23T09:29:28.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.796+0000 7fdf8dffb700 1 -- 172.21.15.82:0/3224855904 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7fdf84020070 con 0x7fdf9010c270 2023-09-23T09:29:28.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.798+0000 7fdf8dffb700 1 --2- 172.21.15.82:0/3224855904 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fdf800a0200 0x7fdf800a26c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:28.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.798+0000 7fdf8dffb700 1 -- 172.21.15.82:0/3224855904 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fdf840ccaf0 con 0x7fdf9010c270 2023-09-23T09:29:28.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.799+0000 7fdf94d9b700 1 --2- 172.21.15.82:0/3224855904 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fdf800a0200 0x7fdf800a26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:28.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.801+0000 7fdf94d9b700 1 --2- 172.21.15.82:0/3224855904 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fdf800a0200 0x7fdf800a26c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c005fd0 tx=0x7fdf7c009310 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:29:28.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:28.803+0000 7fdf8dffb700 1 -- 172.21.15.82:0/3224855904 <== mon.2 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7fdf84096570 con 0x7fdf9010c270 2023-09-23T09:29:29.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.315+0000 7fdf7b7fe700 1 -- 172.21.15.82:0/3224855904 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdf70005160 con 0x7fdf9010c270 2023-09-23T09:29:29.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.321+0000 7fdf8dffb700 1 -- 172.21.15.82:0/3224855904 <== mon.2 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) v1 ==== 94+0+11343 (secure 0 0 0) 0x7fdf84027090 con 0x7fdf9010c270 2023-09-23T09:29:29.324 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T09:29:29.324 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":91,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/1237857359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1237857359},{"type":"v1","addr":"172.21.15.82:6835","nonce":1237857359}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/1335102362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":1335102362},{"type":"v1","addr":"172.21.15.82:6837","nonce":1335102362}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":91,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-23T08:54:52.600479+0000","modified":"2023-09-23T09:28:50.856028+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24557,"mds_1":24550,"mds_2":24526,"mds_3":24515,"mds_4":24514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/3645331700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3645331700},{"type":"v1","addr":"172.21.15.135:6835","nonce":3645331700}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14658":{"gid":14658,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6839/205725278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":205725278},{"type":"v1","addr":"172.21.15.82:6839","nonce":205725278}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14670":{"gid":14670,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6841/2659297867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":2659297867},{"type":"v1","addr":"172.21.15.82:6841","nonce":2659297867}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24461":{"gid":24461,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/503886037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":503886037},{"type":"v1","addr":"172.21.15.135:6833","nonce":503886037}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24463":{"gid":24463,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.161:6833/471569125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":471569125},{"type":"v1","addr":"172.21.15.161:6833","nonce":471569125}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24514":{"gid":24514,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":10,"addr":"172.21.15.161:6835/2237964162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":2237964162},{"type":"v1","addr":"172.21.15.161:6835","nonce":2237964162}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24515":{"gid":24515,"name":"h","rank":3,"incarnation":22,"state":"up:active","state_seq":8,"addr":"172.21.15.135:6837/2655304858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2655304858},{"type":"v1","addr":"172.21.15.135:6837","nonce":2655304858}]},"join_fscid":-1,"export_targets":[0,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24526":{"gid":24526,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.161:6837/43639843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":43639843},{"type":"v1","addr":"172.21.15.161:6837","nonce":43639843}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24550":{"gid":24550,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.161:6839/758982817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6838","nonce":758982817},{"type":"v1","addr":"172.21.15.161:6839","nonce":758982817}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24557":{"gid":24557,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6839/2508669274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2508669274},{"type":"v1","addr":"172.21.15.135:6839","nonce":2508669274}]},"join_fscid":-1,"export_targets":[1,3],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-23T09:29:29.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.325+0000 7fdf7b7fe700 1 -- 172.21.15.82:0/3224855904 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fdf800a0200 msgr2=0x7fdf800a26c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:29:29.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.325+0000 7fdf7b7fe700 1 --2- 172.21.15.82:0/3224855904 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fdf800a0200 0x7fdf800a26c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c005fd0 tx=0x7fdf7c009310 comp rx=0 tx=0).stop 2023-09-23T09:29:29.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.325+0000 7fdf7b7fe700 1 -- 172.21.15.82:0/3224855904 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf9010c270 msgr2=0x7fdf9007ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:29:29.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.325+0000 7fdf7b7fe700 1 --2- 172.21.15.82:0/3224855904 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf9010c270 0x7fdf9007ee90 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fdf84009fd0 tx=0x7fdf8400fa00 comp rx=0 tx=0).stop 2023-09-23T09:29:29.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.326+0000 7fdf7b7fe700 1 -- 172.21.15.82:0/3224855904 shutdown_connections 2023-09-23T09:29:29.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.326+0000 7fdf7b7fe700 1 --2- 172.21.15.82:0/3224855904 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fdf800a0200 0x7fdf800a26c0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:29.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.326+0000 7fdf7b7fe700 1 --2- 172.21.15.82:0/3224855904 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf90079b40 0x7fdf90079ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:29.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.326+0000 7fdf7b7fe700 1 --2- 172.21.15.82:0/3224855904 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf901072b0 0x7fdf9007e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:29.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.326+0000 7fdf7b7fe700 1 --2- 172.21.15.82:0/3224855904 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf9010c270 0x7fdf9007ee90 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:29.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.326+0000 7fdf7b7fe700 1 -- 172.21.15.82:0/3224855904 >> 172.21.15.82:0/3224855904 conn(0x7fdf900767c0 msgr2=0x7fdf9010abc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:29:29.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.326+0000 7fdf7b7fe700 1 -- 172.21.15.82:0/3224855904 shutdown_connections 2023-09-23T09:29:29.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.327+0000 7fdf7b7fe700 1 -- 172.21.15.82:0/3224855904 wait complete. 2023-09-23T09:29:29.342 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 91 2023-09-23T09:29:29.372 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-09-23T09:29:29.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:29:29 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/3224855904' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T09:29:29.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:29:29 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/3224855904' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T09:29:29.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.725+0000 7fd0291ff700 1 -- 172.21.15.82:0/1880885515 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd02410f440 msgr2=0x7fd02410d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:29:29.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.725+0000 7fd0291ff700 1 --2- 172.21.15.82:0/1880885515 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd02410f440 0x7fd02410d0a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fd00c0098f0 tx=0x7fd00c009c00 comp rx=0 tx=0).stop 2023-09-23T09:29:29.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.725+0000 7fd0291ff700 1 -- 172.21.15.82:0/1880885515 shutdown_connections 2023-09-23T09:29:29.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.725+0000 7fd0291ff700 1 --2- 172.21.15.82:0/1880885515 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd02411a100 0x7fd02411c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:29.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.725+0000 7fd0291ff700 1 --2- 172.21.15.82:0/1880885515 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd02410efd0 0x7fd02410cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:29.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.725+0000 7fd0291ff700 1 --2- 172.21.15.82:0/1880885515 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd02410f440 0x7fd02410d0a0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:29.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.725+0000 7fd0291ff700 1 -- 172.21.15.82:0/1880885515 >> 172.21.15.82:0/1880885515 conn(0x7fd02406cbe0 msgr2=0x7fd02406cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:29:29.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.729+0000 7fd0291ff700 1 -- 172.21.15.82:0/1880885515 shutdown_connections 2023-09-23T09:29:29.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.730+0000 7fd0291ff700 1 -- 172.21.15.82:0/1880885515 wait complete. 2023-09-23T09:29:29.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.731+0000 7fd0291ff700 1 Processor -- start 2023-09-23T09:29:29.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.732+0000 7fd0291ff700 1 -- start start 2023-09-23T09:29:29.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.732+0000 7fd0291ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd02410f440 0x7fd024113500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:29.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.732+0000 7fd0291ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd02411a100 0x7fd024113a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:29.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.732+0000 7fd0291ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd024117f10 0x7fd0241183c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:29.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.732+0000 7fd0291ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0241189c0 con 0x7fd024117f10 2023-09-23T09:29:29.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.732+0000 7fd0291ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd024118b30 con 0x7fd02410f440 2023-09-23T09:29:29.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.732+0000 7fd0291ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd024118cf0 con 0x7fd02411a100 2023-09-23T09:29:29.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.733+0000 7fd01a59c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd02411a100 0x7fd024113a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:29.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.733+0000 7fd01a59c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd02411a100 0x7fd024113a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:46058/0 (socket says 172.21.15.82:46058) 2023-09-23T09:29:29.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.733+0000 7fd01a59c700 1 -- 172.21.15.82:0/2758032047 learned_addr learned my addr 172.21.15.82:0/2758032047 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:29:29.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.733+0000 7fd022d9d700 1 --2- 172.21.15.82:0/2758032047 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd02410f440 0x7fd024113500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:29.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.733+0000 7fd01a59c700 1 -- 172.21.15.82:0/2758032047 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd02410f440 msgr2=0x7fd024113500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:29:29.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.733+0000 7fd01a59c700 1 --2- 172.21.15.82:0/2758032047 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd02410f440 0x7fd024113500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:29.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.733+0000 7fd01a59c700 1 -- 172.21.15.82:0/2758032047 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd024117f10 msgr2=0x7fd0241183c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:29:29.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.733+0000 7fd01a59c700 1 --2- 172.21.15.82:0/2758032047 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd024117f10 0x7fd0241183c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:29.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.733+0000 7fd01a59c700 1 -- 172.21.15.82:0/2758032047 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd00c009520 con 0x7fd02411a100 2023-09-23T09:29:29.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.733+0000 7fd01a59c700 1 --2- 172.21.15.82:0/2758032047 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd02411a100 0x7fd024113a40 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd00c009230 tx=0x7fd00c00b610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:29:29.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.734+0000 7fd020d99700 1 -- 172.21.15.82:0/2758032047 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd00c01c070 con 0x7fd02411a100 2023-09-23T09:29:29.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.734+0000 7fd020d99700 1 -- 172.21.15.82:0/2758032047 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd00c0054d0 con 0x7fd02411a100 2023-09-23T09:29:29.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.734+0000 7fd020d99700 1 -- 172.21.15.82:0/2758032047 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd00c003980 con 0x7fd02411a100 2023-09-23T09:29:29.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.734+0000 7fd0291ff700 1 -- 172.21.15.82:0/2758032047 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0241badc0 con 0x7fd02411a100 2023-09-23T09:29:29.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.735+0000 7fd0291ff700 1 -- 172.21.15.82:0/2758032047 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0241bb190 con 0x7fd02411a100 2023-09-23T09:29:29.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.741+0000 7fd03ca6ab80 1 Processor -- start 2023-09-23T09:29:29.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.742+0000 7fd03ca6ab80 1 -- start start 2023-09-23T09:29:29.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.742+0000 7fd03ca6ab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c955940380 0x55c955940760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:29.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.742+0000 7fd03ca6ab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c955940ca0 0x55c95593a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:29.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.742+0000 7fd03ca6ab80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c95593ac40 0x55c95593b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:29.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.742+0000 7fd03ca6ab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9558a27b0 con 0x55c955940380 2023-09-23T09:29:29.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.742+0000 7fd03ca6ab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c955893780 con 0x55c955940ca0 2023-09-23T09:29:29.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.742+0000 7fd03ca6ab80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9558910a0 con 0x55c95593ac40 2023-09-23T09:29:29.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.744+0000 7fd02359e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c955940380 0x55c955940760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:29.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.744+0000 7fd02359e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c955940380 0x55c955940760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42306/0 (socket says 172.21.15.82:42306) 2023-09-23T09:29:29.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.744+0000 7fd02359e700 1 -- 172.21.15.82:0/3938626728 learned_addr learned my addr 172.21.15.82:0/3938626728 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:29:29.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.745+0000 7fd022d9d700 1 --2- 172.21.15.82:0/3938626728 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c955940ca0 0x55c95593a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:29.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.746+0000 7fd02359e700 1 -- 172.21.15.82:0/3938626728 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c95593ac40 msgr2=0x55c95593b0a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-23T09:29:29.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.746+0000 7fd02359e700 1 --2- 172.21.15.82:0/3938626728 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c95593ac40 0x55c95593b0a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:29.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.746+0000 7fd02359e700 1 -- 172.21.15.82:0/3938626728 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c955940ca0 msgr2=0x55c95593a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:29:29.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.746+0000 7fd02359e700 1 --2- 172.21.15.82:0/3938626728 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c955940ca0 0x55c95593a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:29.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.746+0000 7fd02359e700 1 -- 172.21.15.82:0/3938626728 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c95570c630 con 0x55c955940380 2023-09-23T09:29:29.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.746+0000 7fd02359e700 1 --2- 172.21.15.82:0/3938626728 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c955940380 0x55c955940760 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fd01c007ac0 tx=0x7fd01c007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed8f176e645e1741 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:29:29.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.748+0000 7fd01959a700 1 -- 172.21.15.82:0/3938626728 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd01c00d890 con 0x55c955940380 2023-09-23T09:29:29.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.748+0000 7fd01959a700 1 -- 172.21.15.82:0/3938626728 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd01c00de80 con 0x55c955940380 2023-09-23T09:29:29.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.748+0000 7fd01959a700 1 -- 172.21.15.82:0/3938626728 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd01c005310 con 0x55c955940380 2023-09-23T09:29:29.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.748+0000 7fd020d99700 1 -- 172.21.15.82:0/2758032047 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7fd00c020030 con 0x7fd02411a100 2023-09-23T09:29:29.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.749+0000 7fd03ca6ab80 1 -- 172.21.15.82:0/3938626728 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c955940380 msgr2=0x55c955940760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:29:29.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.749+0000 7fd03ca6ab80 1 --2- 172.21.15.82:0/3938626728 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c955940380 0x55c955940760 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fd01c007ac0 tx=0x7fd01c007dd0 comp rx=0 tx=0).stop 2023-09-23T09:29:29.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.750+0000 7fd03ca6ab80 1 -- 172.21.15.82:0/3938626728 shutdown_connections 2023-09-23T09:29:29.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.750+0000 7fd03ca6ab80 1 --2- 172.21.15.82:0/3938626728 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c95593ac40 0x55c95593b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:29.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.750+0000 7fd03ca6ab80 1 --2- 172.21.15.82:0/3938626728 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c955940380 0x55c955940760 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:29.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.750+0000 7fd03ca6ab80 1 --2- 172.21.15.82:0/3938626728 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c955940ca0 0x55c95593a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:29.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.750+0000 7fd03ca6ab80 1 -- 172.21.15.82:0/3938626728 >> 172.21.15.82:0/3938626728 conn(0x55c9558af0e0 msgr2=0x55c955935410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:29:29.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.750+0000 7fd03ca6ab80 1 -- 172.21.15.82:0/3938626728 shutdown_connections 2023-09-23T09:29:29.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.750+0000 7fd03ca6ab80 1 -- 172.21.15.82:0/3938626728 wait complete. 2023-09-23T09:29:29.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.751+0000 7fd03ca6ab80 1 -- start start 2023-09-23T09:29:29.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.752+0000 7fd03ca6ab80 1 Processor -- start 2023-09-23T09:29:29.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.753+0000 7fd03ca6ab80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c95593ac40 0x55c955946cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:29.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.753+0000 7fd03ca6ab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c955940380 0x55c955943fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:29.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.753+0000 7fd03ca6ab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c955940ca0 0x55c955944700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:29.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.753+0000 7fd03ca6ab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c95588c990 con 0x55c955940380 2023-09-23T09:29:29.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.753+0000 7fd03ca6ab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c95582abb0 con 0x55c955940ca0 2023-09-23T09:29:29.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.753+0000 7fd03ca6ab80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c95582a8b0 con 0x55c95593ac40 2023-09-23T09:29:29.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.753+0000 7fd03ca6ab80 10 client.0 _ll_register_callbacks cb 0x55c955774a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:29:29.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.753+0000 7fd02359e700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c95593ac40 0x55c955946cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:29.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.753+0000 7fd02359e700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c95593ac40 0x55c955946cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:46074/0 (socket says 172.21.15.82:46074) 2023-09-23T09:29:29.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.753+0000 7fd02359e700 1 -- 172.21.15.82:0/3327726781 learned_addr learned my addr 172.21.15.82:0/3327726781 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:29:29.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.754+0000 7fd020d99700 1 --2- 172.21.15.82:0/2758032047 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fd0100a0110 0x7fd0100a25d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:29.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.754+0000 7fd020d99700 1 -- 172.21.15.82:0/2758032047 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fd00c0cc7d0 con 0x7fd02411a100 2023-09-23T09:29:29.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.754+0000 7fd02359e700 1 -- 172.21.15.82:0/3327726781 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c955940ca0 msgr2=0x55c955944700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:29:29.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.754+0000 7fd02359e700 1 --2- 172.21.15.82:0/3327726781 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c955940ca0 0x55c955944700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:29.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.754+0000 7fd02359e700 1 -- 172.21.15.82:0/3327726781 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c955940380 msgr2=0x55c955943fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:29:29.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.754+0000 7fd02359e700 1 --2- 172.21.15.82:0/3327726781 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c955940380 0x55c955943fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:29.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.754+0000 7fd02359e700 1 -- 172.21.15.82:0/3327726781 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd01c0076f0 con 0x55c95593ac40 2023-09-23T09:29:29.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.755+0000 7fd02359e700 1 --2- 172.21.15.82:0/3327726781 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c95593ac40 0x55c955946cd0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd01c004a70 tx=0x7fd01c004b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd59165dd238b61 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:29:29.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.755+0000 7fd00a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T09:29:29.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.756+0000 7fd02359e700 1 --2- 172.21.15.82:0/2758032047 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fd0100a0110 0x7fd0100a25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:29.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.757+0000 7fd00a7fc700 1 -- 172.21.15.82:0/3327726781 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd01c00de80 con 0x55c95593ac40 2023-09-23T09:29:29.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.757+0000 7fd00a7fc700 1 -- 172.21.15.82:0/3327726781 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(141..141 src has 1..141) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fd01c004f40 con 0x55c95593ac40 2023-09-23T09:29:29.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.758+0000 7fd03ca6ab80 1 -- 172.21.15.82:0/3327726781 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c95590a1c0 con 0x55c95593ac40 2023-09-23T09:29:29.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.758+0000 7fd00a7fc700 1 -- 172.21.15.82:0/3327726781 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd01c0195a0 con 0x55c95593ac40 2023-09-23T09:29:29.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.759+0000 7fd03ca6ab80 10 client.27109 fetch_fsmap learned FSMap version 91 2023-09-23T09:29:29.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.759+0000 7fd03ca6ab80 1 -- 172.21.15.82:0/3327726781 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=4+}) v3 -- 0x55c9556b8de0 con 0x55c95593ac40 2023-09-23T09:29:29.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.759+0000 7fd02359e700 1 --2- 172.21.15.82:0/2758032047 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fd0100a0110 0x7fd0100a25d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd01c026000 tx=0x7fd01c022000 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:29:29.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.760+0000 7fd00a7fc700 1 -- 172.21.15.82:0/3327726781 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55c95590a1c0 con 0x55c95593ac40 2023-09-23T09:29:29.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.760+0000 7fd00a7fc700 1 -- 172.21.15.82:0/3327726781 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 91) v1 ==== 7930+0+0 (secure 0 0 0) 0x7fd01c036880 con 0x55c95593ac40 2023-09-23T09:29:29.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.760+0000 7fd03ca6ab80 10 client.27109 fetch_fsmap finished waiting for FSMap version 91 2023-09-23T09:29:29.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.760+0000 7fd03ca6ab80 10 client.27109 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2023-09-23T09:29:29.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.760+0000 7fd03ca6ab80 20 client.27109 populate_metadata read hostname 'smithi082' 2023-09-23T09:29:29.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.760+0000 7fd03ca6ab80 1 --2- 172.21.15.82:0/3327726781 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x55c955954880 0x55c955956ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:29.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.760+0000 7fd03ca6ab80 4 client.27109 mds_command: new command op to 24514 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:29:29.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.760+0000 7fd03ca6ab80 1 -- 172.21.15.82:0/3327726781 --> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c955832ba0 con 0x55c955954880 2023-09-23T09:29:29.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.761+0000 7fd022d9d700 1 --2- 172.21.15.82:0/3327726781 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x55c955954880 0x55c955956ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:29.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.762+0000 7fd00a7fc700 10 client.27109 ms_handle_connect on v2:172.21.15.161:6834/2237964162 2023-09-23T09:29:29.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.762+0000 7fd022d9d700 1 --2- 172.21.15.82:0/3327726781 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x55c955954880 0x55c955956ca0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=cde1786763cd2817 server_cookie=1104d496642eca1d in_seq=0 out_seq=0 2023-09-23T09:29:29.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.763+0000 7fd00a7fc700 1 -- 172.21.15.82:0/3327726781 <== mds.4 v2:172.21.15.161:6834/2237964162 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c955832ba0 con 0x55c955954880 2023-09-23T09:29:29.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.763+0000 7fd00a7fc700 10 client.27109 handle_command_reply: tid=0 2023-09-23T09:29:29.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.764+0000 7fd03ca6ab80 1 client.27109 shutdown 2023-09-23T09:29:29.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.764+0000 7fd03ca6ab80 1 -- 172.21.15.82:0/3327726781 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c95593ac40 msgr2=0x55c955946cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:29:29.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.764+0000 7fd03ca6ab80 1 --2- 172.21.15.82:0/3327726781 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c95593ac40 0x55c955946cd0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd01c004a70 tx=0x7fd01c004b50 comp rx=0 tx=0).stop 2023-09-23T09:29:29.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.764+0000 7fd03ca6ab80 1 -- 172.21.15.82:0/3327726781 shutdown_connections 2023-09-23T09:29:29.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.764+0000 7fd03ca6ab80 1 --2- 172.21.15.82:0/3327726781 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x55c955954880 0x55c955956ca0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:29.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.764+0000 7fd03ca6ab80 1 --2- 172.21.15.82:0/3327726781 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c955940ca0 0x55c955944700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:29.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.764+0000 7fd03ca6ab80 1 --2- 172.21.15.82:0/3327726781 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c95593ac40 0x55c955946cd0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:29.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.764+0000 7fd03ca6ab80 1 --2- 172.21.15.82:0/3327726781 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c955940380 0x55c955943fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:29.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.764+0000 7fd03ca6ab80 1 -- 172.21.15.82:0/3327726781 >> 172.21.15.82:0/3327726781 conn(0x55c9558af0e0 msgr2=0x55c95592fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:29:29.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.764+0000 7fd00a7fc700 0 client.27109 ms_handle_reset on v2:172.21.15.161:6834/2237964162 2023-09-23T09:29:29.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.764+0000 7fd03ca6ab80 1 -- 172.21.15.82:0/3327726781 shutdown_connections 2023-09-23T09:29:29.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.765+0000 7fd03ca6ab80 1 -- 172.21.15.82:0/3327726781 wait complete. 2023-09-23T09:29:29.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.765+0000 7fd03ca6ab80 20 client.27109 trim_cache size 0 max 16384 2023-09-23T09:29:29.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.793+0000 7fd03ca6ab80 1 Processor -- start 2023-09-23T09:29:29.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.793+0000 7fd03ca6ab80 1 -- start start 2023-09-23T09:29:29.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.793+0000 7fd03ca6ab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c95593ac40 0x55c955943780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:29.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.793+0000 7fd03ca6ab80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c955940380 0x55c955946870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:29.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.793+0000 7fd03ca6ab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c955940ca0 0x55c95593e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:29.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.793+0000 7fd03ca6ab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c95570e920 con 0x55c95593ac40 2023-09-23T09:29:29.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.793+0000 7fd03ca6ab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9559472a0 con 0x55c955940ca0 2023-09-23T09:29:29.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.793+0000 7fd03ca6ab80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c955935f00 con 0x55c955940380 2023-09-23T09:29:29.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.793+0000 7fd022d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c95593ac40 0x55c955943780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:29.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.794+0000 7fd022d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c95593ac40 0x55c955943780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42326/0 (socket says 172.21.15.82:42326) 2023-09-23T09:29:29.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.794+0000 7fd022d9d700 1 -- 172.21.15.82:0/2053147419 learned_addr learned my addr 172.21.15.82:0/2053147419 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:29:29.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.794+0000 7fd01a59c700 1 --2- 172.21.15.82:0/2053147419 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c955940380 0x55c955946870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:29.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.794+0000 7fd02359e700 1 --2- 172.21.15.82:0/2053147419 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c955940ca0 0x55c95593e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:29.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.794+0000 7fd022d9d700 1 -- 172.21.15.82:0/2053147419 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c955940380 msgr2=0x55c955946870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:29:29.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.794+0000 7fd022d9d700 1 --2- 172.21.15.82:0/2053147419 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c955940380 0x55c955946870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:29.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.794+0000 7fd022d9d700 1 -- 172.21.15.82:0/2053147419 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c955940ca0 msgr2=0x55c95593e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:29:29.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.794+0000 7fd022d9d700 1 --2- 172.21.15.82:0/2053147419 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c955940ca0 0x55c95593e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:29.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.794+0000 7fd022d9d700 1 -- 172.21.15.82:0/2053147419 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c9556a1c60 con 0x55c95593ac40 2023-09-23T09:29:29.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.794+0000 7fd022d9d700 1 --2- 172.21.15.82:0/2053147419 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c95593ac40 0x55c955943780 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fd014002230 tx=0x7fd0140099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4824586373bdc7dc server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:29:29.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.795+0000 7fd019d9b700 1 -- 172.21.15.82:0/2053147419 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd01400e030 con 0x55c95593ac40 2023-09-23T09:29:29.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.795+0000 7fd019d9b700 1 -- 172.21.15.82:0/2053147419 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd01400f040 con 0x55c95593ac40 2023-09-23T09:29:29.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.795+0000 7fd019d9b700 1 -- 172.21.15.82:0/2053147419 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd01401b070 con 0x55c95593ac40 2023-09-23T09:29:29.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.796+0000 7fd03ca6ab80 1 -- 172.21.15.82:0/2053147419 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c95593ac40 msgr2=0x55c955943780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:29:29.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.796+0000 7fd03ca6ab80 1 --2- 172.21.15.82:0/2053147419 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c95593ac40 0x55c955943780 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fd014002230 tx=0x7fd0140099e0 comp rx=0 tx=0).stop 2023-09-23T09:29:29.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.796+0000 7fd03ca6ab80 1 -- 172.21.15.82:0/2053147419 shutdown_connections 2023-09-23T09:29:29.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.796+0000 7fd03ca6ab80 1 --2- 172.21.15.82:0/2053147419 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c955940ca0 0x55c95593e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:29.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.796+0000 7fd03ca6ab80 1 --2- 172.21.15.82:0/2053147419 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c95593ac40 0x55c955943780 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:29.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.796+0000 7fd03ca6ab80 1 --2- 172.21.15.82:0/2053147419 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c955940380 0x55c955946870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:29.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.796+0000 7fd03ca6ab80 1 -- 172.21.15.82:0/2053147419 >> 172.21.15.82:0/2053147419 conn(0x55c9558af0e0 msgr2=0x55c9559350a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:29:29.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.797+0000 7fd03ca6ab80 1 -- 172.21.15.82:0/2053147419 shutdown_connections 2023-09-23T09:29:29.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.797+0000 7fd03ca6ab80 1 -- 172.21.15.82:0/2053147419 wait complete. 2023-09-23T09:29:29.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.797+0000 7fd03ca6ab80 1 -- start start 2023-09-23T09:29:29.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.798+0000 7fd03ca6ab80 1 Processor -- start 2023-09-23T09:29:29.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.798+0000 7fd03ca6ab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c95593ac40 0x55c95593cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:29.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.798+0000 7fd03ca6ab80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c955940380 0x55c95593d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:29.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.798+0000 7fd03ca6ab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c955940ca0 0x55c95593be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:29.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.798+0000 7fd03ca6ab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c95593dbf0 con 0x55c95593ac40 2023-09-23T09:29:29.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.798+0000 7fd03ca6ab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c95593c340 con 0x55c955940ca0 2023-09-23T09:29:29.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.798+0000 7fd03ca6ab80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c95593c500 con 0x55c955940380 2023-09-23T09:29:29.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.798+0000 7fd03ca6ab80 10 client.0 _ll_register_callbacks cb 0x7fd01c007910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:29:29.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.799+0000 7fd02359e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c955940ca0 0x55c95593be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:29.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.799+0000 7fd02359e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c955940ca0 0x55c95593be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:44888/0 (socket says 172.21.15.82:44888) 2023-09-23T09:29:29.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.799+0000 7fd02359e700 1 -- 172.21.15.82:0/2629651071 learned_addr learned my addr 172.21.15.82:0/2629651071 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:29:29.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.799+0000 7fd022d9d700 1 --2- 172.21.15.82:0/2629651071 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c95593ac40 0x55c95593cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:29.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.800+0000 7fd02359e700 1 -- 172.21.15.82:0/2629651071 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c955940380 msgr2=0x55c95593d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:29:29.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.800+0000 7fd02359e700 1 --2- 172.21.15.82:0/2629651071 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c955940380 0x55c95593d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:29.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.800+0000 7fd02359e700 1 -- 172.21.15.82:0/2629651071 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c95593ac40 msgr2=0x55c95593cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:29:29.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.800+0000 7fd02359e700 1 --2- 172.21.15.82:0/2629651071 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c95593ac40 0x55c95593cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:29.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.800+0000 7fd02359e700 1 -- 172.21.15.82:0/2629651071 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd014009390 con 0x55c955940ca0 2023-09-23T09:29:29.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.800+0000 7fd02359e700 1 --2- 172.21.15.82:0/2629651071 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c955940ca0 0x55c95593be00 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd01c027040 tx=0x7fd01c004c70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e8971f4a90bb0cc server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:29:29.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.800+0000 7fd00a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-09-23T09:29:29.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.801+0000 7fd00a7fc700 1 -- 172.21.15.82:0/2629651071 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd01c03b070 con 0x55c955940ca0 2023-09-23T09:29:29.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.801+0000 7fd00a7fc700 1 -- 172.21.15.82:0/2629651071 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(141..141 src has 1..141) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fd01c004f40 con 0x55c955940ca0 2023-09-23T09:29:29.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.801+0000 7fd03ca6ab80 1 -- 172.21.15.82:0/2629651071 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c95592d8b0 con 0x55c955940ca0 2023-09-23T09:29:29.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.802+0000 7fd00a7fc700 1 -- 172.21.15.82:0/2629651071 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd01c036480 con 0x55c955940ca0 2023-09-23T09:29:29.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.802+0000 7fd03ca6ab80 10 client.27071 fetch_fsmap learned FSMap version 91 2023-09-23T09:29:29.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.802+0000 7fd03ca6ab80 1 -- 172.21.15.82:0/2629651071 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=4+}) v3 -- 0x55c9556df250 con 0x55c955940ca0 2023-09-23T09:29:29.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.802+0000 7fd00a7fc700 1 -- 172.21.15.82:0/2629651071 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55c95592d8b0 con 0x55c955940ca0 2023-09-23T09:29:29.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.802+0000 7fd00a7fc700 1 -- 172.21.15.82:0/2629651071 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 91) v1 ==== 7930+0+0 (secure 0 0 0) 0x7fd01c03e020 con 0x55c955940ca0 2023-09-23T09:29:29.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.803+0000 7fd03ca6ab80 10 client.27071 fetch_fsmap finished waiting for FSMap version 91 2023-09-23T09:29:29.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.803+0000 7fd03ca6ab80 10 client.27071 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2023-09-23T09:29:29.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.803+0000 7fd03ca6ab80 20 client.27071 populate_metadata read hostname 'smithi082' 2023-09-23T09:29:29.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.803+0000 7fd03ca6ab80 1 --2- 172.21.15.82:0/2629651071 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x55c9559a91e0 0x55c9559ab600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:29.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.803+0000 7fd03ca6ab80 4 client.27071 mds_command: new command op to 24514 tid=0[{"prefix": "damage ls"}] 2023-09-23T09:29:29.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.803+0000 7fd03ca6ab80 1 -- 172.21.15.82:0/2629651071 --> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55c955885970 con 0x55c9559a91e0 2023-09-23T09:29:29.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.803+0000 7fd022d9d700 1 --2- 172.21.15.82:0/2629651071 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x55c9559a91e0 0x55c9559ab600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:29.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.807+0000 7fd022d9d700 1 --2- 172.21.15.82:0/2629651071 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x55c9559a91e0 0x55c9559ab600 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=8bd84ea09cc536e2 server_cookie=10bab352dfbba1ce in_seq=0 out_seq=0 2023-09-23T09:29:29.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.807+0000 7fd00a7fc700 10 client.27071 ms_handle_connect on v2:172.21.15.161:6834/2237964162 2023-09-23T09:29:29.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.807+0000 7fd00a7fc700 1 -- 172.21.15.82:0/2629651071 <== mds.4 v2:172.21.15.161:6834/2237964162 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55c955885970 con 0x55c9559a91e0 2023-09-23T09:29:29.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.807+0000 7fd00a7fc700 10 client.27071 handle_command_reply: tid=0 2023-09-23T09:29:29.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.807+0000 7fd03ca6ab80 1 client.27071 shutdown 2023-09-23T09:29:29.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.807+0000 7fd03ca6ab80 1 -- 172.21.15.82:0/2629651071 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c955940ca0 msgr2=0x55c95593be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:29:29.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.807+0000 7fd03ca6ab80 1 --2- 172.21.15.82:0/2629651071 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c955940ca0 0x55c95593be00 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd01c027040 tx=0x7fd01c004c70 comp rx=0 tx=0).stop 2023-09-23T09:29:29.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.808+0000 7fd03ca6ab80 1 -- 172.21.15.82:0/2629651071 shutdown_connections 2023-09-23T09:29:29.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.808+0000 7fd03ca6ab80 1 --2- 172.21.15.82:0/2629651071 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x55c9559a91e0 0x55c9559ab600 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:29.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.808+0000 7fd03ca6ab80 1 --2- 172.21.15.82:0/2629651071 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c955940ca0 0x55c95593be00 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:29.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.808+0000 7fd03ca6ab80 1 --2- 172.21.15.82:0/2629651071 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c95593ac40 0x55c95593cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:29.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.808+0000 7fd03ca6ab80 1 --2- 172.21.15.82:0/2629651071 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c955940380 0x55c95593d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:29.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.808+0000 7fd03ca6ab80 1 -- 172.21.15.82:0/2629651071 >> 172.21.15.82:0/2629651071 conn(0x55c9558af0e0 msgr2=0x55c95593e0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:29:29.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.808+0000 7fd00a7fc700 0 client.27071 ms_handle_reset on v2:172.21.15.161:6834/2237964162 2023-09-23T09:29:29.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.808+0000 7fd03ca6ab80 1 -- 172.21.15.82:0/2629651071 shutdown_connections 2023-09-23T09:29:29.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.808+0000 7fd03ca6ab80 1 -- 172.21.15.82:0/2629651071 wait complete. 2023-09-23T09:29:29.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:29:29 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/3224855904' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T09:29:29.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.809+0000 7fd03ca6ab80 20 client.27071 trim_cache size 0 max 16384 2023-09-23T09:29:29.813 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2023-09-23T09:29:29.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.810+0000 7fd0291ff700 1 -- 172.21.15.82:0/2758032047 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fd0100a0110 msgr2=0x7fd0100a25d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:29:29.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.810+0000 7fd0291ff700 1 --2- 172.21.15.82:0/2758032047 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fd0100a0110 0x7fd0100a25d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd01c026000 tx=0x7fd01c022000 comp rx=0 tx=0).stop 2023-09-23T09:29:29.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.810+0000 7fd0291ff700 1 -- 172.21.15.82:0/2758032047 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd02411a100 msgr2=0x7fd024113a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:29:29.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.810+0000 7fd0291ff700 1 --2- 172.21.15.82:0/2758032047 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd02411a100 0x7fd024113a40 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd00c009230 tx=0x7fd00c00b610 comp rx=0 tx=0).stop 2023-09-23T09:29:29.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.810+0000 7fd0291ff700 1 -- 172.21.15.82:0/2758032047 shutdown_connections 2023-09-23T09:29:29.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.810+0000 7fd0291ff700 1 --2- 172.21.15.82:0/2758032047 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fd0100a0110 0x7fd0100a25d0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:29.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.810+0000 7fd0291ff700 1 --2- 172.21.15.82:0/2758032047 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd024117f10 0x7fd0241183c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:29.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.810+0000 7fd0291ff700 1 --2- 172.21.15.82:0/2758032047 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd02410f440 0x7fd024113500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:29.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.810+0000 7fd0291ff700 1 --2- 172.21.15.82:0/2758032047 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd02411a100 0x7fd024113a40 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:29.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.810+0000 7fd0291ff700 1 -- 172.21.15.82:0/2758032047 >> 172.21.15.82:0/2758032047 conn(0x7fd02406cbe0 msgr2=0x7fd02411b6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:29:29.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.811+0000 7fd0291ff700 1 -- 172.21.15.82:0/2758032047 shutdown_connections 2023-09-23T09:29:29.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:29.811+0000 7fd0291ff700 1 -- 172.21.15.82:0/2758032047 wait complete. 2023-09-23T09:29:29.850 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-09-23T09:29:30.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.206+0000 7f3730bff700 1 -- 172.21.15.82:0/4196759368 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f372c107920 msgr2=0x7f372c107d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:29:30.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.206+0000 7f3730bff700 1 --2- 172.21.15.82:0/4196759368 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f372c107920 0x7f372c107d00 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f37140098f0 tx=0x7f3714009c00 comp rx=0 tx=0).stop 2023-09-23T09:29:30.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.206+0000 7f3730bff700 1 -- 172.21.15.82:0/4196759368 shutdown_connections 2023-09-23T09:29:30.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.206+0000 7f3730bff700 1 --2- 172.21.15.82:0/4196759368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f372c113a70 0x7f372c115e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:30.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.206+0000 7f3730bff700 1 --2- 172.21.15.82:0/4196759368 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f372c107920 0x7f372c107d00 secure :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f37140098f0 tx=0x7f3714009c00 comp rx=0 tx=0).stop 2023-09-23T09:29:30.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.206+0000 7f3730bff700 1 --2- 172.21.15.82:0/4196759368 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f372c108240 0x7f372c113530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:30.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.206+0000 7f3730bff700 1 -- 172.21.15.82:0/4196759368 >> 172.21.15.82:0/4196759368 conn(0x7f372c06ce40 msgr2=0x7f372c06d250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:29:30.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.207+0000 7f3730bff700 1 -- 172.21.15.82:0/4196759368 shutdown_connections 2023-09-23T09:29:30.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.207+0000 7f3730bff700 1 -- 172.21.15.82:0/4196759368 wait complete. 2023-09-23T09:29:30.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.209+0000 7f3730bff700 1 Processor -- start 2023-09-23T09:29:30.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.209+0000 7f3730bff700 1 -- start start 2023-09-23T09:29:30.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.209+0000 7f3730bff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f372c108240 0x7f372c19d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:30.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.210+0000 7f3730bff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f372c113a70 0x7f372c19d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:30.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.210+0000 7f3730bff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f372c1a1bd0 0x7f372c1a2050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:30.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.210+0000 7f3730bff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f372c1a2650 con 0x7f372c108240 2023-09-23T09:29:30.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.210+0000 7f3730bff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f372c1a27c0 con 0x7f372c113a70 2023-09-23T09:29:30.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.210+0000 7f3730bff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f372c1a2980 con 0x7f372c1a1bd0 2023-09-23T09:29:30.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.210+0000 7f3723fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f372c113a70 0x7f372c19d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:30.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.210+0000 7f3723fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f372c113a70 0x7f372c19d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:44910/0 (socket says 172.21.15.82:44910) 2023-09-23T09:29:30.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.210+0000 7f3723fff700 1 -- 172.21.15.82:0/3028473217 learned_addr learned my addr 172.21.15.82:0/3028473217 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:29:30.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.211+0000 7f372ad9d700 1 --2- 172.21.15.82:0/3028473217 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f372c1a1bd0 0x7f372c1a2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:30.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.211+0000 7f3723fff700 1 -- 172.21.15.82:0/3028473217 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f372c1a1bd0 msgr2=0x7f372c1a2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:29:30.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.211+0000 7f3723fff700 1 --2- 172.21.15.82:0/3028473217 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f372c1a1bd0 0x7f372c1a2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:30.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.211+0000 7f3723fff700 1 -- 172.21.15.82:0/3028473217 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f372c108240 msgr2=0x7f372c19d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:29:30.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.211+0000 7f3723fff700 1 --2- 172.21.15.82:0/3028473217 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f372c108240 0x7f372c19d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:30.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.211+0000 7f3723fff700 1 -- 172.21.15.82:0/3028473217 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f371c00f750 con 0x7f372c113a70 2023-09-23T09:29:30.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.212+0000 7f3723fff700 1 --2- 172.21.15.82:0/3028473217 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f372c113a70 0x7f372c19d770 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f371c009b30 tx=0x7f371c009e40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:29:30.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.212+0000 7f37237fe700 1 -- 172.21.15.82:0/3028473217 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f371c00cb70 con 0x7f372c113a70 2023-09-23T09:29:30.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.212+0000 7f37237fe700 1 -- 172.21.15.82:0/3028473217 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f371c00ccd0 con 0x7f372c113a70 2023-09-23T09:29:30.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.212+0000 7f37237fe700 1 -- 172.21.15.82:0/3028473217 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f371c0165c0 con 0x7f372c113a70 2023-09-23T09:29:30.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.212+0000 7f3730bff700 1 -- 172.21.15.82:0/3028473217 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3714009520 con 0x7f372c113a70 2023-09-23T09:29:30.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.212+0000 7f3730bff700 1 -- 172.21.15.82:0/3028473217 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f372c1aa180 con 0x7f372c113a70 2023-09-23T09:29:30.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.219+0000 7f37237fe700 1 -- 172.21.15.82:0/3028473217 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f371c017400 con 0x7f372c113a70 2023-09-23T09:29:30.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.220+0000 7f37445e4b80 1 Processor -- start 2023-09-23T09:29:30.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.220+0000 7f37445e4b80 1 -- start start 2023-09-23T09:29:30.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.221+0000 7f37445e4b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5591bf38a380 0x5591bf38a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:30.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.221+0000 7f37445e4b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591bf38aca0 0x5591bf384700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:30.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.221+0000 7f37445e4b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591bf384c40 0x5591bf3850a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:30.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.221+0000 7f37445e4b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591bf2ec7b0 con 0x5591bf38aca0 2023-09-23T09:29:30.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.221+0000 7f37445e4b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591bf2dd780 con 0x5591bf384c40 2023-09-23T09:29:30.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.221+0000 7f37445e4b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591bf2db0a0 con 0x5591bf38a380 2023-09-23T09:29:30.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.221+0000 7f372ad9d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5591bf38a380 0x5591bf38a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:30.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.222+0000 7f372ad9d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5591bf38a380 0x5591bf38a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:46120/0 (socket says 172.21.15.82:46120) 2023-09-23T09:29:30.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.222+0000 7f372ad9d700 1 -- 172.21.15.82:0/118964062 learned_addr learned my addr 172.21.15.82:0/118964062 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:29:30.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.222+0000 7f372a59c700 1 --2- 172.21.15.82:0/118964062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591bf38aca0 0x5591bf384700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:30.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.223+0000 7f372ad9d700 1 -- 172.21.15.82:0/118964062 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591bf384c40 msgr2=0x5591bf3850a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:29:30.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.223+0000 7f37237fe700 1 --2- 172.21.15.82:0/3028473217 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f37180a0200 0x7f37180a26c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:30.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.224+0000 7f3723fff700 1 --2- 172.21.15.82:0/118964062 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591bf384c40 0x5591bf3850a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:30.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.224+0000 7f372ad9d700 1 --2- 172.21.15.82:0/118964062 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591bf384c40 0x5591bf3850a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:30.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.224+0000 7f372ad9d700 1 -- 172.21.15.82:0/118964062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591bf38aca0 msgr2=0x5591bf384700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:29:30.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.224+0000 7f372ad9d700 1 --2- 172.21.15.82:0/118964062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591bf38aca0 0x5591bf384700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:30.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.224+0000 7f372ad9d700 1 -- 172.21.15.82:0/118964062 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5591bf156630 con 0x5591bf38a380 2023-09-23T09:29:30.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.224+0000 7f372a59c700 1 --2- 172.21.15.82:0/118964062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591bf38aca0 0x5591bf384700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:29:30.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.225+0000 7f3723fff700 1 --2- 172.21.15.82:0/118964062 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591bf384c40 0x5591bf3850a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T09:29:30.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.225+0000 7f372ad9d700 1 --2- 172.21.15.82:0/118964062 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5591bf38a380 0x5591bf38a760 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3724011670 tx=0x7f3724011980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e45a3efeb0562d6f server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:29:30.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.226+0000 7f372ad9d700 1 --2- 172.21.15.82:0/3028473217 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f37180a0200 0x7f37180a26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:30.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.226+0000 7f3720ff9700 1 -- 172.21.15.82:0/118964062 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37240044c0 con 0x5591bf38a380 2023-09-23T09:29:30.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.226+0000 7f3720ff9700 1 -- 172.21.15.82:0/118964062 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3724004620 con 0x5591bf38a380 2023-09-23T09:29:30.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.226+0000 7f3720ff9700 1 -- 172.21.15.82:0/118964062 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3724022ea0 con 0x5591bf38a380 2023-09-23T09:29:30.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.227+0000 7f37237fe700 1 -- 172.21.15.82:0/3028473217 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f371c0cb650 con 0x7f372c113a70 2023-09-23T09:29:30.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.227+0000 7f37445e4b80 1 -- 172.21.15.82:0/118964062 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5591bf38a380 msgr2=0x5591bf38a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:29:30.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.227+0000 7f37445e4b80 1 --2- 172.21.15.82:0/118964062 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5591bf38a380 0x5591bf38a760 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3724011670 tx=0x7f3724011980 comp rx=0 tx=0).stop 2023-09-23T09:29:30.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.229+0000 7f372ad9d700 1 --2- 172.21.15.82:0/3028473217 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f37180a0200 0x7f37180a26c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3724021000 tx=0x7f3724017840 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:29:30.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.229+0000 7f37445e4b80 1 -- 172.21.15.82:0/118964062 shutdown_connections 2023-09-23T09:29:30.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.229+0000 7f37445e4b80 1 --2- 172.21.15.82:0/118964062 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591bf384c40 0x5591bf3850a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:30.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.229+0000 7f37445e4b80 1 --2- 172.21.15.82:0/118964062 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5591bf38a380 0x5591bf38a760 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:30.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.229+0000 7f37445e4b80 1 --2- 172.21.15.82:0/118964062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591bf38aca0 0x5591bf384700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:30.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.229+0000 7f37445e4b80 1 -- 172.21.15.82:0/118964062 >> 172.21.15.82:0/118964062 conn(0x5591bf2f90e0 msgr2=0x5591bf37f410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:29:30.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.230+0000 7f37445e4b80 1 -- 172.21.15.82:0/118964062 shutdown_connections 2023-09-23T09:29:30.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.230+0000 7f37445e4b80 1 -- 172.21.15.82:0/118964062 wait complete. 2023-09-23T09:29:30.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.231+0000 7f37445e4b80 1 -- start start 2023-09-23T09:29:30.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.231+0000 7f37445e4b80 1 Processor -- start 2023-09-23T09:29:30.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.232+0000 7f37445e4b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591bf384c40 0x5591bf390be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:30.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.232+0000 7f37445e4b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5591bf38a380 0x5591bf38de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:30.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.232+0000 7f37445e4b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591bf38aca0 0x5591bf38e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:30.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.232+0000 7f37445e4b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591bf2d6990 con 0x5591bf38aca0 2023-09-23T09:29:30.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.232+0000 7f37445e4b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591bf274bb0 con 0x5591bf384c40 2023-09-23T09:29:30.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.232+0000 7f37445e4b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591bf2748b0 con 0x5591bf38a380 2023-09-23T09:29:30.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.233+0000 7f37445e4b80 10 client.0 _ll_register_callbacks cb 0x5591bf1bea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:29:30.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.233+0000 7f3723fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5591bf38a380 0x5591bf38de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:30.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.233+0000 7f3723fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5591bf38a380 0x5591bf38de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:46122/0 (socket says 172.21.15.82:46122) 2023-09-23T09:29:30.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.233+0000 7f3723fff700 1 -- 172.21.15.82:0/1902518618 learned_addr learned my addr 172.21.15.82:0/1902518618 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:29:30.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.234+0000 7f372a59c700 1 --2- 172.21.15.82:0/1902518618 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591bf384c40 0x5591bf390be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:30.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.234+0000 7f3723fff700 1 -- 172.21.15.82:0/1902518618 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591bf384c40 msgr2=0x5591bf390be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:29:30.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.234+0000 7f3723fff700 1 --2- 172.21.15.82:0/1902518618 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591bf384c40 0x5591bf390be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:30.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.234+0000 7f3723fff700 1 -- 172.21.15.82:0/1902518618 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591bf38aca0 msgr2=0x5591bf38e4e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-23T09:29:30.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.234+0000 7f3723fff700 1 --2- 172.21.15.82:0/1902518618 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591bf38aca0 0x5591bf38e4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:30.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.234+0000 7f3723fff700 1 -- 172.21.15.82:0/1902518618 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f372c1168f0 con 0x5591bf38a380 2023-09-23T09:29:30.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.235+0000 7f3723fff700 1 --2- 172.21.15.82:0/1902518618 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5591bf38a380 0x5591bf38de60 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f371c098c90 tx=0x7f371c098660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c7fb1f34cf92404b server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:29:30.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.235+0000 7f3711ffb700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T09:29:30.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.235+0000 7f3711ffb700 1 -- 172.21.15.82:0/1902518618 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f371c098d00 con 0x5591bf38a380 2023-09-23T09:29:30.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.235+0000 7f37445e4b80 1 -- 172.21.15.82:0/1902518618 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5591bf3541c0 con 0x5591bf38a380 2023-09-23T09:29:30.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.236+0000 7f3711ffb700 1 -- 172.21.15.82:0/1902518618 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(141..141 src has 1..141) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f371c09cb30 con 0x5591bf38a380 2023-09-23T09:29:30.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.236+0000 7f3711ffb700 1 -- 172.21.15.82:0/1902518618 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f371c0a0b10 con 0x5591bf38a380 2023-09-23T09:29:30.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.236+0000 7f37445e4b80 10 client.27124 fetch_fsmap learned FSMap version 91 2023-09-23T09:29:30.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.236+0000 7f37445e4b80 1 -- 172.21.15.82:0/1902518618 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=4+}) v3 -- 0x7f3724003cb0 con 0x5591bf38a380 2023-09-23T09:29:30.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.236+0000 7f3711ffb700 1 -- 172.21.15.82:0/1902518618 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5591bf3541c0 con 0x5591bf38a380 2023-09-23T09:29:30.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.237+0000 7f3711ffb700 1 -- 172.21.15.82:0/1902518618 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 91) v1 ==== 7930+0+0 (secure 0 0 0) 0x7f371c098f60 con 0x5591bf38a380 2023-09-23T09:29:30.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.238+0000 7f37445e4b80 10 client.27124 fetch_fsmap finished waiting for FSMap version 91 2023-09-23T09:29:30.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.238+0000 7f37445e4b80 10 client.27124 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2023-09-23T09:29:30.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.238+0000 7f37445e4b80 20 client.27124 populate_metadata read hostname 'smithi082' 2023-09-23T09:29:30.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.238+0000 7f37445e4b80 1 --2- 172.21.15.82:0/1902518618 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x5591bf39e620 0x5591bf3a0a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:30.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.238+0000 7f37445e4b80 4 client.27124 mds_command: new command op to 24515 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:29:30.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.238+0000 7f37445e4b80 1 -- 172.21.15.82:0/1902518618 --> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5591bf27cba0 con 0x5591bf39e620 2023-09-23T09:29:30.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.238+0000 7f372a59c700 1 --2- 172.21.15.82:0/1902518618 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x5591bf39e620 0x5591bf3a0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:30.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.239+0000 7f372a59c700 1 --2- 172.21.15.82:0/1902518618 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x5591bf39e620 0x5591bf3a0a40 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=46549d752109b18f server_cookie=52240d2b312a2a48 in_seq=0 out_seq=0 2023-09-23T09:29:30.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.239+0000 7f3711ffb700 10 client.27124 ms_handle_connect on v2:172.21.15.135:6836/2655304858 2023-09-23T09:29:30.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.240+0000 7f3711ffb700 1 -- 172.21.15.82:0/1902518618 <== mds.3 v2:172.21.15.135:6836/2655304858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5591bf27cba0 con 0x5591bf39e620 2023-09-23T09:29:30.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.240+0000 7f3711ffb700 10 client.27124 handle_command_reply: tid=0 2023-09-23T09:29:30.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.240+0000 7f37445e4b80 1 client.27124 shutdown 2023-09-23T09:29:30.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.241+0000 7f37445e4b80 1 -- 172.21.15.82:0/1902518618 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5591bf38a380 msgr2=0x5591bf38de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:29:30.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.241+0000 7f37445e4b80 1 --2- 172.21.15.82:0/1902518618 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5591bf38a380 0x5591bf38de60 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f371c098c90 tx=0x7f371c098660 comp rx=0 tx=0).stop 2023-09-23T09:29:30.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.243+0000 7f37445e4b80 1 -- 172.21.15.82:0/1902518618 shutdown_connections 2023-09-23T09:29:30.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.243+0000 7f37445e4b80 1 --2- 172.21.15.82:0/1902518618 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591bf38aca0 0x5591bf38e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:30.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.243+0000 7f37445e4b80 1 --2- 172.21.15.82:0/1902518618 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591bf384c40 0x5591bf390be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:30.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.243+0000 7f37445e4b80 1 --2- 172.21.15.82:0/1902518618 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x5591bf39e620 0x5591bf3a0a40 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:30.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.243+0000 7f37445e4b80 1 --2- 172.21.15.82:0/1902518618 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5591bf38a380 0x5591bf38de60 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:30.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.243+0000 7f37445e4b80 1 -- 172.21.15.82:0/1902518618 >> 172.21.15.82:0/1902518618 conn(0x5591bf2f90e0 msgr2=0x5591bf379b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:29:30.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.243+0000 7f3711ffb700 0 client.27124 ms_handle_reset on v2:172.21.15.135:6836/2655304858 2023-09-23T09:29:30.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.243+0000 7f37445e4b80 1 -- 172.21.15.82:0/1902518618 shutdown_connections 2023-09-23T09:29:30.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.243+0000 7f37445e4b80 1 -- 172.21.15.82:0/1902518618 wait complete. 2023-09-23T09:29:30.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.244+0000 7f37445e4b80 20 client.27124 trim_cache size 0 max 16384 2023-09-23T09:29:30.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.270+0000 7f37445e4b80 1 Processor -- start 2023-09-23T09:29:30.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.270+0000 7f37445e4b80 1 -- start start 2023-09-23T09:29:30.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.271+0000 7f37445e4b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5591bf384c40 0x5591bf384700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:30.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.271+0000 7f37445e4b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591bf38a380 0x5591bf37f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:30.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.271+0000 7f37445e4b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591bf38aca0 0x5591bf37f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:30.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.271+0000 7f37445e4b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591bf158920 con 0x5591bf38a380 2023-09-23T09:29:30.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.271+0000 7f37445e4b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591bf39bcb0 con 0x5591bf38aca0 2023-09-23T09:29:30.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.271+0000 7f37445e4b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591bf37bc80 con 0x5591bf384c40 2023-09-23T09:29:30.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.272+0000 7f372a59c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5591bf384c40 0x5591bf384700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:30.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.272+0000 7f372ad9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591bf38aca0 0x5591bf37f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:30.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.272+0000 7f372ad9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591bf38aca0 0x5591bf37f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:44940/0 (socket says 172.21.15.82:44940) 2023-09-23T09:29:30.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.272+0000 7f372ad9d700 1 -- 172.21.15.82:0/1674792696 learned_addr learned my addr 172.21.15.82:0/1674792696 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:29:30.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.272+0000 7f3723fff700 1 --2- 172.21.15.82:0/1674792696 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591bf38a380 0x5591bf37f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:30.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.273+0000 7f372ad9d700 1 -- 172.21.15.82:0/1674792696 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5591bf384c40 msgr2=0x5591bf384700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:29:30.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.273+0000 7f372ad9d700 1 --2- 172.21.15.82:0/1674792696 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5591bf384c40 0x5591bf384700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:30.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.273+0000 7f372ad9d700 1 -- 172.21.15.82:0/1674792696 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591bf38a380 msgr2=0x5591bf37f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:29:30.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.273+0000 7f372ad9d700 1 --2- 172.21.15.82:0/1674792696 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591bf38a380 0x5591bf37f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:30.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.273+0000 7f372ad9d700 1 -- 172.21.15.82:0/1674792696 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5591bf102de0 con 0x5591bf38aca0 2023-09-23T09:29:30.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.274+0000 7f372ad9d700 1 --2- 172.21.15.82:0/1674792696 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591bf38aca0 0x5591bf37f5e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f3724003ff0 tx=0x7f372402d000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f5ae79574c9c9b6 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:29:30.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.274+0000 7f37217fa700 1 -- 172.21.15.82:0/1674792696 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f372400d070 con 0x5591bf38aca0 2023-09-23T09:29:30.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.274+0000 7f37217fa700 1 -- 172.21.15.82:0/1674792696 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3724011300 con 0x5591bf38aca0 2023-09-23T09:29:30.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.274+0000 7f37217fa700 1 -- 172.21.15.82:0/1674792696 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3724005a20 con 0x5591bf38aca0 2023-09-23T09:29:30.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.275+0000 7f37445e4b80 1 -- 172.21.15.82:0/1674792696 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591bf38aca0 msgr2=0x5591bf37f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:29:30.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.275+0000 7f37445e4b80 1 --2- 172.21.15.82:0/1674792696 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591bf38aca0 0x5591bf37f5e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f3724003ff0 tx=0x7f372402d000 comp rx=0 tx=0).stop 2023-09-23T09:29:30.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.276+0000 7f37445e4b80 1 -- 172.21.15.82:0/1674792696 shutdown_connections 2023-09-23T09:29:30.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.276+0000 7f37445e4b80 1 --2- 172.21.15.82:0/1674792696 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591bf38aca0 0x5591bf37f5e0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:30.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.276+0000 7f37445e4b80 1 --2- 172.21.15.82:0/1674792696 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5591bf384c40 0x5591bf384700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:30.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.276+0000 7f37445e4b80 1 --2- 172.21.15.82:0/1674792696 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591bf38a380 0x5591bf37f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:30.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.276+0000 7f37445e4b80 1 -- 172.21.15.82:0/1674792696 >> 172.21.15.82:0/1674792696 conn(0x5591bf2f90e0 msgr2=0x5591bf399ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:29:30.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.276+0000 7f37445e4b80 1 -- 172.21.15.82:0/1674792696 shutdown_connections 2023-09-23T09:29:30.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.276+0000 7f37445e4b80 1 -- 172.21.15.82:0/1674792696 wait complete. 2023-09-23T09:29:30.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.277+0000 7f37445e4b80 1 -- start start 2023-09-23T09:29:30.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.277+0000 7f37445e4b80 1 Processor -- start 2023-09-23T09:29:30.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.278+0000 7f37445e4b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5591bf384c40 0x5591bf385e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:30.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.278+0000 7f37445e4b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591bf38a380 0x5591bf386340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:30.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.278+0000 7f37445e4b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591bf38aca0 0x5591bf386880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:30.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.278+0000 7f37445e4b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591bf386f90 con 0x5591bf38aca0 2023-09-23T09:29:30.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.278+0000 7f37445e4b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591bf387100 con 0x5591bf38a380 2023-09-23T09:29:30.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.278+0000 7f37445e4b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591bf3872c0 con 0x5591bf384c40 2023-09-23T09:29:30.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.278+0000 7f37445e4b80 10 client.0 _ll_register_callbacks cb 0x7f371c095110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:29:30.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.278+0000 7f3723fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591bf38a380 0x5591bf386340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:30.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.278+0000 7f3723fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591bf38a380 0x5591bf386340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:44946/0 (socket says 172.21.15.82:44946) 2023-09-23T09:29:30.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.278+0000 7f3723fff700 1 -- 172.21.15.82:0/819761255 learned_addr learned my addr 172.21.15.82:0/819761255 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:29:30.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.278+0000 7f372a59c700 1 --2- 172.21.15.82:0/819761255 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5591bf384c40 0x5591bf385e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:30.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.278+0000 7f3723fff700 1 -- 172.21.15.82:0/819761255 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5591bf384c40 msgr2=0x5591bf385e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:29:30.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.278+0000 7f3723fff700 1 --2- 172.21.15.82:0/819761255 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5591bf384c40 0x5591bf385e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:30.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.279+0000 7f3723fff700 1 -- 172.21.15.82:0/819761255 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591bf38aca0 msgr2=0x5591bf386880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:29:30.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.279+0000 7f3723fff700 1 --2- 172.21.15.82:0/819761255 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591bf38aca0 0x5591bf386880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:30.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.279+0000 7f3723fff700 1 -- 172.21.15.82:0/819761255 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5591bf156630 con 0x5591bf38a380 2023-09-23T09:29:30.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.279+0000 7f3723fff700 1 --2- 172.21.15.82:0/819761255 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591bf38a380 0x5591bf386340 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f371c005950 tx=0x7f371c099570 comp rx=0 tx=0).ready entity=mon.2 client_cookie=674106ac1f3868e server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:29:30.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.279+0000 7f3711ffb700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-09-23T09:29:30.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.279+0000 7f3711ffb700 1 -- 172.21.15.82:0/819761255 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f371c0a0880 con 0x5591bf38a380 2023-09-23T09:29:30.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.279+0000 7f3711ffb700 1 -- 172.21.15.82:0/819761255 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(141..141 src has 1..141) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f371c098d00 con 0x5591bf38a380 2023-09-23T09:29:30.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.279+0000 7f37445e4b80 1 -- 172.21.15.82:0/819761255 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5591bf3778b0 con 0x5591bf38a380 2023-09-23T09:29:30.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.280+0000 7f3711ffb700 1 -- 172.21.15.82:0/819761255 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f371c0981f0 con 0x5591bf38a380 2023-09-23T09:29:30.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.280+0000 7f37445e4b80 10 client.27086 fetch_fsmap learned FSMap version 91 2023-09-23T09:29:30.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.280+0000 7f37445e4b80 1 -- 172.21.15.82:0/819761255 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=4+}) v3 -- 0x5591bf0ebc60 con 0x5591bf38a380 2023-09-23T09:29:30.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.280+0000 7f3711ffb700 1 -- 172.21.15.82:0/819761255 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5591bf3778b0 con 0x5591bf38a380 2023-09-23T09:29:30.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.281+0000 7f3711ffb700 1 -- 172.21.15.82:0/819761255 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 91) v1 ==== 7930+0+0 (secure 0 0 0) 0x7f371c0cb2d0 con 0x5591bf38a380 2023-09-23T09:29:30.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.281+0000 7f37445e4b80 10 client.27086 fetch_fsmap finished waiting for FSMap version 91 2023-09-23T09:29:30.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.281+0000 7f37445e4b80 10 client.27086 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2023-09-23T09:29:30.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.281+0000 7f37445e4b80 20 client.27086 populate_metadata read hostname 'smithi082' 2023-09-23T09:29:30.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.281+0000 7f37445e4b80 1 --2- 172.21.15.82:0/819761255 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x5591bf3eedc0 0x5591bf3ef1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:30.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.281+0000 7f37445e4b80 4 client.27086 mds_command: new command op to 24515 tid=0[{"prefix": "damage ls"}] 2023-09-23T09:29:30.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.281+0000 7f37445e4b80 1 -- 172.21.15.82:0/819761255 --> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5591bf2cf970 con 0x5591bf3eedc0 2023-09-23T09:29:30.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.282+0000 7f372a59c700 1 --2- 172.21.15.82:0/819761255 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x5591bf3eedc0 0x5591bf3ef1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:30.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.283+0000 7f372a59c700 1 --2- 172.21.15.82:0/819761255 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x5591bf3eedc0 0x5591bf3ef1d0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=c6af1db70ad69830 server_cookie=a2a54f789b76565b in_seq=0 out_seq=0 2023-09-23T09:29:30.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.283+0000 7f3711ffb700 10 client.27086 ms_handle_connect on v2:172.21.15.135:6836/2655304858 2023-09-23T09:29:30.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.283+0000 7f3711ffb700 1 -- 172.21.15.82:0/819761255 <== mds.3 v2:172.21.15.135:6836/2655304858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5591bf2cf970 con 0x5591bf3eedc0 2023-09-23T09:29:30.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.283+0000 7f3711ffb700 10 client.27086 handle_command_reply: tid=0 2023-09-23T09:29:30.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.283+0000 7f37445e4b80 1 client.27086 shutdown 2023-09-23T09:29:30.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.284+0000 7f37445e4b80 1 -- 172.21.15.82:0/819761255 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591bf38a380 msgr2=0x5591bf386340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:29:30.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.284+0000 7f37445e4b80 1 --2- 172.21.15.82:0/819761255 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591bf38a380 0x5591bf386340 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f371c005950 tx=0x7f371c099570 comp rx=0 tx=0).stop 2023-09-23T09:29:30.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.287+0000 7f37445e4b80 1 -- 172.21.15.82:0/819761255 shutdown_connections 2023-09-23T09:29:30.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.287+0000 7f37445e4b80 1 --2- 172.21.15.82:0/819761255 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591bf38aca0 0x5591bf386880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:30.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.287+0000 7f37445e4b80 1 --2- 172.21.15.82:0/819761255 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x5591bf3eedc0 0x5591bf3ef1d0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:30.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.287+0000 7f37445e4b80 1 --2- 172.21.15.82:0/819761255 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5591bf384c40 0x5591bf385e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:30.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.287+0000 7f37445e4b80 1 --2- 172.21.15.82:0/819761255 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591bf38a380 0x5591bf386340 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:30.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.287+0000 7f37445e4b80 1 -- 172.21.15.82:0/819761255 >> 172.21.15.82:0/819761255 conn(0x5591bf2f90e0 msgr2=0x5591bf37f0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:29:30.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.287+0000 7f3711ffb700 0 client.27086 ms_handle_reset on v2:172.21.15.135:6836/2655304858 2023-09-23T09:29:30.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.288+0000 7f37445e4b80 1 -- 172.21.15.82:0/819761255 shutdown_connections 2023-09-23T09:29:30.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.288+0000 7f37445e4b80 1 -- 172.21.15.82:0/819761255 wait complete. 2023-09-23T09:29:30.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.288+0000 7f37445e4b80 20 client.27086 trim_cache size 0 max 16384 2023-09-23T09:29:30.291 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2023-09-23T09:29:30.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.291+0000 7f3730bff700 1 -- 172.21.15.82:0/3028473217 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f37180a0200 msgr2=0x7f37180a26c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:29:30.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.291+0000 7f3730bff700 1 --2- 172.21.15.82:0/3028473217 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f37180a0200 0x7f37180a26c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3724021000 tx=0x7f3724017840 comp rx=0 tx=0).stop 2023-09-23T09:29:30.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.291+0000 7f3730bff700 1 -- 172.21.15.82:0/3028473217 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f372c113a70 msgr2=0x7f372c19d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:29:30.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.291+0000 7f3730bff700 1 --2- 172.21.15.82:0/3028473217 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f372c113a70 0x7f372c19d770 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f371c009b30 tx=0x7f371c009e40 comp rx=0 tx=0).stop 2023-09-23T09:29:30.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.293+0000 7f3730bff700 1 -- 172.21.15.82:0/3028473217 shutdown_connections 2023-09-23T09:29:30.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.293+0000 7f3730bff700 1 --2- 172.21.15.82:0/3028473217 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f37180a0200 0x7f37180a26c0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:30.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.293+0000 7f3730bff700 1 --2- 172.21.15.82:0/3028473217 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f372c1a1bd0 0x7f372c1a2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:30.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.293+0000 7f3730bff700 1 --2- 172.21.15.82:0/3028473217 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f372c108240 0x7f372c19d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:30.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.293+0000 7f3730bff700 1 --2- 172.21.15.82:0/3028473217 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f372c113a70 0x7f372c19d770 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:30.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.293+0000 7f3730bff700 1 -- 172.21.15.82:0/3028473217 >> 172.21.15.82:0/3028473217 conn(0x7f372c06ce40 msgr2=0x7f372c06f390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:29:30.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.302+0000 7f3730bff700 1 -- 172.21.15.82:0/3028473217 shutdown_connections 2023-09-23T09:29:30.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.304+0000 7f3730bff700 1 -- 172.21.15.82:0/3028473217 wait complete. 2023-09-23T09:29:30.345 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-09-23T09:29:30.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:29:30 smithi082 ceph-mon[97694]: pgmap v1033: 97 pgs: 97 active+clean; 16 GiB data, 54 GiB used, 1019 GiB / 1.0 TiB avail; 1.5 MiB/s rd, 19 MiB/s wr, 1.45k op/s 2023-09-23T09:29:30.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.708+0000 7f4aeabff700 1 -- 172.21.15.82:0/3894145310 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ae4074e50 msgr2=0x7f4ae4075230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:29:30.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.708+0000 7f4aeabff700 1 --2- 172.21.15.82:0/3894145310 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ae4074e50 0x7f4ae4075230 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f4ad4009990 tx=0x7f4ad4009ca0 comp rx=0 tx=0).stop 2023-09-23T09:29:30.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.708+0000 7f4aeabff700 1 -- 172.21.15.82:0/3894145310 shutdown_connections 2023-09-23T09:29:30.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.708+0000 7f4aeabff700 1 --2- 172.21.15.82:0/3894145310 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ae4111760 0x7f4ae4113b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:30.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.708+0000 7f4aeabff700 1 --2- 172.21.15.82:0/3894145310 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ae4074e50 0x7f4ae4075230 secure :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f4ad4009990 tx=0x7f4ad4009ca0 comp rx=0 tx=0).stop 2023-09-23T09:29:30.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.708+0000 7f4aeabff700 1 --2- 172.21.15.82:0/3894145310 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ae4075770 0x7f4ae4111220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:30.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.708+0000 7f4aeabff700 1 -- 172.21.15.82:0/3894145310 >> 172.21.15.82:0/3894145310 conn(0x7f4ae40fe570 msgr2=0x7f4ae4100990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:29:30.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.714+0000 7f4aeabff700 1 -- 172.21.15.82:0/3894145310 shutdown_connections 2023-09-23T09:29:30.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.715+0000 7f4aeabff700 1 -- 172.21.15.82:0/3894145310 wait complete. 2023-09-23T09:29:30.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.716+0000 7f4aeabff700 1 Processor -- start 2023-09-23T09:29:30.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.717+0000 7f4aeabff700 1 -- start start 2023-09-23T09:29:30.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.717+0000 7f4aeabff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ae4075770 0x7f4ae4110ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:30.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.717+0000 7f4aeabff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ae4111760 0x7f4ae4111120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:30.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.717+0000 7f4aeabff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ae4109c50 0x7f4ae410a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:30.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.717+0000 7f4aeabff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae410a890 con 0x7f4ae4075770 2023-09-23T09:29:30.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.717+0000 7f4aeabff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae410aa00 con 0x7f4ae4111760 2023-09-23T09:29:30.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.717+0000 7f4aeabff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae410e730 con 0x7f4ae4109c50 2023-09-23T09:29:30.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.717+0000 7f4ae899b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ae4075770 0x7f4ae4110ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:30.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.718+0000 7f4ae899b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ae4075770 0x7f4ae4110ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42402/0 (socket says 172.21.15.82:42402) 2023-09-23T09:29:30.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.718+0000 7f4ae899b700 1 -- 172.21.15.82:0/746444468 learned_addr learned my addr 172.21.15.82:0/746444468 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:29:30.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.718+0000 7f4ae919c700 1 --2- 172.21.15.82:0/746444468 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ae4109c50 0x7f4ae410a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:30.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.718+0000 7f4ae899b700 1 -- 172.21.15.82:0/746444468 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ae4109c50 msgr2=0x7f4ae410a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:29:30.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.718+0000 7f4ae899b700 1 --2- 172.21.15.82:0/746444468 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ae4109c50 0x7f4ae410a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:30.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.718+0000 7f4ae899b700 1 -- 172.21.15.82:0/746444468 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ae4111760 msgr2=0x7f4ae4111120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:29:30.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.718+0000 7f4ae3fff700 1 --2- 172.21.15.82:0/746444468 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ae4111760 0x7f4ae4111120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:30.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.718+0000 7f4ae899b700 1 --2- 172.21.15.82:0/746444468 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ae4111760 0x7f4ae4111120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:30.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.718+0000 7f4ae899b700 1 -- 172.21.15.82:0/746444468 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ad40095f0 con 0x7f4ae4075770 2023-09-23T09:29:30.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.718+0000 7f4ae3fff700 1 --2- 172.21.15.82:0/746444468 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ae4111760 0x7f4ae4111120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T09:29:30.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.719+0000 7f4ae899b700 1 --2- 172.21.15.82:0/746444468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ae4075770 0x7f4ae4110ba0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f4ad4000c00 tx=0x7f4ad40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:29:30.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.720+0000 7f4ae1ffb700 1 -- 172.21.15.82:0/746444468 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad401d070 con 0x7f4ae4075770 2023-09-23T09:29:30.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.720+0000 7f4ae1ffb700 1 -- 172.21.15.82:0/746444468 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4ad4004070 con 0x7f4ae4075770 2023-09-23T09:29:30.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.720+0000 7f4ae1ffb700 1 -- 172.21.15.82:0/746444468 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad400fc90 con 0x7f4ae4075770 2023-09-23T09:29:30.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.720+0000 7f4aeabff700 1 -- 172.21.15.82:0/746444468 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ae410e9b0 con 0x7f4ae4075770 2023-09-23T09:29:30.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.720+0000 7f4aeabff700 1 -- 172.21.15.82:0/746444468 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ae410ee10 con 0x7f4ae4075770 2023-09-23T09:29:30.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.727+0000 7f4afe448b80 1 Processor -- start 2023-09-23T09:29:30.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.727+0000 7f4ae1ffb700 1 -- 172.21.15.82:0/746444468 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f4ad400f460 con 0x7f4ae4075770 2023-09-23T09:29:30.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.728+0000 7f4afe448b80 1 -- start start 2023-09-23T09:29:30.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.728+0000 7f4afe448b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5601306da380 0x5601306da760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:30.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.728+0000 7f4afe448b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5601306daca0 0x5601306d4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:30.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.728+0000 7f4afe448b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5601306d4c40 0x5601306d50a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:30.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.728+0000 7f4afe448b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56013063c7b0 con 0x5601306daca0 2023-09-23T09:29:30.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.728+0000 7f4afe448b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56013062d780 con 0x5601306d4c40 2023-09-23T09:29:30.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.728+0000 7f4afe448b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x56013062b0a0 con 0x5601306da380 2023-09-23T09:29:30.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.729+0000 7f4ae899b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5601306daca0 0x5601306d4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:30.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.729+0000 7f4ae899b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5601306daca0 0x5601306d4700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42416/0 (socket says 172.21.15.82:42416) 2023-09-23T09:29:30.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.729+0000 7f4ae899b700 1 -- 172.21.15.82:0/1798845149 learned_addr learned my addr 172.21.15.82:0/1798845149 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:29:30.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.729+0000 7f4ae919c700 1 --2- 172.21.15.82:0/1798845149 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5601306da380 0x5601306da760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:30.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.731+0000 7f4ae1ffb700 1 --2- 172.21.15.82:0/746444468 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f4acc0a0290 0x7f4acc0a2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:30.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.733+0000 7f4ae3fff700 1 --2- 172.21.15.82:0/1798845149 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5601306d4c40 0x5601306d50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:30.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.734+0000 7f4ae919c700 1 --2- 172.21.15.82:0/746444468 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f4acc0a0290 0x7f4acc0a2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:30.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.734+0000 7f4ae919c700 1 -- 172.21.15.82:0/1798845149 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5601306d4c40 msgr2=0x5601306d50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:29:30.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.734+0000 7f4ae919c700 1 --2- 172.21.15.82:0/1798845149 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5601306d4c40 0x5601306d50a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:30.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.734+0000 7f4ae919c700 1 -- 172.21.15.82:0/1798845149 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5601306daca0 msgr2=0x5601306d4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:29:30.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.734+0000 7f4ae919c700 1 --2- 172.21.15.82:0/1798845149 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5601306daca0 0x5601306d4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:30.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.734+0000 7f4ae919c700 1 -- 172.21.15.82:0/1798845149 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5601304a6630 con 0x5601306da380 2023-09-23T09:29:30.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.735+0000 7f4ae1ffb700 1 -- 172.21.15.82:0/746444468 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f4ad40cc6e0 con 0x7f4ae4075770 2023-09-23T09:29:30.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.735+0000 7f4ae919c700 1 --2- 172.21.15.82:0/1798845149 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5601306da380 0x5601306da760 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4adc007920 tx=0x7f4adc007c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c27d8ed8787a247 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:29:30.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.736+0000 7f4acaffd700 1 -- 172.21.15.82:0/1798845149 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4adc009560 con 0x5601306da380 2023-09-23T09:29:30.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.736+0000 7f4acaffd700 1 -- 172.21.15.82:0/1798845149 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4adc00f030 con 0x5601306da380 2023-09-23T09:29:30.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.736+0000 7f4acaffd700 1 -- 172.21.15.82:0/1798845149 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4adc019400 con 0x5601306da380 2023-09-23T09:29:30.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.737+0000 7f4afe448b80 1 -- 172.21.15.82:0/1798845149 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5601306da380 msgr2=0x5601306da760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:29:30.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.737+0000 7f4ae919c700 1 --2- 172.21.15.82:0/746444468 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f4acc0a0290 0x7f4acc0a2750 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4adc007f80 tx=0x7f4adc01c000 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:29:30.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.737+0000 7f4afe448b80 1 --2- 172.21.15.82:0/1798845149 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5601306da380 0x5601306da760 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4adc007920 tx=0x7f4adc007c30 comp rx=0 tx=0).stop 2023-09-23T09:29:30.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.739+0000 7f4afe448b80 1 -- 172.21.15.82:0/1798845149 shutdown_connections 2023-09-23T09:29:30.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.739+0000 7f4afe448b80 1 --2- 172.21.15.82:0/1798845149 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5601306d4c40 0x5601306d50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:30.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.739+0000 7f4afe448b80 1 --2- 172.21.15.82:0/1798845149 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5601306da380 0x5601306da760 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:30.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.739+0000 7f4afe448b80 1 --2- 172.21.15.82:0/1798845149 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5601306daca0 0x5601306d4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:30.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.739+0000 7f4afe448b80 1 -- 172.21.15.82:0/1798845149 >> 172.21.15.82:0/1798845149 conn(0x5601306490e0 msgr2=0x5601306cf410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:29:30.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.739+0000 7f4afe448b80 1 -- 172.21.15.82:0/1798845149 shutdown_connections 2023-09-23T09:29:30.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.739+0000 7f4afe448b80 1 -- 172.21.15.82:0/1798845149 wait complete. 2023-09-23T09:29:30.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.740+0000 7f4afe448b80 1 -- start start 2023-09-23T09:29:30.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.740+0000 7f4afe448b80 1 Processor -- start 2023-09-23T09:29:30.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.741+0000 7f4afe448b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5601306d4c40 0x5601306e0c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:30.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.741+0000 7f4afe448b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5601306da380 0x5601306ddeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:30.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.742+0000 7f4afe448b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5601306daca0 0x5601306de550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:30.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.742+0000 7f4afe448b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560130626990 con 0x5601306daca0 2023-09-23T09:29:30.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.742+0000 7f4afe448b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601305c4bb0 con 0x5601306da380 2023-09-23T09:29:30.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.742+0000 7f4afe448b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601305c48b0 con 0x5601306d4c40 2023-09-23T09:29:30.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.742+0000 7f4afe448b80 10 client.0 _ll_register_callbacks cb 0x56013050ea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:29:30.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.742+0000 7f4ae899b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5601306d4c40 0x5601306e0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:30.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.742+0000 7f4ae899b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5601306d4c40 0x5601306e0c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:46178/0 (socket says 172.21.15.82:46178) 2023-09-23T09:29:30.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.742+0000 7f4ae899b700 1 -- 172.21.15.82:0/3888326339 learned_addr learned my addr 172.21.15.82:0/3888326339 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:29:30.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.742+0000 7f4ae3fff700 1 --2- 172.21.15.82:0/3888326339 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5601306da380 0x5601306ddeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:30.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.742+0000 7f4ae919c700 1 --2- 172.21.15.82:0/3888326339 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5601306daca0 0x5601306de550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:30.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.743+0000 7f4ae3fff700 1 -- 172.21.15.82:0/3888326339 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5601306d4c40 msgr2=0x5601306e0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:29:30.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.743+0000 7f4ae3fff700 1 --2- 172.21.15.82:0/3888326339 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5601306d4c40 0x5601306e0c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:30.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.743+0000 7f4ae3fff700 1 -- 172.21.15.82:0/3888326339 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5601306daca0 msgr2=0x5601306de550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:29:30.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.743+0000 7f4ae3fff700 1 --2- 172.21.15.82:0/3888326339 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5601306daca0 0x5601306de550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:30.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.743+0000 7f4ae3fff700 1 -- 172.21.15.82:0/3888326339 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4adc007500 con 0x5601306da380 2023-09-23T09:29:30.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.743+0000 7f4ae899b700 1 --2- 172.21.15.82:0/3888326339 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5601306d4c40 0x5601306e0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:29:30.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.744+0000 7f4ae3fff700 1 --2- 172.21.15.82:0/3888326339 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5601306da380 0x5601306ddeb0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f4ad800f470 tx=0x7f4ad800f780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11d63c6848d743a8 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:29:30.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.744+0000 7f4ac3fff700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-09-23T09:29:30.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.744+0000 7f4ac3fff700 1 -- 172.21.15.82:0/3888326339 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad8013850 con 0x5601306da380 2023-09-23T09:29:30.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.744+0000 7f4ac3fff700 1 -- 172.21.15.82:0/3888326339 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(141..141 src has 1..141) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f4ad80139b0 con 0x5601306da380 2023-09-23T09:29:30.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.744+0000 7f4afe448b80 1 -- 172.21.15.82:0/3888326339 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5601306a41c0 con 0x5601306da380 2023-09-23T09:29:30.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.745+0000 7f4ac3fff700 1 -- 172.21.15.82:0/3888326339 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4ad800feb0 con 0x5601306da380 2023-09-23T09:29:30.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.745+0000 7f4afe448b80 10 client.27095 fetch_fsmap learned FSMap version 92 2023-09-23T09:29:30.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.745+0000 7f4afe448b80 1 -- 172.21.15.82:0/3888326339 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=92,monmap=4+}) v3 -- 0x560130452de0 con 0x5601306da380 2023-09-23T09:29:30.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.746+0000 7f4ac3fff700 1 -- 172.21.15.82:0/3888326339 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5601306a41c0 con 0x5601306da380 2023-09-23T09:29:30.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.746+0000 7f4ac3fff700 1 -- 172.21.15.82:0/3888326339 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 92) v1 ==== 7934+0+0 (secure 0 0 0) 0x7f4ad8019020 con 0x5601306da380 2023-09-23T09:29:30.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.746+0000 7f4afe448b80 10 client.27095 fetch_fsmap finished waiting for FSMap version 92 2023-09-23T09:29:30.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.746+0000 7f4afe448b80 10 client.27095 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-09-23T09:29:30.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.746+0000 7f4afe448b80 20 client.27095 populate_metadata read hostname 'smithi082' 2023-09-23T09:29:30.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.746+0000 7f4afe448b80 1 --2- 172.21.15.82:0/3888326339 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x5601306ee750 0x5601306f0b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:30.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.746+0000 7f4afe448b80 4 client.27095 mds_command: new command op to 24526 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:29:30.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.746+0000 7f4afe448b80 1 -- 172.21.15.82:0/3888326339 --> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5601305ccba0 con 0x5601306ee750 2023-09-23T09:29:30.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.747+0000 7f4ae899b700 1 --2- 172.21.15.82:0/3888326339 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x5601306ee750 0x5601306f0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:30.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.748+0000 7f4ae899b700 1 --2- 172.21.15.82:0/3888326339 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x5601306ee750 0x5601306f0b70 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3218bc3e237ada9b server_cookie=80b9511f8a16e130 in_seq=0 out_seq=0 2023-09-23T09:29:30.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.748+0000 7f4ac3fff700 10 client.27095 ms_handle_connect on v2:172.21.15.161:6836/43639843 2023-09-23T09:29:30.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.749+0000 7f4ac3fff700 1 -- 172.21.15.82:0/3888326339 <== mds.2 v2:172.21.15.161:6836/43639843 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5601305ccba0 con 0x5601306ee750 2023-09-23T09:29:30.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.749+0000 7f4ac3fff700 10 client.27095 handle_command_reply: tid=0 2023-09-23T09:29:30.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.749+0000 7f4afe448b80 1 client.27095 shutdown 2023-09-23T09:29:30.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.750+0000 7f4afe448b80 1 -- 172.21.15.82:0/3888326339 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5601306da380 msgr2=0x5601306ddeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:29:30.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.750+0000 7f4afe448b80 1 --2- 172.21.15.82:0/3888326339 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5601306da380 0x5601306ddeb0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f4ad800f470 tx=0x7f4ad800f780 comp rx=0 tx=0).stop 2023-09-23T09:29:30.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.750+0000 7f4afe448b80 1 -- 172.21.15.82:0/3888326339 shutdown_connections 2023-09-23T09:29:30.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.750+0000 7f4afe448b80 1 --2- 172.21.15.82:0/3888326339 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x5601306ee750 0x5601306f0b70 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:30.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.750+0000 7f4afe448b80 1 --2- 172.21.15.82:0/3888326339 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5601306daca0 0x5601306de550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:30.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.750+0000 7f4afe448b80 1 --2- 172.21.15.82:0/3888326339 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5601306d4c40 0x5601306e0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:30.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.750+0000 7f4afe448b80 1 --2- 172.21.15.82:0/3888326339 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5601306da380 0x5601306ddeb0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:30.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.750+0000 7f4afe448b80 1 -- 172.21.15.82:0/3888326339 >> 172.21.15.82:0/3888326339 conn(0x5601306490e0 msgr2=0x5601306c9b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:29:30.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.751+0000 7f4ac3fff700 0 client.27095 ms_handle_reset on v2:172.21.15.161:6836/43639843 2023-09-23T09:29:30.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.751+0000 7f4afe448b80 1 -- 172.21.15.82:0/3888326339 shutdown_connections 2023-09-23T09:29:30.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.751+0000 7f4afe448b80 1 -- 172.21.15.82:0/3888326339 wait complete. 2023-09-23T09:29:30.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.752+0000 7f4afe448b80 20 client.27095 trim_cache size 0 max 16384 2023-09-23T09:29:30.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.777+0000 7f4afe448b80 1 Processor -- start 2023-09-23T09:29:30.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.778+0000 7f4afe448b80 1 -- start start 2023-09-23T09:29:30.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.778+0000 7f4afe448b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5601306d4c40 0x5601306d4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:30.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.778+0000 7f4afe448b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5601306da380 0x5601306f0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:30.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.778+0000 7f4afe448b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5601306daca0 0x5601306e9e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:30.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.778+0000 7f4afe448b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601304a8920 con 0x5601306daca0 2023-09-23T09:29:30.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.778+0000 7f4afe448b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601306cba20 con 0x5601306da380 2023-09-23T09:29:30.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.778+0000 7f4afe448b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601306cb810 con 0x5601306d4c40 2023-09-23T09:29:30.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.779+0000 7f4ae899b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5601306d4c40 0x5601306d4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:30.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.779+0000 7f4ae899b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5601306d4c40 0x5601306d4700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:46180/0 (socket says 172.21.15.82:46180) 2023-09-23T09:29:30.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.779+0000 7f4ae899b700 1 -- 172.21.15.82:0/2340421829 learned_addr learned my addr 172.21.15.82:0/2340421829 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:29:30.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.779+0000 7f4ae919c700 1 --2- 172.21.15.82:0/2340421829 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5601306daca0 0x5601306e9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:30.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.779+0000 7f4ae899b700 1 -- 172.21.15.82:0/2340421829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5601306da380 msgr2=0x5601306f0760 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-23T09:29:30.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.779+0000 7f4ae899b700 1 --2- 172.21.15.82:0/2340421829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5601306da380 0x5601306f0760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:30.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.779+0000 7f4ae899b700 1 -- 172.21.15.82:0/2340421829 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5601306daca0 msgr2=0x5601306e9e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:29:30.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.779+0000 7f4ae899b700 1 --2- 172.21.15.82:0/2340421829 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5601306daca0 0x5601306e9e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:30.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.779+0000 7f4ae899b700 1 -- 172.21.15.82:0/2340421829 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5601306f57a0 con 0x5601306d4c40 2023-09-23T09:29:30.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.784+0000 7f4ae899b700 1 --2- 172.21.15.82:0/2340421829 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5601306d4c40 0x5601306d4700 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4ad40095c0 tx=0x7f4ad40cea70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c386402037a2424c server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:29:30.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.785+0000 7f4acb7fe700 1 -- 172.21.15.82:0/2340421829 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad40b7730 con 0x5601306d4c40 2023-09-23T09:29:30.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.785+0000 7f4acb7fe700 1 -- 172.21.15.82:0/2340421829 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4ad40d2030 con 0x5601306d4c40 2023-09-23T09:29:30.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.785+0000 7f4acb7fe700 1 -- 172.21.15.82:0/2340421829 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad409dc50 con 0x5601306d4c40 2023-09-23T09:29:30.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.794+0000 7f4afe448b80 1 -- 172.21.15.82:0/2340421829 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5601306d4c40 msgr2=0x5601306d4700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:29:30.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.794+0000 7f4afe448b80 1 --2- 172.21.15.82:0/2340421829 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5601306d4c40 0x5601306d4700 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4ad40095c0 tx=0x7f4ad40cea70 comp rx=0 tx=0).stop 2023-09-23T09:29:30.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.801+0000 7f4afe448b80 1 -- 172.21.15.82:0/2340421829 shutdown_connections 2023-09-23T09:29:30.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.801+0000 7f4afe448b80 1 --2- 172.21.15.82:0/2340421829 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5601306daca0 0x5601306e9e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:30.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.801+0000 7f4afe448b80 1 --2- 172.21.15.82:0/2340421829 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5601306d4c40 0x5601306d4700 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:30.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.801+0000 7f4afe448b80 1 --2- 172.21.15.82:0/2340421829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5601306da380 0x5601306f0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:30.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.801+0000 7f4afe448b80 1 -- 172.21.15.82:0/2340421829 >> 172.21.15.82:0/2340421829 conn(0x5601306490e0 msgr2=0x5601306cf1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:29:30.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.804+0000 7f4afe448b80 1 -- 172.21.15.82:0/2340421829 shutdown_connections 2023-09-23T09:29:30.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.804+0000 7f4afe448b80 1 -- 172.21.15.82:0/2340421829 wait complete. 2023-09-23T09:29:30.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.805+0000 7f4afe448b80 1 -- start start 2023-09-23T09:29:30.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.805+0000 7f4afe448b80 1 Processor -- start 2023-09-23T09:29:30.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.806+0000 7f4afe448b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5601306d4c40 0x5601306e5930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:30.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.806+0000 7f4afe448b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5601306da380 0x5601306d5e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:30.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.806+0000 7f4afe448b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5601306daca0 0x5601306d6410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:30.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.806+0000 7f4afe448b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601306d6af0 con 0x5601306da380 2023-09-23T09:29:30.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.806+0000 7f4afe448b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601306d6c60 con 0x5601306d4c40 2023-09-23T09:29:30.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.806+0000 7f4afe448b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601306d6e20 con 0x5601306daca0 2023-09-23T09:29:30.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.806+0000 7f4afe448b80 10 client.0 _ll_register_callbacks cb 0x7f4ad800ab20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:29:30.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.807+0000 7f4ae3fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5601306da380 0x5601306d5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:30.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.807+0000 7f4ae3fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5601306da380 0x5601306d5e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42438/0 (socket says 172.21.15.82:42438) 2023-09-23T09:29:30.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.807+0000 7f4ae3fff700 1 -- 172.21.15.82:0/2593773484 learned_addr learned my addr 172.21.15.82:0/2593773484 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:29:30.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:29:30 smithi135 ceph-mon[99205]: pgmap v1033: 97 pgs: 97 active+clean; 16 GiB data, 54 GiB used, 1019 GiB / 1.0 TiB avail; 1.5 MiB/s rd, 19 MiB/s wr, 1.45k op/s 2023-09-23T09:29:30.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.808+0000 7f4ae3fff700 1 -- 172.21.15.82:0/2593773484 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5601306daca0 msgr2=0x5601306d6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:29:30.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.808+0000 7f4ae3fff700 1 --2- 172.21.15.82:0/2593773484 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5601306daca0 0x5601306d6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:30.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.808+0000 7f4ae3fff700 1 -- 172.21.15.82:0/2593773484 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5601306d4c40 msgr2=0x5601306e5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:29:30.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.808+0000 7f4ae3fff700 1 --2- 172.21.15.82:0/2593773484 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5601306d4c40 0x5601306e5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:30.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.808+0000 7f4ae3fff700 1 -- 172.21.15.82:0/2593773484 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ae410ee10 con 0x5601306da380 2023-09-23T09:29:30.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.808+0000 7f4ae3fff700 1 --2- 172.21.15.82:0/2593773484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5601306da380 0x5601306d5e00 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f4ad8025de0 tx=0x7f4ad800a4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c92e6dbfe998585a server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:29:30.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.809+0000 7f4ac3fff700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:29:30.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.810+0000 7f4ac3fff700 1 -- 172.21.15.82:0/2593773484 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad8004440 con 0x5601306da380 2023-09-23T09:29:30.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.810+0000 7f4ac3fff700 1 -- 172.21.15.82:0/2593773484 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(141..141 src has 1..141) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f4ad80045a0 con 0x5601306da380 2023-09-23T09:29:30.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.810+0000 7f4afe448b80 1 -- 172.21.15.82:0/2593773484 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5601306c78b0 con 0x5601306da380 2023-09-23T09:29:30.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.811+0000 7f4ac3fff700 1 -- 172.21.15.82:0/2593773484 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4ad800feb0 con 0x5601306da380 2023-09-23T09:29:30.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.811+0000 7f4afe448b80 10 client.17397 fetch_fsmap learned FSMap version 92 2023-09-23T09:29:30.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.811+0000 7f4afe448b80 1 -- 172.21.15.82:0/2593773484 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=92,monmap=4+}) v3 -- 0x56013043bc60 con 0x5601306da380 2023-09-23T09:29:30.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.812+0000 7f4ac3fff700 1 -- 172.21.15.82:0/2593773484 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5601306c78b0 con 0x5601306da380 2023-09-23T09:29:30.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.812+0000 7f4ac3fff700 1 -- 172.21.15.82:0/2593773484 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 92) v1 ==== 7934+0+0 (secure 0 0 0) 0x7f4ad8019040 con 0x5601306da380 2023-09-23T09:29:30.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.812+0000 7f4afe448b80 10 client.17397 fetch_fsmap finished waiting for FSMap version 92 2023-09-23T09:29:30.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.812+0000 7f4afe448b80 10 client.17397 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-09-23T09:29:30.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.812+0000 7f4afe448b80 20 client.17397 populate_metadata read hostname 'smithi082' 2023-09-23T09:29:30.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.812+0000 7f4afe448b80 1 --2- 172.21.15.82:0/2593773484 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x560130742c70 0x560130745090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:30.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.813+0000 7f4afe448b80 4 client.17397 mds_command: new command op to 24526 tid=0[{"prefix": "damage ls"}] 2023-09-23T09:29:30.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.813+0000 7f4afe448b80 1 -- 172.21.15.82:0/2593773484 --> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56013061f970 con 0x560130742c70 2023-09-23T09:29:30.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.813+0000 7f4ae899b700 1 --2- 172.21.15.82:0/2593773484 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x560130742c70 0x560130745090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:30.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.814+0000 7f4ae899b700 1 --2- 172.21.15.82:0/2593773484 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x560130742c70 0x560130745090 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3e157d6ff167555b server_cookie=6f62ab5ab0369228 in_seq=0 out_seq=0 2023-09-23T09:29:30.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.814+0000 7f4ac3fff700 10 client.17397 ms_handle_connect on v2:172.21.15.161:6836/43639843 2023-09-23T09:29:30.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.815+0000 7f4ac3fff700 1 -- 172.21.15.82:0/2593773484 <== mds.2 v2:172.21.15.161:6836/43639843 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56013061f970 con 0x560130742c70 2023-09-23T09:29:30.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.815+0000 7f4ac3fff700 10 client.17397 handle_command_reply: tid=0 2023-09-23T09:29:30.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.815+0000 7f4afe448b80 1 client.17397 shutdown 2023-09-23T09:29:30.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.815+0000 7f4afe448b80 1 -- 172.21.15.82:0/2593773484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5601306da380 msgr2=0x5601306d5e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:29:30.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.815+0000 7f4afe448b80 1 --2- 172.21.15.82:0/2593773484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5601306da380 0x5601306d5e00 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f4ad8025de0 tx=0x7f4ad800a4d0 comp rx=0 tx=0).stop 2023-09-23T09:29:30.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.816+0000 7f4afe448b80 1 -- 172.21.15.82:0/2593773484 shutdown_connections 2023-09-23T09:29:30.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.816+0000 7f4afe448b80 1 --2- 172.21.15.82:0/2593773484 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x560130742c70 0x560130745090 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:30.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.816+0000 7f4afe448b80 1 --2- 172.21.15.82:0/2593773484 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5601306daca0 0x5601306d6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:30.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.816+0000 7f4afe448b80 1 --2- 172.21.15.82:0/2593773484 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5601306d4c40 0x5601306e5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:30.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.816+0000 7f4afe448b80 1 --2- 172.21.15.82:0/2593773484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5601306da380 0x5601306d5e00 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:30.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.816+0000 7f4afe448b80 1 -- 172.21.15.82:0/2593773484 >> 172.21.15.82:0/2593773484 conn(0x5601306490e0 msgr2=0x5601306ea970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:29:30.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.816+0000 7f4ac3fff700 0 client.17397 ms_handle_reset on v2:172.21.15.161:6836/43639843 2023-09-23T09:29:30.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.816+0000 7f4afe448b80 1 -- 172.21.15.82:0/2593773484 shutdown_connections 2023-09-23T09:29:30.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.816+0000 7f4afe448b80 1 -- 172.21.15.82:0/2593773484 wait complete. 2023-09-23T09:29:30.834 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 140.0 s, 444.8 tps, lat 223.381 ms stddev 102.190 2023-09-23T09:29:30.834 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2023-09-23T09:29:30.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.818+0000 7f4afe448b80 20 client.17397 trim_cache size 0 max 16384 2023-09-23T09:29:30.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.832+0000 7f4aeabff700 1 -- 172.21.15.82:0/746444468 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f4acc0a0290 msgr2=0x7f4acc0a2750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:29:30.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.832+0000 7f4aeabff700 1 --2- 172.21.15.82:0/746444468 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f4acc0a0290 0x7f4acc0a2750 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4adc007f80 tx=0x7f4adc01c000 comp rx=0 tx=0).stop 2023-09-23T09:29:30.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.832+0000 7f4aeabff700 1 -- 172.21.15.82:0/746444468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ae4075770 msgr2=0x7f4ae4110ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:29:30.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.832+0000 7f4aeabff700 1 --2- 172.21.15.82:0/746444468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ae4075770 0x7f4ae4110ba0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f4ad4000c00 tx=0x7f4ad40057f0 comp rx=0 tx=0).stop 2023-09-23T09:29:30.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.842+0000 7f4aeabff700 1 -- 172.21.15.82:0/746444468 shutdown_connections 2023-09-23T09:29:30.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.842+0000 7f4aeabff700 1 --2- 172.21.15.82:0/746444468 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f4acc0a0290 0x7f4acc0a2750 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:30.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.842+0000 7f4aeabff700 1 --2- 172.21.15.82:0/746444468 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ae4109c50 0x7f4ae410a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:30.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.842+0000 7f4aeabff700 1 --2- 172.21.15.82:0/746444468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ae4075770 0x7f4ae4110ba0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:30.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.842+0000 7f4aeabff700 1 --2- 172.21.15.82:0/746444468 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ae4111760 0x7f4ae4111120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:30.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.842+0000 7f4aeabff700 1 -- 172.21.15.82:0/746444468 >> 172.21.15.82:0/746444468 conn(0x7f4ae40fe570 msgr2=0x7f4ae41123d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:29:30.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.853+0000 7f4aeabff700 1 -- 172.21.15.82:0/746444468 shutdown_connections 2023-09-23T09:29:30.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:30.858+0000 7f4aeabff700 1 -- 172.21.15.82:0/746444468 wait complete. 2023-09-23T09:29:30.890 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-09-23T09:29:30.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:29:30 smithi161 ceph-mon[99580]: pgmap v1033: 97 pgs: 97 active+clean; 16 GiB data, 54 GiB used, 1019 GiB / 1.0 TiB avail; 1.5 MiB/s rd, 19 MiB/s wr, 1.45k op/s 2023-09-23T09:29:31.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.263+0000 7fb7013ff700 1 -- 172.21.15.82:0/2971883719 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb6fc107b90 msgr2=0x7fb6fc107f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:29:31.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.263+0000 7fb7013ff700 1 --2- 172.21.15.82:0/2971883719 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb6fc107b90 0x7fb6fc107f70 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb6e4008570 tx=0x7fb6e400af90 comp rx=0 tx=0).stop 2023-09-23T09:29:31.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.264+0000 7fb7013ff700 1 -- 172.21.15.82:0/2971883719 shutdown_connections 2023-09-23T09:29:31.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.264+0000 7fb7013ff700 1 --2- 172.21.15.82:0/2971883719 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb6fc10c6a0 0x7fb6fc114260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:31.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.264+0000 7fb7013ff700 1 --2- 172.21.15.82:0/2971883719 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb6fc107b90 0x7fb6fc107f70 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:31.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.264+0000 7fb7013ff700 1 --2- 172.21.15.82:0/2971883719 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6fc108540 0x7fb6fc10bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:31.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.264+0000 7fb7013ff700 1 -- 172.21.15.82:0/2971883719 >> 172.21.15.82:0/2971883719 conn(0x7fb6fc06ce40 msgr2=0x7fb6fc06d250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:29:31.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.266+0000 7fb7013ff700 1 -- 172.21.15.82:0/2971883719 shutdown_connections 2023-09-23T09:29:31.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.266+0000 7fb7013ff700 1 -- 172.21.15.82:0/2971883719 wait complete. 2023-09-23T09:29:31.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.268+0000 7fb7013ff700 1 Processor -- start 2023-09-23T09:29:31.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.270+0000 7fb7013ff700 1 -- start start 2023-09-23T09:29:31.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.270+0000 7fb7013ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb6fc107b90 0x7fb6fc116fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:31.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.270+0000 7fb7013ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb6fc10c6a0 0x7fb6fc117510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:31.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.270+0000 7fb7013ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6fc11b970 0x7fb6fc11bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:31.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.270+0000 7fb7013ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6fc11c3c0 con 0x7fb6fc11b970 2023-09-23T09:29:31.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.270+0000 7fb7013ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6fc11c530 con 0x7fb6fc10c6a0 2023-09-23T09:29:31.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.270+0000 7fb7013ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6fc11c6f0 con 0x7fb6fc107b90 2023-09-23T09:29:31.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.271+0000 7fb6fa7fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb6fc10c6a0 0x7fb6fc117510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:31.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.271+0000 7fb6fa7fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb6fc10c6a0 0x7fb6fc117510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:45024/0 (socket says 172.21.15.82:45024) 2023-09-23T09:29:31.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.271+0000 7fb6fa7fc700 1 -- 172.21.15.82:0/3767443575 learned_addr learned my addr 172.21.15.82:0/3767443575 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:29:31.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.271+0000 7fb6fb7fe700 1 --2- 172.21.15.82:0/3767443575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6fc11b970 0x7fb6fc11bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:31.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.271+0000 7fb6fa7fc700 1 -- 172.21.15.82:0/3767443575 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb6fc107b90 msgr2=0x7fb6fc116fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:29:31.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.271+0000 7fb6fa7fc700 1 --2- 172.21.15.82:0/3767443575 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb6fc107b90 0x7fb6fc116fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:31.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.271+0000 7fb6fa7fc700 1 -- 172.21.15.82:0/3767443575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6fc11b970 msgr2=0x7fb6fc11bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:29:31.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.271+0000 7fb6fa7fc700 1 --2- 172.21.15.82:0/3767443575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6fc11b970 0x7fb6fc11bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:31.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.271+0000 7fb6fa7fc700 1 -- 172.21.15.82:0/3767443575 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6e40081d0 con 0x7fb6fc10c6a0 2023-09-23T09:29:31.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.272+0000 7fb6fa7fc700 1 --2- 172.21.15.82:0/3767443575 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb6fc10c6a0 0x7fb6fc117510 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec00b9c0 tx=0x7fb6ec00bd80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:29:31.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.272+0000 7fb6f3fff700 1 -- 172.21.15.82:0/3767443575 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6ec00ca30 con 0x7fb6fc10c6a0 2023-09-23T09:29:31.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.272+0000 7fb6f3fff700 1 -- 172.21.15.82:0/3767443575 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb6ec00cb90 con 0x7fb6fc10c6a0 2023-09-23T09:29:31.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.272+0000 7fb6f3fff700 1 -- 172.21.15.82:0/3767443575 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6ec0125a0 con 0x7fb6fc10c6a0 2023-09-23T09:29:31.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.273+0000 7fb7013ff700 1 -- 172.21.15.82:0/3767443575 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6fc1bad10 con 0x7fb6fc10c6a0 2023-09-23T09:29:31.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.273+0000 7fb7013ff700 1 -- 172.21.15.82:0/3767443575 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6fc1bb1d0 con 0x7fb6fc10c6a0 2023-09-23T09:29:31.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.279+0000 7fb6f3fff700 1 -- 172.21.15.82:0/3767443575 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7fb6ec00cd00 con 0x7fb6fc10c6a0 2023-09-23T09:29:31.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.280+0000 7fb714d57b80 1 Processor -- start 2023-09-23T09:29:31.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.280+0000 7fb714d57b80 1 -- start start 2023-09-23T09:29:31.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.280+0000 7fb714d57b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fcddf27380 0x55fcddf27760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:31.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.281+0000 7fb714d57b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fcddf27ca0 0x55fcddf21700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:31.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.281+0000 7fb714d57b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fcddf21c40 0x55fcddf220a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:31.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.281+0000 7fb714d57b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcdde897b0 con 0x55fcddf27380 2023-09-23T09:29:31.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.281+0000 7fb714d57b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcdde7a780 con 0x55fcddf27ca0 2023-09-23T09:29:31.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.281+0000 7fb714d57b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcdde780a0 con 0x55fcddf21c40 2023-09-23T09:29:31.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.281+0000 7fb6fa7fc700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fcddf21c40 0x55fcddf220a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:31.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.281+0000 7fb6fa7fc700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fcddf21c40 0x55fcddf220a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:46214/0 (socket says 172.21.15.82:46214) 2023-09-23T09:29:31.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.281+0000 7fb6fa7fc700 1 -- 172.21.15.82:0/587492311 learned_addr learned my addr 172.21.15.82:0/587492311 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:29:31.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.281+0000 7fb6faffd700 1 --2- 172.21.15.82:0/587492311 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fcddf27ca0 0x55fcddf21700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:31.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.281+0000 7fb6fb7fe700 1 --2- 172.21.15.82:0/587492311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fcddf27380 0x55fcddf27760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:31.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.282+0000 7fb6fa7fc700 1 -- 172.21.15.82:0/587492311 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fcddf27ca0 msgr2=0x55fcddf21700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:29:31.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.282+0000 7fb6fa7fc700 1 --2- 172.21.15.82:0/587492311 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fcddf27ca0 0x55fcddf21700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:31.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.282+0000 7fb6fa7fc700 1 -- 172.21.15.82:0/587492311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fcddf27380 msgr2=0x55fcddf27760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:29:31.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.282+0000 7fb6fa7fc700 1 --2- 172.21.15.82:0/587492311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fcddf27380 0x55fcddf27760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:31.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.282+0000 7fb6fa7fc700 1 -- 172.21.15.82:0/587492311 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fcddcf3630 con 0x55fcddf21c40 2023-09-23T09:29:31.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.282+0000 7fb6fa7fc700 1 --2- 172.21.15.82:0/587492311 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fcddf21c40 0x55fcddf220a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec0c87c0 tx=0x7fb6ec0cede0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=342cf1e494c6925e server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:29:31.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.282+0000 7fb6f17fa700 1 -- 172.21.15.82:0/587492311 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6ec0d3a30 con 0x55fcddf21c40 2023-09-23T09:29:31.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.282+0000 7fb6f17fa700 1 -- 172.21.15.82:0/587492311 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb6ec0d3b90 con 0x55fcddf21c40 2023-09-23T09:29:31.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.282+0000 7fb6f17fa700 1 -- 172.21.15.82:0/587492311 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6ec0d83a0 con 0x55fcddf21c40 2023-09-23T09:29:31.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.283+0000 7fb714d57b80 1 -- 172.21.15.82:0/587492311 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fcddf21c40 msgr2=0x55fcddf220a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:29:31.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.283+0000 7fb714d57b80 1 --2- 172.21.15.82:0/587492311 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fcddf21c40 0x55fcddf220a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec0c87c0 tx=0x7fb6ec0cede0 comp rx=0 tx=0).stop 2023-09-23T09:29:31.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.284+0000 7fb6f3fff700 1 --2- 172.21.15.82:0/3767443575 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fb6e80a00f0 0x7fb6e80a25b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:31.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.284+0000 7fb6f3fff700 1 -- 172.21.15.82:0/3767443575 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fb6ec006e40 con 0x7fb6fc10c6a0 2023-09-23T09:29:31.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.284+0000 7fb714d57b80 1 -- 172.21.15.82:0/587492311 shutdown_connections 2023-09-23T09:29:31.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.284+0000 7fb714d57b80 1 --2- 172.21.15.82:0/587492311 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fcddf21c40 0x55fcddf220a0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:31.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.284+0000 7fb714d57b80 1 --2- 172.21.15.82:0/587492311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fcddf27380 0x55fcddf27760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:31.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.284+0000 7fb714d57b80 1 --2- 172.21.15.82:0/587492311 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fcddf27ca0 0x55fcddf21700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:31.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.284+0000 7fb714d57b80 1 -- 172.21.15.82:0/587492311 >> 172.21.15.82:0/587492311 conn(0x55fcdde960e0 msgr2=0x55fcddf1c410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:29:31.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.285+0000 7fb6fb7fe700 1 --2- 172.21.15.82:0/3767443575 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fb6e80a00f0 0x7fb6e80a25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:31.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.285+0000 7fb714d57b80 1 -- 172.21.15.82:0/587492311 shutdown_connections 2023-09-23T09:29:31.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.285+0000 7fb714d57b80 1 -- 172.21.15.82:0/587492311 wait complete. 2023-09-23T09:29:31.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.285+0000 7fb714d57b80 1 -- start start 2023-09-23T09:29:31.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.286+0000 7fb6fb7fe700 1 --2- 172.21.15.82:0/3767443575 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fb6e80a00f0 0x7fb6e80a25b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb6f400eaa0 tx=0x7fb6f400e480 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:29:31.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.286+0000 7fb714d57b80 1 Processor -- start 2023-09-23T09:29:31.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.287+0000 7fb714d57b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fcddf21c40 0x55fcddf2dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:31.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.287+0000 7fb714d57b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fcddf27380 0x55fcddf2af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:31.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.287+0000 7fb714d57b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fcddf27ca0 0x55fcddf2b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:31.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.287+0000 7fb714d57b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcdde73990 con 0x55fcddf27380 2023-09-23T09:29:31.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.287+0000 7fb714d57b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcdde11bb0 con 0x55fcddf27ca0 2023-09-23T09:29:31.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.287+0000 7fb714d57b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcdde118b0 con 0x55fcddf21c40 2023-09-23T09:29:31.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.287+0000 7fb714d57b80 10 client.0 _ll_register_callbacks cb 0x55fcddd5ba80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:29:31.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.287+0000 7fb6fb7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fcddf27ca0 0x55fcddf2b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:31.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.287+0000 7fb6fb7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fcddf27ca0 0x55fcddf2b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:45050/0 (socket says 172.21.15.82:45050) 2023-09-23T09:29:31.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.287+0000 7fb6fb7fe700 1 -- 172.21.15.82:0/825077055 learned_addr learned my addr 172.21.15.82:0/825077055 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:29:31.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.288+0000 7fb6fb7fe700 1 -- 172.21.15.82:0/825077055 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fcddf21c40 msgr2=0x55fcddf2dc80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-23T09:29:31.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.288+0000 7fb6fb7fe700 1 --2- 172.21.15.82:0/825077055 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fcddf21c40 0x55fcddf2dc80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:31.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.288+0000 7fb6fb7fe700 1 -- 172.21.15.82:0/825077055 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fcddf27380 msgr2=0x55fcddf2af00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-23T09:29:31.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.288+0000 7fb6fb7fe700 1 --2- 172.21.15.82:0/825077055 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fcddf27380 0x55fcddf2af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:31.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.288+0000 7fb6fb7fe700 1 -- 172.21.15.82:0/825077055 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6fc1bb1d0 con 0x55fcddf27ca0 2023-09-23T09:29:31.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.289+0000 7fb6fb7fe700 1 --2- 172.21.15.82:0/825077055 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fcddf27ca0 0x55fcddf2b5f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb6f4005e80 tx=0x7fb6f4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2864e64bcf03e10e server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:29:31.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.289+0000 7fb6e27fc700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-09-23T09:29:31.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.289+0000 7fb6e27fc700 1 -- 172.21.15.82:0/825077055 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f401c960 con 0x55fcddf27ca0 2023-09-23T09:29:31.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.289+0000 7fb6e27fc700 1 -- 172.21.15.82:0/825077055 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(141..141 src has 1..141) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fb6f4022070 con 0x55fcddf27ca0 2023-09-23T09:29:31.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.289+0000 7fb714d57b80 1 -- 172.21.15.82:0/825077055 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fcddef11c0 con 0x55fcddf27ca0 2023-09-23T09:29:31.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.290+0000 7fb6e27fc700 1 -- 172.21.15.82:0/825077055 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb6f401cac0 con 0x55fcddf27ca0 2023-09-23T09:29:31.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.290+0000 7fb714d57b80 10 client.27107 fetch_fsmap learned FSMap version 92 2023-09-23T09:29:31.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.291+0000 7fb714d57b80 1 -- 172.21.15.82:0/825077055 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=92,monmap=4+}) v3 -- 0x55fcddc9fde0 con 0x55fcddf27ca0 2023-09-23T09:29:31.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.291+0000 7fb6e27fc700 1 -- 172.21.15.82:0/825077055 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55fcddef11c0 con 0x55fcddf27ca0 2023-09-23T09:29:31.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.291+0000 7fb6e27fc700 1 -- 172.21.15.82:0/825077055 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 92) v1 ==== 7934+0+0 (secure 0 0 0) 0x7fb6f4026420 con 0x55fcddf27ca0 2023-09-23T09:29:31.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.292+0000 7fb714d57b80 10 client.27107 fetch_fsmap finished waiting for FSMap version 92 2023-09-23T09:29:31.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.292+0000 7fb714d57b80 10 client.27107 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-23T09:29:31.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.292+0000 7fb714d57b80 20 client.27107 populate_metadata read hostname 'smithi082' 2023-09-23T09:29:31.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.292+0000 7fb714d57b80 1 --2- 172.21.15.82:0/825077055 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x55fcddf3b810 0x55fcddf3dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:31.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.292+0000 7fb714d57b80 4 client.27107 mds_command: new command op to 24550 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:29:31.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.292+0000 7fb714d57b80 1 -- 172.21.15.82:0/825077055 --> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fcdde19ba0 con 0x55fcddf3b810 2023-09-23T09:29:31.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.292+0000 7fb6faffd700 1 --2- 172.21.15.82:0/825077055 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x55fcddf3b810 0x55fcddf3dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:31.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.293+0000 7fb6e27fc700 10 client.27107 ms_handle_connect on v2:172.21.15.161:6838/758982817 2023-09-23T09:29:31.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.293+0000 7fb6faffd700 1 --2- 172.21.15.82:0/825077055 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x55fcddf3b810 0x55fcddf3dc50 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1697073650595214 server_cookie=63eb990a716c4b46 in_seq=0 out_seq=0 2023-09-23T09:29:31.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.294+0000 7fb6e27fc700 1 -- 172.21.15.82:0/825077055 <== mds.1 v2:172.21.15.161:6838/758982817 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55fcdde19ba0 con 0x55fcddf3b810 2023-09-23T09:29:31.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.294+0000 7fb6e27fc700 10 client.27107 handle_command_reply: tid=0 2023-09-23T09:29:31.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.294+0000 7fb714d57b80 1 client.27107 shutdown 2023-09-23T09:29:31.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.295+0000 7fb714d57b80 1 -- 172.21.15.82:0/825077055 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fcddf27ca0 msgr2=0x55fcddf2b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:29:31.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.295+0000 7fb714d57b80 1 --2- 172.21.15.82:0/825077055 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fcddf27ca0 0x55fcddf2b5f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb6f4005e80 tx=0x7fb6f4004750 comp rx=0 tx=0).stop 2023-09-23T09:29:31.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.295+0000 7fb714d57b80 1 -- 172.21.15.82:0/825077055 shutdown_connections 2023-09-23T09:29:31.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.295+0000 7fb714d57b80 1 --2- 172.21.15.82:0/825077055 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x55fcddf3b810 0x55fcddf3dc50 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:31.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.295+0000 7fb714d57b80 1 --2- 172.21.15.82:0/825077055 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fcddf27ca0 0x55fcddf2b5f0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:31.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.295+0000 7fb714d57b80 1 --2- 172.21.15.82:0/825077055 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fcddf21c40 0x55fcddf2dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:31.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.295+0000 7fb714d57b80 1 --2- 172.21.15.82:0/825077055 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fcddf27380 0x55fcddf2af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:31.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.295+0000 7fb714d57b80 1 -- 172.21.15.82:0/825077055 >> 172.21.15.82:0/825077055 conn(0x55fcdde960e0 msgr2=0x55fcddf16b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:29:31.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.295+0000 7fb6e27fc700 0 client.27107 ms_handle_reset on v2:172.21.15.161:6838/758982817 2023-09-23T09:29:31.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.295+0000 7fb714d57b80 1 -- 172.21.15.82:0/825077055 shutdown_connections 2023-09-23T09:29:31.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.296+0000 7fb714d57b80 1 -- 172.21.15.82:0/825077055 wait complete. 2023-09-23T09:29:31.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.296+0000 7fb714d57b80 20 client.27107 trim_cache size 0 max 16384 2023-09-23T09:29:31.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.318+0000 7fb714d57b80 1 Processor -- start 2023-09-23T09:29:31.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.318+0000 7fb714d57b80 1 -- start start 2023-09-23T09:29:31.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.318+0000 7fb714d57b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fcddf21c40 0x55fcddf21700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:31.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.319+0000 7fb714d57b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fcddf27380 0x55fcddf36ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:31.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.319+0000 7fb714d57b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fcddf27ca0 0x55fcddf25050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:31.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.319+0000 7fb714d57b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcddcf5920 con 0x55fcddf27ca0 2023-09-23T09:29:31.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.319+0000 7fb714d57b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcddf18c80 con 0x55fcddf27380 2023-09-23T09:29:31.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.319+0000 7fb714d57b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcddf1dd40 con 0x55fcddf21c40 2023-09-23T09:29:31.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.319+0000 7fb6faffd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fcddf21c40 0x55fcddf21700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:31.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.319+0000 7fb6faffd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fcddf21c40 0x55fcddf21700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:46232/0 (socket says 172.21.15.82:46232) 2023-09-23T09:29:31.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.319+0000 7fb6faffd700 1 -- 172.21.15.82:0/431595986 learned_addr learned my addr 172.21.15.82:0/431595986 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:29:31.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.319+0000 7fb6fa7fc700 1 --2- 172.21.15.82:0/431595986 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fcddf27380 0x55fcddf36ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:31.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.319+0000 7fb6fb7fe700 1 --2- 172.21.15.82:0/431595986 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fcddf27ca0 0x55fcddf25050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:31.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.320+0000 7fb6fa7fc700 1 -- 172.21.15.82:0/431595986 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fcddf21c40 msgr2=0x55fcddf21700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:29:31.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.320+0000 7fb6fa7fc700 1 --2- 172.21.15.82:0/431595986 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fcddf21c40 0x55fcddf21700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:31.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.320+0000 7fb6fa7fc700 1 -- 172.21.15.82:0/431595986 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fcddf27ca0 msgr2=0x55fcddf25050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:29:31.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.320+0000 7fb6fa7fc700 1 --2- 172.21.15.82:0/431595986 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fcddf27ca0 0x55fcddf25050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:31.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.320+0000 7fb6fa7fc700 1 -- 172.21.15.82:0/431595986 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fcddf222f0 con 0x55fcddf27380 2023-09-23T09:29:31.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.320+0000 7fb6fa7fc700 1 --2- 172.21.15.82:0/431595986 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fcddf27380 0x55fcddf36ef0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec0987a0 tx=0x7fb6ec004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77d0223323ac0088 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:29:31.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.321+0000 7fb6f1ffb700 1 -- 172.21.15.82:0/431595986 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6ec0ce450 con 0x55fcddf27380 2023-09-23T09:29:31.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.321+0000 7fb6f1ffb700 1 -- 172.21.15.82:0/431595986 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb6ec0c8e90 con 0x55fcddf27380 2023-09-23T09:29:31.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.321+0000 7fb6f1ffb700 1 -- 172.21.15.82:0/431595986 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6ec098f10 con 0x55fcddf27380 2023-09-23T09:29:31.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.322+0000 7fb714d57b80 1 -- 172.21.15.82:0/431595986 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fcddf27380 msgr2=0x55fcddf36ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:29:31.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.322+0000 7fb714d57b80 1 --2- 172.21.15.82:0/431595986 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fcddf27380 0x55fcddf36ef0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec0987a0 tx=0x7fb6ec004ad0 comp rx=0 tx=0).stop 2023-09-23T09:29:31.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.322+0000 7fb714d57b80 1 -- 172.21.15.82:0/431595986 shutdown_connections 2023-09-23T09:29:31.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.322+0000 7fb714d57b80 1 --2- 172.21.15.82:0/431595986 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fcddf27ca0 0x55fcddf25050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:31.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.322+0000 7fb714d57b80 1 --2- 172.21.15.82:0/431595986 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fcddf21c40 0x55fcddf21700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:31.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.322+0000 7fb714d57b80 1 --2- 172.21.15.82:0/431595986 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fcddf27380 0x55fcddf36ef0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:31.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.322+0000 7fb714d57b80 1 -- 172.21.15.82:0/431595986 >> 172.21.15.82:0/431595986 conn(0x55fcdde960e0 msgr2=0x55fcddf1c110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:29:31.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.322+0000 7fb714d57b80 1 -- 172.21.15.82:0/431595986 shutdown_connections 2023-09-23T09:29:31.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.323+0000 7fb714d57b80 1 -- 172.21.15.82:0/431595986 wait complete. 2023-09-23T09:29:31.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.323+0000 7fb714d57b80 1 -- start start 2023-09-23T09:29:31.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.323+0000 7fb714d57b80 1 Processor -- start 2023-09-23T09:29:31.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.324+0000 7fb714d57b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fcddf21c40 0x55fcddf22e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:31.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.324+0000 7fb714d57b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fcddf27380 0x55fcddf23340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:31.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.324+0000 7fb714d57b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fcddf27ca0 0x55fcddf23880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:31.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.324+0000 7fb714d57b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcddf23dc0 con 0x55fcddf27ca0 2023-09-23T09:29:31.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.324+0000 7fb714d57b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcddf23f30 con 0x55fcddf27380 2023-09-23T09:29:31.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.324+0000 7fb714d57b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcddf240f0 con 0x55fcddf21c40 2023-09-23T09:29:31.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.324+0000 7fb714d57b80 10 client.0 _ll_register_callbacks cb 0x7fb6f4011670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:29:31.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.325+0000 7fb6faffd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fcddf21c40 0x55fcddf22e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:31.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.325+0000 7fb6faffd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fcddf21c40 0x55fcddf22e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:46240/0 (socket says 172.21.15.82:46240) 2023-09-23T09:29:31.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.325+0000 7fb6faffd700 1 -- 172.21.15.82:0/3277019505 learned_addr learned my addr 172.21.15.82:0/3277019505 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:29:31.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.325+0000 7fb6fa7fc700 1 --2- 172.21.15.82:0/3277019505 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fcddf27380 0x55fcddf23340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:31.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.325+0000 7fb6fb7fe700 1 --2- 172.21.15.82:0/3277019505 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fcddf27ca0 0x55fcddf23880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:31.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.325+0000 7fb6faffd700 1 -- 172.21.15.82:0/3277019505 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fcddf27380 msgr2=0x55fcddf23340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:29:31.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.325+0000 7fb6faffd700 1 --2- 172.21.15.82:0/3277019505 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fcddf27380 0x55fcddf23340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:31.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.325+0000 7fb6faffd700 1 -- 172.21.15.82:0/3277019505 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fcddf27ca0 msgr2=0x55fcddf23880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:29:31.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.325+0000 7fb6faffd700 1 --2- 172.21.15.82:0/3277019505 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fcddf27ca0 0x55fcddf23880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:31.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.325+0000 7fb6faffd700 1 -- 172.21.15.82:0/3277019505 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fcddcf3630 con 0x55fcddf21c40 2023-09-23T09:29:31.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.326+0000 7fb6faffd700 1 --2- 172.21.15.82:0/3277019505 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fcddf21c40 0x55fcddf22e00 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb6e400c010 tx=0x7fb6e4005760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c458be482b0932b4 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:29:31.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.326+0000 7fb6e27fc700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T09:29:31.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.326+0000 7fb6e27fc700 1 -- 172.21.15.82:0/3277019505 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e401e040 con 0x55fcddf21c40 2023-09-23T09:29:31.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.326+0000 7fb6e27fc700 1 -- 172.21.15.82:0/3277019505 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(141..141 src has 1..141) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fb6e400dae0 con 0x55fcddf21c40 2023-09-23T09:29:31.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.326+0000 7fb714d57b80 1 -- 172.21.15.82:0/3277019505 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fcddf148b0 con 0x55fcddf21c40 2023-09-23T09:29:31.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.327+0000 7fb6e27fc700 1 -- 172.21.15.82:0/3277019505 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb6e400dca0 con 0x55fcddf21c40 2023-09-23T09:29:31.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.327+0000 7fb714d57b80 10 client.27148 fetch_fsmap learned FSMap version 92 2023-09-23T09:29:31.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.327+0000 7fb714d57b80 1 -- 172.21.15.82:0/3277019505 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=92,monmap=4+}) v3 -- 0x55fcddc88c60 con 0x55fcddf21c40 2023-09-23T09:29:31.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.328+0000 7fb6e27fc700 1 -- 172.21.15.82:0/3277019505 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb6e403a080 con 0x55fcddf21c40 2023-09-23T09:29:31.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.328+0000 7fb6e27fc700 1 -- 172.21.15.82:0/3277019505 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 92) v1 ==== 7934+0+0 (secure 0 0 0) 0x7fb6e4034030 con 0x55fcddf21c40 2023-09-23T09:29:31.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.328+0000 7fb714d57b80 10 client.27148 fetch_fsmap finished waiting for FSMap version 92 2023-09-23T09:29:31.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.328+0000 7fb714d57b80 10 client.27148 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-23T09:29:31.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.328+0000 7fb714d57b80 20 client.27148 populate_metadata read hostname 'smithi082' 2023-09-23T09:29:31.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.328+0000 7fb714d57b80 1 --2- 172.21.15.82:0/3277019505 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x55fcddf90250 0x55fcddf92670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:31.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.328+0000 7fb714d57b80 4 client.27148 mds_command: new command op to 24550 tid=0[{"prefix": "damage ls"}] 2023-09-23T09:29:31.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.328+0000 7fb714d57b80 1 -- 172.21.15.82:0/3277019505 --> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55fcdde6c970 con 0x55fcddf90250 2023-09-23T09:29:31.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.329+0000 7fb6fa7fc700 1 --2- 172.21.15.82:0/3277019505 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x55fcddf90250 0x55fcddf92670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:31.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.330+0000 7fb6fa7fc700 1 --2- 172.21.15.82:0/3277019505 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x55fcddf90250 0x55fcddf92670 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3eb828bdde15c48e server_cookie=1cc4fc591e131d89 in_seq=0 out_seq=0 2023-09-23T09:29:31.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.330+0000 7fb6e27fc700 10 client.27148 ms_handle_connect on v2:172.21.15.161:6838/758982817 2023-09-23T09:29:31.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.330+0000 7fb6e27fc700 1 -- 172.21.15.82:0/3277019505 <== mds.1 v2:172.21.15.161:6838/758982817 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55fcdde6c970 con 0x55fcddf90250 2023-09-23T09:29:31.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.330+0000 7fb6e27fc700 10 client.27148 handle_command_reply: tid=0 2023-09-23T09:29:31.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.330+0000 7fb714d57b80 1 client.27148 shutdown 2023-09-23T09:29:31.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.330+0000 7fb714d57b80 1 -- 172.21.15.82:0/3277019505 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fcddf21c40 msgr2=0x55fcddf22e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:29:31.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.330+0000 7fb714d57b80 1 --2- 172.21.15.82:0/3277019505 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fcddf21c40 0x55fcddf22e00 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb6e400c010 tx=0x7fb6e4005760 comp rx=0 tx=0).stop 2023-09-23T09:29:31.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.330+0000 7fb714d57b80 1 -- 172.21.15.82:0/3277019505 shutdown_connections 2023-09-23T09:29:31.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.330+0000 7fb714d57b80 1 --2- 172.21.15.82:0/3277019505 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x55fcddf90250 0x55fcddf92670 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:31.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.330+0000 7fb714d57b80 1 --2- 172.21.15.82:0/3277019505 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fcddf27ca0 0x55fcddf23880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:31.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.330+0000 7fb714d57b80 1 --2- 172.21.15.82:0/3277019505 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fcddf21c40 0x55fcddf22e00 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:31.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.330+0000 7fb6e27fc700 0 client.27148 ms_handle_reset on v2:172.21.15.161:6838/758982817 2023-09-23T09:29:31.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.330+0000 7fb714d57b80 1 --2- 172.21.15.82:0/3277019505 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fcddf27380 0x55fcddf23340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:31.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.330+0000 7fb714d57b80 1 -- 172.21.15.82:0/3277019505 >> 172.21.15.82:0/3277019505 conn(0x55fcdde960e0 msgr2=0x55fcddf36ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:29:31.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.331+0000 7fb714d57b80 1 -- 172.21.15.82:0/3277019505 shutdown_connections 2023-09-23T09:29:31.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.331+0000 7fb714d57b80 1 -- 172.21.15.82:0/3277019505 wait complete. 2023-09-23T09:29:31.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.331+0000 7fb714d57b80 20 client.27148 trim_cache size 0 max 16384 2023-09-23T09:29:31.335 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2023-09-23T09:29:31.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.332+0000 7fb7013ff700 1 -- 172.21.15.82:0/3767443575 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fb6e80a00f0 msgr2=0x7fb6e80a25b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:29:31.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.332+0000 7fb7013ff700 1 --2- 172.21.15.82:0/3767443575 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fb6e80a00f0 0x7fb6e80a25b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb6f400eaa0 tx=0x7fb6f400e480 comp rx=0 tx=0).stop 2023-09-23T09:29:31.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.332+0000 7fb7013ff700 1 -- 172.21.15.82:0/3767443575 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb6fc10c6a0 msgr2=0x7fb6fc117510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:29:31.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.332+0000 7fb7013ff700 1 --2- 172.21.15.82:0/3767443575 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb6fc10c6a0 0x7fb6fc117510 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec00b9c0 tx=0x7fb6ec00bd80 comp rx=0 tx=0).stop 2023-09-23T09:29:31.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.332+0000 7fb7013ff700 1 -- 172.21.15.82:0/3767443575 shutdown_connections 2023-09-23T09:29:31.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.332+0000 7fb7013ff700 1 --2- 172.21.15.82:0/3767443575 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fb6e80a00f0 0x7fb6e80a25b0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:31.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.332+0000 7fb7013ff700 1 --2- 172.21.15.82:0/3767443575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6fc11b970 0x7fb6fc11bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:31.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.332+0000 7fb7013ff700 1 --2- 172.21.15.82:0/3767443575 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb6fc107b90 0x7fb6fc116fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:31.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.332+0000 7fb7013ff700 1 --2- 172.21.15.82:0/3767443575 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb6fc10c6a0 0x7fb6fc117510 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:31.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.332+0000 7fb7013ff700 1 -- 172.21.15.82:0/3767443575 >> 172.21.15.82:0/3767443575 conn(0x7fb6fc06ce40 msgr2=0x7fb6fc071ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:29:31.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.335+0000 7fb7013ff700 1 -- 172.21.15.82:0/3767443575 shutdown_connections 2023-09-23T09:29:31.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.335+0000 7fb7013ff700 1 -- 172.21.15.82:0/3767443575 wait complete. 2023-09-23T09:29:31.373 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-09-23T09:29:31.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.788+0000 7f8511dff700 1 -- 172.21.15.82:0/2515677514 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f850c100120 msgr2=0x7f850c10c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:29:31.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.788+0000 7f8511dff700 1 --2- 172.21.15.82:0/2515677514 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f850c100120 0x7f850c10c630 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f850401c0d0 tx=0x7f850401c3e0 comp rx=0 tx=0).stop 2023-09-23T09:29:31.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.788+0000 7f8511dff700 1 -- 172.21.15.82:0/2515677514 shutdown_connections 2023-09-23T09:29:31.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.788+0000 7f8511dff700 1 --2- 172.21.15.82:0/2515677514 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f850c100120 0x7f850c10c630 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:31.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.788+0000 7f8511dff700 1 --2- 172.21.15.82:0/2515677514 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f850c105770 0x7f850c105b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:31.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.788+0000 7f8511dff700 1 --2- 172.21.15.82:0/2515677514 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f850c0ff760 0x7f850c0ffbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:31.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.788+0000 7f8511dff700 1 -- 172.21.15.82:0/2515677514 >> 172.21.15.82:0/2515677514 conn(0x7f850c0fb270 msgr2=0x7f850c0fd690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:29:31.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.789+0000 7f8511dff700 1 -- 172.21.15.82:0/2515677514 shutdown_connections 2023-09-23T09:29:31.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.789+0000 7f8511dff700 1 -- 172.21.15.82:0/2515677514 wait complete. 2023-09-23T09:29:31.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.790+0000 7f8511dff700 1 Processor -- start 2023-09-23T09:29:31.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.791+0000 7f8511dff700 1 -- start start 2023-09-23T09:29:31.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.791+0000 7f8511dff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f850c0ff760 0x7f850c06ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:31.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.791+0000 7f8511dff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f850c100120 0x7f850c06cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:31.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.791+0000 7f8511dff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f850c105770 0x7f850c1b9e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:31.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.792+0000 7f8511dff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f850c06d810 con 0x7f850c0ff760 2023-09-23T09:29:31.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.792+0000 7f8511dff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f850c1ba3b0 con 0x7f850c105770 2023-09-23T09:29:31.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.792+0000 7f8511dff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f850c1ba4f0 con 0x7f850c100120 2023-09-23T09:29:31.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.793+0000 7f850b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f850c0ff760 0x7f850c06ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:31.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.793+0000 7f850b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f850c0ff760 0x7f850c06ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47278/0 (socket says 172.21.15.82:47278) 2023-09-23T09:29:31.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.793+0000 7f850b7fe700 1 -- 172.21.15.82:0/4136688530 learned_addr learned my addr 172.21.15.82:0/4136688530 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:29:31.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.793+0000 7f850bfff700 1 --2- 172.21.15.82:0/4136688530 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f850c105770 0x7f850c1b9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:31.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.794+0000 7f850bfff700 1 -- 172.21.15.82:0/4136688530 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f850c100120 msgr2=0x7f850c06cf40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-09-23T09:29:31.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.794+0000 7f850bfff700 1 --2- 172.21.15.82:0/4136688530 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f850c100120 0x7f850c06cf40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:31.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.794+0000 7f850bfff700 1 -- 172.21.15.82:0/4136688530 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f850c0ff760 msgr2=0x7f850c06ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:29:31.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.794+0000 7f850bfff700 1 --2- 172.21.15.82:0/4136688530 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f850c0ff760 0x7f850c06ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:31.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.794+0000 7f850bfff700 1 -- 172.21.15.82:0/4136688530 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8500009520 con 0x7f850c105770 2023-09-23T09:29:31.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.794+0000 7f850bfff700 1 --2- 172.21.15.82:0/4136688530 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f850c105770 0x7f850c1b9e70 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f850401c0d0 tx=0x7f850401dd20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:29:31.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.795+0000 7f8508ff9700 1 -- 172.21.15.82:0/4136688530 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f850401f050 con 0x7f850c105770 2023-09-23T09:29:31.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.795+0000 7f8508ff9700 1 -- 172.21.15.82:0/4136688530 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f850401a4c0 con 0x7f850c105770 2023-09-23T09:29:31.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.795+0000 7f8508ff9700 1 -- 172.21.15.82:0/4136688530 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8504007700 con 0x7f850c105770 2023-09-23T09:29:31.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.795+0000 7f8511dff700 1 -- 172.21.15.82:0/4136688530 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f850401ad10 con 0x7f850c105770 2023-09-23T09:29:31.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.795+0000 7f8511dff700 1 -- 172.21.15.82:0/4136688530 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f850c1baa10 con 0x7f850c105770 2023-09-23T09:29:31.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.804+0000 7f8508ff9700 1 -- 172.21.15.82:0/4136688530 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f85040182f0 con 0x7f850c105770 2023-09-23T09:29:31.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.805+0000 7f85256b3b80 1 Processor -- start 2023-09-23T09:29:31.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.806+0000 7f8508ff9700 1 --2- 172.21.15.82:0/4136688530 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f84f40a4550 0x7f84f40a6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:31.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.806+0000 7f8508ff9700 1 -- 172.21.15.82:0/4136688530 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f85040cc480 con 0x7f850c105770 2023-09-23T09:29:31.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.808+0000 7f85256b3b80 1 -- start start 2023-09-23T09:29:31.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.808+0000 7f85256b3b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d4bdb92380 0x55d4bdb92760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:31.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.808+0000 7f85256b3b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d4bdb92ca0 0x55d4bdb8c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:31.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.808+0000 7f85256b3b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d4bdb8cc40 0x55d4bdb8d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:31.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.808+0000 7f85256b3b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4bdaf47b0 con 0x55d4bdb92380 2023-09-23T09:29:31.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.808+0000 7f85256b3b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4bdae5780 con 0x55d4bdb8cc40 2023-09-23T09:29:31.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.808+0000 7f85256b3b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4bdae30a0 con 0x55d4bdb92ca0 2023-09-23T09:29:31.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:29:31 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:29:31.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.809+0000 7f850affd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d4bdb92ca0 0x55d4bdb8c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:31.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.809+0000 7f850affd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d4bdb92ca0 0x55d4bdb8c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:48956/0 (socket says 172.21.15.82:48956) 2023-09-23T09:29:31.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.809+0000 7f850affd700 1 -- 172.21.15.82:0/3573410286 learned_addr learned my addr 172.21.15.82:0/3573410286 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:29:31.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.809+0000 7f850b7fe700 1 --2- 172.21.15.82:0/3573410286 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d4bdb92380 0x55d4bdb92760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:31.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.809+0000 7f850bfff700 1 --2- 172.21.15.82:0/3573410286 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d4bdb8cc40 0x55d4bdb8d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:31.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.809+0000 7f850affd700 1 -- 172.21.15.82:0/3573410286 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d4bdb8cc40 msgr2=0x55d4bdb8d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:29:31.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.809+0000 7f850affd700 1 --2- 172.21.15.82:0/3573410286 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d4bdb8cc40 0x55d4bdb8d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:31.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.809+0000 7f850affd700 1 -- 172.21.15.82:0/3573410286 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d4bdb92380 msgr2=0x55d4bdb92760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:29:31.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.809+0000 7f850affd700 1 --2- 172.21.15.82:0/3573410286 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d4bdb92380 0x55d4bdb92760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:31.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.810+0000 7f850affd700 1 -- 172.21.15.82:0/3573410286 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d4bd95e630 con 0x55d4bdb92ca0 2023-09-23T09:29:31.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.810+0000 7f850affd700 1 --2- 172.21.15.82:0/3573410286 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d4bdb92ca0 0x55d4bdb8c700 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f84fc00bd20 tx=0x7f84fc00d330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d458cdc0d2f8a718 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:29:31.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.810+0000 7f84f1ffb700 1 -- 172.21.15.82:0/3573410286 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84fc010070 con 0x55d4bdb92ca0 2023-09-23T09:29:31.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.811+0000 7f84f1ffb700 1 -- 172.21.15.82:0/3573410286 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f84fc00be70 con 0x55d4bdb92ca0 2023-09-23T09:29:31.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.811+0000 7f84f1ffb700 1 -- 172.21.15.82:0/3573410286 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84fc006420 con 0x55d4bdb92ca0 2023-09-23T09:29:31.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.811+0000 7f850affd700 1 --2- 172.21.15.82:0/4136688530 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f84f40a4550 0x7f84f40a6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:31.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.812+0000 7f85256b3b80 1 -- 172.21.15.82:0/3573410286 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d4bdb92ca0 msgr2=0x55d4bdb8c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:29:31.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.812+0000 7f85256b3b80 1 --2- 172.21.15.82:0/3573410286 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d4bdb92ca0 0x55d4bdb8c700 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f84fc00bd20 tx=0x7f84fc00d330 comp rx=0 tx=0).stop 2023-09-23T09:29:31.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.812+0000 7f850affd700 1 --2- 172.21.15.82:0/4136688530 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f84f40a4550 0x7f84f40a6a10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f84fc0068a0 tx=0x7f84fc006730 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:29:31.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.816+0000 7f85256b3b80 1 -- 172.21.15.82:0/3573410286 shutdown_connections 2023-09-23T09:29:31.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.816+0000 7f85256b3b80 1 --2- 172.21.15.82:0/3573410286 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d4bdb8cc40 0x55d4bdb8d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:31.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.816+0000 7f85256b3b80 1 --2- 172.21.15.82:0/3573410286 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d4bdb92380 0x55d4bdb92760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:31.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.816+0000 7f85256b3b80 1 --2- 172.21.15.82:0/3573410286 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d4bdb92ca0 0x55d4bdb8c700 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:31.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.816+0000 7f85256b3b80 1 -- 172.21.15.82:0/3573410286 >> 172.21.15.82:0/3573410286 conn(0x55d4bdb010e0 msgr2=0x55d4bdb87410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:29:31.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.818+0000 7f85256b3b80 1 -- 172.21.15.82:0/3573410286 shutdown_connections 2023-09-23T09:29:31.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.819+0000 7f85256b3b80 1 -- 172.21.15.82:0/3573410286 wait complete. 2023-09-23T09:29:31.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.819+0000 7f85256b3b80 1 -- start start 2023-09-23T09:29:31.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.820+0000 7f85256b3b80 1 Processor -- start 2023-09-23T09:29:31.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.820+0000 7f85256b3b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d4bdb8cc40 0x55d4bdb98c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:31.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.820+0000 7f85256b3b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d4bdb92380 0x55d4bdb95ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:31.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.820+0000 7f85256b3b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d4bdb92ca0 0x55d4bdb96620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:31.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.820+0000 7f85256b3b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4bdade990 con 0x55d4bdb92380 2023-09-23T09:29:31.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.820+0000 7f85256b3b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4bda7cbb0 con 0x55d4bdb92ca0 2023-09-23T09:29:31.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.820+0000 7f85256b3b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4bda7c8b0 con 0x55d4bdb8cc40 2023-09-23T09:29:31.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.820+0000 7f85256b3b80 10 client.0 _ll_register_callbacks cb 0x55d4bd9c6a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:29:31.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.821+0000 7f850b7fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d4bdb8cc40 0x55d4bdb98c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:31.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.821+0000 7f850b7fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d4bdb8cc40 0x55d4bdb98c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:48964/0 (socket says 172.21.15.82:48964) 2023-09-23T09:29:31.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.821+0000 7f850b7fe700 1 -- 172.21.15.82:0/2040778660 learned_addr learned my addr 172.21.15.82:0/2040778660 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:29:31.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.821+0000 7f850bfff700 1 --2- 172.21.15.82:0/2040778660 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d4bdb92ca0 0x55d4bdb96620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:31.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.822+0000 7f850b7fe700 1 -- 172.21.15.82:0/2040778660 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d4bdb92ca0 msgr2=0x55d4bdb96620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:29:31.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.822+0000 7f850b7fe700 1 --2- 172.21.15.82:0/2040778660 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d4bdb92ca0 0x55d4bdb96620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:31.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.822+0000 7f850b7fe700 1 -- 172.21.15.82:0/2040778660 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d4bdb92380 msgr2=0x55d4bdb95ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:29:31.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.822+0000 7f850b7fe700 1 --2- 172.21.15.82:0/2040778660 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d4bdb92380 0x55d4bdb95ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:31.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.822+0000 7f850b7fe700 1 -- 172.21.15.82:0/2040778660 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84fc00b9d0 con 0x55d4bdb8cc40 2023-09-23T09:29:31.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.822+0000 7f850b7fe700 1 --2- 172.21.15.82:0/2040778660 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d4bdb8cc40 0x55d4bdb98c60 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f8500012d20 tx=0x7f8500012d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17cb71d97c118f6e server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:29:31.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.822+0000 7f84ef7f6700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T09:29:31.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.822+0000 7f84ef7f6700 1 -- 172.21.15.82:0/2040778660 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8500017070 con 0x55d4bdb8cc40 2023-09-23T09:29:31.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.822+0000 7f84ef7f6700 1 -- 172.21.15.82:0/2040778660 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(141..141 src has 1..141) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f8500004020 con 0x55d4bdb8cc40 2023-09-23T09:29:31.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.823+0000 7f85256b3b80 1 -- 172.21.15.82:0/2040778660 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d4bdb5c1c0 con 0x55d4bdb8cc40 2023-09-23T09:29:31.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.828+0000 7f84ef7f6700 1 -- 172.21.15.82:0/2040778660 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7f85000122e0 con 0x55d4bdb8cc40 2023-09-23T09:29:31.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.830+0000 7f85256b3b80 10 client.27154 fetch_fsmap learned FSMap version 92 2023-09-23T09:29:31.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.830+0000 7f85256b3b80 1 -- 172.21.15.82:0/2040778660 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=92,monmap=4+}) v3 -- 0x55d4bd90ade0 con 0x55d4bdb8cc40 2023-09-23T09:29:31.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.834+0000 7f84ef7f6700 1 -- 172.21.15.82:0/2040778660 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d4bdb5c1c0 con 0x55d4bdb8cc40 2023-09-23T09:29:31.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.834+0000 7f84ef7f6700 1 -- 172.21.15.82:0/2040778660 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 92) v1 ==== 7934+0+0 (secure 0 0 0) 0x7f8500003790 con 0x55d4bdb8cc40 2023-09-23T09:29:31.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.834+0000 7f85256b3b80 10 client.27154 fetch_fsmap finished waiting for FSMap version 92 2023-09-23T09:29:31.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.834+0000 7f85256b3b80 10 client.27154 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:29:31.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.834+0000 7f85256b3b80 20 client.27154 populate_metadata read hostname 'smithi082' 2023-09-23T09:29:31.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.834+0000 7f85256b3b80 1 --2- 172.21.15.82:0/2040778660 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55d4bdbaf0a0 0x55d4bdbb14c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:31.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.834+0000 7f85256b3b80 4 client.27154 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:29:31.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.834+0000 7f85256b3b80 1 -- 172.21.15.82:0/2040778660 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d4bda84ba0 con 0x55d4bdbaf0a0 2023-09-23T09:29:31.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.835+0000 7f850affd700 1 --2- 172.21.15.82:0/2040778660 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55d4bdbaf0a0 0x55d4bdbb14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:31.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.837+0000 7f850affd700 1 --2- 172.21.15.82:0/2040778660 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55d4bdbaf0a0 0x55d4bdbb14c0 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2284c4e06b202f74 server_cookie=9bd659dbbbf43ab in_seq=0 out_seq=0 2023-09-23T09:29:31.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.837+0000 7f84ef7f6700 10 client.27154 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:29:31.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.838+0000 7f84ef7f6700 1 -- 172.21.15.82:0/2040778660 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55d4bda84ba0 con 0x55d4bdbaf0a0 2023-09-23T09:29:31.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.838+0000 7f84ef7f6700 10 client.27154 handle_command_reply: tid=0 2023-09-23T09:29:31.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.839+0000 7f85256b3b80 1 client.27154 shutdown 2023-09-23T09:29:31.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.840+0000 7f85256b3b80 1 -- 172.21.15.82:0/2040778660 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d4bdb8cc40 msgr2=0x55d4bdb98c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:29:31.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.840+0000 7f85256b3b80 1 --2- 172.21.15.82:0/2040778660 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d4bdb8cc40 0x55d4bdb98c60 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f8500012d20 tx=0x7f8500012d50 comp rx=0 tx=0).stop 2023-09-23T09:29:31.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.843+0000 7f85256b3b80 1 -- 172.21.15.82:0/2040778660 shutdown_connections 2023-09-23T09:29:31.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.843+0000 7f85256b3b80 1 --2- 172.21.15.82:0/2040778660 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d4bdb92ca0 0x55d4bdb96620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:31.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.843+0000 7f85256b3b80 1 --2- 172.21.15.82:0/2040778660 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d4bdb8cc40 0x55d4bdb98c60 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:31.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.843+0000 7f85256b3b80 1 --2- 172.21.15.82:0/2040778660 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55d4bdbaf0a0 0x55d4bdbb14c0 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:31.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.843+0000 7f85256b3b80 1 --2- 172.21.15.82:0/2040778660 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d4bdb92380 0x55d4bdb95ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:31.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.843+0000 7f85256b3b80 1 -- 172.21.15.82:0/2040778660 >> 172.21.15.82:0/2040778660 conn(0x55d4bdb010e0 msgr2=0x55d4bdb81b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:29:31.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.843+0000 7f84ef7f6700 0 client.27154 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:29:31.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.843+0000 7f85256b3b80 1 -- 172.21.15.82:0/2040778660 shutdown_connections 2023-09-23T09:29:31.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.843+0000 7f85256b3b80 1 -- 172.21.15.82:0/2040778660 wait complete. 2023-09-23T09:29:31.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.847+0000 7f85256b3b80 20 client.27154 trim_cache size 0 max 16384 2023-09-23T09:29:31.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:29:31 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:29:31.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.873+0000 7f85256b3b80 1 Processor -- start 2023-09-23T09:29:31.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.873+0000 7f85256b3b80 1 -- start start 2023-09-23T09:29:31.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.873+0000 7f85256b3b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d4bdb8cc40 0x55d4bdb91680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:31.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.873+0000 7f85256b3b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d4bdb92380 0x55d4bdb98790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:31.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.873+0000 7f85256b3b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d4bdb92ca0 0x55d4bdb8ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:31.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.873+0000 7f85256b3b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4bd960920 con 0x55d4bdb8cc40 2023-09-23T09:29:31.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.873+0000 7f85256b3b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4bdb89220 con 0x55d4bdb92ca0 2023-09-23T09:29:31.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.873+0000 7f85256b3b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4bdb90b90 con 0x55d4bdb92380 2023-09-23T09:29:31.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.875+0000 7f850b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d4bdb8cc40 0x55d4bdb91680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:31.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.875+0000 7f850b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d4bdb8cc40 0x55d4bdb91680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47302/0 (socket says 172.21.15.82:47302) 2023-09-23T09:29:31.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.875+0000 7f850b7fe700 1 -- 172.21.15.82:0/3497844806 learned_addr learned my addr 172.21.15.82:0/3497844806 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:29:31.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.876+0000 7f850b7fe700 1 -- 172.21.15.82:0/3497844806 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d4bdb92380 msgr2=0x55d4bdb98790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:29:31.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.876+0000 7f850b7fe700 1 --2- 172.21.15.82:0/3497844806 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d4bdb92380 0x55d4bdb98790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:31.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.876+0000 7f850b7fe700 1 -- 172.21.15.82:0/3497844806 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d4bdb92ca0 msgr2=0x55d4bdb8ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:29:31.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.876+0000 7f850b7fe700 1 --2- 172.21.15.82:0/3497844806 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d4bdb92ca0 0x55d4bdb8ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:31.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.876+0000 7f850b7fe700 1 -- 172.21.15.82:0/3497844806 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d4bd8f3c60 con 0x55d4bdb8cc40 2023-09-23T09:29:31.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.877+0000 7f850b7fe700 1 --2- 172.21.15.82:0/3497844806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d4bdb8cc40 0x55d4bdb91680 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f8500000c00 tx=0x7f85000093b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e365d6b8d85a5dd server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:29:31.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.881+0000 7f84f27fc700 1 -- 172.21.15.82:0/3497844806 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8500017070 con 0x55d4bdb8cc40 2023-09-23T09:29:31.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.881+0000 7f84f27fc700 1 -- 172.21.15.82:0/3497844806 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8500018040 con 0x55d4bdb8cc40 2023-09-23T09:29:31.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.881+0000 7f84f27fc700 1 -- 172.21.15.82:0/3497844806 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f850001c540 con 0x55d4bdb8cc40 2023-09-23T09:29:31.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.882+0000 7f85256b3b80 1 -- 172.21.15.82:0/3497844806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d4bdb8cc40 msgr2=0x55d4bdb91680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:29:31.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.882+0000 7f85256b3b80 1 --2- 172.21.15.82:0/3497844806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d4bdb8cc40 0x55d4bdb91680 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f8500000c00 tx=0x7f85000093b0 comp rx=0 tx=0).stop 2023-09-23T09:29:31.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.882+0000 7f85256b3b80 1 -- 172.21.15.82:0/3497844806 shutdown_connections 2023-09-23T09:29:31.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.882+0000 7f85256b3b80 1 --2- 172.21.15.82:0/3497844806 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d4bdb92ca0 0x55d4bdb8ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:31.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.882+0000 7f85256b3b80 1 --2- 172.21.15.82:0/3497844806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d4bdb8cc40 0x55d4bdb91680 secure :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f8500000c00 tx=0x7f85000093b0 comp rx=0 tx=0).stop 2023-09-23T09:29:31.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.882+0000 7f85256b3b80 1 --2- 172.21.15.82:0/3497844806 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d4bdb92380 0x55d4bdb98790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:31.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.882+0000 7f85256b3b80 1 -- 172.21.15.82:0/3497844806 >> 172.21.15.82:0/3497844806 conn(0x55d4bdb010e0 msgr2=0x55d4bdb90f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:29:31.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.885+0000 7f85256b3b80 1 -- 172.21.15.82:0/3497844806 shutdown_connections 2023-09-23T09:29:31.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.886+0000 7f85256b3b80 1 -- 172.21.15.82:0/3497844806 wait complete. 2023-09-23T09:29:31.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.886+0000 7f85256b3b80 1 -- start start 2023-09-23T09:29:31.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.887+0000 7f85256b3b80 1 Processor -- start 2023-09-23T09:29:31.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.887+0000 7f85256b3b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d4bdb92380 0x55d4bdba62b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:31.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.887+0000 7f85256b3b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d4bdb92ca0 0x55d4bdb948b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:31.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.887+0000 7f85256b3b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d4bdb94df0 0x55d4bdb95230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:31.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.887+0000 7f85256b3b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4bdc02f20 con 0x55d4bdb92380 2023-09-23T09:29:31.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.887+0000 7f85256b3b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4bdc03090 con 0x55d4bdb94df0 2023-09-23T09:29:31.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.888+0000 7f85256b3b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4bdb99900 con 0x55d4bdb92ca0 2023-09-23T09:29:31.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.888+0000 7f85256b3b80 10 client.0 _ll_register_callbacks cb 0x7f85000127f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:29:31.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.888+0000 7f850b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d4bdb92380 0x55d4bdba62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:31.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.888+0000 7f850b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d4bdb92380 0x55d4bdba62b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47316/0 (socket says 172.21.15.82:47316) 2023-09-23T09:29:31.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.888+0000 7f850b7fe700 1 -- 172.21.15.82:0/2870361519 learned_addr learned my addr 172.21.15.82:0/2870361519 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:29:31.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.889+0000 7f850b7fe700 1 -- 172.21.15.82:0/2870361519 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d4bdb92ca0 msgr2=0x55d4bdb948b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:29:31.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.889+0000 7f850b7fe700 1 --2- 172.21.15.82:0/2870361519 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d4bdb92ca0 0x55d4bdb948b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:31.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.889+0000 7f850b7fe700 1 -- 172.21.15.82:0/2870361519 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d4bdb94df0 msgr2=0x55d4bdb95230 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-23T09:29:31.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.889+0000 7f850b7fe700 1 --2- 172.21.15.82:0/2870361519 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d4bdb94df0 0x55d4bdb95230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:31.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.889+0000 7f850b7fe700 1 -- 172.21.15.82:0/2870361519 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d4bd90ade0 con 0x55d4bdb92380 2023-09-23T09:29:31.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.890+0000 7f850b7fe700 1 --2- 172.21.15.82:0/2870361519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d4bdb92380 0x55d4bdba62b0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f8500003af0 tx=0x7f8500009930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cca98893e9f35e7 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:29:31.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.890+0000 7f84ef7f6700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:29:31.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.890+0000 7f84ef7f6700 1 -- 172.21.15.82:0/2870361519 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8500033070 con 0x55d4bdb92380 2023-09-23T09:29:31.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.890+0000 7f84ef7f6700 1 -- 172.21.15.82:0/2870361519 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(141..141 src has 1..141) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f850002b070 con 0x55d4bdb92380 2023-09-23T09:29:31.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.890+0000 7f85256b3b80 1 -- 172.21.15.82:0/2870361519 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d4bdb7f8b0 con 0x55d4bdb92380 2023-09-23T09:29:31.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.892+0000 7f84ef7f6700 1 -- 172.21.15.82:0/2870361519 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8500017040 con 0x55d4bdb92380 2023-09-23T09:29:31.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.892+0000 7f85256b3b80 10 client.17424 fetch_fsmap learned FSMap version 92 2023-09-23T09:29:31.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.892+0000 7f85256b3b80 1 -- 172.21.15.82:0/2870361519 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=92,monmap=4+}) v3 -- 0x55d4bd931250 con 0x55d4bdb92380 2023-09-23T09:29:31.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.893+0000 7f84ef7f6700 1 -- 172.21.15.82:0/2870361519 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d4bdb7f8b0 con 0x55d4bdb92380 2023-09-23T09:29:31.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.893+0000 7f84ef7f6700 1 -- 172.21.15.82:0/2870361519 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 92) v1 ==== 7934+0+0 (secure 0 0 0) 0x7f8500036030 con 0x55d4bdb92380 2023-09-23T09:29:31.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.894+0000 7f85256b3b80 10 client.17424 fetch_fsmap finished waiting for FSMap version 92 2023-09-23T09:29:31.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.894+0000 7f85256b3b80 10 client.17424 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:29:31.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.894+0000 7f85256b3b80 20 client.17424 populate_metadata read hostname 'smithi082' 2023-09-23T09:29:31.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.894+0000 7f85256b3b80 1 --2- 172.21.15.82:0/2870361519 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55d4bdb9ac30 0x55d4bdb9d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:31.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.894+0000 7f85256b3b80 4 client.17424 mds_command: new command op to 24557 tid=0[{"prefix": "damage ls"}] 2023-09-23T09:29:31.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.894+0000 7f85256b3b80 1 -- 172.21.15.82:0/2870361519 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55d4bdad7970 con 0x55d4bdb9ac30 2023-09-23T09:29:31.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:29:31 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:29:31.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.894+0000 7f850affd700 1 --2- 172.21.15.82:0/2870361519 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55d4bdb9ac30 0x55d4bdb9d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:31.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.895+0000 7f84ef7f6700 10 client.17424 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:29:31.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.895+0000 7f850affd700 1 --2- 172.21.15.82:0/2870361519 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55d4bdb9ac30 0x55d4bdb9d050 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b59dc22439f59389 server_cookie=ed1f510b918a1530 in_seq=0 out_seq=0 2023-09-23T09:29:31.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.895+0000 7f84ef7f6700 1 -- 172.21.15.82:0/2870361519 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55d4bdad7970 con 0x55d4bdb9ac30 2023-09-23T09:29:31.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.895+0000 7f84ef7f6700 10 client.17424 handle_command_reply: tid=0 2023-09-23T09:29:31.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.895+0000 7f85256b3b80 1 client.17424 shutdown 2023-09-23T09:29:31.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.896+0000 7f85256b3b80 1 -- 172.21.15.82:0/2870361519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d4bdb92380 msgr2=0x55d4bdba62b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:29:31.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.896+0000 7f85256b3b80 1 --2- 172.21.15.82:0/2870361519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d4bdb92380 0x55d4bdba62b0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f8500003af0 tx=0x7f8500009930 comp rx=0 tx=0).stop 2023-09-23T09:29:31.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.896+0000 7f85256b3b80 1 -- 172.21.15.82:0/2870361519 shutdown_connections 2023-09-23T09:29:31.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.896+0000 7f85256b3b80 1 --2- 172.21.15.82:0/2870361519 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d4bdb94df0 0x55d4bdb95230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:31.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.896+0000 7f85256b3b80 1 --2- 172.21.15.82:0/2870361519 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55d4bdb9ac30 0x55d4bdb9d050 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:31.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.896+0000 7f85256b3b80 1 --2- 172.21.15.82:0/2870361519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d4bdb92380 0x55d4bdba62b0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:31.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.896+0000 7f85256b3b80 1 --2- 172.21.15.82:0/2870361519 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d4bdb92ca0 0x55d4bdb948b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:31.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.896+0000 7f85256b3b80 1 -- 172.21.15.82:0/2870361519 >> 172.21.15.82:0/2870361519 conn(0x55d4bdb010e0 msgr2=0x55d4bdb81b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:29:31.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.896+0000 7f84ef7f6700 0 client.17424 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:29:31.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.897+0000 7f85256b3b80 1 -- 172.21.15.82:0/2870361519 shutdown_connections 2023-09-23T09:29:31.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.897+0000 7f85256b3b80 1 -- 172.21.15.82:0/2870361519 wait complete. 2023-09-23T09:29:31.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.897+0000 7f85256b3b80 20 client.17424 trim_cache size 0 max 16384 2023-09-23T09:29:31.901 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2023-09-23T09:29:31.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.898+0000 7f8511dff700 1 -- 172.21.15.82:0/4136688530 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f84f40a4550 msgr2=0x7f84f40a6a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:29:31.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.898+0000 7f8511dff700 1 --2- 172.21.15.82:0/4136688530 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f84f40a4550 0x7f84f40a6a10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f84fc0068a0 tx=0x7f84fc006730 comp rx=0 tx=0).stop 2023-09-23T09:29:31.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.898+0000 7f8511dff700 1 -- 172.21.15.82:0/4136688530 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f850c105770 msgr2=0x7f850c1b9e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:29:31.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.898+0000 7f8511dff700 1 --2- 172.21.15.82:0/4136688530 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f850c105770 0x7f850c1b9e70 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f850401c0d0 tx=0x7f850401dd20 comp rx=0 tx=0).stop 2023-09-23T09:29:31.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.898+0000 7f8511dff700 1 -- 172.21.15.82:0/4136688530 shutdown_connections 2023-09-23T09:29:31.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.898+0000 7f8511dff700 1 --2- 172.21.15.82:0/4136688530 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f84f40a4550 0x7f84f40a6a10 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:31.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.898+0000 7f8511dff700 1 --2- 172.21.15.82:0/4136688530 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f850c105770 0x7f850c1b9e70 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:31.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.898+0000 7f8511dff700 1 --2- 172.21.15.82:0/4136688530 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f850c0ff760 0x7f850c06ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:31.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.898+0000 7f8511dff700 1 --2- 172.21.15.82:0/4136688530 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f850c100120 0x7f850c06cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:31.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.898+0000 7f8511dff700 1 -- 172.21.15.82:0/4136688530 >> 172.21.15.82:0/4136688530 conn(0x7f850c0fb270 msgr2=0x7f850c103270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:29:31.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.898+0000 7f8511dff700 1 -- 172.21.15.82:0/4136688530 shutdown_connections 2023-09-23T09:29:31.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:31.898+0000 7f8511dff700 1 -- 172.21.15.82:0/4136688530 wait complete. 2023-09-23T09:29:32.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:29:32 smithi135 ceph-mon[99205]: pgmap v1034: 97 pgs: 97 active+clean; 16 GiB data, 54 GiB used, 1019 GiB / 1.0 TiB avail; 1.0 MiB/s rd, 14 MiB/s wr, 1.07k op/s 2023-09-23T09:29:32.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:29:32 smithi082 ceph-mon[97694]: pgmap v1034: 97 pgs: 97 active+clean; 16 GiB data, 54 GiB used, 1019 GiB / 1.0 TiB avail; 1.0 MiB/s rd, 14 MiB/s wr, 1.07k op/s 2023-09-23T09:29:32.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:29:32 smithi161 ceph-mon[99580]: pgmap v1034: 97 pgs: 97 active+clean; 16 GiB data, 54 GiB used, 1019 GiB / 1.0 TiB avail; 1.0 MiB/s rd, 14 MiB/s wr, 1.07k op/s 2023-09-23T09:29:32.935 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-09-23T09:29:32.936 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-09-23T09:29:33.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.319+0000 7f0c23fff700 1 -- 172.21.15.82:0/3839104541 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c1c10cfc0 msgr2=0x7f0c1c10d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:29:33.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.319+0000 7f0c23fff700 1 --2- 172.21.15.82:0/3839104541 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c1c10cfc0 0x7f0c1c10d3a0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c009990 tx=0x7f0c0c009ca0 comp rx=0 tx=0).stop 2023-09-23T09:29:33.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.319+0000 7f0c23fff700 1 -- 172.21.15.82:0/3839104541 shutdown_connections 2023-09-23T09:29:33.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.319+0000 7f0c23fff700 1 --2- 172.21.15.82:0/3839104541 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c1c107a00 0x7f0c1c113d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:33.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.319+0000 7f0c23fff700 1 --2- 172.21.15.82:0/3839104541 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c1c10cfc0 0x7f0c1c10d3a0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:33.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.319+0000 7f0c23fff700 1 --2- 172.21.15.82:0/3839104541 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0c1c107040 0x7f0c1c1074c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:33.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.319+0000 7f0c23fff700 1 -- 172.21.15.82:0/3839104541 >> 172.21.15.82:0/3839104541 conn(0x7f0c1c0767c0 msgr2=0x7f0c1c105740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:29:33.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.322+0000 7f0c23fff700 1 -- 172.21.15.82:0/3839104541 shutdown_connections 2023-09-23T09:29:33.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.323+0000 7f0c23fff700 1 -- 172.21.15.82:0/3839104541 wait complete. 2023-09-23T09:29:33.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.324+0000 7f0c23fff700 1 Processor -- start 2023-09-23T09:29:33.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.324+0000 7f0c23fff700 1 -- start start 2023-09-23T09:29:33.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.325+0000 7f0c23fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c1c107040 0x7f0c1c079ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:33.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.325+0000 7f0c23fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0c1c107a00 0x7f0c1c07a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:33.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.325+0000 7f0c23fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c1c10cfc0 0x7f0c1c1a03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:33.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.325+0000 7f0c23fff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c1c1a09d0 con 0x7f0c1c10cfc0 2023-09-23T09:29:33.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.325+0000 7f0c23fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c1c1a0b40 con 0x7f0c1c107a00 2023-09-23T09:29:33.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.325+0000 7f0c23fff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c1c1a0d00 con 0x7f0c1c107040 2023-09-23T09:29:33.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.325+0000 7f0c2159a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0c1c107a00 0x7f0c1c07a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:33.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.325+0000 7f0c2159a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0c1c107a00 0x7f0c1c07a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:47268/0 (socket says 172.21.15.82:47268) 2023-09-23T09:29:33.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.325+0000 7f0c2159a700 1 -- 172.21.15.82:0/3431415969 learned_addr learned my addr 172.21.15.82:0/3431415969 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:29:33.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.326+0000 7f0c2259c700 1 --2- 172.21.15.82:0/3431415969 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c1c10cfc0 0x7f0c1c1a03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:33.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.327+0000 7f0c21d9b700 1 --2- 172.21.15.82:0/3431415969 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c1c107040 0x7f0c1c079ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:33.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.327+0000 7f0c2259c700 1 -- 172.21.15.82:0/3431415969 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c1c107040 msgr2=0x7f0c1c079ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:29:33.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.327+0000 7f0c2259c700 1 --2- 172.21.15.82:0/3431415969 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c1c107040 0x7f0c1c079ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:33.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.327+0000 7f0c2259c700 1 -- 172.21.15.82:0/3431415969 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0c1c107a00 msgr2=0x7f0c1c07a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:29:33.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.327+0000 7f0c2259c700 1 --2- 172.21.15.82:0/3431415969 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0c1c107a00 0x7f0c1c07a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:33.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.327+0000 7f0c2259c700 1 -- 172.21.15.82:0/3431415969 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c0c0095f0 con 0x7f0c1c10cfc0 2023-09-23T09:29:33.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.328+0000 7f0c2259c700 1 --2- 172.21.15.82:0/3431415969 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c1c10cfc0 0x7f0c1c1a03d0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f0c14007f10 tx=0x7f0c1400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:29:33.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.328+0000 7f0c12ffd700 1 -- 172.21.15.82:0/3431415969 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c1400ddd0 con 0x7f0c1c10cfc0 2023-09-23T09:29:33.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.328+0000 7f0c12ffd700 1 -- 172.21.15.82:0/3431415969 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0c1400f040 con 0x7f0c1c10cfc0 2023-09-23T09:29:33.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.329+0000 7f0c12ffd700 1 -- 172.21.15.82:0/3431415969 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c140059f0 con 0x7f0c1c10cfc0 2023-09-23T09:29:33.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.329+0000 7f0c23fff700 1 -- 172.21.15.82:0/3431415969 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c1c1a0fe0 con 0x7f0c1c10cfc0 2023-09-23T09:29:33.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.329+0000 7f0c23fff700 1 -- 172.21.15.82:0/3431415969 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c1c1a14a0 con 0x7f0c1c10cfc0 2023-09-23T09:29:33.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.338+0000 7f0c379ccb80 1 Processor -- start 2023-09-23T09:29:33.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.342+0000 7f0c12ffd700 1 -- 172.21.15.82:0/3431415969 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f0c14005020 con 0x7f0c1c10cfc0 2023-09-23T09:29:33.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.343+0000 7f0c379ccb80 1 -- start start 2023-09-23T09:29:33.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.343+0000 7f0c379ccb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555c2f8aa400 0x555c2f8aa7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:33.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.343+0000 7f0c379ccb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555c2f8aad20 0x555c2f8a4780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:33.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.343+0000 7f0c379ccb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c2f8a4cc0 0x555c2f8a5120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:33.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.343+0000 7f0c379ccb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c2f80c830 con 0x555c2f8a4cc0 2023-09-23T09:29:33.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.343+0000 7f0c379ccb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c2f7fd800 con 0x555c2f8aad20 2023-09-23T09:29:33.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.343+0000 7f0c379ccb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c2f7fb120 con 0x555c2f8aa400 2023-09-23T09:29:33.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.344+0000 7f0c2159a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555c2f8aa400 0x555c2f8aa7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:33.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.345+0000 7f0c12ffd700 1 --2- 172.21.15.82:0/3431415969 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f0c080a0250 0x7f0c080a2710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:33.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.345+0000 7f0c2159a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555c2f8aa400 0x555c2f8aa7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:49002/0 (socket says 172.21.15.82:49002) 2023-09-23T09:29:33.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.345+0000 7f0c2159a700 1 -- 172.21.15.82:0/350823406 learned_addr learned my addr 172.21.15.82:0/350823406 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:29:33.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.345+0000 7f0c2159a700 1 --2- 172.21.15.82:0/350823406 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c2f8a4cc0 0x555c2f8a5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:33.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.345+0000 7f0c12ffd700 1 -- 172.21.15.82:0/3431415969 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f0c140cad70 con 0x7f0c1c10cfc0 2023-09-23T09:29:33.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.346+0000 7f0c21d9b700 1 --2- 172.21.15.82:0/350823406 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555c2f8aad20 0x555c2f8a4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:33.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.346+0000 7f0c2159a700 1 -- 172.21.15.82:0/350823406 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555c2f8aad20 msgr2=0x555c2f8a4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:29:33.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.346+0000 7f0c2159a700 1 --2- 172.21.15.82:0/350823406 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555c2f8aad20 0x555c2f8a4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:33.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.346+0000 7f0c2159a700 1 -- 172.21.15.82:0/350823406 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c2f8a4cc0 msgr2=0x555c2f8a5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:29:33.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.346+0000 7f0c2159a700 1 --2- 172.21.15.82:0/350823406 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c2f8a4cc0 0x555c2f8a5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:33.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.346+0000 7f0c2159a700 1 -- 172.21.15.82:0/350823406 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555c2f6766b0 con 0x555c2f8aa400 2023-09-23T09:29:33.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.347+0000 7f0c2159a700 1 --2- 172.21.15.82:0/350823406 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555c2f8aa400 0x555c2f8aa7e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f0c18011820 tx=0x7f0c1800a7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d49b2a8adbc8cbc server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:29:33.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.347+0000 7f0c07fff700 1 -- 172.21.15.82:0/350823406 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c18011e40 con 0x555c2f8aa400 2023-09-23T09:29:33.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.347+0000 7f0c07fff700 1 -- 172.21.15.82:0/350823406 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0c180044b0 con 0x555c2f8aa400 2023-09-23T09:29:33.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.347+0000 7f0c07fff700 1 -- 172.21.15.82:0/350823406 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c18005260 con 0x555c2f8aa400 2023-09-23T09:29:33.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.348+0000 7f0c379ccb80 1 -- 172.21.15.82:0/350823406 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555c2f8aa400 msgr2=0x555c2f8aa7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:29:33.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.348+0000 7f0c379ccb80 1 --2- 172.21.15.82:0/350823406 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555c2f8aa400 0x555c2f8aa7e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f0c18011820 tx=0x7f0c1800a7b0 comp rx=0 tx=0).stop 2023-09-23T09:29:33.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.349+0000 7f0c379ccb80 1 -- 172.21.15.82:0/350823406 shutdown_connections 2023-09-23T09:29:33.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.349+0000 7f0c379ccb80 1 --2- 172.21.15.82:0/350823406 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c2f8a4cc0 0x555c2f8a5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:33.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.349+0000 7f0c379ccb80 1 --2- 172.21.15.82:0/350823406 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555c2f8aa400 0x555c2f8aa7e0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:33.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.349+0000 7f0c379ccb80 1 --2- 172.21.15.82:0/350823406 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555c2f8aad20 0x555c2f8a4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:33.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.349+0000 7f0c379ccb80 1 -- 172.21.15.82:0/350823406 >> 172.21.15.82:0/350823406 conn(0x555c2f819160 msgr2=0x555c2f89f490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:29:33.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.350+0000 7f0c379ccb80 1 -- 172.21.15.82:0/350823406 shutdown_connections 2023-09-23T09:29:33.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.350+0000 7f0c2259c700 1 --2- 172.21.15.82:0/3431415969 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f0c080a0250 0x7f0c080a2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:33.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.350+0000 7f0c379ccb80 1 -- 172.21.15.82:0/350823406 wait complete. 2023-09-23T09:29:33.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.351+0000 7f0c379ccb80 1 -- start start 2023-09-23T09:29:33.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.351+0000 7f0c379ccb80 1 Processor -- start 2023-09-23T09:29:33.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.352+0000 7f0c379ccb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555c2f8a4cc0 0x555c2f8b0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:33.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.352+0000 7f0c379ccb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c2f8aa400 0x555c2f8adf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:33.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.352+0000 7f0c379ccb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555c2f8aad20 0x555c2f8ae690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:33.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.352+0000 7f0c379ccb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c2f7f6a10 con 0x555c2f8aa400 2023-09-23T09:29:33.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.353+0000 7f0c379ccb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c2f794c30 con 0x555c2f8aad20 2023-09-23T09:29:33.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.353+0000 7f0c379ccb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c2f794930 con 0x555c2f8a4cc0 2023-09-23T09:29:33.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.353+0000 7f0c379ccb80 10 client.0 _ll_register_callbacks cb 0x555c2f6deb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:29:33.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.353+0000 7f0c2259c700 1 --2- 172.21.15.82:0/3431415969 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f0c080a0250 0x7f0c080a2710 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0c14098370 tx=0x7f0c1400b040 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:29:33.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.353+0000 7f0c21d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c2f8aa400 0x555c2f8adf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:33.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.353+0000 7f0c2159a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555c2f8a4cc0 0x555c2f8b0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:33.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.353+0000 7f0c21d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c2f8aa400 0x555c2f8adf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47334/0 (socket says 172.21.15.82:47334) 2023-09-23T09:29:33.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.353+0000 7f0c21d9b700 1 -- 172.21.15.82:0/4083053117 learned_addr learned my addr 172.21.15.82:0/4083053117 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:29:33.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.353+0000 7f0c2159a700 1 --2- 172.21.15.82:0/4083053117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555c2f8aad20 0x555c2f8ae690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:33.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.354+0000 7f0c2159a700 1 -- 172.21.15.82:0/4083053117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555c2f8aad20 msgr2=0x555c2f8ae690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:29:33.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.354+0000 7f0c2159a700 1 --2- 172.21.15.82:0/4083053117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555c2f8aad20 0x555c2f8ae690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:33.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.354+0000 7f0c2159a700 1 -- 172.21.15.82:0/4083053117 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c2f8aa400 msgr2=0x555c2f8adf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:29:33.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.354+0000 7f0c2159a700 1 --2- 172.21.15.82:0/4083053117 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c2f8aa400 0x555c2f8adf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:33.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.354+0000 7f0c2159a700 1 -- 172.21.15.82:0/4083053117 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c18019040 con 0x555c2f8a4cc0 2023-09-23T09:29:33.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.354+0000 7f0c2159a700 1 --2- 172.21.15.82:0/4083053117 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555c2f8a4cc0 0x555c2f8b0cd0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0c18011820 tx=0x7f0c1800ac10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b3bbda1d14fc8f3 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:29:33.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.354+0000 7f0c057fa700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T09:29:33.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.355+0000 7f0c057fa700 1 -- 172.21.15.82:0/4083053117 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c18004400 con 0x555c2f8a4cc0 2023-09-23T09:29:33.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.355+0000 7f0c057fa700 1 -- 172.21.15.82:0/4083053117 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(141..141 src has 1..141) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f0c18003680 con 0x555c2f8a4cc0 2023-09-23T09:29:33.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.355+0000 7f0c379ccb80 1 -- 172.21.15.82:0/4083053117 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555c2f874240 con 0x555c2f8a4cc0 2023-09-23T09:29:33.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.355+0000 7f0c057fa700 1 -- 172.21.15.82:0/4083053117 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0c18003840 con 0x555c2f8a4cc0 2023-09-23T09:29:33.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.355+0000 7f0c379ccb80 10 client.27163 fetch_fsmap learned FSMap version 92 2023-09-23T09:29:33.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.355+0000 7f0c379ccb80 1 -- 172.21.15.82:0/4083053117 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=92,monmap=4+}) v3 -- 0x555c2f622e60 con 0x555c2f8a4cc0 2023-09-23T09:29:33.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.356+0000 7f0c057fa700 1 -- 172.21.15.82:0/4083053117 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x555c2f874240 con 0x555c2f8a4cc0 2023-09-23T09:29:33.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.356+0000 7f0c057fa700 1 -- 172.21.15.82:0/4083053117 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 92) v1 ==== 7934+0+0 (secure 0 0 0) 0x7f0c1800f930 con 0x555c2f8a4cc0 2023-09-23T09:29:33.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.357+0000 7f0c379ccb80 10 client.27163 fetch_fsmap finished waiting for FSMap version 92 2023-09-23T09:29:33.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.357+0000 7f0c379ccb80 10 client.27163 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:29:33.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.357+0000 7f0c379ccb80 20 client.27163 populate_metadata read hostname 'smithi082' 2023-09-23T09:29:33.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.357+0000 7f0c379ccb80 1 --2- 172.21.15.82:0/4083053117 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x555c2f8cf570 0x555c2f8d1990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:33.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.357+0000 7f0c379ccb80 4 client.27163 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:29:33.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.357+0000 7f0c379ccb80 1 -- 172.21.15.82:0/4083053117 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555c2f79cc20 con 0x555c2f8cf570 2023-09-23T09:29:33.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.357+0000 7f0c21d9b700 1 --2- 172.21.15.82:0/4083053117 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x555c2f8cf570 0x555c2f8d1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:33.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.358+0000 7f0c21d9b700 1 --2- 172.21.15.82:0/4083053117 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x555c2f8cf570 0x555c2f8d1990 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab6ec9f8bf63485e server_cookie=1055e330ac15cfed in_seq=0 out_seq=0 2023-09-23T09:29:33.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.359+0000 7f0c057fa700 10 client.27163 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:29:33.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.359+0000 7f0c057fa700 1 -- 172.21.15.82:0/4083053117 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x555c2f79cc20 con 0x555c2f8cf570 2023-09-23T09:29:33.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.359+0000 7f0c057fa700 10 client.27163 handle_command_reply: tid=0 2023-09-23T09:29:33.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.359+0000 7f0c379ccb80 1 client.27163 shutdown 2023-09-23T09:29:33.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.359+0000 7f0c379ccb80 1 -- 172.21.15.82:0/4083053117 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555c2f8a4cc0 msgr2=0x555c2f8b0cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:29:33.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.359+0000 7f0c379ccb80 1 --2- 172.21.15.82:0/4083053117 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555c2f8a4cc0 0x555c2f8b0cd0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0c18011820 tx=0x7f0c1800ac10 comp rx=0 tx=0).stop 2023-09-23T09:29:33.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.360+0000 7f0c379ccb80 1 -- 172.21.15.82:0/4083053117 shutdown_connections 2023-09-23T09:29:33.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.360+0000 7f0c379ccb80 1 --2- 172.21.15.82:0/4083053117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555c2f8aad20 0x555c2f8ae690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:33.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.360+0000 7f0c379ccb80 1 --2- 172.21.15.82:0/4083053117 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555c2f8a4cc0 0x555c2f8b0cd0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:33.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.360+0000 7f0c379ccb80 1 --2- 172.21.15.82:0/4083053117 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x555c2f8cf570 0x555c2f8d1990 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:33.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.360+0000 7f0c379ccb80 1 --2- 172.21.15.82:0/4083053117 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c2f8aa400 0x555c2f8adf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:33.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.360+0000 7f0c379ccb80 1 -- 172.21.15.82:0/4083053117 >> 172.21.15.82:0/4083053117 conn(0x555c2f819160 msgr2=0x555c2f899bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:29:33.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.360+0000 7f0c057fa700 0 client.27163 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:29:33.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.360+0000 7f0c379ccb80 1 -- 172.21.15.82:0/4083053117 shutdown_connections 2023-09-23T09:29:33.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.360+0000 7f0c379ccb80 1 -- 172.21.15.82:0/4083053117 wait complete. 2023-09-23T09:29:33.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.361+0000 7f0c379ccb80 20 client.27163 trim_cache size 0 max 16384 2023-09-23T09:29:33.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.393+0000 7f0c379ccb80 1 Processor -- start 2023-09-23T09:29:33.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.393+0000 7f0c379ccb80 1 -- start start 2023-09-23T09:29:33.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.393+0000 7f0c379ccb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555c2f8a4cc0 0x555c2f8b5850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:33.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.393+0000 7f0c379ccb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555c2f8aa400 0x555c2f8a9720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:33.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.393+0000 7f0c379ccb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c2f8aad20 0x555c2f8b0870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:33.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.393+0000 7f0c379ccb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c2f6789a0 con 0x555c2f8aad20 2023-09-23T09:29:33.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.393+0000 7f0c379ccb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c2f8af530 con 0x555c2f8aa400 2023-09-23T09:29:33.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.393+0000 7f0c379ccb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c2f89bd30 con 0x555c2f8a4cc0 2023-09-23T09:29:33.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.394+0000 7f0c2159a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555c2f8a4cc0 0x555c2f8b5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:33.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.394+0000 7f0c21d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555c2f8aa400 0x555c2f8a9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:33.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.394+0000 7f0c21d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555c2f8aa400 0x555c2f8a9720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:47296/0 (socket says 172.21.15.82:47296) 2023-09-23T09:29:33.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.394+0000 7f0c21d9b700 1 -- 172.21.15.82:0/3599482957 learned_addr learned my addr 172.21.15.82:0/3599482957 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:29:33.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.394+0000 7f0c2159a700 1 --2- 172.21.15.82:0/3599482957 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c2f8aad20 0x555c2f8b0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:33.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.394+0000 7f0c21d9b700 1 -- 172.21.15.82:0/3599482957 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555c2f8a4cc0 msgr2=0x555c2f8b5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:29:33.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.394+0000 7f0c21d9b700 1 --2- 172.21.15.82:0/3599482957 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555c2f8a4cc0 0x555c2f8b5850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:33.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.394+0000 7f0c21d9b700 1 -- 172.21.15.82:0/3599482957 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c2f8aad20 msgr2=0x555c2f8b0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:29:33.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.394+0000 7f0c21d9b700 1 --2- 172.21.15.82:0/3599482957 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c2f8aad20 0x555c2f8b0870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:33.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.394+0000 7f0c21d9b700 1 -- 172.21.15.82:0/3599482957 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555c2f8a5370 con 0x555c2f8aa400 2023-09-23T09:29:33.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.395+0000 7f0c21d9b700 1 --2- 172.21.15.82:0/3599482957 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555c2f8aa400 0x555c2f8a9720 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c006010 tx=0x7f0c0c00b540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b79c31d600b2eec server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:29:33.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.395+0000 7f0c10ff9700 1 -- 172.21.15.82:0/3599482957 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c0c01c030 con 0x555c2f8aa400 2023-09-23T09:29:33.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.395+0000 7f0c10ff9700 1 -- 172.21.15.82:0/3599482957 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0c0c01f040 con 0x555c2f8aa400 2023-09-23T09:29:33.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.395+0000 7f0c10ff9700 1 -- 172.21.15.82:0/3599482957 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c0c0054e0 con 0x555c2f8aa400 2023-09-23T09:29:33.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.396+0000 7f0c379ccb80 1 -- 172.21.15.82:0/3599482957 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555c2f8aa400 msgr2=0x555c2f8a9720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:29:33.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.396+0000 7f0c379ccb80 1 --2- 172.21.15.82:0/3599482957 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555c2f8aa400 0x555c2f8a9720 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c006010 tx=0x7f0c0c00b540 comp rx=0 tx=0).stop 2023-09-23T09:29:33.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.396+0000 7f0c379ccb80 1 -- 172.21.15.82:0/3599482957 shutdown_connections 2023-09-23T09:29:33.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.396+0000 7f0c379ccb80 1 --2- 172.21.15.82:0/3599482957 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c2f8aad20 0x555c2f8b0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:33.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.396+0000 7f0c379ccb80 1 --2- 172.21.15.82:0/3599482957 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555c2f8a4cc0 0x555c2f8b5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:33.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.396+0000 7f0c379ccb80 1 --2- 172.21.15.82:0/3599482957 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555c2f8aa400 0x555c2f8a9720 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:33.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.396+0000 7f0c379ccb80 1 -- 172.21.15.82:0/3599482957 >> 172.21.15.82:0/3599482957 conn(0x555c2f819160 msgr2=0x555c2f8a9010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:29:33.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.396+0000 7f0c379ccb80 1 -- 172.21.15.82:0/3599482957 shutdown_connections 2023-09-23T09:29:33.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.396+0000 7f0c379ccb80 1 -- 172.21.15.82:0/3599482957 wait complete. 2023-09-23T09:29:33.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.397+0000 7f0c379ccb80 1 -- start start 2023-09-23T09:29:33.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.397+0000 7f0c379ccb80 1 Processor -- start 2023-09-23T09:29:33.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.398+0000 7f0c379ccb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c2f8a4cc0 0x555c2f8b3c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:33.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.398+0000 7f0c379ccb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555c2f8aa400 0x555c2f8b41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:33.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.398+0000 7f0c379ccb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555c2f8aad20 0x555c2f8b4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:33.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.398+0000 7f0c379ccb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c2f9233f0 con 0x555c2f8a4cc0 2023-09-23T09:29:33.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.398+0000 7f0c379ccb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c2f923530 con 0x555c2f8aad20 2023-09-23T09:29:33.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.398+0000 7f0c379ccb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c2f923670 con 0x555c2f8aa400 2023-09-23T09:29:33.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.398+0000 7f0c379ccb80 10 client.0 _ll_register_callbacks cb 0x7f0c18004ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:29:33.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.398+0000 7f0c2159a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c2f8a4cc0 0x555c2f8b3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:33.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.398+0000 7f0c2159a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c2f8a4cc0 0x555c2f8b3c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47350/0 (socket says 172.21.15.82:47350) 2023-09-23T09:29:33.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.398+0000 7f0c2159a700 1 -- 172.21.15.82:0/2036470106 learned_addr learned my addr 172.21.15.82:0/2036470106 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:29:33.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.399+0000 7f0c2159a700 1 --2- 172.21.15.82:0/2036470106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555c2f8aad20 0x555c2f8b4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:33.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.399+0000 7f0c21d9b700 1 --2- 172.21.15.82:0/2036470106 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555c2f8aa400 0x555c2f8b41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:33.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.399+0000 7f0c2159a700 1 -- 172.21.15.82:0/2036470106 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555c2f8aa400 msgr2=0x555c2f8b41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:29:33.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.399+0000 7f0c2159a700 1 --2- 172.21.15.82:0/2036470106 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555c2f8aa400 0x555c2f8b41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:33.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.399+0000 7f0c2159a700 1 -- 172.21.15.82:0/2036470106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c2f8a4cc0 msgr2=0x555c2f8b3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:29:33.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.399+0000 7f0c2159a700 1 --2- 172.21.15.82:0/2036470106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c2f8a4cc0 0x555c2f8b3c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:33.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.399+0000 7f0c2159a700 1 -- 172.21.15.82:0/2036470106 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c1c114650 con 0x555c2f8aad20 2023-09-23T09:29:33.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.400+0000 7f0c2159a700 1 --2- 172.21.15.82:0/2036470106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555c2f8aad20 0x555c2f8b4700 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0c18004d60 tx=0x7f0c1800afd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac138e57bf82f86 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:29:33.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.400+0000 7f0c057fa700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-09-23T09:29:33.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.400+0000 7f0c057fa700 1 -- 172.21.15.82:0/2036470106 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c1800f850 con 0x555c2f8aad20 2023-09-23T09:29:33.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.400+0000 7f0c057fa700 1 -- 172.21.15.82:0/2036470106 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(141..141 src has 1..141) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f0c18000e40 con 0x555c2f8aad20 2023-09-23T09:29:33.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.400+0000 7f0c379ccb80 1 -- 172.21.15.82:0/2036470106 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555c2f897930 con 0x555c2f8aad20 2023-09-23T09:29:33.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.401+0000 7f0c057fa700 1 -- 172.21.15.82:0/2036470106 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0c1800f9b0 con 0x555c2f8aad20 2023-09-23T09:29:33.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.401+0000 7f0c379ccb80 10 client.27137 fetch_fsmap learned FSMap version 92 2023-09-23T09:29:33.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.401+0000 7f0c379ccb80 1 -- 172.21.15.82:0/2036470106 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=92,monmap=4+}) v3 -- 0x555c2f60bce0 con 0x555c2f8aad20 2023-09-23T09:29:33.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.402+0000 7f0c057fa700 1 -- 172.21.15.82:0/2036470106 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0c1804a080 con 0x555c2f8aad20 2023-09-23T09:29:33.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.402+0000 7f0c057fa700 1 -- 172.21.15.82:0/2036470106 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 92) v1 ==== 7934+0+0 (secure 0 0 0) 0x7f0c18004e30 con 0x555c2f8aad20 2023-09-23T09:29:33.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.403+0000 7f0c379ccb80 10 client.27137 fetch_fsmap finished waiting for FSMap version 92 2023-09-23T09:29:33.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.403+0000 7f0c379ccb80 10 client.27137 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:29:33.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.403+0000 7f0c379ccb80 20 client.27137 populate_metadata read hostname 'smithi082' 2023-09-23T09:29:33.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.403+0000 7f0c379ccb80 1 --2- 172.21.15.82:0/2036470106 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x555c2f924c30 0x555c2f927050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:33.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.403+0000 7f0c379ccb80 4 client.27137 mds_command: new command op to 24557 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-09-23T09:29:33.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.403+0000 7f0c379ccb80 1 -- 172.21.15.82:0/2036470106 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x555c2f7ef9f0 con 0x555c2f924c30 2023-09-23T09:29:33.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.403+0000 7f0c21d9b700 1 --2- 172.21.15.82:0/2036470106 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x555c2f924c30 0x555c2f927050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:33.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.404+0000 7f0c21d9b700 1 --2- 172.21.15.82:0/2036470106 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x555c2f924c30 0x555c2f927050 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=74f617f83d68d78d server_cookie=61d15bc4e87bc0e1 in_seq=0 out_seq=0 2023-09-23T09:29:33.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.404+0000 7f0c057fa700 10 client.27137 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:29:33.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.405+0000 7f0c057fa700 1 -- 172.21.15.82:0/2036470106 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x555c2f7ef9f0 con 0x555c2f924c30 2023-09-23T09:29:33.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.405+0000 7f0c057fa700 10 client.27137 handle_command_reply: tid=0 2023-09-23T09:29:33.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.405+0000 7f0c379ccb80 1 client.27137 shutdown 2023-09-23T09:29:33.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.406+0000 7f0c379ccb80 1 -- 172.21.15.82:0/2036470106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555c2f8aad20 msgr2=0x555c2f8b4700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:29:33.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.406+0000 7f0c379ccb80 1 --2- 172.21.15.82:0/2036470106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555c2f8aad20 0x555c2f8b4700 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0c18004d60 tx=0x7f0c1800afd0 comp rx=0 tx=0).stop 2023-09-23T09:29:33.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.406+0000 7f0c379ccb80 1 -- 172.21.15.82:0/2036470106 shutdown_connections 2023-09-23T09:29:33.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.406+0000 7f0c379ccb80 1 --2- 172.21.15.82:0/2036470106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555c2f8aad20 0x555c2f8b4700 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:33.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.406+0000 7f0c379ccb80 1 --2- 172.21.15.82:0/2036470106 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x555c2f924c30 0x555c2f927050 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:33.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.406+0000 7f0c379ccb80 1 --2- 172.21.15.82:0/2036470106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c2f8a4cc0 0x555c2f8b3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:33.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.406+0000 7f0c379ccb80 1 --2- 172.21.15.82:0/2036470106 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x555c2f8aa400 0x555c2f8b41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:33.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.406+0000 7f0c379ccb80 1 -- 172.21.15.82:0/2036470106 >> 172.21.15.82:0/2036470106 conn(0x555c2f819160 msgr2=0x555c2f899330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:29:33.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.406+0000 7f0c057fa700 0 client.27137 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:29:33.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.409+0000 7f0c379ccb80 1 -- 172.21.15.82:0/2036470106 shutdown_connections 2023-09-23T09:29:33.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.409+0000 7f0c379ccb80 1 -- 172.21.15.82:0/2036470106 wait complete. 2023-09-23T09:29:33.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.410+0000 7f0c379ccb80 20 client.27137 trim_cache size 0 max 16384 2023-09-23T09:29:33.412 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:29:33.413 INFO:teuthology.orchestra.run.smithi082.stdout: "return_code": 0, 2023-09-23T09:29:33.413 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_tag": "dd4891a0-2d94-4f10-a6c1-dd165ffd5e79", 2023-09-23T09:29:33.413 INFO:teuthology.orchestra.run.smithi082.stdout: "mode": "asynchronous" 2023-09-23T09:29:33.413 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:29:33.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.410+0000 7f0c23fff700 1 -- 172.21.15.82:0/3431415969 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f0c080a0250 msgr2=0x7f0c080a2710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:29:33.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.410+0000 7f0c23fff700 1 --2- 172.21.15.82:0/3431415969 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f0c080a0250 0x7f0c080a2710 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0c14098370 tx=0x7f0c1400b040 comp rx=0 tx=0).stop 2023-09-23T09:29:33.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.410+0000 7f0c23fff700 1 -- 172.21.15.82:0/3431415969 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c1c10cfc0 msgr2=0x7f0c1c1a03d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:29:33.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.410+0000 7f0c23fff700 1 --2- 172.21.15.82:0/3431415969 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c1c10cfc0 0x7f0c1c1a03d0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f0c14007f10 tx=0x7f0c1400d3b0 comp rx=0 tx=0).stop 2023-09-23T09:29:33.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.411+0000 7f0c23fff700 1 -- 172.21.15.82:0/3431415969 shutdown_connections 2023-09-23T09:29:33.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.411+0000 7f0c23fff700 1 --2- 172.21.15.82:0/3431415969 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f0c080a0250 0x7f0c080a2710 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:33.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.411+0000 7f0c23fff700 1 --2- 172.21.15.82:0/3431415969 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c1c10cfc0 0x7f0c1c1a03d0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:33.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.411+0000 7f0c23fff700 1 --2- 172.21.15.82:0/3431415969 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c1c107040 0x7f0c1c079ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:33.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.411+0000 7f0c23fff700 1 --2- 172.21.15.82:0/3431415969 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0c1c107a00 0x7f0c1c07a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:33.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.411+0000 7f0c23fff700 1 -- 172.21.15.82:0/3431415969 >> 172.21.15.82:0/3431415969 conn(0x7f0c1c0767c0 msgr2=0x7f0c1c0779b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:29:33.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.411+0000 7f0c23fff700 1 -- 172.21.15.82:0/3431415969 shutdown_connections 2023-09-23T09:29:33.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.412+0000 7f0c23fff700 1 -- 172.21.15.82:0/3431415969 wait complete. 2023-09-23T09:29:33.448 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:29:33.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.830+0000 7ff17abff700 1 -- 172.21.15.82:0/1465501899 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff174100890 msgr2=0x7ff174100d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:29:33.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.830+0000 7ff17abff700 1 --2- 172.21.15.82:0/1465501899 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff174100890 0x7ff174100d10 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff1640098f0 tx=0x7ff164009c00 comp rx=0 tx=0).stop 2023-09-23T09:29:33.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.832+0000 7ff17abff700 1 -- 172.21.15.82:0/1465501899 shutdown_connections 2023-09-23T09:29:33.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.832+0000 7ff17abff700 1 --2- 172.21.15.82:0/1465501899 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff174101250 0x7ff17410d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:33.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.832+0000 7ff17abff700 1 --2- 172.21.15.82:0/1465501899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff1741068a0 0x7ff174106c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:33.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.832+0000 7ff17abff700 1 --2- 172.21.15.82:0/1465501899 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff174100890 0x7ff174100d10 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:33.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.832+0000 7ff17abff700 1 -- 172.21.15.82:0/1465501899 >> 172.21.15.82:0/1465501899 conn(0x7ff1740fc380 msgr2=0x7ff1740fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:29:33.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.833+0000 7ff17abff700 1 -- 172.21.15.82:0/1465501899 shutdown_connections 2023-09-23T09:29:33.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.833+0000 7ff17abff700 1 -- 172.21.15.82:0/1465501899 wait complete. 2023-09-23T09:29:33.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.834+0000 7ff17abff700 1 Processor -- start 2023-09-23T09:29:33.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.834+0000 7ff17abff700 1 -- start start 2023-09-23T09:29:33.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.835+0000 7ff17abff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff174100890 0x7ff17410cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:33.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.835+0000 7ff17abff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff174101250 0x7ff17410d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:33.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.835+0000 7ff17abff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff1741068a0 0x7ff17410d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:33.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.835+0000 7ff17abff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff174072da0 con 0x7ff174101250 2023-09-23T09:29:33.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.835+0000 7ff17abff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff174072f10 con 0x7ff174100890 2023-09-23T09:29:33.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.835+0000 7ff17abff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1740730d0 con 0x7ff1741068a0 2023-09-23T09:29:33.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.836+0000 7ff17899b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff174100890 0x7ff17410cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:33.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.836+0000 7ff17899b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff174100890 0x7ff17410cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:47326/0 (socket says 172.21.15.82:47326) 2023-09-23T09:29:33.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.836+0000 7ff17899b700 1 -- 172.21.15.82:0/2228435437 learned_addr learned my addr 172.21.15.82:0/2228435437 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:29:33.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.836+0000 7ff17919c700 1 --2- 172.21.15.82:0/2228435437 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff1741068a0 0x7ff17410d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:33.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.836+0000 7ff17899b700 1 -- 172.21.15.82:0/2228435437 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff1741068a0 msgr2=0x7ff17410d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:29:33.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.836+0000 7ff17899b700 1 --2- 172.21.15.82:0/2228435437 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff1741068a0 0x7ff17410d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:33.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.837+0000 7ff17899b700 1 -- 172.21.15.82:0/2228435437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff174101250 msgr2=0x7ff17410d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:29:33.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.837+0000 7ff17899b700 1 --2- 172.21.15.82:0/2228435437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff174101250 0x7ff17410d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:33.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.837+0000 7ff17899b700 1 -- 172.21.15.82:0/2228435437 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff164009520 con 0x7ff174100890 2023-09-23T09:29:33.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.837+0000 7ff17899b700 1 --2- 172.21.15.82:0/2228435437 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff174100890 0x7ff17410cca0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff16c01d0c0 tx=0x7ff16c01d3d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:29:33.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.837+0000 7ff171ffb700 1 -- 172.21.15.82:0/2228435437 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff16c029070 con 0x7ff174100890 2023-09-23T09:29:33.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.838+0000 7ff17abff700 1 -- 172.21.15.82:0/2228435437 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff174073350 con 0x7ff174100890 2023-09-23T09:29:33.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.838+0000 7ff17abff700 1 -- 172.21.15.82:0/2228435437 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1740738b0 con 0x7ff174100890 2023-09-23T09:29:33.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.838+0000 7ff171ffb700 1 -- 172.21.15.82:0/2228435437 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff16c020040 con 0x7ff174100890 2023-09-23T09:29:33.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.838+0000 7ff171ffb700 1 -- 172.21.15.82:0/2228435437 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff16c01f020 con 0x7ff174100890 2023-09-23T09:29:33.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.844+0000 7ff171ffb700 1 -- 172.21.15.82:0/2228435437 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7ff16c01dd10 con 0x7ff174100890 2023-09-23T09:29:33.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.845+0000 7ff18e4c3b80 1 Processor -- start 2023-09-23T09:29:33.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.845+0000 7ff18e4c3b80 1 -- start start 2023-09-23T09:29:33.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.846+0000 7ff18e4c3b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564f7115a380 0x564f7115a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:33.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.846+0000 7ff18e4c3b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564f7115aca0 0x564f71154700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:33.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.846+0000 7ff18e4c3b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f71154c40 0x564f711550a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:33.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.846+0000 7ff18e4c3b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f710bc7b0 con 0x564f71154c40 2023-09-23T09:29:33.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.846+0000 7ff18e4c3b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f710ad780 con 0x564f7115a380 2023-09-23T09:29:33.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.846+0000 7ff18e4c3b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f710ab0a0 con 0x564f7115aca0 2023-09-23T09:29:33.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.846+0000 7ff17899b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564f7115aca0 0x564f71154700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:33.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.847+0000 7ff17899b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564f7115aca0 0x564f71154700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:49024/0 (socket says 172.21.15.82:49024) 2023-09-23T09:29:33.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.847+0000 7ff17899b700 1 -- 172.21.15.82:0/699447578 learned_addr learned my addr 172.21.15.82:0/699447578 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:29:33.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.847+0000 7ff173fff700 1 --2- 172.21.15.82:0/699447578 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f71154c40 0x564f711550a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:33.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.847+0000 7ff17919c700 1 --2- 172.21.15.82:0/699447578 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564f7115a380 0x564f7115a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:33.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.847+0000 7ff17899b700 1 -- 172.21.15.82:0/699447578 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564f7115a380 msgr2=0x564f7115a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:29:33.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.847+0000 7ff17899b700 1 --2- 172.21.15.82:0/699447578 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564f7115a380 0x564f7115a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:33.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.847+0000 7ff17899b700 1 -- 172.21.15.82:0/699447578 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f71154c40 msgr2=0x564f711550a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:29:33.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.847+0000 7ff17899b700 1 --2- 172.21.15.82:0/699447578 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f71154c40 0x564f711550a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:33.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.847+0000 7ff17899b700 1 -- 172.21.15.82:0/699447578 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564f70f26630 con 0x564f7115aca0 2023-09-23T09:29:33.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.847+0000 7ff173fff700 1 --2- 172.21.15.82:0/699447578 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f71154c40 0x564f711550a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:29:33.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.848+0000 7ff171ffb700 1 --2- 172.21.15.82:0/2228435437 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7ff15c0a0200 0x7ff15c0a26c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:33.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.848+0000 7ff17899b700 1 --2- 172.21.15.82:0/699447578 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564f7115aca0 0x564f71154700 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ff16c0d9910 tx=0x7ff16c0e4540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d65568eba9746ad server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:29:33.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.848+0000 7ff17919c700 1 --2- 172.21.15.82:0/2228435437 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7ff15c0a0200 0x7ff15c0a26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:33.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.848+0000 7ff171ffb700 1 -- 172.21.15.82:0/2228435437 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 8513+0+0 (secure 0 0 0) 0x7ff16c0dc2e0 con 0x7ff174100890 2023-09-23T09:29:33.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.848+0000 7ff15affd700 1 -- 172.21.15.82:0/699447578 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff16c0a5cd0 con 0x564f7115aca0 2023-09-23T09:29:33.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.848+0000 7ff15affd700 1 -- 172.21.15.82:0/699447578 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff16c0a9760 con 0x564f7115aca0 2023-09-23T09:29:33.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.848+0000 7ff15affd700 1 -- 172.21.15.82:0/699447578 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff16c0a9990 con 0x564f7115aca0 2023-09-23T09:29:33.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.850+0000 7ff18e4c3b80 1 -- 172.21.15.82:0/699447578 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564f7115aca0 msgr2=0x564f71154700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:29:33.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.850+0000 7ff17919c700 1 --2- 172.21.15.82:0/2228435437 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7ff15c0a0200 0x7ff15c0a26c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff168005950 tx=0x7ff16800b390 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:29:33.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.850+0000 7ff18e4c3b80 1 --2- 172.21.15.82:0/699447578 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564f7115aca0 0x564f71154700 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ff16c0d9910 tx=0x7ff16c0e4540 comp rx=0 tx=0).stop 2023-09-23T09:29:33.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.850+0000 7ff18e4c3b80 1 -- 172.21.15.82:0/699447578 shutdown_connections 2023-09-23T09:29:33.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.850+0000 7ff18e4c3b80 1 --2- 172.21.15.82:0/699447578 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f71154c40 0x564f711550a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:33.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.850+0000 7ff18e4c3b80 1 --2- 172.21.15.82:0/699447578 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564f7115a380 0x564f7115a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:33.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.850+0000 7ff18e4c3b80 1 --2- 172.21.15.82:0/699447578 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564f7115aca0 0x564f71154700 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:33.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.850+0000 7ff18e4c3b80 1 -- 172.21.15.82:0/699447578 >> 172.21.15.82:0/699447578 conn(0x564f710c90e0 msgr2=0x564f7114f410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:29:33.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.851+0000 7ff18e4c3b80 1 -- 172.21.15.82:0/699447578 shutdown_connections 2023-09-23T09:29:33.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.851+0000 7ff18e4c3b80 1 -- 172.21.15.82:0/699447578 wait complete. 2023-09-23T09:29:33.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.852+0000 7ff18e4c3b80 1 -- start start 2023-09-23T09:29:33.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.852+0000 7ff18e4c3b80 1 Processor -- start 2023-09-23T09:29:33.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.853+0000 7ff18e4c3b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564f71154c40 0x564f71160c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:33.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.853+0000 7ff18e4c3b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f7115a380 0x564f7115dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:33.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.853+0000 7ff18e4c3b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564f7115aca0 0x564f7115e620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:33.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.853+0000 7ff18e4c3b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f710a6990 con 0x564f7115a380 2023-09-23T09:29:33.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.853+0000 7ff18e4c3b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f71044bb0 con 0x564f71154c40 2023-09-23T09:29:33.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.853+0000 7ff18e4c3b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f710448b0 con 0x564f7115aca0 2023-09-23T09:29:33.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.853+0000 7ff18e4c3b80 10 client.0 _ll_register_callbacks cb 0x564f70f8ea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:29:33.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.853+0000 7ff17899b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564f71154c40 0x564f71160c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:33.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.854+0000 7ff17899b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564f71154c40 0x564f71160c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:47338/0 (socket says 172.21.15.82:47338) 2023-09-23T09:29:33.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.854+0000 7ff17899b700 1 -- 172.21.15.82:0/109065577 learned_addr learned my addr 172.21.15.82:0/109065577 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:29:33.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.854+0000 7ff173fff700 1 --2- 172.21.15.82:0/109065577 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f7115a380 0x564f7115dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:33.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.854+0000 7ff17919c700 1 --2- 172.21.15.82:0/109065577 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564f7115aca0 0x564f7115e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:33.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.854+0000 7ff17899b700 1 -- 172.21.15.82:0/109065577 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564f7115aca0 msgr2=0x564f7115e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:29:33.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.854+0000 7ff17899b700 1 --2- 172.21.15.82:0/109065577 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564f7115aca0 0x564f7115e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:33.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.854+0000 7ff17899b700 1 -- 172.21.15.82:0/109065577 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f7115a380 msgr2=0x564f7115dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:29:33.858 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.854+0000 7ff17899b700 1 --2- 172.21.15.82:0/109065577 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f7115a380 0x564f7115dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:33.858 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.854+0000 7ff17899b700 1 -- 172.21.15.82:0/109065577 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff17410e060 con 0x564f71154c40 2023-09-23T09:29:33.858 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.855+0000 7ff17899b700 1 --2- 172.21.15.82:0/109065577 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564f71154c40 0x564f71160c60 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff16c0b1270 tx=0x7ff16c0df8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a937fdd81117a334 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:29:33.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.858+0000 7ff153fff700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-09-23T09:29:33.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.858+0000 7ff153fff700 1 -- 172.21.15.82:0/109065577 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff16c0a94d0 con 0x564f71154c40 2023-09-23T09:29:33.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.858+0000 7ff153fff700 1 -- 172.21.15.82:0/109065577 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(141..141 src has 1..141) v4 ==== 8513+0+0 (secure 0 0 0) 0x7ff16c094050 con 0x564f71154c40 2023-09-23T09:29:33.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.858+0000 7ff18e4c3b80 1 -- 172.21.15.82:0/109065577 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564f711241c0 con 0x564f71154c40 2023-09-23T09:29:33.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.858+0000 7ff153fff700 1 -- 172.21.15.82:0/109065577 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff16c0a92f0 con 0x564f71154c40 2023-09-23T09:29:33.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.859+0000 7ff18e4c3b80 10 client.27146 fetch_fsmap learned FSMap version 92 2023-09-23T09:29:33.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.859+0000 7ff18e4c3b80 1 -- 172.21.15.82:0/109065577 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=92,monmap=4+}) v3 -- 0x7ff1740738b0 con 0x564f71154c40 2023-09-23T09:29:33.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.859+0000 7ff153fff700 1 -- 172.21.15.82:0/109065577 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x564f711241c0 con 0x564f71154c40 2023-09-23T09:29:33.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.859+0000 7ff153fff700 1 -- 172.21.15.82:0/109065577 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 92) v1 ==== 7934+0+0 (secure 0 0 0) 0x7ff16c0a60a0 con 0x564f71154c40 2023-09-23T09:29:33.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.860+0000 7ff18e4c3b80 10 client.27146 fetch_fsmap finished waiting for FSMap version 92 2023-09-23T09:29:33.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.860+0000 7ff18e4c3b80 10 client.27146 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:29:33.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.860+0000 7ff18e4c3b80 20 client.27146 populate_metadata read hostname 'smithi082' 2023-09-23T09:29:33.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.860+0000 7ff18e4c3b80 1 --2- 172.21.15.82:0/109065577 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x564f7116e2b0 0x564f711706d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:33.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.861+0000 7ff18e4c3b80 4 client.27146 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:29:33.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.861+0000 7ff18e4c3b80 1 -- 172.21.15.82:0/109065577 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564f7104cba0 con 0x564f7116e2b0 2023-09-23T09:29:33.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.862+0000 7ff173fff700 1 --2- 172.21.15.82:0/109065577 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x564f7116e2b0 0x564f711706d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:33.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.864+0000 7ff173fff700 1 --2- 172.21.15.82:0/109065577 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x564f7116e2b0 0x564f711706d0 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54e63e265c5d0850 server_cookie=362013308f181856 in_seq=0 out_seq=0 2023-09-23T09:29:33.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.864+0000 7ff153fff700 10 client.27146 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:29:33.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.865+0000 7ff153fff700 1 -- 172.21.15.82:0/109065577 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x564f7104cba0 con 0x564f7116e2b0 2023-09-23T09:29:33.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.865+0000 7ff153fff700 10 client.27146 handle_command_reply: tid=0 2023-09-23T09:29:33.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.868+0000 7ff18e4c3b80 1 client.27146 shutdown 2023-09-23T09:29:33.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.874+0000 7ff18e4c3b80 1 -- 172.21.15.82:0/109065577 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564f71154c40 msgr2=0x564f71160c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:29:33.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.874+0000 7ff18e4c3b80 1 --2- 172.21.15.82:0/109065577 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564f71154c40 0x564f71160c60 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff16c0b1270 tx=0x7ff16c0df8f0 comp rx=0 tx=0).stop 2023-09-23T09:29:33.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.874+0000 7ff18e4c3b80 1 -- 172.21.15.82:0/109065577 shutdown_connections 2023-09-23T09:29:33.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.874+0000 7ff18e4c3b80 1 --2- 172.21.15.82:0/109065577 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564f7115aca0 0x564f7115e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:33.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.874+0000 7ff18e4c3b80 1 --2- 172.21.15.82:0/109065577 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564f71154c40 0x564f71160c60 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:33.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.874+0000 7ff18e4c3b80 1 --2- 172.21.15.82:0/109065577 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x564f7116e2b0 0x564f711706d0 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:33.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.874+0000 7ff18e4c3b80 1 --2- 172.21.15.82:0/109065577 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f7115a380 0x564f7115dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:33.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.874+0000 7ff18e4c3b80 1 -- 172.21.15.82:0/109065577 >> 172.21.15.82:0/109065577 conn(0x564f710c90e0 msgr2=0x564f71149b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:29:33.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.874+0000 7ff153fff700 0 client.27146 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:29:33.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.876+0000 7ff18e4c3b80 1 -- 172.21.15.82:0/109065577 shutdown_connections 2023-09-23T09:29:33.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.876+0000 7ff18e4c3b80 1 -- 172.21.15.82:0/109065577 wait complete. 2023-09-23T09:29:33.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.878+0000 7ff18e4c3b80 20 client.27146 trim_cache size 0 max 16384 2023-09-23T09:29:33.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.919+0000 7ff18e4c3b80 1 Processor -- start 2023-09-23T09:29:33.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.922+0000 7ff18e4c3b80 1 -- start start 2023-09-23T09:29:33.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.923+0000 7ff18e4c3b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564f71154c40 0x564f7115d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:33.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.923+0000 7ff18e4c3b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f7115a380 0x564f711702c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:33.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.923+0000 7ff18e4c3b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564f7115aca0 0x564f71160800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:33.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.923+0000 7ff18e4c3b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f70f28920 con 0x564f7115a380 2023-09-23T09:29:33.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.923+0000 7ff18e4c3b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f7115ee90 con 0x564f71154c40 2023-09-23T09:29:33.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.923+0000 7ff18e4c3b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f71150df0 con 0x564f7115aca0 2023-09-23T09:29:33.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.923+0000 7ff17899b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564f71154c40 0x564f7115d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:33.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.923+0000 7ff17899b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564f71154c40 0x564f7115d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:47354/0 (socket says 172.21.15.82:47354) 2023-09-23T09:29:33.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.923+0000 7ff17899b700 1 -- 172.21.15.82:0/4066086308 learned_addr learned my addr 172.21.15.82:0/4066086308 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:29:33.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.924+0000 7ff17919c700 1 --2- 172.21.15.82:0/4066086308 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564f7115aca0 0x564f71160800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:33.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.924+0000 7ff17899b700 1 -- 172.21.15.82:0/4066086308 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564f7115aca0 msgr2=0x564f71160800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:29:33.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.924+0000 7ff17899b700 1 --2- 172.21.15.82:0/4066086308 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564f7115aca0 0x564f71160800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:33.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.924+0000 7ff17899b700 1 -- 172.21.15.82:0/4066086308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f7115a380 msgr2=0x564f711702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:29:33.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.924+0000 7ff17899b700 1 --2- 172.21.15.82:0/4066086308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f7115a380 0x564f711702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:33.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.924+0000 7ff17899b700 1 -- 172.21.15.82:0/4066086308 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564f71175310 con 0x564f71154c40 2023-09-23T09:29:33.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.925+0000 7ff17899b700 1 --2- 172.21.15.82:0/4066086308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564f71154c40 0x564f7115d7f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff16c018890 tx=0x7ff16c0a7f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a20fb41ce1c7811 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:29:33.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.925+0000 7ff15b7fe700 1 -- 172.21.15.82:0/4066086308 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff16c0a92f0 con 0x564f71154c40 2023-09-23T09:29:33.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.925+0000 7ff15b7fe700 1 -- 172.21.15.82:0/4066086308 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff16c0a94d0 con 0x564f71154c40 2023-09-23T09:29:33.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.925+0000 7ff15b7fe700 1 -- 172.21.15.82:0/4066086308 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff16c0aa090 con 0x564f71154c40 2023-09-23T09:29:33.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.926+0000 7ff18e4c3b80 1 -- 172.21.15.82:0/4066086308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564f71154c40 msgr2=0x564f7115d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:29:33.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.926+0000 7ff18e4c3b80 1 --2- 172.21.15.82:0/4066086308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564f71154c40 0x564f7115d7f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff16c018890 tx=0x7ff16c0a7f40 comp rx=0 tx=0).stop 2023-09-23T09:29:33.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.927+0000 7ff18e4c3b80 1 -- 172.21.15.82:0/4066086308 shutdown_connections 2023-09-23T09:29:33.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.927+0000 7ff18e4c3b80 1 --2- 172.21.15.82:0/4066086308 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564f7115aca0 0x564f71160800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:33.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.927+0000 7ff18e4c3b80 1 --2- 172.21.15.82:0/4066086308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564f71154c40 0x564f7115d7f0 secure :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff16c018890 tx=0x7ff16c0a7f40 comp rx=0 tx=0).stop 2023-09-23T09:29:33.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.927+0000 7ff18e4c3b80 1 --2- 172.21.15.82:0/4066086308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f7115a380 0x564f711702c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:33.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.927+0000 7ff18e4c3b80 1 -- 172.21.15.82:0/4066086308 >> 172.21.15.82:0/4066086308 conn(0x564f710c90e0 msgr2=0x564f7114f0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:29:33.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.939+0000 7ff18e4c3b80 1 -- 172.21.15.82:0/4066086308 shutdown_connections 2023-09-23T09:29:33.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.942+0000 7ff18e4c3b80 1 -- 172.21.15.82:0/4066086308 wait complete. 2023-09-23T09:29:33.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.942+0000 7ff18e4c3b80 1 -- start start 2023-09-23T09:29:33.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.943+0000 7ff18e4c3b80 1 Processor -- start 2023-09-23T09:29:33.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.944+0000 7ff18e4c3b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564f7115a380 0x564f71155da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:33.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.944+0000 7ff18e4c3b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564f7115aca0 0x564f711562e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:33.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.944+0000 7ff18e4c3b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f71156820 0x564f71156ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:33.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.944+0000 7ff18e4c3b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f711571e0 con 0x564f71156820 2023-09-23T09:29:33.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.944+0000 7ff18e4c3b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f71157320 con 0x564f7115a380 2023-09-23T09:29:33.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.944+0000 7ff18e4c3b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f711574e0 con 0x564f7115aca0 2023-09-23T09:29:33.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.944+0000 7ff18e4c3b80 10 client.0 _ll_register_callbacks cb 0x7ff164009740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:29:33.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.944+0000 7ff17899b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564f7115a380 0x564f71155da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:33.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.944+0000 7ff17899b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564f7115a380 0x564f71155da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:47364/0 (socket says 172.21.15.82:47364) 2023-09-23T09:29:33.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.944+0000 7ff17899b700 1 -- 172.21.15.82:0/1431637944 learned_addr learned my addr 172.21.15.82:0/1431637944 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:29:33.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.944+0000 7ff173fff700 1 --2- 172.21.15.82:0/1431637944 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564f7115aca0 0x564f711562e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:33.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.945+0000 7ff17919c700 1 --2- 172.21.15.82:0/1431637944 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f71156820 0x564f71156ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:33.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.945+0000 7ff17899b700 1 -- 172.21.15.82:0/1431637944 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564f7115aca0 msgr2=0x564f711562e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:29:33.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.945+0000 7ff17899b700 1 --2- 172.21.15.82:0/1431637944 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564f7115aca0 0x564f711562e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:33.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.945+0000 7ff17899b700 1 -- 172.21.15.82:0/1431637944 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f71156820 msgr2=0x564f71156ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:29:33.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.945+0000 7ff17899b700 1 --2- 172.21.15.82:0/1431637944 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f71156820 0x564f71156ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:33.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.945+0000 7ff17899b700 1 -- 172.21.15.82:0/1431637944 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1740738b0 con 0x564f7115a380 2023-09-23T09:29:33.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.945+0000 7ff17919c700 1 --2- 172.21.15.82:0/1431637944 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f71156820 0x564f71156ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:29:33.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.945+0000 7ff173fff700 1 --2- 172.21.15.82:0/1431637944 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564f7115aca0 0x564f711562e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:29:33.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.945+0000 7ff17899b700 1 --2- 172.21.15.82:0/1431637944 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564f7115a380 0x564f71155da0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff16c018930 tx=0x7ff16c0225c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=958bf6edd9d38fbd server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:29:33.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.945+0000 7ff153fff700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-09-23T09:29:33.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.946+0000 7ff153fff700 1 -- 172.21.15.82:0/1431637944 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff16c0a92f0 con 0x564f7115a380 2023-09-23T09:29:33.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.946+0000 7ff153fff700 1 -- 172.21.15.82:0/1431637944 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(141..141 src has 1..141) v4 ==== 8513+0+0 (secure 0 0 0) 0x7ff16c094070 con 0x564f7115a380 2023-09-23T09:29:33.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.946+0000 7ff18e4c3b80 1 -- 172.21.15.82:0/1431637944 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564f711478b0 con 0x564f7115a380 2023-09-23T09:29:33.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.946+0000 7ff153fff700 1 -- 172.21.15.82:0/1431637944 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff16c0a9760 con 0x564f7115a380 2023-09-23T09:29:33.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.946+0000 7ff18e4c3b80 10 client.27152 fetch_fsmap learned FSMap version 92 2023-09-23T09:29:33.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.946+0000 7ff18e4c3b80 1 -- 172.21.15.82:0/1431637944 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=92,monmap=4+}) v3 -- 0x564f70ed2de0 con 0x564f7115a380 2023-09-23T09:29:33.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.947+0000 7ff153fff700 1 -- 172.21.15.82:0/1431637944 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x564f711478b0 con 0x564f7115a380 2023-09-23T09:29:33.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.947+0000 7ff153fff700 1 -- 172.21.15.82:0/1431637944 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 92) v1 ==== 7934+0+0 (secure 0 0 0) 0x7ff16c0a8e80 con 0x564f7115a380 2023-09-23T09:29:33.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.947+0000 7ff18e4c3b80 10 client.27152 fetch_fsmap finished waiting for FSMap version 92 2023-09-23T09:29:33.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.947+0000 7ff18e4c3b80 10 client.27152 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:29:33.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.947+0000 7ff18e4c3b80 20 client.27152 populate_metadata read hostname 'smithi082' 2023-09-23T09:29:33.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.947+0000 7ff18e4c3b80 1 --2- 172.21.15.82:0/1431637944 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x564f711c2ad0 0x564f711c4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:29:33.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.948+0000 7ff18e4c3b80 4 client.27152 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:29:33.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.948+0000 7ff18e4c3b80 1 -- 172.21.15.82:0/1431637944 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x564f7109f970 con 0x564f711c2ad0 2023-09-23T09:29:33.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.948+0000 7ff173fff700 1 --2- 172.21.15.82:0/1431637944 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x564f711c2ad0 0x564f711c4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:29:33.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.949+0000 7ff153fff700 10 client.27152 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:29:33.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.949+0000 7ff173fff700 1 --2- 172.21.15.82:0/1431637944 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x564f711c2ad0 0x564f711c4ec0 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a58f623a3abef16 server_cookie=9f5dc0480a811d79 in_seq=0 out_seq=0 2023-09-23T09:29:33.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.949+0000 7ff153fff700 1 -- 172.21.15.82:0/1431637944 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x564f7109f970 con 0x564f711c2ad0 2023-09-23T09:29:33.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.949+0000 7ff153fff700 10 client.27152 handle_command_reply: tid=0 2023-09-23T09:29:33.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.949+0000 7ff18e4c3b80 1 client.27152 shutdown 2023-09-23T09:29:33.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.949+0000 7ff18e4c3b80 1 -- 172.21.15.82:0/1431637944 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564f7115a380 msgr2=0x564f71155da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:29:33.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.949+0000 7ff18e4c3b80 1 --2- 172.21.15.82:0/1431637944 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564f7115a380 0x564f71155da0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff16c018930 tx=0x7ff16c0225c0 comp rx=0 tx=0).stop 2023-09-23T09:29:33.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.949+0000 7ff18e4c3b80 1 -- 172.21.15.82:0/1431637944 shutdown_connections 2023-09-23T09:29:33.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.949+0000 7ff18e4c3b80 1 --2- 172.21.15.82:0/1431637944 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x564f711c2ad0 0x564f711c4ec0 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:33.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.950+0000 7ff18e4c3b80 1 --2- 172.21.15.82:0/1431637944 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f71156820 0x564f71156ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:33.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.950+0000 7ff18e4c3b80 1 --2- 172.21.15.82:0/1431637944 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564f7115a380 0x564f71155da0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:33.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.950+0000 7ff18e4c3b80 1 --2- 172.21.15.82:0/1431637944 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564f7115aca0 0x564f711562e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:33.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.950+0000 7ff18e4c3b80 1 -- 172.21.15.82:0/1431637944 >> 172.21.15.82:0/1431637944 conn(0x564f710c90e0 msgr2=0x564f711702c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:29:33.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.950+0000 7ff153fff700 0 client.27152 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:29:33.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.950+0000 7ff18e4c3b80 1 -- 172.21.15.82:0/1431637944 shutdown_connections 2023-09-23T09:29:33.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.950+0000 7ff18e4c3b80 1 -- 172.21.15.82:0/1431637944 wait complete. 2023-09-23T09:29:33.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.950+0000 7ff18e4c3b80 20 client.27152 trim_cache size 0 max 16384 2023-09-23T09:29:33.954 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:29:33.955 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "IDLE (waiting for more scrubs)", 2023-09-23T09:29:33.955 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:29:33.955 INFO:teuthology.orchestra.run.smithi082.stdout: "dd4891a0-2d94-4f10-a6c1-dd165ffd5e79": { 2023-09-23T09:29:33.955 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:29:33.955 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "dd4891a0-2d94-4f10-a6c1-dd165ffd5e79", 2023-09-23T09:29:33.955 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:29:33.955 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:29:33.955 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:29:33.955 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:29:33.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.952+0000 7ff17abff700 1 -- 172.21.15.82:0/2228435437 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7ff15c0a0200 msgr2=0x7ff15c0a26c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:29:33.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.952+0000 7ff17abff700 1 --2- 172.21.15.82:0/2228435437 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7ff15c0a0200 0x7ff15c0a26c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff168005950 tx=0x7ff16800b390 comp rx=0 tx=0).stop 2023-09-23T09:29:33.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.952+0000 7ff17abff700 1 -- 172.21.15.82:0/2228435437 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff174100890 msgr2=0x7ff17410cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:29:33.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.952+0000 7ff17abff700 1 --2- 172.21.15.82:0/2228435437 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff174100890 0x7ff17410cca0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff16c01d0c0 tx=0x7ff16c01d3d0 comp rx=0 tx=0).stop 2023-09-23T09:29:33.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.952+0000 7ff17abff700 1 -- 172.21.15.82:0/2228435437 shutdown_connections 2023-09-23T09:29:33.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.952+0000 7ff17abff700 1 --2- 172.21.15.82:0/2228435437 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7ff15c0a0200 0x7ff15c0a26c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:33.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.952+0000 7ff17abff700 1 --2- 172.21.15.82:0/2228435437 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff1741068a0 0x7ff17410d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:33.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.952+0000 7ff17abff700 1 --2- 172.21.15.82:0/2228435437 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff174100890 0x7ff17410cca0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:33.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.952+0000 7ff17abff700 1 --2- 172.21.15.82:0/2228435437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff174101250 0x7ff17410d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:29:33.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.952+0000 7ff17abff700 1 -- 172.21.15.82:0/2228435437 >> 172.21.15.82:0/2228435437 conn(0x7ff1740fc380 msgr2=0x7ff1740fcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:29:33.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.953+0000 7ff17abff700 1 -- 172.21.15.82:0/2228435437 shutdown_connections 2023-09-23T09:29:33.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:29:33.953+0000 7ff17abff700 1 -- 172.21.15.82:0/2228435437 wait complete. 2023-09-23T09:29:33.988 INFO:tasks.cephfs.filesystem:scrub status for tag:dd4891a0-2d94-4f10-a6c1-dd165ffd5e79 - {'path': '/', 'tag': 'dd4891a0-2d94-4f10-a6c1-dd165ffd5e79', 'options': 'recursive,force'} 2023-09-23T09:29:35.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:29:34 smithi135 ceph-mon[99205]: scrub queued for path: / 2023-09-23T09:29:35.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:29:34 smithi135 ceph-mon[99205]: scrub summary: idle+waiting paths [/] 2023-09-23T09:29:35.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:29:34 smithi135 ceph-mon[99205]: scrub summary: active paths [/] 2023-09-23T09:29:35.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:29:34 smithi135 ceph-mon[99205]: scrub summary: active paths [/] 2023-09-23T09:29:35.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:29:34 smithi135 ceph-mon[99205]: scrub summary: active paths [/] 2023-09-23T09:29:35.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:29:34 smithi135 ceph-mon[99205]: scrub summary: idle+waiting paths [/] 2023-09-23T09:29:35.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:29:34 smithi135 ceph-mon[99205]: scrub summary: active paths [/] 2023-09-23T09:29:35.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:29:34 smithi135 ceph-mon[99205]: scrub summary: active paths [/] 2023-09-23T09:29:35.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:29:34 smithi135 ceph-mon[99205]: scrub summary: active paths [/] 2023-09-23T09:29:35.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:29:34 smithi135 ceph-mon[99205]: scrub summary: idle+waiting paths [/] 2023-09-23T09:29:35.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:29:34 smithi135 ceph-mon[99205]: scrub summary: idle+waiting paths [/] 2023-09-23T09:29:35.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:29:34 smithi135 ceph-mon[99205]: scrub summary: active paths [/] 2023-09-23T09:29:35.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:29:34 smithi135 ceph-mon[99205]: scrub summary: idle+waiting paths [/] 2023-09-23T09:29:35.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:29:34 smithi135 ceph-mon[99205]: scrub summary: idle+waiting paths [/] 2023-09-23T09:29:35.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:29:34 smithi135 ceph-mon[99205]: scrub summary: idle+waiting paths [/] 2023-09-23T09:29:35.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:29:34 smithi135 ceph-mon[99205]: pgmap v1035: 97 pgs: 97 active+clean; 16 GiB data, 54 GiB used, 1019 GiB / 1.0 TiB avail; 1014 KiB/s rd, 13 MiB/s wr, 1.01k op/s 2023-09-23T09:29:35.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:29:34 smithi135 ceph-mon[99205]: scrub summary: idle+waiting paths [/] 2023-09-23T09:29:35.124 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:29:34 smithi082 ceph-mon[97694]: scrub queued for path: / 2023-09-23T09:29:35.124 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:29:34 smithi082 ceph-mon[97694]: scrub summary: idle+waiting paths [/] 2023-09-23T09:29:35.124 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:29:34 smithi082 ceph-mon[97694]: scrub summary: active paths [/] 2023-09-23T09:29:35.124 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:29:34 smithi082 ceph-mon[97694]: scrub summary: active paths [/] 2023-09-23T09:29:35.124 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:29:34 smithi082 ceph-mon[97694]: scrub summary: active paths [/] 2023-09-23T09:29:35.124 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:29:34 smithi082 ceph-mon[97694]: scrub summary: idle+waiting paths [/] 2023-09-23T09:29:35.124 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:29:34 smithi082 ceph-mon[97694]: scrub summary: active paths [/] 2023-09-23T09:29:35.124 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:29:34 smithi082 ceph-mon[97694]: scrub summary: active paths [/] 2023-09-23T09:29:35.125 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:29:34 smithi082 ceph-mon[97694]: scrub summary: active paths [/] 2023-09-23T09:29:35.125 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:29:34 smithi082 ceph-mon[97694]: scrub summary: idle+waiting paths [/] 2023-09-23T09:29:35.125 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:29:34 smithi082 ceph-mon[97694]: scrub summary: idle+waiting paths [/] 2023-09-23T09:29:35.125 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:29:34 smithi082 ceph-mon[97694]: scrub summary: active paths [/] 2023-09-23T09:29:35.125 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:29:34 smithi082 ceph-mon[97694]: scrub summary: idle+waiting paths [/] 2023-09-23T09:29:35.125 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:29:34 smithi082 ceph-mon[97694]: scrub summary: idle+waiting paths [/] 2023-09-23T09:29:35.125 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:29:34 smithi082 ceph-mon[97694]: scrub summary: idle+waiting paths [/] 2023-09-23T09:29:35.125 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:29:34 smithi082 ceph-mon[97694]: pgmap v1035: 97 pgs: 97 active+clean; 16 GiB data, 54 GiB used, 1019 GiB / 1.0 TiB avail; 1014 KiB/s rd, 13 MiB/s wr, 1.01k op/s 2023-09-23T09:29:35.125 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:29:34 smithi082 ceph-mon[97694]: scrub summary: idle+waiting paths [/] 2023-09-23T09:29:35.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:29:34 smithi161 ceph-mon[99580]: scrub queued for path: / 2023-09-23T09:29:35.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:29:34 smithi161 ceph-mon[99580]: scrub summary: idle+waiting paths [/] 2023-09-23T09:29:35.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:29:34 smithi161 ceph-mon[99580]: scrub summary: active paths [/] 2023-09-23T09:29:35.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:29:34 smithi161 ceph-mon[99580]: scrub summary: active paths [/] 2023-09-23T09:29:35.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:29:34 smithi161 ceph-mon[99580]: scrub summary: active paths [/] 2023-09-23T09:29:35.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:29:34 smithi161 ceph-mon[99580]: scrub summary: idle+waiting paths [/] 2023-09-23T09:29:35.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:29:34 smithi161 ceph-mon[99580]: scrub summary: active paths [/] 2023-09-23T09:29:35.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:29:34 smithi161 ceph-mon[99580]: scrub summary: active paths [/] 2023-09-23T09:29:35.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:29:34 smithi161 ceph-mon[99580]: scrub summary: active paths [/] 2023-09-23T09:29:35.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:29:34 smithi161 ceph-mon[99580]: scrub summary: idle+waiting paths [/] 2023-09-23T09:29:35.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:29:34 smithi161 ceph-mon[99580]: scrub summary: idle+waiting paths [/] 2023-09-23T09:29:35.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:29:34 smithi161 ceph-mon[99580]: scrub summary: active paths [/] 2023-09-23T09:29:35.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:29:34 smithi161 ceph-mon[99580]: scrub summary: idle+waiting paths [/] 2023-09-23T09:29:35.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:29:34 smithi161 ceph-mon[99580]: scrub summary: idle+waiting paths [/] 2023-09-23T09:29:35.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:29:34 smithi161 ceph-mon[99580]: scrub summary: idle+waiting paths [/] 2023-09-23T09:29:35.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:29:34 smithi161 ceph-mon[99580]: pgmap v1035: 97 pgs: 97 active+clean; 16 GiB data, 54 GiB used, 1019 GiB / 1.0 TiB avail; 1014 KiB/s rd, 13 MiB/s wr, 1.01k op/s 2023-09-23T09:29:35.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:29:34 smithi161 ceph-mon[99580]: scrub summary: idle+waiting paths [/] 2023-09-23T09:29:35.828 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 145.0 s, 503.2 tps, lat 196.412 ms stddev 57.648 2023-09-23T09:29:37.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:29:36 smithi135 ceph-mon[99205]: pgmap v1036: 97 pgs: 97 active+clean; 16 GiB data, 55 GiB used, 1018 GiB / 1.0 TiB avail; 1.6 MiB/s rd, 20 MiB/s wr, 1.57k op/s 2023-09-23T09:29:37.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:29:36 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:29:37.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:29:36 smithi082 ceph-mon[97694]: pgmap v1036: 97 pgs: 97 active+clean; 16 GiB data, 55 GiB used, 1018 GiB / 1.0 TiB avail; 1.6 MiB/s rd, 20 MiB/s wr, 1.57k op/s 2023-09-23T09:29:37.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:29:36 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:29:37.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:29:36 smithi161 ceph-mon[99580]: pgmap v1036: 97 pgs: 97 active+clean; 16 GiB data, 55 GiB used, 1018 GiB / 1.0 TiB avail; 1.6 MiB/s rd, 20 MiB/s wr, 1.57k op/s 2023-09-23T09:29:37.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:29:36 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:29:38.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:29:37 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:29:38.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:29:37 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:29:38.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:29:37 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:29:39.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:29:38 smithi135 ceph-mon[99205]: pgmap v1037: 97 pgs: 97 active+clean; 16 GiB data, 55 GiB used, 1018 GiB / 1.0 TiB avail; 1.2 MiB/s rd, 13 MiB/s wr, 1.06k op/s 2023-09-23T09:29:39.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:29:38 smithi082 ceph-mon[97694]: pgmap v1037: 97 pgs: 97 active+clean; 16 GiB data, 55 GiB used, 1018 GiB / 1.0 TiB avail; 1.2 MiB/s rd, 13 MiB/s wr, 1.06k op/s 2023-09-23T09:29:39.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:29:38 smithi161 ceph-mon[99580]: pgmap v1037: 97 pgs: 97 active+clean; 16 GiB data, 55 GiB used, 1018 GiB / 1.0 TiB avail; 1.2 MiB/s rd, 13 MiB/s wr, 1.06k op/s 2023-09-23T09:29:40.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 150.0 s, 563.2 tps, lat 179.840 ms stddev 92.085 2023-09-23T09:29:41.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:29:40 smithi135 ceph-mon[99205]: pgmap v1038: 97 pgs: 97 active+clean; 16 GiB data, 55 GiB used, 1018 GiB / 1.0 TiB avail; 1.6 MiB/s rd, 20 MiB/s wr, 1.59k op/s 2023-09-23T09:29:41.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:29:40 smithi082 ceph-mon[97694]: pgmap v1038: 97 pgs: 97 active+clean; 16 GiB data, 55 GiB used, 1018 GiB / 1.0 TiB avail; 1.6 MiB/s rd, 20 MiB/s wr, 1.59k op/s 2023-09-23T09:29:41.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:29:40 smithi161 ceph-mon[99580]: pgmap v1038: 97 pgs: 97 active+clean; 16 GiB data, 55 GiB used, 1018 GiB / 1.0 TiB avail; 1.6 MiB/s rd, 20 MiB/s wr, 1.59k op/s 2023-09-23T09:29:43.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:29:42 smithi135 ceph-mon[99205]: pgmap v1039: 97 pgs: 97 active+clean; 16 GiB data, 55 GiB used, 1018 GiB / 1.0 TiB avail; 1.1 MiB/s rd, 15 MiB/s wr, 1.24k op/s 2023-09-23T09:29:43.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:29:42 smithi082 ceph-mon[97694]: pgmap v1039: 97 pgs: 97 active+clean; 16 GiB data, 55 GiB used, 1018 GiB / 1.0 TiB avail; 1.1 MiB/s rd, 15 MiB/s wr, 1.24k op/s 2023-09-23T09:29:43.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:29:42 smithi161 ceph-mon[99580]: pgmap v1039: 97 pgs: 97 active+clean; 16 GiB data, 55 GiB used, 1018 GiB / 1.0 TiB avail; 1.1 MiB/s rd, 15 MiB/s wr, 1.24k op/s 2023-09-23T09:29:45.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:29:44 smithi135 ceph-mon[99205]: pgmap v1040: 97 pgs: 97 active+clean; 16 GiB data, 55 GiB used, 1018 GiB / 1.0 TiB avail; 1.0 MiB/s rd, 14 MiB/s wr, 1.17k op/s 2023-09-23T09:29:45.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:29:44 smithi082 ceph-mon[97694]: pgmap v1040: 97 pgs: 97 active+clean; 16 GiB data, 55 GiB used, 1018 GiB / 1.0 TiB avail; 1.0 MiB/s rd, 14 MiB/s wr, 1.17k op/s 2023-09-23T09:29:45.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:29:44 smithi161 ceph-mon[99580]: pgmap v1040: 97 pgs: 97 active+clean; 16 GiB data, 55 GiB used, 1018 GiB / 1.0 TiB avail; 1.0 MiB/s rd, 14 MiB/s wr, 1.17k op/s 2023-09-23T09:29:45.827 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 155.0 s, 702.9 tps, lat 143.876 ms stddev 45.498 2023-09-23T09:29:47.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:29:46 smithi135 ceph-mon[99205]: pgmap v1041: 97 pgs: 97 active+clean; 16 GiB data, 55 GiB used, 1018 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 22 MiB/s wr, 1.69k op/s 2023-09-23T09:29:47.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:29:46 smithi135 ceph-mon[99205]: scrub summary: idle 2023-09-23T09:29:47.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:29:46 smithi135 ceph-mon[99205]: scrub summary: idle 2023-09-23T09:29:47.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:29:46 smithi135 ceph-mon[99205]: scrub summary: idle 2023-09-23T09:29:47.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:29:46 smithi135 ceph-mon[99205]: scrub summary: idle 2023-09-23T09:29:47.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:29:46 smithi082 ceph-mon[97694]: pgmap v1041: 97 pgs: 97 active+clean; 16 GiB data, 55 GiB used, 1018 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 22 MiB/s wr, 1.69k op/s 2023-09-23T09:29:47.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:29:46 smithi082 ceph-mon[97694]: scrub summary: idle 2023-09-23T09:29:47.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:29:46 smithi082 ceph-mon[97694]: scrub summary: idle 2023-09-23T09:29:47.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:29:46 smithi082 ceph-mon[97694]: scrub summary: idle 2023-09-23T09:29:47.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:29:46 smithi082 ceph-mon[97694]: scrub summary: idle 2023-09-23T09:29:47.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:29:46 smithi161 ceph-mon[99580]: pgmap v1041: 97 pgs: 97 active+clean; 16 GiB data, 55 GiB used, 1018 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 22 MiB/s wr, 1.69k op/s 2023-09-23T09:29:47.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:29:46 smithi161 ceph-mon[99580]: scrub summary: idle 2023-09-23T09:29:47.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:29:46 smithi161 ceph-mon[99580]: scrub summary: idle 2023-09-23T09:29:47.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:29:46 smithi161 ceph-mon[99580]: scrub summary: idle 2023-09-23T09:29:47.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:29:46 smithi161 ceph-mon[99580]: scrub summary: idle 2023-09-23T09:29:48.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:29:47 smithi135 ceph-mon[99205]: scrub summary: idle 2023-09-23T09:29:48.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:29:47 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:29:48.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:29:47 smithi082 ceph-mon[97694]: scrub summary: idle 2023-09-23T09:29:48.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:29:47 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:29:48.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:29:47 smithi161 ceph-mon[99580]: scrub summary: idle 2023-09-23T09:29:48.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:29:47 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:29:49.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:29:48 smithi135 ceph-mon[99205]: pgmap v1042: 97 pgs: 97 active+clean; 16 GiB data, 55 GiB used, 1018 GiB / 1.0 TiB avail; 1.1 MiB/s rd, 15 MiB/s wr, 1.13k op/s 2023-09-23T09:29:49.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:29:48 smithi082 ceph-mon[97694]: pgmap v1042: 97 pgs: 97 active+clean; 16 GiB data, 55 GiB used, 1018 GiB / 1.0 TiB avail; 1.1 MiB/s rd, 15 MiB/s wr, 1.13k op/s 2023-09-23T09:29:49.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:29:48 smithi161 ceph-mon[99580]: pgmap v1042: 97 pgs: 97 active+clean; 16 GiB data, 55 GiB used, 1018 GiB / 1.0 TiB avail; 1.1 MiB/s rd, 15 MiB/s wr, 1.13k op/s 2023-09-23T09:29:50.827 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 160.0 s, 556.8 tps, lat 174.797 ms stddev 336.816 2023-09-23T09:29:51.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:29:50 smithi135 ceph-mon[99205]: pgmap v1043: 97 pgs: 97 active+clean; 16 GiB data, 55 GiB used, 1017 GiB / 1.0 TiB avail; 1.5 MiB/s rd, 22 MiB/s wr, 1.62k op/s 2023-09-23T09:29:51.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:29:50 smithi082 ceph-mon[97694]: pgmap v1043: 97 pgs: 97 active+clean; 16 GiB data, 55 GiB used, 1017 GiB / 1.0 TiB avail; 1.5 MiB/s rd, 22 MiB/s wr, 1.62k op/s 2023-09-23T09:29:51.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:29:50 smithi161 ceph-mon[99580]: pgmap v1043: 97 pgs: 97 active+clean; 16 GiB data, 55 GiB used, 1017 GiB / 1.0 TiB avail; 1.5 MiB/s rd, 22 MiB/s wr, 1.62k op/s 2023-09-23T09:29:53.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:29:52 smithi135 ceph-mon[99205]: pgmap v1044: 97 pgs: 97 active+clean; 16 GiB data, 55 GiB used, 1017 GiB / 1.0 TiB avail; 1.2 MiB/s rd, 16 MiB/s wr, 1.16k op/s 2023-09-23T09:29:53.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:29:52 smithi082 ceph-mon[97694]: pgmap v1044: 97 pgs: 97 active+clean; 16 GiB data, 55 GiB used, 1017 GiB / 1.0 TiB avail; 1.2 MiB/s rd, 16 MiB/s wr, 1.16k op/s 2023-09-23T09:29:53.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:29:52 smithi161 ceph-mon[99580]: pgmap v1044: 97 pgs: 97 active+clean; 16 GiB data, 55 GiB used, 1017 GiB / 1.0 TiB avail; 1.2 MiB/s rd, 16 MiB/s wr, 1.16k op/s 2023-09-23T09:29:55.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:29:54 smithi135 ceph-mon[99205]: pgmap v1045: 97 pgs: 97 active+clean; 16 GiB data, 55 GiB used, 1017 GiB / 1.0 TiB avail; 1.2 MiB/s rd, 15 MiB/s wr, 1.09k op/s 2023-09-23T09:29:55.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:29:54 smithi082 ceph-mon[97694]: pgmap v1045: 97 pgs: 97 active+clean; 16 GiB data, 55 GiB used, 1017 GiB / 1.0 TiB avail; 1.2 MiB/s rd, 15 MiB/s wr, 1.09k op/s 2023-09-23T09:29:55.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:29:54 smithi161 ceph-mon[99580]: pgmap v1045: 97 pgs: 97 active+clean; 16 GiB data, 55 GiB used, 1017 GiB / 1.0 TiB avail; 1.2 MiB/s rd, 15 MiB/s wr, 1.09k op/s 2023-09-23T09:29:55.827 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 165.0 s, 597.1 tps, lat 170.982 ms stddev 119.497 2023-09-23T09:29:57.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:29:56 smithi135 ceph-mon[99205]: pgmap v1046: 97 pgs: 97 active+clean; 16 GiB data, 56 GiB used, 1017 GiB / 1.0 TiB avail; 1.8 MiB/s rd, 23 MiB/s wr, 1.62k op/s 2023-09-23T09:29:57.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:29:56 smithi082 ceph-mon[97694]: pgmap v1046: 97 pgs: 97 active+clean; 16 GiB data, 56 GiB used, 1017 GiB / 1.0 TiB avail; 1.8 MiB/s rd, 23 MiB/s wr, 1.62k op/s 2023-09-23T09:29:57.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:29:56 smithi161 ceph-mon[99580]: pgmap v1046: 97 pgs: 97 active+clean; 16 GiB data, 56 GiB used, 1017 GiB / 1.0 TiB avail; 1.8 MiB/s rd, 23 MiB/s wr, 1.62k op/s 2023-09-23T09:29:58.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:29:58 smithi135 ceph-mon[99205]: pgmap v1047: 97 pgs: 97 active+clean; 16 GiB data, 56 GiB used, 1017 GiB / 1.0 TiB avail; 1.2 MiB/s rd, 15 MiB/s wr, 1.11k op/s 2023-09-23T09:29:58.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:29:58 smithi082 ceph-mon[97694]: pgmap v1047: 97 pgs: 97 active+clean; 16 GiB data, 56 GiB used, 1017 GiB / 1.0 TiB avail; 1.2 MiB/s rd, 15 MiB/s wr, 1.11k op/s 2023-09-23T09:29:58.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:29:58 smithi161 ceph-mon[99580]: pgmap v1047: 97 pgs: 97 active+clean; 16 GiB data, 56 GiB used, 1017 GiB / 1.0 TiB avail; 1.2 MiB/s rd, 15 MiB/s wr, 1.11k op/s 2023-09-23T09:30:00.828 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 170.0 s, 303.5 tps, lat 140.326 ms stddev 158.974 2023-09-23T09:30:01.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:30:00 smithi135 ceph-mon[99205]: pgmap v1048: 97 pgs: 97 active+clean; 16 GiB data, 56 GiB used, 1017 GiB / 1.0 TiB avail; 1.6 MiB/s rd, 22 MiB/s wr, 1.53k op/s 2023-09-23T09:30:01.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:30:00 smithi135 ceph-mon[99205]: overall HEALTH_OK 2023-09-23T09:30:01.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:30:00 smithi082 ceph-mon[97694]: pgmap v1048: 97 pgs: 97 active+clean; 16 GiB data, 56 GiB used, 1017 GiB / 1.0 TiB avail; 1.6 MiB/s rd, 22 MiB/s wr, 1.53k op/s 2023-09-23T09:30:01.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:30:00 smithi082 ceph-mon[97694]: overall HEALTH_OK 2023-09-23T09:30:01.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:30:00 smithi161 ceph-mon[99580]: pgmap v1048: 97 pgs: 97 active+clean; 16 GiB data, 56 GiB used, 1017 GiB / 1.0 TiB avail; 1.6 MiB/s rd, 22 MiB/s wr, 1.53k op/s 2023-09-23T09:30:01.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:30:00 smithi161 ceph-mon[99580]: overall HEALTH_OK 2023-09-23T09:30:03.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:30:02 smithi135 ceph-mon[99205]: pgmap v1049: 97 pgs: 97 active+clean; 16 GiB data, 56 GiB used, 1017 GiB / 1.0 TiB avail; 1.2 MiB/s rd, 16 MiB/s wr, 1.10k op/s 2023-09-23T09:30:03.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:30:02 smithi082 ceph-mon[97694]: pgmap v1049: 97 pgs: 97 active+clean; 16 GiB data, 56 GiB used, 1017 GiB / 1.0 TiB avail; 1.2 MiB/s rd, 16 MiB/s wr, 1.10k op/s 2023-09-23T09:30:03.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:30:02 smithi161 ceph-mon[99580]: pgmap v1049: 97 pgs: 97 active+clean; 16 GiB data, 56 GiB used, 1017 GiB / 1.0 TiB avail; 1.2 MiB/s rd, 16 MiB/s wr, 1.10k op/s 2023-09-23T09:30:03.989 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:30:04.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.293+0000 7f41767ff700 1 -- 172.21.15.82:0/972429670 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41701068a0 msgr2=0x7f4170106c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:04.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.293+0000 7f41767ff700 1 --2- 172.21.15.82:0/972429670 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41701068a0 0x7f4170106c80 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f416000b0a0 tx=0x7f416000b3b0 comp rx=0 tx=0).stop 2023-09-23T09:30:04.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.296+0000 7f41767ff700 1 -- 172.21.15.82:0/972429670 shutdown_connections 2023-09-23T09:30:04.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.296+0000 7f41767ff700 1 --2- 172.21.15.82:0/972429670 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4170101250 0x7f417010d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:04.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.296+0000 7f41767ff700 1 --2- 172.21.15.82:0/972429670 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41701068a0 0x7f4170106c80 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:04.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.296+0000 7f41767ff700 1 --2- 172.21.15.82:0/972429670 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4170100890 0x7f4170100d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:04.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.296+0000 7f41767ff700 1 -- 172.21.15.82:0/972429670 >> 172.21.15.82:0/972429670 conn(0x7f41700fc380 msgr2=0x7f41700fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:04.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.296+0000 7f41767ff700 1 -- 172.21.15.82:0/972429670 shutdown_connections 2023-09-23T09:30:04.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.296+0000 7f41767ff700 1 -- 172.21.15.82:0/972429670 wait complete. 2023-09-23T09:30:04.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.298+0000 7f41767ff700 1 Processor -- start 2023-09-23T09:30:04.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.299+0000 7f41767ff700 1 -- start start 2023-09-23T09:30:04.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.300+0000 7f41767ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4170100890 0x7f417019e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:04.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.300+0000 7f41767ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4170101250 0x7f417019ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:04.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.300+0000 7f41767ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41701068a0 0x7f41701989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:04.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.300+0000 7f41767ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4170199020 con 0x7f41701068a0 2023-09-23T09:30:04.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.300+0000 7f41767ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4170199190 con 0x7f4170101250 2023-09-23T09:30:04.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.300+0000 7f41767ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4170199350 con 0x7f4170100890 2023-09-23T09:30:04.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.300+0000 7f416f7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4170101250 0x7f417019ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:04.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.301+0000 7f416f7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4170101250 0x7f417019ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:57474/0 (socket says 172.21.15.82:57474) 2023-09-23T09:30:04.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.301+0000 7f416f7fe700 1 -- 172.21.15.82:0/3293993656 learned_addr learned my addr 172.21.15.82:0/3293993656 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:30:04.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.301+0000 7f416ffff700 1 --2- 172.21.15.82:0/3293993656 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4170100890 0x7f417019e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:04.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.301+0000 7f4174d9c700 1 --2- 172.21.15.82:0/3293993656 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41701068a0 0x7f41701989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:04.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.302+0000 7f416ffff700 1 -- 172.21.15.82:0/3293993656 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4170101250 msgr2=0x7f417019ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:04.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.302+0000 7f416ffff700 1 --2- 172.21.15.82:0/3293993656 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4170101250 0x7f417019ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:04.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.302+0000 7f416ffff700 1 -- 172.21.15.82:0/3293993656 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41701068a0 msgr2=0x7f41701989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:04.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.302+0000 7f416ffff700 1 --2- 172.21.15.82:0/3293993656 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41701068a0 0x7f41701989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:04.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.302+0000 7f416ffff700 1 -- 172.21.15.82:0/3293993656 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4160009d00 con 0x7f4170100890 2023-09-23T09:30:04.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.302+0000 7f416ffff700 1 --2- 172.21.15.82:0/3293993656 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4170100890 0x7f417019e940 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f416000b070 tx=0x7f41600077f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:04.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.303+0000 7f416d7fa700 1 -- 172.21.15.82:0/3293993656 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f416000e040 con 0x7f4170100890 2023-09-23T09:30:04.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.303+0000 7f416d7fa700 1 -- 172.21.15.82:0/3293993656 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4160004e60 con 0x7f4170100890 2023-09-23T09:30:04.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.303+0000 7f416d7fa700 1 -- 172.21.15.82:0/3293993656 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f416001b6c0 con 0x7f4170100890 2023-09-23T09:30:04.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.303+0000 7f41767ff700 1 -- 172.21.15.82:0/3293993656 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41701995d0 con 0x7f4170100890 2023-09-23T09:30:04.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.303+0000 7f41767ff700 1 -- 172.21.15.82:0/3293993656 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f417010de80 con 0x7f4170100890 2023-09-23T09:30:04.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.306+0000 7f416d7fa700 1 -- 172.21.15.82:0/3293993656 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f416001d470 con 0x7f4170100890 2023-09-23T09:30:04.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.308+0000 7f418a1dab80 1 Processor -- start 2023-09-23T09:30:04.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.308+0000 7f418a1dab80 1 -- start start 2023-09-23T09:30:04.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.308+0000 7f418a1dab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4fa1b2380 0x55c4fa1b2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:04.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.308+0000 7f418a1dab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4fa1b2ca0 0x55c4fa1ac700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:04.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.308+0000 7f418a1dab80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c4fa1acc40 0x55c4fa1ad0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:04.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.308+0000 7f418a1dab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4fa1147b0 con 0x55c4fa1b2ca0 2023-09-23T09:30:04.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.308+0000 7f418a1dab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4fa105780 con 0x55c4fa1b2380 2023-09-23T09:30:04.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.308+0000 7f418a1dab80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4fa1030a0 con 0x55c4fa1acc40 2023-09-23T09:30:04.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.309+0000 7f416f7fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c4fa1acc40 0x55c4fa1ad0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:04.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.309+0000 7f4174d9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4fa1b2380 0x55c4fa1b2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:04.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.309+0000 7f416f7fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c4fa1acc40 0x55c4fa1ad0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:54716/0 (socket says 172.21.15.82:54716) 2023-09-23T09:30:04.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.309+0000 7f4174d9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4fa1b2380 0x55c4fa1b2760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:57490/0 (socket says 172.21.15.82:57490) 2023-09-23T09:30:04.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.309+0000 7f416f7fe700 1 -- 172.21.15.82:0/2662873854 learned_addr learned my addr 172.21.15.82:0/2662873854 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:30:04.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.309+0000 7f416ffff700 1 --2- 172.21.15.82:0/2662873854 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4fa1b2ca0 0x55c4fa1ac700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:04.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.309+0000 7f416d7fa700 1 --2- 172.21.15.82:0/3293993656 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f41580a0180 0x7f41580a2640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:04.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.309+0000 7f416d7fa700 1 -- 172.21.15.82:0/3293993656 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f41600cc780 con 0x7f4170100890 2023-09-23T09:30:04.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.309+0000 7f416ffff700 1 -- 172.21.15.82:0/2662873854 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c4fa1acc40 msgr2=0x55c4fa1ad0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:04.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.309+0000 7f416ffff700 1 --2- 172.21.15.82:0/2662873854 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c4fa1acc40 0x55c4fa1ad0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:04.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.309+0000 7f416ffff700 1 -- 172.21.15.82:0/2662873854 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4fa1b2380 msgr2=0x55c4fa1b2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:04.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.309+0000 7f416ffff700 1 --2- 172.21.15.82:0/2662873854 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4fa1b2380 0x55c4fa1b2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:04.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.309+0000 7f416ffff700 1 -- 172.21.15.82:0/2662873854 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c4f9f7e630 con 0x55c4fa1b2ca0 2023-09-23T09:30:04.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.309+0000 7f4174d9c700 1 --2- 172.21.15.82:0/3293993656 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f41580a0180 0x7f41580a2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:04.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.310+0000 7f416ffff700 1 --2- 172.21.15.82:0/2662873854 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4fa1b2ca0 0x55c4fa1ac700 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f41600c9e70 tx=0x7f416002b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17b37b35b1ee9993 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:04.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.310+0000 7f4174d9c700 1 --2- 172.21.15.82:0/3293993656 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f41580a0180 0x7f41580a2640 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f41680097a0 tx=0x7f41680047c0 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:04.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.310+0000 7f41567fc700 1 -- 172.21.15.82:0/2662873854 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4160099a00 con 0x55c4fa1b2ca0 2023-09-23T09:30:04.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.310+0000 7f41567fc700 1 -- 172.21.15.82:0/2662873854 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4160099820 con 0x55c4fa1b2ca0 2023-09-23T09:30:04.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.310+0000 7f41567fc700 1 -- 172.21.15.82:0/2662873854 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41600a1c40 con 0x55c4fa1b2ca0 2023-09-23T09:30:04.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.311+0000 7f418a1dab80 1 -- 172.21.15.82:0/2662873854 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4fa1b2ca0 msgr2=0x55c4fa1ac700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:04.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.311+0000 7f418a1dab80 1 --2- 172.21.15.82:0/2662873854 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4fa1b2ca0 0x55c4fa1ac700 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f41600c9e70 tx=0x7f416002b000 comp rx=0 tx=0).stop 2023-09-23T09:30:04.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.311+0000 7f418a1dab80 1 -- 172.21.15.82:0/2662873854 shutdown_connections 2023-09-23T09:30:04.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.311+0000 7f418a1dab80 1 --2- 172.21.15.82:0/2662873854 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c4fa1acc40 0x55c4fa1ad0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:04.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.311+0000 7f418a1dab80 1 --2- 172.21.15.82:0/2662873854 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4fa1b2380 0x55c4fa1b2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:04.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.311+0000 7f418a1dab80 1 --2- 172.21.15.82:0/2662873854 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4fa1b2ca0 0x55c4fa1ac700 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:04.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.311+0000 7f418a1dab80 1 -- 172.21.15.82:0/2662873854 >> 172.21.15.82:0/2662873854 conn(0x55c4fa1210e0 msgr2=0x55c4fa1a7410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:04.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.312+0000 7f418a1dab80 1 -- 172.21.15.82:0/2662873854 shutdown_connections 2023-09-23T09:30:04.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.312+0000 7f418a1dab80 1 -- 172.21.15.82:0/2662873854 wait complete. 2023-09-23T09:30:04.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.312+0000 7f418a1dab80 1 -- start start 2023-09-23T09:30:04.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.313+0000 7f418a1dab80 1 Processor -- start 2023-09-23T09:30:04.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.313+0000 7f418a1dab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4fa1acc40 0x55c4fa1b8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:04.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.313+0000 7f418a1dab80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c4fa1b2380 0x55c4fa1b5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:04.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.313+0000 7f418a1dab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4fa1b2ca0 0x55c4fa1b6570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:04.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.313+0000 7f418a1dab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4fa0fe990 con 0x55c4fa1acc40 2023-09-23T09:30:04.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.313+0000 7f418a1dab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4fa09cbb0 con 0x55c4fa1b2ca0 2023-09-23T09:30:04.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.313+0000 7f418a1dab80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4fa09c8b0 con 0x55c4fa1b2380 2023-09-23T09:30:04.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.313+0000 7f418a1dab80 10 client.0 _ll_register_callbacks cb 0x55c4f9fe6a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:30:04.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.313+0000 7f416ffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4fa1acc40 0x55c4fa1b8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:04.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.314+0000 7f4174d9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4fa1b2ca0 0x55c4fa1b6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:04.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.314+0000 7f416ffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4fa1acc40 0x55c4fa1b8bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47802/0 (socket says 172.21.15.82:47802) 2023-09-23T09:30:04.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.314+0000 7f416ffff700 1 -- 172.21.15.82:0/2420563288 learned_addr learned my addr 172.21.15.82:0/2420563288 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:30:04.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.314+0000 7f416f7fe700 1 --2- 172.21.15.82:0/2420563288 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c4fa1b2380 0x55c4fa1b5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:04.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.314+0000 7f416ffff700 1 -- 172.21.15.82:0/2420563288 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c4fa1b2380 msgr2=0x55c4fa1b5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:04.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.314+0000 7f416ffff700 1 --2- 172.21.15.82:0/2420563288 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c4fa1b2380 0x55c4fa1b5ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:04.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.314+0000 7f416ffff700 1 -- 172.21.15.82:0/2420563288 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4fa1b2ca0 msgr2=0x55c4fa1b6570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:04.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.314+0000 7f416ffff700 1 --2- 172.21.15.82:0/2420563288 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4fa1b2ca0 0x55c4fa1b6570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:04.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.314+0000 7f416ffff700 1 -- 172.21.15.82:0/2420563288 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f417010de80 con 0x55c4fa1acc40 2023-09-23T09:30:04.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.314+0000 7f4174d9c700 1 --2- 172.21.15.82:0/2420563288 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4fa1b2ca0 0x55c4fa1b6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:30:04.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.314+0000 7f416ffff700 1 --2- 172.21.15.82:0/2420563288 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4fa1acc40 0x55c4fa1b8bd0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f41600963c0 tx=0x7f41600ca320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f99c336d157b76ae server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:04.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.314+0000 7f414f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:30:04.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.314+0000 7f414f7fe700 1 -- 172.21.15.82:0/2420563288 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f416009dcf0 con 0x55c4fa1acc40 2023-09-23T09:30:04.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.314+0000 7f414f7fe700 1 -- 172.21.15.82:0/2420563288 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(141..141 src has 1..141) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f4160099ec0 con 0x55c4fa1acc40 2023-09-23T09:30:04.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.314+0000 7f418a1dab80 1 -- 172.21.15.82:0/2420563288 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c4fa17c1c0 con 0x55c4fa1acc40 2023-09-23T09:30:04.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.315+0000 7f414f7fe700 1 -- 172.21.15.82:0/2420563288 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=95) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4160095ec0 con 0x55c4fa1acc40 2023-09-23T09:30:04.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.315+0000 7f418a1dab80 10 client.17466 fetch_fsmap learned FSMap version 95 2023-09-23T09:30:04.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.315+0000 7f418a1dab80 1 -- 172.21.15.82:0/2420563288 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=95,monmap=4+}) v3 -- 0x55c4f9f2ade0 con 0x55c4fa1acc40 2023-09-23T09:30:04.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.315+0000 7f414f7fe700 1 -- 172.21.15.82:0/2420563288 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55c4fa17c1c0 con 0x55c4fa1acc40 2023-09-23T09:30:04.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.315+0000 7f414f7fe700 1 -- 172.21.15.82:0/2420563288 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 95) v1 ==== 7934+0+0 (secure 0 0 0) 0x7f416009a120 con 0x55c4fa1acc40 2023-09-23T09:30:04.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.315+0000 7f418a1dab80 10 client.17466 fetch_fsmap finished waiting for FSMap version 95 2023-09-23T09:30:04.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.315+0000 7f418a1dab80 10 client.17466 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:30:04.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.315+0000 7f418a1dab80 20 client.17466 populate_metadata read hostname 'smithi082' 2023-09-23T09:30:04.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.315+0000 7f418a1dab80 1 --2- 172.21.15.82:0/2420563288 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55c4fa1c5ef0 0x55c4fa1c8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:04.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.315+0000 7f418a1dab80 4 client.17466 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:30:04.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.315+0000 7f418a1dab80 1 -- 172.21.15.82:0/2420563288 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c4fa0a4ba0 con 0x55c4fa1c5ef0 2023-09-23T09:30:04.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.316+0000 7f416f7fe700 1 --2- 172.21.15.82:0/2420563288 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55c4fa1c5ef0 0x55c4fa1c8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:04.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.316+0000 7f414f7fe700 10 client.17466 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:30:04.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.316+0000 7f416f7fe700 1 --2- 172.21.15.82:0/2420563288 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55c4fa1c5ef0 0x55c4fa1c8310 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b920db7253cdd1af server_cookie=426a0fe078c9c31e in_seq=0 out_seq=0 2023-09-23T09:30:04.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.317+0000 7f414f7fe700 1 -- 172.21.15.82:0/2420563288 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c4fa0a4ba0 con 0x55c4fa1c5ef0 2023-09-23T09:30:04.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.317+0000 7f414f7fe700 10 client.17466 handle_command_reply: tid=0 2023-09-23T09:30:04.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.317+0000 7f418a1dab80 1 client.17466 shutdown 2023-09-23T09:30:04.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.317+0000 7f418a1dab80 1 -- 172.21.15.82:0/2420563288 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4fa1acc40 msgr2=0x55c4fa1b8bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:04.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.317+0000 7f418a1dab80 1 --2- 172.21.15.82:0/2420563288 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4fa1acc40 0x55c4fa1b8bd0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f41600963c0 tx=0x7f41600ca320 comp rx=0 tx=0).stop 2023-09-23T09:30:04.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.317+0000 7f418a1dab80 1 -- 172.21.15.82:0/2420563288 shutdown_connections 2023-09-23T09:30:04.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.317+0000 7f418a1dab80 1 --2- 172.21.15.82:0/2420563288 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4fa1b2ca0 0x55c4fa1b6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:04.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.317+0000 7f418a1dab80 1 --2- 172.21.15.82:0/2420563288 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55c4fa1c5ef0 0x55c4fa1c8310 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:04.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.317+0000 7f418a1dab80 1 --2- 172.21.15.82:0/2420563288 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4fa1acc40 0x55c4fa1b8bd0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:04.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.317+0000 7f418a1dab80 1 --2- 172.21.15.82:0/2420563288 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c4fa1b2380 0x55c4fa1b5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:04.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.317+0000 7f414f7fe700 0 client.17466 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:30:04.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.317+0000 7f418a1dab80 1 -- 172.21.15.82:0/2420563288 >> 172.21.15.82:0/2420563288 conn(0x55c4fa1210e0 msgr2=0x55c4fa1a1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:04.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.317+0000 7f418a1dab80 1 -- 172.21.15.82:0/2420563288 shutdown_connections 2023-09-23T09:30:04.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.317+0000 7f418a1dab80 1 -- 172.21.15.82:0/2420563288 wait complete. 2023-09-23T09:30:04.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.318+0000 7f418a1dab80 20 client.17466 trim_cache size 0 max 16384 2023-09-23T09:30:04.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.335+0000 7f418a1dab80 1 Processor -- start 2023-09-23T09:30:04.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.335+0000 7f418a1dab80 1 -- start start 2023-09-23T09:30:04.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.335+0000 7f418a1dab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4fa1acc40 0x55c4fa1bd520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:04.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.335+0000 7f418a1dab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4fa1b2380 0x55c4fa1b8700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:04.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.335+0000 7f418a1dab80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c4fa1b2ca0 0x55c4fa1b1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:04.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.335+0000 7f418a1dab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4f9f80920 con 0x55c4fa1acc40 2023-09-23T09:30:04.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.335+0000 7f418a1dab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4fa1b74d0 con 0x55c4fa1b2380 2023-09-23T09:30:04.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.335+0000 7f418a1dab80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4fa1c2e00 con 0x55c4fa1b2ca0 2023-09-23T09:30:04.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.336+0000 7f416ffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4fa1acc40 0x55c4fa1bd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:04.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.336+0000 7f416f7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4fa1b2380 0x55c4fa1b8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:04.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.336+0000 7f416ffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4fa1acc40 0x55c4fa1bd520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47804/0 (socket says 172.21.15.82:47804) 2023-09-23T09:30:04.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.336+0000 7f416f7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4fa1b2380 0x55c4fa1b8700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:57502/0 (socket says 172.21.15.82:57502) 2023-09-23T09:30:04.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.336+0000 7f416ffff700 1 -- 172.21.15.82:0/1789866965 learned_addr learned my addr 172.21.15.82:0/1789866965 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:30:04.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.336+0000 7f4174d9c700 1 --2- 172.21.15.82:0/1789866965 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c4fa1b2ca0 0x55c4fa1b1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:04.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.336+0000 7f416f7fe700 1 -- 172.21.15.82:0/1789866965 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c4fa1b2ca0 msgr2=0x55c4fa1b1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:04.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.336+0000 7f416f7fe700 1 --2- 172.21.15.82:0/1789866965 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c4fa1b2ca0 0x55c4fa1b1040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:04.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.336+0000 7f416f7fe700 1 -- 172.21.15.82:0/1789866965 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4fa1acc40 msgr2=0x55c4fa1bd520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:04.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.336+0000 7f416f7fe700 1 --2- 172.21.15.82:0/1789866965 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4fa1acc40 0x55c4fa1bd520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:04.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.336+0000 7f416f7fe700 1 -- 172.21.15.82:0/1789866965 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c4f9f13c60 con 0x55c4fa1b2380 2023-09-23T09:30:04.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.336+0000 7f4174d9c700 1 --2- 172.21.15.82:0/1789866965 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c4fa1b2ca0 0x55c4fa1b1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:30:04.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.336+0000 7f416f7fe700 1 --2- 172.21.15.82:0/1789866965 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4fa1b2380 0x55c4fa1b8700 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x55c4fa1c62d0 tx=0x7f4164009290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9fde77888d7c1822 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:04.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.336+0000 7f4156ffd700 1 -- 172.21.15.82:0/1789866965 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f416401e390 con 0x55c4fa1b2380 2023-09-23T09:30:04.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.337+0000 7f4156ffd700 1 -- 172.21.15.82:0/1789866965 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f416401c040 con 0x55c4fa1b2380 2023-09-23T09:30:04.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.337+0000 7f4156ffd700 1 -- 172.21.15.82:0/1789866965 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4164015bc0 con 0x55c4fa1b2380 2023-09-23T09:30:04.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.337+0000 7f418a1dab80 1 -- 172.21.15.82:0/1789866965 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4fa1b2380 msgr2=0x55c4fa1b8700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:04.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.337+0000 7f418a1dab80 1 --2- 172.21.15.82:0/1789866965 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4fa1b2380 0x55c4fa1b8700 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x55c4fa1c62d0 tx=0x7f4164009290 comp rx=0 tx=0).stop 2023-09-23T09:30:04.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.337+0000 7f418a1dab80 1 -- 172.21.15.82:0/1789866965 shutdown_connections 2023-09-23T09:30:04.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.337+0000 7f418a1dab80 1 --2- 172.21.15.82:0/1789866965 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c4fa1b2ca0 0x55c4fa1b1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:04.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.337+0000 7f418a1dab80 1 --2- 172.21.15.82:0/1789866965 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4fa1acc40 0x55c4fa1bd520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:04.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.337+0000 7f418a1dab80 1 --2- 172.21.15.82:0/1789866965 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4fa1b2380 0x55c4fa1b8700 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:04.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.337+0000 7f418a1dab80 1 -- 172.21.15.82:0/1789866965 >> 172.21.15.82:0/1789866965 conn(0x55c4fa1210e0 msgr2=0x55c4fa1b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:04.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.337+0000 7f418a1dab80 1 -- 172.21.15.82:0/1789866965 shutdown_connections 2023-09-23T09:30:04.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.337+0000 7f418a1dab80 1 -- 172.21.15.82:0/1789866965 wait complete. 2023-09-23T09:30:04.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.338+0000 7f418a1dab80 1 -- start start 2023-09-23T09:30:04.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.338+0000 7f418a1dab80 1 Processor -- start 2023-09-23T09:30:04.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.339+0000 7f418a1dab80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c4fa1acc40 0x55c4fa20de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:04.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.339+0000 7f418a1dab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4fa1b2380 0x55c4fa20e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:04.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.339+0000 7f418a1dab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4fa1b2ca0 0x55c4fa218cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:04.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.339+0000 7f418a1dab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4fa219230 con 0x55c4fa1b2380 2023-09-23T09:30:04.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.339+0000 7f418a1dab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4fa219370 con 0x55c4fa1b2ca0 2023-09-23T09:30:04.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.339+0000 7f418a1dab80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4fa219530 con 0x55c4fa1acc40 2023-09-23T09:30:04.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.339+0000 7f418a1dab80 10 client.0 _ll_register_callbacks cb 0x7f4168009810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:30:04.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.339+0000 7f416f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4fa1b2380 0x55c4fa20e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:04.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.339+0000 7f416ffff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c4fa1acc40 0x55c4fa20de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:04.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.339+0000 7f416ffff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c4fa1acc40 0x55c4fa20de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:54742/0 (socket says 172.21.15.82:54742) 2023-09-23T09:30:04.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.339+0000 7f416f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4fa1b2380 0x55c4fa20e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47810/0 (socket says 172.21.15.82:47810) 2023-09-23T09:30:04.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.339+0000 7f416ffff700 1 -- 172.21.15.82:0/995171236 learned_addr learned my addr 172.21.15.82:0/995171236 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:30:04.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.339+0000 7f4174d9c700 1 --2- 172.21.15.82:0/995171236 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4fa1b2ca0 0x55c4fa218cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:04.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.339+0000 7f416ffff700 1 -- 172.21.15.82:0/995171236 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4fa1b2ca0 msgr2=0x55c4fa218cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:04.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.339+0000 7f416ffff700 1 --2- 172.21.15.82:0/995171236 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4fa1b2ca0 0x55c4fa218cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:04.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.339+0000 7f416ffff700 1 -- 172.21.15.82:0/995171236 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4fa1b2380 msgr2=0x55c4fa20e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:04.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.339+0000 7f416ffff700 1 --2- 172.21.15.82:0/995171236 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4fa1b2380 0x55c4fa20e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:04.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.339+0000 7f416ffff700 1 -- 172.21.15.82:0/995171236 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4164009df0 con 0x55c4fa1acc40 2023-09-23T09:30:04.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.339+0000 7f416f7fe700 1 --2- 172.21.15.82:0/995171236 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4fa1b2380 0x55c4fa20e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:30:04.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.340+0000 7f416ffff700 1 --2- 172.21.15.82:0/995171236 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c4fa1acc40 0x55c4fa20de60 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f41600968e0 tx=0x7f416002b000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=379229bbdb9c00a5 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:04.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.340+0000 7f414f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T09:30:04.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.340+0000 7f414f7fe700 1 -- 172.21.15.82:0/995171236 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4160095ec0 con 0x55c4fa1acc40 2023-09-23T09:30:04.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.340+0000 7f414f7fe700 1 -- 172.21.15.82:0/995171236 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(141..141 src has 1..141) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f416009a5c0 con 0x55c4fa1acc40 2023-09-23T09:30:04.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.340+0000 7f418a1dab80 1 -- 172.21.15.82:0/995171236 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c4fa19f8b0 con 0x55c4fa1acc40 2023-09-23T09:30:04.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.340+0000 7f414f7fe700 1 -- 172.21.15.82:0/995171236 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=95) v2 ==== 24+0+0 (secure 0 0 0) 0x7f416009dcf0 con 0x55c4fa1acc40 2023-09-23T09:30:04.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.340+0000 7f418a1dab80 10 client.27202 fetch_fsmap learned FSMap version 95 2023-09-23T09:30:04.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.340+0000 7f418a1dab80 1 -- 172.21.15.82:0/995171236 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=95,monmap=4+}) v3 -- 0x55c4f9f51250 con 0x55c4fa1acc40 2023-09-23T09:30:04.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.340+0000 7f414f7fe700 1 -- 172.21.15.82:0/995171236 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55c4fa19f8b0 con 0x55c4fa1acc40 2023-09-23T09:30:04.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.340+0000 7f414f7fe700 1 -- 172.21.15.82:0/995171236 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 95) v1 ==== 7934+0+0 (secure 0 0 0) 0x7f416009a120 con 0x55c4fa1acc40 2023-09-23T09:30:04.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.341+0000 7f418a1dab80 10 client.27202 fetch_fsmap finished waiting for FSMap version 95 2023-09-23T09:30:04.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.341+0000 7f418a1dab80 10 client.27202 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:30:04.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.341+0000 7f418a1dab80 20 client.27202 populate_metadata read hostname 'smithi082' 2023-09-23T09:30:04.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.341+0000 7f418a1dab80 1 --2- 172.21.15.82:0/995171236 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55c4fa21a790 0x55c4fa21cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:04.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.341+0000 7f418a1dab80 4 client.27202 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:30:04.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.341+0000 7f418a1dab80 1 -- 172.21.15.82:0/995171236 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55c4fa0f7970 con 0x55c4fa21a790 2023-09-23T09:30:04.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.341+0000 7f416f7fe700 1 --2- 172.21.15.82:0/995171236 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55c4fa21a790 0x55c4fa21cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:04.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.341+0000 7f414f7fe700 10 client.27202 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:30:04.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.341+0000 7f416f7fe700 1 --2- 172.21.15.82:0/995171236 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55c4fa21a790 0x55c4fa21cb80 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c12496b08db33720 server_cookie=babfe39e2cf7864 in_seq=0 out_seq=0 2023-09-23T09:30:04.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.342+0000 7f414f7fe700 1 -- 172.21.15.82:0/995171236 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55c4fa0f7970 con 0x55c4fa21a790 2023-09-23T09:30:04.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.342+0000 7f414f7fe700 10 client.27202 handle_command_reply: tid=0 2023-09-23T09:30:04.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.342+0000 7f418a1dab80 1 client.27202 shutdown 2023-09-23T09:30:04.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.342+0000 7f418a1dab80 1 -- 172.21.15.82:0/995171236 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c4fa1acc40 msgr2=0x55c4fa20de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:04.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.342+0000 7f418a1dab80 1 --2- 172.21.15.82:0/995171236 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c4fa1acc40 0x55c4fa20de60 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f41600968e0 tx=0x7f416002b000 comp rx=0 tx=0).stop 2023-09-23T09:30:04.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.342+0000 7f418a1dab80 1 -- 172.21.15.82:0/995171236 shutdown_connections 2023-09-23T09:30:04.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.342+0000 7f418a1dab80 1 --2- 172.21.15.82:0/995171236 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4fa1b2ca0 0x55c4fa218cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:04.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.342+0000 7f418a1dab80 1 --2- 172.21.15.82:0/995171236 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c4fa1acc40 0x55c4fa20de60 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:04.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.342+0000 7f418a1dab80 1 --2- 172.21.15.82:0/995171236 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55c4fa21a790 0x55c4fa21cb80 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:04.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.342+0000 7f418a1dab80 1 --2- 172.21.15.82:0/995171236 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4fa1b2380 0x55c4fa20e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:04.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.342+0000 7f414f7fe700 0 client.27202 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:30:04.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.342+0000 7f418a1dab80 1 -- 172.21.15.82:0/995171236 >> 172.21.15.82:0/995171236 conn(0x55c4fa1210e0 msgr2=0x55c4fa1b1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:04.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.342+0000 7f418a1dab80 1 -- 172.21.15.82:0/995171236 shutdown_connections 2023-09-23T09:30:04.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.342+0000 7f418a1dab80 1 -- 172.21.15.82:0/995171236 wait complete. 2023-09-23T09:30:04.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.342+0000 7f418a1dab80 20 client.27202 trim_cache size 0 max 16384 2023-09-23T09:30:04.350 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:30:04.350 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "no active scrubs running", 2023-09-23T09:30:04.350 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": {} 2023-09-23T09:30:04.350 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:30:04.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.343+0000 7f41767ff700 1 -- 172.21.15.82:0/3293993656 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f41580a0180 msgr2=0x7f41580a2640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:04.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.343+0000 7f41767ff700 1 --2- 172.21.15.82:0/3293993656 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f41580a0180 0x7f41580a2640 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f41680097a0 tx=0x7f41680047c0 comp rx=0 tx=0).stop 2023-09-23T09:30:04.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.343+0000 7f41767ff700 1 -- 172.21.15.82:0/3293993656 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4170100890 msgr2=0x7f417019e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:04.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.343+0000 7f41767ff700 1 --2- 172.21.15.82:0/3293993656 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4170100890 0x7f417019e940 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f416000b070 tx=0x7f41600077f0 comp rx=0 tx=0).stop 2023-09-23T09:30:04.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.343+0000 7f41767ff700 1 -- 172.21.15.82:0/3293993656 shutdown_connections 2023-09-23T09:30:04.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.343+0000 7f41767ff700 1 --2- 172.21.15.82:0/3293993656 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f41580a0180 0x7f41580a2640 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:04.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.343+0000 7f41767ff700 1 --2- 172.21.15.82:0/3293993656 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41701068a0 0x7f41701989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:04.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.343+0000 7f41767ff700 1 --2- 172.21.15.82:0/3293993656 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4170100890 0x7f417019e940 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:04.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.343+0000 7f41767ff700 1 --2- 172.21.15.82:0/3293993656 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4170101250 0x7f417019ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:04.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.343+0000 7f41767ff700 1 -- 172.21.15.82:0/3293993656 >> 172.21.15.82:0/3293993656 conn(0x7f41700fc380 msgr2=0x7f41700fca80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:04.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.343+0000 7f41767ff700 1 -- 172.21.15.82:0/3293993656 shutdown_connections 2023-09-23T09:30:04.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.343+0000 7f41767ff700 1 -- 172.21.15.82:0/3293993656 wait complete. 2023-09-23T09:30:04.362 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-09-23T09:30:04.362 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-23T09:30:04.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.607+0000 7fa1685ff700 1 -- 172.21.15.82:0/1299599193 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa1600ff630 msgr2=0x7fa1600ffa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:04.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.607+0000 7fa1685ff700 1 --2- 172.21.15.82:0/1299599193 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa1600ff630 0x7fa1600ffa10 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa15c009990 tx=0x7fa15c009ca0 comp rx=0 tx=0).stop 2023-09-23T09:30:04.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.607+0000 7fa1685ff700 1 -- 172.21.15.82:0/1299599193 shutdown_connections 2023-09-23T09:30:04.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.607+0000 7fa1685ff700 1 --2- 172.21.15.82:0/1299599193 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa16010d1e0 0x7fa16010f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:04.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.607+0000 7fa1685ff700 1 --2- 172.21.15.82:0/1299599193 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa1600ff630 0x7fa1600ffa10 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:04.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.607+0000 7fa1685ff700 1 --2- 172.21.15.82:0/1299599193 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1600fffe0 0x7fa16010cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:04.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.608+0000 7fa1685ff700 1 -- 172.21.15.82:0/1299599193 >> 172.21.15.82:0/1299599193 conn(0x7fa1600fb230 msgr2=0x7fa1600fd650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:04.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.608+0000 7fa1685ff700 1 -- 172.21.15.82:0/1299599193 shutdown_connections 2023-09-23T09:30:04.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.608+0000 7fa1685ff700 1 -- 172.21.15.82:0/1299599193 wait complete. 2023-09-23T09:30:04.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.609+0000 7fa1685ff700 1 Processor -- start 2023-09-23T09:30:04.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.609+0000 7fa1685ff700 1 -- start start 2023-09-23T09:30:04.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.610+0000 7fa1685ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa1600ff630 0x7fa16019e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:04.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.610+0000 7fa1685ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1600fffe0 0x7fa16019ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:04.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.610+0000 7fa1685ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa16010d1e0 0x7fa160198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:04.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.610+0000 7fa1685ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa160198fa0 con 0x7fa1600fffe0 2023-09-23T09:30:04.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.610+0000 7fa1685ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa160199110 con 0x7fa16010d1e0 2023-09-23T09:30:04.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.610+0000 7fa1685ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1601992d0 con 0x7fa1600ff630 2023-09-23T09:30:04.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.610+0000 7fa165b9a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1600fffe0 0x7fa16019ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:04.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.610+0000 7fa16639b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa1600ff630 0x7fa16019e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:04.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.610+0000 7fa165b9a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1600fffe0 0x7fa16019ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47834/0 (socket says 172.21.15.82:47834) 2023-09-23T09:30:04.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.610+0000 7fa16639b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa1600ff630 0x7fa16019e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:54752/0 (socket says 172.21.15.82:54752) 2023-09-23T09:30:04.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.610+0000 7fa165b9a700 1 -- 172.21.15.82:0/1325191416 learned_addr learned my addr 172.21.15.82:0/1325191416 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:30:04.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.611+0000 7fa166b9c700 1 --2- 172.21.15.82:0/1325191416 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa16010d1e0 0x7fa160198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:04.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.611+0000 7fa165b9a700 1 -- 172.21.15.82:0/1325191416 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa1600ff630 msgr2=0x7fa16019e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:04.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.611+0000 7fa165b9a700 1 --2- 172.21.15.82:0/1325191416 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa1600ff630 0x7fa16019e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:04.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.611+0000 7fa165b9a700 1 -- 172.21.15.82:0/1325191416 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa16010d1e0 msgr2=0x7fa160198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:04.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.611+0000 7fa165b9a700 1 --2- 172.21.15.82:0/1325191416 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa16010d1e0 0x7fa160198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:04.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.611+0000 7fa165b9a700 1 -- 172.21.15.82:0/1325191416 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa15c0095f0 con 0x7fa1600fffe0 2023-09-23T09:30:04.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.611+0000 7fa166b9c700 1 --2- 172.21.15.82:0/1325191416 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa16010d1e0 0x7fa160198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:30:04.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.611+0000 7fa165b9a700 1 --2- 172.21.15.82:0/1325191416 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1600fffe0 0x7fa16019ee00 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fa15000e9a0 tx=0x7fa15000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:04.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.611+0000 7fa1577fe700 1 -- 172.21.15.82:0/1325191416 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa150009790 con 0x7fa1600fffe0 2023-09-23T09:30:04.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.611+0000 7fa1685ff700 1 -- 172.21.15.82:0/1325191416 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1601995b0 con 0x7fa1600fffe0 2023-09-23T09:30:04.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.611+0000 7fa1685ff700 1 -- 172.21.15.82:0/1325191416 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1601a58b0 con 0x7fa1600fffe0 2023-09-23T09:30:04.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.611+0000 7fa1577fe700 1 -- 172.21.15.82:0/1325191416 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa15000cbd0 con 0x7fa1600fffe0 2023-09-23T09:30:04.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.611+0000 7fa1577fe700 1 -- 172.21.15.82:0/1325191416 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa150018680 con 0x7fa1600fffe0 2023-09-23T09:30:04.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.612+0000 7fa1685ff700 1 -- 172.21.15.82:0/1325191416 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa160067710 con 0x7fa1600fffe0 2023-09-23T09:30:04.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.615+0000 7fa1577fe700 1 -- 172.21.15.82:0/1325191416 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7fa15000cd40 con 0x7fa1600fffe0 2023-09-23T09:30:04.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.616+0000 7fa1577fe700 1 --2- 172.21.15.82:0/1325191416 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fa14c0a0180 0x7fa14c0a2640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:04.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.616+0000 7fa1577fe700 1 -- 172.21.15.82:0/1325191416 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fa150014070 con 0x7fa1600fffe0 2023-09-23T09:30:04.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.616+0000 7fa16639b700 1 --2- 172.21.15.82:0/1325191416 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fa14c0a0180 0x7fa14c0a2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:04.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.617+0000 7fa16639b700 1 --2- 172.21.15.82:0/1325191416 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fa14c0a0180 0x7fa14c0a2640 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa15c006010 tx=0x7fa15c00b260 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:04.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.618+0000 7fa1577fe700 1 -- 172.21.15.82:0/1325191416 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7fa150095650 con 0x7fa1600fffe0 2023-09-23T09:30:04.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.918+0000 7fa1685ff700 1 -- 172.21.15.82:0/1325191416 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa160199e40 con 0x7fa1600fffe0 2023-09-23T09:30:04.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.919+0000 7fa1577fe700 1 -- 172.21.15.82:0/1325191416 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) v1 ==== 94+0+11344 (secure 0 0 0) 0x7fa150098c70 con 0x7fa1600fffe0 2023-09-23T09:30:04.921 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T09:30:04.921 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":95,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/1237857359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1237857359},{"type":"v1","addr":"172.21.15.82:6835","nonce":1237857359}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/1335102362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":1335102362},{"type":"v1","addr":"172.21.15.82:6837","nonce":1335102362}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":95,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-23T08:54:52.600479+0000","modified":"2023-09-23T09:29:46.504359+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24557,"mds_1":24550,"mds_2":24526,"mds_3":24515,"mds_4":24514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/3645331700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3645331700},{"type":"v1","addr":"172.21.15.135:6835","nonce":3645331700}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14658":{"gid":14658,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6839/205725278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":205725278},{"type":"v1","addr":"172.21.15.82:6839","nonce":205725278}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14670":{"gid":14670,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6841/2659297867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":2659297867},{"type":"v1","addr":"172.21.15.82:6841","nonce":2659297867}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24461":{"gid":24461,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/503886037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":503886037},{"type":"v1","addr":"172.21.15.135:6833","nonce":503886037}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24463":{"gid":24463,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.161:6833/471569125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":471569125},{"type":"v1","addr":"172.21.15.161:6833","nonce":471569125}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24514":{"gid":24514,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":10,"addr":"172.21.15.161:6835/2237964162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":2237964162},{"type":"v1","addr":"172.21.15.161:6835","nonce":2237964162}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24515":{"gid":24515,"name":"h","rank":3,"incarnation":22,"state":"up:active","state_seq":8,"addr":"172.21.15.135:6837/2655304858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2655304858},{"type":"v1","addr":"172.21.15.135:6837","nonce":2655304858}]},"join_fscid":-1,"export_targets":[0,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24526":{"gid":24526,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.161:6837/43639843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":43639843},{"type":"v1","addr":"172.21.15.161:6837","nonce":43639843}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24550":{"gid":24550,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.161:6839/758982817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6838","nonce":758982817},{"type":"v1","addr":"172.21.15.161:6839","nonce":758982817}]},"join_fscid":-1,"export_targets":[0],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24557":{"gid":24557,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6839/2508669274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2508669274},{"type":"v1","addr":"172.21.15.135:6839","nonce":2508669274}]},"join_fscid":-1,"export_targets":[1,3],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-23T09:30:04.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.921+0000 7fa1685ff700 1 -- 172.21.15.82:0/1325191416 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fa14c0a0180 msgr2=0x7fa14c0a2640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:04.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.921+0000 7fa1685ff700 1 --2- 172.21.15.82:0/1325191416 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fa14c0a0180 0x7fa14c0a2640 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa15c006010 tx=0x7fa15c00b260 comp rx=0 tx=0).stop 2023-09-23T09:30:04.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.921+0000 7fa1685ff700 1 -- 172.21.15.82:0/1325191416 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1600fffe0 msgr2=0x7fa16019ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:04.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.921+0000 7fa1685ff700 1 --2- 172.21.15.82:0/1325191416 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1600fffe0 0x7fa16019ee00 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fa15000e9a0 tx=0x7fa15000ecb0 comp rx=0 tx=0).stop 2023-09-23T09:30:04.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.922+0000 7fa1685ff700 1 -- 172.21.15.82:0/1325191416 shutdown_connections 2023-09-23T09:30:04.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.922+0000 7fa1685ff700 1 --2- 172.21.15.82:0/1325191416 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fa14c0a0180 0x7fa14c0a2640 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:04.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.922+0000 7fa1685ff700 1 --2- 172.21.15.82:0/1325191416 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa16010d1e0 0x7fa160198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:04.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.922+0000 7fa1685ff700 1 --2- 172.21.15.82:0/1325191416 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa1600ff630 0x7fa16019e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:04.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.922+0000 7fa1685ff700 1 --2- 172.21.15.82:0/1325191416 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1600fffe0 0x7fa16019ee00 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:04.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.922+0000 7fa1685ff700 1 -- 172.21.15.82:0/1325191416 >> 172.21.15.82:0/1325191416 conn(0x7fa1600fb230 msgr2=0x7fa16010e590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:04.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.922+0000 7fa1685ff700 1 -- 172.21.15.82:0/1325191416 shutdown_connections 2023-09-23T09:30:04.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:04.922+0000 7fa1685ff700 1 -- 172.21.15.82:0/1325191416 wait complete. 2023-09-23T09:30:04.925 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 95 2023-09-23T09:30:04.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:30:04 smithi082 ceph-mon[97694]: pgmap v1050: 97 pgs: 97 active+clean; 16 GiB data, 56 GiB used, 1017 GiB / 1.0 TiB avail; 1.1 MiB/s rd, 15 MiB/s wr, 1.02k op/s 2023-09-23T09:30:04.942 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-09-23T09:30:05.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:30:04 smithi135 ceph-mon[99205]: pgmap v1050: 97 pgs: 97 active+clean; 16 GiB data, 56 GiB used, 1017 GiB / 1.0 TiB avail; 1.1 MiB/s rd, 15 MiB/s wr, 1.02k op/s 2023-09-23T09:30:05.153 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:30:04 smithi161 ceph-mon[99580]: pgmap v1050: 97 pgs: 97 active+clean; 16 GiB data, 56 GiB used, 1017 GiB / 1.0 TiB avail; 1.1 MiB/s rd, 15 MiB/s wr, 1.02k op/s 2023-09-23T09:30:05.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.198+0000 7f611cbff700 1 -- 172.21.15.82:0/3379330473 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61180735e0 msgr2=0x7f6118111340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:05.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.198+0000 7f611cbff700 1 --2- 172.21.15.82:0/3379330473 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61180735e0 0x7f6118111340 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f61000098f0 tx=0x7f6100009c00 comp rx=0 tx=0).stop 2023-09-23T09:30:05.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.198+0000 7f611cbff700 1 -- 172.21.15.82:0/3379330473 shutdown_connections 2023-09-23T09:30:05.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.198+0000 7f611cbff700 1 --2- 172.21.15.82:0/3379330473 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6118111880 0x7f6118113c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:05.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.198+0000 7f611cbff700 1 --2- 172.21.15.82:0/3379330473 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6118072cc0 0x7f61180730a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:05.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.198+0000 7f611cbff700 1 --2- 172.21.15.82:0/3379330473 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61180735e0 0x7f6118111340 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:05.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.198+0000 7f611cbff700 1 -- 172.21.15.82:0/3379330473 >> 172.21.15.82:0/3379330473 conn(0x7f61180fc3a0 msgr2=0x7f61180fe7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:05.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.199+0000 7f611cbff700 1 -- 172.21.15.82:0/3379330473 shutdown_connections 2023-09-23T09:30:05.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.199+0000 7f611cbff700 1 -- 172.21.15.82:0/3379330473 wait complete. 2023-09-23T09:30:05.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.201+0000 7f611cbff700 1 Processor -- start 2023-09-23T09:30:05.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.201+0000 7f611cbff700 1 -- start start 2023-09-23T09:30:05.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.202+0000 7f611cbff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6118072cc0 0x7f611819cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:05.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.202+0000 7f611cbff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61180735e0 0x7f611819d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:05.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.202+0000 7f611cbff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6118111880 0x7f61181a1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:05.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.202+0000 7f611cbff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61181a1f80 con 0x7f61180735e0 2023-09-23T09:30:05.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.202+0000 7f611cbff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61181a20f0 con 0x7f6118111880 2023-09-23T09:30:05.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.202+0000 7f611cbff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61181a22b0 con 0x7f6118072cc0 2023-09-23T09:30:05.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.203+0000 7f6116d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6118111880 0x7f61181a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:05.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.203+0000 7f6116d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6118111880 0x7f61181a1940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:57538/0 (socket says 172.21.15.82:57538) 2023-09-23T09:30:05.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.203+0000 7f6116d9d700 1 -- 172.21.15.82:0/1166084674 learned_addr learned my addr 172.21.15.82:0/1166084674 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:30:05.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.203+0000 7f610dd9b700 1 --2- 172.21.15.82:0/1166084674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61180735e0 0x7f611819d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:05.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.203+0000 7f611659c700 1 --2- 172.21.15.82:0/1166084674 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6118072cc0 0x7f611819cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:05.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.203+0000 7f6116d9d700 1 -- 172.21.15.82:0/1166084674 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6118072cc0 msgr2=0x7f611819cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:05.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.203+0000 7f6116d9d700 1 --2- 172.21.15.82:0/1166084674 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6118072cc0 0x7f611819cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:05.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.203+0000 7f6116d9d700 1 -- 172.21.15.82:0/1166084674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61180735e0 msgr2=0x7f611819d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:05.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.203+0000 7f6116d9d700 1 --2- 172.21.15.82:0/1166084674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61180735e0 0x7f611819d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:05.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.203+0000 7f6116d9d700 1 -- 172.21.15.82:0/1166084674 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6110009520 con 0x7f6118111880 2023-09-23T09:30:05.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.203+0000 7f611659c700 1 --2- 172.21.15.82:0/1166084674 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6118072cc0 0x7f611819cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T09:30:05.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.203+0000 7f610dd9b700 1 --2- 172.21.15.82:0/1166084674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61180735e0 0x7f611819d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:30:05.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.204+0000 7f6116d9d700 1 --2- 172.21.15.82:0/1166084674 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6118111880 0x7f61181a1940 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f6110005950 tx=0x7f611000ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:05.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.204+0000 7f610ffff700 1 -- 172.21.15.82:0/1166084674 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f611000cbd0 con 0x7f6118111880 2023-09-23T09:30:05.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.204+0000 7f610ffff700 1 -- 172.21.15.82:0/1166084674 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f61100044b0 con 0x7f6118111880 2023-09-23T09:30:05.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.204+0000 7f610ffff700 1 -- 172.21.15.82:0/1166084674 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6110003e00 con 0x7f6118111880 2023-09-23T09:30:05.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.204+0000 7f611cbff700 1 -- 172.21.15.82:0/1166084674 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6100009520 con 0x7f6118111880 2023-09-23T09:30:05.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.204+0000 7f611cbff700 1 -- 172.21.15.82:0/1166084674 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61181a9bf0 con 0x7f6118111880 2023-09-23T09:30:05.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.209+0000 7f610ffff700 1 -- 172.21.15.82:0/1166084674 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f6110003f60 con 0x7f6118111880 2023-09-23T09:30:05.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.211+0000 7f6130472b80 1 Processor -- start 2023-09-23T09:30:05.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.211+0000 7f6130472b80 1 -- start start 2023-09-23T09:30:05.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.212+0000 7f6130472b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5599c3665380 0x5599c3665760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:05.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.212+0000 7f6130472b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599c3665ca0 0x5599c365f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:05.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.212+0000 7f6130472b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5599c365fc40 0x5599c36600a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:05.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.212+0000 7f6130472b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599c35c77b0 con 0x5599c3665380 2023-09-23T09:30:05.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.212+0000 7f6130472b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599c35b8780 con 0x5599c3665ca0 2023-09-23T09:30:05.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.212+0000 7f6130472b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599c35b60a0 con 0x5599c365fc40 2023-09-23T09:30:05.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.212+0000 7f610ffff700 1 --2- 172.21.15.82:0/1166084674 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f61040a0180 0x7f61040a2640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:05.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.212+0000 7f611659c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599c3665ca0 0x5599c365f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:05.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.212+0000 7f611659c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599c3665ca0 0x5599c365f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:57552/0 (socket says 172.21.15.82:57552) 2023-09-23T09:30:05.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.212+0000 7f611659c700 1 -- 172.21.15.82:0/3467121897 learned_addr learned my addr 172.21.15.82:0/3467121897 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:30:05.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.212+0000 7f610dd9b700 1 --2- 172.21.15.82:0/3467121897 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5599c365fc40 0x5599c36600a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:05.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.213+0000 7f610dd9b700 1 --2- 172.21.15.82:0/3467121897 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5599c3665380 0x5599c3665760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:05.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.213+0000 7f611659c700 1 -- 172.21.15.82:0/3467121897 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5599c365fc40 msgr2=0x5599c36600a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:05.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.213+0000 7f611659c700 1 --2- 172.21.15.82:0/3467121897 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5599c365fc40 0x5599c36600a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:05.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.213+0000 7f611659c700 1 -- 172.21.15.82:0/3467121897 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5599c3665380 msgr2=0x5599c3665760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:05.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.213+0000 7f611659c700 1 --2- 172.21.15.82:0/3467121897 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5599c3665380 0x5599c3665760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:05.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.213+0000 7f611659c700 1 -- 172.21.15.82:0/3467121897 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5599c3431630 con 0x5599c3665ca0 2023-09-23T09:30:05.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.213+0000 7f610dd9b700 1 --2- 172.21.15.82:0/3467121897 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5599c3665380 0x5599c3665760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T09:30:05.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.213+0000 7f611659c700 1 --2- 172.21.15.82:0/3467121897 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599c3665ca0 0x5599c365f700 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f61080094f0 tx=0x7f61080099e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e600dd9c6daae2cd server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:05.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.214+0000 7f610cd99700 1 -- 172.21.15.82:0/3467121897 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6108003c00 con 0x5599c3665ca0 2023-09-23T09:30:05.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.214+0000 7f610cd99700 1 -- 172.21.15.82:0/3467121897 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f610800f050 con 0x5599c3665ca0 2023-09-23T09:30:05.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.214+0000 7f610cd99700 1 -- 172.21.15.82:0/3467121897 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6108015830 con 0x5599c3665ca0 2023-09-23T09:30:05.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.214+0000 7f610ffff700 1 -- 172.21.15.82:0/1166084674 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f6110014070 con 0x7f6118111880 2023-09-23T09:30:05.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.214+0000 7f6116d9d700 1 --2- 172.21.15.82:0/1166084674 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f61040a0180 0x7f61040a2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:05.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.215+0000 7f6130472b80 1 -- 172.21.15.82:0/3467121897 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599c3665ca0 msgr2=0x5599c365f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:05.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.215+0000 7f6130472b80 1 --2- 172.21.15.82:0/3467121897 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599c3665ca0 0x5599c365f700 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f61080094f0 tx=0x7f61080099e0 comp rx=0 tx=0).stop 2023-09-23T09:30:05.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.215+0000 7f6116d9d700 1 --2- 172.21.15.82:0/1166084674 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f61040a0180 0x7f61040a2640 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f61100c90e0 tx=0x7f611000efa0 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:05.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.216+0000 7f6130472b80 1 -- 172.21.15.82:0/3467121897 shutdown_connections 2023-09-23T09:30:05.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.216+0000 7f6130472b80 1 --2- 172.21.15.82:0/3467121897 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5599c365fc40 0x5599c36600a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:05.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.216+0000 7f6130472b80 1 --2- 172.21.15.82:0/3467121897 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5599c3665380 0x5599c3665760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:05.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.216+0000 7f6130472b80 1 --2- 172.21.15.82:0/3467121897 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599c3665ca0 0x5599c365f700 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:05.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.216+0000 7f6130472b80 1 -- 172.21.15.82:0/3467121897 >> 172.21.15.82:0/3467121897 conn(0x5599c35d40e0 msgr2=0x5599c365a410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:05.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.216+0000 7f6130472b80 1 -- 172.21.15.82:0/3467121897 shutdown_connections 2023-09-23T09:30:05.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.216+0000 7f6130472b80 1 -- 172.21.15.82:0/3467121897 wait complete. 2023-09-23T09:30:05.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.217+0000 7f6130472b80 1 -- start start 2023-09-23T09:30:05.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.217+0000 7f6130472b80 1 Processor -- start 2023-09-23T09:30:05.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.218+0000 7f6130472b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5599c365fc40 0x5599c3668fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:05.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.218+0000 7f6130472b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5599c3665380 0x5599c3669520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:05.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.218+0000 7f6130472b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599c3665ca0 0x5599c3669a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:05.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.218+0000 7f6130472b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599c35b1990 con 0x5599c3665380 2023-09-23T09:30:05.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.218+0000 7f6130472b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599c354fbb0 con 0x5599c3665ca0 2023-09-23T09:30:05.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.219+0000 7f6130472b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599c354f8b0 con 0x5599c365fc40 2023-09-23T09:30:05.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.219+0000 7f6130472b80 10 client.0 _ll_register_callbacks cb 0x5599c3499a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:30:05.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.219+0000 7f610dd9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5599c365fc40 0x5599c3668fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:05.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.219+0000 7f610dd9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5599c365fc40 0x5599c3668fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:54780/0 (socket says 172.21.15.82:54780) 2023-09-23T09:30:05.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.219+0000 7f610dd9b700 1 -- 172.21.15.82:0/1108287511 learned_addr learned my addr 172.21.15.82:0/1108287511 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:30:05.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.219+0000 7f610dd9b700 1 --2- 172.21.15.82:0/1108287511 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599c3665ca0 0x5599c3669a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:05.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.219+0000 7f611659c700 1 --2- 172.21.15.82:0/1108287511 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5599c3665380 0x5599c3669520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:05.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.219+0000 7f610dd9b700 1 -- 172.21.15.82:0/1108287511 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599c3665ca0 msgr2=0x5599c3669a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:05.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.219+0000 7f610dd9b700 1 --2- 172.21.15.82:0/1108287511 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599c3665ca0 0x5599c3669a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:05.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.219+0000 7f610dd9b700 1 -- 172.21.15.82:0/1108287511 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5599c3665380 msgr2=0x5599c3669520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:05.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.219+0000 7f610dd9b700 1 --2- 172.21.15.82:0/1108287511 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5599c3665380 0x5599c3669520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:05.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.219+0000 7f610dd9b700 1 -- 172.21.15.82:0/1108287511 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61080091a0 con 0x5599c365fc40 2023-09-23T09:30:05.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.220+0000 7f610dd9b700 1 --2- 172.21.15.82:0/1108287511 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5599c365fc40 0x5599c3668fe0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f6100000c00 tx=0x7f6100009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa0c7e3f8c39b879 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:05.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.220+0000 7f60fdffb700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T09:30:05.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.220+0000 7f60fdffb700 1 -- 172.21.15.82:0/1108287511 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f610000ba50 con 0x5599c365fc40 2023-09-23T09:30:05.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.220+0000 7f60fdffb700 1 -- 172.21.15.82:0/1108287511 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(141..141 src has 1..141) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f6100005040 con 0x5599c365fc40 2023-09-23T09:30:05.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.220+0000 7f6130472b80 1 -- 172.21.15.82:0/1108287511 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5599c362f1c0 con 0x5599c365fc40 2023-09-23T09:30:05.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.221+0000 7f60fdffb700 1 -- 172.21.15.82:0/1108287511 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=95) v2 ==== 24+0+0 (secure 0 0 0) 0x7f610000bbb0 con 0x5599c365fc40 2023-09-23T09:30:05.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.221+0000 7f6130472b80 10 client.27217 fetch_fsmap learned FSMap version 95 2023-09-23T09:30:05.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.221+0000 7f6130472b80 1 -- 172.21.15.82:0/1108287511 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=95,monmap=4+}) v3 -- 0x5599c33ddde0 con 0x5599c365fc40 2023-09-23T09:30:05.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.221+0000 7f60fdffb700 1 -- 172.21.15.82:0/1108287511 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5599c362f1c0 con 0x5599c365fc40 2023-09-23T09:30:05.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.222+0000 7f60fdffb700 1 -- 172.21.15.82:0/1108287511 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 95) v1 ==== 7934+0+0 (secure 0 0 0) 0x7f6100022070 con 0x5599c365fc40 2023-09-23T09:30:05.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.222+0000 7f6130472b80 10 client.27217 fetch_fsmap finished waiting for FSMap version 95 2023-09-23T09:30:05.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.222+0000 7f6130472b80 10 client.27217 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2023-09-23T09:30:05.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.222+0000 7f6130472b80 20 client.27217 populate_metadata read hostname 'smithi082' 2023-09-23T09:30:05.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.222+0000 7f6130472b80 1 --2- 172.21.15.82:0/1108287511 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x5599c368a720 0x5599c368cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:05.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.222+0000 7f6130472b80 4 client.27217 mds_command: new command op to 24514 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:30:05.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.222+0000 7f6130472b80 1 -- 172.21.15.82:0/1108287511 --> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5599c3557ba0 con 0x5599c368a720 2023-09-23T09:30:05.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.223+0000 7f611659c700 1 --2- 172.21.15.82:0/1108287511 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x5599c368a720 0x5599c368cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:05.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.224+0000 7f60fdffb700 10 client.27217 ms_handle_connect on v2:172.21.15.161:6834/2237964162 2023-09-23T09:30:05.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.224+0000 7f611659c700 1 --2- 172.21.15.82:0/1108287511 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x5599c368a720 0x5599c368cb40 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=596b2613ad76a01a server_cookie=ec12a3c2c733a202 in_seq=0 out_seq=0 2023-09-23T09:30:05.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.225+0000 7f60fdffb700 1 -- 172.21.15.82:0/1108287511 <== mds.4 v2:172.21.15.161:6834/2237964162 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5599c3557ba0 con 0x5599c368a720 2023-09-23T09:30:05.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.225+0000 7f60fdffb700 10 client.27217 handle_command_reply: tid=0 2023-09-23T09:30:05.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.225+0000 7f6130472b80 1 client.27217 shutdown 2023-09-23T09:30:05.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.226+0000 7f6130472b80 1 -- 172.21.15.82:0/1108287511 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5599c365fc40 msgr2=0x5599c3668fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:05.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.226+0000 7f6130472b80 1 --2- 172.21.15.82:0/1108287511 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5599c365fc40 0x5599c3668fe0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f6100000c00 tx=0x7f6100009c00 comp rx=0 tx=0).stop 2023-09-23T09:30:05.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.226+0000 7f6130472b80 1 -- 172.21.15.82:0/1108287511 shutdown_connections 2023-09-23T09:30:05.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.226+0000 7f6130472b80 1 --2- 172.21.15.82:0/1108287511 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x5599c368a720 0x5599c368cb40 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:05.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.226+0000 7f6130472b80 1 --2- 172.21.15.82:0/1108287511 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599c3665ca0 0x5599c3669a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:05.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.226+0000 7f6130472b80 1 --2- 172.21.15.82:0/1108287511 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5599c365fc40 0x5599c3668fe0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:05.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.226+0000 7f60fdffb700 0 client.27217 ms_handle_reset on v2:172.21.15.161:6834/2237964162 2023-09-23T09:30:05.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.226+0000 7f6130472b80 1 --2- 172.21.15.82:0/1108287511 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5599c3665380 0x5599c3669520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:05.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.226+0000 7f6130472b80 1 -- 172.21.15.82:0/1108287511 >> 172.21.15.82:0/1108287511 conn(0x5599c35d40e0 msgr2=0x5599c3654b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:05.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.226+0000 7f6130472b80 1 -- 172.21.15.82:0/1108287511 shutdown_connections 2023-09-23T09:30:05.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.226+0000 7f6130472b80 1 -- 172.21.15.82:0/1108287511 wait complete. 2023-09-23T09:30:05.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.227+0000 7f6130472b80 20 client.27217 trim_cache size 0 max 16384 2023-09-23T09:30:05.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.252+0000 7f6130472b80 1 Processor -- start 2023-09-23T09:30:05.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.252+0000 7f6130472b80 1 -- start start 2023-09-23T09:30:05.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.253+0000 7f6130472b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5599c365fc40 0x5599c365f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:05.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.253+0000 7f6130472b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599c3665380 0x5599c3670790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:05.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.253+0000 7f6130472b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5599c3665ca0 0x5599c3668570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:05.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.253+0000 7f6130472b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599c3433920 con 0x5599c3665ca0 2023-09-23T09:30:05.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.253+0000 7f6130472b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599c36871c0 con 0x5599c3665380 2023-09-23T09:30:05.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.253+0000 7f6130472b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599c3656cb0 con 0x5599c365fc40 2023-09-23T09:30:05.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.254+0000 7f610dd9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5599c365fc40 0x5599c365f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:05.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.254+0000 7f610dd9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5599c365fc40 0x5599c365f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:54796/0 (socket says 172.21.15.82:54796) 2023-09-23T09:30:05.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.254+0000 7f610dd9b700 1 -- 172.21.15.82:0/596642285 learned_addr learned my addr 172.21.15.82:0/596642285 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:30:05.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.254+0000 7f610dd9b700 1 --2- 172.21.15.82:0/596642285 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5599c3665ca0 0x5599c3668570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:05.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.254+0000 7f611659c700 1 --2- 172.21.15.82:0/596642285 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599c3665380 0x5599c3670790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:05.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.255+0000 7f611659c700 1 -- 172.21.15.82:0/596642285 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5599c365fc40 msgr2=0x5599c365f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:05.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.255+0000 7f611659c700 1 --2- 172.21.15.82:0/596642285 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5599c365fc40 0x5599c365f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:05.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.255+0000 7f611659c700 1 -- 172.21.15.82:0/596642285 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5599c3665ca0 msgr2=0x5599c3668570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:05.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.255+0000 7f611659c700 1 --2- 172.21.15.82:0/596642285 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5599c3665ca0 0x5599c3668570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:05.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.255+0000 7f611659c700 1 -- 172.21.15.82:0/596642285 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5599c33c6c60 con 0x5599c3665380 2023-09-23T09:30:05.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.255+0000 7f610dd9b700 1 --2- 172.21.15.82:0/596642285 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5599c3665ca0 0x5599c3668570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:30:05.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.255+0000 7f611659c700 1 --2- 172.21.15.82:0/596642285 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599c3665380 0x5599c3670790 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f61080094c0 tx=0x7f6108008fb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef088e10f92f8b3d server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:05.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.256+0000 7f610d59a700 1 -- 172.21.15.82:0/596642285 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6108004c50 con 0x5599c3665380 2023-09-23T09:30:05.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.256+0000 7f610d59a700 1 -- 172.21.15.82:0/596642285 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f610800f070 con 0x5599c3665380 2023-09-23T09:30:05.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.256+0000 7f610d59a700 1 -- 172.21.15.82:0/596642285 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6108027ea0 con 0x5599c3665380 2023-09-23T09:30:05.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.257+0000 7f6130472b80 1 -- 172.21.15.82:0/596642285 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599c3665380 msgr2=0x5599c3670790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:05.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.257+0000 7f6130472b80 1 --2- 172.21.15.82:0/596642285 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599c3665380 0x5599c3670790 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f61080094c0 tx=0x7f6108008fb0 comp rx=0 tx=0).stop 2023-09-23T09:30:05.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.257+0000 7f6130472b80 1 -- 172.21.15.82:0/596642285 shutdown_connections 2023-09-23T09:30:05.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.257+0000 7f6130472b80 1 --2- 172.21.15.82:0/596642285 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5599c3665ca0 0x5599c3668570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:05.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.257+0000 7f6130472b80 1 --2- 172.21.15.82:0/596642285 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5599c365fc40 0x5599c365f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:05.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.257+0000 7f6130472b80 1 --2- 172.21.15.82:0/596642285 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599c3665380 0x5599c3670790 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:05.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.257+0000 7f6130472b80 1 -- 172.21.15.82:0/596642285 >> 172.21.15.82:0/596642285 conn(0x5599c35d40e0 msgr2=0x5599c3663130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:05.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.257+0000 7f6130472b80 1 -- 172.21.15.82:0/596642285 shutdown_connections 2023-09-23T09:30:05.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.257+0000 7f6130472b80 1 -- 172.21.15.82:0/596642285 wait complete. 2023-09-23T09:30:05.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.258+0000 7f6130472b80 1 -- start start 2023-09-23T09:30:05.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.258+0000 7f6130472b80 1 Processor -- start 2023-09-23T09:30:05.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.259+0000 7f6130472b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5599c365fc40 0x5599c36701b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:05.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.259+0000 7f6130472b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5599c3665380 0x5599c36706f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:05.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.259+0000 7f6130472b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599c3665ca0 0x5599c366e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:05.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.259+0000 7f6130472b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599c366ec10 con 0x5599c365fc40 2023-09-23T09:30:05.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.259+0000 7f6130472b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599c366ed80 con 0x5599c3665ca0 2023-09-23T09:30:05.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.259+0000 7f6130472b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599c366ef40 con 0x5599c3665380 2023-09-23T09:30:05.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.259+0000 7f6130472b80 10 client.0 _ll_register_callbacks cb 0x7f610000f800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:30:05.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.259+0000 7f610dd9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5599c365fc40 0x5599c36701b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:05.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.259+0000 7f610dd9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5599c365fc40 0x5599c36701b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47868/0 (socket says 172.21.15.82:47868) 2023-09-23T09:30:05.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.259+0000 7f610dd9b700 1 -- 172.21.15.82:0/1234935724 learned_addr learned my addr 172.21.15.82:0/1234935724 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:30:05.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.260+0000 7f610dd9b700 1 --2- 172.21.15.82:0/1234935724 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599c3665ca0 0x5599c366e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:05.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.260+0000 7f611659c700 1 --2- 172.21.15.82:0/1234935724 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5599c3665380 0x5599c36706f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:05.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.261+0000 7f610dd9b700 1 -- 172.21.15.82:0/1234935724 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5599c3665380 msgr2=0x5599c36706f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:05.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.261+0000 7f610dd9b700 1 --2- 172.21.15.82:0/1234935724 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5599c3665380 0x5599c36706f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:05.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.261+0000 7f610dd9b700 1 -- 172.21.15.82:0/1234935724 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5599c365fc40 msgr2=0x5599c36701b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:05.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.261+0000 7f610dd9b700 1 --2- 172.21.15.82:0/1234935724 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5599c365fc40 0x5599c36701b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:05.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.261+0000 7f610dd9b700 1 -- 172.21.15.82:0/1234935724 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5599c3431630 con 0x5599c3665ca0 2023-09-23T09:30:05.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.261+0000 7f610dd9b700 1 --2- 172.21.15.82:0/1234935724 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599c3665ca0 0x5599c366e500 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f610000c010 tx=0x7f6100009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e894a30d4a7489c server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:05.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.261+0000 7f60fdffb700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-09-23T09:30:05.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.261+0000 7f60fdffb700 1 -- 172.21.15.82:0/1234935724 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6100003890 con 0x5599c3665ca0 2023-09-23T09:30:05.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.261+0000 7f6130472b80 1 -- 172.21.15.82:0/1234935724 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5599c36528b0 con 0x5599c3665ca0 2023-09-23T09:30:05.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.261+0000 7f60fdffb700 1 -- 172.21.15.82:0/1234935724 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(141..141 src has 1..141) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f6100005000 con 0x5599c3665ca0 2023-09-23T09:30:05.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.262+0000 7f60fdffb700 1 -- 172.21.15.82:0/1234935724 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=95) v2 ==== 24+0+0 (secure 0 0 0) 0x7f61000051c0 con 0x5599c3665ca0 2023-09-23T09:30:05.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.262+0000 7f6130472b80 10 client.27191 fetch_fsmap learned FSMap version 95 2023-09-23T09:30:05.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.262+0000 7f6130472b80 1 -- 172.21.15.82:0/1234935724 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=95,monmap=4+}) v3 -- 0x5599c3404250 con 0x5599c3665ca0 2023-09-23T09:30:05.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.262+0000 7f60fdffb700 1 -- 172.21.15.82:0/1234935724 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5599c36528b0 con 0x5599c3665ca0 2023-09-23T09:30:05.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.264+0000 7f60fdffb700 1 -- 172.21.15.82:0/1234935724 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 95) v1 ==== 7934+0+0 (secure 0 0 0) 0x7f6100009c70 con 0x5599c3665ca0 2023-09-23T09:30:05.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.269+0000 7f6130472b80 10 client.27191 fetch_fsmap finished waiting for FSMap version 95 2023-09-23T09:30:05.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.269+0000 7f6130472b80 10 client.27191 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2023-09-23T09:30:05.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.269+0000 7f6130472b80 20 client.27191 populate_metadata read hostname 'smithi082' 2023-09-23T09:30:05.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.269+0000 7f6130472b80 1 --2- 172.21.15.82:0/1234935724 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x5599c36df380 0x5599c36e17a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:05.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.269+0000 7f6130472b80 4 client.27191 mds_command: new command op to 24514 tid=0[{"prefix": "damage ls"}] 2023-09-23T09:30:05.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.269+0000 7f6130472b80 1 -- 172.21.15.82:0/1234935724 --> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5599c35aa970 con 0x5599c36df380 2023-09-23T09:30:05.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.272+0000 7f611659c700 1 --2- 172.21.15.82:0/1234935724 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x5599c36df380 0x5599c36e17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:05.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.277+0000 7f611659c700 1 --2- 172.21.15.82:0/1234935724 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x5599c36df380 0x5599c36e17a0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=146a7aa7e38bc328 server_cookie=ab98bc23426f0852 in_seq=0 out_seq=0 2023-09-23T09:30:05.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.277+0000 7f60fdffb700 10 client.27191 ms_handle_connect on v2:172.21.15.161:6834/2237964162 2023-09-23T09:30:05.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.279+0000 7f60fdffb700 1 -- 172.21.15.82:0/1234935724 <== mds.4 v2:172.21.15.161:6834/2237964162 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5599c35aa970 con 0x5599c36df380 2023-09-23T09:30:05.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.279+0000 7f60fdffb700 10 client.27191 handle_command_reply: tid=0 2023-09-23T09:30:05.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.280+0000 7f6130472b80 1 client.27191 shutdown 2023-09-23T09:30:05.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.282+0000 7f6130472b80 1 -- 172.21.15.82:0/1234935724 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599c3665ca0 msgr2=0x5599c366e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:05.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.282+0000 7f6130472b80 1 --2- 172.21.15.82:0/1234935724 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599c3665ca0 0x5599c366e500 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f610000c010 tx=0x7f6100009c00 comp rx=0 tx=0).stop 2023-09-23T09:30:05.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.283+0000 7f6130472b80 1 -- 172.21.15.82:0/1234935724 shutdown_connections 2023-09-23T09:30:05.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.283+0000 7f6130472b80 1 --2- 172.21.15.82:0/1234935724 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x5599c36df380 0x5599c36e17a0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:05.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.283+0000 7f6130472b80 1 --2- 172.21.15.82:0/1234935724 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599c3665ca0 0x5599c366e500 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:05.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.283+0000 7f6130472b80 1 --2- 172.21.15.82:0/1234935724 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5599c365fc40 0x5599c36701b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:05.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.283+0000 7f6130472b80 1 --2- 172.21.15.82:0/1234935724 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5599c3665380 0x5599c36706f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:05.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.283+0000 7f6130472b80 1 -- 172.21.15.82:0/1234935724 >> 172.21.15.82:0/1234935724 conn(0x5599c35d40e0 msgr2=0x5599c3669570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:05.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.283+0000 7f60fdffb700 0 client.27191 ms_handle_reset on v2:172.21.15.161:6834/2237964162 2023-09-23T09:30:05.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.283+0000 7f6130472b80 1 -- 172.21.15.82:0/1234935724 shutdown_connections 2023-09-23T09:30:05.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.284+0000 7f6130472b80 1 -- 172.21.15.82:0/1234935724 wait complete. 2023-09-23T09:30:05.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.286+0000 7f6130472b80 20 client.27191 trim_cache size 0 max 16384 2023-09-23T09:30:05.293 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2023-09-23T09:30:05.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.292+0000 7f611cbff700 1 -- 172.21.15.82:0/1166084674 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f61040a0180 msgr2=0x7f61040a2640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:05.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.292+0000 7f611cbff700 1 --2- 172.21.15.82:0/1166084674 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f61040a0180 0x7f61040a2640 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f61100c90e0 tx=0x7f611000efa0 comp rx=0 tx=0).stop 2023-09-23T09:30:05.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.292+0000 7f611cbff700 1 -- 172.21.15.82:0/1166084674 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6118111880 msgr2=0x7f61181a1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:05.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.292+0000 7f611cbff700 1 --2- 172.21.15.82:0/1166084674 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6118111880 0x7f61181a1940 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f6110005950 tx=0x7f611000ed60 comp rx=0 tx=0).stop 2023-09-23T09:30:05.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.294+0000 7f611cbff700 1 -- 172.21.15.82:0/1166084674 shutdown_connections 2023-09-23T09:30:05.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.294+0000 7f611cbff700 1 --2- 172.21.15.82:0/1166084674 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f61040a0180 0x7f61040a2640 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:05.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.294+0000 7f611cbff700 1 --2- 172.21.15.82:0/1166084674 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6118111880 0x7f61181a1940 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:05.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.294+0000 7f611cbff700 1 --2- 172.21.15.82:0/1166084674 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6118072cc0 0x7f611819cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:05.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.294+0000 7f611cbff700 1 --2- 172.21.15.82:0/1166084674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61180735e0 0x7f611819d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:05.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.294+0000 7f611cbff700 1 -- 172.21.15.82:0/1166084674 >> 172.21.15.82:0/1166084674 conn(0x7f61180fc3a0 msgr2=0x7f61180fd010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:05.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.298+0000 7f611cbff700 1 -- 172.21.15.82:0/1166084674 shutdown_connections 2023-09-23T09:30:05.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.301+0000 7f611cbff700 1 -- 172.21.15.82:0/1166084674 wait complete. 2023-09-23T09:30:05.332 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-09-23T09:30:05.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.698+0000 7f4b8b9ff700 1 -- 172.21.15.82:0/3290503033 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b8411a100 msgr2=0x7f4b8411c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:05.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.698+0000 7f4b8b9ff700 1 --2- 172.21.15.82:0/3290503033 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b8411a100 0x7f4b8411c4f0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f4b8000b0a0 tx=0x7f4b8000b3b0 comp rx=0 tx=0).stop 2023-09-23T09:30:05.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.700+0000 7f4b8b9ff700 1 -- 172.21.15.82:0/3290503033 shutdown_connections 2023-09-23T09:30:05.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.700+0000 7f4b8b9ff700 1 --2- 172.21.15.82:0/3290503033 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b8411a100 0x7f4b8411c4f0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:05.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.700+0000 7f4b8b9ff700 1 --2- 172.21.15.82:0/3290503033 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b8410efd0 0x7f4b8410cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:05.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.700+0000 7f4b8b9ff700 1 --2- 172.21.15.82:0/3290503033 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4b8410f440 0x7f4b8410d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:05.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.700+0000 7f4b8b9ff700 1 -- 172.21.15.82:0/3290503033 >> 172.21.15.82:0/3290503033 conn(0x7f4b8406cbe0 msgr2=0x7f4b8406cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:05.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.700+0000 7f4b8b9ff700 1 -- 172.21.15.82:0/3290503033 shutdown_connections 2023-09-23T09:30:05.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.700+0000 7f4b8b9ff700 1 -- 172.21.15.82:0/3290503033 wait complete. 2023-09-23T09:30:05.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.702+0000 7f4b8b9ff700 1 Processor -- start 2023-09-23T09:30:05.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.702+0000 7f4b8b9ff700 1 -- start start 2023-09-23T09:30:05.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.703+0000 7f4b8b9ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4b8410efd0 0x7f4b84118470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:05.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.703+0000 7f4b8b9ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b8411a100 0x7f4b841189f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:05.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.703+0000 7f4b8b9ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b84111480 0x7f4b84111930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:05.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.703+0000 7f4b8b9ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b84112100 con 0x7f4b8411a100 2023-09-23T09:30:05.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.703+0000 7f4b8b9ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b84112270 con 0x7f4b84111480 2023-09-23T09:30:05.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.703+0000 7f4b8b9ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b84116000 con 0x7f4b8410efd0 2023-09-23T09:30:05.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.704+0000 7f4b89f9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b84111480 0x7f4b84111930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:05.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.704+0000 7f4b89f9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b84111480 0x7f4b84111930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:57604/0 (socket says 172.21.15.82:57604) 2023-09-23T09:30:05.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.704+0000 7f4b89f9c700 1 -- 172.21.15.82:0/2457712995 learned_addr learned my addr 172.21.15.82:0/2457712995 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:30:05.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.705+0000 7f4b89f9c700 1 -- 172.21.15.82:0/2457712995 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4b8410efd0 msgr2=0x7f4b84118470 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-09-23T09:30:05.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.705+0000 7f4b89f9c700 1 --2- 172.21.15.82:0/2457712995 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4b8410efd0 0x7f4b84118470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:05.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.705+0000 7f4b89f9c700 1 -- 172.21.15.82:0/2457712995 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b8411a100 msgr2=0x7f4b841189f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:05.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.705+0000 7f4b89f9c700 1 --2- 172.21.15.82:0/2457712995 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b8411a100 0x7f4b841189f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:05.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.705+0000 7f4b89f9c700 1 -- 172.21.15.82:0/2457712995 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b80009d00 con 0x7f4b84111480 2023-09-23T09:30:05.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.705+0000 7f4b89f9c700 1 --2- 172.21.15.82:0/2457712995 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b84111480 0x7f4b84111930 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f4b80009750 tx=0x7f4b80005b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:05.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.707+0000 7f4b7a7fc700 1 -- 172.21.15.82:0/2457712995 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b8000e040 con 0x7f4b84111480 2023-09-23T09:30:05.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.707+0000 7f4b7a7fc700 1 -- 172.21.15.82:0/2457712995 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4b80003e10 con 0x7f4b84111480 2023-09-23T09:30:05.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.707+0000 7f4b7a7fc700 1 -- 172.21.15.82:0/2457712995 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b80012af0 con 0x7f4b84111480 2023-09-23T09:30:05.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.707+0000 7f4b8b9ff700 1 -- 172.21.15.82:0/2457712995 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b84116220 con 0x7f4b84111480 2023-09-23T09:30:05.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.707+0000 7f4b8b9ff700 1 -- 172.21.15.82:0/2457712995 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b84116680 con 0x7f4b84111480 2023-09-23T09:30:05.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.713+0000 7f4b7a7fc700 1 -- 172.21.15.82:0/2457712995 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f4b80005700 con 0x7f4b84111480 2023-09-23T09:30:05.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.715+0000 7f4b9f2aab80 1 Processor -- start 2023-09-23T09:30:05.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.716+0000 7f4b7a7fc700 1 --2- 172.21.15.82:0/2457712995 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f4b700a02d0 0x7f4b700a2790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:05.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.716+0000 7f4b7a7fc700 1 -- 172.21.15.82:0/2457712995 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f4b800ccb40 con 0x7f4b84111480 2023-09-23T09:30:05.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.717+0000 7f4b9f2aab80 1 -- start start 2023-09-23T09:30:05.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.717+0000 7f4b9f2aab80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5588ffa1e380 0x5588ffa1e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:05.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.717+0000 7f4b9f2aab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5588ffa1eca0 0x5588ffa18700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:05.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.717+0000 7f4b9f2aab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588ffa18c40 0x5588ffa190a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:05.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.717+0000 7f4b9f2aab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588ff9807b0 con 0x5588ffa1eca0 2023-09-23T09:30:05.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.717+0000 7f4b9f2aab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588ff971780 con 0x5588ffa18c40 2023-09-23T09:30:05.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.717+0000 7f4b9f2aab80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588ff96f0a0 con 0x5588ffa1e380 2023-09-23T09:30:05.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.718+0000 7f4b89f9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588ffa18c40 0x5588ffa190a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:05.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.718+0000 7f4b89f9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588ffa18c40 0x5588ffa190a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:57614/0 (socket says 172.21.15.82:57614) 2023-09-23T09:30:05.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.718+0000 7f4b89f9c700 1 -- 172.21.15.82:0/2850531017 learned_addr learned my addr 172.21.15.82:0/2850531017 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:30:05.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.718+0000 7f4b8979b700 1 --2- 172.21.15.82:0/2850531017 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5588ffa1e380 0x5588ffa1e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:05.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.719+0000 7f4b89f9c700 1 -- 172.21.15.82:0/2850531017 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5588ffa1e380 msgr2=0x5588ffa1e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:05.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.719+0000 7f4b89f9c700 1 --2- 172.21.15.82:0/2850531017 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5588ffa1e380 0x5588ffa1e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:05.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.719+0000 7f4b89f9c700 1 -- 172.21.15.82:0/2850531017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5588ffa1eca0 msgr2=0x5588ffa18700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:05.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.719+0000 7f4b89f9c700 1 --2- 172.21.15.82:0/2850531017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5588ffa1eca0 0x5588ffa18700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:05.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.719+0000 7f4b89f9c700 1 -- 172.21.15.82:0/2850531017 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5588ff7ea630 con 0x5588ffa18c40 2023-09-23T09:30:05.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.719+0000 7f4b89f9c700 1 --2- 172.21.15.82:0/2850531017 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588ffa18c40 0x5588ffa190a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f4b80096d80 tx=0x7f4b800099e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=452558671909904c server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:05.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.720+0000 7f4b88f9a700 1 --2- 172.21.15.82:0/2457712995 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f4b700a02d0 0x7f4b700a2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:05.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.721+0000 7f4b88f9a700 1 --2- 172.21.15.82:0/2457712995 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f4b700a02d0 0x7f4b700a2790 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4b74007fd0 tx=0x7f4b74007b40 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:05.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.721+0000 7f4b6f7fe700 1 -- 172.21.15.82:0/2850531017 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b8009e140 con 0x5588ffa18c40 2023-09-23T09:30:05.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.721+0000 7f4b6f7fe700 1 -- 172.21.15.82:0/2850531017 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4b800a2090 con 0x5588ffa18c40 2023-09-23T09:30:05.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.721+0000 7f4b6f7fe700 1 -- 172.21.15.82:0/2850531017 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b800ca4b0 con 0x5588ffa18c40 2023-09-23T09:30:05.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.725+0000 7f4b9f2aab80 1 -- 172.21.15.82:0/2850531017 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588ffa18c40 msgr2=0x5588ffa190a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:05.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.725+0000 7f4b9f2aab80 1 --2- 172.21.15.82:0/2850531017 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588ffa18c40 0x5588ffa190a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f4b80096d80 tx=0x7f4b800099e0 comp rx=0 tx=0).stop 2023-09-23T09:30:05.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.726+0000 7f4b9f2aab80 1 -- 172.21.15.82:0/2850531017 shutdown_connections 2023-09-23T09:30:05.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.726+0000 7f4b9f2aab80 1 --2- 172.21.15.82:0/2850531017 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588ffa18c40 0x5588ffa190a0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:05.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.726+0000 7f4b9f2aab80 1 --2- 172.21.15.82:0/2850531017 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5588ffa1e380 0x5588ffa1e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:05.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.726+0000 7f4b9f2aab80 1 --2- 172.21.15.82:0/2850531017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5588ffa1eca0 0x5588ffa18700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:05.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.726+0000 7f4b9f2aab80 1 -- 172.21.15.82:0/2850531017 >> 172.21.15.82:0/2850531017 conn(0x5588ff98d0e0 msgr2=0x5588ffa13410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:05.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.727+0000 7f4b9f2aab80 1 -- 172.21.15.82:0/2850531017 shutdown_connections 2023-09-23T09:30:05.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.728+0000 7f4b9f2aab80 1 -- 172.21.15.82:0/2850531017 wait complete. 2023-09-23T09:30:05.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.729+0000 7f4b9f2aab80 1 -- start start 2023-09-23T09:30:05.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.729+0000 7f4b9f2aab80 1 Processor -- start 2023-09-23T09:30:05.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.730+0000 7f4b9f2aab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588ffa18c40 0x5588ffa24c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:05.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.730+0000 7f4b9f2aab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5588ffa1e380 0x5588ffa21f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:05.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.730+0000 7f4b9f2aab80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5588ffa1eca0 0x5588ffa225b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:05.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.730+0000 7f4b9f2aab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588ff96a990 con 0x5588ffa1e380 2023-09-23T09:30:05.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.730+0000 7f4b9f2aab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588ff908bb0 con 0x5588ffa18c40 2023-09-23T09:30:05.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.730+0000 7f4b9f2aab80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588ff9088b0 con 0x5588ffa1eca0 2023-09-23T09:30:05.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.730+0000 7f4b9f2aab80 10 client.0 _ll_register_callbacks cb 0x5588ff852a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:30:05.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.730+0000 7f4b88f9a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5588ffa1e380 0x5588ffa21f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:05.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.730+0000 7f4b88f9a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5588ffa1e380 0x5588ffa21f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47908/0 (socket says 172.21.15.82:47908) 2023-09-23T09:30:05.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.730+0000 7f4b88f9a700 1 -- 172.21.15.82:0/4184900669 learned_addr learned my addr 172.21.15.82:0/4184900669 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:30:05.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.731+0000 7f4b89f9c700 1 --2- 172.21.15.82:0/4184900669 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5588ffa1eca0 0x5588ffa225b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:05.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.731+0000 7f4b8979b700 1 --2- 172.21.15.82:0/4184900669 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588ffa18c40 0x5588ffa24c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:05.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.731+0000 7f4b88f9a700 1 -- 172.21.15.82:0/4184900669 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5588ffa1eca0 msgr2=0x5588ffa225b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:05.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.731+0000 7f4b88f9a700 1 --2- 172.21.15.82:0/4184900669 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5588ffa1eca0 0x5588ffa225b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:05.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.731+0000 7f4b88f9a700 1 -- 172.21.15.82:0/4184900669 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588ffa18c40 msgr2=0x5588ffa24c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:05.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.731+0000 7f4b88f9a700 1 --2- 172.21.15.82:0/4184900669 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588ffa18c40 0x5588ffa24c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:05.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.731+0000 7f4b88f9a700 1 -- 172.21.15.82:0/4184900669 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b84116680 con 0x5588ffa1e380 2023-09-23T09:30:05.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.732+0000 7f4b88f9a700 1 --2- 172.21.15.82:0/4184900669 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5588ffa1e380 0x5588ffa21f10 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f4b74016f20 tx=0x7f4b74004800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59e2d901109fa016 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:05.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.732+0000 7f4b6cff9700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:30:05.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.732+0000 7f4b6cff9700 1 -- 172.21.15.82:0/4184900669 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b7401b070 con 0x5588ffa1e380 2023-09-23T09:30:05.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.732+0000 7f4b6cff9700 1 -- 172.21.15.82:0/4184900669 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(141..141 src has 1..141) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f4b74013aa0 con 0x5588ffa1e380 2023-09-23T09:30:05.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.732+0000 7f4b9f2aab80 1 -- 172.21.15.82:0/4184900669 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5588ff9e81c0 con 0x5588ffa1e380 2023-09-23T09:30:05.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.733+0000 7f4b6cff9700 1 -- 172.21.15.82:0/4184900669 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=95) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4b740163a0 con 0x5588ffa1e380 2023-09-23T09:30:05.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.733+0000 7f4b9f2aab80 10 client.17499 fetch_fsmap learned FSMap version 95 2023-09-23T09:30:05.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.733+0000 7f4b9f2aab80 1 -- 172.21.15.82:0/4184900669 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=95,monmap=4+}) v3 -- 0x5588ff796de0 con 0x5588ffa1e380 2023-09-23T09:30:05.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.734+0000 7f4b6cff9700 1 -- 172.21.15.82:0/4184900669 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5588ff9e81c0 con 0x5588ffa1e380 2023-09-23T09:30:05.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.734+0000 7f4b6cff9700 1 -- 172.21.15.82:0/4184900669 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 95) v1 ==== 7934+0+0 (secure 0 0 0) 0x7f4b7401f410 con 0x5588ffa1e380 2023-09-23T09:30:05.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.734+0000 7f4b9f2aab80 10 client.17499 fetch_fsmap finished waiting for FSMap version 95 2023-09-23T09:30:05.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.734+0000 7f4b9f2aab80 10 client.17499 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2023-09-23T09:30:05.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.734+0000 7f4b9f2aab80 20 client.17499 populate_metadata read hostname 'smithi082' 2023-09-23T09:30:05.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.734+0000 7f4b9f2aab80 1 --2- 172.21.15.82:0/4184900669 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x5588ffa324b0 0x5588ffa348d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:05.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.734+0000 7f4b9f2aab80 4 client.17499 mds_command: new command op to 24515 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:30:05.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.734+0000 7f4b9f2aab80 1 -- 172.21.15.82:0/4184900669 --> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5588ff910ba0 con 0x5588ffa324b0 2023-09-23T09:30:05.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.735+0000 7f4b8979b700 1 --2- 172.21.15.82:0/4184900669 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x5588ffa324b0 0x5588ffa348d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:05.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.736+0000 7f4b8979b700 1 --2- 172.21.15.82:0/4184900669 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x5588ffa324b0 0x5588ffa348d0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=9be105f6351b4831 server_cookie=ac6ce61b113d12dc in_seq=0 out_seq=0 2023-09-23T09:30:05.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.736+0000 7f4b6cff9700 10 client.17499 ms_handle_connect on v2:172.21.15.135:6836/2655304858 2023-09-23T09:30:05.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.737+0000 7f4b6cff9700 1 -- 172.21.15.82:0/4184900669 <== mds.3 v2:172.21.15.135:6836/2655304858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5588ff910ba0 con 0x5588ffa324b0 2023-09-23T09:30:05.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.737+0000 7f4b6cff9700 10 client.17499 handle_command_reply: tid=0 2023-09-23T09:30:05.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.737+0000 7f4b9f2aab80 1 client.17499 shutdown 2023-09-23T09:30:05.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.737+0000 7f4b9f2aab80 1 -- 172.21.15.82:0/4184900669 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5588ffa1e380 msgr2=0x5588ffa21f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:05.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.737+0000 7f4b9f2aab80 1 --2- 172.21.15.82:0/4184900669 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5588ffa1e380 0x5588ffa21f10 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f4b74016f20 tx=0x7f4b74004800 comp rx=0 tx=0).stop 2023-09-23T09:30:05.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.737+0000 7f4b9f2aab80 1 -- 172.21.15.82:0/4184900669 shutdown_connections 2023-09-23T09:30:05.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.737+0000 7f4b9f2aab80 1 --2- 172.21.15.82:0/4184900669 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x5588ffa324b0 0x5588ffa348d0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:05.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.737+0000 7f4b9f2aab80 1 --2- 172.21.15.82:0/4184900669 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5588ffa1eca0 0x5588ffa225b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:05.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.737+0000 7f4b9f2aab80 1 --2- 172.21.15.82:0/4184900669 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588ffa18c40 0x5588ffa24c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:05.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.737+0000 7f4b9f2aab80 1 --2- 172.21.15.82:0/4184900669 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5588ffa1e380 0x5588ffa21f10 secure :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f4b74016f20 tx=0x7f4b74004800 comp rx=0 tx=0).stop 2023-09-23T09:30:05.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.737+0000 7f4b9f2aab80 1 -- 172.21.15.82:0/4184900669 >> 172.21.15.82:0/4184900669 conn(0x5588ff98d0e0 msgr2=0x5588ffa0db40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:05.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.737+0000 7f4b6cff9700 0 client.17499 ms_handle_reset on v2:172.21.15.135:6836/2655304858 2023-09-23T09:30:05.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.738+0000 7f4b9f2aab80 1 -- 172.21.15.82:0/4184900669 shutdown_connections 2023-09-23T09:30:05.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.738+0000 7f4b9f2aab80 1 -- 172.21.15.82:0/4184900669 wait complete. 2023-09-23T09:30:05.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.738+0000 7f4b9f2aab80 20 client.17499 trim_cache size 0 max 16384 2023-09-23T09:30:05.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.759+0000 7f4b9f2aab80 1 Processor -- start 2023-09-23T09:30:05.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.759+0000 7f4b9f2aab80 1 -- start start 2023-09-23T09:30:05.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.759+0000 7f4b9f2aab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5588ffa18c40 0x5588ffa18700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:05.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.759+0000 7f4b9f2aab80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5588ffa1eca0 0x5588ffa216d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:05.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.759+0000 7f4b9f2aab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588ffa130a0 0x5588ffa13520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:05.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.759+0000 7f4b9f2aab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588ff7ec920 con 0x5588ffa18c40 2023-09-23T09:30:05.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.759+0000 7f4b9f2aab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588ff910ba0 con 0x5588ffa130a0 2023-09-23T09:30:05.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.759+0000 7f4b9f2aab80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588ff9e81c0 con 0x5588ffa1eca0 2023-09-23T09:30:05.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.760+0000 7f4b89f9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588ffa130a0 0x5588ffa13520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:05.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.760+0000 7f4b88f9a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5588ffa1eca0 0x5588ffa216d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:05.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.760+0000 7f4b88f9a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5588ffa1eca0 0x5588ffa216d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:54852/0 (socket says 172.21.15.82:54852) 2023-09-23T09:30:05.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.760+0000 7f4b88f9a700 1 -- 172.21.15.82:0/42681823 learned_addr learned my addr 172.21.15.82:0/42681823 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:30:05.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.760+0000 7f4b88f9a700 1 -- 172.21.15.82:0/42681823 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588ffa130a0 msgr2=0x5588ffa13520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:05.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.760+0000 7f4b88f9a700 1 --2- 172.21.15.82:0/42681823 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588ffa130a0 0x5588ffa13520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:05.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.760+0000 7f4b88f9a700 1 -- 172.21.15.82:0/42681823 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5588ffa18c40 msgr2=0x5588ffa18700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:05.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.760+0000 7f4b88f9a700 1 --2- 172.21.15.82:0/42681823 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5588ffa18c40 0x5588ffa18700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:05.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.760+0000 7f4b88f9a700 1 -- 172.21.15.82:0/42681823 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5588ff77fc60 con 0x5588ffa1eca0 2023-09-23T09:30:05.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.761+0000 7f4b88f9a700 1 --2- 172.21.15.82:0/42681823 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5588ffa1eca0 0x5588ffa216d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4b7401f840 tx=0x7f4b74005eb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63c68812ef067b6f server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:05.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.761+0000 7f4b6ffff700 1 -- 172.21.15.82:0/42681823 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b7401b040 con 0x5588ffa1eca0 2023-09-23T09:30:05.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.762+0000 7f4b6ffff700 1 -- 172.21.15.82:0/42681823 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4b7401f410 con 0x5588ffa1eca0 2023-09-23T09:30:05.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.762+0000 7f4b6ffff700 1 -- 172.21.15.82:0/42681823 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b74013e70 con 0x5588ffa1eca0 2023-09-23T09:30:05.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.762+0000 7f4b9f2aab80 1 -- 172.21.15.82:0/42681823 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5588ffa1eca0 msgr2=0x5588ffa216d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:05.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.762+0000 7f4b9f2aab80 1 --2- 172.21.15.82:0/42681823 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5588ffa1eca0 0x5588ffa216d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4b7401f840 tx=0x7f4b74005eb0 comp rx=0 tx=0).stop 2023-09-23T09:30:05.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.762+0000 7f4b9f2aab80 1 -- 172.21.15.82:0/42681823 shutdown_connections 2023-09-23T09:30:05.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.762+0000 7f4b9f2aab80 1 --2- 172.21.15.82:0/42681823 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588ffa130a0 0x5588ffa13520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:05.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.762+0000 7f4b9f2aab80 1 --2- 172.21.15.82:0/42681823 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5588ffa18c40 0x5588ffa18700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:05.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.762+0000 7f4b9f2aab80 1 --2- 172.21.15.82:0/42681823 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5588ffa1eca0 0x5588ffa216d0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:05.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.762+0000 7f4b9f2aab80 1 -- 172.21.15.82:0/42681823 >> 172.21.15.82:0/42681823 conn(0x5588ff98d0e0 msgr2=0x5588ffa2dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:05.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.763+0000 7f4b9f2aab80 1 -- 172.21.15.82:0/42681823 shutdown_connections 2023-09-23T09:30:05.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.763+0000 7f4b9f2aab80 1 -- 172.21.15.82:0/42681823 wait complete. 2023-09-23T09:30:05.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.763+0000 7f4b9f2aab80 1 -- start start 2023-09-23T09:30:05.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.764+0000 7f4b9f2aab80 1 Processor -- start 2023-09-23T09:30:05.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.764+0000 7f4b9f2aab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588ffa130a0 0x5588ffa29490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:05.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.764+0000 7f4b9f2aab80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5588ffa18c40 0x5588ffa1a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:05.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.764+0000 7f4b9f2aab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5588ffa1eca0 0x5588ffa1a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:05.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.764+0000 7f4b9f2aab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588ffa1ae70 con 0x5588ffa1eca0 2023-09-23T09:30:05.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.764+0000 7f4b9f2aab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588ffa1afe0 con 0x5588ffa130a0 2023-09-23T09:30:05.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.764+0000 7f4b9f2aab80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588ffa862a0 con 0x5588ffa18c40 2023-09-23T09:30:05.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.764+0000 7f4b9f2aab80 10 client.0 _ll_register_callbacks cb 0x7f4b740168c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:30:05.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.765+0000 7f4b8979b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588ffa130a0 0x5588ffa29490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:05.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.765+0000 7f4b8979b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588ffa130a0 0x5588ffa29490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:57654/0 (socket says 172.21.15.82:57654) 2023-09-23T09:30:05.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.765+0000 7f4b8979b700 1 -- 172.21.15.82:0/2284349563 learned_addr learned my addr 172.21.15.82:0/2284349563 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:30:05.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.765+0000 7f4b89f9c700 1 --2- 172.21.15.82:0/2284349563 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5588ffa1eca0 0x5588ffa1a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:05.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.765+0000 7f4b88f9a700 1 --2- 172.21.15.82:0/2284349563 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5588ffa18c40 0x5588ffa1a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:05.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.765+0000 7f4b8979b700 1 -- 172.21.15.82:0/2284349563 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5588ffa18c40 msgr2=0x5588ffa1a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:05.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.765+0000 7f4b8979b700 1 --2- 172.21.15.82:0/2284349563 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5588ffa18c40 0x5588ffa1a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:05.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.765+0000 7f4b8979b700 1 -- 172.21.15.82:0/2284349563 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5588ffa1eca0 msgr2=0x5588ffa1a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:05.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.765+0000 7f4b8979b700 1 --2- 172.21.15.82:0/2284349563 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5588ffa1eca0 0x5588ffa1a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:05.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.765+0000 7f4b8979b700 1 -- 172.21.15.82:0/2284349563 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5588ff796de0 con 0x5588ffa130a0 2023-09-23T09:30:05.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.766+0000 7f4b8979b700 1 --2- 172.21.15.82:0/2284349563 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588ffa130a0 0x5588ffa29490 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x5588ffa35170 tx=0x7f4b7c015420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84e121959d45898f server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:05.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.766+0000 7f4b6cff9700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-09-23T09:30:05.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.766+0000 7f4b6cff9700 1 -- 172.21.15.82:0/2284349563 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b7c015ac0 con 0x5588ffa130a0 2023-09-23T09:30:05.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.766+0000 7f4b6cff9700 1 -- 172.21.15.82:0/2284349563 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(141..141 src has 1..141) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f4b7c01f070 con 0x5588ffa130a0 2023-09-23T09:30:05.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.766+0000 7f4b9f2aab80 1 -- 172.21.15.82:0/2284349563 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5588ffa0b8b0 con 0x5588ffa130a0 2023-09-23T09:30:05.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.767+0000 7f4b6cff9700 1 -- 172.21.15.82:0/2284349563 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=95) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4b7c015c20 con 0x5588ffa130a0 2023-09-23T09:30:05.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.767+0000 7f4b9f2aab80 10 client.27206 fetch_fsmap learned FSMap version 95 2023-09-23T09:30:05.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.767+0000 7f4b9f2aab80 1 -- 172.21.15.82:0/2284349563 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=95,monmap=4+}) v3 -- 0x5588ff7bd250 con 0x5588ffa130a0 2023-09-23T09:30:05.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.767+0000 7f4b6cff9700 1 -- 172.21.15.82:0/2284349563 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5588ffa0b8b0 con 0x5588ffa130a0 2023-09-23T09:30:05.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.768+0000 7f4b6cff9700 1 -- 172.21.15.82:0/2284349563 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 95) v1 ==== 7934+0+0 (secure 0 0 0) 0x7f4b7c02c3b0 con 0x5588ffa130a0 2023-09-23T09:30:05.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.768+0000 7f4b9f2aab80 10 client.27206 fetch_fsmap finished waiting for FSMap version 95 2023-09-23T09:30:05.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.768+0000 7f4b9f2aab80 10 client.27206 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2023-09-23T09:30:05.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.768+0000 7f4b9f2aab80 20 client.27206 populate_metadata read hostname 'smithi082' 2023-09-23T09:30:05.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.768+0000 7f4b9f2aab80 1 --2- 172.21.15.82:0/2284349563 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x5588ffa87990 0x5588ffa89db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:05.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.768+0000 7f4b9f2aab80 4 client.27206 mds_command: new command op to 24515 tid=0[{"prefix": "damage ls"}] 2023-09-23T09:30:05.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.768+0000 7f4b9f2aab80 1 -- 172.21.15.82:0/2284349563 --> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5588ff963970 con 0x5588ffa87990 2023-09-23T09:30:05.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.769+0000 7f4b88f9a700 1 --2- 172.21.15.82:0/2284349563 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x5588ffa87990 0x5588ffa89db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:05.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.769+0000 7f4b88f9a700 1 --2- 172.21.15.82:0/2284349563 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x5588ffa87990 0x5588ffa89db0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=d552f7fe9ee6565f server_cookie=b55dfd6185d6e9e9 in_seq=0 out_seq=0 2023-09-23T09:30:05.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.769+0000 7f4b6cff9700 10 client.27206 ms_handle_connect on v2:172.21.15.135:6836/2655304858 2023-09-23T09:30:05.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.770+0000 7f4b6cff9700 1 -- 172.21.15.82:0/2284349563 <== mds.3 v2:172.21.15.135:6836/2655304858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5588ff963970 con 0x5588ffa87990 2023-09-23T09:30:05.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.770+0000 7f4b6cff9700 10 client.27206 handle_command_reply: tid=0 2023-09-23T09:30:05.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.770+0000 7f4b9f2aab80 1 client.27206 shutdown 2023-09-23T09:30:05.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.770+0000 7f4b9f2aab80 1 -- 172.21.15.82:0/2284349563 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588ffa130a0 msgr2=0x5588ffa29490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:05.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.770+0000 7f4b9f2aab80 1 --2- 172.21.15.82:0/2284349563 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588ffa130a0 0x5588ffa29490 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x5588ffa35170 tx=0x7f4b7c015420 comp rx=0 tx=0).stop 2023-09-23T09:30:05.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.770+0000 7f4b9f2aab80 1 -- 172.21.15.82:0/2284349563 shutdown_connections 2023-09-23T09:30:05.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.770+0000 7f4b9f2aab80 1 --2- 172.21.15.82:0/2284349563 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5588ffa1eca0 0x5588ffa1a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:05.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.770+0000 7f4b9f2aab80 1 --2- 172.21.15.82:0/2284349563 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588ffa130a0 0x5588ffa29490 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:05.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.770+0000 7f4b9f2aab80 1 --2- 172.21.15.82:0/2284349563 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x5588ffa87990 0x5588ffa89db0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:05.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.770+0000 7f4b9f2aab80 1 --2- 172.21.15.82:0/2284349563 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5588ffa18c40 0x5588ffa1a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:05.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.770+0000 7f4b9f2aab80 1 -- 172.21.15.82:0/2284349563 >> 172.21.15.82:0/2284349563 conn(0x5588ff98d0e0 msgr2=0x5588ffa1cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:05.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.771+0000 7f4b6cff9700 0 client.27206 ms_handle_reset on v2:172.21.15.135:6836/2655304858 2023-09-23T09:30:05.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.771+0000 7f4b9f2aab80 1 -- 172.21.15.82:0/2284349563 shutdown_connections 2023-09-23T09:30:05.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.771+0000 7f4b9f2aab80 1 -- 172.21.15.82:0/2284349563 wait complete. 2023-09-23T09:30:05.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.771+0000 7f4b9f2aab80 20 client.27206 trim_cache size 0 max 16384 2023-09-23T09:30:05.775 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2023-09-23T09:30:05.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.772+0000 7f4b8b9ff700 1 -- 172.21.15.82:0/2457712995 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f4b700a02d0 msgr2=0x7f4b700a2790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:05.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.772+0000 7f4b8b9ff700 1 --2- 172.21.15.82:0/2457712995 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f4b700a02d0 0x7f4b700a2790 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4b74007fd0 tx=0x7f4b74007b40 comp rx=0 tx=0).stop 2023-09-23T09:30:05.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.772+0000 7f4b8b9ff700 1 -- 172.21.15.82:0/2457712995 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b84111480 msgr2=0x7f4b84111930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:05.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.772+0000 7f4b8b9ff700 1 --2- 172.21.15.82:0/2457712995 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b84111480 0x7f4b84111930 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f4b80009750 tx=0x7f4b80005b80 comp rx=0 tx=0).stop 2023-09-23T09:30:05.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.772+0000 7f4b8b9ff700 1 -- 172.21.15.82:0/2457712995 shutdown_connections 2023-09-23T09:30:05.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.772+0000 7f4b8b9ff700 1 --2- 172.21.15.82:0/2457712995 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f4b700a02d0 0x7f4b700a2790 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:05.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.772+0000 7f4b8b9ff700 1 --2- 172.21.15.82:0/2457712995 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b84111480 0x7f4b84111930 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:05.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.772+0000 7f4b8b9ff700 1 --2- 172.21.15.82:0/2457712995 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4b8410efd0 0x7f4b84118470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:05.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.772+0000 7f4b8b9ff700 1 --2- 172.21.15.82:0/2457712995 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b8411a100 0x7f4b841189f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:05.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.772+0000 7f4b8b9ff700 1 -- 172.21.15.82:0/2457712995 >> 172.21.15.82:0/2457712995 conn(0x7f4b8406cbe0 msgr2=0x7f4b8406f2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:05.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.773+0000 7f4b8b9ff700 1 -- 172.21.15.82:0/2457712995 shutdown_connections 2023-09-23T09:30:05.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:05.773+0000 7f4b8b9ff700 1 -- 172.21.15.82:0/2457712995 wait complete. 2023-09-23T09:30:05.801 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-09-23T09:30:05.827 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 175.0 s, 166.0 tps, lat 946.811 ms stddev 1523.083 2023-09-23T09:30:06.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:30:05 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/1325191416' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T09:30:06.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:30:05 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/1325191416' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T09:30:06.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.130+0000 7efc45fff700 1 -- 172.21.15.82:0/2705518741 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc40106880 msgr2=0x7efc40106c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:06.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.130+0000 7efc45fff700 1 --2- 172.21.15.82:0/2705518741 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc40106880 0x7efc40106c60 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7efc3000b0a0 tx=0x7efc3000b3b0 comp rx=0 tx=0).stop 2023-09-23T09:30:06.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.130+0000 7efc45fff700 1 -- 172.21.15.82:0/2705518741 shutdown_connections 2023-09-23T09:30:06.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.130+0000 7efc45fff700 1 --2- 172.21.15.82:0/2705518741 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc40101230 0x7efc4010d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:06.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.130+0000 7efc45fff700 1 --2- 172.21.15.82:0/2705518741 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc40106880 0x7efc40106c60 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:06.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.130+0000 7efc45fff700 1 --2- 172.21.15.82:0/2705518741 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efc40100870 0x7efc40100cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:06.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.130+0000 7efc45fff700 1 -- 172.21.15.82:0/2705518741 >> 172.21.15.82:0/2705518741 conn(0x7efc400fc3a0 msgr2=0x7efc400fe7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:06.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.131+0000 7efc45fff700 1 -- 172.21.15.82:0/2705518741 shutdown_connections 2023-09-23T09:30:06.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.131+0000 7efc45fff700 1 -- 172.21.15.82:0/2705518741 wait complete. 2023-09-23T09:30:06.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.132+0000 7efc45fff700 1 Processor -- start 2023-09-23T09:30:06.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.133+0000 7efc45fff700 1 -- start start 2023-09-23T09:30:06.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.133+0000 7efc45fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc40100870 0x7efc4019e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:06.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.133+0000 7efc45fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc40101230 0x7efc4019ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:06.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.133+0000 7efc45fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efc40106880 0x7efc40198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:06.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.133+0000 7efc45fff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc401990d0 con 0x7efc40100870 2023-09-23T09:30:06.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.133+0000 7efc45fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc40199240 con 0x7efc40101230 2023-09-23T09:30:06.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.133+0000 7efc45fff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc40199400 con 0x7efc40106880 2023-09-23T09:30:06.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.134+0000 7efc3ffff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efc40106880 0x7efc40198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:06.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.134+0000 7efc3ffff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efc40106880 0x7efc40198a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:54888/0 (socket says 172.21.15.82:54888) 2023-09-23T09:30:06.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.134+0000 7efc3ffff700 1 -- 172.21.15.82:0/1425769853 learned_addr learned my addr 172.21.15.82:0/1425769853 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:30:06.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.134+0000 7efc3f7fe700 1 --2- 172.21.15.82:0/1425769853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc40100870 0x7efc4019e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:06.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.134+0000 7efc36ffd700 1 --2- 172.21.15.82:0/1425769853 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc40101230 0x7efc4019ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:06.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.135+0000 7efc3ffff700 1 -- 172.21.15.82:0/1425769853 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc40101230 msgr2=0x7efc4019ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:06.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.135+0000 7efc3ffff700 1 --2- 172.21.15.82:0/1425769853 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc40101230 0x7efc4019ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:06.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.135+0000 7efc3ffff700 1 -- 172.21.15.82:0/1425769853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc40100870 msgr2=0x7efc4019e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:06.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.135+0000 7efc3ffff700 1 --2- 172.21.15.82:0/1425769853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc40100870 0x7efc4019e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:06.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.135+0000 7efc3ffff700 1 -- 172.21.15.82:0/1425769853 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc30009d00 con 0x7efc40106880 2023-09-23T09:30:06.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.135+0000 7efc3ffff700 1 --2- 172.21.15.82:0/1425769853 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efc40106880 0x7efc40198a60 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7efc3800e940 tx=0x7efc3800ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:06.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.135+0000 7efc3d7fa700 1 -- 172.21.15.82:0/1425769853 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc38004a30 con 0x7efc40106880 2023-09-23T09:30:06.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.135+0000 7efc3d7fa700 1 -- 172.21.15.82:0/1425769853 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efc380054b0 con 0x7efc40106880 2023-09-23T09:30:06.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.135+0000 7efc3d7fa700 1 -- 172.21.15.82:0/1425769853 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc3800cbc0 con 0x7efc40106880 2023-09-23T09:30:06.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.136+0000 7efc45fff700 1 -- 172.21.15.82:0/1425769853 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc401996e0 con 0x7efc40106880 2023-09-23T09:30:06.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.136+0000 7efc45fff700 1 -- 172.21.15.82:0/1425769853 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc401a59e0 con 0x7efc40106880 2023-09-23T09:30:06.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.143+0000 7efc599e9b80 1 Processor -- start 2023-09-23T09:30:06.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.144+0000 7efc3d7fa700 1 -- 172.21.15.82:0/1425769853 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7efc3800cd20 con 0x7efc40106880 2023-09-23T09:30:06.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.145+0000 7efc599e9b80 1 -- start start 2023-09-23T09:30:06.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.145+0000 7efc599e9b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e1482ad380 0x55e1482ad760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:06.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.145+0000 7efc599e9b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e1482adca0 0x55e1482a7700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:06.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.145+0000 7efc599e9b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e1482a7c40 0x55e1482a80a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:06.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.145+0000 7efc599e9b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e14820f7b0 con 0x55e1482ad380 2023-09-23T09:30:06.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.145+0000 7efc599e9b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e148200780 con 0x55e1482a7c40 2023-09-23T09:30:06.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.145+0000 7efc599e9b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1481fe0a0 con 0x55e1482adca0 2023-09-23T09:30:06.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:30:05 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/1325191416' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T09:30:06.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.146+0000 7efc36ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e1482ad380 0x55e1482ad760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:06.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.146+0000 7efc36ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e1482ad380 0x55e1482ad760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47960/0 (socket says 172.21.15.82:47960) 2023-09-23T09:30:06.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.146+0000 7efc36ffd700 1 -- 172.21.15.82:0/3832267996 learned_addr learned my addr 172.21.15.82:0/3832267996 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:30:06.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.146+0000 7efc3f7fe700 1 --2- 172.21.15.82:0/3832267996 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e1482adca0 0x55e1482a7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:06.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.146+0000 7efc36ffd700 1 --2- 172.21.15.82:0/3832267996 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e1482a7c40 0x55e1482a80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:06.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.146+0000 7efc3f7fe700 1 -- 172.21.15.82:0/3832267996 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e1482a7c40 msgr2=0x55e1482a80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:06.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.146+0000 7efc3f7fe700 1 --2- 172.21.15.82:0/3832267996 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e1482a7c40 0x55e1482a80a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:06.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.146+0000 7efc3f7fe700 1 -- 172.21.15.82:0/3832267996 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e1482ad380 msgr2=0x55e1482ad760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:06.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.146+0000 7efc3f7fe700 1 --2- 172.21.15.82:0/3832267996 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e1482ad380 0x55e1482ad760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:06.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.146+0000 7efc3f7fe700 1 -- 172.21.15.82:0/3832267996 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e148079630 con 0x55e1482adca0 2023-09-23T09:30:06.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.147+0000 7efc3f7fe700 1 --2- 172.21.15.82:0/3832267996 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e1482adca0 0x55e1482a7700 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7efc30000f80 tx=0x7efc30009360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e526c1db1275de6 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:06.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.148+0000 7efc35ffb700 1 -- 172.21.15.82:0/3832267996 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc3000e040 con 0x55e1482adca0 2023-09-23T09:30:06.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.148+0000 7efc35ffb700 1 -- 172.21.15.82:0/3832267996 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efc30007d90 con 0x55e1482adca0 2023-09-23T09:30:06.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.148+0000 7efc35ffb700 1 -- 172.21.15.82:0/3832267996 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc30003c60 con 0x55e1482adca0 2023-09-23T09:30:06.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.148+0000 7efc3d7fa700 1 --2- 172.21.15.82:0/1425769853 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7efc2c0a0140 0x7efc2c0a2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:06.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.148+0000 7efc3d7fa700 1 -- 172.21.15.82:0/1425769853 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 8513+0+0 (secure 0 0 0) 0x7efc38014070 con 0x7efc40106880 2023-09-23T09:30:06.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.149+0000 7efc36ffd700 1 --2- 172.21.15.82:0/1425769853 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7efc2c0a0140 0x7efc2c0a2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:06.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.149+0000 7efc599e9b80 1 -- 172.21.15.82:0/3832267996 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e1482adca0 msgr2=0x55e1482a7700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:06.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.149+0000 7efc599e9b80 1 --2- 172.21.15.82:0/3832267996 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e1482adca0 0x55e1482a7700 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7efc30000f80 tx=0x7efc30009360 comp rx=0 tx=0).stop 2023-09-23T09:30:06.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.149+0000 7efc599e9b80 1 -- 172.21.15.82:0/3832267996 shutdown_connections 2023-09-23T09:30:06.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.149+0000 7efc599e9b80 1 --2- 172.21.15.82:0/3832267996 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e1482a7c40 0x55e1482a80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:06.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.149+0000 7efc599e9b80 1 --2- 172.21.15.82:0/3832267996 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e1482ad380 0x55e1482ad760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:06.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.149+0000 7efc599e9b80 1 --2- 172.21.15.82:0/3832267996 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e1482adca0 0x55e1482a7700 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:06.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.149+0000 7efc599e9b80 1 -- 172.21.15.82:0/3832267996 >> 172.21.15.82:0/3832267996 conn(0x55e14821c0e0 msgr2=0x55e1482a2410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:06.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.150+0000 7efc599e9b80 1 -- 172.21.15.82:0/3832267996 shutdown_connections 2023-09-23T09:30:06.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.150+0000 7efc599e9b80 1 -- 172.21.15.82:0/3832267996 wait complete. 2023-09-23T09:30:06.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.150+0000 7efc36ffd700 1 --2- 172.21.15.82:0/1425769853 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7efc2c0a0140 0x7efc2c0a2600 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7efc2800b6c0 tx=0x7efc2800b810 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:06.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.151+0000 7efc599e9b80 1 -- start start 2023-09-23T09:30:06.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.151+0000 7efc599e9b80 1 Processor -- start 2023-09-23T09:30:06.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.152+0000 7efc599e9b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e1482a7c40 0x55e1482b3c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:06.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.152+0000 7efc599e9b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e1482ad380 0x55e1482b0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:06.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.152+0000 7efc599e9b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e1482adca0 0x55e1482b1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:06.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.152+0000 7efc599e9b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1481f9990 con 0x55e1482a7c40 2023-09-23T09:30:06.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.152+0000 7efc599e9b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e148197bb0 con 0x55e1482adca0 2023-09-23T09:30:06.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.152+0000 7efc599e9b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1481978b0 con 0x55e1482ad380 2023-09-23T09:30:06.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.152+0000 7efc599e9b80 10 client.0 _ll_register_callbacks cb 0x55e1480e1a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:30:06.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.153+0000 7efc3f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e1482a7c40 0x55e1482b3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:06.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.153+0000 7efc3f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e1482a7c40 0x55e1482b3c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47972/0 (socket says 172.21.15.82:47972) 2023-09-23T09:30:06.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.153+0000 7efc3f7fe700 1 -- 172.21.15.82:0/3839766142 learned_addr learned my addr 172.21.15.82:0/3839766142 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:30:06.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.153+0000 7efc3ffff700 1 --2- 172.21.15.82:0/3839766142 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e1482adca0 0x55e1482b1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:06.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.154+0000 7efc3f7fe700 1 -- 172.21.15.82:0/3839766142 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e1482ad380 msgr2=0x55e1482b0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:06.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.154+0000 7efc3f7fe700 1 --2- 172.21.15.82:0/3839766142 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e1482ad380 0x55e1482b0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:06.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.154+0000 7efc3f7fe700 1 -- 172.21.15.82:0/3839766142 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e1482adca0 msgr2=0x55e1482b1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:06.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.154+0000 7efc3f7fe700 1 --2- 172.21.15.82:0/3839766142 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e1482adca0 0x55e1482b1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:06.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.154+0000 7efc3f7fe700 1 -- 172.21.15.82:0/3839766142 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc40072d10 con 0x55e1482a7c40 2023-09-23T09:30:06.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.155+0000 7efc3f7fe700 1 --2- 172.21.15.82:0/3839766142 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e1482a7c40 0x55e1482b3c90 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7efc3000b070 tx=0x7efc30007dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ad63c3ce2c30b00 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:06.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.155+0000 7efc1effd700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:30:06.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.155+0000 7efc1effd700 1 -- 172.21.15.82:0/3839766142 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc3000e040 con 0x55e1482a7c40 2023-09-23T09:30:06.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.155+0000 7efc1effd700 1 -- 172.21.15.82:0/3839766142 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(141..141 src has 1..141) v4 ==== 8513+0+0 (secure 0 0 0) 0x7efc30003a00 con 0x55e1482a7c40 2023-09-23T09:30:06.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.155+0000 7efc599e9b80 1 -- 172.21.15.82:0/3839766142 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e1482771c0 con 0x55e1482a7c40 2023-09-23T09:30:06.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.156+0000 7efc1effd700 1 -- 172.21.15.82:0/3839766142 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=95) v2 ==== 24+0+0 (secure 0 0 0) 0x7efc30003be0 con 0x55e1482a7c40 2023-09-23T09:30:06.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.156+0000 7efc599e9b80 10 client.17514 fetch_fsmap learned FSMap version 95 2023-09-23T09:30:06.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.156+0000 7efc599e9b80 1 -- 172.21.15.82:0/3839766142 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=95,monmap=4+}) v3 -- 0x55e148025de0 con 0x55e1482a7c40 2023-09-23T09:30:06.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.156+0000 7efc1effd700 1 -- 172.21.15.82:0/3839766142 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55e1482771c0 con 0x55e1482a7c40 2023-09-23T09:30:06.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.157+0000 7efc1effd700 1 -- 172.21.15.82:0/3839766142 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 95) v1 ==== 7934+0+0 (secure 0 0 0) 0x7efc30019050 con 0x55e1482a7c40 2023-09-23T09:30:06.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.157+0000 7efc599e9b80 10 client.17514 fetch_fsmap finished waiting for FSMap version 95 2023-09-23T09:30:06.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.157+0000 7efc599e9b80 10 client.17514 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-09-23T09:30:06.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.157+0000 7efc599e9b80 20 client.17514 populate_metadata read hostname 'smithi082' 2023-09-23T09:30:06.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.157+0000 7efc599e9b80 1 --2- 172.21.15.82:0/3839766142 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x55e1482c9af0 0x55e1482cbf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:06.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.157+0000 7efc599e9b80 4 client.17514 mds_command: new command op to 24526 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:30:06.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.157+0000 7efc599e9b80 1 -- 172.21.15.82:0/3839766142 --> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e14819fba0 con 0x55e1482c9af0 2023-09-23T09:30:06.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.158+0000 7efc36ffd700 1 --2- 172.21.15.82:0/3839766142 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x55e1482c9af0 0x55e1482cbf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:06.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.159+0000 7efc36ffd700 1 --2- 172.21.15.82:0/3839766142 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x55e1482c9af0 0x55e1482cbf10 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5f9eed21f74a5a82 server_cookie=696a93d2827526b9 in_seq=0 out_seq=0 2023-09-23T09:30:06.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.159+0000 7efc1effd700 10 client.17514 ms_handle_connect on v2:172.21.15.161:6836/43639843 2023-09-23T09:30:06.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.159+0000 7efc1effd700 1 -- 172.21.15.82:0/3839766142 <== mds.2 v2:172.21.15.161:6836/43639843 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e14819fba0 con 0x55e1482c9af0 2023-09-23T09:30:06.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.159+0000 7efc1effd700 10 client.17514 handle_command_reply: tid=0 2023-09-23T09:30:06.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.160+0000 7efc599e9b80 1 client.17514 shutdown 2023-09-23T09:30:06.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.160+0000 7efc599e9b80 1 -- 172.21.15.82:0/3839766142 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e1482a7c40 msgr2=0x55e1482b3c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:06.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.160+0000 7efc599e9b80 1 --2- 172.21.15.82:0/3839766142 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e1482a7c40 0x55e1482b3c90 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7efc3000b070 tx=0x7efc30007dc0 comp rx=0 tx=0).stop 2023-09-23T09:30:06.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.161+0000 7efc599e9b80 1 -- 172.21.15.82:0/3839766142 shutdown_connections 2023-09-23T09:30:06.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.161+0000 7efc599e9b80 1 --2- 172.21.15.82:0/3839766142 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x55e1482c9af0 0x55e1482cbf10 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:06.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.161+0000 7efc599e9b80 1 --2- 172.21.15.82:0/3839766142 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e1482adca0 0x55e1482b1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:06.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.161+0000 7efc599e9b80 1 --2- 172.21.15.82:0/3839766142 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e1482a7c40 0x55e1482b3c90 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:06.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.161+0000 7efc599e9b80 1 --2- 172.21.15.82:0/3839766142 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e1482ad380 0x55e1482b0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:06.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.161+0000 7efc1effd700 0 client.17514 ms_handle_reset on v2:172.21.15.161:6836/43639843 2023-09-23T09:30:06.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.161+0000 7efc599e9b80 1 -- 172.21.15.82:0/3839766142 >> 172.21.15.82:0/3839766142 conn(0x55e14821c0e0 msgr2=0x55e14829cb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:06.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.161+0000 7efc599e9b80 1 -- 172.21.15.82:0/3839766142 shutdown_connections 2023-09-23T09:30:06.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.162+0000 7efc599e9b80 1 -- 172.21.15.82:0/3839766142 wait complete. 2023-09-23T09:30:06.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.163+0000 7efc599e9b80 20 client.17514 trim_cache size 0 max 16384 2023-09-23T09:30:06.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.183+0000 7efc599e9b80 1 Processor -- start 2023-09-23T09:30:06.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.184+0000 7efc599e9b80 1 -- start start 2023-09-23T09:30:06.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.184+0000 7efc599e9b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e1482a7c40 0x55e1482a7700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:06.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.184+0000 7efc599e9b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e1482ad380 0x55e1482b37c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:06.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.184+0000 7efc599e9b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e1482adca0 0x55e1482b0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:06.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.184+0000 7efc599e9b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e14807b920 con 0x55e1482a7c40 2023-09-23T09:30:06.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.184+0000 7efc599e9b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1482b4270 con 0x55e1482ad380 2023-09-23T09:30:06.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.184+0000 7efc599e9b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1482a3580 con 0x55e1482adca0 2023-09-23T09:30:06.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.184+0000 7efc3f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e1482a7c40 0x55e1482a7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:06.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.184+0000 7efc36ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e1482ad380 0x55e1482b37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:06.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.184+0000 7efc3f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e1482a7c40 0x55e1482a7700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47984/0 (socket says 172.21.15.82:47984) 2023-09-23T09:30:06.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.184+0000 7efc3f7fe700 1 -- 172.21.15.82:0/3366891789 learned_addr learned my addr 172.21.15.82:0/3366891789 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:30:06.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.184+0000 7efc3ffff700 1 --2- 172.21.15.82:0/3366891789 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e1482adca0 0x55e1482b0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:06.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.185+0000 7efc3f7fe700 1 -- 172.21.15.82:0/3366891789 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e1482adca0 msgr2=0x55e1482b0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:06.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.185+0000 7efc3f7fe700 1 --2- 172.21.15.82:0/3366891789 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e1482adca0 0x55e1482b0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:06.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.185+0000 7efc3f7fe700 1 -- 172.21.15.82:0/3366891789 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e1482ad380 msgr2=0x55e1482b37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:06.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.185+0000 7efc3f7fe700 1 --2- 172.21.15.82:0/3366891789 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e1482ad380 0x55e1482b37c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:06.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.185+0000 7efc3f7fe700 1 -- 172.21.15.82:0/3366891789 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e14800ec60 con 0x55e1482a7c40 2023-09-23T09:30:06.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.185+0000 7efc36ffd700 1 --2- 172.21.15.82:0/3366891789 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e1482ad380 0x55e1482b37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:30:06.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.185+0000 7efc3f7fe700 1 --2- 172.21.15.82:0/3366891789 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e1482a7c40 0x55e1482a7700 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7efc30009a20 tx=0x7efc30000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=182743e31325c2 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:06.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.185+0000 7efc367fc700 1 -- 172.21.15.82:0/3366891789 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc3000e020 con 0x55e1482a7c40 2023-09-23T09:30:06.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.185+0000 7efc367fc700 1 -- 172.21.15.82:0/3366891789 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efc300092e0 con 0x55e1482a7c40 2023-09-23T09:30:06.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.185+0000 7efc367fc700 1 -- 172.21.15.82:0/3366891789 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc3001c820 con 0x55e1482a7c40 2023-09-23T09:30:06.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.186+0000 7efc599e9b80 1 -- 172.21.15.82:0/3366891789 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e1482a7c40 msgr2=0x55e1482a7700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:06.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.186+0000 7efc599e9b80 1 --2- 172.21.15.82:0/3366891789 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e1482a7c40 0x55e1482a7700 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7efc30009a20 tx=0x7efc30000f40 comp rx=0 tx=0).stop 2023-09-23T09:30:06.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.186+0000 7efc599e9b80 1 -- 172.21.15.82:0/3366891789 shutdown_connections 2023-09-23T09:30:06.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.186+0000 7efc599e9b80 1 --2- 172.21.15.82:0/3366891789 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e1482adca0 0x55e1482b0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:06.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.186+0000 7efc599e9b80 1 --2- 172.21.15.82:0/3366891789 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e1482a7c40 0x55e1482a7700 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:06.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.186+0000 7efc599e9b80 1 --2- 172.21.15.82:0/3366891789 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e1482ad380 0x55e1482b37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:06.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.186+0000 7efc599e9b80 1 -- 172.21.15.82:0/3366891789 >> 172.21.15.82:0/3366891789 conn(0x55e14821c0e0 msgr2=0x55e1482ab050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:06.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.186+0000 7efc599e9b80 1 -- 172.21.15.82:0/3366891789 shutdown_connections 2023-09-23T09:30:06.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.186+0000 7efc599e9b80 1 -- 172.21.15.82:0/3366891789 wait complete. 2023-09-23T09:30:06.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.187+0000 7efc599e9b80 1 -- start start 2023-09-23T09:30:06.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.187+0000 7efc599e9b80 1 Processor -- start 2023-09-23T09:30:06.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.188+0000 7efc599e9b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e1482a7c40 0x55e1482af4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:06.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.188+0000 7efc599e9b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e1482ad380 0x55e1482afa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:06.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.188+0000 7efc599e9b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e1482adca0 0x55e1482aff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:06.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.188+0000 7efc599e9b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1482b04c0 con 0x55e1482a7c40 2023-09-23T09:30:06.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.188+0000 7efc599e9b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1482b0630 con 0x55e1482adca0 2023-09-23T09:30:06.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.188+0000 7efc599e9b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1482b07f0 con 0x55e1482ad380 2023-09-23T09:30:06.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.188+0000 7efc599e9b80 10 client.0 _ll_register_callbacks cb 0x7efc2800bb60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:30:06.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.188+0000 7efc3f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e1482a7c40 0x55e1482af4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:06.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.188+0000 7efc36ffd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e1482ad380 0x55e1482afa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:06.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.188+0000 7efc3f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e1482a7c40 0x55e1482af4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47994/0 (socket says 172.21.15.82:47994) 2023-09-23T09:30:06.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.188+0000 7efc3f7fe700 1 -- 172.21.15.82:0/1576080286 learned_addr learned my addr 172.21.15.82:0/1576080286 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:30:06.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.189+0000 7efc3f7fe700 1 -- 172.21.15.82:0/1576080286 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e1482ad380 msgr2=0x55e1482afa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:06.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.189+0000 7efc3f7fe700 1 --2- 172.21.15.82:0/1576080286 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e1482ad380 0x55e1482afa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:06.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.189+0000 7efc3f7fe700 1 -- 172.21.15.82:0/1576080286 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e1482adca0 msgr2=0x55e1482aff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:06.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.189+0000 7efc3ffff700 1 --2- 172.21.15.82:0/1576080286 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e1482adca0 0x55e1482aff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:06.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.189+0000 7efc3f7fe700 1 --2- 172.21.15.82:0/1576080286 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e1482adca0 0x55e1482aff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:06.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.189+0000 7efc3f7fe700 1 -- 172.21.15.82:0/1576080286 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc2801a040 con 0x55e1482a7c40 2023-09-23T09:30:06.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.189+0000 7efc3ffff700 1 --2- 172.21.15.82:0/1576080286 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e1482adca0 0x55e1482aff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T09:30:06.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.189+0000 7efc3f7fe700 1 --2- 172.21.15.82:0/1576080286 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e1482a7c40 0x55e1482af4c0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7efc3000b3f0 tx=0x7efc3000b050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfebdefc2d4c7c8b server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:06.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.189+0000 7efc1effd700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:30:06.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.189+0000 7efc1effd700 1 -- 172.21.15.82:0/1576080286 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc3001c9d0 con 0x55e1482a7c40 2023-09-23T09:30:06.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.189+0000 7efc599e9b80 1 -- 172.21.15.82:0/1576080286 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e14829a8b0 con 0x55e1482a7c40 2023-09-23T09:30:06.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.189+0000 7efc1effd700 1 -- 172.21.15.82:0/1576080286 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(141..141 src has 1..141) v4 ==== 8513+0+0 (secure 0 0 0) 0x7efc3001cb30 con 0x55e1482a7c40 2023-09-23T09:30:06.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.189+0000 7efc1effd700 1 -- 172.21.15.82:0/1576080286 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=95) v2 ==== 24+0+0 (secure 0 0 0) 0x7efc3001cd30 con 0x55e1482a7c40 2023-09-23T09:30:06.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.190+0000 7efc599e9b80 10 client.17520 fetch_fsmap learned FSMap version 95 2023-09-23T09:30:06.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.190+0000 7efc599e9b80 1 -- 172.21.15.82:0/1576080286 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=95,monmap=4+}) v3 -- 0x55e148025de0 con 0x55e1482a7c40 2023-09-23T09:30:06.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.190+0000 7efc1effd700 1 -- 172.21.15.82:0/1576080286 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55e14829a8b0 con 0x55e1482a7c40 2023-09-23T09:30:06.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.190+0000 7efc1effd700 1 -- 172.21.15.82:0/1576080286 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 95) v1 ==== 7934+0+0 (secure 0 0 0) 0x7efc30019070 con 0x55e1482a7c40 2023-09-23T09:30:06.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.190+0000 7efc599e9b80 10 client.17520 fetch_fsmap finished waiting for FSMap version 95 2023-09-23T09:30:06.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.190+0000 7efc599e9b80 10 client.17520 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-09-23T09:30:06.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.190+0000 7efc599e9b80 20 client.17520 populate_metadata read hostname 'smithi082' 2023-09-23T09:30:06.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.190+0000 7efc599e9b80 1 --2- 172.21.15.82:0/1576080286 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x55e14831e000 0x55e1483203f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:06.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.190+0000 7efc599e9b80 4 client.17520 mds_command: new command op to 24526 tid=0[{"prefix": "damage ls"}] 2023-09-23T09:30:06.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.190+0000 7efc599e9b80 1 -- 172.21.15.82:0/1576080286 --> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55e1481f2970 con 0x55e14831e000 2023-09-23T09:30:06.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.190+0000 7efc36ffd700 1 --2- 172.21.15.82:0/1576080286 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x55e14831e000 0x55e1483203f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:06.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.191+0000 7efc36ffd700 1 --2- 172.21.15.82:0/1576080286 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x55e14831e000 0x55e1483203f0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e6421ebe64dbdb3e server_cookie=53949f23b666c8bd in_seq=0 out_seq=0 2023-09-23T09:30:06.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.191+0000 7efc1effd700 10 client.17520 ms_handle_connect on v2:172.21.15.161:6836/43639843 2023-09-23T09:30:06.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.191+0000 7efc1effd700 1 -- 172.21.15.82:0/1576080286 <== mds.2 v2:172.21.15.161:6836/43639843 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55e1481f2970 con 0x55e14831e000 2023-09-23T09:30:06.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.191+0000 7efc1effd700 10 client.17520 handle_command_reply: tid=0 2023-09-23T09:30:06.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.191+0000 7efc599e9b80 1 client.17520 shutdown 2023-09-23T09:30:06.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.191+0000 7efc599e9b80 1 -- 172.21.15.82:0/1576080286 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e1482a7c40 msgr2=0x55e1482af4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:06.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.191+0000 7efc599e9b80 1 --2- 172.21.15.82:0/1576080286 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e1482a7c40 0x55e1482af4c0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7efc3000b3f0 tx=0x7efc3000b050 comp rx=0 tx=0).stop 2023-09-23T09:30:06.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.192+0000 7efc599e9b80 1 -- 172.21.15.82:0/1576080286 shutdown_connections 2023-09-23T09:30:06.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.192+0000 7efc599e9b80 1 --2- 172.21.15.82:0/1576080286 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x55e14831e000 0x55e1483203f0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:06.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.192+0000 7efc599e9b80 1 --2- 172.21.15.82:0/1576080286 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e1482adca0 0x55e1482aff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:06.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.192+0000 7efc599e9b80 1 --2- 172.21.15.82:0/1576080286 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e1482a7c40 0x55e1482af4c0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:06.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.192+0000 7efc599e9b80 1 --2- 172.21.15.82:0/1576080286 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55e1482ad380 0x55e1482afa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:06.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.192+0000 7efc599e9b80 1 -- 172.21.15.82:0/1576080286 >> 172.21.15.82:0/1576080286 conn(0x55e14821c0e0 msgr2=0x55e14829c2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:06.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.192+0000 7efc1effd700 0 client.17520 ms_handle_reset on v2:172.21.15.161:6836/43639843 2023-09-23T09:30:06.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.192+0000 7efc599e9b80 1 -- 172.21.15.82:0/1576080286 shutdown_connections 2023-09-23T09:30:06.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.192+0000 7efc599e9b80 1 -- 172.21.15.82:0/1576080286 wait complete. 2023-09-23T09:30:06.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.192+0000 7efc599e9b80 20 client.17520 trim_cache size 0 max 16384 2023-09-23T09:30:06.200 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2023-09-23T09:30:06.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.193+0000 7efc45fff700 1 -- 172.21.15.82:0/1425769853 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7efc2c0a0140 msgr2=0x7efc2c0a2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:06.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.193+0000 7efc45fff700 1 --2- 172.21.15.82:0/1425769853 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7efc2c0a0140 0x7efc2c0a2600 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7efc2800b6c0 tx=0x7efc2800b810 comp rx=0 tx=0).stop 2023-09-23T09:30:06.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.193+0000 7efc45fff700 1 -- 172.21.15.82:0/1425769853 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efc40106880 msgr2=0x7efc40198a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:06.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.193+0000 7efc45fff700 1 --2- 172.21.15.82:0/1425769853 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efc40106880 0x7efc40198a60 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7efc3800e940 tx=0x7efc3800ec50 comp rx=0 tx=0).stop 2023-09-23T09:30:06.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.193+0000 7efc45fff700 1 -- 172.21.15.82:0/1425769853 shutdown_connections 2023-09-23T09:30:06.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.193+0000 7efc45fff700 1 --2- 172.21.15.82:0/1425769853 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7efc2c0a0140 0x7efc2c0a2600 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:06.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.193+0000 7efc45fff700 1 --2- 172.21.15.82:0/1425769853 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efc40106880 0x7efc40198a60 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:06.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.193+0000 7efc45fff700 1 --2- 172.21.15.82:0/1425769853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc40100870 0x7efc4019e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:06.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.193+0000 7efc45fff700 1 --2- 172.21.15.82:0/1425769853 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc40101230 0x7efc4019ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:06.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.193+0000 7efc45fff700 1 -- 172.21.15.82:0/1425769853 >> 172.21.15.82:0/1425769853 conn(0x7efc400fc3a0 msgr2=0x7efc400fc9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:06.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.193+0000 7efc45fff700 1 -- 172.21.15.82:0/1425769853 shutdown_connections 2023-09-23T09:30:06.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.193+0000 7efc45fff700 1 -- 172.21.15.82:0/1425769853 wait complete. 2023-09-23T09:30:06.218 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-09-23T09:30:06.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.620+0000 7fa59ffff700 1 -- 172.21.15.82:0/3042681186 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa598100120 msgr2=0x7fa59810c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:06.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.620+0000 7fa59ffff700 1 --2- 172.21.15.82:0/3042681186 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa598100120 0x7fa59810c630 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fa590009990 tx=0x7fa590009ca0 comp rx=0 tx=0).stop 2023-09-23T09:30:06.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.620+0000 7fa59ffff700 1 -- 172.21.15.82:0/3042681186 shutdown_connections 2023-09-23T09:30:06.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.620+0000 7fa59ffff700 1 --2- 172.21.15.82:0/3042681186 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa598100120 0x7fa59810c630 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:06.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.620+0000 7fa59ffff700 1 --2- 172.21.15.82:0/3042681186 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa598105770 0x7fa598105b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:06.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.620+0000 7fa59ffff700 1 --2- 172.21.15.82:0/3042681186 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa5980ff760 0x7fa5980ffbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:06.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.620+0000 7fa59ffff700 1 -- 172.21.15.82:0/3042681186 >> 172.21.15.82:0/3042681186 conn(0x7fa5980fb270 msgr2=0x7fa5980fd690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:06.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.620+0000 7fa59ffff700 1 -- 172.21.15.82:0/3042681186 shutdown_connections 2023-09-23T09:30:06.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.620+0000 7fa59ffff700 1 -- 172.21.15.82:0/3042681186 wait complete. 2023-09-23T09:30:06.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.622+0000 7fa59ffff700 1 Processor -- start 2023-09-23T09:30:06.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.622+0000 7fa59ffff700 1 -- start start 2023-09-23T09:30:06.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.622+0000 7fa59ffff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa5980ff760 0x7fa59810d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:06.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.622+0000 7fa59ffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa598100120 0x7fa59810d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:06.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.622+0000 7fa59ffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa598105770 0x7fa5981a4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:06.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.622+0000 7fa59ffff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa59810dde0 con 0x7fa598105770 2023-09-23T09:30:06.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.622+0000 7fa59ffff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5981a5090 con 0x7fa598100120 2023-09-23T09:30:06.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.623+0000 7fa59ffff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5981a51d0 con 0x7fa5980ff760 2023-09-23T09:30:06.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.623+0000 7fa59dd9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa5980ff760 0x7fa59810d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:06.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.623+0000 7fa59dd9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa5980ff760 0x7fa59810d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:54944/0 (socket says 172.21.15.82:54944) 2023-09-23T09:30:06.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.623+0000 7fa59dd9b700 1 -- 172.21.15.82:0/2948677974 learned_addr learned my addr 172.21.15.82:0/2948677974 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:30:06.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.623+0000 7fa59e59c700 1 --2- 172.21.15.82:0/2948677974 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa598105770 0x7fa5981a4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:06.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.624+0000 7fa59e59c700 1 -- 172.21.15.82:0/2948677974 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa5980ff760 msgr2=0x7fa59810d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:06.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.624+0000 7fa59e59c700 1 --2- 172.21.15.82:0/2948677974 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa5980ff760 0x7fa59810d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:06.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.624+0000 7fa59e59c700 1 -- 172.21.15.82:0/2948677974 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa598100120 msgr2=0x7fa59810d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:06.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.624+0000 7fa59e59c700 1 --2- 172.21.15.82:0/2948677974 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa598100120 0x7fa59810d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:06.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.624+0000 7fa59e59c700 1 -- 172.21.15.82:0/2948677974 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5900095f0 con 0x7fa598105770 2023-09-23T09:30:06.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.624+0000 7fa59e59c700 1 --2- 172.21.15.82:0/2948677974 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa598105770 0x7fa5981a4b50 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fa5900036f0 tx=0x7fa590003850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:06.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.626+0000 7fa58affd700 1 -- 172.21.15.82:0/2948677974 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa59001d070 con 0x7fa598105770 2023-09-23T09:30:06.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.626+0000 7fa58affd700 1 -- 172.21.15.82:0/2948677974 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa590004090 con 0x7fa598105770 2023-09-23T09:30:06.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.626+0000 7fa58affd700 1 -- 172.21.15.82:0/2948677974 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa59000fd70 con 0x7fa598105770 2023-09-23T09:30:06.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.626+0000 7fa59ffff700 1 -- 172.21.15.82:0/2948677974 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5981a5420 con 0x7fa598105770 2023-09-23T09:30:06.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.626+0000 7fa59ffff700 1 -- 172.21.15.82:0/2948677974 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5981a57f0 con 0x7fa598105770 2023-09-23T09:30:06.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.633+0000 7fa5b3a09b80 1 Processor -- start 2023-09-23T09:30:06.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.636+0000 7fa58affd700 1 -- 172.21.15.82:0/2948677974 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7fa59000f460 con 0x7fa598105770 2023-09-23T09:30:06.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.636+0000 7fa5b3a09b80 1 -- start start 2023-09-23T09:30:06.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.637+0000 7fa5b3a09b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562385f75b80 0x562385f75f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:06.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.637+0000 7fa5b3a09b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562385f764a0 0x562385f6ff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:06.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.637+0000 7fa5b3a09b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562385f70450 0x562385f70870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:06.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.637+0000 7fa5b3a09b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562385ecf7b0 con 0x562385f764a0 2023-09-23T09:30:06.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.637+0000 7fa5b3a09b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562385ec0780 con 0x562385f75b80 2023-09-23T09:30:06.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.637+0000 7fa5b3a09b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x562385ebe0a0 con 0x562385f70450 2023-09-23T09:30:06.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.638+0000 7fa59d59a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562385f75b80 0x562385f75f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:06.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.638+0000 7fa59d59a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562385f75b80 0x562385f75f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:57714/0 (socket says 172.21.15.82:57714) 2023-09-23T09:30:06.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.638+0000 7fa59d59a700 1 -- 172.21.15.82:0/3011036664 learned_addr learned my addr 172.21.15.82:0/3011036664 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:30:06.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.638+0000 7fa59d59a700 1 --2- 172.21.15.82:0/3011036664 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562385f70450 0x562385f70870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:06.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.638+0000 7fa59d59a700 1 -- 172.21.15.82:0/3011036664 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562385f70450 msgr2=0x562385f70870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:06.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.638+0000 7fa59d59a700 1 --2- 172.21.15.82:0/3011036664 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562385f70450 0x562385f70870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:06.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.638+0000 7fa59d59a700 1 -- 172.21.15.82:0/3011036664 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562385f764a0 msgr2=0x562385f6ff10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-23T09:30:06.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.638+0000 7fa59d59a700 1 --2- 172.21.15.82:0/3011036664 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562385f764a0 0x562385f6ff10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:06.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.638+0000 7fa59d59a700 1 -- 172.21.15.82:0/3011036664 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562385d39630 con 0x562385f75b80 2023-09-23T09:30:06.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.639+0000 7fa59d59a700 1 --2- 172.21.15.82:0/3011036664 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562385f75b80 0x562385f75f60 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fa58c0139e0 tx=0x7fa58c001a70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd80a1a699e9fed9 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:06.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.640+0000 7fa583fff700 1 -- 172.21.15.82:0/3011036664 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa58c004d60 con 0x562385f75b80 2023-09-23T09:30:06.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.640+0000 7fa583fff700 1 -- 172.21.15.82:0/3011036664 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa58c007130 con 0x562385f75b80 2023-09-23T09:30:06.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.640+0000 7fa583fff700 1 -- 172.21.15.82:0/3011036664 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa58c004280 con 0x562385f75b80 2023-09-23T09:30:06.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.641+0000 7fa5b3a09b80 1 -- 172.21.15.82:0/3011036664 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562385f75b80 msgr2=0x562385f75f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:06.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.641+0000 7fa5b3a09b80 1 --2- 172.21.15.82:0/3011036664 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562385f75b80 0x562385f75f60 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fa58c0139e0 tx=0x7fa58c001a70 comp rx=0 tx=0).stop 2023-09-23T09:30:06.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.645+0000 7fa58affd700 1 --2- 172.21.15.82:0/2948677974 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fa5840a0250 0x7fa5840a2710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:06.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.646+0000 7fa58affd700 1 -- 172.21.15.82:0/2948677974 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fa5900cc710 con 0x7fa598105770 2023-09-23T09:30:06.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.650+0000 7fa59d59a700 1 --2- 172.21.15.82:0/2948677974 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fa5840a0250 0x7fa5840a2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:06.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.651+0000 7fa5b3a09b80 1 -- 172.21.15.82:0/3011036664 shutdown_connections 2023-09-23T09:30:06.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.651+0000 7fa5b3a09b80 1 --2- 172.21.15.82:0/3011036664 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562385f70450 0x562385f70870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:06.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.651+0000 7fa5b3a09b80 1 --2- 172.21.15.82:0/3011036664 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562385f75b80 0x562385f75f60 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:06.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.651+0000 7fa5b3a09b80 1 --2- 172.21.15.82:0/3011036664 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562385f764a0 0x562385f6ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:06.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.651+0000 7fa5b3a09b80 1 -- 172.21.15.82:0/3011036664 >> 172.21.15.82:0/3011036664 conn(0x562385edc0e0 msgr2=0x562385f62410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:06.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.652+0000 7fa5b3a09b80 1 -- 172.21.15.82:0/3011036664 shutdown_connections 2023-09-23T09:30:06.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.653+0000 7fa5b3a09b80 1 -- 172.21.15.82:0/3011036664 wait complete. 2023-09-23T09:30:06.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.653+0000 7fa5b3a09b80 1 -- start start 2023-09-23T09:30:06.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.654+0000 7fa5b3a09b80 1 Processor -- start 2023-09-23T09:30:06.657 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.654+0000 7fa5b3a09b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562385f70450 0x562385f7c420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:06.657 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.655+0000 7fa5b3a09b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562385f75b80 0x562385f796a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:06.657 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.655+0000 7fa5b3a09b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562385f764a0 0x562385f79d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:06.657 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.655+0000 7fa5b3a09b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562385eb9990 con 0x562385f75b80 2023-09-23T09:30:06.657 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.655+0000 7fa5b3a09b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562385e57bb0 con 0x562385f764a0 2023-09-23T09:30:06.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.655+0000 7fa5b3a09b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x562385e578b0 con 0x562385f70450 2023-09-23T09:30:06.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.655+0000 7fa5b3a09b80 10 client.0 _ll_register_callbacks cb 0x562385da1a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:30:06.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.656+0000 7fa59dd9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562385f70450 0x562385f7c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:06.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.656+0000 7fa59dd9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562385f70450 0x562385f7c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:54964/0 (socket says 172.21.15.82:54964) 2023-09-23T09:30:06.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.656+0000 7fa59dd9b700 1 -- 172.21.15.82:0/711073631 learned_addr learned my addr 172.21.15.82:0/711073631 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:30:06.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.657+0000 7fa59e59c700 1 --2- 172.21.15.82:0/711073631 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562385f764a0 0x562385f79d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:06.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.657+0000 7fa59dd9b700 1 -- 172.21.15.82:0/711073631 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562385f764a0 msgr2=0x562385f79d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:06.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.657+0000 7fa59dd9b700 1 --2- 172.21.15.82:0/711073631 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562385f764a0 0x562385f79d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:06.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.657+0000 7fa59dd9b700 1 -- 172.21.15.82:0/711073631 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562385f75b80 msgr2=0x562385f796a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:06.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.657+0000 7fa59dd9b700 1 --2- 172.21.15.82:0/711073631 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562385f75b80 0x562385f796a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:06.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.657+0000 7fa59dd9b700 1 -- 172.21.15.82:0/711073631 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa58c013690 con 0x562385f70450 2023-09-23T09:30:06.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.658+0000 7fa59dd9b700 1 --2- 172.21.15.82:0/711073631 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562385f70450 0x562385f7c420 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fa59400e270 tx=0x7fa59400e630 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a08f8629db2d1fa server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:06.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.658+0000 7fa5817fa700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T09:30:06.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.659+0000 7fa5817fa700 1 -- 172.21.15.82:0/711073631 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa59400c070 con 0x562385f70450 2023-09-23T09:30:06.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.659+0000 7fa5817fa700 1 -- 172.21.15.82:0/711073631 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(141..141 src has 1..141) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fa594013410 con 0x562385f70450 2023-09-23T09:30:06.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.659+0000 7fa5b3a09b80 1 -- 172.21.15.82:0/711073631 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562385f371c0 con 0x562385f70450 2023-09-23T09:30:06.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.660+0000 7fa59d59a700 1 --2- 172.21.15.82:0/2948677974 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fa5840a0250 0x7fa5840a2710 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa58c001350 tx=0x7fa58c007b20 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:06.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.660+0000 7fa5817fa700 1 -- 172.21.15.82:0/711073631 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=95) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa5940135d0 con 0x562385f70450 2023-09-23T09:30:06.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.662+0000 7fa5b3a09b80 10 client.27259 fetch_fsmap learned FSMap version 95 2023-09-23T09:30:06.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.662+0000 7fa5b3a09b80 1 -- 172.21.15.82:0/711073631 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=95,monmap=4+}) v3 -- 0x562385ce5de0 con 0x562385f70450 2023-09-23T09:30:06.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.663+0000 7fa5817fa700 1 -- 172.21.15.82:0/711073631 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562385f371c0 con 0x562385f70450 2023-09-23T09:30:06.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.663+0000 7fa5817fa700 1 -- 172.21.15.82:0/711073631 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 95) v1 ==== 7934+0+0 (secure 0 0 0) 0x7fa59401c770 con 0x562385f70450 2023-09-23T09:30:06.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.664+0000 7fa5b3a09b80 10 client.27259 fetch_fsmap finished waiting for FSMap version 95 2023-09-23T09:30:06.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.664+0000 7fa5b3a09b80 10 client.27259 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-23T09:30:06.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.664+0000 7fa5b3a09b80 20 client.27259 populate_metadata read hostname 'smithi082' 2023-09-23T09:30:06.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.664+0000 7fa5b3a09b80 1 --2- 172.21.15.82:0/711073631 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x562385f6b6b0 0x562385f6dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:06.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.664+0000 7fa5b3a09b80 4 client.27259 mds_command: new command op to 24550 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:30:06.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.664+0000 7fa5b3a09b80 1 -- 172.21.15.82:0/711073631 --> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562385e5fba0 con 0x562385f6b6b0 2023-09-23T09:30:06.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.665+0000 7fa59d59a700 1 --2- 172.21.15.82:0/711073631 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x562385f6b6b0 0x562385f6dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:06.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.673+0000 7fa59d59a700 1 --2- 172.21.15.82:0/711073631 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x562385f6b6b0 0x562385f6dad0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=319446a4b5034f34 server_cookie=76996604478d8cb3 in_seq=0 out_seq=0 2023-09-23T09:30:06.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.674+0000 7fa5817fa700 10 client.27259 ms_handle_connect on v2:172.21.15.161:6838/758982817 2023-09-23T09:30:06.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.676+0000 7fa5817fa700 1 -- 172.21.15.82:0/711073631 <== mds.1 v2:172.21.15.161:6838/758982817 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x562385e5fba0 con 0x562385f6b6b0 2023-09-23T09:30:06.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.676+0000 7fa5817fa700 10 client.27259 handle_command_reply: tid=0 2023-09-23T09:30:06.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.676+0000 7fa5b3a09b80 1 client.27259 shutdown 2023-09-23T09:30:06.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.677+0000 7fa5b3a09b80 1 -- 172.21.15.82:0/711073631 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562385f70450 msgr2=0x562385f7c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:06.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.677+0000 7fa5b3a09b80 1 --2- 172.21.15.82:0/711073631 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562385f70450 0x562385f7c420 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fa59400e270 tx=0x7fa59400e630 comp rx=0 tx=0).stop 2023-09-23T09:30:06.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.677+0000 7fa5b3a09b80 1 -- 172.21.15.82:0/711073631 shutdown_connections 2023-09-23T09:30:06.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.677+0000 7fa5b3a09b80 1 --2- 172.21.15.82:0/711073631 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x562385f6b6b0 0x562385f6dad0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:06.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.677+0000 7fa5b3a09b80 1 --2- 172.21.15.82:0/711073631 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562385f764a0 0x562385f79d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:06.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.677+0000 7fa5b3a09b80 1 --2- 172.21.15.82:0/711073631 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562385f70450 0x562385f7c420 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:06.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.677+0000 7fa5b3a09b80 1 --2- 172.21.15.82:0/711073631 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562385f75b80 0x562385f796a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:06.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.677+0000 7fa5b3a09b80 1 -- 172.21.15.82:0/711073631 >> 172.21.15.82:0/711073631 conn(0x562385edc0e0 msgr2=0x562385f5c2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:06.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.679+0000 7fa5817fa700 0 client.27259 ms_handle_reset on v2:172.21.15.161:6838/758982817 2023-09-23T09:30:06.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.681+0000 7fa5b3a09b80 1 -- 172.21.15.82:0/711073631 shutdown_connections 2023-09-23T09:30:06.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.686+0000 7fa5b3a09b80 1 -- 172.21.15.82:0/711073631 wait complete. 2023-09-23T09:30:06.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.687+0000 7fa5b3a09b80 20 client.27259 trim_cache size 0 max 16384 2023-09-23T09:30:06.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.728+0000 7fa5b3a09b80 1 Processor -- start 2023-09-23T09:30:06.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.729+0000 7fa5b3a09b80 1 -- start start 2023-09-23T09:30:06.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.730+0000 7fa5b3a09b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562385f70450 0x562385f7bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:06.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.730+0000 7fa5b3a09b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562385f75b80 0x562385f78e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:06.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.730+0000 7fa5b3a09b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562385f764a0 0x562385f793a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:06.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.730+0000 7fa5b3a09b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562385d3b920 con 0x562385f75b80 2023-09-23T09:30:06.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.730+0000 7fa5b3a09b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562385f757d0 con 0x562385f70450 2023-09-23T09:30:06.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.730+0000 7fa5b3a09b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x562385f63150 con 0x562385f764a0 2023-09-23T09:30:06.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.731+0000 7fa59d59a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562385f75b80 0x562385f78e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:06.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.731+0000 7fa59d59a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562385f75b80 0x562385f78e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48016/0 (socket says 172.21.15.82:48016) 2023-09-23T09:30:06.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.731+0000 7fa59d59a700 1 -- 172.21.15.82:0/1170242278 learned_addr learned my addr 172.21.15.82:0/1170242278 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:30:06.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.732+0000 7fa59d59a700 1 -- 172.21.15.82:0/1170242278 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562385f764a0 msgr2=0x562385f793a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:06.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.732+0000 7fa59d59a700 1 --2- 172.21.15.82:0/1170242278 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562385f764a0 0x562385f793a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:06.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.732+0000 7fa59d59a700 1 -- 172.21.15.82:0/1170242278 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562385f70450 msgr2=0x562385f7bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:06.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.732+0000 7fa59d59a700 1 --2- 172.21.15.82:0/1170242278 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562385f70450 0x562385f7bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:06.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.732+0000 7fa59d59a700 1 -- 172.21.15.82:0/1170242278 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562385f5bdf0 con 0x562385f75b80 2023-09-23T09:30:06.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.732+0000 7fa59d59a700 1 --2- 172.21.15.82:0/1170242278 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562385f75b80 0x562385f78e60 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fa58c0139b0 tx=0x7fa58c01d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbc3770fec72861 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:06.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.737+0000 7fa588ff9700 1 -- 172.21.15.82:0/1170242278 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa58c02d040 con 0x562385f75b80 2023-09-23T09:30:06.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.737+0000 7fa588ff9700 1 -- 172.21.15.82:0/1170242278 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa58c007590 con 0x562385f75b80 2023-09-23T09:30:06.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.737+0000 7fa588ff9700 1 -- 172.21.15.82:0/1170242278 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa58c019470 con 0x562385f75b80 2023-09-23T09:30:06.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.741+0000 7fa5b3a09b80 1 -- 172.21.15.82:0/1170242278 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562385f75b80 msgr2=0x562385f78e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:06.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.741+0000 7fa5b3a09b80 1 --2- 172.21.15.82:0/1170242278 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562385f75b80 0x562385f78e60 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fa58c0139b0 tx=0x7fa58c01d000 comp rx=0 tx=0).stop 2023-09-23T09:30:06.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.741+0000 7fa5b3a09b80 1 -- 172.21.15.82:0/1170242278 shutdown_connections 2023-09-23T09:30:06.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.741+0000 7fa5b3a09b80 1 --2- 172.21.15.82:0/1170242278 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562385f764a0 0x562385f793a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:06.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.741+0000 7fa5b3a09b80 1 --2- 172.21.15.82:0/1170242278 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562385f70450 0x562385f7bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:06.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.741+0000 7fa5b3a09b80 1 --2- 172.21.15.82:0/1170242278 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562385f75b80 0x562385f78e60 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:06.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.741+0000 7fa5b3a09b80 1 -- 172.21.15.82:0/1170242278 >> 172.21.15.82:0/1170242278 conn(0x562385edc0e0 msgr2=0x562385f73890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:06.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.742+0000 7fa5b3a09b80 1 -- 172.21.15.82:0/1170242278 shutdown_connections 2023-09-23T09:30:06.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.742+0000 7fa5b3a09b80 1 -- 172.21.15.82:0/1170242278 wait complete. 2023-09-23T09:30:06.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.743+0000 7fa5b3a09b80 1 -- start start 2023-09-23T09:30:06.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.743+0000 7fa5b3a09b80 1 Processor -- start 2023-09-23T09:30:06.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.744+0000 7fa5b3a09b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562385f70450 0x562385f72d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:06.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.744+0000 7fa5b3a09b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562385f75b80 0x562385f715e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:06.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.744+0000 7fa5b3a09b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562385f764a0 0x562385f71b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:06.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.744+0000 7fa5b3a09b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562385f73400 con 0x562385f70450 2023-09-23T09:30:06.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.744+0000 7fa5b3a09b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562385f72060 con 0x562385f764a0 2023-09-23T09:30:06.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.744+0000 7fa5b3a09b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x562385f72220 con 0x562385f75b80 2023-09-23T09:30:06.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.744+0000 7fa5b3a09b80 10 client.0 _ll_register_callbacks cb 0x7fa594009920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:30:06.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.745+0000 7fa59d59a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562385f75b80 0x562385f715e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:06.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.745+0000 7fa59d59a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562385f75b80 0x562385f715e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:54980/0 (socket says 172.21.15.82:54980) 2023-09-23T09:30:06.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.745+0000 7fa59d59a700 1 -- 172.21.15.82:0/483618458 learned_addr learned my addr 172.21.15.82:0/483618458 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:30:06.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.745+0000 7fa59dd9b700 1 --2- 172.21.15.82:0/483618458 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562385f70450 0x562385f72d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:06.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.746+0000 7fa59d59a700 1 -- 172.21.15.82:0/483618458 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562385f764a0 msgr2=0x562385f71b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:06.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.746+0000 7fa59d59a700 1 --2- 172.21.15.82:0/483618458 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562385f764a0 0x562385f71b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:06.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.746+0000 7fa59d59a700 1 -- 172.21.15.82:0/483618458 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562385f70450 msgr2=0x562385f72d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:06.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.746+0000 7fa59d59a700 1 --2- 172.21.15.82:0/483618458 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562385f70450 0x562385f72d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:06.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.746+0000 7fa59d59a700 1 -- 172.21.15.82:0/483618458 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa58c01e040 con 0x562385f75b80 2023-09-23T09:30:06.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.747+0000 7fa59d59a700 1 --2- 172.21.15.82:0/483618458 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562385f75b80 0x562385f715e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa58c037000 tx=0x7fa58c0018d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=33b4d26279edf04f server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:06.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.748+0000 7fa5817fa700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T09:30:06.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.754+0000 7fa5817fa700 1 -- 172.21.15.82:0/483618458 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa58c0303f0 con 0x562385f75b80 2023-09-23T09:30:06.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.754+0000 7fa5817fa700 1 -- 172.21.15.82:0/483618458 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(142..142 src has 1..142) v4 ==== 8557+0+0 (secure 0 0 0) 0x7fa58c030550 con 0x562385f75b80 2023-09-23T09:30:06.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.754+0000 7fa5b3a09b80 1 -- 172.21.15.82:0/483618458 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562385f5a8b0 con 0x562385f75b80 2023-09-23T09:30:06.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.755+0000 7fa5817fa700 1 -- 172.21.15.82:0/483618458 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=95) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa58c030880 con 0x562385f75b80 2023-09-23T09:30:06.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.755+0000 7fa5b3a09b80 10 client.27262 fetch_fsmap learned FSMap version 95 2023-09-23T09:30:06.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.755+0000 7fa5b3a09b80 1 -- 172.21.15.82:0/483618458 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=95,monmap=4+}) v3 -- 0x562385ccec60 con 0x562385f75b80 2023-09-23T09:30:06.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.757+0000 7fa5817fa700 1 -- 172.21.15.82:0/483618458 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562385f5a8b0 con 0x562385f75b80 2023-09-23T09:30:06.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.757+0000 7fa5817fa700 1 -- 172.21.15.82:0/483618458 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 95) v1 ==== 7934+0+0 (secure 0 0 0) 0x7fa58c030050 con 0x562385f75b80 2023-09-23T09:30:06.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.757+0000 7fa5b3a09b80 10 client.27262 fetch_fsmap finished waiting for FSMap version 95 2023-09-23T09:30:06.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.757+0000 7fa5b3a09b80 10 client.27262 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-23T09:30:06.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.757+0000 7fa5b3a09b80 20 client.27262 populate_metadata read hostname 'smithi082' 2023-09-23T09:30:06.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.757+0000 7fa5b3a09b80 1 --2- 172.21.15.82:0/483618458 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x562385ff8010 0x562385ffa430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:06.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.757+0000 7fa5b3a09b80 4 client.27262 mds_command: new command op to 24550 tid=0[{"prefix": "damage ls"}] 2023-09-23T09:30:06.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.757+0000 7fa5b3a09b80 1 -- 172.21.15.82:0/483618458 --> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x562385eb2970 con 0x562385ff8010 2023-09-23T09:30:06.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.760+0000 7fa59dd9b700 1 --2- 172.21.15.82:0/483618458 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x562385ff8010 0x562385ffa430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:06.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.764+0000 7fa59dd9b700 1 --2- 172.21.15.82:0/483618458 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x562385ff8010 0x562385ffa430 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=cb49fc971fa7a9a9 server_cookie=c1326be5a5ccf780 in_seq=0 out_seq=0 2023-09-23T09:30:06.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.764+0000 7fa5817fa700 10 client.27262 ms_handle_connect on v2:172.21.15.161:6838/758982817 2023-09-23T09:30:06.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.765+0000 7fa5817fa700 1 -- 172.21.15.82:0/483618458 <== mds.1 v2:172.21.15.161:6838/758982817 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x562385eb2970 con 0x562385ff8010 2023-09-23T09:30:06.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.765+0000 7fa5817fa700 10 client.27262 handle_command_reply: tid=0 2023-09-23T09:30:06.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.765+0000 7fa5b3a09b80 1 client.27262 shutdown 2023-09-23T09:30:06.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.771+0000 7fa5b3a09b80 1 -- 172.21.15.82:0/483618458 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562385f75b80 msgr2=0x562385f715e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:06.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.771+0000 7fa5b3a09b80 1 --2- 172.21.15.82:0/483618458 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562385f75b80 0x562385f715e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa58c037000 tx=0x7fa58c0018d0 comp rx=0 tx=0).stop 2023-09-23T09:30:06.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.771+0000 7fa5b3a09b80 1 -- 172.21.15.82:0/483618458 shutdown_connections 2023-09-23T09:30:06.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.771+0000 7fa5b3a09b80 1 --2- 172.21.15.82:0/483618458 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x562385ff8010 0x562385ffa430 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:06.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.771+0000 7fa5b3a09b80 1 --2- 172.21.15.82:0/483618458 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562385f764a0 0x562385f71b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:06.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.771+0000 7fa5b3a09b80 1 --2- 172.21.15.82:0/483618458 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562385f70450 0x562385f72d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:06.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.771+0000 7fa5b3a09b80 1 --2- 172.21.15.82:0/483618458 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562385f75b80 0x562385f715e0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:06.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.771+0000 7fa5b3a09b80 1 -- 172.21.15.82:0/483618458 >> 172.21.15.82:0/483618458 conn(0x562385edc0e0 msgr2=0x562385f5c2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:06.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.772+0000 7fa5817fa700 0 client.27262 ms_handle_reset on v2:172.21.15.161:6838/758982817 2023-09-23T09:30:06.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.772+0000 7fa5b3a09b80 1 -- 172.21.15.82:0/483618458 shutdown_connections 2023-09-23T09:30:06.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.772+0000 7fa5b3a09b80 1 -- 172.21.15.82:0/483618458 wait complete. 2023-09-23T09:30:06.778 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2023-09-23T09:30:06.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.773+0000 7fa5b3a09b80 20 client.27262 trim_cache size 0 max 16384 2023-09-23T09:30:06.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.785+0000 7fa59ffff700 1 -- 172.21.15.82:0/2948677974 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fa5840a0250 msgr2=0x7fa5840a2710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:06.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.785+0000 7fa59ffff700 1 --2- 172.21.15.82:0/2948677974 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fa5840a0250 0x7fa5840a2710 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa58c001350 tx=0x7fa58c007b20 comp rx=0 tx=0).stop 2023-09-23T09:30:06.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.785+0000 7fa59ffff700 1 -- 172.21.15.82:0/2948677974 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa598105770 msgr2=0x7fa5981a4b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:06.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.785+0000 7fa59ffff700 1 --2- 172.21.15.82:0/2948677974 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa598105770 0x7fa5981a4b50 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fa5900036f0 tx=0x7fa590003850 comp rx=0 tx=0).stop 2023-09-23T09:30:06.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.787+0000 7fa59ffff700 1 -- 172.21.15.82:0/2948677974 shutdown_connections 2023-09-23T09:30:06.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.787+0000 7fa59ffff700 1 --2- 172.21.15.82:0/2948677974 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fa5840a0250 0x7fa5840a2710 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:06.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.787+0000 7fa59ffff700 1 --2- 172.21.15.82:0/2948677974 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa598105770 0x7fa5981a4b50 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:06.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.787+0000 7fa59ffff700 1 --2- 172.21.15.82:0/2948677974 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa5980ff760 0x7fa59810d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:06.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.787+0000 7fa59ffff700 1 --2- 172.21.15.82:0/2948677974 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa598100120 0x7fa59810d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:06.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.787+0000 7fa59ffff700 1 -- 172.21.15.82:0/2948677974 >> 172.21.15.82:0/2948677974 conn(0x7fa5980fb270 msgr2=0x7fa5980fb870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:06.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.794+0000 7fa59ffff700 1 -- 172.21.15.82:0/2948677974 shutdown_connections 2023-09-23T09:30:06.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:06.798+0000 7fa59ffff700 1 -- 172.21.15.82:0/2948677974 wait complete. 2023-09-23T09:30:06.846 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-09-23T09:30:07.019 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:30:06 smithi082 ceph-mon[97694]: pgmap v1051: 97 pgs: 97 active+clean; 16 GiB data, 56 GiB used, 1017 GiB / 1.0 TiB avail; 1.3 MiB/s rd, 16 MiB/s wr, 1.12k op/s 2023-09-23T09:30:07.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:30:06 smithi135 ceph-mon[99205]: pgmap v1051: 97 pgs: 97 active+clean; 16 GiB data, 56 GiB used, 1017 GiB / 1.0 TiB avail; 1.3 MiB/s rd, 16 MiB/s wr, 1.12k op/s 2023-09-23T09:30:07.150 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:30:06 smithi161 ceph-mon[99580]: pgmap v1051: 97 pgs: 97 active+clean; 16 GiB data, 56 GiB used, 1017 GiB / 1.0 TiB avail; 1.3 MiB/s rd, 16 MiB/s wr, 1.12k op/s 2023-09-23T09:30:07.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.337+0000 7f9f17dff700 1 -- 172.21.15.82:0/3122402745 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9f1010c4a0 msgr2=0x7f9f10078ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:07.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.337+0000 7f9f17dff700 1 --2- 172.21.15.82:0/3122402745 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9f1010c4a0 0x7f9f10078ba0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f9f00005ce0 tx=0x7f9f00009a60 comp rx=0 tx=0).stop 2023-09-23T09:30:07.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.342+0000 7f9f17dff700 1 -- 172.21.15.82:0/3122402745 shutdown_connections 2023-09-23T09:30:07.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.342+0000 7f9f17dff700 1 --2- 172.21.15.82:0/3122402745 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9f1010c4a0 0x7f9f10078ba0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:07.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.342+0000 7f9f17dff700 1 --2- 172.21.15.82:0/3122402745 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9f1010ce30 0x7f9f1010d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:07.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.342+0000 7f9f17dff700 1 --2- 172.21.15.82:0/3122402745 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f1010bae0 0x7f9f1010bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:07.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.342+0000 7f9f17dff700 1 -- 172.21.15.82:0/3122402745 >> 172.21.15.82:0/3122402745 conn(0x7f9f1006cbe0 msgr2=0x7f9f1006cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:07.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.344+0000 7f9f17dff700 1 -- 172.21.15.82:0/3122402745 shutdown_connections 2023-09-23T09:30:07.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.346+0000 7f9f17dff700 1 -- 172.21.15.82:0/3122402745 wait complete. 2023-09-23T09:30:07.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.347+0000 7f9f17dff700 1 Processor -- start 2023-09-23T09:30:07.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.347+0000 7f9f17dff700 1 -- start start 2023-09-23T09:30:07.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.347+0000 7f9f17dff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f1010bae0 0x7f9f10083000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:07.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.348+0000 7f9f17dff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9f1010c4a0 0x7f9f10083540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:07.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.348+0000 7f9f17dff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9f1010ce30 0x7f9f1007d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:07.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.348+0000 7f9f17dff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1007d900 con 0x7f9f1010bae0 2023-09-23T09:30:07.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.348+0000 7f9f17dff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1007da70 con 0x7f9f1010c4a0 2023-09-23T09:30:07.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.348+0000 7f9f17dff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1007dc30 con 0x7f9f1010ce30 2023-09-23T09:30:07.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.349+0000 7f9f15b9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f1010bae0 0x7f9f10083000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:07.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.349+0000 7f9f15b9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f1010bae0 0x7f9f10083000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48036/0 (socket says 172.21.15.82:48036) 2023-09-23T09:30:07.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.349+0000 7f9f15b9b700 1 -- 172.21.15.82:0/1818323008 learned_addr learned my addr 172.21.15.82:0/1818323008 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:30:07.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.350+0000 7f9f1539a700 1 --2- 172.21.15.82:0/1818323008 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9f1010c4a0 0x7f9f10083540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:07.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.350+0000 7f9f1639c700 1 --2- 172.21.15.82:0/1818323008 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9f1010ce30 0x7f9f1007d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:07.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.351+0000 7f9f15b9b700 1 -- 172.21.15.82:0/1818323008 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9f1010ce30 msgr2=0x7f9f1007d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:07.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.351+0000 7f9f15b9b700 1 --2- 172.21.15.82:0/1818323008 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9f1010ce30 0x7f9f1007d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:07.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.351+0000 7f9f15b9b700 1 -- 172.21.15.82:0/1818323008 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9f1010c4a0 msgr2=0x7f9f10083540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:07.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.351+0000 7f9f15b9b700 1 --2- 172.21.15.82:0/1818323008 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9f1010c4a0 0x7f9f10083540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:07.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.351+0000 7f9f15b9b700 1 -- 172.21.15.82:0/1818323008 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f000095f0 con 0x7f9f1010bae0 2023-09-23T09:30:07.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.352+0000 7f9f15b9b700 1 --2- 172.21.15.82:0/1818323008 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f1010bae0 0x7f9f10083000 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f9f0800b840 tx=0x7f9f0800bb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:07.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.353+0000 7f9f06ffd700 1 -- 172.21.15.82:0/1818323008 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f0800f840 con 0x7f9f1010bae0 2023-09-23T09:30:07.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.353+0000 7f9f06ffd700 1 -- 172.21.15.82:0/1818323008 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9f0800fe30 con 0x7f9f1010bae0 2023-09-23T09:30:07.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.353+0000 7f9f06ffd700 1 -- 172.21.15.82:0/1818323008 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f0800d3d0 con 0x7f9f1010bae0 2023-09-23T09:30:07.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.353+0000 7f9f17dff700 1 -- 172.21.15.82:0/1818323008 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f101c3230 con 0x7f9f1010bae0 2023-09-23T09:30:07.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.353+0000 7f9f17dff700 1 -- 172.21.15.82:0/1818323008 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f101c3660 con 0x7f9f1010bae0 2023-09-23T09:30:07.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.361+0000 7f9f2b73db80 1 Processor -- start 2023-09-23T09:30:07.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.362+0000 7f9f2b73db80 1 -- start start 2023-09-23T09:30:07.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.362+0000 7f9f2b73db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f6596ea380 0x55f6596ea760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:07.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.362+0000 7f9f2b73db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f6596eaca0 0x55f6596e4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:07.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.362+0000 7f9f2b73db80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f6596e4c40 0x55f6596e50a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:07.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.362+0000 7f9f2b73db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f65964c7b0 con 0x55f6596ea380 2023-09-23T09:30:07.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.362+0000 7f9f2b73db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f65963d780 con 0x55f6596eaca0 2023-09-23T09:30:07.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.362+0000 7f9f2b73db80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f65963b0a0 con 0x55f6596e4c40 2023-09-23T09:30:07.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.363+0000 7f9f1639c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f6596ea380 0x55f6596ea760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:07.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.363+0000 7f9f1639c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f6596ea380 0x55f6596ea760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48048/0 (socket says 172.21.15.82:48048) 2023-09-23T09:30:07.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.363+0000 7f9f1639c700 1 -- 172.21.15.82:0/2536142612 learned_addr learned my addr 172.21.15.82:0/2536142612 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:30:07.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.364+0000 7f9f06ffd700 1 -- 172.21.15.82:0/1818323008 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f9f0800f9a0 con 0x7f9f1010bae0 2023-09-23T09:30:07.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.364+0000 7f9f1639c700 1 -- 172.21.15.82:0/2536142612 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f6596e4c40 msgr2=0x55f6596e50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:07.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.364+0000 7f9f1639c700 1 --2- 172.21.15.82:0/2536142612 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f6596e4c40 0x55f6596e50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:07.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.364+0000 7f9f1639c700 1 -- 172.21.15.82:0/2536142612 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f6596eaca0 msgr2=0x55f6596e4700 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-23T09:30:07.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.364+0000 7f9f1639c700 1 --2- 172.21.15.82:0/2536142612 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f6596eaca0 0x55f6596e4700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:07.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.364+0000 7f9f1639c700 1 -- 172.21.15.82:0/2536142612 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f6594b6630 con 0x55f6596ea380 2023-09-23T09:30:07.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.365+0000 7f9f1639c700 1 --2- 172.21.15.82:0/2536142612 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f6596ea380 0x55f6596ea760 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f9f00005bf0 tx=0x7f9f00005c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7ca206e6f09ab56 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:07.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.365+0000 7f9efbfff700 1 -- 172.21.15.82:0/2536142612 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f000056f0 con 0x55f6596ea380 2023-09-23T09:30:07.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.365+0000 7f9efbfff700 1 -- 172.21.15.82:0/2536142612 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9f0000bc20 con 0x55f6596ea380 2023-09-23T09:30:07.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.365+0000 7f9efbfff700 1 -- 172.21.15.82:0/2536142612 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f000040e0 con 0x55f6596ea380 2023-09-23T09:30:07.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.366+0000 7f9f2b73db80 1 -- 172.21.15.82:0/2536142612 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f6596ea380 msgr2=0x55f6596ea760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:07.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.366+0000 7f9f2b73db80 1 --2- 172.21.15.82:0/2536142612 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f6596ea380 0x55f6596ea760 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f9f00005bf0 tx=0x7f9f00005c20 comp rx=0 tx=0).stop 2023-09-23T09:30:07.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.367+0000 7f9f06ffd700 1 --2- 172.21.15.82:0/1818323008 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f9efc0a02d0 0x7f9efc0a2790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:07.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.367+0000 7f9f2b73db80 1 -- 172.21.15.82:0/2536142612 shutdown_connections 2023-09-23T09:30:07.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.367+0000 7f9f06ffd700 1 -- 172.21.15.82:0/1818323008 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 8557+0+0 (secure 0 0 0) 0x7f9f080cb830 con 0x7f9f1010bae0 2023-09-23T09:30:07.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.367+0000 7f9f2b73db80 1 --2- 172.21.15.82:0/2536142612 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f6596e4c40 0x55f6596e50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:07.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.367+0000 7f9f2b73db80 1 --2- 172.21.15.82:0/2536142612 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f6596ea380 0x55f6596ea760 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:07.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.368+0000 7f9f2b73db80 1 --2- 172.21.15.82:0/2536142612 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f6596eaca0 0x55f6596e4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:07.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.368+0000 7f9f2b73db80 1 -- 172.21.15.82:0/2536142612 >> 172.21.15.82:0/2536142612 conn(0x55f6596590e0 msgr2=0x55f6596df410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:07.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.368+0000 7f9f2b73db80 1 -- 172.21.15.82:0/2536142612 shutdown_connections 2023-09-23T09:30:07.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.369+0000 7f9f1639c700 1 --2- 172.21.15.82:0/1818323008 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f9efc0a02d0 0x7f9efc0a2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:07.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.370+0000 7f9f1639c700 1 --2- 172.21.15.82:0/1818323008 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f9efc0a02d0 0x7f9efc0a2790 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9f00005b40 tx=0x7f9f00009a60 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:07.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.372+0000 7f9f2b73db80 1 -- 172.21.15.82:0/2536142612 wait complete. 2023-09-23T09:30:07.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.372+0000 7f9f2b73db80 1 -- start start 2023-09-23T09:30:07.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.373+0000 7f9f2b73db80 1 Processor -- start 2023-09-23T09:30:07.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.374+0000 7f9f2b73db80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f6596e4c40 0x55f6596f0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:07.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.374+0000 7f9f2b73db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f6596ea380 0x55f6596edf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:07.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.374+0000 7f9f2b73db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f6596eaca0 0x55f6596ee5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:07.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.374+0000 7f9f2b73db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f659636990 con 0x55f6596eaca0 2023-09-23T09:30:07.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.374+0000 7f9f2b73db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6595d4bb0 con 0x55f6596ea380 2023-09-23T09:30:07.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.374+0000 7f9f2b73db80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6595d48b0 con 0x55f6596e4c40 2023-09-23T09:30:07.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.374+0000 7f9f2b73db80 10 client.0 _ll_register_callbacks cb 0x55f65951ea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:30:07.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.375+0000 7f9f1539a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f6596ea380 0x55f6596edf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:07.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.375+0000 7f9f1539a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f6596ea380 0x55f6596edf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:57770/0 (socket says 172.21.15.82:57770) 2023-09-23T09:30:07.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.375+0000 7f9f1539a700 1 -- 172.21.15.82:0/2034642012 learned_addr learned my addr 172.21.15.82:0/2034642012 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:30:07.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.376+0000 7f9f1639c700 1 --2- 172.21.15.82:0/2034642012 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f6596eaca0 0x55f6596ee5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:07.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.377+0000 7f9f1539a700 1 -- 172.21.15.82:0/2034642012 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f6596e4c40 msgr2=0x55f6596f0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:07.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.377+0000 7f9f1539a700 1 --2- 172.21.15.82:0/2034642012 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f6596e4c40 0x55f6596f0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:07.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.377+0000 7f9f1539a700 1 -- 172.21.15.82:0/2034642012 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f6596eaca0 msgr2=0x55f6596ee5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:07.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.377+0000 7f9f1539a700 1 --2- 172.21.15.82:0/2034642012 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f6596eaca0 0x55f6596ee5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:07.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.377+0000 7f9f1539a700 1 -- 172.21.15.82:0/2034642012 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f0001a040 con 0x55f6596ea380 2023-09-23T09:30:07.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.377+0000 7f9f1539a700 1 --2- 172.21.15.82:0/2034642012 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f6596ea380 0x55f6596edf00 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c007fb0 tx=0x7f9f0c00d4f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5afacbf4a30635a server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:07.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.382+0000 7f9ef97fa700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-09-23T09:30:07.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.382+0000 7f9ef97fa700 1 -- 172.21.15.82:0/2034642012 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f0c00de30 con 0x55f6596ea380 2023-09-23T09:30:07.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.382+0000 7f9ef97fa700 1 -- 172.21.15.82:0/2034642012 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(142..142 src has 1..142) v4 ==== 8557+0+0 (secure 0 0 0) 0x7f9f0c013480 con 0x55f6596ea380 2023-09-23T09:30:07.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.385+0000 7f9f2b73db80 1 -- 172.21.15.82:0/2034642012 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f6596b41c0 con 0x55f6596ea380 2023-09-23T09:30:07.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.386+0000 7f9ef97fa700 1 -- 172.21.15.82:0/2034642012 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=95) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9f0c013640 con 0x55f6596ea380 2023-09-23T09:30:07.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.386+0000 7f9f2b73db80 10 client.27239 fetch_fsmap learned FSMap version 95 2023-09-23T09:30:07.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.386+0000 7f9f2b73db80 1 -- 172.21.15.82:0/2034642012 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=95,monmap=4+}) v3 -- 0x55f659462de0 con 0x55f6596ea380 2023-09-23T09:30:07.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.387+0000 7f9ef97fa700 1 -- 172.21.15.82:0/2034642012 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f6596b41c0 con 0x55f6596ea380 2023-09-23T09:30:07.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.387+0000 7f9ef97fa700 1 -- 172.21.15.82:0/2034642012 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 95) v1 ==== 7934+0+0 (secure 0 0 0) 0x7f9f0c01d7d0 con 0x55f6596ea380 2023-09-23T09:30:07.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.387+0000 7f9f2b73db80 10 client.27239 fetch_fsmap finished waiting for FSMap version 95 2023-09-23T09:30:07.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.387+0000 7f9f2b73db80 10 client.27239 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:30:07.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.387+0000 7f9f2b73db80 20 client.27239 populate_metadata read hostname 'smithi082' 2023-09-23T09:30:07.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.387+0000 7f9f2b73db80 1 --2- 172.21.15.82:0/2034642012 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55f6596fe810 0x55f659700c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:07.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.387+0000 7f9f2b73db80 4 client.27239 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:30:07.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.387+0000 7f9f2b73db80 1 -- 172.21.15.82:0/2034642012 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f6595dcba0 con 0x55f6596fe810 2023-09-23T09:30:07.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.388+0000 7f9f15b9b700 1 --2- 172.21.15.82:0/2034642012 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55f6596fe810 0x55f659700c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:07.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.389+0000 7f9f15b9b700 1 --2- 172.21.15.82:0/2034642012 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55f6596fe810 0x55f659700c30 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aed1cc38e428f3fd server_cookie=a83d0be5debe9a99 in_seq=0 out_seq=0 2023-09-23T09:30:07.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.389+0000 7f9ef97fa700 10 client.27239 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:30:07.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.392+0000 7f9ef97fa700 1 -- 172.21.15.82:0/2034642012 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f6595dcba0 con 0x55f6596fe810 2023-09-23T09:30:07.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.392+0000 7f9ef97fa700 10 client.27239 handle_command_reply: tid=0 2023-09-23T09:30:07.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.392+0000 7f9f2b73db80 1 client.27239 shutdown 2023-09-23T09:30:07.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.394+0000 7f9f2b73db80 1 -- 172.21.15.82:0/2034642012 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f6596ea380 msgr2=0x55f6596edf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:07.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.394+0000 7f9f2b73db80 1 --2- 172.21.15.82:0/2034642012 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f6596ea380 0x55f6596edf00 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c007fb0 tx=0x7f9f0c00d4f0 comp rx=0 tx=0).stop 2023-09-23T09:30:07.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.394+0000 7f9f2b73db80 1 -- 172.21.15.82:0/2034642012 shutdown_connections 2023-09-23T09:30:07.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.394+0000 7f9f2b73db80 1 --2- 172.21.15.82:0/2034642012 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55f6596fe810 0x55f659700c30 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:07.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.394+0000 7f9f2b73db80 1 --2- 172.21.15.82:0/2034642012 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f6596eaca0 0x55f6596ee5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:07.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.394+0000 7f9f2b73db80 1 --2- 172.21.15.82:0/2034642012 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f6596e4c40 0x55f6596f0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:07.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.394+0000 7f9f2b73db80 1 --2- 172.21.15.82:0/2034642012 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f6596ea380 0x55f6596edf00 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:07.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.394+0000 7f9f2b73db80 1 -- 172.21.15.82:0/2034642012 >> 172.21.15.82:0/2034642012 conn(0x55f6596590e0 msgr2=0x55f6596d9b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:07.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.394+0000 7f9ef97fa700 0 client.27239 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:30:07.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.396+0000 7f9f2b73db80 1 -- 172.21.15.82:0/2034642012 shutdown_connections 2023-09-23T09:30:07.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.396+0000 7f9f2b73db80 1 -- 172.21.15.82:0/2034642012 wait complete. 2023-09-23T09:30:07.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.397+0000 7f9f2b73db80 20 client.27239 trim_cache size 0 max 16384 2023-09-23T09:30:07.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.421+0000 7f9f2b73db80 1 Processor -- start 2023-09-23T09:30:07.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.421+0000 7f9f2b73db80 1 -- start start 2023-09-23T09:30:07.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.421+0000 7f9f2b73db80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f6596e4c40 0x55f6596f0820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:07.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.421+0000 7f9f2b73db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f6596ea380 0x55f6596ed6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:07.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.421+0000 7f9f2b73db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f6596eaca0 0x55f6596edc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:07.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.421+0000 7f9f2b73db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6594b8920 con 0x55f6596ea380 2023-09-23T09:30:07.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.421+0000 7f9f2b73db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6596db810 con 0x55f6596eaca0 2023-09-23T09:30:07.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.421+0000 7f9f2b73db80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6596df830 con 0x55f6596e4c40 2023-09-23T09:30:07.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.422+0000 7f9f1639c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f6596eaca0 0x55f6596edc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:07.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.422+0000 7f9f1639c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f6596eaca0 0x55f6596edc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:57778/0 (socket says 172.21.15.82:57778) 2023-09-23T09:30:07.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.422+0000 7f9f1639c700 1 -- 172.21.15.82:0/1111537576 learned_addr learned my addr 172.21.15.82:0/1111537576 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:30:07.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.423+0000 7f9f15b9b700 1 --2- 172.21.15.82:0/1111537576 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f6596e4c40 0x55f6596f0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:07.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.425+0000 7f9f15b9b700 1 -- 172.21.15.82:0/1111537576 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f6596eaca0 msgr2=0x55f6596edc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:07.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.425+0000 7f9f15b9b700 1 --2- 172.21.15.82:0/1111537576 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f6596eaca0 0x55f6596edc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:07.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.425+0000 7f9f15b9b700 1 -- 172.21.15.82:0/1111537576 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f6596ea380 msgr2=0x55f6596ed6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:07.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.425+0000 7f9f15b9b700 1 --2- 172.21.15.82:0/1111537576 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f6596ea380 0x55f6596ed6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:07.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.425+0000 7f9f15b9b700 1 -- 172.21.15.82:0/1111537576 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f65944bc60 con 0x55f6596e4c40 2023-09-23T09:30:07.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.426+0000 7f9f15b9b700 1 --2- 172.21.15.82:0/1111537576 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f6596e4c40 0x55f6596f0820 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f9f080c8f00 tx=0x7f9f080b8040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b958fb941c93f22 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:07.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.429+0000 7f9f04bff700 1 -- 172.21.15.82:0/1111537576 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f0800fc50 con 0x55f6596e4c40 2023-09-23T09:30:07.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.429+0000 7f9f04bff700 1 -- 172.21.15.82:0/1111537576 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9f080995c0 con 0x55f6596e4c40 2023-09-23T09:30:07.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.429+0000 7f9f04bff700 1 -- 172.21.15.82:0/1111537576 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f08015db0 con 0x55f6596e4c40 2023-09-23T09:30:07.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.430+0000 7f9f2b73db80 1 -- 172.21.15.82:0/1111537576 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f6596e4c40 msgr2=0x55f6596f0820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:07.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.430+0000 7f9f2b73db80 1 --2- 172.21.15.82:0/1111537576 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f6596e4c40 0x55f6596f0820 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f9f080c8f00 tx=0x7f9f080b8040 comp rx=0 tx=0).stop 2023-09-23T09:30:07.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.431+0000 7f9f2b73db80 1 -- 172.21.15.82:0/1111537576 shutdown_connections 2023-09-23T09:30:07.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.431+0000 7f9f2b73db80 1 --2- 172.21.15.82:0/1111537576 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f6596eaca0 0x55f6596edc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:07.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.431+0000 7f9f2b73db80 1 --2- 172.21.15.82:0/1111537576 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f6596e4c40 0x55f6596f0820 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:07.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.431+0000 7f9f2b73db80 1 --2- 172.21.15.82:0/1111537576 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f6596ea380 0x55f6596ed6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:07.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.431+0000 7f9f2b73db80 1 -- 172.21.15.82:0/1111537576 >> 172.21.15.82:0/1111537576 conn(0x55f6596590e0 msgr2=0x55f6596e8090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:07.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.432+0000 7f9f2b73db80 1 -- 172.21.15.82:0/1111537576 shutdown_connections 2023-09-23T09:30:07.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.432+0000 7f9f2b73db80 1 -- 172.21.15.82:0/1111537576 wait complete. 2023-09-23T09:30:07.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.433+0000 7f9f2b73db80 1 -- start start 2023-09-23T09:30:07.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.435+0000 7f9f2b73db80 1 Processor -- start 2023-09-23T09:30:07.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.436+0000 7f9f2b73db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f6596e4c40 0x55f6596e6e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:07.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.436+0000 7f9f2b73db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f6596ea380 0x55f6596e73c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:07.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.436+0000 7f9f2b73db80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f6596eaca0 0x55f6596e5e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:07.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.436+0000 7f9f2b73db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6596e7a10 con 0x55f6596e4c40 2023-09-23T09:30:07.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.436+0000 7f9f2b73db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6596e7b80 con 0x55f6596ea380 2023-09-23T09:30:07.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.436+0000 7f9f2b73db80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6596e6340 con 0x55f6596eaca0 2023-09-23T09:30:07.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.436+0000 7f9f2b73db80 10 client.0 _ll_register_callbacks cb 0x7f9f0c007b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:30:07.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.442+0000 7f9f1639c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f6596eaca0 0x55f6596e5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:07.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.442+0000 7f9f1639c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f6596eaca0 0x55f6596e5e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:55034/0 (socket says 172.21.15.82:55034) 2023-09-23T09:30:07.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.442+0000 7f9f1639c700 1 -- 172.21.15.82:0/2101420705 learned_addr learned my addr 172.21.15.82:0/2101420705 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:30:07.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.443+0000 7f9f15b9b700 1 --2- 172.21.15.82:0/2101420705 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f6596e4c40 0x55f6596e6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:07.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.445+0000 7f9f1539a700 1 --2- 172.21.15.82:0/2101420705 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f6596ea380 0x55f6596e73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:07.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.446+0000 7f9f1539a700 1 -- 172.21.15.82:0/2101420705 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f6596eaca0 msgr2=0x55f6596e5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:07.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.446+0000 7f9f1539a700 1 --2- 172.21.15.82:0/2101420705 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f6596eaca0 0x55f6596e5e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:07.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.446+0000 7f9f1539a700 1 -- 172.21.15.82:0/2101420705 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f6596e4c40 msgr2=0x55f6596e6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:07.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.446+0000 7f9f1539a700 1 --2- 172.21.15.82:0/2101420705 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f6596e4c40 0x55f6596e6e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:07.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.446+0000 7f9f1539a700 1 -- 172.21.15.82:0/2101420705 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f101c3660 con 0x55f6596ea380 2023-09-23T09:30:07.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.447+0000 7f9f1539a700 1 --2- 172.21.15.82:0/2101420705 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f6596ea380 0x55f6596e73c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x55f6596ef170 tx=0x7f9f0c007260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4153a3e9af0f279a server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:07.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.447+0000 7f9ef97fa700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-09-23T09:30:07.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.448+0000 7f9ef97fa700 1 -- 172.21.15.82:0/2101420705 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f0c006f50 con 0x55f6596ea380 2023-09-23T09:30:07.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.448+0000 7f9ef97fa700 1 -- 172.21.15.82:0/2101420705 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(142..142 src has 1..142) v4 ==== 8557+0+0 (secure 0 0 0) 0x7f9f0c01d450 con 0x55f6596ea380 2023-09-23T09:30:07.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.448+0000 7f9f2b73db80 1 -- 172.21.15.82:0/2101420705 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f6596d78b0 con 0x55f6596ea380 2023-09-23T09:30:07.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.449+0000 7f9ef97fa700 1 -- 172.21.15.82:0/2101420705 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=95) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9f0c01d630 con 0x55f6596ea380 2023-09-23T09:30:07.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.449+0000 7f9f2b73db80 10 client.27245 fetch_fsmap learned FSMap version 95 2023-09-23T09:30:07.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.449+0000 7f9f2b73db80 1 -- 172.21.15.82:0/2101420705 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=95,monmap=4+}) v3 -- 0x55f659489250 con 0x55f6596ea380 2023-09-23T09:30:07.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.449+0000 7f9ef97fa700 1 -- 172.21.15.82:0/2101420705 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f6596d78b0 con 0x55f6596ea380 2023-09-23T09:30:07.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.450+0000 7f9ef97fa700 1 -- 172.21.15.82:0/2101420705 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 95) v1 ==== 7934+0+0 (secure 0 0 0) 0x7f9f0c012d20 con 0x55f6596ea380 2023-09-23T09:30:07.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.450+0000 7f9f2b73db80 10 client.27245 fetch_fsmap finished waiting for FSMap version 95 2023-09-23T09:30:07.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.450+0000 7f9f2b73db80 10 client.27245 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:30:07.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.450+0000 7f9f2b73db80 20 client.27245 populate_metadata read hostname 'smithi082' 2023-09-23T09:30:07.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.450+0000 7f9f2b73db80 1 --2- 172.21.15.82:0/2101420705 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55f65974f1e0 0x55f65974f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:07.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.450+0000 7f9f2b73db80 4 client.27245 mds_command: new command op to 24557 tid=0[{"prefix": "damage ls"}] 2023-09-23T09:30:07.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.450+0000 7f9f2b73db80 1 -- 172.21.15.82:0/2101420705 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55f65962f970 con 0x55f65974f1e0 2023-09-23T09:30:07.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.451+0000 7f9f15b9b700 1 --2- 172.21.15.82:0/2101420705 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55f65974f1e0 0x55f65974f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:07.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.457+0000 7f9f15b9b700 1 --2- 172.21.15.82:0/2101420705 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55f65974f1e0 0x55f65974f5f0 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db1ea8d907474afa server_cookie=72c9ae50628152c2 in_seq=0 out_seq=0 2023-09-23T09:30:07.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.457+0000 7f9ef97fa700 10 client.27245 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:30:07.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.458+0000 7f9ef97fa700 1 -- 172.21.15.82:0/2101420705 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55f65962f970 con 0x55f65974f1e0 2023-09-23T09:30:07.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.458+0000 7f9ef97fa700 10 client.27245 handle_command_reply: tid=0 2023-09-23T09:30:07.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.458+0000 7f9f2b73db80 1 client.27245 shutdown 2023-09-23T09:30:07.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.462+0000 7f9f2b73db80 1 -- 172.21.15.82:0/2101420705 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f6596ea380 msgr2=0x55f6596e73c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:07.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.462+0000 7f9f2b73db80 1 --2- 172.21.15.82:0/2101420705 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f6596ea380 0x55f6596e73c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x55f6596ef170 tx=0x7f9f0c007260 comp rx=0 tx=0).stop 2023-09-23T09:30:07.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.462+0000 7f9f2b73db80 1 -- 172.21.15.82:0/2101420705 shutdown_connections 2023-09-23T09:30:07.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.462+0000 7f9f2b73db80 1 --2- 172.21.15.82:0/2101420705 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f6596eaca0 0x55f6596e5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:07.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.462+0000 7f9f2b73db80 1 --2- 172.21.15.82:0/2101420705 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55f65974f1e0 0x55f65974f5f0 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:07.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.462+0000 7f9f2b73db80 1 --2- 172.21.15.82:0/2101420705 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f6596e4c40 0x55f6596e6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:07.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.462+0000 7f9f2b73db80 1 --2- 172.21.15.82:0/2101420705 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f6596ea380 0x55f6596e73c0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:07.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.462+0000 7f9f2b73db80 1 -- 172.21.15.82:0/2101420705 >> 172.21.15.82:0/2101420705 conn(0x55f6596590e0 msgr2=0x55f6596d92b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:07.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.462+0000 7f9ef97fa700 0 client.27245 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:30:07.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.464+0000 7f9f2b73db80 1 -- 172.21.15.82:0/2101420705 shutdown_connections 2023-09-23T09:30:07.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.464+0000 7f9f2b73db80 1 -- 172.21.15.82:0/2101420705 wait complete. 2023-09-23T09:30:07.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.470+0000 7f9f2b73db80 20 client.27245 trim_cache size 0 max 16384 2023-09-23T09:30:07.474 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2023-09-23T09:30:07.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.477+0000 7f9f17dff700 1 -- 172.21.15.82:0/1818323008 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f9efc0a02d0 msgr2=0x7f9efc0a2790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:07.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.477+0000 7f9f17dff700 1 --2- 172.21.15.82:0/1818323008 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f9efc0a02d0 0x7f9efc0a2790 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9f00005b40 tx=0x7f9f00009a60 comp rx=0 tx=0).stop 2023-09-23T09:30:07.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.477+0000 7f9f17dff700 1 -- 172.21.15.82:0/1818323008 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f1010bae0 msgr2=0x7f9f10083000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:07.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.477+0000 7f9f17dff700 1 --2- 172.21.15.82:0/1818323008 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f1010bae0 0x7f9f10083000 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f9f0800b840 tx=0x7f9f0800bb50 comp rx=0 tx=0).stop 2023-09-23T09:30:07.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.487+0000 7f9f17dff700 1 -- 172.21.15.82:0/1818323008 shutdown_connections 2023-09-23T09:30:07.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.487+0000 7f9f17dff700 1 --2- 172.21.15.82:0/1818323008 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f9efc0a02d0 0x7f9efc0a2790 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:07.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.487+0000 7f9f17dff700 1 --2- 172.21.15.82:0/1818323008 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9f1010ce30 0x7f9f1007d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:07.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.487+0000 7f9f17dff700 1 --2- 172.21.15.82:0/1818323008 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f1010bae0 0x7f9f10083000 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:07.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.487+0000 7f9f17dff700 1 --2- 172.21.15.82:0/1818323008 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9f1010c4a0 0x7f9f10083540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:07.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.487+0000 7f9f17dff700 1 -- 172.21.15.82:0/1818323008 >> 172.21.15.82:0/1818323008 conn(0x7f9f1006cbe0 msgr2=0x7f9f10109420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:07.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.488+0000 7f9f17dff700 1 -- 172.21.15.82:0/1818323008 shutdown_connections 2023-09-23T09:30:07.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:07.494+0000 7f9f17dff700 1 -- 172.21.15.82:0/1818323008 wait complete. 2023-09-23T09:30:07.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:30:07 smithi082 ceph-mon[97694]: osdmap e142: 12 total, 12 up, 12 in 2023-09-23T09:30:08.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:30:07 smithi135 ceph-mon[99205]: osdmap e142: 12 total, 12 up, 12 in 2023-09-23T09:30:08.156 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:30:07 smithi161 ceph-mon[99580]: osdmap e142: 12 total, 12 up, 12 in 2023-09-23T09:30:08.548 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-09-23T09:30:08.549 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-09-23T09:30:08.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.957+0000 7fc93b9ff700 1 -- 172.21.15.82:0/933525641 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc934108100 msgr2=0x7fc934113e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:08.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.957+0000 7fc93b9ff700 1 --2- 172.21.15.82:0/933525641 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc934108100 0x7fc934113e20 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc92c009f90 tx=0x7fc92c00b330 comp rx=0 tx=0).stop 2023-09-23T09:30:08.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.957+0000 7fc93b9ff700 1 -- 172.21.15.82:0/933525641 shutdown_connections 2023-09-23T09:30:08.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.957+0000 7fc93b9ff700 1 --2- 172.21.15.82:0/933525641 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc934108100 0x7fc934113e20 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:08.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.957+0000 7fc93b9ff700 1 --2- 172.21.15.82:0/933525641 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc93410d060 0x7fc93410d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:08.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.957+0000 7fc93b9ff700 1 --2- 172.21.15.82:0/933525641 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc934107760 0x7fc934107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:08.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.957+0000 7fc93b9ff700 1 -- 172.21.15.82:0/933525641 >> 172.21.15.82:0/933525641 conn(0x7fc934076580 msgr2=0x7fc9340789a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:08.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.959+0000 7fc93b9ff700 1 -- 172.21.15.82:0/933525641 shutdown_connections 2023-09-23T09:30:08.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.959+0000 7fc93b9ff700 1 -- 172.21.15.82:0/933525641 wait complete. 2023-09-23T09:30:08.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.960+0000 7fc93b9ff700 1 Processor -- start 2023-09-23T09:30:08.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.961+0000 7fc93b9ff700 1 -- start start 2023-09-23T09:30:08.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.961+0000 7fc93b9ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc934107760 0x7fc934071e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:08.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.961+0000 7fc93b9ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc934108100 0x7fc9340723e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:08.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.961+0000 7fc93b9ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc93410d060 0x7fc93406ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:08.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.961+0000 7fc93b9ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc93406b640 con 0x7fc93410d060 2023-09-23T09:30:08.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.961+0000 7fc93b9ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc93406b7b0 con 0x7fc934107760 2023-09-23T09:30:08.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.961+0000 7fc93b9ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc93406b970 con 0x7fc934108100 2023-09-23T09:30:08.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.961+0000 7fc938f9a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc934108100 0x7fc9340723e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:08.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.962+0000 7fc938f9a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc934108100 0x7fc9340723e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:55048/0 (socket says 172.21.15.82:55048) 2023-09-23T09:30:08.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.962+0000 7fc938f9a700 1 -- 172.21.15.82:0/1980539842 learned_addr learned my addr 172.21.15.82:0/1980539842 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:30:08.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.962+0000 7fc938f9a700 1 -- 172.21.15.82:0/1980539842 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc934107760 msgr2=0x7fc934071e60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-23T09:30:08.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.962+0000 7fc938f9a700 1 --2- 172.21.15.82:0/1980539842 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc934107760 0x7fc934071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:08.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.962+0000 7fc938f9a700 1 -- 172.21.15.82:0/1980539842 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc93410d060 msgr2=0x7fc93406ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:08.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.962+0000 7fc938f9a700 1 --2- 172.21.15.82:0/1980539842 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc93410d060 0x7fc93406ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:08.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.962+0000 7fc938f9a700 1 -- 172.21.15.82:0/1980539842 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc92c009c40 con 0x7fc934108100 2023-09-23T09:30:08.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.963+0000 7fc938f9a700 1 --2- 172.21.15.82:0/1980539842 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc934108100 0x7fc9340723e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fc93000e9a0 tx=0x7fc93000ed60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:08.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.963+0000 7fc9267fc700 1 -- 172.21.15.82:0/1980539842 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc930009790 con 0x7fc934108100 2023-09-23T09:30:08.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.963+0000 7fc9267fc700 1 -- 172.21.15.82:0/1980539842 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc93000cbd0 con 0x7fc934108100 2023-09-23T09:30:08.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.963+0000 7fc9267fc700 1 -- 172.21.15.82:0/1980539842 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc930018680 con 0x7fc934108100 2023-09-23T09:30:08.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.963+0000 7fc93b9ff700 1 -- 172.21.15.82:0/1980539842 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc93406bc50 con 0x7fc934108100 2023-09-23T09:30:08.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.964+0000 7fc93b9ff700 1 -- 172.21.15.82:0/1980539842 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc93406fc90 con 0x7fc934108100 2023-09-23T09:30:08.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.970+0000 7fc9267fc700 1 -- 172.21.15.82:0/1980539842 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7fc93000cd40 con 0x7fc934108100 2023-09-23T09:30:08.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.972+0000 7fc94f268b80 1 Processor -- start 2023-09-23T09:30:08.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.973+0000 7fc94f268b80 1 -- start start 2023-09-23T09:30:08.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.973+0000 7fc94f268b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5568d8e38400 0x5568d8e387e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:08.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.973+0000 7fc94f268b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5568d8e38d20 0x5568d8e32780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:08.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.973+0000 7fc94f268b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5568d8e32cc0 0x5568d8e33120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:08.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.973+0000 7fc94f268b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568d8d9a830 con 0x5568d8e38400 2023-09-23T09:30:08.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.973+0000 7fc94f268b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568d8d8b800 con 0x5568d8e38d20 2023-09-23T09:30:08.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.973+0000 7fc94f268b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568d8d89120 con 0x5568d8e32cc0 2023-09-23T09:30:08.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.975+0000 7fc93979b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5568d8e38d20 0x5568d8e32780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:08.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.975+0000 7fc93979b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5568d8e38d20 0x5568d8e32780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:57820/0 (socket says 172.21.15.82:57820) 2023-09-23T09:30:08.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.975+0000 7fc93979b700 1 -- 172.21.15.82:0/3239303099 learned_addr learned my addr 172.21.15.82:0/3239303099 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:30:08.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.976+0000 7fc9267fc700 1 --2- 172.21.15.82:0/1980539842 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fc9200a0290 0x7fc9200a2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:08.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.976+0000 7fc938f9a700 1 --2- 172.21.15.82:0/3239303099 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5568d8e32cc0 0x5568d8e33120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:08.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.976+0000 7fc939f9c700 1 --2- 172.21.15.82:0/3239303099 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5568d8e38400 0x5568d8e387e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:08.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.976+0000 7fc93979b700 1 -- 172.21.15.82:0/3239303099 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5568d8e32cc0 msgr2=0x5568d8e33120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:08.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.976+0000 7fc93979b700 1 --2- 172.21.15.82:0/3239303099 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5568d8e32cc0 0x5568d8e33120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:08.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.976+0000 7fc93979b700 1 -- 172.21.15.82:0/3239303099 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5568d8e38400 msgr2=0x5568d8e387e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:08.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.976+0000 7fc93979b700 1 --2- 172.21.15.82:0/3239303099 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5568d8e38400 0x5568d8e387e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:08.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.977+0000 7fc93979b700 1 -- 172.21.15.82:0/3239303099 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5568d8c046b0 con 0x5568d8e38d20 2023-09-23T09:30:08.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.977+0000 7fc9267fc700 1 -- 172.21.15.82:0/1980539842 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 8557+0+0 (secure 0 0 0) 0x7fc930014070 con 0x7fc934108100 2023-09-23T09:30:08.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.977+0000 7fc939f9c700 1 --2- 172.21.15.82:0/1980539842 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fc9200a0290 0x7fc9200a2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:08.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.977+0000 7fc93979b700 1 --2- 172.21.15.82:0/3239303099 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5568d8e38d20 0x5568d8e32780 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc928009b50 tx=0x7fc928009e60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6cea943805a93827 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:08.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.978+0000 7fc939f9c700 1 --2- 172.21.15.82:0/1980539842 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fc9200a0290 0x7fc9200a2750 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc92c009550 tx=0x7fc92c009420 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:08.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.978+0000 7fc91f7fe700 1 -- 172.21.15.82:0/3239303099 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc92800eae0 con 0x5568d8e38d20 2023-09-23T09:30:08.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.978+0000 7fc91f7fe700 1 -- 172.21.15.82:0/3239303099 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc928004cc0 con 0x5568d8e38d20 2023-09-23T09:30:08.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.978+0000 7fc91f7fe700 1 -- 172.21.15.82:0/3239303099 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc928005460 con 0x5568d8e38d20 2023-09-23T09:30:08.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.979+0000 7fc94f268b80 1 -- 172.21.15.82:0/3239303099 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5568d8e38d20 msgr2=0x5568d8e32780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:08.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.979+0000 7fc94f268b80 1 --2- 172.21.15.82:0/3239303099 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5568d8e38d20 0x5568d8e32780 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc928009b50 tx=0x7fc928009e60 comp rx=0 tx=0).stop 2023-09-23T09:30:08.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.979+0000 7fc94f268b80 1 -- 172.21.15.82:0/3239303099 shutdown_connections 2023-09-23T09:30:08.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.979+0000 7fc94f268b80 1 --2- 172.21.15.82:0/3239303099 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5568d8e32cc0 0x5568d8e33120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:08.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.979+0000 7fc94f268b80 1 --2- 172.21.15.82:0/3239303099 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5568d8e38400 0x5568d8e387e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:08.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.979+0000 7fc94f268b80 1 --2- 172.21.15.82:0/3239303099 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5568d8e38d20 0x5568d8e32780 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:08.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.979+0000 7fc94f268b80 1 -- 172.21.15.82:0/3239303099 >> 172.21.15.82:0/3239303099 conn(0x5568d8da7160 msgr2=0x5568d8e2d490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:08.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.981+0000 7fc94f268b80 1 -- 172.21.15.82:0/3239303099 shutdown_connections 2023-09-23T09:30:08.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.982+0000 7fc94f268b80 1 -- 172.21.15.82:0/3239303099 wait complete. 2023-09-23T09:30:08.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.983+0000 7fc94f268b80 1 -- start start 2023-09-23T09:30:08.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.983+0000 7fc94f268b80 1 Processor -- start 2023-09-23T09:30:08.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.984+0000 7fc94f268b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5568d8e32cc0 0x5568d8e3ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:08.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.984+0000 7fc94f268b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5568d8e38400 0x5568d8e3bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:08.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.984+0000 7fc94f268b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5568d8e38d20 0x5568d8e3c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:08.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.984+0000 7fc94f268b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568d8d84a10 con 0x5568d8e32cc0 2023-09-23T09:30:08.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.984+0000 7fc94f268b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568d8d22c30 con 0x5568d8e38400 2023-09-23T09:30:08.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.984+0000 7fc94f268b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568d8d22930 con 0x5568d8e38d20 2023-09-23T09:30:08.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.984+0000 7fc94f268b80 10 client.0 _ll_register_callbacks cb 0x5568d8c6cb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:30:08.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.985+0000 7fc938f9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5568d8e38400 0x5568d8e3bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:08.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.985+0000 7fc938f9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5568d8e38400 0x5568d8e3bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:57836/0 (socket says 172.21.15.82:57836) 2023-09-23T09:30:08.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.985+0000 7fc938f9a700 1 -- 172.21.15.82:0/3688473805 learned_addr learned my addr 172.21.15.82:0/3688473805 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:30:08.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.987+0000 7fc938f9a700 1 -- 172.21.15.82:0/3688473805 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5568d8e38d20 msgr2=0x5568d8e3c700 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-23T09:30:08.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.987+0000 7fc938f9a700 1 --2- 172.21.15.82:0/3688473805 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5568d8e38d20 0x5568d8e3c700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:08.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.987+0000 7fc938f9a700 1 -- 172.21.15.82:0/3688473805 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5568d8e32cc0 msgr2=0x5568d8e3ecd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-23T09:30:08.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.987+0000 7fc938f9a700 1 --2- 172.21.15.82:0/3688473805 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5568d8e32cc0 0x5568d8e3ecd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:08.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.987+0000 7fc938f9a700 1 -- 172.21.15.82:0/3688473805 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc928009800 con 0x5568d8e38400 2023-09-23T09:30:08.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.987+0000 7fc938f9a700 1 --2- 172.21.15.82:0/3688473805 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5568d8e38400 0x5568d8e3bfc0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc93000c5b0 tx=0x7fc930099770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66eef095062f7be6 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:08.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.987+0000 7fc91cff9700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-09-23T09:30:08.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.988+0000 7fc91cff9700 1 -- 172.21.15.82:0/3688473805 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9300994d0 con 0x5568d8e38400 2023-09-23T09:30:08.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.988+0000 7fc91cff9700 1 -- 172.21.15.82:0/3688473805 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(142..142 src has 1..142) v4 ==== 8557+0+0 (secure 0 0 0) 0x7fc9300a0e80 con 0x5568d8e38400 2023-09-23T09:30:08.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.988+0000 7fc94f268b80 1 -- 172.21.15.82:0/3688473805 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5568d8e02240 con 0x5568d8e38400 2023-09-23T09:30:08.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.988+0000 7fc91cff9700 1 -- 172.21.15.82:0/3688473805 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=95) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc9300b1210 con 0x5568d8e38400 2023-09-23T09:30:08.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.988+0000 7fc94f268b80 10 client.27254 fetch_fsmap learned FSMap version 95 2023-09-23T09:30:08.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.988+0000 7fc94f268b80 1 -- 172.21.15.82:0/3688473805 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=95,monmap=4+}) v3 -- 0x5568d8bb0e60 con 0x5568d8e38400 2023-09-23T09:30:08.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.989+0000 7fc91cff9700 1 -- 172.21.15.82:0/3688473805 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5568d8e02240 con 0x5568d8e38400 2023-09-23T09:30:08.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.989+0000 7fc91cff9700 1 -- 172.21.15.82:0/3688473805 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 95) v1 ==== 7934+0+0 (secure 0 0 0) 0x7fc930097fd0 con 0x5568d8e38400 2023-09-23T09:30:08.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.989+0000 7fc94f268b80 10 client.27254 fetch_fsmap finished waiting for FSMap version 95 2023-09-23T09:30:08.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.989+0000 7fc94f268b80 10 client.27254 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:30:08.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.989+0000 7fc94f268b80 20 client.27254 populate_metadata read hostname 'smithi082' 2023-09-23T09:30:08.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.989+0000 7fc94f268b80 1 --2- 172.21.15.82:0/3688473805 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5568d8e4c750 0x5568d8e4eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:08.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.989+0000 7fc94f268b80 4 client.27254 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:30:08.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.989+0000 7fc94f268b80 1 -- 172.21.15.82:0/3688473805 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5568d8d2ac20 con 0x5568d8e4c750 2023-09-23T09:30:08.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:08.992+0000 7fc93979b700 1 --2- 172.21.15.82:0/3688473805 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5568d8e4c750 0x5568d8e4eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:09.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.001+0000 7fc93979b700 1 --2- 172.21.15.82:0/3688473805 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5568d8e4c750 0x5568d8e4eb70 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=668cad33a14d1cd2 server_cookie=1d12958769e3ef24 in_seq=0 out_seq=0 2023-09-23T09:30:09.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.002+0000 7fc91cff9700 10 client.27254 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:30:09.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.005+0000 7fc91cff9700 1 -- 172.21.15.82:0/3688473805 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5568d8d2ac20 con 0x5568d8e4c750 2023-09-23T09:30:09.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.005+0000 7fc91cff9700 10 client.27254 handle_command_reply: tid=0 2023-09-23T09:30:09.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.008+0000 7fc94f268b80 1 client.27254 shutdown 2023-09-23T09:30:09.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.009+0000 7fc94f268b80 1 -- 172.21.15.82:0/3688473805 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5568d8e38400 msgr2=0x5568d8e3bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:09.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.009+0000 7fc94f268b80 1 --2- 172.21.15.82:0/3688473805 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5568d8e38400 0x5568d8e3bfc0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc93000c5b0 tx=0x7fc930099770 comp rx=0 tx=0).stop 2023-09-23T09:30:09.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.011+0000 7fc94f268b80 1 -- 172.21.15.82:0/3688473805 shutdown_connections 2023-09-23T09:30:09.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.011+0000 7fc94f268b80 1 --2- 172.21.15.82:0/3688473805 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5568d8e38d20 0x5568d8e3c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:09.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.011+0000 7fc94f268b80 1 --2- 172.21.15.82:0/3688473805 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5568d8e4c750 0x5568d8e4eb70 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:09.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.011+0000 7fc94f268b80 1 --2- 172.21.15.82:0/3688473805 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5568d8e32cc0 0x5568d8e3ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:09.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.011+0000 7fc94f268b80 1 --2- 172.21.15.82:0/3688473805 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5568d8e38400 0x5568d8e3bfc0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:09.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.011+0000 7fc91cff9700 0 client.27254 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:30:09.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.011+0000 7fc94f268b80 1 -- 172.21.15.82:0/3688473805 >> 172.21.15.82:0/3688473805 conn(0x5568d8da7160 msgr2=0x5568d8e27bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:09.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.012+0000 7fc94f268b80 1 -- 172.21.15.82:0/3688473805 shutdown_connections 2023-09-23T09:30:09.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.012+0000 7fc94f268b80 1 -- 172.21.15.82:0/3688473805 wait complete. 2023-09-23T09:30:09.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.012+0000 7fc94f268b80 20 client.27254 trim_cache size 0 max 16384 2023-09-23T09:30:09.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.035+0000 7fc94f268b80 1 Processor -- start 2023-09-23T09:30:09.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.035+0000 7fc94f268b80 1 -- start start 2023-09-23T09:30:09.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.035+0000 7fc94f268b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5568d8e32cc0 0x5568d8e43820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:09.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.035+0000 7fc94f268b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5568d8e38400 0x5568d8e3b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:09.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.035+0000 7fc94f268b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5568d8e38d20 0x5568d8e3bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:09.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.035+0000 7fc94f268b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568d8c069a0 con 0x5568d8e38400 2023-09-23T09:30:09.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.035+0000 7fc94f268b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568d8e43d60 con 0x5568d8e38d20 2023-09-23T09:30:09.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.035+0000 7fc94f268b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568d8e38010 con 0x5568d8e32cc0 2023-09-23T09:30:09.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.036+0000 7fc938f9a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5568d8e38400 0x5568d8e3b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:09.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.036+0000 7fc938f9a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5568d8e38400 0x5568d8e3b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48094/0 (socket says 172.21.15.82:48094) 2023-09-23T09:30:09.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.036+0000 7fc938f9a700 1 -- 172.21.15.82:0/625922093 learned_addr learned my addr 172.21.15.82:0/625922093 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:30:09.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.036+0000 7fc93979b700 1 --2- 172.21.15.82:0/625922093 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5568d8e32cc0 0x5568d8e43820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:09.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.036+0000 7fc938f9a700 1 -- 172.21.15.82:0/625922093 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5568d8e32cc0 msgr2=0x5568d8e43820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:09.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.036+0000 7fc938f9a700 1 --2- 172.21.15.82:0/625922093 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5568d8e32cc0 0x5568d8e43820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:09.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.036+0000 7fc939f9c700 1 --2- 172.21.15.82:0/625922093 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5568d8e38d20 0x5568d8e3bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:09.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.036+0000 7fc938f9a700 1 -- 172.21.15.82:0/625922093 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5568d8e38d20 msgr2=0x5568d8e3bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:09.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.036+0000 7fc938f9a700 1 --2- 172.21.15.82:0/625922093 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5568d8e38d20 0x5568d8e3bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:09.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.036+0000 7fc938f9a700 1 -- 172.21.15.82:0/625922093 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5568d8e33390 con 0x5568d8e38400 2023-09-23T09:30:09.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.036+0000 7fc939f9c700 1 --2- 172.21.15.82:0/625922093 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5568d8e38d20 0x5568d8e3bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T09:30:09.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.036+0000 7fc938f9a700 1 --2- 172.21.15.82:0/625922093 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5568d8e38400 0x5568d8e3b780 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fc930021000 tx=0x7fc930099070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fa3c11d11296424 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:09.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.036+0000 7fc91ffff700 1 -- 172.21.15.82:0/625922093 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9300b1210 con 0x5568d8e38400 2023-09-23T09:30:09.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.037+0000 7fc91ffff700 1 -- 172.21.15.82:0/625922093 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc9300a0e80 con 0x5568d8e38400 2023-09-23T09:30:09.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.037+0000 7fc91ffff700 1 -- 172.21.15.82:0/625922093 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc930099530 con 0x5568d8e38400 2023-09-23T09:30:09.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.037+0000 7fc94f268b80 1 -- 172.21.15.82:0/625922093 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5568d8e38400 msgr2=0x5568d8e3b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:09.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.037+0000 7fc94f268b80 1 --2- 172.21.15.82:0/625922093 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5568d8e38400 0x5568d8e3b780 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fc930021000 tx=0x7fc930099070 comp rx=0 tx=0).stop 2023-09-23T09:30:09.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.037+0000 7fc94f268b80 1 -- 172.21.15.82:0/625922093 shutdown_connections 2023-09-23T09:30:09.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.037+0000 7fc94f268b80 1 --2- 172.21.15.82:0/625922093 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5568d8e38d20 0x5568d8e3bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:09.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.037+0000 7fc94f268b80 1 --2- 172.21.15.82:0/625922093 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5568d8e32cc0 0x5568d8e43820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:09.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.037+0000 7fc94f268b80 1 --2- 172.21.15.82:0/625922093 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5568d8e38400 0x5568d8e3b780 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:09.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.037+0000 7fc94f268b80 1 -- 172.21.15.82:0/625922093 >> 172.21.15.82:0/625922093 conn(0x5568d8da7160 msgr2=0x5568d8e361b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:09.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.037+0000 7fc94f268b80 1 -- 172.21.15.82:0/625922093 shutdown_connections 2023-09-23T09:30:09.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.038+0000 7fc94f268b80 1 -- 172.21.15.82:0/625922093 wait complete. 2023-09-23T09:30:09.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.038+0000 7fc94f268b80 1 -- start start 2023-09-23T09:30:09.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.038+0000 7fc94f268b80 1 Processor -- start 2023-09-23T09:30:09.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.039+0000 7fc94f268b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5568d8e32cc0 0x5568d8e9aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:09.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.039+0000 7fc94f268b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5568d8e38400 0x5568d8e9b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:09.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.039+0000 7fc94f268b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5568d8e38d20 0x5568d8e42590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:09.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.039+0000 7fc94f268b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568d8e42ca0 con 0x5568d8e38d20 2023-09-23T09:30:09.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.039+0000 7fc94f268b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568d8e42e10 con 0x5568d8e38400 2023-09-23T09:30:09.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.039+0000 7fc94f268b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568d8e42fd0 con 0x5568d8e32cc0 2023-09-23T09:30:09.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.039+0000 7fc94f268b80 10 client.0 _ll_register_callbacks cb 0x5568d8c6cb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:30:09.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.039+0000 7fc939f9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5568d8e38d20 0x5568d8e42590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:09.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.040+0000 7fc938f9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5568d8e38400 0x5568d8e9b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:09.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.040+0000 7fc93979b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5568d8e32cc0 0x5568d8e9aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:09.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.040+0000 7fc939f9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5568d8e38d20 0x5568d8e42590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48102/0 (socket says 172.21.15.82:48102) 2023-09-23T09:30:09.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.040+0000 7fc939f9c700 1 -- 172.21.15.82:0/2039694255 learned_addr learned my addr 172.21.15.82:0/2039694255 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:30:09.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.040+0000 7fc938f9a700 1 -- 172.21.15.82:0/2039694255 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5568d8e32cc0 msgr2=0x5568d8e9aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:09.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.040+0000 7fc938f9a700 1 --2- 172.21.15.82:0/2039694255 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5568d8e32cc0 0x5568d8e9aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:09.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.040+0000 7fc938f9a700 1 -- 172.21.15.82:0/2039694255 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5568d8e38d20 msgr2=0x5568d8e42590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:09.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.040+0000 7fc938f9a700 1 --2- 172.21.15.82:0/2039694255 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5568d8e38d20 0x5568d8e42590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:09.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.040+0000 7fc938f9a700 1 -- 172.21.15.82:0/2039694255 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5568d8bb0e60 con 0x5568d8e38400 2023-09-23T09:30:09.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.040+0000 7fc93979b700 1 --2- 172.21.15.82:0/2039694255 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5568d8e32cc0 0x5568d8e9aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:30:09.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.040+0000 7fc939f9c700 1 --2- 172.21.15.82:0/2039694255 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5568d8e38d20 0x5568d8e42590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:30:09.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.040+0000 7fc938f9a700 1 --2- 172.21.15.82:0/2039694255 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5568d8e38400 0x5568d8e9b000 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x5568d8e339d0 tx=0x7fc93009cfd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b928055b006e1dc server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:09.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.040+0000 7fc91cff9700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-09-23T09:30:09.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.040+0000 7fc91cff9700 1 -- 172.21.15.82:0/2039694255 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9300b1210 con 0x5568d8e38400 2023-09-23T09:30:09.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.041+0000 7fc91cff9700 1 -- 172.21.15.82:0/2039694255 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(142..142 src has 1..142) v4 ==== 8557+0+0 (secure 0 0 0) 0x7fc9300992d0 con 0x5568d8e38400 2023-09-23T09:30:09.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.041+0000 7fc94f268b80 1 -- 172.21.15.82:0/2039694255 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5568d8e25930 con 0x5568d8e38400 2023-09-23T09:30:09.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.041+0000 7fc91cff9700 1 -- 172.21.15.82:0/2039694255 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=95) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc930099490 con 0x5568d8e38400 2023-09-23T09:30:09.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.041+0000 7fc94f268b80 10 client.27257 fetch_fsmap learned FSMap version 95 2023-09-23T09:30:09.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.041+0000 7fc94f268b80 1 -- 172.21.15.82:0/2039694255 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=95,monmap=4+}) v3 -- 0x5568d8b99ce0 con 0x5568d8e38400 2023-09-23T09:30:09.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.041+0000 7fc91cff9700 1 -- 172.21.15.82:0/2039694255 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5568d8e25930 con 0x5568d8e38400 2023-09-23T09:30:09.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.041+0000 7fc91cff9700 1 -- 172.21.15.82:0/2039694255 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 95) v1 ==== 7934+0+0 (secure 0 0 0) 0x7fc9300c5070 con 0x5568d8e38400 2023-09-23T09:30:09.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.041+0000 7fc94f268b80 10 client.27257 fetch_fsmap finished waiting for FSMap version 95 2023-09-23T09:30:09.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.041+0000 7fc94f268b80 10 client.27257 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:30:09.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.041+0000 7fc94f268b80 20 client.27257 populate_metadata read hostname 'smithi082' 2023-09-23T09:30:09.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.041+0000 7fc94f268b80 1 --2- 172.21.15.82:0/2039694255 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5568d8ea23e0 0x5568d8ea4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:09.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.041+0000 7fc94f268b80 4 client.27257 mds_command: new command op to 24557 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-09-23T09:30:09.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.041+0000 7fc94f268b80 1 -- 172.21.15.82:0/2039694255 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x5568d8d7d9f0 con 0x5568d8ea23e0 2023-09-23T09:30:09.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.042+0000 7fc93979b700 1 --2- 172.21.15.82:0/2039694255 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5568d8ea23e0 0x5568d8ea4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:09.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.042+0000 7fc93979b700 1 --2- 172.21.15.82:0/2039694255 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5568d8ea23e0 0x5568d8ea4800 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e89986f7cc7e22d server_cookie=5b67c83f8779c536 in_seq=0 out_seq=0 2023-09-23T09:30:09.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.042+0000 7fc91cff9700 10 client.27257 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:30:09.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.043+0000 7fc91cff9700 1 -- 172.21.15.82:0/2039694255 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5568d8d7d9f0 con 0x5568d8ea23e0 2023-09-23T09:30:09.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.043+0000 7fc91cff9700 10 client.27257 handle_command_reply: tid=0 2023-09-23T09:30:09.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.043+0000 7fc94f268b80 1 client.27257 shutdown 2023-09-23T09:30:09.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.043+0000 7fc94f268b80 1 -- 172.21.15.82:0/2039694255 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5568d8e38400 msgr2=0x5568d8e9b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:09.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.043+0000 7fc94f268b80 1 --2- 172.21.15.82:0/2039694255 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5568d8e38400 0x5568d8e9b000 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x5568d8e339d0 tx=0x7fc93009cfd0 comp rx=0 tx=0).stop 2023-09-23T09:30:09.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.043+0000 7fc94f268b80 1 -- 172.21.15.82:0/2039694255 shutdown_connections 2023-09-23T09:30:09.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.043+0000 7fc94f268b80 1 --2- 172.21.15.82:0/2039694255 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5568d8ea23e0 0x5568d8ea4800 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:09.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.043+0000 7fc94f268b80 1 --2- 172.21.15.82:0/2039694255 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5568d8e38d20 0x5568d8e42590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:09.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.043+0000 7fc94f268b80 1 --2- 172.21.15.82:0/2039694255 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5568d8e32cc0 0x5568d8e9aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:09.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.043+0000 7fc94f268b80 1 --2- 172.21.15.82:0/2039694255 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5568d8e38400 0x5568d8e9b000 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:09.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.043+0000 7fc94f268b80 1 -- 172.21.15.82:0/2039694255 >> 172.21.15.82:0/2039694255 conn(0x5568d8da7160 msgr2=0x5568d8e37070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:09.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.043+0000 7fc91cff9700 0 client.27257 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:30:09.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.043+0000 7fc94f268b80 1 -- 172.21.15.82:0/2039694255 shutdown_connections 2023-09-23T09:30:09.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.043+0000 7fc94f268b80 1 -- 172.21.15.82:0/2039694255 wait complete. 2023-09-23T09:30:09.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.044+0000 7fc94f268b80 20 client.27257 trim_cache size 0 max 16384 2023-09-23T09:30:09.050 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:30:09.050 INFO:teuthology.orchestra.run.smithi082.stdout: "return_code": 0, 2023-09-23T09:30:09.050 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_tag": "8721861d-3e14-4455-bf56-95507b4cd4d3", 2023-09-23T09:30:09.050 INFO:teuthology.orchestra.run.smithi082.stdout: "mode": "asynchronous" 2023-09-23T09:30:09.050 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:30:09.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.044+0000 7fc93b9ff700 1 -- 172.21.15.82:0/1980539842 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fc9200a0290 msgr2=0x7fc9200a2750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:09.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.044+0000 7fc93b9ff700 1 --2- 172.21.15.82:0/1980539842 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fc9200a0290 0x7fc9200a2750 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc92c009550 tx=0x7fc92c009420 comp rx=0 tx=0).stop 2023-09-23T09:30:09.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.044+0000 7fc93b9ff700 1 -- 172.21.15.82:0/1980539842 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc934108100 msgr2=0x7fc9340723e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:09.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.044+0000 7fc93b9ff700 1 --2- 172.21.15.82:0/1980539842 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc934108100 0x7fc9340723e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fc93000e9a0 tx=0x7fc93000ed60 comp rx=0 tx=0).stop 2023-09-23T09:30:09.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.044+0000 7fc93b9ff700 1 -- 172.21.15.82:0/1980539842 shutdown_connections 2023-09-23T09:30:09.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.044+0000 7fc93b9ff700 1 --2- 172.21.15.82:0/1980539842 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fc9200a0290 0x7fc9200a2750 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:09.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.044+0000 7fc93b9ff700 1 --2- 172.21.15.82:0/1980539842 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc93410d060 0x7fc93406ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:09.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.044+0000 7fc93b9ff700 1 --2- 172.21.15.82:0/1980539842 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc934107760 0x7fc934071e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:09.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.044+0000 7fc93b9ff700 1 --2- 172.21.15.82:0/1980539842 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc934108100 0x7fc9340723e0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:09.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.044+0000 7fc93b9ff700 1 -- 172.21.15.82:0/1980539842 >> 172.21.15.82:0/1980539842 conn(0x7fc934076580 msgr2=0x7fc934078d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:09.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.044+0000 7fc93b9ff700 1 -- 172.21.15.82:0/1980539842 shutdown_connections 2023-09-23T09:30:09.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.044+0000 7fc93b9ff700 1 -- 172.21.15.82:0/1980539842 wait complete. 2023-09-23T09:30:09.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:30:08 smithi135 ceph-mon[99205]: pgmap v1053: 97 pgs: 97 active+clean; 16 GiB data, 56 GiB used, 1017 GiB / 1.0 TiB avail; 828 KiB/s rd, 11 MiB/s wr, 693 op/s 2023-09-23T09:30:09.063 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:30:08 smithi082 ceph-mon[97694]: pgmap v1053: 97 pgs: 97 active+clean; 16 GiB data, 56 GiB used, 1017 GiB / 1.0 TiB avail; 828 KiB/s rd, 11 MiB/s wr, 693 op/s 2023-09-23T09:30:09.066 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:30:09.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:30:08 smithi161 ceph-mon[99580]: pgmap v1053: 97 pgs: 97 active+clean; 16 GiB data, 56 GiB used, 1017 GiB / 1.0 TiB avail; 828 KiB/s rd, 11 MiB/s wr, 693 op/s 2023-09-23T09:30:09.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.320+0000 7fa489dff700 1 -- 172.21.15.82:0/898789136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa484101250 msgr2=0x7fa48410d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:09.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.320+0000 7fa489dff700 1 --2- 172.21.15.82:0/898789136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa484101250 0x7fa48410d760 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fa47c00b0a0 tx=0x7fa47c00b3b0 comp rx=0 tx=0).stop 2023-09-23T09:30:09.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.320+0000 7fa489dff700 1 -- 172.21.15.82:0/898789136 shutdown_connections 2023-09-23T09:30:09.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.320+0000 7fa489dff700 1 --2- 172.21.15.82:0/898789136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa484101250 0x7fa48410d760 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:09.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.320+0000 7fa489dff700 1 --2- 172.21.15.82:0/898789136 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4841068a0 0x7fa484106c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:09.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.320+0000 7fa489dff700 1 --2- 172.21.15.82:0/898789136 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa484100890 0x7fa484100d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:09.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.320+0000 7fa489dff700 1 -- 172.21.15.82:0/898789136 >> 172.21.15.82:0/898789136 conn(0x7fa4840fc380 msgr2=0x7fa4840fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:09.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.320+0000 7fa489dff700 1 -- 172.21.15.82:0/898789136 shutdown_connections 2023-09-23T09:30:09.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.320+0000 7fa489dff700 1 -- 172.21.15.82:0/898789136 wait complete. 2023-09-23T09:30:09.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.321+0000 7fa489dff700 1 Processor -- start 2023-09-23T09:30:09.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.321+0000 7fa489dff700 1 -- start start 2023-09-23T09:30:09.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.321+0000 7fa489dff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa484100890 0x7fa484072c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:09.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.321+0000 7fa489dff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa484101250 0x7fa484073160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:09.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.321+0000 7fa489dff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4841068a0 0x7fa4841a49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:09.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.321+0000 7fa489dff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa484073990 con 0x7fa4841068a0 2023-09-23T09:30:09.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.321+0000 7fa489dff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4841a4f20 con 0x7fa484101250 2023-09-23T09:30:09.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.321+0000 7fa489dff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4841a5060 con 0x7fa484100890 2023-09-23T09:30:09.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.322+0000 7fa483fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4841068a0 0x7fa4841a49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:09.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.322+0000 7fa483fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4841068a0 0x7fa4841a49e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48122/0 (socket says 172.21.15.82:48122) 2023-09-23T09:30:09.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.322+0000 7fa483fff700 1 -- 172.21.15.82:0/2012741880 learned_addr learned my addr 172.21.15.82:0/2012741880 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:30:09.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.322+0000 7fa4837fe700 1 --2- 172.21.15.82:0/2012741880 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa484100890 0x7fa484072c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:09.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.322+0000 7fa482ffd700 1 --2- 172.21.15.82:0/2012741880 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa484101250 0x7fa484073160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:09.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.322+0000 7fa483fff700 1 -- 172.21.15.82:0/2012741880 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa484100890 msgr2=0x7fa484072c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:09.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.322+0000 7fa483fff700 1 --2- 172.21.15.82:0/2012741880 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa484100890 0x7fa484072c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:09.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.322+0000 7fa483fff700 1 -- 172.21.15.82:0/2012741880 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa484101250 msgr2=0x7fa484073160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:09.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.322+0000 7fa483fff700 1 --2- 172.21.15.82:0/2012741880 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa484101250 0x7fa484073160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:09.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.322+0000 7fa483fff700 1 -- 172.21.15.82:0/2012741880 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa47c009d00 con 0x7fa4841068a0 2023-09-23T09:30:09.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.322+0000 7fa483fff700 1 --2- 172.21.15.82:0/2012741880 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4841068a0 0x7fa4841a49e0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fa47c009fd0 tx=0x7fa47c00bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:09.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.323+0000 7fa480ff9700 1 -- 172.21.15.82:0/2012741880 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47c00e040 con 0x7fa4841068a0 2023-09-23T09:30:09.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.323+0000 7fa480ff9700 1 -- 172.21.15.82:0/2012741880 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa47c0094c0 con 0x7fa4841068a0 2023-09-23T09:30:09.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.323+0000 7fa480ff9700 1 -- 172.21.15.82:0/2012741880 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47c0052a0 con 0x7fa4841068a0 2023-09-23T09:30:09.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.323+0000 7fa489dff700 1 -- 172.21.15.82:0/2012741880 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4841a5260 con 0x7fa4841068a0 2023-09-23T09:30:09.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.323+0000 7fa489dff700 1 -- 172.21.15.82:0/2012741880 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4841a5690 con 0x7fa4841068a0 2023-09-23T09:30:09.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.327+0000 7fa480ff9700 1 -- 172.21.15.82:0/2012741880 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7fa47c01d470 con 0x7fa4841068a0 2023-09-23T09:30:09.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.328+0000 7fa49d6acb80 1 Processor -- start 2023-09-23T09:30:09.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.328+0000 7fa49d6acb80 1 -- start start 2023-09-23T09:30:09.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.329+0000 7fa49d6acb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ecbcd1a380 0x55ecbcd1a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:09.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.329+0000 7fa49d6acb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ecbcd1aca0 0x55ecbcd14700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:09.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.329+0000 7fa49d6acb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ecbcd14c40 0x55ecbcd150a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:09.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.329+0000 7fa49d6acb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ecbcc7c7b0 con 0x55ecbcd1a380 2023-09-23T09:30:09.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.329+0000 7fa49d6acb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ecbcc6d780 con 0x55ecbcd14c40 2023-09-23T09:30:09.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.329+0000 7fa49d6acb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ecbcc6b0a0 con 0x55ecbcd1aca0 2023-09-23T09:30:09.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.329+0000 7fa482ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ecbcd1a380 0x55ecbcd1a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:09.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.329+0000 7fa482ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ecbcd1a380 0x55ecbcd1a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48130/0 (socket says 172.21.15.82:48130) 2023-09-23T09:30:09.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.329+0000 7fa482ffd700 1 -- 172.21.15.82:0/2494349798 learned_addr learned my addr 172.21.15.82:0/2494349798 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:30:09.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.329+0000 7fa480ff9700 1 --2- 172.21.15.82:0/2012741880 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fa46c0a0140 0x7fa46c0a2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:09.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.329+0000 7fa4837fe700 1 --2- 172.21.15.82:0/2494349798 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ecbcd1aca0 0x55ecbcd14700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:09.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.329+0000 7fa482ffd700 1 --2- 172.21.15.82:0/2494349798 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ecbcd14c40 0x55ecbcd150a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:09.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.329+0000 7fa480ff9700 1 -- 172.21.15.82:0/2012741880 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 8557+0+0 (secure 0 0 0) 0x7fa47c0cc970 con 0x7fa4841068a0 2023-09-23T09:30:09.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.330+0000 7fa482ffd700 1 -- 172.21.15.82:0/2494349798 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ecbcd1aca0 msgr2=0x55ecbcd14700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:09.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.330+0000 7fa483fff700 1 --2- 172.21.15.82:0/2012741880 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fa46c0a0140 0x7fa46c0a2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:09.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.330+0000 7fa482ffd700 1 --2- 172.21.15.82:0/2494349798 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ecbcd1aca0 0x55ecbcd14700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:09.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.330+0000 7fa482ffd700 1 -- 172.21.15.82:0/2494349798 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ecbcd14c40 msgr2=0x55ecbcd150a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:09.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.330+0000 7fa482ffd700 1 --2- 172.21.15.82:0/2494349798 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ecbcd14c40 0x55ecbcd150a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:09.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.330+0000 7fa482ffd700 1 -- 172.21.15.82:0/2494349798 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ecbcae6630 con 0x55ecbcd1a380 2023-09-23T09:30:09.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.330+0000 7fa482ffd700 1 --2- 172.21.15.82:0/2494349798 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ecbcd1a380 0x55ecbcd1a760 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fa478009fa0 tx=0x7fa478009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4783e17f28847baa server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:09.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.330+0000 7fa469ffb700 1 -- 172.21.15.82:0/2494349798 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa478011470 con 0x55ecbcd1a380 2023-09-23T09:30:09.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.330+0000 7fa483fff700 1 --2- 172.21.15.82:0/2012741880 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fa46c0a0140 0x7fa46c0a2600 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa47c0a18e0 tx=0x7fa47c0099e0 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:09.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.330+0000 7fa469ffb700 1 -- 172.21.15.82:0/2494349798 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa478011a60 con 0x55ecbcd1a380 2023-09-23T09:30:09.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.330+0000 7fa469ffb700 1 -- 172.21.15.82:0/2494349798 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47800f880 con 0x55ecbcd1a380 2023-09-23T09:30:09.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.331+0000 7fa49d6acb80 1 -- 172.21.15.82:0/2494349798 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ecbcd1a380 msgr2=0x55ecbcd1a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:09.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.331+0000 7fa49d6acb80 1 --2- 172.21.15.82:0/2494349798 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ecbcd1a380 0x55ecbcd1a760 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fa478009fa0 tx=0x7fa478009840 comp rx=0 tx=0).stop 2023-09-23T09:30:09.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.331+0000 7fa49d6acb80 1 -- 172.21.15.82:0/2494349798 shutdown_connections 2023-09-23T09:30:09.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.331+0000 7fa49d6acb80 1 --2- 172.21.15.82:0/2494349798 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ecbcd14c40 0x55ecbcd150a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:09.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.331+0000 7fa49d6acb80 1 --2- 172.21.15.82:0/2494349798 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ecbcd1a380 0x55ecbcd1a760 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:09.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.331+0000 7fa49d6acb80 1 --2- 172.21.15.82:0/2494349798 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ecbcd1aca0 0x55ecbcd14700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:09.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.331+0000 7fa49d6acb80 1 -- 172.21.15.82:0/2494349798 >> 172.21.15.82:0/2494349798 conn(0x55ecbcc890e0 msgr2=0x55ecbcd0f410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:09.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.331+0000 7fa49d6acb80 1 -- 172.21.15.82:0/2494349798 shutdown_connections 2023-09-23T09:30:09.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.331+0000 7fa49d6acb80 1 -- 172.21.15.82:0/2494349798 wait complete. 2023-09-23T09:30:09.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.332+0000 7fa49d6acb80 1 -- start start 2023-09-23T09:30:09.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.332+0000 7fa49d6acb80 1 Processor -- start 2023-09-23T09:30:09.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.332+0000 7fa49d6acb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ecbcd14c40 0x55ecbcd20ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:09.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.332+0000 7fa49d6acb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ecbcd1a380 0x55ecbcd1df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:09.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.332+0000 7fa49d6acb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ecbcd1aca0 0x55ecbcd1e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:09.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.333+0000 7fa49d6acb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ecbcc66990 con 0x55ecbcd1aca0 2023-09-23T09:30:09.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.333+0000 7fa49d6acb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ecbcc04bb0 con 0x55ecbcd14c40 2023-09-23T09:30:09.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.333+0000 7fa49d6acb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ecbcc048b0 con 0x55ecbcd1a380 2023-09-23T09:30:09.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.333+0000 7fa49d6acb80 10 client.0 _ll_register_callbacks cb 0x55ecbcb4ea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:30:09.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.333+0000 7fa482ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ecbcd14c40 0x55ecbcd20ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:09.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.333+0000 7fa4837fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ecbcd1a380 0x55ecbcd1df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:09.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.333+0000 7fa482ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ecbcd14c40 0x55ecbcd20ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:57888/0 (socket says 172.21.15.82:57888) 2023-09-23T09:30:09.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.333+0000 7fa482ffd700 1 -- 172.21.15.82:0/3260073637 learned_addr learned my addr 172.21.15.82:0/3260073637 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:30:09.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.333+0000 7fa482ffd700 1 --2- 172.21.15.82:0/3260073637 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ecbcd1aca0 0x55ecbcd1e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:09.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.333+0000 7fa4837fe700 1 -- 172.21.15.82:0/3260073637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ecbcd14c40 msgr2=0x55ecbcd20ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:09.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.333+0000 7fa4837fe700 1 --2- 172.21.15.82:0/3260073637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ecbcd14c40 0x55ecbcd20ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:09.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.333+0000 7fa4837fe700 1 -- 172.21.15.82:0/3260073637 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ecbcd1aca0 msgr2=0x55ecbcd1e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:09.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.333+0000 7fa4837fe700 1 --2- 172.21.15.82:0/3260073637 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ecbcd1aca0 0x55ecbcd1e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:09.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.333+0000 7fa4837fe700 1 -- 172.21.15.82:0/3260073637 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa478009d80 con 0x55ecbcd1a380 2023-09-23T09:30:09.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.334+0000 7fa4837fe700 1 --2- 172.21.15.82:0/3260073637 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ecbcd1a380 0x55ecbcd1df20 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa474012680 tx=0x7fa474012990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e584c78cca8251ad server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:09.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.334+0000 7fa462ffd700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T09:30:09.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.334+0000 7fa462ffd700 1 -- 172.21.15.82:0/3260073637 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa474017070 con 0x55ecbcd1a380 2023-09-23T09:30:09.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.334+0000 7fa49d6acb80 1 -- 172.21.15.82:0/3260073637 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ecbcce41c0 con 0x55ecbcd1a380 2023-09-23T09:30:09.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.334+0000 7fa462ffd700 1 -- 172.21.15.82:0/3260073637 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(142..142 src has 1..142) v4 ==== 8557+0+0 (secure 0 0 0) 0x7fa474010430 con 0x55ecbcd1a380 2023-09-23T09:30:09.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.334+0000 7fa462ffd700 1 -- 172.21.15.82:0/3260073637 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=95) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa4740105f0 con 0x55ecbcd1a380 2023-09-23T09:30:09.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.334+0000 7fa49d6acb80 10 client.27295 fetch_fsmap learned FSMap version 95 2023-09-23T09:30:09.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.334+0000 7fa49d6acb80 1 -- 172.21.15.82:0/3260073637 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=95,monmap=4+}) v3 -- 0x55ecbca92de0 con 0x55ecbcd1a380 2023-09-23T09:30:09.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.334+0000 7fa462ffd700 1 -- 172.21.15.82:0/3260073637 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa474028080 con 0x55ecbcd1a380 2023-09-23T09:30:09.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.335+0000 7fa462ffd700 1 -- 172.21.15.82:0/3260073637 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 95) v1 ==== 7934+0+0 (secure 0 0 0) 0x7fa4740247d0 con 0x55ecbcd1a380 2023-09-23T09:30:09.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.335+0000 7fa49d6acb80 10 client.27295 fetch_fsmap finished waiting for FSMap version 95 2023-09-23T09:30:09.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.335+0000 7fa49d6acb80 10 client.27295 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:30:09.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.335+0000 7fa49d6acb80 20 client.27295 populate_metadata read hostname 'smithi082' 2023-09-23T09:30:09.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.335+0000 7fa49d6acb80 1 --2- 172.21.15.82:0/3260073637 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55ecbcd370a0 0x55ecbcd394c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:09.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.335+0000 7fa49d6acb80 4 client.27295 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:30:09.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.335+0000 7fa49d6acb80 1 -- 172.21.15.82:0/3260073637 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ecbcc0cba0 con 0x55ecbcd370a0 2023-09-23T09:30:09.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.335+0000 7fa482ffd700 1 --2- 172.21.15.82:0/3260073637 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55ecbcd370a0 0x55ecbcd394c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:09.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.336+0000 7fa462ffd700 10 client.27295 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:30:09.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.336+0000 7fa482ffd700 1 --2- 172.21.15.82:0/3260073637 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55ecbcd370a0 0x55ecbcd394c0 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=41f22e097d91757d server_cookie=b1684180a1aa73cf in_seq=0 out_seq=0 2023-09-23T09:30:09.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.336+0000 7fa462ffd700 1 -- 172.21.15.82:0/3260073637 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55ecbcc0cba0 con 0x55ecbcd370a0 2023-09-23T09:30:09.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.336+0000 7fa462ffd700 10 client.27295 handle_command_reply: tid=0 2023-09-23T09:30:09.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.337+0000 7fa49d6acb80 1 client.27295 shutdown 2023-09-23T09:30:09.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.337+0000 7fa49d6acb80 1 -- 172.21.15.82:0/3260073637 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ecbcd1a380 msgr2=0x55ecbcd1df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:09.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.337+0000 7fa49d6acb80 1 --2- 172.21.15.82:0/3260073637 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ecbcd1a380 0x55ecbcd1df20 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa474012680 tx=0x7fa474012990 comp rx=0 tx=0).stop 2023-09-23T09:30:09.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.337+0000 7fa49d6acb80 1 -- 172.21.15.82:0/3260073637 shutdown_connections 2023-09-23T09:30:09.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.337+0000 7fa49d6acb80 1 --2- 172.21.15.82:0/3260073637 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55ecbcd370a0 0x55ecbcd394c0 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:09.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.337+0000 7fa49d6acb80 1 --2- 172.21.15.82:0/3260073637 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ecbcd1aca0 0x55ecbcd1e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:09.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.337+0000 7fa49d6acb80 1 --2- 172.21.15.82:0/3260073637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ecbcd14c40 0x55ecbcd20ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:09.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.337+0000 7fa462ffd700 0 client.27295 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:30:09.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.337+0000 7fa49d6acb80 1 --2- 172.21.15.82:0/3260073637 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ecbcd1a380 0x55ecbcd1df20 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:09.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.337+0000 7fa49d6acb80 1 -- 172.21.15.82:0/3260073637 >> 172.21.15.82:0/3260073637 conn(0x55ecbcc890e0 msgr2=0x55ecbcd09b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:09.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.337+0000 7fa49d6acb80 1 -- 172.21.15.82:0/3260073637 shutdown_connections 2023-09-23T09:30:09.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.337+0000 7fa49d6acb80 1 -- 172.21.15.82:0/3260073637 wait complete. 2023-09-23T09:30:09.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.337+0000 7fa49d6acb80 20 client.27295 trim_cache size 0 max 16384 2023-09-23T09:30:09.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.354+0000 7fa49d6acb80 1 Processor -- start 2023-09-23T09:30:09.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.354+0000 7fa49d6acb80 1 -- start start 2023-09-23T09:30:09.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.355+0000 7fa49d6acb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ecbcd14c40 0x55ecbcd18050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:09.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.355+0000 7fa49d6acb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ecbcd1a380 0x55ecbcd18590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:09.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.355+0000 7fa49d6acb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ecbcd1aca0 0x55ecbcd1d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:09.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.355+0000 7fa49d6acb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ecbcae8920 con 0x55ecbcd1aca0 2023-09-23T09:30:09.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.355+0000 7fa49d6acb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ecbcd0bc80 con 0x55ecbcd1a380 2023-09-23T09:30:09.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.355+0000 7fa49d6acb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ecbcd0b810 con 0x55ecbcd14c40 2023-09-23T09:30:09.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.355+0000 7fa482ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ecbcd1aca0 0x55ecbcd1d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:09.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.355+0000 7fa482ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ecbcd1aca0 0x55ecbcd1d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48146/0 (socket says 172.21.15.82:48146) 2023-09-23T09:30:09.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.355+0000 7fa482ffd700 1 -- 172.21.15.82:0/1139968000 learned_addr learned my addr 172.21.15.82:0/1139968000 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:30:09.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.355+0000 7fa482ffd700 1 --2- 172.21.15.82:0/1139968000 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ecbcd14c40 0x55ecbcd18050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:09.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.355+0000 7fa4837fe700 1 --2- 172.21.15.82:0/1139968000 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ecbcd1a380 0x55ecbcd18590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:09.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.355+0000 7fa482ffd700 1 -- 172.21.15.82:0/1139968000 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ecbcd14c40 msgr2=0x55ecbcd18050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:09.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.355+0000 7fa482ffd700 1 --2- 172.21.15.82:0/1139968000 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ecbcd14c40 0x55ecbcd18050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:09.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.355+0000 7fa482ffd700 1 -- 172.21.15.82:0/1139968000 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ecbcd1a380 msgr2=0x55ecbcd18590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:09.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.355+0000 7fa482ffd700 1 --2- 172.21.15.82:0/1139968000 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ecbcd1a380 0x55ecbcd18590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:09.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.355+0000 7fa482ffd700 1 -- 172.21.15.82:0/1139968000 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ecbcd3e0b0 con 0x55ecbcd1aca0 2023-09-23T09:30:09.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.356+0000 7fa4837fe700 1 --2- 172.21.15.82:0/1139968000 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ecbcd1a380 0x55ecbcd18590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T09:30:09.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.356+0000 7fa482ffd700 1 --2- 172.21.15.82:0/1139968000 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ecbcd1aca0 0x55ecbcd1d6e0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x55ecbcd39d90 tx=0x7fa478009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a51f461b3beccb5e server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:09.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.356+0000 7fa46a7fc700 1 -- 172.21.15.82:0/1139968000 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4780313c0 con 0x55ecbcd1aca0 2023-09-23T09:30:09.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.356+0000 7fa46a7fc700 1 -- 172.21.15.82:0/1139968000 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa478031520 con 0x55ecbcd1aca0 2023-09-23T09:30:09.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.356+0000 7fa46a7fc700 1 -- 172.21.15.82:0/1139968000 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa478003680 con 0x55ecbcd1aca0 2023-09-23T09:30:09.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.357+0000 7fa49d6acb80 1 -- 172.21.15.82:0/1139968000 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ecbcd1aca0 msgr2=0x55ecbcd1d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:09.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.357+0000 7fa49d6acb80 1 --2- 172.21.15.82:0/1139968000 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ecbcd1aca0 0x55ecbcd1d6e0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x55ecbcd39d90 tx=0x7fa478009260 comp rx=0 tx=0).stop 2023-09-23T09:30:09.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.357+0000 7fa49d6acb80 1 -- 172.21.15.82:0/1139968000 shutdown_connections 2023-09-23T09:30:09.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.357+0000 7fa49d6acb80 1 --2- 172.21.15.82:0/1139968000 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ecbcd1aca0 0x55ecbcd1d6e0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:09.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.357+0000 7fa49d6acb80 1 --2- 172.21.15.82:0/1139968000 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ecbcd14c40 0x55ecbcd18050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:09.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.357+0000 7fa49d6acb80 1 --2- 172.21.15.82:0/1139968000 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ecbcd1a380 0x55ecbcd18590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:09.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.357+0000 7fa49d6acb80 1 -- 172.21.15.82:0/1139968000 >> 172.21.15.82:0/1139968000 conn(0x55ecbcc890e0 msgr2=0x55ecbcd32700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:09.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.357+0000 7fa49d6acb80 1 -- 172.21.15.82:0/1139968000 shutdown_connections 2023-09-23T09:30:09.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.357+0000 7fa49d6acb80 1 -- 172.21.15.82:0/1139968000 wait complete. 2023-09-23T09:30:09.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.357+0000 7fa49d6acb80 1 -- start start 2023-09-23T09:30:09.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.358+0000 7fa49d6acb80 1 Processor -- start 2023-09-23T09:30:09.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.358+0000 7fa49d6acb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ecbcd14c40 0x55ecbcd174c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:09.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.358+0000 7fa49d6acb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ecbcd1a380 0x55ecbcd15da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:09.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.358+0000 7fa49d6acb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ecbcd1aca0 0x55ecbcd162e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:09.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.358+0000 7fa49d6acb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ecbcd17bd0 con 0x55ecbcd14c40 2023-09-23T09:30:09.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.358+0000 7fa49d6acb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ecbcd16820 con 0x55ecbcd1aca0 2023-09-23T09:30:09.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.358+0000 7fa49d6acb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ecbcd169e0 con 0x55ecbcd1a380 2023-09-23T09:30:09.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.358+0000 7fa49d6acb80 10 client.0 _ll_register_callbacks cb 0x7fa474009d30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:30:09.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.358+0000 7fa482ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ecbcd14c40 0x55ecbcd174c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:09.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.358+0000 7fa482ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ecbcd14c40 0x55ecbcd174c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48160/0 (socket says 172.21.15.82:48160) 2023-09-23T09:30:09.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.358+0000 7fa482ffd700 1 -- 172.21.15.82:0/3527865488 learned_addr learned my addr 172.21.15.82:0/3527865488 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:30:09.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.359+0000 7fa4837fe700 1 --2- 172.21.15.82:0/3527865488 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ecbcd1a380 0x55ecbcd15da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:09.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.359+0000 7fa482ffd700 1 --2- 172.21.15.82:0/3527865488 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ecbcd1aca0 0x55ecbcd162e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:09.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.359+0000 7fa482ffd700 1 -- 172.21.15.82:0/3527865488 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ecbcd1a380 msgr2=0x55ecbcd15da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:09.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.359+0000 7fa482ffd700 1 --2- 172.21.15.82:0/3527865488 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ecbcd1a380 0x55ecbcd15da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:09.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.359+0000 7fa482ffd700 1 -- 172.21.15.82:0/3527865488 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ecbcd1aca0 msgr2=0x55ecbcd162e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:09.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.359+0000 7fa482ffd700 1 --2- 172.21.15.82:0/3527865488 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ecbcd1aca0 0x55ecbcd162e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:09.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.359+0000 7fa482ffd700 1 -- 172.21.15.82:0/3527865488 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa47802a040 con 0x55ecbcd14c40 2023-09-23T09:30:09.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.359+0000 7fa482ffd700 1 --2- 172.21.15.82:0/3527865488 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ecbcd14c40 0x55ecbcd174c0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fa478013600 tx=0x7fa478009fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25223b6b404fa49 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:09.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.359+0000 7fa462ffd700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:30:09.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.359+0000 7fa462ffd700 1 -- 172.21.15.82:0/3527865488 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4780319b0 con 0x55ecbcd14c40 2023-09-23T09:30:09.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.359+0000 7fa49d6acb80 1 -- 172.21.15.82:0/3527865488 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ecbcd078b0 con 0x55ecbcd14c40 2023-09-23T09:30:09.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.359+0000 7fa462ffd700 1 -- 172.21.15.82:0/3527865488 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(142..142 src has 1..142) v4 ==== 8557+0+0 (secure 0 0 0) 0x7fa478025070 con 0x55ecbcd14c40 2023-09-23T09:30:09.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.359+0000 7fa462ffd700 1 -- 172.21.15.82:0/3527865488 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=95) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa478031b10 con 0x55ecbcd14c40 2023-09-23T09:30:09.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.360+0000 7fa49d6acb80 10 client.17571 fetch_fsmap learned FSMap version 95 2023-09-23T09:30:09.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.360+0000 7fa49d6acb80 1 -- 172.21.15.82:0/3527865488 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=95,monmap=4+}) v3 -- 0x7fa48419a7e0 con 0x55ecbcd14c40 2023-09-23T09:30:09.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.360+0000 7fa462ffd700 1 -- 172.21.15.82:0/3527865488 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55ecbcd078b0 con 0x55ecbcd14c40 2023-09-23T09:30:09.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.360+0000 7fa462ffd700 1 -- 172.21.15.82:0/3527865488 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 95) v1 ==== 7934+0+0 (secure 0 0 0) 0x7fa478003d50 con 0x55ecbcd14c40 2023-09-23T09:30:09.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.360+0000 7fa49d6acb80 10 client.17571 fetch_fsmap finished waiting for FSMap version 95 2023-09-23T09:30:09.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.360+0000 7fa49d6acb80 10 client.17571 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:30:09.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.360+0000 7fa49d6acb80 20 client.17571 populate_metadata read hostname 'smithi082' 2023-09-23T09:30:09.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.360+0000 7fa49d6acb80 1 --2- 172.21.15.82:0/3527865488 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55ecbcd8bd20 0x55ecbcd8e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:09.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.360+0000 7fa49d6acb80 4 client.17571 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:30:09.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.360+0000 7fa49d6acb80 1 -- 172.21.15.82:0/3527865488 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55ecbcc5f970 con 0x55ecbcd8bd20 2023-09-23T09:30:09.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.360+0000 7fa4837fe700 1 --2- 172.21.15.82:0/3527865488 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55ecbcd8bd20 0x55ecbcd8e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:09.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.361+0000 7fa462ffd700 10 client.17571 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:30:09.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.361+0000 7fa4837fe700 1 --2- 172.21.15.82:0/3527865488 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55ecbcd8bd20 0x55ecbcd8e140 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=49e34e1cacae7c20 server_cookie=3928d311e9cff722 in_seq=0 out_seq=0 2023-09-23T09:30:09.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.361+0000 7fa462ffd700 1 -- 172.21.15.82:0/3527865488 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55ecbcc5f970 con 0x55ecbcd8bd20 2023-09-23T09:30:09.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.361+0000 7fa462ffd700 10 client.17571 handle_command_reply: tid=0 2023-09-23T09:30:09.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.361+0000 7fa49d6acb80 1 client.17571 shutdown 2023-09-23T09:30:09.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.361+0000 7fa49d6acb80 1 -- 172.21.15.82:0/3527865488 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ecbcd14c40 msgr2=0x55ecbcd174c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:09.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.361+0000 7fa49d6acb80 1 --2- 172.21.15.82:0/3527865488 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ecbcd14c40 0x55ecbcd174c0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fa478013600 tx=0x7fa478009fa0 comp rx=0 tx=0).stop 2023-09-23T09:30:09.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.361+0000 7fa49d6acb80 1 -- 172.21.15.82:0/3527865488 shutdown_connections 2023-09-23T09:30:09.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.361+0000 7fa49d6acb80 1 --2- 172.21.15.82:0/3527865488 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ecbcd1aca0 0x55ecbcd162e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:09.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.361+0000 7fa49d6acb80 1 --2- 172.21.15.82:0/3527865488 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55ecbcd8bd20 0x55ecbcd8e140 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:09.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.361+0000 7fa49d6acb80 1 --2- 172.21.15.82:0/3527865488 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ecbcd14c40 0x55ecbcd174c0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:09.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.361+0000 7fa49d6acb80 1 --2- 172.21.15.82:0/3527865488 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ecbcd1a380 0x55ecbcd15da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:09.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.361+0000 7fa462ffd700 0 client.17571 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:30:09.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.361+0000 7fa49d6acb80 1 -- 172.21.15.82:0/3527865488 >> 172.21.15.82:0/3527865488 conn(0x55ecbcc890e0 msgr2=0x55ecbcd18050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:09.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.361+0000 7fa49d6acb80 1 -- 172.21.15.82:0/3527865488 shutdown_connections 2023-09-23T09:30:09.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.362+0000 7fa49d6acb80 1 -- 172.21.15.82:0/3527865488 wait complete. 2023-09-23T09:30:09.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.362+0000 7fa49d6acb80 20 client.17571 trim_cache size 0 max 16384 2023-09-23T09:30:09.369 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:30:09.369 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "scrub active (0 inodes in the stack)", 2023-09-23T09:30:09.369 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:30:09.369 INFO:teuthology.orchestra.run.smithi082.stdout: "8721861d-3e14-4455-bf56-95507b4cd4d3": { 2023-09-23T09:30:09.369 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:30:09.369 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "8721861d-3e14-4455-bf56-95507b4cd4d3", 2023-09-23T09:30:09.370 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:30:09.370 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:30:09.370 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:30:09.370 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:30:09.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.362+0000 7fa489dff700 1 -- 172.21.15.82:0/2012741880 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fa46c0a0140 msgr2=0x7fa46c0a2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:09.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.362+0000 7fa489dff700 1 --2- 172.21.15.82:0/2012741880 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fa46c0a0140 0x7fa46c0a2600 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa47c0a18e0 tx=0x7fa47c0099e0 comp rx=0 tx=0).stop 2023-09-23T09:30:09.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.362+0000 7fa489dff700 1 -- 172.21.15.82:0/2012741880 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4841068a0 msgr2=0x7fa4841a49e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:09.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.362+0000 7fa489dff700 1 --2- 172.21.15.82:0/2012741880 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4841068a0 0x7fa4841a49e0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fa47c009fd0 tx=0x7fa47c00bce0 comp rx=0 tx=0).stop 2023-09-23T09:30:09.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.362+0000 7fa489dff700 1 -- 172.21.15.82:0/2012741880 shutdown_connections 2023-09-23T09:30:09.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.362+0000 7fa489dff700 1 --2- 172.21.15.82:0/2012741880 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fa46c0a0140 0x7fa46c0a2600 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:09.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.362+0000 7fa489dff700 1 --2- 172.21.15.82:0/2012741880 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4841068a0 0x7fa4841a49e0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:09.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.362+0000 7fa489dff700 1 --2- 172.21.15.82:0/2012741880 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa484100890 0x7fa484072c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:09.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.362+0000 7fa489dff700 1 --2- 172.21.15.82:0/2012741880 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa484101250 0x7fa484073160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:09.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.362+0000 7fa489dff700 1 -- 172.21.15.82:0/2012741880 >> 172.21.15.82:0/2012741880 conn(0x7fa4840fc380 msgr2=0x7fa4841043a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:09.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.362+0000 7fa489dff700 1 -- 172.21.15.82:0/2012741880 shutdown_connections 2023-09-23T09:30:09.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:09.362+0000 7fa489dff700 1 -- 172.21.15.82:0/2012741880 wait complete. 2023-09-23T09:30:09.382 INFO:tasks.cephfs.filesystem:scrub status for tag:8721861d-3e14-4455-bf56-95507b4cd4d3 - {'path': '/', 'tag': '8721861d-3e14-4455-bf56-95507b4cd4d3', 'options': 'recursive,force'} 2023-09-23T09:30:10.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:30:09 smithi135 ceph-mon[99205]: scrub queued for path: / 2023-09-23T09:30:10.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:30:09 smithi135 ceph-mon[99205]: scrub summary: idle+waiting paths [/] 2023-09-23T09:30:10.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:30:09 smithi135 ceph-mon[99205]: scrub summary: active paths [/] 2023-09-23T09:30:10.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:30:09 smithi135 ceph-mon[99205]: scrub summary: active paths [/] 2023-09-23T09:30:10.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:30:09 smithi135 ceph-mon[99205]: scrub summary: idle+waiting paths [/] 2023-09-23T09:30:10.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:30:09 smithi135 ceph-mon[99205]: scrub summary: active paths [/] 2023-09-23T09:30:10.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:30:09 smithi135 ceph-mon[99205]: scrub summary: active paths [/] 2023-09-23T09:30:10.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:30:09 smithi135 ceph-mon[99205]: scrub summary: active paths [/] 2023-09-23T09:30:10.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:30:09 smithi135 ceph-mon[99205]: scrub summary: idle+waiting paths [/] 2023-09-23T09:30:10.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:30:09 smithi135 ceph-mon[99205]: scrub summary: idle+waiting paths [/] 2023-09-23T09:30:10.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:30:09 smithi135 ceph-mon[99205]: scrub summary: idle+waiting paths [/] 2023-09-23T09:30:10.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:30:09 smithi082 ceph-mon[97694]: scrub queued for path: / 2023-09-23T09:30:10.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:30:09 smithi082 ceph-mon[97694]: scrub summary: idle+waiting paths [/] 2023-09-23T09:30:10.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:30:09 smithi082 ceph-mon[97694]: scrub summary: active paths [/] 2023-09-23T09:30:10.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:30:09 smithi082 ceph-mon[97694]: scrub summary: active paths [/] 2023-09-23T09:30:10.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:30:09 smithi082 ceph-mon[97694]: scrub summary: idle+waiting paths [/] 2023-09-23T09:30:10.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:30:09 smithi082 ceph-mon[97694]: scrub summary: active paths [/] 2023-09-23T09:30:10.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:30:09 smithi082 ceph-mon[97694]: scrub summary: active paths [/] 2023-09-23T09:30:10.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:30:09 smithi082 ceph-mon[97694]: scrub summary: active paths [/] 2023-09-23T09:30:10.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:30:09 smithi082 ceph-mon[97694]: scrub summary: idle+waiting paths [/] 2023-09-23T09:30:10.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:30:09 smithi082 ceph-mon[97694]: scrub summary: idle+waiting paths [/] 2023-09-23T09:30:10.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:30:09 smithi082 ceph-mon[97694]: scrub summary: idle+waiting paths [/] 2023-09-23T09:30:10.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:30:09 smithi161 ceph-mon[99580]: scrub queued for path: / 2023-09-23T09:30:10.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:30:09 smithi161 ceph-mon[99580]: scrub summary: idle+waiting paths [/] 2023-09-23T09:30:10.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:30:09 smithi161 ceph-mon[99580]: scrub summary: active paths [/] 2023-09-23T09:30:10.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:30:09 smithi161 ceph-mon[99580]: scrub summary: active paths [/] 2023-09-23T09:30:10.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:30:09 smithi161 ceph-mon[99580]: scrub summary: idle+waiting paths [/] 2023-09-23T09:30:10.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:30:09 smithi161 ceph-mon[99580]: scrub summary: active paths [/] 2023-09-23T09:30:10.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:30:09 smithi161 ceph-mon[99580]: scrub summary: active paths [/] 2023-09-23T09:30:10.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:30:09 smithi161 ceph-mon[99580]: scrub summary: active paths [/] 2023-09-23T09:30:10.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:30:09 smithi161 ceph-mon[99580]: scrub summary: idle+waiting paths [/] 2023-09-23T09:30:10.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:30:09 smithi161 ceph-mon[99580]: scrub summary: idle+waiting paths [/] 2023-09-23T09:30:10.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:30:09 smithi161 ceph-mon[99580]: scrub summary: idle+waiting paths [/] 2023-09-23T09:30:10.828 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 180.0 s, 293.2 tps, lat 339.058 ms stddev 356.447 2023-09-23T09:30:11.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:30:10 smithi135 ceph-mon[99205]: scrub summary: active paths [/] 2023-09-23T09:30:11.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:30:10 smithi135 ceph-mon[99205]: scrub summary: idle+waiting paths [/] 2023-09-23T09:30:11.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:30:10 smithi135 ceph-mon[99205]: pgmap v1054: 97 pgs: 97 active+clean; 15 GiB data, 54 GiB used, 1019 GiB / 1.0 TiB avail; 872 KiB/s rd, 5.6 MiB/s wr, 467 op/s 2023-09-23T09:30:11.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:30:10 smithi082 ceph-mon[97694]: scrub summary: active paths [/] 2023-09-23T09:30:11.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:30:10 smithi082 ceph-mon[97694]: scrub summary: idle+waiting paths [/] 2023-09-23T09:30:11.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:30:10 smithi082 ceph-mon[97694]: pgmap v1054: 97 pgs: 97 active+clean; 15 GiB data, 54 GiB used, 1019 GiB / 1.0 TiB avail; 872 KiB/s rd, 5.6 MiB/s wr, 467 op/s 2023-09-23T09:30:11.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:30:10 smithi161 ceph-mon[99580]: scrub summary: active paths [/] 2023-09-23T09:30:11.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:30:10 smithi161 ceph-mon[99580]: scrub summary: idle+waiting paths [/] 2023-09-23T09:30:11.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:30:10 smithi161 ceph-mon[99580]: pgmap v1054: 97 pgs: 97 active+clean; 15 GiB data, 54 GiB used, 1019 GiB / 1.0 TiB avail; 872 KiB/s rd, 5.6 MiB/s wr, 467 op/s 2023-09-23T09:30:12.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:30:11 smithi135 ceph-mon[99205]: scrub summary: idle+waiting paths [/] 2023-09-23T09:30:12.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:30:11 smithi082 ceph-mon[97694]: scrub summary: idle+waiting paths [/] 2023-09-23T09:30:12.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:30:11 smithi161 ceph-mon[99580]: scrub summary: idle+waiting paths [/] 2023-09-23T09:30:13.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:30:12 smithi135 ceph-mon[99205]: pgmap v1055: 97 pgs: 97 active+clean; 15 GiB data, 53 GiB used, 1019 GiB / 1.0 TiB avail; 867 KiB/s rd, 5.0 MiB/s wr, 436 op/s 2023-09-23T09:30:13.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:30:12 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:30:13.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:30:12 smithi135 ceph-mon[99205]: osdmap e143: 12 total, 12 up, 12 in 2023-09-23T09:30:13.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:30:12 smithi082 ceph-mon[97694]: pgmap v1055: 97 pgs: 97 active+clean; 15 GiB data, 53 GiB used, 1019 GiB / 1.0 TiB avail; 867 KiB/s rd, 5.0 MiB/s wr, 436 op/s 2023-09-23T09:30:13.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:30:12 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:30:13.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:30:12 smithi082 ceph-mon[97694]: osdmap e143: 12 total, 12 up, 12 in 2023-09-23T09:30:13.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:30:12 smithi161 ceph-mon[99580]: pgmap v1055: 97 pgs: 97 active+clean; 15 GiB data, 53 GiB used, 1019 GiB / 1.0 TiB avail; 867 KiB/s rd, 5.0 MiB/s wr, 436 op/s 2023-09-23T09:30:13.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:30:12 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:30:13.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:30:12 smithi161 ceph-mon[99580]: osdmap e143: 12 total, 12 up, 12 in 2023-09-23T09:30:15.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:30:14 smithi135 ceph-mon[99205]: pgmap v1057: 97 pgs: 97 active+clean; 15 GiB data, 53 GiB used, 1019 GiB / 1.0 TiB avail; 815 KiB/s rd, 4.8 MiB/s wr, 407 op/s 2023-09-23T09:30:15.123 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:30:14 smithi082 ceph-mon[97694]: pgmap v1057: 97 pgs: 97 active+clean; 15 GiB data, 53 GiB used, 1019 GiB / 1.0 TiB avail; 815 KiB/s rd, 4.8 MiB/s wr, 407 op/s 2023-09-23T09:30:15.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:30:14 smithi161 ceph-mon[99580]: pgmap v1057: 97 pgs: 97 active+clean; 15 GiB data, 53 GiB used, 1019 GiB / 1.0 TiB avail; 815 KiB/s rd, 4.8 MiB/s wr, 407 op/s 2023-09-23T09:30:15.827 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 185.0 s, 547.0 tps, lat 184.101 ms stddev 58.120 2023-09-23T09:30:17.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:30:16 smithi135 ceph-mon[99205]: pgmap v1058: 97 pgs: 97 active+clean; 15 GiB data, 54 GiB used, 1019 GiB / 1.0 TiB avail; 1.5 MiB/s rd, 12 MiB/s wr, 990 op/s 2023-09-23T09:30:17.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:30:16 smithi082 ceph-mon[97694]: pgmap v1058: 97 pgs: 97 active+clean; 15 GiB data, 54 GiB used, 1019 GiB / 1.0 TiB avail; 1.5 MiB/s rd, 12 MiB/s wr, 990 op/s 2023-09-23T09:30:17.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:30:16 smithi161 ceph-mon[99580]: pgmap v1058: 97 pgs: 97 active+clean; 15 GiB data, 54 GiB used, 1019 GiB / 1.0 TiB avail; 1.5 MiB/s rd, 12 MiB/s wr, 990 op/s 2023-09-23T09:30:18.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:30:17 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:30:18.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:30:17 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:30:18.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:30:17 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:30:19.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:30:18 smithi135 ceph-mon[99205]: pgmap v1059: 97 pgs: 97 active+clean; 15 GiB data, 54 GiB used, 1019 GiB / 1.0 TiB avail; 1.3 MiB/s rd, 11 MiB/s wr, 879 op/s 2023-09-23T09:30:19.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:30:18 smithi082 ceph-mon[97694]: pgmap v1059: 97 pgs: 97 active+clean; 15 GiB data, 54 GiB used, 1019 GiB / 1.0 TiB avail; 1.3 MiB/s rd, 11 MiB/s wr, 879 op/s 2023-09-23T09:30:19.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:30:18 smithi161 ceph-mon[99580]: pgmap v1059: 97 pgs: 97 active+clean; 15 GiB data, 54 GiB used, 1019 GiB / 1.0 TiB avail; 1.3 MiB/s rd, 11 MiB/s wr, 879 op/s 2023-09-23T09:30:20.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:30:19 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:30:20.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:30:19 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:30:20.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:30:19 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:30:20.830 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 190.0 s, 131.1 tps, lat 182.466 ms stddev 45.372 2023-09-23T09:30:21.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:30:20 smithi082 ceph-mon[97694]: pgmap v1060: 97 pgs: 97 active+clean; 15 GiB data, 54 GiB used, 1019 GiB / 1.0 TiB avail; 1.3 MiB/s rd, 11 MiB/s wr, 919 op/s 2023-09-23T09:30:21.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:30:20 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:30:21.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:30:20 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:30:21.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:30:20 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:30:21.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:30:20 smithi161 ceph-mon[99580]: pgmap v1060: 97 pgs: 97 active+clean; 15 GiB data, 54 GiB used, 1019 GiB / 1.0 TiB avail; 1.3 MiB/s rd, 11 MiB/s wr, 919 op/s 2023-09-23T09:30:21.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:30:20 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:30:21.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:30:20 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:30:21.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:30:20 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:30:21.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:30:20 smithi135 ceph-mon[99205]: pgmap v1060: 97 pgs: 97 active+clean; 15 GiB data, 54 GiB used, 1019 GiB / 1.0 TiB avail; 1.3 MiB/s rd, 11 MiB/s wr, 919 op/s 2023-09-23T09:30:21.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:30:20 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:30:21.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:30:20 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:30:21.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:30:20 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:30:22.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:30:21 smithi082 ceph-mon[97694]: scrub summary: idle 2023-09-23T09:30:22.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:30:21 smithi082 ceph-mon[97694]: scrub summary: idle 2023-09-23T09:30:22.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:30:21 smithi082 ceph-mon[97694]: scrub summary: idle 2023-09-23T09:30:22.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:30:21 smithi082 ceph-mon[97694]: scrub summary: idle 2023-09-23T09:30:22.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:30:21 smithi082 ceph-mon[97694]: scrub summary: idle 2023-09-23T09:30:22.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:30:21 smithi161 ceph-mon[99580]: scrub summary: idle 2023-09-23T09:30:22.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:30:21 smithi161 ceph-mon[99580]: scrub summary: idle 2023-09-23T09:30:22.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:30:21 smithi161 ceph-mon[99580]: scrub summary: idle 2023-09-23T09:30:22.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:30:21 smithi161 ceph-mon[99580]: scrub summary: idle 2023-09-23T09:30:22.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:30:21 smithi161 ceph-mon[99580]: scrub summary: idle 2023-09-23T09:30:22.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:30:21 smithi135 ceph-mon[99205]: scrub summary: idle 2023-09-23T09:30:22.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:30:21 smithi135 ceph-mon[99205]: scrub summary: idle 2023-09-23T09:30:22.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:30:21 smithi135 ceph-mon[99205]: scrub summary: idle 2023-09-23T09:30:22.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:30:21 smithi135 ceph-mon[99205]: scrub summary: idle 2023-09-23T09:30:22.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:30:21 smithi135 ceph-mon[99205]: scrub summary: idle 2023-09-23T09:30:23.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:30:22 smithi082 ceph-mon[97694]: pgmap v1061: 97 pgs: 97 active+clean; 15 GiB data, 54 GiB used, 1019 GiB / 1.0 TiB avail; 1.3 MiB/s rd, 12 MiB/s wr, 924 op/s 2023-09-23T09:30:23.122 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:30:22 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:30:23.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:30:22 smithi161 ceph-mon[99580]: pgmap v1061: 97 pgs: 97 active+clean; 15 GiB data, 54 GiB used, 1019 GiB / 1.0 TiB avail; 1.3 MiB/s rd, 12 MiB/s wr, 924 op/s 2023-09-23T09:30:23.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:30:22 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:30:23.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:30:22 smithi135 ceph-mon[99205]: pgmap v1061: 97 pgs: 97 active+clean; 15 GiB data, 54 GiB used, 1019 GiB / 1.0 TiB avail; 1.3 MiB/s rd, 12 MiB/s wr, 924 op/s 2023-09-23T09:30:23.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:30:22 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:30:25.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:30:24 smithi082 ceph-mon[97694]: pgmap v1062: 97 pgs: 97 active+clean; 15 GiB data, 54 GiB used, 1019 GiB / 1.0 TiB avail; 1.1 MiB/s rd, 10 MiB/s wr, 799 op/s 2023-09-23T09:30:25.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:30:24 smithi161 ceph-mon[99580]: pgmap v1062: 97 pgs: 97 active+clean; 15 GiB data, 54 GiB used, 1019 GiB / 1.0 TiB avail; 1.1 MiB/s rd, 10 MiB/s wr, 799 op/s 2023-09-23T09:30:25.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:30:24 smithi135 ceph-mon[99205]: pgmap v1062: 97 pgs: 97 active+clean; 15 GiB data, 54 GiB used, 1019 GiB / 1.0 TiB avail; 1.1 MiB/s rd, 10 MiB/s wr, 799 op/s 2023-09-23T09:30:25.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 195.0 s, 448.7 tps, lat 391.980 ms stddev 1019.351 2023-09-23T09:30:27.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:30:26 smithi082 ceph-mon[97694]: pgmap v1063: 97 pgs: 97 active+clean; 15 GiB data, 54 GiB used, 1019 GiB / 1.0 TiB avail; 1.4 MiB/s rd, 14 MiB/s wr, 1.05k op/s 2023-09-23T09:30:27.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:30:26 smithi161 ceph-mon[99580]: pgmap v1063: 97 pgs: 97 active+clean; 15 GiB data, 54 GiB used, 1019 GiB / 1.0 TiB avail; 1.4 MiB/s rd, 14 MiB/s wr, 1.05k op/s 2023-09-23T09:30:27.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:30:26 smithi135 ceph-mon[99205]: pgmap v1063: 97 pgs: 97 active+clean; 15 GiB data, 54 GiB used, 1019 GiB / 1.0 TiB avail; 1.4 MiB/s rd, 14 MiB/s wr, 1.05k op/s 2023-09-23T09:30:28.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:30:28 smithi135 ceph-mon[99205]: pgmap v1064: 97 pgs: 97 active+clean; 15 GiB data, 54 GiB used, 1019 GiB / 1.0 TiB avail; 881 KiB/s rd, 7.7 MiB/s wr, 584 op/s 2023-09-23T09:30:28.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:30:28 smithi082 ceph-mon[97694]: pgmap v1064: 97 pgs: 97 active+clean; 15 GiB data, 54 GiB used, 1019 GiB / 1.0 TiB avail; 881 KiB/s rd, 7.7 MiB/s wr, 584 op/s 2023-09-23T09:30:28.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:30:28 smithi161 ceph-mon[99580]: pgmap v1064: 97 pgs: 97 active+clean; 15 GiB data, 54 GiB used, 1019 GiB / 1.0 TiB avail; 881 KiB/s rd, 7.7 MiB/s wr, 584 op/s 2023-09-23T09:30:30.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 200.0 s, 524.8 tps, lat 185.967 ms stddev 53.416 2023-09-23T09:30:31.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:30:30 smithi135 ceph-mon[99205]: pgmap v1065: 97 pgs: 97 active+clean; 16 GiB data, 54 GiB used, 1018 GiB / 1.0 TiB avail; 1.6 MiB/s rd, 13 MiB/s wr, 1.06k op/s 2023-09-23T09:30:31.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:30:30 smithi082 ceph-mon[97694]: pgmap v1065: 97 pgs: 97 active+clean; 16 GiB data, 54 GiB used, 1018 GiB / 1.0 TiB avail; 1.6 MiB/s rd, 13 MiB/s wr, 1.06k op/s 2023-09-23T09:30:31.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:30:30 smithi161 ceph-mon[99580]: pgmap v1065: 97 pgs: 97 active+clean; 16 GiB data, 54 GiB used, 1018 GiB / 1.0 TiB avail; 1.6 MiB/s rd, 13 MiB/s wr, 1.06k op/s 2023-09-23T09:30:33.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:30:32 smithi135 ceph-mon[99205]: pgmap v1066: 97 pgs: 97 active+clean; 16 GiB data, 54 GiB used, 1018 GiB / 1.0 TiB avail; 1.2 MiB/s rd, 11 MiB/s wr, 872 op/s 2023-09-23T09:30:33.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:30:32 smithi082 ceph-mon[97694]: pgmap v1066: 97 pgs: 97 active+clean; 16 GiB data, 54 GiB used, 1018 GiB / 1.0 TiB avail; 1.2 MiB/s rd, 11 MiB/s wr, 872 op/s 2023-09-23T09:30:33.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:30:32 smithi161 ceph-mon[99580]: pgmap v1066: 97 pgs: 97 active+clean; 16 GiB data, 54 GiB used, 1018 GiB / 1.0 TiB avail; 1.2 MiB/s rd, 11 MiB/s wr, 872 op/s 2023-09-23T09:30:35.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:30:34 smithi135 ceph-mon[99205]: pgmap v1067: 97 pgs: 97 active+clean; 16 GiB data, 54 GiB used, 1018 GiB / 1.0 TiB avail; 1.2 MiB/s rd, 11 MiB/s wr, 833 op/s 2023-09-23T09:30:35.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:30:34 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:30:35.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:30:34 smithi082 ceph-mon[97694]: pgmap v1067: 97 pgs: 97 active+clean; 16 GiB data, 54 GiB used, 1018 GiB / 1.0 TiB avail; 1.2 MiB/s rd, 11 MiB/s wr, 833 op/s 2023-09-23T09:30:35.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:30:34 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:30:35.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:30:34 smithi161 ceph-mon[99580]: pgmap v1067: 97 pgs: 97 active+clean; 16 GiB data, 54 GiB used, 1018 GiB / 1.0 TiB avail; 1.2 MiB/s rd, 11 MiB/s wr, 833 op/s 2023-09-23T09:30:35.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:30:34 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:30:35.839 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 205.0 s, 295.9 tps, lat 207.198 ms stddev 207.494 2023-09-23T09:30:37.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:30:36 smithi135 ceph-mon[99205]: pgmap v1068: 97 pgs: 97 active+clean; 16 GiB data, 55 GiB used, 1018 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 16 MiB/s wr, 1.27k op/s 2023-09-23T09:30:37.125 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:30:36 smithi082 ceph-mon[97694]: pgmap v1068: 97 pgs: 97 active+clean; 16 GiB data, 55 GiB used, 1018 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 16 MiB/s wr, 1.27k op/s 2023-09-23T09:30:37.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:30:36 smithi161 ceph-mon[99580]: pgmap v1068: 97 pgs: 97 active+clean; 16 GiB data, 55 GiB used, 1018 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 16 MiB/s wr, 1.27k op/s 2023-09-23T09:30:38.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:30:38 smithi082 ceph-mon[97694]: pgmap v1069: 97 pgs: 97 active+clean; 16 GiB data, 55 GiB used, 1018 GiB / 1.0 TiB avail; 1.5 MiB/s rd, 12 MiB/s wr, 998 op/s 2023-09-23T09:30:38.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:30:38 smithi161 ceph-mon[99580]: pgmap v1069: 97 pgs: 97 active+clean; 16 GiB data, 55 GiB used, 1018 GiB / 1.0 TiB avail; 1.5 MiB/s rd, 12 MiB/s wr, 998 op/s 2023-09-23T09:30:38.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:30:38 smithi135 ceph-mon[99205]: pgmap v1069: 97 pgs: 97 active+clean; 16 GiB data, 55 GiB used, 1018 GiB / 1.0 TiB avail; 1.5 MiB/s rd, 12 MiB/s wr, 998 op/s 2023-09-23T09:30:39.382 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:30:39.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.605+0000 7f8cd7fff700 1 -- 172.21.15.82:0/2314927343 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cd0073670 msgr2=0x7f8cd010cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:39.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.605+0000 7f8cd7fff700 1 --2- 172.21.15.82:0/2314927343 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cd0073670 0x7f8cd010cb70 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f8cc0009990 tx=0x7f8cc0009ca0 comp rx=0 tx=0).stop 2023-09-23T09:30:39.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.606+0000 7f8cd7fff700 1 -- 172.21.15.82:0/2314927343 shutdown_connections 2023-09-23T09:30:39.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.606+0000 7f8cd7fff700 1 --2- 172.21.15.82:0/2314927343 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8cd010d0b0 0x7f8cd010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:39.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.606+0000 7f8cd7fff700 1 --2- 172.21.15.82:0/2314927343 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cd0072d50 0x7f8cd0073130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:39.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.606+0000 7f8cd7fff700 1 --2- 172.21.15.82:0/2314927343 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cd0073670 0x7f8cd010cb70 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:39.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.606+0000 7f8cd7fff700 1 -- 172.21.15.82:0/2314927343 >> 172.21.15.82:0/2314927343 conn(0x7f8cd00fc3a0 msgr2=0x7f8cd00fe7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:39.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.606+0000 7f8cd7fff700 1 -- 172.21.15.82:0/2314927343 shutdown_connections 2023-09-23T09:30:39.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.606+0000 7f8cd7fff700 1 -- 172.21.15.82:0/2314927343 wait complete. 2023-09-23T09:30:39.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.607+0000 7f8cd7fff700 1 Processor -- start 2023-09-23T09:30:39.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.607+0000 7f8cd7fff700 1 -- start start 2023-09-23T09:30:39.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.607+0000 7f8cd7fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cd0072d50 0x7f8cd019e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:39.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.607+0000 7f8cd7fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cd0073670 0x7f8cd019edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:39.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.607+0000 7f8cd7fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8cd010d0b0 0x7f8cd01988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:39.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.607+0000 7f8cd7fff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd0198f50 con 0x7f8cd0072d50 2023-09-23T09:30:39.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.607+0000 7f8cd7fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd01990c0 con 0x7f8cd0073670 2023-09-23T09:30:39.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.607+0000 7f8cd7fff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd0199280 con 0x7f8cd010d0b0 2023-09-23T09:30:39.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.607+0000 7f8cd5d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cd0072d50 0x7f8cd019e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:39.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.607+0000 7f8cd5d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cd0072d50 0x7f8cd019e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36284/0 (socket says 172.21.15.82:36284) 2023-09-23T09:30:39.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.607+0000 7f8cd5d9b700 1 -- 172.21.15.82:0/2908544454 learned_addr learned my addr 172.21.15.82:0/2908544454 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:30:39.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.608+0000 7f8cd659c700 1 --2- 172.21.15.82:0/2908544454 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8cd010d0b0 0x7f8cd01988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:39.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.608+0000 7f8cd559a700 1 --2- 172.21.15.82:0/2908544454 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cd0073670 0x7f8cd019edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:39.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.608+0000 7f8cd5d9b700 1 -- 172.21.15.82:0/2908544454 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8cd010d0b0 msgr2=0x7f8cd01988e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:39.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.608+0000 7f8cd5d9b700 1 --2- 172.21.15.82:0/2908544454 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8cd010d0b0 0x7f8cd01988e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:39.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.608+0000 7f8cd5d9b700 1 -- 172.21.15.82:0/2908544454 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cd0073670 msgr2=0x7f8cd019edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:39.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.608+0000 7f8cd5d9b700 1 --2- 172.21.15.82:0/2908544454 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cd0073670 0x7f8cd019edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:39.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.608+0000 7f8cd5d9b700 1 -- 172.21.15.82:0/2908544454 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cc00095f0 con 0x7f8cd0072d50 2023-09-23T09:30:39.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.608+0000 7f8cd559a700 1 --2- 172.21.15.82:0/2908544454 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cd0073670 0x7f8cd019edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T09:30:39.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.608+0000 7f8cd5d9b700 1 --2- 172.21.15.82:0/2908544454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cd0072d50 0x7f8cd019e870 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc00c9b0 tx=0x7f8ccc00cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:39.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.608+0000 7f8cc6ffd700 1 -- 172.21.15.82:0/2908544454 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ccc007b00 con 0x7f8cd0072d50 2023-09-23T09:30:39.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.608+0000 7f8cd7fff700 1 -- 172.21.15.82:0/2908544454 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cd0199560 con 0x7f8cd0072d50 2023-09-23T09:30:39.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.608+0000 7f8cc6ffd700 1 -- 172.21.15.82:0/2908544454 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8ccc007c60 con 0x7f8cd0072d50 2023-09-23T09:30:39.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.608+0000 7f8cc6ffd700 1 -- 172.21.15.82:0/2908544454 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ccc018660 con 0x7f8cd0072d50 2023-09-23T09:30:39.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.608+0000 7f8cd7fff700 1 -- 172.21.15.82:0/2908544454 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cd01a5860 con 0x7f8cd0072d50 2023-09-23T09:30:39.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.612+0000 7f8cc6ffd700 1 -- 172.21.15.82:0/2908544454 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f8ccc00f450 con 0x7f8cd0072d50 2023-09-23T09:30:39.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.613+0000 7f8ceb943b80 1 Processor -- start 2023-09-23T09:30:39.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.613+0000 7f8ceb943b80 1 -- start start 2023-09-23T09:30:39.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.613+0000 7f8ceb943b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649b075a380 0x5649b075a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:39.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.613+0000 7f8ceb943b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5649b075aca0 0x5649b0754700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:39.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.614+0000 7f8ceb943b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5649b0754c40 0x5649b07550a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:39.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.614+0000 7f8ceb943b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649b06bc7b0 con 0x5649b075a380 2023-09-23T09:30:39.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.614+0000 7f8ceb943b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649b06ad780 con 0x5649b075aca0 2023-09-23T09:30:39.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.614+0000 7f8ceb943b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649b06ab0a0 con 0x5649b0754c40 2023-09-23T09:30:39.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.614+0000 7f8cc6ffd700 1 --2- 172.21.15.82:0/2908544454 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f8cbc0a00c0 0x7f8cbc0a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:39.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.614+0000 7f8cd659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649b075a380 0x5649b075a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:39.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.614+0000 7f8cd659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649b075a380 0x5649b075a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36296/0 (socket says 172.21.15.82:36296) 2023-09-23T09:30:39.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.614+0000 7f8cd659c700 1 -- 172.21.15.82:0/1698806208 learned_addr learned my addr 172.21.15.82:0/1698806208 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:30:39.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.614+0000 7f8cd5d9b700 1 --2- 172.21.15.82:0/1698806208 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5649b075aca0 0x5649b0754700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:39.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.614+0000 7f8cd559a700 1 --2- 172.21.15.82:0/1698806208 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5649b0754c40 0x5649b07550a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:39.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.614+0000 7f8cc6ffd700 1 -- 172.21.15.82:0/2908544454 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f8ccc0cb720 con 0x7f8cd0072d50 2023-09-23T09:30:39.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.614+0000 7f8cd659c700 1 --2- 172.21.15.82:0/2908544454 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f8cbc0a00c0 0x7f8cbc0a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:39.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.614+0000 7f8cd559a700 1 -- 172.21.15.82:0/1698806208 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5649b075aca0 msgr2=0x5649b0754700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:39.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.614+0000 7f8cd559a700 1 --2- 172.21.15.82:0/1698806208 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5649b075aca0 0x5649b0754700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:39.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.614+0000 7f8cd559a700 1 -- 172.21.15.82:0/1698806208 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649b075a380 msgr2=0x5649b075a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:39.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.614+0000 7f8cd559a700 1 --2- 172.21.15.82:0/1698806208 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649b075a380 0x5649b075a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:39.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.614+0000 7f8cd559a700 1 -- 172.21.15.82:0/1698806208 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5649b0526630 con 0x5649b0754c40 2023-09-23T09:30:39.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.614+0000 7f8cd659c700 1 --2- 172.21.15.82:0/1698806208 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649b075a380 0x5649b075a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:30:39.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.615+0000 7f8cd559a700 1 --2- 172.21.15.82:0/1698806208 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5649b0754c40 0x5649b07550a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f8cd010e5c0 tx=0x7f8cc0009510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f73b1564b31ef03 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:39.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.615+0000 7f8cd659c700 1 --2- 172.21.15.82:0/2908544454 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f8cbc0a00c0 0x7f8cbc0a2580 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8cc8007a30 tx=0x7f8cc8004b40 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:39.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.615+0000 7f8cbbfff700 1 -- 172.21.15.82:0/1698806208 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc0009ee0 con 0x5649b0754c40 2023-09-23T09:30:39.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.615+0000 7f8cbbfff700 1 -- 172.21.15.82:0/1698806208 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8cc001d040 con 0x5649b0754c40 2023-09-23T09:30:39.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.615+0000 7f8cbbfff700 1 -- 172.21.15.82:0/1698806208 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc0004500 con 0x5649b0754c40 2023-09-23T09:30:39.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.616+0000 7f8ceb943b80 1 -- 172.21.15.82:0/1698806208 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5649b0754c40 msgr2=0x5649b07550a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:39.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.616+0000 7f8ceb943b80 1 --2- 172.21.15.82:0/1698806208 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5649b0754c40 0x5649b07550a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f8cd010e5c0 tx=0x7f8cc0009510 comp rx=0 tx=0).stop 2023-09-23T09:30:39.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.616+0000 7f8ceb943b80 1 -- 172.21.15.82:0/1698806208 shutdown_connections 2023-09-23T09:30:39.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.616+0000 7f8ceb943b80 1 --2- 172.21.15.82:0/1698806208 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5649b0754c40 0x5649b07550a0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:39.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.616+0000 7f8ceb943b80 1 --2- 172.21.15.82:0/1698806208 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649b075a380 0x5649b075a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:39.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.616+0000 7f8ceb943b80 1 --2- 172.21.15.82:0/1698806208 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5649b075aca0 0x5649b0754700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:39.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.616+0000 7f8ceb943b80 1 -- 172.21.15.82:0/1698806208 >> 172.21.15.82:0/1698806208 conn(0x5649b06c90e0 msgr2=0x5649b074f410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:39.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.616+0000 7f8ceb943b80 1 -- 172.21.15.82:0/1698806208 shutdown_connections 2023-09-23T09:30:39.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.616+0000 7f8ceb943b80 1 -- 172.21.15.82:0/1698806208 wait complete. 2023-09-23T09:30:39.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.616+0000 7f8ceb943b80 1 -- start start 2023-09-23T09:30:39.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.617+0000 7f8ceb943b80 1 Processor -- start 2023-09-23T09:30:39.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.617+0000 7f8ceb943b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5649b0754c40 0x5649b0760bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:39.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.617+0000 7f8ceb943b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5649b075a380 0x5649b075dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:39.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.617+0000 7f8ceb943b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649b075aca0 0x5649b075e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:39.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.617+0000 7f8ceb943b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649b06a6990 con 0x5649b075aca0 2023-09-23T09:30:39.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.617+0000 7f8ceb943b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649b0644bb0 con 0x5649b075a380 2023-09-23T09:30:39.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.617+0000 7f8ceb943b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649b06448b0 con 0x5649b0754c40 2023-09-23T09:30:39.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.617+0000 7f8ceb943b80 10 client.0 _ll_register_callbacks cb 0x5649b058ea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:30:39.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.617+0000 7f8cd659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649b075aca0 0x5649b075e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:39.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.618+0000 7f8cd659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649b075aca0 0x5649b075e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36304/0 (socket says 172.21.15.82:36304) 2023-09-23T09:30:39.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.618+0000 7f8cd659c700 1 -- 172.21.15.82:0/3755592812 learned_addr learned my addr 172.21.15.82:0/3755592812 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:30:39.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.618+0000 7f8cd559a700 1 --2- 172.21.15.82:0/3755592812 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5649b075a380 0x5649b075dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:39.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.618+0000 7f8cd5d9b700 1 --2- 172.21.15.82:0/3755592812 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5649b0754c40 0x5649b0760bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:39.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.618+0000 7f8cd659c700 1 -- 172.21.15.82:0/3755592812 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5649b0754c40 msgr2=0x5649b0760bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:39.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.618+0000 7f8cd659c700 1 --2- 172.21.15.82:0/3755592812 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5649b0754c40 0x5649b0760bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:39.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.618+0000 7f8cd659c700 1 -- 172.21.15.82:0/3755592812 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5649b075a380 msgr2=0x5649b075dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:39.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.618+0000 7f8cd659c700 1 --2- 172.21.15.82:0/3755592812 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5649b075a380 0x5649b075dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:39.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.618+0000 7f8cd659c700 1 -- 172.21.15.82:0/3755592812 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cc8007500 con 0x5649b075aca0 2023-09-23T09:30:39.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.618+0000 7f8cd659c700 1 --2- 172.21.15.82:0/3755592812 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649b075aca0 0x5649b075e540 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f8cc8016cf0 tx=0x7f8cc8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=549527f34690843f server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:39.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.618+0000 7f8cb97fa700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:30:39.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.618+0000 7f8cb97fa700 1 -- 172.21.15.82:0/3755592812 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc8020070 con 0x5649b075aca0 2023-09-23T09:30:39.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.618+0000 7f8ceb943b80 1 -- 172.21.15.82:0/3755592812 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5649b07241c0 con 0x5649b075aca0 2023-09-23T09:30:39.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.618+0000 7f8cb97fa700 1 -- 172.21.15.82:0/3755592812 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(143..143 src has 1..143) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f8cc801b0d0 con 0x5649b075aca0 2023-09-23T09:30:39.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.619+0000 7f8cb97fa700 1 -- 172.21.15.82:0/3755592812 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=100) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8cc8007ea0 con 0x5649b075aca0 2023-09-23T09:30:39.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.619+0000 7f8ceb943b80 10 client.17583 fetch_fsmap learned FSMap version 100 2023-09-23T09:30:39.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.619+0000 7f8ceb943b80 1 -- 172.21.15.82:0/3755592812 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=100,monmap=4+}) v3 -- 0x7f8cd01101e0 con 0x5649b075aca0 2023-09-23T09:30:39.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.619+0000 7f8cb97fa700 1 -- 172.21.15.82:0/3755592812 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5649b07241c0 con 0x5649b075aca0 2023-09-23T09:30:39.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.619+0000 7f8cb97fa700 1 -- 172.21.15.82:0/3755592812 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 100) v1 ==== 7946+0+0 (secure 0 0 0) 0x7f8cc8004cd0 con 0x5649b075aca0 2023-09-23T09:30:39.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.619+0000 7f8ceb943b80 10 client.17583 fetch_fsmap finished waiting for FSMap version 100 2023-09-23T09:30:39.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.619+0000 7f8ceb943b80 10 client.17583 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:30:39.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.619+0000 7f8ceb943b80 20 client.17583 populate_metadata read hostname 'smithi082' 2023-09-23T09:30:39.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.619+0000 7f8ceb943b80 1 --2- 172.21.15.82:0/3755592812 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5649b076e6b0 0x5649b0770ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:39.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.619+0000 7f8ceb943b80 4 client.17583 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:30:39.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.619+0000 7f8ceb943b80 1 -- 172.21.15.82:0/3755592812 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5649b064cba0 con 0x5649b076e6b0 2023-09-23T09:30:39.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.620+0000 7f8cd5d9b700 1 --2- 172.21.15.82:0/3755592812 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5649b076e6b0 0x5649b0770ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:39.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.620+0000 7f8cd5d9b700 1 --2- 172.21.15.82:0/3755592812 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5649b076e6b0 0x5649b0770ad0 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc845c93b9a653f0 server_cookie=c6b4a855625f83e1 in_seq=0 out_seq=0 2023-09-23T09:30:39.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.620+0000 7f8cb97fa700 10 client.17583 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:30:39.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.621+0000 7f8cb97fa700 1 -- 172.21.15.82:0/3755592812 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5649b064cba0 con 0x5649b076e6b0 2023-09-23T09:30:39.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.621+0000 7f8cb97fa700 10 client.17583 handle_command_reply: tid=0 2023-09-23T09:30:39.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.621+0000 7f8ceb943b80 1 client.17583 shutdown 2023-09-23T09:30:39.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.621+0000 7f8ceb943b80 1 -- 172.21.15.82:0/3755592812 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649b075aca0 msgr2=0x5649b075e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:39.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.621+0000 7f8ceb943b80 1 --2- 172.21.15.82:0/3755592812 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649b075aca0 0x5649b075e540 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f8cc8016cf0 tx=0x7f8cc8004ad0 comp rx=0 tx=0).stop 2023-09-23T09:30:39.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.621+0000 7f8ceb943b80 1 -- 172.21.15.82:0/3755592812 shutdown_connections 2023-09-23T09:30:39.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.621+0000 7f8ceb943b80 1 --2- 172.21.15.82:0/3755592812 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5649b076e6b0 0x5649b0770ad0 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:39.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.621+0000 7f8ceb943b80 1 --2- 172.21.15.82:0/3755592812 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649b075aca0 0x5649b075e540 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:39.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.621+0000 7f8ceb943b80 1 --2- 172.21.15.82:0/3755592812 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5649b0754c40 0x5649b0760bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:39.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.621+0000 7f8ceb943b80 1 --2- 172.21.15.82:0/3755592812 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5649b075a380 0x5649b075dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:39.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.621+0000 7f8cb97fa700 0 client.17583 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:30:39.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.621+0000 7f8ceb943b80 1 -- 172.21.15.82:0/3755592812 >> 172.21.15.82:0/3755592812 conn(0x5649b06c90e0 msgr2=0x5649b0749b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:39.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.621+0000 7f8ceb943b80 1 -- 172.21.15.82:0/3755592812 shutdown_connections 2023-09-23T09:30:39.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.621+0000 7f8ceb943b80 1 -- 172.21.15.82:0/3755592812 wait complete. 2023-09-23T09:30:39.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.622+0000 7f8ceb943b80 20 client.17583 trim_cache size 0 max 16384 2023-09-23T09:30:39.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.640+0000 7f8ceb943b80 1 Processor -- start 2023-09-23T09:30:39.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.640+0000 7f8ceb943b80 1 -- start start 2023-09-23T09:30:39.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.640+0000 7f8ceb943b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5649b0754c40 0x5649b0754700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:39.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.640+0000 7f8ceb943b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649b075a380 0x5649b0765740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:39.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.640+0000 7f8ceb943b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5649b075aca0 0x5649b0760790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:39.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.640+0000 7f8ceb943b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649b0528920 con 0x5649b075a380 2023-09-23T09:30:39.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.640+0000 7f8ceb943b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649b076b100 con 0x5649b075aca0 2023-09-23T09:30:39.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.640+0000 7f8ceb943b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649b0765d00 con 0x5649b0754c40 2023-09-23T09:30:39.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.640+0000 7f8cd559a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649b075a380 0x5649b0765740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:39.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.640+0000 7f8cd559a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649b075a380 0x5649b0765740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36306/0 (socket says 172.21.15.82:36306) 2023-09-23T09:30:39.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.640+0000 7f8cd559a700 1 -- 172.21.15.82:0/1406442223 learned_addr learned my addr 172.21.15.82:0/1406442223 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:30:39.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.641+0000 7f8cd5d9b700 1 --2- 172.21.15.82:0/1406442223 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5649b0754c40 0x5649b0754700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:39.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.641+0000 7f8cd659c700 1 --2- 172.21.15.82:0/1406442223 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5649b075aca0 0x5649b0760790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:39.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.641+0000 7f8cd559a700 1 -- 172.21.15.82:0/1406442223 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5649b0754c40 msgr2=0x5649b0754700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:39.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.641+0000 7f8cd559a700 1 --2- 172.21.15.82:0/1406442223 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5649b0754c40 0x5649b0754700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:39.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.641+0000 7f8cd559a700 1 -- 172.21.15.82:0/1406442223 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5649b075aca0 msgr2=0x5649b0760790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:39.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.641+0000 7f8cd559a700 1 --2- 172.21.15.82:0/1406442223 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5649b075aca0 0x5649b0760790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:39.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.641+0000 7f8cd559a700 1 -- 172.21.15.82:0/1406442223 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5649b0748df0 con 0x5649b075a380 2023-09-23T09:30:39.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.641+0000 7f8cd659c700 1 --2- 172.21.15.82:0/1406442223 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5649b075aca0 0x5649b0760790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T09:30:39.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.641+0000 7f8cd5d9b700 1 --2- 172.21.15.82:0/1406442223 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5649b0754c40 0x5649b0754700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:30:39.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.641+0000 7f8cd559a700 1 --2- 172.21.15.82:0/1406442223 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649b075a380 0x5649b0765740 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f8cc00095c0 tx=0x7f8cc0009f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4261557f7ee4400b server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:39.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.641+0000 7f8cc4ff9700 1 -- 172.21.15.82:0/1406442223 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc0005230 con 0x5649b075a380 2023-09-23T09:30:39.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.641+0000 7f8cc4ff9700 1 -- 172.21.15.82:0/1406442223 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8cc001d040 con 0x5649b075a380 2023-09-23T09:30:39.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.641+0000 7f8cc4ff9700 1 -- 172.21.15.82:0/1406442223 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc0004760 con 0x5649b075a380 2023-09-23T09:30:39.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.642+0000 7f8ceb943b80 1 -- 172.21.15.82:0/1406442223 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649b075a380 msgr2=0x5649b0765740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:39.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.642+0000 7f8ceb943b80 1 --2- 172.21.15.82:0/1406442223 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649b075a380 0x5649b0765740 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f8cc00095c0 tx=0x7f8cc0009f80 comp rx=0 tx=0).stop 2023-09-23T09:30:39.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.642+0000 7f8ceb943b80 1 -- 172.21.15.82:0/1406442223 shutdown_connections 2023-09-23T09:30:39.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.642+0000 7f8ceb943b80 1 --2- 172.21.15.82:0/1406442223 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5649b075aca0 0x5649b0760790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:39.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.642+0000 7f8ceb943b80 1 --2- 172.21.15.82:0/1406442223 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5649b0754c40 0x5649b0754700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:39.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.642+0000 7f8ceb943b80 1 --2- 172.21.15.82:0/1406442223 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649b075a380 0x5649b0765740 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:39.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.642+0000 7f8ceb943b80 1 -- 172.21.15.82:0/1406442223 >> 172.21.15.82:0/1406442223 conn(0x5649b06c90e0 msgr2=0x5649b0758050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:39.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.642+0000 7f8ceb943b80 1 -- 172.21.15.82:0/1406442223 shutdown_connections 2023-09-23T09:30:39.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.642+0000 7f8ceb943b80 1 -- 172.21.15.82:0/1406442223 wait complete. 2023-09-23T09:30:39.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.642+0000 7f8ceb943b80 1 -- start start 2023-09-23T09:30:39.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.643+0000 7f8ceb943b80 1 Processor -- start 2023-09-23T09:30:39.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.643+0000 7f8ceb943b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649b0754c40 0x5649b0764b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:39.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.643+0000 7f8ceb943b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5649b075a380 0x5649b0765040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:39.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.643+0000 7f8ceb943b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5649b075aca0 0x5649b07c1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:39.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.643+0000 7f8ceb943b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649b0765720 con 0x5649b0754c40 2023-09-23T09:30:39.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.643+0000 7f8ceb943b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649b07c1a60 con 0x5649b075a380 2023-09-23T09:30:39.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.643+0000 7f8ceb943b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649b07c1bd0 con 0x5649b075aca0 2023-09-23T09:30:39.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.643+0000 7f8ceb943b80 10 client.0 _ll_register_callbacks cb 0x5649b058ea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:30:39.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.643+0000 7f8cd5d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649b0754c40 0x5649b0764b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:39.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.643+0000 7f8cd5d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649b0754c40 0x5649b0764b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36320/0 (socket says 172.21.15.82:36320) 2023-09-23T09:30:39.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.643+0000 7f8cd5d9b700 1 -- 172.21.15.82:0/2425020857 learned_addr learned my addr 172.21.15.82:0/2425020857 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:30:39.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.644+0000 7f8cd5d9b700 1 -- 172.21.15.82:0/2425020857 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5649b075aca0 msgr2=0x5649b07c1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:39.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.644+0000 7f8cd5d9b700 1 --2- 172.21.15.82:0/2425020857 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5649b075aca0 0x5649b07c1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:39.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.644+0000 7f8cd5d9b700 1 -- 172.21.15.82:0/2425020857 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5649b075a380 msgr2=0x5649b0765040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:39.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.644+0000 7f8cd5d9b700 1 --2- 172.21.15.82:0/2425020857 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5649b075a380 0x5649b0765040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:39.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.644+0000 7f8cd5d9b700 1 -- 172.21.15.82:0/2425020857 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5649b0526630 con 0x5649b0754c40 2023-09-23T09:30:39.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.644+0000 7f8cd5d9b700 1 --2- 172.21.15.82:0/2425020857 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649b0754c40 0x5649b0764b00 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc000c00 tx=0x7f8ccc06ae40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab2688f9313dbfb9 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:39.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.644+0000 7f8cb97fa700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:30:39.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.644+0000 7f8cb97fa700 1 -- 172.21.15.82:0/2425020857 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ccc09cc00 con 0x5649b0754c40 2023-09-23T09:30:39.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.644+0000 7f8cb97fa700 1 -- 172.21.15.82:0/2425020857 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(143..143 src has 1..143) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f8ccc0a0be0 con 0x5649b0754c40 2023-09-23T09:30:39.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.644+0000 7f8ceb943b80 1 -- 172.21.15.82:0/2425020857 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5649b07478b0 con 0x5649b0754c40 2023-09-23T09:30:39.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.644+0000 7f8cb97fa700 1 -- 172.21.15.82:0/2425020857 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=100) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8ccc0b80b0 con 0x5649b0754c40 2023-09-23T09:30:39.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.644+0000 7f8ceb943b80 10 client.17589 fetch_fsmap learned FSMap version 100 2023-09-23T09:30:39.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.644+0000 7f8ceb943b80 1 -- 172.21.15.82:0/2425020857 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=100,monmap=4+}) v3 -- 0x5649b04d2de0 con 0x5649b0754c40 2023-09-23T09:30:39.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.644+0000 7f8cb97fa700 1 -- 172.21.15.82:0/2425020857 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5649b07478b0 con 0x5649b0754c40 2023-09-23T09:30:39.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.645+0000 7f8cb97fa700 1 -- 172.21.15.82:0/2425020857 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 100) v1 ==== 7946+0+0 (secure 0 0 0) 0x7f8ccc0c9120 con 0x5649b0754c40 2023-09-23T09:30:39.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.645+0000 7f8ceb943b80 10 client.17589 fetch_fsmap finished waiting for FSMap version 100 2023-09-23T09:30:39.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.645+0000 7f8ceb943b80 10 client.17589 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:30:39.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.645+0000 7f8ceb943b80 20 client.17589 populate_metadata read hostname 'smithi082' 2023-09-23T09:30:39.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.645+0000 7f8ceb943b80 1 --2- 172.21.15.82:0/2425020857 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5649b07c32e0 0x5649b07c5740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:39.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.645+0000 7f8ceb943b80 4 client.17589 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:30:39.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.645+0000 7f8ceb943b80 1 -- 172.21.15.82:0/2425020857 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5649b069f970 con 0x5649b07c32e0 2023-09-23T09:30:39.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.645+0000 7f8cd559a700 1 --2- 172.21.15.82:0/2425020857 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5649b07c32e0 0x5649b07c5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:39.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.646+0000 7f8cd559a700 1 --2- 172.21.15.82:0/2425020857 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5649b07c32e0 0x5649b07c5740 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8baf3dae0d3a391f server_cookie=572cfb2a3788b9ce in_seq=0 out_seq=0 2023-09-23T09:30:39.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.646+0000 7f8cb97fa700 10 client.17589 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:30:39.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.646+0000 7f8cb97fa700 1 -- 172.21.15.82:0/2425020857 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x5649b069f970 con 0x5649b07c32e0 2023-09-23T09:30:39.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.646+0000 7f8cb97fa700 10 client.17589 handle_command_reply: tid=0 2023-09-23T09:30:39.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.646+0000 7f8ceb943b80 1 client.17589 shutdown 2023-09-23T09:30:39.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.646+0000 7f8ceb943b80 1 -- 172.21.15.82:0/2425020857 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649b0754c40 msgr2=0x5649b0764b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:39.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.646+0000 7f8ceb943b80 1 --2- 172.21.15.82:0/2425020857 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649b0754c40 0x5649b0764b00 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc000c00 tx=0x7f8ccc06ae40 comp rx=0 tx=0).stop 2023-09-23T09:30:39.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.646+0000 7f8ceb943b80 1 -- 172.21.15.82:0/2425020857 shutdown_connections 2023-09-23T09:30:39.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.646+0000 7f8ceb943b80 1 --2- 172.21.15.82:0/2425020857 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5649b075aca0 0x5649b07c1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:39.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.646+0000 7f8ceb943b80 1 --2- 172.21.15.82:0/2425020857 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5649b07c32e0 0x5649b07c5740 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:39.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.646+0000 7f8ceb943b80 1 --2- 172.21.15.82:0/2425020857 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649b0754c40 0x5649b0764b00 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:39.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.646+0000 7f8ceb943b80 1 --2- 172.21.15.82:0/2425020857 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5649b075a380 0x5649b0765040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:39.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.646+0000 7f8ceb943b80 1 -- 172.21.15.82:0/2425020857 >> 172.21.15.82:0/2425020857 conn(0x5649b06c90e0 msgr2=0x5649b0758fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:39.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.647+0000 7f8cb97fa700 0 client.17589 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:30:39.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.647+0000 7f8ceb943b80 1 -- 172.21.15.82:0/2425020857 shutdown_connections 2023-09-23T09:30:39.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.647+0000 7f8ceb943b80 1 -- 172.21.15.82:0/2425020857 wait complete. 2023-09-23T09:30:39.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.647+0000 7f8ceb943b80 20 client.17589 trim_cache size 0 max 16384 2023-09-23T09:30:39.654 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:30:39.654 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "no active scrubs running", 2023-09-23T09:30:39.654 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": {} 2023-09-23T09:30:39.654 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:30:39.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.647+0000 7f8cd7fff700 1 -- 172.21.15.82:0/2908544454 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f8cbc0a00c0 msgr2=0x7f8cbc0a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:39.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.647+0000 7f8cd7fff700 1 --2- 172.21.15.82:0/2908544454 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f8cbc0a00c0 0x7f8cbc0a2580 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8cc8007a30 tx=0x7f8cc8004b40 comp rx=0 tx=0).stop 2023-09-23T09:30:39.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.647+0000 7f8cd7fff700 1 -- 172.21.15.82:0/2908544454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cd0072d50 msgr2=0x7f8cd019e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:39.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.647+0000 7f8cd7fff700 1 --2- 172.21.15.82:0/2908544454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cd0072d50 0x7f8cd019e870 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc00c9b0 tx=0x7f8ccc00cd70 comp rx=0 tx=0).stop 2023-09-23T09:30:39.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.647+0000 7f8cd7fff700 1 -- 172.21.15.82:0/2908544454 shutdown_connections 2023-09-23T09:30:39.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.647+0000 7f8cd7fff700 1 --2- 172.21.15.82:0/2908544454 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f8cbc0a00c0 0x7f8cbc0a2580 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:39.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.647+0000 7f8cd7fff700 1 --2- 172.21.15.82:0/2908544454 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8cd010d0b0 0x7f8cd01988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:39.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.647+0000 7f8cd7fff700 1 --2- 172.21.15.82:0/2908544454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cd0072d50 0x7f8cd019e870 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:39.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.647+0000 7f8cd7fff700 1 --2- 172.21.15.82:0/2908544454 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cd0073670 0x7f8cd019edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:39.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.647+0000 7f8cd7fff700 1 -- 172.21.15.82:0/2908544454 >> 172.21.15.82:0/2908544454 conn(0x7f8cd00fc3a0 msgr2=0x7f8cd010f300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:39.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.648+0000 7f8cd7fff700 1 -- 172.21.15.82:0/2908544454 shutdown_connections 2023-09-23T09:30:39.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.648+0000 7f8cd7fff700 1 -- 172.21.15.82:0/2908544454 wait complete. 2023-09-23T09:30:39.666 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-09-23T09:30:39.667 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-23T09:30:39.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.864+0000 7f85805ff700 1 -- 172.21.15.82:0/2998617486 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85781008a0 msgr2=0x7f8578100d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:39.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.864+0000 7f85805ff700 1 --2- 172.21.15.82:0/2998617486 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85781008a0 0x7f8578100d20 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f8568009990 tx=0x7f8568009ca0 comp rx=0 tx=0).stop 2023-09-23T09:30:39.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.864+0000 7f85805ff700 1 -- 172.21.15.82:0/2998617486 shutdown_connections 2023-09-23T09:30:39.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.864+0000 7f85805ff700 1 --2- 172.21.15.82:0/2998617486 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8578101260 0x7f857810d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:39.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.864+0000 7f85805ff700 1 --2- 172.21.15.82:0/2998617486 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f85781068b0 0x7f8578106c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:39.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.864+0000 7f85805ff700 1 --2- 172.21.15.82:0/2998617486 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85781008a0 0x7f8578100d20 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:39.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.864+0000 7f85805ff700 1 -- 172.21.15.82:0/2998617486 >> 172.21.15.82:0/2998617486 conn(0x7f85780fc3d0 msgr2=0x7f85780fe7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:39.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.864+0000 7f85805ff700 1 -- 172.21.15.82:0/2998617486 shutdown_connections 2023-09-23T09:30:39.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.864+0000 7f85805ff700 1 -- 172.21.15.82:0/2998617486 wait complete. 2023-09-23T09:30:39.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.865+0000 7f85805ff700 1 Processor -- start 2023-09-23T09:30:39.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.865+0000 7f85805ff700 1 -- start start 2023-09-23T09:30:39.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.866+0000 7f85805ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85781008a0 0x7f857819c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:39.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.866+0000 7f85805ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8578101260 0x7f857819cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:39.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.866+0000 7f85805ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85781068b0 0x7f85781966a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:39.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.866+0000 7f85805ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8578196d10 con 0x7f85781068b0 2023-09-23T09:30:39.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.866+0000 7f85805ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8578196e80 con 0x7f85781008a0 2023-09-23T09:30:39.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.866+0000 7f85805ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8578197040 con 0x7f8578101260 2023-09-23T09:30:39.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.866+0000 7f857eb9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85781068b0 0x7f85781966a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:39.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.866+0000 7f857e39b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85781008a0 0x7f857819c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:39.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.866+0000 7f857eb9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85781068b0 0x7f85781966a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36340/0 (socket says 172.21.15.82:36340) 2023-09-23T09:30:39.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.867+0000 7f857eb9c700 1 -- 172.21.15.82:0/208838462 learned_addr learned my addr 172.21.15.82:0/208838462 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:30:39.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.866+0000 7f857e39b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85781008a0 0x7f857819c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:59352/0 (socket says 172.21.15.82:59352) 2023-09-23T09:30:39.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.867+0000 7f857db9a700 1 --2- 172.21.15.82:0/208838462 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8578101260 0x7f857819cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:39.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.867+0000 7f857e39b700 1 -- 172.21.15.82:0/208838462 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8578101260 msgr2=0x7f857819cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:39.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.867+0000 7f857e39b700 1 --2- 172.21.15.82:0/208838462 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8578101260 0x7f857819cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:39.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.867+0000 7f857e39b700 1 -- 172.21.15.82:0/208838462 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85781068b0 msgr2=0x7f85781966a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:39.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.867+0000 7f857e39b700 1 --2- 172.21.15.82:0/208838462 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85781068b0 0x7f85781966a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:39.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.867+0000 7f857e39b700 1 -- 172.21.15.82:0/208838462 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85680095f0 con 0x7f85781008a0 2023-09-23T09:30:39.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.867+0000 7f857e39b700 1 --2- 172.21.15.82:0/208838462 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85781008a0 0x7f857819c630 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f857400e9f0 tx=0x7f857400ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:39.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.868+0000 7f856f7fe700 1 -- 172.21.15.82:0/208838462 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f857400c9c0 con 0x7f85781008a0 2023-09-23T09:30:39.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.868+0000 7f85805ff700 1 -- 172.21.15.82:0/208838462 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8578197320 con 0x7f85781008a0 2023-09-23T09:30:39.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.868+0000 7f856f7fe700 1 -- 172.21.15.82:0/208838462 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8574010430 con 0x7f85781008a0 2023-09-23T09:30:39.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.868+0000 7f856f7fe700 1 -- 172.21.15.82:0/208838462 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8574018680 con 0x7f85781008a0 2023-09-23T09:30:39.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.868+0000 7f85805ff700 1 -- 172.21.15.82:0/208838462 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85781a3620 con 0x7f85781008a0 2023-09-23T09:30:39.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.869+0000 7f85805ff700 1 -- 172.21.15.82:0/208838462 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8578067710 con 0x7f85781008a0 2023-09-23T09:30:39.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.871+0000 7f856f7fe700 1 -- 172.21.15.82:0/208838462 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f85740105a0 con 0x7f85781008a0 2023-09-23T09:30:39.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.872+0000 7f856f7fe700 1 --2- 172.21.15.82:0/208838462 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f85640a0100 0x7f85640a25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:39.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.872+0000 7f856f7fe700 1 -- 172.21.15.82:0/208838462 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f8574014070 con 0x7f85781008a0 2023-09-23T09:30:39.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.873+0000 7f857db9a700 1 --2- 172.21.15.82:0/208838462 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f85640a0100 0x7f85640a25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:39.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.873+0000 7f857db9a700 1 --2- 172.21.15.82:0/208838462 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f85640a0100 0x7f85640a25c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8568006010 tx=0x7f8568005960 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:39.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:39.875+0000 7f856f7fe700 1 -- 172.21.15.82:0/208838462 <== mon.2 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f85740952b0 con 0x7f85781008a0 2023-09-23T09:30:40.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.120+0000 7f85805ff700 1 -- 172.21.15.82:0/208838462 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8578197bb0 con 0x7f85781008a0 2023-09-23T09:30:40.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.126+0000 7f856f7fe700 1 -- 172.21.15.82:0/208838462 <== mon.2 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 100 v100) v1 ==== 95+0+11352 (secure 0 0 0) 0x7f85740988d0 con 0x7f85781008a0 2023-09-23T09:30:40.127 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T09:30:40.128 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":100,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/1237857359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1237857359},{"type":"v1","addr":"172.21.15.82:6835","nonce":1237857359}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/1335102362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":1335102362},{"type":"v1","addr":"172.21.15.82:6837","nonce":1335102362}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":100,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-23T08:54:52.600479+0000","modified":"2023-09-23T09:30:38.209859+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24557,"mds_1":24550,"mds_2":24526,"mds_3":24515,"mds_4":24514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/3645331700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3645331700},{"type":"v1","addr":"172.21.15.135:6835","nonce":3645331700}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14658":{"gid":14658,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6839/205725278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":205725278},{"type":"v1","addr":"172.21.15.82:6839","nonce":205725278}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14670":{"gid":14670,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6841/2659297867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":2659297867},{"type":"v1","addr":"172.21.15.82:6841","nonce":2659297867}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24461":{"gid":24461,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/503886037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":503886037},{"type":"v1","addr":"172.21.15.135:6833","nonce":503886037}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24463":{"gid":24463,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.161:6833/471569125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":471569125},{"type":"v1","addr":"172.21.15.161:6833","nonce":471569125}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24514":{"gid":24514,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":10,"addr":"172.21.15.161:6835/2237964162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":2237964162},{"type":"v1","addr":"172.21.15.161:6835","nonce":2237964162}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24515":{"gid":24515,"name":"h","rank":3,"incarnation":22,"state":"up:active","state_seq":8,"addr":"172.21.15.135:6837/2655304858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2655304858},{"type":"v1","addr":"172.21.15.135:6837","nonce":2655304858}]},"join_fscid":-1,"export_targets":[0,1,2,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24526":{"gid":24526,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.161:6837/43639843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":43639843},{"type":"v1","addr":"172.21.15.161:6837","nonce":43639843}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24550":{"gid":24550,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.161:6839/758982817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6838","nonce":758982817},{"type":"v1","addr":"172.21.15.161:6839","nonce":758982817}]},"join_fscid":-1,"export_targets":[0,3],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24557":{"gid":24557,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6839/2508669274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2508669274},{"type":"v1","addr":"172.21.15.135:6839","nonce":2508669274}]},"join_fscid":-1,"export_targets":[1,3],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-23T09:30:40.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.128+0000 7f85805ff700 1 -- 172.21.15.82:0/208838462 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f85640a0100 msgr2=0x7f85640a25c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:40.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.128+0000 7f85805ff700 1 --2- 172.21.15.82:0/208838462 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f85640a0100 0x7f85640a25c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8568006010 tx=0x7f8568005960 comp rx=0 tx=0).stop 2023-09-23T09:30:40.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.128+0000 7f85805ff700 1 -- 172.21.15.82:0/208838462 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85781008a0 msgr2=0x7f857819c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:40.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.128+0000 7f85805ff700 1 --2- 172.21.15.82:0/208838462 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85781008a0 0x7f857819c630 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f857400e9f0 tx=0x7f857400ed00 comp rx=0 tx=0).stop 2023-09-23T09:30:40.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.128+0000 7f85805ff700 1 -- 172.21.15.82:0/208838462 shutdown_connections 2023-09-23T09:30:40.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.128+0000 7f85805ff700 1 --2- 172.21.15.82:0/208838462 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f85640a0100 0x7f85640a25c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.128+0000 7f85805ff700 1 --2- 172.21.15.82:0/208838462 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85781068b0 0x7f85781966a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.128+0000 7f85805ff700 1 --2- 172.21.15.82:0/208838462 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85781008a0 0x7f857819c630 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.128+0000 7f85805ff700 1 --2- 172.21.15.82:0/208838462 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8578101260 0x7f857819cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.128+0000 7f85805ff700 1 -- 172.21.15.82:0/208838462 >> 172.21.15.82:0/208838462 conn(0x7f85780fc3d0 msgr2=0x7f85780fc9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:40.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.128+0000 7f85805ff700 1 -- 172.21.15.82:0/208838462 shutdown_connections 2023-09-23T09:30:40.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.128+0000 7f85805ff700 1 -- 172.21.15.82:0/208838462 wait complete. 2023-09-23T09:30:40.131 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 100 2023-09-23T09:30:40.148 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-09-23T09:30:40.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.349+0000 7f9e073ff700 1 -- 172.21.15.82:0/2653715253 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e00101250 msgr2=0x7f9e0010d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:40.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.349+0000 7f9e073ff700 1 --2- 172.21.15.82:0/2653715253 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e00101250 0x7f9e0010d760 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f9df800b0a0 tx=0x7f9df800b3b0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.349+0000 7f9e073ff700 1 -- 172.21.15.82:0/2653715253 shutdown_connections 2023-09-23T09:30:40.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.349+0000 7f9e073ff700 1 --2- 172.21.15.82:0/2653715253 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e00101250 0x7f9e0010d760 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.349+0000 7f9e073ff700 1 --2- 172.21.15.82:0/2653715253 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9e001068a0 0x7f9e00106c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.349+0000 7f9e073ff700 1 --2- 172.21.15.82:0/2653715253 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e00100890 0x7f9e00100d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.349+0000 7f9e073ff700 1 -- 172.21.15.82:0/2653715253 >> 172.21.15.82:0/2653715253 conn(0x7f9e000fc380 msgr2=0x7f9e000fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:40.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.349+0000 7f9e073ff700 1 -- 172.21.15.82:0/2653715253 shutdown_connections 2023-09-23T09:30:40.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.349+0000 7f9e073ff700 1 -- 172.21.15.82:0/2653715253 wait complete. 2023-09-23T09:30:40.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.350+0000 7f9e073ff700 1 Processor -- start 2023-09-23T09:30:40.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.350+0000 7f9e073ff700 1 -- start start 2023-09-23T09:30:40.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.351+0000 7f9e073ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e00100890 0x7f9e0019e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:40.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.351+0000 7f9e073ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9e00101250 0x7f9e0019ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:40.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.351+0000 7f9e073ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e001068a0 0x7f9e00198830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:40.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.351+0000 7f9e073ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e00198ea0 con 0x7f9e00100890 2023-09-23T09:30:40.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.351+0000 7f9e073ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e00199010 con 0x7f9e001068a0 2023-09-23T09:30:40.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.351+0000 7f9e073ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e001991d0 con 0x7f9e00101250 2023-09-23T09:30:40.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.351+0000 7f9e0519b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e00100890 0x7f9e0019e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:40.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.351+0000 7f9e0519b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e00100890 0x7f9e0019e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36366/0 (socket says 172.21.15.82:36366) 2023-09-23T09:30:40.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.351+0000 7f9e0519b700 1 -- 172.21.15.82:0/770744984 learned_addr learned my addr 172.21.15.82:0/770744984 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:30:40.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.351+0000 7f9e0499a700 1 --2- 172.21.15.82:0/770744984 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9e00101250 0x7f9e0019ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:40.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.351+0000 7f9e0599c700 1 --2- 172.21.15.82:0/770744984 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e001068a0 0x7f9e00198830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:40.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.351+0000 7f9e0519b700 1 -- 172.21.15.82:0/770744984 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9e00101250 msgr2=0x7f9e0019ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:40.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.351+0000 7f9e0519b700 1 --2- 172.21.15.82:0/770744984 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9e00101250 0x7f9e0019ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.351+0000 7f9e0519b700 1 -- 172.21.15.82:0/770744984 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e001068a0 msgr2=0x7f9e00198830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:40.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.351+0000 7f9e0519b700 1 --2- 172.21.15.82:0/770744984 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e001068a0 0x7f9e00198830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.351+0000 7f9e0519b700 1 -- 172.21.15.82:0/770744984 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9df8009d00 con 0x7f9e00100890 2023-09-23T09:30:40.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.352+0000 7f9e0519b700 1 --2- 172.21.15.82:0/770744984 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e00100890 0x7f9e0019e7c0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc00d950 tx=0x7f9dfc00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:40.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.352+0000 7f9df67fc700 1 -- 172.21.15.82:0/770744984 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dfc009b40 con 0x7f9e00100890 2023-09-23T09:30:40.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.352+0000 7f9df67fc700 1 -- 172.21.15.82:0/770744984 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9dfc009ca0 con 0x7f9e00100890 2023-09-23T09:30:40.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.352+0000 7f9e073ff700 1 -- 172.21.15.82:0/770744984 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e001994b0 con 0x7f9e00100890 2023-09-23T09:30:40.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.352+0000 7f9df67fc700 1 -- 172.21.15.82:0/770744984 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dfc00f620 con 0x7f9e00100890 2023-09-23T09:30:40.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.352+0000 7f9e073ff700 1 -- 172.21.15.82:0/770744984 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e001a57b0 con 0x7f9e00100890 2023-09-23T09:30:40.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.355+0000 7f9df67fc700 1 -- 172.21.15.82:0/770744984 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f9dfc010460 con 0x7f9e00100890 2023-09-23T09:30:40.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.356+0000 7f9e1ad42b80 1 Processor -- start 2023-09-23T09:30:40.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.357+0000 7f9df67fc700 1 --2- 172.21.15.82:0/770744984 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f9dec0a0140 0x7f9dec0a2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:40.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.357+0000 7f9df67fc700 1 -- 172.21.15.82:0/770744984 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f9dfc0cb930 con 0x7f9e00100890 2023-09-23T09:30:40.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.357+0000 7f9e1ad42b80 1 -- start start 2023-09-23T09:30:40.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.357+0000 7f9e0599c700 1 --2- 172.21.15.82:0/770744984 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f9dec0a0140 0x7f9dec0a2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:40.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.357+0000 7f9e1ad42b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56104e5fd380 0x56104e5fd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:40.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.357+0000 7f9e1ad42b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56104e5fdca0 0x56104e5f7700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:40.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.357+0000 7f9e1ad42b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56104e5f7c40 0x56104e5f80a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:40.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.357+0000 7f9e1ad42b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56104e55f7b0 con 0x56104e5fd380 2023-09-23T09:30:40.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.357+0000 7f9e1ad42b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56104e550780 con 0x56104e5fdca0 2023-09-23T09:30:40.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.357+0000 7f9e1ad42b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x56104e54e0a0 con 0x56104e5f7c40 2023-09-23T09:30:40.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.357+0000 7f9e0599c700 1 --2- 172.21.15.82:0/770744984 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f9dec0a0140 0x7f9dec0a2600 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9df80062a0 tx=0x7f9df8006210 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:40.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.358+0000 7f9e0519b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56104e5fd380 0x56104e5fd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:40.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.358+0000 7f9e0519b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56104e5fd380 0x56104e5fd760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36382/0 (socket says 172.21.15.82:36382) 2023-09-23T09:30:40.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.358+0000 7f9e0519b700 1 -- 172.21.15.82:0/1538169668 learned_addr learned my addr 172.21.15.82:0/1538169668 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:30:40.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.358+0000 7f9e0499a700 1 --2- 172.21.15.82:0/1538169668 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56104e5fdca0 0x56104e5f7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:40.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.358+0000 7f9e0599c700 1 --2- 172.21.15.82:0/1538169668 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56104e5f7c40 0x56104e5f80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:40.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.358+0000 7f9e0519b700 1 -- 172.21.15.82:0/1538169668 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56104e5f7c40 msgr2=0x56104e5f80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:40.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.358+0000 7f9e0519b700 1 --2- 172.21.15.82:0/1538169668 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56104e5f7c40 0x56104e5f80a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.358+0000 7f9e0519b700 1 -- 172.21.15.82:0/1538169668 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56104e5fdca0 msgr2=0x56104e5f7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:40.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.358+0000 7f9e0519b700 1 --2- 172.21.15.82:0/1538169668 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56104e5fdca0 0x56104e5f7700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.358+0000 7f9e0519b700 1 -- 172.21.15.82:0/1538169668 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56104e3c9630 con 0x56104e5fd380 2023-09-23T09:30:40.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.358+0000 7f9e0499a700 1 --2- 172.21.15.82:0/1538169668 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56104e5fdca0 0x56104e5f7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:30:40.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.358+0000 7f9e0519b700 1 --2- 172.21.15.82:0/1538169668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56104e5fd380 0x56104e5fd760 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc010ab0 tx=0x7f9dfc098ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90f30d6e4626e18 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:40.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.358+0000 7f9deb7fe700 1 -- 172.21.15.82:0/1538169668 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dfc098fe0 con 0x56104e5fd380 2023-09-23T09:30:40.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.358+0000 7f9deb7fe700 1 -- 172.21.15.82:0/1538169668 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9dfc09ce10 con 0x56104e5fd380 2023-09-23T09:30:40.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.358+0000 7f9deb7fe700 1 -- 172.21.15.82:0/1538169668 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dfc099240 con 0x56104e5fd380 2023-09-23T09:30:40.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.359+0000 7f9e1ad42b80 1 -- 172.21.15.82:0/1538169668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56104e5fd380 msgr2=0x56104e5fd760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:40.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.359+0000 7f9e1ad42b80 1 --2- 172.21.15.82:0/1538169668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56104e5fd380 0x56104e5fd760 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc010ab0 tx=0x7f9dfc098ee0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.359+0000 7f9e1ad42b80 1 -- 172.21.15.82:0/1538169668 shutdown_connections 2023-09-23T09:30:40.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.359+0000 7f9e1ad42b80 1 --2- 172.21.15.82:0/1538169668 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56104e5f7c40 0x56104e5f80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.359+0000 7f9e1ad42b80 1 --2- 172.21.15.82:0/1538169668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56104e5fd380 0x56104e5fd760 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.359+0000 7f9e1ad42b80 1 --2- 172.21.15.82:0/1538169668 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56104e5fdca0 0x56104e5f7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.359+0000 7f9e1ad42b80 1 -- 172.21.15.82:0/1538169668 >> 172.21.15.82:0/1538169668 conn(0x56104e56c0e0 msgr2=0x56104e5f2410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:40.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.359+0000 7f9e1ad42b80 1 -- 172.21.15.82:0/1538169668 shutdown_connections 2023-09-23T09:30:40.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.359+0000 7f9e1ad42b80 1 -- 172.21.15.82:0/1538169668 wait complete. 2023-09-23T09:30:40.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.360+0000 7f9e1ad42b80 1 -- start start 2023-09-23T09:30:40.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.360+0000 7f9e1ad42b80 1 Processor -- start 2023-09-23T09:30:40.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.360+0000 7f9e1ad42b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56104e5f7c40 0x56104e600fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:40.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.360+0000 7f9e1ad42b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56104e5fd380 0x56104e6014e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:40.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.360+0000 7f9e1ad42b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56104e5fdca0 0x56104e601a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:40.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.360+0000 7f9e1ad42b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56104e549990 con 0x56104e5f7c40 2023-09-23T09:30:40.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.360+0000 7f9e1ad42b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56104e4e7bb0 con 0x56104e5fdca0 2023-09-23T09:30:40.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.360+0000 7f9e1ad42b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x56104e4e78b0 con 0x56104e5fd380 2023-09-23T09:30:40.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.361+0000 7f9e1ad42b80 10 client.0 _ll_register_callbacks cb 0x56104e431a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:30:40.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.361+0000 7f9e0519b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56104e5f7c40 0x56104e600fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:40.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.361+0000 7f9e0519b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56104e5f7c40 0x56104e600fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36388/0 (socket says 172.21.15.82:36388) 2023-09-23T09:30:40.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.361+0000 7f9e0519b700 1 -- 172.21.15.82:0/2246558582 learned_addr learned my addr 172.21.15.82:0/2246558582 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:30:40.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.361+0000 7f9e0499a700 1 --2- 172.21.15.82:0/2246558582 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56104e5fd380 0x56104e6014e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:40.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.361+0000 7f9e0599c700 1 --2- 172.21.15.82:0/2246558582 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56104e5fdca0 0x56104e601a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:40.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.361+0000 7f9e0519b700 1 -- 172.21.15.82:0/2246558582 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56104e5fd380 msgr2=0x56104e6014e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:40.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.361+0000 7f9e0519b700 1 --2- 172.21.15.82:0/2246558582 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56104e5fd380 0x56104e6014e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.361+0000 7f9e0519b700 1 -- 172.21.15.82:0/2246558582 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56104e5fdca0 msgr2=0x56104e601a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:40.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.361+0000 7f9e0519b700 1 --2- 172.21.15.82:0/2246558582 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56104e5fdca0 0x56104e601a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.361+0000 7f9e0519b700 1 -- 172.21.15.82:0/2246558582 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e001a57b0 con 0x56104e5f7c40 2023-09-23T09:30:40.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.361+0000 7f9e0599c700 1 --2- 172.21.15.82:0/2246558582 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56104e5fdca0 0x56104e601a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T09:30:40.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.361+0000 7f9e0519b700 1 --2- 172.21.15.82:0/2246558582 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56104e5f7c40 0x56104e600fa0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc009520 tx=0x7f9dfc0c9030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c7e7a39b51ccab6 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:40.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.361+0000 7f9de8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:30:40.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.362+0000 7f9de8ff9700 1 -- 172.21.15.82:0/2246558582 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dfc09ce10 con 0x56104e5f7c40 2023-09-23T09:30:40.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.362+0000 7f9e1ad42b80 1 -- 172.21.15.82:0/2246558582 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56104e5c71c0 con 0x56104e5f7c40 2023-09-23T09:30:40.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.362+0000 7f9de8ff9700 1 -- 172.21.15.82:0/2246558582 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(143..143 src has 1..143) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f9dfc0a0df0 con 0x56104e5f7c40 2023-09-23T09:30:40.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.362+0000 7f9de8ff9700 1 -- 172.21.15.82:0/2246558582 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=100) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9dfc098fe0 con 0x56104e5f7c40 2023-09-23T09:30:40.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.362+0000 7f9e1ad42b80 10 client.17607 fetch_fsmap learned FSMap version 100 2023-09-23T09:30:40.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.362+0000 7f9e1ad42b80 1 -- 172.21.15.82:0/2246558582 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=100,monmap=4+}) v3 -- 0x56104e375de0 con 0x56104e5f7c40 2023-09-23T09:30:40.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.362+0000 7f9de8ff9700 1 -- 172.21.15.82:0/2246558582 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56104e5c71c0 con 0x56104e5f7c40 2023-09-23T09:30:40.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.362+0000 7f9de8ff9700 1 -- 172.21.15.82:0/2246558582 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 100) v1 ==== 7946+0+0 (secure 0 0 0) 0x7f9dfc0992b0 con 0x56104e5f7c40 2023-09-23T09:30:40.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.362+0000 7f9e1ad42b80 10 client.17607 fetch_fsmap finished waiting for FSMap version 100 2023-09-23T09:30:40.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.362+0000 7f9e1ad42b80 10 client.17607 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2023-09-23T09:30:40.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.362+0000 7f9e1ad42b80 20 client.17607 populate_metadata read hostname 'smithi082' 2023-09-23T09:30:40.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.362+0000 7f9e1ad42b80 1 --2- 172.21.15.82:0/2246558582 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x56104e611470 0x56104e613890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:40.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.362+0000 7f9e1ad42b80 4 client.17607 mds_command: new command op to 24514 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:30:40.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.362+0000 7f9e1ad42b80 1 -- 172.21.15.82:0/2246558582 --> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56104e4efba0 con 0x56104e611470 2023-09-23T09:30:40.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.363+0000 7f9e0499a700 1 --2- 172.21.15.82:0/2246558582 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x56104e611470 0x56104e613890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:40.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.363+0000 7f9de8ff9700 10 client.17607 ms_handle_connect on v2:172.21.15.161:6834/2237964162 2023-09-23T09:30:40.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.363+0000 7f9e0499a700 1 --2- 172.21.15.82:0/2246558582 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x56104e611470 0x56104e613890 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=153cc7d9bdd6aa74 server_cookie=e011ff297ac974d3 in_seq=0 out_seq=0 2023-09-23T09:30:40.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.364+0000 7f9de8ff9700 1 -- 172.21.15.82:0/2246558582 <== mds.4 v2:172.21.15.161:6834/2237964162 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56104e4efba0 con 0x56104e611470 2023-09-23T09:30:40.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.364+0000 7f9de8ff9700 10 client.17607 handle_command_reply: tid=0 2023-09-23T09:30:40.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.364+0000 7f9e1ad42b80 1 client.17607 shutdown 2023-09-23T09:30:40.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.364+0000 7f9e1ad42b80 1 -- 172.21.15.82:0/2246558582 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56104e5f7c40 msgr2=0x56104e600fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:40.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.364+0000 7f9e1ad42b80 1 --2- 172.21.15.82:0/2246558582 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56104e5f7c40 0x56104e600fa0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc009520 tx=0x7f9dfc0c9030 comp rx=0 tx=0).stop 2023-09-23T09:30:40.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.365+0000 7f9e1ad42b80 1 -- 172.21.15.82:0/2246558582 shutdown_connections 2023-09-23T09:30:40.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.365+0000 7f9e1ad42b80 1 --2- 172.21.15.82:0/2246558582 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x56104e611470 0x56104e613890 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.365+0000 7f9e1ad42b80 1 --2- 172.21.15.82:0/2246558582 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56104e5fdca0 0x56104e601a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.365+0000 7f9de8ff9700 0 client.17607 ms_handle_reset on v2:172.21.15.161:6834/2237964162 2023-09-23T09:30:40.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.365+0000 7f9e1ad42b80 1 --2- 172.21.15.82:0/2246558582 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56104e5f7c40 0x56104e600fa0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.365+0000 7f9e1ad42b80 1 --2- 172.21.15.82:0/2246558582 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56104e5fd380 0x56104e6014e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.365+0000 7f9e1ad42b80 1 -- 172.21.15.82:0/2246558582 >> 172.21.15.82:0/2246558582 conn(0x56104e56c0e0 msgr2=0x56104e5ecb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:40.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.365+0000 7f9e1ad42b80 1 -- 172.21.15.82:0/2246558582 shutdown_connections 2023-09-23T09:30:40.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.365+0000 7f9e1ad42b80 1 -- 172.21.15.82:0/2246558582 wait complete. 2023-09-23T09:30:40.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.365+0000 7f9e1ad42b80 20 client.17607 trim_cache size 0 max 16384 2023-09-23T09:30:40.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.378+0000 7f9e1ad42b80 1 Processor -- start 2023-09-23T09:30:40.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.378+0000 7f9e1ad42b80 1 -- start start 2023-09-23T09:30:40.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.379+0000 7f9e1ad42b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56104e5f7c40 0x56104e6086e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:40.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.379+0000 7f9e1ad42b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56104e5fd380 0x56104e601940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:40.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.379+0000 7f9e1ad42b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56104e5fdca0 0x56104e5ec2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:40.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.379+0000 7f9e1ad42b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56104e3cb920 con 0x56104e5fd380 2023-09-23T09:30:40.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.379+0000 7f9e1ad42b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56104e6042a0 con 0x56104e5f7c40 2023-09-23T09:30:40.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.379+0000 7f9e1ad42b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x56104e5eec80 con 0x56104e5fdca0 2023-09-23T09:30:40.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.379+0000 7f9e0499a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56104e5fd380 0x56104e601940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:40.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.379+0000 7f9e0499a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56104e5fd380 0x56104e601940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36398/0 (socket says 172.21.15.82:36398) 2023-09-23T09:30:40.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.379+0000 7f9e0499a700 1 -- 172.21.15.82:0/2338755425 learned_addr learned my addr 172.21.15.82:0/2338755425 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:30:40.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.379+0000 7f9e0519b700 1 --2- 172.21.15.82:0/2338755425 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56104e5f7c40 0x56104e6086e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:40.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.379+0000 7f9e0599c700 1 --2- 172.21.15.82:0/2338755425 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56104e5fdca0 0x56104e5ec2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:40.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.379+0000 7f9e0499a700 1 -- 172.21.15.82:0/2338755425 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56104e5fdca0 msgr2=0x56104e5ec2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:40.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.379+0000 7f9e0499a700 1 --2- 172.21.15.82:0/2338755425 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56104e5fdca0 0x56104e5ec2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.379+0000 7f9e0499a700 1 -- 172.21.15.82:0/2338755425 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56104e5f7c40 msgr2=0x56104e6086e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:40.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.379+0000 7f9e0499a700 1 --2- 172.21.15.82:0/2338755425 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56104e5f7c40 0x56104e6086e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.380+0000 7f9e0499a700 1 -- 172.21.15.82:0/2338755425 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56104e5f82f0 con 0x56104e5fd380 2023-09-23T09:30:40.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.380+0000 7f9e0519b700 1 --2- 172.21.15.82:0/2338755425 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56104e5f7c40 0x56104e6086e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:30:40.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.380+0000 7f9e0599c700 1 --2- 172.21.15.82:0/2338755425 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56104e5fdca0 0x56104e5ec2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T09:30:40.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.380+0000 7f9e0499a700 1 --2- 172.21.15.82:0/2338755425 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56104e5fd380 0x56104e601940 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x56104e602550 tx=0x7f9df001cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1344ff07e0af692 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:40.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.380+0000 7f9debfff700 1 -- 172.21.15.82:0/2338755425 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df0016040 con 0x56104e5fd380 2023-09-23T09:30:40.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.380+0000 7f9debfff700 1 -- 172.21.15.82:0/2338755425 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9df0020070 con 0x56104e5fd380 2023-09-23T09:30:40.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.380+0000 7f9debfff700 1 -- 172.21.15.82:0/2338755425 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df0013ae0 con 0x56104e5fd380 2023-09-23T09:30:40.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.381+0000 7f9e1ad42b80 1 -- 172.21.15.82:0/2338755425 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56104e5fd380 msgr2=0x56104e601940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:40.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.381+0000 7f9e1ad42b80 1 --2- 172.21.15.82:0/2338755425 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56104e5fd380 0x56104e601940 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x56104e602550 tx=0x7f9df001cc50 comp rx=0 tx=0).stop 2023-09-23T09:30:40.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.381+0000 7f9e1ad42b80 1 -- 172.21.15.82:0/2338755425 shutdown_connections 2023-09-23T09:30:40.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.381+0000 7f9e1ad42b80 1 --2- 172.21.15.82:0/2338755425 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56104e5fdca0 0x56104e5ec2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.381+0000 7f9e1ad42b80 1 --2- 172.21.15.82:0/2338755425 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56104e5f7c40 0x56104e6086e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.381+0000 7f9e1ad42b80 1 --2- 172.21.15.82:0/2338755425 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56104e5fd380 0x56104e601940 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.381+0000 7f9e1ad42b80 1 -- 172.21.15.82:0/2338755425 >> 172.21.15.82:0/2338755425 conn(0x56104e56c0e0 msgr2=0x56104e601230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:40.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.381+0000 7f9e1ad42b80 1 -- 172.21.15.82:0/2338755425 shutdown_connections 2023-09-23T09:30:40.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.381+0000 7f9e1ad42b80 1 -- 172.21.15.82:0/2338755425 wait complete. 2023-09-23T09:30:40.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.381+0000 7f9e1ad42b80 1 -- start start 2023-09-23T09:30:40.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.382+0000 7f9e1ad42b80 1 Processor -- start 2023-09-23T09:30:40.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.382+0000 7f9e1ad42b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56104e5f7c40 0x56104e6593e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:40.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.382+0000 7f9e1ad42b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56104e5fd380 0x56104e659960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:40.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.382+0000 7f9e1ad42b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56104e5fdca0 0x56104e664270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:40.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.382+0000 7f9e1ad42b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56104e664800 con 0x56104e5f7c40 2023-09-23T09:30:40.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.382+0000 7f9e1ad42b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56104e664970 con 0x56104e5fdca0 2023-09-23T09:30:40.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.382+0000 7f9e1ad42b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x56104e664b30 con 0x56104e5fd380 2023-09-23T09:30:40.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.382+0000 7f9e1ad42b80 10 client.0 _ll_register_callbacks cb 0x7f9dfc098db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:30:40.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.383+0000 7f9e0519b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56104e5f7c40 0x56104e6593e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:40.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.383+0000 7f9e0519b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56104e5f7c40 0x56104e6593e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36414/0 (socket says 172.21.15.82:36414) 2023-09-23T09:30:40.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.383+0000 7f9e0519b700 1 -- 172.21.15.82:0/4099277719 learned_addr learned my addr 172.21.15.82:0/4099277719 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:30:40.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.383+0000 7f9e0599c700 1 --2- 172.21.15.82:0/4099277719 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56104e5fdca0 0x56104e664270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:40.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.383+0000 7f9e0499a700 1 --2- 172.21.15.82:0/4099277719 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56104e5fd380 0x56104e659960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:40.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.383+0000 7f9e0519b700 1 -- 172.21.15.82:0/4099277719 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56104e5fd380 msgr2=0x56104e659960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:40.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.383+0000 7f9e0519b700 1 --2- 172.21.15.82:0/4099277719 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56104e5fd380 0x56104e659960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.383+0000 7f9e0519b700 1 -- 172.21.15.82:0/4099277719 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56104e5fdca0 msgr2=0x56104e664270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:40.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.383+0000 7f9e0519b700 1 --2- 172.21.15.82:0/4099277719 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56104e5fdca0 0x56104e664270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.383+0000 7f9e0519b700 1 -- 172.21.15.82:0/4099277719 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9df0008730 con 0x56104e5f7c40 2023-09-23T09:30:40.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.383+0000 7f9e0499a700 1 --2- 172.21.15.82:0/4099277719 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56104e5fd380 0x56104e659960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T09:30:40.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.383+0000 7f9e0519b700 1 --2- 172.21.15.82:0/4099277719 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56104e5f7c40 0x56104e6593e0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc00b2f0 tx=0x7f9dfc0c9580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d9459b456cba872 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:40.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.383+0000 7f9de8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:30:40.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.383+0000 7f9de8ff9700 1 -- 172.21.15.82:0/4099277719 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dfc09ce10 con 0x56104e5f7c40 2023-09-23T09:30:40.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.383+0000 7f9e1ad42b80 1 -- 172.21.15.82:0/4099277719 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56104e60e140 con 0x56104e5f7c40 2023-09-23T09:30:40.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.383+0000 7f9de8ff9700 1 -- 172.21.15.82:0/4099277719 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(143..143 src has 1..143) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f9dfc0a0df0 con 0x56104e5f7c40 2023-09-23T09:30:40.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.384+0000 7f9de8ff9700 1 -- 172.21.15.82:0/4099277719 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=100) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9dfc098fe0 con 0x56104e5f7c40 2023-09-23T09:30:40.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.384+0000 7f9e1ad42b80 10 client.17613 fetch_fsmap learned FSMap version 100 2023-09-23T09:30:40.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.384+0000 7f9e1ad42b80 1 -- 172.21.15.82:0/4099277719 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=100,monmap=4+}) v3 -- 0x56104e35ec60 con 0x56104e5f7c40 2023-09-23T09:30:40.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.384+0000 7f9de8ff9700 1 -- 172.21.15.82:0/4099277719 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56104e60e140 con 0x56104e5f7c40 2023-09-23T09:30:40.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.384+0000 7f9de8ff9700 1 -- 172.21.15.82:0/4099277719 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 100) v1 ==== 7946+0+0 (secure 0 0 0) 0x7f9dfc098060 con 0x56104e5f7c40 2023-09-23T09:30:40.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.384+0000 7f9e1ad42b80 10 client.17613 fetch_fsmap finished waiting for FSMap version 100 2023-09-23T09:30:40.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.384+0000 7f9e1ad42b80 10 client.17613 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2023-09-23T09:30:40.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.384+0000 7f9e1ad42b80 20 client.17613 populate_metadata read hostname 'smithi082' 2023-09-23T09:30:40.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.384+0000 7f9e1ad42b80 1 --2- 172.21.15.82:0/4099277719 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x56104e665d70 0x56104e668190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:40.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.384+0000 7f9e1ad42b80 4 client.17613 mds_command: new command op to 24514 tid=0[{"prefix": "damage ls"}] 2023-09-23T09:30:40.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.384+0000 7f9e1ad42b80 1 -- 172.21.15.82:0/4099277719 --> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56104e5ea8b0 con 0x56104e665d70 2023-09-23T09:30:40.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.385+0000 7f9e0499a700 1 --2- 172.21.15.82:0/4099277719 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x56104e665d70 0x56104e668190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:40.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.385+0000 7f9e0499a700 1 --2- 172.21.15.82:0/4099277719 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x56104e665d70 0x56104e668190 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=3a2c6a000b1562f8 server_cookie=8a411419441af395 in_seq=0 out_seq=0 2023-09-23T09:30:40.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.385+0000 7f9de8ff9700 10 client.17613 ms_handle_connect on v2:172.21.15.161:6834/2237964162 2023-09-23T09:30:40.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.385+0000 7f9de8ff9700 1 -- 172.21.15.82:0/4099277719 <== mds.4 v2:172.21.15.161:6834/2237964162 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56104e5ea8b0 con 0x56104e665d70 2023-09-23T09:30:40.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.385+0000 7f9de8ff9700 10 client.17613 handle_command_reply: tid=0 2023-09-23T09:30:40.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.385+0000 7f9e1ad42b80 1 client.17613 shutdown 2023-09-23T09:30:40.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.386+0000 7f9e1ad42b80 1 -- 172.21.15.82:0/4099277719 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56104e5f7c40 msgr2=0x56104e6593e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:40.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.386+0000 7f9e1ad42b80 1 --2- 172.21.15.82:0/4099277719 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56104e5f7c40 0x56104e6593e0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc00b2f0 tx=0x7f9dfc0c9580 comp rx=0 tx=0).stop 2023-09-23T09:30:40.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.386+0000 7f9e1ad42b80 1 -- 172.21.15.82:0/4099277719 shutdown_connections 2023-09-23T09:30:40.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.386+0000 7f9e1ad42b80 1 --2- 172.21.15.82:0/4099277719 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x56104e665d70 0x56104e668190 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.386+0000 7f9e1ad42b80 1 --2- 172.21.15.82:0/4099277719 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56104e5fdca0 0x56104e664270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.386+0000 7f9e1ad42b80 1 --2- 172.21.15.82:0/4099277719 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56104e5f7c40 0x56104e6593e0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.386+0000 7f9de8ff9700 0 client.17613 ms_handle_reset on v2:172.21.15.161:6834/2237964162 2023-09-23T09:30:40.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.386+0000 7f9e1ad42b80 1 --2- 172.21.15.82:0/4099277719 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56104e5fd380 0x56104e659960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.386+0000 7f9e1ad42b80 1 -- 172.21.15.82:0/4099277719 >> 172.21.15.82:0/4099277719 conn(0x56104e56c0e0 msgr2=0x56104e5ec2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:40.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.386+0000 7f9e1ad42b80 1 -- 172.21.15.82:0/4099277719 shutdown_connections 2023-09-23T09:30:40.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.386+0000 7f9e1ad42b80 1 -- 172.21.15.82:0/4099277719 wait complete. 2023-09-23T09:30:40.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.386+0000 7f9e1ad42b80 20 client.17613 trim_cache size 0 max 16384 2023-09-23T09:30:40.392 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2023-09-23T09:30:40.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.386+0000 7f9e073ff700 1 -- 172.21.15.82:0/770744984 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f9dec0a0140 msgr2=0x7f9dec0a2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:40.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.386+0000 7f9e073ff700 1 --2- 172.21.15.82:0/770744984 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f9dec0a0140 0x7f9dec0a2600 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9df80062a0 tx=0x7f9df8006210 comp rx=0 tx=0).stop 2023-09-23T09:30:40.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.386+0000 7f9e073ff700 1 -- 172.21.15.82:0/770744984 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e00100890 msgr2=0x7f9e0019e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:40.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.386+0000 7f9e073ff700 1 --2- 172.21.15.82:0/770744984 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e00100890 0x7f9e0019e7c0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc00d950 tx=0x7f9dfc00dd10 comp rx=0 tx=0).stop 2023-09-23T09:30:40.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.387+0000 7f9e073ff700 1 -- 172.21.15.82:0/770744984 shutdown_connections 2023-09-23T09:30:40.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.387+0000 7f9e073ff700 1 --2- 172.21.15.82:0/770744984 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f9dec0a0140 0x7f9dec0a2600 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.387+0000 7f9e073ff700 1 --2- 172.21.15.82:0/770744984 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e001068a0 0x7f9e00198830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.387+0000 7f9e073ff700 1 --2- 172.21.15.82:0/770744984 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e00100890 0x7f9e0019e7c0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.387+0000 7f9e073ff700 1 --2- 172.21.15.82:0/770744984 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9e00101250 0x7f9e0019ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.387+0000 7f9e073ff700 1 -- 172.21.15.82:0/770744984 >> 172.21.15.82:0/770744984 conn(0x7f9e000fc380 msgr2=0x7f9e0010bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:40.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.387+0000 7f9e073ff700 1 -- 172.21.15.82:0/770744984 shutdown_connections 2023-09-23T09:30:40.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.387+0000 7f9e073ff700 1 -- 172.21.15.82:0/770744984 wait complete. 2023-09-23T09:30:40.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:30:40 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:30:40.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:30:40 smithi161 ceph-mon[99580]: pgmap v1070: 97 pgs: 97 active+clean; 16 GiB data, 55 GiB used, 1018 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 15 MiB/s wr, 1.22k op/s 2023-09-23T09:30:40.403 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:30:40 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:30:40.403 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:30:40 smithi082 ceph-mon[97694]: pgmap v1070: 97 pgs: 97 active+clean; 16 GiB data, 55 GiB used, 1018 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 15 MiB/s wr, 1.22k op/s 2023-09-23T09:30:40.405 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-09-23T09:30:40.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:30:40 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:30:40.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:30:40 smithi135 ceph-mon[99205]: pgmap v1070: 97 pgs: 97 active+clean; 16 GiB data, 55 GiB used, 1018 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 15 MiB/s wr, 1.22k op/s 2023-09-23T09:30:40.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.605+0000 7f789b1ff700 1 -- 172.21.15.82:0/1724511594 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7894100890 msgr2=0x7f7894100d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:40.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.605+0000 7f789b1ff700 1 --2- 172.21.15.82:0/1724511594 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7894100890 0x7f7894100d10 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f7880009990 tx=0x7f7880009ca0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.606+0000 7f789b1ff700 1 -- 172.21.15.82:0/1724511594 shutdown_connections 2023-09-23T09:30:40.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.606+0000 7f789b1ff700 1 --2- 172.21.15.82:0/1724511594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7894101250 0x7f789410d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.606+0000 7f789b1ff700 1 --2- 172.21.15.82:0/1724511594 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f78941068a0 0x7f7894106c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.606+0000 7f789b1ff700 1 --2- 172.21.15.82:0/1724511594 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7894100890 0x7f7894100d10 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.606+0000 7f789b1ff700 1 -- 172.21.15.82:0/1724511594 >> 172.21.15.82:0/1724511594 conn(0x7f78940fc380 msgr2=0x7f78940fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:40.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.606+0000 7f789b1ff700 1 -- 172.21.15.82:0/1724511594 shutdown_connections 2023-09-23T09:30:40.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.606+0000 7f789b1ff700 1 -- 172.21.15.82:0/1724511594 wait complete. 2023-09-23T09:30:40.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.607+0000 7f789b1ff700 1 Processor -- start 2023-09-23T09:30:40.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.607+0000 7f789b1ff700 1 -- start start 2023-09-23T09:30:40.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.607+0000 7f789b1ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7894100890 0x7f789419e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:40.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.607+0000 7f789b1ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7894101250 0x7f789419ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:40.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.607+0000 7f789b1ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78941068a0 0x7f7894198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:40.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.607+0000 7f789b1ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7894199050 con 0x7f78941068a0 2023-09-23T09:30:40.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.607+0000 7f789b1ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78941991c0 con 0x7f7894100890 2023-09-23T09:30:40.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.607+0000 7f789b1ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7894199380 con 0x7f7894101250 2023-09-23T09:30:40.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.607+0000 7f789979c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78941068a0 0x7f7894198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:40.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.608+0000 7f789979c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78941068a0 0x7f7894198880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36428/0 (socket says 172.21.15.82:36428) 2023-09-23T09:30:40.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.608+0000 7f789979c700 1 -- 172.21.15.82:0/3487584215 learned_addr learned my addr 172.21.15.82:0/3487584215 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:30:40.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.608+0000 7f7898f9b700 1 --2- 172.21.15.82:0/3487584215 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7894100890 0x7f789419e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:40.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.608+0000 7f7893fff700 1 --2- 172.21.15.82:0/3487584215 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7894101250 0x7f789419ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:40.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.608+0000 7f789979c700 1 -- 172.21.15.82:0/3487584215 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7894101250 msgr2=0x7f789419ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:40.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.608+0000 7f789979c700 1 --2- 172.21.15.82:0/3487584215 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7894101250 0x7f789419ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.608+0000 7f789979c700 1 -- 172.21.15.82:0/3487584215 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7894100890 msgr2=0x7f789419e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:40.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.608+0000 7f789979c700 1 --2- 172.21.15.82:0/3487584215 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7894100890 0x7f789419e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.608+0000 7f789979c700 1 -- 172.21.15.82:0/3487584215 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78800095f0 con 0x7f78941068a0 2023-09-23T09:30:40.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.608+0000 7f789979c700 1 --2- 172.21.15.82:0/3487584215 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78941068a0 0x7f7894198880 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f788c007d70 tx=0x7f788c00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:40.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.608+0000 7f7891ffb700 1 -- 172.21.15.82:0/3487584215 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f788c00ad40 con 0x7f78941068a0 2023-09-23T09:30:40.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.608+0000 7f7891ffb700 1 -- 172.21.15.82:0/3487584215 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f788c0128b0 con 0x7f78941068a0 2023-09-23T09:30:40.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.608+0000 7f789b1ff700 1 -- 172.21.15.82:0/3487584215 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7894199660 con 0x7f78941068a0 2023-09-23T09:30:40.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.608+0000 7f7891ffb700 1 -- 172.21.15.82:0/3487584215 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f788c0115a0 con 0x7f78941068a0 2023-09-23T09:30:40.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.609+0000 7f789b1ff700 1 -- 172.21.15.82:0/3487584215 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78941a5820 con 0x7f78941068a0 2023-09-23T09:30:40.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.612+0000 7f7891ffb700 1 -- 172.21.15.82:0/3487584215 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f788c012a20 con 0x7f78941068a0 2023-09-23T09:30:40.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.613+0000 7f78aeb7cb80 1 Processor -- start 2023-09-23T09:30:40.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.614+0000 7f78aeb7cb80 1 -- start start 2023-09-23T09:30:40.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.614+0000 7f78aeb7cb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56327c8a7380 0x56327c8a7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:40.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.614+0000 7f78aeb7cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56327c8a7ca0 0x56327c8a1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:40.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.614+0000 7f78aeb7cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56327c8a1c40 0x56327c8a20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:40.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.614+0000 7f78aeb7cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56327c8097b0 con 0x56327c8a1c40 2023-09-23T09:30:40.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.614+0000 7f78aeb7cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56327c7fa780 con 0x56327c8a7ca0 2023-09-23T09:30:40.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.614+0000 7f78aeb7cb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x56327c7f80a0 con 0x56327c8a7380 2023-09-23T09:30:40.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.614+0000 7f7891ffb700 1 --2- 172.21.15.82:0/3487584215 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f78840a00c0 0x7f78840a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:40.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.615+0000 7f7891ffb700 1 -- 172.21.15.82:0/3487584215 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f788c0cb840 con 0x7f78941068a0 2023-09-23T09:30:40.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.615+0000 7f7893fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56327c8a1c40 0x56327c8a20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:40.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.615+0000 7f789979c700 1 --2- 172.21.15.82:0/3487584215 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f78840a00c0 0x7f78840a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:40.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.615+0000 7f7893fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56327c8a1c40 0x56327c8a20a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36438/0 (socket says 172.21.15.82:36438) 2023-09-23T09:30:40.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.615+0000 7f7893fff700 1 -- 172.21.15.82:0/1463189569 learned_addr learned my addr 172.21.15.82:0/1463189569 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:30:40.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.615+0000 7f7898f9b700 1 --2- 172.21.15.82:0/1463189569 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56327c8a7ca0 0x56327c8a1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:40.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.615+0000 7f7893fff700 1 --2- 172.21.15.82:0/1463189569 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56327c8a7380 0x56327c8a7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:40.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.615+0000 7f7893fff700 1 -- 172.21.15.82:0/1463189569 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56327c8a7380 msgr2=0x56327c8a7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:40.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.615+0000 7f7893fff700 1 --2- 172.21.15.82:0/1463189569 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56327c8a7380 0x56327c8a7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.615+0000 7f7893fff700 1 -- 172.21.15.82:0/1463189569 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56327c8a7ca0 msgr2=0x56327c8a1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:40.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.615+0000 7f7893fff700 1 --2- 172.21.15.82:0/1463189569 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56327c8a7ca0 0x56327c8a1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.615+0000 7f7893fff700 1 -- 172.21.15.82:0/1463189569 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56327c673630 con 0x56327c8a1c40 2023-09-23T09:30:40.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.615+0000 7f7898f9b700 1 --2- 172.21.15.82:0/1463189569 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56327c8a7ca0 0x56327c8a1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:30:40.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.615+0000 7f789979c700 1 --2- 172.21.15.82:0/3487584215 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f78840a00c0 0x7f78840a2580 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f788c0cbaa0 tx=0x7f788c098f00 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:40.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.615+0000 7f7893fff700 1 --2- 172.21.15.82:0/1463189569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56327c8a1c40 0x56327c8a20a0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f78800098e0 tx=0x7f788001a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46e75762e097f94c server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:40.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.616+0000 7f787effd700 1 -- 172.21.15.82:0/1463189569 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f788000baa0 con 0x56327c8a1c40 2023-09-23T09:30:40.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.616+0000 7f787effd700 1 -- 172.21.15.82:0/1463189569 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f788001e070 con 0x56327c8a1c40 2023-09-23T09:30:40.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.616+0000 7f787effd700 1 -- 172.21.15.82:0/1463189569 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7880003f80 con 0x56327c8a1c40 2023-09-23T09:30:40.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.616+0000 7f78aeb7cb80 1 -- 172.21.15.82:0/1463189569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56327c8a1c40 msgr2=0x56327c8a20a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:40.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.616+0000 7f78aeb7cb80 1 --2- 172.21.15.82:0/1463189569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56327c8a1c40 0x56327c8a20a0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f78800098e0 tx=0x7f788001a040 comp rx=0 tx=0).stop 2023-09-23T09:30:40.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.616+0000 7f78aeb7cb80 1 -- 172.21.15.82:0/1463189569 shutdown_connections 2023-09-23T09:30:40.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.616+0000 7f78aeb7cb80 1 --2- 172.21.15.82:0/1463189569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56327c8a1c40 0x56327c8a20a0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.617+0000 7f78aeb7cb80 1 --2- 172.21.15.82:0/1463189569 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56327c8a7380 0x56327c8a7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.617+0000 7f78aeb7cb80 1 --2- 172.21.15.82:0/1463189569 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56327c8a7ca0 0x56327c8a1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.617+0000 7f78aeb7cb80 1 -- 172.21.15.82:0/1463189569 >> 172.21.15.82:0/1463189569 conn(0x56327c8160e0 msgr2=0x56327c89c410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:40.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.617+0000 7f78aeb7cb80 1 -- 172.21.15.82:0/1463189569 shutdown_connections 2023-09-23T09:30:40.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.617+0000 7f78aeb7cb80 1 -- 172.21.15.82:0/1463189569 wait complete. 2023-09-23T09:30:40.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.617+0000 7f78aeb7cb80 1 -- start start 2023-09-23T09:30:40.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.617+0000 7f78aeb7cb80 1 Processor -- start 2023-09-23T09:30:40.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.618+0000 7f78aeb7cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56327c8a1c40 0x56327c8adc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:40.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.618+0000 7f78aeb7cb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56327c8a7380 0x56327c8aaec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:40.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.618+0000 7f78aeb7cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56327c8a7ca0 0x56327c8ab600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:40.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.618+0000 7f78aeb7cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56327c7f3990 con 0x56327c8a1c40 2023-09-23T09:30:40.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.618+0000 7f78aeb7cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56327c791bb0 con 0x56327c8a7ca0 2023-09-23T09:30:40.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.618+0000 7f78aeb7cb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x56327c7918b0 con 0x56327c8a7380 2023-09-23T09:30:40.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.618+0000 7f78aeb7cb80 10 client.0 _ll_register_callbacks cb 0x56327c6dba80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:30:40.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.618+0000 7f7893fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56327c8a1c40 0x56327c8adc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:40.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.618+0000 7f7893fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56327c8a1c40 0x56327c8adc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36454/0 (socket says 172.21.15.82:36454) 2023-09-23T09:30:40.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.618+0000 7f7893fff700 1 -- 172.21.15.82:0/903871755 learned_addr learned my addr 172.21.15.82:0/903871755 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:30:40.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.618+0000 7f7898f9b700 1 --2- 172.21.15.82:0/903871755 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56327c8a7380 0x56327c8aaec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:40.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.618+0000 7f7893fff700 1 -- 172.21.15.82:0/903871755 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56327c8a7380 msgr2=0x56327c8aaec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:40.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.618+0000 7f7893fff700 1 --2- 172.21.15.82:0/903871755 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56327c8a7380 0x56327c8aaec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.618+0000 7f7893fff700 1 -- 172.21.15.82:0/903871755 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56327c8a7ca0 msgr2=0x56327c8ab600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:40.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.618+0000 7f7893fff700 1 --2- 172.21.15.82:0/903871755 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56327c8a7ca0 0x56327c8ab600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.618+0000 7f7893fff700 1 -- 172.21.15.82:0/903871755 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f788800b860 con 0x56327c8a1c40 2023-09-23T09:30:40.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.619+0000 7f7893fff700 1 --2- 172.21.15.82:0/903871755 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56327c8a1c40 0x56327c8adc40 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f7880005ca0 tx=0x7f7880005f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff0942a375cac580 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:40.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.619+0000 7f7873fff700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:30:40.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.619+0000 7f7873fff700 1 -- 172.21.15.82:0/903871755 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f788000be70 con 0x56327c8a1c40 2023-09-23T09:30:40.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.619+0000 7f7873fff700 1 -- 172.21.15.82:0/903871755 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(143..143 src has 1..143) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f7880003820 con 0x56327c8a1c40 2023-09-23T09:30:40.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.619+0000 7f78aeb7cb80 1 -- 172.21.15.82:0/903871755 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56327c8711c0 con 0x56327c8a1c40 2023-09-23T09:30:40.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.619+0000 7f7873fff700 1 -- 172.21.15.82:0/903871755 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=100) v2 ==== 24+0+0 (secure 0 0 0) 0x7f78800039e0 con 0x56327c8a1c40 2023-09-23T09:30:40.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.619+0000 7f78aeb7cb80 10 client.17625 fetch_fsmap learned FSMap version 100 2023-09-23T09:30:40.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.619+0000 7f78aeb7cb80 1 -- 172.21.15.82:0/903871755 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=100,monmap=4+}) v3 -- 0x7f789410e060 con 0x56327c8a1c40 2023-09-23T09:30:40.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.619+0000 7f7873fff700 1 -- 172.21.15.82:0/903871755 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56327c8711c0 con 0x56327c8a1c40 2023-09-23T09:30:40.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.620+0000 7f7873fff700 1 -- 172.21.15.82:0/903871755 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 100) v1 ==== 7946+0+0 (secure 0 0 0) 0x7f788000f8e0 con 0x56327c8a1c40 2023-09-23T09:30:40.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.620+0000 7f78aeb7cb80 10 client.17625 fetch_fsmap finished waiting for FSMap version 100 2023-09-23T09:30:40.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.620+0000 7f78aeb7cb80 10 client.17625 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2023-09-23T09:30:40.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.620+0000 7f78aeb7cb80 20 client.17625 populate_metadata read hostname 'smithi082' 2023-09-23T09:30:40.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.620+0000 7f78aeb7cb80 1 --2- 172.21.15.82:0/903871755 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x56327c8bb340 0x56327c8bd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:40.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.620+0000 7f78aeb7cb80 4 client.17625 mds_command: new command op to 24515 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:30:40.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.620+0000 7f78aeb7cb80 1 -- 172.21.15.82:0/903871755 --> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56327c799ba0 con 0x56327c8bb340 2023-09-23T09:30:40.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.620+0000 7f7898f9b700 1 --2- 172.21.15.82:0/903871755 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x56327c8bb340 0x56327c8bd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:40.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.621+0000 7f7898f9b700 1 --2- 172.21.15.82:0/903871755 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x56327c8bb340 0x56327c8bd760 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=6f454e47a118f18c server_cookie=1f853c5fca68f5bc in_seq=0 out_seq=0 2023-09-23T09:30:40.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.621+0000 7f7873fff700 10 client.17625 ms_handle_connect on v2:172.21.15.135:6836/2655304858 2023-09-23T09:30:40.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.622+0000 7f7873fff700 1 -- 172.21.15.82:0/903871755 <== mds.3 v2:172.21.15.135:6836/2655304858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56327c799ba0 con 0x56327c8bb340 2023-09-23T09:30:40.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.622+0000 7f7873fff700 10 client.17625 handle_command_reply: tid=0 2023-09-23T09:30:40.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.622+0000 7f78aeb7cb80 1 client.17625 shutdown 2023-09-23T09:30:40.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.622+0000 7f78aeb7cb80 1 -- 172.21.15.82:0/903871755 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56327c8a1c40 msgr2=0x56327c8adc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:40.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.622+0000 7f78aeb7cb80 1 --2- 172.21.15.82:0/903871755 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56327c8a1c40 0x56327c8adc40 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f7880005ca0 tx=0x7f7880005f10 comp rx=0 tx=0).stop 2023-09-23T09:30:40.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.622+0000 7f78aeb7cb80 1 -- 172.21.15.82:0/903871755 shutdown_connections 2023-09-23T09:30:40.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.622+0000 7f78aeb7cb80 1 --2- 172.21.15.82:0/903871755 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56327c8a7ca0 0x56327c8ab600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.622+0000 7f78aeb7cb80 1 --2- 172.21.15.82:0/903871755 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56327c8a1c40 0x56327c8adc40 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.622+0000 7f78aeb7cb80 1 --2- 172.21.15.82:0/903871755 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x56327c8bb340 0x56327c8bd760 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.622+0000 7f78aeb7cb80 1 --2- 172.21.15.82:0/903871755 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56327c8a7380 0x56327c8aaec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.622+0000 7f7873fff700 0 client.17625 ms_handle_reset on v2:172.21.15.135:6836/2655304858 2023-09-23T09:30:40.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.622+0000 7f78aeb7cb80 1 -- 172.21.15.82:0/903871755 >> 172.21.15.82:0/903871755 conn(0x56327c8160e0 msgr2=0x56327c896b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:40.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.622+0000 7f78aeb7cb80 1 -- 172.21.15.82:0/903871755 shutdown_connections 2023-09-23T09:30:40.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.622+0000 7f78aeb7cb80 1 -- 172.21.15.82:0/903871755 wait complete. 2023-09-23T09:30:40.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.622+0000 7f78aeb7cb80 20 client.17625 trim_cache size 0 max 16384 2023-09-23T09:30:40.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.635+0000 7f78aeb7cb80 1 Processor -- start 2023-09-23T09:30:40.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.635+0000 7f78aeb7cb80 1 -- start start 2023-09-23T09:30:40.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.636+0000 7f78aeb7cb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56327c8a1c40 0x56327c8a66b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:40.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.636+0000 7f78aeb7cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56327c8a7380 0x56327c8ad7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:40.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.636+0000 7f78aeb7cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56327c8a7ca0 0x56327c8aa680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:40.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.636+0000 7f78aeb7cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56327c8b8170 con 0x56327c8a7380 2023-09-23T09:30:40.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.636+0000 7f78aeb7cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56327c675920 con 0x56327c8a7ca0 2023-09-23T09:30:40.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.636+0000 7f78aeb7cb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x56327c8ac4a0 con 0x56327c8a1c40 2023-09-23T09:30:40.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.636+0000 7f7898f9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56327c8a7380 0x56327c8ad7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:40.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.636+0000 7f7898f9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56327c8a7380 0x56327c8ad7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36468/0 (socket says 172.21.15.82:36468) 2023-09-23T09:30:40.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.636+0000 7f7898f9b700 1 -- 172.21.15.82:0/270869002 learned_addr learned my addr 172.21.15.82:0/270869002 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:30:40.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.636+0000 7f7893fff700 1 --2- 172.21.15.82:0/270869002 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56327c8a1c40 0x56327c8a66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:40.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.636+0000 7f7893fff700 1 --2- 172.21.15.82:0/270869002 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56327c8a7ca0 0x56327c8aa680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:40.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.636+0000 7f7898f9b700 1 -- 172.21.15.82:0/270869002 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56327c8a1c40 msgr2=0x56327c8a66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:40.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.636+0000 7f7898f9b700 1 --2- 172.21.15.82:0/270869002 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56327c8a1c40 0x56327c8a66b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.636+0000 7f7898f9b700 1 -- 172.21.15.82:0/270869002 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56327c8a7ca0 msgr2=0x56327c8aa680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:40.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.636+0000 7f7898f9b700 1 --2- 172.21.15.82:0/270869002 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56327c8a7ca0 0x56327c8aa680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.637+0000 7f7898f9b700 1 -- 172.21.15.82:0/270869002 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56327c89df50 con 0x56327c8a7380 2023-09-23T09:30:40.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.637+0000 7f7893fff700 1 --2- 172.21.15.82:0/270869002 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56327c8a7ca0 0x56327c8aa680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:30:40.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.637+0000 7f7898f9b700 1 --2- 172.21.15.82:0/270869002 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56327c8a7380 0x56327c8ad7e0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x56327c8ac470 tx=0x7f788800b410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8e94c5855852c8a server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:40.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.637+0000 7f787f7fe700 1 -- 172.21.15.82:0/270869002 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7888016030 con 0x56327c8a7380 2023-09-23T09:30:40.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.637+0000 7f787f7fe700 1 -- 172.21.15.82:0/270869002 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7888017040 con 0x56327c8a7380 2023-09-23T09:30:40.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.637+0000 7f787f7fe700 1 -- 172.21.15.82:0/270869002 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7888005280 con 0x56327c8a7380 2023-09-23T09:30:40.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.638+0000 7f78aeb7cb80 1 -- 172.21.15.82:0/270869002 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56327c8a7380 msgr2=0x56327c8ad7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:40.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.638+0000 7f78aeb7cb80 1 --2- 172.21.15.82:0/270869002 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56327c8a7380 0x56327c8ad7e0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x56327c8ac470 tx=0x7f788800b410 comp rx=0 tx=0).stop 2023-09-23T09:30:40.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.638+0000 7f78aeb7cb80 1 -- 172.21.15.82:0/270869002 shutdown_connections 2023-09-23T09:30:40.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.638+0000 7f78aeb7cb80 1 --2- 172.21.15.82:0/270869002 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56327c8a7ca0 0x56327c8aa680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.638+0000 7f78aeb7cb80 1 --2- 172.21.15.82:0/270869002 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56327c8a1c40 0x56327c8a66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.638+0000 7f78aeb7cb80 1 --2- 172.21.15.82:0/270869002 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56327c8a7380 0x56327c8ad7e0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.638+0000 7f78aeb7cb80 1 -- 172.21.15.82:0/270869002 >> 172.21.15.82:0/270869002 conn(0x56327c8160e0 msgr2=0x56327c8a5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:40.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.638+0000 7f78aeb7cb80 1 -- 172.21.15.82:0/270869002 shutdown_connections 2023-09-23T09:30:40.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.638+0000 7f78aeb7cb80 1 -- 172.21.15.82:0/270869002 wait complete. 2023-09-23T09:30:40.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.638+0000 7f78aeb7cb80 1 -- start start 2023-09-23T09:30:40.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.638+0000 7f78aeb7cb80 1 Processor -- start 2023-09-23T09:30:40.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.639+0000 7f78aeb7cb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56327c8a1c40 0x56327c8b27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:40.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.639+0000 7f78aeb7cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56327c8a7380 0x56327c8a2f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:40.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.639+0000 7f78aeb7cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56327c8a7ca0 0x56327c8a3460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:40.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.639+0000 7f78aeb7cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56327c8a3a40 con 0x56327c8a7ca0 2023-09-23T09:30:40.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.639+0000 7f78aeb7cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56327c8a3bb0 con 0x56327c8a7380 2023-09-23T09:30:40.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.639+0000 7f78aeb7cb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x56327c8a3d70 con 0x56327c8a1c40 2023-09-23T09:30:40.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.639+0000 7f78aeb7cb80 10 client.0 _ll_register_callbacks cb 0x7f788800b730 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:30:40.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.639+0000 7f7893fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56327c8a7ca0 0x56327c8a3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:40.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.639+0000 7f7893fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56327c8a7ca0 0x56327c8a3460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36476/0 (socket says 172.21.15.82:36476) 2023-09-23T09:30:40.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.639+0000 7f7893fff700 1 -- 172.21.15.82:0/3663581145 learned_addr learned my addr 172.21.15.82:0/3663581145 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:30:40.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.639+0000 7f7898f9b700 1 --2- 172.21.15.82:0/3663581145 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56327c8a7380 0x56327c8a2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:40.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.639+0000 7f7893fff700 1 --2- 172.21.15.82:0/3663581145 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56327c8a1c40 0x56327c8b27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:40.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.639+0000 7f7893fff700 1 -- 172.21.15.82:0/3663581145 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56327c8a1c40 msgr2=0x56327c8b27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:40.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.639+0000 7f7893fff700 1 --2- 172.21.15.82:0/3663581145 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56327c8a1c40 0x56327c8b27d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.639+0000 7f7893fff700 1 -- 172.21.15.82:0/3663581145 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56327c8a7380 msgr2=0x56327c8a2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:40.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.639+0000 7f7893fff700 1 --2- 172.21.15.82:0/3663581145 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56327c8a7380 0x56327c8a2f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.639+0000 7f7893fff700 1 -- 172.21.15.82:0/3663581145 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f788801fa60 con 0x56327c8a7ca0 2023-09-23T09:30:40.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.640+0000 7f7893fff700 1 --2- 172.21.15.82:0/3663581145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56327c8a7ca0 0x56327c8a3460 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f7880005d10 tx=0x7f7880005f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba070da5e208affe server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:40.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.640+0000 7f7873fff700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:30:40.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.640+0000 7f7873fff700 1 -- 172.21.15.82:0/3663581145 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78800285f0 con 0x56327c8a7ca0 2023-09-23T09:30:40.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.640+0000 7f78aeb7cb80 1 -- 172.21.15.82:0/3663581145 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56327c8948b0 con 0x56327c8a7ca0 2023-09-23T09:30:40.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.640+0000 7f7873fff700 1 -- 172.21.15.82:0/3663581145 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(143..143 src has 1..143) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f7880000e40 con 0x56327c8a7ca0 2023-09-23T09:30:40.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.640+0000 7f7873fff700 1 -- 172.21.15.82:0/3663581145 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=100) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7880028750 con 0x56327c8a7ca0 2023-09-23T09:30:40.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.640+0000 7f78aeb7cb80 10 client.17631 fetch_fsmap learned FSMap version 100 2023-09-23T09:30:40.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.640+0000 7f78aeb7cb80 1 -- 172.21.15.82:0/3663581145 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=100,monmap=4+}) v3 -- 0x56327c61fde0 con 0x56327c8a7ca0 2023-09-23T09:30:40.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.640+0000 7f7873fff700 1 -- 172.21.15.82:0/3663581145 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56327c8948b0 con 0x56327c8a7ca0 2023-09-23T09:30:40.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.640+0000 7f7873fff700 1 -- 172.21.15.82:0/3663581145 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 100) v1 ==== 7946+0+0 (secure 0 0 0) 0x7f7880003af0 con 0x56327c8a7ca0 2023-09-23T09:30:40.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.640+0000 7f78aeb7cb80 10 client.17631 fetch_fsmap finished waiting for FSMap version 100 2023-09-23T09:30:40.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.640+0000 7f78aeb7cb80 10 client.17631 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2023-09-23T09:30:40.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.640+0000 7f78aeb7cb80 20 client.17631 populate_metadata read hostname 'smithi082' 2023-09-23T09:30:40.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.641+0000 7f78aeb7cb80 1 --2- 172.21.15.82:0/3663581145 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x56327c910260 0x56327c912650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:40.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.641+0000 7f78aeb7cb80 4 client.17631 mds_command: new command op to 24515 tid=0[{"prefix": "damage ls"}] 2023-09-23T09:30:40.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.641+0000 7f78aeb7cb80 1 -- 172.21.15.82:0/3663581145 --> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56327c7ec970 con 0x56327c910260 2023-09-23T09:30:40.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.641+0000 7f7898f9b700 1 --2- 172.21.15.82:0/3663581145 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x56327c910260 0x56327c912650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:40.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.641+0000 7f7873fff700 10 client.17631 ms_handle_connect on v2:172.21.15.135:6836/2655304858 2023-09-23T09:30:40.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.641+0000 7f7898f9b700 1 --2- 172.21.15.82:0/3663581145 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x56327c910260 0x56327c912650 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=2a001285ad805978 server_cookie=ad4dac1c578914b2 in_seq=0 out_seq=0 2023-09-23T09:30:40.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.642+0000 7f7873fff700 1 -- 172.21.15.82:0/3663581145 <== mds.3 v2:172.21.15.135:6836/2655304858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56327c7ec970 con 0x56327c910260 2023-09-23T09:30:40.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.642+0000 7f7873fff700 10 client.17631 handle_command_reply: tid=0 2023-09-23T09:30:40.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.642+0000 7f78aeb7cb80 1 client.17631 shutdown 2023-09-23T09:30:40.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.642+0000 7f78aeb7cb80 1 -- 172.21.15.82:0/3663581145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56327c8a7ca0 msgr2=0x56327c8a3460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:40.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.642+0000 7f78aeb7cb80 1 --2- 172.21.15.82:0/3663581145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56327c8a7ca0 0x56327c8a3460 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f7880005d10 tx=0x7f7880005f10 comp rx=0 tx=0).stop 2023-09-23T09:30:40.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.642+0000 7f78aeb7cb80 1 -- 172.21.15.82:0/3663581145 shutdown_connections 2023-09-23T09:30:40.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.642+0000 7f78aeb7cb80 1 --2- 172.21.15.82:0/3663581145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56327c8a7ca0 0x56327c8a3460 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.642+0000 7f78aeb7cb80 1 --2- 172.21.15.82:0/3663581145 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x56327c910260 0x56327c912650 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.642+0000 7f78aeb7cb80 1 --2- 172.21.15.82:0/3663581145 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56327c8a1c40 0x56327c8b27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.642+0000 7f78aeb7cb80 1 --2- 172.21.15.82:0/3663581145 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56327c8a7380 0x56327c8a2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.642+0000 7f7873fff700 0 client.17631 ms_handle_reset on v2:172.21.15.135:6836/2655304858 2023-09-23T09:30:40.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.642+0000 7f78aeb7cb80 1 -- 172.21.15.82:0/3663581145 >> 172.21.15.82:0/3663581145 conn(0x56327c8160e0 msgr2=0x56327c8a6830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:40.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.642+0000 7f78aeb7cb80 1 -- 172.21.15.82:0/3663581145 shutdown_connections 2023-09-23T09:30:40.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.642+0000 7f78aeb7cb80 1 -- 172.21.15.82:0/3663581145 wait complete. 2023-09-23T09:30:40.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.642+0000 7f78aeb7cb80 20 client.17631 trim_cache size 0 max 16384 2023-09-23T09:30:40.649 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2023-09-23T09:30:40.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.643+0000 7f789b1ff700 1 -- 172.21.15.82:0/3487584215 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f78840a00c0 msgr2=0x7f78840a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:40.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.643+0000 7f789b1ff700 1 --2- 172.21.15.82:0/3487584215 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f78840a00c0 0x7f78840a2580 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f788c0cbaa0 tx=0x7f788c098f00 comp rx=0 tx=0).stop 2023-09-23T09:30:40.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.643+0000 7f789b1ff700 1 -- 172.21.15.82:0/3487584215 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78941068a0 msgr2=0x7f7894198880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:40.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.643+0000 7f789b1ff700 1 --2- 172.21.15.82:0/3487584215 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78941068a0 0x7f7894198880 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f788c007d70 tx=0x7f788c00a340 comp rx=0 tx=0).stop 2023-09-23T09:30:40.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.643+0000 7f789b1ff700 1 -- 172.21.15.82:0/3487584215 shutdown_connections 2023-09-23T09:30:40.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.643+0000 7f789b1ff700 1 --2- 172.21.15.82:0/3487584215 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f78840a00c0 0x7f78840a2580 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.643+0000 7f789b1ff700 1 --2- 172.21.15.82:0/3487584215 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78941068a0 0x7f7894198880 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.643+0000 7f789b1ff700 1 --2- 172.21.15.82:0/3487584215 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7894100890 0x7f789419e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.643+0000 7f789b1ff700 1 --2- 172.21.15.82:0/3487584215 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7894101250 0x7f789419ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.643+0000 7f789b1ff700 1 -- 172.21.15.82:0/3487584215 >> 172.21.15.82:0/3487584215 conn(0x7f78940fc380 msgr2=0x7f789410bc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:40.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.643+0000 7f789b1ff700 1 -- 172.21.15.82:0/3487584215 shutdown_connections 2023-09-23T09:30:40.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.643+0000 7f789b1ff700 1 -- 172.21.15.82:0/3487584215 wait complete. 2023-09-23T09:30:40.662 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-09-23T09:30:40.828 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 210.0 s, 307.2 tps, lat 246.055 ms stddev 534.462 2023-09-23T09:30:40.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.865+0000 7fdb453ff700 1 -- 172.21.15.82:0/1638782311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb400ff540 msgr2=0x7fdb401055a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:40.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.865+0000 7fdb453ff700 1 --2- 172.21.15.82:0/1638782311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb400ff540 0x7fdb401055a0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fdb340099c0 tx=0x7fdb34009cd0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.865+0000 7fdb453ff700 1 -- 172.21.15.82:0/1638782311 shutdown_connections 2023-09-23T09:30:40.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.865+0000 7fdb453ff700 1 --2- 172.21.15.82:0/1638782311 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdb40105cd0 0x7fdb4010d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.865+0000 7fdb453ff700 1 --2- 172.21.15.82:0/1638782311 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdb400feb90 0x7fdb400fef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.865+0000 7fdb453ff700 1 --2- 172.21.15.82:0/1638782311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb400ff540 0x7fdb401055a0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.865+0000 7fdb453ff700 1 -- 172.21.15.82:0/1638782311 >> 172.21.15.82:0/1638782311 conn(0x7fdb40076910 msgr2=0x7fdb400fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:40.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.866+0000 7fdb453ff700 1 -- 172.21.15.82:0/1638782311 shutdown_connections 2023-09-23T09:30:40.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.866+0000 7fdb453ff700 1 -- 172.21.15.82:0/1638782311 wait complete. 2023-09-23T09:30:40.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.867+0000 7fdb453ff700 1 Processor -- start 2023-09-23T09:30:40.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.868+0000 7fdb453ff700 1 -- start start 2023-09-23T09:30:40.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.868+0000 7fdb453ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdb400feb90 0x7fdb4019e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:40.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.868+0000 7fdb453ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdb40105cd0 0x7fdb4019ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:40.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.868+0000 7fdb453ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb40198910 0x7fdb40198dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:40.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.868+0000 7fdb453ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb40199390 con 0x7fdb40198910 2023-09-23T09:30:40.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.868+0000 7fdb453ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb401994d0 con 0x7fdb400feb90 2023-09-23T09:30:40.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.868+0000 7fdb453ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb40199690 con 0x7fdb40105cd0 2023-09-23T09:30:40.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.869+0000 7fdb3e7fc700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdb40105cd0 0x7fdb4019ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:40.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.869+0000 7fdb3e7fc700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdb40105cd0 0x7fdb4019ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:48984/0 (socket says 172.21.15.82:48984) 2023-09-23T09:30:40.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.869+0000 7fdb3e7fc700 1 -- 172.21.15.82:0/2765544390 learned_addr learned my addr 172.21.15.82:0/2765544390 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:30:40.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.869+0000 7fdb3effd700 1 --2- 172.21.15.82:0/2765544390 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdb400feb90 0x7fdb4019e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:40.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.869+0000 7fdb3f7fe700 1 --2- 172.21.15.82:0/2765544390 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb40198910 0x7fdb40198dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:40.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.869+0000 7fdb3e7fc700 1 -- 172.21.15.82:0/2765544390 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdb400feb90 msgr2=0x7fdb4019e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:40.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.869+0000 7fdb3e7fc700 1 --2- 172.21.15.82:0/2765544390 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdb400feb90 0x7fdb4019e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.869+0000 7fdb3e7fc700 1 -- 172.21.15.82:0/2765544390 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb40198910 msgr2=0x7fdb40198dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:40.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.869+0000 7fdb3e7fc700 1 --2- 172.21.15.82:0/2765544390 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb40198910 0x7fdb40198dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.869+0000 7fdb3e7fc700 1 -- 172.21.15.82:0/2765544390 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb340095f0 con 0x7fdb40105cd0 2023-09-23T09:30:40.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.870+0000 7fdb3e7fc700 1 --2- 172.21.15.82:0/2765544390 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdb40105cd0 0x7fdb4019ede0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fdb3400f690 tx=0x7fdb3400f6c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:40.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.870+0000 7fdb27fff700 1 -- 172.21.15.82:0/2765544390 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb3401d070 con 0x7fdb40105cd0 2023-09-23T09:30:40.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.870+0000 7fdb27fff700 1 -- 172.21.15.82:0/2765544390 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdb34005050 con 0x7fdb40105cd0 2023-09-23T09:30:40.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.870+0000 7fdb27fff700 1 -- 172.21.15.82:0/2765544390 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb34004a70 con 0x7fdb40105cd0 2023-09-23T09:30:40.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.871+0000 7fdb453ff700 1 -- 172.21.15.82:0/2765544390 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb401a56b0 con 0x7fdb40105cd0 2023-09-23T09:30:40.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.871+0000 7fdb453ff700 1 -- 172.21.15.82:0/2765544390 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb401a5ae0 con 0x7fdb40105cd0 2023-09-23T09:30:40.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.876+0000 7fdb27fff700 1 -- 172.21.15.82:0/2765544390 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7fdb340051c0 con 0x7fdb40105cd0 2023-09-23T09:30:40.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.877+0000 7fdb58d29b80 1 Processor -- start 2023-09-23T09:30:40.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.877+0000 7fdb58d29b80 1 -- start start 2023-09-23T09:30:40.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.878+0000 7fdb58d29b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624ef996100 0x5624ef9964e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:40.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.878+0000 7fdb58d29b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5624ef996a20 0x5624ef99a790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:40.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.878+0000 7fdb58d29b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5624ef99acd0 0x5624ef99b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:40.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.878+0000 7fdb58d29b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624ef8f57b0 con 0x5624ef996a20 2023-09-23T09:30:40.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.878+0000 7fdb58d29b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624ef8e6780 con 0x5624ef996100 2023-09-23T09:30:40.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.878+0000 7fdb58d29b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624ef8e40a0 con 0x5624ef99acd0 2023-09-23T09:30:40.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.879+0000 7fdb3f7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624ef996100 0x5624ef9964e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:40.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.879+0000 7fdb3effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5624ef996a20 0x5624ef99a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:40.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.879+0000 7fdb3f7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624ef996100 0x5624ef9964e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:59484/0 (socket says 172.21.15.82:59484) 2023-09-23T09:30:40.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.879+0000 7fdb3f7fe700 1 -- 172.21.15.82:0/2770711592 learned_addr learned my addr 172.21.15.82:0/2770711592 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:30:40.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.879+0000 7fdb3e7fc700 1 --2- 172.21.15.82:0/2770711592 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5624ef99acd0 0x5624ef99b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:40.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.879+0000 7fdb3effd700 1 -- 172.21.15.82:0/2770711592 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5624ef99acd0 msgr2=0x5624ef99b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:40.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.879+0000 7fdb3effd700 1 --2- 172.21.15.82:0/2770711592 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5624ef99acd0 0x5624ef99b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.879+0000 7fdb3effd700 1 -- 172.21.15.82:0/2770711592 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624ef996100 msgr2=0x5624ef9964e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:40.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.879+0000 7fdb3effd700 1 --2- 172.21.15.82:0/2770711592 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624ef996100 0x5624ef9964e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.879+0000 7fdb3effd700 1 -- 172.21.15.82:0/2770711592 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5624ef75f630 con 0x5624ef996a20 2023-09-23T09:30:40.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.879+0000 7fdb27fff700 1 --2- 172.21.15.82:0/2765544390 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fdb280a0140 0x7fdb280a2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:40.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.879+0000 7fdb27fff700 1 -- 172.21.15.82:0/2765544390 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fdb340cc2f0 con 0x7fdb40105cd0 2023-09-23T09:30:40.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.880+0000 7fdb3effd700 1 --2- 172.21.15.82:0/2770711592 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5624ef996a20 0x5624ef99a790 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fdb30009c80 tx=0x7fdb30009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f1b89a57567d8ad server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:40.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.880+0000 7fdb3f7fe700 1 --2- 172.21.15.82:0/2765544390 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fdb280a0140 0x7fdb280a2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:40.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.880+0000 7fdb257fa700 1 -- 172.21.15.82:0/2770711592 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb30011cb0 con 0x5624ef996a20 2023-09-23T09:30:40.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.880+0000 7fdb257fa700 1 -- 172.21.15.82:0/2770711592 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdb30011e10 con 0x5624ef996a20 2023-09-23T09:30:40.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.880+0000 7fdb257fa700 1 -- 172.21.15.82:0/2770711592 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb30005020 con 0x5624ef996a20 2023-09-23T09:30:40.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.881+0000 7fdb58d29b80 1 -- 172.21.15.82:0/2770711592 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5624ef996a20 msgr2=0x5624ef99a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:40.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.881+0000 7fdb58d29b80 1 --2- 172.21.15.82:0/2770711592 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5624ef996a20 0x5624ef99a790 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fdb30009c80 tx=0x7fdb30009f90 comp rx=0 tx=0).stop 2023-09-23T09:30:40.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.881+0000 7fdb3f7fe700 1 --2- 172.21.15.82:0/2765544390 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fdb280a0140 0x7fdb280a2600 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fdb380075c0 tx=0x7fdb3800b040 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:40.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.882+0000 7fdb58d29b80 1 -- 172.21.15.82:0/2770711592 shutdown_connections 2023-09-23T09:30:40.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.882+0000 7fdb58d29b80 1 --2- 172.21.15.82:0/2770711592 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5624ef99acd0 0x5624ef99b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.882+0000 7fdb58d29b80 1 --2- 172.21.15.82:0/2770711592 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624ef996100 0x5624ef9964e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.882+0000 7fdb58d29b80 1 --2- 172.21.15.82:0/2770711592 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5624ef996a20 0x5624ef99a790 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.882+0000 7fdb58d29b80 1 -- 172.21.15.82:0/2770711592 >> 172.21.15.82:0/2770711592 conn(0x5624ef9020e0 msgr2=0x5624ef988410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:40.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.883+0000 7fdb58d29b80 1 -- 172.21.15.82:0/2770711592 shutdown_connections 2023-09-23T09:30:40.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.883+0000 7fdb58d29b80 1 -- 172.21.15.82:0/2770711592 wait complete. 2023-09-23T09:30:40.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.884+0000 7fdb58d29b80 1 -- start start 2023-09-23T09:30:40.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.884+0000 7fdb58d29b80 1 Processor -- start 2023-09-23T09:30:40.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.885+0000 7fdb58d29b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5624ef996100 0x5624ef9a2460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:40.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.885+0000 7fdb58d29b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624ef996a20 0x5624ef99f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:40.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.885+0000 7fdb58d29b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5624ef99acd0 0x5624ef99fd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:40.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.885+0000 7fdb58d29b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624ef8df990 con 0x5624ef996100 2023-09-23T09:30:40.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.885+0000 7fdb58d29b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624ef87dbb0 con 0x5624ef996a20 2023-09-23T09:30:40.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.885+0000 7fdb58d29b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624ef87d8b0 con 0x5624ef99acd0 2023-09-23T09:30:40.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.885+0000 7fdb58d29b80 10 client.0 _ll_register_callbacks cb 0x5624ef7c7a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:30:40.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.885+0000 7fdb3effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5624ef996100 0x5624ef9a2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:40.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.885+0000 7fdb3effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5624ef996100 0x5624ef9a2460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36510/0 (socket says 172.21.15.82:36510) 2023-09-23T09:30:40.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.885+0000 7fdb3effd700 1 -- 172.21.15.82:0/3969824563 learned_addr learned my addr 172.21.15.82:0/3969824563 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:30:40.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.886+0000 7fdb3e7fc700 1 --2- 172.21.15.82:0/3969824563 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624ef996a20 0x5624ef99f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:40.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.886+0000 7fdb3f7fe700 1 --2- 172.21.15.82:0/3969824563 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5624ef99acd0 0x5624ef99fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:40.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.886+0000 7fdb3effd700 1 -- 172.21.15.82:0/3969824563 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5624ef99acd0 msgr2=0x5624ef99fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:40.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.886+0000 7fdb3effd700 1 --2- 172.21.15.82:0/3969824563 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5624ef99acd0 0x5624ef99fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.886+0000 7fdb3effd700 1 -- 172.21.15.82:0/3969824563 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624ef996a20 msgr2=0x5624ef99f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:40.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.886+0000 7fdb3effd700 1 --2- 172.21.15.82:0/3969824563 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624ef996a20 0x5624ef99f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.886+0000 7fdb3effd700 1 -- 172.21.15.82:0/3969824563 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb300098e0 con 0x5624ef996100 2023-09-23T09:30:40.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.886+0000 7fdb3f7fe700 1 --2- 172.21.15.82:0/3969824563 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5624ef99acd0 0x5624ef99fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:30:40.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.887+0000 7fdb3effd700 1 --2- 172.21.15.82:0/3969824563 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5624ef996100 0x5624ef9a2460 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fdb30011ca0 tx=0x7fdb30011cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=960926058d1c3388 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:40.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.887+0000 7fdb22ff5700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:30:40.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.887+0000 7fdb22ff5700 1 -- 172.21.15.82:0/3969824563 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb30019640 con 0x5624ef996100 2023-09-23T09:30:40.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.887+0000 7fdb22ff5700 1 -- 172.21.15.82:0/3969824563 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(143..143 src has 1..143) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fdb300197a0 con 0x5624ef996100 2023-09-23T09:30:40.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.887+0000 7fdb58d29b80 1 -- 172.21.15.82:0/3969824563 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5624ef95d1c0 con 0x5624ef996100 2023-09-23T09:30:40.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.888+0000 7fdb22ff5700 1 -- 172.21.15.82:0/3969824563 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=100) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdb30019960 con 0x5624ef996100 2023-09-23T09:30:40.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.888+0000 7fdb58d29b80 10 client.17643 fetch_fsmap learned FSMap version 100 2023-09-23T09:30:40.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.888+0000 7fdb58d29b80 1 -- 172.21.15.82:0/3969824563 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=100,monmap=4+}) v3 -- 0x5624ef70bde0 con 0x5624ef996100 2023-09-23T09:30:40.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.889+0000 7fdb22ff5700 1 -- 172.21.15.82:0/3969824563 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5624ef95d1c0 con 0x5624ef996100 2023-09-23T09:30:40.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.889+0000 7fdb22ff5700 1 -- 172.21.15.82:0/3969824563 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 100) v1 ==== 7946+0+0 (secure 0 0 0) 0x7fdb30022bf0 con 0x5624ef996100 2023-09-23T09:30:40.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.889+0000 7fdb58d29b80 10 client.17643 fetch_fsmap finished waiting for FSMap version 100 2023-09-23T09:30:40.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.889+0000 7fdb58d29b80 10 client.17643 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-09-23T09:30:40.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.889+0000 7fdb58d29b80 20 client.17643 populate_metadata read hostname 'smithi082' 2023-09-23T09:30:40.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.889+0000 7fdb58d29b80 1 --2- 172.21.15.82:0/3969824563 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x5624ef9afda0 0x5624ef9b21c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:40.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.889+0000 7fdb58d29b80 4 client.17643 mds_command: new command op to 24526 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:30:40.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.889+0000 7fdb58d29b80 1 -- 172.21.15.82:0/3969824563 --> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5624ef885ba0 con 0x5624ef9afda0 2023-09-23T09:30:40.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.890+0000 7fdb3e7fc700 1 --2- 172.21.15.82:0/3969824563 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x5624ef9afda0 0x5624ef9b21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:40.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.890+0000 7fdb3e7fc700 1 --2- 172.21.15.82:0/3969824563 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x5624ef9afda0 0x5624ef9b21c0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4698d0209aae19e8 server_cookie=7739d5e88f2f913f in_seq=0 out_seq=0 2023-09-23T09:30:40.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.890+0000 7fdb22ff5700 10 client.17643 ms_handle_connect on v2:172.21.15.161:6836/43639843 2023-09-23T09:30:40.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.891+0000 7fdb22ff5700 1 -- 172.21.15.82:0/3969824563 <== mds.2 v2:172.21.15.161:6836/43639843 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5624ef885ba0 con 0x5624ef9afda0 2023-09-23T09:30:40.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.891+0000 7fdb22ff5700 10 client.17643 handle_command_reply: tid=0 2023-09-23T09:30:40.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.892+0000 7fdb58d29b80 1 client.17643 shutdown 2023-09-23T09:30:40.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.892+0000 7fdb58d29b80 1 -- 172.21.15.82:0/3969824563 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5624ef996100 msgr2=0x5624ef9a2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:40.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.892+0000 7fdb58d29b80 1 --2- 172.21.15.82:0/3969824563 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5624ef996100 0x5624ef9a2460 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fdb30011ca0 tx=0x7fdb30011cd0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.892+0000 7fdb58d29b80 1 -- 172.21.15.82:0/3969824563 shutdown_connections 2023-09-23T09:30:40.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.892+0000 7fdb58d29b80 1 --2- 172.21.15.82:0/3969824563 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x5624ef9afda0 0x5624ef9b21c0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.892+0000 7fdb58d29b80 1 --2- 172.21.15.82:0/3969824563 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5624ef99acd0 0x5624ef99fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.892+0000 7fdb58d29b80 1 --2- 172.21.15.82:0/3969824563 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5624ef996100 0x5624ef9a2460 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.892+0000 7fdb58d29b80 1 --2- 172.21.15.82:0/3969824563 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624ef996a20 0x5624ef99f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.892+0000 7fdb22ff5700 0 client.17643 ms_handle_reset on v2:172.21.15.161:6836/43639843 2023-09-23T09:30:40.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.892+0000 7fdb58d29b80 1 -- 172.21.15.82:0/3969824563 >> 172.21.15.82:0/3969824563 conn(0x5624ef9020e0 msgr2=0x5624ef9822b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:40.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.893+0000 7fdb58d29b80 1 -- 172.21.15.82:0/3969824563 shutdown_connections 2023-09-23T09:30:40.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.893+0000 7fdb58d29b80 1 -- 172.21.15.82:0/3969824563 wait complete. 2023-09-23T09:30:40.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.894+0000 7fdb58d29b80 20 client.17643 trim_cache size 0 max 16384 2023-09-23T09:30:40.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.918+0000 7fdb58d29b80 1 Processor -- start 2023-09-23T09:30:40.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.919+0000 7fdb58d29b80 1 -- start start 2023-09-23T09:30:40.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.919+0000 7fdb58d29b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624ef996100 0x5624ef99f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:40.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.919+0000 7fdb58d29b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5624ef996a20 0x5624ef9a6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:40.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.919+0000 7fdb58d29b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5624ef99acd0 0x5624ef99c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:40.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.919+0000 7fdb58d29b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624ef761920 con 0x5624ef99acd0 2023-09-23T09:30:40.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.919+0000 7fdb58d29b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624ef989150 con 0x5624ef996100 2023-09-23T09:30:40.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.919+0000 7fdb58d29b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624ef984810 con 0x5624ef996a20 2023-09-23T09:30:40.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.919+0000 7fdb3effd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624ef996100 0x5624ef99f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:40.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.919+0000 7fdb3f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5624ef99acd0 0x5624ef99c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:40.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.919+0000 7fdb3effd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624ef996100 0x5624ef99f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:59498/0 (socket says 172.21.15.82:59498) 2023-09-23T09:30:40.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.920+0000 7fdb3effd700 1 -- 172.21.15.82:0/965809405 learned_addr learned my addr 172.21.15.82:0/965809405 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:30:40.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.920+0000 7fdb3e7fc700 1 --2- 172.21.15.82:0/965809405 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5624ef996a20 0x5624ef9a6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:40.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.920+0000 7fdb3effd700 1 -- 172.21.15.82:0/965809405 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5624ef996a20 msgr2=0x5624ef9a6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:40.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.920+0000 7fdb3effd700 1 --2- 172.21.15.82:0/965809405 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5624ef996a20 0x5624ef9a6fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.920+0000 7fdb3effd700 1 -- 172.21.15.82:0/965809405 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5624ef99acd0 msgr2=0x5624ef99c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:40.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.920+0000 7fdb3effd700 1 --2- 172.21.15.82:0/965809405 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5624ef99acd0 0x5624ef99c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.920+0000 7fdb3effd700 1 -- 172.21.15.82:0/965809405 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5624ef6f4c60 con 0x5624ef996100 2023-09-23T09:30:40.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.921+0000 7fdb3effd700 1 --2- 172.21.15.82:0/965809405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624ef996100 0x5624ef99f6e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fdb30022fb0 tx=0x7fdb30004690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a151ab8c6c66ed21 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:40.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.921+0000 7fdb25ffb700 1 -- 172.21.15.82:0/965809405 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb30011720 con 0x5624ef996100 2023-09-23T09:30:40.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.921+0000 7fdb25ffb700 1 -- 172.21.15.82:0/965809405 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdb30011d40 con 0x5624ef996100 2023-09-23T09:30:40.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.921+0000 7fdb25ffb700 1 -- 172.21.15.82:0/965809405 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb30019b40 con 0x5624ef996100 2023-09-23T09:30:40.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.922+0000 7fdb58d29b80 1 -- 172.21.15.82:0/965809405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624ef996100 msgr2=0x5624ef99f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:40.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.922+0000 7fdb58d29b80 1 --2- 172.21.15.82:0/965809405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624ef996100 0x5624ef99f6e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fdb30022fb0 tx=0x7fdb30004690 comp rx=0 tx=0).stop 2023-09-23T09:30:40.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.922+0000 7fdb58d29b80 1 -- 172.21.15.82:0/965809405 shutdown_connections 2023-09-23T09:30:40.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.922+0000 7fdb58d29b80 1 --2- 172.21.15.82:0/965809405 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5624ef99acd0 0x5624ef99c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.922+0000 7fdb58d29b80 1 --2- 172.21.15.82:0/965809405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624ef996100 0x5624ef99f6e0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.922+0000 7fdb58d29b80 1 --2- 172.21.15.82:0/965809405 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5624ef996a20 0x5624ef9a6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.922+0000 7fdb58d29b80 1 -- 172.21.15.82:0/965809405 >> 172.21.15.82:0/965809405 conn(0x5624ef9020e0 msgr2=0x5624ef99efd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:40.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.922+0000 7fdb58d29b80 1 -- 172.21.15.82:0/965809405 shutdown_connections 2023-09-23T09:30:40.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.922+0000 7fdb58d29b80 1 -- 172.21.15.82:0/965809405 wait complete. 2023-09-23T09:30:40.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.923+0000 7fdb58d29b80 1 -- start start 2023-09-23T09:30:40.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.923+0000 7fdb58d29b80 1 Processor -- start 2023-09-23T09:30:40.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.924+0000 7fdb58d29b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624ef996100 0x5624ef9a2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:40.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.924+0000 7fdb58d29b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5624ef996a20 0x5624ef9a34e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:40.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.924+0000 7fdb58d29b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5624ef99acd0 0x5624ef9a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:40.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.924+0000 7fdb58d29b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624ef9a7500 con 0x5624ef99acd0 2023-09-23T09:30:40.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.924+0000 7fdb58d29b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624efa02bc0 con 0x5624ef996100 2023-09-23T09:30:40.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.924+0000 7fdb58d29b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624efa02d00 con 0x5624ef996a20 2023-09-23T09:30:40.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.924+0000 7fdb58d29b80 10 client.0 _ll_register_callbacks cb 0x7fdb38009f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:30:40.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.925+0000 7fdb3effd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624ef996100 0x5624ef9a2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:40.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.925+0000 7fdb3f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5624ef99acd0 0x5624ef9a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:40.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.925+0000 7fdb3effd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624ef996100 0x5624ef9a2fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:59502/0 (socket says 172.21.15.82:59502) 2023-09-23T09:30:40.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.925+0000 7fdb3effd700 1 -- 172.21.15.82:0/1859703068 learned_addr learned my addr 172.21.15.82:0/1859703068 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:30:40.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.925+0000 7fdb3e7fc700 1 --2- 172.21.15.82:0/1859703068 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5624ef996a20 0x5624ef9a34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:40.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.925+0000 7fdb3effd700 1 -- 172.21.15.82:0/1859703068 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5624ef996a20 msgr2=0x5624ef9a34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:40.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.925+0000 7fdb3effd700 1 --2- 172.21.15.82:0/1859703068 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5624ef996a20 0x5624ef9a34e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.925+0000 7fdb3effd700 1 -- 172.21.15.82:0/1859703068 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5624ef99acd0 msgr2=0x5624ef9a3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:40.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.925+0000 7fdb3effd700 1 --2- 172.21.15.82:0/1859703068 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5624ef99acd0 0x5624ef9a3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.925+0000 7fdb3effd700 1 -- 172.21.15.82:0/1859703068 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5624ef70bde0 con 0x5624ef996100 2023-09-23T09:30:40.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.925+0000 7fdb3e7fc700 1 --2- 172.21.15.82:0/1859703068 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5624ef996a20 0x5624ef9a34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T09:30:40.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.925+0000 7fdb3effd700 1 --2- 172.21.15.82:0/1859703068 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624ef996100 0x5624ef9a2fa0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fdb300183a0 tx=0x7fdb30018f30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f363d0d2eeba21c9 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:40.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.926+0000 7fdb22ff5700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-09-23T09:30:40.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.926+0000 7fdb22ff5700 1 -- 172.21.15.82:0/1859703068 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb30018730 con 0x5624ef996100 2023-09-23T09:30:40.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.926+0000 7fdb22ff5700 1 -- 172.21.15.82:0/1859703068 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(143..143 src has 1..143) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fdb30018b30 con 0x5624ef996100 2023-09-23T09:30:40.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.926+0000 7fdb58d29b80 1 -- 172.21.15.82:0/1859703068 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5624ef9808b0 con 0x5624ef996100 2023-09-23T09:30:40.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.927+0000 7fdb22ff5700 1 -- 172.21.15.82:0/1859703068 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=100) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdb30018cf0 con 0x5624ef996100 2023-09-23T09:30:40.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.927+0000 7fdb58d29b80 10 client.27326 fetch_fsmap learned FSMap version 100 2023-09-23T09:30:40.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.927+0000 7fdb58d29b80 1 -- 172.21.15.82:0/1859703068 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=100,monmap=4+}) v3 -- 0x5624ef732250 con 0x5624ef996100 2023-09-23T09:30:40.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.927+0000 7fdb22ff5700 1 -- 172.21.15.82:0/1859703068 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5624ef9808b0 con 0x5624ef996100 2023-09-23T09:30:40.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.927+0000 7fdb22ff5700 1 -- 172.21.15.82:0/1859703068 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 100) v1 ==== 7946+0+0 (secure 0 0 0) 0x7fdb3003e030 con 0x5624ef996100 2023-09-23T09:30:40.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.927+0000 7fdb58d29b80 10 client.27326 fetch_fsmap finished waiting for FSMap version 100 2023-09-23T09:30:40.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.927+0000 7fdb58d29b80 10 client.27326 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-09-23T09:30:40.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.927+0000 7fdb58d29b80 20 client.27326 populate_metadata read hostname 'smithi082' 2023-09-23T09:30:40.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.927+0000 7fdb58d29b80 1 --2- 172.21.15.82:0/1859703068 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x5624efa03fa0 0x5624efa063c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:40.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.927+0000 7fdb58d29b80 4 client.27326 mds_command: new command op to 24526 tid=0[{"prefix": "damage ls"}] 2023-09-23T09:30:40.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.927+0000 7fdb58d29b80 1 -- 172.21.15.82:0/1859703068 --> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5624ef8d8970 con 0x5624efa03fa0 2023-09-23T09:30:40.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.928+0000 7fdb3e7fc700 1 --2- 172.21.15.82:0/1859703068 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x5624efa03fa0 0x5624efa063c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:40.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.931+0000 7fdb3e7fc700 1 --2- 172.21.15.82:0/1859703068 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x5624efa03fa0 0x5624efa063c0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=80cdac06fa7d5d0a server_cookie=d0d3ae4d2f652ff3 in_seq=0 out_seq=0 2023-09-23T09:30:40.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.931+0000 7fdb22ff5700 10 client.27326 ms_handle_connect on v2:172.21.15.161:6836/43639843 2023-09-23T09:30:40.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.937+0000 7fdb22ff5700 1 -- 172.21.15.82:0/1859703068 <== mds.2 v2:172.21.15.161:6836/43639843 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5624ef8d8970 con 0x5624efa03fa0 2023-09-23T09:30:40.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.937+0000 7fdb22ff5700 10 client.27326 handle_command_reply: tid=0 2023-09-23T09:30:40.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.938+0000 7fdb58d29b80 1 client.27326 shutdown 2023-09-23T09:30:40.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.945+0000 7fdb58d29b80 1 -- 172.21.15.82:0/1859703068 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624ef996100 msgr2=0x5624ef9a2fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:40.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.945+0000 7fdb58d29b80 1 --2- 172.21.15.82:0/1859703068 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624ef996100 0x5624ef9a2fa0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fdb300183a0 tx=0x7fdb30018f30 comp rx=0 tx=0).stop 2023-09-23T09:30:40.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.949+0000 7fdb58d29b80 1 -- 172.21.15.82:0/1859703068 shutdown_connections 2023-09-23T09:30:40.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.949+0000 7fdb58d29b80 1 --2- 172.21.15.82:0/1859703068 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x5624efa03fa0 0x5624efa063c0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.949+0000 7fdb58d29b80 1 --2- 172.21.15.82:0/1859703068 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5624ef99acd0 0x5624ef9a3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.949+0000 7fdb58d29b80 1 --2- 172.21.15.82:0/1859703068 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624ef996100 0x5624ef9a2fa0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.949+0000 7fdb58d29b80 1 --2- 172.21.15.82:0/1859703068 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5624ef996a20 0x5624ef9a34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.949+0000 7fdb58d29b80 1 -- 172.21.15.82:0/1859703068 >> 172.21.15.82:0/1859703068 conn(0x5624ef9020e0 msgr2=0x5624ef99d0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:40.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.950+0000 7fdb22ff5700 0 client.27326 ms_handle_reset on v2:172.21.15.161:6836/43639843 2023-09-23T09:30:40.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.951+0000 7fdb58d29b80 1 -- 172.21.15.82:0/1859703068 shutdown_connections 2023-09-23T09:30:40.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.955+0000 7fdb58d29b80 1 -- 172.21.15.82:0/1859703068 wait complete. 2023-09-23T09:30:40.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.961+0000 7fdb58d29b80 20 client.27326 trim_cache size 0 max 16384 2023-09-23T09:30:40.963 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2023-09-23T09:30:40.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.963+0000 7fdb453ff700 1 -- 172.21.15.82:0/2765544390 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fdb280a0140 msgr2=0x7fdb280a2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:40.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.963+0000 7fdb453ff700 1 --2- 172.21.15.82:0/2765544390 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fdb280a0140 0x7fdb280a2600 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fdb380075c0 tx=0x7fdb3800b040 comp rx=0 tx=0).stop 2023-09-23T09:30:40.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.963+0000 7fdb453ff700 1 -- 172.21.15.82:0/2765544390 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdb40105cd0 msgr2=0x7fdb4019ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:40.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.963+0000 7fdb453ff700 1 --2- 172.21.15.82:0/2765544390 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdb40105cd0 0x7fdb4019ede0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fdb3400f690 tx=0x7fdb3400f6c0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.963+0000 7fdb453ff700 1 -- 172.21.15.82:0/2765544390 shutdown_connections 2023-09-23T09:30:40.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.963+0000 7fdb453ff700 1 --2- 172.21.15.82:0/2765544390 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fdb280a0140 0x7fdb280a2600 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.963+0000 7fdb453ff700 1 --2- 172.21.15.82:0/2765544390 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb40198910 0x7fdb40198dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.963+0000 7fdb453ff700 1 --2- 172.21.15.82:0/2765544390 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdb400feb90 0x7fdb4019e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.963+0000 7fdb453ff700 1 --2- 172.21.15.82:0/2765544390 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdb40105cd0 0x7fdb4019ede0 secure :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fdb3400f690 tx=0x7fdb3400f6c0 comp rx=0 tx=0).stop 2023-09-23T09:30:40.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.963+0000 7fdb453ff700 1 -- 172.21.15.82:0/2765544390 >> 172.21.15.82:0/2765544390 conn(0x7fdb40076910 msgr2=0x7fdb401046e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:40.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.964+0000 7fdb453ff700 1 -- 172.21.15.82:0/2765544390 shutdown_connections 2023-09-23T09:30:40.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:40.964+0000 7fdb453ff700 1 -- 172.21.15.82:0/2765544390 wait complete. 2023-09-23T09:30:40.997 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-09-23T09:30:41.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.353+0000 7f290e5ff700 1 -- 172.21.15.82:0/2498863219 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2908106880 msgr2=0x7f2908106c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:41.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.353+0000 7f290e5ff700 1 --2- 172.21.15.82:0/2498863219 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2908106880 0x7f2908106c60 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f28f8009990 tx=0x7f28f8009ca0 comp rx=0 tx=0).stop 2023-09-23T09:30:41.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.353+0000 7f290e5ff700 1 -- 172.21.15.82:0/2498863219 shutdown_connections 2023-09-23T09:30:41.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.353+0000 7f290e5ff700 1 --2- 172.21.15.82:0/2498863219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2908101230 0x7f290810d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:41.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.353+0000 7f290e5ff700 1 --2- 172.21.15.82:0/2498863219 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2908106880 0x7f2908106c60 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:41.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.353+0000 7f290e5ff700 1 --2- 172.21.15.82:0/2498863219 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2908100870 0x7f2908100cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:41.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.353+0000 7f290e5ff700 1 -- 172.21.15.82:0/2498863219 >> 172.21.15.82:0/2498863219 conn(0x7f29080fc3a0 msgr2=0x7f29080fe7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:41.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.354+0000 7f290e5ff700 1 -- 172.21.15.82:0/2498863219 shutdown_connections 2023-09-23T09:30:41.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.354+0000 7f290e5ff700 1 -- 172.21.15.82:0/2498863219 wait complete. 2023-09-23T09:30:41.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.355+0000 7f290e5ff700 1 Processor -- start 2023-09-23T09:30:41.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.355+0000 7f290e5ff700 1 -- start start 2023-09-23T09:30:41.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.355+0000 7f290e5ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2908100870 0x7f2908074220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:41.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.355+0000 7f290e5ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2908101230 0x7f2908074760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:41.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.355+0000 7f290e5ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2908106880 0x7f290806f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:41.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.355+0000 7f290e5ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f290806fae0 con 0x7f2908101230 2023-09-23T09:30:41.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.355+0000 7f290e5ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f290806fc50 con 0x7f2908106880 2023-09-23T09:30:41.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.355+0000 7f290e5ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f290806fe10 con 0x7f2908100870 2023-09-23T09:30:41.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.355+0000 7f29077fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2908101230 0x7f2908074760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:41.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.355+0000 7f29077fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2908101230 0x7f2908074760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36552/0 (socket says 172.21.15.82:36552) 2023-09-23T09:30:41.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.355+0000 7f29077fe700 1 -- 172.21.15.82:0/275178020 learned_addr learned my addr 172.21.15.82:0/275178020 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:30:41.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.356+0000 7f290cb9c700 1 --2- 172.21.15.82:0/275178020 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2908106880 0x7f290806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:41.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.356+0000 7f2907fff700 1 --2- 172.21.15.82:0/275178020 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2908100870 0x7f2908074220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:41.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.356+0000 7f29077fe700 1 -- 172.21.15.82:0/275178020 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2908100870 msgr2=0x7f2908074220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:41.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.356+0000 7f29077fe700 1 --2- 172.21.15.82:0/275178020 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2908100870 0x7f2908074220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:41.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.356+0000 7f29077fe700 1 -- 172.21.15.82:0/275178020 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2908106880 msgr2=0x7f290806f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:41.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.356+0000 7f29077fe700 1 --2- 172.21.15.82:0/275178020 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2908106880 0x7f290806f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:41.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.356+0000 7f29077fe700 1 -- 172.21.15.82:0/275178020 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28f80095f0 con 0x7f2908101230 2023-09-23T09:30:41.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.356+0000 7f29077fe700 1 --2- 172.21.15.82:0/275178020 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2908101230 0x7f2908074760 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f28fc00e9a0 tx=0x7f28fc00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:41.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.356+0000 7f29057fa700 1 -- 172.21.15.82:0/275178020 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28fc009790 con 0x7f2908101230 2023-09-23T09:30:41.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.356+0000 7f290e5ff700 1 -- 172.21.15.82:0/275178020 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29081adcf0 con 0x7f2908101230 2023-09-23T09:30:41.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.357+0000 7f29057fa700 1 -- 172.21.15.82:0/275178020 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f28fc010430 con 0x7f2908101230 2023-09-23T09:30:41.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.357+0000 7f290e5ff700 1 -- 172.21.15.82:0/275178020 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29081ae120 con 0x7f2908101230 2023-09-23T09:30:41.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.357+0000 7f29057fa700 1 -- 172.21.15.82:0/275178020 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28fc00cea0 con 0x7f2908101230 2023-09-23T09:30:41.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.360+0000 7f29057fa700 1 -- 172.21.15.82:0/275178020 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f28fc00ca10 con 0x7f2908101230 2023-09-23T09:30:41.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.361+0000 7f2921f9eb80 1 Processor -- start 2023-09-23T09:30:41.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.361+0000 7f2921f9eb80 1 -- start start 2023-09-23T09:30:41.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.362+0000 7f2921f9eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558b6b55f380 0x558b6b55f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:41.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.362+0000 7f2921f9eb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558b6b55fca0 0x558b6b559700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:41.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.362+0000 7f2921f9eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b6b559c40 0x558b6b55a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:41.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.362+0000 7f2921f9eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b6b4c17b0 con 0x558b6b55f380 2023-09-23T09:30:41.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.362+0000 7f2921f9eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b6b4b2780 con 0x558b6b559c40 2023-09-23T09:30:41.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.362+0000 7f2921f9eb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b6b4b00a0 con 0x558b6b55fca0 2023-09-23T09:30:41.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.362+0000 7f290cb9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558b6b55f380 0x558b6b55f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:41.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.362+0000 7f29077fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b6b559c40 0x558b6b55a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:41.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.362+0000 7f29077fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b6b559c40 0x558b6b55a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:59516/0 (socket says 172.21.15.82:59516) 2023-09-23T09:30:41.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.362+0000 7f29077fe700 1 -- 172.21.15.82:0/1026624655 learned_addr learned my addr 172.21.15.82:0/1026624655 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:30:41.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.362+0000 7f2907fff700 1 --2- 172.21.15.82:0/1026624655 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558b6b55fca0 0x558b6b559700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:41.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.363+0000 7f29077fe700 1 -- 172.21.15.82:0/1026624655 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558b6b55fca0 msgr2=0x558b6b559700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:41.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.363+0000 7f29077fe700 1 --2- 172.21.15.82:0/1026624655 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558b6b55fca0 0x558b6b559700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:41.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.363+0000 7f29077fe700 1 -- 172.21.15.82:0/1026624655 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558b6b55f380 msgr2=0x558b6b55f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:41.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.363+0000 7f29077fe700 1 --2- 172.21.15.82:0/1026624655 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558b6b55f380 0x558b6b55f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:41.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.363+0000 7f29077fe700 1 -- 172.21.15.82:0/1026624655 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558b6b32b630 con 0x558b6b559c40 2023-09-23T09:30:41.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.363+0000 7f29057fa700 1 --2- 172.21.15.82:0/275178020 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f28f00a0140 0x7f28f00a2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:41.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.363+0000 7f29077fe700 1 --2- 172.21.15.82:0/1026624655 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b6b559c40 0x558b6b55a0a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f28fc0c8d10 tx=0x7f28fc0d1770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dde51ca0e1e41da3 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:41.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.363+0000 7f290cb9c700 1 --2- 172.21.15.82:0/275178020 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f28f00a0140 0x7f28f00a2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:41.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.363+0000 7f29057fa700 1 -- 172.21.15.82:0/275178020 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f28fc014070 con 0x7f2908101230 2023-09-23T09:30:41.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.363+0000 7f28ee7fc700 1 -- 172.21.15.82:0/1026624655 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28fc0d1e70 con 0x558b6b559c40 2023-09-23T09:30:41.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.363+0000 7f28ee7fc700 1 -- 172.21.15.82:0/1026624655 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f28fc0950d0 con 0x558b6b559c40 2023-09-23T09:30:41.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.363+0000 7f28ee7fc700 1 -- 172.21.15.82:0/1026624655 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28fc099500 con 0x558b6b559c40 2023-09-23T09:30:41.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.364+0000 7f2921f9eb80 1 -- 172.21.15.82:0/1026624655 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b6b559c40 msgr2=0x558b6b55a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:41.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.364+0000 7f2921f9eb80 1 --2- 172.21.15.82:0/1026624655 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b6b559c40 0x558b6b55a0a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f28fc0c8d10 tx=0x7f28fc0d1770 comp rx=0 tx=0).stop 2023-09-23T09:30:41.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.365+0000 7f290cb9c700 1 --2- 172.21.15.82:0/275178020 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f28f00a0140 0x7f28f00a2600 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f29000127f0 tx=0x7f290000b040 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:41.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.365+0000 7f2921f9eb80 1 -- 172.21.15.82:0/1026624655 shutdown_connections 2023-09-23T09:30:41.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.365+0000 7f2921f9eb80 1 --2- 172.21.15.82:0/1026624655 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b6b559c40 0x558b6b55a0a0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:41.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.365+0000 7f2921f9eb80 1 --2- 172.21.15.82:0/1026624655 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558b6b55f380 0x558b6b55f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:41.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.365+0000 7f2921f9eb80 1 --2- 172.21.15.82:0/1026624655 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558b6b55fca0 0x558b6b559700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:41.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.365+0000 7f2921f9eb80 1 -- 172.21.15.82:0/1026624655 >> 172.21.15.82:0/1026624655 conn(0x558b6b4ce0e0 msgr2=0x558b6b554410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:41.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.365+0000 7f2921f9eb80 1 -- 172.21.15.82:0/1026624655 shutdown_connections 2023-09-23T09:30:41.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.365+0000 7f2921f9eb80 1 -- 172.21.15.82:0/1026624655 wait complete. 2023-09-23T09:30:41.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.365+0000 7f2921f9eb80 1 -- start start 2023-09-23T09:30:41.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.366+0000 7f2921f9eb80 1 Processor -- start 2023-09-23T09:30:41.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.367+0000 7f2921f9eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558b6b559c40 0x558b6b565c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:41.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.367+0000 7f2921f9eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b6b55f380 0x558b6b562ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:41.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.367+0000 7f2921f9eb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558b6b55fca0 0x558b6b563590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:41.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.367+0000 7f2921f9eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b6b4ab990 con 0x558b6b559c40 2023-09-23T09:30:41.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.367+0000 7f2921f9eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b6b449bb0 con 0x558b6b55f380 2023-09-23T09:30:41.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.367+0000 7f2921f9eb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b6b4498b0 con 0x558b6b55fca0 2023-09-23T09:30:41.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.367+0000 7f2921f9eb80 10 client.0 _ll_register_callbacks cb 0x558b6b393a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:30:41.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.367+0000 7f290cb9c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558b6b55fca0 0x558b6b563590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:41.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.367+0000 7f290cb9c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558b6b55fca0 0x558b6b563590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:49050/0 (socket says 172.21.15.82:49050) 2023-09-23T09:30:41.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.367+0000 7f290cb9c700 1 -- 172.21.15.82:0/3658086322 learned_addr learned my addr 172.21.15.82:0/3658086322 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:30:41.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.368+0000 7f290cb9c700 1 -- 172.21.15.82:0/3658086322 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b6b55f380 msgr2=0x558b6b562ea0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-23T09:30:41.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.368+0000 7f290cb9c700 1 --2- 172.21.15.82:0/3658086322 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b6b55f380 0x558b6b562ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:41.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.368+0000 7f290cb9c700 1 -- 172.21.15.82:0/3658086322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558b6b559c40 msgr2=0x558b6b565c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:41.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.368+0000 7f290cb9c700 1 --2- 172.21.15.82:0/3658086322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558b6b559c40 0x558b6b565c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:41.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.368+0000 7f290cb9c700 1 -- 172.21.15.82:0/3658086322 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29081ae120 con 0x558b6b55fca0 2023-09-23T09:30:41.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:30:41 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/208838462' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T09:30:41.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.368+0000 7f290cb9c700 1 --2- 172.21.15.82:0/3658086322 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558b6b55fca0 0x558b6b563590 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f2900004440 tx=0x7f2900004b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1fa5964261c1d8d6 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:41.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.369+0000 7f28e77fe700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T09:30:41.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.369+0000 7f28e77fe700 1 -- 172.21.15.82:0/3658086322 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f290000e040 con 0x558b6b55fca0 2023-09-23T09:30:41.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.369+0000 7f28e77fe700 1 -- 172.21.15.82:0/3658086322 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(143..143 src has 1..143) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f29000048b0 con 0x558b6b55fca0 2023-09-23T09:30:41.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.369+0000 7f2921f9eb80 1 -- 172.21.15.82:0/3658086322 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558b6b5291c0 con 0x558b6b55fca0 2023-09-23T09:30:41.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.369+0000 7f28e77fe700 1 -- 172.21.15.82:0/3658086322 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=100) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2900016ca0 con 0x558b6b55fca0 2023-09-23T09:30:41.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.369+0000 7f2921f9eb80 10 client.27379 fetch_fsmap learned FSMap version 100 2023-09-23T09:30:41.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.369+0000 7f2921f9eb80 1 -- 172.21.15.82:0/3658086322 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=100,monmap=4+}) v3 -- 0x558b6b2d7de0 con 0x558b6b55fca0 2023-09-23T09:30:41.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.370+0000 7f28e77fe700 1 -- 172.21.15.82:0/3658086322 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x558b6b5291c0 con 0x558b6b55fca0 2023-09-23T09:30:41.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.371+0000 7f28e77fe700 1 -- 172.21.15.82:0/3658086322 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 100) v1 ==== 7946+0+0 (secure 0 0 0) 0x7f29000153f0 con 0x558b6b55fca0 2023-09-23T09:30:41.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.371+0000 7f2921f9eb80 10 client.27379 fetch_fsmap finished waiting for FSMap version 100 2023-09-23T09:30:41.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.371+0000 7f2921f9eb80 10 client.27379 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-23T09:30:41.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.371+0000 7f2921f9eb80 20 client.27379 populate_metadata read hostname 'smithi082' 2023-09-23T09:30:41.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.371+0000 7f2921f9eb80 1 --2- 172.21.15.82:0/3658086322 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x558b6b57bfb0 0x558b6b57e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:41.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.371+0000 7f2921f9eb80 4 client.27379 mds_command: new command op to 24550 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:30:41.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.371+0000 7f2921f9eb80 1 -- 172.21.15.82:0/3658086322 --> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558b6b451ba0 con 0x558b6b57bfb0 2023-09-23T09:30:41.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.372+0000 7f2907fff700 1 --2- 172.21.15.82:0/3658086322 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x558b6b57bfb0 0x558b6b57e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:41.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.373+0000 7f2907fff700 1 --2- 172.21.15.82:0/3658086322 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x558b6b57bfb0 0x558b6b57e3d0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9d420744bed0d5cc server_cookie=adb93b0800c4f4f in_seq=0 out_seq=0 2023-09-23T09:30:41.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.373+0000 7f28e77fe700 10 client.27379 ms_handle_connect on v2:172.21.15.161:6838/758982817 2023-09-23T09:30:41.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.375+0000 7f28e77fe700 1 -- 172.21.15.82:0/3658086322 <== mds.1 v2:172.21.15.161:6838/758982817 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558b6b451ba0 con 0x558b6b57bfb0 2023-09-23T09:30:41.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.375+0000 7f28e77fe700 10 client.27379 handle_command_reply: tid=0 2023-09-23T09:30:41.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.375+0000 7f2921f9eb80 1 client.27379 shutdown 2023-09-23T09:30:41.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.378+0000 7f2921f9eb80 1 -- 172.21.15.82:0/3658086322 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558b6b55fca0 msgr2=0x558b6b563590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:41.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.378+0000 7f2921f9eb80 1 --2- 172.21.15.82:0/3658086322 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558b6b55fca0 0x558b6b563590 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f2900004440 tx=0x7f2900004b40 comp rx=0 tx=0).stop 2023-09-23T09:30:41.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.379+0000 7f2921f9eb80 1 -- 172.21.15.82:0/3658086322 shutdown_connections 2023-09-23T09:30:41.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.379+0000 7f2921f9eb80 1 --2- 172.21.15.82:0/3658086322 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x558b6b57bfb0 0x558b6b57e3d0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:41.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.379+0000 7f2921f9eb80 1 --2- 172.21.15.82:0/3658086322 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558b6b55fca0 0x558b6b563590 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:41.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.379+0000 7f2921f9eb80 1 --2- 172.21.15.82:0/3658086322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558b6b559c40 0x558b6b565c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:41.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.379+0000 7f2921f9eb80 1 --2- 172.21.15.82:0/3658086322 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b6b55f380 0x558b6b562ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:41.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.379+0000 7f2921f9eb80 1 -- 172.21.15.82:0/3658086322 >> 172.21.15.82:0/3658086322 conn(0x558b6b4ce0e0 msgr2=0x558b6b54eb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:41.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.379+0000 7f28e77fe700 0 client.27379 ms_handle_reset on v2:172.21.15.161:6838/758982817 2023-09-23T09:30:41.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.381+0000 7f2921f9eb80 1 -- 172.21.15.82:0/3658086322 shutdown_connections 2023-09-23T09:30:41.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.381+0000 7f2921f9eb80 1 -- 172.21.15.82:0/3658086322 wait complete. 2023-09-23T09:30:41.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.382+0000 7f2921f9eb80 20 client.27379 trim_cache size 0 max 16384 2023-09-23T09:30:41.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:30:41 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/208838462' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T09:30:41.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.408+0000 7f2921f9eb80 1 Processor -- start 2023-09-23T09:30:41.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.410+0000 7f2921f9eb80 1 -- start start 2023-09-23T09:30:41.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.411+0000 7f2921f9eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558b6b559c40 0x558b6b5657c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:41.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.411+0000 7f2921f9eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b6b55f380 0x558b6b55be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:41.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.411+0000 7f2921f9eb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558b6b55fca0 0x558b6b55c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:41.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.411+0000 7f2921f9eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b6b32d920 con 0x558b6b559c40 2023-09-23T09:30:41.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.411+0000 7f2921f9eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b6b578980 con 0x558b6b55f380 2023-09-23T09:30:41.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.411+0000 7f2921f9eb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b6b55dbb0 con 0x558b6b55fca0 2023-09-23T09:30:41.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.411+0000 7f29077fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b6b55f380 0x558b6b55be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:41.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.412+0000 7f290cb9c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558b6b55fca0 0x558b6b55c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:41.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.412+0000 7f290cb9c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558b6b55fca0 0x558b6b55c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:49064/0 (socket says 172.21.15.82:49064) 2023-09-23T09:30:41.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.412+0000 7f29077fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b6b55f380 0x558b6b55be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:59548/0 (socket says 172.21.15.82:59548) 2023-09-23T09:30:41.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.412+0000 7f290cb9c700 1 -- 172.21.15.82:0/4202233092 learned_addr learned my addr 172.21.15.82:0/4202233092 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:30:41.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.412+0000 7f2907fff700 1 --2- 172.21.15.82:0/4202233092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558b6b559c40 0x558b6b5657c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:41.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.412+0000 7f290cb9c700 1 -- 172.21.15.82:0/4202233092 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b6b55f380 msgr2=0x558b6b55be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:41.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.412+0000 7f290cb9c700 1 --2- 172.21.15.82:0/4202233092 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b6b55f380 0x558b6b55be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:41.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.412+0000 7f290cb9c700 1 -- 172.21.15.82:0/4202233092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558b6b559c40 msgr2=0x558b6b5657c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:41.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.412+0000 7f290cb9c700 1 --2- 172.21.15.82:0/4202233092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558b6b559c40 0x558b6b5657c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:41.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.412+0000 7f290cb9c700 1 -- 172.21.15.82:0/4202233092 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558b6b2c0c60 con 0x558b6b55fca0 2023-09-23T09:30:41.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.413+0000 7f290cb9c700 1 --2- 172.21.15.82:0/4202233092 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558b6b55fca0 0x558b6b55c350 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f29000122f0 tx=0x7f2900012440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5bd25d0e306eb67a server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:41.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.414+0000 7f28eeffd700 1 -- 172.21.15.82:0/4202233092 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f290000e050 con 0x558b6b55fca0 2023-09-23T09:30:41.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.414+0000 7f28eeffd700 1 -- 172.21.15.82:0/4202233092 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f290000f040 con 0x558b6b55fca0 2023-09-23T09:30:41.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.414+0000 7f28eeffd700 1 -- 172.21.15.82:0/4202233092 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2900004bd0 con 0x558b6b55fca0 2023-09-23T09:30:41.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.415+0000 7f2921f9eb80 1 -- 172.21.15.82:0/4202233092 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558b6b55fca0 msgr2=0x558b6b55c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:41.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.415+0000 7f2921f9eb80 1 --2- 172.21.15.82:0/4202233092 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558b6b55fca0 0x558b6b55c350 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f29000122f0 tx=0x7f2900012440 comp rx=0 tx=0).stop 2023-09-23T09:30:41.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.417+0000 7f2921f9eb80 1 -- 172.21.15.82:0/4202233092 shutdown_connections 2023-09-23T09:30:41.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.417+0000 7f2921f9eb80 1 --2- 172.21.15.82:0/4202233092 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558b6b55fca0 0x558b6b55c350 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:41.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.417+0000 7f2921f9eb80 1 --2- 172.21.15.82:0/4202233092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558b6b559c40 0x558b6b5657c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:41.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.417+0000 7f2921f9eb80 1 --2- 172.21.15.82:0/4202233092 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b6b55f380 0x558b6b55be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:41.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.417+0000 7f2921f9eb80 1 -- 172.21.15.82:0/4202233092 >> 172.21.15.82:0/4202233092 conn(0x558b6b4ce0e0 msgr2=0x558b6b55cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:41.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.417+0000 7f2921f9eb80 1 -- 172.21.15.82:0/4202233092 shutdown_connections 2023-09-23T09:30:41.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.417+0000 7f2921f9eb80 1 -- 172.21.15.82:0/4202233092 wait complete. 2023-09-23T09:30:41.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.418+0000 7f2921f9eb80 1 -- start start 2023-09-23T09:30:41.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.418+0000 7f2921f9eb80 1 Processor -- start 2023-09-23T09:30:41.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.419+0000 7f2921f9eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558b6b559c40 0x558b6b5628e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:41.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.419+0000 7f2921f9eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b6b55f380 0x558b6b562e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:41.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.419+0000 7f2921f9eb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558b6b55fca0 0x558b6b561400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:41.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.419+0000 7f2921f9eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b6b5619d0 con 0x558b6b559c40 2023-09-23T09:30:41.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.419+0000 7f2921f9eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b6b561b40 con 0x558b6b55f380 2023-09-23T09:30:41.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.419+0000 7f2921f9eb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b6b561d00 con 0x558b6b55fca0 2023-09-23T09:30:41.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.419+0000 7f2921f9eb80 10 client.0 _ll_register_callbacks cb 0x7f2900003d10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:30:41.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.419+0000 7f29077fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b6b55f380 0x558b6b562e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:41.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.420+0000 7f29077fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b6b55f380 0x558b6b562e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:59552/0 (socket says 172.21.15.82:59552) 2023-09-23T09:30:41.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.420+0000 7f29077fe700 1 -- 172.21.15.82:0/2378621959 learned_addr learned my addr 172.21.15.82:0/2378621959 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:30:41.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.420+0000 7f2907fff700 1 --2- 172.21.15.82:0/2378621959 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558b6b559c40 0x558b6b5628e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:41.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.420+0000 7f2907fff700 1 -- 172.21.15.82:0/2378621959 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558b6b55fca0 msgr2=0x558b6b561400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:41.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.420+0000 7f2907fff700 1 --2- 172.21.15.82:0/2378621959 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558b6b55fca0 0x558b6b561400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:41.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.420+0000 7f2907fff700 1 -- 172.21.15.82:0/2378621959 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b6b55f380 msgr2=0x558b6b562e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:41.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.420+0000 7f2907fff700 1 --2- 172.21.15.82:0/2378621959 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b6b55f380 0x558b6b562e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:41.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.420+0000 7f2907fff700 1 -- 172.21.15.82:0/2378621959 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558b6b2d7de0 con 0x558b6b559c40 2023-09-23T09:30:41.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.421+0000 7f2907fff700 1 --2- 172.21.15.82:0/2378621959 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558b6b559c40 0x558b6b5628e0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f28f8005910 tx=0x7f28f8005bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=109168a832968b35 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:41.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.422+0000 7f28e77fe700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:30:41.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.422+0000 7f28e77fe700 1 -- 172.21.15.82:0/2378621959 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f801d070 con 0x558b6b559c40 2023-09-23T09:30:41.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.422+0000 7f28e77fe700 1 -- 172.21.15.82:0/2378621959 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(143..143 src has 1..143) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f28f8028ce0 con 0x558b6b559c40 2023-09-23T09:30:41.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.422+0000 7f2921f9eb80 1 -- 172.21.15.82:0/2378621959 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558b6b54c8b0 con 0x558b6b559c40 2023-09-23T09:30:41.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.422+0000 7f28e77fe700 1 -- 172.21.15.82:0/2378621959 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=100) v2 ==== 24+0+0 (secure 0 0 0) 0x7f28f8028ea0 con 0x558b6b559c40 2023-09-23T09:30:41.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.423+0000 7f2921f9eb80 10 client.17664 fetch_fsmap learned FSMap version 100 2023-09-23T09:30:41.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.423+0000 7f2921f9eb80 1 -- 172.21.15.82:0/2378621959 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=100,monmap=4+}) v3 -- 0x558b6b2fe250 con 0x558b6b559c40 2023-09-23T09:30:41.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.427+0000 7f28e77fe700 1 -- 172.21.15.82:0/2378621959 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x558b6b54c8b0 con 0x558b6b559c40 2023-09-23T09:30:41.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.427+0000 7f28e77fe700 1 -- 172.21.15.82:0/2378621959 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 100) v1 ==== 7946+0+0 (secure 0 0 0) 0x7f28f8004950 con 0x558b6b559c40 2023-09-23T09:30:41.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.428+0000 7f2921f9eb80 10 client.17664 fetch_fsmap finished waiting for FSMap version 100 2023-09-23T09:30:41.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.428+0000 7f2921f9eb80 10 client.17664 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-23T09:30:41.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.428+0000 7f2921f9eb80 20 client.17664 populate_metadata read hostname 'smithi082' 2023-09-23T09:30:41.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.428+0000 7f2921f9eb80 1 --2- 172.21.15.82:0/2378621959 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x558b6b5d0ed0 0x558b6b5d32f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:41.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.428+0000 7f2921f9eb80 4 client.17664 mds_command: new command op to 24550 tid=0[{"prefix": "damage ls"}] 2023-09-23T09:30:41.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.428+0000 7f2921f9eb80 1 -- 172.21.15.82:0/2378621959 --> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x558b6b4a4970 con 0x558b6b5d0ed0 2023-09-23T09:30:41.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.429+0000 7f29077fe700 1 --2- 172.21.15.82:0/2378621959 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x558b6b5d0ed0 0x558b6b5d32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:41.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.430+0000 7f29077fe700 1 --2- 172.21.15.82:0/2378621959 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x558b6b5d0ed0 0x558b6b5d32f0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=72753f291537fa80 server_cookie=88be64f2f4b3df0d in_seq=0 out_seq=0 2023-09-23T09:30:41.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.431+0000 7f28e77fe700 10 client.17664 ms_handle_connect on v2:172.21.15.161:6838/758982817 2023-09-23T09:30:41.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.431+0000 7f28e77fe700 1 -- 172.21.15.82:0/2378621959 <== mds.1 v2:172.21.15.161:6838/758982817 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x558b6b4a4970 con 0x558b6b5d0ed0 2023-09-23T09:30:41.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.431+0000 7f28e77fe700 10 client.17664 handle_command_reply: tid=0 2023-09-23T09:30:41.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.431+0000 7f2921f9eb80 1 client.17664 shutdown 2023-09-23T09:30:41.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.431+0000 7f2921f9eb80 1 -- 172.21.15.82:0/2378621959 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558b6b559c40 msgr2=0x558b6b5628e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:41.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.431+0000 7f2921f9eb80 1 --2- 172.21.15.82:0/2378621959 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558b6b559c40 0x558b6b5628e0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f28f8005910 tx=0x7f28f8005bc0 comp rx=0 tx=0).stop 2023-09-23T09:30:41.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.432+0000 7f2921f9eb80 1 -- 172.21.15.82:0/2378621959 shutdown_connections 2023-09-23T09:30:41.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.432+0000 7f2921f9eb80 1 --2- 172.21.15.82:0/2378621959 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x558b6b5d0ed0 0x558b6b5d32f0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:41.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.432+0000 7f2921f9eb80 1 --2- 172.21.15.82:0/2378621959 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558b6b55fca0 0x558b6b561400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:41.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.432+0000 7f2921f9eb80 1 --2- 172.21.15.82:0/2378621959 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558b6b559c40 0x558b6b5628e0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:41.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.432+0000 7f2921f9eb80 1 --2- 172.21.15.82:0/2378621959 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b6b55f380 0x558b6b562e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:41.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.432+0000 7f2921f9eb80 1 -- 172.21.15.82:0/2378621959 >> 172.21.15.82:0/2378621959 conn(0x558b6b4ce0e0 msgr2=0x558b6b54e2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:41.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.433+0000 7f28e77fe700 0 client.17664 ms_handle_reset on v2:172.21.15.161:6838/758982817 2023-09-23T09:30:41.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.433+0000 7f2921f9eb80 1 -- 172.21.15.82:0/2378621959 shutdown_connections 2023-09-23T09:30:41.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.433+0000 7f2921f9eb80 1 -- 172.21.15.82:0/2378621959 wait complete. 2023-09-23T09:30:41.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.434+0000 7f2921f9eb80 20 client.17664 trim_cache size 0 max 16384 2023-09-23T09:30:41.438 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2023-09-23T09:30:41.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.435+0000 7f290e5ff700 1 -- 172.21.15.82:0/275178020 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f28f00a0140 msgr2=0x7f28f00a2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:41.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.435+0000 7f290e5ff700 1 --2- 172.21.15.82:0/275178020 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f28f00a0140 0x7f28f00a2600 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f29000127f0 tx=0x7f290000b040 comp rx=0 tx=0).stop 2023-09-23T09:30:41.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.435+0000 7f290e5ff700 1 -- 172.21.15.82:0/275178020 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2908101230 msgr2=0x7f2908074760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:41.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.435+0000 7f290e5ff700 1 --2- 172.21.15.82:0/275178020 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2908101230 0x7f2908074760 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f28fc00e9a0 tx=0x7f28fc00ecb0 comp rx=0 tx=0).stop 2023-09-23T09:30:41.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.436+0000 7f290e5ff700 1 -- 172.21.15.82:0/275178020 shutdown_connections 2023-09-23T09:30:41.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.436+0000 7f290e5ff700 1 --2- 172.21.15.82:0/275178020 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f28f00a0140 0x7f28f00a2600 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:41.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.436+0000 7f290e5ff700 1 --2- 172.21.15.82:0/275178020 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2908106880 0x7f290806f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:41.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.436+0000 7f290e5ff700 1 --2- 172.21.15.82:0/275178020 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2908100870 0x7f2908074220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:41.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.436+0000 7f290e5ff700 1 --2- 172.21.15.82:0/275178020 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2908101230 0x7f2908074760 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:41.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.436+0000 7f290e5ff700 1 -- 172.21.15.82:0/275178020 >> 172.21.15.82:0/275178020 conn(0x7f29080fc3a0 msgr2=0x7f29080fcbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:41.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.437+0000 7f290e5ff700 1 -- 172.21.15.82:0/275178020 shutdown_connections 2023-09-23T09:30:41.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.437+0000 7f290e5ff700 1 -- 172.21.15.82:0/275178020 wait complete. 2023-09-23T09:30:41.475 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-09-23T09:30:41.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:30:41 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/208838462' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T09:30:41.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.822+0000 7ff37f3ff700 1 -- 172.21.15.82:0/4024235487 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff3781023b0 msgr2=0x7ff37810a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:41.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.822+0000 7ff37f3ff700 1 --2- 172.21.15.82:0/4024235487 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff3781023b0 0x7ff37810a890 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ff36c00b0a0 tx=0x7ff36c00b3b0 comp rx=0 tx=0).stop 2023-09-23T09:30:41.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.823+0000 7ff37f3ff700 1 -- 172.21.15.82:0/4024235487 shutdown_connections 2023-09-23T09:30:41.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.823+0000 7ff37f3ff700 1 --2- 172.21.15.82:0/4024235487 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff37810ae60 0x7ff37810d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:41.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.823+0000 7ff37f3ff700 1 --2- 172.21.15.82:0/4024235487 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff378101a90 0x7ff378101e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:41.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.823+0000 7ff37f3ff700 1 --2- 172.21.15.82:0/4024235487 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff3781023b0 0x7ff37810a890 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:41.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.823+0000 7ff37f3ff700 1 -- 172.21.15.82:0/4024235487 >> 172.21.15.82:0/4024235487 conn(0x7ff3780fb270 msgr2=0x7ff3780fd690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:41.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.828+0000 7ff37f3ff700 1 -- 172.21.15.82:0/4024235487 shutdown_connections 2023-09-23T09:30:41.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.829+0000 7ff37f3ff700 1 -- 172.21.15.82:0/4024235487 wait complete. 2023-09-23T09:30:41.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.830+0000 7ff37f3ff700 1 Processor -- start 2023-09-23T09:30:41.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.830+0000 7ff37f3ff700 1 -- start start 2023-09-23T09:30:41.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.831+0000 7ff37f3ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff378101a90 0x7ff378199420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:41.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.831+0000 7ff37f3ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3781023b0 0x7ff378199960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:41.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.831+0000 7ff37f3ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff37810ae60 0x7ff3781945a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:41.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.831+0000 7ff37f3ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff378194c50 con 0x7ff3781023b0 2023-09-23T09:30:41.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.831+0000 7ff37f3ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff378194dc0 con 0x7ff378101a90 2023-09-23T09:30:41.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.831+0000 7ff37f3ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff378194f80 con 0x7ff37810ae60 2023-09-23T09:30:41.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.831+0000 7ff37d99c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff37810ae60 0x7ff3781945a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:41.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.832+0000 7ff37d99c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff37810ae60 0x7ff3781945a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:56580/0 (socket says 172.21.15.82:56580) 2023-09-23T09:30:41.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.832+0000 7ff37d99c700 1 -- 172.21.15.82:0/3695604966 learned_addr learned my addr 172.21.15.82:0/3695604966 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:30:41.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.832+0000 7ff37c99a700 1 --2- 172.21.15.82:0/3695604966 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3781023b0 0x7ff378199960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:41.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.832+0000 7ff37d99c700 1 -- 172.21.15.82:0/3695604966 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff378101a90 msgr2=0x7ff378199420 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-09-23T09:30:41.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.832+0000 7ff37d99c700 1 --2- 172.21.15.82:0/3695604966 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff378101a90 0x7ff378199420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:41.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.832+0000 7ff37d99c700 1 -- 172.21.15.82:0/3695604966 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3781023b0 msgr2=0x7ff378199960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:41.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.832+0000 7ff37d99c700 1 --2- 172.21.15.82:0/3695604966 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3781023b0 0x7ff378199960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:41.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.832+0000 7ff37d99c700 1 -- 172.21.15.82:0/3695604966 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff36c009d00 con 0x7ff37810ae60 2023-09-23T09:30:41.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.832+0000 7ff37c99a700 1 --2- 172.21.15.82:0/3695604966 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3781023b0 0x7ff378199960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T09:30:41.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.832+0000 7ff37d99c700 1 --2- 172.21.15.82:0/3695604966 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff37810ae60 0x7ff3781945a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ff37400b4a0 tx=0x7ff37400b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:41.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.833+0000 7ff36a7fc700 1 -- 172.21.15.82:0/3695604966 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff374011830 con 0x7ff37810ae60 2023-09-23T09:30:41.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.833+0000 7ff36a7fc700 1 -- 172.21.15.82:0/3695604966 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff374011e20 con 0x7ff37810ae60 2023-09-23T09:30:41.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.833+0000 7ff36a7fc700 1 -- 172.21.15.82:0/3695604966 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff374010d40 con 0x7ff37810ae60 2023-09-23T09:30:41.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.833+0000 7ff37f3ff700 1 -- 172.21.15.82:0/3695604966 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff378195260 con 0x7ff37810ae60 2023-09-23T09:30:41.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.833+0000 7ff37f3ff700 1 -- 172.21.15.82:0/3695604966 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff378198360 con 0x7ff37810ae60 2023-09-23T09:30:41.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.839+0000 7ff36a7fc700 1 -- 172.21.15.82:0/3695604966 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7ff374011990 con 0x7ff37810ae60 2023-09-23T09:30:41.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.842+0000 7ff36a7fc700 1 --2- 172.21.15.82:0/3695604966 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7ff3640a01f0 0x7ff3640a26b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:41.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.842+0000 7ff36a7fc700 1 -- 172.21.15.82:0/3695604966 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 8513+0+0 (secure 0 0 0) 0x7ff3740cafe0 con 0x7ff37810ae60 2023-09-23T09:30:41.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.843+0000 7ff37d19b700 1 --2- 172.21.15.82:0/3695604966 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7ff3640a01f0 0x7ff3640a26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:41.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.844+0000 7ff392d4cb80 1 Processor -- start 2023-09-23T09:30:41.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.845+0000 7ff392d4cb80 1 -- start start 2023-09-23T09:30:41.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.845+0000 7ff37d19b700 1 --2- 172.21.15.82:0/3695604966 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7ff3640a01f0 0x7ff3640a26b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff37000ba10 tx=0x7ff37000b3f0 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:41.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.845+0000 7ff392d4cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558bb9f6d380 0x558bb9f6d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:41.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.845+0000 7ff392d4cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558bb9f6dca0 0x558bb9f67700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:41.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.845+0000 7ff392d4cb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558bb9f67c40 0x558bb9f680a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:41.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.845+0000 7ff392d4cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x558bb9ecf7b0 con 0x558bb9f6d380 2023-09-23T09:30:41.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.845+0000 7ff392d4cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x558bb9ec0780 con 0x558bb9f6dca0 2023-09-23T09:30:41.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.845+0000 7ff392d4cb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x558bb9ebe0a0 con 0x558bb9f67c40 2023-09-23T09:30:41.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.846+0000 7ff37c99a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558bb9f6dca0 0x558bb9f67700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:41.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.846+0000 7ff37c99a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558bb9f6dca0 0x558bb9f67700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:34930/0 (socket says 172.21.15.82:34930) 2023-09-23T09:30:41.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.846+0000 7ff37c99a700 1 -- 172.21.15.82:0/660062383 learned_addr learned my addr 172.21.15.82:0/660062383 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:30:41.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.846+0000 7ff37d99c700 1 --2- 172.21.15.82:0/660062383 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558bb9f67c40 0x558bb9f680a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:41.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.846+0000 7ff37d19b700 1 --2- 172.21.15.82:0/660062383 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558bb9f6d380 0x558bb9f6d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:41.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.846+0000 7ff37c99a700 1 -- 172.21.15.82:0/660062383 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558bb9f67c40 msgr2=0x558bb9f680a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:41.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.847+0000 7ff37c99a700 1 --2- 172.21.15.82:0/660062383 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558bb9f67c40 0x558bb9f680a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:41.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.847+0000 7ff37c99a700 1 -- 172.21.15.82:0/660062383 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558bb9f6d380 msgr2=0x558bb9f6d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:41.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.847+0000 7ff37c99a700 1 --2- 172.21.15.82:0/660062383 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558bb9f6d380 0x558bb9f6d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:41.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.847+0000 7ff37c99a700 1 -- 172.21.15.82:0/660062383 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558bb9d39630 con 0x558bb9f6dca0 2023-09-23T09:30:41.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.847+0000 7ff37c99a700 1 --2- 172.21.15.82:0/660062383 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558bb9f6dca0 0x558bb9f67700 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ff36c00b070 tx=0x7ff36c008c70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=507b7c147431b494 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:41.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.847+0000 7ff3637fe700 1 -- 172.21.15.82:0/660062383 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff36c00e050 con 0x558bb9f6dca0 2023-09-23T09:30:41.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.847+0000 7ff3637fe700 1 -- 172.21.15.82:0/660062383 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff36c0092d0 con 0x558bb9f6dca0 2023-09-23T09:30:41.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.847+0000 7ff3637fe700 1 -- 172.21.15.82:0/660062383 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff36c005040 con 0x558bb9f6dca0 2023-09-23T09:30:41.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.848+0000 7ff392d4cb80 1 -- 172.21.15.82:0/660062383 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558bb9f6dca0 msgr2=0x558bb9f67700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:41.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.848+0000 7ff392d4cb80 1 --2- 172.21.15.82:0/660062383 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558bb9f6dca0 0x558bb9f67700 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ff36c00b070 tx=0x7ff36c008c70 comp rx=0 tx=0).stop 2023-09-23T09:30:41.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.849+0000 7ff392d4cb80 1 -- 172.21.15.82:0/660062383 shutdown_connections 2023-09-23T09:30:41.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.849+0000 7ff392d4cb80 1 --2- 172.21.15.82:0/660062383 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558bb9f67c40 0x558bb9f680a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:41.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.849+0000 7ff392d4cb80 1 --2- 172.21.15.82:0/660062383 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558bb9f6d380 0x558bb9f6d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:41.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.849+0000 7ff392d4cb80 1 --2- 172.21.15.82:0/660062383 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558bb9f6dca0 0x558bb9f67700 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:41.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.849+0000 7ff392d4cb80 1 -- 172.21.15.82:0/660062383 >> 172.21.15.82:0/660062383 conn(0x558bb9edc0e0 msgr2=0x558bb9f62410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:41.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.849+0000 7ff392d4cb80 1 -- 172.21.15.82:0/660062383 shutdown_connections 2023-09-23T09:30:41.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.849+0000 7ff392d4cb80 1 -- 172.21.15.82:0/660062383 wait complete. 2023-09-23T09:30:41.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.850+0000 7ff392d4cb80 1 -- start start 2023-09-23T09:30:41.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.850+0000 7ff392d4cb80 1 Processor -- start 2023-09-23T09:30:41.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.851+0000 7ff392d4cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558bb9f67c40 0x558bb9f73c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:41.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.851+0000 7ff392d4cb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558bb9f6d380 0x558bb9f70f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:41.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.851+0000 7ff392d4cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558bb9f6dca0 0x558bb9f71670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:41.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.851+0000 7ff392d4cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x558bb9eb9990 con 0x558bb9f67c40 2023-09-23T09:30:41.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.851+0000 7ff392d4cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x558bb9e57bb0 con 0x558bb9f6dca0 2023-09-23T09:30:41.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.851+0000 7ff392d4cb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x558bb9e578b0 con 0x558bb9f6d380 2023-09-23T09:30:41.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.851+0000 7ff392d4cb80 10 client.0 _ll_register_callbacks cb 0x558bb9da1a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:30:41.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.852+0000 7ff37c99a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558bb9f6d380 0x558bb9f70f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:41.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.852+0000 7ff37c99a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558bb9f6d380 0x558bb9f70f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:56598/0 (socket says 172.21.15.82:56598) 2023-09-23T09:30:41.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.852+0000 7ff37c99a700 1 -- 172.21.15.82:0/1712639293 learned_addr learned my addr 172.21.15.82:0/1712639293 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:30:41.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.852+0000 7ff37d99c700 1 --2- 172.21.15.82:0/1712639293 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558bb9f6dca0 0x558bb9f71670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:41.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.852+0000 7ff37c99a700 1 -- 172.21.15.82:0/1712639293 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558bb9f6dca0 msgr2=0x558bb9f71670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:41.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.852+0000 7ff37c99a700 1 --2- 172.21.15.82:0/1712639293 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558bb9f6dca0 0x558bb9f71670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:41.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.852+0000 7ff37c99a700 1 -- 172.21.15.82:0/1712639293 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558bb9f67c40 msgr2=0x558bb9f73c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:41.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.852+0000 7ff37c99a700 1 --2- 172.21.15.82:0/1712639293 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558bb9f67c40 0x558bb9f73c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:41.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.852+0000 7ff37c99a700 1 -- 172.21.15.82:0/1712639293 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff37810dfc0 con 0x558bb9f6d380 2023-09-23T09:30:41.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.853+0000 7ff37c99a700 1 --2- 172.21.15.82:0/1712639293 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558bb9f6d380 0x558bb9f70f30 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff36c004c80 tx=0x7ff36c004cb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=384a6d115b543899 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:41.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.853+0000 7ff360ff9700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T09:30:41.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.855+0000 7ff360ff9700 1 -- 172.21.15.82:0/1712639293 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff36c0092e0 con 0x558bb9f6d380 2023-09-23T09:30:41.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.855+0000 7ff360ff9700 1 -- 172.21.15.82:0/1712639293 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(143..143 src has 1..143) v4 ==== 8513+0+0 (secure 0 0 0) 0x7ff36c029070 con 0x558bb9f6d380 2023-09-23T09:30:41.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.855+0000 7ff392d4cb80 1 -- 172.21.15.82:0/1712639293 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558bb9f371c0 con 0x558bb9f6d380 2023-09-23T09:30:41.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.856+0000 7ff360ff9700 1 -- 172.21.15.82:0/1712639293 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=100) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff36c009440 con 0x558bb9f6d380 2023-09-23T09:30:41.859 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.857+0000 7ff392d4cb80 10 client.27394 fetch_fsmap learned FSMap version 100 2023-09-23T09:30:41.859 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.857+0000 7ff392d4cb80 1 -- 172.21.15.82:0/1712639293 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=100,monmap=4+}) v3 -- 0x558bb9ce5de0 con 0x558bb9f6d380 2023-09-23T09:30:41.859 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.858+0000 7ff360ff9700 1 -- 172.21.15.82:0/1712639293 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff36c03a020 con 0x558bb9f6d380 2023-09-23T09:30:41.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.858+0000 7ff360ff9700 1 -- 172.21.15.82:0/1712639293 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 100) v1 ==== 7946+0+0 (secure 0 0 0) 0x7ff36c00b0d0 con 0x558bb9f6d380 2023-09-23T09:30:41.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.859+0000 7ff392d4cb80 10 client.27394 fetch_fsmap finished waiting for FSMap version 100 2023-09-23T09:30:41.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.859+0000 7ff392d4cb80 10 client.27394 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:30:41.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.859+0000 7ff392d4cb80 20 client.27394 populate_metadata read hostname 'smithi082' 2023-09-23T09:30:41.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.859+0000 7ff392d4cb80 1 --2- 172.21.15.82:0/1712639293 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x558bb9f81470 0x558bb9f83890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:41.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.859+0000 7ff392d4cb80 4 client.27394 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:30:41.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.859+0000 7ff392d4cb80 1 -- 172.21.15.82:0/1712639293 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558bb9e5fba0 con 0x558bb9f81470 2023-09-23T09:30:41.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.860+0000 7ff37d19b700 1 --2- 172.21.15.82:0/1712639293 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x558bb9f81470 0x558bb9f83890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:41.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.862+0000 7ff37d19b700 1 --2- 172.21.15.82:0/1712639293 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x558bb9f81470 0x558bb9f83890 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=82caa8ce02f88740 server_cookie=5c91231f06ee6982 in_seq=0 out_seq=0 2023-09-23T09:30:41.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.862+0000 7ff360ff9700 10 client.27394 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:30:41.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.863+0000 7ff360ff9700 1 -- 172.21.15.82:0/1712639293 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558bb9e5fba0 con 0x558bb9f81470 2023-09-23T09:30:41.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.863+0000 7ff360ff9700 10 client.27394 handle_command_reply: tid=0 2023-09-23T09:30:41.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.863+0000 7ff392d4cb80 1 client.27394 shutdown 2023-09-23T09:30:41.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.863+0000 7ff392d4cb80 1 -- 172.21.15.82:0/1712639293 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558bb9f6d380 msgr2=0x558bb9f70f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:41.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.863+0000 7ff392d4cb80 1 --2- 172.21.15.82:0/1712639293 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558bb9f6d380 0x558bb9f70f30 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff36c004c80 tx=0x7ff36c004cb0 comp rx=0 tx=0).stop 2023-09-23T09:30:41.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.864+0000 7ff392d4cb80 1 -- 172.21.15.82:0/1712639293 shutdown_connections 2023-09-23T09:30:41.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.864+0000 7ff392d4cb80 1 --2- 172.21.15.82:0/1712639293 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558bb9f6dca0 0x558bb9f71670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:41.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.864+0000 7ff392d4cb80 1 --2- 172.21.15.82:0/1712639293 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x558bb9f81470 0x558bb9f83890 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:41.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.864+0000 7ff392d4cb80 1 --2- 172.21.15.82:0/1712639293 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558bb9f67c40 0x558bb9f73c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:41.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.864+0000 7ff392d4cb80 1 --2- 172.21.15.82:0/1712639293 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558bb9f6d380 0x558bb9f70f30 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:41.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.864+0000 7ff392d4cb80 1 -- 172.21.15.82:0/1712639293 >> 172.21.15.82:0/1712639293 conn(0x558bb9edc0e0 msgr2=0x558bb9f5cb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:41.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.864+0000 7ff360ff9700 0 client.27394 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:30:41.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.865+0000 7ff392d4cb80 1 -- 172.21.15.82:0/1712639293 shutdown_connections 2023-09-23T09:30:41.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.865+0000 7ff392d4cb80 1 -- 172.21.15.82:0/1712639293 wait complete. 2023-09-23T09:30:41.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.866+0000 7ff392d4cb80 20 client.27394 trim_cache size 0 max 16384 2023-09-23T09:30:41.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.883+0000 7ff392d4cb80 1 Processor -- start 2023-09-23T09:30:41.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.883+0000 7ff392d4cb80 1 -- start start 2023-09-23T09:30:41.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.884+0000 7ff392d4cb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558bb9f67c40 0x558bb9f6d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:41.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.884+0000 7ff392d4cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558bb9f6d380 0x558bb9f70760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:41.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.884+0000 7ff392d4cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558bb9f6dca0 0x558bb9f737e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:41.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.884+0000 7ff392d4cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x558bb9d3b920 con 0x558bb9f6d380 2023-09-23T09:30:41.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.884+0000 7ff392d4cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x558bb9f724a0 con 0x558bb9f6dca0 2023-09-23T09:30:41.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.884+0000 7ff392d4cb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x558bb9f5ec80 con 0x558bb9f67c40 2023-09-23T09:30:41.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.884+0000 7ff37d19b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558bb9f67c40 0x558bb9f6d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:41.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.884+0000 7ff37d19b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558bb9f67c40 0x558bb9f6d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:56602/0 (socket says 172.21.15.82:56602) 2023-09-23T09:30:41.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.884+0000 7ff37d19b700 1 -- 172.21.15.82:0/2604176982 learned_addr learned my addr 172.21.15.82:0/2604176982 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:30:41.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.885+0000 7ff37c99a700 1 --2- 172.21.15.82:0/2604176982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558bb9f6d380 0x558bb9f70760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:41.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.885+0000 7ff37d19b700 1 -- 172.21.15.82:0/2604176982 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558bb9f6dca0 msgr2=0x558bb9f737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:41.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.885+0000 7ff37d19b700 1 --2- 172.21.15.82:0/2604176982 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558bb9f6dca0 0x558bb9f737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:41.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.885+0000 7ff37d19b700 1 -- 172.21.15.82:0/2604176982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558bb9f6d380 msgr2=0x558bb9f70760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:41.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.885+0000 7ff37d19b700 1 --2- 172.21.15.82:0/2604176982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558bb9f6d380 0x558bb9f70760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:41.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.885+0000 7ff37d19b700 1 -- 172.21.15.82:0/2604176982 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558bb9ccec60 con 0x558bb9f67c40 2023-09-23T09:30:41.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.885+0000 7ff37c99a700 1 --2- 172.21.15.82:0/2604176982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558bb9f6d380 0x558bb9f70760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T09:30:41.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.886+0000 7ff37d19b700 1 --2- 172.21.15.82:0/2604176982 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558bb9f67c40 0x558bb9f6d760 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x558bb9f84150 tx=0x7ff370010000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3da2a0a609382481 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:41.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.886+0000 7ff363fff700 1 -- 172.21.15.82:0/2604176982 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff370023070 con 0x558bb9f67c40 2023-09-23T09:30:41.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.886+0000 7ff363fff700 1 -- 172.21.15.82:0/2604176982 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff370024b00 con 0x558bb9f67c40 2023-09-23T09:30:41.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.886+0000 7ff363fff700 1 -- 172.21.15.82:0/2604176982 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff370010aa0 con 0x558bb9f67c40 2023-09-23T09:30:41.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.887+0000 7ff392d4cb80 1 -- 172.21.15.82:0/2604176982 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558bb9f67c40 msgr2=0x558bb9f6d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:41.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.887+0000 7ff392d4cb80 1 --2- 172.21.15.82:0/2604176982 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558bb9f67c40 0x558bb9f6d760 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x558bb9f84150 tx=0x7ff370010000 comp rx=0 tx=0).stop 2023-09-23T09:30:41.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.888+0000 7ff392d4cb80 1 -- 172.21.15.82:0/2604176982 shutdown_connections 2023-09-23T09:30:41.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.888+0000 7ff392d4cb80 1 --2- 172.21.15.82:0/2604176982 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558bb9f6dca0 0x558bb9f737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:41.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.888+0000 7ff392d4cb80 1 --2- 172.21.15.82:0/2604176982 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558bb9f67c40 0x558bb9f6d760 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:41.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.888+0000 7ff392d4cb80 1 --2- 172.21.15.82:0/2604176982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558bb9f6d380 0x558bb9f70760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:41.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.888+0000 7ff392d4cb80 1 -- 172.21.15.82:0/2604176982 >> 172.21.15.82:0/2604176982 conn(0x558bb9edc0e0 msgr2=0x558bb9f7ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:41.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.888+0000 7ff392d4cb80 1 -- 172.21.15.82:0/2604176982 shutdown_connections 2023-09-23T09:30:41.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.888+0000 7ff392d4cb80 1 -- 172.21.15.82:0/2604176982 wait complete. 2023-09-23T09:30:41.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.889+0000 7ff392d4cb80 1 -- start start 2023-09-23T09:30:41.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.889+0000 7ff392d4cb80 1 Processor -- start 2023-09-23T09:30:41.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.890+0000 7ff392d4cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558bb9f67c40 0x558bb9f6a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:41.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.890+0000 7ff392d4cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558bb9f6d380 0x558bb9f68e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:41.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.890+0000 7ff392d4cb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558bb9f6dca0 0x558bb9f69340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:41.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.890+0000 7ff392d4cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x558bb9f6ab00 con 0x558bb9f67c40 2023-09-23T09:30:41.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.890+0000 7ff392d4cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x558bb9f6ac70 con 0x558bb9f6d380 2023-09-23T09:30:41.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.890+0000 7ff392d4cb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x558bb9f69880 con 0x558bb9f6dca0 2023-09-23T09:30:41.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.890+0000 7ff392d4cb80 10 client.0 _ll_register_callbacks cb 0x7ff36c009f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:30:41.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.891+0000 7ff37d19b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558bb9f67c40 0x558bb9f6a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:41.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.891+0000 7ff37d99c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558bb9f6dca0 0x558bb9f69340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:41.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.891+0000 7ff37d19b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558bb9f67c40 0x558bb9f6a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54998/0 (socket says 172.21.15.82:54998) 2023-09-23T09:30:41.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.891+0000 7ff37d19b700 1 -- 172.21.15.82:0/506584759 learned_addr learned my addr 172.21.15.82:0/506584759 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:30:41.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.891+0000 7ff37c99a700 1 --2- 172.21.15.82:0/506584759 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558bb9f6d380 0x558bb9f68e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:41.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.891+0000 7ff37d99c700 1 -- 172.21.15.82:0/506584759 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558bb9f6d380 msgr2=0x558bb9f68e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:41.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.891+0000 7ff37d99c700 1 --2- 172.21.15.82:0/506584759 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558bb9f6d380 0x558bb9f68e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:41.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.891+0000 7ff37d99c700 1 -- 172.21.15.82:0/506584759 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558bb9f67c40 msgr2=0x558bb9f6a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:41.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.891+0000 7ff37d99c700 1 --2- 172.21.15.82:0/506584759 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558bb9f67c40 0x558bb9f6a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:41.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.891+0000 7ff37d99c700 1 -- 172.21.15.82:0/506584759 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff37000d970 con 0x558bb9f6dca0 2023-09-23T09:30:41.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.892+0000 7ff37d99c700 1 --2- 172.21.15.82:0/506584759 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558bb9f6dca0 0x558bb9f69340 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff3740c8800 tx=0x7ff374098370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=86cc880220baac64 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:41.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.892+0000 7ff360ff9700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T09:30:41.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.892+0000 7ff360ff9700 1 -- 172.21.15.82:0/506584759 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff374098c20 con 0x558bb9f6dca0 2023-09-23T09:30:41.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.892+0000 7ff360ff9700 1 -- 172.21.15.82:0/506584759 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(143..143 src has 1..143) v4 ==== 8513+0+0 (secure 0 0 0) 0x7ff3740c8e40 con 0x558bb9f6dca0 2023-09-23T09:30:41.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.892+0000 7ff392d4cb80 1 -- 172.21.15.82:0/506584759 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558bb9f5a8b0 con 0x558bb9f6dca0 2023-09-23T09:30:41.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.892+0000 7ff360ff9700 1 -- 172.21.15.82:0/506584759 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=100) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff374011c40 con 0x558bb9f6dca0 2023-09-23T09:30:41.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.892+0000 7ff392d4cb80 10 client.27400 fetch_fsmap learned FSMap version 100 2023-09-23T09:30:41.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.892+0000 7ff392d4cb80 1 -- 172.21.15.82:0/506584759 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=100,monmap=4+}) v3 -- 0x558bb9d0c250 con 0x558bb9f6dca0 2023-09-23T09:30:41.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.893+0000 7ff360ff9700 1 -- 172.21.15.82:0/506584759 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x558bb9f5a8b0 con 0x558bb9f6dca0 2023-09-23T09:30:41.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.894+0000 7ff360ff9700 1 -- 172.21.15.82:0/506584759 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 100) v1 ==== 7946+0+0 (secure 0 0 0) 0x7ff374097cb0 con 0x558bb9f6dca0 2023-09-23T09:30:41.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.894+0000 7ff392d4cb80 10 client.27400 fetch_fsmap finished waiting for FSMap version 100 2023-09-23T09:30:41.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.894+0000 7ff392d4cb80 10 client.27400 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:30:41.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.894+0000 7ff392d4cb80 20 client.27400 populate_metadata read hostname 'smithi082' 2023-09-23T09:30:41.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.894+0000 7ff392d4cb80 1 --2- 172.21.15.82:0/506584759 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x558bb9fd64f0 0x558bb9fd8910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:41.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.894+0000 7ff392d4cb80 4 client.27400 mds_command: new command op to 24557 tid=0[{"prefix": "damage ls"}] 2023-09-23T09:30:41.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.894+0000 7ff392d4cb80 1 -- 172.21.15.82:0/506584759 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x558bb9eb2970 con 0x558bb9fd64f0 2023-09-23T09:30:41.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.894+0000 7ff37d19b700 1 --2- 172.21.15.82:0/506584759 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x558bb9fd64f0 0x558bb9fd8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:41.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.895+0000 7ff360ff9700 10 client.27400 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:30:41.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.895+0000 7ff37d19b700 1 --2- 172.21.15.82:0/506584759 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x558bb9fd64f0 0x558bb9fd8910 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=39449893a7e894d3 server_cookie=3d29a1d0fbd77b73 in_seq=0 out_seq=0 2023-09-23T09:30:41.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.895+0000 7ff360ff9700 1 -- 172.21.15.82:0/506584759 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x558bb9eb2970 con 0x558bb9fd64f0 2023-09-23T09:30:41.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.895+0000 7ff360ff9700 10 client.27400 handle_command_reply: tid=0 2023-09-23T09:30:41.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.895+0000 7ff392d4cb80 1 client.27400 shutdown 2023-09-23T09:30:41.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.896+0000 7ff392d4cb80 1 -- 172.21.15.82:0/506584759 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558bb9f6dca0 msgr2=0x558bb9f69340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:41.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.896+0000 7ff392d4cb80 1 --2- 172.21.15.82:0/506584759 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558bb9f6dca0 0x558bb9f69340 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff3740c8800 tx=0x7ff374098370 comp rx=0 tx=0).stop 2023-09-23T09:30:41.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.896+0000 7ff392d4cb80 1 -- 172.21.15.82:0/506584759 shutdown_connections 2023-09-23T09:30:41.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.896+0000 7ff392d4cb80 1 --2- 172.21.15.82:0/506584759 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558bb9f6dca0 0x558bb9f69340 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:41.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.896+0000 7ff392d4cb80 1 --2- 172.21.15.82:0/506584759 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x558bb9fd64f0 0x558bb9fd8910 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:41.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.896+0000 7ff392d4cb80 1 --2- 172.21.15.82:0/506584759 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558bb9f67c40 0x558bb9f6a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:41.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.896+0000 7ff392d4cb80 1 --2- 172.21.15.82:0/506584759 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558bb9f6d380 0x558bb9f68e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:41.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.896+0000 7ff392d4cb80 1 -- 172.21.15.82:0/506584759 >> 172.21.15.82:0/506584759 conn(0x558bb9edc0e0 msgr2=0x558bb9f6b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:41.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.896+0000 7ff360ff9700 0 client.27400 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:30:41.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.896+0000 7ff392d4cb80 1 -- 172.21.15.82:0/506584759 shutdown_connections 2023-09-23T09:30:41.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.896+0000 7ff392d4cb80 1 -- 172.21.15.82:0/506584759 wait complete. 2023-09-23T09:30:41.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.896+0000 7ff392d4cb80 20 client.27400 trim_cache size 0 max 16384 2023-09-23T09:30:41.901 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2023-09-23T09:30:41.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.897+0000 7ff37f3ff700 1 -- 172.21.15.82:0/3695604966 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7ff3640a01f0 msgr2=0x7ff3640a26b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:41.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.897+0000 7ff37f3ff700 1 --2- 172.21.15.82:0/3695604966 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7ff3640a01f0 0x7ff3640a26b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff37000ba10 tx=0x7ff37000b3f0 comp rx=0 tx=0).stop 2023-09-23T09:30:41.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.897+0000 7ff37f3ff700 1 -- 172.21.15.82:0/3695604966 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff37810ae60 msgr2=0x7ff3781945a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:41.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.897+0000 7ff37f3ff700 1 --2- 172.21.15.82:0/3695604966 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff37810ae60 0x7ff3781945a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ff37400b4a0 tx=0x7ff37400b860 comp rx=0 tx=0).stop 2023-09-23T09:30:41.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.897+0000 7ff37f3ff700 1 -- 172.21.15.82:0/3695604966 shutdown_connections 2023-09-23T09:30:41.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.897+0000 7ff37f3ff700 1 --2- 172.21.15.82:0/3695604966 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7ff3640a01f0 0x7ff3640a26b0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:41.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.897+0000 7ff37f3ff700 1 --2- 172.21.15.82:0/3695604966 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff37810ae60 0x7ff3781945a0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:41.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.897+0000 7ff37f3ff700 1 --2- 172.21.15.82:0/3695604966 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff378101a90 0x7ff378199420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:41.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.897+0000 7ff37f3ff700 1 --2- 172.21.15.82:0/3695604966 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3781023b0 0x7ff378199960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:41.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.897+0000 7ff37f3ff700 1 -- 172.21.15.82:0/3695604966 >> 172.21.15.82:0/3695604966 conn(0x7ff3780fb270 msgr2=0x7ff3780fbee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:41.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.898+0000 7ff37f3ff700 1 -- 172.21.15.82:0/3695604966 shutdown_connections 2023-09-23T09:30:41.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:41.898+0000 7ff37f3ff700 1 -- 172.21.15.82:0/3695604966 wait complete. 2023-09-23T09:30:42.373 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:30:42 smithi082 ceph-mon[97694]: pgmap v1071: 97 pgs: 97 active+clean; 16 GiB data, 55 GiB used, 1018 GiB / 1.0 TiB avail; 1.3 MiB/s rd, 10 MiB/s wr, 769 op/s 2023-09-23T09:30:42.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:30:42 smithi135 ceph-mon[99205]: pgmap v1071: 97 pgs: 97 active+clean; 16 GiB data, 55 GiB used, 1018 GiB / 1.0 TiB avail; 1.3 MiB/s rd, 10 MiB/s wr, 769 op/s 2023-09-23T09:30:42.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:30:42 smithi161 ceph-mon[99580]: pgmap v1071: 97 pgs: 97 active+clean; 16 GiB data, 55 GiB used, 1018 GiB / 1.0 TiB avail; 1.3 MiB/s rd, 10 MiB/s wr, 769 op/s 2023-09-23T09:30:42.934 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-09-23T09:30:42.934 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-09-23T09:30:43.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.324+0000 7fdf9679d700 1 -- 172.21.15.82:0/698031009 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf90107760 msgr2=0x7fdf90107be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:43.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.324+0000 7fdf9679d700 1 --2- 172.21.15.82:0/698031009 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf90107760 0x7fdf90107be0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fdf80009990 tx=0x7fdf80009ca0 comp rx=0 tx=0).stop 2023-09-23T09:30:43.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.324+0000 7fdf9679d700 1 -- 172.21.15.82:0/698031009 shutdown_connections 2023-09-23T09:30:43.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.324+0000 7fdf9679d700 1 --2- 172.21.15.82:0/698031009 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf90108120 0x7fdf90113bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:43.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.324+0000 7fdf9679d700 1 --2- 172.21.15.82:0/698031009 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf9010bd40 0x7fdf9010c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:43.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.324+0000 7fdf9679d700 1 --2- 172.21.15.82:0/698031009 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf90107760 0x7fdf90107be0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:43.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.324+0000 7fdf9679d700 1 -- 172.21.15.82:0/698031009 >> 172.21.15.82:0/698031009 conn(0x7fdf90076310 msgr2=0x7fdf90078730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:43.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.325+0000 7fdf9679d700 1 -- 172.21.15.82:0/698031009 shutdown_connections 2023-09-23T09:30:43.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.325+0000 7fdf9679d700 1 -- 172.21.15.82:0/698031009 wait complete. 2023-09-23T09:30:43.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.326+0000 7fdf9679d700 1 Processor -- start 2023-09-23T09:30:43.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.326+0000 7fdf9679d700 1 -- start start 2023-09-23T09:30:43.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.327+0000 7fdf9679d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf90107760 0x7fdf9006ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:43.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.327+0000 7fdf9679d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf90108120 0x7fdf9006b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:43.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.327+0000 7fdf9679d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf9010bd40 0x7fdf901b1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:43.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.327+0000 7fdf9679d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf901b18e0 con 0x7fdf9010bd40 2023-09-23T09:30:43.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.327+0000 7fdf9679d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf9007b1c0 con 0x7fdf90107760 2023-09-23T09:30:43.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.327+0000 7fdf9679d700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf9007b380 con 0x7fdf90108120 2023-09-23T09:30:43.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.327+0000 7fdf9579b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf90107760 0x7fdf9006ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:43.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.328+0000 7fdf9579b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf90107760 0x7fdf9006ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:34978/0 (socket says 172.21.15.82:34978) 2023-09-23T09:30:43.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.328+0000 7fdf9579b700 1 -- 172.21.15.82:0/3627083630 learned_addr learned my addr 172.21.15.82:0/3627083630 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:30:43.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.328+0000 7fdf95f9c700 1 --2- 172.21.15.82:0/3627083630 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf9010bd40 0x7fdf901b1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:43.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.328+0000 7fdf9579b700 1 -- 172.21.15.82:0/3627083630 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf90108120 msgr2=0x7fdf9006b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:43.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.328+0000 7fdf9579b700 1 --2- 172.21.15.82:0/3627083630 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf90108120 0x7fdf9006b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:43.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.328+0000 7fdf9579b700 1 -- 172.21.15.82:0/3627083630 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf9010bd40 msgr2=0x7fdf901b1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:43.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.328+0000 7fdf9579b700 1 --2- 172.21.15.82:0/3627083630 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf9010bd40 0x7fdf901b1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:43.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.328+0000 7fdf9579b700 1 -- 172.21.15.82:0/3627083630 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf800095f0 con 0x7fdf90107760 2023-09-23T09:30:43.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.329+0000 7fdf9579b700 1 --2- 172.21.15.82:0/3627083630 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf90107760 0x7fdf9006ae60 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c00b530 tx=0x7fdf8c00b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:43.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.329+0000 7fdf867fc700 1 -- 172.21.15.82:0/3627083630 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf8c011830 con 0x7fdf90107760 2023-09-23T09:30:43.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.329+0000 7fdf867fc700 1 -- 172.21.15.82:0/3627083630 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdf8c011e20 con 0x7fdf90107760 2023-09-23T09:30:43.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.329+0000 7fdf867fc700 1 -- 172.21.15.82:0/3627083630 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf8c010e40 con 0x7fdf90107760 2023-09-23T09:30:43.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.329+0000 7fdf9679d700 1 -- 172.21.15.82:0/3627083630 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf9007b660 con 0x7fdf90107760 2023-09-23T09:30:43.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.329+0000 7fdf9679d700 1 -- 172.21.15.82:0/3627083630 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf9007bb20 con 0x7fdf90107760 2023-09-23T09:30:43.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.337+0000 7fdfab2b3b80 1 Processor -- start 2023-09-23T09:30:43.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.342+0000 7fdf867fc700 1 -- 172.21.15.82:0/3627083630 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7fdf8c011990 con 0x7fdf90107760 2023-09-23T09:30:43.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.344+0000 7fdfab2b3b80 1 -- start start 2023-09-23T09:30:43.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.345+0000 7fdfab2b3b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55dcb1b00580 0x55dcb1b00960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:43.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.345+0000 7fdfab2b3b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dcb1b00ea0 0x55dcb1afa780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:43.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.345+0000 7fdfab2b3b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcb1afacc0 0x55dcb1afb100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:43.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.345+0000 7fdfab2b3b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcb1a62830 con 0x55dcb1b00ea0 2023-09-23T09:30:43.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.345+0000 7fdfab2b3b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcb1a53800 con 0x55dcb1afacc0 2023-09-23T09:30:43.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.345+0000 7fdfab2b3b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcb1a51120 con 0x55dcb1b00580 2023-09-23T09:30:43.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.346+0000 7fdf94f9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcb1afacc0 0x55dcb1afb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:43.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.346+0000 7fdf94f9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcb1afacc0 0x55dcb1afb100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:34992/0 (socket says 172.21.15.82:34992) 2023-09-23T09:30:43.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.346+0000 7fdf94f9a700 1 -- 172.21.15.82:0/3978001772 learned_addr learned my addr 172.21.15.82:0/3978001772 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:30:43.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.346+0000 7fdf867fc700 1 --2- 172.21.15.82:0/3627083630 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fdf7c0a02b0 0x7fdf7c0a2770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:43.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.347+0000 7fdf867fc700 1 -- 172.21.15.82:0/3627083630 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fdf8c0cb0a0 con 0x7fdf90107760 2023-09-23T09:30:43.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.347+0000 7fdf95f9c700 1 --2- 172.21.15.82:0/3978001772 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55dcb1b00580 0x55dcb1b00960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:43.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.347+0000 7fdf94f9a700 1 -- 172.21.15.82:0/3978001772 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55dcb1b00580 msgr2=0x55dcb1b00960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:43.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.347+0000 7fdf9579b700 1 --2- 172.21.15.82:0/3978001772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dcb1b00ea0 0x55dcb1afa780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:43.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.347+0000 7fdf94f9a700 1 --2- 172.21.15.82:0/3978001772 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55dcb1b00580 0x55dcb1b00960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:43.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.347+0000 7fdf94f9a700 1 -- 172.21.15.82:0/3978001772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dcb1b00ea0 msgr2=0x55dcb1afa780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:43.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.347+0000 7fdf94f9a700 1 --2- 172.21.15.82:0/3978001772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dcb1b00ea0 0x55dcb1afa780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:43.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.347+0000 7fdf94f9a700 1 -- 172.21.15.82:0/3978001772 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dcb18cc6b0 con 0x55dcb1afacc0 2023-09-23T09:30:43.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.347+0000 7fdf95f9c700 1 --2- 172.21.15.82:0/3978001772 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55dcb1b00580 0x55dcb1b00960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T09:30:43.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.347+0000 7fdf9579b700 1 --2- 172.21.15.82:0/3978001772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dcb1b00ea0 0x55dcb1afa780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T09:30:43.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.348+0000 7fdf94f9a700 1 --2- 172.21.15.82:0/3978001772 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcb1afacc0 0x55dcb1afb100 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fdf800098e0 tx=0x7fdf80005af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=31c16a7c5b6733d3 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:43.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.348+0000 7fdf95f9c700 1 --2- 172.21.15.82:0/3627083630 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fdf7c0a02b0 0x7fdf7c0a2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:43.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.348+0000 7fdf7b7fe700 1 -- 172.21.15.82:0/3978001772 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf8001d070 con 0x55dcb1afacc0 2023-09-23T09:30:43.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.348+0000 7fdf7b7fe700 1 -- 172.21.15.82:0/3978001772 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdf80005650 con 0x55dcb1afacc0 2023-09-23T09:30:43.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.348+0000 7fdf7b7fe700 1 -- 172.21.15.82:0/3978001772 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf80003e60 con 0x55dcb1afacc0 2023-09-23T09:30:43.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.350+0000 7fdfab2b3b80 1 -- 172.21.15.82:0/3978001772 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcb1afacc0 msgr2=0x55dcb1afb100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:43.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.350+0000 7fdfab2b3b80 1 --2- 172.21.15.82:0/3978001772 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcb1afacc0 0x55dcb1afb100 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fdf800098e0 tx=0x7fdf80005af0 comp rx=0 tx=0).stop 2023-09-23T09:30:43.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.352+0000 7fdf95f9c700 1 --2- 172.21.15.82:0/3627083630 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fdf7c0a02b0 0x7fdf7c0a2770 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fdf88009f80 tx=0x7fdf8800e040 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:43.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.353+0000 7fdfab2b3b80 1 -- 172.21.15.82:0/3978001772 shutdown_connections 2023-09-23T09:30:43.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.353+0000 7fdfab2b3b80 1 --2- 172.21.15.82:0/3978001772 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcb1afacc0 0x55dcb1afb100 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:43.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.353+0000 7fdfab2b3b80 1 --2- 172.21.15.82:0/3978001772 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55dcb1b00580 0x55dcb1b00960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:43.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.353+0000 7fdfab2b3b80 1 --2- 172.21.15.82:0/3978001772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dcb1b00ea0 0x55dcb1afa780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:43.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.353+0000 7fdfab2b3b80 1 -- 172.21.15.82:0/3978001772 >> 172.21.15.82:0/3978001772 conn(0x55dcb1a6f160 msgr2=0x55dcb1af59c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:43.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.354+0000 7fdfab2b3b80 1 -- 172.21.15.82:0/3978001772 shutdown_connections 2023-09-23T09:30:43.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.354+0000 7fdfab2b3b80 1 -- 172.21.15.82:0/3978001772 wait complete. 2023-09-23T09:30:43.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.355+0000 7fdfab2b3b80 1 -- start start 2023-09-23T09:30:43.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.355+0000 7fdfab2b3b80 1 Processor -- start 2023-09-23T09:30:43.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.356+0000 7fdfab2b3b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55dcb1afacc0 0x55dcb1b04110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:43.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.356+0000 7fdfab2b3b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcb1b00580 0x55dcb1b04650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:43.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.356+0000 7fdfab2b3b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dcb1b00ea0 0x55dcb1b04b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:43.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.357+0000 7fdfab2b3b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcb1a4ca10 con 0x55dcb1b00ea0 2023-09-23T09:30:43.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.357+0000 7fdfab2b3b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcb19eac30 con 0x55dcb1b00580 2023-09-23T09:30:43.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.357+0000 7fdfab2b3b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcb19ea930 con 0x55dcb1afacc0 2023-09-23T09:30:43.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.357+0000 7fdfab2b3b80 10 client.0 _ll_register_callbacks cb 0x55dcb1934b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:30:43.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.357+0000 7fdf94f9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcb1b00580 0x55dcb1b04650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:43.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.357+0000 7fdf94f9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcb1b00580 0x55dcb1b04650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:34996/0 (socket says 172.21.15.82:34996) 2023-09-23T09:30:43.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.357+0000 7fdf94f9a700 1 -- 172.21.15.82:0/1244747091 learned_addr learned my addr 172.21.15.82:0/1244747091 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:30:43.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.357+0000 7fdf9579b700 1 --2- 172.21.15.82:0/1244747091 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55dcb1afacc0 0x55dcb1b04110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:43.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.357+0000 7fdf95f9c700 1 --2- 172.21.15.82:0/1244747091 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dcb1b00ea0 0x55dcb1b04b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:43.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.358+0000 7fdf94f9a700 1 -- 172.21.15.82:0/1244747091 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55dcb1afacc0 msgr2=0x55dcb1b04110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:43.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.358+0000 7fdf94f9a700 1 --2- 172.21.15.82:0/1244747091 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55dcb1afacc0 0x55dcb1b04110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:43.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.358+0000 7fdf94f9a700 1 -- 172.21.15.82:0/1244747091 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dcb1b00ea0 msgr2=0x55dcb1b04b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:43.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.358+0000 7fdf94f9a700 1 --2- 172.21.15.82:0/1244747091 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dcb1b00ea0 0x55dcb1b04b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:43.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.358+0000 7fdf94f9a700 1 -- 172.21.15.82:0/1244747091 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf90114460 con 0x55dcb1b00580 2023-09-23T09:30:43.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.358+0000 7fdf94f9a700 1 --2- 172.21.15.82:0/1244747091 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcb1b00580 0x55dcb1b04650 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fdf8000a010 tx=0x7fdf8000bd70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97a00a6eb99c3829 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:43.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.359+0000 7fdf78ff9700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-09-23T09:30:43.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.359+0000 7fdf78ff9700 1 -- 172.21.15.82:0/1244747091 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf8001d040 con 0x55dcb1b00580 2023-09-23T09:30:43.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.359+0000 7fdf78ff9700 1 -- 172.21.15.82:0/1244747091 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(143..143 src has 1..143) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fdf80003c40 con 0x55dcb1b00580 2023-09-23T09:30:43.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.363+0000 7fdfab2b3b80 1 -- 172.21.15.82:0/1244747091 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dcb1aca240 con 0x55dcb1b00580 2023-09-23T09:30:43.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.363+0000 7fdf78ff9700 1 -- 172.21.15.82:0/1244747091 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=100) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdf80003e00 con 0x55dcb1b00580 2023-09-23T09:30:43.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.363+0000 7fdfab2b3b80 10 client.27362 fetch_fsmap learned FSMap version 100 2023-09-23T09:30:43.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.363+0000 7fdfab2b3b80 1 -- 172.21.15.82:0/1244747091 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=100,monmap=4+}) v3 -- 0x55dcb1878e60 con 0x55dcb1b00580 2023-09-23T09:30:43.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.364+0000 7fdf78ff9700 1 -- 172.21.15.82:0/1244747091 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55dcb1aca240 con 0x55dcb1b00580 2023-09-23T09:30:43.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.364+0000 7fdf78ff9700 1 -- 172.21.15.82:0/1244747091 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 100) v1 ==== 7946+0+0 (secure 0 0 0) 0x7fdf80028070 con 0x55dcb1b00580 2023-09-23T09:30:43.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.364+0000 7fdfab2b3b80 10 client.27362 fetch_fsmap finished waiting for FSMap version 100 2023-09-23T09:30:43.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.364+0000 7fdfab2b3b80 10 client.27362 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:30:43.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.364+0000 7fdfab2b3b80 20 client.27362 populate_metadata read hostname 'smithi082' 2023-09-23T09:30:43.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.364+0000 7fdfab2b3b80 1 --2- 172.21.15.82:0/1244747091 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55dcb1b14320 0x55dcb1b16740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:43.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.364+0000 7fdfab2b3b80 4 client.27362 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:30:43.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.364+0000 7fdfab2b3b80 1 -- 172.21.15.82:0/1244747091 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55dcb19f2c20 con 0x55dcb1b14320 2023-09-23T09:30:43.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.365+0000 7fdf9579b700 1 --2- 172.21.15.82:0/1244747091 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55dcb1b14320 0x55dcb1b16740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:43.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.366+0000 7fdf9579b700 1 --2- 172.21.15.82:0/1244747091 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55dcb1b14320 0x55dcb1b16740 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=53291d4693dee5c7 server_cookie=ec5840757a828708 in_seq=0 out_seq=0 2023-09-23T09:30:43.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.366+0000 7fdf78ff9700 10 client.27362 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:30:43.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.367+0000 7fdf78ff9700 1 -- 172.21.15.82:0/1244747091 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55dcb19f2c20 con 0x55dcb1b14320 2023-09-23T09:30:43.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.367+0000 7fdf78ff9700 10 client.27362 handle_command_reply: tid=0 2023-09-23T09:30:43.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.367+0000 7fdfab2b3b80 1 client.27362 shutdown 2023-09-23T09:30:43.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.368+0000 7fdfab2b3b80 1 -- 172.21.15.82:0/1244747091 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcb1b00580 msgr2=0x55dcb1b04650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:43.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.368+0000 7fdfab2b3b80 1 --2- 172.21.15.82:0/1244747091 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcb1b00580 0x55dcb1b04650 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fdf8000a010 tx=0x7fdf8000bd70 comp rx=0 tx=0).stop 2023-09-23T09:30:43.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.368+0000 7fdfab2b3b80 1 -- 172.21.15.82:0/1244747091 shutdown_connections 2023-09-23T09:30:43.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.368+0000 7fdfab2b3b80 1 --2- 172.21.15.82:0/1244747091 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55dcb1b14320 0x55dcb1b16740 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:43.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.368+0000 7fdfab2b3b80 1 --2- 172.21.15.82:0/1244747091 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dcb1b00ea0 0x55dcb1b04b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:43.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.368+0000 7fdfab2b3b80 1 --2- 172.21.15.82:0/1244747091 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55dcb1afacc0 0x55dcb1b04110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:43.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.368+0000 7fdfab2b3b80 1 --2- 172.21.15.82:0/1244747091 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcb1b00580 0x55dcb1b04650 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:43.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.368+0000 7fdfab2b3b80 1 -- 172.21.15.82:0/1244747091 >> 172.21.15.82:0/1244747091 conn(0x55dcb1a6f160 msgr2=0x55dcb1af9770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:43.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.368+0000 7fdf78ff9700 0 client.27362 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:30:43.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.369+0000 7fdfab2b3b80 1 -- 172.21.15.82:0/1244747091 shutdown_connections 2023-09-23T09:30:43.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.369+0000 7fdfab2b3b80 1 -- 172.21.15.82:0/1244747091 wait complete. 2023-09-23T09:30:43.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.369+0000 7fdfab2b3b80 20 client.27362 trim_cache size 0 max 16384 2023-09-23T09:30:43.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.399+0000 7fdfab2b3b80 1 Processor -- start 2023-09-23T09:30:43.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.399+0000 7fdfab2b3b80 1 -- start start 2023-09-23T09:30:43.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.400+0000 7fdfab2b3b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55dcb1afacc0 0x55dcb1affa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:43.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.400+0000 7fdfab2b3b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcb1b00580 0x55dcb1afe6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:43.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.400+0000 7fdfab2b3b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dcb1b00ea0 0x55dcb1b0b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:43.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.400+0000 7fdfab2b3b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcb18ce9a0 con 0x55dcb1b00ea0 2023-09-23T09:30:43.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.400+0000 7fdfab2b3b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcb1b112d0 con 0x55dcb1b00580 2023-09-23T09:30:43.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.400+0000 7fdfab2b3b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcb1b07770 con 0x55dcb1afacc0 2023-09-23T09:30:43.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.400+0000 7fdf94f9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcb1b00580 0x55dcb1afe6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:43.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.401+0000 7fdf94f9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcb1b00580 0x55dcb1afe6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:35012/0 (socket says 172.21.15.82:35012) 2023-09-23T09:30:43.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.401+0000 7fdf94f9a700 1 -- 172.21.15.82:0/3129201694 learned_addr learned my addr 172.21.15.82:0/3129201694 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:30:43.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.401+0000 7fdf9579b700 1 --2- 172.21.15.82:0/3129201694 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55dcb1afacc0 0x55dcb1affa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:43.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.401+0000 7fdf95f9c700 1 --2- 172.21.15.82:0/3129201694 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dcb1b00ea0 0x55dcb1b0b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:43.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.401+0000 7fdf94f9a700 1 -- 172.21.15.82:0/3129201694 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55dcb1afacc0 msgr2=0x55dcb1affa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:43.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.401+0000 7fdf94f9a700 1 --2- 172.21.15.82:0/3129201694 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55dcb1afacc0 0x55dcb1affa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:43.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.401+0000 7fdf94f9a700 1 -- 172.21.15.82:0/3129201694 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dcb1b00ea0 msgr2=0x55dcb1b0b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:43.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.401+0000 7fdf94f9a700 1 --2- 172.21.15.82:0/3129201694 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dcb1b00ea0 0x55dcb1b0b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:43.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.401+0000 7fdf94f9a700 1 -- 172.21.15.82:0/3129201694 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dcb1861ce0 con 0x55dcb1b00580 2023-09-23T09:30:43.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.401+0000 7fdf94f9a700 1 --2- 172.21.15.82:0/3129201694 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcb1b00580 0x55dcb1afe6e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fdf80006010 tx=0x7fdf80021480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53e0024adfee6750 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:43.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.402+0000 7fdf7bfff700 1 -- 172.21.15.82:0/3129201694 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf8000f660 con 0x55dcb1b00580 2023-09-23T09:30:43.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.402+0000 7fdf7bfff700 1 -- 172.21.15.82:0/3129201694 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdf80005a00 con 0x55dcb1b00580 2023-09-23T09:30:43.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.402+0000 7fdf7bfff700 1 -- 172.21.15.82:0/3129201694 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf80021d10 con 0x55dcb1b00580 2023-09-23T09:30:43.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.403+0000 7fdfab2b3b80 1 -- 172.21.15.82:0/3129201694 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcb1b00580 msgr2=0x55dcb1afe6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:43.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.403+0000 7fdfab2b3b80 1 --2- 172.21.15.82:0/3129201694 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcb1b00580 0x55dcb1afe6e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fdf80006010 tx=0x7fdf80021480 comp rx=0 tx=0).stop 2023-09-23T09:30:43.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.403+0000 7fdfab2b3b80 1 -- 172.21.15.82:0/3129201694 shutdown_connections 2023-09-23T09:30:43.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.403+0000 7fdfab2b3b80 1 --2- 172.21.15.82:0/3129201694 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dcb1b00ea0 0x55dcb1b0b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:43.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.403+0000 7fdfab2b3b80 1 --2- 172.21.15.82:0/3129201694 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55dcb1afacc0 0x55dcb1affa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:43.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.403+0000 7fdfab2b3b80 1 --2- 172.21.15.82:0/3129201694 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcb1b00580 0x55dcb1afe6e0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:43.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.403+0000 7fdfab2b3b80 1 -- 172.21.15.82:0/3129201694 >> 172.21.15.82:0/3129201694 conn(0x55dcb1a6f160 msgr2=0x55dcb1af5120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:43.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.403+0000 7fdfab2b3b80 1 -- 172.21.15.82:0/3129201694 shutdown_connections 2023-09-23T09:30:43.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.404+0000 7fdfab2b3b80 1 -- 172.21.15.82:0/3129201694 wait complete. 2023-09-23T09:30:43.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.404+0000 7fdfab2b3b80 1 -- start start 2023-09-23T09:30:43.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.404+0000 7fdfab2b3b80 1 Processor -- start 2023-09-23T09:30:43.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.405+0000 7fdfab2b3b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dcb1afacc0 0x55dcb1b61d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:43.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.405+0000 7fdfab2b3b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcb1b00580 0x55dcb1b62290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:43.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.405+0000 7fdfab2b3b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55dcb1b00ea0 0x55dcb1b5c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:43.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.405+0000 7fdfab2b3b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcb1b5c710 con 0x55dcb1afacc0 2023-09-23T09:30:43.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.405+0000 7fdfab2b3b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcb1b5c880 con 0x55dcb1b00580 2023-09-23T09:30:43.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.405+0000 7fdfab2b3b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcb1b5ca40 con 0x55dcb1b00ea0 2023-09-23T09:30:43.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.405+0000 7fdfab2b3b80 10 client.0 _ll_register_callbacks cb 0x7fdf80009810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:30:43.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.406+0000 7fdf95f9c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55dcb1b00ea0 0x55dcb1b5c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:43.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.406+0000 7fdf95f9c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55dcb1b00ea0 0x55dcb1b5c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:56678/0 (socket says 172.21.15.82:56678) 2023-09-23T09:30:43.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.406+0000 7fdf95f9c700 1 -- 172.21.15.82:0/3644071722 learned_addr learned my addr 172.21.15.82:0/3644071722 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:30:43.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.407+0000 7fdf94f9a700 1 --2- 172.21.15.82:0/3644071722 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcb1b00580 0x55dcb1b62290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:43.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.407+0000 7fdf9579b700 1 --2- 172.21.15.82:0/3644071722 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dcb1afacc0 0x55dcb1b61d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:43.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.407+0000 7fdf95f9c700 1 -- 172.21.15.82:0/3644071722 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcb1b00580 msgr2=0x55dcb1b62290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:43.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.407+0000 7fdf95f9c700 1 --2- 172.21.15.82:0/3644071722 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcb1b00580 0x55dcb1b62290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:43.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.407+0000 7fdf95f9c700 1 -- 172.21.15.82:0/3644071722 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dcb1afacc0 msgr2=0x55dcb1b61d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:43.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.407+0000 7fdf95f9c700 1 --2- 172.21.15.82:0/3644071722 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dcb1afacc0 0x55dcb1b61d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:43.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.407+0000 7fdf95f9c700 1 -- 172.21.15.82:0/3644071722 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dcb1878e60 con 0x55dcb1b00ea0 2023-09-23T09:30:43.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.408+0000 7fdf95f9c700 1 --2- 172.21.15.82:0/3644071722 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55dcb1b00ea0 0x55dcb1b5c130 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fdf880159b0 tx=0x7fdf88009450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3680d231accd13a9 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:43.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.408+0000 7fdf78ff9700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T09:30:43.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.408+0000 7fdf78ff9700 1 -- 172.21.15.82:0/3644071722 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf88011040 con 0x55dcb1b00ea0 2023-09-23T09:30:43.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.408+0000 7fdf78ff9700 1 -- 172.21.15.82:0/3644071722 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(143..143 src has 1..143) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fdf88006e40 con 0x55dcb1b00ea0 2023-09-23T09:30:43.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.409+0000 7fdfab2b3b80 1 -- 172.21.15.82:0/3644071722 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dcb1aed930 con 0x55dcb1b00ea0 2023-09-23T09:30:43.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.409+0000 7fdf78ff9700 1 -- 172.21.15.82:0/3644071722 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=100) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdf8800aca0 con 0x55dcb1b00ea0 2023-09-23T09:30:43.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.410+0000 7fdfab2b3b80 10 client.27409 fetch_fsmap learned FSMap version 100 2023-09-23T09:30:43.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.410+0000 7fdfab2b3b80 1 -- 172.21.15.82:0/3644071722 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=100,monmap=4+}) v3 -- 0x55dcb189f2d0 con 0x55dcb1b00ea0 2023-09-23T09:30:43.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.411+0000 7fdf78ff9700 1 -- 172.21.15.82:0/3644071722 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55dcb1aed930 con 0x55dcb1b00ea0 2023-09-23T09:30:43.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.411+0000 7fdf78ff9700 1 -- 172.21.15.82:0/3644071722 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 100) v1 ==== 7946+0+0 (secure 0 0 0) 0x7fdf8802b070 con 0x55dcb1b00ea0 2023-09-23T09:30:43.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.411+0000 7fdfab2b3b80 10 client.27409 fetch_fsmap finished waiting for FSMap version 100 2023-09-23T09:30:43.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.411+0000 7fdfab2b3b80 10 client.27409 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:30:43.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.411+0000 7fdfab2b3b80 20 client.27409 populate_metadata read hostname 'smithi082' 2023-09-23T09:30:43.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.412+0000 7fdfab2b3b80 1 --2- 172.21.15.82:0/3644071722 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55dcb1b69cb0 0x55dcb1b6c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:43.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.412+0000 7fdfab2b3b80 4 client.27409 mds_command: new command op to 24557 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-09-23T09:30:43.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.412+0000 7fdfab2b3b80 1 -- 172.21.15.82:0/3644071722 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55dcb1a459f0 con 0x55dcb1b69cb0 2023-09-23T09:30:43.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.412+0000 7fdf9579b700 1 --2- 172.21.15.82:0/3644071722 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55dcb1b69cb0 0x55dcb1b6c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:43.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.415+0000 7fdf9579b700 1 --2- 172.21.15.82:0/3644071722 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55dcb1b69cb0 0x55dcb1b6c0d0 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce6bda6fdbf7d89a server_cookie=1c5e5a567b80bf41 in_seq=0 out_seq=0 2023-09-23T09:30:43.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.415+0000 7fdf78ff9700 10 client.27409 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:30:43.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.416+0000 7fdf78ff9700 1 -- 172.21.15.82:0/3644071722 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55dcb1a459f0 con 0x55dcb1b69cb0 2023-09-23T09:30:43.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.416+0000 7fdf78ff9700 10 client.27409 handle_command_reply: tid=0 2023-09-23T09:30:43.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.416+0000 7fdfab2b3b80 1 client.27409 shutdown 2023-09-23T09:30:43.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.417+0000 7fdfab2b3b80 1 -- 172.21.15.82:0/3644071722 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55dcb1b00ea0 msgr2=0x55dcb1b5c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:43.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.417+0000 7fdfab2b3b80 1 --2- 172.21.15.82:0/3644071722 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55dcb1b00ea0 0x55dcb1b5c130 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fdf880159b0 tx=0x7fdf88009450 comp rx=0 tx=0).stop 2023-09-23T09:30:43.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.417+0000 7fdfab2b3b80 1 -- 172.21.15.82:0/3644071722 shutdown_connections 2023-09-23T09:30:43.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.417+0000 7fdfab2b3b80 1 --2- 172.21.15.82:0/3644071722 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55dcb1b00ea0 0x55dcb1b5c130 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:43.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.417+0000 7fdfab2b3b80 1 --2- 172.21.15.82:0/3644071722 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55dcb1b69cb0 0x55dcb1b6c0d0 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:43.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.417+0000 7fdfab2b3b80 1 --2- 172.21.15.82:0/3644071722 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dcb1afacc0 0x55dcb1b61d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:43.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.417+0000 7fdfab2b3b80 1 --2- 172.21.15.82:0/3644071722 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcb1b00580 0x55dcb1b62290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:43.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.417+0000 7fdfab2b3b80 1 -- 172.21.15.82:0/3644071722 >> 172.21.15.82:0/3644071722 conn(0x55dcb1a6f160 msgr2=0x55dcb1af9770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:43.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.417+0000 7fdf78ff9700 0 client.27409 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:30:43.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.418+0000 7fdfab2b3b80 1 -- 172.21.15.82:0/3644071722 shutdown_connections 2023-09-23T09:30:43.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.418+0000 7fdfab2b3b80 1 -- 172.21.15.82:0/3644071722 wait complete. 2023-09-23T09:30:43.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.419+0000 7fdfab2b3b80 20 client.27409 trim_cache size 0 max 16384 2023-09-23T09:30:43.421 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:30:43.421 INFO:teuthology.orchestra.run.smithi082.stdout: "return_code": 0, 2023-09-23T09:30:43.421 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_tag": "1bf2f9b8-9ce6-41cc-b047-379c24ec4afd", 2023-09-23T09:30:43.421 INFO:teuthology.orchestra.run.smithi082.stdout: "mode": "asynchronous" 2023-09-23T09:30:43.421 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:30:43.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.420+0000 7fdf9679d700 1 -- 172.21.15.82:0/3627083630 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fdf7c0a02b0 msgr2=0x7fdf7c0a2770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:43.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.420+0000 7fdf9679d700 1 --2- 172.21.15.82:0/3627083630 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fdf7c0a02b0 0x7fdf7c0a2770 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fdf88009f80 tx=0x7fdf8800e040 comp rx=0 tx=0).stop 2023-09-23T09:30:43.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.420+0000 7fdf9679d700 1 -- 172.21.15.82:0/3627083630 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf90107760 msgr2=0x7fdf9006ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:43.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.420+0000 7fdf9679d700 1 --2- 172.21.15.82:0/3627083630 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf90107760 0x7fdf9006ae60 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c00b530 tx=0x7fdf8c00b8f0 comp rx=0 tx=0).stop 2023-09-23T09:30:43.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.420+0000 7fdf9679d700 1 -- 172.21.15.82:0/3627083630 shutdown_connections 2023-09-23T09:30:43.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.420+0000 7fdf9679d700 1 --2- 172.21.15.82:0/3627083630 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fdf7c0a02b0 0x7fdf7c0a2770 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:43.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.420+0000 7fdf9679d700 1 --2- 172.21.15.82:0/3627083630 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf9010bd40 0x7fdf901b1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:43.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.420+0000 7fdf9679d700 1 --2- 172.21.15.82:0/3627083630 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf90107760 0x7fdf9006ae60 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:43.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.420+0000 7fdf9679d700 1 --2- 172.21.15.82:0/3627083630 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf90108120 0x7fdf9006b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:43.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.420+0000 7fdf9679d700 1 -- 172.21.15.82:0/3627083630 >> 172.21.15.82:0/3627083630 conn(0x7fdf90076310 msgr2=0x7fdf90109c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:43.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.420+0000 7fdf9679d700 1 -- 172.21.15.82:0/3627083630 shutdown_connections 2023-09-23T09:30:43.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.421+0000 7fdf9679d700 1 -- 172.21.15.82:0/3627083630 wait complete. 2023-09-23T09:30:43.465 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:30:43.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.846+0000 7f104e7ff700 1 -- 172.21.15.82:0/2369757212 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1048108540 msgr2=0x7f104810bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:43.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.846+0000 7f104e7ff700 1 --2- 172.21.15.82:0/2369757212 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1048108540 0x7f104810bf70 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f103c0098f0 tx=0x7f103c009c00 comp rx=0 tx=0).stop 2023-09-23T09:30:43.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.848+0000 7f104e7ff700 1 -- 172.21.15.82:0/2369757212 shutdown_connections 2023-09-23T09:30:43.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.848+0000 7f104e7ff700 1 --2- 172.21.15.82:0/2369757212 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f104810c6a0 0x7f1048114260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:43.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.848+0000 7f104e7ff700 1 --2- 172.21.15.82:0/2369757212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1048107b90 0x7f1048107f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:43.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.848+0000 7f104e7ff700 1 --2- 172.21.15.82:0/2369757212 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1048108540 0x7f104810bf70 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:43.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.848+0000 7f104e7ff700 1 -- 172.21.15.82:0/2369757212 >> 172.21.15.82:0/2369757212 conn(0x7f104806ce40 msgr2=0x7f104806d250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:43.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.848+0000 7f104e7ff700 1 -- 172.21.15.82:0/2369757212 shutdown_connections 2023-09-23T09:30:43.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.848+0000 7f104e7ff700 1 -- 172.21.15.82:0/2369757212 wait complete. 2023-09-23T09:30:43.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.849+0000 7f104e7ff700 1 Processor -- start 2023-09-23T09:30:43.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.850+0000 7f104e7ff700 1 -- start start 2023-09-23T09:30:43.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.850+0000 7f104e7ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1048107b90 0x7f1048116c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:43.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.850+0000 7f104e7ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f104810c6a0 0x7f1048117150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:43.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.850+0000 7f104e7ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1048117690 0x7f10481b19d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:43.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.850+0000 7f104e7ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10481b1f10 con 0x7f104810c6a0 2023-09-23T09:30:43.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.850+0000 7f104e7ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10481a1170 con 0x7f1048117690 2023-09-23T09:30:43.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.850+0000 7f104e7ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10481a12e0 con 0x7f1048107b90 2023-09-23T09:30:43.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.851+0000 7f10477fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f104810c6a0 0x7f1048117150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:43.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.852+0000 7f10477fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f104810c6a0 0x7f1048117150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55068/0 (socket says 172.21.15.82:55068) 2023-09-23T09:30:43.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.852+0000 7f10477fe700 1 -- 172.21.15.82:0/828080692 learned_addr learned my addr 172.21.15.82:0/828080692 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:30:43.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.852+0000 7f104cd9c700 1 --2- 172.21.15.82:0/828080692 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1048117690 0x7f10481b19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:43.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.852+0000 7f1047fff700 1 --2- 172.21.15.82:0/828080692 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1048107b90 0x7f1048116c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:43.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.852+0000 7f10477fe700 1 -- 172.21.15.82:0/828080692 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1048107b90 msgr2=0x7f1048116c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:43.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.852+0000 7f10477fe700 1 --2- 172.21.15.82:0/828080692 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1048107b90 0x7f1048116c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:43.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.852+0000 7f10477fe700 1 -- 172.21.15.82:0/828080692 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1048117690 msgr2=0x7f10481b19d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:43.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.852+0000 7f10477fe700 1 --2- 172.21.15.82:0/828080692 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1048117690 0x7f10481b19d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:43.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.852+0000 7f10477fe700 1 -- 172.21.15.82:0/828080692 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f103c009520 con 0x7f104810c6a0 2023-09-23T09:30:43.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.852+0000 7f1047fff700 1 --2- 172.21.15.82:0/828080692 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1048107b90 0x7f1048116c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:30:43.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.853+0000 7f10477fe700 1 --2- 172.21.15.82:0/828080692 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f104810c6a0 0x7f1048117150 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f103c009230 tx=0x7f103c00fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:43.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.854+0000 7f10457fa700 1 -- 172.21.15.82:0/828080692 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f103c01c070 con 0x7f104810c6a0 2023-09-23T09:30:43.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.854+0000 7f10457fa700 1 -- 172.21.15.82:0/828080692 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f103c00baf0 con 0x7f104810c6a0 2023-09-23T09:30:43.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.854+0000 7f10457fa700 1 -- 172.21.15.82:0/828080692 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f103c004930 con 0x7f104810c6a0 2023-09-23T09:30:43.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.854+0000 7f104e7ff700 1 -- 172.21.15.82:0/828080692 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10481a1560 con 0x7f104810c6a0 2023-09-23T09:30:43.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.854+0000 7f104e7ff700 1 -- 172.21.15.82:0/828080692 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10481a1a20 con 0x7f104810c6a0 2023-09-23T09:30:43.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.861+0000 7f106219db80 1 Processor -- start 2023-09-23T09:30:43.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.863+0000 7f106219db80 1 -- start start 2023-09-23T09:30:43.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.863+0000 7f106219db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b437e08380 0x55b437e08760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:43.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.863+0000 7f106219db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b437e08ca0 0x55b437e02700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:43.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.863+0000 7f106219db80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b437e02c40 0x55b437e030a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:43.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.864+0000 7f106219db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b437d6a7b0 con 0x55b437e08380 2023-09-23T09:30:43.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.864+0000 7f106219db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b437d5b780 con 0x55b437e08ca0 2023-09-23T09:30:43.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.864+0000 7f106219db80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b437d590a0 con 0x55b437e02c40 2023-09-23T09:30:43.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.866+0000 7f10457fa700 1 -- 172.21.15.82:0/828080692 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f103c020070 con 0x7f104810c6a0 2023-09-23T09:30:43.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.867+0000 7f10477fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b437e02c40 0x55b437e030a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:43.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.867+0000 7f10477fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b437e02c40 0x55b437e030a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:56704/0 (socket says 172.21.15.82:56704) 2023-09-23T09:30:43.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.867+0000 7f10477fe700 1 -- 172.21.15.82:0/205657430 learned_addr learned my addr 172.21.15.82:0/205657430 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:30:43.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.868+0000 7f10477fe700 1 -- 172.21.15.82:0/205657430 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b437e08ca0 msgr2=0x55b437e02700 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-23T09:30:43.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.868+0000 7f10477fe700 1 --2- 172.21.15.82:0/205657430 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b437e08ca0 0x55b437e02700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:43.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.868+0000 7f10477fe700 1 -- 172.21.15.82:0/205657430 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b437e08380 msgr2=0x55b437e08760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:43.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.868+0000 7f10477fe700 1 --2- 172.21.15.82:0/205657430 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b437e08380 0x55b437e08760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:43.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.868+0000 7f10477fe700 1 -- 172.21.15.82:0/205657430 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b437bd4630 con 0x55b437e02c40 2023-09-23T09:30:43.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.868+0000 7f10457fa700 1 --2- 172.21.15.82:0/828080692 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f10300a0180 0x7f10300a2640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:43.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.869+0000 7f10457fa700 1 -- 172.21.15.82:0/828080692 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f103c0cbee0 con 0x7f104810c6a0 2023-09-23T09:30:43.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.870+0000 7f10477fe700 1 --2- 172.21.15.82:0/205657430 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b437e02c40 0x55b437e030a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f103c0c9510 tx=0x7f103c0cfdf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3d6b36559e09818 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:43.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.870+0000 7f102e7fc700 1 -- 172.21.15.82:0/205657430 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f103c005040 con 0x55b437e02c40 2023-09-23T09:30:43.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.870+0000 7f102e7fc700 1 -- 172.21.15.82:0/205657430 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f103c0cfa60 con 0x55b437e02c40 2023-09-23T09:30:43.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.870+0000 7f102e7fc700 1 -- 172.21.15.82:0/205657430 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f103c098f80 con 0x55b437e02c40 2023-09-23T09:30:43.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.872+0000 7f106219db80 1 -- 172.21.15.82:0/205657430 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b437e02c40 msgr2=0x55b437e030a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:43.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.872+0000 7f106219db80 1 --2- 172.21.15.82:0/205657430 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b437e02c40 0x55b437e030a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f103c0c9510 tx=0x7f103c0cfdf0 comp rx=0 tx=0).stop 2023-09-23T09:30:43.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.873+0000 7f106219db80 1 -- 172.21.15.82:0/205657430 shutdown_connections 2023-09-23T09:30:43.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.873+0000 7f106219db80 1 --2- 172.21.15.82:0/205657430 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b437e02c40 0x55b437e030a0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:43.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.873+0000 7f106219db80 1 --2- 172.21.15.82:0/205657430 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b437e08380 0x55b437e08760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:43.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.873+0000 7f106219db80 1 --2- 172.21.15.82:0/205657430 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b437e08ca0 0x55b437e02700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:43.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.873+0000 7f106219db80 1 -- 172.21.15.82:0/205657430 >> 172.21.15.82:0/205657430 conn(0x55b437d770e0 msgr2=0x55b437dfd410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:43.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.876+0000 7f106219db80 1 -- 172.21.15.82:0/205657430 shutdown_connections 2023-09-23T09:30:43.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.877+0000 7f104cd9c700 1 --2- 172.21.15.82:0/828080692 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f10300a0180 0x7f10300a2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:43.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.877+0000 7f106219db80 1 -- 172.21.15.82:0/205657430 wait complete. 2023-09-23T09:30:43.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.878+0000 7f106219db80 1 -- start start 2023-09-23T09:30:43.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.878+0000 7f106219db80 1 Processor -- start 2023-09-23T09:30:43.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.879+0000 7f106219db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b437e02c40 0x55b437e0ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:43.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.879+0000 7f106219db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b437e08380 0x55b437e0bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:43.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.879+0000 7f106219db80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b437e08ca0 0x55b437e0c550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:43.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.879+0000 7f106219db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b437d54990 con 0x55b437e08380 2023-09-23T09:30:43.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.879+0000 7f106219db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b437cf2bb0 con 0x55b437e02c40 2023-09-23T09:30:43.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.879+0000 7f106219db80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b437cf28b0 con 0x55b437e08ca0 2023-09-23T09:30:43.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.879+0000 7f106219db80 10 client.0 _ll_register_callbacks cb 0x55b437c3ca80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:30:43.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.879+0000 7f104cd9c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b437e08ca0 0x55b437e0c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:43.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.880+0000 7f104cd9c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b437e08ca0 0x55b437e0c550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:56718/0 (socket says 172.21.15.82:56718) 2023-09-23T09:30:43.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.880+0000 7f104cd9c700 1 -- 172.21.15.82:0/4098284622 learned_addr learned my addr 172.21.15.82:0/4098284622 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:30:43.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.880+0000 7f1047fff700 1 --2- 172.21.15.82:0/4098284622 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b437e02c40 0x55b437e0ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:43.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.880+0000 7f10477fe700 1 --2- 172.21.15.82:0/4098284622 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b437e08380 0x55b437e0bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:43.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.881+0000 7f1047fff700 1 -- 172.21.15.82:0/4098284622 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b437e08ca0 msgr2=0x55b437e0c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:43.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.881+0000 7f1047fff700 1 --2- 172.21.15.82:0/4098284622 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b437e08ca0 0x55b437e0c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:43.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.881+0000 7f1047fff700 1 -- 172.21.15.82:0/4098284622 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b437e08380 msgr2=0x55b437e0bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:43.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.881+0000 7f1047fff700 1 --2- 172.21.15.82:0/4098284622 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b437e08380 0x55b437e0bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:43.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.881+0000 7f1047fff700 1 -- 172.21.15.82:0/4098284622 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10481a1a20 con 0x55b437e02c40 2023-09-23T09:30:43.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.881+0000 7f104cd9c700 1 --2- 172.21.15.82:0/828080692 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f10300a0180 0x7f10300a2640 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1040004b10 tx=0x7f1040009920 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:43.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.881+0000 7f1047fff700 1 --2- 172.21.15.82:0/4098284622 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b437e02c40 0x55b437e0ebe0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f1038005fd0 tx=0x7f10380106d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=31a93bb0f4778a67 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:43.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.881+0000 7f10277fe700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-09-23T09:30:43.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.888+0000 7f10277fe700 1 -- 172.21.15.82:0/4098284622 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1038012620 con 0x55b437e02c40 2023-09-23T09:30:43.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.888+0000 7f10277fe700 1 -- 172.21.15.82:0/4098284622 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(143..143 src has 1..143) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f1038012780 con 0x55b437e02c40 2023-09-23T09:30:43.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.888+0000 7f106219db80 1 -- 172.21.15.82:0/4098284622 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b437dd21c0 con 0x55b437e02c40 2023-09-23T09:30:43.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.904+0000 7f10277fe700 1 -- 172.21.15.82:0/4098284622 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=100) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1038012940 con 0x55b437e02c40 2023-09-23T09:30:43.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.905+0000 7f106219db80 10 client.27377 fetch_fsmap learned FSMap version 100 2023-09-23T09:30:43.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.905+0000 7f106219db80 1 -- 172.21.15.82:0/4098284622 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=100,monmap=4+}) v3 -- 0x55b437b80de0 con 0x55b437e02c40 2023-09-23T09:30:43.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.906+0000 7f10277fe700 1 -- 172.21.15.82:0/4098284622 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b437dd21c0 con 0x55b437e02c40 2023-09-23T09:30:43.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.906+0000 7f10277fe700 1 -- 172.21.15.82:0/4098284622 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 100) v1 ==== 7946+0+0 (secure 0 0 0) 0x7f1038026c30 con 0x55b437e02c40 2023-09-23T09:30:43.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.906+0000 7f106219db80 10 client.27377 fetch_fsmap finished waiting for FSMap version 100 2023-09-23T09:30:43.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.906+0000 7f106219db80 10 client.27377 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:30:43.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.906+0000 7f106219db80 20 client.27377 populate_metadata read hostname 'smithi082' 2023-09-23T09:30:43.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.906+0000 7f106219db80 1 --2- 172.21.15.82:0/4098284622 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55b437e1c3a0 0x55b437e1e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:43.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.906+0000 7f106219db80 4 client.27377 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:30:43.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.906+0000 7f106219db80 1 -- 172.21.15.82:0/4098284622 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b437cfaba0 con 0x55b437e1c3a0 2023-09-23T09:30:43.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.908+0000 7f10477fe700 1 --2- 172.21.15.82:0/4098284622 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55b437e1c3a0 0x55b437e1e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:43.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.911+0000 7f10477fe700 1 --2- 172.21.15.82:0/4098284622 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55b437e1c3a0 0x55b437e1e7c0 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=92ac5e689a2525b3 server_cookie=7a4d80b103438bdc in_seq=0 out_seq=0 2023-09-23T09:30:43.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.911+0000 7f10277fe700 10 client.27377 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:30:43.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.914+0000 7f10277fe700 1 -- 172.21.15.82:0/4098284622 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b437cfaba0 con 0x55b437e1c3a0 2023-09-23T09:30:43.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.914+0000 7f10277fe700 10 client.27377 handle_command_reply: tid=0 2023-09-23T09:30:43.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.914+0000 7f106219db80 1 client.27377 shutdown 2023-09-23T09:30:43.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.915+0000 7f106219db80 1 -- 172.21.15.82:0/4098284622 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b437e02c40 msgr2=0x55b437e0ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:43.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.915+0000 7f106219db80 1 --2- 172.21.15.82:0/4098284622 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b437e02c40 0x55b437e0ebe0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f1038005fd0 tx=0x7f10380106d0 comp rx=0 tx=0).stop 2023-09-23T09:30:43.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.916+0000 7f106219db80 1 -- 172.21.15.82:0/4098284622 shutdown_connections 2023-09-23T09:30:43.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.916+0000 7f106219db80 1 --2- 172.21.15.82:0/4098284622 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b437e08ca0 0x55b437e0c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:43.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.916+0000 7f106219db80 1 --2- 172.21.15.82:0/4098284622 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b437e02c40 0x55b437e0ebe0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:43.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.916+0000 7f106219db80 1 --2- 172.21.15.82:0/4098284622 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55b437e1c3a0 0x55b437e1e7c0 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:43.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.916+0000 7f106219db80 1 --2- 172.21.15.82:0/4098284622 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b437e08380 0x55b437e0bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:43.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.916+0000 7f106219db80 1 -- 172.21.15.82:0/4098284622 >> 172.21.15.82:0/4098284622 conn(0x55b437d770e0 msgr2=0x55b437df7b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:43.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.916+0000 7f10277fe700 0 client.27377 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:30:43.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.916+0000 7f106219db80 1 -- 172.21.15.82:0/4098284622 shutdown_connections 2023-09-23T09:30:43.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.916+0000 7f106219db80 1 -- 172.21.15.82:0/4098284622 wait complete. 2023-09-23T09:30:43.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.918+0000 7f106219db80 20 client.27377 trim_cache size 0 max 16384 2023-09-23T09:30:43.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.953+0000 7f106219db80 1 Processor -- start 2023-09-23T09:30:43.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.953+0000 7f106219db80 1 -- start start 2023-09-23T09:30:43.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.953+0000 7f106219db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b437e02c40 0x55b437e0e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:43.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.953+0000 7f106219db80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b437e08380 0x55b437e06090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:43.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.953+0000 7f106219db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b437e08ca0 0x55b437e065d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:43.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.953+0000 7f106219db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b437bd6920 con 0x55b437e08ca0 2023-09-23T09:30:43.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.953+0000 7f106219db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b437dfed40 con 0x55b437e02c40 2023-09-23T09:30:43.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.953+0000 7f106219db80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b437e18d00 con 0x55b437e08380 2023-09-23T09:30:43.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.955+0000 7f104cd9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b437e08ca0 0x55b437e065d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:43.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.955+0000 7f104cd9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b437e08ca0 0x55b437e065d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55102/0 (socket says 172.21.15.82:55102) 2023-09-23T09:30:43.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.955+0000 7f104cd9c700 1 -- 172.21.15.82:0/3580800981 learned_addr learned my addr 172.21.15.82:0/3580800981 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:30:43.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.955+0000 7f104cd9c700 1 -- 172.21.15.82:0/3580800981 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b437e08380 msgr2=0x55b437e06090 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-23T09:30:43.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.955+0000 7f104cd9c700 1 --2- 172.21.15.82:0/3580800981 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b437e08380 0x55b437e06090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:43.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.955+0000 7f104cd9c700 1 -- 172.21.15.82:0/3580800981 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b437e02c40 msgr2=0x55b437e0e780 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-23T09:30:43.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.955+0000 7f104cd9c700 1 --2- 172.21.15.82:0/3580800981 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b437e02c40 0x55b437e0e780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:43.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.955+0000 7f104cd9c700 1 -- 172.21.15.82:0/3580800981 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b437b69c60 con 0x55b437e08ca0 2023-09-23T09:30:43.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.956+0000 7f104cd9c700 1 --2- 172.21.15.82:0/3580800981 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b437e08ca0 0x55b437e065d0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f10400176e0 tx=0x7f104001f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6d9e55e3b5e1f82 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:43.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.957+0000 7f102effd700 1 -- 172.21.15.82:0/3580800981 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f104000e040 con 0x55b437e08ca0 2023-09-23T09:30:43.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.957+0000 7f102effd700 1 -- 172.21.15.82:0/3580800981 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f104000f040 con 0x55b437e08ca0 2023-09-23T09:30:43.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.957+0000 7f102effd700 1 -- 172.21.15.82:0/3580800981 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1040015790 con 0x55b437e08ca0 2023-09-23T09:30:43.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.958+0000 7f106219db80 1 -- 172.21.15.82:0/3580800981 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b437e08ca0 msgr2=0x55b437e065d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:43.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.958+0000 7f106219db80 1 --2- 172.21.15.82:0/3580800981 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b437e08ca0 0x55b437e065d0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f10400176e0 tx=0x7f104001f000 comp rx=0 tx=0).stop 2023-09-23T09:30:43.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.958+0000 7f106219db80 1 -- 172.21.15.82:0/3580800981 shutdown_connections 2023-09-23T09:30:43.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.958+0000 7f106219db80 1 --2- 172.21.15.82:0/3580800981 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b437e08ca0 0x55b437e065d0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:43.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.958+0000 7f106219db80 1 --2- 172.21.15.82:0/3580800981 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b437e02c40 0x55b437e0e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:43.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.958+0000 7f106219db80 1 --2- 172.21.15.82:0/3580800981 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b437e08380 0x55b437e06090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:43.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.958+0000 7f106219db80 1 -- 172.21.15.82:0/3580800981 >> 172.21.15.82:0/3580800981 conn(0x55b437d770e0 msgr2=0x55b437dfd110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:43.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.958+0000 7f106219db80 1 -- 172.21.15.82:0/3580800981 shutdown_connections 2023-09-23T09:30:43.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.959+0000 7f106219db80 1 -- 172.21.15.82:0/3580800981 wait complete. 2023-09-23T09:30:43.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.959+0000 7f106219db80 1 -- start start 2023-09-23T09:30:43.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.959+0000 7f106219db80 1 Processor -- start 2023-09-23T09:30:43.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.960+0000 7f106219db80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b437e02c40 0x55b437e0f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:43.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.960+0000 7f106219db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b437e08380 0x55b437e0fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:43.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.960+0000 7f106219db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b437e08ca0 0x55b437e6f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:43.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.960+0000 7f106219db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b437e103a0 con 0x55b437e08380 2023-09-23T09:30:43.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.960+0000 7f106219db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b437e6f6f0 con 0x55b437e08ca0 2023-09-23T09:30:43.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.960+0000 7f106219db80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b437e6f8b0 con 0x55b437e02c40 2023-09-23T09:30:43.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.960+0000 7f106219db80 10 client.0 _ll_register_callbacks cb 0x55b437c3ca80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:30:43.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.961+0000 7f1047fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b437e02c40 0x55b437e0f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:43.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.961+0000 7f1047fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b437e02c40 0x55b437e0f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:56726/0 (socket says 172.21.15.82:56726) 2023-09-23T09:30:43.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.961+0000 7f1047fff700 1 -- 172.21.15.82:0/3646384477 learned_addr learned my addr 172.21.15.82:0/3646384477 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:30:43.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.962+0000 7f104cd9c700 1 --2- 172.21.15.82:0/3646384477 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b437e08ca0 0x55b437e6f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:43.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.962+0000 7f10477fe700 1 --2- 172.21.15.82:0/3646384477 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b437e08380 0x55b437e0fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:43.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.962+0000 7f1047fff700 1 -- 172.21.15.82:0/3646384477 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b437e08ca0 msgr2=0x55b437e6f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:43.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.962+0000 7f1047fff700 1 --2- 172.21.15.82:0/3646384477 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b437e08ca0 0x55b437e6f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:43.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.962+0000 7f1047fff700 1 -- 172.21.15.82:0/3646384477 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b437e08380 msgr2=0x55b437e0fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:30:43.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.962+0000 7f1047fff700 1 --2- 172.21.15.82:0/3646384477 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b437e08380 0x55b437e0fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:43.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.962+0000 7f1047fff700 1 -- 172.21.15.82:0/3646384477 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f104001c040 con 0x55b437e02c40 2023-09-23T09:30:43.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.980+0000 7f1047fff700 1 --2- 172.21.15.82:0/3646384477 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b437e02c40 0x55b437e0f650 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f1038001eb0 tx=0x7f1038026700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1217e4eef50ece4c server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:30:43.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.981+0000 7f10277fe700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T09:30:43.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.981+0000 7f10277fe700 1 -- 172.21.15.82:0/3646384477 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1038005a00 con 0x55b437e02c40 2023-09-23T09:30:43.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.981+0000 7f10277fe700 1 -- 172.21.15.82:0/3646384477 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(143..143 src has 1..143) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f103802a070 con 0x55b437e02c40 2023-09-23T09:30:43.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.981+0000 7f106219db80 1 -- 172.21.15.82:0/3646384477 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b437df58b0 con 0x55b437e02c40 2023-09-23T09:30:43.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.991+0000 7f10277fe700 1 -- 172.21.15.82:0/3646384477 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=100) v2 ==== 24+0+0 (secure 0 0 0) 0x7f103801ce70 con 0x55b437e02c40 2023-09-23T09:30:43.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.993+0000 7f106219db80 10 client.27424 fetch_fsmap learned FSMap version 100 2023-09-23T09:30:43.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.993+0000 7f106219db80 1 -- 172.21.15.82:0/3646384477 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=100,monmap=4+}) v3 -- 0x55b437ba7250 con 0x55b437e02c40 2023-09-23T09:30:43.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.994+0000 7f10277fe700 1 -- 172.21.15.82:0/3646384477 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b437df58b0 con 0x55b437e02c40 2023-09-23T09:30:43.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.994+0000 7f10277fe700 1 -- 172.21.15.82:0/3646384477 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 100) v1 ==== 7946+0+0 (secure 0 0 0) 0x7f1038004710 con 0x55b437e02c40 2023-09-23T09:30:43.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.994+0000 7f106219db80 10 client.27424 fetch_fsmap finished waiting for FSMap version 100 2023-09-23T09:30:43.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.994+0000 7f106219db80 10 client.27424 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:30:43.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.994+0000 7f106219db80 20 client.27424 populate_metadata read hostname 'smithi082' 2023-09-23T09:30:43.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.994+0000 7f106219db80 1 --2- 172.21.15.82:0/3646384477 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55b437e71040 0x55b437e73460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:30:43.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.994+0000 7f106219db80 4 client.27424 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:30:43.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.994+0000 7f106219db80 1 -- 172.21.15.82:0/3646384477 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55b437d4d970 con 0x55b437e71040 2023-09-23T09:30:43.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.996+0000 7f10477fe700 1 --2- 172.21.15.82:0/3646384477 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55b437e71040 0x55b437e73460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:30:43.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.997+0000 7f10477fe700 1 --2- 172.21.15.82:0/3646384477 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55b437e71040 0x55b437e73460 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=919458d87e5ad8f4 server_cookie=6ae4d2a0fdeefb6e in_seq=0 out_seq=0 2023-09-23T09:30:43.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.998+0000 7f10277fe700 10 client.27424 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:30:43.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.998+0000 7f10277fe700 1 -- 172.21.15.82:0/3646384477 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55b437d4d970 con 0x55b437e71040 2023-09-23T09:30:43.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.998+0000 7f10277fe700 10 client.27424 handle_command_reply: tid=0 2023-09-23T09:30:43.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.998+0000 7f106219db80 1 client.27424 shutdown 2023-09-23T09:30:44.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.999+0000 7f106219db80 1 -- 172.21.15.82:0/3646384477 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b437e02c40 msgr2=0x55b437e0f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:44.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:43.999+0000 7f106219db80 1 --2- 172.21.15.82:0/3646384477 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b437e02c40 0x55b437e0f650 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f1038001eb0 tx=0x7f1038026700 comp rx=0 tx=0).stop 2023-09-23T09:30:44.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:44.000+0000 7f106219db80 1 -- 172.21.15.82:0/3646384477 shutdown_connections 2023-09-23T09:30:44.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:44.000+0000 7f106219db80 1 --2- 172.21.15.82:0/3646384477 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b437e08ca0 0x55b437e6f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:44.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:44.000+0000 7f106219db80 1 --2- 172.21.15.82:0/3646384477 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b437e02c40 0x55b437e0f650 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:44.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:44.000+0000 7f106219db80 1 --2- 172.21.15.82:0/3646384477 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55b437e71040 0x55b437e73460 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:44.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:44.000+0000 7f106219db80 1 --2- 172.21.15.82:0/3646384477 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b437e08380 0x55b437e0fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:44.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:44.000+0000 7f106219db80 1 -- 172.21.15.82:0/3646384477 >> 172.21.15.82:0/3646384477 conn(0x55b437d770e0 msgr2=0x55b437e06090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:44.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:44.000+0000 7f10277fe700 0 client.27424 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:30:44.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:44.000+0000 7f106219db80 1 -- 172.21.15.82:0/3646384477 shutdown_connections 2023-09-23T09:30:44.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:44.001+0000 7f106219db80 1 -- 172.21.15.82:0/3646384477 wait complete. 2023-09-23T09:30:44.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:44.001+0000 7f106219db80 20 client.27424 trim_cache size 0 max 16384 2023-09-23T09:30:44.003 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:30:44.003 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "IDLE (waiting for more scrubs)", 2023-09-23T09:30:44.003 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:30:44.003 INFO:teuthology.orchestra.run.smithi082.stdout: "1bf2f9b8-9ce6-41cc-b047-379c24ec4afd": { 2023-09-23T09:30:44.004 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:30:44.004 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "1bf2f9b8-9ce6-41cc-b047-379c24ec4afd", 2023-09-23T09:30:44.004 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:30:44.004 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:30:44.004 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:30:44.004 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:30:44.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:44.006+0000 7f104e7ff700 1 -- 172.21.15.82:0/828080692 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f10300a0180 msgr2=0x7f10300a2640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:44.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:44.006+0000 7f104e7ff700 1 --2- 172.21.15.82:0/828080692 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f10300a0180 0x7f10300a2640 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1040004b10 tx=0x7f1040009920 comp rx=0 tx=0).stop 2023-09-23T09:30:44.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:44.006+0000 7f104e7ff700 1 -- 172.21.15.82:0/828080692 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f104810c6a0 msgr2=0x7f1048117150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:30:44.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:44.006+0000 7f104e7ff700 1 --2- 172.21.15.82:0/828080692 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f104810c6a0 0x7f1048117150 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f103c009230 tx=0x7f103c00fa00 comp rx=0 tx=0).stop 2023-09-23T09:30:44.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:44.007+0000 7f104e7ff700 1 -- 172.21.15.82:0/828080692 shutdown_connections 2023-09-23T09:30:44.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:44.007+0000 7f104e7ff700 1 --2- 172.21.15.82:0/828080692 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f10300a0180 0x7f10300a2640 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:44.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:44.007+0000 7f104e7ff700 1 --2- 172.21.15.82:0/828080692 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1048117690 0x7f10481b19d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:44.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:44.007+0000 7f104e7ff700 1 --2- 172.21.15.82:0/828080692 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1048107b90 0x7f1048116c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:30:44.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:44.007+0000 7f104e7ff700 1 --2- 172.21.15.82:0/828080692 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f104810c6a0 0x7f1048117150 secure :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f103c009230 tx=0x7f103c00fa00 comp rx=0 tx=0).stop 2023-09-23T09:30:44.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:44.007+0000 7f104e7ff700 1 -- 172.21.15.82:0/828080692 >> 172.21.15.82:0/828080692 conn(0x7f104806ce40 msgr2=0x7f1048070fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:30:44.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:44.008+0000 7f104e7ff700 1 -- 172.21.15.82:0/828080692 shutdown_connections 2023-09-23T09:30:44.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:30:44.011+0000 7f104e7ff700 1 -- 172.21.15.82:0/828080692 wait complete. 2023-09-23T09:30:44.051 INFO:tasks.cephfs.filesystem:scrub status for tag:1bf2f9b8-9ce6-41cc-b047-379c24ec4afd - {'path': '/', 'tag': '1bf2f9b8-9ce6-41cc-b047-379c24ec4afd', 'options': 'recursive,force'} 2023-09-23T09:30:45.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:30:44 smithi135 ceph-mon[99205]: scrub queued for path: / 2023-09-23T09:30:45.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:30:44 smithi135 ceph-mon[99205]: scrub summary: idle+waiting paths [/] 2023-09-23T09:30:45.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:30:44 smithi135 ceph-mon[99205]: scrub summary: active paths [/] 2023-09-23T09:30:45.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:30:44 smithi135 ceph-mon[99205]: scrub summary: active paths [/] 2023-09-23T09:30:45.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:30:44 smithi135 ceph-mon[99205]: scrub summary: active paths [/] 2023-09-23T09:30:45.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:30:44 smithi135 ceph-mon[99205]: scrub summary: active paths [/] 2023-09-23T09:30:45.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:30:44 smithi135 ceph-mon[99205]: scrub summary: active paths [/] 2023-09-23T09:30:45.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:30:44 smithi135 ceph-mon[99205]: scrub summary: idle+waiting paths [/] 2023-09-23T09:30:45.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:30:44 smithi135 ceph-mon[99205]: scrub summary: idle+waiting paths [/] 2023-09-23T09:30:45.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:30:44 smithi135 ceph-mon[99205]: scrub summary: idle+waiting paths [/] 2023-09-23T09:30:45.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:30:44 smithi135 ceph-mon[99205]: scrub summary: idle+waiting paths [/] 2023-09-23T09:30:45.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:30:44 smithi135 ceph-mon[99205]: pgmap v1072: 97 pgs: 97 active+clean; 16 GiB data, 55 GiB used, 1018 GiB / 1.0 TiB avail; 1.2 MiB/s rd, 8.7 MiB/s wr, 690 op/s 2023-09-23T09:30:45.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:30:44 smithi135 ceph-mon[99205]: scrub summary: idle+waiting paths [/] 2023-09-23T09:30:45.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:30:44 smithi082 ceph-mon[97694]: scrub queued for path: / 2023-09-23T09:30:45.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:30:44 smithi082 ceph-mon[97694]: scrub summary: idle+waiting paths [/] 2023-09-23T09:30:45.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:30:44 smithi082 ceph-mon[97694]: scrub summary: active paths [/] 2023-09-23T09:30:45.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:30:44 smithi082 ceph-mon[97694]: scrub summary: active paths [/] 2023-09-23T09:30:45.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:30:44 smithi082 ceph-mon[97694]: scrub summary: active paths [/] 2023-09-23T09:30:45.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:30:44 smithi082 ceph-mon[97694]: scrub summary: active paths [/] 2023-09-23T09:30:45.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:30:44 smithi082 ceph-mon[97694]: scrub summary: active paths [/] 2023-09-23T09:30:45.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:30:44 smithi082 ceph-mon[97694]: scrub summary: idle+waiting paths [/] 2023-09-23T09:30:45.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:30:44 smithi082 ceph-mon[97694]: scrub summary: idle+waiting paths [/] 2023-09-23T09:30:45.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:30:44 smithi082 ceph-mon[97694]: scrub summary: idle+waiting paths [/] 2023-09-23T09:30:45.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:30:44 smithi082 ceph-mon[97694]: scrub summary: idle+waiting paths [/] 2023-09-23T09:30:45.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:30:44 smithi082 ceph-mon[97694]: pgmap v1072: 97 pgs: 97 active+clean; 16 GiB data, 55 GiB used, 1018 GiB / 1.0 TiB avail; 1.2 MiB/s rd, 8.7 MiB/s wr, 690 op/s 2023-09-23T09:30:45.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:30:44 smithi082 ceph-mon[97694]: scrub summary: idle+waiting paths [/] 2023-09-23T09:30:45.150 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:30:44 smithi161 ceph-mon[99580]: scrub queued for path: / 2023-09-23T09:30:45.150 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:30:44 smithi161 ceph-mon[99580]: scrub summary: idle+waiting paths [/] 2023-09-23T09:30:45.150 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:30:44 smithi161 ceph-mon[99580]: scrub summary: active paths [/] 2023-09-23T09:30:45.150 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:30:44 smithi161 ceph-mon[99580]: scrub summary: active paths [/] 2023-09-23T09:30:45.150 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:30:44 smithi161 ceph-mon[99580]: scrub summary: active paths [/] 2023-09-23T09:30:45.150 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:30:44 smithi161 ceph-mon[99580]: scrub summary: active paths [/] 2023-09-23T09:30:45.150 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:30:44 smithi161 ceph-mon[99580]: scrub summary: active paths [/] 2023-09-23T09:30:45.151 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:30:44 smithi161 ceph-mon[99580]: scrub summary: idle+waiting paths [/] 2023-09-23T09:30:45.151 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:30:44 smithi161 ceph-mon[99580]: scrub summary: idle+waiting paths [/] 2023-09-23T09:30:45.151 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:30:44 smithi161 ceph-mon[99580]: scrub summary: idle+waiting paths [/] 2023-09-23T09:30:45.151 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:30:44 smithi161 ceph-mon[99580]: scrub summary: idle+waiting paths [/] 2023-09-23T09:30:45.151 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:30:44 smithi161 ceph-mon[99580]: pgmap v1072: 97 pgs: 97 active+clean; 16 GiB data, 55 GiB used, 1018 GiB / 1.0 TiB avail; 1.2 MiB/s rd, 8.7 MiB/s wr, 690 op/s 2023-09-23T09:30:45.151 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:30:44 smithi161 ceph-mon[99580]: scrub summary: idle+waiting paths [/] 2023-09-23T09:30:45.827 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 215.0 s, 434.6 tps, lat 381.520 ms stddev 709.946 2023-09-23T09:30:47.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:30:46 smithi135 ceph-mon[99205]: pgmap v1073: 97 pgs: 97 active+clean; 16 GiB data, 55 GiB used, 1018 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 13 MiB/s wr, 1.12k op/s 2023-09-23T09:30:47.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:30:46 smithi082 ceph-mon[97694]: pgmap v1073: 97 pgs: 97 active+clean; 16 GiB data, 55 GiB used, 1018 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 13 MiB/s wr, 1.12k op/s 2023-09-23T09:30:47.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:30:46 smithi161 ceph-mon[99580]: pgmap v1073: 97 pgs: 97 active+clean; 16 GiB data, 55 GiB used, 1018 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 13 MiB/s wr, 1.12k op/s 2023-09-23T09:30:48.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:30:47 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:30:48.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:30:47 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:30:48.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:30:47 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:30:49.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:30:48 smithi135 ceph-mon[99205]: pgmap v1074: 97 pgs: 97 active+clean; 16 GiB data, 55 GiB used, 1018 GiB / 1.0 TiB avail; 1.0 MiB/s rd, 8.0 MiB/s wr, 685 op/s 2023-09-23T09:30:49.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:30:48 smithi082 ceph-mon[97694]: pgmap v1074: 97 pgs: 97 active+clean; 16 GiB data, 55 GiB used, 1018 GiB / 1.0 TiB avail; 1.0 MiB/s rd, 8.0 MiB/s wr, 685 op/s 2023-09-23T09:30:49.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:30:48 smithi161 ceph-mon[99580]: pgmap v1074: 97 pgs: 97 active+clean; 16 GiB data, 55 GiB used, 1018 GiB / 1.0 TiB avail; 1.0 MiB/s rd, 8.0 MiB/s wr, 685 op/s 2023-09-23T09:30:50.827 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 220.0 s, 600.0 tps, lat 165.684 ms stddev 53.095 2023-09-23T09:30:51.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:30:50 smithi135 ceph-mon[99205]: pgmap v1075: 97 pgs: 97 active+clean; 16 GiB data, 55 GiB used, 1017 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 15 MiB/s wr, 1.23k op/s 2023-09-23T09:30:51.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:30:50 smithi082 ceph-mon[97694]: pgmap v1075: 97 pgs: 97 active+clean; 16 GiB data, 55 GiB used, 1017 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 15 MiB/s wr, 1.23k op/s 2023-09-23T09:30:51.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:30:50 smithi161 ceph-mon[99580]: pgmap v1075: 97 pgs: 97 active+clean; 16 GiB data, 55 GiB used, 1017 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 15 MiB/s wr, 1.23k op/s 2023-09-23T09:30:53.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:30:52 smithi135 ceph-mon[99205]: pgmap v1076: 97 pgs: 97 active+clean; 16 GiB data, 56 GiB used, 1017 GiB / 1.0 TiB avail; 1.4 MiB/s rd, 13 MiB/s wr, 1.10k op/s 2023-09-23T09:30:53.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:30:52 smithi082 ceph-mon[97694]: pgmap v1076: 97 pgs: 97 active+clean; 16 GiB data, 56 GiB used, 1017 GiB / 1.0 TiB avail; 1.4 MiB/s rd, 13 MiB/s wr, 1.10k op/s 2023-09-23T09:30:53.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:30:52 smithi161 ceph-mon[99580]: pgmap v1076: 97 pgs: 97 active+clean; 16 GiB data, 56 GiB used, 1017 GiB / 1.0 TiB avail; 1.4 MiB/s rd, 13 MiB/s wr, 1.10k op/s 2023-09-23T09:30:55.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:30:54 smithi135 ceph-mon[99205]: pgmap v1077: 97 pgs: 97 active+clean; 16 GiB data, 56 GiB used, 1017 GiB / 1.0 TiB avail; 1.3 MiB/s rd, 12 MiB/s wr, 1.07k op/s 2023-09-23T09:30:55.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:30:54 smithi082 ceph-mon[97694]: pgmap v1077: 97 pgs: 97 active+clean; 16 GiB data, 56 GiB used, 1017 GiB / 1.0 TiB avail; 1.3 MiB/s rd, 12 MiB/s wr, 1.07k op/s 2023-09-23T09:30:55.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:30:54 smithi161 ceph-mon[99580]: pgmap v1077: 97 pgs: 97 active+clean; 16 GiB data, 56 GiB used, 1017 GiB / 1.0 TiB avail; 1.3 MiB/s rd, 12 MiB/s wr, 1.07k op/s 2023-09-23T09:30:55.827 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 225.0 s, 657.4 tps, lat 152.699 ms stddev 55.877 2023-09-23T09:30:57.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:30:56 smithi135 ceph-mon[99205]: pgmap v1078: 97 pgs: 97 active+clean; 16 GiB data, 56 GiB used, 1017 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 20 MiB/s wr, 1.59k op/s 2023-09-23T09:30:57.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:30:56 smithi135 ceph-mon[99205]: scrub summary: idle 2023-09-23T09:30:57.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:30:56 smithi135 ceph-mon[99205]: scrub summary: idle 2023-09-23T09:30:57.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:30:56 smithi135 ceph-mon[99205]: scrub summary: idle 2023-09-23T09:30:57.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:30:56 smithi135 ceph-mon[99205]: scrub summary: idle 2023-09-23T09:30:57.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:30:56 smithi082 ceph-mon[97694]: pgmap v1078: 97 pgs: 97 active+clean; 16 GiB data, 56 GiB used, 1017 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 20 MiB/s wr, 1.59k op/s 2023-09-23T09:30:57.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:30:56 smithi082 ceph-mon[97694]: scrub summary: idle 2023-09-23T09:30:57.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:30:56 smithi082 ceph-mon[97694]: scrub summary: idle 2023-09-23T09:30:57.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:30:56 smithi082 ceph-mon[97694]: scrub summary: idle 2023-09-23T09:30:57.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:30:56 smithi082 ceph-mon[97694]: scrub summary: idle 2023-09-23T09:30:57.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:30:56 smithi161 ceph-mon[99580]: pgmap v1078: 97 pgs: 97 active+clean; 16 GiB data, 56 GiB used, 1017 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 20 MiB/s wr, 1.59k op/s 2023-09-23T09:30:57.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:30:56 smithi161 ceph-mon[99580]: scrub summary: idle 2023-09-23T09:30:57.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:30:56 smithi161 ceph-mon[99580]: scrub summary: idle 2023-09-23T09:30:57.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:30:56 smithi161 ceph-mon[99580]: scrub summary: idle 2023-09-23T09:30:57.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:30:56 smithi161 ceph-mon[99580]: scrub summary: idle 2023-09-23T09:30:58.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:30:57 smithi135 ceph-mon[99205]: scrub summary: idle 2023-09-23T09:30:58.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:30:57 smithi082 ceph-mon[97694]: scrub summary: idle 2023-09-23T09:30:58.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:30:57 smithi161 ceph-mon[99580]: scrub summary: idle 2023-09-23T09:30:59.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:30:58 smithi135 ceph-mon[99205]: pgmap v1079: 97 pgs: 97 active+clean; 16 GiB data, 56 GiB used, 1017 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 15 MiB/s wr, 1.15k op/s 2023-09-23T09:30:59.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:30:58 smithi082 ceph-mon[97694]: pgmap v1079: 97 pgs: 97 active+clean; 16 GiB data, 56 GiB used, 1017 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 15 MiB/s wr, 1.15k op/s 2023-09-23T09:30:59.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:30:58 smithi161 ceph-mon[99580]: pgmap v1079: 97 pgs: 97 active+clean; 16 GiB data, 56 GiB used, 1017 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 15 MiB/s wr, 1.15k op/s 2023-09-23T09:31:00.828 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 230.0 s, 569.0 tps, lat 168.392 ms stddev 52.343 2023-09-23T09:31:01.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:31:00 smithi082 ceph-mon[97694]: pgmap v1080: 97 pgs: 97 active+clean; 16 GiB data, 56 GiB used, 1017 GiB / 1.0 TiB avail; 2.4 MiB/s rd, 21 MiB/s wr, 1.64k op/s 2023-09-23T09:31:01.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:31:00 smithi161 ceph-mon[99580]: pgmap v1080: 97 pgs: 97 active+clean; 16 GiB data, 56 GiB used, 1017 GiB / 1.0 TiB avail; 2.4 MiB/s rd, 21 MiB/s wr, 1.64k op/s 2023-09-23T09:31:01.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:31:00 smithi135 ceph-mon[99205]: pgmap v1080: 97 pgs: 97 active+clean; 16 GiB data, 56 GiB used, 1017 GiB / 1.0 TiB avail; 2.4 MiB/s rd, 21 MiB/s wr, 1.64k op/s 2023-09-23T09:31:03.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:31:02 smithi082 ceph-mon[97694]: pgmap v1081: 97 pgs: 97 active+clean; 16 GiB data, 56 GiB used, 1017 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 15 MiB/s wr, 1.17k op/s 2023-09-23T09:31:03.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:31:02 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:31:03.150 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:31:02 smithi161 ceph-mon[99580]: pgmap v1081: 97 pgs: 97 active+clean; 16 GiB data, 56 GiB used, 1017 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 15 MiB/s wr, 1.17k op/s 2023-09-23T09:31:03.150 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:31:02 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:31:03.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:31:02 smithi135 ceph-mon[99205]: pgmap v1081: 97 pgs: 97 active+clean; 16 GiB data, 56 GiB used, 1017 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 15 MiB/s wr, 1.17k op/s 2023-09-23T09:31:03.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:31:02 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:31:05.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:31:04 smithi082 ceph-mon[97694]: pgmap v1082: 97 pgs: 97 active+clean; 16 GiB data, 56 GiB used, 1017 GiB / 1.0 TiB avail; 1.8 MiB/s rd, 14 MiB/s wr, 1.09k op/s 2023-09-23T09:31:05.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:31:04 smithi161 ceph-mon[99580]: pgmap v1082: 97 pgs: 97 active+clean; 16 GiB data, 56 GiB used, 1017 GiB / 1.0 TiB avail; 1.8 MiB/s rd, 14 MiB/s wr, 1.09k op/s 2023-09-23T09:31:05.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:31:04 smithi135 ceph-mon[99205]: pgmap v1082: 97 pgs: 97 active+clean; 16 GiB data, 56 GiB used, 1017 GiB / 1.0 TiB avail; 1.8 MiB/s rd, 14 MiB/s wr, 1.09k op/s 2023-09-23T09:31:05.827 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 235.0 s, 484.0 tps, lat 216.310 ms stddev 145.598 2023-09-23T09:31:07.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:31:06 smithi135 ceph-mon[99205]: pgmap v1083: 97 pgs: 97 active+clean; 16 GiB data, 57 GiB used, 1016 GiB / 1.0 TiB avail; 2.5 MiB/s rd, 20 MiB/s wr, 1.59k op/s 2023-09-23T09:31:07.654 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:31:06 smithi135 ceph-mon[99205]: osdmap e144: 12 total, 12 up, 12 in 2023-09-23T09:31:07.655 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:31:06 smithi161 ceph-mon[99580]: pgmap v1083: 97 pgs: 97 active+clean; 16 GiB data, 57 GiB used, 1016 GiB / 1.0 TiB avail; 2.5 MiB/s rd, 20 MiB/s wr, 1.59k op/s 2023-09-23T09:31:07.655 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:31:06 smithi161 ceph-mon[99580]: osdmap e144: 12 total, 12 up, 12 in 2023-09-23T09:31:07.655 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:31:06 smithi082 ceph-mon[97694]: pgmap v1083: 97 pgs: 97 active+clean; 16 GiB data, 57 GiB used, 1016 GiB / 1.0 TiB avail; 2.5 MiB/s rd, 20 MiB/s wr, 1.59k op/s 2023-09-23T09:31:07.655 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:31:06 smithi082 ceph-mon[97694]: osdmap e144: 12 total, 12 up, 12 in 2023-09-23T09:31:08.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:31:08 smithi161 ceph-mon[99580]: pgmap v1085: 97 pgs: 97 active+clean; 16 GiB data, 57 GiB used, 1016 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 16 MiB/s wr, 1.28k op/s 2023-09-23T09:31:08.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:31:08 smithi135 ceph-mon[99205]: pgmap v1085: 97 pgs: 97 active+clean; 16 GiB data, 57 GiB used, 1016 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 16 MiB/s wr, 1.28k op/s 2023-09-23T09:31:08.624 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:31:08 smithi082 ceph-mon[97694]: pgmap v1085: 97 pgs: 97 active+clean; 16 GiB data, 57 GiB used, 1016 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 16 MiB/s wr, 1.28k op/s 2023-09-23T09:31:10.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 240.0 s, 379.8 tps, lat 263.070 ms stddev 168.285 2023-09-23T09:31:11.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:31:10 smithi135 ceph-mon[99205]: pgmap v1086: 97 pgs: 97 active+clean; 16 GiB data, 57 GiB used, 1016 GiB / 1.0 TiB avail; 1.6 MiB/s rd, 13 MiB/s wr, 1.09k op/s 2023-09-23T09:31:11.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:31:10 smithi082 ceph-mon[97694]: pgmap v1086: 97 pgs: 97 active+clean; 16 GiB data, 57 GiB used, 1016 GiB / 1.0 TiB avail; 1.6 MiB/s rd, 13 MiB/s wr, 1.09k op/s 2023-09-23T09:31:11.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:31:10 smithi161 ceph-mon[99580]: pgmap v1086: 97 pgs: 97 active+clean; 16 GiB data, 57 GiB used, 1016 GiB / 1.0 TiB avail; 1.6 MiB/s rd, 13 MiB/s wr, 1.09k op/s 2023-09-23T09:31:13.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:31:12 smithi135 ceph-mon[99205]: pgmap v1087: 97 pgs: 97 active+clean; 16 GiB data, 57 GiB used, 1016 GiB / 1.0 TiB avail; 1.5 MiB/s rd, 13 MiB/s wr, 1.06k op/s 2023-09-23T09:31:13.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:31:12 smithi135 ceph-mon[99205]: osdmap e145: 12 total, 12 up, 12 in 2023-09-23T09:31:13.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:31:12 smithi082 ceph-mon[97694]: pgmap v1087: 97 pgs: 97 active+clean; 16 GiB data, 57 GiB used, 1016 GiB / 1.0 TiB avail; 1.5 MiB/s rd, 13 MiB/s wr, 1.06k op/s 2023-09-23T09:31:13.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:31:12 smithi082 ceph-mon[97694]: osdmap e145: 12 total, 12 up, 12 in 2023-09-23T09:31:13.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:31:12 smithi161 ceph-mon[99580]: pgmap v1087: 97 pgs: 97 active+clean; 16 GiB data, 57 GiB used, 1016 GiB / 1.0 TiB avail; 1.5 MiB/s rd, 13 MiB/s wr, 1.06k op/s 2023-09-23T09:31:13.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:31:12 smithi161 ceph-mon[99580]: osdmap e145: 12 total, 12 up, 12 in 2023-09-23T09:31:14.052 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:31:14.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.466+0000 7fc98fdff700 1 -- 172.21.15.82:0/131416390 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc988119fc0 msgr2=0x7fc98811c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:31:14.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.466+0000 7fc98fdff700 1 --2- 172.21.15.82:0/131416390 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc988119fc0 0x7fc98811c3b0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc9800098f0 tx=0x7fc980009c00 comp rx=0 tx=0).stop 2023-09-23T09:31:14.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.466+0000 7fc98fdff700 1 -- 172.21.15.82:0/131416390 shutdown_connections 2023-09-23T09:31:14.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.466+0000 7fc98fdff700 1 --2- 172.21.15.82:0/131416390 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc988119fc0 0x7fc98811c3b0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:14.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.466+0000 7fc98fdff700 1 --2- 172.21.15.82:0/131416390 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc98806bff0 0x7fc98806c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:14.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.466+0000 7fc98fdff700 1 --2- 172.21.15.82:0/131416390 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc98806c910 0x7fc988119a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:14.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.466+0000 7fc98fdff700 1 -- 172.21.15.82:0/131416390 >> 172.21.15.82:0/131416390 conn(0x7fc98806b710 msgr2=0x7fc988109930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:31:14.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.468+0000 7fc98fdff700 1 -- 172.21.15.82:0/131416390 shutdown_connections 2023-09-23T09:31:14.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.468+0000 7fc98fdff700 1 -- 172.21.15.82:0/131416390 wait complete. 2023-09-23T09:31:14.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.469+0000 7fc98fdff700 1 Processor -- start 2023-09-23T09:31:14.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.470+0000 7fc98fdff700 1 -- start start 2023-09-23T09:31:14.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.471+0000 7fc98fdff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc98806bff0 0x7fc9881ab510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:14.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.471+0000 7fc98fdff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc98806c910 0x7fc9881aba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:14.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.471+0000 7fc98fdff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc988119fc0 0x7fc9881a5580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:14.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.471+0000 7fc98fdff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9881a5bf0 con 0x7fc98806bff0 2023-09-23T09:31:14.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.471+0000 7fc98fdff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9881a5d60 con 0x7fc98806c910 2023-09-23T09:31:14.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.471+0000 7fc98fdff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9881a5f20 con 0x7fc988119fc0 2023-09-23T09:31:14.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.472+0000 7fc98db9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc98806bff0 0x7fc9881ab510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:14.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.472+0000 7fc98db9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc98806bff0 0x7fc9881ab510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44716/0 (socket says 172.21.15.82:44716) 2023-09-23T09:31:14.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.472+0000 7fc98db9b700 1 -- 172.21.15.82:0/1112853910 learned_addr learned my addr 172.21.15.82:0/1112853910 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:31:14.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.472+0000 7fc98db9b700 1 -- 172.21.15.82:0/1112853910 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc988119fc0 msgr2=0x7fc9881a5580 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-09-23T09:31:14.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.472+0000 7fc98db9b700 1 --2- 172.21.15.82:0/1112853910 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc988119fc0 0x7fc9881a5580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:14.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.472+0000 7fc98db9b700 1 -- 172.21.15.82:0/1112853910 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc98806c910 msgr2=0x7fc9881aba50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-09-23T09:31:14.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.472+0000 7fc98db9b700 1 --2- 172.21.15.82:0/1112853910 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc98806c910 0x7fc9881aba50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:14.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.472+0000 7fc98db9b700 1 -- 172.21.15.82:0/1112853910 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc980009520 con 0x7fc98806bff0 2023-09-23T09:31:14.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.473+0000 7fc98db9b700 1 --2- 172.21.15.82:0/1112853910 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc98806bff0 0x7fc9881ab510 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fc97c007fa0 tx=0x7fc97c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:31:14.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.473+0000 7fc986ffd700 1 -- 172.21.15.82:0/1112853910 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc97c00de60 con 0x7fc98806bff0 2023-09-23T09:31:14.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.473+0000 7fc986ffd700 1 -- 172.21.15.82:0/1112853910 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc97c00f040 con 0x7fc98806bff0 2023-09-23T09:31:14.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.473+0000 7fc986ffd700 1 -- 172.21.15.82:0/1112853910 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc97c014600 con 0x7fc98806bff0 2023-09-23T09:31:14.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.473+0000 7fc98fdff700 1 -- 172.21.15.82:0/1112853910 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9881a6200 con 0x7fc98806bff0 2023-09-23T09:31:14.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.474+0000 7fc98fdff700 1 -- 172.21.15.82:0/1112853910 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9881b2500 con 0x7fc98806bff0 2023-09-23T09:31:14.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.480+0000 7fc9a3745b80 1 Processor -- start 2023-09-23T09:31:14.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.481+0000 7fc9a3745b80 1 -- start start 2023-09-23T09:31:14.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.481+0000 7fc986ffd700 1 -- 172.21.15.82:0/1112853910 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7fc97c015a20 con 0x7fc98806bff0 2023-09-23T09:31:14.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.481+0000 7fc9a3745b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55adca56c380 0x55adca56c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:14.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.481+0000 7fc9a3745b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55adca56cca0 0x55adca566700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:14.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.481+0000 7fc9a3745b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55adca566c40 0x55adca5670a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:14.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.481+0000 7fc9a3745b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55adca4ce7b0 con 0x55adca566c40 2023-09-23T09:31:14.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.481+0000 7fc9a3745b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55adca4bf780 con 0x55adca56c380 2023-09-23T09:31:14.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.481+0000 7fc9a3745b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55adca4bd0a0 con 0x55adca56cca0 2023-09-23T09:31:14.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.482+0000 7fc98e39c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55adca56c380 0x55adca56c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:14.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.482+0000 7fc98e39c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55adca56c380 0x55adca56c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:50766/0 (socket says 172.21.15.82:50766) 2023-09-23T09:31:14.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.482+0000 7fc98e39c700 1 -- 172.21.15.82:0/841446383 learned_addr learned my addr 172.21.15.82:0/841446383 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:31:14.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.482+0000 7fc98db9b700 1 --2- 172.21.15.82:0/841446383 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55adca56cca0 0x55adca566700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:14.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.483+0000 7fc98e39c700 1 -- 172.21.15.82:0/841446383 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55adca56cca0 msgr2=0x55adca566700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:31:14.490 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.485+0000 7fc986ffd700 1 --2- 172.21.15.82:0/1112853910 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fc9780a02d0 0x7fc9780a2790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:14.490 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.485+0000 7fc986ffd700 1 -- 172.21.15.82:0/1112853910 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fc97c0cac50 con 0x7fc98806bff0 2023-09-23T09:31:14.490 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.486+0000 7fc98e39c700 1 --2- 172.21.15.82:0/841446383 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55adca56cca0 0x55adca566700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:14.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.486+0000 7fc98e39c700 1 -- 172.21.15.82:0/841446383 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55adca566c40 msgr2=0x55adca5670a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:31:14.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.486+0000 7fc98e39c700 1 --2- 172.21.15.82:0/841446383 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55adca566c40 0x55adca5670a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:14.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.486+0000 7fc98e39c700 1 -- 172.21.15.82:0/841446383 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55adca338630 con 0x55adca56c380 2023-09-23T09:31:14.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.486+0000 7fc98db9b700 1 --2- 172.21.15.82:0/841446383 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55adca56cca0 0x55adca566700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T09:31:14.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.488+0000 7fc98e39c700 1 --2- 172.21.15.82:0/841446383 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55adca56c380 0x55adca56c760 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc980009810 tx=0x7fc980009400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f75a6fd8c7703d1 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:31:14.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.488+0000 7fc98e39c700 1 --2- 172.21.15.82:0/1112853910 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fc9780a02d0 0x7fc9780a2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:14.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.489+0000 7fc973fff700 1 -- 172.21.15.82:0/841446383 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc98001c070 con 0x55adca56c380 2023-09-23T09:31:14.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.489+0000 7fc973fff700 1 -- 172.21.15.82:0/841446383 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc98000f8f0 con 0x55adca56c380 2023-09-23T09:31:14.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.489+0000 7fc973fff700 1 -- 172.21.15.82:0/841446383 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9800038e0 con 0x55adca56c380 2023-09-23T09:31:14.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.491+0000 7fc9a3745b80 1 -- 172.21.15.82:0/841446383 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55adca56c380 msgr2=0x55adca56c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:31:14.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.491+0000 7fc9a3745b80 1 --2- 172.21.15.82:0/841446383 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55adca56c380 0x55adca56c760 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc980009810 tx=0x7fc980009400 comp rx=0 tx=0).stop 2023-09-23T09:31:14.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.491+0000 7fc98e39c700 1 --2- 172.21.15.82:0/1112853910 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fc9780a02d0 0x7fc9780a2790 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc980027000 tx=0x7fc980003c00 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:31:14.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.491+0000 7fc9a3745b80 1 -- 172.21.15.82:0/841446383 shutdown_connections 2023-09-23T09:31:14.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.491+0000 7fc9a3745b80 1 --2- 172.21.15.82:0/841446383 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55adca566c40 0x55adca5670a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:14.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.491+0000 7fc9a3745b80 1 --2- 172.21.15.82:0/841446383 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55adca56c380 0x55adca56c760 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:14.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.491+0000 7fc9a3745b80 1 --2- 172.21.15.82:0/841446383 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55adca56cca0 0x55adca566700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:14.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.492+0000 7fc9a3745b80 1 -- 172.21.15.82:0/841446383 >> 172.21.15.82:0/841446383 conn(0x55adca4db0e0 msgr2=0x55adca561410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:31:14.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.492+0000 7fc9a3745b80 1 -- 172.21.15.82:0/841446383 shutdown_connections 2023-09-23T09:31:14.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.492+0000 7fc9a3745b80 1 -- 172.21.15.82:0/841446383 wait complete. 2023-09-23T09:31:14.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.493+0000 7fc9a3745b80 1 -- start start 2023-09-23T09:31:14.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.493+0000 7fc9a3745b80 1 Processor -- start 2023-09-23T09:31:14.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.494+0000 7fc9a3745b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55adca566c40 0x55adca572c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:14.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.494+0000 7fc9a3745b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55adca56c380 0x55adca56ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:14.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.494+0000 7fc9a3745b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55adca56cca0 0x55adca5705f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:14.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.495+0000 7fc9a3745b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55adca4b8990 con 0x55adca56cca0 2023-09-23T09:31:14.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.495+0000 7fc9a3745b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55adca456bb0 con 0x55adca566c40 2023-09-23T09:31:14.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.495+0000 7fc9a3745b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55adca4568b0 con 0x55adca56c380 2023-09-23T09:31:14.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.495+0000 7fc9a3745b80 10 client.0 _ll_register_callbacks cb 0x55adca3a0a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:31:14.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.495+0000 7fc98d39a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55adca56c380 0x55adca56ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:14.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.495+0000 7fc98d39a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55adca56c380 0x55adca56ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:58494/0 (socket says 172.21.15.82:58494) 2023-09-23T09:31:14.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.495+0000 7fc98d39a700 1 -- 172.21.15.82:0/1247591380 learned_addr learned my addr 172.21.15.82:0/1247591380 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:31:14.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.495+0000 7fc98db9b700 1 --2- 172.21.15.82:0/1247591380 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55adca566c40 0x55adca572c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:14.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.496+0000 7fc98e39c700 1 --2- 172.21.15.82:0/1247591380 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55adca56cca0 0x55adca5705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:14.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.496+0000 7fc98db9b700 1 -- 172.21.15.82:0/1247591380 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55adca56c380 msgr2=0x55adca56ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:31:14.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.496+0000 7fc98db9b700 1 --2- 172.21.15.82:0/1247591380 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55adca56c380 0x55adca56ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:14.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.496+0000 7fc98db9b700 1 -- 172.21.15.82:0/1247591380 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55adca56cca0 msgr2=0x55adca5705f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:31:14.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.496+0000 7fc98db9b700 1 --2- 172.21.15.82:0/1247591380 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55adca56cca0 0x55adca5705f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:14.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.496+0000 7fc98db9b700 1 -- 172.21.15.82:0/1247591380 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc98811ce70 con 0x55adca566c40 2023-09-23T09:31:14.500 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.497+0000 7fc98db9b700 1 --2- 172.21.15.82:0/1247591380 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55adca566c40 0x55adca572c80 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc97c0c8340 tx=0x7fc97c097c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a6ac2a4847836dd server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:31:14.500 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.497+0000 7fc9717fa700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-09-23T09:31:14.500 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.498+0000 7fc9717fa700 1 -- 172.21.15.82:0/1247591380 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc97c09c130 con 0x55adca566c40 2023-09-23T09:31:14.500 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.498+0000 7fc9717fa700 1 -- 172.21.15.82:0/1247591380 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(145..145 src has 1..145) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fc97c0a0110 con 0x55adca566c40 2023-09-23T09:31:14.500 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.498+0000 7fc9a3745b80 1 -- 172.21.15.82:0/1247591380 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55adca5361c0 con 0x55adca566c40 2023-09-23T09:31:14.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.498+0000 7fc9717fa700 1 -- 172.21.15.82:0/1247591380 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc97c0977f0 con 0x55adca566c40 2023-09-23T09:31:14.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.499+0000 7fc9a3745b80 10 client.27386 fetch_fsmap learned FSMap version 102 2023-09-23T09:31:14.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.499+0000 7fc9a3745b80 1 -- 172.21.15.82:0/1247591380 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=4+}) v3 -- 0x55adca2e4de0 con 0x55adca566c40 2023-09-23T09:31:14.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.499+0000 7fc9717fa700 1 -- 172.21.15.82:0/1247591380 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55adca5361c0 con 0x55adca566c40 2023-09-23T09:31:14.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.499+0000 7fc9717fa700 1 -- 172.21.15.82:0/1247591380 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 102) v1 ==== 7954+0+0 (secure 0 0 0) 0x7fc97c09fc80 con 0x55adca566c40 2023-09-23T09:31:14.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.499+0000 7fc9a3745b80 10 client.27386 fetch_fsmap finished waiting for FSMap version 102 2023-09-23T09:31:14.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.499+0000 7fc9a3745b80 10 client.27386 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:31:14.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.499+0000 7fc9a3745b80 20 client.27386 populate_metadata read hostname 'smithi082' 2023-09-23T09:31:14.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.499+0000 7fc9a3745b80 1 --2- 172.21.15.82:0/1247591380 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55adca580640 0x55adca582a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:14.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.499+0000 7fc9a3745b80 4 client.27386 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:31:14.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.499+0000 7fc9a3745b80 1 -- 172.21.15.82:0/1247591380 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55adca45eba0 con 0x55adca580640 2023-09-23T09:31:14.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.500+0000 7fc98d39a700 1 --2- 172.21.15.82:0/1247591380 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55adca580640 0x55adca582a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:14.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.502+0000 7fc98d39a700 1 --2- 172.21.15.82:0/1247591380 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55adca580640 0x55adca582a80 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6056ef275583c156 server_cookie=4d21e80e258d93c3 in_seq=0 out_seq=0 2023-09-23T09:31:14.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.502+0000 7fc9717fa700 10 client.27386 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:31:14.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.503+0000 7fc9717fa700 1 -- 172.21.15.82:0/1247591380 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55adca45eba0 con 0x55adca580640 2023-09-23T09:31:14.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.503+0000 7fc9717fa700 10 client.27386 handle_command_reply: tid=0 2023-09-23T09:31:14.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.507+0000 7fc9a3745b80 1 client.27386 shutdown 2023-09-23T09:31:14.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.510+0000 7fc9a3745b80 1 -- 172.21.15.82:0/1247591380 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55adca566c40 msgr2=0x55adca572c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:31:14.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.510+0000 7fc9a3745b80 1 --2- 172.21.15.82:0/1247591380 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55adca566c40 0x55adca572c80 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc97c0c8340 tx=0x7fc97c097c60 comp rx=0 tx=0).stop 2023-09-23T09:31:14.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.516+0000 7fc9a3745b80 1 -- 172.21.15.82:0/1247591380 shutdown_connections 2023-09-23T09:31:14.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.516+0000 7fc9a3745b80 1 --2- 172.21.15.82:0/1247591380 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55adca580640 0x55adca582a80 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:14.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.516+0000 7fc9a3745b80 1 --2- 172.21.15.82:0/1247591380 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55adca56cca0 0x55adca5705f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:14.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.516+0000 7fc9a3745b80 1 --2- 172.21.15.82:0/1247591380 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55adca566c40 0x55adca572c80 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:14.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.516+0000 7fc9a3745b80 1 --2- 172.21.15.82:0/1247591380 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55adca56c380 0x55adca56ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:14.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.516+0000 7fc9a3745b80 1 -- 172.21.15.82:0/1247591380 >> 172.21.15.82:0/1247591380 conn(0x55adca4db0e0 msgr2=0x55adca55bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:31:14.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.516+0000 7fc9717fa700 0 client.27386 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:31:14.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.518+0000 7fc9a3745b80 1 -- 172.21.15.82:0/1247591380 shutdown_connections 2023-09-23T09:31:14.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.519+0000 7fc9a3745b80 1 -- 172.21.15.82:0/1247591380 wait complete. 2023-09-23T09:31:14.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.520+0000 7fc9a3745b80 20 client.27386 trim_cache size 0 max 16384 2023-09-23T09:31:14.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.557+0000 7fc9a3745b80 1 Processor -- start 2023-09-23T09:31:14.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.558+0000 7fc9a3745b80 1 -- start start 2023-09-23T09:31:14.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.558+0000 7fc9a3745b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55adca566c40 0x55adca566700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:14.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.558+0000 7fc9a3745b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55adca56c380 0x55adca5727b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:14.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.558+0000 7fc9a3745b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55adca56cca0 0x55adca56a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:14.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.558+0000 7fc9a3745b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55adca33a920 con 0x55adca566c40 2023-09-23T09:31:14.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.558+0000 7fc9a3745b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55adca570bf0 con 0x55adca56c380 2023-09-23T09:31:14.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.558+0000 7fc9a3745b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55adca56e460 con 0x55adca56cca0 2023-09-23T09:31:14.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.559+0000 7fc98e39c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55adca56cca0 0x55adca56a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:14.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.559+0000 7fc98d39a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55adca56c380 0x55adca5727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:14.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.559+0000 7fc98d39a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55adca56c380 0x55adca5727b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:50776/0 (socket says 172.21.15.82:50776) 2023-09-23T09:31:14.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.559+0000 7fc98d39a700 1 -- 172.21.15.82:0/303730408 learned_addr learned my addr 172.21.15.82:0/303730408 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:31:14.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.559+0000 7fc98d39a700 1 -- 172.21.15.82:0/303730408 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55adca56cca0 msgr2=0x55adca56a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:31:14.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.559+0000 7fc98d39a700 1 --2- 172.21.15.82:0/303730408 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55adca56cca0 0x55adca56a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:14.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.559+0000 7fc98d39a700 1 -- 172.21.15.82:0/303730408 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55adca566c40 msgr2=0x55adca566700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:31:14.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.559+0000 7fc98d39a700 1 --2- 172.21.15.82:0/303730408 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55adca566c40 0x55adca566700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:14.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.559+0000 7fc98d39a700 1 -- 172.21.15.82:0/303730408 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55adca2cdc60 con 0x55adca56c380 2023-09-23T09:31:14.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.560+0000 7fc98d39a700 1 --2- 172.21.15.82:0/303730408 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55adca56c380 0x55adca5727b0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x55adca571540 tx=0x7fc974005d90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7300c642a3e1db6 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:31:14.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.560+0000 7fc984bff700 1 -- 172.21.15.82:0/303730408 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc974017510 con 0x55adca56c380 2023-09-23T09:31:14.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.560+0000 7fc984bff700 1 -- 172.21.15.82:0/303730408 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc974016040 con 0x55adca56c380 2023-09-23T09:31:14.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.560+0000 7fc984bff700 1 -- 172.21.15.82:0/303730408 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc974010a00 con 0x55adca56c380 2023-09-23T09:31:14.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.561+0000 7fc9a3745b80 1 -- 172.21.15.82:0/303730408 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55adca56c380 msgr2=0x55adca5727b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:31:14.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.561+0000 7fc9a3745b80 1 --2- 172.21.15.82:0/303730408 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55adca56c380 0x55adca5727b0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x55adca571540 tx=0x7fc974005d90 comp rx=0 tx=0).stop 2023-09-23T09:31:14.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.562+0000 7fc9a3745b80 1 -- 172.21.15.82:0/303730408 shutdown_connections 2023-09-23T09:31:14.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.562+0000 7fc9a3745b80 1 --2- 172.21.15.82:0/303730408 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55adca56cca0 0x55adca56a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:14.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.562+0000 7fc9a3745b80 1 --2- 172.21.15.82:0/303730408 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55adca566c40 0x55adca566700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:14.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.562+0000 7fc9a3745b80 1 --2- 172.21.15.82:0/303730408 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55adca56c380 0x55adca5727b0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:14.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.562+0000 7fc9a3745b80 1 -- 172.21.15.82:0/303730408 >> 172.21.15.82:0/303730408 conn(0x55adca4db0e0 msgr2=0x55adca582650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:31:14.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.562+0000 7fc9a3745b80 1 -- 172.21.15.82:0/303730408 shutdown_connections 2023-09-23T09:31:14.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.562+0000 7fc9a3745b80 1 -- 172.21.15.82:0/303730408 wait complete. 2023-09-23T09:31:14.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.563+0000 7fc9a3745b80 1 -- start start 2023-09-23T09:31:14.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.563+0000 7fc9a3745b80 1 Processor -- start 2023-09-23T09:31:14.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.564+0000 7fc9a3745b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55adca566c40 0x55adca5777d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:14.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.564+0000 7fc9a3745b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55adca56c380 0x55adca567f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:14.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.564+0000 7fc9a3745b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55adca56cca0 0x55adca568460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:14.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.564+0000 7fc9a3745b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55adca5689a0 con 0x55adca56c380 2023-09-23T09:31:14.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.564+0000 7fc9a3745b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55adca568b10 con 0x55adca56cca0 2023-09-23T09:31:14.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.564+0000 7fc9a3745b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55adca568cd0 con 0x55adca566c40 2023-09-23T09:31:14.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.564+0000 7fc9a3745b80 10 client.0 _ll_register_callbacks cb 0x7fc97c0981a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:31:14.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.564+0000 7fc98db9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55adca566c40 0x55adca5777d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:14.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.564+0000 7fc98db9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55adca566c40 0x55adca5777d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:58514/0 (socket says 172.21.15.82:58514) 2023-09-23T09:31:14.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.565+0000 7fc98db9b700 1 -- 172.21.15.82:0/2140656794 learned_addr learned my addr 172.21.15.82:0/2140656794 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:31:14.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.565+0000 7fc98e39c700 1 --2- 172.21.15.82:0/2140656794 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55adca56cca0 0x55adca568460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:14.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.565+0000 7fc98e39c700 1 -- 172.21.15.82:0/2140656794 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55adca566c40 msgr2=0x55adca5777d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:31:14.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.565+0000 7fc98e39c700 1 --2- 172.21.15.82:0/2140656794 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55adca566c40 0x55adca5777d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:14.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.565+0000 7fc98e39c700 1 -- 172.21.15.82:0/2140656794 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55adca56c380 msgr2=0x55adca567f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:31:14.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.565+0000 7fc98d39a700 1 --2- 172.21.15.82:0/2140656794 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55adca56c380 0x55adca567f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:14.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.565+0000 7fc98e39c700 1 --2- 172.21.15.82:0/2140656794 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55adca56c380 0x55adca567f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:14.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.565+0000 7fc98e39c700 1 -- 172.21.15.82:0/2140656794 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc97400c6a0 con 0x55adca56cca0 2023-09-23T09:31:14.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.566+0000 7fc98db9b700 1 --2- 172.21.15.82:0/2140656794 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55adca566c40 0x55adca5777d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:31:14.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.566+0000 7fc98e39c700 1 --2- 172.21.15.82:0/2140656794 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55adca56cca0 0x55adca568460 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fc980028040 tx=0x7fc98001d000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca42cd2f2651bc8b server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:31:14.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.566+0000 7fc9717fa700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-09-23T09:31:14.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.566+0000 7fc9717fa700 1 -- 172.21.15.82:0/2140656794 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc980035070 con 0x55adca56cca0 2023-09-23T09:31:14.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.566+0000 7fc9717fa700 1 -- 172.21.15.82:0/2140656794 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(145..145 src has 1..145) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fc98000b820 con 0x55adca56cca0 2023-09-23T09:31:14.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.566+0000 7fc9a3745b80 1 -- 172.21.15.82:0/2140656794 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55adca5598b0 con 0x55adca56cca0 2023-09-23T09:31:14.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.567+0000 7fc9717fa700 1 -- 172.21.15.82:0/2140656794 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc98001c040 con 0x55adca56cca0 2023-09-23T09:31:14.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.567+0000 7fc9a3745b80 10 client.27392 fetch_fsmap learned FSMap version 102 2023-09-23T09:31:14.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.567+0000 7fc9a3745b80 1 -- 172.21.15.82:0/2140656794 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=4+}) v3 -- 0x55adca30b250 con 0x55adca56cca0 2023-09-23T09:31:14.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.567+0000 7fc9717fa700 1 -- 172.21.15.82:0/2140656794 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc980046020 con 0x55adca56cca0 2023-09-23T09:31:14.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.567+0000 7fc9717fa700 1 -- 172.21.15.82:0/2140656794 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 102) v1 ==== 7954+0+0 (secure 0 0 0) 0x7fc98002c030 con 0x55adca56cca0 2023-09-23T09:31:14.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.568+0000 7fc9a3745b80 10 client.27392 fetch_fsmap finished waiting for FSMap version 102 2023-09-23T09:31:14.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.568+0000 7fc9a3745b80 10 client.27392 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:31:14.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.568+0000 7fc9a3745b80 20 client.27392 populate_metadata read hostname 'smithi082' 2023-09-23T09:31:14.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.568+0000 7fc9a3745b80 1 --2- 172.21.15.82:0/2140656794 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55adca5d16f0 0x55adca5d1b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:14.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.568+0000 7fc9a3745b80 4 client.27392 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:31:14.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.568+0000 7fc9a3745b80 1 -- 172.21.15.82:0/2140656794 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55adca4b1970 con 0x55adca5d16f0 2023-09-23T09:31:14.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.568+0000 7fc98db9b700 1 --2- 172.21.15.82:0/2140656794 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55adca5d16f0 0x55adca5d1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:14.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.569+0000 7fc98db9b700 1 --2- 172.21.15.82:0/2140656794 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55adca5d16f0 0x55adca5d1b00 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bbe231458e9b9c80 server_cookie=4760923c0cc04928 in_seq=0 out_seq=0 2023-09-23T09:31:14.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.569+0000 7fc9717fa700 10 client.27392 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:31:14.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.570+0000 7fc9717fa700 1 -- 172.21.15.82:0/2140656794 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55adca4b1970 con 0x55adca5d16f0 2023-09-23T09:31:14.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.570+0000 7fc9717fa700 10 client.27392 handle_command_reply: tid=0 2023-09-23T09:31:14.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.570+0000 7fc9a3745b80 1 client.27392 shutdown 2023-09-23T09:31:14.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.570+0000 7fc9a3745b80 1 -- 172.21.15.82:0/2140656794 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55adca56cca0 msgr2=0x55adca568460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:31:14.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.570+0000 7fc9a3745b80 1 --2- 172.21.15.82:0/2140656794 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55adca56cca0 0x55adca568460 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fc980028040 tx=0x7fc98001d000 comp rx=0 tx=0).stop 2023-09-23T09:31:14.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.572+0000 7fc9a3745b80 1 -- 172.21.15.82:0/2140656794 shutdown_connections 2023-09-23T09:31:14.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.572+0000 7fc9a3745b80 1 --2- 172.21.15.82:0/2140656794 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55adca56cca0 0x55adca568460 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:14.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.572+0000 7fc9a3745b80 1 --2- 172.21.15.82:0/2140656794 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55adca566c40 0x55adca5777d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:14.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.572+0000 7fc9a3745b80 1 --2- 172.21.15.82:0/2140656794 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55adca5d16f0 0x55adca5d1b00 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:14.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.572+0000 7fc9a3745b80 1 --2- 172.21.15.82:0/2140656794 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55adca56c380 0x55adca567f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:14.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.572+0000 7fc9a3745b80 1 -- 172.21.15.82:0/2140656794 >> 172.21.15.82:0/2140656794 conn(0x55adca4db0e0 msgr2=0x55adca56a050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:31:14.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.572+0000 7fc9717fa700 0 client.27392 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:31:14.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.573+0000 7fc9a3745b80 1 -- 172.21.15.82:0/2140656794 shutdown_connections 2023-09-23T09:31:14.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.573+0000 7fc9a3745b80 1 -- 172.21.15.82:0/2140656794 wait complete. 2023-09-23T09:31:14.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.574+0000 7fc9a3745b80 20 client.27392 trim_cache size 0 max 16384 2023-09-23T09:31:14.576 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:31:14.576 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "no active scrubs running", 2023-09-23T09:31:14.576 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": {} 2023-09-23T09:31:14.576 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:31:14.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.576+0000 7fc98fdff700 1 -- 172.21.15.82:0/1112853910 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fc9780a02d0 msgr2=0x7fc9780a2790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:31:14.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.576+0000 7fc98fdff700 1 --2- 172.21.15.82:0/1112853910 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fc9780a02d0 0x7fc9780a2790 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc980027000 tx=0x7fc980003c00 comp rx=0 tx=0).stop 2023-09-23T09:31:14.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.576+0000 7fc98fdff700 1 -- 172.21.15.82:0/1112853910 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc98806bff0 msgr2=0x7fc9881ab510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:31:14.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.576+0000 7fc98fdff700 1 --2- 172.21.15.82:0/1112853910 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc98806bff0 0x7fc9881ab510 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fc97c007fa0 tx=0x7fc97c00d3b0 comp rx=0 tx=0).stop 2023-09-23T09:31:14.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.577+0000 7fc98fdff700 1 -- 172.21.15.82:0/1112853910 shutdown_connections 2023-09-23T09:31:14.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.577+0000 7fc98fdff700 1 --2- 172.21.15.82:0/1112853910 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fc9780a02d0 0x7fc9780a2790 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:14.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.577+0000 7fc98fdff700 1 --2- 172.21.15.82:0/1112853910 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc988119fc0 0x7fc9881a5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:14.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.577+0000 7fc98fdff700 1 --2- 172.21.15.82:0/1112853910 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc98806bff0 0x7fc9881ab510 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:14.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.577+0000 7fc98fdff700 1 --2- 172.21.15.82:0/1112853910 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc98806c910 0x7fc9881aba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:14.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.577+0000 7fc98fdff700 1 -- 172.21.15.82:0/1112853910 >> 172.21.15.82:0/1112853910 conn(0x7fc98806b710 msgr2=0x7fc98811b490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:31:14.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.580+0000 7fc98fdff700 1 -- 172.21.15.82:0/1112853910 shutdown_connections 2023-09-23T09:31:14.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:14.580+0000 7fc98fdff700 1 -- 172.21.15.82:0/1112853910 wait complete. 2023-09-23T09:31:14.615 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-09-23T09:31:14.615 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-23T09:31:14.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:31:14 smithi082 ceph-mon[97694]: pgmap v1089: 97 pgs: 97 active+clean; 16 GiB data, 57 GiB used, 1016 GiB / 1.0 TiB avail; 897 KiB/s rd, 7.2 MiB/s wr, 569 op/s 2023-09-23T09:31:15.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.003+0000 7fb3969ff700 1 -- 172.21.15.82:0/3186584835 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb390107920 msgr2=0x7fb390107d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:31:15.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.003+0000 7fb3969ff700 1 --2- 172.21.15.82:0/3186584835 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb390107920 0x7fb390107d00 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fb38800b0a0 tx=0x7fb38800b3b0 comp rx=0 tx=0).stop 2023-09-23T09:31:15.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.004+0000 7fb3969ff700 1 -- 172.21.15.82:0/3186584835 shutdown_connections 2023-09-23T09:31:15.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.004+0000 7fb3969ff700 1 --2- 172.21.15.82:0/3186584835 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb390113a70 0x7fb390115e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:15.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.004+0000 7fb3969ff700 1 --2- 172.21.15.82:0/3186584835 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb390107920 0x7fb390107d00 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:15.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.004+0000 7fb3969ff700 1 --2- 172.21.15.82:0/3186584835 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb390108240 0x7fb390113530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:15.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.004+0000 7fb3969ff700 1 -- 172.21.15.82:0/3186584835 >> 172.21.15.82:0/3186584835 conn(0x7fb39006b960 msgr2=0x7fb39006bd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:31:15.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.005+0000 7fb3969ff700 1 -- 172.21.15.82:0/3186584835 shutdown_connections 2023-09-23T09:31:15.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.005+0000 7fb3969ff700 1 -- 172.21.15.82:0/3186584835 wait complete. 2023-09-23T09:31:15.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.006+0000 7fb3969ff700 1 Processor -- start 2023-09-23T09:31:15.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.007+0000 7fb3969ff700 1 -- start start 2023-09-23T09:31:15.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.007+0000 7fb3969ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb390107920 0x7fb39011c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:15.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.007+0000 7fb3969ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb390108240 0x7fb39011c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:15.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.007+0000 7fb3969ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb390113a70 0x7fb3901173f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:15.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.007+0000 7fb3969ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb390117a00 con 0x7fb390108240 2023-09-23T09:31:15.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.007+0000 7fb3969ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb390117b70 con 0x7fb390113a70 2023-09-23T09:31:15.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.007+0000 7fb3969ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb390117d30 con 0x7fb390107920 2023-09-23T09:31:15.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.008+0000 7fb38ffff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb390107920 0x7fb39011c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:15.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.008+0000 7fb38ffff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb390107920 0x7fb39011c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:58534/0 (socket says 172.21.15.82:58534) 2023-09-23T09:31:15.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.008+0000 7fb38ffff700 1 -- 172.21.15.82:0/1899917297 learned_addr learned my addr 172.21.15.82:0/1899917297 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:31:15.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.008+0000 7fb38f7fe700 1 --2- 172.21.15.82:0/1899917297 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb390108240 0x7fb39011c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:15.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.009+0000 7fb394f9c700 1 --2- 172.21.15.82:0/1899917297 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb390113a70 0x7fb3901173f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:15.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.009+0000 7fb38ffff700 1 -- 172.21.15.82:0/1899917297 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb390113a70 msgr2=0x7fb3901173f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:31:15.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.009+0000 7fb38ffff700 1 --2- 172.21.15.82:0/1899917297 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb390113a70 0x7fb3901173f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:15.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.009+0000 7fb38ffff700 1 -- 172.21.15.82:0/1899917297 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb390108240 msgr2=0x7fb39011c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:31:15.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.009+0000 7fb38ffff700 1 --2- 172.21.15.82:0/1899917297 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb390108240 0x7fb39011c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:15.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.009+0000 7fb38ffff700 1 -- 172.21.15.82:0/1899917297 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb388009d00 con 0x7fb390107920 2023-09-23T09:31:15.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.011+0000 7fb38ffff700 1 --2- 172.21.15.82:0/1899917297 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb390107920 0x7fb39011c200 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fb388006070 tx=0x7fb388009700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:31:15.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.014+0000 7fb38d7fa700 1 -- 172.21.15.82:0/1899917297 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb388010580 con 0x7fb390107920 2023-09-23T09:31:15.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.014+0000 7fb38d7fa700 1 -- 172.21.15.82:0/1899917297 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb38800f070 con 0x7fb390107920 2023-09-23T09:31:15.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.014+0000 7fb38d7fa700 1 -- 172.21.15.82:0/1899917297 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb388007b20 con 0x7fb390107920 2023-09-23T09:31:15.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.017+0000 7fb3969ff700 1 -- 172.21.15.82:0/1899917297 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb390117fb0 con 0x7fb390107920 2023-09-23T09:31:15.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.017+0000 7fb3969ff700 1 -- 172.21.15.82:0/1899917297 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb39011af60 con 0x7fb390107920 2023-09-23T09:31:15.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.019+0000 7fb3969ff700 1 -- 172.21.15.82:0/1899917297 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb390067710 con 0x7fb390107920 2023-09-23T09:31:15.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.023+0000 7fb38d7fa700 1 -- 172.21.15.82:0/1899917297 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7fb388003a00 con 0x7fb390107920 2023-09-23T09:31:15.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.026+0000 7fb38d7fa700 1 --2- 172.21.15.82:0/1899917297 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fb3780a02d0 0x7fb3780a2790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:15.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.026+0000 7fb38d7fa700 1 -- 172.21.15.82:0/1899917297 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fb3880cbfb0 con 0x7fb390107920 2023-09-23T09:31:15.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.027+0000 7fb38d7fa700 1 -- 172.21.15.82:0/1899917297 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7fb3880cc390 con 0x7fb390107920 2023-09-23T09:31:15.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.027+0000 7fb38f7fe700 1 --2- 172.21.15.82:0/1899917297 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fb3780a02d0 0x7fb3780a2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:15.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.028+0000 7fb38f7fe700 1 --2- 172.21.15.82:0/1899917297 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fb3780a02d0 0x7fb3780a2790 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb390118be0 tx=0x7fb384009190 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:31:15.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:31:14 smithi135 ceph-mon[99205]: pgmap v1089: 97 pgs: 97 active+clean; 16 GiB data, 57 GiB used, 1016 GiB / 1.0 TiB avail; 897 KiB/s rd, 7.2 MiB/s wr, 569 op/s 2023-09-23T09:31:15.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:31:14 smithi161 ceph-mon[99580]: pgmap v1089: 97 pgs: 97 active+clean; 16 GiB data, 57 GiB used, 1016 GiB / 1.0 TiB avail; 897 KiB/s rd, 7.2 MiB/s wr, 569 op/s 2023-09-23T09:31:15.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.523+0000 7fb3969ff700 1 -- 172.21.15.82:0/1899917297 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb390118920 con 0x7fb390107920 2023-09-23T09:31:15.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.525+0000 7fb38d7fa700 1 -- 172.21.15.82:0/1899917297 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 102 v102) v1 ==== 95+0+11356 (secure 0 0 0) 0x7fb388095bc0 con 0x7fb390107920 2023-09-23T09:31:15.527 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T09:31:15.527 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":102,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/1237857359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1237857359},{"type":"v1","addr":"172.21.15.82:6835","nonce":1237857359}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/1335102362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":1335102362},{"type":"v1","addr":"172.21.15.82:6837","nonce":1335102362}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":102,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-23T08:54:52.600479+0000","modified":"2023-09-23T09:31:00.873166+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24557,"mds_1":24550,"mds_2":24526,"mds_3":24515,"mds_4":24514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/3645331700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3645331700},{"type":"v1","addr":"172.21.15.135:6835","nonce":3645331700}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14658":{"gid":14658,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6839/205725278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":205725278},{"type":"v1","addr":"172.21.15.82:6839","nonce":205725278}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14670":{"gid":14670,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6841/2659297867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":2659297867},{"type":"v1","addr":"172.21.15.82:6841","nonce":2659297867}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24461":{"gid":24461,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/503886037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":503886037},{"type":"v1","addr":"172.21.15.135:6833","nonce":503886037}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24463":{"gid":24463,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.161:6833/471569125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":471569125},{"type":"v1","addr":"172.21.15.161:6833","nonce":471569125}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24514":{"gid":24514,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":10,"addr":"172.21.15.161:6835/2237964162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":2237964162},{"type":"v1","addr":"172.21.15.161:6835","nonce":2237964162}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24515":{"gid":24515,"name":"h","rank":3,"incarnation":22,"state":"up:active","state_seq":8,"addr":"172.21.15.135:6837/2655304858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2655304858},{"type":"v1","addr":"172.21.15.135:6837","nonce":2655304858}]},"join_fscid":-1,"export_targets":[0,1,2,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24526":{"gid":24526,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.161:6837/43639843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":43639843},{"type":"v1","addr":"172.21.15.161:6837","nonce":43639843}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24550":{"gid":24550,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.161:6839/758982817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6838","nonce":758982817},{"type":"v1","addr":"172.21.15.161:6839","nonce":758982817}]},"join_fscid":-1,"export_targets":[0,3],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24557":{"gid":24557,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6839/2508669274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2508669274},{"type":"v1","addr":"172.21.15.135:6839","nonce":2508669274}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-23T09:31:15.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.529+0000 7fb3969ff700 1 -- 172.21.15.82:0/1899917297 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fb3780a02d0 msgr2=0x7fb3780a2790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:31:15.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.529+0000 7fb3969ff700 1 --2- 172.21.15.82:0/1899917297 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fb3780a02d0 0x7fb3780a2790 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb390118be0 tx=0x7fb384009190 comp rx=0 tx=0).stop 2023-09-23T09:31:15.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.529+0000 7fb3969ff700 1 -- 172.21.15.82:0/1899917297 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb390107920 msgr2=0x7fb39011c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:31:15.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.529+0000 7fb3969ff700 1 --2- 172.21.15.82:0/1899917297 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb390107920 0x7fb39011c200 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fb388006070 tx=0x7fb388009700 comp rx=0 tx=0).stop 2023-09-23T09:31:15.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.529+0000 7fb3969ff700 1 -- 172.21.15.82:0/1899917297 shutdown_connections 2023-09-23T09:31:15.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.529+0000 7fb3969ff700 1 --2- 172.21.15.82:0/1899917297 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fb3780a02d0 0x7fb3780a2790 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:15.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.529+0000 7fb3969ff700 1 --2- 172.21.15.82:0/1899917297 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb390113a70 0x7fb3901173f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:15.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.529+0000 7fb3969ff700 1 --2- 172.21.15.82:0/1899917297 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb390107920 0x7fb39011c200 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:15.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.529+0000 7fb3969ff700 1 --2- 172.21.15.82:0/1899917297 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb390108240 0x7fb39011c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:15.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.529+0000 7fb3969ff700 1 -- 172.21.15.82:0/1899917297 >> 172.21.15.82:0/1899917297 conn(0x7fb39006b960 msgr2=0x7fb39010b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:31:15.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.529+0000 7fb3969ff700 1 -- 172.21.15.82:0/1899917297 shutdown_connections 2023-09-23T09:31:15.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.529+0000 7fb3969ff700 1 -- 172.21.15.82:0/1899917297 wait complete. 2023-09-23T09:31:15.534 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 102 2023-09-23T09:31:15.567 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-09-23T09:31:15.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 245.0 s, 551.0 tps, lat 180.404 ms stddev 55.885 2023-09-23T09:31:15.873 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:31:15 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/1899917297' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T09:31:15.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.935+0000 7f264d9ff700 1 -- 172.21.15.82:0/3700324149 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f264810f440 msgr2=0x7f264810d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:31:15.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.935+0000 7f264d9ff700 1 --2- 172.21.15.82:0/3700324149 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f264810f440 0x7f264810d0a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f2630009990 tx=0x7f2630009ca0 comp rx=0 tx=0).stop 2023-09-23T09:31:15.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.935+0000 7f264d9ff700 1 -- 172.21.15.82:0/3700324149 shutdown_connections 2023-09-23T09:31:15.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.935+0000 7f264d9ff700 1 --2- 172.21.15.82:0/3700324149 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f264811a100 0x7f264811c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:15.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.935+0000 7f264d9ff700 1 --2- 172.21.15.82:0/3700324149 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f264810efd0 0x7f264810cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:15.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.935+0000 7f264d9ff700 1 --2- 172.21.15.82:0/3700324149 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f264810f440 0x7f264810d0a0 secure :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f2630009990 tx=0x7f2630009ca0 comp rx=0 tx=0).stop 2023-09-23T09:31:15.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.935+0000 7f264d9ff700 1 -- 172.21.15.82:0/3700324149 >> 172.21.15.82:0/3700324149 conn(0x7f264806cbe0 msgr2=0x7f264806cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:31:15.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.936+0000 7f264d9ff700 1 -- 172.21.15.82:0/3700324149 shutdown_connections 2023-09-23T09:31:15.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.936+0000 7f264d9ff700 1 -- 172.21.15.82:0/3700324149 wait complete. 2023-09-23T09:31:15.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.937+0000 7f264d9ff700 1 Processor -- start 2023-09-23T09:31:15.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.938+0000 7f264d9ff700 1 -- start start 2023-09-23T09:31:15.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.938+0000 7f264d9ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f264810efd0 0x7f26481184f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:15.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.938+0000 7f264d9ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f264811a100 0x7f2648118a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:15.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.938+0000 7f264d9ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2648111550 0x7f2648111a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:15.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.938+0000 7f264d9ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2648112190 con 0x7f2648111550 2023-09-23T09:31:15.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.938+0000 7f264d9ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2648112300 con 0x7f264810efd0 2023-09-23T09:31:15.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.938+0000 7f264d9ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2648116080 con 0x7f264811a100 2023-09-23T09:31:15.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.939+0000 7f2646ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f264810efd0 0x7f26481184f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:15.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.939+0000 7f26467fc700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f264811a100 0x7f2648118a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:15.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.939+0000 7f2646ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f264810efd0 0x7f26481184f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:50830/0 (socket says 172.21.15.82:50830) 2023-09-23T09:31:15.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.939+0000 7f2646ffd700 1 -- 172.21.15.82:0/3788039347 learned_addr learned my addr 172.21.15.82:0/3788039347 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:31:15.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.940+0000 7f26477fe700 1 --2- 172.21.15.82:0/3788039347 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2648111550 0x7f2648111a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:15.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.940+0000 7f2646ffd700 1 -- 172.21.15.82:0/3788039347 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f264811a100 msgr2=0x7f2648118a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:31:15.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.940+0000 7f2646ffd700 1 --2- 172.21.15.82:0/3788039347 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f264811a100 0x7f2648118a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:15.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.940+0000 7f2646ffd700 1 -- 172.21.15.82:0/3788039347 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2648111550 msgr2=0x7f2648111a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:31:15.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.941+0000 7f2646ffd700 1 --2- 172.21.15.82:0/3788039347 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2648111550 0x7f2648111a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:15.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.941+0000 7f2646ffd700 1 -- 172.21.15.82:0/3788039347 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26300095f0 con 0x7f264810efd0 2023-09-23T09:31:15.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.941+0000 7f26477fe700 1 --2- 172.21.15.82:0/3788039347 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2648111550 0x7f2648111a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T09:31:15.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.942+0000 7f2646ffd700 1 --2- 172.21.15.82:0/3788039347 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f264810efd0 0x7f26481184f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f2638007f10 tx=0x7f263800d3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:31:15.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.943+0000 7f264c9fd700 1 -- 172.21.15.82:0/3788039347 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f263800ddd0 con 0x7f264810efd0 2023-09-23T09:31:15.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.943+0000 7f264c9fd700 1 -- 172.21.15.82:0/3788039347 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f263800f040 con 0x7f264810efd0 2023-09-23T09:31:15.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.943+0000 7f264c9fd700 1 -- 172.21.15.82:0/3788039347 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26380048e0 con 0x7f264810efd0 2023-09-23T09:31:15.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.943+0000 7f264d9ff700 1 -- 172.21.15.82:0/3788039347 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2648116310 con 0x7f264810efd0 2023-09-23T09:31:15.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.943+0000 7f264d9ff700 1 -- 172.21.15.82:0/3788039347 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26481167a0 con 0x7f264810efd0 2023-09-23T09:31:15.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.950+0000 7f26613e3b80 1 Processor -- start 2023-09-23T09:31:15.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.950+0000 7f26613e3b80 1 -- start start 2023-09-23T09:31:15.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.951+0000 7f26613e3b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556da834d380 0x556da834d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:15.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.951+0000 7f26613e3b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556da834dca0 0x556da8347700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:15.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.951+0000 7f26613e3b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556da8347c40 0x556da83480a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:15.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.951+0000 7f26613e3b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x556da82af7b0 con 0x556da8347c40 2023-09-23T09:31:15.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.951+0000 7f26613e3b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x556da82a0780 con 0x556da834d380 2023-09-23T09:31:15.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.951+0000 7f26613e3b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x556da829e0a0 con 0x556da834dca0 2023-09-23T09:31:15.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.952+0000 7f26477fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556da834d380 0x556da834d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:15.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.952+0000 7f26477fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556da834d380 0x556da834d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:50838/0 (socket says 172.21.15.82:50838) 2023-09-23T09:31:15.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.952+0000 7f26477fe700 1 -- 172.21.15.82:0/2767892580 learned_addr learned my addr 172.21.15.82:0/2767892580 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:31:15.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.952+0000 7f26467fc700 1 --2- 172.21.15.82:0/2767892580 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556da8347c40 0x556da83480a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:15.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.953+0000 7f26477fe700 1 -- 172.21.15.82:0/2767892580 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556da834dca0 msgr2=0x556da8347700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:31:15.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.953+0000 7f26477fe700 1 --2- 172.21.15.82:0/2767892580 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556da834dca0 0x556da8347700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:15.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.953+0000 7f26477fe700 1 -- 172.21.15.82:0/2767892580 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556da8347c40 msgr2=0x556da83480a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:31:15.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.953+0000 7f26477fe700 1 --2- 172.21.15.82:0/2767892580 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556da8347c40 0x556da83480a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:15.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.953+0000 7f26477fe700 1 -- 172.21.15.82:0/2767892580 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556da8119630 con 0x556da834d380 2023-09-23T09:31:15.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.953+0000 7f26477fe700 1 --2- 172.21.15.82:0/2767892580 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556da834d380 0x556da834d760 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f2640009c20 tx=0x7f2640009f30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70bd0219ceb7a567 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:31:15.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.957+0000 7f264c9fd700 1 -- 172.21.15.82:0/3788039347 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f2638004ad0 con 0x7f264810efd0 2023-09-23T09:31:15.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.958+0000 7f263dffb700 1 -- 172.21.15.82:0/2767892580 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f264000eaa0 con 0x556da834d380 2023-09-23T09:31:15.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.958+0000 7f263dffb700 1 -- 172.21.15.82:0/2767892580 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f264000ec00 con 0x556da834d380 2023-09-23T09:31:15.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.958+0000 7f263dffb700 1 -- 172.21.15.82:0/2767892580 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2640010630 con 0x556da834d380 2023-09-23T09:31:15.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.960+0000 7f264c9fd700 1 --2- 172.21.15.82:0/3788039347 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f26340a0250 0x7f26340a2710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:15.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.961+0000 7f264c9fd700 1 -- 172.21.15.82:0/3788039347 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f26380cafe0 con 0x7f264810efd0 2023-09-23T09:31:15.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.961+0000 7f26613e3b80 1 -- 172.21.15.82:0/2767892580 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556da834d380 msgr2=0x556da834d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:31:15.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.961+0000 7f26613e3b80 1 --2- 172.21.15.82:0/2767892580 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556da834d380 0x556da834d760 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f2640009c20 tx=0x7f2640009f30 comp rx=0 tx=0).stop 2023-09-23T09:31:15.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.962+0000 7f26613e3b80 1 -- 172.21.15.82:0/2767892580 shutdown_connections 2023-09-23T09:31:15.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.962+0000 7f26613e3b80 1 --2- 172.21.15.82:0/2767892580 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556da8347c40 0x556da83480a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:15.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.962+0000 7f26613e3b80 1 --2- 172.21.15.82:0/2767892580 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556da834d380 0x556da834d760 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:15.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.962+0000 7f26613e3b80 1 --2- 172.21.15.82:0/2767892580 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556da834dca0 0x556da8347700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:15.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.962+0000 7f26613e3b80 1 -- 172.21.15.82:0/2767892580 >> 172.21.15.82:0/2767892580 conn(0x556da82bc0e0 msgr2=0x556da8342410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:31:15.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.962+0000 7f2646ffd700 1 --2- 172.21.15.82:0/3788039347 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f26340a0250 0x7f26340a2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:15.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.963+0000 7f26613e3b80 1 -- 172.21.15.82:0/2767892580 shutdown_connections 2023-09-23T09:31:15.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.964+0000 7f26613e3b80 1 -- 172.21.15.82:0/2767892580 wait complete. 2023-09-23T09:31:15.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.964+0000 7f2646ffd700 1 --2- 172.21.15.82:0/3788039347 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f26340a0250 0x7f26340a2710 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2638094c70 tx=0x7f263800b040 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:31:15.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.964+0000 7f26613e3b80 1 -- start start 2023-09-23T09:31:15.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.965+0000 7f26613e3b80 1 Processor -- start 2023-09-23T09:31:15.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.966+0000 7f26613e3b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556da8347c40 0x556da8353cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:15.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.966+0000 7f26613e3b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556da834d380 0x556da8350ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:15.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.966+0000 7f26613e3b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556da834dca0 0x556da8351600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:15.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.966+0000 7f26613e3b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x556da8299990 con 0x556da834d380 2023-09-23T09:31:15.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.966+0000 7f26613e3b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x556da8237bb0 con 0x556da834dca0 2023-09-23T09:31:15.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.966+0000 7f26613e3b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x556da82378b0 con 0x556da8347c40 2023-09-23T09:31:15.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.966+0000 7f26613e3b80 10 client.0 _ll_register_callbacks cb 0x556da8181a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:31:15.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.967+0000 7f26467fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556da834d380 0x556da8350ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:15.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.967+0000 7f26467fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556da834d380 0x556da8350ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44802/0 (socket says 172.21.15.82:44802) 2023-09-23T09:31:15.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.967+0000 7f26467fc700 1 -- 172.21.15.82:0/860031212 learned_addr learned my addr 172.21.15.82:0/860031212 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:31:15.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.967+0000 7f26477fe700 1 --2- 172.21.15.82:0/860031212 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556da8347c40 0x556da8353cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:15.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.967+0000 7f26477fe700 1 --2- 172.21.15.82:0/860031212 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556da834dca0 0x556da8351600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:15.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.968+0000 7f26467fc700 1 -- 172.21.15.82:0/860031212 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556da8347c40 msgr2=0x556da8353cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:31:15.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.968+0000 7f26467fc700 1 --2- 172.21.15.82:0/860031212 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556da8347c40 0x556da8353cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:15.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.968+0000 7f26467fc700 1 -- 172.21.15.82:0/860031212 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556da834dca0 msgr2=0x556da8351600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:31:15.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.968+0000 7f26467fc700 1 --2- 172.21.15.82:0/860031212 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556da834dca0 0x556da8351600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:15.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.968+0000 7f26467fc700 1 -- 172.21.15.82:0/860031212 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2640009850 con 0x556da834d380 2023-09-23T09:31:15.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.968+0000 7f26467fc700 1 --2- 172.21.15.82:0/860031212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556da834d380 0x556da8350ec0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f2630009990 tx=0x7f2630005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be80b179ec078bdd server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:31:15.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.968+0000 7f2626ffd700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:31:15.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.969+0000 7f2626ffd700 1 -- 172.21.15.82:0/860031212 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f263001d070 con 0x556da834d380 2023-09-23T09:31:15.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.969+0000 7f2626ffd700 1 -- 172.21.15.82:0/860031212 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(145..145 src has 1..145) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f263000bbe0 con 0x556da834d380 2023-09-23T09:31:15.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.969+0000 7f26613e3b80 1 -- 172.21.15.82:0/860031212 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556da83171c0 con 0x556da834d380 2023-09-23T09:31:15.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.970+0000 7f2626ffd700 1 -- 172.21.15.82:0/860031212 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7f263000bda0 con 0x556da834d380 2023-09-23T09:31:15.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.970+0000 7f26613e3b80 10 client.17721 fetch_fsmap learned FSMap version 102 2023-09-23T09:31:15.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.970+0000 7f26613e3b80 1 -- 172.21.15.82:0/860031212 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=4+}) v3 -- 0x556da80c5de0 con 0x556da834d380 2023-09-23T09:31:15.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.971+0000 7f2626ffd700 1 -- 172.21.15.82:0/860031212 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x556da83171c0 con 0x556da834d380 2023-09-23T09:31:15.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.971+0000 7f2626ffd700 1 -- 172.21.15.82:0/860031212 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 102) v1 ==== 7954+0+0 (secure 0 0 0) 0x7f2630003820 con 0x556da834d380 2023-09-23T09:31:15.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.971+0000 7f26613e3b80 10 client.17721 fetch_fsmap finished waiting for FSMap version 102 2023-09-23T09:31:15.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.971+0000 7f26613e3b80 10 client.17721 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2023-09-23T09:31:15.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.971+0000 7f26613e3b80 20 client.17721 populate_metadata read hostname 'smithi082' 2023-09-23T09:31:15.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.971+0000 7f26613e3b80 1 --2- 172.21.15.82:0/860031212 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x556da83618a0 0x556da8363cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:15.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.971+0000 7f26613e3b80 4 client.17721 mds_command: new command op to 24514 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:31:15.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.971+0000 7f26613e3b80 1 -- 172.21.15.82:0/860031212 --> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556da823fba0 con 0x556da83618a0 2023-09-23T09:31:15.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.972+0000 7f26477fe700 1 --2- 172.21.15.82:0/860031212 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x556da83618a0 0x556da8363cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:15.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.972+0000 7f26477fe700 1 --2- 172.21.15.82:0/860031212 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x556da83618a0 0x556da8363cc0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=157d76d2ea12a9b0 server_cookie=6383e4f8424cc602 in_seq=0 out_seq=0 2023-09-23T09:31:15.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.972+0000 7f2626ffd700 10 client.17721 ms_handle_connect on v2:172.21.15.161:6834/2237964162 2023-09-23T09:31:15.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.973+0000 7f2626ffd700 1 -- 172.21.15.82:0/860031212 <== mds.4 v2:172.21.15.161:6834/2237964162 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x556da823fba0 con 0x556da83618a0 2023-09-23T09:31:15.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.973+0000 7f2626ffd700 10 client.17721 handle_command_reply: tid=0 2023-09-23T09:31:15.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.978+0000 7f26613e3b80 1 client.17721 shutdown 2023-09-23T09:31:15.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.979+0000 7f26613e3b80 1 -- 172.21.15.82:0/860031212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556da834d380 msgr2=0x556da8350ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:31:15.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.979+0000 7f26613e3b80 1 --2- 172.21.15.82:0/860031212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556da834d380 0x556da8350ec0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f2630009990 tx=0x7f2630005800 comp rx=0 tx=0).stop 2023-09-23T09:31:15.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.979+0000 7f26613e3b80 1 -- 172.21.15.82:0/860031212 shutdown_connections 2023-09-23T09:31:15.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.979+0000 7f26613e3b80 1 --2- 172.21.15.82:0/860031212 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x556da83618a0 0x556da8363cc0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:15.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.979+0000 7f26613e3b80 1 --2- 172.21.15.82:0/860031212 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556da834dca0 0x556da8351600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:15.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.979+0000 7f26613e3b80 1 --2- 172.21.15.82:0/860031212 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556da8347c40 0x556da8353cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:15.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.979+0000 7f26613e3b80 1 --2- 172.21.15.82:0/860031212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556da834d380 0x556da8350ec0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:15.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.979+0000 7f26613e3b80 1 -- 172.21.15.82:0/860031212 >> 172.21.15.82:0/860031212 conn(0x556da82bc0e0 msgr2=0x556da833c2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:31:15.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.980+0000 7f2626ffd700 0 client.17721 ms_handle_reset on v2:172.21.15.161:6834/2237964162 2023-09-23T09:31:15.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.980+0000 7f26613e3b80 1 -- 172.21.15.82:0/860031212 shutdown_connections 2023-09-23T09:31:15.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.980+0000 7f26613e3b80 1 -- 172.21.15.82:0/860031212 wait complete. 2023-09-23T09:31:15.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:15.981+0000 7f26613e3b80 20 client.17721 trim_cache size 0 max 16384 2023-09-23T09:31:16.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.007+0000 7f26613e3b80 1 Processor -- start 2023-09-23T09:31:16.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.010+0000 7f26613e3b80 1 -- start start 2023-09-23T09:31:16.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.011+0000 7f26613e3b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556da8347c40 0x556da8347700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:16.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.011+0000 7f26613e3b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556da834d380 0x556da8358800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:16.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.011+0000 7f26613e3b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556da834dca0 0x556da834b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:16.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.011+0000 7f26613e3b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x556da811b920 con 0x556da8347c40 2023-09-23T09:31:16.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.011+0000 7f26613e3b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x556da8358d80 con 0x556da834d380 2023-09-23T09:31:16.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.011+0000 7f26613e3b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x556da83433e0 con 0x556da834dca0 2023-09-23T09:31:16.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.012+0000 7f26477fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556da8347c40 0x556da8347700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:16.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.012+0000 7f26477fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556da8347c40 0x556da8347700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44808/0 (socket says 172.21.15.82:44808) 2023-09-23T09:31:16.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.012+0000 7f26477fe700 1 -- 172.21.15.82:0/1614494683 learned_addr learned my addr 172.21.15.82:0/1614494683 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:31:16.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.012+0000 7f26477fe700 1 --2- 172.21.15.82:0/1614494683 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556da834dca0 0x556da834b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:16.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.013+0000 7f26467fc700 1 --2- 172.21.15.82:0/1614494683 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556da834d380 0x556da8358800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:16.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.013+0000 7f26477fe700 1 -- 172.21.15.82:0/1614494683 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556da834d380 msgr2=0x556da8358800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:31:16.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.013+0000 7f26477fe700 1 --2- 172.21.15.82:0/1614494683 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556da834d380 0x556da8358800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:16.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.013+0000 7f26477fe700 1 -- 172.21.15.82:0/1614494683 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556da8347c40 msgr2=0x556da8347700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:31:16.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.013+0000 7f26477fe700 1 --2- 172.21.15.82:0/1614494683 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556da8347c40 0x556da8347700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:16.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.013+0000 7f26477fe700 1 -- 172.21.15.82:0/1614494683 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556da8343f50 con 0x556da834dca0 2023-09-23T09:31:16.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.014+0000 7f26477fe700 1 --2- 172.21.15.82:0/1614494683 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556da834dca0 0x556da834b050 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2640011b10 tx=0x7f2640000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=faf6f4386a5f5565 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:31:16.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.018+0000 7f263e7fc700 1 -- 172.21.15.82:0/1614494683 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f264002c430 con 0x556da834dca0 2023-09-23T09:31:16.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.018+0000 7f263e7fc700 1 -- 172.21.15.82:0/1614494683 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2640032070 con 0x556da834dca0 2023-09-23T09:31:16.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.018+0000 7f263e7fc700 1 -- 172.21.15.82:0/1614494683 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2640005290 con 0x556da834dca0 2023-09-23T09:31:16.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.019+0000 7f26613e3b80 1 -- 172.21.15.82:0/1614494683 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556da834dca0 msgr2=0x556da834b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:31:16.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.019+0000 7f26613e3b80 1 --2- 172.21.15.82:0/1614494683 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556da834dca0 0x556da834b050 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2640011b10 tx=0x7f2640000bc0 comp rx=0 tx=0).stop 2023-09-23T09:31:16.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.019+0000 7f26613e3b80 1 -- 172.21.15.82:0/1614494683 shutdown_connections 2023-09-23T09:31:16.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.019+0000 7f26613e3b80 1 --2- 172.21.15.82:0/1614494683 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556da834dca0 0x556da834b050 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:16.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.019+0000 7f26613e3b80 1 --2- 172.21.15.82:0/1614494683 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556da8347c40 0x556da8347700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:16.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.019+0000 7f26613e3b80 1 --2- 172.21.15.82:0/1614494683 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556da834d380 0x556da8358800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:16.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.019+0000 7f26613e3b80 1 -- 172.21.15.82:0/1614494683 >> 172.21.15.82:0/1614494683 conn(0x556da82bc0e0 msgr2=0x556da83420a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:31:16.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.020+0000 7f26613e3b80 1 -- 172.21.15.82:0/1614494683 shutdown_connections 2023-09-23T09:31:16.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.020+0000 7f26613e3b80 1 -- 172.21.15.82:0/1614494683 wait complete. 2023-09-23T09:31:16.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.020+0000 7f26613e3b80 1 -- start start 2023-09-23T09:31:16.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.021+0000 7f26613e3b80 1 Processor -- start 2023-09-23T09:31:16.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.022+0000 7f26613e3b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556da8347c40 0x556da83567e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:16.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.023+0000 7f26613e3b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556da834d380 0x556da8356d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:16.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.023+0000 7f26613e3b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556da834dca0 0x556da8357260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:16.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.023+0000 7f26613e3b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x556da83b4690 con 0x556da834dca0 2023-09-23T09:31:16.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.023+0000 7f26613e3b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x556da83b47d0 con 0x556da8347c40 2023-09-23T09:31:16.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.023+0000 7f26613e3b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x556da83b4910 con 0x556da834d380 2023-09-23T09:31:16.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.023+0000 7f26613e3b80 10 client.0 _ll_register_callbacks cb 0x7f2630005350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:31:16.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.024+0000 7f26477fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556da8347c40 0x556da83567e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:16.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.024+0000 7f26477fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556da8347c40 0x556da83567e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:50860/0 (socket says 172.21.15.82:50860) 2023-09-23T09:31:16.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.024+0000 7f26477fe700 1 -- 172.21.15.82:0/4001979806 learned_addr learned my addr 172.21.15.82:0/4001979806 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:31:16.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.024+0000 7f26477fe700 1 --2- 172.21.15.82:0/4001979806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556da834dca0 0x556da8357260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:16.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.025+0000 7f26467fc700 1 --2- 172.21.15.82:0/4001979806 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556da834d380 0x556da8356d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:16.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.026+0000 7f26467fc700 1 -- 172.21.15.82:0/4001979806 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556da8347c40 msgr2=0x556da83567e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:31:16.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.026+0000 7f26467fc700 1 --2- 172.21.15.82:0/4001979806 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556da8347c40 0x556da83567e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:16.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.026+0000 7f26467fc700 1 -- 172.21.15.82:0/4001979806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556da834dca0 msgr2=0x556da8357260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:31:16.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.026+0000 7f26467fc700 1 --2- 172.21.15.82:0/4001979806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556da834dca0 0x556da8357260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:16.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.026+0000 7f26467fc700 1 -- 172.21.15.82:0/4001979806 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2640023040 con 0x556da834d380 2023-09-23T09:31:16.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.026+0000 7f26467fc700 1 --2- 172.21.15.82:0/4001979806 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556da834d380 0x556da8356d20 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f2630003be0 tx=0x7f2630009580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c46fbdedf6a46e5 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:31:16.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.028+0000 7f2626ffd700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T09:31:16.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.028+0000 7f2626ffd700 1 -- 172.21.15.82:0/4001979806 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f263001d040 con 0x556da834d380 2023-09-23T09:31:16.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.028+0000 7f2626ffd700 1 -- 172.21.15.82:0/4001979806 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(145..145 src has 1..145) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f263000bdf0 con 0x556da834d380 2023-09-23T09:31:16.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.028+0000 7f26613e3b80 1 -- 172.21.15.82:0/4001979806 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556da833a8b0 con 0x556da834d380 2023-09-23T09:31:16.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.029+0000 7f2626ffd700 1 -- 172.21.15.82:0/4001979806 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2630009ee0 con 0x556da834d380 2023-09-23T09:31:16.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.029+0000 7f26613e3b80 10 client.27451 fetch_fsmap learned FSMap version 102 2023-09-23T09:31:16.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.029+0000 7f26613e3b80 1 -- 172.21.15.82:0/4001979806 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=4+}) v3 -- 0x556da80aec60 con 0x556da834d380 2023-09-23T09:31:16.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.029+0000 7f2626ffd700 1 -- 172.21.15.82:0/4001979806 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x556da833a8b0 con 0x556da834d380 2023-09-23T09:31:16.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.030+0000 7f2626ffd700 1 -- 172.21.15.82:0/4001979806 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 102) v1 ==== 7954+0+0 (secure 0 0 0) 0x7f2630004cc0 con 0x556da834d380 2023-09-23T09:31:16.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.030+0000 7f26613e3b80 10 client.27451 fetch_fsmap finished waiting for FSMap version 102 2023-09-23T09:31:16.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.030+0000 7f26613e3b80 10 client.27451 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2023-09-23T09:31:16.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.030+0000 7f26613e3b80 20 client.27451 populate_metadata read hostname 'smithi082' 2023-09-23T09:31:16.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.030+0000 7f26613e3b80 1 --2- 172.21.15.82:0/4001979806 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x556da83b5c80 0x556da83b80a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:16.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.030+0000 7f26613e3b80 4 client.27451 mds_command: new command op to 24514 tid=0[{"prefix": "damage ls"}] 2023-09-23T09:31:16.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.030+0000 7f26613e3b80 1 -- 172.21.15.82:0/4001979806 --> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x556da8292970 con 0x556da83b5c80 2023-09-23T09:31:16.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.030+0000 7f26477fe700 1 --2- 172.21.15.82:0/4001979806 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x556da83b5c80 0x556da83b80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:16.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.033+0000 7f26477fe700 1 --2- 172.21.15.82:0/4001979806 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x556da83b5c80 0x556da83b80a0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=1f38abf0865e6858 server_cookie=e2e89eff209e2d99 in_seq=0 out_seq=0 2023-09-23T09:31:16.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.033+0000 7f2626ffd700 10 client.27451 ms_handle_connect on v2:172.21.15.161:6834/2237964162 2023-09-23T09:31:16.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.033+0000 7f2626ffd700 1 -- 172.21.15.82:0/4001979806 <== mds.4 v2:172.21.15.161:6834/2237964162 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x556da8292970 con 0x556da83b5c80 2023-09-23T09:31:16.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.033+0000 7f2626ffd700 10 client.27451 handle_command_reply: tid=0 2023-09-23T09:31:16.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.033+0000 7f26613e3b80 1 client.27451 shutdown 2023-09-23T09:31:16.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.038+0000 7f26613e3b80 1 -- 172.21.15.82:0/4001979806 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556da834d380 msgr2=0x556da8356d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:31:16.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.038+0000 7f26613e3b80 1 --2- 172.21.15.82:0/4001979806 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556da834d380 0x556da8356d20 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f2630003be0 tx=0x7f2630009580 comp rx=0 tx=0).stop 2023-09-23T09:31:16.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.039+0000 7f26613e3b80 1 -- 172.21.15.82:0/4001979806 shutdown_connections 2023-09-23T09:31:16.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.039+0000 7f26613e3b80 1 --2- 172.21.15.82:0/4001979806 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x556da83b5c80 0x556da83b80a0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:16.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.039+0000 7f26613e3b80 1 --2- 172.21.15.82:0/4001979806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556da834dca0 0x556da8357260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:16.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.039+0000 7f26613e3b80 1 --2- 172.21.15.82:0/4001979806 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556da8347c40 0x556da83567e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:16.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.039+0000 7f26613e3b80 1 --2- 172.21.15.82:0/4001979806 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556da834d380 0x556da8356d20 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:16.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.039+0000 7f26613e3b80 1 -- 172.21.15.82:0/4001979806 >> 172.21.15.82:0/4001979806 conn(0x556da82bc0e0 msgr2=0x556da834b050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:31:16.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.039+0000 7f2626ffd700 0 client.27451 ms_handle_reset on v2:172.21.15.161:6834/2237964162 2023-09-23T09:31:16.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.039+0000 7f26613e3b80 1 -- 172.21.15.82:0/4001979806 shutdown_connections 2023-09-23T09:31:16.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.039+0000 7f26613e3b80 1 -- 172.21.15.82:0/4001979806 wait complete. 2023-09-23T09:31:16.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.040+0000 7f26613e3b80 20 client.27451 trim_cache size 0 max 16384 2023-09-23T09:31:16.042 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2023-09-23T09:31:16.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.041+0000 7f264d9ff700 1 -- 172.21.15.82:0/3788039347 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f26340a0250 msgr2=0x7f26340a2710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:31:16.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.041+0000 7f264d9ff700 1 --2- 172.21.15.82:0/3788039347 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f26340a0250 0x7f26340a2710 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2638094c70 tx=0x7f263800b040 comp rx=0 tx=0).stop 2023-09-23T09:31:16.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.041+0000 7f264d9ff700 1 -- 172.21.15.82:0/3788039347 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f264810efd0 msgr2=0x7f26481184f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:31:16.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.041+0000 7f264d9ff700 1 --2- 172.21.15.82:0/3788039347 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f264810efd0 0x7f26481184f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f2638007f10 tx=0x7f263800d3b0 comp rx=0 tx=0).stop 2023-09-23T09:31:16.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.048+0000 7f264d9ff700 1 -- 172.21.15.82:0/3788039347 shutdown_connections 2023-09-23T09:31:16.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.048+0000 7f264d9ff700 1 --2- 172.21.15.82:0/3788039347 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f26340a0250 0x7f26340a2710 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:16.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.048+0000 7f264d9ff700 1 --2- 172.21.15.82:0/3788039347 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2648111550 0x7f2648111a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:16.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.048+0000 7f264d9ff700 1 --2- 172.21.15.82:0/3788039347 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f264810efd0 0x7f26481184f0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:16.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.048+0000 7f264d9ff700 1 --2- 172.21.15.82:0/3788039347 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f264811a100 0x7f2648118a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:16.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.048+0000 7f264d9ff700 1 -- 172.21.15.82:0/3788039347 >> 172.21.15.82:0/3788039347 conn(0x7f264806cbe0 msgr2=0x7f264806f2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:31:16.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.050+0000 7f264d9ff700 1 -- 172.21.15.82:0/3788039347 shutdown_connections 2023-09-23T09:31:16.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.055+0000 7f264d9ff700 1 -- 172.21.15.82:0/3788039347 wait complete. 2023-09-23T09:31:16.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:31:15 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/1899917297' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T09:31:16.094 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-09-23T09:31:16.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:31:15 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/1899917297' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T09:31:16.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.496+0000 7f810dfff700 1 -- 172.21.15.82:0/4292591097 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f810810efd0 msgr2=0x7f810810cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:31:16.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.496+0000 7f810dfff700 1 --2- 172.21.15.82:0/4292591097 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f810810efd0 0x7f810810cb60 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f80fc009990 tx=0x7f80fc009ca0 comp rx=0 tx=0).stop 2023-09-23T09:31:16.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.497+0000 7f810dfff700 1 -- 172.21.15.82:0/4292591097 shutdown_connections 2023-09-23T09:31:16.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.497+0000 7f810dfff700 1 --2- 172.21.15.82:0/4292591097 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f810811a100 0x7f810811c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:16.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.497+0000 7f810dfff700 1 --2- 172.21.15.82:0/4292591097 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f810810efd0 0x7f810810cb60 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:16.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.497+0000 7f810dfff700 1 --2- 172.21.15.82:0/4292591097 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f810810f440 0x7f810810d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:16.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.497+0000 7f810dfff700 1 -- 172.21.15.82:0/4292591097 >> 172.21.15.82:0/4292591097 conn(0x7f810806cbe0 msgr2=0x7f810806cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:31:16.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.499+0000 7f810dfff700 1 -- 172.21.15.82:0/4292591097 shutdown_connections 2023-09-23T09:31:16.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.499+0000 7f810dfff700 1 -- 172.21.15.82:0/4292591097 wait complete. 2023-09-23T09:31:16.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.500+0000 7f810dfff700 1 Processor -- start 2023-09-23T09:31:16.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.501+0000 7f810dfff700 1 -- start start 2023-09-23T09:31:16.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.501+0000 7f810dfff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f810810efd0 0x7f8108116120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:16.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.501+0000 7f810dfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f810810f440 0x7f8108116660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:16.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.501+0000 7f810dfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f810811a100 0x7f81081112c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:16.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.501+0000 7f810dfff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8108111950 con 0x7f810810f440 2023-09-23T09:31:16.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.501+0000 7f810dfff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8108111ac0 con 0x7f810811a100 2023-09-23T09:31:16.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.501+0000 7f810dfff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8108111c80 con 0x7f810810efd0 2023-09-23T09:31:16.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.502+0000 7f8107fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f810811a100 0x7f81081112c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:16.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.502+0000 7f8107fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f810811a100 0x7f81081112c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:50870/0 (socket says 172.21.15.82:50870) 2023-09-23T09:31:16.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.502+0000 7f8107fff700 1 -- 172.21.15.82:0/3507700152 learned_addr learned my addr 172.21.15.82:0/3507700152 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:31:16.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.502+0000 7f81077fe700 1 --2- 172.21.15.82:0/3507700152 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f810810efd0 0x7f8108116120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:16.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.502+0000 7f8107fff700 1 -- 172.21.15.82:0/3507700152 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f810810efd0 msgr2=0x7f8108116120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:31:16.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.502+0000 7f8107fff700 1 --2- 172.21.15.82:0/3507700152 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f810810efd0 0x7f8108116120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:16.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.502+0000 7f8107fff700 1 -- 172.21.15.82:0/3507700152 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f810810f440 msgr2=0x7f8108116660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:31:16.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.502+0000 7f8107fff700 1 --2- 172.21.15.82:0/3507700152 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f810810f440 0x7f8108116660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:16.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.502+0000 7f8107fff700 1 -- 172.21.15.82:0/3507700152 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80fc0095f0 con 0x7f810811a100 2023-09-23T09:31:16.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.507+0000 7f8107fff700 1 --2- 172.21.15.82:0/3507700152 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f810811a100 0x7f81081112c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f8100007ee0 tx=0x7f810000d3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:31:16.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.507+0000 7f8104ff9700 1 -- 172.21.15.82:0/3507700152 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810000ddd0 con 0x7f810811a100 2023-09-23T09:31:16.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.507+0000 7f8104ff9700 1 -- 172.21.15.82:0/3507700152 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f810000f040 con 0x7f810811a100 2023-09-23T09:31:16.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.507+0000 7f8104ff9700 1 -- 172.21.15.82:0/3507700152 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81000058a0 con 0x7f810811a100 2023-09-23T09:31:16.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.508+0000 7f810dfff700 1 -- 172.21.15.82:0/3507700152 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8108111f60 con 0x7f810811a100 2023-09-23T09:31:16.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.509+0000 7f810dfff700 1 -- 172.21.15.82:0/3507700152 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8108115080 con 0x7f810811a100 2023-09-23T09:31:16.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.516+0000 7f812188db80 1 Processor -- start 2023-09-23T09:31:16.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.516+0000 7f8104ff9700 1 -- 172.21.15.82:0/3507700152 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f8100005000 con 0x7f810811a100 2023-09-23T09:31:16.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.516+0000 7f812188db80 1 -- start start 2023-09-23T09:31:16.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.517+0000 7f812188db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3417db380 0x55f3417db760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:16.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.517+0000 7f812188db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3417dbca0 0x55f3417d5700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:16.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.517+0000 7f812188db80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f3417d5c40 0x55f3417d60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:16.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.517+0000 7f812188db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f34173d7b0 con 0x55f3417dbca0 2023-09-23T09:31:16.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.517+0000 7f812188db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f34172e780 con 0x55f3417db380 2023-09-23T09:31:16.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.517+0000 7f812188db80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f34172c0a0 con 0x55f3417d5c40 2023-09-23T09:31:16.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.518+0000 7f8106ffd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f3417d5c40 0x55f3417d60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:16.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.518+0000 7f8106ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3417db380 0x55f3417db760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:16.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.518+0000 7f8106ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3417db380 0x55f3417db760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:50874/0 (socket says 172.21.15.82:50874) 2023-09-23T09:31:16.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.518+0000 7f8106ffd700 1 -- 172.21.15.82:0/4065924398 learned_addr learned my addr 172.21.15.82:0/4065924398 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:31:16.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.518+0000 7f8106ffd700 1 -- 172.21.15.82:0/4065924398 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f3417d5c40 msgr2=0x55f3417d60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:31:16.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.518+0000 7f8106ffd700 1 --2- 172.21.15.82:0/4065924398 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f3417d5c40 0x55f3417d60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:16.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.518+0000 7f8106ffd700 1 -- 172.21.15.82:0/4065924398 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3417dbca0 msgr2=0x55f3417d5700 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-23T09:31:16.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.519+0000 7f8106ffd700 1 --2- 172.21.15.82:0/4065924398 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3417dbca0 0x55f3417d5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:16.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.519+0000 7f8106ffd700 1 -- 172.21.15.82:0/4065924398 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f3415a7630 con 0x55f3417db380 2023-09-23T09:31:16.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.519+0000 7f8106ffd700 1 --2- 172.21.15.82:0/4065924398 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3417db380 0x55f3417db760 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f80f8013840 tx=0x7f80f8005c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64eb85d5b1929ffa server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:31:16.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.520+0000 7f80edffb700 1 -- 172.21.15.82:0/4065924398 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f8004a30 con 0x55f3417db380 2023-09-23T09:31:16.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.520+0000 7f80edffb700 1 -- 172.21.15.82:0/4065924398 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f80f80054b0 con 0x55f3417db380 2023-09-23T09:31:16.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.520+0000 7f80edffb700 1 -- 172.21.15.82:0/4065924398 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f8010660 con 0x55f3417db380 2023-09-23T09:31:16.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.520+0000 7f8104ff9700 1 --2- 172.21.15.82:0/3507700152 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f80f00a0180 0x7f80f00a2640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:16.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.521+0000 7f8104ff9700 1 -- 172.21.15.82:0/3507700152 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f81000cafa0 con 0x7f810811a100 2023-09-23T09:31:16.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.521+0000 7f812188db80 1 -- 172.21.15.82:0/4065924398 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3417db380 msgr2=0x55f3417db760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:31:16.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.521+0000 7f812188db80 1 --2- 172.21.15.82:0/4065924398 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3417db380 0x55f3417db760 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f80f8013840 tx=0x7f80f8005c50 comp rx=0 tx=0).stop 2023-09-23T09:31:16.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.522+0000 7f81077fe700 1 --2- 172.21.15.82:0/3507700152 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f80f00a0180 0x7f80f00a2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:16.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.524+0000 7f81077fe700 1 --2- 172.21.15.82:0/3507700152 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f80f00a0180 0x7f80f00a2640 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f80fc005950 tx=0x7f80fc0058e0 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:31:16.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.526+0000 7f812188db80 1 -- 172.21.15.82:0/4065924398 shutdown_connections 2023-09-23T09:31:16.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.526+0000 7f812188db80 1 --2- 172.21.15.82:0/4065924398 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f3417d5c40 0x55f3417d60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:16.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.526+0000 7f812188db80 1 --2- 172.21.15.82:0/4065924398 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3417db380 0x55f3417db760 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:16.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.526+0000 7f812188db80 1 --2- 172.21.15.82:0/4065924398 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3417dbca0 0x55f3417d5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:16.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.526+0000 7f812188db80 1 -- 172.21.15.82:0/4065924398 >> 172.21.15.82:0/4065924398 conn(0x55f34174a0e0 msgr2=0x55f3417d0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:31:16.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.527+0000 7f812188db80 1 -- 172.21.15.82:0/4065924398 shutdown_connections 2023-09-23T09:31:16.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.527+0000 7f812188db80 1 -- 172.21.15.82:0/4065924398 wait complete. 2023-09-23T09:31:16.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.528+0000 7f812188db80 1 -- start start 2023-09-23T09:31:16.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.528+0000 7f812188db80 1 Processor -- start 2023-09-23T09:31:16.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.529+0000 7f812188db80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f3417d5c40 0x55f3417e1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:16.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.529+0000 7f812188db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3417db380 0x55f3417deec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:16.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.529+0000 7f812188db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3417dbca0 0x55f3417df600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:16.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.529+0000 7f812188db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f341727990 con 0x55f3417dbca0 2023-09-23T09:31:16.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.529+0000 7f812188db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3416c5bb0 con 0x55f3417db380 2023-09-23T09:31:16.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.529+0000 7f812188db80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3416c58b0 con 0x55f3417d5c40 2023-09-23T09:31:16.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.529+0000 7f812188db80 10 client.0 _ll_register_callbacks cb 0x55f34160fa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:31:16.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.530+0000 7f8106ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3417db380 0x55f3417deec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:16.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.530+0000 7f8106ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3417db380 0x55f3417deec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:50886/0 (socket says 172.21.15.82:50886) 2023-09-23T09:31:16.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.530+0000 7f8106ffd700 1 -- 172.21.15.82:0/558830803 learned_addr learned my addr 172.21.15.82:0/558830803 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:31:16.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.531+0000 7f8107fff700 1 --2- 172.21.15.82:0/558830803 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3417dbca0 0x55f3417df600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:16.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.531+0000 7f8106ffd700 1 -- 172.21.15.82:0/558830803 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f3417d5c40 msgr2=0x55f3417e1cb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-23T09:31:16.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.531+0000 7f8106ffd700 1 --2- 172.21.15.82:0/558830803 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f3417d5c40 0x55f3417e1cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:16.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.531+0000 7f8106ffd700 1 -- 172.21.15.82:0/558830803 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3417dbca0 msgr2=0x55f3417df600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:31:16.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.531+0000 7f8106ffd700 1 --2- 172.21.15.82:0/558830803 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3417dbca0 0x55f3417df600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:16.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.531+0000 7f8106ffd700 1 -- 172.21.15.82:0/558830803 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80f8013520 con 0x55f3417db380 2023-09-23T09:31:16.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.532+0000 7f8106ffd700 1 --2- 172.21.15.82:0/558830803 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3417db380 0x55f3417deec0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f80f8005c20 tx=0x7f80f8004f60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41236d8e754e9e75 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:31:16.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.532+0000 7f80e6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-09-23T09:31:16.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.532+0000 7f80e6ffd700 1 -- 172.21.15.82:0/558830803 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f80054f0 con 0x55f3417db380 2023-09-23T09:31:16.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.532+0000 7f80e6ffd700 1 -- 172.21.15.82:0/558830803 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(145..145 src has 1..145) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f80f801d430 con 0x55f3417db380 2023-09-23T09:31:16.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.533+0000 7f812188db80 1 -- 172.21.15.82:0/558830803 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f3417a51c0 con 0x55f3417db380 2023-09-23T09:31:16.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.533+0000 7f80e6ffd700 1 -- 172.21.15.82:0/558830803 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7f80f8005650 con 0x55f3417db380 2023-09-23T09:31:16.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.533+0000 7f812188db80 10 client.27425 fetch_fsmap learned FSMap version 102 2023-09-23T09:31:16.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.533+0000 7f812188db80 1 -- 172.21.15.82:0/558830803 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=4+}) v3 -- 0x55f341553de0 con 0x55f3417db380 2023-09-23T09:31:16.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.534+0000 7f80e6ffd700 1 -- 172.21.15.82:0/558830803 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f3417a51c0 con 0x55f3417db380 2023-09-23T09:31:16.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.534+0000 7f80e6ffd700 1 -- 172.21.15.82:0/558830803 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 102) v1 ==== 7954+0+0 (secure 0 0 0) 0x7f80f801b070 con 0x55f3417db380 2023-09-23T09:31:16.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.534+0000 7f812188db80 10 client.27425 fetch_fsmap finished waiting for FSMap version 102 2023-09-23T09:31:16.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.534+0000 7f812188db80 10 client.27425 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2023-09-23T09:31:16.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.534+0000 7f812188db80 20 client.27425 populate_metadata read hostname 'smithi082' 2023-09-23T09:31:16.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.535+0000 7f812188db80 1 --2- 172.21.15.82:0/558830803 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x55f3417ef5a0 0x55f3417f19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:16.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.535+0000 7f812188db80 4 client.27425 mds_command: new command op to 24515 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:31:16.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.535+0000 7f812188db80 1 -- 172.21.15.82:0/558830803 --> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f3416cdba0 con 0x55f3417ef5a0 2023-09-23T09:31:16.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.535+0000 7f81077fe700 1 --2- 172.21.15.82:0/558830803 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x55f3417ef5a0 0x55f3417f19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:16.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.536+0000 7f81077fe700 1 --2- 172.21.15.82:0/558830803 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x55f3417ef5a0 0x55f3417f19c0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=cb64b084d17234eb server_cookie=14ab2db791e07465 in_seq=0 out_seq=0 2023-09-23T09:31:16.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.537+0000 7f80e6ffd700 10 client.27425 ms_handle_connect on v2:172.21.15.135:6836/2655304858 2023-09-23T09:31:16.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.537+0000 7f80e6ffd700 1 -- 172.21.15.82:0/558830803 <== mds.3 v2:172.21.15.135:6836/2655304858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f3416cdba0 con 0x55f3417ef5a0 2023-09-23T09:31:16.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.537+0000 7f80e6ffd700 10 client.27425 handle_command_reply: tid=0 2023-09-23T09:31:16.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.538+0000 7f812188db80 1 client.27425 shutdown 2023-09-23T09:31:16.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.538+0000 7f812188db80 1 -- 172.21.15.82:0/558830803 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3417db380 msgr2=0x55f3417deec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:31:16.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.538+0000 7f812188db80 1 --2- 172.21.15.82:0/558830803 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3417db380 0x55f3417deec0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f80f8005c20 tx=0x7f80f8004f60 comp rx=0 tx=0).stop 2023-09-23T09:31:16.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.539+0000 7f812188db80 1 -- 172.21.15.82:0/558830803 shutdown_connections 2023-09-23T09:31:16.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.539+0000 7f812188db80 1 --2- 172.21.15.82:0/558830803 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3417dbca0 0x55f3417df600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:16.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.539+0000 7f812188db80 1 --2- 172.21.15.82:0/558830803 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x55f3417ef5a0 0x55f3417f19c0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:16.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.539+0000 7f812188db80 1 --2- 172.21.15.82:0/558830803 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f3417d5c40 0x55f3417e1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:16.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.539+0000 7f812188db80 1 --2- 172.21.15.82:0/558830803 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3417db380 0x55f3417deec0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:16.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.539+0000 7f812188db80 1 -- 172.21.15.82:0/558830803 >> 172.21.15.82:0/558830803 conn(0x55f34174a0e0 msgr2=0x55f3417cab40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:31:16.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.539+0000 7f80e6ffd700 0 client.27425 ms_handle_reset on v2:172.21.15.135:6836/2655304858 2023-09-23T09:31:16.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.539+0000 7f812188db80 1 -- 172.21.15.82:0/558830803 shutdown_connections 2023-09-23T09:31:16.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.539+0000 7f812188db80 1 -- 172.21.15.82:0/558830803 wait complete. 2023-09-23T09:31:16.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.541+0000 7f812188db80 20 client.27425 trim_cache size 0 max 16384 2023-09-23T09:31:16.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.567+0000 7f812188db80 1 Processor -- start 2023-09-23T09:31:16.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.567+0000 7f812188db80 1 -- start start 2023-09-23T09:31:16.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.568+0000 7f812188db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3417d5c40 0x55f3417d5700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:16.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.568+0000 7f812188db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3417db380 0x55f3417e6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:16.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.568+0000 7f812188db80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f3417dbca0 0x55f3417d9050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:16.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.568+0000 7f812188db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3415a9920 con 0x55f3417d5c40 2023-09-23T09:31:16.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.568+0000 7f812188db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3417d6800 con 0x55f3417db380 2023-09-23T09:31:16.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.568+0000 7f812188db80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3417ccc80 con 0x55f3417dbca0 2023-09-23T09:31:16.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.568+0000 7f8107fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f3417dbca0 0x55f3417d9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:16.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.568+0000 7f8106ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3417db380 0x55f3417e6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:16.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.569+0000 7f8107fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f3417dbca0 0x55f3417d9050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:58630/0 (socket says 172.21.15.82:58630) 2023-09-23T09:31:16.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.569+0000 7f8107fff700 1 -- 172.21.15.82:0/901282159 learned_addr learned my addr 172.21.15.82:0/901282159 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:31:16.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.571+0000 7f8107fff700 1 -- 172.21.15.82:0/901282159 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3417db380 msgr2=0x55f3417e6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:31:16.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.571+0000 7f8107fff700 1 --2- 172.21.15.82:0/901282159 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3417db380 0x55f3417e6770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:16.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.571+0000 7f8107fff700 1 -- 172.21.15.82:0/901282159 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3417d5c40 msgr2=0x55f3417d5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:31:16.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.571+0000 7f8107fff700 1 --2- 172.21.15.82:0/901282159 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3417d5c40 0x55f3417d5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:16.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.571+0000 7f8107fff700 1 -- 172.21.15.82:0/901282159 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f3417f6610 con 0x55f3417dbca0 2023-09-23T09:31:16.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.571+0000 7f8107fff700 1 --2- 172.21.15.82:0/901282159 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f3417dbca0 0x55f3417d9050 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f81000c87a0 tx=0x7f8100083040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=550918d03c553b98 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:31:16.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.571+0000 7f80ee7fc700 1 -- 172.21.15.82:0/901282159 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8100098610 con 0x55f3417dbca0 2023-09-23T09:31:16.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.571+0000 7f80ee7fc700 1 -- 172.21.15.82:0/901282159 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f810009c440 con 0x55f3417dbca0 2023-09-23T09:31:16.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.572+0000 7f80ee7fc700 1 -- 172.21.15.82:0/901282159 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8100004ad0 con 0x55f3417dbca0 2023-09-23T09:31:16.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.572+0000 7f812188db80 1 -- 172.21.15.82:0/901282159 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f3417dbca0 msgr2=0x55f3417d9050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:31:16.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.572+0000 7f812188db80 1 --2- 172.21.15.82:0/901282159 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f3417dbca0 0x55f3417d9050 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f81000c87a0 tx=0x7f8100083040 comp rx=0 tx=0).stop 2023-09-23T09:31:16.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.573+0000 7f812188db80 1 -- 172.21.15.82:0/901282159 shutdown_connections 2023-09-23T09:31:16.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.573+0000 7f812188db80 1 --2- 172.21.15.82:0/901282159 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f3417dbca0 0x55f3417d9050 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:16.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.573+0000 7f812188db80 1 --2- 172.21.15.82:0/901282159 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3417d5c40 0x55f3417d5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:16.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.573+0000 7f812188db80 1 --2- 172.21.15.82:0/901282159 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3417db380 0x55f3417e6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:16.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.573+0000 7f812188db80 1 -- 172.21.15.82:0/901282159 >> 172.21.15.82:0/901282159 conn(0x55f34174a0e0 msgr2=0x55f3417eba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:31:16.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.573+0000 7f812188db80 1 -- 172.21.15.82:0/901282159 shutdown_connections 2023-09-23T09:31:16.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.573+0000 7f812188db80 1 -- 172.21.15.82:0/901282159 wait complete. 2023-09-23T09:31:16.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.574+0000 7f812188db80 1 -- start start 2023-09-23T09:31:16.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.574+0000 7f812188db80 1 Processor -- start 2023-09-23T09:31:16.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.575+0000 7f812188db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3417d5c40 0x55f3417e4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:16.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.575+0000 7f812188db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3417db380 0x55f3417e4c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:16.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.575+0000 7f812188db80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f3417dbca0 0x55f3418423f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:16.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.575+0000 7f812188db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3417e5570 con 0x55f3417db380 2023-09-23T09:31:16.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.575+0000 7f812188db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f341842930 con 0x55f3417d5c40 2023-09-23T09:31:16.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.575+0000 7f812188db80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f341842a70 con 0x55f3417dbca0 2023-09-23T09:31:16.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.575+0000 7f812188db80 10 client.0 _ll_register_callbacks cb 0x7f80f800bd90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:31:16.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.576+0000 7f8106ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3417db380 0x55f3417e4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:16.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.576+0000 7f81077fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3417d5c40 0x55f3417e4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:16.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.576+0000 7f81077fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3417d5c40 0x55f3417e4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:50900/0 (socket says 172.21.15.82:50900) 2023-09-23T09:31:16.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.576+0000 7f8106ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3417db380 0x55f3417e4c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44864/0 (socket says 172.21.15.82:44864) 2023-09-23T09:31:16.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.576+0000 7f81077fe700 1 -- 172.21.15.82:0/1301800795 learned_addr learned my addr 172.21.15.82:0/1301800795 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:31:16.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.576+0000 7f8107fff700 1 --2- 172.21.15.82:0/1301800795 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f3417dbca0 0x55f3418423f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:16.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.577+0000 7f81077fe700 1 -- 172.21.15.82:0/1301800795 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f3417dbca0 msgr2=0x55f3418423f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:31:16.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.577+0000 7f81077fe700 1 --2- 172.21.15.82:0/1301800795 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f3417dbca0 0x55f3418423f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:16.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.577+0000 7f81077fe700 1 -- 172.21.15.82:0/1301800795 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3417db380 msgr2=0x55f3417e4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:31:16.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.577+0000 7f81077fe700 1 --2- 172.21.15.82:0/1301800795 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3417db380 0x55f3417e4c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:16.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.577+0000 7f81077fe700 1 -- 172.21.15.82:0/1301800795 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8108115080 con 0x55f3417d5c40 2023-09-23T09:31:16.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.577+0000 7f8106ffd700 1 --2- 172.21.15.82:0/1301800795 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3417db380 0x55f3417e4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:31:16.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.577+0000 7f81077fe700 1 --2- 172.21.15.82:0/1301800795 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3417d5c40 0x55f3417e4750 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f80fc009990 tx=0x7f80fc005310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ec0ed665d40d6cc server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:31:16.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.577+0000 7f80e6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-09-23T09:31:16.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.578+0000 7f80e6ffd700 1 -- 172.21.15.82:0/1301800795 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80fc02b040 con 0x55f3417d5c40 2023-09-23T09:31:16.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.578+0000 7f80e6ffd700 1 -- 172.21.15.82:0/1301800795 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(145..145 src has 1..145) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f80fc030b00 con 0x55f3417d5c40 2023-09-23T09:31:16.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.578+0000 7f812188db80 1 -- 172.21.15.82:0/1301800795 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f3417c88b0 con 0x55f3417d5c40 2023-09-23T09:31:16.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.578+0000 7f80e6ffd700 1 -- 172.21.15.82:0/1301800795 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7f80fc030cc0 con 0x55f3417d5c40 2023-09-23T09:31:16.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.578+0000 7f812188db80 10 client.27431 fetch_fsmap learned FSMap version 102 2023-09-23T09:31:16.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.578+0000 7f812188db80 1 -- 172.21.15.82:0/1301800795 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=4+}) v3 -- 0x55f34153cc60 con 0x55f3417d5c40 2023-09-23T09:31:16.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.579+0000 7f80e6ffd700 1 -- 172.21.15.82:0/1301800795 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f3417c88b0 con 0x55f3417d5c40 2023-09-23T09:31:16.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.579+0000 7f80e6ffd700 1 -- 172.21.15.82:0/1301800795 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 102) v1 ==== 7954+0+0 (secure 0 0 0) 0x7f80fc038070 con 0x55f3417d5c40 2023-09-23T09:31:16.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.579+0000 7f812188db80 10 client.27431 fetch_fsmap finished waiting for FSMap version 102 2023-09-23T09:31:16.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.579+0000 7f812188db80 10 client.27431 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2023-09-23T09:31:16.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.579+0000 7f812188db80 20 client.27431 populate_metadata read hostname 'smithi082' 2023-09-23T09:31:16.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.579+0000 7f812188db80 1 --2- 172.21.15.82:0/1301800795 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x55f341844220 0x55f341846640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:16.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.579+0000 7f812188db80 4 client.27431 mds_command: new command op to 24515 tid=0[{"prefix": "damage ls"}] 2023-09-23T09:31:16.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.579+0000 7f812188db80 1 -- 172.21.15.82:0/1301800795 --> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55f341720970 con 0x55f341844220 2023-09-23T09:31:16.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.579+0000 7f8106ffd700 1 --2- 172.21.15.82:0/1301800795 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x55f341844220 0x55f341846640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:16.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.580+0000 7f8106ffd700 1 --2- 172.21.15.82:0/1301800795 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x55f341844220 0x55f341846640 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=ae0920ef7a80d370 server_cookie=995b8f202eb769bf in_seq=0 out_seq=0 2023-09-23T09:31:16.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.580+0000 7f80e6ffd700 10 client.27431 ms_handle_connect on v2:172.21.15.135:6836/2655304858 2023-09-23T09:31:16.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.581+0000 7f80e6ffd700 1 -- 172.21.15.82:0/1301800795 <== mds.3 v2:172.21.15.135:6836/2655304858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55f341720970 con 0x55f341844220 2023-09-23T09:31:16.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.581+0000 7f80e6ffd700 10 client.27431 handle_command_reply: tid=0 2023-09-23T09:31:16.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.582+0000 7f812188db80 1 client.27431 shutdown 2023-09-23T09:31:16.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.583+0000 7f812188db80 1 -- 172.21.15.82:0/1301800795 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3417d5c40 msgr2=0x55f3417e4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:31:16.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.583+0000 7f812188db80 1 --2- 172.21.15.82:0/1301800795 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3417d5c40 0x55f3417e4750 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f80fc009990 tx=0x7f80fc005310 comp rx=0 tx=0).stop 2023-09-23T09:31:16.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.583+0000 7f812188db80 1 -- 172.21.15.82:0/1301800795 shutdown_connections 2023-09-23T09:31:16.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.583+0000 7f812188db80 1 --2- 172.21.15.82:0/1301800795 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x55f341844220 0x55f341846640 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:16.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.583+0000 7f812188db80 1 --2- 172.21.15.82:0/1301800795 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f3417dbca0 0x55f3418423f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:16.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.583+0000 7f812188db80 1 --2- 172.21.15.82:0/1301800795 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3417d5c40 0x55f3417e4750 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:16.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.583+0000 7f812188db80 1 --2- 172.21.15.82:0/1301800795 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3417db380 0x55f3417e4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:16.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.583+0000 7f812188db80 1 -- 172.21.15.82:0/1301800795 >> 172.21.15.82:0/1301800795 conn(0x55f34174a0e0 msgr2=0x55f3417d9050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:31:16.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.583+0000 7f80e6ffd700 0 client.27431 ms_handle_reset on v2:172.21.15.135:6836/2655304858 2023-09-23T09:31:16.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.583+0000 7f812188db80 1 -- 172.21.15.82:0/1301800795 shutdown_connections 2023-09-23T09:31:16.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.583+0000 7f812188db80 1 -- 172.21.15.82:0/1301800795 wait complete. 2023-09-23T09:31:16.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.584+0000 7f812188db80 20 client.27431 trim_cache size 0 max 16384 2023-09-23T09:31:16.587 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2023-09-23T09:31:16.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.585+0000 7f810dfff700 1 -- 172.21.15.82:0/3507700152 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f80f00a0180 msgr2=0x7f80f00a2640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:31:16.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.585+0000 7f810dfff700 1 --2- 172.21.15.82:0/3507700152 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f80f00a0180 0x7f80f00a2640 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f80fc005950 tx=0x7f80fc0058e0 comp rx=0 tx=0).stop 2023-09-23T09:31:16.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.585+0000 7f810dfff700 1 -- 172.21.15.82:0/3507700152 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f810811a100 msgr2=0x7f81081112c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:31:16.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.585+0000 7f810dfff700 1 --2- 172.21.15.82:0/3507700152 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f810811a100 0x7f81081112c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f8100007ee0 tx=0x7f810000d3b0 comp rx=0 tx=0).stop 2023-09-23T09:31:16.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.585+0000 7f810dfff700 1 -- 172.21.15.82:0/3507700152 shutdown_connections 2023-09-23T09:31:16.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.585+0000 7f810dfff700 1 --2- 172.21.15.82:0/3507700152 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f80f00a0180 0x7f80f00a2640 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:16.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.585+0000 7f810dfff700 1 --2- 172.21.15.82:0/3507700152 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f810811a100 0x7f81081112c0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:16.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.585+0000 7f810dfff700 1 --2- 172.21.15.82:0/3507700152 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f810810efd0 0x7f8108116120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:16.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.585+0000 7f810dfff700 1 --2- 172.21.15.82:0/3507700152 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f810810f440 0x7f8108116660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:16.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.585+0000 7f810dfff700 1 -- 172.21.15.82:0/3507700152 >> 172.21.15.82:0/3507700152 conn(0x7f810806cbe0 msgr2=0x7f810806f2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:31:16.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.585+0000 7f810dfff700 1 -- 172.21.15.82:0/3507700152 shutdown_connections 2023-09-23T09:31:16.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:16.585+0000 7f810dfff700 1 -- 172.21.15.82:0/3507700152 wait complete. 2023-09-23T09:31:16.618 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-09-23T09:31:16.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:31:16 smithi082 ceph-mon[97694]: pgmap v1090: 97 pgs: 97 active+clean; 16 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 15 MiB/s wr, 1.15k op/s 2023-09-23T09:31:17.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.002+0000 7f98addff700 1 -- 172.21.15.82:0/3968006817 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f98a8111880 msgr2=0x7f98a8113c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:31:17.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.002+0000 7f98addff700 1 --2- 172.21.15.82:0/3968006817 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f98a8111880 0x7f98a8113c70 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f98a00098f0 tx=0x7f98a0009c00 comp rx=0 tx=0).stop 2023-09-23T09:31:17.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.002+0000 7f98addff700 1 -- 172.21.15.82:0/3968006817 shutdown_connections 2023-09-23T09:31:17.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.002+0000 7f98addff700 1 --2- 172.21.15.82:0/3968006817 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f98a8111880 0x7f98a8113c70 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:17.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.002+0000 7f98addff700 1 --2- 172.21.15.82:0/3968006817 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98a8072cc0 0x7f98a80730a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:17.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.002+0000 7f98addff700 1 --2- 172.21.15.82:0/3968006817 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98a80735e0 0x7f98a8111340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:17.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.002+0000 7f98addff700 1 -- 172.21.15.82:0/3968006817 >> 172.21.15.82:0/3968006817 conn(0x7f98a80fc3a0 msgr2=0x7f98a80fe7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:31:17.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.003+0000 7f98addff700 1 -- 172.21.15.82:0/3968006817 shutdown_connections 2023-09-23T09:31:17.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.004+0000 7f98addff700 1 -- 172.21.15.82:0/3968006817 wait complete. 2023-09-23T09:31:17.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.005+0000 7f98addff700 1 Processor -- start 2023-09-23T09:31:17.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.005+0000 7f98addff700 1 -- start start 2023-09-23T09:31:17.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.006+0000 7f98addff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98a8072cc0 0x7f98a819cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:17.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.006+0000 7f98addff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f98a80735e0 0x7f98a819d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:17.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.007+0000 7f98addff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98a8111880 0x7f98a81a1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:17.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.007+0000 7f98addff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98a81a1ed0 con 0x7f98a8111880 2023-09-23T09:31:17.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.007+0000 7f98addff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98a81a2040 con 0x7f98a8072cc0 2023-09-23T09:31:17.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.007+0000 7f98addff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98a81a2200 con 0x7f98a80735e0 2023-09-23T09:31:17.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.007+0000 7f98a77fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98a8072cc0 0x7f98a819cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:17.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.007+0000 7f98a77fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98a8072cc0 0x7f98a819cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:50930/0 (socket says 172.21.15.82:50930) 2023-09-23T09:31:17.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.007+0000 7f98a77fe700 1 -- 172.21.15.82:0/830068302 learned_addr learned my addr 172.21.15.82:0/830068302 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:31:17.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.007+0000 7f989effd700 1 --2- 172.21.15.82:0/830068302 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f98a80735e0 0x7f98a819d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:17.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.007+0000 7f98a7fff700 1 --2- 172.21.15.82:0/830068302 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98a8111880 0x7f98a81a1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:17.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.007+0000 7f98a77fe700 1 -- 172.21.15.82:0/830068302 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f98a80735e0 msgr2=0x7f98a819d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:31:17.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.007+0000 7f98a77fe700 1 --2- 172.21.15.82:0/830068302 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f98a80735e0 0x7f98a819d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:17.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.008+0000 7f98a77fe700 1 -- 172.21.15.82:0/830068302 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98a8111880 msgr2=0x7f98a81a1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:31:17.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.008+0000 7f98a77fe700 1 --2- 172.21.15.82:0/830068302 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98a8111880 0x7f98a81a1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:17.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.008+0000 7f98a77fe700 1 -- 172.21.15.82:0/830068302 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98a0009520 con 0x7f98a8072cc0 2023-09-23T09:31:17.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.008+0000 7f98a77fe700 1 --2- 172.21.15.82:0/830068302 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98a8072cc0 0x7f98a819cef0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f989800d980 tx=0x7f989800dc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:31:17.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.008+0000 7f98a57fa700 1 -- 172.21.15.82:0/830068302 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9898009930 con 0x7f98a8072cc0 2023-09-23T09:31:17.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.009+0000 7f98a57fa700 1 -- 172.21.15.82:0/830068302 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9898010460 con 0x7f98a8072cc0 2023-09-23T09:31:17.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.009+0000 7f98addff700 1 -- 172.21.15.82:0/830068302 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98a81a24e0 con 0x7f98a8072cc0 2023-09-23T09:31:17.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.009+0000 7f98a57fa700 1 -- 172.21.15.82:0/830068302 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f989800f620 con 0x7f98a8072cc0 2023-09-23T09:31:17.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.009+0000 7f98addff700 1 -- 172.21.15.82:0/830068302 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98a81a9d20 con 0x7f98a8072cc0 2023-09-23T09:31:17.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.014+0000 7f98a57fa700 1 -- 172.21.15.82:0/830068302 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f9898009a90 con 0x7f98a8072cc0 2023-09-23T09:31:17.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.015+0000 7f98c1686b80 1 Processor -- start 2023-09-23T09:31:17.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.015+0000 7f98c1686b80 1 -- start start 2023-09-23T09:31:17.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.016+0000 7f98c1686b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558eae0b5380 0x558eae0b5760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:17.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.016+0000 7f98c1686b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558eae0b5ca0 0x558eae0af700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:17.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.016+0000 7f98c1686b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558eae0afc40 0x558eae0b00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:17.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.016+0000 7f98c1686b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x558eae0177b0 con 0x558eae0b5ca0 2023-09-23T09:31:17.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.016+0000 7f98c1686b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x558eae008780 con 0x558eae0afc40 2023-09-23T09:31:17.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.016+0000 7f98c1686b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x558eae0060a0 con 0x558eae0b5380 2023-09-23T09:31:17.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.016+0000 7f98a7fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558eae0b5380 0x558eae0b5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:17.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.016+0000 7f98a77fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558eae0b5ca0 0x558eae0af700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:17.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.016+0000 7f98a7fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558eae0b5380 0x558eae0b5760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:58680/0 (socket says 172.21.15.82:58680) 2023-09-23T09:31:17.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.016+0000 7f98a7fff700 1 -- 172.21.15.82:0/3360288514 learned_addr learned my addr 172.21.15.82:0/3360288514 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:31:17.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.016+0000 7f989effd700 1 --2- 172.21.15.82:0/3360288514 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558eae0afc40 0x558eae0b00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:17.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.017+0000 7f98a77fe700 1 -- 172.21.15.82:0/3360288514 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558eae0b5380 msgr2=0x558eae0b5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:31:17.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.017+0000 7f98a77fe700 1 --2- 172.21.15.82:0/3360288514 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558eae0b5380 0x558eae0b5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:17.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.017+0000 7f98a77fe700 1 -- 172.21.15.82:0/3360288514 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558eae0afc40 msgr2=0x558eae0b00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:31:17.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.017+0000 7f98a77fe700 1 --2- 172.21.15.82:0/3360288514 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558eae0afc40 0x558eae0b00a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:17.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.017+0000 7f98a77fe700 1 -- 172.21.15.82:0/3360288514 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558eade81630 con 0x558eae0b5ca0 2023-09-23T09:31:17.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.017+0000 7f98a7fff700 1 --2- 172.21.15.82:0/3360288514 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558eae0b5380 0x558eae0b5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:31:17.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.017+0000 7f98a57fa700 1 --2- 172.21.15.82:0/830068302 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f98940a0140 0x7f98940a2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:17.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.017+0000 7f98a77fe700 1 --2- 172.21.15.82:0/3360288514 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558eae0b5ca0 0x558eae0af700 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f98980c8ac0 tx=0x7f98980d36b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=539b3d189b27612 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:31:17.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.017+0000 7f98a57fa700 1 -- 172.21.15.82:0/830068302 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f98980cb3d0 con 0x7f98a8072cc0 2023-09-23T09:31:17.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.017+0000 7f98a7fff700 1 --2- 172.21.15.82:0/830068302 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f98940a0140 0x7f98940a2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:17.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.017+0000 7f989dffb700 1 -- 172.21.15.82:0/3360288514 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9898094dc0 con 0x558eae0b5ca0 2023-09-23T09:31:17.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.018+0000 7f989dffb700 1 -- 172.21.15.82:0/3360288514 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9898098850 con 0x558eae0b5ca0 2023-09-23T09:31:17.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.018+0000 7f989dffb700 1 -- 172.21.15.82:0/3360288514 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98980a0890 con 0x558eae0b5ca0 2023-09-23T09:31:17.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.018+0000 7f98a7fff700 1 --2- 172.21.15.82:0/830068302 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f98940a0140 0x7f98940a2600 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f98a8069eb0 tx=0x7f98a0019040 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:31:17.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.018+0000 7f98c1686b80 1 -- 172.21.15.82:0/3360288514 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558eae0b5ca0 msgr2=0x558eae0af700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:31:17.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.018+0000 7f98c1686b80 1 --2- 172.21.15.82:0/3360288514 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558eae0b5ca0 0x558eae0af700 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f98980c8ac0 tx=0x7f98980d36b0 comp rx=0 tx=0).stop 2023-09-23T09:31:17.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.018+0000 7f98c1686b80 1 -- 172.21.15.82:0/3360288514 shutdown_connections 2023-09-23T09:31:17.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.018+0000 7f98c1686b80 1 --2- 172.21.15.82:0/3360288514 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558eae0afc40 0x558eae0b00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:17.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.018+0000 7f98c1686b80 1 --2- 172.21.15.82:0/3360288514 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558eae0b5380 0x558eae0b5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:17.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.018+0000 7f98c1686b80 1 --2- 172.21.15.82:0/3360288514 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558eae0b5ca0 0x558eae0af700 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:17.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.018+0000 7f98c1686b80 1 -- 172.21.15.82:0/3360288514 >> 172.21.15.82:0/3360288514 conn(0x558eae0240e0 msgr2=0x558eae0aa410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:31:17.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.018+0000 7f98c1686b80 1 -- 172.21.15.82:0/3360288514 shutdown_connections 2023-09-23T09:31:17.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.018+0000 7f98c1686b80 1 -- 172.21.15.82:0/3360288514 wait complete. 2023-09-23T09:31:17.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.019+0000 7f98c1686b80 1 -- start start 2023-09-23T09:31:17.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.019+0000 7f98c1686b80 1 Processor -- start 2023-09-23T09:31:17.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.020+0000 7f98c1686b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558eae0afc40 0x558eae0bbc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:17.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.020+0000 7f98c1686b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558eae0b5380 0x558eae0b8e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:17.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.020+0000 7f98c1686b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558eae0b5ca0 0x558eae0b9500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:17.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.020+0000 7f98c1686b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x558eae001990 con 0x558eae0b5380 2023-09-23T09:31:17.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.020+0000 7f98c1686b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x558eadf9fbb0 con 0x558eae0b5ca0 2023-09-23T09:31:17.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.020+0000 7f98c1686b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x558eadf9f8b0 con 0x558eae0afc40 2023-09-23T09:31:17.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.020+0000 7f98c1686b80 10 client.0 _ll_register_callbacks cb 0x558eadee9a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:31:17.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.020+0000 7f989effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558eae0b5380 0x558eae0b8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:17.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.020+0000 7f989effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558eae0b5380 0x558eae0b8e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44894/0 (socket says 172.21.15.82:44894) 2023-09-23T09:31:17.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.020+0000 7f989effd700 1 -- 172.21.15.82:0/2051189602 learned_addr learned my addr 172.21.15.82:0/2051189602 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:31:17.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.020+0000 7f98a77fe700 1 --2- 172.21.15.82:0/2051189602 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558eae0afc40 0x558eae0bbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:17.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.020+0000 7f98a7fff700 1 --2- 172.21.15.82:0/2051189602 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558eae0b5ca0 0x558eae0b9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:17.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.020+0000 7f989effd700 1 -- 172.21.15.82:0/2051189602 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558eae0afc40 msgr2=0x558eae0bbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:31:17.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.020+0000 7f989effd700 1 --2- 172.21.15.82:0/2051189602 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558eae0afc40 0x558eae0bbc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:17.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.020+0000 7f989effd700 1 -- 172.21.15.82:0/2051189602 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558eae0b5ca0 msgr2=0x558eae0b9500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:31:17.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.020+0000 7f989effd700 1 --2- 172.21.15.82:0/2051189602 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558eae0b5ca0 0x558eae0b9500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:17.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.021+0000 7f989effd700 1 -- 172.21.15.82:0/2051189602 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98a8114620 con 0x558eae0b5380 2023-09-23T09:31:17.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.021+0000 7f989effd700 1 --2- 172.21.15.82:0/2051189602 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558eae0b5380 0x558eae0b8e80 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f9890009fd0 tx=0x7f9890007f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af6d3839995a6e41 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:31:17.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.021+0000 7f9886ffd700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:31:17.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.021+0000 7f9886ffd700 1 -- 172.21.15.82:0/2051189602 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f989000e040 con 0x558eae0b5380 2023-09-23T09:31:17.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.021+0000 7f98c1686b80 1 -- 172.21.15.82:0/2051189602 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558eae07f1c0 con 0x558eae0b5380 2023-09-23T09:31:17.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.021+0000 7f9886ffd700 1 -- 172.21.15.82:0/2051189602 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(145..145 src has 1..145) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f9890013ca0 con 0x558eae0b5380 2023-09-23T09:31:17.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.021+0000 7f9886ffd700 1 -- 172.21.15.82:0/2051189602 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9890013e60 con 0x558eae0b5380 2023-09-23T09:31:17.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.021+0000 7f98c1686b80 10 client.17748 fetch_fsmap learned FSMap version 102 2023-09-23T09:31:17.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.021+0000 7f98c1686b80 1 -- 172.21.15.82:0/2051189602 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=4+}) v3 -- 0x7f98a81a9d20 con 0x558eae0b5380 2023-09-23T09:31:17.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.022+0000 7f9886ffd700 1 -- 172.21.15.82:0/2051189602 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x558eae07f1c0 con 0x558eae0b5380 2023-09-23T09:31:17.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.022+0000 7f9886ffd700 1 -- 172.21.15.82:0/2051189602 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 102) v1 ==== 7954+0+0 (secure 0 0 0) 0x7f9890020460 con 0x558eae0b5380 2023-09-23T09:31:17.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.022+0000 7f98c1686b80 10 client.17748 fetch_fsmap finished waiting for FSMap version 102 2023-09-23T09:31:17.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.022+0000 7f98c1686b80 10 client.17748 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-09-23T09:31:17.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.022+0000 7f98c1686b80 20 client.17748 populate_metadata read hostname 'smithi082' 2023-09-23T09:31:17.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.022+0000 7f98c1686b80 1 --2- 172.21.15.82:0/2051189602 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x558eae0c9880 0x558eae0cbca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:17.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.022+0000 7f98c1686b80 4 client.17748 mds_command: new command op to 24526 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:31:17.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.022+0000 7f98c1686b80 1 -- 172.21.15.82:0/2051189602 --> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558eadfa7ba0 con 0x558eae0c9880 2023-09-23T09:31:17.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.022+0000 7f98a77fe700 1 --2- 172.21.15.82:0/2051189602 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x558eae0c9880 0x558eae0cbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:17.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.023+0000 7f98a77fe700 1 --2- 172.21.15.82:0/2051189602 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x558eae0c9880 0x558eae0cbca0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a846370392756b4f server_cookie=36f646e0e9765bb7 in_seq=0 out_seq=0 2023-09-23T09:31:17.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.023+0000 7f9886ffd700 10 client.17748 ms_handle_connect on v2:172.21.15.161:6836/43639843 2023-09-23T09:31:17.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.024+0000 7f9886ffd700 1 -- 172.21.15.82:0/2051189602 <== mds.2 v2:172.21.15.161:6836/43639843 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558eadfa7ba0 con 0x558eae0c9880 2023-09-23T09:31:17.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.024+0000 7f9886ffd700 10 client.17748 handle_command_reply: tid=0 2023-09-23T09:31:17.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.024+0000 7f98c1686b80 1 client.17748 shutdown 2023-09-23T09:31:17.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.024+0000 7f98c1686b80 1 -- 172.21.15.82:0/2051189602 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558eae0b5380 msgr2=0x558eae0b8e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:31:17.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.024+0000 7f98c1686b80 1 --2- 172.21.15.82:0/2051189602 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558eae0b5380 0x558eae0b8e80 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f9890009fd0 tx=0x7f9890007f20 comp rx=0 tx=0).stop 2023-09-23T09:31:17.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.024+0000 7f98c1686b80 1 -- 172.21.15.82:0/2051189602 shutdown_connections 2023-09-23T09:31:17.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.024+0000 7f98c1686b80 1 --2- 172.21.15.82:0/2051189602 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x558eae0c9880 0x558eae0cbca0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:17.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.024+0000 7f98c1686b80 1 --2- 172.21.15.82:0/2051189602 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558eae0b5ca0 0x558eae0b9500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:17.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.024+0000 7f98c1686b80 1 --2- 172.21.15.82:0/2051189602 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558eae0afc40 0x558eae0bbc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:17.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.024+0000 7f98c1686b80 1 --2- 172.21.15.82:0/2051189602 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558eae0b5380 0x558eae0b8e80 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:17.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.024+0000 7f98c1686b80 1 -- 172.21.15.82:0/2051189602 >> 172.21.15.82:0/2051189602 conn(0x558eae0240e0 msgr2=0x558eae0a42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:31:17.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.024+0000 7f9886ffd700 0 client.17748 ms_handle_reset on v2:172.21.15.161:6836/43639843 2023-09-23T09:31:17.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.024+0000 7f98c1686b80 1 -- 172.21.15.82:0/2051189602 shutdown_connections 2023-09-23T09:31:17.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.024+0000 7f98c1686b80 1 -- 172.21.15.82:0/2051189602 wait complete. 2023-09-23T09:31:17.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.024+0000 7f98c1686b80 20 client.17748 trim_cache size 0 max 16384 2023-09-23T09:31:17.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.038+0000 7f98c1686b80 1 Processor -- start 2023-09-23T09:31:17.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.038+0000 7f98c1686b80 1 -- start start 2023-09-23T09:31:17.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.038+0000 7f98c1686b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558eae0afc40 0x558eae0af700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:17.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.038+0000 7f98c1686b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558eae0b5380 0x558eae0aa180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:17.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.038+0000 7f98c1686b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558eae0b5ca0 0x558eae0b2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:17.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.038+0000 7f98c1686b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x558eade83920 con 0x558eae0b5380 2023-09-23T09:31:17.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.038+0000 7f98c1686b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x558eae0a6c80 con 0x558eae0afc40 2023-09-23T09:31:17.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.038+0000 7f98c1686b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x558eae0b9b00 con 0x558eae0b5ca0 2023-09-23T09:31:17.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.039+0000 7f98a7fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558eae0b5ca0 0x558eae0b2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:17.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.039+0000 7f989effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558eae0b5380 0x558eae0aa180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:17.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.039+0000 7f98a7fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558eae0b5ca0 0x558eae0b2fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:58692/0 (socket says 172.21.15.82:58692) 2023-09-23T09:31:17.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.039+0000 7f98a7fff700 1 -- 172.21.15.82:0/1221231098 learned_addr learned my addr 172.21.15.82:0/1221231098 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:31:17.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.039+0000 7f98a77fe700 1 --2- 172.21.15.82:0/1221231098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558eae0afc40 0x558eae0af700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:17.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.039+0000 7f98a7fff700 1 -- 172.21.15.82:0/1221231098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558eae0afc40 msgr2=0x558eae0af700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:31:17.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.039+0000 7f98a7fff700 1 --2- 172.21.15.82:0/1221231098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558eae0afc40 0x558eae0af700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:17.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.039+0000 7f98a7fff700 1 -- 172.21.15.82:0/1221231098 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558eae0b5380 msgr2=0x558eae0aa180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:31:17.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.039+0000 7f98a7fff700 1 --2- 172.21.15.82:0/1221231098 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558eae0b5380 0x558eae0aa180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:17.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.039+0000 7f98a7fff700 1 -- 172.21.15.82:0/1221231098 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558eae0d08d0 con 0x558eae0b5ca0 2023-09-23T09:31:17.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.039+0000 7f989effd700 1 --2- 172.21.15.82:0/1221231098 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558eae0b5380 0x558eae0aa180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:31:17.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.040+0000 7f98a7fff700 1 --2- 172.21.15.82:0/1221231098 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558eae0b5ca0 0x558eae0b2fb0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f98a000f910 tx=0x7f98a001f000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=efb5ddf9db2ce049 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:31:17.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.040+0000 7f989e7fc700 1 -- 172.21.15.82:0/1221231098 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a000bbf0 con 0x558eae0b5ca0 2023-09-23T09:31:17.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.040+0000 7f989e7fc700 1 -- 172.21.15.82:0/1221231098 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f98a001d040 con 0x558eae0b5ca0 2023-09-23T09:31:17.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.040+0000 7f989e7fc700 1 -- 172.21.15.82:0/1221231098 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a0004cd0 con 0x558eae0b5ca0 2023-09-23T09:31:17.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.041+0000 7f98c1686b80 1 -- 172.21.15.82:0/1221231098 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558eae0b5ca0 msgr2=0x558eae0b2fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:31:17.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.041+0000 7f98c1686b80 1 --2- 172.21.15.82:0/1221231098 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558eae0b5ca0 0x558eae0b2fb0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f98a000f910 tx=0x7f98a001f000 comp rx=0 tx=0).stop 2023-09-23T09:31:17.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.041+0000 7f98c1686b80 1 -- 172.21.15.82:0/1221231098 shutdown_connections 2023-09-23T09:31:17.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.041+0000 7f98c1686b80 1 --2- 172.21.15.82:0/1221231098 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558eae0b5ca0 0x558eae0b2fb0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:17.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.041+0000 7f98c1686b80 1 --2- 172.21.15.82:0/1221231098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558eae0afc40 0x558eae0af700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:17.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.041+0000 7f98c1686b80 1 --2- 172.21.15.82:0/1221231098 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558eae0b5380 0x558eae0aa180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:17.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.041+0000 7f98c1686b80 1 -- 172.21.15.82:0/1221231098 >> 172.21.15.82:0/1221231098 conn(0x558eae0240e0 msgr2=0x558eae0c5a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:31:17.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.041+0000 7f98c1686b80 1 -- 172.21.15.82:0/1221231098 shutdown_connections 2023-09-23T09:31:17.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.041+0000 7f98c1686b80 1 -- 172.21.15.82:0/1221231098 wait complete. 2023-09-23T09:31:17.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.041+0000 7f98c1686b80 1 -- start start 2023-09-23T09:31:17.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.041+0000 7f98c1686b80 1 Processor -- start 2023-09-23T09:31:17.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.042+0000 7f98c1686b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558eae0afc40 0x558eae0b1e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:17.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.042+0000 7f98c1686b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558eae0b5380 0x558eae0b23c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:17.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.042+0000 7f98c1686b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558eae0b5ca0 0x558eae0b0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:17.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.042+0000 7f98c1686b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x558eae0b2ac0 con 0x558eae0b5ca0 2023-09-23T09:31:17.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.042+0000 7f98c1686b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x558eae0b1340 con 0x558eae0afc40 2023-09-23T09:31:17.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.042+0000 7f98c1686b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x558eae0b1500 con 0x558eae0b5380 2023-09-23T09:31:17.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.042+0000 7f98c1686b80 10 client.0 _ll_register_callbacks cb 0x7f9890007860 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:31:17.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.042+0000 7f98a7fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558eae0b5ca0 0x558eae0b0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:17.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.042+0000 7f98a7fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558eae0b5ca0 0x558eae0b0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44924/0 (socket says 172.21.15.82:44924) 2023-09-23T09:31:17.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.042+0000 7f98a7fff700 1 -- 172.21.15.82:0/4176435575 learned_addr learned my addr 172.21.15.82:0/4176435575 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:31:17.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.042+0000 7f989effd700 1 --2- 172.21.15.82:0/4176435575 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558eae0b5380 0x558eae0b23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:17.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.043+0000 7f98a77fe700 1 --2- 172.21.15.82:0/4176435575 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558eae0afc40 0x558eae0b1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:17.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.043+0000 7f98a7fff700 1 -- 172.21.15.82:0/4176435575 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558eae0b5380 msgr2=0x558eae0b23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:31:17.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.043+0000 7f98a7fff700 1 --2- 172.21.15.82:0/4176435575 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558eae0b5380 0x558eae0b23c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:17.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.043+0000 7f98a7fff700 1 -- 172.21.15.82:0/4176435575 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558eae0afc40 msgr2=0x558eae0b1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:31:17.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.043+0000 7f98a7fff700 1 --2- 172.21.15.82:0/4176435575 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558eae0afc40 0x558eae0b1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:17.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.043+0000 7f98a7fff700 1 -- 172.21.15.82:0/4176435575 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98a81a9d20 con 0x558eae0b5ca0 2023-09-23T09:31:17.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.043+0000 7f98a7fff700 1 --2- 172.21.15.82:0/4176435575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558eae0b5ca0 0x558eae0b0e00 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f98a000b840 tx=0x7f98a00176e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f9aa167034c698e server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:31:17.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.043+0000 7f9886ffd700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:31:17.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.043+0000 7f9886ffd700 1 -- 172.21.15.82:0/4176435575 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a0017d90 con 0x558eae0b5ca0 2023-09-23T09:31:17.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.043+0000 7f98c1686b80 1 -- 172.21.15.82:0/4176435575 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558eae0a28b0 con 0x558eae0b5ca0 2023-09-23T09:31:17.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.043+0000 7f9886ffd700 1 -- 172.21.15.82:0/4176435575 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(145..145 src has 1..145) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f98a0041470 con 0x558eae0b5ca0 2023-09-23T09:31:17.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.044+0000 7f9886ffd700 1 -- 172.21.15.82:0/4176435575 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7f98a0041630 con 0x558eae0b5ca0 2023-09-23T09:31:17.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.044+0000 7f98c1686b80 10 client.17754 fetch_fsmap learned FSMap version 102 2023-09-23T09:31:17.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.044+0000 7f98c1686b80 1 -- 172.21.15.82:0/4176435575 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=4+}) v3 -- 0x7f98a000f730 con 0x558eae0b5ca0 2023-09-23T09:31:17.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.044+0000 7f9886ffd700 1 -- 172.21.15.82:0/4176435575 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x558eae0a28b0 con 0x558eae0b5ca0 2023-09-23T09:31:17.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.044+0000 7f9886ffd700 1 -- 172.21.15.82:0/4176435575 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 102) v1 ==== 7954+0+0 (secure 0 0 0) 0x7f98a002e6f0 con 0x558eae0b5ca0 2023-09-23T09:31:17.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.044+0000 7f98c1686b80 10 client.17754 fetch_fsmap finished waiting for FSMap version 102 2023-09-23T09:31:17.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.044+0000 7f98c1686b80 10 client.17754 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-09-23T09:31:17.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.044+0000 7f98c1686b80 20 client.17754 populate_metadata read hostname 'smithi082' 2023-09-23T09:31:17.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.044+0000 7f98c1686b80 1 --2- 172.21.15.82:0/4176435575 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x558eae11e0f0 0x558eae120510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:17.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.044+0000 7f98c1686b80 4 client.17754 mds_command: new command op to 24526 tid=0[{"prefix": "damage ls"}] 2023-09-23T09:31:17.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.044+0000 7f98c1686b80 1 -- 172.21.15.82:0/4176435575 --> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x558eadffa970 con 0x558eae11e0f0 2023-09-23T09:31:17.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.044+0000 7f98a77fe700 1 --2- 172.21.15.82:0/4176435575 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x558eae11e0f0 0x558eae120510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:17.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.045+0000 7f9886ffd700 10 client.17754 ms_handle_connect on v2:172.21.15.161:6836/43639843 2023-09-23T09:31:17.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.045+0000 7f98a77fe700 1 --2- 172.21.15.82:0/4176435575 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x558eae11e0f0 0x558eae120510 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2bcbfcee0b661a6 server_cookie=e377810667951931 in_seq=0 out_seq=0 2023-09-23T09:31:17.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.045+0000 7f9886ffd700 1 -- 172.21.15.82:0/4176435575 <== mds.2 v2:172.21.15.161:6836/43639843 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x558eadffa970 con 0x558eae11e0f0 2023-09-23T09:31:17.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.045+0000 7f9886ffd700 10 client.17754 handle_command_reply: tid=0 2023-09-23T09:31:17.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.045+0000 7f98c1686b80 1 client.17754 shutdown 2023-09-23T09:31:17.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.045+0000 7f98c1686b80 1 -- 172.21.15.82:0/4176435575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558eae0b5ca0 msgr2=0x558eae0b0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:31:17.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.045+0000 7f98c1686b80 1 --2- 172.21.15.82:0/4176435575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558eae0b5ca0 0x558eae0b0e00 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f98a000b840 tx=0x7f98a00176e0 comp rx=0 tx=0).stop 2023-09-23T09:31:17.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.045+0000 7f98c1686b80 1 -- 172.21.15.82:0/4176435575 shutdown_connections 2023-09-23T09:31:17.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.045+0000 7f98c1686b80 1 --2- 172.21.15.82:0/4176435575 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x558eae11e0f0 0x558eae120510 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:17.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.045+0000 7f98c1686b80 1 --2- 172.21.15.82:0/4176435575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558eae0b5ca0 0x558eae0b0e00 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:17.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.045+0000 7f98c1686b80 1 --2- 172.21.15.82:0/4176435575 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558eae0afc40 0x558eae0b1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:17.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.045+0000 7f9886ffd700 0 client.17754 ms_handle_reset on v2:172.21.15.161:6836/43639843 2023-09-23T09:31:17.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.045+0000 7f98c1686b80 1 --2- 172.21.15.82:0/4176435575 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558eae0b5380 0x558eae0b23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:17.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.045+0000 7f98c1686b80 1 -- 172.21.15.82:0/4176435575 >> 172.21.15.82:0/4176435575 conn(0x558eae0240e0 msgr2=0x558eae0aa180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:31:17.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.045+0000 7f98c1686b80 1 -- 172.21.15.82:0/4176435575 shutdown_connections 2023-09-23T09:31:17.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.045+0000 7f98c1686b80 1 -- 172.21.15.82:0/4176435575 wait complete. 2023-09-23T09:31:17.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.046+0000 7f98c1686b80 20 client.17754 trim_cache size 0 max 16384 2023-09-23T09:31:17.051 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2023-09-23T09:31:17.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.046+0000 7f98addff700 1 -- 172.21.15.82:0/830068302 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f98940a0140 msgr2=0x7f98940a2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:31:17.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.046+0000 7f98addff700 1 --2- 172.21.15.82:0/830068302 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f98940a0140 0x7f98940a2600 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f98a8069eb0 tx=0x7f98a0019040 comp rx=0 tx=0).stop 2023-09-23T09:31:17.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.046+0000 7f98addff700 1 -- 172.21.15.82:0/830068302 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98a8072cc0 msgr2=0x7f98a819cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:31:17.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.046+0000 7f98addff700 1 --2- 172.21.15.82:0/830068302 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98a8072cc0 0x7f98a819cef0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f989800d980 tx=0x7f989800dc90 comp rx=0 tx=0).stop 2023-09-23T09:31:17.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.046+0000 7f98addff700 1 -- 172.21.15.82:0/830068302 shutdown_connections 2023-09-23T09:31:17.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.046+0000 7f98addff700 1 --2- 172.21.15.82:0/830068302 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f98940a0140 0x7f98940a2600 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:17.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.046+0000 7f98addff700 1 --2- 172.21.15.82:0/830068302 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98a8111880 0x7f98a81a1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:17.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.046+0000 7f98addff700 1 --2- 172.21.15.82:0/830068302 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98a8072cc0 0x7f98a819cef0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:17.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.046+0000 7f98addff700 1 --2- 172.21.15.82:0/830068302 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f98a80735e0 0x7f98a819d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:17.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.046+0000 7f98addff700 1 -- 172.21.15.82:0/830068302 >> 172.21.15.82:0/830068302 conn(0x7f98a80fc3a0 msgr2=0x7f98a80fd010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:31:17.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.046+0000 7f98addff700 1 -- 172.21.15.82:0/830068302 shutdown_connections 2023-09-23T09:31:17.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.046+0000 7f98addff700 1 -- 172.21.15.82:0/830068302 wait complete. 2023-09-23T09:31:17.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:31:16 smithi135 ceph-mon[99205]: pgmap v1090: 97 pgs: 97 active+clean; 16 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 15 MiB/s wr, 1.15k op/s 2023-09-23T09:31:17.065 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-09-23T09:31:17.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:31:16 smithi161 ceph-mon[99580]: pgmap v1090: 97 pgs: 97 active+clean; 16 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 15 MiB/s wr, 1.15k op/s 2023-09-23T09:31:17.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.369+0000 7fef1afff700 1 -- 172.21.15.82:0/634165770 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fef14107040 msgr2=0x7fef141074c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:31:17.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.369+0000 7fef1afff700 1 --2- 172.21.15.82:0/634165770 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fef14107040 0x7fef141074c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fef04009990 tx=0x7fef04009ca0 comp rx=0 tx=0).stop 2023-09-23T09:31:17.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.369+0000 7fef1afff700 1 -- 172.21.15.82:0/634165770 shutdown_connections 2023-09-23T09:31:17.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.369+0000 7fef1afff700 1 --2- 172.21.15.82:0/634165770 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef14107a00 0x7fef14113d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:17.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.369+0000 7fef1afff700 1 --2- 172.21.15.82:0/634165770 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef1410cfc0 0x7fef1410d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:17.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.369+0000 7fef1afff700 1 --2- 172.21.15.82:0/634165770 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fef14107040 0x7fef141074c0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:17.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.369+0000 7fef1afff700 1 -- 172.21.15.82:0/634165770 >> 172.21.15.82:0/634165770 conn(0x7fef140767c0 msgr2=0x7fef14105740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:31:17.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.370+0000 7fef1afff700 1 -- 172.21.15.82:0/634165770 shutdown_connections 2023-09-23T09:31:17.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.370+0000 7fef1afff700 1 -- 172.21.15.82:0/634165770 wait complete. 2023-09-23T09:31:17.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.371+0000 7fef1afff700 1 Processor -- start 2023-09-23T09:31:17.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.372+0000 7fef1afff700 1 -- start start 2023-09-23T09:31:17.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.373+0000 7fef1afff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef14107040 0x7fef1406aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:17.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.373+0000 7fef1afff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fef14107a00 0x7fef1406b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:17.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.373+0000 7fef1afff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef1410cfc0 0x7fef1406e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:17.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.373+0000 7fef1afff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef1406ee40 con 0x7fef1410cfc0 2023-09-23T09:31:17.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.373+0000 7fef1afff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef1406efb0 con 0x7fef14107040 2023-09-23T09:31:17.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.373+0000 7fef1afff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef1406f170 con 0x7fef14107a00 2023-09-23T09:31:17.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.374+0000 7fef1959c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef1410cfc0 0x7fef1406e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:17.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.374+0000 7fef0bfff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fef14107a00 0x7fef1406b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:17.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.374+0000 7fef1959c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef1410cfc0 0x7fef1406e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44932/0 (socket says 172.21.15.82:44932) 2023-09-23T09:31:17.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.374+0000 7fef1959c700 1 -- 172.21.15.82:0/2979497902 learned_addr learned my addr 172.21.15.82:0/2979497902 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:31:17.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.374+0000 7fef18d9b700 1 --2- 172.21.15.82:0/2979497902 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef14107040 0x7fef1406aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:17.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.375+0000 7fef0bfff700 1 -- 172.21.15.82:0/2979497902 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef14107040 msgr2=0x7fef1406aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:31:17.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.375+0000 7fef0bfff700 1 --2- 172.21.15.82:0/2979497902 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef14107040 0x7fef1406aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:17.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.375+0000 7fef0bfff700 1 -- 172.21.15.82:0/2979497902 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef1410cfc0 msgr2=0x7fef1406e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:31:17.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.375+0000 7fef0bfff700 1 --2- 172.21.15.82:0/2979497902 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef1410cfc0 0x7fef1406e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:17.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.375+0000 7fef0bfff700 1 -- 172.21.15.82:0/2979497902 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef040095f0 con 0x7fef14107a00 2023-09-23T09:31:17.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.376+0000 7fef0bfff700 1 --2- 172.21.15.82:0/2979497902 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fef14107a00 0x7fef1406b430 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fef04000c00 tx=0x7fef04005740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:31:17.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.376+0000 7fef1959c700 1 --2- 172.21.15.82:0/2979497902 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef1410cfc0 0x7fef1406e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:31:17.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.378+0000 7fef09ffb700 1 -- 172.21.15.82:0/2979497902 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef0401d070 con 0x7fef14107a00 2023-09-23T09:31:17.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.378+0000 7fef09ffb700 1 -- 172.21.15.82:0/2979497902 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fef04004030 con 0x7fef14107a00 2023-09-23T09:31:17.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.378+0000 7fef09ffb700 1 -- 172.21.15.82:0/2979497902 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef0400fc50 con 0x7fef14107a00 2023-09-23T09:31:17.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.383+0000 7fef1afff700 1 -- 172.21.15.82:0/2979497902 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef1406f3f0 con 0x7fef14107a00 2023-09-23T09:31:17.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.384+0000 7fef1afff700 1 -- 172.21.15.82:0/2979497902 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef1406f860 con 0x7fef14107a00 2023-09-23T09:31:17.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.390+0000 7fef2e8e7b80 1 Processor -- start 2023-09-23T09:31:17.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.391+0000 7fef2e8e7b80 1 -- start start 2023-09-23T09:31:17.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.392+0000 7fef2e8e7b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56289aef1380 0x56289aef1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:17.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.392+0000 7fef2e8e7b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56289aef1ca0 0x56289aeeb700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:17.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.392+0000 7fef2e8e7b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56289aeebc40 0x56289aeec0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:17.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.392+0000 7fef2e8e7b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56289ae537b0 con 0x56289aef1380 2023-09-23T09:31:17.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.392+0000 7fef2e8e7b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56289ae44780 con 0x56289aeebc40 2023-09-23T09:31:17.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.392+0000 7fef2e8e7b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x56289ae420a0 con 0x56289aef1ca0 2023-09-23T09:31:17.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.392+0000 7fef1959c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56289aef1380 0x56289aef1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:17.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.392+0000 7fef1959c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56289aef1380 0x56289aef1760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44940/0 (socket says 172.21.15.82:44940) 2023-09-23T09:31:17.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.392+0000 7fef1959c700 1 -- 172.21.15.82:0/3824816032 learned_addr learned my addr 172.21.15.82:0/3824816032 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:31:17.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.393+0000 7fef18d9b700 1 --2- 172.21.15.82:0/3824816032 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56289aef1ca0 0x56289aeeb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:17.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.393+0000 7fef1959c700 1 -- 172.21.15.82:0/3824816032 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56289aef1ca0 msgr2=0x56289aeeb700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:31:17.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.393+0000 7fef1959c700 1 --2- 172.21.15.82:0/3824816032 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56289aef1ca0 0x56289aeeb700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:17.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.393+0000 7fef1959c700 1 -- 172.21.15.82:0/3824816032 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56289aeebc40 msgr2=0x56289aeec0a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-23T09:31:17.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.393+0000 7fef1959c700 1 --2- 172.21.15.82:0/3824816032 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56289aeebc40 0x56289aeec0a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:17.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.393+0000 7fef1959c700 1 -- 172.21.15.82:0/3824816032 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56289acbd630 con 0x56289aef1380 2023-09-23T09:31:17.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.394+0000 7fef1959c700 1 --2- 172.21.15.82:0/3824816032 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56289aef1380 0x56289aef1760 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fef0c00e5b0 tx=0x7fef0c009660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=957e7e63f14019cb server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:31:17.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.395+0000 7feefaffd700 1 -- 172.21.15.82:0/3824816032 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef0c00e030 con 0x56289aef1380 2023-09-23T09:31:17.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.395+0000 7feefaffd700 1 -- 172.21.15.82:0/3824816032 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fef0c00f040 con 0x56289aef1380 2023-09-23T09:31:17.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.395+0000 7feefaffd700 1 -- 172.21.15.82:0/3824816032 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef0c0139b0 con 0x56289aef1380 2023-09-23T09:31:17.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.396+0000 7fef2e8e7b80 1 -- 172.21.15.82:0/3824816032 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56289aef1380 msgr2=0x56289aef1760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:31:17.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.396+0000 7fef2e8e7b80 1 --2- 172.21.15.82:0/3824816032 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56289aef1380 0x56289aef1760 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fef0c00e5b0 tx=0x7fef0c009660 comp rx=0 tx=0).stop 2023-09-23T09:31:17.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.397+0000 7fef2e8e7b80 1 -- 172.21.15.82:0/3824816032 shutdown_connections 2023-09-23T09:31:17.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.397+0000 7fef2e8e7b80 1 --2- 172.21.15.82:0/3824816032 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56289aeebc40 0x56289aeec0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:17.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.397+0000 7fef2e8e7b80 1 --2- 172.21.15.82:0/3824816032 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56289aef1380 0x56289aef1760 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:17.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.397+0000 7fef2e8e7b80 1 --2- 172.21.15.82:0/3824816032 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56289aef1ca0 0x56289aeeb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:17.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.397+0000 7fef2e8e7b80 1 -- 172.21.15.82:0/3824816032 >> 172.21.15.82:0/3824816032 conn(0x56289ae600e0 msgr2=0x56289aee6410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:31:17.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.400+0000 7fef2e8e7b80 1 -- 172.21.15.82:0/3824816032 shutdown_connections 2023-09-23T09:31:17.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.400+0000 7fef2e8e7b80 1 -- 172.21.15.82:0/3824816032 wait complete. 2023-09-23T09:31:17.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.401+0000 7fef2e8e7b80 1 -- start start 2023-09-23T09:31:17.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.401+0000 7fef2e8e7b80 1 Processor -- start 2023-09-23T09:31:17.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.402+0000 7fef2e8e7b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56289aef1380 0x56289aef5010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:17.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.402+0000 7fef2e8e7b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56289aef1ca0 0x56289aef5550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:17.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.402+0000 7fef2e8e7b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56289aef5a90 0x56289af01880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:17.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.402+0000 7fef2e8e7b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56289ae3d990 con 0x56289aef1ca0 2023-09-23T09:31:17.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.402+0000 7fef2e8e7b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56289addbbb0 con 0x56289aef1380 2023-09-23T09:31:17.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.402+0000 7fef2e8e7b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x56289addb8b0 con 0x56289aef5a90 2023-09-23T09:31:17.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.402+0000 7fef2e8e7b80 10 client.0 _ll_register_callbacks cb 0x56289ad25a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:31:17.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.403+0000 7fef18d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56289aef1ca0 0x56289aef5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:17.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.403+0000 7fef18d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56289aef1ca0 0x56289aef5550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44950/0 (socket says 172.21.15.82:44950) 2023-09-23T09:31:17.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.403+0000 7fef18d9b700 1 -- 172.21.15.82:0/3998633214 learned_addr learned my addr 172.21.15.82:0/3998633214 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:31:17.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.404+0000 7fef1959c700 1 --2- 172.21.15.82:0/3998633214 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56289aef1380 0x56289aef5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:17.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.404+0000 7fef0bfff700 1 --2- 172.21.15.82:0/3998633214 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56289aef5a90 0x56289af01880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:17.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.404+0000 7fef1959c700 1 -- 172.21.15.82:0/3998633214 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56289aef5a90 msgr2=0x56289af01880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:31:17.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.404+0000 7fef1959c700 1 --2- 172.21.15.82:0/3998633214 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56289aef5a90 0x56289af01880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:17.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.404+0000 7fef1959c700 1 -- 172.21.15.82:0/3998633214 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56289aef1ca0 msgr2=0x56289aef5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:31:17.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.404+0000 7fef1959c700 1 --2- 172.21.15.82:0/3998633214 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56289aef1ca0 0x56289aef5550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:17.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.404+0000 7fef1959c700 1 -- 172.21.15.82:0/3998633214 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef0c00e260 con 0x56289aef1380 2023-09-23T09:31:17.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.405+0000 7fef1959c700 1 --2- 172.21.15.82:0/3998633214 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56289aef1380 0x56289aef5010 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fef0c000f80 tx=0x7fef0c013e10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b9f90f2c34db43c server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:31:17.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.405+0000 7feef3fff700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-09-23T09:31:17.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.405+0000 7fef09ffb700 1 -- 172.21.15.82:0/2979497902 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7fef0400f460 con 0x7fef14107a00 2023-09-23T09:31:17.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.405+0000 7feef3fff700 1 -- 172.21.15.82:0/3998633214 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef0c014680 con 0x56289aef1380 2023-09-23T09:31:17.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.405+0000 7fef2e8e7b80 1 -- 172.21.15.82:0/3998633214 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56289aebb1c0 con 0x56289aef1380 2023-09-23T09:31:17.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.405+0000 7feef3fff700 1 -- 172.21.15.82:0/3998633214 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(145..145 src has 1..145) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fef0c0147e0 con 0x56289aef1380 2023-09-23T09:31:17.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.406+0000 7feef3fff700 1 -- 172.21.15.82:0/3998633214 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7fef0c0149a0 con 0x56289aef1380 2023-09-23T09:31:17.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.407+0000 7fef2e8e7b80 10 client.27455 fetch_fsmap learned FSMap version 102 2023-09-23T09:31:17.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.407+0000 7fef2e8e7b80 1 -- 172.21.15.82:0/3998633214 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=4+}) v3 -- 0x56289ac69de0 con 0x56289aef1380 2023-09-23T09:31:17.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.408+0000 7feef3fff700 1 -- 172.21.15.82:0/3998633214 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fef0c033080 con 0x56289aef1380 2023-09-23T09:31:17.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.409+0000 7feef3fff700 1 -- 172.21.15.82:0/3998633214 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 102) v1 ==== 7954+0+0 (secure 0 0 0) 0x7fef0c02d030 con 0x56289aef1380 2023-09-23T09:31:17.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.409+0000 7fef2e8e7b80 10 client.27455 fetch_fsmap finished waiting for FSMap version 102 2023-09-23T09:31:17.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.409+0000 7fef2e8e7b80 10 client.27455 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-23T09:31:17.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.409+0000 7fef2e8e7b80 20 client.27455 populate_metadata read hostname 'smithi082' 2023-09-23T09:31:17.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.409+0000 7fef2e8e7b80 1 --2- 172.21.15.82:0/3998633214 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x56289af16c80 0x56289af190a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:17.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.409+0000 7fef2e8e7b80 4 client.27455 mds_command: new command op to 24550 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:31:17.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.409+0000 7fef2e8e7b80 1 -- 172.21.15.82:0/3998633214 --> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56289ade3ba0 con 0x56289af16c80 2023-09-23T09:31:17.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.409+0000 7fef18d9b700 1 --2- 172.21.15.82:0/3998633214 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x56289af16c80 0x56289af190a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:17.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.410+0000 7fef09ffb700 1 --2- 172.21.15.82:0/2979497902 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7feefc0a01e0 0x7feefc0a26a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:17.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.410+0000 7fef09ffb700 1 -- 172.21.15.82:0/2979497902 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fef040cc9a0 con 0x7fef14107a00 2023-09-23T09:31:17.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.411+0000 7fef18d9b700 1 --2- 172.21.15.82:0/3998633214 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x56289af16c80 0x56289af190a0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f37d40ec7a7195c2 server_cookie=60e43d3b4d508faf in_seq=0 out_seq=0 2023-09-23T09:31:17.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.411+0000 7feef3fff700 10 client.27455 ms_handle_connect on v2:172.21.15.161:6838/758982817 2023-09-23T09:31:17.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.411+0000 7fef0bfff700 1 --2- 172.21.15.82:0/2979497902 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7feefc0a01e0 0x7feefc0a26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:17.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.412+0000 7feef3fff700 1 -- 172.21.15.82:0/3998633214 <== mds.1 v2:172.21.15.161:6838/758982817 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56289ade3ba0 con 0x56289af16c80 2023-09-23T09:31:17.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.412+0000 7feef3fff700 10 client.27455 handle_command_reply: tid=0 2023-09-23T09:31:17.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.412+0000 7fef2e8e7b80 1 client.27455 shutdown 2023-09-23T09:31:17.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.412+0000 7fef0bfff700 1 --2- 172.21.15.82:0/2979497902 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7feefc0a01e0 0x7feefc0a26a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x56289aee7280 tx=0x7fef040b9040 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:31:17.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.412+0000 7fef2e8e7b80 1 -- 172.21.15.82:0/3998633214 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56289aef1380 msgr2=0x56289aef5010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:31:17.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.412+0000 7fef2e8e7b80 1 --2- 172.21.15.82:0/3998633214 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56289aef1380 0x56289aef5010 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fef0c000f80 tx=0x7fef0c013e10 comp rx=0 tx=0).stop 2023-09-23T09:31:17.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.412+0000 7fef2e8e7b80 1 -- 172.21.15.82:0/3998633214 shutdown_connections 2023-09-23T09:31:17.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.412+0000 7fef2e8e7b80 1 --2- 172.21.15.82:0/3998633214 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x56289af16c80 0x56289af190a0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:17.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.413+0000 7fef2e8e7b80 1 --2- 172.21.15.82:0/3998633214 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56289aef5a90 0x56289af01880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:17.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.413+0000 7fef2e8e7b80 1 --2- 172.21.15.82:0/3998633214 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56289aef1380 0x56289aef5010 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:17.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.413+0000 7fef2e8e7b80 1 --2- 172.21.15.82:0/3998633214 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56289aef1ca0 0x56289aef5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:17.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.413+0000 7fef2e8e7b80 1 -- 172.21.15.82:0/3998633214 >> 172.21.15.82:0/3998633214 conn(0x56289ae600e0 msgr2=0x56289aee0b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:31:17.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.413+0000 7feef3fff700 0 client.27455 ms_handle_reset on v2:172.21.15.161:6838/758982817 2023-09-23T09:31:17.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.414+0000 7fef2e8e7b80 1 -- 172.21.15.82:0/3998633214 shutdown_connections 2023-09-23T09:31:17.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.418+0000 7fef2e8e7b80 1 -- 172.21.15.82:0/3998633214 wait complete. 2023-09-23T09:31:17.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.418+0000 7fef2e8e7b80 20 client.27455 trim_cache size 0 max 16384 2023-09-23T09:31:17.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.445+0000 7fef2e8e7b80 1 Processor -- start 2023-09-23T09:31:17.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.445+0000 7fef2e8e7b80 1 -- start start 2023-09-23T09:31:17.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.445+0000 7fef2e8e7b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56289aef1380 0x56289aeeb700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:17.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.445+0000 7fef2e8e7b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56289aef1ca0 0x56289af01630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:17.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.445+0000 7fef2e8e7b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56289aef5a90 0x56289aeede10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:17.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.445+0000 7fef2e8e7b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56289acbf920 con 0x56289aef1380 2023-09-23T09:31:17.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.445+0000 7fef2e8e7b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56289aee70c0 con 0x56289aef5a90 2023-09-23T09:31:17.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.446+0000 7fef2e8e7b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x56289aede6d0 con 0x56289aef1ca0 2023-09-23T09:31:17.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.446+0000 7fef18d9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56289aef1ca0 0x56289af01630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:17.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.446+0000 7fef18d9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56289aef1ca0 0x56289af01630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:58760/0 (socket says 172.21.15.82:58760) 2023-09-23T09:31:17.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.446+0000 7fef18d9b700 1 -- 172.21.15.82:0/2012122140 learned_addr learned my addr 172.21.15.82:0/2012122140 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:31:17.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.446+0000 7fef1959c700 1 --2- 172.21.15.82:0/2012122140 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56289aef1380 0x56289aeeb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:17.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.447+0000 7fef18d9b700 1 -- 172.21.15.82:0/2012122140 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56289aef5a90 msgr2=0x56289aeede10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:31:17.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.447+0000 7fef18d9b700 1 --2- 172.21.15.82:0/2012122140 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56289aef5a90 0x56289aeede10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:17.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.447+0000 7fef18d9b700 1 -- 172.21.15.82:0/2012122140 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56289aef1380 msgr2=0x56289aeeb700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:31:17.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.447+0000 7fef18d9b700 1 --2- 172.21.15.82:0/2012122140 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56289aef1380 0x56289aeeb700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:17.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.447+0000 7fef18d9b700 1 -- 172.21.15.82:0/2012122140 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56289ac52c60 con 0x56289aef1ca0 2023-09-23T09:31:17.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.447+0000 7fef1959c700 1 --2- 172.21.15.82:0/2012122140 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56289aef1380 0x56289aeeb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:31:17.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.447+0000 7fef18d9b700 1 --2- 172.21.15.82:0/2012122140 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56289aef1ca0 0x56289af01630 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x56289af19970 tx=0x7fef10008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d625414b7731ee79 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:31:17.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.448+0000 7feefb7fe700 1 -- 172.21.15.82:0/2012122140 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1001c070 con 0x56289aef1ca0 2023-09-23T09:31:17.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.448+0000 7feefb7fe700 1 -- 172.21.15.82:0/2012122140 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fef10020070 con 0x56289aef1ca0 2023-09-23T09:31:17.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.448+0000 7feefb7fe700 1 -- 172.21.15.82:0/2012122140 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef10016c30 con 0x56289aef1ca0 2023-09-23T09:31:17.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.449+0000 7fef2e8e7b80 1 -- 172.21.15.82:0/2012122140 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56289aef1ca0 msgr2=0x56289af01630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:31:17.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.449+0000 7fef2e8e7b80 1 --2- 172.21.15.82:0/2012122140 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56289aef1ca0 0x56289af01630 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x56289af19970 tx=0x7fef10008040 comp rx=0 tx=0).stop 2023-09-23T09:31:17.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.449+0000 7fef2e8e7b80 1 -- 172.21.15.82:0/2012122140 shutdown_connections 2023-09-23T09:31:17.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.449+0000 7fef2e8e7b80 1 --2- 172.21.15.82:0/2012122140 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56289aef5a90 0x56289aeede10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:17.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.449+0000 7fef2e8e7b80 1 --2- 172.21.15.82:0/2012122140 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56289aef1380 0x56289aeeb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:17.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.449+0000 7fef2e8e7b80 1 --2- 172.21.15.82:0/2012122140 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56289aef1ca0 0x56289af01630 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:17.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.449+0000 7fef2e8e7b80 1 -- 172.21.15.82:0/2012122140 >> 172.21.15.82:0/2012122140 conn(0x56289ae600e0 msgr2=0x56289af00f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:31:17.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.452+0000 7fef2e8e7b80 1 -- 172.21.15.82:0/2012122140 shutdown_connections 2023-09-23T09:31:17.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.452+0000 7fef2e8e7b80 1 -- 172.21.15.82:0/2012122140 wait complete. 2023-09-23T09:31:17.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.453+0000 7fef2e8e7b80 1 -- start start 2023-09-23T09:31:17.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.453+0000 7fef2e8e7b80 1 Processor -- start 2023-09-23T09:31:17.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.454+0000 7fef2e8e7b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56289aef1380 0x56289af63ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:17.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.454+0000 7fef2e8e7b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56289aef1ca0 0x56289af641e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:17.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.454+0000 7fef2e8e7b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56289aef5a90 0x56289aefa7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:17.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.454+0000 7fef2e8e7b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56289aefacf0 con 0x56289aef1380 2023-09-23T09:31:17.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.454+0000 7fef2e8e7b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56289aefae60 con 0x56289aef1ca0 2023-09-23T09:31:17.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.454+0000 7fef2e8e7b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x56289aefb020 con 0x56289aef5a90 2023-09-23T09:31:17.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.454+0000 7fef2e8e7b80 10 client.0 _ll_register_callbacks cb 0x7fef0c00e480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:31:17.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.455+0000 7fef1959c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56289aef5a90 0x56289aefa7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:17.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.455+0000 7fef1959c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56289aef1380 0x56289af63ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:17.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.455+0000 7fef1959c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56289aef1380 0x56289af63ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44972/0 (socket says 172.21.15.82:44972) 2023-09-23T09:31:17.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.455+0000 7fef1959c700 1 -- 172.21.15.82:0/718132562 learned_addr learned my addr 172.21.15.82:0/718132562 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:31:17.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.455+0000 7fef18d9b700 1 --2- 172.21.15.82:0/718132562 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56289aef1ca0 0x56289af641e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:17.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.456+0000 7fef1959c700 1 -- 172.21.15.82:0/718132562 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56289aef1ca0 msgr2=0x56289af641e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:31:17.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.456+0000 7fef1959c700 1 --2- 172.21.15.82:0/718132562 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56289aef1ca0 0x56289af641e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:17.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.456+0000 7fef1959c700 1 -- 172.21.15.82:0/718132562 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56289aef1380 msgr2=0x56289af63ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:31:17.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.456+0000 7fef1959c700 1 --2- 172.21.15.82:0/718132562 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56289aef1380 0x56289af63ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:17.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.456+0000 7fef1959c700 1 -- 172.21.15.82:0/718132562 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef100098c0 con 0x56289aef5a90 2023-09-23T09:31:17.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.457+0000 7fef1959c700 1 --2- 172.21.15.82:0/718132562 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56289aef5a90 0x56289aefa7b0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fef0c004ba0 tx=0x7fef0c007000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e60a9926eb72f860 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:31:17.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.457+0000 7feef3fff700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T09:31:17.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.457+0000 7feef3fff700 1 -- 172.21.15.82:0/718132562 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef0c014b40 con 0x56289aef5a90 2023-09-23T09:31:17.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.457+0000 7feef3fff700 1 -- 172.21.15.82:0/718132562 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(145..145 src has 1..145) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fef0c014ca0 con 0x56289aef5a90 2023-09-23T09:31:17.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.458+0000 7fef2e8e7b80 1 -- 172.21.15.82:0/718132562 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56289aede8b0 con 0x56289aef5a90 2023-09-23T09:31:17.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.458+0000 7feef3fff700 1 -- 172.21.15.82:0/718132562 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7fef0c014e60 con 0x56289aef5a90 2023-09-23T09:31:17.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.458+0000 7fef2e8e7b80 10 client.27502 fetch_fsmap learned FSMap version 102 2023-09-23T09:31:17.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.458+0000 7fef2e8e7b80 1 -- 172.21.15.82:0/718132562 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=4+}) v3 -- 0x56289ac90250 con 0x56289aef5a90 2023-09-23T09:31:17.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.459+0000 7feef3fff700 1 -- 172.21.15.82:0/718132562 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56289aede8b0 con 0x56289aef5a90 2023-09-23T09:31:17.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.459+0000 7feef3fff700 1 -- 172.21.15.82:0/718132562 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 102) v1 ==== 7954+0+0 (secure 0 0 0) 0x7fef0c01dba0 con 0x56289aef5a90 2023-09-23T09:31:17.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.460+0000 7fef2e8e7b80 10 client.27502 fetch_fsmap finished waiting for FSMap version 102 2023-09-23T09:31:17.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.460+0000 7fef2e8e7b80 10 client.27502 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-23T09:31:17.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.460+0000 7fef2e8e7b80 20 client.27502 populate_metadata read hostname 'smithi082' 2023-09-23T09:31:17.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.460+0000 7fef2e8e7b80 1 --2- 172.21.15.82:0/718132562 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x56289af6b880 0x56289af6dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:17.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.460+0000 7fef2e8e7b80 4 client.27502 mds_command: new command op to 24550 tid=0[{"prefix": "damage ls"}] 2023-09-23T09:31:17.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.460+0000 7fef2e8e7b80 1 -- 172.21.15.82:0/718132562 --> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56289ae36970 con 0x56289af6b880 2023-09-23T09:31:17.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.460+0000 7fef18d9b700 1 --2- 172.21.15.82:0/718132562 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x56289af6b880 0x56289af6dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:17.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.461+0000 7feef3fff700 10 client.27502 ms_handle_connect on v2:172.21.15.161:6838/758982817 2023-09-23T09:31:17.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.461+0000 7fef18d9b700 1 --2- 172.21.15.82:0/718132562 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x56289af6b880 0x56289af6dca0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=51a5599e36a91c04 server_cookie=1ac9f235955202be in_seq=0 out_seq=0 2023-09-23T09:31:17.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.462+0000 7feef3fff700 1 -- 172.21.15.82:0/718132562 <== mds.1 v2:172.21.15.161:6838/758982817 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56289ae36970 con 0x56289af6b880 2023-09-23T09:31:17.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.462+0000 7feef3fff700 10 client.27502 handle_command_reply: tid=0 2023-09-23T09:31:17.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.462+0000 7fef2e8e7b80 1 client.27502 shutdown 2023-09-23T09:31:17.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.462+0000 7fef2e8e7b80 1 -- 172.21.15.82:0/718132562 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56289aef5a90 msgr2=0x56289aefa7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:31:17.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.462+0000 7fef2e8e7b80 1 --2- 172.21.15.82:0/718132562 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56289aef5a90 0x56289aefa7b0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fef0c004ba0 tx=0x7fef0c007000 comp rx=0 tx=0).stop 2023-09-23T09:31:17.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.462+0000 7fef2e8e7b80 1 -- 172.21.15.82:0/718132562 shutdown_connections 2023-09-23T09:31:17.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.462+0000 7fef2e8e7b80 1 --2- 172.21.15.82:0/718132562 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x56289af6b880 0x56289af6dca0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:17.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.462+0000 7fef2e8e7b80 1 --2- 172.21.15.82:0/718132562 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56289aef5a90 0x56289aefa7b0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:17.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.462+0000 7fef2e8e7b80 1 --2- 172.21.15.82:0/718132562 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56289aef1380 0x56289af63ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:17.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.462+0000 7fef2e8e7b80 1 --2- 172.21.15.82:0/718132562 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56289aef1ca0 0x56289af641e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:17.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.462+0000 7fef2e8e7b80 1 -- 172.21.15.82:0/718132562 >> 172.21.15.82:0/718132562 conn(0x56289ae600e0 msgr2=0x56289aee02b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:31:17.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.462+0000 7feef3fff700 0 client.27502 ms_handle_reset on v2:172.21.15.161:6838/758982817 2023-09-23T09:31:17.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.462+0000 7fef2e8e7b80 1 -- 172.21.15.82:0/718132562 shutdown_connections 2023-09-23T09:31:17.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.463+0000 7fef2e8e7b80 1 -- 172.21.15.82:0/718132562 wait complete. 2023-09-23T09:31:17.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.463+0000 7fef2e8e7b80 20 client.27502 trim_cache size 0 max 16384 2023-09-23T09:31:17.466 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2023-09-23T09:31:17.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.467+0000 7fef1afff700 1 -- 172.21.15.82:0/2979497902 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7feefc0a01e0 msgr2=0x7feefc0a26a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:31:17.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.467+0000 7fef1afff700 1 --2- 172.21.15.82:0/2979497902 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7feefc0a01e0 0x7feefc0a26a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x56289aee7280 tx=0x7fef040b9040 comp rx=0 tx=0).stop 2023-09-23T09:31:17.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.467+0000 7fef1afff700 1 -- 172.21.15.82:0/2979497902 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fef14107a00 msgr2=0x7fef1406b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:31:17.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.467+0000 7fef1afff700 1 --2- 172.21.15.82:0/2979497902 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fef14107a00 0x7fef1406b430 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fef04000c00 tx=0x7fef04005740 comp rx=0 tx=0).stop 2023-09-23T09:31:17.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.468+0000 7fef1afff700 1 -- 172.21.15.82:0/2979497902 shutdown_connections 2023-09-23T09:31:17.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.468+0000 7fef1afff700 1 --2- 172.21.15.82:0/2979497902 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7feefc0a01e0 0x7feefc0a26a0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:17.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.468+0000 7fef1afff700 1 --2- 172.21.15.82:0/2979497902 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef1410cfc0 0x7fef1406e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:17.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.468+0000 7fef1afff700 1 --2- 172.21.15.82:0/2979497902 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef14107040 0x7fef1406aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:17.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.468+0000 7fef1afff700 1 --2- 172.21.15.82:0/2979497902 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fef14107a00 0x7fef1406b430 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:17.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.468+0000 7fef1afff700 1 -- 172.21.15.82:0/2979497902 >> 172.21.15.82:0/2979497902 conn(0x7fef140767c0 msgr2=0x7fef14077720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:31:17.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.468+0000 7fef1afff700 1 -- 172.21.15.82:0/2979497902 shutdown_connections 2023-09-23T09:31:17.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.468+0000 7fef1afff700 1 -- 172.21.15.82:0/2979497902 wait complete. 2023-09-23T09:31:17.511 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-09-23T09:31:17.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.900+0000 7fbb169ff700 1 -- 172.21.15.82:0/2273712614 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb1010ce30 msgr2=0x7fbb1010d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:31:17.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.900+0000 7fbb169ff700 1 --2- 172.21.15.82:0/2273712614 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb1010ce30 0x7fbb1010d210 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fbb0000b0a0 tx=0x7fbb0000b3b0 comp rx=0 tx=0).stop 2023-09-23T09:31:17.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.900+0000 7fbb169ff700 1 -- 172.21.15.82:0/2273712614 shutdown_connections 2023-09-23T09:31:17.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.900+0000 7fbb169ff700 1 --2- 172.21.15.82:0/2273712614 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbb1010c4a0 0x7fbb10078ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:17.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.900+0000 7fbb169ff700 1 --2- 172.21.15.82:0/2273712614 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb1010ce30 0x7fbb1010d210 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:17.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.900+0000 7fbb169ff700 1 --2- 172.21.15.82:0/2273712614 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb1010bae0 0x7fbb1010bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:17.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.900+0000 7fbb169ff700 1 -- 172.21.15.82:0/2273712614 >> 172.21.15.82:0/2273712614 conn(0x7fbb1006cbe0 msgr2=0x7fbb1006cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:31:17.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.901+0000 7fbb169ff700 1 -- 172.21.15.82:0/2273712614 shutdown_connections 2023-09-23T09:31:17.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.901+0000 7fbb169ff700 1 -- 172.21.15.82:0/2273712614 wait complete. 2023-09-23T09:31:17.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.902+0000 7fbb169ff700 1 Processor -- start 2023-09-23T09:31:17.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.906+0000 7fbb169ff700 1 -- start start 2023-09-23T09:31:17.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.906+0000 7fbb169ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb1010bae0 0x7fbb10082f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:17.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.906+0000 7fbb169ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbb1010c4a0 0x7fbb10083480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:17.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.906+0000 7fbb169ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb1010ce30 0x7fbb1007d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:17.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.906+0000 7fbb169ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb1007d830 con 0x7fbb1010bae0 2023-09-23T09:31:17.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.906+0000 7fbb169ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb1007d9a0 con 0x7fbb1010ce30 2023-09-23T09:31:17.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.906+0000 7fbb169ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb1007db60 con 0x7fbb1010c4a0 2023-09-23T09:31:17.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.907+0000 7fbb14f9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb1010ce30 0x7fbb1007d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:17.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.907+0000 7fbb14f9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb1010ce30 0x7fbb1007d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:51034/0 (socket says 172.21.15.82:51034) 2023-09-23T09:31:17.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.907+0000 7fbb14f9c700 1 -- 172.21.15.82:0/4227799760 learned_addr learned my addr 172.21.15.82:0/4227799760 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:31:17.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.907+0000 7fbb077fe700 1 --2- 172.21.15.82:0/4227799760 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbb1010c4a0 0x7fbb10083480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:17.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.910+0000 7fbb14f9c700 1 -- 172.21.15.82:0/4227799760 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbb1010c4a0 msgr2=0x7fbb10083480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:31:17.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.910+0000 7fbb14f9c700 1 --2- 172.21.15.82:0/4227799760 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbb1010c4a0 0x7fbb10083480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:17.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.910+0000 7fbb14f9c700 1 -- 172.21.15.82:0/4227799760 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb1010bae0 msgr2=0x7fbb10082f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:31:17.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.910+0000 7fbb14f9c700 1 --2- 172.21.15.82:0/4227799760 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb1010bae0 0x7fbb10082f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:17.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.910+0000 7fbb14f9c700 1 -- 172.21.15.82:0/4227799760 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb00009d00 con 0x7fbb1010ce30 2023-09-23T09:31:17.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.910+0000 7fbb14f9c700 1 --2- 172.21.15.82:0/4227799760 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb1010ce30 0x7fbb1007d060 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fbb0800e970 tx=0x7fbb0800ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:31:17.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.911+0000 7fbb0dffb700 1 -- 172.21.15.82:0/4227799760 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb0800cbd0 con 0x7fbb1010ce30 2023-09-23T09:31:17.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.911+0000 7fbb0dffb700 1 -- 172.21.15.82:0/4227799760 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbb0800ee60 con 0x7fbb1010ce30 2023-09-23T09:31:17.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.911+0000 7fbb0dffb700 1 -- 172.21.15.82:0/4227799760 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb080054c0 con 0x7fbb1010ce30 2023-09-23T09:31:17.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.911+0000 7fbb169ff700 1 -- 172.21.15.82:0/4227799760 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb1007de40 con 0x7fbb1010ce30 2023-09-23T09:31:17.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.912+0000 7fbb169ff700 1 -- 172.21.15.82:0/4227799760 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb101bad50 con 0x7fbb1010ce30 2023-09-23T09:31:17.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.920+0000 7fbb2a3a6b80 1 Processor -- start 2023-09-23T09:31:17.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.920+0000 7fbb0dffb700 1 -- 172.21.15.82:0/4227799760 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7fbb08005620 con 0x7fbb1010ce30 2023-09-23T09:31:17.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.922+0000 7fbb0dffb700 1 --2- 172.21.15.82:0/4227799760 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fbafc0a0200 0x7fbafc0a26c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:17.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.922+0000 7fbb0dffb700 1 -- 172.21.15.82:0/4227799760 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fbb08014070 con 0x7fbb1010ce30 2023-09-23T09:31:17.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.923+0000 7fbb077fe700 1 --2- 172.21.15.82:0/4227799760 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fbafc0a0200 0x7fbafc0a26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:17.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.924+0000 7fbb2a3a6b80 1 -- start start 2023-09-23T09:31:17.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.924+0000 7fbb2a3a6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556bcaaa9380 0x556bcaaa9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:17.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.924+0000 7fbb2a3a6b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bcaaa9ca0 0x556bcaaa3700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:17.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.924+0000 7fbb2a3a6b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556bcaaa3c40 0x556bcaaa40a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:17.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.924+0000 7fbb2a3a6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bcaa0b7b0 con 0x556bcaaa9380 2023-09-23T09:31:17.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.924+0000 7fbb2a3a6b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bca9fc780 con 0x556bcaaa9ca0 2023-09-23T09:31:17.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.924+0000 7fbb2a3a6b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bca9fa0a0 con 0x556bcaaa3c40 2023-09-23T09:31:17.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.925+0000 7fbb0ffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556bcaaa9380 0x556bcaaa9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:17.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.925+0000 7fbb077fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bcaaa9ca0 0x556bcaaa3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:17.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.925+0000 7fbb077fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bcaaa9ca0 0x556bcaaa3700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:51036/0 (socket says 172.21.15.82:51036) 2023-09-23T09:31:17.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.925+0000 7fbb0ffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556bcaaa9380 0x556bcaaa9760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45014/0 (socket says 172.21.15.82:45014) 2023-09-23T09:31:17.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.925+0000 7fbb077fe700 1 -- 172.21.15.82:0/2642044924 learned_addr learned my addr 172.21.15.82:0/2642044924 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:31:17.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.925+0000 7fbb14f9c700 1 --2- 172.21.15.82:0/2642044924 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556bcaaa3c40 0x556bcaaa40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:17.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.925+0000 7fbb077fe700 1 -- 172.21.15.82:0/2642044924 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556bcaaa3c40 msgr2=0x556bcaaa40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:31:17.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.925+0000 7fbb077fe700 1 --2- 172.21.15.82:0/2642044924 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556bcaaa3c40 0x556bcaaa40a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:17.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.925+0000 7fbb077fe700 1 -- 172.21.15.82:0/2642044924 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556bcaaa9380 msgr2=0x556bcaaa9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:31:17.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.925+0000 7fbb077fe700 1 --2- 172.21.15.82:0/2642044924 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556bcaaa9380 0x556bcaaa9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:17.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.925+0000 7fbb077fe700 1 -- 172.21.15.82:0/2642044924 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556bca875630 con 0x556bcaaa9ca0 2023-09-23T09:31:17.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.925+0000 7fbb077fe700 1 --2- 172.21.15.82:0/2642044924 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bcaaa9ca0 0x556bcaaa3700 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fbaf800e850 tx=0x7fbaf8011000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4984d1fdb7dabdc9 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:31:17.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.926+0000 7fbb077fe700 1 --2- 172.21.15.82:0/4227799760 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fbafc0a0200 0x7fbafc0a26c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fbb1007e710 tx=0x7fbaf8009190 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:31:17.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.926+0000 7fbb067fc700 1 -- 172.21.15.82:0/2642044924 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf800ed50 con 0x556bcaaa9ca0 2023-09-23T09:31:17.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.926+0000 7fbb067fc700 1 -- 172.21.15.82:0/2642044924 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbaf800eeb0 con 0x556bcaaa9ca0 2023-09-23T09:31:17.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.926+0000 7fbb067fc700 1 -- 172.21.15.82:0/2642044924 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf8013850 con 0x556bcaaa9ca0 2023-09-23T09:31:17.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.927+0000 7fbb2a3a6b80 1 -- 172.21.15.82:0/2642044924 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bcaaa9ca0 msgr2=0x556bcaaa3700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:31:17.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.927+0000 7fbb2a3a6b80 1 --2- 172.21.15.82:0/2642044924 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bcaaa9ca0 0x556bcaaa3700 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fbaf800e850 tx=0x7fbaf8011000 comp rx=0 tx=0).stop 2023-09-23T09:31:17.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.927+0000 7fbb2a3a6b80 1 -- 172.21.15.82:0/2642044924 shutdown_connections 2023-09-23T09:31:17.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.927+0000 7fbb2a3a6b80 1 --2- 172.21.15.82:0/2642044924 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556bcaaa3c40 0x556bcaaa40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:17.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.928+0000 7fbb2a3a6b80 1 --2- 172.21.15.82:0/2642044924 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556bcaaa9380 0x556bcaaa9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:17.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.928+0000 7fbb2a3a6b80 1 --2- 172.21.15.82:0/2642044924 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bcaaa9ca0 0x556bcaaa3700 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:17.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.928+0000 7fbb2a3a6b80 1 -- 172.21.15.82:0/2642044924 >> 172.21.15.82:0/2642044924 conn(0x556bcaa180e0 msgr2=0x556bcaa9e410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:31:17.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.929+0000 7fbb2a3a6b80 1 -- 172.21.15.82:0/2642044924 shutdown_connections 2023-09-23T09:31:17.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.929+0000 7fbb2a3a6b80 1 -- 172.21.15.82:0/2642044924 wait complete. 2023-09-23T09:31:17.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.930+0000 7fbb2a3a6b80 1 -- start start 2023-09-23T09:31:17.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.930+0000 7fbb2a3a6b80 1 Processor -- start 2023-09-23T09:31:17.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.931+0000 7fbb2a3a6b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556bcaaa3c40 0x556bcaaafc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:17.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.931+0000 7fbb2a3a6b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bcaaa9380 0x556bcaaacf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:17.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.933+0000 7fbb0ffff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556bcaaa3c40 0x556bcaaafc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:17.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.933+0000 7fbb0ffff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556bcaaa3c40 0x556bcaaafc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:58806/0 (socket says 172.21.15.82:58806) 2023-09-23T09:31:17.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.934+0000 7fbb2a3a6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556bcaaa9ca0 0x556bcaaad660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:17.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.934+0000 7fbb2a3a6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bca9f5990 con 0x556bcaaa9ca0 2023-09-23T09:31:17.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.934+0000 7fbb2a3a6b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bca993bb0 con 0x556bcaaa9380 2023-09-23T09:31:17.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.934+0000 7fbb2a3a6b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bca9938b0 con 0x556bcaaa3c40 2023-09-23T09:31:17.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.934+0000 7fbb2a3a6b80 10 client.0 _ll_register_callbacks cb 0x556bca8dda80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:31:17.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.934+0000 7fbb0ffff700 1 -- 172.21.15.82:0/3262328618 learned_addr learned my addr 172.21.15.82:0/3262328618 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:31:17.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.934+0000 7fbb077fe700 1 --2- 172.21.15.82:0/3262328618 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bcaaa9380 0x556bcaaacf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:17.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.935+0000 7fbb077fe700 1 -- 172.21.15.82:0/3262328618 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556bcaaa3c40 msgr2=0x556bcaaafc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:31:17.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.935+0000 7fbb077fe700 1 --2- 172.21.15.82:0/3262328618 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556bcaaa3c40 0x556bcaaafc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:17.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.935+0000 7fbb077fe700 1 -- 172.21.15.82:0/3262328618 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556bcaaa9ca0 msgr2=0x556bcaaad660 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-23T09:31:17.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.935+0000 7fbb077fe700 1 --2- 172.21.15.82:0/3262328618 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556bcaaa9ca0 0x556bcaaad660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:17.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.935+0000 7fbb077fe700 1 -- 172.21.15.82:0/3262328618 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556bca821de0 con 0x556bcaaa9380 2023-09-23T09:31:17.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.936+0000 7fbb077fe700 1 --2- 172.21.15.82:0/3262328618 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bcaaa9380 0x556bcaaacf70 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fbaf8017010 tx=0x7fbaf80159e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7da0a172830e0bb4 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:31:17.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.936+0000 7fbaef7fe700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-09-23T09:31:17.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.936+0000 7fbaef7fe700 1 -- 172.21.15.82:0/3262328618 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf8013860 con 0x556bcaaa9380 2023-09-23T09:31:17.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.936+0000 7fbaef7fe700 1 -- 172.21.15.82:0/3262328618 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(145..145 src has 1..145) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fbaf80139c0 con 0x556bcaaa9380 2023-09-23T09:31:17.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.937+0000 7fbb2a3a6b80 1 -- 172.21.15.82:0/3262328618 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556bcaa731c0 con 0x556bcaaa9380 2023-09-23T09:31:17.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.937+0000 7fbaef7fe700 1 -- 172.21.15.82:0/3262328618 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbaf8013ba0 con 0x556bcaaa9380 2023-09-23T09:31:17.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.937+0000 7fbb2a3a6b80 10 client.27470 fetch_fsmap learned FSMap version 102 2023-09-23T09:31:17.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.937+0000 7fbb2a3a6b80 1 -- 172.21.15.82:0/3262328618 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=4+}) v3 -- 0x556bca80ac60 con 0x556bcaaa9380 2023-09-23T09:31:17.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.938+0000 7fbaef7fe700 1 -- 172.21.15.82:0/3262328618 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x556bcaa731c0 con 0x556bcaaa9380 2023-09-23T09:31:17.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.938+0000 7fbaef7fe700 1 -- 172.21.15.82:0/3262328618 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 102) v1 ==== 7954+0+0 (secure 0 0 0) 0x7fbaf803cd20 con 0x556bcaaa9380 2023-09-23T09:31:17.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.938+0000 7fbb2a3a6b80 10 client.27470 fetch_fsmap finished waiting for FSMap version 102 2023-09-23T09:31:17.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.938+0000 7fbb2a3a6b80 10 client.27470 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:31:17.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.938+0000 7fbb2a3a6b80 20 client.27470 populate_metadata read hostname 'smithi082' 2023-09-23T09:31:17.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.938+0000 7fbb2a3a6b80 1 --2- 172.21.15.82:0/3262328618 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x556bcaabd780 0x556bcaabfba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:17.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.939+0000 7fbb2a3a6b80 4 client.27470 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:31:17.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.939+0000 7fbb2a3a6b80 1 -- 172.21.15.82:0/3262328618 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556bca99bba0 con 0x556bcaabd780 2023-09-23T09:31:17.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.939+0000 7fbb0ffff700 1 --2- 172.21.15.82:0/3262328618 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x556bcaabd780 0x556bcaabfba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:17.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.940+0000 7fbb0ffff700 1 --2- 172.21.15.82:0/3262328618 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x556bcaabd780 0x556bcaabfba0 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=848e25db0e791ad server_cookie=63799c767c398c09 in_seq=0 out_seq=0 2023-09-23T09:31:17.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.940+0000 7fbaef7fe700 10 client.27470 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:31:17.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.941+0000 7fbaef7fe700 1 -- 172.21.15.82:0/3262328618 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x556bca99bba0 con 0x556bcaabd780 2023-09-23T09:31:17.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.941+0000 7fbaef7fe700 10 client.27470 handle_command_reply: tid=0 2023-09-23T09:31:17.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.941+0000 7fbb2a3a6b80 1 client.27470 shutdown 2023-09-23T09:31:17.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.946+0000 7fbb2a3a6b80 1 -- 172.21.15.82:0/3262328618 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bcaaa9380 msgr2=0x556bcaaacf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:31:17.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.946+0000 7fbb2a3a6b80 1 --2- 172.21.15.82:0/3262328618 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bcaaa9380 0x556bcaaacf70 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fbaf8017010 tx=0x7fbaf80159e0 comp rx=0 tx=0).stop 2023-09-23T09:31:17.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.946+0000 7fbb2a3a6b80 1 -- 172.21.15.82:0/3262328618 shutdown_connections 2023-09-23T09:31:17.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.946+0000 7fbb2a3a6b80 1 --2- 172.21.15.82:0/3262328618 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x556bcaabd780 0x556bcaabfba0 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:17.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.946+0000 7fbb2a3a6b80 1 --2- 172.21.15.82:0/3262328618 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556bcaaa9ca0 0x556bcaaad660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:17.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.946+0000 7fbb2a3a6b80 1 --2- 172.21.15.82:0/3262328618 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556bcaaa3c40 0x556bcaaafc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:17.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.946+0000 7fbb2a3a6b80 1 --2- 172.21.15.82:0/3262328618 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bcaaa9380 0x556bcaaacf70 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:17.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.946+0000 7fbb2a3a6b80 1 -- 172.21.15.82:0/3262328618 >> 172.21.15.82:0/3262328618 conn(0x556bcaa180e0 msgr2=0x556bcaa98b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:31:17.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.946+0000 7fbaef7fe700 0 client.27470 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:31:17.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.947+0000 7fbb2a3a6b80 1 -- 172.21.15.82:0/3262328618 shutdown_connections 2023-09-23T09:31:17.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.947+0000 7fbb2a3a6b80 1 -- 172.21.15.82:0/3262328618 wait complete. 2023-09-23T09:31:17.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.948+0000 7fbb2a3a6b80 20 client.27470 trim_cache size 0 max 16384 2023-09-23T09:31:17.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.975+0000 7fbb2a3a6b80 1 Processor -- start 2023-09-23T09:31:17.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.982+0000 7fbb2a3a6b80 1 -- start start 2023-09-23T09:31:17.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.982+0000 7fbb2a3a6b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bcaaa3c40 0x556bcaaa3700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:17.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.982+0000 7fbb2a3a6b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556bcaaa9380 0x556bcaa9e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:17.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.982+0000 7fbb2a3a6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556bcaaa9ca0 0x556bcaaa7130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:17.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.982+0000 7fbb2a3a6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bca877920 con 0x556bcaaa9ca0 2023-09-23T09:31:17.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.982+0000 7fbb2a3a6b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bcaaa4600 con 0x556bcaaa3c40 2023-09-23T09:31:17.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.982+0000 7fbb2a3a6b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bcaabadf0 con 0x556bcaaa9380 2023-09-23T09:31:17.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.983+0000 7fbb14f9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556bcaaa9ca0 0x556bcaaa7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:17.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.983+0000 7fbb14f9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556bcaaa9ca0 0x556bcaaa7130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45030/0 (socket says 172.21.15.82:45030) 2023-09-23T09:31:17.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.983+0000 7fbb14f9c700 1 -- 172.21.15.82:0/1046997463 learned_addr learned my addr 172.21.15.82:0/1046997463 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:31:17.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.984+0000 7fbb0ffff700 1 --2- 172.21.15.82:0/1046997463 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bcaaa3c40 0x556bcaaa3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:17.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.985+0000 7fbb0ffff700 1 -- 172.21.15.82:0/1046997463 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556bcaaa9380 msgr2=0x556bcaa9e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:31:17.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.985+0000 7fbb0ffff700 1 --2- 172.21.15.82:0/1046997463 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556bcaaa9380 0x556bcaa9e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:17.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.985+0000 7fbb0ffff700 1 -- 172.21.15.82:0/1046997463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556bcaaa9ca0 msgr2=0x556bcaaa7130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:31:17.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.985+0000 7fbb0ffff700 1 --2- 172.21.15.82:0/1046997463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556bcaaa9ca0 0x556bcaaa7130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:17.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.985+0000 7fbb0ffff700 1 -- 172.21.15.82:0/1046997463 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556bcaac47d0 con 0x556bcaaa3c40 2023-09-23T09:31:17.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.986+0000 7fbb0ffff700 1 --2- 172.21.15.82:0/1046997463 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bcaaa3c40 0x556bcaaa3700 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x556bcaac0480 tx=0x7fbb000096e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1b948830facb1f2 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:31:17.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.987+0000 7fbb06ffd700 1 -- 172.21.15.82:0/1046997463 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb00022070 con 0x556bcaaa3c40 2023-09-23T09:31:17.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.987+0000 7fbb06ffd700 1 -- 172.21.15.82:0/1046997463 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbb00003e90 con 0x556bcaaa3c40 2023-09-23T09:31:17.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.987+0000 7fbb06ffd700 1 -- 172.21.15.82:0/1046997463 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb0000e040 con 0x556bcaaa3c40 2023-09-23T09:31:17.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.989+0000 7fbb2a3a6b80 1 -- 172.21.15.82:0/1046997463 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bcaaa3c40 msgr2=0x556bcaaa3700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:31:17.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.989+0000 7fbb2a3a6b80 1 --2- 172.21.15.82:0/1046997463 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bcaaa3c40 0x556bcaaa3700 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x556bcaac0480 tx=0x7fbb000096e0 comp rx=0 tx=0).stop 2023-09-23T09:31:17.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.989+0000 7fbb2a3a6b80 1 -- 172.21.15.82:0/1046997463 shutdown_connections 2023-09-23T09:31:17.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.989+0000 7fbb2a3a6b80 1 --2- 172.21.15.82:0/1046997463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556bcaaa9ca0 0x556bcaaa7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:17.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.989+0000 7fbb2a3a6b80 1 --2- 172.21.15.82:0/1046997463 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bcaaa3c40 0x556bcaaa3700 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:17.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.989+0000 7fbb2a3a6b80 1 --2- 172.21.15.82:0/1046997463 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556bcaaa9380 0x556bcaa9e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:17.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.989+0000 7fbb2a3a6b80 1 -- 172.21.15.82:0/1046997463 >> 172.21.15.82:0/1046997463 conn(0x556bcaa180e0 msgr2=0x556bcaab8ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:31:17.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.990+0000 7fbb2a3a6b80 1 -- 172.21.15.82:0/1046997463 shutdown_connections 2023-09-23T09:31:17.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.990+0000 7fbb2a3a6b80 1 -- 172.21.15.82:0/1046997463 wait complete. 2023-09-23T09:31:17.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.991+0000 7fbb2a3a6b80 1 -- start start 2023-09-23T09:31:17.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.991+0000 7fbb2a3a6b80 1 Processor -- start 2023-09-23T09:31:17.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.992+0000 7fbb2a3a6b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bcaaa3c40 0x556bcaab3de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:17.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.992+0000 7fbb2a3a6b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556bcaaa9ca0 0x556bcaab4320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:17.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.992+0000 7fbb2a3a6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556bcab0e5a0 0x556bcab10990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:17.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.992+0000 7fbb2a3a6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bcab10ed0 con 0x556bcab0e5a0 2023-09-23T09:31:17.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.992+0000 7fbb2a3a6b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bcab11040 con 0x556bcaaa3c40 2023-09-23T09:31:17.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.992+0000 7fbb2a3a6b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bcab11200 con 0x556bcaaa9ca0 2023-09-23T09:31:17.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.993+0000 7fbb2a3a6b80 10 client.0 _ll_register_callbacks cb 0x7fbaf80157b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:31:17.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.993+0000 7fbb0ffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bcaaa3c40 0x556bcaab3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:17.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.993+0000 7fbb0ffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bcaaa3c40 0x556bcaab3de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:51058/0 (socket says 172.21.15.82:51058) 2023-09-23T09:31:17.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.993+0000 7fbb0ffff700 1 -- 172.21.15.82:0/3986345412 learned_addr learned my addr 172.21.15.82:0/3986345412 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:31:17.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.993+0000 7fbb077fe700 1 --2- 172.21.15.82:0/3986345412 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556bcaaa9ca0 0x556bcaab4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:17.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.994+0000 7fbb14f9c700 1 --2- 172.21.15.82:0/3986345412 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556bcab0e5a0 0x556bcab10990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:17.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.994+0000 7fbb077fe700 1 -- 172.21.15.82:0/3986345412 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bcaaa3c40 msgr2=0x556bcaab3de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:31:17.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.994+0000 7fbb077fe700 1 --2- 172.21.15.82:0/3986345412 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bcaaa3c40 0x556bcaab3de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:17.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.994+0000 7fbb077fe700 1 -- 172.21.15.82:0/3986345412 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556bcab0e5a0 msgr2=0x556bcab10990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:31:17.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.994+0000 7fbb077fe700 1 --2- 172.21.15.82:0/3986345412 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556bcab0e5a0 0x556bcab10990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:17.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.994+0000 7fbb077fe700 1 -- 172.21.15.82:0/3986345412 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb100795d0 con 0x556bcaaa9ca0 2023-09-23T09:31:17.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.995+0000 7fbb077fe700 1 --2- 172.21.15.82:0/3986345412 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556bcaaa9ca0 0x556bcaab4320 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x556bcaaae520 tx=0x7fbaf8015860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f3ba2f60ba3ada2 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:31:17.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.995+0000 7fbaef7fe700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T09:31:17.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.995+0000 7fbaef7fe700 1 -- 172.21.15.82:0/3986345412 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf8042070 con 0x556bcaaa9ca0 2023-09-23T09:31:17.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.995+0000 7fbb2a3a6b80 1 -- 172.21.15.82:0/3986345412 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556bcaa968b0 con 0x556bcaaa9ca0 2023-09-23T09:31:17.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.996+0000 7fbaef7fe700 1 -- 172.21.15.82:0/3986345412 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(145..145 src has 1..145) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fbaf800e4b0 con 0x556bcaaa9ca0 2023-09-23T09:31:17.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.996+0000 7fbaef7fe700 1 -- 172.21.15.82:0/3986345412 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbaf8006e50 con 0x556bcaaa9ca0 2023-09-23T09:31:17.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.996+0000 7fbb2a3a6b80 10 client.27517 fetch_fsmap learned FSMap version 102 2023-09-23T09:31:17.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.996+0000 7fbb2a3a6b80 1 -- 172.21.15.82:0/3986345412 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=4+}) v3 -- 0x556bca848250 con 0x556bcaaa9ca0 2023-09-23T09:31:17.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.997+0000 7fbaef7fe700 1 -- 172.21.15.82:0/3986345412 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x556bcaa968b0 con 0x556bcaaa9ca0 2023-09-23T09:31:17.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.997+0000 7fbaef7fe700 1 -- 172.21.15.82:0/3986345412 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 102) v1 ==== 7954+0+0 (secure 0 0 0) 0x7fbaf803c470 con 0x556bcaaa9ca0 2023-09-23T09:31:18.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.998+0000 7fbb2a3a6b80 10 client.27517 fetch_fsmap finished waiting for FSMap version 102 2023-09-23T09:31:18.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.998+0000 7fbb2a3a6b80 10 client.27517 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:31:18.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.998+0000 7fbb2a3a6b80 20 client.27517 populate_metadata read hostname 'smithi082' 2023-09-23T09:31:18.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.998+0000 7fbb2a3a6b80 1 --2- 172.21.15.82:0/3986345412 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x556bcab125a0 0x556bcab14990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:18.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.998+0000 7fbb2a3a6b80 4 client.27517 mds_command: new command op to 24557 tid=0[{"prefix": "damage ls"}] 2023-09-23T09:31:18.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.998+0000 7fbb2a3a6b80 1 -- 172.21.15.82:0/3986345412 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x556bca9ee970 con 0x556bcab125a0 2023-09-23T09:31:18.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:17.999+0000 7fbb0ffff700 1 --2- 172.21.15.82:0/3986345412 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x556bcab125a0 0x556bcab14990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:18.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:18.000+0000 7fbb0ffff700 1 --2- 172.21.15.82:0/3986345412 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x556bcab125a0 0x556bcab14990 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb16d069c1425055 server_cookie=8cdfe219c96cc3ea in_seq=0 out_seq=0 2023-09-23T09:31:18.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:18.001+0000 7fbaef7fe700 10 client.27517 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:31:18.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:18.001+0000 7fbaef7fe700 1 -- 172.21.15.82:0/3986345412 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x556bca9ee970 con 0x556bcab125a0 2023-09-23T09:31:18.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:18.001+0000 7fbaef7fe700 10 client.27517 handle_command_reply: tid=0 2023-09-23T09:31:18.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:18.001+0000 7fbb2a3a6b80 1 client.27517 shutdown 2023-09-23T09:31:18.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:18.002+0000 7fbb2a3a6b80 1 -- 172.21.15.82:0/3986345412 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556bcaaa9ca0 msgr2=0x556bcaab4320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:31:18.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:18.002+0000 7fbb2a3a6b80 1 --2- 172.21.15.82:0/3986345412 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556bcaaa9ca0 0x556bcaab4320 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x556bcaaae520 tx=0x7fbaf8015860 comp rx=0 tx=0).stop 2023-09-23T09:31:18.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:18.003+0000 7fbb2a3a6b80 1 -- 172.21.15.82:0/3986345412 shutdown_connections 2023-09-23T09:31:18.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:18.003+0000 7fbb2a3a6b80 1 --2- 172.21.15.82:0/3986345412 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x556bcab125a0 0x556bcab14990 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:18.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:18.003+0000 7fbb2a3a6b80 1 --2- 172.21.15.82:0/3986345412 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556bcab0e5a0 0x556bcab10990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:18.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:18.003+0000 7fbb2a3a6b80 1 --2- 172.21.15.82:0/3986345412 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bcaaa3c40 0x556bcaab3de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:18.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:18.003+0000 7fbb2a3a6b80 1 --2- 172.21.15.82:0/3986345412 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556bcaaa9ca0 0x556bcaab4320 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:18.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:18.003+0000 7fbb2a3a6b80 1 -- 172.21.15.82:0/3986345412 >> 172.21.15.82:0/3986345412 conn(0x556bcaa180e0 msgr2=0x556bcaab8ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:31:18.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:18.003+0000 7fbaef7fe700 0 client.27517 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:31:18.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:18.003+0000 7fbb2a3a6b80 1 -- 172.21.15.82:0/3986345412 shutdown_connections 2023-09-23T09:31:18.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:18.003+0000 7fbb2a3a6b80 1 -- 172.21.15.82:0/3986345412 wait complete. 2023-09-23T09:31:18.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:18.003+0000 7fbb2a3a6b80 20 client.27517 trim_cache size 0 max 16384 2023-09-23T09:31:18.006 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2023-09-23T09:31:18.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:18.005+0000 7fbb169ff700 1 -- 172.21.15.82:0/4227799760 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fbafc0a0200 msgr2=0x7fbafc0a26c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:31:18.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:18.005+0000 7fbb169ff700 1 --2- 172.21.15.82:0/4227799760 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fbafc0a0200 0x7fbafc0a26c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fbb1007e710 tx=0x7fbaf8009190 comp rx=0 tx=0).stop 2023-09-23T09:31:18.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:18.005+0000 7fbb169ff700 1 -- 172.21.15.82:0/4227799760 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb1010ce30 msgr2=0x7fbb1007d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:31:18.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:18.005+0000 7fbb169ff700 1 --2- 172.21.15.82:0/4227799760 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb1010ce30 0x7fbb1007d060 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fbb0800e970 tx=0x7fbb0800ec80 comp rx=0 tx=0).stop 2023-09-23T09:31:18.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:18.006+0000 7fbb169ff700 1 -- 172.21.15.82:0/4227799760 shutdown_connections 2023-09-23T09:31:18.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:18.006+0000 7fbb169ff700 1 --2- 172.21.15.82:0/4227799760 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fbafc0a0200 0x7fbafc0a26c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:18.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:18.006+0000 7fbb169ff700 1 --2- 172.21.15.82:0/4227799760 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb1010ce30 0x7fbb1007d060 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:18.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:18.006+0000 7fbb169ff700 1 --2- 172.21.15.82:0/4227799760 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb1010bae0 0x7fbb10082f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:18.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:18.006+0000 7fbb169ff700 1 --2- 172.21.15.82:0/4227799760 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbb1010c4a0 0x7fbb10083480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:18.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:18.006+0000 7fbb169ff700 1 -- 172.21.15.82:0/4227799760 >> 172.21.15.82:0/4227799760 conn(0x7fbb1006cbe0 msgr2=0x7fbb10109470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:31:18.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:18.007+0000 7fbb169ff700 1 -- 172.21.15.82:0/4227799760 shutdown_connections 2023-09-23T09:31:18.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:18.007+0000 7fbb169ff700 1 -- 172.21.15.82:0/4227799760 wait complete. 2023-09-23T09:31:18.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:31:18 smithi082 ceph-mon[97694]: pgmap v1091: 97 pgs: 97 active+clean; 16 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 1.8 MiB/s rd, 14 MiB/s wr, 1.12k op/s 2023-09-23T09:31:18.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:31:18 smithi161 ceph-mon[99580]: pgmap v1091: 97 pgs: 97 active+clean; 16 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 1.8 MiB/s rd, 14 MiB/s wr, 1.12k op/s 2023-09-23T09:31:18.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:31:18 smithi135 ceph-mon[99205]: pgmap v1091: 97 pgs: 97 active+clean; 16 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 1.8 MiB/s rd, 14 MiB/s wr, 1.12k op/s 2023-09-23T09:31:19.042 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-09-23T09:31:19.043 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-09-23T09:31:19.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.419+0000 7f8895dff700 1 -- 172.21.15.82:0/4141296012 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8890072cc0 msgr2=0x7f88900730a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:31:19.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.419+0000 7f8895dff700 1 --2- 172.21.15.82:0/4141296012 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8890072cc0 0x7f88900730a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f88800098f0 tx=0x7f8880009c00 comp rx=0 tx=0).stop 2023-09-23T09:31:19.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.419+0000 7f8895dff700 1 -- 172.21.15.82:0/4141296012 shutdown_connections 2023-09-23T09:31:19.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.419+0000 7f8895dff700 1 --2- 172.21.15.82:0/4141296012 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8890111870 0x7f8890113c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:19.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.419+0000 7f8895dff700 1 --2- 172.21.15.82:0/4141296012 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8890072cc0 0x7f88900730a0 secure :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f88800098f0 tx=0x7f8880009c00 comp rx=0 tx=0).stop 2023-09-23T09:31:19.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.419+0000 7f8895dff700 1 --2- 172.21.15.82:0/4141296012 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88900735e0 0x7f8890111330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:19.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.419+0000 7f8895dff700 1 -- 172.21.15.82:0/4141296012 >> 172.21.15.82:0/4141296012 conn(0x7f88900fc390 msgr2=0x7f88900fe7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:31:19.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.421+0000 7f8895dff700 1 -- 172.21.15.82:0/4141296012 shutdown_connections 2023-09-23T09:31:19.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.421+0000 7f8895dff700 1 -- 172.21.15.82:0/4141296012 wait complete. 2023-09-23T09:31:19.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.423+0000 7f8895dff700 1 Processor -- start 2023-09-23T09:31:19.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.423+0000 7f8895dff700 1 -- start start 2023-09-23T09:31:19.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.423+0000 7f8895dff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88900735e0 0x7f889019d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:19.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.423+0000 7f8895dff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8890111870 0x7f889019d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:19.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.423+0000 7f8895dff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88901a1bb0 0x7f88901a2030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:19.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.423+0000 7f8895dff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88901a2630 con 0x7f88901a1bb0 2023-09-23T09:31:19.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.423+0000 7f8895dff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88901a27a0 con 0x7f8890111870 2023-09-23T09:31:19.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.423+0000 7f8895dff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88901a2960 con 0x7f88900735e0 2023-09-23T09:31:19.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.424+0000 7f888effd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8890111870 0x7f889019d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:19.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.424+0000 7f888effd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8890111870 0x7f889019d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:51084/0 (socket says 172.21.15.82:51084) 2023-09-23T09:31:19.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.424+0000 7f888effd700 1 -- 172.21.15.82:0/2914426721 learned_addr learned my addr 172.21.15.82:0/2914426721 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:31:19.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.424+0000 7f888f7fe700 1 --2- 172.21.15.82:0/2914426721 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88900735e0 0x7f889019d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:19.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.425+0000 7f888effd700 1 -- 172.21.15.82:0/2914426721 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88900735e0 msgr2=0x7f889019d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:31:19.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.425+0000 7f888effd700 1 --2- 172.21.15.82:0/2914426721 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88900735e0 0x7f889019d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:19.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.425+0000 7f888effd700 1 -- 172.21.15.82:0/2914426721 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88901a1bb0 msgr2=0x7f88901a2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:31:19.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.425+0000 7f888effd700 1 --2- 172.21.15.82:0/2914426721 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88901a1bb0 0x7f88901a2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:19.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.425+0000 7f888effd700 1 -- 172.21.15.82:0/2914426721 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8880009520 con 0x7f8890111870 2023-09-23T09:31:19.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.425+0000 7f888effd700 1 --2- 172.21.15.82:0/2914426721 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8890111870 0x7f889019d750 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f888400e9c0 tx=0x7f888400ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:31:19.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.426+0000 7f888cff9700 1 -- 172.21.15.82:0/2914426721 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f888400cbd0 con 0x7f8890111870 2023-09-23T09:31:19.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.426+0000 7f888cff9700 1 -- 172.21.15.82:0/2914426721 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f888400eeb0 con 0x7f8890111870 2023-09-23T09:31:19.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.426+0000 7f888cff9700 1 -- 172.21.15.82:0/2914426721 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8884005440 con 0x7f8890111870 2023-09-23T09:31:19.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.427+0000 7f8895dff700 1 -- 172.21.15.82:0/2914426721 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88901a9ec0 con 0x7f8890111870 2023-09-23T09:31:19.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.427+0000 7f8895dff700 1 -- 172.21.15.82:0/2914426721 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88901aa290 con 0x7f8890111870 2023-09-23T09:31:19.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.433+0000 7f88a9671b80 1 Processor -- start 2023-09-23T09:31:19.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.433+0000 7f88a9671b80 1 -- start start 2023-09-23T09:31:19.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.434+0000 7f88a9671b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562de59d6400 0x562de59d67e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:19.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.434+0000 7f88a9671b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562de59d6d20 0x562de59d0780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:19.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.434+0000 7f88a9671b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562de59d0cc0 0x562de59d1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:19.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.434+0000 7f88a9671b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562de5938830 con 0x562de59d6d20 2023-09-23T09:31:19.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.434+0000 7f88a9671b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562de5929800 con 0x562de59d6400 2023-09-23T09:31:19.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.434+0000 7f88a9671b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x562de5927120 con 0x562de59d0cc0 2023-09-23T09:31:19.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.434+0000 7f888f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562de59d6d20 0x562de59d0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:19.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.434+0000 7f888f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562de59d6d20 0x562de59d0780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45064/0 (socket says 172.21.15.82:45064) 2023-09-23T09:31:19.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.434+0000 7f888f7fe700 1 -- 172.21.15.82:0/1911428574 learned_addr learned my addr 172.21.15.82:0/1911428574 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:31:19.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.435+0000 7f888ffff700 1 --2- 172.21.15.82:0/1911428574 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562de59d6400 0x562de59d67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:19.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.435+0000 7f888f7fe700 1 -- 172.21.15.82:0/1911428574 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562de59d0cc0 msgr2=0x562de59d1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:31:19.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.435+0000 7f888f7fe700 1 --2- 172.21.15.82:0/1911428574 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562de59d0cc0 0x562de59d1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:19.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.435+0000 7f888f7fe700 1 -- 172.21.15.82:0/1911428574 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562de59d6400 msgr2=0x562de59d67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:31:19.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.435+0000 7f888f7fe700 1 --2- 172.21.15.82:0/1911428574 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562de59d6400 0x562de59d67e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:19.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.435+0000 7f888f7fe700 1 -- 172.21.15.82:0/1911428574 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562de57a26b0 con 0x562de59d6d20 2023-09-23T09:31:19.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.435+0000 7f888f7fe700 1 --2- 172.21.15.82:0/1911428574 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562de59d6d20 0x562de59d0780 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f88800098f0 tx=0x7f8880009f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ff31ef86520e23a server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:31:19.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.436+0000 7f8875ffb700 1 -- 172.21.15.82:0/1911428574 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f888000fda0 con 0x562de59d6d20 2023-09-23T09:31:19.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.436+0000 7f8875ffb700 1 -- 172.21.15.82:0/1911428574 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f888001d040 con 0x562de59d6d20 2023-09-23T09:31:19.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.436+0000 7f8875ffb700 1 -- 172.21.15.82:0/1911428574 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8880005040 con 0x562de59d6d20 2023-09-23T09:31:19.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.437+0000 7f88a9671b80 1 -- 172.21.15.82:0/1911428574 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562de59d6d20 msgr2=0x562de59d0780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:31:19.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.437+0000 7f88a9671b80 1 --2- 172.21.15.82:0/1911428574 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562de59d6d20 0x562de59d0780 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f88800098f0 tx=0x7f8880009f50 comp rx=0 tx=0).stop 2023-09-23T09:31:19.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.437+0000 7f88a9671b80 1 -- 172.21.15.82:0/1911428574 shutdown_connections 2023-09-23T09:31:19.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.437+0000 7f88a9671b80 1 --2- 172.21.15.82:0/1911428574 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562de59d0cc0 0x562de59d1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:19.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.437+0000 7f88a9671b80 1 --2- 172.21.15.82:0/1911428574 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562de59d6400 0x562de59d67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:19.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.437+0000 7f88a9671b80 1 --2- 172.21.15.82:0/1911428574 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562de59d6d20 0x562de59d0780 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:19.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.437+0000 7f88a9671b80 1 -- 172.21.15.82:0/1911428574 >> 172.21.15.82:0/1911428574 conn(0x562de5945160 msgr2=0x562de59cb490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:31:19.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.439+0000 7f888cff9700 1 -- 172.21.15.82:0/2914426721 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f88840055a0 con 0x7f8890111870 2023-09-23T09:31:19.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.440+0000 7f88a9671b80 1 -- 172.21.15.82:0/1911428574 shutdown_connections 2023-09-23T09:31:19.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.440+0000 7f88a9671b80 1 -- 172.21.15.82:0/1911428574 wait complete. 2023-09-23T09:31:19.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.441+0000 7f88a9671b80 1 -- start start 2023-09-23T09:31:19.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.441+0000 7f88a9671b80 1 Processor -- start 2023-09-23T09:31:19.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.442+0000 7f888cff9700 1 --2- 172.21.15.82:0/2914426721 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f88780a0090 0x7f88780a2550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:19.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.443+0000 7f888cff9700 1 -- 172.21.15.82:0/2914426721 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f8884014070 con 0x7f8890111870 2023-09-23T09:31:19.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.444+0000 7f888ffff700 1 --2- 172.21.15.82:0/2914426721 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f88780a0090 0x7f88780a2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:19.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.444+0000 7f88a9671b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562de59d6400 0x562de59da010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:19.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.444+0000 7f88a9671b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562de59d6d20 0x562de59da550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:19.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.444+0000 7f88a9671b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562de59daa90 0x562de59e68d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:19.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.444+0000 7f88a9671b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562de5922a10 con 0x562de59d6d20 2023-09-23T09:31:19.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.444+0000 7f88a9671b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562de58c0c30 con 0x562de59daa90 2023-09-23T09:31:19.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.444+0000 7f88a9671b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x562de58c0930 con 0x562de59d6400 2023-09-23T09:31:19.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.444+0000 7f88a9671b80 10 client.0 _ll_register_callbacks cb 0x562de580ab00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:31:19.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.445+0000 7f888f7fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562de59d6400 0x562de59da010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:19.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.445+0000 7f888f7fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562de59d6400 0x562de59da010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:58866/0 (socket says 172.21.15.82:58866) 2023-09-23T09:31:19.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.445+0000 7f888f7fe700 1 -- 172.21.15.82:0/1909442617 learned_addr learned my addr 172.21.15.82:0/1909442617 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:31:19.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.445+0000 7f888ffff700 1 --2- 172.21.15.82:0/1909442617 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562de59daa90 0x562de59e68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:19.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.445+0000 7f888effd700 1 --2- 172.21.15.82:0/1909442617 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562de59d6d20 0x562de59da550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:19.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.446+0000 7f888f7fe700 1 -- 172.21.15.82:0/1909442617 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562de59daa90 msgr2=0x562de59e68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:31:19.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.446+0000 7f888f7fe700 1 --2- 172.21.15.82:0/1909442617 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562de59daa90 0x562de59e68d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:19.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.446+0000 7f888f7fe700 1 -- 172.21.15.82:0/1909442617 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562de59d6d20 msgr2=0x562de59da550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:31:19.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.446+0000 7f888f7fe700 1 --2- 172.21.15.82:0/1909442617 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562de59d6d20 0x562de59da550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:19.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.446+0000 7f888f7fe700 1 -- 172.21.15.82:0/1909442617 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8890114610 con 0x562de59d6400 2023-09-23T09:31:19.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.446+0000 7f888ffff700 1 --2- 172.21.15.82:0/2914426721 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f88780a0090 0x7f88780a2550 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f8890069ff0 tx=0x7f8888007cc0 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:31:19.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.446+0000 7f888f7fe700 1 --2- 172.21.15.82:0/1909442617 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562de59d6400 0x562de59da010 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f8880006010 tx=0x7f888000f700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=902a45614dbb521b server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:31:19.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.446+0000 7f886effd700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T09:31:19.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.447+0000 7f886effd700 1 -- 172.21.15.82:0/1909442617 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f888000fda0 con 0x562de59d6400 2023-09-23T09:31:19.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.447+0000 7f886effd700 1 -- 172.21.15.82:0/1909442617 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(145..145 src has 1..145) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f888000b770 con 0x562de59d6400 2023-09-23T09:31:19.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.448+0000 7f88a9671b80 1 -- 172.21.15.82:0/1909442617 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562de59a0240 con 0x562de59d6400 2023-09-23T09:31:19.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.449+0000 7f886effd700 1 -- 172.21.15.82:0/1909442617 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7f888000b970 con 0x562de59d6400 2023-09-23T09:31:19.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.449+0000 7f88a9671b80 10 client.27526 fetch_fsmap learned FSMap version 102 2023-09-23T09:31:19.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.449+0000 7f88a9671b80 1 -- 172.21.15.82:0/1909442617 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=4+}) v3 -- 0x562de574ee60 con 0x562de59d6400 2023-09-23T09:31:19.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.451+0000 7f886effd700 1 -- 172.21.15.82:0/1909442617 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562de59a0240 con 0x562de59d6400 2023-09-23T09:31:19.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.451+0000 7f886effd700 1 -- 172.21.15.82:0/1909442617 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 102) v1 ==== 7954+0+0 (secure 0 0 0) 0x7f8880015020 con 0x562de59d6400 2023-09-23T09:31:19.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.451+0000 7f88a9671b80 10 client.27526 fetch_fsmap finished waiting for FSMap version 102 2023-09-23T09:31:19.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.451+0000 7f88a9671b80 10 client.27526 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:31:19.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.451+0000 7f88a9671b80 20 client.27526 populate_metadata read hostname 'smithi082' 2023-09-23T09:31:19.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.451+0000 7f88a9671b80 1 --2- 172.21.15.82:0/1909442617 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x562de59ea890 0x562de59eccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:19.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.451+0000 7f88a9671b80 4 client.27526 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:31:19.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.451+0000 7f88a9671b80 1 -- 172.21.15.82:0/1909442617 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562de58c8c20 con 0x562de59ea890 2023-09-23T09:31:19.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.453+0000 7f888effd700 1 --2- 172.21.15.82:0/1909442617 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x562de59ea890 0x562de59eccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:19.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.454+0000 7f888effd700 1 --2- 172.21.15.82:0/1909442617 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x562de59ea890 0x562de59eccb0 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2df76999e48f06f7 server_cookie=1aee3584ae3ee4b9 in_seq=0 out_seq=0 2023-09-23T09:31:19.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.454+0000 7f886effd700 10 client.27526 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:31:19.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.455+0000 7f886effd700 1 -- 172.21.15.82:0/1909442617 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x562de58c8c20 con 0x562de59ea890 2023-09-23T09:31:19.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.455+0000 7f886effd700 10 client.27526 handle_command_reply: tid=0 2023-09-23T09:31:19.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.455+0000 7f88a9671b80 1 client.27526 shutdown 2023-09-23T09:31:19.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.456+0000 7f88a9671b80 1 -- 172.21.15.82:0/1909442617 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562de59d6400 msgr2=0x562de59da010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:31:19.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.456+0000 7f88a9671b80 1 --2- 172.21.15.82:0/1909442617 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562de59d6400 0x562de59da010 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f8880006010 tx=0x7f888000f700 comp rx=0 tx=0).stop 2023-09-23T09:31:19.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.456+0000 7f88a9671b80 1 -- 172.21.15.82:0/1909442617 shutdown_connections 2023-09-23T09:31:19.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.456+0000 7f88a9671b80 1 --2- 172.21.15.82:0/1909442617 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562de59daa90 0x562de59e68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:19.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.456+0000 7f88a9671b80 1 --2- 172.21.15.82:0/1909442617 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562de59d6400 0x562de59da010 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:19.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.456+0000 7f88a9671b80 1 --2- 172.21.15.82:0/1909442617 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x562de59ea890 0x562de59eccb0 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:19.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.456+0000 7f88a9671b80 1 --2- 172.21.15.82:0/1909442617 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562de59d6d20 0x562de59da550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:19.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.456+0000 7f886effd700 0 client.27526 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:31:19.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.456+0000 7f88a9671b80 1 -- 172.21.15.82:0/1909442617 >> 172.21.15.82:0/1909442617 conn(0x562de5945160 msgr2=0x562de59c5bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:31:19.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.456+0000 7f88a9671b80 1 -- 172.21.15.82:0/1909442617 shutdown_connections 2023-09-23T09:31:19.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.457+0000 7f88a9671b80 1 -- 172.21.15.82:0/1909442617 wait complete. 2023-09-23T09:31:19.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.457+0000 7f88a9671b80 20 client.27526 trim_cache size 0 max 16384 2023-09-23T09:31:19.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.489+0000 7f88a9671b80 1 Processor -- start 2023-09-23T09:31:19.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.489+0000 7f88a9671b80 1 -- start start 2023-09-23T09:31:19.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.490+0000 7f88a9671b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562de5945160 0x562de59d0780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:19.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.490+0000 7f88a9671b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562de59d6400 0x562de59e1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:19.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.490+0000 7f88a9671b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562de59d6d20 0x562de59e6680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:19.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.490+0000 7f88a9671b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562de57a49a0 con 0x562de5945160 2023-09-23T09:31:19.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.490+0000 7f88a9671b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562de59cc1d0 con 0x562de59d6400 2023-09-23T09:31:19.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.490+0000 7f88a9671b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x562de59e1d50 con 0x562de59d6d20 2023-09-23T09:31:19.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.490+0000 7f888f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562de5945160 0x562de59d0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:19.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.490+0000 7f888f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562de5945160 0x562de59d0780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45080/0 (socket says 172.21.15.82:45080) 2023-09-23T09:31:19.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.490+0000 7f888f7fe700 1 -- 172.21.15.82:0/420290680 learned_addr learned my addr 172.21.15.82:0/420290680 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:31:19.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.490+0000 7f888effd700 1 --2- 172.21.15.82:0/420290680 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562de59d6400 0x562de59e1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:19.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.491+0000 7f888f7fe700 1 -- 172.21.15.82:0/420290680 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562de59d6d20 msgr2=0x562de59e6680 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-23T09:31:19.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.491+0000 7f888f7fe700 1 --2- 172.21.15.82:0/420290680 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562de59d6d20 0x562de59e6680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:19.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.491+0000 7f888f7fe700 1 -- 172.21.15.82:0/420290680 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562de59d6400 msgr2=0x562de59e1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:31:19.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.491+0000 7f888f7fe700 1 --2- 172.21.15.82:0/420290680 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562de59d6400 0x562de59e1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:19.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.491+0000 7f888f7fe700 1 -- 172.21.15.82:0/420290680 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562de59f18a0 con 0x562de5945160 2023-09-23T09:31:19.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.491+0000 7f888f7fe700 1 --2- 172.21.15.82:0/420290680 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562de5945160 0x562de59d0780 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f8880009810 tx=0x7f8880003680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c0d30777b9ee01f server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:31:19.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.492+0000 7f88767fc700 1 -- 172.21.15.82:0/420290680 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8880003c10 con 0x562de5945160 2023-09-23T09:31:19.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.492+0000 7f88767fc700 1 -- 172.21.15.82:0/420290680 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f888001d040 con 0x562de5945160 2023-09-23T09:31:19.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.492+0000 7f88767fc700 1 -- 172.21.15.82:0/420290680 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f888002a460 con 0x562de5945160 2023-09-23T09:31:19.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.493+0000 7f88a9671b80 1 -- 172.21.15.82:0/420290680 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562de5945160 msgr2=0x562de59d0780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:31:19.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.493+0000 7f88a9671b80 1 --2- 172.21.15.82:0/420290680 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562de5945160 0x562de59d0780 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f8880009810 tx=0x7f8880003680 comp rx=0 tx=0).stop 2023-09-23T09:31:19.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.493+0000 7f88a9671b80 1 -- 172.21.15.82:0/420290680 shutdown_connections 2023-09-23T09:31:19.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.493+0000 7f88a9671b80 1 --2- 172.21.15.82:0/420290680 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562de59d6d20 0x562de59e6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:19.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.493+0000 7f88a9671b80 1 --2- 172.21.15.82:0/420290680 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562de5945160 0x562de59d0780 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:19.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.493+0000 7f88a9671b80 1 --2- 172.21.15.82:0/420290680 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562de59d6400 0x562de59e1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:19.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.493+0000 7f88a9671b80 1 -- 172.21.15.82:0/420290680 >> 172.21.15.82:0/420290680 conn(0x562de59d9bd0 msgr2=0x562de59e5f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:31:19.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.494+0000 7f88a9671b80 1 -- 172.21.15.82:0/420290680 shutdown_connections 2023-09-23T09:31:19.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.494+0000 7f88a9671b80 1 -- 172.21.15.82:0/420290680 wait complete. 2023-09-23T09:31:19.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.495+0000 7f88a9671b80 1 -- start start 2023-09-23T09:31:19.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.495+0000 7f88a9671b80 1 Processor -- start 2023-09-23T09:31:19.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.496+0000 7f88a9671b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562de5945160 0x562de5a39650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:19.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.496+0000 7f88a9671b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562de59d6400 0x562de5a39b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:19.500 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.496+0000 7f88a9671b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562de59d6d20 0x562de5a3a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:19.500 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.496+0000 7f88a9671b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562de59d2530 con 0x562de59d6d20 2023-09-23T09:31:19.500 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.496+0000 7f88a9671b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562de59d26a0 con 0x562de5945160 2023-09-23T09:31:19.500 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.496+0000 7f88a9671b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x562de59d2860 con 0x562de59d6400 2023-09-23T09:31:19.500 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.496+0000 7f88a9671b80 10 client.0 _ll_register_callbacks cb 0x7f8880024070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:31:19.500 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.497+0000 7f888f7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562de5945160 0x562de5a39650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:19.500 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.497+0000 7f888effd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562de59d6400 0x562de5a39b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:19.500 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.497+0000 7f888f7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562de5945160 0x562de5a39650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:51122/0 (socket says 172.21.15.82:51122) 2023-09-23T09:31:19.500 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.497+0000 7f888f7fe700 1 -- 172.21.15.82:0/211516615 learned_addr learned my addr 172.21.15.82:0/211516615 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:31:19.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.497+0000 7f888ffff700 1 --2- 172.21.15.82:0/211516615 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562de59d6d20 0x562de5a3a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:19.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.498+0000 7f888ffff700 1 -- 172.21.15.82:0/211516615 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562de59d6400 msgr2=0x562de5a39b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:31:19.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.498+0000 7f888ffff700 1 --2- 172.21.15.82:0/211516615 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562de59d6400 0x562de5a39b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:19.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.498+0000 7f888ffff700 1 -- 172.21.15.82:0/211516615 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562de5945160 msgr2=0x562de5a39650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:31:19.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.498+0000 7f888ffff700 1 --2- 172.21.15.82:0/211516615 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562de5945160 0x562de5a39650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:19.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.498+0000 7f888ffff700 1 -- 172.21.15.82:0/211516615 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562de574ee60 con 0x562de59d6d20 2023-09-23T09:31:19.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.502+0000 7f888ffff700 1 --2- 172.21.15.82:0/211516615 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562de59d6d20 0x562de5a3a0d0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f8888009f70 tx=0x7f8888004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1d18d0761c10261 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:31:19.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.502+0000 7f886effd700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:31:19.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.503+0000 7f886effd700 1 -- 172.21.15.82:0/211516615 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8888004230 con 0x562de59d6d20 2023-09-23T09:31:19.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.503+0000 7f886effd700 1 -- 172.21.15.82:0/211516615 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(145..145 src has 1..145) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f8888003e20 con 0x562de59d6d20 2023-09-23T09:31:19.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.503+0000 7f88a9671b80 1 -- 172.21.15.82:0/211516615 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562de59c3930 con 0x562de59d6d20 2023-09-23T09:31:19.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.504+0000 7f886effd700 1 -- 172.21.15.82:0/211516615 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8888004390 con 0x562de59d6d20 2023-09-23T09:31:19.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.504+0000 7f88a9671b80 10 client.17793 fetch_fsmap learned FSMap version 102 2023-09-23T09:31:19.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.504+0000 7f88a9671b80 1 -- 172.21.15.82:0/211516615 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=4+}) v3 -- 0x562de5737ce0 con 0x562de59d6d20 2023-09-23T09:31:19.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.505+0000 7f886effd700 1 -- 172.21.15.82:0/211516615 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562de59c3930 con 0x562de59d6d20 2023-09-23T09:31:19.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.505+0000 7f886effd700 1 -- 172.21.15.82:0/211516615 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 102) v1 ==== 7954+0+0 (secure 0 0 0) 0x7f888801ca70 con 0x562de59d6d20 2023-09-23T09:31:19.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.505+0000 7f88a9671b80 10 client.17793 fetch_fsmap finished waiting for FSMap version 102 2023-09-23T09:31:19.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.505+0000 7f88a9671b80 10 client.17793 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:31:19.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.505+0000 7f88a9671b80 20 client.17793 populate_metadata read hostname 'smithi082' 2023-09-23T09:31:19.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.505+0000 7f88a9671b80 1 --2- 172.21.15.82:0/211516615 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x562de59daa90 0x562de5a646b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:19.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.505+0000 7f88a9671b80 4 client.17793 mds_command: new command op to 24557 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-09-23T09:31:19.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.505+0000 7f88a9671b80 1 -- 172.21.15.82:0/211516615 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x562de591b9f0 con 0x562de59daa90 2023-09-23T09:31:19.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.506+0000 7f888f7fe700 1 --2- 172.21.15.82:0/211516615 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x562de59daa90 0x562de5a646b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:19.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.508+0000 7f886effd700 10 client.17793 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:31:19.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.509+0000 7f888f7fe700 1 --2- 172.21.15.82:0/211516615 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x562de59daa90 0x562de5a646b0 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e4697a44002184b server_cookie=c6a8dd35d605ae3a in_seq=0 out_seq=0 2023-09-23T09:31:19.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.511+0000 7f886effd700 1 -- 172.21.15.82:0/211516615 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x562de591b9f0 con 0x562de59daa90 2023-09-23T09:31:19.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.511+0000 7f886effd700 10 client.17793 handle_command_reply: tid=0 2023-09-23T09:31:19.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.511+0000 7f88a9671b80 1 client.17793 shutdown 2023-09-23T09:31:19.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.511+0000 7f88a9671b80 1 -- 172.21.15.82:0/211516615 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562de59d6d20 msgr2=0x562de5a3a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:31:19.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.511+0000 7f88a9671b80 1 --2- 172.21.15.82:0/211516615 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562de59d6d20 0x562de5a3a0d0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f8888009f70 tx=0x7f8888004ad0 comp rx=0 tx=0).stop 2023-09-23T09:31:19.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.512+0000 7f88a9671b80 1 -- 172.21.15.82:0/211516615 shutdown_connections 2023-09-23T09:31:19.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.512+0000 7f88a9671b80 1 --2- 172.21.15.82:0/211516615 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x562de59daa90 0x562de5a646b0 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:19.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.512+0000 7f88a9671b80 1 --2- 172.21.15.82:0/211516615 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562de59d6d20 0x562de5a3a0d0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:19.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.512+0000 7f88a9671b80 1 --2- 172.21.15.82:0/211516615 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562de5945160 0x562de5a39650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:19.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.512+0000 7f88a9671b80 1 --2- 172.21.15.82:0/211516615 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562de59d6400 0x562de5a39b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:19.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.512+0000 7f88a9671b80 1 -- 172.21.15.82:0/211516615 >> 172.21.15.82:0/211516615 conn(0x562de59d9bd0 msgr2=0x562de59e6800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:31:19.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.512+0000 7f886effd700 0 client.17793 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:31:19.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.512+0000 7f88a9671b80 1 -- 172.21.15.82:0/211516615 shutdown_connections 2023-09-23T09:31:19.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.512+0000 7f88a9671b80 1 -- 172.21.15.82:0/211516615 wait complete. 2023-09-23T09:31:19.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.513+0000 7f88a9671b80 20 client.17793 trim_cache size 0 max 16384 2023-09-23T09:31:19.516 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:31:19.516 INFO:teuthology.orchestra.run.smithi082.stdout: "return_code": 0, 2023-09-23T09:31:19.516 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_tag": "2aec802a-e2df-49b3-a22a-82c491ba0c59", 2023-09-23T09:31:19.516 INFO:teuthology.orchestra.run.smithi082.stdout: "mode": "asynchronous" 2023-09-23T09:31:19.516 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:31:19.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.514+0000 7f8895dff700 1 -- 172.21.15.82:0/2914426721 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f88780a0090 msgr2=0x7f88780a2550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:31:19.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.514+0000 7f8895dff700 1 --2- 172.21.15.82:0/2914426721 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f88780a0090 0x7f88780a2550 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f8890069ff0 tx=0x7f8888007cc0 comp rx=0 tx=0).stop 2023-09-23T09:31:19.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.514+0000 7f8895dff700 1 -- 172.21.15.82:0/2914426721 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8890111870 msgr2=0x7f889019d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:31:19.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.514+0000 7f8895dff700 1 --2- 172.21.15.82:0/2914426721 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8890111870 0x7f889019d750 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f888400e9c0 tx=0x7f888400ecd0 comp rx=0 tx=0).stop 2023-09-23T09:31:19.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.514+0000 7f8895dff700 1 -- 172.21.15.82:0/2914426721 shutdown_connections 2023-09-23T09:31:19.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.514+0000 7f8895dff700 1 --2- 172.21.15.82:0/2914426721 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f88780a0090 0x7f88780a2550 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:19.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.514+0000 7f8895dff700 1 --2- 172.21.15.82:0/2914426721 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88901a1bb0 0x7f88901a2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:19.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.514+0000 7f8895dff700 1 --2- 172.21.15.82:0/2914426721 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88900735e0 0x7f889019d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:19.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.514+0000 7f8895dff700 1 --2- 172.21.15.82:0/2914426721 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8890111870 0x7f889019d750 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:19.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.514+0000 7f8895dff700 1 -- 172.21.15.82:0/2914426721 >> 172.21.15.82:0/2914426721 conn(0x7f88900fc390 msgr2=0x7f88900fd060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:31:19.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.515+0000 7f8895dff700 1 -- 172.21.15.82:0/2914426721 shutdown_connections 2023-09-23T09:31:19.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.515+0000 7f8895dff700 1 -- 172.21.15.82:0/2914426721 wait complete. 2023-09-23T09:31:19.566 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:31:19.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.942+0000 7f70e35ff700 1 -- 172.21.15.82:0/4237161290 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f70dc11a100 msgr2=0x7f70dc11c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:31:19.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.942+0000 7f70e35ff700 1 --2- 172.21.15.82:0/4237161290 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f70dc11a100 0x7f70dc11c4f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f70d4009990 tx=0x7f70d4009ca0 comp rx=0 tx=0).stop 2023-09-23T09:31:19.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.943+0000 7f70e35ff700 1 -- 172.21.15.82:0/4237161290 shutdown_connections 2023-09-23T09:31:19.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.943+0000 7f70e35ff700 1 --2- 172.21.15.82:0/4237161290 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f70dc11a100 0x7f70dc11c4f0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:19.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.943+0000 7f70e35ff700 1 --2- 172.21.15.82:0/4237161290 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70dc10efd0 0x7f70dc10cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:19.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.943+0000 7f70e35ff700 1 --2- 172.21.15.82:0/4237161290 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70dc10f440 0x7f70dc10d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:19.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.943+0000 7f70e35ff700 1 -- 172.21.15.82:0/4237161290 >> 172.21.15.82:0/4237161290 conn(0x7f70dc06cbe0 msgr2=0x7f70dc06cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:31:19.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.943+0000 7f70e35ff700 1 -- 172.21.15.82:0/4237161290 shutdown_connections 2023-09-23T09:31:19.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.943+0000 7f70e35ff700 1 -- 172.21.15.82:0/4237161290 wait complete. 2023-09-23T09:31:19.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.944+0000 7f70e35ff700 1 Processor -- start 2023-09-23T09:31:19.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.945+0000 7f70e35ff700 1 -- start start 2023-09-23T09:31:19.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.945+0000 7f70e35ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70dc10efd0 0x7f70dc117360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:19.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.945+0000 7f70e35ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70dc10f440 0x7f70dc1178a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:19.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.945+0000 7f70e35ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f70dc11a100 0x7f70dc110300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:19.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.945+0000 7f70e35ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70dc1109e0 con 0x7f70dc10efd0 2023-09-23T09:31:19.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.945+0000 7f70e35ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70dc110b50 con 0x7f70dc10f440 2023-09-23T09:31:19.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.945+0000 7f70e35ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70dc110d10 con 0x7f70dc11a100 2023-09-23T09:31:19.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.946+0000 7f70e1b9c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f70dc11a100 0x7f70dc110300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:19.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.946+0000 7f70e1b9c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f70dc11a100 0x7f70dc110300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:58890/0 (socket says 172.21.15.82:58890) 2023-09-23T09:31:19.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.946+0000 7f70e1b9c700 1 -- 172.21.15.82:0/1743787327 learned_addr learned my addr 172.21.15.82:0/1743787327 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:31:19.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.946+0000 7f70e0b9a700 1 --2- 172.21.15.82:0/1743787327 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70dc10f440 0x7f70dc1178a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:19.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.946+0000 7f70e139b700 1 --2- 172.21.15.82:0/1743787327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70dc10efd0 0x7f70dc117360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:19.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.947+0000 7f70e1b9c700 1 -- 172.21.15.82:0/1743787327 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70dc10f440 msgr2=0x7f70dc1178a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:31:19.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.947+0000 7f70e1b9c700 1 --2- 172.21.15.82:0/1743787327 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70dc10f440 0x7f70dc1178a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:19.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.947+0000 7f70e1b9c700 1 -- 172.21.15.82:0/1743787327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70dc10efd0 msgr2=0x7f70dc117360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:31:19.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.947+0000 7f70e1b9c700 1 --2- 172.21.15.82:0/1743787327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70dc10efd0 0x7f70dc117360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:19.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.947+0000 7f70e1b9c700 1 -- 172.21.15.82:0/1743787327 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70d40095f0 con 0x7f70dc11a100 2023-09-23T09:31:19.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.947+0000 7f70e1b9c700 1 --2- 172.21.15.82:0/1743787327 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f70dc11a100 0x7f70dc110300 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f70d4005f50 tx=0x7f70d4005740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:31:19.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.948+0000 7f70da7fc700 1 -- 172.21.15.82:0/1743787327 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d401d070 con 0x7f70dc11a100 2023-09-23T09:31:19.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.948+0000 7f70e35ff700 1 -- 172.21.15.82:0/1743787327 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70dc110f90 con 0x7f70dc11a100 2023-09-23T09:31:19.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.948+0000 7f70e35ff700 1 -- 172.21.15.82:0/1743787327 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70dc115060 con 0x7f70dc11a100 2023-09-23T09:31:19.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.948+0000 7f70da7fc700 1 -- 172.21.15.82:0/1743787327 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f70d400fb00 con 0x7f70dc11a100 2023-09-23T09:31:19.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.948+0000 7f70da7fc700 1 -- 172.21.15.82:0/1743787327 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d4003cc0 con 0x7f70dc11a100 2023-09-23T09:31:19.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.954+0000 7f70da7fc700 1 -- 172.21.15.82:0/1743787327 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f70d400fc70 con 0x7f70dc11a100 2023-09-23T09:31:19.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.955+0000 7f70f6e31b80 1 Processor -- start 2023-09-23T09:31:19.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.955+0000 7f70f6e31b80 1 -- start start 2023-09-23T09:31:19.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.956+0000 7f70f6e31b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55de581dd380 0x55de581dd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:19.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.956+0000 7f70f6e31b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55de581ddca0 0x55de581d7700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:19.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.956+0000 7f70f6e31b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de581d7c40 0x55de581d80a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:19.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.956+0000 7f70f6e31b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de5813f7b0 con 0x55de581d7c40 2023-09-23T09:31:19.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.956+0000 7f70f6e31b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de58130780 con 0x55de581dd380 2023-09-23T09:31:19.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.956+0000 7f70f6e31b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de5812e0a0 con 0x55de581ddca0 2023-09-23T09:31:19.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.957+0000 7f70e0b9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55de581dd380 0x55de581dd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:19.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.957+0000 7f70e0b9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55de581dd380 0x55de581dd760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:51150/0 (socket says 172.21.15.82:51150) 2023-09-23T09:31:19.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.957+0000 7f70e0b9a700 1 -- 172.21.15.82:0/4268163734 learned_addr learned my addr 172.21.15.82:0/4268163734 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:31:19.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.957+0000 7f70e0b9a700 1 --2- 172.21.15.82:0/4268163734 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de581d7c40 0x55de581d80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:19.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.957+0000 7f70da7fc700 1 --2- 172.21.15.82:0/1743787327 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f70cc0a0200 0x7f70cc0a26c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:19.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.957+0000 7f70da7fc700 1 -- 172.21.15.82:0/1743787327 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f70d40cc420 con 0x7f70dc11a100 2023-09-23T09:31:19.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.958+0000 7f70e0b9a700 1 -- 172.21.15.82:0/4268163734 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55de581ddca0 msgr2=0x55de581d7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:31:19.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.958+0000 7f70e0b9a700 1 --2- 172.21.15.82:0/4268163734 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55de581ddca0 0x55de581d7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:19.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.958+0000 7f70e0b9a700 1 -- 172.21.15.82:0/4268163734 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de581d7c40 msgr2=0x55de581d80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:31:19.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.958+0000 7f70e0b9a700 1 --2- 172.21.15.82:0/4268163734 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de581d7c40 0x55de581d80a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:19.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.958+0000 7f70e0b9a700 1 -- 172.21.15.82:0/4268163734 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55de57fa9630 con 0x55de581dd380 2023-09-23T09:31:19.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.958+0000 7f70e0b9a700 1 --2- 172.21.15.82:0/4268163734 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55de581dd380 0x55de581dd760 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f70c8039790 tx=0x7f70c8009550 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f502655b0c9890b server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:31:19.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.958+0000 7f70e1b9c700 1 --2- 172.21.15.82:0/1743787327 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f70cc0a0200 0x7f70cc0a26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:19.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.959+0000 7f70c77fe700 1 -- 172.21.15.82:0/4268163734 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c8039db0 con 0x55de581dd380 2023-09-23T09:31:19.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.959+0000 7f70c77fe700 1 -- 172.21.15.82:0/4268163734 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f70c8038870 con 0x55de581dd380 2023-09-23T09:31:19.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.959+0000 7f70c77fe700 1 -- 172.21.15.82:0/4268163734 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c8035610 con 0x55de581dd380 2023-09-23T09:31:19.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.960+0000 7f70f6e31b80 1 -- 172.21.15.82:0/4268163734 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55de581dd380 msgr2=0x55de581dd760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:31:19.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.960+0000 7f70f6e31b80 1 --2- 172.21.15.82:0/4268163734 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55de581dd380 0x55de581dd760 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f70c8039790 tx=0x7f70c8009550 comp rx=0 tx=0).stop 2023-09-23T09:31:19.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.960+0000 7f70f6e31b80 1 -- 172.21.15.82:0/4268163734 shutdown_connections 2023-09-23T09:31:19.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.960+0000 7f70f6e31b80 1 --2- 172.21.15.82:0/4268163734 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de581d7c40 0x55de581d80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:19.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.960+0000 7f70f6e31b80 1 --2- 172.21.15.82:0/4268163734 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55de581dd380 0x55de581dd760 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:19.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.960+0000 7f70f6e31b80 1 --2- 172.21.15.82:0/4268163734 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55de581ddca0 0x55de581d7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:19.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.960+0000 7f70f6e31b80 1 -- 172.21.15.82:0/4268163734 >> 172.21.15.82:0/4268163734 conn(0x55de5814c0e0 msgr2=0x55de581d2410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:31:19.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.960+0000 7f70f6e31b80 1 -- 172.21.15.82:0/4268163734 shutdown_connections 2023-09-23T09:31:19.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.960+0000 7f70f6e31b80 1 -- 172.21.15.82:0/4268163734 wait complete. 2023-09-23T09:31:19.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.961+0000 7f70f6e31b80 1 -- start start 2023-09-23T09:31:19.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.961+0000 7f70e1b9c700 1 --2- 172.21.15.82:0/1743787327 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f70cc0a0200 0x7f70cc0a26c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f70d4096530 tx=0x7f70d40037b0 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:31:19.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.962+0000 7f70f6e31b80 1 Processor -- start 2023-09-23T09:31:19.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.962+0000 7f70f6e31b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55de581d7c40 0x55de581e3c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:19.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.962+0000 7f70f6e31b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55de581dd380 0x55de581e0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:19.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.962+0000 7f70f6e31b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de581ddca0 0x55de581e1620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:19.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.962+0000 7f70f6e31b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de58129990 con 0x55de581ddca0 2023-09-23T09:31:19.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.962+0000 7f70f6e31b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de580c7bb0 con 0x55de581dd380 2023-09-23T09:31:19.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.962+0000 7f70f6e31b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de580c78b0 con 0x55de581d7c40 2023-09-23T09:31:19.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.963+0000 7f70f6e31b80 10 client.0 _ll_register_callbacks cb 0x55de58011a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:31:19.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.963+0000 7f70e139b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55de581dd380 0x55de581e0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:19.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.963+0000 7f70e0b9a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55de581d7c40 0x55de581e3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:19.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.963+0000 7f70e0b9a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55de581d7c40 0x55de581e3c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:58906/0 (socket says 172.21.15.82:58906) 2023-09-23T09:31:19.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.963+0000 7f70e0b9a700 1 -- 172.21.15.82:0/688356438 learned_addr learned my addr 172.21.15.82:0/688356438 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:31:19.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.964+0000 7f70e139b700 1 -- 172.21.15.82:0/688356438 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55de581d7c40 msgr2=0x55de581e3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:31:19.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.964+0000 7f70e139b700 1 --2- 172.21.15.82:0/688356438 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55de581d7c40 0x55de581e3c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:19.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.964+0000 7f70e139b700 1 -- 172.21.15.82:0/688356438 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de581ddca0 msgr2=0x55de581e1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:31:19.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.964+0000 7f70e139b700 1 --2- 172.21.15.82:0/688356438 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de581ddca0 0x55de581e1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:19.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.964+0000 7f70e139b700 1 -- 172.21.15.82:0/688356438 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70c8039470 con 0x55de581dd380 2023-09-23T09:31:19.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.964+0000 7f70e139b700 1 --2- 172.21.15.82:0/688356438 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55de581dd380 0x55de581e0ee0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x55de581de100 tx=0x7f70d000adf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84f227e8d86dd69e server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:31:19.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.964+0000 7f70c4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-09-23T09:31:19.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.965+0000 7f70c4ff9700 1 -- 172.21.15.82:0/688356438 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d0010040 con 0x55de581dd380 2023-09-23T09:31:19.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.965+0000 7f70c4ff9700 1 -- 172.21.15.82:0/688356438 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(145..145 src has 1..145) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f70d0006e40 con 0x55de581dd380 2023-09-23T09:31:19.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.965+0000 7f70f6e31b80 1 -- 172.21.15.82:0/688356438 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55de581a71c0 con 0x55de581dd380 2023-09-23T09:31:19.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.966+0000 7f70c4ff9700 1 -- 172.21.15.82:0/688356438 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7f70d000e940 con 0x55de581dd380 2023-09-23T09:31:19.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.971+0000 7f70f6e31b80 10 client.27500 fetch_fsmap learned FSMap version 102 2023-09-23T09:31:19.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.971+0000 7f70f6e31b80 1 -- 172.21.15.82:0/688356438 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=4+}) v3 -- 0x55de57f55de0 con 0x55de581dd380 2023-09-23T09:31:19.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.973+0000 7f70c4ff9700 1 -- 172.21.15.82:0/688356438 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55de581a71c0 con 0x55de581dd380 2023-09-23T09:31:19.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.973+0000 7f70c4ff9700 1 -- 172.21.15.82:0/688356438 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 102) v1 ==== 7954+0+0 (secure 0 0 0) 0x7f70d0008030 con 0x55de581dd380 2023-09-23T09:31:19.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.975+0000 7f70f6e31b80 10 client.27500 fetch_fsmap finished waiting for FSMap version 102 2023-09-23T09:31:19.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.975+0000 7f70f6e31b80 10 client.27500 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:31:19.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.975+0000 7f70f6e31b80 20 client.27500 populate_metadata read hostname 'smithi082' 2023-09-23T09:31:19.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.975+0000 7f70f6e31b80 1 --2- 172.21.15.82:0/688356438 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55de581f1910 0x55de581f3d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:19.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.975+0000 7f70f6e31b80 4 client.27500 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:31:19.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.975+0000 7f70f6e31b80 1 -- 172.21.15.82:0/688356438 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55de580cfba0 con 0x55de581f1910 2023-09-23T09:31:19.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.977+0000 7f70e0b9a700 1 --2- 172.21.15.82:0/688356438 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55de581f1910 0x55de581f3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:19.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.979+0000 7f70e0b9a700 1 --2- 172.21.15.82:0/688356438 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55de581f1910 0x55de581f3d30 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd5e1723e30df26f server_cookie=23ee882f72a45463 in_seq=0 out_seq=0 2023-09-23T09:31:19.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.979+0000 7f70c4ff9700 10 client.27500 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:31:19.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.980+0000 7f70c4ff9700 1 -- 172.21.15.82:0/688356438 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55de580cfba0 con 0x55de581f1910 2023-09-23T09:31:19.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.980+0000 7f70c4ff9700 10 client.27500 handle_command_reply: tid=0 2023-09-23T09:31:19.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.980+0000 7f70f6e31b80 1 client.27500 shutdown 2023-09-23T09:31:19.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.980+0000 7f70f6e31b80 1 -- 172.21.15.82:0/688356438 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55de581dd380 msgr2=0x55de581e0ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:31:19.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.980+0000 7f70f6e31b80 1 --2- 172.21.15.82:0/688356438 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55de581dd380 0x55de581e0ee0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x55de581de100 tx=0x7f70d000adf0 comp rx=0 tx=0).stop 2023-09-23T09:31:19.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.981+0000 7f70f6e31b80 1 -- 172.21.15.82:0/688356438 shutdown_connections 2023-09-23T09:31:19.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.981+0000 7f70f6e31b80 1 --2- 172.21.15.82:0/688356438 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55de581f1910 0x55de581f3d30 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:19.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.981+0000 7f70f6e31b80 1 --2- 172.21.15.82:0/688356438 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de581ddca0 0x55de581e1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:19.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.981+0000 7f70f6e31b80 1 --2- 172.21.15.82:0/688356438 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55de581d7c40 0x55de581e3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:19.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.981+0000 7f70f6e31b80 1 --2- 172.21.15.82:0/688356438 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55de581dd380 0x55de581e0ee0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:19.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.981+0000 7f70f6e31b80 1 -- 172.21.15.82:0/688356438 >> 172.21.15.82:0/688356438 conn(0x55de5814c0e0 msgr2=0x55de581ccb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:31:19.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.982+0000 7f70c4ff9700 0 client.27500 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:31:19.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.986+0000 7f70f6e31b80 1 -- 172.21.15.82:0/688356438 shutdown_connections 2023-09-23T09:31:19.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.987+0000 7f70f6e31b80 1 -- 172.21.15.82:0/688356438 wait complete. 2023-09-23T09:31:19.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:19.987+0000 7f70f6e31b80 20 client.27500 trim_cache size 0 max 16384 2023-09-23T09:31:20.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.020+0000 7f70f6e31b80 1 Processor -- start 2023-09-23T09:31:20.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.022+0000 7f70f6e31b80 1 -- start start 2023-09-23T09:31:20.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.022+0000 7f70f6e31b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55de581d7c40 0x55de581ecf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:20.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.022+0000 7f70f6e31b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de581dd380 0x55de581db010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:20.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.022+0000 7f70f6e31b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55de581ddca0 0x55de581db550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:20.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.022+0000 7f70f6e31b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de57fab920 con 0x55de581dd380 2023-09-23T09:31:20.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.022+0000 7f70f6e31b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de581ce810 con 0x55de581d7c40 2023-09-23T09:31:20.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.022+0000 7f70f6e31b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de581dcf90 con 0x55de581ddca0 2023-09-23T09:31:20.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.023+0000 7f70e0b9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55de581d7c40 0x55de581ecf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:20.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.023+0000 7f70e0b9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55de581d7c40 0x55de581ecf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:51164/0 (socket says 172.21.15.82:51164) 2023-09-23T09:31:20.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.023+0000 7f70e0b9a700 1 -- 172.21.15.82:0/1735933169 learned_addr learned my addr 172.21.15.82:0/1735933169 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:31:20.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.023+0000 7f70e0b9a700 1 --2- 172.21.15.82:0/1735933169 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55de581ddca0 0x55de581db550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:20.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.023+0000 7f70e139b700 1 --2- 172.21.15.82:0/1735933169 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de581dd380 0x55de581db010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:20.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.023+0000 7f70e0b9a700 1 -- 172.21.15.82:0/1735933169 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55de581ddca0 msgr2=0x55de581db550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:31:20.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.023+0000 7f70e0b9a700 1 --2- 172.21.15.82:0/1735933169 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55de581ddca0 0x55de581db550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:20.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.023+0000 7f70e0b9a700 1 -- 172.21.15.82:0/1735933169 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de581dd380 msgr2=0x55de581db010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:31:20.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.023+0000 7f70e0b9a700 1 --2- 172.21.15.82:0/1735933169 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de581dd380 0x55de581db010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:20.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.023+0000 7f70e0b9a700 1 -- 172.21.15.82:0/1735933169 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55de57f3ec60 con 0x55de581d7c40 2023-09-23T09:31:20.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.024+0000 7f70e139b700 1 --2- 172.21.15.82:0/1735933169 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de581dd380 0x55de581db010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:31:20.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.024+0000 7f70e0b9a700 1 --2- 172.21.15.82:0/1735933169 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55de581d7c40 0x55de581ecf80 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f70c8000c00 tx=0x7f70c8047040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f61c419b99c6fc5 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:31:20.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.025+0000 7f70c7fff700 1 -- 172.21.15.82:0/1735933169 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c8039ea0 con 0x55de581d7c40 2023-09-23T09:31:20.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.025+0000 7f70c7fff700 1 -- 172.21.15.82:0/1735933169 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f70c804dd10 con 0x55de581d7c40 2023-09-23T09:31:20.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.025+0000 7f70c7fff700 1 -- 172.21.15.82:0/1735933169 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c8038ba0 con 0x55de581d7c40 2023-09-23T09:31:20.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.026+0000 7f70f6e31b80 1 -- 172.21.15.82:0/1735933169 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55de581d7c40 msgr2=0x55de581ecf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:31:20.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.026+0000 7f70f6e31b80 1 --2- 172.21.15.82:0/1735933169 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55de581d7c40 0x55de581ecf80 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f70c8000c00 tx=0x7f70c8047040 comp rx=0 tx=0).stop 2023-09-23T09:31:20.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.026+0000 7f70f6e31b80 1 -- 172.21.15.82:0/1735933169 shutdown_connections 2023-09-23T09:31:20.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.026+0000 7f70f6e31b80 1 --2- 172.21.15.82:0/1735933169 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55de581ddca0 0x55de581db550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:20.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.026+0000 7f70f6e31b80 1 --2- 172.21.15.82:0/1735933169 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55de581d7c40 0x55de581ecf80 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:20.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.026+0000 7f70f6e31b80 1 --2- 172.21.15.82:0/1735933169 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de581dd380 0x55de581db010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:20.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.026+0000 7f70f6e31b80 1 -- 172.21.15.82:0/1735933169 >> 172.21.15.82:0/1735933169 conn(0x55de5814c0e0 msgr2=0x55de581f3920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:31:20.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.026+0000 7f70f6e31b80 1 -- 172.21.15.82:0/1735933169 shutdown_connections 2023-09-23T09:31:20.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.026+0000 7f70f6e31b80 1 -- 172.21.15.82:0/1735933169 wait complete. 2023-09-23T09:31:20.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.027+0000 7f70f6e31b80 1 -- start start 2023-09-23T09:31:20.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.027+0000 7f70f6e31b80 1 Processor -- start 2023-09-23T09:31:20.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.028+0000 7f70f6e31b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de581d7c40 0x55de581da150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:20.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.028+0000 7f70f6e31b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55de581dd380 0x55de581da690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:20.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.028+0000 7f70f6e31b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55de581ddca0 0x55de581d8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:20.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.028+0000 7f70f6e31b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de581d9340 con 0x55de581d7c40 2023-09-23T09:31:20.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.028+0000 7f70f6e31b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de581d94b0 con 0x55de581ddca0 2023-09-23T09:31:20.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.028+0000 7f70f6e31b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de581d9670 con 0x55de581dd380 2023-09-23T09:31:20.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.028+0000 7f70f6e31b80 10 client.0 _ll_register_callbacks cb 0x7f70d000a400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:31:20.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.029+0000 7f70e0b9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55de581ddca0 0x55de581d8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:20.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.029+0000 7f70e139b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55de581dd380 0x55de581da690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:20.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.029+0000 7f70e139b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55de581dd380 0x55de581da690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:58920/0 (socket says 172.21.15.82:58920) 2023-09-23T09:31:20.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.029+0000 7f70e139b700 1 -- 172.21.15.82:0/342806092 learned_addr learned my addr 172.21.15.82:0/342806092 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:31:20.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.029+0000 7f70e0b9a700 1 --2- 172.21.15.82:0/342806092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de581d7c40 0x55de581da150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:20.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.030+0000 7f70e0b9a700 1 -- 172.21.15.82:0/342806092 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55de581dd380 msgr2=0x55de581da690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:31:20.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.030+0000 7f70e0b9a700 1 --2- 172.21.15.82:0/342806092 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55de581dd380 0x55de581da690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:20.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.030+0000 7f70e0b9a700 1 -- 172.21.15.82:0/342806092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de581d7c40 msgr2=0x55de581da150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:31:20.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.030+0000 7f70e0b9a700 1 --2- 172.21.15.82:0/342806092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de581d7c40 0x55de581da150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:20.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.030+0000 7f70e0b9a700 1 -- 172.21.15.82:0/342806092 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55de57fa9630 con 0x55de581ddca0 2023-09-23T09:31:20.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.030+0000 7f70e139b700 1 --2- 172.21.15.82:0/342806092 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55de581dd380 0x55de581da690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:31:20.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.031+0000 7f70e0b9a700 1 --2- 172.21.15.82:0/342806092 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55de581ddca0 0x55de581d8e00 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f70c8009b20 tx=0x7f70c8004860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=85ee654634be6d28 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:31:20.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.031+0000 7f70c4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-09-23T09:31:20.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.032+0000 7f70c4ff9700 1 -- 172.21.15.82:0/342806092 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c804d2e0 con 0x55de581ddca0 2023-09-23T09:31:20.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.032+0000 7f70c4ff9700 1 -- 172.21.15.82:0/342806092 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(145..145 src has 1..145) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f70c8000e40 con 0x55de581ddca0 2023-09-23T09:31:20.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.032+0000 7f70f6e31b80 1 -- 172.21.15.82:0/342806092 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55de581ca8b0 con 0x55de581ddca0 2023-09-23T09:31:20.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.033+0000 7f70c4ff9700 1 -- 172.21.15.82:0/342806092 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7f70c804d440 con 0x55de581ddca0 2023-09-23T09:31:20.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.034+0000 7f70f6e31b80 10 client.27506 fetch_fsmap learned FSMap version 102 2023-09-23T09:31:20.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.034+0000 7f70f6e31b80 1 -- 172.21.15.82:0/342806092 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=4+}) v3 -- 0x55de57f7c250 con 0x55de581ddca0 2023-09-23T09:31:20.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.035+0000 7f70c4ff9700 1 -- 172.21.15.82:0/342806092 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55de581ca8b0 con 0x55de581ddca0 2023-09-23T09:31:20.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.035+0000 7f70c4ff9700 1 -- 172.21.15.82:0/342806092 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 102) v1 ==== 7954+0+0 (secure 0 0 0) 0x7f70c8038940 con 0x55de581ddca0 2023-09-23T09:31:20.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.036+0000 7f70f6e31b80 10 client.27506 fetch_fsmap finished waiting for FSMap version 102 2023-09-23T09:31:20.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.036+0000 7f70f6e31b80 10 client.27506 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:31:20.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.036+0000 7f70f6e31b80 20 client.27506 populate_metadata read hostname 'smithi082' 2023-09-23T09:31:20.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.036+0000 7f70f6e31b80 1 --2- 172.21.15.82:0/342806092 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55de582462b0 0x55de582486d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:20.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.036+0000 7f70f6e31b80 4 client.27506 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:31:20.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.036+0000 7f70f6e31b80 1 -- 172.21.15.82:0/342806092 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55de58122970 con 0x55de582462b0 2023-09-23T09:31:20.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.038+0000 7f70e139b700 1 --2- 172.21.15.82:0/342806092 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55de582462b0 0x55de582486d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:20.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.041+0000 7f70e139b700 1 --2- 172.21.15.82:0/342806092 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55de582462b0 0x55de582486d0 crc :-1 s=READY pgs=230 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=44077e94fff22273 server_cookie=1e83fccc5c841991 in_seq=0 out_seq=0 2023-09-23T09:31:20.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.041+0000 7f70c4ff9700 10 client.27506 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:31:20.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.042+0000 7f70c4ff9700 1 -- 172.21.15.82:0/342806092 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55de58122970 con 0x55de582462b0 2023-09-23T09:31:20.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.042+0000 7f70c4ff9700 10 client.27506 handle_command_reply: tid=0 2023-09-23T09:31:20.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.043+0000 7f70f6e31b80 1 client.27506 shutdown 2023-09-23T09:31:20.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.043+0000 7f70f6e31b80 1 -- 172.21.15.82:0/342806092 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55de581ddca0 msgr2=0x55de581d8e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:31:20.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.043+0000 7f70f6e31b80 1 --2- 172.21.15.82:0/342806092 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55de581ddca0 0x55de581d8e00 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f70c8009b20 tx=0x7f70c8004860 comp rx=0 tx=0).stop 2023-09-23T09:31:20.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.044+0000 7f70f6e31b80 1 -- 172.21.15.82:0/342806092 shutdown_connections 2023-09-23T09:31:20.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.044+0000 7f70f6e31b80 1 --2- 172.21.15.82:0/342806092 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55de581ddca0 0x55de581d8e00 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:20.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.044+0000 7f70f6e31b80 1 --2- 172.21.15.82:0/342806092 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55de582462b0 0x55de582486d0 crc :-1 s=READY pgs=230 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:20.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.044+0000 7f70f6e31b80 1 --2- 172.21.15.82:0/342806092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de581d7c40 0x55de581da150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:20.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.044+0000 7f70f6e31b80 1 --2- 172.21.15.82:0/342806092 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55de581dd380 0x55de581da690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:20.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.044+0000 7f70f6e31b80 1 -- 172.21.15.82:0/342806092 >> 172.21.15.82:0/342806092 conn(0x55de5814c0e0 msgr2=0x55de581d20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:31:20.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.044+0000 7f70c4ff9700 0 client.27506 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:31:20.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.044+0000 7f70f6e31b80 1 -- 172.21.15.82:0/342806092 shutdown_connections 2023-09-23T09:31:20.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.045+0000 7f70f6e31b80 1 -- 172.21.15.82:0/342806092 wait complete. 2023-09-23T09:31:20.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.047+0000 7f70f6e31b80 20 client.27506 trim_cache size 0 max 16384 2023-09-23T09:31:20.050 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:31:20.050 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-23T09:31:20.050 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:31:20.050 INFO:teuthology.orchestra.run.smithi082.stdout: "2aec802a-e2df-49b3-a22a-82c491ba0c59": { 2023-09-23T09:31:20.050 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:31:20.050 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "2aec802a-e2df-49b3-a22a-82c491ba0c59", 2023-09-23T09:31:20.051 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:31:20.051 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:31:20.051 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:31:20.051 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:31:20.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.049+0000 7f70e35ff700 1 -- 172.21.15.82:0/1743787327 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f70cc0a0200 msgr2=0x7f70cc0a26c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:31:20.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.049+0000 7f70e35ff700 1 --2- 172.21.15.82:0/1743787327 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f70cc0a0200 0x7f70cc0a26c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f70d4096530 tx=0x7f70d40037b0 comp rx=0 tx=0).stop 2023-09-23T09:31:20.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.049+0000 7f70e35ff700 1 -- 172.21.15.82:0/1743787327 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f70dc11a100 msgr2=0x7f70dc110300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:31:20.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.049+0000 7f70e35ff700 1 --2- 172.21.15.82:0/1743787327 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f70dc11a100 0x7f70dc110300 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f70d4005f50 tx=0x7f70d4005740 comp rx=0 tx=0).stop 2023-09-23T09:31:20.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.049+0000 7f70e35ff700 1 -- 172.21.15.82:0/1743787327 shutdown_connections 2023-09-23T09:31:20.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.049+0000 7f70e35ff700 1 --2- 172.21.15.82:0/1743787327 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f70cc0a0200 0x7f70cc0a26c0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:20.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.049+0000 7f70e35ff700 1 --2- 172.21.15.82:0/1743787327 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f70dc11a100 0x7f70dc110300 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:20.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.049+0000 7f70e35ff700 1 --2- 172.21.15.82:0/1743787327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70dc10efd0 0x7f70dc117360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:20.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.049+0000 7f70e35ff700 1 --2- 172.21.15.82:0/1743787327 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70dc10f440 0x7f70dc1178a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:20.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.049+0000 7f70e35ff700 1 -- 172.21.15.82:0/1743787327 >> 172.21.15.82:0/1743787327 conn(0x7f70dc06cbe0 msgr2=0x7f70dc118c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:31:20.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.052+0000 7f70e35ff700 1 -- 172.21.15.82:0/1743787327 shutdown_connections 2023-09-23T09:31:20.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:20.052+0000 7f70e35ff700 1 -- 172.21.15.82:0/1743787327 wait complete. 2023-09-23T09:31:20.092 INFO:tasks.cephfs.filesystem:scrub status for tag:2aec802a-e2df-49b3-a22a-82c491ba0c59 - {'path': '/', 'tag': '2aec802a-e2df-49b3-a22a-82c491ba0c59', 'options': 'recursive,force'} 2023-09-23T09:31:20.827 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 250.0 s, 560.2 tps, lat 178.125 ms stddev 67.873 2023-09-23T09:31:21.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:31:20 smithi135 ceph-mon[99205]: scrub queued for path: / 2023-09-23T09:31:21.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:31:20 smithi135 ceph-mon[99205]: scrub summary: idle+waiting paths [/] 2023-09-23T09:31:21.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:31:20 smithi135 ceph-mon[99205]: scrub summary: active paths [/] 2023-09-23T09:31:21.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:31:20 smithi135 ceph-mon[99205]: scrub summary: active paths [/] 2023-09-23T09:31:21.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:31:20 smithi135 ceph-mon[99205]: scrub summary: active paths [/] 2023-09-23T09:31:21.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:31:20 smithi135 ceph-mon[99205]: scrub summary: idle+waiting paths [/] 2023-09-23T09:31:21.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:31:20 smithi135 ceph-mon[99205]: scrub summary: active paths [/] 2023-09-23T09:31:21.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:31:20 smithi135 ceph-mon[99205]: scrub summary: active paths [/] 2023-09-23T09:31:21.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:31:20 smithi135 ceph-mon[99205]: scrub summary: active paths [/] 2023-09-23T09:31:21.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:31:20 smithi135 ceph-mon[99205]: scrub summary: idle+waiting paths [/] 2023-09-23T09:31:21.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:31:20 smithi135 ceph-mon[99205]: scrub summary: idle+waiting paths [/] 2023-09-23T09:31:21.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:31:20 smithi135 ceph-mon[99205]: scrub summary: idle+waiting paths [/] 2023-09-23T09:31:21.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:31:20 smithi135 ceph-mon[99205]: scrub summary: active paths [/] 2023-09-23T09:31:21.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:31:20 smithi135 ceph-mon[99205]: scrub summary: idle+waiting paths [/] 2023-09-23T09:31:21.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:31:20 smithi135 ceph-mon[99205]: pgmap v1092: 97 pgs: 97 active+clean; 16 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 16 MiB/s wr, 1.24k op/s 2023-09-23T09:31:21.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:31:20 smithi135 ceph-mon[99205]: scrub summary: idle+waiting paths [/] 2023-09-23T09:31:21.124 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:31:20 smithi082 ceph-mon[97694]: scrub queued for path: / 2023-09-23T09:31:21.125 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:31:20 smithi082 ceph-mon[97694]: scrub summary: idle+waiting paths [/] 2023-09-23T09:31:21.125 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:31:20 smithi082 ceph-mon[97694]: scrub summary: active paths [/] 2023-09-23T09:31:21.125 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:31:20 smithi082 ceph-mon[97694]: scrub summary: active paths [/] 2023-09-23T09:31:21.125 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:31:20 smithi082 ceph-mon[97694]: scrub summary: active paths [/] 2023-09-23T09:31:21.125 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:31:20 smithi082 ceph-mon[97694]: scrub summary: idle+waiting paths [/] 2023-09-23T09:31:21.125 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:31:20 smithi082 ceph-mon[97694]: scrub summary: active paths [/] 2023-09-23T09:31:21.125 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:31:20 smithi082 ceph-mon[97694]: scrub summary: active paths [/] 2023-09-23T09:31:21.125 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:31:20 smithi082 ceph-mon[97694]: scrub summary: active paths [/] 2023-09-23T09:31:21.125 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:31:20 smithi082 ceph-mon[97694]: scrub summary: idle+waiting paths [/] 2023-09-23T09:31:21.125 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:31:20 smithi082 ceph-mon[97694]: scrub summary: idle+waiting paths [/] 2023-09-23T09:31:21.126 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:31:20 smithi082 ceph-mon[97694]: scrub summary: idle+waiting paths [/] 2023-09-23T09:31:21.126 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:31:20 smithi082 ceph-mon[97694]: scrub summary: active paths [/] 2023-09-23T09:31:21.126 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:31:20 smithi082 ceph-mon[97694]: scrub summary: idle+waiting paths [/] 2023-09-23T09:31:21.126 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:31:20 smithi082 ceph-mon[97694]: pgmap v1092: 97 pgs: 97 active+clean; 16 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 16 MiB/s wr, 1.24k op/s 2023-09-23T09:31:21.126 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:31:20 smithi082 ceph-mon[97694]: scrub summary: idle+waiting paths [/] 2023-09-23T09:31:21.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:31:20 smithi161 ceph-mon[99580]: scrub queued for path: / 2023-09-23T09:31:21.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:31:20 smithi161 ceph-mon[99580]: scrub summary: idle+waiting paths [/] 2023-09-23T09:31:21.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:31:20 smithi161 ceph-mon[99580]: scrub summary: active paths [/] 2023-09-23T09:31:21.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:31:20 smithi161 ceph-mon[99580]: scrub summary: active paths [/] 2023-09-23T09:31:21.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:31:20 smithi161 ceph-mon[99580]: scrub summary: active paths [/] 2023-09-23T09:31:21.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:31:20 smithi161 ceph-mon[99580]: scrub summary: idle+waiting paths [/] 2023-09-23T09:31:21.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:31:20 smithi161 ceph-mon[99580]: scrub summary: active paths [/] 2023-09-23T09:31:21.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:31:20 smithi161 ceph-mon[99580]: scrub summary: active paths [/] 2023-09-23T09:31:21.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:31:20 smithi161 ceph-mon[99580]: scrub summary: active paths [/] 2023-09-23T09:31:21.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:31:20 smithi161 ceph-mon[99580]: scrub summary: idle+waiting paths [/] 2023-09-23T09:31:21.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:31:20 smithi161 ceph-mon[99580]: scrub summary: idle+waiting paths [/] 2023-09-23T09:31:21.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:31:20 smithi161 ceph-mon[99580]: scrub summary: idle+waiting paths [/] 2023-09-23T09:31:21.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:31:20 smithi161 ceph-mon[99580]: scrub summary: active paths [/] 2023-09-23T09:31:21.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:31:20 smithi161 ceph-mon[99580]: scrub summary: idle+waiting paths [/] 2023-09-23T09:31:21.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:31:20 smithi161 ceph-mon[99580]: pgmap v1092: 97 pgs: 97 active+clean; 16 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 16 MiB/s wr, 1.24k op/s 2023-09-23T09:31:21.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:31:20 smithi161 ceph-mon[99580]: scrub summary: idle+waiting paths [/] 2023-09-23T09:31:22.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:31:21 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:31:22.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:31:21 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:31:22.154 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:31:21 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:31:23.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:31:22 smithi135 ceph-mon[99205]: pgmap v1093: 97 pgs: 97 active+clean; 16 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 16 MiB/s wr, 1.26k op/s 2023-09-23T09:31:23.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:31:22 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:31:23.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:31:22 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:31:23.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:31:22 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:31:23.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:31:22 smithi082 ceph-mon[97694]: pgmap v1093: 97 pgs: 97 active+clean; 16 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 16 MiB/s wr, 1.26k op/s 2023-09-23T09:31:23.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:31:22 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:31:23.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:31:22 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:31:23.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:31:22 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:31:23.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:31:22 smithi161 ceph-mon[99580]: pgmap v1093: 97 pgs: 97 active+clean; 16 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 16 MiB/s wr, 1.26k op/s 2023-09-23T09:31:23.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:31:22 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:31:23.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:31:22 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:31:23.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:31:22 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:31:25.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:31:24 smithi135 ceph-mon[99205]: pgmap v1094: 97 pgs: 97 active+clean; 16 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 14 MiB/s wr, 1.10k op/s 2023-09-23T09:31:25.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:31:24 smithi082 ceph-mon[97694]: pgmap v1094: 97 pgs: 97 active+clean; 16 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 14 MiB/s wr, 1.10k op/s 2023-09-23T09:31:25.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:31:24 smithi161 ceph-mon[99580]: pgmap v1094: 97 pgs: 97 active+clean; 16 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 14 MiB/s wr, 1.10k op/s 2023-09-23T09:31:25.830 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 255.0 s, 388.4 tps, lat 258.144 ms stddev 389.847 2023-09-23T09:31:27.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:31:26 smithi135 ceph-mon[99205]: pgmap v1095: 97 pgs: 97 active+clean; 16 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 19 MiB/s wr, 1.52k op/s 2023-09-23T09:31:27.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:31:26 smithi082 ceph-mon[97694]: pgmap v1095: 97 pgs: 97 active+clean; 16 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 19 MiB/s wr, 1.52k op/s 2023-09-23T09:31:27.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:31:26 smithi161 ceph-mon[99580]: pgmap v1095: 97 pgs: 97 active+clean; 16 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 19 MiB/s wr, 1.52k op/s 2023-09-23T09:31:28.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:31:28 smithi161 ceph-mon[99580]: pgmap v1096: 97 pgs: 97 active+clean; 16 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 11 MiB/s wr, 966 op/s 2023-09-23T09:31:28.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:31:28 smithi135 ceph-mon[99205]: pgmap v1096: 97 pgs: 97 active+clean; 16 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 11 MiB/s wr, 966 op/s 2023-09-23T09:31:28.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:31:28 smithi082 ceph-mon[97694]: pgmap v1096: 97 pgs: 97 active+clean; 16 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 11 MiB/s wr, 966 op/s 2023-09-23T09:31:30.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 260.0 s, 419.4 tps, lat 237.930 ms stddev 223.847 2023-09-23T09:31:31.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:31:30 smithi135 ceph-mon[99205]: pgmap v1097: 97 pgs: 97 active+clean; 16 GiB data, 58 GiB used, 1014 GiB / 1.0 TiB avail; 2.4 MiB/s rd, 15 MiB/s wr, 1.31k op/s 2023-09-23T09:31:31.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:31:30 smithi082 ceph-mon[97694]: pgmap v1097: 97 pgs: 97 active+clean; 16 GiB data, 58 GiB used, 1014 GiB / 1.0 TiB avail; 2.4 MiB/s rd, 15 MiB/s wr, 1.31k op/s 2023-09-23T09:31:33.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:31:32 smithi135 ceph-mon[99205]: pgmap v1098: 97 pgs: 97 active+clean; 16 GiB data, 58 GiB used, 1014 GiB / 1.0 TiB avail; 1.6 MiB/s rd, 11 MiB/s wr, 935 op/s 2023-09-23T09:31:33.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:31:32 smithi082 ceph-mon[97694]: pgmap v1098: 97 pgs: 97 active+clean; 16 GiB data, 58 GiB used, 1014 GiB / 1.0 TiB avail; 1.6 MiB/s rd, 11 MiB/s wr, 935 op/s 2023-09-23T09:31:33.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:31:30 smithi161 ceph-mon[99580]: pgmap v1097: 97 pgs: 97 active+clean; 16 GiB data, 58 GiB used, 1014 GiB / 1.0 TiB avail; 2.4 MiB/s rd, 15 MiB/s wr, 1.31k op/s 2023-09-23T09:31:33.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:31:32 smithi161 ceph-mon[99580]: pgmap v1098: 97 pgs: 97 active+clean; 16 GiB data, 58 GiB used, 1014 GiB / 1.0 TiB avail; 1.6 MiB/s rd, 11 MiB/s wr, 935 op/s 2023-09-23T09:31:35.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:31:34 smithi135 ceph-mon[99205]: pgmap v1099: 97 pgs: 97 active+clean; 16 GiB data, 58 GiB used, 1014 GiB / 1.0 TiB avail; 1.5 MiB/s rd, 10 MiB/s wr, 863 op/s 2023-09-23T09:31:35.122 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:31:34 smithi082 ceph-mon[97694]: pgmap v1099: 97 pgs: 97 active+clean; 16 GiB data, 58 GiB used, 1014 GiB / 1.0 TiB avail; 1.5 MiB/s rd, 10 MiB/s wr, 863 op/s 2023-09-23T09:31:35.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:31:34 smithi161 ceph-mon[99580]: pgmap v1099: 97 pgs: 97 active+clean; 16 GiB data, 58 GiB used, 1014 GiB / 1.0 TiB avail; 1.5 MiB/s rd, 10 MiB/s wr, 863 op/s 2023-09-23T09:31:35.827 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 265.0 s, 542.2 tps, lat 184.321 ms stddev 59.759 2023-09-23T09:31:37.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:31:36 smithi135 ceph-mon[99205]: pgmap v1100: 97 pgs: 97 active+clean; 16 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 2.5 MiB/s rd, 17 MiB/s wr, 1.42k op/s 2023-09-23T09:31:37.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:31:36 smithi082 ceph-mon[97694]: pgmap v1100: 97 pgs: 97 active+clean; 16 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 2.5 MiB/s rd, 17 MiB/s wr, 1.42k op/s 2023-09-23T09:31:37.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:31:36 smithi161 ceph-mon[99580]: pgmap v1100: 97 pgs: 97 active+clean; 16 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 2.5 MiB/s rd, 17 MiB/s wr, 1.42k op/s 2023-09-23T09:31:38.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:31:38 smithi161 ceph-mon[99580]: pgmap v1101: 97 pgs: 97 active+clean; 16 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 1.8 MiB/s rd, 12 MiB/s wr, 953 op/s 2023-09-23T09:31:38.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:31:38 smithi135 ceph-mon[99205]: pgmap v1101: 97 pgs: 97 active+clean; 16 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 1.8 MiB/s rd, 12 MiB/s wr, 953 op/s 2023-09-23T09:31:38.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:31:38 smithi082 ceph-mon[97694]: pgmap v1101: 97 pgs: 97 active+clean; 16 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 1.8 MiB/s rd, 12 MiB/s wr, 953 op/s 2023-09-23T09:31:40.829 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 270.0 s, 232.7 tps, lat 196.605 ms stddev 60.854 2023-09-23T09:31:41.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:31:40 smithi135 ceph-mon[99205]: pgmap v1102: 97 pgs: 97 active+clean; 16 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 16 MiB/s wr, 1.35k op/s 2023-09-23T09:31:41.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:31:40 smithi082 ceph-mon[97694]: pgmap v1102: 97 pgs: 97 active+clean; 16 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 16 MiB/s wr, 1.35k op/s 2023-09-23T09:31:41.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:31:40 smithi161 ceph-mon[99580]: pgmap v1102: 97 pgs: 97 active+clean; 16 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 16 MiB/s wr, 1.35k op/s 2023-09-23T09:31:43.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:31:42 smithi135 ceph-mon[99205]: pgmap v1103: 97 pgs: 97 active+clean; 16 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 13 MiB/s wr, 1.06k op/s 2023-09-23T09:31:43.122 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:31:42 smithi082 ceph-mon[97694]: pgmap v1103: 97 pgs: 97 active+clean; 16 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 13 MiB/s wr, 1.06k op/s 2023-09-23T09:31:43.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:31:42 smithi161 ceph-mon[99580]: pgmap v1103: 97 pgs: 97 active+clean; 16 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 13 MiB/s wr, 1.06k op/s 2023-09-23T09:31:45.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:31:44 smithi082 ceph-mon[97694]: pgmap v1104: 97 pgs: 97 active+clean; 16 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 12 MiB/s wr, 1.00k op/s 2023-09-23T09:31:45.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:31:44 smithi161 ceph-mon[99580]: pgmap v1104: 97 pgs: 97 active+clean; 16 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 12 MiB/s wr, 1.00k op/s 2023-09-23T09:31:45.830 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 275.0 s, 449.6 tps, lat 332.829 ms stddev 757.640 2023-09-23T09:31:47.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:31:44 smithi135 ceph-mon[99205]: pgmap v1104: 97 pgs: 97 active+clean; 16 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 12 MiB/s wr, 1.00k op/s 2023-09-23T09:31:47.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:31:46 smithi135 ceph-mon[99205]: pgmap v1105: 97 pgs: 97 active+clean; 16 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 15 MiB/s wr, 1.30k op/s 2023-09-23T09:31:47.122 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:31:46 smithi082 ceph-mon[97694]: pgmap v1105: 97 pgs: 97 active+clean; 16 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 15 MiB/s wr, 1.30k op/s 2023-09-23T09:31:47.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:31:46 smithi161 ceph-mon[99580]: pgmap v1105: 97 pgs: 97 active+clean; 16 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 15 MiB/s wr, 1.30k op/s 2023-09-23T09:31:48.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:31:48 smithi161 ceph-mon[99580]: pgmap v1106: 97 pgs: 97 active+clean; 16 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 8.6 MiB/s wr, 746 op/s 2023-09-23T09:31:48.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:31:48 smithi135 ceph-mon[99205]: pgmap v1106: 97 pgs: 97 active+clean; 16 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 8.6 MiB/s wr, 746 op/s 2023-09-23T09:31:48.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:31:48 smithi082 ceph-mon[97694]: pgmap v1106: 97 pgs: 97 active+clean; 16 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 8.6 MiB/s wr, 746 op/s 2023-09-23T09:31:50.093 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:31:50.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.487+0000 7fe1e59ff700 1 -- 172.21.15.82:0/4049895217 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe1e010f440 msgr2=0x7fe1e010d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:31:50.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.487+0000 7fe1e59ff700 1 --2- 172.21.15.82:0/4049895217 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe1e010f440 0x7fe1e010d0a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe1d000b0a0 tx=0x7fe1d000b3b0 comp rx=0 tx=0).stop 2023-09-23T09:31:50.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.487+0000 7fe1e59ff700 1 -- 172.21.15.82:0/4049895217 shutdown_connections 2023-09-23T09:31:50.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.487+0000 7fe1e59ff700 1 --2- 172.21.15.82:0/4049895217 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1e011a100 0x7fe1e011c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:50.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.487+0000 7fe1e59ff700 1 --2- 172.21.15.82:0/4049895217 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1e010efd0 0x7fe1e010cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:50.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.487+0000 7fe1e59ff700 1 --2- 172.21.15.82:0/4049895217 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe1e010f440 0x7fe1e010d0a0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:50.490 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.487+0000 7fe1e59ff700 1 -- 172.21.15.82:0/4049895217 >> 172.21.15.82:0/4049895217 conn(0x7fe1e006cbe0 msgr2=0x7fe1e006cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:31:50.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.493+0000 7fe1e59ff700 1 -- 172.21.15.82:0/4049895217 shutdown_connections 2023-09-23T09:31:50.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.493+0000 7fe1e59ff700 1 -- 172.21.15.82:0/4049895217 wait complete. 2023-09-23T09:31:50.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.494+0000 7fe1e59ff700 1 Processor -- start 2023-09-23T09:31:50.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.494+0000 7fe1e59ff700 1 -- start start 2023-09-23T09:31:50.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.495+0000 7fe1e59ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1e010efd0 0x7fe1e01161a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:50.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.495+0000 7fe1e59ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1e010f440 0x7fe1e01166e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:50.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.495+0000 7fe1e59ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe1e011a100 0x7fe1e0111320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:50.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.495+0000 7fe1e59ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e01119d0 con 0x7fe1e010f440 2023-09-23T09:31:50.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.495+0000 7fe1e59ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e0111b40 con 0x7fe1e010efd0 2023-09-23T09:31:50.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.495+0000 7fe1e59ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e0111d00 con 0x7fe1e011a100 2023-09-23T09:31:50.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.495+0000 7fe1deffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1e010efd0 0x7fe1e01161a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:50.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.495+0000 7fe1deffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1e010efd0 0x7fe1e01161a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:37306/0 (socket says 172.21.15.82:37306) 2023-09-23T09:31:50.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.495+0000 7fe1deffd700 1 -- 172.21.15.82:0/2641716586 learned_addr learned my addr 172.21.15.82:0/2641716586 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:31:50.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.496+0000 7fe1deffd700 1 -- 172.21.15.82:0/2641716586 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe1e011a100 msgr2=0x7fe1e0111320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:31:50.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.496+0000 7fe1deffd700 1 --2- 172.21.15.82:0/2641716586 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe1e011a100 0x7fe1e0111320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:50.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.496+0000 7fe1deffd700 1 -- 172.21.15.82:0/2641716586 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1e010f440 msgr2=0x7fe1e01166e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:31:50.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.496+0000 7fe1deffd700 1 --2- 172.21.15.82:0/2641716586 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1e010f440 0x7fe1e01166e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:50.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.496+0000 7fe1deffd700 1 -- 172.21.15.82:0/2641716586 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1d0009d00 con 0x7fe1e010efd0 2023-09-23T09:31:50.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.496+0000 7fe1deffd700 1 --2- 172.21.15.82:0/2641716586 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1e010efd0 0x7fe1e01161a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fe1c800d950 tx=0x7fe1c800dd10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:31:50.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.497+0000 7fe1e49fd700 1 -- 172.21.15.82:0/2641716586 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c8009b40 con 0x7fe1e010efd0 2023-09-23T09:31:50.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.497+0000 7fe1e49fd700 1 -- 172.21.15.82:0/2641716586 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe1c8009ca0 con 0x7fe1e010efd0 2023-09-23T09:31:50.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.497+0000 7fe1e49fd700 1 -- 172.21.15.82:0/2641716586 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c800f620 con 0x7fe1e010efd0 2023-09-23T09:31:50.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.500+0000 7fe1e59ff700 1 -- 172.21.15.82:0/2641716586 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1e0111fe0 con 0x7fe1e010efd0 2023-09-23T09:31:50.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.501+0000 7fe1e59ff700 1 -- 172.21.15.82:0/2641716586 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1e01150e0 con 0x7fe1e010efd0 2023-09-23T09:31:50.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.509+0000 7fe1f9316b80 1 Processor -- start 2023-09-23T09:31:50.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.510+0000 7fe1f9316b80 1 -- start start 2023-09-23T09:31:50.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.510+0000 7fe1f9316b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56004d45d380 0x56004d45d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:50.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.510+0000 7fe1f9316b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56004d45dca0 0x56004d457700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:50.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.510+0000 7fe1f9316b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56004d457c40 0x56004d4580a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:50.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.510+0000 7fe1f9316b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56004d3bf7b0 con 0x56004d45dca0 2023-09-23T09:31:50.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.510+0000 7fe1f9316b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56004d3b0780 con 0x56004d457c40 2023-09-23T09:31:50.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.510+0000 7fe1f9316b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x56004d3ae0a0 con 0x56004d45d380 2023-09-23T09:31:50.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.512+0000 7fe1de7fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56004d457c40 0x56004d4580a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:50.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.512+0000 7fe1de7fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56004d457c40 0x56004d4580a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:37318/0 (socket says 172.21.15.82:37318) 2023-09-23T09:31:50.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.512+0000 7fe1de7fc700 1 -- 172.21.15.82:0/596371679 learned_addr learned my addr 172.21.15.82:0/596371679 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:31:50.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.513+0000 7fe1e49fd700 1 -- 172.21.15.82:0/2641716586 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7fe1c8010460 con 0x7fe1e010efd0 2023-09-23T09:31:50.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.513+0000 7fe1de7fc700 1 -- 172.21.15.82:0/596371679 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56004d45d380 msgr2=0x56004d45d760 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-23T09:31:50.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.513+0000 7fe1de7fc700 1 --2- 172.21.15.82:0/596371679 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56004d45d380 0x56004d45d760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:50.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.513+0000 7fe1de7fc700 1 -- 172.21.15.82:0/596371679 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56004d45dca0 msgr2=0x56004d457700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:31:50.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.513+0000 7fe1de7fc700 1 --2- 172.21.15.82:0/596371679 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56004d45dca0 0x56004d457700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:50.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.513+0000 7fe1de7fc700 1 -- 172.21.15.82:0/596371679 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56004d229630 con 0x56004d457c40 2023-09-23T09:31:50.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.514+0000 7fe1de7fc700 1 --2- 172.21.15.82:0/596371679 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56004d457c40 0x56004d4580a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fe1d0005b00 tx=0x7fe1d0005b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5c535e9559a8794 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:31:50.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.515+0000 7fe1d5ffb700 1 -- 172.21.15.82:0/596371679 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d000e040 con 0x56004d457c40 2023-09-23T09:31:50.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.515+0000 7fe1d5ffb700 1 -- 172.21.15.82:0/596371679 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe1d0003e90 con 0x56004d457c40 2023-09-23T09:31:50.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.515+0000 7fe1d5ffb700 1 -- 172.21.15.82:0/596371679 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d0005250 con 0x56004d457c40 2023-09-23T09:31:50.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.516+0000 7fe1f9316b80 1 -- 172.21.15.82:0/596371679 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56004d457c40 msgr2=0x56004d4580a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:31:50.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.516+0000 7fe1f9316b80 1 --2- 172.21.15.82:0/596371679 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56004d457c40 0x56004d4580a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fe1d0005b00 tx=0x7fe1d0005b30 comp rx=0 tx=0).stop 2023-09-23T09:31:50.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.516+0000 7fe1e49fd700 1 --2- 172.21.15.82:0/2641716586 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fe1cc0a0290 0x7fe1cc0a2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:50.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.517+0000 7fe1e49fd700 1 -- 172.21.15.82:0/2641716586 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fe1c80cb1c0 con 0x7fe1e010efd0 2023-09-23T09:31:50.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.517+0000 7fe1f9316b80 1 -- 172.21.15.82:0/596371679 shutdown_connections 2023-09-23T09:31:50.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.517+0000 7fe1f9316b80 1 --2- 172.21.15.82:0/596371679 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56004d457c40 0x56004d4580a0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:50.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.517+0000 7fe1f9316b80 1 --2- 172.21.15.82:0/596371679 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56004d45d380 0x56004d45d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:50.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.517+0000 7fe1f9316b80 1 --2- 172.21.15.82:0/596371679 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56004d45dca0 0x56004d457700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:50.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.518+0000 7fe1f9316b80 1 -- 172.21.15.82:0/596371679 >> 172.21.15.82:0/596371679 conn(0x56004d3cc0e0 msgr2=0x56004d452410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:31:50.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.518+0000 7fe1df7fe700 1 --2- 172.21.15.82:0/2641716586 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fe1cc0a0290 0x7fe1cc0a2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:50.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.519+0000 7fe1df7fe700 1 --2- 172.21.15.82:0/2641716586 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fe1cc0a0290 0x7fe1cc0a2750 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe1e0069c80 tx=0x7fe1d8006d70 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:31:50.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.519+0000 7fe1f9316b80 1 -- 172.21.15.82:0/596371679 shutdown_connections 2023-09-23T09:31:50.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.520+0000 7fe1f9316b80 1 -- 172.21.15.82:0/596371679 wait complete. 2023-09-23T09:31:50.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.520+0000 7fe1f9316b80 1 -- start start 2023-09-23T09:31:50.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.521+0000 7fe1f9316b80 1 Processor -- start 2023-09-23T09:31:50.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.522+0000 7fe1f9316b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56004d457c40 0x56004d463cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:50.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.522+0000 7fe1f9316b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56004d45d380 0x56004d460fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:50.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.522+0000 7fe1f9316b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56004d45dca0 0x56004d4616e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:50.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.522+0000 7fe1f9316b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56004d3a9990 con 0x56004d457c40 2023-09-23T09:31:50.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.522+0000 7fe1f9316b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56004d347bb0 con 0x56004d45dca0 2023-09-23T09:31:50.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.522+0000 7fe1f9316b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x56004d3478b0 con 0x56004d45d380 2023-09-23T09:31:50.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.522+0000 7fe1f9316b80 10 client.0 _ll_register_callbacks cb 0x56004d291a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:31:50.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.523+0000 7fe1de7fc700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56004d45d380 0x56004d460fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:50.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.523+0000 7fe1de7fc700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56004d45d380 0x56004d460fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:59152/0 (socket says 172.21.15.82:59152) 2023-09-23T09:31:50.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.523+0000 7fe1de7fc700 1 -- 172.21.15.82:0/4087053533 learned_addr learned my addr 172.21.15.82:0/4087053533 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:31:50.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.523+0000 7fe1deffd700 1 --2- 172.21.15.82:0/4087053533 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56004d457c40 0x56004d463cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:50.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.523+0000 7fe1df7fe700 1 --2- 172.21.15.82:0/4087053533 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56004d45dca0 0x56004d4616e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:50.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.524+0000 7fe1de7fc700 1 -- 172.21.15.82:0/4087053533 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56004d45dca0 msgr2=0x56004d4616e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:31:50.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.524+0000 7fe1de7fc700 1 --2- 172.21.15.82:0/4087053533 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56004d45dca0 0x56004d4616e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:50.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.524+0000 7fe1de7fc700 1 -- 172.21.15.82:0/4087053533 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56004d457c40 msgr2=0x56004d463cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:31:50.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.524+0000 7fe1de7fc700 1 --2- 172.21.15.82:0/4087053533 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56004d457c40 0x56004d463cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:50.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.524+0000 7fe1de7fc700 1 -- 172.21.15.82:0/4087053533 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1e011cdf0 con 0x56004d45d380 2023-09-23T09:31:50.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.524+0000 7fe1de7fc700 1 --2- 172.21.15.82:0/4087053533 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56004d45d380 0x56004d460fa0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe1d000d010 tx=0x7fe1d00095d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b41af61fdbc04b2f server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:31:50.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.525+0000 7fe1beffd700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T09:31:50.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.525+0000 7fe1beffd700 1 -- 172.21.15.82:0/4087053533 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d000e040 con 0x56004d45d380 2023-09-23T09:31:50.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.525+0000 7fe1beffd700 1 -- 172.21.15.82:0/4087053533 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(145..145 src has 1..145) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fe1d0005050 con 0x56004d45d380 2023-09-23T09:31:50.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.525+0000 7fe1f9316b80 1 -- 172.21.15.82:0/4087053533 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56004d4271c0 con 0x56004d45d380 2023-09-23T09:31:50.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.526+0000 7fe1beffd700 1 -- 172.21.15.82:0/4087053533 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe1d0003e90 con 0x56004d45d380 2023-09-23T09:31:50.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.526+0000 7fe1f9316b80 10 client.27550 fetch_fsmap learned FSMap version 102 2023-09-23T09:31:50.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.526+0000 7fe1f9316b80 1 -- 172.21.15.82:0/4087053533 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=4+}) v3 -- 0x56004d1d5de0 con 0x56004d45d380 2023-09-23T09:31:50.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.527+0000 7fe1beffd700 1 -- 172.21.15.82:0/4087053533 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56004d4271c0 con 0x56004d45d380 2023-09-23T09:31:50.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.527+0000 7fe1beffd700 1 -- 172.21.15.82:0/4087053533 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 102) v1 ==== 7954+0+0 (secure 0 0 0) 0x7fe1d0019070 con 0x56004d45d380 2023-09-23T09:31:50.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.527+0000 7fe1f9316b80 10 client.27550 fetch_fsmap finished waiting for FSMap version 102 2023-09-23T09:31:50.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.527+0000 7fe1f9316b80 10 client.27550 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:31:50.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.527+0000 7fe1f9316b80 20 client.27550 populate_metadata read hostname 'smithi082' 2023-09-23T09:31:50.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.527+0000 7fe1f9316b80 1 --2- 172.21.15.82:0/4087053533 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56004d471390 0x56004d4737b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:50.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.527+0000 7fe1f9316b80 4 client.27550 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:31:50.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.527+0000 7fe1f9316b80 1 -- 172.21.15.82:0/4087053533 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56004d34fba0 con 0x56004d471390 2023-09-23T09:31:50.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.528+0000 7fe1deffd700 1 --2- 172.21.15.82:0/4087053533 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56004d471390 0x56004d4737b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:50.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.528+0000 7fe1deffd700 1 --2- 172.21.15.82:0/4087053533 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56004d471390 0x56004d4737b0 crc :-1 s=READY pgs=231 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e171cbe66652144 server_cookie=3954cd45f78ee657 in_seq=0 out_seq=0 2023-09-23T09:31:50.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.528+0000 7fe1beffd700 10 client.27550 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:31:50.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.529+0000 7fe1beffd700 1 -- 172.21.15.82:0/4087053533 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56004d34fba0 con 0x56004d471390 2023-09-23T09:31:50.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.529+0000 7fe1beffd700 10 client.27550 handle_command_reply: tid=0 2023-09-23T09:31:50.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.529+0000 7fe1f9316b80 1 client.27550 shutdown 2023-09-23T09:31:50.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.532+0000 7fe1f9316b80 1 -- 172.21.15.82:0/4087053533 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56004d45d380 msgr2=0x56004d460fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:31:50.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.532+0000 7fe1f9316b80 1 --2- 172.21.15.82:0/4087053533 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56004d45d380 0x56004d460fa0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe1d000d010 tx=0x7fe1d00095d0 comp rx=0 tx=0).stop 2023-09-23T09:31:50.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.536+0000 7fe1f9316b80 1 -- 172.21.15.82:0/4087053533 shutdown_connections 2023-09-23T09:31:50.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.536+0000 7fe1f9316b80 1 --2- 172.21.15.82:0/4087053533 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56004d45dca0 0x56004d4616e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:50.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.536+0000 7fe1f9316b80 1 --2- 172.21.15.82:0/4087053533 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56004d471390 0x56004d4737b0 crc :-1 s=READY pgs=231 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:50.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.536+0000 7fe1f9316b80 1 --2- 172.21.15.82:0/4087053533 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56004d457c40 0x56004d463cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:50.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.536+0000 7fe1f9316b80 1 --2- 172.21.15.82:0/4087053533 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56004d45d380 0x56004d460fa0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:50.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.536+0000 7fe1f9316b80 1 -- 172.21.15.82:0/4087053533 >> 172.21.15.82:0/4087053533 conn(0x56004d3cc0e0 msgr2=0x56004d44cb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:31:50.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.536+0000 7fe1beffd700 0 client.27550 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:31:50.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.536+0000 7fe1f9316b80 1 -- 172.21.15.82:0/4087053533 shutdown_connections 2023-09-23T09:31:50.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.536+0000 7fe1f9316b80 1 -- 172.21.15.82:0/4087053533 wait complete. 2023-09-23T09:31:50.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.537+0000 7fe1f9316b80 20 client.27550 trim_cache size 0 max 16384 2023-09-23T09:31:50.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.565+0000 7fe1f9316b80 1 Processor -- start 2023-09-23T09:31:50.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.565+0000 7fe1f9316b80 1 -- start start 2023-09-23T09:31:50.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.566+0000 7fe1f9316b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56004d457c40 0x56004d457700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:50.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.566+0000 7fe1f9316b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56004d45d380 0x56004d452110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:50.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.566+0000 7fe1f9316b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56004d45dca0 0x56004d45b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:50.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.566+0000 7fe1f9316b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56004d22b920 con 0x56004d457c40 2023-09-23T09:31:50.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.566+0000 7fe1f9316b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56004d44a740 con 0x56004d45d380 2023-09-23T09:31:50.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.566+0000 7fe1f9316b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x56004d44e890 con 0x56004d45dca0 2023-09-23T09:31:50.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.567+0000 7fe1de7fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56004d45d380 0x56004d452110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:50.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.567+0000 7fe1de7fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56004d45d380 0x56004d452110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:37326/0 (socket says 172.21.15.82:37326) 2023-09-23T09:31:50.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.567+0000 7fe1de7fc700 1 -- 172.21.15.82:0/2929163200 learned_addr learned my addr 172.21.15.82:0/2929163200 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:31:50.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.567+0000 7fe1df7fe700 1 --2- 172.21.15.82:0/2929163200 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56004d45dca0 0x56004d45b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:50.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.568+0000 7fe1de7fc700 1 -- 172.21.15.82:0/2929163200 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56004d45dca0 msgr2=0x56004d45b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:31:50.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.568+0000 7fe1de7fc700 1 --2- 172.21.15.82:0/2929163200 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56004d45dca0 0x56004d45b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:50.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.568+0000 7fe1de7fc700 1 -- 172.21.15.82:0/2929163200 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56004d457c40 msgr2=0x56004d457700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:31:50.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.568+0000 7fe1de7fc700 1 --2- 172.21.15.82:0/2929163200 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56004d457c40 0x56004d457700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:50.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.568+0000 7fe1de7fc700 1 -- 172.21.15.82:0/2929163200 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56004d1bec60 con 0x56004d45d380 2023-09-23T09:31:50.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.568+0000 7fe1de7fc700 1 --2- 172.21.15.82:0/2929163200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56004d45d380 0x56004d452110 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe1d00077c0 tx=0x7fe1d0027fb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f27f12991f7ba0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:31:50.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.568+0000 7fe1d67fc700 1 -- 172.21.15.82:0/2929163200 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d000e040 con 0x56004d45d380 2023-09-23T09:31:50.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.569+0000 7fe1d67fc700 1 -- 172.21.15.82:0/2929163200 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe1d0026de0 con 0x56004d45d380 2023-09-23T09:31:50.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.569+0000 7fe1d67fc700 1 -- 172.21.15.82:0/2929163200 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d0024440 con 0x56004d45d380 2023-09-23T09:31:50.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.570+0000 7fe1f9316b80 1 -- 172.21.15.82:0/2929163200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56004d45d380 msgr2=0x56004d452110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:31:50.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.570+0000 7fe1f9316b80 1 --2- 172.21.15.82:0/2929163200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56004d45d380 0x56004d452110 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe1d00077c0 tx=0x7fe1d0027fb0 comp rx=0 tx=0).stop 2023-09-23T09:31:50.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.570+0000 7fe1f9316b80 1 -- 172.21.15.82:0/2929163200 shutdown_connections 2023-09-23T09:31:50.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.570+0000 7fe1f9316b80 1 --2- 172.21.15.82:0/2929163200 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56004d45dca0 0x56004d45b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:50.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.570+0000 7fe1f9316b80 1 --2- 172.21.15.82:0/2929163200 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56004d457c40 0x56004d457700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:50.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.570+0000 7fe1f9316b80 1 --2- 172.21.15.82:0/2929163200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56004d45d380 0x56004d452110 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:50.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.570+0000 7fe1f9316b80 1 -- 172.21.15.82:0/2929163200 >> 172.21.15.82:0/2929163200 conn(0x56004d3cc0e0 msgr2=0x56004d46cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:31:50.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.570+0000 7fe1f9316b80 1 -- 172.21.15.82:0/2929163200 shutdown_connections 2023-09-23T09:31:50.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.570+0000 7fe1f9316b80 1 -- 172.21.15.82:0/2929163200 wait complete. 2023-09-23T09:31:50.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.571+0000 7fe1f9316b80 1 -- start start 2023-09-23T09:31:50.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.571+0000 7fe1f9316b80 1 Processor -- start 2023-09-23T09:31:50.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.572+0000 7fe1f9316b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56004d457c40 0x56004d4687a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:50.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.572+0000 7fe1f9316b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56004d45d380 0x56004d466780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:50.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.572+0000 7fe1f9316b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56004d45dca0 0x56004d466cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:50.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.572+0000 7fe1f9316b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56004d4672a0 con 0x56004d457c40 2023-09-23T09:31:50.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.572+0000 7fe1f9316b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56004d4673e0 con 0x56004d45d380 2023-09-23T09:31:50.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.572+0000 7fe1f9316b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x56004d4675a0 con 0x56004d45dca0 2023-09-23T09:31:50.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.572+0000 7fe1f9316b80 10 client.0 _ll_register_callbacks cb 0x7fe1d0009f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:31:50.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.573+0000 7fe1deffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56004d457c40 0x56004d4687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:50.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.573+0000 7fe1df7fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56004d45dca0 0x56004d466cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:50.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.573+0000 7fe1de7fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56004d45d380 0x56004d466780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:50.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.573+0000 7fe1deffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56004d457c40 0x56004d4687a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47958/0 (socket says 172.21.15.82:47958) 2023-09-23T09:31:50.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.573+0000 7fe1deffd700 1 -- 172.21.15.82:0/3154897262 learned_addr learned my addr 172.21.15.82:0/3154897262 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:31:50.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.574+0000 7fe1deffd700 1 -- 172.21.15.82:0/3154897262 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56004d45dca0 msgr2=0x56004d466cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:31:50.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.574+0000 7fe1deffd700 1 --2- 172.21.15.82:0/3154897262 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56004d45dca0 0x56004d466cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:50.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.574+0000 7fe1deffd700 1 -- 172.21.15.82:0/3154897262 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56004d45d380 msgr2=0x56004d466780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:31:50.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.574+0000 7fe1deffd700 1 --2- 172.21.15.82:0/3154897262 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56004d45d380 0x56004d466780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:50.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.574+0000 7fe1deffd700 1 -- 172.21.15.82:0/3154897262 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56004d1d5de0 con 0x56004d457c40 2023-09-23T09:31:50.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.574+0000 7fe1de7fc700 1 --2- 172.21.15.82:0/3154897262 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56004d45d380 0x56004d466780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:31:50.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.574+0000 7fe1deffd700 1 --2- 172.21.15.82:0/3154897262 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56004d457c40 0x56004d4687a0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fe1c8094d70 tx=0x7fe1c8094bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23270e41a5964aca server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:31:50.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.574+0000 7fe1beffd700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:31:50.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.574+0000 7fe1beffd700 1 -- 172.21.15.82:0/3154897262 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c8014040 con 0x56004d457c40 2023-09-23T09:31:50.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.574+0000 7fe1beffd700 1 -- 172.21.15.82:0/3154897262 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(145..145 src has 1..145) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fe1c8098870 con 0x56004d457c40 2023-09-23T09:31:50.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.575+0000 7fe1f9316b80 1 -- 172.21.15.82:0/3154897262 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56004d44a8b0 con 0x56004d457c40 2023-09-23T09:31:50.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.575+0000 7fe1beffd700 1 -- 172.21.15.82:0/3154897262 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe1c809c6a0 con 0x56004d457c40 2023-09-23T09:31:50.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.575+0000 7fe1f9316b80 10 client.17814 fetch_fsmap learned FSMap version 102 2023-09-23T09:31:50.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.575+0000 7fe1f9316b80 1 -- 172.21.15.82:0/3154897262 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=4+}) v3 -- 0x56004d1fc250 con 0x56004d457c40 2023-09-23T09:31:50.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.576+0000 7fe1beffd700 1 -- 172.21.15.82:0/3154897262 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56004d44a8b0 con 0x56004d457c40 2023-09-23T09:31:50.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.576+0000 7fe1beffd700 1 -- 172.21.15.82:0/3154897262 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 102) v1 ==== 7954+0+0 (secure 0 0 0) 0x7fe1c8097df0 con 0x56004d457c40 2023-09-23T09:31:50.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.577+0000 7fe1f9316b80 10 client.17814 fetch_fsmap finished waiting for FSMap version 102 2023-09-23T09:31:50.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.577+0000 7fe1f9316b80 10 client.17814 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:31:50.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.577+0000 7fe1f9316b80 20 client.17814 populate_metadata read hostname 'smithi082' 2023-09-23T09:31:50.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.577+0000 7fe1f9316b80 1 --2- 172.21.15.82:0/3154897262 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56004d4c56e0 0x56004d4c7b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:31:50.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.577+0000 7fe1f9316b80 4 client.17814 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:31:50.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.577+0000 7fe1f9316b80 1 -- 172.21.15.82:0/3154897262 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x56004d3a2970 con 0x56004d4c56e0 2023-09-23T09:31:50.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.577+0000 7fe1de7fc700 1 --2- 172.21.15.82:0/3154897262 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56004d4c56e0 0x56004d4c7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:31:50.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.578+0000 7fe1de7fc700 1 --2- 172.21.15.82:0/3154897262 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56004d4c56e0 0x56004d4c7b00 crc :-1 s=READY pgs=232 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3da0dfe023115ae9 server_cookie=1be093cc7a8cbcdc in_seq=0 out_seq=0 2023-09-23T09:31:50.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.578+0000 7fe1beffd700 10 client.17814 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:31:50.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.579+0000 7fe1beffd700 1 -- 172.21.15.82:0/3154897262 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x56004d3a2970 con 0x56004d4c56e0 2023-09-23T09:31:50.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.579+0000 7fe1beffd700 10 client.17814 handle_command_reply: tid=0 2023-09-23T09:31:50.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.579+0000 7fe1f9316b80 1 client.17814 shutdown 2023-09-23T09:31:50.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.579+0000 7fe1f9316b80 1 -- 172.21.15.82:0/3154897262 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56004d457c40 msgr2=0x56004d4687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:31:50.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.579+0000 7fe1f9316b80 1 --2- 172.21.15.82:0/3154897262 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56004d457c40 0x56004d4687a0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fe1c8094d70 tx=0x7fe1c8094bb0 comp rx=0 tx=0).stop 2023-09-23T09:31:50.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.581+0000 7fe1f9316b80 1 -- 172.21.15.82:0/3154897262 shutdown_connections 2023-09-23T09:31:50.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.581+0000 7fe1f9316b80 1 --2- 172.21.15.82:0/3154897262 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56004d45dca0 0x56004d466cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:50.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.581+0000 7fe1f9316b80 1 --2- 172.21.15.82:0/3154897262 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56004d4c56e0 0x56004d4c7b00 crc :-1 s=READY pgs=232 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:50.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.582+0000 7fe1f9316b80 1 --2- 172.21.15.82:0/3154897262 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56004d457c40 0x56004d4687a0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:50.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.582+0000 7fe1f9316b80 1 --2- 172.21.15.82:0/3154897262 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56004d45d380 0x56004d466780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:50.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.582+0000 7fe1f9316b80 1 -- 172.21.15.82:0/3154897262 >> 172.21.15.82:0/3154897262 conn(0x56004d3cc0e0 msgr2=0x56004d4520a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:31:50.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.582+0000 7fe1beffd700 0 client.17814 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:31:50.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.584+0000 7fe1f9316b80 1 -- 172.21.15.82:0/3154897262 shutdown_connections 2023-09-23T09:31:50.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.584+0000 7fe1f9316b80 1 -- 172.21.15.82:0/3154897262 wait complete. 2023-09-23T09:31:50.598 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:31:50.598 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-23T09:31:50.599 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:31:50.599 INFO:teuthology.orchestra.run.smithi082.stdout: "2aec802a-e2df-49b3-a22a-82c491ba0c59": { 2023-09-23T09:31:50.599 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:31:50.599 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "2aec802a-e2df-49b3-a22a-82c491ba0c59", 2023-09-23T09:31:50.599 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:31:50.599 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:31:50.599 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:31:50.599 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:31:50.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.589+0000 7fe1f9316b80 20 client.17814 trim_cache size 0 max 16384 2023-09-23T09:31:50.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.601+0000 7fe1e59ff700 1 -- 172.21.15.82:0/2641716586 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fe1cc0a0290 msgr2=0x7fe1cc0a2750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:31:50.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.601+0000 7fe1e59ff700 1 --2- 172.21.15.82:0/2641716586 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fe1cc0a0290 0x7fe1cc0a2750 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe1e0069c80 tx=0x7fe1d8006d70 comp rx=0 tx=0).stop 2023-09-23T09:31:50.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.601+0000 7fe1e59ff700 1 -- 172.21.15.82:0/2641716586 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1e010efd0 msgr2=0x7fe1e01161a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:31:50.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.601+0000 7fe1e59ff700 1 --2- 172.21.15.82:0/2641716586 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1e010efd0 0x7fe1e01161a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fe1c800d950 tx=0x7fe1c800dd10 comp rx=0 tx=0).stop 2023-09-23T09:31:50.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.604+0000 7fe1e59ff700 1 -- 172.21.15.82:0/2641716586 shutdown_connections 2023-09-23T09:31:50.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.604+0000 7fe1e59ff700 1 --2- 172.21.15.82:0/2641716586 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fe1cc0a0290 0x7fe1cc0a2750 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:50.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.604+0000 7fe1e59ff700 1 --2- 172.21.15.82:0/2641716586 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe1e011a100 0x7fe1e0111320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:50.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.604+0000 7fe1e59ff700 1 --2- 172.21.15.82:0/2641716586 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1e010efd0 0x7fe1e01161a0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:50.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.604+0000 7fe1e59ff700 1 --2- 172.21.15.82:0/2641716586 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1e010f440 0x7fe1e01166e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:31:50.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.604+0000 7fe1e59ff700 1 -- 172.21.15.82:0/2641716586 >> 172.21.15.82:0/2641716586 conn(0x7fe1e006cbe0 msgr2=0x7fe1e006f2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:31:50.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.605+0000 7fe1e59ff700 1 -- 172.21.15.82:0/2641716586 shutdown_connections 2023-09-23T09:31:50.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:31:50.605+0000 7fe1e59ff700 1 -- 172.21.15.82:0/2641716586 wait complete. 2023-09-23T09:31:50.640 INFO:tasks.cephfs.filesystem:scrub status for tag:2aec802a-e2df-49b3-a22a-82c491ba0c59 - {'path': '/', 'tag': '2aec802a-e2df-49b3-a22a-82c491ba0c59', 'options': 'recursive,force'} 2023-09-23T09:31:50.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 280.0 s, 461.8 tps, lat 135.714 ms stddev 100.968 2023-09-23T09:31:51.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:31:50 smithi135 ceph-mon[99205]: pgmap v1107: 97 pgs: 97 active+clean; 17 GiB data, 59 GiB used, 1013 GiB / 1.0 TiB avail; 3.0 MiB/s rd, 14 MiB/s wr, 1.25k op/s 2023-09-23T09:31:51.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:31:50 smithi082 ceph-mon[97694]: pgmap v1107: 97 pgs: 97 active+clean; 17 GiB data, 59 GiB used, 1013 GiB / 1.0 TiB avail; 3.0 MiB/s rd, 14 MiB/s wr, 1.25k op/s 2023-09-23T09:31:51.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:31:50 smithi161 ceph-mon[99580]: pgmap v1107: 97 pgs: 97 active+clean; 17 GiB data, 59 GiB used, 1013 GiB / 1.0 TiB avail; 3.0 MiB/s rd, 14 MiB/s wr, 1.25k op/s 2023-09-23T09:31:52.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:31:51 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:31:52.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:31:51 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:31:52.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:31:51 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:31:53.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:31:52 smithi135 ceph-mon[99205]: pgmap v1108: 97 pgs: 97 active+clean; 17 GiB data, 59 GiB used, 1013 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 10 MiB/s wr, 932 op/s 2023-09-23T09:31:53.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:31:52 smithi082 ceph-mon[97694]: pgmap v1108: 97 pgs: 97 active+clean; 17 GiB data, 59 GiB used, 1013 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 10 MiB/s wr, 932 op/s 2023-09-23T09:31:53.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:31:52 smithi161 ceph-mon[99580]: pgmap v1108: 97 pgs: 97 active+clean; 17 GiB data, 59 GiB used, 1013 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 10 MiB/s wr, 932 op/s 2023-09-23T09:31:55.064 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:31:54 smithi135 ceph-mon[99205]: pgmap v1109: 97 pgs: 97 active+clean; 17 GiB data, 59 GiB used, 1013 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 9.8 MiB/s wr, 875 op/s 2023-09-23T09:31:55.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:31:54 smithi082 ceph-mon[97694]: pgmap v1109: 97 pgs: 97 active+clean; 17 GiB data, 59 GiB used, 1013 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 9.8 MiB/s wr, 875 op/s 2023-09-23T09:31:55.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:31:54 smithi161 ceph-mon[99580]: pgmap v1109: 97 pgs: 97 active+clean; 17 GiB data, 59 GiB used, 1013 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 9.8 MiB/s wr, 875 op/s 2023-09-23T09:31:55.827 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 285.0 s, 524.2 tps, lat 271.709 ms stddev 869.911 2023-09-23T09:31:57.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:31:56 smithi135 ceph-mon[99205]: pgmap v1110: 97 pgs: 97 active+clean; 17 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 3.5 MiB/s rd, 16 MiB/s wr, 1.46k op/s 2023-09-23T09:31:57.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:31:56 smithi082 ceph-mon[97694]: pgmap v1110: 97 pgs: 97 active+clean; 17 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 3.5 MiB/s rd, 16 MiB/s wr, 1.46k op/s 2023-09-23T09:31:57.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:31:56 smithi161 ceph-mon[99580]: pgmap v1110: 97 pgs: 97 active+clean; 17 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 3.5 MiB/s rd, 16 MiB/s wr, 1.46k op/s 2023-09-23T09:31:58.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:31:58 smithi161 ceph-mon[99580]: pgmap v1111: 97 pgs: 97 active+clean; 17 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 13 MiB/s wr, 1.16k op/s 2023-09-23T09:31:58.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:31:58 smithi135 ceph-mon[99205]: pgmap v1111: 97 pgs: 97 active+clean; 17 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 13 MiB/s wr, 1.16k op/s 2023-09-23T09:31:58.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:31:58 smithi082 ceph-mon[97694]: pgmap v1111: 97 pgs: 97 active+clean; 17 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 13 MiB/s wr, 1.16k op/s 2023-09-23T09:32:00.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 290.0 s, 492.6 tps, lat 202.119 ms stddev 98.361 2023-09-23T09:32:01.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:32:00 smithi135 ceph-mon[99205]: pgmap v1112: 97 pgs: 97 active+clean; 17 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 4.0 MiB/s rd, 18 MiB/s wr, 1.67k op/s 2023-09-23T09:32:01.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:32:00 smithi082 ceph-mon[97694]: pgmap v1112: 97 pgs: 97 active+clean; 17 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 4.0 MiB/s rd, 18 MiB/s wr, 1.67k op/s 2023-09-23T09:32:01.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:32:00 smithi161 ceph-mon[99580]: pgmap v1112: 97 pgs: 97 active+clean; 17 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 4.0 MiB/s rd, 18 MiB/s wr, 1.67k op/s 2023-09-23T09:32:03.064 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:32:02 smithi135 ceph-mon[99205]: pgmap v1113: 97 pgs: 97 active+clean; 17 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 3.0 MiB/s rd, 13 MiB/s wr, 1.25k op/s 2023-09-23T09:32:03.065 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:32:02 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:32:03.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:32:02 smithi082 ceph-mon[97694]: pgmap v1113: 97 pgs: 97 active+clean; 17 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 3.0 MiB/s rd, 13 MiB/s wr, 1.25k op/s 2023-09-23T09:32:03.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:32:02 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:32:03.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:32:02 smithi161 ceph-mon[99580]: pgmap v1113: 97 pgs: 97 active+clean; 17 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 3.0 MiB/s rd, 13 MiB/s wr, 1.25k op/s 2023-09-23T09:32:03.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:32:02 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:32:05.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:32:04 smithi135 ceph-mon[99205]: pgmap v1114: 97 pgs: 97 active+clean; 17 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 2.8 MiB/s rd, 13 MiB/s wr, 1.17k op/s 2023-09-23T09:32:05.122 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:32:04 smithi082 ceph-mon[97694]: pgmap v1114: 97 pgs: 97 active+clean; 17 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 2.8 MiB/s rd, 13 MiB/s wr, 1.17k op/s 2023-09-23T09:32:05.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:32:04 smithi161 ceph-mon[99580]: pgmap v1114: 97 pgs: 97 active+clean; 17 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 2.8 MiB/s rd, 13 MiB/s wr, 1.17k op/s 2023-09-23T09:32:05.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 295.0 s, 440.6 tps, lat 224.603 ms stddev 167.033 2023-09-23T09:32:07.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:32:06 smithi135 ceph-mon[99205]: pgmap v1115: 97 pgs: 97 active+clean; 17 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 4.1 MiB/s rd, 18 MiB/s wr, 1.65k op/s 2023-09-23T09:32:07.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:32:06 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:32:07.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:32:06 smithi082 ceph-mon[97694]: pgmap v1115: 97 pgs: 97 active+clean; 17 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 4.1 MiB/s rd, 18 MiB/s wr, 1.65k op/s 2023-09-23T09:32:07.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:32:06 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:32:07.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:32:06 smithi161 ceph-mon[99580]: pgmap v1115: 97 pgs: 97 active+clean; 17 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 4.1 MiB/s rd, 18 MiB/s wr, 1.65k op/s 2023-09-23T09:32:07.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:32:06 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:32:08.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:32:07 smithi135 ceph-mon[99205]: osdmap e146: 12 total, 12 up, 12 in 2023-09-23T09:32:08.122 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:32:07 smithi082 ceph-mon[97694]: osdmap e146: 12 total, 12 up, 12 in 2023-09-23T09:32:08.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:32:07 smithi161 ceph-mon[99580]: osdmap e146: 12 total, 12 up, 12 in 2023-09-23T09:32:09.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:32:08 smithi135 ceph-mon[99205]: pgmap v1117: 97 pgs: 97 active+clean; 17 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 3.3 MiB/s rd, 14 MiB/s wr, 1.28k op/s 2023-09-23T09:32:09.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:32:08 smithi082 ceph-mon[97694]: pgmap v1117: 97 pgs: 97 active+clean; 17 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 3.3 MiB/s rd, 14 MiB/s wr, 1.28k op/s 2023-09-23T09:32:09.150 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:32:08 smithi161 ceph-mon[99580]: pgmap v1117: 97 pgs: 97 active+clean; 17 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 3.3 MiB/s rd, 14 MiB/s wr, 1.28k op/s 2023-09-23T09:32:10.830 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 300.0 s, 355.1 tps, lat 283.771 ms stddev 207.363 2023-09-23T09:32:11.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:32:10 smithi135 ceph-mon[99205]: pgmap v1118: 97 pgs: 97 active+clean; 17 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 12 MiB/s wr, 1.05k op/s 2023-09-23T09:32:11.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:32:10 smithi082 ceph-mon[97694]: pgmap v1118: 97 pgs: 97 active+clean; 17 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 12 MiB/s wr, 1.05k op/s 2023-09-23T09:32:11.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:32:10 smithi161 ceph-mon[99580]: pgmap v1118: 97 pgs: 97 active+clean; 17 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 12 MiB/s wr, 1.05k op/s 2023-09-23T09:32:12.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:32:11 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:32:12.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:32:11 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:32:12.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:32:11 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:32:13.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:32:12 smithi082 ceph-mon[97694]: pgmap v1119: 97 pgs: 97 active+clean; 17 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 11 MiB/s wr, 1.02k op/s 2023-09-23T09:32:13.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:32:12 smithi082 ceph-mon[97694]: osdmap e147: 12 total, 12 up, 12 in 2023-09-23T09:32:13.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:32:12 smithi161 ceph-mon[99580]: pgmap v1119: 97 pgs: 97 active+clean; 17 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 11 MiB/s wr, 1.02k op/s 2023-09-23T09:32:13.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:32:12 smithi161 ceph-mon[99580]: osdmap e147: 12 total, 12 up, 12 in 2023-09-23T09:32:13.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:32:12 smithi135 ceph-mon[99205]: pgmap v1119: 97 pgs: 97 active+clean; 17 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 11 MiB/s wr, 1.02k op/s 2023-09-23T09:32:13.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:32:12 smithi135 ceph-mon[99205]: osdmap e147: 12 total, 12 up, 12 in 2023-09-23T09:32:15.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:32:14 smithi082 ceph-mon[97694]: pgmap v1121: 97 pgs: 97 active+clean; 17 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 1.4 MiB/s rd, 5.9 MiB/s wr, 555 op/s 2023-09-23T09:32:15.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:32:14 smithi161 ceph-mon[99580]: pgmap v1121: 97 pgs: 97 active+clean; 17 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 1.4 MiB/s rd, 5.9 MiB/s wr, 555 op/s 2023-09-23T09:32:15.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:32:14 smithi135 ceph-mon[99205]: pgmap v1121: 97 pgs: 97 active+clean; 17 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 1.4 MiB/s rd, 5.9 MiB/s wr, 555 op/s 2023-09-23T09:32:15.828 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 305.0 s, 243.7 tps, lat 228.123 ms stddev 120.288 2023-09-23T09:32:17.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:32:16 smithi082 ceph-mon[97694]: pgmap v1122: 97 pgs: 97 active+clean; 17 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 12 MiB/s wr, 1.19k op/s 2023-09-23T09:32:17.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:32:16 smithi161 ceph-mon[99580]: pgmap v1122: 97 pgs: 97 active+clean; 17 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 12 MiB/s wr, 1.19k op/s 2023-09-23T09:32:17.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:32:16 smithi135 ceph-mon[99205]: pgmap v1122: 97 pgs: 97 active+clean; 17 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 12 MiB/s wr, 1.19k op/s 2023-09-23T09:32:18.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:32:18 smithi161 ceph-mon[99580]: pgmap v1123: 97 pgs: 97 active+clean; 17 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.4 MiB/s rd, 11 MiB/s wr, 1.06k op/s 2023-09-23T09:32:18.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:32:18 smithi135 ceph-mon[99205]: pgmap v1123: 97 pgs: 97 active+clean; 17 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.4 MiB/s rd, 11 MiB/s wr, 1.06k op/s 2023-09-23T09:32:18.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:32:18 smithi082 ceph-mon[97694]: pgmap v1123: 97 pgs: 97 active+clean; 17 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.4 MiB/s rd, 11 MiB/s wr, 1.06k op/s 2023-09-23T09:32:20.641 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:32:20.829 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 310.0 s, 232.6 tps, lat 400.566 ms stddev 830.687 2023-09-23T09:32:20.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.849+0000 7ffa8cdff700 1 -- 172.21.15.82:0/3412880119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa88100890 msgr2=0x7ffa88100d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:32:20.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.849+0000 7ffa8cdff700 1 --2- 172.21.15.82:0/3412880119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa88100890 0x7ffa88100d10 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7ffa70009990 tx=0x7ffa70009ca0 comp rx=0 tx=0).stop 2023-09-23T09:32:20.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.849+0000 7ffa8cdff700 1 -- 172.21.15.82:0/3412880119 shutdown_connections 2023-09-23T09:32:20.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.849+0000 7ffa8cdff700 1 --2- 172.21.15.82:0/3412880119 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffa88101250 0x7ffa8810d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:32:20.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.849+0000 7ffa8cdff700 1 --2- 172.21.15.82:0/3412880119 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa881068a0 0x7ffa88106c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:32:20.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.849+0000 7ffa8cdff700 1 --2- 172.21.15.82:0/3412880119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa88100890 0x7ffa88100d10 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:32:20.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.849+0000 7ffa8cdff700 1 -- 172.21.15.82:0/3412880119 >> 172.21.15.82:0/3412880119 conn(0x7ffa880fc380 msgr2=0x7ffa880fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:32:20.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.849+0000 7ffa8cdff700 1 -- 172.21.15.82:0/3412880119 shutdown_connections 2023-09-23T09:32:20.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.849+0000 7ffa8cdff700 1 -- 172.21.15.82:0/3412880119 wait complete. 2023-09-23T09:32:20.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.850+0000 7ffa8cdff700 1 Processor -- start 2023-09-23T09:32:20.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.850+0000 7ffa8cdff700 1 -- start start 2023-09-23T09:32:20.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.850+0000 7ffa8cdff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffa88100890 0x7ffa8819c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:32:20.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.850+0000 7ffa8cdff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa88101250 0x7ffa8819cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:32:20.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.850+0000 7ffa8cdff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa881068a0 0x7ffa88196760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:32:20.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.850+0000 7ffa8cdff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa88196dd0 con 0x7ffa881068a0 2023-09-23T09:32:20.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.850+0000 7ffa8cdff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa88196f40 con 0x7ffa88101250 2023-09-23T09:32:20.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.851+0000 7ffa8cdff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa88197100 con 0x7ffa88100890 2023-09-23T09:32:20.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.851+0000 7ffa8659c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffa88100890 0x7ffa8819c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:32:20.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.851+0000 7ffa86d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa881068a0 0x7ffa88196760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:32:20.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.851+0000 7ffa8659c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffa88100890 0x7ffa8819c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:48762/0 (socket says 172.21.15.82:48762) 2023-09-23T09:32:20.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.851+0000 7ffa8659c700 1 -- 172.21.15.82:0/1949049844 learned_addr learned my addr 172.21.15.82:0/1949049844 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:32:20.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.851+0000 7ffa7ffff700 1 --2- 172.21.15.82:0/1949049844 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa88101250 0x7ffa8819cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:32:20.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.851+0000 7ffa86d9d700 1 -- 172.21.15.82:0/1949049844 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffa88100890 msgr2=0x7ffa8819c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:32:20.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.851+0000 7ffa86d9d700 1 --2- 172.21.15.82:0/1949049844 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffa88100890 0x7ffa8819c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:32:20.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.851+0000 7ffa86d9d700 1 -- 172.21.15.82:0/1949049844 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa88101250 msgr2=0x7ffa8819cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:32:20.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.851+0000 7ffa86d9d700 1 --2- 172.21.15.82:0/1949049844 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa88101250 0x7ffa8819cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:32:20.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.851+0000 7ffa86d9d700 1 -- 172.21.15.82:0/1949049844 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa700095f0 con 0x7ffa881068a0 2023-09-23T09:32:20.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.851+0000 7ffa8659c700 1 --2- 172.21.15.82:0/1949049844 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffa88100890 0x7ffa8819c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:32:20.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.851+0000 7ffa7ffff700 1 --2- 172.21.15.82:0/1949049844 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa88101250 0x7ffa8819cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:32:20.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.851+0000 7ffa86d9d700 1 --2- 172.21.15.82:0/1949049844 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa881068a0 0x7ffa88196760 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7ffa8000efc0 tx=0x7ffa8000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:32:20.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.852+0000 7ffa7f7fe700 1 -- 172.21.15.82:0/1949049844 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa80018070 con 0x7ffa881068a0 2023-09-23T09:32:20.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.852+0000 7ffa7f7fe700 1 -- 172.21.15.82:0/1949049844 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ffa8000f040 con 0x7ffa881068a0 2023-09-23T09:32:20.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.852+0000 7ffa8cdff700 1 -- 172.21.15.82:0/1949049844 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa88197380 con 0x7ffa881068a0 2023-09-23T09:32:20.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.852+0000 7ffa7f7fe700 1 -- 172.21.15.82:0/1949049844 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa8000cba0 con 0x7ffa881068a0 2023-09-23T09:32:20.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.852+0000 7ffa8cdff700 1 -- 172.21.15.82:0/1949049844 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa881a36e0 con 0x7ffa881068a0 2023-09-23T09:32:20.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.855+0000 7ffa7f7fe700 1 -- 172.21.15.82:0/1949049844 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7ffa80003a00 con 0x7ffa881068a0 2023-09-23T09:32:20.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.856+0000 7ffaa06d0b80 1 Processor -- start 2023-09-23T09:32:20.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.856+0000 7ffaa06d0b80 1 -- start start 2023-09-23T09:32:20.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.856+0000 7ffa7f7fe700 1 --2- 172.21.15.82:0/1949049844 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7ffa740a00c0 0x7ffa740a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:32:20.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.857+0000 7ffa7f7fe700 1 -- 172.21.15.82:0/1949049844 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 8513+0+0 (secure 0 0 0) 0x7ffa800cb160 con 0x7ffa881068a0 2023-09-23T09:32:20.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.857+0000 7ffaa06d0b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558a75bf4790 0x558a75bf4b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:32:20.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.857+0000 7ffaa06d0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a75bf50b0 0x558a75beeb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:32:20.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.857+0000 7ffaa06d0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558a75bef050 0x558a75bef4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:32:20.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.857+0000 7ffaa06d0b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a75b527b0 con 0x558a75bef050 2023-09-23T09:32:20.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.857+0000 7ffaa06d0b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a75b43780 con 0x558a75bf50b0 2023-09-23T09:32:20.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.857+0000 7ffaa06d0b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a75b410a0 con 0x558a75bf4790 2023-09-23T09:32:20.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.857+0000 7ffa7ffff700 1 --2- 172.21.15.82:0/1949049844 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7ffa740a00c0 0x7ffa740a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:32:20.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.857+0000 7ffa8659c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558a75bf4790 0x558a75bf4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:32:20.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.857+0000 7ffa86d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558a75bef050 0x558a75bef4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:32:20.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.857+0000 7ffa7ffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a75bf50b0 0x558a75beeb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:32:20.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.857+0000 7ffa8659c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558a75bf4790 0x558a75bf4b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:48772/0 (socket says 172.21.15.82:48772) 2023-09-23T09:32:20.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.857+0000 7ffa8659c700 1 -- 172.21.15.82:0/1409925481 learned_addr learned my addr 172.21.15.82:0/1409925481 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:32:20.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.858+0000 7ffa8659c700 1 -- 172.21.15.82:0/1409925481 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a75bf50b0 msgr2=0x558a75beeb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:32:20.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.858+0000 7ffa8659c700 1 --2- 172.21.15.82:0/1409925481 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a75bf50b0 0x558a75beeb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:32:20.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.858+0000 7ffa8659c700 1 -- 172.21.15.82:0/1409925481 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558a75bef050 msgr2=0x558a75bef4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:32:20.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.858+0000 7ffa8659c700 1 --2- 172.21.15.82:0/1409925481 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558a75bef050 0x558a75bef4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:32:20.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.858+0000 7ffa8659c700 1 -- 172.21.15.82:0/1409925481 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558a759bc630 con 0x558a75bf4790 2023-09-23T09:32:20.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.858+0000 7ffa7ffff700 1 --2- 172.21.15.82:0/1409925481 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a75bf50b0 0x558a75beeb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:32:20.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.858+0000 7ffa86d9d700 1 --2- 172.21.15.82:0/1409925481 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558a75bef050 0x558a75bef4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:32:20.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.858+0000 7ffa7ffff700 1 --2- 172.21.15.82:0/1949049844 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7ffa740a00c0 0x7ffa740a2580 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ffa88197bd0 tx=0x7ffa7000bc20 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:32:20.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.858+0000 7ffa8659c700 1 --2- 172.21.15.82:0/1409925481 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558a75bf4790 0x558a75bf4b70 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ffa78011650 tx=0x7ffa78011960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4cbae8c65326322f server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:32:20.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.858+0000 7ffa7cff9700 1 -- 172.21.15.82:0/1409925481 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa78019630 con 0x558a75bf4790 2023-09-23T09:32:20.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.858+0000 7ffa7cff9700 1 -- 172.21.15.82:0/1409925481 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ffa78019c20 con 0x558a75bf4790 2023-09-23T09:32:20.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.858+0000 7ffa7cff9700 1 -- 172.21.15.82:0/1409925481 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7800ea60 con 0x558a75bf4790 2023-09-23T09:32:20.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.859+0000 7ffaa06d0b80 1 -- 172.21.15.82:0/1409925481 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558a75bf4790 msgr2=0x558a75bf4b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:32:20.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.859+0000 7ffaa06d0b80 1 --2- 172.21.15.82:0/1409925481 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558a75bf4790 0x558a75bf4b70 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ffa78011650 tx=0x7ffa78011960 comp rx=0 tx=0).stop 2023-09-23T09:32:20.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.859+0000 7ffaa06d0b80 1 -- 172.21.15.82:0/1409925481 shutdown_connections 2023-09-23T09:32:20.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.859+0000 7ffaa06d0b80 1 --2- 172.21.15.82:0/1409925481 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558a75bef050 0x558a75bef4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:32:20.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.859+0000 7ffaa06d0b80 1 --2- 172.21.15.82:0/1409925481 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558a75bf4790 0x558a75bf4b70 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:32:20.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.859+0000 7ffaa06d0b80 1 --2- 172.21.15.82:0/1409925481 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a75bf50b0 0x558a75beeb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:32:20.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.859+0000 7ffaa06d0b80 1 -- 172.21.15.82:0/1409925481 >> 172.21.15.82:0/1409925481 conn(0x558a75b5f0e0 msgr2=0x558a75be5410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:32:20.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.859+0000 7ffaa06d0b80 1 -- 172.21.15.82:0/1409925481 shutdown_connections 2023-09-23T09:32:20.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.859+0000 7ffaa06d0b80 1 -- 172.21.15.82:0/1409925481 wait complete. 2023-09-23T09:32:20.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.860+0000 7ffaa06d0b80 1 -- start start 2023-09-23T09:32:20.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.860+0000 7ffaa06d0b80 1 Processor -- start 2023-09-23T09:32:20.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.860+0000 7ffaa06d0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558a75bef050 0x558a75bfb010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:32:20.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.860+0000 7ffaa06d0b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558a75bf4790 0x558a75bf8290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:32:20.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.860+0000 7ffaa06d0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a75bf50b0 0x558a75bf8910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:32:20.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.860+0000 7ffaa06d0b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a75b3c990 con 0x558a75bef050 2023-09-23T09:32:20.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.861+0000 7ffaa06d0b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a75adabb0 con 0x558a75bf50b0 2023-09-23T09:32:20.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.861+0000 7ffaa06d0b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a75ada8b0 con 0x558a75bf4790 2023-09-23T09:32:20.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.861+0000 7ffaa06d0b80 10 client.0 _ll_register_callbacks cb 0x558a75a24a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:32:20.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.861+0000 7ffa8659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558a75bef050 0x558a75bfb010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:32:20.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.861+0000 7ffa8659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558a75bef050 0x558a75bfb010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52022/0 (socket says 172.21.15.82:52022) 2023-09-23T09:32:20.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.861+0000 7ffa8659c700 1 -- 172.21.15.82:0/1211106879 learned_addr learned my addr 172.21.15.82:0/1211106879 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:32:20.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.861+0000 7ffa7ffff700 1 --2- 172.21.15.82:0/1211106879 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558a75bf4790 0x558a75bf8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:32:20.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.861+0000 7ffa86d9d700 1 --2- 172.21.15.82:0/1211106879 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a75bf50b0 0x558a75bf8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:32:20.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.861+0000 7ffa8659c700 1 -- 172.21.15.82:0/1211106879 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558a75bf4790 msgr2=0x558a75bf8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:32:20.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.861+0000 7ffa8659c700 1 --2- 172.21.15.82:0/1211106879 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558a75bf4790 0x558a75bf8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:32:20.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.861+0000 7ffa8659c700 1 -- 172.21.15.82:0/1211106879 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a75bf50b0 msgr2=0x558a75bf8910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:32:20.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.861+0000 7ffa8659c700 1 --2- 172.21.15.82:0/1211106879 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a75bf50b0 0x558a75bf8910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:32:20.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.861+0000 7ffa8659c700 1 -- 172.21.15.82:0/1211106879 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa881a36e0 con 0x558a75bef050 2023-09-23T09:32:20.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.861+0000 7ffa8659c700 1 --2- 172.21.15.82:0/1211106879 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558a75bef050 0x558a75bfb010 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7ffa7801c040 tx=0x7ffa780056a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db853cc0a29dc474 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:32:20.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.861+0000 7ffa6dffb700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:32:20.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.862+0000 7ffa6dffb700 1 -- 172.21.15.82:0/1211106879 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa78004230 con 0x558a75bef050 2023-09-23T09:32:20.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.862+0000 7ffaa06d0b80 1 -- 172.21.15.82:0/1211106879 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558a75bba1c0 con 0x558a75bef050 2023-09-23T09:32:20.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.862+0000 7ffa6dffb700 1 -- 172.21.15.82:0/1211106879 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(147..147 src has 1..147) v4 ==== 8513+0+0 (secure 0 0 0) 0x7ffa78005ce0 con 0x558a75bef050 2023-09-23T09:32:20.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.862+0000 7ffa6dffb700 1 -- 172.21.15.82:0/1211106879 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=106) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffa78004390 con 0x558a75bef050 2023-09-23T09:32:20.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.862+0000 7ffaa06d0b80 10 client.17826 fetch_fsmap learned FSMap version 106 2023-09-23T09:32:20.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.862+0000 7ffaa06d0b80 1 -- 172.21.15.82:0/1211106879 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=106,monmap=4+}) v3 -- 0x7ffa78009e10 con 0x558a75bef050 2023-09-23T09:32:20.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.863+0000 7ffa6dffb700 1 -- 172.21.15.82:0/1211106879 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x558a75bba1c0 con 0x558a75bef050 2023-09-23T09:32:20.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.863+0000 7ffa6dffb700 1 -- 172.21.15.82:0/1211106879 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 106) v1 ==== 7946+0+0 (secure 0 0 0) 0x7ffa7800eb60 con 0x558a75bef050 2023-09-23T09:32:20.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.863+0000 7ffaa06d0b80 10 client.17826 fetch_fsmap finished waiting for FSMap version 106 2023-09-23T09:32:20.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.863+0000 7ffaa06d0b80 10 client.17826 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:32:20.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.863+0000 7ffaa06d0b80 20 client.17826 populate_metadata read hostname 'smithi082' 2023-09-23T09:32:20.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.863+0000 7ffaa06d0b80 1 --2- 172.21.15.82:0/1211106879 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x558a75c08ac0 0x558a75c0aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:32:20.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.863+0000 7ffaa06d0b80 4 client.17826 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:32:20.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.863+0000 7ffaa06d0b80 1 -- 172.21.15.82:0/1211106879 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558a75ae2ba0 con 0x558a75c08ac0 2023-09-23T09:32:20.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.863+0000 7ffa7ffff700 1 --2- 172.21.15.82:0/1211106879 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x558a75c08ac0 0x558a75c0aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:32:20.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.864+0000 7ffa7ffff700 1 --2- 172.21.15.82:0/1211106879 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x558a75c08ac0 0x558a75c0aee0 crc :-1 s=READY pgs=233 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=93792c51a2b6e6df server_cookie=214674562be6484a in_seq=0 out_seq=0 2023-09-23T09:32:20.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.864+0000 7ffa6dffb700 10 client.17826 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:32:20.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.867+0000 7ffa6dffb700 1 -- 172.21.15.82:0/1211106879 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558a75ae2ba0 con 0x558a75c08ac0 2023-09-23T09:32:20.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.867+0000 7ffa6dffb700 10 client.17826 handle_command_reply: tid=0 2023-09-23T09:32:20.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.867+0000 7ffaa06d0b80 1 client.17826 shutdown 2023-09-23T09:32:20.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.867+0000 7ffaa06d0b80 1 -- 172.21.15.82:0/1211106879 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558a75bef050 msgr2=0x558a75bfb010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:32:20.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.867+0000 7ffaa06d0b80 1 --2- 172.21.15.82:0/1211106879 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558a75bef050 0x558a75bfb010 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7ffa7801c040 tx=0x7ffa780056a0 comp rx=0 tx=0).stop 2023-09-23T09:32:20.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.867+0000 7ffaa06d0b80 1 -- 172.21.15.82:0/1211106879 shutdown_connections 2023-09-23T09:32:20.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.867+0000 7ffaa06d0b80 1 --2- 172.21.15.82:0/1211106879 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a75bf50b0 0x558a75bf8910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:32:20.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.867+0000 7ffaa06d0b80 1 --2- 172.21.15.82:0/1211106879 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x558a75c08ac0 0x558a75c0aee0 crc :-1 s=READY pgs=233 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:32:20.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.867+0000 7ffaa06d0b80 1 --2- 172.21.15.82:0/1211106879 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558a75bef050 0x558a75bfb010 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:32:20.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.867+0000 7ffaa06d0b80 1 --2- 172.21.15.82:0/1211106879 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558a75bf4790 0x558a75bf8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:32:20.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.867+0000 7ffa6dffb700 0 client.17826 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:32:20.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.867+0000 7ffaa06d0b80 1 -- 172.21.15.82:0/1211106879 >> 172.21.15.82:0/1211106879 conn(0x558a75b5f0e0 msgr2=0x558a75bdfb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:32:20.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.867+0000 7ffaa06d0b80 1 -- 172.21.15.82:0/1211106879 shutdown_connections 2023-09-23T09:32:20.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.867+0000 7ffaa06d0b80 1 -- 172.21.15.82:0/1211106879 wait complete. 2023-09-23T09:32:20.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.867+0000 7ffaa06d0b80 20 client.17826 trim_cache size 0 max 16384 2023-09-23T09:32:20.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.885+0000 7ffaa06d0b80 1 Processor -- start 2023-09-23T09:32:20.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.885+0000 7ffaa06d0b80 1 -- start start 2023-09-23T09:32:20.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.885+0000 7ffaa06d0b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558a75bef050 0x558a75bffbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:32:20.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.885+0000 7ffaa06d0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a75bf4790 0x558a75bfabb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:32:20.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.885+0000 7ffaa06d0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558a75bf50b0 0x558a75bf11c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:32:20.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.885+0000 7ffaa06d0b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a759be920 con 0x558a75bf50b0 2023-09-23T09:32:20.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.885+0000 7ffaa06d0b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a75be1c80 con 0x558a75bf4790 2023-09-23T09:32:20.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.885+0000 7ffaa06d0b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a75be1810 con 0x558a75bef050 2023-09-23T09:32:20.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.885+0000 7ffa8659c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558a75bef050 0x558a75bffbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:32:20.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.886+0000 7ffa7ffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a75bf4790 0x558a75bfabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:32:20.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.886+0000 7ffa86d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558a75bf50b0 0x558a75bf11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:32:20.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.886+0000 7ffa7ffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a75bf4790 0x558a75bfabb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:50922/0 (socket says 172.21.15.82:50922) 2023-09-23T09:32:20.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.886+0000 7ffa8659c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558a75bef050 0x558a75bffbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:48784/0 (socket says 172.21.15.82:48784) 2023-09-23T09:32:20.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.886+0000 7ffa7ffff700 1 -- 172.21.15.82:0/2165104785 learned_addr learned my addr 172.21.15.82:0/2165104785 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:32:20.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.886+0000 7ffa86d9d700 1 -- 172.21.15.82:0/2165104785 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558a75bef050 msgr2=0x558a75bffbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:32:20.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.886+0000 7ffa86d9d700 1 --2- 172.21.15.82:0/2165104785 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558a75bef050 0x558a75bffbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:32:20.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.886+0000 7ffa86d9d700 1 -- 172.21.15.82:0/2165104785 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a75bf4790 msgr2=0x558a75bfabb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:32:20.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.886+0000 7ffa86d9d700 1 --2- 172.21.15.82:0/2165104785 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a75bf4790 0x558a75bfabb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:32:20.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.886+0000 7ffa86d9d700 1 -- 172.21.15.82:0/2165104785 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558a75968de0 con 0x558a75bf50b0 2023-09-23T09:32:20.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.886+0000 7ffa7ffff700 1 --2- 172.21.15.82:0/2165104785 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a75bf4790 0x558a75bfabb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:32:20.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.886+0000 7ffa86d9d700 1 --2- 172.21.15.82:0/2165104785 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558a75bf50b0 0x558a75bf11c0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7ffa800c8880 tx=0x7ffa800ca040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=469d4c8567a1be1f server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:32:20.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.886+0000 7ffa7d7fa700 1 -- 172.21.15.82:0/2165104785 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa80099000 con 0x558a75bf50b0 2023-09-23T09:32:20.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.886+0000 7ffa7d7fa700 1 -- 172.21.15.82:0/2165104785 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ffa80098900 con 0x558a75bf50b0 2023-09-23T09:32:20.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.886+0000 7ffa7d7fa700 1 -- 172.21.15.82:0/2165104785 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa80095010 con 0x558a75bf50b0 2023-09-23T09:32:20.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.887+0000 7ffaa06d0b80 1 -- 172.21.15.82:0/2165104785 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558a75bf50b0 msgr2=0x558a75bf11c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:32:20.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.887+0000 7ffaa06d0b80 1 --2- 172.21.15.82:0/2165104785 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558a75bf50b0 0x558a75bf11c0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7ffa800c8880 tx=0x7ffa800ca040 comp rx=0 tx=0).stop 2023-09-23T09:32:20.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.887+0000 7ffaa06d0b80 1 -- 172.21.15.82:0/2165104785 shutdown_connections 2023-09-23T09:32:20.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.887+0000 7ffaa06d0b80 1 --2- 172.21.15.82:0/2165104785 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558a75bf50b0 0x558a75bf11c0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:32:20.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.887+0000 7ffaa06d0b80 1 --2- 172.21.15.82:0/2165104785 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558a75bef050 0x558a75bffbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:32:20.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.887+0000 7ffaa06d0b80 1 --2- 172.21.15.82:0/2165104785 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a75bf4790 0x558a75bfabb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:32:20.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.887+0000 7ffaa06d0b80 1 -- 172.21.15.82:0/2165104785 >> 172.21.15.82:0/2165104785 conn(0x558a75b5f0e0 msgr2=0x558a75bf2420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:32:20.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.887+0000 7ffaa06d0b80 1 -- 172.21.15.82:0/2165104785 shutdown_connections 2023-09-23T09:32:20.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.887+0000 7ffaa06d0b80 1 -- 172.21.15.82:0/2165104785 wait complete. 2023-09-23T09:32:20.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.888+0000 7ffaa06d0b80 1 -- start start 2023-09-23T09:32:20.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.888+0000 7ffaa06d0b80 1 Processor -- start 2023-09-23T09:32:20.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.888+0000 7ffaa06d0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a75bef050 0x558a75bff4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:32:20.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.888+0000 7ffaa06d0b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558a75bf4790 0x558a75bffa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:32:20.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.888+0000 7ffaa06d0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558a75bf50b0 0x558a75bfdb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:32:20.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.888+0000 7ffaa06d0b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a75bfe270 con 0x558a75bf50b0 2023-09-23T09:32:20.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.888+0000 7ffaa06d0b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a75bfe3e0 con 0x558a75bef050 2023-09-23T09:32:20.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.888+0000 7ffaa06d0b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a75bfe5a0 con 0x558a75bf4790 2023-09-23T09:32:20.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.888+0000 7ffaa06d0b80 10 client.0 _ll_register_callbacks cb 0x7ffa80004ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:32:20.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.889+0000 7ffa8659c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a75bef050 0x558a75bff4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:32:20.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.889+0000 7ffa8659c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a75bef050 0x558a75bff4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:50934/0 (socket says 172.21.15.82:50934) 2023-09-23T09:32:20.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.889+0000 7ffa8659c700 1 -- 172.21.15.82:0/739324079 learned_addr learned my addr 172.21.15.82:0/739324079 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:32:20.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.889+0000 7ffa86d9d700 1 --2- 172.21.15.82:0/739324079 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558a75bf50b0 0x558a75bfdb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:32:20.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.889+0000 7ffa7ffff700 1 --2- 172.21.15.82:0/739324079 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558a75bf4790 0x558a75bffa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:32:20.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.889+0000 7ffa8659c700 1 -- 172.21.15.82:0/739324079 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558a75bf4790 msgr2=0x558a75bffa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:32:20.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.889+0000 7ffa8659c700 1 --2- 172.21.15.82:0/739324079 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558a75bf4790 0x558a75bffa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:32:20.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.889+0000 7ffa8659c700 1 -- 172.21.15.82:0/739324079 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558a75bf50b0 msgr2=0x558a75bfdb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:32:20.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.889+0000 7ffa8659c700 1 --2- 172.21.15.82:0/739324079 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558a75bf50b0 0x558a75bfdb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:32:20.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.889+0000 7ffa8659c700 1 -- 172.21.15.82:0/739324079 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa7002e040 con 0x558a75bef050 2023-09-23T09:32:20.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.889+0000 7ffa86d9d700 1 --2- 172.21.15.82:0/739324079 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558a75bf50b0 0x558a75bfdb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:32:20.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.889+0000 7ffa8659c700 1 --2- 172.21.15.82:0/739324079 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a75bef050 0x558a75bff4c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ffa7800f010 tx=0x7ffa78004b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a66567687d3d1594 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:32:20.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.889+0000 7ffa6dffb700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-09-23T09:32:20.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.890+0000 7ffa6dffb700 1 -- 172.21.15.82:0/739324079 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7800e640 con 0x558a75bef050 2023-09-23T09:32:20.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.890+0000 7ffaa06d0b80 1 -- 172.21.15.82:0/739324079 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558a75bdd8b0 con 0x558a75bef050 2023-09-23T09:32:20.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.890+0000 7ffa6dffb700 1 -- 172.21.15.82:0/739324079 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(147..147 src has 1..147) v4 ==== 8513+0+0 (secure 0 0 0) 0x7ffa78005ce0 con 0x558a75bef050 2023-09-23T09:32:20.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.890+0000 7ffa6dffb700 1 -- 172.21.15.82:0/739324079 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=106) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffa78005710 con 0x558a75bef050 2023-09-23T09:32:20.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.890+0000 7ffaa06d0b80 10 client.27539 fetch_fsmap learned FSMap version 106 2023-09-23T09:32:20.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.890+0000 7ffaa06d0b80 1 -- 172.21.15.82:0/739324079 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=106,monmap=4+}) v3 -- 0x7ffa88197380 con 0x558a75bef050 2023-09-23T09:32:20.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.890+0000 7ffa6dffb700 1 -- 172.21.15.82:0/739324079 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ffa78042080 con 0x558a75bef050 2023-09-23T09:32:20.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.890+0000 7ffa6dffb700 1 -- 172.21.15.82:0/739324079 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 106) v1 ==== 7946+0+0 (secure 0 0 0) 0x7ffa7803c030 con 0x558a75bef050 2023-09-23T09:32:20.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.890+0000 7ffaa06d0b80 10 client.27539 fetch_fsmap finished waiting for FSMap version 106 2023-09-23T09:32:20.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.890+0000 7ffaa06d0b80 10 client.27539 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:32:20.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.890+0000 7ffaa06d0b80 20 client.27539 populate_metadata read hostname 'smithi082' 2023-09-23T09:32:20.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.890+0000 7ffaa06d0b80 1 --2- 172.21.15.82:0/739324079 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x558a75c5d790 0x558a75c5fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:32:20.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.890+0000 7ffaa06d0b80 4 client.27539 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:32:20.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.890+0000 7ffaa06d0b80 1 -- 172.21.15.82:0/739324079 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x558a75b35970 con 0x558a75c5d790 2023-09-23T09:32:20.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.891+0000 7ffa7ffff700 1 --2- 172.21.15.82:0/739324079 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x558a75c5d790 0x558a75c5fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:32:20.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.891+0000 7ffa6dffb700 10 client.27539 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:32:20.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.891+0000 7ffa7ffff700 1 --2- 172.21.15.82:0/739324079 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x558a75c5d790 0x558a75c5fbb0 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=72cecc98827aeb97 server_cookie=35529fa7b195d88f in_seq=0 out_seq=0 2023-09-23T09:32:20.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.891+0000 7ffa6dffb700 1 -- 172.21.15.82:0/739324079 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x558a75b35970 con 0x558a75c5d790 2023-09-23T09:32:20.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.891+0000 7ffa6dffb700 10 client.27539 handle_command_reply: tid=0 2023-09-23T09:32:20.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.891+0000 7ffaa06d0b80 1 client.27539 shutdown 2023-09-23T09:32:20.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.892+0000 7ffaa06d0b80 1 -- 172.21.15.82:0/739324079 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a75bef050 msgr2=0x558a75bff4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:32:20.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.892+0000 7ffaa06d0b80 1 --2- 172.21.15.82:0/739324079 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a75bef050 0x558a75bff4c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ffa7800f010 tx=0x7ffa78004b90 comp rx=0 tx=0).stop 2023-09-23T09:32:20.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.892+0000 7ffaa06d0b80 1 -- 172.21.15.82:0/739324079 shutdown_connections 2023-09-23T09:32:20.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.892+0000 7ffaa06d0b80 1 --2- 172.21.15.82:0/739324079 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x558a75c5d790 0x558a75c5fbb0 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:32:20.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.892+0000 7ffaa06d0b80 1 --2- 172.21.15.82:0/739324079 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558a75bf50b0 0x558a75bfdb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:32:20.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.892+0000 7ffa6dffb700 0 client.27539 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:32:20.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.892+0000 7ffaa06d0b80 1 --2- 172.21.15.82:0/739324079 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a75bef050 0x558a75bff4c0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:32:20.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.892+0000 7ffaa06d0b80 1 --2- 172.21.15.82:0/739324079 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558a75bf4790 0x558a75bffa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:32:20.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.892+0000 7ffaa06d0b80 1 -- 172.21.15.82:0/739324079 >> 172.21.15.82:0/739324079 conn(0x558a75b5f0e0 msgr2=0x558a75bdf2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:32:20.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.892+0000 7ffaa06d0b80 1 -- 172.21.15.82:0/739324079 shutdown_connections 2023-09-23T09:32:20.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.892+0000 7ffaa06d0b80 1 -- 172.21.15.82:0/739324079 wait complete. 2023-09-23T09:32:20.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.892+0000 7ffaa06d0b80 20 client.27539 trim_cache size 0 max 16384 2023-09-23T09:32:20.900 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:32:20.900 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-23T09:32:20.900 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:32:20.901 INFO:teuthology.orchestra.run.smithi082.stdout: "2aec802a-e2df-49b3-a22a-82c491ba0c59": { 2023-09-23T09:32:20.901 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:32:20.901 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "2aec802a-e2df-49b3-a22a-82c491ba0c59", 2023-09-23T09:32:20.901 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:32:20.901 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:32:20.901 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:32:20.901 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:32:20.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.892+0000 7ffa8cdff700 1 -- 172.21.15.82:0/1949049844 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7ffa740a00c0 msgr2=0x7ffa740a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:32:20.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.892+0000 7ffa8cdff700 1 --2- 172.21.15.82:0/1949049844 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7ffa740a00c0 0x7ffa740a2580 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ffa88197bd0 tx=0x7ffa7000bc20 comp rx=0 tx=0).stop 2023-09-23T09:32:20.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.892+0000 7ffa8cdff700 1 -- 172.21.15.82:0/1949049844 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa881068a0 msgr2=0x7ffa88196760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:32:20.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.892+0000 7ffa8cdff700 1 --2- 172.21.15.82:0/1949049844 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa881068a0 0x7ffa88196760 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7ffa8000efc0 tx=0x7ffa8000c3a0 comp rx=0 tx=0).stop 2023-09-23T09:32:20.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.893+0000 7ffa8cdff700 1 -- 172.21.15.82:0/1949049844 shutdown_connections 2023-09-23T09:32:20.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.893+0000 7ffa8cdff700 1 --2- 172.21.15.82:0/1949049844 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7ffa740a00c0 0x7ffa740a2580 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:32:20.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.893+0000 7ffa8cdff700 1 --2- 172.21.15.82:0/1949049844 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa881068a0 0x7ffa88196760 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:32:20.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.893+0000 7ffa8cdff700 1 --2- 172.21.15.82:0/1949049844 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffa88100890 0x7ffa8819c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:32:20.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.893+0000 7ffa8cdff700 1 --2- 172.21.15.82:0/1949049844 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa88101250 0x7ffa8819cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:32:20.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.893+0000 7ffa8cdff700 1 -- 172.21.15.82:0/1949049844 >> 172.21.15.82:0/1949049844 conn(0x7ffa880fc380 msgr2=0x7ffa880fca60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:32:20.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.893+0000 7ffa8cdff700 1 -- 172.21.15.82:0/1949049844 shutdown_connections 2023-09-23T09:32:20.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:20.893+0000 7ffa8cdff700 1 -- 172.21.15.82:0/1949049844 wait complete. 2023-09-23T09:32:20.915 INFO:tasks.cephfs.filesystem:scrub status for tag:2aec802a-e2df-49b3-a22a-82c491ba0c59 - {'path': '/', 'tag': '2aec802a-e2df-49b3-a22a-82c491ba0c59', 'options': 'recursive,force'} 2023-09-23T09:32:21.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:32:20 smithi135 ceph-mon[99205]: pgmap v1124: 97 pgs: 97 active+clean; 17 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 9.5 MiB/s wr, 911 op/s 2023-09-23T09:32:21.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:32:20 smithi082 ceph-mon[97694]: pgmap v1124: 97 pgs: 97 active+clean; 17 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 9.5 MiB/s wr, 911 op/s 2023-09-23T09:32:21.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:32:20 smithi161 ceph-mon[99580]: pgmap v1124: 97 pgs: 97 active+clean; 17 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 9.5 MiB/s wr, 911 op/s 2023-09-23T09:32:23.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:32:22 smithi135 ceph-mon[99205]: pgmap v1125: 97 pgs: 97 active+clean; 17 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 9.4 MiB/s wr, 884 op/s 2023-09-23T09:32:23.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:32:22 smithi082 ceph-mon[97694]: pgmap v1125: 97 pgs: 97 active+clean; 17 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 9.4 MiB/s wr, 884 op/s 2023-09-23T09:32:23.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:32:22 smithi161 ceph-mon[99580]: pgmap v1125: 97 pgs: 97 active+clean; 17 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 9.4 MiB/s wr, 884 op/s 2023-09-23T09:32:24.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:32:23 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:32:24.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:32:23 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:32:24.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:32:23 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:32:25.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:32:24 smithi135 ceph-mon[99205]: pgmap v1126: 97 pgs: 97 active+clean; 17 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 1.8 MiB/s rd, 8.1 MiB/s wr, 767 op/s 2023-09-23T09:32:25.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:32:24 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:32:25.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:32:24 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:32:25.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:32:24 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:32:25.125 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:32:24 smithi082 ceph-mon[97694]: pgmap v1126: 97 pgs: 97 active+clean; 17 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 1.8 MiB/s rd, 8.1 MiB/s wr, 767 op/s 2023-09-23T09:32:25.125 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:32:24 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:32:25.125 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:32:24 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:32:25.125 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:32:24 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:32:25.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:32:24 smithi161 ceph-mon[99580]: pgmap v1126: 97 pgs: 97 active+clean; 17 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 1.8 MiB/s rd, 8.1 MiB/s wr, 767 op/s 2023-09-23T09:32:25.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:32:24 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:32:25.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:32:24 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:32:25.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:32:24 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:32:25.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 315.0 s, 395.8 tps, lat 377.407 ms stddev 817.621 2023-09-23T09:32:27.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:32:26 smithi135 ceph-mon[99205]: pgmap v1127: 97 pgs: 97 active+clean; 17 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 11 MiB/s wr, 1.02k op/s 2023-09-23T09:32:27.124 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:32:26 smithi082 ceph-mon[97694]: pgmap v1127: 97 pgs: 97 active+clean; 17 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 11 MiB/s wr, 1.02k op/s 2023-09-23T09:32:27.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:32:26 smithi161 ceph-mon[99580]: pgmap v1127: 97 pgs: 97 active+clean; 17 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 11 MiB/s wr, 1.02k op/s 2023-09-23T09:32:28.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:32:28 smithi161 ceph-mon[99580]: pgmap v1128: 97 pgs: 97 active+clean; 17 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 1.5 MiB/s rd, 5.6 MiB/s wr, 506 op/s 2023-09-23T09:32:28.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:32:28 smithi135 ceph-mon[99205]: pgmap v1128: 97 pgs: 97 active+clean; 17 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 1.5 MiB/s rd, 5.6 MiB/s wr, 506 op/s 2023-09-23T09:32:28.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:32:28 smithi082 ceph-mon[97694]: pgmap v1128: 97 pgs: 97 active+clean; 17 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 1.5 MiB/s rd, 5.6 MiB/s wr, 506 op/s 2023-09-23T09:32:30.828 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 320.0 s, 521.0 tps, lat 194.657 ms stddev 119.457 2023-09-23T09:32:31.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:32:30 smithi135 ceph-mon[99205]: pgmap v1129: 97 pgs: 97 active+clean; 17 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 2.8 MiB/s rd, 11 MiB/s wr, 995 op/s 2023-09-23T09:32:31.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:32:30 smithi082 ceph-mon[97694]: pgmap v1129: 97 pgs: 97 active+clean; 17 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 2.8 MiB/s rd, 11 MiB/s wr, 995 op/s 2023-09-23T09:32:31.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:32:30 smithi161 ceph-mon[99580]: pgmap v1129: 97 pgs: 97 active+clean; 17 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 2.8 MiB/s rd, 11 MiB/s wr, 995 op/s 2023-09-23T09:32:33.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:32:32 smithi135 ceph-mon[99205]: pgmap v1130: 97 pgs: 97 active+clean; 17 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 2.4 MiB/s rd, 9.5 MiB/s wr, 870 op/s 2023-09-23T09:32:33.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:32:32 smithi082 ceph-mon[97694]: pgmap v1130: 97 pgs: 97 active+clean; 17 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 2.4 MiB/s rd, 9.5 MiB/s wr, 870 op/s 2023-09-23T09:32:33.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:32:32 smithi161 ceph-mon[99580]: pgmap v1130: 97 pgs: 97 active+clean; 17 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 2.4 MiB/s rd, 9.5 MiB/s wr, 870 op/s 2023-09-23T09:32:35.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:32:34 smithi135 ceph-mon[99205]: pgmap v1131: 97 pgs: 97 active+clean; 17 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 9.0 MiB/s wr, 840 op/s 2023-09-23T09:32:35.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:32:34 smithi082 ceph-mon[97694]: pgmap v1131: 97 pgs: 97 active+clean; 17 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 9.0 MiB/s wr, 840 op/s 2023-09-23T09:32:35.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:32:34 smithi161 ceph-mon[99580]: pgmap v1131: 97 pgs: 97 active+clean; 17 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 9.0 MiB/s wr, 840 op/s 2023-09-23T09:32:35.829 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 325.0 s, 217.8 tps, lat 213.741 ms stddev 97.832 2023-09-23T09:32:37.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:32:36 smithi135 ceph-mon[99205]: pgmap v1132: 97 pgs: 97 active+clean; 17 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 3.5 MiB/s rd, 14 MiB/s wr, 1.31k op/s 2023-09-23T09:32:37.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:32:36 smithi082 ceph-mon[97694]: pgmap v1132: 97 pgs: 97 active+clean; 17 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 3.5 MiB/s rd, 14 MiB/s wr, 1.31k op/s 2023-09-23T09:32:37.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:32:36 smithi161 ceph-mon[99580]: pgmap v1132: 97 pgs: 97 active+clean; 17 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 3.5 MiB/s rd, 14 MiB/s wr, 1.31k op/s 2023-09-23T09:32:38.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:32:38 smithi161 ceph-mon[99580]: pgmap v1133: 97 pgs: 97 active+clean; 17 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 11 MiB/s wr, 1.03k op/s 2023-09-23T09:32:38.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:32:38 smithi135 ceph-mon[99205]: pgmap v1133: 97 pgs: 97 active+clean; 17 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 11 MiB/s wr, 1.03k op/s 2023-09-23T09:32:38.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:32:38 smithi082 ceph-mon[97694]: pgmap v1133: 97 pgs: 97 active+clean; 17 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 11 MiB/s wr, 1.03k op/s 2023-09-23T09:32:40.828 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 330.0 s, 198.4 tps, lat 491.408 ms stddev 1047.623 2023-09-23T09:32:41.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:32:40 smithi135 ceph-mon[99205]: pgmap v1134: 97 pgs: 97 active+clean; 17 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 3.2 MiB/s rd, 13 MiB/s wr, 1.24k op/s 2023-09-23T09:32:41.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:32:40 smithi082 ceph-mon[97694]: pgmap v1134: 97 pgs: 97 active+clean; 17 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 3.2 MiB/s rd, 13 MiB/s wr, 1.24k op/s 2023-09-23T09:32:41.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:32:40 smithi161 ceph-mon[99580]: pgmap v1134: 97 pgs: 97 active+clean; 17 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 3.2 MiB/s rd, 13 MiB/s wr, 1.24k op/s 2023-09-23T09:32:43.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:32:42 smithi135 ceph-mon[99205]: pgmap v1135: 97 pgs: 97 active+clean; 17 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 7.7 MiB/s wr, 778 op/s 2023-09-23T09:32:43.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:32:42 smithi082 ceph-mon[97694]: pgmap v1135: 97 pgs: 97 active+clean; 17 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 7.7 MiB/s wr, 778 op/s 2023-09-23T09:32:43.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:32:42 smithi161 ceph-mon[99580]: pgmap v1135: 97 pgs: 97 active+clean; 17 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 7.7 MiB/s wr, 778 op/s 2023-09-23T09:32:45.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:32:44 smithi135 ceph-mon[99205]: pgmap v1136: 97 pgs: 97 active+clean; 17 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 1.8 MiB/s rd, 7.3 MiB/s wr, 706 op/s 2023-09-23T09:32:45.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:32:44 smithi082 ceph-mon[97694]: pgmap v1136: 97 pgs: 97 active+clean; 17 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 1.8 MiB/s rd, 7.3 MiB/s wr, 706 op/s 2023-09-23T09:32:45.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:32:44 smithi161 ceph-mon[99580]: pgmap v1136: 97 pgs: 97 active+clean; 17 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 1.8 MiB/s rd, 7.3 MiB/s wr, 706 op/s 2023-09-23T09:32:45.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 335.0 s, 357.9 tps, lat 436.152 ms stddev 954.754 2023-09-23T09:32:47.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:32:46 smithi135 ceph-mon[99205]: pgmap v1137: 97 pgs: 97 active+clean; 17 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 2.5 MiB/s rd, 9.6 MiB/s wr, 906 op/s 2023-09-23T09:32:47.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:32:46 smithi082 ceph-mon[97694]: pgmap v1137: 97 pgs: 97 active+clean; 17 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 2.5 MiB/s rd, 9.6 MiB/s wr, 906 op/s 2023-09-23T09:32:47.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:32:46 smithi161 ceph-mon[99580]: pgmap v1137: 97 pgs: 97 active+clean; 17 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 2.5 MiB/s rd, 9.6 MiB/s wr, 906 op/s 2023-09-23T09:32:48.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:32:48 smithi135 ceph-mon[99205]: pgmap v1138: 97 pgs: 97 active+clean; 17 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.8 MiB/s wr, 438 op/s 2023-09-23T09:32:48.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:32:48 smithi082 ceph-mon[97694]: pgmap v1138: 97 pgs: 97 active+clean; 17 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.8 MiB/s wr, 438 op/s 2023-09-23T09:32:48.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:32:48 smithi161 ceph-mon[99580]: pgmap v1138: 97 pgs: 97 active+clean; 17 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.8 MiB/s wr, 438 op/s 2023-09-23T09:32:50.827 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 340.0 s, 488.4 tps, lat 206.917 ms stddev 322.383 2023-09-23T09:32:50.916 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:32:51.045 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:32:50 smithi082 ceph-mon[97694]: pgmap v1139: 97 pgs: 97 active+clean; 17 GiB data, 62 GiB used, 1010 GiB / 1.0 TiB avail; 2.5 MiB/s rd, 10 MiB/s wr, 936 op/s 2023-09-23T09:32:51.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:32:50 smithi135 ceph-mon[99205]: pgmap v1139: 97 pgs: 97 active+clean; 17 GiB data, 62 GiB used, 1010 GiB / 1.0 TiB avail; 2.5 MiB/s rd, 10 MiB/s wr, 936 op/s 2023-09-23T09:32:51.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:32:50 smithi161 ceph-mon[99580]: pgmap v1139: 97 pgs: 97 active+clean; 17 GiB data, 62 GiB used, 1010 GiB / 1.0 TiB avail; 2.5 MiB/s rd, 10 MiB/s wr, 936 op/s 2023-09-23T09:32:51.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.295+0000 7fed6cfff700 1 -- 172.21.15.82:0/4275484909 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed680ff760 msgr2=0x7fed680ffbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:32:51.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.295+0000 7fed6cfff700 1 --2- 172.21.15.82:0/4275484909 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed680ff760 0x7fed680ffbe0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fed5c009990 tx=0x7fed5c009ca0 comp rx=0 tx=0).stop 2023-09-23T09:32:51.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.295+0000 7fed6cfff700 1 -- 172.21.15.82:0/4275484909 shutdown_connections 2023-09-23T09:32:51.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.295+0000 7fed6cfff700 1 --2- 172.21.15.82:0/4275484909 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed68100120 0x7fed6810c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:32:51.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.295+0000 7fed6cfff700 1 --2- 172.21.15.82:0/4275484909 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed68105770 0x7fed68105b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:32:51.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.295+0000 7fed6cfff700 1 --2- 172.21.15.82:0/4275484909 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed680ff760 0x7fed680ffbe0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:32:51.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.295+0000 7fed6cfff700 1 -- 172.21.15.82:0/4275484909 >> 172.21.15.82:0/4275484909 conn(0x7fed680fb270 msgr2=0x7fed680fd690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:32:51.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.296+0000 7fed6cfff700 1 -- 172.21.15.82:0/4275484909 shutdown_connections 2023-09-23T09:32:51.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.296+0000 7fed6cfff700 1 -- 172.21.15.82:0/4275484909 wait complete. 2023-09-23T09:32:51.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.298+0000 7fed6cfff700 1 Processor -- start 2023-09-23T09:32:51.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.298+0000 7fed6cfff700 1 -- start start 2023-09-23T09:32:51.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.298+0000 7fed6cfff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed680ff760 0x7fed681151e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:32:51.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.298+0000 7fed6cfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed68100120 0x7fed68115760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:32:51.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.298+0000 7fed6cfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed68105770 0x7fed6810e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:32:51.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.298+0000 7fed6cfff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed6810e9c0 con 0x7fed68105770 2023-09-23T09:32:51.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.298+0000 7fed6cfff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed6810eb30 con 0x7fed68100120 2023-09-23T09:32:51.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.298+0000 7fed6cfff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed6810ecf0 con 0x7fed680ff760 2023-09-23T09:32:51.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.299+0000 7fed6659c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed680ff760 0x7fed681151e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:32:51.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.299+0000 7fed6659c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed680ff760 0x7fed681151e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:37070/0 (socket says 172.21.15.82:37070) 2023-09-23T09:32:51.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.299+0000 7fed6659c700 1 -- 172.21.15.82:0/1918323044 learned_addr learned my addr 172.21.15.82:0/1918323044 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:32:51.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.299+0000 7fed65d9b700 1 --2- 172.21.15.82:0/1918323044 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed68100120 0x7fed68115760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:32:51.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.299+0000 7fed6659c700 1 -- 172.21.15.82:0/1918323044 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed68100120 msgr2=0x7fed68115760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:32:51.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.299+0000 7fed6659c700 1 --2- 172.21.15.82:0/1918323044 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed68100120 0x7fed68115760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:32:51.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.299+0000 7fed66d9d700 1 --2- 172.21.15.82:0/1918323044 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed68105770 0x7fed6810e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:32:51.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.299+0000 7fed6659c700 1 -- 172.21.15.82:0/1918323044 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed68105770 msgr2=0x7fed6810e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:32:51.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.299+0000 7fed6659c700 1 --2- 172.21.15.82:0/1918323044 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed68105770 0x7fed6810e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:32:51.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.300+0000 7fed6659c700 1 -- 172.21.15.82:0/1918323044 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed5c0095f0 con 0x7fed680ff760 2023-09-23T09:32:51.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.300+0000 7fed65d9b700 1 --2- 172.21.15.82:0/1918323044 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed68100120 0x7fed68115760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:32:51.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.300+0000 7fed66d9d700 1 --2- 172.21.15.82:0/1918323044 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed68105770 0x7fed6810e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T09:32:51.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.300+0000 7fed6659c700 1 --2- 172.21.15.82:0/1918323044 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed680ff760 0x7fed681151e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fed58007bd0 tx=0x7fed58007f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:32:51.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.300+0000 7fed577fe700 1 -- 172.21.15.82:0/1918323044 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed58010040 con 0x7fed680ff760 2023-09-23T09:32:51.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.301+0000 7fed577fe700 1 -- 172.21.15.82:0/1918323044 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fed58015470 con 0x7fed680ff760 2023-09-23T09:32:51.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.301+0000 7fed577fe700 1 -- 172.21.15.82:0/1918323044 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed5800b810 con 0x7fed680ff760 2023-09-23T09:32:51.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.303+0000 7fed6cfff700 1 -- 172.21.15.82:0/1918323044 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed6810ef70 con 0x7fed680ff760 2023-09-23T09:32:51.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.303+0000 7fed6cfff700 1 -- 172.21.15.82:0/1918323044 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed68112fb0 con 0x7fed680ff760 2023-09-23T09:32:51.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.310+0000 7fed809fab80 1 Processor -- start 2023-09-23T09:32:51.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.312+0000 7fed809fab80 1 -- start start 2023-09-23T09:32:51.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.312+0000 7fed809fab80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f09db50380 0x55f09db50760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:32:51.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.312+0000 7fed809fab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f09db50ca0 0x55f09db4a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:32:51.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.312+0000 7fed809fab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f09db4ac40 0x55f09db4b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:32:51.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.312+0000 7fed809fab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f09dab27b0 con 0x55f09db50ca0 2023-09-23T09:32:51.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.312+0000 7fed809fab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f09daa3780 con 0x55f09db4ac40 2023-09-23T09:32:51.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.312+0000 7fed809fab80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f09daa10a0 con 0x55f09db50380 2023-09-23T09:32:51.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.313+0000 7fed65d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f09db4ac40 0x55f09db4b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:32:51.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.313+0000 7fed65d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f09db4ac40 0x55f09db4b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:60202/0 (socket says 172.21.15.82:60202) 2023-09-23T09:32:51.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.313+0000 7fed65d9b700 1 -- 172.21.15.82:0/2506128209 learned_addr learned my addr 172.21.15.82:0/2506128209 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:32:51.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.313+0000 7fed66d9d700 1 --2- 172.21.15.82:0/2506128209 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f09db50380 0x55f09db50760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:32:51.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.314+0000 7fed65d9b700 1 -- 172.21.15.82:0/2506128209 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f09db50380 msgr2=0x55f09db50760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:32:51.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.314+0000 7fed65d9b700 1 --2- 172.21.15.82:0/2506128209 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f09db50380 0x55f09db50760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:32:51.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.314+0000 7fed65d9b700 1 -- 172.21.15.82:0/2506128209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f09db50ca0 msgr2=0x55f09db4a700 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-23T09:32:51.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.314+0000 7fed65d9b700 1 --2- 172.21.15.82:0/2506128209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f09db50ca0 0x55f09db4a700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:32:51.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.314+0000 7fed65d9b700 1 -- 172.21.15.82:0/2506128209 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f09d91c630 con 0x55f09db4ac40 2023-09-23T09:32:51.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.314+0000 7fed577fe700 1 -- 172.21.15.82:0/1918323044 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7fed580155e0 con 0x7fed680ff760 2023-09-23T09:32:51.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.315+0000 7fed65d9b700 1 --2- 172.21.15.82:0/2506128209 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f09db4ac40 0x55f09db4b0a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fed5c00b2e0 tx=0x7fed5c005c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8f1c9bdb02355d2 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:32:51.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.316+0000 7fed54ff9700 1 -- 172.21.15.82:0/2506128209 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed5c0056a0 con 0x55f09db4ac40 2023-09-23T09:32:51.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.316+0000 7fed54ff9700 1 -- 172.21.15.82:0/2506128209 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fed5c01e040 con 0x55f09db4ac40 2023-09-23T09:32:51.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.316+0000 7fed54ff9700 1 -- 172.21.15.82:0/2506128209 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed5c004b70 con 0x55f09db4ac40 2023-09-23T09:32:51.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.316+0000 7fed577fe700 1 --2- 172.21.15.82:0/1918323044 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fed500a0290 0x7fed500a2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:32:51.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.316+0000 7fed577fe700 1 -- 172.21.15.82:0/1918323044 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fed580cb460 con 0x7fed680ff760 2023-09-23T09:32:51.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.317+0000 7fed809fab80 1 -- 172.21.15.82:0/2506128209 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f09db4ac40 msgr2=0x55f09db4b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:32:51.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.317+0000 7fed809fab80 1 --2- 172.21.15.82:0/2506128209 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f09db4ac40 0x55f09db4b0a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fed5c00b2e0 tx=0x7fed5c005c80 comp rx=0 tx=0).stop 2023-09-23T09:32:51.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.317+0000 7fed66d9d700 1 --2- 172.21.15.82:0/1918323044 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fed500a0290 0x7fed500a2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:32:51.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.317+0000 7fed809fab80 1 -- 172.21.15.82:0/2506128209 shutdown_connections 2023-09-23T09:32:51.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.317+0000 7fed809fab80 1 --2- 172.21.15.82:0/2506128209 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f09db4ac40 0x55f09db4b0a0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:32:51.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.317+0000 7fed809fab80 1 --2- 172.21.15.82:0/2506128209 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f09db50380 0x55f09db50760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:32:51.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.317+0000 7fed809fab80 1 --2- 172.21.15.82:0/2506128209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f09db50ca0 0x55f09db4a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:32:51.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.317+0000 7fed809fab80 1 -- 172.21.15.82:0/2506128209 >> 172.21.15.82:0/2506128209 conn(0x55f09dabf0e0 msgr2=0x55f09db45410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:32:51.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.318+0000 7fed809fab80 1 -- 172.21.15.82:0/2506128209 shutdown_connections 2023-09-23T09:32:51.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.318+0000 7fed809fab80 1 -- 172.21.15.82:0/2506128209 wait complete. 2023-09-23T09:32:51.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.319+0000 7fed809fab80 1 -- start start 2023-09-23T09:32:51.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.319+0000 7fed66d9d700 1 --2- 172.21.15.82:0/1918323044 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fed500a0290 0x7fed500a2750 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fed6000dfd0 tx=0x7fed6000d040 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:32:51.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.319+0000 7fed809fab80 1 Processor -- start 2023-09-23T09:32:51.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.321+0000 7fed809fab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f09db4ac40 0x55f09db53f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:32:51.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.321+0000 7fed809fab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f09db50380 0x55f09db544b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:32:51.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.321+0000 7fed809fab80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f09db50ca0 0x55f09db549f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:32:51.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.321+0000 7fed809fab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f09da9c990 con 0x55f09db50380 2023-09-23T09:32:51.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.321+0000 7fed809fab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f09da3abb0 con 0x55f09db4ac40 2023-09-23T09:32:51.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.321+0000 7fed809fab80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f09da3a8b0 con 0x55f09db50ca0 2023-09-23T09:32:51.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.322+0000 7fed809fab80 10 client.0 _ll_register_callbacks cb 0x55f09d984a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:32:51.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.322+0000 7fed6659c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f09db4ac40 0x55f09db53f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:32:51.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.322+0000 7fed6659c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f09db4ac40 0x55f09db53f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:60216/0 (socket says 172.21.15.82:60216) 2023-09-23T09:32:51.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.322+0000 7fed6659c700 1 -- 172.21.15.82:0/1147334619 learned_addr learned my addr 172.21.15.82:0/1147334619 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:32:51.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.322+0000 7fed66d9d700 1 --2- 172.21.15.82:0/1147334619 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f09db50ca0 0x55f09db549f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:32:51.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.322+0000 7fed66d9d700 1 -- 172.21.15.82:0/1147334619 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f09db4ac40 msgr2=0x55f09db53f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:32:51.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.322+0000 7fed66d9d700 1 --2- 172.21.15.82:0/1147334619 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f09db4ac40 0x55f09db53f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:32:51.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.322+0000 7fed66d9d700 1 -- 172.21.15.82:0/1147334619 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f09db50380 msgr2=0x55f09db544b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-23T09:32:51.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.322+0000 7fed66d9d700 1 --2- 172.21.15.82:0/1147334619 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f09db50380 0x55f09db544b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:32:51.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.322+0000 7fed66d9d700 1 -- 172.21.15.82:0/1147334619 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed6810cf30 con 0x55f09db50ca0 2023-09-23T09:32:51.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.323+0000 7fed66d9d700 1 --2- 172.21.15.82:0/1147334619 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f09db50ca0 0x55f09db549f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fed6000d010 tx=0x7fed6000f040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=94236b70723a0384 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:32:51.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.323+0000 7fed4dffb700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T09:32:51.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.323+0000 7fed4dffb700 1 -- 172.21.15.82:0/1147334619 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed6001f070 con 0x55f09db50ca0 2023-09-23T09:32:51.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.323+0000 7fed809fab80 1 -- 172.21.15.82:0/1147334619 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f09db1a1c0 con 0x55f09db50ca0 2023-09-23T09:32:51.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.323+0000 7fed4dffb700 1 -- 172.21.15.82:0/1147334619 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(147..147 src has 1..147) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fed60019660 con 0x55f09db50ca0 2023-09-23T09:32:51.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.324+0000 7fed4dffb700 1 -- 172.21.15.82:0/1147334619 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=106) v2 ==== 24+0+0 (secure 0 0 0) 0x7fed60012040 con 0x55f09db50ca0 2023-09-23T09:32:51.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.324+0000 7fed809fab80 10 client.27586 fetch_fsmap learned FSMap version 106 2023-09-23T09:32:51.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.324+0000 7fed809fab80 1 -- 172.21.15.82:0/1147334619 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=106,monmap=4+}) v3 -- 0x55f09d8c8de0 con 0x55f09db50ca0 2023-09-23T09:32:51.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.324+0000 7fed4dffb700 1 -- 172.21.15.82:0/1147334619 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fed60031020 con 0x55f09db50ca0 2023-09-23T09:32:51.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.324+0000 7fed4dffb700 1 -- 172.21.15.82:0/1147334619 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 106) v1 ==== 7946+0+0 (secure 0 0 0) 0x7fed600248e0 con 0x55f09db50ca0 2023-09-23T09:32:51.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.324+0000 7fed809fab80 10 client.27586 fetch_fsmap finished waiting for FSMap version 106 2023-09-23T09:32:51.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.324+0000 7fed809fab80 10 client.27586 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:32:51.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.324+0000 7fed809fab80 20 client.27586 populate_metadata read hostname 'smithi082' 2023-09-23T09:32:51.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.324+0000 7fed809fab80 1 --2- 172.21.15.82:0/1147334619 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55f09db648e0 0x55f09db66d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:32:51.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.324+0000 7fed809fab80 4 client.27586 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:32:51.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.324+0000 7fed809fab80 1 -- 172.21.15.82:0/1147334619 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f09da42ba0 con 0x55f09db648e0 2023-09-23T09:32:51.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.325+0000 7fed6659c700 1 --2- 172.21.15.82:0/1147334619 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55f09db648e0 0x55f09db66d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:32:51.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.326+0000 7fed4dffb700 10 client.27586 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:32:51.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.326+0000 7fed6659c700 1 --2- 172.21.15.82:0/1147334619 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55f09db648e0 0x55f09db66d00 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1595371c185599e2 server_cookie=b3d87db1c4e9311f in_seq=0 out_seq=0 2023-09-23T09:32:51.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.326+0000 7fed4dffb700 1 -- 172.21.15.82:0/1147334619 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f09da42ba0 con 0x55f09db648e0 2023-09-23T09:32:51.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.326+0000 7fed4dffb700 10 client.27586 handle_command_reply: tid=0 2023-09-23T09:32:51.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.327+0000 7fed809fab80 1 client.27586 shutdown 2023-09-23T09:32:51.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.327+0000 7fed809fab80 1 -- 172.21.15.82:0/1147334619 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f09db50ca0 msgr2=0x55f09db549f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:32:51.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.327+0000 7fed809fab80 1 --2- 172.21.15.82:0/1147334619 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f09db50ca0 0x55f09db549f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fed6000d010 tx=0x7fed6000f040 comp rx=0 tx=0).stop 2023-09-23T09:32:51.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.328+0000 7fed809fab80 1 -- 172.21.15.82:0/1147334619 shutdown_connections 2023-09-23T09:32:51.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.328+0000 7fed809fab80 1 --2- 172.21.15.82:0/1147334619 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f09db50ca0 0x55f09db549f0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:32:51.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.328+0000 7fed809fab80 1 --2- 172.21.15.82:0/1147334619 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f09db4ac40 0x55f09db53f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:32:51.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.328+0000 7fed809fab80 1 --2- 172.21.15.82:0/1147334619 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55f09db648e0 0x55f09db66d00 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:32:51.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.328+0000 7fed809fab80 1 --2- 172.21.15.82:0/1147334619 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f09db50380 0x55f09db544b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:32:51.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.328+0000 7fed809fab80 1 -- 172.21.15.82:0/1147334619 >> 172.21.15.82:0/1147334619 conn(0x55f09dabf0e0 msgr2=0x55f09db3fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:32:51.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.328+0000 7fed4dffb700 0 client.27586 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:32:51.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.328+0000 7fed809fab80 1 -- 172.21.15.82:0/1147334619 shutdown_connections 2023-09-23T09:32:51.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.328+0000 7fed809fab80 1 -- 172.21.15.82:0/1147334619 wait complete. 2023-09-23T09:32:51.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.329+0000 7fed809fab80 20 client.27586 trim_cache size 0 max 16384 2023-09-23T09:32:51.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.351+0000 7fed809fab80 1 Processor -- start 2023-09-23T09:32:51.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.351+0000 7fed809fab80 1 -- start start 2023-09-23T09:32:51.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.351+0000 7fed809fab80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f09db4ac40 0x55f09db4a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:32:51.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.351+0000 7fed809fab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f09db50380 0x55f09db5b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:32:51.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.351+0000 7fed809fab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f09db50ca0 0x55f09db54530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:32:51.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.351+0000 7fed809fab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f09d91e920 con 0x55f09db50ca0 2023-09-23T09:32:51.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.351+0000 7fed809fab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f09db4b640 con 0x55f09db50380 2023-09-23T09:32:51.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.351+0000 7fed809fab80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f09db57580 con 0x55f09db4ac40 2023-09-23T09:32:51.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.352+0000 7fed65d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f09db50380 0x55f09db5b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:32:51.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.352+0000 7fed66d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f09db50ca0 0x55f09db54530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:32:51.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.352+0000 7fed65d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f09db50380 0x55f09db5b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:60220/0 (socket says 172.21.15.82:60220) 2023-09-23T09:32:51.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.352+0000 7fed65d9b700 1 -- 172.21.15.82:0/2026795178 learned_addr learned my addr 172.21.15.82:0/2026795178 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:32:51.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.352+0000 7fed66d9d700 1 -- 172.21.15.82:0/2026795178 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f09db4ac40 msgr2=0x55f09db4a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:32:51.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.352+0000 7fed66d9d700 1 --2- 172.21.15.82:0/2026795178 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f09db4ac40 0x55f09db4a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:32:51.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.352+0000 7fed66d9d700 1 -- 172.21.15.82:0/2026795178 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f09db50380 msgr2=0x55f09db5b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:32:51.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.352+0000 7fed66d9d700 1 --2- 172.21.15.82:0/2026795178 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f09db50380 0x55f09db5b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:32:51.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.352+0000 7fed66d9d700 1 -- 172.21.15.82:0/2026795178 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f09db6b930 con 0x55f09db50ca0 2023-09-23T09:32:51.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.352+0000 7fed65d9b700 1 --2- 172.21.15.82:0/2026795178 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f09db50380 0x55f09db5b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:32:51.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.352+0000 7fed66d9d700 1 --2- 172.21.15.82:0/2026795178 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f09db50ca0 0x55f09db54530 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fed60024d40 tx=0x7fed60003f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a91be221a6c93cd6 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:32:51.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.353+0000 7fed557fa700 1 -- 172.21.15.82:0/2026795178 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed6001f070 con 0x55f09db50ca0 2023-09-23T09:32:51.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.353+0000 7fed557fa700 1 -- 172.21.15.82:0/2026795178 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fed60031070 con 0x55f09db50ca0 2023-09-23T09:32:51.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.353+0000 7fed557fa700 1 -- 172.21.15.82:0/2026795178 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed60012040 con 0x55f09db50ca0 2023-09-23T09:32:51.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.354+0000 7fed809fab80 1 -- 172.21.15.82:0/2026795178 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f09db50ca0 msgr2=0x55f09db54530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:32:51.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.354+0000 7fed809fab80 1 --2- 172.21.15.82:0/2026795178 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f09db50ca0 0x55f09db54530 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fed60024d40 tx=0x7fed60003f00 comp rx=0 tx=0).stop 2023-09-23T09:32:51.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.354+0000 7fed809fab80 1 -- 172.21.15.82:0/2026795178 shutdown_connections 2023-09-23T09:32:51.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.354+0000 7fed809fab80 1 --2- 172.21.15.82:0/2026795178 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f09db50ca0 0x55f09db54530 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:32:51.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.354+0000 7fed809fab80 1 --2- 172.21.15.82:0/2026795178 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f09db4ac40 0x55f09db4a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:32:51.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.354+0000 7fed809fab80 1 --2- 172.21.15.82:0/2026795178 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f09db50380 0x55f09db5b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:32:51.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.354+0000 7fed809fab80 1 -- 172.21.15.82:0/2026795178 >> 172.21.15.82:0/2026795178 conn(0x55f09dabf0e0 msgr2=0x55f09db60b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:32:51.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.354+0000 7fed809fab80 1 -- 172.21.15.82:0/2026795178 shutdown_connections 2023-09-23T09:32:51.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.354+0000 7fed809fab80 1 -- 172.21.15.82:0/2026795178 wait complete. 2023-09-23T09:32:51.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.354+0000 7fed809fab80 1 -- start start 2023-09-23T09:32:51.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.354+0000 7fed809fab80 1 Processor -- start 2023-09-23T09:32:51.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.355+0000 7fed809fab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f09db4ac40 0x55f09db599a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:32:51.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.355+0000 7fed809fab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f09db50380 0x55f09db59ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:32:51.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.355+0000 7fed809fab80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f09db50ca0 0x55f09dbb36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:32:51.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.355+0000 7fed809fab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f09db5a5c0 con 0x55f09db50380 2023-09-23T09:32:51.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.355+0000 7fed809fab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f09dbb3c30 con 0x55f09db4ac40 2023-09-23T09:32:51.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.355+0000 7fed809fab80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f09dbb3df0 con 0x55f09db50ca0 2023-09-23T09:32:51.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.355+0000 7fed809fab80 10 client.0 _ll_register_callbacks cb 0x7fed60003da0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:32:51.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.355+0000 7fed65d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f09db50380 0x55f09db59ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:32:51.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.355+0000 7fed65d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f09db50380 0x55f09db59ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45012/0 (socket says 172.21.15.82:45012) 2023-09-23T09:32:51.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.355+0000 7fed65d9b700 1 -- 172.21.15.82:0/1981968854 learned_addr learned my addr 172.21.15.82:0/1981968854 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:32:51.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.355+0000 7fed66d9d700 1 --2- 172.21.15.82:0/1981968854 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f09db50ca0 0x55f09dbb36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:32:51.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.355+0000 7fed6659c700 1 --2- 172.21.15.82:0/1981968854 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f09db4ac40 0x55f09db599a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:32:51.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.356+0000 7fed65d9b700 1 -- 172.21.15.82:0/1981968854 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f09db50ca0 msgr2=0x55f09dbb36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:32:51.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.356+0000 7fed65d9b700 1 --2- 172.21.15.82:0/1981968854 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f09db50ca0 0x55f09dbb36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:32:51.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.356+0000 7fed65d9b700 1 -- 172.21.15.82:0/1981968854 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f09db4ac40 msgr2=0x55f09db599a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:32:51.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.356+0000 7fed65d9b700 1 --2- 172.21.15.82:0/1981968854 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f09db4ac40 0x55f09db599a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:32:51.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.356+0000 7fed65d9b700 1 -- 172.21.15.82:0/1981968854 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f09d91c630 con 0x55f09db50380 2023-09-23T09:32:51.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.356+0000 7fed66d9d700 1 --2- 172.21.15.82:0/1981968854 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f09db50ca0 0x55f09dbb36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:32:51.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.356+0000 7fed6659c700 1 --2- 172.21.15.82:0/1981968854 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f09db4ac40 0x55f09db599a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:32:51.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.357+0000 7fed65d9b700 1 --2- 172.21.15.82:0/1981968854 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f09db50380 0x55f09db59ee0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fed5c009990 tx=0x7fed5c00ba80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b81a3e9e25a3ff5a server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:32:51.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.357+0000 7fed4dffb700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:32:51.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.358+0000 7fed4dffb700 1 -- 172.21.15.82:0/1981968854 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed5c004500 con 0x55f09db50380 2023-09-23T09:32:51.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.358+0000 7fed809fab80 1 -- 172.21.15.82:0/1981968854 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f09db3d8b0 con 0x55f09db50380 2023-09-23T09:32:51.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.358+0000 7fed4dffb700 1 -- 172.21.15.82:0/1981968854 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(147..147 src has 1..147) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fed5c004660 con 0x55f09db50380 2023-09-23T09:32:51.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.359+0000 7fed4dffb700 1 -- 172.21.15.82:0/1981968854 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=106) v2 ==== 24+0+0 (secure 0 0 0) 0x7fed5c004820 con 0x55f09db50380 2023-09-23T09:32:51.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.359+0000 7fed809fab80 10 client.17841 fetch_fsmap learned FSMap version 106 2023-09-23T09:32:51.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.359+0000 7fed809fab80 1 -- 172.21.15.82:0/1981968854 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=106,monmap=4+}) v3 -- 0x55f09d8c8de0 con 0x55f09db50380 2023-09-23T09:32:51.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.359+0000 7fed4dffb700 1 -- 172.21.15.82:0/1981968854 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f09db3d8b0 con 0x55f09db50380 2023-09-23T09:32:51.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.359+0000 7fed4dffb700 1 -- 172.21.15.82:0/1981968854 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 106) v1 ==== 7946+0+0 (secure 0 0 0) 0x7fed5c02db20 con 0x55f09db50380 2023-09-23T09:32:51.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.359+0000 7fed809fab80 10 client.17841 fetch_fsmap finished waiting for FSMap version 106 2023-09-23T09:32:51.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.359+0000 7fed809fab80 10 client.17841 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:32:51.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.360+0000 7fed809fab80 20 client.17841 populate_metadata read hostname 'smithi082' 2023-09-23T09:32:51.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.360+0000 7fed809fab80 1 --2- 172.21.15.82:0/1981968854 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55f09dbc9ff0 0x55f09dbcc410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:32:51.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.360+0000 7fed809fab80 4 client.17841 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:32:51.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.360+0000 7fed809fab80 1 -- 172.21.15.82:0/1981968854 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55f09da95970 con 0x55f09dbc9ff0 2023-09-23T09:32:51.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.360+0000 7fed6659c700 1 --2- 172.21.15.82:0/1981968854 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55f09dbc9ff0 0x55f09dbcc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:32:51.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.361+0000 7fed6659c700 1 --2- 172.21.15.82:0/1981968854 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55f09dbc9ff0 0x55f09dbcc410 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b979dd9579a05928 server_cookie=cbf747e87f4a246a in_seq=0 out_seq=0 2023-09-23T09:32:51.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.361+0000 7fed4dffb700 10 client.17841 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:32:51.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.361+0000 7fed4dffb700 1 -- 172.21.15.82:0/1981968854 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55f09da95970 con 0x55f09dbc9ff0 2023-09-23T09:32:51.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.361+0000 7fed4dffb700 10 client.17841 handle_command_reply: tid=0 2023-09-23T09:32:51.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.361+0000 7fed809fab80 1 client.17841 shutdown 2023-09-23T09:32:51.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.361+0000 7fed809fab80 1 -- 172.21.15.82:0/1981968854 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f09db50380 msgr2=0x55f09db59ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:32:51.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.361+0000 7fed809fab80 1 --2- 172.21.15.82:0/1981968854 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f09db50380 0x55f09db59ee0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fed5c009990 tx=0x7fed5c00ba80 comp rx=0 tx=0).stop 2023-09-23T09:32:51.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.362+0000 7fed809fab80 1 -- 172.21.15.82:0/1981968854 shutdown_connections 2023-09-23T09:32:51.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.362+0000 7fed809fab80 1 --2- 172.21.15.82:0/1981968854 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f09db50ca0 0x55f09dbb36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:32:51.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.362+0000 7fed809fab80 1 --2- 172.21.15.82:0/1981968854 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f09db4ac40 0x55f09db599a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:32:51.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.362+0000 7fed809fab80 1 --2- 172.21.15.82:0/1981968854 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55f09dbc9ff0 0x55f09dbcc410 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:32:51.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.362+0000 7fed809fab80 1 --2- 172.21.15.82:0/1981968854 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f09db50380 0x55f09db59ee0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:32:51.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.362+0000 7fed809fab80 1 -- 172.21.15.82:0/1981968854 >> 172.21.15.82:0/1981968854 conn(0x55f09dabf0e0 msgr2=0x55f09db4e090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:32:51.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.362+0000 7fed4dffb700 0 client.17841 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:32:51.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.362+0000 7fed809fab80 1 -- 172.21.15.82:0/1981968854 shutdown_connections 2023-09-23T09:32:51.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.362+0000 7fed809fab80 1 -- 172.21.15.82:0/1981968854 wait complete. 2023-09-23T09:32:51.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.362+0000 7fed809fab80 20 client.17841 trim_cache size 0 max 16384 2023-09-23T09:32:51.365 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:32:51.365 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-23T09:32:51.366 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:32:51.366 INFO:teuthology.orchestra.run.smithi082.stdout: "2aec802a-e2df-49b3-a22a-82c491ba0c59": { 2023-09-23T09:32:51.366 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:32:51.366 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "2aec802a-e2df-49b3-a22a-82c491ba0c59", 2023-09-23T09:32:51.366 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:32:51.366 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:32:51.366 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:32:51.366 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:32:51.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.363+0000 7fed6cfff700 1 -- 172.21.15.82:0/1918323044 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fed500a0290 msgr2=0x7fed500a2750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:32:51.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.363+0000 7fed6cfff700 1 --2- 172.21.15.82:0/1918323044 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fed500a0290 0x7fed500a2750 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fed6000dfd0 tx=0x7fed6000d040 comp rx=0 tx=0).stop 2023-09-23T09:32:51.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.363+0000 7fed6cfff700 1 -- 172.21.15.82:0/1918323044 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed680ff760 msgr2=0x7fed681151e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:32:51.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.363+0000 7fed6cfff700 1 --2- 172.21.15.82:0/1918323044 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed680ff760 0x7fed681151e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fed58007bd0 tx=0x7fed58007f90 comp rx=0 tx=0).stop 2023-09-23T09:32:51.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.366+0000 7fed6cfff700 1 -- 172.21.15.82:0/1918323044 shutdown_connections 2023-09-23T09:32:51.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.366+0000 7fed6cfff700 1 --2- 172.21.15.82:0/1918323044 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fed500a0290 0x7fed500a2750 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:32:51.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.366+0000 7fed6cfff700 1 --2- 172.21.15.82:0/1918323044 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed68105770 0x7fed6810e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:32:51.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.366+0000 7fed6cfff700 1 --2- 172.21.15.82:0/1918323044 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed680ff760 0x7fed681151e0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:32:51.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.366+0000 7fed6cfff700 1 --2- 172.21.15.82:0/1918323044 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed68100120 0x7fed68115760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:32:51.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.366+0000 7fed6cfff700 1 -- 172.21.15.82:0/1918323044 >> 172.21.15.82:0/1918323044 conn(0x7fed680fb270 msgr2=0x7fed680fb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:32:51.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.366+0000 7fed6cfff700 1 -- 172.21.15.82:0/1918323044 shutdown_connections 2023-09-23T09:32:51.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:32:51.366+0000 7fed6cfff700 1 -- 172.21.15.82:0/1918323044 wait complete. 2023-09-23T09:32:51.407 INFO:tasks.cephfs.filesystem:scrub status for tag:2aec802a-e2df-49b3-a22a-82c491ba0c59 - {'path': '/', 'tag': '2aec802a-e2df-49b3-a22a-82c491ba0c59', 'options': 'recursive,force'} 2023-09-23T09:32:53.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:32:52 smithi135 ceph-mon[99205]: pgmap v1140: 97 pgs: 97 active+clean; 17 GiB data, 62 GiB used, 1010 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 8.6 MiB/s wr, 798 op/s 2023-09-23T09:32:53.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:32:52 smithi082 ceph-mon[97694]: pgmap v1140: 97 pgs: 97 active+clean; 17 GiB data, 62 GiB used, 1010 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 8.6 MiB/s wr, 798 op/s 2023-09-23T09:32:53.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:32:52 smithi161 ceph-mon[99580]: pgmap v1140: 97 pgs: 97 active+clean; 17 GiB data, 62 GiB used, 1010 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 8.6 MiB/s wr, 798 op/s 2023-09-23T09:32:55.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:32:54 smithi135 ceph-mon[99205]: pgmap v1141: 97 pgs: 97 active+clean; 17 GiB data, 62 GiB used, 1010 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 8.4 MiB/s wr, 768 op/s 2023-09-23T09:32:55.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:32:54 smithi082 ceph-mon[97694]: pgmap v1141: 97 pgs: 97 active+clean; 17 GiB data, 62 GiB used, 1010 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 8.4 MiB/s wr, 768 op/s 2023-09-23T09:32:55.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:32:54 smithi161 ceph-mon[99580]: pgmap v1141: 97 pgs: 97 active+clean; 17 GiB data, 62 GiB used, 1010 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 8.4 MiB/s wr, 768 op/s 2023-09-23T09:32:55.827 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 345.0 s, 504.2 tps, lat 195.687 ms stddev 80.744 2023-09-23T09:32:57.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:32:56 smithi135 ceph-mon[99205]: pgmap v1142: 97 pgs: 97 active+clean; 17 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 3.4 MiB/s rd, 14 MiB/s wr, 1.33k op/s 2023-09-23T09:32:57.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:32:56 smithi082 ceph-mon[97694]: pgmap v1142: 97 pgs: 97 active+clean; 17 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 3.4 MiB/s rd, 14 MiB/s wr, 1.33k op/s 2023-09-23T09:32:57.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:32:56 smithi161 ceph-mon[99580]: pgmap v1142: 97 pgs: 97 active+clean; 17 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 3.4 MiB/s rd, 14 MiB/s wr, 1.33k op/s 2023-09-23T09:32:58.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:32:58 smithi135 ceph-mon[99205]: pgmap v1143: 97 pgs: 97 active+clean; 17 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 12 MiB/s wr, 1.13k op/s 2023-09-23T09:32:58.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:32:58 smithi082 ceph-mon[97694]: pgmap v1143: 97 pgs: 97 active+clean; 17 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 12 MiB/s wr, 1.13k op/s 2023-09-23T09:32:58.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:32:58 smithi161 ceph-mon[99580]: pgmap v1143: 97 pgs: 97 active+clean; 17 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 12 MiB/s wr, 1.13k op/s 2023-09-23T09:33:00.830 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 350.0 s, 521.5 tps, lat 191.105 ms stddev 74.870 2023-09-23T09:33:01.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:33:00 smithi135 ceph-mon[99205]: pgmap v1144: 97 pgs: 97 active+clean; 17 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 3.8 MiB/s rd, 18 MiB/s wr, 1.61k op/s 2023-09-23T09:33:01.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:33:00 smithi082 ceph-mon[97694]: pgmap v1144: 97 pgs: 97 active+clean; 17 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 3.8 MiB/s rd, 18 MiB/s wr, 1.61k op/s 2023-09-23T09:33:01.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:33:00 smithi161 ceph-mon[99580]: pgmap v1144: 97 pgs: 97 active+clean; 17 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 3.8 MiB/s rd, 18 MiB/s wr, 1.61k op/s 2023-09-23T09:33:03.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:33:02 smithi135 ceph-mon[99205]: pgmap v1145: 97 pgs: 97 active+clean; 17 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 2.9 MiB/s rd, 13 MiB/s wr, 1.19k op/s 2023-09-23T09:33:03.122 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:33:02 smithi082 ceph-mon[97694]: pgmap v1145: 97 pgs: 97 active+clean; 17 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 2.9 MiB/s rd, 13 MiB/s wr, 1.19k op/s 2023-09-23T09:33:03.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:33:02 smithi161 ceph-mon[99580]: pgmap v1145: 97 pgs: 97 active+clean; 17 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 2.9 MiB/s rd, 13 MiB/s wr, 1.19k op/s 2023-09-23T09:33:05.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:33:04 smithi135 ceph-mon[99205]: pgmap v1146: 97 pgs: 97 active+clean; 17 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 12 MiB/s wr, 1.12k op/s 2023-09-23T09:33:05.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:33:04 smithi082 ceph-mon[97694]: pgmap v1146: 97 pgs: 97 active+clean; 17 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 12 MiB/s wr, 1.12k op/s 2023-09-23T09:33:05.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:33:04 smithi161 ceph-mon[99580]: pgmap v1146: 97 pgs: 97 active+clean; 17 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 12 MiB/s wr, 1.12k op/s 2023-09-23T09:33:05.827 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 355.0 s, 392.7 tps, lat 245.022 ms stddev 262.578 2023-09-23T09:33:07.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:33:06 smithi135 ceph-mon[99205]: pgmap v1147: 97 pgs: 97 active+clean; 17 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 3.8 MiB/s rd, 18 MiB/s wr, 1.59k op/s 2023-09-23T09:33:07.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:33:06 smithi082 ceph-mon[97694]: pgmap v1147: 97 pgs: 97 active+clean; 17 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 3.8 MiB/s rd, 18 MiB/s wr, 1.59k op/s 2023-09-23T09:33:07.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:33:06 smithi161 ceph-mon[99580]: pgmap v1147: 97 pgs: 97 active+clean; 17 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 3.8 MiB/s rd, 18 MiB/s wr, 1.59k op/s 2023-09-23T09:33:08.123 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:33:07 smithi082 ceph-mon[97694]: osdmap e148: 12 total, 12 up, 12 in 2023-09-23T09:33:08.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:33:07 smithi161 ceph-mon[99580]: osdmap e148: 12 total, 12 up, 12 in 2023-09-23T09:33:08.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:33:07 smithi135 ceph-mon[99205]: osdmap e148: 12 total, 12 up, 12 in 2023-09-23T09:33:09.131 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:33:08 smithi082 ceph-mon[97694]: pgmap v1149: 97 pgs: 97 active+clean; 17 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 2.8 MiB/s rd, 14 MiB/s wr, 1.24k op/s 2023-09-23T09:33:09.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:33:08 smithi161 ceph-mon[99580]: pgmap v1149: 97 pgs: 97 active+clean; 17 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 2.8 MiB/s rd, 14 MiB/s wr, 1.24k op/s 2023-09-23T09:33:09.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:33:08 smithi135 ceph-mon[99205]: pgmap v1149: 97 pgs: 97 active+clean; 17 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 2.8 MiB/s rd, 14 MiB/s wr, 1.24k op/s 2023-09-23T09:33:10.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 360.0 s, 231.4 tps, lat 446.278 ms stddev 534.107 2023-09-23T09:33:11.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:33:10 smithi082 ceph-mon[97694]: pgmap v1150: 97 pgs: 12 active+clean+snaptrim, 62 active+clean, 23 active+clean+snaptrim_wait; 16 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 10 MiB/s wr, 958 op/s 2023-09-23T09:33:11.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:33:10 smithi161 ceph-mon[99580]: pgmap v1150: 97 pgs: 12 active+clean+snaptrim, 62 active+clean, 23 active+clean+snaptrim_wait; 16 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 10 MiB/s wr, 958 op/s 2023-09-23T09:33:11.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:33:10 smithi135 ceph-mon[99205]: pgmap v1150: 97 pgs: 12 active+clean+snaptrim, 62 active+clean, 23 active+clean+snaptrim_wait; 16 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 10 MiB/s wr, 958 op/s 2023-09-23T09:33:13.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:33:12 smithi161 ceph-mon[99580]: pgmap v1151: 97 pgs: 15 active+clean+snaptrim, 54 active+clean, 28 active+clean+snaptrim_wait; 16 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 9.8 MiB/s wr, 919 op/s 2023-09-23T09:33:13.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:33:12 smithi135 ceph-mon[99205]: pgmap v1151: 97 pgs: 15 active+clean+snaptrim, 54 active+clean, 28 active+clean+snaptrim_wait; 16 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 9.8 MiB/s wr, 919 op/s 2023-09-23T09:33:13.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:33:12 smithi082 ceph-mon[97694]: pgmap v1151: 97 pgs: 15 active+clean+snaptrim, 54 active+clean, 28 active+clean+snaptrim_wait; 16 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 9.8 MiB/s wr, 919 op/s 2023-09-23T09:33:15.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:33:14 smithi161 ceph-mon[99580]: pgmap v1152: 97 pgs: 15 active+clean+snaptrim, 54 active+clean, 28 active+clean+snaptrim_wait; 16 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 9.9 MiB/s wr, 919 op/s 2023-09-23T09:33:15.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:33:14 smithi135 ceph-mon[99205]: pgmap v1152: 97 pgs: 15 active+clean+snaptrim, 54 active+clean, 28 active+clean+snaptrim_wait; 16 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 9.9 MiB/s wr, 919 op/s 2023-09-23T09:33:15.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:33:14 smithi082 ceph-mon[97694]: pgmap v1152: 97 pgs: 15 active+clean+snaptrim, 54 active+clean, 28 active+clean+snaptrim_wait; 16 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 9.9 MiB/s wr, 919 op/s 2023-09-23T09:33:15.829 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 365.0 s, 448.6 tps, lat 223.217 ms stddev 158.198 2023-09-23T09:33:17.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:33:16 smithi161 ceph-mon[99580]: pgmap v1153: 97 pgs: 97 active+clean; 15 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 9.5 MiB/s wr, 890 op/s 2023-09-23T09:33:17.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:33:16 smithi135 ceph-mon[99205]: pgmap v1153: 97 pgs: 97 active+clean; 15 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 9.5 MiB/s wr, 890 op/s 2023-09-23T09:33:17.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:33:16 smithi082 ceph-mon[97694]: pgmap v1153: 97 pgs: 97 active+clean; 15 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 9.5 MiB/s wr, 890 op/s 2023-09-23T09:33:18.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:33:18 smithi135 ceph-mon[99205]: osdmap e149: 12 total, 12 up, 12 in 2023-09-23T09:33:18.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:33:18 smithi135 ceph-mon[99205]: pgmap v1155: 97 pgs: 97 active+clean; 15 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 9.5 MiB/s wr, 890 op/s 2023-09-23T09:33:18.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:33:18 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:33:18.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:33:18 smithi082 ceph-mon[97694]: osdmap e149: 12 total, 12 up, 12 in 2023-09-23T09:33:18.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:33:18 smithi082 ceph-mon[97694]: pgmap v1155: 97 pgs: 97 active+clean; 15 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 9.5 MiB/s wr, 890 op/s 2023-09-23T09:33:18.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:33:18 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:33:18.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:33:18 smithi161 ceph-mon[99580]: osdmap e149: 12 total, 12 up, 12 in 2023-09-23T09:33:18.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:33:18 smithi161 ceph-mon[99580]: pgmap v1155: 97 pgs: 97 active+clean; 15 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 9.5 MiB/s wr, 890 op/s 2023-09-23T09:33:18.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:33:18 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:33:20.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 370.0 s, 513.5 tps, lat 192.759 ms stddev 80.451 2023-09-23T09:33:21.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:33:20 smithi135 ceph-mon[99205]: pgmap v1156: 97 pgs: 97 active+clean; 16 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 13 MiB/s wr, 1.17k op/s 2023-09-23T09:33:21.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:33:20 smithi082 ceph-mon[97694]: pgmap v1156: 97 pgs: 97 active+clean; 16 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 13 MiB/s wr, 1.17k op/s 2023-09-23T09:33:21.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:33:20 smithi161 ceph-mon[99580]: pgmap v1156: 97 pgs: 97 active+clean; 16 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 13 MiB/s wr, 1.17k op/s 2023-09-23T09:33:21.408 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:33:21.769 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:33:21 smithi082 ceph-mon[97694]: scrub summary: idle+waiting paths [/] 2023-09-23T09:33:21.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.792+0000 7f0eff5ff700 1 -- 172.21.15.82:0/416789948 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ef8074e50 msgr2=0x7f0ef8075230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:33:21.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.792+0000 7f0eff5ff700 1 --2- 172.21.15.82:0/416789948 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ef8074e50 0x7f0ef8075230 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f0eec00b0a0 tx=0x7f0eec00b3b0 comp rx=0 tx=0).stop 2023-09-23T09:33:21.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.792+0000 7f0eff5ff700 1 -- 172.21.15.82:0/416789948 shutdown_connections 2023-09-23T09:33:21.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.792+0000 7f0eff5ff700 1 --2- 172.21.15.82:0/416789948 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ef8111740 0x7f0ef8113b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:21.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.792+0000 7f0eff5ff700 1 --2- 172.21.15.82:0/416789948 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ef8074e50 0x7f0ef8075230 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:21.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.792+0000 7f0eff5ff700 1 --2- 172.21.15.82:0/416789948 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0ef8075770 0x7f0ef8111200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:21.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.792+0000 7f0eff5ff700 1 -- 172.21.15.82:0/416789948 >> 172.21.15.82:0/416789948 conn(0x7f0ef80fe570 msgr2=0x7f0ef8100990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:33:21.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.793+0000 7f0eff5ff700 1 -- 172.21.15.82:0/416789948 shutdown_connections 2023-09-23T09:33:21.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.793+0000 7f0eff5ff700 1 -- 172.21.15.82:0/416789948 wait complete. 2023-09-23T09:33:21.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.794+0000 7f0eff5ff700 1 Processor -- start 2023-09-23T09:33:21.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.794+0000 7f0eff5ff700 1 -- start start 2023-09-23T09:33:21.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.794+0000 7f0eff5ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ef8074e50 0x7f0ef8071f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:21.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.795+0000 7f0eff5ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ef8075770 0x7f0ef80724a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:21.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.795+0000 7f0eff5ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0ef8111740 0x7f0ef806b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:21.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.795+0000 7f0eff5ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef806b820 con 0x7f0ef8074e50 2023-09-23T09:33:21.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.795+0000 7f0eff5ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef806b990 con 0x7f0ef8075770 2023-09-23T09:33:21.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.795+0000 7f0eff5ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef806bb50 con 0x7f0ef8111740 2023-09-23T09:33:21.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.795+0000 7f0efd39b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ef8074e50 0x7f0ef8071f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:21.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.795+0000 7f0efd39b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ef8074e50 0x7f0ef8071f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39114/0 (socket says 172.21.15.82:39114) 2023-09-23T09:33:21.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.795+0000 7f0efd39b700 1 -- 172.21.15.82:0/1410797740 learned_addr learned my addr 172.21.15.82:0/1410797740 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:33:21.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.796+0000 7f0efd39b700 1 -- 172.21.15.82:0/1410797740 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0ef8111740 msgr2=0x7f0ef806b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:33:21.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.796+0000 7f0efd39b700 1 --2- 172.21.15.82:0/1410797740 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0ef8111740 0x7f0ef806b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:21.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.796+0000 7f0efd39b700 1 -- 172.21.15.82:0/1410797740 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ef8075770 msgr2=0x7f0ef80724a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-09-23T09:33:21.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.796+0000 7f0efd39b700 1 --2- 172.21.15.82:0/1410797740 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ef8075770 0x7f0ef80724a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:21.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.796+0000 7f0efd39b700 1 -- 172.21.15.82:0/1410797740 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eec009d00 con 0x7f0ef8074e50 2023-09-23T09:33:21.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.798+0000 7f0efd39b700 1 --2- 172.21.15.82:0/1410797740 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ef8074e50 0x7f0ef8071f20 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f0eec006070 tx=0x7f0eec004db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:33:21.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.799+0000 7f0ef67fc700 1 -- 172.21.15.82:0/1410797740 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eec00e040 con 0x7f0ef8074e50 2023-09-23T09:33:21.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.799+0000 7f0ef67fc700 1 -- 172.21.15.82:0/1410797740 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0eec003e90 con 0x7f0ef8074e50 2023-09-23T09:33:21.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.799+0000 7f0ef67fc700 1 -- 172.21.15.82:0/1410797740 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eec004020 con 0x7f0ef8074e50 2023-09-23T09:33:21.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.799+0000 7f0eff5ff700 1 -- 172.21.15.82:0/1410797740 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ef806bd70 con 0x7f0ef8074e50 2023-09-23T09:33:21.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.799+0000 7f0eff5ff700 1 -- 172.21.15.82:0/1410797740 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ef806fd50 con 0x7f0ef8074e50 2023-09-23T09:33:21.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.806+0000 7f0f12f1fb80 1 Processor -- start 2023-09-23T09:33:21.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.807+0000 7f0f12f1fb80 1 -- start start 2023-09-23T09:33:21.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.807+0000 7f0f12f1fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c02de6c380 0x55c02de6c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:21.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.807+0000 7f0f12f1fb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c02de6cca0 0x55c02de66700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:21.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.807+0000 7f0f12f1fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c02de66c40 0x55c02de670a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:21.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.807+0000 7f0f12f1fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c02ddce7b0 con 0x55c02de6c380 2023-09-23T09:33:21.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.807+0000 7f0f12f1fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c02ddbf780 con 0x55c02de66c40 2023-09-23T09:33:21.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.807+0000 7f0f12f1fb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c02ddbd0a0 con 0x55c02de6cca0 2023-09-23T09:33:21.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.807+0000 7f0efdb9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c02de6c380 0x55c02de6c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:21.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.807+0000 7f0efdb9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c02de6c380 0x55c02de6c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39118/0 (socket says 172.21.15.82:39118) 2023-09-23T09:33:21.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.807+0000 7f0efdb9c700 1 -- 172.21.15.82:0/3524309157 learned_addr learned my addr 172.21.15.82:0/3524309157 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:33:21.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.808+0000 7f0efcb9a700 1 --2- 172.21.15.82:0/3524309157 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c02de66c40 0x55c02de670a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:21.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.808+0000 7f0efdb9c700 1 -- 172.21.15.82:0/3524309157 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c02de6cca0 msgr2=0x55c02de66700 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-23T09:33:21.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.808+0000 7f0efdb9c700 1 --2- 172.21.15.82:0/3524309157 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c02de6cca0 0x55c02de66700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:21.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.808+0000 7f0efdb9c700 1 -- 172.21.15.82:0/3524309157 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c02de66c40 msgr2=0x55c02de670a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:33:21.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.808+0000 7f0efdb9c700 1 --2- 172.21.15.82:0/3524309157 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c02de66c40 0x55c02de670a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:21.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.808+0000 7f0efdb9c700 1 -- 172.21.15.82:0/3524309157 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c02dc38630 con 0x55c02de6c380 2023-09-23T09:33:21.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.808+0000 7f0ef67fc700 1 -- 172.21.15.82:0/1410797740 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f0eec01b660 con 0x7f0ef8074e50 2023-09-23T09:33:21.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.808+0000 7f0efdb9c700 1 --2- 172.21.15.82:0/3524309157 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c02de6c380 0x55c02de6c760 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f0ef000ba70 tx=0x7f0ef000bd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0a1533f7c3f05c2 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:33:21.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.809+0000 7f0ee37fe700 1 -- 172.21.15.82:0/3524309157 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef0004a30 con 0x55c02de6c380 2023-09-23T09:33:21.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.809+0000 7f0ee37fe700 1 -- 172.21.15.82:0/3524309157 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0ef000b520 con 0x55c02de6c380 2023-09-23T09:33:21.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.809+0000 7f0ee37fe700 1 -- 172.21.15.82:0/3524309157 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef0005390 con 0x55c02de6c380 2023-09-23T09:33:21.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.810+0000 7f0f12f1fb80 1 -- 172.21.15.82:0/3524309157 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c02de6c380 msgr2=0x55c02de6c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:33:21.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.810+0000 7f0f12f1fb80 1 --2- 172.21.15.82:0/3524309157 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c02de6c380 0x55c02de6c760 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f0ef000ba70 tx=0x7f0ef000bd80 comp rx=0 tx=0).stop 2023-09-23T09:33:21.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.810+0000 7f0f12f1fb80 1 -- 172.21.15.82:0/3524309157 shutdown_connections 2023-09-23T09:33:21.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.810+0000 7f0f12f1fb80 1 --2- 172.21.15.82:0/3524309157 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c02de66c40 0x55c02de670a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:21.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.810+0000 7f0f12f1fb80 1 --2- 172.21.15.82:0/3524309157 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c02de6c380 0x55c02de6c760 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:21.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.810+0000 7f0f12f1fb80 1 --2- 172.21.15.82:0/3524309157 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c02de6cca0 0x55c02de66700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:21.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.810+0000 7f0f12f1fb80 1 -- 172.21.15.82:0/3524309157 >> 172.21.15.82:0/3524309157 conn(0x55c02dddb0e0 msgr2=0x55c02de61410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:33:21.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.810+0000 7f0ef67fc700 1 --2- 172.21.15.82:0/1410797740 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f0ee80a01c0 0x7f0ee80a2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:21.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.811+0000 7f0ef67fc700 1 -- 172.21.15.82:0/1410797740 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f0eec0cc740 con 0x7f0ef8074e50 2023-09-23T09:33:21.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.811+0000 7f0f12f1fb80 1 -- 172.21.15.82:0/3524309157 shutdown_connections 2023-09-23T09:33:21.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.811+0000 7f0f12f1fb80 1 -- 172.21.15.82:0/3524309157 wait complete. 2023-09-23T09:33:21.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.811+0000 7f0f12f1fb80 1 -- start start 2023-09-23T09:33:21.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.812+0000 7f0f12f1fb80 1 Processor -- start 2023-09-23T09:33:21.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.812+0000 7f0efcb9a700 1 --2- 172.21.15.82:0/1410797740 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f0ee80a01c0 0x7f0ee80a2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:21.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.813+0000 7f0f12f1fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c02de66c40 0x55c02de72c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:21.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.813+0000 7f0f12f1fb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c02de6c380 0x55c02de6fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:21.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.813+0000 7f0f12f1fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c02de6cca0 0x55c02de705d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:21.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.813+0000 7f0f12f1fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c02ddb8990 con 0x55c02de66c40 2023-09-23T09:33:21.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.813+0000 7f0f12f1fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c02dd56bb0 con 0x55c02de6cca0 2023-09-23T09:33:21.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.813+0000 7f0f12f1fb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c02dd568b0 con 0x55c02de6c380 2023-09-23T09:33:21.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.813+0000 7f0efcb9a700 1 --2- 172.21.15.82:0/1410797740 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f0ee80a01c0 0x7f0ee80a2680 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0ee4005950 tx=0x7f0ee400b390 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:33:21.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.813+0000 7f0f12f1fb80 10 client.0 _ll_register_callbacks cb 0x55c02dca0a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:33:21.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.814+0000 7f0efcb9a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c02de6c380 0x55c02de6fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:21.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.814+0000 7f0efd39b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c02de66c40 0x55c02de72c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:21.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.814+0000 7f0efcb9a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c02de6c380 0x55c02de6fe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:51124/0 (socket says 172.21.15.82:51124) 2023-09-23T09:33:21.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.814+0000 7f0efcb9a700 1 -- 172.21.15.82:0/3293891433 learned_addr learned my addr 172.21.15.82:0/3293891433 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:33:21.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.814+0000 7f0efdb9c700 1 --2- 172.21.15.82:0/3293891433 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c02de6cca0 0x55c02de705d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:21.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.814+0000 7f0efd39b700 1 -- 172.21.15.82:0/3293891433 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c02de6c380 msgr2=0x55c02de6fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:33:21.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.814+0000 7f0efd39b700 1 --2- 172.21.15.82:0/3293891433 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c02de6c380 0x55c02de6fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:21.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.814+0000 7f0efd39b700 1 -- 172.21.15.82:0/3293891433 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c02de6cca0 msgr2=0x55c02de705d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:33:21.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.814+0000 7f0efd39b700 1 --2- 172.21.15.82:0/3293891433 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c02de6cca0 0x55c02de705d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:21.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.814+0000 7f0efd39b700 1 -- 172.21.15.82:0/3293891433 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ef000b6a0 con 0x55c02de66c40 2023-09-23T09:33:21.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.815+0000 7f0efdb9c700 1 --2- 172.21.15.82:0/3293891433 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c02de6cca0 0x55c02de705d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:33:21.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.815+0000 7f0efd39b700 1 --2- 172.21.15.82:0/3293891433 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c02de66c40 0x55c02de72c50 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f0eec0c9e30 tx=0x7f0eec0961c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8355b5f5d2e58bb9 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:33:21.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.816+0000 7f0ee0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:33:21.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.816+0000 7f0ee0ff9700 1 -- 172.21.15.82:0/3293891433 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eec09a2e0 con 0x55c02de66c40 2023-09-23T09:33:21.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.816+0000 7f0ee0ff9700 1 -- 172.21.15.82:0/3293891433 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(149..149 src has 1..149) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f0eec09a580 con 0x55c02de66c40 2023-09-23T09:33:21.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.816+0000 7f0f12f1fb80 1 -- 172.21.15.82:0/3293891433 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c02de361c0 con 0x55c02de66c40 2023-09-23T09:33:21.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.817+0000 7f0ee0ff9700 1 -- 172.21.15.82:0/3293891433 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=107) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0eec0999c0 con 0x55c02de66c40 2023-09-23T09:33:21.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.817+0000 7f0f12f1fb80 10 client.17853 fetch_fsmap learned FSMap version 107 2023-09-23T09:33:21.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.817+0000 7f0f12f1fb80 1 -- 172.21.15.82:0/3293891433 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=107,monmap=4+}) v3 -- 0x55c02dbe4de0 con 0x55c02de66c40 2023-09-23T09:33:21.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.817+0000 7f0ee0ff9700 1 -- 172.21.15.82:0/3293891433 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55c02de361c0 con 0x55c02de66c40 2023-09-23T09:33:21.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.818+0000 7f0ee0ff9700 1 -- 172.21.15.82:0/3293891433 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 107) v1 ==== 7942+0+0 (secure 0 0 0) 0x7f0eec099370 con 0x55c02de66c40 2023-09-23T09:33:21.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.818+0000 7f0f12f1fb80 10 client.17853 fetch_fsmap finished waiting for FSMap version 107 2023-09-23T09:33:21.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.818+0000 7f0f12f1fb80 10 client.17853 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:33:21.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.818+0000 7f0f12f1fb80 20 client.17853 populate_metadata read hostname 'smithi082' 2023-09-23T09:33:21.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.818+0000 7f0f12f1fb80 1 --2- 172.21.15.82:0/3293891433 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55c02de91430 0x55c02de93850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:21.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.818+0000 7f0f12f1fb80 4 client.17853 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:33:21.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.818+0000 7f0f12f1fb80 1 -- 172.21.15.82:0/3293891433 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c02dd5eba0 con 0x55c02de91430 2023-09-23T09:33:21.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.818+0000 7f0efcb9a700 1 --2- 172.21.15.82:0/3293891433 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55c02de91430 0x55c02de93850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:21.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.819+0000 7f0efcb9a700 1 --2- 172.21.15.82:0/3293891433 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55c02de91430 0x55c02de93850 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=57de37c79cc896e5 server_cookie=9dd42f36b3813856 in_seq=0 out_seq=0 2023-09-23T09:33:21.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.819+0000 7f0ee0ff9700 10 client.17853 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:33:21.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.820+0000 7f0ee0ff9700 1 -- 172.21.15.82:0/3293891433 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c02dd5eba0 con 0x55c02de91430 2023-09-23T09:33:21.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.820+0000 7f0ee0ff9700 10 client.17853 handle_command_reply: tid=0 2023-09-23T09:33:21.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.820+0000 7f0f12f1fb80 1 client.17853 shutdown 2023-09-23T09:33:21.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.821+0000 7f0f12f1fb80 1 -- 172.21.15.82:0/3293891433 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c02de66c40 msgr2=0x55c02de72c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:33:21.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.821+0000 7f0f12f1fb80 1 --2- 172.21.15.82:0/3293891433 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c02de66c40 0x55c02de72c50 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f0eec0c9e30 tx=0x7f0eec0961c0 comp rx=0 tx=0).stop 2023-09-23T09:33:21.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.825+0000 7f0f12f1fb80 1 -- 172.21.15.82:0/3293891433 shutdown_connections 2023-09-23T09:33:21.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.825+0000 7f0f12f1fb80 1 --2- 172.21.15.82:0/3293891433 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c02de6cca0 0x55c02de705d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:21.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.825+0000 7f0f12f1fb80 1 --2- 172.21.15.82:0/3293891433 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55c02de91430 0x55c02de93850 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:21.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.825+0000 7f0f12f1fb80 1 --2- 172.21.15.82:0/3293891433 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c02de66c40 0x55c02de72c50 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:21.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.825+0000 7f0f12f1fb80 1 --2- 172.21.15.82:0/3293891433 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c02de6c380 0x55c02de6fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:21.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.825+0000 7f0f12f1fb80 1 -- 172.21.15.82:0/3293891433 >> 172.21.15.82:0/3293891433 conn(0x55c02dddb0e0 msgr2=0x55c02de5bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:33:21.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.825+0000 7f0ee0ff9700 0 client.17853 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:33:21.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.826+0000 7f0f12f1fb80 1 -- 172.21.15.82:0/3293891433 shutdown_connections 2023-09-23T09:33:21.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.827+0000 7f0f12f1fb80 1 -- 172.21.15.82:0/3293891433 wait complete. 2023-09-23T09:33:21.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.833+0000 7f0f12f1fb80 20 client.17853 trim_cache size 0 max 16384 2023-09-23T09:33:21.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.865+0000 7f0f12f1fb80 1 Processor -- start 2023-09-23T09:33:21.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.866+0000 7f0f12f1fb80 1 -- start start 2023-09-23T09:33:21.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.866+0000 7f0f12f1fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c02de66c40 0x55c02de77820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:21.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.866+0000 7f0f12f1fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c02de6c380 0x55c02de727b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:21.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.866+0000 7f0f12f1fb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c02de6cca0 0x55c02de68e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:21.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.866+0000 7f0f12f1fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c02dc3a920 con 0x55c02de66c40 2023-09-23T09:33:21.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.866+0000 7f0f12f1fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c02de73620 con 0x55c02de6c380 2023-09-23T09:33:21.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.866+0000 7f0f12f1fb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c02de5d890 con 0x55c02de6cca0 2023-09-23T09:33:21.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.866+0000 7f0efcb9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c02de6c380 0x55c02de727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:21.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.867+0000 7f0efcb9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c02de6c380 0x55c02de727b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:57728/0 (socket says 172.21.15.82:57728) 2023-09-23T09:33:21.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.867+0000 7f0efd39b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c02de66c40 0x55c02de77820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:21.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.867+0000 7f0efcb9a700 1 -- 172.21.15.82:0/420404629 learned_addr learned my addr 172.21.15.82:0/420404629 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:33:21.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.867+0000 7f0efdb9c700 1 --2- 172.21.15.82:0/420404629 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c02de6cca0 0x55c02de68e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:21.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.867+0000 7f0efcb9a700 1 -- 172.21.15.82:0/420404629 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c02de6cca0 msgr2=0x55c02de68e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:33:21.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.867+0000 7f0efcb9a700 1 --2- 172.21.15.82:0/420404629 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c02de6cca0 0x55c02de68e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:21.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.867+0000 7f0efcb9a700 1 -- 172.21.15.82:0/420404629 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c02de66c40 msgr2=0x55c02de77820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:33:21.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.867+0000 7f0efcb9a700 1 --2- 172.21.15.82:0/420404629 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c02de66c40 0x55c02de77820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:21.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.867+0000 7f0efcb9a700 1 -- 172.21.15.82:0/420404629 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c02dbcdc60 con 0x55c02de6c380 2023-09-23T09:33:21.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.867+0000 7f0efcb9a700 1 --2- 172.21.15.82:0/420404629 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c02de6c380 0x55c02de727b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f0ee400b660 tx=0x7f0ee4013000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d137d3640b72fdc server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:33:21.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.868+0000 7f0ee3fff700 1 -- 172.21.15.82:0/420404629 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee4025070 con 0x55c02de6c380 2023-09-23T09:33:21.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.868+0000 7f0ee3fff700 1 -- 172.21.15.82:0/420404629 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0ee4015070 con 0x55c02de6c380 2023-09-23T09:33:21.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.868+0000 7f0ee3fff700 1 -- 172.21.15.82:0/420404629 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee4026a90 con 0x55c02de6c380 2023-09-23T09:33:21.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.868+0000 7f0f12f1fb80 1 -- 172.21.15.82:0/420404629 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c02de6c380 msgr2=0x55c02de727b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:33:21.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.868+0000 7f0f12f1fb80 1 --2- 172.21.15.82:0/420404629 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c02de6c380 0x55c02de727b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f0ee400b660 tx=0x7f0ee4013000 comp rx=0 tx=0).stop 2023-09-23T09:33:21.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.868+0000 7f0f12f1fb80 1 -- 172.21.15.82:0/420404629 shutdown_connections 2023-09-23T09:33:21.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.868+0000 7f0f12f1fb80 1 --2- 172.21.15.82:0/420404629 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c02de6cca0 0x55c02de68e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:21.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.868+0000 7f0f12f1fb80 1 --2- 172.21.15.82:0/420404629 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c02de66c40 0x55c02de77820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:21.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.868+0000 7f0f12f1fb80 1 --2- 172.21.15.82:0/420404629 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c02de6c380 0x55c02de727b0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:21.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.869+0000 7f0f12f1fb80 1 -- 172.21.15.82:0/420404629 >> 172.21.15.82:0/420404629 conn(0x55c02dddb0e0 msgr2=0x55c02de69ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:33:21.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.869+0000 7f0f12f1fb80 1 -- 172.21.15.82:0/420404629 shutdown_connections 2023-09-23T09:33:21.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.869+0000 7f0f12f1fb80 1 -- 172.21.15.82:0/420404629 wait complete. 2023-09-23T09:33:21.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.870+0000 7f0f12f1fb80 1 -- start start 2023-09-23T09:33:21.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.870+0000 7f0f12f1fb80 1 Processor -- start 2023-09-23T09:33:21.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.871+0000 7f0f12f1fb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c02de66c40 0x55c02de77390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:21.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.871+0000 7f0f12f1fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c02de6c380 0x55c02de75800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:21.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.871+0000 7f0f12f1fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c02de6cca0 0x55c02de75d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:21.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.871+0000 7f0f12f1fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c02de76280 con 0x55c02de6c380 2023-09-23T09:33:21.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.871+0000 7f0f12f1fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c02de763f0 con 0x55c02de6cca0 2023-09-23T09:33:21.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.871+0000 7f0f12f1fb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c02de765b0 con 0x55c02de66c40 2023-09-23T09:33:21.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.871+0000 7f0f12f1fb80 10 client.0 _ll_register_callbacks cb 0x7f0eec01bf00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:33:21.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.871+0000 7f0efd39b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c02de66c40 0x55c02de77390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:21.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.871+0000 7f0efd39b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c02de66c40 0x55c02de77390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:51138/0 (socket says 172.21.15.82:51138) 2023-09-23T09:33:21.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.871+0000 7f0efd39b700 1 -- 172.21.15.82:0/1318976896 learned_addr learned my addr 172.21.15.82:0/1318976896 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:33:21.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.871+0000 7f0efcb9a700 1 --2- 172.21.15.82:0/1318976896 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c02de6c380 0x55c02de75800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:21.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.871+0000 7f0efdb9c700 1 --2- 172.21.15.82:0/1318976896 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c02de6cca0 0x55c02de75d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:21.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.872+0000 7f0efd39b700 1 -- 172.21.15.82:0/1318976896 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c02de6cca0 msgr2=0x55c02de75d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:33:21.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.872+0000 7f0efd39b700 1 --2- 172.21.15.82:0/1318976896 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c02de6cca0 0x55c02de75d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:21.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.872+0000 7f0efd39b700 1 -- 172.21.15.82:0/1318976896 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c02de6c380 msgr2=0x55c02de75800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:33:21.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.872+0000 7f0efd39b700 1 --2- 172.21.15.82:0/1318976896 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c02de6c380 0x55c02de75800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:21.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.872+0000 7f0efd39b700 1 -- 172.21.15.82:0/1318976896 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ee4003720 con 0x55c02de66c40 2023-09-23T09:33:21.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.872+0000 7f0efd39b700 1 --2- 172.21.15.82:0/1318976896 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c02de66c40 0x55c02de77390 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f0eec099e10 tx=0x7f0eec09a470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1955e5e9477b4da3 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:33:21.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.873+0000 7f0ee0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T09:33:21.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.873+0000 7f0ee0ff9700 1 -- 172.21.15.82:0/1318976896 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eec019350 con 0x55c02de66c40 2023-09-23T09:33:21.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.873+0000 7f0ee0ff9700 1 -- 172.21.15.82:0/1318976896 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(149..149 src has 1..149) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f0eec0b3020 con 0x55c02de66c40 2023-09-23T09:33:21.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.873+0000 7f0f12f1fb80 1 -- 172.21.15.82:0/1318976896 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c02de598b0 con 0x55c02de66c40 2023-09-23T09:33:21.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.873+0000 7f0ee0ff9700 1 -- 172.21.15.82:0/1318976896 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=107) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0eec0999c0 con 0x55c02de66c40 2023-09-23T09:33:21.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.873+0000 7f0f12f1fb80 10 client.27601 fetch_fsmap learned FSMap version 107 2023-09-23T09:33:21.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.873+0000 7f0f12f1fb80 1 -- 172.21.15.82:0/1318976896 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=107,monmap=4+}) v3 -- 0x55c02dc0b250 con 0x55c02de66c40 2023-09-23T09:33:21.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.874+0000 7f0ee0ff9700 1 -- 172.21.15.82:0/1318976896 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55c02de598b0 con 0x55c02de66c40 2023-09-23T09:33:21.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.874+0000 7f0ee0ff9700 1 -- 172.21.15.82:0/1318976896 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 107) v1 ==== 7942+0+0 (secure 0 0 0) 0x7f0eec095c70 con 0x55c02de66c40 2023-09-23T09:33:21.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.875+0000 7f0f12f1fb80 10 client.27601 fetch_fsmap finished waiting for FSMap version 107 2023-09-23T09:33:21.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.875+0000 7f0f12f1fb80 10 client.27601 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:33:21.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.875+0000 7f0f12f1fb80 20 client.27601 populate_metadata read hostname 'smithi082' 2023-09-23T09:33:21.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.875+0000 7f0f12f1fb80 1 --2- 172.21.15.82:0/1318976896 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55c02dee6220 0x55c02dee8640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:21.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.875+0000 7f0f12f1fb80 4 client.27601 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:33:21.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.875+0000 7f0f12f1fb80 1 -- 172.21.15.82:0/1318976896 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55c02ddb1970 con 0x55c02dee6220 2023-09-23T09:33:21.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.875+0000 7f0efcb9a700 1 --2- 172.21.15.82:0/1318976896 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55c02dee6220 0x55c02dee8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:21.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.876+0000 7f0efcb9a700 1 --2- 172.21.15.82:0/1318976896 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55c02dee6220 0x55c02dee8640 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a8199d5732edb9c4 server_cookie=82aa747afee2ee21 in_seq=0 out_seq=0 2023-09-23T09:33:21.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.876+0000 7f0ee0ff9700 10 client.27601 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:33:21.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.876+0000 7f0ee0ff9700 1 -- 172.21.15.82:0/1318976896 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55c02ddb1970 con 0x55c02dee6220 2023-09-23T09:33:21.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.876+0000 7f0ee0ff9700 10 client.27601 handle_command_reply: tid=0 2023-09-23T09:33:21.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.876+0000 7f0f12f1fb80 1 client.27601 shutdown 2023-09-23T09:33:21.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.878+0000 7f0f12f1fb80 1 -- 172.21.15.82:0/1318976896 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c02de66c40 msgr2=0x55c02de77390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:33:21.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.878+0000 7f0f12f1fb80 1 --2- 172.21.15.82:0/1318976896 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c02de66c40 0x55c02de77390 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f0eec099e10 tx=0x7f0eec09a470 comp rx=0 tx=0).stop 2023-09-23T09:33:21.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.879+0000 7f0f12f1fb80 1 -- 172.21.15.82:0/1318976896 shutdown_connections 2023-09-23T09:33:21.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.879+0000 7f0f12f1fb80 1 --2- 172.21.15.82:0/1318976896 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c02de6cca0 0x55c02de75d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:21.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.879+0000 7f0f12f1fb80 1 --2- 172.21.15.82:0/1318976896 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c02de66c40 0x55c02de77390 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:21.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.879+0000 7f0f12f1fb80 1 --2- 172.21.15.82:0/1318976896 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55c02dee6220 0x55c02dee8640 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:21.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.879+0000 7f0f12f1fb80 1 --2- 172.21.15.82:0/1318976896 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c02de6c380 0x55c02de75800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:21.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.879+0000 7f0ee0ff9700 0 client.27601 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:33:21.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.879+0000 7f0f12f1fb80 1 -- 172.21.15.82:0/1318976896 >> 172.21.15.82:0/1318976896 conn(0x55c02dddb0e0 msgr2=0x55c02de6af70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:33:21.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.882+0000 7f0f12f1fb80 1 -- 172.21.15.82:0/1318976896 shutdown_connections 2023-09-23T09:33:21.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.882+0000 7f0f12f1fb80 1 -- 172.21.15.82:0/1318976896 wait complete. 2023-09-23T09:33:21.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.883+0000 7f0f12f1fb80 20 client.27601 trim_cache size 0 max 16384 2023-09-23T09:33:21.884 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:33:21.885 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "IDLE (waiting for more scrubs)", 2023-09-23T09:33:21.885 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:33:21.885 INFO:teuthology.orchestra.run.smithi082.stdout: "2aec802a-e2df-49b3-a22a-82c491ba0c59": { 2023-09-23T09:33:21.885 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:33:21.885 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "2aec802a-e2df-49b3-a22a-82c491ba0c59", 2023-09-23T09:33:21.885 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:33:21.885 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:33:21.885 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:33:21.885 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:33:21.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.883+0000 7f0eff5ff700 1 -- 172.21.15.82:0/1410797740 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f0ee80a01c0 msgr2=0x7f0ee80a2680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:33:21.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.883+0000 7f0eff5ff700 1 --2- 172.21.15.82:0/1410797740 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f0ee80a01c0 0x7f0ee80a2680 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0ee4005950 tx=0x7f0ee400b390 comp rx=0 tx=0).stop 2023-09-23T09:33:21.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.883+0000 7f0eff5ff700 1 -- 172.21.15.82:0/1410797740 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ef8074e50 msgr2=0x7f0ef8071f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:33:21.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.883+0000 7f0eff5ff700 1 --2- 172.21.15.82:0/1410797740 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ef8074e50 0x7f0ef8071f20 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f0eec006070 tx=0x7f0eec004db0 comp rx=0 tx=0).stop 2023-09-23T09:33:21.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.884+0000 7f0eff5ff700 1 -- 172.21.15.82:0/1410797740 shutdown_connections 2023-09-23T09:33:21.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.884+0000 7f0eff5ff700 1 --2- 172.21.15.82:0/1410797740 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f0ee80a01c0 0x7f0ee80a2680 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:21.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.884+0000 7f0eff5ff700 1 --2- 172.21.15.82:0/1410797740 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0ef8111740 0x7f0ef806b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:21.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.884+0000 7f0eff5ff700 1 --2- 172.21.15.82:0/1410797740 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ef8074e50 0x7f0ef8071f20 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:21.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.884+0000 7f0eff5ff700 1 --2- 172.21.15.82:0/1410797740 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ef8075770 0x7f0ef80724a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:21.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.884+0000 7f0eff5ff700 1 -- 172.21.15.82:0/1410797740 >> 172.21.15.82:0/1410797740 conn(0x7f0ef80fe570 msgr2=0x7f0ef8100960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:33:21.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.885+0000 7f0eff5ff700 1 -- 172.21.15.82:0/1410797740 shutdown_connections 2023-09-23T09:33:21.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:21.885+0000 7f0eff5ff700 1 -- 172.21.15.82:0/1410797740 wait complete. 2023-09-23T09:33:21.918 INFO:tasks.cephfs.filesystem:scrub status for tag:2aec802a-e2df-49b3-a22a-82c491ba0c59 - {'path': '/', 'tag': '2aec802a-e2df-49b3-a22a-82c491ba0c59', 'options': 'recursive,force'} 2023-09-23T09:33:22.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:33:21 smithi135 ceph-mon[99205]: scrub summary: idle+waiting paths [/] 2023-09-23T09:33:22.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:33:21 smithi161 ceph-mon[99580]: scrub summary: idle+waiting paths [/] 2023-09-23T09:33:23.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:33:22 smithi135 ceph-mon[99205]: scrub summary: active paths [/] 2023-09-23T09:33:23.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:33:22 smithi135 ceph-mon[99205]: scrub summary: idle+waiting paths [/] 2023-09-23T09:33:23.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:33:22 smithi135 ceph-mon[99205]: pgmap v1157: 97 pgs: 97 active+clean; 16 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 13 MiB/s wr, 1.21k op/s 2023-09-23T09:33:23.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:33:22 smithi082 ceph-mon[97694]: scrub summary: active paths [/] 2023-09-23T09:33:23.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:33:22 smithi082 ceph-mon[97694]: scrub summary: idle+waiting paths [/] 2023-09-23T09:33:23.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:33:22 smithi082 ceph-mon[97694]: pgmap v1157: 97 pgs: 97 active+clean; 16 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 13 MiB/s wr, 1.21k op/s 2023-09-23T09:33:23.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:33:22 smithi161 ceph-mon[99580]: scrub summary: active paths [/] 2023-09-23T09:33:23.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:33:22 smithi161 ceph-mon[99580]: scrub summary: idle+waiting paths [/] 2023-09-23T09:33:23.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:33:22 smithi161 ceph-mon[99580]: pgmap v1157: 97 pgs: 97 active+clean; 16 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 13 MiB/s wr, 1.21k op/s 2023-09-23T09:33:24.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:33:23 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:33:24.123 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:33:23 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:33:24.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:33:23 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:33:25.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:33:24 smithi135 ceph-mon[99205]: pgmap v1158: 97 pgs: 97 active+clean; 16 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 13 MiB/s wr, 1.21k op/s 2023-09-23T09:33:25.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:33:24 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:33:25.123 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:33:24 smithi082 ceph-mon[97694]: pgmap v1158: 97 pgs: 97 active+clean; 16 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 13 MiB/s wr, 1.21k op/s 2023-09-23T09:33:25.123 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:33:24 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:33:25.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:33:24 smithi161 ceph-mon[99580]: pgmap v1158: 97 pgs: 97 active+clean; 16 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 13 MiB/s wr, 1.21k op/s 2023-09-23T09:33:25.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:33:24 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:33:25.831 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 375.0 s, 396.6 tps, lat 257.730 ms stddev 622.212 2023-09-23T09:33:27.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:33:26 smithi135 ceph-mon[99205]: pgmap v1159: 97 pgs: 97 active+clean; 16 GiB data, 59 GiB used, 1013 GiB / 1.0 TiB avail; 2.8 MiB/s rd, 15 MiB/s wr, 1.30k op/s 2023-09-23T09:33:27.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:33:26 smithi082 ceph-mon[97694]: pgmap v1159: 97 pgs: 97 active+clean; 16 GiB data, 59 GiB used, 1013 GiB / 1.0 TiB avail; 2.8 MiB/s rd, 15 MiB/s wr, 1.30k op/s 2023-09-23T09:33:27.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:33:26 smithi161 ceph-mon[99580]: pgmap v1159: 97 pgs: 97 active+clean; 16 GiB data, 59 GiB used, 1013 GiB / 1.0 TiB avail; 2.8 MiB/s rd, 15 MiB/s wr, 1.30k op/s 2023-09-23T09:33:28.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:33:28 smithi135 ceph-mon[99205]: pgmap v1160: 97 pgs: 97 active+clean; 16 GiB data, 59 GiB used, 1013 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 14 MiB/s wr, 1.24k op/s 2023-09-23T09:33:28.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:33:28 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:33:28.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:33:28 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:33:28.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:33:28 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:33:28.623 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:33:28 smithi082 ceph-mon[97694]: pgmap v1160: 97 pgs: 97 active+clean; 16 GiB data, 59 GiB used, 1013 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 14 MiB/s wr, 1.24k op/s 2023-09-23T09:33:28.624 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:33:28 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:33:28.624 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:33:28 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:33:28.624 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:33:28 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:33:28.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:33:28 smithi161 ceph-mon[99580]: pgmap v1160: 97 pgs: 97 active+clean; 16 GiB data, 59 GiB used, 1013 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 14 MiB/s wr, 1.24k op/s 2023-09-23T09:33:28.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:33:28 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:33:28.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:33:28 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:33:28.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:33:28 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:33:30.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 380.0 s, 511.1 tps, lat 197.980 ms stddev 87.776 2023-09-23T09:33:31.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:33:30 smithi135 ceph-mon[99205]: pgmap v1161: 97 pgs: 97 active+clean; 16 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 3.7 MiB/s rd, 17 MiB/s wr, 1.56k op/s 2023-09-23T09:33:31.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:33:30 smithi082 ceph-mon[97694]: pgmap v1161: 97 pgs: 97 active+clean; 16 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 3.7 MiB/s rd, 17 MiB/s wr, 1.56k op/s 2023-09-23T09:33:31.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:33:30 smithi161 ceph-mon[99580]: pgmap v1161: 97 pgs: 97 active+clean; 16 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 3.7 MiB/s rd, 17 MiB/s wr, 1.56k op/s 2023-09-23T09:33:32.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:33:31 smithi135 ceph-mon[99205]: scrub summary: idle 2023-09-23T09:33:32.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:33:31 smithi135 ceph-mon[99205]: scrub summary: idle 2023-09-23T09:33:32.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:33:31 smithi135 ceph-mon[99205]: scrub summary: idle 2023-09-23T09:33:32.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:33:31 smithi082 ceph-mon[97694]: scrub summary: idle 2023-09-23T09:33:32.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:33:31 smithi082 ceph-mon[97694]: scrub summary: idle 2023-09-23T09:33:32.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:33:31 smithi082 ceph-mon[97694]: scrub summary: idle 2023-09-23T09:33:32.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:33:31 smithi161 ceph-mon[99580]: scrub summary: idle 2023-09-23T09:33:32.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:33:31 smithi161 ceph-mon[99580]: scrub summary: idle 2023-09-23T09:33:32.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:33:31 smithi161 ceph-mon[99580]: scrub summary: idle 2023-09-23T09:33:33.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:33:32 smithi135 ceph-mon[99205]: scrub summary: idle 2023-09-23T09:33:33.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:33:32 smithi135 ceph-mon[99205]: scrub summary: idle 2023-09-23T09:33:33.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:33:32 smithi135 ceph-mon[99205]: pgmap v1162: 97 pgs: 97 active+clean; 16 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 2.8 MiB/s rd, 13 MiB/s wr, 1.16k op/s 2023-09-23T09:33:33.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:33:32 smithi082 ceph-mon[97694]: scrub summary: idle 2023-09-23T09:33:33.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:33:32 smithi082 ceph-mon[97694]: scrub summary: idle 2023-09-23T09:33:33.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:33:32 smithi082 ceph-mon[97694]: pgmap v1162: 97 pgs: 97 active+clean; 16 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 2.8 MiB/s rd, 13 MiB/s wr, 1.16k op/s 2023-09-23T09:33:33.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:33:32 smithi161 ceph-mon[99580]: scrub summary: idle 2023-09-23T09:33:33.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:33:32 smithi161 ceph-mon[99580]: scrub summary: idle 2023-09-23T09:33:33.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:33:32 smithi161 ceph-mon[99580]: pgmap v1162: 97 pgs: 97 active+clean; 16 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 2.8 MiB/s rd, 13 MiB/s wr, 1.16k op/s 2023-09-23T09:33:35.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:33:34 smithi135 ceph-mon[99205]: pgmap v1163: 97 pgs: 97 active+clean; 16 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 12 MiB/s wr, 1.08k op/s 2023-09-23T09:33:35.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:33:34 smithi082 ceph-mon[97694]: pgmap v1163: 97 pgs: 97 active+clean; 16 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 12 MiB/s wr, 1.08k op/s 2023-09-23T09:33:35.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:33:34 smithi161 ceph-mon[99580]: pgmap v1163: 97 pgs: 97 active+clean; 16 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 12 MiB/s wr, 1.08k op/s 2023-09-23T09:33:35.831 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 385.0 s, 499.6 tps, lat 199.055 ms stddev 69.893 2023-09-23T09:33:37.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:33:36 smithi135 ceph-mon[99205]: pgmap v1164: 97 pgs: 97 active+clean; 16 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 4.1 MiB/s rd, 18 MiB/s wr, 1.60k op/s 2023-09-23T09:33:37.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:33:36 smithi082 ceph-mon[97694]: pgmap v1164: 97 pgs: 97 active+clean; 16 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 4.1 MiB/s rd, 18 MiB/s wr, 1.60k op/s 2023-09-23T09:33:37.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:33:36 smithi161 ceph-mon[99580]: pgmap v1164: 97 pgs: 97 active+clean; 16 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 4.1 MiB/s rd, 18 MiB/s wr, 1.60k op/s 2023-09-23T09:33:38.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:33:38 smithi135 ceph-mon[99205]: pgmap v1165: 97 pgs: 97 active+clean; 16 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 3.0 MiB/s rd, 12 MiB/s wr, 1.07k op/s 2023-09-23T09:33:38.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:33:38 smithi082 ceph-mon[97694]: pgmap v1165: 97 pgs: 97 active+clean; 16 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 3.0 MiB/s rd, 12 MiB/s wr, 1.07k op/s 2023-09-23T09:33:38.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:33:38 smithi161 ceph-mon[99580]: pgmap v1165: 97 pgs: 97 active+clean; 16 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 3.0 MiB/s rd, 12 MiB/s wr, 1.07k op/s 2023-09-23T09:33:40.827 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 390.0 s, 494.4 tps, lat 186.154 ms stddev 74.704 2023-09-23T09:33:41.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:33:40 smithi135 ceph-mon[99205]: pgmap v1166: 97 pgs: 97 active+clean; 16 GiB data, 60 GiB used, 1012 GiB / 1.0 TiB avail; 4.4 MiB/s rd, 17 MiB/s wr, 1.57k op/s 2023-09-23T09:33:41.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:33:40 smithi082 ceph-mon[97694]: pgmap v1166: 97 pgs: 97 active+clean; 16 GiB data, 60 GiB used, 1012 GiB / 1.0 TiB avail; 4.4 MiB/s rd, 17 MiB/s wr, 1.57k op/s 2023-09-23T09:33:41.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:33:40 smithi161 ceph-mon[99580]: pgmap v1166: 97 pgs: 97 active+clean; 16 GiB data, 60 GiB used, 1012 GiB / 1.0 TiB avail; 4.4 MiB/s rd, 17 MiB/s wr, 1.57k op/s 2023-09-23T09:33:43.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:33:42 smithi135 ceph-mon[99205]: pgmap v1167: 97 pgs: 97 active+clean; 16 GiB data, 60 GiB used, 1012 GiB / 1.0 TiB avail; 3.2 MiB/s rd, 13 MiB/s wr, 1.17k op/s 2023-09-23T09:33:43.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:33:42 smithi082 ceph-mon[97694]: pgmap v1167: 97 pgs: 97 active+clean; 16 GiB data, 60 GiB used, 1012 GiB / 1.0 TiB avail; 3.2 MiB/s rd, 13 MiB/s wr, 1.17k op/s 2023-09-23T09:33:43.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:33:42 smithi161 ceph-mon[99580]: pgmap v1167: 97 pgs: 97 active+clean; 16 GiB data, 60 GiB used, 1012 GiB / 1.0 TiB avail; 3.2 MiB/s rd, 13 MiB/s wr, 1.17k op/s 2023-09-23T09:33:45.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:33:44 smithi135 ceph-mon[99205]: pgmap v1168: 97 pgs: 97 active+clean; 16 GiB data, 60 GiB used, 1012 GiB / 1.0 TiB avail; 3.0 MiB/s rd, 12 MiB/s wr, 1.09k op/s 2023-09-23T09:33:45.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:33:44 smithi082 ceph-mon[97694]: pgmap v1168: 97 pgs: 97 active+clean; 16 GiB data, 60 GiB used, 1012 GiB / 1.0 TiB avail; 3.0 MiB/s rd, 12 MiB/s wr, 1.09k op/s 2023-09-23T09:33:45.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:33:44 smithi161 ceph-mon[99580]: pgmap v1168: 97 pgs: 97 active+clean; 16 GiB data, 60 GiB used, 1012 GiB / 1.0 TiB avail; 3.0 MiB/s rd, 12 MiB/s wr, 1.09k op/s 2023-09-23T09:33:45.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 395.0 s, 278.6 tps, lat 388.493 ms stddev 726.273 2023-09-23T09:33:47.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:33:46 smithi135 ceph-mon[99205]: pgmap v1169: 97 pgs: 97 active+clean; 16 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 3.8 MiB/s rd, 15 MiB/s wr, 1.38k op/s 2023-09-23T09:33:47.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:33:46 smithi082 ceph-mon[97694]: pgmap v1169: 97 pgs: 97 active+clean; 16 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 3.8 MiB/s rd, 15 MiB/s wr, 1.38k op/s 2023-09-23T09:33:47.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:33:46 smithi161 ceph-mon[99580]: pgmap v1169: 97 pgs: 97 active+clean; 16 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 3.8 MiB/s rd, 15 MiB/s wr, 1.38k op/s 2023-09-23T09:33:48.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:33:48 smithi135 ceph-mon[99205]: pgmap v1170: 97 pgs: 97 active+clean; 16 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 9.6 MiB/s wr, 859 op/s 2023-09-23T09:33:48.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:33:48 smithi082 ceph-mon[97694]: pgmap v1170: 97 pgs: 97 active+clean; 16 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 9.6 MiB/s wr, 859 op/s 2023-09-23T09:33:48.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:33:48 smithi161 ceph-mon[99580]: pgmap v1170: 97 pgs: 97 active+clean; 16 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 9.6 MiB/s wr, 859 op/s 2023-09-23T09:33:50.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:33:50 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:33:50.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:33:50 smithi135 ceph-mon[99205]: pgmap v1171: 97 pgs: 97 active+clean; 16 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 3.7 MiB/s rd, 14 MiB/s wr, 1.32k op/s 2023-09-23T09:33:50.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:33:50 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:33:50.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:33:50 smithi082 ceph-mon[97694]: pgmap v1171: 97 pgs: 97 active+clean; 16 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 3.7 MiB/s rd, 14 MiB/s wr, 1.32k op/s 2023-09-23T09:33:50.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:33:50 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:33:50.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:33:50 smithi161 ceph-mon[99580]: pgmap v1171: 97 pgs: 97 active+clean; 16 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 3.7 MiB/s rd, 14 MiB/s wr, 1.32k op/s 2023-09-23T09:33:50.828 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 400.0 s, 503.9 tps, lat 197.205 ms stddev 75.865 2023-09-23T09:33:51.919 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:33:52.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.274+0000 7fb81afff700 1 -- 172.21.15.82:0/2751169039 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb814072cc0 msgr2=0x7fb8140730a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:33:52.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.274+0000 7fb81afff700 1 --2- 172.21.15.82:0/2751169039 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb814072cc0 0x7fb8140730a0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fb80800b0a0 tx=0x7fb80800b3b0 comp rx=0 tx=0).stop 2023-09-23T09:33:52.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.276+0000 7fb81afff700 1 -- 172.21.15.82:0/2751169039 shutdown_connections 2023-09-23T09:33:52.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.276+0000 7fb81afff700 1 --2- 172.21.15.82:0/2751169039 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb814111880 0x7fb814113c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:52.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.276+0000 7fb81afff700 1 --2- 172.21.15.82:0/2751169039 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb814072cc0 0x7fb8140730a0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:52.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.276+0000 7fb81afff700 1 --2- 172.21.15.82:0/2751169039 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8140735e0 0x7fb814111340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:52.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.276+0000 7fb81afff700 1 -- 172.21.15.82:0/2751169039 >> 172.21.15.82:0/2751169039 conn(0x7fb8140fc3a0 msgr2=0x7fb8140fe7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:33:52.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.276+0000 7fb81afff700 1 -- 172.21.15.82:0/2751169039 shutdown_connections 2023-09-23T09:33:52.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.277+0000 7fb81afff700 1 -- 172.21.15.82:0/2751169039 wait complete. 2023-09-23T09:33:52.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.278+0000 7fb81afff700 1 Processor -- start 2023-09-23T09:33:52.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.279+0000 7fb81afff700 1 -- start start 2023-09-23T09:33:52.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.279+0000 7fb81afff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb814072cc0 0x7fb814071eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:52.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.279+0000 7fb81afff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8140735e0 0x7fb814072430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:52.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.279+0000 7fb81afff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb814111880 0x7fb81406af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:52.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.279+0000 7fb81afff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb81406b6f0 con 0x7fb8140735e0 2023-09-23T09:33:52.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.279+0000 7fb81afff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb81406b860 con 0x7fb814111880 2023-09-23T09:33:52.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.279+0000 7fb81afff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb81406ba20 con 0x7fb814072cc0 2023-09-23T09:33:52.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.280+0000 7fb81959c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb814111880 0x7fb81406af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:52.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.280+0000 7fb818d9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb814072cc0 0x7fb814071eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:52.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.280+0000 7fb81959c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb814111880 0x7fb81406af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:44132/0 (socket says 172.21.15.82:44132) 2023-09-23T09:33:52.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.280+0000 7fb81959c700 1 -- 172.21.15.82:0/2932000277 learned_addr learned my addr 172.21.15.82:0/2932000277 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:33:52.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.280+0000 7fb813fff700 1 --2- 172.21.15.82:0/2932000277 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8140735e0 0x7fb814072430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:52.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.280+0000 7fb81959c700 1 -- 172.21.15.82:0/2932000277 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb814072cc0 msgr2=0x7fb814071eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:33:52.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.280+0000 7fb81959c700 1 --2- 172.21.15.82:0/2932000277 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb814072cc0 0x7fb814071eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:52.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.280+0000 7fb81959c700 1 -- 172.21.15.82:0/2932000277 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8140735e0 msgr2=0x7fb814072430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:33:52.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.280+0000 7fb81959c700 1 --2- 172.21.15.82:0/2932000277 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8140735e0 0x7fb814072430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:52.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.280+0000 7fb81959c700 1 -- 172.21.15.82:0/2932000277 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb808009d00 con 0x7fb814111880 2023-09-23T09:33:52.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.280+0000 7fb81959c700 1 --2- 172.21.15.82:0/2932000277 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb814111880 0x7fb81406af20 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fb80c00e970 tx=0x7fb80c00ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:33:52.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.281+0000 7fb811ffb700 1 -- 172.21.15.82:0/2932000277 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb80c00cbd0 con 0x7fb814111880 2023-09-23T09:33:52.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.281+0000 7fb81afff700 1 -- 172.21.15.82:0/2932000277 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb81406bd00 con 0x7fb814111880 2023-09-23T09:33:52.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.281+0000 7fb811ffb700 1 -- 172.21.15.82:0/2932000277 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb80c00ee60 con 0x7fb814111880 2023-09-23T09:33:52.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.281+0000 7fb811ffb700 1 -- 172.21.15.82:0/2932000277 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb80c0054f0 con 0x7fb814111880 2023-09-23T09:33:52.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.282+0000 7fb81afff700 1 -- 172.21.15.82:0/2932000277 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb81406fdc0 con 0x7fb814111880 2023-09-23T09:33:52.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.292+0000 7fb82e839b80 1 Processor -- start 2023-09-23T09:33:52.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.293+0000 7fb811ffb700 1 -- 172.21.15.82:0/2932000277 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7fb80c004750 con 0x7fb814111880 2023-09-23T09:33:52.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.293+0000 7fb82e839b80 1 -- start start 2023-09-23T09:33:52.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.294+0000 7fb82e839b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556511cfc380 0x556511cfc760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:52.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.294+0000 7fb82e839b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556511cfcca0 0x556511cf6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:52.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.294+0000 7fb82e839b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556511cf6c40 0x556511cf70a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:52.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.294+0000 7fb82e839b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x556511c5e7b0 con 0x556511cfc380 2023-09-23T09:33:52.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.294+0000 7fb82e839b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x556511c4f780 con 0x556511cfcca0 2023-09-23T09:33:52.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.294+0000 7fb82e839b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x556511c4d0a0 con 0x556511cf6c40 2023-09-23T09:33:52.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.294+0000 7fb818d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556511cfcca0 0x556511cf6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:52.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.294+0000 7fb813fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556511cfc380 0x556511cfc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:52.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.294+0000 7fb813fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556511cfc380 0x556511cfc760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50034/0 (socket says 172.21.15.82:50034) 2023-09-23T09:33:52.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.294+0000 7fb818d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556511cfcca0 0x556511cf6700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:44144/0 (socket says 172.21.15.82:44144) 2023-09-23T09:33:52.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.294+0000 7fb813fff700 1 -- 172.21.15.82:0/525735463 learned_addr learned my addr 172.21.15.82:0/525735463 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:33:52.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.294+0000 7fb813fff700 1 --2- 172.21.15.82:0/525735463 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556511cf6c40 0x556511cf70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:52.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.295+0000 7fb818d9b700 1 -- 172.21.15.82:0/525735463 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556511cf6c40 msgr2=0x556511cf70a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:33:52.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.295+0000 7fb818d9b700 1 --2- 172.21.15.82:0/525735463 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556511cf6c40 0x556511cf70a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:52.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.295+0000 7fb818d9b700 1 -- 172.21.15.82:0/525735463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556511cfc380 msgr2=0x556511cfc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:33:52.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.295+0000 7fb818d9b700 1 --2- 172.21.15.82:0/525735463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556511cfc380 0x556511cfc760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:52.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.295+0000 7fb818d9b700 1 -- 172.21.15.82:0/525735463 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556511ac8630 con 0x556511cfcca0 2023-09-23T09:33:52.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.295+0000 7fb818d9b700 1 --2- 172.21.15.82:0/525735463 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556511cfcca0 0x556511cf6700 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fb808000f80 tx=0x7fb808009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37ad44a04234b44e server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:33:52.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.296+0000 7fb7feffd700 1 -- 172.21.15.82:0/525735463 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb80800e040 con 0x556511cfcca0 2023-09-23T09:33:52.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.296+0000 7fb7feffd700 1 -- 172.21.15.82:0/525735463 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb808009460 con 0x556511cfcca0 2023-09-23T09:33:52.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.296+0000 7fb7feffd700 1 -- 172.21.15.82:0/525735463 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb808004cb0 con 0x556511cfcca0 2023-09-23T09:33:52.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.296+0000 7fb811ffb700 1 --2- 172.21.15.82:0/2932000277 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fb8040a01c0 0x7fb8040a2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:52.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.296+0000 7fb811ffb700 1 -- 172.21.15.82:0/2932000277 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fb80c014070 con 0x7fb814111880 2023-09-23T09:33:52.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.296+0000 7fb813fff700 1 --2- 172.21.15.82:0/2932000277 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fb8040a01c0 0x7fb8040a2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:52.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.297+0000 7fb82e839b80 1 -- 172.21.15.82:0/525735463 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556511cfcca0 msgr2=0x556511cf6700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:33:52.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.297+0000 7fb82e839b80 1 --2- 172.21.15.82:0/525735463 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556511cfcca0 0x556511cf6700 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fb808000f80 tx=0x7fb808009c60 comp rx=0 tx=0).stop 2023-09-23T09:33:52.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.297+0000 7fb82e839b80 1 -- 172.21.15.82:0/525735463 shutdown_connections 2023-09-23T09:33:52.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.297+0000 7fb82e839b80 1 --2- 172.21.15.82:0/525735463 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556511cf6c40 0x556511cf70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:52.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.297+0000 7fb82e839b80 1 --2- 172.21.15.82:0/525735463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556511cfc380 0x556511cfc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:52.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.297+0000 7fb82e839b80 1 --2- 172.21.15.82:0/525735463 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556511cfcca0 0x556511cf6700 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:52.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.297+0000 7fb82e839b80 1 -- 172.21.15.82:0/525735463 >> 172.21.15.82:0/525735463 conn(0x556511c6b0e0 msgr2=0x556511cf1410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:33:52.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.297+0000 7fb813fff700 1 --2- 172.21.15.82:0/2932000277 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fb8040a01c0 0x7fb8040a2680 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb800005c50 tx=0x7fb800015040 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:33:52.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.298+0000 7fb82e839b80 1 -- 172.21.15.82:0/525735463 shutdown_connections 2023-09-23T09:33:52.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.298+0000 7fb82e839b80 1 -- 172.21.15.82:0/525735463 wait complete. 2023-09-23T09:33:52.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.298+0000 7fb82e839b80 1 -- start start 2023-09-23T09:33:52.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.299+0000 7fb82e839b80 1 Processor -- start 2023-09-23T09:33:52.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.300+0000 7fb82e839b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556511cf6c40 0x556511d02cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:52.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.300+0000 7fb82e839b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556511cfc380 0x556511cffec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:52.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.300+0000 7fb82e839b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556511cfcca0 0x556511d00600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:52.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.300+0000 7fb82e839b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x556511c48990 con 0x556511cf6c40 2023-09-23T09:33:52.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.300+0000 7fb82e839b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x556511be6bb0 con 0x556511cfcca0 2023-09-23T09:33:52.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.300+0000 7fb82e839b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x556511be68b0 con 0x556511cfc380 2023-09-23T09:33:52.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.300+0000 7fb82e839b80 10 client.0 _ll_register_callbacks cb 0x556511b30a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:33:52.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.301+0000 7fb813fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556511cfc380 0x556511cffec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:52.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.301+0000 7fb813fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556511cfc380 0x556511cffec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:34690/0 (socket says 172.21.15.82:34690) 2023-09-23T09:33:52.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.301+0000 7fb813fff700 1 -- 172.21.15.82:0/330421825 learned_addr learned my addr 172.21.15.82:0/330421825 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:33:52.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.301+0000 7fb818d9b700 1 --2- 172.21.15.82:0/330421825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556511cf6c40 0x556511d02cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:52.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.301+0000 7fb81959c700 1 --2- 172.21.15.82:0/330421825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556511cfcca0 0x556511d00600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:52.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.301+0000 7fb813fff700 1 -- 172.21.15.82:0/330421825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556511cfcca0 msgr2=0x556511d00600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:33:52.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.301+0000 7fb813fff700 1 --2- 172.21.15.82:0/330421825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556511cfcca0 0x556511d00600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:52.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.301+0000 7fb813fff700 1 -- 172.21.15.82:0/330421825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556511cf6c40 msgr2=0x556511d02cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:33:52.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.301+0000 7fb813fff700 1 --2- 172.21.15.82:0/330421825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556511cf6c40 0x556511d02cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:52.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.301+0000 7fb813fff700 1 -- 172.21.15.82:0/330421825 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb814114620 con 0x556511cfc380 2023-09-23T09:33:52.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.302+0000 7fb813fff700 1 --2- 172.21.15.82:0/330421825 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556511cfc380 0x556511cffec0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fb800013230 tx=0x7fb800009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8576f6e2f4bbdb10 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:33:52.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.302+0000 7fb7f3fff700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T09:33:52.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.303+0000 7fb7f3fff700 1 -- 172.21.15.82:0/330421825 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb800026070 con 0x556511cfc380 2023-09-23T09:33:52.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.303+0000 7fb7f3fff700 1 -- 172.21.15.82:0/330421825 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(149..149 src has 1..149) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fb800003e20 con 0x556511cfc380 2023-09-23T09:33:52.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.303+0000 7fb82e839b80 1 -- 172.21.15.82:0/330421825 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556511cc61c0 con 0x556511cfc380 2023-09-23T09:33:52.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.303+0000 7fb7f3fff700 1 -- 172.21.15.82:0/330421825 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=109) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb800020650 con 0x556511cfc380 2023-09-23T09:33:52.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.304+0000 7fb82e839b80 10 client.27613 fetch_fsmap learned FSMap version 109 2023-09-23T09:33:52.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.304+0000 7fb82e839b80 1 -- 172.21.15.82:0/330421825 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=109,monmap=4+}) v3 -- 0x556511a74de0 con 0x556511cfc380 2023-09-23T09:33:52.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.304+0000 7fb7f3fff700 1 -- 172.21.15.82:0/330421825 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x556511cc61c0 con 0x556511cfc380 2023-09-23T09:33:52.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.304+0000 7fb7f3fff700 1 -- 172.21.15.82:0/330421825 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 109) v1 ==== 7942+0+0 (secure 0 0 0) 0x7fb800010820 con 0x556511cfc380 2023-09-23T09:33:52.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.305+0000 7fb82e839b80 10 client.27613 fetch_fsmap finished waiting for FSMap version 109 2023-09-23T09:33:52.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.305+0000 7fb82e839b80 10 client.27613 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:33:52.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.305+0000 7fb82e839b80 20 client.27613 populate_metadata read hostname 'smithi082' 2023-09-23T09:33:52.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.305+0000 7fb82e839b80 1 --2- 172.21.15.82:0/330421825 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x556511d21790 0x556511d23bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:52.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.305+0000 7fb82e839b80 4 client.27613 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:33:52.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.305+0000 7fb82e839b80 1 -- 172.21.15.82:0/330421825 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556511beeba0 con 0x556511d21790 2023-09-23T09:33:52.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.305+0000 7fb818d9b700 1 --2- 172.21.15.82:0/330421825 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x556511d21790 0x556511d23bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:52.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.306+0000 7fb818d9b700 1 --2- 172.21.15.82:0/330421825 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x556511d21790 0x556511d23bb0 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e580073f5abb12c1 server_cookie=dfa9642ed53e787f in_seq=0 out_seq=0 2023-09-23T09:33:52.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.306+0000 7fb7f3fff700 10 client.27613 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:33:52.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.307+0000 7fb7f3fff700 1 -- 172.21.15.82:0/330421825 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x556511beeba0 con 0x556511d21790 2023-09-23T09:33:52.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.307+0000 7fb7f3fff700 10 client.27613 handle_command_reply: tid=0 2023-09-23T09:33:52.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.307+0000 7fb82e839b80 1 client.27613 shutdown 2023-09-23T09:33:52.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.307+0000 7fb82e839b80 1 -- 172.21.15.82:0/330421825 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556511cfc380 msgr2=0x556511cffec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:33:52.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.307+0000 7fb82e839b80 1 --2- 172.21.15.82:0/330421825 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556511cfc380 0x556511cffec0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fb800013230 tx=0x7fb800009260 comp rx=0 tx=0).stop 2023-09-23T09:33:52.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.308+0000 7fb82e839b80 1 -- 172.21.15.82:0/330421825 shutdown_connections 2023-09-23T09:33:52.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.308+0000 7fb82e839b80 1 --2- 172.21.15.82:0/330421825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556511cfcca0 0x556511d00600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:52.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.308+0000 7fb82e839b80 1 --2- 172.21.15.82:0/330421825 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x556511d21790 0x556511d23bb0 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:52.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.308+0000 7fb82e839b80 1 --2- 172.21.15.82:0/330421825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556511cf6c40 0x556511d02cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:52.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.308+0000 7fb82e839b80 1 --2- 172.21.15.82:0/330421825 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556511cfc380 0x556511cffec0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:52.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.308+0000 7fb7f3fff700 0 client.27613 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:33:52.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.308+0000 7fb82e839b80 1 -- 172.21.15.82:0/330421825 >> 172.21.15.82:0/330421825 conn(0x556511c6b0e0 msgr2=0x556511cebb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:33:52.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.308+0000 7fb82e839b80 1 -- 172.21.15.82:0/330421825 shutdown_connections 2023-09-23T09:33:52.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.308+0000 7fb82e839b80 1 -- 172.21.15.82:0/330421825 wait complete. 2023-09-23T09:33:52.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.309+0000 7fb82e839b80 20 client.27613 trim_cache size 0 max 16384 2023-09-23T09:33:52.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.348+0000 7fb82e839b80 1 Processor -- start 2023-09-23T09:33:52.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.348+0000 7fb82e839b80 1 -- start start 2023-09-23T09:33:52.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.349+0000 7fb82e839b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556511cf6c40 0x556511cf6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:52.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.349+0000 7fb82e839b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556511cfc380 0x556511d027e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:52.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.349+0000 7fb82e839b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556511cfcca0 0x556511cfa010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:52.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.349+0000 7fb82e839b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x556511aca920 con 0x556511cf6c40 2023-09-23T09:33:52.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.349+0000 7fb82e839b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x556511d1e0c0 con 0x556511cfcca0 2023-09-23T09:33:52.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.349+0000 7fb82e839b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x556511ceda40 con 0x556511cfc380 2023-09-23T09:33:52.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.349+0000 7fb813fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556511cfc380 0x556511d027e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:52.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.350+0000 7fb813fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556511cfc380 0x556511d027e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:34692/0 (socket says 172.21.15.82:34692) 2023-09-23T09:33:52.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.350+0000 7fb813fff700 1 -- 172.21.15.82:0/2876575807 learned_addr learned my addr 172.21.15.82:0/2876575807 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:33:52.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.350+0000 7fb81959c700 1 --2- 172.21.15.82:0/2876575807 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556511cfcca0 0x556511cfa010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:52.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.350+0000 7fb818d9b700 1 --2- 172.21.15.82:0/2876575807 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556511cf6c40 0x556511cf6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:52.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.351+0000 7fb818d9b700 1 -- 172.21.15.82:0/2876575807 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556511cfc380 msgr2=0x556511d027e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:33:52.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.351+0000 7fb818d9b700 1 --2- 172.21.15.82:0/2876575807 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556511cfc380 0x556511d027e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:52.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.351+0000 7fb818d9b700 1 -- 172.21.15.82:0/2876575807 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556511cfcca0 msgr2=0x556511cfa010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:33:52.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.351+0000 7fb818d9b700 1 --2- 172.21.15.82:0/2876575807 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556511cfcca0 0x556511cfa010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:52.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.351+0000 7fb818d9b700 1 -- 172.21.15.82:0/2876575807 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556511a5dc60 con 0x556511cf6c40 2023-09-23T09:33:52.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.352+0000 7fb818d9b700 1 --2- 172.21.15.82:0/2876575807 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556511cf6c40 0x556511cf6700 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fb80800b3f0 tx=0x7fb8080097f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae114e5b2c1bf70b server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:33:52.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.352+0000 7fb7ff7fe700 1 -- 172.21.15.82:0/2876575807 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb808020070 con 0x556511cf6c40 2023-09-23T09:33:52.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.352+0000 7fb7ff7fe700 1 -- 172.21.15.82:0/2876575807 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb808009460 con 0x556511cf6c40 2023-09-23T09:33:52.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.352+0000 7fb7ff7fe700 1 -- 172.21.15.82:0/2876575807 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb80800e040 con 0x556511cf6c40 2023-09-23T09:33:52.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.357+0000 7fb82e839b80 1 -- 172.21.15.82:0/2876575807 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556511cf6c40 msgr2=0x556511cf6700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:33:52.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.357+0000 7fb82e839b80 1 --2- 172.21.15.82:0/2876575807 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556511cf6c40 0x556511cf6700 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fb80800b3f0 tx=0x7fb8080097f0 comp rx=0 tx=0).stop 2023-09-23T09:33:52.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.357+0000 7fb82e839b80 1 -- 172.21.15.82:0/2876575807 shutdown_connections 2023-09-23T09:33:52.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.357+0000 7fb82e839b80 1 --2- 172.21.15.82:0/2876575807 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556511cfcca0 0x556511cfa010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:52.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.357+0000 7fb82e839b80 1 --2- 172.21.15.82:0/2876575807 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556511cf6c40 0x556511cf6700 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:52.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.357+0000 7fb82e839b80 1 --2- 172.21.15.82:0/2876575807 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556511cfc380 0x556511d027e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:52.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.357+0000 7fb82e839b80 1 -- 172.21.15.82:0/2876575807 >> 172.21.15.82:0/2876575807 conn(0x556511c6b0e0 msgr2=0x556511d1d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:33:52.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.358+0000 7fb82e839b80 1 -- 172.21.15.82:0/2876575807 shutdown_connections 2023-09-23T09:33:52.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.358+0000 7fb82e839b80 1 -- 172.21.15.82:0/2876575807 wait complete. 2023-09-23T09:33:52.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.359+0000 7fb82e839b80 1 -- start start 2023-09-23T09:33:52.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.359+0000 7fb82e839b80 1 Processor -- start 2023-09-23T09:33:52.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.360+0000 7fb82e839b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556511cf6c40 0x556511cf9240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:52.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.360+0000 7fb82e839b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556511cfc380 0x556511cf9780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:52.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.360+0000 7fb82e839b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556511cfcca0 0x556511cf7e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:52.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.360+0000 7fb82e839b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x556511cf8420 con 0x556511cfcca0 2023-09-23T09:33:52.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.360+0000 7fb82e839b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x556511cf8590 con 0x556511cf6c40 2023-09-23T09:33:52.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.360+0000 7fb82e839b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x556511cf8750 con 0x556511cfc380 2023-09-23T09:33:52.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.360+0000 7fb82e839b80 10 client.0 _ll_register_callbacks cb 0x7fb800004360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:33:52.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.361+0000 7fb813fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556511cfc380 0x556511cf9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:52.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.361+0000 7fb818d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556511cf6c40 0x556511cf9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:52.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.361+0000 7fb818d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556511cf6c40 0x556511cf9240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:44172/0 (socket says 172.21.15.82:44172) 2023-09-23T09:33:52.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.361+0000 7fb813fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556511cfc380 0x556511cf9780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:34706/0 (socket says 172.21.15.82:34706) 2023-09-23T09:33:52.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.361+0000 7fb818d9b700 1 -- 172.21.15.82:0/3005207626 learned_addr learned my addr 172.21.15.82:0/3005207626 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:33:52.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.362+0000 7fb818d9b700 1 -- 172.21.15.82:0/3005207626 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556511cfc380 msgr2=0x556511cf9780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:33:52.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.362+0000 7fb818d9b700 1 --2- 172.21.15.82:0/3005207626 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556511cfc380 0x556511cf9780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:52.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.362+0000 7fb818d9b700 1 -- 172.21.15.82:0/3005207626 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556511cfcca0 msgr2=0x556511cf7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:33:52.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.362+0000 7fb818d9b700 1 --2- 172.21.15.82:0/3005207626 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556511cfcca0 0x556511cf7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:52.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.362+0000 7fb818d9b700 1 -- 172.21.15.82:0/3005207626 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556511ac8630 con 0x556511cf6c40 2023-09-23T09:33:52.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.363+0000 7fb818d9b700 1 --2- 172.21.15.82:0/3005207626 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556511cf6c40 0x556511cf9240 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fb80800d010 tx=0x7fb80802abd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a993bad19d772c7 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:33:52.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.363+0000 7fb7f3fff700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-09-23T09:33:52.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.363+0000 7fb7f3fff700 1 -- 172.21.15.82:0/3005207626 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb80800e070 con 0x556511cf6c40 2023-09-23T09:33:52.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.363+0000 7fb7f3fff700 1 -- 172.21.15.82:0/3005207626 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(149..149 src has 1..149) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fb80800bcb0 con 0x556511cf6c40 2023-09-23T09:33:52.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.363+0000 7fb82e839b80 1 -- 172.21.15.82:0/3005207626 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556511ce98b0 con 0x556511cf6c40 2023-09-23T09:33:52.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.364+0000 7fb7f3fff700 1 -- 172.21.15.82:0/3005207626 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=109) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb808020040 con 0x556511cf6c40 2023-09-23T09:33:52.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.364+0000 7fb82e839b80 10 client.27590 fetch_fsmap learned FSMap version 109 2023-09-23T09:33:52.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.364+0000 7fb82e839b80 1 -- 172.21.15.82:0/3005207626 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=109,monmap=4+}) v3 -- 0x556511a9b250 con 0x556511cf6c40 2023-09-23T09:33:52.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.365+0000 7fb7f3fff700 1 -- 172.21.15.82:0/3005207626 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x556511ce98b0 con 0x556511cf6c40 2023-09-23T09:33:52.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.365+0000 7fb7f3fff700 1 -- 172.21.15.82:0/3005207626 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 109) v1 ==== 7942+0+0 (secure 0 0 0) 0x7fb808024070 con 0x556511cf6c40 2023-09-23T09:33:52.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.365+0000 7fb82e839b80 10 client.27590 fetch_fsmap finished waiting for FSMap version 109 2023-09-23T09:33:52.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.365+0000 7fb82e839b80 10 client.27590 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:33:52.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.365+0000 7fb82e839b80 20 client.27590 populate_metadata read hostname 'smithi082' 2023-09-23T09:33:52.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.365+0000 7fb82e839b80 1 --2- 172.21.15.82:0/3005207626 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x556511d76150 0x556511d78540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:52.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.365+0000 7fb82e839b80 4 client.27590 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:33:52.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.365+0000 7fb82e839b80 1 -- 172.21.15.82:0/3005207626 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x556511c41970 con 0x556511d76150 2023-09-23T09:33:52.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.365+0000 7fb813fff700 1 --2- 172.21.15.82:0/3005207626 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x556511d76150 0x556511d78540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:52.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.366+0000 7fb813fff700 1 --2- 172.21.15.82:0/3005207626 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x556511d76150 0x556511d78540 crc :-1 s=READY pgs=240 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ab98eebcdc7884a server_cookie=7014dd6d135883b8 in_seq=0 out_seq=0 2023-09-23T09:33:52.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.366+0000 7fb7f3fff700 10 client.27590 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:33:52.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.367+0000 7fb7f3fff700 1 -- 172.21.15.82:0/3005207626 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x556511c41970 con 0x556511d76150 2023-09-23T09:33:52.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.367+0000 7fb7f3fff700 10 client.27590 handle_command_reply: tid=0 2023-09-23T09:33:52.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.367+0000 7fb82e839b80 1 client.27590 shutdown 2023-09-23T09:33:52.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.367+0000 7fb82e839b80 1 -- 172.21.15.82:0/3005207626 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556511cf6c40 msgr2=0x556511cf9240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:33:52.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.367+0000 7fb82e839b80 1 --2- 172.21.15.82:0/3005207626 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556511cf6c40 0x556511cf9240 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fb80800d010 tx=0x7fb80802abd0 comp rx=0 tx=0).stop 2023-09-23T09:33:52.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.367+0000 7fb82e839b80 1 -- 172.21.15.82:0/3005207626 shutdown_connections 2023-09-23T09:33:52.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.367+0000 7fb82e839b80 1 --2- 172.21.15.82:0/3005207626 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x556511d76150 0x556511d78540 crc :-1 s=READY pgs=240 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:52.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.367+0000 7fb82e839b80 1 --2- 172.21.15.82:0/3005207626 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556511cfcca0 0x556511cf7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:52.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.367+0000 7fb82e839b80 1 --2- 172.21.15.82:0/3005207626 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556511cf6c40 0x556511cf9240 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:52.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.367+0000 7fb82e839b80 1 --2- 172.21.15.82:0/3005207626 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556511cfc380 0x556511cf9780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:52.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.367+0000 7fb82e839b80 1 -- 172.21.15.82:0/3005207626 >> 172.21.15.82:0/3005207626 conn(0x556511c6b0e0 msgr2=0x556511cfa010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:33:52.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.368+0000 7fb7f3fff700 0 client.27590 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:33:52.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.373+0000 7fb82e839b80 1 -- 172.21.15.82:0/3005207626 shutdown_connections 2023-09-23T09:33:52.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.374+0000 7fb82e839b80 1 -- 172.21.15.82:0/3005207626 wait complete. 2023-09-23T09:33:52.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.375+0000 7fb82e839b80 20 client.27590 trim_cache size 0 max 16384 2023-09-23T09:33:52.377 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:33:52.377 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "no active scrubs running", 2023-09-23T09:33:52.377 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": {} 2023-09-23T09:33:52.377 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:33:52.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.376+0000 7fb81afff700 1 -- 172.21.15.82:0/2932000277 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fb8040a01c0 msgr2=0x7fb8040a2680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:33:52.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.376+0000 7fb81afff700 1 --2- 172.21.15.82:0/2932000277 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fb8040a01c0 0x7fb8040a2680 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb800005c50 tx=0x7fb800015040 comp rx=0 tx=0).stop 2023-09-23T09:33:52.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.376+0000 7fb81afff700 1 -- 172.21.15.82:0/2932000277 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb814111880 msgr2=0x7fb81406af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:33:52.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.376+0000 7fb81afff700 1 --2- 172.21.15.82:0/2932000277 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb814111880 0x7fb81406af20 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fb80c00e970 tx=0x7fb80c00ec80 comp rx=0 tx=0).stop 2023-09-23T09:33:52.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.376+0000 7fb81afff700 1 -- 172.21.15.82:0/2932000277 shutdown_connections 2023-09-23T09:33:52.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.376+0000 7fb81afff700 1 --2- 172.21.15.82:0/2932000277 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fb8040a01c0 0x7fb8040a2680 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:52.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.376+0000 7fb81afff700 1 --2- 172.21.15.82:0/2932000277 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb814111880 0x7fb81406af20 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:52.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.376+0000 7fb81afff700 1 --2- 172.21.15.82:0/2932000277 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb814072cc0 0x7fb814071eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:52.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.376+0000 7fb81afff700 1 --2- 172.21.15.82:0/2932000277 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8140735e0 0x7fb814072430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:52.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.376+0000 7fb81afff700 1 -- 172.21.15.82:0/2932000277 >> 172.21.15.82:0/2932000277 conn(0x7fb8140fc3a0 msgr2=0x7fb8140fd010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:33:52.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.377+0000 7fb81afff700 1 -- 172.21.15.82:0/2932000277 shutdown_connections 2023-09-23T09:33:52.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.377+0000 7fb81afff700 1 -- 172.21.15.82:0/2932000277 wait complete. 2023-09-23T09:33:52.414 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-09-23T09:33:52.415 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-23T09:33:52.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.787+0000 7f1dd97ff700 1 -- 172.21.15.82:0/3428379392 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1dd4105770 msgr2=0x7f1dd4105b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:33:52.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.787+0000 7f1dd97ff700 1 --2- 172.21.15.82:0/3428379392 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1dd4105770 0x7f1dd4105b50 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f1dc4009990 tx=0x7f1dc4009ca0 comp rx=0 tx=0).stop 2023-09-23T09:33:52.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.788+0000 7f1dd97ff700 1 -- 172.21.15.82:0/3428379392 shutdown_connections 2023-09-23T09:33:52.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.788+0000 7f1dd97ff700 1 --2- 172.21.15.82:0/3428379392 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1dd4100120 0x7f1dd410c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:52.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.788+0000 7f1dd97ff700 1 --2- 172.21.15.82:0/3428379392 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1dd4105770 0x7f1dd4105b50 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:52.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.788+0000 7f1dd97ff700 1 --2- 172.21.15.82:0/3428379392 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1dd40ff760 0x7f1dd40ffbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:52.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.788+0000 7f1dd97ff700 1 -- 172.21.15.82:0/3428379392 >> 172.21.15.82:0/3428379392 conn(0x7f1dd40fb230 msgr2=0x7f1dd40fd650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:33:52.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.789+0000 7f1dd97ff700 1 -- 172.21.15.82:0/3428379392 shutdown_connections 2023-09-23T09:33:52.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.789+0000 7f1dd97ff700 1 -- 172.21.15.82:0/3428379392 wait complete. 2023-09-23T09:33:52.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.791+0000 7f1dd97ff700 1 Processor -- start 2023-09-23T09:33:52.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.791+0000 7f1dd97ff700 1 -- start start 2023-09-23T09:33:52.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.791+0000 7f1dd97ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1dd40ff760 0x7f1dd410a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:52.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.792+0000 7f1dd97ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1dd4100120 0x7f1dd4119ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:52.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.792+0000 7f1dd97ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1dd4105770 0x7f1dd410ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:52.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.792+0000 7f1dd97ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd410b320 con 0x7f1dd4105770 2023-09-23T09:33:52.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.792+0000 7f1dd97ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd410b460 con 0x7f1dd4100120 2023-09-23T09:33:52.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.792+0000 7f1dd97ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd410b620 con 0x7f1dd40ff760 2023-09-23T09:33:52.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.792+0000 7f1dd2ffd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1dd40ff760 0x7f1dd410a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:52.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.792+0000 7f1dd2ffd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1dd40ff760 0x7f1dd410a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:34720/0 (socket says 172.21.15.82:34720) 2023-09-23T09:33:52.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.792+0000 7f1dd2ffd700 1 -- 172.21.15.82:0/3752258889 learned_addr learned my addr 172.21.15.82:0/3752258889 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:33:52.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.792+0000 7f1dd37fe700 1 --2- 172.21.15.82:0/3752258889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1dd4105770 0x7f1dd410ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:52.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.793+0000 7f1dd27fc700 1 --2- 172.21.15.82:0/3752258889 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1dd4100120 0x7f1dd4119ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:52.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.793+0000 7f1dd2ffd700 1 -- 172.21.15.82:0/3752258889 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1dd4100120 msgr2=0x7f1dd4119ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:33:52.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.793+0000 7f1dd2ffd700 1 --2- 172.21.15.82:0/3752258889 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1dd4100120 0x7f1dd4119ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:52.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.793+0000 7f1dd2ffd700 1 -- 172.21.15.82:0/3752258889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1dd4105770 msgr2=0x7f1dd410ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:33:52.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.793+0000 7f1dd2ffd700 1 --2- 172.21.15.82:0/3752258889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1dd4105770 0x7f1dd410ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:52.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.793+0000 7f1dd2ffd700 1 -- 172.21.15.82:0/3752258889 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dc40095f0 con 0x7f1dd40ff760 2023-09-23T09:33:52.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.793+0000 7f1dd2ffd700 1 --2- 172.21.15.82:0/3752258889 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1dd40ff760 0x7f1dd410a8a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f1dc4000c00 tx=0x7f1dc4005720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:33:52.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.794+0000 7f1dcbfff700 1 -- 172.21.15.82:0/3752258889 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc401d070 con 0x7f1dd40ff760 2023-09-23T09:33:52.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.794+0000 7f1dcbfff700 1 -- 172.21.15.82:0/3752258889 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1dc4003f80 con 0x7f1dd40ff760 2023-09-23T09:33:52.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.794+0000 7f1dcbfff700 1 -- 172.21.15.82:0/3752258889 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc400fb80 con 0x7f1dd40ff760 2023-09-23T09:33:52.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.794+0000 7f1dd97ff700 1 -- 172.21.15.82:0/3752258889 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dd406a340 con 0x7f1dd40ff760 2023-09-23T09:33:52.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.794+0000 7f1dd97ff700 1 -- 172.21.15.82:0/3752258889 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dd406a7d0 con 0x7f1dd40ff760 2023-09-23T09:33:52.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.797+0000 7f1dd97ff700 1 -- 172.21.15.82:0/3752258889 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dd4102a00 con 0x7f1dd40ff760 2023-09-23T09:33:52.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.799+0000 7f1dcbfff700 1 -- 172.21.15.82:0/3752258889 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f1dc400fce0 con 0x7f1dd40ff760 2023-09-23T09:33:52.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.802+0000 7f1dcbfff700 1 --2- 172.21.15.82:0/3752258889 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f1dc00a0320 0x7f1dc00a27e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:52.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.802+0000 7f1dcbfff700 1 -- 172.21.15.82:0/3752258889 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f1dc40cc5f0 con 0x7f1dd40ff760 2023-09-23T09:33:52.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.803+0000 7f1dd27fc700 1 --2- 172.21.15.82:0/3752258889 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f1dc00a0320 0x7f1dc00a27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:52.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.804+0000 7f1dd27fc700 1 --2- 172.21.15.82:0/3752258889 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f1dc00a0320 0x7f1dc00a27e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f1dd410c090 tx=0x7f1dbc00c040 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:33:52.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:52.810+0000 7f1dcbfff700 1 -- 172.21.15.82:0/3752258889 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f1dc4099c20 con 0x7f1dd40ff760 2023-09-23T09:33:53.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:33:52 smithi135 ceph-mon[99205]: pgmap v1172: 97 pgs: 97 active+clean; 16 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 9.8 MiB/s wr, 898 op/s 2023-09-23T09:33:53.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:33:52 smithi082 ceph-mon[97694]: pgmap v1172: 97 pgs: 97 active+clean; 16 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 9.8 MiB/s wr, 898 op/s 2023-09-23T09:33:53.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:33:52 smithi161 ceph-mon[99580]: pgmap v1172: 97 pgs: 97 active+clean; 16 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 9.8 MiB/s wr, 898 op/s 2023-09-23T09:33:53.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.295+0000 7f1dd97ff700 1 -- 172.21.15.82:0/3752258889 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1dd4067710 con 0x7f1dd40ff760 2023-09-23T09:33:53.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.297+0000 7f1dcbfff700 1 -- 172.21.15.82:0/3752258889 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 109 v109) v1 ==== 95+0+11351 (secure 0 0 0) 0x7f1dc40997b0 con 0x7f1dd40ff760 2023-09-23T09:33:53.301 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T09:33:53.301 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":109,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/1237857359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1237857359},{"type":"v1","addr":"172.21.15.82:6835","nonce":1237857359}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/1335102362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":1335102362},{"type":"v1","addr":"172.21.15.82:6837","nonce":1335102362}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":109,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-23T08:54:52.600479+0000","modified":"2023-09-23T09:33:48.221963+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24557,"mds_1":24550,"mds_2":24526,"mds_3":24515,"mds_4":24514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/3645331700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3645331700},{"type":"v1","addr":"172.21.15.135:6835","nonce":3645331700}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14658":{"gid":14658,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6839/205725278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":205725278},{"type":"v1","addr":"172.21.15.82:6839","nonce":205725278}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14670":{"gid":14670,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6841/2659297867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":2659297867},{"type":"v1","addr":"172.21.15.82:6841","nonce":2659297867}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24461":{"gid":24461,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/503886037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":503886037},{"type":"v1","addr":"172.21.15.135:6833","nonce":503886037}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24463":{"gid":24463,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.161:6833/471569125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":471569125},{"type":"v1","addr":"172.21.15.161:6833","nonce":471569125}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24514":{"gid":24514,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":10,"addr":"172.21.15.161:6835/2237964162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":2237964162},{"type":"v1","addr":"172.21.15.161:6835","nonce":2237964162}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24515":{"gid":24515,"name":"h","rank":3,"incarnation":22,"state":"up:active","state_seq":8,"addr":"172.21.15.135:6837/2655304858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2655304858},{"type":"v1","addr":"172.21.15.135:6837","nonce":2655304858}]},"join_fscid":-1,"export_targets":[0,1,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24526":{"gid":24526,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.161:6837/43639843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":43639843},{"type":"v1","addr":"172.21.15.161:6837","nonce":43639843}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24550":{"gid":24550,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.161:6839/758982817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6838","nonce":758982817},{"type":"v1","addr":"172.21.15.161:6839","nonce":758982817}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24557":{"gid":24557,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6839/2508669274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2508669274},{"type":"v1","addr":"172.21.15.135:6839","nonce":2508669274}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-23T09:33:53.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.303+0000 7f1dd97ff700 1 -- 172.21.15.82:0/3752258889 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f1dc00a0320 msgr2=0x7f1dc00a27e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:33:53.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.303+0000 7f1dd97ff700 1 --2- 172.21.15.82:0/3752258889 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f1dc00a0320 0x7f1dc00a27e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f1dd410c090 tx=0x7f1dbc00c040 comp rx=0 tx=0).stop 2023-09-23T09:33:53.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.303+0000 7f1dd97ff700 1 -- 172.21.15.82:0/3752258889 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1dd40ff760 msgr2=0x7f1dd410a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:33:53.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.303+0000 7f1dd97ff700 1 --2- 172.21.15.82:0/3752258889 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1dd40ff760 0x7f1dd410a8a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f1dc4000c00 tx=0x7f1dc4005720 comp rx=0 tx=0).stop 2023-09-23T09:33:53.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.306+0000 7f1dd97ff700 1 -- 172.21.15.82:0/3752258889 shutdown_connections 2023-09-23T09:33:53.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.306+0000 7f1dd97ff700 1 --2- 172.21.15.82:0/3752258889 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f1dc00a0320 0x7f1dc00a27e0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:53.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.306+0000 7f1dd97ff700 1 --2- 172.21.15.82:0/3752258889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1dd4105770 0x7f1dd410ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:53.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.306+0000 7f1dd97ff700 1 --2- 172.21.15.82:0/3752258889 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1dd40ff760 0x7f1dd410a8a0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:53.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.306+0000 7f1dd97ff700 1 --2- 172.21.15.82:0/3752258889 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1dd4100120 0x7f1dd4119ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:53.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.306+0000 7f1dd97ff700 1 -- 172.21.15.82:0/3752258889 >> 172.21.15.82:0/3752258889 conn(0x7f1dd40fb230 msgr2=0x7f1dd40fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:33:53.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.307+0000 7f1dd97ff700 1 -- 172.21.15.82:0/3752258889 shutdown_connections 2023-09-23T09:33:53.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.308+0000 7f1dd97ff700 1 -- 172.21.15.82:0/3752258889 wait complete. 2023-09-23T09:33:53.318 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 109 2023-09-23T09:33:53.340 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-09-23T09:33:53.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.727+0000 7f9188dff700 1 -- 172.21.15.82:0/1202139565 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f918410cfc0 msgr2=0x7f918410d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:33:53.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.727+0000 7f9188dff700 1 --2- 172.21.15.82:0/1202139565 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f918410cfc0 0x7f918410d3a0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f9174009990 tx=0x7f9174009ca0 comp rx=0 tx=0).stop 2023-09-23T09:33:53.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.729+0000 7f9188dff700 1 -- 172.21.15.82:0/1202139565 shutdown_connections 2023-09-23T09:33:53.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.729+0000 7f9188dff700 1 --2- 172.21.15.82:0/1202139565 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9184107a00 0x7f9184113d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:53.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.729+0000 7f9188dff700 1 --2- 172.21.15.82:0/1202139565 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f918410cfc0 0x7f918410d3a0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:53.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.729+0000 7f9188dff700 1 --2- 172.21.15.82:0/1202139565 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9184107040 0x7f91841074c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:53.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.729+0000 7f9188dff700 1 -- 172.21.15.82:0/1202139565 >> 172.21.15.82:0/1202139565 conn(0x7f91840767c0 msgr2=0x7f9184105740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:33:53.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.732+0000 7f9188dff700 1 -- 172.21.15.82:0/1202139565 shutdown_connections 2023-09-23T09:33:53.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.732+0000 7f9188dff700 1 -- 172.21.15.82:0/1202139565 wait complete. 2023-09-23T09:33:53.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.733+0000 7f9188dff700 1 Processor -- start 2023-09-23T09:33:53.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.735+0000 7f9188dff700 1 -- start start 2023-09-23T09:33:53.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.735+0000 7f9188dff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9184107040 0x7f9184079ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:53.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.735+0000 7f9188dff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9184107a00 0x7f918407a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:53.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.735+0000 7f9188dff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f918410cfc0 0x7f91841b1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:53.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.735+0000 7f9188dff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91841b1960 con 0x7f9184107040 2023-09-23T09:33:53.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.735+0000 7f9188dff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f918406a370 con 0x7f918410cfc0 2023-09-23T09:33:53.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.735+0000 7f9188dff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f918406a530 con 0x7f9184107a00 2023-09-23T09:33:53.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.736+0000 7f918259c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9184107040 0x7f9184079ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:53.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.736+0000 7f918259c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9184107040 0x7f9184079ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50092/0 (socket says 172.21.15.82:50092) 2023-09-23T09:33:53.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.736+0000 7f918259c700 1 -- 172.21.15.82:0/1769551104 learned_addr learned my addr 172.21.15.82:0/1769551104 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:33:53.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.736+0000 7f9181d9b700 1 --2- 172.21.15.82:0/1769551104 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9184107a00 0x7f918407a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:53.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.736+0000 7f9182d9d700 1 --2- 172.21.15.82:0/1769551104 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f918410cfc0 0x7f91841b1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:53.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.736+0000 7f918259c700 1 -- 172.21.15.82:0/1769551104 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9184107a00 msgr2=0x7f918407a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:33:53.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.736+0000 7f918259c700 1 --2- 172.21.15.82:0/1769551104 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9184107a00 0x7f918407a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:53.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.736+0000 7f918259c700 1 -- 172.21.15.82:0/1769551104 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f918410cfc0 msgr2=0x7f91841b1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:33:53.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.736+0000 7f918259c700 1 --2- 172.21.15.82:0/1769551104 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f918410cfc0 0x7f91841b1390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:53.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.736+0000 7f918259c700 1 -- 172.21.15.82:0/1769551104 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91740095f0 con 0x7f9184107040 2023-09-23T09:33:53.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.737+0000 7f9182d9d700 1 --2- 172.21.15.82:0/1769551104 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f918410cfc0 0x7f91841b1390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:33:53.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.737+0000 7f918259c700 1 --2- 172.21.15.82:0/1769551104 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9184107040 0x7f9184079ca0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f917400f6c0 tx=0x7f917400bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:33:53.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.738+0000 7f91737fe700 1 -- 172.21.15.82:0/1769551104 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f917401d070 con 0x7f9184107040 2023-09-23T09:33:53.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.738+0000 7f91737fe700 1 -- 172.21.15.82:0/1769551104 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9174005da0 con 0x7f9184107040 2023-09-23T09:33:53.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.738+0000 7f91737fe700 1 -- 172.21.15.82:0/1769551104 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91740047e0 con 0x7f9184107040 2023-09-23T09:33:53.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.738+0000 7f9188dff700 1 -- 172.21.15.82:0/1769551104 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f918406a7b0 con 0x7f9184107040 2023-09-23T09:33:53.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.738+0000 7f9188dff700 1 -- 172.21.15.82:0/1769551104 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f918406ac10 con 0x7f9184107040 2023-09-23T09:33:53.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.746+0000 7f919c7bbb80 1 Processor -- start 2023-09-23T09:33:53.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.747+0000 7f919c7bbb80 1 -- start start 2023-09-23T09:33:53.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.747+0000 7f919c7bbb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558f0426b380 0x558f0426b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:53.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.747+0000 7f919c7bbb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f0426bca0 0x558f04265700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:53.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.747+0000 7f919c7bbb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558f04265c40 0x558f042660a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:53.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.747+0000 7f919c7bbb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f041cd7b0 con 0x558f0426bca0 2023-09-23T09:33:53.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.747+0000 7f919c7bbb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f041be780 con 0x558f0426b380 2023-09-23T09:33:53.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.747+0000 7f919c7bbb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f041bc0a0 con 0x558f04265c40 2023-09-23T09:33:53.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.748+0000 7f9181d9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558f04265c40 0x558f042660a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:53.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.748+0000 7f9181d9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558f04265c40 0x558f042660a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:34738/0 (socket says 172.21.15.82:34738) 2023-09-23T09:33:53.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.748+0000 7f9181d9b700 1 -- 172.21.15.82:0/573830314 learned_addr learned my addr 172.21.15.82:0/573830314 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:33:53.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.748+0000 7f9181d9b700 1 -- 172.21.15.82:0/573830314 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558f0426b380 msgr2=0x558f0426b760 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-23T09:33:53.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.749+0000 7f9181d9b700 1 --2- 172.21.15.82:0/573830314 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558f0426b380 0x558f0426b760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:53.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.749+0000 7f9181d9b700 1 -- 172.21.15.82:0/573830314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f0426bca0 msgr2=0x558f04265700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:33:53.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.749+0000 7f9181d9b700 1 --2- 172.21.15.82:0/573830314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f0426bca0 0x558f04265700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:53.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.749+0000 7f9181d9b700 1 -- 172.21.15.82:0/573830314 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558f04037630 con 0x558f04265c40 2023-09-23T09:33:53.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.749+0000 7f91737fe700 1 -- 172.21.15.82:0/1769551104 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f91740052c0 con 0x7f9184107040 2023-09-23T09:33:53.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.749+0000 7f9181d9b700 1 --2- 172.21.15.82:0/573830314 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558f04265c40 0x558f042660a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9178009d20 tx=0x7f9178011720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88deb552072bb7a4 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:33:53.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.749+0000 7f9170ff9700 1 -- 172.21.15.82:0/573830314 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9178004a30 con 0x558f04265c40 2023-09-23T09:33:53.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.750+0000 7f9170ff9700 1 -- 172.21.15.82:0/573830314 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f91780054b0 con 0x558f04265c40 2023-09-23T09:33:53.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.750+0000 7f9170ff9700 1 -- 172.21.15.82:0/573830314 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9178019890 con 0x558f04265c40 2023-09-23T09:33:53.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.750+0000 7f919c7bbb80 1 -- 172.21.15.82:0/573830314 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558f04265c40 msgr2=0x558f042660a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:33:53.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.750+0000 7f919c7bbb80 1 --2- 172.21.15.82:0/573830314 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558f04265c40 0x558f042660a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9178009d20 tx=0x7f9178011720 comp rx=0 tx=0).stop 2023-09-23T09:33:53.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.751+0000 7f919c7bbb80 1 -- 172.21.15.82:0/573830314 shutdown_connections 2023-09-23T09:33:53.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.751+0000 7f919c7bbb80 1 --2- 172.21.15.82:0/573830314 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558f04265c40 0x558f042660a0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:53.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.751+0000 7f919c7bbb80 1 --2- 172.21.15.82:0/573830314 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558f0426b380 0x558f0426b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:53.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.751+0000 7f919c7bbb80 1 --2- 172.21.15.82:0/573830314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f0426bca0 0x558f04265700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:53.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.751+0000 7f919c7bbb80 1 -- 172.21.15.82:0/573830314 >> 172.21.15.82:0/573830314 conn(0x558f041da0e0 msgr2=0x558f04260410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:33:53.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.751+0000 7f91737fe700 1 --2- 172.21.15.82:0/1769551104 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f916c0a0290 0x7f916c0a2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:53.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.751+0000 7f919c7bbb80 1 -- 172.21.15.82:0/573830314 shutdown_connections 2023-09-23T09:33:53.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.751+0000 7f91737fe700 1 -- 172.21.15.82:0/1769551104 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f91740cc2e0 con 0x7f9184107040 2023-09-23T09:33:53.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.752+0000 7f919c7bbb80 1 -- 172.21.15.82:0/573830314 wait complete. 2023-09-23T09:33:53.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.752+0000 7f9181d9b700 1 --2- 172.21.15.82:0/1769551104 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f916c0a0290 0x7f916c0a2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:53.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.752+0000 7f919c7bbb80 1 -- start start 2023-09-23T09:33:53.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.753+0000 7f919c7bbb80 1 Processor -- start 2023-09-23T09:33:53.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.753+0000 7f9181d9b700 1 --2- 172.21.15.82:0/1769551104 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f916c0a0290 0x7f916c0a2750 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9178004f60 tx=0x7f9178000bc0 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:33:53.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.754+0000 7f919c7bbb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558f04265c40 0x558f04271c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:53.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.754+0000 7f919c7bbb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f0426b380 0x558f0426ef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:53.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.754+0000 7f919c7bbb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558f0426bca0 0x558f0426f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:53.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.754+0000 7f919c7bbb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f041b7990 con 0x558f0426b380 2023-09-23T09:33:53.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.754+0000 7f919c7bbb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f04155bb0 con 0x558f04265c40 2023-09-23T09:33:53.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.754+0000 7f919c7bbb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f041558b0 con 0x558f0426bca0 2023-09-23T09:33:53.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.754+0000 7f919c7bbb80 10 client.0 _ll_register_callbacks cb 0x558f0409fa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:33:53.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.755+0000 7f918259c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558f04265c40 0x558f04271c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:53.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.755+0000 7f918259c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558f04265c40 0x558f04271c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:44210/0 (socket says 172.21.15.82:44210) 2023-09-23T09:33:53.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.755+0000 7f918259c700 1 -- 172.21.15.82:0/3831189092 learned_addr learned my addr 172.21.15.82:0/3831189092 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:33:53.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.755+0000 7f9182d9d700 1 --2- 172.21.15.82:0/3831189092 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558f0426bca0 0x558f0426f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:53.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.756+0000 7f918259c700 1 -- 172.21.15.82:0/3831189092 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558f0426bca0 msgr2=0x558f0426f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:33:53.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.756+0000 7f918259c700 1 --2- 172.21.15.82:0/3831189092 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558f0426bca0 0x558f0426f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:53.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.756+0000 7f918259c700 1 -- 172.21.15.82:0/3831189092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f0426b380 msgr2=0x558f0426ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:33:53.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.756+0000 7f918259c700 1 --2- 172.21.15.82:0/3831189092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f0426b380 0x558f0426ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:53.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.756+0000 7f918259c700 1 -- 172.21.15.82:0/3831189092 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9178009980 con 0x558f04265c40 2023-09-23T09:33:53.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.757+0000 7f918259c700 1 --2- 172.21.15.82:0/3831189092 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558f04265c40 0x558f04271c80 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f9174006010 tx=0x7f91740c9f30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6fe18774bfbb679 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:33:53.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.757+0000 7f9169ffb700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-09-23T09:33:53.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.757+0000 7f9169ffb700 1 -- 172.21.15.82:0/3831189092 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f917409d850 con 0x558f04265c40 2023-09-23T09:33:53.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.757+0000 7f9169ffb700 1 -- 172.21.15.82:0/3831189092 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(149..149 src has 1..149) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f91740a17a0 con 0x558f04265c40 2023-09-23T09:33:53.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.758+0000 7f919c7bbb80 1 -- 172.21.15.82:0/3831189092 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558f042351c0 con 0x558f04265c40 2023-09-23T09:33:53.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.762+0000 7f9169ffb700 1 -- 172.21.15.82:0/3831189092 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=109) v2 ==== 24+0+0 (secure 0 0 0) 0x7f91740a1310 con 0x558f04265c40 2023-09-23T09:33:53.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.765+0000 7f919c7bbb80 10 client.27605 fetch_fsmap learned FSMap version 109 2023-09-23T09:33:53.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.765+0000 7f919c7bbb80 1 -- 172.21.15.82:0/3831189092 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=109,monmap=4+}) v3 -- 0x558f03fe3de0 con 0x558f04265c40 2023-09-23T09:33:53.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.766+0000 7f9169ffb700 1 -- 172.21.15.82:0/3831189092 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x558f042351c0 con 0x558f04265c40 2023-09-23T09:33:53.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.766+0000 7f9169ffb700 1 -- 172.21.15.82:0/3831189092 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 109) v1 ==== 7942+0+0 (secure 0 0 0) 0x7f9174095a50 con 0x558f04265c40 2023-09-23T09:33:53.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.766+0000 7f919c7bbb80 10 client.27605 fetch_fsmap finished waiting for FSMap version 109 2023-09-23T09:33:53.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.766+0000 7f919c7bbb80 10 client.27605 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2023-09-23T09:33:53.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.766+0000 7f919c7bbb80 20 client.27605 populate_metadata read hostname 'smithi082' 2023-09-23T09:33:53.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.766+0000 7f919c7bbb80 1 --2- 172.21.15.82:0/3831189092 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x558f0427f400 0x558f04281820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:53.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.766+0000 7f919c7bbb80 4 client.27605 mds_command: new command op to 24514 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:33:53.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.766+0000 7f919c7bbb80 1 -- 172.21.15.82:0/3831189092 --> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558f0415dba0 con 0x558f0427f400 2023-09-23T09:33:53.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.768+0000 7f9181d9b700 1 --2- 172.21.15.82:0/3831189092 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x558f0427f400 0x558f04281820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:53.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.769+0000 7f9181d9b700 1 --2- 172.21.15.82:0/3831189092 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x558f0427f400 0x558f04281820 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=7e2716b177eb2d74 server_cookie=a9b1630cd2f8c25d in_seq=0 out_seq=0 2023-09-23T09:33:53.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.769+0000 7f9169ffb700 10 client.27605 ms_handle_connect on v2:172.21.15.161:6834/2237964162 2023-09-23T09:33:53.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.770+0000 7f9169ffb700 1 -- 172.21.15.82:0/3831189092 <== mds.4 v2:172.21.15.161:6834/2237964162 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558f0415dba0 con 0x558f0427f400 2023-09-23T09:33:53.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.770+0000 7f9169ffb700 10 client.27605 handle_command_reply: tid=0 2023-09-23T09:33:53.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.770+0000 7f919c7bbb80 1 client.27605 shutdown 2023-09-23T09:33:53.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.774+0000 7f919c7bbb80 1 -- 172.21.15.82:0/3831189092 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558f04265c40 msgr2=0x558f04271c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:33:53.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.774+0000 7f919c7bbb80 1 --2- 172.21.15.82:0/3831189092 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558f04265c40 0x558f04271c80 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f9174006010 tx=0x7f91740c9f30 comp rx=0 tx=0).stop 2023-09-23T09:33:53.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.781+0000 7f919c7bbb80 1 -- 172.21.15.82:0/3831189092 shutdown_connections 2023-09-23T09:33:53.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.781+0000 7f919c7bbb80 1 --2- 172.21.15.82:0/3831189092 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x558f0427f400 0x558f04281820 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:53.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.781+0000 7f919c7bbb80 1 --2- 172.21.15.82:0/3831189092 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558f0426bca0 0x558f0426f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:53.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.781+0000 7f919c7bbb80 1 --2- 172.21.15.82:0/3831189092 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558f04265c40 0x558f04271c80 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:53.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.781+0000 7f919c7bbb80 1 --2- 172.21.15.82:0/3831189092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f0426b380 0x558f0426ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:53.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.781+0000 7f919c7bbb80 1 -- 172.21.15.82:0/3831189092 >> 172.21.15.82:0/3831189092 conn(0x558f041da0e0 msgr2=0x558f0425ab40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:33:53.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.781+0000 7f9169ffb700 0 client.27605 ms_handle_reset on v2:172.21.15.161:6834/2237964162 2023-09-23T09:33:53.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.781+0000 7f919c7bbb80 1 -- 172.21.15.82:0/3831189092 shutdown_connections 2023-09-23T09:33:53.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.781+0000 7f919c7bbb80 1 -- 172.21.15.82:0/3831189092 wait complete. 2023-09-23T09:33:53.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.783+0000 7f919c7bbb80 20 client.27605 trim_cache size 0 max 16384 2023-09-23T09:33:53.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.809+0000 7f919c7bbb80 1 Processor -- start 2023-09-23T09:33:53.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.810+0000 7f919c7bbb80 1 -- start start 2023-09-23T09:33:53.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.810+0000 7f919c7bbb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f04265c40 0x558f04271820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:53.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.810+0000 7f919c7bbb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558f0426b380 0x558f0426e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:53.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.810+0000 7f919c7bbb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558f0426bca0 0x558f0426ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:53.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.810+0000 7f919c7bbb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f04039920 con 0x558f04265c40 2023-09-23T09:33:53.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.810+0000 7f919c7bbb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f0425cd00 con 0x558f0426b380 2023-09-23T09:33:53.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.810+0000 7f919c7bbb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f04261dc0 con 0x558f0426bca0 2023-09-23T09:33:53.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.811+0000 7f9182d9d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558f0426bca0 0x558f0426ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:53.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.811+0000 7f9182d9d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558f0426bca0 0x558f0426ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:34758/0 (socket says 172.21.15.82:34758) 2023-09-23T09:33:53.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.811+0000 7f9181d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558f0426b380 0x558f0426e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:53.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.811+0000 7f9182d9d700 1 -- 172.21.15.82:0/2366330818 learned_addr learned my addr 172.21.15.82:0/2366330818 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:33:53.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.811+0000 7f918259c700 1 --2- 172.21.15.82:0/2366330818 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f04265c40 0x558f04271820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:53.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.811+0000 7f9182d9d700 1 -- 172.21.15.82:0/2366330818 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558f0426b380 msgr2=0x558f0426e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:33:53.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.812+0000 7f9182d9d700 1 --2- 172.21.15.82:0/2366330818 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558f0426b380 0x558f0426e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:53.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.812+0000 7f9182d9d700 1 -- 172.21.15.82:0/2366330818 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f04265c40 msgr2=0x558f04271820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:33:53.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.812+0000 7f9182d9d700 1 --2- 172.21.15.82:0/2366330818 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f04265c40 0x558f04271820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:53.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.812+0000 7f9182d9d700 1 -- 172.21.15.82:0/2366330818 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558f042662f0 con 0x558f0426bca0 2023-09-23T09:33:53.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.812+0000 7f9182d9d700 1 --2- 172.21.15.82:0/2366330818 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558f0426bca0 0x558f0426ec60 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f917c009440 tx=0x7f917c00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5095583f37551877 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:33:53.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.819+0000 7f91717fa700 1 -- 172.21.15.82:0/2366330818 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f917c00e030 con 0x558f0426bca0 2023-09-23T09:33:53.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.819+0000 7f91717fa700 1 -- 172.21.15.82:0/2366330818 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f917c00f040 con 0x558f0426bca0 2023-09-23T09:33:53.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.819+0000 7f91717fa700 1 -- 172.21.15.82:0/2366330818 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f917c015990 con 0x558f0426bca0 2023-09-23T09:33:53.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.820+0000 7f919c7bbb80 1 -- 172.21.15.82:0/2366330818 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558f0426bca0 msgr2=0x558f0426ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:33:53.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.820+0000 7f919c7bbb80 1 --2- 172.21.15.82:0/2366330818 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558f0426bca0 0x558f0426ec60 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f917c009440 tx=0x7f917c00b040 comp rx=0 tx=0).stop 2023-09-23T09:33:53.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.820+0000 7f919c7bbb80 1 -- 172.21.15.82:0/2366330818 shutdown_connections 2023-09-23T09:33:53.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.820+0000 7f919c7bbb80 1 --2- 172.21.15.82:0/2366330818 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558f0426bca0 0x558f0426ec60 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:53.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.820+0000 7f919c7bbb80 1 --2- 172.21.15.82:0/2366330818 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f04265c40 0x558f04271820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:53.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.820+0000 7f919c7bbb80 1 --2- 172.21.15.82:0/2366330818 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558f0426b380 0x558f0426e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:53.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.820+0000 7f919c7bbb80 1 -- 172.21.15.82:0/2366330818 >> 172.21.15.82:0/2366330818 conn(0x558f041da0e0 msgr2=0x558f042690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:33:53.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.821+0000 7f919c7bbb80 1 -- 172.21.15.82:0/2366330818 shutdown_connections 2023-09-23T09:33:53.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.821+0000 7f919c7bbb80 1 -- 172.21.15.82:0/2366330818 wait complete. 2023-09-23T09:33:53.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.821+0000 7f919c7bbb80 1 -- start start 2023-09-23T09:33:53.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.822+0000 7f919c7bbb80 1 Processor -- start 2023-09-23T09:33:53.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.822+0000 7f919c7bbb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f04265c40 0x558f04276680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:53.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.822+0000 7f919c7bbb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558f0426b380 0x558f04272990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:53.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.822+0000 7f919c7bbb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558f0426bca0 0x558f04272ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:53.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.822+0000 7f919c7bbb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f04273520 con 0x558f04265c40 2023-09-23T09:33:53.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.822+0000 7f919c7bbb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f04273690 con 0x558f0426bca0 2023-09-23T09:33:53.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.822+0000 7f919c7bbb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f04273850 con 0x558f0426b380 2023-09-23T09:33:53.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.822+0000 7f919c7bbb80 10 client.0 _ll_register_callbacks cb 0x7f9174095e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:33:53.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.823+0000 7f9181d9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558f0426b380 0x558f04272990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:53.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.823+0000 7f9181d9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558f0426b380 0x558f04272990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:34774/0 (socket says 172.21.15.82:34774) 2023-09-23T09:33:53.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.823+0000 7f9181d9b700 1 -- 172.21.15.82:0/3910238514 learned_addr learned my addr 172.21.15.82:0/3910238514 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:33:53.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.823+0000 7f9182d9d700 1 --2- 172.21.15.82:0/3910238514 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558f0426bca0 0x558f04272ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:53.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.823+0000 7f9181d9b700 1 -- 172.21.15.82:0/3910238514 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558f0426bca0 msgr2=0x558f04272ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:33:53.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.823+0000 7f9181d9b700 1 --2- 172.21.15.82:0/3910238514 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558f0426bca0 0x558f04272ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:53.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.823+0000 7f9181d9b700 1 -- 172.21.15.82:0/3910238514 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f04265c40 msgr2=0x558f04276680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:33:53.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.823+0000 7f9181d9b700 1 --2- 172.21.15.82:0/3910238514 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f04265c40 0x558f04276680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:53.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.823+0000 7f9181d9b700 1 -- 172.21.15.82:0/3910238514 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f917c0090f0 con 0x558f0426b380 2023-09-23T09:33:53.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.824+0000 7f9181d9b700 1 --2- 172.21.15.82:0/3910238514 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558f0426b380 0x558f04272990 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f9178009230 tx=0x7f9178011720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cbf3ed20c6dd8e96 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:33:53.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.825+0000 7f9169ffb700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T09:33:53.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.825+0000 7f9169ffb700 1 -- 172.21.15.82:0/3910238514 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9178034530 con 0x558f0426b380 2023-09-23T09:33:53.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.825+0000 7f9169ffb700 1 -- 172.21.15.82:0/3910238514 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(149..149 src has 1..149) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f917803a070 con 0x558f0426b380 2023-09-23T09:33:53.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.825+0000 7f919c7bbb80 1 -- 172.21.15.82:0/3910238514 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558f0427c160 con 0x558f0426b380 2023-09-23T09:33:53.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.826+0000 7f9169ffb700 1 -- 172.21.15.82:0/3910238514 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=109) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9178004ba0 con 0x558f0426b380 2023-09-23T09:33:53.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.826+0000 7f919c7bbb80 10 client.27640 fetch_fsmap learned FSMap version 109 2023-09-23T09:33:53.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.826+0000 7f919c7bbb80 1 -- 172.21.15.82:0/3910238514 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=109,monmap=4+}) v3 -- 0x558f03fccc60 con 0x558f0426b380 2023-09-23T09:33:53.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.827+0000 7f9169ffb700 1 -- 172.21.15.82:0/3910238514 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x558f0427c160 con 0x558f0426b380 2023-09-23T09:33:53.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.827+0000 7f9169ffb700 1 -- 172.21.15.82:0/3910238514 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 109) v1 ==== 7942+0+0 (secure 0 0 0) 0x7f9178019670 con 0x558f0426b380 2023-09-23T09:33:53.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.827+0000 7f919c7bbb80 10 client.27640 fetch_fsmap finished waiting for FSMap version 109 2023-09-23T09:33:53.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.827+0000 7f919c7bbb80 10 client.27640 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2023-09-23T09:33:53.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.827+0000 7f919c7bbb80 20 client.27640 populate_metadata read hostname 'smithi082' 2023-09-23T09:33:53.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.828+0000 7f919c7bbb80 1 --2- 172.21.15.82:0/3910238514 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x558f042d48e0 0x558f042d6d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:53.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.828+0000 7f919c7bbb80 4 client.27640 mds_command: new command op to 24514 tid=0[{"prefix": "damage ls"}] 2023-09-23T09:33:53.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.828+0000 7f919c7bbb80 1 -- 172.21.15.82:0/3910238514 --> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x558f042588b0 con 0x558f042d48e0 2023-09-23T09:33:53.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.828+0000 7f918259c700 1 --2- 172.21.15.82:0/3910238514 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x558f042d48e0 0x558f042d6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:53.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.829+0000 7f9169ffb700 10 client.27640 ms_handle_connect on v2:172.21.15.161:6834/2237964162 2023-09-23T09:33:53.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.829+0000 7f918259c700 1 --2- 172.21.15.82:0/3910238514 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x558f042d48e0 0x558f042d6d00 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=a55ff116661ca92e server_cookie=86f01a075ebb70fa in_seq=0 out_seq=0 2023-09-23T09:33:53.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.830+0000 7f9169ffb700 1 -- 172.21.15.82:0/3910238514 <== mds.4 v2:172.21.15.161:6834/2237964162 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x558f042588b0 con 0x558f042d48e0 2023-09-23T09:33:53.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.830+0000 7f9169ffb700 10 client.27640 handle_command_reply: tid=0 2023-09-23T09:33:53.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.831+0000 7f919c7bbb80 1 client.27640 shutdown 2023-09-23T09:33:53.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.831+0000 7f919c7bbb80 1 -- 172.21.15.82:0/3910238514 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558f0426b380 msgr2=0x558f04272990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:33:53.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.831+0000 7f919c7bbb80 1 --2- 172.21.15.82:0/3910238514 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558f0426b380 0x558f04272990 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f9178009230 tx=0x7f9178011720 comp rx=0 tx=0).stop 2023-09-23T09:33:53.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.831+0000 7f919c7bbb80 1 -- 172.21.15.82:0/3910238514 shutdown_connections 2023-09-23T09:33:53.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.831+0000 7f919c7bbb80 1 --2- 172.21.15.82:0/3910238514 >> [v2:172.21.15.161:6834/2237964162,v1:172.21.15.161:6835/2237964162] conn(0x558f042d48e0 0x558f042d6d00 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:53.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.831+0000 7f919c7bbb80 1 --2- 172.21.15.82:0/3910238514 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558f0426bca0 0x558f04272ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:53.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.831+0000 7f919c7bbb80 1 --2- 172.21.15.82:0/3910238514 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f04265c40 0x558f04276680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:53.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.831+0000 7f919c7bbb80 1 --2- 172.21.15.82:0/3910238514 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558f0426b380 0x558f04272990 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:53.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.831+0000 7f919c7bbb80 1 -- 172.21.15.82:0/3910238514 >> 172.21.15.82:0/3910238514 conn(0x558f041da0e0 msgr2=0x558f0426a000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:33:53.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.831+0000 7f9169ffb700 0 client.27640 ms_handle_reset on v2:172.21.15.161:6834/2237964162 2023-09-23T09:33:53.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.832+0000 7f919c7bbb80 1 -- 172.21.15.82:0/3910238514 shutdown_connections 2023-09-23T09:33:53.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.832+0000 7f919c7bbb80 1 -- 172.21.15.82:0/3910238514 wait complete. 2023-09-23T09:33:53.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.832+0000 7f919c7bbb80 20 client.27640 trim_cache size 0 max 16384 2023-09-23T09:33:53.835 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2023-09-23T09:33:53.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.834+0000 7f9188dff700 1 -- 172.21.15.82:0/1769551104 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f916c0a0290 msgr2=0x7f916c0a2750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:33:53.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.834+0000 7f9188dff700 1 --2- 172.21.15.82:0/1769551104 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f916c0a0290 0x7f916c0a2750 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9178004f60 tx=0x7f9178000bc0 comp rx=0 tx=0).stop 2023-09-23T09:33:53.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.834+0000 7f9188dff700 1 -- 172.21.15.82:0/1769551104 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9184107040 msgr2=0x7f9184079ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:33:53.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.834+0000 7f9188dff700 1 --2- 172.21.15.82:0/1769551104 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9184107040 0x7f9184079ca0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f917400f6c0 tx=0x7f917400bfd0 comp rx=0 tx=0).stop 2023-09-23T09:33:53.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.839+0000 7f9188dff700 1 -- 172.21.15.82:0/1769551104 shutdown_connections 2023-09-23T09:33:53.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.839+0000 7f9188dff700 1 --2- 172.21.15.82:0/1769551104 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f916c0a0290 0x7f916c0a2750 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:53.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.839+0000 7f9188dff700 1 --2- 172.21.15.82:0/1769551104 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f918410cfc0 0x7f91841b1390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:53.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.839+0000 7f9188dff700 1 --2- 172.21.15.82:0/1769551104 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9184107040 0x7f9184079ca0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:53.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.839+0000 7f9188dff700 1 --2- 172.21.15.82:0/1769551104 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9184107a00 0x7f918407a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:53.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.839+0000 7f9188dff700 1 -- 172.21.15.82:0/1769551104 >> 172.21.15.82:0/1769551104 conn(0x7f91840767c0 msgr2=0x7f9184077a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:33:53.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.846+0000 7f9188dff700 1 -- 172.21.15.82:0/1769551104 shutdown_connections 2023-09-23T09:33:53.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:53.846+0000 7f9188dff700 1 -- 172.21.15.82:0/1769551104 wait complete. 2023-09-23T09:33:53.878 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-09-23T09:33:54.122 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:33:53 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/3752258889' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T09:33:54.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:33:53 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/3752258889' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T09:33:54.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.243+0000 7f5b721ff700 1 -- 172.21.15.82:0/759902713 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b6c115920 msgr2=0x7f5b6c117d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:33:54.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.243+0000 7f5b721ff700 1 --2- 172.21.15.82:0/759902713 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b6c115920 0x7f5b6c117d30 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c009f90 tx=0x7f5b5c00b330 comp rx=0 tx=0).stop 2023-09-23T09:33:54.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.243+0000 7f5b721ff700 1 -- 172.21.15.82:0/759902713 shutdown_connections 2023-09-23T09:33:54.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.243+0000 7f5b721ff700 1 --2- 172.21.15.82:0/759902713 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b6c115920 0x7f5b6c117d30 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:54.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.243+0000 7f5b721ff700 1 --2- 172.21.15.82:0/759902713 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b6c10af90 0x7f5b6c107920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:54.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.243+0000 7f5b721ff700 1 --2- 172.21.15.82:0/759902713 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b6c107e60 0x7f5b6c1082e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:54.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.243+0000 7f5b721ff700 1 -- 172.21.15.82:0/759902713 >> 172.21.15.82:0/759902713 conn(0x7f5b6c06cbe0 msgr2=0x7f5b6c06cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:33:54.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.244+0000 7f5b721ff700 1 -- 172.21.15.82:0/759902713 shutdown_connections 2023-09-23T09:33:54.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.244+0000 7f5b721ff700 1 -- 172.21.15.82:0/759902713 wait complete. 2023-09-23T09:33:54.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.245+0000 7f5b721ff700 1 Processor -- start 2023-09-23T09:33:54.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.245+0000 7f5b721ff700 1 -- start start 2023-09-23T09:33:54.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.246+0000 7f5b721ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b6c107e60 0x7f5b6c113820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:54.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.246+0000 7f5b721ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b6c10af90 0x7f5b6c113d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:54.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.246+0000 7f5b721ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b6c115920 0x7f5b6c1b1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:54.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.246+0000 7f5b721ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6c114650 con 0x7f5b6c115920 2023-09-23T09:33:54.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.246+0000 7f5b721ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6c1b1d90 con 0x7f5b6c107e60 2023-09-23T09:33:54.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.246+0000 7f5b721ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6c1b1f00 con 0x7f5b6c10af90 2023-09-23T09:33:54.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.246+0000 7f5b6affd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b6c10af90 0x7f5b6c113d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:54.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.247+0000 7f5b6affd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b6c10af90 0x7f5b6c113d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:34780/0 (socket says 172.21.15.82:34780) 2023-09-23T09:33:54.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.247+0000 7f5b6affd700 1 -- 172.21.15.82:0/1792734761 learned_addr learned my addr 172.21.15.82:0/1792734761 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:33:54.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.247+0000 7f5b6bfff700 1 --2- 172.21.15.82:0/1792734761 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b6c115920 0x7f5b6c1b1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:54.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.247+0000 7f5b6b7fe700 1 --2- 172.21.15.82:0/1792734761 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b6c107e60 0x7f5b6c113820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:54.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.247+0000 7f5b6affd700 1 -- 172.21.15.82:0/1792734761 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b6c107e60 msgr2=0x7f5b6c113820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:33:54.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.247+0000 7f5b6affd700 1 --2- 172.21.15.82:0/1792734761 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b6c107e60 0x7f5b6c113820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:54.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.247+0000 7f5b6affd700 1 -- 172.21.15.82:0/1792734761 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b6c115920 msgr2=0x7f5b6c1b1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:33:54.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.247+0000 7f5b6affd700 1 --2- 172.21.15.82:0/1792734761 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b6c115920 0x7f5b6c1b1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:54.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.247+0000 7f5b6affd700 1 -- 172.21.15.82:0/1792734761 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b5c009c40 con 0x7f5b6c10af90 2023-09-23T09:33:54.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.248+0000 7f5b6affd700 1 --2- 172.21.15.82:0/1792734761 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b6c10af90 0x7f5b6c113d60 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f5b6400e9f0 tx=0x7f5b6400ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:33:54.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.248+0000 7f5b68ff9700 1 -- 172.21.15.82:0/1792734761 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b6400eee0 con 0x7f5b6c10af90 2023-09-23T09:33:54.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.248+0000 7f5b68ff9700 1 -- 172.21.15.82:0/1792734761 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5b640044b0 con 0x7f5b6c10af90 2023-09-23T09:33:54.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.249+0000 7f5b68ff9700 1 -- 172.21.15.82:0/1792734761 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b64003c20 con 0x7f5b6c10af90 2023-09-23T09:33:54.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.249+0000 7f5b721ff700 1 -- 172.21.15.82:0/1792734761 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b6c1b21e0 con 0x7f5b6c10af90 2023-09-23T09:33:54.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.249+0000 7f5b721ff700 1 -- 172.21.15.82:0/1792734761 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b6c1b26f0 con 0x7f5b6c10af90 2023-09-23T09:33:54.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.256+0000 7f5b68ff9700 1 -- 172.21.15.82:0/1792734761 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f5b64004020 con 0x7f5b6c10af90 2023-09-23T09:33:54.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.256+0000 7f5b85b0cb80 1 Processor -- start 2023-09-23T09:33:54.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.257+0000 7f5b85b0cb80 1 -- start start 2023-09-23T09:33:54.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.257+0000 7f5b85b0cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ffe041a380 0x55ffe041a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:54.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.257+0000 7f5b85b0cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ffe041aca0 0x55ffe0414700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:54.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.257+0000 7f5b85b0cb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ffe0414c40 0x55ffe04150a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:54.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.257+0000 7f5b85b0cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ffe037c7b0 con 0x55ffe041aca0 2023-09-23T09:33:54.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.257+0000 7f5b85b0cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ffe036d780 con 0x55ffe041a380 2023-09-23T09:33:54.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.257+0000 7f5b85b0cb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ffe036b0a0 con 0x55ffe0414c40 2023-09-23T09:33:54.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.258+0000 7f5b6b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ffe041aca0 0x55ffe0414700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:54.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.258+0000 7f5b6b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ffe041aca0 0x55ffe0414700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50150/0 (socket says 172.21.15.82:50150) 2023-09-23T09:33:54.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.258+0000 7f5b6b7fe700 1 -- 172.21.15.82:0/3020147499 learned_addr learned my addr 172.21.15.82:0/3020147499 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:33:54.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.258+0000 7f5b6bfff700 1 --2- 172.21.15.82:0/3020147499 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ffe041a380 0x55ffe041a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:54.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.258+0000 7f5b6affd700 1 --2- 172.21.15.82:0/3020147499 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ffe0414c40 0x55ffe04150a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:54.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.259+0000 7f5b6b7fe700 1 -- 172.21.15.82:0/3020147499 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ffe0414c40 msgr2=0x55ffe04150a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:33:54.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.259+0000 7f5b6b7fe700 1 --2- 172.21.15.82:0/3020147499 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ffe0414c40 0x55ffe04150a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:54.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.259+0000 7f5b6b7fe700 1 -- 172.21.15.82:0/3020147499 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ffe041a380 msgr2=0x55ffe041a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:33:54.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.259+0000 7f5b6b7fe700 1 --2- 172.21.15.82:0/3020147499 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ffe041a380 0x55ffe041a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:54.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.259+0000 7f5b6b7fe700 1 -- 172.21.15.82:0/3020147499 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ffe01e6630 con 0x55ffe041aca0 2023-09-23T09:33:54.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.259+0000 7f5b68ff9700 1 --2- 172.21.15.82:0/1792734761 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f5b540a0290 0x7f5b540a2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:54.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.259+0000 7f5b68ff9700 1 -- 172.21.15.82:0/1792734761 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f5b64014070 con 0x7f5b6c10af90 2023-09-23T09:33:54.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.259+0000 7f5b6bfff700 1 --2- 172.21.15.82:0/1792734761 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f5b540a0290 0x7f5b540a2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:54.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.259+0000 7f5b6b7fe700 1 --2- 172.21.15.82:0/3020147499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ffe041aca0 0x55ffe0414700 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f5b60007810 tx=0x7f5b60007b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcb319fd3216111f server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:33:54.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.260+0000 7f5b51ffb700 1 -- 172.21.15.82:0/3020147499 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b600125f0 con 0x55ffe041aca0 2023-09-23T09:33:54.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.260+0000 7f5b51ffb700 1 -- 172.21.15.82:0/3020147499 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5b60012be0 con 0x55ffe041aca0 2023-09-23T09:33:54.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.260+0000 7f5b51ffb700 1 -- 172.21.15.82:0/3020147499 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b60013e00 con 0x55ffe041aca0 2023-09-23T09:33:54.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.261+0000 7f5b6bfff700 1 --2- 172.21.15.82:0/1792734761 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f5b540a0290 0x7f5b540a2750 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c009790 tx=0x7f5b5c0096c0 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:33:54.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.261+0000 7f5b85b0cb80 1 -- 172.21.15.82:0/3020147499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ffe041aca0 msgr2=0x55ffe0414700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:33:54.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.261+0000 7f5b85b0cb80 1 --2- 172.21.15.82:0/3020147499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ffe041aca0 0x55ffe0414700 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f5b60007810 tx=0x7f5b60007b20 comp rx=0 tx=0).stop 2023-09-23T09:33:54.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.261+0000 7f5b85b0cb80 1 -- 172.21.15.82:0/3020147499 shutdown_connections 2023-09-23T09:33:54.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.261+0000 7f5b85b0cb80 1 --2- 172.21.15.82:0/3020147499 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ffe0414c40 0x55ffe04150a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:54.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.261+0000 7f5b85b0cb80 1 --2- 172.21.15.82:0/3020147499 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ffe041a380 0x55ffe041a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:54.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.261+0000 7f5b85b0cb80 1 --2- 172.21.15.82:0/3020147499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ffe041aca0 0x55ffe0414700 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:54.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.262+0000 7f5b85b0cb80 1 -- 172.21.15.82:0/3020147499 >> 172.21.15.82:0/3020147499 conn(0x55ffe03890e0 msgr2=0x55ffe040f410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:33:54.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.262+0000 7f5b85b0cb80 1 -- 172.21.15.82:0/3020147499 shutdown_connections 2023-09-23T09:33:54.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.262+0000 7f5b85b0cb80 1 -- 172.21.15.82:0/3020147499 wait complete. 2023-09-23T09:33:54.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.263+0000 7f5b85b0cb80 1 -- start start 2023-09-23T09:33:54.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.263+0000 7f5b85b0cb80 1 Processor -- start 2023-09-23T09:33:54.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.265+0000 7f5b85b0cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ffe0414c40 0x55ffe0420c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:54.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.265+0000 7f5b85b0cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ffe041a380 0x55ffe041de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:54.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.265+0000 7f5b85b0cb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ffe041aca0 0x55ffe041e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:54.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.265+0000 7f5b85b0cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ffe0366990 con 0x55ffe0414c40 2023-09-23T09:33:54.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.265+0000 7f5b85b0cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ffe0304bb0 con 0x55ffe041a380 2023-09-23T09:33:54.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.265+0000 7f5b85b0cb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ffe03048b0 con 0x55ffe041aca0 2023-09-23T09:33:54.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.265+0000 7f5b85b0cb80 10 client.0 _ll_register_callbacks cb 0x55ffe024ea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:33:54.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.266+0000 7f5b6affd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ffe041a380 0x55ffe041de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:54.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.266+0000 7f5b6affd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ffe041a380 0x55ffe041de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:44278/0 (socket says 172.21.15.82:44278) 2023-09-23T09:33:54.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.266+0000 7f5b6affd700 1 -- 172.21.15.82:0/3178156148 learned_addr learned my addr 172.21.15.82:0/3178156148 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:33:54.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.266+0000 7f5b6b7fe700 1 --2- 172.21.15.82:0/3178156148 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ffe0414c40 0x55ffe0420c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:54.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.266+0000 7f5b6bfff700 1 --2- 172.21.15.82:0/3178156148 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ffe041aca0 0x55ffe041e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:54.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.267+0000 7f5b6affd700 1 -- 172.21.15.82:0/3178156148 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ffe041aca0 msgr2=0x55ffe041e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:33:54.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.267+0000 7f5b6affd700 1 --2- 172.21.15.82:0/3178156148 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ffe041aca0 0x55ffe041e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:54.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.267+0000 7f5b6affd700 1 -- 172.21.15.82:0/3178156148 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ffe0414c40 msgr2=0x55ffe0420c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:33:54.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.267+0000 7f5b6affd700 1 --2- 172.21.15.82:0/3178156148 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ffe0414c40 0x55ffe0420c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:54.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.267+0000 7f5b6affd700 1 -- 172.21.15.82:0/3178156148 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b6000e040 con 0x55ffe041a380 2023-09-23T09:33:54.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.267+0000 7f5b6affd700 1 --2- 172.21.15.82:0/3178156148 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ffe041a380 0x55ffe041de80 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f5b640a06f0 tx=0x7f5b6400cbd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=167e2b1e90896b0a server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:33:54.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.268+0000 7f5b4affd700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-09-23T09:33:54.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.268+0000 7f5b4affd700 1 -- 172.21.15.82:0/3178156148 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b64098be0 con 0x55ffe041a380 2023-09-23T09:33:54.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.268+0000 7f5b4affd700 1 -- 172.21.15.82:0/3178156148 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(149..149 src has 1..149) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f5b640042d0 con 0x55ffe041a380 2023-09-23T09:33:54.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.268+0000 7f5b85b0cb80 1 -- 172.21.15.82:0/3178156148 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ffe03e41c0 con 0x55ffe041a380 2023-09-23T09:33:54.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.269+0000 7f5b4affd700 1 -- 172.21.15.82:0/3178156148 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=109) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5b64098950 con 0x55ffe041a380 2023-09-23T09:33:54.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.269+0000 7f5b85b0cb80 10 client.27620 fetch_fsmap learned FSMap version 109 2023-09-23T09:33:54.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.269+0000 7f5b85b0cb80 1 -- 172.21.15.82:0/3178156148 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=109,monmap=4+}) v3 -- 0x55ffe0192de0 con 0x55ffe041a380 2023-09-23T09:33:54.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.269+0000 7f5b4affd700 1 -- 172.21.15.82:0/3178156148 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55ffe03e41c0 con 0x55ffe041a380 2023-09-23T09:33:54.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.269+0000 7f5b4affd700 1 -- 172.21.15.82:0/3178156148 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 109) v1 ==== 7942+0+0 (secure 0 0 0) 0x7f5b640b80c0 con 0x55ffe041a380 2023-09-23T09:33:54.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.270+0000 7f5b85b0cb80 10 client.27620 fetch_fsmap finished waiting for FSMap version 109 2023-09-23T09:33:54.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.270+0000 7f5b85b0cb80 10 client.27620 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2023-09-23T09:33:54.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.270+0000 7f5b85b0cb80 20 client.27620 populate_metadata read hostname 'smithi082' 2023-09-23T09:33:54.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.270+0000 7f5b85b0cb80 1 --2- 172.21.15.82:0/3178156148 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x55ffe042e6f0 0x55ffe0430b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:54.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.270+0000 7f5b85b0cb80 4 client.27620 mds_command: new command op to 24515 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:33:54.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.270+0000 7f5b85b0cb80 1 -- 172.21.15.82:0/3178156148 --> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ffe030cba0 con 0x55ffe042e6f0 2023-09-23T09:33:54.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.270+0000 7f5b6b7fe700 1 --2- 172.21.15.82:0/3178156148 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x55ffe042e6f0 0x55ffe0430b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:54.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.271+0000 7f5b6b7fe700 1 --2- 172.21.15.82:0/3178156148 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x55ffe042e6f0 0x55ffe0430b10 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=d779965381159c26 server_cookie=896540d907762234 in_seq=0 out_seq=0 2023-09-23T09:33:54.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.271+0000 7f5b4affd700 10 client.27620 ms_handle_connect on v2:172.21.15.135:6836/2655304858 2023-09-23T09:33:54.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.272+0000 7f5b4affd700 1 -- 172.21.15.82:0/3178156148 <== mds.3 v2:172.21.15.135:6836/2655304858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55ffe030cba0 con 0x55ffe042e6f0 2023-09-23T09:33:54.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.272+0000 7f5b4affd700 10 client.27620 handle_command_reply: tid=0 2023-09-23T09:33:54.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.272+0000 7f5b85b0cb80 1 client.27620 shutdown 2023-09-23T09:33:54.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.273+0000 7f5b85b0cb80 1 -- 172.21.15.82:0/3178156148 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ffe041a380 msgr2=0x55ffe041de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:33:54.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.273+0000 7f5b85b0cb80 1 --2- 172.21.15.82:0/3178156148 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ffe041a380 0x55ffe041de80 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f5b640a06f0 tx=0x7f5b6400cbd0 comp rx=0 tx=0).stop 2023-09-23T09:33:54.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.274+0000 7f5b85b0cb80 1 -- 172.21.15.82:0/3178156148 shutdown_connections 2023-09-23T09:33:54.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.274+0000 7f5b85b0cb80 1 --2- 172.21.15.82:0/3178156148 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x55ffe042e6f0 0x55ffe0430b10 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:54.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.274+0000 7f5b85b0cb80 1 --2- 172.21.15.82:0/3178156148 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ffe041aca0 0x55ffe041e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:54.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.274+0000 7f5b85b0cb80 1 --2- 172.21.15.82:0/3178156148 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ffe0414c40 0x55ffe0420c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:54.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.274+0000 7f5b85b0cb80 1 --2- 172.21.15.82:0/3178156148 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ffe041a380 0x55ffe041de80 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:54.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.274+0000 7f5b85b0cb80 1 -- 172.21.15.82:0/3178156148 >> 172.21.15.82:0/3178156148 conn(0x55ffe03890e0 msgr2=0x55ffe0409b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:33:54.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.274+0000 7f5b4affd700 0 client.27620 ms_handle_reset on v2:172.21.15.135:6836/2655304858 2023-09-23T09:33:54.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.274+0000 7f5b85b0cb80 1 -- 172.21.15.82:0/3178156148 shutdown_connections 2023-09-23T09:33:54.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.274+0000 7f5b85b0cb80 1 -- 172.21.15.82:0/3178156148 wait complete. 2023-09-23T09:33:54.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.274+0000 7f5b85b0cb80 20 client.27620 trim_cache size 0 max 16384 2023-09-23T09:33:54.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.305+0000 7f5b85b0cb80 1 Processor -- start 2023-09-23T09:33:54.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.306+0000 7f5b85b0cb80 1 -- start start 2023-09-23T09:33:54.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.306+0000 7f5b85b0cb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ffe0414c40 0x55ffe0415020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:54.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.306+0000 7f5b85b0cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ffe041a380 0x55ffe04207a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:54.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.306+0000 7f5b85b0cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ffe041aca0 0x55ffe041d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:54.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.306+0000 7f5b85b0cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ffe01e8920 con 0x55ffe041aca0 2023-09-23T09:33:54.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.306+0000 7f5b85b0cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ffe041f460 con 0x55ffe041a380 2023-09-23T09:33:54.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.306+0000 7f5b85b0cb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ffe040bc80 con 0x55ffe0414c40 2023-09-23T09:33:54.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.307+0000 7f5b6affd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ffe041a380 0x55ffe04207a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:54.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.307+0000 7f5b6affd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ffe041a380 0x55ffe04207a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:44286/0 (socket says 172.21.15.82:44286) 2023-09-23T09:33:54.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.307+0000 7f5b6affd700 1 -- 172.21.15.82:0/1946540277 learned_addr learned my addr 172.21.15.82:0/1946540277 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:33:54.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.307+0000 7f5b6b7fe700 1 --2- 172.21.15.82:0/1946540277 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ffe0414c40 0x55ffe0415020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:54.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.307+0000 7f5b6bfff700 1 --2- 172.21.15.82:0/1946540277 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ffe041aca0 0x55ffe041d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:54.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.307+0000 7f5b6affd700 1 -- 172.21.15.82:0/1946540277 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ffe0414c40 msgr2=0x55ffe0415020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:33:54.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.307+0000 7f5b6affd700 1 --2- 172.21.15.82:0/1946540277 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ffe0414c40 0x55ffe0415020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:54.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.307+0000 7f5b6affd700 1 -- 172.21.15.82:0/1946540277 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ffe041aca0 msgr2=0x55ffe041d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:33:54.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.307+0000 7f5b6affd700 1 --2- 172.21.15.82:0/1946540277 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ffe041aca0 0x55ffe041d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:54.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.307+0000 7f5b6affd700 1 -- 172.21.15.82:0/1946540277 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ffe017bc60 con 0x55ffe041a380 2023-09-23T09:33:54.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.308+0000 7f5b6affd700 1 --2- 172.21.15.82:0/1946540277 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ffe041a380 0x55ffe04207a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f5b6400e9c0 tx=0x7f5b64003f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aef0e3fd564f606a server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:33:54.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.308+0000 7f5b527fc700 1 -- 172.21.15.82:0/1946540277 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b64098be0 con 0x55ffe041a380 2023-09-23T09:33:54.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.309+0000 7f5b527fc700 1 -- 172.21.15.82:0/1946540277 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5b64098950 con 0x55ffe041a380 2023-09-23T09:33:54.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.309+0000 7f5b527fc700 1 -- 172.21.15.82:0/1946540277 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b64098e10 con 0x55ffe041a380 2023-09-23T09:33:54.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:33:53 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/3752258889' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-23T09:33:54.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.310+0000 7f5b85b0cb80 1 -- 172.21.15.82:0/1946540277 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ffe041a380 msgr2=0x55ffe04207a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:33:54.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.310+0000 7f5b85b0cb80 1 --2- 172.21.15.82:0/1946540277 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ffe041a380 0x55ffe04207a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f5b6400e9c0 tx=0x7f5b64003f90 comp rx=0 tx=0).stop 2023-09-23T09:33:54.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.310+0000 7f5b85b0cb80 1 -- 172.21.15.82:0/1946540277 shutdown_connections 2023-09-23T09:33:54.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.310+0000 7f5b85b0cb80 1 --2- 172.21.15.82:0/1946540277 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ffe041aca0 0x55ffe041d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:54.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.310+0000 7f5b85b0cb80 1 --2- 172.21.15.82:0/1946540277 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ffe0414c40 0x55ffe0415020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:54.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.310+0000 7f5b85b0cb80 1 --2- 172.21.15.82:0/1946540277 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ffe041a380 0x55ffe04207a0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:54.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.310+0000 7f5b85b0cb80 1 -- 172.21.15.82:0/1946540277 >> 172.21.15.82:0/1946540277 conn(0x55ffe03890e0 msgr2=0x55ffe0418010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:33:54.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.310+0000 7f5b85b0cb80 1 -- 172.21.15.82:0/1946540277 shutdown_connections 2023-09-23T09:33:54.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.310+0000 7f5b85b0cb80 1 -- 172.21.15.82:0/1946540277 wait complete. 2023-09-23T09:33:54.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.311+0000 7f5b85b0cb80 1 -- start start 2023-09-23T09:33:54.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.311+0000 7f5b85b0cb80 1 Processor -- start 2023-09-23T09:33:54.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.313+0000 7f5b85b0cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ffe0414c40 0x55ffe0416f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:54.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.313+0000 7f5b85b0cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ffe041a380 0x55ffe04174a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:54.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.313+0000 7f5b85b0cb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ffe041aca0 0x55ffe0415e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:54.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.313+0000 7f5b85b0cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ffe0417bb0 con 0x55ffe041a380 2023-09-23T09:33:54.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.313+0000 7f5b85b0cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ffe0416340 con 0x55ffe0414c40 2023-09-23T09:33:54.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.313+0000 7f5b85b0cb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ffe0416500 con 0x55ffe041aca0 2023-09-23T09:33:54.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.313+0000 7f5b85b0cb80 10 client.0 _ll_register_callbacks cb 0x55ffe024ea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:33:54.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.313+0000 7f5b6bfff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ffe041aca0 0x55ffe0415e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:54.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.313+0000 7f5b6bfff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ffe041aca0 0x55ffe0415e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:34820/0 (socket says 172.21.15.82:34820) 2023-09-23T09:33:54.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.313+0000 7f5b6bfff700 1 -- 172.21.15.82:0/1410861501 learned_addr learned my addr 172.21.15.82:0/1410861501 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:33:54.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.314+0000 7f5b6b7fe700 1 --2- 172.21.15.82:0/1410861501 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ffe0414c40 0x55ffe0416f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:54.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.314+0000 7f5b6bfff700 1 -- 172.21.15.82:0/1410861501 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ffe0414c40 msgr2=0x55ffe0416f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:33:54.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.314+0000 7f5b6bfff700 1 --2- 172.21.15.82:0/1410861501 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ffe0414c40 0x55ffe0416f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:54.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.314+0000 7f5b6bfff700 1 -- 172.21.15.82:0/1410861501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ffe041a380 msgr2=0x55ffe04174a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-23T09:33:54.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.314+0000 7f5b6bfff700 1 --2- 172.21.15.82:0/1410861501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ffe041a380 0x55ffe04174a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:54.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.314+0000 7f5b6bfff700 1 -- 172.21.15.82:0/1410861501 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ffe0192de0 con 0x55ffe041aca0 2023-09-23T09:33:54.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.315+0000 7f5b6bfff700 1 --2- 172.21.15.82:0/1410861501 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ffe041aca0 0x55ffe0415e00 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c009f90 tx=0x7f5b5c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=423579ba80c0e9ec server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:33:54.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.315+0000 7f5b4affd700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T09:33:54.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.315+0000 7f5b4affd700 1 -- 172.21.15.82:0/1410861501 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b5c00e040 con 0x55ffe041aca0 2023-09-23T09:33:54.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.315+0000 7f5b4affd700 1 -- 172.21.15.82:0/1410861501 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(149..149 src has 1..149) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f5b5c005250 con 0x55ffe041aca0 2023-09-23T09:33:54.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.316+0000 7f5b85b0cb80 1 -- 172.21.15.82:0/1410861501 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ffe04078b0 con 0x55ffe041aca0 2023-09-23T09:33:54.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.316+0000 7f5b4affd700 1 -- 172.21.15.82:0/1410861501 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=109) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5b5c005450 con 0x55ffe041aca0 2023-09-23T09:33:54.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.316+0000 7f5b85b0cb80 10 client.27658 fetch_fsmap learned FSMap version 109 2023-09-23T09:33:54.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.316+0000 7f5b85b0cb80 1 -- 172.21.15.82:0/1410861501 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=109,monmap=4+}) v3 -- 0x55ffe01b9250 con 0x55ffe041aca0 2023-09-23T09:33:54.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.317+0000 7f5b4affd700 1 -- 172.21.15.82:0/1410861501 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55ffe04078b0 con 0x55ffe041aca0 2023-09-23T09:33:54.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.318+0000 7f5b4affd700 1 -- 172.21.15.82:0/1410861501 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 109) v1 ==== 7942+0+0 (secure 0 0 0) 0x7f5b5c02a9a0 con 0x55ffe041aca0 2023-09-23T09:33:54.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.318+0000 7f5b85b0cb80 10 client.27658 fetch_fsmap finished waiting for FSMap version 109 2023-09-23T09:33:54.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.318+0000 7f5b85b0cb80 10 client.27658 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2023-09-23T09:33:54.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.318+0000 7f5b85b0cb80 20 client.27658 populate_metadata read hostname 'smithi082' 2023-09-23T09:33:54.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.318+0000 7f5b85b0cb80 1 --2- 172.21.15.82:0/1410861501 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x55ffe0483350 0x55ffe0485770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:54.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.318+0000 7f5b85b0cb80 4 client.27658 mds_command: new command op to 24515 tid=0[{"prefix": "damage ls"}] 2023-09-23T09:33:54.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.318+0000 7f5b85b0cb80 1 -- 172.21.15.82:0/1410861501 --> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55ffe035f970 con 0x55ffe0483350 2023-09-23T09:33:54.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.318+0000 7f5b6b7fe700 1 --2- 172.21.15.82:0/1410861501 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x55ffe0483350 0x55ffe0485770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:54.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.320+0000 7f5b6b7fe700 1 --2- 172.21.15.82:0/1410861501 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x55ffe0483350 0x55ffe0485770 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=11f465c640ba52f3 server_cookie=b3d8b9d4e3c07c3d in_seq=0 out_seq=0 2023-09-23T09:33:54.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.320+0000 7f5b4affd700 10 client.27658 ms_handle_connect on v2:172.21.15.135:6836/2655304858 2023-09-23T09:33:54.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.320+0000 7f5b4affd700 1 -- 172.21.15.82:0/1410861501 <== mds.3 v2:172.21.15.135:6836/2655304858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55ffe035f970 con 0x55ffe0483350 2023-09-23T09:33:54.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.320+0000 7f5b4affd700 10 client.27658 handle_command_reply: tid=0 2023-09-23T09:33:54.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.320+0000 7f5b85b0cb80 1 client.27658 shutdown 2023-09-23T09:33:54.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.321+0000 7f5b85b0cb80 1 -- 172.21.15.82:0/1410861501 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ffe041aca0 msgr2=0x55ffe0415e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:33:54.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.321+0000 7f5b85b0cb80 1 --2- 172.21.15.82:0/1410861501 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ffe041aca0 0x55ffe0415e00 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c009f90 tx=0x7f5b5c00b330 comp rx=0 tx=0).stop 2023-09-23T09:33:54.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.322+0000 7f5b85b0cb80 1 -- 172.21.15.82:0/1410861501 shutdown_connections 2023-09-23T09:33:54.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.322+0000 7f5b85b0cb80 1 --2- 172.21.15.82:0/1410861501 >> [v2:172.21.15.135:6836/2655304858,v1:172.21.15.135:6837/2655304858] conn(0x55ffe0483350 0x55ffe0485770 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:54.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.322+0000 7f5b85b0cb80 1 --2- 172.21.15.82:0/1410861501 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ffe041aca0 0x55ffe0415e00 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:54.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.322+0000 7f5b85b0cb80 1 --2- 172.21.15.82:0/1410861501 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ffe0414c40 0x55ffe0416f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:54.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.322+0000 7f5b85b0cb80 1 --2- 172.21.15.82:0/1410861501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ffe041a380 0x55ffe04174a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:54.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.322+0000 7f5b85b0cb80 1 -- 172.21.15.82:0/1410861501 >> 172.21.15.82:0/1410861501 conn(0x55ffe03890e0 msgr2=0x55ffe041b130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:33:54.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.322+0000 7f5b4affd700 0 client.27658 ms_handle_reset on v2:172.21.15.135:6836/2655304858 2023-09-23T09:33:54.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.323+0000 7f5b85b0cb80 1 -- 172.21.15.82:0/1410861501 shutdown_connections 2023-09-23T09:33:54.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.323+0000 7f5b85b0cb80 1 -- 172.21.15.82:0/1410861501 wait complete. 2023-09-23T09:33:54.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.324+0000 7f5b85b0cb80 20 client.27658 trim_cache size 0 max 16384 2023-09-23T09:33:54.326 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2023-09-23T09:33:54.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.325+0000 7f5b721ff700 1 -- 172.21.15.82:0/1792734761 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f5b540a0290 msgr2=0x7f5b540a2750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:33:54.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.325+0000 7f5b721ff700 1 --2- 172.21.15.82:0/1792734761 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f5b540a0290 0x7f5b540a2750 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c009790 tx=0x7f5b5c0096c0 comp rx=0 tx=0).stop 2023-09-23T09:33:54.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.325+0000 7f5b721ff700 1 -- 172.21.15.82:0/1792734761 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b6c10af90 msgr2=0x7f5b6c113d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:33:54.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.325+0000 7f5b721ff700 1 --2- 172.21.15.82:0/1792734761 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b6c10af90 0x7f5b6c113d60 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f5b6400e9f0 tx=0x7f5b6400ed00 comp rx=0 tx=0).stop 2023-09-23T09:33:54.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.325+0000 7f5b721ff700 1 -- 172.21.15.82:0/1792734761 shutdown_connections 2023-09-23T09:33:54.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.325+0000 7f5b721ff700 1 --2- 172.21.15.82:0/1792734761 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f5b540a0290 0x7f5b540a2750 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:54.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.325+0000 7f5b721ff700 1 --2- 172.21.15.82:0/1792734761 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b6c115920 0x7f5b6c1b1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:54.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.325+0000 7f5b721ff700 1 --2- 172.21.15.82:0/1792734761 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b6c107e60 0x7f5b6c113820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:54.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.325+0000 7f5b721ff700 1 --2- 172.21.15.82:0/1792734761 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b6c10af90 0x7f5b6c113d60 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:54.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.325+0000 7f5b721ff700 1 -- 172.21.15.82:0/1792734761 >> 172.21.15.82:0/1792734761 conn(0x7f5b6c06cbe0 msgr2=0x7f5b6c115d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:33:54.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.326+0000 7f5b721ff700 1 -- 172.21.15.82:0/1792734761 shutdown_connections 2023-09-23T09:33:54.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.330+0000 7f5b721ff700 1 -- 172.21.15.82:0/1792734761 wait complete. 2023-09-23T09:33:54.375 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-09-23T09:33:54.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.726+0000 7fce2b5ff700 1 -- 172.21.15.82:0/1554107967 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce24101230 msgr2=0x7fce2410d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:33:54.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.726+0000 7fce2b5ff700 1 --2- 172.21.15.82:0/1554107967 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce24101230 0x7fce2410d740 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fce1c00b0a0 tx=0x7fce1c00b3b0 comp rx=0 tx=0).stop 2023-09-23T09:33:54.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.726+0000 7fce2b5ff700 1 -- 172.21.15.82:0/1554107967 shutdown_connections 2023-09-23T09:33:54.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.726+0000 7fce2b5ff700 1 --2- 172.21.15.82:0/1554107967 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce24101230 0x7fce2410d740 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:54.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.726+0000 7fce2b5ff700 1 --2- 172.21.15.82:0/1554107967 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fce24106880 0x7fce24106c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:54.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.726+0000 7fce2b5ff700 1 --2- 172.21.15.82:0/1554107967 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce24100870 0x7fce24100cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:54.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.726+0000 7fce2b5ff700 1 -- 172.21.15.82:0/1554107967 >> 172.21.15.82:0/1554107967 conn(0x7fce240fc3a0 msgr2=0x7fce240fe7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:33:54.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.726+0000 7fce2b5ff700 1 -- 172.21.15.82:0/1554107967 shutdown_connections 2023-09-23T09:33:54.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.726+0000 7fce2b5ff700 1 -- 172.21.15.82:0/1554107967 wait complete. 2023-09-23T09:33:54.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.727+0000 7fce2b5ff700 1 Processor -- start 2023-09-23T09:33:54.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.727+0000 7fce2b5ff700 1 -- start start 2023-09-23T09:33:54.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.727+0000 7fce2b5ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fce24100870 0x7fce2419c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:54.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.727+0000 7fce2b5ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce24101230 0x7fce2419cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:54.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.728+0000 7fce2b5ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce24106880 0x7fce241966c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:54.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.728+0000 7fce2b5ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce24196d30 con 0x7fce24106880 2023-09-23T09:33:54.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.728+0000 7fce2b5ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce24196ea0 con 0x7fce24101230 2023-09-23T09:33:54.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.728+0000 7fce2b5ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce24197060 con 0x7fce24100870 2023-09-23T09:33:54.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.728+0000 7fce29b9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce24106880 0x7fce241966c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:54.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.728+0000 7fce29b9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce24106880 0x7fce241966c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50202/0 (socket says 172.21.15.82:50202) 2023-09-23T09:33:54.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.728+0000 7fce29b9c700 1 -- 172.21.15.82:0/329205322 learned_addr learned my addr 172.21.15.82:0/329205322 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:33:54.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.728+0000 7fce28b9a700 1 --2- 172.21.15.82:0/329205322 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce24101230 0x7fce2419cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:54.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.728+0000 7fce2939b700 1 --2- 172.21.15.82:0/329205322 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fce24100870 0x7fce2419c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:54.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.728+0000 7fce29b9c700 1 -- 172.21.15.82:0/329205322 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fce24100870 msgr2=0x7fce2419c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:33:54.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.728+0000 7fce29b9c700 1 --2- 172.21.15.82:0/329205322 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fce24100870 0x7fce2419c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:54.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.728+0000 7fce29b9c700 1 -- 172.21.15.82:0/329205322 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce24101230 msgr2=0x7fce2419cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:33:54.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.728+0000 7fce29b9c700 1 --2- 172.21.15.82:0/329205322 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce24101230 0x7fce2419cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:54.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.728+0000 7fce29b9c700 1 -- 172.21.15.82:0/329205322 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce1c009d00 con 0x7fce24106880 2023-09-23T09:33:54.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.728+0000 7fce29b9c700 1 --2- 172.21.15.82:0/329205322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce24106880 0x7fce241966c0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fce1c009fd0 tx=0x7fce1c00bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:33:54.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.729+0000 7fce1a7fc700 1 -- 172.21.15.82:0/329205322 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce1c00e040 con 0x7fce24106880 2023-09-23T09:33:54.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.729+0000 7fce1a7fc700 1 -- 172.21.15.82:0/329205322 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fce1c003c00 con 0x7fce24106880 2023-09-23T09:33:54.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.729+0000 7fce1a7fc700 1 -- 172.21.15.82:0/329205322 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce1c0052a0 con 0x7fce24106880 2023-09-23T09:33:54.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.729+0000 7fce2b5ff700 1 -- 172.21.15.82:0/329205322 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce241972e0 con 0x7fce24106880 2023-09-23T09:33:54.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.729+0000 7fce2b5ff700 1 -- 172.21.15.82:0/329205322 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce241a3640 con 0x7fce24106880 2023-09-23T09:33:54.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.732+0000 7fce1a7fc700 1 -- 172.21.15.82:0/329205322 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7fce1c01d470 con 0x7fce24106880 2023-09-23T09:33:54.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.734+0000 7fce3eea1b80 1 Processor -- start 2023-09-23T09:33:54.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.734+0000 7fce3eea1b80 1 -- start start 2023-09-23T09:33:54.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.735+0000 7fce1a7fc700 1 --2- 172.21.15.82:0/329205322 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fce100a0140 0x7fce100a2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:54.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.735+0000 7fce3eea1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56204972f380 0x56204972f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:54.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.735+0000 7fce3eea1b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56204972fca0 0x562049729700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:54.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.735+0000 7fce3eea1b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562049729c40 0x56204972a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:54.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.735+0000 7fce3eea1b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620496917b0 con 0x56204972f380 2023-09-23T09:33:54.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.735+0000 7fce3eea1b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562049682780 con 0x56204972fca0 2023-09-23T09:33:54.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.735+0000 7fce3eea1b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620496800a0 con 0x562049729c40 2023-09-23T09:33:54.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.735+0000 7fce1a7fc700 1 -- 172.21.15.82:0/329205322 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fce1c0cc9d0 con 0x7fce24106880 2023-09-23T09:33:54.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.735+0000 7fce28b9a700 1 --2- 172.21.15.82:0/329205322 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fce100a0140 0x7fce100a2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:54.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.735+0000 7fce2939b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56204972f380 0x56204972f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:54.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.735+0000 7fce2939b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56204972f380 0x56204972f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50218/0 (socket says 172.21.15.82:50218) 2023-09-23T09:33:54.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.735+0000 7fce2939b700 1 -- 172.21.15.82:0/217042767 learned_addr learned my addr 172.21.15.82:0/217042767 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:33:54.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.735+0000 7fce29b9c700 1 --2- 172.21.15.82:0/217042767 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562049729c40 0x56204972a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:54.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.735+0000 7fce28b9a700 1 --2- 172.21.15.82:0/217042767 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56204972fca0 0x562049729700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:54.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.735+0000 7fce2939b700 1 -- 172.21.15.82:0/217042767 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562049729c40 msgr2=0x56204972a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:33:54.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.735+0000 7fce2939b700 1 --2- 172.21.15.82:0/217042767 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562049729c40 0x56204972a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:54.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.736+0000 7fce2939b700 1 -- 172.21.15.82:0/217042767 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56204972fca0 msgr2=0x562049729700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:33:54.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.736+0000 7fce2939b700 1 --2- 172.21.15.82:0/217042767 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56204972fca0 0x562049729700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:54.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.736+0000 7fce2939b700 1 -- 172.21.15.82:0/217042767 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5620494fb630 con 0x56204972f380 2023-09-23T09:33:54.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.736+0000 7fce28b9a700 1 --2- 172.21.15.82:0/217042767 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56204972fca0 0x562049729700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T09:33:54.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.736+0000 7fce28b9a700 1 --2- 172.21.15.82:0/329205322 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fce100a0140 0x7fce100a2600 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fce1400b6c0 tx=0x7fce1400b830 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:33:54.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.736+0000 7fce2939b700 1 --2- 172.21.15.82:0/217042767 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56204972f380 0x56204972f760 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fce20009cf0 tx=0x7fce200103d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=990badc837503dfd server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:33:54.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.736+0000 7fce0f7fe700 1 -- 172.21.15.82:0/217042767 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce200097c0 con 0x56204972f380 2023-09-23T09:33:54.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.736+0000 7fce0f7fe700 1 -- 172.21.15.82:0/217042767 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fce20015070 con 0x56204972f380 2023-09-23T09:33:54.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.736+0000 7fce0f7fe700 1 -- 172.21.15.82:0/217042767 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce20011640 con 0x56204972f380 2023-09-23T09:33:54.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.737+0000 7fce3eea1b80 1 -- 172.21.15.82:0/217042767 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56204972f380 msgr2=0x56204972f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:33:54.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.737+0000 7fce3eea1b80 1 --2- 172.21.15.82:0/217042767 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56204972f380 0x56204972f760 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fce20009cf0 tx=0x7fce200103d0 comp rx=0 tx=0).stop 2023-09-23T09:33:54.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.737+0000 7fce3eea1b80 1 -- 172.21.15.82:0/217042767 shutdown_connections 2023-09-23T09:33:54.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.737+0000 7fce3eea1b80 1 --2- 172.21.15.82:0/217042767 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562049729c40 0x56204972a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:54.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.737+0000 7fce3eea1b80 1 --2- 172.21.15.82:0/217042767 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56204972f380 0x56204972f760 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:54.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.737+0000 7fce3eea1b80 1 --2- 172.21.15.82:0/217042767 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56204972fca0 0x562049729700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:54.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.737+0000 7fce3eea1b80 1 -- 172.21.15.82:0/217042767 >> 172.21.15.82:0/217042767 conn(0x56204969e0e0 msgr2=0x562049724410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:33:54.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.737+0000 7fce3eea1b80 1 -- 172.21.15.82:0/217042767 shutdown_connections 2023-09-23T09:33:54.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.737+0000 7fce3eea1b80 1 -- 172.21.15.82:0/217042767 wait complete. 2023-09-23T09:33:54.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.737+0000 7fce3eea1b80 1 -- start start 2023-09-23T09:33:54.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.738+0000 7fce3eea1b80 1 Processor -- start 2023-09-23T09:33:54.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.738+0000 7fce3eea1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562049729c40 0x562049733000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:54.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.738+0000 7fce3eea1b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56204972f380 0x562049733540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:54.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.738+0000 7fce3eea1b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56204972fca0 0x562049733a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:54.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.739+0000 7fce3eea1b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56204967b990 con 0x562049729c40 2023-09-23T09:33:54.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.739+0000 7fce3eea1b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562049619bb0 con 0x56204972f380 2023-09-23T09:33:54.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.739+0000 7fce3eea1b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620496198b0 con 0x56204972fca0 2023-09-23T09:33:54.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.739+0000 7fce3eea1b80 10 client.0 _ll_register_callbacks cb 0x562049563a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:33:54.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.739+0000 7fce2939b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562049729c40 0x562049733000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:54.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.739+0000 7fce2939b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562049729c40 0x562049733000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50226/0 (socket says 172.21.15.82:50226) 2023-09-23T09:33:54.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.739+0000 7fce2939b700 1 -- 172.21.15.82:0/142308035 learned_addr learned my addr 172.21.15.82:0/142308035 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:33:54.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.739+0000 7fce28b9a700 1 --2- 172.21.15.82:0/142308035 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56204972f380 0x562049733540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:54.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.739+0000 7fce29b9c700 1 --2- 172.21.15.82:0/142308035 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56204972fca0 0x562049733a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:54.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.739+0000 7fce2939b700 1 -- 172.21.15.82:0/142308035 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56204972fca0 msgr2=0x562049733a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:33:54.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.739+0000 7fce2939b700 1 --2- 172.21.15.82:0/142308035 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56204972fca0 0x562049733a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:54.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.739+0000 7fce2939b700 1 -- 172.21.15.82:0/142308035 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56204972f380 msgr2=0x562049733540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:33:54.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.739+0000 7fce2939b700 1 --2- 172.21.15.82:0/142308035 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56204972f380 0x562049733540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:54.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.739+0000 7fce2939b700 1 -- 172.21.15.82:0/142308035 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce20009920 con 0x562049729c40 2023-09-23T09:33:54.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.739+0000 7fce28b9a700 1 --2- 172.21.15.82:0/142308035 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56204972f380 0x562049733540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:33:54.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.739+0000 7fce2939b700 1 --2- 172.21.15.82:0/142308035 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562049729c40 0x562049733000 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fce2001cd20 tx=0x7fce2001c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=476a3f858338fcf1 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:33:54.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.740+0000 7fce0cff9700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:33:54.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.740+0000 7fce0cff9700 1 -- 172.21.15.82:0/142308035 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce20005ce0 con 0x562049729c40 2023-09-23T09:33:54.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.740+0000 7fce0cff9700 1 -- 172.21.15.82:0/142308035 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(149..149 src has 1..149) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fce20017070 con 0x562049729c40 2023-09-23T09:33:54.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.740+0000 7fce3eea1b80 1 -- 172.21.15.82:0/142308035 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5620496f91c0 con 0x562049729c40 2023-09-23T09:33:54.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.740+0000 7fce0cff9700 1 -- 172.21.15.82:0/142308035 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=109) v2 ==== 24+0+0 (secure 0 0 0) 0x7fce200097c0 con 0x562049729c40 2023-09-23T09:33:54.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.740+0000 7fce3eea1b80 10 client.17913 fetch_fsmap learned FSMap version 109 2023-09-23T09:33:54.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.740+0000 7fce3eea1b80 1 -- 172.21.15.82:0/142308035 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=109,monmap=4+}) v3 -- 0x5620494a7de0 con 0x562049729c40 2023-09-23T09:33:54.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.740+0000 7fce0cff9700 1 -- 172.21.15.82:0/142308035 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5620496f91c0 con 0x562049729c40 2023-09-23T09:33:54.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.741+0000 7fce0cff9700 1 -- 172.21.15.82:0/142308035 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 109) v1 ==== 7942+0+0 (secure 0 0 0) 0x7fce20025440 con 0x562049729c40 2023-09-23T09:33:54.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.741+0000 7fce3eea1b80 10 client.17913 fetch_fsmap finished waiting for FSMap version 109 2023-09-23T09:33:54.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.741+0000 7fce3eea1b80 10 client.17913 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-09-23T09:33:54.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.741+0000 7fce3eea1b80 20 client.17913 populate_metadata read hostname 'smithi082' 2023-09-23T09:33:54.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.741+0000 7fce3eea1b80 1 --2- 172.21.15.82:0/142308035 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x562049747b60 0x562049749f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:54.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.741+0000 7fce3eea1b80 4 client.17913 mds_command: new command op to 24526 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:33:54.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.741+0000 7fce3eea1b80 1 -- 172.21.15.82:0/142308035 --> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562049621ba0 con 0x562049747b60 2023-09-23T09:33:54.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.741+0000 7fce28b9a700 1 --2- 172.21.15.82:0/142308035 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x562049747b60 0x562049749f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:54.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.742+0000 7fce0cff9700 10 client.17913 ms_handle_connect on v2:172.21.15.161:6836/43639843 2023-09-23T09:33:54.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.742+0000 7fce28b9a700 1 --2- 172.21.15.82:0/142308035 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x562049747b60 0x562049749f80 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f30dac61c12dc5c7 server_cookie=d618a5877fd79bc4 in_seq=0 out_seq=0 2023-09-23T09:33:54.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.742+0000 7fce0cff9700 1 -- 172.21.15.82:0/142308035 <== mds.2 v2:172.21.15.161:6836/43639843 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x562049621ba0 con 0x562049747b60 2023-09-23T09:33:54.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.742+0000 7fce0cff9700 10 client.17913 handle_command_reply: tid=0 2023-09-23T09:33:54.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.742+0000 7fce3eea1b80 1 client.17913 shutdown 2023-09-23T09:33:54.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.742+0000 7fce3eea1b80 1 -- 172.21.15.82:0/142308035 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562049729c40 msgr2=0x562049733000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:33:54.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.742+0000 7fce3eea1b80 1 --2- 172.21.15.82:0/142308035 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562049729c40 0x562049733000 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fce2001cd20 tx=0x7fce2001c730 comp rx=0 tx=0).stop 2023-09-23T09:33:54.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.743+0000 7fce3eea1b80 1 -- 172.21.15.82:0/142308035 shutdown_connections 2023-09-23T09:33:54.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.743+0000 7fce3eea1b80 1 --2- 172.21.15.82:0/142308035 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x562049747b60 0x562049749f80 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:54.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.743+0000 7fce3eea1b80 1 --2- 172.21.15.82:0/142308035 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56204972fca0 0x562049733a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:54.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.743+0000 7fce3eea1b80 1 --2- 172.21.15.82:0/142308035 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562049729c40 0x562049733000 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:54.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.743+0000 7fce3eea1b80 1 --2- 172.21.15.82:0/142308035 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56204972f380 0x562049733540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:54.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.743+0000 7fce3eea1b80 1 -- 172.21.15.82:0/142308035 >> 172.21.15.82:0/142308035 conn(0x56204969e0e0 msgr2=0x56204971eb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:33:54.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.743+0000 7fce0cff9700 0 client.17913 ms_handle_reset on v2:172.21.15.161:6836/43639843 2023-09-23T09:33:54.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.743+0000 7fce3eea1b80 1 -- 172.21.15.82:0/142308035 shutdown_connections 2023-09-23T09:33:54.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.743+0000 7fce3eea1b80 1 -- 172.21.15.82:0/142308035 wait complete. 2023-09-23T09:33:54.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.743+0000 7fce3eea1b80 20 client.17913 trim_cache size 0 max 16384 2023-09-23T09:33:54.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.756+0000 7fce3eea1b80 1 Processor -- start 2023-09-23T09:33:54.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.756+0000 7fce3eea1b80 1 -- start start 2023-09-23T09:33:54.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.756+0000 7fce3eea1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562049729c40 0x562049729700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:54.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.757+0000 7fce3eea1b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56204972f380 0x56204972a020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:54.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.757+0000 7fce3eea1b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56204972fca0 0x56204973ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:54.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.757+0000 7fce3eea1b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620494fd920 con 0x562049729c40 2023-09-23T09:33:54.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.757+0000 7fce3eea1b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562049720a40 con 0x56204972f380 2023-09-23T09:33:54.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.757+0000 7fce3eea1b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x562049720890 con 0x56204972fca0 2023-09-23T09:33:54.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.757+0000 7fce2939b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562049729c40 0x562049729700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:54.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.757+0000 7fce2939b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562049729c40 0x562049729700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50242/0 (socket says 172.21.15.82:50242) 2023-09-23T09:33:54.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.757+0000 7fce2939b700 1 -- 172.21.15.82:0/3896067655 learned_addr learned my addr 172.21.15.82:0/3896067655 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:33:54.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.757+0000 7fce29b9c700 1 --2- 172.21.15.82:0/3896067655 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56204972fca0 0x56204973ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:54.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.757+0000 7fce28b9a700 1 --2- 172.21.15.82:0/3896067655 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56204972f380 0x56204972a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:54.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.757+0000 7fce2939b700 1 -- 172.21.15.82:0/3896067655 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56204972fca0 msgr2=0x56204973ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:33:54.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.757+0000 7fce2939b700 1 --2- 172.21.15.82:0/3896067655 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56204972fca0 0x56204973ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:54.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.757+0000 7fce2939b700 1 -- 172.21.15.82:0/3896067655 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56204972f380 msgr2=0x56204972a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:33:54.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.757+0000 7fce2939b700 1 --2- 172.21.15.82:0/3896067655 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56204972f380 0x56204972a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:54.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.757+0000 7fce2939b700 1 -- 172.21.15.82:0/3896067655 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562049490c60 con 0x562049729c40 2023-09-23T09:33:54.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.757+0000 7fce29b9c700 1 --2- 172.21.15.82:0/3896067655 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56204972fca0 0x56204973ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:33:54.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.757+0000 7fce28b9a700 1 --2- 172.21.15.82:0/3896067655 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56204972f380 0x56204972a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T09:33:54.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.757+0000 7fce2939b700 1 --2- 172.21.15.82:0/3896067655 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562049729c40 0x562049729700 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fce20009c10 tx=0x7fce20009350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23eb15cc2e1c591c server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:33:54.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.758+0000 7fce0ffff700 1 -- 172.21.15.82:0/3896067655 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce20005880 con 0x562049729c40 2023-09-23T09:33:54.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.758+0000 7fce0ffff700 1 -- 172.21.15.82:0/3896067655 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fce20015070 con 0x562049729c40 2023-09-23T09:33:54.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.758+0000 7fce0ffff700 1 -- 172.21.15.82:0/3896067655 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce20003680 con 0x562049729c40 2023-09-23T09:33:54.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.758+0000 7fce3eea1b80 1 -- 172.21.15.82:0/3896067655 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562049729c40 msgr2=0x562049729700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:33:54.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.758+0000 7fce3eea1b80 1 --2- 172.21.15.82:0/3896067655 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562049729c40 0x562049729700 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fce20009c10 tx=0x7fce20009350 comp rx=0 tx=0).stop 2023-09-23T09:33:54.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.758+0000 7fce3eea1b80 1 -- 172.21.15.82:0/3896067655 shutdown_connections 2023-09-23T09:33:54.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.758+0000 7fce3eea1b80 1 --2- 172.21.15.82:0/3896067655 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56204972fca0 0x56204973ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:54.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.758+0000 7fce3eea1b80 1 --2- 172.21.15.82:0/3896067655 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562049729c40 0x562049729700 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:54.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.758+0000 7fce3eea1b80 1 --2- 172.21.15.82:0/3896067655 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56204972f380 0x56204972a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:54.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.758+0000 7fce3eea1b80 1 -- 172.21.15.82:0/3896067655 >> 172.21.15.82:0/3896067655 conn(0x56204969e0e0 msgr2=0x56204972d190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:33:54.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.758+0000 7fce3eea1b80 1 -- 172.21.15.82:0/3896067655 shutdown_connections 2023-09-23T09:33:54.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.758+0000 7fce3eea1b80 1 -- 172.21.15.82:0/3896067655 wait complete. 2023-09-23T09:33:54.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.759+0000 7fce3eea1b80 1 -- start start 2023-09-23T09:33:54.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.759+0000 7fce3eea1b80 1 Processor -- start 2023-09-23T09:33:54.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.760+0000 7fce3eea1b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562049729c40 0x56204973c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:54.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.760+0000 7fce3eea1b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56204972f380 0x56204973c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:54.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.760+0000 7fce3eea1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56204972fca0 0x56204973cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:54.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.760+0000 7fce3eea1b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56204979a970 con 0x56204972fca0 2023-09-23T09:33:54.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.760+0000 7fce3eea1b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56204979aab0 con 0x562049729c40 2023-09-23T09:33:54.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.760+0000 7fce3eea1b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x56204979ac20 con 0x56204972f380 2023-09-23T09:33:54.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.760+0000 7fce3eea1b80 10 client.0 _ll_register_callbacks cb 0x7fce1c01db60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:33:54.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.760+0000 7fce29b9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56204972fca0 0x56204973cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:54.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.760+0000 7fce29b9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56204972fca0 0x56204973cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50256/0 (socket says 172.21.15.82:50256) 2023-09-23T09:33:54.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.760+0000 7fce29b9c700 1 -- 172.21.15.82:0/1514147734 learned_addr learned my addr 172.21.15.82:0/1514147734 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:33:54.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.760+0000 7fce2939b700 1 --2- 172.21.15.82:0/1514147734 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562049729c40 0x56204973c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:54.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.760+0000 7fce28b9a700 1 --2- 172.21.15.82:0/1514147734 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56204972f380 0x56204973c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:54.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.760+0000 7fce29b9c700 1 -- 172.21.15.82:0/1514147734 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56204972f380 msgr2=0x56204973c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:33:54.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.760+0000 7fce29b9c700 1 --2- 172.21.15.82:0/1514147734 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56204972f380 0x56204973c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:54.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.760+0000 7fce29b9c700 1 -- 172.21.15.82:0/1514147734 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562049729c40 msgr2=0x56204973c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:33:54.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.760+0000 7fce29b9c700 1 --2- 172.21.15.82:0/1514147734 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562049729c40 0x56204973c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:54.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.760+0000 7fce29b9c700 1 -- 172.21.15.82:0/1514147734 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5620494a7de0 con 0x56204972fca0 2023-09-23T09:33:54.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.760+0000 7fce29b9c700 1 --2- 172.21.15.82:0/1514147734 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56204972fca0 0x56204973cbb0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fce1c096610 tx=0x7fce1c0964a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab894578543d7b7a server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:33:54.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.760+0000 7fce0cff9700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:33:54.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.761+0000 7fce0cff9700 1 -- 172.21.15.82:0/1514147734 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce1c09a810 con 0x56204972fca0 2023-09-23T09:33:54.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.761+0000 7fce3eea1b80 1 -- 172.21.15.82:0/1514147734 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56204971c8b0 con 0x56204972fca0 2023-09-23T09:33:54.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.761+0000 7fce0cff9700 1 -- 172.21.15.82:0/1514147734 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(149..149 src has 1..149) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fce1c09d040 con 0x56204972fca0 2023-09-23T09:33:54.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.761+0000 7fce0cff9700 1 -- 172.21.15.82:0/1514147734 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=109) v2 ==== 24+0+0 (secure 0 0 0) 0x7fce1c09a110 con 0x56204972fca0 2023-09-23T09:33:54.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.761+0000 7fce3eea1b80 10 client.17919 fetch_fsmap learned FSMap version 109 2023-09-23T09:33:54.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.761+0000 7fce3eea1b80 1 -- 172.21.15.82:0/1514147734 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=109,monmap=4+}) v3 -- 0x5620494ce250 con 0x56204972fca0 2023-09-23T09:33:54.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.761+0000 7fce0cff9700 1 -- 172.21.15.82:0/1514147734 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56204971c8b0 con 0x56204972fca0 2023-09-23T09:33:54.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.761+0000 7fce0cff9700 1 -- 172.21.15.82:0/1514147734 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 109) v1 ==== 7942+0+0 (secure 0 0 0) 0x7fce1c01d720 con 0x56204972fca0 2023-09-23T09:33:54.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.761+0000 7fce3eea1b80 10 client.17919 fetch_fsmap finished waiting for FSMap version 109 2023-09-23T09:33:54.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.761+0000 7fce3eea1b80 10 client.17919 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-09-23T09:33:54.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.761+0000 7fce3eea1b80 20 client.17919 populate_metadata read hostname 'smithi082' 2023-09-23T09:33:54.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.761+0000 7fce3eea1b80 1 --2- 172.21.15.82:0/1514147734 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x56204979bdf0 0x56204979e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:54.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.761+0000 7fce3eea1b80 4 client.17919 mds_command: new command op to 24526 tid=0[{"prefix": "damage ls"}] 2023-09-23T09:33:54.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.761+0000 7fce3eea1b80 1 -- 172.21.15.82:0/1514147734 --> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x562049674970 con 0x56204979bdf0 2023-09-23T09:33:54.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.762+0000 7fce2939b700 1 --2- 172.21.15.82:0/1514147734 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x56204979bdf0 0x56204979e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:54.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.762+0000 7fce2939b700 1 --2- 172.21.15.82:0/1514147734 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x56204979bdf0 0x56204979e1e0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ddc70e67f7ecd60a server_cookie=f353ee94495cc028 in_seq=0 out_seq=0 2023-09-23T09:33:54.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.762+0000 7fce0cff9700 10 client.17919 ms_handle_connect on v2:172.21.15.161:6836/43639843 2023-09-23T09:33:54.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.762+0000 7fce0cff9700 1 -- 172.21.15.82:0/1514147734 <== mds.2 v2:172.21.15.161:6836/43639843 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x562049674970 con 0x56204979bdf0 2023-09-23T09:33:54.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.762+0000 7fce0cff9700 10 client.17919 handle_command_reply: tid=0 2023-09-23T09:33:54.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.762+0000 7fce3eea1b80 1 client.17919 shutdown 2023-09-23T09:33:54.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.763+0000 7fce3eea1b80 1 -- 172.21.15.82:0/1514147734 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56204972fca0 msgr2=0x56204973cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:33:54.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.763+0000 7fce3eea1b80 1 --2- 172.21.15.82:0/1514147734 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56204972fca0 0x56204973cbb0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fce1c096610 tx=0x7fce1c0964a0 comp rx=0 tx=0).stop 2023-09-23T09:33:54.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.763+0000 7fce3eea1b80 1 -- 172.21.15.82:0/1514147734 shutdown_connections 2023-09-23T09:33:54.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.763+0000 7fce3eea1b80 1 --2- 172.21.15.82:0/1514147734 >> [v2:172.21.15.161:6836/43639843,v1:172.21.15.161:6837/43639843] conn(0x56204979bdf0 0x56204979e1e0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:54.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.763+0000 7fce3eea1b80 1 --2- 172.21.15.82:0/1514147734 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56204972fca0 0x56204973cbb0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:54.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.763+0000 7fce3eea1b80 1 --2- 172.21.15.82:0/1514147734 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562049729c40 0x56204973c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:54.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.763+0000 7fce3eea1b80 1 --2- 172.21.15.82:0/1514147734 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56204972f380 0x56204973c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:54.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.763+0000 7fce3eea1b80 1 -- 172.21.15.82:0/1514147734 >> 172.21.15.82:0/1514147734 conn(0x56204969e0e0 msgr2=0x5620497335e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:33:54.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.763+0000 7fce0cff9700 0 client.17919 ms_handle_reset on v2:172.21.15.161:6836/43639843 2023-09-23T09:33:54.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.763+0000 7fce3eea1b80 1 -- 172.21.15.82:0/1514147734 shutdown_connections 2023-09-23T09:33:54.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.763+0000 7fce3eea1b80 1 -- 172.21.15.82:0/1514147734 wait complete. 2023-09-23T09:33:54.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.763+0000 7fce3eea1b80 20 client.17919 trim_cache size 0 max 16384 2023-09-23T09:33:54.772 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2023-09-23T09:33:54.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.763+0000 7fce2b5ff700 1 -- 172.21.15.82:0/329205322 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fce100a0140 msgr2=0x7fce100a2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:33:54.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.763+0000 7fce2b5ff700 1 --2- 172.21.15.82:0/329205322 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fce100a0140 0x7fce100a2600 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fce1400b6c0 tx=0x7fce1400b830 comp rx=0 tx=0).stop 2023-09-23T09:33:54.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.763+0000 7fce2b5ff700 1 -- 172.21.15.82:0/329205322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce24106880 msgr2=0x7fce241966c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:33:54.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.763+0000 7fce2b5ff700 1 --2- 172.21.15.82:0/329205322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce24106880 0x7fce241966c0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fce1c009fd0 tx=0x7fce1c00bab0 comp rx=0 tx=0).stop 2023-09-23T09:33:54.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.763+0000 7fce2b5ff700 1 -- 172.21.15.82:0/329205322 shutdown_connections 2023-09-23T09:33:54.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.764+0000 7fce2b5ff700 1 --2- 172.21.15.82:0/329205322 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fce100a0140 0x7fce100a2600 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:54.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.764+0000 7fce2b5ff700 1 --2- 172.21.15.82:0/329205322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce24106880 0x7fce241966c0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:54.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.764+0000 7fce2b5ff700 1 --2- 172.21.15.82:0/329205322 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fce24100870 0x7fce2419c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:54.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.764+0000 7fce2b5ff700 1 --2- 172.21.15.82:0/329205322 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce24101230 0x7fce2419cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:54.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.764+0000 7fce2b5ff700 1 -- 172.21.15.82:0/329205322 >> 172.21.15.82:0/329205322 conn(0x7fce240fc3a0 msgr2=0x7fce240fc9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:33:54.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.764+0000 7fce2b5ff700 1 -- 172.21.15.82:0/329205322 shutdown_connections 2023-09-23T09:33:54.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:54.764+0000 7fce2b5ff700 1 -- 172.21.15.82:0/329205322 wait complete. 2023-09-23T09:33:54.782 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-09-23T09:33:55.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.077+0000 7f7172fff700 1 -- 172.21.15.82:0/2955912881 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f716c10f440 msgr2=0x7f716c10d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:33:55.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.077+0000 7f7172fff700 1 --2- 172.21.15.82:0/2955912881 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f716c10f440 0x7f716c10d0a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f71580098f0 tx=0x7f7158009c00 comp rx=0 tx=0).stop 2023-09-23T09:33:55.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.077+0000 7f7172fff700 1 -- 172.21.15.82:0/2955912881 shutdown_connections 2023-09-23T09:33:55.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.077+0000 7f7172fff700 1 --2- 172.21.15.82:0/2955912881 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f716c11a100 0x7f716c11c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:55.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.077+0000 7f7172fff700 1 --2- 172.21.15.82:0/2955912881 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f716c10efd0 0x7f716c10cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:55.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.077+0000 7f7172fff700 1 --2- 172.21.15.82:0/2955912881 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f716c10f440 0x7f716c10d0a0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:55.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.077+0000 7f7172fff700 1 -- 172.21.15.82:0/2955912881 >> 172.21.15.82:0/2955912881 conn(0x7f716c06cbe0 msgr2=0x7f716c06cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:33:55.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.080+0000 7f7172fff700 1 -- 172.21.15.82:0/2955912881 shutdown_connections 2023-09-23T09:33:55.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.083+0000 7f7172fff700 1 -- 172.21.15.82:0/2955912881 wait complete. 2023-09-23T09:33:55.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.085+0000 7f7172fff700 1 Processor -- start 2023-09-23T09:33:55.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.085+0000 7f7172fff700 1 -- start start 2023-09-23T09:33:55.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.086+0000 7f7172fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f716c10efd0 0x7f716c1ab520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:55.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.086+0000 7f7172fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f716c10f440 0x7f716c1aba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:55.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.086+0000 7f7172fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f716c11a100 0x7f716c1a5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:55.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.086+0000 7f7172fff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f716c1a5c00 con 0x7f716c10f440 2023-09-23T09:33:55.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.086+0000 7f7172fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f716c1a5d70 con 0x7f716c11a100 2023-09-23T09:33:55.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.086+0000 7f7172fff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f716c1a5f30 con 0x7f716c10efd0 2023-09-23T09:33:55.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.086+0000 7f7170d9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f716c10efd0 0x7f716c1ab520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:55.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.087+0000 7f717159c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f716c11a100 0x7f716c1a5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:55.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.087+0000 7f717159c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f716c11a100 0x7f716c1a5590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:44364/0 (socket says 172.21.15.82:44364) 2023-09-23T09:33:55.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.087+0000 7f717159c700 1 -- 172.21.15.82:0/3257293255 learned_addr learned my addr 172.21.15.82:0/3257293255 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:33:55.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.088+0000 7f717159c700 1 -- 172.21.15.82:0/3257293255 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f716c10efd0 msgr2=0x7f716c1ab520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:33:55.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.088+0000 7f717159c700 1 --2- 172.21.15.82:0/3257293255 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f716c10efd0 0x7f716c1ab520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:55.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.088+0000 7f717159c700 1 -- 172.21.15.82:0/3257293255 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f716c10f440 msgr2=0x7f716c1aba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:33:55.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.088+0000 7f717159c700 1 --2- 172.21.15.82:0/3257293255 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f716c10f440 0x7f716c1aba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:55.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.088+0000 7f717159c700 1 -- 172.21.15.82:0/3257293255 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7158009520 con 0x7f716c11a100 2023-09-23T09:33:55.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.088+0000 7f717159c700 1 --2- 172.21.15.82:0/3257293255 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f716c11a100 0x7f716c1a5590 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f716400efc0 tx=0x7f716400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:33:55.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.088+0000 7f7169ffb700 1 -- 172.21.15.82:0/3257293255 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7164018070 con 0x7f716c11a100 2023-09-23T09:33:55.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.089+0000 7f7169ffb700 1 -- 172.21.15.82:0/3257293255 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f716400f040 con 0x7f716c11a100 2023-09-23T09:33:55.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.089+0000 7f7169ffb700 1 -- 172.21.15.82:0/3257293255 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7164003c40 con 0x7f716c11a100 2023-09-23T09:33:55.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.089+0000 7f7172fff700 1 -- 172.21.15.82:0/3257293255 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f716c1a61b0 con 0x7f716c11a100 2023-09-23T09:33:55.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.089+0000 7f7172fff700 1 -- 172.21.15.82:0/3257293255 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f716c1b2510 con 0x7f716c11a100 2023-09-23T09:33:55.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.095+0000 7f718696eb80 1 Processor -- start 2023-09-23T09:33:55.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.096+0000 7f7169ffb700 1 -- 172.21.15.82:0/3257293255 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f716400ca20 con 0x7f716c11a100 2023-09-23T09:33:55.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.098+0000 7f7169ffb700 1 --2- 172.21.15.82:0/3257293255 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f715c0a0140 0x7f715c0a2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:55.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.099+0000 7f7169ffb700 1 -- 172.21.15.82:0/3257293255 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f71640caa00 con 0x7f716c11a100 2023-09-23T09:33:55.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.099+0000 7f716bfff700 1 --2- 172.21.15.82:0/3257293255 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f715c0a0140 0x7f715c0a2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:55.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.100+0000 7f718696eb80 1 -- start start 2023-09-23T09:33:55.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.101+0000 7f718696eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561087bb1380 0x561087bb1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:55.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.101+0000 7f718696eb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561087bb1ca0 0x561087bab700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:55.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.101+0000 7f718696eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561087babc40 0x561087bac0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:55.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.101+0000 7f718696eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561087b137b0 con 0x561087bb1380 2023-09-23T09:33:55.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.101+0000 7f718696eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561087b04780 con 0x561087babc40 2023-09-23T09:33:55.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.101+0000 7f718696eb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x561087b020a0 con 0x561087bb1ca0 2023-09-23T09:33:55.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.101+0000 7f716bfff700 1 --2- 172.21.15.82:0/3257293255 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f715c0a0140 0x7f715c0a2600 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7158009230 tx=0x7f7158005b40 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:33:55.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.101+0000 7f717159c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561087babc40 0x561087bac0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:55.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.101+0000 7f717159c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561087babc40 0x561087bac0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:44366/0 (socket says 172.21.15.82:44366) 2023-09-23T09:33:55.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.101+0000 7f717159c700 1 -- 172.21.15.82:0/2784355882 learned_addr learned my addr 172.21.15.82:0/2784355882 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:33:55.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.102+0000 7f717159c700 1 -- 172.21.15.82:0/2784355882 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561087bb1ca0 msgr2=0x561087bab700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:33:55.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.102+0000 7f717159c700 1 --2- 172.21.15.82:0/2784355882 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561087bb1ca0 0x561087bab700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:55.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.102+0000 7f717159c700 1 -- 172.21.15.82:0/2784355882 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561087bb1380 msgr2=0x561087bb1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:33:55.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.102+0000 7f717159c700 1 --2- 172.21.15.82:0/2784355882 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561087bb1380 0x561087bb1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:55.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.102+0000 7f717159c700 1 -- 172.21.15.82:0/2784355882 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56108797d630 con 0x561087babc40 2023-09-23T09:33:55.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.103+0000 7f717159c700 1 --2- 172.21.15.82:0/2784355882 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561087babc40 0x561087bac0a0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f716400ef90 tx=0x7f7164097c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b46e646ba54ecfd7 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:33:55.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.103+0000 7f7156ffd700 1 -- 172.21.15.82:0/2784355882 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7164098010 con 0x561087babc40 2023-09-23T09:33:55.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.105+0000 7f7156ffd700 1 -- 172.21.15.82:0/2784355882 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f716409be40 con 0x561087babc40 2023-09-23T09:33:55.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.105+0000 7f7156ffd700 1 -- 172.21.15.82:0/2784355882 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7164094720 con 0x561087babc40 2023-09-23T09:33:55.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.106+0000 7f718696eb80 1 -- 172.21.15.82:0/2784355882 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561087babc40 msgr2=0x561087bac0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:33:55.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.106+0000 7f718696eb80 1 --2- 172.21.15.82:0/2784355882 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561087babc40 0x561087bac0a0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f716400ef90 tx=0x7f7164097c50 comp rx=0 tx=0).stop 2023-09-23T09:33:55.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.108+0000 7f718696eb80 1 -- 172.21.15.82:0/2784355882 shutdown_connections 2023-09-23T09:33:55.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.108+0000 7f718696eb80 1 --2- 172.21.15.82:0/2784355882 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561087babc40 0x561087bac0a0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:55.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.108+0000 7f718696eb80 1 --2- 172.21.15.82:0/2784355882 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561087bb1380 0x561087bb1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:55.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.108+0000 7f718696eb80 1 --2- 172.21.15.82:0/2784355882 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561087bb1ca0 0x561087bab700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:55.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.108+0000 7f718696eb80 1 -- 172.21.15.82:0/2784355882 >> 172.21.15.82:0/2784355882 conn(0x561087b200e0 msgr2=0x561087ba6410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:33:55.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.110+0000 7f718696eb80 1 -- 172.21.15.82:0/2784355882 shutdown_connections 2023-09-23T09:33:55.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.113+0000 7f718696eb80 1 -- 172.21.15.82:0/2784355882 wait complete. 2023-09-23T09:33:55.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.113+0000 7f718696eb80 1 -- start start 2023-09-23T09:33:55.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.113+0000 7f718696eb80 1 Processor -- start 2023-09-23T09:33:55.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.117+0000 7f718696eb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561087babc40 0x561087bb4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:55.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.117+0000 7f718696eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561087bb1380 0x561087bb54e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:55.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.117+0000 7f718696eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561087bb1ca0 0x561087bb5a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:55.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.117+0000 7f718696eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561087afd990 con 0x561087bb1380 2023-09-23T09:33:55.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.117+0000 7f718696eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561087a9bbb0 con 0x561087bb1ca0 2023-09-23T09:33:55.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.117+0000 7f718696eb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x561087a9b8b0 con 0x561087babc40 2023-09-23T09:33:55.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.117+0000 7f718696eb80 10 client.0 _ll_register_callbacks cb 0x5610879e5a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:33:55.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.118+0000 7f717159c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561087bb1ca0 0x561087bb5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:55.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.118+0000 7f717159c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561087bb1ca0 0x561087bb5a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:44380/0 (socket says 172.21.15.82:44380) 2023-09-23T09:33:55.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.118+0000 7f717159c700 1 -- 172.21.15.82:0/1697830609 learned_addr learned my addr 172.21.15.82:0/1697830609 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:33:55.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.118+0000 7f716bfff700 1 --2- 172.21.15.82:0/1697830609 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561087bb1380 0x561087bb54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:55.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.119+0000 7f717159c700 1 -- 172.21.15.82:0/1697830609 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561087babc40 msgr2=0x561087bb4fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-23T09:33:55.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.119+0000 7f717159c700 1 --2- 172.21.15.82:0/1697830609 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561087babc40 0x561087bb4fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:55.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.119+0000 7f717159c700 1 -- 172.21.15.82:0/1697830609 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561087bb1380 msgr2=0x561087bb54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:33:55.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.119+0000 7f717159c700 1 --2- 172.21.15.82:0/1697830609 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561087bb1380 0x561087bb54e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:55.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.119+0000 7f717159c700 1 -- 172.21.15.82:0/1697830609 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f716c1b2510 con 0x561087bb1ca0 2023-09-23T09:33:55.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.119+0000 7f717159c700 1 --2- 172.21.15.82:0/1697830609 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561087bb1ca0 0x561087bb5a20 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f71640090a0 tx=0x7f7164004d00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2be439a5f9794c4e server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:33:55.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.119+0000 7f714bfff700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-09-23T09:33:55.123 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:33:54 smithi082 ceph-mon[97694]: pgmap v1173: 97 pgs: 97 active+clean; 16 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.4 MiB/s rd, 8.8 MiB/s wr, 822 op/s 2023-09-23T09:33:55.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.120+0000 7f714bfff700 1 -- 172.21.15.82:0/1697830609 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f716409fe20 con 0x561087bb1ca0 2023-09-23T09:33:55.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.120+0000 7f714bfff700 1 -- 172.21.15.82:0/1697830609 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(149..149 src has 1..149) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f71640093e0 con 0x561087bb1ca0 2023-09-23T09:33:55.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.120+0000 7f718696eb80 1 -- 172.21.15.82:0/1697830609 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561087b7b1c0 con 0x561087bb1ca0 2023-09-23T09:33:55.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.120+0000 7f714bfff700 1 -- 172.21.15.82:0/1697830609 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=109) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7164098480 con 0x561087bb1ca0 2023-09-23T09:33:55.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.120+0000 7f718696eb80 10 client.27650 fetch_fsmap learned FSMap version 109 2023-09-23T09:33:55.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.120+0000 7f718696eb80 1 -- 172.21.15.82:0/1697830609 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=109,monmap=4+}) v3 -- 0x561087929de0 con 0x561087bb1ca0 2023-09-23T09:33:55.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.120+0000 7f714bfff700 1 -- 172.21.15.82:0/1697830609 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x561087b7b1c0 con 0x561087bb1ca0 2023-09-23T09:33:55.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.121+0000 7f714bfff700 1 -- 172.21.15.82:0/1697830609 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 109) v1 ==== 7942+0+0 (secure 0 0 0) 0x7f716409fa90 con 0x561087bb1ca0 2023-09-23T09:33:55.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.121+0000 7f718696eb80 10 client.27650 fetch_fsmap finished waiting for FSMap version 109 2023-09-23T09:33:55.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.121+0000 7f718696eb80 10 client.27650 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-23T09:33:55.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.121+0000 7f718696eb80 20 client.27650 populate_metadata read hostname 'smithi082' 2023-09-23T09:33:55.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.121+0000 7f718696eb80 1 --2- 172.21.15.82:0/1697830609 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x561087bd6460 0x561087bd8880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:55.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.121+0000 7f718696eb80 4 client.27650 mds_command: new command op to 24550 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:33:55.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.121+0000 7f718696eb80 1 -- 172.21.15.82:0/1697830609 --> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561087aa3ba0 con 0x561087bd6460 2023-09-23T09:33:55.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.121+0000 7f7170d9b700 1 --2- 172.21.15.82:0/1697830609 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x561087bd6460 0x561087bd8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:55.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.122+0000 7f7170d9b700 1 --2- 172.21.15.82:0/1697830609 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x561087bd6460 0x561087bd8880 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6302e90c9c1a70eb server_cookie=8d1e54bbd0230ea4 in_seq=0 out_seq=0 2023-09-23T09:33:55.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.122+0000 7f714bfff700 10 client.27650 ms_handle_connect on v2:172.21.15.161:6838/758982817 2023-09-23T09:33:55.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.123+0000 7f714bfff700 1 -- 172.21.15.82:0/1697830609 <== mds.1 v2:172.21.15.161:6838/758982817 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x561087aa3ba0 con 0x561087bd6460 2023-09-23T09:33:55.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.123+0000 7f714bfff700 10 client.27650 handle_command_reply: tid=0 2023-09-23T09:33:55.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.123+0000 7f718696eb80 1 client.27650 shutdown 2023-09-23T09:33:55.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.125+0000 7f718696eb80 1 -- 172.21.15.82:0/1697830609 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561087bb1ca0 msgr2=0x561087bb5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:33:55.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.125+0000 7f718696eb80 1 --2- 172.21.15.82:0/1697830609 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561087bb1ca0 0x561087bb5a20 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f71640090a0 tx=0x7f7164004d00 comp rx=0 tx=0).stop 2023-09-23T09:33:55.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.126+0000 7f718696eb80 1 -- 172.21.15.82:0/1697830609 shutdown_connections 2023-09-23T09:33:55.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.126+0000 7f718696eb80 1 --2- 172.21.15.82:0/1697830609 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x561087bd6460 0x561087bd8880 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:55.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.126+0000 7f718696eb80 1 --2- 172.21.15.82:0/1697830609 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561087bb1ca0 0x561087bb5a20 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:55.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.126+0000 7f718696eb80 1 --2- 172.21.15.82:0/1697830609 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561087babc40 0x561087bb4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:55.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.126+0000 7f718696eb80 1 --2- 172.21.15.82:0/1697830609 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561087bb1380 0x561087bb54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:55.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.126+0000 7f718696eb80 1 -- 172.21.15.82:0/1697830609 >> 172.21.15.82:0/1697830609 conn(0x561087b200e0 msgr2=0x561087ba0b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:33:55.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.126+0000 7f714bfff700 0 client.27650 ms_handle_reset on v2:172.21.15.161:6838/758982817 2023-09-23T09:33:55.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.126+0000 7f718696eb80 1 -- 172.21.15.82:0/1697830609 shutdown_connections 2023-09-23T09:33:55.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.127+0000 7f718696eb80 1 -- 172.21.15.82:0/1697830609 wait complete. 2023-09-23T09:33:55.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.128+0000 7f718696eb80 20 client.27650 trim_cache size 0 max 16384 2023-09-23T09:33:55.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:33:54 smithi161 ceph-mon[99580]: pgmap v1173: 97 pgs: 97 active+clean; 16 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.4 MiB/s rd, 8.8 MiB/s wr, 822 op/s 2023-09-23T09:33:55.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.153+0000 7f718696eb80 1 Processor -- start 2023-09-23T09:33:55.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.153+0000 7f718696eb80 1 -- start start 2023-09-23T09:33:55.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.154+0000 7f718696eb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561087babc40 0x561087bab700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:55.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.154+0000 7f718696eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561087bb1380 0x561087bcd800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:55.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.154+0000 7f718696eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561087bb1ca0 0x561087ba02b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:55.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.154+0000 7f718696eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56108797f920 con 0x561087bb1380 2023-09-23T09:33:55.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.154+0000 7f718696eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561087bc9600 con 0x561087bb1ca0 2023-09-23T09:33:55.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.154+0000 7f718696eb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x561087bb6580 con 0x561087babc40 2023-09-23T09:33:55.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.157+0000 7f717159c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561087bb1ca0 0x561087ba02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:55.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.157+0000 7f717159c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561087bb1ca0 0x561087ba02b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:44396/0 (socket says 172.21.15.82:44396) 2023-09-23T09:33:55.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.157+0000 7f717159c700 1 -- 172.21.15.82:0/121971126 learned_addr learned my addr 172.21.15.82:0/121971126 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:33:55.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.158+0000 7f717159c700 1 -- 172.21.15.82:0/121971126 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561087babc40 msgr2=0x561087bab700 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-23T09:33:55.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.158+0000 7f717159c700 1 --2- 172.21.15.82:0/121971126 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561087babc40 0x561087bab700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:55.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.158+0000 7f717159c700 1 -- 172.21.15.82:0/121971126 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561087bb1380 msgr2=0x561087bcd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:33:55.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.158+0000 7f717159c700 1 --2- 172.21.15.82:0/121971126 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561087bb1380 0x561087bcd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:55.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.158+0000 7f717159c700 1 -- 172.21.15.82:0/121971126 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561087912c60 con 0x561087bb1ca0 2023-09-23T09:33:55.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.158+0000 7f717159c700 1 --2- 172.21.15.82:0/121971126 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561087bb1ca0 0x561087ba02b0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f7164096360 tx=0x7f71640c8050 comp rx=0 tx=0).ready entity=mon.2 client_cookie=caeb86c62e0fa7de server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:33:55.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.160+0000 7f71577fe700 1 -- 172.21.15.82:0/121971126 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71640093e0 con 0x561087bb1ca0 2023-09-23T09:33:55.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.160+0000 7f71577fe700 1 -- 172.21.15.82:0/121971126 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f716409fe20 con 0x561087bb1ca0 2023-09-23T09:33:55.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.160+0000 7f71577fe700 1 -- 172.21.15.82:0/121971126 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7164097700 con 0x561087bb1ca0 2023-09-23T09:33:55.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.161+0000 7f718696eb80 1 -- 172.21.15.82:0/121971126 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561087bb1ca0 msgr2=0x561087ba02b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:33:55.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.161+0000 7f718696eb80 1 --2- 172.21.15.82:0/121971126 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561087bb1ca0 0x561087ba02b0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f7164096360 tx=0x7f71640c8050 comp rx=0 tx=0).stop 2023-09-23T09:33:55.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.162+0000 7f718696eb80 1 -- 172.21.15.82:0/121971126 shutdown_connections 2023-09-23T09:33:55.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.162+0000 7f718696eb80 1 --2- 172.21.15.82:0/121971126 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561087bb1ca0 0x561087ba02b0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:55.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.162+0000 7f718696eb80 1 --2- 172.21.15.82:0/121971126 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561087babc40 0x561087bab700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:55.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.162+0000 7f718696eb80 1 --2- 172.21.15.82:0/121971126 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561087bb1380 0x561087bcd800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:55.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.162+0000 7f718696eb80 1 -- 172.21.15.82:0/121971126 >> 172.21.15.82:0/121971126 conn(0x561087b200e0 msgr2=0x561087baf0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:33:55.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.162+0000 7f718696eb80 1 -- 172.21.15.82:0/121971126 shutdown_connections 2023-09-23T09:33:55.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.162+0000 7f718696eb80 1 -- 172.21.15.82:0/121971126 wait complete. 2023-09-23T09:33:55.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.163+0000 7f718696eb80 1 -- start start 2023-09-23T09:33:55.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.163+0000 7f718696eb80 1 Processor -- start 2023-09-23T09:33:55.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.164+0000 7f718696eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561087babc40 0x561087c1e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:55.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.164+0000 7f718696eb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561087bb1380 0x561087c1e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:55.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.164+0000 7f718696eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561087bb1ca0 0x561087c1ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:55.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.164+0000 7f718696eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561087c292b0 con 0x561087babc40 2023-09-23T09:33:55.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.164+0000 7f718696eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561087c293f0 con 0x561087bb1ca0 2023-09-23T09:33:55.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.164+0000 7f718696eb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x561087c295b0 con 0x561087bb1380 2023-09-23T09:33:55.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.164+0000 7f718696eb80 10 client.0 _ll_register_callbacks cb 0x7f7164097b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:33:55.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.165+0000 7f7170d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561087babc40 0x561087c1e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:55.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.165+0000 7f7170d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561087babc40 0x561087c1e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50314/0 (socket says 172.21.15.82:50314) 2023-09-23T09:33:55.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.165+0000 7f7170d9b700 1 -- 172.21.15.82:0/1969451937 learned_addr learned my addr 172.21.15.82:0/1969451937 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:33:55.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.166+0000 7f717159c700 1 --2- 172.21.15.82:0/1969451937 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561087bb1ca0 0x561087c1ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:55.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.166+0000 7f716bfff700 1 --2- 172.21.15.82:0/1969451937 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561087bb1380 0x561087c1e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:55.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.166+0000 7f7170d9b700 1 -- 172.21.15.82:0/1969451937 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561087bb1380 msgr2=0x561087c1e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:33:55.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.166+0000 7f7170d9b700 1 --2- 172.21.15.82:0/1969451937 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561087bb1380 0x561087c1e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:55.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.166+0000 7f7170d9b700 1 -- 172.21.15.82:0/1969451937 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561087bb1ca0 msgr2=0x561087c1ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:33:55.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.166+0000 7f7170d9b700 1 --2- 172.21.15.82:0/1969451937 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561087bb1ca0 0x561087c1ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:55.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.166+0000 7f7170d9b700 1 -- 172.21.15.82:0/1969451937 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561087929de0 con 0x561087babc40 2023-09-23T09:33:55.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.167+0000 7f7170d9b700 1 --2- 172.21.15.82:0/1969451937 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561087babc40 0x561087c1e1e0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f71600099a0 tx=0x7f7160009e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4c4ca0b9449a426 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:33:55.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.167+0000 7f714bfff700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:33:55.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.167+0000 7f714bfff700 1 -- 172.21.15.82:0/1969451937 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7160012840 con 0x561087babc40 2023-09-23T09:33:55.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.167+0000 7f714bfff700 1 -- 172.21.15.82:0/1969451937 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(149..149 src has 1..149) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f71600129a0 con 0x561087babc40 2023-09-23T09:33:55.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.167+0000 7f718696eb80 1 -- 172.21.15.82:0/1969451937 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561087b9e8b0 con 0x561087babc40 2023-09-23T09:33:55.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.168+0000 7f714bfff700 1 -- 172.21.15.82:0/1969451937 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=109) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7160012b60 con 0x561087babc40 2023-09-23T09:33:55.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.168+0000 7f718696eb80 10 client.17928 fetch_fsmap learned FSMap version 109 2023-09-23T09:33:55.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.168+0000 7f718696eb80 1 -- 172.21.15.82:0/1969451937 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=109,monmap=4+}) v3 -- 0x561087950250 con 0x561087babc40 2023-09-23T09:33:55.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.169+0000 7f714bfff700 1 -- 172.21.15.82:0/1969451937 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x561087b9e8b0 con 0x561087babc40 2023-09-23T09:33:55.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.169+0000 7f714bfff700 1 -- 172.21.15.82:0/1969451937 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 109) v1 ==== 7942+0+0 (secure 0 0 0) 0x7f71600216d0 con 0x561087babc40 2023-09-23T09:33:55.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.169+0000 7f718696eb80 10 client.17928 fetch_fsmap finished waiting for FSMap version 109 2023-09-23T09:33:55.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.169+0000 7f718696eb80 10 client.17928 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-23T09:33:55.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.169+0000 7f718696eb80 20 client.17928 populate_metadata read hostname 'smithi082' 2023-09-23T09:33:55.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.169+0000 7f718696eb80 1 --2- 172.21.15.82:0/1969451937 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x561087c2ade0 0x561087c2d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:55.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.169+0000 7f718696eb80 4 client.17928 mds_command: new command op to 24550 tid=0[{"prefix": "damage ls"}] 2023-09-23T09:33:55.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.169+0000 7f718696eb80 1 -- 172.21.15.82:0/1969451937 --> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x561087af6970 con 0x561087c2ade0 2023-09-23T09:33:55.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.170+0000 7f716bfff700 1 --2- 172.21.15.82:0/1969451937 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x561087c2ade0 0x561087c2d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:55.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.171+0000 7f716bfff700 1 --2- 172.21.15.82:0/1969451937 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x561087c2ade0 0x561087c2d200 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5973ae770db8b5c0 server_cookie=8f2c3fcc87727504 in_seq=0 out_seq=0 2023-09-23T09:33:55.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.171+0000 7f714bfff700 10 client.17928 ms_handle_connect on v2:172.21.15.161:6838/758982817 2023-09-23T09:33:55.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.172+0000 7f714bfff700 1 -- 172.21.15.82:0/1969451937 <== mds.1 v2:172.21.15.161:6838/758982817 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x561087af6970 con 0x561087c2ade0 2023-09-23T09:33:55.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.172+0000 7f714bfff700 10 client.17928 handle_command_reply: tid=0 2023-09-23T09:33:55.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.172+0000 7f718696eb80 1 client.17928 shutdown 2023-09-23T09:33:55.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.173+0000 7f718696eb80 1 -- 172.21.15.82:0/1969451937 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561087babc40 msgr2=0x561087c1e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:33:55.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.173+0000 7f718696eb80 1 --2- 172.21.15.82:0/1969451937 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561087babc40 0x561087c1e1e0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f71600099a0 tx=0x7f7160009e40 comp rx=0 tx=0).stop 2023-09-23T09:33:55.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.173+0000 7f718696eb80 1 -- 172.21.15.82:0/1969451937 shutdown_connections 2023-09-23T09:33:55.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.173+0000 7f718696eb80 1 --2- 172.21.15.82:0/1969451937 >> [v2:172.21.15.161:6838/758982817,v1:172.21.15.161:6839/758982817] conn(0x561087c2ade0 0x561087c2d200 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:55.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.173+0000 7f718696eb80 1 --2- 172.21.15.82:0/1969451937 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561087bb1ca0 0x561087c1ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:55.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.173+0000 7f718696eb80 1 --2- 172.21.15.82:0/1969451937 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561087babc40 0x561087c1e1e0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:55.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.173+0000 7f718696eb80 1 --2- 172.21.15.82:0/1969451937 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561087bb1380 0x561087c1e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:55.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.173+0000 7f718696eb80 1 -- 172.21.15.82:0/1969451937 >> 172.21.15.82:0/1969451937 conn(0x561087b200e0 msgr2=0x561087ba02b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:33:55.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.173+0000 7f714bfff700 0 client.17928 ms_handle_reset on v2:172.21.15.161:6838/758982817 2023-09-23T09:33:55.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.174+0000 7f718696eb80 1 -- 172.21.15.82:0/1969451937 shutdown_connections 2023-09-23T09:33:55.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.174+0000 7f718696eb80 1 -- 172.21.15.82:0/1969451937 wait complete. 2023-09-23T09:33:55.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.175+0000 7f718696eb80 20 client.17928 trim_cache size 0 max 16384 2023-09-23T09:33:55.177 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2023-09-23T09:33:55.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.177+0000 7f7172fff700 1 -- 172.21.15.82:0/3257293255 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f715c0a0140 msgr2=0x7f715c0a2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:33:55.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.177+0000 7f7172fff700 1 --2- 172.21.15.82:0/3257293255 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f715c0a0140 0x7f715c0a2600 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7158009230 tx=0x7f7158005b40 comp rx=0 tx=0).stop 2023-09-23T09:33:55.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.177+0000 7f7172fff700 1 -- 172.21.15.82:0/3257293255 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f716c11a100 msgr2=0x7f716c1a5590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:33:55.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.177+0000 7f7172fff700 1 --2- 172.21.15.82:0/3257293255 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f716c11a100 0x7f716c1a5590 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f716400efc0 tx=0x7f716400c3a0 comp rx=0 tx=0).stop 2023-09-23T09:33:55.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.177+0000 7f7172fff700 1 -- 172.21.15.82:0/3257293255 shutdown_connections 2023-09-23T09:33:55.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.177+0000 7f7172fff700 1 --2- 172.21.15.82:0/3257293255 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f715c0a0140 0x7f715c0a2600 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:55.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.177+0000 7f7172fff700 1 --2- 172.21.15.82:0/3257293255 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f716c11a100 0x7f716c1a5590 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:55.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.177+0000 7f7172fff700 1 --2- 172.21.15.82:0/3257293255 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f716c10efd0 0x7f716c1ab520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:55.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.177+0000 7f7172fff700 1 --2- 172.21.15.82:0/3257293255 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f716c10f440 0x7f716c1aba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:55.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.177+0000 7f7172fff700 1 -- 172.21.15.82:0/3257293255 >> 172.21.15.82:0/3257293255 conn(0x7f716c06cbe0 msgr2=0x7f716c1180f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:33:55.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.179+0000 7f7172fff700 1 -- 172.21.15.82:0/3257293255 shutdown_connections 2023-09-23T09:33:55.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.179+0000 7f7172fff700 1 -- 172.21.15.82:0/3257293255 wait complete. 2023-09-23T09:33:55.210 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-09-23T09:33:55.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:33:54 smithi135 ceph-mon[99205]: pgmap v1173: 97 pgs: 97 active+clean; 16 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.4 MiB/s rd, 8.8 MiB/s wr, 822 op/s 2023-09-23T09:33:55.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.553+0000 7fcd3b1ff700 1 -- 172.21.15.82:0/2213578348 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd34106880 msgr2=0x7fcd34106c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:33:55.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.553+0000 7fcd3b1ff700 1 --2- 172.21.15.82:0/2213578348 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd34106880 0x7fcd34106c60 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fcd28009990 tx=0x7fcd28009ca0 comp rx=0 tx=0).stop 2023-09-23T09:33:55.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.553+0000 7fcd3b1ff700 1 -- 172.21.15.82:0/2213578348 shutdown_connections 2023-09-23T09:33:55.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.553+0000 7fcd3b1ff700 1 --2- 172.21.15.82:0/2213578348 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd34101230 0x7fcd3410d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:55.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.553+0000 7fcd3b1ff700 1 --2- 172.21.15.82:0/2213578348 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd34106880 0x7fcd34106c60 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:55.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.553+0000 7fcd3b1ff700 1 --2- 172.21.15.82:0/2213578348 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd34100870 0x7fcd34100cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:55.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.553+0000 7fcd3b1ff700 1 -- 172.21.15.82:0/2213578348 >> 172.21.15.82:0/2213578348 conn(0x7fcd340fc3a0 msgr2=0x7fcd340fe7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:33:55.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.553+0000 7fcd3b1ff700 1 -- 172.21.15.82:0/2213578348 shutdown_connections 2023-09-23T09:33:55.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.553+0000 7fcd3b1ff700 1 -- 172.21.15.82:0/2213578348 wait complete. 2023-09-23T09:33:55.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.554+0000 7fcd3b1ff700 1 Processor -- start 2023-09-23T09:33:55.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.554+0000 7fcd3b1ff700 1 -- start start 2023-09-23T09:33:55.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.554+0000 7fcd3b1ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd34100870 0x7fcd3419c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:55.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.554+0000 7fcd3b1ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd34101230 0x7fcd3419cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:55.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.554+0000 7fcd3b1ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd34106880 0x7fcd341967b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:55.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.554+0000 7fcd3b1ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd34196e20 con 0x7fcd34101230 2023-09-23T09:33:55.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.554+0000 7fcd3b1ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd34196f90 con 0x7fcd34100870 2023-09-23T09:33:55.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.554+0000 7fcd3b1ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd34197150 con 0x7fcd34106880 2023-09-23T09:33:55.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.555+0000 7fcd33fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd34101230 0x7fcd3419cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:55.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.555+0000 7fcd33fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd34101230 0x7fcd3419cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50328/0 (socket says 172.21.15.82:50328) 2023-09-23T09:33:55.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.555+0000 7fcd33fff700 1 -- 172.21.15.82:0/134754416 learned_addr learned my addr 172.21.15.82:0/134754416 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:33:55.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.555+0000 7fcd38f9b700 1 --2- 172.21.15.82:0/134754416 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd34100870 0x7fcd3419c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:55.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.555+0000 7fcd3979c700 1 --2- 172.21.15.82:0/134754416 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd34106880 0x7fcd341967b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:55.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.555+0000 7fcd33fff700 1 -- 172.21.15.82:0/134754416 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd34106880 msgr2=0x7fcd341967b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:33:55.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.555+0000 7fcd33fff700 1 --2- 172.21.15.82:0/134754416 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd34106880 0x7fcd341967b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:55.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.555+0000 7fcd33fff700 1 -- 172.21.15.82:0/134754416 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd34100870 msgr2=0x7fcd3419c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:33:55.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.555+0000 7fcd33fff700 1 --2- 172.21.15.82:0/134754416 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd34100870 0x7fcd3419c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:55.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.555+0000 7fcd33fff700 1 -- 172.21.15.82:0/134754416 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd280095f0 con 0x7fcd34101230 2023-09-23T09:33:55.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.555+0000 7fcd38f9b700 1 --2- 172.21.15.82:0/134754416 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd34100870 0x7fcd3419c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:33:55.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.555+0000 7fcd33fff700 1 --2- 172.21.15.82:0/134754416 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd34101230 0x7fcd3419cc30 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fcd2000d950 tx=0x7fcd2000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:33:55.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.555+0000 7fcd31ffb700 1 -- 172.21.15.82:0/134754416 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd20009940 con 0x7fcd34101230 2023-09-23T09:33:55.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.556+0000 7fcd31ffb700 1 -- 172.21.15.82:0/134754416 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcd20010460 con 0x7fcd34101230 2023-09-23T09:33:55.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.556+0000 7fcd3b1ff700 1 -- 172.21.15.82:0/134754416 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd34197430 con 0x7fcd34101230 2023-09-23T09:33:55.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.556+0000 7fcd31ffb700 1 -- 172.21.15.82:0/134754416 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd2000f620 con 0x7fcd34101230 2023-09-23T09:33:55.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.556+0000 7fcd3b1ff700 1 -- 172.21.15.82:0/134754416 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd341a36e0 con 0x7fcd34101230 2023-09-23T09:33:55.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.561+0000 7fcd31ffb700 1 -- 172.21.15.82:0/134754416 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7fcd200105d0 con 0x7fcd34101230 2023-09-23T09:33:55.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.561+0000 7fcd4ea8cb80 1 Processor -- start 2023-09-23T09:33:55.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.562+0000 7fcd4ea8cb80 1 -- start start 2023-09-23T09:33:55.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.562+0000 7fcd4ea8cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562335ba9780 0x562335ba9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:55.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.562+0000 7fcd4ea8cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562335baa0a0 0x562335ba3b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:55.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.562+0000 7fcd4ea8cb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562335ba4050 0x562335ba4470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:55.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.562+0000 7fcd4ea8cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562335b077b0 con 0x562335baa0a0 2023-09-23T09:33:55.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.562+0000 7fcd4ea8cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562335af8780 con 0x562335ba9780 2023-09-23T09:33:55.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.562+0000 7fcd4ea8cb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x562335af60a0 con 0x562335ba4050 2023-09-23T09:33:55.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.562+0000 7fcd38f9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562335baa0a0 0x562335ba3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:55.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.562+0000 7fcd38f9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562335baa0a0 0x562335ba3b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50330/0 (socket says 172.21.15.82:50330) 2023-09-23T09:33:55.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.562+0000 7fcd38f9b700 1 -- 172.21.15.82:0/3663292620 learned_addr learned my addr 172.21.15.82:0/3663292620 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:33:55.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.562+0000 7fcd3979c700 1 --2- 172.21.15.82:0/3663292620 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562335ba9780 0x562335ba9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:55.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.562+0000 7fcd33fff700 1 --2- 172.21.15.82:0/3663292620 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562335ba4050 0x562335ba4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:55.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.563+0000 7fcd3979c700 1 -- 172.21.15.82:0/3663292620 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562335ba4050 msgr2=0x562335ba4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:33:55.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.563+0000 7fcd3979c700 1 --2- 172.21.15.82:0/3663292620 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562335ba4050 0x562335ba4470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:55.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.563+0000 7fcd3979c700 1 -- 172.21.15.82:0/3663292620 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562335baa0a0 msgr2=0x562335ba3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:33:55.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.563+0000 7fcd3979c700 1 --2- 172.21.15.82:0/3663292620 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562335baa0a0 0x562335ba3b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:55.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.563+0000 7fcd3979c700 1 -- 172.21.15.82:0/3663292620 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562335971630 con 0x562335ba9780 2023-09-23T09:33:55.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.563+0000 7fcd38f9b700 1 --2- 172.21.15.82:0/3663292620 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562335baa0a0 0x562335ba3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:33:55.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.563+0000 7fcd31ffb700 1 --2- 172.21.15.82:0/134754416 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fcd240a00c0 0x7fcd240a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:55.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.563+0000 7fcd3979c700 1 --2- 172.21.15.82:0/3663292620 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562335ba9780 0x562335ba9b60 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c0092e0 tx=0x7fcd2c009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13fc905404dd0a6f server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:33:55.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.563+0000 7fcd31ffb700 1 -- 172.21.15.82:0/134754416 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fcd200cb4e0 con 0x7fcd34101230 2023-09-23T09:33:55.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.563+0000 7fcd38f9b700 1 --2- 172.21.15.82:0/134754416 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fcd240a00c0 0x7fcd240a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:55.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.563+0000 7fcd1effd700 1 -- 172.21.15.82:0/3663292620 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd2c00e070 con 0x562335ba9780 2023-09-23T09:33:55.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.564+0000 7fcd1effd700 1 -- 172.21.15.82:0/3663292620 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcd2c00f040 con 0x562335ba9780 2023-09-23T09:33:55.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.564+0000 7fcd1effd700 1 -- 172.21.15.82:0/3663292620 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd2c004660 con 0x562335ba9780 2023-09-23T09:33:55.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.564+0000 7fcd4ea8cb80 1 -- 172.21.15.82:0/3663292620 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562335ba9780 msgr2=0x562335ba9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:33:55.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.564+0000 7fcd38f9b700 1 --2- 172.21.15.82:0/134754416 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fcd240a00c0 0x7fcd240a2580 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x562335baa500 tx=0x7fcd2800b260 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:33:55.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.564+0000 7fcd4ea8cb80 1 --2- 172.21.15.82:0/3663292620 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562335ba9780 0x562335ba9b60 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c0092e0 tx=0x7fcd2c009920 comp rx=0 tx=0).stop 2023-09-23T09:33:55.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.564+0000 7fcd4ea8cb80 1 -- 172.21.15.82:0/3663292620 shutdown_connections 2023-09-23T09:33:55.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.564+0000 7fcd4ea8cb80 1 --2- 172.21.15.82:0/3663292620 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562335ba4050 0x562335ba4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:55.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.564+0000 7fcd4ea8cb80 1 --2- 172.21.15.82:0/3663292620 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562335ba9780 0x562335ba9b60 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:55.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.564+0000 7fcd4ea8cb80 1 --2- 172.21.15.82:0/3663292620 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562335baa0a0 0x562335ba3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:55.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.564+0000 7fcd4ea8cb80 1 -- 172.21.15.82:0/3663292620 >> 172.21.15.82:0/3663292620 conn(0x562335b140e0 msgr2=0x562335b9a410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:33:55.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.564+0000 7fcd4ea8cb80 1 -- 172.21.15.82:0/3663292620 shutdown_connections 2023-09-23T09:33:55.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.564+0000 7fcd4ea8cb80 1 -- 172.21.15.82:0/3663292620 wait complete. 2023-09-23T09:33:55.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.565+0000 7fcd4ea8cb80 1 -- start start 2023-09-23T09:33:55.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.565+0000 7fcd4ea8cb80 1 Processor -- start 2023-09-23T09:33:55.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.565+0000 7fcd4ea8cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562335ba4050 0x562335baffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:55.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.565+0000 7fcd4ea8cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562335ba9780 0x562335bad1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:55.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.565+0000 7fcd4ea8cb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562335baa0a0 0x562335bad780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:55.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.566+0000 7fcd4ea8cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562335af1990 con 0x562335ba4050 2023-09-23T09:33:55.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.566+0000 7fcd4ea8cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562335a8fbb0 con 0x562335ba9780 2023-09-23T09:33:55.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.566+0000 7fcd4ea8cb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x562335a8f8b0 con 0x562335baa0a0 2023-09-23T09:33:55.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.566+0000 7fcd4ea8cb80 10 client.0 _ll_register_callbacks cb 0x5623359d9a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:33:55.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.566+0000 7fcd38f9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562335ba4050 0x562335baffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:55.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.566+0000 7fcd38f9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562335ba4050 0x562335baffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50344/0 (socket says 172.21.15.82:50344) 2023-09-23T09:33:55.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.566+0000 7fcd38f9b700 1 -- 172.21.15.82:0/349978549 learned_addr learned my addr 172.21.15.82:0/349978549 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:33:55.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.566+0000 7fcd3979c700 1 --2- 172.21.15.82:0/349978549 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562335baa0a0 0x562335bad780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:55.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.566+0000 7fcd33fff700 1 --2- 172.21.15.82:0/349978549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562335ba9780 0x562335bad1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:55.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.566+0000 7fcd38f9b700 1 -- 172.21.15.82:0/349978549 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562335baa0a0 msgr2=0x562335bad780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:33:55.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.566+0000 7fcd38f9b700 1 --2- 172.21.15.82:0/349978549 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562335baa0a0 0x562335bad780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:55.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.566+0000 7fcd38f9b700 1 -- 172.21.15.82:0/349978549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562335ba9780 msgr2=0x562335bad1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:33:55.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.566+0000 7fcd38f9b700 1 --2- 172.21.15.82:0/349978549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562335ba9780 0x562335bad1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:55.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.566+0000 7fcd38f9b700 1 -- 172.21.15.82:0/349978549 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd3410e040 con 0x562335ba4050 2023-09-23T09:33:55.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.566+0000 7fcd38f9b700 1 --2- 172.21.15.82:0/349978549 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562335ba4050 0x562335baffb0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fcd28006010 tx=0x7fcd28009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad4ffc3a07345c6 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:33:55.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.566+0000 7fcd13fff700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:33:55.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.567+0000 7fcd13fff700 1 -- 172.21.15.82:0/349978549 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd28026870 con 0x562335ba4050 2023-09-23T09:33:55.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.567+0000 7fcd4ea8cb80 1 -- 172.21.15.82:0/349978549 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562335b6f1c0 con 0x562335ba4050 2023-09-23T09:33:55.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.567+0000 7fcd13fff700 1 -- 172.21.15.82:0/349978549 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(149..149 src has 1..149) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fcd280269d0 con 0x562335ba4050 2023-09-23T09:33:55.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.567+0000 7fcd13fff700 1 -- 172.21.15.82:0/349978549 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=109) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcd28004ea0 con 0x562335ba4050 2023-09-23T09:33:55.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.567+0000 7fcd4ea8cb80 10 client.17940 fetch_fsmap learned FSMap version 109 2023-09-23T09:33:55.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.567+0000 7fcd4ea8cb80 1 -- 172.21.15.82:0/349978549 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=109,monmap=4+}) v3 -- 0x7fcd2c009050 con 0x562335ba4050 2023-09-23T09:33:55.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.567+0000 7fcd13fff700 1 -- 172.21.15.82:0/349978549 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcd2803e020 con 0x562335ba4050 2023-09-23T09:33:55.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.568+0000 7fcd13fff700 1 -- 172.21.15.82:0/349978549 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 109) v1 ==== 7942+0+0 (secure 0 0 0) 0x7fcd28024410 con 0x562335ba4050 2023-09-23T09:33:55.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.568+0000 7fcd4ea8cb80 10 client.17940 fetch_fsmap finished waiting for FSMap version 109 2023-09-23T09:33:55.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.568+0000 7fcd4ea8cb80 10 client.17940 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:33:55.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.568+0000 7fcd4ea8cb80 20 client.17940 populate_metadata read hostname 'smithi082' 2023-09-23T09:33:55.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.568+0000 7fcd4ea8cb80 1 --2- 172.21.15.82:0/349978549 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x562335bbdac0 0x562335bbfee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:55.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.568+0000 7fcd4ea8cb80 4 client.17940 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:33:55.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.568+0000 7fcd4ea8cb80 1 -- 172.21.15.82:0/349978549 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562335a97ba0 con 0x562335bbdac0 2023-09-23T09:33:55.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.568+0000 7fcd33fff700 1 --2- 172.21.15.82:0/349978549 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x562335bbdac0 0x562335bbfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:55.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.569+0000 7fcd13fff700 10 client.17940 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:33:55.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.569+0000 7fcd33fff700 1 --2- 172.21.15.82:0/349978549 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x562335bbdac0 0x562335bbfee0 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=95aa70f4fb146ae2 server_cookie=b5db98c0f0a7b285 in_seq=0 out_seq=0 2023-09-23T09:33:55.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.569+0000 7fcd13fff700 1 -- 172.21.15.82:0/349978549 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x562335a97ba0 con 0x562335bbdac0 2023-09-23T09:33:55.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.569+0000 7fcd13fff700 10 client.17940 handle_command_reply: tid=0 2023-09-23T09:33:55.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.570+0000 7fcd4ea8cb80 1 client.17940 shutdown 2023-09-23T09:33:55.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.570+0000 7fcd4ea8cb80 1 -- 172.21.15.82:0/349978549 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562335ba4050 msgr2=0x562335baffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:33:55.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.570+0000 7fcd4ea8cb80 1 --2- 172.21.15.82:0/349978549 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562335ba4050 0x562335baffb0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fcd28006010 tx=0x7fcd28009310 comp rx=0 tx=0).stop 2023-09-23T09:33:55.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.570+0000 7fcd4ea8cb80 1 -- 172.21.15.82:0/349978549 shutdown_connections 2023-09-23T09:33:55.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.570+0000 7fcd4ea8cb80 1 --2- 172.21.15.82:0/349978549 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562335baa0a0 0x562335bad780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:55.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.570+0000 7fcd4ea8cb80 1 --2- 172.21.15.82:0/349978549 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x562335bbdac0 0x562335bbfee0 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:55.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.570+0000 7fcd4ea8cb80 1 --2- 172.21.15.82:0/349978549 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562335ba4050 0x562335baffb0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:55.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.570+0000 7fcd4ea8cb80 1 --2- 172.21.15.82:0/349978549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562335ba9780 0x562335bad1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:55.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.570+0000 7fcd4ea8cb80 1 -- 172.21.15.82:0/349978549 >> 172.21.15.82:0/349978549 conn(0x562335b140e0 msgr2=0x562335b94b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:33:55.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.570+0000 7fcd13fff700 0 client.17940 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:33:55.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.570+0000 7fcd4ea8cb80 1 -- 172.21.15.82:0/349978549 shutdown_connections 2023-09-23T09:33:55.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.570+0000 7fcd4ea8cb80 1 -- 172.21.15.82:0/349978549 wait complete. 2023-09-23T09:33:55.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.570+0000 7fcd4ea8cb80 20 client.17940 trim_cache size 0 max 16384 2023-09-23T09:33:55.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.583+0000 7fcd4ea8cb80 1 Processor -- start 2023-09-23T09:33:55.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.584+0000 7fcd4ea8cb80 1 -- start start 2023-09-23T09:33:55.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.584+0000 7fcd4ea8cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562335ba4050 0x562335ba7450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:55.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.584+0000 7fcd4ea8cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562335ba9780 0x562335bafae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:55.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.584+0000 7fcd4ea8cb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562335baa0a0 0x562335baca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:55.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.584+0000 7fcd4ea8cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562335973920 con 0x562335ba9780 2023-09-23T09:33:55.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.584+0000 7fcd4ea8cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562335b926d0 con 0x562335ba4050 2023-09-23T09:33:55.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.584+0000 7fcd4ea8cb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x562335b96810 con 0x562335baa0a0 2023-09-23T09:33:55.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.584+0000 7fcd33fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562335ba9780 0x562335bafae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:55.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.584+0000 7fcd33fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562335ba9780 0x562335bafae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50354/0 (socket says 172.21.15.82:50354) 2023-09-23T09:33:55.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.584+0000 7fcd33fff700 1 -- 172.21.15.82:0/3650766687 learned_addr learned my addr 172.21.15.82:0/3650766687 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:33:55.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.584+0000 7fcd3979c700 1 --2- 172.21.15.82:0/3650766687 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562335baa0a0 0x562335baca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:55.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.584+0000 7fcd38f9b700 1 --2- 172.21.15.82:0/3650766687 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562335ba4050 0x562335ba7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:55.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.584+0000 7fcd33fff700 1 -- 172.21.15.82:0/3650766687 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562335baa0a0 msgr2=0x562335baca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:33:55.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.584+0000 7fcd33fff700 1 --2- 172.21.15.82:0/3650766687 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562335baa0a0 0x562335baca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:55.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.584+0000 7fcd33fff700 1 -- 172.21.15.82:0/3650766687 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562335ba4050 msgr2=0x562335ba7450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:33:55.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.584+0000 7fcd33fff700 1 --2- 172.21.15.82:0/3650766687 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562335ba4050 0x562335ba7450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:55.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.584+0000 7fcd33fff700 1 -- 172.21.15.82:0/3650766687 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56233591dde0 con 0x562335ba9780 2023-09-23T09:33:55.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.584+0000 7fcd38f9b700 1 --2- 172.21.15.82:0/3650766687 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562335ba4050 0x562335ba7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T09:33:55.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.584+0000 7fcd3979c700 1 --2- 172.21.15.82:0/3650766687 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562335baa0a0 0x562335baca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T09:33:55.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.585+0000 7fcd33fff700 1 --2- 172.21.15.82:0/3650766687 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562335ba9780 0x562335bafae0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fcd20095600 tx=0x7fcd200b8040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f42ba7aaeb9cad server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:33:55.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.585+0000 7fcd1f7fe700 1 -- 172.21.15.82:0/3650766687 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd200984f0 con 0x562335ba9780 2023-09-23T09:33:55.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.585+0000 7fcd1f7fe700 1 -- 172.21.15.82:0/3650766687 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcd200108d0 con 0x562335ba9780 2023-09-23T09:33:55.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.585+0000 7fcd1f7fe700 1 -- 172.21.15.82:0/3650766687 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd200a09a0 con 0x562335ba9780 2023-09-23T09:33:55.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.585+0000 7fcd4ea8cb80 1 -- 172.21.15.82:0/3650766687 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562335ba9780 msgr2=0x562335bafae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:33:55.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.585+0000 7fcd4ea8cb80 1 --2- 172.21.15.82:0/3650766687 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562335ba9780 0x562335bafae0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fcd20095600 tx=0x7fcd200b8040 comp rx=0 tx=0).stop 2023-09-23T09:33:55.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.586+0000 7fcd4ea8cb80 1 -- 172.21.15.82:0/3650766687 shutdown_connections 2023-09-23T09:33:55.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.586+0000 7fcd4ea8cb80 1 --2- 172.21.15.82:0/3650766687 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562335baa0a0 0x562335baca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:55.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.586+0000 7fcd4ea8cb80 1 --2- 172.21.15.82:0/3650766687 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562335ba4050 0x562335ba7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:55.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.586+0000 7fcd4ea8cb80 1 --2- 172.21.15.82:0/3650766687 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562335ba9780 0x562335bafae0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:55.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.586+0000 7fcd4ea8cb80 1 -- 172.21.15.82:0/3650766687 >> 172.21.15.82:0/3650766687 conn(0x562335b140e0 msgr2=0x562335bb9380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:33:55.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.586+0000 7fcd4ea8cb80 1 -- 172.21.15.82:0/3650766687 shutdown_connections 2023-09-23T09:33:55.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.586+0000 7fcd4ea8cb80 1 -- 172.21.15.82:0/3650766687 wait complete. 2023-09-23T09:33:55.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.586+0000 7fcd4ea8cb80 1 -- start start 2023-09-23T09:33:55.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.586+0000 7fcd4ea8cb80 1 Processor -- start 2023-09-23T09:33:55.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.587+0000 7fcd4ea8cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562335ba4050 0x562335ba6690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:55.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.587+0000 7fcd4ea8cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562335ba9780 0x562335ba6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:55.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.587+0000 7fcd4ea8cb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562335baa0a0 0x562335ba51e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:55.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.587+0000 7fcd4ea8cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562335ba5920 con 0x562335ba4050 2023-09-23T09:33:55.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.587+0000 7fcd4ea8cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562335ba5a90 con 0x562335ba9780 2023-09-23T09:33:55.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.587+0000 7fcd4ea8cb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x562335ba5c50 con 0x562335baa0a0 2023-09-23T09:33:55.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.587+0000 7fcd4ea8cb80 10 client.0 _ll_register_callbacks cb 0x7fcd28005730 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:33:55.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.587+0000 7fcd38f9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562335ba4050 0x562335ba6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:55.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.587+0000 7fcd38f9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562335ba4050 0x562335ba6690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50366/0 (socket says 172.21.15.82:50366) 2023-09-23T09:33:55.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.587+0000 7fcd33fff700 1 --2- 172.21.15.82:0/549534816 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562335ba9780 0x562335ba6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:55.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.587+0000 7fcd38f9b700 1 -- 172.21.15.82:0/549534816 learned_addr learned my addr 172.21.15.82:0/549534816 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:33:55.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.587+0000 7fcd3979c700 1 --2- 172.21.15.82:0/549534816 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562335baa0a0 0x562335ba51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:55.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.587+0000 7fcd33fff700 1 -- 172.21.15.82:0/549534816 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562335baa0a0 msgr2=0x562335ba51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:33:55.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.587+0000 7fcd33fff700 1 --2- 172.21.15.82:0/549534816 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562335baa0a0 0x562335ba51e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:55.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.587+0000 7fcd33fff700 1 -- 172.21.15.82:0/549534816 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562335ba4050 msgr2=0x562335ba6690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:33:55.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.587+0000 7fcd33fff700 1 --2- 172.21.15.82:0/549534816 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562335ba4050 0x562335ba6690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:55.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.587+0000 7fcd33fff700 1 -- 172.21.15.82:0/549534816 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd341a36e0 con 0x562335ba9780 2023-09-23T09:33:55.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.587+0000 7fcd38f9b700 1 --2- 172.21.15.82:0/549534816 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562335ba4050 0x562335ba6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:33:55.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.588+0000 7fcd33fff700 1 --2- 172.21.15.82:0/549534816 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562335ba9780 0x562335ba6bd0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fcd20095600 tx=0x7fcd200c8bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b2ce66814e3da4d server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:33:55.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.588+0000 7fcd13fff700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-09-23T09:33:55.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.588+0000 7fcd13fff700 1 -- 172.21.15.82:0/549534816 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd200c9060 con 0x562335ba9780 2023-09-23T09:33:55.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.588+0000 7fcd4ea8cb80 1 -- 172.21.15.82:0/549534816 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562335b928b0 con 0x562335ba9780 2023-09-23T09:33:55.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.588+0000 7fcd13fff700 1 -- 172.21.15.82:0/549534816 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(149..149 src has 1..149) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fcd20099290 con 0x562335ba9780 2023-09-23T09:33:55.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.588+0000 7fcd13fff700 1 -- 172.21.15.82:0/549534816 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=109) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcd200a09a0 con 0x562335ba9780 2023-09-23T09:33:55.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.588+0000 7fcd4ea8cb80 10 client.27671 fetch_fsmap learned FSMap version 109 2023-09-23T09:33:55.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.588+0000 7fcd4ea8cb80 1 -- 172.21.15.82:0/549534816 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=109,monmap=4+}) v3 -- 0x562335906c60 con 0x562335ba9780 2023-09-23T09:33:55.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.588+0000 7fcd13fff700 1 -- 172.21.15.82:0/549534816 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562335b928b0 con 0x562335ba9780 2023-09-23T09:33:55.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.589+0000 7fcd13fff700 1 -- 172.21.15.82:0/549534816 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 109) v1 ==== 7942+0+0 (secure 0 0 0) 0x7fcd200a0510 con 0x562335ba9780 2023-09-23T09:33:55.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.589+0000 7fcd4ea8cb80 10 client.27671 fetch_fsmap finished waiting for FSMap version 109 2023-09-23T09:33:55.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.589+0000 7fcd4ea8cb80 10 client.27671 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:33:55.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.589+0000 7fcd4ea8cb80 20 client.27671 populate_metadata read hostname 'smithi082' 2023-09-23T09:33:55.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.589+0000 7fcd4ea8cb80 1 --2- 172.21.15.82:0/549534816 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x562335c12570 0x562335c14990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:55.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.589+0000 7fcd4ea8cb80 4 client.27671 mds_command: new command op to 24557 tid=0[{"prefix": "damage ls"}] 2023-09-23T09:33:55.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.589+0000 7fcd4ea8cb80 1 -- 172.21.15.82:0/549534816 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x562335aea970 con 0x562335c12570 2023-09-23T09:33:55.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.589+0000 7fcd38f9b700 1 --2- 172.21.15.82:0/549534816 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x562335c12570 0x562335c14990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:55.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.589+0000 7fcd13fff700 10 client.27671 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:33:55.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.589+0000 7fcd38f9b700 1 --2- 172.21.15.82:0/549534816 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x562335c12570 0x562335c14990 crc :-1 s=READY pgs=242 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=492be5901d2a5d47 server_cookie=50058316f3ae0254 in_seq=0 out_seq=0 2023-09-23T09:33:55.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.590+0000 7fcd13fff700 1 -- 172.21.15.82:0/549534816 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x562335aea970 con 0x562335c12570 2023-09-23T09:33:55.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.590+0000 7fcd13fff700 10 client.27671 handle_command_reply: tid=0 2023-09-23T09:33:55.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.590+0000 7fcd4ea8cb80 1 client.27671 shutdown 2023-09-23T09:33:55.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.590+0000 7fcd4ea8cb80 1 -- 172.21.15.82:0/549534816 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562335ba9780 msgr2=0x562335ba6bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:33:55.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.590+0000 7fcd4ea8cb80 1 --2- 172.21.15.82:0/549534816 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562335ba9780 0x562335ba6bd0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fcd20095600 tx=0x7fcd200c8bc0 comp rx=0 tx=0).stop 2023-09-23T09:33:55.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.590+0000 7fcd4ea8cb80 1 -- 172.21.15.82:0/549534816 shutdown_connections 2023-09-23T09:33:55.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.590+0000 7fcd4ea8cb80 1 --2- 172.21.15.82:0/549534816 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562335baa0a0 0x562335ba51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:55.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.590+0000 7fcd4ea8cb80 1 --2- 172.21.15.82:0/549534816 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x562335c12570 0x562335c14990 crc :-1 s=READY pgs=242 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:55.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.590+0000 7fcd4ea8cb80 1 --2- 172.21.15.82:0/549534816 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562335ba4050 0x562335ba6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:55.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.590+0000 7fcd4ea8cb80 1 --2- 172.21.15.82:0/549534816 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562335ba9780 0x562335ba6bd0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:55.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.590+0000 7fcd13fff700 0 client.27671 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:33:55.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.590+0000 7fcd4ea8cb80 1 -- 172.21.15.82:0/549534816 >> 172.21.15.82:0/549534816 conn(0x562335b140e0 msgr2=0x562335ba7450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:33:55.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.590+0000 7fcd4ea8cb80 1 -- 172.21.15.82:0/549534816 shutdown_connections 2023-09-23T09:33:55.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.590+0000 7fcd4ea8cb80 1 -- 172.21.15.82:0/549534816 wait complete. 2023-09-23T09:33:55.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.590+0000 7fcd4ea8cb80 20 client.27671 trim_cache size 0 max 16384 2023-09-23T09:33:55.597 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2023-09-23T09:33:55.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.591+0000 7fcd3b1ff700 1 -- 172.21.15.82:0/134754416 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fcd240a00c0 msgr2=0x7fcd240a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:33:55.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.591+0000 7fcd3b1ff700 1 --2- 172.21.15.82:0/134754416 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fcd240a00c0 0x7fcd240a2580 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x562335baa500 tx=0x7fcd2800b260 comp rx=0 tx=0).stop 2023-09-23T09:33:55.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.591+0000 7fcd3b1ff700 1 -- 172.21.15.82:0/134754416 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd34101230 msgr2=0x7fcd3419cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:33:55.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.591+0000 7fcd3b1ff700 1 --2- 172.21.15.82:0/134754416 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd34101230 0x7fcd3419cc30 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fcd2000d950 tx=0x7fcd2000dc60 comp rx=0 tx=0).stop 2023-09-23T09:33:55.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.591+0000 7fcd3b1ff700 1 -- 172.21.15.82:0/134754416 shutdown_connections 2023-09-23T09:33:55.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.591+0000 7fcd3b1ff700 1 --2- 172.21.15.82:0/134754416 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fcd240a00c0 0x7fcd240a2580 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:55.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.591+0000 7fcd3b1ff700 1 --2- 172.21.15.82:0/134754416 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd34106880 0x7fcd341967b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:55.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.591+0000 7fcd3b1ff700 1 --2- 172.21.15.82:0/134754416 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd34100870 0x7fcd3419c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:55.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.591+0000 7fcd3b1ff700 1 --2- 172.21.15.82:0/134754416 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd34101230 0x7fcd3419cc30 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:55.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.591+0000 7fcd3b1ff700 1 -- 172.21.15.82:0/134754416 >> 172.21.15.82:0/134754416 conn(0x7fcd340fc3a0 msgr2=0x7fcd340fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:33:55.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.591+0000 7fcd3b1ff700 1 -- 172.21.15.82:0/134754416 shutdown_connections 2023-09-23T09:33:55.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:55.591+0000 7fcd3b1ff700 1 -- 172.21.15.82:0/134754416 wait complete. 2023-09-23T09:33:55.828 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 405.0 s, 473.9 tps, lat 211.934 ms stddev 101.336 2023-09-23T09:33:56.610 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-09-23T09:33:56.611 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-09-23T09:33:56.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:56.981+0000 7f95e1dff700 1 -- 172.21.15.82:0/1869407491 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f95dc10d280 msgr2=0x7f95dc10bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:33:56.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:56.981+0000 7f95e1dff700 1 --2- 172.21.15.82:0/1869407491 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f95dc10d280 0x7f95dc10bae0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f95cc00af90 tx=0x7f95cc008850 comp rx=0 tx=0).stop 2023-09-23T09:33:56.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:56.982+0000 7f95e1dff700 1 -- 172.21.15.82:0/1869407491 shutdown_connections 2023-09-23T09:33:56.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:56.982+0000 7f95e1dff700 1 --2- 172.21.15.82:0/1869407491 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95dc076b90 0x7f95dc079050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:56.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:56.982+0000 7f95e1dff700 1 --2- 172.21.15.82:0/1869407491 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f95dc10d280 0x7f95dc10bae0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:56.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:56.982+0000 7f95e1dff700 1 --2- 172.21.15.82:0/1869407491 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95dc10d6f0 0x7f95dc10c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:56.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:56.982+0000 7f95e1dff700 1 -- 172.21.15.82:0/1869407491 >> 172.21.15.82:0/1869407491 conn(0x7f95dc06cbe0 msgr2=0x7f95dc06cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:33:56.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:56.983+0000 7f95e1dff700 1 -- 172.21.15.82:0/1869407491 shutdown_connections 2023-09-23T09:33:56.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:56.983+0000 7f95e1dff700 1 -- 172.21.15.82:0/1869407491 wait complete. 2023-09-23T09:33:56.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:56.984+0000 7f95e1dff700 1 Processor -- start 2023-09-23T09:33:56.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:56.984+0000 7f95e1dff700 1 -- start start 2023-09-23T09:33:56.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:56.985+0000 7f95e1dff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95dc076b90 0x7f95dc082f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:56.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:56.985+0000 7f95e1dff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95dc10d280 0x7f95dc083480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:56.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:56.985+0000 7f95e1dff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f95dc10d6f0 0x7f95dc07cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:56.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:56.985+0000 7f95e1dff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95dc07d790 con 0x7f95dc076b90 2023-09-23T09:33:56.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:56.985+0000 7f95e1dff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95dc07d900 con 0x7f95dc10d280 2023-09-23T09:33:56.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:56.985+0000 7f95e1dff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95dc07dac0 con 0x7f95dc10d6f0 2023-09-23T09:33:56.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:56.985+0000 7f95dbfff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f95dc10d6f0 0x7f95dc07cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:56.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:56.986+0000 7f95dbfff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f95dc10d6f0 0x7f95dc07cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:35034/0 (socket says 172.21.15.82:35034) 2023-09-23T09:33:56.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:56.986+0000 7f95dbfff700 1 -- 172.21.15.82:0/4250692376 learned_addr learned my addr 172.21.15.82:0/4250692376 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:33:56.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:56.986+0000 7f95d2ffd700 1 --2- 172.21.15.82:0/4250692376 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95dc10d280 0x7f95dc083480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:56.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:56.986+0000 7f95dbfff700 1 -- 172.21.15.82:0/4250692376 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95dc10d280 msgr2=0x7f95dc083480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:33:56.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:56.986+0000 7f95dbfff700 1 --2- 172.21.15.82:0/4250692376 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95dc10d280 0x7f95dc083480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:56.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:56.986+0000 7f95dbfff700 1 -- 172.21.15.82:0/4250692376 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95dc076b90 msgr2=0x7f95dc082f40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-23T09:33:56.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:56.986+0000 7f95dbfff700 1 --2- 172.21.15.82:0/4250692376 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95dc076b90 0x7f95dc082f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:56.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:56.986+0000 7f95dbfff700 1 -- 172.21.15.82:0/4250692376 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95cc0081d0 con 0x7f95dc10d6f0 2023-09-23T09:33:56.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:56.987+0000 7f95dbfff700 1 --2- 172.21.15.82:0/4250692376 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f95dc10d6f0 0x7f95dc07cfc0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f95d400b9e0 tx=0x7f95d400bcf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:33:56.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:56.987+0000 7f95d97fa700 1 -- 172.21.15.82:0/4250692376 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d400d8e0 con 0x7f95dc10d6f0 2023-09-23T09:33:56.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:56.987+0000 7f95d97fa700 1 -- 172.21.15.82:0/4250692376 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f95d4015420 con 0x7f95dc10d6f0 2023-09-23T09:33:56.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:56.987+0000 7f95d97fa700 1 -- 172.21.15.82:0/4250692376 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d4014630 con 0x7f95dc10d6f0 2023-09-23T09:33:56.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:56.987+0000 7f95e1dff700 1 -- 172.21.15.82:0/4250692376 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95dc07dda0 con 0x7f95dc10d6f0 2023-09-23T09:33:56.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:56.987+0000 7f95e1dff700 1 -- 172.21.15.82:0/4250692376 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95dc1c3560 con 0x7f95dc10d6f0 2023-09-23T09:33:56.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:56.994+0000 7f95f5794b80 1 Processor -- start 2023-09-23T09:33:56.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:56.995+0000 7f95d97fa700 1 -- 172.21.15.82:0/4250692376 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f95d4015590 con 0x7f95dc10d6f0 2023-09-23T09:33:56.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:56.995+0000 7f95f5794b80 1 -- start start 2023-09-23T09:33:56.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:56.997+0000 7f95f5794b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5570c72c6400 0x5570c72c67e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:56.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:56.997+0000 7f95f5794b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570c72c6d20 0x5570c72c0780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:56.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:56.997+0000 7f95f5794b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5570c72c0cc0 0x5570c72c1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:56.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:56.997+0000 7f95f5794b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570c7228830 con 0x5570c72c6d20 2023-09-23T09:33:56.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:56.997+0000 7f95f5794b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570c7219800 con 0x5570c72c6400 2023-09-23T09:33:56.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:56.997+0000 7f95f5794b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570c7217120 con 0x5570c72c0cc0 2023-09-23T09:33:56.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:56.997+0000 7f95d2ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5570c72c6400 0x5570c72c67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:57.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:56.997+0000 7f95d2ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5570c72c6400 0x5570c72c67e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:44468/0 (socket says 172.21.15.82:44468) 2023-09-23T09:33:57.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:56.997+0000 7f95d2ffd700 1 -- 172.21.15.82:0/154908561 learned_addr learned my addr 172.21.15.82:0/154908561 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:33:57.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:56.997+0000 7f95d2ffd700 1 --2- 172.21.15.82:0/154908561 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5570c72c0cc0 0x5570c72c1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:57.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:56.998+0000 7f95d2ffd700 1 -- 172.21.15.82:0/154908561 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5570c72c0cc0 msgr2=0x5570c72c1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:33:57.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:56.998+0000 7f95d2ffd700 1 --2- 172.21.15.82:0/154908561 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5570c72c0cc0 0x5570c72c1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:57.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:56.998+0000 7f95d2ffd700 1 -- 172.21.15.82:0/154908561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570c72c6d20 msgr2=0x5570c72c0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:33:57.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:56.998+0000 7f95d2ffd700 1 --2- 172.21.15.82:0/154908561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570c72c6d20 0x5570c72c0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:57.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:56.998+0000 7f95d2ffd700 1 -- 172.21.15.82:0/154908561 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5570c70926b0 con 0x5570c72c6400 2023-09-23T09:33:57.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:56.998+0000 7f95d2ffd700 1 --2- 172.21.15.82:0/154908561 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5570c72c6400 0x5570c72c67e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f95c4005ce0 tx=0x7f95c400a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e4fa06ac21ce9bd server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:33:57.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:56.999+0000 7f95d97fa700 1 --2- 172.21.15.82:0/4250692376 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f95c80a0140 0x7f95c80a2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:57.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:56.999+0000 7f95d1ffb700 1 -- 172.21.15.82:0/154908561 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c4004020 con 0x5570c72c6400 2023-09-23T09:33:57.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:56.999+0000 7f95d1ffb700 1 -- 172.21.15.82:0/154908561 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f95c4004830 con 0x5570c72c6400 2023-09-23T09:33:57.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:56.999+0000 7f95d1ffb700 1 -- 172.21.15.82:0/154908561 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c4005280 con 0x5570c72c6400 2023-09-23T09:33:57.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:56.999+0000 7f95d97fa700 1 -- 172.21.15.82:0/4250692376 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f95d4011070 con 0x7f95dc10d6f0 2023-09-23T09:33:57.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:56.999+0000 7f95db7fe700 1 --2- 172.21.15.82:0/4250692376 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f95c80a0140 0x7f95c80a2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:57.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.000+0000 7f95f5794b80 1 -- 172.21.15.82:0/154908561 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5570c72c6400 msgr2=0x5570c72c67e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:33:57.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.000+0000 7f95f5794b80 1 --2- 172.21.15.82:0/154908561 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5570c72c6400 0x5570c72c67e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f95c4005ce0 tx=0x7f95c400a710 comp rx=0 tx=0).stop 2023-09-23T09:33:57.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.000+0000 7f95f5794b80 1 -- 172.21.15.82:0/154908561 shutdown_connections 2023-09-23T09:33:57.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.000+0000 7f95f5794b80 1 --2- 172.21.15.82:0/154908561 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5570c72c0cc0 0x5570c72c1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:57.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.000+0000 7f95f5794b80 1 --2- 172.21.15.82:0/154908561 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5570c72c6400 0x5570c72c67e0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:57.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.000+0000 7f95f5794b80 1 --2- 172.21.15.82:0/154908561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570c72c6d20 0x5570c72c0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:57.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.000+0000 7f95f5794b80 1 -- 172.21.15.82:0/154908561 >> 172.21.15.82:0/154908561 conn(0x5570c7235160 msgr2=0x5570c72bb490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:33:57.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.000+0000 7f95db7fe700 1 --2- 172.21.15.82:0/4250692376 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f95c80a0140 0x7f95c80a2600 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x5570c72c7180 tx=0x7f95cc00d040 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:33:57.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.001+0000 7f95f5794b80 1 -- 172.21.15.82:0/154908561 shutdown_connections 2023-09-23T09:33:57.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.002+0000 7f95f5794b80 1 -- 172.21.15.82:0/154908561 wait complete. 2023-09-23T09:33:57.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.002+0000 7f95f5794b80 1 -- start start 2023-09-23T09:33:57.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.003+0000 7f95f5794b80 1 Processor -- start 2023-09-23T09:33:57.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.004+0000 7f95f5794b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570c72c0cc0 0x5570c72ca020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:57.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.004+0000 7f95f5794b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5570c72c6400 0x5570c72ca560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:57.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.004+0000 7f95f5794b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5570c72c6d20 0x5570c72caaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:57.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.004+0000 7f95f5794b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570c7212a10 con 0x5570c72c0cc0 2023-09-23T09:33:57.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.004+0000 7f95f5794b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570c71b0c30 con 0x5570c72c6400 2023-09-23T09:33:57.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.004+0000 7f95f5794b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570c71b0930 con 0x5570c72c6d20 2023-09-23T09:33:57.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.004+0000 7f95f5794b80 10 client.0 _ll_register_callbacks cb 0x5570c70fab00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:33:57.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.005+0000 7f95dbfff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5570c72c6d20 0x5570c72caaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:57.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.005+0000 7f95dbfff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5570c72c6d20 0x5570c72caaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:35062/0 (socket says 172.21.15.82:35062) 2023-09-23T09:33:57.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.005+0000 7f95dbfff700 1 -- 172.21.15.82:0/3508909505 learned_addr learned my addr 172.21.15.82:0/3508909505 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:33:57.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.006+0000 7f95dbfff700 1 -- 172.21.15.82:0/3508909505 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5570c72c6400 msgr2=0x5570c72ca560 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-23T09:33:57.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.006+0000 7f95dbfff700 1 --2- 172.21.15.82:0/3508909505 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5570c72c6400 0x5570c72ca560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:57.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.006+0000 7f95dbfff700 1 -- 172.21.15.82:0/3508909505 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570c72c0cc0 msgr2=0x5570c72ca020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:33:57.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.006+0000 7f95dbfff700 1 --2- 172.21.15.82:0/3508909505 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570c72c0cc0 0x5570c72ca020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:57.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.006+0000 7f95dbfff700 1 -- 172.21.15.82:0/3508909505 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95c4019040 con 0x5570c72c6d20 2023-09-23T09:33:57.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.006+0000 7f95dbfff700 1 --2- 172.21.15.82:0/3508909505 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5570c72c6d20 0x5570c72caaa0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f95d4094b40 tx=0x7f95d4015870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=358f43ec4b2c621a server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:33:57.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.006+0000 7f95baffd700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T09:33:57.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.007+0000 7f95baffd700 1 -- 172.21.15.82:0/3508909505 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d40832f0 con 0x5570c72c6d20 2023-09-23T09:33:57.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.007+0000 7f95baffd700 1 -- 172.21.15.82:0/3508909505 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(149..149 src has 1..149) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f95d4081e40 con 0x5570c72c6d20 2023-09-23T09:33:57.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.007+0000 7f95f5794b80 1 -- 172.21.15.82:0/3508909505 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5570c7290240 con 0x5570c72c6d20 2023-09-23T09:33:57.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.007+0000 7f95baffd700 1 -- 172.21.15.82:0/3508909505 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=109) v2 ==== 24+0+0 (secure 0 0 0) 0x7f95d4098640 con 0x5570c72c6d20 2023-09-23T09:33:57.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.008+0000 7f95f5794b80 10 client.27709 fetch_fsmap learned FSMap version 109 2023-09-23T09:33:57.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.008+0000 7f95f5794b80 1 -- 172.21.15.82:0/3508909505 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=109,monmap=4+}) v3 -- 0x5570c703ee60 con 0x5570c72c6d20 2023-09-23T09:33:57.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.008+0000 7f95baffd700 1 -- 172.21.15.82:0/3508909505 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5570c7290240 con 0x5570c72c6d20 2023-09-23T09:33:57.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.008+0000 7f95baffd700 1 -- 172.21.15.82:0/3508909505 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 109) v1 ==== 7942+0+0 (secure 0 0 0) 0x7f95d4097b30 con 0x5570c72c6d20 2023-09-23T09:33:57.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.009+0000 7f95f5794b80 10 client.27709 fetch_fsmap finished waiting for FSMap version 109 2023-09-23T09:33:57.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.009+0000 7f95f5794b80 10 client.27709 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:33:57.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.009+0000 7f95f5794b80 20 client.27709 populate_metadata read hostname 'smithi082' 2023-09-23T09:33:57.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.010+0000 7f95f5794b80 1 --2- 172.21.15.82:0/3508909505 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5570c72da860 0x5570c72dcca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:57.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.010+0000 7f95f5794b80 4 client.27709 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:33:57.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.010+0000 7f95f5794b80 1 -- 172.21.15.82:0/3508909505 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5570c71b8c20 con 0x5570c72da860 2023-09-23T09:33:57.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.012+0000 7f95db7fe700 1 --2- 172.21.15.82:0/3508909505 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5570c72da860 0x5570c72dcca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:57.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.013+0000 7f95db7fe700 1 --2- 172.21.15.82:0/3508909505 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5570c72da860 0x5570c72dcca0 crc :-1 s=READY pgs=243 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=71968a215e34cef1 server_cookie=1c16e273d47f2fff in_seq=0 out_seq=0 2023-09-23T09:33:57.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.014+0000 7f95baffd700 10 client.27709 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:33:57.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.014+0000 7f95baffd700 1 -- 172.21.15.82:0/3508909505 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5570c71b8c20 con 0x5570c72da860 2023-09-23T09:33:57.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.014+0000 7f95baffd700 10 client.27709 handle_command_reply: tid=0 2023-09-23T09:33:57.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.014+0000 7f95f5794b80 1 client.27709 shutdown 2023-09-23T09:33:57.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.015+0000 7f95f5794b80 1 -- 172.21.15.82:0/3508909505 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5570c72c6d20 msgr2=0x5570c72caaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:33:57.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.015+0000 7f95f5794b80 1 --2- 172.21.15.82:0/3508909505 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5570c72c6d20 0x5570c72caaa0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f95d4094b40 tx=0x7f95d4015870 comp rx=0 tx=0).stop 2023-09-23T09:33:57.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.015+0000 7f95f5794b80 1 -- 172.21.15.82:0/3508909505 shutdown_connections 2023-09-23T09:33:57.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.015+0000 7f95f5794b80 1 --2- 172.21.15.82:0/3508909505 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5570c72c6d20 0x5570c72caaa0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:57.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.015+0000 7f95f5794b80 1 --2- 172.21.15.82:0/3508909505 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5570c72da860 0x5570c72dcca0 crc :-1 s=READY pgs=243 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:57.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.015+0000 7f95f5794b80 1 --2- 172.21.15.82:0/3508909505 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570c72c0cc0 0x5570c72ca020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:57.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.015+0000 7f95f5794b80 1 --2- 172.21.15.82:0/3508909505 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5570c72c6400 0x5570c72ca560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:57.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.015+0000 7f95f5794b80 1 -- 172.21.15.82:0/3508909505 >> 172.21.15.82:0/3508909505 conn(0x5570c7235160 msgr2=0x5570c72b5bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:33:57.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.016+0000 7f95baffd700 0 client.27709 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:33:57.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.016+0000 7f95f5794b80 1 -- 172.21.15.82:0/3508909505 shutdown_connections 2023-09-23T09:33:57.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.016+0000 7f95f5794b80 1 -- 172.21.15.82:0/3508909505 wait complete. 2023-09-23T09:33:57.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.016+0000 7f95f5794b80 20 client.27709 trim_cache size 0 max 16384 2023-09-23T09:33:57.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.060+0000 7f95f5794b80 1 Processor -- start 2023-09-23T09:33:57.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.060+0000 7f95f5794b80 1 -- start start 2023-09-23T09:33:57.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.061+0000 7f95f5794b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5570c72c0cc0 0x5570c72c0780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:57.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.061+0000 7f95f5794b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5570c72c6400 0x5570c72d1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:57.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.061+0000 7f95f5794b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570c72c6d20 0x5570c72c9880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:57.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.061+0000 7f95f5794b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570c70949a0 con 0x5570c72c6d20 2023-09-23T09:33:57.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.061+0000 7f95f5794b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570c72b7d50 con 0x5570c72c6400 2023-09-23T09:33:57.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.061+0000 7f95f5794b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570c72cb600 con 0x5570c72c0cc0 2023-09-23T09:33:57.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.062+0000 7f95db7fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5570c72c0cc0 0x5570c72c0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:57.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.062+0000 7f95db7fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5570c72c0cc0 0x5570c72c0780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:35076/0 (socket says 172.21.15.82:35076) 2023-09-23T09:33:57.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.062+0000 7f95db7fe700 1 -- 172.21.15.82:0/2246298580 learned_addr learned my addr 172.21.15.82:0/2246298580 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:33:57.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.062+0000 7f95dbfff700 1 --2- 172.21.15.82:0/2246298580 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570c72c6d20 0x5570c72c9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:57.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.062+0000 7f95d2ffd700 1 --2- 172.21.15.82:0/2246298580 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5570c72c6400 0x5570c72d1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:57.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.062+0000 7f95db7fe700 1 -- 172.21.15.82:0/2246298580 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5570c72c6400 msgr2=0x5570c72d1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:33:57.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.062+0000 7f95db7fe700 1 --2- 172.21.15.82:0/2246298580 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5570c72c6400 0x5570c72d1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:57.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.062+0000 7f95db7fe700 1 -- 172.21.15.82:0/2246298580 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570c72c6d20 msgr2=0x5570c72c9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:33:57.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.062+0000 7f95db7fe700 1 --2- 172.21.15.82:0/2246298580 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570c72c6d20 0x5570c72c9880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:57.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.062+0000 7f95db7fe700 1 -- 172.21.15.82:0/2246298580 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5570c7027ce0 con 0x5570c72c0cc0 2023-09-23T09:33:57.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.062+0000 7f95dbfff700 1 --2- 172.21.15.82:0/2246298580 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570c72c6d20 0x5570c72c9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:33:57.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.063+0000 7f95db7fe700 1 --2- 172.21.15.82:0/2246298580 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5570c72c0cc0 0x5570c72c0780 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f95cc018000 tx=0x7f95cc00acb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34f5978afb8aa8cd server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:33:57.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.064+0000 7f95d27fc700 1 -- 172.21.15.82:0/2246298580 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95cc00bea0 con 0x5570c72c0cc0 2023-09-23T09:33:57.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.064+0000 7f95d27fc700 1 -- 172.21.15.82:0/2246298580 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f95cc02a160 con 0x5570c72c0cc0 2023-09-23T09:33:57.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.064+0000 7f95d27fc700 1 -- 172.21.15.82:0/2246298580 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95cc00a670 con 0x5570c72c0cc0 2023-09-23T09:33:57.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.065+0000 7f95f5794b80 1 -- 172.21.15.82:0/2246298580 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5570c72c0cc0 msgr2=0x5570c72c0780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:33:57.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.065+0000 7f95f5794b80 1 --2- 172.21.15.82:0/2246298580 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5570c72c0cc0 0x5570c72c0780 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f95cc018000 tx=0x7f95cc00acb0 comp rx=0 tx=0).stop 2023-09-23T09:33:57.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.065+0000 7f95f5794b80 1 -- 172.21.15.82:0/2246298580 shutdown_connections 2023-09-23T09:33:57.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.066+0000 7f95f5794b80 1 --2- 172.21.15.82:0/2246298580 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570c72c6d20 0x5570c72c9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:57.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.066+0000 7f95f5794b80 1 --2- 172.21.15.82:0/2246298580 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5570c72c0cc0 0x5570c72c0780 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:57.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.066+0000 7f95f5794b80 1 --2- 172.21.15.82:0/2246298580 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5570c72c6400 0x5570c72d1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:57.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.066+0000 7f95f5794b80 1 -- 172.21.15.82:0/2246298580 >> 172.21.15.82:0/2246298580 conn(0x5570c7235160 msgr2=0x5570c72b5bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:33:57.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.067+0000 7f95f5794b80 1 -- 172.21.15.82:0/2246298580 shutdown_connections 2023-09-23T09:33:57.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.068+0000 7f95f5794b80 1 -- 172.21.15.82:0/2246298580 wait complete. 2023-09-23T09:33:57.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.068+0000 7f95f5794b80 1 -- start start 2023-09-23T09:33:57.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.069+0000 7f95f5794b80 1 Processor -- start 2023-09-23T09:33:57.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.069+0000 7f95f5794b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5570c72c0cc0 0x5570c72cffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:57.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.069+0000 7f95f5794b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5570c72c6400 0x5570c72d0500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:57.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.069+0000 7f95f5794b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570c72c6d20 0x5570c72d0a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:57.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.069+0000 7f95f5794b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570c732e790 con 0x5570c72c6d20 2023-09-23T09:33:57.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.069+0000 7f95f5794b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570c732e8d0 con 0x5570c72c0cc0 2023-09-23T09:33:57.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.069+0000 7f95f5794b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570c732ea90 con 0x5570c72c6400 2023-09-23T09:33:57.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.069+0000 7f95f5794b80 10 client.0 _ll_register_callbacks cb 0x7f95d4098180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:33:57.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.070+0000 7f95db7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5570c72c0cc0 0x5570c72cffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:57.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.070+0000 7f95db7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5570c72c0cc0 0x5570c72cffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:44502/0 (socket says 172.21.15.82:44502) 2023-09-23T09:33:57.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.070+0000 7f95db7fe700 1 -- 172.21.15.82:0/424043127 learned_addr learned my addr 172.21.15.82:0/424043127 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:33:57.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.070+0000 7f95dbfff700 1 --2- 172.21.15.82:0/424043127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570c72c6d20 0x5570c72d0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:57.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.070+0000 7f95dbfff700 1 -- 172.21.15.82:0/424043127 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5570c72c6400 msgr2=0x5570c72d0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:33:57.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.070+0000 7f95dbfff700 1 --2- 172.21.15.82:0/424043127 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5570c72c6400 0x5570c72d0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:57.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.070+0000 7f95dbfff700 1 -- 172.21.15.82:0/424043127 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5570c72c0cc0 msgr2=0x5570c72cffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:33:57.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.070+0000 7f95dbfff700 1 --2- 172.21.15.82:0/424043127 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5570c72c0cc0 0x5570c72cffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:57.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.070+0000 7f95dbfff700 1 -- 172.21.15.82:0/424043127 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5570c703ee60 con 0x5570c72c6d20 2023-09-23T09:33:57.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.071+0000 7f95dbfff700 1 --2- 172.21.15.82:0/424043127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570c72c6d20 0x5570c72d0a40 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f95d40c8c80 tx=0x7f95d4094980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9c9e508849259b8 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:33:57.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.071+0000 7f95baffd700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:33:57.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.071+0000 7f95baffd700 1 -- 172.21.15.82:0/424043127 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d409ffc0 con 0x5570c72c6d20 2023-09-23T09:33:57.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.071+0000 7f95baffd700 1 -- 172.21.15.82:0/424043127 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(149..149 src has 1..149) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f95d4081e40 con 0x5570c72c6d20 2023-09-23T09:33:57.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.071+0000 7f95f5794b80 1 -- 172.21.15.82:0/424043127 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5570c72b3930 con 0x5570c72c6d20 2023-09-23T09:33:57.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.072+0000 7f95baffd700 1 -- 172.21.15.82:0/424043127 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=109) v2 ==== 24+0+0 (secure 0 0 0) 0x7f95d4098640 con 0x5570c72c6d20 2023-09-23T09:33:57.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.072+0000 7f95f5794b80 10 client.17952 fetch_fsmap learned FSMap version 109 2023-09-23T09:33:57.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.072+0000 7f95f5794b80 1 -- 172.21.15.82:0/424043127 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=109,monmap=4+}) v3 -- 0x7f95dc079a80 con 0x5570c72c6d20 2023-09-23T09:33:57.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.072+0000 7f95baffd700 1 -- 172.21.15.82:0/424043127 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5570c72b3930 con 0x5570c72c6d20 2023-09-23T09:33:57.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.072+0000 7f95baffd700 1 -- 172.21.15.82:0/424043127 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 109) v1 ==== 7942+0+0 (secure 0 0 0) 0x7f95d40c82e0 con 0x5570c72c6d20 2023-09-23T09:33:57.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.073+0000 7f95f5794b80 10 client.17952 fetch_fsmap finished waiting for FSMap version 109 2023-09-23T09:33:57.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.073+0000 7f95f5794b80 10 client.17952 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:33:57.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.073+0000 7f95f5794b80 20 client.17952 populate_metadata read hostname 'smithi082' 2023-09-23T09:33:57.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.073+0000 7f95f5794b80 1 --2- 172.21.15.82:0/424043127 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5570c732ff90 0x5570c73323b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:57.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.073+0000 7f95f5794b80 4 client.17952 mds_command: new command op to 24557 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-09-23T09:33:57.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.073+0000 7f95f5794b80 1 -- 172.21.15.82:0/424043127 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x5570c720b9f0 con 0x5570c732ff90 2023-09-23T09:33:57.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.074+0000 7f95db7fe700 1 --2- 172.21.15.82:0/424043127 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5570c732ff90 0x5570c73323b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:57.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.076+0000 7f95db7fe700 1 --2- 172.21.15.82:0/424043127 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5570c732ff90 0x5570c73323b0 crc :-1 s=READY pgs=244 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea300e36c92dc19b server_cookie=d847c26b3d3e625 in_seq=0 out_seq=0 2023-09-23T09:33:57.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.076+0000 7f95baffd700 10 client.17952 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:33:57.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.077+0000 7f95baffd700 1 -- 172.21.15.82:0/424043127 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5570c720b9f0 con 0x5570c732ff90 2023-09-23T09:33:57.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.077+0000 7f95baffd700 10 client.17952 handle_command_reply: tid=0 2023-09-23T09:33:57.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.077+0000 7f95f5794b80 1 client.17952 shutdown 2023-09-23T09:33:57.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.079+0000 7f95f5794b80 1 -- 172.21.15.82:0/424043127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570c72c6d20 msgr2=0x5570c72d0a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:33:57.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.079+0000 7f95f5794b80 1 --2- 172.21.15.82:0/424043127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570c72c6d20 0x5570c72d0a40 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f95d40c8c80 tx=0x7f95d4094980 comp rx=0 tx=0).stop 2023-09-23T09:33:57.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.079+0000 7f95f5794b80 1 -- 172.21.15.82:0/424043127 shutdown_connections 2023-09-23T09:33:57.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.079+0000 7f95f5794b80 1 --2- 172.21.15.82:0/424043127 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5570c732ff90 0x5570c73323b0 crc :-1 s=READY pgs=244 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:57.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.079+0000 7f95f5794b80 1 --2- 172.21.15.82:0/424043127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570c72c6d20 0x5570c72d0a40 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:57.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.079+0000 7f95f5794b80 1 --2- 172.21.15.82:0/424043127 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5570c72c0cc0 0x5570c72cffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:57.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.079+0000 7f95f5794b80 1 --2- 172.21.15.82:0/424043127 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5570c72c6400 0x5570c72d0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:57.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.079+0000 7f95f5794b80 1 -- 172.21.15.82:0/424043127 >> 172.21.15.82:0/424043127 conn(0x5570c7235160 msgr2=0x5570c72ca880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:33:57.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.079+0000 7f95baffd700 0 client.17952 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:33:57.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.080+0000 7f95f5794b80 1 -- 172.21.15.82:0/424043127 shutdown_connections 2023-09-23T09:33:57.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.080+0000 7f95f5794b80 1 -- 172.21.15.82:0/424043127 wait complete. 2023-09-23T09:33:57.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.081+0000 7f95f5794b80 20 client.17952 trim_cache size 0 max 16384 2023-09-23T09:33:57.083 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:33:57.083 INFO:teuthology.orchestra.run.smithi082.stdout: "return_code": 0, 2023-09-23T09:33:57.083 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_tag": "d9e62ab8-1468-4fb0-a9fe-61bed13e954b", 2023-09-23T09:33:57.083 INFO:teuthology.orchestra.run.smithi082.stdout: "mode": "asynchronous" 2023-09-23T09:33:57.083 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:33:57.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.082+0000 7f95e1dff700 1 -- 172.21.15.82:0/4250692376 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f95c80a0140 msgr2=0x7f95c80a2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:33:57.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.082+0000 7f95e1dff700 1 --2- 172.21.15.82:0/4250692376 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f95c80a0140 0x7f95c80a2600 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x5570c72c7180 tx=0x7f95cc00d040 comp rx=0 tx=0).stop 2023-09-23T09:33:57.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.082+0000 7f95e1dff700 1 -- 172.21.15.82:0/4250692376 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f95dc10d6f0 msgr2=0x7f95dc07cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:33:57.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.082+0000 7f95e1dff700 1 --2- 172.21.15.82:0/4250692376 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f95dc10d6f0 0x7f95dc07cfc0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f95d400b9e0 tx=0x7f95d400bcf0 comp rx=0 tx=0).stop 2023-09-23T09:33:57.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.082+0000 7f95e1dff700 1 -- 172.21.15.82:0/4250692376 shutdown_connections 2023-09-23T09:33:57.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.082+0000 7f95e1dff700 1 --2- 172.21.15.82:0/4250692376 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f95c80a0140 0x7f95c80a2600 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:57.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.082+0000 7f95e1dff700 1 --2- 172.21.15.82:0/4250692376 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f95dc10d6f0 0x7f95dc07cfc0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:57.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.082+0000 7f95e1dff700 1 --2- 172.21.15.82:0/4250692376 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95dc076b90 0x7f95dc082f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:57.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.082+0000 7f95e1dff700 1 --2- 172.21.15.82:0/4250692376 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95dc10d280 0x7f95dc083480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:57.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.082+0000 7f95e1dff700 1 -- 172.21.15.82:0/4250692376 >> 172.21.15.82:0/4250692376 conn(0x7f95dc06cbe0 msgr2=0x7f95dc071b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:33:57.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.083+0000 7f95e1dff700 1 -- 172.21.15.82:0/4250692376 shutdown_connections 2023-09-23T09:33:57.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.083+0000 7f95e1dff700 1 -- 172.21.15.82:0/4250692376 wait complete. 2023-09-23T09:33:57.113 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:33:56 smithi082 ceph-mon[97694]: pgmap v1174: 97 pgs: 97 active+clean; 16 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 3.8 MiB/s rd, 15 MiB/s wr, 1.38k op/s 2023-09-23T09:33:57.116 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:33:57.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:33:56 smithi161 ceph-mon[99580]: pgmap v1174: 97 pgs: 97 active+clean; 16 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 3.8 MiB/s rd, 15 MiB/s wr, 1.38k op/s 2023-09-23T09:33:57.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:33:56 smithi135 ceph-mon[99205]: pgmap v1174: 97 pgs: 97 active+clean; 16 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 3.8 MiB/s rd, 15 MiB/s wr, 1.38k op/s 2023-09-23T09:33:57.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.494+0000 7fc253dff700 1 -- 172.21.15.82:0/1288041710 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc24c107a00 msgr2=0x7fc24c113d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:33:57.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.494+0000 7fc253dff700 1 --2- 172.21.15.82:0/1288041710 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc24c107a00 0x7fc24c113d60 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fc23c0098f0 tx=0x7fc23c009c00 comp rx=0 tx=0).stop 2023-09-23T09:33:57.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.495+0000 7fc253dff700 1 -- 172.21.15.82:0/1288041710 shutdown_connections 2023-09-23T09:33:57.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.495+0000 7fc253dff700 1 --2- 172.21.15.82:0/1288041710 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc24c107a00 0x7fc24c113d60 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:57.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.495+0000 7fc253dff700 1 --2- 172.21.15.82:0/1288041710 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc24c10cfc0 0x7fc24c10d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:57.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.495+0000 7fc253dff700 1 --2- 172.21.15.82:0/1288041710 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc24c107040 0x7fc24c1074c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:57.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.495+0000 7fc253dff700 1 -- 172.21.15.82:0/1288041710 >> 172.21.15.82:0/1288041710 conn(0x7fc24c0767c0 msgr2=0x7fc24c105740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:33:57.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.495+0000 7fc253dff700 1 -- 172.21.15.82:0/1288041710 shutdown_connections 2023-09-23T09:33:57.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.495+0000 7fc253dff700 1 -- 172.21.15.82:0/1288041710 wait complete. 2023-09-23T09:33:57.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.497+0000 7fc253dff700 1 Processor -- start 2023-09-23T09:33:57.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.497+0000 7fc253dff700 1 -- start start 2023-09-23T09:33:57.500 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.497+0000 7fc253dff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc24c107040 0x7fc24c19cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:57.500 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.498+0000 7fc253dff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc24c107a00 0x7fc24c19d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:57.500 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.498+0000 7fc253dff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc24c10cfc0 0x7fc24c1a18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:57.500 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.498+0000 7fc253dff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc24c1a1f30 con 0x7fc24c107a00 2023-09-23T09:33:57.500 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.498+0000 7fc253dff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc24c1a20a0 con 0x7fc24c107040 2023-09-23T09:33:57.500 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.498+0000 7fc253dff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc24c1a2260 con 0x7fc24c10cfc0 2023-09-23T09:33:57.500 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.498+0000 7fc251b9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc24c107040 0x7fc24c19cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:57.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.498+0000 7fc251b9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc24c107040 0x7fc24c19cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:44524/0 (socket says 172.21.15.82:44524) 2023-09-23T09:33:57.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.498+0000 7fc251b9b700 1 -- 172.21.15.82:0/3713296297 learned_addr learned my addr 172.21.15.82:0/3713296297 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:33:57.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.499+0000 7fc25239c700 1 --2- 172.21.15.82:0/3713296297 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc24c10cfc0 0x7fc24c1a18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:57.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.499+0000 7fc251b9b700 1 -- 172.21.15.82:0/3713296297 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc24c10cfc0 msgr2=0x7fc24c1a18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:33:57.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.499+0000 7fc251b9b700 1 --2- 172.21.15.82:0/3713296297 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc24c10cfc0 0x7fc24c1a18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:57.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.499+0000 7fc251b9b700 1 -- 172.21.15.82:0/3713296297 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc24c107a00 msgr2=0x7fc24c19d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:33:57.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.499+0000 7fc251b9b700 1 --2- 172.21.15.82:0/3713296297 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc24c107a00 0x7fc24c19d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:57.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.499+0000 7fc251b9b700 1 -- 172.21.15.82:0/3713296297 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc23c009520 con 0x7fc24c107040 2023-09-23T09:33:57.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.499+0000 7fc25239c700 1 --2- 172.21.15.82:0/3713296297 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc24c10cfc0 0x7fc24c1a18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:33:57.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.500+0000 7fc251b9b700 1 --2- 172.21.15.82:0/3713296297 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc24c107040 0x7fc24c19cf50 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fc24400ba50 tx=0x7fc24400be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:33:57.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.501+0000 7fc242ffd700 1 -- 172.21.15.82:0/3713296297 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc24400cab0 con 0x7fc24c107040 2023-09-23T09:33:57.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.501+0000 7fc242ffd700 1 -- 172.21.15.82:0/3713296297 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc24400cc10 con 0x7fc24c107040 2023-09-23T09:33:57.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.501+0000 7fc242ffd700 1 -- 172.21.15.82:0/3713296297 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2440075b0 con 0x7fc24c107040 2023-09-23T09:33:57.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.502+0000 7fc253dff700 1 -- 172.21.15.82:0/3713296297 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc24c1a2540 con 0x7fc24c107040 2023-09-23T09:33:57.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.502+0000 7fc253dff700 1 -- 172.21.15.82:0/3713296297 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc24c0793d0 con 0x7fc24c107040 2023-09-23T09:33:57.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.510+0000 7fc267735b80 1 Processor -- start 2023-09-23T09:33:57.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.510+0000 7fc267735b80 1 -- start start 2023-09-23T09:33:57.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.511+0000 7fc267735b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557c34b1c380 0x557c34b1c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:57.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.511+0000 7fc267735b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x557c34b1cca0 0x557c34b16700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:57.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.511+0000 7fc267735b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557c34b16c40 0x557c34b170a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:57.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.511+0000 7fc267735b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c34a7e7b0 con 0x557c34b1c380 2023-09-23T09:33:57.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.511+0000 7fc267735b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c34a6f780 con 0x557c34b16c40 2023-09-23T09:33:57.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.511+0000 7fc267735b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c34a6d0a0 con 0x557c34b1cca0 2023-09-23T09:33:57.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.512+0000 7fc251b9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x557c34b1cca0 0x557c34b16700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:57.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.512+0000 7fc242ffd700 1 -- 172.21.15.82:0/3713296297 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7fc244014440 con 0x7fc24c107040 2023-09-23T09:33:57.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.512+0000 7fc251b9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x557c34b1cca0 0x557c34b16700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:35092/0 (socket says 172.21.15.82:35092) 2023-09-23T09:33:57.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.512+0000 7fc251b9b700 1 -- 172.21.15.82:0/3955210068 learned_addr learned my addr 172.21.15.82:0/3955210068 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:33:57.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.512+0000 7fc25139a700 1 --2- 172.21.15.82:0/3955210068 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557c34b16c40 0x557c34b170a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:57.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.513+0000 7fc251b9b700 1 -- 172.21.15.82:0/3955210068 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557c34b16c40 msgr2=0x557c34b170a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:33:57.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.513+0000 7fc251b9b700 1 --2- 172.21.15.82:0/3955210068 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557c34b16c40 0x557c34b170a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:57.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.513+0000 7fc251b9b700 1 -- 172.21.15.82:0/3955210068 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557c34b1c380 msgr2=0x557c34b1c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:33:57.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.513+0000 7fc251b9b700 1 --2- 172.21.15.82:0/3955210068 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557c34b1c380 0x557c34b1c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:57.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.513+0000 7fc251b9b700 1 -- 172.21.15.82:0/3955210068 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557c348e8630 con 0x557c34b1cca0 2023-09-23T09:33:57.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.513+0000 7fc251b9b700 1 --2- 172.21.15.82:0/3955210068 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x557c34b1cca0 0x557c34b16700 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc2440c86d0 tx=0x7fc2440cee20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4dabdb1765014a2 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:33:57.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.514+0000 7fc237fff700 1 -- 172.21.15.82:0/3955210068 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2440d3b20 con 0x557c34b1cca0 2023-09-23T09:33:57.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.514+0000 7fc237fff700 1 -- 172.21.15.82:0/3955210068 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc2440d3c80 con 0x557c34b1cca0 2023-09-23T09:33:57.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.514+0000 7fc237fff700 1 -- 172.21.15.82:0/3955210068 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2440d8600 con 0x557c34b1cca0 2023-09-23T09:33:57.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.515+0000 7fc242ffd700 1 --2- 172.21.15.82:0/3713296297 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fc2380a0200 0x7fc2380a26c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:57.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.515+0000 7fc242ffd700 1 -- 172.21.15.82:0/3713296297 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fc2440caf90 con 0x7fc24c107040 2023-09-23T09:33:57.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.516+0000 7fc267735b80 1 -- 172.21.15.82:0/3955210068 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x557c34b1cca0 msgr2=0x557c34b16700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:33:57.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.516+0000 7fc267735b80 1 --2- 172.21.15.82:0/3955210068 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x557c34b1cca0 0x557c34b16700 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc2440c86d0 tx=0x7fc2440cee20 comp rx=0 tx=0).stop 2023-09-23T09:33:57.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.517+0000 7fc267735b80 1 -- 172.21.15.82:0/3955210068 shutdown_connections 2023-09-23T09:33:57.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.517+0000 7fc267735b80 1 --2- 172.21.15.82:0/3955210068 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557c34b16c40 0x557c34b170a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:57.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.517+0000 7fc267735b80 1 --2- 172.21.15.82:0/3955210068 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557c34b1c380 0x557c34b1c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:57.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.517+0000 7fc267735b80 1 --2- 172.21.15.82:0/3955210068 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x557c34b1cca0 0x557c34b16700 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:57.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.517+0000 7fc267735b80 1 -- 172.21.15.82:0/3955210068 >> 172.21.15.82:0/3955210068 conn(0x557c34a8b0e0 msgr2=0x557c34b11410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:33:57.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.517+0000 7fc25239c700 1 --2- 172.21.15.82:0/3713296297 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fc2380a0200 0x7fc2380a26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:57.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.519+0000 7fc25239c700 1 --2- 172.21.15.82:0/3713296297 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fc2380a0200 0x7fc2380a26c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc23c00c010 tx=0x7fc23c010ca0 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:33:57.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.520+0000 7fc267735b80 1 -- 172.21.15.82:0/3955210068 shutdown_connections 2023-09-23T09:33:57.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.520+0000 7fc267735b80 1 -- 172.21.15.82:0/3955210068 wait complete. 2023-09-23T09:33:57.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.520+0000 7fc267735b80 1 -- start start 2023-09-23T09:33:57.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.521+0000 7fc267735b80 1 Processor -- start 2023-09-23T09:33:57.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.522+0000 7fc267735b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557c34b16c40 0x557c34b22c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:57.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.522+0000 7fc267735b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557c34b1c380 0x557c34b1fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:57.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.522+0000 7fc267735b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x557c34b1cca0 0x557c34b20610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:57.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.522+0000 7fc267735b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c34a68990 con 0x557c34b16c40 2023-09-23T09:33:57.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.522+0000 7fc267735b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c34a06bb0 con 0x557c34b1c380 2023-09-23T09:33:57.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.522+0000 7fc267735b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c34a068b0 con 0x557c34b1cca0 2023-09-23T09:33:57.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.522+0000 7fc267735b80 10 client.0 _ll_register_callbacks cb 0x557c34950a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:33:57.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.523+0000 7fc251b9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557c34b16c40 0x557c34b22c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:57.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.523+0000 7fc251b9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557c34b16c40 0x557c34b22c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50422/0 (socket says 172.21.15.82:50422) 2023-09-23T09:33:57.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.523+0000 7fc251b9b700 1 -- 172.21.15.82:0/2580641355 learned_addr learned my addr 172.21.15.82:0/2580641355 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:33:57.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.523+0000 7fc25139a700 1 --2- 172.21.15.82:0/2580641355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557c34b1c380 0x557c34b1fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:57.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.523+0000 7fc25239c700 1 --2- 172.21.15.82:0/2580641355 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x557c34b1cca0 0x557c34b20610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:57.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.524+0000 7fc251b9b700 1 -- 172.21.15.82:0/2580641355 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x557c34b1cca0 msgr2=0x557c34b20610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:33:57.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.524+0000 7fc251b9b700 1 --2- 172.21.15.82:0/2580641355 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x557c34b1cca0 0x557c34b20610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:57.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.524+0000 7fc251b9b700 1 -- 172.21.15.82:0/2580641355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557c34b1c380 msgr2=0x557c34b1fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:33:57.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.524+0000 7fc251b9b700 1 --2- 172.21.15.82:0/2580641355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557c34b1c380 0x557c34b1fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:57.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.524+0000 7fc251b9b700 1 -- 172.21.15.82:0/2580641355 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc24c0793d0 con 0x557c34b16c40 2023-09-23T09:33:57.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.524+0000 7fc25139a700 1 --2- 172.21.15.82:0/2580641355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557c34b1c380 0x557c34b1fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:33:57.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.524+0000 7fc251b9b700 1 --2- 172.21.15.82:0/2580641355 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557c34b16c40 0x557c34b22c50 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fc2440951c0 tx=0x7fc24400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e753df1f496f1b61 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:33:57.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.525+0000 7fc2357fa700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:33:57.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.525+0000 7fc2357fa700 1 -- 172.21.15.82:0/2580641355 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2440c8700 con 0x557c34b16c40 2023-09-23T09:33:57.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.525+0000 7fc2357fa700 1 -- 172.21.15.82:0/2580641355 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(149..149 src has 1..149) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fc244098e50 con 0x557c34b16c40 2023-09-23T09:33:57.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.525+0000 7fc267735b80 1 -- 172.21.15.82:0/2580641355 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557c34ae61c0 con 0x557c34b16c40 2023-09-23T09:33:57.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.526+0000 7fc2357fa700 1 -- 172.21.15.82:0/2580641355 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=109) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc2440d9bf0 con 0x557c34b16c40 2023-09-23T09:33:57.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.526+0000 7fc267735b80 10 client.17955 fetch_fsmap learned FSMap version 109 2023-09-23T09:33:57.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.526+0000 7fc267735b80 1 -- 172.21.15.82:0/2580641355 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=109,monmap=4+}) v3 -- 0x557c34894de0 con 0x557c34b16c40 2023-09-23T09:33:57.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.527+0000 7fc2357fa700 1 -- 172.21.15.82:0/2580641355 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x557c34ae61c0 con 0x557c34b16c40 2023-09-23T09:33:57.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.527+0000 7fc2357fa700 1 -- 172.21.15.82:0/2580641355 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 109) v1 ==== 7942+0+0 (secure 0 0 0) 0x7fc2440c8900 con 0x557c34b16c40 2023-09-23T09:33:57.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.527+0000 7fc267735b80 10 client.17955 fetch_fsmap finished waiting for FSMap version 109 2023-09-23T09:33:57.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.527+0000 7fc267735b80 10 client.17955 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:33:57.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.527+0000 7fc267735b80 20 client.17955 populate_metadata read hostname 'smithi082' 2023-09-23T09:33:57.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.527+0000 7fc267735b80 1 --2- 172.21.15.82:0/2580641355 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x557c34b30220 0x557c34b32610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:57.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.527+0000 7fc267735b80 4 client.17955 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:33:57.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.527+0000 7fc267735b80 1 -- 172.21.15.82:0/2580641355 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557c34a0eba0 con 0x557c34b30220 2023-09-23T09:33:57.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.528+0000 7fc25139a700 1 --2- 172.21.15.82:0/2580641355 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x557c34b30220 0x557c34b32610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:57.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.529+0000 7fc2357fa700 10 client.17955 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:33:57.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.529+0000 7fc25139a700 1 --2- 172.21.15.82:0/2580641355 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x557c34b30220 0x557c34b32610 crc :-1 s=READY pgs=245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1650a6a63897b82c server_cookie=78b18ed7bf6d967c in_seq=0 out_seq=0 2023-09-23T09:33:57.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.531+0000 7fc2357fa700 1 -- 172.21.15.82:0/2580641355 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x557c34a0eba0 con 0x557c34b30220 2023-09-23T09:33:57.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.531+0000 7fc2357fa700 10 client.17955 handle_command_reply: tid=0 2023-09-23T09:33:57.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.531+0000 7fc267735b80 1 client.17955 shutdown 2023-09-23T09:33:57.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.531+0000 7fc267735b80 1 -- 172.21.15.82:0/2580641355 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557c34b16c40 msgr2=0x557c34b22c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:33:57.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.531+0000 7fc267735b80 1 --2- 172.21.15.82:0/2580641355 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557c34b16c40 0x557c34b22c50 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fc2440951c0 tx=0x7fc24400c520 comp rx=0 tx=0).stop 2023-09-23T09:33:57.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.533+0000 7fc267735b80 1 -- 172.21.15.82:0/2580641355 shutdown_connections 2023-09-23T09:33:57.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.533+0000 7fc267735b80 1 --2- 172.21.15.82:0/2580641355 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x557c34b1cca0 0x557c34b20610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:57.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.533+0000 7fc267735b80 1 --2- 172.21.15.82:0/2580641355 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x557c34b30220 0x557c34b32610 crc :-1 s=READY pgs=245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:57.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.533+0000 7fc267735b80 1 --2- 172.21.15.82:0/2580641355 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557c34b16c40 0x557c34b22c50 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:57.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.533+0000 7fc267735b80 1 --2- 172.21.15.82:0/2580641355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557c34b1c380 0x557c34b1fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:57.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.533+0000 7fc2357fa700 0 client.17955 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:33:57.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.533+0000 7fc267735b80 1 -- 172.21.15.82:0/2580641355 >> 172.21.15.82:0/2580641355 conn(0x557c34a8b0e0 msgr2=0x557c34b0bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:33:57.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.533+0000 7fc267735b80 1 -- 172.21.15.82:0/2580641355 shutdown_connections 2023-09-23T09:33:57.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.533+0000 7fc267735b80 1 -- 172.21.15.82:0/2580641355 wait complete. 2023-09-23T09:33:57.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.534+0000 7fc267735b80 20 client.17955 trim_cache size 0 max 16384 2023-09-23T09:33:57.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.566+0000 7fc267735b80 1 Processor -- start 2023-09-23T09:33:57.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.566+0000 7fc267735b80 1 -- start start 2023-09-23T09:33:57.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.567+0000 7fc267735b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557c34b16c40 0x557c34b1f690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:57.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.567+0000 7fc267735b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x557c34b1c380 0x557c34b227f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:57.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.567+0000 7fc267735b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557c34b1cca0 0x557c34b1af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:57.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.567+0000 7fc267735b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c348ea920 con 0x557c34b1cca0 2023-09-23T09:33:57.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.567+0000 7fc267735b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c34b23580 con 0x557c34b16c40 2023-09-23T09:33:57.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.567+0000 7fc267735b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c34b2d150 con 0x557c34b1c380 2023-09-23T09:33:57.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.567+0000 7fc251b9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557c34b16c40 0x557c34b1f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:57.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.568+0000 7fc251b9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557c34b16c40 0x557c34b1f690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:44556/0 (socket says 172.21.15.82:44556) 2023-09-23T09:33:57.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.568+0000 7fc251b9b700 1 -- 172.21.15.82:0/2535152325 learned_addr learned my addr 172.21.15.82:0/2535152325 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:33:57.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.568+0000 7fc25239c700 1 --2- 172.21.15.82:0/2535152325 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557c34b1cca0 0x557c34b1af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:57.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.568+0000 7fc25139a700 1 --2- 172.21.15.82:0/2535152325 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x557c34b1c380 0x557c34b227f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:57.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.568+0000 7fc251b9b700 1 -- 172.21.15.82:0/2535152325 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x557c34b1c380 msgr2=0x557c34b227f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:33:57.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.568+0000 7fc251b9b700 1 --2- 172.21.15.82:0/2535152325 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x557c34b1c380 0x557c34b227f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:57.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.568+0000 7fc251b9b700 1 -- 172.21.15.82:0/2535152325 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557c34b1cca0 msgr2=0x557c34b1af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:33:57.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.568+0000 7fc251b9b700 1 --2- 172.21.15.82:0/2535152325 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557c34b1cca0 0x557c34b1af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:57.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.568+0000 7fc251b9b700 1 -- 172.21.15.82:0/2535152325 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557c34b0adf0 con 0x557c34b16c40 2023-09-23T09:33:57.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.569+0000 7fc251b9b700 1 --2- 172.21.15.82:0/2535152325 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557c34b16c40 0x557c34b1f690 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fc2440ced70 tx=0x7fc2440ce980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6d114a6b603e3ee server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:33:57.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.569+0000 7fc25139a700 1 --2- 172.21.15.82:0/2535152325 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x557c34b1c380 0x557c34b227f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T09:33:57.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.570+0000 7fc240bff700 1 -- 172.21.15.82:0/2535152325 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc244098290 con 0x557c34b16c40 2023-09-23T09:33:57.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.570+0000 7fc240bff700 1 -- 172.21.15.82:0/2535152325 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc244098520 con 0x557c34b16c40 2023-09-23T09:33:57.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.570+0000 7fc240bff700 1 -- 172.21.15.82:0/2535152325 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2440a0560 con 0x557c34b16c40 2023-09-23T09:33:57.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.573+0000 7fc267735b80 1 -- 172.21.15.82:0/2535152325 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557c34b16c40 msgr2=0x557c34b1f690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:33:57.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.573+0000 7fc267735b80 1 --2- 172.21.15.82:0/2535152325 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557c34b16c40 0x557c34b1f690 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fc2440ced70 tx=0x7fc2440ce980 comp rx=0 tx=0).stop 2023-09-23T09:33:57.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.574+0000 7fc267735b80 1 -- 172.21.15.82:0/2535152325 shutdown_connections 2023-09-23T09:33:57.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.574+0000 7fc267735b80 1 --2- 172.21.15.82:0/2535152325 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557c34b1cca0 0x557c34b1af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:57.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.574+0000 7fc267735b80 1 --2- 172.21.15.82:0/2535152325 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557c34b16c40 0x557c34b1f690 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:57.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.574+0000 7fc267735b80 1 --2- 172.21.15.82:0/2535152325 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x557c34b1c380 0x557c34b227f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:57.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.574+0000 7fc267735b80 1 -- 172.21.15.82:0/2535152325 >> 172.21.15.82:0/2535152325 conn(0x557c34a8b0e0 msgr2=0x557c34b1a050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:33:57.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.574+0000 7fc267735b80 1 -- 172.21.15.82:0/2535152325 shutdown_connections 2023-09-23T09:33:57.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.574+0000 7fc267735b80 1 -- 172.21.15.82:0/2535152325 wait complete. 2023-09-23T09:33:57.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.575+0000 7fc267735b80 1 -- start start 2023-09-23T09:33:57.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.575+0000 7fc267735b80 1 Processor -- start 2023-09-23T09:33:57.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.578+0000 7fc267735b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x557c34b16c40 0x557c34b17da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:57.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.578+0000 7fc267735b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557c34b1c380 0x557c34b182e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:57.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.578+0000 7fc267735b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557c34b1cca0 0x557c34b18820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:57.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.578+0000 7fc267735b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c34b27db0 con 0x557c34b1c380 2023-09-23T09:33:57.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.578+0000 7fc267735b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c34b18d60 con 0x557c34b1cca0 2023-09-23T09:33:57.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.578+0000 7fc267735b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c34b18f20 con 0x557c34b16c40 2023-09-23T09:33:57.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.578+0000 7fc267735b80 10 client.0 _ll_register_callbacks cb 0x7fc2440ceca0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:33:57.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.580+0000 7fc251b9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x557c34b16c40 0x557c34b17da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:57.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.580+0000 7fc251b9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x557c34b16c40 0x557c34b17da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:35136/0 (socket says 172.21.15.82:35136) 2023-09-23T09:33:57.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.580+0000 7fc251b9b700 1 -- 172.21.15.82:0/2171176314 learned_addr learned my addr 172.21.15.82:0/2171176314 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:33:57.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.581+0000 7fc251b9b700 1 -- 172.21.15.82:0/2171176314 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557c34b1cca0 msgr2=0x557c34b18820 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-23T09:33:57.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.581+0000 7fc251b9b700 1 --2- 172.21.15.82:0/2171176314 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557c34b1cca0 0x557c34b18820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:57.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.581+0000 7fc251b9b700 1 -- 172.21.15.82:0/2171176314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557c34b1c380 msgr2=0x557c34b182e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:33:57.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.581+0000 7fc251b9b700 1 --2- 172.21.15.82:0/2171176314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557c34b1c380 0x557c34b182e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:57.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.581+0000 7fc251b9b700 1 -- 172.21.15.82:0/2171176314 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557c34894de0 con 0x557c34b16c40 2023-09-23T09:33:57.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.582+0000 7fc251b9b700 1 --2- 172.21.15.82:0/2171176314 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x557c34b16c40 0x557c34b17da0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc244098860 tx=0x7fc244096d00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=257701a63a3f15b6 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:33:57.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.582+0000 7fc2357fa700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T09:33:57.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.583+0000 7fc2357fa700 1 -- 172.21.15.82:0/2171176314 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc244098290 con 0x557c34b16c40 2023-09-23T09:33:57.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.583+0000 7fc2357fa700 1 -- 172.21.15.82:0/2171176314 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(149..149 src has 1..149) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fc244098e50 con 0x557c34b16c40 2023-09-23T09:33:57.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.583+0000 7fc267735b80 1 -- 172.21.15.82:0/2171176314 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557c34b098b0 con 0x557c34b16c40 2023-09-23T09:33:57.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.586+0000 7fc2357fa700 1 -- 172.21.15.82:0/2171176314 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=109) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc244094a90 con 0x557c34b16c40 2023-09-23T09:33:57.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.586+0000 7fc267735b80 10 client.27727 fetch_fsmap learned FSMap version 109 2023-09-23T09:33:57.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.586+0000 7fc267735b80 1 -- 172.21.15.82:0/2171176314 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=109,monmap=4+}) v3 -- 0x557c3487dc60 con 0x557c34b16c40 2023-09-23T09:33:57.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.587+0000 7fc2357fa700 1 -- 172.21.15.82:0/2171176314 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x557c34b098b0 con 0x557c34b16c40 2023-09-23T09:33:57.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.587+0000 7fc2357fa700 1 -- 172.21.15.82:0/2171176314 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 109) v1 ==== 7942+0+0 (secure 0 0 0) 0x7fc2440989b0 con 0x557c34b16c40 2023-09-23T09:33:57.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.587+0000 7fc267735b80 10 client.27727 fetch_fsmap finished waiting for FSMap version 109 2023-09-23T09:33:57.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.587+0000 7fc267735b80 10 client.27727 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:33:57.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.587+0000 7fc267735b80 20 client.27727 populate_metadata read hostname 'smithi082' 2023-09-23T09:33:57.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.587+0000 7fc267735b80 1 --2- 172.21.15.82:0/2171176314 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x557c34b84360 0x557c34b86750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:33:57.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.587+0000 7fc267735b80 4 client.27727 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:33:57.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.587+0000 7fc267735b80 1 -- 172.21.15.82:0/2171176314 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x557c34a61970 con 0x557c34b84360 2023-09-23T09:33:57.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.588+0000 7fc25139a700 1 --2- 172.21.15.82:0/2171176314 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x557c34b84360 0x557c34b86750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:33:57.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.590+0000 7fc25139a700 1 --2- 172.21.15.82:0/2171176314 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x557c34b84360 0x557c34b86750 crc :-1 s=READY pgs=246 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c92f9fb9868a638 server_cookie=59687157ca322dbf in_seq=0 out_seq=0 2023-09-23T09:33:57.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.595+0000 7fc2357fa700 10 client.27727 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:33:57.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.595+0000 7fc2357fa700 1 -- 172.21.15.82:0/2171176314 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x557c34a61970 con 0x557c34b84360 2023-09-23T09:33:57.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.595+0000 7fc2357fa700 10 client.27727 handle_command_reply: tid=0 2023-09-23T09:33:57.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.596+0000 7fc267735b80 1 client.27727 shutdown 2023-09-23T09:33:57.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.596+0000 7fc267735b80 1 -- 172.21.15.82:0/2171176314 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x557c34b16c40 msgr2=0x557c34b17da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:33:57.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.596+0000 7fc267735b80 1 --2- 172.21.15.82:0/2171176314 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x557c34b16c40 0x557c34b17da0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc244098860 tx=0x7fc244096d00 comp rx=0 tx=0).stop 2023-09-23T09:33:57.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.597+0000 7fc267735b80 1 -- 172.21.15.82:0/2171176314 shutdown_connections 2023-09-23T09:33:57.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.597+0000 7fc267735b80 1 --2- 172.21.15.82:0/2171176314 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557c34b1cca0 0x557c34b18820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:57.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.597+0000 7fc267735b80 1 --2- 172.21.15.82:0/2171176314 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x557c34b16c40 0x557c34b17da0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:57.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.597+0000 7fc267735b80 1 --2- 172.21.15.82:0/2171176314 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x557c34b84360 0x557c34b86750 crc :-1 s=READY pgs=246 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:57.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.597+0000 7fc267735b80 1 --2- 172.21.15.82:0/2171176314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557c34b1c380 0x557c34b182e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:57.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.597+0000 7fc2357fa700 0 client.27727 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:33:57.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.597+0000 7fc267735b80 1 -- 172.21.15.82:0/2171176314 >> 172.21.15.82:0/2171176314 conn(0x557c34a8b0e0 msgr2=0x557c34b0b2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:33:57.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.598+0000 7fc267735b80 1 -- 172.21.15.82:0/2171176314 shutdown_connections 2023-09-23T09:33:57.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.598+0000 7fc267735b80 1 -- 172.21.15.82:0/2171176314 wait complete. 2023-09-23T09:33:57.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.599+0000 7fc267735b80 20 client.27727 trim_cache size 0 max 16384 2023-09-23T09:33:57.601 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:33:57.601 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-23T09:33:57.601 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:33:57.602 INFO:teuthology.orchestra.run.smithi082.stdout: "d9e62ab8-1468-4fb0-a9fe-61bed13e954b": { 2023-09-23T09:33:57.602 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:33:57.602 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "d9e62ab8-1468-4fb0-a9fe-61bed13e954b", 2023-09-23T09:33:57.602 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:33:57.602 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:33:57.602 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:33:57.602 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:33:57.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.606+0000 7fc253dff700 1 -- 172.21.15.82:0/3713296297 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fc2380a0200 msgr2=0x7fc2380a26c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:33:57.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.606+0000 7fc253dff700 1 --2- 172.21.15.82:0/3713296297 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fc2380a0200 0x7fc2380a26c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc23c00c010 tx=0x7fc23c010ca0 comp rx=0 tx=0).stop 2023-09-23T09:33:57.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.606+0000 7fc253dff700 1 -- 172.21.15.82:0/3713296297 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc24c107040 msgr2=0x7fc24c19cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:33:57.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.606+0000 7fc253dff700 1 --2- 172.21.15.82:0/3713296297 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc24c107040 0x7fc24c19cf50 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fc24400ba50 tx=0x7fc24400be10 comp rx=0 tx=0).stop 2023-09-23T09:33:57.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.607+0000 7fc253dff700 1 -- 172.21.15.82:0/3713296297 shutdown_connections 2023-09-23T09:33:57.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.607+0000 7fc253dff700 1 --2- 172.21.15.82:0/3713296297 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fc2380a0200 0x7fc2380a26c0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:57.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.607+0000 7fc253dff700 1 --2- 172.21.15.82:0/3713296297 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc24c10cfc0 0x7fc24c1a18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:57.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.607+0000 7fc253dff700 1 --2- 172.21.15.82:0/3713296297 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc24c107040 0x7fc24c19cf50 secure :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fc24400ba50 tx=0x7fc24400be10 comp rx=0 tx=0).stop 2023-09-23T09:33:57.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.607+0000 7fc253dff700 1 --2- 172.21.15.82:0/3713296297 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc24c107a00 0x7fc24c19d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:33:57.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.607+0000 7fc253dff700 1 -- 172.21.15.82:0/3713296297 >> 172.21.15.82:0/3713296297 conn(0x7fc24c0767c0 msgr2=0x7fc24c0777c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:33:57.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.607+0000 7fc253dff700 1 -- 172.21.15.82:0/3713296297 shutdown_connections 2023-09-23T09:33:57.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:33:57.608+0000 7fc253dff700 1 -- 172.21.15.82:0/3713296297 wait complete. 2023-09-23T09:33:57.646 INFO:tasks.cephfs.filesystem:scrub status for tag:d9e62ab8-1468-4fb0-a9fe-61bed13e954b - {'path': '/', 'tag': 'd9e62ab8-1468-4fb0-a9fe-61bed13e954b', 'options': 'recursive,force'} 2023-09-23T09:33:58.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:33:58 smithi135 ceph-mon[99205]: scrub queued for path: / 2023-09-23T09:33:58.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:33:58 smithi135 ceph-mon[99205]: scrub summary: idle+waiting paths [/] 2023-09-23T09:33:58.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:33:58 smithi135 ceph-mon[99205]: scrub summary: active paths [/] 2023-09-23T09:33:58.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:33:58 smithi135 ceph-mon[99205]: scrub summary: active paths [/] 2023-09-23T09:33:58.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:33:58 smithi135 ceph-mon[99205]: scrub summary: active paths [/] 2023-09-23T09:33:58.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:33:58 smithi135 ceph-mon[99205]: scrub summary: active paths [/] 2023-09-23T09:33:58.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:33:58 smithi135 ceph-mon[99205]: scrub summary: idle+waiting paths [/] 2023-09-23T09:33:58.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:33:58 smithi135 ceph-mon[99205]: scrub summary: active paths [/] 2023-09-23T09:33:58.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:33:58 smithi135 ceph-mon[99205]: scrub summary: active paths [/] 2023-09-23T09:33:58.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:33:58 smithi135 ceph-mon[99205]: scrub summary: idle+waiting paths [/] 2023-09-23T09:33:58.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:33:58 smithi135 ceph-mon[99205]: scrub summary: active paths [/] 2023-09-23T09:33:58.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:33:58 smithi135 ceph-mon[99205]: scrub summary: idle+waiting paths [/] 2023-09-23T09:33:58.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:33:58 smithi135 ceph-mon[99205]: scrub summary: idle+waiting paths [/] 2023-09-23T09:33:58.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:33:58 smithi135 ceph-mon[99205]: scrub summary: idle+waiting paths [/] 2023-09-23T09:33:58.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:33:58 smithi082 ceph-mon[97694]: scrub queued for path: / 2023-09-23T09:33:58.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:33:58 smithi082 ceph-mon[97694]: scrub summary: idle+waiting paths [/] 2023-09-23T09:33:58.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:33:58 smithi082 ceph-mon[97694]: scrub summary: active paths [/] 2023-09-23T09:33:58.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:33:58 smithi082 ceph-mon[97694]: scrub summary: active paths [/] 2023-09-23T09:33:58.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:33:58 smithi082 ceph-mon[97694]: scrub summary: active paths [/] 2023-09-23T09:33:58.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:33:58 smithi082 ceph-mon[97694]: scrub summary: active paths [/] 2023-09-23T09:33:58.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:33:58 smithi082 ceph-mon[97694]: scrub summary: idle+waiting paths [/] 2023-09-23T09:33:58.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:33:58 smithi082 ceph-mon[97694]: scrub summary: active paths [/] 2023-09-23T09:33:58.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:33:58 smithi082 ceph-mon[97694]: scrub summary: active paths [/] 2023-09-23T09:33:58.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:33:58 smithi082 ceph-mon[97694]: scrub summary: idle+waiting paths [/] 2023-09-23T09:33:58.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:33:58 smithi082 ceph-mon[97694]: scrub summary: active paths [/] 2023-09-23T09:33:58.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:33:58 smithi082 ceph-mon[97694]: scrub summary: idle+waiting paths [/] 2023-09-23T09:33:58.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:33:58 smithi082 ceph-mon[97694]: scrub summary: idle+waiting paths [/] 2023-09-23T09:33:58.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:33:58 smithi082 ceph-mon[97694]: scrub summary: idle+waiting paths [/] 2023-09-23T09:33:58.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:33:58 smithi161 ceph-mon[99580]: scrub queued for path: / 2023-09-23T09:33:58.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:33:58 smithi161 ceph-mon[99580]: scrub summary: idle+waiting paths [/] 2023-09-23T09:33:58.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:33:58 smithi161 ceph-mon[99580]: scrub summary: active paths [/] 2023-09-23T09:33:58.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:33:58 smithi161 ceph-mon[99580]: scrub summary: active paths [/] 2023-09-23T09:33:58.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:33:58 smithi161 ceph-mon[99580]: scrub summary: active paths [/] 2023-09-23T09:33:58.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:33:58 smithi161 ceph-mon[99580]: scrub summary: active paths [/] 2023-09-23T09:33:58.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:33:58 smithi161 ceph-mon[99580]: scrub summary: idle+waiting paths [/] 2023-09-23T09:33:58.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:33:58 smithi161 ceph-mon[99580]: scrub summary: active paths [/] 2023-09-23T09:33:58.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:33:58 smithi161 ceph-mon[99580]: scrub summary: active paths [/] 2023-09-23T09:33:58.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:33:58 smithi161 ceph-mon[99580]: scrub summary: idle+waiting paths [/] 2023-09-23T09:33:58.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:33:58 smithi161 ceph-mon[99580]: scrub summary: active paths [/] 2023-09-23T09:33:58.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:33:58 smithi161 ceph-mon[99580]: scrub summary: idle+waiting paths [/] 2023-09-23T09:33:58.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:33:58 smithi161 ceph-mon[99580]: scrub summary: idle+waiting paths [/] 2023-09-23T09:33:58.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:33:58 smithi161 ceph-mon[99580]: scrub summary: idle+waiting paths [/] 2023-09-23T09:33:59.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:33:59 smithi135 ceph-mon[99205]: pgmap v1175: 97 pgs: 97 active+clean; 16 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 3.0 MiB/s rd, 12 MiB/s wr, 1.09k op/s 2023-09-23T09:33:59.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:33:59 smithi082 ceph-mon[97694]: pgmap v1175: 97 pgs: 97 active+clean; 16 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 3.0 MiB/s rd, 12 MiB/s wr, 1.09k op/s 2023-09-23T09:33:59.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:33:59 smithi161 ceph-mon[99580]: pgmap v1175: 97 pgs: 97 active+clean; 16 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 3.0 MiB/s rd, 12 MiB/s wr, 1.09k op/s 2023-09-23T09:34:00.566 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:34:00 smithi135 ceph-mon[99205]: pgmap v1176: 97 pgs: 97 active+clean; 16 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 4.1 MiB/s rd, 16 MiB/s wr, 1.58k op/s 2023-09-23T09:34:00.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:34:00 smithi082 ceph-mon[97694]: pgmap v1176: 97 pgs: 97 active+clean; 16 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 4.1 MiB/s rd, 16 MiB/s wr, 1.58k op/s 2023-09-23T09:34:00.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:34:00 smithi161 ceph-mon[99580]: pgmap v1176: 97 pgs: 97 active+clean; 16 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 4.1 MiB/s rd, 16 MiB/s wr, 1.58k op/s 2023-09-23T09:34:00.830 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 410.0 s, 435.6 tps, lat 215.479 ms stddev 118.119 2023-09-23T09:34:02.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:34:02 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:34:02.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:34:02 smithi082 ceph-mon[97694]: pgmap v1177: 97 pgs: 97 active+clean; 16 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 2.8 MiB/s rd, 12 MiB/s wr, 1.19k op/s 2023-09-23T09:34:02.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:34:02 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:34:02.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:34:02 smithi161 ceph-mon[99580]: pgmap v1177: 97 pgs: 97 active+clean; 16 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 2.8 MiB/s rd, 12 MiB/s wr, 1.19k op/s 2023-09-23T09:34:03.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:34:02 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:34:03.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:34:02 smithi135 ceph-mon[99205]: pgmap v1177: 97 pgs: 97 active+clean; 16 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 2.8 MiB/s rd, 12 MiB/s wr, 1.19k op/s 2023-09-23T09:34:05.066 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:34:04 smithi135 ceph-mon[99205]: pgmap v1178: 97 pgs: 97 active+clean; 16 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 11 MiB/s wr, 1.12k op/s 2023-09-23T09:34:05.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:34:04 smithi082 ceph-mon[97694]: pgmap v1178: 97 pgs: 97 active+clean; 16 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 11 MiB/s wr, 1.12k op/s 2023-09-23T09:34:05.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:34:04 smithi161 ceph-mon[99580]: pgmap v1178: 97 pgs: 97 active+clean; 16 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 11 MiB/s wr, 1.12k op/s 2023-09-23T09:34:05.827 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 415.0 s, 371.8 tps, lat 276.900 ms stddev 254.557 2023-09-23T09:34:07.065 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:34:06 smithi135 ceph-mon[99205]: pgmap v1179: 97 pgs: 97 active+clean; 16 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 3.7 MiB/s rd, 16 MiB/s wr, 1.55k op/s 2023-09-23T09:34:07.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:34:06 smithi082 ceph-mon[97694]: pgmap v1179: 97 pgs: 97 active+clean; 16 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 3.7 MiB/s rd, 16 MiB/s wr, 1.55k op/s 2023-09-23T09:34:07.149 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:34:06 smithi161 ceph-mon[99580]: pgmap v1179: 97 pgs: 97 active+clean; 16 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 3.7 MiB/s rd, 16 MiB/s wr, 1.55k op/s 2023-09-23T09:34:08.126 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:34:07 smithi082 ceph-mon[97694]: osdmap e150: 12 total, 12 up, 12 in 2023-09-23T09:34:08.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:34:07 smithi161 ceph-mon[99580]: osdmap e150: 12 total, 12 up, 12 in 2023-09-23T09:34:08.314 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:34:07 smithi135 ceph-mon[99205]: osdmap e150: 12 total, 12 up, 12 in 2023-09-23T09:34:09.123 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:34:08 smithi082 ceph-mon[97694]: pgmap v1181: 97 pgs: 97 active+clean; 16 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 2.9 MiB/s rd, 12 MiB/s wr, 1.19k op/s 2023-09-23T09:34:09.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:34:08 smithi161 ceph-mon[99580]: pgmap v1181: 97 pgs: 97 active+clean; 16 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 2.9 MiB/s rd, 12 MiB/s wr, 1.19k op/s 2023-09-23T09:34:09.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:34:08 smithi135 ceph-mon[99205]: pgmap v1181: 97 pgs: 97 active+clean; 16 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 2.9 MiB/s rd, 12 MiB/s wr, 1.19k op/s 2023-09-23T09:34:10.827 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 420.0 s, 201.6 tps, lat 499.800 ms stddev 364.588 2023-09-23T09:34:11.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:34:10 smithi082 ceph-mon[97694]: pgmap v1182: 97 pgs: 12 active+clean+snaptrim, 21 active+clean+snaptrim_wait, 64 active+clean; 16 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 9.5 MiB/s wr, 866 op/s 2023-09-23T09:34:11.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:34:10 smithi161 ceph-mon[99580]: pgmap v1182: 97 pgs: 12 active+clean+snaptrim, 21 active+clean+snaptrim_wait, 64 active+clean; 16 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 9.5 MiB/s wr, 866 op/s 2023-09-23T09:34:11.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:34:10 smithi135 ceph-mon[99205]: pgmap v1182: 97 pgs: 12 active+clean+snaptrim, 21 active+clean+snaptrim_wait, 64 active+clean; 16 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 9.5 MiB/s wr, 866 op/s 2023-09-23T09:34:13.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:34:13 smithi135 ceph-mon[99205]: pgmap v1183: 97 pgs: 14 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 56 active+clean; 16 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 8.8 MiB/s wr, 812 op/s 2023-09-23T09:34:13.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:34:13 smithi082 ceph-mon[97694]: pgmap v1183: 97 pgs: 14 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 56 active+clean; 16 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 8.8 MiB/s wr, 812 op/s 2023-09-23T09:34:13.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:34:13 smithi161 ceph-mon[99580]: pgmap v1183: 97 pgs: 14 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 56 active+clean; 16 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 8.8 MiB/s wr, 812 op/s 2023-09-23T09:34:14.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:34:14 smithi135 ceph-mon[99205]: pgmap v1184: 97 pgs: 14 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 56 active+clean; 16 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 8.8 MiB/s wr, 812 op/s 2023-09-23T09:34:14.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:34:14 smithi082 ceph-mon[97694]: pgmap v1184: 97 pgs: 14 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 56 active+clean; 16 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 8.8 MiB/s wr, 812 op/s 2023-09-23T09:34:14.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:34:14 smithi161 ceph-mon[99580]: pgmap v1184: 97 pgs: 14 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 56 active+clean; 16 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 8.8 MiB/s wr, 812 op/s 2023-09-23T09:34:15.565 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:34:15 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:34:15.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:34:15 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:34:15.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:34:15 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:34:15.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 425.0 s, 434.2 tps, lat 231.767 ms stddev 161.171 2023-09-23T09:34:16.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:34:16 smithi135 ceph-mon[99205]: pgmap v1185: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 8.7 MiB/s wr, 809 op/s 2023-09-23T09:34:16.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:34:16 smithi082 ceph-mon[97694]: pgmap v1185: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 8.7 MiB/s wr, 809 op/s 2023-09-23T09:34:16.651 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:34:16 smithi161 ceph-mon[99580]: pgmap v1185: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 8.7 MiB/s wr, 809 op/s 2023-09-23T09:34:18.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:34:18 smithi135 ceph-mon[99205]: scrub summary: active paths [/] 2023-09-23T09:34:18.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:34:18 smithi135 ceph-mon[99205]: scrub summary: idle+waiting paths [/] 2023-09-23T09:34:18.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:34:18 smithi135 ceph-mon[99205]: osdmap e151: 12 total, 12 up, 12 in 2023-09-23T09:34:18.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:34:18 smithi082 ceph-mon[97694]: scrub summary: active paths [/] 2023-09-23T09:34:18.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:34:18 smithi082 ceph-mon[97694]: scrub summary: idle+waiting paths [/] 2023-09-23T09:34:18.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:34:18 smithi082 ceph-mon[97694]: osdmap e151: 12 total, 12 up, 12 in 2023-09-23T09:34:18.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:34:18 smithi161 ceph-mon[99580]: scrub summary: active paths [/] 2023-09-23T09:34:18.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:34:18 smithi161 ceph-mon[99580]: scrub summary: idle+waiting paths [/] 2023-09-23T09:34:18.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:34:18 smithi161 ceph-mon[99580]: osdmap e151: 12 total, 12 up, 12 in 2023-09-23T09:34:19.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:34:19 smithi135 ceph-mon[99205]: pgmap v1187: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 8.7 MiB/s wr, 809 op/s 2023-09-23T09:34:19.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:34:19 smithi082 ceph-mon[97694]: pgmap v1187: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 8.7 MiB/s wr, 809 op/s 2023-09-23T09:34:19.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:34:19 smithi161 ceph-mon[99580]: pgmap v1187: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 8.7 MiB/s wr, 809 op/s 2023-09-23T09:34:20.565 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:34:20 smithi135 ceph-mon[99205]: pgmap v1188: 97 pgs: 97 active+clean; 15 GiB data, 60 GiB used, 1012 GiB / 1.0 TiB avail; 2.8 MiB/s rd, 12 MiB/s wr, 1.11k op/s 2023-09-23T09:34:20.624 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:34:20 smithi082 ceph-mon[97694]: pgmap v1188: 97 pgs: 97 active+clean; 15 GiB data, 60 GiB used, 1012 GiB / 1.0 TiB avail; 2.8 MiB/s rd, 12 MiB/s wr, 1.11k op/s 2023-09-23T09:34:20.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:34:20 smithi161 ceph-mon[99580]: pgmap v1188: 97 pgs: 97 active+clean; 15 GiB data, 60 GiB used, 1012 GiB / 1.0 TiB avail; 2.8 MiB/s rd, 12 MiB/s wr, 1.11k op/s 2023-09-23T09:34:20.827 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 430.0 s, 497.2 tps, lat 201.912 ms stddev 116.516 2023-09-23T09:34:22.873 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:34:22 smithi082 ceph-mon[97694]: scrub summary: idle+waiting paths [/] 2023-09-23T09:34:22.874 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:34:22 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:34:22.874 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:34:22 smithi082 ceph-mon[97694]: pgmap v1189: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.9 MiB/s rd, 12 MiB/s wr, 1.17k op/s 2023-09-23T09:34:22.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:34:22 smithi161 ceph-mon[99580]: scrub summary: idle+waiting paths [/] 2023-09-23T09:34:22.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:34:22 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:34:22.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:34:22 smithi161 ceph-mon[99580]: pgmap v1189: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.9 MiB/s rd, 12 MiB/s wr, 1.17k op/s 2023-09-23T09:34:23.064 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:34:22 smithi135 ceph-mon[99205]: scrub summary: idle+waiting paths [/] 2023-09-23T09:34:23.064 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:34:22 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:34:23.064 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:34:22 smithi135 ceph-mon[99205]: pgmap v1189: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.9 MiB/s rd, 12 MiB/s wr, 1.17k op/s 2023-09-23T09:34:25.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:34:24 smithi082 ceph-mon[97694]: pgmap v1190: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.9 MiB/s rd, 12 MiB/s wr, 1.16k op/s 2023-09-23T09:34:25.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:34:24 smithi161 ceph-mon[99580]: pgmap v1190: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.9 MiB/s rd, 12 MiB/s wr, 1.16k op/s 2023-09-23T09:34:25.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:34:24 smithi135 ceph-mon[99205]: pgmap v1190: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.9 MiB/s rd, 12 MiB/s wr, 1.16k op/s 2023-09-23T09:34:25.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 435.0 s, 349.0 tps, lat 269.259 ms stddev 229.567 2023-09-23T09:34:27.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:34:26 smithi082 ceph-mon[97694]: pgmap v1191: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 3.3 MiB/s rd, 13 MiB/s wr, 1.33k op/s 2023-09-23T09:34:27.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:34:26 smithi161 ceph-mon[99580]: pgmap v1191: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 3.3 MiB/s rd, 13 MiB/s wr, 1.33k op/s 2023-09-23T09:34:27.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:34:26 smithi135 ceph-mon[99205]: pgmap v1191: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 3.3 MiB/s rd, 13 MiB/s wr, 1.33k op/s 2023-09-23T09:34:27.647 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:34:27.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.933+0000 7f57efbff700 1 -- 172.21.15.82:0/1859966924 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57e8108ad0 msgr2=0x7f57e8108eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:34:27.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.933+0000 7f57efbff700 1 --2- 172.21.15.82:0/1859966924 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57e8108ad0 0x7f57e8108eb0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f57e4009990 tx=0x7f57e4009ca0 comp rx=0 tx=0).stop 2023-09-23T09:34:27.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.934+0000 7f57efbff700 1 -- 172.21.15.82:0/1859966924 shutdown_connections 2023-09-23T09:34:27.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.934+0000 7f57efbff700 1 --2- 172.21.15.82:0/1859966924 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57e8103480 0x7f57e810f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:34:27.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.934+0000 7f57efbff700 1 --2- 172.21.15.82:0/1859966924 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57e8108ad0 0x7f57e8108eb0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:34:27.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.934+0000 7f57efbff700 1 --2- 172.21.15.82:0/1859966924 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57e8102ac0 0x7f57e8102f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:34:27.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.934+0000 7f57efbff700 1 -- 172.21.15.82:0/1859966924 >> 172.21.15.82:0/1859966924 conn(0x7f57e80fe5b0 msgr2=0x7f57e81009d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:34:27.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.934+0000 7f57efbff700 1 -- 172.21.15.82:0/1859966924 shutdown_connections 2023-09-23T09:34:27.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.934+0000 7f57efbff700 1 -- 172.21.15.82:0/1859966924 wait complete. 2023-09-23T09:34:27.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.936+0000 7f57efbff700 1 Processor -- start 2023-09-23T09:34:27.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.936+0000 7f57efbff700 1 -- start start 2023-09-23T09:34:27.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.936+0000 7f57efbff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57e8102ac0 0x7f57e819e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:34:27.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.936+0000 7f57efbff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57e8103480 0x7f57e819ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:34:27.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.936+0000 7f57efbff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57e8108ad0 0x7f57e8198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:34:27.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.936+0000 7f57efbff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57e8198ef0 con 0x7f57e8103480 2023-09-23T09:34:27.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.936+0000 7f57efbff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57e8199060 con 0x7f57e8102ac0 2023-09-23T09:34:27.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.936+0000 7f57efbff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57e8199220 con 0x7f57e8108ad0 2023-09-23T09:34:27.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.937+0000 7f57ed99b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57e8102ac0 0x7f57e819e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:34:27.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.937+0000 7f57ed99b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57e8102ac0 0x7f57e819e810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:39036/0 (socket says 172.21.15.82:39036) 2023-09-23T09:34:27.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.937+0000 7f57ed99b700 1 -- 172.21.15.82:0/3466701994 learned_addr learned my addr 172.21.15.82:0/3466701994 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:34:27.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.937+0000 7f57ed19a700 1 --2- 172.21.15.82:0/3466701994 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57e8103480 0x7f57e819ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:34:27.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.937+0000 7f57ee19c700 1 --2- 172.21.15.82:0/3466701994 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57e8108ad0 0x7f57e8198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:34:27.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.937+0000 7f57ed99b700 1 -- 172.21.15.82:0/3466701994 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57e8108ad0 msgr2=0x7f57e8198880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:34:27.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.937+0000 7f57ed99b700 1 --2- 172.21.15.82:0/3466701994 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57e8108ad0 0x7f57e8198880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:34:27.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.937+0000 7f57ed99b700 1 -- 172.21.15.82:0/3466701994 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57e8103480 msgr2=0x7f57e819ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:34:27.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.937+0000 7f57ed99b700 1 --2- 172.21.15.82:0/3466701994 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57e8103480 0x7f57e819ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:34:27.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.937+0000 7f57ed99b700 1 -- 172.21.15.82:0/3466701994 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57e40095f0 con 0x7f57e8102ac0 2023-09-23T09:34:27.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.937+0000 7f57ed99b700 1 --2- 172.21.15.82:0/3466701994 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57e8102ac0 0x7f57e819e810 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f57e4005770 tx=0x7f57e40057a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:34:27.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.938+0000 7f57daffd700 1 -- 172.21.15.82:0/3466701994 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e401d070 con 0x7f57e8102ac0 2023-09-23T09:34:27.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.938+0000 7f57efbff700 1 -- 172.21.15.82:0/3466701994 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57e8199500 con 0x7f57e8102ac0 2023-09-23T09:34:27.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.938+0000 7f57daffd700 1 -- 172.21.15.82:0/3466701994 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f57e4021410 con 0x7f57e8102ac0 2023-09-23T09:34:27.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.938+0000 7f57daffd700 1 -- 172.21.15.82:0/3466701994 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e40173f0 con 0x7f57e8102ac0 2023-09-23T09:34:27.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.938+0000 7f57efbff700 1 -- 172.21.15.82:0/3466701994 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57e81a5800 con 0x7f57e8102ac0 2023-09-23T09:34:27.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.942+0000 7f580346cb80 1 Processor -- start 2023-09-23T09:34:27.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.943+0000 7f580346cb80 1 -- start start 2023-09-23T09:34:27.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.943+0000 7f580346cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c102294b90 0x55c102294f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:34:27.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.943+0000 7f57daffd700 1 -- 172.21.15.82:0/3466701994 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f57e4021780 con 0x7f57e8102ac0 2023-09-23T09:34:27.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.943+0000 7f580346cb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c1022954b0 0x55c10228ef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:34:27.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.943+0000 7f580346cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c10228f450 0x55c10228f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:34:27.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.943+0000 7f580346cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1021ee7b0 con 0x55c102294b90 2023-09-23T09:34:27.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.943+0000 7f580346cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1021df780 con 0x55c10228f450 2023-09-23T09:34:27.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.943+0000 7f580346cb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1021dd0a0 con 0x55c1022954b0 2023-09-23T09:34:27.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.944+0000 7f57ee19c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c102294b90 0x55c102294f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:34:27.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.944+0000 7f57ee19c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c102294b90 0x55c102294f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44670/0 (socket says 172.21.15.82:44670) 2023-09-23T09:34:27.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.944+0000 7f57ee19c700 1 -- 172.21.15.82:0/3679897794 learned_addr learned my addr 172.21.15.82:0/3679897794 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:34:27.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.944+0000 7f57ed19a700 1 --2- 172.21.15.82:0/3679897794 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c10228f450 0x55c10228f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:34:27.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.944+0000 7f57ee19c700 1 -- 172.21.15.82:0/3679897794 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c1022954b0 msgr2=0x55c10228ef10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-23T09:34:27.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.944+0000 7f57ee19c700 1 --2- 172.21.15.82:0/3679897794 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c1022954b0 0x55c10228ef10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:34:27.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.944+0000 7f57ee19c700 1 -- 172.21.15.82:0/3679897794 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c10228f450 msgr2=0x55c10228f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:34:27.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.944+0000 7f57ee19c700 1 --2- 172.21.15.82:0/3679897794 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c10228f450 0x55c10228f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:34:27.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.944+0000 7f57ee19c700 1 -- 172.21.15.82:0/3679897794 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c102058630 con 0x55c102294b90 2023-09-23T09:34:27.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.944+0000 7f57ee19c700 1 --2- 172.21.15.82:0/3679897794 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c102294b90 0x55c102294f70 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f57e0003f40 tx=0x7f57e0009ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a54c4719d071509d server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:34:27.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.945+0000 7f57d3fff700 1 -- 172.21.15.82:0/3679897794 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e0019070 con 0x55c102294b90 2023-09-23T09:34:27.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.945+0000 7f57d3fff700 1 -- 172.21.15.82:0/3679897794 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f57e000f040 con 0x55c102294b90 2023-09-23T09:34:27.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.945+0000 7f57d3fff700 1 -- 172.21.15.82:0/3679897794 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e0007ad0 con 0x55c102294b90 2023-09-23T09:34:27.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.946+0000 7f57daffd700 1 --2- 172.21.15.82:0/3466701994 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f57d40a00c0 0x7f57d40a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:34:27.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.946+0000 7f580346cb80 1 -- 172.21.15.82:0/3679897794 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c102294b90 msgr2=0x55c102294f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:34:27.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.946+0000 7f580346cb80 1 --2- 172.21.15.82:0/3679897794 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c102294b90 0x55c102294f70 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f57e0003f40 tx=0x7f57e0009ba0 comp rx=0 tx=0).stop 2023-09-23T09:34:27.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.946+0000 7f57daffd700 1 -- 172.21.15.82:0/3466701994 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f57e40cc750 con 0x7f57e8102ac0 2023-09-23T09:34:27.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.946+0000 7f580346cb80 1 -- 172.21.15.82:0/3679897794 shutdown_connections 2023-09-23T09:34:27.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.946+0000 7f580346cb80 1 --2- 172.21.15.82:0/3679897794 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c10228f450 0x55c10228f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:34:27.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.946+0000 7f580346cb80 1 --2- 172.21.15.82:0/3679897794 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c102294b90 0x55c102294f70 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:34:27.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.946+0000 7f580346cb80 1 --2- 172.21.15.82:0/3679897794 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c1022954b0 0x55c10228ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:34:27.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.946+0000 7f580346cb80 1 -- 172.21.15.82:0/3679897794 >> 172.21.15.82:0/3679897794 conn(0x55c1021fb0e0 msgr2=0x55c102281410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:34:27.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.946+0000 7f580346cb80 1 -- 172.21.15.82:0/3679897794 shutdown_connections 2023-09-23T09:34:27.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.946+0000 7f57ed99b700 1 --2- 172.21.15.82:0/3466701994 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f57d40a00c0 0x7f57d40a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:34:27.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.947+0000 7f580346cb80 1 -- 172.21.15.82:0/3679897794 wait complete. 2023-09-23T09:34:27.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.947+0000 7f580346cb80 1 -- start start 2023-09-23T09:34:27.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.947+0000 7f57ed99b700 1 --2- 172.21.15.82:0/3466701994 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f57d40a00c0 0x7f57d40a2580 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x55c102295910 tx=0x7f57e4005810 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:34:27.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.947+0000 7f580346cb80 1 Processor -- start 2023-09-23T09:34:27.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.948+0000 7f580346cb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c10228f450 0x55c10229b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:34:27.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.948+0000 7f580346cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c102294b90 0x55c102298690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:34:27.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.948+0000 7f580346cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c1022954b0 0x55c102298d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:34:27.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.948+0000 7f580346cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1021d8990 con 0x55c102294b90 2023-09-23T09:34:27.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.948+0000 7f580346cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c102176bb0 con 0x55c1022954b0 2023-09-23T09:34:27.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.948+0000 7f580346cb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1021768b0 con 0x55c10228f450 2023-09-23T09:34:27.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.948+0000 7f580346cb80 10 client.0 _ll_register_callbacks cb 0x55c1020c0a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:34:27.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.948+0000 7f57ed19a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c102294b90 0x55c102298690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:34:27.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.949+0000 7f57ed19a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c102294b90 0x55c102298690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44684/0 (socket says 172.21.15.82:44684) 2023-09-23T09:34:27.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.949+0000 7f57ed19a700 1 -- 172.21.15.82:0/3882814024 learned_addr learned my addr 172.21.15.82:0/3882814024 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:34:27.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.949+0000 7f57ee19c700 1 --2- 172.21.15.82:0/3882814024 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c10228f450 0x55c10229b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:34:27.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.949+0000 7f57ee19c700 1 --2- 172.21.15.82:0/3882814024 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c1022954b0 0x55c102298d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:34:27.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.949+0000 7f57ee19c700 1 -- 172.21.15.82:0/3882814024 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c1022954b0 msgr2=0x55c102298d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:34:27.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.949+0000 7f57ee19c700 1 --2- 172.21.15.82:0/3882814024 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c1022954b0 0x55c102298d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:34:27.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.949+0000 7f57ee19c700 1 -- 172.21.15.82:0/3882814024 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c102294b90 msgr2=0x55c102298690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:34:27.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.949+0000 7f57ee19c700 1 --2- 172.21.15.82:0/3882814024 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c102294b90 0x55c102298690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:34:27.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.949+0000 7f57ee19c700 1 -- 172.21.15.82:0/3882814024 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57e0003b70 con 0x55c10228f450 2023-09-23T09:34:27.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.949+0000 7f57ee19c700 1 --2- 172.21.15.82:0/3882814024 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c10228f450 0x55c10229b410 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f57e0003f40 tx=0x7f57e000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de4ed2d198addb3a server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:34:27.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.949+0000 7f57d17fa700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T09:34:27.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.950+0000 7f57d17fa700 1 -- 172.21.15.82:0/3882814024 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e0019070 con 0x55c10228f450 2023-09-23T09:34:27.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.950+0000 7f57d17fa700 1 -- 172.21.15.82:0/3882814024 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(151..151 src has 1..151) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f57e0009230 con 0x55c10228f450 2023-09-23T09:34:27.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.950+0000 7f580346cb80 1 -- 172.21.15.82:0/3882814024 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c1022561c0 con 0x55c10228f450 2023-09-23T09:34:27.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.950+0000 7f57d17fa700 1 -- 172.21.15.82:0/3882814024 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7f57e0007d00 con 0x55c10228f450 2023-09-23T09:34:27.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.950+0000 7f580346cb80 10 client.27736 fetch_fsmap learned FSMap version 112 2023-09-23T09:34:27.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.950+0000 7f580346cb80 1 -- 172.21.15.82:0/3882814024 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=4+}) v3 -- 0x55c102004de0 con 0x55c10228f450 2023-09-23T09:34:27.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.951+0000 7f57d17fa700 1 -- 172.21.15.82:0/3882814024 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f57e0030020 con 0x55c10228f450 2023-09-23T09:34:27.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.951+0000 7f57d17fa700 1 -- 172.21.15.82:0/3882814024 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 112) v1 ==== 7946+0+0 (secure 0 0 0) 0x7f57e002c450 con 0x55c10228f450 2023-09-23T09:34:27.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.951+0000 7f580346cb80 10 client.27736 fetch_fsmap finished waiting for FSMap version 112 2023-09-23T09:34:27.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.951+0000 7f580346cb80 10 client.27736 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:34:27.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.951+0000 7f580346cb80 20 client.27736 populate_metadata read hostname 'smithi082' 2023-09-23T09:34:27.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.951+0000 7f580346cb80 1 --2- 172.21.15.82:0/3882814024 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55c1022a8ed0 0x55c1022ab2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:34:27.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.951+0000 7f580346cb80 4 client.27736 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:34:27.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.951+0000 7f580346cb80 1 -- 172.21.15.82:0/3882814024 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c10217eba0 con 0x55c1022a8ed0 2023-09-23T09:34:27.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.952+0000 7f57ed19a700 1 --2- 172.21.15.82:0/3882814024 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55c1022a8ed0 0x55c1022ab2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:34:27.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.953+0000 7f57d17fa700 10 client.27736 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:34:27.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.953+0000 7f57ed19a700 1 --2- 172.21.15.82:0/3882814024 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55c1022a8ed0 0x55c1022ab2f0 crc :-1 s=READY pgs=247 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a8d002753d7a566 server_cookie=952e5b81d87b33 in_seq=0 out_seq=0 2023-09-23T09:34:27.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.953+0000 7f57d17fa700 1 -- 172.21.15.82:0/3882814024 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c10217eba0 con 0x55c1022a8ed0 2023-09-23T09:34:27.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.954+0000 7f57d17fa700 10 client.27736 handle_command_reply: tid=0 2023-09-23T09:34:27.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.954+0000 7f580346cb80 1 client.27736 shutdown 2023-09-23T09:34:27.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.954+0000 7f580346cb80 1 -- 172.21.15.82:0/3882814024 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c10228f450 msgr2=0x55c10229b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:34:27.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.954+0000 7f580346cb80 1 --2- 172.21.15.82:0/3882814024 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c10228f450 0x55c10229b410 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f57e0003f40 tx=0x7f57e000b040 comp rx=0 tx=0).stop 2023-09-23T09:34:27.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.954+0000 7f580346cb80 1 -- 172.21.15.82:0/3882814024 shutdown_connections 2023-09-23T09:34:27.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.954+0000 7f580346cb80 1 --2- 172.21.15.82:0/3882814024 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c1022954b0 0x55c102298d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:34:27.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.954+0000 7f580346cb80 1 --2- 172.21.15.82:0/3882814024 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c10228f450 0x55c10229b410 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:34:27.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.954+0000 7f580346cb80 1 --2- 172.21.15.82:0/3882814024 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55c1022a8ed0 0x55c1022ab2f0 crc :-1 s=READY pgs=247 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:34:27.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.954+0000 7f580346cb80 1 --2- 172.21.15.82:0/3882814024 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c102294b90 0x55c102298690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:34:27.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.954+0000 7f580346cb80 1 -- 172.21.15.82:0/3882814024 >> 172.21.15.82:0/3882814024 conn(0x55c1021fb0e0 msgr2=0x55c10227b2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:34:27.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.954+0000 7f57d17fa700 0 client.27736 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:34:27.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.954+0000 7f580346cb80 1 -- 172.21.15.82:0/3882814024 shutdown_connections 2023-09-23T09:34:27.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.955+0000 7f580346cb80 1 -- 172.21.15.82:0/3882814024 wait complete. 2023-09-23T09:34:27.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.955+0000 7f580346cb80 20 client.27736 trim_cache size 0 max 16384 2023-09-23T09:34:27.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.978+0000 7f580346cb80 1 Processor -- start 2023-09-23T09:34:27.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.978+0000 7f580346cb80 1 -- start start 2023-09-23T09:34:27.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.979+0000 7f580346cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c10228f450 0x55c10229afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:34:27.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.979+0000 7f580346cb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c102294b90 0x55c102297e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:34:27.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.979+0000 7f580346cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1022954b0 0x55c1022983d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:34:27.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.979+0000 7f580346cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c10205a920 con 0x55c1022954b0 2023-09-23T09:34:27.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.979+0000 7f580346cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c10227d810 con 0x55c10228f450 2023-09-23T09:34:27.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.979+0000 7f580346cb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c102282580 con 0x55c102294b90 2023-09-23T09:34:27.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.979+0000 7f57ed19a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c102294b90 0x55c102297e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:34:27.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.979+0000 7f57ee19c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1022954b0 0x55c1022983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:34:27.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.979+0000 7f57ed19a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c102294b90 0x55c102297e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:48702/0 (socket says 172.21.15.82:48702) 2023-09-23T09:34:27.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.979+0000 7f57ed19a700 1 -- 172.21.15.82:0/3351469522 learned_addr learned my addr 172.21.15.82:0/3351469522 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:34:27.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.980+0000 7f57ee19c700 1 --2- 172.21.15.82:0/3351469522 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c10228f450 0x55c10229afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:34:27.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.980+0000 7f57ed19a700 1 -- 172.21.15.82:0/3351469522 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c10228f450 msgr2=0x55c10229afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:34:27.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.980+0000 7f57ed19a700 1 --2- 172.21.15.82:0/3351469522 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c10228f450 0x55c10229afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:34:27.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.980+0000 7f57ed19a700 1 -- 172.21.15.82:0/3351469522 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1022954b0 msgr2=0x55c1022983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:34:27.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.980+0000 7f57ed19a700 1 --2- 172.21.15.82:0/3351469522 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1022954b0 0x55c1022983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:34:27.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.980+0000 7f57ed19a700 1 -- 172.21.15.82:0/3351469522 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c1022aff20 con 0x55c102294b90 2023-09-23T09:34:27.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.980+0000 7f57ee19c700 1 --2- 172.21.15.82:0/3351469522 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1022954b0 0x55c1022983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:34:27.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.980+0000 7f57ed19a700 1 --2- 172.21.15.82:0/3351469522 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c102294b90 0x55c102297e90 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x55c10229b9f0 tx=0x7f57dc009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a07fe21855ac54c2 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:34:27.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.981+0000 7f57d8bff700 1 -- 172.21.15.82:0/3351469522 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57dc016030 con 0x55c102294b90 2023-09-23T09:34:27.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.981+0000 7f57d8bff700 1 -- 172.21.15.82:0/3351469522 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f57dc017040 con 0x55c102294b90 2023-09-23T09:34:27.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.981+0000 7f57d8bff700 1 -- 172.21.15.82:0/3351469522 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57dc010430 con 0x55c102294b90 2023-09-23T09:34:27.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.982+0000 7f580346cb80 1 -- 172.21.15.82:0/3351469522 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c102294b90 msgr2=0x55c102297e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:34:27.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.982+0000 7f580346cb80 1 --2- 172.21.15.82:0/3351469522 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c102294b90 0x55c102297e90 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x55c10229b9f0 tx=0x7f57dc009260 comp rx=0 tx=0).stop 2023-09-23T09:34:27.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.982+0000 7f580346cb80 1 -- 172.21.15.82:0/3351469522 shutdown_connections 2023-09-23T09:34:27.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.982+0000 7f580346cb80 1 --2- 172.21.15.82:0/3351469522 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1022954b0 0x55c1022983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:34:27.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.982+0000 7f580346cb80 1 --2- 172.21.15.82:0/3351469522 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c10228f450 0x55c10229afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:34:27.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.982+0000 7f580346cb80 1 --2- 172.21.15.82:0/3351469522 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c102294b90 0x55c102297e90 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:34:27.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.982+0000 7f580346cb80 1 -- 172.21.15.82:0/3351469522 >> 172.21.15.82:0/3351469522 conn(0x55c1021fb0e0 msgr2=0x55c102292800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:34:27.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.982+0000 7f580346cb80 1 -- 172.21.15.82:0/3351469522 shutdown_connections 2023-09-23T09:34:27.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.982+0000 7f580346cb80 1 -- 172.21.15.82:0/3351469522 wait complete. 2023-09-23T09:34:27.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.982+0000 7f580346cb80 1 -- start start 2023-09-23T09:34:27.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.982+0000 7f580346cb80 1 Processor -- start 2023-09-23T09:34:27.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.983+0000 7f580346cb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c10228f450 0x55c102291c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:34:27.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.983+0000 7f580346cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c102294b90 0x55c102290610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:34:27.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.983+0000 7f580346cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1022954b0 0x55c102290b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:34:27.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.983+0000 7f580346cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c102292310 con 0x55c1022954b0 2023-09-23T09:34:27.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.983+0000 7f580346cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c102291090 con 0x55c102294b90 2023-09-23T09:34:27.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.983+0000 7f580346cb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c102291250 con 0x55c10228f450 2023-09-23T09:34:27.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.983+0000 7f580346cb80 10 client.0 _ll_register_callbacks cb 0x7f57e00047e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:34:27.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.984+0000 7f57ee19c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c10228f450 0x55c102291c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:34:27.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.984+0000 7f57ee19c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1022954b0 0x55c102290b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:34:27.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.984+0000 7f57ee19c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1022954b0 0x55c102290b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44700/0 (socket says 172.21.15.82:44700) 2023-09-23T09:34:27.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.984+0000 7f57ee19c700 1 -- 172.21.15.82:0/1569441254 learned_addr learned my addr 172.21.15.82:0/1569441254 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:34:27.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.984+0000 7f57ed19a700 1 --2- 172.21.15.82:0/1569441254 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c102294b90 0x55c102290610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:34:27.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.984+0000 7f57ee19c700 1 -- 172.21.15.82:0/1569441254 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c10228f450 msgr2=0x55c102291c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:34:27.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.984+0000 7f57ee19c700 1 --2- 172.21.15.82:0/1569441254 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c10228f450 0x55c102291c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:34:27.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.984+0000 7f57ee19c700 1 -- 172.21.15.82:0/1569441254 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c102294b90 msgr2=0x55c102290610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:34:27.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.984+0000 7f57ee19c700 1 --2- 172.21.15.82:0/1569441254 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c102294b90 0x55c102290610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:34:27.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.984+0000 7f57ee19c700 1 -- 172.21.15.82:0/1569441254 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c102004de0 con 0x55c1022954b0 2023-09-23T09:34:27.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.984+0000 7f57ed19a700 1 --2- 172.21.15.82:0/1569441254 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c102294b90 0x55c102290610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T09:34:27.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.985+0000 7f57ee19c700 1 --2- 172.21.15.82:0/1569441254 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1022954b0 0x55c102290b50 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f57e0004a30 tx=0x7f57e0009100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=202b0405cf7e9e62 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:34:27.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.985+0000 7f57d17fa700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:34:27.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.985+0000 7f57d17fa700 1 -- 172.21.15.82:0/1569441254 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e0019040 con 0x55c1022954b0 2023-09-23T09:34:27.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.985+0000 7f57d17fa700 1 -- 172.21.15.82:0/1569441254 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(151..151 src has 1..151) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f57e0031080 con 0x55c1022954b0 2023-09-23T09:34:27.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.985+0000 7f580346cb80 1 -- 172.21.15.82:0/1569441254 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c1022798b0 con 0x55c1022954b0 2023-09-23T09:34:27.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.985+0000 7f57d17fa700 1 -- 172.21.15.82:0/1569441254 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7f57e002c970 con 0x55c1022954b0 2023-09-23T09:34:27.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.985+0000 7f580346cb80 10 client.17976 fetch_fsmap learned FSMap version 112 2023-09-23T09:34:27.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.985+0000 7f580346cb80 1 -- 172.21.15.82:0/1569441254 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=4+}) v3 -- 0x55c101fedc60 con 0x55c1022954b0 2023-09-23T09:34:27.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.986+0000 7f57d17fa700 1 -- 172.21.15.82:0/1569441254 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55c1022798b0 con 0x55c1022954b0 2023-09-23T09:34:27.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.986+0000 7f57d17fa700 1 -- 172.21.15.82:0/1569441254 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 112) v1 ==== 7946+0+0 (secure 0 0 0) 0x7f57e0033050 con 0x55c1022954b0 2023-09-23T09:34:27.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.986+0000 7f580346cb80 10 client.17976 fetch_fsmap finished waiting for FSMap version 112 2023-09-23T09:34:27.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.986+0000 7f580346cb80 10 client.17976 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:34:27.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.986+0000 7f580346cb80 20 client.17976 populate_metadata read hostname 'smithi082' 2023-09-23T09:34:27.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.986+0000 7f580346cb80 1 --2- 172.21.15.82:0/1569441254 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55c1022f9c00 0x55c1022fa010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:34:27.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.986+0000 7f580346cb80 4 client.17976 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:34:27.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.986+0000 7f580346cb80 1 -- 172.21.15.82:0/1569441254 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55c1021d1970 con 0x55c1022f9c00 2023-09-23T09:34:27.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.987+0000 7f57ed19a700 1 --2- 172.21.15.82:0/1569441254 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55c1022f9c00 0x55c1022fa010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:34:27.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.988+0000 7f57d17fa700 10 client.17976 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:34:27.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.988+0000 7f57ed19a700 1 --2- 172.21.15.82:0/1569441254 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55c1022f9c00 0x55c1022fa010 crc :-1 s=READY pgs=248 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d39bb2dc578bf2c9 server_cookie=9dced4cdf4b15af6 in_seq=0 out_seq=0 2023-09-23T09:34:27.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.988+0000 7f57d17fa700 1 -- 172.21.15.82:0/1569441254 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55c1021d1970 con 0x55c1022f9c00 2023-09-23T09:34:27.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.988+0000 7f57d17fa700 10 client.17976 handle_command_reply: tid=0 2023-09-23T09:34:27.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.988+0000 7f580346cb80 1 client.17976 shutdown 2023-09-23T09:34:27.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.988+0000 7f580346cb80 1 -- 172.21.15.82:0/1569441254 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1022954b0 msgr2=0x55c102290b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:34:27.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.988+0000 7f580346cb80 1 --2- 172.21.15.82:0/1569441254 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1022954b0 0x55c102290b50 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f57e0004a30 tx=0x7f57e0009100 comp rx=0 tx=0).stop 2023-09-23T09:34:27.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.989+0000 7f580346cb80 1 -- 172.21.15.82:0/1569441254 shutdown_connections 2023-09-23T09:34:27.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.989+0000 7f580346cb80 1 --2- 172.21.15.82:0/1569441254 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55c1022f9c00 0x55c1022fa010 crc :-1 s=READY pgs=248 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:34:27.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.989+0000 7f580346cb80 1 --2- 172.21.15.82:0/1569441254 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1022954b0 0x55c102290b50 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:34:27.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.989+0000 7f57d17fa700 0 client.17976 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:34:27.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.989+0000 7f580346cb80 1 --2- 172.21.15.82:0/1569441254 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c10228f450 0x55c102291c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:34:27.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.989+0000 7f580346cb80 1 --2- 172.21.15.82:0/1569441254 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c102294b90 0x55c102290610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:34:27.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.989+0000 7f580346cb80 1 -- 172.21.15.82:0/1569441254 >> 172.21.15.82:0/1569441254 conn(0x55c1021fb0e0 msgr2=0x55c10227b2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:34:27.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.989+0000 7f580346cb80 1 -- 172.21.15.82:0/1569441254 shutdown_connections 2023-09-23T09:34:27.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.990+0000 7f580346cb80 1 -- 172.21.15.82:0/1569441254 wait complete. 2023-09-23T09:34:27.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.990+0000 7f580346cb80 20 client.17976 trim_cache size 0 max 16384 2023-09-23T09:34:27.993 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:34:27.993 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-23T09:34:27.993 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:34:27.993 INFO:teuthology.orchestra.run.smithi082.stdout: "d9e62ab8-1468-4fb0-a9fe-61bed13e954b": { 2023-09-23T09:34:27.994 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:34:27.994 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "d9e62ab8-1468-4fb0-a9fe-61bed13e954b", 2023-09-23T09:34:27.994 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:34:27.994 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:34:27.994 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:34:27.994 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:34:27.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.991+0000 7f57efbff700 1 -- 172.21.15.82:0/3466701994 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f57d40a00c0 msgr2=0x7f57d40a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:34:27.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.991+0000 7f57efbff700 1 --2- 172.21.15.82:0/3466701994 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f57d40a00c0 0x7f57d40a2580 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x55c102295910 tx=0x7f57e4005810 comp rx=0 tx=0).stop 2023-09-23T09:34:27.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.991+0000 7f57efbff700 1 -- 172.21.15.82:0/3466701994 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57e8102ac0 msgr2=0x7f57e819e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:34:27.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.991+0000 7f57efbff700 1 --2- 172.21.15.82:0/3466701994 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57e8102ac0 0x7f57e819e810 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f57e4005770 tx=0x7f57e40057a0 comp rx=0 tx=0).stop 2023-09-23T09:34:27.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.991+0000 7f57efbff700 1 -- 172.21.15.82:0/3466701994 shutdown_connections 2023-09-23T09:34:27.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.991+0000 7f57efbff700 1 --2- 172.21.15.82:0/3466701994 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f57d40a00c0 0x7f57d40a2580 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:34:27.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.991+0000 7f57efbff700 1 --2- 172.21.15.82:0/3466701994 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57e8108ad0 0x7f57e8198880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:34:27.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.991+0000 7f57efbff700 1 --2- 172.21.15.82:0/3466701994 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57e8102ac0 0x7f57e819e810 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:34:27.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.991+0000 7f57efbff700 1 --2- 172.21.15.82:0/3466701994 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57e8103480 0x7f57e819ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:34:27.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.991+0000 7f57efbff700 1 -- 172.21.15.82:0/3466701994 >> 172.21.15.82:0/3466701994 conn(0x7f57e80fe5b0 msgr2=0x7f57e81065d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:34:27.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.991+0000 7f57efbff700 1 -- 172.21.15.82:0/3466701994 shutdown_connections 2023-09-23T09:34:27.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:27.992+0000 7f57efbff700 1 -- 172.21.15.82:0/3466701994 wait complete. 2023-09-23T09:34:28.019 INFO:tasks.cephfs.filesystem:scrub status for tag:d9e62ab8-1468-4fb0-a9fe-61bed13e954b - {'path': '/', 'tag': 'd9e62ab8-1468-4fb0-a9fe-61bed13e954b', 'options': 'recursive,force'} 2023-09-23T09:34:29.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:34:29 smithi135 ceph-mon[99205]: pgmap v1192: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 3.2 MiB/s rd, 13 MiB/s wr, 1.26k op/s 2023-09-23T09:34:29.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:34:29 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:34:29.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:34:29 smithi082 ceph-mon[97694]: pgmap v1192: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 3.2 MiB/s rd, 13 MiB/s wr, 1.26k op/s 2023-09-23T09:34:29.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:34:29 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:34:29.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:34:29 smithi161 ceph-mon[99580]: pgmap v1192: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 3.2 MiB/s rd, 13 MiB/s wr, 1.26k op/s 2023-09-23T09:34:29.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:34:29 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:34:30.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 440.0 s, 205.4 tps, lat 487.484 ms stddev 472.044 2023-09-23T09:34:31.564 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:34:31 smithi135 ceph-mon[99205]: pgmap v1193: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 4.0 MiB/s rd, 13 MiB/s wr, 1.37k op/s 2023-09-23T09:34:31.564 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:34:31 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:34:31.565 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:34:31 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:34:31.565 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:34:31 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:34:31.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:34:31 smithi082 ceph-mon[97694]: pgmap v1193: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 4.0 MiB/s rd, 13 MiB/s wr, 1.37k op/s 2023-09-23T09:34:31.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:34:31 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:34:31.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:34:31 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:34:31.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:34:31 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:34:31.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:34:31 smithi161 ceph-mon[99580]: pgmap v1193: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 4.0 MiB/s rd, 13 MiB/s wr, 1.37k op/s 2023-09-23T09:34:31.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:34:31 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:34:31.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:34:31 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:34:31.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:34:31 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:34:33.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:34:33 smithi135 ceph-mon[99205]: pgmap v1194: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 3.0 MiB/s rd, 8.8 MiB/s wr, 962 op/s 2023-09-23T09:34:33.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:34:33 smithi082 ceph-mon[97694]: pgmap v1194: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 3.0 MiB/s rd, 8.8 MiB/s wr, 962 op/s 2023-09-23T09:34:33.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:34:33 smithi161 ceph-mon[99580]: pgmap v1194: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 3.0 MiB/s rd, 8.8 MiB/s wr, 962 op/s 2023-09-23T09:34:35.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:34:35 smithi135 ceph-mon[99205]: pgmap v1195: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.8 MiB/s rd, 8.1 MiB/s wr, 885 op/s 2023-09-23T09:34:35.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:34:35 smithi082 ceph-mon[97694]: pgmap v1195: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.8 MiB/s rd, 8.1 MiB/s wr, 885 op/s 2023-09-23T09:34:35.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:34:35 smithi161 ceph-mon[99580]: pgmap v1195: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.8 MiB/s rd, 8.1 MiB/s wr, 885 op/s 2023-09-23T09:34:35.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 445.0 s, 207.6 tps, lat 476.771 ms stddev 469.202 2023-09-23T09:34:37.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:34:37 smithi135 ceph-mon[99205]: pgmap v1196: 97 pgs: 97 active+clean; 16 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 4.2 MiB/s rd, 11 MiB/s wr, 1.26k op/s 2023-09-23T09:34:37.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:34:37 smithi082 ceph-mon[97694]: pgmap v1196: 97 pgs: 97 active+clean; 16 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 4.2 MiB/s rd, 11 MiB/s wr, 1.26k op/s 2023-09-23T09:34:37.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:34:37 smithi161 ceph-mon[99580]: pgmap v1196: 97 pgs: 97 active+clean; 16 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 4.2 MiB/s rd, 11 MiB/s wr, 1.26k op/s 2023-09-23T09:34:38.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:34:38 smithi135 ceph-mon[99205]: pgmap v1197: 97 pgs: 97 active+clean; 16 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.4 MiB/s wr, 698 op/s 2023-09-23T09:34:38.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:34:38 smithi082 ceph-mon[97694]: pgmap v1197: 97 pgs: 97 active+clean; 16 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.4 MiB/s wr, 698 op/s 2023-09-23T09:34:38.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:34:38 smithi161 ceph-mon[99580]: pgmap v1197: 97 pgs: 97 active+clean; 16 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.4 MiB/s wr, 698 op/s 2023-09-23T09:34:40.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 450.0 s, 167.6 tps, lat 600.887 ms stddev 524.939 2023-09-23T09:34:41.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:34:40 smithi135 ceph-mon[99205]: pgmap v1198: 97 pgs: 97 active+clean; 16 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 3.9 MiB/s rd, 8.1 MiB/s wr, 1.01k op/s 2023-09-23T09:34:41.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:34:40 smithi082 ceph-mon[97694]: pgmap v1198: 97 pgs: 97 active+clean; 16 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 3.9 MiB/s rd, 8.1 MiB/s wr, 1.01k op/s 2023-09-23T09:34:41.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:34:40 smithi161 ceph-mon[99580]: pgmap v1198: 97 pgs: 97 active+clean; 16 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 3.9 MiB/s rd, 8.1 MiB/s wr, 1.01k op/s 2023-09-23T09:34:43.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:34:43 smithi135 ceph-mon[99205]: pgmap v1199: 97 pgs: 97 active+clean; 16 GiB data, 61 GiB used, 1011 GiB / 1.0 TiB avail; 2.9 MiB/s rd, 6.9 MiB/s wr, 788 op/s 2023-09-23T09:34:43.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:34:43 smithi082 ceph-mon[97694]: pgmap v1199: 97 pgs: 97 active+clean; 16 GiB data, 61 GiB used, 1011 GiB / 1.0 TiB avail; 2.9 MiB/s rd, 6.9 MiB/s wr, 788 op/s 2023-09-23T09:34:43.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:34:43 smithi161 ceph-mon[99580]: pgmap v1199: 97 pgs: 97 active+clean; 16 GiB data, 61 GiB used, 1011 GiB / 1.0 TiB avail; 2.9 MiB/s rd, 6.9 MiB/s wr, 788 op/s 2023-09-23T09:34:45.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:34:45 smithi135 ceph-mon[99205]: pgmap v1200: 97 pgs: 97 active+clean; 16 GiB data, 61 GiB used, 1011 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.8 MiB/s wr, 724 op/s 2023-09-23T09:34:45.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:34:45 smithi082 ceph-mon[97694]: pgmap v1200: 97 pgs: 97 active+clean; 16 GiB data, 61 GiB used, 1011 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.8 MiB/s wr, 724 op/s 2023-09-23T09:34:45.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:34:45 smithi161 ceph-mon[99580]: pgmap v1200: 97 pgs: 97 active+clean; 16 GiB data, 61 GiB used, 1011 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.8 MiB/s wr, 724 op/s 2023-09-23T09:34:45.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 455.0 s, 187.0 tps, lat 529.683 ms stddev 462.557 2023-09-23T09:34:47.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:34:47 smithi135 ceph-mon[99205]: pgmap v1201: 97 pgs: 97 active+clean; 16 GiB data, 61 GiB used, 1011 GiB / 1.0 TiB avail; 4.1 MiB/s rd, 8.3 MiB/s wr, 1.04k op/s 2023-09-23T09:34:47.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:34:47 smithi082 ceph-mon[97694]: pgmap v1201: 97 pgs: 97 active+clean; 16 GiB data, 61 GiB used, 1011 GiB / 1.0 TiB avail; 4.1 MiB/s rd, 8.3 MiB/s wr, 1.04k op/s 2023-09-23T09:34:47.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:34:47 smithi161 ceph-mon[99580]: pgmap v1201: 97 pgs: 97 active+clean; 16 GiB data, 61 GiB used, 1011 GiB / 1.0 TiB avail; 4.1 MiB/s rd, 8.3 MiB/s wr, 1.04k op/s 2023-09-23T09:34:49.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:34:49 smithi135 ceph-mon[99205]: pgmap v1202: 97 pgs: 97 active+clean; 16 GiB data, 61 GiB used, 1011 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.4 MiB/s wr, 671 op/s 2023-09-23T09:34:49.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:34:49 smithi082 ceph-mon[97694]: pgmap v1202: 97 pgs: 97 active+clean; 16 GiB data, 61 GiB used, 1011 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.4 MiB/s wr, 671 op/s 2023-09-23T09:34:49.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:34:49 smithi161 ceph-mon[99580]: pgmap v1202: 97 pgs: 97 active+clean; 16 GiB data, 61 GiB used, 1011 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.4 MiB/s wr, 671 op/s 2023-09-23T09:34:50.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 460.0 s, 183.2 tps, lat 554.857 ms stddev 518.699 2023-09-23T09:34:51.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:34:51 smithi135 ceph-mon[99205]: pgmap v1203: 97 pgs: 97 active+clean; 16 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 4.0 MiB/s rd, 8.1 MiB/s wr, 977 op/s 2023-09-23T09:34:51.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:34:51 smithi082 ceph-mon[97694]: pgmap v1203: 97 pgs: 97 active+clean; 16 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 4.0 MiB/s rd, 8.1 MiB/s wr, 977 op/s 2023-09-23T09:34:51.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:34:51 smithi161 ceph-mon[99580]: pgmap v1203: 97 pgs: 97 active+clean; 16 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 4.0 MiB/s rd, 8.1 MiB/s wr, 977 op/s 2023-09-23T09:34:53.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:34:53 smithi135 ceph-mon[99205]: pgmap v1204: 97 pgs: 97 active+clean; 16 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.5 MiB/s wr, 700 op/s 2023-09-23T09:34:53.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:34:53 smithi082 ceph-mon[97694]: pgmap v1204: 97 pgs: 97 active+clean; 16 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.5 MiB/s wr, 700 op/s 2023-09-23T09:34:53.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:34:53 smithi161 ceph-mon[99580]: pgmap v1204: 97 pgs: 97 active+clean; 16 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.5 MiB/s wr, 700 op/s 2023-09-23T09:34:55.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:34:55 smithi135 ceph-mon[99205]: pgmap v1205: 97 pgs: 97 active+clean; 16 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.3 MiB/s wr, 662 op/s 2023-09-23T09:34:55.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:34:55 smithi082 ceph-mon[97694]: pgmap v1205: 97 pgs: 97 active+clean; 16 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.3 MiB/s wr, 662 op/s 2023-09-23T09:34:55.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:34:55 smithi161 ceph-mon[99580]: pgmap v1205: 97 pgs: 97 active+clean; 16 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.3 MiB/s wr, 662 op/s 2023-09-23T09:34:55.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 465.0 s, 192.8 tps, lat 509.323 ms stddev 476.429 2023-09-23T09:34:57.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:34:57 smithi135 ceph-mon[99205]: pgmap v1206: 97 pgs: 97 active+clean; 16 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 4.2 MiB/s rd, 7.8 MiB/s wr, 980 op/s 2023-09-23T09:34:57.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:34:57 smithi082 ceph-mon[97694]: pgmap v1206: 97 pgs: 97 active+clean; 16 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 4.2 MiB/s rd, 7.8 MiB/s wr, 980 op/s 2023-09-23T09:34:57.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:34:57 smithi161 ceph-mon[99580]: pgmap v1206: 97 pgs: 97 active+clean; 16 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 4.2 MiB/s rd, 7.8 MiB/s wr, 980 op/s 2023-09-23T09:34:58.020 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:34:58.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.343+0000 7fe0415ff700 1 -- 172.21.15.82:0/4192349819 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe03c106880 msgr2=0x7fe03c106c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:34:58.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.343+0000 7fe0415ff700 1 --2- 172.21.15.82:0/4192349819 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe03c106880 0x7fe03c106c60 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fe0340098f0 tx=0x7fe034009c00 comp rx=0 tx=0).stop 2023-09-23T09:34:58.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.343+0000 7fe0415ff700 1 -- 172.21.15.82:0/4192349819 shutdown_connections 2023-09-23T09:34:58.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.343+0000 7fe0415ff700 1 --2- 172.21.15.82:0/4192349819 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe03c101230 0x7fe03c10d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:34:58.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.343+0000 7fe0415ff700 1 --2- 172.21.15.82:0/4192349819 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe03c106880 0x7fe03c106c60 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:34:58.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.343+0000 7fe0415ff700 1 --2- 172.21.15.82:0/4192349819 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe03c100870 0x7fe03c100cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:34:58.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.343+0000 7fe0415ff700 1 -- 172.21.15.82:0/4192349819 >> 172.21.15.82:0/4192349819 conn(0x7fe03c0fc3a0 msgr2=0x7fe03c0fe7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:34:58.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.344+0000 7fe0415ff700 1 -- 172.21.15.82:0/4192349819 shutdown_connections 2023-09-23T09:34:58.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.345+0000 7fe0415ff700 1 -- 172.21.15.82:0/4192349819 wait complete. 2023-09-23T09:34:58.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.346+0000 7fe0415ff700 1 Processor -- start 2023-09-23T09:34:58.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.346+0000 7fe0415ff700 1 -- start start 2023-09-23T09:34:58.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.347+0000 7fe0415ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe03c101230 0x7fe03c1ab680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:34:58.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.347+0000 7fe0415ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe03c106880 0x7fe03c1abbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:34:58.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.347+0000 7fe0415ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe03c1a5e70 0x7fe03c1a6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:34:58.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.347+0000 7fe0415ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe03c1a6930 con 0x7fe03c1a5e70 2023-09-23T09:34:58.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.347+0000 7fe0415ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe03c1a6aa0 con 0x7fe03c106880 2023-09-23T09:34:58.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.347+0000 7fe0415ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe03c1a6c60 con 0x7fe03c101230 2023-09-23T09:34:58.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.347+0000 7fe03b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe03c1a5e70 0x7fe03c1a6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:34:58.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.348+0000 7fe03b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe03c1a5e70 0x7fe03c1a6320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48358/0 (socket says 172.21.15.82:48358) 2023-09-23T09:34:58.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.348+0000 7fe03b7fe700 1 -- 172.21.15.82:0/1015691626 learned_addr learned my addr 172.21.15.82:0/1015691626 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:34:58.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.348+0000 7fe03a7fc700 1 --2- 172.21.15.82:0/1015691626 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe03c106880 0x7fe03c1abbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:34:58.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.348+0000 7fe03affd700 1 --2- 172.21.15.82:0/1015691626 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe03c101230 0x7fe03c1ab680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:34:58.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.348+0000 7fe03b7fe700 1 -- 172.21.15.82:0/1015691626 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe03c101230 msgr2=0x7fe03c1ab680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:34:58.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.348+0000 7fe03b7fe700 1 --2- 172.21.15.82:0/1015691626 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe03c101230 0x7fe03c1ab680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:34:58.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.348+0000 7fe03b7fe700 1 -- 172.21.15.82:0/1015691626 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe03c106880 msgr2=0x7fe03c1abbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:34:58.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.348+0000 7fe03b7fe700 1 --2- 172.21.15.82:0/1015691626 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe03c106880 0x7fe03c1abbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:34:58.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.348+0000 7fe03b7fe700 1 -- 172.21.15.82:0/1015691626 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe034009520 con 0x7fe03c1a5e70 2023-09-23T09:34:58.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.349+0000 7fe03b7fe700 1 --2- 172.21.15.82:0/1015691626 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe03c1a5e70 0x7fe03c1a6320 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fe02c007ee0 tx=0x7fe02c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:34:58.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.350+0000 7fe023fff700 1 -- 172.21.15.82:0/1015691626 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe02c017070 con 0x7fe03c1a5e70 2023-09-23T09:34:58.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.350+0000 7fe023fff700 1 -- 172.21.15.82:0/1015691626 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe02c00f040 con 0x7fe03c1a5e70 2023-09-23T09:34:58.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.350+0000 7fe023fff700 1 -- 172.21.15.82:0/1015691626 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe02c005710 con 0x7fe03c1a5e70 2023-09-23T09:34:58.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.350+0000 7fe0415ff700 1 -- 172.21.15.82:0/1015691626 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe03c1b24f0 con 0x7fe03c1a5e70 2023-09-23T09:34:58.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.350+0000 7fe0415ff700 1 -- 172.21.15.82:0/1015691626 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe03c1b29b0 con 0x7fe03c1a5e70 2023-09-23T09:34:58.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.356+0000 7fe023fff700 1 -- 172.21.15.82:0/1015691626 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7fe02c005870 con 0x7fe03c1a5e70 2023-09-23T09:34:58.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.357+0000 7fe054f9fb80 1 Processor -- start 2023-09-23T09:34:58.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.358+0000 7fe054f9fb80 1 -- start start 2023-09-23T09:34:58.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.358+0000 7fe054f9fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6c800f380 0x55a6c800f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:34:58.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.358+0000 7fe054f9fb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a6c800fca0 0x55a6c8009700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:34:58.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.358+0000 7fe054f9fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a6c8009c40 0x55a6c800a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:34:58.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.358+0000 7fe054f9fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6c7f717b0 con 0x55a6c800f380 2023-09-23T09:34:58.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.358+0000 7fe054f9fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6c7f62780 con 0x55a6c8009c40 2023-09-23T09:34:58.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.358+0000 7fe054f9fb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6c7f600a0 con 0x55a6c800fca0 2023-09-23T09:34:58.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.359+0000 7fe03affd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a6c800fca0 0x55a6c8009700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:34:58.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.359+0000 7fe03affd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a6c800fca0 0x55a6c8009700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:38492/0 (socket says 172.21.15.82:38492) 2023-09-23T09:34:58.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.359+0000 7fe03affd700 1 -- 172.21.15.82:0/2829761918 learned_addr learned my addr 172.21.15.82:0/2829761918 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:34:58.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.359+0000 7fe023fff700 1 --2- 172.21.15.82:0/1015691626 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fe0240a0210 0x7fe0240a26d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:34:58.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.359+0000 7fe03a7fc700 1 --2- 172.21.15.82:0/2829761918 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a6c8009c40 0x55a6c800a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:34:58.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.360+0000 7fe03a7fc700 1 --2- 172.21.15.82:0/2829761918 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6c800f380 0x55a6c800f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:34:58.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.360+0000 7fe03affd700 1 -- 172.21.15.82:0/2829761918 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a6c8009c40 msgr2=0x55a6c800a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:34:58.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.360+0000 7fe03affd700 1 --2- 172.21.15.82:0/2829761918 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a6c8009c40 0x55a6c800a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:34:58.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.360+0000 7fe03affd700 1 -- 172.21.15.82:0/2829761918 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6c800f380 msgr2=0x55a6c800f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:34:58.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.360+0000 7fe023fff700 1 -- 172.21.15.82:0/1015691626 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fe02c0ce170 con 0x7fe03c1a5e70 2023-09-23T09:34:58.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.360+0000 7fe03affd700 1 --2- 172.21.15.82:0/2829761918 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6c800f380 0x55a6c800f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:34:58.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.360+0000 7fe03affd700 1 -- 172.21.15.82:0/2829761918 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a6c7ddb630 con 0x55a6c800fca0 2023-09-23T09:34:58.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.360+0000 7fe03a7fc700 1 --2- 172.21.15.82:0/2829761918 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6c800f380 0x55a6c800f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T09:34:58.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.360+0000 7fe03b7fe700 1 --2- 172.21.15.82:0/1015691626 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fe0240a0210 0x7fe0240a26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:34:58.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.360+0000 7fe03affd700 1 --2- 172.21.15.82:0/2829761918 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a6c800fca0 0x55a6c8009700 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe034016000 tx=0x7fe034009480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=323c92fe04bb2e40 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:34:58.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.361+0000 7fe0217fa700 1 -- 172.21.15.82:0/2829761918 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe03401c040 con 0x55a6c800fca0 2023-09-23T09:34:58.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.361+0000 7fe0217fa700 1 -- 172.21.15.82:0/2829761918 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe03400fe80 con 0x55a6c800fca0 2023-09-23T09:34:58.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.361+0000 7fe0217fa700 1 -- 172.21.15.82:0/2829761918 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0340052a0 con 0x55a6c800fca0 2023-09-23T09:34:58.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.362+0000 7fe054f9fb80 1 -- 172.21.15.82:0/2829761918 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a6c800fca0 msgr2=0x55a6c8009700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:34:58.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.362+0000 7fe03b7fe700 1 --2- 172.21.15.82:0/1015691626 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fe0240a0210 0x7fe0240a26d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe03c1b2b40 tx=0x7fe02c00b040 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:34:58.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.362+0000 7fe054f9fb80 1 --2- 172.21.15.82:0/2829761918 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a6c800fca0 0x55a6c8009700 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe034016000 tx=0x7fe034009480 comp rx=0 tx=0).stop 2023-09-23T09:34:58.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.362+0000 7fe054f9fb80 1 -- 172.21.15.82:0/2829761918 shutdown_connections 2023-09-23T09:34:58.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.362+0000 7fe054f9fb80 1 --2- 172.21.15.82:0/2829761918 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a6c8009c40 0x55a6c800a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:34:58.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.362+0000 7fe054f9fb80 1 --2- 172.21.15.82:0/2829761918 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6c800f380 0x55a6c800f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:34:58.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.362+0000 7fe054f9fb80 1 --2- 172.21.15.82:0/2829761918 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a6c800fca0 0x55a6c8009700 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:34:58.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.362+0000 7fe054f9fb80 1 -- 172.21.15.82:0/2829761918 >> 172.21.15.82:0/2829761918 conn(0x55a6c7f7e0e0 msgr2=0x55a6c8004410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:34:58.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.362+0000 7fe054f9fb80 1 -- 172.21.15.82:0/2829761918 shutdown_connections 2023-09-23T09:34:58.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.362+0000 7fe054f9fb80 1 -- 172.21.15.82:0/2829761918 wait complete. 2023-09-23T09:34:58.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.363+0000 7fe054f9fb80 1 -- start start 2023-09-23T09:34:58.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.364+0000 7fe054f9fb80 1 Processor -- start 2023-09-23T09:34:58.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.364+0000 7fe054f9fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a6c8009c40 0x55a6c8015c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:34:58.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.364+0000 7fe054f9fb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a6c800f380 0x55a6c8012e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:34:58.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.364+0000 7fe054f9fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6c800fca0 0x55a6c8013500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:34:58.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.364+0000 7fe054f9fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6c7f5b990 con 0x55a6c800fca0 2023-09-23T09:34:58.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.364+0000 7fe054f9fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6c7ef9bb0 con 0x55a6c8009c40 2023-09-23T09:34:58.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.364+0000 7fe054f9fb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6c7ef98b0 con 0x55a6c800f380 2023-09-23T09:34:58.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.364+0000 7fe054f9fb80 10 client.0 _ll_register_callbacks cb 0x55a6c7e43a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:34:58.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.365+0000 7fe03affd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a6c800f380 0x55a6c8012e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:34:58.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.365+0000 7fe03affd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a6c800f380 0x55a6c8012e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:38504/0 (socket says 172.21.15.82:38504) 2023-09-23T09:34:58.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.365+0000 7fe03affd700 1 -- 172.21.15.82:0/3786451562 learned_addr learned my addr 172.21.15.82:0/3786451562 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:34:58.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.365+0000 7fe03a7fc700 1 --2- 172.21.15.82:0/3786451562 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a6c8009c40 0x55a6c8015c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:34:58.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.365+0000 7fe03affd700 1 -- 172.21.15.82:0/3786451562 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a6c8009c40 msgr2=0x55a6c8015c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:34:58.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.365+0000 7fe03affd700 1 --2- 172.21.15.82:0/3786451562 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a6c8009c40 0x55a6c8015c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:34:58.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.365+0000 7fe03affd700 1 -- 172.21.15.82:0/3786451562 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6c800fca0 msgr2=0x55a6c8013500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:34:58.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.365+0000 7fe03affd700 1 --2- 172.21.15.82:0/3786451562 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6c800fca0 0x55a6c8013500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:34:58.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.366+0000 7fe03affd700 1 -- 172.21.15.82:0/3786451562 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe03c10e040 con 0x55a6c800f380 2023-09-23T09:34:58.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.366+0000 7fe03affd700 1 --2- 172.21.15.82:0/3786451562 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a6c800f380 0x55a6c8012e80 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fe034009810 tx=0x7fe034005e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3579ee12da1344a5 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:34:58.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.366+0000 7fe01eff5700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T09:34:58.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.366+0000 7fe01eff5700 1 -- 172.21.15.82:0/3786451562 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe03401c070 con 0x55a6c800f380 2023-09-23T09:34:58.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.367+0000 7fe054f9fb80 1 -- 172.21.15.82:0/3786451562 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a6c7fd91c0 con 0x55a6c800f380 2023-09-23T09:34:58.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.367+0000 7fe01eff5700 1 -- 172.21.15.82:0/3786451562 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(151..151 src has 1..151) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fe03400f870 con 0x55a6c800f380 2023-09-23T09:34:58.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.367+0000 7fe01eff5700 1 -- 172.21.15.82:0/3786451562 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe03402b430 con 0x55a6c800f380 2023-09-23T09:34:58.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.367+0000 7fe054f9fb80 10 client.27754 fetch_fsmap learned FSMap version 112 2023-09-23T09:34:58.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.367+0000 7fe054f9fb80 1 -- 172.21.15.82:0/3786451562 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=4+}) v3 -- 0x55a6c7d87de0 con 0x55a6c800f380 2023-09-23T09:34:58.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.368+0000 7fe01eff5700 1 -- 172.21.15.82:0/3786451562 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55a6c7fd91c0 con 0x55a6c800f380 2023-09-23T09:34:58.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.368+0000 7fe01eff5700 1 -- 172.21.15.82:0/3786451562 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 112) v1 ==== 7946+0+0 (secure 0 0 0) 0x7fe034015020 con 0x55a6c800f380 2023-09-23T09:34:58.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.368+0000 7fe054f9fb80 10 client.27754 fetch_fsmap finished waiting for FSMap version 112 2023-09-23T09:34:58.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.368+0000 7fe054f9fb80 10 client.27754 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:34:58.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.368+0000 7fe054f9fb80 20 client.27754 populate_metadata read hostname 'smithi082' 2023-09-23T09:34:58.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.368+0000 7fe054f9fb80 1 --2- 172.21.15.82:0/3786451562 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55a6c80233a0 0x55a6c80257c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:34:58.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.368+0000 7fe054f9fb80 4 client.27754 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:34:58.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.368+0000 7fe054f9fb80 1 -- 172.21.15.82:0/3786451562 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a6c7f01ba0 con 0x55a6c80233a0 2023-09-23T09:34:58.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.368+0000 7fe03a7fc700 1 --2- 172.21.15.82:0/3786451562 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55a6c80233a0 0x55a6c80257c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:34:58.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.369+0000 7fe01eff5700 10 client.27754 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:34:58.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.369+0000 7fe03a7fc700 1 --2- 172.21.15.82:0/3786451562 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55a6c80233a0 0x55a6c80257c0 crc :-1 s=READY pgs=249 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=264e42849ea9b264 server_cookie=7356815b1b34b3db in_seq=0 out_seq=0 2023-09-23T09:34:58.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.370+0000 7fe01eff5700 1 -- 172.21.15.82:0/3786451562 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a6c7f01ba0 con 0x55a6c80233a0 2023-09-23T09:34:58.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.370+0000 7fe01eff5700 10 client.27754 handle_command_reply: tid=0 2023-09-23T09:34:58.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.370+0000 7fe054f9fb80 1 client.27754 shutdown 2023-09-23T09:34:58.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.371+0000 7fe054f9fb80 1 -- 172.21.15.82:0/3786451562 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a6c800f380 msgr2=0x55a6c8012e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:34:58.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.371+0000 7fe054f9fb80 1 --2- 172.21.15.82:0/3786451562 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a6c800f380 0x55a6c8012e80 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fe034009810 tx=0x7fe034005e30 comp rx=0 tx=0).stop 2023-09-23T09:34:58.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.371+0000 7fe054f9fb80 1 -- 172.21.15.82:0/3786451562 shutdown_connections 2023-09-23T09:34:58.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.371+0000 7fe054f9fb80 1 --2- 172.21.15.82:0/3786451562 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55a6c80233a0 0x55a6c80257c0 crc :-1 s=READY pgs=249 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:34:58.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.371+0000 7fe054f9fb80 1 --2- 172.21.15.82:0/3786451562 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6c800fca0 0x55a6c8013500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:34:58.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.371+0000 7fe054f9fb80 1 --2- 172.21.15.82:0/3786451562 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a6c8009c40 0x55a6c8015c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:34:58.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.371+0000 7fe054f9fb80 1 --2- 172.21.15.82:0/3786451562 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a6c800f380 0x55a6c8012e80 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:34:58.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.371+0000 7fe054f9fb80 1 -- 172.21.15.82:0/3786451562 >> 172.21.15.82:0/3786451562 conn(0x55a6c7f7e0e0 msgr2=0x55a6c7ffeb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:34:58.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.371+0000 7fe01eff5700 0 client.27754 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:34:58.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.371+0000 7fe054f9fb80 1 -- 172.21.15.82:0/3786451562 shutdown_connections 2023-09-23T09:34:58.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.371+0000 7fe054f9fb80 1 -- 172.21.15.82:0/3786451562 wait complete. 2023-09-23T09:34:58.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.372+0000 7fe054f9fb80 20 client.27754 trim_cache size 0 max 16384 2023-09-23T09:34:58.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.404+0000 7fe054f9fb80 1 Processor -- start 2023-09-23T09:34:58.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.404+0000 7fe054f9fb80 1 -- start start 2023-09-23T09:34:58.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.404+0000 7fe054f9fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a6c8009c40 0x55a6c80040a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:34:58.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.404+0000 7fe054f9fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6c800f380 0x55a6c800d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:34:58.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.404+0000 7fe054f9fb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a6c800fca0 0x55a6c800d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:34:58.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.404+0000 7fe054f9fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6c7ddd920 con 0x55a6c800f380 2023-09-23T09:34:58.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.404+0000 7fe054f9fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6c8000c80 con 0x55a6c8009c40 2023-09-23T09:34:58.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.404+0000 7fe054f9fb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6c8020080 con 0x55a6c800fca0 2023-09-23T09:34:58.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.405+0000 7fe03a7fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a6c8009c40 0x55a6c80040a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:34:58.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.405+0000 7fe03a7fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a6c8009c40 0x55a6c80040a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:38146/0 (socket says 172.21.15.82:38146) 2023-09-23T09:34:58.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.405+0000 7fe03a7fc700 1 -- 172.21.15.82:0/2559069456 learned_addr learned my addr 172.21.15.82:0/2559069456 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:34:58.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.405+0000 7fe03a7fc700 1 --2- 172.21.15.82:0/2559069456 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a6c800fca0 0x55a6c800d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:34:58.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.406+0000 7fe03a7fc700 1 -- 172.21.15.82:0/2559069456 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a6c800fca0 msgr2=0x55a6c800d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:34:58.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.406+0000 7fe03a7fc700 1 --2- 172.21.15.82:0/2559069456 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a6c800fca0 0x55a6c800d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:34:58.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.406+0000 7fe03a7fc700 1 -- 172.21.15.82:0/2559069456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6c800f380 msgr2=0x55a6c800d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:34:58.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.406+0000 7fe03a7fc700 1 --2- 172.21.15.82:0/2559069456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6c800f380 0x55a6c800d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:34:58.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.406+0000 7fe03a7fc700 1 -- 172.21.15.82:0/2559069456 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a6c7d70c60 con 0x55a6c8009c40 2023-09-23T09:34:58.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.406+0000 7fe03a7fc700 1 --2- 172.21.15.82:0/2559069456 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a6c8009c40 0x55a6c80040a0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe030009e40 tx=0x7fe030013040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49a07bd667c3e1a0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:34:58.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.406+0000 7fe021ffb700 1 -- 172.21.15.82:0/2559069456 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe030016070 con 0x55a6c8009c40 2023-09-23T09:34:58.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.407+0000 7fe021ffb700 1 -- 172.21.15.82:0/2559069456 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe030048020 con 0x55a6c8009c40 2023-09-23T09:34:58.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.407+0000 7fe021ffb700 1 -- 172.21.15.82:0/2559069456 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe030042850 con 0x55a6c8009c40 2023-09-23T09:34:58.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.407+0000 7fe054f9fb80 1 -- 172.21.15.82:0/2559069456 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a6c8009c40 msgr2=0x55a6c80040a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:34:58.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.407+0000 7fe054f9fb80 1 --2- 172.21.15.82:0/2559069456 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a6c8009c40 0x55a6c80040a0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe030009e40 tx=0x7fe030013040 comp rx=0 tx=0).stop 2023-09-23T09:34:58.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.408+0000 7fe054f9fb80 1 -- 172.21.15.82:0/2559069456 shutdown_connections 2023-09-23T09:34:58.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.408+0000 7fe054f9fb80 1 --2- 172.21.15.82:0/2559069456 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a6c800fca0 0x55a6c800d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:34:58.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.408+0000 7fe054f9fb80 1 --2- 172.21.15.82:0/2559069456 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a6c8009c40 0x55a6c80040a0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:34:58.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.408+0000 7fe054f9fb80 1 --2- 172.21.15.82:0/2559069456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6c800f380 0x55a6c800d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:34:58.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.408+0000 7fe054f9fb80 1 -- 172.21.15.82:0/2559069456 >> 172.21.15.82:0/2559069456 conn(0x55a6c7f7e0e0 msgr2=0x55a6c801ef20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:34:58.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.408+0000 7fe054f9fb80 1 -- 172.21.15.82:0/2559069456 shutdown_connections 2023-09-23T09:34:58.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.408+0000 7fe054f9fb80 1 -- 172.21.15.82:0/2559069456 wait complete. 2023-09-23T09:34:58.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.409+0000 7fe054f9fb80 1 -- start start 2023-09-23T09:34:58.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.409+0000 7fe054f9fb80 1 Processor -- start 2023-09-23T09:34:58.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.410+0000 7fe054f9fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6c8009c40 0x55a6c800c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:34:58.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.410+0000 7fe054f9fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a6c800f380 0x55a6c800c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:34:58.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.410+0000 7fe054f9fb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a6c800fca0 0x55a6c800ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:34:58.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.410+0000 7fe054f9fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6c800b3b0 con 0x55a6c8009c40 2023-09-23T09:34:58.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.410+0000 7fe054f9fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6c800b520 con 0x55a6c800f380 2023-09-23T09:34:58.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.410+0000 7fe054f9fb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6c800b6e0 con 0x55a6c800fca0 2023-09-23T09:34:58.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.410+0000 7fe054f9fb80 10 client.0 _ll_register_callbacks cb 0x7fe0300091e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:34:58.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.410+0000 7fe03affd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a6c800f380 0x55a6c800c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:34:58.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.410+0000 7fe03affd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a6c800f380 0x55a6c800c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:38150/0 (socket says 172.21.15.82:38150) 2023-09-23T09:34:58.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.410+0000 7fe03affd700 1 -- 172.21.15.82:0/3909882734 learned_addr learned my addr 172.21.15.82:0/3909882734 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:34:58.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.410+0000 7fe03a7fc700 1 --2- 172.21.15.82:0/3909882734 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a6c800fca0 0x55a6c800ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:34:58.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.410+0000 7fe03a7fc700 1 --2- 172.21.15.82:0/3909882734 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6c8009c40 0x55a6c800c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:34:58.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.411+0000 7fe03affd700 1 -- 172.21.15.82:0/3909882734 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a6c800fca0 msgr2=0x55a6c800ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:34:58.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.411+0000 7fe03affd700 1 --2- 172.21.15.82:0/3909882734 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a6c800fca0 0x55a6c800ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:34:58.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.411+0000 7fe03affd700 1 -- 172.21.15.82:0/3909882734 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6c8009c40 msgr2=0x55a6c800c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:34:58.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.411+0000 7fe03affd700 1 --2- 172.21.15.82:0/3909882734 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6c8009c40 0x55a6c800c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:34:58.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.411+0000 7fe03affd700 1 -- 172.21.15.82:0/3909882734 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe030042b80 con 0x55a6c800f380 2023-09-23T09:34:58.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.411+0000 7fe03affd700 1 --2- 172.21.15.82:0/3909882734 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a6c800f380 0x55a6c800c6c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fe034017640 tx=0x7fe03400f920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c2c90cf92fdc1af server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:34:58.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.411+0000 7fe01eff5700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-09-23T09:34:58.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.412+0000 7fe01eff5700 1 -- 172.21.15.82:0/3909882734 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe03401c070 con 0x55a6c800f380 2023-09-23T09:34:58.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.412+0000 7fe01eff5700 1 -- 172.21.15.82:0/3909882734 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(151..151 src has 1..151) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fe034000e40 con 0x55a6c800f380 2023-09-23T09:34:58.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.412+0000 7fe054f9fb80 1 -- 172.21.15.82:0/3909882734 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a6c7ffc8b0 con 0x55a6c800f380 2023-09-23T09:34:58.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.412+0000 7fe01eff5700 1 -- 172.21.15.82:0/3909882734 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe034017400 con 0x55a6c800f380 2023-09-23T09:34:58.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.412+0000 7fe054f9fb80 10 client.27731 fetch_fsmap learned FSMap version 112 2023-09-23T09:34:58.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.412+0000 7fe054f9fb80 1 -- 172.21.15.82:0/3909882734 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=4+}) v3 -- 0x55a6c7dae250 con 0x55a6c800f380 2023-09-23T09:34:58.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.413+0000 7fe01eff5700 1 -- 172.21.15.82:0/3909882734 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55a6c7ffc8b0 con 0x55a6c800f380 2023-09-23T09:34:58.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.413+0000 7fe01eff5700 1 -- 172.21.15.82:0/3909882734 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 112) v1 ==== 7946+0+0 (secure 0 0 0) 0x7fe034009920 con 0x55a6c800f380 2023-09-23T09:34:58.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.413+0000 7fe054f9fb80 10 client.27731 fetch_fsmap finished waiting for FSMap version 112 2023-09-23T09:34:58.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.413+0000 7fe054f9fb80 10 client.27731 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:34:58.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.413+0000 7fe054f9fb80 20 client.27731 populate_metadata read hostname 'smithi082' 2023-09-23T09:34:58.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.413+0000 7fe054f9fb80 1 --2- 172.21.15.82:0/3909882734 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55a6c8077f20 0x55a6c807a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:34:58.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.413+0000 7fe054f9fb80 4 client.27731 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:34:58.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.413+0000 7fe054f9fb80 1 -- 172.21.15.82:0/3909882734 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55a6c7f54970 con 0x55a6c8077f20 2023-09-23T09:34:58.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.414+0000 7fe03a7fc700 1 --2- 172.21.15.82:0/3909882734 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55a6c8077f20 0x55a6c807a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:34:58.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.414+0000 7fe03a7fc700 1 --2- 172.21.15.82:0/3909882734 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55a6c8077f20 0x55a6c807a340 crc :-1 s=READY pgs=250 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b229834abe32189f server_cookie=7ebfc929c7626e66 in_seq=0 out_seq=0 2023-09-23T09:34:58.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.414+0000 7fe01eff5700 10 client.27731 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:34:58.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.415+0000 7fe01eff5700 1 -- 172.21.15.82:0/3909882734 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55a6c7f54970 con 0x55a6c8077f20 2023-09-23T09:34:58.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.415+0000 7fe01eff5700 10 client.27731 handle_command_reply: tid=0 2023-09-23T09:34:58.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.415+0000 7fe054f9fb80 1 client.27731 shutdown 2023-09-23T09:34:58.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.415+0000 7fe054f9fb80 1 -- 172.21.15.82:0/3909882734 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a6c800f380 msgr2=0x55a6c800c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:34:58.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.415+0000 7fe054f9fb80 1 --2- 172.21.15.82:0/3909882734 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a6c800f380 0x55a6c800c6c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fe034017640 tx=0x7fe03400f920 comp rx=0 tx=0).stop 2023-09-23T09:34:58.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.415+0000 7fe054f9fb80 1 -- 172.21.15.82:0/3909882734 shutdown_connections 2023-09-23T09:34:58.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.415+0000 7fe054f9fb80 1 --2- 172.21.15.82:0/3909882734 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a6c800fca0 0x55a6c800ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:34:58.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.415+0000 7fe054f9fb80 1 --2- 172.21.15.82:0/3909882734 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55a6c8077f20 0x55a6c807a340 crc :-1 s=READY pgs=250 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:34:58.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.415+0000 7fe054f9fb80 1 --2- 172.21.15.82:0/3909882734 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6c8009c40 0x55a6c800c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:34:58.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.415+0000 7fe054f9fb80 1 --2- 172.21.15.82:0/3909882734 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a6c800f380 0x55a6c800c6c0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:34:58.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.415+0000 7fe054f9fb80 1 -- 172.21.15.82:0/3909882734 >> 172.21.15.82:0/3909882734 conn(0x55a6c7f7e0e0 msgr2=0x55a6c80040a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:34:58.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.415+0000 7fe01eff5700 0 client.27731 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:34:58.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.416+0000 7fe054f9fb80 1 -- 172.21.15.82:0/3909882734 shutdown_connections 2023-09-23T09:34:58.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.416+0000 7fe054f9fb80 1 -- 172.21.15.82:0/3909882734 wait complete. 2023-09-23T09:34:58.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.416+0000 7fe054f9fb80 20 client.27731 trim_cache size 0 max 16384 2023-09-23T09:34:58.421 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:34:58.421 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-23T09:34:58.421 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:34:58.421 INFO:teuthology.orchestra.run.smithi082.stdout: "d9e62ab8-1468-4fb0-a9fe-61bed13e954b": { 2023-09-23T09:34:58.422 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:34:58.422 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "d9e62ab8-1468-4fb0-a9fe-61bed13e954b", 2023-09-23T09:34:58.422 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:34:58.422 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:34:58.422 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:34:58.422 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:34:58.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.417+0000 7fe0415ff700 1 -- 172.21.15.82:0/1015691626 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fe0240a0210 msgr2=0x7fe0240a26d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:34:58.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.417+0000 7fe0415ff700 1 --2- 172.21.15.82:0/1015691626 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fe0240a0210 0x7fe0240a26d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe03c1b2b40 tx=0x7fe02c00b040 comp rx=0 tx=0).stop 2023-09-23T09:34:58.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.417+0000 7fe0415ff700 1 -- 172.21.15.82:0/1015691626 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe03c1a5e70 msgr2=0x7fe03c1a6320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:34:58.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.417+0000 7fe0415ff700 1 --2- 172.21.15.82:0/1015691626 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe03c1a5e70 0x7fe03c1a6320 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fe02c007ee0 tx=0x7fe02c00d3b0 comp rx=0 tx=0).stop 2023-09-23T09:34:58.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.417+0000 7fe0415ff700 1 -- 172.21.15.82:0/1015691626 shutdown_connections 2023-09-23T09:34:58.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.417+0000 7fe0415ff700 1 --2- 172.21.15.82:0/1015691626 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fe0240a0210 0x7fe0240a26d0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:34:58.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.417+0000 7fe0415ff700 1 --2- 172.21.15.82:0/1015691626 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe03c1a5e70 0x7fe03c1a6320 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:34:58.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.417+0000 7fe0415ff700 1 --2- 172.21.15.82:0/1015691626 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe03c101230 0x7fe03c1ab680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:34:58.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.417+0000 7fe0415ff700 1 --2- 172.21.15.82:0/1015691626 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe03c106880 0x7fe03c1abbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:34:58.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.417+0000 7fe0415ff700 1 -- 172.21.15.82:0/1015691626 >> 172.21.15.82:0/1015691626 conn(0x7fe03c0fc3a0 msgr2=0x7fe03c073a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:34:58.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.417+0000 7fe0415ff700 1 -- 172.21.15.82:0/1015691626 shutdown_connections 2023-09-23T09:34:58.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:34:58.418+0000 7fe0415ff700 1 -- 172.21.15.82:0/1015691626 wait complete. 2023-09-23T09:34:58.448 INFO:tasks.cephfs.filesystem:scrub status for tag:d9e62ab8-1468-4fb0-a9fe-61bed13e954b - {'path': '/', 'tag': 'd9e62ab8-1468-4fb0-a9fe-61bed13e954b', 'options': 'recursive,force'} 2023-09-23T09:34:59.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:34:59 smithi135 ceph-mon[99205]: pgmap v1207: 97 pgs: 97 active+clean; 16 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.3 MiB/s wr, 660 op/s 2023-09-23T09:34:59.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:34:59 smithi082 ceph-mon[97694]: pgmap v1207: 97 pgs: 97 active+clean; 16 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.3 MiB/s wr, 660 op/s 2023-09-23T09:34:59.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:34:59 smithi161 ceph-mon[99580]: pgmap v1207: 97 pgs: 97 active+clean; 16 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.3 MiB/s wr, 660 op/s 2023-09-23T09:35:00.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:35:00 smithi135 ceph-mon[99205]: pgmap v1208: 97 pgs: 97 active+clean; 16 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 3.9 MiB/s rd, 7.6 MiB/s wr, 953 op/s 2023-09-23T09:35:00.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:35:00 smithi082 ceph-mon[97694]: pgmap v1208: 97 pgs: 97 active+clean; 16 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 3.9 MiB/s rd, 7.6 MiB/s wr, 953 op/s 2023-09-23T09:35:00.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:35:00 smithi161 ceph-mon[99580]: pgmap v1208: 97 pgs: 97 active+clean; 16 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 3.9 MiB/s rd, 7.6 MiB/s wr, 953 op/s 2023-09-23T09:35:00.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 470.0 s, 194.4 tps, lat 517.585 ms stddev 482.298 2023-09-23T09:35:02.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:35:02 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:35:02.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:35:02 smithi082 ceph-mon[97694]: pgmap v1209: 97 pgs: 97 active+clean; 16 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.1 MiB/s wr, 687 op/s 2023-09-23T09:35:02.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:35:02 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:35:02.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:35:02 smithi161 ceph-mon[99580]: pgmap v1209: 97 pgs: 97 active+clean; 16 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.1 MiB/s wr, 687 op/s 2023-09-23T09:35:03.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:35:02 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:35:03.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:35:02 smithi135 ceph-mon[99205]: pgmap v1209: 97 pgs: 97 active+clean; 16 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.1 MiB/s wr, 687 op/s 2023-09-23T09:35:05.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:35:04 smithi135 ceph-mon[99205]: pgmap v1210: 97 pgs: 97 active+clean; 16 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.9 MiB/s wr, 652 op/s 2023-09-23T09:35:05.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:35:04 smithi082 ceph-mon[97694]: pgmap v1210: 97 pgs: 97 active+clean; 16 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.9 MiB/s wr, 652 op/s 2023-09-23T09:35:05.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:35:04 smithi161 ceph-mon[99580]: pgmap v1210: 97 pgs: 97 active+clean; 16 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.9 MiB/s wr, 652 op/s 2023-09-23T09:35:05.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 475.0 s, 81.0 tps, lat 1138.364 ms stddev 1076.129 2023-09-23T09:35:07.067 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:35:06 smithi135 ceph-mon[99205]: pgmap v1211: 97 pgs: 97 active+clean; 16 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 3.4 MiB/s rd, 7.2 MiB/s wr, 944 op/s 2023-09-23T09:35:07.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:35:06 smithi082 ceph-mon[97694]: pgmap v1211: 97 pgs: 97 active+clean; 16 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 3.4 MiB/s rd, 7.2 MiB/s wr, 944 op/s 2023-09-23T09:35:07.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:35:06 smithi161 ceph-mon[99580]: pgmap v1211: 97 pgs: 97 active+clean; 16 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 3.4 MiB/s rd, 7.2 MiB/s wr, 944 op/s 2023-09-23T09:35:08.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:35:07 smithi082 ceph-mon[97694]: osdmap e152: 12 total, 12 up, 12 in 2023-09-23T09:35:08.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:35:07 smithi161 ceph-mon[99580]: osdmap e152: 12 total, 12 up, 12 in 2023-09-23T09:35:08.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:35:07 smithi135 ceph-mon[99205]: osdmap e152: 12 total, 12 up, 12 in 2023-09-23T09:35:09.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:35:09 smithi135 ceph-mon[99205]: pgmap v1213: 97 pgs: 97 active+clean; 16 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.7 MiB/s wr, 750 op/s 2023-09-23T09:35:09.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:35:09 smithi082 ceph-mon[97694]: pgmap v1213: 97 pgs: 97 active+clean; 16 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.7 MiB/s wr, 750 op/s 2023-09-23T09:35:09.652 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:35:09 smithi161 ceph-mon[99580]: pgmap v1213: 97 pgs: 97 active+clean; 16 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.7 MiB/s wr, 750 op/s 2023-09-23T09:35:10.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:35:10 smithi135 ceph-mon[99205]: pgmap v1214: 97 pgs: 25 active+clean+snaptrim_wait, 12 active+clean+snaptrim, 60 active+clean; 15 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.0 MiB/s wr, 517 op/s 2023-09-23T09:35:10.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:35:10 smithi082 ceph-mon[97694]: pgmap v1214: 97 pgs: 25 active+clean+snaptrim_wait, 12 active+clean+snaptrim, 60 active+clean; 15 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.0 MiB/s wr, 517 op/s 2023-09-23T09:35:10.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:35:10 smithi161 ceph-mon[99580]: pgmap v1214: 97 pgs: 25 active+clean+snaptrim_wait, 12 active+clean+snaptrim, 60 active+clean; 15 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.0 MiB/s wr, 517 op/s 2023-09-23T09:35:10.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 480.0 s, 54.6 tps, lat 1578.956 ms stddev 1554.623 2023-09-23T09:35:13.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:35:13 smithi135 ceph-mon[99205]: pgmap v1215: 97 pgs: 31 active+clean+snaptrim_wait, 14 active+clean+snaptrim, 52 active+clean; 15 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.9 MiB/s wr, 487 op/s 2023-09-23T09:35:13.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:35:13 smithi082 ceph-mon[97694]: pgmap v1215: 97 pgs: 31 active+clean+snaptrim_wait, 14 active+clean+snaptrim, 52 active+clean; 15 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.9 MiB/s wr, 487 op/s 2023-09-23T09:35:13.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:35:13 smithi161 ceph-mon[99580]: pgmap v1215: 97 pgs: 31 active+clean+snaptrim_wait, 14 active+clean+snaptrim, 52 active+clean; 15 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.9 MiB/s wr, 487 op/s 2023-09-23T09:35:15.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:35:15 smithi135 ceph-mon[99205]: pgmap v1216: 97 pgs: 31 active+clean+snaptrim_wait, 14 active+clean+snaptrim, 52 active+clean; 15 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.9 MiB/s wr, 487 op/s 2023-09-23T09:35:15.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:35:15 smithi082 ceph-mon[97694]: pgmap v1216: 97 pgs: 31 active+clean+snaptrim_wait, 14 active+clean+snaptrim, 52 active+clean; 15 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.9 MiB/s wr, 487 op/s 2023-09-23T09:35:15.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:35:15 smithi161 ceph-mon[99580]: pgmap v1216: 97 pgs: 31 active+clean+snaptrim_wait, 14 active+clean+snaptrim, 52 active+clean; 15 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.9 MiB/s wr, 487 op/s 2023-09-23T09:35:15.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 485.0 s, 150.6 tps, lat 805.733 ms stddev 929.897 2023-09-23T09:35:17.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:35:17 smithi135 ceph-mon[99205]: pgmap v1217: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.2 MiB/s wr, 403 op/s 2023-09-23T09:35:17.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:35:17 smithi135 ceph-mon[99205]: osdmap e153: 12 total, 12 up, 12 in 2023-09-23T09:35:17.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:35:17 smithi082 ceph-mon[97694]: pgmap v1217: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.2 MiB/s wr, 403 op/s 2023-09-23T09:35:17.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:35:17 smithi082 ceph-mon[97694]: osdmap e153: 12 total, 12 up, 12 in 2023-09-23T09:35:17.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:35:17 smithi161 ceph-mon[99580]: pgmap v1217: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.2 MiB/s wr, 403 op/s 2023-09-23T09:35:17.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:35:17 smithi161 ceph-mon[99580]: osdmap e153: 12 total, 12 up, 12 in 2023-09-23T09:35:19.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:35:19 smithi135 ceph-mon[99205]: pgmap v1219: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.2 MiB/s wr, 403 op/s 2023-09-23T09:35:19.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:35:19 smithi082 ceph-mon[97694]: pgmap v1219: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.2 MiB/s wr, 403 op/s 2023-09-23T09:35:19.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:35:19 smithi161 ceph-mon[99580]: pgmap v1219: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.2 MiB/s wr, 403 op/s 2023-09-23T09:35:20.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:35:20 smithi135 ceph-mon[99205]: pgmap v1220: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.9 MiB/s wr, 537 op/s 2023-09-23T09:35:20.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:35:20 smithi082 ceph-mon[97694]: pgmap v1220: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.9 MiB/s wr, 537 op/s 2023-09-23T09:35:20.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:35:20 smithi161 ceph-mon[99580]: pgmap v1220: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.9 MiB/s wr, 537 op/s 2023-09-23T09:35:20.828 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 490.0 s, 52.2 tps, lat 1040.769 ms stddev 767.622 2023-09-23T09:35:23.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:35:23 smithi135 ceph-mon[99205]: pgmap v1221: 97 pgs: 97 active+clean; 15 GiB data, 60 GiB used, 1012 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.8 MiB/s wr, 549 op/s 2023-09-23T09:35:23.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:35:23 smithi082 ceph-mon[97694]: pgmap v1221: 97 pgs: 97 active+clean; 15 GiB data, 60 GiB used, 1012 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.8 MiB/s wr, 549 op/s 2023-09-23T09:35:23.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:35:23 smithi161 ceph-mon[99580]: pgmap v1221: 97 pgs: 97 active+clean; 15 GiB data, 60 GiB used, 1012 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.8 MiB/s wr, 549 op/s 2023-09-23T09:35:25.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:35:25 smithi135 ceph-mon[99205]: pgmap v1222: 97 pgs: 97 active+clean; 15 GiB data, 60 GiB used, 1012 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.8 MiB/s wr, 549 op/s 2023-09-23T09:35:25.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:35:25 smithi082 ceph-mon[97694]: pgmap v1222: 97 pgs: 97 active+clean; 15 GiB data, 60 GiB used, 1012 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.8 MiB/s wr, 549 op/s 2023-09-23T09:35:25.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:35:25 smithi161 ceph-mon[99580]: pgmap v1222: 97 pgs: 97 active+clean; 15 GiB data, 60 GiB used, 1012 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.8 MiB/s wr, 549 op/s 2023-09-23T09:35:25.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 495.0 s, 80.2 tps, lat 1909.033 ms stddev 1730.916 2023-09-23T09:35:26.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:35:26 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:35:26.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:35:26 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:35:26.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:35:26 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:35:27.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:35:27 smithi135 ceph-mon[99205]: pgmap v1223: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.4 MiB/s wr, 369 op/s 2023-09-23T09:35:27.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:35:27 smithi082 ceph-mon[97694]: pgmap v1223: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.4 MiB/s wr, 369 op/s 2023-09-23T09:35:27.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:35:27 smithi161 ceph-mon[99580]: pgmap v1223: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.4 MiB/s wr, 369 op/s 2023-09-23T09:35:28.449 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:35:28.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.738+0000 7f7822fff700 1 -- 172.21.15.82:0/1412643352 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f781c10aea0 msgr2=0x7f781c10d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:35:28.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.738+0000 7f7822fff700 1 --2- 172.21.15.82:0/1412643352 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f781c10aea0 0x7f781c10d310 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f7814009f90 tx=0x7f781400b330 comp rx=0 tx=0).stop 2023-09-23T09:35:28.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.738+0000 7f7822fff700 1 -- 172.21.15.82:0/1412643352 shutdown_connections 2023-09-23T09:35:28.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.738+0000 7f7822fff700 1 --2- 172.21.15.82:0/1412643352 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f781c10aea0 0x7f781c10d310 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:35:28.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.738+0000 7f7822fff700 1 --2- 172.21.15.82:0/1412643352 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f781c101a80 0x7f781c101e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:35:28.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.738+0000 7f7822fff700 1 --2- 172.21.15.82:0/1412643352 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f781c1023a0 0x7f781c10a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:35:28.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.738+0000 7f7822fff700 1 -- 172.21.15.82:0/1412643352 >> 172.21.15.82:0/1412643352 conn(0x7f781c0fb280 msgr2=0x7f781c0fd6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:35:28.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.738+0000 7f7822fff700 1 -- 172.21.15.82:0/1412643352 shutdown_connections 2023-09-23T09:35:28.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.739+0000 7f7822fff700 1 -- 172.21.15.82:0/1412643352 wait complete. 2023-09-23T09:35:28.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.740+0000 7f7822fff700 1 Processor -- start 2023-09-23T09:35:28.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.741+0000 7f7822fff700 1 -- start start 2023-09-23T09:35:28.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.741+0000 7f7822fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f781c101a80 0x7f781c19d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:35:28.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.741+0000 7f7822fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f781c1023a0 0x7f781c19d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:35:28.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.741+0000 7f7822fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f781c10aea0 0x7f781c1a1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:35:28.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.741+0000 7f7822fff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f781c1a2090 con 0x7f781c1023a0 2023-09-23T09:35:28.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.741+0000 7f7822fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f781c1a2200 con 0x7f781c10aea0 2023-09-23T09:35:28.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.741+0000 7f7822fff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f781c1a23c0 con 0x7f781c101a80 2023-09-23T09:35:28.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.742+0000 7f782159c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f781c10aea0 0x7f781c1a1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:35:28.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.742+0000 7f782159c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f781c10aea0 0x7f781c1a1a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:40132/0 (socket says 172.21.15.82:40132) 2023-09-23T09:35:28.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.742+0000 7f782159c700 1 -- 172.21.15.82:0/2176416522 learned_addr learned my addr 172.21.15.82:0/2176416522 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:35:28.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.742+0000 7f781bfff700 1 --2- 172.21.15.82:0/2176416522 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f781c1023a0 0x7f781c19d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:35:28.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.742+0000 7f782159c700 1 -- 172.21.15.82:0/2176416522 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f781c101a80 msgr2=0x7f781c19d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:35:28.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.742+0000 7f782159c700 1 --2- 172.21.15.82:0/2176416522 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f781c101a80 0x7f781c19d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:35:28.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.742+0000 7f782159c700 1 -- 172.21.15.82:0/2176416522 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f781c1023a0 msgr2=0x7f781c19d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:35:28.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.742+0000 7f782159c700 1 --2- 172.21.15.82:0/2176416522 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f781c1023a0 0x7f781c19d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:35:28.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.742+0000 7f782159c700 1 -- 172.21.15.82:0/2176416522 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f781000f750 con 0x7f781c10aea0 2023-09-23T09:35:28.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.743+0000 7f782159c700 1 --2- 172.21.15.82:0/2176416522 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f781c10aea0 0x7f781c1a1a50 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f7814009f60 tx=0x7f7814008ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:35:28.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.743+0000 7f7819ffb700 1 -- 172.21.15.82:0/2176416522 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781400e040 con 0x7f781c10aea0 2023-09-23T09:35:28.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.743+0000 7f7822fff700 1 -- 172.21.15.82:0/2176416522 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7814009c40 con 0x7f781c10aea0 2023-09-23T09:35:28.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.743+0000 7f7819ffb700 1 -- 172.21.15.82:0/2176416522 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7814004e30 con 0x7f781c10aea0 2023-09-23T09:35:28.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.743+0000 7f7819ffb700 1 -- 172.21.15.82:0/2176416522 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78140052a0 con 0x7f781c10aea0 2023-09-23T09:35:28.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.743+0000 7f7822fff700 1 -- 172.21.15.82:0/2176416522 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f781c1a9d00 con 0x7f781c10aea0 2023-09-23T09:35:28.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.748+0000 7f7819ffb700 1 -- 172.21.15.82:0/2176416522 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f781401d470 con 0x7f781c10aea0 2023-09-23T09:35:28.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.749+0000 7f7836a21b80 1 Processor -- start 2023-09-23T09:35:28.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.749+0000 7f7836a21b80 1 -- start start 2023-09-23T09:35:28.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.750+0000 7f7836a21b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ec71e8c380 0x55ec71e8c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:35:28.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.750+0000 7f7836a21b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec71e8cca0 0x55ec71e86700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:35:28.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.750+0000 7f7836a21b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec71e86c40 0x55ec71e870a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:35:28.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.750+0000 7f7836a21b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec71dee7b0 con 0x55ec71e8cca0 2023-09-23T09:35:28.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.750+0000 7f7836a21b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec71ddf780 con 0x55ec71e86c40 2023-09-23T09:35:28.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.750+0000 7f7836a21b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec71ddd0a0 con 0x55ec71e8c380 2023-09-23T09:35:28.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.750+0000 7f7819ffb700 1 --2- 172.21.15.82:0/2176416522 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f780c0a00c0 0x7f780c0a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:35:28.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.750+0000 7f7819ffb700 1 -- 172.21.15.82:0/2176416522 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f78140cca90 con 0x7f781c10aea0 2023-09-23T09:35:28.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.751+0000 7f7820d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec71e8cca0 0x55ec71e86700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:35:28.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.751+0000 7f781bfff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ec71e8c380 0x55ec71e8c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:35:28.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.751+0000 7f7820d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec71e8cca0 0x55ec71e86700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38482/0 (socket says 172.21.15.82:38482) 2023-09-23T09:35:28.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.751+0000 7f7820d9b700 1 -- 172.21.15.82:0/4024245132 learned_addr learned my addr 172.21.15.82:0/4024245132 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:35:28.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.751+0000 7f781bfff700 1 --2- 172.21.15.82:0/4024245132 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec71e86c40 0x55ec71e870a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:35:28.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.751+0000 7f782159c700 1 --2- 172.21.15.82:0/2176416522 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f780c0a00c0 0x7f780c0a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:35:28.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.751+0000 7f7820d9b700 1 -- 172.21.15.82:0/4024245132 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ec71e8c380 msgr2=0x55ec71e8c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:35:28.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.751+0000 7f7820d9b700 1 --2- 172.21.15.82:0/4024245132 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ec71e8c380 0x55ec71e8c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:35:28.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.751+0000 7f7820d9b700 1 -- 172.21.15.82:0/4024245132 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec71e86c40 msgr2=0x55ec71e870a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:35:28.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.751+0000 7f7820d9b700 1 --2- 172.21.15.82:0/4024245132 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec71e86c40 0x55ec71e870a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:35:28.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.751+0000 7f7820d9b700 1 -- 172.21.15.82:0/4024245132 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ec71c58630 con 0x55ec71e8cca0 2023-09-23T09:35:28.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.752+0000 7f7820d9b700 1 --2- 172.21.15.82:0/4024245132 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec71e8cca0 0x55ec71e86700 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f781000fc80 tx=0x7f781000f300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20c195ce079e5c72 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:35:28.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.752+0000 7f782159c700 1 --2- 172.21.15.82:0/2176416522 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f780c0a00c0 0x7f780c0a2580 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7814099f30 tx=0x7f781400b330 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:35:28.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.752+0000 7f7806ffd700 1 -- 172.21.15.82:0/4024245132 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7810009cc0 con 0x55ec71e8cca0 2023-09-23T09:35:28.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.752+0000 7f7806ffd700 1 -- 172.21.15.82:0/4024245132 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7810009e20 con 0x55ec71e8cca0 2023-09-23T09:35:28.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.752+0000 7f7806ffd700 1 -- 172.21.15.82:0/4024245132 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781000c5d0 con 0x55ec71e8cca0 2023-09-23T09:35:28.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.753+0000 7f7836a21b80 1 -- 172.21.15.82:0/4024245132 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec71e8cca0 msgr2=0x55ec71e86700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:35:28.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.753+0000 7f7836a21b80 1 --2- 172.21.15.82:0/4024245132 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec71e8cca0 0x55ec71e86700 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f781000fc80 tx=0x7f781000f300 comp rx=0 tx=0).stop 2023-09-23T09:35:28.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.754+0000 7f7836a21b80 1 -- 172.21.15.82:0/4024245132 shutdown_connections 2023-09-23T09:35:28.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.754+0000 7f7836a21b80 1 --2- 172.21.15.82:0/4024245132 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec71e86c40 0x55ec71e870a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:35:28.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.754+0000 7f7836a21b80 1 --2- 172.21.15.82:0/4024245132 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ec71e8c380 0x55ec71e8c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:35:28.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.754+0000 7f7836a21b80 1 --2- 172.21.15.82:0/4024245132 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec71e8cca0 0x55ec71e86700 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:35:28.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.754+0000 7f7836a21b80 1 -- 172.21.15.82:0/4024245132 >> 172.21.15.82:0/4024245132 conn(0x55ec71dfb0e0 msgr2=0x55ec71e81410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:35:28.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.754+0000 7f7836a21b80 1 -- 172.21.15.82:0/4024245132 shutdown_connections 2023-09-23T09:35:28.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.754+0000 7f7836a21b80 1 -- 172.21.15.82:0/4024245132 wait complete. 2023-09-23T09:35:28.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.755+0000 7f7836a21b80 1 -- start start 2023-09-23T09:35:28.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.756+0000 7f7836a21b80 1 Processor -- start 2023-09-23T09:35:28.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.756+0000 7f7836a21b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec71e86c40 0x55ec71e8ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:35:28.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.756+0000 7f7836a21b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ec71e8c380 0x55ec71e904e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:35:28.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.756+0000 7f7836a21b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec71e8cca0 0x55ec71e90a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:35:28.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.756+0000 7f7836a21b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec71dd8990 con 0x55ec71e8cca0 2023-09-23T09:35:28.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.756+0000 7f7836a21b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec71d76bb0 con 0x55ec71e86c40 2023-09-23T09:35:28.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.756+0000 7f7836a21b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec71d768b0 con 0x55ec71e8c380 2023-09-23T09:35:28.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.756+0000 7f7836a21b80 10 client.0 _ll_register_callbacks cb 0x55ec71cc0a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:35:28.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.757+0000 7f781bfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec71e86c40 0x55ec71e8ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:35:28.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.757+0000 7f781bfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec71e86c40 0x55ec71e8ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:40152/0 (socket says 172.21.15.82:40152) 2023-09-23T09:35:28.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.757+0000 7f781bfff700 1 -- 172.21.15.82:0/526123777 learned_addr learned my addr 172.21.15.82:0/526123777 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:35:28.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.757+0000 7f781bfff700 1 --2- 172.21.15.82:0/526123777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec71e8cca0 0x55ec71e90a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:35:28.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.757+0000 7f7820d9b700 1 --2- 172.21.15.82:0/526123777 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ec71e8c380 0x55ec71e904e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:35:28.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.757+0000 7f781bfff700 1 -- 172.21.15.82:0/526123777 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ec71e8c380 msgr2=0x55ec71e904e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:35:28.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.757+0000 7f781bfff700 1 --2- 172.21.15.82:0/526123777 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ec71e8c380 0x55ec71e904e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:35:28.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.757+0000 7f781bfff700 1 -- 172.21.15.82:0/526123777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec71e8cca0 msgr2=0x55ec71e90a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:35:28.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.757+0000 7f781bfff700 1 --2- 172.21.15.82:0/526123777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec71e8cca0 0x55ec71e90a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:35:28.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.757+0000 7f781bfff700 1 -- 172.21.15.82:0/526123777 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f781000f4f0 con 0x55ec71e86c40 2023-09-23T09:35:28.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.758+0000 7f781bfff700 1 --2- 172.21.15.82:0/526123777 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec71e86c40 0x55ec71e8ffa0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f7808012f70 tx=0x7f7808004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=519e3b511018f2bb server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:35:28.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.758+0000 7f77fbfff700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-09-23T09:35:28.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.758+0000 7f77fbfff700 1 -- 172.21.15.82:0/526123777 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7808011d50 con 0x55ec71e86c40 2023-09-23T09:35:28.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.758+0000 7f77fbfff700 1 -- 172.21.15.82:0/526123777 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(153..153 src has 1..153) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f7808004050 con 0x55ec71e86c40 2023-09-23T09:35:28.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.758+0000 7f7836a21b80 1 -- 172.21.15.82:0/526123777 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ec71e561c0 con 0x55ec71e86c40 2023-09-23T09:35:28.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.759+0000 7f77fbfff700 1 -- 172.21.15.82:0/526123777 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=114) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7808011eb0 con 0x55ec71e86c40 2023-09-23T09:35:28.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.759+0000 7f7836a21b80 10 client.27743 fetch_fsmap learned FSMap version 114 2023-09-23T09:35:28.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.759+0000 7f7836a21b80 1 -- 172.21.15.82:0/526123777 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=114,monmap=4+}) v3 -- 0x55ec71c04de0 con 0x55ec71e86c40 2023-09-23T09:35:28.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.759+0000 7f77fbfff700 1 -- 172.21.15.82:0/526123777 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55ec71e561c0 con 0x55ec71e86c40 2023-09-23T09:35:28.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.759+0000 7f77fbfff700 1 -- 172.21.15.82:0/526123777 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 114) v1 ==== 7946+0+0 (secure 0 0 0) 0x7f7808003c50 con 0x55ec71e86c40 2023-09-23T09:35:28.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.759+0000 7f7836a21b80 10 client.27743 fetch_fsmap finished waiting for FSMap version 114 2023-09-23T09:35:28.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.759+0000 7f7836a21b80 10 client.27743 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:35:28.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.759+0000 7f7836a21b80 20 client.27743 populate_metadata read hostname 'smithi082' 2023-09-23T09:35:28.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.760+0000 7f7836a21b80 1 --2- 172.21.15.82:0/526123777 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55ec71ea07b0 0x55ec71ea2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:35:28.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.760+0000 7f7836a21b80 4 client.27743 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:35:28.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.760+0000 7f7836a21b80 1 -- 172.21.15.82:0/526123777 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ec71d7eba0 con 0x55ec71ea07b0 2023-09-23T09:35:28.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.760+0000 7f7820d9b700 1 --2- 172.21.15.82:0/526123777 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55ec71ea07b0 0x55ec71ea2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:35:28.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.761+0000 7f7820d9b700 1 --2- 172.21.15.82:0/526123777 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55ec71ea07b0 0x55ec71ea2bd0 crc :-1 s=READY pgs=251 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a47841cd1471a227 server_cookie=2a50a4f37fb8f797 in_seq=0 out_seq=0 2023-09-23T09:35:28.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.761+0000 7f77fbfff700 10 client.27743 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:35:28.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.762+0000 7f77fbfff700 1 -- 172.21.15.82:0/526123777 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55ec71d7eba0 con 0x55ec71ea07b0 2023-09-23T09:35:28.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.762+0000 7f77fbfff700 10 client.27743 handle_command_reply: tid=0 2023-09-23T09:35:28.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.762+0000 7f7836a21b80 1 client.27743 shutdown 2023-09-23T09:35:28.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.762+0000 7f7836a21b80 1 -- 172.21.15.82:0/526123777 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec71e86c40 msgr2=0x55ec71e8ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:35:28.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.762+0000 7f7836a21b80 1 --2- 172.21.15.82:0/526123777 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec71e86c40 0x55ec71e8ffa0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f7808012f70 tx=0x7f7808004750 comp rx=0 tx=0).stop 2023-09-23T09:35:28.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.762+0000 7f7836a21b80 1 -- 172.21.15.82:0/526123777 shutdown_connections 2023-09-23T09:35:28.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.762+0000 7f7836a21b80 1 --2- 172.21.15.82:0/526123777 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55ec71ea07b0 0x55ec71ea2bd0 crc :-1 s=READY pgs=251 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:35:28.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.762+0000 7f7836a21b80 1 --2- 172.21.15.82:0/526123777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec71e8cca0 0x55ec71e90a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:35:28.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.762+0000 7f7836a21b80 1 --2- 172.21.15.82:0/526123777 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec71e86c40 0x55ec71e8ffa0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:35:28.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.762+0000 7f7836a21b80 1 --2- 172.21.15.82:0/526123777 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ec71e8c380 0x55ec71e904e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:35:28.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.762+0000 7f7836a21b80 1 -- 172.21.15.82:0/526123777 >> 172.21.15.82:0/526123777 conn(0x55ec71dfb0e0 msgr2=0x55ec71e7bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:35:28.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.762+0000 7f77fbfff700 0 client.27743 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:35:28.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.763+0000 7f7836a21b80 1 -- 172.21.15.82:0/526123777 shutdown_connections 2023-09-23T09:35:28.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.763+0000 7f7836a21b80 1 -- 172.21.15.82:0/526123777 wait complete. 2023-09-23T09:35:28.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.763+0000 7f7836a21b80 20 client.27743 trim_cache size 0 max 16384 2023-09-23T09:35:28.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.786+0000 7f7836a21b80 1 Processor -- start 2023-09-23T09:35:28.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.786+0000 7f7836a21b80 1 -- start start 2023-09-23T09:35:28.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.786+0000 7f7836a21b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec71e86c40 0x55ec71e86700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:35:28.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.786+0000 7f7836a21b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec71e8c380 0x55ec71e977a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:35:28.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.786+0000 7f7836a21b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ec71e8cca0 0x55ec71e8a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:35:28.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.786+0000 7f7836a21b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec71c5a920 con 0x55ec71e86c40 2023-09-23T09:35:28.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.786+0000 7f7836a21b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec71e561c0 con 0x55ec71e8c380 2023-09-23T09:35:28.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.786+0000 7f7836a21b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec71e7da40 con 0x55ec71e8cca0 2023-09-23T09:35:28.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.786+0000 7f781bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec71e86c40 0x55ec71e86700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:35:28.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.787+0000 7f781bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec71e86c40 0x55ec71e86700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38498/0 (socket says 172.21.15.82:38498) 2023-09-23T09:35:28.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.787+0000 7f781bfff700 1 -- 172.21.15.82:0/2746518822 learned_addr learned my addr 172.21.15.82:0/2746518822 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:35:28.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.787+0000 7f7820d9b700 1 --2- 172.21.15.82:0/2746518822 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec71e8c380 0x55ec71e977a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:35:28.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.787+0000 7f781bfff700 1 --2- 172.21.15.82:0/2746518822 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ec71e8cca0 0x55ec71e8a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:35:28.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.787+0000 7f7820d9b700 1 -- 172.21.15.82:0/2746518822 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ec71e8cca0 msgr2=0x55ec71e8a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:35:28.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.787+0000 7f7820d9b700 1 --2- 172.21.15.82:0/2746518822 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ec71e8cca0 0x55ec71e8a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:35:28.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.787+0000 7f7820d9b700 1 -- 172.21.15.82:0/2746518822 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec71e86c40 msgr2=0x55ec71e86700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:35:28.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.787+0000 7f7820d9b700 1 --2- 172.21.15.82:0/2746518822 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec71e86c40 0x55ec71e86700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:35:28.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.787+0000 7f7820d9b700 1 -- 172.21.15.82:0/2746518822 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ec71bedc60 con 0x55ec71e8c380 2023-09-23T09:35:28.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.787+0000 7f781bfff700 1 --2- 172.21.15.82:0/2746518822 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec71e86c40 0x55ec71e86700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:35:28.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.788+0000 7f7820d9b700 1 --2- 172.21.15.82:0/2746518822 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec71e8c380 0x55ec71e977a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f781000fc50 tx=0x7f7810009380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef3dbe8cc05ec1a6 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:35:28.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.788+0000 7f78077fe700 1 -- 172.21.15.82:0/2746518822 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7810028070 con 0x55ec71e8c380 2023-09-23T09:35:28.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.788+0000 7f78077fe700 1 -- 172.21.15.82:0/2746518822 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f78100044d0 con 0x55ec71e8c380 2023-09-23T09:35:28.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.788+0000 7f78077fe700 1 -- 172.21.15.82:0/2746518822 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7810004a90 con 0x55ec71e8c380 2023-09-23T09:35:28.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.789+0000 7f7836a21b80 1 -- 172.21.15.82:0/2746518822 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec71e8c380 msgr2=0x55ec71e977a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:35:28.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.789+0000 7f7836a21b80 1 --2- 172.21.15.82:0/2746518822 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec71e8c380 0x55ec71e977a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f781000fc50 tx=0x7f7810009380 comp rx=0 tx=0).stop 2023-09-23T09:35:28.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.789+0000 7f7836a21b80 1 -- 172.21.15.82:0/2746518822 shutdown_connections 2023-09-23T09:35:28.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.789+0000 7f7836a21b80 1 --2- 172.21.15.82:0/2746518822 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ec71e8cca0 0x55ec71e8a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:35:28.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.789+0000 7f7836a21b80 1 --2- 172.21.15.82:0/2746518822 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec71e86c40 0x55ec71e86700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:35:28.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.789+0000 7f7836a21b80 1 --2- 172.21.15.82:0/2746518822 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec71e8c380 0x55ec71e977a0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:35:28.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.789+0000 7f7836a21b80 1 -- 172.21.15.82:0/2746518822 >> 172.21.15.82:0/2746518822 conn(0x55ec71dfb0e0 msgr2=0x55ec71e90890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:35:28.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.789+0000 7f7836a21b80 1 -- 172.21.15.82:0/2746518822 shutdown_connections 2023-09-23T09:35:28.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.789+0000 7f7836a21b80 1 -- 172.21.15.82:0/2746518822 wait complete. 2023-09-23T09:35:28.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.790+0000 7f7836a21b80 1 -- start start 2023-09-23T09:35:28.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.790+0000 7f7836a21b80 1 Processor -- start 2023-09-23T09:35:28.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.791+0000 7f7836a21b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ec71e86c40 0x55ec71ee8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:35:28.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.791+0000 7f7836a21b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec71e8c380 0x55ec71ee8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:35:28.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.791+0000 7f7836a21b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec71e8cca0 0x55ec71eec700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:35:28.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.791+0000 7f7836a21b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec71eeccb0 con 0x55ec71e8c380 2023-09-23T09:35:28.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.791+0000 7f7836a21b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec71eece20 con 0x55ec71e8cca0 2023-09-23T09:35:28.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.791+0000 7f7836a21b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec71eecfe0 con 0x55ec71e86c40 2023-09-23T09:35:28.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.791+0000 7f7836a21b80 10 client.0 _ll_register_callbacks cb 0x7f7808012c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:35:28.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.791+0000 7f781bfff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ec71e86c40 0x55ec71ee8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:35:28.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.791+0000 7f781bfff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ec71e86c40 0x55ec71ee8760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:53856/0 (socket says 172.21.15.82:53856) 2023-09-23T09:35:28.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.791+0000 7f781bfff700 1 -- 172.21.15.82:0/4081985172 learned_addr learned my addr 172.21.15.82:0/4081985172 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:35:28.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.791+0000 7f7820d9b700 1 --2- 172.21.15.82:0/4081985172 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec71e8c380 0x55ec71ee8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:35:28.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.791+0000 7f781bfff700 1 --2- 172.21.15.82:0/4081985172 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec71e8cca0 0x55ec71eec700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:35:28.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.792+0000 7f781bfff700 1 -- 172.21.15.82:0/4081985172 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec71e8cca0 msgr2=0x55ec71eec700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:35:28.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.792+0000 7f781bfff700 1 --2- 172.21.15.82:0/4081985172 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec71e8cca0 0x55ec71eec700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:35:28.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.792+0000 7f781bfff700 1 -- 172.21.15.82:0/4081985172 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec71e8c380 msgr2=0x55ec71ee8ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:35:28.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.792+0000 7f781bfff700 1 --2- 172.21.15.82:0/4081985172 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec71e8c380 0x55ec71ee8ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:35:28.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.792+0000 7f781bfff700 1 -- 172.21.15.82:0/4081985172 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ec71c04de0 con 0x55ec71e86c40 2023-09-23T09:35:28.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.792+0000 7f7820d9b700 1 --2- 172.21.15.82:0/4081985172 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec71e8c380 0x55ec71ee8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:35:28.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.792+0000 7f781bfff700 1 --2- 172.21.15.82:0/4081985172 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ec71e86c40 0x55ec71ee8760 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f7808012d60 tx=0x7f7808009240 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c046bbd146919321 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:35:28.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.792+0000 7f77fbfff700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T09:35:28.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.792+0000 7f77fbfff700 1 -- 172.21.15.82:0/4081985172 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780800eaf0 con 0x55ec71e86c40 2023-09-23T09:35:28.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.792+0000 7f7836a21b80 1 -- 172.21.15.82:0/4081985172 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ec71e798b0 con 0x55ec71e86c40 2023-09-23T09:35:28.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.792+0000 7f77fbfff700 1 -- 172.21.15.82:0/4081985172 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(153..153 src has 1..153) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f7808000e40 con 0x55ec71e86c40 2023-09-23T09:35:28.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.793+0000 7f77fbfff700 1 -- 172.21.15.82:0/4081985172 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=114) v2 ==== 24+0+0 (secure 0 0 0) 0x7f780800ec50 con 0x55ec71e86c40 2023-09-23T09:35:28.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.793+0000 7f7836a21b80 10 client.27775 fetch_fsmap learned FSMap version 114 2023-09-23T09:35:28.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.793+0000 7f7836a21b80 1 -- 172.21.15.82:0/4081985172 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=114,monmap=4+}) v3 -- 0x55ec71c58630 con 0x55ec71e86c40 2023-09-23T09:35:28.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.793+0000 7f77fbfff700 1 -- 172.21.15.82:0/4081985172 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f780803e020 con 0x55ec71e86c40 2023-09-23T09:35:28.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.793+0000 7f77fbfff700 1 -- 172.21.15.82:0/4081985172 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 114) v1 ==== 7946+0+0 (secure 0 0 0) 0x7f7808005040 con 0x55ec71e86c40 2023-09-23T09:35:28.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.793+0000 7f7836a21b80 10 client.27775 fetch_fsmap finished waiting for FSMap version 114 2023-09-23T09:35:28.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.793+0000 7f7836a21b80 10 client.27775 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:35:28.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.793+0000 7f7836a21b80 20 client.27775 populate_metadata read hostname 'smithi082' 2023-09-23T09:35:28.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.793+0000 7f7836a21b80 1 --2- 172.21.15.82:0/4081985172 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55ec71ef5a40 0x55ec71ef7e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:35:28.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.793+0000 7f7836a21b80 4 client.27775 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:35:28.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.793+0000 7f7836a21b80 1 -- 172.21.15.82:0/4081985172 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55ec71dd1970 con 0x55ec71ef5a40 2023-09-23T09:35:28.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.794+0000 7f7820d9b700 1 --2- 172.21.15.82:0/4081985172 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55ec71ef5a40 0x55ec71ef7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:35:28.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.794+0000 7f7820d9b700 1 --2- 172.21.15.82:0/4081985172 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55ec71ef5a40 0x55ec71ef7e60 crc :-1 s=READY pgs=252 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a053878b168400d3 server_cookie=47f0cd6584b7a03b in_seq=0 out_seq=0 2023-09-23T09:35:28.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.794+0000 7f77fbfff700 10 client.27775 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:35:28.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.795+0000 7f77fbfff700 1 -- 172.21.15.82:0/4081985172 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55ec71dd1970 con 0x55ec71ef5a40 2023-09-23T09:35:28.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.795+0000 7f77fbfff700 10 client.27775 handle_command_reply: tid=0 2023-09-23T09:35:28.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.795+0000 7f7836a21b80 1 client.27775 shutdown 2023-09-23T09:35:28.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.795+0000 7f7836a21b80 1 -- 172.21.15.82:0/4081985172 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ec71e86c40 msgr2=0x55ec71ee8760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:35:28.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.795+0000 7f7836a21b80 1 --2- 172.21.15.82:0/4081985172 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ec71e86c40 0x55ec71ee8760 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f7808012d60 tx=0x7f7808009240 comp rx=0 tx=0).stop 2023-09-23T09:35:28.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.796+0000 7f7836a21b80 1 -- 172.21.15.82:0/4081985172 shutdown_connections 2023-09-23T09:35:28.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.796+0000 7f7836a21b80 1 --2- 172.21.15.82:0/4081985172 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec71e8cca0 0x55ec71eec700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:35:28.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.796+0000 7f7836a21b80 1 --2- 172.21.15.82:0/4081985172 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ec71e86c40 0x55ec71ee8760 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:35:28.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.796+0000 7f7836a21b80 1 --2- 172.21.15.82:0/4081985172 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55ec71ef5a40 0x55ec71ef7e60 crc :-1 s=READY pgs=252 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:35:28.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.796+0000 7f7836a21b80 1 --2- 172.21.15.82:0/4081985172 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec71e8c380 0x55ec71ee8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:35:28.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.796+0000 7f7836a21b80 1 -- 172.21.15.82:0/4081985172 >> 172.21.15.82:0/4081985172 conn(0x55ec71dfb0e0 msgr2=0x55ec71e8a130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:35:28.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.796+0000 7f77fbfff700 0 client.27775 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:35:28.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.796+0000 7f7836a21b80 1 -- 172.21.15.82:0/4081985172 shutdown_connections 2023-09-23T09:35:28.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.796+0000 7f7836a21b80 1 -- 172.21.15.82:0/4081985172 wait complete. 2023-09-23T09:35:28.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.797+0000 7f7836a21b80 20 client.27775 trim_cache size 0 max 16384 2023-09-23T09:35:28.803 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:35:28.803 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-23T09:35:28.803 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:35:28.803 INFO:teuthology.orchestra.run.smithi082.stdout: "d9e62ab8-1468-4fb0-a9fe-61bed13e954b": { 2023-09-23T09:35:28.803 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:35:28.803 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "d9e62ab8-1468-4fb0-a9fe-61bed13e954b", 2023-09-23T09:35:28.803 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:35:28.803 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:35:28.803 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:35:28.804 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:35:28.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.798+0000 7f7822fff700 1 -- 172.21.15.82:0/2176416522 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f780c0a00c0 msgr2=0x7f780c0a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:35:28.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.798+0000 7f7822fff700 1 --2- 172.21.15.82:0/2176416522 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f780c0a00c0 0x7f780c0a2580 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7814099f30 tx=0x7f781400b330 comp rx=0 tx=0).stop 2023-09-23T09:35:28.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.798+0000 7f7822fff700 1 -- 172.21.15.82:0/2176416522 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f781c10aea0 msgr2=0x7f781c1a1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:35:28.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.798+0000 7f7822fff700 1 --2- 172.21.15.82:0/2176416522 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f781c10aea0 0x7f781c1a1a50 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f7814009f60 tx=0x7f7814008ca0 comp rx=0 tx=0).stop 2023-09-23T09:35:28.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.798+0000 7f7822fff700 1 -- 172.21.15.82:0/2176416522 shutdown_connections 2023-09-23T09:35:28.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.798+0000 7f7822fff700 1 --2- 172.21.15.82:0/2176416522 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f780c0a00c0 0x7f780c0a2580 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:35:28.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.798+0000 7f7822fff700 1 --2- 172.21.15.82:0/2176416522 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f781c10aea0 0x7f781c1a1a50 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:35:28.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.798+0000 7f7822fff700 1 --2- 172.21.15.82:0/2176416522 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f781c101a80 0x7f781c19d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:35:28.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.798+0000 7f7822fff700 1 --2- 172.21.15.82:0/2176416522 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f781c1023a0 0x7f781c19d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:35:28.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.798+0000 7f7822fff700 1 -- 172.21.15.82:0/2176416522 >> 172.21.15.82:0/2176416522 conn(0x7f781c0fb280 msgr2=0x7f781c10d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:35:28.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.798+0000 7f7822fff700 1 -- 172.21.15.82:0/2176416522 shutdown_connections 2023-09-23T09:35:28.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:28.798+0000 7f7822fff700 1 -- 172.21.15.82:0/2176416522 wait complete. 2023-09-23T09:35:28.827 INFO:tasks.cephfs.filesystem:scrub status for tag:d9e62ab8-1468-4fb0-a9fe-61bed13e954b - {'path': '/', 'tag': 'd9e62ab8-1468-4fb0-a9fe-61bed13e954b', 'options': 'recursive,force'} 2023-09-23T09:35:29.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:35:29 smithi135 ceph-mon[99205]: pgmap v1224: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.2 MiB/s wr, 351 op/s 2023-09-23T09:35:29.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:35:29 smithi082 ceph-mon[97694]: pgmap v1224: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.2 MiB/s wr, 351 op/s 2023-09-23T09:35:29.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:35:29 smithi161 ceph-mon[99580]: pgmap v1224: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.2 MiB/s wr, 351 op/s 2023-09-23T09:35:30.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:35:30 smithi135 ceph-mon[99205]: pgmap v1225: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.5 MiB/s rd, 6.0 MiB/s wr, 567 op/s 2023-09-23T09:35:30.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:35:30 smithi082 ceph-mon[97694]: pgmap v1225: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.5 MiB/s rd, 6.0 MiB/s wr, 567 op/s 2023-09-23T09:35:30.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:35:30 smithi161 ceph-mon[99580]: pgmap v1225: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.5 MiB/s rd, 6.0 MiB/s wr, 567 op/s 2023-09-23T09:35:30.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 500.0 s, 186.0 tps, lat 434.563 ms stddev 317.996 2023-09-23T09:35:31.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:35:31 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:35:31.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:35:31 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:35:31.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:35:31 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:35:32.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:35:32 smithi135 ceph-mon[99205]: pgmap v1226: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.3 MiB/s wr, 399 op/s 2023-09-23T09:35:32.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:35:32 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:35:32.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:35:32 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:35:32.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:35:32 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:35:32.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:35:32 smithi082 ceph-mon[97694]: pgmap v1226: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.3 MiB/s wr, 399 op/s 2023-09-23T09:35:32.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:35:32 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:35:32.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:35:32 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:35:32.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:35:32 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:35:32.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:35:32 smithi161 ceph-mon[99580]: pgmap v1226: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.3 MiB/s wr, 399 op/s 2023-09-23T09:35:32.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:35:32 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:35:32.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:35:32 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:35:32.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:35:32 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:35:35.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:35:34 smithi135 ceph-mon[99205]: pgmap v1227: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.2 MiB/s wr, 374 op/s 2023-09-23T09:35:35.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:35:34 smithi082 ceph-mon[97694]: pgmap v1227: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.2 MiB/s wr, 374 op/s 2023-09-23T09:35:35.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:35:34 smithi161 ceph-mon[99580]: pgmap v1227: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.2 MiB/s wr, 374 op/s 2023-09-23T09:35:35.828 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 505.0 s, 20.2 tps, lat 3590.152 ms stddev 496.538 2023-09-23T09:35:37.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:35:36 smithi135 ceph-mon[99205]: pgmap v1228: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.2 MiB/s wr, 518 op/s 2023-09-23T09:35:37.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:35:36 smithi082 ceph-mon[97694]: pgmap v1228: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.2 MiB/s wr, 518 op/s 2023-09-23T09:35:37.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:35:36 smithi161 ceph-mon[99580]: pgmap v1228: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.2 MiB/s wr, 518 op/s 2023-09-23T09:35:39.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:35:39 smithi135 ceph-mon[99205]: pgmap v1229: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.7 MiB/s wr, 445 op/s 2023-09-23T09:35:39.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:35:39 smithi082 ceph-mon[97694]: pgmap v1229: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.7 MiB/s wr, 445 op/s 2023-09-23T09:35:39.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:35:39 smithi161 ceph-mon[99580]: pgmap v1229: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.7 MiB/s wr, 445 op/s 2023-09-23T09:35:40.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 510.0 s, 153.9 tps, lat 939.344 ms stddev 1561.077 2023-09-23T09:35:41.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:35:41 smithi135 ceph-mon[99205]: pgmap v1230: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.4 MiB/s wr, 564 op/s 2023-09-23T09:35:41.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:35:41 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:35:41.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:35:41 smithi082 ceph-mon[97694]: pgmap v1230: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.4 MiB/s wr, 564 op/s 2023-09-23T09:35:41.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:35:41 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:35:41.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:35:41 smithi161 ceph-mon[99580]: pgmap v1230: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.4 MiB/s wr, 564 op/s 2023-09-23T09:35:41.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:35:41 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:35:43.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:35:43 smithi135 ceph-mon[99205]: pgmap v1231: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.5 MiB/s wr, 330 op/s 2023-09-23T09:35:43.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:35:43 smithi082 ceph-mon[97694]: pgmap v1231: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.5 MiB/s wr, 330 op/s 2023-09-23T09:35:43.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:35:43 smithi161 ceph-mon[99580]: pgmap v1231: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.5 MiB/s wr, 330 op/s 2023-09-23T09:35:44.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:35:44 smithi135 ceph-mon[99205]: pgmap v1232: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.1 MiB/s wr, 287 op/s 2023-09-23T09:35:44.775 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:35:44 smithi161 ceph-mon[99580]: pgmap v1232: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.1 MiB/s wr, 287 op/s 2023-09-23T09:35:44.775 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:35:44 smithi082 ceph-mon[97694]: pgmap v1232: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.1 MiB/s wr, 287 op/s 2023-09-23T09:35:45.829 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 515.0 s, 37.0 tps, lat 405.156 ms stddev 291.135 2023-09-23T09:35:46.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:35:46 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:35:46.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:35:46 smithi135 ceph-mon[99205]: pgmap v1233: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.5 MiB/s wr, 480 op/s 2023-09-23T09:35:46.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:35:46 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:35:46.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:35:46 smithi082 ceph-mon[97694]: pgmap v1233: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.5 MiB/s wr, 480 op/s 2023-09-23T09:35:46.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:35:46 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:35:46.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:35:46 smithi161 ceph-mon[99580]: pgmap v1233: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.5 MiB/s wr, 480 op/s 2023-09-23T09:35:49.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:35:49 smithi135 ceph-mon[99205]: pgmap v1234: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.5 MiB/s wr, 336 op/s 2023-09-23T09:35:49.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:35:49 smithi082 ceph-mon[97694]: pgmap v1234: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.5 MiB/s wr, 336 op/s 2023-09-23T09:35:49.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:35:49 smithi161 ceph-mon[99580]: pgmap v1234: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.5 MiB/s wr, 336 op/s 2023-09-23T09:35:50.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 520.0 s, 199.3 tps, lat 853.395 ms stddev 1498.609 2023-09-23T09:35:51.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:35:51 smithi135 ceph-mon[99205]: pgmap v1235: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.8 MiB/s wr, 524 op/s 2023-09-23T09:35:51.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:35:51 smithi082 ceph-mon[97694]: pgmap v1235: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.8 MiB/s wr, 524 op/s 2023-09-23T09:35:51.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:35:51 smithi161 ceph-mon[99580]: pgmap v1235: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.8 MiB/s wr, 524 op/s 2023-09-23T09:35:53.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:35:53 smithi135 ceph-mon[99205]: pgmap v1236: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.5 MiB/s wr, 446 op/s 2023-09-23T09:35:53.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:35:53 smithi082 ceph-mon[97694]: pgmap v1236: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.5 MiB/s wr, 446 op/s 2023-09-23T09:35:53.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:35:53 smithi161 ceph-mon[99580]: pgmap v1236: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.5 MiB/s wr, 446 op/s 2023-09-23T09:35:55.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:35:55 smithi135 ceph-mon[99205]: pgmap v1237: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.1 MiB/s wr, 421 op/s 2023-09-23T09:35:55.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:35:55 smithi082 ceph-mon[97694]: pgmap v1237: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.1 MiB/s wr, 421 op/s 2023-09-23T09:35:55.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:35:55 smithi161 ceph-mon[99580]: pgmap v1237: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.1 MiB/s wr, 421 op/s 2023-09-23T09:35:55.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 525.0 s, 206.2 tps, lat 530.567 ms stddev 544.496 2023-09-23T09:35:56.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:35:56 smithi135 ceph-mon[99205]: pgmap v1238: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 3.3 MiB/s rd, 5.5 MiB/s wr, 714 op/s 2023-09-23T09:35:56.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:35:56 smithi082 ceph-mon[97694]: pgmap v1238: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 3.3 MiB/s rd, 5.5 MiB/s wr, 714 op/s 2023-09-23T09:35:56.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:35:56 smithi161 ceph-mon[99580]: pgmap v1238: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 3.3 MiB/s rd, 5.5 MiB/s wr, 714 op/s 2023-09-23T09:35:58.828 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:35:59.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.049+0000 7fee5939d700 1 -- 172.21.15.82:0/2139512603 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee54111720 msgr2=0x7fee54113b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:35:59.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.049+0000 7fee5939d700 1 --2- 172.21.15.82:0/2139512603 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee54111720 0x7fee54113b10 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fee4c009f90 tx=0x7fee4c00b330 comp rx=0 tx=0).stop 2023-09-23T09:35:59.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.050+0000 7fee5939d700 1 -- 172.21.15.82:0/2139512603 shutdown_connections 2023-09-23T09:35:59.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.050+0000 7fee5939d700 1 --2- 172.21.15.82:0/2139512603 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee54111720 0x7fee54113b10 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:35:59.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.050+0000 7fee5939d700 1 --2- 172.21.15.82:0/2139512603 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fee54072cc0 0x7fee540730a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:35:59.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.050+0000 7fee5939d700 1 --2- 172.21.15.82:0/2139512603 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee540735e0 0x7fee541111e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:35:59.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.050+0000 7fee5939d700 1 -- 172.21.15.82:0/2139512603 >> 172.21.15.82:0/2139512603 conn(0x7fee540fc1e0 msgr2=0x7fee540fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:35:59.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.050+0000 7fee5939d700 1 -- 172.21.15.82:0/2139512603 shutdown_connections 2023-09-23T09:35:59.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.050+0000 7fee5939d700 1 -- 172.21.15.82:0/2139512603 wait complete. 2023-09-23T09:35:59.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.051+0000 7fee5939d700 1 Processor -- start 2023-09-23T09:35:59.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.051+0000 7fee5939d700 1 -- start start 2023-09-23T09:35:59.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.052+0000 7fee5939d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee54072cc0 0x7fee5419cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:35:59.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.052+0000 7fee5939d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fee540735e0 0x7fee5419d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:35:59.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.052+0000 7fee5939d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee54111720 0x7fee541a1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:35:59.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.052+0000 7fee5939d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee541a1db0 con 0x7fee54111720 2023-09-23T09:35:59.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.052+0000 7fee5939d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee541a1f20 con 0x7fee54072cc0 2023-09-23T09:35:59.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.052+0000 7fee5939d700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee541a20e0 con 0x7fee540735e0 2023-09-23T09:35:59.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.052+0000 7fee53fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee54072cc0 0x7fee5419cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:35:59.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.052+0000 7fee537fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fee540735e0 0x7fee5419d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:35:59.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.052+0000 7fee53fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee54072cc0 0x7fee5419cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:41526/0 (socket says 172.21.15.82:41526) 2023-09-23T09:35:59.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.052+0000 7fee53fff700 1 -- 172.21.15.82:0/470167003 learned_addr learned my addr 172.21.15.82:0/470167003 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:35:59.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.052+0000 7fee58b9c700 1 --2- 172.21.15.82:0/470167003 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee54111720 0x7fee541a1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:35:59.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.053+0000 7fee537fe700 1 -- 172.21.15.82:0/470167003 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee54072cc0 msgr2=0x7fee5419cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:35:59.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.053+0000 7fee537fe700 1 --2- 172.21.15.82:0/470167003 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee54072cc0 0x7fee5419cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:35:59.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.053+0000 7fee537fe700 1 -- 172.21.15.82:0/470167003 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee54111720 msgr2=0x7fee541a1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:35:59.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.053+0000 7fee537fe700 1 --2- 172.21.15.82:0/470167003 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee54111720 0x7fee541a1770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:35:59.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.053+0000 7fee537fe700 1 -- 172.21.15.82:0/470167003 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee4c009c40 con 0x7fee540735e0 2023-09-23T09:35:59.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.053+0000 7fee58b9c700 1 --2- 172.21.15.82:0/470167003 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee54111720 0x7fee541a1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:35:59.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.053+0000 7fee537fe700 1 --2- 172.21.15.82:0/470167003 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fee540735e0 0x7fee5419d310 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fee4800e9f0 tx=0x7fee4800ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:35:59.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.053+0000 7fee517fa700 1 -- 172.21.15.82:0/470167003 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee4800eee0 con 0x7fee540735e0 2023-09-23T09:35:59.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.053+0000 7fee517fa700 1 -- 172.21.15.82:0/470167003 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fee4800cbd0 con 0x7fee540735e0 2023-09-23T09:35:59.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.053+0000 7fee5939d700 1 -- 172.21.15.82:0/470167003 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee541a23c0 con 0x7fee540735e0 2023-09-23T09:35:59.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.053+0000 7fee517fa700 1 -- 172.21.15.82:0/470167003 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee48018680 con 0x7fee540735e0 2023-09-23T09:35:59.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.053+0000 7fee5939d700 1 -- 172.21.15.82:0/470167003 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee541a9c00 con 0x7fee540735e0 2023-09-23T09:35:59.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.057+0000 7fee517fa700 1 -- 172.21.15.82:0/470167003 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7fee4800cd40 con 0x7fee540735e0 2023-09-23T09:35:59.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.058+0000 7fee6dfa9b80 1 Processor -- start 2023-09-23T09:35:59.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.058+0000 7fee6dfa9b80 1 -- start start 2023-09-23T09:35:59.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.058+0000 7fee6dfa9b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fabd8a1500 0x55fabd8a18e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:35:59.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.059+0000 7fee6dfa9b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fabd8a1e20 0x55fabd89b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:35:59.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.059+0000 7fee6dfa9b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fabd89bc40 0x55fabd89c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:35:59.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.059+0000 7fee6dfa9b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fabd8037b0 con 0x55fabd8a1e20 2023-09-23T09:35:59.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.059+0000 7fee6dfa9b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fabd7f4780 con 0x55fabd89bc40 2023-09-23T09:35:59.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.059+0000 7fee6dfa9b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fabd7f20a0 con 0x55fabd8a1500 2023-09-23T09:35:59.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.059+0000 7fee58b9c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fabd8a1500 0x55fabd8a18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:35:59.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.059+0000 7fee58b9c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fabd8a1500 0x55fabd8a18e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:50342/0 (socket says 172.21.15.82:50342) 2023-09-23T09:35:59.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.059+0000 7fee58b9c700 1 -- 172.21.15.82:0/1705955284 learned_addr learned my addr 172.21.15.82:0/1705955284 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:35:59.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.059+0000 7fee53fff700 1 --2- 172.21.15.82:0/1705955284 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fabd8a1e20 0x55fabd89b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:35:59.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.059+0000 7fee537fe700 1 --2- 172.21.15.82:0/1705955284 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fabd89bc40 0x55fabd89c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:35:59.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.059+0000 7fee517fa700 1 --2- 172.21.15.82:0/470167003 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fee3c0a0160 0x7fee3c0a2620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:35:59.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.059+0000 7fee58b9c700 1 -- 172.21.15.82:0/1705955284 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fabd89bc40 msgr2=0x55fabd89c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:35:59.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.059+0000 7fee58b9c700 1 --2- 172.21.15.82:0/1705955284 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fabd89bc40 0x55fabd89c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:35:59.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.060+0000 7fee58b9c700 1 -- 172.21.15.82:0/1705955284 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fabd8a1e20 msgr2=0x55fabd89b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:35:59.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.060+0000 7fee58b9c700 1 --2- 172.21.15.82:0/1705955284 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fabd8a1e20 0x55fabd89b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:35:59.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.060+0000 7fee58b9c700 1 -- 172.21.15.82:0/1705955284 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fabd66d630 con 0x55fabd8a1500 2023-09-23T09:35:59.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.060+0000 7fee517fa700 1 -- 172.21.15.82:0/470167003 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fee48014070 con 0x7fee540735e0 2023-09-23T09:35:59.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.060+0000 7fee58b9c700 1 --2- 172.21.15.82:0/470167003 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fee3c0a0160 0x7fee3c0a2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:35:59.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.060+0000 7fee58b9c700 1 --2- 172.21.15.82:0/1705955284 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fabd8a1500 0x55fabd8a18e0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fee4c009360 tx=0x7fee4c009390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=49b735210f2690c0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:35:59.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.061+0000 7fee3a7fc700 1 -- 172.21.15.82:0/1705955284 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee4c00e070 con 0x55fabd8a1500 2023-09-23T09:35:59.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.061+0000 7fee3a7fc700 1 -- 172.21.15.82:0/1705955284 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fee4c0076e0 con 0x55fabd8a1500 2023-09-23T09:35:59.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.061+0000 7fee3a7fc700 1 -- 172.21.15.82:0/1705955284 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee4c0052a0 con 0x55fabd8a1500 2023-09-23T09:35:59.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.061+0000 7fee58b9c700 1 --2- 172.21.15.82:0/470167003 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fee3c0a0160 0x7fee3c0a2620 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fee4c009530 tx=0x7fee4c029000 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:35:59.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.061+0000 7fee6dfa9b80 1 -- 172.21.15.82:0/1705955284 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fabd8a1500 msgr2=0x55fabd8a18e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:35:59.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.061+0000 7fee6dfa9b80 1 --2- 172.21.15.82:0/1705955284 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fabd8a1500 0x55fabd8a18e0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fee4c009360 tx=0x7fee4c009390 comp rx=0 tx=0).stop 2023-09-23T09:35:59.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.062+0000 7fee6dfa9b80 1 -- 172.21.15.82:0/1705955284 shutdown_connections 2023-09-23T09:35:59.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.062+0000 7fee6dfa9b80 1 --2- 172.21.15.82:0/1705955284 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fabd89bc40 0x55fabd89c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:35:59.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.062+0000 7fee6dfa9b80 1 --2- 172.21.15.82:0/1705955284 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fabd8a1500 0x55fabd8a18e0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:35:59.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.062+0000 7fee6dfa9b80 1 --2- 172.21.15.82:0/1705955284 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fabd8a1e20 0x55fabd89b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:35:59.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.062+0000 7fee6dfa9b80 1 -- 172.21.15.82:0/1705955284 >> 172.21.15.82:0/1705955284 conn(0x55fabd8100e0 msgr2=0x55fabd896940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:35:59.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.062+0000 7fee6dfa9b80 1 -- 172.21.15.82:0/1705955284 shutdown_connections 2023-09-23T09:35:59.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.062+0000 7fee6dfa9b80 1 -- 172.21.15.82:0/1705955284 wait complete. 2023-09-23T09:35:59.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.062+0000 7fee6dfa9b80 1 -- start start 2023-09-23T09:35:59.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.063+0000 7fee6dfa9b80 1 Processor -- start 2023-09-23T09:35:59.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.063+0000 7fee6dfa9b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fabd89bc40 0x55fabd8a5150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:35:59.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.063+0000 7fee6dfa9b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fabd8a1500 0x55fabd8a5690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:35:59.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.063+0000 7fee6dfa9b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fabd8a1e20 0x55fabd8a5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:35:59.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.063+0000 7fee6dfa9b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fabd7ed990 con 0x55fabd8a1e20 2023-09-23T09:35:59.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.063+0000 7fee6dfa9b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fabd78bbb0 con 0x55fabd8a1500 2023-09-23T09:35:59.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.063+0000 7fee6dfa9b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fabd78b8b0 con 0x55fabd89bc40 2023-09-23T09:35:59.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.064+0000 7fee6dfa9b80 10 client.0 _ll_register_callbacks cb 0x55fabd6d5a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:35:59.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.064+0000 7fee58b9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fabd8a1e20 0x55fabd8a5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:35:59.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.064+0000 7fee537fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fabd8a1500 0x55fabd8a5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:35:59.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.064+0000 7fee53fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fabd89bc40 0x55fabd8a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:35:59.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.064+0000 7fee58b9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fabd8a1e20 0x55fabd8a5bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57892/0 (socket says 172.21.15.82:57892) 2023-09-23T09:35:59.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.064+0000 7fee58b9c700 1 -- 172.21.15.82:0/513490842 learned_addr learned my addr 172.21.15.82:0/513490842 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:35:59.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.064+0000 7fee53fff700 1 -- 172.21.15.82:0/513490842 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fabd8a1500 msgr2=0x55fabd8a5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:35:59.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.064+0000 7fee53fff700 1 --2- 172.21.15.82:0/513490842 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fabd8a1500 0x55fabd8a5690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:35:59.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.064+0000 7fee53fff700 1 -- 172.21.15.82:0/513490842 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fabd8a1e20 msgr2=0x55fabd8a5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:35:59.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.064+0000 7fee53fff700 1 --2- 172.21.15.82:0/513490842 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fabd8a1e20 0x55fabd8a5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:35:59.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.064+0000 7fee53fff700 1 -- 172.21.15.82:0/513490842 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee541144c0 con 0x55fabd89bc40 2023-09-23T09:35:59.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.065+0000 7fee53fff700 1 --2- 172.21.15.82:0/513490842 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fabd89bc40 0x55fabd8a5150 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fee44005950 tx=0x7fee44012af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6703f463cd35412c server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:35:59.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.065+0000 7fee337fe700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T09:35:59.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.065+0000 7fee337fe700 1 -- 172.21.15.82:0/513490842 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee44017070 con 0x55fabd89bc40 2023-09-23T09:35:59.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.065+0000 7fee337fe700 1 -- 172.21.15.82:0/513490842 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(153..153 src has 1..153) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fee44004020 con 0x55fabd89bc40 2023-09-23T09:35:59.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.065+0000 7fee6dfa9b80 1 -- 172.21.15.82:0/513490842 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fabd86b1c0 con 0x55fabd89bc40 2023-09-23T09:35:59.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.065+0000 7fee337fe700 1 -- 172.21.15.82:0/513490842 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7fee440122e0 con 0x55fabd89bc40 2023-09-23T09:35:59.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.065+0000 7fee6dfa9b80 10 client.27787 fetch_fsmap learned FSMap version 116 2023-09-23T09:35:59.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.065+0000 7fee6dfa9b80 1 -- 172.21.15.82:0/513490842 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=4+}) v3 -- 0x55fabd619de0 con 0x55fabd89bc40 2023-09-23T09:35:59.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.065+0000 7fee337fe700 1 -- 172.21.15.82:0/513490842 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55fabd86b1c0 con 0x55fabd89bc40 2023-09-23T09:35:59.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.066+0000 7fee337fe700 1 -- 172.21.15.82:0/513490842 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 116) v1 ==== 7958+0+0 (secure 0 0 0) 0x7fee44025480 con 0x55fabd89bc40 2023-09-23T09:35:59.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.066+0000 7fee6dfa9b80 10 client.27787 fetch_fsmap finished waiting for FSMap version 116 2023-09-23T09:35:59.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.066+0000 7fee6dfa9b80 10 client.27787 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:35:59.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.066+0000 7fee6dfa9b80 20 client.27787 populate_metadata read hostname 'smithi082' 2023-09-23T09:35:59.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.066+0000 7fee6dfa9b80 1 --2- 172.21.15.82:0/513490842 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55fabd8b5aa0 0x55fabd8b7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:35:59.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.066+0000 7fee6dfa9b80 4 client.27787 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:35:59.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.066+0000 7fee6dfa9b80 1 -- 172.21.15.82:0/513490842 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fabd793ba0 con 0x55fabd8b5aa0 2023-09-23T09:35:59.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.066+0000 7fee537fe700 1 --2- 172.21.15.82:0/513490842 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55fabd8b5aa0 0x55fabd8b7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:35:59.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.067+0000 7fee337fe700 10 client.27787 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:35:59.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.067+0000 7fee537fe700 1 --2- 172.21.15.82:0/513490842 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55fabd8b5aa0 0x55fabd8b7ec0 crc :-1 s=READY pgs=253 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=564a83d99303c87b server_cookie=a040a97b696da01f in_seq=0 out_seq=0 2023-09-23T09:35:59.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.068+0000 7fee337fe700 1 -- 172.21.15.82:0/513490842 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55fabd793ba0 con 0x55fabd8b5aa0 2023-09-23T09:35:59.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.068+0000 7fee337fe700 10 client.27787 handle_command_reply: tid=0 2023-09-23T09:35:59.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.068+0000 7fee6dfa9b80 1 client.27787 shutdown 2023-09-23T09:35:59.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.068+0000 7fee6dfa9b80 1 -- 172.21.15.82:0/513490842 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fabd89bc40 msgr2=0x55fabd8a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:35:59.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.068+0000 7fee6dfa9b80 1 --2- 172.21.15.82:0/513490842 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fabd89bc40 0x55fabd8a5150 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fee44005950 tx=0x7fee44012af0 comp rx=0 tx=0).stop 2023-09-23T09:35:59.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.068+0000 7fee6dfa9b80 1 -- 172.21.15.82:0/513490842 shutdown_connections 2023-09-23T09:35:59.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.068+0000 7fee6dfa9b80 1 --2- 172.21.15.82:0/513490842 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55fabd8b5aa0 0x55fabd8b7ec0 crc :-1 s=READY pgs=253 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:35:59.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.068+0000 7fee6dfa9b80 1 --2- 172.21.15.82:0/513490842 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fabd8a1e20 0x55fabd8a5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:35:59.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.068+0000 7fee6dfa9b80 1 --2- 172.21.15.82:0/513490842 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fabd89bc40 0x55fabd8a5150 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:35:59.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.068+0000 7fee337fe700 0 client.27787 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:35:59.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.068+0000 7fee6dfa9b80 1 --2- 172.21.15.82:0/513490842 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fabd8a1500 0x55fabd8a5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:35:59.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.068+0000 7fee6dfa9b80 1 -- 172.21.15.82:0/513490842 >> 172.21.15.82:0/513490842 conn(0x55fabd8100e0 msgr2=0x55fabd89a6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:35:59.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.068+0000 7fee6dfa9b80 1 -- 172.21.15.82:0/513490842 shutdown_connections 2023-09-23T09:35:59.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.068+0000 7fee6dfa9b80 1 -- 172.21.15.82:0/513490842 wait complete. 2023-09-23T09:35:59.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.068+0000 7fee6dfa9b80 20 client.27787 trim_cache size 0 max 16384 2023-09-23T09:35:59.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.087+0000 7fee6dfa9b80 1 Processor -- start 2023-09-23T09:35:59.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.087+0000 7fee6dfa9b80 1 -- start start 2023-09-23T09:35:59.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.088+0000 7fee6dfa9b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fabd89bc40 0x55fabd89b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:35:59.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.088+0000 7fee6dfa9b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fabd8a1500 0x55fabd89f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:35:59.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.088+0000 7fee6dfa9b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fabd8a1e20 0x55fabd8ac9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:35:59.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.088+0000 7fee6dfa9b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fabd66f920 con 0x55fabd8a1e20 2023-09-23T09:35:59.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.088+0000 7fee6dfa9b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fabd8977a0 con 0x55fabd8a1500 2023-09-23T09:35:59.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.088+0000 7fee6dfa9b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fabd8a8200 con 0x55fabd89bc40 2023-09-23T09:35:59.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.088+0000 7fee58b9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fabd8a1e20 0x55fabd8ac9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:35:59.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.088+0000 7fee58b9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fabd8a1e20 0x55fabd8ac9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57908/0 (socket says 172.21.15.82:57908) 2023-09-23T09:35:59.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.088+0000 7fee58b9c700 1 -- 172.21.15.82:0/1005771967 learned_addr learned my addr 172.21.15.82:0/1005771967 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:35:59.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.088+0000 7fee537fe700 1 --2- 172.21.15.82:0/1005771967 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fabd8a1500 0x55fabd89f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:35:59.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.088+0000 7fee53fff700 1 --2- 172.21.15.82:0/1005771967 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fabd89bc40 0x55fabd89b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:35:59.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.088+0000 7fee58b9c700 1 -- 172.21.15.82:0/1005771967 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fabd89bc40 msgr2=0x55fabd89b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:35:59.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.088+0000 7fee58b9c700 1 --2- 172.21.15.82:0/1005771967 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fabd89bc40 0x55fabd89b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:35:59.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.088+0000 7fee58b9c700 1 -- 172.21.15.82:0/1005771967 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fabd8a1500 msgr2=0x55fabd89f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:35:59.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.088+0000 7fee58b9c700 1 --2- 172.21.15.82:0/1005771967 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fabd8a1500 0x55fabd89f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:35:59.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.088+0000 7fee58b9c700 1 -- 172.21.15.82:0/1005771967 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fabd602c60 con 0x55fabd8a1e20 2023-09-23T09:35:59.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.089+0000 7fee58b9c700 1 --2- 172.21.15.82:0/1005771967 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fabd8a1e20 0x55fabd8ac9c0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fee4c009400 tx=0x7fee4c0096c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=520079e0f282b8c0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:35:59.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.089+0000 7fee3affd700 1 -- 172.21.15.82:0/1005771967 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee4c00e040 con 0x55fabd8a1e20 2023-09-23T09:35:59.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.089+0000 7fee3affd700 1 -- 172.21.15.82:0/1005771967 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fee4c005040 con 0x55fabd8a1e20 2023-09-23T09:35:59.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.089+0000 7fee3affd700 1 -- 172.21.15.82:0/1005771967 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee4c005530 con 0x55fabd8a1e20 2023-09-23T09:35:59.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.090+0000 7fee6dfa9b80 1 -- 172.21.15.82:0/1005771967 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fabd8a1e20 msgr2=0x55fabd8ac9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:35:59.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.090+0000 7fee6dfa9b80 1 --2- 172.21.15.82:0/1005771967 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fabd8a1e20 0x55fabd8ac9c0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fee4c009400 tx=0x7fee4c0096c0 comp rx=0 tx=0).stop 2023-09-23T09:35:59.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.090+0000 7fee6dfa9b80 1 -- 172.21.15.82:0/1005771967 shutdown_connections 2023-09-23T09:35:59.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.090+0000 7fee6dfa9b80 1 --2- 172.21.15.82:0/1005771967 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fabd8a1e20 0x55fabd8ac9c0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:35:59.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.090+0000 7fee6dfa9b80 1 --2- 172.21.15.82:0/1005771967 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fabd89bc40 0x55fabd89b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:35:59.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.090+0000 7fee6dfa9b80 1 --2- 172.21.15.82:0/1005771967 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fabd8a1500 0x55fabd89f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:35:59.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.090+0000 7fee6dfa9b80 1 -- 172.21.15.82:0/1005771967 >> 172.21.15.82:0/1005771967 conn(0x55fabd8100e0 msgr2=0x55fabd89f040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:35:59.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.090+0000 7fee6dfa9b80 1 -- 172.21.15.82:0/1005771967 shutdown_connections 2023-09-23T09:35:59.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.090+0000 7fee6dfa9b80 1 -- 172.21.15.82:0/1005771967 wait complete. 2023-09-23T09:35:59.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.091+0000 7fee6dfa9b80 1 -- start start 2023-09-23T09:35:59.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.091+0000 7fee6dfa9b80 1 Processor -- start 2023-09-23T09:35:59.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.091+0000 7fee6dfa9b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fabd89bc40 0x55fabd8ac760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:35:59.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.091+0000 7fee6dfa9b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fabd8a1500 0x55fabd8aaa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:35:59.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.091+0000 7fee6dfa9b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fabd8a1e20 0x55fabd8aafd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:35:59.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.091+0000 7fee6dfa9b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fabd8ab510 con 0x55fabd8a1e20 2023-09-23T09:35:59.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.091+0000 7fee6dfa9b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fabd8ab680 con 0x55fabd8a1500 2023-09-23T09:35:59.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.091+0000 7fee6dfa9b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fabd8ab840 con 0x55fabd89bc40 2023-09-23T09:35:59.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.091+0000 7fee6dfa9b80 10 client.0 _ll_register_callbacks cb 0x7fee44009e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:35:59.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.092+0000 7fee537fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fabd8a1500 0x55fabd8aaa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:35:59.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.092+0000 7fee53fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fabd89bc40 0x55fabd8ac760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:35:59.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.092+0000 7fee537fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fabd8a1500 0x55fabd8aaa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:41560/0 (socket says 172.21.15.82:41560) 2023-09-23T09:35:59.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.092+0000 7fee58b9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fabd8a1e20 0x55fabd8aafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:35:59.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.092+0000 7fee537fe700 1 -- 172.21.15.82:0/1291266490 learned_addr learned my addr 172.21.15.82:0/1291266490 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:35:59.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.092+0000 7fee537fe700 1 -- 172.21.15.82:0/1291266490 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fabd89bc40 msgr2=0x55fabd8ac760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:35:59.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.092+0000 7fee537fe700 1 --2- 172.21.15.82:0/1291266490 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fabd89bc40 0x55fabd8ac760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:35:59.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.092+0000 7fee537fe700 1 -- 172.21.15.82:0/1291266490 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fabd8a1e20 msgr2=0x55fabd8aafd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:35:59.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.092+0000 7fee537fe700 1 --2- 172.21.15.82:0/1291266490 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fabd8a1e20 0x55fabd8aafd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:35:59.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.092+0000 7fee537fe700 1 -- 172.21.15.82:0/1291266490 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee4c02a040 con 0x55fabd8a1500 2023-09-23T09:35:59.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.092+0000 7fee537fe700 1 --2- 172.21.15.82:0/1291266490 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fabd8a1500 0x55fabd8aaa90 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fee48095390 tx=0x7fee480cda30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e4ae50d64dc49c90 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:35:59.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.092+0000 7fee337fe700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-09-23T09:35:59.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.093+0000 7fee337fe700 1 -- 172.21.15.82:0/1291266490 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee48099ea0 con 0x55fabd8a1500 2023-09-23T09:35:59.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.093+0000 7fee337fe700 1 -- 172.21.15.82:0/1291266490 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(153..153 src has 1..153) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fee48099590 con 0x55fabd8a1500 2023-09-23T09:35:59.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.093+0000 7fee6dfa9b80 1 -- 172.21.15.82:0/1291266490 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fabd88e8b0 con 0x55fabd8a1500 2023-09-23T09:35:59.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.093+0000 7fee337fe700 1 -- 172.21.15.82:0/1291266490 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7fee480987f0 con 0x55fabd8a1500 2023-09-23T09:35:59.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.093+0000 7fee6dfa9b80 10 client.27767 fetch_fsmap learned FSMap version 116 2023-09-23T09:35:59.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.093+0000 7fee6dfa9b80 1 -- 172.21.15.82:0/1291266490 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=4+}) v3 -- 0x55fabd640250 con 0x55fabd8a1500 2023-09-23T09:35:59.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.093+0000 7fee337fe700 1 -- 172.21.15.82:0/1291266490 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55fabd88e8b0 con 0x55fabd8a1500 2023-09-23T09:35:59.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.093+0000 7fee337fe700 1 -- 172.21.15.82:0/1291266490 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 116) v1 ==== 7958+0+0 (secure 0 0 0) 0x7fee48098380 con 0x55fabd8a1500 2023-09-23T09:35:59.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.093+0000 7fee6dfa9b80 10 client.27767 fetch_fsmap finished waiting for FSMap version 116 2023-09-23T09:35:59.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.094+0000 7fee6dfa9b80 10 client.27767 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:35:59.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.094+0000 7fee6dfa9b80 20 client.27767 populate_metadata read hostname 'smithi082' 2023-09-23T09:35:59.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.094+0000 7fee6dfa9b80 1 --2- 172.21.15.82:0/1291266490 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55fabd90adc0 0x55fabd90d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:35:59.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.094+0000 7fee6dfa9b80 4 client.27767 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:35:59.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.094+0000 7fee6dfa9b80 1 -- 172.21.15.82:0/1291266490 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55fabd7e6970 con 0x55fabd90adc0 2023-09-23T09:35:59.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.094+0000 7fee53fff700 1 --2- 172.21.15.82:0/1291266490 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55fabd90adc0 0x55fabd90d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:35:59.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.095+0000 7fee53fff700 1 --2- 172.21.15.82:0/1291266490 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55fabd90adc0 0x55fabd90d1e0 crc :-1 s=READY pgs=254 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f1bb5f94c216aa2a server_cookie=25987275e0a3e053 in_seq=0 out_seq=0 2023-09-23T09:35:59.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.095+0000 7fee337fe700 10 client.27767 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:35:59.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.095+0000 7fee337fe700 1 -- 172.21.15.82:0/1291266490 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55fabd7e6970 con 0x55fabd90adc0 2023-09-23T09:35:59.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.095+0000 7fee337fe700 10 client.27767 handle_command_reply: tid=0 2023-09-23T09:35:59.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.095+0000 7fee6dfa9b80 1 client.27767 shutdown 2023-09-23T09:35:59.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.095+0000 7fee6dfa9b80 1 -- 172.21.15.82:0/1291266490 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fabd8a1500 msgr2=0x55fabd8aaa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:35:59.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.095+0000 7fee6dfa9b80 1 --2- 172.21.15.82:0/1291266490 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fabd8a1500 0x55fabd8aaa90 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fee48095390 tx=0x7fee480cda30 comp rx=0 tx=0).stop 2023-09-23T09:35:59.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.095+0000 7fee6dfa9b80 1 -- 172.21.15.82:0/1291266490 shutdown_connections 2023-09-23T09:35:59.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.095+0000 7fee6dfa9b80 1 --2- 172.21.15.82:0/1291266490 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55fabd90adc0 0x55fabd90d1e0 crc :-1 s=READY pgs=254 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:35:59.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.095+0000 7fee6dfa9b80 1 --2- 172.21.15.82:0/1291266490 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fabd8a1e20 0x55fabd8aafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:35:59.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.095+0000 7fee6dfa9b80 1 --2- 172.21.15.82:0/1291266490 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fabd89bc40 0x55fabd8ac760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:35:59.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.095+0000 7fee6dfa9b80 1 --2- 172.21.15.82:0/1291266490 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fabd8a1500 0x55fabd8aaa90 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:35:59.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.095+0000 7fee337fe700 0 client.27767 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:35:59.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.095+0000 7fee6dfa9b80 1 -- 172.21.15.82:0/1291266490 >> 172.21.15.82:0/1291266490 conn(0x55fabd8100e0 msgr2=0x55fabd896930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:35:59.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.095+0000 7fee6dfa9b80 1 -- 172.21.15.82:0/1291266490 shutdown_connections 2023-09-23T09:35:59.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.095+0000 7fee6dfa9b80 1 -- 172.21.15.82:0/1291266490 wait complete. 2023-09-23T09:35:59.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.096+0000 7fee6dfa9b80 20 client.27767 trim_cache size 0 max 16384 2023-09-23T09:35:59.102 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:35:59.102 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-23T09:35:59.102 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:35:59.102 INFO:teuthology.orchestra.run.smithi082.stdout: "d9e62ab8-1468-4fb0-a9fe-61bed13e954b": { 2023-09-23T09:35:59.102 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:35:59.102 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "d9e62ab8-1468-4fb0-a9fe-61bed13e954b", 2023-09-23T09:35:59.102 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:35:59.102 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:35:59.102 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:35:59.103 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:35:59.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.096+0000 7fee5939d700 1 -- 172.21.15.82:0/470167003 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fee3c0a0160 msgr2=0x7fee3c0a2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:35:59.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.096+0000 7fee5939d700 1 --2- 172.21.15.82:0/470167003 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fee3c0a0160 0x7fee3c0a2620 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fee4c009530 tx=0x7fee4c029000 comp rx=0 tx=0).stop 2023-09-23T09:35:59.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.096+0000 7fee5939d700 1 -- 172.21.15.82:0/470167003 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fee540735e0 msgr2=0x7fee5419d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:35:59.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.096+0000 7fee5939d700 1 --2- 172.21.15.82:0/470167003 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fee540735e0 0x7fee5419d310 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fee4800e9f0 tx=0x7fee4800ed00 comp rx=0 tx=0).stop 2023-09-23T09:35:59.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.096+0000 7fee5939d700 1 -- 172.21.15.82:0/470167003 shutdown_connections 2023-09-23T09:35:59.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.096+0000 7fee5939d700 1 --2- 172.21.15.82:0/470167003 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fee3c0a0160 0x7fee3c0a2620 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:35:59.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.096+0000 7fee5939d700 1 --2- 172.21.15.82:0/470167003 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee54111720 0x7fee541a1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:35:59.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.096+0000 7fee5939d700 1 --2- 172.21.15.82:0/470167003 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee54072cc0 0x7fee5419cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:35:59.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.096+0000 7fee5939d700 1 --2- 172.21.15.82:0/470167003 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fee540735e0 0x7fee5419d310 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:35:59.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.096+0000 7fee5939d700 1 -- 172.21.15.82:0/470167003 >> 172.21.15.82:0/470167003 conn(0x7fee540fc1e0 msgr2=0x7fee540fce50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:35:59.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.097+0000 7fee5939d700 1 -- 172.21.15.82:0/470167003 shutdown_connections 2023-09-23T09:35:59.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:35:59.097+0000 7fee5939d700 1 -- 172.21.15.82:0/470167003 wait complete. 2023-09-23T09:35:59.120 INFO:tasks.cephfs.filesystem:scrub status for tag:d9e62ab8-1468-4fb0-a9fe-61bed13e954b - {'path': '/', 'tag': 'd9e62ab8-1468-4fb0-a9fe-61bed13e954b', 'options': 'recursive,force'} 2023-09-23T09:35:59.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:35:59 smithi135 ceph-mon[99205]: pgmap v1239: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.1 MiB/s wr, 521 op/s 2023-09-23T09:35:59.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:35:59 smithi082 ceph-mon[97694]: pgmap v1239: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.1 MiB/s wr, 521 op/s 2023-09-23T09:35:59.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:35:59 smithi161 ceph-mon[99580]: pgmap v1239: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.1 MiB/s wr, 521 op/s 2023-09-23T09:36:00.827 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 530.0 s, 99.8 tps, lat 1003.450 ms stddev 1161.864 2023-09-23T09:36:01.566 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:36:01 smithi135 ceph-mon[99205]: pgmap v1240: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1011 GiB / 1.0 TiB avail; 3.3 MiB/s rd, 5.9 MiB/s wr, 740 op/s 2023-09-23T09:36:01.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:36:01 smithi082 ceph-mon[97694]: pgmap v1240: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1011 GiB / 1.0 TiB avail; 3.3 MiB/s rd, 5.9 MiB/s wr, 740 op/s 2023-09-23T09:36:01.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:36:01 smithi161 ceph-mon[99580]: pgmap v1240: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1011 GiB / 1.0 TiB avail; 3.3 MiB/s rd, 5.9 MiB/s wr, 740 op/s 2023-09-23T09:36:03.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:36:03 smithi135 ceph-mon[99205]: pgmap v1241: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1011 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.7 MiB/s wr, 577 op/s 2023-09-23T09:36:03.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:36:03 smithi082 ceph-mon[97694]: pgmap v1241: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1011 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.7 MiB/s wr, 577 op/s 2023-09-23T09:36:03.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:36:03 smithi161 ceph-mon[99580]: pgmap v1241: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1011 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.7 MiB/s wr, 577 op/s 2023-09-23T09:36:04.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:36:04 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:36:04.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:36:04 smithi135 ceph-mon[99205]: pgmap v1242: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1011 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.2 MiB/s wr, 536 op/s 2023-09-23T09:36:04.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:36:04 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:36:04.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:36:04 smithi082 ceph-mon[97694]: pgmap v1242: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1011 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.2 MiB/s wr, 536 op/s 2023-09-23T09:36:04.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:36:04 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:36:04.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:36:04 smithi161 ceph-mon[99580]: pgmap v1242: 97 pgs: 97 active+clean; 15 GiB data, 61 GiB used, 1011 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.2 MiB/s wr, 536 op/s 2023-09-23T09:36:05.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 535.0 s, 59.2 tps, lat 1789.271 ms stddev 1666.799 2023-09-23T09:36:07.122 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:36:06 smithi082 ceph-mon[97694]: pgmap v1243: 97 pgs: 97 active+clean; 15 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.4 MiB/s wr, 695 op/s 2023-09-23T09:36:07.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:36:06 smithi161 ceph-mon[99580]: pgmap v1243: 97 pgs: 97 active+clean; 15 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.4 MiB/s wr, 695 op/s 2023-09-23T09:36:07.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:36:06 smithi135 ceph-mon[99205]: pgmap v1243: 97 pgs: 97 active+clean; 15 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.4 MiB/s wr, 695 op/s 2023-09-23T09:36:08.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:36:07 smithi082 ceph-mon[97694]: osdmap e154: 12 total, 12 up, 12 in 2023-09-23T09:36:08.151 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:36:07 smithi161 ceph-mon[99580]: osdmap e154: 12 total, 12 up, 12 in 2023-09-23T09:36:08.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:36:07 smithi135 ceph-mon[99205]: osdmap e154: 12 total, 12 up, 12 in 2023-09-23T09:36:09.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:36:08 smithi082 ceph-mon[97694]: pgmap v1245: 97 pgs: 97 active+clean; 15 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.7 MiB/s wr, 484 op/s 2023-09-23T09:36:09.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:36:08 smithi161 ceph-mon[99580]: pgmap v1245: 97 pgs: 97 active+clean; 15 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.7 MiB/s wr, 484 op/s 2023-09-23T09:36:09.316 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:36:08 smithi135 ceph-mon[99205]: pgmap v1245: 97 pgs: 97 active+clean; 15 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.7 MiB/s wr, 484 op/s 2023-09-23T09:36:10.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 540.0 s, 37.8 tps, lat 382.486 ms stddev 220.571 2023-09-23T09:36:11.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:36:10 smithi082 ceph-mon[97694]: pgmap v1246: 97 pgs: 12 active+clean+snaptrim, 21 active+clean+snaptrim_wait, 64 active+clean; 15 GiB data, 61 GiB used, 1011 GiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.6 MiB/s wr, 339 op/s 2023-09-23T09:36:11.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:36:10 smithi161 ceph-mon[99580]: pgmap v1246: 97 pgs: 12 active+clean+snaptrim, 21 active+clean+snaptrim_wait, 64 active+clean; 15 GiB data, 61 GiB used, 1011 GiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.6 MiB/s wr, 339 op/s 2023-09-23T09:36:11.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:36:10 smithi135 ceph-mon[99205]: pgmap v1246: 97 pgs: 12 active+clean+snaptrim, 21 active+clean+snaptrim_wait, 64 active+clean; 15 GiB data, 61 GiB used, 1011 GiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.6 MiB/s wr, 339 op/s 2023-09-23T09:36:13.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:36:12 smithi161 ceph-mon[99580]: pgmap v1247: 97 pgs: 14 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 56 active+clean; 14 GiB data, 61 GiB used, 1011 GiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.5 MiB/s wr, 326 op/s 2023-09-23T09:36:13.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:36:12 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:36:13.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:36:12 smithi135 ceph-mon[99205]: pgmap v1247: 97 pgs: 14 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 56 active+clean; 14 GiB data, 61 GiB used, 1011 GiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.5 MiB/s wr, 326 op/s 2023-09-23T09:36:13.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:36:12 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:36:13.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:36:12 smithi082 ceph-mon[97694]: pgmap v1247: 97 pgs: 14 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 56 active+clean; 14 GiB data, 61 GiB used, 1011 GiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.5 MiB/s wr, 326 op/s 2023-09-23T09:36:13.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:36:12 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:36:15.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:36:14 smithi161 ceph-mon[99580]: pgmap v1248: 97 pgs: 14 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 56 active+clean; 14 GiB data, 61 GiB used, 1011 GiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.5 MiB/s wr, 326 op/s 2023-09-23T09:36:15.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:36:14 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:36:15.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:36:14 smithi135 ceph-mon[99205]: pgmap v1248: 97 pgs: 14 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 56 active+clean; 14 GiB data, 61 GiB used, 1011 GiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.5 MiB/s wr, 326 op/s 2023-09-23T09:36:15.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:36:14 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:36:15.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:36:14 smithi082 ceph-mon[97694]: pgmap v1248: 97 pgs: 14 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 56 active+clean; 14 GiB data, 61 GiB used, 1011 GiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.5 MiB/s wr, 326 op/s 2023-09-23T09:36:15.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:36:14 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:36:15.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 545.0 s, 145.8 tps, lat 1219.836 ms stddev 1731.424 2023-09-23T09:36:17.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:36:16 smithi161 ceph-mon[99580]: pgmap v1249: 97 pgs: 97 active+clean; 14 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.6 MiB/s wr, 339 op/s 2023-09-23T09:36:17.315 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:36:16 smithi135 ceph-mon[99205]: pgmap v1249: 97 pgs: 97 active+clean; 14 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.6 MiB/s wr, 339 op/s 2023-09-23T09:36:17.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:36:16 smithi082 ceph-mon[97694]: pgmap v1249: 97 pgs: 97 active+clean; 14 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.6 MiB/s wr, 339 op/s 2023-09-23T09:36:18.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:36:18 smithi135 ceph-mon[99205]: osdmap e155: 12 total, 12 up, 12 in 2023-09-23T09:36:18.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:36:18 smithi082 ceph-mon[97694]: osdmap e155: 12 total, 12 up, 12 in 2023-09-23T09:36:18.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:36:18 smithi161 ceph-mon[99580]: osdmap e155: 12 total, 12 up, 12 in 2023-09-23T09:36:19.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:36:19 smithi135 ceph-mon[99205]: pgmap v1251: 97 pgs: 97 active+clean; 14 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.6 MiB/s wr, 339 op/s 2023-09-23T09:36:19.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:36:19 smithi082 ceph-mon[97694]: pgmap v1251: 97 pgs: 97 active+clean; 14 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.6 MiB/s wr, 339 op/s 2023-09-23T09:36:19.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:36:19 smithi161 ceph-mon[99580]: pgmap v1251: 97 pgs: 97 active+clean; 14 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.6 MiB/s wr, 339 op/s 2023-09-23T09:36:20.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 550.0 s, 160.8 tps, lat 632.500 ms stddev 578.866 2023-09-23T09:36:21.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:36:21 smithi135 ceph-mon[99205]: pgmap v1252: 97 pgs: 97 active+clean; 14 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.9 MiB/s wr, 510 op/s 2023-09-23T09:36:21.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:36:21 smithi082 ceph-mon[97694]: pgmap v1252: 97 pgs: 97 active+clean; 14 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.9 MiB/s wr, 510 op/s 2023-09-23T09:36:21.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:36:21 smithi161 ceph-mon[99580]: pgmap v1252: 97 pgs: 97 active+clean; 14 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.9 MiB/s wr, 510 op/s 2023-09-23T09:36:23.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:36:23 smithi135 ceph-mon[99205]: pgmap v1253: 97 pgs: 97 active+clean; 14 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.0 MiB/s wr, 530 op/s 2023-09-23T09:36:23.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:36:23 smithi082 ceph-mon[97694]: pgmap v1253: 97 pgs: 97 active+clean; 14 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.0 MiB/s wr, 530 op/s 2023-09-23T09:36:23.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:36:23 smithi161 ceph-mon[99580]: pgmap v1253: 97 pgs: 97 active+clean; 14 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.0 MiB/s wr, 530 op/s 2023-09-23T09:36:24.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:36:24 smithi135 ceph-mon[99205]: pgmap v1254: 97 pgs: 97 active+clean; 14 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.0 MiB/s wr, 530 op/s 2023-09-23T09:36:24.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:36:24 smithi082 ceph-mon[97694]: pgmap v1254: 97 pgs: 97 active+clean; 14 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.0 MiB/s wr, 530 op/s 2023-09-23T09:36:24.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:36:24 smithi161 ceph-mon[99580]: pgmap v1254: 97 pgs: 97 active+clean; 14 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.0 MiB/s wr, 530 op/s 2023-09-23T09:36:25.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 555.0 s, 166.4 tps, lat 598.735 ms stddev 553.336 2023-09-23T09:36:27.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:36:26 smithi082 ceph-mon[97694]: pgmap v1255: 97 pgs: 97 active+clean; 14 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.9 MiB/s wr, 662 op/s 2023-09-23T09:36:27.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:36:26 smithi161 ceph-mon[99580]: pgmap v1255: 97 pgs: 97 active+clean; 14 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.9 MiB/s wr, 662 op/s 2023-09-23T09:36:27.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:36:26 smithi135 ceph-mon[99205]: pgmap v1255: 97 pgs: 97 active+clean; 14 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.9 MiB/s wr, 662 op/s 2023-09-23T09:36:28.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:36:27 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:36:28.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:36:27 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:36:28.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:36:27 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:36:29.120 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:36:29.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.425+0000 7fb738bff700 1 -- 172.21.15.82:0/4252787902 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb734106880 msgr2=0x7fb734106c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:36:29.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.425+0000 7fb738bff700 1 --2- 172.21.15.82:0/4252787902 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb734106880 0x7fb734106c60 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fb724009990 tx=0x7fb724009ca0 comp rx=0 tx=0).stop 2023-09-23T09:36:29.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.425+0000 7fb738bff700 1 -- 172.21.15.82:0/4252787902 shutdown_connections 2023-09-23T09:36:29.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.425+0000 7fb738bff700 1 --2- 172.21.15.82:0/4252787902 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb734101230 0x7fb73410d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:36:29.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.425+0000 7fb738bff700 1 --2- 172.21.15.82:0/4252787902 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb734106880 0x7fb734106c60 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:36:29.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.425+0000 7fb738bff700 1 --2- 172.21.15.82:0/4252787902 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb734100870 0x7fb734100cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:36:29.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.425+0000 7fb738bff700 1 -- 172.21.15.82:0/4252787902 >> 172.21.15.82:0/4252787902 conn(0x7fb7340fc3a0 msgr2=0x7fb7340fe7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:36:29.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.425+0000 7fb738bff700 1 -- 172.21.15.82:0/4252787902 shutdown_connections 2023-09-23T09:36:29.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.425+0000 7fb738bff700 1 -- 172.21.15.82:0/4252787902 wait complete. 2023-09-23T09:36:29.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.426+0000 7fb738bff700 1 Processor -- start 2023-09-23T09:36:29.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.426+0000 7fb738bff700 1 -- start start 2023-09-23T09:36:29.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.426+0000 7fb738bff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb734100870 0x7fb73419e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:36:29.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.426+0000 7fb738bff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb734101230 0x7fb73419ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:36:29.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.426+0000 7fb738bff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb734106880 0x7fb7341988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:36:29.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.426+0000 7fb738bff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb734199070 con 0x7fb734101230 2023-09-23T09:36:29.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.426+0000 7fb738bff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7341991e0 con 0x7fb734106880 2023-09-23T09:36:29.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.426+0000 7fb738bff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7341993a0 con 0x7fb734100870 2023-09-23T09:36:29.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.427+0000 7fb731d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb734101230 0x7fb73419ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:36:29.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.427+0000 7fb731d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb734101230 0x7fb73419ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51462/0 (socket says 172.21.15.82:51462) 2023-09-23T09:36:29.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.427+0000 7fb731d9b700 1 -- 172.21.15.82:0/1253635594 learned_addr learned my addr 172.21.15.82:0/1253635594 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:36:29.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.427+0000 7fb73259c700 1 --2- 172.21.15.82:0/1253635594 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb734100870 0x7fb73419e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:36:29.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.427+0000 7fb732d9d700 1 --2- 172.21.15.82:0/1253635594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb734106880 0x7fb7341988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:36:29.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.427+0000 7fb731d9b700 1 -- 172.21.15.82:0/1253635594 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb734100870 msgr2=0x7fb73419e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:36:29.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.427+0000 7fb731d9b700 1 --2- 172.21.15.82:0/1253635594 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb734100870 0x7fb73419e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:36:29.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.427+0000 7fb731d9b700 1 -- 172.21.15.82:0/1253635594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb734106880 msgr2=0x7fb7341988a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:36:29.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.427+0000 7fb731d9b700 1 --2- 172.21.15.82:0/1253635594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb734106880 0x7fb7341988a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:36:29.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.427+0000 7fb731d9b700 1 -- 172.21.15.82:0/1253635594 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7240095f0 con 0x7fb734101230 2023-09-23T09:36:29.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.427+0000 7fb73259c700 1 --2- 172.21.15.82:0/1253635594 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb734100870 0x7fb73419e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:36:29.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.427+0000 7fb731d9b700 1 --2- 172.21.15.82:0/1253635594 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb734101230 0x7fb73419ee00 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fb72800e9a0 tx=0x7fb72800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:36:29.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.428+0000 7fb7237fe700 1 -- 172.21.15.82:0/1253635594 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb728009790 con 0x7fb734101230 2023-09-23T09:36:29.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.428+0000 7fb7237fe700 1 -- 172.21.15.82:0/1253635594 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb728010430 con 0x7fb734101230 2023-09-23T09:36:29.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.428+0000 7fb738bff700 1 -- 172.21.15.82:0/1253635594 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb734199680 con 0x7fb734101230 2023-09-23T09:36:29.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.428+0000 7fb7237fe700 1 -- 172.21.15.82:0/1253635594 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72800cea0 con 0x7fb734101230 2023-09-23T09:36:29.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.428+0000 7fb738bff700 1 -- 172.21.15.82:0/1253635594 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7341a5890 con 0x7fb734101230 2023-09-23T09:36:29.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.431+0000 7fb7237fe700 1 -- 172.21.15.82:0/1253635594 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7fb7280105a0 con 0x7fb734101230 2023-09-23T09:36:29.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.433+0000 7fb74c61eb80 1 Processor -- start 2023-09-23T09:36:29.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.433+0000 7fb7237fe700 1 --2- 172.21.15.82:0/1253635594 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fb71c0a0140 0x7fb71c0a2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:36:29.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.433+0000 7fb74c61eb80 1 -- start start 2023-09-23T09:36:29.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.433+0000 7fb7237fe700 1 -- 172.21.15.82:0/1253635594 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fb728014070 con 0x7fb734101230 2023-09-23T09:36:29.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.433+0000 7fb732d9d700 1 --2- 172.21.15.82:0/1253635594 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fb71c0a0140 0x7fb71c0a2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:36:29.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.433+0000 7fb74c61eb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fc8b2b4380 0x55fc8b2b4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:36:29.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.433+0000 7fb74c61eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc8b2b4ca0 0x55fc8b2ae700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:36:29.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.433+0000 7fb74c61eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc8b2aec40 0x55fc8b2af0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:36:29.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.433+0000 7fb74c61eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc8b2167b0 con 0x55fc8b2aec40 2023-09-23T09:36:29.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.433+0000 7fb74c61eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc8b207780 con 0x55fc8b2b4ca0 2023-09-23T09:36:29.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.433+0000 7fb74c61eb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc8b2050a0 con 0x55fc8b2b4380 2023-09-23T09:36:29.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.434+0000 7fb732d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc8b2aec40 0x55fc8b2af0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:36:29.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.434+0000 7fb732d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc8b2aec40 0x55fc8b2af0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51466/0 (socket says 172.21.15.82:51466) 2023-09-23T09:36:29.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.434+0000 7fb732d9d700 1 -- 172.21.15.82:0/2655362655 learned_addr learned my addr 172.21.15.82:0/2655362655 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:36:29.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.434+0000 7fb731d9b700 1 --2- 172.21.15.82:0/2655362655 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc8b2b4ca0 0x55fc8b2ae700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:36:29.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.434+0000 7fb73259c700 1 --2- 172.21.15.82:0/2655362655 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fc8b2b4380 0x55fc8b2b4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:36:29.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.434+0000 7fb732d9d700 1 -- 172.21.15.82:0/2655362655 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fc8b2b4380 msgr2=0x55fc8b2b4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:36:29.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.434+0000 7fb732d9d700 1 --2- 172.21.15.82:0/2655362655 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fc8b2b4380 0x55fc8b2b4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:36:29.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.434+0000 7fb732d9d700 1 -- 172.21.15.82:0/2655362655 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc8b2b4ca0 msgr2=0x55fc8b2ae700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:36:29.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.434+0000 7fb732d9d700 1 --2- 172.21.15.82:0/2655362655 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc8b2b4ca0 0x55fc8b2ae700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:36:29.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.434+0000 7fb732d9d700 1 -- 172.21.15.82:0/2655362655 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fc8b080630 con 0x55fc8b2aec40 2023-09-23T09:36:29.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.434+0000 7fb731d9b700 1 --2- 172.21.15.82:0/2655362655 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc8b2b4ca0 0x55fc8b2ae700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:36:29.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.434+0000 7fb732d9d700 1 --2- 172.21.15.82:0/1253635594 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fb71c0a0140 0x7fb71c0a2600 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb72c00f900 tx=0x7fb72c00fcc0 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:36:29.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.435+0000 7fb732d9d700 1 --2- 172.21.15.82:0/2655362655 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc8b2aec40 0x55fc8b2af0a0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fb72c018640 tx=0x7fb72c020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9c267000cea87ea server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:36:29.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.435+0000 7fb720ff9700 1 -- 172.21.15.82:0/2655362655 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72c00e040 con 0x55fc8b2aec40 2023-09-23T09:36:29.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.435+0000 7fb720ff9700 1 -- 172.21.15.82:0/2655362655 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb72c00f040 con 0x55fc8b2aec40 2023-09-23T09:36:29.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.435+0000 7fb720ff9700 1 -- 172.21.15.82:0/2655362655 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72c01ad80 con 0x55fc8b2aec40 2023-09-23T09:36:29.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.436+0000 7fb74c61eb80 1 -- 172.21.15.82:0/2655362655 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc8b2aec40 msgr2=0x55fc8b2af0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:36:29.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.436+0000 7fb74c61eb80 1 --2- 172.21.15.82:0/2655362655 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc8b2aec40 0x55fc8b2af0a0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fb72c018640 tx=0x7fb72c020000 comp rx=0 tx=0).stop 2023-09-23T09:36:29.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.436+0000 7fb74c61eb80 1 -- 172.21.15.82:0/2655362655 shutdown_connections 2023-09-23T09:36:29.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.436+0000 7fb74c61eb80 1 --2- 172.21.15.82:0/2655362655 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc8b2aec40 0x55fc8b2af0a0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:36:29.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.436+0000 7fb74c61eb80 1 --2- 172.21.15.82:0/2655362655 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fc8b2b4380 0x55fc8b2b4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:36:29.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.436+0000 7fb74c61eb80 1 --2- 172.21.15.82:0/2655362655 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc8b2b4ca0 0x55fc8b2ae700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:36:29.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.436+0000 7fb74c61eb80 1 -- 172.21.15.82:0/2655362655 >> 172.21.15.82:0/2655362655 conn(0x55fc8b2230e0 msgr2=0x55fc8b2a9410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:36:29.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.436+0000 7fb74c61eb80 1 -- 172.21.15.82:0/2655362655 shutdown_connections 2023-09-23T09:36:29.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.437+0000 7fb74c61eb80 1 -- 172.21.15.82:0/2655362655 wait complete. 2023-09-23T09:36:29.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.437+0000 7fb74c61eb80 1 -- start start 2023-09-23T09:36:29.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.437+0000 7fb74c61eb80 1 Processor -- start 2023-09-23T09:36:29.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.438+0000 7fb74c61eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc8b2aec40 0x55fc8b2bac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:36:29.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.438+0000 7fb74c61eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc8b2b4380 0x55fc8b2b7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:36:29.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.438+0000 7fb74c61eb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fc8b2b4ca0 0x55fc8b2b8540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:36:29.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.438+0000 7fb74c61eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc8b200990 con 0x55fc8b2b4380 2023-09-23T09:36:29.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.438+0000 7fb74c61eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc8b19ebb0 con 0x55fc8b2aec40 2023-09-23T09:36:29.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.438+0000 7fb74c61eb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc8b19e8b0 con 0x55fc8b2b4ca0 2023-09-23T09:36:29.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.438+0000 7fb74c61eb80 10 client.0 _ll_register_callbacks cb 0x55fc8b0e8a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:36:29.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.439+0000 7fb731d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc8b2b4380 0x55fc8b2b7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:36:29.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.439+0000 7fb732d9d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fc8b2b4ca0 0x55fc8b2b8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:36:29.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.439+0000 7fb731d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc8b2b4380 0x55fc8b2b7ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51472/0 (socket says 172.21.15.82:51472) 2023-09-23T09:36:29.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.439+0000 7fb732d9d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fc8b2b4ca0 0x55fc8b2b8540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:58714/0 (socket says 172.21.15.82:58714) 2023-09-23T09:36:29.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.439+0000 7fb731d9b700 1 -- 172.21.15.82:0/3121394480 learned_addr learned my addr 172.21.15.82:0/3121394480 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:36:29.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.439+0000 7fb73259c700 1 --2- 172.21.15.82:0/3121394480 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc8b2aec40 0x55fc8b2bac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:36:29.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.439+0000 7fb731d9b700 1 -- 172.21.15.82:0/3121394480 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fc8b2b4ca0 msgr2=0x55fc8b2b8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:36:29.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.439+0000 7fb731d9b700 1 --2- 172.21.15.82:0/3121394480 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fc8b2b4ca0 0x55fc8b2b8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:36:29.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.439+0000 7fb731d9b700 1 -- 172.21.15.82:0/3121394480 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc8b2aec40 msgr2=0x55fc8b2bac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:36:29.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.439+0000 7fb731d9b700 1 --2- 172.21.15.82:0/3121394480 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc8b2aec40 0x55fc8b2bac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:36:29.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.439+0000 7fb731d9b700 1 -- 172.21.15.82:0/3121394480 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7341a5890 con 0x55fc8b2b4380 2023-09-23T09:36:29.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.439+0000 7fb73259c700 1 --2- 172.21.15.82:0/3121394480 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc8b2aec40 0x55fc8b2bac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T09:36:29.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.440+0000 7fb731d9b700 1 --2- 172.21.15.82:0/3121394480 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc8b2b4380 0x55fc8b2b7ea0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fb72800c2d0 tx=0x7fb7280988c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7016d9f6185bba3 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:36:29.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.440+0000 7fb719ffb700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:36:29.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.440+0000 7fb719ffb700 1 -- 172.21.15.82:0/3121394480 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72809cc80 con 0x55fc8b2b4380 2023-09-23T09:36:29.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.440+0000 7fb719ffb700 1 -- 172.21.15.82:0/3121394480 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(155..155 src has 1..155) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fb7280b6e40 con 0x55fc8b2b4380 2023-09-23T09:36:29.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.440+0000 7fb74c61eb80 1 -- 172.21.15.82:0/3121394480 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fc8b27e1c0 con 0x55fc8b2b4380 2023-09-23T09:36:29.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.441+0000 7fb719ffb700 1 -- 172.21.15.82:0/3121394480 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=120) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb7280a0c60 con 0x55fc8b2b4380 2023-09-23T09:36:29.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.441+0000 7fb74c61eb80 10 client.18033 fetch_fsmap learned FSMap version 120 2023-09-23T09:36:29.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.441+0000 7fb74c61eb80 1 -- 172.21.15.82:0/3121394480 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=120,monmap=4+}) v3 -- 0x7fb72c00fe40 con 0x55fc8b2b4380 2023-09-23T09:36:29.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.441+0000 7fb719ffb700 1 -- 172.21.15.82:0/3121394480 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55fc8b27e1c0 con 0x55fc8b2b4380 2023-09-23T09:36:29.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.441+0000 7fb719ffb700 1 -- 172.21.15.82:0/3121394480 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 120) v1 ==== 7934+0+0 (secure 0 0 0) 0x7fb728094c40 con 0x55fc8b2b4380 2023-09-23T09:36:29.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.441+0000 7fb74c61eb80 10 client.18033 fetch_fsmap finished waiting for FSMap version 120 2023-09-23T09:36:29.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.441+0000 7fb74c61eb80 10 client.18033 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:36:29.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.441+0000 7fb74c61eb80 20 client.18033 populate_metadata read hostname 'smithi082' 2023-09-23T09:36:29.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.441+0000 7fb74c61eb80 1 --2- 172.21.15.82:0/3121394480 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55fc8b2d0f50 0x55fc8b2d3370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:36:29.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.441+0000 7fb74c61eb80 4 client.18033 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:36:29.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.441+0000 7fb74c61eb80 1 -- 172.21.15.82:0/3121394480 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fc8b1a6ba0 con 0x55fc8b2d0f50 2023-09-23T09:36:29.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.442+0000 7fb73259c700 1 --2- 172.21.15.82:0/3121394480 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55fc8b2d0f50 0x55fc8b2d3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:36:29.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.443+0000 7fb73259c700 1 --2- 172.21.15.82:0/3121394480 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55fc8b2d0f50 0x55fc8b2d3370 crc :-1 s=READY pgs=255 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=388a602ea73897e2 server_cookie=2a3e6d02a7d478da in_seq=0 out_seq=0 2023-09-23T09:36:29.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.443+0000 7fb719ffb700 10 client.18033 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:36:29.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.443+0000 7fb719ffb700 1 -- 172.21.15.82:0/3121394480 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55fc8b1a6ba0 con 0x55fc8b2d0f50 2023-09-23T09:36:29.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.443+0000 7fb719ffb700 10 client.18033 handle_command_reply: tid=0 2023-09-23T09:36:29.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.444+0000 7fb74c61eb80 1 client.18033 shutdown 2023-09-23T09:36:29.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.444+0000 7fb74c61eb80 1 -- 172.21.15.82:0/3121394480 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc8b2b4380 msgr2=0x55fc8b2b7ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:36:29.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.444+0000 7fb74c61eb80 1 --2- 172.21.15.82:0/3121394480 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc8b2b4380 0x55fc8b2b7ea0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fb72800c2d0 tx=0x7fb7280988c0 comp rx=0 tx=0).stop 2023-09-23T09:36:29.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.444+0000 7fb74c61eb80 1 -- 172.21.15.82:0/3121394480 shutdown_connections 2023-09-23T09:36:29.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.444+0000 7fb74c61eb80 1 --2- 172.21.15.82:0/3121394480 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fc8b2b4ca0 0x55fc8b2b8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:36:29.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.444+0000 7fb74c61eb80 1 --2- 172.21.15.82:0/3121394480 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc8b2aec40 0x55fc8b2bac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:36:29.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.444+0000 7fb74c61eb80 1 --2- 172.21.15.82:0/3121394480 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55fc8b2d0f50 0x55fc8b2d3370 crc :-1 s=READY pgs=255 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:36:29.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.444+0000 7fb74c61eb80 1 --2- 172.21.15.82:0/3121394480 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc8b2b4380 0x55fc8b2b7ea0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:36:29.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.444+0000 7fb719ffb700 0 client.18033 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:36:29.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.444+0000 7fb74c61eb80 1 -- 172.21.15.82:0/3121394480 >> 172.21.15.82:0/3121394480 conn(0x55fc8b2230e0 msgr2=0x55fc8b2a3b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:36:29.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.444+0000 7fb74c61eb80 1 -- 172.21.15.82:0/3121394480 shutdown_connections 2023-09-23T09:36:29.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.444+0000 7fb74c61eb80 1 -- 172.21.15.82:0/3121394480 wait complete. 2023-09-23T09:36:29.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.445+0000 7fb74c61eb80 20 client.18033 trim_cache size 0 max 16384 2023-09-23T09:36:29.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.469+0000 7fb74c61eb80 1 Processor -- start 2023-09-23T09:36:29.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.469+0000 7fb74c61eb80 1 -- start start 2023-09-23T09:36:29.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.470+0000 7fb74c61eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc8b2aec40 0x55fc8b2ae700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:36:29.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.470+0000 7fb74c61eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc8b2b4380 0x55fc8b2b7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:36:29.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.470+0000 7fb74c61eb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fc8b2b4ca0 0x55fc8b2b7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:36:29.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.470+0000 7fb74c61eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc8b082920 con 0x55fc8b2aec40 2023-09-23T09:36:29.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.470+0000 7fb74c61eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc8b2ce590 con 0x55fc8b2b4380 2023-09-23T09:36:29.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.470+0000 7fb74c61eb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc8b2b9480 con 0x55fc8b2b4ca0 2023-09-23T09:36:29.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.470+0000 7fb73259c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc8b2aec40 0x55fc8b2ae700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:36:29.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.470+0000 7fb73259c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc8b2aec40 0x55fc8b2ae700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51486/0 (socket says 172.21.15.82:51486) 2023-09-23T09:36:29.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.470+0000 7fb73259c700 1 -- 172.21.15.82:0/2692566181 learned_addr learned my addr 172.21.15.82:0/2692566181 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:36:29.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.470+0000 7fb731d9b700 1 --2- 172.21.15.82:0/2692566181 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc8b2b4380 0x55fc8b2b7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:36:29.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.470+0000 7fb732d9d700 1 --2- 172.21.15.82:0/2692566181 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fc8b2b4ca0 0x55fc8b2b7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:36:29.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.471+0000 7fb732d9d700 1 -- 172.21.15.82:0/2692566181 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc8b2b4380 msgr2=0x55fc8b2b7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:36:29.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.471+0000 7fb732d9d700 1 --2- 172.21.15.82:0/2692566181 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc8b2b4380 0x55fc8b2b7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:36:29.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.471+0000 7fb732d9d700 1 -- 172.21.15.82:0/2692566181 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc8b2aec40 msgr2=0x55fc8b2ae700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:36:29.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.471+0000 7fb732d9d700 1 --2- 172.21.15.82:0/2692566181 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc8b2aec40 0x55fc8b2ae700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:36:29.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.471+0000 7fb732d9d700 1 -- 172.21.15.82:0/2692566181 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fc8b02cde0 con 0x55fc8b2b4ca0 2023-09-23T09:36:29.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.471+0000 7fb732d9d700 1 --2- 172.21.15.82:0/2692566181 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fc8b2b4ca0 0x55fc8b2b7ba0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fb72c01c010 tx=0x7fb72c0060b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0ce33837ff9e0a6 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:36:29.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.471+0000 7fb7217fa700 1 -- 172.21.15.82:0/2692566181 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72c00e040 con 0x55fc8b2b4ca0 2023-09-23T09:36:29.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.471+0000 7fb7217fa700 1 -- 172.21.15.82:0/2692566181 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb72c0098a0 con 0x55fc8b2b4ca0 2023-09-23T09:36:29.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.471+0000 7fb7217fa700 1 -- 172.21.15.82:0/2692566181 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72c01abb0 con 0x55fc8b2b4ca0 2023-09-23T09:36:29.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.472+0000 7fb74c61eb80 1 -- 172.21.15.82:0/2692566181 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fc8b2b4ca0 msgr2=0x55fc8b2b7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:36:29.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.472+0000 7fb74c61eb80 1 --2- 172.21.15.82:0/2692566181 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fc8b2b4ca0 0x55fc8b2b7ba0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fb72c01c010 tx=0x7fb72c0060b0 comp rx=0 tx=0).stop 2023-09-23T09:36:29.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.472+0000 7fb74c61eb80 1 -- 172.21.15.82:0/2692566181 shutdown_connections 2023-09-23T09:36:29.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.472+0000 7fb74c61eb80 1 --2- 172.21.15.82:0/2692566181 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fc8b2b4ca0 0x55fc8b2b7ba0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:36:29.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.472+0000 7fb74c61eb80 1 --2- 172.21.15.82:0/2692566181 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc8b2aec40 0x55fc8b2ae700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:36:29.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.472+0000 7fb74c61eb80 1 --2- 172.21.15.82:0/2692566181 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc8b2b4380 0x55fc8b2b7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:36:29.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.472+0000 7fb74c61eb80 1 -- 172.21.15.82:0/2692566181 >> 172.21.15.82:0/2692566181 conn(0x55fc8b2230e0 msgr2=0x55fc8b2b2010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:36:29.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.472+0000 7fb74c61eb80 1 -- 172.21.15.82:0/2692566181 shutdown_connections 2023-09-23T09:36:29.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.472+0000 7fb74c61eb80 1 -- 172.21.15.82:0/2692566181 wait complete. 2023-09-23T09:36:29.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.473+0000 7fb74c61eb80 1 -- start start 2023-09-23T09:36:29.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.473+0000 7fb74c61eb80 1 Processor -- start 2023-09-23T09:36:29.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.474+0000 7fb74c61eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc8b2aec40 0x55fc8b2c7f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:36:29.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.474+0000 7fb74c61eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc8b2b4380 0x55fc8b2afea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:36:29.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.474+0000 7fb74c61eb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fc8b2b4ca0 0x55fc8b2b03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:36:29.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.474+0000 7fb74c61eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc8b2b0920 con 0x55fc8b2aec40 2023-09-23T09:36:29.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.474+0000 7fb74c61eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc8b2b0a90 con 0x55fc8b2b4380 2023-09-23T09:36:29.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.474+0000 7fb74c61eb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc8b2b0c50 con 0x55fc8b2b4ca0 2023-09-23T09:36:29.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.474+0000 7fb74c61eb80 10 client.0 _ll_register_callbacks cb 0x7fb7280987f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:36:29.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.474+0000 7fb73259c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc8b2aec40 0x55fc8b2c7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:36:29.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.474+0000 7fb73259c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc8b2aec40 0x55fc8b2c7f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51496/0 (socket says 172.21.15.82:51496) 2023-09-23T09:36:29.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.474+0000 7fb73259c700 1 -- 172.21.15.82:0/2058631432 learned_addr learned my addr 172.21.15.82:0/2058631432 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:36:29.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.474+0000 7fb731d9b700 1 --2- 172.21.15.82:0/2058631432 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc8b2b4380 0x55fc8b2afea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:36:29.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.474+0000 7fb732d9d700 1 --2- 172.21.15.82:0/2058631432 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fc8b2b4ca0 0x55fc8b2b03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:36:29.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.475+0000 7fb73259c700 1 -- 172.21.15.82:0/2058631432 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fc8b2b4ca0 msgr2=0x55fc8b2b03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:36:29.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.475+0000 7fb73259c700 1 --2- 172.21.15.82:0/2058631432 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fc8b2b4ca0 0x55fc8b2b03e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:36:29.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.475+0000 7fb73259c700 1 -- 172.21.15.82:0/2058631432 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc8b2b4380 msgr2=0x55fc8b2afea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:36:29.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.475+0000 7fb73259c700 1 --2- 172.21.15.82:0/2058631432 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc8b2b4380 0x55fc8b2afea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:36:29.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.475+0000 7fb73259c700 1 -- 172.21.15.82:0/2058631432 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fc8b080630 con 0x55fc8b2aec40 2023-09-23T09:36:29.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.476+0000 7fb73259c700 1 --2- 172.21.15.82:0/2058631432 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc8b2aec40 0x55fc8b2c7f50 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fb724015000 tx=0x7fb72400bde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d860c2fe100b11 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:36:29.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.476+0000 7fb719ffb700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:36:29.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.476+0000 7fb719ffb700 1 -- 172.21.15.82:0/2058631432 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72401d040 con 0x55fc8b2aec40 2023-09-23T09:36:29.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.476+0000 7fb719ffb700 1 -- 172.21.15.82:0/2058631432 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(155..155 src has 1..155) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fb724026e10 con 0x55fc8b2aec40 2023-09-23T09:36:29.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.476+0000 7fb74c61eb80 1 -- 172.21.15.82:0/2058631432 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fc8b2a18b0 con 0x55fc8b2aec40 2023-09-23T09:36:29.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.477+0000 7fb719ffb700 1 -- 172.21.15.82:0/2058631432 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=120) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb724005040 con 0x55fc8b2aec40 2023-09-23T09:36:29.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.477+0000 7fb74c61eb80 10 client.18039 fetch_fsmap learned FSMap version 120 2023-09-23T09:36:29.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.477+0000 7fb74c61eb80 1 -- 172.21.15.82:0/2058631432 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=120,monmap=4+}) v3 -- 0x55fc8b015c60 con 0x55fc8b2aec40 2023-09-23T09:36:29.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.477+0000 7fb719ffb700 1 -- 172.21.15.82:0/2058631432 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55fc8b2a18b0 con 0x55fc8b2aec40 2023-09-23T09:36:29.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.477+0000 7fb719ffb700 1 -- 172.21.15.82:0/2058631432 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 120) v1 ==== 7934+0+0 (secure 0 0 0) 0x7fb724004b60 con 0x55fc8b2aec40 2023-09-23T09:36:29.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.477+0000 7fb74c61eb80 10 client.18039 fetch_fsmap finished waiting for FSMap version 120 2023-09-23T09:36:29.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.477+0000 7fb74c61eb80 10 client.18039 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:36:29.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.477+0000 7fb74c61eb80 20 client.18039 populate_metadata read hostname 'smithi082' 2023-09-23T09:36:29.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.477+0000 7fb74c61eb80 1 --2- 172.21.15.82:0/2058631432 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55fc8b326210 0x55fc8b328630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:36:29.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.477+0000 7fb74c61eb80 4 client.18039 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:36:29.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.477+0000 7fb74c61eb80 1 -- 172.21.15.82:0/2058631432 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55fc8b1f9970 con 0x55fc8b326210 2023-09-23T09:36:29.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.479+0000 7fb731d9b700 1 --2- 172.21.15.82:0/2058631432 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55fc8b326210 0x55fc8b328630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:36:29.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.481+0000 7fb719ffb700 10 client.18039 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:36:29.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.481+0000 7fb731d9b700 1 --2- 172.21.15.82:0/2058631432 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55fc8b326210 0x55fc8b328630 crc :-1 s=READY pgs=256 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f6a910cbd090da4 server_cookie=1d94b204a4146471 in_seq=0 out_seq=0 2023-09-23T09:36:29.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.481+0000 7fb719ffb700 1 -- 172.21.15.82:0/2058631432 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55fc8b1f9970 con 0x55fc8b326210 2023-09-23T09:36:29.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.481+0000 7fb719ffb700 10 client.18039 handle_command_reply: tid=0 2023-09-23T09:36:29.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.481+0000 7fb74c61eb80 1 client.18039 shutdown 2023-09-23T09:36:29.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.481+0000 7fb74c61eb80 1 -- 172.21.15.82:0/2058631432 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc8b2aec40 msgr2=0x55fc8b2c7f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:36:29.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.481+0000 7fb74c61eb80 1 --2- 172.21.15.82:0/2058631432 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc8b2aec40 0x55fc8b2c7f50 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fb724015000 tx=0x7fb72400bde0 comp rx=0 tx=0).stop 2023-09-23T09:36:29.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.481+0000 7fb74c61eb80 1 -- 172.21.15.82:0/2058631432 shutdown_connections 2023-09-23T09:36:29.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.481+0000 7fb74c61eb80 1 --2- 172.21.15.82:0/2058631432 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fc8b2b4ca0 0x55fc8b2b03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:36:29.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.481+0000 7fb74c61eb80 1 --2- 172.21.15.82:0/2058631432 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55fc8b326210 0x55fc8b328630 crc :-1 s=READY pgs=256 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:36:29.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.481+0000 7fb74c61eb80 1 --2- 172.21.15.82:0/2058631432 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc8b2aec40 0x55fc8b2c7f50 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:36:29.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.481+0000 7fb74c61eb80 1 --2- 172.21.15.82:0/2058631432 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc8b2b4380 0x55fc8b2afea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:36:29.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.481+0000 7fb74c61eb80 1 -- 172.21.15.82:0/2058631432 >> 172.21.15.82:0/2058631432 conn(0x55fc8b2230e0 msgr2=0x55fc8b2a32b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:36:29.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.482+0000 7fb719ffb700 0 client.18039 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:36:29.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.482+0000 7fb74c61eb80 1 -- 172.21.15.82:0/2058631432 shutdown_connections 2023-09-23T09:36:29.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.482+0000 7fb74c61eb80 1 -- 172.21.15.82:0/2058631432 wait complete. 2023-09-23T09:36:29.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.482+0000 7fb74c61eb80 20 client.18039 trim_cache size 0 max 16384 2023-09-23T09:36:29.485 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:36:29.485 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-23T09:36:29.485 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:36:29.485 INFO:teuthology.orchestra.run.smithi082.stdout: "d9e62ab8-1468-4fb0-a9fe-61bed13e954b": { 2023-09-23T09:36:29.485 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:36:29.485 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "d9e62ab8-1468-4fb0-a9fe-61bed13e954b", 2023-09-23T09:36:29.486 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:36:29.486 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:36:29.486 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:36:29.486 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:36:29.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.483+0000 7fb738bff700 1 -- 172.21.15.82:0/1253635594 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fb71c0a0140 msgr2=0x7fb71c0a2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:36:29.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.483+0000 7fb738bff700 1 --2- 172.21.15.82:0/1253635594 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fb71c0a0140 0x7fb71c0a2600 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb72c00f900 tx=0x7fb72c00fcc0 comp rx=0 tx=0).stop 2023-09-23T09:36:29.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.483+0000 7fb738bff700 1 -- 172.21.15.82:0/1253635594 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb734101230 msgr2=0x7fb73419ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:36:29.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.483+0000 7fb738bff700 1 --2- 172.21.15.82:0/1253635594 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb734101230 0x7fb73419ee00 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fb72800e9a0 tx=0x7fb72800ecb0 comp rx=0 tx=0).stop 2023-09-23T09:36:29.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.483+0000 7fb738bff700 1 -- 172.21.15.82:0/1253635594 shutdown_connections 2023-09-23T09:36:29.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.483+0000 7fb738bff700 1 --2- 172.21.15.82:0/1253635594 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fb71c0a0140 0x7fb71c0a2600 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:36:29.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.483+0000 7fb738bff700 1 --2- 172.21.15.82:0/1253635594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb734106880 0x7fb7341988a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:36:29.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.483+0000 7fb738bff700 1 --2- 172.21.15.82:0/1253635594 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb734100870 0x7fb73419e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:36:29.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.483+0000 7fb738bff700 1 --2- 172.21.15.82:0/1253635594 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb734101230 0x7fb73419ee00 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:36:29.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.483+0000 7fb738bff700 1 -- 172.21.15.82:0/1253635594 >> 172.21.15.82:0/1253635594 conn(0x7fb7340fc3a0 msgr2=0x7fb73410bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:36:29.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.483+0000 7fb738bff700 1 -- 172.21.15.82:0/1253635594 shutdown_connections 2023-09-23T09:36:29.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:29.483+0000 7fb738bff700 1 -- 172.21.15.82:0/1253635594 wait complete. 2023-09-23T09:36:29.509 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:36:29 smithi082 ceph-mon[97694]: pgmap v1256: 97 pgs: 97 active+clean; 14 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.7 MiB/s wr, 629 op/s 2023-09-23T09:36:29.512 INFO:tasks.cephfs.filesystem:scrub status for tag:d9e62ab8-1468-4fb0-a9fe-61bed13e954b - {'path': '/', 'tag': 'd9e62ab8-1468-4fb0-a9fe-61bed13e954b', 'options': 'recursive,force'} 2023-09-23T09:36:29.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:36:29 smithi135 ceph-mon[99205]: pgmap v1256: 97 pgs: 97 active+clean; 14 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.7 MiB/s wr, 629 op/s 2023-09-23T09:36:29.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:36:29 smithi161 ceph-mon[99580]: pgmap v1256: 97 pgs: 97 active+clean; 14 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.7 MiB/s wr, 629 op/s 2023-09-23T09:36:30.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 560.0 s, 183.8 tps, lat 551.582 ms stddev 515.574 2023-09-23T09:36:31.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:36:31 smithi135 ceph-mon[99205]: pgmap v1257: 97 pgs: 97 active+clean; 14 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 3.2 MiB/s rd, 6.3 MiB/s wr, 814 op/s 2023-09-23T09:36:31.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:36:31 smithi082 ceph-mon[97694]: pgmap v1257: 97 pgs: 97 active+clean; 14 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 3.2 MiB/s rd, 6.3 MiB/s wr, 814 op/s 2023-09-23T09:36:31.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:36:31 smithi161 ceph-mon[99580]: pgmap v1257: 97 pgs: 97 active+clean; 14 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 3.2 MiB/s rd, 6.3 MiB/s wr, 814 op/s 2023-09-23T09:36:33.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:36:33 smithi135 ceph-mon[99205]: pgmap v1258: 97 pgs: 97 active+clean; 14 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.5 MiB/s wr, 607 op/s 2023-09-23T09:36:33.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:36:33 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:36:33.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:36:33 smithi082 ceph-mon[97694]: pgmap v1258: 97 pgs: 97 active+clean; 14 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.5 MiB/s wr, 607 op/s 2023-09-23T09:36:33.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:36:33 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:36:33.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:36:33 smithi161 ceph-mon[99580]: pgmap v1258: 97 pgs: 97 active+clean; 14 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.5 MiB/s wr, 607 op/s 2023-09-23T09:36:33.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:36:33 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:36:34.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:36:34 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:36:34.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:36:34 smithi135 ceph-mon[99205]: pgmap v1259: 97 pgs: 97 active+clean; 14 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.4 MiB/s wr, 576 op/s 2023-09-23T09:36:34.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:36:34 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:36:34.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:36:34 smithi082 ceph-mon[97694]: pgmap v1259: 97 pgs: 97 active+clean; 14 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.4 MiB/s wr, 576 op/s 2023-09-23T09:36:34.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:36:34 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:36:34.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:36:34 smithi161 ceph-mon[99580]: pgmap v1259: 97 pgs: 97 active+clean; 14 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.4 MiB/s wr, 576 op/s 2023-09-23T09:36:35.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 565.0 s, 148.4 tps, lat 542.709 ms stddev 500.255 2023-09-23T09:36:37.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:36:36 smithi082 ceph-mon[97694]: pgmap v1260: 97 pgs: 97 active+clean; 14 GiB data, 60 GiB used, 1012 GiB / 1.0 TiB avail; 3.4 MiB/s rd, 6.6 MiB/s wr, 860 op/s 2023-09-23T09:36:37.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:36:36 smithi161 ceph-mon[99580]: pgmap v1260: 97 pgs: 97 active+clean; 14 GiB data, 60 GiB used, 1012 GiB / 1.0 TiB avail; 3.4 MiB/s rd, 6.6 MiB/s wr, 860 op/s 2023-09-23T09:36:37.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:36:36 smithi135 ceph-mon[99205]: pgmap v1260: 97 pgs: 97 active+clean; 14 GiB data, 60 GiB used, 1012 GiB / 1.0 TiB avail; 3.4 MiB/s rd, 6.6 MiB/s wr, 860 op/s 2023-09-23T09:36:38.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:36:37 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:36:38.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:36:37 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:36:38.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:36:37 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:36:38.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:36:37 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:36:38.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:36:37 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:36:38.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:36:37 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:36:38.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:36:37 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:36:38.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:36:37 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:36:38.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:36:37 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:36:38.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:36:37 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:36:38.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:36:37 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:36:38.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:36:37 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:36:39.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:36:39 smithi135 ceph-mon[99205]: pgmap v1261: 97 pgs: 97 active+clean; 14 GiB data, 60 GiB used, 1012 GiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.5 MiB/s wr, 579 op/s 2023-09-23T09:36:39.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:36:39 smithi082 ceph-mon[97694]: pgmap v1261: 97 pgs: 97 active+clean; 14 GiB data, 60 GiB used, 1012 GiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.5 MiB/s wr, 579 op/s 2023-09-23T09:36:39.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:36:39 smithi161 ceph-mon[99580]: pgmap v1261: 97 pgs: 97 active+clean; 14 GiB data, 60 GiB used, 1012 GiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.5 MiB/s wr, 579 op/s 2023-09-23T09:36:40.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 570.0 s, 176.4 tps, lat 677.427 ms stddev 1344.235 2023-09-23T09:36:41.567 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:36:41 smithi135 ceph-mon[99205]: pgmap v1262: 97 pgs: 97 active+clean; 14 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 3.5 MiB/s rd, 6.5 MiB/s wr, 839 op/s 2023-09-23T09:36:41.633 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:36:41 smithi082 ceph-mon[97694]: pgmap v1262: 97 pgs: 97 active+clean; 14 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 3.5 MiB/s rd, 6.5 MiB/s wr, 839 op/s 2023-09-23T09:36:41.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:36:41 smithi161 ceph-mon[99580]: pgmap v1262: 97 pgs: 97 active+clean; 14 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 3.5 MiB/s rd, 6.5 MiB/s wr, 839 op/s 2023-09-23T09:36:42.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:36:42 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:36:42.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:36:42 smithi135 ceph-mon[99205]: pgmap v1263: 97 pgs: 97 active+clean; 14 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.6 MiB/s wr, 618 op/s 2023-09-23T09:36:42.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:36:42 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:36:42.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:36:42 smithi082 ceph-mon[97694]: pgmap v1263: 97 pgs: 97 active+clean; 14 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.6 MiB/s wr, 618 op/s 2023-09-23T09:36:42.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:36:42 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:36:42.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:36:42 smithi161 ceph-mon[99580]: pgmap v1263: 97 pgs: 97 active+clean; 14 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.6 MiB/s wr, 618 op/s 2023-09-23T09:36:45.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:36:44 smithi082 ceph-mon[97694]: pgmap v1264: 97 pgs: 97 active+clean; 14 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.5 MiB/s wr, 585 op/s 2023-09-23T09:36:45.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:36:44 smithi161 ceph-mon[99580]: pgmap v1264: 97 pgs: 97 active+clean; 14 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.5 MiB/s wr, 585 op/s 2023-09-23T09:36:45.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:36:44 smithi135 ceph-mon[99205]: pgmap v1264: 97 pgs: 97 active+clean; 14 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.5 MiB/s wr, 585 op/s 2023-09-23T09:36:45.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 575.0 s, 50.2 tps, lat 2140.350 ms stddev 2376.496 2023-09-23T09:36:47.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:36:46 smithi082 ceph-mon[97694]: pgmap v1265: 97 pgs: 97 active+clean; 15 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 3.1 MiB/s rd, 6.7 MiB/s wr, 861 op/s 2023-09-23T09:36:47.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:36:46 smithi161 ceph-mon[99580]: pgmap v1265: 97 pgs: 97 active+clean; 15 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 3.1 MiB/s rd, 6.7 MiB/s wr, 861 op/s 2023-09-23T09:36:47.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:36:46 smithi135 ceph-mon[99205]: pgmap v1265: 97 pgs: 97 active+clean; 15 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 3.1 MiB/s rd, 6.7 MiB/s wr, 861 op/s 2023-09-23T09:36:48.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:36:48 smithi082 ceph-mon[97694]: pgmap v1266: 97 pgs: 97 active+clean; 15 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.5 MiB/s wr, 577 op/s 2023-09-23T09:36:48.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:36:48 smithi161 ceph-mon[99580]: pgmap v1266: 97 pgs: 97 active+clean; 15 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.5 MiB/s wr, 577 op/s 2023-09-23T09:36:48.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:36:48 smithi135 ceph-mon[99205]: pgmap v1266: 97 pgs: 97 active+clean; 15 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.5 MiB/s wr, 577 op/s 2023-09-23T09:36:49.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:36:49 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:36:49.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:36:49 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:36:49.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:36:49 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:36:50.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:36:50 smithi082 ceph-mon[97694]: pgmap v1267: 97 pgs: 97 active+clean; 15 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 3.0 MiB/s rd, 6.5 MiB/s wr, 813 op/s 2023-09-23T09:36:50.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:36:50 smithi161 ceph-mon[99580]: pgmap v1267: 97 pgs: 97 active+clean; 15 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 3.0 MiB/s rd, 6.5 MiB/s wr, 813 op/s 2023-09-23T09:36:50.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:36:50 smithi135 ceph-mon[99205]: pgmap v1267: 97 pgs: 97 active+clean; 15 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 3.0 MiB/s rd, 6.5 MiB/s wr, 813 op/s 2023-09-23T09:36:50.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 580.0 s, 181.4 tps, lat 296.167 ms stddev 230.205 2023-09-23T09:36:53.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:36:53 smithi135 ceph-mon[99205]: pgmap v1268: 97 pgs: 97 active+clean; 15 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.7 MiB/s wr, 587 op/s 2023-09-23T09:36:53.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:36:53 smithi082 ceph-mon[97694]: pgmap v1268: 97 pgs: 97 active+clean; 15 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.7 MiB/s wr, 587 op/s 2023-09-23T09:36:53.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:36:53 smithi161 ceph-mon[99580]: pgmap v1268: 97 pgs: 97 active+clean; 15 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.7 MiB/s wr, 587 op/s 2023-09-23T09:36:55.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:36:55 smithi135 ceph-mon[99205]: pgmap v1269: 97 pgs: 97 active+clean; 15 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.4 MiB/s wr, 546 op/s 2023-09-23T09:36:55.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:36:55 smithi082 ceph-mon[97694]: pgmap v1269: 97 pgs: 97 active+clean; 15 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.4 MiB/s wr, 546 op/s 2023-09-23T09:36:55.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:36:55 smithi161 ceph-mon[99580]: pgmap v1269: 97 pgs: 97 active+clean; 15 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.4 MiB/s wr, 546 op/s 2023-09-23T09:36:55.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 585.0 s, 181.0 tps, lat 292.417 ms stddev 249.350 2023-09-23T09:36:57.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:36:57 smithi135 ceph-mon[99205]: pgmap v1270: 97 pgs: 97 active+clean; 15 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 3.0 MiB/s rd, 6.9 MiB/s wr, 856 op/s 2023-09-23T09:36:57.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:36:57 smithi082 ceph-mon[97694]: pgmap v1270: 97 pgs: 97 active+clean; 15 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 3.0 MiB/s rd, 6.9 MiB/s wr, 856 op/s 2023-09-23T09:36:57.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:36:57 smithi161 ceph-mon[99580]: pgmap v1270: 97 pgs: 97 active+clean; 15 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 3.0 MiB/s rd, 6.9 MiB/s wr, 856 op/s 2023-09-23T09:36:58.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:36:58 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:36:58.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:36:58 smithi135 ceph-mon[99205]: pgmap v1271: 97 pgs: 97 active+clean; 15 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.7 MiB/s wr, 580 op/s 2023-09-23T09:36:58.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:36:58 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:36:58.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:36:58 smithi082 ceph-mon[97694]: pgmap v1271: 97 pgs: 97 active+clean; 15 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.7 MiB/s wr, 580 op/s 2023-09-23T09:36:58.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:36:58 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:36:58.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:36:58 smithi161 ceph-mon[99580]: pgmap v1271: 97 pgs: 97 active+clean; 15 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.7 MiB/s wr, 580 op/s 2023-09-23T09:36:59.513 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:36:59.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.873+0000 7f9b49fff700 1 -- 172.21.15.82:0/4060150770 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b440ff760 msgr2=0x7f9b440ffbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:36:59.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.873+0000 7f9b49fff700 1 --2- 172.21.15.82:0/4060150770 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b440ff760 0x7f9b440ffbe0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c0098f0 tx=0x7f9b2c009c00 comp rx=0 tx=0).stop 2023-09-23T09:36:59.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.873+0000 7f9b49fff700 1 -- 172.21.15.82:0/4060150770 shutdown_connections 2023-09-23T09:36:59.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.873+0000 7f9b49fff700 1 --2- 172.21.15.82:0/4060150770 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b44100120 0x7f9b4410c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:36:59.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.873+0000 7f9b49fff700 1 --2- 172.21.15.82:0/4060150770 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b44105770 0x7f9b44105b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:36:59.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.873+0000 7f9b49fff700 1 --2- 172.21.15.82:0/4060150770 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b440ff760 0x7f9b440ffbe0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:36:59.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.873+0000 7f9b49fff700 1 -- 172.21.15.82:0/4060150770 >> 172.21.15.82:0/4060150770 conn(0x7f9b440fb270 msgr2=0x7f9b440fd690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:36:59.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.873+0000 7f9b49fff700 1 -- 172.21.15.82:0/4060150770 shutdown_connections 2023-09-23T09:36:59.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.873+0000 7f9b49fff700 1 -- 172.21.15.82:0/4060150770 wait complete. 2023-09-23T09:36:59.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.874+0000 7f9b49fff700 1 Processor -- start 2023-09-23T09:36:59.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.874+0000 7f9b49fff700 1 -- start start 2023-09-23T09:36:59.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.875+0000 7f9b49fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b440ff760 0x7f9b4410d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:36:59.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.875+0000 7f9b49fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b44100120 0x7f9b4410d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:36:59.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.875+0000 7f9b49fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b44105770 0x7f9b4410da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:36:59.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.875+0000 7f9b49fff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b441a92f0 con 0x7f9b44100120 2023-09-23T09:36:59.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.875+0000 7f9b49fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b441a9430 con 0x7f9b44105770 2023-09-23T09:36:59.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.875+0000 7f9b49fff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b441a9570 con 0x7f9b440ff760 2023-09-23T09:36:59.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.875+0000 7f9b3bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b44100120 0x7f9b4410d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:36:59.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.876+0000 7f9b43fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b44105770 0x7f9b4410da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:36:59.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.876+0000 7f9b3bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b44100120 0x7f9b4410d540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44156/0 (socket says 172.21.15.82:44156) 2023-09-23T09:36:59.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.876+0000 7f9b3bfff700 1 -- 172.21.15.82:0/2285344689 learned_addr learned my addr 172.21.15.82:0/2285344689 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:36:59.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.876+0000 7f9b437fe700 1 --2- 172.21.15.82:0/2285344689 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b440ff760 0x7f9b4410d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:36:59.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.876+0000 7f9b43fff700 1 -- 172.21.15.82:0/2285344689 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b440ff760 msgr2=0x7f9b4410d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:36:59.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.876+0000 7f9b43fff700 1 --2- 172.21.15.82:0/2285344689 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b440ff760 0x7f9b4410d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:36:59.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.876+0000 7f9b43fff700 1 -- 172.21.15.82:0/2285344689 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b44100120 msgr2=0x7f9b4410d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:36:59.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.876+0000 7f9b43fff700 1 --2- 172.21.15.82:0/2285344689 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b44100120 0x7f9b4410d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:36:59.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.876+0000 7f9b43fff700 1 -- 172.21.15.82:0/2285344689 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b2c009520 con 0x7f9b44105770 2023-09-23T09:36:59.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.876+0000 7f9b3bfff700 1 --2- 172.21.15.82:0/2285344689 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b44100120 0x7f9b4410d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:36:59.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.877+0000 7f9b43fff700 1 --2- 172.21.15.82:0/2285344689 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b44105770 0x7f9b4410da80 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c00efc0 tx=0x7f9b3c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:36:59.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.877+0000 7f9b417fa700 1 -- 172.21.15.82:0/2285344689 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b3c018070 con 0x7f9b44105770 2023-09-23T09:36:59.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.877+0000 7f9b49fff700 1 -- 172.21.15.82:0/2285344689 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b441a97f0 con 0x7f9b44105770 2023-09-23T09:36:59.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.877+0000 7f9b417fa700 1 -- 172.21.15.82:0/2285344689 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9b3c00f040 con 0x7f9b44105770 2023-09-23T09:36:59.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.877+0000 7f9b49fff700 1 -- 172.21.15.82:0/2285344689 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b441a9d00 con 0x7f9b44105770 2023-09-23T09:36:59.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.877+0000 7f9b417fa700 1 -- 172.21.15.82:0/2285344689 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b3c00cc50 con 0x7f9b44105770 2023-09-23T09:36:59.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.882+0000 7f9b417fa700 1 -- 172.21.15.82:0/2285344689 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f9b3c003a00 con 0x7f9b44105770 2023-09-23T09:36:59.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.884+0000 7f9b5d8f3b80 1 Processor -- start 2023-09-23T09:36:59.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.884+0000 7f9b5d8f3b80 1 -- start start 2023-09-23T09:36:59.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.884+0000 7f9b5d8f3b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561c59925380 0x561c59925760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:36:59.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.884+0000 7f9b5d8f3b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561c59925ca0 0x561c5991f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:36:59.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.884+0000 7f9b5d8f3b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c5991fc40 0x561c599200a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:36:59.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.884+0000 7f9b5d8f3b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c598877b0 con 0x561c5991fc40 2023-09-23T09:36:59.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.884+0000 7f9b5d8f3b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c59878780 con 0x561c59925380 2023-09-23T09:36:59.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.884+0000 7f9b5d8f3b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c598760a0 con 0x561c59925ca0 2023-09-23T09:36:59.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.885+0000 7f9b437fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561c59925ca0 0x561c5991f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:36:59.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.885+0000 7f9b437fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561c59925ca0 0x561c5991f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:51476/0 (socket says 172.21.15.82:51476) 2023-09-23T09:36:59.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.885+0000 7f9b437fe700 1 -- 172.21.15.82:0/4187370819 learned_addr learned my addr 172.21.15.82:0/4187370819 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:36:59.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.885+0000 7f9b3bfff700 1 --2- 172.21.15.82:0/4187370819 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561c59925380 0x561c59925760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:36:59.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.885+0000 7f9b3bfff700 1 --2- 172.21.15.82:0/4187370819 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c5991fc40 0x561c599200a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:36:59.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.886+0000 7f9b417fa700 1 --2- 172.21.15.82:0/2285344689 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f9b300a0140 0x7f9b300a2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:36:59.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.886+0000 7f9b437fe700 1 -- 172.21.15.82:0/4187370819 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561c59925380 msgr2=0x561c59925760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:36:59.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.886+0000 7f9b437fe700 1 --2- 172.21.15.82:0/4187370819 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561c59925380 0x561c59925760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:36:59.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.886+0000 7f9b437fe700 1 -- 172.21.15.82:0/4187370819 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c5991fc40 msgr2=0x561c599200a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:36:59.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.886+0000 7f9b437fe700 1 --2- 172.21.15.82:0/4187370819 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c5991fc40 0x561c599200a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:36:59.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.886+0000 7f9b437fe700 1 -- 172.21.15.82:0/4187370819 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561c596f1630 con 0x561c59925ca0 2023-09-23T09:36:59.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.886+0000 7f9b417fa700 1 -- 172.21.15.82:0/2285344689 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f9b3c0cb070 con 0x7f9b44105770 2023-09-23T09:36:59.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.886+0000 7f9b437fe700 1 --2- 172.21.15.82:0/4187370819 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561c59925ca0 0x561c5991f700 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f9b34009c60 tx=0x7f9b34009f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e9913c88d61af45 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:36:59.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.886+0000 7f9b43fff700 1 --2- 172.21.15.82:0/2285344689 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f9b300a0140 0x7f9b300a2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:36:59.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.887+0000 7f9b39ffb700 1 -- 172.21.15.82:0/4187370819 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b34011bf0 con 0x561c59925ca0 2023-09-23T09:36:59.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.887+0000 7f9b39ffb700 1 -- 172.21.15.82:0/4187370819 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9b340044b0 con 0x561c59925ca0 2023-09-23T09:36:59.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.887+0000 7f9b39ffb700 1 -- 172.21.15.82:0/4187370819 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b34003d20 con 0x561c59925ca0 2023-09-23T09:36:59.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.888+0000 7f9b5d8f3b80 1 -- 172.21.15.82:0/4187370819 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561c59925ca0 msgr2=0x561c5991f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:36:59.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.888+0000 7f9b43fff700 1 --2- 172.21.15.82:0/2285344689 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f9b300a0140 0x7f9b300a2600 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c094d10 tx=0x7f9b3c094430 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:36:59.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.888+0000 7f9b5d8f3b80 1 --2- 172.21.15.82:0/4187370819 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561c59925ca0 0x561c5991f700 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f9b34009c60 tx=0x7f9b34009f70 comp rx=0 tx=0).stop 2023-09-23T09:36:59.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.888+0000 7f9b5d8f3b80 1 -- 172.21.15.82:0/4187370819 shutdown_connections 2023-09-23T09:36:59.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.888+0000 7f9b5d8f3b80 1 --2- 172.21.15.82:0/4187370819 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c5991fc40 0x561c599200a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:36:59.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.888+0000 7f9b5d8f3b80 1 --2- 172.21.15.82:0/4187370819 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561c59925380 0x561c59925760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:36:59.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.888+0000 7f9b5d8f3b80 1 --2- 172.21.15.82:0/4187370819 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561c59925ca0 0x561c5991f700 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:36:59.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.888+0000 7f9b5d8f3b80 1 -- 172.21.15.82:0/4187370819 >> 172.21.15.82:0/4187370819 conn(0x561c598940e0 msgr2=0x561c5991a410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:36:59.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.888+0000 7f9b5d8f3b80 1 -- 172.21.15.82:0/4187370819 shutdown_connections 2023-09-23T09:36:59.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.888+0000 7f9b5d8f3b80 1 -- 172.21.15.82:0/4187370819 wait complete. 2023-09-23T09:36:59.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.889+0000 7f9b5d8f3b80 1 -- start start 2023-09-23T09:36:59.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.889+0000 7f9b5d8f3b80 1 Processor -- start 2023-09-23T09:36:59.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.890+0000 7f9b5d8f3b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561c5991fc40 0x561c59928f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:36:59.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.890+0000 7f9b5d8f3b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561c59925380 0x561c59929460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:36:59.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.890+0000 7f9b5d8f3b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c59925ca0 0x561c599299a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:36:59.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.890+0000 7f9b5d8f3b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c59871990 con 0x561c59925ca0 2023-09-23T09:36:59.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.890+0000 7f9b5d8f3b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c5980fbb0 con 0x561c59925380 2023-09-23T09:36:59.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.890+0000 7f9b5d8f3b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c5980f8b0 con 0x561c5991fc40 2023-09-23T09:36:59.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.890+0000 7f9b5d8f3b80 10 client.0 _ll_register_callbacks cb 0x561c59759a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:36:59.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.891+0000 7f9b3bfff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561c5991fc40 0x561c59928f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:36:59.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.891+0000 7f9b3bfff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561c5991fc40 0x561c59928f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:51488/0 (socket says 172.21.15.82:51488) 2023-09-23T09:36:59.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.891+0000 7f9b3bfff700 1 -- 172.21.15.82:0/1183989154 learned_addr learned my addr 172.21.15.82:0/1183989154 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:36:59.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.891+0000 7f9b3bfff700 1 --2- 172.21.15.82:0/1183989154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c59925ca0 0x561c599299a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:36:59.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.891+0000 7f9b437fe700 1 --2- 172.21.15.82:0/1183989154 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561c59925380 0x561c59929460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:36:59.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.891+0000 7f9b3bfff700 1 -- 172.21.15.82:0/1183989154 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561c59925380 msgr2=0x561c59929460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:36:59.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.891+0000 7f9b3bfff700 1 --2- 172.21.15.82:0/1183989154 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561c59925380 0x561c59929460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:36:59.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.891+0000 7f9b3bfff700 1 -- 172.21.15.82:0/1183989154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c59925ca0 msgr2=0x561c599299a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:36:59.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.891+0000 7f9b3bfff700 1 --2- 172.21.15.82:0/1183989154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c59925ca0 0x561c599299a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:36:59.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.891+0000 7f9b3bfff700 1 -- 172.21.15.82:0/1183989154 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b340098c0 con 0x561c5991fc40 2023-09-23T09:36:59.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.891+0000 7f9b437fe700 1 --2- 172.21.15.82:0/1183989154 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561c59925380 0x561c59929460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T09:36:59.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.892+0000 7f9b3bfff700 1 --2- 172.21.15.82:0/1183989154 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561c5991fc40 0x561c59928f20 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c005e90 tx=0x7f9b2c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a635629d5d07dfd server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:36:59.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.893+0000 7f9b22ffd700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T09:36:59.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.893+0000 7f9b22ffd700 1 -- 172.21.15.82:0/1183989154 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b2c0050b0 con 0x561c5991fc40 2023-09-23T09:36:59.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.893+0000 7f9b22ffd700 1 -- 172.21.15.82:0/1183989154 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(155..155 src has 1..155) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f9b2c005210 con 0x561c5991fc40 2023-09-23T09:36:59.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.893+0000 7f9b5d8f3b80 1 -- 172.21.15.82:0/1183989154 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561c598ef1c0 con 0x561c5991fc40 2023-09-23T09:36:59.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.893+0000 7f9b22ffd700 1 -- 172.21.15.82:0/1183989154 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=125) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9b2c0053d0 con 0x561c5991fc40 2023-09-23T09:36:59.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.894+0000 7f9b5d8f3b80 10 client.27823 fetch_fsmap learned FSMap version 125 2023-09-23T09:36:59.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.894+0000 7f9b5d8f3b80 1 -- 172.21.15.82:0/1183989154 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=125,monmap=4+}) v3 -- 0x561c5969dde0 con 0x561c5991fc40 2023-09-23T09:36:59.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.894+0000 7f9b22ffd700 1 -- 172.21.15.82:0/1183989154 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x561c598ef1c0 con 0x561c5991fc40 2023-09-23T09:36:59.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.894+0000 7f9b22ffd700 1 -- 172.21.15.82:0/1183989154 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 125) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f9b2c015020 con 0x561c5991fc40 2023-09-23T09:36:59.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.895+0000 7f9b5d8f3b80 10 client.27823 fetch_fsmap finished waiting for FSMap version 125 2023-09-23T09:36:59.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.895+0000 7f9b5d8f3b80 10 client.27823 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:36:59.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.895+0000 7f9b5d8f3b80 20 client.27823 populate_metadata read hostname 'smithi082' 2023-09-23T09:36:59.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.895+0000 7f9b5d8f3b80 1 --2- 172.21.15.82:0/1183989154 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x561c599397a0 0x561c5993bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:36:59.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.895+0000 7f9b5d8f3b80 4 client.27823 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:36:59.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.895+0000 7f9b5d8f3b80 1 -- 172.21.15.82:0/1183989154 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561c59817ba0 con 0x561c599397a0 2023-09-23T09:36:59.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.895+0000 7f9b437fe700 1 --2- 172.21.15.82:0/1183989154 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x561c599397a0 0x561c5993bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:36:59.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.896+0000 7f9b437fe700 1 --2- 172.21.15.82:0/1183989154 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x561c599397a0 0x561c5993bbc0 crc :-1 s=READY pgs=257 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba2462ee6d2a42c server_cookie=cb502cdccc24696 in_seq=0 out_seq=0 2023-09-23T09:36:59.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.896+0000 7f9b22ffd700 10 client.27823 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:36:59.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.897+0000 7f9b22ffd700 1 -- 172.21.15.82:0/1183989154 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x561c59817ba0 con 0x561c599397a0 2023-09-23T09:36:59.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.897+0000 7f9b22ffd700 10 client.27823 handle_command_reply: tid=0 2023-09-23T09:36:59.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.897+0000 7f9b5d8f3b80 1 client.27823 shutdown 2023-09-23T09:36:59.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.897+0000 7f9b5d8f3b80 1 -- 172.21.15.82:0/1183989154 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561c5991fc40 msgr2=0x561c59928f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:36:59.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.897+0000 7f9b5d8f3b80 1 --2- 172.21.15.82:0/1183989154 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561c5991fc40 0x561c59928f20 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c005e90 tx=0x7f9b2c009c00 comp rx=0 tx=0).stop 2023-09-23T09:36:59.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.898+0000 7f9b5d8f3b80 1 -- 172.21.15.82:0/1183989154 shutdown_connections 2023-09-23T09:36:59.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.898+0000 7f9b5d8f3b80 1 --2- 172.21.15.82:0/1183989154 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x561c599397a0 0x561c5993bbc0 crc :-1 s=READY pgs=257 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:36:59.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.898+0000 7f9b5d8f3b80 1 --2- 172.21.15.82:0/1183989154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c59925ca0 0x561c599299a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:36:59.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.898+0000 7f9b5d8f3b80 1 --2- 172.21.15.82:0/1183989154 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561c5991fc40 0x561c59928f20 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:36:59.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.898+0000 7f9b5d8f3b80 1 --2- 172.21.15.82:0/1183989154 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561c59925380 0x561c59929460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:36:59.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.898+0000 7f9b22ffd700 0 client.27823 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:36:59.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.898+0000 7f9b5d8f3b80 1 -- 172.21.15.82:0/1183989154 >> 172.21.15.82:0/1183989154 conn(0x561c598940e0 msgr2=0x561c59914b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:36:59.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.898+0000 7f9b5d8f3b80 1 -- 172.21.15.82:0/1183989154 shutdown_connections 2023-09-23T09:36:59.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.898+0000 7f9b5d8f3b80 1 -- 172.21.15.82:0/1183989154 wait complete. 2023-09-23T09:36:59.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.898+0000 7f9b5d8f3b80 20 client.27823 trim_cache size 0 max 16384 2023-09-23T09:36:59.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.921+0000 7f9b5d8f3b80 1 Processor -- start 2023-09-23T09:36:59.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.921+0000 7f9b5d8f3b80 1 -- start start 2023-09-23T09:36:59.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.922+0000 7f9b5d8f3b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561c5991fc40 0x561c5991f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:36:59.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.922+0000 7f9b5d8f3b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561c59925380 0x561c59930820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:36:59.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.922+0000 7f9b5d8f3b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c59925ca0 0x561c599297d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:36:59.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.922+0000 7f9b5d8f3b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c596f3920 con 0x561c59925ca0 2023-09-23T09:36:59.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.922+0000 7f9b5d8f3b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c59930d60 con 0x561c5991fc40 2023-09-23T09:36:59.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.922+0000 7f9b5d8f3b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c599274a0 con 0x561c59925380 2023-09-23T09:36:59.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.922+0000 7f9b437fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561c59925380 0x561c59930820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:36:59.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.922+0000 7f9b437fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561c59925380 0x561c59930820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:51494/0 (socket says 172.21.15.82:51494) 2023-09-23T09:36:59.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.922+0000 7f9b437fe700 1 -- 172.21.15.82:0/1824319535 learned_addr learned my addr 172.21.15.82:0/1824319535 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:36:59.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.922+0000 7f9b3bfff700 1 --2- 172.21.15.82:0/1824319535 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561c5991fc40 0x561c5991f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:36:59.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.922+0000 7f9b3bfff700 1 --2- 172.21.15.82:0/1824319535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c59925ca0 0x561c599297d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:36:59.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.923+0000 7f9b437fe700 1 -- 172.21.15.82:0/1824319535 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561c5991fc40 msgr2=0x561c5991f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:36:59.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.923+0000 7f9b437fe700 1 --2- 172.21.15.82:0/1824319535 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561c5991fc40 0x561c5991f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:36:59.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.923+0000 7f9b437fe700 1 -- 172.21.15.82:0/1824319535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c59925ca0 msgr2=0x561c599297d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:36:59.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.923+0000 7f9b437fe700 1 --2- 172.21.15.82:0/1824319535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c59925ca0 0x561c599297d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:36:59.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.923+0000 7f9b437fe700 1 -- 172.21.15.82:0/1824319535 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561c59686c60 con 0x561c59925380 2023-09-23T09:36:59.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.923+0000 7f9b437fe700 1 --2- 172.21.15.82:0/1824319535 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561c59925380 0x561c59930820 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f9b34009bb0 tx=0x7f9b34005fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44dca700d13ed4e0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:36:59.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.924+0000 7f9b3a7fc700 1 -- 172.21.15.82:0/1824319535 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b34027c30 con 0x561c59925380 2023-09-23T09:36:59.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.924+0000 7f9b3a7fc700 1 -- 172.21.15.82:0/1824319535 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9b34011e80 con 0x561c59925380 2023-09-23T09:36:59.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.924+0000 7f9b3a7fc700 1 -- 172.21.15.82:0/1824319535 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b34003ac0 con 0x561c59925380 2023-09-23T09:36:59.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.925+0000 7f9b5d8f3b80 1 -- 172.21.15.82:0/1824319535 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561c59925380 msgr2=0x561c59930820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:36:59.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.925+0000 7f9b5d8f3b80 1 --2- 172.21.15.82:0/1824319535 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561c59925380 0x561c59930820 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f9b34009bb0 tx=0x7f9b34005fd0 comp rx=0 tx=0).stop 2023-09-23T09:36:59.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.925+0000 7f9b5d8f3b80 1 -- 172.21.15.82:0/1824319535 shutdown_connections 2023-09-23T09:36:59.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.925+0000 7f9b5d8f3b80 1 --2- 172.21.15.82:0/1824319535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c59925ca0 0x561c599297d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:36:59.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.925+0000 7f9b5d8f3b80 1 --2- 172.21.15.82:0/1824319535 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561c5991fc40 0x561c5991f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:36:59.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.925+0000 7f9b5d8f3b80 1 --2- 172.21.15.82:0/1824319535 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561c59925380 0x561c59930820 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:36:59.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.925+0000 7f9b5d8f3b80 1 -- 172.21.15.82:0/1824319535 >> 172.21.15.82:0/1824319535 conn(0x561c598940e0 msgr2=0x561c59923090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:36:59.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.925+0000 7f9b5d8f3b80 1 -- 172.21.15.82:0/1824319535 shutdown_connections 2023-09-23T09:36:59.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.925+0000 7f9b5d8f3b80 1 -- 172.21.15.82:0/1824319535 wait complete. 2023-09-23T09:36:59.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.925+0000 7f9b5d8f3b80 1 -- start start 2023-09-23T09:36:59.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.926+0000 7f9b5d8f3b80 1 Processor -- start 2023-09-23T09:36:59.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.927+0000 7f9b5d8f3b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561c5991fc40 0x561c59922520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:36:59.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.927+0000 7f9b5d8f3b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561c59925380 0x561c59920da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:36:59.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.927+0000 7f9b5d8f3b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c59925ca0 0x561c599212e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:36:59.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.927+0000 7f9b5d8f3b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c59921820 con 0x561c59925ca0 2023-09-23T09:36:59.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.927+0000 7f9b5d8f3b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c59921990 con 0x561c5991fc40 2023-09-23T09:36:59.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.927+0000 7f9b5d8f3b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c59921b50 con 0x561c59925380 2023-09-23T09:36:59.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.927+0000 7f9b5d8f3b80 10 client.0 _ll_register_callbacks cb 0x561c59759a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:36:59.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.928+0000 7f9b3bfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561c5991fc40 0x561c59922520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:36:59.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.928+0000 7f9b3bfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561c5991fc40 0x561c59922520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:53656/0 (socket says 172.21.15.82:53656) 2023-09-23T09:36:59.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.928+0000 7f9b3bfff700 1 -- 172.21.15.82:0/3484076903 learned_addr learned my addr 172.21.15.82:0/3484076903 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:36:59.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.928+0000 7f9b3bfff700 1 --2- 172.21.15.82:0/3484076903 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c59925ca0 0x561c599212e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:36:59.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.928+0000 7f9b437fe700 1 --2- 172.21.15.82:0/3484076903 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561c59925380 0x561c59920da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:36:59.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.929+0000 7f9b437fe700 1 -- 172.21.15.82:0/3484076903 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561c5991fc40 msgr2=0x561c59922520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:36:59.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.929+0000 7f9b437fe700 1 --2- 172.21.15.82:0/3484076903 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561c5991fc40 0x561c59922520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:36:59.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.929+0000 7f9b437fe700 1 -- 172.21.15.82:0/3484076903 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c59925ca0 msgr2=0x561c599212e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:36:59.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.929+0000 7f9b437fe700 1 --2- 172.21.15.82:0/3484076903 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c59925ca0 0x561c599212e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:36:59.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.929+0000 7f9b437fe700 1 -- 172.21.15.82:0/3484076903 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b3401e040 con 0x561c59925380 2023-09-23T09:36:59.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.929+0000 7f9b437fe700 1 --2- 172.21.15.82:0/3484076903 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561c59925380 0x561c59920da0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x561c599206e0 tx=0x7f9b340270d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7fc8c3502bfc7217 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:36:59.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.929+0000 7f9b22ffd700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T09:36:59.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.929+0000 7f9b22ffd700 1 -- 172.21.15.82:0/3484076903 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b340119f0 con 0x561c59925380 2023-09-23T09:36:59.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.929+0000 7f9b5d8f3b80 1 -- 172.21.15.82:0/3484076903 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561c599128b0 con 0x561c59925380 2023-09-23T09:36:59.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.930+0000 7f9b22ffd700 1 -- 172.21.15.82:0/3484076903 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(155..155 src has 1..155) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f9b34011b50 con 0x561c59925380 2023-09-23T09:36:59.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.930+0000 7f9b22ffd700 1 -- 172.21.15.82:0/3484076903 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=125) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9b34027a30 con 0x561c59925380 2023-09-23T09:36:59.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.930+0000 7f9b5d8f3b80 10 client.27829 fetch_fsmap learned FSMap version 125 2023-09-23T09:36:59.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.930+0000 7f9b5d8f3b80 1 -- 172.21.15.82:0/3484076903 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=125,monmap=4+}) v3 -- 0x561c596c4250 con 0x561c59925380 2023-09-23T09:36:59.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.930+0000 7f9b22ffd700 1 -- 172.21.15.82:0/3484076903 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9b3403d080 con 0x561c59925380 2023-09-23T09:36:59.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.930+0000 7f9b22ffd700 1 -- 172.21.15.82:0/3484076903 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 125) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f9b340050b0 con 0x561c59925380 2023-09-23T09:36:59.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.931+0000 7f9b5d8f3b80 10 client.27829 fetch_fsmap finished waiting for FSMap version 125 2023-09-23T09:36:59.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.931+0000 7f9b5d8f3b80 10 client.27829 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:36:59.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.931+0000 7f9b5d8f3b80 20 client.27829 populate_metadata read hostname 'smithi082' 2023-09-23T09:36:59.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.931+0000 7f9b5d8f3b80 1 --2- 172.21.15.82:0/3484076903 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x561c5998e710 0x561c59990b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:36:59.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.931+0000 7f9b5d8f3b80 4 client.27829 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:36:59.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.931+0000 7f9b5d8f3b80 1 -- 172.21.15.82:0/3484076903 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x561c5986a970 con 0x561c5998e710 2023-09-23T09:36:59.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.931+0000 7f9b3bfff700 1 --2- 172.21.15.82:0/3484076903 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x561c5998e710 0x561c59990b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:36:59.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.932+0000 7f9b3bfff700 1 --2- 172.21.15.82:0/3484076903 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x561c5998e710 0x561c59990b00 crc :-1 s=READY pgs=258 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a61269e16da0b18 server_cookie=ee2dc6a445e51dda in_seq=0 out_seq=0 2023-09-23T09:36:59.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.932+0000 7f9b22ffd700 10 client.27829 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:36:59.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.932+0000 7f9b22ffd700 1 -- 172.21.15.82:0/3484076903 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x561c5986a970 con 0x561c5998e710 2023-09-23T09:36:59.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.932+0000 7f9b22ffd700 10 client.27829 handle_command_reply: tid=0 2023-09-23T09:36:59.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.932+0000 7f9b5d8f3b80 1 client.27829 shutdown 2023-09-23T09:36:59.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.932+0000 7f9b5d8f3b80 1 -- 172.21.15.82:0/3484076903 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561c59925380 msgr2=0x561c59920da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:36:59.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.932+0000 7f9b5d8f3b80 1 --2- 172.21.15.82:0/3484076903 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561c59925380 0x561c59920da0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x561c599206e0 tx=0x7f9b340270d0 comp rx=0 tx=0).stop 2023-09-23T09:36:59.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.932+0000 7f9b5d8f3b80 1 -- 172.21.15.82:0/3484076903 shutdown_connections 2023-09-23T09:36:59.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.932+0000 7f9b5d8f3b80 1 --2- 172.21.15.82:0/3484076903 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x561c5998e710 0x561c59990b00 crc :-1 s=READY pgs=258 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:36:59.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.932+0000 7f9b5d8f3b80 1 --2- 172.21.15.82:0/3484076903 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c59925ca0 0x561c599212e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:36:59.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.932+0000 7f9b5d8f3b80 1 --2- 172.21.15.82:0/3484076903 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561c5991fc40 0x561c59922520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:36:59.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.932+0000 7f9b5d8f3b80 1 --2- 172.21.15.82:0/3484076903 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561c59925380 0x561c59920da0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:36:59.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.932+0000 7f9b5d8f3b80 1 -- 172.21.15.82:0/3484076903 >> 172.21.15.82:0/3484076903 conn(0x561c598940e0 msgr2=0x561c59923fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:36:59.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.932+0000 7f9b22ffd700 0 client.27829 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:36:59.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.933+0000 7f9b5d8f3b80 1 -- 172.21.15.82:0/3484076903 shutdown_connections 2023-09-23T09:36:59.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.933+0000 7f9b5d8f3b80 1 -- 172.21.15.82:0/3484076903 wait complete. 2023-09-23T09:36:59.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.933+0000 7f9b5d8f3b80 20 client.27829 trim_cache size 0 max 16384 2023-09-23T09:36:59.939 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:36:59.939 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-23T09:36:59.939 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:36:59.939 INFO:teuthology.orchestra.run.smithi082.stdout: "d9e62ab8-1468-4fb0-a9fe-61bed13e954b": { 2023-09-23T09:36:59.939 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:36:59.939 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "d9e62ab8-1468-4fb0-a9fe-61bed13e954b", 2023-09-23T09:36:59.939 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:36:59.939 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:36:59.940 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:36:59.940 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:36:59.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.934+0000 7f9b49fff700 1 -- 172.21.15.82:0/2285344689 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f9b300a0140 msgr2=0x7f9b300a2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:36:59.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.934+0000 7f9b49fff700 1 --2- 172.21.15.82:0/2285344689 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f9b300a0140 0x7f9b300a2600 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c094d10 tx=0x7f9b3c094430 comp rx=0 tx=0).stop 2023-09-23T09:36:59.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.934+0000 7f9b49fff700 1 -- 172.21.15.82:0/2285344689 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b44105770 msgr2=0x7f9b4410da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:36:59.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.934+0000 7f9b49fff700 1 --2- 172.21.15.82:0/2285344689 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b44105770 0x7f9b4410da80 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c00efc0 tx=0x7f9b3c00c3a0 comp rx=0 tx=0).stop 2023-09-23T09:36:59.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.934+0000 7f9b49fff700 1 -- 172.21.15.82:0/2285344689 shutdown_connections 2023-09-23T09:36:59.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.934+0000 7f9b49fff700 1 --2- 172.21.15.82:0/2285344689 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f9b300a0140 0x7f9b300a2600 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:36:59.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.934+0000 7f9b49fff700 1 --2- 172.21.15.82:0/2285344689 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b44105770 0x7f9b4410da80 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:36:59.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.934+0000 7f9b49fff700 1 --2- 172.21.15.82:0/2285344689 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b440ff760 0x7f9b4410d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:36:59.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.934+0000 7f9b49fff700 1 --2- 172.21.15.82:0/2285344689 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b44100120 0x7f9b4410d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:36:59.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.934+0000 7f9b49fff700 1 -- 172.21.15.82:0/2285344689 >> 172.21.15.82:0/2285344689 conn(0x7f9b440fb270 msgr2=0x7f9b440fbab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:36:59.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.934+0000 7f9b49fff700 1 -- 172.21.15.82:0/2285344689 shutdown_connections 2023-09-23T09:36:59.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:36:59.934+0000 7f9b49fff700 1 -- 172.21.15.82:0/2285344689 wait complete. 2023-09-23T09:36:59.965 INFO:tasks.cephfs.filesystem:scrub status for tag:d9e62ab8-1468-4fb0-a9fe-61bed13e954b - {'path': '/', 'tag': 'd9e62ab8-1468-4fb0-a9fe-61bed13e954b', 'options': 'recursive,force'} 2023-09-23T09:37:00.827 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 590.0 s, 181.2 tps, lat 259.656 ms stddev 223.748 2023-09-23T09:37:01.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:37:00 smithi082 ceph-mon[97694]: pgmap v1272: 97 pgs: 97 active+clean; 15 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 3.5 MiB/s rd, 5.8 MiB/s wr, 833 op/s 2023-09-23T09:37:01.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:37:00 smithi161 ceph-mon[99580]: pgmap v1272: 97 pgs: 97 active+clean; 15 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 3.5 MiB/s rd, 5.8 MiB/s wr, 833 op/s 2023-09-23T09:37:01.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:37:00 smithi135 ceph-mon[99205]: pgmap v1272: 97 pgs: 97 active+clean; 15 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 3.5 MiB/s rd, 5.8 MiB/s wr, 833 op/s 2023-09-23T09:37:03.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:37:03 smithi135 ceph-mon[99205]: pgmap v1273: 97 pgs: 97 active+clean; 15 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.2 MiB/s wr, 682 op/s 2023-09-23T09:37:03.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:37:03 smithi082 ceph-mon[97694]: pgmap v1273: 97 pgs: 97 active+clean; 15 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.2 MiB/s wr, 682 op/s 2023-09-23T09:37:03.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:37:03 smithi161 ceph-mon[99580]: pgmap v1273: 97 pgs: 97 active+clean; 15 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.2 MiB/s wr, 682 op/s 2023-09-23T09:37:05.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:37:05 smithi135 ceph-mon[99205]: pgmap v1274: 97 pgs: 97 active+clean; 15 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.1 MiB/s wr, 647 op/s 2023-09-23T09:37:05.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:37:05 smithi082 ceph-mon[97694]: pgmap v1274: 97 pgs: 97 active+clean; 15 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.1 MiB/s wr, 647 op/s 2023-09-23T09:37:05.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:37:05 smithi161 ceph-mon[99580]: pgmap v1274: 97 pgs: 97 active+clean; 15 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.1 MiB/s wr, 647 op/s 2023-09-23T09:37:05.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 595.0 s, 103.2 tps, lat 537.915 ms stddev 546.194 2023-09-23T09:37:07.564 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:37:07 smithi135 ceph-mon[99205]: pgmap v1275: 97 pgs: 97 active+clean; 15 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 3.2 MiB/s rd, 7.2 MiB/s wr, 897 op/s 2023-09-23T09:37:07.564 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:37:07 smithi135 ceph-mon[99205]: osdmap e156: 12 total, 12 up, 12 in 2023-09-23T09:37:07.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:37:07 smithi082 ceph-mon[97694]: pgmap v1275: 97 pgs: 97 active+clean; 15 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 3.2 MiB/s rd, 7.2 MiB/s wr, 897 op/s 2023-09-23T09:37:07.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:37:07 smithi082 ceph-mon[97694]: osdmap e156: 12 total, 12 up, 12 in 2023-09-23T09:37:07.650 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:37:07 smithi161 ceph-mon[99580]: pgmap v1275: 97 pgs: 97 active+clean; 15 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 3.2 MiB/s rd, 7.2 MiB/s wr, 897 op/s 2023-09-23T09:37:07.650 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:37:07 smithi161 ceph-mon[99580]: osdmap e156: 12 total, 12 up, 12 in 2023-09-23T09:37:08.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:37:08 smithi082 ceph-mon[97694]: pgmap v1277: 97 pgs: 97 active+clean; 15 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.6 MiB/s wr, 705 op/s 2023-09-23T09:37:08.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:37:08 smithi161 ceph-mon[99580]: pgmap v1277: 97 pgs: 97 active+clean; 15 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.6 MiB/s wr, 705 op/s 2023-09-23T09:37:08.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:37:08 smithi135 ceph-mon[99205]: pgmap v1277: 97 pgs: 97 active+clean; 15 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.6 MiB/s wr, 705 op/s 2023-09-23T09:37:10.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 600.0 s, 44.8 tps, lat 1153.472 ms stddev 1230.676 2023-09-23T09:37:11.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:37:10 smithi082 ceph-mon[97694]: pgmap v1278: 97 pgs: 8 active+clean+snaptrim, 17 active+clean+snaptrim_wait, 72 active+clean; 14 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 1.4 MiB/s rd, 5.0 MiB/s wr, 514 op/s 2023-09-23T09:37:11.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:37:10 smithi161 ceph-mon[99580]: pgmap v1278: 97 pgs: 8 active+clean+snaptrim, 17 active+clean+snaptrim_wait, 72 active+clean; 14 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 1.4 MiB/s rd, 5.0 MiB/s wr, 514 op/s 2023-09-23T09:37:11.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:37:10 smithi135 ceph-mon[99205]: pgmap v1278: 97 pgs: 8 active+clean+snaptrim, 17 active+clean+snaptrim_wait, 72 active+clean; 14 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 1.4 MiB/s rd, 5.0 MiB/s wr, 514 op/s 2023-09-23T09:37:13.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:37:13 smithi135 ceph-mon[99205]: pgmap v1279: 97 pgs: 8 active+clean+snaptrim, 17 active+clean+snaptrim_wait, 72 active+clean; 14 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.3 MiB/s wr, 425 op/s 2023-09-23T09:37:13.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:37:13 smithi082 ceph-mon[97694]: pgmap v1279: 97 pgs: 8 active+clean+snaptrim, 17 active+clean+snaptrim_wait, 72 active+clean; 14 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.3 MiB/s wr, 425 op/s 2023-09-23T09:37:13.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:37:13 smithi161 ceph-mon[99580]: pgmap v1279: 97 pgs: 8 active+clean+snaptrim, 17 active+clean+snaptrim_wait, 72 active+clean; 14 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.3 MiB/s wr, 425 op/s 2023-09-23T09:37:15.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:37:15 smithi135 ceph-mon[99205]: pgmap v1280: 97 pgs: 8 active+clean+snaptrim, 17 active+clean+snaptrim_wait, 72 active+clean; 14 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.3 MiB/s wr, 425 op/s 2023-09-23T09:37:15.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:37:15 smithi082 ceph-mon[97694]: pgmap v1280: 97 pgs: 8 active+clean+snaptrim, 17 active+clean+snaptrim_wait, 72 active+clean; 14 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.3 MiB/s wr, 425 op/s 2023-09-23T09:37:15.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:37:15 smithi161 ceph-mon[99580]: pgmap v1280: 97 pgs: 8 active+clean+snaptrim, 17 active+clean+snaptrim_wait, 72 active+clean; 14 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.3 MiB/s wr, 425 op/s 2023-09-23T09:37:15.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 605.0 s, 123.2 tps, lat 427.097 ms stddev 379.954 2023-09-23T09:37:17.565 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:37:17 smithi135 ceph-mon[99205]: pgmap v1281: 97 pgs: 97 active+clean; 14 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.8 MiB/s wr, 392 op/s 2023-09-23T09:37:17.565 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:37:17 smithi135 ceph-mon[99205]: osdmap e157: 12 total, 12 up, 12 in 2023-09-23T09:37:17.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:37:17 smithi082 ceph-mon[97694]: pgmap v1281: 97 pgs: 97 active+clean; 14 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.8 MiB/s wr, 392 op/s 2023-09-23T09:37:17.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:37:17 smithi082 ceph-mon[97694]: osdmap e157: 12 total, 12 up, 12 in 2023-09-23T09:37:17.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:37:17 smithi161 ceph-mon[99580]: pgmap v1281: 97 pgs: 97 active+clean; 14 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.8 MiB/s wr, 392 op/s 2023-09-23T09:37:17.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:37:17 smithi161 ceph-mon[99580]: osdmap e157: 12 total, 12 up, 12 in 2023-09-23T09:37:18.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:37:18 smithi135 ceph-mon[99205]: pgmap v1283: 97 pgs: 97 active+clean; 14 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.8 MiB/s wr, 392 op/s 2023-09-23T09:37:18.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:37:18 smithi082 ceph-mon[97694]: pgmap v1283: 97 pgs: 97 active+clean; 14 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.8 MiB/s wr, 392 op/s 2023-09-23T09:37:18.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:37:18 smithi161 ceph-mon[99580]: pgmap v1283: 97 pgs: 97 active+clean; 14 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.8 MiB/s wr, 392 op/s 2023-09-23T09:37:20.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 610.0 s, 194.6 tps, lat 271.222 ms stddev 258.664 2023-09-23T09:37:21.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:37:20 smithi082 ceph-mon[97694]: pgmap v1284: 97 pgs: 97 active+clean; 14 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.2 MiB/s wr, 659 op/s 2023-09-23T09:37:21.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:37:20 smithi161 ceph-mon[99580]: pgmap v1284: 97 pgs: 97 active+clean; 14 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.2 MiB/s wr, 659 op/s 2023-09-23T09:37:21.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:37:20 smithi135 ceph-mon[99205]: pgmap v1284: 97 pgs: 97 active+clean; 14 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.2 MiB/s wr, 659 op/s 2023-09-23T09:37:23.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:37:23 smithi135 ceph-mon[99205]: pgmap v1285: 97 pgs: 97 active+clean; 14 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 5.4 MiB/s wr, 700 op/s 2023-09-23T09:37:23.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:37:23 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:37:23.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:37:23 smithi082 ceph-mon[97694]: pgmap v1285: 97 pgs: 97 active+clean; 14 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 5.4 MiB/s wr, 700 op/s 2023-09-23T09:37:23.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:37:23 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:37:23.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:37:23 smithi161 ceph-mon[99580]: pgmap v1285: 97 pgs: 97 active+clean; 14 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 5.4 MiB/s wr, 700 op/s 2023-09-23T09:37:23.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:37:23 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:37:25.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:37:25 smithi135 ceph-mon[99205]: pgmap v1286: 97 pgs: 97 active+clean; 14 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 5.4 MiB/s wr, 700 op/s 2023-09-23T09:37:25.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:37:25 smithi082 ceph-mon[97694]: pgmap v1286: 97 pgs: 97 active+clean; 14 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 5.4 MiB/s wr, 700 op/s 2023-09-23T09:37:25.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:37:25 smithi161 ceph-mon[99580]: pgmap v1286: 97 pgs: 97 active+clean; 14 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 5.4 MiB/s wr, 700 op/s 2023-09-23T09:37:25.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 615.0 s, 164.4 tps, lat 312.421 ms stddev 265.386 2023-09-23T09:37:27.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:37:27 smithi135 ceph-mon[99205]: pgmap v1287: 97 pgs: 97 active+clean; 14 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 2.9 MiB/s rd, 6.7 MiB/s wr, 817 op/s 2023-09-23T09:37:27.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:37:27 smithi082 ceph-mon[97694]: pgmap v1287: 97 pgs: 97 active+clean; 14 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 2.9 MiB/s rd, 6.7 MiB/s wr, 817 op/s 2023-09-23T09:37:27.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:37:27 smithi161 ceph-mon[99580]: pgmap v1287: 97 pgs: 97 active+clean; 14 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 2.9 MiB/s rd, 6.7 MiB/s wr, 817 op/s 2023-09-23T09:37:29.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:37:29 smithi135 ceph-mon[99205]: pgmap v1288: 97 pgs: 97 active+clean; 14 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.4 MiB/s wr, 777 op/s 2023-09-23T09:37:29.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:37:29 smithi082 ceph-mon[97694]: pgmap v1288: 97 pgs: 97 active+clean; 14 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.4 MiB/s wr, 777 op/s 2023-09-23T09:37:29.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:37:29 smithi161 ceph-mon[99580]: pgmap v1288: 97 pgs: 97 active+clean; 14 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.4 MiB/s wr, 777 op/s 2023-09-23T09:37:29.966 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:37:30.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:37:30 smithi082 ceph-mon[97694]: pgmap v1289: 97 pgs: 97 active+clean; 14 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 3.4 MiB/s rd, 7.8 MiB/s wr, 941 op/s 2023-09-23T09:37:30.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:37:30 smithi161 ceph-mon[99580]: pgmap v1289: 97 pgs: 97 active+clean; 14 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 3.4 MiB/s rd, 7.8 MiB/s wr, 941 op/s 2023-09-23T09:37:30.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.705+0000 7f61fabff700 1 -- 172.21.15.82:0/3202774277 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61f4101250 msgr2=0x7f61f410d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:37:30.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.705+0000 7f61fabff700 1 --2- 172.21.15.82:0/3202774277 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61f4101250 0x7f61f410d760 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f61ec009f90 tx=0x7f61ec00b330 comp rx=0 tx=0).stop 2023-09-23T09:37:30.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.706+0000 7f61fabff700 1 -- 172.21.15.82:0/3202774277 shutdown_connections 2023-09-23T09:37:30.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.706+0000 7f61fabff700 1 --2- 172.21.15.82:0/3202774277 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61f4101250 0x7f61f410d760 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:37:30.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.706+0000 7f61fabff700 1 --2- 172.21.15.82:0/3202774277 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61f41068a0 0x7f61f4106c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:37:30.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.706+0000 7f61fabff700 1 --2- 172.21.15.82:0/3202774277 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f61f4100890 0x7f61f4100d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:37:30.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.706+0000 7f61fabff700 1 -- 172.21.15.82:0/3202774277 >> 172.21.15.82:0/3202774277 conn(0x7f61f40fc380 msgr2=0x7f61f40fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:37:30.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.706+0000 7f61fabff700 1 -- 172.21.15.82:0/3202774277 shutdown_connections 2023-09-23T09:37:30.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.706+0000 7f61fabff700 1 -- 172.21.15.82:0/3202774277 wait complete. 2023-09-23T09:37:30.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.707+0000 7f61fabff700 1 Processor -- start 2023-09-23T09:37:30.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.707+0000 7f61fabff700 1 -- start start 2023-09-23T09:37:30.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.708+0000 7f61fabff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f61f4100890 0x7f61f419e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:37:30.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.708+0000 7f61fabff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61f4101250 0x7f61f419eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:37:30.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.708+0000 7f61fabff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61f41068a0 0x7f61f4198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:37:30.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.708+0000 7f61fabff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f4199070 con 0x7f61f41068a0 2023-09-23T09:37:30.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.708+0000 7f61fabff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f41991e0 con 0x7f61f4101250 2023-09-23T09:37:30.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.708+0000 7f61fabff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f41993a0 con 0x7f61f4100890 2023-09-23T09:37:30.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.708+0000 7f61f919c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61f41068a0 0x7f61f4198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:37:30.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.708+0000 7f61f3fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61f4101250 0x7f61f419eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:37:30.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.708+0000 7f61f3fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61f4101250 0x7f61f419eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:59554/0 (socket says 172.21.15.82:59554) 2023-09-23T09:37:30.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.708+0000 7f61f899b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f61f4100890 0x7f61f419e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:37:30.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.708+0000 7f61f3fff700 1 -- 172.21.15.82:0/254601119 learned_addr learned my addr 172.21.15.82:0/254601119 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:37:30.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.709+0000 7f61f919c700 1 -- 172.21.15.82:0/254601119 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f61f4100890 msgr2=0x7f61f419e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:37:30.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.709+0000 7f61f919c700 1 --2- 172.21.15.82:0/254601119 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f61f4100890 0x7f61f419e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:37:30.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.709+0000 7f61f919c700 1 -- 172.21.15.82:0/254601119 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61f4101250 msgr2=0x7f61f419eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:37:30.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.709+0000 7f61f919c700 1 --2- 172.21.15.82:0/254601119 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61f4101250 0x7f61f419eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:37:30.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.709+0000 7f61f919c700 1 -- 172.21.15.82:0/254601119 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61ec009c40 con 0x7f61f41068a0 2023-09-23T09:37:30.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.709+0000 7f61f899b700 1 --2- 172.21.15.82:0/254601119 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f61f4100890 0x7f61f419e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:37:30.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.709+0000 7f61f919c700 1 --2- 172.21.15.82:0/254601119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61f41068a0 0x7f61f4198a00 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f61ec00b6c0 tx=0x7f61ec007730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:37:30.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.709+0000 7f61f1ffb700 1 -- 172.21.15.82:0/254601119 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61ec00e040 con 0x7f61f41068a0 2023-09-23T09:37:30.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.710+0000 7f61f1ffb700 1 -- 172.21.15.82:0/254601119 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f61ec004e60 con 0x7f61f41068a0 2023-09-23T09:37:30.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.710+0000 7f61fabff700 1 -- 172.21.15.82:0/254601119 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61f4199620 con 0x7f61f41068a0 2023-09-23T09:37:30.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.710+0000 7f61f1ffb700 1 -- 172.21.15.82:0/254601119 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61ec0052a0 con 0x7f61f41068a0 2023-09-23T09:37:30.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.710+0000 7f61fabff700 1 -- 172.21.15.82:0/254601119 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61f41a5980 con 0x7f61f41068a0 2023-09-23T09:37:30.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.714+0000 7f61f1ffb700 1 -- 172.21.15.82:0/254601119 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f61ec01d480 con 0x7f61f41068a0 2023-09-23T09:37:30.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.716+0000 7f61f1ffb700 1 --2- 172.21.15.82:0/254601119 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f61e40a0180 0x7f61e40a2640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:37:30.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.716+0000 7f61f1ffb700 1 -- 172.21.15.82:0/254601119 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f61ec0ccd40 con 0x7f61f41068a0 2023-09-23T09:37:30.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.716+0000 7f620e578b80 1 Processor -- start 2023-09-23T09:37:30.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.716+0000 7f620e578b80 1 -- start start 2023-09-23T09:37:30.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.717+0000 7f620e578b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b21f92e100 0x55b21f92e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:37:30.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.717+0000 7f61f899b700 1 --2- 172.21.15.82:0/254601119 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f61e40a0180 0x7f61e40a2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:37:30.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.717+0000 7f620e578b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b21f92ea20 0x55b21f932790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:37:30.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.717+0000 7f620e578b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b21f932cd0 0x55b21f933130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:37:30.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.717+0000 7f620e578b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b21f88d7b0 con 0x55b21f92e100 2023-09-23T09:37:30.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.717+0000 7f620e578b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b21f87e780 con 0x55b21f92ea20 2023-09-23T09:37:30.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.717+0000 7f620e578b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b21f87c0a0 con 0x55b21f932cd0 2023-09-23T09:37:30.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.717+0000 7f61f3fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b21f92ea20 0x55b21f932790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:37:30.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.717+0000 7f61f3fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b21f92ea20 0x55b21f932790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:59556/0 (socket says 172.21.15.82:59556) 2023-09-23T09:37:30.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.717+0000 7f61f3fff700 1 -- 172.21.15.82:0/451100478 learned_addr learned my addr 172.21.15.82:0/451100478 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:37:30.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.717+0000 7f61f899b700 1 --2- 172.21.15.82:0/451100478 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b21f92e100 0x55b21f92e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:37:30.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.717+0000 7f61f919c700 1 --2- 172.21.15.82:0/451100478 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b21f932cd0 0x55b21f933130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:37:30.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.718+0000 7f61f3fff700 1 -- 172.21.15.82:0/451100478 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b21f932cd0 msgr2=0x55b21f933130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:37:30.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.718+0000 7f61f3fff700 1 --2- 172.21.15.82:0/451100478 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b21f932cd0 0x55b21f933130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:37:30.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.718+0000 7f61f3fff700 1 -- 172.21.15.82:0/451100478 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b21f92e100 msgr2=0x55b21f92e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:37:30.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.718+0000 7f61f3fff700 1 --2- 172.21.15.82:0/451100478 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b21f92e100 0x55b21f92e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:37:30.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.718+0000 7f61f3fff700 1 -- 172.21.15.82:0/451100478 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b21f6f7630 con 0x55b21f92ea20 2023-09-23T09:37:30.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.718+0000 7f61f899b700 1 --2- 172.21.15.82:0/254601119 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f61e40a0180 0x7f61e40a2640 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f61e800bfd0 tx=0x7f61e8013530 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:37:30.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.718+0000 7f61f3fff700 1 --2- 172.21.15.82:0/451100478 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b21f92ea20 0x55b21f932790 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f61e0009df0 tx=0x7f61e0011720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd3437ee89ba996b server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:37:30.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.718+0000 7f61deffd700 1 -- 172.21.15.82:0/451100478 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e0004230 con 0x55b21f92ea20 2023-09-23T09:37:30.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.718+0000 7f61deffd700 1 -- 172.21.15.82:0/451100478 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f61e0004390 con 0x55b21f92ea20 2023-09-23T09:37:30.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.718+0000 7f61deffd700 1 -- 172.21.15.82:0/451100478 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e0019740 con 0x55b21f92ea20 2023-09-23T09:37:30.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.719+0000 7f620e578b80 1 -- 172.21.15.82:0/451100478 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b21f92ea20 msgr2=0x55b21f932790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:37:30.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.719+0000 7f620e578b80 1 --2- 172.21.15.82:0/451100478 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b21f92ea20 0x55b21f932790 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f61e0009df0 tx=0x7f61e0011720 comp rx=0 tx=0).stop 2023-09-23T09:37:30.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.720+0000 7f620e578b80 1 -- 172.21.15.82:0/451100478 shutdown_connections 2023-09-23T09:37:30.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.720+0000 7f620e578b80 1 --2- 172.21.15.82:0/451100478 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b21f932cd0 0x55b21f933130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:37:30.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.720+0000 7f620e578b80 1 --2- 172.21.15.82:0/451100478 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b21f92e100 0x55b21f92e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:37:30.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.720+0000 7f620e578b80 1 --2- 172.21.15.82:0/451100478 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b21f92ea20 0x55b21f932790 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:37:30.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.720+0000 7f620e578b80 1 -- 172.21.15.82:0/451100478 >> 172.21.15.82:0/451100478 conn(0x55b21f89a0e0 msgr2=0x55b21f920410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:37:30.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.720+0000 7f620e578b80 1 -- 172.21.15.82:0/451100478 shutdown_connections 2023-09-23T09:37:30.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.720+0000 7f620e578b80 1 -- 172.21.15.82:0/451100478 wait complete. 2023-09-23T09:37:30.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.721+0000 7f620e578b80 1 -- start start 2023-09-23T09:37:30.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.721+0000 7f620e578b80 1 Processor -- start 2023-09-23T09:37:30.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.722+0000 7f620e578b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b21f92e100 0x55b21f93a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:37:30.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.722+0000 7f620e578b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b21f92ea20 0x55b21f9376c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:37:30.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.722+0000 7f620e578b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b21f932cd0 0x55b21f937db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:37:30.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.722+0000 7f620e578b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b21f877990 con 0x55b21f92ea20 2023-09-23T09:37:30.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.722+0000 7f620e578b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b21f815bb0 con 0x55b21f92e100 2023-09-23T09:37:30.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.722+0000 7f620e578b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b21f8158b0 con 0x55b21f932cd0 2023-09-23T09:37:30.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.722+0000 7f620e578b80 10 client.0 _ll_register_callbacks cb 0x55b21f75fa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:37:30.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.722+0000 7f61f899b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b21f92e100 0x55b21f93a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:37:30.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.722+0000 7f61f3fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b21f92ea20 0x55b21f9376c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:37:30.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.722+0000 7f61f899b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b21f92e100 0x55b21f93a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:59562/0 (socket says 172.21.15.82:59562) 2023-09-23T09:37:30.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.722+0000 7f61f899b700 1 -- 172.21.15.82:0/1047739166 learned_addr learned my addr 172.21.15.82:0/1047739166 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:37:30.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.722+0000 7f61f919c700 1 --2- 172.21.15.82:0/1047739166 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b21f932cd0 0x55b21f937db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:37:30.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.722+0000 7f61f899b700 1 -- 172.21.15.82:0/1047739166 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b21f932cd0 msgr2=0x55b21f937db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:37:30.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.722+0000 7f61f899b700 1 --2- 172.21.15.82:0/1047739166 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b21f932cd0 0x55b21f937db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:37:30.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.722+0000 7f61f899b700 1 -- 172.21.15.82:0/1047739166 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b21f92ea20 msgr2=0x55b21f9376c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:37:30.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.722+0000 7f61f899b700 1 --2- 172.21.15.82:0/1047739166 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b21f92ea20 0x55b21f9376c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:37:30.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.722+0000 7f61f899b700 1 -- 172.21.15.82:0/1047739166 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61e0009a20 con 0x55b21f92e100 2023-09-23T09:37:30.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.722+0000 7f61f3fff700 1 --2- 172.21.15.82:0/1047739166 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b21f92ea20 0x55b21f9376c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:37:30.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.723+0000 7f61f899b700 1 --2- 172.21.15.82:0/1047739166 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b21f92e100 0x55b21f93a4b0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f61e80042e0 tx=0x7f61e80047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c1a26c4a167796e server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:37:30.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.723+0000 7f61d3fff700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-09-23T09:37:30.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.723+0000 7f61d3fff700 1 -- 172.21.15.82:0/1047739166 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e8003880 con 0x55b21f92e100 2023-09-23T09:37:30.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.723+0000 7f620e578b80 1 -- 172.21.15.82:0/1047739166 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b21f8f51c0 con 0x55b21f92e100 2023-09-23T09:37:30.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.723+0000 7f61d3fff700 1 -- 172.21.15.82:0/1047739166 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(157..157 src has 1..157) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f61e8011e60 con 0x55b21f92e100 2023-09-23T09:37:30.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.724+0000 7f61d3fff700 1 -- 172.21.15.82:0/1047739166 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=126) v2 ==== 24+0+0 (secure 0 0 0) 0x7f61e80039e0 con 0x55b21f92e100 2023-09-23T09:37:30.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.724+0000 7f620e578b80 10 client.27809 fetch_fsmap learned FSMap version 126 2023-09-23T09:37:30.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.724+0000 7f620e578b80 1 -- 172.21.15.82:0/1047739166 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=126,monmap=4+}) v3 -- 0x55b21f6a3de0 con 0x55b21f92e100 2023-09-23T09:37:30.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.724+0000 7f61d3fff700 1 -- 172.21.15.82:0/1047739166 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b21f8f51c0 con 0x55b21f92e100 2023-09-23T09:37:30.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.724+0000 7f61d3fff700 1 -- 172.21.15.82:0/1047739166 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 126) v1 ==== 7910+0+0 (secure 0 0 0) 0x7f61e8029b60 con 0x55b21f92e100 2023-09-23T09:37:30.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.724+0000 7f620e578b80 10 client.27809 fetch_fsmap finished waiting for FSMap version 126 2023-09-23T09:37:30.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.724+0000 7f620e578b80 10 client.27809 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:37:30.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.724+0000 7f620e578b80 20 client.27809 populate_metadata read hostname 'smithi082' 2023-09-23T09:37:30.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.725+0000 7f620e578b80 1 --2- 172.21.15.82:0/1047739166 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55b21f947fb0 0x55b21f94a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:37:30.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.725+0000 7f620e578b80 4 client.27809 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:37:30.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.725+0000 7f620e578b80 1 -- 172.21.15.82:0/1047739166 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b21f81dba0 con 0x55b21f947fb0 2023-09-23T09:37:30.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.725+0000 7f61f3fff700 1 --2- 172.21.15.82:0/1047739166 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55b21f947fb0 0x55b21f94a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:37:30.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.726+0000 7f61d3fff700 10 client.27809 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:37:30.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.726+0000 7f61f3fff700 1 --2- 172.21.15.82:0/1047739166 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55b21f947fb0 0x55b21f94a3d0 crc :-1 s=READY pgs=259 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67147aa6c6b0599b server_cookie=ad69e3bbd027c76a in_seq=0 out_seq=0 2023-09-23T09:37:30.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.726+0000 7f61d3fff700 1 -- 172.21.15.82:0/1047739166 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b21f81dba0 con 0x55b21f947fb0 2023-09-23T09:37:30.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.726+0000 7f61d3fff700 10 client.27809 handle_command_reply: tid=0 2023-09-23T09:37:30.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.727+0000 7f620e578b80 1 client.27809 shutdown 2023-09-23T09:37:30.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.727+0000 7f620e578b80 1 -- 172.21.15.82:0/1047739166 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b21f92e100 msgr2=0x55b21f93a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:37:30.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.727+0000 7f620e578b80 1 --2- 172.21.15.82:0/1047739166 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b21f92e100 0x55b21f93a4b0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f61e80042e0 tx=0x7f61e80047c0 comp rx=0 tx=0).stop 2023-09-23T09:37:30.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.727+0000 7f620e578b80 1 -- 172.21.15.82:0/1047739166 shutdown_connections 2023-09-23T09:37:30.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.727+0000 7f620e578b80 1 --2- 172.21.15.82:0/1047739166 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b21f932cd0 0x55b21f937db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:37:30.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.727+0000 7f620e578b80 1 --2- 172.21.15.82:0/1047739166 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b21f92e100 0x55b21f93a4b0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:37:30.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.727+0000 7f620e578b80 1 --2- 172.21.15.82:0/1047739166 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55b21f947fb0 0x55b21f94a3d0 crc :-1 s=READY pgs=259 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:37:30.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.727+0000 7f620e578b80 1 --2- 172.21.15.82:0/1047739166 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b21f92ea20 0x55b21f9376c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:37:30.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.727+0000 7f61d3fff700 0 client.27809 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:37:30.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.727+0000 7f620e578b80 1 -- 172.21.15.82:0/1047739166 >> 172.21.15.82:0/1047739166 conn(0x55b21f89a0e0 msgr2=0x55b21f91a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:37:30.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.727+0000 7f620e578b80 1 -- 172.21.15.82:0/1047739166 shutdown_connections 2023-09-23T09:37:30.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.727+0000 7f620e578b80 1 -- 172.21.15.82:0/1047739166 wait complete. 2023-09-23T09:37:30.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.728+0000 7f620e578b80 20 client.27809 trim_cache size 0 max 16384 2023-09-23T09:37:30.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.748+0000 7f620e578b80 1 Processor -- start 2023-09-23T09:37:30.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.748+0000 7f620e578b80 1 -- start start 2023-09-23T09:37:30.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.748+0000 7f620e578b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b21f92e100 0x55b21f93efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:37:30.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.748+0000 7f620e578b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b21f92ea20 0x55b21f9340c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:37:30.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.748+0000 7f620e578b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b21f932cd0 0x55b21f939fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:37:30.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.748+0000 7f620e578b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b21f6f9920 con 0x55b21f932cd0 2023-09-23T09:37:30.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.748+0000 7f620e578b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b21f93f500 con 0x55b21f92e100 2023-09-23T09:37:30.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.748+0000 7f620e578b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b21f931860 con 0x55b21f92ea20 2023-09-23T09:37:30.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.748+0000 7f61f3fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b21f92ea20 0x55b21f9340c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:37:30.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.748+0000 7f61f919c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b21f932cd0 0x55b21f939fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:37:30.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.748+0000 7f61f3fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b21f92ea20 0x55b21f9340c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:36388/0 (socket says 172.21.15.82:36388) 2023-09-23T09:37:30.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.748+0000 7f61f3fff700 1 -- 172.21.15.82:0/436894903 learned_addr learned my addr 172.21.15.82:0/436894903 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:37:30.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.749+0000 7f61f899b700 1 --2- 172.21.15.82:0/436894903 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b21f92e100 0x55b21f93efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:37:30.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.749+0000 7f61f3fff700 1 -- 172.21.15.82:0/436894903 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b21f92e100 msgr2=0x55b21f93efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:37:30.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.749+0000 7f61f3fff700 1 --2- 172.21.15.82:0/436894903 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b21f92e100 0x55b21f93efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:37:30.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.749+0000 7f61f3fff700 1 -- 172.21.15.82:0/436894903 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b21f932cd0 msgr2=0x55b21f939fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:37:30.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.749+0000 7f61f3fff700 1 --2- 172.21.15.82:0/436894903 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b21f932cd0 0x55b21f939fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:37:30.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.749+0000 7f61f3fff700 1 -- 172.21.15.82:0/436894903 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b21f68cc60 con 0x55b21f92ea20 2023-09-23T09:37:30.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.749+0000 7f61f3fff700 1 --2- 172.21.15.82:0/436894903 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b21f92ea20 0x55b21f9340c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f61e0000c00 tx=0x7f61e0009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6afbbdffbf006056 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:37:30.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.749+0000 7f61df7fe700 1 -- 172.21.15.82:0/436894903 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e0003b10 con 0x55b21f92ea20 2023-09-23T09:37:30.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.750+0000 7f61df7fe700 1 -- 172.21.15.82:0/436894903 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f61e0003c70 con 0x55b21f92ea20 2023-09-23T09:37:30.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.750+0000 7f61df7fe700 1 -- 172.21.15.82:0/436894903 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e001aa40 con 0x55b21f92ea20 2023-09-23T09:37:30.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.750+0000 7f620e578b80 1 -- 172.21.15.82:0/436894903 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b21f92ea20 msgr2=0x55b21f9340c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:37:30.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.750+0000 7f620e578b80 1 --2- 172.21.15.82:0/436894903 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b21f92ea20 0x55b21f9340c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f61e0000c00 tx=0x7f61e0009840 comp rx=0 tx=0).stop 2023-09-23T09:37:30.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.750+0000 7f620e578b80 1 -- 172.21.15.82:0/436894903 shutdown_connections 2023-09-23T09:37:30.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.750+0000 7f620e578b80 1 --2- 172.21.15.82:0/436894903 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b21f932cd0 0x55b21f939fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:37:30.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.750+0000 7f620e578b80 1 --2- 172.21.15.82:0/436894903 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b21f92e100 0x55b21f93efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:37:30.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.750+0000 7f620e578b80 1 --2- 172.21.15.82:0/436894903 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b21f92ea20 0x55b21f9340c0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:37:30.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.750+0000 7f620e578b80 1 -- 172.21.15.82:0/436894903 >> 172.21.15.82:0/436894903 conn(0x55b21f89a0e0 msgr2=0x55b21f930d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:37:30.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.750+0000 7f620e578b80 1 -- 172.21.15.82:0/436894903 shutdown_connections 2023-09-23T09:37:30.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.750+0000 7f620e578b80 1 -- 172.21.15.82:0/436894903 wait complete. 2023-09-23T09:37:30.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.751+0000 7f620e578b80 1 -- start start 2023-09-23T09:37:30.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.751+0000 7f620e578b80 1 Processor -- start 2023-09-23T09:37:30.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.752+0000 7f620e578b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b21f92e100 0x55b21f93b190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:37:30.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.752+0000 7f620e578b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b21f92ea20 0x55b21f93b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:37:30.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.752+0000 7f620e578b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b21f932cd0 0x55b21f99add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:37:30.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.752+0000 7f620e578b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b21f99b310 con 0x55b21f92e100 2023-09-23T09:37:30.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.752+0000 7f620e578b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b21f99b450 con 0x55b21f932cd0 2023-09-23T09:37:30.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.752+0000 7f620e578b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b21f99b590 con 0x55b21f92ea20 2023-09-23T09:37:30.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.752+0000 7f620e578b80 10 client.0 _ll_register_callbacks cb 0x55b21f75fa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:37:30.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.752+0000 7f61f899b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b21f92e100 0x55b21f93b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:37:30.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.752+0000 7f61f899b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b21f92e100 0x55b21f93b190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38010/0 (socket says 172.21.15.82:38010) 2023-09-23T09:37:30.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.752+0000 7f61f899b700 1 -- 172.21.15.82:0/3966255112 learned_addr learned my addr 172.21.15.82:0/3966255112 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:37:30.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.752+0000 7f61f3fff700 1 --2- 172.21.15.82:0/3966255112 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b21f92ea20 0x55b21f93b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:37:30.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.752+0000 7f61f919c700 1 --2- 172.21.15.82:0/3966255112 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b21f932cd0 0x55b21f99add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:37:30.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.752+0000 7f61f899b700 1 -- 172.21.15.82:0/3966255112 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b21f92ea20 msgr2=0x55b21f93b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:37:30.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.752+0000 7f61f899b700 1 --2- 172.21.15.82:0/3966255112 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b21f92ea20 0x55b21f93b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:37:30.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.752+0000 7f61f899b700 1 -- 172.21.15.82:0/3966255112 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b21f932cd0 msgr2=0x55b21f99add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:37:30.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.752+0000 7f61f899b700 1 --2- 172.21.15.82:0/3966255112 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b21f932cd0 0x55b21f99add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:37:30.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.752+0000 7f61f899b700 1 -- 172.21.15.82:0/3966255112 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61e001e040 con 0x55b21f92e100 2023-09-23T09:37:30.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.753+0000 7f61f899b700 1 --2- 172.21.15.82:0/3966255112 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b21f92e100 0x55b21f93b190 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f61e80042e0 tx=0x7f61e8011b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4aa2b2aad4ab4e server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:37:30.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.753+0000 7f61d3fff700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:37:30.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.753+0000 7f61d3fff700 1 -- 172.21.15.82:0/3966255112 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e80208a0 con 0x55b21f92e100 2023-09-23T09:37:30.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.753+0000 7f61d3fff700 1 -- 172.21.15.82:0/3966255112 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(157..157 src has 1..157) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f61e8020a00 con 0x55b21f92e100 2023-09-23T09:37:30.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.753+0000 7f620e578b80 1 -- 172.21.15.82:0/3966255112 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b21f9188b0 con 0x55b21f92e100 2023-09-23T09:37:30.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.753+0000 7f61d3fff700 1 -- 172.21.15.82:0/3966255112 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=126) v2 ==== 24+0+0 (secure 0 0 0) 0x7f61e8020bc0 con 0x55b21f92e100 2023-09-23T09:37:30.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.753+0000 7f620e578b80 10 client.18075 fetch_fsmap learned FSMap version 126 2023-09-23T09:37:30.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.753+0000 7f620e578b80 1 -- 172.21.15.82:0/3966255112 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=126,monmap=4+}) v3 -- 0x55b21f6ca250 con 0x55b21f92e100 2023-09-23T09:37:30.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.753+0000 7f61d3fff700 1 -- 172.21.15.82:0/3966255112 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b21f9188b0 con 0x55b21f92e100 2023-09-23T09:37:30.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.753+0000 7f61d3fff700 1 -- 172.21.15.82:0/3966255112 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 126) v1 ==== 7910+0+0 (secure 0 0 0) 0x7f61e8029460 con 0x55b21f92e100 2023-09-23T09:37:30.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.754+0000 7f620e578b80 10 client.18075 fetch_fsmap finished waiting for FSMap version 126 2023-09-23T09:37:30.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.754+0000 7f620e578b80 10 client.18075 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:37:30.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.754+0000 7f620e578b80 20 client.18075 populate_metadata read hostname 'smithi082' 2023-09-23T09:37:30.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.754+0000 7f620e578b80 1 --2- 172.21.15.82:0/3966255112 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55b21f99ccb0 0x55b21f99f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:37:30.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.754+0000 7f620e578b80 4 client.18075 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:37:30.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.754+0000 7f620e578b80 1 -- 172.21.15.82:0/3966255112 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55b21f870970 con 0x55b21f99ccb0 2023-09-23T09:37:30.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.754+0000 7f61f3fff700 1 --2- 172.21.15.82:0/3966255112 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55b21f99ccb0 0x55b21f99f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:37:30.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.754+0000 7f61f3fff700 1 --2- 172.21.15.82:0/3966255112 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55b21f99ccb0 0x55b21f99f0d0 crc :-1 s=READY pgs=260 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7f2f1c1fdf3f88c server_cookie=35b783a3ef69b3ce in_seq=0 out_seq=0 2023-09-23T09:37:30.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.754+0000 7f61d3fff700 10 client.18075 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:37:30.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.755+0000 7f61d3fff700 1 -- 172.21.15.82:0/3966255112 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55b21f870970 con 0x55b21f99ccb0 2023-09-23T09:37:30.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.755+0000 7f61d3fff700 10 client.18075 handle_command_reply: tid=0 2023-09-23T09:37:30.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.755+0000 7f620e578b80 1 client.18075 shutdown 2023-09-23T09:37:30.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.755+0000 7f620e578b80 1 -- 172.21.15.82:0/3966255112 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b21f92e100 msgr2=0x55b21f93b190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:37:30.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.755+0000 7f620e578b80 1 --2- 172.21.15.82:0/3966255112 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b21f92e100 0x55b21f93b190 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f61e80042e0 tx=0x7f61e8011b20 comp rx=0 tx=0).stop 2023-09-23T09:37:30.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.755+0000 7f620e578b80 1 -- 172.21.15.82:0/3966255112 shutdown_connections 2023-09-23T09:37:30.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.755+0000 7f620e578b80 1 --2- 172.21.15.82:0/3966255112 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b21f932cd0 0x55b21f99add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:37:30.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.755+0000 7f620e578b80 1 --2- 172.21.15.82:0/3966255112 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55b21f99ccb0 0x55b21f99f0d0 crc :-1 s=READY pgs=260 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:37:30.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.755+0000 7f620e578b80 1 --2- 172.21.15.82:0/3966255112 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b21f92e100 0x55b21f93b190 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:37:30.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.755+0000 7f620e578b80 1 --2- 172.21.15.82:0/3966255112 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b21f92ea20 0x55b21f93b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:37:30.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.755+0000 7f61d3fff700 0 client.18075 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:37:30.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.755+0000 7f620e578b80 1 -- 172.21.15.82:0/3966255112 >> 172.21.15.82:0/3966255112 conn(0x55b21f89a0e0 msgr2=0x55b21f9350c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:37:30.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.755+0000 7f620e578b80 1 -- 172.21.15.82:0/3966255112 shutdown_connections 2023-09-23T09:37:30.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.755+0000 7f620e578b80 1 -- 172.21.15.82:0/3966255112 wait complete. 2023-09-23T09:37:30.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.755+0000 7f620e578b80 20 client.18075 trim_cache size 0 max 16384 2023-09-23T09:37:30.762 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:37:30.762 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-23T09:37:30.762 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:37:30.762 INFO:teuthology.orchestra.run.smithi082.stdout: "d9e62ab8-1468-4fb0-a9fe-61bed13e954b": { 2023-09-23T09:37:30.763 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:37:30.763 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "d9e62ab8-1468-4fb0-a9fe-61bed13e954b", 2023-09-23T09:37:30.763 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:37:30.763 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:37:30.763 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:37:30.763 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:37:30.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.756+0000 7f61fabff700 1 -- 172.21.15.82:0/254601119 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f61e40a0180 msgr2=0x7f61e40a2640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:37:30.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.756+0000 7f61fabff700 1 --2- 172.21.15.82:0/254601119 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f61e40a0180 0x7f61e40a2640 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f61e800bfd0 tx=0x7f61e8013530 comp rx=0 tx=0).stop 2023-09-23T09:37:30.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.756+0000 7f61fabff700 1 -- 172.21.15.82:0/254601119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61f41068a0 msgr2=0x7f61f4198a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:37:30.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.756+0000 7f61fabff700 1 --2- 172.21.15.82:0/254601119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61f41068a0 0x7f61f4198a00 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f61ec00b6c0 tx=0x7f61ec007730 comp rx=0 tx=0).stop 2023-09-23T09:37:30.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.756+0000 7f61fabff700 1 -- 172.21.15.82:0/254601119 shutdown_connections 2023-09-23T09:37:30.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.756+0000 7f61fabff700 1 --2- 172.21.15.82:0/254601119 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f61e40a0180 0x7f61e40a2640 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:37:30.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.756+0000 7f61fabff700 1 --2- 172.21.15.82:0/254601119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61f41068a0 0x7f61f4198a00 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:37:30.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.756+0000 7f61fabff700 1 --2- 172.21.15.82:0/254601119 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f61f4100890 0x7f61f419e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:37:30.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.756+0000 7f61fabff700 1 --2- 172.21.15.82:0/254601119 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61f4101250 0x7f61f419eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:37:30.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.756+0000 7f61fabff700 1 -- 172.21.15.82:0/254601119 >> 172.21.15.82:0/254601119 conn(0x7f61f40fc380 msgr2=0x7f61f410bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:37:30.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.756+0000 7f61fabff700 1 -- 172.21.15.82:0/254601119 shutdown_connections 2023-09-23T09:37:30.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:37:30.756+0000 7f61fabff700 1 -- 172.21.15.82:0/254601119 wait complete. 2023-09-23T09:37:30.777 INFO:tasks.cephfs.filesystem:scrub status for tag:d9e62ab8-1468-4fb0-a9fe-61bed13e954b - {'path': '/', 'tag': 'd9e62ab8-1468-4fb0-a9fe-61bed13e954b', 'options': 'recursive,force'} 2023-09-23T09:37:30.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:37:30 smithi135 ceph-mon[99205]: pgmap v1289: 97 pgs: 97 active+clean; 14 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 3.4 MiB/s rd, 7.8 MiB/s wr, 941 op/s 2023-09-23T09:37:30.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 620.0 s, 158.6 tps, lat 326.944 ms stddev 271.105 2023-09-23T09:37:33.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:37:33 smithi135 ceph-mon[99205]: pgmap v1290: 97 pgs: 97 active+clean; 14 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.4 MiB/s wr, 656 op/s 2023-09-23T09:37:33.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:37:33 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:37:33.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:37:33 smithi082 ceph-mon[97694]: pgmap v1290: 97 pgs: 97 active+clean; 14 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.4 MiB/s wr, 656 op/s 2023-09-23T09:37:33.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:37:33 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:37:33.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:37:33 smithi161 ceph-mon[99580]: pgmap v1290: 97 pgs: 97 active+clean; 14 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.4 MiB/s wr, 656 op/s 2023-09-23T09:37:33.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:37:33 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:37:35.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:37:35 smithi135 ceph-mon[99205]: pgmap v1291: 97 pgs: 97 active+clean; 14 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 5.2 MiB/s wr, 611 op/s 2023-09-23T09:37:35.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:37:35 smithi082 ceph-mon[97694]: pgmap v1291: 97 pgs: 97 active+clean; 14 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 5.2 MiB/s wr, 611 op/s 2023-09-23T09:37:35.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:37:35 smithi161 ceph-mon[99580]: pgmap v1291: 97 pgs: 97 active+clean; 14 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 5.2 MiB/s wr, 611 op/s 2023-09-23T09:37:35.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 625.0 s, 151.4 tps, lat 345.314 ms stddev 290.798 2023-09-23T09:37:37.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:37:37 smithi135 ceph-mon[99205]: pgmap v1292: 97 pgs: 97 active+clean; 14 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 3.3 MiB/s rd, 7.3 MiB/s wr, 875 op/s 2023-09-23T09:37:37.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:37:37 smithi082 ceph-mon[97694]: pgmap v1292: 97 pgs: 97 active+clean; 14 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 3.3 MiB/s rd, 7.3 MiB/s wr, 875 op/s 2023-09-23T09:37:37.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:37:37 smithi161 ceph-mon[99580]: pgmap v1292: 97 pgs: 97 active+clean; 14 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 3.3 MiB/s rd, 7.3 MiB/s wr, 875 op/s 2023-09-23T09:37:38.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:37:38 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:37:38.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:37:38 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:37:38.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:37:38 smithi135 ceph-mon[99205]: pgmap v1293: 97 pgs: 97 active+clean; 14 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.5 MiB/s wr, 555 op/s 2023-09-23T09:37:38.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:37:38 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:37:38.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:37:38 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:37:38.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:37:38 smithi082 ceph-mon[97694]: pgmap v1293: 97 pgs: 97 active+clean; 14 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.5 MiB/s wr, 555 op/s 2023-09-23T09:37:38.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:37:38 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:37:38.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:37:38 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:37:38.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:37:38 smithi161 ceph-mon[99580]: pgmap v1293: 97 pgs: 97 active+clean; 14 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.5 MiB/s wr, 555 op/s 2023-09-23T09:37:39.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:37:39 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:37:39.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:37:39 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:37:39.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:37:39 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:37:39.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:37:39 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:37:39.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:37:39 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:37:39.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:37:39 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:37:39.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:37:39 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:37:39.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:37:39 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:37:39.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:37:39 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:37:40.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:37:40 smithi135 ceph-mon[99205]: pgmap v1294: 97 pgs: 97 active+clean; 14 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 3.1 MiB/s rd, 6.3 MiB/s wr, 805 op/s 2023-09-23T09:37:40.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:37:40 smithi082 ceph-mon[97694]: pgmap v1294: 97 pgs: 97 active+clean; 14 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 3.1 MiB/s rd, 6.3 MiB/s wr, 805 op/s 2023-09-23T09:37:40.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:37:40 smithi161 ceph-mon[99580]: pgmap v1294: 97 pgs: 97 active+clean; 14 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 3.1 MiB/s rd, 6.3 MiB/s wr, 805 op/s 2023-09-23T09:37:40.827 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 630.0 s, 168.4 tps, lat 307.864 ms stddev 267.973 2023-09-23T09:37:43.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:37:43 smithi135 ceph-mon[99205]: pgmap v1295: 97 pgs: 97 active+clean; 14 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.6 MiB/s wr, 591 op/s 2023-09-23T09:37:43.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:37:43 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:37:43.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:37:43 smithi082 ceph-mon[97694]: pgmap v1295: 97 pgs: 97 active+clean; 14 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.6 MiB/s wr, 591 op/s 2023-09-23T09:37:43.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:37:43 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:37:43.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:37:43 smithi161 ceph-mon[99580]: pgmap v1295: 97 pgs: 97 active+clean; 14 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.6 MiB/s wr, 591 op/s 2023-09-23T09:37:43.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:37:43 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:37:45.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:37:45 smithi135 ceph-mon[99205]: pgmap v1296: 97 pgs: 97 active+clean; 14 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.5 MiB/s wr, 559 op/s 2023-09-23T09:37:45.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:37:45 smithi082 ceph-mon[97694]: pgmap v1296: 97 pgs: 97 active+clean; 14 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.5 MiB/s wr, 559 op/s 2023-09-23T09:37:45.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:37:45 smithi161 ceph-mon[99580]: pgmap v1296: 97 pgs: 97 active+clean; 14 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.5 MiB/s wr, 559 op/s 2023-09-23T09:37:45.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 635.0 s, 218.0 tps, lat 2842.861 ms stddev 11785.723 2023-09-23T09:37:47.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:37:47 smithi135 ceph-mon[99205]: pgmap v1297: 97 pgs: 97 active+clean; 14 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 3.5 MiB/s rd, 7.2 MiB/s wr, 898 op/s 2023-09-23T09:37:47.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:37:47 smithi082 ceph-mon[97694]: pgmap v1297: 97 pgs: 97 active+clean; 14 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 3.5 MiB/s rd, 7.2 MiB/s wr, 898 op/s 2023-09-23T09:37:47.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:37:47 smithi161 ceph-mon[99580]: pgmap v1297: 97 pgs: 97 active+clean; 14 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 3.5 MiB/s rd, 7.2 MiB/s wr, 898 op/s 2023-09-23T09:37:49.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:37:49 smithi135 ceph-mon[99205]: pgmap v1298: 97 pgs: 97 active+clean; 14 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.0 MiB/s wr, 634 op/s 2023-09-23T09:37:49.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:37:49 smithi082 ceph-mon[97694]: pgmap v1298: 97 pgs: 97 active+clean; 14 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.0 MiB/s wr, 634 op/s 2023-09-23T09:37:49.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:37:49 smithi161 ceph-mon[99580]: pgmap v1298: 97 pgs: 97 active+clean; 14 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.0 MiB/s wr, 634 op/s 2023-09-23T09:37:50.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 640.0 s, 190.8 tps, lat 517.780 ms stddev 495.795 2023-09-23T09:37:51.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:37:51 smithi135 ceph-mon[99205]: pgmap v1299: 97 pgs: 97 active+clean; 14 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 3.6 MiB/s rd, 7.0 MiB/s wr, 878 op/s 2023-09-23T09:37:51.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:37:51 smithi082 ceph-mon[97694]: pgmap v1299: 97 pgs: 97 active+clean; 14 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 3.6 MiB/s rd, 7.0 MiB/s wr, 878 op/s 2023-09-23T09:37:51.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:37:51 smithi161 ceph-mon[99580]: pgmap v1299: 97 pgs: 97 active+clean; 14 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 3.6 MiB/s rd, 7.0 MiB/s wr, 878 op/s 2023-09-23T09:37:53.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:37:53 smithi135 ceph-mon[99205]: pgmap v1300: 97 pgs: 97 active+clean; 14 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.4 MiB/s wr, 662 op/s 2023-09-23T09:37:53.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:37:53 smithi082 ceph-mon[97694]: pgmap v1300: 97 pgs: 97 active+clean; 14 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.4 MiB/s wr, 662 op/s 2023-09-23T09:37:53.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:37:53 smithi161 ceph-mon[99580]: pgmap v1300: 97 pgs: 97 active+clean; 14 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.4 MiB/s wr, 662 op/s 2023-09-23T09:37:55.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:37:55 smithi135 ceph-mon[99205]: pgmap v1301: 97 pgs: 97 active+clean; 14 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.8 MiB/s wr, 616 op/s 2023-09-23T09:37:55.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:37:55 smithi082 ceph-mon[97694]: pgmap v1301: 97 pgs: 97 active+clean; 14 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.8 MiB/s wr, 616 op/s 2023-09-23T09:37:55.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:37:55 smithi161 ceph-mon[99580]: pgmap v1301: 97 pgs: 97 active+clean; 14 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.8 MiB/s wr, 616 op/s 2023-09-23T09:37:55.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 645.0 s, 197.6 tps, lat 513.230 ms stddev 504.719 2023-09-23T09:37:57.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:37:57 smithi135 ceph-mon[99205]: pgmap v1302: 97 pgs: 97 active+clean; 14 GiB data, 58 GiB used, 1014 GiB / 1.0 TiB avail; 3.8 MiB/s rd, 7.4 MiB/s wr, 923 op/s 2023-09-23T09:37:57.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:37:57 smithi082 ceph-mon[97694]: pgmap v1302: 97 pgs: 97 active+clean; 14 GiB data, 58 GiB used, 1014 GiB / 1.0 TiB avail; 3.8 MiB/s rd, 7.4 MiB/s wr, 923 op/s 2023-09-23T09:37:57.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:37:57 smithi161 ceph-mon[99580]: pgmap v1302: 97 pgs: 97 active+clean; 14 GiB data, 58 GiB used, 1014 GiB / 1.0 TiB avail; 3.8 MiB/s rd, 7.4 MiB/s wr, 923 op/s 2023-09-23T09:37:58.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:37:58 smithi082 ceph-mon[97694]: pgmap v1303: 97 pgs: 97 active+clean; 14 GiB data, 58 GiB used, 1014 GiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.7 MiB/s wr, 584 op/s 2023-09-23T09:37:58.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:37:58 smithi161 ceph-mon[99580]: pgmap v1303: 97 pgs: 97 active+clean; 14 GiB data, 58 GiB used, 1014 GiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.7 MiB/s wr, 584 op/s 2023-09-23T09:37:58.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:37:58 smithi135 ceph-mon[99205]: pgmap v1303: 97 pgs: 97 active+clean; 14 GiB data, 58 GiB used, 1014 GiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.7 MiB/s wr, 584 op/s 2023-09-23T09:38:00.777 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:38:00.840 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 650.0 s, 176.9 tps, lat 535.262 ms stddev 502.803 2023-09-23T09:38:01.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.278+0000 7fa9b659d700 1 -- 172.21.15.82:0/1998941080 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9b0108900 msgr2=0x7fa9b0108ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:38:01.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.278+0000 7fa9b659d700 1 --2- 172.21.15.82:0/1998941080 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9b0108900 0x7fa9b0108ce0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fa9a800b0a0 tx=0x7fa9a800b3b0 comp rx=0 tx=0).stop 2023-09-23T09:38:01.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.278+0000 7fa9b659d700 1 -- 172.21.15.82:0/1998941080 shutdown_connections 2023-09-23T09:38:01.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.278+0000 7fa9b659d700 1 --2- 172.21.15.82:0/1998941080 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa9b01032b0 0x7fa9b010f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:38:01.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.278+0000 7fa9b659d700 1 --2- 172.21.15.82:0/1998941080 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9b0108900 0x7fa9b0108ce0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:38:01.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.278+0000 7fa9b659d700 1 --2- 172.21.15.82:0/1998941080 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9b01028f0 0x7fa9b0102d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:38:01.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.278+0000 7fa9b659d700 1 -- 172.21.15.82:0/1998941080 >> 172.21.15.82:0/1998941080 conn(0x7fa9b00fe3c0 msgr2=0x7fa9b01007e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:38:01.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.279+0000 7fa9b659d700 1 -- 172.21.15.82:0/1998941080 shutdown_connections 2023-09-23T09:38:01.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.279+0000 7fa9b659d700 1 -- 172.21.15.82:0/1998941080 wait complete. 2023-09-23T09:38:01.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.280+0000 7fa9b659d700 1 Processor -- start 2023-09-23T09:38:01.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.281+0000 7fa9b659d700 1 -- start start 2023-09-23T09:38:01.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.281+0000 7fa9b659d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9b01028f0 0x7fa9b010f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:38:01.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.281+0000 7fa9b659d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9b01032b0 0x7fa9b010f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:38:01.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.281+0000 7fa9b659d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa9b0108900 0x7fa9b010c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:38:01.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.281+0000 7fa9b659d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b010cc60 con 0x7fa9b01028f0 2023-09-23T09:38:01.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.281+0000 7fa9b659d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b010cda0 con 0x7fa9b01032b0 2023-09-23T09:38:01.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.281+0000 7fa9b659d700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b010cf60 con 0x7fa9b0108900 2023-09-23T09:38:01.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.281+0000 7fa9b559b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9b01028f0 0x7fa9b010f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:38:01.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.281+0000 7fa9b559b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9b01028f0 0x7fa9b010f200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49634/0 (socket says 172.21.15.82:49634) 2023-09-23T09:38:01.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.281+0000 7fa9b559b700 1 -- 172.21.15.82:0/2724417497 learned_addr learned my addr 172.21.15.82:0/2724417497 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:38:01.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.281+0000 7fa9b5d9c700 1 --2- 172.21.15.82:0/2724417497 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa9b0108900 0x7fa9b010c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:38:01.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.282+0000 7fa9b559b700 1 -- 172.21.15.82:0/2724417497 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa9b0108900 msgr2=0x7fa9b010c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:38:01.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.282+0000 7fa9b4d9a700 1 --2- 172.21.15.82:0/2724417497 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9b01032b0 0x7fa9b010f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:38:01.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.282+0000 7fa9b559b700 1 --2- 172.21.15.82:0/2724417497 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa9b0108900 0x7fa9b010c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:38:01.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.282+0000 7fa9b559b700 1 -- 172.21.15.82:0/2724417497 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9b01032b0 msgr2=0x7fa9b010f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:38:01.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.282+0000 7fa9b559b700 1 --2- 172.21.15.82:0/2724417497 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9b01032b0 0x7fa9b010f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:38:01.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.282+0000 7fa9b559b700 1 -- 172.21.15.82:0/2724417497 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9a8009d00 con 0x7fa9b01028f0 2023-09-23T09:38:01.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.282+0000 7fa9b5d9c700 1 --2- 172.21.15.82:0/2724417497 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa9b0108900 0x7fa9b010c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:38:01.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.282+0000 7fa9b4d9a700 1 --2- 172.21.15.82:0/2724417497 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9b01032b0 0x7fa9b010f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T09:38:01.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.283+0000 7fa9b559b700 1 --2- 172.21.15.82:0/2724417497 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9b01028f0 0x7fa9b010f200 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fa9a8006070 tx=0x7fa9a80126a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:38:01.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.283+0000 7fa9ae7fc700 1 -- 172.21.15.82:0/2724417497 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a800e040 con 0x7fa9b01028f0 2023-09-23T09:38:01.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.283+0000 7fa9ae7fc700 1 -- 172.21.15.82:0/2724417497 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa9a8003e10 con 0x7fa9b01028f0 2023-09-23T09:38:01.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.283+0000 7fa9ae7fc700 1 -- 172.21.15.82:0/2724417497 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a8005700 con 0x7fa9b01028f0 2023-09-23T09:38:01.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.283+0000 7fa9b659d700 1 -- 172.21.15.82:0/2724417497 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9b019ed80 con 0x7fa9b01028f0 2023-09-23T09:38:01.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.283+0000 7fa9b659d700 1 -- 172.21.15.82:0/2724417497 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9b019f240 con 0x7fa9b01028f0 2023-09-23T09:38:01.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.290+0000 7fa9ae7fc700 1 -- 172.21.15.82:0/2724417497 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7fa9a8005860 con 0x7fa9b01028f0 2023-09-23T09:38:01.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.290+0000 7fa9cb1f9b80 1 Processor -- start 2023-09-23T09:38:01.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.290+0000 7fa9cb1f9b80 1 -- start start 2023-09-23T09:38:01.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.291+0000 7fa9cb1f9b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556489dfc500 0x556489dfc8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:38:01.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.291+0000 7fa9cb1f9b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556489dfce20 0x556489df6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:38:01.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.291+0000 7fa9cb1f9b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556489df6c40 0x556489df7080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:38:01.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.291+0000 7fa9cb1f9b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x556489d5e7b0 con 0x556489dfce20 2023-09-23T09:38:01.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.291+0000 7fa9cb1f9b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x556489d4f780 con 0x556489df6c40 2023-09-23T09:38:01.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.291+0000 7fa9cb1f9b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x556489d4d0a0 con 0x556489dfc500 2023-09-23T09:38:01.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.292+0000 7fa9b559b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556489dfce20 0x556489df6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:38:01.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.292+0000 7fa9b559b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556489dfce20 0x556489df6700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49648/0 (socket says 172.21.15.82:49648) 2023-09-23T09:38:01.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.292+0000 7fa9b559b700 1 -- 172.21.15.82:0/1575391576 learned_addr learned my addr 172.21.15.82:0/1575391576 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:38:01.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.292+0000 7fa9b4d9a700 1 --2- 172.21.15.82:0/1575391576 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556489df6c40 0x556489df7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:38:01.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.293+0000 7fa9ae7fc700 1 --2- 172.21.15.82:0/2724417497 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fa99c0a0340 0x7fa99c0a2800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:38:01.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.293+0000 7fa9ae7fc700 1 -- 172.21.15.82:0/2724417497 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fa9a80cc840 con 0x7fa9b01028f0 2023-09-23T09:38:01.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.293+0000 7fa9b559b700 1 -- 172.21.15.82:0/1575391576 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556489dfc500 msgr2=0x556489dfc8e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-23T09:38:01.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.293+0000 7fa9b559b700 1 --2- 172.21.15.82:0/1575391576 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556489dfc500 0x556489dfc8e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:38:01.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.293+0000 7fa9b559b700 1 -- 172.21.15.82:0/1575391576 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556489df6c40 msgr2=0x556489df7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:38:01.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.293+0000 7fa9b559b700 1 --2- 172.21.15.82:0/1575391576 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556489df6c40 0x556489df7080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:38:01.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.293+0000 7fa9b559b700 1 -- 172.21.15.82:0/1575391576 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556489bc8630 con 0x556489dfce20 2023-09-23T09:38:01.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.294+0000 7fa9b559b700 1 --2- 172.21.15.82:0/1575391576 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556489dfce20 0x556489df6700 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fa9a80c9e70 tx=0x7fa9a80099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8c2ea3606340fe8 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:38:01.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.294+0000 7fa9b5d9c700 1 --2- 172.21.15.82:0/2724417497 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fa99c0a0340 0x7fa99c0a2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:38:01.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.294+0000 7fa9a77fe700 1 -- 172.21.15.82:0/1575391576 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a80962c0 con 0x556489dfce20 2023-09-23T09:38:01.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.295+0000 7fa9a77fe700 1 -- 172.21.15.82:0/1575391576 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa9a8099d50 con 0x556489dfce20 2023-09-23T09:38:01.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.295+0000 7fa9a77fe700 1 -- 172.21.15.82:0/1575391576 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a809ddb0 con 0x556489dfce20 2023-09-23T09:38:01.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.295+0000 7fa9cb1f9b80 1 -- 172.21.15.82:0/1575391576 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556489dfce20 msgr2=0x556489df6700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:38:01.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.296+0000 7fa9cb1f9b80 1 --2- 172.21.15.82:0/1575391576 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556489dfce20 0x556489df6700 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fa9a80c9e70 tx=0x7fa9a80099e0 comp rx=0 tx=0).stop 2023-09-23T09:38:01.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.296+0000 7fa9b5d9c700 1 --2- 172.21.15.82:0/2724417497 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fa99c0a0340 0x7fa99c0a2800 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa998005950 tx=0x7fa99800b390 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:38:01.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.296+0000 7fa9cb1f9b80 1 -- 172.21.15.82:0/1575391576 shutdown_connections 2023-09-23T09:38:01.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.296+0000 7fa9cb1f9b80 1 --2- 172.21.15.82:0/1575391576 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556489df6c40 0x556489df7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:38:01.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.296+0000 7fa9cb1f9b80 1 --2- 172.21.15.82:0/1575391576 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556489dfc500 0x556489dfc8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:38:01.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.296+0000 7fa9cb1f9b80 1 --2- 172.21.15.82:0/1575391576 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556489dfce20 0x556489df6700 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:38:01.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.296+0000 7fa9cb1f9b80 1 -- 172.21.15.82:0/1575391576 >> 172.21.15.82:0/1575391576 conn(0x556489d6b0e0 msgr2=0x556489df1940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:38:01.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.296+0000 7fa9cb1f9b80 1 -- 172.21.15.82:0/1575391576 shutdown_connections 2023-09-23T09:38:01.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.296+0000 7fa9cb1f9b80 1 -- 172.21.15.82:0/1575391576 wait complete. 2023-09-23T09:38:01.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.297+0000 7fa9cb1f9b80 1 -- start start 2023-09-23T09:38:01.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.297+0000 7fa9cb1f9b80 1 Processor -- start 2023-09-23T09:38:01.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.298+0000 7fa9cb1f9b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556489df6c40 0x556489e00130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:38:01.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.298+0000 7fa9cb1f9b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556489dfc500 0x556489e00670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:38:01.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.298+0000 7fa9cb1f9b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556489dfce20 0x556489e00bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:38:01.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.298+0000 7fa9cb1f9b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x556489d48990 con 0x556489dfce20 2023-09-23T09:38:01.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.298+0000 7fa9cb1f9b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x556489ce6bb0 con 0x556489dfc500 2023-09-23T09:38:01.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.298+0000 7fa9cb1f9b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x556489ce68b0 con 0x556489df6c40 2023-09-23T09:38:01.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.298+0000 7fa9cb1f9b80 10 client.0 _ll_register_callbacks cb 0x556489c30a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:38:01.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.299+0000 7fa9b559b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556489df6c40 0x556489e00130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:38:01.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.299+0000 7fa9b559b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556489df6c40 0x556489e00130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:54908/0 (socket says 172.21.15.82:54908) 2023-09-23T09:38:01.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.299+0000 7fa9b559b700 1 -- 172.21.15.82:0/1692961576 learned_addr learned my addr 172.21.15.82:0/1692961576 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:38:01.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.299+0000 7fa9b5d9c700 1 --2- 172.21.15.82:0/1692961576 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556489dfce20 0x556489e00bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:38:01.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.299+0000 7fa9b4d9a700 1 --2- 172.21.15.82:0/1692961576 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556489dfc500 0x556489e00670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:38:01.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.299+0000 7fa9b559b700 1 -- 172.21.15.82:0/1692961576 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556489dfc500 msgr2=0x556489e00670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:38:01.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.299+0000 7fa9b559b700 1 --2- 172.21.15.82:0/1692961576 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556489dfc500 0x556489e00670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:38:01.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.299+0000 7fa9b559b700 1 -- 172.21.15.82:0/1692961576 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556489dfce20 msgr2=0x556489e00bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:38:01.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.299+0000 7fa9b559b700 1 --2- 172.21.15.82:0/1692961576 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556489dfce20 0x556489e00bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:38:01.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.299+0000 7fa9b559b700 1 -- 172.21.15.82:0/1692961576 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9b019f240 con 0x556489df6c40 2023-09-23T09:38:01.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.300+0000 7fa9b559b700 1 --2- 172.21.15.82:0/1692961576 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556489df6c40 0x556489e00130 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa9a80095d0 tx=0x7fa9a809a410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e0c0e1f3ab84f35 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:38:01.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.300+0000 7fa9a4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T09:38:01.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.300+0000 7fa9a4ff9700 1 -- 172.21.15.82:0/1692961576 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a80962c0 con 0x556489df6c40 2023-09-23T09:38:01.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.300+0000 7fa9a4ff9700 1 -- 172.21.15.82:0/1692961576 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(157..157 src has 1..157) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fa9a809a680 con 0x556489df6c40 2023-09-23T09:38:01.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.300+0000 7fa9cb1f9b80 1 -- 172.21.15.82:0/1692961576 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556489dc61c0 con 0x556489df6c40 2023-09-23T09:38:01.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.300+0000 7fa9a4ff9700 1 -- 172.21.15.82:0/1692961576 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=129) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa9a8099ac0 con 0x556489df6c40 2023-09-23T09:38:01.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.300+0000 7fa9cb1f9b80 10 client.27856 fetch_fsmap learned FSMap version 129 2023-09-23T09:38:01.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.300+0000 7fa9cb1f9b80 1 -- 172.21.15.82:0/1692961576 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=129,monmap=4+}) v3 -- 0x556489b74de0 con 0x556489df6c40 2023-09-23T09:38:01.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.300+0000 7fa9a4ff9700 1 -- 172.21.15.82:0/1692961576 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x556489dc61c0 con 0x556489df6c40 2023-09-23T09:38:01.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.301+0000 7fa9a4ff9700 1 -- 172.21.15.82:0/1692961576 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 129) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fa9a80a1870 con 0x556489df6c40 2023-09-23T09:38:01.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.301+0000 7fa9cb1f9b80 10 client.27856 fetch_fsmap finished waiting for FSMap version 129 2023-09-23T09:38:01.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.301+0000 7fa9cb1f9b80 10 client.27856 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:38:01.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.301+0000 7fa9cb1f9b80 20 client.27856 populate_metadata read hostname 'smithi082' 2023-09-23T09:38:01.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.301+0000 7fa9cb1f9b80 1 --2- 172.21.15.82:0/1692961576 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x556489e102d0 0x556489e126f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:38:01.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.301+0000 7fa9cb1f9b80 4 client.27856 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:38:01.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.301+0000 7fa9cb1f9b80 1 -- 172.21.15.82:0/1692961576 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556489ceeba0 con 0x556489e102d0 2023-09-23T09:38:01.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.301+0000 7fa9b4d9a700 1 --2- 172.21.15.82:0/1692961576 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x556489e102d0 0x556489e126f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:38:01.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.302+0000 7fa9b4d9a700 1 --2- 172.21.15.82:0/1692961576 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x556489e102d0 0x556489e126f0 crc :-1 s=READY pgs=261 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=18b019d8c021deb4 server_cookie=388b2a7f8efa44a7 in_seq=0 out_seq=0 2023-09-23T09:38:01.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.302+0000 7fa9a4ff9700 10 client.27856 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:38:01.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.303+0000 7fa9a4ff9700 1 -- 172.21.15.82:0/1692961576 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x556489ceeba0 con 0x556489e102d0 2023-09-23T09:38:01.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.303+0000 7fa9a4ff9700 10 client.27856 handle_command_reply: tid=0 2023-09-23T09:38:01.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.303+0000 7fa9cb1f9b80 1 client.27856 shutdown 2023-09-23T09:38:01.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.304+0000 7fa9cb1f9b80 1 -- 172.21.15.82:0/1692961576 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556489df6c40 msgr2=0x556489e00130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:38:01.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.304+0000 7fa9cb1f9b80 1 --2- 172.21.15.82:0/1692961576 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556489df6c40 0x556489e00130 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa9a80095d0 tx=0x7fa9a809a410 comp rx=0 tx=0).stop 2023-09-23T09:38:01.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.304+0000 7fa9cb1f9b80 1 -- 172.21.15.82:0/1692961576 shutdown_connections 2023-09-23T09:38:01.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.304+0000 7fa9cb1f9b80 1 --2- 172.21.15.82:0/1692961576 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x556489e102d0 0x556489e126f0 crc :-1 s=READY pgs=261 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:38:01.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.304+0000 7fa9cb1f9b80 1 --2- 172.21.15.82:0/1692961576 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556489dfce20 0x556489e00bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:38:01.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.304+0000 7fa9cb1f9b80 1 --2- 172.21.15.82:0/1692961576 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556489df6c40 0x556489e00130 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:38:01.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.304+0000 7fa9cb1f9b80 1 --2- 172.21.15.82:0/1692961576 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556489dfc500 0x556489e00670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:38:01.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.304+0000 7fa9cb1f9b80 1 -- 172.21.15.82:0/1692961576 >> 172.21.15.82:0/1692961576 conn(0x556489d6b0e0 msgr2=0x556489df14d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:38:01.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.304+0000 7fa9a4ff9700 0 client.27856 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:38:01.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.304+0000 7fa9cb1f9b80 1 -- 172.21.15.82:0/1692961576 shutdown_connections 2023-09-23T09:38:01.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.304+0000 7fa9cb1f9b80 1 -- 172.21.15.82:0/1692961576 wait complete. 2023-09-23T09:38:01.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.304+0000 7fa9cb1f9b80 20 client.27856 trim_cache size 0 max 16384 2023-09-23T09:38:01.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:38:00 smithi135 ceph-mon[99205]: pgmap v1304: 97 pgs: 97 active+clean; 14 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 3.5 MiB/s rd, 6.5 MiB/s wr, 838 op/s 2023-09-23T09:38:01.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.334+0000 7fa9cb1f9b80 1 Processor -- start 2023-09-23T09:38:01.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.334+0000 7fa9cb1f9b80 1 -- start start 2023-09-23T09:38:01.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.335+0000 7fa9cb1f9b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556489df6c40 0x556489df6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:38:01.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.335+0000 7fa9cb1f9b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556489dfc500 0x556489e07760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:38:01.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.335+0000 7fa9cb1f9b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556489dfce20 0x556489dfa290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:38:01.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.335+0000 7fa9cb1f9b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x556489bca920 con 0x556489dfc500 2023-09-23T09:38:01.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.335+0000 7fa9cb1f9b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x556489ded880 con 0x556489df6c40 2023-09-23T09:38:01.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.335+0000 7fa9cb1f9b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x556489df7720 con 0x556489dfce20 2023-09-23T09:38:01.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.335+0000 7fa9b5d9c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556489dfce20 0x556489dfa290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:38:01.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.335+0000 7fa9b5d9c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556489dfce20 0x556489dfa290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:54924/0 (socket says 172.21.15.82:54924) 2023-09-23T09:38:01.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.335+0000 7fa9b5d9c700 1 -- 172.21.15.82:0/3637555437 learned_addr learned my addr 172.21.15.82:0/3637555437 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:38:01.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.335+0000 7fa9b559b700 1 --2- 172.21.15.82:0/3637555437 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556489df6c40 0x556489df6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:38:01.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.336+0000 7fa9b5d9c700 1 -- 172.21.15.82:0/3637555437 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556489df6c40 msgr2=0x556489df6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:38:01.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.336+0000 7fa9b5d9c700 1 --2- 172.21.15.82:0/3637555437 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556489df6c40 0x556489df6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:38:01.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.336+0000 7fa9b5d9c700 1 -- 172.21.15.82:0/3637555437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556489dfc500 msgr2=0x556489e07760 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-23T09:38:01.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.336+0000 7fa9b5d9c700 1 --2- 172.21.15.82:0/3637555437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556489dfc500 0x556489e07760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:38:01.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.336+0000 7fa9b5d9c700 1 -- 172.21.15.82:0/3637555437 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556489b5dc60 con 0x556489dfce20 2023-09-23T09:38:01.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.336+0000 7fa9b5d9c700 1 --2- 172.21.15.82:0/3637555437 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556489dfce20 0x556489dfa290 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fa998003fd0 tx=0x7fa998013000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1f65fe2644c58f server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:38:01.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.337+0000 7fa9a7fff700 1 -- 172.21.15.82:0/3637555437 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa998011be0 con 0x556489dfce20 2023-09-23T09:38:01.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.337+0000 7fa9a7fff700 1 -- 172.21.15.82:0/3637555437 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa998015070 con 0x556489dfce20 2023-09-23T09:38:01.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.337+0000 7fa9a7fff700 1 -- 172.21.15.82:0/3637555437 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa998041440 con 0x556489dfce20 2023-09-23T09:38:01.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.337+0000 7fa9cb1f9b80 1 -- 172.21.15.82:0/3637555437 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556489dfce20 msgr2=0x556489dfa290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:38:01.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.337+0000 7fa9cb1f9b80 1 --2- 172.21.15.82:0/3637555437 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556489dfce20 0x556489dfa290 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fa998003fd0 tx=0x7fa998013000 comp rx=0 tx=0).stop 2023-09-23T09:38:01.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.338+0000 7fa9cb1f9b80 1 -- 172.21.15.82:0/3637555437 shutdown_connections 2023-09-23T09:38:01.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.338+0000 7fa9cb1f9b80 1 --2- 172.21.15.82:0/3637555437 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556489dfce20 0x556489dfa290 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:38:01.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.338+0000 7fa9cb1f9b80 1 --2- 172.21.15.82:0/3637555437 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556489df6c40 0x556489df6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:38:01.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.338+0000 7fa9cb1f9b80 1 --2- 172.21.15.82:0/3637555437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556489dfc500 0x556489e07760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:38:01.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.338+0000 7fa9cb1f9b80 1 -- 172.21.15.82:0/3637555437 >> 172.21.15.82:0/3637555437 conn(0x556489d6b0e0 msgr2=0x556489e0beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:38:01.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.338+0000 7fa9cb1f9b80 1 -- 172.21.15.82:0/3637555437 shutdown_connections 2023-09-23T09:38:01.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.338+0000 7fa9cb1f9b80 1 -- 172.21.15.82:0/3637555437 wait complete. 2023-09-23T09:38:01.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.338+0000 7fa9cb1f9b80 1 -- start start 2023-09-23T09:38:01.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.339+0000 7fa9cb1f9b80 1 Processor -- start 2023-09-23T09:38:01.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.339+0000 7fa9cb1f9b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556489df6c40 0x556489e5dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:38:01.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.339+0000 7fa9cb1f9b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556489dfc500 0x556489e5e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:38:01.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.339+0000 7fa9cb1f9b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556489dfce20 0x556489e58050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:38:01.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.339+0000 7fa9cb1f9b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x556489e58650 con 0x556489dfc500 2023-09-23T09:38:01.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.339+0000 7fa9cb1f9b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x556489e587c0 con 0x556489df6c40 2023-09-23T09:38:01.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.339+0000 7fa9cb1f9b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x556489e58980 con 0x556489dfce20 2023-09-23T09:38:01.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.340+0000 7fa9cb1f9b80 10 client.0 _ll_register_callbacks cb 0x556489c30a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:38:01.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.340+0000 7fa9b559b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556489df6c40 0x556489e5dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:38:01.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.340+0000 7fa9b559b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556489df6c40 0x556489e5dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:33858/0 (socket says 172.21.15.82:33858) 2023-09-23T09:38:01.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.340+0000 7fa9b4d9a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556489dfc500 0x556489e5e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:38:01.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.340+0000 7fa9b559b700 1 -- 172.21.15.82:0/4052290351 learned_addr learned my addr 172.21.15.82:0/4052290351 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:38:01.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.340+0000 7fa9b5d9c700 1 --2- 172.21.15.82:0/4052290351 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556489dfce20 0x556489e58050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:38:01.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.340+0000 7fa9b559b700 1 -- 172.21.15.82:0/4052290351 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556489dfce20 msgr2=0x556489e58050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:38:01.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.340+0000 7fa9b559b700 1 --2- 172.21.15.82:0/4052290351 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556489dfce20 0x556489e58050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:38:01.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.340+0000 7fa9b559b700 1 -- 172.21.15.82:0/4052290351 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556489dfc500 msgr2=0x556489e5e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:38:01.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.340+0000 7fa9b559b700 1 --2- 172.21.15.82:0/4052290351 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556489dfc500 0x556489e5e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:38:01.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.340+0000 7fa9b559b700 1 -- 172.21.15.82:0/4052290351 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa998003c80 con 0x556489df6c40 2023-09-23T09:38:01.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.340+0000 7fa9b4d9a700 1 --2- 172.21.15.82:0/4052290351 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556489dfc500 0x556489e5e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:38:01.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.341+0000 7fa9b559b700 1 --2- 172.21.15.82:0/4052290351 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556489df6c40 0x556489e5dbd0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fa9a8096480 tx=0x7fa9a8005b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f75daa5f6f45edfa server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:38:01.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.341+0000 7fa9a4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-09-23T09:38:01.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.341+0000 7fa9a4ff9700 1 -- 172.21.15.82:0/4052290351 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a80962c0 con 0x556489df6c40 2023-09-23T09:38:01.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.341+0000 7fa9cb1f9b80 1 -- 172.21.15.82:0/4052290351 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556489de98b0 con 0x556489df6c40 2023-09-23T09:38:01.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.341+0000 7fa9a4ff9700 1 -- 172.21.15.82:0/4052290351 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(157..157 src has 1..157) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fa9a809a680 con 0x556489df6c40 2023-09-23T09:38:01.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.341+0000 7fa9a4ff9700 1 -- 172.21.15.82:0/4052290351 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=129) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa9a8099ac0 con 0x556489df6c40 2023-09-23T09:38:01.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.341+0000 7fa9cb1f9b80 10 client.27830 fetch_fsmap learned FSMap version 129 2023-09-23T09:38:01.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.341+0000 7fa9cb1f9b80 1 -- 172.21.15.82:0/4052290351 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=129,monmap=4+}) v3 -- 0x556489b9b250 con 0x556489df6c40 2023-09-23T09:38:01.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.342+0000 7fa9a4ff9700 1 -- 172.21.15.82:0/4052290351 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x556489de98b0 con 0x556489df6c40 2023-09-23T09:38:01.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.342+0000 7fa9a4ff9700 1 -- 172.21.15.82:0/4052290351 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 129) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fa9a80ccd20 con 0x556489df6c40 2023-09-23T09:38:01.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.342+0000 7fa9cb1f9b80 10 client.27830 fetch_fsmap finished waiting for FSMap version 129 2023-09-23T09:38:01.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.342+0000 7fa9cb1f9b80 10 client.27830 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:38:01.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.342+0000 7fa9cb1f9b80 20 client.27830 populate_metadata read hostname 'smithi082' 2023-09-23T09:38:01.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.342+0000 7fa9cb1f9b80 1 --2- 172.21.15.82:0/4052290351 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x556489e65560 0x556489e67950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:38:01.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.342+0000 7fa9cb1f9b80 4 client.27830 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:38:01.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.342+0000 7fa9cb1f9b80 1 -- 172.21.15.82:0/4052290351 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x556489d41970 con 0x556489e65560 2023-09-23T09:38:01.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.342+0000 7fa9b4d9a700 1 --2- 172.21.15.82:0/4052290351 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x556489e65560 0x556489e67950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:38:01.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.343+0000 7fa9a4ff9700 10 client.27830 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:38:01.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.343+0000 7fa9b4d9a700 1 --2- 172.21.15.82:0/4052290351 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x556489e65560 0x556489e67950 crc :-1 s=READY pgs=262 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea18410014498c42 server_cookie=6b1a601b74cf908e in_seq=0 out_seq=0 2023-09-23T09:38:01.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.343+0000 7fa9a4ff9700 1 -- 172.21.15.82:0/4052290351 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x556489d41970 con 0x556489e65560 2023-09-23T09:38:01.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.343+0000 7fa9a4ff9700 10 client.27830 handle_command_reply: tid=0 2023-09-23T09:38:01.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.343+0000 7fa9cb1f9b80 1 client.27830 shutdown 2023-09-23T09:38:01.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.344+0000 7fa9cb1f9b80 1 -- 172.21.15.82:0/4052290351 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556489df6c40 msgr2=0x556489e5dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:38:01.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.344+0000 7fa9cb1f9b80 1 --2- 172.21.15.82:0/4052290351 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556489df6c40 0x556489e5dbd0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fa9a8096480 tx=0x7fa9a8005b90 comp rx=0 tx=0).stop 2023-09-23T09:38:01.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.344+0000 7fa9cb1f9b80 1 -- 172.21.15.82:0/4052290351 shutdown_connections 2023-09-23T09:38:01.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.344+0000 7fa9cb1f9b80 1 --2- 172.21.15.82:0/4052290351 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556489dfce20 0x556489e58050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:38:01.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.344+0000 7fa9cb1f9b80 1 --2- 172.21.15.82:0/4052290351 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556489df6c40 0x556489e5dbd0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:38:01.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.344+0000 7fa9cb1f9b80 1 --2- 172.21.15.82:0/4052290351 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x556489e65560 0x556489e67950 crc :-1 s=READY pgs=262 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:38:01.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.344+0000 7fa9cb1f9b80 1 --2- 172.21.15.82:0/4052290351 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556489dfc500 0x556489e5e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:38:01.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.344+0000 7fa9cb1f9b80 1 -- 172.21.15.82:0/4052290351 >> 172.21.15.82:0/4052290351 conn(0x556489d6b0e0 msgr2=0x556489dfa290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:38:01.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.344+0000 7fa9a4ff9700 0 client.27830 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:38:01.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.344+0000 7fa9cb1f9b80 1 -- 172.21.15.82:0/4052290351 shutdown_connections 2023-09-23T09:38:01.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.344+0000 7fa9cb1f9b80 1 -- 172.21.15.82:0/4052290351 wait complete. 2023-09-23T09:38:01.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.344+0000 7fa9cb1f9b80 20 client.27830 trim_cache size 0 max 16384 2023-09-23T09:38:01.349 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:38:01.349 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-23T09:38:01.349 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:38:01.349 INFO:teuthology.orchestra.run.smithi082.stdout: "d9e62ab8-1468-4fb0-a9fe-61bed13e954b": { 2023-09-23T09:38:01.349 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:38:01.349 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "d9e62ab8-1468-4fb0-a9fe-61bed13e954b", 2023-09-23T09:38:01.349 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:38:01.349 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:38:01.350 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:38:01.350 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:38:01.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.345+0000 7fa9b659d700 1 -- 172.21.15.82:0/2724417497 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fa99c0a0340 msgr2=0x7fa99c0a2800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:38:01.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.345+0000 7fa9b659d700 1 --2- 172.21.15.82:0/2724417497 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fa99c0a0340 0x7fa99c0a2800 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa998005950 tx=0x7fa99800b390 comp rx=0 tx=0).stop 2023-09-23T09:38:01.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.345+0000 7fa9b659d700 1 -- 172.21.15.82:0/2724417497 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9b01028f0 msgr2=0x7fa9b010f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:38:01.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.345+0000 7fa9b659d700 1 --2- 172.21.15.82:0/2724417497 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9b01028f0 0x7fa9b010f200 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fa9a8006070 tx=0x7fa9a80126a0 comp rx=0 tx=0).stop 2023-09-23T09:38:01.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.345+0000 7fa9b659d700 1 -- 172.21.15.82:0/2724417497 shutdown_connections 2023-09-23T09:38:01.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.345+0000 7fa9b659d700 1 --2- 172.21.15.82:0/2724417497 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fa99c0a0340 0x7fa99c0a2800 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:38:01.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.345+0000 7fa9b659d700 1 --2- 172.21.15.82:0/2724417497 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa9b0108900 0x7fa9b010c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:38:01.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.345+0000 7fa9b659d700 1 --2- 172.21.15.82:0/2724417497 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9b01028f0 0x7fa9b010f200 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:38:01.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.345+0000 7fa9b659d700 1 --2- 172.21.15.82:0/2724417497 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9b01032b0 0x7fa9b010f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:38:01.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.345+0000 7fa9b659d700 1 -- 172.21.15.82:0/2724417497 >> 172.21.15.82:0/2724417497 conn(0x7fa9b00fe3c0 msgr2=0x7fa9b00fea20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:38:01.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.345+0000 7fa9b659d700 1 -- 172.21.15.82:0/2724417497 shutdown_connections 2023-09-23T09:38:01.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:01.345+0000 7fa9b659d700 1 -- 172.21.15.82:0/2724417497 wait complete. 2023-09-23T09:38:01.366 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:38:00 smithi082 ceph-mon[97694]: pgmap v1304: 97 pgs: 97 active+clean; 14 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 3.5 MiB/s rd, 6.5 MiB/s wr, 838 op/s 2023-09-23T09:38:01.368 INFO:tasks.cephfs.filesystem:scrub status for tag:d9e62ab8-1468-4fb0-a9fe-61bed13e954b - {'path': '/', 'tag': 'd9e62ab8-1468-4fb0-a9fe-61bed13e954b', 'options': 'recursive,force'} 2023-09-23T09:38:01.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:38:00 smithi161 ceph-mon[99580]: pgmap v1304: 97 pgs: 97 active+clean; 14 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 3.5 MiB/s rd, 6.5 MiB/s wr, 838 op/s 2023-09-23T09:38:03.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:38:03 smithi135 ceph-mon[99205]: pgmap v1305: 97 pgs: 97 active+clean; 14 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.0 MiB/s wr, 645 op/s 2023-09-23T09:38:03.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:38:03 smithi082 ceph-mon[97694]: pgmap v1305: 97 pgs: 97 active+clean; 14 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.0 MiB/s wr, 645 op/s 2023-09-23T09:38:03.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:38:03 smithi161 ceph-mon[99580]: pgmap v1305: 97 pgs: 97 active+clean; 14 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.0 MiB/s wr, 645 op/s 2023-09-23T09:38:05.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:38:05 smithi135 ceph-mon[99205]: pgmap v1306: 97 pgs: 97 active+clean; 14 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.9 MiB/s wr, 611 op/s 2023-09-23T09:38:05.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:38:05 smithi082 ceph-mon[97694]: pgmap v1306: 97 pgs: 97 active+clean; 14 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.9 MiB/s wr, 611 op/s 2023-09-23T09:38:05.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:38:05 smithi161 ceph-mon[99580]: pgmap v1306: 97 pgs: 97 active+clean; 14 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.9 MiB/s wr, 611 op/s 2023-09-23T09:38:05.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 655.0 s, 87.2 tps, lat 1116.442 ms stddev 1035.641 2023-09-23T09:38:07.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:38:07 smithi082 ceph-mon[97694]: pgmap v1307: 97 pgs: 97 active+clean; 14 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 3.1 MiB/s rd, 6.9 MiB/s wr, 878 op/s 2023-09-23T09:38:07.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:38:07 smithi082 ceph-mon[97694]: osdmap e158: 12 total, 12 up, 12 in 2023-09-23T09:38:07.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:38:07 smithi161 ceph-mon[99580]: pgmap v1307: 97 pgs: 97 active+clean; 14 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 3.1 MiB/s rd, 6.9 MiB/s wr, 878 op/s 2023-09-23T09:38:07.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:38:07 smithi161 ceph-mon[99580]: osdmap e158: 12 total, 12 up, 12 in 2023-09-23T09:38:07.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:38:07 smithi135 ceph-mon[99205]: pgmap v1307: 97 pgs: 97 active+clean; 14 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 3.1 MiB/s rd, 6.9 MiB/s wr, 878 op/s 2023-09-23T09:38:07.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:38:07 smithi135 ceph-mon[99205]: osdmap e158: 12 total, 12 up, 12 in 2023-09-23T09:38:08.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:38:08 smithi082 ceph-mon[97694]: pgmap v1309: 97 pgs: 97 active+clean; 14 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 5.2 MiB/s wr, 685 op/s 2023-09-23T09:38:08.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:38:08 smithi161 ceph-mon[99580]: pgmap v1309: 97 pgs: 97 active+clean; 14 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 5.2 MiB/s wr, 685 op/s 2023-09-23T09:38:08.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:38:08 smithi135 ceph-mon[99205]: pgmap v1309: 97 pgs: 97 active+clean; 14 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 5.2 MiB/s wr, 685 op/s 2023-09-23T09:38:10.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 660.0 s, 39.2 tps, lat 1838.984 ms stddev 1870.762 2023-09-23T09:38:11.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:38:10 smithi161 ceph-mon[99580]: pgmap v1310: 97 pgs: 10 active+clean+snaptrim, 20 active+clean+snaptrim_wait, 67 active+clean; 14 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.9 MiB/s wr, 472 op/s 2023-09-23T09:38:11.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:38:10 smithi135 ceph-mon[99205]: pgmap v1310: 97 pgs: 10 active+clean+snaptrim, 20 active+clean+snaptrim_wait, 67 active+clean; 14 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.9 MiB/s wr, 472 op/s 2023-09-23T09:38:11.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:38:10 smithi082 ceph-mon[97694]: pgmap v1310: 97 pgs: 10 active+clean+snaptrim, 20 active+clean+snaptrim_wait, 67 active+clean; 14 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.9 MiB/s wr, 472 op/s 2023-09-23T09:38:13.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:38:13 smithi135 ceph-mon[99205]: pgmap v1311: 97 pgs: 13 active+clean+snaptrim, 26 active+clean+snaptrim_wait, 58 active+clean; 14 GiB data, 58 GiB used, 1014 GiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.4 MiB/s wr, 430 op/s 2023-09-23T09:38:13.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:38:13 smithi082 ceph-mon[97694]: pgmap v1311: 97 pgs: 13 active+clean+snaptrim, 26 active+clean+snaptrim_wait, 58 active+clean; 14 GiB data, 58 GiB used, 1014 GiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.4 MiB/s wr, 430 op/s 2023-09-23T09:38:13.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:38:13 smithi161 ceph-mon[99580]: pgmap v1311: 97 pgs: 13 active+clean+snaptrim, 26 active+clean+snaptrim_wait, 58 active+clean; 14 GiB data, 58 GiB used, 1014 GiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.4 MiB/s wr, 430 op/s 2023-09-23T09:38:15.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:38:15 smithi135 ceph-mon[99205]: pgmap v1312: 97 pgs: 13 active+clean+snaptrim, 26 active+clean+snaptrim_wait, 58 active+clean; 14 GiB data, 58 GiB used, 1014 GiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.4 MiB/s wr, 430 op/s 2023-09-23T09:38:15.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:38:15 smithi082 ceph-mon[97694]: pgmap v1312: 97 pgs: 13 active+clean+snaptrim, 26 active+clean+snaptrim_wait, 58 active+clean; 14 GiB data, 58 GiB used, 1014 GiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.4 MiB/s wr, 430 op/s 2023-09-23T09:38:15.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:38:15 smithi161 ceph-mon[99580]: pgmap v1312: 97 pgs: 13 active+clean+snaptrim, 26 active+clean+snaptrim_wait, 58 active+clean; 14 GiB data, 58 GiB used, 1014 GiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.4 MiB/s wr, 430 op/s 2023-09-23T09:38:15.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 665.0 s, 129.8 tps, lat 1011.502 ms stddev 1198.183 2023-09-23T09:38:16.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:38:16 smithi082 ceph-mon[97694]: pgmap v1313: 97 pgs: 97 active+clean; 14 GiB data, 57 GiB used, 1015 GiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.7 MiB/s wr, 341 op/s 2023-09-23T09:38:16.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:38:16 smithi161 ceph-mon[99580]: pgmap v1313: 97 pgs: 97 active+clean; 14 GiB data, 57 GiB used, 1015 GiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.7 MiB/s wr, 341 op/s 2023-09-23T09:38:16.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:38:16 smithi135 ceph-mon[99205]: pgmap v1313: 97 pgs: 97 active+clean; 14 GiB data, 57 GiB used, 1015 GiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.7 MiB/s wr, 341 op/s 2023-09-23T09:38:18.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:38:18 smithi135 ceph-mon[99205]: osdmap e159: 12 total, 12 up, 12 in 2023-09-23T09:38:18.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:38:18 smithi082 ceph-mon[97694]: osdmap e159: 12 total, 12 up, 12 in 2023-09-23T09:38:18.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:38:18 smithi161 ceph-mon[99580]: osdmap e159: 12 total, 12 up, 12 in 2023-09-23T09:38:19.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:38:19 smithi135 ceph-mon[99205]: pgmap v1315: 97 pgs: 97 active+clean; 14 GiB data, 57 GiB used, 1015 GiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.7 MiB/s wr, 341 op/s 2023-09-23T09:38:19.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:38:19 smithi082 ceph-mon[97694]: pgmap v1315: 97 pgs: 97 active+clean; 14 GiB data, 57 GiB used, 1015 GiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.7 MiB/s wr, 341 op/s 2023-09-23T09:38:19.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:38:19 smithi161 ceph-mon[99580]: pgmap v1315: 97 pgs: 97 active+clean; 14 GiB data, 57 GiB used, 1015 GiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.7 MiB/s wr, 341 op/s 2023-09-23T09:38:20.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 670.0 s, 174.6 tps, lat 580.915 ms stddev 534.967 2023-09-23T09:38:21.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:38:21 smithi135 ceph-mon[99205]: pgmap v1316: 97 pgs: 97 active+clean; 14 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.9 MiB/s wr, 491 op/s 2023-09-23T09:38:21.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:38:21 smithi082 ceph-mon[97694]: pgmap v1316: 97 pgs: 97 active+clean; 14 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.9 MiB/s wr, 491 op/s 2023-09-23T09:38:21.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:38:21 smithi161 ceph-mon[99580]: pgmap v1316: 97 pgs: 97 active+clean; 14 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.9 MiB/s wr, 491 op/s 2023-09-23T09:38:23.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:38:23 smithi135 ceph-mon[99205]: pgmap v1317: 97 pgs: 97 active+clean; 14 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.1 MiB/s wr, 544 op/s 2023-09-23T09:38:23.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:38:23 smithi082 ceph-mon[97694]: pgmap v1317: 97 pgs: 97 active+clean; 14 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.1 MiB/s wr, 544 op/s 2023-09-23T09:38:23.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:38:23 smithi161 ceph-mon[99580]: pgmap v1317: 97 pgs: 97 active+clean; 14 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.1 MiB/s wr, 544 op/s 2023-09-23T09:38:25.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:38:25 smithi135 ceph-mon[99205]: pgmap v1318: 97 pgs: 97 active+clean; 14 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.1 MiB/s wr, 544 op/s 2023-09-23T09:38:25.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:38:25 smithi082 ceph-mon[97694]: pgmap v1318: 97 pgs: 97 active+clean; 14 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.1 MiB/s wr, 544 op/s 2023-09-23T09:38:25.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:38:25 smithi161 ceph-mon[99580]: pgmap v1318: 97 pgs: 97 active+clean; 14 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.1 MiB/s wr, 544 op/s 2023-09-23T09:38:25.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 675.0 s, 167.0 tps, lat 602.655 ms stddev 532.192 2023-09-23T09:38:26.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:38:26 smithi135 ceph-mon[99205]: pgmap v1319: 97 pgs: 97 active+clean; 14 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.3 MiB/s wr, 653 op/s 2023-09-23T09:38:26.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:38:26 smithi082 ceph-mon[97694]: pgmap v1319: 97 pgs: 97 active+clean; 14 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.3 MiB/s wr, 653 op/s 2023-09-23T09:38:26.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:38:26 smithi161 ceph-mon[99580]: pgmap v1319: 97 pgs: 97 active+clean; 14 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.3 MiB/s wr, 653 op/s 2023-09-23T09:38:29.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:38:29 smithi135 ceph-mon[99205]: pgmap v1320: 97 pgs: 97 active+clean; 14 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.0 MiB/s wr, 619 op/s 2023-09-23T09:38:29.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:38:29 smithi082 ceph-mon[97694]: pgmap v1320: 97 pgs: 97 active+clean; 14 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.0 MiB/s wr, 619 op/s 2023-09-23T09:38:29.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:38:29 smithi161 ceph-mon[99580]: pgmap v1320: 97 pgs: 97 active+clean; 14 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.0 MiB/s wr, 619 op/s 2023-09-23T09:38:30.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:38:30 smithi082 ceph-mon[97694]: pgmap v1321: 97 pgs: 97 active+clean; 14 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 3.1 MiB/s rd, 5.7 MiB/s wr, 740 op/s 2023-09-23T09:38:30.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:38:30 smithi161 ceph-mon[99580]: pgmap v1321: 97 pgs: 97 active+clean; 14 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 3.1 MiB/s rd, 5.7 MiB/s wr, 740 op/s 2023-09-23T09:38:30.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:38:30 smithi135 ceph-mon[99205]: pgmap v1321: 97 pgs: 97 active+clean; 14 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 3.1 MiB/s rd, 5.7 MiB/s wr, 740 op/s 2023-09-23T09:38:30.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 680.0 s, 149.0 tps, lat 667.283 ms stddev 608.395 2023-09-23T09:38:31.369 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:38:31.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.717+0000 7ff787dff700 1 -- 172.21.15.82:0/452199711 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff78011a100 msgr2=0x7ff78011c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:38:31.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.717+0000 7ff787dff700 1 --2- 172.21.15.82:0/452199711 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff78011a100 0x7ff78011c4f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7ff778009990 tx=0x7ff778009ca0 comp rx=0 tx=0).stop 2023-09-23T09:38:31.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.717+0000 7ff787dff700 1 -- 172.21.15.82:0/452199711 shutdown_connections 2023-09-23T09:38:31.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.717+0000 7ff787dff700 1 --2- 172.21.15.82:0/452199711 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff78011a100 0x7ff78011c4f0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:38:31.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.717+0000 7ff787dff700 1 --2- 172.21.15.82:0/452199711 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff78010efd0 0x7ff78010cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:38:31.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.717+0000 7ff787dff700 1 --2- 172.21.15.82:0/452199711 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff78010f440 0x7ff78010d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:38:31.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.717+0000 7ff787dff700 1 -- 172.21.15.82:0/452199711 >> 172.21.15.82:0/452199711 conn(0x7ff78006cbe0 msgr2=0x7ff78006cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:38:31.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.718+0000 7ff787dff700 1 -- 172.21.15.82:0/452199711 shutdown_connections 2023-09-23T09:38:31.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.718+0000 7ff787dff700 1 -- 172.21.15.82:0/452199711 wait complete. 2023-09-23T09:38:31.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.720+0000 7ff787dff700 1 Processor -- start 2023-09-23T09:38:31.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.720+0000 7ff787dff700 1 -- start start 2023-09-23T09:38:31.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.721+0000 7ff787dff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff78010efd0 0x7ff7801160a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:38:31.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.721+0000 7ff787dff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff78010f440 0x7ff7801165e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:38:31.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.721+0000 7ff787dff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff78011a100 0x7ff780111330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:38:31.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.721+0000 7ff787dff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff780111900 con 0x7ff78011a100 2023-09-23T09:38:31.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.721+0000 7ff787dff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff780111a70 con 0x7ff78010f440 2023-09-23T09:38:31.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.721+0000 7ff787dff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff780111c30 con 0x7ff78010efd0 2023-09-23T09:38:31.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.721+0000 7ff78539a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff78010f440 0x7ff7801165e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:38:31.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.721+0000 7ff78539a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff78010f440 0x7ff7801165e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:52524/0 (socket says 172.21.15.82:52524) 2023-09-23T09:38:31.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.721+0000 7ff78539a700 1 -- 172.21.15.82:0/266749949 learned_addr learned my addr 172.21.15.82:0/266749949 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:38:31.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.721+0000 7ff785b9b700 1 --2- 172.21.15.82:0/266749949 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff78010efd0 0x7ff7801160a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:38:31.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.722+0000 7ff78539a700 1 -- 172.21.15.82:0/266749949 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff78010efd0 msgr2=0x7ff7801160a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:38:31.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.722+0000 7ff78539a700 1 --2- 172.21.15.82:0/266749949 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff78010efd0 0x7ff7801160a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:38:31.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.723+0000 7ff78539a700 1 -- 172.21.15.82:0/266749949 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff78011a100 msgr2=0x7ff780111330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:38:31.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.723+0000 7ff78539a700 1 --2- 172.21.15.82:0/266749949 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff78011a100 0x7ff780111330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:38:31.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.723+0000 7ff78539a700 1 -- 172.21.15.82:0/266749949 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7780095f0 con 0x7ff78010f440 2023-09-23T09:38:31.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.723+0000 7ff78539a700 1 --2- 172.21.15.82:0/266749949 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff78010f440 0x7ff7801165e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7ff77000b530 tx=0x7ff77000b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:38:31.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.724+0000 7ff77effd700 1 -- 172.21.15.82:0/266749949 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff770011830 con 0x7ff78010f440 2023-09-23T09:38:31.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.724+0000 7ff77effd700 1 -- 172.21.15.82:0/266749949 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff770011e20 con 0x7ff78010f440 2023-09-23T09:38:31.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.724+0000 7ff77effd700 1 -- 172.21.15.82:0/266749949 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff77000f2e0 con 0x7ff78010f440 2023-09-23T09:38:31.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.724+0000 7ff787dff700 1 -- 172.21.15.82:0/266749949 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff780111f10 con 0x7ff78010f440 2023-09-23T09:38:31.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.724+0000 7ff787dff700 1 -- 172.21.15.82:0/266749949 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff780114fe0 con 0x7ff78010f440 2023-09-23T09:38:31.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.730+0000 7ff79b722b80 1 Processor -- start 2023-09-23T09:38:31.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.731+0000 7ff79b722b80 1 -- start start 2023-09-23T09:38:31.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.733+0000 7ff79b722b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563de90e5380 0x563de90e5760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:38:31.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.733+0000 7ff79b722b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563de90e5ca0 0x563de90df700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:38:31.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.733+0000 7ff79b722b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563de90dfc40 0x563de90e00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:38:31.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.733+0000 7ff79b722b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x563de90477b0 con 0x563de90dfc40 2023-09-23T09:38:31.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.733+0000 7ff79b722b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x563de9038780 con 0x563de90e5ca0 2023-09-23T09:38:31.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.733+0000 7ff79b722b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x563de90360a0 con 0x563de90e5380 2023-09-23T09:38:31.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.734+0000 7ff785b9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563de90e5ca0 0x563de90df700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:38:31.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.734+0000 7ff77effd700 1 -- 172.21.15.82:0/266749949 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7ff770011990 con 0x7ff78010f440 2023-09-23T09:38:31.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.734+0000 7ff785b9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563de90e5ca0 0x563de90df700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:52526/0 (socket says 172.21.15.82:52526) 2023-09-23T09:38:31.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.734+0000 7ff785b9b700 1 -- 172.21.15.82:0/257862815 learned_addr learned my addr 172.21.15.82:0/257862815 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:38:31.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.734+0000 7ff78639c700 1 --2- 172.21.15.82:0/257862815 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563de90e5380 0x563de90e5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:38:31.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.734+0000 7ff78539a700 1 --2- 172.21.15.82:0/257862815 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563de90dfc40 0x563de90e00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:38:31.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.734+0000 7ff785b9b700 1 -- 172.21.15.82:0/257862815 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563de90e5380 msgr2=0x563de90e5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:38:31.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.734+0000 7ff785b9b700 1 --2- 172.21.15.82:0/257862815 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563de90e5380 0x563de90e5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:38:31.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.734+0000 7ff785b9b700 1 -- 172.21.15.82:0/257862815 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563de90dfc40 msgr2=0x563de90e00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:38:31.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.734+0000 7ff785b9b700 1 --2- 172.21.15.82:0/257862815 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563de90dfc40 0x563de90e00a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:38:31.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.735+0000 7ff785b9b700 1 -- 172.21.15.82:0/257862815 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563de8eb1630 con 0x563de90e5ca0 2023-09-23T09:38:31.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.735+0000 7ff785b9b700 1 --2- 172.21.15.82:0/257862815 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563de90e5ca0 0x563de90df700 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7ff774011650 tx=0x7ff774009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99dd7d27d1140eef server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:38:31.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.735+0000 7ff767fff700 1 -- 172.21.15.82:0/257862815 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff77400e040 con 0x563de90e5ca0 2023-09-23T09:38:31.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.736+0000 7ff767fff700 1 -- 172.21.15.82:0/257862815 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff77400f040 con 0x563de90e5ca0 2023-09-23T09:38:31.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.736+0000 7ff767fff700 1 -- 172.21.15.82:0/257862815 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff774015740 con 0x563de90e5ca0 2023-09-23T09:38:31.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.736+0000 7ff77effd700 1 --2- 172.21.15.82:0/266749949 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7ff7680a0290 0x7ff7680a2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:38:31.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.737+0000 7ff77effd700 1 -- 172.21.15.82:0/266749949 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 8513+0+0 (secure 0 0 0) 0x7ff7700cb020 con 0x7ff78010f440 2023-09-23T09:38:31.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.737+0000 7ff79b722b80 1 -- 172.21.15.82:0/257862815 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563de90e5ca0 msgr2=0x563de90df700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:38:31.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.737+0000 7ff79b722b80 1 --2- 172.21.15.82:0/257862815 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563de90e5ca0 0x563de90df700 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7ff774011650 tx=0x7ff774009920 comp rx=0 tx=0).stop 2023-09-23T09:38:31.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.738+0000 7ff79b722b80 1 -- 172.21.15.82:0/257862815 shutdown_connections 2023-09-23T09:38:31.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.738+0000 7ff79b722b80 1 --2- 172.21.15.82:0/257862815 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563de90dfc40 0x563de90e00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:38:31.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.738+0000 7ff79b722b80 1 --2- 172.21.15.82:0/257862815 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563de90e5380 0x563de90e5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:38:31.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.738+0000 7ff79b722b80 1 --2- 172.21.15.82:0/257862815 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563de90e5ca0 0x563de90df700 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:38:31.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.738+0000 7ff79b722b80 1 -- 172.21.15.82:0/257862815 >> 172.21.15.82:0/257862815 conn(0x563de90540e0 msgr2=0x563de90da410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:38:31.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.738+0000 7ff79b722b80 1 -- 172.21.15.82:0/257862815 shutdown_connections 2023-09-23T09:38:31.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.738+0000 7ff79b722b80 1 -- 172.21.15.82:0/257862815 wait complete. 2023-09-23T09:38:31.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.738+0000 7ff78639c700 1 --2- 172.21.15.82:0/266749949 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7ff7680a0290 0x7ff7680a2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:38:31.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.739+0000 7ff79b722b80 1 -- start start 2023-09-23T09:38:31.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.739+0000 7ff79b722b80 1 Processor -- start 2023-09-23T09:38:31.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.739+0000 7ff78639c700 1 --2- 172.21.15.82:0/266749949 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7ff7680a0290 0x7ff7680a2750 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff7780095c0 tx=0x7ff778005060 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:38:31.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.740+0000 7ff79b722b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563de90dfc40 0x563de90ebc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:38:31.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.740+0000 7ff79b722b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563de90e5380 0x563de90e8f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:38:31.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.740+0000 7ff79b722b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563de90e5ca0 0x563de90e9600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:38:31.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.740+0000 7ff79b722b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x563de9031990 con 0x563de90dfc40 2023-09-23T09:38:31.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.740+0000 7ff79b722b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x563de8fcfbb0 con 0x563de90e5ca0 2023-09-23T09:38:31.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.740+0000 7ff79b722b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x563de8fcf8b0 con 0x563de90e5380 2023-09-23T09:38:31.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.740+0000 7ff79b722b80 10 client.0 _ll_register_callbacks cb 0x563de8f19a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:38:31.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.740+0000 7ff78539a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563de90e5380 0x563de90e8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:38:31.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.740+0000 7ff78539a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563de90e5380 0x563de90e8f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:48950/0 (socket says 172.21.15.82:48950) 2023-09-23T09:38:31.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.740+0000 7ff78539a700 1 -- 172.21.15.82:0/1930550445 learned_addr learned my addr 172.21.15.82:0/1930550445 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:38:31.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.740+0000 7ff785b9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563de90dfc40 0x563de90ebc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:38:31.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.740+0000 7ff78639c700 1 --2- 172.21.15.82:0/1930550445 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563de90e5ca0 0x563de90e9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:38:31.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.741+0000 7ff78539a700 1 -- 172.21.15.82:0/1930550445 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563de90e5ca0 msgr2=0x563de90e9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:38:31.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.741+0000 7ff78539a700 1 --2- 172.21.15.82:0/1930550445 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563de90e5ca0 0x563de90e9600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:38:31.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.741+0000 7ff78539a700 1 -- 172.21.15.82:0/1930550445 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563de90dfc40 msgr2=0x563de90ebc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:38:31.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.741+0000 7ff78539a700 1 --2- 172.21.15.82:0/1930550445 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563de90dfc40 0x563de90ebc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:38:31.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.741+0000 7ff78539a700 1 -- 172.21.15.82:0/1930550445 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff774011330 con 0x563de90e5380 2023-09-23T09:38:31.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.741+0000 7ff78539a700 1 --2- 172.21.15.82:0/1930550445 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563de90e5380 0x563de90e8f10 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7ff770095250 tx=0x7ff770098320 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a41805c9b9ea7e41 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:38:31.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.741+0000 7ff7657fa700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T09:38:31.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.742+0000 7ff7657fa700 1 -- 172.21.15.82:0/1930550445 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7700abea0 con 0x563de90e5380 2023-09-23T09:38:31.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.742+0000 7ff7657fa700 1 -- 172.21.15.82:0/1930550445 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(159..159 src has 1..159) v4 ==== 8513+0+0 (secure 0 0 0) 0x7ff770010eb0 con 0x563de90e5380 2023-09-23T09:38:31.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.742+0000 7ff79b722b80 1 -- 172.21.15.82:0/1930550445 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563de90af1c0 con 0x563de90e5380 2023-09-23T09:38:31.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.742+0000 7ff7657fa700 1 -- 172.21.15.82:0/1930550445 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=129) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff7700cd2d0 con 0x563de90e5380 2023-09-23T09:38:31.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.742+0000 7ff79b722b80 10 client.27871 fetch_fsmap learned FSMap version 129 2023-09-23T09:38:31.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.742+0000 7ff79b722b80 1 -- 172.21.15.82:0/1930550445 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=129,monmap=4+}) v3 -- 0x563de8e5dde0 con 0x563de90e5380 2023-09-23T09:38:31.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.742+0000 7ff7657fa700 1 -- 172.21.15.82:0/1930550445 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x563de90af1c0 con 0x563de90e5380 2023-09-23T09:38:31.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.743+0000 7ff7657fa700 1 -- 172.21.15.82:0/1930550445 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 129) v1 ==== 7898+0+0 (secure 0 0 0) 0x7ff7700172c0 con 0x563de90e5380 2023-09-23T09:38:31.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.743+0000 7ff79b722b80 10 client.27871 fetch_fsmap finished waiting for FSMap version 129 2023-09-23T09:38:31.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.743+0000 7ff79b722b80 10 client.27871 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:38:31.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.743+0000 7ff79b722b80 20 client.27871 populate_metadata read hostname 'smithi082' 2023-09-23T09:38:31.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.743+0000 7ff79b722b80 1 --2- 172.21.15.82:0/1930550445 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x563de90f96e0 0x563de90fbb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:38:31.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.743+0000 7ff79b722b80 4 client.27871 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:38:31.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.743+0000 7ff79b722b80 1 -- 172.21.15.82:0/1930550445 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563de8fd7ba0 con 0x563de90f96e0 2023-09-23T09:38:31.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.743+0000 7ff785b9b700 1 --2- 172.21.15.82:0/1930550445 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x563de90f96e0 0x563de90fbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:38:31.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.744+0000 7ff7657fa700 10 client.27871 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:38:31.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.744+0000 7ff785b9b700 1 --2- 172.21.15.82:0/1930550445 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x563de90f96e0 0x563de90fbb00 crc :-1 s=READY pgs=263 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f0865b00476b5880 server_cookie=484f19d8e118d47f in_seq=0 out_seq=0 2023-09-23T09:38:31.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.745+0000 7ff7657fa700 1 -- 172.21.15.82:0/1930550445 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x563de8fd7ba0 con 0x563de90f96e0 2023-09-23T09:38:31.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.745+0000 7ff7657fa700 10 client.27871 handle_command_reply: tid=0 2023-09-23T09:38:31.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.745+0000 7ff79b722b80 1 client.27871 shutdown 2023-09-23T09:38:31.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.746+0000 7ff79b722b80 1 -- 172.21.15.82:0/1930550445 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563de90e5380 msgr2=0x563de90e8f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:38:31.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.746+0000 7ff79b722b80 1 --2- 172.21.15.82:0/1930550445 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563de90e5380 0x563de90e8f10 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7ff770095250 tx=0x7ff770098320 comp rx=0 tx=0).stop 2023-09-23T09:38:31.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.746+0000 7ff79b722b80 1 -- 172.21.15.82:0/1930550445 shutdown_connections 2023-09-23T09:38:31.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.746+0000 7ff79b722b80 1 --2- 172.21.15.82:0/1930550445 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563de90e5ca0 0x563de90e9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:38:31.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.746+0000 7ff79b722b80 1 --2- 172.21.15.82:0/1930550445 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x563de90f96e0 0x563de90fbb00 crc :-1 s=READY pgs=263 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:38:31.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.746+0000 7ff79b722b80 1 --2- 172.21.15.82:0/1930550445 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563de90dfc40 0x563de90ebc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:38:31.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.746+0000 7ff79b722b80 1 --2- 172.21.15.82:0/1930550445 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563de90e5380 0x563de90e8f10 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:38:31.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.746+0000 7ff79b722b80 1 -- 172.21.15.82:0/1930550445 >> 172.21.15.82:0/1930550445 conn(0x563de90540e0 msgr2=0x563de90d4b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:38:31.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.746+0000 7ff7657fa700 0 client.27871 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:38:31.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.747+0000 7ff79b722b80 1 -- 172.21.15.82:0/1930550445 shutdown_connections 2023-09-23T09:38:31.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.747+0000 7ff79b722b80 1 -- 172.21.15.82:0/1930550445 wait complete. 2023-09-23T09:38:31.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.747+0000 7ff79b722b80 20 client.27871 trim_cache size 0 max 16384 2023-09-23T09:38:31.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.774+0000 7ff79b722b80 1 Processor -- start 2023-09-23T09:38:31.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.774+0000 7ff79b722b80 1 -- start start 2023-09-23T09:38:31.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.775+0000 7ff79b722b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563de90dfc40 0x563de90df700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:38:31.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.775+0000 7ff79b722b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563de90e5380 0x563de90eb7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:38:31.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.775+0000 7ff79b722b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563de90e5ca0 0x563de90e30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:38:31.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.775+0000 7ff79b722b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x563de8eb3920 con 0x563de90dfc40 2023-09-23T09:38:31.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.775+0000 7ff79b722b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x563de90e9c00 con 0x563de90e5ca0 2023-09-23T09:38:31.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.775+0000 7ff79b722b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x563de90e4f60 con 0x563de90e5380 2023-09-23T09:38:31.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.776+0000 7ff785b9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563de90dfc40 0x563de90df700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:38:31.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.776+0000 7ff785b9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563de90dfc40 0x563de90df700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58394/0 (socket says 172.21.15.82:58394) 2023-09-23T09:38:31.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.776+0000 7ff785b9b700 1 -- 172.21.15.82:0/3690992937 learned_addr learned my addr 172.21.15.82:0/3690992937 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:38:31.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.776+0000 7ff78539a700 1 --2- 172.21.15.82:0/3690992937 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563de90e5380 0x563de90eb7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:38:31.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.776+0000 7ff78639c700 1 --2- 172.21.15.82:0/3690992937 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563de90e5ca0 0x563de90e30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:38:31.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.776+0000 7ff78539a700 1 -- 172.21.15.82:0/3690992937 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563de90e5ca0 msgr2=0x563de90e30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:38:31.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.776+0000 7ff78539a700 1 --2- 172.21.15.82:0/3690992937 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563de90e5ca0 0x563de90e30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:38:31.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.776+0000 7ff78539a700 1 -- 172.21.15.82:0/3690992937 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563de90dfc40 msgr2=0x563de90df700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:38:31.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.776+0000 7ff78539a700 1 --2- 172.21.15.82:0/3690992937 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563de90dfc40 0x563de90df700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:38:31.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.776+0000 7ff78539a700 1 -- 172.21.15.82:0/3690992937 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563de8e46c60 con 0x563de90e5380 2023-09-23T09:38:31.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.776+0000 7ff785b9b700 1 --2- 172.21.15.82:0/3690992937 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563de90dfc40 0x563de90df700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:38:31.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.776+0000 7ff78539a700 1 --2- 172.21.15.82:0/3690992937 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563de90e5380 0x563de90eb7c0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7ff77009c7d0 tx=0x7ff770096d90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=52d78e7dc03b05ff server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:38:31.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.777+0000 7ff77cbff700 1 -- 172.21.15.82:0/3690992937 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7700abea0 con 0x563de90e5380 2023-09-23T09:38:31.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.777+0000 7ff77cbff700 1 -- 172.21.15.82:0/3690992937 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff770098140 con 0x563de90e5380 2023-09-23T09:38:31.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.777+0000 7ff77cbff700 1 -- 172.21.15.82:0/3690992937 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7700ce550 con 0x563de90e5380 2023-09-23T09:38:31.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.777+0000 7ff79b722b80 1 -- 172.21.15.82:0/3690992937 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563de90e5380 msgr2=0x563de90eb7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:38:31.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.777+0000 7ff79b722b80 1 --2- 172.21.15.82:0/3690992937 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563de90e5380 0x563de90eb7c0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7ff77009c7d0 tx=0x7ff770096d90 comp rx=0 tx=0).stop 2023-09-23T09:38:31.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.778+0000 7ff79b722b80 1 -- 172.21.15.82:0/3690992937 shutdown_connections 2023-09-23T09:38:31.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.778+0000 7ff79b722b80 1 --2- 172.21.15.82:0/3690992937 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563de90e5ca0 0x563de90e30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:38:31.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.778+0000 7ff79b722b80 1 --2- 172.21.15.82:0/3690992937 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563de90dfc40 0x563de90df700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:38:31.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.778+0000 7ff79b722b80 1 --2- 172.21.15.82:0/3690992937 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563de90e5380 0x563de90eb7c0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:38:31.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.778+0000 7ff79b722b80 1 -- 172.21.15.82:0/3690992937 >> 172.21.15.82:0/3690992937 conn(0x563de90540e0 msgr2=0x563de90da160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:38:31.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.778+0000 7ff79b722b80 1 -- 172.21.15.82:0/3690992937 shutdown_connections 2023-09-23T09:38:31.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.778+0000 7ff79b722b80 1 -- 172.21.15.82:0/3690992937 wait complete. 2023-09-23T09:38:31.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.778+0000 7ff79b722b80 1 -- start start 2023-09-23T09:38:31.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.779+0000 7ff79b722b80 1 Processor -- start 2023-09-23T09:38:31.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.779+0000 7ff79b722b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563de90dfc40 0x563de90e20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:38:31.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.779+0000 7ff79b722b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563de90e5380 0x563de90e25e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:38:31.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.779+0000 7ff79b722b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563de90e5ca0 0x563de90e0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:38:31.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.779+0000 7ff79b722b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x563de90e2c30 con 0x563de90dfc40 2023-09-23T09:38:31.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.779+0000 7ff79b722b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x563de90e1340 con 0x563de90e5380 2023-09-23T09:38:31.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.779+0000 7ff79b722b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x563de90e14d0 con 0x563de90e5ca0 2023-09-23T09:38:31.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.779+0000 7ff79b722b80 10 client.0 _ll_register_callbacks cb 0x563de8f19a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:38:31.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.779+0000 7ff785b9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563de90dfc40 0x563de90e20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:38:31.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.779+0000 7ff785b9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563de90dfc40 0x563de90e20a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58400/0 (socket says 172.21.15.82:58400) 2023-09-23T09:38:31.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.780+0000 7ff785b9b700 1 -- 172.21.15.82:0/1058449907 learned_addr learned my addr 172.21.15.82:0/1058449907 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:38:31.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.780+0000 7ff78539a700 1 --2- 172.21.15.82:0/1058449907 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563de90e5380 0x563de90e25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:38:31.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.780+0000 7ff78639c700 1 --2- 172.21.15.82:0/1058449907 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563de90e5ca0 0x563de90e0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:38:31.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.780+0000 7ff785b9b700 1 -- 172.21.15.82:0/1058449907 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563de90e5ca0 msgr2=0x563de90e0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:38:31.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.780+0000 7ff785b9b700 1 --2- 172.21.15.82:0/1058449907 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563de90e5ca0 0x563de90e0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:38:31.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.780+0000 7ff785b9b700 1 -- 172.21.15.82:0/1058449907 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563de90e5380 msgr2=0x563de90e25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:38:31.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.780+0000 7ff785b9b700 1 --2- 172.21.15.82:0/1058449907 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563de90e5380 0x563de90e25e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:38:31.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.780+0000 7ff785b9b700 1 -- 172.21.15.82:0/1058449907 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563de8eb1630 con 0x563de90dfc40 2023-09-23T09:38:31.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.780+0000 7ff785b9b700 1 --2- 172.21.15.82:0/1058449907 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563de90dfc40 0x563de90e20a0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7ff774004aa0 tx=0x7ff7740092e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea938036c942b601 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:38:31.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.780+0000 7ff7657fa700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:38:31.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.780+0000 7ff7657fa700 1 -- 172.21.15.82:0/1058449907 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff77400e040 con 0x563de90dfc40 2023-09-23T09:38:31.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.781+0000 7ff79b722b80 1 -- 172.21.15.82:0/1058449907 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563de90d28b0 con 0x563de90dfc40 2023-09-23T09:38:31.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.781+0000 7ff7657fa700 1 -- 172.21.15.82:0/1058449907 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(159..159 src has 1..159) v4 ==== 8513+0+0 (secure 0 0 0) 0x7ff774024040 con 0x563de90dfc40 2023-09-23T09:38:31.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.781+0000 7ff7657fa700 1 -- 172.21.15.82:0/1058449907 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=129) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff774026520 con 0x563de90dfc40 2023-09-23T09:38:31.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.781+0000 7ff79b722b80 10 client.18105 fetch_fsmap learned FSMap version 129 2023-09-23T09:38:31.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.781+0000 7ff79b722b80 1 -- 172.21.15.82:0/1058449907 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=129,monmap=4+}) v3 -- 0x563de8e5dde0 con 0x563de90dfc40 2023-09-23T09:38:31.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.781+0000 7ff7657fa700 1 -- 172.21.15.82:0/1058449907 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x563de90d28b0 con 0x563de90dfc40 2023-09-23T09:38:31.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.781+0000 7ff7657fa700 1 -- 172.21.15.82:0/1058449907 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 129) v1 ==== 7898+0+0 (secure 0 0 0) 0x7ff774007870 con 0x563de90dfc40 2023-09-23T09:38:31.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.781+0000 7ff79b722b80 10 client.18105 fetch_fsmap finished waiting for FSMap version 129 2023-09-23T09:38:31.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.781+0000 7ff79b722b80 10 client.18105 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:38:31.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.781+0000 7ff79b722b80 20 client.18105 populate_metadata read hostname 'smithi082' 2023-09-23T09:38:31.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.781+0000 7ff79b722b80 1 --2- 172.21.15.82:0/1058449907 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x563de914e310 0x563de9150730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:38:31.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.781+0000 7ff79b722b80 4 client.18105 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:38:31.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.781+0000 7ff79b722b80 1 -- 172.21.15.82:0/1058449907 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x563de902a970 con 0x563de914e310 2023-09-23T09:38:31.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.782+0000 7ff78539a700 1 --2- 172.21.15.82:0/1058449907 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x563de914e310 0x563de9150730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:38:31.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.782+0000 7ff7657fa700 10 client.18105 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:38:31.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.782+0000 7ff78539a700 1 --2- 172.21.15.82:0/1058449907 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x563de914e310 0x563de9150730 crc :-1 s=READY pgs=264 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=369ef2d9a0383ab2 server_cookie=429c24c127f2adb6 in_seq=0 out_seq=0 2023-09-23T09:38:31.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.782+0000 7ff7657fa700 1 -- 172.21.15.82:0/1058449907 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x563de902a970 con 0x563de914e310 2023-09-23T09:38:31.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.782+0000 7ff7657fa700 10 client.18105 handle_command_reply: tid=0 2023-09-23T09:38:31.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.782+0000 7ff79b722b80 1 client.18105 shutdown 2023-09-23T09:38:31.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.783+0000 7ff79b722b80 1 -- 172.21.15.82:0/1058449907 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563de90dfc40 msgr2=0x563de90e20a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:38:31.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.783+0000 7ff79b722b80 1 --2- 172.21.15.82:0/1058449907 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563de90dfc40 0x563de90e20a0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7ff774004aa0 tx=0x7ff7740092e0 comp rx=0 tx=0).stop 2023-09-23T09:38:31.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.783+0000 7ff79b722b80 1 -- 172.21.15.82:0/1058449907 shutdown_connections 2023-09-23T09:38:31.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.783+0000 7ff79b722b80 1 --2- 172.21.15.82:0/1058449907 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563de90e5ca0 0x563de90e0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:38:31.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.783+0000 7ff79b722b80 1 --2- 172.21.15.82:0/1058449907 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x563de914e310 0x563de9150730 crc :-1 s=READY pgs=264 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:38:31.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.783+0000 7ff79b722b80 1 --2- 172.21.15.82:0/1058449907 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563de90dfc40 0x563de90e20a0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:38:31.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.783+0000 7ff79b722b80 1 --2- 172.21.15.82:0/1058449907 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563de90e5380 0x563de90e25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:38:31.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.783+0000 7ff7657fa700 0 client.18105 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:38:31.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.783+0000 7ff79b722b80 1 -- 172.21.15.82:0/1058449907 >> 172.21.15.82:0/1058449907 conn(0x563de90540e0 msgr2=0x563de90e30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:38:31.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.783+0000 7ff79b722b80 1 -- 172.21.15.82:0/1058449907 shutdown_connections 2023-09-23T09:38:31.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.783+0000 7ff79b722b80 1 -- 172.21.15.82:0/1058449907 wait complete. 2023-09-23T09:38:31.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.783+0000 7ff79b722b80 20 client.18105 trim_cache size 0 max 16384 2023-09-23T09:38:31.788 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:38:31.789 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-23T09:38:31.789 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:38:31.789 INFO:teuthology.orchestra.run.smithi082.stdout: "d9e62ab8-1468-4fb0-a9fe-61bed13e954b": { 2023-09-23T09:38:31.789 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:38:31.789 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "d9e62ab8-1468-4fb0-a9fe-61bed13e954b", 2023-09-23T09:38:31.789 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:38:31.789 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:38:31.789 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:38:31.789 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:38:31.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.784+0000 7ff787dff700 1 -- 172.21.15.82:0/266749949 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7ff7680a0290 msgr2=0x7ff7680a2750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:38:31.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.784+0000 7ff787dff700 1 --2- 172.21.15.82:0/266749949 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7ff7680a0290 0x7ff7680a2750 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff7780095c0 tx=0x7ff778005060 comp rx=0 tx=0).stop 2023-09-23T09:38:31.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.784+0000 7ff787dff700 1 -- 172.21.15.82:0/266749949 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff78010f440 msgr2=0x7ff7801165e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:38:31.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.784+0000 7ff787dff700 1 --2- 172.21.15.82:0/266749949 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff78010f440 0x7ff7801165e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7ff77000b530 tx=0x7ff77000b840 comp rx=0 tx=0).stop 2023-09-23T09:38:31.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.784+0000 7ff787dff700 1 -- 172.21.15.82:0/266749949 shutdown_connections 2023-09-23T09:38:31.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.784+0000 7ff787dff700 1 --2- 172.21.15.82:0/266749949 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7ff7680a0290 0x7ff7680a2750 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:38:31.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.784+0000 7ff787dff700 1 --2- 172.21.15.82:0/266749949 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff78011a100 0x7ff780111330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:38:31.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.784+0000 7ff787dff700 1 --2- 172.21.15.82:0/266749949 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff78010efd0 0x7ff7801160a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:38:31.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.784+0000 7ff787dff700 1 --2- 172.21.15.82:0/266749949 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff78010f440 0x7ff7801165e0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:38:31.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.784+0000 7ff787dff700 1 -- 172.21.15.82:0/266749949 >> 172.21.15.82:0/266749949 conn(0x7ff78006cbe0 msgr2=0x7ff78006f2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:38:31.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.784+0000 7ff787dff700 1 -- 172.21.15.82:0/266749949 shutdown_connections 2023-09-23T09:38:31.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:38:31.784+0000 7ff787dff700 1 -- 172.21.15.82:0/266749949 wait complete. 2023-09-23T09:38:31.808 INFO:tasks.cephfs.filesystem:scrub status for tag:d9e62ab8-1468-4fb0-a9fe-61bed13e954b - {'path': '/', 'tag': 'd9e62ab8-1468-4fb0-a9fe-61bed13e954b', 'options': 'recursive,force'} 2023-09-23T09:38:33.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:38:33 smithi135 ceph-mon[99205]: pgmap v1322: 97 pgs: 97 active+clean; 14 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.7 MiB/s wr, 607 op/s 2023-09-23T09:38:33.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:38:33 smithi082 ceph-mon[97694]: pgmap v1322: 97 pgs: 97 active+clean; 14 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.7 MiB/s wr, 607 op/s 2023-09-23T09:38:33.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:38:33 smithi161 ceph-mon[99580]: pgmap v1322: 97 pgs: 97 active+clean; 14 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.7 MiB/s wr, 607 op/s 2023-09-23T09:38:34.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:38:34 smithi082 ceph-mon[97694]: pgmap v1323: 97 pgs: 97 active+clean; 14 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.5 MiB/s wr, 548 op/s 2023-09-23T09:38:34.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:38:34 smithi161 ceph-mon[99580]: pgmap v1323: 97 pgs: 97 active+clean; 14 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.5 MiB/s wr, 548 op/s 2023-09-23T09:38:34.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:38:34 smithi135 ceph-mon[99205]: pgmap v1323: 97 pgs: 97 active+clean; 14 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.5 MiB/s wr, 548 op/s 2023-09-23T09:38:35.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 685.0 s, 171.6 tps, lat 582.046 ms stddev 556.426 2023-09-23T09:38:37.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:38:36 smithi161 ceph-mon[99580]: pgmap v1324: 97 pgs: 97 active+clean; 14 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 3.5 MiB/s rd, 7.0 MiB/s wr, 854 op/s 2023-09-23T09:38:37.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:38:36 smithi135 ceph-mon[99205]: pgmap v1324: 97 pgs: 97 active+clean; 14 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 3.5 MiB/s rd, 7.0 MiB/s wr, 854 op/s 2023-09-23T09:38:37.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:38:36 smithi082 ceph-mon[97694]: pgmap v1324: 97 pgs: 97 active+clean; 14 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 3.5 MiB/s rd, 7.0 MiB/s wr, 854 op/s 2023-09-23T09:38:38.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:38:38 smithi135 ceph-mon[99205]: pgmap v1325: 97 pgs: 97 active+clean; 14 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.5 MiB/s wr, 571 op/s 2023-09-23T09:38:38.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:38:38 smithi082 ceph-mon[97694]: pgmap v1325: 97 pgs: 97 active+clean; 14 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.5 MiB/s wr, 571 op/s 2023-09-23T09:38:38.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:38:38 smithi161 ceph-mon[99580]: pgmap v1325: 97 pgs: 97 active+clean; 14 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.5 MiB/s wr, 571 op/s 2023-09-23T09:38:39.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:38:39 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:38:39.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:38:39 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:38:39.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:38:39 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:38:40.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:38:40 smithi082 ceph-mon[97694]: pgmap v1326: 97 pgs: 97 active+clean; 14 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 3.2 MiB/s rd, 5.9 MiB/s wr, 791 op/s 2023-09-23T09:38:40.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:38:40 smithi161 ceph-mon[99580]: pgmap v1326: 97 pgs: 97 active+clean; 14 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 3.2 MiB/s rd, 5.9 MiB/s wr, 791 op/s 2023-09-23T09:38:40.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:38:40 smithi135 ceph-mon[99205]: pgmap v1326: 97 pgs: 97 active+clean; 14 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 3.2 MiB/s rd, 5.9 MiB/s wr, 791 op/s 2023-09-23T09:38:40.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 690.0 s, 164.2 tps, lat 611.774 ms stddev 583.591 2023-09-23T09:38:43.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:38:42 smithi135 ceph-mon[99205]: pgmap v1327: 97 pgs: 97 active+clean; 14 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.6 MiB/s wr, 677 op/s 2023-09-23T09:38:43.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:38:42 smithi082 ceph-mon[97694]: pgmap v1327: 97 pgs: 97 active+clean; 14 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.6 MiB/s wr, 677 op/s 2023-09-23T09:38:43.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:38:42 smithi161 ceph-mon[99580]: pgmap v1327: 97 pgs: 97 active+clean; 14 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.6 MiB/s wr, 677 op/s 2023-09-23T09:38:45.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:38:44 smithi135 ceph-mon[99205]: pgmap v1328: 97 pgs: 97 active+clean; 14 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.8 MiB/s wr, 609 op/s 2023-09-23T09:38:45.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:38:44 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:38:45.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:38:44 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:38:45.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:38:44 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:38:45.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:38:44 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:38:45.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:38:44 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:38:45.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:38:44 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:38:45.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:38:44 smithi082 ceph-mon[97694]: pgmap v1328: 97 pgs: 97 active+clean; 14 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.8 MiB/s wr, 609 op/s 2023-09-23T09:38:45.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:38:44 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:38:45.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:38:44 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:38:45.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:38:44 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:38:45.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:38:44 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:38:45.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:38:44 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:38:45.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:38:44 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:38:45.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:38:44 smithi161 ceph-mon[99580]: pgmap v1328: 97 pgs: 97 active+clean; 14 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.8 MiB/s wr, 609 op/s 2023-09-23T09:38:45.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:38:44 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:38:45.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:38:44 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:38:45.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:38:44 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:38:45.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:38:44 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:38:45.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:38:44 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:38:45.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:38:44 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:38:45.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 695.0 s, 163.4 tps, lat 627.313 ms stddev 552.197 2023-09-23T09:38:46.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:38:45 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:38:46.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:38:45 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:38:46.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:38:45 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:38:46.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:38:45 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:38:46.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:38:45 smithi135 ceph-mon[99205]: Adjusting osd_memory_target on smithi082 to 220.9M 2023-09-23T09:38:46.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:38:45 smithi135 ceph-mon[99205]: Unable to set osd_memory_target on smithi082 to 231651840: error parsing value: Value '231651840' is below minimum 939524096 2023-09-23T09:38:46.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:38:45 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:38:46.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:38:45 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:38:46.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:38:45 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:38:46.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:38:45 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:38:46.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:38:45 smithi082 ceph-mon[97694]: Adjusting osd_memory_target on smithi082 to 220.9M 2023-09-23T09:38:46.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:38:45 smithi082 ceph-mon[97694]: Unable to set osd_memory_target on smithi082 to 231651840: error parsing value: Value '231651840' is below minimum 939524096 2023-09-23T09:38:46.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:38:45 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:38:46.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:38:45 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:38:46.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:38:45 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:38:46.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:38:45 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:38:46.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:38:45 smithi161 ceph-mon[99580]: Adjusting osd_memory_target on smithi082 to 220.9M 2023-09-23T09:38:46.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:38:45 smithi161 ceph-mon[99580]: Unable to set osd_memory_target on smithi082 to 231651840: error parsing value: Value '231651840' is below minimum 939524096 2023-09-23T09:38:47.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:38:46 smithi135 ceph-mon[99205]: pgmap v1329: 97 pgs: 97 active+clean; 14 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 3.4 MiB/s rd, 7.3 MiB/s wr, 933 op/s 2023-09-23T09:38:47.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:38:46 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:38:47.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:38:46 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:38:47.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:38:46 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:38:47.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:38:46 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:38:47.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:38:46 smithi135 ceph-mon[99205]: Adjusting osd_memory_target on smithi135 to 220.9M 2023-09-23T09:38:47.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:38:46 smithi135 ceph-mon[99205]: Unable to set osd_memory_target on smithi135 to 231659008: error parsing value: Value '231659008' is below minimum 939524096 2023-09-23T09:38:47.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:38:46 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:38:47.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:38:46 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:38:47.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:38:46 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:38:47.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:38:46 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:38:47.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:38:46 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:38:47.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:38:46 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:38:47.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:38:46 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:38:47.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:38:46 smithi082 ceph-mon[97694]: pgmap v1329: 97 pgs: 97 active+clean; 14 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 3.4 MiB/s rd, 7.3 MiB/s wr, 933 op/s 2023-09-23T09:38:47.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:38:46 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:38:47.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:38:46 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:38:47.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:38:46 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:38:47.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:38:46 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:38:47.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:38:46 smithi082 ceph-mon[97694]: Adjusting osd_memory_target on smithi135 to 220.9M 2023-09-23T09:38:47.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:38:46 smithi082 ceph-mon[97694]: Unable to set osd_memory_target on smithi135 to 231659008: error parsing value: Value '231659008' is below minimum 939524096 2023-09-23T09:38:47.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:38:46 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:38:47.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:38:46 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:38:47.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:38:46 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:38:47.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:38:46 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:38:47.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:38:46 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:38:47.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:38:46 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:38:47.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:38:46 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:38:47.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:38:46 smithi161 ceph-mon[99580]: pgmap v1329: 97 pgs: 97 active+clean; 14 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 3.4 MiB/s rd, 7.3 MiB/s wr, 933 op/s 2023-09-23T09:38:47.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:38:46 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:38:47.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:38:46 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:38:47.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:38:46 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:38:47.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:38:46 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:38:47.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:38:46 smithi161 ceph-mon[99580]: Adjusting osd_memory_target on smithi135 to 220.9M 2023-09-23T09:38:47.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:38:46 smithi161 ceph-mon[99580]: Unable to set osd_memory_target on smithi135 to 231659008: error parsing value: Value '231659008' is below minimum 939524096 2023-09-23T09:38:47.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:38:46 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:38:47.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:38:46 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:38:47.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:38:46 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:38:47.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:38:46 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:38:47.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:38:46 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:38:47.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:38:46 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:38:47.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:38:46 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:38:48.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:38:48 smithi135 ceph-mon[99205]: Adjusting osd_memory_target on smithi161 to 220.9M 2023-09-23T09:38:48.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:38:48 smithi135 ceph-mon[99205]: Unable to set osd_memory_target on smithi161 to 231676211: error parsing value: Value '231676211' is below minimum 939524096 2023-09-23T09:38:48.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:38:48 smithi082 ceph-mon[97694]: Adjusting osd_memory_target on smithi161 to 220.9M 2023-09-23T09:38:48.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:38:48 smithi082 ceph-mon[97694]: Unable to set osd_memory_target on smithi161 to 231676211: error parsing value: Value '231676211' is below minimum 939524096 2023-09-23T09:38:48.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:38:48 smithi161 ceph-mon[99580]: Adjusting osd_memory_target on smithi161 to 220.9M 2023-09-23T09:38:48.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:38:48 smithi161 ceph-mon[99580]: Unable to set osd_memory_target on smithi161 to 231676211: error parsing value: Value '231676211' is below minimum 939524096 2023-09-23T09:38:49.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:38:49 smithi082 ceph-mon[97694]: pgmap v1330: 97 pgs: 97 active+clean; 14 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.8 MiB/s wr, 627 op/s 2023-09-23T09:38:49.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:38:49 smithi161 ceph-mon[99580]: pgmap v1330: 97 pgs: 97 active+clean; 14 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.8 MiB/s wr, 627 op/s 2023-09-23T09:38:49.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:38:49 smithi135 ceph-mon[99205]: pgmap v1330: 97 pgs: 97 active+clean; 14 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.8 MiB/s wr, 627 op/s 2023-09-23T09:38:50.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:38:50 smithi082 ceph-mon[97694]: pgmap v1331: 97 pgs: 97 active+clean; 14 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 3.1 MiB/s rd, 7.0 MiB/s wr, 887 op/s 2023-09-23T09:38:50.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:38:50 smithi161 ceph-mon[99580]: pgmap v1331: 97 pgs: 97 active+clean; 14 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 3.1 MiB/s rd, 7.0 MiB/s wr, 887 op/s 2023-09-23T09:38:50.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:38:50 smithi135 ceph-mon[99205]: pgmap v1331: 97 pgs: 97 active+clean; 14 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 3.1 MiB/s rd, 7.0 MiB/s wr, 887 op/s 2023-09-23T09:38:50.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 700.0 s, 163.4 tps, lat 598.697 ms stddev 601.072 2023-09-23T09:38:53.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:38:53 smithi135 ceph-mon[99205]: pgmap v1332: 97 pgs: 97 active+clean; 14 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.9 MiB/s wr, 729 op/s 2023-09-23T09:38:53.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:38:53 smithi082 ceph-mon[97694]: pgmap v1332: 97 pgs: 97 active+clean; 14 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.9 MiB/s wr, 729 op/s 2023-09-23T09:38:53.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:38:53 smithi161 ceph-mon[99580]: pgmap v1332: 97 pgs: 97 active+clean; 14 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.9 MiB/s wr, 729 op/s 2023-09-23T09:38:54.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:38:54 smithi135 ceph-mon[99205]: pgmap v1333: 97 pgs: 97 active+clean; 14 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.0 MiB/s wr, 646 op/s 2023-09-23T09:38:54.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:38:54 smithi082 ceph-mon[97694]: pgmap v1333: 97 pgs: 97 active+clean; 14 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.0 MiB/s wr, 646 op/s 2023-09-23T09:38:54.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:38:54 smithi161 ceph-mon[99580]: pgmap v1333: 97 pgs: 97 active+clean; 14 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.0 MiB/s wr, 646 op/s 2023-09-23T09:38:55.827 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 705.0 s, 99.0 tps, lat 533.746 ms stddev 507.379 2023-09-23T09:38:57.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:38:56 smithi161 ceph-mon[99580]: pgmap v1334: 97 pgs: 97 active+clean; 14 GiB data, 57 GiB used, 1016 GiB / 1.0 TiB avail; 3.3 MiB/s rd, 6.8 MiB/s wr, 896 op/s 2023-09-23T09:38:57.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:38:56 smithi135 ceph-mon[99205]: pgmap v1334: 97 pgs: 97 active+clean; 14 GiB data, 57 GiB used, 1016 GiB / 1.0 TiB avail; 3.3 MiB/s rd, 6.8 MiB/s wr, 896 op/s 2023-09-23T09:38:57.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:38:56 smithi082 ceph-mon[97694]: pgmap v1334: 97 pgs: 97 active+clean; 14 GiB data, 57 GiB used, 1016 GiB / 1.0 TiB avail; 3.3 MiB/s rd, 6.8 MiB/s wr, 896 op/s 2023-09-23T09:38:58.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:38:58 smithi082 ceph-mon[97694]: pgmap v1335: 97 pgs: 97 active+clean; 14 GiB data, 57 GiB used, 1016 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.4 MiB/s wr, 572 op/s 2023-09-23T09:38:58.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:38:58 smithi161 ceph-mon[99580]: pgmap v1335: 97 pgs: 97 active+clean; 14 GiB data, 57 GiB used, 1016 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.4 MiB/s wr, 572 op/s 2023-09-23T09:38:58.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:38:58 smithi135 ceph-mon[99205]: pgmap v1335: 97 pgs: 97 active+clean; 14 GiB data, 57 GiB used, 1016 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.4 MiB/s wr, 572 op/s 2023-09-23T09:39:00.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 710.0 s, 110.0 tps, lat 1395.372 ms stddev 1953.574 2023-09-23T09:39:01.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:39:00 smithi161 ceph-mon[99580]: pgmap v1336: 97 pgs: 97 active+clean; 14 GiB data, 57 GiB used, 1016 GiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.7 MiB/s wr, 700 op/s 2023-09-23T09:39:01.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:39:00 smithi135 ceph-mon[99205]: pgmap v1336: 97 pgs: 97 active+clean; 14 GiB data, 57 GiB used, 1016 GiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.7 MiB/s wr, 700 op/s 2023-09-23T09:39:01.372 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:39:00 smithi082 ceph-mon[97694]: pgmap v1336: 97 pgs: 97 active+clean; 14 GiB data, 57 GiB used, 1016 GiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.7 MiB/s wr, 700 op/s 2023-09-23T09:39:01.809 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:39:02.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.228+0000 7f612d5ff700 1 -- 172.21.15.82:0/3933690486 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f612811a100 msgr2=0x7f612811c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:39:02.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.228+0000 7f612d5ff700 1 --2- 172.21.15.82:0/3933690486 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f612811a100 0x7f612811c4f0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f6118009990 tx=0x7f6118009ca0 comp rx=0 tx=0).stop 2023-09-23T09:39:02.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.228+0000 7f612d5ff700 1 -- 172.21.15.82:0/3933690486 shutdown_connections 2023-09-23T09:39:02.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.228+0000 7f612d5ff700 1 --2- 172.21.15.82:0/3933690486 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f612811a100 0x7f612811c4f0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:39:02.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.228+0000 7f612d5ff700 1 --2- 172.21.15.82:0/3933690486 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f612810efd0 0x7f612810cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:39:02.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.228+0000 7f612d5ff700 1 --2- 172.21.15.82:0/3933690486 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f612810f440 0x7f612810d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:39:02.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.228+0000 7f612d5ff700 1 -- 172.21.15.82:0/3933690486 >> 172.21.15.82:0/3933690486 conn(0x7f612806cbe0 msgr2=0x7f612806cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:39:02.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.229+0000 7f612d5ff700 1 -- 172.21.15.82:0/3933690486 shutdown_connections 2023-09-23T09:39:02.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.229+0000 7f612d5ff700 1 -- 172.21.15.82:0/3933690486 wait complete. 2023-09-23T09:39:02.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.231+0000 7f612d5ff700 1 Processor -- start 2023-09-23T09:39:02.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.231+0000 7f612d5ff700 1 -- start start 2023-09-23T09:39:02.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.232+0000 7f612d5ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f612810efd0 0x7f6128114ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:39:02.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.232+0000 7f612d5ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f612810f440 0x7f6128115530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:39:02.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.232+0000 7f612d5ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f612811a100 0x7f61281112a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:39:02.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.232+0000 7f612d5ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61281118a0 con 0x7f612810f440 2023-09-23T09:39:02.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.232+0000 7f612d5ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6128111a10 con 0x7f612810efd0 2023-09-23T09:39:02.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.232+0000 7f612d5ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6128111bd0 con 0x7f612811a100 2023-09-23T09:39:02.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.232+0000 7f61277fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f612811a100 0x7f61281112a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:39:02.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.232+0000 7f61277fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f612811a100 0x7f61281112a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:44062/0 (socket says 172.21.15.82:44062) 2023-09-23T09:39:02.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.232+0000 7f61277fe700 1 -- 172.21.15.82:0/2243528288 learned_addr learned my addr 172.21.15.82:0/2243528288 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:39:02.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.234+0000 7f61277fe700 1 -- 172.21.15.82:0/2243528288 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f612810efd0 msgr2=0x7f6128114ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:39:02.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.234+0000 7f61277fe700 1 --2- 172.21.15.82:0/2243528288 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f612810efd0 0x7f6128114ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:39:02.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.234+0000 7f61277fe700 1 -- 172.21.15.82:0/2243528288 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f612810f440 msgr2=0x7f6128115530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:39:02.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.234+0000 7f61277fe700 1 --2- 172.21.15.82:0/2243528288 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f612810f440 0x7f6128115530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:39:02.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.234+0000 7f61277fe700 1 -- 172.21.15.82:0/2243528288 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61180095f0 con 0x7f612811a100 2023-09-23T09:39:02.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.235+0000 7f61277fe700 1 --2- 172.21.15.82:0/2243528288 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f612811a100 0x7f61281112a0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f61180038e0 tx=0x7f61180039c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:39:02.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.237+0000 7f610ffff700 1 -- 172.21.15.82:0/2243528288 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f611801d070 con 0x7f612811a100 2023-09-23T09:39:02.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.237+0000 7f610ffff700 1 -- 172.21.15.82:0/2243528288 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f611800bdb0 con 0x7f612811a100 2023-09-23T09:39:02.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.237+0000 7f610ffff700 1 -- 172.21.15.82:0/2243528288 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6118022d40 con 0x7f612811a100 2023-09-23T09:39:02.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.239+0000 7f612d5ff700 1 -- 172.21.15.82:0/2243528288 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6128111e50 con 0x7f612811a100 2023-09-23T09:39:02.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.239+0000 7f612d5ff700 1 -- 172.21.15.82:0/2243528288 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6128115eb0 con 0x7f612811a100 2023-09-23T09:39:02.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.246+0000 7f6140ea9b80 1 Processor -- start 2023-09-23T09:39:02.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.248+0000 7f6140ea9b80 1 -- start start 2023-09-23T09:39:02.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.248+0000 7f6140ea9b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c0e9e0d380 0x55c0e9e0d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:39:02.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.248+0000 7f6140ea9b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c0e9e0dca0 0x55c0e9e07700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:39:02.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.248+0000 7f6140ea9b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c0e9e07c40 0x55c0e9e080a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:39:02.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.248+0000 7f6140ea9b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0e9d6f7b0 con 0x55c0e9e07c40 2023-09-23T09:39:02.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.248+0000 7f6140ea9b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0e9d60780 con 0x55c0e9e0dca0 2023-09-23T09:39:02.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.248+0000 7f6140ea9b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0e9d5e0a0 con 0x55c0e9e0d380 2023-09-23T09:39:02.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.248+0000 7f610ffff700 1 -- 172.21.15.82:0/2243528288 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f6118022470 con 0x7f612811a100 2023-09-23T09:39:02.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.250+0000 7f61267fc700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c0e9e0d380 0x55c0e9e0d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:39:02.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.250+0000 7f61267fc700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c0e9e0d380 0x55c0e9e0d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:44068/0 (socket says 172.21.15.82:44068) 2023-09-23T09:39:02.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.250+0000 7f61267fc700 1 -- 172.21.15.82:0/3267373049 learned_addr learned my addr 172.21.15.82:0/3267373049 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:39:02.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.253+0000 7f61267fc700 1 -- 172.21.15.82:0/3267373049 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c0e9e0dca0 msgr2=0x55c0e9e07700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:39:02.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.253+0000 7f61267fc700 1 --2- 172.21.15.82:0/3267373049 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c0e9e0dca0 0x55c0e9e07700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:39:02.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.253+0000 7f61267fc700 1 -- 172.21.15.82:0/3267373049 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c0e9e07c40 msgr2=0x55c0e9e080a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:39:02.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.253+0000 7f61267fc700 1 --2- 172.21.15.82:0/3267373049 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c0e9e07c40 0x55c0e9e080a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:39:02.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.253+0000 7f61267fc700 1 -- 172.21.15.82:0/3267373049 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c0e9bd9630 con 0x55c0e9e0d380 2023-09-23T09:39:02.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.256+0000 7f610ffff700 1 --2- 172.21.15.82:0/2243528288 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f61100a01c0 0x7f61100a2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:39:02.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.256+0000 7f610ffff700 1 -- 172.21.15.82:0/2243528288 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 8557+0+0 (secure 0 0 0) 0x7f61180cc900 con 0x7f612811a100 2023-09-23T09:39:02.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.260+0000 7f61267fc700 1 --2- 172.21.15.82:0/3267373049 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c0e9e0d380 0x55c0e9e0d760 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f611c009c60 tx=0x7f611c009f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26b0911189468e8b server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:39:02.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.261+0000 7f610d7fa700 1 -- 172.21.15.82:0/3267373049 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f611c0097e0 con 0x55c0e9e0d380 2023-09-23T09:39:02.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.261+0000 7f610d7fa700 1 -- 172.21.15.82:0/3267373049 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f611c0044e0 con 0x55c0e9e0d380 2023-09-23T09:39:02.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.261+0000 7f610d7fa700 1 -- 172.21.15.82:0/3267373049 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f611c011440 con 0x55c0e9e0d380 2023-09-23T09:39:02.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.264+0000 7f6140ea9b80 1 -- 172.21.15.82:0/3267373049 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c0e9e0d380 msgr2=0x55c0e9e0d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:39:02.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.264+0000 7f6140ea9b80 1 --2- 172.21.15.82:0/3267373049 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c0e9e0d380 0x55c0e9e0d760 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f611c009c60 tx=0x7f611c009f70 comp rx=0 tx=0).stop 2023-09-23T09:39:02.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.265+0000 7f6126ffd700 1 --2- 172.21.15.82:0/2243528288 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f61100a01c0 0x7f61100a2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:39:02.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.265+0000 7f6140ea9b80 1 -- 172.21.15.82:0/3267373049 shutdown_connections 2023-09-23T09:39:02.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.265+0000 7f6140ea9b80 1 --2- 172.21.15.82:0/3267373049 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c0e9e07c40 0x55c0e9e080a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:39:02.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.265+0000 7f6140ea9b80 1 --2- 172.21.15.82:0/3267373049 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c0e9e0d380 0x55c0e9e0d760 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:39:02.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.265+0000 7f6140ea9b80 1 --2- 172.21.15.82:0/3267373049 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c0e9e0dca0 0x55c0e9e07700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:39:02.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.265+0000 7f6140ea9b80 1 -- 172.21.15.82:0/3267373049 >> 172.21.15.82:0/3267373049 conn(0x55c0e9d7c0e0 msgr2=0x55c0e9e02410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:39:02.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.266+0000 7f6140ea9b80 1 -- 172.21.15.82:0/3267373049 shutdown_connections 2023-09-23T09:39:02.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.266+0000 7f6140ea9b80 1 -- 172.21.15.82:0/3267373049 wait complete. 2023-09-23T09:39:02.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.266+0000 7f6140ea9b80 1 -- start start 2023-09-23T09:39:02.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.267+0000 7f6140ea9b80 1 Processor -- start 2023-09-23T09:39:02.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.267+0000 7f6140ea9b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c0e9e07c40 0x55c0e9e10ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:39:02.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.267+0000 7f6140ea9b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c0e9e0d380 0x55c0e9e11530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:39:02.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.267+0000 7f6140ea9b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c0e9e0dca0 0x55c0e9e11a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:39:02.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.268+0000 7f6140ea9b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0e9d59990 con 0x55c0e9e0dca0 2023-09-23T09:39:02.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.268+0000 7f6140ea9b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0e9cf7bb0 con 0x55c0e9e07c40 2023-09-23T09:39:02.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.268+0000 7f6140ea9b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0e9cf78b0 con 0x55c0e9e0d380 2023-09-23T09:39:02.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.268+0000 7f6140ea9b80 10 client.0 _ll_register_callbacks cb 0x55c0e9c41a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:39:02.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.268+0000 7f61277fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c0e9e0dca0 0x55c0e9e11a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:39:02.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.268+0000 7f61267fc700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c0e9e0d380 0x55c0e9e11530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:39:02.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.268+0000 7f61277fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c0e9e0dca0 0x55c0e9e11a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42366/0 (socket says 172.21.15.82:42366) 2023-09-23T09:39:02.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.268+0000 7f61277fe700 1 -- 172.21.15.82:0/2202612004 learned_addr learned my addr 172.21.15.82:0/2202612004 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:39:02.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.269+0000 7f61277fe700 1 -- 172.21.15.82:0/2202612004 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c0e9e0d380 msgr2=0x55c0e9e11530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:39:02.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.269+0000 7f61277fe700 1 --2- 172.21.15.82:0/2202612004 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c0e9e0d380 0x55c0e9e11530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:39:02.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.269+0000 7f61277fe700 1 -- 172.21.15.82:0/2202612004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c0e9e07c40 msgr2=0x55c0e9e10ff0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-23T09:39:02.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.269+0000 7f61277fe700 1 --2- 172.21.15.82:0/2202612004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c0e9e07c40 0x55c0e9e10ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:39:02.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.269+0000 7f61277fe700 1 -- 172.21.15.82:0/2202612004 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f611c009940 con 0x55c0e9e0dca0 2023-09-23T09:39:02.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.269+0000 7f61277fe700 1 --2- 172.21.15.82:0/2202612004 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c0e9e0dca0 0x55c0e9e11a70 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f6118096b10 tx=0x7f61180ca530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d0c2d37e0a97c1b server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:39:02.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.269+0000 7f610aff5700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:39:02.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.270+0000 7f610aff5700 1 -- 172.21.15.82:0/2202612004 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f611809f070 con 0x55c0e9e0dca0 2023-09-23T09:39:02.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.270+0000 7f610aff5700 1 -- 172.21.15.82:0/2202612004 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(160..160 src has 1..160) v4 ==== 8557+0+0 (secure 0 0 0) 0x7f611809ded0 con 0x55c0e9e0dca0 2023-09-23T09:39:02.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.271+0000 7f6140ea9b80 1 -- 172.21.15.82:0/2202612004 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c0e9dd71c0 con 0x55c0e9e0dca0 2023-09-23T09:39:02.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.271+0000 7f610aff5700 1 -- 172.21.15.82:0/2202612004 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=129) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6118022ea0 con 0x55c0e9e0dca0 2023-09-23T09:39:02.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.271+0000 7f6140ea9b80 10 client.18108 fetch_fsmap learned FSMap version 129 2023-09-23T09:39:02.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.271+0000 7f6140ea9b80 1 -- 172.21.15.82:0/2202612004 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=129,monmap=4+}) v3 -- 0x55c0e9b85de0 con 0x55c0e9e0dca0 2023-09-23T09:39:02.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.272+0000 7f610aff5700 1 -- 172.21.15.82:0/2202612004 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55c0e9dd71c0 con 0x55c0e9e0dca0 2023-09-23T09:39:02.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.272+0000 7f610aff5700 1 -- 172.21.15.82:0/2202612004 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 129) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f61180c9080 con 0x55c0e9e0dca0 2023-09-23T09:39:02.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.272+0000 7f6140ea9b80 10 client.18108 fetch_fsmap finished waiting for FSMap version 129 2023-09-23T09:39:02.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.272+0000 7f6140ea9b80 10 client.18108 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:39:02.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.272+0000 7f6140ea9b80 20 client.18108 populate_metadata read hostname 'smithi082' 2023-09-23T09:39:02.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.272+0000 7f6140ea9b80 1 --2- 172.21.15.82:0/2202612004 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55c0e9e21490 0x55c0e9e238b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:39:02.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.272+0000 7f6140ea9b80 4 client.18108 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:39:02.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.272+0000 7f6140ea9b80 1 -- 172.21.15.82:0/2202612004 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c0e9cffba0 con 0x55c0e9e21490 2023-09-23T09:39:02.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.284+0000 7f6126ffd700 1 --2- 172.21.15.82:0/2202612004 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55c0e9e21490 0x55c0e9e238b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:39:02.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.284+0000 7f6126ffd700 1 --2- 172.21.15.82:0/2243528288 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f61100a01c0 0x7f61100a2680 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x55c0e9e0e100 tx=0x7f612000ae10 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:39:02.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.285+0000 7f6126ffd700 1 --2- 172.21.15.82:0/2202612004 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55c0e9e21490 0x55c0e9e238b0 crc :-1 s=READY pgs=265 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4867653656af3479 server_cookie=38c7de0b3066cf5e in_seq=0 out_seq=0 2023-09-23T09:39:02.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.285+0000 7f610aff5700 10 client.18108 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:39:02.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.295+0000 7f610aff5700 1 -- 172.21.15.82:0/2202612004 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c0e9cffba0 con 0x55c0e9e21490 2023-09-23T09:39:02.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.295+0000 7f610aff5700 10 client.18108 handle_command_reply: tid=0 2023-09-23T09:39:02.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.295+0000 7f6140ea9b80 1 client.18108 shutdown 2023-09-23T09:39:02.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.302+0000 7f6140ea9b80 1 -- 172.21.15.82:0/2202612004 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c0e9e0dca0 msgr2=0x55c0e9e11a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:39:02.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.302+0000 7f6140ea9b80 1 --2- 172.21.15.82:0/2202612004 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c0e9e0dca0 0x55c0e9e11a70 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f6118096b10 tx=0x7f61180ca530 comp rx=0 tx=0).stop 2023-09-23T09:39:02.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.305+0000 7f6140ea9b80 1 -- 172.21.15.82:0/2202612004 shutdown_connections 2023-09-23T09:39:02.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.305+0000 7f6140ea9b80 1 --2- 172.21.15.82:0/2202612004 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55c0e9e21490 0x55c0e9e238b0 crc :-1 s=READY pgs=265 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:39:02.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.305+0000 7f6140ea9b80 1 --2- 172.21.15.82:0/2202612004 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c0e9e0dca0 0x55c0e9e11a70 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:39:02.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.305+0000 7f6140ea9b80 1 --2- 172.21.15.82:0/2202612004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c0e9e07c40 0x55c0e9e10ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:39:02.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.305+0000 7f6140ea9b80 1 --2- 172.21.15.82:0/2202612004 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c0e9e0d380 0x55c0e9e11530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:39:02.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.305+0000 7f6140ea9b80 1 -- 172.21.15.82:0/2202612004 >> 172.21.15.82:0/2202612004 conn(0x55c0e9d7c0e0 msgr2=0x55c0e9dfcb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:39:02.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.305+0000 7f610aff5700 0 client.18108 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:39:02.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.305+0000 7f6140ea9b80 1 -- 172.21.15.82:0/2202612004 shutdown_connections 2023-09-23T09:39:02.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.305+0000 7f6140ea9b80 1 -- 172.21.15.82:0/2202612004 wait complete. 2023-09-23T09:39:02.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:39:01 smithi135 ceph-mon[99205]: osdmap e160: 12 total, 12 up, 12 in 2023-09-23T09:39:02.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.310+0000 7f6140ea9b80 20 client.18108 trim_cache size 0 max 16384 2023-09-23T09:39:02.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.343+0000 7f6140ea9b80 1 Processor -- start 2023-09-23T09:39:02.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.343+0000 7f6140ea9b80 1 -- start start 2023-09-23T09:39:02.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.343+0000 7f6140ea9b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c0e9e07c40 0x55c0e9e07700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:39:02.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.343+0000 7f6140ea9b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c0e9e0d380 0x55c0e9e187a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:39:02.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.343+0000 7f6140ea9b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c0e9e0dca0 0x55c0e9e0b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:39:02.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.343+0000 7f6140ea9b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0e9bdb920 con 0x55c0e9e07c40 2023-09-23T09:39:02.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.343+0000 7f6140ea9b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0e9dfec80 con 0x55c0e9e0dca0 2023-09-23T09:39:02.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.343+0000 7f6140ea9b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0e9e041d0 con 0x55c0e9e0d380 2023-09-23T09:39:02.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.344+0000 7f61267fc700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c0e9e0d380 0x55c0e9e187a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:39:02.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.344+0000 7f61267fc700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c0e9e0d380 0x55c0e9e187a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:44088/0 (socket says 172.21.15.82:44088) 2023-09-23T09:39:02.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.344+0000 7f61267fc700 1 -- 172.21.15.82:0/900731707 learned_addr learned my addr 172.21.15.82:0/900731707 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:39:02.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.347+0000 7f6126ffd700 1 --2- 172.21.15.82:0/900731707 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c0e9e07c40 0x55c0e9e07700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:39:02.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.347+0000 7f61267fc700 1 -- 172.21.15.82:0/900731707 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c0e9e0dca0 msgr2=0x55c0e9e0b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:39:02.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.347+0000 7f61267fc700 1 --2- 172.21.15.82:0/900731707 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c0e9e0dca0 0x55c0e9e0b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:39:02.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.347+0000 7f61267fc700 1 -- 172.21.15.82:0/900731707 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c0e9e07c40 msgr2=0x55c0e9e07700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:39:02.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.347+0000 7f61267fc700 1 --2- 172.21.15.82:0/900731707 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c0e9e07c40 0x55c0e9e07700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:39:02.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.347+0000 7f61267fc700 1 -- 172.21.15.82:0/900731707 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c0e9b6ec60 con 0x55c0e9e0d380 2023-09-23T09:39:02.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.348+0000 7f61267fc700 1 --2- 172.21.15.82:0/900731707 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c0e9e0d380 0x55c0e9e187a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f611c003760 tx=0x7f611c01c040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0b00045e3074cc9 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:39:02.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.350+0000 7f610dffb700 1 -- 172.21.15.82:0/900731707 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f611c021040 con 0x55c0e9e0d380 2023-09-23T09:39:02.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.351+0000 7f610dffb700 1 -- 172.21.15.82:0/900731707 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f611c010c50 con 0x55c0e9e0d380 2023-09-23T09:39:02.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.351+0000 7f610dffb700 1 -- 172.21.15.82:0/900731707 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f611c025420 con 0x55c0e9e0d380 2023-09-23T09:39:02.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.352+0000 7f6140ea9b80 1 -- 172.21.15.82:0/900731707 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c0e9e0d380 msgr2=0x55c0e9e187a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:39:02.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.352+0000 7f6140ea9b80 1 --2- 172.21.15.82:0/900731707 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c0e9e0d380 0x55c0e9e187a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f611c003760 tx=0x7f611c01c040 comp rx=0 tx=0).stop 2023-09-23T09:39:02.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.352+0000 7f6140ea9b80 1 -- 172.21.15.82:0/900731707 shutdown_connections 2023-09-23T09:39:02.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.352+0000 7f6140ea9b80 1 --2- 172.21.15.82:0/900731707 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c0e9e0dca0 0x55c0e9e0b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:39:02.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.352+0000 7f6140ea9b80 1 --2- 172.21.15.82:0/900731707 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c0e9e07c40 0x55c0e9e07700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:39:02.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.352+0000 7f6140ea9b80 1 --2- 172.21.15.82:0/900731707 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c0e9e0d380 0x55c0e9e187a0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:39:02.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.352+0000 7f6140ea9b80 1 -- 172.21.15.82:0/900731707 >> 172.21.15.82:0/900731707 conn(0x55c0e9d7c0e0 msgr2=0x55c0e9e02110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:39:02.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.352+0000 7f6140ea9b80 1 -- 172.21.15.82:0/900731707 shutdown_connections 2023-09-23T09:39:02.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.353+0000 7f6140ea9b80 1 -- 172.21.15.82:0/900731707 wait complete. 2023-09-23T09:39:02.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.353+0000 7f6140ea9b80 1 -- start start 2023-09-23T09:39:02.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.353+0000 7f6140ea9b80 1 Processor -- start 2023-09-23T09:39:02.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.355+0000 7f6140ea9b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c0e9e07c40 0x55c0e9e69440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:39:02.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.355+0000 7f6140ea9b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c0e9e0d380 0x55c0e9e699e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:39:02.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.355+0000 7f6140ea9b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c0e9e0dca0 0x55c0e9e6d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:39:02.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.355+0000 7f6140ea9b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0e9e6db40 con 0x55c0e9e0dca0 2023-09-23T09:39:02.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.355+0000 7f6140ea9b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0e9e6dcb0 con 0x55c0e9e0d380 2023-09-23T09:39:02.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.355+0000 7f6140ea9b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0e9e6de70 con 0x55c0e9e07c40 2023-09-23T09:39:02.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.355+0000 7f6140ea9b80 10 client.0 _ll_register_callbacks cb 0x7f6118099f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:39:02.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.356+0000 7f61277fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c0e9e0dca0 0x55c0e9e6d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:39:02.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.356+0000 7f61277fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c0e9e0dca0 0x55c0e9e6d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42376/0 (socket says 172.21.15.82:42376) 2023-09-23T09:39:02.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.356+0000 7f61277fe700 1 -- 172.21.15.82:0/844030460 learned_addr learned my addr 172.21.15.82:0/844030460 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:39:02.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.358+0000 7f61277fe700 1 -- 172.21.15.82:0/844030460 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c0e9e07c40 msgr2=0x55c0e9e69440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:39:02.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.358+0000 7f61277fe700 1 --2- 172.21.15.82:0/844030460 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c0e9e07c40 0x55c0e9e69440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:39:02.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.358+0000 7f61277fe700 1 -- 172.21.15.82:0/844030460 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c0e9e0d380 msgr2=0x55c0e9e699e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-23T09:39:02.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.358+0000 7f61277fe700 1 --2- 172.21.15.82:0/844030460 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c0e9e0d380 0x55c0e9e699e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:39:02.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.358+0000 7f61277fe700 1 -- 172.21.15.82:0/844030460 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c0e9bd9630 con 0x55c0e9e0dca0 2023-09-23T09:39:02.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.358+0000 7f61277fe700 1 --2- 172.21.15.82:0/844030460 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c0e9e0dca0 0x55c0e9e6d590 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f61180965a0 tx=0x7f6118096320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8b9cd51d9c8c851 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:39:02.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.359+0000 7f610aff5700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:39:02.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.360+0000 7f610aff5700 1 -- 172.21.15.82:0/844030460 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f611809f070 con 0x55c0e9e0dca0 2023-09-23T09:39:02.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.360+0000 7f610aff5700 1 -- 172.21.15.82:0/844030460 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(160..160 src has 1..160) v4 ==== 8557+0+0 (secure 0 0 0) 0x7f611809ded0 con 0x55c0e9e0dca0 2023-09-23T09:39:02.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.361+0000 7f6140ea9b80 1 -- 172.21.15.82:0/844030460 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c0e9dfa8b0 con 0x55c0e9e0dca0 2023-09-23T09:39:02.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.361+0000 7f610aff5700 1 -- 172.21.15.82:0/844030460 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=129) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6118022ea0 con 0x55c0e9e0dca0 2023-09-23T09:39:02.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.361+0000 7f6140ea9b80 10 client.18114 fetch_fsmap learned FSMap version 129 2023-09-23T09:39:02.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.361+0000 7f6140ea9b80 1 -- 172.21.15.82:0/844030460 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=129,monmap=4+}) v3 -- 0x55c0e9bac250 con 0x55c0e9e0dca0 2023-09-23T09:39:02.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.362+0000 7f610aff5700 1 -- 172.21.15.82:0/844030460 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55c0e9dfa8b0 con 0x55c0e9e0dca0 2023-09-23T09:39:02.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.362+0000 7f610aff5700 1 -- 172.21.15.82:0/844030460 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 129) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f611809aa30 con 0x55c0e9e0dca0 2023-09-23T09:39:02.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.362+0000 7f6140ea9b80 10 client.18114 fetch_fsmap finished waiting for FSMap version 129 2023-09-23T09:39:02.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.362+0000 7f6140ea9b80 10 client.18114 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:39:02.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.362+0000 7f6140ea9b80 20 client.18114 populate_metadata read hostname 'smithi082' 2023-09-23T09:39:02.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.363+0000 7f6140ea9b80 1 --2- 172.21.15.82:0/844030460 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55c0e9e76330 0x55c0e9e78720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:39:02.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.363+0000 7f6140ea9b80 4 client.18114 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:39:02.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.363+0000 7f6140ea9b80 1 -- 172.21.15.82:0/844030460 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55c0e9d52970 con 0x55c0e9e76330 2023-09-23T09:39:02.373 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:39:01 smithi082 ceph-mon[97694]: osdmap e160: 12 total, 12 up, 12 in 2023-09-23T09:39:02.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.378+0000 7f6126ffd700 1 --2- 172.21.15.82:0/844030460 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55c0e9e76330 0x55c0e9e78720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:39:02.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.389+0000 7f6126ffd700 1 --2- 172.21.15.82:0/844030460 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55c0e9e76330 0x55c0e9e78720 crc :-1 s=READY pgs=266 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94277b9387a896a6 server_cookie=c0727f88385ecb34 in_seq=0 out_seq=0 2023-09-23T09:39:02.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.389+0000 7f610aff5700 10 client.18114 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:39:02.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.394+0000 7f610aff5700 1 -- 172.21.15.82:0/844030460 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55c0e9d52970 con 0x55c0e9e76330 2023-09-23T09:39:02.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.394+0000 7f610aff5700 10 client.18114 handle_command_reply: tid=0 2023-09-23T09:39:02.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.394+0000 7f6140ea9b80 1 client.18114 shutdown 2023-09-23T09:39:02.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.396+0000 7f6140ea9b80 1 -- 172.21.15.82:0/844030460 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c0e9e0dca0 msgr2=0x55c0e9e6d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:39:02.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.396+0000 7f6140ea9b80 1 --2- 172.21.15.82:0/844030460 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c0e9e0dca0 0x55c0e9e6d590 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f61180965a0 tx=0x7f6118096320 comp rx=0 tx=0).stop 2023-09-23T09:39:02.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.397+0000 7f6140ea9b80 1 -- 172.21.15.82:0/844030460 shutdown_connections 2023-09-23T09:39:02.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.397+0000 7f6140ea9b80 1 --2- 172.21.15.82:0/844030460 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55c0e9e76330 0x55c0e9e78720 crc :-1 s=READY pgs=266 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:39:02.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.397+0000 7f6140ea9b80 1 --2- 172.21.15.82:0/844030460 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c0e9e0dca0 0x55c0e9e6d590 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:39:02.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.397+0000 7f6140ea9b80 1 --2- 172.21.15.82:0/844030460 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c0e9e07c40 0x55c0e9e69440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:39:02.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.397+0000 7f6140ea9b80 1 --2- 172.21.15.82:0/844030460 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c0e9e0d380 0x55c0e9e699e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:39:02.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.397+0000 7f6140ea9b80 1 -- 172.21.15.82:0/844030460 >> 172.21.15.82:0/844030460 conn(0x55c0e9d7c0e0 msgr2=0x55c0e9e0b130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:39:02.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.397+0000 7f610aff5700 0 client.18114 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:39:02.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.397+0000 7f6140ea9b80 1 -- 172.21.15.82:0/844030460 shutdown_connections 2023-09-23T09:39:02.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.397+0000 7f6140ea9b80 1 -- 172.21.15.82:0/844030460 wait complete. 2023-09-23T09:39:02.401 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:39:01 smithi161 ceph-mon[99580]: osdmap e160: 12 total, 12 up, 12 in 2023-09-23T09:39:02.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.399+0000 7f6140ea9b80 20 client.18114 trim_cache size 0 max 16384 2023-09-23T09:39:02.406 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:39:02.406 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-23T09:39:02.406 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:39:02.406 INFO:teuthology.orchestra.run.smithi082.stdout: "d9e62ab8-1468-4fb0-a9fe-61bed13e954b": { 2023-09-23T09:39:02.407 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:39:02.407 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "d9e62ab8-1468-4fb0-a9fe-61bed13e954b", 2023-09-23T09:39:02.407 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:39:02.407 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:39:02.407 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:39:02.407 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:39:02.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.407+0000 7f612d5ff700 1 -- 172.21.15.82:0/2243528288 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f61100a01c0 msgr2=0x7f61100a2680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:39:02.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.407+0000 7f612d5ff700 1 --2- 172.21.15.82:0/2243528288 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f61100a01c0 0x7f61100a2680 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x55c0e9e0e100 tx=0x7f612000ae10 comp rx=0 tx=0).stop 2023-09-23T09:39:02.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.407+0000 7f612d5ff700 1 -- 172.21.15.82:0/2243528288 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f612811a100 msgr2=0x7f61281112a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:39:02.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.407+0000 7f612d5ff700 1 --2- 172.21.15.82:0/2243528288 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f612811a100 0x7f61281112a0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f61180038e0 tx=0x7f61180039c0 comp rx=0 tx=0).stop 2023-09-23T09:39:02.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.407+0000 7f612d5ff700 1 -- 172.21.15.82:0/2243528288 shutdown_connections 2023-09-23T09:39:02.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.407+0000 7f612d5ff700 1 --2- 172.21.15.82:0/2243528288 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f61100a01c0 0x7f61100a2680 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:39:02.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.407+0000 7f612d5ff700 1 --2- 172.21.15.82:0/2243528288 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f612811a100 0x7f61281112a0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:39:02.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.407+0000 7f612d5ff700 1 --2- 172.21.15.82:0/2243528288 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f612810efd0 0x7f6128114ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:39:02.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.407+0000 7f612d5ff700 1 --2- 172.21.15.82:0/2243528288 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f612810f440 0x7f6128115530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:39:02.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.407+0000 7f612d5ff700 1 -- 172.21.15.82:0/2243528288 >> 172.21.15.82:0/2243528288 conn(0x7f612806cbe0 msgr2=0x7f612806f2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:39:02.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.407+0000 7f612d5ff700 1 -- 172.21.15.82:0/2243528288 shutdown_connections 2023-09-23T09:39:02.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:02.408+0000 7f612d5ff700 1 -- 172.21.15.82:0/2243528288 wait complete. 2023-09-23T09:39:02.453 INFO:tasks.cephfs.filesystem:scrub status for tag:d9e62ab8-1468-4fb0-a9fe-61bed13e954b - {'path': '/', 'tag': 'd9e62ab8-1468-4fb0-a9fe-61bed13e954b', 'options': 'recursive,force'} 2023-09-23T09:39:03.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:39:02 smithi135 ceph-mon[99205]: pgmap v1338: 97 pgs: 97 active+clean; 14 GiB data, 57 GiB used, 1016 GiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.0 MiB/s wr, 494 op/s 2023-09-23T09:39:03.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:39:02 smithi082 ceph-mon[97694]: pgmap v1338: 97 pgs: 97 active+clean; 14 GiB data, 57 GiB used, 1016 GiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.0 MiB/s wr, 494 op/s 2023-09-23T09:39:03.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:39:02 smithi161 ceph-mon[99580]: pgmap v1338: 97 pgs: 97 active+clean; 14 GiB data, 57 GiB used, 1016 GiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.0 MiB/s wr, 494 op/s 2023-09-23T09:39:05.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:39:04 smithi135 ceph-mon[99205]: pgmap v1339: 97 pgs: 97 active+clean; 14 GiB data, 57 GiB used, 1016 GiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.0 MiB/s wr, 494 op/s 2023-09-23T09:39:05.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:39:04 smithi082 ceph-mon[97694]: pgmap v1339: 97 pgs: 97 active+clean; 14 GiB data, 57 GiB used, 1016 GiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.0 MiB/s wr, 494 op/s 2023-09-23T09:39:05.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:39:04 smithi161 ceph-mon[99580]: pgmap v1339: 97 pgs: 97 active+clean; 14 GiB data, 57 GiB used, 1016 GiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.0 MiB/s wr, 494 op/s 2023-09-23T09:39:05.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 715.0 s, 41.4 tps, lat 1451.176 ms stddev 1257.268 2023-09-23T09:39:07.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:39:06 smithi135 ceph-mon[99205]: pgmap v1340: 97 pgs: 7 active+clean+snaptrim, 17 active+clean+snaptrim_wait, 73 active+clean; 13 GiB data, 56 GiB used, 1017 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.9 MiB/s wr, 332 op/s 2023-09-23T09:39:07.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:39:06 smithi082 ceph-mon[97694]: pgmap v1340: 97 pgs: 7 active+clean+snaptrim, 17 active+clean+snaptrim_wait, 73 active+clean; 13 GiB data, 56 GiB used, 1017 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.9 MiB/s wr, 332 op/s 2023-09-23T09:39:07.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:39:06 smithi161 ceph-mon[99580]: pgmap v1340: 97 pgs: 7 active+clean+snaptrim, 17 active+clean+snaptrim_wait, 73 active+clean; 13 GiB data, 56 GiB used, 1017 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.9 MiB/s wr, 332 op/s 2023-09-23T09:39:09.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:39:09 smithi135 ceph-mon[99205]: pgmap v1341: 97 pgs: 7 active+clean+snaptrim, 17 active+clean+snaptrim_wait, 73 active+clean; 13 GiB data, 56 GiB used, 1017 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.9 MiB/s wr, 332 op/s 2023-09-23T09:39:09.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:39:09 smithi082 ceph-mon[97694]: pgmap v1341: 97 pgs: 7 active+clean+snaptrim, 17 active+clean+snaptrim_wait, 73 active+clean; 13 GiB data, 56 GiB used, 1017 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.9 MiB/s wr, 332 op/s 2023-09-23T09:39:09.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:39:09 smithi161 ceph-mon[99580]: pgmap v1341: 97 pgs: 7 active+clean+snaptrim, 17 active+clean+snaptrim_wait, 73 active+clean; 13 GiB data, 56 GiB used, 1017 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.9 MiB/s wr, 332 op/s 2023-09-23T09:39:10.827 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 720.0 s, 21.0 tps, lat 4509.776 ms stddev 1663.141 2023-09-23T09:39:11.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:39:11 smithi082 ceph-mon[97694]: pgmap v1342: 97 pgs: 97 active+clean; 13 GiB data, 54 GiB used, 1019 GiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.1 MiB/s wr, 270 op/s 2023-09-23T09:39:11.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:39:11 smithi161 ceph-mon[99580]: pgmap v1342: 97 pgs: 97 active+clean; 13 GiB data, 54 GiB used, 1019 GiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.1 MiB/s wr, 270 op/s 2023-09-23T09:39:11.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:39:11 smithi135 ceph-mon[99205]: pgmap v1342: 97 pgs: 97 active+clean; 13 GiB data, 54 GiB used, 1019 GiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.1 MiB/s wr, 270 op/s 2023-09-23T09:39:13.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:39:13 smithi135 ceph-mon[99205]: pgmap v1343: 97 pgs: 97 active+clean; 13 GiB data, 53 GiB used, 1019 GiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.9 MiB/s wr, 229 op/s 2023-09-23T09:39:13.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:39:13 smithi135 ceph-mon[99205]: osdmap e161: 12 total, 12 up, 12 in 2023-09-23T09:39:13.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:39:13 smithi082 ceph-mon[97694]: pgmap v1343: 97 pgs: 97 active+clean; 13 GiB data, 53 GiB used, 1019 GiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.9 MiB/s wr, 229 op/s 2023-09-23T09:39:13.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:39:13 smithi082 ceph-mon[97694]: osdmap e161: 12 total, 12 up, 12 in 2023-09-23T09:39:13.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:39:13 smithi161 ceph-mon[99580]: pgmap v1343: 97 pgs: 97 active+clean; 13 GiB data, 53 GiB used, 1019 GiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.9 MiB/s wr, 229 op/s 2023-09-23T09:39:13.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:39:13 smithi161 ceph-mon[99580]: osdmap e161: 12 total, 12 up, 12 in 2023-09-23T09:39:15.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:39:15 smithi082 ceph-mon[97694]: pgmap v1345: 97 pgs: 97 active+clean; 13 GiB data, 53 GiB used, 1019 GiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.1 MiB/s wr, 250 op/s 2023-09-23T09:39:15.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:39:15 smithi161 ceph-mon[99580]: pgmap v1345: 97 pgs: 97 active+clean; 13 GiB data, 53 GiB used, 1019 GiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.1 MiB/s wr, 250 op/s 2023-09-23T09:39:15.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:39:15 smithi135 ceph-mon[99205]: pgmap v1345: 97 pgs: 97 active+clean; 13 GiB data, 53 GiB used, 1019 GiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.1 MiB/s wr, 250 op/s 2023-09-23T09:39:15.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 725.0 s, 153.6 tps, lat 897.942 ms stddev 1053.736 2023-09-23T09:39:17.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:39:17 smithi082 ceph-mon[97694]: pgmap v1346: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.8 MiB/s wr, 336 op/s 2023-09-23T09:39:17.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:39:17 smithi161 ceph-mon[99580]: pgmap v1346: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.8 MiB/s wr, 336 op/s 2023-09-23T09:39:17.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:39:17 smithi135 ceph-mon[99205]: pgmap v1346: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.8 MiB/s wr, 336 op/s 2023-09-23T09:39:18.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:39:18 smithi082 ceph-mon[97694]: pgmap v1347: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.8 MiB/s wr, 336 op/s 2023-09-23T09:39:18.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:39:18 smithi161 ceph-mon[99580]: pgmap v1347: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.8 MiB/s wr, 336 op/s 2023-09-23T09:39:18.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:39:18 smithi135 ceph-mon[99205]: pgmap v1347: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.8 MiB/s wr, 336 op/s 2023-09-23T09:39:20.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 730.0 s, 160.4 tps, lat 635.981 ms stddev 631.605 2023-09-23T09:39:21.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:39:20 smithi161 ceph-mon[99580]: pgmap v1348: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.3 MiB/s wr, 511 op/s 2023-09-23T09:39:21.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:39:20 smithi135 ceph-mon[99205]: pgmap v1348: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.3 MiB/s wr, 511 op/s 2023-09-23T09:39:21.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:39:20 smithi082 ceph-mon[97694]: pgmap v1348: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.3 MiB/s wr, 511 op/s 2023-09-23T09:39:22.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:39:21 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:39:22.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:39:21 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:39:22.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:39:21 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:39:23.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:39:23 smithi082 ceph-mon[97694]: pgmap v1349: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1020 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.4 MiB/s wr, 555 op/s 2023-09-23T09:39:23.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:39:23 smithi161 ceph-mon[99580]: pgmap v1349: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1020 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.4 MiB/s wr, 555 op/s 2023-09-23T09:39:23.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:39:23 smithi135 ceph-mon[99205]: pgmap v1349: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1020 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.4 MiB/s wr, 555 op/s 2023-09-23T09:39:25.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:39:25 smithi082 ceph-mon[97694]: pgmap v1350: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1020 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.8 MiB/s wr, 481 op/s 2023-09-23T09:39:25.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:39:25 smithi161 ceph-mon[99580]: pgmap v1350: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1020 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.8 MiB/s wr, 481 op/s 2023-09-23T09:39:25.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:39:25 smithi135 ceph-mon[99205]: pgmap v1350: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1020 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.8 MiB/s wr, 481 op/s 2023-09-23T09:39:25.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 735.0 s, 180.6 tps, lat 539.745 ms stddev 507.893 2023-09-23T09:39:26.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:39:26 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:39:26.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:39:26 smithi082 ceph-mon[97694]: pgmap v1351: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 3.1 MiB/s rd, 5.8 MiB/s wr, 743 op/s 2023-09-23T09:39:26.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:39:26 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:39:26.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:39:26 smithi161 ceph-mon[99580]: pgmap v1351: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 3.1 MiB/s rd, 5.8 MiB/s wr, 743 op/s 2023-09-23T09:39:26.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:39:26 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:39:26.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:39:26 smithi135 ceph-mon[99205]: pgmap v1351: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 3.1 MiB/s rd, 5.8 MiB/s wr, 743 op/s 2023-09-23T09:39:29.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:39:29 smithi082 ceph-mon[97694]: pgmap v1352: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.3 MiB/s wr, 558 op/s 2023-09-23T09:39:29.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:39:29 smithi161 ceph-mon[99580]: pgmap v1352: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.3 MiB/s wr, 558 op/s 2023-09-23T09:39:29.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:39:29 smithi135 ceph-mon[99205]: pgmap v1352: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.3 MiB/s wr, 558 op/s 2023-09-23T09:39:30.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 740.0 s, 179.4 tps, lat 567.736 ms stddev 524.455 2023-09-23T09:39:31.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:39:31 smithi082 ceph-mon[97694]: pgmap v1353: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1021 GiB / 1.0 TiB avail; 3.2 MiB/s rd, 5.7 MiB/s wr, 772 op/s 2023-09-23T09:39:31.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:39:31 smithi161 ceph-mon[99580]: pgmap v1353: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1021 GiB / 1.0 TiB avail; 3.2 MiB/s rd, 5.7 MiB/s wr, 772 op/s 2023-09-23T09:39:31.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:39:31 smithi135 ceph-mon[99205]: pgmap v1353: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1021 GiB / 1.0 TiB avail; 3.2 MiB/s rd, 5.7 MiB/s wr, 772 op/s 2023-09-23T09:39:32.454 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:39:32.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.768+0000 7f7adedff700 1 -- 172.21.15.82:0/2663211947 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ad8101260 msgr2=0x7f7ad810d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:39:32.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.769+0000 7f7adedff700 1 --2- 172.21.15.82:0/2663211947 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ad8101260 0x7f7ad810d770 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f7ad0009990 tx=0x7f7ad0009ca0 comp rx=0 tx=0).stop 2023-09-23T09:39:32.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.769+0000 7f7adedff700 1 -- 172.21.15.82:0/2663211947 shutdown_connections 2023-09-23T09:39:32.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.769+0000 7f7adedff700 1 --2- 172.21.15.82:0/2663211947 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ad8101260 0x7f7ad810d770 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:39:32.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.769+0000 7f7adedff700 1 --2- 172.21.15.82:0/2663211947 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ad81068b0 0x7f7ad8106c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:39:32.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.769+0000 7f7adedff700 1 --2- 172.21.15.82:0/2663211947 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ad81008a0 0x7f7ad8100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:39:32.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.769+0000 7f7adedff700 1 -- 172.21.15.82:0/2663211947 >> 172.21.15.82:0/2663211947 conn(0x7f7ad80fc390 msgr2=0x7f7ad80fe7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:39:32.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.770+0000 7f7adedff700 1 -- 172.21.15.82:0/2663211947 shutdown_connections 2023-09-23T09:39:32.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.770+0000 7f7adedff700 1 -- 172.21.15.82:0/2663211947 wait complete. 2023-09-23T09:39:32.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.772+0000 7f7adedff700 1 Processor -- start 2023-09-23T09:39:32.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.773+0000 7f7adedff700 1 -- start start 2023-09-23T09:39:32.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.773+0000 7f7adedff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ad81008a0 0x7f7ad806ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:39:32.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.773+0000 7f7adedff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ad8101260 0x7f7ad806ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:39:32.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.773+0000 7f7adedff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ad81068b0 0x7f7ad806acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:39:32.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.773+0000 7f7adedff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad806b2f0 con 0x7f7ad81008a0 2023-09-23T09:39:32.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.773+0000 7f7adedff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad806b460 con 0x7f7ad81068b0 2023-09-23T09:39:32.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.773+0000 7f7adedff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad806b620 con 0x7f7ad8101260 2023-09-23T09:39:32.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.774+0000 7f7acffff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ad8101260 0x7f7ad806ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:39:32.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.774+0000 7f7acffff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ad8101260 0x7f7ad806ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:33210/0 (socket says 172.21.15.82:33210) 2023-09-23T09:39:32.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.774+0000 7f7acffff700 1 -- 172.21.15.82:0/1665128995 learned_addr learned my addr 172.21.15.82:0/1665128995 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:39:32.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.774+0000 7f7adcb9b700 1 --2- 172.21.15.82:0/1665128995 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ad81008a0 0x7f7ad806ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:39:32.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.774+0000 7f7add39c700 1 --2- 172.21.15.82:0/1665128995 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ad81068b0 0x7f7ad806acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:39:32.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.774+0000 7f7acffff700 1 -- 172.21.15.82:0/1665128995 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ad81068b0 msgr2=0x7f7ad806acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:39:32.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.774+0000 7f7acffff700 1 --2- 172.21.15.82:0/1665128995 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ad81068b0 0x7f7ad806acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:39:32.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.774+0000 7f7acffff700 1 -- 172.21.15.82:0/1665128995 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ad81008a0 msgr2=0x7f7ad806ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:39:32.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.774+0000 7f7acffff700 1 --2- 172.21.15.82:0/1665128995 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ad81008a0 0x7f7ad806ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:39:32.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.774+0000 7f7acffff700 1 -- 172.21.15.82:0/1665128995 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ad00095f0 con 0x7f7ad8101260 2023-09-23T09:39:32.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.774+0000 7f7add39c700 1 --2- 172.21.15.82:0/1665128995 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ad81068b0 0x7f7ad806acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:39:32.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.775+0000 7f7acffff700 1 --2- 172.21.15.82:0/1665128995 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ad8101260 0x7f7ad806ef80 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f7ac000d950 tx=0x7f7ac000dc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:39:32.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.775+0000 7f7ad67fc700 1 -- 172.21.15.82:0/1665128995 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac0009940 con 0x7f7ad8101260 2023-09-23T09:39:32.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.775+0000 7f7adedff700 1 -- 172.21.15.82:0/1665128995 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ad806b900 con 0x7f7ad8101260 2023-09-23T09:39:32.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.775+0000 7f7ad67fc700 1 -- 172.21.15.82:0/1665128995 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7ac0010460 con 0x7f7ad8101260 2023-09-23T09:39:32.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.775+0000 7f7ad67fc700 1 -- 172.21.15.82:0/1665128995 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac000f620 con 0x7f7ad8101260 2023-09-23T09:39:32.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.775+0000 7f7adedff700 1 -- 172.21.15.82:0/1665128995 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ad806fae0 con 0x7f7ad8101260 2023-09-23T09:39:32.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.781+0000 7f7ad67fc700 1 -- 172.21.15.82:0/1665128995 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f7ac00105d0 con 0x7f7ad8101260 2023-09-23T09:39:32.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.782+0000 7f7af26c1b80 1 Processor -- start 2023-09-23T09:39:32.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.782+0000 7f7af26c1b80 1 -- start start 2023-09-23T09:39:32.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.782+0000 7f7af26c1b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55eb796d4380 0x55eb796d4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:39:32.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.782+0000 7f7af26c1b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb796d4ca0 0x55eb796ce700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:39:32.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.782+0000 7f7af26c1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eb796cec40 0x55eb796cf0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:39:32.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.782+0000 7f7af26c1b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb796367b0 con 0x55eb796cec40 2023-09-23T09:39:32.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.782+0000 7f7af26c1b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb79627780 con 0x55eb796d4ca0 2023-09-23T09:39:32.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.782+0000 7f7af26c1b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb796250a0 con 0x55eb796d4380 2023-09-23T09:39:32.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.783+0000 7f7ad67fc700 1 --2- 172.21.15.82:0/1665128995 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f7ac40a01c0 0x7f7ac40a2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:39:32.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.783+0000 7f7acffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eb796cec40 0x55eb796cf0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:39:32.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.783+0000 7f7add39c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55eb796d4380 0x55eb796d4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:39:32.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.784+0000 7f7add39c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55eb796d4380 0x55eb796d4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:33224/0 (socket says 172.21.15.82:33224) 2023-09-23T09:39:32.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.784+0000 7f7add39c700 1 -- 172.21.15.82:0/3836813828 learned_addr learned my addr 172.21.15.82:0/3836813828 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:39:32.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.784+0000 7f7ad67fc700 1 -- 172.21.15.82:0/1665128995 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f7ac00cb830 con 0x7f7ad8101260 2023-09-23T09:39:32.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.784+0000 7f7adcb9b700 1 --2- 172.21.15.82:0/3836813828 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb796d4ca0 0x55eb796ce700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:39:32.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.784+0000 7f7acffff700 1 -- 172.21.15.82:0/3836813828 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55eb796d4380 msgr2=0x55eb796d4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:39:32.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.784+0000 7f7acffff700 1 --2- 172.21.15.82:0/3836813828 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55eb796d4380 0x55eb796d4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:39:32.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.784+0000 7f7acffff700 1 -- 172.21.15.82:0/3836813828 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb796d4ca0 msgr2=0x55eb796ce700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:39:32.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.784+0000 7f7acffff700 1 --2- 172.21.15.82:0/3836813828 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb796d4ca0 0x55eb796ce700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:39:32.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.784+0000 7f7acffff700 1 -- 172.21.15.82:0/3836813828 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eb794a0630 con 0x55eb796cec40 2023-09-23T09:39:32.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.784+0000 7f7adcb9b700 1 --2- 172.21.15.82:0/3836813828 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb796d4ca0 0x55eb796ce700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T09:39:32.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.784+0000 7f7add39c700 1 --2- 172.21.15.82:0/1665128995 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f7ac40a01c0 0x7f7ac40a2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:39:32.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.784+0000 7f7acffff700 1 --2- 172.21.15.82:0/3836813828 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eb796cec40 0x55eb796cf0a0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f7ac00c8f20 tx=0x7f7ac006af50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=184bf80de5e5389f server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:39:32.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.785+0000 7f7aceffd700 1 -- 172.21.15.82:0/3836813828 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac00108d0 con 0x55eb796cec40 2023-09-23T09:39:32.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.785+0000 7f7add39c700 1 --2- 172.21.15.82:0/1665128995 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f7ac40a01c0 0x7f7ac40a2680 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7ad00095c0 tx=0x7f7ad0009310 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:39:32.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.785+0000 7f7aceffd700 1 -- 172.21.15.82:0/3836813828 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7ac0064e80 con 0x55eb796cec40 2023-09-23T09:39:32.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.785+0000 7f7aceffd700 1 -- 172.21.15.82:0/3836813828 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac00649e0 con 0x55eb796cec40 2023-09-23T09:39:32.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.786+0000 7f7af26c1b80 1 -- 172.21.15.82:0/3836813828 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eb796cec40 msgr2=0x55eb796cf0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:39:32.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.786+0000 7f7af26c1b80 1 --2- 172.21.15.82:0/3836813828 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eb796cec40 0x55eb796cf0a0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f7ac00c8f20 tx=0x7f7ac006af50 comp rx=0 tx=0).stop 2023-09-23T09:39:32.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.786+0000 7f7af26c1b80 1 -- 172.21.15.82:0/3836813828 shutdown_connections 2023-09-23T09:39:32.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.786+0000 7f7af26c1b80 1 --2- 172.21.15.82:0/3836813828 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eb796cec40 0x55eb796cf0a0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:39:32.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.786+0000 7f7af26c1b80 1 --2- 172.21.15.82:0/3836813828 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55eb796d4380 0x55eb796d4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:39:32.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.786+0000 7f7af26c1b80 1 --2- 172.21.15.82:0/3836813828 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb796d4ca0 0x55eb796ce700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:39:32.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.786+0000 7f7af26c1b80 1 -- 172.21.15.82:0/3836813828 >> 172.21.15.82:0/3836813828 conn(0x55eb796430e0 msgr2=0x55eb796c9410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:39:32.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.787+0000 7f7af26c1b80 1 -- 172.21.15.82:0/3836813828 shutdown_connections 2023-09-23T09:39:32.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.787+0000 7f7af26c1b80 1 -- 172.21.15.82:0/3836813828 wait complete. 2023-09-23T09:39:32.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.787+0000 7f7af26c1b80 1 -- start start 2023-09-23T09:39:32.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.788+0000 7f7af26c1b80 1 Processor -- start 2023-09-23T09:39:32.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.788+0000 7f7af26c1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eb796cec40 0x55eb796d7f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:39:32.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.788+0000 7f7af26c1b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55eb796d4380 0x55eb796d84b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:39:32.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.789+0000 7f7af26c1b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb796d4ca0 0x55eb796d89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:39:32.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.789+0000 7f7af26c1b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb79620990 con 0x55eb796cec40 2023-09-23T09:39:32.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.789+0000 7f7af26c1b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb795bebb0 con 0x55eb796d4ca0 2023-09-23T09:39:32.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.789+0000 7f7af26c1b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb795be8b0 con 0x55eb796d4380 2023-09-23T09:39:32.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.789+0000 7f7af26c1b80 10 client.0 _ll_register_callbacks cb 0x55eb79508a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:39:32.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.789+0000 7f7acffff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55eb796d4380 0x55eb796d84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:39:32.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.789+0000 7f7adcb9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eb796cec40 0x55eb796d7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:39:32.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.789+0000 7f7acffff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55eb796d4380 0x55eb796d84b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:33226/0 (socket says 172.21.15.82:33226) 2023-09-23T09:39:32.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.789+0000 7f7acffff700 1 -- 172.21.15.82:0/326944888 learned_addr learned my addr 172.21.15.82:0/326944888 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:39:32.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.789+0000 7f7add39c700 1 --2- 172.21.15.82:0/326944888 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb796d4ca0 0x55eb796d89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:39:32.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.790+0000 7f7acffff700 1 -- 172.21.15.82:0/326944888 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb796d4ca0 msgr2=0x55eb796d89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:39:32.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.790+0000 7f7acffff700 1 --2- 172.21.15.82:0/326944888 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb796d4ca0 0x55eb796d89f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:39:32.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.790+0000 7f7acffff700 1 -- 172.21.15.82:0/326944888 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eb796cec40 msgr2=0x55eb796d7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:39:32.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.790+0000 7f7acffff700 1 --2- 172.21.15.82:0/326944888 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eb796cec40 0x55eb796d7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:39:32.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.790+0000 7f7acffff700 1 -- 172.21.15.82:0/326944888 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ad806fae0 con 0x55eb796d4380 2023-09-23T09:39:32.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.790+0000 7f7add39c700 1 --2- 172.21.15.82:0/326944888 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb796d4ca0 0x55eb796d89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:39:32.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.790+0000 7f7acffff700 1 --2- 172.21.15.82:0/326944888 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55eb796d4380 0x55eb796d84b0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f7ac0098e70 tx=0x7f7ac0095820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=183f0fad4740ab2d server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:39:32.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.790+0000 7f7ab7fff700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T09:39:32.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.790+0000 7f7ab7fff700 1 -- 172.21.15.82:0/326944888 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac0098ee0 con 0x55eb796d4380 2023-09-23T09:39:32.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.790+0000 7f7ab7fff700 1 -- 172.21.15.82:0/326944888 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(161..161 src has 1..161) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f7ac00995e0 con 0x55eb796d4380 2023-09-23T09:39:32.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.790+0000 7f7af26c1b80 1 -- 172.21.15.82:0/326944888 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55eb7969e1c0 con 0x55eb796d4380 2023-09-23T09:39:32.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.791+0000 7f7ab7fff700 1 -- 172.21.15.82:0/326944888 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=131) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7ac00a0cf0 con 0x55eb796d4380 2023-09-23T09:39:32.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.791+0000 7f7af26c1b80 10 client.27904 fetch_fsmap learned FSMap version 131 2023-09-23T09:39:32.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.791+0000 7f7af26c1b80 1 -- 172.21.15.82:0/326944888 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=131,monmap=4+}) v3 -- 0x55eb7944cde0 con 0x55eb796d4380 2023-09-23T09:39:32.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.791+0000 7f7ab7fff700 1 -- 172.21.15.82:0/326944888 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55eb7969e1c0 con 0x55eb796d4380 2023-09-23T09:39:32.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.791+0000 7f7ab7fff700 1 -- 172.21.15.82:0/326944888 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 131) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f7ac00a08d0 con 0x55eb796d4380 2023-09-23T09:39:32.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.791+0000 7f7af26c1b80 10 client.27904 fetch_fsmap finished waiting for FSMap version 131 2023-09-23T09:39:32.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.791+0000 7f7af26c1b80 10 client.27904 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:39:32.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.791+0000 7f7af26c1b80 20 client.27904 populate_metadata read hostname 'smithi082' 2023-09-23T09:39:32.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.791+0000 7f7af26c1b80 1 --2- 172.21.15.82:0/326944888 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55eb796e8150 0x55eb796ea540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:39:32.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.791+0000 7f7af26c1b80 4 client.27904 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:39:32.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.791+0000 7f7af26c1b80 1 -- 172.21.15.82:0/326944888 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55eb795c6ba0 con 0x55eb796e8150 2023-09-23T09:39:32.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.792+0000 7f7adcb9b700 1 --2- 172.21.15.82:0/326944888 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55eb796e8150 0x55eb796ea540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:39:32.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.792+0000 7f7adcb9b700 1 --2- 172.21.15.82:0/326944888 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55eb796e8150 0x55eb796ea540 crc :-1 s=READY pgs=267 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d72629413827de9d server_cookie=adf5e1bd1b99b743 in_seq=0 out_seq=0 2023-09-23T09:39:32.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.792+0000 7f7ab7fff700 10 client.27904 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:39:32.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.794+0000 7f7ab7fff700 1 -- 172.21.15.82:0/326944888 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55eb795c6ba0 con 0x55eb796e8150 2023-09-23T09:39:32.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.794+0000 7f7ab7fff700 10 client.27904 handle_command_reply: tid=0 2023-09-23T09:39:32.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.794+0000 7f7af26c1b80 1 client.27904 shutdown 2023-09-23T09:39:32.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.794+0000 7f7af26c1b80 1 -- 172.21.15.82:0/326944888 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55eb796d4380 msgr2=0x55eb796d84b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:39:32.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.794+0000 7f7af26c1b80 1 --2- 172.21.15.82:0/326944888 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55eb796d4380 0x55eb796d84b0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f7ac0098e70 tx=0x7f7ac0095820 comp rx=0 tx=0).stop 2023-09-23T09:39:32.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.794+0000 7f7af26c1b80 1 -- 172.21.15.82:0/326944888 shutdown_connections 2023-09-23T09:39:32.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.794+0000 7f7af26c1b80 1 --2- 172.21.15.82:0/326944888 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb796d4ca0 0x55eb796d89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:39:32.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.794+0000 7f7af26c1b80 1 --2- 172.21.15.82:0/326944888 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55eb796e8150 0x55eb796ea540 crc :-1 s=READY pgs=267 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:39:32.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.794+0000 7f7af26c1b80 1 --2- 172.21.15.82:0/326944888 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eb796cec40 0x55eb796d7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:39:32.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.794+0000 7f7af26c1b80 1 --2- 172.21.15.82:0/326944888 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55eb796d4380 0x55eb796d84b0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:39:32.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.794+0000 7f7af26c1b80 1 -- 172.21.15.82:0/326944888 >> 172.21.15.82:0/326944888 conn(0x55eb796430e0 msgr2=0x55eb796c3b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:39:32.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.794+0000 7f7ab7fff700 0 client.27904 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:39:32.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.794+0000 7f7af26c1b80 1 -- 172.21.15.82:0/326944888 shutdown_connections 2023-09-23T09:39:32.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.795+0000 7f7af26c1b80 1 -- 172.21.15.82:0/326944888 wait complete. 2023-09-23T09:39:32.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.795+0000 7f7af26c1b80 20 client.27904 trim_cache size 0 max 16384 2023-09-23T09:39:32.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.821+0000 7f7af26c1b80 1 Processor -- start 2023-09-23T09:39:32.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.821+0000 7f7af26c1b80 1 -- start start 2023-09-23T09:39:32.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.821+0000 7f7af26c1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eb796cec40 0x55eb796ce700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:39:32.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.821+0000 7f7af26c1b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb796d4380 0x55eb796df6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:39:32.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.821+0000 7f7af26c1b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55eb796d4ca0 0x55eb796d8530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:39:32.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.821+0000 7f7af26c1b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb794a2920 con 0x55eb796cec40 2023-09-23T09:39:32.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.821+0000 7f7af26c1b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb796e5100 con 0x55eb796d4380 2023-09-23T09:39:32.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.821+0000 7f7af26c1b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb796c5c80 con 0x55eb796d4ca0 2023-09-23T09:39:32.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.822+0000 7f7add39c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55eb796d4ca0 0x55eb796d8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:39:32.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.822+0000 7f7acffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb796d4380 0x55eb796df6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:39:32.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.822+0000 7f7add39c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55eb796d4ca0 0x55eb796d8530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:33242/0 (socket says 172.21.15.82:33242) 2023-09-23T09:39:32.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.822+0000 7f7add39c700 1 -- 172.21.15.82:0/1572395131 learned_addr learned my addr 172.21.15.82:0/1572395131 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:39:32.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.822+0000 7f7adcb9b700 1 --2- 172.21.15.82:0/1572395131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eb796cec40 0x55eb796ce700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:39:32.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.822+0000 7f7add39c700 1 -- 172.21.15.82:0/1572395131 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb796d4380 msgr2=0x55eb796df6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:39:32.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.822+0000 7f7add39c700 1 --2- 172.21.15.82:0/1572395131 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb796d4380 0x55eb796df6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:39:32.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.822+0000 7f7add39c700 1 -- 172.21.15.82:0/1572395131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eb796cec40 msgr2=0x55eb796ce700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:39:32.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.822+0000 7f7add39c700 1 --2- 172.21.15.82:0/1572395131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eb796cec40 0x55eb796ce700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:39:32.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.822+0000 7f7add39c700 1 -- 172.21.15.82:0/1572395131 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eb79435c60 con 0x55eb796d4ca0 2023-09-23T09:39:32.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.822+0000 7f7acffff700 1 --2- 172.21.15.82:0/1572395131 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb796d4380 0x55eb796df6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:39:32.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.823+0000 7f7add39c700 1 --2- 172.21.15.82:0/1572395131 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55eb796d4ca0 0x55eb796d8530 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f7ad000bb20 tx=0x7f7ad0023000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e47b4aeda2feeda7 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:39:32.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.823+0000 7f7acf7fe700 1 -- 172.21.15.82:0/1572395131 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad000be30 con 0x55eb796d4ca0 2023-09-23T09:39:32.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.823+0000 7f7acf7fe700 1 -- 172.21.15.82:0/1572395131 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7ad0026d60 con 0x55eb796d4ca0 2023-09-23T09:39:32.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.823+0000 7f7acf7fe700 1 -- 172.21.15.82:0/1572395131 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad00246e0 con 0x55eb796d4ca0 2023-09-23T09:39:32.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.824+0000 7f7af26c1b80 1 -- 172.21.15.82:0/1572395131 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55eb796d4ca0 msgr2=0x55eb796d8530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:39:32.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.824+0000 7f7af26c1b80 1 --2- 172.21.15.82:0/1572395131 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55eb796d4ca0 0x55eb796d8530 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f7ad000bb20 tx=0x7f7ad0023000 comp rx=0 tx=0).stop 2023-09-23T09:39:32.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.825+0000 7f7af26c1b80 1 -- 172.21.15.82:0/1572395131 shutdown_connections 2023-09-23T09:39:32.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.825+0000 7f7af26c1b80 1 --2- 172.21.15.82:0/1572395131 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55eb796d4ca0 0x55eb796d8530 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:39:32.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.825+0000 7f7af26c1b80 1 --2- 172.21.15.82:0/1572395131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eb796cec40 0x55eb796ce700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:39:32.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.825+0000 7f7af26c1b80 1 --2- 172.21.15.82:0/1572395131 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb796d4380 0x55eb796df6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:39:32.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.825+0000 7f7af26c1b80 1 -- 172.21.15.82:0/1572395131 >> 172.21.15.82:0/1572395131 conn(0x55eb796430e0 msgr2=0x55eb796d2090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:39:32.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.825+0000 7f7af26c1b80 1 -- 172.21.15.82:0/1572395131 shutdown_connections 2023-09-23T09:39:32.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.825+0000 7f7af26c1b80 1 -- 172.21.15.82:0/1572395131 wait complete. 2023-09-23T09:39:32.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.826+0000 7f7af26c1b80 1 -- start start 2023-09-23T09:39:32.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.826+0000 7f7af26c1b80 1 Processor -- start 2023-09-23T09:39:32.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.827+0000 7f7af26c1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eb796cec40 0x55eb796dd8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:39:32.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.827+0000 7f7af26c1b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55eb796d4380 0x55eb796dde50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:39:32.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.827+0000 7f7af26c1b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb796d4ca0 0x55eb79734eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:39:32.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.827+0000 7f7af26c1b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb79735460 con 0x55eb796cec40 2023-09-23T09:39:32.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.827+0000 7f7af26c1b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb797355d0 con 0x55eb796d4ca0 2023-09-23T09:39:32.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.827+0000 7f7af26c1b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb79735790 con 0x55eb796d4380 2023-09-23T09:39:32.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.827+0000 7f7af26c1b80 10 client.0 _ll_register_callbacks cb 0x7f7ad0009810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:39:32.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.828+0000 7f7acffff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55eb796d4380 0x55eb796dde50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:39:32.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.828+0000 7f7acffff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55eb796d4380 0x55eb796dde50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:33248/0 (socket says 172.21.15.82:33248) 2023-09-23T09:39:32.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.828+0000 7f7acffff700 1 -- 172.21.15.82:0/522003132 learned_addr learned my addr 172.21.15.82:0/522003132 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:39:32.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.828+0000 7f7adcb9b700 1 --2- 172.21.15.82:0/522003132 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eb796cec40 0x55eb796dd8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:39:32.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.828+0000 7f7add39c700 1 --2- 172.21.15.82:0/522003132 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb796d4ca0 0x55eb79734eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:39:32.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.828+0000 7f7acffff700 1 -- 172.21.15.82:0/522003132 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb796d4ca0 msgr2=0x55eb79734eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:39:32.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.828+0000 7f7acffff700 1 --2- 172.21.15.82:0/522003132 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb796d4ca0 0x55eb79734eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:39:32.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.828+0000 7f7acffff700 1 -- 172.21.15.82:0/522003132 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eb796cec40 msgr2=0x55eb796dd8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:39:32.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.828+0000 7f7acffff700 1 --2- 172.21.15.82:0/522003132 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eb796cec40 0x55eb796dd8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:39:32.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.828+0000 7f7acffff700 1 -- 172.21.15.82:0/522003132 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55eb7944cde0 con 0x55eb796d4380 2023-09-23T09:39:32.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.828+0000 7f7adcb9b700 1 --2- 172.21.15.82:0/522003132 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eb796cec40 0x55eb796dd8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:39:32.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.829+0000 7f7acffff700 1 --2- 172.21.15.82:0/522003132 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55eb796d4380 0x55eb796dde50 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f7ac0000c00 tx=0x7f7ac00985e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=53047bbbca9e5419 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:39:32.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.829+0000 7f7ab7fff700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T09:39:32.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.829+0000 7f7ab7fff700 1 -- 172.21.15.82:0/522003132 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac00c8f00 con 0x55eb796d4380 2023-09-23T09:39:32.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.829+0000 7f7ab7fff700 1 -- 172.21.15.82:0/522003132 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(161..161 src has 1..161) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f7ac0099350 con 0x55eb796d4380 2023-09-23T09:39:32.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.829+0000 7f7af26c1b80 1 -- 172.21.15.82:0/522003132 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55eb796c18b0 con 0x55eb796d4380 2023-09-23T09:39:32.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.830+0000 7f7ab7fff700 1 -- 172.21.15.82:0/522003132 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=131) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7ac00995e0 con 0x55eb796d4380 2023-09-23T09:39:32.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.830+0000 7f7af26c1b80 10 client.27910 fetch_fsmap learned FSMap version 131 2023-09-23T09:39:32.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.830+0000 7f7af26c1b80 1 -- 172.21.15.82:0/522003132 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=131,monmap=4+}) v3 -- 0x7f7ad002e040 con 0x55eb796d4380 2023-09-23T09:39:32.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.830+0000 7f7ab7fff700 1 -- 172.21.15.82:0/522003132 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55eb796c18b0 con 0x55eb796d4380 2023-09-23T09:39:32.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.830+0000 7f7ab7fff700 1 -- 172.21.15.82:0/522003132 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 131) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f7ac0093d00 con 0x55eb796d4380 2023-09-23T09:39:32.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.830+0000 7f7af26c1b80 10 client.27910 fetch_fsmap finished waiting for FSMap version 131 2023-09-23T09:39:32.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.830+0000 7f7af26c1b80 10 client.27910 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:39:32.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.831+0000 7f7af26c1b80 20 client.27910 populate_metadata read hostname 'smithi082' 2023-09-23T09:39:32.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.831+0000 7f7af26c1b80 1 --2- 172.21.15.82:0/522003132 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55eb7973caa0 0x55eb7973ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:39:32.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.831+0000 7f7af26c1b80 4 client.27910 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:39:32.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.831+0000 7f7af26c1b80 1 -- 172.21.15.82:0/522003132 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55eb79619970 con 0x55eb7973caa0 2023-09-23T09:39:32.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.831+0000 7f7adcb9b700 1 --2- 172.21.15.82:0/522003132 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55eb7973caa0 0x55eb7973ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:39:32.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.832+0000 7f7adcb9b700 1 --2- 172.21.15.82:0/522003132 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55eb7973caa0 0x55eb7973ee90 crc :-1 s=READY pgs=268 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc6f8d398d871431 server_cookie=6d831259ba48d2f2 in_seq=0 out_seq=0 2023-09-23T09:39:32.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.832+0000 7f7ab7fff700 10 client.27910 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:39:32.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.832+0000 7f7ab7fff700 1 -- 172.21.15.82:0/522003132 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55eb79619970 con 0x55eb7973caa0 2023-09-23T09:39:32.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.832+0000 7f7ab7fff700 10 client.27910 handle_command_reply: tid=0 2023-09-23T09:39:32.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.832+0000 7f7af26c1b80 1 client.27910 shutdown 2023-09-23T09:39:32.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.832+0000 7f7af26c1b80 1 -- 172.21.15.82:0/522003132 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55eb796d4380 msgr2=0x55eb796dde50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:39:32.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.832+0000 7f7af26c1b80 1 --2- 172.21.15.82:0/522003132 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55eb796d4380 0x55eb796dde50 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f7ac0000c00 tx=0x7f7ac00985e0 comp rx=0 tx=0).stop 2023-09-23T09:39:32.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.833+0000 7f7af26c1b80 1 -- 172.21.15.82:0/522003132 shutdown_connections 2023-09-23T09:39:32.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.833+0000 7f7af26c1b80 1 --2- 172.21.15.82:0/522003132 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb796d4ca0 0x55eb79734eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:39:32.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.833+0000 7f7af26c1b80 1 --2- 172.21.15.82:0/522003132 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55eb7973caa0 0x55eb7973ee90 crc :-1 s=READY pgs=268 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:39:32.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.833+0000 7f7af26c1b80 1 --2- 172.21.15.82:0/522003132 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eb796cec40 0x55eb796dd8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:39:32.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.833+0000 7f7af26c1b80 1 --2- 172.21.15.82:0/522003132 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55eb796d4380 0x55eb796dde50 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:39:32.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.833+0000 7f7ab7fff700 0 client.27910 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:39:32.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.833+0000 7f7af26c1b80 1 -- 172.21.15.82:0/522003132 >> 172.21.15.82:0/522003132 conn(0x55eb796430e0 msgr2=0x55eb796d8530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:39:32.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.833+0000 7f7af26c1b80 1 -- 172.21.15.82:0/522003132 shutdown_connections 2023-09-23T09:39:32.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.833+0000 7f7af26c1b80 1 -- 172.21.15.82:0/522003132 wait complete. 2023-09-23T09:39:32.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.833+0000 7f7af26c1b80 20 client.27910 trim_cache size 0 max 16384 2023-09-23T09:39:32.836 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:39:32.836 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-23T09:39:32.836 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:39:32.837 INFO:teuthology.orchestra.run.smithi082.stdout: "d9e62ab8-1468-4fb0-a9fe-61bed13e954b": { 2023-09-23T09:39:32.837 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:39:32.837 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "d9e62ab8-1468-4fb0-a9fe-61bed13e954b", 2023-09-23T09:39:32.837 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:39:32.837 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:39:32.837 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:39:32.837 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:39:32.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.835+0000 7f7adedff700 1 -- 172.21.15.82:0/1665128995 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f7ac40a01c0 msgr2=0x7f7ac40a2680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:39:32.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.835+0000 7f7adedff700 1 --2- 172.21.15.82:0/1665128995 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f7ac40a01c0 0x7f7ac40a2680 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7ad00095c0 tx=0x7f7ad0009310 comp rx=0 tx=0).stop 2023-09-23T09:39:32.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.835+0000 7f7adedff700 1 -- 172.21.15.82:0/1665128995 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ad8101260 msgr2=0x7f7ad806ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:39:32.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.835+0000 7f7adedff700 1 --2- 172.21.15.82:0/1665128995 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ad8101260 0x7f7ad806ef80 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f7ac000d950 tx=0x7f7ac000dc60 comp rx=0 tx=0).stop 2023-09-23T09:39:32.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.835+0000 7f7adedff700 1 -- 172.21.15.82:0/1665128995 shutdown_connections 2023-09-23T09:39:32.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.835+0000 7f7adedff700 1 --2- 172.21.15.82:0/1665128995 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f7ac40a01c0 0x7f7ac40a2680 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:39:32.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.835+0000 7f7adedff700 1 --2- 172.21.15.82:0/1665128995 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ad81068b0 0x7f7ad806acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:39:32.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.835+0000 7f7adedff700 1 --2- 172.21.15.82:0/1665128995 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ad81008a0 0x7f7ad806ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:39:32.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.835+0000 7f7adedff700 1 --2- 172.21.15.82:0/1665128995 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ad8101260 0x7f7ad806ef80 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:39:32.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.835+0000 7f7adedff700 1 -- 172.21.15.82:0/1665128995 >> 172.21.15.82:0/1665128995 conn(0x7f7ad80fc390 msgr2=0x7f7ad80fc990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:39:32.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.835+0000 7f7adedff700 1 -- 172.21.15.82:0/1665128995 shutdown_connections 2023-09-23T09:39:32.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:39:32.836+0000 7f7adedff700 1 -- 172.21.15.82:0/1665128995 wait complete. 2023-09-23T09:39:32.865 INFO:tasks.cephfs.filesystem:scrub status for tag:d9e62ab8-1468-4fb0-a9fe-61bed13e954b - {'path': '/', 'tag': 'd9e62ab8-1468-4fb0-a9fe-61bed13e954b', 'options': 'recursive,force'} 2023-09-23T09:39:33.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:39:33 smithi082 ceph-mon[97694]: pgmap v1354: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.5 MiB/s wr, 622 op/s 2023-09-23T09:39:33.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:39:33 smithi161 ceph-mon[99580]: pgmap v1354: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.5 MiB/s wr, 622 op/s 2023-09-23T09:39:33.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:39:33 smithi135 ceph-mon[99205]: pgmap v1354: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.5 MiB/s wr, 622 op/s 2023-09-23T09:39:35.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:39:35 smithi082 ceph-mon[97694]: pgmap v1355: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.3 MiB/s wr, 568 op/s 2023-09-23T09:39:35.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:39:35 smithi161 ceph-mon[99580]: pgmap v1355: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.3 MiB/s wr, 568 op/s 2023-09-23T09:39:35.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:39:35 smithi135 ceph-mon[99205]: pgmap v1355: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.3 MiB/s wr, 568 op/s 2023-09-23T09:39:35.847 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 745.0 s, 191.0 tps, lat 528.192 ms stddev 518.413 2023-09-23T09:39:36.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:39:36 smithi082 ceph-mon[97694]: pgmap v1356: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 3.7 MiB/s rd, 6.6 MiB/s wr, 893 op/s 2023-09-23T09:39:36.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:39:36 smithi161 ceph-mon[99580]: pgmap v1356: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 3.7 MiB/s rd, 6.6 MiB/s wr, 893 op/s 2023-09-23T09:39:36.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:39:36 smithi135 ceph-mon[99205]: pgmap v1356: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 3.7 MiB/s rd, 6.6 MiB/s wr, 893 op/s 2023-09-23T09:39:39.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:39:39 smithi082 ceph-mon[97694]: pgmap v1357: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.5 MiB/s wr, 612 op/s 2023-09-23T09:39:39.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:39:39 smithi161 ceph-mon[99580]: pgmap v1357: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.5 MiB/s wr, 612 op/s 2023-09-23T09:39:39.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:39:39 smithi135 ceph-mon[99205]: pgmap v1357: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.5 MiB/s wr, 612 op/s 2023-09-23T09:39:40.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:39:40 smithi161 ceph-mon[99580]: pgmap v1358: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 3.5 MiB/s rd, 6.8 MiB/s wr, 872 op/s 2023-09-23T09:39:40.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:39:40 smithi135 ceph-mon[99205]: pgmap v1358: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 3.5 MiB/s rd, 6.8 MiB/s wr, 872 op/s 2023-09-23T09:39:40.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 750.0 s, 186.4 tps, lat 535.887 ms stddev 499.434 2023-09-23T09:39:40.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:39:40 smithi082 ceph-mon[97694]: pgmap v1358: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 3.5 MiB/s rd, 6.8 MiB/s wr, 872 op/s 2023-09-23T09:39:43.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:39:43 smithi082 ceph-mon[97694]: pgmap v1359: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.7 MiB/s wr, 733 op/s 2023-09-23T09:39:43.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:39:43 smithi161 ceph-mon[99580]: pgmap v1359: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.7 MiB/s wr, 733 op/s 2023-09-23T09:39:43.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:39:43 smithi135 ceph-mon[99205]: pgmap v1359: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.7 MiB/s wr, 733 op/s 2023-09-23T09:39:45.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:39:45 smithi082 ceph-mon[97694]: pgmap v1360: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.0 MiB/s wr, 659 op/s 2023-09-23T09:39:45.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:39:45 smithi161 ceph-mon[99580]: pgmap v1360: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.0 MiB/s wr, 659 op/s 2023-09-23T09:39:45.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:39:45 smithi135 ceph-mon[99205]: pgmap v1360: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.0 MiB/s wr, 659 op/s 2023-09-23T09:39:45.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 755.0 s, 180.0 tps, lat 544.228 ms stddev 527.894 2023-09-23T09:39:46.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:39:46 smithi082 ceph-mon[97694]: pgmap v1361: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 3.8 MiB/s rd, 7.5 MiB/s wr, 984 op/s 2023-09-23T09:39:46.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:39:46 smithi161 ceph-mon[99580]: pgmap v1361: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 3.8 MiB/s rd, 7.5 MiB/s wr, 984 op/s 2023-09-23T09:39:46.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:39:46 smithi135 ceph-mon[99205]: pgmap v1361: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 3.8 MiB/s rd, 7.5 MiB/s wr, 984 op/s 2023-09-23T09:39:47.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:39:47 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:39:47.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:39:47 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:39:47.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:39:47 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:39:49.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:39:48 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:39:49.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:39:48 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:39:49.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:39:48 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:39:49.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:39:48 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:39:49.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:39:48 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:39:49.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:39:48 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:39:49.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:39:48 smithi135 ceph-mon[99205]: pgmap v1362: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.1 MiB/s wr, 659 op/s 2023-09-23T09:39:49.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:39:48 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:39:49.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:39:48 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:39:49.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:39:48 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:39:49.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:39:48 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:39:49.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:39:48 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:39:49.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:39:48 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:39:49.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:39:48 smithi082 ceph-mon[97694]: pgmap v1362: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.1 MiB/s wr, 659 op/s 2023-09-23T09:39:49.151 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:39:48 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:39:49.151 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:39:48 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:39:49.151 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:39:48 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:39:49.151 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:39:48 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:39:49.151 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:39:48 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:39:49.151 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:39:48 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:39:49.151 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:39:48 smithi161 ceph-mon[99580]: pgmap v1362: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.1 MiB/s wr, 659 op/s 2023-09-23T09:39:50.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:39:49 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:39:50.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:39:49 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:39:50.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:39:49 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:39:50.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:39:49 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:39:50.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:39:49 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:39:50.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:39:49 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:39:50.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:39:49 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:39:50.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:39:49 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:39:50.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:39:49 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:39:50.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 760.0 s, 166.4 tps, lat 609.666 ms stddev 594.470 2023-09-23T09:39:51.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:39:50 smithi135 ceph-mon[99205]: pgmap v1363: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 3.5 MiB/s rd, 7.1 MiB/s wr, 901 op/s 2023-09-23T09:39:51.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:39:50 smithi082 ceph-mon[97694]: pgmap v1363: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 3.5 MiB/s rd, 7.1 MiB/s wr, 901 op/s 2023-09-23T09:39:51.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:39:50 smithi161 ceph-mon[99580]: pgmap v1363: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 3.5 MiB/s rd, 7.1 MiB/s wr, 901 op/s 2023-09-23T09:39:52.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:39:51 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:39:52.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:39:51 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:39:52.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:39:51 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:39:53.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:39:53 smithi082 ceph-mon[97694]: pgmap v1364: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.1 MiB/s wr, 700 op/s 2023-09-23T09:39:53.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:39:53 smithi161 ceph-mon[99580]: pgmap v1364: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.1 MiB/s wr, 700 op/s 2023-09-23T09:39:53.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:39:53 smithi135 ceph-mon[99205]: pgmap v1364: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.1 MiB/s wr, 700 op/s 2023-09-23T09:39:54.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:39:54 smithi161 ceph-mon[99580]: pgmap v1365: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.7 MiB/s wr, 626 op/s 2023-09-23T09:39:54.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:39:54 smithi135 ceph-mon[99205]: pgmap v1365: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.7 MiB/s wr, 626 op/s 2023-09-23T09:39:54.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:39:54 smithi082 ceph-mon[97694]: pgmap v1365: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.7 MiB/s wr, 626 op/s 2023-09-23T09:39:55.827 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 765.0 s, 173.0 tps, lat 575.344 ms stddev 518.768 2023-09-23T09:39:57.314 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:39:56 smithi135 ceph-mon[99205]: pgmap v1366: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 3.4 MiB/s rd, 7.1 MiB/s wr, 934 op/s 2023-09-23T09:39:57.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:39:56 smithi082 ceph-mon[97694]: pgmap v1366: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 3.4 MiB/s rd, 7.1 MiB/s wr, 934 op/s 2023-09-23T09:39:57.396 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:39:56 smithi161 ceph-mon[99580]: pgmap v1366: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 3.4 MiB/s rd, 7.1 MiB/s wr, 934 op/s 2023-09-23T09:39:58.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:39:58 smithi161 ceph-mon[99580]: pgmap v1367: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.6 MiB/s wr, 609 op/s 2023-09-23T09:39:58.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:39:58 smithi135 ceph-mon[99205]: pgmap v1367: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.6 MiB/s wr, 609 op/s 2023-09-23T09:39:58.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:39:58 smithi082 ceph-mon[97694]: pgmap v1367: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.6 MiB/s wr, 609 op/s 2023-09-23T09:40:00.834 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 770.0 s, 160.0 tps, lat 588.909 ms stddev 526.677 2023-09-23T09:40:01.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:40:00 smithi135 ceph-mon[99205]: pgmap v1368: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 3.3 MiB/s rd, 6.9 MiB/s wr, 860 op/s 2023-09-23T09:40:01.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:40:00 smithi135 ceph-mon[99205]: overall HEALTH_OK 2023-09-23T09:40:01.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:40:00 smithi082 ceph-mon[97694]: pgmap v1368: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 3.3 MiB/s rd, 6.9 MiB/s wr, 860 op/s 2023-09-23T09:40:01.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:40:00 smithi082 ceph-mon[97694]: overall HEALTH_OK 2023-09-23T09:40:01.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:40:00 smithi161 ceph-mon[99580]: pgmap v1368: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 3.3 MiB/s rd, 6.9 MiB/s wr, 860 op/s 2023-09-23T09:40:01.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:40:00 smithi161 ceph-mon[99580]: overall HEALTH_OK 2023-09-23T09:40:02.868 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:40:03.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.142+0000 7fe3dedff700 1 -- 172.21.15.82:0/813210379 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3d810d110 msgr2=0x7fe3d810f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:40:03.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.142+0000 7fe3dedff700 1 --2- 172.21.15.82:0/813210379 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3d810d110 0x7fe3d810f540 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fe3d000b0a0 tx=0x7fe3d000b3b0 comp rx=0 tx=0).stop 2023-09-23T09:40:03.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.142+0000 7fe3dedff700 1 -- 172.21.15.82:0/813210379 shutdown_connections 2023-09-23T09:40:03.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.142+0000 7fe3dedff700 1 --2- 172.21.15.82:0/813210379 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3d810d110 0x7fe3d810f540 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:40:03.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.142+0000 7fe3dedff700 1 --2- 172.21.15.82:0/813210379 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3d8072cf0 0x7fe3d80730d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:40:03.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.142+0000 7fe3dedff700 1 --2- 172.21.15.82:0/813210379 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3d8073610 0x7fe3d810cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:40:03.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.142+0000 7fe3dedff700 1 -- 172.21.15.82:0/813210379 >> 172.21.15.82:0/813210379 conn(0x7fe3d80fc3c0 msgr2=0x7fe3d80fe7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:40:03.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.142+0000 7fe3dedff700 1 -- 172.21.15.82:0/813210379 shutdown_connections 2023-09-23T09:40:03.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.142+0000 7fe3dedff700 1 -- 172.21.15.82:0/813210379 wait complete. 2023-09-23T09:40:03.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.144+0000 7fe3dedff700 1 Processor -- start 2023-09-23T09:40:03.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.144+0000 7fe3dedff700 1 -- start start 2023-09-23T09:40:03.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.145+0000 7fe3dedff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3d8072cf0 0x7fe3d8198ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:40:03.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.145+0000 7fe3dedff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3d8073610 0x7fe3d8199220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:40:03.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.145+0000 7fe3dedff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3d810d110 0x7fe3d819c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:40:03.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.145+0000 7fe3dedff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d819cbd0 con 0x7fe3d810d110 2023-09-23T09:40:03.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.145+0000 7fe3dedff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d819cd40 con 0x7fe3d8073610 2023-09-23T09:40:03.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.145+0000 7fe3dedff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d819cf00 con 0x7fe3d8072cf0 2023-09-23T09:40:03.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.145+0000 7fe3dcb9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3d8072cf0 0x7fe3d8198ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:40:03.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.145+0000 7fe3dcb9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3d8072cf0 0x7fe3d8198ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:60680/0 (socket says 172.21.15.82:60680) 2023-09-23T09:40:03.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.145+0000 7fe3dcb9b700 1 -- 172.21.15.82:0/3513695962 learned_addr learned my addr 172.21.15.82:0/3513695962 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:40:03.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.146+0000 7fe3d7fff700 1 --2- 172.21.15.82:0/3513695962 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3d8073610 0x7fe3d8199220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:40:03.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.146+0000 7fe3dd39c700 1 --2- 172.21.15.82:0/3513695962 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3d810d110 0x7fe3d819c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:40:03.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.146+0000 7fe3dcb9b700 1 -- 172.21.15.82:0/3513695962 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3d8073610 msgr2=0x7fe3d8199220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:40:03.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.146+0000 7fe3dcb9b700 1 --2- 172.21.15.82:0/3513695962 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3d8073610 0x7fe3d8199220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:40:03.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.146+0000 7fe3dcb9b700 1 -- 172.21.15.82:0/3513695962 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3d810d110 msgr2=0x7fe3d819c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:40:03.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.146+0000 7fe3dcb9b700 1 --2- 172.21.15.82:0/3513695962 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3d810d110 0x7fe3d819c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:40:03.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.146+0000 7fe3dcb9b700 1 -- 172.21.15.82:0/3513695962 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3d0009d00 con 0x7fe3d8072cf0 2023-09-23T09:40:03.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.146+0000 7fe3dcb9b700 1 --2- 172.21.15.82:0/3513695962 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3d8072cf0 0x7fe3d8198ce0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc00e9a0 tx=0x7fe3cc00ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:40:03.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.147+0000 7fe3d5ffb700 1 -- 172.21.15.82:0/3513695962 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc009790 con 0x7fe3d8072cf0 2023-09-23T09:40:03.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.147+0000 7fe3d5ffb700 1 -- 172.21.15.82:0/3513695962 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe3cc00cbd0 con 0x7fe3d8072cf0 2023-09-23T09:40:03.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.147+0000 7fe3d5ffb700 1 -- 172.21.15.82:0/3513695962 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc018680 con 0x7fe3d8072cf0 2023-09-23T09:40:03.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.147+0000 7fe3dedff700 1 -- 172.21.15.82:0/3513695962 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3d819d1e0 con 0x7fe3d8072cf0 2023-09-23T09:40:03.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.147+0000 7fe3dedff700 1 -- 172.21.15.82:0/3513695962 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3d81a5b40 con 0x7fe3d8072cf0 2023-09-23T09:40:03.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.152+0000 7fe3d5ffb700 1 -- 172.21.15.82:0/3513695962 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7fe3cc00cd40 con 0x7fe3d8072cf0 2023-09-23T09:40:03.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.154+0000 7fe3f277cb80 1 Processor -- start 2023-09-23T09:40:03.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.154+0000 7fe3f277cb80 1 -- start start 2023-09-23T09:40:03.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.154+0000 7fe3f277cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a683893380 0x55a683893760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:40:03.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.154+0000 7fe3f277cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a683893ca0 0x55a68388d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:40:03.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.154+0000 7fe3f277cb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a68388dc40 0x55a68388e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:40:03.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.154+0000 7fe3f277cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6837f57b0 con 0x55a683893ca0 2023-09-23T09:40:03.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.154+0000 7fe3f277cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6837e6780 con 0x55a683893380 2023-09-23T09:40:03.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.154+0000 7fe3f277cb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6837e40a0 con 0x55a68388dc40 2023-09-23T09:40:03.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.155+0000 7fe3d5ffb700 1 --2- 172.21.15.82:0/3513695962 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fe3c80a0140 0x7fe3c80a2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:40:03.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.155+0000 7fe3dcb9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a683893ca0 0x55a68388d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:40:03.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.155+0000 7fe3d7fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a68388dc40 0x55a68388e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:40:03.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.155+0000 7fe3d7fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a68388dc40 0x55a68388e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:60696/0 (socket says 172.21.15.82:60696) 2023-09-23T09:40:03.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.155+0000 7fe3d7fff700 1 -- 172.21.15.82:0/991262867 learned_addr learned my addr 172.21.15.82:0/991262867 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:40:03.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.155+0000 7fe3d5ffb700 1 -- 172.21.15.82:0/3513695962 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fe3cc014070 con 0x7fe3d8072cf0 2023-09-23T09:40:03.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.155+0000 7fe3dd39c700 1 --2- 172.21.15.82:0/991262867 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a683893380 0x55a683893760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:40:03.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.155+0000 7fe3dd39c700 1 --2- 172.21.15.82:0/3513695962 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fe3c80a0140 0x7fe3c80a2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:40:03.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.155+0000 7fe3dcb9b700 1 -- 172.21.15.82:0/991262867 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a68388dc40 msgr2=0x55a68388e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:40:03.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.155+0000 7fe3dcb9b700 1 --2- 172.21.15.82:0/991262867 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a68388dc40 0x55a68388e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:40:03.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.155+0000 7fe3dcb9b700 1 -- 172.21.15.82:0/991262867 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a683893380 msgr2=0x55a683893760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:40:03.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.155+0000 7fe3dcb9b700 1 --2- 172.21.15.82:0/991262867 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a683893380 0x55a683893760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:40:03.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.155+0000 7fe3dcb9b700 1 -- 172.21.15.82:0/991262867 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a68365f630 con 0x55a683893ca0 2023-09-23T09:40:03.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.155+0000 7fe3dd39c700 1 --2- 172.21.15.82:0/991262867 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a683893380 0x55a683893760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:40:03.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.156+0000 7fe3dcb9b700 1 --2- 172.21.15.82:0/991262867 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a683893ca0 0x55a68388d700 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc0c8fd0 tx=0x7fe3cc064a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59b32dc61e39317d server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:40:03.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.156+0000 7fe3c2ffd700 1 -- 172.21.15.82:0/991262867 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc025170 con 0x55a683893ca0 2023-09-23T09:40:03.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.156+0000 7fe3dd39c700 1 --2- 172.21.15.82:0/3513695962 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fe3c80a0140 0x7fe3c80a2600 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe3d0009cd0 tx=0x7fe3d00099e0 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:40:03.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.156+0000 7fe3c2ffd700 1 -- 172.21.15.82:0/991262867 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe3cc064f30 con 0x55a683893ca0 2023-09-23T09:40:03.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.156+0000 7fe3c2ffd700 1 -- 172.21.15.82:0/991262867 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc064cf0 con 0x55a683893ca0 2023-09-23T09:40:03.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.157+0000 7fe3f277cb80 1 -- 172.21.15.82:0/991262867 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a683893ca0 msgr2=0x55a68388d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:40:03.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.157+0000 7fe3f277cb80 1 --2- 172.21.15.82:0/991262867 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a683893ca0 0x55a68388d700 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc0c8fd0 tx=0x7fe3cc064a20 comp rx=0 tx=0).stop 2023-09-23T09:40:03.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.157+0000 7fe3f277cb80 1 -- 172.21.15.82:0/991262867 shutdown_connections 2023-09-23T09:40:03.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.157+0000 7fe3f277cb80 1 --2- 172.21.15.82:0/991262867 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a68388dc40 0x55a68388e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:40:03.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.157+0000 7fe3f277cb80 1 --2- 172.21.15.82:0/991262867 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a683893380 0x55a683893760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:40:03.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.157+0000 7fe3f277cb80 1 --2- 172.21.15.82:0/991262867 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a683893ca0 0x55a68388d700 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:40:03.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.157+0000 7fe3f277cb80 1 -- 172.21.15.82:0/991262867 >> 172.21.15.82:0/991262867 conn(0x55a6838020e0 msgr2=0x55a683888410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:40:03.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.157+0000 7fe3f277cb80 1 -- 172.21.15.82:0/991262867 shutdown_connections 2023-09-23T09:40:03.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.157+0000 7fe3f277cb80 1 -- 172.21.15.82:0/991262867 wait complete. 2023-09-23T09:40:03.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.158+0000 7fe3f277cb80 1 -- start start 2023-09-23T09:40:03.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.158+0000 7fe3f277cb80 1 Processor -- start 2023-09-23T09:40:03.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.158+0000 7fe3f277cb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a68388dc40 0x55a683899c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:40:03.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.158+0000 7fe3f277cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a683893380 0x55a683896ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:40:03.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.158+0000 7fe3f277cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a683893ca0 0x55a683897600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:40:03.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.158+0000 7fe3f277cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6837df990 con 0x55a683893ca0 2023-09-23T09:40:03.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.158+0000 7fe3f277cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a68377dbb0 con 0x55a683893380 2023-09-23T09:40:03.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.158+0000 7fe3f277cb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a68377d8b0 con 0x55a68388dc40 2023-09-23T09:40:03.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.159+0000 7fe3f277cb80 10 client.0 _ll_register_callbacks cb 0x55a6836c7a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:40:03.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.159+0000 7fe3dcb9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a68388dc40 0x55a683899c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:40:03.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.159+0000 7fe3d7fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a683893380 0x55a683896ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:40:03.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.159+0000 7fe3dcb9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a68388dc40 0x55a683899c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:60700/0 (socket says 172.21.15.82:60700) 2023-09-23T09:40:03.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.159+0000 7fe3dcb9b700 1 -- 172.21.15.82:0/3147943539 learned_addr learned my addr 172.21.15.82:0/3147943539 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:40:03.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.159+0000 7fe3dd39c700 1 --2- 172.21.15.82:0/3147943539 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a683893ca0 0x55a683897600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:40:03.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.159+0000 7fe3dcb9b700 1 -- 172.21.15.82:0/3147943539 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a683893380 msgr2=0x55a683896ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:40:03.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.159+0000 7fe3dcb9b700 1 --2- 172.21.15.82:0/3147943539 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a683893380 0x55a683896ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:40:03.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.159+0000 7fe3dcb9b700 1 -- 172.21.15.82:0/3147943539 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a683893ca0 msgr2=0x55a683897600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:40:03.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.159+0000 7fe3dcb9b700 1 --2- 172.21.15.82:0/3147943539 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a683893ca0 0x55a683897600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:40:03.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.159+0000 7fe3dcb9b700 1 -- 172.21.15.82:0/3147943539 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3d81a5b40 con 0x55a68388dc40 2023-09-23T09:40:03.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.159+0000 7fe3dd39c700 1 --2- 172.21.15.82:0/3147943539 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a683893ca0 0x55a683897600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:40:03.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.160+0000 7fe3dcb9b700 1 --2- 172.21.15.82:0/3147943539 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a68388dc40 0x55a683899c40 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc098c90 tx=0x7fe3cc0986b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d4f815be82f4160 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:40:03.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.160+0000 7fe3b7fff700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T09:40:03.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.160+0000 7fe3b7fff700 1 -- 172.21.15.82:0/3147943539 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc099690 con 0x55a68388dc40 2023-09-23T09:40:03.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.160+0000 7fe3b7fff700 1 -- 172.21.15.82:0/3147943539 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(161..161 src has 1..161) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fe3cc09cdc0 con 0x55a68388dc40 2023-09-23T09:40:03.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.160+0000 7fe3f277cb80 1 -- 172.21.15.82:0/3147943539 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a68385d1c0 con 0x55a68388dc40 2023-09-23T09:40:03.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.160+0000 7fe3b7fff700 1 -- 172.21.15.82:0/3147943539 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=132) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe3cc0a0da0 con 0x55a68388dc40 2023-09-23T09:40:03.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.160+0000 7fe3f277cb80 10 client.27922 fetch_fsmap learned FSMap version 132 2023-09-23T09:40:03.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.160+0000 7fe3f277cb80 1 -- 172.21.15.82:0/3147943539 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=132,monmap=4+}) v3 -- 0x55a68360bde0 con 0x55a68388dc40 2023-09-23T09:40:03.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.161+0000 7fe3b7fff700 1 -- 172.21.15.82:0/3147943539 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55a68385d1c0 con 0x55a68388dc40 2023-09-23T09:40:03.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.161+0000 7fe3b7fff700 1 -- 172.21.15.82:0/3147943539 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 132) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fe3cc093ba0 con 0x55a68388dc40 2023-09-23T09:40:03.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.161+0000 7fe3f277cb80 10 client.27922 fetch_fsmap finished waiting for FSMap version 132 2023-09-23T09:40:03.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.161+0000 7fe3f277cb80 10 client.27922 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:40:03.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.161+0000 7fe3f277cb80 20 client.27922 populate_metadata read hostname 'smithi082' 2023-09-23T09:40:03.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.161+0000 7fe3f277cb80 1 --2- 172.21.15.82:0/3147943539 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55a6838a7410 0x55a6838a9830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:40:03.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.161+0000 7fe3f277cb80 4 client.27922 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:40:03.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.161+0000 7fe3f277cb80 1 -- 172.21.15.82:0/3147943539 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a683785ba0 con 0x55a6838a7410 2023-09-23T09:40:03.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.161+0000 7fe3d7fff700 1 --2- 172.21.15.82:0/3147943539 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55a6838a7410 0x55a6838a9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:40:03.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.162+0000 7fe3d7fff700 1 --2- 172.21.15.82:0/3147943539 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55a6838a7410 0x55a6838a9830 crc :-1 s=READY pgs=269 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=72caa4ace0d9df00 server_cookie=d6f3d300e777ee44 in_seq=0 out_seq=0 2023-09-23T09:40:03.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.162+0000 7fe3b7fff700 10 client.27922 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:40:03.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.163+0000 7fe3b7fff700 1 -- 172.21.15.82:0/3147943539 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a683785ba0 con 0x55a6838a7410 2023-09-23T09:40:03.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.163+0000 7fe3b7fff700 10 client.27922 handle_command_reply: tid=0 2023-09-23T09:40:03.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.163+0000 7fe3f277cb80 1 client.27922 shutdown 2023-09-23T09:40:03.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.163+0000 7fe3f277cb80 1 -- 172.21.15.82:0/3147943539 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a68388dc40 msgr2=0x55a683899c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:40:03.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.163+0000 7fe3f277cb80 1 --2- 172.21.15.82:0/3147943539 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a68388dc40 0x55a683899c40 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc098c90 tx=0x7fe3cc0986b0 comp rx=0 tx=0).stop 2023-09-23T09:40:03.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.164+0000 7fe3f277cb80 1 -- 172.21.15.82:0/3147943539 shutdown_connections 2023-09-23T09:40:03.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.164+0000 7fe3f277cb80 1 --2- 172.21.15.82:0/3147943539 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55a6838a7410 0x55a6838a9830 crc :-1 s=READY pgs=269 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:40:03.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.164+0000 7fe3f277cb80 1 --2- 172.21.15.82:0/3147943539 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a683893ca0 0x55a683897600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:40:03.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.164+0000 7fe3f277cb80 1 --2- 172.21.15.82:0/3147943539 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a68388dc40 0x55a683899c40 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:40:03.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.164+0000 7fe3f277cb80 1 --2- 172.21.15.82:0/3147943539 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a683893380 0x55a683896ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:40:03.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.164+0000 7fe3f277cb80 1 -- 172.21.15.82:0/3147943539 >> 172.21.15.82:0/3147943539 conn(0x55a6838020e0 msgr2=0x55a6838822b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:40:03.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.164+0000 7fe3b7fff700 0 client.27922 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:40:03.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.164+0000 7fe3f277cb80 1 -- 172.21.15.82:0/3147943539 shutdown_connections 2023-09-23T09:40:03.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.164+0000 7fe3f277cb80 1 -- 172.21.15.82:0/3147943539 wait complete. 2023-09-23T09:40:03.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.165+0000 7fe3f277cb80 20 client.27922 trim_cache size 0 max 16384 2023-09-23T09:40:03.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.186+0000 7fe3f277cb80 1 Processor -- start 2023-09-23T09:40:03.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.186+0000 7fe3f277cb80 1 -- start start 2023-09-23T09:40:03.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.187+0000 7fe3f277cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a68388dc40 0x55a6838997e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:40:03.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.187+0000 7fe3f277cb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a683893380 0x55a683896430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:40:03.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.187+0000 7fe3f277cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a683893ca0 0x55a683890fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:40:03.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.187+0000 7fe3f277cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a683661920 con 0x55a68388dc40 2023-09-23T09:40:03.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.187+0000 7fe3f277cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6838891b0 con 0x55a683893ca0 2023-09-23T09:40:03.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.187+0000 7fe3f277cb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a683884d00 con 0x55a683893380 2023-09-23T09:40:03.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.187+0000 7fe3dcb9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a68388dc40 0x55a6838997e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:40:03.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.187+0000 7fe3dcb9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a68388dc40 0x55a6838997e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38602/0 (socket says 172.21.15.82:38602) 2023-09-23T09:40:03.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.187+0000 7fe3dcb9b700 1 -- 172.21.15.82:0/3182173318 learned_addr learned my addr 172.21.15.82:0/3182173318 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:40:03.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.187+0000 7fe3d7fff700 1 --2- 172.21.15.82:0/3182173318 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a683893380 0x55a683896430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:40:03.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.187+0000 7fe3dd39c700 1 --2- 172.21.15.82:0/3182173318 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a683893ca0 0x55a683890fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:40:03.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.187+0000 7fe3dcb9b700 1 -- 172.21.15.82:0/3182173318 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a683893380 msgr2=0x55a683896430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:40:03.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.187+0000 7fe3dcb9b700 1 --2- 172.21.15.82:0/3182173318 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a683893380 0x55a683896430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:40:03.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.187+0000 7fe3dcb9b700 1 -- 172.21.15.82:0/3182173318 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a683893ca0 msgr2=0x55a683890fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:40:03.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.187+0000 7fe3dcb9b700 1 --2- 172.21.15.82:0/3182173318 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a683893ca0 0x55a683890fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:40:03.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.188+0000 7fe3dcb9b700 1 -- 172.21.15.82:0/3182173318 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a6835f4c60 con 0x55a68388dc40 2023-09-23T09:40:03.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.188+0000 7fe3dcb9b700 1 --2- 172.21.15.82:0/3182173318 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a68388dc40 0x55a6838997e0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc095490 tx=0x7fe3cc0c9080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53eea507616fe75c server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:40:03.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.188+0000 7fe3c37fe700 1 -- 172.21.15.82:0/3182173318 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc098d60 con 0x55a68388dc40 2023-09-23T09:40:03.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.188+0000 7fe3c37fe700 1 -- 172.21.15.82:0/3182173318 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe3cc0a0da0 con 0x55a68388dc40 2023-09-23T09:40:03.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.188+0000 7fe3c37fe700 1 -- 172.21.15.82:0/3182173318 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc093ba0 con 0x55a68388dc40 2023-09-23T09:40:03.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.189+0000 7fe3f277cb80 1 -- 172.21.15.82:0/3182173318 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a68388dc40 msgr2=0x55a6838997e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:40:03.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.189+0000 7fe3f277cb80 1 --2- 172.21.15.82:0/3182173318 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a68388dc40 0x55a6838997e0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc095490 tx=0x7fe3cc0c9080 comp rx=0 tx=0).stop 2023-09-23T09:40:03.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.189+0000 7fe3f277cb80 1 -- 172.21.15.82:0/3182173318 shutdown_connections 2023-09-23T09:40:03.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.189+0000 7fe3f277cb80 1 --2- 172.21.15.82:0/3182173318 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a683893ca0 0x55a683890fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:40:03.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.189+0000 7fe3f277cb80 1 --2- 172.21.15.82:0/3182173318 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a68388dc40 0x55a6838997e0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:40:03.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.189+0000 7fe3f277cb80 1 --2- 172.21.15.82:0/3182173318 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a683893380 0x55a683896430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:40:03.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.189+0000 7fe3f277cb80 1 -- 172.21.15.82:0/3182173318 >> 172.21.15.82:0/3182173318 conn(0x55a6838020e0 msgr2=0x55a683888180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:40:03.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.189+0000 7fe3f277cb80 1 -- 172.21.15.82:0/3182173318 shutdown_connections 2023-09-23T09:40:03.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.189+0000 7fe3f277cb80 1 -- 172.21.15.82:0/3182173318 wait complete. 2023-09-23T09:40:03.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.189+0000 7fe3f277cb80 1 -- start start 2023-09-23T09:40:03.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.190+0000 7fe3f277cb80 1 Processor -- start 2023-09-23T09:40:03.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.190+0000 7fe3f277cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a68388dc40 0x55a68388fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:40:03.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.190+0000 7fe3f277cb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a683893380 0x55a683890430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:40:03.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.190+0000 7fe3f277cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a683893ca0 0x55a68388ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:40:03.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.190+0000 7fe3f277cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a68389eab0 con 0x55a68388dc40 2023-09-23T09:40:03.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.190+0000 7fe3f277cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a68389ebf0 con 0x55a683893ca0 2023-09-23T09:40:03.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.190+0000 7fe3f277cb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a68388f340 con 0x55a683893380 2023-09-23T09:40:03.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.190+0000 7fe3f277cb80 10 client.0 _ll_register_callbacks cb 0x55a6836c7a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:40:03.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.190+0000 7fe3dcb9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a68388dc40 0x55a68388fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:40:03.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.190+0000 7fe3dcb9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a68388dc40 0x55a68388fef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38616/0 (socket says 172.21.15.82:38616) 2023-09-23T09:40:03.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.190+0000 7fe3dcb9b700 1 -- 172.21.15.82:0/2961806632 learned_addr learned my addr 172.21.15.82:0/2961806632 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:40:03.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.191+0000 7fe3d7fff700 1 --2- 172.21.15.82:0/2961806632 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a683893380 0x55a683890430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:40:03.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.191+0000 7fe3dd39c700 1 --2- 172.21.15.82:0/2961806632 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a683893ca0 0x55a68388ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:40:03.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.191+0000 7fe3dcb9b700 1 -- 172.21.15.82:0/2961806632 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a683893380 msgr2=0x55a683890430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:40:03.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.191+0000 7fe3dcb9b700 1 --2- 172.21.15.82:0/2961806632 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a683893380 0x55a683890430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:40:03.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.191+0000 7fe3dcb9b700 1 -- 172.21.15.82:0/2961806632 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a683893ca0 msgr2=0x55a68388ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:40:03.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.191+0000 7fe3dcb9b700 1 --2- 172.21.15.82:0/2961806632 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a683893ca0 0x55a68388ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:40:03.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.191+0000 7fe3dcb9b700 1 -- 172.21.15.82:0/2961806632 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a68360bde0 con 0x55a68388dc40 2023-09-23T09:40:03.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.191+0000 7fe3dcb9b700 1 --2- 172.21.15.82:0/2961806632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a68388dc40 0x55a68388fef0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc0953c0 tx=0x7fe3cc0a0cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=594b92b37becece server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:40:03.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.191+0000 7fe3b7fff700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:40:03.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.191+0000 7fe3b7fff700 1 -- 172.21.15.82:0/2961806632 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc09cdc0 con 0x55a68388dc40 2023-09-23T09:40:03.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.191+0000 7fe3b7fff700 1 -- 172.21.15.82:0/2961806632 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(161..161 src has 1..161) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fe3cc098f90 con 0x55a68388dc40 2023-09-23T09:40:03.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.191+0000 7fe3f277cb80 1 -- 172.21.15.82:0/2961806632 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a6838808b0 con 0x55a68388dc40 2023-09-23T09:40:03.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.192+0000 7fe3b7fff700 1 -- 172.21.15.82:0/2961806632 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=132) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe3cc093ba0 con 0x55a68388dc40 2023-09-23T09:40:03.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.192+0000 7fe3f277cb80 10 client.18150 fetch_fsmap learned FSMap version 132 2023-09-23T09:40:03.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.192+0000 7fe3f277cb80 1 -- 172.21.15.82:0/2961806632 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=132,monmap=4+}) v3 -- 0x55a683632250 con 0x55a68388dc40 2023-09-23T09:40:03.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.192+0000 7fe3b7fff700 1 -- 172.21.15.82:0/2961806632 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55a6838808b0 con 0x55a68388dc40 2023-09-23T09:40:03.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.192+0000 7fe3b7fff700 1 -- 172.21.15.82:0/2961806632 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 132) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fe3cc097ef0 con 0x55a68388dc40 2023-09-23T09:40:03.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.192+0000 7fe3f277cb80 10 client.18150 fetch_fsmap finished waiting for FSMap version 132 2023-09-23T09:40:03.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.192+0000 7fe3f277cb80 10 client.18150 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:40:03.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.192+0000 7fe3f277cb80 20 client.18150 populate_metadata read hostname 'smithi082' 2023-09-23T09:40:03.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.192+0000 7fe3f277cb80 1 --2- 172.21.15.82:0/2961806632 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55a6838fb910 0x55a6838fdd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:40:03.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.192+0000 7fe3f277cb80 4 client.18150 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:40:03.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.192+0000 7fe3f277cb80 1 -- 172.21.15.82:0/2961806632 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55a6837d8970 con 0x55a6838fb910 2023-09-23T09:40:03.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.193+0000 7fe3d7fff700 1 --2- 172.21.15.82:0/2961806632 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55a6838fb910 0x55a6838fdd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:40:03.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.194+0000 7fe3d7fff700 1 --2- 172.21.15.82:0/2961806632 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55a6838fb910 0x55a6838fdd00 crc :-1 s=READY pgs=270 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d49cb6fba6f301c6 server_cookie=a25578a4a973c0c1 in_seq=0 out_seq=0 2023-09-23T09:40:03.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.194+0000 7fe3b7fff700 10 client.18150 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:40:03.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.194+0000 7fe3b7fff700 1 -- 172.21.15.82:0/2961806632 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55a6837d8970 con 0x55a6838fb910 2023-09-23T09:40:03.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.194+0000 7fe3b7fff700 10 client.18150 handle_command_reply: tid=0 2023-09-23T09:40:03.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.194+0000 7fe3f277cb80 1 client.18150 shutdown 2023-09-23T09:40:03.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.194+0000 7fe3f277cb80 1 -- 172.21.15.82:0/2961806632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a68388dc40 msgr2=0x55a68388fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:40:03.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.194+0000 7fe3f277cb80 1 --2- 172.21.15.82:0/2961806632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a68388dc40 0x55a68388fef0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc0953c0 tx=0x7fe3cc0a0cd0 comp rx=0 tx=0).stop 2023-09-23T09:40:03.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.195+0000 7fe3f277cb80 1 -- 172.21.15.82:0/2961806632 shutdown_connections 2023-09-23T09:40:03.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.195+0000 7fe3f277cb80 1 --2- 172.21.15.82:0/2961806632 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a683893ca0 0x55a68388ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:40:03.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.195+0000 7fe3f277cb80 1 --2- 172.21.15.82:0/2961806632 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55a6838fb910 0x55a6838fdd00 crc :-1 s=READY pgs=270 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:40:03.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.195+0000 7fe3f277cb80 1 --2- 172.21.15.82:0/2961806632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a68388dc40 0x55a68388fef0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:40:03.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.195+0000 7fe3f277cb80 1 --2- 172.21.15.82:0/2961806632 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a683893380 0x55a683890430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:40:03.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.195+0000 7fe3f277cb80 1 -- 172.21.15.82:0/2961806632 >> 172.21.15.82:0/2961806632 conn(0x55a6838020e0 msgr2=0x55a683890fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:40:03.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.195+0000 7fe3b7fff700 0 client.18150 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:40:03.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.195+0000 7fe3f277cb80 1 -- 172.21.15.82:0/2961806632 shutdown_connections 2023-09-23T09:40:03.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.195+0000 7fe3f277cb80 1 -- 172.21.15.82:0/2961806632 wait complete. 2023-09-23T09:40:03.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.195+0000 7fe3f277cb80 20 client.18150 trim_cache size 0 max 16384 2023-09-23T09:40:03.200 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:40:03.200 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-23T09:40:03.200 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:40:03.200 INFO:teuthology.orchestra.run.smithi082.stdout: "d9e62ab8-1468-4fb0-a9fe-61bed13e954b": { 2023-09-23T09:40:03.200 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:40:03.200 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "d9e62ab8-1468-4fb0-a9fe-61bed13e954b", 2023-09-23T09:40:03.201 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:40:03.201 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:40:03.201 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:40:03.201 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:40:03.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.196+0000 7fe3dedff700 1 -- 172.21.15.82:0/3513695962 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fe3c80a0140 msgr2=0x7fe3c80a2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:40:03.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.196+0000 7fe3dedff700 1 --2- 172.21.15.82:0/3513695962 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fe3c80a0140 0x7fe3c80a2600 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe3d0009cd0 tx=0x7fe3d00099e0 comp rx=0 tx=0).stop 2023-09-23T09:40:03.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.196+0000 7fe3dedff700 1 -- 172.21.15.82:0/3513695962 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3d8072cf0 msgr2=0x7fe3d8198ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:40:03.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.196+0000 7fe3dedff700 1 --2- 172.21.15.82:0/3513695962 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3d8072cf0 0x7fe3d8198ce0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc00e9a0 tx=0x7fe3cc00ecb0 comp rx=0 tx=0).stop 2023-09-23T09:40:03.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.196+0000 7fe3dedff700 1 -- 172.21.15.82:0/3513695962 shutdown_connections 2023-09-23T09:40:03.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.196+0000 7fe3dedff700 1 --2- 172.21.15.82:0/3513695962 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fe3c80a0140 0x7fe3c80a2600 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:40:03.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.196+0000 7fe3dedff700 1 --2- 172.21.15.82:0/3513695962 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3d810d110 0x7fe3d819c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:40:03.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.196+0000 7fe3dedff700 1 --2- 172.21.15.82:0/3513695962 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3d8072cf0 0x7fe3d8198ce0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:40:03.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.196+0000 7fe3dedff700 1 --2- 172.21.15.82:0/3513695962 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3d8073610 0x7fe3d8199220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:40:03.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.196+0000 7fe3dedff700 1 -- 172.21.15.82:0/3513695962 >> 172.21.15.82:0/3513695962 conn(0x7fe3d80fc3c0 msgr2=0x7fe3d810f320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:40:03.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.196+0000 7fe3dedff700 1 -- 172.21.15.82:0/3513695962 shutdown_connections 2023-09-23T09:40:03.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:03.196+0000 7fe3dedff700 1 -- 172.21.15.82:0/3513695962 wait complete. 2023-09-23T09:40:03.222 INFO:tasks.cephfs.filesystem:scrub status for tag:d9e62ab8-1468-4fb0-a9fe-61bed13e954b - {'path': '/', 'tag': 'd9e62ab8-1468-4fb0-a9fe-61bed13e954b', 'options': 'recursive,force'} 2023-09-23T09:40:03.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:40:03 smithi082 ceph-mon[97694]: pgmap v1369: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.1 MiB/s wr, 679 op/s 2023-09-23T09:40:03.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:40:03 smithi161 ceph-mon[99580]: pgmap v1369: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.1 MiB/s wr, 679 op/s 2023-09-23T09:40:03.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:40:03 smithi135 ceph-mon[99205]: pgmap v1369: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.1 MiB/s wr, 679 op/s 2023-09-23T09:40:04.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:40:04 smithi082 ceph-mon[97694]: pgmap v1370: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.9 MiB/s wr, 619 op/s 2023-09-23T09:40:04.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:40:04 smithi161 ceph-mon[99580]: pgmap v1370: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.9 MiB/s wr, 619 op/s 2023-09-23T09:40:04.810 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:40:04 smithi135 ceph-mon[99205]: pgmap v1370: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.9 MiB/s wr, 619 op/s 2023-09-23T09:40:05.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 775.0 s, 101.8 tps, lat 983.445 ms stddev 1033.069 2023-09-23T09:40:07.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:40:06 smithi135 ceph-mon[99205]: pgmap v1371: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1020 GiB / 1.0 TiB avail; 3.1 MiB/s rd, 6.7 MiB/s wr, 874 op/s 2023-09-23T09:40:07.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:40:06 smithi135 ceph-mon[99205]: osdmap e162: 12 total, 12 up, 12 in 2023-09-23T09:40:07.373 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:40:06 smithi082 ceph-mon[97694]: pgmap v1371: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1020 GiB / 1.0 TiB avail; 3.1 MiB/s rd, 6.7 MiB/s wr, 874 op/s 2023-09-23T09:40:07.373 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:40:06 smithi082 ceph-mon[97694]: osdmap e162: 12 total, 12 up, 12 in 2023-09-23T09:40:07.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:40:06 smithi161 ceph-mon[99580]: pgmap v1371: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1020 GiB / 1.0 TiB avail; 3.1 MiB/s rd, 6.7 MiB/s wr, 874 op/s 2023-09-23T09:40:07.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:40:06 smithi161 ceph-mon[99580]: osdmap e162: 12 total, 12 up, 12 in 2023-09-23T09:40:08.816 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:40:08 smithi135 ceph-mon[99205]: pgmap v1373: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1020 GiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.3 MiB/s wr, 679 op/s 2023-09-23T09:40:08.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:40:08 smithi082 ceph-mon[97694]: pgmap v1373: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1020 GiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.3 MiB/s wr, 679 op/s 2023-09-23T09:40:08.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:40:08 smithi161 ceph-mon[99580]: pgmap v1373: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1020 GiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.3 MiB/s wr, 679 op/s 2023-09-23T09:40:10.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 780.0 s, 30.8 tps, lat 2176.510 ms stddev 2076.094 2023-09-23T09:40:11.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:40:10 smithi135 ceph-mon[99205]: pgmap v1374: 97 pgs: 11 active+clean+snaptrim_wait, 5 active+clean+snaptrim, 81 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.4 MiB/s wr, 464 op/s 2023-09-23T09:40:11.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:40:10 smithi082 ceph-mon[97694]: pgmap v1374: 97 pgs: 11 active+clean+snaptrim_wait, 5 active+clean+snaptrim, 81 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.4 MiB/s wr, 464 op/s 2023-09-23T09:40:11.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:40:10 smithi161 ceph-mon[99580]: pgmap v1374: 97 pgs: 11 active+clean+snaptrim_wait, 5 active+clean+snaptrim, 81 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.4 MiB/s wr, 464 op/s 2023-09-23T09:40:13.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:40:13 smithi082 ceph-mon[97694]: pgmap v1375: 97 pgs: 17 active+clean+snaptrim_wait, 8 active+clean+snaptrim, 72 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.3 MiB/s wr, 418 op/s 2023-09-23T09:40:13.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:40:13 smithi161 ceph-mon[99580]: pgmap v1375: 97 pgs: 17 active+clean+snaptrim_wait, 8 active+clean+snaptrim, 72 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.3 MiB/s wr, 418 op/s 2023-09-23T09:40:13.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:40:13 smithi135 ceph-mon[99205]: pgmap v1375: 97 pgs: 17 active+clean+snaptrim_wait, 8 active+clean+snaptrim, 72 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.3 MiB/s wr, 418 op/s 2023-09-23T09:40:15.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:40:15 smithi082 ceph-mon[97694]: pgmap v1376: 97 pgs: 17 active+clean+snaptrim_wait, 8 active+clean+snaptrim, 72 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.3 MiB/s wr, 418 op/s 2023-09-23T09:40:15.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:40:15 smithi161 ceph-mon[99580]: pgmap v1376: 97 pgs: 17 active+clean+snaptrim_wait, 8 active+clean+snaptrim, 72 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.3 MiB/s wr, 418 op/s 2023-09-23T09:40:15.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:40:15 smithi135 ceph-mon[99205]: pgmap v1376: 97 pgs: 17 active+clean+snaptrim_wait, 8 active+clean+snaptrim, 72 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.3 MiB/s wr, 418 op/s 2023-09-23T09:40:15.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 785.0 s, 159.0 tps, lat 878.046 ms stddev 1181.138 2023-09-23T09:40:16.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:40:16 smithi161 ceph-mon[99580]: pgmap v1377: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.1 MiB/s wr, 380 op/s 2023-09-23T09:40:16.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:40:16 smithi135 ceph-mon[99205]: pgmap v1377: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.1 MiB/s wr, 380 op/s 2023-09-23T09:40:16.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:40:16 smithi082 ceph-mon[97694]: pgmap v1377: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.1 MiB/s wr, 380 op/s 2023-09-23T09:40:18.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:40:18 smithi082 ceph-mon[97694]: osdmap e163: 12 total, 12 up, 12 in 2023-09-23T09:40:18.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:40:18 smithi161 ceph-mon[99580]: osdmap e163: 12 total, 12 up, 12 in 2023-09-23T09:40:18.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:40:18 smithi135 ceph-mon[99205]: osdmap e163: 12 total, 12 up, 12 in 2023-09-23T09:40:19.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:40:19 smithi082 ceph-mon[97694]: pgmap v1379: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.1 MiB/s wr, 380 op/s 2023-09-23T09:40:19.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:40:19 smithi161 ceph-mon[99580]: pgmap v1379: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.1 MiB/s wr, 380 op/s 2023-09-23T09:40:19.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:40:19 smithi135 ceph-mon[99205]: pgmap v1379: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.1 MiB/s wr, 380 op/s 2023-09-23T09:40:20.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 790.0 s, 163.6 tps, lat 594.966 ms stddev 581.532 2023-09-23T09:40:21.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:40:21 smithi082 ceph-mon[97694]: pgmap v1380: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.7 MiB/s wr, 502 op/s 2023-09-23T09:40:21.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:40:21 smithi161 ceph-mon[99580]: pgmap v1380: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.7 MiB/s wr, 502 op/s 2023-09-23T09:40:21.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:40:21 smithi135 ceph-mon[99205]: pgmap v1380: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.7 MiB/s wr, 502 op/s 2023-09-23T09:40:23.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:40:23 smithi082 ceph-mon[97694]: pgmap v1381: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.6 MiB/s wr, 596 op/s 2023-09-23T09:40:23.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:40:23 smithi161 ceph-mon[99580]: pgmap v1381: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.6 MiB/s wr, 596 op/s 2023-09-23T09:40:23.810 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:40:23 smithi135 ceph-mon[99205]: pgmap v1381: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.6 MiB/s wr, 596 op/s 2023-09-23T09:40:25.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:40:25 smithi082 ceph-mon[97694]: pgmap v1382: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.6 MiB/s wr, 596 op/s 2023-09-23T09:40:25.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:40:25 smithi161 ceph-mon[99580]: pgmap v1382: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.6 MiB/s wr, 596 op/s 2023-09-23T09:40:25.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:40:25 smithi135 ceph-mon[99205]: pgmap v1382: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.6 MiB/s wr, 596 op/s 2023-09-23T09:40:25.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 795.0 s, 160.6 tps, lat 634.326 ms stddev 589.705 2023-09-23T09:40:26.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:40:26 smithi082 ceph-mon[97694]: pgmap v1383: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.0 MiB/s wr, 660 op/s 2023-09-23T09:40:26.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:40:26 smithi161 ceph-mon[99580]: pgmap v1383: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.0 MiB/s wr, 660 op/s 2023-09-23T09:40:26.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:40:26 smithi135 ceph-mon[99205]: pgmap v1383: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.0 MiB/s wr, 660 op/s 2023-09-23T09:40:29.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:40:29 smithi082 ceph-mon[97694]: pgmap v1384: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.7 MiB/s wr, 627 op/s 2023-09-23T09:40:29.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:40:29 smithi161 ceph-mon[99580]: pgmap v1384: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.7 MiB/s wr, 627 op/s 2023-09-23T09:40:29.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:40:29 smithi135 ceph-mon[99205]: pgmap v1384: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.7 MiB/s wr, 627 op/s 2023-09-23T09:40:30.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:40:30 smithi082 ceph-mon[97694]: pgmap v1385: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.6 MiB/s wr, 730 op/s 2023-09-23T09:40:30.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:40:30 smithi161 ceph-mon[99580]: pgmap v1385: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.6 MiB/s wr, 730 op/s 2023-09-23T09:40:30.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:40:30 smithi135 ceph-mon[99205]: pgmap v1385: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.6 MiB/s wr, 730 op/s 2023-09-23T09:40:30.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 800.0 s, 180.2 tps, lat 554.613 ms stddev 527.774 2023-09-23T09:40:33.224 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:40:33.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:40:33 smithi082 ceph-mon[97694]: pgmap v1386: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.1 MiB/s wr, 656 op/s 2023-09-23T09:40:33.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.621+0000 7f9091199700 1 -- 172.21.15.82:0/3938044270 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f908800b9d0 con 0x7f908c072cc0 2023-09-23T09:40:33.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.621+0000 7f90943ff700 1 -- 172.21.15.82:0/3938044270 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f908c072cc0 msgr2=0x7f908c0730a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:40:33.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.621+0000 7f90943ff700 1 --2- 172.21.15.82:0/3938044270 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f908c072cc0 0x7f908c0730a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f9088009990 tx=0x7f9088009ca0 comp rx=0 tx=0).stop 2023-09-23T09:40:33.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.622+0000 7f90943ff700 1 -- 172.21.15.82:0/3938044270 shutdown_connections 2023-09-23T09:40:33.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.622+0000 7f90943ff700 1 --2- 172.21.15.82:0/3938044270 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f908c1118a0 0x7f908c113c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:40:33.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.622+0000 7f90943ff700 1 --2- 172.21.15.82:0/3938044270 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f908c072cc0 0x7f908c0730a0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:40:33.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.622+0000 7f90943ff700 1 --2- 172.21.15.82:0/3938044270 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f908c0735e0 0x7f908c111360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:40:33.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.622+0000 7f90943ff700 1 -- 172.21.15.82:0/3938044270 >> 172.21.15.82:0/3938044270 conn(0x7f908c0fc380 msgr2=0x7f908c0fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:40:33.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.622+0000 7f90943ff700 1 -- 172.21.15.82:0/3938044270 shutdown_connections 2023-09-23T09:40:33.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.622+0000 7f90943ff700 1 -- 172.21.15.82:0/3938044270 wait complete. 2023-09-23T09:40:33.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.624+0000 7f90943ff700 1 Processor -- start 2023-09-23T09:40:33.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.624+0000 7f90943ff700 1 -- start start 2023-09-23T09:40:33.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.624+0000 7f90943ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f908c072cc0 0x7f908c19cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:40:33.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.624+0000 7f90943ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f908c0735e0 0x7f908c19d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:40:33.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.625+0000 7f90943ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f908c1118a0 0x7f908c1a18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:40:33.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.625+0000 7f90943ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f908c1a1f30 con 0x7f908c1118a0 2023-09-23T09:40:33.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.625+0000 7f90943ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f908c1a20a0 con 0x7f908c072cc0 2023-09-23T09:40:33.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.625+0000 7f90943ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f908c1a2260 con 0x7f908c0735e0 2023-09-23T09:40:33.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.625+0000 7f909219b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f908c072cc0 0x7f908c19cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:40:33.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.625+0000 7f909219b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f908c072cc0 0x7f908c19cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:44536/0 (socket says 172.21.15.82:44536) 2023-09-23T09:40:33.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.625+0000 7f909219b700 1 -- 172.21.15.82:0/921771138 learned_addr learned my addr 172.21.15.82:0/921771138 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:40:33.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.625+0000 7f909299c700 1 --2- 172.21.15.82:0/921771138 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f908c1118a0 0x7f908c1a18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:40:33.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.625+0000 7f909199a700 1 --2- 172.21.15.82:0/921771138 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f908c0735e0 0x7f908c19d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:40:33.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.626+0000 7f909219b700 1 -- 172.21.15.82:0/921771138 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f908c0735e0 msgr2=0x7f908c19d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:40:33.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.626+0000 7f909219b700 1 --2- 172.21.15.82:0/921771138 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f908c0735e0 0x7f908c19d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:40:33.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.626+0000 7f909219b700 1 -- 172.21.15.82:0/921771138 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f908c1118a0 msgr2=0x7f908c1a18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:40:33.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.626+0000 7f909219b700 1 --2- 172.21.15.82:0/921771138 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f908c1118a0 0x7f908c1a18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:40:33.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.626+0000 7f909219b700 1 -- 172.21.15.82:0/921771138 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90880095f0 con 0x7f908c072cc0 2023-09-23T09:40:33.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.626+0000 7f909219b700 1 --2- 172.21.15.82:0/921771138 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f908c072cc0 0x7f908c19cf50 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f908800b2e0 tx=0x7f9088003890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:40:33.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.627+0000 7f90837fe700 1 -- 172.21.15.82:0/921771138 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f908801d070 con 0x7f908c072cc0 2023-09-23T09:40:33.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.627+0000 7f90837fe700 1 -- 172.21.15.82:0/921771138 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f908800bdb0 con 0x7f908c072cc0 2023-09-23T09:40:33.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.627+0000 7f90837fe700 1 -- 172.21.15.82:0/921771138 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f908800fd20 con 0x7f908c072cc0 2023-09-23T09:40:33.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.627+0000 7f90943ff700 1 -- 172.21.15.82:0/921771138 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f908c1a24e0 con 0x7f908c072cc0 2023-09-23T09:40:33.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.627+0000 7f90943ff700 1 -- 172.21.15.82:0/921771138 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f908c1a2760 con 0x7f908c072cc0 2023-09-23T09:40:33.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.633+0000 7f90837fe700 1 -- 172.21.15.82:0/921771138 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f908800f4f0 con 0x7f908c072cc0 2023-09-23T09:40:33.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.634+0000 7f90a7ddeb80 1 Processor -- start 2023-09-23T09:40:33.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.634+0000 7f90a7ddeb80 1 -- start start 2023-09-23T09:40:33.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.635+0000 7f90a7ddeb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56375936e380 0x56375936e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:40:33.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.635+0000 7f90a7ddeb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56375936eca0 0x563759368700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:40:33.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.635+0000 7f90a7ddeb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563759368c40 0x5637593690a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:40:33.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.635+0000 7f90a7ddeb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637592d07b0 con 0x56375936e380 2023-09-23T09:40:33.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.635+0000 7f90a7ddeb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637592c1780 con 0x56375936eca0 2023-09-23T09:40:33.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.635+0000 7f90a7ddeb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637592bf0a0 con 0x563759368c40 2023-09-23T09:40:33.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.635+0000 7f909199a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563759368c40 0x5637593690a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:40:33.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.635+0000 7f909199a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563759368c40 0x5637593690a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:38584/0 (socket says 172.21.15.82:38584) 2023-09-23T09:40:33.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.635+0000 7f909199a700 1 -- 172.21.15.82:0/2725601356 learned_addr learned my addr 172.21.15.82:0/2725601356 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:40:33.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.635+0000 7f909299c700 1 --2- 172.21.15.82:0/2725601356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56375936e380 0x56375936e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:40:33.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.636+0000 7f909219b700 1 --2- 172.21.15.82:0/2725601356 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56375936eca0 0x563759368700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:40:33.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.636+0000 7f909199a700 1 -- 172.21.15.82:0/2725601356 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56375936eca0 msgr2=0x563759368700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:40:33.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.636+0000 7f909199a700 1 --2- 172.21.15.82:0/2725601356 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56375936eca0 0x563759368700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:40:33.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.636+0000 7f909199a700 1 -- 172.21.15.82:0/2725601356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56375936e380 msgr2=0x56375936e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:40:33.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.636+0000 7f909199a700 1 --2- 172.21.15.82:0/2725601356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56375936e380 0x56375936e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:40:33.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.636+0000 7f909199a700 1 -- 172.21.15.82:0/2725601356 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56375913a630 con 0x563759368c40 2023-09-23T09:40:33.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.636+0000 7f90837fe700 1 --2- 172.21.15.82:0/921771138 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f90780a0210 0x7f90780a26d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:40:33.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.636+0000 7f909299c700 1 --2- 172.21.15.82:0/2725601356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56375936e380 0x56375936e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T09:40:33.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.636+0000 7f90837fe700 1 -- 172.21.15.82:0/921771138 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f90880cc750 con 0x7f908c072cc0 2023-09-23T09:40:33.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.636+0000 7f909299c700 1 --2- 172.21.15.82:0/921771138 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f90780a0210 0x7f90780a26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:40:33.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.637+0000 7f909199a700 1 --2- 172.21.15.82:0/2725601356 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563759368c40 0x5637593690a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f907c009cb0 tx=0x7f907c0113e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=40c9aa686c7fc31d server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:40:33.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.637+0000 7f9080bfe700 1 -- 172.21.15.82:0/2725601356 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f907c0097b0 con 0x563759368c40 2023-09-23T09:40:33.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.637+0000 7f9080bfe700 1 -- 172.21.15.82:0/2725601356 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f907c011d10 con 0x563759368c40 2023-09-23T09:40:33.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.637+0000 7f9080bfe700 1 -- 172.21.15.82:0/2725601356 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f907c00f6a0 con 0x563759368c40 2023-09-23T09:40:33.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.638+0000 7f90a7ddeb80 1 -- 172.21.15.82:0/2725601356 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563759368c40 msgr2=0x5637593690a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:40:33.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.638+0000 7f90a7ddeb80 1 --2- 172.21.15.82:0/2725601356 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563759368c40 0x5637593690a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f907c009cb0 tx=0x7f907c0113e0 comp rx=0 tx=0).stop 2023-09-23T09:40:33.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.638+0000 7f909299c700 1 --2- 172.21.15.82:0/921771138 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f90780a0210 0x7f90780a26d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f908c069e90 tx=0x7f908400b040 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:40:33.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.639+0000 7f90a7ddeb80 1 -- 172.21.15.82:0/2725601356 shutdown_connections 2023-09-23T09:40:33.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.639+0000 7f90a7ddeb80 1 --2- 172.21.15.82:0/2725601356 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563759368c40 0x5637593690a0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:40:33.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.639+0000 7f90a7ddeb80 1 --2- 172.21.15.82:0/2725601356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56375936e380 0x56375936e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:40:33.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.639+0000 7f90a7ddeb80 1 --2- 172.21.15.82:0/2725601356 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56375936eca0 0x563759368700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:40:33.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.639+0000 7f90a7ddeb80 1 -- 172.21.15.82:0/2725601356 >> 172.21.15.82:0/2725601356 conn(0x5637592dd0e0 msgr2=0x563759363410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:40:33.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.639+0000 7f90a7ddeb80 1 -- 172.21.15.82:0/2725601356 shutdown_connections 2023-09-23T09:40:33.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.640+0000 7f90a7ddeb80 1 -- 172.21.15.82:0/2725601356 wait complete. 2023-09-23T09:40:33.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.640+0000 7f90a7ddeb80 1 -- start start 2023-09-23T09:40:33.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.641+0000 7f90a7ddeb80 1 Processor -- start 2023-09-23T09:40:33.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.641+0000 7f90a7ddeb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563759368c40 0x563759374cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:40:33.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.642+0000 7f90a7ddeb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56375936e380 0x563759371f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:40:33.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.642+0000 7f90a7ddeb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56375936eca0 0x563759372690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:40:33.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.642+0000 7f90a7ddeb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637592ba990 con 0x563759368c40 2023-09-23T09:40:33.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.642+0000 7f90a7ddeb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x563759258bb0 con 0x56375936e380 2023-09-23T09:40:33.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.642+0000 7f90a7ddeb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637592588b0 con 0x56375936eca0 2023-09-23T09:40:33.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.642+0000 7f90a7ddeb80 10 client.0 _ll_register_callbacks cb 0x5637591a2a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:40:33.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.642+0000 7f909219b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563759368c40 0x563759374cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:40:33.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.642+0000 7f909219b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563759368c40 0x563759374cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35484/0 (socket says 172.21.15.82:35484) 2023-09-23T09:40:33.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.642+0000 7f909219b700 1 -- 172.21.15.82:0/996305545 learned_addr learned my addr 172.21.15.82:0/996305545 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:40:33.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.642+0000 7f909199a700 1 --2- 172.21.15.82:0/996305545 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56375936e380 0x563759371f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:40:33.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.642+0000 7f909299c700 1 --2- 172.21.15.82:0/996305545 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56375936eca0 0x563759372690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:40:33.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.643+0000 7f909219b700 1 -- 172.21.15.82:0/996305545 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56375936eca0 msgr2=0x563759372690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:40:33.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.643+0000 7f909219b700 1 --2- 172.21.15.82:0/996305545 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56375936eca0 0x563759372690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:40:33.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.643+0000 7f909219b700 1 -- 172.21.15.82:0/996305545 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56375936e380 msgr2=0x563759371f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:40:33.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.643+0000 7f909219b700 1 --2- 172.21.15.82:0/996305545 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56375936e380 0x563759371f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:40:33.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.643+0000 7f909219b700 1 -- 172.21.15.82:0/996305545 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f907c009910 con 0x563759368c40 2023-09-23T09:40:33.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.643+0000 7f909219b700 1 --2- 172.21.15.82:0/996305545 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563759368c40 0x563759374cd0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f90880c9ea0 tx=0x7f9088009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=772d4d65a1b51254 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:40:33.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.643+0000 7f9075ffb700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:40:33.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.643+0000 7f9075ffb700 1 -- 172.21.15.82:0/996305545 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90880b92c0 con 0x563759368c40 2023-09-23T09:40:33.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.644+0000 7f9075ffb700 1 -- 172.21.15.82:0/996305545 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(163..163 src has 1..163) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f908809a590 con 0x563759368c40 2023-09-23T09:40:33.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.644+0000 7f90a7ddeb80 1 -- 172.21.15.82:0/996305545 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5637593381c0 con 0x563759368c40 2023-09-23T09:40:33.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.644+0000 7f9075ffb700 1 -- 172.21.15.82:0/996305545 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=132) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9088099e90 con 0x563759368c40 2023-09-23T09:40:33.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.644+0000 7f90a7ddeb80 10 client.18159 fetch_fsmap learned FSMap version 132 2023-09-23T09:40:33.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.644+0000 7f90a7ddeb80 1 -- 172.21.15.82:0/996305545 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=132,monmap=4+}) v3 -- 0x5637590e6de0 con 0x563759368c40 2023-09-23T09:40:33.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.644+0000 7f9075ffb700 1 -- 172.21.15.82:0/996305545 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5637593381c0 con 0x563759368c40 2023-09-23T09:40:33.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.644+0000 7f9075ffb700 1 -- 172.21.15.82:0/996305545 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 132) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f908809a200 con 0x563759368c40 2023-09-23T09:40:33.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.645+0000 7f90a7ddeb80 10 client.18159 fetch_fsmap finished waiting for FSMap version 132 2023-09-23T09:40:33.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.645+0000 7f90a7ddeb80 10 client.18159 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:40:33.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.645+0000 7f90a7ddeb80 20 client.18159 populate_metadata read hostname 'smithi082' 2023-09-23T09:40:33.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.645+0000 7f90a7ddeb80 1 --2- 172.21.15.82:0/996305545 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5637593823c0 0x5637593847b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:40:33.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:40:33 smithi161 ceph-mon[99580]: pgmap v1386: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.1 MiB/s wr, 656 op/s 2023-09-23T09:40:33.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.645+0000 7f90a7ddeb80 4 client.18159 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:40:33.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.645+0000 7f90a7ddeb80 1 -- 172.21.15.82:0/996305545 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563759260ba0 con 0x5637593823c0 2023-09-23T09:40:33.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.645+0000 7f909199a700 1 --2- 172.21.15.82:0/996305545 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5637593823c0 0x5637593847b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:40:33.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.646+0000 7f909199a700 1 --2- 172.21.15.82:0/996305545 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5637593823c0 0x5637593847b0 crc :-1 s=READY pgs=271 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=97e23b802bda5bfc server_cookie=f2a108b50a04ee55 in_seq=0 out_seq=0 2023-09-23T09:40:33.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.646+0000 7f9075ffb700 10 client.18159 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:40:33.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.647+0000 7f9075ffb700 1 -- 172.21.15.82:0/996305545 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x563759260ba0 con 0x5637593823c0 2023-09-23T09:40:33.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.647+0000 7f9075ffb700 10 client.18159 handle_command_reply: tid=0 2023-09-23T09:40:33.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.647+0000 7f90a7ddeb80 1 client.18159 shutdown 2023-09-23T09:40:33.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.648+0000 7f90a7ddeb80 1 -- 172.21.15.82:0/996305545 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563759368c40 msgr2=0x563759374cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:40:33.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.648+0000 7f90a7ddeb80 1 --2- 172.21.15.82:0/996305545 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563759368c40 0x563759374cd0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f90880c9ea0 tx=0x7f9088009310 comp rx=0 tx=0).stop 2023-09-23T09:40:33.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.648+0000 7f90a7ddeb80 1 -- 172.21.15.82:0/996305545 shutdown_connections 2023-09-23T09:40:33.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.648+0000 7f90a7ddeb80 1 --2- 172.21.15.82:0/996305545 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56375936eca0 0x563759372690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:40:33.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.648+0000 7f90a7ddeb80 1 --2- 172.21.15.82:0/996305545 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5637593823c0 0x5637593847b0 crc :-1 s=READY pgs=271 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:40:33.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.648+0000 7f90a7ddeb80 1 --2- 172.21.15.82:0/996305545 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563759368c40 0x563759374cd0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:40:33.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.648+0000 7f90a7ddeb80 1 --2- 172.21.15.82:0/996305545 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56375936e380 0x563759371f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:40:33.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.648+0000 7f90a7ddeb80 1 -- 172.21.15.82:0/996305545 >> 172.21.15.82:0/996305545 conn(0x5637592dd0e0 msgr2=0x56375935db40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:40:33.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.648+0000 7f9075ffb700 0 client.18159 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:40:33.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.648+0000 7f90a7ddeb80 1 -- 172.21.15.82:0/996305545 shutdown_connections 2023-09-23T09:40:33.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.648+0000 7f90a7ddeb80 1 -- 172.21.15.82:0/996305545 wait complete. 2023-09-23T09:40:33.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.649+0000 7f90a7ddeb80 20 client.18159 trim_cache size 0 max 16384 2023-09-23T09:40:33.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.677+0000 7f90a7ddeb80 1 Processor -- start 2023-09-23T09:40:33.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.677+0000 7f90a7ddeb80 1 -- start start 2023-09-23T09:40:33.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.678+0000 7f90a7ddeb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563759368c40 0x563759374870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:40:33.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.678+0000 7f90a7ddeb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56375936e380 0x56375936c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:40:33.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.678+0000 7f90a7ddeb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56375936eca0 0x56375936c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:40:33.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.678+0000 7f90a7ddeb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56375913c920 con 0x56375936e380 2023-09-23T09:40:33.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.678+0000 7f90a7ddeb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56375935fa40 con 0x56375936eca0 2023-09-23T09:40:33.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.678+0000 7f90a7ddeb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x563759369800 con 0x563759368c40 2023-09-23T09:40:33.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.678+0000 7f909199a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56375936e380 0x56375936c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:40:33.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.678+0000 7f909299c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56375936eca0 0x56375936c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:40:33.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.678+0000 7f909299c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56375936eca0 0x56375936c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:44582/0 (socket says 172.21.15.82:44582) 2023-09-23T09:40:33.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.678+0000 7f909299c700 1 -- 172.21.15.82:0/3770871050 learned_addr learned my addr 172.21.15.82:0/3770871050 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:40:33.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.679+0000 7f909219b700 1 --2- 172.21.15.82:0/3770871050 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563759368c40 0x563759374870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:40:33.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.679+0000 7f909299c700 1 -- 172.21.15.82:0/3770871050 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563759368c40 msgr2=0x563759374870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:40:33.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.679+0000 7f909299c700 1 --2- 172.21.15.82:0/3770871050 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563759368c40 0x563759374870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:40:33.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.679+0000 7f909299c700 1 -- 172.21.15.82:0/3770871050 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56375936e380 msgr2=0x56375936c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:40:33.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.679+0000 7f909299c700 1 --2- 172.21.15.82:0/3770871050 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56375936e380 0x56375936c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:40:33.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.679+0000 7f909299c700 1 -- 172.21.15.82:0/3770871050 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5637590cfc60 con 0x56375936eca0 2023-09-23T09:40:33.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.679+0000 7f909299c700 1 --2- 172.21.15.82:0/3770871050 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56375936eca0 0x56375936c5d0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f90840187c0 tx=0x7f9084015000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0cad5fbe6249161 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:40:33.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.680+0000 7f90813ff700 1 -- 172.21.15.82:0/3770871050 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f908400e040 con 0x56375936eca0 2023-09-23T09:40:33.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.680+0000 7f90813ff700 1 -- 172.21.15.82:0/3770871050 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f908400f040 con 0x56375936eca0 2023-09-23T09:40:33.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.680+0000 7f90813ff700 1 -- 172.21.15.82:0/3770871050 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9084016660 con 0x56375936eca0 2023-09-23T09:40:33.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.680+0000 7f90a7ddeb80 1 -- 172.21.15.82:0/3770871050 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56375936eca0 msgr2=0x56375936c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:40:33.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.680+0000 7f90a7ddeb80 1 --2- 172.21.15.82:0/3770871050 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56375936eca0 0x56375936c5d0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f90840187c0 tx=0x7f9084015000 comp rx=0 tx=0).stop 2023-09-23T09:40:33.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.681+0000 7f90a7ddeb80 1 -- 172.21.15.82:0/3770871050 shutdown_connections 2023-09-23T09:40:33.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.681+0000 7f90a7ddeb80 1 --2- 172.21.15.82:0/3770871050 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56375936eca0 0x56375936c5d0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:40:33.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.681+0000 7f90a7ddeb80 1 --2- 172.21.15.82:0/3770871050 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563759368c40 0x563759374870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:40:33.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.681+0000 7f90a7ddeb80 1 --2- 172.21.15.82:0/3770871050 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56375936e380 0x56375936c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:40:33.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.681+0000 7f90a7ddeb80 1 -- 172.21.15.82:0/3770871050 >> 172.21.15.82:0/3770871050 conn(0x5637592dd0e0 msgr2=0x563759363110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:40:33.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.681+0000 7f90a7ddeb80 1 -- 172.21.15.82:0/3770871050 shutdown_connections 2023-09-23T09:40:33.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.681+0000 7f90a7ddeb80 1 -- 172.21.15.82:0/3770871050 wait complete. 2023-09-23T09:40:33.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.681+0000 7f90a7ddeb80 1 -- start start 2023-09-23T09:40:33.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.682+0000 7f90a7ddeb80 1 Processor -- start 2023-09-23T09:40:33.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.682+0000 7f90a7ddeb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563759368c40 0x56375936b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:40:33.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.682+0000 7f90a7ddeb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56375936e380 0x563759369e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:40:33.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.682+0000 7f90a7ddeb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56375936eca0 0x56375936a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:40:33.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.682+0000 7f90a7ddeb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56375936baf0 con 0x56375936e380 2023-09-23T09:40:33.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.682+0000 7f90a7ddeb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56375936a880 con 0x56375936eca0 2023-09-23T09:40:33.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.682+0000 7f90a7ddeb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x56375936aa40 con 0x563759368c40 2023-09-23T09:40:33.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.682+0000 7f90a7ddeb80 10 client.0 _ll_register_callbacks cb 0x5637591a2a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:40:33.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.683+0000 7f909199a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56375936e380 0x563759369e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:40:33.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.683+0000 7f909199a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56375936e380 0x563759369e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35502/0 (socket says 172.21.15.82:35502) 2023-09-23T09:40:33.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.683+0000 7f909199a700 1 -- 172.21.15.82:0/465263444 learned_addr learned my addr 172.21.15.82:0/465263444 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:40:33.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.683+0000 7f909299c700 1 --2- 172.21.15.82:0/465263444 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56375936eca0 0x56375936a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:40:33.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.683+0000 7f909219b700 1 --2- 172.21.15.82:0/465263444 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563759368c40 0x56375936b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:40:33.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.683+0000 7f909199a700 1 -- 172.21.15.82:0/465263444 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563759368c40 msgr2=0x56375936b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:40:33.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.683+0000 7f909199a700 1 --2- 172.21.15.82:0/465263444 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563759368c40 0x56375936b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:40:33.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.683+0000 7f909199a700 1 -- 172.21.15.82:0/465263444 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56375936eca0 msgr2=0x56375936a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:40:33.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.683+0000 7f909199a700 1 --2- 172.21.15.82:0/465263444 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56375936eca0 0x56375936a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:40:33.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.683+0000 7f909199a700 1 -- 172.21.15.82:0/465263444 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9084018470 con 0x56375936e380 2023-09-23T09:40:33.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.684+0000 7f909199a700 1 --2- 172.21.15.82:0/465263444 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56375936e380 0x563759369e00 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f907c012c90 tx=0x7f907c011d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=869b5f166a94559f server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:40:33.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.684+0000 7f9075ffb700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:40:33.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.684+0000 7f9075ffb700 1 -- 172.21.15.82:0/465263444 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f907c02d070 con 0x56375936e380 2023-09-23T09:40:33.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.684+0000 7f9075ffb700 1 -- 172.21.15.82:0/465263444 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(163..163 src has 1..163) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f907c011e80 con 0x56375936e380 2023-09-23T09:40:33.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.684+0000 7f90a7ddeb80 1 -- 172.21.15.82:0/465263444 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56375935b8b0 con 0x56375936e380 2023-09-23T09:40:33.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.684+0000 7f9075ffb700 1 -- 172.21.15.82:0/465263444 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=132) v2 ==== 24+0+0 (secure 0 0 0) 0x7f907c012660 con 0x56375936e380 2023-09-23T09:40:33.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.684+0000 7f90a7ddeb80 10 client.18165 fetch_fsmap learned FSMap version 132 2023-09-23T09:40:33.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.684+0000 7f90a7ddeb80 1 -- 172.21.15.82:0/465263444 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=132,monmap=4+}) v3 -- 0x56375910d250 con 0x56375936e380 2023-09-23T09:40:33.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.685+0000 7f9075ffb700 1 -- 172.21.15.82:0/465263444 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f907c03d080 con 0x56375936e380 2023-09-23T09:40:33.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.685+0000 7f9075ffb700 1 -- 172.21.15.82:0/465263444 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 132) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f907c009ce0 con 0x56375936e380 2023-09-23T09:40:33.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.685+0000 7f90a7ddeb80 10 client.18165 fetch_fsmap finished waiting for FSMap version 132 2023-09-23T09:40:33.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.685+0000 7f90a7ddeb80 10 client.18165 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:40:33.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.685+0000 7f90a7ddeb80 20 client.18165 populate_metadata read hostname 'smithi082' 2023-09-23T09:40:33.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.685+0000 7f90a7ddeb80 1 --2- 172.21.15.82:0/465263444 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5637593d7340 0x5637593d9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:40:33.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.685+0000 7f90a7ddeb80 4 client.18165 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:40:33.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.685+0000 7f90a7ddeb80 1 -- 172.21.15.82:0/465263444 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5637592b3970 con 0x5637593d7340 2023-09-23T09:40:33.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.686+0000 7f909219b700 1 --2- 172.21.15.82:0/465263444 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5637593d7340 0x5637593d9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:40:33.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.686+0000 7f909219b700 1 --2- 172.21.15.82:0/465263444 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5637593d7340 0x5637593d9760 crc :-1 s=READY pgs=272 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d59b2586230fd654 server_cookie=fc5f64f94442b1a1 in_seq=0 out_seq=0 2023-09-23T09:40:33.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.687+0000 7f9075ffb700 10 client.18165 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:40:33.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.687+0000 7f9075ffb700 1 -- 172.21.15.82:0/465263444 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x5637592b3970 con 0x5637593d7340 2023-09-23T09:40:33.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.687+0000 7f9075ffb700 10 client.18165 handle_command_reply: tid=0 2023-09-23T09:40:33.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.687+0000 7f90a7ddeb80 1 client.18165 shutdown 2023-09-23T09:40:33.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.687+0000 7f90a7ddeb80 1 -- 172.21.15.82:0/465263444 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56375936e380 msgr2=0x563759369e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:40:33.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.687+0000 7f90a7ddeb80 1 --2- 172.21.15.82:0/465263444 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56375936e380 0x563759369e00 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f907c012c90 tx=0x7f907c011d50 comp rx=0 tx=0).stop 2023-09-23T09:40:33.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.687+0000 7f90a7ddeb80 1 -- 172.21.15.82:0/465263444 shutdown_connections 2023-09-23T09:40:33.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.687+0000 7f90a7ddeb80 1 --2- 172.21.15.82:0/465263444 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56375936eca0 0x56375936a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:40:33.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.687+0000 7f90a7ddeb80 1 --2- 172.21.15.82:0/465263444 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563759368c40 0x56375936b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:40:33.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.687+0000 7f90a7ddeb80 1 --2- 172.21.15.82:0/465263444 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5637593d7340 0x5637593d9760 crc :-1 s=READY pgs=272 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:40:33.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.688+0000 7f90a7ddeb80 1 --2- 172.21.15.82:0/465263444 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56375936e380 0x563759369e00 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:40:33.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.688+0000 7f90a7ddeb80 1 -- 172.21.15.82:0/465263444 >> 172.21.15.82:0/465263444 conn(0x5637592dd0e0 msgr2=0x56375936c090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:40:33.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.688+0000 7f9075ffb700 0 client.18165 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:40:33.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.688+0000 7f90a7ddeb80 1 -- 172.21.15.82:0/465263444 shutdown_connections 2023-09-23T09:40:33.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.688+0000 7f90a7ddeb80 1 -- 172.21.15.82:0/465263444 wait complete. 2023-09-23T09:40:33.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.688+0000 7f90a7ddeb80 20 client.18165 trim_cache size 0 max 16384 2023-09-23T09:40:33.693 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:40:33.694 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-23T09:40:33.694 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:40:33.694 INFO:teuthology.orchestra.run.smithi082.stdout: "d9e62ab8-1468-4fb0-a9fe-61bed13e954b": { 2023-09-23T09:40:33.694 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:40:33.694 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "d9e62ab8-1468-4fb0-a9fe-61bed13e954b", 2023-09-23T09:40:33.694 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:40:33.694 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:40:33.694 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:40:33.694 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:40:33.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.689+0000 7f90943ff700 1 -- 172.21.15.82:0/921771138 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f90780a0210 msgr2=0x7f90780a26d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:40:33.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.689+0000 7f90943ff700 1 --2- 172.21.15.82:0/921771138 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f90780a0210 0x7f90780a26d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f908c069e90 tx=0x7f908400b040 comp rx=0 tx=0).stop 2023-09-23T09:40:33.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.689+0000 7f90943ff700 1 -- 172.21.15.82:0/921771138 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f908c072cc0 msgr2=0x7f908c19cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:40:33.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.689+0000 7f90943ff700 1 --2- 172.21.15.82:0/921771138 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f908c072cc0 0x7f908c19cf50 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f908800b2e0 tx=0x7f9088003890 comp rx=0 tx=0).stop 2023-09-23T09:40:33.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.689+0000 7f90943ff700 1 -- 172.21.15.82:0/921771138 shutdown_connections 2023-09-23T09:40:33.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.689+0000 7f90943ff700 1 --2- 172.21.15.82:0/921771138 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f90780a0210 0x7f90780a26d0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:40:33.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.689+0000 7f90943ff700 1 --2- 172.21.15.82:0/921771138 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f908c1118a0 0x7f908c1a18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:40:33.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.689+0000 7f90943ff700 1 --2- 172.21.15.82:0/921771138 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f908c072cc0 0x7f908c19cf50 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:40:33.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.689+0000 7f90943ff700 1 --2- 172.21.15.82:0/921771138 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f908c0735e0 0x7f908c19d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:40:33.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.689+0000 7f90943ff700 1 -- 172.21.15.82:0/921771138 >> 172.21.15.82:0/921771138 conn(0x7f908c0fc380 msgr2=0x7f908c0fcff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:40:33.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.689+0000 7f90943ff700 1 -- 172.21.15.82:0/921771138 shutdown_connections 2023-09-23T09:40:33.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:40:33.689+0000 7f90943ff700 1 -- 172.21.15.82:0/921771138 wait complete. 2023-09-23T09:40:33.720 INFO:tasks.cephfs.filesystem:scrub status for tag:d9e62ab8-1468-4fb0-a9fe-61bed13e954b - {'path': '/', 'tag': 'd9e62ab8-1468-4fb0-a9fe-61bed13e954b', 'options': 'recursive,force'} 2023-09-23T09:40:33.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:40:33 smithi135 ceph-mon[99205]: pgmap v1386: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.1 MiB/s wr, 656 op/s 2023-09-23T09:40:34.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:40:34 smithi161 ceph-mon[99580]: pgmap v1387: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.2 MiB/s wr, 555 op/s 2023-09-23T09:40:34.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:40:34 smithi135 ceph-mon[99205]: pgmap v1387: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.2 MiB/s wr, 555 op/s 2023-09-23T09:40:34.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:40:34 smithi082 ceph-mon[97694]: pgmap v1387: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.2 MiB/s wr, 555 op/s 2023-09-23T09:40:35.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 805.0 s, 173.6 tps, lat 581.338 ms stddev 535.550 2023-09-23T09:40:37.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:40:36 smithi135 ceph-mon[99205]: pgmap v1388: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 3.4 MiB/s rd, 7.0 MiB/s wr, 895 op/s 2023-09-23T09:40:37.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:40:36 smithi082 ceph-mon[97694]: pgmap v1388: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 3.4 MiB/s rd, 7.0 MiB/s wr, 895 op/s 2023-09-23T09:40:37.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:40:36 smithi161 ceph-mon[99580]: pgmap v1388: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 3.4 MiB/s rd, 7.0 MiB/s wr, 895 op/s 2023-09-23T09:40:38.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:40:38 smithi161 ceph-mon[99580]: pgmap v1389: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.0 MiB/s wr, 618 op/s 2023-09-23T09:40:38.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:40:38 smithi135 ceph-mon[99205]: pgmap v1389: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.0 MiB/s wr, 618 op/s 2023-09-23T09:40:38.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:40:38 smithi082 ceph-mon[97694]: pgmap v1389: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.0 MiB/s wr, 618 op/s 2023-09-23T09:40:40.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 810.0 s, 165.8 tps, lat 598.097 ms stddev 526.814 2023-09-23T09:40:41.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:40:40 smithi135 ceph-mon[99205]: pgmap v1390: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 3.3 MiB/s rd, 7.3 MiB/s wr, 865 op/s 2023-09-23T09:40:41.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:40:40 smithi082 ceph-mon[97694]: pgmap v1390: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 3.3 MiB/s rd, 7.3 MiB/s wr, 865 op/s 2023-09-23T09:40:41.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:40:40 smithi161 ceph-mon[99580]: pgmap v1390: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 3.3 MiB/s rd, 7.3 MiB/s wr, 865 op/s 2023-09-23T09:40:43.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:40:43 smithi082 ceph-mon[97694]: pgmap v1391: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.4 MiB/s wr, 787 op/s 2023-09-23T09:40:43.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:40:43 smithi161 ceph-mon[99580]: pgmap v1391: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.4 MiB/s wr, 787 op/s 2023-09-23T09:40:43.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:40:43 smithi135 ceph-mon[99205]: pgmap v1391: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.4 MiB/s wr, 787 op/s 2023-09-23T09:40:44.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:40:44 smithi161 ceph-mon[99580]: pgmap v1392: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.7 MiB/s wr, 688 op/s 2023-09-23T09:40:44.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:40:44 smithi135 ceph-mon[99205]: pgmap v1392: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.7 MiB/s wr, 688 op/s 2023-09-23T09:40:44.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:40:44 smithi082 ceph-mon[97694]: pgmap v1392: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.7 MiB/s wr, 688 op/s 2023-09-23T09:40:45.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 815.0 s, 159.4 tps, lat 623.157 ms stddev 588.276 2023-09-23T09:40:47.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:40:46 smithi135 ceph-mon[99205]: pgmap v1393: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1021 GiB / 1.0 TiB avail; 3.7 MiB/s rd, 8.7 MiB/s wr, 1.05k op/s 2023-09-23T09:40:47.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:40:46 smithi082 ceph-mon[97694]: pgmap v1393: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1021 GiB / 1.0 TiB avail; 3.7 MiB/s rd, 8.7 MiB/s wr, 1.05k op/s 2023-09-23T09:40:47.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:40:46 smithi161 ceph-mon[99580]: pgmap v1393: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1021 GiB / 1.0 TiB avail; 3.7 MiB/s rd, 8.7 MiB/s wr, 1.05k op/s 2023-09-23T09:40:48.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:40:48 smithi161 ceph-mon[99580]: pgmap v1394: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1021 GiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.9 MiB/s wr, 715 op/s 2023-09-23T09:40:48.810 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:40:48 smithi135 ceph-mon[99205]: pgmap v1394: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1021 GiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.9 MiB/s wr, 715 op/s 2023-09-23T09:40:48.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:40:48 smithi082 ceph-mon[97694]: pgmap v1394: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1021 GiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.9 MiB/s wr, 715 op/s 2023-09-23T09:40:49.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:40:49 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:40:49.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:40:49 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:40:49.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:40:49 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:40:50.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:40:50 smithi135 ceph-mon[99205]: pgmap v1395: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1021 GiB / 1.0 TiB avail; 3.3 MiB/s rd, 7.5 MiB/s wr, 924 op/s 2023-09-23T09:40:50.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 820.0 s, 158.2 tps, lat 626.665 ms stddev 578.430 2023-09-23T09:40:50.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:40:50 smithi082 ceph-mon[97694]: pgmap v1395: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1021 GiB / 1.0 TiB avail; 3.3 MiB/s rd, 7.5 MiB/s wr, 924 op/s 2023-09-23T09:40:50.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:40:50 smithi161 ceph-mon[99580]: pgmap v1395: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1021 GiB / 1.0 TiB avail; 3.3 MiB/s rd, 7.5 MiB/s wr, 924 op/s 2023-09-23T09:40:51.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:40:51 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:40:51.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:40:51 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:40:51.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:40:51 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:40:51.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:40:51 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:40:51.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:40:51 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:40:51.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:40:51 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:40:51.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:40:51 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:40:51.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:40:51 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:40:51.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:40:51 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:40:53.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:40:53 smithi082 ceph-mon[97694]: pgmap v1396: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.1 MiB/s wr, 781 op/s 2023-09-23T09:40:53.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:40:53 smithi161 ceph-mon[99580]: pgmap v1396: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.1 MiB/s wr, 781 op/s 2023-09-23T09:40:53.810 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:40:53 smithi135 ceph-mon[99205]: pgmap v1396: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.1 MiB/s wr, 781 op/s 2023-09-23T09:40:54.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:40:54 smithi082 ceph-mon[97694]: pgmap v1397: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.5 MiB/s wr, 680 op/s 2023-09-23T09:40:54.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:40:54 smithi161 ceph-mon[99580]: pgmap v1397: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.5 MiB/s wr, 680 op/s 2023-09-23T09:40:54.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:40:54 smithi135 ceph-mon[99205]: pgmap v1397: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.5 MiB/s wr, 680 op/s 2023-09-23T09:40:56.819 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 825.0 s, 183.6 tps, lat 558.601 ms stddev 543.510 2023-09-23T09:40:57.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:40:56 smithi135 ceph-mon[99205]: pgmap v1398: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 3.5 MiB/s rd, 7.8 MiB/s wr, 972 op/s 2023-09-23T09:41:00.083 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:40:58 smithi135 ceph-mon[99205]: pgmap v1399: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.8 MiB/s wr, 605 op/s 2023-09-23T09:41:00.083 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:40:56 smithi161 ceph-mon[99580]: pgmap v1398: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 3.5 MiB/s rd, 7.8 MiB/s wr, 972 op/s 2023-09-23T09:41:00.083 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:40:58 smithi161 ceph-mon[99580]: pgmap v1399: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.8 MiB/s wr, 605 op/s 2023-09-23T09:41:00.083 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:40:56 smithi082 ceph-mon[97694]: pgmap v1398: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 3.5 MiB/s rd, 7.8 MiB/s wr, 972 op/s 2023-09-23T09:41:00.083 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:40:58 smithi082 ceph-mon[97694]: pgmap v1399: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.8 MiB/s wr, 605 op/s 2023-09-23T09:41:00.828 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 830.0 s, 156.0 tps, lat 569.949 ms stddev 528.484 2023-09-23T09:41:01.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:41:00 smithi135 ceph-mon[99205]: pgmap v1400: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 3.0 MiB/s rd, 6.1 MiB/s wr, 779 op/s 2023-09-23T09:41:01.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:41:00 smithi082 ceph-mon[97694]: pgmap v1400: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 3.0 MiB/s rd, 6.1 MiB/s wr, 779 op/s 2023-09-23T09:41:01.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:41:00 smithi161 ceph-mon[99580]: pgmap v1400: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 3.0 MiB/s rd, 6.1 MiB/s wr, 779 op/s 2023-09-23T09:41:03.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:41:03 smithi082 ceph-mon[97694]: pgmap v1401: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.3 MiB/s wr, 669 op/s 2023-09-23T09:41:03.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:41:03 smithi161 ceph-mon[99580]: pgmap v1401: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.3 MiB/s wr, 669 op/s 2023-09-23T09:41:03.720 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:41:03.814 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:41:03 smithi135 ceph-mon[99205]: pgmap v1401: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.3 MiB/s wr, 669 op/s 2023-09-23T09:41:04.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.001+0000 7f7477fff700 1 -- 172.21.15.82:0/1095763698 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74700ff610 msgr2=0x7f74700ff9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:41:04.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.001+0000 7f7477fff700 1 --2- 172.21.15.82:0/1095763698 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74700ff610 0x7f74700ff9f0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f746c009990 tx=0x7f746c009ca0 comp rx=0 tx=0).stop 2023-09-23T09:41:04.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.002+0000 7f7477fff700 1 -- 172.21.15.82:0/1095763698 shutdown_connections 2023-09-23T09:41:04.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.002+0000 7f7477fff700 1 --2- 172.21.15.82:0/1095763698 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f747010d1c0 0x7f747010f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:41:04.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.002+0000 7f7477fff700 1 --2- 172.21.15.82:0/1095763698 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74700ff610 0x7f74700ff9f0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:41:04.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.002+0000 7f7477fff700 1 --2- 172.21.15.82:0/1095763698 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74700fffc0 0x7f747010cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:41:04.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.002+0000 7f7477fff700 1 -- 172.21.15.82:0/1095763698 >> 172.21.15.82:0/1095763698 conn(0x7f74700fb270 msgr2=0x7f74700fd690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:41:04.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.002+0000 7f7477fff700 1 -- 172.21.15.82:0/1095763698 shutdown_connections 2023-09-23T09:41:04.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.002+0000 7f7477fff700 1 -- 172.21.15.82:0/1095763698 wait complete. 2023-09-23T09:41:04.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.003+0000 7f7477fff700 1 Processor -- start 2023-09-23T09:41:04.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.004+0000 7f7477fff700 1 -- start start 2023-09-23T09:41:04.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.004+0000 7f7477fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f74700ff610 0x7f747019e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:41:04.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.004+0000 7f7477fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74700fffc0 0x7f747019ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:41:04.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.004+0000 7f7477fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f747010d1c0 0x7f7470198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:41:04.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.004+0000 7f7477fff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7470198fb0 con 0x7f747010d1c0 2023-09-23T09:41:04.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.004+0000 7f7477fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7470199120 con 0x7f74700fffc0 2023-09-23T09:41:04.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.004+0000 7f7477fff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74701992e0 con 0x7f74700ff610 2023-09-23T09:41:04.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.005+0000 7f7475d9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f74700ff610 0x7f747019e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:41:04.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.005+0000 7f7475d9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f74700ff610 0x7f747019e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:54808/0 (socket says 172.21.15.82:54808) 2023-09-23T09:41:04.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.005+0000 7f7475d9b700 1 -- 172.21.15.82:0/2837482536 learned_addr learned my addr 172.21.15.82:0/2837482536 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:41:04.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.005+0000 7f747659c700 1 --2- 172.21.15.82:0/2837482536 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f747010d1c0 0x7f7470198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:41:04.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.005+0000 7f747559a700 1 --2- 172.21.15.82:0/2837482536 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74700fffc0 0x7f747019ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:41:04.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.005+0000 7f7475d9b700 1 -- 172.21.15.82:0/2837482536 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74700fffc0 msgr2=0x7f747019ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:41:04.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.005+0000 7f7475d9b700 1 --2- 172.21.15.82:0/2837482536 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74700fffc0 0x7f747019ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:41:04.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.005+0000 7f7475d9b700 1 -- 172.21.15.82:0/2837482536 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f747010d1c0 msgr2=0x7f7470198940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:41:04.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.005+0000 7f7475d9b700 1 --2- 172.21.15.82:0/2837482536 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f747010d1c0 0x7f7470198940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:41:04.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.005+0000 7f7475d9b700 1 -- 172.21.15.82:0/2837482536 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f746c0095f0 con 0x7f74700ff610 2023-09-23T09:41:04.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.006+0000 7f7475d9b700 1 --2- 172.21.15.82:0/2837482536 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f74700ff610 0x7f747019e8d0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f746c000c00 tx=0x7f746c004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:41:04.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.006+0000 7f7466ffd700 1 -- 172.21.15.82:0/2837482536 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f746c01d070 con 0x7f74700ff610 2023-09-23T09:41:04.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.006+0000 7f7477fff700 1 -- 172.21.15.82:0/2837482536 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7470199560 con 0x7f74700ff610 2023-09-23T09:41:04.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.006+0000 7f7466ffd700 1 -- 172.21.15.82:0/2837482536 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f746c022470 con 0x7f74700ff610 2023-09-23T09:41:04.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.006+0000 7f7477fff700 1 -- 172.21.15.82:0/2837482536 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74701a58c0 con 0x7f74700ff610 2023-09-23T09:41:04.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.007+0000 7f7466ffd700 1 -- 172.21.15.82:0/2837482536 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f746c017650 con 0x7f74700ff610 2023-09-23T09:41:04.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.012+0000 7f7466ffd700 1 -- 172.21.15.82:0/2837482536 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f746c0225e0 con 0x7f74700ff610 2023-09-23T09:41:04.958 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:41:04 smithi135 ceph-mon[99205]: pgmap v1402: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.4 MiB/s wr, 565 op/s 2023-09-23T09:41:04.958 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:41:04 smithi161 ceph-mon[99580]: pgmap v1402: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.4 MiB/s wr, 565 op/s 2023-09-23T09:41:04.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.013+0000 7f748ba17b80 1 Processor -- start 2023-09-23T09:41:04.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.013+0000 7f748ba17b80 1 -- start start 2023-09-23T09:41:04.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.013+0000 7f748ba17b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56255aa85380 0x56255aa85760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:41:04.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.013+0000 7f748ba17b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56255aa85ca0 0x56255aa7f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:41:04.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.013+0000 7f748ba17b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56255aa7fc40 0x56255aa800a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:41:04.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.013+0000 7f748ba17b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56255a9e77b0 con 0x56255aa85380 2023-09-23T09:41:04.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.013+0000 7f748ba17b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56255a9d8780 con 0x56255aa7fc40 2023-09-23T09:41:04.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.013+0000 7f748ba17b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x56255a9d60a0 con 0x56255aa85ca0 2023-09-23T09:41:04.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.014+0000 7f7475d9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56255aa85ca0 0x56255aa7f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:41:04.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.014+0000 7f7475d9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56255aa85ca0 0x56255aa7f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:54812/0 (socket says 172.21.15.82:54812) 2023-09-23T09:41:04.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.014+0000 7f7475d9b700 1 -- 172.21.15.82:0/2859116976 learned_addr learned my addr 172.21.15.82:0/2859116976 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:41:04.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.014+0000 7f747559a700 1 --2- 172.21.15.82:0/2859116976 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56255aa7fc40 0x56255aa800a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:41:04.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.014+0000 7f747659c700 1 --2- 172.21.15.82:0/2859116976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56255aa85380 0x56255aa85760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:41:04.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.015+0000 7f747559a700 1 -- 172.21.15.82:0/2859116976 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56255aa85ca0 msgr2=0x56255aa7f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:41:04.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.015+0000 7f7466ffd700 1 --2- 172.21.15.82:0/2837482536 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f745c0a00c0 0x7f745c0a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:41:04.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.015+0000 7f747559a700 1 --2- 172.21.15.82:0/2859116976 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56255aa85ca0 0x56255aa7f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:41:04.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.015+0000 7f747559a700 1 -- 172.21.15.82:0/2859116976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56255aa85380 msgr2=0x56255aa85760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:41:04.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.015+0000 7f747559a700 1 --2- 172.21.15.82:0/2859116976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56255aa85380 0x56255aa85760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:41:04.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.015+0000 7f747559a700 1 -- 172.21.15.82:0/2859116976 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56255a851630 con 0x56255aa7fc40 2023-09-23T09:41:04.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.015+0000 7f7466ffd700 1 -- 172.21.15.82:0/2837482536 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f746c0cca50 con 0x7f74700ff610 2023-09-23T09:41:04.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.015+0000 7f747659c700 1 --2- 172.21.15.82:0/2859116976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56255aa85380 0x56255aa85760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:41:04.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.015+0000 7f747559a700 1 --2- 172.21.15.82:0/2859116976 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56255aa7fc40 0x56255aa800a0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f7460009c80 tx=0x7f7460009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d40da9cac9d95faf server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:41:04.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.015+0000 7f747659c700 1 --2- 172.21.15.82:0/2837482536 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f745c0a00c0 0x7f745c0a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:41:04.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.016+0000 7f745bfff700 1 -- 172.21.15.82:0/2859116976 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7460011d60 con 0x56255aa7fc40 2023-09-23T09:41:04.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.016+0000 7f745bfff700 1 -- 172.21.15.82:0/2859116976 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f74600044c0 con 0x56255aa7fc40 2023-09-23T09:41:04.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.016+0000 7f745bfff700 1 -- 172.21.15.82:0/2859116976 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7460005280 con 0x56255aa7fc40 2023-09-23T09:41:04.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.017+0000 7f748ba17b80 1 -- 172.21.15.82:0/2859116976 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56255aa7fc40 msgr2=0x56255aa800a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:41:04.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.017+0000 7f747659c700 1 --2- 172.21.15.82:0/2837482536 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f745c0a00c0 0x7f745c0a2580 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f7468009ec0 tx=0x7f7468009040 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:41:04.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.017+0000 7f748ba17b80 1 --2- 172.21.15.82:0/2859116976 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56255aa7fc40 0x56255aa800a0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f7460009c80 tx=0x7f7460009f90 comp rx=0 tx=0).stop 2023-09-23T09:41:04.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.017+0000 7f748ba17b80 1 -- 172.21.15.82:0/2859116976 shutdown_connections 2023-09-23T09:41:04.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.017+0000 7f748ba17b80 1 --2- 172.21.15.82:0/2859116976 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56255aa7fc40 0x56255aa800a0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:41:04.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.017+0000 7f748ba17b80 1 --2- 172.21.15.82:0/2859116976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56255aa85380 0x56255aa85760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:41:04.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.017+0000 7f748ba17b80 1 --2- 172.21.15.82:0/2859116976 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56255aa85ca0 0x56255aa7f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:41:04.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.017+0000 7f748ba17b80 1 -- 172.21.15.82:0/2859116976 >> 172.21.15.82:0/2859116976 conn(0x56255a9f40e0 msgr2=0x56255aa7a410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:41:04.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.018+0000 7f748ba17b80 1 -- 172.21.15.82:0/2859116976 shutdown_connections 2023-09-23T09:41:04.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.018+0000 7f748ba17b80 1 -- 172.21.15.82:0/2859116976 wait complete. 2023-09-23T09:41:04.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.018+0000 7f748ba17b80 1 -- start start 2023-09-23T09:41:04.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.019+0000 7f748ba17b80 1 Processor -- start 2023-09-23T09:41:04.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.019+0000 7f748ba17b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56255aa7fc40 0x56255aa8bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:41:04.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.019+0000 7f748ba17b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56255aa85380 0x56255aa88e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:41:04.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.019+0000 7f748ba17b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56255aa85ca0 0x56255aa89470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:41:04.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.019+0000 7f748ba17b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56255a9d1990 con 0x56255aa85380 2023-09-23T09:41:04.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.019+0000 7f748ba17b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56255a96fbb0 con 0x56255aa85ca0 2023-09-23T09:41:04.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.019+0000 7f748ba17b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x56255a96f8b0 con 0x56255aa7fc40 2023-09-23T09:41:04.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.020+0000 7f748ba17b80 10 client.0 _ll_register_callbacks cb 0x56255a8b9a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:41:04.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.020+0000 7f747659c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56255aa85ca0 0x56255aa89470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:41:04.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.020+0000 7f747659c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56255aa85ca0 0x56255aa89470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:40432/0 (socket says 172.21.15.82:40432) 2023-09-23T09:41:04.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.020+0000 7f747659c700 1 -- 172.21.15.82:0/3290182331 learned_addr learned my addr 172.21.15.82:0/3290182331 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:41:04.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.020+0000 7f7475d9b700 1 --2- 172.21.15.82:0/3290182331 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56255aa7fc40 0x56255aa8bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:41:04.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.020+0000 7f747559a700 1 --2- 172.21.15.82:0/3290182331 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56255aa85380 0x56255aa88e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:41:04.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.021+0000 7f747659c700 1 -- 172.21.15.82:0/3290182331 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56255aa7fc40 msgr2=0x56255aa8bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:41:04.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.021+0000 7f747659c700 1 --2- 172.21.15.82:0/3290182331 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56255aa7fc40 0x56255aa8bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:41:04.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.021+0000 7f747659c700 1 -- 172.21.15.82:0/3290182331 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56255aa85380 msgr2=0x56255aa88e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:41:04.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.021+0000 7f747659c700 1 --2- 172.21.15.82:0/3290182331 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56255aa85380 0x56255aa88e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:41:04.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.021+0000 7f747659c700 1 -- 172.21.15.82:0/3290182331 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74600098e0 con 0x56255aa85ca0 2023-09-23T09:41:04.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.021+0000 7f7475d9b700 1 --2- 172.21.15.82:0/3290182331 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56255aa7fc40 0x56255aa8bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:41:04.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.021+0000 7f747659c700 1 --2- 172.21.15.82:0/3290182331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56255aa85ca0 0x56255aa89470 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f7468016450 tx=0x7f7468004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=778b0af2b4cd461c server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:41:04.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.021+0000 7f74597fa700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-09-23T09:41:04.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.022+0000 7f74597fa700 1 -- 172.21.15.82:0/3290182331 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7468026070 con 0x56255aa85ca0 2023-09-23T09:41:04.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.022+0000 7f74597fa700 1 -- 172.21.15.82:0/3290182331 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(163..163 src has 1..163) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f7468007e40 con 0x56255aa85ca0 2023-09-23T09:41:04.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.022+0000 7f748ba17b80 1 -- 172.21.15.82:0/3290182331 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56255aa4f1c0 con 0x56255aa85ca0 2023-09-23T09:41:04.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.022+0000 7f74597fa700 1 -- 172.21.15.82:0/3290182331 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=132) v2 ==== 24+0+0 (secure 0 0 0) 0x7f746800e040 con 0x56255aa85ca0 2023-09-23T09:41:04.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.022+0000 7f748ba17b80 10 client.27914 fetch_fsmap learned FSMap version 132 2023-09-23T09:41:04.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.022+0000 7f748ba17b80 1 -- 172.21.15.82:0/3290182331 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=132,monmap=4+}) v3 -- 0x56255a7fdde0 con 0x56255aa85ca0 2023-09-23T09:41:04.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.023+0000 7f74597fa700 1 -- 172.21.15.82:0/3290182331 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56255aa4f1c0 con 0x56255aa85ca0 2023-09-23T09:41:04.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.023+0000 7f74597fa700 1 -- 172.21.15.82:0/3290182331 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 132) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f7468029020 con 0x56255aa85ca0 2023-09-23T09:41:04.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.023+0000 7f748ba17b80 10 client.27914 fetch_fsmap finished waiting for FSMap version 132 2023-09-23T09:41:04.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.023+0000 7f748ba17b80 10 client.27914 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:41:04.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.023+0000 7f748ba17b80 20 client.27914 populate_metadata read hostname 'smithi082' 2023-09-23T09:41:04.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.023+0000 7f748ba17b80 1 --2- 172.21.15.82:0/3290182331 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56255aaa2040 0x56255aaa4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:41:04.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.023+0000 7f748ba17b80 4 client.27914 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:41:04.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.023+0000 7f748ba17b80 1 -- 172.21.15.82:0/3290182331 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56255a977ba0 con 0x56255aaa2040 2023-09-23T09:41:04.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.024+0000 7f7475d9b700 1 --2- 172.21.15.82:0/3290182331 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56255aaa2040 0x56255aaa4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:41:04.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.025+0000 7f7475d9b700 1 --2- 172.21.15.82:0/3290182331 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56255aaa2040 0x56255aaa4460 crc :-1 s=READY pgs=273 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3611dc3ec4dea1f9 server_cookie=d5b2a10f2e10e8ac in_seq=0 out_seq=0 2023-09-23T09:41:04.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.025+0000 7f74597fa700 10 client.27914 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:41:04.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.026+0000 7f74597fa700 1 -- 172.21.15.82:0/3290182331 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56255a977ba0 con 0x56255aaa2040 2023-09-23T09:41:04.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.026+0000 7f74597fa700 10 client.27914 handle_command_reply: tid=0 2023-09-23T09:41:04.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.026+0000 7f748ba17b80 1 client.27914 shutdown 2023-09-23T09:41:04.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.026+0000 7f748ba17b80 1 -- 172.21.15.82:0/3290182331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56255aa85ca0 msgr2=0x56255aa89470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:41:04.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.026+0000 7f748ba17b80 1 --2- 172.21.15.82:0/3290182331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56255aa85ca0 0x56255aa89470 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f7468016450 tx=0x7f7468004ad0 comp rx=0 tx=0).stop 2023-09-23T09:41:04.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.026+0000 7f748ba17b80 1 -- 172.21.15.82:0/3290182331 shutdown_connections 2023-09-23T09:41:04.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.026+0000 7f748ba17b80 1 --2- 172.21.15.82:0/3290182331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56255aa85ca0 0x56255aa89470 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:41:04.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.026+0000 7f748ba17b80 1 --2- 172.21.15.82:0/3290182331 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56255aa7fc40 0x56255aa8bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:41:04.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.026+0000 7f748ba17b80 1 --2- 172.21.15.82:0/3290182331 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56255aaa2040 0x56255aaa4460 crc :-1 s=READY pgs=273 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:41:04.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.026+0000 7f748ba17b80 1 --2- 172.21.15.82:0/3290182331 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56255aa85380 0x56255aa88e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:41:04.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.026+0000 7f748ba17b80 1 -- 172.21.15.82:0/3290182331 >> 172.21.15.82:0/3290182331 conn(0x56255a9f40e0 msgr2=0x56255aa74b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:41:04.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.026+0000 7f74597fa700 0 client.27914 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:41:04.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.027+0000 7f748ba17b80 1 -- 172.21.15.82:0/3290182331 shutdown_connections 2023-09-23T09:41:04.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.027+0000 7f748ba17b80 1 -- 172.21.15.82:0/3290182331 wait complete. 2023-09-23T09:41:04.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.027+0000 7f748ba17b80 20 client.27914 trim_cache size 0 max 16384 2023-09-23T09:41:04.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.056+0000 7f748ba17b80 1 Processor -- start 2023-09-23T09:41:04.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.057+0000 7f748ba17b80 1 -- start start 2023-09-23T09:41:04.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.057+0000 7f748ba17b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56255aa7fc40 0x56255aa7f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:41:04.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.057+0000 7f748ba17b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56255aa85380 0x56255aa88600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:41:04.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.057+0000 7f748ba17b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56255aa85ca0 0x56255aa94f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:41:04.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.057+0000 7f748ba17b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56255a853920 con 0x56255aa85ca0 2023-09-23T09:41:04.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.057+0000 7f748ba17b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56255aa9f620 con 0x56255aa85380 2023-09-23T09:41:04.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.057+0000 7f748ba17b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x56255aa7b600 con 0x56255aa7fc40 2023-09-23T09:41:04.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.057+0000 7f7475d9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56255aa7fc40 0x56255aa7f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:41:04.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.057+0000 7f747659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56255aa85ca0 0x56255aa94f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:41:04.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.057+0000 7f7475d9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56255aa7fc40 0x56255aa7f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:54828/0 (socket says 172.21.15.82:54828) 2023-09-23T09:41:04.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.057+0000 7f7475d9b700 1 -- 172.21.15.82:0/586776653 learned_addr learned my addr 172.21.15.82:0/586776653 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:41:04.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.057+0000 7f747559a700 1 --2- 172.21.15.82:0/586776653 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56255aa85380 0x56255aa88600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:41:04.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.058+0000 7f747659c700 1 -- 172.21.15.82:0/586776653 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56255aa7fc40 msgr2=0x56255aa7f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:41:04.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.058+0000 7f747659c700 1 --2- 172.21.15.82:0/586776653 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56255aa7fc40 0x56255aa7f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:41:04.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.058+0000 7f747659c700 1 -- 172.21.15.82:0/586776653 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56255aa85380 msgr2=0x56255aa88600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:41:04.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.058+0000 7f747659c700 1 --2- 172.21.15.82:0/586776653 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56255aa85380 0x56255aa88600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:41:04.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.058+0000 7f747659c700 1 -- 172.21.15.82:0/586776653 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56255a7e6c60 con 0x56255aa85ca0 2023-09-23T09:41:04.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.058+0000 7f7475d9b700 1 --2- 172.21.15.82:0/586776653 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56255aa7fc40 0x56255aa7f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:41:04.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.058+0000 7f747659c700 1 --2- 172.21.15.82:0/586776653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56255aa85ca0 0x56255aa94f50 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f74680061e0 tx=0x7f7468009300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1e37003ee1382e1 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:41:04.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.059+0000 7f7464ff9700 1 -- 172.21.15.82:0/586776653 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7468026040 con 0x56255aa85ca0 2023-09-23T09:41:04.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.059+0000 7f7464ff9700 1 -- 172.21.15.82:0/586776653 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f746800f040 con 0x56255aa85ca0 2023-09-23T09:41:04.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.059+0000 7f7464ff9700 1 -- 172.21.15.82:0/586776653 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f746800e040 con 0x56255aa85ca0 2023-09-23T09:41:04.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.060+0000 7f748ba17b80 1 -- 172.21.15.82:0/586776653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56255aa85ca0 msgr2=0x56255aa94f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:41:04.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.060+0000 7f748ba17b80 1 --2- 172.21.15.82:0/586776653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56255aa85ca0 0x56255aa94f50 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f74680061e0 tx=0x7f7468009300 comp rx=0 tx=0).stop 2023-09-23T09:41:04.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.060+0000 7f748ba17b80 1 -- 172.21.15.82:0/586776653 shutdown_connections 2023-09-23T09:41:04.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.060+0000 7f748ba17b80 1 --2- 172.21.15.82:0/586776653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56255aa85ca0 0x56255aa94f50 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:41:04.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.060+0000 7f748ba17b80 1 --2- 172.21.15.82:0/586776653 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56255aa7fc40 0x56255aa7f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:41:04.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.060+0000 7f748ba17b80 1 --2- 172.21.15.82:0/586776653 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56255aa85380 0x56255aa88600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:41:04.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.060+0000 7f748ba17b80 1 -- 172.21.15.82:0/586776653 >> 172.21.15.82:0/586776653 conn(0x56255a9f40e0 msgr2=0x56255aaa4050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:41:04.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.060+0000 7f748ba17b80 1 -- 172.21.15.82:0/586776653 shutdown_connections 2023-09-23T09:41:04.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.060+0000 7f748ba17b80 1 -- 172.21.15.82:0/586776653 wait complete. 2023-09-23T09:41:04.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.061+0000 7f748ba17b80 1 -- start start 2023-09-23T09:41:04.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.061+0000 7f748ba17b80 1 Processor -- start 2023-09-23T09:41:04.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.062+0000 7f748ba17b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56255aa7fc40 0x56255aa82580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:41:04.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.062+0000 7f748ba17b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56255aa85380 0x56255aa80e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:41:04.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.062+0000 7f748ba17b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56255aa85ca0 0x56255aa81340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:41:04.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.062+0000 7f748ba17b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56255aa81880 con 0x56255aa7fc40 2023-09-23T09:41:04.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.062+0000 7f748ba17b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56255aa819f0 con 0x56255aa85ca0 2023-09-23T09:41:04.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.062+0000 7f748ba17b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x56255aa81bb0 con 0x56255aa85380 2023-09-23T09:41:04.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.062+0000 7f748ba17b80 10 client.0 _ll_register_callbacks cb 0x7f7468017a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:41:04.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.062+0000 7f747659c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56255aa85ca0 0x56255aa81340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:41:04.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.062+0000 7f747659c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56255aa85ca0 0x56255aa81340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:40452/0 (socket says 172.21.15.82:40452) 2023-09-23T09:41:04.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.062+0000 7f747659c700 1 -- 172.21.15.82:0/2557616283 learned_addr learned my addr 172.21.15.82:0/2557616283 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:41:04.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.063+0000 7f747559a700 1 --2- 172.21.15.82:0/2557616283 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56255aa85380 0x56255aa80e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:41:04.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.063+0000 7f747659c700 1 -- 172.21.15.82:0/2557616283 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56255aa85380 msgr2=0x56255aa80e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:41:04.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.063+0000 7f747659c700 1 --2- 172.21.15.82:0/2557616283 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56255aa85380 0x56255aa80e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:41:04.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.063+0000 7f747659c700 1 -- 172.21.15.82:0/2557616283 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56255aa7fc40 msgr2=0x56255aa82580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:41:04.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.063+0000 7f747659c700 1 --2- 172.21.15.82:0/2557616283 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56255aa7fc40 0x56255aa82580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:41:04.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.063+0000 7f747659c700 1 -- 172.21.15.82:0/2557616283 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56255a7fdde0 con 0x56255aa85ca0 2023-09-23T09:41:04.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.063+0000 7f747659c700 1 --2- 172.21.15.82:0/2557616283 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56255aa85ca0 0x56255aa81340 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f7468016e00 tx=0x7f7468016ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9fbde630d9b20c90 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:41:04.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.063+0000 7f74597fa700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-09-23T09:41:04.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.064+0000 7f74597fa700 1 -- 172.21.15.82:0/2557616283 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7468026040 con 0x56255aa85ca0 2023-09-23T09:41:04.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.065+0000 7f74597fa700 1 -- 172.21.15.82:0/2557616283 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(163..163 src has 1..163) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f7468022e30 con 0x56255aa85ca0 2023-09-23T09:41:04.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.065+0000 7f748ba17b80 1 -- 172.21.15.82:0/2557616283 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56255aa728b0 con 0x56255aa85ca0 2023-09-23T09:41:04.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.065+0000 7f74597fa700 1 -- 172.21.15.82:0/2557616283 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=132) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7468003a00 con 0x56255aa85ca0 2023-09-23T09:41:04.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.065+0000 7f748ba17b80 10 client.27920 fetch_fsmap learned FSMap version 132 2023-09-23T09:41:04.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.065+0000 7f748ba17b80 1 -- 172.21.15.82:0/2557616283 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=132,monmap=4+}) v3 -- 0x56255a824250 con 0x56255aa85ca0 2023-09-23T09:41:04.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.066+0000 7f74597fa700 1 -- 172.21.15.82:0/2557616283 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56255aa728b0 con 0x56255aa85ca0 2023-09-23T09:41:04.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.066+0000 7f74597fa700 1 -- 172.21.15.82:0/2557616283 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 132) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f7468044070 con 0x56255aa85ca0 2023-09-23T09:41:04.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.066+0000 7f748ba17b80 10 client.27920 fetch_fsmap finished waiting for FSMap version 132 2023-09-23T09:41:04.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.066+0000 7f748ba17b80 10 client.27920 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:41:04.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.066+0000 7f748ba17b80 20 client.27920 populate_metadata read hostname 'smithi082' 2023-09-23T09:41:04.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.066+0000 7f748ba17b80 1 --2- 172.21.15.82:0/2557616283 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56255aaf2d80 0x56255aaf3190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:41:04.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.066+0000 7f748ba17b80 4 client.27920 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:41:04.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.066+0000 7f748ba17b80 1 -- 172.21.15.82:0/2557616283 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x56255a9ca970 con 0x56255aaf2d80 2023-09-23T09:41:04.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.067+0000 7f7475d9b700 1 --2- 172.21.15.82:0/2557616283 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56255aaf2d80 0x56255aaf3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:41:04.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.068+0000 7f7475d9b700 1 --2- 172.21.15.82:0/2557616283 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56255aaf2d80 0x56255aaf3190 crc :-1 s=READY pgs=274 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fb9adf94fb4b178 server_cookie=dfc46f1eb3a871fb in_seq=0 out_seq=0 2023-09-23T09:41:04.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.068+0000 7f74597fa700 10 client.27920 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:41:04.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.069+0000 7f74597fa700 1 -- 172.21.15.82:0/2557616283 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x56255a9ca970 con 0x56255aaf2d80 2023-09-23T09:41:04.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.069+0000 7f74597fa700 10 client.27920 handle_command_reply: tid=0 2023-09-23T09:41:04.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.069+0000 7f748ba17b80 1 client.27920 shutdown 2023-09-23T09:41:04.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.069+0000 7f748ba17b80 1 -- 172.21.15.82:0/2557616283 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56255aa85ca0 msgr2=0x56255aa81340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:41:04.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.069+0000 7f748ba17b80 1 --2- 172.21.15.82:0/2557616283 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56255aa85ca0 0x56255aa81340 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f7468016e00 tx=0x7f7468016ee0 comp rx=0 tx=0).stop 2023-09-23T09:41:04.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.070+0000 7f748ba17b80 1 -- 172.21.15.82:0/2557616283 shutdown_connections 2023-09-23T09:41:04.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.070+0000 7f748ba17b80 1 --2- 172.21.15.82:0/2557616283 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56255aa85ca0 0x56255aa81340 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:41:04.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.070+0000 7f748ba17b80 1 --2- 172.21.15.82:0/2557616283 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56255aaf2d80 0x56255aaf3190 crc :-1 s=READY pgs=274 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:41:04.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.070+0000 7f748ba17b80 1 --2- 172.21.15.82:0/2557616283 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56255aa7fc40 0x56255aa82580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:41:04.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.070+0000 7f748ba17b80 1 --2- 172.21.15.82:0/2557616283 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56255aa85380 0x56255aa80e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:41:04.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.070+0000 7f748ba17b80 1 -- 172.21.15.82:0/2557616283 >> 172.21.15.82:0/2557616283 conn(0x56255a9f40e0 msgr2=0x56255aa82fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:41:04.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.070+0000 7f74597fa700 0 client.27920 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:41:04.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.071+0000 7f748ba17b80 1 -- 172.21.15.82:0/2557616283 shutdown_connections 2023-09-23T09:41:04.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.071+0000 7f748ba17b80 1 -- 172.21.15.82:0/2557616283 wait complete. 2023-09-23T09:41:04.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.071+0000 7f748ba17b80 20 client.27920 trim_cache size 0 max 16384 2023-09-23T09:41:04.979 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:41:04.979 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-23T09:41:04.980 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:41:04.980 INFO:teuthology.orchestra.run.smithi082.stdout: "d9e62ab8-1468-4fb0-a9fe-61bed13e954b": { 2023-09-23T09:41:04.980 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:41:04.980 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "d9e62ab8-1468-4fb0-a9fe-61bed13e954b", 2023-09-23T09:41:04.980 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:41:04.980 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:41:04.980 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:41:04.980 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:41:04.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.072+0000 7f7477fff700 1 -- 172.21.15.82:0/2837482536 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f745c0a00c0 msgr2=0x7f745c0a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:41:04.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.072+0000 7f7477fff700 1 --2- 172.21.15.82:0/2837482536 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f745c0a00c0 0x7f745c0a2580 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f7468009ec0 tx=0x7f7468009040 comp rx=0 tx=0).stop 2023-09-23T09:41:04.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.072+0000 7f7477fff700 1 -- 172.21.15.82:0/2837482536 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f74700ff610 msgr2=0x7f747019e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:41:04.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.072+0000 7f7477fff700 1 --2- 172.21.15.82:0/2837482536 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f74700ff610 0x7f747019e8d0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f746c000c00 tx=0x7f746c004730 comp rx=0 tx=0).stop 2023-09-23T09:41:04.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.073+0000 7f7477fff700 1 -- 172.21.15.82:0/2837482536 shutdown_connections 2023-09-23T09:41:04.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.073+0000 7f7477fff700 1 --2- 172.21.15.82:0/2837482536 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f745c0a00c0 0x7f745c0a2580 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:41:04.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.073+0000 7f7477fff700 1 --2- 172.21.15.82:0/2837482536 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f747010d1c0 0x7f7470198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:41:04.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.073+0000 7f7477fff700 1 --2- 172.21.15.82:0/2837482536 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f74700ff610 0x7f747019e8d0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:41:04.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.073+0000 7f7477fff700 1 --2- 172.21.15.82:0/2837482536 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74700fffc0 0x7f747019ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:41:04.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.073+0000 7f7477fff700 1 -- 172.21.15.82:0/2837482536 >> 172.21.15.82:0/2837482536 conn(0x7f74700fb270 msgr2=0x7f747010f390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:41:04.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.073+0000 7f7477fff700 1 -- 172.21.15.82:0/2837482536 shutdown_connections 2023-09-23T09:41:04.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:04.073+0000 7f7477fff700 1 -- 172.21.15.82:0/2837482536 wait complete. 2023-09-23T09:41:04.982 INFO:tasks.cephfs.filesystem:scrub status for tag:d9e62ab8-1468-4fb0-a9fe-61bed13e954b - {'path': '/', 'tag': 'd9e62ab8-1468-4fb0-a9fe-61bed13e954b', 'options': 'recursive,force'} 2023-09-23T09:41:04.983 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:41:04 smithi082 ceph-mon[97694]: pgmap v1402: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.4 MiB/s wr, 565 op/s 2023-09-23T09:41:05.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 835.0 s, 99.8 tps, lat 1061.427 ms stddev 1071.003 2023-09-23T09:41:08.032 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:41:06 smithi161 ceph-mon[99580]: pgmap v1403: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 2.9 MiB/s rd, 6.1 MiB/s wr, 793 op/s 2023-09-23T09:41:08.032 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:41:06 smithi161 ceph-mon[99580]: osdmap e164: 12 total, 12 up, 12 in 2023-09-23T09:41:08.032 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:41:06 smithi135 ceph-mon[99205]: pgmap v1403: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 2.9 MiB/s rd, 6.1 MiB/s wr, 793 op/s 2023-09-23T09:41:08.032 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:41:06 smithi135 ceph-mon[99205]: osdmap e164: 12 total, 12 up, 12 in 2023-09-23T09:41:08.033 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:41:06 smithi082 ceph-mon[97694]: pgmap v1403: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 2.9 MiB/s rd, 6.1 MiB/s wr, 793 op/s 2023-09-23T09:41:08.033 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:41:06 smithi082 ceph-mon[97694]: osdmap e164: 12 total, 12 up, 12 in 2023-09-23T09:41:08.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:41:08 smithi161 ceph-mon[99580]: pgmap v1405: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.6 MiB/s wr, 601 op/s 2023-09-23T09:41:08.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:41:08 smithi135 ceph-mon[99205]: pgmap v1405: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.6 MiB/s wr, 601 op/s 2023-09-23T09:41:08.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:41:08 smithi082 ceph-mon[97694]: pgmap v1405: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.6 MiB/s wr, 601 op/s 2023-09-23T09:41:10.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 840.0 s, 43.0 tps, lat 2146.780 ms stddev 2011.064 2023-09-23T09:41:11.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:41:10 smithi135 ceph-mon[99205]: pgmap v1406: 97 pgs: 11 active+clean+snaptrim_wait, 4 active+clean+snaptrim, 82 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.7 MiB/s wr, 469 op/s 2023-09-23T09:41:11.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:41:10 smithi082 ceph-mon[97694]: pgmap v1406: 97 pgs: 11 active+clean+snaptrim_wait, 4 active+clean+snaptrim, 82 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.7 MiB/s wr, 469 op/s 2023-09-23T09:41:11.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:41:10 smithi161 ceph-mon[99580]: pgmap v1406: 97 pgs: 11 active+clean+snaptrim_wait, 4 active+clean+snaptrim, 82 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.7 MiB/s wr, 469 op/s 2023-09-23T09:41:13.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:41:13 smithi082 ceph-mon[97694]: pgmap v1407: 97 pgs: 17 active+clean+snaptrim_wait, 6 active+clean+snaptrim, 74 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.8 MiB/s wr, 375 op/s 2023-09-23T09:41:13.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:41:13 smithi161 ceph-mon[99580]: pgmap v1407: 97 pgs: 17 active+clean+snaptrim_wait, 6 active+clean+snaptrim, 74 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.8 MiB/s wr, 375 op/s 2023-09-23T09:41:13.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:41:13 smithi135 ceph-mon[99205]: pgmap v1407: 97 pgs: 17 active+clean+snaptrim_wait, 6 active+clean+snaptrim, 74 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.8 MiB/s wr, 375 op/s 2023-09-23T09:41:14.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:41:14 smithi082 ceph-mon[97694]: pgmap v1408: 97 pgs: 17 active+clean+snaptrim_wait, 6 active+clean+snaptrim, 74 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.8 MiB/s wr, 375 op/s 2023-09-23T09:41:14.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:41:14 smithi161 ceph-mon[99580]: pgmap v1408: 97 pgs: 17 active+clean+snaptrim_wait, 6 active+clean+snaptrim, 74 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.8 MiB/s wr, 375 op/s 2023-09-23T09:41:14.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:41:14 smithi135 ceph-mon[99205]: pgmap v1408: 97 pgs: 17 active+clean+snaptrim_wait, 6 active+clean+snaptrim, 74 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.8 MiB/s wr, 375 op/s 2023-09-23T09:41:15.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 845.0 s, 182.4 tps, lat 614.276 ms stddev 745.897 2023-09-23T09:41:17.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:41:16 smithi135 ceph-mon[99205]: pgmap v1409: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.2 MiB/s wr, 383 op/s 2023-09-23T09:41:17.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:41:16 smithi082 ceph-mon[97694]: pgmap v1409: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.2 MiB/s wr, 383 op/s 2023-09-23T09:41:17.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:41:16 smithi161 ceph-mon[99580]: pgmap v1409: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.2 MiB/s wr, 383 op/s 2023-09-23T09:41:18.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:41:18 smithi082 ceph-mon[97694]: osdmap e165: 12 total, 12 up, 12 in 2023-09-23T09:41:18.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:41:18 smithi082 ceph-mon[97694]: pgmap v1411: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.2 MiB/s wr, 383 op/s 2023-09-23T09:41:18.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:41:18 smithi161 ceph-mon[99580]: osdmap e165: 12 total, 12 up, 12 in 2023-09-23T09:41:18.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:41:18 smithi161 ceph-mon[99580]: pgmap v1411: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.2 MiB/s wr, 383 op/s 2023-09-23T09:41:18.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:41:18 smithi135 ceph-mon[99205]: osdmap e165: 12 total, 12 up, 12 in 2023-09-23T09:41:18.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:41:18 smithi135 ceph-mon[99205]: pgmap v1411: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.2 MiB/s wr, 383 op/s 2023-09-23T09:41:20.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 850.0 s, 180.4 tps, lat 543.871 ms stddev 523.117 2023-09-23T09:41:21.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:41:20 smithi135 ceph-mon[99205]: pgmap v1412: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.3 MiB/s wr, 525 op/s 2023-09-23T09:41:21.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:41:20 smithi082 ceph-mon[97694]: pgmap v1412: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.3 MiB/s wr, 525 op/s 2023-09-23T09:41:21.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:41:20 smithi161 ceph-mon[99580]: pgmap v1412: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.3 MiB/s wr, 525 op/s 2023-09-23T09:41:23.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:41:22 smithi135 ceph-mon[99205]: pgmap v1413: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.1 MiB/s wr, 608 op/s 2023-09-23T09:41:23.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:41:22 smithi082 ceph-mon[97694]: pgmap v1413: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.1 MiB/s wr, 608 op/s 2023-09-23T09:41:23.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:41:22 smithi161 ceph-mon[99580]: pgmap v1413: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.1 MiB/s wr, 608 op/s 2023-09-23T09:41:25.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:41:24 smithi135 ceph-mon[99205]: pgmap v1414: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.1 MiB/s wr, 608 op/s 2023-09-23T09:41:25.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:41:24 smithi082 ceph-mon[97694]: pgmap v1414: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.1 MiB/s wr, 608 op/s 2023-09-23T09:41:25.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:41:24 smithi161 ceph-mon[99580]: pgmap v1414: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.1 MiB/s wr, 608 op/s 2023-09-23T09:41:25.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 855.0 s, 161.2 tps, lat 621.955 ms stddev 554.275 2023-09-23T09:41:27.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:41:26 smithi135 ceph-mon[99205]: pgmap v1415: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.1 MiB/s wr, 643 op/s 2023-09-23T09:41:27.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:41:26 smithi082 ceph-mon[97694]: pgmap v1415: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.1 MiB/s wr, 643 op/s 2023-09-23T09:41:27.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:41:26 smithi161 ceph-mon[99580]: pgmap v1415: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.1 MiB/s wr, 643 op/s 2023-09-23T09:41:28.626 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:41:28 smithi082 ceph-mon[97694]: pgmap v1416: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 2.8 MiB/s rd, 4.9 MiB/s wr, 610 op/s 2023-09-23T09:41:28.651 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:41:28 smithi161 ceph-mon[99580]: pgmap v1416: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 2.8 MiB/s rd, 4.9 MiB/s wr, 610 op/s 2023-09-23T09:41:28.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:41:28 smithi135 ceph-mon[99205]: pgmap v1416: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 2.8 MiB/s rd, 4.9 MiB/s wr, 610 op/s 2023-09-23T09:41:30.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 860.0 s, 158.6 tps, lat 610.000 ms stddev 557.545 2023-09-23T09:41:31.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:41:30 smithi135 ceph-mon[99205]: pgmap v1417: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 3.2 MiB/s rd, 5.8 MiB/s wr, 713 op/s 2023-09-23T09:41:31.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:41:30 smithi082 ceph-mon[97694]: pgmap v1417: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 3.2 MiB/s rd, 5.8 MiB/s wr, 713 op/s 2023-09-23T09:41:31.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:41:30 smithi161 ceph-mon[99580]: pgmap v1417: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 3.2 MiB/s rd, 5.8 MiB/s wr, 713 op/s 2023-09-23T09:41:33.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:41:32 smithi135 ceph-mon[99205]: pgmap v1418: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.1 MiB/s wr, 632 op/s 2023-09-23T09:41:33.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:41:32 smithi082 ceph-mon[97694]: pgmap v1418: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.1 MiB/s wr, 632 op/s 2023-09-23T09:41:33.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:41:32 smithi161 ceph-mon[99580]: pgmap v1418: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.1 MiB/s wr, 632 op/s 2023-09-23T09:41:34.984 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:41:35.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.306+0000 7f30c97ff700 1 -- 172.21.15.82:0/406783292 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f30c4107b90 msgr2=0x7f30c4107f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:41:35.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.306+0000 7f30c97ff700 1 --2- 172.21.15.82:0/406783292 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f30c4107b90 0x7f30c4107f70 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f30b400b0a0 tx=0x7f30b400b3b0 comp rx=0 tx=0).stop 2023-09-23T09:41:35.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.306+0000 7f30c97ff700 1 -- 172.21.15.82:0/406783292 shutdown_connections 2023-09-23T09:41:35.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.306+0000 7f30c97ff700 1 --2- 172.21.15.82:0/406783292 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30c410c4b0 0x7f30c410c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:41:35.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.306+0000 7f30c97ff700 1 --2- 172.21.15.82:0/406783292 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f30c4107b90 0x7f30c4107f70 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:41:35.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.306+0000 7f30c97ff700 1 --2- 172.21.15.82:0/406783292 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30c41084b0 0x7f30c410bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:41:35.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.307+0000 7f30c97ff700 1 -- 172.21.15.82:0/406783292 >> 172.21.15.82:0/406783292 conn(0x7f30c406ce40 msgr2=0x7f30c406d250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:41:35.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.307+0000 7f30c97ff700 1 -- 172.21.15.82:0/406783292 shutdown_connections 2023-09-23T09:41:35.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.307+0000 7f30c97ff700 1 -- 172.21.15.82:0/406783292 wait complete. 2023-09-23T09:41:35.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.308+0000 7f30c97ff700 1 Processor -- start 2023-09-23T09:41:35.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:41:34 smithi135 ceph-mon[99205]: pgmap v1419: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.4 MiB/s wr, 542 op/s 2023-09-23T09:41:35.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.308+0000 7f30c97ff700 1 -- start start 2023-09-23T09:41:35.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.309+0000 7f30c97ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30c4107b90 0x7f30c41ab6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:41:35.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.309+0000 7f30c97ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f30c41084b0 0x7f30c41abbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:41:35.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.309+0000 7f30c97ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30c410c4b0 0x7f30c41a5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:41:35.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.309+0000 7f30c97ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30c41a62c0 con 0x7f30c410c4b0 2023-09-23T09:41:35.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.309+0000 7f30c97ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30c41a6430 con 0x7f30c41084b0 2023-09-23T09:41:35.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.309+0000 7f30c97ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30c41a65f0 con 0x7f30c4107b90 2023-09-23T09:41:35.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.310+0000 7f30c27fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f30c41084b0 0x7f30c41abbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:41:35.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.310+0000 7f30c27fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f30c41084b0 0x7f30c41abbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:48390/0 (socket says 172.21.15.82:48390) 2023-09-23T09:41:35.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.310+0000 7f30c27fc700 1 -- 172.21.15.82:0/1893187976 learned_addr learned my addr 172.21.15.82:0/1893187976 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:41:35.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.310+0000 7f30c37fe700 1 --2- 172.21.15.82:0/1893187976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30c410c4b0 0x7f30c41a5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:41:35.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.310+0000 7f30c2ffd700 1 --2- 172.21.15.82:0/1893187976 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30c4107b90 0x7f30c41ab6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:41:35.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.311+0000 7f30c27fc700 1 -- 172.21.15.82:0/1893187976 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30c4107b90 msgr2=0x7f30c41ab6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:41:35.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.311+0000 7f30c27fc700 1 --2- 172.21.15.82:0/1893187976 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30c4107b90 0x7f30c41ab6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:41:35.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.311+0000 7f30c27fc700 1 -- 172.21.15.82:0/1893187976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30c410c4b0 msgr2=0x7f30c41a5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:41:35.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.311+0000 7f30c27fc700 1 --2- 172.21.15.82:0/1893187976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30c410c4b0 0x7f30c41a5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:41:35.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.311+0000 7f30c27fc700 1 -- 172.21.15.82:0/1893187976 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30b4009d00 con 0x7f30c41084b0 2023-09-23T09:41:35.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.311+0000 7f30c37fe700 1 --2- 172.21.15.82:0/1893187976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30c410c4b0 0x7f30c41a5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:41:35.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.311+0000 7f30c27fc700 1 --2- 172.21.15.82:0/1893187976 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f30c41084b0 0x7f30c41abbe0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f30b800e9a0 tx=0x7f30b800ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:41:35.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.311+0000 7f30abfff700 1 -- 172.21.15.82:0/1893187976 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b8009790 con 0x7f30c41084b0 2023-09-23T09:41:35.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.311+0000 7f30c97ff700 1 -- 172.21.15.82:0/1893187976 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30c41a68d0 con 0x7f30c41084b0 2023-09-23T09:41:35.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.312+0000 7f30abfff700 1 -- 172.21.15.82:0/1893187976 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f30b800cbd0 con 0x7f30c41084b0 2023-09-23T09:41:35.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.312+0000 7f30abfff700 1 -- 172.21.15.82:0/1893187976 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b8018680 con 0x7f30c41084b0 2023-09-23T09:41:35.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.312+0000 7f30c97ff700 1 -- 172.21.15.82:0/1893187976 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30c41b2690 con 0x7f30c41084b0 2023-09-23T09:41:35.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.317+0000 7f30abfff700 1 -- 172.21.15.82:0/1893187976 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f30b800cd40 con 0x7f30c41084b0 2023-09-23T09:41:35.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.317+0000 7f30dd0bbb80 1 Processor -- start 2023-09-23T09:41:35.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.318+0000 7f30dd0bbb80 1 -- start start 2023-09-23T09:41:35.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.318+0000 7f30dd0bbb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5583ce2c2380 0x5583ce2c2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:41:35.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.318+0000 7f30dd0bbb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5583ce2c2ca0 0x5583ce2bc700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:41:35.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.318+0000 7f30dd0bbb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5583ce2bcc40 0x5583ce2bd0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:41:35.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.318+0000 7f30dd0bbb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583ce2247b0 con 0x5583ce2c2ca0 2023-09-23T09:41:35.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.318+0000 7f30dd0bbb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583ce215780 con 0x5583ce2c2380 2023-09-23T09:41:35.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.318+0000 7f30dd0bbb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583ce2130a0 con 0x5583ce2bcc40 2023-09-23T09:41:35.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.319+0000 7f30c2ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5583ce2c2ca0 0x5583ce2bc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:41:35.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.319+0000 7f30c2ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5583ce2c2ca0 0x5583ce2bc700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37440/0 (socket says 172.21.15.82:37440) 2023-09-23T09:41:35.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.319+0000 7f30c2ffd700 1 -- 172.21.15.82:0/2642368713 learned_addr learned my addr 172.21.15.82:0/2642368713 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:41:35.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.319+0000 7f30c37fe700 1 --2- 172.21.15.82:0/2642368713 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5583ce2c2380 0x5583ce2c2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:41:35.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.320+0000 7f30c27fc700 1 --2- 172.21.15.82:0/2642368713 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5583ce2bcc40 0x5583ce2bd0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:41:35.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.320+0000 7f30abfff700 1 --2- 172.21.15.82:0/1893187976 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f30ac0a01c0 0x7f30ac0a2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:41:35.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.320+0000 7f30c2ffd700 1 -- 172.21.15.82:0/2642368713 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5583ce2bcc40 msgr2=0x5583ce2bd0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:41:35.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.320+0000 7f30c2ffd700 1 --2- 172.21.15.82:0/2642368713 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5583ce2bcc40 0x5583ce2bd0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:41:35.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.320+0000 7f30c2ffd700 1 -- 172.21.15.82:0/2642368713 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5583ce2c2380 msgr2=0x5583ce2c2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:41:35.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.320+0000 7f30c2ffd700 1 --2- 172.21.15.82:0/2642368713 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5583ce2c2380 0x5583ce2c2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:41:35.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.320+0000 7f30c2ffd700 1 -- 172.21.15.82:0/2642368713 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5583ce08e630 con 0x5583ce2c2ca0 2023-09-23T09:41:35.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.320+0000 7f30abfff700 1 -- 172.21.15.82:0/1893187976 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f30b8014070 con 0x7f30c41084b0 2023-09-23T09:41:35.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.321+0000 7f30c37fe700 1 --2- 172.21.15.82:0/1893187976 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f30ac0a01c0 0x7f30ac0a2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:41:35.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.321+0000 7f30c2ffd700 1 --2- 172.21.15.82:0/2642368713 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5583ce2c2ca0 0x5583ce2bc700 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f30b400b0a0 tx=0x7f30b4009c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed75b637e04a623 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:41:35.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.321+0000 7f30c37fe700 1 --2- 172.21.15.82:0/1893187976 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f30ac0a01c0 0x7f30ac0a2680 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f30bc0041e0 tx=0x7f30bc014040 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:41:35.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.322+0000 7f30a97fa700 1 -- 172.21.15.82:0/2642368713 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b400e040 con 0x5583ce2c2ca0 2023-09-23T09:41:35.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.322+0000 7f30a97fa700 1 -- 172.21.15.82:0/2642368713 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f30b4009460 con 0x5583ce2c2ca0 2023-09-23T09:41:35.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.322+0000 7f30a97fa700 1 -- 172.21.15.82:0/2642368713 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b4004c90 con 0x5583ce2c2ca0 2023-09-23T09:41:35.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.323+0000 7f30dd0bbb80 1 -- 172.21.15.82:0/2642368713 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5583ce2c2ca0 msgr2=0x5583ce2bc700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:41:35.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.323+0000 7f30dd0bbb80 1 --2- 172.21.15.82:0/2642368713 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5583ce2c2ca0 0x5583ce2bc700 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f30b400b0a0 tx=0x7f30b4009c80 comp rx=0 tx=0).stop 2023-09-23T09:41:35.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.323+0000 7f30dd0bbb80 1 -- 172.21.15.82:0/2642368713 shutdown_connections 2023-09-23T09:41:35.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.323+0000 7f30dd0bbb80 1 --2- 172.21.15.82:0/2642368713 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5583ce2bcc40 0x5583ce2bd0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:41:35.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.323+0000 7f30dd0bbb80 1 --2- 172.21.15.82:0/2642368713 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5583ce2c2380 0x5583ce2c2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:41:35.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.323+0000 7f30dd0bbb80 1 --2- 172.21.15.82:0/2642368713 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5583ce2c2ca0 0x5583ce2bc700 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:41:35.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.323+0000 7f30dd0bbb80 1 -- 172.21.15.82:0/2642368713 >> 172.21.15.82:0/2642368713 conn(0x5583ce2310e0 msgr2=0x5583ce2b7410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:41:35.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.323+0000 7f30dd0bbb80 1 -- 172.21.15.82:0/2642368713 shutdown_connections 2023-09-23T09:41:35.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.323+0000 7f30dd0bbb80 1 -- 172.21.15.82:0/2642368713 wait complete. 2023-09-23T09:41:35.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.324+0000 7f30dd0bbb80 1 -- start start 2023-09-23T09:41:35.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.324+0000 7f30dd0bbb80 1 Processor -- start 2023-09-23T09:41:35.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.325+0000 7f30dd0bbb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5583ce2bcc40 0x5583ce2c8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:41:35.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.325+0000 7f30dd0bbb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5583ce2c2380 0x5583ce2c5f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:41:35.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.325+0000 7f30dd0bbb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5583ce2c2ca0 0x5583ce2c66d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:41:35.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.325+0000 7f30dd0bbb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583ce20e990 con 0x5583ce2bcc40 2023-09-23T09:41:35.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.325+0000 7f30dd0bbb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583ce1acbb0 con 0x5583ce2c2380 2023-09-23T09:41:35.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.325+0000 7f30dd0bbb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583ce1ac8b0 con 0x5583ce2c2ca0 2023-09-23T09:41:35.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.325+0000 7f30dd0bbb80 10 client.0 _ll_register_callbacks cb 0x5583ce0f6a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:41:35.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.325+0000 7f30c2ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5583ce2bcc40 0x5583ce2c8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:41:35.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.325+0000 7f30c2ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5583ce2bcc40 0x5583ce2c8ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37448/0 (socket says 172.21.15.82:37448) 2023-09-23T09:41:35.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.325+0000 7f30c2ffd700 1 -- 172.21.15.82:0/452707494 learned_addr learned my addr 172.21.15.82:0/452707494 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:41:35.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.326+0000 7f30c37fe700 1 --2- 172.21.15.82:0/452707494 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5583ce2c2ca0 0x5583ce2c66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:41:35.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.326+0000 7f30c27fc700 1 --2- 172.21.15.82:0/452707494 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5583ce2c2380 0x5583ce2c5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:41:35.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.326+0000 7f30c2ffd700 1 -- 172.21.15.82:0/452707494 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5583ce2c2ca0 msgr2=0x5583ce2c66d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:41:35.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.326+0000 7f30c2ffd700 1 --2- 172.21.15.82:0/452707494 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5583ce2c2ca0 0x5583ce2c66d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:41:35.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.326+0000 7f30c2ffd700 1 -- 172.21.15.82:0/452707494 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5583ce2c2380 msgr2=0x5583ce2c5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:41:35.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.326+0000 7f30c2ffd700 1 --2- 172.21.15.82:0/452707494 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5583ce2c2380 0x5583ce2c5f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:41:35.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.326+0000 7f30c2ffd700 1 -- 172.21.15.82:0/452707494 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30c41157b0 con 0x5583ce2bcc40 2023-09-23T09:41:35.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.326+0000 7f30c27fc700 1 --2- 172.21.15.82:0/452707494 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5583ce2c2380 0x5583ce2c5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T09:41:35.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.326+0000 7f30c2ffd700 1 --2- 172.21.15.82:0/452707494 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5583ce2bcc40 0x5583ce2c8ca0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f30b40075b0 tx=0x7f30b4009460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53aa75916970ccfa server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:41:35.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.326+0000 7f30a6ff5700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:41:35.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.327+0000 7f30a6ff5700 1 -- 172.21.15.82:0/452707494 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b400e050 con 0x5583ce2bcc40 2023-09-23T09:41:35.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.327+0000 7f30a6ff5700 1 -- 172.21.15.82:0/452707494 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(165..165 src has 1..165) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f30b4003a00 con 0x5583ce2bcc40 2023-09-23T09:41:35.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.327+0000 7f30dd0bbb80 1 -- 172.21.15.82:0/452707494 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5583ce28c1c0 con 0x5583ce2bcc40 2023-09-23T09:41:35.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.327+0000 7f30a6ff5700 1 -- 172.21.15.82:0/452707494 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=132) v2 ==== 24+0+0 (secure 0 0 0) 0x7f30b4003bc0 con 0x5583ce2bcc40 2023-09-23T09:41:35.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.327+0000 7f30dd0bbb80 10 client.18192 fetch_fsmap learned FSMap version 132 2023-09-23T09:41:35.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.327+0000 7f30dd0bbb80 1 -- 172.21.15.82:0/452707494 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=132,monmap=4+}) v3 -- 0x5583ce03ade0 con 0x5583ce2bcc40 2023-09-23T09:41:35.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.327+0000 7f30a6ff5700 1 -- 172.21.15.82:0/452707494 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5583ce28c1c0 con 0x5583ce2bcc40 2023-09-23T09:41:35.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.328+0000 7f30a6ff5700 1 -- 172.21.15.82:0/452707494 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 132) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f30b400b0d0 con 0x5583ce2bcc40 2023-09-23T09:41:35.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.328+0000 7f30dd0bbb80 10 client.18192 fetch_fsmap finished waiting for FSMap version 132 2023-09-23T09:41:35.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.328+0000 7f30dd0bbb80 10 client.18192 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:41:35.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.328+0000 7f30dd0bbb80 20 client.18192 populate_metadata read hostname 'smithi082' 2023-09-23T09:41:35.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.328+0000 7f30dd0bbb80 1 --2- 172.21.15.82:0/452707494 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5583ce2d61d0 0x5583ce2d85c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:41:35.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.328+0000 7f30dd0bbb80 4 client.18192 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:41:35.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.328+0000 7f30dd0bbb80 1 -- 172.21.15.82:0/452707494 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5583ce1b4ba0 con 0x5583ce2d61d0 2023-09-23T09:41:35.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.328+0000 7f30c27fc700 1 --2- 172.21.15.82:0/452707494 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5583ce2d61d0 0x5583ce2d85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:41:35.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.329+0000 7f30a6ff5700 10 client.18192 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:41:35.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.329+0000 7f30c27fc700 1 --2- 172.21.15.82:0/452707494 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5583ce2d61d0 0x5583ce2d85c0 crc :-1 s=READY pgs=275 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=564a909e199006c8 server_cookie=c3fed1dc0d0f9720 in_seq=0 out_seq=0 2023-09-23T09:41:35.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.330+0000 7f30a6ff5700 1 -- 172.21.15.82:0/452707494 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5583ce1b4ba0 con 0x5583ce2d61d0 2023-09-23T09:41:35.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.330+0000 7f30a6ff5700 10 client.18192 handle_command_reply: tid=0 2023-09-23T09:41:35.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.330+0000 7f30dd0bbb80 1 client.18192 shutdown 2023-09-23T09:41:35.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.330+0000 7f30dd0bbb80 1 -- 172.21.15.82:0/452707494 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5583ce2bcc40 msgr2=0x5583ce2c8ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:41:35.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.330+0000 7f30dd0bbb80 1 --2- 172.21.15.82:0/452707494 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5583ce2bcc40 0x5583ce2c8ca0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f30b40075b0 tx=0x7f30b4009460 comp rx=0 tx=0).stop 2023-09-23T09:41:35.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.330+0000 7f30dd0bbb80 1 -- 172.21.15.82:0/452707494 shutdown_connections 2023-09-23T09:41:35.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.330+0000 7f30dd0bbb80 1 --2- 172.21.15.82:0/452707494 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5583ce2c2ca0 0x5583ce2c66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:41:35.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.330+0000 7f30dd0bbb80 1 --2- 172.21.15.82:0/452707494 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5583ce2d61d0 0x5583ce2d85c0 crc :-1 s=READY pgs=275 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:41:35.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.330+0000 7f30dd0bbb80 1 --2- 172.21.15.82:0/452707494 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5583ce2bcc40 0x5583ce2c8ca0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:41:35.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.330+0000 7f30dd0bbb80 1 --2- 172.21.15.82:0/452707494 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5583ce2c2380 0x5583ce2c5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:41:35.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.330+0000 7f30dd0bbb80 1 -- 172.21.15.82:0/452707494 >> 172.21.15.82:0/452707494 conn(0x5583ce2310e0 msgr2=0x5583ce2b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:41:35.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.330+0000 7f30a6ff5700 0 client.18192 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:41:35.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.330+0000 7f30dd0bbb80 1 -- 172.21.15.82:0/452707494 shutdown_connections 2023-09-23T09:41:35.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.330+0000 7f30dd0bbb80 1 -- 172.21.15.82:0/452707494 wait complete. 2023-09-23T09:41:35.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.331+0000 7f30dd0bbb80 20 client.18192 trim_cache size 0 max 16384 2023-09-23T09:41:35.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.357+0000 7f30dd0bbb80 1 Processor -- start 2023-09-23T09:41:35.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.357+0000 7f30dd0bbb80 1 -- start start 2023-09-23T09:41:35.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.357+0000 7f30dd0bbb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5583ce2bcc40 0x5583ce2c57a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:41:35.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.357+0000 7f30dd0bbb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5583ce2c2380 0x5583ce2c8840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:41:35.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.357+0000 7f30dd0bbb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5583ce2c2ca0 0x5583ce2c0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:41:35.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.357+0000 7f30dd0bbb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583ce090920 con 0x5583ce2c2380 2023-09-23T09:41:35.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.357+0000 7f30dd0bbb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583ce2b7960 con 0x5583ce2c2ca0 2023-09-23T09:41:35.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.357+0000 7f30dd0bbb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583ce2c92a0 con 0x5583ce2bcc40 2023-09-23T09:41:35.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.358+0000 7f30c2ffd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5583ce2bcc40 0x5583ce2c57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:41:35.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.358+0000 7f30c2ffd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5583ce2bcc40 0x5583ce2c57a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:37448/0 (socket says 172.21.15.82:37448) 2023-09-23T09:41:35.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.358+0000 7f30c2ffd700 1 -- 172.21.15.82:0/2283909372 learned_addr learned my addr 172.21.15.82:0/2283909372 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:41:35.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.358+0000 7f30c27fc700 1 --2- 172.21.15.82:0/2283909372 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5583ce2c2380 0x5583ce2c8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:41:35.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.358+0000 7f30c37fe700 1 --2- 172.21.15.82:0/2283909372 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5583ce2c2ca0 0x5583ce2c0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:41:35.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.358+0000 7f30c2ffd700 1 -- 172.21.15.82:0/2283909372 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5583ce2c2ca0 msgr2=0x5583ce2c0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:41:35.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.358+0000 7f30c2ffd700 1 --2- 172.21.15.82:0/2283909372 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5583ce2c2ca0 0x5583ce2c0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:41:35.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.358+0000 7f30c2ffd700 1 -- 172.21.15.82:0/2283909372 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5583ce2c2380 msgr2=0x5583ce2c8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:41:35.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.358+0000 7f30c2ffd700 1 --2- 172.21.15.82:0/2283909372 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5583ce2c2380 0x5583ce2c8840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:41:35.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.358+0000 7f30c2ffd700 1 -- 172.21.15.82:0/2283909372 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5583ce023c60 con 0x5583ce2bcc40 2023-09-23T09:41:35.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.358+0000 7f30c27fc700 1 --2- 172.21.15.82:0/2283909372 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5583ce2c2380 0x5583ce2c8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:41:35.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.359+0000 7f30c2ffd700 1 --2- 172.21.15.82:0/2283909372 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5583ce2bcc40 0x5583ce2c57a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f30b4009780 tx=0x7f30b40097b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb123aeb676f5e3f server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:41:35.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.359+0000 7f30a9ffb700 1 -- 172.21.15.82:0/2283909372 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b400e040 con 0x5583ce2bcc40 2023-09-23T09:41:35.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.359+0000 7f30a9ffb700 1 -- 172.21.15.82:0/2283909372 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f30b4003e90 con 0x5583ce2bcc40 2023-09-23T09:41:35.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.359+0000 7f30a9ffb700 1 -- 172.21.15.82:0/2283909372 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b401b800 con 0x5583ce2bcc40 2023-09-23T09:41:35.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.360+0000 7f30dd0bbb80 1 -- 172.21.15.82:0/2283909372 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5583ce2bcc40 msgr2=0x5583ce2c57a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:41:35.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.360+0000 7f30dd0bbb80 1 --2- 172.21.15.82:0/2283909372 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5583ce2bcc40 0x5583ce2c57a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f30b4009780 tx=0x7f30b40097b0 comp rx=0 tx=0).stop 2023-09-23T09:41:35.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.361+0000 7f30dd0bbb80 1 -- 172.21.15.82:0/2283909372 shutdown_connections 2023-09-23T09:41:35.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.361+0000 7f30dd0bbb80 1 --2- 172.21.15.82:0/2283909372 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5583ce2c2ca0 0x5583ce2c0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:41:35.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.361+0000 7f30dd0bbb80 1 --2- 172.21.15.82:0/2283909372 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5583ce2bcc40 0x5583ce2c57a0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:41:35.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.361+0000 7f30dd0bbb80 1 --2- 172.21.15.82:0/2283909372 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5583ce2c2380 0x5583ce2c8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:41:35.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.361+0000 7f30dd0bbb80 1 -- 172.21.15.82:0/2283909372 >> 172.21.15.82:0/2283909372 conn(0x5583ce2310e0 msgr2=0x5583ce2d2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:41:35.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.361+0000 7f30dd0bbb80 1 -- 172.21.15.82:0/2283909372 shutdown_connections 2023-09-23T09:41:35.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.361+0000 7f30dd0bbb80 1 -- 172.21.15.82:0/2283909372 wait complete. 2023-09-23T09:41:35.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.362+0000 7f30dd0bbb80 1 -- start start 2023-09-23T09:41:35.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.362+0000 7f30dd0bbb80 1 Processor -- start 2023-09-23T09:41:35.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.362+0000 7f30dd0bbb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5583ce2bcc40 0x5583ce2cb720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:41:35.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.362+0000 7f30dd0bbb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5583ce2c2380 0x5583ce2cbc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:41:35.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.362+0000 7f30dd0bbb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5583ce2c2ca0 0x5583ce2cc1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:41:35.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.362+0000 7f30dd0bbb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583ce328fa0 con 0x5583ce2c2ca0 2023-09-23T09:41:35.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.362+0000 7f30dd0bbb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583ce3290e0 con 0x5583ce2c2380 2023-09-23T09:41:35.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.362+0000 7f30dd0bbb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583ce329250 con 0x5583ce2bcc40 2023-09-23T09:41:35.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.362+0000 7f30dd0bbb80 10 client.0 _ll_register_callbacks cb 0x7f30bc005ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:41:35.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.363+0000 7f30c2ffd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5583ce2bcc40 0x5583ce2cb720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:41:35.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.363+0000 7f30c2ffd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5583ce2bcc40 0x5583ce2cb720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:37454/0 (socket says 172.21.15.82:37454) 2023-09-23T09:41:35.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.363+0000 7f30c2ffd700 1 -- 172.21.15.82:0/1203098008 learned_addr learned my addr 172.21.15.82:0/1203098008 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:41:35.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.363+0000 7f30c37fe700 1 --2- 172.21.15.82:0/1203098008 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5583ce2c2ca0 0x5583ce2cc1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:41:35.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.363+0000 7f30c27fc700 1 --2- 172.21.15.82:0/1203098008 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5583ce2c2380 0x5583ce2cbc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:41:35.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.363+0000 7f30c2ffd700 1 -- 172.21.15.82:0/1203098008 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5583ce2c2380 msgr2=0x5583ce2cbc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:41:35.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.363+0000 7f30c2ffd700 1 --2- 172.21.15.82:0/1203098008 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5583ce2c2380 0x5583ce2cbc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:41:35.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.363+0000 7f30c2ffd700 1 -- 172.21.15.82:0/1203098008 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5583ce2c2ca0 msgr2=0x5583ce2cc1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:41:35.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.363+0000 7f30c2ffd700 1 --2- 172.21.15.82:0/1203098008 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5583ce2c2ca0 0x5583ce2cc1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:41:35.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.363+0000 7f30c2ffd700 1 -- 172.21.15.82:0/1203098008 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30c41b2690 con 0x5583ce2bcc40 2023-09-23T09:41:35.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.364+0000 7f30c2ffd700 1 --2- 172.21.15.82:0/1203098008 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5583ce2bcc40 0x5583ce2cb720 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f30b401b610 tx=0x7f30b4007520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a2f75ef5b12023e server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:41:35.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.364+0000 7f30a6ff5700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T09:41:35.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.365+0000 7f30a6ff5700 1 -- 172.21.15.82:0/1203098008 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b400e070 con 0x5583ce2bcc40 2023-09-23T09:41:35.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.365+0000 7f30a6ff5700 1 -- 172.21.15.82:0/1203098008 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(165..165 src has 1..165) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f30b400bcc0 con 0x5583ce2bcc40 2023-09-23T09:41:35.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.365+0000 7f30dd0bbb80 1 -- 172.21.15.82:0/1203098008 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5583ce2af8b0 con 0x5583ce2bcc40 2023-09-23T09:41:35.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.365+0000 7f30a6ff5700 1 -- 172.21.15.82:0/1203098008 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=132) v2 ==== 24+0+0 (secure 0 0 0) 0x7f30b4003a00 con 0x5583ce2bcc40 2023-09-23T09:41:35.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.365+0000 7f30dd0bbb80 10 client.27979 fetch_fsmap learned FSMap version 132 2023-09-23T09:41:35.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.365+0000 7f30dd0bbb80 1 -- 172.21.15.82:0/1203098008 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=132,monmap=4+}) v3 -- 0x5583ce03ade0 con 0x5583ce2bcc40 2023-09-23T09:41:35.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.366+0000 7f30a6ff5700 1 -- 172.21.15.82:0/1203098008 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f30b4047030 con 0x5583ce2bcc40 2023-09-23T09:41:35.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.366+0000 7f30a6ff5700 1 -- 172.21.15.82:0/1203098008 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 132) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f30b4041060 con 0x5583ce2bcc40 2023-09-23T09:41:35.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.366+0000 7f30dd0bbb80 10 client.27979 fetch_fsmap finished waiting for FSMap version 132 2023-09-23T09:41:35.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.366+0000 7f30dd0bbb80 10 client.27979 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:41:35.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.366+0000 7f30dd0bbb80 20 client.27979 populate_metadata read hostname 'smithi082' 2023-09-23T09:41:35.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.366+0000 7f30dd0bbb80 1 --2- 172.21.15.82:0/1203098008 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5583ce32a550 0x5583ce32c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:41:35.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.366+0000 7f30dd0bbb80 4 client.27979 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:41:35.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.366+0000 7f30dd0bbb80 1 -- 172.21.15.82:0/1203098008 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5583ce207970 con 0x5583ce32a550 2023-09-23T09:41:35.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.366+0000 7f30c27fc700 1 --2- 172.21.15.82:0/1203098008 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5583ce32a550 0x5583ce32c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:41:35.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:41:34 smithi082 ceph-mon[97694]: pgmap v1419: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.4 MiB/s wr, 542 op/s 2023-09-23T09:41:35.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.367+0000 7f30a6ff5700 10 client.27979 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:41:35.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.367+0000 7f30c27fc700 1 --2- 172.21.15.82:0/1203098008 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5583ce32a550 0x5583ce32c940 crc :-1 s=READY pgs=276 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80c6d5eef8f53213 server_cookie=93f27018d3739587 in_seq=0 out_seq=0 2023-09-23T09:41:35.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.368+0000 7f30a6ff5700 1 -- 172.21.15.82:0/1203098008 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x5583ce207970 con 0x5583ce32a550 2023-09-23T09:41:35.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.368+0000 7f30a6ff5700 10 client.27979 handle_command_reply: tid=0 2023-09-23T09:41:35.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.368+0000 7f30dd0bbb80 1 client.27979 shutdown 2023-09-23T09:41:35.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.368+0000 7f30dd0bbb80 1 -- 172.21.15.82:0/1203098008 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5583ce2bcc40 msgr2=0x5583ce2cb720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:41:35.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.368+0000 7f30dd0bbb80 1 --2- 172.21.15.82:0/1203098008 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5583ce2bcc40 0x5583ce2cb720 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f30b401b610 tx=0x7f30b4007520 comp rx=0 tx=0).stop 2023-09-23T09:41:35.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.368+0000 7f30dd0bbb80 1 -- 172.21.15.82:0/1203098008 shutdown_connections 2023-09-23T09:41:35.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.368+0000 7f30dd0bbb80 1 --2- 172.21.15.82:0/1203098008 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5583ce32a550 0x5583ce32c940 crc :-1 s=READY pgs=276 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:41:35.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.368+0000 7f30dd0bbb80 1 --2- 172.21.15.82:0/1203098008 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5583ce2c2ca0 0x5583ce2cc1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:41:35.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.368+0000 7f30dd0bbb80 1 --2- 172.21.15.82:0/1203098008 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5583ce2bcc40 0x5583ce2cb720 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:41:35.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.368+0000 7f30dd0bbb80 1 --2- 172.21.15.82:0/1203098008 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5583ce2c2380 0x5583ce2cbc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:41:35.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.368+0000 7f30dd0bbb80 1 -- 172.21.15.82:0/1203098008 >> 172.21.15.82:0/1203098008 conn(0x5583ce2310e0 msgr2=0x5583ce2c0170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:41:35.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.368+0000 7f30a6ff5700 0 client.27979 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:41:35.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.368+0000 7f30dd0bbb80 1 -- 172.21.15.82:0/1203098008 shutdown_connections 2023-09-23T09:41:35.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.368+0000 7f30dd0bbb80 1 -- 172.21.15.82:0/1203098008 wait complete. 2023-09-23T09:41:35.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.369+0000 7f30dd0bbb80 20 client.27979 trim_cache size 0 max 16384 2023-09-23T09:41:35.373 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:41:35.373 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-23T09:41:35.373 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:41:35.373 INFO:teuthology.orchestra.run.smithi082.stdout: "d9e62ab8-1468-4fb0-a9fe-61bed13e954b": { 2023-09-23T09:41:35.373 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:41:35.373 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "d9e62ab8-1468-4fb0-a9fe-61bed13e954b", 2023-09-23T09:41:35.373 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:41:35.373 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:41:35.373 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:41:35.373 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:41:35.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.369+0000 7f30c97ff700 1 -- 172.21.15.82:0/1893187976 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f30ac0a01c0 msgr2=0x7f30ac0a2680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:41:35.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.369+0000 7f30c97ff700 1 --2- 172.21.15.82:0/1893187976 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f30ac0a01c0 0x7f30ac0a2680 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f30bc0041e0 tx=0x7f30bc014040 comp rx=0 tx=0).stop 2023-09-23T09:41:35.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.369+0000 7f30c97ff700 1 -- 172.21.15.82:0/1893187976 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f30c41084b0 msgr2=0x7f30c41abbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:41:35.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.369+0000 7f30c97ff700 1 --2- 172.21.15.82:0/1893187976 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f30c41084b0 0x7f30c41abbe0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f30b800e9a0 tx=0x7f30b800ecb0 comp rx=0 tx=0).stop 2023-09-23T09:41:35.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.370+0000 7f30c97ff700 1 -- 172.21.15.82:0/1893187976 shutdown_connections 2023-09-23T09:41:35.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.370+0000 7f30c97ff700 1 --2- 172.21.15.82:0/1893187976 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f30ac0a01c0 0x7f30ac0a2680 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:41:35.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.370+0000 7f30c97ff700 1 --2- 172.21.15.82:0/1893187976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30c410c4b0 0x7f30c41a5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:41:35.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.370+0000 7f30c97ff700 1 --2- 172.21.15.82:0/1893187976 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30c4107b90 0x7f30c41ab6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:41:35.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.370+0000 7f30c97ff700 1 --2- 172.21.15.82:0/1893187976 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f30c41084b0 0x7f30c41abbe0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:41:35.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.370+0000 7f30c97ff700 1 -- 172.21.15.82:0/1893187976 >> 172.21.15.82:0/1893187976 conn(0x7f30c406ce40 msgr2=0x7f30c4070120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:41:35.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.370+0000 7f30c97ff700 1 -- 172.21.15.82:0/1893187976 shutdown_connections 2023-09-23T09:41:35.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:41:35.370+0000 7f30c97ff700 1 -- 172.21.15.82:0/1893187976 wait complete. 2023-09-23T09:41:35.392 INFO:tasks.cephfs.filesystem:scrub status for tag:d9e62ab8-1468-4fb0-a9fe-61bed13e954b - {'path': '/', 'tag': 'd9e62ab8-1468-4fb0-a9fe-61bed13e954b', 'options': 'recursive,force'} 2023-09-23T09:41:35.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:41:34 smithi161 ceph-mon[99580]: pgmap v1419: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.4 MiB/s wr, 542 op/s 2023-09-23T09:41:35.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 865.0 s, 102.4 tps, lat 136.026 ms stddev 225.866 2023-09-23T09:41:37.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:41:36 smithi135 ceph-mon[99205]: pgmap v1420: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 3.0 MiB/s rd, 6.2 MiB/s wr, 782 op/s 2023-09-23T09:41:37.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:41:36 smithi082 ceph-mon[97694]: pgmap v1420: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 3.0 MiB/s rd, 6.2 MiB/s wr, 782 op/s 2023-09-23T09:41:37.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:41:36 smithi161 ceph-mon[99580]: pgmap v1420: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 3.0 MiB/s rd, 6.2 MiB/s wr, 782 op/s 2023-09-23T09:41:38.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:41:38 smithi082 ceph-mon[97694]: pgmap v1421: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.2 MiB/s wr, 518 op/s 2023-09-23T09:41:38.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:41:38 smithi161 ceph-mon[99580]: pgmap v1421: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.2 MiB/s wr, 518 op/s 2023-09-23T09:41:38.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:41:38 smithi135 ceph-mon[99205]: pgmap v1421: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.2 MiB/s wr, 518 op/s 2023-09-23T09:41:40.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 870.0 s, 126.0 tps, lat 79.530 ms stddev 57.354 2023-09-23T09:41:41.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:41:40 smithi135 ceph-mon[99205]: pgmap v1422: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.8 MiB/s wr, 689 op/s 2023-09-23T09:41:41.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:41:40 smithi082 ceph-mon[97694]: pgmap v1422: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.8 MiB/s wr, 689 op/s 2023-09-23T09:41:41.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:41:40 smithi161 ceph-mon[99580]: pgmap v1422: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.8 MiB/s wr, 689 op/s 2023-09-23T09:41:43.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:41:42 smithi135 ceph-mon[99205]: pgmap v1423: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.6 MiB/s wr, 576 op/s 2023-09-23T09:41:43.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:41:42 smithi082 ceph-mon[97694]: pgmap v1423: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.6 MiB/s wr, 576 op/s 2023-09-23T09:41:43.396 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:41:42 smithi161 ceph-mon[99580]: pgmap v1423: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.6 MiB/s wr, 576 op/s 2023-09-23T09:41:45.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:41:44 smithi135 ceph-mon[99205]: pgmap v1424: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.8 MiB/s wr, 475 op/s 2023-09-23T09:41:45.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:41:44 smithi082 ceph-mon[97694]: pgmap v1424: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.8 MiB/s wr, 475 op/s 2023-09-23T09:41:45.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:41:44 smithi161 ceph-mon[99580]: pgmap v1424: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.8 MiB/s wr, 475 op/s 2023-09-23T09:41:45.838 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 875.0 s, 157.2 tps, lat 1805.620 ms stddev 4605.949 2023-09-23T09:41:47.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:41:46 smithi135 ceph-mon[99205]: pgmap v1425: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 6.0 MiB/s wr, 747 op/s 2023-09-23T09:41:47.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:41:46 smithi082 ceph-mon[97694]: pgmap v1425: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 6.0 MiB/s wr, 747 op/s 2023-09-23T09:41:47.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:41:46 smithi161 ceph-mon[99580]: pgmap v1425: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 6.0 MiB/s wr, 747 op/s 2023-09-23T09:41:48.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:41:48 smithi082 ceph-mon[97694]: pgmap v1426: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.2 MiB/s wr, 508 op/s 2023-09-23T09:41:48.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:41:48 smithi161 ceph-mon[99580]: pgmap v1426: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.2 MiB/s wr, 508 op/s 2023-09-23T09:41:48.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:41:48 smithi135 ceph-mon[99205]: pgmap v1426: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.2 MiB/s wr, 508 op/s 2023-09-23T09:41:50.828 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 880.0 s, 187.3 tps, lat 507.876 ms stddev 478.330 2023-09-23T09:41:51.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:41:50 smithi135 ceph-mon[99205]: pgmap v1427: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 6.4 MiB/s wr, 666 op/s 2023-09-23T09:41:51.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:41:50 smithi082 ceph-mon[97694]: pgmap v1427: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 6.4 MiB/s wr, 666 op/s 2023-09-23T09:41:51.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:41:50 smithi161 ceph-mon[99580]: pgmap v1427: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 6.4 MiB/s wr, 666 op/s 2023-09-23T09:41:52.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:41:51 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:41:52.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:41:51 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:41:52.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:41:51 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:41:53.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:41:52 smithi135 ceph-mon[99205]: pgmap v1428: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.5 MiB/s wr, 659 op/s 2023-09-23T09:41:53.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:41:52 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:41:53.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:41:52 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:41:53.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:41:52 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:41:53.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:41:52 smithi082 ceph-mon[97694]: pgmap v1428: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.5 MiB/s wr, 659 op/s 2023-09-23T09:41:53.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:41:52 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:41:53.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:41:52 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:41:53.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:41:52 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:41:53.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:41:52 smithi161 ceph-mon[99580]: pgmap v1428: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.5 MiB/s wr, 659 op/s 2023-09-23T09:41:53.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:41:52 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:41:53.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:41:52 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:41:53.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:41:52 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:41:55.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:41:54 smithi135 ceph-mon[99205]: pgmap v1429: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 5.2 MiB/s wr, 594 op/s 2023-09-23T09:41:55.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:41:54 smithi082 ceph-mon[97694]: pgmap v1429: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 5.2 MiB/s wr, 594 op/s 2023-09-23T09:41:55.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:41:54 smithi161 ceph-mon[99580]: pgmap v1429: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 5.2 MiB/s wr, 594 op/s 2023-09-23T09:41:55.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 885.0 s, 198.1 tps, lat 504.747 ms stddev 533.003 2023-09-23T09:41:57.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:41:56 smithi135 ceph-mon[99205]: pgmap v1430: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1021 GiB / 1.0 TiB avail; 3.5 MiB/s rd, 7.7 MiB/s wr, 898 op/s 2023-09-23T09:41:57.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:41:56 smithi082 ceph-mon[97694]: pgmap v1430: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1021 GiB / 1.0 TiB avail; 3.5 MiB/s rd, 7.7 MiB/s wr, 898 op/s 2023-09-23T09:41:57.396 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:41:56 smithi161 ceph-mon[99580]: pgmap v1430: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1021 GiB / 1.0 TiB avail; 3.5 MiB/s rd, 7.7 MiB/s wr, 898 op/s 2023-09-23T09:41:58.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:41:58 smithi082 ceph-mon[97694]: pgmap v1431: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1021 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.4 MiB/s wr, 627 op/s 2023-09-23T09:41:58.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:41:58 smithi161 ceph-mon[99580]: pgmap v1431: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1021 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.4 MiB/s wr, 627 op/s 2023-09-23T09:41:58.810 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:41:58 smithi135 ceph-mon[99205]: pgmap v1431: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1021 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.4 MiB/s wr, 627 op/s 2023-09-23T09:42:00.830 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 890.0 s, 192.2 tps, lat 503.413 ms stddev 513.117 2023-09-23T09:42:01.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:42:01 smithi135 ceph-mon[99205]: pgmap v1432: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1021 GiB / 1.0 TiB avail; 3.3 MiB/s rd, 6.3 MiB/s wr, 772 op/s 2023-09-23T09:42:01.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:42:00 smithi082 ceph-mon[97694]: pgmap v1432: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1021 GiB / 1.0 TiB avail; 3.3 MiB/s rd, 6.3 MiB/s wr, 772 op/s 2023-09-23T09:42:01.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:42:00 smithi161 ceph-mon[99580]: pgmap v1432: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1021 GiB / 1.0 TiB avail; 3.3 MiB/s rd, 6.3 MiB/s wr, 772 op/s 2023-09-23T09:42:03.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:42:02 smithi135 ceph-mon[99205]: pgmap v1433: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 3.1 MiB/s rd, 5.7 MiB/s wr, 773 op/s 2023-09-23T09:42:03.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:42:02 smithi082 ceph-mon[97694]: pgmap v1433: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 3.1 MiB/s rd, 5.7 MiB/s wr, 773 op/s 2023-09-23T09:42:03.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:42:02 smithi161 ceph-mon[99580]: pgmap v1433: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 3.1 MiB/s rd, 5.7 MiB/s wr, 773 op/s 2023-09-23T09:42:05.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:42:04 smithi135 ceph-mon[99205]: pgmap v1434: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.9 MiB/s wr, 609 op/s 2023-09-23T09:42:05.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:42:04 smithi082 ceph-mon[97694]: pgmap v1434: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.9 MiB/s wr, 609 op/s 2023-09-23T09:42:05.393 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:42:05.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:42:04 smithi161 ceph-mon[99580]: pgmap v1434: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.9 MiB/s wr, 609 op/s 2023-09-23T09:42:05.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.795+0000 7f9efe9ff700 1 -- 172.21.15.82:0/672971808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ef810d150 msgr2=0x7f9ef810f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:42:05.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.795+0000 7f9efe9ff700 1 --2- 172.21.15.82:0/672971808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ef810d150 0x7f9ef810f540 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f9ef0009f90 tx=0x7f9ef000b330 comp rx=0 tx=0).stop 2023-09-23T09:42:05.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.795+0000 7f9efe9ff700 1 -- 172.21.15.82:0/672971808 shutdown_connections 2023-09-23T09:42:05.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.795+0000 7f9efe9ff700 1 --2- 172.21.15.82:0/672971808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ef810d150 0x7f9ef810f540 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:42:05.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.795+0000 7f9efe9ff700 1 --2- 172.21.15.82:0/672971808 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9ef8072cd0 0x7f9ef80730b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:42:05.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.795+0000 7f9efe9ff700 1 --2- 172.21.15.82:0/672971808 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ef80735f0 0x7f9ef810cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:42:05.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.795+0000 7f9efe9ff700 1 -- 172.21.15.82:0/672971808 >> 172.21.15.82:0/672971808 conn(0x7f9ef80fc380 msgr2=0x7f9ef80fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:42:05.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.795+0000 7f9efe9ff700 1 -- 172.21.15.82:0/672971808 shutdown_connections 2023-09-23T09:42:05.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.795+0000 7f9efe9ff700 1 -- 172.21.15.82:0/672971808 wait complete. 2023-09-23T09:42:05.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.796+0000 7f9efe9ff700 1 Processor -- start 2023-09-23T09:42:05.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.797+0000 7f9efe9ff700 1 -- start start 2023-09-23T09:42:05.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.797+0000 7f9efe9ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9ef8072cd0 0x7f9ef819e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:42:05.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.797+0000 7f9efe9ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ef80735f0 0x7f9ef819ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:42:05.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.797+0000 7f9efe9ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ef810d150 0x7f9ef8198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:42:05.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.797+0000 7f9efe9ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef81990c0 con 0x7f9ef810d150 2023-09-23T09:42:05.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.797+0000 7f9efe9ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef8199230 con 0x7f9ef80735f0 2023-09-23T09:42:05.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.797+0000 7f9efe9ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef81993f0 con 0x7f9ef8072cd0 2023-09-23T09:42:05.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.798+0000 7f9ef7fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9ef8072cd0 0x7f9ef819e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:42:05.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.798+0000 7f9ef7fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9ef8072cd0 0x7f9ef819e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:55670/0 (socket says 172.21.15.82:55670) 2023-09-23T09:42:05.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.798+0000 7f9ef7fff700 1 -- 172.21.15.82:0/2649005969 learned_addr learned my addr 172.21.15.82:0/2649005969 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:42:05.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.798+0000 7f9ef77fe700 1 --2- 172.21.15.82:0/2649005969 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ef80735f0 0x7f9ef819ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:42:05.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.798+0000 7f9efcf9c700 1 --2- 172.21.15.82:0/2649005969 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ef810d150 0x7f9ef8198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:42:05.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.798+0000 7f9ef7fff700 1 -- 172.21.15.82:0/2649005969 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ef80735f0 msgr2=0x7f9ef819ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:42:05.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.798+0000 7f9ef7fff700 1 --2- 172.21.15.82:0/2649005969 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ef80735f0 0x7f9ef819ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:42:05.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.798+0000 7f9ef7fff700 1 -- 172.21.15.82:0/2649005969 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ef810d150 msgr2=0x7f9ef8198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:42:05.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.798+0000 7f9ef7fff700 1 --2- 172.21.15.82:0/2649005969 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ef810d150 0x7f9ef8198a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:42:05.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.798+0000 7f9ef7fff700 1 -- 172.21.15.82:0/2649005969 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eec009520 con 0x7f9ef8072cd0 2023-09-23T09:42:05.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.799+0000 7f9ef7fff700 1 --2- 172.21.15.82:0/2649005969 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9ef8072cd0 0x7f9ef819e9e0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f9ee800e9c0 tx=0x7f9ee800ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:42:05.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.799+0000 7f9ef57fa700 1 -- 172.21.15.82:0/2649005969 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee8004a30 con 0x7f9ef8072cd0 2023-09-23T09:42:05.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.799+0000 7f9efe9ff700 1 -- 172.21.15.82:0/2649005969 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ef0009c40 con 0x7f9ef8072cd0 2023-09-23T09:42:05.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.799+0000 7f9ef57fa700 1 -- 172.21.15.82:0/2649005969 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9ee800cc50 con 0x7f9ef8072cd0 2023-09-23T09:42:05.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.799+0000 7f9ef57fa700 1 -- 172.21.15.82:0/2649005969 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee8005410 con 0x7f9ef8072cd0 2023-09-23T09:42:05.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.799+0000 7f9efe9ff700 1 -- 172.21.15.82:0/2649005969 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ef81998c0 con 0x7f9ef8072cd0 2023-09-23T09:42:05.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.803+0000 7f9ef57fa700 1 -- 172.21.15.82:0/2649005969 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f9ee8005570 con 0x7f9ef8072cd0 2023-09-23T09:42:05.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.804+0000 7f9f12328b80 1 Processor -- start 2023-09-23T09:42:05.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.804+0000 7f9f12328b80 1 -- start start 2023-09-23T09:42:05.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.804+0000 7f9f12328b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b194411380 0x55b194411760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:42:05.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.804+0000 7f9f12328b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b194411ca0 0x55b19440b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:42:05.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.804+0000 7f9f12328b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b19440bc40 0x55b19440c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:42:05.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.804+0000 7f9f12328b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1943737b0 con 0x55b194411380 2023-09-23T09:42:05.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.804+0000 7f9f12328b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b194364780 con 0x55b194411ca0 2023-09-23T09:42:05.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.804+0000 7f9f12328b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1943620a0 con 0x55b19440bc40 2023-09-23T09:42:05.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.805+0000 7f9efcf9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b194411380 0x55b194411760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:42:05.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.805+0000 7f9efcf9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b194411380 0x55b194411760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45688/0 (socket says 172.21.15.82:45688) 2023-09-23T09:42:05.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.805+0000 7f9efcf9c700 1 -- 172.21.15.82:0/4089613216 learned_addr learned my addr 172.21.15.82:0/4089613216 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:42:05.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.805+0000 7f9ef77fe700 1 --2- 172.21.15.82:0/4089613216 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b19440bc40 0x55b19440c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:42:05.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.805+0000 7f9ef7fff700 1 --2- 172.21.15.82:0/4089613216 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b194411ca0 0x55b19440b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:42:05.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.806+0000 7f9ef7fff700 1 -- 172.21.15.82:0/4089613216 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b19440bc40 msgr2=0x55b19440c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:42:05.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.806+0000 7f9ef7fff700 1 --2- 172.21.15.82:0/4089613216 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b19440bc40 0x55b19440c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:42:05.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.806+0000 7f9ef7fff700 1 -- 172.21.15.82:0/4089613216 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b194411380 msgr2=0x55b194411760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:42:05.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.806+0000 7f9ef7fff700 1 --2- 172.21.15.82:0/4089613216 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b194411380 0x55b194411760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:42:05.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.806+0000 7f9ef7fff700 1 -- 172.21.15.82:0/4089613216 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b1941dd630 con 0x55b194411ca0 2023-09-23T09:42:05.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.806+0000 7f9ef7fff700 1 --2- 172.21.15.82:0/4089613216 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b194411ca0 0x55b19440b700 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f9ee80c8c40 tx=0x7f9ee80d3390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1d558a4940a90a7 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:42:05.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.807+0000 7f9ef57fa700 1 --2- 172.21.15.82:0/2649005969 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f9ee00a0140 0x7f9ee00a2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:42:05.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.807+0000 7f9ede7fc700 1 -- 172.21.15.82:0/4089613216 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee80cd110 con 0x55b194411ca0 2023-09-23T09:42:05.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.807+0000 7f9ede7fc700 1 -- 172.21.15.82:0/4089613216 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9ee80cb740 con 0x55b194411ca0 2023-09-23T09:42:05.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.807+0000 7f9ede7fc700 1 -- 172.21.15.82:0/4089613216 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee80949f0 con 0x55b194411ca0 2023-09-23T09:42:05.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.807+0000 7f9ef57fa700 1 -- 172.21.15.82:0/2649005969 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f9ee8014070 con 0x7f9ef8072cd0 2023-09-23T09:42:05.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.807+0000 7f9efcf9c700 1 --2- 172.21.15.82:0/2649005969 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f9ee00a0140 0x7f9ee00a2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:42:05.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.808+0000 7f9f12328b80 1 -- 172.21.15.82:0/4089613216 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b194411ca0 msgr2=0x55b19440b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:42:05.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.808+0000 7f9f12328b80 1 --2- 172.21.15.82:0/4089613216 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b194411ca0 0x55b19440b700 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f9ee80c8c40 tx=0x7f9ee80d3390 comp rx=0 tx=0).stop 2023-09-23T09:42:05.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.808+0000 7f9f12328b80 1 -- 172.21.15.82:0/4089613216 shutdown_connections 2023-09-23T09:42:05.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.808+0000 7f9f12328b80 1 --2- 172.21.15.82:0/4089613216 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b19440bc40 0x55b19440c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:42:05.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.808+0000 7f9f12328b80 1 --2- 172.21.15.82:0/4089613216 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b194411380 0x55b194411760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:42:05.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.808+0000 7f9f12328b80 1 --2- 172.21.15.82:0/4089613216 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b194411ca0 0x55b19440b700 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:42:05.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.808+0000 7f9f12328b80 1 -- 172.21.15.82:0/4089613216 >> 172.21.15.82:0/4089613216 conn(0x55b1943800e0 msgr2=0x55b194406410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:42:05.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.808+0000 7f9f12328b80 1 -- 172.21.15.82:0/4089613216 shutdown_connections 2023-09-23T09:42:05.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.808+0000 7f9f12328b80 1 -- 172.21.15.82:0/4089613216 wait complete. 2023-09-23T09:42:05.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.808+0000 7f9efcf9c700 1 --2- 172.21.15.82:0/2649005969 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f9ee00a0140 0x7f9ee00a2600 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f9ef0015000 tx=0x7f9ef00096c0 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:42:05.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.809+0000 7f9f12328b80 1 -- start start 2023-09-23T09:42:05.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.809+0000 7f9f12328b80 1 Processor -- start 2023-09-23T09:42:05.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.810+0000 7f9f12328b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b19440bc40 0x55b194417bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:42:05.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.810+0000 7f9f12328b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b194411380 0x55b194414ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:42:05.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.810+0000 7f9f12328b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b194411ca0 0x55b1944154d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:42:05.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.810+0000 7f9f12328b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b19435d990 con 0x55b19440bc40 2023-09-23T09:42:05.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.810+0000 7f9f12328b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1942fbbb0 con 0x55b194411380 2023-09-23T09:42:05.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.810+0000 7f9f12328b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1942fb8b0 con 0x55b194411ca0 2023-09-23T09:42:05.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.810+0000 7f9f12328b80 10 client.0 _ll_register_callbacks cb 0x55b194245a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:42:05.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.810+0000 7f9ef77fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b194411380 0x55b194414ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:42:05.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.810+0000 7f9ef77fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b194411380 0x55b194414ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:51308/0 (socket says 172.21.15.82:51308) 2023-09-23T09:42:05.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.810+0000 7f9ef77fe700 1 -- 172.21.15.82:0/670395600 learned_addr learned my addr 172.21.15.82:0/670395600 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:42:05.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.810+0000 7f9ef7fff700 1 --2- 172.21.15.82:0/670395600 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b19440bc40 0x55b194417bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:42:05.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.811+0000 7f9ef7fff700 1 -- 172.21.15.82:0/670395600 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b194411ca0 msgr2=0x55b1944154d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-23T09:42:05.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.811+0000 7f9ef7fff700 1 --2- 172.21.15.82:0/670395600 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b194411ca0 0x55b1944154d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:42:05.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.811+0000 7f9ef7fff700 1 -- 172.21.15.82:0/670395600 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b194411380 msgr2=0x55b194414ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:42:05.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.811+0000 7f9ef7fff700 1 --2- 172.21.15.82:0/670395600 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b194411380 0x55b194414ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:42:05.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.811+0000 7f9ef7fff700 1 -- 172.21.15.82:0/670395600 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ef0009c40 con 0x55b19440bc40 2023-09-23T09:42:05.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.811+0000 7f9ef7fff700 1 --2- 172.21.15.82:0/670395600 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b19440bc40 0x55b194417bb0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x55b194412100 tx=0x7f9ee8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=943ff0cf12b7ec72 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:42:05.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.811+0000 7f9ed77fe700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:42:05.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.812+0000 7f9ed77fe700 1 -- 172.21.15.82:0/670395600 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee80b80c0 con 0x55b19440bc40 2023-09-23T09:42:05.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.812+0000 7f9ed77fe700 1 -- 172.21.15.82:0/670395600 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(165..165 src has 1..165) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f9ee800cdc0 con 0x55b19440bc40 2023-09-23T09:42:05.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.812+0000 7f9f12328b80 1 -- 172.21.15.82:0/670395600 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b1943db1c0 con 0x55b19440bc40 2023-09-23T09:42:05.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.812+0000 7f9ed77fe700 1 -- 172.21.15.82:0/670395600 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=132) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9ee80989d0 con 0x55b19440bc40 2023-09-23T09:42:05.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.812+0000 7f9f12328b80 10 client.18210 fetch_fsmap learned FSMap version 132 2023-09-23T09:42:05.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.812+0000 7f9f12328b80 1 -- 172.21.15.82:0/670395600 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=132,monmap=4+}) v3 -- 0x55b194189de0 con 0x55b19440bc40 2023-09-23T09:42:05.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.813+0000 7f9ed77fe700 1 -- 172.21.15.82:0/670395600 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9ee80b4080 con 0x55b19440bc40 2023-09-23T09:42:05.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.813+0000 7f9ed77fe700 1 -- 172.21.15.82:0/670395600 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 132) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f9ee8004b90 con 0x55b19440bc40 2023-09-23T09:42:05.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.813+0000 7f9f12328b80 10 client.18210 fetch_fsmap finished waiting for FSMap version 132 2023-09-23T09:42:05.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.813+0000 7f9f12328b80 10 client.18210 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:42:05.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.813+0000 7f9f12328b80 20 client.18210 populate_metadata read hostname 'smithi082' 2023-09-23T09:42:05.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.813+0000 7f9f12328b80 1 --2- 172.21.15.82:0/670395600 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55b194425380 0x55b1944277c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:42:05.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.813+0000 7f9f12328b80 4 client.18210 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:42:05.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.813+0000 7f9f12328b80 1 -- 172.21.15.82:0/670395600 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b194303ba0 con 0x55b194425380 2023-09-23T09:42:05.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.814+0000 7f9ef77fe700 1 --2- 172.21.15.82:0/670395600 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55b194425380 0x55b1944277c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:42:05.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.814+0000 7f9ed77fe700 10 client.18210 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:42:05.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.814+0000 7f9ef77fe700 1 --2- 172.21.15.82:0/670395600 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55b194425380 0x55b1944277c0 crc :-1 s=READY pgs=277 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a3c851f2d9f0d2d server_cookie=ffdcea3001b762c in_seq=0 out_seq=0 2023-09-23T09:42:05.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.815+0000 7f9ed77fe700 1 -- 172.21.15.82:0/670395600 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b194303ba0 con 0x55b194425380 2023-09-23T09:42:05.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.815+0000 7f9ed77fe700 10 client.18210 handle_command_reply: tid=0 2023-09-23T09:42:05.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.815+0000 7f9f12328b80 1 client.18210 shutdown 2023-09-23T09:42:05.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.816+0000 7f9f12328b80 1 -- 172.21.15.82:0/670395600 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b19440bc40 msgr2=0x55b194417bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:42:05.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.816+0000 7f9f12328b80 1 --2- 172.21.15.82:0/670395600 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b19440bc40 0x55b194417bb0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x55b194412100 tx=0x7f9ee8004750 comp rx=0 tx=0).stop 2023-09-23T09:42:05.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.816+0000 7f9f12328b80 1 -- 172.21.15.82:0/670395600 shutdown_connections 2023-09-23T09:42:05.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.816+0000 7f9f12328b80 1 --2- 172.21.15.82:0/670395600 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b194411ca0 0x55b1944154d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:42:05.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.816+0000 7f9f12328b80 1 --2- 172.21.15.82:0/670395600 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55b194425380 0x55b1944277c0 crc :-1 s=READY pgs=277 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:42:05.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.816+0000 7f9f12328b80 1 --2- 172.21.15.82:0/670395600 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b19440bc40 0x55b194417bb0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:42:05.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.816+0000 7f9f12328b80 1 --2- 172.21.15.82:0/670395600 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b194411380 0x55b194414ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:42:05.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.816+0000 7f9f12328b80 1 -- 172.21.15.82:0/670395600 >> 172.21.15.82:0/670395600 conn(0x55b1943800e0 msgr2=0x55b194400b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:42:05.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.816+0000 7f9ed77fe700 0 client.18210 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:42:05.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.816+0000 7f9f12328b80 1 -- 172.21.15.82:0/670395600 shutdown_connections 2023-09-23T09:42:05.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.816+0000 7f9f12328b80 1 -- 172.21.15.82:0/670395600 wait complete. 2023-09-23T09:42:05.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.816+0000 7f9f12328b80 20 client.18210 trim_cache size 0 max 16384 2023-09-23T09:42:05.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 895.0 s, 105.5 tps, lat 951.009 ms stddev 1021.845 2023-09-23T09:42:05.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.845+0000 7f9f12328b80 1 Processor -- start 2023-09-23T09:42:05.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.846+0000 7f9f12328b80 1 -- start start 2023-09-23T09:42:05.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.846+0000 7f9f12328b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b19440bc40 0x55b194414660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:42:05.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.846+0000 7f9f12328b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b194411380 0x55b194417750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:42:05.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.846+0000 7f9f12328b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b194411ca0 0x55b19440ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:42:05.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.846+0000 7f9f12328b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1941df920 con 0x55b19440bc40 2023-09-23T09:42:05.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.846+0000 7f9f12328b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b194402840 con 0x55b194411ca0 2023-09-23T09:42:05.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.846+0000 7f9f12328b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b194413430 con 0x55b194411380 2023-09-23T09:42:05.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.847+0000 7f9efcf9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b194411ca0 0x55b19440ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:42:05.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.847+0000 7f9efcf9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b194411ca0 0x55b19440ddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:51310/0 (socket says 172.21.15.82:51310) 2023-09-23T09:42:05.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.847+0000 7f9efcf9c700 1 -- 172.21.15.82:0/1102224830 learned_addr learned my addr 172.21.15.82:0/1102224830 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:42:05.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.847+0000 7f9ef7fff700 1 --2- 172.21.15.82:0/1102224830 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b19440bc40 0x55b194414660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:42:05.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.847+0000 7f9ef77fe700 1 --2- 172.21.15.82:0/1102224830 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b194411380 0x55b194417750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:42:05.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.847+0000 7f9ef7fff700 1 -- 172.21.15.82:0/1102224830 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b194411380 msgr2=0x55b194417750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:42:05.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.847+0000 7f9ef7fff700 1 --2- 172.21.15.82:0/1102224830 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b194411380 0x55b194417750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:42:05.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.847+0000 7f9ef7fff700 1 -- 172.21.15.82:0/1102224830 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b194411ca0 msgr2=0x55b19440ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:42:05.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.847+0000 7f9ef7fff700 1 --2- 172.21.15.82:0/1102224830 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b194411ca0 0x55b19440ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:42:05.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.847+0000 7f9ef7fff700 1 -- 172.21.15.82:0/1102224830 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b194172c60 con 0x55b19440bc40 2023-09-23T09:42:05.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.847+0000 7f9ef77fe700 1 --2- 172.21.15.82:0/1102224830 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b194411380 0x55b194417750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:42:05.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.847+0000 7f9efcf9c700 1 --2- 172.21.15.82:0/1102224830 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b194411ca0 0x55b19440ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:42:05.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.847+0000 7f9ef7fff700 1 --2- 172.21.15.82:0/1102224830 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b19440bc40 0x55b194414660 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f9ee8095100 tx=0x7f9ee80971b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=506c5283ad8a7d9a server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:42:05.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.848+0000 7f9edeffd700 1 -- 172.21.15.82:0/1102224830 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee8098560 con 0x55b19440bc40 2023-09-23T09:42:05.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.848+0000 7f9edeffd700 1 -- 172.21.15.82:0/1102224830 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b1943db1c0 con 0x55b19440bc40 2023-09-23T09:42:05.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.848+0000 7f9edeffd700 1 -- 172.21.15.82:0/1102224830 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee800cdc0 con 0x55b19440bc40 2023-09-23T09:42:05.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.849+0000 7f9f12328b80 1 -- 172.21.15.82:0/1102224830 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b19440bc40 msgr2=0x55b194414660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:42:05.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.849+0000 7f9f12328b80 1 --2- 172.21.15.82:0/1102224830 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b19440bc40 0x55b194414660 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f9ee8095100 tx=0x7f9ee80971b0 comp rx=0 tx=0).stop 2023-09-23T09:42:05.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.849+0000 7f9f12328b80 1 -- 172.21.15.82:0/1102224830 shutdown_connections 2023-09-23T09:42:05.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.849+0000 7f9f12328b80 1 --2- 172.21.15.82:0/1102224830 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b194411ca0 0x55b19440ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:42:05.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.849+0000 7f9f12328b80 1 --2- 172.21.15.82:0/1102224830 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b19440bc40 0x55b194414660 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:42:05.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.849+0000 7f9f12328b80 1 --2- 172.21.15.82:0/1102224830 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b194411380 0x55b194417750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:42:05.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.849+0000 7f9f12328b80 1 -- 172.21.15.82:0/1102224830 >> 172.21.15.82:0/1102224830 conn(0x55b1943800e0 msgr2=0x55b19440efb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:42:05.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.849+0000 7f9f12328b80 1 -- 172.21.15.82:0/1102224830 shutdown_connections 2023-09-23T09:42:05.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.849+0000 7f9f12328b80 1 -- 172.21.15.82:0/1102224830 wait complete. 2023-09-23T09:42:05.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.850+0000 7f9f12328b80 1 -- start start 2023-09-23T09:42:05.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.850+0000 7f9f12328b80 1 Processor -- start 2023-09-23T09:42:05.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.851+0000 7f9f12328b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b19440bc40 0x55b19440dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:42:05.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.851+0000 7f9f12328b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b194411380 0x55b19440e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:42:05.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.851+0000 7f9f12328b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b194411ca0 0x55b19440cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:42:05.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.851+0000 7f9f12328b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b19441cdb0 con 0x55b194411ca0 2023-09-23T09:42:05.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.851+0000 7f9f12328b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b19440d310 con 0x55b194411380 2023-09-23T09:42:05.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.851+0000 7f9f12328b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b19440d4d0 con 0x55b19440bc40 2023-09-23T09:42:05.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.851+0000 7f9f12328b80 10 client.0 _ll_register_callbacks cb 0x7f9eec005ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:42:05.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.851+0000 7f9ef7fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b19440bc40 0x55b19440dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:42:05.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.851+0000 7f9ef7fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b19440bc40 0x55b19440dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:55722/0 (socket says 172.21.15.82:55722) 2023-09-23T09:42:05.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.851+0000 7f9ef7fff700 1 -- 172.21.15.82:0/2917411273 learned_addr learned my addr 172.21.15.82:0/2917411273 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:42:05.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.851+0000 7f9efcf9c700 1 --2- 172.21.15.82:0/2917411273 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b194411ca0 0x55b19440cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:42:05.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.851+0000 7f9ef77fe700 1 --2- 172.21.15.82:0/2917411273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b194411380 0x55b19440e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:42:05.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.851+0000 7f9ef7fff700 1 -- 172.21.15.82:0/2917411273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b194411380 msgr2=0x55b19440e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:42:05.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.851+0000 7f9ef7fff700 1 --2- 172.21.15.82:0/2917411273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b194411380 0x55b19440e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:42:05.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.851+0000 7f9ef7fff700 1 -- 172.21.15.82:0/2917411273 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b194411ca0 msgr2=0x55b19440cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:42:05.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.851+0000 7f9ef7fff700 1 --2- 172.21.15.82:0/2917411273 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b194411ca0 0x55b19440cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:42:05.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.851+0000 7f9ef7fff700 1 -- 172.21.15.82:0/2917411273 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9eec012050 con 0x55b19440bc40 2023-09-23T09:42:05.858 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.852+0000 7f9ef7fff700 1 --2- 172.21.15.82:0/2917411273 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b19440bc40 0x55b19440dfe0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f9ee8009fd0 tx=0x7f9ee8004dc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eda327dc2e92df7c server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:42:05.858 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.852+0000 7f9ed77fe700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T09:42:05.858 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.852+0000 7f9ed77fe700 1 -- 172.21.15.82:0/2917411273 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee80c90c0 con 0x55b19440bc40 2023-09-23T09:42:05.858 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.852+0000 7f9ed77fe700 1 -- 172.21.15.82:0/2917411273 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(165..165 src has 1..165) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f9ee800cdc0 con 0x55b19440bc40 2023-09-23T09:42:05.858 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.852+0000 7f9f12328b80 1 -- 172.21.15.82:0/2917411273 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b1943fe8b0 con 0x55b19440bc40 2023-09-23T09:42:05.858 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.853+0000 7f9ed77fe700 1 -- 172.21.15.82:0/2917411273 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=132) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9ee80ceb40 con 0x55b19440bc40 2023-09-23T09:42:05.858 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.853+0000 7f9f12328b80 10 client.27994 fetch_fsmap learned FSMap version 132 2023-09-23T09:42:05.858 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.853+0000 7f9f12328b80 1 -- 172.21.15.82:0/2917411273 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=132,monmap=4+}) v3 -- 0x55b194189de0 con 0x55b19440bc40 2023-09-23T09:42:05.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.853+0000 7f9ed77fe700 1 -- 172.21.15.82:0/2917411273 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b1943fe8b0 con 0x55b19440bc40 2023-09-23T09:42:05.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.853+0000 7f9ed77fe700 1 -- 172.21.15.82:0/2917411273 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 132) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f9ee8016330 con 0x55b19440bc40 2023-09-23T09:42:05.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.853+0000 7f9f12328b80 10 client.27994 fetch_fsmap finished waiting for FSMap version 132 2023-09-23T09:42:05.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.853+0000 7f9f12328b80 10 client.27994 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:42:05.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.853+0000 7f9f12328b80 20 client.27994 populate_metadata read hostname 'smithi082' 2023-09-23T09:42:05.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.853+0000 7f9f12328b80 1 --2- 172.21.15.82:0/2917411273 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55b194475d00 0x55b1944760e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:42:05.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.853+0000 7f9f12328b80 4 client.27994 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:42:05.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.853+0000 7f9f12328b80 1 -- 172.21.15.82:0/2917411273 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55b194356970 con 0x55b194475d00 2023-09-23T09:42:05.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.854+0000 7f9ef77fe700 1 --2- 172.21.15.82:0/2917411273 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55b194475d00 0x55b1944760e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:42:05.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.855+0000 7f9ef77fe700 1 --2- 172.21.15.82:0/2917411273 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55b194475d00 0x55b1944760e0 crc :-1 s=READY pgs=278 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d23efdcf8219f4a1 server_cookie=27efd006c2c621a4 in_seq=0 out_seq=0 2023-09-23T09:42:05.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.855+0000 7f9ed77fe700 10 client.27994 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:42:05.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.855+0000 7f9ed77fe700 1 -- 172.21.15.82:0/2917411273 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55b194356970 con 0x55b194475d00 2023-09-23T09:42:05.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.855+0000 7f9ed77fe700 10 client.27994 handle_command_reply: tid=0 2023-09-23T09:42:05.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.855+0000 7f9f12328b80 1 client.27994 shutdown 2023-09-23T09:42:05.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.856+0000 7f9f12328b80 1 -- 172.21.15.82:0/2917411273 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b19440bc40 msgr2=0x55b19440dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:42:05.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.856+0000 7f9f12328b80 1 --2- 172.21.15.82:0/2917411273 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b19440bc40 0x55b19440dfe0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f9ee8009fd0 tx=0x7f9ee8004dc0 comp rx=0 tx=0).stop 2023-09-23T09:42:05.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.856+0000 7f9f12328b80 1 -- 172.21.15.82:0/2917411273 shutdown_connections 2023-09-23T09:42:05.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.856+0000 7f9f12328b80 1 --2- 172.21.15.82:0/2917411273 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55b194475d00 0x55b1944760e0 crc :-1 s=READY pgs=278 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:42:05.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.856+0000 7f9f12328b80 1 --2- 172.21.15.82:0/2917411273 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b194411ca0 0x55b19440cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:42:05.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.856+0000 7f9f12328b80 1 --2- 172.21.15.82:0/2917411273 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b19440bc40 0x55b19440dfe0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:42:05.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.856+0000 7f9f12328b80 1 --2- 172.21.15.82:0/2917411273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b194411380 0x55b19440e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:42:05.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.856+0000 7f9f12328b80 1 -- 172.21.15.82:0/2917411273 >> 172.21.15.82:0/2917411273 conn(0x55b1943800e0 msgr2=0x55b194412130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:42:05.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.856+0000 7f9ed77fe700 0 client.27994 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:42:05.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.857+0000 7f9f12328b80 1 -- 172.21.15.82:0/2917411273 shutdown_connections 2023-09-23T09:42:05.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.857+0000 7f9f12328b80 1 -- 172.21.15.82:0/2917411273 wait complete. 2023-09-23T09:42:05.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.857+0000 7f9f12328b80 20 client.27994 trim_cache size 0 max 16384 2023-09-23T09:42:05.864 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:42:05.865 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-23T09:42:05.865 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:42:05.865 INFO:teuthology.orchestra.run.smithi082.stdout: "d9e62ab8-1468-4fb0-a9fe-61bed13e954b": { 2023-09-23T09:42:05.865 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:42:05.865 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "d9e62ab8-1468-4fb0-a9fe-61bed13e954b", 2023-09-23T09:42:05.865 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:42:05.865 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:42:05.866 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:42:05.866 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:42:05.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.858+0000 7f9efe9ff700 1 -- 172.21.15.82:0/2649005969 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f9ee00a0140 msgr2=0x7f9ee00a2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:42:05.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.858+0000 7f9efe9ff700 1 --2- 172.21.15.82:0/2649005969 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f9ee00a0140 0x7f9ee00a2600 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f9ef0015000 tx=0x7f9ef00096c0 comp rx=0 tx=0).stop 2023-09-23T09:42:05.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.858+0000 7f9efe9ff700 1 -- 172.21.15.82:0/2649005969 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9ef8072cd0 msgr2=0x7f9ef819e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:42:05.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.858+0000 7f9efe9ff700 1 --2- 172.21.15.82:0/2649005969 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9ef8072cd0 0x7f9ef819e9e0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f9ee800e9c0 tx=0x7f9ee800ecd0 comp rx=0 tx=0).stop 2023-09-23T09:42:05.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.858+0000 7f9efe9ff700 1 -- 172.21.15.82:0/2649005969 shutdown_connections 2023-09-23T09:42:05.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.858+0000 7f9efe9ff700 1 --2- 172.21.15.82:0/2649005969 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f9ee00a0140 0x7f9ee00a2600 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:42:05.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.858+0000 7f9efe9ff700 1 --2- 172.21.15.82:0/2649005969 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ef810d150 0x7f9ef8198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:42:05.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.858+0000 7f9efe9ff700 1 --2- 172.21.15.82:0/2649005969 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9ef8072cd0 0x7f9ef819e9e0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:42:05.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.858+0000 7f9efe9ff700 1 --2- 172.21.15.82:0/2649005969 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ef80735f0 0x7f9ef819ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:42:05.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.858+0000 7f9efe9ff700 1 -- 172.21.15.82:0/2649005969 >> 172.21.15.82:0/2649005969 conn(0x7f9ef80fc380 msgr2=0x7f9ef810f260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:42:05.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.858+0000 7f9efe9ff700 1 -- 172.21.15.82:0/2649005969 shutdown_connections 2023-09-23T09:42:05.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:05.858+0000 7f9efe9ff700 1 -- 172.21.15.82:0/2649005969 wait complete. 2023-09-23T09:42:05.891 INFO:tasks.cephfs.filesystem:scrub status for tag:d9e62ab8-1468-4fb0-a9fe-61bed13e954b - {'path': '/', 'tag': 'd9e62ab8-1468-4fb0-a9fe-61bed13e954b', 'options': 'recursive,force'} 2023-09-23T09:42:07.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:42:06 smithi135 ceph-mon[99205]: pgmap v1435: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 3.1 MiB/s rd, 6.5 MiB/s wr, 829 op/s 2023-09-23T09:42:07.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:42:06 smithi082 ceph-mon[97694]: pgmap v1435: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 3.1 MiB/s rd, 6.5 MiB/s wr, 829 op/s 2023-09-23T09:42:07.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:42:06 smithi161 ceph-mon[99580]: pgmap v1435: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 3.1 MiB/s rd, 6.5 MiB/s wr, 829 op/s 2023-09-23T09:42:08.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:42:08 smithi082 ceph-mon[97694]: pgmap v1436: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.1 MiB/s wr, 542 op/s 2023-09-23T09:42:08.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:42:08 smithi161 ceph-mon[99580]: pgmap v1436: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.1 MiB/s wr, 542 op/s 2023-09-23T09:42:08.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:42:08 smithi135 ceph-mon[99205]: pgmap v1436: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.1 MiB/s wr, 542 op/s 2023-09-23T09:42:10.826 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 900.0 s, 175.4 tps, lat 594.728 ms stddev 638.271 2023-09-23T09:42:11.318 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:42:10 smithi135 ceph-mon[99205]: pgmap v1437: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.7 MiB/s wr, 680 op/s 2023-09-23T09:42:11.377 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:42:10 smithi082 ceph-mon[97694]: pgmap v1437: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.7 MiB/s wr, 680 op/s 2023-09-23T09:42:11.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:42:10 smithi161 ceph-mon[99580]: pgmap v1437: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.7 MiB/s wr, 680 op/s 2023-09-23T09:42:12.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:42:11 smithi135 ceph-mon[99205]: osdmap e166: 12 total, 12 up, 12 in 2023-09-23T09:42:12.374 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:42:11 smithi082 ceph-mon[97694]: osdmap e166: 12 total, 12 up, 12 in 2023-09-23T09:42:12.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:42:11 smithi161 ceph-mon[99580]: osdmap e166: 12 total, 12 up, 12 in 2023-09-23T09:42:13.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:42:13 smithi135 ceph-mon[99205]: pgmap v1439: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.3 MiB/s wr, 565 op/s 2023-09-23T09:42:13.373 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:42:13 smithi082 ceph-mon[97694]: pgmap v1439: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.3 MiB/s wr, 565 op/s 2023-09-23T09:42:13.400 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:42:13 smithi161 ceph-mon[99580]: pgmap v1439: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.3 MiB/s wr, 565 op/s 2023-09-23T09:42:15.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:42:15 smithi135 ceph-mon[99205]: pgmap v1440: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.3 MiB/s wr, 565 op/s 2023-09-23T09:42:15.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:42:15 smithi082 ceph-mon[97694]: pgmap v1440: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.3 MiB/s wr, 565 op/s 2023-09-23T09:42:15.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:42:15 smithi161 ceph-mon[99580]: pgmap v1440: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.3 MiB/s wr, 565 op/s 2023-09-23T09:42:15.502 INFO:teuthology.orchestra.run.smithi082.stdout:transaction type: 2023-09-23T09:42:15.502 INFO:teuthology.orchestra.run.smithi082.stdout:scaling factor: 500 2023-09-23T09:42:15.502 INFO:teuthology.orchestra.run.smithi082.stdout:query mode: simple 2023-09-23T09:42:15.502 INFO:teuthology.orchestra.run.smithi082.stdout:number of clients: 100 2023-09-23T09:42:15.503 INFO:teuthology.orchestra.run.smithi082.stdout:number of threads: 4 2023-09-23T09:42:15.503 INFO:teuthology.orchestra.run.smithi082.stdout:duration: 900 s 2023-09-23T09:42:15.503 INFO:teuthology.orchestra.run.smithi082.stdout:number of transactions actually processed: 271109 2023-09-23T09:42:15.503 INFO:teuthology.orchestra.run.smithi082.stdout:latency average = 332.748 ms 2023-09-23T09:42:15.503 INFO:teuthology.orchestra.run.smithi082.stdout:latency stddev = 977.972 ms 2023-09-23T09:42:15.503 INFO:teuthology.orchestra.run.smithi082.stdout:tps = 299.706334 (including connections establishing) 2023-09-23T09:42:15.503 INFO:teuthology.orchestra.run.smithi082.stdout:tps = 299.714610 (excluding connections establishing) 2023-09-23T09:42:15.510 DEBUG:teuthology.orchestra.run.smithi082:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo systemctl stop postgresql' 2023-09-23T09:42:17.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:42:17 smithi135 ceph-mon[99205]: pgmap v1441: 97 pgs: 6 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 79 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.2 MiB/s wr, 395 op/s 2023-09-23T09:42:17.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:42:17 smithi082 ceph-mon[97694]: pgmap v1441: 97 pgs: 6 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 79 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.2 MiB/s wr, 395 op/s 2023-09-23T09:42:17.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:42:17 smithi161 ceph-mon[99580]: pgmap v1441: 97 pgs: 6 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 79 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.2 MiB/s wr, 395 op/s 2023-09-23T09:42:18.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:42:18 smithi082 ceph-mon[97694]: pgmap v1442: 97 pgs: 4 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 87 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.2 MiB/s wr, 382 op/s 2023-09-23T09:42:18.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:42:18 smithi161 ceph-mon[99580]: pgmap v1442: 97 pgs: 4 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 87 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.2 MiB/s wr, 382 op/s 2023-09-23T09:42:18.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:42:18 smithi135 ceph-mon[99205]: pgmap v1442: 97 pgs: 4 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 87 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.2 MiB/s wr, 382 op/s 2023-09-23T09:42:21.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:42:20 smithi135 ceph-mon[99205]: pgmap v1443: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.8 MiB/s wr, 266 op/s 2023-09-23T09:42:21.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:42:20 smithi082 ceph-mon[97694]: pgmap v1443: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.8 MiB/s wr, 266 op/s 2023-09-23T09:42:21.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:42:20 smithi161 ceph-mon[99580]: pgmap v1443: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.8 MiB/s wr, 266 op/s 2023-09-23T09:42:23.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:42:22 smithi135 ceph-mon[99205]: pgmap v1444: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 796 KiB/s rd, 1.9 MiB/s wr, 205 op/s 2023-09-23T09:42:23.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:42:22 smithi135 ceph-mon[99205]: osdmap e167: 12 total, 12 up, 12 in 2023-09-23T09:42:23.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:42:22 smithi082 ceph-mon[97694]: pgmap v1444: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 796 KiB/s rd, 1.9 MiB/s wr, 205 op/s 2023-09-23T09:42:23.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:42:22 smithi082 ceph-mon[97694]: osdmap e167: 12 total, 12 up, 12 in 2023-09-23T09:42:23.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:42:22 smithi161 ceph-mon[99580]: pgmap v1444: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 796 KiB/s rd, 1.9 MiB/s wr, 205 op/s 2023-09-23T09:42:23.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:42:22 smithi161 ceph-mon[99580]: osdmap e167: 12 total, 12 up, 12 in 2023-09-23T09:42:25.310 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:42:24 smithi135 ceph-mon[99205]: pgmap v1446: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 700 KiB/s rd, 2.0 MiB/s wr, 194 op/s 2023-09-23T09:42:25.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:42:24 smithi082 ceph-mon[97694]: pgmap v1446: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 700 KiB/s rd, 2.0 MiB/s wr, 194 op/s 2023-09-23T09:42:25.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:42:24 smithi161 ceph-mon[99580]: pgmap v1446: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 700 KiB/s rd, 2.0 MiB/s wr, 194 op/s 2023-09-23T09:42:27.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:42:26 smithi135 ceph-mon[99205]: pgmap v1447: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 396 KiB/s rd, 1.3 MiB/s wr, 115 op/s 2023-09-23T09:42:27.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:42:26 smithi082 ceph-mon[97694]: pgmap v1447: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 396 KiB/s rd, 1.3 MiB/s wr, 115 op/s 2023-09-23T09:42:27.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:42:26 smithi161 ceph-mon[99580]: pgmap v1447: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 396 KiB/s rd, 1.3 MiB/s wr, 115 op/s 2023-09-23T09:42:28.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:42:28 smithi161 ceph-mon[99580]: pgmap v1448: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 1.3 MiB/s wr, 108 op/s 2023-09-23T09:42:28.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:42:28 smithi135 ceph-mon[99205]: pgmap v1448: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 1.3 MiB/s wr, 108 op/s 2023-09-23T09:42:28.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:42:28 smithi082 ceph-mon[97694]: pgmap v1448: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 1.3 MiB/s wr, 108 op/s 2023-09-23T09:42:31.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:42:30 smithi135 ceph-mon[99205]: pgmap v1449: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 916 KiB/s wr, 67 op/s 2023-09-23T09:42:31.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:42:30 smithi082 ceph-mon[97694]: pgmap v1449: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 916 KiB/s wr, 67 op/s 2023-09-23T09:42:31.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:42:30 smithi161 ceph-mon[99580]: pgmap v1449: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 916 KiB/s wr, 67 op/s 2023-09-23T09:42:33.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:42:32 smithi135 ceph-mon[99205]: pgmap v1450: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 286 KiB/s rd, 317 KiB/s wr, 27 op/s 2023-09-23T09:42:33.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:42:32 smithi082 ceph-mon[97694]: pgmap v1450: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 286 KiB/s rd, 317 KiB/s wr, 27 op/s 2023-09-23T09:42:33.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:42:32 smithi161 ceph-mon[99580]: pgmap v1450: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 286 KiB/s rd, 317 KiB/s wr, 27 op/s 2023-09-23T09:42:35.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:42:34 smithi135 ceph-mon[99205]: pgmap v1451: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 275 KiB/s wr, 23 op/s 2023-09-23T09:42:35.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:42:34 smithi082 ceph-mon[97694]: pgmap v1451: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 275 KiB/s wr, 23 op/s 2023-09-23T09:42:35.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:42:34 smithi161 ceph-mon[99580]: pgmap v1451: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 275 KiB/s wr, 23 op/s 2023-09-23T09:42:35.892 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:42:36.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.104+0000 7f46f57ff700 1 -- 172.21.15.82:0/1128145452 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46f0100890 msgr2=0x7f46f0100d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:42:36.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.104+0000 7f46f57ff700 1 --2- 172.21.15.82:0/1128145452 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46f0100890 0x7f46f0100d10 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f46e4009990 tx=0x7f46e4009ca0 comp rx=0 tx=0).stop 2023-09-23T09:42:36.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.104+0000 7f46f57ff700 1 -- 172.21.15.82:0/1128145452 shutdown_connections 2023-09-23T09:42:36.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.104+0000 7f46f57ff700 1 --2- 172.21.15.82:0/1128145452 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46f0101250 0x7f46f010d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:42:36.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.104+0000 7f46f57ff700 1 --2- 172.21.15.82:0/1128145452 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f46f01068a0 0x7f46f0106c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:42:36.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.104+0000 7f46f57ff700 1 --2- 172.21.15.82:0/1128145452 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46f0100890 0x7f46f0100d10 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:42:36.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.104+0000 7f46f57ff700 1 -- 172.21.15.82:0/1128145452 >> 172.21.15.82:0/1128145452 conn(0x7f46f00fc380 msgr2=0x7f46f00fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:42:36.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.104+0000 7f46f57ff700 1 -- 172.21.15.82:0/1128145452 shutdown_connections 2023-09-23T09:42:36.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.104+0000 7f46f57ff700 1 -- 172.21.15.82:0/1128145452 wait complete. 2023-09-23T09:42:36.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.105+0000 7f46f57ff700 1 Processor -- start 2023-09-23T09:42:36.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.105+0000 7f46f57ff700 1 -- start start 2023-09-23T09:42:36.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.106+0000 7f46f57ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f46f0100890 0x7f46f0072c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:42:36.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.106+0000 7f46f57ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46f0101250 0x7f46f0073160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:42:36.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.106+0000 7f46f57ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46f01068a0 0x7f46f01a4a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:42:36.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.106+0000 7f46f57ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46f0073990 con 0x7f46f01068a0 2023-09-23T09:42:36.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.106+0000 7f46f57ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46f01a4f80 con 0x7f46f0101250 2023-09-23T09:42:36.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.106+0000 7f46f57ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46f01a50c0 con 0x7f46f0100890 2023-09-23T09:42:36.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.106+0000 7f46ef7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46f01068a0 0x7f46f01a4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:42:36.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.106+0000 7f46ef7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46f01068a0 0x7f46f01a4a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45170/0 (socket says 172.21.15.82:45170) 2023-09-23T09:42:36.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.106+0000 7f46ef7fe700 1 -- 172.21.15.82:0/2068659793 learned_addr learned my addr 172.21.15.82:0/2068659793 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:42:36.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.106+0000 7f46ee7fc700 1 --2- 172.21.15.82:0/2068659793 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46f0101250 0x7f46f0073160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:42:36.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.106+0000 7f46eeffd700 1 --2- 172.21.15.82:0/2068659793 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f46f0100890 0x7f46f0072c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:42:36.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.106+0000 7f46ef7fe700 1 -- 172.21.15.82:0/2068659793 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f46f0100890 msgr2=0x7f46f0072c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:42:36.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.106+0000 7f46ef7fe700 1 --2- 172.21.15.82:0/2068659793 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f46f0100890 0x7f46f0072c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:42:36.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.106+0000 7f46ef7fe700 1 -- 172.21.15.82:0/2068659793 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46f0101250 msgr2=0x7f46f0073160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:42:36.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.106+0000 7f46ef7fe700 1 --2- 172.21.15.82:0/2068659793 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46f0101250 0x7f46f0073160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:42:36.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.106+0000 7f46ef7fe700 1 -- 172.21.15.82:0/2068659793 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46e40095f0 con 0x7f46f01068a0 2023-09-23T09:42:36.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.106+0000 7f46eeffd700 1 --2- 172.21.15.82:0/2068659793 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f46f0100890 0x7f46f0072c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:42:36.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.107+0000 7f46ef7fe700 1 --2- 172.21.15.82:0/2068659793 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46f01068a0 0x7f46f01a4a40 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f46e800ef30 tx=0x7f46e800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:42:36.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.107+0000 7f46d7fff700 1 -- 172.21.15.82:0/2068659793 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e8018070 con 0x7f46f01068a0 2023-09-23T09:42:36.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.107+0000 7f46f57ff700 1 -- 172.21.15.82:0/2068659793 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46f01a52c0 con 0x7f46f01068a0 2023-09-23T09:42:36.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.107+0000 7f46d7fff700 1 -- 172.21.15.82:0/2068659793 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f46e800f040 con 0x7f46f01068a0 2023-09-23T09:42:36.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.107+0000 7f46d7fff700 1 -- 172.21.15.82:0/2068659793 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e800cc70 con 0x7f46f01068a0 2023-09-23T09:42:36.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.107+0000 7f46f57ff700 1 -- 172.21.15.82:0/2068659793 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46f01a5750 con 0x7f46f01068a0 2023-09-23T09:42:36.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.111+0000 7f46d7fff700 1 -- 172.21.15.82:0/2068659793 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f46e8007500 con 0x7f46f01068a0 2023-09-23T09:42:36.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.112+0000 7f47090e8b80 1 Processor -- start 2023-09-23T09:42:36.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.112+0000 7f47090e8b80 1 -- start start 2023-09-23T09:42:36.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.113+0000 7f47090e8b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558d8b90c380 0x558d8b90c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:42:36.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.113+0000 7f47090e8b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d8b90cca0 0x558d8b906700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:42:36.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.113+0000 7f47090e8b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558d8b906c40 0x558d8b9070a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:42:36.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.113+0000 7f47090e8b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d8b86e7b0 con 0x558d8b90c380 2023-09-23T09:42:36.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.113+0000 7f47090e8b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d8b85f780 con 0x558d8b90cca0 2023-09-23T09:42:36.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.113+0000 7f47090e8b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d8b85d0a0 con 0x558d8b906c40 2023-09-23T09:42:36.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.113+0000 7f46ee7fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558d8b90c380 0x558d8b90c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:42:36.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.113+0000 7f46ee7fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558d8b90c380 0x558d8b90c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45180/0 (socket says 172.21.15.82:45180) 2023-09-23T09:42:36.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.113+0000 7f46eeffd700 1 --2- 172.21.15.82:0/2549701558 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d8b90cca0 0x558d8b906700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:42:36.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.113+0000 7f46ee7fc700 1 -- 172.21.15.82:0/2549701558 learned_addr learned my addr 172.21.15.82:0/2549701558 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:42:36.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.113+0000 7f46d7fff700 1 --2- 172.21.15.82:0/2068659793 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f46d80a00c0 0x7f46d80a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:42:36.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.113+0000 7f46ee7fc700 1 -- 172.21.15.82:0/2549701558 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558d8b906c40 msgr2=0x558d8b9070a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:42:36.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.113+0000 7f46ee7fc700 1 --2- 172.21.15.82:0/2549701558 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558d8b906c40 0x558d8b9070a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:42:36.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.113+0000 7f46ee7fc700 1 -- 172.21.15.82:0/2549701558 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d8b90cca0 msgr2=0x558d8b906700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:42:36.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.113+0000 7f46ee7fc700 1 --2- 172.21.15.82:0/2549701558 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d8b90cca0 0x558d8b906700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:42:36.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.114+0000 7f46ee7fc700 1 -- 172.21.15.82:0/2549701558 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558d8b6d8630 con 0x558d8b90c380 2023-09-23T09:42:36.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.114+0000 7f46d7fff700 1 -- 172.21.15.82:0/2068659793 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f46e80cb270 con 0x7f46f01068a0 2023-09-23T09:42:36.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.114+0000 7f46ef7fe700 1 --2- 172.21.15.82:0/2068659793 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f46d80a00c0 0x7f46d80a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:42:36.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.114+0000 7f46ee7fc700 1 --2- 172.21.15.82:0/2549701558 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558d8b90c380 0x558d8b90c760 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f46e40098e0 tx=0x7f46e4005040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a9d07952c47676 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:42:36.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.114+0000 7f46d57fa700 1 -- 172.21.15.82:0/2549701558 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e401d040 con 0x558d8b90c380 2023-09-23T09:42:36.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.114+0000 7f46d57fa700 1 -- 172.21.15.82:0/2549701558 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f46e40055d0 con 0x558d8b90c380 2023-09-23T09:42:36.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.114+0000 7f46d57fa700 1 -- 172.21.15.82:0/2549701558 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e4004830 con 0x558d8b90c380 2023-09-23T09:42:36.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.115+0000 7f47090e8b80 1 -- 172.21.15.82:0/2549701558 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558d8b90c380 msgr2=0x558d8b90c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:42:36.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.115+0000 7f46ef7fe700 1 --2- 172.21.15.82:0/2068659793 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f46d80a00c0 0x7f46d80a2580 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f46e8009f40 tx=0x7f46e8004bf0 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:42:36.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.115+0000 7f47090e8b80 1 --2- 172.21.15.82:0/2549701558 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558d8b90c380 0x558d8b90c760 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f46e40098e0 tx=0x7f46e4005040 comp rx=0 tx=0).stop 2023-09-23T09:42:36.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.115+0000 7f47090e8b80 1 -- 172.21.15.82:0/2549701558 shutdown_connections 2023-09-23T09:42:36.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.115+0000 7f47090e8b80 1 --2- 172.21.15.82:0/2549701558 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558d8b906c40 0x558d8b9070a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:42:36.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.115+0000 7f47090e8b80 1 --2- 172.21.15.82:0/2549701558 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558d8b90c380 0x558d8b90c760 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:42:36.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.115+0000 7f47090e8b80 1 --2- 172.21.15.82:0/2549701558 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d8b90cca0 0x558d8b906700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:42:36.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.115+0000 7f47090e8b80 1 -- 172.21.15.82:0/2549701558 >> 172.21.15.82:0/2549701558 conn(0x558d8b87b0e0 msgr2=0x558d8b901410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:42:36.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.115+0000 7f47090e8b80 1 -- 172.21.15.82:0/2549701558 shutdown_connections 2023-09-23T09:42:36.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.115+0000 7f47090e8b80 1 -- 172.21.15.82:0/2549701558 wait complete. 2023-09-23T09:42:36.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.116+0000 7f47090e8b80 1 -- start start 2023-09-23T09:42:36.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.116+0000 7f47090e8b80 1 Processor -- start 2023-09-23T09:42:36.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.117+0000 7f47090e8b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558d8b906c40 0x558d8b912c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:42:36.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.117+0000 7f47090e8b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d8b90c380 0x558d8b90fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:42:36.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.117+0000 7f47090e8b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558d8b90cca0 0x558d8b910540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:42:36.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.117+0000 7f47090e8b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d8b858990 con 0x558d8b90cca0 2023-09-23T09:42:36.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.117+0000 7f47090e8b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d8b7f6bb0 con 0x558d8b90c380 2023-09-23T09:42:36.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.117+0000 7f47090e8b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d8b7f68b0 con 0x558d8b906c40 2023-09-23T09:42:36.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.117+0000 7f47090e8b80 10 client.0 _ll_register_callbacks cb 0x558d8b740a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:42:36.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.117+0000 7f46ee7fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558d8b90cca0 0x558d8b910540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:42:36.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.117+0000 7f46eeffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d8b90c380 0x558d8b90fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:42:36.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.117+0000 7f46ee7fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558d8b90cca0 0x558d8b910540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45194/0 (socket says 172.21.15.82:45194) 2023-09-23T09:42:36.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.117+0000 7f46ee7fc700 1 -- 172.21.15.82:0/4175848415 learned_addr learned my addr 172.21.15.82:0/4175848415 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:42:36.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.117+0000 7f46ee7fc700 1 --2- 172.21.15.82:0/4175848415 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558d8b906c40 0x558d8b912c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:42:36.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.117+0000 7f46eeffd700 1 -- 172.21.15.82:0/4175848415 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558d8b906c40 msgr2=0x558d8b912c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:42:36.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.117+0000 7f46eeffd700 1 --2- 172.21.15.82:0/4175848415 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558d8b906c40 0x558d8b912c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:42:36.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.117+0000 7f46eeffd700 1 -- 172.21.15.82:0/4175848415 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558d8b90cca0 msgr2=0x558d8b910540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:42:36.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.117+0000 7f46eeffd700 1 --2- 172.21.15.82:0/4175848415 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558d8b90cca0 0x558d8b910540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:42:36.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.118+0000 7f46eeffd700 1 -- 172.21.15.82:0/4175848415 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46e4020040 con 0x558d8b90c380 2023-09-23T09:42:36.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.118+0000 7f46eeffd700 1 --2- 172.21.15.82:0/4175848415 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d8b90c380 0x558d8b90fea0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f46e0009bb0 tx=0x7f46e0009ec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b31fed1f1da82d8 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:42:36.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.118+0000 7f46d2ff5700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-09-23T09:42:36.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.118+0000 7f46d2ff5700 1 -- 172.21.15.82:0/4175848415 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e0016070 con 0x558d8b90c380 2023-09-23T09:42:36.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.118+0000 7f47090e8b80 1 -- 172.21.15.82:0/4175848415 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558d8b8d61c0 con 0x558d8b90c380 2023-09-23T09:42:36.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.118+0000 7f46d2ff5700 1 -- 172.21.15.82:0/4175848415 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(167..167 src has 1..167) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f46e0003dc0 con 0x558d8b90c380 2023-09-23T09:42:36.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.118+0000 7f46d2ff5700 1 -- 172.21.15.82:0/4175848415 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=132) v2 ==== 24+0+0 (secure 0 0 0) 0x7f46e0011440 con 0x558d8b90c380 2023-09-23T09:42:36.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.118+0000 7f47090e8b80 10 client.27965 fetch_fsmap learned FSMap version 132 2023-09-23T09:42:36.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.118+0000 7f47090e8b80 1 -- 172.21.15.82:0/4175848415 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=132,monmap=4+}) v3 -- 0x558d8b684de0 con 0x558d8b90c380 2023-09-23T09:42:36.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.119+0000 7f46d2ff5700 1 -- 172.21.15.82:0/4175848415 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f46e0027080 con 0x558d8b90c380 2023-09-23T09:42:36.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.119+0000 7f46d2ff5700 1 -- 172.21.15.82:0/4175848415 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 132) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f46e0021030 con 0x558d8b90c380 2023-09-23T09:42:36.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.119+0000 7f47090e8b80 10 client.27965 fetch_fsmap finished waiting for FSMap version 132 2023-09-23T09:42:36.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.119+0000 7f47090e8b80 10 client.27965 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:42:36.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.119+0000 7f47090e8b80 20 client.27965 populate_metadata read hostname 'smithi082' 2023-09-23T09:42:36.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.119+0000 7f47090e8b80 1 --2- 172.21.15.82:0/4175848415 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x558d8b920830 0x558d8b922c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:42:36.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.119+0000 7f47090e8b80 4 client.27965 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:42:36.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.119+0000 7f47090e8b80 1 -- 172.21.15.82:0/4175848415 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558d8b7feba0 con 0x558d8b920830 2023-09-23T09:42:36.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.119+0000 7f46ee7fc700 1 --2- 172.21.15.82:0/4175848415 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x558d8b920830 0x558d8b922c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:42:36.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.120+0000 7f46d2ff5700 10 client.27965 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:42:36.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.120+0000 7f46ee7fc700 1 --2- 172.21.15.82:0/4175848415 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x558d8b920830 0x558d8b922c50 crc :-1 s=READY pgs=279 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6633866be8afd04c server_cookie=5d960b27d5161828 in_seq=0 out_seq=0 2023-09-23T09:42:36.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.121+0000 7f46d2ff5700 1 -- 172.21.15.82:0/4175848415 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558d8b7feba0 con 0x558d8b920830 2023-09-23T09:42:36.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.121+0000 7f46d2ff5700 10 client.27965 handle_command_reply: tid=0 2023-09-23T09:42:36.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.121+0000 7f47090e8b80 1 client.27965 shutdown 2023-09-23T09:42:36.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.121+0000 7f47090e8b80 1 -- 172.21.15.82:0/4175848415 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d8b90c380 msgr2=0x558d8b90fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:42:36.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.121+0000 7f47090e8b80 1 --2- 172.21.15.82:0/4175848415 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d8b90c380 0x558d8b90fea0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f46e0009bb0 tx=0x7f46e0009ec0 comp rx=0 tx=0).stop 2023-09-23T09:42:36.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.121+0000 7f47090e8b80 1 -- 172.21.15.82:0/4175848415 shutdown_connections 2023-09-23T09:42:36.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.121+0000 7f47090e8b80 1 --2- 172.21.15.82:0/4175848415 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x558d8b920830 0x558d8b922c50 crc :-1 s=READY pgs=279 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:42:36.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.121+0000 7f47090e8b80 1 --2- 172.21.15.82:0/4175848415 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558d8b90cca0 0x558d8b910540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:42:36.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.121+0000 7f46d2ff5700 0 client.27965 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:42:36.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.121+0000 7f47090e8b80 1 --2- 172.21.15.82:0/4175848415 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558d8b906c40 0x558d8b912c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:42:36.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.121+0000 7f47090e8b80 1 --2- 172.21.15.82:0/4175848415 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d8b90c380 0x558d8b90fea0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:42:36.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.121+0000 7f47090e8b80 1 -- 172.21.15.82:0/4175848415 >> 172.21.15.82:0/4175848415 conn(0x558d8b87b0e0 msgr2=0x558d8b8fbb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:42:36.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.121+0000 7f47090e8b80 1 -- 172.21.15.82:0/4175848415 shutdown_connections 2023-09-23T09:42:36.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.121+0000 7f47090e8b80 1 -- 172.21.15.82:0/4175848415 wait complete. 2023-09-23T09:42:36.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.121+0000 7f47090e8b80 20 client.27965 trim_cache size 0 max 16384 2023-09-23T09:42:36.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.138+0000 7f47090e8b80 1 Processor -- start 2023-09-23T09:42:36.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.139+0000 7f47090e8b80 1 -- start start 2023-09-23T09:42:36.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.139+0000 7f47090e8b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558d8b906c40 0x558d8b906700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:42:36.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.139+0000 7f47090e8b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558d8b90c380 0x558d8b912850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:42:36.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.139+0000 7f47090e8b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d8b90cca0 0x558d8b91bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:42:36.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.139+0000 7f47090e8b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d8b6da920 con 0x558d8b90c380 2023-09-23T09:42:36.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.139+0000 7f47090e8b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d8b8fdc80 con 0x558d8b90cca0 2023-09-23T09:42:36.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.139+0000 7f47090e8b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d8b90ab30 con 0x558d8b906c40 2023-09-23T09:42:36.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.139+0000 7f46eeffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558d8b90c380 0x558d8b912850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:42:36.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.139+0000 7f46eeffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558d8b90c380 0x558d8b912850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45210/0 (socket says 172.21.15.82:45210) 2023-09-23T09:42:36.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.139+0000 7f46eeffd700 1 -- 172.21.15.82:0/1113102405 learned_addr learned my addr 172.21.15.82:0/1113102405 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:42:36.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.139+0000 7f46ee7fc700 1 --2- 172.21.15.82:0/1113102405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d8b90cca0 0x558d8b91bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:42:36.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.139+0000 7f46ee7fc700 1 --2- 172.21.15.82:0/1113102405 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558d8b906c40 0x558d8b906700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:42:36.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.140+0000 7f46ee7fc700 1 -- 172.21.15.82:0/1113102405 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558d8b906c40 msgr2=0x558d8b906700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:42:36.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.140+0000 7f46ee7fc700 1 --2- 172.21.15.82:0/1113102405 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558d8b906c40 0x558d8b906700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:42:36.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.140+0000 7f46ee7fc700 1 -- 172.21.15.82:0/1113102405 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558d8b90c380 msgr2=0x558d8b912850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:42:36.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.140+0000 7f46ee7fc700 1 --2- 172.21.15.82:0/1113102405 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558d8b90c380 0x558d8b912850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:42:36.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.140+0000 7f46ee7fc700 1 -- 172.21.15.82:0/1113102405 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558d8b66dc60 con 0x558d8b90cca0 2023-09-23T09:42:36.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.140+0000 7f46ee7fc700 1 --2- 172.21.15.82:0/1113102405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d8b90cca0 0x558d8b91bef0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f46e4009990 tx=0x7f46e4005e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c13429df8a87a1f server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:42:36.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.140+0000 7f46d5ffb700 1 -- 172.21.15.82:0/1113102405 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e401d030 con 0x558d8b90cca0 2023-09-23T09:42:36.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.140+0000 7f46d5ffb700 1 -- 172.21.15.82:0/1113102405 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f46e4036ad0 con 0x558d8b90cca0 2023-09-23T09:42:36.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.140+0000 7f46d5ffb700 1 -- 172.21.15.82:0/1113102405 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e4004590 con 0x558d8b90cca0 2023-09-23T09:42:36.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.141+0000 7f47090e8b80 1 -- 172.21.15.82:0/1113102405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d8b90cca0 msgr2=0x558d8b91bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:42:36.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.141+0000 7f47090e8b80 1 --2- 172.21.15.82:0/1113102405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d8b90cca0 0x558d8b91bef0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f46e4009990 tx=0x7f46e4005e80 comp rx=0 tx=0).stop 2023-09-23T09:42:36.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.141+0000 7f47090e8b80 1 -- 172.21.15.82:0/1113102405 shutdown_connections 2023-09-23T09:42:36.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.141+0000 7f47090e8b80 1 --2- 172.21.15.82:0/1113102405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d8b90cca0 0x558d8b91bef0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:42:36.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.141+0000 7f47090e8b80 1 --2- 172.21.15.82:0/1113102405 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558d8b906c40 0x558d8b906700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:42:36.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.141+0000 7f47090e8b80 1 --2- 172.21.15.82:0/1113102405 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558d8b90c380 0x558d8b912850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:42:36.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.141+0000 7f47090e8b80 1 -- 172.21.15.82:0/1113102405 >> 172.21.15.82:0/1113102405 conn(0x558d8b87b0e0 msgr2=0x558d8b907020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:42:36.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.141+0000 7f47090e8b80 1 -- 172.21.15.82:0/1113102405 shutdown_connections 2023-09-23T09:42:36.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.141+0000 7f47090e8b80 1 -- 172.21.15.82:0/1113102405 wait complete. 2023-09-23T09:42:36.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.141+0000 7f47090e8b80 1 -- start start 2023-09-23T09:42:36.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.141+0000 7f47090e8b80 1 Processor -- start 2023-09-23T09:42:36.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.142+0000 7f47090e8b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d8b906c40 0x558d8b908ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:42:36.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.142+0000 7f47090e8b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558d8b90c380 0x558d8b909430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:42:36.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.142+0000 7f47090e8b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558d8b90cca0 0x558d8b907e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:42:36.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.142+0000 7f47090e8b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d8b909a80 con 0x558d8b90cca0 2023-09-23T09:42:36.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.142+0000 7f47090e8b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d8b909bf0 con 0x558d8b906c40 2023-09-23T09:42:36.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.142+0000 7f47090e8b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d8b9083c0 con 0x558d8b90c380 2023-09-23T09:42:36.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.142+0000 7f47090e8b80 10 client.0 _ll_register_callbacks cb 0x7f46e0004590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:42:36.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.142+0000 7f46ee7fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d8b906c40 0x558d8b908ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:42:36.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.142+0000 7f46ee7fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558d8b90cca0 0x558d8b907e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:42:36.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.142+0000 7f46ee7fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558d8b90cca0 0x558d8b907e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45218/0 (socket says 172.21.15.82:45218) 2023-09-23T09:42:36.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.142+0000 7f46ee7fc700 1 -- 172.21.15.82:0/3886838493 learned_addr learned my addr 172.21.15.82:0/3886838493 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:42:36.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.142+0000 7f46eeffd700 1 --2- 172.21.15.82:0/3886838493 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558d8b90c380 0x558d8b909430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:42:36.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.143+0000 7f46ee7fc700 1 -- 172.21.15.82:0/3886838493 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558d8b90c380 msgr2=0x558d8b909430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:42:36.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.143+0000 7f46ee7fc700 1 --2- 172.21.15.82:0/3886838493 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558d8b90c380 0x558d8b909430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:42:36.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.143+0000 7f46ee7fc700 1 -- 172.21.15.82:0/3886838493 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d8b906c40 msgr2=0x558d8b908ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:42:36.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.143+0000 7f46ee7fc700 1 --2- 172.21.15.82:0/3886838493 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d8b906c40 0x558d8b908ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:42:36.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.143+0000 7f46ee7fc700 1 -- 172.21.15.82:0/3886838493 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558d8b6d8630 con 0x558d8b90cca0 2023-09-23T09:42:36.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.143+0000 7f46eeffd700 1 --2- 172.21.15.82:0/3886838493 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558d8b90c380 0x558d8b909430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:42:36.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.143+0000 7f46ee7fc700 1 --2- 172.21.15.82:0/3886838493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558d8b90cca0 0x558d8b907e00 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x558d8b90f940 tx=0x7f46e400bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0cb50a5250d87d3 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:42:36.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.143+0000 7f46d2ff5700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:42:36.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.143+0000 7f46d2ff5700 1 -- 172.21.15.82:0/3886838493 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e4036260 con 0x558d8b90cca0 2023-09-23T09:42:36.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.143+0000 7f47090e8b80 1 -- 172.21.15.82:0/3886838493 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558d8b8f98b0 con 0x558d8b90cca0 2023-09-23T09:42:36.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.143+0000 7f46d2ff5700 1 -- 172.21.15.82:0/3886838493 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(167..167 src has 1..167) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f46e40363c0 con 0x558d8b90cca0 2023-09-23T09:42:36.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.144+0000 7f46d2ff5700 1 -- 172.21.15.82:0/3886838493 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=132) v2 ==== 24+0+0 (secure 0 0 0) 0x7f46e4036580 con 0x558d8b90cca0 2023-09-23T09:42:36.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.144+0000 7f47090e8b80 10 client.18234 fetch_fsmap learned FSMap version 132 2023-09-23T09:42:36.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.144+0000 7f47090e8b80 1 -- 172.21.15.82:0/3886838493 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=132,monmap=4+}) v3 -- 0x558d8b6ab250 con 0x558d8b90cca0 2023-09-23T09:42:36.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.144+0000 7f46d2ff5700 1 -- 172.21.15.82:0/3886838493 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x558d8b8f98b0 con 0x558d8b90cca0 2023-09-23T09:42:36.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.144+0000 7f46d2ff5700 1 -- 172.21.15.82:0/3886838493 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 132) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f46e4040070 con 0x558d8b90cca0 2023-09-23T09:42:36.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.144+0000 7f47090e8b80 10 client.18234 fetch_fsmap finished waiting for FSMap version 132 2023-09-23T09:42:36.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.144+0000 7f47090e8b80 10 client.18234 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:42:36.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.144+0000 7f47090e8b80 20 client.18234 populate_metadata read hostname 'smithi082' 2023-09-23T09:42:36.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.144+0000 7f47090e8b80 1 --2- 172.21.15.82:0/3886838493 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x558d8b974df0 0x558d8b9771e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:42:36.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.144+0000 7f47090e8b80 4 client.18234 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:42:36.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.144+0000 7f47090e8b80 1 -- 172.21.15.82:0/3886838493 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x558d8b851970 con 0x558d8b974df0 2023-09-23T09:42:36.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.144+0000 7f46eeffd700 1 --2- 172.21.15.82:0/3886838493 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x558d8b974df0 0x558d8b9771e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:42:36.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.145+0000 7f46d2ff5700 10 client.18234 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:42:36.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.145+0000 7f46eeffd700 1 --2- 172.21.15.82:0/3886838493 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x558d8b974df0 0x558d8b9771e0 crc :-1 s=READY pgs=280 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a71d101a2da6ae1f server_cookie=a56c81d957d24a99 in_seq=0 out_seq=0 2023-09-23T09:42:36.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.145+0000 7f46d2ff5700 1 -- 172.21.15.82:0/3886838493 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x558d8b851970 con 0x558d8b974df0 2023-09-23T09:42:36.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.145+0000 7f46d2ff5700 10 client.18234 handle_command_reply: tid=0 2023-09-23T09:42:36.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.145+0000 7f47090e8b80 1 client.18234 shutdown 2023-09-23T09:42:36.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.146+0000 7f47090e8b80 1 -- 172.21.15.82:0/3886838493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558d8b90cca0 msgr2=0x558d8b907e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:42:36.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.146+0000 7f47090e8b80 1 --2- 172.21.15.82:0/3886838493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558d8b90cca0 0x558d8b907e00 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x558d8b90f940 tx=0x7f46e400bf00 comp rx=0 tx=0).stop 2023-09-23T09:42:36.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.146+0000 7f47090e8b80 1 -- 172.21.15.82:0/3886838493 shutdown_connections 2023-09-23T09:42:36.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.146+0000 7f47090e8b80 1 --2- 172.21.15.82:0/3886838493 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x558d8b974df0 0x558d8b9771e0 crc :-1 s=READY pgs=280 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:42:36.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.146+0000 7f47090e8b80 1 --2- 172.21.15.82:0/3886838493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558d8b90cca0 0x558d8b907e00 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:42:36.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.146+0000 7f47090e8b80 1 --2- 172.21.15.82:0/3886838493 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d8b906c40 0x558d8b908ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:42:36.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.146+0000 7f46d2ff5700 0 client.18234 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:42:36.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.146+0000 7f47090e8b80 1 --2- 172.21.15.82:0/3886838493 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x558d8b90c380 0x558d8b909430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:42:36.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.146+0000 7f47090e8b80 1 -- 172.21.15.82:0/3886838493 >> 172.21.15.82:0/3886838493 conn(0x558d8b87b0e0 msgr2=0x558d8b91c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:42:36.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.146+0000 7f47090e8b80 1 -- 172.21.15.82:0/3886838493 shutdown_connections 2023-09-23T09:42:36.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.146+0000 7f47090e8b80 1 -- 172.21.15.82:0/3886838493 wait complete. 2023-09-23T09:42:36.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.146+0000 7f47090e8b80 20 client.18234 trim_cache size 0 max 16384 2023-09-23T09:42:36.157 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:42:36.158 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-23T09:42:36.158 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:42:36.158 INFO:teuthology.orchestra.run.smithi082.stdout: "d9e62ab8-1468-4fb0-a9fe-61bed13e954b": { 2023-09-23T09:42:36.158 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:42:36.158 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "d9e62ab8-1468-4fb0-a9fe-61bed13e954b", 2023-09-23T09:42:36.158 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:42:36.158 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:42:36.158 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:42:36.158 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:42:36.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.146+0000 7f46f57ff700 1 -- 172.21.15.82:0/2068659793 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f46d80a00c0 msgr2=0x7f46d80a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:42:36.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.146+0000 7f46f57ff700 1 --2- 172.21.15.82:0/2068659793 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f46d80a00c0 0x7f46d80a2580 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f46e8009f40 tx=0x7f46e8004bf0 comp rx=0 tx=0).stop 2023-09-23T09:42:36.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.146+0000 7f46f57ff700 1 -- 172.21.15.82:0/2068659793 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46f01068a0 msgr2=0x7f46f01a4a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:42:36.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.146+0000 7f46f57ff700 1 --2- 172.21.15.82:0/2068659793 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46f01068a0 0x7f46f01a4a40 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f46e800ef30 tx=0x7f46e800c3a0 comp rx=0 tx=0).stop 2023-09-23T09:42:36.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.147+0000 7f46f57ff700 1 -- 172.21.15.82:0/2068659793 shutdown_connections 2023-09-23T09:42:36.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.147+0000 7f46f57ff700 1 --2- 172.21.15.82:0/2068659793 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f46d80a00c0 0x7f46d80a2580 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:42:36.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.147+0000 7f46f57ff700 1 --2- 172.21.15.82:0/2068659793 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46f01068a0 0x7f46f01a4a40 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:42:36.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.147+0000 7f46f57ff700 1 --2- 172.21.15.82:0/2068659793 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f46f0100890 0x7f46f0072c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:42:36.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.147+0000 7f46f57ff700 1 --2- 172.21.15.82:0/2068659793 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46f0101250 0x7f46f0073160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:42:36.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.147+0000 7f46f57ff700 1 -- 172.21.15.82:0/2068659793 >> 172.21.15.82:0/2068659793 conn(0x7f46f00fc380 msgr2=0x7f46f00fc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:42:36.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.147+0000 7f46f57ff700 1 -- 172.21.15.82:0/2068659793 shutdown_connections 2023-09-23T09:42:36.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:42:36.147+0000 7f46f57ff700 1 -- 172.21.15.82:0/2068659793 wait complete. 2023-09-23T09:42:36.167 INFO:tasks.cephfs.filesystem:scrub status for tag:d9e62ab8-1468-4fb0-a9fe-61bed13e954b - {'path': '/', 'tag': 'd9e62ab8-1468-4fb0-a9fe-61bed13e954b', 'options': 'recursive,force'} 2023-09-23T09:42:37.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:42:36 smithi135 ceph-mon[99205]: pgmap v1452: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 336 KiB/s rd, 371 KiB/s wr, 32 op/s 2023-09-23T09:42:37.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:42:36 smithi082 ceph-mon[97694]: pgmap v1452: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 336 KiB/s rd, 371 KiB/s wr, 32 op/s 2023-09-23T09:42:37.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:42:36 smithi161 ceph-mon[99580]: pgmap v1452: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 336 KiB/s rd, 371 KiB/s wr, 32 op/s 2023-09-23T09:42:38.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:42:38 smithi161 ceph-mon[99580]: pgmap v1453: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 199 KiB/s wr, 19 op/s 2023-09-23T09:42:38.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:42:38 smithi135 ceph-mon[99205]: pgmap v1453: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 199 KiB/s wr, 19 op/s 2023-09-23T09:42:38.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:42:38 smithi082 ceph-mon[97694]: pgmap v1453: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 199 KiB/s wr, 19 op/s 2023-09-23T09:42:41.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:42:40 smithi135 ceph-mon[99205]: pgmap v1454: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 241 KiB/s wr, 23 op/s 2023-09-23T09:42:41.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:42:40 smithi082 ceph-mon[97694]: pgmap v1454: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 241 KiB/s wr, 23 op/s 2023-09-23T09:42:41.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:42:40 smithi161 ceph-mon[99580]: pgmap v1454: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 241 KiB/s wr, 23 op/s 2023-09-23T09:42:43.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:42:42 smithi135 ceph-mon[99205]: pgmap v1455: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 168 KiB/s wr, 18 op/s 2023-09-23T09:42:43.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:42:42 smithi082 ceph-mon[97694]: pgmap v1455: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 168 KiB/s wr, 18 op/s 2023-09-23T09:42:43.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:42:42 smithi161 ceph-mon[99580]: pgmap v1455: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 168 KiB/s wr, 18 op/s 2023-09-23T09:42:45.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:42:44 smithi135 ceph-mon[99205]: pgmap v1456: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 165 KiB/s wr, 16 op/s 2023-09-23T09:42:45.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:42:44 smithi082 ceph-mon[97694]: pgmap v1456: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 165 KiB/s wr, 16 op/s 2023-09-23T09:42:45.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:42:44 smithi161 ceph-mon[99580]: pgmap v1456: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 165 KiB/s wr, 16 op/s 2023-09-23T09:42:47.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:42:46 smithi135 ceph-mon[99205]: pgmap v1457: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 292 KiB/s rd, 319 KiB/s wr, 28 op/s 2023-09-23T09:42:47.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:42:46 smithi082 ceph-mon[97694]: pgmap v1457: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 292 KiB/s rd, 319 KiB/s wr, 28 op/s 2023-09-23T09:42:47.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:42:46 smithi161 ceph-mon[99580]: pgmap v1457: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 292 KiB/s rd, 319 KiB/s wr, 28 op/s 2023-09-23T09:42:48.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:42:48 smithi161 ceph-mon[99580]: pgmap v1458: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 212 KiB/s wr, 18 op/s 2023-09-23T09:42:48.810 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:42:48 smithi135 ceph-mon[99205]: pgmap v1458: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 212 KiB/s wr, 18 op/s 2023-09-23T09:42:48.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:42:48 smithi082 ceph-mon[97694]: pgmap v1458: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 212 KiB/s wr, 18 op/s 2023-09-23T09:42:51.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:42:50 smithi135 ceph-mon[99205]: pgmap v1459: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 255 KiB/s rd, 231 KiB/s wr, 23 op/s 2023-09-23T09:42:51.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:42:50 smithi082 ceph-mon[97694]: pgmap v1459: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 255 KiB/s rd, 231 KiB/s wr, 23 op/s 2023-09-23T09:42:51.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:42:50 smithi161 ceph-mon[99580]: pgmap v1459: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 255 KiB/s rd, 231 KiB/s wr, 23 op/s 2023-09-23T09:42:53.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:42:52 smithi135 ceph-mon[99205]: pgmap v1460: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 185 KiB/s wr, 20 op/s 2023-09-23T09:42:53.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:42:52 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:42:53.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:42:52 smithi082 ceph-mon[97694]: pgmap v1460: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 185 KiB/s wr, 20 op/s 2023-09-23T09:42:53.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:42:52 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:42:53.396 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:42:52 smithi161 ceph-mon[99580]: pgmap v1460: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 185 KiB/s wr, 20 op/s 2023-09-23T09:42:53.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:42:52 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:42:54.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:42:53 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:42:54.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:42:53 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:42:54.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:42:53 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:42:54.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:42:53 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:42:54.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:42:53 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:42:54.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:42:53 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:42:54.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:42:53 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:42:54.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:42:53 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:42:54.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:42:53 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:42:55.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:42:54 smithi135 ceph-mon[99205]: pgmap v1461: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 174 KiB/s wr, 17 op/s 2023-09-23T09:42:55.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:42:54 smithi082 ceph-mon[97694]: pgmap v1461: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 174 KiB/s wr, 17 op/s 2023-09-23T09:42:55.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:42:54 smithi161 ceph-mon[99580]: pgmap v1461: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 174 KiB/s wr, 17 op/s 2023-09-23T09:42:57.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:42:56 smithi135 ceph-mon[99205]: pgmap v1462: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 258 KiB/s wr, 26 op/s 2023-09-23T09:42:57.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:42:56 smithi082 ceph-mon[97694]: pgmap v1462: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 258 KiB/s wr, 26 op/s 2023-09-23T09:42:57.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:42:56 smithi161 ceph-mon[99580]: pgmap v1462: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 258 KiB/s wr, 26 op/s 2023-09-23T09:42:58.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:42:58 smithi161 ceph-mon[99580]: pgmap v1463: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 104 KiB/s wr, 14 op/s 2023-09-23T09:42:58.810 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:42:58 smithi135 ceph-mon[99205]: pgmap v1463: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 104 KiB/s wr, 14 op/s 2023-09-23T09:42:58.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:42:58 smithi082 ceph-mon[97694]: pgmap v1463: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 104 KiB/s wr, 14 op/s 2023-09-23T09:43:01.310 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:43:00 smithi135 ceph-mon[99205]: pgmap v1464: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 146 KiB/s wr, 19 op/s 2023-09-23T09:43:01.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:43:00 smithi082 ceph-mon[97694]: pgmap v1464: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 146 KiB/s wr, 19 op/s 2023-09-23T09:43:01.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:43:00 smithi161 ceph-mon[99580]: pgmap v1464: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 146 KiB/s wr, 19 op/s 2023-09-23T09:43:03.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:43:02 smithi135 ceph-mon[99205]: pgmap v1465: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 139 KiB/s wr, 17 op/s 2023-09-23T09:43:03.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:43:02 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:43:03.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:43:02 smithi082 ceph-mon[97694]: pgmap v1465: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 139 KiB/s wr, 17 op/s 2023-09-23T09:43:03.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:43:02 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:43:03.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:43:02 smithi161 ceph-mon[99580]: pgmap v1465: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 139 KiB/s wr, 17 op/s 2023-09-23T09:43:03.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:43:02 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:43:05.310 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:43:04 smithi135 ceph-mon[99205]: pgmap v1466: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 138 KiB/s wr, 15 op/s 2023-09-23T09:43:05.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:43:04 smithi082 ceph-mon[97694]: pgmap v1466: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 138 KiB/s wr, 15 op/s 2023-09-23T09:43:05.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:43:04 smithi161 ceph-mon[99580]: pgmap v1466: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 138 KiB/s wr, 15 op/s 2023-09-23T09:43:06.168 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:43:06.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.378+0000 7f135cb9d700 1 -- 172.21.15.82:0/1698768973 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1358068440 msgr2=0x7f135810d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:43:06.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.378+0000 7f135cb9d700 1 --2- 172.21.15.82:0/1698768973 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1358068440 0x7f135810d540 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f135000b0a0 tx=0x7f135000b3b0 comp rx=0 tx=0).stop 2023-09-23T09:43:06.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.378+0000 7f135cb9d700 1 -- 172.21.15.82:0/1698768973 shutdown_connections 2023-09-23T09:43:06.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.378+0000 7f135cb9d700 1 --2- 172.21.15.82:0/1698768973 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1358068440 0x7f135810d540 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:43:06.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.378+0000 7f135cb9d700 1 --2- 172.21.15.82:0/1698768973 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1358106780 0x7f1358106b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:43:06.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.378+0000 7f135cb9d700 1 --2- 172.21.15.82:0/1698768973 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1358067a80 0x7f1358067f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:43:06.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.378+0000 7f135cb9d700 1 -- 172.21.15.82:0/1698768973 >> 172.21.15.82:0/1698768973 conn(0x7f13580750e0 msgr2=0x7f13580754f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:43:06.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.378+0000 7f135cb9d700 1 -- 172.21.15.82:0/1698768973 shutdown_connections 2023-09-23T09:43:06.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.378+0000 7f135cb9d700 1 -- 172.21.15.82:0/1698768973 wait complete. 2023-09-23T09:43:06.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.379+0000 7f135cb9d700 1 Processor -- start 2023-09-23T09:43:06.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.379+0000 7f135cb9d700 1 -- start start 2023-09-23T09:43:06.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.380+0000 7f135cb9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1358067a80 0x7f13580ff930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:43:06.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.380+0000 7f135cb9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1358068440 0x7f13580ffe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:43:06.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.380+0000 7f135cb9d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1358106780 0x7f13581a4880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:43:06.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.380+0000 7f135cb9d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13581006a0 con 0x7f1358067a80 2023-09-23T09:43:06.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.380+0000 7f135cb9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13581a4dc0 con 0x7f1358068440 2023-09-23T09:43:06.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.380+0000 7f135cb9d700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13581a4f00 con 0x7f1358106780 2023-09-23T09:43:06.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.380+0000 7f13577fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1358067a80 0x7f13580ff930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:43:06.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.380+0000 7f134ffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1358068440 0x7f13580ffe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:43:06.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.380+0000 7f13577fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1358067a80 0x7f13580ff930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46002/0 (socket says 172.21.15.82:46002) 2023-09-23T09:43:06.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.380+0000 7f134ffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1358068440 0x7f13580ffe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:40986/0 (socket says 172.21.15.82:40986) 2023-09-23T09:43:06.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.380+0000 7f13577fe700 1 -- 172.21.15.82:0/3047377035 learned_addr learned my addr 172.21.15.82:0/3047377035 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:43:06.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.380+0000 7f1357fff700 1 --2- 172.21.15.82:0/3047377035 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1358106780 0x7f13581a4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:43:06.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.380+0000 7f13577fe700 1 -- 172.21.15.82:0/3047377035 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1358106780 msgr2=0x7f13581a4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:43:06.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.380+0000 7f13577fe700 1 --2- 172.21.15.82:0/3047377035 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1358106780 0x7f13581a4880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:43:06.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.380+0000 7f13577fe700 1 -- 172.21.15.82:0/3047377035 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1358068440 msgr2=0x7f13580ffe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:43:06.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.380+0000 7f13577fe700 1 --2- 172.21.15.82:0/3047377035 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1358068440 0x7f13580ffe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:43:06.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.381+0000 7f13577fe700 1 -- 172.21.15.82:0/3047377035 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1350009d00 con 0x7f1358067a80 2023-09-23T09:43:06.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.381+0000 7f134ffff700 1 --2- 172.21.15.82:0/3047377035 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1358068440 0x7f13580ffe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:43:06.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.381+0000 7f13577fe700 1 --2- 172.21.15.82:0/3047377035 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1358067a80 0x7f13580ff930 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f134800d950 tx=0x7f134800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:43:06.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.381+0000 7f13557fa700 1 -- 172.21.15.82:0/3047377035 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f134800f890 con 0x7f1358067a80 2023-09-23T09:43:06.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.381+0000 7f13557fa700 1 -- 172.21.15.82:0/3047377035 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f134800fe80 con 0x7f1358067a80 2023-09-23T09:43:06.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.381+0000 7f13557fa700 1 -- 172.21.15.82:0/3047377035 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f134800e3b0 con 0x7f1358067a80 2023-09-23T09:43:06.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.381+0000 7f135cb9d700 1 -- 172.21.15.82:0/3047377035 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13581a5160 con 0x7f1358067a80 2023-09-23T09:43:06.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.381+0000 7f135cb9d700 1 -- 172.21.15.82:0/3047377035 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13581a55f0 con 0x7f1358067a80 2023-09-23T09:43:06.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.384+0000 7f13557fa700 1 -- 172.21.15.82:0/3047377035 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f1348010460 con 0x7f1358067a80 2023-09-23T09:43:06.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.385+0000 7f137177ab80 1 Processor -- start 2023-09-23T09:43:06.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.386+0000 7f137177ab80 1 -- start start 2023-09-23T09:43:06.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.386+0000 7f13557fa700 1 --2- 172.21.15.82:0/3047377035 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f13440a0160 0x7f13440a2620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:43:06.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.386+0000 7f137177ab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6b7ca5500 0x55d6b7ca58e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:43:06.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.386+0000 7f137177ab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6b7ca5e20 0x55d6b7c9f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:43:06.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.386+0000 7f13557fa700 1 -- 172.21.15.82:0/3047377035 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f13480cb430 con 0x7f1358067a80 2023-09-23T09:43:06.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.386+0000 7f137177ab80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d6b7c9fc40 0x55d6b7ca0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:43:06.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.386+0000 7f137177ab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6b7c077b0 con 0x55d6b7ca5e20 2023-09-23T09:43:06.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.386+0000 7f137177ab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6b7bf8780 con 0x55d6b7ca5500 2023-09-23T09:43:06.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.386+0000 7f137177ab80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6b7bf60a0 con 0x55d6b7c9fc40 2023-09-23T09:43:06.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.386+0000 7f13577fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6b7ca5500 0x55d6b7ca58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:43:06.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.386+0000 7f134ffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6b7ca5e20 0x55d6b7c9f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:43:06.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.386+0000 7f1357fff700 1 --2- 172.21.15.82:0/3047377035 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f13440a0160 0x7f13440a2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:43:06.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.386+0000 7f13577fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6b7ca5500 0x55d6b7ca58e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:41002/0 (socket says 172.21.15.82:41002) 2023-09-23T09:43:06.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.386+0000 7f13577fe700 1 -- 172.21.15.82:0/4145373305 learned_addr learned my addr 172.21.15.82:0/4145373305 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:43:06.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.387+0000 7f1357fff700 1 --2- 172.21.15.82:0/4145373305 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d6b7c9fc40 0x55d6b7ca0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:43:06.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.387+0000 7f13577fe700 1 -- 172.21.15.82:0/4145373305 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d6b7c9fc40 msgr2=0x55d6b7ca0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:43:06.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.387+0000 7f13577fe700 1 --2- 172.21.15.82:0/4145373305 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d6b7c9fc40 0x55d6b7ca0080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:43:06.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.387+0000 7f13577fe700 1 -- 172.21.15.82:0/4145373305 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6b7ca5e20 msgr2=0x55d6b7c9f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:43:06.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.387+0000 7f13577fe700 1 --2- 172.21.15.82:0/4145373305 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6b7ca5e20 0x55d6b7c9f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:43:06.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.387+0000 7f13577fe700 1 -- 172.21.15.82:0/4145373305 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d6b7a71630 con 0x55d6b7ca5500 2023-09-23T09:43:06.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.387+0000 7f13577fe700 1 --2- 172.21.15.82:0/4145373305 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6b7ca5500 0x55d6b7ca58e0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f1348095550 tx=0x7f1348010760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb67952ead4dcc3 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:43:06.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.387+0000 7f1357fff700 1 --2- 172.21.15.82:0/3047377035 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f13440a0160 0x7f13440a2620 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f1350006130 tx=0x7f1350006020 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:43:06.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.387+0000 7f134dffb700 1 -- 172.21.15.82:0/4145373305 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1348098ae0 con 0x55d6b7ca5500 2023-09-23T09:43:06.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.387+0000 7f134dffb700 1 -- 172.21.15.82:0/4145373305 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f134809c910 con 0x55d6b7ca5500 2023-09-23T09:43:06.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.387+0000 7f134dffb700 1 -- 172.21.15.82:0/4145373305 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1348098230 con 0x55d6b7ca5500 2023-09-23T09:43:06.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.388+0000 7f137177ab80 1 -- 172.21.15.82:0/4145373305 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6b7ca5500 msgr2=0x55d6b7ca58e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:43:06.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.388+0000 7f137177ab80 1 --2- 172.21.15.82:0/4145373305 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6b7ca5500 0x55d6b7ca58e0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f1348095550 tx=0x7f1348010760 comp rx=0 tx=0).stop 2023-09-23T09:43:06.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.388+0000 7f137177ab80 1 -- 172.21.15.82:0/4145373305 shutdown_connections 2023-09-23T09:43:06.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.388+0000 7f137177ab80 1 --2- 172.21.15.82:0/4145373305 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d6b7c9fc40 0x55d6b7ca0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:43:06.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.388+0000 7f137177ab80 1 --2- 172.21.15.82:0/4145373305 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6b7ca5500 0x55d6b7ca58e0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:43:06.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.388+0000 7f137177ab80 1 --2- 172.21.15.82:0/4145373305 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6b7ca5e20 0x55d6b7c9f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:43:06.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.388+0000 7f137177ab80 1 -- 172.21.15.82:0/4145373305 >> 172.21.15.82:0/4145373305 conn(0x55d6b7c140e0 msgr2=0x55d6b7c9a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:43:06.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.388+0000 7f137177ab80 1 -- 172.21.15.82:0/4145373305 shutdown_connections 2023-09-23T09:43:06.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.388+0000 7f137177ab80 1 -- 172.21.15.82:0/4145373305 wait complete. 2023-09-23T09:43:06.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.389+0000 7f137177ab80 1 -- start start 2023-09-23T09:43:06.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.389+0000 7f137177ab80 1 Processor -- start 2023-09-23T09:43:06.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.389+0000 7f137177ab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6b7c9fc40 0x55d6b7cabde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:43:06.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.389+0000 7f137177ab80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d6b7ca5500 0x55d6b7ca9060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:43:06.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.389+0000 7f137177ab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6b7ca5e20 0x55d6b7ca97a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:43:06.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.389+0000 7f137177ab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6b7bf1990 con 0x55d6b7c9fc40 2023-09-23T09:43:06.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.389+0000 7f137177ab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6b7b8fbb0 con 0x55d6b7ca5e20 2023-09-23T09:43:06.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.389+0000 7f137177ab80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6b7b8f8b0 con 0x55d6b7ca5500 2023-09-23T09:43:06.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.389+0000 7f137177ab80 10 client.0 _ll_register_callbacks cb 0x55d6b7ad9a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:43:06.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.389+0000 7f13577fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6b7c9fc40 0x55d6b7cabde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:43:06.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.390+0000 7f13577fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6b7c9fc40 0x55d6b7cabde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46010/0 (socket says 172.21.15.82:46010) 2023-09-23T09:43:06.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.390+0000 7f13577fe700 1 -- 172.21.15.82:0/878610536 learned_addr learned my addr 172.21.15.82:0/878610536 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:43:06.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.390+0000 7f1357fff700 1 --2- 172.21.15.82:0/878610536 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6b7ca5e20 0x55d6b7ca97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:43:06.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.390+0000 7f134ffff700 1 --2- 172.21.15.82:0/878610536 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d6b7ca5500 0x55d6b7ca9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:43:06.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.390+0000 7f13577fe700 1 -- 172.21.15.82:0/878610536 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d6b7ca5500 msgr2=0x55d6b7ca9060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:43:06.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.390+0000 7f13577fe700 1 --2- 172.21.15.82:0/878610536 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d6b7ca5500 0x55d6b7ca9060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:43:06.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.390+0000 7f13577fe700 1 -- 172.21.15.82:0/878610536 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6b7ca5e20 msgr2=0x55d6b7ca97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:43:06.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.390+0000 7f13577fe700 1 --2- 172.21.15.82:0/878610536 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6b7ca5e20 0x55d6b7ca97a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:43:06.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.390+0000 7f13577fe700 1 -- 172.21.15.82:0/878610536 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13581a55f0 con 0x55d6b7c9fc40 2023-09-23T09:43:06.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.390+0000 7f13577fe700 1 --2- 172.21.15.82:0/878610536 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6b7c9fc40 0x55d6b7cabde0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f134800e010 tx=0x7f1348098200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a745a629fe2c3ee9 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:43:06.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.390+0000 7f1336ffd700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:43:06.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.390+0000 7f1336ffd700 1 -- 172.21.15.82:0/878610536 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13480a08f0 con 0x55d6b7c9fc40 2023-09-23T09:43:06.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.390+0000 7f1336ffd700 1 -- 172.21.15.82:0/878610536 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(167..167 src has 1..167) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f1348098ae0 con 0x55d6b7c9fc40 2023-09-23T09:43:06.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.390+0000 7f137177ab80 1 -- 172.21.15.82:0/878610536 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d6b7c6f1c0 con 0x55d6b7c9fc40 2023-09-23T09:43:06.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.391+0000 7f1336ffd700 1 -- 172.21.15.82:0/878610536 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=133) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1348098f50 con 0x55d6b7c9fc40 2023-09-23T09:43:06.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.391+0000 7f137177ab80 10 client.18246 fetch_fsmap learned FSMap version 133 2023-09-23T09:43:06.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.391+0000 7f137177ab80 1 -- 172.21.15.82:0/878610536 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=133,monmap=4+}) v3 -- 0x55d6b7a1dde0 con 0x55d6b7c9fc40 2023-09-23T09:43:06.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.391+0000 7f1336ffd700 1 -- 172.21.15.82:0/878610536 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d6b7c6f1c0 con 0x55d6b7c9fc40 2023-09-23T09:43:06.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.391+0000 7f1336ffd700 1 -- 172.21.15.82:0/878610536 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 133) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f13480948d0 con 0x55d6b7c9fc40 2023-09-23T09:43:06.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.391+0000 7f137177ab80 10 client.18246 fetch_fsmap finished waiting for FSMap version 133 2023-09-23T09:43:06.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.391+0000 7f137177ab80 10 client.18246 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:43:06.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.391+0000 7f137177ab80 20 client.18246 populate_metadata read hostname 'smithi082' 2023-09-23T09:43:06.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.391+0000 7f137177ab80 1 --2- 172.21.15.82:0/878610536 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55d6b7cb9430 0x55d6b7cbb820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:43:06.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.391+0000 7f137177ab80 4 client.18246 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:43:06.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.391+0000 7f137177ab80 1 -- 172.21.15.82:0/878610536 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d6b7b97ba0 con 0x55d6b7cb9430 2023-09-23T09:43:06.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.391+0000 7f134ffff700 1 --2- 172.21.15.82:0/878610536 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55d6b7cb9430 0x55d6b7cbb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:43:06.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.392+0000 7f134ffff700 1 --2- 172.21.15.82:0/878610536 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55d6b7cb9430 0x55d6b7cbb820 crc :-1 s=READY pgs=281 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cff3223f86d1caa6 server_cookie=1234523f09365789 in_seq=0 out_seq=0 2023-09-23T09:43:06.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.392+0000 7f1336ffd700 10 client.18246 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:43:06.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.393+0000 7f1336ffd700 1 -- 172.21.15.82:0/878610536 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55d6b7b97ba0 con 0x55d6b7cb9430 2023-09-23T09:43:06.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.393+0000 7f1336ffd700 10 client.18246 handle_command_reply: tid=0 2023-09-23T09:43:06.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.393+0000 7f137177ab80 1 client.18246 shutdown 2023-09-23T09:43:06.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.393+0000 7f137177ab80 1 -- 172.21.15.82:0/878610536 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6b7c9fc40 msgr2=0x55d6b7cabde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:43:06.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.393+0000 7f137177ab80 1 --2- 172.21.15.82:0/878610536 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6b7c9fc40 0x55d6b7cabde0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f134800e010 tx=0x7f1348098200 comp rx=0 tx=0).stop 2023-09-23T09:43:06.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.393+0000 7f137177ab80 1 -- 172.21.15.82:0/878610536 shutdown_connections 2023-09-23T09:43:06.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.393+0000 7f137177ab80 1 --2- 172.21.15.82:0/878610536 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6b7ca5e20 0x55d6b7ca97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:43:06.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.393+0000 7f137177ab80 1 --2- 172.21.15.82:0/878610536 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55d6b7cb9430 0x55d6b7cbb820 crc :-1 s=READY pgs=281 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:43:06.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.393+0000 7f137177ab80 1 --2- 172.21.15.82:0/878610536 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6b7c9fc40 0x55d6b7cabde0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:43:06.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.393+0000 7f137177ab80 1 --2- 172.21.15.82:0/878610536 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d6b7ca5500 0x55d6b7ca9060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:43:06.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.393+0000 7f137177ab80 1 -- 172.21.15.82:0/878610536 >> 172.21.15.82:0/878610536 conn(0x55d6b7c140e0 msgr2=0x55d6b7c9a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:43:06.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.393+0000 7f1336ffd700 0 client.18246 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:43:06.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.393+0000 7f137177ab80 1 -- 172.21.15.82:0/878610536 shutdown_connections 2023-09-23T09:43:06.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.393+0000 7f137177ab80 1 -- 172.21.15.82:0/878610536 wait complete. 2023-09-23T09:43:06.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.393+0000 7f137177ab80 20 client.18246 trim_cache size 0 max 16384 2023-09-23T09:43:06.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.410+0000 7f137177ab80 1 Processor -- start 2023-09-23T09:43:06.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.410+0000 7f137177ab80 1 -- start start 2023-09-23T09:43:06.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.410+0000 7f137177ab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6b7c9fc40 0x55d6b7cab980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:43:06.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.410+0000 7f137177ab80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d6b7ca5500 0x55d6b7c9a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:43:06.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.410+0000 7f137177ab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6b7ca5e20 0x55d6b7ca3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:43:06.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.410+0000 7f137177ab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6b7a73920 con 0x55d6b7ca5e20 2023-09-23T09:43:06.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.410+0000 7f137177ab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6b7c9b580 con 0x55d6b7c9fc40 2023-09-23T09:43:06.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.410+0000 7f137177ab80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6b7ca0990 con 0x55d6b7ca5500 2023-09-23T09:43:06.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.411+0000 7f1357fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6b7ca5e20 0x55d6b7ca3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:43:06.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.411+0000 7f13577fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6b7c9fc40 0x55d6b7cab980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:43:06.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.411+0000 7f13577fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6b7c9fc40 0x55d6b7cab980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:41020/0 (socket says 172.21.15.82:41020) 2023-09-23T09:43:06.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.411+0000 7f13577fe700 1 -- 172.21.15.82:0/1298366272 learned_addr learned my addr 172.21.15.82:0/1298366272 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:43:06.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.411+0000 7f134ffff700 1 --2- 172.21.15.82:0/1298366272 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d6b7ca5500 0x55d6b7c9a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:43:06.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.411+0000 7f13577fe700 1 -- 172.21.15.82:0/1298366272 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d6b7ca5500 msgr2=0x55d6b7c9a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:43:06.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.411+0000 7f13577fe700 1 --2- 172.21.15.82:0/1298366272 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d6b7ca5500 0x55d6b7c9a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:43:06.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.411+0000 7f13577fe700 1 -- 172.21.15.82:0/1298366272 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6b7ca5e20 msgr2=0x55d6b7ca3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:43:06.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.411+0000 7f13577fe700 1 --2- 172.21.15.82:0/1298366272 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6b7ca5e20 0x55d6b7ca3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:43:06.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.411+0000 7f13577fe700 1 -- 172.21.15.82:0/1298366272 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d6b7a06c60 con 0x55d6b7c9fc40 2023-09-23T09:43:06.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.411+0000 7f13577fe700 1 --2- 172.21.15.82:0/1298366272 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6b7c9fc40 0x55d6b7cab980 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f1348094fe0 tx=0x7f1348094f50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8fa1317180e7be2e server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:43:06.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.412+0000 7f134e7fc700 1 -- 172.21.15.82:0/1298366272 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f134809c910 con 0x55d6b7c9fc40 2023-09-23T09:43:06.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.412+0000 7f134e7fc700 1 -- 172.21.15.82:0/1298366272 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1348010760 con 0x55d6b7c9fc40 2023-09-23T09:43:06.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.412+0000 7f134e7fc700 1 -- 172.21.15.82:0/1298366272 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1348099d50 con 0x55d6b7c9fc40 2023-09-23T09:43:06.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.412+0000 7f137177ab80 1 -- 172.21.15.82:0/1298366272 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6b7c9fc40 msgr2=0x55d6b7cab980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:43:06.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.412+0000 7f137177ab80 1 --2- 172.21.15.82:0/1298366272 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6b7c9fc40 0x55d6b7cab980 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f1348094fe0 tx=0x7f1348094f50 comp rx=0 tx=0).stop 2023-09-23T09:43:06.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.412+0000 7f137177ab80 1 -- 172.21.15.82:0/1298366272 shutdown_connections 2023-09-23T09:43:06.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.412+0000 7f137177ab80 1 --2- 172.21.15.82:0/1298366272 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6b7ca5e20 0x55d6b7ca3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:43:06.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.412+0000 7f137177ab80 1 --2- 172.21.15.82:0/1298366272 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6b7c9fc40 0x55d6b7cab980 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:43:06.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.412+0000 7f137177ab80 1 --2- 172.21.15.82:0/1298366272 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d6b7ca5500 0x55d6b7c9a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:43:06.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.412+0000 7f137177ab80 1 -- 172.21.15.82:0/1298366272 >> 172.21.15.82:0/1298366272 conn(0x55d6b7c140e0 msgr2=0x55d6b7cb50f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:43:06.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.412+0000 7f137177ab80 1 -- 172.21.15.82:0/1298366272 shutdown_connections 2023-09-23T09:43:06.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.412+0000 7f137177ab80 1 -- 172.21.15.82:0/1298366272 wait complete. 2023-09-23T09:43:06.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.413+0000 7f137177ab80 1 -- start start 2023-09-23T09:43:06.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.413+0000 7f137177ab80 1 Processor -- start 2023-09-23T09:43:06.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.413+0000 7f137177ab80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d6b7c9fc40 0x55d6b7ca75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:43:06.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.413+0000 7f137177ab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6b7ca5500 0x55d6b7ca7b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:43:06.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.413+0000 7f137177ab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6b7ca5e20 0x55d6b7ca8040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:43:06.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.413+0000 7f137177ab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6b7ca8580 con 0x55d6b7ca5500 2023-09-23T09:43:06.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.413+0000 7f137177ab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6b7ca86f0 con 0x55d6b7ca5e20 2023-09-23T09:43:06.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.413+0000 7f137177ab80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6b7ca88b0 con 0x55d6b7c9fc40 2023-09-23T09:43:06.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.413+0000 7f137177ab80 10 client.0 _ll_register_callbacks cb 0x7f1340009be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:43:06.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.414+0000 7f134ffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6b7ca5500 0x55d6b7ca7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:43:06.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.414+0000 7f134ffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6b7ca5500 0x55d6b7ca7b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46026/0 (socket says 172.21.15.82:46026) 2023-09-23T09:43:06.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.414+0000 7f134ffff700 1 -- 172.21.15.82:0/1606515812 learned_addr learned my addr 172.21.15.82:0/1606515812 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:43:06.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.414+0000 7f1357fff700 1 --2- 172.21.15.82:0/1606515812 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6b7ca5e20 0x55d6b7ca8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:43:06.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.414+0000 7f13577fe700 1 --2- 172.21.15.82:0/1606515812 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d6b7c9fc40 0x55d6b7ca75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:43:06.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.414+0000 7f134ffff700 1 -- 172.21.15.82:0/1606515812 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d6b7c9fc40 msgr2=0x55d6b7ca75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:43:06.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.414+0000 7f134ffff700 1 --2- 172.21.15.82:0/1606515812 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d6b7c9fc40 0x55d6b7ca75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:43:06.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.414+0000 7f134ffff700 1 -- 172.21.15.82:0/1606515812 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6b7ca5e20 msgr2=0x55d6b7ca8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:43:06.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.414+0000 7f134ffff700 1 --2- 172.21.15.82:0/1606515812 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6b7ca5e20 0x55d6b7ca8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:43:06.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.414+0000 7f134ffff700 1 -- 172.21.15.82:0/1606515812 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d6b7a1dde0 con 0x55d6b7ca5500 2023-09-23T09:43:06.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.414+0000 7f1357fff700 1 --2- 172.21.15.82:0/1606515812 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6b7ca5e20 0x55d6b7ca8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:43:06.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.414+0000 7f13577fe700 1 --2- 172.21.15.82:0/1606515812 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d6b7c9fc40 0x55d6b7ca75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T09:43:06.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.414+0000 7f134ffff700 1 --2- 172.21.15.82:0/1606515812 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6b7ca5500 0x55d6b7ca7b00 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x55d6b7ca62a0 tx=0x7f1340005910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67347accb003d6b8 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:43:06.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.414+0000 7f1336ffd700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:43:06.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.414+0000 7f1336ffd700 1 -- 172.21.15.82:0/1606515812 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1340010c30 con 0x55d6b7ca5500 2023-09-23T09:43:06.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.414+0000 7f137177ab80 1 -- 172.21.15.82:0/1606515812 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d6b7c928b0 con 0x55d6b7ca5500 2023-09-23T09:43:06.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.415+0000 7f1336ffd700 1 -- 172.21.15.82:0/1606515812 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(167..167 src has 1..167) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f1340010d90 con 0x55d6b7ca5500 2023-09-23T09:43:06.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.415+0000 7f1336ffd700 1 -- 172.21.15.82:0/1606515812 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=133) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1340004050 con 0x55d6b7ca5500 2023-09-23T09:43:06.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.415+0000 7f137177ab80 10 client.18252 fetch_fsmap learned FSMap version 133 2023-09-23T09:43:06.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.415+0000 7f137177ab80 1 -- 172.21.15.82:0/1606515812 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=133,monmap=4+}) v3 -- 0x55d6b7a44250 con 0x55d6b7ca5500 2023-09-23T09:43:06.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.415+0000 7f1336ffd700 1 -- 172.21.15.82:0/1606515812 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d6b7c928b0 con 0x55d6b7ca5500 2023-09-23T09:43:06.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.415+0000 7f1336ffd700 1 -- 172.21.15.82:0/1606515812 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 133) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f134000f3c0 con 0x55d6b7ca5500 2023-09-23T09:43:06.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.415+0000 7f137177ab80 10 client.18252 fetch_fsmap finished waiting for FSMap version 133 2023-09-23T09:43:06.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.415+0000 7f137177ab80 10 client.18252 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:43:06.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.415+0000 7f137177ab80 20 client.18252 populate_metadata read hostname 'smithi082' 2023-09-23T09:43:06.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.415+0000 7f137177ab80 1 --2- 172.21.15.82:0/1606515812 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55d6b7d0dd00 0x55d6b7d10120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:43:06.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.415+0000 7f137177ab80 4 client.18252 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:43:06.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.415+0000 7f137177ab80 1 -- 172.21.15.82:0/1606515812 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55d6b7bea970 con 0x55d6b7d0dd00 2023-09-23T09:43:06.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.416+0000 7f13577fe700 1 --2- 172.21.15.82:0/1606515812 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55d6b7d0dd00 0x55d6b7d10120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:43:06.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.416+0000 7f1336ffd700 10 client.18252 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:43:06.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.416+0000 7f13577fe700 1 --2- 172.21.15.82:0/1606515812 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55d6b7d0dd00 0x55d6b7d10120 crc :-1 s=READY pgs=282 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=82202c4b93f9c158 server_cookie=b37869127e96612 in_seq=0 out_seq=0 2023-09-23T09:43:06.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.416+0000 7f1336ffd700 1 -- 172.21.15.82:0/1606515812 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55d6b7bea970 con 0x55d6b7d0dd00 2023-09-23T09:43:06.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.416+0000 7f1336ffd700 10 client.18252 handle_command_reply: tid=0 2023-09-23T09:43:06.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.416+0000 7f137177ab80 1 client.18252 shutdown 2023-09-23T09:43:06.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.416+0000 7f137177ab80 1 -- 172.21.15.82:0/1606515812 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6b7ca5500 msgr2=0x55d6b7ca7b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:43:06.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.416+0000 7f137177ab80 1 --2- 172.21.15.82:0/1606515812 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6b7ca5500 0x55d6b7ca7b00 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x55d6b7ca62a0 tx=0x7f1340005910 comp rx=0 tx=0).stop 2023-09-23T09:43:06.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.417+0000 7f137177ab80 1 -- 172.21.15.82:0/1606515812 shutdown_connections 2023-09-23T09:43:06.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.417+0000 7f137177ab80 1 --2- 172.21.15.82:0/1606515812 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6b7ca5e20 0x55d6b7ca8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:43:06.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.417+0000 7f137177ab80 1 --2- 172.21.15.82:0/1606515812 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d6b7c9fc40 0x55d6b7ca75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:43:06.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.417+0000 7f137177ab80 1 --2- 172.21.15.82:0/1606515812 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55d6b7d0dd00 0x55d6b7d10120 crc :-1 s=READY pgs=282 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:43:06.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.417+0000 7f137177ab80 1 --2- 172.21.15.82:0/1606515812 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6b7ca5500 0x55d6b7ca7b00 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:43:06.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.417+0000 7f1336ffd700 0 client.18252 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:43:06.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.417+0000 7f137177ab80 1 -- 172.21.15.82:0/1606515812 >> 172.21.15.82:0/1606515812 conn(0x55d6b7c140e0 msgr2=0x55d6b7ca3290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:43:06.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.417+0000 7f137177ab80 1 -- 172.21.15.82:0/1606515812 shutdown_connections 2023-09-23T09:43:06.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.417+0000 7f137177ab80 1 -- 172.21.15.82:0/1606515812 wait complete. 2023-09-23T09:43:06.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.417+0000 7f137177ab80 20 client.18252 trim_cache size 0 max 16384 2023-09-23T09:43:06.425 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:43:06.426 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-23T09:43:06.426 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:43:06.426 INFO:teuthology.orchestra.run.smithi082.stdout: "d9e62ab8-1468-4fb0-a9fe-61bed13e954b": { 2023-09-23T09:43:06.426 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:43:06.426 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "d9e62ab8-1468-4fb0-a9fe-61bed13e954b", 2023-09-23T09:43:06.426 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:43:06.426 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:43:06.426 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:43:06.426 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:43:06.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.417+0000 7f135cb9d700 1 -- 172.21.15.82:0/3047377035 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f13440a0160 msgr2=0x7f13440a2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:43:06.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.417+0000 7f135cb9d700 1 --2- 172.21.15.82:0/3047377035 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f13440a0160 0x7f13440a2620 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f1350006130 tx=0x7f1350006020 comp rx=0 tx=0).stop 2023-09-23T09:43:06.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.417+0000 7f135cb9d700 1 -- 172.21.15.82:0/3047377035 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1358067a80 msgr2=0x7f13580ff930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:43:06.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.417+0000 7f135cb9d700 1 --2- 172.21.15.82:0/3047377035 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1358067a80 0x7f13580ff930 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f134800d950 tx=0x7f134800dc60 comp rx=0 tx=0).stop 2023-09-23T09:43:06.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.418+0000 7f135cb9d700 1 -- 172.21.15.82:0/3047377035 shutdown_connections 2023-09-23T09:43:06.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.418+0000 7f135cb9d700 1 --2- 172.21.15.82:0/3047377035 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f13440a0160 0x7f13440a2620 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:43:06.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.418+0000 7f135cb9d700 1 --2- 172.21.15.82:0/3047377035 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1358106780 0x7f13581a4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:43:06.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.418+0000 7f135cb9d700 1 --2- 172.21.15.82:0/3047377035 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1358067a80 0x7f13580ff930 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:43:06.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.418+0000 7f135cb9d700 1 --2- 172.21.15.82:0/3047377035 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1358068440 0x7f13580ffe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:43:06.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.418+0000 7f135cb9d700 1 -- 172.21.15.82:0/3047377035 >> 172.21.15.82:0/3047377035 conn(0x7f13580750e0 msgr2=0x7f1358104330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:43:06.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.418+0000 7f135cb9d700 1 -- 172.21.15.82:0/3047377035 shutdown_connections 2023-09-23T09:43:06.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:06.418+0000 7f135cb9d700 1 -- 172.21.15.82:0/3047377035 wait complete. 2023-09-23T09:43:06.437 INFO:tasks.cephfs.filesystem:scrub status for tag:d9e62ab8-1468-4fb0-a9fe-61bed13e954b - {'path': '/', 'tag': 'd9e62ab8-1468-4fb0-a9fe-61bed13e954b', 'options': 'recursive,force'} 2023-09-23T09:43:07.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:43:06 smithi135 ceph-mon[99205]: pgmap v1467: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 183 KiB/s wr, 33 op/s 2023-09-23T09:43:07.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:43:06 smithi082 ceph-mon[97694]: pgmap v1467: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 183 KiB/s wr, 33 op/s 2023-09-23T09:43:07.396 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:43:06 smithi161 ceph-mon[99580]: pgmap v1467: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 183 KiB/s wr, 33 op/s 2023-09-23T09:43:08.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:43:08 smithi161 ceph-mon[99580]: pgmap v1468: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 99 KiB/s wr, 24 op/s 2023-09-23T09:43:08.810 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:43:08 smithi135 ceph-mon[99205]: pgmap v1468: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 99 KiB/s wr, 24 op/s 2023-09-23T09:43:08.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:43:08 smithi082 ceph-mon[97694]: pgmap v1468: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 99 KiB/s wr, 24 op/s 2023-09-23T09:43:11.317 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:43:10 smithi135 ceph-mon[99205]: pgmap v1469: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 405 KiB/s wr, 55 op/s 2023-09-23T09:43:11.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:43:10 smithi082 ceph-mon[97694]: pgmap v1469: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 405 KiB/s wr, 55 op/s 2023-09-23T09:43:11.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:43:10 smithi161 ceph-mon[99580]: pgmap v1469: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 405 KiB/s wr, 55 op/s 2023-09-23T09:43:12.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:43:12 smithi135 ceph-mon[99205]: osdmap e168: 12 total, 12 up, 12 in 2023-09-23T09:43:12.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:43:12 smithi082 ceph-mon[97694]: osdmap e168: 12 total, 12 up, 12 in 2023-09-23T09:43:12.399 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:43:12 smithi161 ceph-mon[99580]: osdmap e168: 12 total, 12 up, 12 in 2023-09-23T09:43:13.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:43:13 smithi082 ceph-mon[97694]: pgmap v1471: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 622 KiB/s wr, 77 op/s 2023-09-23T09:43:13.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:43:13 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:43:13.402 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:43:13 smithi161 ceph-mon[99580]: pgmap v1471: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 622 KiB/s wr, 77 op/s 2023-09-23T09:43:13.402 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:43:13 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:43:13.564 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:43:13 smithi135 ceph-mon[99205]: pgmap v1471: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 622 KiB/s wr, 77 op/s 2023-09-23T09:43:13.564 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:43:13 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:43:15.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:43:15 smithi082 ceph-mon[97694]: pgmap v1472: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 622 KiB/s wr, 77 op/s 2023-09-23T09:43:15.396 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:43:15 smithi161 ceph-mon[99580]: pgmap v1472: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 622 KiB/s wr, 77 op/s 2023-09-23T09:43:15.560 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:43:15 smithi135 ceph-mon[99205]: pgmap v1472: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 622 KiB/s wr, 77 op/s 2023-09-23T09:43:17.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:43:17 smithi082 ceph-mon[97694]: pgmap v1473: 97 pgs: 8 active+clean+snaptrim, 20 active+clean+snaptrim_wait, 69 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 818 KiB/s wr, 91 op/s 2023-09-23T09:43:17.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:43:17 smithi161 ceph-mon[99580]: pgmap v1473: 97 pgs: 8 active+clean+snaptrim, 20 active+clean+snaptrim_wait, 69 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 818 KiB/s wr, 91 op/s 2023-09-23T09:43:17.560 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:43:17 smithi135 ceph-mon[99205]: pgmap v1473: 97 pgs: 8 active+clean+snaptrim, 20 active+clean+snaptrim_wait, 69 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 818 KiB/s wr, 91 op/s 2023-09-23T09:43:18.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:43:18 smithi161 ceph-mon[99580]: pgmap v1474: 97 pgs: 6 active+clean+snaptrim, 14 active+clean+snaptrim_wait, 77 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 863 KiB/s wr, 96 op/s 2023-09-23T09:43:18.810 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:43:18 smithi135 ceph-mon[99205]: pgmap v1474: 97 pgs: 6 active+clean+snaptrim, 14 active+clean+snaptrim_wait, 77 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 863 KiB/s wr, 96 op/s 2023-09-23T09:43:18.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:43:18 smithi082 ceph-mon[97694]: pgmap v1474: 97 pgs: 6 active+clean+snaptrim, 14 active+clean+snaptrim_wait, 77 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 863 KiB/s wr, 96 op/s 2023-09-23T09:43:21.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:43:20 smithi135 ceph-mon[99205]: pgmap v1475: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 890 KiB/s wr, 103 op/s 2023-09-23T09:43:21.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:43:20 smithi082 ceph-mon[97694]: pgmap v1475: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 890 KiB/s wr, 103 op/s 2023-09-23T09:43:21.396 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:43:20 smithi161 ceph-mon[99580]: pgmap v1475: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 890 KiB/s wr, 103 op/s 2023-09-23T09:43:23.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:43:22 smithi135 ceph-mon[99205]: pgmap v1476: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 1019 KiB/s wr, 119 op/s 2023-09-23T09:43:23.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:43:22 smithi135 ceph-mon[99205]: osdmap e169: 12 total, 12 up, 12 in 2023-09-23T09:43:23.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:43:22 smithi082 ceph-mon[97694]: pgmap v1476: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 1019 KiB/s wr, 119 op/s 2023-09-23T09:43:23.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:43:22 smithi082 ceph-mon[97694]: osdmap e169: 12 total, 12 up, 12 in 2023-09-23T09:43:23.396 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:43:22 smithi161 ceph-mon[99580]: pgmap v1476: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 1019 KiB/s wr, 119 op/s 2023-09-23T09:43:23.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:43:22 smithi161 ceph-mon[99580]: osdmap e169: 12 total, 12 up, 12 in 2023-09-23T09:43:25.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:43:24 smithi135 ceph-mon[99205]: pgmap v1478: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 1012 KiB/s wr, 125 op/s 2023-09-23T09:43:25.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:43:24 smithi082 ceph-mon[97694]: pgmap v1478: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 1012 KiB/s wr, 125 op/s 2023-09-23T09:43:25.396 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:43:24 smithi161 ceph-mon[99580]: pgmap v1478: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 1012 KiB/s wr, 125 op/s 2023-09-23T09:43:27.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:43:26 smithi135 ceph-mon[99205]: pgmap v1479: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 1.3 MiB/s wr, 170 op/s 2023-09-23T09:43:27.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:43:26 smithi082 ceph-mon[97694]: pgmap v1479: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 1.3 MiB/s wr, 170 op/s 2023-09-23T09:43:27.396 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:43:26 smithi161 ceph-mon[99580]: pgmap v1479: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 1.3 MiB/s wr, 170 op/s 2023-09-23T09:43:28.646 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:43:28 smithi161 ceph-mon[99580]: pgmap v1480: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 1.4 MiB/s wr, 174 op/s 2023-09-23T09:43:28.810 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:43:28 smithi135 ceph-mon[99205]: pgmap v1480: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 1.4 MiB/s wr, 174 op/s 2023-09-23T09:43:28.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:43:28 smithi082 ceph-mon[97694]: pgmap v1480: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 1.4 MiB/s wr, 174 op/s 2023-09-23T09:43:31.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:43:30 smithi135 ceph-mon[99205]: pgmap v1481: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 1.6 MiB/s wr, 205 op/s 2023-09-23T09:43:31.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:43:30 smithi082 ceph-mon[97694]: pgmap v1481: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 1.6 MiB/s wr, 205 op/s 2023-09-23T09:43:31.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:43:30 smithi161 ceph-mon[99580]: pgmap v1481: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 1.6 MiB/s wr, 205 op/s 2023-09-23T09:43:33.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:43:32 smithi135 ceph-mon[99205]: pgmap v1482: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 1.8 MiB/s wr, 227 op/s 2023-09-23T09:43:33.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:43:32 smithi082 ceph-mon[97694]: pgmap v1482: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 1.8 MiB/s wr, 227 op/s 2023-09-23T09:43:33.396 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:43:32 smithi161 ceph-mon[99580]: pgmap v1482: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 1.8 MiB/s wr, 227 op/s 2023-09-23T09:43:35.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:43:34 smithi135 ceph-mon[99205]: pgmap v1483: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 1.5 MiB/s wr, 197 op/s 2023-09-23T09:43:35.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:43:34 smithi082 ceph-mon[97694]: pgmap v1483: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 1.5 MiB/s wr, 197 op/s 2023-09-23T09:43:35.396 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:43:34 smithi161 ceph-mon[99580]: pgmap v1483: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 1.5 MiB/s wr, 197 op/s 2023-09-23T09:43:36.438 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:43:36.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.849+0000 7f48c01ff700 1 -- 172.21.15.82:0/1077871259 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48b8072cc0 msgr2=0x7f48b80730a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:43:36.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.849+0000 7f48c01ff700 1 --2- 172.21.15.82:0/1077871259 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48b8072cc0 0x7f48b80730a0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f48a8009990 tx=0x7f48a8009ca0 comp rx=0 tx=0).stop 2023-09-23T09:43:36.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.849+0000 7f48c01ff700 1 -- 172.21.15.82:0/1077871259 shutdown_connections 2023-09-23T09:43:36.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.849+0000 7f48c01ff700 1 --2- 172.21.15.82:0/1077871259 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f48b81118a0 0x7f48b8113c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:43:36.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.849+0000 7f48c01ff700 1 --2- 172.21.15.82:0/1077871259 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48b8072cc0 0x7f48b80730a0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:43:36.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.849+0000 7f48c01ff700 1 --2- 172.21.15.82:0/1077871259 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48b80735e0 0x7f48b8111360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:43:36.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.849+0000 7f48c01ff700 1 -- 172.21.15.82:0/1077871259 >> 172.21.15.82:0/1077871259 conn(0x7f48b80fc380 msgr2=0x7f48b80fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:43:36.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.850+0000 7f48c01ff700 1 -- 172.21.15.82:0/1077871259 shutdown_connections 2023-09-23T09:43:36.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.850+0000 7f48c01ff700 1 -- 172.21.15.82:0/1077871259 wait complete. 2023-09-23T09:43:36.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.851+0000 7f48c01ff700 1 Processor -- start 2023-09-23T09:43:36.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.851+0000 7f48c01ff700 1 -- start start 2023-09-23T09:43:36.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.852+0000 7f48c01ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48b8072cc0 0x7f48b819cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:43:36.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.852+0000 7f48c01ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f48b80735e0 0x7f48b819d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:43:36.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.852+0000 7f48c01ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48b81118a0 0x7f48b81a18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:43:36.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.852+0000 7f48c01ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b81a1f20 con 0x7f48b81118a0 2023-09-23T09:43:36.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.852+0000 7f48c01ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b81a2090 con 0x7f48b8072cc0 2023-09-23T09:43:36.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.852+0000 7f48c01ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b81a2250 con 0x7f48b80735e0 2023-09-23T09:43:36.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.852+0000 7f48be79c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48b81118a0 0x7f48b81a18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:43:36.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.852+0000 7f48be79c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48b81118a0 0x7f48b81a18e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45730/0 (socket says 172.21.15.82:45730) 2023-09-23T09:43:36.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.852+0000 7f48be79c700 1 -- 172.21.15.82:0/4032699988 learned_addr learned my addr 172.21.15.82:0/4032699988 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:43:36.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.852+0000 7f48bdf9b700 1 --2- 172.21.15.82:0/4032699988 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48b8072cc0 0x7f48b819cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:43:36.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.852+0000 7f48bd79a700 1 --2- 172.21.15.82:0/4032699988 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f48b80735e0 0x7f48b819d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:43:36.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.853+0000 7f48be79c700 1 -- 172.21.15.82:0/4032699988 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f48b80735e0 msgr2=0x7f48b819d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:43:36.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.853+0000 7f48be79c700 1 --2- 172.21.15.82:0/4032699988 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f48b80735e0 0x7f48b819d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:43:36.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.853+0000 7f48be79c700 1 -- 172.21.15.82:0/4032699988 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48b8072cc0 msgr2=0x7f48b819cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:43:36.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.853+0000 7f48be79c700 1 --2- 172.21.15.82:0/4032699988 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48b8072cc0 0x7f48b819cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:43:36.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.853+0000 7f48be79c700 1 -- 172.21.15.82:0/4032699988 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48a80095f0 con 0x7f48b81118a0 2023-09-23T09:43:36.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.853+0000 7f48be79c700 1 --2- 172.21.15.82:0/4032699988 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48b81118a0 0x7f48b81a18e0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f48b400b480 tx=0x7f48b400b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:43:36.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.854+0000 7f48aeffd700 1 -- 172.21.15.82:0/4032699988 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b4011830 con 0x7f48b81118a0 2023-09-23T09:43:36.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.854+0000 7f48aeffd700 1 -- 172.21.15.82:0/4032699988 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f48b4011e20 con 0x7f48b81118a0 2023-09-23T09:43:36.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.854+0000 7f48c01ff700 1 -- 172.21.15.82:0/4032699988 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48b81a2530 con 0x7f48b81118a0 2023-09-23T09:43:36.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.854+0000 7f48aeffd700 1 -- 172.21.15.82:0/4032699988 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b400f2e0 con 0x7f48b81118a0 2023-09-23T09:43:36.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.854+0000 7f48c01ff700 1 -- 172.21.15.82:0/4032699988 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48b81a9d70 con 0x7f48b81118a0 2023-09-23T09:43:36.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.859+0000 7f48aeffd700 1 -- 172.21.15.82:0/4032699988 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f48b4011990 con 0x7f48b81118a0 2023-09-23T09:43:36.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.860+0000 7f48d3b62b80 1 Processor -- start 2023-09-23T09:43:36.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.861+0000 7f48d3b62b80 1 -- start start 2023-09-23T09:43:36.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.861+0000 7f48d3b62b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55db5d874380 0x55db5d874760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:43:36.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.861+0000 7f48d3b62b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55db5d874ca0 0x55db5d86e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:43:36.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.861+0000 7f48d3b62b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55db5d86ec40 0x55db5d86f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:43:36.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.861+0000 7f48d3b62b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db5d7d67b0 con 0x55db5d86ec40 2023-09-23T09:43:36.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.861+0000 7f48d3b62b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db5d7c7780 con 0x55db5d874ca0 2023-09-23T09:43:36.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.861+0000 7f48d3b62b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db5d7c50a0 con 0x55db5d874380 2023-09-23T09:43:36.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.862+0000 7f48bd79a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55db5d874380 0x55db5d874760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:43:36.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.862+0000 7f48bd79a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55db5d874380 0x55db5d874760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:41292/0 (socket says 172.21.15.82:41292) 2023-09-23T09:43:36.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.862+0000 7f48bd79a700 1 -- 172.21.15.82:0/2757294961 learned_addr learned my addr 172.21.15.82:0/2757294961 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:43:36.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.862+0000 7f48bd79a700 1 --2- 172.21.15.82:0/2757294961 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55db5d86ec40 0x55db5d86f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:43:36.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.862+0000 7f48aeffd700 1 --2- 172.21.15.82:0/4032699988 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f48a40a01c0 0x7f48a40a2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:43:36.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.863+0000 7f48bdf9b700 1 --2- 172.21.15.82:0/2757294961 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55db5d874ca0 0x55db5d86e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:43:36.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.863+0000 7f48aeffd700 1 -- 172.21.15.82:0/4032699988 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f48b40cb140 con 0x7f48b81118a0 2023-09-23T09:43:36.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.863+0000 7f48be79c700 1 --2- 172.21.15.82:0/4032699988 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f48a40a01c0 0x7f48a40a2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:43:36.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.863+0000 7f48bd79a700 1 -- 172.21.15.82:0/2757294961 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55db5d874ca0 msgr2=0x55db5d86e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:43:36.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.863+0000 7f48bd79a700 1 --2- 172.21.15.82:0/2757294961 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55db5d874ca0 0x55db5d86e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:43:36.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.863+0000 7f48bd79a700 1 -- 172.21.15.82:0/2757294961 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55db5d86ec40 msgr2=0x55db5d86f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:43:36.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.863+0000 7f48bd79a700 1 --2- 172.21.15.82:0/2757294961 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55db5d86ec40 0x55db5d86f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:43:36.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.863+0000 7f48bd79a700 1 -- 172.21.15.82:0/2757294961 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55db5d640630 con 0x55db5d874380 2023-09-23T09:43:36.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.864+0000 7f48bd79a700 1 --2- 172.21.15.82:0/2757294961 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55db5d874380 0x55db5d874760 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f48b00138d0 tx=0x7f48b0007b10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2de0d16b4e273def server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:43:36.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.864+0000 7f48a3fff700 1 -- 172.21.15.82:0/2757294961 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b0017400 con 0x55db5d874380 2023-09-23T09:43:36.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.864+0000 7f48be79c700 1 --2- 172.21.15.82:0/4032699988 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f48a40a01c0 0x7f48a40a2680 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f48b4095370 tx=0x7f48b4011f90 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:43:36.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.864+0000 7f48a3fff700 1 -- 172.21.15.82:0/2757294961 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f48b000d030 con 0x55db5d874380 2023-09-23T09:43:36.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.864+0000 7f48a3fff700 1 -- 172.21.15.82:0/2757294961 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b0015610 con 0x55db5d874380 2023-09-23T09:43:36.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.865+0000 7f48d3b62b80 1 -- 172.21.15.82:0/2757294961 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55db5d874380 msgr2=0x55db5d874760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:43:36.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.865+0000 7f48d3b62b80 1 --2- 172.21.15.82:0/2757294961 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55db5d874380 0x55db5d874760 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f48b00138d0 tx=0x7f48b0007b10 comp rx=0 tx=0).stop 2023-09-23T09:43:36.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.866+0000 7f48d3b62b80 1 -- 172.21.15.82:0/2757294961 shutdown_connections 2023-09-23T09:43:36.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.866+0000 7f48d3b62b80 1 --2- 172.21.15.82:0/2757294961 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55db5d86ec40 0x55db5d86f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:43:36.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.866+0000 7f48d3b62b80 1 --2- 172.21.15.82:0/2757294961 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55db5d874380 0x55db5d874760 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:43:36.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.866+0000 7f48d3b62b80 1 --2- 172.21.15.82:0/2757294961 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55db5d874ca0 0x55db5d86e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:43:36.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.866+0000 7f48d3b62b80 1 -- 172.21.15.82:0/2757294961 >> 172.21.15.82:0/2757294961 conn(0x55db5d7e30e0 msgr2=0x55db5d869410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:43:36.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.866+0000 7f48d3b62b80 1 -- 172.21.15.82:0/2757294961 shutdown_connections 2023-09-23T09:43:36.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.866+0000 7f48d3b62b80 1 -- 172.21.15.82:0/2757294961 wait complete. 2023-09-23T09:43:36.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.867+0000 7f48d3b62b80 1 -- start start 2023-09-23T09:43:36.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.867+0000 7f48d3b62b80 1 Processor -- start 2023-09-23T09:43:36.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.868+0000 7f48d3b62b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55db5d86ec40 0x55db5d87ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:43:36.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.868+0000 7f48d3b62b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55db5d874380 0x55db5d877f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:43:36.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.868+0000 7f48d3b62b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55db5d874ca0 0x55db5d878600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:43:36.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.868+0000 7f48d3b62b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db5d7c0990 con 0x55db5d874ca0 2023-09-23T09:43:36.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.868+0000 7f48d3b62b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db5d75ebb0 con 0x55db5d874380 2023-09-23T09:43:36.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.868+0000 7f48d3b62b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db5d75e8b0 con 0x55db5d86ec40 2023-09-23T09:43:36.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.868+0000 7f48d3b62b80 10 client.0 _ll_register_callbacks cb 0x55db5d6a8a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:43:36.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.869+0000 7f48bd79a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55db5d86ec40 0x55db5d87ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:43:36.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.869+0000 7f48bd79a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55db5d86ec40 0x55db5d87ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:41294/0 (socket says 172.21.15.82:41294) 2023-09-23T09:43:36.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.869+0000 7f48bd79a700 1 -- 172.21.15.82:0/796126494 learned_addr learned my addr 172.21.15.82:0/796126494 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:43:36.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.869+0000 7f48bdf9b700 1 --2- 172.21.15.82:0/796126494 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55db5d874380 0x55db5d877f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:43:36.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.869+0000 7f48bd79a700 1 -- 172.21.15.82:0/796126494 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55db5d874380 msgr2=0x55db5d877f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:43:36.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.870+0000 7f48bd79a700 1 --2- 172.21.15.82:0/796126494 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55db5d874380 0x55db5d877f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:43:36.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.870+0000 7f48bd79a700 1 -- 172.21.15.82:0/796126494 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55db5d874ca0 msgr2=0x55db5d878600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:43:36.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.870+0000 7f48bd79a700 1 --2- 172.21.15.82:0/796126494 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55db5d874ca0 0x55db5d878600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:43:36.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.870+0000 7f48bd79a700 1 -- 172.21.15.82:0/796126494 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48b000f040 con 0x55db5d86ec40 2023-09-23T09:43:36.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.870+0000 7f48bd79a700 1 --2- 172.21.15.82:0/796126494 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55db5d86ec40 0x55db5d87ac90 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f48b0019000 tx=0x7f48b00079d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54a03ea4f661e819 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:43:36.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.870+0000 7f48a17fa700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T09:43:36.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.873+0000 7f48a17fa700 1 -- 172.21.15.82:0/796126494 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b0015e20 con 0x55db5d86ec40 2023-09-23T09:43:36.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.873+0000 7f48a17fa700 1 -- 172.21.15.82:0/796126494 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(169..169 src has 1..169) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f48b0017400 con 0x55db5d86ec40 2023-09-23T09:43:36.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.873+0000 7f48d3b62b80 1 -- 172.21.15.82:0/796126494 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55db5d83e1c0 con 0x55db5d86ec40 2023-09-23T09:43:36.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.877+0000 7f48a17fa700 1 -- 172.21.15.82:0/796126494 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=134) v2 ==== 24+0+0 (secure 0 0 0) 0x7f48b00175c0 con 0x55db5d86ec40 2023-09-23T09:43:36.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.877+0000 7f48d3b62b80 10 client.28033 fetch_fsmap learned FSMap version 134 2023-09-23T09:43:36.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.877+0000 7f48d3b62b80 1 -- 172.21.15.82:0/796126494 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=134,monmap=4+}) v3 -- 0x55db5d5ecde0 con 0x55db5d86ec40 2023-09-23T09:43:36.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.882+0000 7f48a17fa700 1 -- 172.21.15.82:0/796126494 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55db5d83e1c0 con 0x55db5d86ec40 2023-09-23T09:43:36.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.882+0000 7f48a17fa700 1 -- 172.21.15.82:0/796126494 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 134) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f48b002a990 con 0x55db5d86ec40 2023-09-23T09:43:36.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.882+0000 7f48d3b62b80 10 client.28033 fetch_fsmap finished waiting for FSMap version 134 2023-09-23T09:43:36.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.882+0000 7f48d3b62b80 10 client.28033 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:43:36.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.882+0000 7f48d3b62b80 20 client.28033 populate_metadata read hostname 'smithi082' 2023-09-23T09:43:36.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.882+0000 7f48d3b62b80 1 --2- 172.21.15.82:0/796126494 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55db5d888570 0x55db5d88a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:43:36.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.882+0000 7f48d3b62b80 4 client.28033 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:43:36.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.882+0000 7f48d3b62b80 1 -- 172.21.15.82:0/796126494 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55db5d766ba0 con 0x55db5d888570 2023-09-23T09:43:36.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.884+0000 7f48bdf9b700 1 --2- 172.21.15.82:0/796126494 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55db5d888570 0x55db5d88a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:43:36.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.885+0000 7f48bdf9b700 1 --2- 172.21.15.82:0/796126494 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55db5d888570 0x55db5d88a990 crc :-1 s=READY pgs=283 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=11733560ff9e6497 server_cookie=5137b333facec2f0 in_seq=0 out_seq=0 2023-09-23T09:43:36.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.885+0000 7f48a17fa700 10 client.28033 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:43:36.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.886+0000 7f48a17fa700 1 -- 172.21.15.82:0/796126494 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55db5d766ba0 con 0x55db5d888570 2023-09-23T09:43:36.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.886+0000 7f48a17fa700 10 client.28033 handle_command_reply: tid=0 2023-09-23T09:43:36.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.887+0000 7f48d3b62b80 1 client.28033 shutdown 2023-09-23T09:43:36.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.889+0000 7f48d3b62b80 1 -- 172.21.15.82:0/796126494 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55db5d86ec40 msgr2=0x55db5d87ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:43:36.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.889+0000 7f48d3b62b80 1 --2- 172.21.15.82:0/796126494 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55db5d86ec40 0x55db5d87ac90 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f48b0019000 tx=0x7f48b00079d0 comp rx=0 tx=0).stop 2023-09-23T09:43:36.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.889+0000 7f48d3b62b80 1 -- 172.21.15.82:0/796126494 shutdown_connections 2023-09-23T09:43:36.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.889+0000 7f48d3b62b80 1 --2- 172.21.15.82:0/796126494 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55db5d888570 0x55db5d88a990 crc :-1 s=READY pgs=283 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:43:36.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.889+0000 7f48d3b62b80 1 --2- 172.21.15.82:0/796126494 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55db5d874ca0 0x55db5d878600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:43:36.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.889+0000 7f48d3b62b80 1 --2- 172.21.15.82:0/796126494 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55db5d86ec40 0x55db5d87ac90 secure :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f48b0019000 tx=0x7f48b00079d0 comp rx=0 tx=0).stop 2023-09-23T09:43:36.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.889+0000 7f48d3b62b80 1 --2- 172.21.15.82:0/796126494 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55db5d874380 0x55db5d877f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:43:36.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.889+0000 7f48d3b62b80 1 -- 172.21.15.82:0/796126494 >> 172.21.15.82:0/796126494 conn(0x55db5d7e30e0 msgr2=0x55db5d863b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:43:36.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.889+0000 7f48a17fa700 0 client.28033 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:43:36.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.891+0000 7f48d3b62b80 1 -- 172.21.15.82:0/796126494 shutdown_connections 2023-09-23T09:43:36.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.891+0000 7f48d3b62b80 1 -- 172.21.15.82:0/796126494 wait complete. 2023-09-23T09:43:36.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.892+0000 7f48d3b62b80 20 client.28033 trim_cache size 0 max 16384 2023-09-23T09:43:36.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.919+0000 7f48d3b62b80 1 Processor -- start 2023-09-23T09:43:36.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.920+0000 7f48d3b62b80 1 -- start start 2023-09-23T09:43:36.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.920+0000 7f48d3b62b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55db5d874380 0x55db5d8785c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:43:36.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.920+0000 7f48d3b62b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55db5d874ca0 0x55db5d884a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:43:36.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.920+0000 7f48d3b62b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55db5d87a830 0x55db5d87ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:43:36.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.920+0000 7f48d3b62b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db5d642920 con 0x55db5d87a830 2023-09-23T09:43:36.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.920+0000 7f48d3b62b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db5d865c80 con 0x55db5d874380 2023-09-23T09:43:36.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.920+0000 7f48d3b62b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db5d8794d0 con 0x55db5d874ca0 2023-09-23T09:43:36.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.928+0000 7f48bdf9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55db5d874ca0 0x55db5d884a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:43:36.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.928+0000 7f48bdf9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55db5d874ca0 0x55db5d884a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:41308/0 (socket says 172.21.15.82:41308) 2023-09-23T09:43:36.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.928+0000 7f48bdf9b700 1 -- 172.21.15.82:0/657664037 learned_addr learned my addr 172.21.15.82:0/657664037 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:43:36.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.930+0000 7f48bd79a700 1 --2- 172.21.15.82:0/657664037 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55db5d874380 0x55db5d8785c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:43:36.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.930+0000 7f48bd79a700 1 --2- 172.21.15.82:0/657664037 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55db5d87a830 0x55db5d87ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:43:36.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.934+0000 7f48bd79a700 1 -- 172.21.15.82:0/657664037 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55db5d874ca0 msgr2=0x55db5d884a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:43:36.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.934+0000 7f48bd79a700 1 --2- 172.21.15.82:0/657664037 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55db5d874ca0 0x55db5d884a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:43:36.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.934+0000 7f48bd79a700 1 -- 172.21.15.82:0/657664037 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55db5d87a830 msgr2=0x55db5d87ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:43:36.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.934+0000 7f48bd79a700 1 --2- 172.21.15.82:0/657664037 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55db5d87a830 0x55db5d87ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:43:36.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.934+0000 7f48bd79a700 1 -- 172.21.15.82:0/657664037 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55db5d5d5c60 con 0x55db5d874380 2023-09-23T09:43:36.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.936+0000 7f48bd79a700 1 --2- 172.21.15.82:0/657664037 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55db5d874380 0x55db5d8785c0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f48b0008000 tx=0x7f48b00079d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=60fcbe51de7463c9 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:43:36.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.944+0000 7f48acff9700 1 -- 172.21.15.82:0/657664037 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b0007b80 con 0x55db5d874380 2023-09-23T09:43:36.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.944+0000 7f48acff9700 1 -- 172.21.15.82:0/657664037 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f48b002ae90 con 0x55db5d874380 2023-09-23T09:43:36.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.944+0000 7f48acff9700 1 -- 172.21.15.82:0/657664037 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b002a6d0 con 0x55db5d874380 2023-09-23T09:43:36.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.945+0000 7f48d3b62b80 1 -- 172.21.15.82:0/657664037 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55db5d874380 msgr2=0x55db5d8785c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:43:36.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.945+0000 7f48d3b62b80 1 --2- 172.21.15.82:0/657664037 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55db5d874380 0x55db5d8785c0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f48b0008000 tx=0x7f48b00079d0 comp rx=0 tx=0).stop 2023-09-23T09:43:36.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.947+0000 7f48d3b62b80 1 -- 172.21.15.82:0/657664037 shutdown_connections 2023-09-23T09:43:36.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.947+0000 7f48d3b62b80 1 --2- 172.21.15.82:0/657664037 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55db5d87a830 0x55db5d87ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:43:36.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.947+0000 7f48d3b62b80 1 --2- 172.21.15.82:0/657664037 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55db5d874380 0x55db5d8785c0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:43:36.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.947+0000 7f48d3b62b80 1 --2- 172.21.15.82:0/657664037 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55db5d874ca0 0x55db5d884a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:43:36.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.947+0000 7f48d3b62b80 1 -- 172.21.15.82:0/657664037 >> 172.21.15.82:0/657664037 conn(0x55db5d7e30e0 msgr2=0x55db5d862b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:43:36.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.952+0000 7f48d3b62b80 1 -- 172.21.15.82:0/657664037 shutdown_connections 2023-09-23T09:43:36.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.953+0000 7f48d3b62b80 1 -- 172.21.15.82:0/657664037 wait complete. 2023-09-23T09:43:36.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.953+0000 7f48d3b62b80 1 -- start start 2023-09-23T09:43:36.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.954+0000 7f48d3b62b80 1 Processor -- start 2023-09-23T09:43:36.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.954+0000 7f48d3b62b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55db5d874380 0x55db5d87f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:43:36.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.954+0000 7f48d3b62b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55db5d874ca0 0x55db5d8701f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:43:36.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.954+0000 7f48d3b62b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55db5d87a830 0x55db5d870790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:43:36.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.954+0000 7f48d3b62b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db5d870e60 con 0x55db5d87a830 2023-09-23T09:43:36.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.954+0000 7f48d3b62b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db5d870fd0 con 0x55db5d874ca0 2023-09-23T09:43:36.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.954+0000 7f48d3b62b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db5d8d8380 con 0x55db5d874380 2023-09-23T09:43:36.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.954+0000 7f48d3b62b80 10 client.0 _ll_register_callbacks cb 0x7f48b00078b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:43:36.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.955+0000 7f48bdf9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55db5d874ca0 0x55db5d8701f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:43:36.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.955+0000 7f48bdf9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55db5d874ca0 0x55db5d8701f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:40782/0 (socket says 172.21.15.82:40782) 2023-09-23T09:43:36.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.955+0000 7f48bd79a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55db5d874380 0x55db5d87f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:43:36.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.955+0000 7f48bdf9b700 1 -- 172.21.15.82:0/562238519 learned_addr learned my addr 172.21.15.82:0/562238519 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:43:36.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.956+0000 7f48bd79a700 1 -- 172.21.15.82:0/562238519 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55db5d874ca0 msgr2=0x55db5d8701f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:43:36.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.956+0000 7f48bd79a700 1 --2- 172.21.15.82:0/562238519 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55db5d874ca0 0x55db5d8701f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:43:36.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.956+0000 7f48bd79a700 1 -- 172.21.15.82:0/562238519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55db5d87a830 msgr2=0x55db5d870790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:43:36.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.956+0000 7f48bd79a700 1 --2- 172.21.15.82:0/562238519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55db5d87a830 0x55db5d870790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:43:36.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.956+0000 7f48bd79a700 1 -- 172.21.15.82:0/562238519 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55db5d5ecde0 con 0x55db5d874380 2023-09-23T09:43:36.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.957+0000 7f48bd79a700 1 --2- 172.21.15.82:0/562238519 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55db5d874380 0x55db5d87f990 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f48b0015860 tx=0x7f48b0015980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f375cf45a9224674 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:43:36.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.957+0000 7f48a17fa700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T09:43:36.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.957+0000 7f48a17fa700 1 -- 172.21.15.82:0/562238519 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b0004c40 con 0x55db5d874380 2023-09-23T09:43:36.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.957+0000 7f48a17fa700 1 -- 172.21.15.82:0/562238519 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(169..169 src has 1..169) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f48b0039020 con 0x55db5d874380 2023-09-23T09:43:36.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.957+0000 7f48d3b62b80 1 -- 172.21.15.82:0/562238519 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55db5d8618b0 con 0x55db5d874380 2023-09-23T09:43:36.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.958+0000 7f48a17fa700 1 -- 172.21.15.82:0/562238519 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=134) v2 ==== 24+0+0 (secure 0 0 0) 0x7f48b0004da0 con 0x55db5d874380 2023-09-23T09:43:36.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.958+0000 7f48d3b62b80 10 client.28039 fetch_fsmap learned FSMap version 134 2023-09-23T09:43:36.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.958+0000 7f48d3b62b80 1 -- 172.21.15.82:0/562238519 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=134,monmap=4+}) v3 -- 0x55db5d613250 con 0x55db5d874380 2023-09-23T09:43:36.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.959+0000 7f48a17fa700 1 -- 172.21.15.82:0/562238519 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55db5d8618b0 con 0x55db5d874380 2023-09-23T09:43:36.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.959+0000 7f48a17fa700 1 -- 172.21.15.82:0/562238519 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 134) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f48b0034960 con 0x55db5d874380 2023-09-23T09:43:36.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.959+0000 7f48d3b62b80 10 client.28039 fetch_fsmap finished waiting for FSMap version 134 2023-09-23T09:43:36.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.959+0000 7f48d3b62b80 10 client.28039 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:43:36.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.959+0000 7f48d3b62b80 20 client.28039 populate_metadata read hostname 'smithi082' 2023-09-23T09:43:36.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.959+0000 7f48d3b62b80 1 --2- 172.21.15.82:0/562238519 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55db5d8d9670 0x55db5d8d9a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:43:36.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.959+0000 7f48d3b62b80 4 client.28039 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:43:36.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.959+0000 7f48d3b62b80 1 -- 172.21.15.82:0/562238519 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55db5d7b9970 con 0x55db5d8d9670 2023-09-23T09:43:36.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.962+0000 7f48bdf9b700 1 --2- 172.21.15.82:0/562238519 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55db5d8d9670 0x55db5d8d9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:43:36.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.966+0000 7f48bdf9b700 1 --2- 172.21.15.82:0/562238519 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55db5d8d9670 0x55db5d8d9a80 crc :-1 s=READY pgs=284 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3867b3f3df109db0 server_cookie=5d97827a95920f28 in_seq=0 out_seq=0 2023-09-23T09:43:36.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.967+0000 7f48a17fa700 10 client.28039 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:43:36.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.968+0000 7f48a17fa700 1 -- 172.21.15.82:0/562238519 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55db5d7b9970 con 0x55db5d8d9670 2023-09-23T09:43:36.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.968+0000 7f48a17fa700 10 client.28039 handle_command_reply: tid=0 2023-09-23T09:43:36.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.968+0000 7f48d3b62b80 1 client.28039 shutdown 2023-09-23T09:43:36.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.968+0000 7f48d3b62b80 1 -- 172.21.15.82:0/562238519 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55db5d874380 msgr2=0x55db5d87f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:43:36.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.968+0000 7f48d3b62b80 1 --2- 172.21.15.82:0/562238519 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55db5d874380 0x55db5d87f990 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f48b0015860 tx=0x7f48b0015980 comp rx=0 tx=0).stop 2023-09-23T09:43:36.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.969+0000 7f48d3b62b80 1 -- 172.21.15.82:0/562238519 shutdown_connections 2023-09-23T09:43:36.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.969+0000 7f48d3b62b80 1 --2- 172.21.15.82:0/562238519 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55db5d8d9670 0x55db5d8d9a80 crc :-1 s=READY pgs=284 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:43:36.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.969+0000 7f48d3b62b80 1 --2- 172.21.15.82:0/562238519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55db5d87a830 0x55db5d870790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:43:36.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.969+0000 7f48d3b62b80 1 --2- 172.21.15.82:0/562238519 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55db5d874380 0x55db5d87f990 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:43:36.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.969+0000 7f48d3b62b80 1 --2- 172.21.15.82:0/562238519 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55db5d874ca0 0x55db5d8701f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:43:36.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.969+0000 7f48d3b62b80 1 -- 172.21.15.82:0/562238519 >> 172.21.15.82:0/562238519 conn(0x55db5d7e30e0 msgr2=0x55db5d884a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:43:36.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.969+0000 7f48a17fa700 0 client.28039 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:43:36.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.969+0000 7f48d3b62b80 1 -- 172.21.15.82:0/562238519 shutdown_connections 2023-09-23T09:43:36.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.969+0000 7f48d3b62b80 1 -- 172.21.15.82:0/562238519 wait complete. 2023-09-23T09:43:36.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.969+0000 7f48d3b62b80 20 client.28039 trim_cache size 0 max 16384 2023-09-23T09:43:36.975 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:43:36.975 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-23T09:43:36.975 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:43:36.975 INFO:teuthology.orchestra.run.smithi082.stdout: "d9e62ab8-1468-4fb0-a9fe-61bed13e954b": { 2023-09-23T09:43:36.976 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:43:36.976 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "d9e62ab8-1468-4fb0-a9fe-61bed13e954b", 2023-09-23T09:43:36.976 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:43:36.976 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:43:36.976 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:43:36.976 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:43:36.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.980+0000 7f48c01ff700 1 -- 172.21.15.82:0/4032699988 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f48a40a01c0 msgr2=0x7f48a40a2680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:43:36.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.980+0000 7f48c01ff700 1 --2- 172.21.15.82:0/4032699988 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f48a40a01c0 0x7f48a40a2680 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f48b4095370 tx=0x7f48b4011f90 comp rx=0 tx=0).stop 2023-09-23T09:43:36.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.980+0000 7f48c01ff700 1 -- 172.21.15.82:0/4032699988 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48b81118a0 msgr2=0x7f48b81a18e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:43:36.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.980+0000 7f48c01ff700 1 --2- 172.21.15.82:0/4032699988 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48b81118a0 0x7f48b81a18e0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f48b400b480 tx=0x7f48b400b840 comp rx=0 tx=0).stop 2023-09-23T09:43:36.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.981+0000 7f48c01ff700 1 -- 172.21.15.82:0/4032699988 shutdown_connections 2023-09-23T09:43:36.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.981+0000 7f48c01ff700 1 --2- 172.21.15.82:0/4032699988 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f48a40a01c0 0x7f48a40a2680 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:43:36.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.981+0000 7f48c01ff700 1 --2- 172.21.15.82:0/4032699988 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48b81118a0 0x7f48b81a18e0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:43:36.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.981+0000 7f48c01ff700 1 --2- 172.21.15.82:0/4032699988 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48b8072cc0 0x7f48b819cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:43:36.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.981+0000 7f48c01ff700 1 --2- 172.21.15.82:0/4032699988 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f48b80735e0 0x7f48b819d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:43:36.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.981+0000 7f48c01ff700 1 -- 172.21.15.82:0/4032699988 >> 172.21.15.82:0/4032699988 conn(0x7f48b80fc380 msgr2=0x7f48b80fcff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:43:36.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.985+0000 7f48c01ff700 1 -- 172.21.15.82:0/4032699988 shutdown_connections 2023-09-23T09:43:36.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:43:36.986+0000 7f48c01ff700 1 -- 172.21.15.82:0/4032699988 wait complete. 2023-09-23T09:43:37.028 INFO:tasks.cephfs.filesystem:scrub status for tag:d9e62ab8-1468-4fb0-a9fe-61bed13e954b - {'path': '/', 'tag': 'd9e62ab8-1468-4fb0-a9fe-61bed13e954b', 'options': 'recursive,force'} 2023-09-23T09:43:37.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:43:37 smithi135 ceph-mon[99205]: pgmap v1484: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 1.9 MiB/s wr, 250 op/s 2023-09-23T09:43:37.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:43:37 smithi082 ceph-mon[97694]: pgmap v1484: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 1.9 MiB/s wr, 250 op/s 2023-09-23T09:43:37.396 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:43:37 smithi161 ceph-mon[99580]: pgmap v1484: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 1.9 MiB/s wr, 250 op/s 2023-09-23T09:43:38.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:43:38 smithi161 ceph-mon[99580]: pgmap v1485: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 1.5 MiB/s wr, 201 op/s 2023-09-23T09:43:38.810 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:43:38 smithi135 ceph-mon[99205]: pgmap v1485: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 1.5 MiB/s wr, 201 op/s 2023-09-23T09:43:38.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:43:38 smithi082 ceph-mon[97694]: pgmap v1485: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 1.5 MiB/s wr, 201 op/s 2023-09-23T09:43:41.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:43:40 smithi135 ceph-mon[99205]: pgmap v1486: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 2.2 MiB/s wr, 279 op/s 2023-09-23T09:43:41.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:43:40 smithi082 ceph-mon[97694]: pgmap v1486: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 2.2 MiB/s wr, 279 op/s 2023-09-23T09:43:41.396 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:43:40 smithi161 ceph-mon[99580]: pgmap v1486: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 2.2 MiB/s wr, 279 op/s 2023-09-23T09:43:43.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:43:42 smithi135 ceph-mon[99205]: pgmap v1487: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 2.3 MiB/s wr, 300 op/s 2023-09-23T09:43:43.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:43:42 smithi082 ceph-mon[97694]: pgmap v1487: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 2.3 MiB/s wr, 300 op/s 2023-09-23T09:43:43.396 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:43:42 smithi161 ceph-mon[99580]: pgmap v1487: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 2.3 MiB/s wr, 300 op/s 2023-09-23T09:43:45.310 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:43:44 smithi135 ceph-mon[99205]: pgmap v1488: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 1.9 MiB/s wr, 247 op/s 2023-09-23T09:43:45.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:43:44 smithi082 ceph-mon[97694]: pgmap v1488: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 1.9 MiB/s wr, 247 op/s 2023-09-23T09:43:45.396 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:43:44 smithi161 ceph-mon[99580]: pgmap v1488: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 1.9 MiB/s wr, 247 op/s 2023-09-23T09:43:47.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:43:46 smithi135 ceph-mon[99205]: pgmap v1489: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 2.4 MiB/s wr, 312 op/s 2023-09-23T09:43:47.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:43:46 smithi082 ceph-mon[97694]: pgmap v1489: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 2.4 MiB/s wr, 312 op/s 2023-09-23T09:43:47.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:43:46 smithi161 ceph-mon[99580]: pgmap v1489: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 2.4 MiB/s wr, 312 op/s 2023-09-23T09:43:48.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:43:48 smithi161 ceph-mon[99580]: pgmap v1490: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 2.0 MiB/s wr, 262 op/s 2023-09-23T09:43:48.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:43:48 smithi135 ceph-mon[99205]: pgmap v1490: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 2.0 MiB/s wr, 262 op/s 2023-09-23T09:43:48.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:43:48 smithi082 ceph-mon[97694]: pgmap v1490: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 2.0 MiB/s wr, 262 op/s 2023-09-23T09:43:51.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:43:50 smithi135 ceph-mon[99205]: pgmap v1491: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 2.2 MiB/s wr, 291 op/s 2023-09-23T09:43:51.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:43:50 smithi082 ceph-mon[97694]: pgmap v1491: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 2.2 MiB/s wr, 291 op/s 2023-09-23T09:43:51.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:43:50 smithi161 ceph-mon[99580]: pgmap v1491: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 2.2 MiB/s wr, 291 op/s 2023-09-23T09:43:53.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:43:52 smithi135 ceph-mon[99205]: pgmap v1492: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 1.8 MiB/s wr, 240 op/s 2023-09-23T09:43:53.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:43:52 smithi082 ceph-mon[97694]: pgmap v1492: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 1.8 MiB/s wr, 240 op/s 2023-09-23T09:43:53.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:43:52 smithi161 ceph-mon[99580]: pgmap v1492: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 1.8 MiB/s wr, 240 op/s 2023-09-23T09:43:55.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:43:54 smithi135 ceph-mon[99205]: pgmap v1493: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 1.2 MiB/s wr, 156 op/s 2023-09-23T09:43:55.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:43:54 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:43:55.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:43:54 smithi082 ceph-mon[97694]: pgmap v1493: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 1.2 MiB/s wr, 156 op/s 2023-09-23T09:43:55.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:43:54 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:43:55.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:43:54 smithi161 ceph-mon[99580]: pgmap v1493: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 1.2 MiB/s wr, 156 op/s 2023-09-23T09:43:55.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:43:54 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:43:56.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:43:55 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:43:56.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:43:55 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:43:56.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:43:55 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:43:56.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:43:55 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:43:56.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:43:55 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:43:56.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:43:55 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:43:56.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:43:55 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:43:56.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:43:55 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:43:56.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:43:55 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:43:57.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:43:57 smithi135 ceph-mon[99205]: pgmap v1494: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 1.7 MiB/s wr, 225 op/s 2023-09-23T09:43:57.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:43:57 smithi082 ceph-mon[97694]: pgmap v1494: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 1.7 MiB/s wr, 225 op/s 2023-09-23T09:43:57.646 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:43:57 smithi161 ceph-mon[99580]: pgmap v1494: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 1.7 MiB/s wr, 225 op/s 2023-09-23T09:43:58.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:43:58 smithi161 ceph-mon[99580]: pgmap v1495: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 1.3 MiB/s wr, 170 op/s 2023-09-23T09:43:58.810 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:43:58 smithi135 ceph-mon[99205]: pgmap v1495: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 1.3 MiB/s wr, 170 op/s 2023-09-23T09:43:58.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:43:58 smithi082 ceph-mon[97694]: pgmap v1495: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 1.3 MiB/s wr, 170 op/s 2023-09-23T09:44:01.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:44:00 smithi135 ceph-mon[99205]: pgmap v1496: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 1.5 MiB/s wr, 202 op/s 2023-09-23T09:44:01.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:44:00 smithi082 ceph-mon[97694]: pgmap v1496: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 1.5 MiB/s wr, 202 op/s 2023-09-23T09:44:01.396 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:44:00 smithi161 ceph-mon[99580]: pgmap v1496: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 1.5 MiB/s wr, 202 op/s 2023-09-23T09:44:03.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:44:02 smithi135 ceph-mon[99205]: pgmap v1497: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.5 MiB/s wr, 196 op/s 2023-09-23T09:44:03.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:44:02 smithi082 ceph-mon[97694]: pgmap v1497: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.5 MiB/s wr, 196 op/s 2023-09-23T09:44:03.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:44:02 smithi161 ceph-mon[99580]: pgmap v1497: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.5 MiB/s wr, 196 op/s 2023-09-23T09:44:05.310 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:44:04 smithi135 ceph-mon[99205]: pgmap v1498: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 MiB/s wr, 161 op/s 2023-09-23T09:44:05.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:44:04 smithi082 ceph-mon[97694]: pgmap v1498: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 MiB/s wr, 161 op/s 2023-09-23T09:44:05.396 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:44:04 smithi161 ceph-mon[99580]: pgmap v1498: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 MiB/s wr, 161 op/s 2023-09-23T09:44:07.030 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:44:07.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:44:07 smithi135 ceph-mon[99205]: pgmap v1499: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.7 MiB/s wr, 242 op/s 2023-09-23T09:44:07.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:44:07 smithi135 ceph-mon[99205]: osdmap e170: 12 total, 12 up, 12 in 2023-09-23T09:44:07.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:44:07 smithi082 ceph-mon[97694]: pgmap v1499: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.7 MiB/s wr, 242 op/s 2023-09-23T09:44:07.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:44:07 smithi082 ceph-mon[97694]: osdmap e170: 12 total, 12 up, 12 in 2023-09-23T09:44:07.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:44:07 smithi161 ceph-mon[99580]: pgmap v1499: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.7 MiB/s wr, 242 op/s 2023-09-23T09:44:07.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:44:07 smithi161 ceph-mon[99580]: osdmap e170: 12 total, 12 up, 12 in 2023-09-23T09:44:07.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.405+0000 7f692ddff700 1 -- 172.21.15.82:0/2451682423 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f692810c260 msgr2=0x7f6928113de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:44:07.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.405+0000 7f692ddff700 1 --2- 172.21.15.82:0/2451682423 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f692810c260 0x7f6928113de0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f69200099c0 tx=0x7f6920009cd0 comp rx=0 tx=0).stop 2023-09-23T09:44:07.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.405+0000 7f692ddff700 1 -- 172.21.15.82:0/2451682423 shutdown_connections 2023-09-23T09:44:07.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.405+0000 7f692ddff700 1 --2- 172.21.15.82:0/2451682423 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f692810c260 0x7f6928113de0 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:44:07.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.405+0000 7f692ddff700 1 --2- 172.21.15.82:0/2451682423 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f69281079d0 0x7f6928107db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:44:07.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.405+0000 7f692ddff700 1 --2- 172.21.15.82:0/2451682423 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6928108380 0x7f692810bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:44:07.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.405+0000 7f692ddff700 1 -- 172.21.15.82:0/2451682423 >> 172.21.15.82:0/2451682423 conn(0x7f6928076650 msgr2=0x7f6928078a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:44:07.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.406+0000 7f692ddff700 1 -- 172.21.15.82:0/2451682423 shutdown_connections 2023-09-23T09:44:07.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.406+0000 7f692ddff700 1 -- 172.21.15.82:0/2451682423 wait complete. 2023-09-23T09:44:07.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.407+0000 7f692ddff700 1 Processor -- start 2023-09-23T09:44:07.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.408+0000 7f692ddff700 1 -- start start 2023-09-23T09:44:07.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.408+0000 7f692ddff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f69281079d0 0x7f692819cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:44:07.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.408+0000 7f692ddff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f692810c260 0x7f692819d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:44:07.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.408+0000 7f692ddff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69281a1920 0x7f69281a1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:44:07.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.408+0000 7f692ddff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69281a23a0 con 0x7f692810c260 2023-09-23T09:44:07.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.408+0000 7f692ddff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69281a2510 con 0x7f69281079d0 2023-09-23T09:44:07.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.408+0000 7f692ddff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69281a26d0 con 0x7f69281a1920 2023-09-23T09:44:07.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.409+0000 7f6926ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f692810c260 0x7f692819d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:44:07.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.409+0000 7f6926ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f692810c260 0x7f692819d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54804/0 (socket says 172.21.15.82:54804) 2023-09-23T09:44:07.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.409+0000 7f6926ffd700 1 -- 172.21.15.82:0/3949557873 learned_addr learned my addr 172.21.15.82:0/3949557873 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:44:07.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.410+0000 7f6926ffd700 1 -- 172.21.15.82:0/3949557873 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69281a1920 msgr2=0x7f69281a1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:44:07.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.410+0000 7f6926ffd700 1 --2- 172.21.15.82:0/3949557873 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69281a1920 0x7f69281a1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:44:07.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.410+0000 7f6926ffd700 1 -- 172.21.15.82:0/3949557873 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f69281079d0 msgr2=0x7f692819cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:44:07.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.410+0000 7f6926ffd700 1 --2- 172.21.15.82:0/3949557873 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f69281079d0 0x7f692819cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:44:07.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.410+0000 7f6926ffd700 1 -- 172.21.15.82:0/3949557873 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69200095f0 con 0x7f692810c260 2023-09-23T09:44:07.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.410+0000 7f6926ffd700 1 --2- 172.21.15.82:0/3949557873 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f692810c260 0x7f692819d4c0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f691c00d980 tx=0x7f691c00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:44:07.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.411+0000 7f6924ff9700 1 -- 172.21.15.82:0/3949557873 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691c009b40 con 0x7f692810c260 2023-09-23T09:44:07.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.411+0000 7f6924ff9700 1 -- 172.21.15.82:0/3949557873 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f691c00de60 con 0x7f692810c260 2023-09-23T09:44:07.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.411+0000 7f6924ff9700 1 -- 172.21.15.82:0/3949557873 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691c00f620 con 0x7f692810c260 2023-09-23T09:44:07.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.411+0000 7f692ddff700 1 -- 172.21.15.82:0/3949557873 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69281a9c30 con 0x7f692810c260 2023-09-23T09:44:07.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.411+0000 7f692ddff700 1 -- 172.21.15.82:0/3949557873 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69281aa0c0 con 0x7f692810c260 2023-09-23T09:44:07.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.418+0000 7f69417e6b80 1 Processor -- start 2023-09-23T09:44:07.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.419+0000 7f69417e6b80 1 -- start start 2023-09-23T09:44:07.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.419+0000 7f69417e6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561e08d58380 0x561e08d58760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:44:07.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.419+0000 7f69417e6b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561e08d58ca0 0x561e08d52700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:44:07.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.419+0000 7f69417e6b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e08d52c40 0x561e08d530a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:44:07.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.419+0000 7f69417e6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e08cba7b0 con 0x561e08d58380 2023-09-23T09:44:07.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.419+0000 7f69417e6b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e08cab780 con 0x561e08d52c40 2023-09-23T09:44:07.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.419+0000 7f69417e6b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e08ca90a0 con 0x561e08d58ca0 2023-09-23T09:44:07.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.419+0000 7f6924ff9700 1 -- 172.21.15.82:0/3949557873 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f691c010460 con 0x7f692810c260 2023-09-23T09:44:07.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.422+0000 7f6924ff9700 1 --2- 172.21.15.82:0/3949557873 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f69100a01c0 0x7f69100a2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:44:07.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.422+0000 7f6924ff9700 1 -- 172.21.15.82:0/3949557873 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 8557+0+0 (secure 0 0 0) 0x7f691c0cb2a0 con 0x7f692810c260 2023-09-23T09:44:07.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.422+0000 7f6926ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e08d52c40 0x561e08d530a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:44:07.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.423+0000 7f6927fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561e08d58380 0x561e08d58760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:44:07.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.423+0000 7f6927fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561e08d58380 0x561e08d58760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54808/0 (socket says 172.21.15.82:54808) 2023-09-23T09:44:07.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.423+0000 7f6927fff700 1 -- 172.21.15.82:0/4130679941 learned_addr learned my addr 172.21.15.82:0/4130679941 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:44:07.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.427+0000 7f6927fff700 1 --2- 172.21.15.82:0/3949557873 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f69100a01c0 0x7f69100a2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:44:07.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.427+0000 7f6927fff700 1 -- 172.21.15.82:0/4130679941 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561e08d58ca0 msgr2=0x561e08d52700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:44:07.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.427+0000 7f6927fff700 1 --2- 172.21.15.82:0/4130679941 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561e08d58ca0 0x561e08d52700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:44:07.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.427+0000 7f6927fff700 1 -- 172.21.15.82:0/4130679941 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e08d52c40 msgr2=0x561e08d530a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:44:07.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.427+0000 7f6927fff700 1 --2- 172.21.15.82:0/4130679941 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e08d52c40 0x561e08d530a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:44:07.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.427+0000 7f6927fff700 1 -- 172.21.15.82:0/4130679941 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561e08b24630 con 0x561e08d58380 2023-09-23T09:44:07.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.428+0000 7f6927fff700 1 --2- 172.21.15.82:0/4130679941 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561e08d58380 0x561e08d58760 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f6920006010 tx=0x7f692000b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f54fffa0d8f3154e server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:44:07.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.428+0000 7f6927fff700 1 --2- 172.21.15.82:0/3949557873 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f69100a01c0 0x7f69100a2680 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f692002b000 tx=0x7f6920029000 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:44:07.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.428+0000 7f690dffb700 1 -- 172.21.15.82:0/4130679941 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6920003a20 con 0x561e08d58380 2023-09-23T09:44:07.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.428+0000 7f690dffb700 1 -- 172.21.15.82:0/4130679941 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6920004010 con 0x561e08d58380 2023-09-23T09:44:07.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.428+0000 7f690dffb700 1 -- 172.21.15.82:0/4130679941 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f692000f940 con 0x561e08d58380 2023-09-23T09:44:07.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.429+0000 7f69417e6b80 1 -- 172.21.15.82:0/4130679941 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561e08d58380 msgr2=0x561e08d58760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:44:07.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.429+0000 7f69417e6b80 1 --2- 172.21.15.82:0/4130679941 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561e08d58380 0x561e08d58760 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f6920006010 tx=0x7f692000b810 comp rx=0 tx=0).stop 2023-09-23T09:44:07.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.430+0000 7f69417e6b80 1 -- 172.21.15.82:0/4130679941 shutdown_connections 2023-09-23T09:44:07.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.430+0000 7f69417e6b80 1 --2- 172.21.15.82:0/4130679941 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e08d52c40 0x561e08d530a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:44:07.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.430+0000 7f69417e6b80 1 --2- 172.21.15.82:0/4130679941 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561e08d58380 0x561e08d58760 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:44:07.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.430+0000 7f69417e6b80 1 --2- 172.21.15.82:0/4130679941 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561e08d58ca0 0x561e08d52700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:44:07.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.430+0000 7f69417e6b80 1 -- 172.21.15.82:0/4130679941 >> 172.21.15.82:0/4130679941 conn(0x561e08cc70e0 msgr2=0x561e08d4d410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:44:07.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.430+0000 7f69417e6b80 1 -- 172.21.15.82:0/4130679941 shutdown_connections 2023-09-23T09:44:07.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.430+0000 7f69417e6b80 1 -- 172.21.15.82:0/4130679941 wait complete. 2023-09-23T09:44:07.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.431+0000 7f69417e6b80 1 -- start start 2023-09-23T09:44:07.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.431+0000 7f69417e6b80 1 Processor -- start 2023-09-23T09:44:07.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.432+0000 7f69417e6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561e08d52c40 0x561e08d5bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:44:07.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.432+0000 7f69417e6b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561e08d58380 0x561e08d5c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:44:07.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.432+0000 7f69417e6b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e08d58ca0 0x561e08d5ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:44:07.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.432+0000 7f69417e6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e08ca4990 con 0x561e08d52c40 2023-09-23T09:44:07.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.432+0000 7f69417e6b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e08c42bb0 con 0x561e08d58ca0 2023-09-23T09:44:07.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.432+0000 7f69417e6b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e08c428b0 con 0x561e08d58380 2023-09-23T09:44:07.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.432+0000 7f69417e6b80 10 client.0 _ll_register_callbacks cb 0x561e08b8ca80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:44:07.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.433+0000 7f6926ffd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561e08d58380 0x561e08d5c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:44:07.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.433+0000 7f6926ffd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561e08d58380 0x561e08d5c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:38088/0 (socket says 172.21.15.82:38088) 2023-09-23T09:44:07.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.433+0000 7f6926ffd700 1 -- 172.21.15.82:0/3514575982 learned_addr learned my addr 172.21.15.82:0/3514575982 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:44:07.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.434+0000 7f6926ffd700 1 -- 172.21.15.82:0/3514575982 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e08d58ca0 msgr2=0x561e08d5ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:44:07.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.434+0000 7f6926ffd700 1 --2- 172.21.15.82:0/3514575982 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e08d58ca0 0x561e08d5ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:44:07.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.434+0000 7f6926ffd700 1 -- 172.21.15.82:0/3514575982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561e08d52c40 msgr2=0x561e08d5bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:44:07.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.434+0000 7f6926ffd700 1 --2- 172.21.15.82:0/3514575982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561e08d52c40 0x561e08d5bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:44:07.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.434+0000 7f6926ffd700 1 -- 172.21.15.82:0/3514575982 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6928114620 con 0x561e08d58380 2023-09-23T09:44:07.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.436+0000 7f6926ffd700 1 --2- 172.21.15.82:0/3514575982 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561e08d58380 0x561e08d5c520 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f691c00d950 tx=0x7f691c098930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c494992bdd58e334 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:44:07.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.436+0000 7f6906ffd700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T09:44:07.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.437+0000 7f6906ffd700 1 -- 172.21.15.82:0/3514575982 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691c0cb070 con 0x561e08d58380 2023-09-23T09:44:07.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.437+0000 7f6906ffd700 1 -- 172.21.15.82:0/3514575982 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(170..170 src has 1..170) v4 ==== 8557+0+0 (secure 0 0 0) 0x7f691c010910 con 0x561e08d58380 2023-09-23T09:44:07.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.437+0000 7f69417e6b80 1 -- 172.21.15.82:0/3514575982 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561e08d221c0 con 0x561e08d58380 2023-09-23T09:44:07.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.440+0000 7f6906ffd700 1 -- 172.21.15.82:0/3514575982 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=134) v2 ==== 24+0+0 (secure 0 0 0) 0x7f691c098b90 con 0x561e08d58380 2023-09-23T09:44:07.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.441+0000 7f69417e6b80 10 client.28045 fetch_fsmap learned FSMap version 134 2023-09-23T09:44:07.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.441+0000 7f69417e6b80 1 -- 172.21.15.82:0/3514575982 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=134,monmap=4+}) v3 -- 0x561e08ad0de0 con 0x561e08d58380 2023-09-23T09:44:07.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.445+0000 7f6906ffd700 1 -- 172.21.15.82:0/3514575982 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x561e08d221c0 con 0x561e08d58380 2023-09-23T09:44:07.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.445+0000 7f6906ffd700 1 -- 172.21.15.82:0/3514575982 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 134) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f691c0a02b0 con 0x561e08d58380 2023-09-23T09:44:07.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.445+0000 7f69417e6b80 10 client.28045 fetch_fsmap finished waiting for FSMap version 134 2023-09-23T09:44:07.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.445+0000 7f69417e6b80 10 client.28045 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:44:07.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.445+0000 7f69417e6b80 20 client.28045 populate_metadata read hostname 'smithi082' 2023-09-23T09:44:07.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.445+0000 7f69417e6b80 1 --2- 172.21.15.82:0/3514575982 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x561e08d6c700 0x561e08d6eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:44:07.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.445+0000 7f69417e6b80 4 client.28045 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:44:07.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.445+0000 7f69417e6b80 1 -- 172.21.15.82:0/3514575982 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561e08c4aba0 con 0x561e08d6c700 2023-09-23T09:44:07.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.453+0000 7f69277fe700 1 --2- 172.21.15.82:0/3514575982 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x561e08d6c700 0x561e08d6eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:44:07.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.476+0000 7f69277fe700 1 --2- 172.21.15.82:0/3514575982 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x561e08d6c700 0x561e08d6eb20 crc :-1 s=READY pgs=285 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86f0bd863294b0b1 server_cookie=8f2c86cdabdc7e4e in_seq=0 out_seq=0 2023-09-23T09:44:07.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.476+0000 7f6906ffd700 10 client.28045 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:44:07.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.486+0000 7f6906ffd700 1 -- 172.21.15.82:0/3514575982 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x561e08c4aba0 con 0x561e08d6c700 2023-09-23T09:44:07.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.486+0000 7f6906ffd700 10 client.28045 handle_command_reply: tid=0 2023-09-23T09:44:07.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.486+0000 7f69417e6b80 1 client.28045 shutdown 2023-09-23T09:44:07.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.487+0000 7f69417e6b80 1 -- 172.21.15.82:0/3514575982 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561e08d58380 msgr2=0x561e08d5c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:44:07.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.487+0000 7f69417e6b80 1 --2- 172.21.15.82:0/3514575982 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561e08d58380 0x561e08d5c520 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f691c00d950 tx=0x7f691c098930 comp rx=0 tx=0).stop 2023-09-23T09:44:07.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.487+0000 7f69417e6b80 1 -- 172.21.15.82:0/3514575982 shutdown_connections 2023-09-23T09:44:07.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.487+0000 7f69417e6b80 1 --2- 172.21.15.82:0/3514575982 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e08d58ca0 0x561e08d5ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:44:07.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.487+0000 7f69417e6b80 1 --2- 172.21.15.82:0/3514575982 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x561e08d6c700 0x561e08d6eb20 crc :-1 s=READY pgs=285 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:44:07.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.487+0000 7f69417e6b80 1 --2- 172.21.15.82:0/3514575982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561e08d52c40 0x561e08d5bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:44:07.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.487+0000 7f69417e6b80 1 --2- 172.21.15.82:0/3514575982 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561e08d58380 0x561e08d5c520 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:44:07.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.487+0000 7f69417e6b80 1 -- 172.21.15.82:0/3514575982 >> 172.21.15.82:0/3514575982 conn(0x561e08cc70e0 msgr2=0x561e08d47b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:44:07.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.487+0000 7f6906ffd700 0 client.28045 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:44:07.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.491+0000 7f69417e6b80 1 -- 172.21.15.82:0/3514575982 shutdown_connections 2023-09-23T09:44:07.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.491+0000 7f69417e6b80 1 -- 172.21.15.82:0/3514575982 wait complete. 2023-09-23T09:44:07.500 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.498+0000 7f69417e6b80 20 client.28045 trim_cache size 0 max 16384 2023-09-23T09:44:07.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.526+0000 7f69417e6b80 1 Processor -- start 2023-09-23T09:44:07.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.527+0000 7f69417e6b80 1 -- start start 2023-09-23T09:44:07.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.527+0000 7f69417e6b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561e08d52c40 0x561e08d52700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:44:07.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.527+0000 7f69417e6b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e08d58380 0x561e08d637a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:44:07.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.527+0000 7f69417e6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561e08d58ca0 0x561e08d57090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:44:07.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.527+0000 7f69417e6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e08b26920 con 0x561e08d58ca0 2023-09-23T09:44:07.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.527+0000 7f69417e6b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e08d63ce0 con 0x561e08d58380 2023-09-23T09:44:07.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.527+0000 7f69417e6b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e08d4f1b0 con 0x561e08d52c40 2023-09-23T09:44:07.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.530+0000 7f6927fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561e08d58ca0 0x561e08d57090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:44:07.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.530+0000 7f6927fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561e08d58ca0 0x561e08d57090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54820/0 (socket says 172.21.15.82:54820) 2023-09-23T09:44:07.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.530+0000 7f6927fff700 1 -- 172.21.15.82:0/2653460898 learned_addr learned my addr 172.21.15.82:0/2653460898 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:44:07.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.537+0000 7f6926ffd700 1 --2- 172.21.15.82:0/2653460898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e08d58380 0x561e08d637a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:44:07.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.537+0000 7f69277fe700 1 --2- 172.21.15.82:0/2653460898 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561e08d52c40 0x561e08d52700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:44:07.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.538+0000 7f6927fff700 1 -- 172.21.15.82:0/2653460898 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561e08d52c40 msgr2=0x561e08d52700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:44:07.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.538+0000 7f6927fff700 1 --2- 172.21.15.82:0/2653460898 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561e08d52c40 0x561e08d52700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:44:07.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.538+0000 7f6927fff700 1 -- 172.21.15.82:0/2653460898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e08d58380 msgr2=0x561e08d637a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:44:07.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.538+0000 7f6927fff700 1 --2- 172.21.15.82:0/2653460898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e08d58380 0x561e08d637a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:44:07.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.538+0000 7f6927fff700 1 -- 172.21.15.82:0/2653460898 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561e08ab9c60 con 0x561e08d58ca0 2023-09-23T09:44:07.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.539+0000 7f6927fff700 1 --2- 172.21.15.82:0/2653460898 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561e08d58ca0 0x561e08d57090 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f6920004530 tx=0x7f6920009510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efd12604d8ed5493 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:44:07.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.540+0000 7f690e7fc700 1 -- 172.21.15.82:0/2653460898 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6920034070 con 0x561e08d58ca0 2023-09-23T09:44:07.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.540+0000 7f690e7fc700 1 -- 172.21.15.82:0/2653460898 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f692000b630 con 0x561e08d58ca0 2023-09-23T09:44:07.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.540+0000 7f690e7fc700 1 -- 172.21.15.82:0/2653460898 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6920003820 con 0x561e08d58ca0 2023-09-23T09:44:07.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.541+0000 7f69417e6b80 1 -- 172.21.15.82:0/2653460898 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561e08d58ca0 msgr2=0x561e08d57090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:44:07.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.541+0000 7f69417e6b80 1 --2- 172.21.15.82:0/2653460898 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561e08d58ca0 0x561e08d57090 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f6920004530 tx=0x7f6920009510 comp rx=0 tx=0).stop 2023-09-23T09:44:07.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.542+0000 7f69417e6b80 1 -- 172.21.15.82:0/2653460898 shutdown_connections 2023-09-23T09:44:07.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.542+0000 7f69417e6b80 1 --2- 172.21.15.82:0/2653460898 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561e08d58ca0 0x561e08d57090 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:44:07.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.542+0000 7f69417e6b80 1 --2- 172.21.15.82:0/2653460898 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561e08d52c40 0x561e08d52700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:44:07.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.542+0000 7f69417e6b80 1 --2- 172.21.15.82:0/2653460898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e08d58380 0x561e08d637a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:44:07.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.542+0000 7f69417e6b80 1 -- 172.21.15.82:0/2653460898 >> 172.21.15.82:0/2653460898 conn(0x561e08cc70e0 msgr2=0x561e08d560f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:44:07.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.545+0000 7f69417e6b80 1 -- 172.21.15.82:0/2653460898 shutdown_connections 2023-09-23T09:44:07.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.546+0000 7f69417e6b80 1 -- 172.21.15.82:0/2653460898 wait complete. 2023-09-23T09:44:07.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.546+0000 7f69417e6b80 1 -- start start 2023-09-23T09:44:07.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.547+0000 7f69417e6b80 1 Processor -- start 2023-09-23T09:44:07.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.547+0000 7f69417e6b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561e08d52c40 0x561e08d61bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:44:07.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.547+0000 7f69417e6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561e08d58380 0x561e08d62110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:44:07.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.547+0000 7f69417e6b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e08d58ca0 0x561e08d62650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:44:07.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.547+0000 7f69417e6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e08d63b30 con 0x561e08d58380 2023-09-23T09:44:07.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.547+0000 7f69417e6b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e08dd1550 con 0x561e08d58ca0 2023-09-23T09:44:07.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.547+0000 7f69417e6b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e08de26a0 con 0x561e08d52c40 2023-09-23T09:44:07.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.548+0000 7f69417e6b80 10 client.0 _ll_register_callbacks cb 0x7f691c098540 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:44:07.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.548+0000 7f6926ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561e08d58380 0x561e08d62110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:44:07.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.548+0000 7f6926ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561e08d58380 0x561e08d62110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54822/0 (socket says 172.21.15.82:54822) 2023-09-23T09:44:07.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.548+0000 7f6926ffd700 1 -- 172.21.15.82:0/1891689299 learned_addr learned my addr 172.21.15.82:0/1891689299 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:44:07.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.549+0000 7f6926ffd700 1 -- 172.21.15.82:0/1891689299 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561e08d52c40 msgr2=0x561e08d61bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:44:07.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.549+0000 7f6926ffd700 1 --2- 172.21.15.82:0/1891689299 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561e08d52c40 0x561e08d61bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:44:07.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.549+0000 7f6926ffd700 1 -- 172.21.15.82:0/1891689299 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e08d58ca0 msgr2=0x561e08d62650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:44:07.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.549+0000 7f6926ffd700 1 --2- 172.21.15.82:0/1891689299 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e08d58ca0 0x561e08d62650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:44:07.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.549+0000 7f6926ffd700 1 -- 172.21.15.82:0/1891689299 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561e08b24630 con 0x561e08d58380 2023-09-23T09:44:07.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.549+0000 7f6926ffd700 1 --2- 172.21.15.82:0/1891689299 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561e08d58380 0x561e08d62110 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f691c0a0690 tx=0x7f691c005c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b496d0c9e0727ed2 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:44:07.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.550+0000 7f6906ffd700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:44:07.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.550+0000 7f6906ffd700 1 -- 172.21.15.82:0/1891689299 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691c0cb040 con 0x561e08d58380 2023-09-23T09:44:07.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.550+0000 7f6906ffd700 1 -- 172.21.15.82:0/1891689299 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(170..170 src has 1..170) v4 ==== 8557+0+0 (secure 0 0 0) 0x7f691c004750 con 0x561e08d58380 2023-09-23T09:44:07.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.550+0000 7f69417e6b80 1 -- 172.21.15.82:0/1891689299 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561e08d691b0 con 0x561e08d58380 2023-09-23T09:44:07.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.551+0000 7f6906ffd700 1 -- 172.21.15.82:0/1891689299 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=134) v2 ==== 24+0+0 (secure 0 0 0) 0x7f691c094ad0 con 0x561e08d58380 2023-09-23T09:44:07.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.551+0000 7f69417e6b80 10 client.18279 fetch_fsmap learned FSMap version 134 2023-09-23T09:44:07.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.551+0000 7f69417e6b80 1 -- 172.21.15.82:0/1891689299 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=134,monmap=4+}) v3 -- 0x561e08af7250 con 0x561e08d58380 2023-09-23T09:44:07.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.551+0000 7f6906ffd700 1 -- 172.21.15.82:0/1891689299 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x561e08d691b0 con 0x561e08d58380 2023-09-23T09:44:07.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.551+0000 7f6906ffd700 1 -- 172.21.15.82:0/1891689299 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 134) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f691c097ad0 con 0x561e08d58380 2023-09-23T09:44:07.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.551+0000 7f69417e6b80 10 client.18279 fetch_fsmap finished waiting for FSMap version 134 2023-09-23T09:44:07.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.551+0000 7f69417e6b80 10 client.18279 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:44:07.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.551+0000 7f69417e6b80 20 client.18279 populate_metadata read hostname 'smithi082' 2023-09-23T09:44:07.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.552+0000 7f69417e6b80 1 --2- 172.21.15.82:0/1891689299 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x561e08de3a30 0x561e08de5e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:44:07.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.552+0000 7f69417e6b80 4 client.18279 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:44:07.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.552+0000 7f69417e6b80 1 -- 172.21.15.82:0/1891689299 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x561e08d458b0 con 0x561e08de3a30 2023-09-23T09:44:07.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.554+0000 7f69277fe700 1 --2- 172.21.15.82:0/1891689299 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x561e08de3a30 0x561e08de5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:44:07.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.573+0000 7f69277fe700 1 --2- 172.21.15.82:0/1891689299 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x561e08de3a30 0x561e08de5e50 crc :-1 s=READY pgs=286 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4a9bc15d4530afd server_cookie=2744210f369ce6e9 in_seq=0 out_seq=0 2023-09-23T09:44:07.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.574+0000 7f6906ffd700 10 client.18279 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:44:07.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.592+0000 7f6906ffd700 1 -- 172.21.15.82:0/1891689299 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x561e08d458b0 con 0x561e08de3a30 2023-09-23T09:44:07.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.593+0000 7f6906ffd700 10 client.18279 handle_command_reply: tid=0 2023-09-23T09:44:07.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.593+0000 7f69417e6b80 1 client.18279 shutdown 2023-09-23T09:44:07.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.593+0000 7f69417e6b80 1 -- 172.21.15.82:0/1891689299 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561e08d58380 msgr2=0x561e08d62110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:44:07.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.593+0000 7f69417e6b80 1 --2- 172.21.15.82:0/1891689299 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561e08d58380 0x561e08d62110 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f691c0a0690 tx=0x7f691c005c40 comp rx=0 tx=0).stop 2023-09-23T09:44:07.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.594+0000 7f69417e6b80 1 -- 172.21.15.82:0/1891689299 shutdown_connections 2023-09-23T09:44:07.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.594+0000 7f69417e6b80 1 --2- 172.21.15.82:0/1891689299 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e08d58ca0 0x561e08d62650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:44:07.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.594+0000 7f69417e6b80 1 --2- 172.21.15.82:0/1891689299 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561e08d52c40 0x561e08d61bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:44:07.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.594+0000 7f69417e6b80 1 --2- 172.21.15.82:0/1891689299 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x561e08de3a30 0x561e08de5e50 crc :-1 s=READY pgs=286 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:44:07.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.594+0000 7f69417e6b80 1 --2- 172.21.15.82:0/1891689299 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561e08d58380 0x561e08d62110 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:44:07.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.594+0000 7f69417e6b80 1 -- 172.21.15.82:0/1891689299 >> 172.21.15.82:0/1891689299 conn(0x561e08cc70e0 msgr2=0x561e08d57090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:44:07.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.594+0000 7f6906ffd700 0 client.18279 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:44:07.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.594+0000 7f69417e6b80 1 -- 172.21.15.82:0/1891689299 shutdown_connections 2023-09-23T09:44:07.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.594+0000 7f69417e6b80 1 -- 172.21.15.82:0/1891689299 wait complete. 2023-09-23T09:44:07.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.595+0000 7f69417e6b80 20 client.18279 trim_cache size 0 max 16384 2023-09-23T09:44:07.598 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:44:07.598 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-23T09:44:07.598 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:44:07.598 INFO:teuthology.orchestra.run.smithi082.stdout: "d9e62ab8-1468-4fb0-a9fe-61bed13e954b": { 2023-09-23T09:44:07.598 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:44:07.598 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "d9e62ab8-1468-4fb0-a9fe-61bed13e954b", 2023-09-23T09:44:07.599 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:44:07.599 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:44:07.599 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:44:07.599 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:44:07.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.596+0000 7f692ddff700 1 -- 172.21.15.82:0/3949557873 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f69100a01c0 msgr2=0x7f69100a2680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:44:07.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.596+0000 7f692ddff700 1 --2- 172.21.15.82:0/3949557873 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f69100a01c0 0x7f69100a2680 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f692002b000 tx=0x7f6920029000 comp rx=0 tx=0).stop 2023-09-23T09:44:07.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.596+0000 7f692ddff700 1 -- 172.21.15.82:0/3949557873 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f692810c260 msgr2=0x7f692819d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:44:07.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.596+0000 7f692ddff700 1 --2- 172.21.15.82:0/3949557873 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f692810c260 0x7f692819d4c0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f691c00d980 tx=0x7f691c00dd40 comp rx=0 tx=0).stop 2023-09-23T09:44:07.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.596+0000 7f692ddff700 1 -- 172.21.15.82:0/3949557873 shutdown_connections 2023-09-23T09:44:07.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.596+0000 7f692ddff700 1 --2- 172.21.15.82:0/3949557873 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f69100a01c0 0x7f69100a2680 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:44:07.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.596+0000 7f692ddff700 1 --2- 172.21.15.82:0/3949557873 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69281a1920 0x7f69281a1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:44:07.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.596+0000 7f692ddff700 1 --2- 172.21.15.82:0/3949557873 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f69281079d0 0x7f692819cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:44:07.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.596+0000 7f692ddff700 1 --2- 172.21.15.82:0/3949557873 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f692810c260 0x7f692819d4c0 secure :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f691c00d980 tx=0x7f691c00dd40 comp rx=0 tx=0).stop 2023-09-23T09:44:07.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.596+0000 7f692ddff700 1 -- 172.21.15.82:0/3949557873 >> 172.21.15.82:0/3949557873 conn(0x7f6928076650 msgr2=0x7f692810abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:44:07.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.598+0000 7f692ddff700 1 -- 172.21.15.82:0/3949557873 shutdown_connections 2023-09-23T09:44:07.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:07.598+0000 7f692ddff700 1 -- 172.21.15.82:0/3949557873 wait complete. 2023-09-23T09:44:07.634 INFO:tasks.cephfs.filesystem:scrub status for tag:d9e62ab8-1468-4fb0-a9fe-61bed13e954b - {'path': '/', 'tag': 'd9e62ab8-1468-4fb0-a9fe-61bed13e954b', 'options': 'recursive,force'} 2023-09-23T09:44:08.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:44:08 smithi135 ceph-mon[99205]: pgmap v1501: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.5 MiB/s wr, 214 op/s 2023-09-23T09:44:08.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:44:08 smithi082 ceph-mon[97694]: pgmap v1501: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.5 MiB/s wr, 214 op/s 2023-09-23T09:44:08.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:44:08 smithi161 ceph-mon[99580]: pgmap v1501: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.5 MiB/s wr, 214 op/s 2023-09-23T09:44:11.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:44:10 smithi135 ceph-mon[99205]: pgmap v1502: 97 pgs: 6 active+clean+snaptrim, 11 active+clean+snaptrim_wait, 80 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 1.4 MiB/s wr, 190 op/s 2023-09-23T09:44:11.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:44:10 smithi082 ceph-mon[97694]: pgmap v1502: 97 pgs: 6 active+clean+snaptrim, 11 active+clean+snaptrim_wait, 80 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 1.4 MiB/s wr, 190 op/s 2023-09-23T09:44:11.396 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:44:10 smithi161 ceph-mon[99580]: pgmap v1502: 97 pgs: 6 active+clean+snaptrim, 11 active+clean+snaptrim_wait, 80 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 1.4 MiB/s wr, 190 op/s 2023-09-23T09:44:13.310 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:44:12 smithi135 ceph-mon[99205]: pgmap v1503: 97 pgs: 7 active+clean+snaptrim, 11 active+clean+snaptrim_wait, 79 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 1.3 MiB/s wr, 155 op/s 2023-09-23T09:44:13.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:44:12 smithi082 ceph-mon[97694]: pgmap v1503: 97 pgs: 7 active+clean+snaptrim, 11 active+clean+snaptrim_wait, 79 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 1.3 MiB/s wr, 155 op/s 2023-09-23T09:44:13.396 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:44:12 smithi161 ceph-mon[99580]: pgmap v1503: 97 pgs: 7 active+clean+snaptrim, 11 active+clean+snaptrim_wait, 79 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 1.3 MiB/s wr, 155 op/s 2023-09-23T09:44:15.310 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:44:14 smithi135 ceph-mon[99205]: pgmap v1504: 97 pgs: 7 active+clean+snaptrim, 11 active+clean+snaptrim_wait, 79 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 1.3 MiB/s wr, 155 op/s 2023-09-23T09:44:15.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:44:14 smithi082 ceph-mon[97694]: pgmap v1504: 97 pgs: 7 active+clean+snaptrim, 11 active+clean+snaptrim_wait, 79 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 1.3 MiB/s wr, 155 op/s 2023-09-23T09:44:15.396 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:44:14 smithi161 ceph-mon[99580]: pgmap v1504: 97 pgs: 7 active+clean+snaptrim, 11 active+clean+snaptrim_wait, 79 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 1.3 MiB/s wr, 155 op/s 2023-09-23T09:44:17.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:44:16 smithi135 ceph-mon[99205]: pgmap v1505: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 1.2 MiB/s wr, 130 op/s 2023-09-23T09:44:17.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:44:16 smithi082 ceph-mon[97694]: pgmap v1505: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 1.2 MiB/s wr, 130 op/s 2023-09-23T09:44:17.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:44:16 smithi161 ceph-mon[99580]: pgmap v1505: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 1.2 MiB/s wr, 130 op/s 2023-09-23T09:44:18.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:44:18 smithi135 ceph-mon[99205]: osdmap e171: 12 total, 12 up, 12 in 2023-09-23T09:44:18.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:44:18 smithi135 ceph-mon[99205]: pgmap v1507: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 1.1 MiB/s wr, 127 op/s 2023-09-23T09:44:18.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:44:18 smithi082 ceph-mon[97694]: osdmap e171: 12 total, 12 up, 12 in 2023-09-23T09:44:18.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:44:18 smithi082 ceph-mon[97694]: pgmap v1507: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 1.1 MiB/s wr, 127 op/s 2023-09-23T09:44:18.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:44:18 smithi161 ceph-mon[99580]: osdmap e171: 12 total, 12 up, 12 in 2023-09-23T09:44:18.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:44:18 smithi161 ceph-mon[99580]: pgmap v1507: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 1.1 MiB/s wr, 127 op/s 2023-09-23T09:44:21.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:44:20 smithi135 ceph-mon[99205]: pgmap v1508: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 1.2 MiB/s wr, 139 op/s 2023-09-23T09:44:21.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:44:20 smithi082 ceph-mon[97694]: pgmap v1508: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 1.2 MiB/s wr, 139 op/s 2023-09-23T09:44:21.396 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:44:20 smithi161 ceph-mon[99580]: pgmap v1508: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 1.2 MiB/s wr, 139 op/s 2023-09-23T09:44:23.310 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:44:22 smithi135 ceph-mon[99205]: pgmap v1509: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 1.3 MiB/s wr, 170 op/s 2023-09-23T09:44:23.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:44:22 smithi082 ceph-mon[97694]: pgmap v1509: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 1.3 MiB/s wr, 170 op/s 2023-09-23T09:44:23.396 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:44:22 smithi161 ceph-mon[99580]: pgmap v1509: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 1.3 MiB/s wr, 170 op/s 2023-09-23T09:44:25.310 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:44:24 smithi135 ceph-mon[99205]: pgmap v1510: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 1.3 MiB/s wr, 170 op/s 2023-09-23T09:44:25.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:44:24 smithi082 ceph-mon[97694]: pgmap v1510: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 1.3 MiB/s wr, 170 op/s 2023-09-23T09:44:25.396 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:44:24 smithi161 ceph-mon[99580]: pgmap v1510: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 1.3 MiB/s wr, 170 op/s 2023-09-23T09:44:27.310 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:44:26 smithi135 ceph-mon[99205]: pgmap v1511: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 1.2 MiB/s wr, 148 op/s 2023-09-23T09:44:27.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:44:26 smithi082 ceph-mon[97694]: pgmap v1511: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 1.2 MiB/s wr, 148 op/s 2023-09-23T09:44:27.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:44:26 smithi161 ceph-mon[99580]: pgmap v1511: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 1.2 MiB/s wr, 148 op/s 2023-09-23T09:44:28.810 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:44:28 smithi135 ceph-mon[99205]: pgmap v1512: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 1.1 MiB/s wr, 126 op/s 2023-09-23T09:44:28.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:44:28 smithi082 ceph-mon[97694]: pgmap v1512: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 1.1 MiB/s wr, 126 op/s 2023-09-23T09:44:28.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:44:28 smithi161 ceph-mon[99580]: pgmap v1512: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 1.1 MiB/s wr, 126 op/s 2023-09-23T09:44:31.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:44:30 smithi135 ceph-mon[99205]: pgmap v1513: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 991 KiB/s wr, 115 op/s 2023-09-23T09:44:31.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:44:30 smithi082 ceph-mon[97694]: pgmap v1513: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 991 KiB/s wr, 115 op/s 2023-09-23T09:44:31.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:44:30 smithi161 ceph-mon[99580]: pgmap v1513: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 991 KiB/s wr, 115 op/s 2023-09-23T09:44:33.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:44:32 smithi135 ceph-mon[99205]: pgmap v1514: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 743 KiB/s wr, 86 op/s 2023-09-23T09:44:33.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:44:32 smithi082 ceph-mon[97694]: pgmap v1514: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 743 KiB/s wr, 86 op/s 2023-09-23T09:44:33.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:44:32 smithi161 ceph-mon[99580]: pgmap v1514: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 743 KiB/s wr, 86 op/s 2023-09-23T09:44:35.310 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:44:35 smithi135 ceph-mon[99205]: pgmap v1515: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 464 KiB/s wr, 49 op/s 2023-09-23T09:44:35.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:44:34 smithi082 ceph-mon[97694]: pgmap v1515: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 464 KiB/s wr, 49 op/s 2023-09-23T09:44:35.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:44:35 smithi161 ceph-mon[99580]: pgmap v1515: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 464 KiB/s wr, 49 op/s 2023-09-23T09:44:37.310 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:44:37 smithi135 ceph-mon[99205]: pgmap v1516: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 522 KiB/s wr, 56 op/s 2023-09-23T09:44:37.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:44:37 smithi082 ceph-mon[97694]: pgmap v1516: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 522 KiB/s wr, 56 op/s 2023-09-23T09:44:37.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:44:37 smithi161 ceph-mon[99580]: pgmap v1516: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 522 KiB/s wr, 56 op/s 2023-09-23T09:44:37.634 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:44:37.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.845+0000 7fd5799ff700 1 -- 172.21.15.82:0/3152241487 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5741023b0 msgr2=0x7fd57410a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:44:37.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.845+0000 7fd5799ff700 1 --2- 172.21.15.82:0/3152241487 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5741023b0 0x7fd57410a890 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fd568009990 tx=0x7fd568009ca0 comp rx=0 tx=0).stop 2023-09-23T09:44:37.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.845+0000 7fd5799ff700 1 -- 172.21.15.82:0/3152241487 shutdown_connections 2023-09-23T09:44:37.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.845+0000 7fd5799ff700 1 --2- 172.21.15.82:0/3152241487 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd57410ae60 0x7fd57410d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:44:37.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.845+0000 7fd5799ff700 1 --2- 172.21.15.82:0/3152241487 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd574101a90 0x7fd574101e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:44:37.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.845+0000 7fd5799ff700 1 --2- 172.21.15.82:0/3152241487 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5741023b0 0x7fd57410a890 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:44:37.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.845+0000 7fd5799ff700 1 -- 172.21.15.82:0/3152241487 >> 172.21.15.82:0/3152241487 conn(0x7fd5740fb270 msgr2=0x7fd5740fd690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:44:37.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.845+0000 7fd5799ff700 1 -- 172.21.15.82:0/3152241487 shutdown_connections 2023-09-23T09:44:37.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.845+0000 7fd5799ff700 1 -- 172.21.15.82:0/3152241487 wait complete. 2023-09-23T09:44:37.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.846+0000 7fd5799ff700 1 Processor -- start 2023-09-23T09:44:37.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.846+0000 7fd5799ff700 1 -- start start 2023-09-23T09:44:37.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.846+0000 7fd5799ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd574101a90 0x7fd5740ff6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:44:37.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.846+0000 7fd5799ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd5741023b0 0x7fd5740ffc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:44:37.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.847+0000 7fd5799ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd57410ae60 0x7fd5741a4a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:44:37.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.847+0000 7fd5799ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd574100450 con 0x7fd574101a90 2023-09-23T09:44:37.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.847+0000 7fd5799ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5741a4fd0 con 0x7fd57410ae60 2023-09-23T09:44:37.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.847+0000 7fd5799ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5741a5110 con 0x7fd5741023b0 2023-09-23T09:44:37.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.847+0000 7fd572ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd574101a90 0x7fd5740ff6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:44:37.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.847+0000 7fd572ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd574101a90 0x7fd5740ff6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54560/0 (socket says 172.21.15.82:54560) 2023-09-23T09:44:37.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.847+0000 7fd5737fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd57410ae60 0x7fd5741a4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:44:37.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.847+0000 7fd572ffd700 1 -- 172.21.15.82:0/3918252987 learned_addr learned my addr 172.21.15.82:0/3918252987 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:44:37.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.847+0000 7fd5727fc700 1 --2- 172.21.15.82:0/3918252987 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd5741023b0 0x7fd5740ffc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:44:37.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.847+0000 7fd572ffd700 1 -- 172.21.15.82:0/3918252987 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd5741023b0 msgr2=0x7fd5740ffc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:44:37.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.847+0000 7fd572ffd700 1 --2- 172.21.15.82:0/3918252987 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd5741023b0 0x7fd5740ffc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:44:37.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.847+0000 7fd572ffd700 1 -- 172.21.15.82:0/3918252987 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd57410ae60 msgr2=0x7fd5741a4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:44:37.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.847+0000 7fd572ffd700 1 --2- 172.21.15.82:0/3918252987 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd57410ae60 0x7fd5741a4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:44:37.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.847+0000 7fd572ffd700 1 -- 172.21.15.82:0/3918252987 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5680095f0 con 0x7fd574101a90 2023-09-23T09:44:37.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.847+0000 7fd572ffd700 1 --2- 172.21.15.82:0/3918252987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd574101a90 0x7fd5740ff6e0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fd56400e9a0 tx=0x7fd56400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:44:37.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.848+0000 7fd5789fd700 1 -- 172.21.15.82:0/3918252987 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd564009790 con 0x7fd574101a90 2023-09-23T09:44:37.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.848+0000 7fd5789fd700 1 -- 172.21.15.82:0/3918252987 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd564010430 con 0x7fd574101a90 2023-09-23T09:44:37.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.848+0000 7fd5799ff700 1 -- 172.21.15.82:0/3918252987 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5741a5370 con 0x7fd574101a90 2023-09-23T09:44:37.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.848+0000 7fd5789fd700 1 -- 172.21.15.82:0/3918252987 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd56400cea0 con 0x7fd574101a90 2023-09-23T09:44:37.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.848+0000 7fd5799ff700 1 -- 172.21.15.82:0/3918252987 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5741a58a0 con 0x7fd574101a90 2023-09-23T09:44:37.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.851+0000 7fd5789fd700 1 -- 172.21.15.82:0/3918252987 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7fd5640105a0 con 0x7fd574101a90 2023-09-23T09:44:37.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.852+0000 7fd58d3f1b80 1 Processor -- start 2023-09-23T09:44:37.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.852+0000 7fd5789fd700 1 --2- 172.21.15.82:0/3918252987 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fd55c0a0140 0x7fd55c0a2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:44:37.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.852+0000 7fd58d3f1b80 1 -- start start 2023-09-23T09:44:37.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.853+0000 7fd5789fd700 1 -- 172.21.15.82:0/3918252987 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fd564014070 con 0x7fd574101a90 2023-09-23T09:44:37.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.853+0000 7fd5737fe700 1 --2- 172.21.15.82:0/3918252987 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fd55c0a0140 0x7fd55c0a2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:44:37.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.853+0000 7fd58d3f1b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56010c09f380 0x56010c09f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:44:37.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.853+0000 7fd58d3f1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56010c09fca0 0x56010c099700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:44:37.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.853+0000 7fd58d3f1b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56010c099c40 0x56010c09a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:44:37.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.853+0000 7fd58d3f1b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56010c0017b0 con 0x56010c09fca0 2023-09-23T09:44:37.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.853+0000 7fd58d3f1b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56010bff2780 con 0x56010c099c40 2023-09-23T09:44:37.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.853+0000 7fd58d3f1b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x56010bff00a0 con 0x56010c09f380 2023-09-23T09:44:37.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.853+0000 7fd5727fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56010c09fca0 0x56010c099700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:44:37.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.853+0000 7fd5727fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56010c09fca0 0x56010c099700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54566/0 (socket says 172.21.15.82:54566) 2023-09-23T09:44:37.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.853+0000 7fd5727fc700 1 -- 172.21.15.82:0/3326389098 learned_addr learned my addr 172.21.15.82:0/3326389098 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:44:37.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.853+0000 7fd572ffd700 1 --2- 172.21.15.82:0/3326389098 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56010c09f380 0x56010c09f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:44:37.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.853+0000 7fd5737fe700 1 --2- 172.21.15.82:0/3918252987 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fd55c0a0140 0x7fd55c0a2600 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fd5741017f0 tx=0x7fd56c007950 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:44:37.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.853+0000 7fd5737fe700 1 --2- 172.21.15.82:0/3326389098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56010c099c40 0x56010c09a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:44:37.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.854+0000 7fd5727fc700 1 -- 172.21.15.82:0/3326389098 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56010c09f380 msgr2=0x56010c09f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:44:37.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.854+0000 7fd5727fc700 1 --2- 172.21.15.82:0/3326389098 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56010c09f380 0x56010c09f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:44:37.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.854+0000 7fd5727fc700 1 -- 172.21.15.82:0/3326389098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56010c099c40 msgr2=0x56010c09a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:44:37.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.854+0000 7fd5727fc700 1 --2- 172.21.15.82:0/3326389098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56010c099c40 0x56010c09a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:44:37.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.854+0000 7fd5727fc700 1 -- 172.21.15.82:0/3326389098 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56010be6b630 con 0x56010c09fca0 2023-09-23T09:44:37.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.854+0000 7fd5727fc700 1 --2- 172.21.15.82:0/3326389098 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56010c09fca0 0x56010c099700 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fd568009990 tx=0x7fd568005040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9aac27414ddc47a2 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:44:37.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.854+0000 7fd559ffb700 1 -- 172.21.15.82:0/3326389098 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd56801d070 con 0x56010c09fca0 2023-09-23T09:44:37.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.854+0000 7fd559ffb700 1 -- 172.21.15.82:0/3326389098 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd56801e040 con 0x56010c09fca0 2023-09-23T09:44:37.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.854+0000 7fd559ffb700 1 -- 172.21.15.82:0/3326389098 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd568004a30 con 0x56010c09fca0 2023-09-23T09:44:37.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.855+0000 7fd58d3f1b80 1 -- 172.21.15.82:0/3326389098 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56010c09fca0 msgr2=0x56010c099700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:44:37.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.855+0000 7fd58d3f1b80 1 --2- 172.21.15.82:0/3326389098 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56010c09fca0 0x56010c099700 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fd568009990 tx=0x7fd568005040 comp rx=0 tx=0).stop 2023-09-23T09:44:37.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.855+0000 7fd58d3f1b80 1 -- 172.21.15.82:0/3326389098 shutdown_connections 2023-09-23T09:44:37.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.855+0000 7fd58d3f1b80 1 --2- 172.21.15.82:0/3326389098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56010c099c40 0x56010c09a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:44:37.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.855+0000 7fd58d3f1b80 1 --2- 172.21.15.82:0/3326389098 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56010c09f380 0x56010c09f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:44:37.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.855+0000 7fd58d3f1b80 1 --2- 172.21.15.82:0/3326389098 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56010c09fca0 0x56010c099700 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:44:37.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.855+0000 7fd58d3f1b80 1 -- 172.21.15.82:0/3326389098 >> 172.21.15.82:0/3326389098 conn(0x56010c00e0e0 msgr2=0x56010c094410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:44:37.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.855+0000 7fd58d3f1b80 1 -- 172.21.15.82:0/3326389098 shutdown_connections 2023-09-23T09:44:37.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.855+0000 7fd58d3f1b80 1 -- 172.21.15.82:0/3326389098 wait complete. 2023-09-23T09:44:37.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.856+0000 7fd58d3f1b80 1 -- start start 2023-09-23T09:44:37.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.856+0000 7fd58d3f1b80 1 Processor -- start 2023-09-23T09:44:37.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.856+0000 7fd58d3f1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56010c099c40 0x56010c0a2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:44:37.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.856+0000 7fd58d3f1b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56010c09f380 0x56010c0a34e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:44:37.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.856+0000 7fd58d3f1b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56010c09fca0 0x56010c0a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:44:37.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.856+0000 7fd58d3f1b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56010bfeb990 con 0x56010c099c40 2023-09-23T09:44:37.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.856+0000 7fd58d3f1b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56010bf89bb0 con 0x56010c09f380 2023-09-23T09:44:37.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.856+0000 7fd58d3f1b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x56010bf898b0 con 0x56010c09fca0 2023-09-23T09:44:37.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.856+0000 7fd58d3f1b80 10 client.0 _ll_register_callbacks cb 0x56010bed3a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:44:37.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.857+0000 7fd572ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56010c099c40 0x56010c0a2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:44:37.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.857+0000 7fd5727fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56010c09f380 0x56010c0a34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:44:37.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.857+0000 7fd572ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56010c099c40 0x56010c0a2fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54572/0 (socket says 172.21.15.82:54572) 2023-09-23T09:44:37.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.857+0000 7fd5727fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56010c09f380 0x56010c0a34e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:51030/0 (socket says 172.21.15.82:51030) 2023-09-23T09:44:37.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.857+0000 7fd572ffd700 1 -- 172.21.15.82:0/1206588272 learned_addr learned my addr 172.21.15.82:0/1206588272 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:44:37.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.857+0000 7fd5737fe700 1 --2- 172.21.15.82:0/1206588272 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56010c09fca0 0x56010c0a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:44:37.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.857+0000 7fd5727fc700 1 -- 172.21.15.82:0/1206588272 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56010c09fca0 msgr2=0x56010c0a3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:44:37.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.857+0000 7fd5727fc700 1 --2- 172.21.15.82:0/1206588272 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56010c09fca0 0x56010c0a3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:44:37.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.857+0000 7fd5727fc700 1 -- 172.21.15.82:0/1206588272 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56010c099c40 msgr2=0x56010c0a2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:44:37.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.857+0000 7fd5727fc700 1 --2- 172.21.15.82:0/1206588272 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56010c099c40 0x56010c0a2fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:44:37.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.857+0000 7fd5727fc700 1 -- 172.21.15.82:0/1206588272 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd57410dfc0 con 0x56010c09f380 2023-09-23T09:44:37.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.857+0000 7fd572ffd700 1 --2- 172.21.15.82:0/1206588272 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56010c099c40 0x56010c0a2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:44:37.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.857+0000 7fd5727fc700 1 --2- 172.21.15.82:0/1206588272 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56010c09f380 0x56010c0a34e0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fd5680098e0 tx=0x7fd56800be90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=96b60efaba4df0b server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:44:37.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.857+0000 7fd552ffd700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-09-23T09:44:37.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.858+0000 7fd552ffd700 1 -- 172.21.15.82:0/1206588272 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd56801d040 con 0x56010c09f380 2023-09-23T09:44:37.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.858+0000 7fd58d3f1b80 1 -- 172.21.15.82:0/1206588272 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56010c0691c0 con 0x56010c09f380 2023-09-23T09:44:37.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.858+0000 7fd552ffd700 1 -- 172.21.15.82:0/1206588272 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(171..171 src has 1..171) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fd568004700 con 0x56010c09f380 2023-09-23T09:44:37.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.858+0000 7fd552ffd700 1 -- 172.21.15.82:0/1206588272 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=134) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd5680048c0 con 0x56010c09f380 2023-09-23T09:44:37.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.858+0000 7fd58d3f1b80 10 client.28019 fetch_fsmap learned FSMap version 134 2023-09-23T09:44:37.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.858+0000 7fd58d3f1b80 1 -- 172.21.15.82:0/1206588272 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=134,monmap=4+}) v3 -- 0x56010be17de0 con 0x56010c09f380 2023-09-23T09:44:37.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.858+0000 7fd552ffd700 1 -- 172.21.15.82:0/1206588272 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56010c0691c0 con 0x56010c09f380 2023-09-23T09:44:37.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.858+0000 7fd552ffd700 1 -- 172.21.15.82:0/1206588272 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 134) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fd56800fa00 con 0x56010c09f380 2023-09-23T09:44:37.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.858+0000 7fd58d3f1b80 10 client.28019 fetch_fsmap finished waiting for FSMap version 134 2023-09-23T09:44:37.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.858+0000 7fd58d3f1b80 10 client.28019 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:44:37.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.859+0000 7fd58d3f1b80 20 client.28019 populate_metadata read hostname 'smithi082' 2023-09-23T09:44:37.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.859+0000 7fd58d3f1b80 1 --2- 172.21.15.82:0/1206588272 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56010c0b3330 0x56010c0b5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:44:37.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.859+0000 7fd58d3f1b80 4 client.28019 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:44:37.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.859+0000 7fd58d3f1b80 1 -- 172.21.15.82:0/1206588272 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56010bf91ba0 con 0x56010c0b3330 2023-09-23T09:44:37.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.859+0000 7fd572ffd700 1 --2- 172.21.15.82:0/1206588272 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56010c0b3330 0x56010c0b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:44:37.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.859+0000 7fd572ffd700 1 --2- 172.21.15.82:0/1206588272 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56010c0b3330 0x56010c0b5750 crc :-1 s=READY pgs=287 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b9129c9c05add82 server_cookie=4f1237c72dd04c3a in_seq=0 out_seq=0 2023-09-23T09:44:37.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.859+0000 7fd552ffd700 10 client.28019 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:44:37.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.860+0000 7fd552ffd700 1 -- 172.21.15.82:0/1206588272 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56010bf91ba0 con 0x56010c0b3330 2023-09-23T09:44:37.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.860+0000 7fd552ffd700 10 client.28019 handle_command_reply: tid=0 2023-09-23T09:44:37.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.860+0000 7fd58d3f1b80 1 client.28019 shutdown 2023-09-23T09:44:37.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.860+0000 7fd58d3f1b80 1 -- 172.21.15.82:0/1206588272 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56010c09f380 msgr2=0x56010c0a34e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:44:37.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.860+0000 7fd58d3f1b80 1 --2- 172.21.15.82:0/1206588272 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56010c09f380 0x56010c0a34e0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fd5680098e0 tx=0x7fd56800be90 comp rx=0 tx=0).stop 2023-09-23T09:44:37.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.860+0000 7fd58d3f1b80 1 -- 172.21.15.82:0/1206588272 shutdown_connections 2023-09-23T09:44:37.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.860+0000 7fd58d3f1b80 1 --2- 172.21.15.82:0/1206588272 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56010c09fca0 0x56010c0a3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:44:37.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.860+0000 7fd58d3f1b80 1 --2- 172.21.15.82:0/1206588272 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56010c0b3330 0x56010c0b5750 crc :-1 s=READY pgs=287 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:44:37.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.860+0000 7fd58d3f1b80 1 --2- 172.21.15.82:0/1206588272 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56010c099c40 0x56010c0a2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:44:37.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.860+0000 7fd58d3f1b80 1 --2- 172.21.15.82:0/1206588272 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56010c09f380 0x56010c0a34e0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:44:37.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.860+0000 7fd552ffd700 0 client.28019 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:44:37.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.860+0000 7fd58d3f1b80 1 -- 172.21.15.82:0/1206588272 >> 172.21.15.82:0/1206588272 conn(0x56010c00e0e0 msgr2=0x56010c08eb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:44:37.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.861+0000 7fd58d3f1b80 1 -- 172.21.15.82:0/1206588272 shutdown_connections 2023-09-23T09:44:37.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.861+0000 7fd58d3f1b80 1 -- 172.21.15.82:0/1206588272 wait complete. 2023-09-23T09:44:37.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.861+0000 7fd58d3f1b80 20 client.28019 trim_cache size 0 max 16384 2023-09-23T09:44:37.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.877+0000 7fd58d3f1b80 1 Processor -- start 2023-09-23T09:44:37.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.878+0000 7fd58d3f1b80 1 -- start start 2023-09-23T09:44:37.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.878+0000 7fd58d3f1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56010c099c40 0x56010c0aa730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:44:37.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.878+0000 7fd58d3f1b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56010c09f380 0x56010c08e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:44:37.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.878+0000 7fd58d3f1b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56010c09fca0 0x56010c08e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:44:37.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.878+0000 7fd58d3f1b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56010be6d920 con 0x56010c099c40 2023-09-23T09:44:37.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.878+0000 7fd58d3f1b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56010c090a40 con 0x56010c09f380 2023-09-23T09:44:37.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.878+0000 7fd58d3f1b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x56010c09a800 con 0x56010c09fca0 2023-09-23T09:44:37.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.878+0000 7fd572ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56010c099c40 0x56010c0aa730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:44:37.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.878+0000 7fd5727fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56010c09f380 0x56010c08e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:44:37.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.878+0000 7fd5727fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56010c09f380 0x56010c08e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:51046/0 (socket says 172.21.15.82:51046) 2023-09-23T09:44:37.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.878+0000 7fd5727fc700 1 -- 172.21.15.82:0/2669927290 learned_addr learned my addr 172.21.15.82:0/2669927290 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:44:37.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.879+0000 7fd572ffd700 1 -- 172.21.15.82:0/2669927290 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56010c09fca0 msgr2=0x56010c08e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:44:37.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.879+0000 7fd572ffd700 1 --2- 172.21.15.82:0/2669927290 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56010c09fca0 0x56010c08e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:44:37.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.879+0000 7fd572ffd700 1 -- 172.21.15.82:0/2669927290 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56010c09f380 msgr2=0x56010c08e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:44:37.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.879+0000 7fd572ffd700 1 --2- 172.21.15.82:0/2669927290 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56010c09f380 0x56010c08e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:44:37.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.879+0000 7fd572ffd700 1 -- 172.21.15.82:0/2669927290 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56010be00c60 con 0x56010c099c40 2023-09-23T09:44:37.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.879+0000 7fd5727fc700 1 --2- 172.21.15.82:0/2669927290 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56010c09f380 0x56010c08e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:44:37.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.879+0000 7fd572ffd700 1 --2- 172.21.15.82:0/2669927290 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56010c099c40 0x56010c0aa730 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fd5640c8f00 tx=0x7fd5640b8040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62fc8aeed819e238 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:44:37.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.879+0000 7fd55a7fc700 1 -- 172.21.15.82:0/2669927290 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd564098e60 con 0x56010c099c40 2023-09-23T09:44:37.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.879+0000 7fd55a7fc700 1 -- 172.21.15.82:0/2669927290 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd56409cc90 con 0x56010c099c40 2023-09-23T09:44:37.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.879+0000 7fd55a7fc700 1 -- 172.21.15.82:0/2669927290 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd564098350 con 0x56010c099c40 2023-09-23T09:44:37.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.880+0000 7fd58d3f1b80 1 -- 172.21.15.82:0/2669927290 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56010c099c40 msgr2=0x56010c0aa730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:44:37.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.880+0000 7fd58d3f1b80 1 --2- 172.21.15.82:0/2669927290 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56010c099c40 0x56010c0aa730 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fd5640c8f00 tx=0x7fd5640b8040 comp rx=0 tx=0).stop 2023-09-23T09:44:37.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.880+0000 7fd58d3f1b80 1 -- 172.21.15.82:0/2669927290 shutdown_connections 2023-09-23T09:44:37.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.880+0000 7fd58d3f1b80 1 --2- 172.21.15.82:0/2669927290 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56010c09fca0 0x56010c08e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:44:37.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.880+0000 7fd58d3f1b80 1 --2- 172.21.15.82:0/2669927290 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56010c099c40 0x56010c0aa730 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:44:37.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.880+0000 7fd58d3f1b80 1 --2- 172.21.15.82:0/2669927290 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56010c09f380 0x56010c08e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:44:37.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.880+0000 7fd58d3f1b80 1 -- 172.21.15.82:0/2669927290 >> 172.21.15.82:0/2669927290 conn(0x56010c00e0e0 msgr2=0x56010c09d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:44:37.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.880+0000 7fd58d3f1b80 1 -- 172.21.15.82:0/2669927290 shutdown_connections 2023-09-23T09:44:37.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.880+0000 7fd58d3f1b80 1 -- 172.21.15.82:0/2669927290 wait complete. 2023-09-23T09:44:37.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.880+0000 7fd58d3f1b80 1 -- start start 2023-09-23T09:44:37.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.880+0000 7fd58d3f1b80 1 Processor -- start 2023-09-23T09:44:37.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.881+0000 7fd58d3f1b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56010c099c40 0x56010c09c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:44:37.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.881+0000 7fd58d3f1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56010c09f380 0x56010c09ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:44:37.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.881+0000 7fd58d3f1b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56010c09fca0 0x56010c09b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:44:37.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.881+0000 7fd58d3f1b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56010c09cc40 con 0x56010c09f380 2023-09-23T09:44:37.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.881+0000 7fd58d3f1b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56010c09b880 con 0x56010c099c40 2023-09-23T09:44:37.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.881+0000 7fd58d3f1b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x56010c09ba40 con 0x56010c09fca0 2023-09-23T09:44:37.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.881+0000 7fd58d3f1b80 10 client.0 _ll_register_callbacks cb 0x7fd5640951a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:44:37.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.881+0000 7fd5727fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56010c09f380 0x56010c09ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:44:37.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.881+0000 7fd5727fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56010c09f380 0x56010c09ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54586/0 (socket says 172.21.15.82:54586) 2023-09-23T09:44:37.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.881+0000 7fd5727fc700 1 -- 172.21.15.82:0/2692065381 learned_addr learned my addr 172.21.15.82:0/2692065381 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:44:37.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.881+0000 7fd572ffd700 1 --2- 172.21.15.82:0/2692065381 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56010c099c40 0x56010c09c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:44:37.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.881+0000 7fd5737fe700 1 --2- 172.21.15.82:0/2692065381 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56010c09fca0 0x56010c09b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:44:37.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.881+0000 7fd5727fc700 1 -- 172.21.15.82:0/2692065381 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56010c09fca0 msgr2=0x56010c09b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:44:37.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.881+0000 7fd5727fc700 1 --2- 172.21.15.82:0/2692065381 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56010c09fca0 0x56010c09b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:44:37.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.881+0000 7fd5727fc700 1 -- 172.21.15.82:0/2692065381 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56010c099c40 msgr2=0x56010c09c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:44:37.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.881+0000 7fd5727fc700 1 --2- 172.21.15.82:0/2692065381 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56010c099c40 0x56010c09c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:44:37.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.881+0000 7fd5727fc700 1 -- 172.21.15.82:0/2692065381 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56010be17de0 con 0x56010c09f380 2023-09-23T09:44:37.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.882+0000 7fd5727fc700 1 --2- 172.21.15.82:0/2692065381 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56010c09f380 0x56010c09ae00 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fd5680098e0 tx=0x7fd5680057e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=928da8e3da61dfc7 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:44:37.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.882+0000 7fd552ffd700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:44:37.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.882+0000 7fd552ffd700 1 -- 172.21.15.82:0/2692065381 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd56801d030 con 0x56010c09f380 2023-09-23T09:44:37.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.882+0000 7fd58d3f1b80 1 -- 172.21.15.82:0/2692065381 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56010c08c8b0 con 0x56010c09f380 2023-09-23T09:44:37.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.882+0000 7fd552ffd700 1 -- 172.21.15.82:0/2692065381 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(171..171 src has 1..171) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fd568000e40 con 0x56010c09f380 2023-09-23T09:44:37.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.882+0000 7fd552ffd700 1 -- 172.21.15.82:0/2692065381 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=134) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd568005910 con 0x56010c09f380 2023-09-23T09:44:37.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.882+0000 7fd58d3f1b80 10 client.18297 fetch_fsmap learned FSMap version 134 2023-09-23T09:44:37.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.882+0000 7fd58d3f1b80 1 -- 172.21.15.82:0/2692065381 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=134,monmap=4+}) v3 -- 0x7fd5741a58a0 con 0x56010c09f380 2023-09-23T09:44:37.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.882+0000 7fd552ffd700 1 -- 172.21.15.82:0/2692065381 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd56804d020 con 0x56010c09f380 2023-09-23T09:44:37.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.883+0000 7fd552ffd700 1 -- 172.21.15.82:0/2692065381 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 134) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fd568049460 con 0x56010c09f380 2023-09-23T09:44:37.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.883+0000 7fd58d3f1b80 10 client.18297 fetch_fsmap finished waiting for FSMap version 134 2023-09-23T09:44:37.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.883+0000 7fd58d3f1b80 10 client.18297 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:44:37.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.883+0000 7fd58d3f1b80 20 client.18297 populate_metadata read hostname 'smithi082' 2023-09-23T09:44:37.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.883+0000 7fd58d3f1b80 1 --2- 172.21.15.82:0/2692065381 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56010c108050 0x56010c10a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:44:37.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.883+0000 7fd58d3f1b80 4 client.18297 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:44:37.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.883+0000 7fd58d3f1b80 1 -- 172.21.15.82:0/2692065381 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x56010bfe4970 con 0x56010c108050 2023-09-23T09:44:37.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.883+0000 7fd572ffd700 1 --2- 172.21.15.82:0/2692065381 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56010c108050 0x56010c10a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:44:37.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.883+0000 7fd572ffd700 1 --2- 172.21.15.82:0/2692065381 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56010c108050 0x56010c10a440 crc :-1 s=READY pgs=288 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96f051af9b46d199 server_cookie=405a7608648d7eeb in_seq=0 out_seq=0 2023-09-23T09:44:37.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.883+0000 7fd552ffd700 10 client.18297 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:44:37.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.884+0000 7fd552ffd700 1 -- 172.21.15.82:0/2692065381 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x56010bfe4970 con 0x56010c108050 2023-09-23T09:44:37.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.884+0000 7fd552ffd700 10 client.18297 handle_command_reply: tid=0 2023-09-23T09:44:37.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.884+0000 7fd58d3f1b80 1 client.18297 shutdown 2023-09-23T09:44:37.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.884+0000 7fd58d3f1b80 1 -- 172.21.15.82:0/2692065381 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56010c09f380 msgr2=0x56010c09ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:44:37.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.884+0000 7fd58d3f1b80 1 --2- 172.21.15.82:0/2692065381 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56010c09f380 0x56010c09ae00 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fd5680098e0 tx=0x7fd5680057e0 comp rx=0 tx=0).stop 2023-09-23T09:44:37.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.884+0000 7fd58d3f1b80 1 -- 172.21.15.82:0/2692065381 shutdown_connections 2023-09-23T09:44:37.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.884+0000 7fd58d3f1b80 1 --2- 172.21.15.82:0/2692065381 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56010c09fca0 0x56010c09b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:44:37.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.884+0000 7fd58d3f1b80 1 --2- 172.21.15.82:0/2692065381 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56010c099c40 0x56010c09c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:44:37.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.884+0000 7fd58d3f1b80 1 --2- 172.21.15.82:0/2692065381 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56010c108050 0x56010c10a440 crc :-1 s=READY pgs=288 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:44:37.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.884+0000 7fd58d3f1b80 1 --2- 172.21.15.82:0/2692065381 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56010c09f380 0x56010c09ae00 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:44:37.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.884+0000 7fd552ffd700 0 client.18297 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:44:37.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.884+0000 7fd58d3f1b80 1 -- 172.21.15.82:0/2692065381 >> 172.21.15.82:0/2692065381 conn(0x56010c00e0e0 msgr2=0x56010c08e2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:44:37.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.884+0000 7fd58d3f1b80 1 -- 172.21.15.82:0/2692065381 shutdown_connections 2023-09-23T09:44:37.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.884+0000 7fd58d3f1b80 1 -- 172.21.15.82:0/2692065381 wait complete. 2023-09-23T09:44:37.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.884+0000 7fd58d3f1b80 20 client.18297 trim_cache size 0 max 16384 2023-09-23T09:44:37.891 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:44:37.891 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-23T09:44:37.891 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:44:37.891 INFO:teuthology.orchestra.run.smithi082.stdout: "d9e62ab8-1468-4fb0-a9fe-61bed13e954b": { 2023-09-23T09:44:37.891 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:44:37.891 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "d9e62ab8-1468-4fb0-a9fe-61bed13e954b", 2023-09-23T09:44:37.891 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:44:37.891 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:44:37.892 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:44:37.892 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:44:37.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.885+0000 7fd5799ff700 1 -- 172.21.15.82:0/3918252987 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fd55c0a0140 msgr2=0x7fd55c0a2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:44:37.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.885+0000 7fd5799ff700 1 --2- 172.21.15.82:0/3918252987 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fd55c0a0140 0x7fd55c0a2600 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fd5741017f0 tx=0x7fd56c007950 comp rx=0 tx=0).stop 2023-09-23T09:44:37.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.885+0000 7fd5799ff700 1 -- 172.21.15.82:0/3918252987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd574101a90 msgr2=0x7fd5740ff6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:44:37.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.885+0000 7fd5799ff700 1 --2- 172.21.15.82:0/3918252987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd574101a90 0x7fd5740ff6e0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fd56400e9a0 tx=0x7fd56400ecb0 comp rx=0 tx=0).stop 2023-09-23T09:44:37.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.885+0000 7fd5799ff700 1 -- 172.21.15.82:0/3918252987 shutdown_connections 2023-09-23T09:44:37.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.885+0000 7fd5799ff700 1 --2- 172.21.15.82:0/3918252987 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fd55c0a0140 0x7fd55c0a2600 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:44:37.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.885+0000 7fd5799ff700 1 --2- 172.21.15.82:0/3918252987 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd57410ae60 0x7fd5741a4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:44:37.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.885+0000 7fd5799ff700 1 --2- 172.21.15.82:0/3918252987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd574101a90 0x7fd5740ff6e0 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:44:37.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.885+0000 7fd5799ff700 1 --2- 172.21.15.82:0/3918252987 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd5741023b0 0x7fd5740ffc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:44:37.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.885+0000 7fd5799ff700 1 -- 172.21.15.82:0/3918252987 >> 172.21.15.82:0/3918252987 conn(0x7fd5740fb270 msgr2=0x7fd5740fbee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:44:37.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.885+0000 7fd5799ff700 1 -- 172.21.15.82:0/3918252987 shutdown_connections 2023-09-23T09:44:37.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:44:37.885+0000 7fd5799ff700 1 -- 172.21.15.82:0/3918252987 wait complete. 2023-09-23T09:44:37.904 INFO:tasks.cephfs.filesystem:scrub status for tag:d9e62ab8-1468-4fb0-a9fe-61bed13e954b - {'path': '/', 'tag': 'd9e62ab8-1468-4fb0-a9fe-61bed13e954b', 'options': 'recursive,force'} 2023-09-23T09:44:38.810 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:44:38 smithi135 ceph-mon[99205]: pgmap v1517: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 106 KiB/s wr, 15 op/s 2023-09-23T09:44:38.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:44:38 smithi082 ceph-mon[97694]: pgmap v1517: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 106 KiB/s wr, 15 op/s 2023-09-23T09:44:38.896 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:44:38 smithi161 ceph-mon[99580]: pgmap v1517: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 106 KiB/s wr, 15 op/s 2023-09-23T09:44:41.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:44:40 smithi135 ceph-mon[99205]: pgmap v1518: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 177 KiB/s wr, 20 op/s 2023-09-23T09:44:41.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:44:40 smithi082 ceph-mon[97694]: pgmap v1518: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 177 KiB/s wr, 20 op/s 2023-09-23T09:44:41.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:44:40 smithi161 ceph-mon[99580]: pgmap v1518: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 177 KiB/s wr, 20 op/s 2023-09-23T09:44:43.310 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:44:42 smithi135 ceph-mon[99205]: pgmap v1519: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 147 KiB/s wr, 18 op/s 2023-09-23T09:44:43.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:44:42 smithi082 ceph-mon[97694]: pgmap v1519: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 147 KiB/s wr, 18 op/s 2023-09-23T09:44:43.396 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:44:42 smithi161 ceph-mon[99580]: pgmap v1519: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 147 KiB/s wr, 18 op/s 2023-09-23T09:44:45.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:44:45 smithi135 ceph-mon[99205]: pgmap v1520: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 144 KiB/s wr, 15 op/s 2023-09-23T09:44:45.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:44:45 smithi082 ceph-mon[97694]: pgmap v1520: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 144 KiB/s wr, 15 op/s 2023-09-23T09:44:45.396 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:44:45 smithi161 ceph-mon[99580]: pgmap v1520: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 144 KiB/s wr, 15 op/s 2023-09-23T09:44:47.310 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:44:47 smithi135 ceph-mon[99205]: pgmap v1521: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 223 KiB/s rd, 221 KiB/s wr, 24 op/s 2023-09-23T09:44:47.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:44:47 smithi082 ceph-mon[97694]: pgmap v1521: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 223 KiB/s rd, 221 KiB/s wr, 24 op/s 2023-09-23T09:44:47.396 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:44:47 smithi161 ceph-mon[99580]: pgmap v1521: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 223 KiB/s rd, 221 KiB/s wr, 24 op/s 2023-09-23T09:44:48.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:44:48 smithi135 ceph-mon[99205]: pgmap v1522: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 213 KiB/s wr, 17 op/s 2023-09-23T09:44:48.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:44:48 smithi082 ceph-mon[97694]: pgmap v1522: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 213 KiB/s wr, 17 op/s 2023-09-23T09:44:48.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:44:48 smithi161 ceph-mon[99580]: pgmap v1522: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 213 KiB/s wr, 17 op/s 2023-09-23T09:44:51.310 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:44:50 smithi135 ceph-mon[99205]: pgmap v1523: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 241 KiB/s wr, 20 op/s 2023-09-23T09:44:51.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:44:50 smithi082 ceph-mon[97694]: pgmap v1523: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 241 KiB/s wr, 20 op/s 2023-09-23T09:44:51.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:44:50 smithi161 ceph-mon[99580]: pgmap v1523: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 241 KiB/s wr, 20 op/s 2023-09-23T09:44:52.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:44:52 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:44:52.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:44:52 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:44:52.396 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:44:52 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:44:53.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:44:53 smithi135 ceph-mon[99205]: pgmap v1524: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 355 KiB/s wr, 23 op/s 2023-09-23T09:44:53.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:44:53 smithi082 ceph-mon[97694]: pgmap v1524: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 355 KiB/s wr, 23 op/s 2023-09-23T09:44:53.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:44:53 smithi161 ceph-mon[99580]: pgmap v1524: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 355 KiB/s wr, 23 op/s 2023-09-23T09:44:55.310 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:44:55 smithi135 ceph-mon[99205]: pgmap v1525: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 339 KiB/s wr, 20 op/s 2023-09-23T09:44:55.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:44:55 smithi082 ceph-mon[97694]: pgmap v1525: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 339 KiB/s wr, 20 op/s 2023-09-23T09:44:55.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:44:55 smithi161 ceph-mon[99580]: pgmap v1525: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 339 KiB/s wr, 20 op/s 2023-09-23T09:44:56.314 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:44:56 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:44:56.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:44:56 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:44:56.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:44:56 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:44:57.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:44:57 smithi135 ceph-mon[99205]: pgmap v1526: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 389 KiB/s wr, 29 op/s 2023-09-23T09:44:57.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:44:57 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:44:57.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:44:57 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:44:57.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:44:57 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:44:57.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:44:57 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:44:57.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:44:57 smithi082 ceph-mon[97694]: pgmap v1526: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 389 KiB/s wr, 29 op/s 2023-09-23T09:44:57.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:44:57 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:44:57.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:44:57 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:44:57.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:44:57 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:44:57.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:44:57 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:44:57.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:44:57 smithi161 ceph-mon[99580]: pgmap v1526: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 389 KiB/s wr, 29 op/s 2023-09-23T09:44:57.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:44:57 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:44:57.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:44:57 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:44:57.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:44:57 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:44:57.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:44:57 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:44:58.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:44:58 smithi135 ceph-mon[99205]: pgmap v1527: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 366 KiB/s rd, 379 KiB/s wr, 23 op/s 2023-09-23T09:44:58.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:44:58 smithi082 ceph-mon[97694]: pgmap v1527: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 366 KiB/s rd, 379 KiB/s wr, 23 op/s 2023-09-23T09:44:58.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:44:58 smithi161 ceph-mon[99580]: pgmap v1527: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 366 KiB/s rd, 379 KiB/s wr, 23 op/s 2023-09-23T09:45:01.280 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:45:01 smithi135 ceph-mon[99205]: pgmap v1528: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 331 KiB/s wr, 24 op/s 2023-09-23T09:45:01.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:45:01 smithi082 ceph-mon[97694]: pgmap v1528: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 331 KiB/s wr, 24 op/s 2023-09-23T09:45:01.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:45:01 smithi161 ceph-mon[99580]: pgmap v1528: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 331 KiB/s wr, 24 op/s 2023-09-23T09:45:03.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:45:03 smithi135 ceph-mon[99205]: pgmap v1529: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 327 KiB/s wr, 25 op/s 2023-09-23T09:45:03.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:45:03 smithi082 ceph-mon[97694]: pgmap v1529: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 327 KiB/s wr, 25 op/s 2023-09-23T09:45:03.396 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:45:03 smithi161 ceph-mon[99580]: pgmap v1529: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 327 KiB/s wr, 25 op/s 2023-09-23T09:45:05.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:45:05 smithi135 ceph-mon[99205]: pgmap v1530: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 143 KiB/s wr, 17 op/s 2023-09-23T09:45:05.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:45:05 smithi082 ceph-mon[97694]: pgmap v1530: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 143 KiB/s wr, 17 op/s 2023-09-23T09:45:05.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:45:05 smithi161 ceph-mon[99580]: pgmap v1530: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 143 KiB/s wr, 17 op/s 2023-09-23T09:45:07.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:45:07 smithi135 ceph-mon[99205]: pgmap v1531: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 214 KiB/s wr, 39 op/s 2023-09-23T09:45:07.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:45:07 smithi135 ceph-mon[99205]: osdmap e172: 12 total, 12 up, 12 in 2023-09-23T09:45:07.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:45:07 smithi082 ceph-mon[97694]: pgmap v1531: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 214 KiB/s wr, 39 op/s 2023-09-23T09:45:07.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:45:07 smithi082 ceph-mon[97694]: osdmap e172: 12 total, 12 up, 12 in 2023-09-23T09:45:07.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:45:07 smithi161 ceph-mon[99580]: pgmap v1531: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 214 KiB/s wr, 39 op/s 2023-09-23T09:45:07.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:45:07 smithi161 ceph-mon[99580]: osdmap e172: 12 total, 12 up, 12 in 2023-09-23T09:45:07.905 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:45:08.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.234+0000 7feed5bff700 1 -- 172.21.15.82:0/805004062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feed0102ac0 msgr2=0x7feed0102f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:45:08.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.234+0000 7feed5bff700 1 --2- 172.21.15.82:0/805004062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feed0102ac0 0x7feed0102f40 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7feec4009990 tx=0x7feec4009ca0 comp rx=0 tx=0).stop 2023-09-23T09:45:08.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.234+0000 7feed5bff700 1 -- 172.21.15.82:0/805004062 shutdown_connections 2023-09-23T09:45:08.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.234+0000 7feed5bff700 1 --2- 172.21.15.82:0/805004062 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feed0103480 0x7feed010f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:45:08.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.234+0000 7feed5bff700 1 --2- 172.21.15.82:0/805004062 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feed0108ad0 0x7feed0108eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:45:08.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.234+0000 7feed5bff700 1 --2- 172.21.15.82:0/805004062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feed0102ac0 0x7feed0102f40 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:45:08.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.234+0000 7feed5bff700 1 -- 172.21.15.82:0/805004062 >> 172.21.15.82:0/805004062 conn(0x7feed00fe570 msgr2=0x7feed0100990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:45:08.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.234+0000 7feed5bff700 1 -- 172.21.15.82:0/805004062 shutdown_connections 2023-09-23T09:45:08.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.234+0000 7feed5bff700 1 -- 172.21.15.82:0/805004062 wait complete. 2023-09-23T09:45:08.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.236+0000 7feed5bff700 1 Processor -- start 2023-09-23T09:45:08.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.236+0000 7feed5bff700 1 -- start start 2023-09-23T09:45:08.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.236+0000 7feed5bff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feed0102ac0 0x7feed019e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:45:08.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.236+0000 7feed5bff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feed0103480 0x7feed019edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:45:08.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.236+0000 7feed5bff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feed0108ad0 0x7feed0198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:45:08.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.236+0000 7feed5bff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feed0198f70 con 0x7feed0108ad0 2023-09-23T09:45:08.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.236+0000 7feed5bff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feed01990e0 con 0x7feed0102ac0 2023-09-23T09:45:08.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.236+0000 7feed5bff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feed01992a0 con 0x7feed0103480 2023-09-23T09:45:08.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.237+0000 7feecffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feed0108ad0 0x7feed0198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:45:08.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.237+0000 7feecffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feed0108ad0 0x7feed0198900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44906/0 (socket says 172.21.15.82:44906) 2023-09-23T09:45:08.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.237+0000 7feecffff700 1 -- 172.21.15.82:0/1890247720 learned_addr learned my addr 172.21.15.82:0/1890247720 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:45:08.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.237+0000 7feecf7fe700 1 --2- 172.21.15.82:0/1890247720 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feed0102ac0 0x7feed019e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:45:08.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.237+0000 7feecffff700 1 -- 172.21.15.82:0/1890247720 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feed0103480 msgr2=0x7feed019edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:45:08.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.237+0000 7feecffff700 1 --2- 172.21.15.82:0/1890247720 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feed0103480 0x7feed019edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:45:08.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.237+0000 7feecffff700 1 -- 172.21.15.82:0/1890247720 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feed0102ac0 msgr2=0x7feed019e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:45:08.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.237+0000 7feecffff700 1 --2- 172.21.15.82:0/1890247720 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feed0102ac0 0x7feed019e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:45:08.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.237+0000 7feecffff700 1 -- 172.21.15.82:0/1890247720 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec40095f0 con 0x7feed0108ad0 2023-09-23T09:45:08.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.237+0000 7feecf7fe700 1 --2- 172.21.15.82:0/1890247720 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feed0102ac0 0x7feed019e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:45:08.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.238+0000 7feecffff700 1 --2- 172.21.15.82:0/1890247720 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feed0108ad0 0x7feed0198900 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7feec8007ee0 tx=0x7feec800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:45:08.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.238+0000 7feeccff9700 1 -- 172.21.15.82:0/1890247720 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec8017070 con 0x7feed0108ad0 2023-09-23T09:45:08.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.238+0000 7feeccff9700 1 -- 172.21.15.82:0/1890247720 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7feec800f040 con 0x7feed0108ad0 2023-09-23T09:45:08.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.238+0000 7feed5bff700 1 -- 172.21.15.82:0/1890247720 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feed0199580 con 0x7feed0108ad0 2023-09-23T09:45:08.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.238+0000 7feeccff9700 1 -- 172.21.15.82:0/1890247720 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec8005710 con 0x7feed0108ad0 2023-09-23T09:45:08.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.239+0000 7feed5bff700 1 -- 172.21.15.82:0/1890247720 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feed01a5880 con 0x7feed0108ad0 2023-09-23T09:45:08.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.245+0000 7feee95b7b80 1 Processor -- start 2023-09-23T09:45:08.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.245+0000 7feee95b7b80 1 -- start start 2023-09-23T09:45:08.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.246+0000 7feee95b7b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b2dcc5e100 0x55b2dcc5e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:45:08.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.246+0000 7feee95b7b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2dcc5ea20 0x55b2dcc62790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:45:08.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.246+0000 7feee95b7b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2dcc62cd0 0x55b2dcc63130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:45:08.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.246+0000 7feee95b7b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2dcbbd7b0 con 0x55b2dcc5ea20 2023-09-23T09:45:08.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.246+0000 7feee95b7b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2dcbae780 con 0x55b2dcc62cd0 2023-09-23T09:45:08.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.246+0000 7feee95b7b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2dcbac0a0 con 0x55b2dcc5e100 2023-09-23T09:45:08.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.246+0000 7feeccff9700 1 -- 172.21.15.82:0/1890247720 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7feec8005870 con 0x7feed0108ad0 2023-09-23T09:45:08.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.247+0000 7feecf7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2dcc5ea20 0x55b2dcc62790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:45:08.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.247+0000 7feeceffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2dcc62cd0 0x55b2dcc63130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:45:08.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.247+0000 7feecf7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2dcc5ea20 0x55b2dcc62790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44910/0 (socket says 172.21.15.82:44910) 2023-09-23T09:45:08.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.247+0000 7feecf7fe700 1 -- 172.21.15.82:0/2912657057 learned_addr learned my addr 172.21.15.82:0/2912657057 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:45:08.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.247+0000 7feecf7fe700 1 -- 172.21.15.82:0/2912657057 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b2dcc5e100 msgr2=0x55b2dcc5e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:45:08.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.247+0000 7feecf7fe700 1 --2- 172.21.15.82:0/2912657057 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b2dcc5e100 0x55b2dcc5e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:45:08.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.247+0000 7feecf7fe700 1 -- 172.21.15.82:0/2912657057 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2dcc62cd0 msgr2=0x55b2dcc63130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:45:08.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.247+0000 7feecf7fe700 1 --2- 172.21.15.82:0/2912657057 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2dcc62cd0 0x55b2dcc63130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:45:08.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.247+0000 7feecf7fe700 1 -- 172.21.15.82:0/2912657057 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b2dca27630 con 0x55b2dcc5ea20 2023-09-23T09:45:08.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.248+0000 7feecf7fe700 1 --2- 172.21.15.82:0/2912657057 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2dcc5ea20 0x55b2dcc62790 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7feec0009dc0 tx=0x7feec00106b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4fc3e49c4cd5ac3 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:45:08.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.248+0000 7feeccff9700 1 --2- 172.21.15.82:0/1890247720 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7feeb80a01c0 0x7feeb80a2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:45:08.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.248+0000 7feeb5ffb700 1 -- 172.21.15.82:0/2912657057 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec0010e10 con 0x55b2dcc5ea20 2023-09-23T09:45:08.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.248+0000 7feeccff9700 1 -- 172.21.15.82:0/1890247720 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 8557+0+0 (secure 0 0 0) 0x7feec80caf00 con 0x7feed0108ad0 2023-09-23T09:45:08.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.248+0000 7feeb5ffb700 1 -- 172.21.15.82:0/2912657057 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7feec0015070 con 0x55b2dcc5ea20 2023-09-23T09:45:08.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.248+0000 7feeb5ffb700 1 -- 172.21.15.82:0/2912657057 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec00116a0 con 0x55b2dcc5ea20 2023-09-23T09:45:08.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.249+0000 7feeceffd700 1 --2- 172.21.15.82:0/1890247720 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7feeb80a01c0 0x7feeb80a2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:45:08.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.249+0000 7feee95b7b80 1 -- 172.21.15.82:0/2912657057 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2dcc5ea20 msgr2=0x55b2dcc62790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:45:08.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.249+0000 7feee95b7b80 1 --2- 172.21.15.82:0/2912657057 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2dcc5ea20 0x55b2dcc62790 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7feec0009dc0 tx=0x7feec00106b0 comp rx=0 tx=0).stop 2023-09-23T09:45:08.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.250+0000 7feee95b7b80 1 -- 172.21.15.82:0/2912657057 shutdown_connections 2023-09-23T09:45:08.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.250+0000 7feee95b7b80 1 --2- 172.21.15.82:0/2912657057 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2dcc62cd0 0x55b2dcc63130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:45:08.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.250+0000 7feee95b7b80 1 --2- 172.21.15.82:0/2912657057 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b2dcc5e100 0x55b2dcc5e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:45:08.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.250+0000 7feee95b7b80 1 --2- 172.21.15.82:0/2912657057 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2dcc5ea20 0x55b2dcc62790 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:45:08.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.250+0000 7feee95b7b80 1 -- 172.21.15.82:0/2912657057 >> 172.21.15.82:0/2912657057 conn(0x55b2dcbca0e0 msgr2=0x55b2dcc50410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:45:08.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.250+0000 7feee95b7b80 1 -- 172.21.15.82:0/2912657057 shutdown_connections 2023-09-23T09:45:08.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.250+0000 7feee95b7b80 1 -- 172.21.15.82:0/2912657057 wait complete. 2023-09-23T09:45:08.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.251+0000 7feeceffd700 1 --2- 172.21.15.82:0/1890247720 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7feeb80a01c0 0x7feeb80a2680 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7feec400b2e0 tx=0x7feec401a040 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:45:08.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.251+0000 7feee95b7b80 1 -- start start 2023-09-23T09:45:08.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.251+0000 7feee95b7b80 1 Processor -- start 2023-09-23T09:45:08.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.252+0000 7feee95b7b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2dcc5e100 0x55b2dcc6a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:45:08.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.252+0000 7feee95b7b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b2dcc5ea20 0x55b2dcc676c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:45:08.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.252+0000 7feee95b7b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2dcc62cd0 0x55b2dcc67db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:45:08.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.252+0000 7feee95b7b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2dcba7990 con 0x55b2dcc5e100 2023-09-23T09:45:08.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.252+0000 7feee95b7b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2dcb45bb0 con 0x55b2dcc62cd0 2023-09-23T09:45:08.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.252+0000 7feee95b7b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2dcb458b0 con 0x55b2dcc5ea20 2023-09-23T09:45:08.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.252+0000 7feee95b7b80 10 client.0 _ll_register_callbacks cb 0x55b2dca8fa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:45:08.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.253+0000 7feecf7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2dcc5e100 0x55b2dcc6a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:45:08.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.253+0000 7feecf7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2dcc5e100 0x55b2dcc6a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44924/0 (socket says 172.21.15.82:44924) 2023-09-23T09:45:08.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.253+0000 7feecf7fe700 1 -- 172.21.15.82:0/901186684 learned_addr learned my addr 172.21.15.82:0/901186684 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:45:08.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.253+0000 7feeceffd700 1 --2- 172.21.15.82:0/901186684 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b2dcc5ea20 0x55b2dcc676c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:45:08.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.253+0000 7feecffff700 1 --2- 172.21.15.82:0/901186684 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2dcc62cd0 0x55b2dcc67db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:45:08.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.254+0000 7feecf7fe700 1 -- 172.21.15.82:0/901186684 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b2dcc5ea20 msgr2=0x55b2dcc676c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:45:08.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.254+0000 7feecf7fe700 1 --2- 172.21.15.82:0/901186684 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b2dcc5ea20 0x55b2dcc676c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:45:08.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.254+0000 7feecf7fe700 1 -- 172.21.15.82:0/901186684 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2dcc62cd0 msgr2=0x55b2dcc67db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:45:08.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.254+0000 7feecf7fe700 1 --2- 172.21.15.82:0/901186684 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2dcc62cd0 0x55b2dcc67db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:45:08.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.254+0000 7feecf7fe700 1 -- 172.21.15.82:0/901186684 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feec00099f0 con 0x55b2dcc5e100 2023-09-23T09:45:08.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.254+0000 7feecf7fe700 1 --2- 172.21.15.82:0/901186684 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2dcc5e100 0x55b2dcc6a4b0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7feec0009f50 tx=0x7feec0009980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7be692eece2be6 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:45:08.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.255+0000 7feeaeffd700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:45:08.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.255+0000 7feeaeffd700 1 -- 172.21.15.82:0/901186684 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec0020070 con 0x55b2dcc5e100 2023-09-23T09:45:08.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.255+0000 7feeaeffd700 1 -- 172.21.15.82:0/901186684 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(172..172 src has 1..172) v4 ==== 8557+0+0 (secure 0 0 0) 0x7feec0017070 con 0x55b2dcc5e100 2023-09-23T09:45:08.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.255+0000 7feee95b7b80 1 -- 172.21.15.82:0/901186684 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b2dcc251c0 con 0x55b2dcc5e100 2023-09-23T09:45:08.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.256+0000 7feeaeffd700 1 -- 172.21.15.82:0/901186684 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=136) v2 ==== 24+0+0 (secure 0 0 0) 0x7feec001c790 con 0x55b2dcc5e100 2023-09-23T09:45:08.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.256+0000 7feee95b7b80 10 client.18309 fetch_fsmap learned FSMap version 136 2023-09-23T09:45:08.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.256+0000 7feee95b7b80 1 -- 172.21.15.82:0/901186684 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=136,monmap=4+}) v3 -- 0x55b2dc9d3de0 con 0x55b2dcc5e100 2023-09-23T09:45:08.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.256+0000 7feeaeffd700 1 -- 172.21.15.82:0/901186684 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b2dcc251c0 con 0x55b2dcc5e100 2023-09-23T09:45:08.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.257+0000 7feeaeffd700 1 -- 172.21.15.82:0/901186684 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 136) v1 ==== 7914+0+0 (secure 0 0 0) 0x7feec002c070 con 0x55b2dcc5e100 2023-09-23T09:45:08.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.257+0000 7feee95b7b80 10 client.18309 fetch_fsmap finished waiting for FSMap version 136 2023-09-23T09:45:08.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.257+0000 7feee95b7b80 10 client.18309 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:45:08.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.257+0000 7feee95b7b80 20 client.18309 populate_metadata read hostname 'smithi082' 2023-09-23T09:45:08.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.257+0000 7feee95b7b80 1 --2- 172.21.15.82:0/901186684 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55b2dcc88ec0 0x55b2dcc8b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:45:08.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.257+0000 7feee95b7b80 4 client.18309 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:45:08.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.257+0000 7feee95b7b80 1 -- 172.21.15.82:0/901186684 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b2dcb4dba0 con 0x55b2dcc88ec0 2023-09-23T09:45:08.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.257+0000 7feeceffd700 1 --2- 172.21.15.82:0/901186684 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55b2dcc88ec0 0x55b2dcc8b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:45:08.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.258+0000 7feeceffd700 1 --2- 172.21.15.82:0/901186684 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55b2dcc88ec0 0x55b2dcc8b2e0 crc :-1 s=READY pgs=289 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3166ac4b51d9264c server_cookie=e5c2f7362edfd56c in_seq=0 out_seq=0 2023-09-23T09:45:08.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.258+0000 7feeaeffd700 10 client.18309 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:45:08.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.260+0000 7feeaeffd700 1 -- 172.21.15.82:0/901186684 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b2dcb4dba0 con 0x55b2dcc88ec0 2023-09-23T09:45:08.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.260+0000 7feeaeffd700 10 client.18309 handle_command_reply: tid=0 2023-09-23T09:45:08.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.260+0000 7feee95b7b80 1 client.18309 shutdown 2023-09-23T09:45:08.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.263+0000 7feee95b7b80 1 -- 172.21.15.82:0/901186684 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2dcc5e100 msgr2=0x55b2dcc6a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:45:08.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.263+0000 7feee95b7b80 1 --2- 172.21.15.82:0/901186684 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2dcc5e100 0x55b2dcc6a4b0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7feec0009f50 tx=0x7feec0009980 comp rx=0 tx=0).stop 2023-09-23T09:45:08.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.263+0000 7feee95b7b80 1 -- 172.21.15.82:0/901186684 shutdown_connections 2023-09-23T09:45:08.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.263+0000 7feee95b7b80 1 --2- 172.21.15.82:0/901186684 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2dcc62cd0 0x55b2dcc67db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:45:08.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.263+0000 7feee95b7b80 1 --2- 172.21.15.82:0/901186684 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55b2dcc88ec0 0x55b2dcc8b2e0 crc :-1 s=READY pgs=289 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:45:08.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.263+0000 7feee95b7b80 1 --2- 172.21.15.82:0/901186684 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2dcc5e100 0x55b2dcc6a4b0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:45:08.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.263+0000 7feee95b7b80 1 --2- 172.21.15.82:0/901186684 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b2dcc5ea20 0x55b2dcc676c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:45:08.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.263+0000 7feee95b7b80 1 -- 172.21.15.82:0/901186684 >> 172.21.15.82:0/901186684 conn(0x55b2dcbca0e0 msgr2=0x55b2dcc4a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:45:08.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.263+0000 7feeaeffd700 0 client.18309 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:45:08.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.264+0000 7feee95b7b80 1 -- 172.21.15.82:0/901186684 shutdown_connections 2023-09-23T09:45:08.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.264+0000 7feee95b7b80 1 -- 172.21.15.82:0/901186684 wait complete. 2023-09-23T09:45:08.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.265+0000 7feee95b7b80 20 client.18309 trim_cache size 0 max 16384 2023-09-23T09:45:08.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.285+0000 7feee95b7b80 1 Processor -- start 2023-09-23T09:45:08.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.285+0000 7feee95b7b80 1 -- start start 2023-09-23T09:45:08.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.286+0000 7feee95b7b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b2dcc5ea20 0x55b2dcc69fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:45:08.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.286+0000 7feee95b7b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2dcc62cd0 0x55b2dcc60ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:45:08.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.286+0000 7feee95b7b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2dcc605c0 0x55b2dcc61220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:45:08.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.286+0000 7feee95b7b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2dca29920 con 0x55b2dcc62cd0 2023-09-23T09:45:08.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.286+0000 7feee95b7b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2dcc68640 con 0x55b2dcc605c0 2023-09-23T09:45:08.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.286+0000 7feee95b7b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2dcc6adb0 con 0x55b2dcc5ea20 2023-09-23T09:45:08.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.286+0000 7feeceffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2dcc62cd0 0x55b2dcc60ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:45:08.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.286+0000 7feeceffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2dcc62cd0 0x55b2dcc60ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44926/0 (socket says 172.21.15.82:44926) 2023-09-23T09:45:08.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.286+0000 7feeceffd700 1 -- 172.21.15.82:0/403859346 learned_addr learned my addr 172.21.15.82:0/403859346 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:45:08.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.287+0000 7feeceffd700 1 -- 172.21.15.82:0/403859346 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b2dcc5ea20 msgr2=0x55b2dcc69fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:45:08.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.287+0000 7feeceffd700 1 --2- 172.21.15.82:0/403859346 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b2dcc5ea20 0x55b2dcc69fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:45:08.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.287+0000 7feeceffd700 1 -- 172.21.15.82:0/403859346 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2dcc605c0 msgr2=0x55b2dcc61220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:45:08.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.287+0000 7feeceffd700 1 --2- 172.21.15.82:0/403859346 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2dcc605c0 0x55b2dcc61220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:45:08.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.287+0000 7feeceffd700 1 -- 172.21.15.82:0/403859346 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b2dcc8ff10 con 0x55b2dcc62cd0 2023-09-23T09:45:08.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.287+0000 7feeceffd700 1 --2- 172.21.15.82:0/403859346 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2dcc62cd0 0x55b2dcc60ce0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7feec4009350 tx=0x7feec4021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b98bdbaf33db1abf server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:45:08.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.288+0000 7feeb67fc700 1 -- 172.21.15.82:0/403859346 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec400b990 con 0x55b2dcc62cd0 2023-09-23T09:45:08.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.288+0000 7feeb67fc700 1 -- 172.21.15.82:0/403859346 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7feec4005920 con 0x55b2dcc62cd0 2023-09-23T09:45:08.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.288+0000 7feeb67fc700 1 -- 172.21.15.82:0/403859346 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec4024e90 con 0x55b2dcc62cd0 2023-09-23T09:45:08.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.289+0000 7feee95b7b80 1 -- 172.21.15.82:0/403859346 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2dcc62cd0 msgr2=0x55b2dcc60ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:45:08.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.289+0000 7feee95b7b80 1 --2- 172.21.15.82:0/403859346 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2dcc62cd0 0x55b2dcc60ce0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7feec4009350 tx=0x7feec4021000 comp rx=0 tx=0).stop 2023-09-23T09:45:08.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.290+0000 7feee95b7b80 1 -- 172.21.15.82:0/403859346 shutdown_connections 2023-09-23T09:45:08.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.290+0000 7feee95b7b80 1 --2- 172.21.15.82:0/403859346 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2dcc605c0 0x55b2dcc61220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:45:08.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.290+0000 7feee95b7b80 1 --2- 172.21.15.82:0/403859346 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b2dcc5ea20 0x55b2dcc69fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:45:08.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.290+0000 7feee95b7b80 1 --2- 172.21.15.82:0/403859346 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2dcc62cd0 0x55b2dcc60ce0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:45:08.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.290+0000 7feee95b7b80 1 -- 172.21.15.82:0/403859346 >> 172.21.15.82:0/403859346 conn(0x55b2dcbca0e0 msgr2=0x55b2dcc650c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:45:08.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.290+0000 7feee95b7b80 1 -- 172.21.15.82:0/403859346 shutdown_connections 2023-09-23T09:45:08.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.290+0000 7feee95b7b80 1 -- 172.21.15.82:0/403859346 wait complete. 2023-09-23T09:45:08.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.290+0000 7feee95b7b80 1 -- start start 2023-09-23T09:45:08.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.291+0000 7feee95b7b80 1 Processor -- start 2023-09-23T09:45:08.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.291+0000 7feee95b7b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2dcc5ea20 0x55b2dcc6eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:45:08.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.291+0000 7feee95b7b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2dcc605c0 0x55b2dcc6b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:45:08.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.291+0000 7feee95b7b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b2dcc62cd0 0x55b2dcc6b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:45:08.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.291+0000 7feee95b7b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2dcc6bac0 con 0x55b2dcc5ea20 2023-09-23T09:45:08.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.291+0000 7feee95b7b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2dcc6bc30 con 0x55b2dcc605c0 2023-09-23T09:45:08.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.291+0000 7feee95b7b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2dcc6bdf0 con 0x55b2dcc62cd0 2023-09-23T09:45:08.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.291+0000 7feee95b7b80 10 client.0 _ll_register_callbacks cb 0x55b2dca8fa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:45:08.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.292+0000 7feecf7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2dcc5ea20 0x55b2dcc6eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:45:08.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.292+0000 7feecf7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2dcc5ea20 0x55b2dcc6eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44938/0 (socket says 172.21.15.82:44938) 2023-09-23T09:45:08.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.292+0000 7feecf7fe700 1 -- 172.21.15.82:0/3746488723 learned_addr learned my addr 172.21.15.82:0/3746488723 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:45:08.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.292+0000 7feecffff700 1 --2- 172.21.15.82:0/3746488723 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b2dcc62cd0 0x55b2dcc6b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:45:08.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.293+0000 7feeceffd700 1 --2- 172.21.15.82:0/3746488723 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2dcc605c0 0x55b2dcc6b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:45:08.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.293+0000 7feecf7fe700 1 -- 172.21.15.82:0/3746488723 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b2dcc62cd0 msgr2=0x55b2dcc6b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:45:08.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.293+0000 7feecf7fe700 1 --2- 172.21.15.82:0/3746488723 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b2dcc62cd0 0x55b2dcc6b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:45:08.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.293+0000 7feecf7fe700 1 -- 172.21.15.82:0/3746488723 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2dcc605c0 msgr2=0x55b2dcc6b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:45:08.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.293+0000 7feecf7fe700 1 --2- 172.21.15.82:0/3746488723 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2dcc605c0 0x55b2dcc6b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:45:08.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.293+0000 7feecf7fe700 1 -- 172.21.15.82:0/3746488723 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feec402c040 con 0x55b2dcc5ea20 2023-09-23T09:45:08.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.293+0000 7feecf7fe700 1 --2- 172.21.15.82:0/3746488723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2dcc5ea20 0x55b2dcc6eda0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7feec0005570 tx=0x7feec00106b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1819773f7f62513a server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:45:08.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.293+0000 7feeaeffd700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:45:08.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.294+0000 7feeaeffd700 1 -- 172.21.15.82:0/3746488723 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec0020020 con 0x55b2dcc5ea20 2023-09-23T09:45:08.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.294+0000 7feeaeffd700 1 -- 172.21.15.82:0/3746488723 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(172..172 src has 1..172) v4 ==== 8557+0+0 (secure 0 0 0) 0x7feec0017070 con 0x55b2dcc5ea20 2023-09-23T09:45:08.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.294+0000 7feee95b7b80 1 -- 172.21.15.82:0/3746488723 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b2dcc488b0 con 0x55b2dcc5ea20 2023-09-23T09:45:08.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.294+0000 7feeaeffd700 1 -- 172.21.15.82:0/3746488723 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=136) v2 ==== 24+0+0 (secure 0 0 0) 0x7feec00092d0 con 0x55b2dcc5ea20 2023-09-23T09:45:08.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.294+0000 7feee95b7b80 10 client.18315 fetch_fsmap learned FSMap version 136 2023-09-23T09:45:08.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.294+0000 7feee95b7b80 1 -- 172.21.15.82:0/3746488723 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=136,monmap=4+}) v3 -- 0x55b2dc9bcc60 con 0x55b2dcc5ea20 2023-09-23T09:45:08.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.295+0000 7feeaeffd700 1 -- 172.21.15.82:0/3746488723 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b2dcc488b0 con 0x55b2dcc5ea20 2023-09-23T09:45:08.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.295+0000 7feeaeffd700 1 -- 172.21.15.82:0/3746488723 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 136) v1 ==== 7914+0+0 (secure 0 0 0) 0x7feec0010720 con 0x55b2dcc5ea20 2023-09-23T09:45:08.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.295+0000 7feee95b7b80 10 client.18315 fetch_fsmap finished waiting for FSMap version 136 2023-09-23T09:45:08.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.295+0000 7feee95b7b80 10 client.18315 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:45:08.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.295+0000 7feee95b7b80 20 client.18315 populate_metadata read hostname 'smithi082' 2023-09-23T09:45:08.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.295+0000 7feee95b7b80 1 --2- 172.21.15.82:0/3746488723 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55b2dccddec0 0x55b2dcce02e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:45:08.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.295+0000 7feee95b7b80 4 client.18315 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:45:08.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.295+0000 7feee95b7b80 1 -- 172.21.15.82:0/3746488723 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55b2dcba0970 con 0x55b2dccddec0 2023-09-23T09:45:08.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.303+0000 7feeceffd700 1 --2- 172.21.15.82:0/3746488723 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55b2dccddec0 0x55b2dcce02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:45:08.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.306+0000 7feeceffd700 1 --2- 172.21.15.82:0/3746488723 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55b2dccddec0 0x55b2dcce02e0 crc :-1 s=READY pgs=290 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68ad7a6e87cda30f server_cookie=26896616f2f5f27a in_seq=0 out_seq=0 2023-09-23T09:45:08.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.306+0000 7feeaeffd700 10 client.18315 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:45:08.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.306+0000 7feeaeffd700 1 -- 172.21.15.82:0/3746488723 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55b2dcba0970 con 0x55b2dccddec0 2023-09-23T09:45:08.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.306+0000 7feeaeffd700 10 client.18315 handle_command_reply: tid=0 2023-09-23T09:45:08.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.306+0000 7feee95b7b80 1 client.18315 shutdown 2023-09-23T09:45:08.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.307+0000 7feee95b7b80 1 -- 172.21.15.82:0/3746488723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2dcc5ea20 msgr2=0x55b2dcc6eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:45:08.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.307+0000 7feee95b7b80 1 --2- 172.21.15.82:0/3746488723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2dcc5ea20 0x55b2dcc6eda0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7feec0005570 tx=0x7feec00106b0 comp rx=0 tx=0).stop 2023-09-23T09:45:08.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.307+0000 7feee95b7b80 1 -- 172.21.15.82:0/3746488723 shutdown_connections 2023-09-23T09:45:08.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.307+0000 7feee95b7b80 1 --2- 172.21.15.82:0/3746488723 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55b2dcc62cd0 0x55b2dcc6b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:45:08.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.307+0000 7feee95b7b80 1 --2- 172.21.15.82:0/3746488723 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55b2dccddec0 0x55b2dcce02e0 crc :-1 s=READY pgs=290 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:45:08.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.307+0000 7feee95b7b80 1 --2- 172.21.15.82:0/3746488723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2dcc5ea20 0x55b2dcc6eda0 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:45:08.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.307+0000 7feee95b7b80 1 --2- 172.21.15.82:0/3746488723 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2dcc605c0 0x55b2dcc6b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:45:08.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.307+0000 7feee95b7b80 1 -- 172.21.15.82:0/3746488723 >> 172.21.15.82:0/3746488723 conn(0x55b2dcbca0e0 msgr2=0x55b2dcc650c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:45:08.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.307+0000 7feeaeffd700 0 client.18315 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:45:08.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.307+0000 7feee95b7b80 1 -- 172.21.15.82:0/3746488723 shutdown_connections 2023-09-23T09:45:08.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.307+0000 7feee95b7b80 1 -- 172.21.15.82:0/3746488723 wait complete. 2023-09-23T09:45:08.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.308+0000 7feee95b7b80 20 client.18315 trim_cache size 0 max 16384 2023-09-23T09:45:08.311 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:45:08.311 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-23T09:45:08.311 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:45:08.311 INFO:teuthology.orchestra.run.smithi082.stdout: "d9e62ab8-1468-4fb0-a9fe-61bed13e954b": { 2023-09-23T09:45:08.311 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:45:08.312 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "d9e62ab8-1468-4fb0-a9fe-61bed13e954b", 2023-09-23T09:45:08.312 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:45:08.312 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:45:08.312 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:45:08.312 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:45:08.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.309+0000 7feed5bff700 1 -- 172.21.15.82:0/1890247720 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7feeb80a01c0 msgr2=0x7feeb80a2680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:45:08.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.309+0000 7feed5bff700 1 --2- 172.21.15.82:0/1890247720 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7feeb80a01c0 0x7feeb80a2680 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7feec400b2e0 tx=0x7feec401a040 comp rx=0 tx=0).stop 2023-09-23T09:45:08.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.309+0000 7feed5bff700 1 -- 172.21.15.82:0/1890247720 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feed0108ad0 msgr2=0x7feed0198900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:45:08.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.309+0000 7feed5bff700 1 --2- 172.21.15.82:0/1890247720 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feed0108ad0 0x7feed0198900 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7feec8007ee0 tx=0x7feec800d3b0 comp rx=0 tx=0).stop 2023-09-23T09:45:08.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.309+0000 7feed5bff700 1 -- 172.21.15.82:0/1890247720 shutdown_connections 2023-09-23T09:45:08.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.309+0000 7feed5bff700 1 --2- 172.21.15.82:0/1890247720 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7feeb80a01c0 0x7feeb80a2680 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:45:08.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.309+0000 7feed5bff700 1 --2- 172.21.15.82:0/1890247720 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feed0108ad0 0x7feed0198900 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:45:08.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.309+0000 7feed5bff700 1 --2- 172.21.15.82:0/1890247720 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feed0102ac0 0x7feed019e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:45:08.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.309+0000 7feed5bff700 1 --2- 172.21.15.82:0/1890247720 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feed0103480 0x7feed019edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:45:08.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.309+0000 7feed5bff700 1 -- 172.21.15.82:0/1890247720 >> 172.21.15.82:0/1890247720 conn(0x7feed00fe570 msgr2=0x7feed00fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:45:08.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.309+0000 7feed5bff700 1 -- 172.21.15.82:0/1890247720 shutdown_connections 2023-09-23T09:45:08.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:08.309+0000 7feed5bff700 1 -- 172.21.15.82:0/1890247720 wait complete. 2023-09-23T09:45:08.335 INFO:tasks.cephfs.filesystem:scrub status for tag:d9e62ab8-1468-4fb0-a9fe-61bed13e954b - {'path': '/', 'tag': 'd9e62ab8-1468-4fb0-a9fe-61bed13e954b', 'options': 'recursive,force'} 2023-09-23T09:45:08.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:45:08 smithi082 ceph-mon[97694]: pgmap v1533: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 212 KiB/s wr, 36 op/s 2023-09-23T09:45:08.794 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:45:08 smithi135 ceph-mon[99205]: pgmap v1533: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 212 KiB/s wr, 36 op/s 2023-09-23T09:45:08.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:45:08 smithi161 ceph-mon[99580]: pgmap v1533: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 212 KiB/s wr, 36 op/s 2023-09-23T09:45:11.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:45:11 smithi135 ceph-mon[99205]: pgmap v1534: 97 pgs: 9 active+clean+snaptrim, 18 active+clean+snaptrim_wait, 70 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 232 KiB/s wr, 38 op/s 2023-09-23T09:45:11.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:45:11 smithi082 ceph-mon[97694]: pgmap v1534: 97 pgs: 9 active+clean+snaptrim, 18 active+clean+snaptrim_wait, 70 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 232 KiB/s wr, 38 op/s 2023-09-23T09:45:11.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:45:11 smithi161 ceph-mon[99580]: pgmap v1534: 97 pgs: 9 active+clean+snaptrim, 18 active+clean+snaptrim_wait, 70 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 232 KiB/s wr, 38 op/s 2023-09-23T09:45:13.310 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:45:13 smithi135 ceph-mon[99205]: pgmap v1535: 97 pgs: 11 active+clean+snaptrim, 24 active+clean+snaptrim_wait, 62 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 291 KiB/s wr, 39 op/s 2023-09-23T09:45:13.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:45:13 smithi082 ceph-mon[97694]: pgmap v1535: 97 pgs: 11 active+clean+snaptrim, 24 active+clean+snaptrim_wait, 62 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 291 KiB/s wr, 39 op/s 2023-09-23T09:45:13.396 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:45:13 smithi161 ceph-mon[99580]: pgmap v1535: 97 pgs: 11 active+clean+snaptrim, 24 active+clean+snaptrim_wait, 62 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 291 KiB/s wr, 39 op/s 2023-09-23T09:45:14.106 DEBUG:teuthology.orchestra.run.smithi082:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2023-09-23T09:45:14.938 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/: 2023-09-23T09:45:14.938 INFO:teuthology.orchestra.run.smithi082.stdout:total 2 2023-09-23T09:45:14.938 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 8989915420 Sep 23 08:56 . 2023-09-23T09:45:14.939 INFO:teuthology.orchestra.run.smithi082.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 8989915420 Sep 23 08:56 .. 2023-09-23T09:45:14.939 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 8989927083 Sep 23 09:45 data 2023-09-23T09:45:14.939 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T09:45:14.939 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data: 2023-09-23T09:45:14.939 INFO:teuthology.orchestra.run.smithi082.stdout:total 41 2023-09-23T09:45:14.939 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 8989927083 Sep 23 09:45 . 2023-09-23T09:45:14.939 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 8989915420 Sep 23 08:56 .. 2023-09-23T09:45:14.939 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 7915405453 Sep 23 09:24 base 2023-09-23T09:45:14.939 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 30 Sep 23 08:57 current_logfiles 2023-09-23T09:45:14.939 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 587404 Sep 23 08:57 global 2023-09-23T09:45:14.939 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 522 Sep 23 08:57 log 2023-09-23T09:45:14.940 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 pg_commit_ts 2023-09-23T09:45:14.940 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 pg_dynshmem 2023-09-23T09:45:14.940 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 4269 Sep 23 08:57 pg_hba.conf 2023-09-23T09:45:14.940 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1636 Sep 23 08:57 pg_ident.conf 2023-09-23T09:45:14.940 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Sep 23 09:44 pg_logical 2023-09-23T09:45:14.940 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 pg_multixact 2023-09-23T09:45:14.940 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 pg_notify 2023-09-23T09:45:14.940 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 pg_replslot 2023-09-23T09:45:14.940 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 pg_serial 2023-09-23T09:45:14.940 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 pg_snapshots 2023-09-23T09:45:14.940 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 11771 Sep 23 09:45 pg_stat 2023-09-23T09:45:14.940 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 11771 Sep 23 09:45 pg_stat_tmp 2023-09-23T09:45:14.941 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 23 09:43 pg_subtrans 2023-09-23T09:45:14.941 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 pg_tblspc 2023-09-23T09:45:14.941 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 pg_twophase 2023-09-23T09:45:14.941 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 23 08:57 PG_VERSION 2023-09-23T09:45:14.941 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1073741824 Sep 23 09:45 pg_wal 2023-09-23T09:45:14.941 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 73728 Sep 23 08:57 pg_xact 2023-09-23T09:45:14.941 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 88 Sep 23 08:57 postgresql.auto.conf 2023-09-23T09:45:14.941 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 22989 Sep 23 08:57 postgresql.conf 2023-09-23T09:45:14.941 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 51 Sep 23 08:57 postmaster.opts 2023-09-23T09:45:14.941 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T09:45:14.941 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/base: 2023-09-23T09:45:14.941 INFO:teuthology.orchestra.run.smithi082.stdout:total 3 2023-09-23T09:45:14.942 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 7915405453 Sep 23 09:24 . 2023-09-23T09:45:14.942 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 8989927083 Sep 23 09:45 .. 2023-09-23T09:45:14.942 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7381507 Sep 23 08:57 1 2023-09-23T09:45:14.942 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7381507 Sep 23 08:57 12346 2023-09-23T09:45:14.942 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7900642439 Sep 23 09:28 12347 2023-09-23T09:45:14.942 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 09:27 pgsql_tmp 2023-09-23T09:45:14.942 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T09:45:14.942 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/base/1: 2023-09-23T09:45:14.942 INFO:teuthology.orchestra.run.smithi082.stdout:total 7210 2023-09-23T09:45:14.942 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7381507 Sep 23 08:57 . 2023-09-23T09:45:14.942 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 7915405453 Sep 23 09:24 .. 2023-09-23T09:45:14.942 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 112 2023-09-23T09:45:14.942 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 113 2023-09-23T09:45:14.943 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 23 08:57 12182 2023-09-23T09:45:14.943 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 12182_fsm 2023-09-23T09:45:14.943 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12182_vm 2023-09-23T09:45:14.943 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 12184 2023-09-23T09:45:14.943 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12186 2023-09-23T09:45:14.943 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12187 2023-09-23T09:45:14.943 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 12187_fsm 2023-09-23T09:45:14.943 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12187_vm 2023-09-23T09:45:14.943 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 12189 2023-09-23T09:45:14.943 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12191 2023-09-23T09:45:14.943 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12192 2023-09-23T09:45:14.943 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 12192_fsm 2023-09-23T09:45:14.944 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12192_vm 2023-09-23T09:45:14.944 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 12194 2023-09-23T09:45:14.944 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12196 2023-09-23T09:45:14.944 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12197 2023-09-23T09:45:14.944 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 12197_fsm 2023-09-23T09:45:14.944 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12197_vm 2023-09-23T09:45:14.944 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 12199 2023-09-23T09:45:14.944 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12201 2023-09-23T09:45:14.944 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12202 2023-09-23T09:45:14.944 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 12202_fsm 2023-09-23T09:45:14.944 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12202_vm 2023-09-23T09:45:14.944 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 12204 2023-09-23T09:45:14.944 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12206 2023-09-23T09:45:14.945 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12207 2023-09-23T09:45:14.945 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 12207_fsm 2023-09-23T09:45:14.945 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12207_vm 2023-09-23T09:45:14.945 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 12209 2023-09-23T09:45:14.945 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12211 2023-09-23T09:45:14.945 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 12212 2023-09-23T09:45:14.945 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 12214 2023-09-23T09:45:14.945 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12216 2023-09-23T09:45:14.945 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 73728 Sep 23 08:57 1247 2023-09-23T09:45:14.945 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 1247_fsm 2023-09-23T09:45:14.945 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 1247_vm 2023-09-23T09:45:14.945 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 393216 Sep 23 08:57 1249 2023-09-23T09:45:14.946 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 1249_fsm 2023-09-23T09:45:14.946 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 1249_vm 2023-09-23T09:45:14.946 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 606208 Sep 23 08:57 1255 2023-09-23T09:45:14.946 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 1255_fsm 2023-09-23T09:45:14.946 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 1255_vm 2023-09-23T09:45:14.946 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 23 08:57 1259 2023-09-23T09:45:14.946 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 1259_fsm 2023-09-23T09:45:14.946 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 1259_vm 2023-09-23T09:45:14.946 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 1417 2023-09-23T09:45:14.946 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 1417_vm 2023-09-23T09:45:14.947 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 1418 2023-09-23T09:45:14.947 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 1418_vm 2023-09-23T09:45:14.947 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 174 2023-09-23T09:45:14.947 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 175 2023-09-23T09:45:14.947 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2187 2023-09-23T09:45:14.947 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2224 2023-09-23T09:45:14.947 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2224_vm 2023-09-23T09:45:14.947 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2328 2023-09-23T09:45:14.947 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2328_vm 2023-09-23T09:45:14.947 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2336 2023-09-23T09:45:14.947 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2336_vm 2023-09-23T09:45:14.948 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2337 2023-09-23T09:45:14.948 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2600 2023-09-23T09:45:14.948 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2600_fsm 2023-09-23T09:45:14.948 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2600_vm 2023-09-23T09:45:14.948 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2601 2023-09-23T09:45:14.948 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2601_fsm 2023-09-23T09:45:14.948 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2601_vm 2023-09-23T09:45:14.948 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 23 08:57 2602 2023-09-23T09:45:14.948 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2602_fsm 2023-09-23T09:45:14.948 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2602_vm 2023-09-23T09:45:14.948 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 23 08:57 2603 2023-09-23T09:45:14.948 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2603_fsm 2023-09-23T09:45:14.949 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2603_vm 2023-09-23T09:45:14.949 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2604 2023-09-23T09:45:14.949 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2604_vm 2023-09-23T09:45:14.949 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2605 2023-09-23T09:45:14.949 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2605_fsm 2023-09-23T09:45:14.949 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2605_vm 2023-09-23T09:45:14.949 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2606 2023-09-23T09:45:14.949 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2606_fsm 2023-09-23T09:45:14.949 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2606_vm 2023-09-23T09:45:14.949 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2607 2023-09-23T09:45:14.949 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2607_fsm 2023-09-23T09:45:14.949 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2607_vm 2023-09-23T09:45:14.949 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 442368 Sep 23 08:57 2608 2023-09-23T09:45:14.950 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2608_fsm 2023-09-23T09:45:14.950 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2608_vm 2023-09-23T09:45:14.950 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 286720 Sep 23 08:57 2609 2023-09-23T09:45:14.950 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2609_fsm 2023-09-23T09:45:14.950 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2609_vm 2023-09-23T09:45:14.950 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2610 2023-09-23T09:45:14.950 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2610_fsm 2023-09-23T09:45:14.950 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2610_vm 2023-09-23T09:45:14.950 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2611 2023-09-23T09:45:14.950 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2611_vm 2023-09-23T09:45:14.950 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2612 2023-09-23T09:45:14.950 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2612_fsm 2023-09-23T09:45:14.950 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2612_vm 2023-09-23T09:45:14.951 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2613 2023-09-23T09:45:14.951 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2613_vm 2023-09-23T09:45:14.951 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2615 2023-09-23T09:45:14.951 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2615_fsm 2023-09-23T09:45:14.951 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2615_vm 2023-09-23T09:45:14.951 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2616 2023-09-23T09:45:14.951 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2616_fsm 2023-09-23T09:45:14.951 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2616_vm 2023-09-23T09:45:14.951 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Sep 23 08:57 2617 2023-09-23T09:45:14.951 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2617_fsm 2023-09-23T09:45:14.951 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2617_vm 2023-09-23T09:45:14.951 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Sep 23 08:57 2618 2023-09-23T09:45:14.951 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2618_fsm 2023-09-23T09:45:14.951 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2618_vm 2023-09-23T09:45:14.952 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Sep 23 08:57 2619 2023-09-23T09:45:14.952 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2619_fsm 2023-09-23T09:45:14.952 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2619_vm 2023-09-23T09:45:14.952 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2620 2023-09-23T09:45:14.952 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2620_vm 2023-09-23T09:45:14.952 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2650 2023-09-23T09:45:14.952 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2651 2023-09-23T09:45:14.952 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2652 2023-09-23T09:45:14.952 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 23 08:57 2653 2023-09-23T09:45:14.952 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 23 08:57 2654 2023-09-23T09:45:14.952 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 23 08:57 2655 2023-09-23T09:45:14.952 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2656 2023-09-23T09:45:14.952 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2657 2023-09-23T09:45:14.953 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 23 08:57 2658 2023-09-23T09:45:14.953 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 23 08:57 2659 2023-09-23T09:45:14.953 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2660 2023-09-23T09:45:14.953 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2661 2023-09-23T09:45:14.953 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 23 08:57 2662 2023-09-23T09:45:14.953 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 23 08:57 2663 2023-09-23T09:45:14.953 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2664 2023-09-23T09:45:14.953 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2665 2023-09-23T09:45:14.953 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2666 2023-09-23T09:45:14.953 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2667 2023-09-23T09:45:14.953 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2668 2023-09-23T09:45:14.953 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2669 2023-09-23T09:45:14.954 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2670 2023-09-23T09:45:14.954 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 335872 Sep 23 08:57 2673 2023-09-23T09:45:14.954 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 376832 Sep 23 08:57 2674 2023-09-23T09:45:14.954 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 180224 Sep 23 08:57 2675 2023-09-23T09:45:14.954 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2678 2023-09-23T09:45:14.954 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2679 2023-09-23T09:45:14.954 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2680 2023-09-23T09:45:14.954 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2681 2023-09-23T09:45:14.954 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2682 2023-09-23T09:45:14.954 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2683 2023-09-23T09:45:14.954 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2684 2023-09-23T09:45:14.954 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2685 2023-09-23T09:45:14.955 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2686 2023-09-23T09:45:14.955 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2687 2023-09-23T09:45:14.955 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 23 08:57 2688 2023-09-23T09:45:14.955 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 23 08:57 2689 2023-09-23T09:45:14.955 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 23 08:57 2690 2023-09-23T09:45:14.955 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 270336 Sep 23 08:57 2691 2023-09-23T09:45:14.955 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2692 2023-09-23T09:45:14.955 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2693 2023-09-23T09:45:14.955 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2696 2023-09-23T09:45:14.955 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2699 2023-09-23T09:45:14.955 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2701 2023-09-23T09:45:14.955 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2702 2023-09-23T09:45:14.956 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2703 2023-09-23T09:45:14.956 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 23 08:57 2704 2023-09-23T09:45:14.956 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2753 2023-09-23T09:45:14.956 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2753_fsm 2023-09-23T09:45:14.956 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2753_vm 2023-09-23T09:45:14.956 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2754 2023-09-23T09:45:14.956 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2755 2023-09-23T09:45:14.956 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 23 08:57 2756 2023-09-23T09:45:14.956 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 23 08:57 2757 2023-09-23T09:45:14.956 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2830 2023-09-23T09:45:14.956 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2830_vm 2023-09-23T09:45:14.956 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2831 2023-09-23T09:45:14.957 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2832 2023-09-23T09:45:14.957 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2832_vm 2023-09-23T09:45:14.957 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2833 2023-09-23T09:45:14.957 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2834 2023-09-23T09:45:14.957 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2834_vm 2023-09-23T09:45:14.957 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2835 2023-09-23T09:45:14.957 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2836 2023-09-23T09:45:14.957 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2836_vm 2023-09-23T09:45:14.957 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2837 2023-09-23T09:45:14.957 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 417792 Sep 23 08:57 2838 2023-09-23T09:45:14.957 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2838_fsm 2023-09-23T09:45:14.957 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2838_vm 2023-09-23T09:45:14.957 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2839 2023-09-23T09:45:14.958 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2840 2023-09-23T09:45:14.958 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2840_fsm 2023-09-23T09:45:14.958 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2840_vm 2023-09-23T09:45:14.958 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2841 2023-09-23T09:45:14.958 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2995 2023-09-23T09:45:14.958 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2995_vm 2023-09-23T09:45:14.958 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2996 2023-09-23T09:45:14.958 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3079 2023-09-23T09:45:14.958 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 3079_fsm 2023-09-23T09:45:14.958 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3079_vm 2023-09-23T09:45:14.958 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3080 2023-09-23T09:45:14.959 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3081 2023-09-23T09:45:14.959 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3085 2023-09-23T09:45:14.959 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3118 2023-09-23T09:45:14.959 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3118_vm 2023-09-23T09:45:14.959 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3119 2023-09-23T09:45:14.959 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3164 2023-09-23T09:45:14.959 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3256 2023-09-23T09:45:14.959 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3256_vm 2023-09-23T09:45:14.959 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3257 2023-09-23T09:45:14.959 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3258 2023-09-23T09:45:14.959 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3350 2023-09-23T09:45:14.959 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3350_vm 2023-09-23T09:45:14.959 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3351 2023-09-23T09:45:14.960 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3379 2023-09-23T09:45:14.960 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3380 2023-09-23T09:45:14.960 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3381 2023-09-23T09:45:14.960 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3381_vm 2023-09-23T09:45:14.960 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3394 2023-09-23T09:45:14.960 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 3394_fsm 2023-09-23T09:45:14.960 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3394_vm 2023-09-23T09:45:14.960 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3395 2023-09-23T09:45:14.960 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3439 2023-09-23T09:45:14.960 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3439_vm 2023-09-23T09:45:14.960 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3440 2023-09-23T09:45:14.960 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 23 08:57 3455 2023-09-23T09:45:14.961 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3456 2023-09-23T09:45:14.961 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 3456_fsm 2023-09-23T09:45:14.961 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3456_vm 2023-09-23T09:45:14.961 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3466 2023-09-23T09:45:14.961 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3466_vm 2023-09-23T09:45:14.961 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3467 2023-09-23T09:45:14.961 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3468 2023-09-23T09:45:14.961 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3501 2023-09-23T09:45:14.961 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3501_vm 2023-09-23T09:45:14.961 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3502 2023-09-23T09:45:14.961 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3503 2023-09-23T09:45:14.961 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3534 2023-09-23T09:45:14.961 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3541 2023-09-23T09:45:14.962 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 3541_fsm 2023-09-23T09:45:14.962 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3541_vm 2023-09-23T09:45:14.962 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3542 2023-09-23T09:45:14.962 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3574 2023-09-23T09:45:14.962 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3575 2023-09-23T09:45:14.962 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3576 2023-09-23T09:45:14.962 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3576_vm 2023-09-23T09:45:14.962 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3596 2023-09-23T09:45:14.962 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3596_vm 2023-09-23T09:45:14.962 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3597 2023-09-23T09:45:14.962 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3598 2023-09-23T09:45:14.962 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3598_vm 2023-09-23T09:45:14.963 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3599 2023-09-23T09:45:14.963 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3600 2023-09-23T09:45:14.963 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 3600_fsm 2023-09-23T09:45:14.963 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3600_vm 2023-09-23T09:45:14.963 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3601 2023-09-23T09:45:14.963 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 3601_fsm 2023-09-23T09:45:14.963 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3601_vm 2023-09-23T09:45:14.963 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3602 2023-09-23T09:45:14.963 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 3602_fsm 2023-09-23T09:45:14.963 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3602_vm 2023-09-23T09:45:14.963 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3603 2023-09-23T09:45:14.963 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 3603_fsm 2023-09-23T09:45:14.963 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3603_vm 2023-09-23T09:45:14.964 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3604 2023-09-23T09:45:14.964 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3605 2023-09-23T09:45:14.964 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3606 2023-09-23T09:45:14.964 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3607 2023-09-23T09:45:14.964 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3608 2023-09-23T09:45:14.964 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 23 08:57 3609 2023-09-23T09:45:14.964 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3712 2023-09-23T09:45:14.964 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3764 2023-09-23T09:45:14.964 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 3764_fsm 2023-09-23T09:45:14.964 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3764_vm 2023-09-23T09:45:14.964 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3766 2023-09-23T09:45:14.964 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3767 2023-09-23T09:45:14.965 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3997 2023-09-23T09:45:14.965 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 5002 2023-09-23T09:45:14.965 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 548 2023-09-23T09:45:14.965 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 549 2023-09-23T09:45:14.965 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 6102 2023-09-23T09:45:14.965 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 6102_vm 2023-09-23T09:45:14.965 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 6104 2023-09-23T09:45:14.965 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 6104_vm 2023-09-23T09:45:14.965 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 6106 2023-09-23T09:45:14.965 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 6106_vm 2023-09-23T09:45:14.965 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 6110 2023-09-23T09:45:14.965 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 6111 2023-09-23T09:45:14.965 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 6112 2023-09-23T09:45:14.966 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 6113 2023-09-23T09:45:14.966 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 6117 2023-09-23T09:45:14.966 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 826 2023-09-23T09:45:14.966 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 826_vm 2023-09-23T09:45:15.310 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:45:15 smithi135 ceph-mon[99205]: pgmap v1536: 97 pgs: 11 active+clean+snaptrim, 24 active+clean+snaptrim_wait, 62 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 291 KiB/s wr, 39 op/s 2023-09-23T09:45:15.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:45:15 smithi082 ceph-mon[97694]: pgmap v1536: 97 pgs: 11 active+clean+snaptrim, 24 active+clean+snaptrim_wait, 62 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 291 KiB/s wr, 39 op/s 2023-09-23T09:45:15.396 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:45:15 smithi161 ceph-mon[99580]: pgmap v1536: 97 pgs: 11 active+clean+snaptrim, 24 active+clean+snaptrim_wait, 62 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 291 KiB/s wr, 39 op/s 2023-09-23T09:45:15.500 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 827 2023-09-23T09:45:15.501 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 828 2023-09-23T09:45:15.501 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 23 08:57 pg_filenode.map 2023-09-23T09:45:15.501 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 23 08:57 PG_VERSION 2023-09-23T09:45:15.501 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T09:45:15.501 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/base/12346: 2023-09-23T09:45:15.501 INFO:teuthology.orchestra.run.smithi082.stdout:total 7210 2023-09-23T09:45:15.501 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7381507 Sep 23 08:57 . 2023-09-23T09:45:15.501 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 7915405453 Sep 23 09:24 .. 2023-09-23T09:45:15.501 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 112 2023-09-23T09:45:15.502 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 113 2023-09-23T09:45:15.502 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 23 08:57 12182 2023-09-23T09:45:15.502 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 12182_fsm 2023-09-23T09:45:15.502 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12182_vm 2023-09-23T09:45:15.502 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 12184 2023-09-23T09:45:15.502 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12186 2023-09-23T09:45:15.502 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12187 2023-09-23T09:45:15.502 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 12187_fsm 2023-09-23T09:45:15.502 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12187_vm 2023-09-23T09:45:15.502 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 12189 2023-09-23T09:45:15.502 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12191 2023-09-23T09:45:15.502 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12192 2023-09-23T09:45:15.503 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 12192_fsm 2023-09-23T09:45:15.503 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12192_vm 2023-09-23T09:45:15.503 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 12194 2023-09-23T09:45:15.503 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12196 2023-09-23T09:45:15.503 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12197 2023-09-23T09:45:15.503 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 12197_fsm 2023-09-23T09:45:15.503 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12197_vm 2023-09-23T09:45:15.503 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 12199 2023-09-23T09:45:15.503 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12201 2023-09-23T09:45:15.503 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12202 2023-09-23T09:45:15.503 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 12202_fsm 2023-09-23T09:45:15.503 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12202_vm 2023-09-23T09:45:15.504 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 12204 2023-09-23T09:45:15.504 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12206 2023-09-23T09:45:15.504 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12207 2023-09-23T09:45:15.504 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 12207_fsm 2023-09-23T09:45:15.504 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12207_vm 2023-09-23T09:45:15.504 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 12209 2023-09-23T09:45:15.504 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12211 2023-09-23T09:45:15.504 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 12212 2023-09-23T09:45:15.504 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 12214 2023-09-23T09:45:15.504 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12216 2023-09-23T09:45:15.504 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 73728 Sep 23 08:57 1247 2023-09-23T09:45:15.504 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 1247_fsm 2023-09-23T09:45:15.505 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 1247_vm 2023-09-23T09:45:15.505 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 393216 Sep 23 08:57 1249 2023-09-23T09:45:15.505 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 1249_fsm 2023-09-23T09:45:15.505 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 1249_vm 2023-09-23T09:45:15.505 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 606208 Sep 23 08:57 1255 2023-09-23T09:45:15.505 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 1255_fsm 2023-09-23T09:45:15.505 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 1255_vm 2023-09-23T09:45:15.505 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 23 08:57 1259 2023-09-23T09:45:15.505 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 1259_fsm 2023-09-23T09:45:15.505 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 1259_vm 2023-09-23T09:45:15.505 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 1417 2023-09-23T09:45:15.505 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 1417_vm 2023-09-23T09:45:15.506 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 1418 2023-09-23T09:45:15.506 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 1418_vm 2023-09-23T09:45:15.506 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 174 2023-09-23T09:45:15.506 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 175 2023-09-23T09:45:15.506 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2187 2023-09-23T09:45:15.506 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2224 2023-09-23T09:45:15.506 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2224_vm 2023-09-23T09:45:15.506 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2328 2023-09-23T09:45:15.506 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2328_vm 2023-09-23T09:45:15.506 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2336 2023-09-23T09:45:15.506 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2336_vm 2023-09-23T09:45:15.506 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2337 2023-09-23T09:45:15.507 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2600 2023-09-23T09:45:15.507 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2600_fsm 2023-09-23T09:45:15.507 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2600_vm 2023-09-23T09:45:15.507 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2601 2023-09-23T09:45:15.507 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2601_fsm 2023-09-23T09:45:15.507 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2601_vm 2023-09-23T09:45:15.507 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 23 08:57 2602 2023-09-23T09:45:15.507 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2602_fsm 2023-09-23T09:45:15.507 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2602_vm 2023-09-23T09:45:15.507 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 23 08:57 2603 2023-09-23T09:45:15.507 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2603_fsm 2023-09-23T09:45:15.508 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2603_vm 2023-09-23T09:45:15.508 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2604 2023-09-23T09:45:15.508 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2604_vm 2023-09-23T09:45:15.508 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2605 2023-09-23T09:45:15.508 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2605_fsm 2023-09-23T09:45:15.508 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2605_vm 2023-09-23T09:45:15.508 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2606 2023-09-23T09:45:15.508 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2606_fsm 2023-09-23T09:45:15.508 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2606_vm 2023-09-23T09:45:15.508 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2607 2023-09-23T09:45:15.508 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2607_fsm 2023-09-23T09:45:15.509 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2607_vm 2023-09-23T09:45:15.509 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 442368 Sep 23 08:57 2608 2023-09-23T09:45:15.509 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2608_fsm 2023-09-23T09:45:15.509 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2608_vm 2023-09-23T09:45:15.509 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 286720 Sep 23 08:57 2609 2023-09-23T09:45:15.509 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2609_fsm 2023-09-23T09:45:15.509 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2609_vm 2023-09-23T09:45:15.509 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2610 2023-09-23T09:45:15.509 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2610_fsm 2023-09-23T09:45:15.509 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2610_vm 2023-09-23T09:45:15.509 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2611 2023-09-23T09:45:15.509 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2611_vm 2023-09-23T09:45:15.510 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2612 2023-09-23T09:45:15.510 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2612_fsm 2023-09-23T09:45:15.510 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2612_vm 2023-09-23T09:45:15.510 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2613 2023-09-23T09:45:15.510 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2613_vm 2023-09-23T09:45:15.510 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2615 2023-09-23T09:45:15.510 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2615_fsm 2023-09-23T09:45:15.510 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2615_vm 2023-09-23T09:45:15.510 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2616 2023-09-23T09:45:15.510 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2616_fsm 2023-09-23T09:45:15.510 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2616_vm 2023-09-23T09:45:15.511 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Sep 23 08:57 2617 2023-09-23T09:45:15.511 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2617_fsm 2023-09-23T09:45:15.511 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2617_vm 2023-09-23T09:45:15.511 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Sep 23 08:57 2618 2023-09-23T09:45:15.511 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2618_fsm 2023-09-23T09:45:15.511 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2618_vm 2023-09-23T09:45:15.511 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Sep 23 08:57 2619 2023-09-23T09:45:15.511 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2619_fsm 2023-09-23T09:45:15.511 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2619_vm 2023-09-23T09:45:15.511 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2620 2023-09-23T09:45:15.511 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2620_vm 2023-09-23T09:45:15.511 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2650 2023-09-23T09:45:15.512 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2651 2023-09-23T09:45:15.512 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2652 2023-09-23T09:45:15.512 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 23 08:57 2653 2023-09-23T09:45:15.512 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 23 08:57 2654 2023-09-23T09:45:15.512 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 23 08:57 2655 2023-09-23T09:45:15.512 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2656 2023-09-23T09:45:15.512 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2657 2023-09-23T09:45:15.512 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 23 08:57 2658 2023-09-23T09:45:15.512 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 23 08:57 2659 2023-09-23T09:45:15.512 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2660 2023-09-23T09:45:15.512 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2661 2023-09-23T09:45:15.512 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 23 08:57 2662 2023-09-23T09:45:15.513 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 23 08:57 2663 2023-09-23T09:45:15.513 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2664 2023-09-23T09:45:15.513 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2665 2023-09-23T09:45:15.513 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2666 2023-09-23T09:45:15.513 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2667 2023-09-23T09:45:15.513 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2668 2023-09-23T09:45:15.513 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2669 2023-09-23T09:45:15.513 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2670 2023-09-23T09:45:15.513 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 335872 Sep 23 08:57 2673 2023-09-23T09:45:15.513 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 376832 Sep 23 08:57 2674 2023-09-23T09:45:15.513 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 180224 Sep 23 08:57 2675 2023-09-23T09:45:15.513 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2678 2023-09-23T09:45:15.514 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2679 2023-09-23T09:45:15.514 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2680 2023-09-23T09:45:15.514 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2681 2023-09-23T09:45:15.514 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2682 2023-09-23T09:45:15.514 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2683 2023-09-23T09:45:15.514 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2684 2023-09-23T09:45:15.514 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2685 2023-09-23T09:45:15.514 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2686 2023-09-23T09:45:15.514 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2687 2023-09-23T09:45:15.514 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 23 08:57 2688 2023-09-23T09:45:15.514 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 23 08:57 2689 2023-09-23T09:45:15.514 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 23 08:57 2690 2023-09-23T09:45:15.515 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 270336 Sep 23 08:57 2691 2023-09-23T09:45:15.515 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2692 2023-09-23T09:45:15.515 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2693 2023-09-23T09:45:15.515 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2696 2023-09-23T09:45:15.515 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2699 2023-09-23T09:45:15.515 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2701 2023-09-23T09:45:15.515 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2702 2023-09-23T09:45:15.515 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2703 2023-09-23T09:45:15.515 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 23 08:57 2704 2023-09-23T09:45:15.515 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2753 2023-09-23T09:45:15.515 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2753_fsm 2023-09-23T09:45:15.515 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2753_vm 2023-09-23T09:45:15.516 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2754 2023-09-23T09:45:15.516 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2755 2023-09-23T09:45:15.516 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 23 08:57 2756 2023-09-23T09:45:15.516 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 23 08:57 2757 2023-09-23T09:45:15.516 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2830 2023-09-23T09:45:15.516 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2830_vm 2023-09-23T09:45:15.516 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2831 2023-09-23T09:45:15.516 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2832 2023-09-23T09:45:15.516 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2832_vm 2023-09-23T09:45:15.516 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2833 2023-09-23T09:45:15.516 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2834 2023-09-23T09:45:15.516 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2834_vm 2023-09-23T09:45:15.517 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2835 2023-09-23T09:45:15.517 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2836 2023-09-23T09:45:15.517 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2836_vm 2023-09-23T09:45:15.517 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2837 2023-09-23T09:45:15.517 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 417792 Sep 23 08:57 2838 2023-09-23T09:45:15.517 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2838_fsm 2023-09-23T09:45:15.517 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2838_vm 2023-09-23T09:45:15.517 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2839 2023-09-23T09:45:15.517 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2840 2023-09-23T09:45:15.517 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2840_fsm 2023-09-23T09:45:15.517 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2840_vm 2023-09-23T09:45:15.518 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2841 2023-09-23T09:45:15.518 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2995 2023-09-23T09:45:15.518 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2995_vm 2023-09-23T09:45:15.518 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2996 2023-09-23T09:45:15.518 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3079 2023-09-23T09:45:15.518 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 3079_fsm 2023-09-23T09:45:15.518 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3079_vm 2023-09-23T09:45:15.518 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3080 2023-09-23T09:45:15.518 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3081 2023-09-23T09:45:15.518 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3085 2023-09-23T09:45:15.518 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3118 2023-09-23T09:45:15.518 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3118_vm 2023-09-23T09:45:15.519 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3119 2023-09-23T09:45:15.519 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3164 2023-09-23T09:45:15.519 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3256 2023-09-23T09:45:15.519 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3256_vm 2023-09-23T09:45:15.519 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3257 2023-09-23T09:45:15.519 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3258 2023-09-23T09:45:15.519 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3350 2023-09-23T09:45:15.519 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3350_vm 2023-09-23T09:45:15.519 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3351 2023-09-23T09:45:15.519 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3379 2023-09-23T09:45:15.519 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3380 2023-09-23T09:45:15.519 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3381 2023-09-23T09:45:15.520 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3381_vm 2023-09-23T09:45:15.520 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3394 2023-09-23T09:45:15.520 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 3394_fsm 2023-09-23T09:45:15.520 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3394_vm 2023-09-23T09:45:15.520 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3395 2023-09-23T09:45:15.520 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3439 2023-09-23T09:45:15.520 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3439_vm 2023-09-23T09:45:15.520 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3440 2023-09-23T09:45:15.520 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 23 08:57 3455 2023-09-23T09:45:15.520 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3456 2023-09-23T09:45:15.520 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 3456_fsm 2023-09-23T09:45:15.521 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3456_vm 2023-09-23T09:45:15.521 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3466 2023-09-23T09:45:15.521 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3466_vm 2023-09-23T09:45:15.521 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3467 2023-09-23T09:45:15.521 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3468 2023-09-23T09:45:15.521 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3501 2023-09-23T09:45:15.521 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3501_vm 2023-09-23T09:45:15.521 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3502 2023-09-23T09:45:15.521 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3503 2023-09-23T09:45:15.521 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3534 2023-09-23T09:45:15.521 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3541 2023-09-23T09:45:15.522 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 3541_fsm 2023-09-23T09:45:15.522 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3541_vm 2023-09-23T09:45:15.522 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3542 2023-09-23T09:45:15.522 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3574 2023-09-23T09:45:15.522 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3575 2023-09-23T09:45:15.522 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3576 2023-09-23T09:45:15.522 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3576_vm 2023-09-23T09:45:15.522 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3596 2023-09-23T09:45:15.522 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3596_vm 2023-09-23T09:45:15.522 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3597 2023-09-23T09:45:15.522 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3598 2023-09-23T09:45:15.522 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3598_vm 2023-09-23T09:45:15.523 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3599 2023-09-23T09:45:15.523 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3600 2023-09-23T09:45:15.523 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 3600_fsm 2023-09-23T09:45:15.523 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3600_vm 2023-09-23T09:45:15.523 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3601 2023-09-23T09:45:15.523 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 3601_fsm 2023-09-23T09:45:15.523 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3601_vm 2023-09-23T09:45:15.523 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3602 2023-09-23T09:45:15.523 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 3602_fsm 2023-09-23T09:45:15.523 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3602_vm 2023-09-23T09:45:15.523 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3603 2023-09-23T09:45:15.523 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 3603_fsm 2023-09-23T09:45:15.524 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3603_vm 2023-09-23T09:45:15.524 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3604 2023-09-23T09:45:15.524 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3605 2023-09-23T09:45:15.524 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3606 2023-09-23T09:45:15.524 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3607 2023-09-23T09:45:15.524 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3608 2023-09-23T09:45:15.524 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 23 08:57 3609 2023-09-23T09:45:15.524 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3712 2023-09-23T09:45:15.524 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3764 2023-09-23T09:45:15.524 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 3764_fsm 2023-09-23T09:45:15.524 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3764_vm 2023-09-23T09:45:15.524 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3766 2023-09-23T09:45:15.524 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3767 2023-09-23T09:45:15.525 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3997 2023-09-23T09:45:15.525 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 5002 2023-09-23T09:45:15.525 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 548 2023-09-23T09:45:15.525 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 549 2023-09-23T09:45:15.525 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 6102 2023-09-23T09:45:15.525 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 6102_vm 2023-09-23T09:45:15.525 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 6104 2023-09-23T09:45:15.525 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 6104_vm 2023-09-23T09:45:15.525 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 6106 2023-09-23T09:45:15.525 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 6106_vm 2023-09-23T09:45:16.252 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 6110 2023-09-23T09:45:16.252 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 6111 2023-09-23T09:45:16.252 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 6112 2023-09-23T09:45:16.252 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 6113 2023-09-23T09:45:16.252 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 6117 2023-09-23T09:45:16.252 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 826 2023-09-23T09:45:16.252 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 826_vm 2023-09-23T09:45:16.252 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 827 2023-09-23T09:45:16.253 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 828 2023-09-23T09:45:16.253 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 23 08:57 pg_filenode.map 2023-09-23T09:45:16.253 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 23 08:57 PG_VERSION 2023-09-23T09:45:16.253 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T09:45:16.253 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/base/12347: 2023-09-23T09:45:16.253 INFO:teuthology.orchestra.run.smithi082.stdout:total 7715473 2023-09-23T09:45:16.253 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7900642439 Sep 23 09:28 . 2023-09-23T09:45:16.253 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 7915405453 Sep 23 09:24 .. 2023-09-23T09:45:16.253 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 112 2023-09-23T09:45:16.253 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 113 2023-09-23T09:45:16.253 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 23 08:57 12182 2023-09-23T09:45:16.253 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 12182_fsm 2023-09-23T09:45:16.254 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12182_vm 2023-09-23T09:45:16.254 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 12184 2023-09-23T09:45:16.254 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12186 2023-09-23T09:45:16.254 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12187 2023-09-23T09:45:16.254 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 12187_fsm 2023-09-23T09:45:16.254 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12187_vm 2023-09-23T09:45:16.254 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 12189 2023-09-23T09:45:16.254 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12191 2023-09-23T09:45:16.254 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12192 2023-09-23T09:45:16.254 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 12192_fsm 2023-09-23T09:45:16.254 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12192_vm 2023-09-23T09:45:16.255 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 12194 2023-09-23T09:45:16.255 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12196 2023-09-23T09:45:16.255 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12197 2023-09-23T09:45:16.255 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 12197_fsm 2023-09-23T09:45:16.255 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12197_vm 2023-09-23T09:45:16.255 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 12199 2023-09-23T09:45:16.255 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12201 2023-09-23T09:45:16.255 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12202 2023-09-23T09:45:16.255 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 12202_fsm 2023-09-23T09:45:16.255 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12202_vm 2023-09-23T09:45:16.255 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 12204 2023-09-23T09:45:16.255 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12206 2023-09-23T09:45:16.255 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12207 2023-09-23T09:45:16.256 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 12207_fsm 2023-09-23T09:45:16.256 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12207_vm 2023-09-23T09:45:16.256 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 12209 2023-09-23T09:45:16.256 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12211 2023-09-23T09:45:16.256 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 12212 2023-09-23T09:45:16.256 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 12214 2023-09-23T09:45:16.256 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 12216 2023-09-23T09:45:16.256 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 73728 Sep 23 08:58 1247 2023-09-23T09:45:16.256 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:58 1247_fsm 2023-09-23T09:45:16.256 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:58 1247_vm 2023-09-23T09:45:16.256 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 393216 Sep 23 09:27 1249 2023-09-23T09:45:16.256 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:58 1249_fsm 2023-09-23T09:45:16.257 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:58 1249_vm 2023-09-23T09:45:16.257 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 606208 Sep 23 08:57 1255 2023-09-23T09:45:16.257 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 1255_fsm 2023-09-23T09:45:16.257 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 1255_vm 2023-09-23T09:45:16.257 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 23 09:43 1259 2023-09-23T09:45:16.257 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 1259_fsm 2023-09-23T09:45:16.257 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:58 1259_vm 2023-09-23T09:45:16.257 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 1417 2023-09-23T09:45:16.257 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 1417_vm 2023-09-23T09:45:16.257 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 1418 2023-09-23T09:45:16.257 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 1418_vm 2023-09-23T09:45:16.257 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 745472 Sep 23 09:43 16387 2023-09-23T09:45:16.258 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 09:43 16387_fsm 2023-09-23T09:45:16.258 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 09:43 16387_vm 2023-09-23T09:45:16.258 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1548288 Sep 23 09:43 16393 2023-09-23T09:45:16.258 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 09:43 16393_fsm 2023-09-23T09:45:16.258 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 09:43 16393_vm 2023-09-23T09:45:16.258 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1073741824 Sep 23 09:43 16396 2023-09-23T09:45:16.258 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1073741824 Sep 23 09:43 16396.1 2023-09-23T09:45:16.258 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1073741824 Sep 23 09:43 16396.2 2023-09-23T09:45:16.258 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1073741824 Sep 23 09:43 16396.3 2023-09-23T09:45:16.258 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1073741824 Sep 23 09:43 16396.4 2023-09-23T09:45:16.258 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1073741824 Sep 23 09:43 16396.5 2023-09-23T09:45:16.258 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 307036160 Sep 23 09:43 16396.6 2023-09-23T09:45:16.259 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1679360 Sep 23 09:43 16396_fsm 2023-09-23T09:45:16.259 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 212992 Sep 23 09:43 16396_vm 2023-09-23T09:45:16.259 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 73728 Sep 23 09:43 16397 2023-09-23T09:45:16.259 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 237568 Sep 23 09:43 16399 2023-09-23T09:45:16.259 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1073741824 Sep 23 09:44 16401 2023-09-23T09:45:16.259 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49373184 Sep 23 09:44 16401.1 2023-09-23T09:45:16.259 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 15867904 Sep 23 09:44 16403 2023-09-23T09:45:16.259 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 09:42 16403_fsm 2023-09-23T09:45:16.259 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 174 2023-09-23T09:45:16.259 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 175 2023-09-23T09:45:16.259 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2187 2023-09-23T09:45:16.260 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2224 2023-09-23T09:45:16.260 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2224_vm 2023-09-23T09:45:16.260 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2328 2023-09-23T09:45:16.260 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2328_vm 2023-09-23T09:45:16.260 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2336 2023-09-23T09:45:16.260 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2336_vm 2023-09-23T09:45:16.260 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2337 2023-09-23T09:45:16.260 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2600 2023-09-23T09:45:16.260 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2600_fsm 2023-09-23T09:45:16.260 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2600_vm 2023-09-23T09:45:16.260 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2601 2023-09-23T09:45:16.260 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2601_fsm 2023-09-23T09:45:16.260 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2601_vm 2023-09-23T09:45:16.261 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 23 08:57 2602 2023-09-23T09:45:16.261 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2602_fsm 2023-09-23T09:45:16.261 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2602_vm 2023-09-23T09:45:16.261 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 23 08:57 2603 2023-09-23T09:45:16.261 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2603_fsm 2023-09-23T09:45:16.261 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2603_vm 2023-09-23T09:45:16.261 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2604 2023-09-23T09:45:16.261 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2604_vm 2023-09-23T09:45:16.261 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2605 2023-09-23T09:45:16.261 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2605_fsm 2023-09-23T09:45:16.261 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2605_vm 2023-09-23T09:45:16.261 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 09:24 2606 2023-09-23T09:45:16.262 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2606_fsm 2023-09-23T09:45:16.262 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 09:24 2606_vm 2023-09-23T09:45:16.262 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2607 2023-09-23T09:45:16.262 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2607_fsm 2023-09-23T09:45:16.262 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2607_vm 2023-09-23T09:45:16.262 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 450560 Sep 23 09:24 2608 2023-09-23T09:45:16.262 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 09:24 2608_fsm 2023-09-23T09:45:16.262 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 09:24 2608_vm 2023-09-23T09:45:16.262 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 286720 Sep 23 08:57 2609 2023-09-23T09:45:16.262 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2609_fsm 2023-09-23T09:45:16.262 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2609_vm 2023-09-23T09:45:16.263 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 23 09:27 2610 2023-09-23T09:45:16.263 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 09:24 2610_fsm 2023-09-23T09:45:16.263 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 09:24 2610_vm 2023-09-23T09:45:16.263 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2611 2023-09-23T09:45:16.263 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2611_vm 2023-09-23T09:45:16.263 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2612 2023-09-23T09:45:16.263 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2612_fsm 2023-09-23T09:45:16.263 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2612_vm 2023-09-23T09:45:16.263 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2613 2023-09-23T09:45:16.263 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2613_vm 2023-09-23T09:45:16.263 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2615 2023-09-23T09:45:16.263 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2615_fsm 2023-09-23T09:45:16.264 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2615_vm 2023-09-23T09:45:16.264 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2616 2023-09-23T09:45:16.264 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2616_fsm 2023-09-23T09:45:16.264 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2616_vm 2023-09-23T09:45:16.264 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Sep 23 08:57 2617 2023-09-23T09:45:16.264 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2617_fsm 2023-09-23T09:45:16.264 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2617_vm 2023-09-23T09:45:16.264 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Sep 23 08:57 2618 2023-09-23T09:45:16.264 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2618_fsm 2023-09-23T09:45:16.264 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2618_vm 2023-09-23T09:45:16.264 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 155648 Sep 23 09:43 2619 2023-09-23T09:45:16.264 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 09:28 2619_fsm 2023-09-23T09:45:16.265 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 09:19 2619_vm 2023-09-23T09:45:16.265 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2620 2023-09-23T09:45:16.265 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2620_vm 2023-09-23T09:45:16.265 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2650 2023-09-23T09:45:16.265 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2651 2023-09-23T09:45:16.265 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2652 2023-09-23T09:45:16.265 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 23 08:57 2653 2023-09-23T09:45:16.265 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 23 08:57 2654 2023-09-23T09:45:16.265 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 23 08:57 2655 2023-09-23T09:45:16.265 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2656 2023-09-23T09:45:16.265 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2657 2023-09-23T09:45:16.265 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Sep 23 09:24 2658 2023-09-23T09:45:16.265 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 23 09:24 2659 2023-09-23T09:45:16.266 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2660 2023-09-23T09:45:16.266 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2661 2023-09-23T09:45:16.266 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 23 09:27 2662 2023-09-23T09:45:16.266 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 23 09:27 2663 2023-09-23T09:45:16.266 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 09:24 2664 2023-09-23T09:45:16.266 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 09:24 2665 2023-09-23T09:45:16.266 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 09:24 2666 2023-09-23T09:45:16.266 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 09:24 2667 2023-09-23T09:45:16.266 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2668 2023-09-23T09:45:16.266 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2669 2023-09-23T09:45:16.266 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2670 2023-09-23T09:45:16.266 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 335872 Sep 23 09:24 2673 2023-09-23T09:45:16.267 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 376832 Sep 23 09:24 2674 2023-09-23T09:45:16.267 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 180224 Sep 23 08:57 2675 2023-09-23T09:45:16.267 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 09:24 2678 2023-09-23T09:45:16.267 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 09:24 2679 2023-09-23T09:45:16.267 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2680 2023-09-23T09:45:16.267 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2681 2023-09-23T09:45:16.267 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2682 2023-09-23T09:45:16.267 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2683 2023-09-23T09:45:16.267 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2684 2023-09-23T09:45:16.267 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2685 2023-09-23T09:45:16.267 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2686 2023-09-23T09:45:16.267 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2687 2023-09-23T09:45:16.268 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 23 08:57 2688 2023-09-23T09:45:16.268 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 23 08:57 2689 2023-09-23T09:45:16.268 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 23 08:57 2690 2023-09-23T09:45:16.268 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 270336 Sep 23 08:57 2691 2023-09-23T09:45:16.268 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2692 2023-09-23T09:45:16.268 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2693 2023-09-23T09:45:16.268 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 23 09:40 2696 2023-09-23T09:45:16.268 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2699 2023-09-23T09:45:16.268 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2701 2023-09-23T09:45:16.268 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2702 2023-09-23T09:45:16.268 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:58 2703 2023-09-23T09:45:16.268 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 23 08:58 2704 2023-09-23T09:45:16.268 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2753 2023-09-23T09:45:16.269 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2753_fsm 2023-09-23T09:45:16.269 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2753_vm 2023-09-23T09:45:16.269 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2754 2023-09-23T09:45:16.269 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2755 2023-09-23T09:45:16.269 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 23 08:57 2756 2023-09-23T09:45:16.269 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 23 08:57 2757 2023-09-23T09:45:16.269 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2830 2023-09-23T09:45:16.269 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2830_vm 2023-09-23T09:45:16.269 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2831 2023-09-23T09:45:16.269 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2832 2023-09-23T09:45:16.269 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2832_vm 2023-09-23T09:45:16.269 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2833 2023-09-23T09:45:16.270 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2834 2023-09-23T09:45:16.270 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2834_vm 2023-09-23T09:45:16.270 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2835 2023-09-23T09:45:16.270 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2836 2023-09-23T09:45:16.270 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2836_vm 2023-09-23T09:45:16.270 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2837 2023-09-23T09:45:16.270 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 417792 Sep 23 08:57 2838 2023-09-23T09:45:16.270 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2838_fsm 2023-09-23T09:45:16.270 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2838_vm 2023-09-23T09:45:16.270 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2839 2023-09-23T09:45:16.270 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2840 2023-09-23T09:45:16.270 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2840_fsm 2023-09-23T09:45:16.270 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2840_vm 2023-09-23T09:45:16.271 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2841 2023-09-23T09:45:16.271 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2995 2023-09-23T09:45:16.271 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2995_vm 2023-09-23T09:45:16.271 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2996 2023-09-23T09:45:16.271 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3079 2023-09-23T09:45:16.271 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 3079_fsm 2023-09-23T09:45:16.271 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3079_vm 2023-09-23T09:45:16.271 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3080 2023-09-23T09:45:16.271 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3081 2023-09-23T09:45:16.271 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3085 2023-09-23T09:45:16.271 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3118 2023-09-23T09:45:16.271 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3118_vm 2023-09-23T09:45:16.271 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3119 2023-09-23T09:45:16.272 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3164 2023-09-23T09:45:16.272 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3256 2023-09-23T09:45:16.272 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3256_vm 2023-09-23T09:45:16.272 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3257 2023-09-23T09:45:16.272 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3258 2023-09-23T09:45:16.272 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3350 2023-09-23T09:45:16.272 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3350_vm 2023-09-23T09:45:16.272 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3351 2023-09-23T09:45:16.272 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3379 2023-09-23T09:45:16.272 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3380 2023-09-23T09:45:16.272 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3381 2023-09-23T09:45:16.272 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3381_vm 2023-09-23T09:45:16.273 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3394 2023-09-23T09:45:16.273 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 3394_fsm 2023-09-23T09:45:16.273 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3394_vm 2023-09-23T09:45:16.273 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3395 2023-09-23T09:45:16.273 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3439 2023-09-23T09:45:16.273 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3439_vm 2023-09-23T09:45:16.273 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3440 2023-09-23T09:45:16.273 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 23 09:27 3455 2023-09-23T09:45:16.273 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3456 2023-09-23T09:45:16.273 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 3456_fsm 2023-09-23T09:45:16.273 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3456_vm 2023-09-23T09:45:16.273 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3466 2023-09-23T09:45:16.273 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3466_vm 2023-09-23T09:45:16.274 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3467 2023-09-23T09:45:16.274 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3468 2023-09-23T09:45:16.274 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3501 2023-09-23T09:45:16.274 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3501_vm 2023-09-23T09:45:16.274 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3502 2023-09-23T09:45:16.274 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3503 2023-09-23T09:45:16.274 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3534 2023-09-23T09:45:16.274 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3541 2023-09-23T09:45:16.274 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 3541_fsm 2023-09-23T09:45:16.274 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3541_vm 2023-09-23T09:45:16.274 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3542 2023-09-23T09:45:16.274 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3574 2023-09-23T09:45:16.275 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3575 2023-09-23T09:45:16.275 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3576 2023-09-23T09:45:16.275 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3576_vm 2023-09-23T09:45:16.275 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3596 2023-09-23T09:45:16.275 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3596_vm 2023-09-23T09:45:16.275 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3597 2023-09-23T09:45:16.275 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3598 2023-09-23T09:45:16.275 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3598_vm 2023-09-23T09:45:16.275 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3599 2023-09-23T09:45:16.275 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3600 2023-09-23T09:45:16.275 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 3600_fsm 2023-09-23T09:45:16.275 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3600_vm 2023-09-23T09:45:16.275 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3601 2023-09-23T09:45:16.276 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 3601_fsm 2023-09-23T09:45:16.276 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3601_vm 2023-09-23T09:45:16.276 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3602 2023-09-23T09:45:16.276 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 3602_fsm 2023-09-23T09:45:16.276 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3602_vm 2023-09-23T09:45:16.276 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3603 2023-09-23T09:45:16.276 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 3603_fsm 2023-09-23T09:45:16.276 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3603_vm 2023-09-23T09:45:16.277 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3604 2023-09-23T09:45:16.277 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3605 2023-09-23T09:45:16.277 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3606 2023-09-23T09:45:16.277 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3607 2023-09-23T09:45:16.277 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3608 2023-09-23T09:45:16.277 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 23 08:57 3609 2023-09-23T09:45:16.277 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3712 2023-09-23T09:45:16.277 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3764 2023-09-23T09:45:16.277 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 3764_fsm 2023-09-23T09:45:16.277 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3764_vm 2023-09-23T09:45:16.277 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3766 2023-09-23T09:45:16.277 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 3767 2023-09-23T09:45:16.277 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3997 2023-09-23T09:45:16.278 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 5002 2023-09-23T09:45:16.278 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 548 2023-09-23T09:45:16.278 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 549 2023-09-23T09:45:16.278 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 6102 2023-09-23T09:45:16.278 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 6102_vm 2023-09-23T09:45:16.278 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 6104 2023-09-23T09:45:16.278 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 6104_vm 2023-09-23T09:45:16.278 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 6106 2023-09-23T09:45:16.278 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 6106_vm 2023-09-23T09:45:16.278 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 6110 2023-09-23T09:45:16.278 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 6111 2023-09-23T09:45:16.278 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 6112 2023-09-23T09:45:16.279 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 6113 2023-09-23T09:45:16.279 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 6117 2023-09-23T09:45:16.279 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 826 2023-09-23T09:45:16.279 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 826_vm 2023-09-23T09:45:16.279 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 827 2023-09-23T09:45:16.279 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 828 2023-09-23T09:45:16.279 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 23 08:57 pg_filenode.map 2023-09-23T09:45:16.279 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 137860 Sep 23 08:57 pg_internal.init 2023-09-23T09:45:16.279 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 23 08:57 PG_VERSION 2023-09-23T09:45:16.279 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T09:45:16.279 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/base/pgsql_tmp: 2023-09-23T09:45:16.279 INFO:teuthology.orchestra.run.smithi082.stdout:total 1 2023-09-23T09:45:16.372 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 09:27 . 2023-09-23T09:45:16.373 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 7915405453 Sep 23 09:24 .. 2023-09-23T09:45:16.373 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T09:45:16.373 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/global: 2023-09-23T09:45:16.373 INFO:teuthology.orchestra.run.smithi082.stdout:total 575 2023-09-23T09:45:16.373 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 587404 Sep 23 08:57 . 2023-09-23T09:45:16.373 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 8989927083 Sep 23 09:45 .. 2023-09-23T09:45:16.373 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 1136 2023-09-23T09:45:16.373 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 1136_fsm 2023-09-23T09:45:16.373 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 1136_vm 2023-09-23T09:45:16.373 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 1137 2023-09-23T09:45:16.373 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 1213 2023-09-23T09:45:16.374 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 1213_fsm 2023-09-23T09:45:16.374 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 1213_vm 2023-09-23T09:45:16.374 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 1214 2023-09-23T09:45:16.374 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 1214_fsm 2023-09-23T09:45:16.374 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 1214_vm 2023-09-23T09:45:16.374 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 1232 2023-09-23T09:45:16.374 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 1233 2023-09-23T09:45:16.374 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 1260 2023-09-23T09:45:16.374 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 1260_fsm 2023-09-23T09:45:16.374 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 1260_vm 2023-09-23T09:45:16.374 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 1261 2023-09-23T09:45:16.374 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 1261_fsm 2023-09-23T09:45:16.375 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 1261_vm 2023-09-23T09:45:16.375 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 1262 2023-09-23T09:45:16.375 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 1262_fsm 2023-09-23T09:45:16.375 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 1262_vm 2023-09-23T09:45:16.375 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2396 2023-09-23T09:45:16.375 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 23 08:57 2396_fsm 2023-09-23T09:45:16.375 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2396_vm 2023-09-23T09:45:16.375 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2397 2023-09-23T09:45:16.375 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2671 2023-09-23T09:45:16.375 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2672 2023-09-23T09:45:16.375 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2676 2023-09-23T09:45:16.376 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2677 2023-09-23T09:45:16.376 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2694 2023-09-23T09:45:16.376 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2695 2023-09-23T09:45:16.376 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2697 2023-09-23T09:45:16.376 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 2698 2023-09-23T09:45:16.376 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2846 2023-09-23T09:45:16.376 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2846_vm 2023-09-23T09:45:16.376 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2847 2023-09-23T09:45:16.376 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2964 2023-09-23T09:45:16.421 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2964_vm 2023-09-23T09:45:16.421 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2965 2023-09-23T09:45:16.422 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2966 2023-09-23T09:45:16.422 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 2966_vm 2023-09-23T09:45:16.422 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 2967 2023-09-23T09:45:16.422 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3592 2023-09-23T09:45:16.422 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 3592_vm 2023-09-23T09:45:16.422 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 3593 2023-09-23T09:45:16.422 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 4060 2023-09-23T09:45:16.422 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 4060_vm 2023-09-23T09:45:16.422 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 4061 2023-09-23T09:45:16.422 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 6000 2023-09-23T09:45:16.422 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 6000_vm 2023-09-23T09:45:16.423 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 6001 2023-09-23T09:45:16.423 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 6002 2023-09-23T09:45:16.423 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 6100 2023-09-23T09:45:16.423 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 6100_vm 2023-09-23T09:45:16.423 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 6114 2023-09-23T09:45:16.423 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 6115 2023-09-23T09:45:16.423 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 09:44 pg_control 2023-09-23T09:45:16.423 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 23 08:57 pg_filenode.map 2023-09-23T09:45:16.423 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 21644 Sep 23 08:57 pg_internal.init 2023-09-23T09:45:16.423 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T09:45:16.423 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/log: 2023-09-23T09:45:16.423 INFO:teuthology.orchestra.run.smithi082.stdout:total 2 2023-09-23T09:45:16.423 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 522 Sep 23 08:57 . 2023-09-23T09:45:16.424 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 8989927083 Sep 23 09:45 .. 2023-09-23T09:45:16.424 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 594 Sep 23 09:45 postgresql-Sat.log 2023-09-23T09:45:16.424 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T09:45:16.424 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/pg_commit_ts: 2023-09-23T09:45:16.424 INFO:teuthology.orchestra.run.smithi082.stdout:total 1 2023-09-23T09:45:16.424 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 . 2023-09-23T09:45:16.424 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 8989927083 Sep 23 09:45 .. 2023-09-23T09:45:16.424 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T09:45:16.424 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/pg_dynshmem: 2023-09-23T09:45:16.424 INFO:teuthology.orchestra.run.smithi082.stdout:total 1 2023-09-23T09:45:16.424 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 . 2023-09-23T09:45:16.424 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 8989927083 Sep 23 09:45 .. 2023-09-23T09:45:16.425 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T09:45:16.425 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/pg_logical: 2023-09-23T09:45:16.425 INFO:teuthology.orchestra.run.smithi082.stdout:total 3 2023-09-23T09:45:16.425 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Sep 23 09:44 . 2023-09-23T09:45:16.425 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 8989927083 Sep 23 09:45 .. 2023-09-23T09:45:16.425 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 mappings 2023-09-23T09:45:16.425 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Sep 23 09:44 replorigin_checkpoint 2023-09-23T09:45:16.425 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 snapshots 2023-09-23T09:45:16.425 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T09:45:16.425 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/pg_logical/mappings: 2023-09-23T09:45:16.425 INFO:teuthology.orchestra.run.smithi082.stdout:total 1 2023-09-23T09:45:16.425 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 . 2023-09-23T09:45:16.425 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Sep 23 09:44 .. 2023-09-23T09:45:16.426 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T09:45:16.426 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/pg_logical/snapshots: 2023-09-23T09:45:16.426 INFO:teuthology.orchestra.run.smithi082.stdout:total 1 2023-09-23T09:45:16.426 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 . 2023-09-23T09:45:16.426 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Sep 23 09:44 .. 2023-09-23T09:45:16.426 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T09:45:16.426 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/pg_multixact: 2023-09-23T09:45:16.627 INFO:teuthology.orchestra.run.smithi082.stdout:total 2 2023-09-23T09:45:16.627 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 . 2023-09-23T09:45:16.627 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 8989927083 Sep 23 09:45 .. 2023-09-23T09:45:16.627 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 members 2023-09-23T09:45:16.627 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 offsets 2023-09-23T09:45:16.628 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T09:45:16.628 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/pg_multixact/members: 2023-09-23T09:45:16.628 INFO:teuthology.orchestra.run.smithi082.stdout:total 9 2023-09-23T09:45:16.628 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 . 2023-09-23T09:45:16.628 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 .. 2023-09-23T09:45:16.628 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 0000 2023-09-23T09:45:16.628 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T09:45:16.628 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/pg_multixact/offsets: 2023-09-23T09:45:16.628 INFO:teuthology.orchestra.run.smithi082.stdout:total 9 2023-09-23T09:45:16.628 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 . 2023-09-23T09:45:16.628 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 23 08:57 .. 2023-09-23T09:45:16.628 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:58 0000 2023-09-23T09:45:16.629 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T09:45:16.629 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/pg_notify: 2023-09-23T09:45:16.629 INFO:teuthology.orchestra.run.smithi082.stdout:total 9 2023-09-23T09:45:16.629 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 . 2023-09-23T09:45:16.629 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 8989927083 Sep 23 09:45 .. 2023-09-23T09:45:16.629 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 23 08:57 0000 2023-09-23T09:45:16.629 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T09:45:16.629 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/pg_replslot: 2023-09-23T09:45:16.629 INFO:teuthology.orchestra.run.smithi082.stdout:total 1 2023-09-23T09:45:16.629 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 . 2023-09-23T09:45:16.629 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 8989927083 Sep 23 09:45 .. 2023-09-23T09:45:16.629 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T09:45:16.630 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/pg_serial: 2023-09-23T09:45:16.630 INFO:teuthology.orchestra.run.smithi082.stdout:total 1 2023-09-23T09:45:16.630 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 . 2023-09-23T09:45:16.630 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 8989927083 Sep 23 09:45 .. 2023-09-23T09:45:16.630 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T09:45:16.630 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/pg_snapshots: 2023-09-23T09:45:16.630 INFO:teuthology.orchestra.run.smithi082.stdout:total 1 2023-09-23T09:45:16.630 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 . 2023-09-23T09:45:16.630 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 8989927083 Sep 23 09:45 .. 2023-09-23T09:45:16.630 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T09:45:16.630 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/pg_stat: 2023-09-23T09:45:16.630 INFO:teuthology.orchestra.run.smithi082.stdout:total 14 2023-09-23T09:45:16.630 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 11771 Sep 23 09:45 . 2023-09-23T09:45:16.631 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 8989927083 Sep 23 09:45 .. 2023-09-23T09:45:16.631 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1864 Sep 23 09:45 db_0.stat 2023-09-23T09:45:16.631 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 9300 Sep 23 09:45 db_12347.stat 2023-09-23T09:45:16.631 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 607 Sep 23 09:45 global.stat 2023-09-23T09:45:16.631 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T09:45:16.631 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/pg_stat_tmp: 2023-09-23T09:45:16.631 INFO:teuthology.orchestra.run.smithi082.stdout:total 1 2023-09-23T09:45:16.631 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 11771 Sep 23 09:45 . 2023-09-23T09:45:16.631 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 8989927083 Sep 23 09:45 .. 2023-09-23T09:45:16.631 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T09:45:16.631 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/pg_subtrans: 2023-09-23T09:45:16.631 INFO:teuthology.orchestra.run.smithi082.stdout:total 41 2023-09-23T09:45:16.632 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 23 09:43 . 2023-09-23T09:45:16.632 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 8989927083 Sep 23 09:45 .. 2023-09-23T09:45:16.632 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 23 09:43 0004 2023-09-23T09:45:16.632 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T09:45:16.632 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/pg_tblspc: 2023-09-23T09:45:16.632 INFO:teuthology.orchestra.run.smithi082.stdout:total 1 2023-09-23T09:45:16.632 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 . 2023-09-23T09:45:16.632 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 8989927083 Sep 23 09:45 .. 2023-09-23T09:45:16.632 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T09:45:16.632 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/pg_twophase: 2023-09-23T09:45:16.632 INFO:teuthology.orchestra.run.smithi082.stdout:total 1 2023-09-23T09:45:16.632 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 . 2023-09-23T09:45:16.633 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 8989927083 Sep 23 09:45 .. 2023-09-23T09:45:16.633 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T09:45:16.633 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/pg_wal: 2023-09-23T09:45:16.633 INFO:teuthology.orchestra.run.smithi082.stdout:total 1048578 2023-09-23T09:45:16.633 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1073741824 Sep 23 09:45 . 2023-09-23T09:45:16.633 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 8989927083 Sep 23 09:45 .. 2023-09-23T09:45:16.633 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 23 09:40 00000001000000020000005E 2023-09-23T09:45:16.633 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 23 09:40 00000001000000020000005F 2023-09-23T09:45:16.633 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 23 09:40 000000010000000200000060 2023-09-23T09:45:16.633 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 23 09:41 000000010000000200000061 2023-09-23T09:45:16.633 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 23 09:41 000000010000000200000062 2023-09-23T09:45:16.633 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 23 09:41 000000010000000200000063 2023-09-23T09:45:16.634 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 23 09:41 000000010000000200000064 2023-09-23T09:45:16.634 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 23 09:41 000000010000000200000065 2023-09-23T09:45:16.634 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 23 09:41 000000010000000200000066 2023-09-23T09:45:16.634 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 23 09:41 000000010000000200000067 2023-09-23T09:45:16.634 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 23 09:41 000000010000000200000068 2023-09-23T09:45:16.634 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 23 09:42 000000010000000200000069 2023-09-23T09:45:16.634 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 23 09:44 00000001000000020000006A 2023-09-23T09:45:16.634 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 23 09:33 00000001000000020000006B 2023-09-23T09:45:16.634 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 23 09:35 00000001000000020000006C 2023-09-23T09:45:16.634 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 23 09:36 00000001000000020000006D 2023-09-23T09:45:16.634 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 23 09:34 00000001000000020000006E 2023-09-23T09:45:16.634 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 23 09:34 00000001000000020000006F 2023-09-23T09:45:16.635 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 23 09:35 000000010000000200000070 2023-09-23T09:45:16.635 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 23 09:35 000000010000000200000071 2023-09-23T09:45:16.635 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 23 09:36 000000010000000200000072 2023-09-23T09:45:16.635 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 23 09:34 000000010000000200000073 2023-09-23T09:45:16.635 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 23 09:34 000000010000000200000074 2023-09-23T09:45:16.635 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 23 09:36 000000010000000200000075 2023-09-23T09:45:16.635 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 23 09:34 000000010000000200000076 2023-09-23T09:45:16.635 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 23 09:37 000000010000000200000077 2023-09-23T09:45:16.635 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 23 09:36 000000010000000200000078 2023-09-23T09:45:16.635 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 23 09:34 000000010000000200000079 2023-09-23T09:45:16.635 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 23 09:34 00000001000000020000007A 2023-09-23T09:45:16.635 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 23 09:34 00000001000000020000007B 2023-09-23T09:45:16.635 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 23 09:35 00000001000000020000007C 2023-09-23T09:45:16.636 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 23 09:34 00000001000000020000007D 2023-09-23T09:45:16.636 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 23 09:34 00000001000000020000007E 2023-09-23T09:45:16.636 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 23 09:35 00000001000000020000007F 2023-09-23T09:45:16.636 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 23 09:36 000000010000000200000080 2023-09-23T09:45:16.639 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 23 09:35 000000010000000200000081 2023-09-23T09:45:16.639 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 23 09:36 000000010000000200000082 2023-09-23T09:45:16.640 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 23 09:34 000000010000000200000083 2023-09-23T09:45:16.640 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 23 09:34 000000010000000200000084 2023-09-23T09:45:16.640 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 23 09:37 000000010000000200000085 2023-09-23T09:45:16.640 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 23 09:39 000000010000000200000086 2023-09-23T09:45:16.640 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 23 09:40 000000010000000200000087 2023-09-23T09:45:16.640 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 23 09:38 000000010000000200000088 2023-09-23T09:45:16.640 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 23 09:40 000000010000000200000089 2023-09-23T09:45:16.640 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 23 09:38 00000001000000020000008A 2023-09-23T09:45:16.640 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 23 09:38 00000001000000020000008B 2023-09-23T09:45:16.640 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 23 09:40 00000001000000020000008C 2023-09-23T09:45:16.640 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 23 09:38 00000001000000020000008D 2023-09-23T09:45:16.641 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 23 09:37 00000001000000020000008E 2023-09-23T09:45:16.641 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 23 09:38 00000001000000020000008F 2023-09-23T09:45:16.641 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 23 09:37 000000010000000200000090 2023-09-23T09:45:16.641 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 23 09:39 000000010000000200000091 2023-09-23T09:45:16.641 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 23 09:38 000000010000000200000092 2023-09-23T09:45:16.641 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 23 09:39 000000010000000200000093 2023-09-23T09:45:16.641 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 23 09:39 000000010000000200000094 2023-09-23T09:45:16.641 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 23 09:37 000000010000000200000095 2023-09-23T09:45:16.641 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 23 09:39 000000010000000200000096 2023-09-23T09:45:16.641 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 23 09:39 000000010000000200000097 2023-09-23T09:45:16.641 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 23 09:39 000000010000000200000098 2023-09-23T09:45:16.641 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 23 09:37 000000010000000200000099 2023-09-23T09:45:16.642 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 23 09:37 00000001000000020000009A 2023-09-23T09:45:16.642 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 23 09:37 00000001000000020000009B 2023-09-23T09:45:16.642 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 23 09:40 00000001000000020000009C 2023-09-23T09:45:16.642 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 23 09:38 00000001000000020000009D 2023-09-23T09:45:16.642 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 archive_status 2023-09-23T09:45:16.642 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T09:45:16.642 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/pg_wal/archive_status: 2023-09-23T09:45:16.642 INFO:teuthology.orchestra.run.smithi082.stdout:total 1 2023-09-23T09:45:16.642 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 23 08:57 . 2023-09-23T09:45:16.642 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1073741824 Sep 23 09:45 .. 2023-09-23T09:45:16.642 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T09:45:16.642 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/pg_xact: 2023-09-23T09:45:16.643 INFO:teuthology.orchestra.run.smithi082.stdout:total 73 2023-09-23T09:45:16.643 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 73728 Sep 23 08:57 . 2023-09-23T09:45:16.643 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 8989927083 Sep 23 09:45 .. 2023-09-23T09:45:16.643 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 73728 Sep 23 09:43 0000 2023-09-23T09:45:16.645 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2023-09-23T09:45:16.659 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2023-09-23T09:45:16.659 INFO:teuthology.task.exec:Executing custom commands... 2023-09-23T09:45:16.660 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi082.front.sepia.ceph.com 2023-09-23T09:45:16.660 DEBUG:teuthology.orchestra.run.smithi082:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2023-09-23T09:45:16.752 DEBUG:teuthology.orchestra.run.smithi082:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2023-09-23T09:45:16.843 DEBUG:teuthology.orchestra.run.smithi082:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2023-09-23T09:45:17.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.035+0000 7f44031ff700 1 -- 172.21.15.82:0/3063516780 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43fc101260 msgr2=0x7f43fc10d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:45:17.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.035+0000 7f44031ff700 1 --2- 172.21.15.82:0/3063516780 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43fc101260 0x7f43fc10d770 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f43f400b0a0 tx=0x7f43f400b3b0 comp rx=0 tx=0).stop 2023-09-23T09:45:17.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.035+0000 7f44031ff700 1 -- 172.21.15.82:0/3063516780 shutdown_connections 2023-09-23T09:45:17.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.035+0000 7f44031ff700 1 --2- 172.21.15.82:0/3063516780 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43fc101260 0x7f43fc10d770 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:45:17.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.035+0000 7f44031ff700 1 --2- 172.21.15.82:0/3063516780 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43fc1068b0 0x7f43fc106c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:45:17.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.035+0000 7f44031ff700 1 --2- 172.21.15.82:0/3063516780 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f43fc1008a0 0x7f43fc100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:45:17.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.035+0000 7f44031ff700 1 -- 172.21.15.82:0/3063516780 >> 172.21.15.82:0/3063516780 conn(0x7f43fc0fc370 msgr2=0x7f43fc0fe790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:45:17.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.035+0000 7f44031ff700 1 -- 172.21.15.82:0/3063516780 shutdown_connections 2023-09-23T09:45:17.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.035+0000 7f44031ff700 1 -- 172.21.15.82:0/3063516780 wait complete. 2023-09-23T09:45:17.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.036+0000 7f44031ff700 1 Processor -- start 2023-09-23T09:45:17.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.036+0000 7f44031ff700 1 -- start start 2023-09-23T09:45:17.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.037+0000 7f44031ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43fc1008a0 0x7f43fc19eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:45:17.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.037+0000 7f44031ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43fc101260 0x7f43fc19eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:45:17.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.037+0000 7f44031ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f43fc1068b0 0x7f43fc198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:45:17.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.037+0000 7f44031ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43fc198f80 con 0x7f43fc1008a0 2023-09-23T09:45:17.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.037+0000 7f44031ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43fc1990f0 con 0x7f43fc101260 2023-09-23T09:45:17.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.037+0000 7f44031ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43fc1992b0 con 0x7f43fc1068b0 2023-09-23T09:45:17.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.037+0000 7f4400f9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43fc1008a0 0x7f43fc19eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:45:17.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.037+0000 7f4400f9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43fc1008a0 0x7f43fc19eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51898/0 (socket says 172.21.15.82:51898) 2023-09-23T09:45:17.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.037+0000 7f4400f9b700 1 -- 172.21.15.82:0/3394934808 learned_addr learned my addr 172.21.15.82:0/3394934808 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:45:17.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.037+0000 7f43fbfff700 1 --2- 172.21.15.82:0/3394934808 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43fc101260 0x7f43fc19eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:45:17.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.037+0000 7f440179c700 1 --2- 172.21.15.82:0/3394934808 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f43fc1068b0 0x7f43fc198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:45:17.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.037+0000 7f4400f9b700 1 -- 172.21.15.82:0/3394934808 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f43fc1068b0 msgr2=0x7f43fc198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:45:17.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.037+0000 7f4400f9b700 1 --2- 172.21.15.82:0/3394934808 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f43fc1068b0 0x7f43fc198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:45:17.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.037+0000 7f4400f9b700 1 -- 172.21.15.82:0/3394934808 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43fc101260 msgr2=0x7f43fc19eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:45:17.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.037+0000 7f4400f9b700 1 --2- 172.21.15.82:0/3394934808 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43fc101260 0x7f43fc19eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:45:17.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.037+0000 7f4400f9b700 1 -- 172.21.15.82:0/3394934808 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43f4009d00 con 0x7f43fc1008a0 2023-09-23T09:45:17.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.038+0000 7f4400f9b700 1 --2- 172.21.15.82:0/3394934808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43fc1008a0 0x7f43fc19eab0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f43f000e9a0 tx=0x7f43f000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:45:17.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.038+0000 7f43f9ffb700 1 -- 172.21.15.82:0/3394934808 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f0009790 con 0x7f43fc1008a0 2023-09-23T09:45:17.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.038+0000 7f44031ff700 1 -- 172.21.15.82:0/3394934808 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43fc199590 con 0x7f43fc1008a0 2023-09-23T09:45:17.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.038+0000 7f43f9ffb700 1 -- 172.21.15.82:0/3394934808 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f43f0010430 con 0x7f43fc1008a0 2023-09-23T09:45:17.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.038+0000 7f43f9ffb700 1 -- 172.21.15.82:0/3394934808 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f000cea0 con 0x7f43fc1008a0 2023-09-23T09:45:17.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.038+0000 7f44031ff700 1 -- 172.21.15.82:0/3394934808 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43fc1a5aa0 con 0x7f43fc1008a0 2023-09-23T09:45:17.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.039+0000 7f44031ff700 1 -- 172.21.15.82:0/3394934808 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43fc0fffe0 con 0x7f43fc1008a0 2023-09-23T09:45:17.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.041+0000 7f43f9ffb700 1 -- 172.21.15.82:0/3394934808 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f43f00105a0 con 0x7f43fc1008a0 2023-09-23T09:45:17.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.042+0000 7f43f9ffb700 1 --2- 172.21.15.82:0/3394934808 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f43ec0a0140 0x7f43ec0a2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:45:17.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.042+0000 7f43f9ffb700 1 -- 172.21.15.82:0/3394934808 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 8557+0+0 (secure 0 0 0) 0x7f43f0014070 con 0x7f43fc1008a0 2023-09-23T09:45:17.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.042+0000 7f43fbfff700 1 --2- 172.21.15.82:0/3394934808 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f43ec0a0140 0x7f43ec0a2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:45:17.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.043+0000 7f43fbfff700 1 --2- 172.21.15.82:0/3394934808 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f43ec0a0140 0x7f43ec0a2600 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f43fc105fc0 tx=0x7f43e800b410 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:45:17.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.045+0000 7f43f9ffb700 1 -- 172.21.15.82:0/3394934808 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f43f0095400 con 0x7f43fc1008a0 2023-09-23T09:45:17.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.273+0000 7f44031ff700 1 -- 172.21.15.82:0/3394934808 --> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) v1 -- 0x7f43fc1106c0 con 0x7f43ec0a0140 2023-09-23T09:45:17.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.284+0000 7f43f9ffb700 1 -- 172.21.15.82:0/3394934808 <== mgr.15537 v2:172.21.15.82:6800/630725563 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f43fc1106c0 con 0x7f43ec0a0140 2023-09-23T09:45:17.286 INFO:teuthology.orchestra.run.smithi082.stdout:{"fs": "cephfs", "subvol": null, "path": "/", "rel_path": "/", "schedule": "1M", "retention": {"h": 3, "M": 6}, "start": "2023-09-23T00:00:00", "created": "2023-09-23T08:56:54", "first": "2023-09-23T08:57:00", "last": "2023-09-23T09:45:00", "last_pruned": "2023-09-23T09:45:03", "created_count": 49, "pruned_count": 42, "active": true} 2023-09-23T09:45:17.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.287+0000 7f44031ff700 1 -- 172.21.15.82:0/3394934808 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f43ec0a0140 msgr2=0x7f43ec0a2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:45:17.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.287+0000 7f44031ff700 1 --2- 172.21.15.82:0/3394934808 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f43ec0a0140 0x7f43ec0a2600 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f43fc105fc0 tx=0x7f43e800b410 comp rx=0 tx=0).stop 2023-09-23T09:45:17.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.287+0000 7f44031ff700 1 -- 172.21.15.82:0/3394934808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43fc1008a0 msgr2=0x7f43fc19eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:45:17.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.287+0000 7f44031ff700 1 --2- 172.21.15.82:0/3394934808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43fc1008a0 0x7f43fc19eab0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f43f000e9a0 tx=0x7f43f000ecb0 comp rx=0 tx=0).stop 2023-09-23T09:45:17.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.287+0000 7f44031ff700 1 -- 172.21.15.82:0/3394934808 shutdown_connections 2023-09-23T09:45:17.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.287+0000 7f44031ff700 1 --2- 172.21.15.82:0/3394934808 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f43ec0a0140 0x7f43ec0a2600 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:45:17.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.287+0000 7f44031ff700 1 --2- 172.21.15.82:0/3394934808 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f43fc1068b0 0x7f43fc198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:45:17.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.287+0000 7f44031ff700 1 --2- 172.21.15.82:0/3394934808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43fc1008a0 0x7f43fc19eab0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:45:17.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.287+0000 7f44031ff700 1 --2- 172.21.15.82:0/3394934808 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43fc101260 0x7f43fc19eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:45:17.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.287+0000 7f44031ff700 1 -- 172.21.15.82:0/3394934808 >> 172.21.15.82:0/3394934808 conn(0x7f43fc0fc370 msgr2=0x7f43fc10be50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:45:17.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.287+0000 7f44031ff700 1 -- 172.21.15.82:0/3394934808 shutdown_connections 2023-09-23T09:45:17.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.287+0000 7f44031ff700 1 -- 172.21.15.82:0/3394934808 wait complete. 2023-09-23T09:45:17.305 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:45:17 smithi082 ceph-mon[97694]: pgmap v1537: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 265 KiB/s wr, 26 op/s 2023-09-23T09:45:17.307 DEBUG:teuthology.orchestra.run.smithi082:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2023-09-23T09:45:17.310 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:45:17 smithi135 ceph-mon[99205]: pgmap v1537: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 265 KiB/s wr, 26 op/s 2023-09-23T09:45:17.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:45:17 smithi161 ceph-mon[99580]: pgmap v1537: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 265 KiB/s wr, 26 op/s 2023-09-23T09:45:17.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.514+0000 7f99895ff700 1 -- 172.21.15.82:0/3798683235 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99840ffa80 msgr2=0x7f99840fff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:45:17.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.514+0000 7f99895ff700 1 --2- 172.21.15.82:0/3798683235 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99840ffa80 0x7f99840fff00 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f9978009920 tx=0x7f9978009c30 comp rx=0 tx=0).stop 2023-09-23T09:45:17.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.514+0000 7f99895ff700 1 -- 172.21.15.82:0/3798683235 shutdown_connections 2023-09-23T09:45:17.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.514+0000 7f99895ff700 1 --2- 172.21.15.82:0/3798683235 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9984100440 0x7f998410c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:45:17.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.514+0000 7f99895ff700 1 --2- 172.21.15.82:0/3798683235 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9984105840 0x7f9984105c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:45:17.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.514+0000 7f99895ff700 1 --2- 172.21.15.82:0/3798683235 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99840ffa80 0x7f99840fff00 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:45:17.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.514+0000 7f99895ff700 1 -- 172.21.15.82:0/3798683235 >> 172.21.15.82:0/3798683235 conn(0x7f9984075250 msgr2=0x7f9984075660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:45:17.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.514+0000 7f99895ff700 1 -- 172.21.15.82:0/3798683235 shutdown_connections 2023-09-23T09:45:17.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.514+0000 7f99895ff700 1 -- 172.21.15.82:0/3798683235 wait complete. 2023-09-23T09:45:17.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.516+0000 7f99895ff700 1 Processor -- start 2023-09-23T09:45:17.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.516+0000 7f99895ff700 1 -- start start 2023-09-23T09:45:17.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.516+0000 7f99895ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99840ffa80 0x7f998410d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:45:17.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.516+0000 7f99895ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9984100440 0x7f998410d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:45:17.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.516+0000 7f99895ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9984105840 0x7f99841a4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:45:17.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.516+0000 7f99895ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99841a50b0 con 0x7f99840ffa80 2023-09-23T09:45:17.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.516+0000 7f99895ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99841a51f0 con 0x7f9984100440 2023-09-23T09:45:17.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.516+0000 7f99895ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99841a5360 con 0x7f9984105840 2023-09-23T09:45:17.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.517+0000 7f9982ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99840ffa80 0x7f998410d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:45:17.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.517+0000 7f9982ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99840ffa80 0x7f998410d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51914/0 (socket says 172.21.15.82:51914) 2023-09-23T09:45:17.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.517+0000 7f9982ffd700 1 -- 172.21.15.82:0/3504225714 learned_addr learned my addr 172.21.15.82:0/3504225714 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:45:17.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.517+0000 7f99827fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9984100440 0x7f998410d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:45:17.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.517+0000 7f99837fe700 1 --2- 172.21.15.82:0/3504225714 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9984105840 0x7f99841a4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:45:17.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.517+0000 7f9982ffd700 1 -- 172.21.15.82:0/3504225714 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9984105840 msgr2=0x7f99841a4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:45:17.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.517+0000 7f9982ffd700 1 --2- 172.21.15.82:0/3504225714 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9984105840 0x7f99841a4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:45:17.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.517+0000 7f9982ffd700 1 -- 172.21.15.82:0/3504225714 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9984100440 msgr2=0x7f998410d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:45:17.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.517+0000 7f9982ffd700 1 --2- 172.21.15.82:0/3504225714 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9984100440 0x7f998410d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:45:17.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.517+0000 7f9982ffd700 1 -- 172.21.15.82:0/3504225714 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9978009520 con 0x7f99840ffa80 2023-09-23T09:45:17.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.517+0000 7f9982ffd700 1 --2- 172.21.15.82:0/3504225714 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99840ffa80 0x7f998410d190 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f997400e9c0 tx=0x7f997400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:45:17.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.518+0000 7f996bfff700 1 -- 172.21.15.82:0/3504225714 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9974004a30 con 0x7f99840ffa80 2023-09-23T09:45:17.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.518+0000 7f996bfff700 1 -- 172.21.15.82:0/3504225714 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f997400cc50 con 0x7f99840ffa80 2023-09-23T09:45:17.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.518+0000 7f99895ff700 1 -- 172.21.15.82:0/3504225714 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99841a5640 con 0x7f99840ffa80 2023-09-23T09:45:17.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.518+0000 7f996bfff700 1 -- 172.21.15.82:0/3504225714 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9974005410 con 0x7f99840ffa80 2023-09-23T09:45:17.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.518+0000 7f99895ff700 1 -- 172.21.15.82:0/3504225714 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99841a5b50 con 0x7f99840ffa80 2023-09-23T09:45:17.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.519+0000 7f99895ff700 1 -- 172.21.15.82:0/3504225714 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9984075e80 con 0x7f99840ffa80 2023-09-23T09:45:17.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.521+0000 7f996bfff700 1 -- 172.21.15.82:0/3504225714 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f9974005570 con 0x7f99840ffa80 2023-09-23T09:45:17.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.522+0000 7f996bfff700 1 --2- 172.21.15.82:0/3504225714 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f996c0a00c0 0x7f996c0a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:45:17.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.522+0000 7f996bfff700 1 -- 172.21.15.82:0/3504225714 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f9974014070 con 0x7f99840ffa80 2023-09-23T09:45:17.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.522+0000 7f99827fc700 1 --2- 172.21.15.82:0/3504225714 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f996c0a00c0 0x7f996c0a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:45:17.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.523+0000 7f99827fc700 1 --2- 172.21.15.82:0/3504225714 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f996c0a00c0 0x7f996c0a2580 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f998410e9b0 tx=0x7f9978019040 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:45:17.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.526+0000 7f996bfff700 1 -- 172.21.15.82:0/3504225714 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f9974095120 con 0x7f99840ffa80 2023-09-23T09:45:17.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.759+0000 7f99895ff700 1 -- 172.21.15.82:0/3504225714 --> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f99841106c0 con 0x7f996c0a00c0 2023-09-23T09:45:17.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.770+0000 7f996bfff700 1 -- 172.21.15.82:0/3504225714 <== mgr.15537 v2:172.21.15.82:6800/630725563 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+10 (secure 0 0 0) 0x7f99841106c0 con 0x7f996c0a00c0 2023-09-23T09:45:17.771 INFO:teuthology.orchestra.run.smithi082.stdout:/ 1M 6M3h 2023-09-23T09:45:17.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.772+0000 7f99895ff700 1 -- 172.21.15.82:0/3504225714 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f996c0a00c0 msgr2=0x7f996c0a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:45:17.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.772+0000 7f99895ff700 1 --2- 172.21.15.82:0/3504225714 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f996c0a00c0 0x7f996c0a2580 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f998410e9b0 tx=0x7f9978019040 comp rx=0 tx=0).stop 2023-09-23T09:45:17.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.772+0000 7f99895ff700 1 -- 172.21.15.82:0/3504225714 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99840ffa80 msgr2=0x7f998410d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:45:17.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.772+0000 7f99895ff700 1 --2- 172.21.15.82:0/3504225714 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99840ffa80 0x7f998410d190 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f997400e9c0 tx=0x7f997400ecd0 comp rx=0 tx=0).stop 2023-09-23T09:45:17.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.772+0000 7f99895ff700 1 -- 172.21.15.82:0/3504225714 shutdown_connections 2023-09-23T09:45:17.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.772+0000 7f99895ff700 1 --2- 172.21.15.82:0/3504225714 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f996c0a00c0 0x7f996c0a2580 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:45:17.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.772+0000 7f99895ff700 1 --2- 172.21.15.82:0/3504225714 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9984105840 0x7f99841a4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:45:17.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.772+0000 7f99895ff700 1 --2- 172.21.15.82:0/3504225714 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99840ffa80 0x7f998410d190 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:45:17.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.772+0000 7f99895ff700 1 --2- 172.21.15.82:0/3504225714 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9984100440 0x7f998410d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:45:17.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.772+0000 7f99895ff700 1 -- 172.21.15.82:0/3504225714 >> 172.21.15.82:0/3504225714 conn(0x7f9984075250 msgr2=0x7f99840fd950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:45:17.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.772+0000 7f99895ff700 1 -- 172.21.15.82:0/3504225714 shutdown_connections 2023-09-23T09:45:17.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:17.772+0000 7f99895ff700 1 -- 172.21.15.82:0/3504225714 wait complete. 2023-09-23T09:45:17.792 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2023-09-23T09:45:17.803 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2023-09-23T09:45:18.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:45:18 smithi082 ceph-mon[97694]: from='client.18321 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T09:45:18.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:45:18 smithi082 ceph-mon[97694]: osdmap e173: 12 total, 12 up, 12 in 2023-09-23T09:45:18.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:45:18 smithi135 ceph-mon[99205]: from='client.18321 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T09:45:18.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:45:18 smithi135 ceph-mon[99205]: osdmap e173: 12 total, 12 up, 12 in 2023-09-23T09:45:18.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:45:18 smithi161 ceph-mon[99580]: from='client.18321 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T09:45:18.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:45:18 smithi161 ceph-mon[99580]: osdmap e173: 12 total, 12 up, 12 in 2023-09-23T09:45:19.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:45:19 smithi135 ceph-mon[99205]: from='client.18327 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T09:45:19.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:45:19 smithi135 ceph-mon[99205]: pgmap v1539: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 312 KiB/s wr, 28 op/s 2023-09-23T09:45:19.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:45:19 smithi082 ceph-mon[97694]: from='client.18327 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T09:45:19.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:45:19 smithi082 ceph-mon[97694]: pgmap v1539: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 312 KiB/s wr, 28 op/s 2023-09-23T09:45:19.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:45:19 smithi161 ceph-mon[99580]: from='client.18327 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-09-23T09:45:19.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:45:19 smithi161 ceph-mon[99580]: pgmap v1539: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 312 KiB/s wr, 28 op/s 2023-09-23T09:45:21.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:45:21 smithi135 ceph-mon[99205]: pgmap v1540: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 336 KiB/s rd, 307 KiB/s wr, 35 op/s 2023-09-23T09:45:21.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:45:21 smithi082 ceph-mon[97694]: pgmap v1540: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 336 KiB/s rd, 307 KiB/s wr, 35 op/s 2023-09-23T09:45:21.396 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:45:21 smithi161 ceph-mon[99580]: pgmap v1540: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 336 KiB/s rd, 307 KiB/s wr, 35 op/s 2023-09-23T09:45:23.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:45:23 smithi135 ceph-mon[99205]: pgmap v1541: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 262 KiB/s wr, 34 op/s 2023-09-23T09:45:23.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:45:23 smithi082 ceph-mon[97694]: pgmap v1541: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 262 KiB/s wr, 34 op/s 2023-09-23T09:45:23.396 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:45:23 smithi161 ceph-mon[99580]: pgmap v1541: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 262 KiB/s wr, 34 op/s 2023-09-23T09:45:25.310 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:45:25 smithi135 ceph-mon[99205]: pgmap v1542: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 262 KiB/s wr, 34 op/s 2023-09-23T09:45:25.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:45:25 smithi082 ceph-mon[97694]: pgmap v1542: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 262 KiB/s wr, 34 op/s 2023-09-23T09:45:25.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:45:25 smithi161 ceph-mon[99580]: pgmap v1542: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 262 KiB/s wr, 34 op/s 2023-09-23T09:45:27.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:45:27 smithi135 ceph-mon[99205]: pgmap v1543: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 235 KiB/s wr, 28 op/s 2023-09-23T09:45:27.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:45:27 smithi082 ceph-mon[97694]: pgmap v1543: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 235 KiB/s wr, 28 op/s 2023-09-23T09:45:27.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:45:27 smithi161 ceph-mon[99580]: pgmap v1543: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 235 KiB/s wr, 28 op/s 2023-09-23T09:45:28.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:45:28 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:45:28.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:45:28 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:45:28.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:45:28 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:45:29.310 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:45:29 smithi135 ceph-mon[99205]: pgmap v1544: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 132 KiB/s wr, 24 op/s 2023-09-23T09:45:29.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:45:29 smithi082 ceph-mon[97694]: pgmap v1544: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 132 KiB/s wr, 24 op/s 2023-09-23T09:45:29.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:45:29 smithi161 ceph-mon[99580]: pgmap v1544: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 132 KiB/s wr, 24 op/s 2023-09-23T09:45:31.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:45:31 smithi135 ceph-mon[99205]: pgmap v1545: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 116 KiB/s wr, 23 op/s 2023-09-23T09:45:31.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:45:31 smithi082 ceph-mon[97694]: pgmap v1545: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 116 KiB/s wr, 23 op/s 2023-09-23T09:45:31.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:45:31 smithi161 ceph-mon[99580]: pgmap v1545: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 116 KiB/s wr, 23 op/s 2023-09-23T09:45:33.310 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:45:33 smithi135 ceph-mon[99205]: pgmap v1546: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 132 KiB/s wr, 16 op/s 2023-09-23T09:45:33.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:45:33 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:45:33.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:45:33 smithi082 ceph-mon[97694]: pgmap v1546: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 132 KiB/s wr, 16 op/s 2023-09-23T09:45:33.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:45:33 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:45:33.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:45:33 smithi161 ceph-mon[99580]: pgmap v1546: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 132 KiB/s wr, 16 op/s 2023-09-23T09:45:33.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:45:33 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:45:35.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:45:35 smithi082 ceph-mon[97694]: pgmap v1547: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 96 KiB/s wr, 12 op/s 2023-09-23T09:45:35.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:45:35 smithi161 ceph-mon[99580]: pgmap v1547: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 96 KiB/s wr, 12 op/s 2023-09-23T09:45:35.560 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:45:35 smithi135 ceph-mon[99205]: pgmap v1547: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 96 KiB/s wr, 12 op/s 2023-09-23T09:45:37.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:45:37 smithi082 ceph-mon[97694]: pgmap v1548: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 154 KiB/s wr, 19 op/s 2023-09-23T09:45:37.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:45:37 smithi161 ceph-mon[99580]: pgmap v1548: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 154 KiB/s wr, 19 op/s 2023-09-23T09:45:37.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:45:37 smithi135 ceph-mon[99205]: pgmap v1548: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 154 KiB/s wr, 19 op/s 2023-09-23T09:45:38.336 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:45:38.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.545+0000 7fa3663ff700 1 -- 172.21.15.82:0/4235071035 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa360100890 msgr2=0x7fa360100d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:45:38.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.545+0000 7fa3663ff700 1 --2- 172.21.15.82:0/4235071035 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa360100890 0x7fa360100d10 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fa348009990 tx=0x7fa348009ca0 comp rx=0 tx=0).stop 2023-09-23T09:45:38.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.546+0000 7fa3663ff700 1 -- 172.21.15.82:0/4235071035 shutdown_connections 2023-09-23T09:45:38.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.546+0000 7fa3663ff700 1 --2- 172.21.15.82:0/4235071035 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa360101250 0x7fa36010d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:45:38.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.546+0000 7fa3663ff700 1 --2- 172.21.15.82:0/4235071035 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3601068a0 0x7fa360106c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:45:38.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.546+0000 7fa3663ff700 1 --2- 172.21.15.82:0/4235071035 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa360100890 0x7fa360100d10 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:45:38.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.546+0000 7fa3663ff700 1 -- 172.21.15.82:0/4235071035 >> 172.21.15.82:0/4235071035 conn(0x7fa3600fc380 msgr2=0x7fa3600fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:45:38.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.546+0000 7fa3663ff700 1 -- 172.21.15.82:0/4235071035 shutdown_connections 2023-09-23T09:45:38.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.546+0000 7fa3663ff700 1 -- 172.21.15.82:0/4235071035 wait complete. 2023-09-23T09:45:38.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.547+0000 7fa3663ff700 1 Processor -- start 2023-09-23T09:45:38.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.547+0000 7fa3663ff700 1 -- start start 2023-09-23T09:45:38.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.547+0000 7fa3663ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa360100890 0x7fa36019e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:45:38.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.547+0000 7fa3663ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa360101250 0x7fa36019ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:45:38.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.547+0000 7fa3663ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3601068a0 0x7fa360198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:45:38.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.547+0000 7fa3663ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3601990d0 con 0x7fa3601068a0 2023-09-23T09:45:38.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.547+0000 7fa3663ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa360199240 con 0x7fa360100890 2023-09-23T09:45:38.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.547+0000 7fa3663ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa360199400 con 0x7fa360101250 2023-09-23T09:45:38.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.548+0000 7fa35ffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa360100890 0x7fa36019e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:45:38.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.548+0000 7fa36499c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3601068a0 0x7fa360198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:45:38.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.548+0000 7fa35ffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa360100890 0x7fa36019e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:42838/0 (socket says 172.21.15.82:42838) 2023-09-23T09:45:38.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.548+0000 7fa35ffff700 1 -- 172.21.15.82:0/3550245477 learned_addr learned my addr 172.21.15.82:0/3550245477 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:45:38.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.548+0000 7fa357fff700 1 --2- 172.21.15.82:0/3550245477 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa360101250 0x7fa36019ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:45:38.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.548+0000 7fa35ffff700 1 -- 172.21.15.82:0/3550245477 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa360101250 msgr2=0x7fa36019ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:45:38.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.548+0000 7fa35ffff700 1 --2- 172.21.15.82:0/3550245477 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa360101250 0x7fa36019ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:45:38.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.548+0000 7fa35ffff700 1 -- 172.21.15.82:0/3550245477 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3601068a0 msgr2=0x7fa360198900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:45:38.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.548+0000 7fa35ffff700 1 --2- 172.21.15.82:0/3550245477 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3601068a0 0x7fa360198900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:45:38.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.548+0000 7fa35ffff700 1 -- 172.21.15.82:0/3550245477 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3480095f0 con 0x7fa360100890 2023-09-23T09:45:38.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.548+0000 7fa35ffff700 1 --2- 172.21.15.82:0/3550245477 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa360100890 0x7fa36019e920 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fa35000e9a0 tx=0x7fa35000ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:45:38.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.548+0000 7fa35dffb700 1 -- 172.21.15.82:0/3550245477 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa350009790 con 0x7fa360100890 2023-09-23T09:45:38.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.549+0000 7fa3663ff700 1 -- 172.21.15.82:0/3550245477 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3601996e0 con 0x7fa360100890 2023-09-23T09:45:38.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.549+0000 7fa35dffb700 1 -- 172.21.15.82:0/3550245477 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa35000cbd0 con 0x7fa360100890 2023-09-23T09:45:38.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.549+0000 7fa35dffb700 1 -- 172.21.15.82:0/3550245477 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa350018680 con 0x7fa360100890 2023-09-23T09:45:38.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.549+0000 7fa3663ff700 1 -- 172.21.15.82:0/3550245477 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3601a58f0 con 0x7fa360100890 2023-09-23T09:45:38.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.552+0000 7fa35dffb700 1 -- 172.21.15.82:0/3550245477 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7fa35000cd40 con 0x7fa360100890 2023-09-23T09:45:38.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.553+0000 7fa379cd2b80 1 Processor -- start 2023-09-23T09:45:38.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.553+0000 7fa379cd2b80 1 -- start start 2023-09-23T09:45:38.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.553+0000 7fa379cd2b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653b942e380 0x5653b942e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:45:38.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.553+0000 7fa379cd2b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653b942eca0 0x5653b9428700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:45:38.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.553+0000 7fa35dffb700 1 --2- 172.21.15.82:0/3550245477 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fa34c0a0140 0x7fa34c0a2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:45:38.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.553+0000 7fa379cd2b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5653b9428c40 0x5653b94290a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:45:38.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.553+0000 7fa379cd2b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653b93907b0 con 0x5653b942eca0 2023-09-23T09:45:38.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.553+0000 7fa379cd2b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653b9381780 con 0x5653b942e380 2023-09-23T09:45:38.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.553+0000 7fa379cd2b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653b937f0a0 con 0x5653b9428c40 2023-09-23T09:45:38.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.554+0000 7fa35dffb700 1 -- 172.21.15.82:0/3550245477 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fa350014070 con 0x7fa360100890 2023-09-23T09:45:38.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.554+0000 7fa36499c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653b942e380 0x5653b942e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:45:38.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.554+0000 7fa36499c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653b942e380 0x5653b942e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:42852/0 (socket says 172.21.15.82:42852) 2023-09-23T09:45:38.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.554+0000 7fa36499c700 1 -- 172.21.15.82:0/440542290 learned_addr learned my addr 172.21.15.82:0/440542290 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:45:38.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.554+0000 7fa357fff700 1 --2- 172.21.15.82:0/440542290 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653b942eca0 0x5653b9428700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:45:38.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.554+0000 7fa35ffff700 1 --2- 172.21.15.82:0/3550245477 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fa34c0a0140 0x7fa34c0a2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:45:38.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.554+0000 7fa36499c700 1 --2- 172.21.15.82:0/440542290 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5653b9428c40 0x5653b94290a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:45:38.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.554+0000 7fa36499c700 1 -- 172.21.15.82:0/440542290 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5653b9428c40 msgr2=0x5653b94290a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:45:38.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.554+0000 7fa36499c700 1 --2- 172.21.15.82:0/440542290 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5653b9428c40 0x5653b94290a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:45:38.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.554+0000 7fa36499c700 1 -- 172.21.15.82:0/440542290 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653b942eca0 msgr2=0x5653b9428700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:45:38.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.554+0000 7fa36499c700 1 --2- 172.21.15.82:0/440542290 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653b942eca0 0x5653b9428700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:45:38.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.554+0000 7fa36499c700 1 -- 172.21.15.82:0/440542290 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5653b91fa630 con 0x5653b942e380 2023-09-23T09:45:38.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.554+0000 7fa357fff700 1 --2- 172.21.15.82:0/440542290 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653b942eca0 0x5653b9428700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:45:38.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.554+0000 7fa36499c700 1 --2- 172.21.15.82:0/440542290 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653b942e380 0x5653b942e760 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fa358009900 tx=0x7fa358009650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6962da5c0c52abf server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:45:38.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.554+0000 7fa35ffff700 1 --2- 172.21.15.82:0/3550245477 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fa34c0a0140 0x7fa34c0a2600 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa350095960 tx=0x7fa35000eef0 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:45:38.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.555+0000 7fa3567fc700 1 -- 172.21.15.82:0/440542290 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa358015500 con 0x5653b942e380 2023-09-23T09:45:38.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.555+0000 7fa3567fc700 1 -- 172.21.15.82:0/440542290 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa358015af0 con 0x5653b942e380 2023-09-23T09:45:38.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.555+0000 7fa3567fc700 1 -- 172.21.15.82:0/440542290 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa35801aa80 con 0x5653b942e380 2023-09-23T09:45:38.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.555+0000 7fa379cd2b80 1 -- 172.21.15.82:0/440542290 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653b942e380 msgr2=0x5653b942e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:45:38.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.555+0000 7fa379cd2b80 1 --2- 172.21.15.82:0/440542290 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653b942e380 0x5653b942e760 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fa358009900 tx=0x7fa358009650 comp rx=0 tx=0).stop 2023-09-23T09:45:38.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.555+0000 7fa379cd2b80 1 -- 172.21.15.82:0/440542290 shutdown_connections 2023-09-23T09:45:38.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.555+0000 7fa379cd2b80 1 --2- 172.21.15.82:0/440542290 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5653b9428c40 0x5653b94290a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:45:38.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.555+0000 7fa379cd2b80 1 --2- 172.21.15.82:0/440542290 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653b942e380 0x5653b942e760 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:45:38.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.555+0000 7fa379cd2b80 1 --2- 172.21.15.82:0/440542290 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653b942eca0 0x5653b9428700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:45:38.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.555+0000 7fa379cd2b80 1 -- 172.21.15.82:0/440542290 >> 172.21.15.82:0/440542290 conn(0x5653b939d0e0 msgr2=0x5653b9423410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:45:38.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.555+0000 7fa379cd2b80 1 -- 172.21.15.82:0/440542290 shutdown_connections 2023-09-23T09:45:38.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.555+0000 7fa379cd2b80 1 -- 172.21.15.82:0/440542290 wait complete. 2023-09-23T09:45:38.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.556+0000 7fa379cd2b80 1 -- start start 2023-09-23T09:45:38.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.556+0000 7fa379cd2b80 1 Processor -- start 2023-09-23T09:45:38.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.557+0000 7fa379cd2b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5653b9428c40 0x5653b9434c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:45:38.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.557+0000 7fa379cd2b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653b942e380 0x5653b9431f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:45:38.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.557+0000 7fa379cd2b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653b942eca0 0x5653b9432670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:45:38.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.557+0000 7fa379cd2b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653b937a990 con 0x5653b942e380 2023-09-23T09:45:38.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.557+0000 7fa379cd2b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653b9318bb0 con 0x5653b942eca0 2023-09-23T09:45:38.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.557+0000 7fa379cd2b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653b93188b0 con 0x5653b9428c40 2023-09-23T09:45:38.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.557+0000 7fa379cd2b80 10 client.0 _ll_register_callbacks cb 0x5653b9262a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:45:38.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.557+0000 7fa357fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653b942e380 0x5653b9431f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:45:38.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.557+0000 7fa357fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653b942e380 0x5653b9431f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44706/0 (socket says 172.21.15.82:44706) 2023-09-23T09:45:38.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.557+0000 7fa357fff700 1 -- 172.21.15.82:0/328819651 learned_addr learned my addr 172.21.15.82:0/328819651 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:45:38.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.557+0000 7fa36499c700 1 --2- 172.21.15.82:0/328819651 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653b942eca0 0x5653b9432670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:45:38.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.557+0000 7fa36499c700 1 --2- 172.21.15.82:0/328819651 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5653b9428c40 0x5653b9434c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:45:38.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.557+0000 7fa357fff700 1 -- 172.21.15.82:0/328819651 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5653b9428c40 msgr2=0x5653b9434c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:45:38.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.557+0000 7fa357fff700 1 --2- 172.21.15.82:0/328819651 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5653b9428c40 0x5653b9434c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:45:38.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.557+0000 7fa357fff700 1 -- 172.21.15.82:0/328819651 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653b942eca0 msgr2=0x5653b9432670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:45:38.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.557+0000 7fa357fff700 1 --2- 172.21.15.82:0/328819651 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653b942eca0 0x5653b9432670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:45:38.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.557+0000 7fa357fff700 1 -- 172.21.15.82:0/328819651 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa358013040 con 0x5653b942e380 2023-09-23T09:45:38.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.558+0000 7fa357fff700 1 --2- 172.21.15.82:0/328819651 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653b942e380 0x5653b9431f80 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fa348009990 tx=0x7fa348005750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f53e7b05dd1a27d server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:45:38.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.558+0000 7fa33f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:45:38.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.558+0000 7fa33f7fe700 1 -- 172.21.15.82:0/328819651 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa348004500 con 0x5653b942e380 2023-09-23T09:45:38.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.558+0000 7fa379cd2b80 1 -- 172.21.15.82:0/328819651 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5653b93f81c0 con 0x5653b942e380 2023-09-23T09:45:38.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.558+0000 7fa33f7fe700 1 -- 172.21.15.82:0/328819651 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(173..173 src has 1..173) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fa348004660 con 0x5653b942e380 2023-09-23T09:45:38.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.558+0000 7fa33f7fe700 1 -- 172.21.15.82:0/328819651 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=138) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa348004820 con 0x5653b942e380 2023-09-23T09:45:38.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.558+0000 7fa379cd2b80 10 client.18339 fetch_fsmap learned FSMap version 138 2023-09-23T09:45:38.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.558+0000 7fa379cd2b80 1 -- 172.21.15.82:0/328819651 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=138,monmap=4+}) v3 -- 0x5653b91a6de0 con 0x5653b942e380 2023-09-23T09:45:38.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.558+0000 7fa33f7fe700 1 -- 172.21.15.82:0/328819651 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5653b93f81c0 con 0x5653b942e380 2023-09-23T09:45:38.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.559+0000 7fa33f7fe700 1 -- 172.21.15.82:0/328819651 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 138) v1 ==== 7930+0+0 (secure 0 0 0) 0x7fa34800fa60 con 0x5653b942e380 2023-09-23T09:45:38.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.559+0000 7fa379cd2b80 10 client.18339 fetch_fsmap finished waiting for FSMap version 138 2023-09-23T09:45:38.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.559+0000 7fa379cd2b80 10 client.18339 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:45:38.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.559+0000 7fa379cd2b80 20 client.18339 populate_metadata read hostname 'smithi082' 2023-09-23T09:45:38.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.559+0000 7fa379cd2b80 1 --2- 172.21.15.82:0/328819651 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5653b9442860 0x5653b9444c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:45:38.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.559+0000 7fa379cd2b80 4 client.18339 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:45:38.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.559+0000 7fa379cd2b80 1 -- 172.21.15.82:0/328819651 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5653b9320ba0 con 0x5653b9442860 2023-09-23T09:45:38.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.559+0000 7fa36499c700 1 --2- 172.21.15.82:0/328819651 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5653b9442860 0x5653b9444c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:45:38.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.559+0000 7fa33f7fe700 10 client.18339 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:45:38.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.559+0000 7fa36499c700 1 --2- 172.21.15.82:0/328819651 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5653b9442860 0x5653b9444c80 crc :-1 s=READY pgs=291 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=38839f83b0aeef6 server_cookie=135603639a993abf in_seq=0 out_seq=0 2023-09-23T09:45:38.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.560+0000 7fa33f7fe700 1 -- 172.21.15.82:0/328819651 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5653b9320ba0 con 0x5653b9442860 2023-09-23T09:45:38.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.560+0000 7fa33f7fe700 10 client.18339 handle_command_reply: tid=0 2023-09-23T09:45:38.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.560+0000 7fa379cd2b80 1 client.18339 shutdown 2023-09-23T09:45:38.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.561+0000 7fa379cd2b80 1 -- 172.21.15.82:0/328819651 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653b942e380 msgr2=0x5653b9431f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:45:38.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.561+0000 7fa379cd2b80 1 --2- 172.21.15.82:0/328819651 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653b942e380 0x5653b9431f80 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fa348009990 tx=0x7fa348005750 comp rx=0 tx=0).stop 2023-09-23T09:45:38.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.561+0000 7fa379cd2b80 1 -- 172.21.15.82:0/328819651 shutdown_connections 2023-09-23T09:45:38.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.561+0000 7fa379cd2b80 1 --2- 172.21.15.82:0/328819651 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653b942eca0 0x5653b9432670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:45:38.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.561+0000 7fa379cd2b80 1 --2- 172.21.15.82:0/328819651 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5653b9428c40 0x5653b9434c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:45:38.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.561+0000 7fa379cd2b80 1 --2- 172.21.15.82:0/328819651 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5653b9442860 0x5653b9444c80 crc :-1 s=READY pgs=291 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:45:38.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.561+0000 7fa379cd2b80 1 --2- 172.21.15.82:0/328819651 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653b942e380 0x5653b9431f80 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:45:38.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.561+0000 7fa33f7fe700 0 client.18339 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:45:38.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.561+0000 7fa379cd2b80 1 -- 172.21.15.82:0/328819651 >> 172.21.15.82:0/328819651 conn(0x5653b939d0e0 msgr2=0x5653b941db40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:45:38.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.561+0000 7fa379cd2b80 1 -- 172.21.15.82:0/328819651 shutdown_connections 2023-09-23T09:45:38.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.561+0000 7fa379cd2b80 1 -- 172.21.15.82:0/328819651 wait complete. 2023-09-23T09:45:38.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.561+0000 7fa379cd2b80 20 client.18339 trim_cache size 0 max 16384 2023-09-23T09:45:38.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.578+0000 7fa379cd2b80 1 Processor -- start 2023-09-23T09:45:38.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.578+0000 7fa379cd2b80 1 -- start start 2023-09-23T09:45:38.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.578+0000 7fa379cd2b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653b9428c40 0x5653b9428700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:45:38.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.578+0000 7fa379cd2b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653b942e380 0x5653b94397a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:45:38.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.578+0000 7fa379cd2b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5653b942eca0 0x5653b942c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:45:38.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.578+0000 7fa379cd2b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653b91fc920 con 0x5653b942e380 2023-09-23T09:45:38.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.578+0000 7fa379cd2b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653b94330c0 con 0x5653b9428c40 2023-09-23T09:45:38.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.578+0000 7fa379cd2b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653b943f140 con 0x5653b942eca0 2023-09-23T09:45:38.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.579+0000 7fa36499c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653b9428c40 0x5653b9428700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:45:38.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.579+0000 7fa357fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653b942e380 0x5653b94397a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:45:38.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.579+0000 7fa36499c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653b9428c40 0x5653b9428700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:42874/0 (socket says 172.21.15.82:42874) 2023-09-23T09:45:38.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.579+0000 7fa36499c700 1 -- 172.21.15.82:0/2456999492 learned_addr learned my addr 172.21.15.82:0/2456999492 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:45:38.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.579+0000 7fa357fff700 1 -- 172.21.15.82:0/2456999492 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5653b942eca0 msgr2=0x5653b942c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:45:38.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.579+0000 7fa357fff700 1 --2- 172.21.15.82:0/2456999492 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5653b942eca0 0x5653b942c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:45:38.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.579+0000 7fa357fff700 1 -- 172.21.15.82:0/2456999492 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653b9428c40 msgr2=0x5653b9428700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:45:38.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.579+0000 7fa357fff700 1 --2- 172.21.15.82:0/2456999492 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653b9428c40 0x5653b9428700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:45:38.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.579+0000 7fa357fff700 1 -- 172.21.15.82:0/2456999492 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5653b9449870 con 0x5653b942e380 2023-09-23T09:45:38.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.579+0000 7fa357fff700 1 --2- 172.21.15.82:0/2456999492 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653b942e380 0x5653b94397a0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fa34800fe20 tx=0x7fa348009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2689ea19b6e49f8 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:45:38.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.579+0000 7fa356ffd700 1 -- 172.21.15.82:0/2456999492 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa34803b070 con 0x5653b942e380 2023-09-23T09:45:38.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.579+0000 7fa356ffd700 1 -- 172.21.15.82:0/2456999492 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa34801e050 con 0x5653b942e380 2023-09-23T09:45:38.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.580+0000 7fa356ffd700 1 -- 172.21.15.82:0/2456999492 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa34800f460 con 0x5653b942e380 2023-09-23T09:45:38.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.580+0000 7fa379cd2b80 1 -- 172.21.15.82:0/2456999492 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653b942e380 msgr2=0x5653b94397a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:45:38.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.580+0000 7fa379cd2b80 1 --2- 172.21.15.82:0/2456999492 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653b942e380 0x5653b94397a0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fa34800fe20 tx=0x7fa348009ca0 comp rx=0 tx=0).stop 2023-09-23T09:45:38.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.580+0000 7fa379cd2b80 1 -- 172.21.15.82:0/2456999492 shutdown_connections 2023-09-23T09:45:38.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.580+0000 7fa379cd2b80 1 --2- 172.21.15.82:0/2456999492 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5653b942eca0 0x5653b942c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:45:38.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.580+0000 7fa379cd2b80 1 --2- 172.21.15.82:0/2456999492 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653b9428c40 0x5653b9428700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:45:38.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.580+0000 7fa379cd2b80 1 --2- 172.21.15.82:0/2456999492 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653b942e380 0x5653b94397a0 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:45:38.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.580+0000 7fa379cd2b80 1 -- 172.21.15.82:0/2456999492 >> 172.21.15.82:0/2456999492 conn(0x5653b939d0e0 msgr2=0x5653b94230a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:45:38.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.580+0000 7fa379cd2b80 1 -- 172.21.15.82:0/2456999492 shutdown_connections 2023-09-23T09:45:38.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.580+0000 7fa379cd2b80 1 -- 172.21.15.82:0/2456999492 wait complete. 2023-09-23T09:45:38.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.581+0000 7fa379cd2b80 1 -- start start 2023-09-23T09:45:38.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.581+0000 7fa379cd2b80 1 Processor -- start 2023-09-23T09:45:38.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.581+0000 7fa379cd2b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653b9428c40 0x5653b94389c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:45:38.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.581+0000 7fa379cd2b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653b942e380 0x5653b9438f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:45:38.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.581+0000 7fa379cd2b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5653b942eca0 0x5653b9495650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:45:38.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.581+0000 7fa379cd2b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653b9439750 con 0x5653b942e380 2023-09-23T09:45:38.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.581+0000 7fa379cd2b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653b9495b90 con 0x5653b9428c40 2023-09-23T09:45:38.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.581+0000 7fa379cd2b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653b9495cd0 con 0x5653b942eca0 2023-09-23T09:45:38.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.581+0000 7fa379cd2b80 10 client.0 _ll_register_callbacks cb 0x7fa3480053e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:45:38.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.582+0000 7fa357fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653b942e380 0x5653b9438f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:45:38.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.582+0000 7fa357fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653b942e380 0x5653b9438f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44730/0 (socket says 172.21.15.82:44730) 2023-09-23T09:45:38.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.582+0000 7fa357fff700 1 -- 172.21.15.82:0/969831824 learned_addr learned my addr 172.21.15.82:0/969831824 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:45:38.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.582+0000 7fa36499c700 1 --2- 172.21.15.82:0/969831824 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653b9428c40 0x5653b94389c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:45:38.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.582+0000 7fa357fff700 1 -- 172.21.15.82:0/969831824 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5653b942eca0 msgr2=0x5653b9495650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:45:38.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.582+0000 7fa357fff700 1 --2- 172.21.15.82:0/969831824 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5653b942eca0 0x5653b9495650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:45:38.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.582+0000 7fa357fff700 1 -- 172.21.15.82:0/969831824 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653b9428c40 msgr2=0x5653b94389c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:45:38.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.582+0000 7fa357fff700 1 --2- 172.21.15.82:0/969831824 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653b9428c40 0x5653b94389c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:45:38.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.582+0000 7fa357fff700 1 -- 172.21.15.82:0/969831824 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5653b91a6de0 con 0x5653b942e380 2023-09-23T09:45:38.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.582+0000 7fa357fff700 1 --2- 172.21.15.82:0/969831824 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653b942e380 0x5653b9438f00 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x5653b9432af0 tx=0x7fa34800b2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9d406641691c04c server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:45:38.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.582+0000 7fa33f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:45:38.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.582+0000 7fa33f7fe700 1 -- 172.21.15.82:0/969831824 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa34803b040 con 0x5653b942e380 2023-09-23T09:45:38.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.582+0000 7fa379cd2b80 1 -- 172.21.15.82:0/969831824 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5653b941b8b0 con 0x5653b942e380 2023-09-23T09:45:38.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.582+0000 7fa33f7fe700 1 -- 172.21.15.82:0/969831824 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(173..173 src has 1..173) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fa348000e40 con 0x5653b942e380 2023-09-23T09:45:38.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.583+0000 7fa33f7fe700 1 -- 172.21.15.82:0/969831824 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=138) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa348023b20 con 0x5653b942e380 2023-09-23T09:45:38.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.583+0000 7fa379cd2b80 10 client.18345 fetch_fsmap learned FSMap version 138 2023-09-23T09:45:38.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.583+0000 7fa379cd2b80 1 -- 172.21.15.82:0/969831824 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=138,monmap=4+}) v3 -- 0x5653b918fc60 con 0x5653b942e380 2023-09-23T09:45:38.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.583+0000 7fa33f7fe700 1 -- 172.21.15.82:0/969831824 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa34804c020 con 0x5653b942e380 2023-09-23T09:45:38.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.583+0000 7fa33f7fe700 1 -- 172.21.15.82:0/969831824 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 138) v1 ==== 7930+0+0 (secure 0 0 0) 0x7fa348004500 con 0x5653b942e380 2023-09-23T09:45:38.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.583+0000 7fa379cd2b80 10 client.18345 fetch_fsmap finished waiting for FSMap version 138 2023-09-23T09:45:38.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.583+0000 7fa379cd2b80 10 client.18345 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:45:38.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.583+0000 7fa379cd2b80 20 client.18345 populate_metadata read hostname 'smithi082' 2023-09-23T09:45:38.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.583+0000 7fa379cd2b80 1 --2- 172.21.15.82:0/969831824 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5653b9497060 0x5653b9499480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:45:38.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.583+0000 7fa379cd2b80 4 client.18345 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:45:38.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.583+0000 7fa379cd2b80 1 -- 172.21.15.82:0/969831824 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5653b9373970 con 0x5653b9497060 2023-09-23T09:45:38.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.583+0000 7fa36499c700 1 --2- 172.21.15.82:0/969831824 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5653b9497060 0x5653b9499480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:45:38.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.584+0000 7fa36499c700 1 --2- 172.21.15.82:0/969831824 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5653b9497060 0x5653b9499480 crc :-1 s=READY pgs=292 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b3938862e772db02 server_cookie=29485162f08ddd43 in_seq=0 out_seq=0 2023-09-23T09:45:38.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.584+0000 7fa33f7fe700 10 client.18345 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:45:38.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.584+0000 7fa33f7fe700 1 -- 172.21.15.82:0/969831824 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x5653b9373970 con 0x5653b9497060 2023-09-23T09:45:38.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.584+0000 7fa33f7fe700 10 client.18345 handle_command_reply: tid=0 2023-09-23T09:45:38.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.584+0000 7fa379cd2b80 1 client.18345 shutdown 2023-09-23T09:45:38.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.584+0000 7fa379cd2b80 1 -- 172.21.15.82:0/969831824 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653b942e380 msgr2=0x5653b9438f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:45:38.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.584+0000 7fa379cd2b80 1 --2- 172.21.15.82:0/969831824 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653b942e380 0x5653b9438f00 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x5653b9432af0 tx=0x7fa34800b2d0 comp rx=0 tx=0).stop 2023-09-23T09:45:38.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.584+0000 7fa379cd2b80 1 -- 172.21.15.82:0/969831824 shutdown_connections 2023-09-23T09:45:38.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.584+0000 7fa379cd2b80 1 --2- 172.21.15.82:0/969831824 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5653b942eca0 0x5653b9495650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:45:38.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.584+0000 7fa379cd2b80 1 --2- 172.21.15.82:0/969831824 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653b9428c40 0x5653b94389c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:45:38.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.584+0000 7fa379cd2b80 1 --2- 172.21.15.82:0/969831824 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x5653b9497060 0x5653b9499480 crc :-1 s=READY pgs=292 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:45:38.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.584+0000 7fa379cd2b80 1 --2- 172.21.15.82:0/969831824 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653b942e380 0x5653b9438f00 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:45:38.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.584+0000 7fa33f7fe700 0 client.18345 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:45:38.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.584+0000 7fa379cd2b80 1 -- 172.21.15.82:0/969831824 >> 172.21.15.82:0/969831824 conn(0x5653b939d0e0 msgr2=0x5653b942c170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:45:38.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.585+0000 7fa379cd2b80 1 -- 172.21.15.82:0/969831824 shutdown_connections 2023-09-23T09:45:38.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.585+0000 7fa379cd2b80 1 -- 172.21.15.82:0/969831824 wait complete. 2023-09-23T09:45:38.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.585+0000 7fa379cd2b80 20 client.18345 trim_cache size 0 max 16384 2023-09-23T09:45:38.593 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:45:38.593 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-23T09:45:38.593 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:45:38.593 INFO:teuthology.orchestra.run.smithi082.stdout: "d9e62ab8-1468-4fb0-a9fe-61bed13e954b": { 2023-09-23T09:45:38.593 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:45:38.593 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "d9e62ab8-1468-4fb0-a9fe-61bed13e954b", 2023-09-23T09:45:38.594 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:45:38.594 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:45:38.594 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:45:38.594 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:45:38.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.585+0000 7fa3663ff700 1 -- 172.21.15.82:0/3550245477 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fa34c0a0140 msgr2=0x7fa34c0a2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:45:38.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.585+0000 7fa3663ff700 1 --2- 172.21.15.82:0/3550245477 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fa34c0a0140 0x7fa34c0a2600 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa350095960 tx=0x7fa35000eef0 comp rx=0 tx=0).stop 2023-09-23T09:45:38.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.585+0000 7fa3663ff700 1 -- 172.21.15.82:0/3550245477 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa360100890 msgr2=0x7fa36019e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:45:38.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.585+0000 7fa3663ff700 1 --2- 172.21.15.82:0/3550245477 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa360100890 0x7fa36019e920 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fa35000e9a0 tx=0x7fa35000ecb0 comp rx=0 tx=0).stop 2023-09-23T09:45:38.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.585+0000 7fa3663ff700 1 -- 172.21.15.82:0/3550245477 shutdown_connections 2023-09-23T09:45:38.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.585+0000 7fa3663ff700 1 --2- 172.21.15.82:0/3550245477 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fa34c0a0140 0x7fa34c0a2600 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:45:38.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.585+0000 7fa3663ff700 1 --2- 172.21.15.82:0/3550245477 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3601068a0 0x7fa360198900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:45:38.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.585+0000 7fa3663ff700 1 --2- 172.21.15.82:0/3550245477 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa360100890 0x7fa36019e920 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:45:38.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.585+0000 7fa3663ff700 1 --2- 172.21.15.82:0/3550245477 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa360101250 0x7fa36019ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:45:38.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.585+0000 7fa3663ff700 1 -- 172.21.15.82:0/3550245477 >> 172.21.15.82:0/3550245477 conn(0x7fa3600fc380 msgr2=0x7fa36010bc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:45:38.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.586+0000 7fa3663ff700 1 -- 172.21.15.82:0/3550245477 shutdown_connections 2023-09-23T09:45:38.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:45:38.586+0000 7fa3663ff700 1 -- 172.21.15.82:0/3550245477 wait complete. 2023-09-23T09:45:38.605 INFO:tasks.cephfs.filesystem:scrub status for tag:d9e62ab8-1468-4fb0-a9fe-61bed13e954b - {'path': '/', 'tag': 'd9e62ab8-1468-4fb0-a9fe-61bed13e954b', 'options': 'recursive,force'} 2023-09-23T09:45:38.810 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:45:38 smithi135 ceph-mon[99205]: pgmap v1549: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 145 KiB/s wr, 14 op/s 2023-09-23T09:45:38.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:45:38 smithi082 ceph-mon[97694]: pgmap v1549: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 145 KiB/s wr, 14 op/s 2023-09-23T09:45:38.896 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:45:38 smithi161 ceph-mon[99580]: pgmap v1549: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 145 KiB/s wr, 14 op/s 2023-09-23T09:45:41.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:45:41 smithi135 ceph-mon[99205]: pgmap v1550: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 106 KiB/s wr, 16 op/s 2023-09-23T09:45:41.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:45:41 smithi082 ceph-mon[97694]: pgmap v1550: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 106 KiB/s wr, 16 op/s 2023-09-23T09:45:41.396 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:45:41 smithi161 ceph-mon[99580]: pgmap v1550: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 106 KiB/s wr, 16 op/s 2023-09-23T09:45:43.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:45:43 smithi135 ceph-mon[99205]: pgmap v1551: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 106 KiB/s wr, 17 op/s 2023-09-23T09:45:43.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:45:43 smithi082 ceph-mon[97694]: pgmap v1551: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 106 KiB/s wr, 17 op/s 2023-09-23T09:45:43.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:45:43 smithi161 ceph-mon[99580]: pgmap v1551: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 106 KiB/s wr, 17 op/s 2023-09-23T09:45:45.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:45:45 smithi135 ceph-mon[99205]: pgmap v1552: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 76 KiB/s wr, 13 op/s 2023-09-23T09:45:45.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:45:45 smithi082 ceph-mon[97694]: pgmap v1552: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 76 KiB/s wr, 13 op/s 2023-09-23T09:45:45.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:45:45 smithi161 ceph-mon[99580]: pgmap v1552: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 76 KiB/s wr, 13 op/s 2023-09-23T09:45:47.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:45:47 smithi135 ceph-mon[99205]: pgmap v1553: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 76 KiB/s wr, 16 op/s 2023-09-23T09:45:47.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:45:47 smithi082 ceph-mon[97694]: pgmap v1553: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 76 KiB/s wr, 16 op/s 2023-09-23T09:45:47.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:45:47 smithi161 ceph-mon[99580]: pgmap v1553: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 76 KiB/s wr, 16 op/s 2023-09-23T09:45:48.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:45:48 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:45:48.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:45:48 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:45:48.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:45:48 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:45:49.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:45:49 smithi135 ceph-mon[99205]: pgmap v1554: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 9 op/s 2023-09-23T09:45:49.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:45:49 smithi082 ceph-mon[97694]: pgmap v1554: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 9 op/s 2023-09-23T09:45:49.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:45:49 smithi161 ceph-mon[99580]: pgmap v1554: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 9 op/s 2023-09-23T09:45:51.310 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:45:51 smithi135 ceph-mon[99205]: pgmap v1555: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 426 B/s wr, 10 op/s 2023-09-23T09:45:51.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:45:51 smithi082 ceph-mon[97694]: pgmap v1555: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 426 B/s wr, 10 op/s 2023-09-23T09:45:51.396 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:45:51 smithi161 ceph-mon[99580]: pgmap v1555: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 426 B/s wr, 10 op/s 2023-09-23T09:45:53.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:45:53 smithi135 ceph-mon[99205]: pgmap v1556: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 85 B/s wr, 10 op/s 2023-09-23T09:45:53.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:45:53 smithi082 ceph-mon[97694]: pgmap v1556: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 85 B/s wr, 10 op/s 2023-09-23T09:45:53.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:45:53 smithi161 ceph-mon[99580]: pgmap v1556: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 85 B/s wr, 10 op/s 2023-09-23T09:45:55.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:45:55 smithi135 ceph-mon[99205]: pgmap v1557: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-09-23T09:45:55.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:45:55 smithi082 ceph-mon[97694]: pgmap v1557: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-09-23T09:45:55.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:45:55 smithi161 ceph-mon[99580]: pgmap v1557: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-09-23T09:45:57.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:45:57 smithi135 ceph-mon[99205]: pgmap v1558: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-09-23T09:45:57.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:45:57 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:45:57.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:45:57 smithi082 ceph-mon[97694]: pgmap v1558: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-09-23T09:45:57.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:45:57 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:45:57.396 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:45:57 smithi161 ceph-mon[99580]: pgmap v1558: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-09-23T09:45:57.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:45:57 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:45:58.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:45:58 smithi135 ceph-mon[99205]: pgmap v1559: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-09-23T09:45:58.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:45:58 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:45:58.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:45:58 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:45:58.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:45:58 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:45:58.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:45:58 smithi082 ceph-mon[97694]: pgmap v1559: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-09-23T09:45:58.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:45:58 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:45:58.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:45:58 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:45:58.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:45:58 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:45:58.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:45:58 smithi161 ceph-mon[99580]: pgmap v1559: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-09-23T09:45:58.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:45:58 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:45:58.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:45:58 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:45:58.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:45:58 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:46:01.310 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:46:01 smithi135 ceph-mon[99205]: pgmap v1560: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-09-23T09:46:01.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:46:01 smithi082 ceph-mon[97694]: pgmap v1560: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-09-23T09:46:01.396 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:46:01 smithi161 ceph-mon[99580]: pgmap v1560: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-09-23T09:46:03.310 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:46:03 smithi135 ceph-mon[99205]: pgmap v1561: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2023-09-23T09:46:03.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:46:03 smithi082 ceph-mon[97694]: pgmap v1561: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2023-09-23T09:46:03.396 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:46:03 smithi161 ceph-mon[99580]: pgmap v1561: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2023-09-23T09:46:05.310 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:46:05 smithi135 ceph-mon[99205]: pgmap v1562: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2023-09-23T09:46:05.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:46:05 smithi082 ceph-mon[97694]: pgmap v1562: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2023-09-23T09:46:05.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:46:05 smithi161 ceph-mon[99580]: pgmap v1562: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2023-09-23T09:46:07.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:46:07 smithi135 ceph-mon[99205]: pgmap v1563: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 26 op/s 2023-09-23T09:46:07.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:46:07 smithi135 ceph-mon[99205]: osdmap e174: 12 total, 12 up, 12 in 2023-09-23T09:46:07.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:46:07 smithi082 ceph-mon[97694]: pgmap v1563: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 26 op/s 2023-09-23T09:46:07.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:46:07 smithi082 ceph-mon[97694]: osdmap e174: 12 total, 12 up, 12 in 2023-09-23T09:46:07.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:46:07 smithi161 ceph-mon[99580]: pgmap v1563: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 26 op/s 2023-09-23T09:46:07.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:46:07 smithi161 ceph-mon[99580]: osdmap e174: 12 total, 12 up, 12 in 2023-09-23T09:46:08.605 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:46:08.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:46:08 smithi135 ceph-mon[99205]: pgmap v1565: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-09-23T09:46:08.874 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:46:08 smithi082 ceph-mon[97694]: pgmap v1565: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-09-23T09:46:08.896 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:46:08 smithi161 ceph-mon[99580]: pgmap v1565: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-09-23T09:46:08.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.939+0000 7f4094fff700 1 -- 172.21.15.82:0/3236141954 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f409010d0b0 msgr2=0x7f409010f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:46:08.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.939+0000 7f4094fff700 1 --2- 172.21.15.82:0/3236141954 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f409010d0b0 0x7f409010f520 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f408800b0a0 tx=0x7f408800b3b0 comp rx=0 tx=0).stop 2023-09-23T09:46:08.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.940+0000 7f4094fff700 1 -- 172.21.15.82:0/3236141954 shutdown_connections 2023-09-23T09:46:08.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.940+0000 7f4094fff700 1 --2- 172.21.15.82:0/3236141954 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f409010d0b0 0x7f409010f520 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:46:08.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.940+0000 7f4094fff700 1 --2- 172.21.15.82:0/3236141954 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4090072d50 0x7f4090073130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:46:08.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.940+0000 7f4094fff700 1 --2- 172.21.15.82:0/3236141954 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4090073670 0x7f409010cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:46:08.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.940+0000 7f4094fff700 1 -- 172.21.15.82:0/3236141954 >> 172.21.15.82:0/3236141954 conn(0x7f40900fc3a0 msgr2=0x7f40900fe7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:46:08.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.940+0000 7f4094fff700 1 -- 172.21.15.82:0/3236141954 shutdown_connections 2023-09-23T09:46:08.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.940+0000 7f4094fff700 1 -- 172.21.15.82:0/3236141954 wait complete. 2023-09-23T09:46:08.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.942+0000 7f4094fff700 1 Processor -- start 2023-09-23T09:46:08.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.942+0000 7f4094fff700 1 -- start start 2023-09-23T09:46:08.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.943+0000 7f4094fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4090073670 0x7f409019eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:46:08.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.943+0000 7f4094fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f409010d0b0 0x7f409019f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:46:08.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.943+0000 7f4094fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4090198b50 0x7f4090199000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:46:08.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.943+0000 7f4094fff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40901995d0 con 0x7f4090073670 2023-09-23T09:46:08.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.943+0000 7f4094fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4090199710 con 0x7f4090198b50 2023-09-23T09:46:08.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.943+0000 7f4094fff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40901998d0 con 0x7f409010d0b0 2023-09-23T09:46:08.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.943+0000 7f408e59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4090073670 0x7f409019eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:46:08.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.943+0000 7f408e59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4090073670 0x7f409019eae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55708/0 (socket says 172.21.15.82:55708) 2023-09-23T09:46:08.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.943+0000 7f408e59c700 1 -- 172.21.15.82:0/665341457 learned_addr learned my addr 172.21.15.82:0/665341457 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:46:08.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.943+0000 7f408dd9b700 1 --2- 172.21.15.82:0/665341457 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f409010d0b0 0x7f409019f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:46:08.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.944+0000 7f408dd9b700 1 -- 172.21.15.82:0/665341457 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4090198b50 msgr2=0x7f4090199000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:46:08.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.944+0000 7f408dd9b700 1 --2- 172.21.15.82:0/665341457 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4090198b50 0x7f4090199000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:46:08.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.944+0000 7f408dd9b700 1 -- 172.21.15.82:0/665341457 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4090073670 msgr2=0x7f409019eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:46:08.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.944+0000 7f408dd9b700 1 --2- 172.21.15.82:0/665341457 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4090073670 0x7f409019eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:46:08.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.944+0000 7f408dd9b700 1 -- 172.21.15.82:0/665341457 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4088009d00 con 0x7f409010d0b0 2023-09-23T09:46:08.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.944+0000 7f408e59c700 1 --2- 172.21.15.82:0/665341457 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4090073670 0x7f409019eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:46:08.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.945+0000 7f408dd9b700 1 --2- 172.21.15.82:0/665341457 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f409010d0b0 0x7f409019f020 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f408000b450 tx=0x7f408000b760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:46:08.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.945+0000 7f407f7fe700 1 -- 172.21.15.82:0/665341457 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4080011830 con 0x7f409010d0b0 2023-09-23T09:46:08.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.945+0000 7f4094fff700 1 -- 172.21.15.82:0/665341457 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40901a5950 con 0x7f409010d0b0 2023-09-23T09:46:08.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.945+0000 7f407f7fe700 1 -- 172.21.15.82:0/665341457 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4080011e20 con 0x7f409010d0b0 2023-09-23T09:46:08.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.945+0000 7f407f7fe700 1 -- 172.21.15.82:0/665341457 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4080010d10 con 0x7f409010d0b0 2023-09-23T09:46:08.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.945+0000 7f4094fff700 1 -- 172.21.15.82:0/665341457 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40901a5eb0 con 0x7f409010d0b0 2023-09-23T09:46:08.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.950+0000 7f407f7fe700 1 -- 172.21.15.82:0/665341457 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f4080011990 con 0x7f409010d0b0 2023-09-23T09:46:08.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.950+0000 7f40a892fb80 1 Processor -- start 2023-09-23T09:46:08.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.952+0000 7f40a892fb80 1 -- start start 2023-09-23T09:46:08.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.952+0000 7f40a892fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56299d142380 0x56299d142760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:46:08.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.952+0000 7f40a892fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56299d142ca0 0x56299d13c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:46:08.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.952+0000 7f40a892fb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56299d13cc40 0x56299d13d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:46:08.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.952+0000 7f40a892fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56299d0a47b0 con 0x56299d142ca0 2023-09-23T09:46:08.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.952+0000 7f40a892fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56299d095780 con 0x56299d142380 2023-09-23T09:46:08.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.952+0000 7f40a892fb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x56299d0930a0 con 0x56299d13cc40 2023-09-23T09:46:08.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.952+0000 7f407f7fe700 1 --2- 172.21.15.82:0/665341457 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f40780a01c0 0x7f40780a2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:46:08.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.953+0000 7f407f7fe700 1 -- 172.21.15.82:0/665341457 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 8557+0+0 (secure 0 0 0) 0x7f40800cb000 con 0x7f409010d0b0 2023-09-23T09:46:08.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.953+0000 7f408e59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56299d142ca0 0x56299d13c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:46:08.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.953+0000 7f408e59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56299d142ca0 0x56299d13c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55718/0 (socket says 172.21.15.82:55718) 2023-09-23T09:46:08.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.953+0000 7f408e59c700 1 -- 172.21.15.82:0/2445880845 learned_addr learned my addr 172.21.15.82:0/2445880845 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:46:08.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.953+0000 7f408ed9d700 1 --2- 172.21.15.82:0/665341457 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f40780a01c0 0x7f40780a2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:46:08.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.953+0000 7f408dd9b700 1 --2- 172.21.15.82:0/2445880845 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56299d13cc40 0x56299d13d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:46:08.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.953+0000 7f408dd9b700 1 -- 172.21.15.82:0/2445880845 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56299d142380 msgr2=0x56299d142760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:46:08.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.953+0000 7f408dd9b700 1 --2- 172.21.15.82:0/2445880845 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56299d142380 0x56299d142760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:46:08.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.953+0000 7f408dd9b700 1 -- 172.21.15.82:0/2445880845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56299d142ca0 msgr2=0x56299d13c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:46:08.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.954+0000 7f408dd9b700 1 --2- 172.21.15.82:0/2445880845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56299d142ca0 0x56299d13c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:46:08.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.954+0000 7f408dd9b700 1 -- 172.21.15.82:0/2445880845 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56299cf0e630 con 0x56299d13cc40 2023-09-23T09:46:08.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.954+0000 7f408dd9b700 1 --2- 172.21.15.82:0/2445880845 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56299d13cc40 0x56299d13d0a0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f40800c87e0 tx=0x7f4080004860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e04d72e67832a0b2 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:46:08.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.954+0000 7f407cff9700 1 -- 172.21.15.82:0/2445880845 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4080098100 con 0x56299d13cc40 2023-09-23T09:46:08.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.954+0000 7f408ed9d700 1 --2- 172.21.15.82:0/665341457 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f40780a01c0 0x7f40780a2680 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f408800d010 tx=0x7f4088006210 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:46:08.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.954+0000 7f407cff9700 1 -- 172.21.15.82:0/2445880845 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4080010410 con 0x56299d13cc40 2023-09-23T09:46:08.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.954+0000 7f407cff9700 1 -- 172.21.15.82:0/2445880845 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4080098c40 con 0x56299d13cc40 2023-09-23T09:46:08.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.955+0000 7f40a892fb80 1 -- 172.21.15.82:0/2445880845 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56299d13cc40 msgr2=0x56299d13d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:46:08.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.955+0000 7f40a892fb80 1 --2- 172.21.15.82:0/2445880845 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56299d13cc40 0x56299d13d0a0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f40800c87e0 tx=0x7f4080004860 comp rx=0 tx=0).stop 2023-09-23T09:46:08.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.956+0000 7f40a892fb80 1 -- 172.21.15.82:0/2445880845 shutdown_connections 2023-09-23T09:46:08.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.956+0000 7f40a892fb80 1 --2- 172.21.15.82:0/2445880845 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56299d13cc40 0x56299d13d0a0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:46:08.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.956+0000 7f40a892fb80 1 --2- 172.21.15.82:0/2445880845 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56299d142380 0x56299d142760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:46:08.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.956+0000 7f40a892fb80 1 --2- 172.21.15.82:0/2445880845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56299d142ca0 0x56299d13c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:46:08.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.956+0000 7f40a892fb80 1 -- 172.21.15.82:0/2445880845 >> 172.21.15.82:0/2445880845 conn(0x56299d0b10e0 msgr2=0x56299d137410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:46:08.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.956+0000 7f40a892fb80 1 -- 172.21.15.82:0/2445880845 shutdown_connections 2023-09-23T09:46:08.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.956+0000 7f40a892fb80 1 -- 172.21.15.82:0/2445880845 wait complete. 2023-09-23T09:46:08.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.957+0000 7f40a892fb80 1 -- start start 2023-09-23T09:46:08.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.957+0000 7f40a892fb80 1 Processor -- start 2023-09-23T09:46:08.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.960+0000 7f40a892fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56299d13cc40 0x56299d146040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:46:08.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.960+0000 7f40a892fb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56299d142380 0x56299d146580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:46:08.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.960+0000 7f40a892fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56299d142ca0 0x56299d146ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:46:08.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.960+0000 7f40a892fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56299d08e990 con 0x56299d13cc40 2023-09-23T09:46:08.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.960+0000 7f40a892fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56299d02cbb0 con 0x56299d142ca0 2023-09-23T09:46:08.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.960+0000 7f40a892fb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x56299d02c8b0 con 0x56299d142380 2023-09-23T09:46:08.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.961+0000 7f40a892fb80 10 client.0 _ll_register_callbacks cb 0x56299cf76a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:46:08.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.964+0000 7f408e59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56299d13cc40 0x56299d146040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:46:08.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.964+0000 7f408e59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56299d13cc40 0x56299d146040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55732/0 (socket says 172.21.15.82:55732) 2023-09-23T09:46:08.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.964+0000 7f408e59c700 1 -- 172.21.15.82:0/3586446221 learned_addr learned my addr 172.21.15.82:0/3586446221 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:46:08.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.965+0000 7f408e59c700 1 -- 172.21.15.82:0/3586446221 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56299d142380 msgr2=0x56299d146580 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-23T09:46:08.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.965+0000 7f408e59c700 1 --2- 172.21.15.82:0/3586446221 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56299d142380 0x56299d146580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:46:08.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.965+0000 7f408e59c700 1 -- 172.21.15.82:0/3586446221 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56299d142ca0 msgr2=0x56299d146ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-23T09:46:08.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.965+0000 7f408e59c700 1 --2- 172.21.15.82:0/3586446221 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56299d142ca0 0x56299d146ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:46:08.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.965+0000 7f408e59c700 1 -- 172.21.15.82:0/3586446221 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40901a5eb0 con 0x56299d13cc40 2023-09-23T09:46:08.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.965+0000 7f408e59c700 1 --2- 172.21.15.82:0/3586446221 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56299d13cc40 0x56299d146040 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f4084009fd0 tx=0x7f4084011cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=728cbd8e21b032ca server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:46:08.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.966+0000 7f4075ffb700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:46:08.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.976+0000 7f4075ffb700 1 -- 172.21.15.82:0/3586446221 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f408400f8e0 con 0x56299d13cc40 2023-09-23T09:46:08.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.976+0000 7f4075ffb700 1 -- 172.21.15.82:0/3586446221 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(174..174 src has 1..174) v4 ==== 8557+0+0 (secure 0 0 0) 0x7f408400fa40 con 0x56299d13cc40 2023-09-23T09:46:08.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.976+0000 7f40a892fb80 1 -- 172.21.15.82:0/3586446221 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56299d10c1c0 con 0x56299d13cc40 2023-09-23T09:46:08.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.977+0000 7f4075ffb700 1 -- 172.21.15.82:0/3586446221 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=139) v2 ==== 24+0+0 (secure 0 0 0) 0x7f408400fc40 con 0x56299d13cc40 2023-09-23T09:46:08.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.977+0000 7f40a892fb80 10 client.18354 fetch_fsmap learned FSMap version 139 2023-09-23T09:46:08.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.977+0000 7f40a892fb80 1 -- 172.21.15.82:0/3586446221 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=139,monmap=4+}) v3 -- 0x56299cebade0 con 0x56299d13cc40 2023-09-23T09:46:08.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.978+0000 7f4075ffb700 1 -- 172.21.15.82:0/3586446221 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56299d10c1c0 con 0x56299d13cc40 2023-09-23T09:46:08.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.978+0000 7f4075ffb700 1 -- 172.21.15.82:0/3586446221 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 139) v1 ==== 7926+0+0 (secure 0 0 0) 0x7f408401b020 con 0x56299d13cc40 2023-09-23T09:46:08.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.978+0000 7f40a892fb80 10 client.18354 fetch_fsmap finished waiting for FSMap version 139 2023-09-23T09:46:08.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.978+0000 7f40a892fb80 10 client.18354 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:46:08.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.978+0000 7f40a892fb80 20 client.18354 populate_metadata read hostname 'smithi082' 2023-09-23T09:46:08.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.978+0000 7f40a892fb80 1 --2- 172.21.15.82:0/3586446221 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56299d167970 0x56299d169d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:46:08.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.979+0000 7f40a892fb80 4 client.18354 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:46:08.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.979+0000 7f40a892fb80 1 -- 172.21.15.82:0/3586446221 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56299d034ba0 con 0x56299d167970 2023-09-23T09:46:08.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.980+0000 7f408dd9b700 1 --2- 172.21.15.82:0/3586446221 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56299d167970 0x56299d169d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:46:08.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.998+0000 7f408dd9b700 1 --2- 172.21.15.82:0/3586446221 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56299d167970 0x56299d169d90 crc :-1 s=READY pgs=293 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8ab1176bb62f2161 server_cookie=62a9a7efd5fbc72d in_seq=0 out_seq=0 2023-09-23T09:46:08.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.998+0000 7f4075ffb700 10 client.18354 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:46:09.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.999+0000 7f4075ffb700 1 -- 172.21.15.82:0/3586446221 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56299d034ba0 con 0x56299d167970 2023-09-23T09:46:09.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.999+0000 7f4075ffb700 10 client.18354 handle_command_reply: tid=0 2023-09-23T09:46:09.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:08.999+0000 7f40a892fb80 1 client.18354 shutdown 2023-09-23T09:46:09.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.000+0000 7f40a892fb80 1 -- 172.21.15.82:0/3586446221 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56299d13cc40 msgr2=0x56299d146040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:46:09.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.000+0000 7f40a892fb80 1 --2- 172.21.15.82:0/3586446221 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56299d13cc40 0x56299d146040 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f4084009fd0 tx=0x7f4084011cb0 comp rx=0 tx=0).stop 2023-09-23T09:46:09.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.001+0000 7f40a892fb80 1 -- 172.21.15.82:0/3586446221 shutdown_connections 2023-09-23T09:46:09.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.001+0000 7f40a892fb80 1 --2- 172.21.15.82:0/3586446221 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56299d142ca0 0x56299d146ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:46:09.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.001+0000 7f40a892fb80 1 --2- 172.21.15.82:0/3586446221 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56299d167970 0x56299d169d90 crc :-1 s=READY pgs=293 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:46:09.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.001+0000 7f40a892fb80 1 --2- 172.21.15.82:0/3586446221 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56299d13cc40 0x56299d146040 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:46:09.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.001+0000 7f40a892fb80 1 --2- 172.21.15.82:0/3586446221 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56299d142380 0x56299d146580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:46:09.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.001+0000 7f40a892fb80 1 -- 172.21.15.82:0/3586446221 >> 172.21.15.82:0/3586446221 conn(0x56299d0b10e0 msgr2=0x56299d131b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:46:09.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.001+0000 7f4075ffb700 0 client.18354 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:46:09.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.001+0000 7f40a892fb80 1 -- 172.21.15.82:0/3586446221 shutdown_connections 2023-09-23T09:46:09.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.001+0000 7f40a892fb80 1 -- 172.21.15.82:0/3586446221 wait complete. 2023-09-23T09:46:09.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.002+0000 7f40a892fb80 20 client.18354 trim_cache size 0 max 16384 2023-09-23T09:46:09.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.032+0000 7f40a892fb80 1 Processor -- start 2023-09-23T09:46:09.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.033+0000 7f40a892fb80 1 -- start start 2023-09-23T09:46:09.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.033+0000 7f40a892fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56299d13cc40 0x56299d13c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:46:09.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.033+0000 7f40a892fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56299d142380 0x56299d14d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:46:09.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.033+0000 7f40a892fb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56299d142ca0 0x56299d141110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:46:09.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.033+0000 7f40a892fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56299cf10920 con 0x56299d13cc40 2023-09-23T09:46:09.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.033+0000 7f40a892fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56299d133a40 con 0x56299d142380 2023-09-23T09:46:09.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.033+0000 7f40a892fb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x56299d138c80 con 0x56299d142ca0 2023-09-23T09:46:09.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.034+0000 7f408ed9d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56299d142ca0 0x56299d141110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:46:09.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.034+0000 7f408ed9d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56299d142ca0 0x56299d141110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.82:52626/0 (socket says 172.21.15.82:52626) 2023-09-23T09:46:09.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.034+0000 7f408ed9d700 1 -- 172.21.15.82:0/2189970561 learned_addr learned my addr 172.21.15.82:0/2189970561 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:46:09.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.035+0000 7f408ed9d700 1 -- 172.21.15.82:0/2189970561 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56299d142380 msgr2=0x56299d14d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:46:09.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.035+0000 7f408ed9d700 1 --2- 172.21.15.82:0/2189970561 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56299d142380 0x56299d14d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:46:09.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.035+0000 7f408ed9d700 1 -- 172.21.15.82:0/2189970561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56299d13cc40 msgr2=0x56299d13c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:46:09.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.035+0000 7f408ed9d700 1 --2- 172.21.15.82:0/2189970561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56299d13cc40 0x56299d13c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:46:09.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.035+0000 7f408ed9d700 1 -- 172.21.15.82:0/2189970561 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56299cea3c60 con 0x56299d142ca0 2023-09-23T09:46:09.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.035+0000 7f408ed9d700 1 --2- 172.21.15.82:0/2189970561 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56299d142ca0 0x56299d141110 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f4088015000 tx=0x7f408801c000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed9ef6be883a9471 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:46:09.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.037+0000 7f407d7fa700 1 -- 172.21.15.82:0/2189970561 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f408800e040 con 0x56299d142ca0 2023-09-23T09:46:09.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.037+0000 7f407d7fa700 1 -- 172.21.15.82:0/2189970561 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f408804b470 con 0x56299d142ca0 2023-09-23T09:46:09.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.037+0000 7f407d7fa700 1 -- 172.21.15.82:0/2189970561 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f408801c6a0 con 0x56299d142ca0 2023-09-23T09:46:09.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.038+0000 7f40a892fb80 1 -- 172.21.15.82:0/2189970561 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56299d142ca0 msgr2=0x56299d141110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:46:09.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.038+0000 7f40a892fb80 1 --2- 172.21.15.82:0/2189970561 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56299d142ca0 0x56299d141110 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f4088015000 tx=0x7f408801c000 comp rx=0 tx=0).stop 2023-09-23T09:46:09.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.038+0000 7f40a892fb80 1 -- 172.21.15.82:0/2189970561 shutdown_connections 2023-09-23T09:46:09.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.038+0000 7f40a892fb80 1 --2- 172.21.15.82:0/2189970561 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56299d142ca0 0x56299d141110 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:46:09.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.038+0000 7f40a892fb80 1 --2- 172.21.15.82:0/2189970561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56299d13cc40 0x56299d13c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:46:09.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.038+0000 7f40a892fb80 1 --2- 172.21.15.82:0/2189970561 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56299d142380 0x56299d14d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:46:09.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.038+0000 7f40a892fb80 1 -- 172.21.15.82:0/2189970561 >> 172.21.15.82:0/2189970561 conn(0x56299d0b10e0 msgr2=0x56299d1465b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:46:09.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.040+0000 7f40a892fb80 1 -- 172.21.15.82:0/2189970561 shutdown_connections 2023-09-23T09:46:09.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.040+0000 7f40a892fb80 1 -- 172.21.15.82:0/2189970561 wait complete. 2023-09-23T09:46:09.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.040+0000 7f40a892fb80 1 -- start start 2023-09-23T09:46:09.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.041+0000 7f40a892fb80 1 Processor -- start 2023-09-23T09:46:09.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.041+0000 7f40a892fb80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56299d13cc40 0x56299d1b50f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:46:09.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.041+0000 7f40a892fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56299d142380 0x56299d1b5630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:46:09.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.041+0000 7f40a892fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56299d142ca0 0x56299d1af750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:46:09.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.041+0000 7f40a892fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56299d1afe30 con 0x56299d142ca0 2023-09-23T09:46:09.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.041+0000 7f40a892fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56299d1affa0 con 0x56299d142380 2023-09-23T09:46:09.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.041+0000 7f40a892fb80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x56299d1b0160 con 0x56299d13cc40 2023-09-23T09:46:09.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.041+0000 7f40a892fb80 10 client.0 _ll_register_callbacks cb 0x7f4084009f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:46:09.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.042+0000 7f408dd9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56299d142380 0x56299d1b5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:46:09.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.042+0000 7f408dd9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56299d142380 0x56299d1b5630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:49148/0 (socket says 172.21.15.82:49148) 2023-09-23T09:46:09.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.042+0000 7f408dd9b700 1 -- 172.21.15.82:0/2309031768 learned_addr learned my addr 172.21.15.82:0/2309031768 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:46:09.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.042+0000 7f408ed9d700 1 --2- 172.21.15.82:0/2309031768 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56299d142ca0 0x56299d1af750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:46:09.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.043+0000 7f408e59c700 1 --2- 172.21.15.82:0/2309031768 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56299d13cc40 0x56299d1b50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:46:09.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.044+0000 7f408ed9d700 1 -- 172.21.15.82:0/2309031768 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56299d13cc40 msgr2=0x56299d1b50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:46:09.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.044+0000 7f408ed9d700 1 --2- 172.21.15.82:0/2309031768 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56299d13cc40 0x56299d1b50f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:46:09.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.044+0000 7f408ed9d700 1 -- 172.21.15.82:0/2309031768 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56299d142380 msgr2=0x56299d1b5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:46:09.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.044+0000 7f408ed9d700 1 --2- 172.21.15.82:0/2309031768 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56299d142380 0x56299d1b5630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:46:09.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.044+0000 7f408ed9d700 1 -- 172.21.15.82:0/2309031768 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40901101e0 con 0x56299d142ca0 2023-09-23T09:46:09.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.044+0000 7f408ed9d700 1 --2- 172.21.15.82:0/2309031768 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56299d142ca0 0x56299d1af750 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f4088009fd0 tx=0x7f408804b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ef330b18438a1dc server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:46:09.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.044+0000 7f4075ffb700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:46:09.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.045+0000 7f4075ffb700 1 -- 172.21.15.82:0/2309031768 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40880079b0 con 0x56299d142ca0 2023-09-23T09:46:09.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.045+0000 7f4075ffb700 1 -- 172.21.15.82:0/2309031768 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(174..174 src has 1..174) v4 ==== 8557+0+0 (secure 0 0 0) 0x7f4088058070 con 0x56299d142ca0 2023-09-23T09:46:09.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.045+0000 7f40a892fb80 1 -- 172.21.15.82:0/2309031768 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56299d164240 con 0x56299d142ca0 2023-09-23T09:46:09.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.046+0000 7f4075ffb700 1 -- 172.21.15.82:0/2309031768 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=139) v2 ==== 24+0+0 (secure 0 0 0) 0x7f408801c440 con 0x56299d142ca0 2023-09-23T09:46:09.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.046+0000 7f40a892fb80 10 client.18357 fetch_fsmap learned FSMap version 139 2023-09-23T09:46:09.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.046+0000 7f40a892fb80 1 -- 172.21.15.82:0/2309031768 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=139,monmap=4+}) v3 -- 0x56299cee1250 con 0x56299d142ca0 2023-09-23T09:46:09.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.046+0000 7f4075ffb700 1 -- 172.21.15.82:0/2309031768 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56299d164240 con 0x56299d142ca0 2023-09-23T09:46:09.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.047+0000 7f4075ffb700 1 -- 172.21.15.82:0/2309031768 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 139) v1 ==== 7926+0+0 (secure 0 0 0) 0x7f4088063050 con 0x56299d142ca0 2023-09-23T09:46:09.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.047+0000 7f40a892fb80 10 client.18357 fetch_fsmap finished waiting for FSMap version 139 2023-09-23T09:46:09.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.047+0000 7f40a892fb80 10 client.18357 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:46:09.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.047+0000 7f40a892fb80 20 client.18357 populate_metadata read hostname 'smithi082' 2023-09-23T09:46:09.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.047+0000 7f40a892fb80 1 --2- 172.21.15.82:0/2309031768 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56299d1bcc70 0x56299d1bf090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:46:09.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.047+0000 7f40a892fb80 4 client.18357 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:46:09.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.047+0000 7f40a892fb80 1 -- 172.21.15.82:0/2309031768 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x56299d12f8b0 con 0x56299d1bcc70 2023-09-23T09:46:09.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.056+0000 7f408e59c700 1 --2- 172.21.15.82:0/2309031768 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56299d1bcc70 0x56299d1bf090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:46:09.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.059+0000 7f408e59c700 1 --2- 172.21.15.82:0/2309031768 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56299d1bcc70 0x56299d1bf090 crc :-1 s=READY pgs=294 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=efd911b7e8d40f59 server_cookie=b730c5dbe95b8eb1 in_seq=0 out_seq=0 2023-09-23T09:46:09.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.059+0000 7f4075ffb700 10 client.18357 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:46:09.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.067+0000 7f4075ffb700 1 -- 172.21.15.82:0/2309031768 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x56299d12f8b0 con 0x56299d1bcc70 2023-09-23T09:46:09.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.067+0000 7f4075ffb700 10 client.18357 handle_command_reply: tid=0 2023-09-23T09:46:09.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.067+0000 7f40a892fb80 1 client.18357 shutdown 2023-09-23T09:46:09.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.068+0000 7f40a892fb80 1 -- 172.21.15.82:0/2309031768 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56299d142ca0 msgr2=0x56299d1af750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:46:09.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.068+0000 7f40a892fb80 1 --2- 172.21.15.82:0/2309031768 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56299d142ca0 0x56299d1af750 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f4088009fd0 tx=0x7f408804b810 comp rx=0 tx=0).stop 2023-09-23T09:46:09.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.068+0000 7f40a892fb80 1 -- 172.21.15.82:0/2309031768 shutdown_connections 2023-09-23T09:46:09.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.068+0000 7f40a892fb80 1 --2- 172.21.15.82:0/2309031768 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56299d1bcc70 0x56299d1bf090 crc :-1 s=READY pgs=294 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:46:09.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.068+0000 7f40a892fb80 1 --2- 172.21.15.82:0/2309031768 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56299d142ca0 0x56299d1af750 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:46:09.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.068+0000 7f40a892fb80 1 --2- 172.21.15.82:0/2309031768 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56299d13cc40 0x56299d1b50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:46:09.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.068+0000 7f40a892fb80 1 --2- 172.21.15.82:0/2309031768 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56299d142380 0x56299d1b5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:46:09.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.068+0000 7f40a892fb80 1 -- 172.21.15.82:0/2309031768 >> 172.21.15.82:0/2309031768 conn(0x56299d0b10e0 msgr2=0x56299d1312b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:46:09.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.068+0000 7f4075ffb700 0 client.18357 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:46:09.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.068+0000 7f40a892fb80 1 -- 172.21.15.82:0/2309031768 shutdown_connections 2023-09-23T09:46:09.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.068+0000 7f40a892fb80 1 -- 172.21.15.82:0/2309031768 wait complete. 2023-09-23T09:46:09.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.069+0000 7f40a892fb80 20 client.18357 trim_cache size 0 max 16384 2023-09-23T09:46:09.071 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:46:09.071 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-23T09:46:09.071 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:46:09.072 INFO:teuthology.orchestra.run.smithi082.stdout: "d9e62ab8-1468-4fb0-a9fe-61bed13e954b": { 2023-09-23T09:46:09.072 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:46:09.072 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "d9e62ab8-1468-4fb0-a9fe-61bed13e954b", 2023-09-23T09:46:09.072 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:46:09.072 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:46:09.072 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:46:09.072 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:46:09.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.070+0000 7f4094fff700 1 -- 172.21.15.82:0/665341457 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f40780a01c0 msgr2=0x7f40780a2680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:46:09.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.070+0000 7f4094fff700 1 --2- 172.21.15.82:0/665341457 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f40780a01c0 0x7f40780a2680 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f408800d010 tx=0x7f4088006210 comp rx=0 tx=0).stop 2023-09-23T09:46:09.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.070+0000 7f4094fff700 1 -- 172.21.15.82:0/665341457 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f409010d0b0 msgr2=0x7f409019f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:46:09.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.070+0000 7f4094fff700 1 --2- 172.21.15.82:0/665341457 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f409010d0b0 0x7f409019f020 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f408000b450 tx=0x7f408000b760 comp rx=0 tx=0).stop 2023-09-23T09:46:09.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.071+0000 7f4094fff700 1 -- 172.21.15.82:0/665341457 shutdown_connections 2023-09-23T09:46:09.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.071+0000 7f4094fff700 1 --2- 172.21.15.82:0/665341457 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f40780a01c0 0x7f40780a2680 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:46:09.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.071+0000 7f4094fff700 1 --2- 172.21.15.82:0/665341457 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4090198b50 0x7f4090199000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:46:09.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.071+0000 7f4094fff700 1 --2- 172.21.15.82:0/665341457 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4090073670 0x7f409019eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:46:09.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.071+0000 7f4094fff700 1 --2- 172.21.15.82:0/665341457 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f409010d0b0 0x7f409019f020 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:46:09.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.071+0000 7f4094fff700 1 -- 172.21.15.82:0/665341457 >> 172.21.15.82:0/665341457 conn(0x7f40900fc3a0 msgr2=0x7f40900fe790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:46:09.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.071+0000 7f4094fff700 1 -- 172.21.15.82:0/665341457 shutdown_connections 2023-09-23T09:46:09.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:09.071+0000 7f4094fff700 1 -- 172.21.15.82:0/665341457 wait complete. 2023-09-23T09:46:09.103 INFO:tasks.cephfs.filesystem:scrub status for tag:d9e62ab8-1468-4fb0-a9fe-61bed13e954b - {'path': '/', 'tag': 'd9e62ab8-1468-4fb0-a9fe-61bed13e954b', 'options': 'recursive,force'} 2023-09-23T09:46:11.310 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:46:11 smithi135 ceph-mon[99205]: pgmap v1566: 97 pgs: 5 active+clean+snaptrim, 11 active+clean+snaptrim_wait, 81 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-09-23T09:46:11.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:46:11 smithi082 ceph-mon[97694]: pgmap v1566: 97 pgs: 5 active+clean+snaptrim, 11 active+clean+snaptrim_wait, 81 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-09-23T09:46:11.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:46:11 smithi161 ceph-mon[99580]: pgmap v1566: 97 pgs: 5 active+clean+snaptrim, 11 active+clean+snaptrim_wait, 81 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-09-23T09:46:13.310 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:46:13 smithi135 ceph-mon[99205]: pgmap v1567: 97 pgs: 5 active+clean+snaptrim, 11 active+clean+snaptrim_wait, 81 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-09-23T09:46:13.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:46:13 smithi082 ceph-mon[97694]: pgmap v1567: 97 pgs: 5 active+clean+snaptrim, 11 active+clean+snaptrim_wait, 81 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-09-23T09:46:13.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:46:13 smithi161 ceph-mon[99580]: pgmap v1567: 97 pgs: 5 active+clean+snaptrim, 11 active+clean+snaptrim_wait, 81 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-09-23T09:46:15.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:46:15 smithi135 ceph-mon[99205]: pgmap v1568: 97 pgs: 5 active+clean+snaptrim, 11 active+clean+snaptrim_wait, 81 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-09-23T09:46:15.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:46:15 smithi082 ceph-mon[97694]: pgmap v1568: 97 pgs: 5 active+clean+snaptrim, 11 active+clean+snaptrim_wait, 81 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-09-23T09:46:15.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:46:15 smithi161 ceph-mon[99580]: pgmap v1568: 97 pgs: 5 active+clean+snaptrim, 11 active+clean+snaptrim_wait, 81 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-09-23T09:46:17.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:46:17 smithi135 ceph-mon[99205]: pgmap v1569: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-09-23T09:46:17.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:46:17 smithi082 ceph-mon[97694]: pgmap v1569: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-09-23T09:46:17.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:46:17 smithi161 ceph-mon[99580]: pgmap v1569: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-09-23T09:46:18.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:46:18 smithi135 ceph-mon[99205]: osdmap e175: 12 total, 12 up, 12 in 2023-09-23T09:46:18.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:46:18 smithi135 ceph-mon[99205]: pgmap v1571: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-09-23T09:46:18.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:46:18 smithi082 ceph-mon[97694]: osdmap e175: 12 total, 12 up, 12 in 2023-09-23T09:46:18.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:46:18 smithi082 ceph-mon[97694]: pgmap v1571: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-09-23T09:46:18.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:46:18 smithi161 ceph-mon[99580]: osdmap e175: 12 total, 12 up, 12 in 2023-09-23T09:46:18.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:46:18 smithi161 ceph-mon[99580]: pgmap v1571: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-09-23T09:46:21.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:46:21 smithi135 ceph-mon[99205]: pgmap v1572: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-09-23T09:46:21.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:46:21 smithi082 ceph-mon[97694]: pgmap v1572: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-09-23T09:46:21.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:46:21 smithi161 ceph-mon[99580]: pgmap v1572: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-09-23T09:46:23.310 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:46:23 smithi135 ceph-mon[99205]: pgmap v1573: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-09-23T09:46:23.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:46:23 smithi082 ceph-mon[97694]: pgmap v1573: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-09-23T09:46:23.396 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:46:23 smithi161 ceph-mon[99580]: pgmap v1573: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-09-23T09:46:25.310 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:46:25 smithi135 ceph-mon[99205]: pgmap v1574: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-09-23T09:46:25.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:46:25 smithi082 ceph-mon[97694]: pgmap v1574: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-09-23T09:46:25.396 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:46:25 smithi161 ceph-mon[99580]: pgmap v1574: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-09-23T09:46:27.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:46:27 smithi135 ceph-mon[99205]: pgmap v1575: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-09-23T09:46:27.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:46:27 smithi082 ceph-mon[97694]: pgmap v1575: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-09-23T09:46:27.396 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:46:27 smithi161 ceph-mon[99580]: pgmap v1575: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-09-23T09:46:28.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:46:28 smithi135 ceph-mon[99205]: pgmap v1576: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-09-23T09:46:28.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:46:28 smithi082 ceph-mon[97694]: pgmap v1576: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-09-23T09:46:28.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:46:28 smithi161 ceph-mon[99580]: pgmap v1576: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-09-23T09:46:31.310 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:46:31 smithi135 ceph-mon[99205]: pgmap v1577: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-09-23T09:46:31.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:46:31 smithi082 ceph-mon[97694]: pgmap v1577: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-09-23T09:46:31.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:46:31 smithi161 ceph-mon[99580]: pgmap v1577: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-09-23T09:46:33.310 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:46:33 smithi135 ceph-mon[99205]: pgmap v1578: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-09-23T09:46:33.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:46:33 smithi082 ceph-mon[97694]: pgmap v1578: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-09-23T09:46:33.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:46:33 smithi161 ceph-mon[99580]: pgmap v1578: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-09-23T09:46:35.310 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:46:35 smithi135 ceph-mon[99205]: pgmap v1579: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-09-23T09:46:35.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:46:35 smithi082 ceph-mon[97694]: pgmap v1579: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-09-23T09:46:35.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:46:35 smithi161 ceph-mon[99580]: pgmap v1579: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-09-23T09:46:37.310 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:46:37 smithi135 ceph-mon[99205]: pgmap v1580: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-09-23T09:46:37.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:46:37 smithi082 ceph-mon[97694]: pgmap v1580: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-09-23T09:46:37.396 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:46:37 smithi161 ceph-mon[99580]: pgmap v1580: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-09-23T09:46:38.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:46:38 smithi135 ceph-mon[99205]: pgmap v1581: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-09-23T09:46:38.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:46:38 smithi082 ceph-mon[97694]: pgmap v1581: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-09-23T09:46:38.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:46:38 smithi161 ceph-mon[99580]: pgmap v1581: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-09-23T09:46:39.104 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:46:39.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.315+0000 7f15ab7ff700 1 -- 172.21.15.82:0/556921979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15a4100890 msgr2=0x7f15a4100d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:46:39.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.315+0000 7f15ab7ff700 1 --2- 172.21.15.82:0/556921979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15a4100890 0x7f15a4100d10 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f1594009990 tx=0x7f1594009ca0 comp rx=0 tx=0).stop 2023-09-23T09:46:39.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.315+0000 7f15ab7ff700 1 -- 172.21.15.82:0/556921979 shutdown_connections 2023-09-23T09:46:39.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.315+0000 7f15ab7ff700 1 --2- 172.21.15.82:0/556921979 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f15a4101250 0x7f15a410d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:46:39.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.315+0000 7f15ab7ff700 1 --2- 172.21.15.82:0/556921979 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15a41068a0 0x7f15a4106c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:46:39.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.315+0000 7f15ab7ff700 1 --2- 172.21.15.82:0/556921979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15a4100890 0x7f15a4100d10 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:46:39.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.315+0000 7f15ab7ff700 1 -- 172.21.15.82:0/556921979 >> 172.21.15.82:0/556921979 conn(0x7f15a40fc380 msgr2=0x7f15a40fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:46:39.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.315+0000 7f15ab7ff700 1 -- 172.21.15.82:0/556921979 shutdown_connections 2023-09-23T09:46:39.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.315+0000 7f15ab7ff700 1 -- 172.21.15.82:0/556921979 wait complete. 2023-09-23T09:46:39.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.316+0000 7f15ab7ff700 1 Processor -- start 2023-09-23T09:46:39.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.316+0000 7f15ab7ff700 1 -- start start 2023-09-23T09:46:39.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.317+0000 7f15ab7ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f15a4100890 0x7f15a419e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:46:39.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.317+0000 7f15ab7ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15a4101250 0x7f15a419edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:46:39.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.317+0000 7f15ab7ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15a41068a0 0x7f15a4198890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:46:39.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.317+0000 7f15ab7ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15a4199060 con 0x7f15a41068a0 2023-09-23T09:46:39.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.317+0000 7f15ab7ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15a41991d0 con 0x7f15a4101250 2023-09-23T09:46:39.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.317+0000 7f15ab7ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15a4199390 con 0x7f15a4100890 2023-09-23T09:46:39.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.317+0000 7f15a9d9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15a41068a0 0x7f15a4198890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:46:39.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.317+0000 7f15a9d9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15a41068a0 0x7f15a4198890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48440/0 (socket says 172.21.15.82:48440) 2023-09-23T09:46:39.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.317+0000 7f15a9d9c700 1 -- 172.21.15.82:0/1244128831 learned_addr learned my addr 172.21.15.82:0/1244128831 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:46:39.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.317+0000 7f15a8d9a700 1 --2- 172.21.15.82:0/1244128831 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15a4101250 0x7f15a419edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:46:39.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.317+0000 7f15a959b700 1 --2- 172.21.15.82:0/1244128831 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f15a4100890 0x7f15a419e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:46:39.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.318+0000 7f15a9d9c700 1 -- 172.21.15.82:0/1244128831 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f15a4100890 msgr2=0x7f15a419e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:46:39.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.318+0000 7f15a9d9c700 1 --2- 172.21.15.82:0/1244128831 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f15a4100890 0x7f15a419e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:46:39.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.318+0000 7f15a9d9c700 1 -- 172.21.15.82:0/1244128831 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15a4101250 msgr2=0x7f15a419edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:46:39.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.318+0000 7f15a9d9c700 1 --2- 172.21.15.82:0/1244128831 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15a4101250 0x7f15a419edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:46:39.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.318+0000 7f15a9d9c700 1 -- 172.21.15.82:0/1244128831 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15940095f0 con 0x7f15a41068a0 2023-09-23T09:46:39.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.318+0000 7f15a959b700 1 --2- 172.21.15.82:0/1244128831 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f15a4100890 0x7f15a419e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:46:39.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.318+0000 7f15a8d9a700 1 --2- 172.21.15.82:0/1244128831 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15a4101250 0x7f15a419edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:46:39.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.318+0000 7f15a9d9c700 1 --2- 172.21.15.82:0/1244128831 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15a41068a0 0x7f15a4198890 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f159c007d70 tx=0x7f159c00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:46:39.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.318+0000 7f159a7fc700 1 -- 172.21.15.82:0/1244128831 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f159c00ad40 con 0x7f15a41068a0 2023-09-23T09:46:39.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.318+0000 7f159a7fc700 1 -- 172.21.15.82:0/1244128831 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f159c0128b0 con 0x7f15a41068a0 2023-09-23T09:46:39.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.318+0000 7f15ab7ff700 1 -- 172.21.15.82:0/1244128831 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15a4199670 con 0x7f15a41068a0 2023-09-23T09:46:39.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.318+0000 7f159a7fc700 1 -- 172.21.15.82:0/1244128831 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f159c0115a0 con 0x7f15a41068a0 2023-09-23T09:46:39.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.318+0000 7f15ab7ff700 1 -- 172.21.15.82:0/1244128831 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15a41a5830 con 0x7f15a41068a0 2023-09-23T09:46:39.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.321+0000 7f159a7fc700 1 -- 172.21.15.82:0/1244128831 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f159c012a20 con 0x7f15a41068a0 2023-09-23T09:46:39.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.323+0000 7f159a7fc700 1 --2- 172.21.15.82:0/1244128831 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f15900a00c0 0x7f15900a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:46:39.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.323+0000 7f15bf163b80 1 Processor -- start 2023-09-23T09:46:39.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.323+0000 7f159a7fc700 1 -- 172.21.15.82:0/1244128831 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f159c0cb840 con 0x7f15a41068a0 2023-09-23T09:46:39.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.323+0000 7f15a959b700 1 --2- 172.21.15.82:0/1244128831 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f15900a00c0 0x7f15900a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:46:39.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.323+0000 7f15bf163b80 1 -- start start 2023-09-23T09:46:39.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.323+0000 7f15bf163b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56370c00b380 0x56370c00b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:46:39.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.324+0000 7f15bf163b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56370c00bca0 0x56370c005700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:46:39.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.324+0000 7f15bf163b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56370c005c40 0x56370c0060a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:46:39.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.324+0000 7f15bf163b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56370bf6d7b0 con 0x56370c00bca0 2023-09-23T09:46:39.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.324+0000 7f15bf163b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56370bf5e780 con 0x56370c005c40 2023-09-23T09:46:39.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.324+0000 7f15bf163b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x56370bf5c0a0 con 0x56370c00b380 2023-09-23T09:46:39.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.324+0000 7f15a959b700 1 --2- 172.21.15.82:0/1244128831 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f15900a00c0 0x7f15900a2580 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f15a0009c90 tx=0x7f15a0009260 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:46:39.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.324+0000 7f15a8d9a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56370c00bca0 0x56370c005700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:46:39.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.324+0000 7f15a8d9a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56370c00bca0 0x56370c005700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48442/0 (socket says 172.21.15.82:48442) 2023-09-23T09:46:39.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.324+0000 7f15a9d9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56370c005c40 0x56370c0060a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:46:39.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.324+0000 7f15a8d9a700 1 -- 172.21.15.82:0/2446433519 learned_addr learned my addr 172.21.15.82:0/2446433519 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:46:39.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.324+0000 7f15a959b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56370c00b380 0x56370c00b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:46:39.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.324+0000 7f15a8d9a700 1 -- 172.21.15.82:0/2446433519 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56370c00b380 msgr2=0x56370c00b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:46:39.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.324+0000 7f15a8d9a700 1 --2- 172.21.15.82:0/2446433519 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56370c00b380 0x56370c00b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:46:39.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.324+0000 7f15a8d9a700 1 -- 172.21.15.82:0/2446433519 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56370c005c40 msgr2=0x56370c0060a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:46:39.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.324+0000 7f15a8d9a700 1 --2- 172.21.15.82:0/2446433519 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56370c005c40 0x56370c0060a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:46:39.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.324+0000 7f15a8d9a700 1 -- 172.21.15.82:0/2446433519 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56370bdd7630 con 0x56370c00bca0 2023-09-23T09:46:39.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.324+0000 7f15a9d9c700 1 --2- 172.21.15.82:0/2446433519 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56370c005c40 0x56370c0060a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:46:39.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.324+0000 7f15a8d9a700 1 --2- 172.21.15.82:0/2446433519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56370c00bca0 0x56370c005700 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f1594009990 tx=0x7f159400bb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=553dd25e468688da server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:46:39.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.325+0000 7f158f7fe700 1 -- 172.21.15.82:0/2446433519 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f159401d070 con 0x56370c00bca0 2023-09-23T09:46:39.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.325+0000 7f158f7fe700 1 -- 172.21.15.82:0/2446433519 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f159401e040 con 0x56370c00bca0 2023-09-23T09:46:39.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.325+0000 7f158f7fe700 1 -- 172.21.15.82:0/2446433519 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1594004d80 con 0x56370c00bca0 2023-09-23T09:46:39.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.325+0000 7f15bf163b80 1 -- 172.21.15.82:0/2446433519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56370c00bca0 msgr2=0x56370c005700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:46:39.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.325+0000 7f15bf163b80 1 --2- 172.21.15.82:0/2446433519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56370c00bca0 0x56370c005700 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f1594009990 tx=0x7f159400bb70 comp rx=0 tx=0).stop 2023-09-23T09:46:39.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.326+0000 7f15bf163b80 1 -- 172.21.15.82:0/2446433519 shutdown_connections 2023-09-23T09:46:39.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.326+0000 7f15bf163b80 1 --2- 172.21.15.82:0/2446433519 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56370c005c40 0x56370c0060a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:46:39.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.326+0000 7f15bf163b80 1 --2- 172.21.15.82:0/2446433519 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56370c00b380 0x56370c00b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:46:39.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.326+0000 7f15bf163b80 1 --2- 172.21.15.82:0/2446433519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56370c00bca0 0x56370c005700 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:46:39.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.326+0000 7f15bf163b80 1 -- 172.21.15.82:0/2446433519 >> 172.21.15.82:0/2446433519 conn(0x56370bf7a0e0 msgr2=0x56370c000410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:46:39.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.326+0000 7f15bf163b80 1 -- 172.21.15.82:0/2446433519 shutdown_connections 2023-09-23T09:46:39.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.326+0000 7f15bf163b80 1 -- 172.21.15.82:0/2446433519 wait complete. 2023-09-23T09:46:39.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.326+0000 7f15bf163b80 1 -- start start 2023-09-23T09:46:39.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.326+0000 7f15bf163b80 1 Processor -- start 2023-09-23T09:46:39.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.327+0000 7f15bf163b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56370c005c40 0x56370c011bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:46:39.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.327+0000 7f15bf163b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56370c00b380 0x56370c00ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:46:39.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.327+0000 7f15bf163b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56370c00bca0 0x56370c00f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:46:39.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.327+0000 7f15bf163b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56370bf57990 con 0x56370c005c40 2023-09-23T09:46:39.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.327+0000 7f15bf163b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56370bef5bb0 con 0x56370c00b380 2023-09-23T09:46:39.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.327+0000 7f15bf163b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x56370bef58b0 con 0x56370c00bca0 2023-09-23T09:46:39.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.327+0000 7f15bf163b80 10 client.0 _ll_register_callbacks cb 0x56370be3fa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:46:39.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.327+0000 7f15a959b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56370c005c40 0x56370c011bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:46:39.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.327+0000 7f15a959b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56370c005c40 0x56370c011bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48452/0 (socket says 172.21.15.82:48452) 2023-09-23T09:46:39.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.327+0000 7f15a959b700 1 -- 172.21.15.82:0/3370952310 learned_addr learned my addr 172.21.15.82:0/3370952310 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:46:39.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.327+0000 7f15a8d9a700 1 --2- 172.21.15.82:0/3370952310 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56370c00b380 0x56370c00ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:46:39.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.327+0000 7f15a9d9c700 1 --2- 172.21.15.82:0/3370952310 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56370c00bca0 0x56370c00f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:46:39.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.327+0000 7f15a959b700 1 -- 172.21.15.82:0/3370952310 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56370c00bca0 msgr2=0x56370c00f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:46:39.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.327+0000 7f15a959b700 1 --2- 172.21.15.82:0/3370952310 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56370c00bca0 0x56370c00f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:46:39.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.328+0000 7f15a959b700 1 -- 172.21.15.82:0/3370952310 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56370c00b380 msgr2=0x56370c00ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:46:39.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.328+0000 7f15a959b700 1 --2- 172.21.15.82:0/3370952310 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56370c00b380 0x56370c00ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:46:39.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.328+0000 7f15a959b700 1 -- 172.21.15.82:0/3370952310 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15a41a5830 con 0x56370c005c40 2023-09-23T09:46:39.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.328+0000 7f15a8d9a700 1 --2- 172.21.15.82:0/3370952310 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56370c00b380 0x56370c00ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:46:39.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.328+0000 7f15a959b700 1 --2- 172.21.15.82:0/3370952310 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56370c005c40 0x56370c011bf0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f15a0011c30 tx=0x7f15a00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=225083151e5a4991 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:46:39.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.328+0000 7f158cff9700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:46:39.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.328+0000 7f158cff9700 1 -- 172.21.15.82:0/3370952310 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a001fac0 con 0x56370c005c40 2023-09-23T09:46:39.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.328+0000 7f15bf163b80 1 -- 172.21.15.82:0/3370952310 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56370bfd51c0 con 0x56370c005c40 2023-09-23T09:46:39.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.328+0000 7f158cff9700 1 -- 172.21.15.82:0/3370952310 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(175..175 src has 1..175) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f15a0017070 con 0x56370c005c40 2023-09-23T09:46:39.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.328+0000 7f158cff9700 1 -- 172.21.15.82:0/3370952310 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=139) v2 ==== 24+0+0 (secure 0 0 0) 0x7f15a001fc20 con 0x56370c005c40 2023-09-23T09:46:39.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.328+0000 7f15bf163b80 10 client.18369 fetch_fsmap learned FSMap version 139 2023-09-23T09:46:39.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.328+0000 7f15bf163b80 1 -- 172.21.15.82:0/3370952310 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=139,monmap=4+}) v3 -- 0x7f15a410e060 con 0x56370c005c40 2023-09-23T09:46:39.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.329+0000 7f158cff9700 1 -- 172.21.15.82:0/3370952310 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f15a0034080 con 0x56370c005c40 2023-09-23T09:46:39.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.329+0000 7f158cff9700 1 -- 172.21.15.82:0/3370952310 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 139) v1 ==== 7926+0+0 (secure 0 0 0) 0x7f15a002e030 con 0x56370c005c40 2023-09-23T09:46:39.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.329+0000 7f15bf163b80 10 client.18369 fetch_fsmap finished waiting for FSMap version 139 2023-09-23T09:46:39.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.329+0000 7f15bf163b80 10 client.18369 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:46:39.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.329+0000 7f15bf163b80 20 client.18369 populate_metadata read hostname 'smithi082' 2023-09-23T09:46:39.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.329+0000 7f15bf163b80 1 --2- 172.21.15.82:0/3370952310 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56370c01f770 0x56370c021b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:46:39.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.329+0000 7f15bf163b80 4 client.18369 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:46:39.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.329+0000 7f15bf163b80 1 -- 172.21.15.82:0/3370952310 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56370befdba0 con 0x56370c01f770 2023-09-23T09:46:39.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.329+0000 7f15a8d9a700 1 --2- 172.21.15.82:0/3370952310 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56370c01f770 0x56370c021b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:46:39.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.330+0000 7f15a8d9a700 1 --2- 172.21.15.82:0/3370952310 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56370c01f770 0x56370c021b90 crc :-1 s=READY pgs=295 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c5f9eff0201c7a6 server_cookie=ad5ae637a01a007 in_seq=0 out_seq=0 2023-09-23T09:46:39.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.330+0000 7f158cff9700 10 client.18369 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:46:39.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.331+0000 7f158cff9700 1 -- 172.21.15.82:0/3370952310 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56370befdba0 con 0x56370c01f770 2023-09-23T09:46:39.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.331+0000 7f158cff9700 10 client.18369 handle_command_reply: tid=0 2023-09-23T09:46:39.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.331+0000 7f15bf163b80 1 client.18369 shutdown 2023-09-23T09:46:39.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.331+0000 7f15bf163b80 1 -- 172.21.15.82:0/3370952310 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56370c005c40 msgr2=0x56370c011bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:46:39.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.331+0000 7f15bf163b80 1 --2- 172.21.15.82:0/3370952310 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56370c005c40 0x56370c011bf0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f15a0011c30 tx=0x7f15a00047c0 comp rx=0 tx=0).stop 2023-09-23T09:46:39.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.331+0000 7f15bf163b80 1 -- 172.21.15.82:0/3370952310 shutdown_connections 2023-09-23T09:46:39.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.331+0000 7f15bf163b80 1 --2- 172.21.15.82:0/3370952310 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56370c00bca0 0x56370c00f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:46:39.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.331+0000 7f15bf163b80 1 --2- 172.21.15.82:0/3370952310 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56370c01f770 0x56370c021b90 crc :-1 s=READY pgs=295 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:46:39.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.331+0000 7f15bf163b80 1 --2- 172.21.15.82:0/3370952310 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56370c005c40 0x56370c011bf0 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:46:39.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.331+0000 7f15bf163b80 1 --2- 172.21.15.82:0/3370952310 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56370c00b380 0x56370c00ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:46:39.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.331+0000 7f158cff9700 0 client.18369 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:46:39.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.331+0000 7f15bf163b80 1 -- 172.21.15.82:0/3370952310 >> 172.21.15.82:0/3370952310 conn(0x56370bf7a0e0 msgr2=0x56370bffab40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:46:39.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.331+0000 7f15bf163b80 1 -- 172.21.15.82:0/3370952310 shutdown_connections 2023-09-23T09:46:39.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.331+0000 7f15bf163b80 1 -- 172.21.15.82:0/3370952310 wait complete. 2023-09-23T09:46:39.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.332+0000 7f15bf163b80 20 client.18369 trim_cache size 0 max 16384 2023-09-23T09:46:39.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.349+0000 7f15bf163b80 1 Processor -- start 2023-09-23T09:46:39.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.349+0000 7f15bf163b80 1 -- start start 2023-09-23T09:46:39.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.349+0000 7f15bf163b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56370c005c40 0x56370c016740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:46:39.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.349+0000 7f15bf163b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56370c00b380 0x56370c011790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:46:39.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.350+0000 7f15bf163b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56370c00bca0 0x56370c007e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:46:39.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.350+0000 7f15bf163b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56370bdd9920 con 0x56370c00b380 2023-09-23T09:46:39.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.350+0000 7f15bf163b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56370c0122a0 con 0x56370c00bca0 2023-09-23T09:46:39.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.350+0000 7f15bf163b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x56370bffcc80 con 0x56370c005c40 2023-09-23T09:46:39.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.350+0000 7f15a8d9a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56370c00b380 0x56370c011790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:46:39.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.350+0000 7f15a8d9a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56370c00b380 0x56370c011790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48462/0 (socket says 172.21.15.82:48462) 2023-09-23T09:46:39.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.350+0000 7f15a8d9a700 1 -- 172.21.15.82:0/1601138704 learned_addr learned my addr 172.21.15.82:0/1601138704 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:46:39.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.350+0000 7f15a9d9c700 1 --2- 172.21.15.82:0/1601138704 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56370c00bca0 0x56370c007e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:46:39.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.350+0000 7f15a959b700 1 --2- 172.21.15.82:0/1601138704 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56370c005c40 0x56370c016740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:46:39.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.350+0000 7f15a8d9a700 1 -- 172.21.15.82:0/1601138704 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56370c005c40 msgr2=0x56370c016740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:46:39.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.350+0000 7f15a8d9a700 1 --2- 172.21.15.82:0/1601138704 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56370c005c40 0x56370c016740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:46:39.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.350+0000 7f15a8d9a700 1 -- 172.21.15.82:0/1601138704 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56370c00bca0 msgr2=0x56370c007e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:46:39.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.350+0000 7f15a8d9a700 1 --2- 172.21.15.82:0/1601138704 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56370c00bca0 0x56370c007e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:46:39.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.350+0000 7f15a8d9a700 1 -- 172.21.15.82:0/1601138704 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56370bd83de0 con 0x56370c00b380 2023-09-23T09:46:39.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.350+0000 7f15a8d9a700 1 --2- 172.21.15.82:0/1601138704 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56370c00b380 0x56370c011790 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f1594026000 tx=0x7f159401a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a934b3d661457a42 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:46:39.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.351+0000 7f158ffff700 1 -- 172.21.15.82:0/1601138704 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f159401d040 con 0x56370c00b380 2023-09-23T09:46:39.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.351+0000 7f158ffff700 1 -- 172.21.15.82:0/1601138704 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1594034d10 con 0x56370c00b380 2023-09-23T09:46:39.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.351+0000 7f158ffff700 1 -- 172.21.15.82:0/1601138704 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1594022b90 con 0x56370c00b380 2023-09-23T09:46:39.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.351+0000 7f15bf163b80 1 -- 172.21.15.82:0/1601138704 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56370c00b380 msgr2=0x56370c011790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:46:39.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.351+0000 7f15bf163b80 1 --2- 172.21.15.82:0/1601138704 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56370c00b380 0x56370c011790 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f1594026000 tx=0x7f159401a040 comp rx=0 tx=0).stop 2023-09-23T09:46:39.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.351+0000 7f15bf163b80 1 -- 172.21.15.82:0/1601138704 shutdown_connections 2023-09-23T09:46:39.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.351+0000 7f15bf163b80 1 --2- 172.21.15.82:0/1601138704 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56370c00bca0 0x56370c007e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:46:39.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.351+0000 7f15bf163b80 1 --2- 172.21.15.82:0/1601138704 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56370c005c40 0x56370c016740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:46:39.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.351+0000 7f15bf163b80 1 --2- 172.21.15.82:0/1601138704 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56370c00b380 0x56370c011790 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:46:39.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.351+0000 7f15bf163b80 1 -- 172.21.15.82:0/1601138704 >> 172.21.15.82:0/1601138704 conn(0x56370bf7a0e0 msgr2=0x56370c0000a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:46:39.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.351+0000 7f15bf163b80 1 -- 172.21.15.82:0/1601138704 shutdown_connections 2023-09-23T09:46:39.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.351+0000 7f15bf163b80 1 -- 172.21.15.82:0/1601138704 wait complete. 2023-09-23T09:46:39.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.352+0000 7f15bf163b80 1 -- start start 2023-09-23T09:46:39.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.352+0000 7f15bf163b80 1 Processor -- start 2023-09-23T09:46:39.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.353+0000 7f15bf163b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56370c005c40 0x56370c06c870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:46:39.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.353+0000 7f15bf163b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56370c00b380 0x56370c06cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:46:39.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.353+0000 7f15bf163b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56370c00bca0 0x56370c014720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:46:39.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.353+0000 7f15bf163b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56370c014c60 con 0x56370c005c40 2023-09-23T09:46:39.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.353+0000 7f15bf163b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56370c014dd0 con 0x56370c00bca0 2023-09-23T09:46:39.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.353+0000 7f15bf163b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x56370c014f90 con 0x56370c00b380 2023-09-23T09:46:39.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.353+0000 7f15bf163b80 10 client.0 _ll_register_callbacks cb 0x56370be3fa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:46:39.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.353+0000 7f15a959b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56370c005c40 0x56370c06c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:46:39.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.353+0000 7f15a959b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56370c005c40 0x56370c06c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48476/0 (socket says 172.21.15.82:48476) 2023-09-23T09:46:39.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.353+0000 7f15a959b700 1 -- 172.21.15.82:0/3777004371 learned_addr learned my addr 172.21.15.82:0/3777004371 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:46:39.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.353+0000 7f15a9d9c700 1 --2- 172.21.15.82:0/3777004371 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56370c00bca0 0x56370c014720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:46:39.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.353+0000 7f15a8d9a700 1 --2- 172.21.15.82:0/3777004371 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56370c00b380 0x56370c06cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:46:39.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.353+0000 7f15a959b700 1 -- 172.21.15.82:0/3777004371 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56370c00b380 msgr2=0x56370c06cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:46:39.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.353+0000 7f15a959b700 1 --2- 172.21.15.82:0/3777004371 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56370c00b380 0x56370c06cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:46:39.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.353+0000 7f15a959b700 1 -- 172.21.15.82:0/3777004371 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56370c00bca0 msgr2=0x56370c014720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:46:39.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.353+0000 7f15a959b700 1 --2- 172.21.15.82:0/3777004371 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56370c00bca0 0x56370c014720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:46:39.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.353+0000 7f15a959b700 1 -- 172.21.15.82:0/3777004371 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56370bdd7630 con 0x56370c005c40 2023-09-23T09:46:39.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.354+0000 7f15a959b700 1 --2- 172.21.15.82:0/3777004371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56370c005c40 0x56370c06c870 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f15a0000c00 tx=0x7f15a0028d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de7754985ecbf244 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:46:39.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.354+0000 7f158cff9700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:46:39.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.354+0000 7f158cff9700 1 -- 172.21.15.82:0/3777004371 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a001fbd0 con 0x56370c005c40 2023-09-23T09:46:39.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.354+0000 7f15bf163b80 1 -- 172.21.15.82:0/3777004371 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56370bff88b0 con 0x56370c005c40 2023-09-23T09:46:39.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.354+0000 7f158cff9700 1 -- 172.21.15.82:0/3777004371 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(175..175 src has 1..175) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f15a0017040 con 0x56370c005c40 2023-09-23T09:46:39.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.354+0000 7f158cff9700 1 -- 172.21.15.82:0/3777004371 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=139) v2 ==== 24+0+0 (secure 0 0 0) 0x7f15a001fd30 con 0x56370c005c40 2023-09-23T09:46:39.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.354+0000 7f15bf163b80 10 client.18375 fetch_fsmap learned FSMap version 139 2023-09-23T09:46:39.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.354+0000 7f15bf163b80 1 -- 172.21.15.82:0/3777004371 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=139,monmap=4+}) v3 -- 0x56370bd6cc60 con 0x56370c005c40 2023-09-23T09:46:39.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.354+0000 7f158cff9700 1 -- 172.21.15.82:0/3777004371 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56370bff88b0 con 0x56370c005c40 2023-09-23T09:46:39.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.355+0000 7f158cff9700 1 -- 172.21.15.82:0/3777004371 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 139) v1 ==== 7926+0+0 (secure 0 0 0) 0x7f15a00273e0 con 0x56370c005c40 2023-09-23T09:46:39.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.355+0000 7f15bf163b80 10 client.18375 fetch_fsmap finished waiting for FSMap version 139 2023-09-23T09:46:39.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.355+0000 7f15bf163b80 10 client.18375 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:46:39.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.355+0000 7f15bf163b80 20 client.18375 populate_metadata read hostname 'smithi082' 2023-09-23T09:46:39.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.355+0000 7f15bf163b80 1 --2- 172.21.15.82:0/3777004371 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56370c0746b0 0x56370c076ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:46:39.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.355+0000 7f15bf163b80 4 client.18375 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:46:39.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.355+0000 7f15bf163b80 1 -- 172.21.15.82:0/3777004371 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x56370bf50970 con 0x56370c0746b0 2023-09-23T09:46:39.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.355+0000 7f15a8d9a700 1 --2- 172.21.15.82:0/3777004371 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56370c0746b0 0x56370c076ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:46:39.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.356+0000 7f15a8d9a700 1 --2- 172.21.15.82:0/3777004371 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56370c0746b0 0x56370c076ad0 crc :-1 s=READY pgs=296 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=578f16ef881a9024 server_cookie=b1f7d1aa41ef9e87 in_seq=0 out_seq=0 2023-09-23T09:46:39.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.356+0000 7f158cff9700 10 client.18375 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:46:39.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.356+0000 7f158cff9700 1 -- 172.21.15.82:0/3777004371 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x56370bf50970 con 0x56370c0746b0 2023-09-23T09:46:39.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.356+0000 7f158cff9700 10 client.18375 handle_command_reply: tid=0 2023-09-23T09:46:39.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.356+0000 7f15bf163b80 1 client.18375 shutdown 2023-09-23T09:46:39.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.356+0000 7f15bf163b80 1 -- 172.21.15.82:0/3777004371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56370c005c40 msgr2=0x56370c06c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:46:39.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.356+0000 7f15bf163b80 1 --2- 172.21.15.82:0/3777004371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56370c005c40 0x56370c06c870 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f15a0000c00 tx=0x7f15a0028d00 comp rx=0 tx=0).stop 2023-09-23T09:46:39.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.356+0000 7f15bf163b80 1 -- 172.21.15.82:0/3777004371 shutdown_connections 2023-09-23T09:46:39.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.356+0000 7f15bf163b80 1 --2- 172.21.15.82:0/3777004371 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56370c00bca0 0x56370c014720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:46:39.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.356+0000 7f15bf163b80 1 --2- 172.21.15.82:0/3777004371 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x56370c0746b0 0x56370c076ad0 crc :-1 s=READY pgs=296 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:46:39.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.356+0000 7f15bf163b80 1 --2- 172.21.15.82:0/3777004371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56370c005c40 0x56370c06c870 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:46:39.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.356+0000 7f15bf163b80 1 --2- 172.21.15.82:0/3777004371 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x56370c00b380 0x56370c06cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:46:39.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.356+0000 7f158cff9700 0 client.18375 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:46:39.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.356+0000 7f15bf163b80 1 -- 172.21.15.82:0/3777004371 >> 172.21.15.82:0/3777004371 conn(0x56370bf7a0e0 msgr2=0x56370bffa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:46:39.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.356+0000 7f15bf163b80 1 -- 172.21.15.82:0/3777004371 shutdown_connections 2023-09-23T09:46:39.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.356+0000 7f15bf163b80 1 -- 172.21.15.82:0/3777004371 wait complete. 2023-09-23T09:46:39.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.356+0000 7f15bf163b80 20 client.18375 trim_cache size 0 max 16384 2023-09-23T09:46:39.367 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:46:39.367 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-23T09:46:39.367 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:46:39.367 INFO:teuthology.orchestra.run.smithi082.stdout: "d9e62ab8-1468-4fb0-a9fe-61bed13e954b": { 2023-09-23T09:46:39.367 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:46:39.367 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "d9e62ab8-1468-4fb0-a9fe-61bed13e954b", 2023-09-23T09:46:39.368 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:46:39.368 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:46:39.368 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:46:39.368 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:46:39.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.357+0000 7f15ab7ff700 1 -- 172.21.15.82:0/1244128831 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f15900a00c0 msgr2=0x7f15900a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:46:39.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.357+0000 7f15ab7ff700 1 --2- 172.21.15.82:0/1244128831 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f15900a00c0 0x7f15900a2580 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f15a0009c90 tx=0x7f15a0009260 comp rx=0 tx=0).stop 2023-09-23T09:46:39.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.357+0000 7f15ab7ff700 1 -- 172.21.15.82:0/1244128831 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15a41068a0 msgr2=0x7f15a4198890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:46:39.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.357+0000 7f15ab7ff700 1 --2- 172.21.15.82:0/1244128831 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15a41068a0 0x7f15a4198890 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f159c007d70 tx=0x7f159c00a340 comp rx=0 tx=0).stop 2023-09-23T09:46:39.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.357+0000 7f15ab7ff700 1 -- 172.21.15.82:0/1244128831 shutdown_connections 2023-09-23T09:46:39.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.357+0000 7f15ab7ff700 1 --2- 172.21.15.82:0/1244128831 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f15900a00c0 0x7f15900a2580 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:46:39.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.357+0000 7f15ab7ff700 1 --2- 172.21.15.82:0/1244128831 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15a41068a0 0x7f15a4198890 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:46:39.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.357+0000 7f15ab7ff700 1 --2- 172.21.15.82:0/1244128831 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f15a4100890 0x7f15a419e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:46:39.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.357+0000 7f15ab7ff700 1 --2- 172.21.15.82:0/1244128831 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15a4101250 0x7f15a419edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:46:39.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.357+0000 7f15ab7ff700 1 -- 172.21.15.82:0/1244128831 >> 172.21.15.82:0/1244128831 conn(0x7f15a40fc380 msgr2=0x7f15a410bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:46:39.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.357+0000 7f15ab7ff700 1 -- 172.21.15.82:0/1244128831 shutdown_connections 2023-09-23T09:46:39.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:46:39.357+0000 7f15ab7ff700 1 -- 172.21.15.82:0/1244128831 wait complete. 2023-09-23T09:46:39.378 INFO:tasks.cephfs.filesystem:scrub status for tag:d9e62ab8-1468-4fb0-a9fe-61bed13e954b - {'path': '/', 'tag': 'd9e62ab8-1468-4fb0-a9fe-61bed13e954b', 'options': 'recursive,force'} 2023-09-23T09:46:41.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:46:41 smithi135 ceph-mon[99205]: pgmap v1582: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-09-23T09:46:41.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:46:41 smithi082 ceph-mon[97694]: pgmap v1582: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-09-23T09:46:41.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:46:41 smithi161 ceph-mon[99580]: pgmap v1582: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-09-23T09:46:43.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:46:43 smithi135 ceph-mon[99205]: pgmap v1583: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2023-09-23T09:46:43.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:46:43 smithi082 ceph-mon[97694]: pgmap v1583: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2023-09-23T09:46:43.396 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:46:43 smithi161 ceph-mon[99580]: pgmap v1583: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2023-09-23T09:46:45.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:46:45 smithi135 ceph-mon[99205]: pgmap v1584: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-09-23T09:46:45.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:46:45 smithi082 ceph-mon[97694]: pgmap v1584: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-09-23T09:46:45.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:46:45 smithi161 ceph-mon[99580]: pgmap v1584: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-09-23T09:46:47.310 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:46:47 smithi135 ceph-mon[99205]: pgmap v1585: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-09-23T09:46:47.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:46:47 smithi082 ceph-mon[97694]: pgmap v1585: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-09-23T09:46:47.396 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:46:47 smithi161 ceph-mon[99580]: pgmap v1585: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-09-23T09:46:48.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:46:48 smithi135 ceph-mon[99205]: pgmap v1586: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-09-23T09:46:48.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:46:48 smithi082 ceph-mon[97694]: pgmap v1586: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-09-23T09:46:48.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:46:48 smithi161 ceph-mon[99580]: pgmap v1586: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-09-23T09:46:51.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:46:51 smithi135 ceph-mon[99205]: pgmap v1587: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-09-23T09:46:51.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:46:51 smithi082 ceph-mon[97694]: pgmap v1587: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-09-23T09:46:51.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:46:51 smithi161 ceph-mon[99580]: pgmap v1587: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-09-23T09:46:53.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:46:53 smithi135 ceph-mon[99205]: pgmap v1588: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-09-23T09:46:53.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:46:53 smithi082 ceph-mon[97694]: pgmap v1588: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-09-23T09:46:53.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:46:53 smithi161 ceph-mon[99580]: pgmap v1588: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-09-23T09:46:55.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:46:55 smithi135 ceph-mon[99205]: pgmap v1589: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-09-23T09:46:55.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:46:55 smithi082 ceph-mon[97694]: pgmap v1589: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-09-23T09:46:55.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:46:55 smithi161 ceph-mon[99580]: pgmap v1589: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-09-23T09:46:57.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:46:57 smithi135 ceph-mon[99205]: pgmap v1590: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-09-23T09:46:57.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:46:57 smithi082 ceph-mon[97694]: pgmap v1590: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-09-23T09:46:57.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:46:57 smithi161 ceph-mon[99580]: pgmap v1590: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-09-23T09:46:58.810 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:46:58 smithi135 ceph-mon[99205]: pgmap v1591: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-09-23T09:46:58.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:46:58 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:46:58.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:46:58 smithi082 ceph-mon[97694]: pgmap v1591: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-09-23T09:46:58.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:46:58 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:46:58.896 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:46:58 smithi161 ceph-mon[99580]: pgmap v1591: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-09-23T09:46:58.896 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:46:58 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:46:59.810 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:46:59 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:46:59.810 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:46:59 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:46:59.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:46:59 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:46:59.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:46:59 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:46:59.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:46:59 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:46:59.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:46:59 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:46:59.896 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:46:59 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:46:59.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:46:59 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:46:59.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:46:59 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:47:00.810 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:47:00 smithi135 ceph-mon[99205]: pgmap v1592: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-09-23T09:47:00.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:47:00 smithi082 ceph-mon[97694]: pgmap v1592: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-09-23T09:47:00.896 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:47:00 smithi161 ceph-mon[99580]: pgmap v1592: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-09-23T09:47:02.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:47:02 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:47:02.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:47:02 smithi135 ceph-mon[99205]: pgmap v1593: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2023-09-23T09:47:02.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:47:02 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:47:02.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:47:02 smithi082 ceph-mon[97694]: pgmap v1593: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2023-09-23T09:47:02.896 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:47:02 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:47:02.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:47:02 smithi161 ceph-mon[99580]: pgmap v1593: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2023-09-23T09:47:05.310 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:47:05 smithi135 ceph-mon[99205]: pgmap v1594: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.1 KiB/s wr, 8 op/s 2023-09-23T09:47:05.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:47:05 smithi082 ceph-mon[97694]: pgmap v1594: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.1 KiB/s wr, 8 op/s 2023-09-23T09:47:05.396 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:47:05 smithi161 ceph-mon[99580]: pgmap v1594: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.1 KiB/s wr, 8 op/s 2023-09-23T09:47:07.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:47:07 smithi135 ceph-mon[99205]: pgmap v1595: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 26 op/s 2023-09-23T09:47:07.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:47:07 smithi082 ceph-mon[97694]: pgmap v1595: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 26 op/s 2023-09-23T09:47:07.402 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:47:07 smithi161 ceph-mon[99580]: pgmap v1595: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 26 op/s 2023-09-23T09:47:08.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:47:08 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:47:08.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:47:08 smithi082 ceph-mon[97694]: osdmap e176: 12 total, 12 up, 12 in 2023-09-23T09:47:08.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:47:08 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:47:08.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:47:08 smithi161 ceph-mon[99580]: osdmap e176: 12 total, 12 up, 12 in 2023-09-23T09:47:08.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:47:08 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:47:08.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:47:08 smithi135 ceph-mon[99205]: osdmap e176: 12 total, 12 up, 12 in 2023-09-23T09:47:09.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:47:09 smithi082 ceph-mon[97694]: pgmap v1597: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-09-23T09:47:09.379 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:47:09.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:47:09 smithi161 ceph-mon[99580]: pgmap v1597: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-09-23T09:47:09.565 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:47:09 smithi135 ceph-mon[99205]: pgmap v1597: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-09-23T09:47:09.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.745+0000 7f4113dff700 1 -- 172.21.15.82:0/1895494591 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f410c107a00 msgr2=0x7f410c113d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:47:09.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.745+0000 7f4113dff700 1 --2- 172.21.15.82:0/1895494591 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f410c107a00 0x7f410c113d60 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f4104009990 tx=0x7f4104009ca0 comp rx=0 tx=0).stop 2023-09-23T09:47:09.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.746+0000 7f4113dff700 1 -- 172.21.15.82:0/1895494591 shutdown_connections 2023-09-23T09:47:09.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.746+0000 7f4113dff700 1 --2- 172.21.15.82:0/1895494591 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f410c107a00 0x7f410c113d60 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:47:09.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.746+0000 7f4113dff700 1 --2- 172.21.15.82:0/1895494591 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f410c10cfc0 0x7f410c10d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:47:09.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.746+0000 7f4113dff700 1 --2- 172.21.15.82:0/1895494591 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f410c107040 0x7f410c1074c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:47:09.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.746+0000 7f4113dff700 1 -- 172.21.15.82:0/1895494591 >> 172.21.15.82:0/1895494591 conn(0x7f410c0767c0 msgr2=0x7f410c105740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:47:09.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.746+0000 7f4113dff700 1 -- 172.21.15.82:0/1895494591 shutdown_connections 2023-09-23T09:47:09.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.746+0000 7f4113dff700 1 -- 172.21.15.82:0/1895494591 wait complete. 2023-09-23T09:47:09.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.747+0000 7f4113dff700 1 Processor -- start 2023-09-23T09:47:09.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.748+0000 7f4113dff700 1 -- start start 2023-09-23T09:47:09.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.748+0000 7f4113dff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f410c107040 0x7f410c19cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:47:09.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.748+0000 7f4113dff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f410c107a00 0x7f410c19d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:47:09.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.748+0000 7f4113dff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f410c10cfc0 0x7f410c1a18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:47:09.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.748+0000 7f4113dff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f410c1a1f30 con 0x7f410c107040 2023-09-23T09:47:09.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.748+0000 7f4113dff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f410c1a20a0 con 0x7f410c107a00 2023-09-23T09:47:09.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.748+0000 7f4113dff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f410c1a2260 con 0x7f410c10cfc0 2023-09-23T09:47:09.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.750+0000 7f4111b9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f410c107040 0x7f410c19cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:47:09.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.750+0000 7f4111b9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f410c107040 0x7f410c19cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50564/0 (socket says 172.21.15.82:50564) 2023-09-23T09:47:09.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.750+0000 7f4111b9b700 1 -- 172.21.15.82:0/1326856695 learned_addr learned my addr 172.21.15.82:0/1326856695 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:47:09.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.750+0000 7f4111b9b700 1 -- 172.21.15.82:0/1326856695 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f410c10cfc0 msgr2=0x7f410c1a18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:47:09.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.750+0000 7f4111b9b700 1 --2- 172.21.15.82:0/1326856695 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f410c10cfc0 0x7f410c1a18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:47:09.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.750+0000 7f4111b9b700 1 -- 172.21.15.82:0/1326856695 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f410c107a00 msgr2=0x7f410c19d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:47:09.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.750+0000 7f4111b9b700 1 --2- 172.21.15.82:0/1326856695 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f410c107a00 0x7f410c19d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:47:09.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.750+0000 7f4111b9b700 1 -- 172.21.15.82:0/1326856695 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41040095f0 con 0x7f410c107040 2023-09-23T09:47:09.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.751+0000 7f4111b9b700 1 --2- 172.21.15.82:0/1326856695 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f410c107040 0x7f410c19cf50 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f410800b530 tx=0x7f410800b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:47:09.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.752+0000 7f40feffd700 1 -- 172.21.15.82:0/1326856695 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4108011830 con 0x7f410c107040 2023-09-23T09:47:09.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.752+0000 7f40feffd700 1 -- 172.21.15.82:0/1326856695 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4108011e20 con 0x7f410c107040 2023-09-23T09:47:09.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.752+0000 7f40feffd700 1 -- 172.21.15.82:0/1326856695 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4108010da0 con 0x7f410c107040 2023-09-23T09:47:09.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.753+0000 7f4113dff700 1 -- 172.21.15.82:0/1326856695 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f410c1a2540 con 0x7f410c107040 2023-09-23T09:47:09.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.753+0000 7f4113dff700 1 -- 172.21.15.82:0/1326856695 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f410c079350 con 0x7f410c107040 2023-09-23T09:47:09.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.760+0000 7f41277a7b80 1 Processor -- start 2023-09-23T09:47:09.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.766+0000 7f40feffd700 1 -- 172.21.15.82:0/1326856695 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f4108011990 con 0x7f410c107040 2023-09-23T09:47:09.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.768+0000 7f41277a7b80 1 -- start start 2023-09-23T09:47:09.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.769+0000 7f41277a7b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a55e29380 0x561a55e29760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:47:09.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.769+0000 7f41277a7b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561a55e29ca0 0x561a55e23700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:47:09.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.769+0000 7f41277a7b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a55e23c40 0x561a55e240a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:47:09.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.769+0000 7f41277a7b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a55d8b7b0 con 0x561a55e23c40 2023-09-23T09:47:09.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.769+0000 7f41277a7b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a55d7c780 con 0x561a55e29380 2023-09-23T09:47:09.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.769+0000 7f41277a7b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a55d7a0a0 con 0x561a55e29ca0 2023-09-23T09:47:09.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.770+0000 7f40feffd700 1 --2- 172.21.15.82:0/1326856695 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f40f80a02d0 0x7f40f80a2790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:47:09.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.770+0000 7f40feffd700 1 -- 172.21.15.82:0/1326856695 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 8557+0+0 (secure 0 0 0) 0x7f41080cace0 con 0x7f410c107040 2023-09-23T09:47:09.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.771+0000 7f411239c700 1 --2- 172.21.15.82:0/1326856695 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f40f80a02d0 0x7f40f80a2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:47:09.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.772+0000 7f411239c700 1 --2- 172.21.15.82:0/1326856695 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f40f80a02d0 0x7f40f80a2790 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f4104006010 tx=0x7f410400b540 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:47:09.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.776+0000 7f411239c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a55e29380 0x561a55e29760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:47:09.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.776+0000 7f411239c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a55e29380 0x561a55e29760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:56876/0 (socket says 172.21.15.82:56876) 2023-09-23T09:47:09.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.776+0000 7f411239c700 1 -- 172.21.15.82:0/2647678377 learned_addr learned my addr 172.21.15.82:0/2647678377 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:47:09.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.778+0000 7f411139a700 1 --2- 172.21.15.82:0/2647678377 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a55e23c40 0x561a55e240a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:47:09.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.779+0000 7f4111b9b700 1 --2- 172.21.15.82:0/2647678377 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561a55e29ca0 0x561a55e23700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:47:09.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.779+0000 7f411139a700 1 -- 172.21.15.82:0/2647678377 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561a55e29ca0 msgr2=0x561a55e23700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:47:09.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.779+0000 7f411139a700 1 --2- 172.21.15.82:0/2647678377 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561a55e29ca0 0x561a55e23700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:47:09.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.779+0000 7f411139a700 1 -- 172.21.15.82:0/2647678377 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a55e29380 msgr2=0x561a55e29760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:47:09.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.779+0000 7f411139a700 1 --2- 172.21.15.82:0/2647678377 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a55e29380 0x561a55e29760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:47:09.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.779+0000 7f411139a700 1 -- 172.21.15.82:0/2647678377 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561a55bf5630 con 0x561a55e23c40 2023-09-23T09:47:09.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.780+0000 7f411139a700 1 --2- 172.21.15.82:0/2647678377 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a55e23c40 0x561a55e240a0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f4100009c60 tx=0x7f41000094d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abe384721c8d5c75 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:47:09.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.780+0000 7f40f7fff700 1 -- 172.21.15.82:0/2647678377 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4100003a00 con 0x561a55e23c40 2023-09-23T09:47:09.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.780+0000 7f40f7fff700 1 -- 172.21.15.82:0/2647678377 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f410000f040 con 0x561a55e23c40 2023-09-23T09:47:09.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.780+0000 7f40f7fff700 1 -- 172.21.15.82:0/2647678377 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4100013650 con 0x561a55e23c40 2023-09-23T09:47:09.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.781+0000 7f41277a7b80 1 -- 172.21.15.82:0/2647678377 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a55e23c40 msgr2=0x561a55e240a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:47:09.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.781+0000 7f41277a7b80 1 --2- 172.21.15.82:0/2647678377 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a55e23c40 0x561a55e240a0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f4100009c60 tx=0x7f41000094d0 comp rx=0 tx=0).stop 2023-09-23T09:47:09.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.782+0000 7f41277a7b80 1 -- 172.21.15.82:0/2647678377 shutdown_connections 2023-09-23T09:47:09.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.782+0000 7f41277a7b80 1 --2- 172.21.15.82:0/2647678377 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a55e23c40 0x561a55e240a0 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:47:09.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.782+0000 7f41277a7b80 1 --2- 172.21.15.82:0/2647678377 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a55e29380 0x561a55e29760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:47:09.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.782+0000 7f41277a7b80 1 --2- 172.21.15.82:0/2647678377 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561a55e29ca0 0x561a55e23700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:47:09.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.782+0000 7f41277a7b80 1 -- 172.21.15.82:0/2647678377 >> 172.21.15.82:0/2647678377 conn(0x561a55d980e0 msgr2=0x561a55e1e410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:47:09.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.782+0000 7f41277a7b80 1 -- 172.21.15.82:0/2647678377 shutdown_connections 2023-09-23T09:47:09.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.782+0000 7f41277a7b80 1 -- 172.21.15.82:0/2647678377 wait complete. 2023-09-23T09:47:09.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.783+0000 7f41277a7b80 1 -- start start 2023-09-23T09:47:09.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.783+0000 7f41277a7b80 1 Processor -- start 2023-09-23T09:47:09.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.784+0000 7f41277a7b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a55e23c40 0x561a55e2fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:47:09.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.784+0000 7f41277a7b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561a55e29380 0x561a55e2cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:47:09.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.784+0000 7f41277a7b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a55e29ca0 0x561a55e2d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:47:09.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.784+0000 7f41277a7b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a55d75990 con 0x561a55e23c40 2023-09-23T09:47:09.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.784+0000 7f41277a7b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a55d13bb0 con 0x561a55e29ca0 2023-09-23T09:47:09.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.784+0000 7f41277a7b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a55d138b0 con 0x561a55e29380 2023-09-23T09:47:09.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.784+0000 7f41277a7b80 10 client.0 _ll_register_callbacks cb 0x561a55c5da80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:47:09.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.786+0000 7f411139a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561a55e29380 0x561a55e2cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:47:09.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.786+0000 7f411239c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a55e29ca0 0x561a55e2d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:47:09.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.786+0000 7f411239c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a55e29ca0 0x561a55e2d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:56886/0 (socket says 172.21.15.82:56886) 2023-09-23T09:47:09.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.786+0000 7f411239c700 1 -- 172.21.15.82:0/1215163147 learned_addr learned my addr 172.21.15.82:0/1215163147 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:47:09.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.787+0000 7f4111b9b700 1 --2- 172.21.15.82:0/1215163147 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a55e23c40 0x561a55e2fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:47:09.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.787+0000 7f4111b9b700 1 -- 172.21.15.82:0/1215163147 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561a55e29380 msgr2=0x561a55e2cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:47:09.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.787+0000 7f4111b9b700 1 --2- 172.21.15.82:0/1215163147 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561a55e29380 0x561a55e2cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:47:09.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.787+0000 7f4111b9b700 1 -- 172.21.15.82:0/1215163147 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a55e29ca0 msgr2=0x561a55e2d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:47:09.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.787+0000 7f4111b9b700 1 --2- 172.21.15.82:0/1215163147 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a55e29ca0 0x561a55e2d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:47:09.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.787+0000 7f4111b9b700 1 -- 172.21.15.82:0/1215163147 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41000098c0 con 0x561a55e23c40 2023-09-23T09:47:09.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.788+0000 7f4111b9b700 1 --2- 172.21.15.82:0/1215163147 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a55e23c40 0x561a55e2fca0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f41080c84c0 tx=0x7f4108097de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b4b27f0392aaf34 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:47:09.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.788+0000 7f40f57fa700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:47:09.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.789+0000 7f40f57fa700 1 -- 172.21.15.82:0/1215163147 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41080988e0 con 0x561a55e23c40 2023-09-23T09:47:09.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.789+0000 7f40f57fa700 1 -- 172.21.15.82:0/1215163147 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(176..176 src has 1..176) v4 ==== 8557+0+0 (secure 0 0 0) 0x7f4108098b80 con 0x561a55e23c40 2023-09-23T09:47:09.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.789+0000 7f41277a7b80 1 -- 172.21.15.82:0/1215163147 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561a55df31c0 con 0x561a55e23c40 2023-09-23T09:47:09.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.789+0000 7f40f57fa700 1 -- 172.21.15.82:0/1215163147 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=141) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4108098480 con 0x561a55e23c40 2023-09-23T09:47:09.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.792+0000 7f41277a7b80 10 client.18387 fetch_fsmap learned FSMap version 141 2023-09-23T09:47:09.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.792+0000 7f41277a7b80 1 -- 172.21.15.82:0/1215163147 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=141,monmap=4+}) v3 -- 0x561a55ba1de0 con 0x561a55e23c40 2023-09-23T09:47:09.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.793+0000 7f40f57fa700 1 -- 172.21.15.82:0/1215163147 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x561a55df31c0 con 0x561a55e23c40 2023-09-23T09:47:09.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.793+0000 7f40f57fa700 1 -- 172.21.15.82:0/1215163147 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 141) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f4108097970 con 0x561a55e23c40 2023-09-23T09:47:09.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.793+0000 7f41277a7b80 10 client.18387 fetch_fsmap finished waiting for FSMap version 141 2023-09-23T09:47:09.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.793+0000 7f41277a7b80 10 client.18387 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:47:09.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.793+0000 7f41277a7b80 20 client.18387 populate_metadata read hostname 'smithi082' 2023-09-23T09:47:09.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.793+0000 7f41277a7b80 1 --2- 172.21.15.82:0/1215163147 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x561a55e4e7c0 0x561a55e50be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:47:09.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.793+0000 7f41277a7b80 4 client.18387 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:47:09.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.793+0000 7f41277a7b80 1 -- 172.21.15.82:0/1215163147 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561a55d1bba0 con 0x561a55e4e7c0 2023-09-23T09:47:09.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.793+0000 7f411139a700 1 --2- 172.21.15.82:0/1215163147 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x561a55e4e7c0 0x561a55e50be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:47:09.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.804+0000 7f411139a700 1 --2- 172.21.15.82:0/1215163147 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x561a55e4e7c0 0x561a55e50be0 crc :-1 s=READY pgs=297 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4315dac193438bd8 server_cookie=e1f37f7eeaa44ff8 in_seq=0 out_seq=0 2023-09-23T09:47:09.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.804+0000 7f40f57fa700 10 client.18387 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:47:09.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.811+0000 7f40f57fa700 1 -- 172.21.15.82:0/1215163147 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x561a55d1bba0 con 0x561a55e4e7c0 2023-09-23T09:47:09.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.811+0000 7f40f57fa700 10 client.18387 handle_command_reply: tid=0 2023-09-23T09:47:09.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.811+0000 7f41277a7b80 1 client.18387 shutdown 2023-09-23T09:47:09.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.813+0000 7f41277a7b80 1 -- 172.21.15.82:0/1215163147 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a55e23c40 msgr2=0x561a55e2fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:47:09.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.813+0000 7f41277a7b80 1 --2- 172.21.15.82:0/1215163147 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a55e23c40 0x561a55e2fca0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f41080c84c0 tx=0x7f4108097de0 comp rx=0 tx=0).stop 2023-09-23T09:47:09.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.815+0000 7f41277a7b80 1 -- 172.21.15.82:0/1215163147 shutdown_connections 2023-09-23T09:47:09.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.815+0000 7f41277a7b80 1 --2- 172.21.15.82:0/1215163147 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a55e29ca0 0x561a55e2d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:47:09.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.815+0000 7f41277a7b80 1 --2- 172.21.15.82:0/1215163147 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x561a55e4e7c0 0x561a55e50be0 crc :-1 s=READY pgs=297 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:47:09.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.815+0000 7f41277a7b80 1 --2- 172.21.15.82:0/1215163147 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a55e23c40 0x561a55e2fca0 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:47:09.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.815+0000 7f41277a7b80 1 --2- 172.21.15.82:0/1215163147 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561a55e29380 0x561a55e2cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:47:09.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.815+0000 7f41277a7b80 1 -- 172.21.15.82:0/1215163147 >> 172.21.15.82:0/1215163147 conn(0x561a55d980e0 msgr2=0x561a55e18b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:47:09.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.815+0000 7f40f57fa700 0 client.18387 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:47:09.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.817+0000 7f41277a7b80 1 -- 172.21.15.82:0/1215163147 shutdown_connections 2023-09-23T09:47:09.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.817+0000 7f41277a7b80 1 -- 172.21.15.82:0/1215163147 wait complete. 2023-09-23T09:47:09.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.819+0000 7f41277a7b80 20 client.18387 trim_cache size 0 max 16384 2023-09-23T09:47:09.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.852+0000 7f41277a7b80 1 Processor -- start 2023-09-23T09:47:09.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.853+0000 7f41277a7b80 1 -- start start 2023-09-23T09:47:09.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.853+0000 7f41277a7b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a55e23c40 0x561a55e2f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:47:09.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.853+0000 7f41277a7b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561a55e29380 0x561a55e27090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:47:09.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.853+0000 7f41277a7b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a55e29ca0 0x561a55e275d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:47:09.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.853+0000 7f41277a7b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a55bf7920 con 0x561a55e29ca0 2023-09-23T09:47:09.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.853+0000 7f41277a7b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a55e1f180 con 0x561a55e23c40 2023-09-23T09:47:09.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.853+0000 7f41277a7b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a55e1acb0 con 0x561a55e29380 2023-09-23T09:47:09.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.854+0000 7f411239c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a55e29ca0 0x561a55e275d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:47:09.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.854+0000 7f411239c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a55e29ca0 0x561a55e275d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50606/0 (socket says 172.21.15.82:50606) 2023-09-23T09:47:09.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.854+0000 7f411239c700 1 -- 172.21.15.82:0/1925878331 learned_addr learned my addr 172.21.15.82:0/1925878331 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:47:09.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.855+0000 7f411239c700 1 -- 172.21.15.82:0/1925878331 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561a55e29380 msgr2=0x561a55e27090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:47:09.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.855+0000 7f411239c700 1 --2- 172.21.15.82:0/1925878331 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561a55e29380 0x561a55e27090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:47:09.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.855+0000 7f411239c700 1 -- 172.21.15.82:0/1925878331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a55e23c40 msgr2=0x561a55e2f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:47:09.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.855+0000 7f411239c700 1 --2- 172.21.15.82:0/1925878331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a55e23c40 0x561a55e2f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:47:09.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.855+0000 7f411239c700 1 -- 172.21.15.82:0/1925878331 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561a55b8ac60 con 0x561a55e29ca0 2023-09-23T09:47:09.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.856+0000 7f411239c700 1 --2- 172.21.15.82:0/1925878331 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a55e29ca0 0x561a55e275d0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f41040053f0 tx=0x7f4104018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=369bfb689abde105 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:47:09.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.856+0000 7f40fcbff700 1 -- 172.21.15.82:0/1925878331 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f410400bb90 con 0x561a55e29ca0 2023-09-23T09:47:09.858 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.856+0000 7f40fcbff700 1 -- 172.21.15.82:0/1925878331 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4104027070 con 0x561a55e29ca0 2023-09-23T09:47:09.858 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.857+0000 7f40fcbff700 1 -- 172.21.15.82:0/1925878331 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4104003a90 con 0x561a55e29ca0 2023-09-23T09:47:09.859 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.858+0000 7f41277a7b80 1 -- 172.21.15.82:0/1925878331 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a55e29ca0 msgr2=0x561a55e275d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:47:09.859 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.858+0000 7f41277a7b80 1 --2- 172.21.15.82:0/1925878331 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a55e29ca0 0x561a55e275d0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f41040053f0 tx=0x7f4104018000 comp rx=0 tx=0).stop 2023-09-23T09:47:09.859 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.858+0000 7f41277a7b80 1 -- 172.21.15.82:0/1925878331 shutdown_connections 2023-09-23T09:47:09.859 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.858+0000 7f41277a7b80 1 --2- 172.21.15.82:0/1925878331 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a55e29ca0 0x561a55e275d0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:47:09.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.858+0000 7f41277a7b80 1 --2- 172.21.15.82:0/1925878331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a55e23c40 0x561a55e2f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:47:09.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.858+0000 7f41277a7b80 1 --2- 172.21.15.82:0/1925878331 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561a55e29380 0x561a55e27090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:47:09.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.858+0000 7f41277a7b80 1 -- 172.21.15.82:0/1925878331 >> 172.21.15.82:0/1925878331 conn(0x561a55d980e0 msgr2=0x561a55e1e110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:47:09.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.858+0000 7f41277a7b80 1 -- 172.21.15.82:0/1925878331 shutdown_connections 2023-09-23T09:47:09.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.858+0000 7f41277a7b80 1 -- 172.21.15.82:0/1925878331 wait complete. 2023-09-23T09:47:09.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.859+0000 7f41277a7b80 1 -- start start 2023-09-23T09:47:09.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.859+0000 7f41277a7b80 1 Processor -- start 2023-09-23T09:47:09.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.860+0000 7f41277a7b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561a55e23c40 0x561a55e260a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:47:09.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.860+0000 7f41277a7b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a55e29380 0x561a55e265e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:47:09.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.860+0000 7f41277a7b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a55e29ca0 0x561a55e24e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:47:09.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.860+0000 7f41277a7b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a55e26be0 con 0x561a55e29380 2023-09-23T09:47:09.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.860+0000 7f41277a7b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a55e25340 con 0x561a55e29ca0 2023-09-23T09:47:09.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.860+0000 7f41277a7b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a55e25500 con 0x561a55e23c40 2023-09-23T09:47:09.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.860+0000 7f41277a7b80 10 client.0 _ll_register_callbacks cb 0x7f4108097fc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:47:09.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.861+0000 7f411239c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a55e29ca0 0x561a55e24e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:47:09.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.862+0000 7f411239c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a55e29ca0 0x561a55e24e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:56906/0 (socket says 172.21.15.82:56906) 2023-09-23T09:47:09.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.862+0000 7f411239c700 1 -- 172.21.15.82:0/3496914628 learned_addr learned my addr 172.21.15.82:0/3496914628 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:47:09.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.862+0000 7f4111b9b700 1 --2- 172.21.15.82:0/3496914628 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561a55e23c40 0x561a55e260a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:47:09.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.866+0000 7f411139a700 1 --2- 172.21.15.82:0/3496914628 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a55e29380 0x561a55e265e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:47:09.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.866+0000 7f4111b9b700 1 -- 172.21.15.82:0/3496914628 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a55e29ca0 msgr2=0x561a55e24e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:47:09.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.866+0000 7f4111b9b700 1 --2- 172.21.15.82:0/3496914628 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a55e29ca0 0x561a55e24e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:47:09.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.866+0000 7f4111b9b700 1 -- 172.21.15.82:0/3496914628 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a55e29380 msgr2=0x561a55e265e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:47:09.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.866+0000 7f4111b9b700 1 --2- 172.21.15.82:0/3496914628 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a55e29380 0x561a55e265e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:47:09.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.866+0000 7f4111b9b700 1 -- 172.21.15.82:0/3496914628 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f410c114650 con 0x561a55e23c40 2023-09-23T09:47:09.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.867+0000 7f4111b9b700 1 --2- 172.21.15.82:0/3496914628 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561a55e23c40 0x561a55e260a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f41080a0430 tx=0x7f4108004860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3905d4287776639 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:47:09.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.867+0000 7f40f57fa700 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-09-23T09:47:09.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.868+0000 7f40f57fa700 1 -- 172.21.15.82:0/3496914628 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41080abd40 con 0x561a55e23c40 2023-09-23T09:47:09.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.868+0000 7f40f57fa700 1 -- 172.21.15.82:0/3496914628 <== mon.1 v2:172.21.15.161:3300/0 2 ==== osd_map(176..176 src has 1..176) v4 ==== 8557+0+0 (secure 0 0 0) 0x7f4108098b80 con 0x561a55e23c40 2023-09-23T09:47:09.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.868+0000 7f41277a7b80 1 -- 172.21.15.82:0/3496914628 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561a55e168b0 con 0x561a55e23c40 2023-09-23T09:47:09.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.870+0000 7f40f57fa700 1 -- 172.21.15.82:0/3496914628 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=141) v2 ==== 24+0+0 (secure 0 0 0) 0x7f41080abea0 con 0x561a55e23c40 2023-09-23T09:47:09.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.877+0000 7f41277a7b80 10 client.28126 fetch_fsmap learned FSMap version 141 2023-09-23T09:47:09.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.877+0000 7f41277a7b80 1 -- 172.21.15.82:0/3496914628 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=141,monmap=4+}) v3 -- 0x561a55bc8250 con 0x561a55e23c40 2023-09-23T09:47:09.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.888+0000 7f40f57fa700 1 -- 172.21.15.82:0/3496914628 <== mon.1 v2:172.21.15.161:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x561a55e168b0 con 0x561a55e23c40 2023-09-23T09:47:09.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.888+0000 7f40f57fa700 1 -- 172.21.15.82:0/3496914628 <== mon.1 v2:172.21.15.161:3300/0 5 ==== fsmap(e 141) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f4108094270 con 0x561a55e23c40 2023-09-23T09:47:09.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.888+0000 7f41277a7b80 10 client.28126 fetch_fsmap finished waiting for FSMap version 141 2023-09-23T09:47:09.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.888+0000 7f41277a7b80 10 client.28126 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:47:09.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.888+0000 7f41277a7b80 20 client.28126 populate_metadata read hostname 'smithi082' 2023-09-23T09:47:09.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.888+0000 7f41277a7b80 1 --2- 172.21.15.82:0/3496914628 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x561a55ea3260 0x561a55ea5680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:47:09.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.888+0000 7f41277a7b80 4 client.28126 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:47:09.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.888+0000 7f41277a7b80 1 -- 172.21.15.82:0/3496914628 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x561a55d6e970 con 0x561a55ea3260 2023-09-23T09:47:09.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.889+0000 7f411139a700 1 --2- 172.21.15.82:0/3496914628 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x561a55ea3260 0x561a55ea5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:47:09.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.912+0000 7f411139a700 1 --2- 172.21.15.82:0/3496914628 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x561a55ea3260 0x561a55ea5680 crc :-1 s=READY pgs=298 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a1a4028526b57c70 server_cookie=732aa1c39b1b8b63 in_seq=0 out_seq=0 2023-09-23T09:47:09.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.912+0000 7f40f57fa700 10 client.28126 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:47:09.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.914+0000 7f40f57fa700 1 -- 172.21.15.82:0/3496914628 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x561a55d6e970 con 0x561a55ea3260 2023-09-23T09:47:09.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.914+0000 7f40f57fa700 10 client.28126 handle_command_reply: tid=0 2023-09-23T09:47:09.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.914+0000 7f41277a7b80 1 client.28126 shutdown 2023-09-23T09:47:09.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.915+0000 7f41277a7b80 1 -- 172.21.15.82:0/3496914628 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561a55e23c40 msgr2=0x561a55e260a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:47:09.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.915+0000 7f41277a7b80 1 --2- 172.21.15.82:0/3496914628 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561a55e23c40 0x561a55e260a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f41080a0430 tx=0x7f4108004860 comp rx=0 tx=0).stop 2023-09-23T09:47:09.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.923+0000 7f41277a7b80 1 -- 172.21.15.82:0/3496914628 shutdown_connections 2023-09-23T09:47:09.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.923+0000 7f41277a7b80 1 --2- 172.21.15.82:0/3496914628 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a55e29ca0 0x561a55e24e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:47:09.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.923+0000 7f41277a7b80 1 --2- 172.21.15.82:0/3496914628 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561a55e23c40 0x561a55e260a0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:47:09.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.923+0000 7f41277a7b80 1 --2- 172.21.15.82:0/3496914628 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x561a55ea3260 0x561a55ea5680 crc :-1 s=READY pgs=298 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:47:09.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.923+0000 7f41277a7b80 1 --2- 172.21.15.82:0/3496914628 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a55e29380 0x561a55e265e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:47:09.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.923+0000 7f41277a7b80 1 -- 172.21.15.82:0/3496914628 >> 172.21.15.82:0/3496914628 conn(0x561a55d980e0 msgr2=0x561a55e27090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:47:09.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.924+0000 7f40f57fa700 0 client.28126 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:47:09.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.924+0000 7f41277a7b80 1 -- 172.21.15.82:0/3496914628 shutdown_connections 2023-09-23T09:47:09.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.924+0000 7f41277a7b80 1 -- 172.21.15.82:0/3496914628 wait complete. 2023-09-23T09:47:09.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.925+0000 7f41277a7b80 20 client.28126 trim_cache size 0 max 16384 2023-09-23T09:47:09.927 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:47:09.927 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-23T09:47:09.927 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:47:09.927 INFO:teuthology.orchestra.run.smithi082.stdout: "d9e62ab8-1468-4fb0-a9fe-61bed13e954b": { 2023-09-23T09:47:09.927 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:47:09.927 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "d9e62ab8-1468-4fb0-a9fe-61bed13e954b", 2023-09-23T09:47:09.927 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:47:09.927 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:47:09.927 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:47:09.928 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:47:09.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.927+0000 7f4113dff700 1 -- 172.21.15.82:0/1326856695 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f40f80a02d0 msgr2=0x7f40f80a2790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:47:09.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.927+0000 7f4113dff700 1 --2- 172.21.15.82:0/1326856695 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f40f80a02d0 0x7f40f80a2790 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f4104006010 tx=0x7f410400b540 comp rx=0 tx=0).stop 2023-09-23T09:47:09.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.927+0000 7f4113dff700 1 -- 172.21.15.82:0/1326856695 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f410c107040 msgr2=0x7f410c19cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:47:09.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.927+0000 7f4113dff700 1 --2- 172.21.15.82:0/1326856695 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f410c107040 0x7f410c19cf50 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f410800b530 tx=0x7f410800b8f0 comp rx=0 tx=0).stop 2023-09-23T09:47:09.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.929+0000 7f4113dff700 1 -- 172.21.15.82:0/1326856695 shutdown_connections 2023-09-23T09:47:09.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.929+0000 7f4113dff700 1 --2- 172.21.15.82:0/1326856695 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f40f80a02d0 0x7f40f80a2790 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:47:09.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.929+0000 7f4113dff700 1 --2- 172.21.15.82:0/1326856695 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f410c10cfc0 0x7f410c1a18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:47:09.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.929+0000 7f4113dff700 1 --2- 172.21.15.82:0/1326856695 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f410c107040 0x7f410c19cf50 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:47:09.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.929+0000 7f4113dff700 1 --2- 172.21.15.82:0/1326856695 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f410c107a00 0x7f410c19d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:47:09.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.929+0000 7f4113dff700 1 -- 172.21.15.82:0/1326856695 >> 172.21.15.82:0/1326856695 conn(0x7f410c0767c0 msgr2=0x7f410c0779f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:47:09.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.930+0000 7f4113dff700 1 -- 172.21.15.82:0/1326856695 shutdown_connections 2023-09-23T09:47:09.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:09.930+0000 7f4113dff700 1 -- 172.21.15.82:0/1326856695 wait complete. 2023-09-23T09:47:09.972 INFO:tasks.cephfs.filesystem:scrub status for tag:d9e62ab8-1468-4fb0-a9fe-61bed13e954b - {'path': '/', 'tag': 'd9e62ab8-1468-4fb0-a9fe-61bed13e954b', 'options': 'recursive,force'} 2023-09-23T09:47:11.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:47:11 smithi082 ceph-mon[97694]: pgmap v1598: 97 pgs: 16 active+clean+snaptrim_wait, 9 active+clean+snaptrim, 72 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-09-23T09:47:11.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:47:11 smithi161 ceph-mon[99580]: pgmap v1598: 97 pgs: 16 active+clean+snaptrim_wait, 9 active+clean+snaptrim, 72 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-09-23T09:47:11.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:47:11 smithi135 ceph-mon[99205]: pgmap v1598: 97 pgs: 16 active+clean+snaptrim_wait, 9 active+clean+snaptrim, 72 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-09-23T09:47:13.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:47:13 smithi082 ceph-mon[97694]: pgmap v1599: 97 pgs: 28 active+clean+snaptrim_wait, 13 active+clean+snaptrim, 56 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-09-23T09:47:13.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:47:13 smithi161 ceph-mon[99580]: pgmap v1599: 97 pgs: 28 active+clean+snaptrim_wait, 13 active+clean+snaptrim, 56 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-09-23T09:47:13.560 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:47:13 smithi135 ceph-mon[99205]: pgmap v1599: 97 pgs: 28 active+clean+snaptrim_wait, 13 active+clean+snaptrim, 56 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-09-23T09:47:15.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:47:15 smithi082 ceph-mon[97694]: pgmap v1600: 97 pgs: 28 active+clean+snaptrim_wait, 13 active+clean+snaptrim, 56 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-09-23T09:47:15.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:47:15 smithi161 ceph-mon[99580]: pgmap v1600: 97 pgs: 28 active+clean+snaptrim_wait, 13 active+clean+snaptrim, 56 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-09-23T09:47:15.560 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:47:15 smithi135 ceph-mon[99205]: pgmap v1600: 97 pgs: 28 active+clean+snaptrim_wait, 13 active+clean+snaptrim, 56 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-09-23T09:47:17.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:47:17 smithi082 ceph-mon[97694]: pgmap v1601: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-09-23T09:47:17.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:47:17 smithi161 ceph-mon[99580]: pgmap v1601: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-09-23T09:47:17.560 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:47:17 smithi135 ceph-mon[99205]: pgmap v1601: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-09-23T09:47:18.810 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:47:18 smithi135 ceph-mon[99205]: osdmap e177: 12 total, 12 up, 12 in 2023-09-23T09:47:18.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:47:18 smithi135 ceph-mon[99205]: pgmap v1603: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-09-23T09:47:18.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:47:18 smithi082 ceph-mon[97694]: osdmap e177: 12 total, 12 up, 12 in 2023-09-23T09:47:18.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:47:18 smithi082 ceph-mon[97694]: pgmap v1603: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-09-23T09:47:18.896 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:47:18 smithi161 ceph-mon[99580]: osdmap e177: 12 total, 12 up, 12 in 2023-09-23T09:47:18.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:47:18 smithi161 ceph-mon[99580]: pgmap v1603: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-09-23T09:47:21.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:47:21 smithi135 ceph-mon[99205]: pgmap v1604: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-09-23T09:47:21.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:47:21 smithi082 ceph-mon[97694]: pgmap v1604: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-09-23T09:47:21.396 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:47:21 smithi161 ceph-mon[99580]: pgmap v1604: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-09-23T09:47:23.310 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:47:23 smithi135 ceph-mon[99205]: pgmap v1605: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-09-23T09:47:23.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:47:23 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:47:23.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:47:23 smithi082 ceph-mon[97694]: pgmap v1605: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-09-23T09:47:23.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:47:23 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:47:23.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:47:23 smithi161 ceph-mon[99580]: pgmap v1605: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-09-23T09:47:23.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:47:23 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:47:25.310 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:47:25 smithi135 ceph-mon[99205]: pgmap v1606: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-09-23T09:47:25.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:47:25 smithi082 ceph-mon[97694]: pgmap v1606: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-09-23T09:47:25.396 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:47:25 smithi161 ceph-mon[99580]: pgmap v1606: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-09-23T09:47:27.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:47:27 smithi082 ceph-mon[97694]: pgmap v1607: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-09-23T09:47:27.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:47:27 smithi161 ceph-mon[99580]: pgmap v1607: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-09-23T09:47:27.560 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:47:27 smithi135 ceph-mon[99205]: pgmap v1607: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-09-23T09:47:28.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:47:28 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:47:28.396 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:47:28 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:47:28.560 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:47:28 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:47:29.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:47:29 smithi082 ceph-mon[97694]: pgmap v1608: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-09-23T09:47:29.396 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:47:29 smithi161 ceph-mon[99580]: pgmap v1608: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-09-23T09:47:29.560 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:47:29 smithi135 ceph-mon[99205]: pgmap v1608: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-09-23T09:47:31.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:47:31 smithi082 ceph-mon[97694]: pgmap v1609: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-09-23T09:47:31.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:47:31 smithi161 ceph-mon[99580]: pgmap v1609: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-09-23T09:47:31.560 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:47:31 smithi135 ceph-mon[99205]: pgmap v1609: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-09-23T09:47:33.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:47:33 smithi082 ceph-mon[97694]: pgmap v1610: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-09-23T09:47:33.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:47:33 smithi161 ceph-mon[99580]: pgmap v1610: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-09-23T09:47:33.560 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:47:33 smithi135 ceph-mon[99205]: pgmap v1610: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-09-23T09:47:35.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:47:35 smithi082 ceph-mon[97694]: pgmap v1611: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-09-23T09:47:35.396 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:47:35 smithi161 ceph-mon[99580]: pgmap v1611: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-09-23T09:47:35.560 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:47:35 smithi135 ceph-mon[99205]: pgmap v1611: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-09-23T09:47:37.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:47:37 smithi082 ceph-mon[97694]: pgmap v1612: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-09-23T09:47:37.396 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:47:37 smithi161 ceph-mon[99580]: pgmap v1612: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-09-23T09:47:37.560 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:47:37 smithi135 ceph-mon[99205]: pgmap v1612: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-09-23T09:47:38.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:47:38 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:47:38.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:47:38 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:47:38.560 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:47:38 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:47:39.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:47:39 smithi082 ceph-mon[97694]: pgmap v1613: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-09-23T09:47:39.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:47:39 smithi161 ceph-mon[99580]: pgmap v1613: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-09-23T09:47:39.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:47:39 smithi135 ceph-mon[99205]: pgmap v1613: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-09-23T09:47:39.973 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:47:40.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.184+0000 7f087fdff700 1 -- 172.21.15.82:0/4258691368 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0878106880 msgr2=0x7f0878106c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:47:40.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.184+0000 7f087fdff700 1 --2- 172.21.15.82:0/4258691368 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0878106880 0x7f0878106c60 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f0874009990 tx=0x7f0874009ca0 comp rx=0 tx=0).stop 2023-09-23T09:47:40.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.185+0000 7f087fdff700 1 -- 172.21.15.82:0/4258691368 shutdown_connections 2023-09-23T09:47:40.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.185+0000 7f087fdff700 1 --2- 172.21.15.82:0/4258691368 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0878101230 0x7f087810d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:47:40.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.185+0000 7f087fdff700 1 --2- 172.21.15.82:0/4258691368 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0878106880 0x7f0878106c60 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:47:40.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.185+0000 7f087fdff700 1 --2- 172.21.15.82:0/4258691368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0878100870 0x7f0878100cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:47:40.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.185+0000 7f087fdff700 1 -- 172.21.15.82:0/4258691368 >> 172.21.15.82:0/4258691368 conn(0x7f08780fc3a0 msgr2=0x7f08780fe7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:47:40.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.185+0000 7f087fdff700 1 -- 172.21.15.82:0/4258691368 shutdown_connections 2023-09-23T09:47:40.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.185+0000 7f087fdff700 1 -- 172.21.15.82:0/4258691368 wait complete. 2023-09-23T09:47:40.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.186+0000 7f087fdff700 1 Processor -- start 2023-09-23T09:47:40.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.186+0000 7f087fdff700 1 -- start start 2023-09-23T09:47:40.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.186+0000 7f087fdff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0878100870 0x7f0878072c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:47:40.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.186+0000 7f087fdff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0878101230 0x7f0878073160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:47:40.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.186+0000 7f087fdff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0878106880 0x7f08781a4a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:47:40.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.186+0000 7f087fdff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0878073990 con 0x7f0878101230 2023-09-23T09:47:40.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.186+0000 7f087fdff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08781a4fb0 con 0x7f0878106880 2023-09-23T09:47:40.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.186+0000 7f087fdff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08781a50f0 con 0x7f0878100870 2023-09-23T09:47:40.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.187+0000 7f087d39a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0878101230 0x7f0878073160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:47:40.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.187+0000 7f087d39a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0878101230 0x7f0878073160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43810/0 (socket says 172.21.15.82:43810) 2023-09-23T09:47:40.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.187+0000 7f087e39c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0878106880 0x7f08781a4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:47:40.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.187+0000 7f087d39a700 1 -- 172.21.15.82:0/2533135100 learned_addr learned my addr 172.21.15.82:0/2533135100 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:47:40.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.187+0000 7f087db9b700 1 --2- 172.21.15.82:0/2533135100 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0878100870 0x7f0878072c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:47:40.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.187+0000 7f087d39a700 1 -- 172.21.15.82:0/2533135100 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0878100870 msgr2=0x7f0878072c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:47:40.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.187+0000 7f087d39a700 1 --2- 172.21.15.82:0/2533135100 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0878100870 0x7f0878072c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:47:40.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.187+0000 7f087d39a700 1 -- 172.21.15.82:0/2533135100 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0878106880 msgr2=0x7f08781a4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:47:40.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.187+0000 7f087d39a700 1 --2- 172.21.15.82:0/2533135100 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0878106880 0x7f08781a4a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:47:40.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.187+0000 7f087d39a700 1 -- 172.21.15.82:0/2533135100 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08740095f0 con 0x7f0878101230 2023-09-23T09:47:40.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.187+0000 7f087e39c700 1 --2- 172.21.15.82:0/2533135100 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0878106880 0x7f08781a4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:47:40.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.187+0000 7f087d39a700 1 --2- 172.21.15.82:0/2533135100 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0878101230 0x7f0878073160 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f086800e9a0 tx=0x7f086800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:47:40.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.188+0000 7f086effd700 1 -- 172.21.15.82:0/2533135100 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0868009790 con 0x7f0878101230 2023-09-23T09:47:40.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.188+0000 7f087fdff700 1 -- 172.21.15.82:0/2533135100 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08781a5350 con 0x7f0878101230 2023-09-23T09:47:40.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.188+0000 7f086effd700 1 -- 172.21.15.82:0/2533135100 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f086800cbd0 con 0x7f0878101230 2023-09-23T09:47:40.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.188+0000 7f086effd700 1 -- 172.21.15.82:0/2533135100 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0868018680 con 0x7f0878101230 2023-09-23T09:47:40.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.188+0000 7f087fdff700 1 -- 172.21.15.82:0/2533135100 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08781a5880 con 0x7f0878101230 2023-09-23T09:47:40.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.191+0000 7f086effd700 1 -- 172.21.15.82:0/2533135100 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f086800cd40 con 0x7f0878101230 2023-09-23T09:47:40.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.192+0000 7f0893655b80 1 Processor -- start 2023-09-23T09:47:40.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.193+0000 7f0893655b80 1 -- start start 2023-09-23T09:47:40.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.193+0000 7f0893655b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561c003cd380 0x561c003cd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:47:40.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.193+0000 7f0893655b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561c003cdca0 0x561c003c7700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:47:40.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.193+0000 7f0893655b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c003c7c40 0x561c003c80a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:47:40.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.193+0000 7f086effd700 1 --2- 172.21.15.82:0/2533135100 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f08640a00c0 0x7f08640a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:47:40.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.193+0000 7f0893655b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c0032f7b0 con 0x561c003c7c40 2023-09-23T09:47:40.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.193+0000 7f0893655b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c00320780 con 0x561c003cd380 2023-09-23T09:47:40.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.193+0000 7f0893655b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c0031e0a0 con 0x561c003cdca0 2023-09-23T09:47:40.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.193+0000 7f086effd700 1 -- 172.21.15.82:0/2533135100 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f0868014070 con 0x7f0878101230 2023-09-23T09:47:40.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.194+0000 7f087e39c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561c003cd380 0x561c003cd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:47:40.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.194+0000 7f087e39c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561c003cd380 0x561c003cd760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:59576/0 (socket says 172.21.15.82:59576) 2023-09-23T09:47:40.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.194+0000 7f087e39c700 1 -- 172.21.15.82:0/3688391893 learned_addr learned my addr 172.21.15.82:0/3688391893 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:47:40.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.194+0000 7f087d39a700 1 --2- 172.21.15.82:0/3688391893 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c003c7c40 0x561c003c80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:47:40.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.194+0000 7f087e39c700 1 --2- 172.21.15.82:0/2533135100 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f08640a00c0 0x7f08640a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:47:40.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.194+0000 7f087db9b700 1 --2- 172.21.15.82:0/3688391893 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561c003cdca0 0x561c003c7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:47:40.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.194+0000 7f087e39c700 1 -- 172.21.15.82:0/3688391893 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561c003cdca0 msgr2=0x561c003c7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:47:40.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.194+0000 7f087e39c700 1 --2- 172.21.15.82:0/3688391893 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561c003cdca0 0x561c003c7700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:47:40.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.194+0000 7f087e39c700 1 -- 172.21.15.82:0/3688391893 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c003c7c40 msgr2=0x561c003c80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:47:40.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.194+0000 7f087e39c700 1 --2- 172.21.15.82:0/3688391893 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c003c7c40 0x561c003c80a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:47:40.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.194+0000 7f087e39c700 1 -- 172.21.15.82:0/3688391893 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561c00199630 con 0x561c003cd380 2023-09-23T09:47:40.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.194+0000 7f087d39a700 1 --2- 172.21.15.82:0/3688391893 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c003c7c40 0x561c003c80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:47:40.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.194+0000 7f087e39c700 1 --2- 172.21.15.82:0/3688391893 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561c003cd380 0x561c003cd760 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f08700193f0 tx=0x7f0870019700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9fa4095c9637bb2e server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:47:40.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.194+0000 7f087e39c700 1 --2- 172.21.15.82:0/2533135100 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f08640a00c0 0x7f08640a2580 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f0870019a50 tx=0x7f087000d000 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:47:40.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.195+0000 7f0863fff700 1 -- 172.21.15.82:0/3688391893 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0870007b50 con 0x561c003cd380 2023-09-23T09:47:40.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.195+0000 7f0863fff700 1 -- 172.21.15.82:0/3688391893 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f087000f040 con 0x561c003cd380 2023-09-23T09:47:40.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.195+0000 7f0863fff700 1 -- 172.21.15.82:0/3688391893 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0870023870 con 0x561c003cd380 2023-09-23T09:47:40.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.195+0000 7f0893655b80 1 -- 172.21.15.82:0/3688391893 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561c003cd380 msgr2=0x561c003cd760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:47:40.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.195+0000 7f0893655b80 1 --2- 172.21.15.82:0/3688391893 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561c003cd380 0x561c003cd760 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f08700193f0 tx=0x7f0870019700 comp rx=0 tx=0).stop 2023-09-23T09:47:40.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.195+0000 7f0893655b80 1 -- 172.21.15.82:0/3688391893 shutdown_connections 2023-09-23T09:47:40.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.195+0000 7f0893655b80 1 --2- 172.21.15.82:0/3688391893 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c003c7c40 0x561c003c80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:47:40.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.195+0000 7f0893655b80 1 --2- 172.21.15.82:0/3688391893 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561c003cd380 0x561c003cd760 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:47:40.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.195+0000 7f0893655b80 1 --2- 172.21.15.82:0/3688391893 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561c003cdca0 0x561c003c7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:47:40.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.195+0000 7f0893655b80 1 -- 172.21.15.82:0/3688391893 >> 172.21.15.82:0/3688391893 conn(0x561c0033c0e0 msgr2=0x561c003c2410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:47:40.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.195+0000 7f0893655b80 1 -- 172.21.15.82:0/3688391893 shutdown_connections 2023-09-23T09:47:40.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.196+0000 7f0893655b80 1 -- 172.21.15.82:0/3688391893 wait complete. 2023-09-23T09:47:40.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.196+0000 7f0893655b80 1 -- start start 2023-09-23T09:47:40.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.196+0000 7f0893655b80 1 Processor -- start 2023-09-23T09:47:40.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.197+0000 7f0893655b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561c003c7c40 0x561c003d3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:47:40.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.197+0000 7f0893655b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c003cd380 0x561c003d0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:47:40.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.197+0000 7f0893655b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561c003cdca0 0x561c003d1500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:47:40.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.197+0000 7f0893655b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c00319990 con 0x561c003cd380 2023-09-23T09:47:40.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.197+0000 7f0893655b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c002b7bb0 con 0x561c003cdca0 2023-09-23T09:47:40.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.197+0000 7f0893655b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c002b78b0 con 0x561c003c7c40 2023-09-23T09:47:40.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.197+0000 7f0893655b80 10 client.0 _ll_register_callbacks cb 0x561c00201a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:47:40.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.197+0000 7f087d39a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c003cd380 0x561c003d0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:47:40.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.197+0000 7f087d39a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c003cd380 0x561c003d0e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43842/0 (socket says 172.21.15.82:43842) 2023-09-23T09:47:40.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.197+0000 7f087d39a700 1 -- 172.21.15.82:0/816376600 learned_addr learned my addr 172.21.15.82:0/816376600 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:47:40.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.197+0000 7f087e39c700 1 --2- 172.21.15.82:0/816376600 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561c003cdca0 0x561c003d1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:47:40.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.198+0000 7f087db9b700 1 --2- 172.21.15.82:0/816376600 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561c003c7c40 0x561c003d3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:47:40.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.198+0000 7f087d39a700 1 -- 172.21.15.82:0/816376600 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561c003c7c40 msgr2=0x561c003d3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:47:40.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.198+0000 7f087d39a700 1 --2- 172.21.15.82:0/816376600 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561c003c7c40 0x561c003d3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:47:40.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.198+0000 7f087d39a700 1 -- 172.21.15.82:0/816376600 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561c003cdca0 msgr2=0x561c003d1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:47:40.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.198+0000 7f087d39a700 1 --2- 172.21.15.82:0/816376600 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561c003cdca0 0x561c003d1500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:47:40.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.198+0000 7f087d39a700 1 -- 172.21.15.82:0/816376600 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08781a5880 con 0x561c003cd380 2023-09-23T09:47:40.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.198+0000 7f087db9b700 1 --2- 172.21.15.82:0/816376600 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561c003c7c40 0x561c003d3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T09:47:40.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.198+0000 7f087d39a700 1 --2- 172.21.15.82:0/816376600 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c003cd380 0x561c003d0e80 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f08680954e0 tx=0x7f08680c9580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af2de8f5217d76b3 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:47:40.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.198+0000 7f08617fa700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:47:40.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.198+0000 7f08617fa700 1 -- 172.21.15.82:0/816376600 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f086809ce10 con 0x561c003cd380 2023-09-23T09:47:40.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.198+0000 7f08617fa700 1 -- 172.21.15.82:0/816376600 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(177..177 src has 1..177) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f08680a0df0 con 0x561c003cd380 2023-09-23T09:47:40.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.198+0000 7f0893655b80 1 -- 172.21.15.82:0/816376600 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561c003971c0 con 0x561c003cd380 2023-09-23T09:47:40.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.199+0000 7f08617fa700 1 -- 172.21.15.82:0/816376600 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=144) v2 ==== 24+0+0 (secure 0 0 0) 0x7f08680a0960 con 0x561c003cd380 2023-09-23T09:47:40.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.199+0000 7f0893655b80 10 client.18405 fetch_fsmap learned FSMap version 144 2023-09-23T09:47:40.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.199+0000 7f0893655b80 1 -- 172.21.15.82:0/816376600 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=144,monmap=4+}) v3 -- 0x7f0870011040 con 0x561c003cd380 2023-09-23T09:47:40.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.199+0000 7f08617fa700 1 -- 172.21.15.82:0/816376600 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0868063020 con 0x561c003cd380 2023-09-23T09:47:40.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.199+0000 7f08617fa700 1 -- 172.21.15.82:0/816376600 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 144) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f0868094f20 con 0x561c003cd380 2023-09-23T09:47:40.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.199+0000 7f0893655b80 10 client.18405 fetch_fsmap finished waiting for FSMap version 144 2023-09-23T09:47:40.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.199+0000 7f0893655b80 10 client.18405 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:47:40.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.199+0000 7f0893655b80 20 client.18405 populate_metadata read hostname 'smithi082' 2023-09-23T09:47:40.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.199+0000 7f0893655b80 1 --2- 172.21.15.82:0/816376600 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x561c003e16b0 0x561c003e3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:47:40.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.199+0000 7f0893655b80 4 client.18405 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:47:40.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.199+0000 7f0893655b80 1 -- 172.21.15.82:0/816376600 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561c002bfba0 con 0x561c003e16b0 2023-09-23T09:47:40.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.199+0000 7f087db9b700 1 --2- 172.21.15.82:0/816376600 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x561c003e16b0 0x561c003e3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:47:40.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.200+0000 7f08617fa700 10 client.18405 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:47:40.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.200+0000 7f087db9b700 1 --2- 172.21.15.82:0/816376600 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x561c003e16b0 0x561c003e3ad0 crc :-1 s=READY pgs=299 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b873aa2281819fdd server_cookie=418c11e91fa8b22f in_seq=0 out_seq=0 2023-09-23T09:47:40.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.201+0000 7f08617fa700 1 -- 172.21.15.82:0/816376600 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x561c002bfba0 con 0x561c003e16b0 2023-09-23T09:47:40.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.201+0000 7f08617fa700 10 client.18405 handle_command_reply: tid=0 2023-09-23T09:47:40.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.201+0000 7f0893655b80 1 client.18405 shutdown 2023-09-23T09:47:40.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.201+0000 7f0893655b80 1 -- 172.21.15.82:0/816376600 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c003cd380 msgr2=0x561c003d0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:47:40.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.201+0000 7f0893655b80 1 --2- 172.21.15.82:0/816376600 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c003cd380 0x561c003d0e80 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f08680954e0 tx=0x7f08680c9580 comp rx=0 tx=0).stop 2023-09-23T09:47:40.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.201+0000 7f0893655b80 1 -- 172.21.15.82:0/816376600 shutdown_connections 2023-09-23T09:47:40.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.201+0000 7f0893655b80 1 --2- 172.21.15.82:0/816376600 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561c003cdca0 0x561c003d1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:47:40.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.201+0000 7f0893655b80 1 --2- 172.21.15.82:0/816376600 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561c003c7c40 0x561c003d3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:47:40.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.201+0000 7f0893655b80 1 --2- 172.21.15.82:0/816376600 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x561c003e16b0 0x561c003e3ad0 crc :-1 s=READY pgs=299 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:47:40.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.201+0000 7f0893655b80 1 --2- 172.21.15.82:0/816376600 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c003cd380 0x561c003d0e80 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:47:40.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.201+0000 7f0893655b80 1 -- 172.21.15.82:0/816376600 >> 172.21.15.82:0/816376600 conn(0x561c0033c0e0 msgr2=0x561c003bcb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:47:40.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.201+0000 7f08617fa700 0 client.18405 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:47:40.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.201+0000 7f0893655b80 1 -- 172.21.15.82:0/816376600 shutdown_connections 2023-09-23T09:47:40.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.202+0000 7f0893655b80 1 -- 172.21.15.82:0/816376600 wait complete. 2023-09-23T09:47:40.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.202+0000 7f0893655b80 20 client.18405 trim_cache size 0 max 16384 2023-09-23T09:47:40.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.219+0000 7f0893655b80 1 Processor -- start 2023-09-23T09:47:40.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.219+0000 7f0893655b80 1 -- start start 2023-09-23T09:47:40.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.219+0000 7f0893655b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561c003c7c40 0x561c003c7700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:47:40.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.219+0000 7f0893655b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c003cd380 0x561c003cb050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:47:40.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.219+0000 7f0893655b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561c003cdca0 0x561c003cb590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:47:40.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.219+0000 7f0893655b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c0019b920 con 0x561c003cd380 2023-09-23T09:47:40.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.219+0000 7f0893655b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c003bec80 con 0x561c003cdca0 2023-09-23T09:47:40.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.219+0000 7f0893655b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c003cbb30 con 0x561c003c7c40 2023-09-23T09:47:40.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.219+0000 7f087d39a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c003cd380 0x561c003cb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:47:40.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.219+0000 7f087d39a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c003cd380 0x561c003cb050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43846/0 (socket says 172.21.15.82:43846) 2023-09-23T09:47:40.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.219+0000 7f087d39a700 1 -- 172.21.15.82:0/1445978241 learned_addr learned my addr 172.21.15.82:0/1445978241 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:47:40.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.219+0000 7f087e39c700 1 --2- 172.21.15.82:0/1445978241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561c003cdca0 0x561c003cb590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:47:40.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.219+0000 7f087db9b700 1 --2- 172.21.15.82:0/1445978241 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561c003c7c40 0x561c003c7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:47:40.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.220+0000 7f087d39a700 1 -- 172.21.15.82:0/1445978241 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561c003c7c40 msgr2=0x561c003c7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:47:40.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.220+0000 7f087d39a700 1 --2- 172.21.15.82:0/1445978241 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561c003c7c40 0x561c003c7700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:47:40.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.220+0000 7f087d39a700 1 -- 172.21.15.82:0/1445978241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561c003cdca0 msgr2=0x561c003cb590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:47:40.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.220+0000 7f087d39a700 1 --2- 172.21.15.82:0/1445978241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561c003cdca0 0x561c003cb590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:47:40.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.220+0000 7f087d39a700 1 -- 172.21.15.82:0/1445978241 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561c003c82f0 con 0x561c003cd380 2023-09-23T09:47:40.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.220+0000 7f087db9b700 1 --2- 172.21.15.82:0/1445978241 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561c003c7c40 0x561c003c7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:47:40.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.220+0000 7f087d39a700 1 --2- 172.21.15.82:0/1445978241 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c003cd380 0x561c003cb050 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f0868099890 tx=0x7f08680cb9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f067365e4eabdb8c server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:47:40.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.220+0000 7f086cbff700 1 -- 172.21.15.82:0/1445978241 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08680982e0 con 0x561c003cd380 2023-09-23T09:47:40.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.220+0000 7f086cbff700 1 -- 172.21.15.82:0/1445978241 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0868063070 con 0x561c003cd380 2023-09-23T09:47:40.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.220+0000 7f086cbff700 1 -- 172.21.15.82:0/1445978241 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08680a0bc0 con 0x561c003cd380 2023-09-23T09:47:40.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.221+0000 7f0893655b80 1 -- 172.21.15.82:0/1445978241 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c003cd380 msgr2=0x561c003cb050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:47:40.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.221+0000 7f0893655b80 1 --2- 172.21.15.82:0/1445978241 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c003cd380 0x561c003cb050 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f0868099890 tx=0x7f08680cb9b0 comp rx=0 tx=0).stop 2023-09-23T09:47:40.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.221+0000 7f0893655b80 1 -- 172.21.15.82:0/1445978241 shutdown_connections 2023-09-23T09:47:40.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.221+0000 7f0893655b80 1 --2- 172.21.15.82:0/1445978241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561c003cdca0 0x561c003cb590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:47:40.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.221+0000 7f0893655b80 1 --2- 172.21.15.82:0/1445978241 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561c003c7c40 0x561c003c7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:47:40.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.221+0000 7f0893655b80 1 --2- 172.21.15.82:0/1445978241 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c003cd380 0x561c003cb050 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:47:40.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.221+0000 7f0893655b80 1 -- 172.21.15.82:0/1445978241 >> 172.21.15.82:0/1445978241 conn(0x561c0033c0e0 msgr2=0x561c003dce90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:47:40.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.221+0000 7f0893655b80 1 -- 172.21.15.82:0/1445978241 shutdown_connections 2023-09-23T09:47:40.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.221+0000 7f0893655b80 1 -- 172.21.15.82:0/1445978241 wait complete. 2023-09-23T09:47:40.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.221+0000 7f0893655b80 1 -- start start 2023-09-23T09:47:40.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.222+0000 7f0893655b80 1 Processor -- start 2023-09-23T09:47:40.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.222+0000 7f0893655b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561c003c7c40 0x561c003ca110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:47:40.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.222+0000 7f0893655b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561c003cd380 0x561c003ca650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:47:40.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.222+0000 7f0893655b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c003cdca0 0x561c003c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:47:40.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.222+0000 7f0893655b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c003c9340 con 0x561c003cdca0 2023-09-23T09:47:40.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.222+0000 7f0893655b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c003c94b0 con 0x561c003cd380 2023-09-23T09:47:40.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.222+0000 7f0893655b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c003c9620 con 0x561c003c7c40 2023-09-23T09:47:40.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.222+0000 7f0893655b80 10 client.0 _ll_register_callbacks cb 0x7f0868098b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:47:40.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.222+0000 7f087e39c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c003cdca0 0x561c003c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:47:40.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.222+0000 7f087d39a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561c003cd380 0x561c003ca650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:47:40.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.222+0000 7f087e39c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c003cdca0 0x561c003c8e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43860/0 (socket says 172.21.15.82:43860) 2023-09-23T09:47:40.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.222+0000 7f087e39c700 1 -- 172.21.15.82:0/738160087 learned_addr learned my addr 172.21.15.82:0/738160087 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:47:40.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.222+0000 7f087db9b700 1 --2- 172.21.15.82:0/738160087 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561c003c7c40 0x561c003ca110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:47:40.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.223+0000 7f087e39c700 1 -- 172.21.15.82:0/738160087 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561c003c7c40 msgr2=0x561c003ca110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:47:40.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.223+0000 7f087e39c700 1 --2- 172.21.15.82:0/738160087 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561c003c7c40 0x561c003ca110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:47:40.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.223+0000 7f087e39c700 1 -- 172.21.15.82:0/738160087 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561c003cd380 msgr2=0x561c003ca650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:47:40.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.223+0000 7f087e39c700 1 --2- 172.21.15.82:0/738160087 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561c003cd380 0x561c003ca650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:47:40.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.223+0000 7f087e39c700 1 -- 172.21.15.82:0/738160087 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0870011040 con 0x561c003cdca0 2023-09-23T09:47:40.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.223+0000 7f087e39c700 1 --2- 172.21.15.82:0/738160087 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c003cdca0 0x561c003c8e00 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f08700193f0 tx=0x7f0870019e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2534201a6dba3a2 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:47:40.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.223+0000 7f08617fa700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:47:40.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.223+0000 7f08617fa700 1 -- 172.21.15.82:0/738160087 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f087001bd50 con 0x561c003cdca0 2023-09-23T09:47:40.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.223+0000 7f08617fa700 1 -- 172.21.15.82:0/738160087 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(177..177 src has 1..177) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f0870003a00 con 0x561c003cdca0 2023-09-23T09:47:40.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.223+0000 7f0893655b80 1 -- 172.21.15.82:0/738160087 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561c003ba8b0 con 0x561c003cdca0 2023-09-23T09:47:40.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.224+0000 7f08617fa700 1 -- 172.21.15.82:0/738160087 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=144) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0870003bc0 con 0x561c003cdca0 2023-09-23T09:47:40.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.224+0000 7f0893655b80 10 client.18411 fetch_fsmap learned FSMap version 144 2023-09-23T09:47:40.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.224+0000 7f0893655b80 1 -- 172.21.15.82:0/738160087 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=144,monmap=4+}) v3 -- 0x561c00145de0 con 0x561c003cdca0 2023-09-23T09:47:40.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.224+0000 7f08617fa700 1 -- 172.21.15.82:0/738160087 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x561c003ba8b0 con 0x561c003cdca0 2023-09-23T09:47:40.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.224+0000 7f08617fa700 1 -- 172.21.15.82:0/738160087 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 144) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f087002d470 con 0x561c003cdca0 2023-09-23T09:47:40.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.224+0000 7f0893655b80 10 client.18411 fetch_fsmap finished waiting for FSMap version 144 2023-09-23T09:47:40.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.224+0000 7f0893655b80 10 client.18411 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:47:40.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.224+0000 7f0893655b80 20 client.18411 populate_metadata read hostname 'smithi082' 2023-09-23T09:47:40.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.224+0000 7f0893655b80 1 --2- 172.21.15.82:0/738160087 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x561c004364d0 0x561c004388f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:47:40.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.224+0000 7f0893655b80 4 client.18411 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:47:40.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.224+0000 7f0893655b80 1 -- 172.21.15.82:0/738160087 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x561c00312970 con 0x561c004364d0 2023-09-23T09:47:40.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.224+0000 7f087db9b700 1 --2- 172.21.15.82:0/738160087 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x561c004364d0 0x561c004388f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:47:40.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.225+0000 7f08617fa700 10 client.18411 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:47:40.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.225+0000 7f087db9b700 1 --2- 172.21.15.82:0/738160087 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x561c004364d0 0x561c004388f0 crc :-1 s=READY pgs=300 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d4206ae5e82f242 server_cookie=8c49306400ed8459 in_seq=0 out_seq=0 2023-09-23T09:47:40.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.225+0000 7f08617fa700 1 -- 172.21.15.82:0/738160087 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x561c00312970 con 0x561c004364d0 2023-09-23T09:47:40.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.225+0000 7f08617fa700 10 client.18411 handle_command_reply: tid=0 2023-09-23T09:47:40.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.225+0000 7f0893655b80 1 client.18411 shutdown 2023-09-23T09:47:40.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.225+0000 7f0893655b80 1 -- 172.21.15.82:0/738160087 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c003cdca0 msgr2=0x561c003c8e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:47:40.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.225+0000 7f0893655b80 1 --2- 172.21.15.82:0/738160087 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c003cdca0 0x561c003c8e00 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f08700193f0 tx=0x7f0870019e00 comp rx=0 tx=0).stop 2023-09-23T09:47:40.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.225+0000 7f0893655b80 1 -- 172.21.15.82:0/738160087 shutdown_connections 2023-09-23T09:47:40.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.225+0000 7f0893655b80 1 --2- 172.21.15.82:0/738160087 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x561c004364d0 0x561c004388f0 crc :-1 s=READY pgs=300 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:47:40.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.225+0000 7f0893655b80 1 --2- 172.21.15.82:0/738160087 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c003cdca0 0x561c003c8e00 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:47:40.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.225+0000 7f0893655b80 1 --2- 172.21.15.82:0/738160087 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x561c003c7c40 0x561c003ca110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:47:40.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.225+0000 7f0893655b80 1 --2- 172.21.15.82:0/738160087 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561c003cd380 0x561c003ca650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:47:40.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.225+0000 7f08617fa700 0 client.18411 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:47:40.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.225+0000 7f0893655b80 1 -- 172.21.15.82:0/738160087 >> 172.21.15.82:0/738160087 conn(0x561c0033c0e0 msgr2=0x561c003cb050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:47:40.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.226+0000 7f0893655b80 1 -- 172.21.15.82:0/738160087 shutdown_connections 2023-09-23T09:47:40.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.226+0000 7f0893655b80 1 -- 172.21.15.82:0/738160087 wait complete. 2023-09-23T09:47:40.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.226+0000 7f0893655b80 20 client.18411 trim_cache size 0 max 16384 2023-09-23T09:47:40.235 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:47:40.235 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-23T09:47:40.235 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:47:40.235 INFO:teuthology.orchestra.run.smithi082.stdout: "d9e62ab8-1468-4fb0-a9fe-61bed13e954b": { 2023-09-23T09:47:40.235 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:47:40.235 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "d9e62ab8-1468-4fb0-a9fe-61bed13e954b", 2023-09-23T09:47:40.236 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:47:40.236 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:47:40.236 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:47:40.236 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:47:40.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.226+0000 7f087fdff700 1 -- 172.21.15.82:0/2533135100 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f08640a00c0 msgr2=0x7f08640a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:47:40.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.226+0000 7f087fdff700 1 --2- 172.21.15.82:0/2533135100 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f08640a00c0 0x7f08640a2580 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f0870019a50 tx=0x7f087000d000 comp rx=0 tx=0).stop 2023-09-23T09:47:40.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.226+0000 7f087fdff700 1 -- 172.21.15.82:0/2533135100 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0878101230 msgr2=0x7f0878073160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:47:40.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.226+0000 7f087fdff700 1 --2- 172.21.15.82:0/2533135100 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0878101230 0x7f0878073160 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f086800e9a0 tx=0x7f086800ecb0 comp rx=0 tx=0).stop 2023-09-23T09:47:40.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.226+0000 7f087fdff700 1 -- 172.21.15.82:0/2533135100 shutdown_connections 2023-09-23T09:47:40.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.226+0000 7f087fdff700 1 --2- 172.21.15.82:0/2533135100 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f08640a00c0 0x7f08640a2580 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:47:40.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.226+0000 7f087fdff700 1 --2- 172.21.15.82:0/2533135100 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0878106880 0x7f08781a4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:47:40.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.226+0000 7f087fdff700 1 --2- 172.21.15.82:0/2533135100 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0878100870 0x7f0878072c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:47:40.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.226+0000 7f087fdff700 1 --2- 172.21.15.82:0/2533135100 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0878101230 0x7f0878073160 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:47:40.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.226+0000 7f087fdff700 1 -- 172.21.15.82:0/2533135100 >> 172.21.15.82:0/2533135100 conn(0x7f08780fc3a0 msgr2=0x7f08780fca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:47:40.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.227+0000 7f087fdff700 1 -- 172.21.15.82:0/2533135100 shutdown_connections 2023-09-23T09:47:40.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:47:40.227+0000 7f087fdff700 1 -- 172.21.15.82:0/2533135100 wait complete. 2023-09-23T09:47:40.246 INFO:tasks.cephfs.filesystem:scrub status for tag:d9e62ab8-1468-4fb0-a9fe-61bed13e954b - {'path': '/', 'tag': 'd9e62ab8-1468-4fb0-a9fe-61bed13e954b', 'options': 'recursive,force'} 2023-09-23T09:47:41.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:47:41 smithi082 ceph-mon[97694]: pgmap v1614: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-09-23T09:47:41.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:47:41 smithi161 ceph-mon[99580]: pgmap v1614: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-09-23T09:47:41.560 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:47:41 smithi135 ceph-mon[99205]: pgmap v1614: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-09-23T09:47:43.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:47:43 smithi082 ceph-mon[97694]: pgmap v1615: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-09-23T09:47:43.396 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:47:43 smithi161 ceph-mon[99580]: pgmap v1615: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-09-23T09:47:43.560 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:47:43 smithi135 ceph-mon[99205]: pgmap v1615: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-09-23T09:47:45.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:47:45 smithi082 ceph-mon[97694]: pgmap v1616: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-09-23T09:47:45.396 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:47:45 smithi161 ceph-mon[99580]: pgmap v1616: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-09-23T09:47:45.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:47:45 smithi135 ceph-mon[99205]: pgmap v1616: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-09-23T09:47:47.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:47:47 smithi082 ceph-mon[97694]: pgmap v1617: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-09-23T09:47:47.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:47:47 smithi161 ceph-mon[99580]: pgmap v1617: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-09-23T09:47:47.560 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:47:47 smithi135 ceph-mon[99205]: pgmap v1617: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-09-23T09:47:48.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:47:48 smithi135 ceph-mon[99205]: pgmap v1618: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-09-23T09:47:48.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:47:48 smithi082 ceph-mon[97694]: pgmap v1618: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-09-23T09:47:48.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:47:48 smithi161 ceph-mon[99580]: pgmap v1618: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-09-23T09:47:51.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:47:51 smithi135 ceph-mon[99205]: pgmap v1619: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-09-23T09:47:51.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:47:51 smithi082 ceph-mon[97694]: pgmap v1619: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-09-23T09:47:51.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:47:51 smithi161 ceph-mon[99580]: pgmap v1619: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-09-23T09:47:53.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:47:53 smithi135 ceph-mon[99205]: pgmap v1620: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-09-23T09:47:53.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:47:53 smithi082 ceph-mon[97694]: pgmap v1620: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-09-23T09:47:53.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:47:53 smithi161 ceph-mon[99580]: pgmap v1620: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-09-23T09:47:55.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:47:55 smithi082 ceph-mon[97694]: pgmap v1621: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-09-23T09:47:55.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:47:55 smithi161 ceph-mon[99580]: pgmap v1621: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-09-23T09:47:55.560 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:47:55 smithi135 ceph-mon[99205]: pgmap v1621: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-09-23T09:47:57.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:47:57 smithi082 ceph-mon[97694]: pgmap v1622: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-09-23T09:47:57.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:47:57 smithi161 ceph-mon[99580]: pgmap v1622: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-09-23T09:47:57.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:47:57 smithi135 ceph-mon[99205]: pgmap v1622: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-09-23T09:47:58.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:47:58 smithi135 ceph-mon[99205]: pgmap v1623: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-09-23T09:47:58.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:47:58 smithi082 ceph-mon[97694]: pgmap v1623: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-09-23T09:47:58.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:47:58 smithi161 ceph-mon[99580]: pgmap v1623: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-09-23T09:48:00.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:47:59 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:48:00.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:47:59 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:48:00.147 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:47:59 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:48:01.060 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:48:00 smithi135 ceph-mon[99205]: pgmap v1624: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-09-23T09:48:01.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:48:00 smithi082 ceph-mon[97694]: pgmap v1624: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-09-23T09:48:01.146 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:48:00 smithi161 ceph-mon[99580]: pgmap v1624: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-09-23T09:48:03.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:48:03 smithi082 ceph-mon[97694]: pgmap v1625: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 938 B/s wr, 11 op/s 2023-09-23T09:48:03.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:48:03 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:48:03.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:48:03 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:48:03.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:48:03 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:48:03.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:48:03 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:48:03.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:48:03 smithi161 ceph-mon[99580]: pgmap v1625: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 938 B/s wr, 11 op/s 2023-09-23T09:48:03.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:48:03 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:48:03.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:48:03 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:48:03.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:48:03 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:48:03.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:48:03 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:48:03.560 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:48:03 smithi135 ceph-mon[99205]: pgmap v1625: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 938 B/s wr, 11 op/s 2023-09-23T09:48:03.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:48:03 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:48:03.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:48:03 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:48:03.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:48:03 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:48:03.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:48:03 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:48:05.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:48:05 smithi082 ceph-mon[97694]: pgmap v1626: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 938 B/s wr, 8 op/s 2023-09-23T09:48:05.396 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:48:05 smithi161 ceph-mon[99580]: pgmap v1626: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 938 B/s wr, 8 op/s 2023-09-23T09:48:05.560 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:48:05 smithi135 ceph-mon[99205]: pgmap v1626: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 938 B/s wr, 8 op/s 2023-09-23T09:48:07.374 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:48:07 smithi082 ceph-mon[97694]: pgmap v1627: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 26 op/s 2023-09-23T09:48:07.400 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:48:07 smithi161 ceph-mon[99580]: pgmap v1627: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 26 op/s 2023-09-23T09:48:07.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:48:07 smithi135 ceph-mon[99205]: pgmap v1627: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 26 op/s 2023-09-23T09:48:08.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:48:08 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:48:08.398 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:48:08 smithi161 ceph-mon[99580]: osdmap e178: 12 total, 12 up, 12 in 2023-09-23T09:48:08.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:48:08 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:48:08.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:48:08 smithi135 ceph-mon[99205]: osdmap e178: 12 total, 12 up, 12 in 2023-09-23T09:48:08.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:48:08 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:48:08.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:48:08 smithi082 ceph-mon[97694]: osdmap e178: 12 total, 12 up, 12 in 2023-09-23T09:48:09.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:48:09 smithi161 ceph-mon[99580]: pgmap v1629: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-09-23T09:48:09.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:48:09 smithi135 ceph-mon[99205]: pgmap v1629: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-09-23T09:48:09.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:48:09 smithi082 ceph-mon[97694]: pgmap v1629: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-09-23T09:48:10.248 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:48:10.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.473+0000 7efdb639d700 1 -- 172.21.15.82:0/4019840237 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efdb010c0a0 msgr2=0x7efdb0113c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:48:10.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.473+0000 7efdb639d700 1 --2- 172.21.15.82:0/4019840237 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efdb010c0a0 0x7efdb0113c20 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7efda800b0a0 tx=0x7efda800b3b0 comp rx=0 tx=0).stop 2023-09-23T09:48:10.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.473+0000 7efdb639d700 1 -- 172.21.15.82:0/4019840237 shutdown_connections 2023-09-23T09:48:10.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.473+0000 7efdb639d700 1 --2- 172.21.15.82:0/4019840237 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efdb010c0a0 0x7efdb0113c20 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:10.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.473+0000 7efdb639d700 1 --2- 172.21.15.82:0/4019840237 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efdb0106f90 0x7efdb0107370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:10.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.473+0000 7efdb639d700 1 --2- 172.21.15.82:0/4019840237 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdb0107940 0x7efdb010b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:10.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.473+0000 7efdb639d700 1 -- 172.21.15.82:0/4019840237 >> 172.21.15.82:0/4019840237 conn(0x7efdb00764c0 msgr2=0x7efdb00788e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:48:10.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.474+0000 7efdb639d700 1 -- 172.21.15.82:0/4019840237 shutdown_connections 2023-09-23T09:48:10.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.474+0000 7efdb639d700 1 -- 172.21.15.82:0/4019840237 wait complete. 2023-09-23T09:48:10.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.475+0000 7efdb639d700 1 Processor -- start 2023-09-23T09:48:10.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.475+0000 7efdb639d700 1 -- start start 2023-09-23T09:48:10.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.476+0000 7efdb639d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdb0106f90 0x7efdb019cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:48:10.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.476+0000 7efdb639d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efdb010c0a0 0x7efdb019d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:48:10.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.476+0000 7efdb639d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efdb01a16d0 0x7efdb01a1b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:48:10.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.476+0000 7efdb639d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb01a2150 con 0x7efdb01a16d0 2023-09-23T09:48:10.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.476+0000 7efdb639d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb01a22c0 con 0x7efdb0106f90 2023-09-23T09:48:10.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.476+0000 7efdb639d700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb01a2480 con 0x7efdb010c0a0 2023-09-23T09:48:10.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.476+0000 7efdb539b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdb0106f90 0x7efdb019cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:48:10.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.476+0000 7efdb539b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdb0106f90 0x7efdb019cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:53552/0 (socket says 172.21.15.82:53552) 2023-09-23T09:48:10.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.476+0000 7efdb539b700 1 -- 172.21.15.82:0/250963314 learned_addr learned my addr 172.21.15.82:0/250963314 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:48:10.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.476+0000 7efdb4b9a700 1 --2- 172.21.15.82:0/250963314 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efdb010c0a0 0x7efdb019d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:48:10.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.476+0000 7efdb5b9c700 1 --2- 172.21.15.82:0/250963314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efdb01a16d0 0x7efdb01a1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:48:10.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.476+0000 7efdb4b9a700 1 -- 172.21.15.82:0/250963314 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdb0106f90 msgr2=0x7efdb019cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:48:10.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.476+0000 7efdb4b9a700 1 --2- 172.21.15.82:0/250963314 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdb0106f90 0x7efdb019cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:10.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.476+0000 7efdb4b9a700 1 -- 172.21.15.82:0/250963314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efdb01a16d0 msgr2=0x7efdb01a1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:48:10.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.476+0000 7efdb4b9a700 1 --2- 172.21.15.82:0/250963314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efdb01a16d0 0x7efdb01a1b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:10.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.476+0000 7efdb4b9a700 1 -- 172.21.15.82:0/250963314 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efda8009d00 con 0x7efdb010c0a0 2023-09-23T09:48:10.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.476+0000 7efdb539b700 1 --2- 172.21.15.82:0/250963314 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdb0106f90 0x7efdb019cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:48:10.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.476+0000 7efdb5b9c700 1 --2- 172.21.15.82:0/250963314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efdb01a16d0 0x7efdb01a1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:48:10.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.477+0000 7efdb4b9a700 1 --2- 172.21.15.82:0/250963314 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efdb010c0a0 0x7efdb019d270 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7efda000e9c0 tx=0x7efda000ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:48:10.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.477+0000 7efda67fc700 1 -- 172.21.15.82:0/250963314 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda000c9c0 con 0x7efdb010c0a0 2023-09-23T09:48:10.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.477+0000 7efdb639d700 1 -- 172.21.15.82:0/250963314 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdb01a99e0 con 0x7efdb010c0a0 2023-09-23T09:48:10.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.477+0000 7efda67fc700 1 -- 172.21.15.82:0/250963314 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efda0010430 con 0x7efdb010c0a0 2023-09-23T09:48:10.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.477+0000 7efda67fc700 1 -- 172.21.15.82:0/250963314 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda0018680 con 0x7efdb010c0a0 2023-09-23T09:48:10.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.477+0000 7efdb639d700 1 -- 172.21.15.82:0/250963314 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdb01a9f10 con 0x7efdb010c0a0 2023-09-23T09:48:10.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.480+0000 7efda67fc700 1 -- 172.21.15.82:0/250963314 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7efda00105a0 con 0x7efdb010c0a0 2023-09-23T09:48:10.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.481+0000 7efdcafc1b80 1 Processor -- start 2023-09-23T09:48:10.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.482+0000 7efda67fc700 1 --2- 172.21.15.82:0/250963314 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7efd9c0a0160 0x7efd9c0a2620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:48:10.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.482+0000 7efdcafc1b80 1 -- start start 2023-09-23T09:48:10.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.482+0000 7efda67fc700 1 -- 172.21.15.82:0/250963314 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 8557+0+0 (secure 0 0 0) 0x7efda0014070 con 0x7efdb010c0a0 2023-09-23T09:48:10.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.482+0000 7efdcafc1b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564b6643a500 0x564b6643a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:48:10.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.482+0000 7efdcafc1b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564b6643ae20 0x564b66434700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:48:10.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.482+0000 7efdcafc1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b66434c40 0x564b66435080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:48:10.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.482+0000 7efdcafc1b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b6639c7b0 con 0x564b66434c40 2023-09-23T09:48:10.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.482+0000 7efdcafc1b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b6638d780 con 0x564b6643a500 2023-09-23T09:48:10.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.482+0000 7efdcafc1b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b6638b0a0 con 0x564b6643ae20 2023-09-23T09:48:10.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.482+0000 7efdb5b9c700 1 --2- 172.21.15.82:0/250963314 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7efd9c0a0160 0x7efd9c0a2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:48:10.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.482+0000 7efdb539b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564b6643a500 0x564b6643a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:48:10.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.483+0000 7efdb539b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564b6643a500 0x564b6643a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:53560/0 (socket says 172.21.15.82:53560) 2023-09-23T09:48:10.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.483+0000 7efdb539b700 1 -- 172.21.15.82:0/2531503035 learned_addr learned my addr 172.21.15.82:0/2531503035 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:48:10.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.483+0000 7efdb4b9a700 1 --2- 172.21.15.82:0/2531503035 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564b6643ae20 0x564b66434700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:48:10.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.483+0000 7efdb5b9c700 1 --2- 172.21.15.82:0/2531503035 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b66434c40 0x564b66435080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:48:10.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.483+0000 7efdb4b9a700 1 -- 172.21.15.82:0/2531503035 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564b6643a500 msgr2=0x564b6643a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:48:10.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.483+0000 7efdb4b9a700 1 --2- 172.21.15.82:0/2531503035 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564b6643a500 0x564b6643a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:10.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.483+0000 7efdb4b9a700 1 -- 172.21.15.82:0/2531503035 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b66434c40 msgr2=0x564b66435080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:48:10.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.483+0000 7efdb4b9a700 1 --2- 172.21.15.82:0/2531503035 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b66434c40 0x564b66435080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:10.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.483+0000 7efdb4b9a700 1 -- 172.21.15.82:0/2531503035 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564b66206630 con 0x564b6643ae20 2023-09-23T09:48:10.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.483+0000 7efdb5b9c700 1 --2- 172.21.15.82:0/250963314 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7efd9c0a0160 0x7efd9c0a2620 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7efda8009fd0 tx=0x7efda8009b80 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:48:10.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.483+0000 7efdb4b9a700 1 --2- 172.21.15.82:0/2531503035 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564b6643ae20 0x564b66434700 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7efda00c8e20 tx=0x7efda0098740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=898ff7a16f5791d5 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:48:10.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.483+0000 7efd9b7fe700 1 -- 172.21.15.82:0/2531503035 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda009cc10 con 0x564b6643ae20 2023-09-23T09:48:10.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.484+0000 7efd9b7fe700 1 -- 172.21.15.82:0/2531503035 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efda00a0bf0 con 0x564b6643ae20 2023-09-23T09:48:10.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.484+0000 7efd9b7fe700 1 -- 172.21.15.82:0/2531503035 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda00992a0 con 0x564b6643ae20 2023-09-23T09:48:10.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.484+0000 7efdcafc1b80 1 -- 172.21.15.82:0/2531503035 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564b6643ae20 msgr2=0x564b66434700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:48:10.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.484+0000 7efdcafc1b80 1 --2- 172.21.15.82:0/2531503035 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564b6643ae20 0x564b66434700 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7efda00c8e20 tx=0x7efda0098740 comp rx=0 tx=0).stop 2023-09-23T09:48:10.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.484+0000 7efdcafc1b80 1 -- 172.21.15.82:0/2531503035 shutdown_connections 2023-09-23T09:48:10.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.484+0000 7efdcafc1b80 1 --2- 172.21.15.82:0/2531503035 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b66434c40 0x564b66435080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:10.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.484+0000 7efdcafc1b80 1 --2- 172.21.15.82:0/2531503035 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564b6643a500 0x564b6643a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:10.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.484+0000 7efdcafc1b80 1 --2- 172.21.15.82:0/2531503035 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564b6643ae20 0x564b66434700 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:10.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.484+0000 7efdcafc1b80 1 -- 172.21.15.82:0/2531503035 >> 172.21.15.82:0/2531503035 conn(0x564b663a90e0 msgr2=0x564b6642f940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:48:10.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.484+0000 7efdcafc1b80 1 -- 172.21.15.82:0/2531503035 shutdown_connections 2023-09-23T09:48:10.490 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.485+0000 7efdcafc1b80 1 -- 172.21.15.82:0/2531503035 wait complete. 2023-09-23T09:48:10.490 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.485+0000 7efdcafc1b80 1 -- start start 2023-09-23T09:48:10.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.485+0000 7efdcafc1b80 1 Processor -- start 2023-09-23T09:48:10.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.486+0000 7efdcafc1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b66434c40 0x564b6643e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:48:10.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.486+0000 7efdcafc1b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564b6643a500 0x564b6643e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:48:10.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.486+0000 7efdcafc1b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564b6643ae20 0x564b6643ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:48:10.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.486+0000 7efdcafc1b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b66386990 con 0x564b66434c40 2023-09-23T09:48:10.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.486+0000 7efdcafc1b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b66324bb0 con 0x564b6643a500 2023-09-23T09:48:10.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.486+0000 7efdcafc1b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b663248b0 con 0x564b6643ae20 2023-09-23T09:48:10.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.486+0000 7efdcafc1b80 10 client.0 _ll_register_callbacks cb 0x564b6626ea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:48:10.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.486+0000 7efdb539b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b66434c40 0x564b6643e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:48:10.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.487+0000 7efdb4b9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564b6643a500 0x564b6643e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:48:10.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.487+0000 7efdb539b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b66434c40 0x564b6643e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:32776/0 (socket says 172.21.15.82:32776) 2023-09-23T09:48:10.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.487+0000 7efdb539b700 1 -- 172.21.15.82:0/235454878 learned_addr learned my addr 172.21.15.82:0/235454878 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:48:10.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.487+0000 7efdb5b9c700 1 --2- 172.21.15.82:0/235454878 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564b6643ae20 0x564b6643ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:48:10.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.487+0000 7efdb539b700 1 -- 172.21.15.82:0/235454878 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564b6643ae20 msgr2=0x564b6643ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:48:10.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.487+0000 7efdb539b700 1 --2- 172.21.15.82:0/235454878 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564b6643ae20 0x564b6643ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:10.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.487+0000 7efdb539b700 1 -- 172.21.15.82:0/235454878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564b6643a500 msgr2=0x564b6643e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:48:10.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.487+0000 7efdb539b700 1 --2- 172.21.15.82:0/235454878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564b6643a500 0x564b6643e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:10.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.487+0000 7efdb539b700 1 -- 172.21.15.82:0/235454878 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdb01a9f10 con 0x564b66434c40 2023-09-23T09:48:10.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.487+0000 7efdb4b9a700 1 --2- 172.21.15.82:0/235454878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564b6643a500 0x564b6643e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:48:10.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.487+0000 7efdb539b700 1 --2- 172.21.15.82:0/235454878 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b66434c40 0x564b6643e130 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7efdac012d10 tx=0x7efdac00f6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c69011be9ebcf8bb server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:48:10.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.487+0000 7efd98ff9700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:48:10.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.487+0000 7efd98ff9700 1 -- 172.21.15.82:0/235454878 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdac017070 con 0x564b66434c40 2023-09-23T09:48:10.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.487+0000 7efdcafc1b80 1 -- 172.21.15.82:0/235454878 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564b664041c0 con 0x564b66434c40 2023-09-23T09:48:10.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.487+0000 7efd98ff9700 1 -- 172.21.15.82:0/235454878 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(178..178 src has 1..178) v4 ==== 8557+0+0 (secure 0 0 0) 0x7efdac00fb20 con 0x564b66434c40 2023-09-23T09:48:10.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.488+0000 7efd98ff9700 1 -- 172.21.15.82:0/235454878 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=146) v2 ==== 24+0+0 (secure 0 0 0) 0x7efdac00fce0 con 0x564b66434c40 2023-09-23T09:48:10.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.488+0000 7efdcafc1b80 10 client.18423 fetch_fsmap learned FSMap version 146 2023-09-23T09:48:10.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.488+0000 7efdcafc1b80 1 -- 172.21.15.82:0/235454878 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=146,monmap=4+}) v3 -- 0x564b661b2de0 con 0x564b66434c40 2023-09-23T09:48:10.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.488+0000 7efd98ff9700 1 -- 172.21.15.82:0/235454878 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x564b664041c0 con 0x564b66434c40 2023-09-23T09:48:10.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.488+0000 7efd98ff9700 1 -- 172.21.15.82:0/235454878 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 146) v1 ==== 7890+0+0 (secure 0 0 0) 0x7efdac003a20 con 0x564b66434c40 2023-09-23T09:48:10.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.488+0000 7efdcafc1b80 10 client.18423 fetch_fsmap finished waiting for FSMap version 146 2023-09-23T09:48:10.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.488+0000 7efdcafc1b80 10 client.18423 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:48:10.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.488+0000 7efdcafc1b80 20 client.18423 populate_metadata read hostname 'smithi082' 2023-09-23T09:48:10.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.488+0000 7efdcafc1b80 1 --2- 172.21.15.82:0/235454878 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x564b6644e980 0x564b66450da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:48:10.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.488+0000 7efdcafc1b80 4 client.18423 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:48:10.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.488+0000 7efdcafc1b80 1 -- 172.21.15.82:0/235454878 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564b6632cba0 con 0x564b6644e980 2023-09-23T09:48:10.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.489+0000 7efdb4b9a700 1 --2- 172.21.15.82:0/235454878 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x564b6644e980 0x564b66450da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:48:10.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.489+0000 7efdb4b9a700 1 --2- 172.21.15.82:0/235454878 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x564b6644e980 0x564b66450da0 crc :-1 s=READY pgs=301 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=958d6f3a9ad0820 server_cookie=ea8c44161366b315 in_seq=0 out_seq=0 2023-09-23T09:48:10.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.489+0000 7efd98ff9700 10 client.18423 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:48:10.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.490+0000 7efd98ff9700 1 -- 172.21.15.82:0/235454878 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x564b6632cba0 con 0x564b6644e980 2023-09-23T09:48:10.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.490+0000 7efd98ff9700 10 client.18423 handle_command_reply: tid=0 2023-09-23T09:48:10.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.490+0000 7efdcafc1b80 1 client.18423 shutdown 2023-09-23T09:48:10.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.490+0000 7efdcafc1b80 1 -- 172.21.15.82:0/235454878 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b66434c40 msgr2=0x564b6643e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:48:10.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.490+0000 7efdcafc1b80 1 --2- 172.21.15.82:0/235454878 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b66434c40 0x564b6643e130 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7efdac012d10 tx=0x7efdac00f6a0 comp rx=0 tx=0).stop 2023-09-23T09:48:10.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.490+0000 7efdcafc1b80 1 -- 172.21.15.82:0/235454878 shutdown_connections 2023-09-23T09:48:10.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.490+0000 7efdcafc1b80 1 --2- 172.21.15.82:0/235454878 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564b6643ae20 0x564b6643ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:10.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.490+0000 7efdcafc1b80 1 --2- 172.21.15.82:0/235454878 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x564b6644e980 0x564b66450da0 crc :-1 s=READY pgs=301 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:10.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.490+0000 7efdcafc1b80 1 --2- 172.21.15.82:0/235454878 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b66434c40 0x564b6643e130 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:10.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.490+0000 7efdcafc1b80 1 --2- 172.21.15.82:0/235454878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564b6643a500 0x564b6643e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:10.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.491+0000 7efdcafc1b80 1 -- 172.21.15.82:0/235454878 >> 172.21.15.82:0/235454878 conn(0x564b663a90e0 msgr2=0x564b664336f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:48:10.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.491+0000 7efd98ff9700 0 client.18423 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:48:10.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.491+0000 7efdcafc1b80 1 -- 172.21.15.82:0/235454878 shutdown_connections 2023-09-23T09:48:10.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.491+0000 7efdcafc1b80 1 -- 172.21.15.82:0/235454878 wait complete. 2023-09-23T09:48:10.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.491+0000 7efdcafc1b80 20 client.18423 trim_cache size 0 max 16384 2023-09-23T09:48:10.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.508+0000 7efdcafc1b80 1 Processor -- start 2023-09-23T09:48:10.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.508+0000 7efdcafc1b80 1 -- start start 2023-09-23T09:48:10.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.508+0000 7efdcafc1b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564b66434c40 0x564b66434700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:48:10.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.509+0000 7efdcafc1b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564b6643a500 0x564b66438800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:48:10.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.509+0000 7efdcafc1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b6643ae20 0x564b664398a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:48:10.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.509+0000 7efdcafc1b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b66208920 con 0x564b6643ae20 2023-09-23T09:48:10.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.509+0000 7efdcafc1b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b66435750 con 0x564b66434c40 2023-09-23T09:48:10.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.509+0000 7efdcafc1b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b66430580 con 0x564b6643a500 2023-09-23T09:48:10.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.509+0000 7efdb5b9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b6643ae20 0x564b664398a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:48:10.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.509+0000 7efdb539b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564b66434c40 0x564b66434700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:48:10.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.509+0000 7efdb5b9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b6643ae20 0x564b664398a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:32782/0 (socket says 172.21.15.82:32782) 2023-09-23T09:48:10.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.509+0000 7efdb5b9c700 1 -- 172.21.15.82:0/2572635849 learned_addr learned my addr 172.21.15.82:0/2572635849 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:48:10.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.509+0000 7efdb4b9a700 1 --2- 172.21.15.82:0/2572635849 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564b6643a500 0x564b66438800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:48:10.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.509+0000 7efdb5b9c700 1 -- 172.21.15.82:0/2572635849 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564b6643a500 msgr2=0x564b66438800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:48:10.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.509+0000 7efdb5b9c700 1 --2- 172.21.15.82:0/2572635849 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564b6643a500 0x564b66438800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:10.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.509+0000 7efdb5b9c700 1 -- 172.21.15.82:0/2572635849 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564b66434c40 msgr2=0x564b66434700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:48:10.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.509+0000 7efdb5b9c700 1 --2- 172.21.15.82:0/2572635849 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564b66434c40 0x564b66434700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:10.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.509+0000 7efdb5b9c700 1 -- 172.21.15.82:0/2572635849 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564b664559f0 con 0x564b6643ae20 2023-09-23T09:48:10.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.509+0000 7efdb5b9c700 1 --2- 172.21.15.82:0/2572635849 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b6643ae20 0x564b664398a0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7efda8007d80 tx=0x7efda8020040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ed0bc8638d1c0d4 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:48:10.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.510+0000 7efd9bfff700 1 -- 172.21.15.82:0/2572635849 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda800e040 con 0x564b6643ae20 2023-09-23T09:48:10.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.510+0000 7efd9bfff700 1 -- 172.21.15.82:0/2572635849 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efda8006060 con 0x564b6643ae20 2023-09-23T09:48:10.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.510+0000 7efd9bfff700 1 -- 172.21.15.82:0/2572635849 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda8005060 con 0x564b6643ae20 2023-09-23T09:48:10.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.510+0000 7efdcafc1b80 1 -- 172.21.15.82:0/2572635849 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b6643ae20 msgr2=0x564b664398a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:48:10.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.510+0000 7efdcafc1b80 1 --2- 172.21.15.82:0/2572635849 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b6643ae20 0x564b664398a0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7efda8007d80 tx=0x7efda8020040 comp rx=0 tx=0).stop 2023-09-23T09:48:10.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.511+0000 7efdcafc1b80 1 -- 172.21.15.82:0/2572635849 shutdown_connections 2023-09-23T09:48:10.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.511+0000 7efdcafc1b80 1 --2- 172.21.15.82:0/2572635849 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b6643ae20 0x564b664398a0 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:10.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.511+0000 7efdcafc1b80 1 --2- 172.21.15.82:0/2572635849 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564b66434c40 0x564b66434700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:10.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.511+0000 7efdcafc1b80 1 --2- 172.21.15.82:0/2572635849 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564b6643a500 0x564b66438800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:10.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.511+0000 7efdcafc1b80 1 -- 172.21.15.82:0/2572635849 >> 172.21.15.82:0/2572635849 conn(0x564b663a90e0 msgr2=0x564b66439190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:48:10.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.511+0000 7efdcafc1b80 1 -- 172.21.15.82:0/2572635849 shutdown_connections 2023-09-23T09:48:10.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.511+0000 7efdcafc1b80 1 -- 172.21.15.82:0/2572635849 wait complete. 2023-09-23T09:48:10.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.511+0000 7efdcafc1b80 1 -- start start 2023-09-23T09:48:10.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.511+0000 7efdcafc1b80 1 Processor -- start 2023-09-23T09:48:10.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.512+0000 7efdcafc1b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564b66434c40 0x564b664431b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:48:10.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.512+0000 7efdcafc1b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564b6643a500 0x564b664436f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:48:10.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.512+0000 7efdcafc1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b6643ae20 0x564b66443c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:48:10.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.512+0000 7efdcafc1b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b664a1900 con 0x564b6643ae20 2023-09-23T09:48:10.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.512+0000 7efdcafc1b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b664a1a70 con 0x564b6643a500 2023-09-23T09:48:10.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.512+0000 7efdcafc1b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b664a1c30 con 0x564b66434c40 2023-09-23T09:48:10.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.512+0000 7efdcafc1b80 10 client.0 _ll_register_callbacks cb 0x7efdac012810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:48:10.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.512+0000 7efdb5b9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b6643ae20 0x564b66443c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:48:10.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.512+0000 7efdb5b9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b6643ae20 0x564b66443c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:32792/0 (socket says 172.21.15.82:32792) 2023-09-23T09:48:10.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.512+0000 7efdb5b9c700 1 -- 172.21.15.82:0/611819377 learned_addr learned my addr 172.21.15.82:0/611819377 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:48:10.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.512+0000 7efdb4b9a700 1 --2- 172.21.15.82:0/611819377 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564b6643a500 0x564b664436f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:48:10.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.512+0000 7efdb539b700 1 --2- 172.21.15.82:0/611819377 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564b66434c40 0x564b664431b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:48:10.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.513+0000 7efdb5b9c700 1 -- 172.21.15.82:0/611819377 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564b66434c40 msgr2=0x564b664431b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:48:10.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.513+0000 7efdb5b9c700 1 --2- 172.21.15.82:0/611819377 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564b66434c40 0x564b664431b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:10.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.513+0000 7efdb5b9c700 1 -- 172.21.15.82:0/611819377 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564b6643a500 msgr2=0x564b664436f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:48:10.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.513+0000 7efdb5b9c700 1 --2- 172.21.15.82:0/611819377 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564b6643a500 0x564b664436f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:10.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.513+0000 7efdb5b9c700 1 -- 172.21.15.82:0/611819377 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdb0114490 con 0x564b6643ae20 2023-09-23T09:48:10.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.513+0000 7efdb5b9c700 1 --2- 172.21.15.82:0/611819377 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b6643ae20 0x564b66443c30 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7efda80062a0 tx=0x7efda800b3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9a2fa438f30b436 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:48:10.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.513+0000 7efd98ff9700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:48:10.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.513+0000 7efd98ff9700 1 -- 172.21.15.82:0/611819377 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda800e040 con 0x564b6643ae20 2023-09-23T09:48:10.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.513+0000 7efd98ff9700 1 -- 172.21.15.82:0/611819377 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(178..178 src has 1..178) v4 ==== 8557+0+0 (secure 0 0 0) 0x7efda801e660 con 0x564b6643ae20 2023-09-23T09:48:10.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.513+0000 7efdcafc1b80 1 -- 172.21.15.82:0/611819377 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564b664278b0 con 0x564b6643ae20 2023-09-23T09:48:10.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.513+0000 7efd98ff9700 1 -- 172.21.15.82:0/611819377 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=146) v2 ==== 24+0+0 (secure 0 0 0) 0x7efda801e820 con 0x564b6643ae20 2023-09-23T09:48:10.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.513+0000 7efdcafc1b80 10 client.18429 fetch_fsmap learned FSMap version 146 2023-09-23T09:48:10.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.514+0000 7efdcafc1b80 1 -- 172.21.15.82:0/611819377 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=146,monmap=4+}) v3 -- 0x564b6619bc60 con 0x564b6643ae20 2023-09-23T09:48:10.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.514+0000 7efd98ff9700 1 -- 172.21.15.82:0/611819377 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efda8047020 con 0x564b6643ae20 2023-09-23T09:48:10.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.514+0000 7efd98ff9700 1 -- 172.21.15.82:0/611819377 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 146) v1 ==== 7890+0+0 (secure 0 0 0) 0x7efda8030030 con 0x564b6643ae20 2023-09-23T09:48:10.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.514+0000 7efdcafc1b80 10 client.18429 fetch_fsmap finished waiting for FSMap version 146 2023-09-23T09:48:10.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.514+0000 7efdcafc1b80 10 client.18429 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:48:10.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.514+0000 7efdcafc1b80 20 client.18429 populate_metadata read hostname 'smithi082' 2023-09-23T09:48:10.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.514+0000 7efdcafc1b80 1 --2- 172.21.15.82:0/611819377 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x564b664a2f30 0x564b664a5320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:48:10.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.514+0000 7efdcafc1b80 4 client.18429 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:48:10.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.514+0000 7efdcafc1b80 1 -- 172.21.15.82:0/611819377 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x564b6637f970 con 0x564b664a2f30 2023-09-23T09:48:10.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.514+0000 7efdb539b700 1 --2- 172.21.15.82:0/611819377 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x564b664a2f30 0x564b664a5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:48:10.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.515+0000 7efdb539b700 1 --2- 172.21.15.82:0/611819377 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x564b664a2f30 0x564b664a5320 crc :-1 s=READY pgs=302 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=840ea60f2b380056 server_cookie=bf8a79a33a48a56d in_seq=0 out_seq=0 2023-09-23T09:48:10.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.515+0000 7efd98ff9700 10 client.18429 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:48:10.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.515+0000 7efd98ff9700 1 -- 172.21.15.82:0/611819377 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x564b6637f970 con 0x564b664a2f30 2023-09-23T09:48:10.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.515+0000 7efd98ff9700 10 client.18429 handle_command_reply: tid=0 2023-09-23T09:48:10.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.515+0000 7efdcafc1b80 1 client.18429 shutdown 2023-09-23T09:48:10.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.515+0000 7efdcafc1b80 1 -- 172.21.15.82:0/611819377 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b6643ae20 msgr2=0x564b66443c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:48:10.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.515+0000 7efdcafc1b80 1 --2- 172.21.15.82:0/611819377 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b6643ae20 0x564b66443c30 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7efda80062a0 tx=0x7efda800b3b0 comp rx=0 tx=0).stop 2023-09-23T09:48:10.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.515+0000 7efdcafc1b80 1 -- 172.21.15.82:0/611819377 shutdown_connections 2023-09-23T09:48:10.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.515+0000 7efdcafc1b80 1 --2- 172.21.15.82:0/611819377 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x564b664a2f30 0x564b664a5320 crc :-1 s=READY pgs=302 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:10.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.515+0000 7efdcafc1b80 1 --2- 172.21.15.82:0/611819377 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b6643ae20 0x564b66443c30 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:10.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.515+0000 7efdcafc1b80 1 --2- 172.21.15.82:0/611819377 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x564b66434c40 0x564b664431b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:10.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.515+0000 7efd98ff9700 0 client.18429 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:48:10.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.515+0000 7efdcafc1b80 1 --2- 172.21.15.82:0/611819377 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564b6643a500 0x564b664436f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:10.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.515+0000 7efdcafc1b80 1 -- 172.21.15.82:0/611819377 >> 172.21.15.82:0/611819377 conn(0x564b663a90e0 msgr2=0x564b6643e8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:48:10.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.515+0000 7efdcafc1b80 1 -- 172.21.15.82:0/611819377 shutdown_connections 2023-09-23T09:48:10.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.515+0000 7efdcafc1b80 1 -- 172.21.15.82:0/611819377 wait complete. 2023-09-23T09:48:10.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.516+0000 7efdcafc1b80 20 client.18429 trim_cache size 0 max 16384 2023-09-23T09:48:10.525 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:48:10.525 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-23T09:48:10.525 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:48:10.525 INFO:teuthology.orchestra.run.smithi082.stdout: "d9e62ab8-1468-4fb0-a9fe-61bed13e954b": { 2023-09-23T09:48:10.525 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:48:10.525 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "d9e62ab8-1468-4fb0-a9fe-61bed13e954b", 2023-09-23T09:48:10.525 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:48:10.525 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:10.525 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:10.526 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:48:10.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.516+0000 7efdb639d700 1 -- 172.21.15.82:0/250963314 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7efd9c0a0160 msgr2=0x7efd9c0a2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:48:10.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.516+0000 7efdb639d700 1 --2- 172.21.15.82:0/250963314 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7efd9c0a0160 0x7efd9c0a2620 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7efda8009fd0 tx=0x7efda8009b80 comp rx=0 tx=0).stop 2023-09-23T09:48:10.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.516+0000 7efdb639d700 1 -- 172.21.15.82:0/250963314 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efdb010c0a0 msgr2=0x7efdb019d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:48:10.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.516+0000 7efdb639d700 1 --2- 172.21.15.82:0/250963314 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efdb010c0a0 0x7efdb019d270 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7efda000e9c0 tx=0x7efda000ecd0 comp rx=0 tx=0).stop 2023-09-23T09:48:10.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.516+0000 7efdb639d700 1 -- 172.21.15.82:0/250963314 shutdown_connections 2023-09-23T09:48:10.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.516+0000 7efdb639d700 1 --2- 172.21.15.82:0/250963314 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7efd9c0a0160 0x7efd9c0a2620 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:10.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.516+0000 7efdb639d700 1 --2- 172.21.15.82:0/250963314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efdb01a16d0 0x7efdb01a1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:10.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.516+0000 7efdb639d700 1 --2- 172.21.15.82:0/250963314 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdb0106f90 0x7efdb019cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:10.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.516+0000 7efdb639d700 1 --2- 172.21.15.82:0/250963314 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efdb010c0a0 0x7efdb019d270 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:10.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.516+0000 7efdb639d700 1 -- 172.21.15.82:0/250963314 >> 172.21.15.82:0/250963314 conn(0x7efdb00764c0 msgr2=0x7efdb0076f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:48:10.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.516+0000 7efdb639d700 1 -- 172.21.15.82:0/250963314 shutdown_connections 2023-09-23T09:48:10.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:10.516+0000 7efdb639d700 1 -- 172.21.15.82:0/250963314 wait complete. 2023-09-23T09:48:10.537 INFO:tasks.cephfs.filesystem:scrub status for tag:d9e62ab8-1468-4fb0-a9fe-61bed13e954b - {'path': '/', 'tag': 'd9e62ab8-1468-4fb0-a9fe-61bed13e954b', 'options': 'recursive,force'} 2023-09-23T09:48:11.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:48:11 smithi161 ceph-mon[99580]: pgmap v1630: 97 pgs: 6 active+clean+snaptrim, 8 active+clean+snaptrim_wait, 83 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-09-23T09:48:11.560 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:48:11 smithi135 ceph-mon[99205]: pgmap v1630: 97 pgs: 6 active+clean+snaptrim, 8 active+clean+snaptrim_wait, 83 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-09-23T09:48:11.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:48:11 smithi082 ceph-mon[97694]: pgmap v1630: 97 pgs: 6 active+clean+snaptrim, 8 active+clean+snaptrim_wait, 83 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-09-23T09:48:13.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:48:13 smithi161 ceph-mon[99580]: pgmap v1631: 97 pgs: 8 active+clean+snaptrim, 14 active+clean+snaptrim_wait, 75 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-09-23T09:48:13.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:48:13 smithi161 ceph-mon[99580]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:48:13.560 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:48:13 smithi135 ceph-mon[99205]: pgmap v1631: 97 pgs: 8 active+clean+snaptrim, 14 active+clean+snaptrim_wait, 75 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-09-23T09:48:13.560 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:48:13 smithi135 ceph-mon[99205]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:48:13.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:48:13 smithi082 ceph-mon[97694]: pgmap v1631: 97 pgs: 8 active+clean+snaptrim, 14 active+clean+snaptrim_wait, 75 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-09-23T09:48:13.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:48:13 smithi082 ceph-mon[97694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-23T09:48:15.560 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:48:15 smithi135 ceph-mon[99205]: pgmap v1632: 97 pgs: 8 active+clean+snaptrim, 14 active+clean+snaptrim_wait, 75 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-09-23T09:48:15.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:48:15 smithi082 ceph-mon[97694]: pgmap v1632: 97 pgs: 8 active+clean+snaptrim, 14 active+clean+snaptrim_wait, 75 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-09-23T09:48:15.646 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:48:15 smithi161 ceph-mon[99580]: pgmap v1632: 97 pgs: 8 active+clean+snaptrim, 14 active+clean+snaptrim_wait, 75 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-09-23T09:48:17.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:48:17 smithi135 ceph-mon[99205]: pgmap v1633: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-09-23T09:48:17.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:48:17 smithi082 ceph-mon[97694]: pgmap v1633: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-09-23T09:48:17.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:48:17 smithi161 ceph-mon[99580]: pgmap v1633: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-09-23T09:48:18.810 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:48:18 smithi135 ceph-mon[99205]: osdmap e179: 12 total, 12 up, 12 in 2023-09-23T09:48:18.810 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:48:18 smithi135 ceph-mon[99205]: pgmap v1635: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-09-23T09:48:18.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:48:18 smithi082 ceph-mon[97694]: osdmap e179: 12 total, 12 up, 12 in 2023-09-23T09:48:18.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:48:18 smithi082 ceph-mon[97694]: pgmap v1635: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-09-23T09:48:18.896 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:48:18 smithi161 ceph-mon[99580]: osdmap e179: 12 total, 12 up, 12 in 2023-09-23T09:48:18.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:48:18 smithi161 ceph-mon[99580]: pgmap v1635: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-09-23T09:48:21.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:48:21 smithi082 ceph-mon[97694]: pgmap v1636: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-09-23T09:48:21.396 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:48:21 smithi161 ceph-mon[99580]: pgmap v1636: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-09-23T09:48:21.560 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:48:21 smithi135 ceph-mon[99205]: pgmap v1636: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-09-23T09:48:23.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:48:23 smithi082 ceph-mon[97694]: pgmap v1637: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-09-23T09:48:23.396 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:48:23 smithi161 ceph-mon[99580]: pgmap v1637: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-09-23T09:48:23.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:48:23 smithi135 ceph-mon[99205]: pgmap v1637: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-09-23T09:48:25.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:48:25 smithi082 ceph-mon[97694]: pgmap v1638: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-09-23T09:48:25.396 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:48:25 smithi161 ceph-mon[99580]: pgmap v1638: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-09-23T09:48:25.560 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:48:25 smithi135 ceph-mon[99205]: pgmap v1638: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-09-23T09:48:27.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:48:27 smithi082 ceph-mon[97694]: pgmap v1639: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-09-23T09:48:27.396 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:48:27 smithi161 ceph-mon[99580]: pgmap v1639: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-09-23T09:48:27.560 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:48:27 smithi135 ceph-mon[99205]: pgmap v1639: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-09-23T09:48:28.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:48:28 smithi135 ceph-mon[99205]: pgmap v1640: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-09-23T09:48:28.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:48:28 smithi082 ceph-mon[97694]: pgmap v1640: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-09-23T09:48:28.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:48:28 smithi161 ceph-mon[99580]: pgmap v1640: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-09-23T09:48:31.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:48:31 smithi082 ceph-mon[97694]: pgmap v1641: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-09-23T09:48:31.396 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:48:31 smithi161 ceph-mon[99580]: pgmap v1641: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-09-23T09:48:31.560 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:48:31 smithi135 ceph-mon[99205]: pgmap v1641: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-09-23T09:48:33.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:48:33 smithi082 ceph-mon[97694]: pgmap v1642: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-09-23T09:48:33.396 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:48:33 smithi161 ceph-mon[99580]: pgmap v1642: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-09-23T09:48:33.560 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:48:33 smithi135 ceph-mon[99205]: pgmap v1642: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-09-23T09:48:35.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:48:35 smithi082 ceph-mon[97694]: pgmap v1643: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-09-23T09:48:35.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:48:35 smithi161 ceph-mon[99580]: pgmap v1643: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-09-23T09:48:35.560 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:48:35 smithi135 ceph-mon[99205]: pgmap v1643: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-09-23T09:48:37.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:48:37 smithi082 ceph-mon[97694]: pgmap v1644: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-09-23T09:48:37.396 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:48:37 smithi161 ceph-mon[99580]: pgmap v1644: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-09-23T09:48:37.560 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:48:37 smithi135 ceph-mon[99205]: pgmap v1644: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-09-23T09:48:38.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:48:38 smithi135 ceph-mon[99205]: pgmap v1645: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-09-23T09:48:38.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:48:38 smithi082 ceph-mon[97694]: pgmap v1645: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-09-23T09:48:38.896 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:48:38 smithi161 ceph-mon[99580]: pgmap v1645: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-09-23T09:48:40.538 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-23T09:48:40.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.746+0000 7f91c33ff700 1 -- 172.21.15.82:0/1374023990 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91bc101250 msgr2=0x7f91bc10d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:48:40.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.746+0000 7f91c33ff700 1 --2- 172.21.15.82:0/1374023990 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91bc101250 0x7f91bc10d760 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f91b400b0a0 tx=0x7f91b400b3b0 comp rx=0 tx=0).stop 2023-09-23T09:48:40.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.746+0000 7f91c33ff700 1 -- 172.21.15.82:0/1374023990 shutdown_connections 2023-09-23T09:48:40.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.746+0000 7f91c33ff700 1 --2- 172.21.15.82:0/1374023990 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91bc101250 0x7f91bc10d760 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:40.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.746+0000 7f91c33ff700 1 --2- 172.21.15.82:0/1374023990 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f91bc1068a0 0x7f91bc106c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:40.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.746+0000 7f91c33ff700 1 --2- 172.21.15.82:0/1374023990 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91bc100890 0x7f91bc100d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:40.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.746+0000 7f91c33ff700 1 -- 172.21.15.82:0/1374023990 >> 172.21.15.82:0/1374023990 conn(0x7f91bc0fc380 msgr2=0x7f91bc0fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:48:40.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.746+0000 7f91c33ff700 1 -- 172.21.15.82:0/1374023990 shutdown_connections 2023-09-23T09:48:40.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.746+0000 7f91c33ff700 1 -- 172.21.15.82:0/1374023990 wait complete. 2023-09-23T09:48:40.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.747+0000 7f91c33ff700 1 Processor -- start 2023-09-23T09:48:40.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.747+0000 7f91c33ff700 1 -- start start 2023-09-23T09:48:40.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.747+0000 7f91c33ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f91bc100890 0x7f91bc19e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:48:40.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.747+0000 7f91c33ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91bc101250 0x7f91bc19ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:48:40.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.747+0000 7f91c33ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91bc1068a0 0x7f91bc198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:48:40.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.747+0000 7f91c33ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91bc198ef0 con 0x7f91bc1068a0 2023-09-23T09:48:40.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.747+0000 7f91c33ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91bc199060 con 0x7f91bc101250 2023-09-23T09:48:40.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.747+0000 7f91c33ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91bc199220 con 0x7f91bc100890 2023-09-23T09:48:40.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.748+0000 7f91c099a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91bc101250 0x7f91bc19ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:48:40.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.748+0000 7f91c099a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91bc101250 0x7f91bc19ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:38086/0 (socket says 172.21.15.82:38086) 2023-09-23T09:48:40.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.748+0000 7f91c099a700 1 -- 172.21.15.82:0/4057946314 learned_addr learned my addr 172.21.15.82:0/4057946314 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:48:40.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.748+0000 7f91c199c700 1 --2- 172.21.15.82:0/4057946314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91bc1068a0 0x7f91bc198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:48:40.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.748+0000 7f91c119b700 1 --2- 172.21.15.82:0/4057946314 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f91bc100890 0x7f91bc19e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:48:40.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.748+0000 7f91c099a700 1 -- 172.21.15.82:0/4057946314 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f91bc100890 msgr2=0x7f91bc19e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:48:40.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.748+0000 7f91c099a700 1 --2- 172.21.15.82:0/4057946314 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f91bc100890 0x7f91bc19e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:40.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.748+0000 7f91c099a700 1 -- 172.21.15.82:0/4057946314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91bc1068a0 msgr2=0x7f91bc198880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:48:40.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.748+0000 7f91c099a700 1 --2- 172.21.15.82:0/4057946314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91bc1068a0 0x7f91bc198880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:40.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.748+0000 7f91c099a700 1 -- 172.21.15.82:0/4057946314 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91b4009d00 con 0x7f91bc101250 2023-09-23T09:48:40.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.748+0000 7f91c199c700 1 --2- 172.21.15.82:0/4057946314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91bc1068a0 0x7f91bc198880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:48:40.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.748+0000 7f91c099a700 1 --2- 172.21.15.82:0/4057946314 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91bc101250 0x7f91bc19ed50 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f91ac00e9a0 tx=0x7f91ac00ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:48:40.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.749+0000 7f91b27fc700 1 -- 172.21.15.82:0/4057946314 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91ac009790 con 0x7f91bc101250 2023-09-23T09:48:40.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.749+0000 7f91c33ff700 1 -- 172.21.15.82:0/4057946314 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91bc199500 con 0x7f91bc101250 2023-09-23T09:48:40.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.749+0000 7f91b27fc700 1 -- 172.21.15.82:0/4057946314 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f91ac010430 con 0x7f91bc101250 2023-09-23T09:48:40.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.749+0000 7f91b27fc700 1 -- 172.21.15.82:0/4057946314 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91ac00cea0 con 0x7f91bc101250 2023-09-23T09:48:40.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.749+0000 7f91c33ff700 1 -- 172.21.15.82:0/4057946314 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91bc1a5800 con 0x7f91bc101250 2023-09-23T09:48:40.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.752+0000 7f91b27fc700 1 -- 172.21.15.82:0/4057946314 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f91ac0105a0 con 0x7f91bc101250 2023-09-23T09:48:40.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.753+0000 7f91d6d96b80 1 Processor -- start 2023-09-23T09:48:40.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.753+0000 7f91d6d96b80 1 -- start start 2023-09-23T09:48:40.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.753+0000 7f91b27fc700 1 --2- 172.21.15.82:0/4057946314 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f91a80a0140 0x7f91a80a2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:48:40.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.753+0000 7f91d6d96b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a8f6d83380 0x55a8f6d83760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:48:40.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.753+0000 7f91d6d96b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a8f6d83ca0 0x55a8f6d7d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:48:40.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.753+0000 7f91b27fc700 1 -- 172.21.15.82:0/4057946314 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f91ac014070 con 0x7f91bc101250 2023-09-23T09:48:40.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.753+0000 7f91d6d96b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a8f6d7dc40 0x55a8f6d7e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:48:40.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.754+0000 7f91d6d96b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8f6ce57b0 con 0x55a8f6d83380 2023-09-23T09:48:40.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.754+0000 7f91d6d96b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8f6cd6780 con 0x55a8f6d83ca0 2023-09-23T09:48:40.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.754+0000 7f91d6d96b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8f6cd40a0 con 0x55a8f6d7dc40 2023-09-23T09:48:40.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.754+0000 7f91c199c700 1 --2- 172.21.15.82:0/4057946314 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f91a80a0140 0x7f91a80a2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:48:40.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.754+0000 7f91c119b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a8f6d83380 0x55a8f6d83760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:48:40.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.754+0000 7f91c099a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a8f6d83ca0 0x55a8f6d7d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:48:40.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.754+0000 7f91c099a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a8f6d83ca0 0x55a8f6d7d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:38100/0 (socket says 172.21.15.82:38100) 2023-09-23T09:48:40.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.754+0000 7f91c099a700 1 -- 172.21.15.82:0/4117301135 learned_addr learned my addr 172.21.15.82:0/4117301135 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:48:40.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.754+0000 7f91c199c700 1 --2- 172.21.15.82:0/4117301135 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a8f6d7dc40 0x55a8f6d7e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:48:40.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.754+0000 7f91c099a700 1 -- 172.21.15.82:0/4117301135 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a8f6d7dc40 msgr2=0x55a8f6d7e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:48:40.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.754+0000 7f91c099a700 1 --2- 172.21.15.82:0/4117301135 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a8f6d7dc40 0x55a8f6d7e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:40.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.754+0000 7f91c099a700 1 -- 172.21.15.82:0/4117301135 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a8f6d83380 msgr2=0x55a8f6d83760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:48:40.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.754+0000 7f91c099a700 1 --2- 172.21.15.82:0/4117301135 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a8f6d83380 0x55a8f6d83760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:40.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.754+0000 7f91c099a700 1 -- 172.21.15.82:0/4117301135 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a8f6b4f630 con 0x55a8f6d83ca0 2023-09-23T09:48:40.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.754+0000 7f91c099a700 1 --2- 172.21.15.82:0/4117301135 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a8f6d83ca0 0x55a8f6d7d700 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f91ac095980 tx=0x7f91ac098b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26164c9a6ba5de87 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:48:40.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.755+0000 7f91c199c700 1 --2- 172.21.15.82:0/4057946314 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f91a80a0140 0x7f91a80a2600 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f91b400b780 tx=0x7f91b400be70 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:48:40.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.755+0000 7f91a77fe700 1 -- 172.21.15.82:0/4117301135 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91ac098f10 con 0x55a8f6d83ca0 2023-09-23T09:48:40.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.755+0000 7f91a77fe700 1 -- 172.21.15.82:0/4117301135 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f91ac09cd40 con 0x55a8f6d83ca0 2023-09-23T09:48:40.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.755+0000 7f91a77fe700 1 -- 172.21.15.82:0/4117301135 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91ac098660 con 0x55a8f6d83ca0 2023-09-23T09:48:40.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.755+0000 7f91d6d96b80 1 -- 172.21.15.82:0/4117301135 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a8f6d83ca0 msgr2=0x55a8f6d7d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:48:40.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.755+0000 7f91d6d96b80 1 --2- 172.21.15.82:0/4117301135 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a8f6d83ca0 0x55a8f6d7d700 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f91ac095980 tx=0x7f91ac098b60 comp rx=0 tx=0).stop 2023-09-23T09:48:40.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.755+0000 7f91d6d96b80 1 -- 172.21.15.82:0/4117301135 shutdown_connections 2023-09-23T09:48:40.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.755+0000 7f91d6d96b80 1 --2- 172.21.15.82:0/4117301135 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a8f6d7dc40 0x55a8f6d7e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:40.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.755+0000 7f91d6d96b80 1 --2- 172.21.15.82:0/4117301135 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a8f6d83380 0x55a8f6d83760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:40.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.755+0000 7f91d6d96b80 1 --2- 172.21.15.82:0/4117301135 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a8f6d83ca0 0x55a8f6d7d700 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:40.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.755+0000 7f91d6d96b80 1 -- 172.21.15.82:0/4117301135 >> 172.21.15.82:0/4117301135 conn(0x55a8f6cf20e0 msgr2=0x55a8f6d78410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:48:40.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.755+0000 7f91d6d96b80 1 -- 172.21.15.82:0/4117301135 shutdown_connections 2023-09-23T09:48:40.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.755+0000 7f91d6d96b80 1 -- 172.21.15.82:0/4117301135 wait complete. 2023-09-23T09:48:40.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.756+0000 7f91d6d96b80 1 -- start start 2023-09-23T09:48:40.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.756+0000 7f91d6d96b80 1 Processor -- start 2023-09-23T09:48:40.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.757+0000 7f91d6d96b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a8f6d7dc40 0x55a8f6d89c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:48:40.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.757+0000 7f91d6d96b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a8f6d83380 0x55a8f6d86f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:48:40.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.757+0000 7f91d6d96b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a8f6d83ca0 0x55a8f6d875c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:48:40.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.757+0000 7f91d6d96b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8f6ccf990 con 0x55a8f6d7dc40 2023-09-23T09:48:40.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.757+0000 7f91d6d96b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8f6c6dbb0 con 0x55a8f6d83380 2023-09-23T09:48:40.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.757+0000 7f91d6d96b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8f6c6d8b0 con 0x55a8f6d83ca0 2023-09-23T09:48:40.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.757+0000 7f91d6d96b80 10 client.0 _ll_register_callbacks cb 0x55a8f6bb7a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:48:40.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.757+0000 7f91c119b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a8f6d7dc40 0x55a8f6d89c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:48:40.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.757+0000 7f91c119b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a8f6d7dc40 0x55a8f6d89c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36308/0 (socket says 172.21.15.82:36308) 2023-09-23T09:48:40.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.757+0000 7f91c119b700 1 -- 172.21.15.82:0/851292043 learned_addr learned my addr 172.21.15.82:0/851292043 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:48:40.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.757+0000 7f91c099a700 1 --2- 172.21.15.82:0/851292043 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a8f6d83380 0x55a8f6d86f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:48:40.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.757+0000 7f91c199c700 1 --2- 172.21.15.82:0/851292043 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a8f6d83ca0 0x55a8f6d875c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:48:40.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.757+0000 7f91c119b700 1 -- 172.21.15.82:0/851292043 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a8f6d83ca0 msgr2=0x55a8f6d875c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:48:40.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.757+0000 7f91c119b700 1 --2- 172.21.15.82:0/851292043 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a8f6d83ca0 0x55a8f6d875c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:40.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.757+0000 7f91c119b700 1 -- 172.21.15.82:0/851292043 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a8f6d83380 msgr2=0x55a8f6d86f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:48:40.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.757+0000 7f91c119b700 1 --2- 172.21.15.82:0/851292043 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a8f6d83380 0x55a8f6d86f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:40.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.757+0000 7f91c119b700 1 -- 172.21.15.82:0/851292043 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91bc1a5800 con 0x55a8f6d7dc40 2023-09-23T09:48:40.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.757+0000 7f91c119b700 1 --2- 172.21.15.82:0/851292043 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a8f6d7dc40 0x55a8f6d89c30 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f91b8007fd0 tx=0x7f91b8011720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=545c3ea016b75761 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:48:40.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.757+0000 7f91a4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:48:40.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.758+0000 7f91a4ff9700 1 -- 172.21.15.82:0/851292043 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b8016070 con 0x55a8f6d7dc40 2023-09-23T09:48:40.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.758+0000 7f91d6d96b80 1 -- 172.21.15.82:0/851292043 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a8f6d4d1c0 con 0x55a8f6d7dc40 2023-09-23T09:48:40.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.758+0000 7f91a4ff9700 1 -- 172.21.15.82:0/851292043 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(179..179 src has 1..179) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f91b8010640 con 0x55a8f6d7dc40 2023-09-23T09:48:40.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.758+0000 7f91a4ff9700 1 -- 172.21.15.82:0/851292043 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=147) v2 ==== 24+0+0 (secure 0 0 0) 0x7f91b8010800 con 0x55a8f6d7dc40 2023-09-23T09:48:40.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.758+0000 7f91d6d96b80 10 client.18441 fetch_fsmap learned FSMap version 147 2023-09-23T09:48:40.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.758+0000 7f91d6d96b80 1 -- 172.21.15.82:0/851292043 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=147,monmap=4+}) v3 -- 0x55a8f6afbde0 con 0x55a8f6d7dc40 2023-09-23T09:48:40.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.758+0000 7f91a4ff9700 1 -- 172.21.15.82:0/851292043 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f91b8027080 con 0x55a8f6d7dc40 2023-09-23T09:48:40.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.758+0000 7f91a4ff9700 1 -- 172.21.15.82:0/851292043 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 147) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f91b8021030 con 0x55a8f6d7dc40 2023-09-23T09:48:40.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.758+0000 7f91d6d96b80 10 client.18441 fetch_fsmap finished waiting for FSMap version 147 2023-09-23T09:48:40.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.758+0000 7f91d6d96b80 10 client.18441 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:48:40.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.759+0000 7f91d6d96b80 20 client.18441 populate_metadata read hostname 'smithi082' 2023-09-23T09:48:40.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.759+0000 7f91d6d96b80 1 --2- 172.21.15.82:0/851292043 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55a8f6d97820 0x55a8f6d99c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:48:40.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.759+0000 7f91d6d96b80 4 client.18441 mds_command: new command op to 24557 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-23T09:48:40.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.759+0000 7f91d6d96b80 1 -- 172.21.15.82:0/851292043 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a8f6c75ba0 con 0x55a8f6d97820 2023-09-23T09:48:40.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.759+0000 7f91c099a700 1 --2- 172.21.15.82:0/851292043 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55a8f6d97820 0x55a8f6d99c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:48:40.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.759+0000 7f91c099a700 1 --2- 172.21.15.82:0/851292043 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55a8f6d97820 0x55a8f6d99c40 crc :-1 s=READY pgs=303 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54a42f607bb570d0 server_cookie=8299dd2cfcaa4784 in_seq=0 out_seq=0 2023-09-23T09:48:40.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.759+0000 7f91a4ff9700 10 client.18441 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:48:40.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.760+0000 7f91a4ff9700 1 -- 172.21.15.82:0/851292043 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a8f6c75ba0 con 0x55a8f6d97820 2023-09-23T09:48:40.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.760+0000 7f91a4ff9700 10 client.18441 handle_command_reply: tid=0 2023-09-23T09:48:40.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.760+0000 7f91d6d96b80 1 client.18441 shutdown 2023-09-23T09:48:40.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.760+0000 7f91d6d96b80 1 -- 172.21.15.82:0/851292043 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a8f6d7dc40 msgr2=0x55a8f6d89c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:48:40.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.760+0000 7f91d6d96b80 1 --2- 172.21.15.82:0/851292043 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a8f6d7dc40 0x55a8f6d89c30 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f91b8007fd0 tx=0x7f91b8011720 comp rx=0 tx=0).stop 2023-09-23T09:48:40.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.760+0000 7f91d6d96b80 1 -- 172.21.15.82:0/851292043 shutdown_connections 2023-09-23T09:48:40.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.760+0000 7f91d6d96b80 1 --2- 172.21.15.82:0/851292043 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a8f6d83ca0 0x55a8f6d875c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:40.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.760+0000 7f91d6d96b80 1 --2- 172.21.15.82:0/851292043 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55a8f6d97820 0x55a8f6d99c40 crc :-1 s=READY pgs=303 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:40.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.760+0000 7f91d6d96b80 1 --2- 172.21.15.82:0/851292043 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a8f6d7dc40 0x55a8f6d89c30 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:40.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.760+0000 7f91d6d96b80 1 --2- 172.21.15.82:0/851292043 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a8f6d83380 0x55a8f6d86f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:40.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.760+0000 7f91d6d96b80 1 -- 172.21.15.82:0/851292043 >> 172.21.15.82:0/851292043 conn(0x55a8f6cf20e0 msgr2=0x55a8f6d72b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:48:40.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.760+0000 7f91a4ff9700 0 client.18441 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:48:40.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.760+0000 7f91d6d96b80 1 -- 172.21.15.82:0/851292043 shutdown_connections 2023-09-23T09:48:40.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.760+0000 7f91d6d96b80 1 -- 172.21.15.82:0/851292043 wait complete. 2023-09-23T09:48:40.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.761+0000 7f91d6d96b80 20 client.18441 trim_cache size 0 max 16384 2023-09-23T09:48:40.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.778+0000 7f91d6d96b80 1 Processor -- start 2023-09-23T09:48:40.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.778+0000 7f91d6d96b80 1 -- start start 2023-09-23T09:48:40.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.778+0000 7f91d6d96b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a8f6d7dc40 0x55a8f6d897d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:48:40.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.778+0000 7f91d6d96b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a8f6d83380 0x55a8f6d810f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:48:40.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.778+0000 7f91d6d96b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a8f6d83ca0 0x55a8f6d86810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:48:40.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.778+0000 7f91d6d96b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8f6b51920 con 0x55a8f6d83ca0 2023-09-23T09:48:40.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.778+0000 7f91d6d96b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8f6d88270 con 0x55a8f6d7dc40 2023-09-23T09:48:40.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.779+0000 7f91d6d96b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8f6d74c80 con 0x55a8f6d83380 2023-09-23T09:48:40.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.779+0000 7f91c199c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a8f6d83ca0 0x55a8f6d86810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:48:40.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.779+0000 7f91c199c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a8f6d83ca0 0x55a8f6d86810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36318/0 (socket says 172.21.15.82:36318) 2023-09-23T09:48:40.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.779+0000 7f91c199c700 1 -- 172.21.15.82:0/1835257934 learned_addr learned my addr 172.21.15.82:0/1835257934 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:48:40.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.779+0000 7f91c119b700 1 --2- 172.21.15.82:0/1835257934 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a8f6d7dc40 0x55a8f6d897d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:48:40.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.779+0000 7f91c099a700 1 --2- 172.21.15.82:0/1835257934 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a8f6d83380 0x55a8f6d810f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:48:40.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.779+0000 7f91c199c700 1 -- 172.21.15.82:0/1835257934 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a8f6d83380 msgr2=0x55a8f6d810f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:48:40.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.779+0000 7f91c199c700 1 --2- 172.21.15.82:0/1835257934 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a8f6d83380 0x55a8f6d810f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:40.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.779+0000 7f91c199c700 1 -- 172.21.15.82:0/1835257934 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a8f6d7dc40 msgr2=0x55a8f6d897d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:48:40.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.779+0000 7f91c199c700 1 --2- 172.21.15.82:0/1835257934 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a8f6d7dc40 0x55a8f6d897d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:40.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.779+0000 7f91c199c700 1 -- 172.21.15.82:0/1835257934 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a8f6d9e890 con 0x55a8f6d83ca0 2023-09-23T09:48:40.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.779+0000 7f91c119b700 1 --2- 172.21.15.82:0/1835257934 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a8f6d7dc40 0x55a8f6d897d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:48:40.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.779+0000 7f91c199c700 1 --2- 172.21.15.82:0/1835257934 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a8f6d83ca0 0x55a8f6d86810 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f91b400bd40 tx=0x7f91b4028000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e37cb74213d77a8f server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:48:40.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.780+0000 7f91a7fff700 1 -- 172.21.15.82:0/1835257934 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b400e040 con 0x55a8f6d83ca0 2023-09-23T09:48:40.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.780+0000 7f91a7fff700 1 -- 172.21.15.82:0/1835257934 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f91b4007820 con 0x55a8f6d83ca0 2023-09-23T09:48:40.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.780+0000 7f91a7fff700 1 -- 172.21.15.82:0/1835257934 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b40052a0 con 0x55a8f6d83ca0 2023-09-23T09:48:40.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.780+0000 7f91d6d96b80 1 -- 172.21.15.82:0/1835257934 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a8f6d83ca0 msgr2=0x55a8f6d86810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:48:40.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.780+0000 7f91d6d96b80 1 --2- 172.21.15.82:0/1835257934 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a8f6d83ca0 0x55a8f6d86810 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f91b400bd40 tx=0x7f91b4028000 comp rx=0 tx=0).stop 2023-09-23T09:48:40.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.780+0000 7f91d6d96b80 1 -- 172.21.15.82:0/1835257934 shutdown_connections 2023-09-23T09:48:40.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.780+0000 7f91d6d96b80 1 --2- 172.21.15.82:0/1835257934 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a8f6d83ca0 0x55a8f6d86810 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:40.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.780+0000 7f91d6d96b80 1 --2- 172.21.15.82:0/1835257934 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a8f6d7dc40 0x55a8f6d897d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:40.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.780+0000 7f91d6d96b80 1 --2- 172.21.15.82:0/1835257934 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a8f6d83380 0x55a8f6d810f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:40.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.780+0000 7f91d6d96b80 1 -- 172.21.15.82:0/1835257934 >> 172.21.15.82:0/1835257934 conn(0x55a8f6cf20e0 msgr2=0x55a8f6d780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:48:40.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.780+0000 7f91d6d96b80 1 -- 172.21.15.82:0/1835257934 shutdown_connections 2023-09-23T09:48:40.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.780+0000 7f91d6d96b80 1 -- 172.21.15.82:0/1835257934 wait complete. 2023-09-23T09:48:40.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.781+0000 7f91d6d96b80 1 -- start start 2023-09-23T09:48:40.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.781+0000 7f91d6d96b80 1 Processor -- start 2023-09-23T09:48:40.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.782+0000 7f91d6d96b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a8f6d7dc40 0x55a8f6d80400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:48:40.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.782+0000 7f91d6d96b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a8f6d83380 0x55a8f6d7ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:48:40.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.782+0000 7f91d6d96b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a8f6d83ca0 0x55a8f6d7f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:48:40.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.782+0000 7f91d6d96b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8f6d80b10 con 0x55a8f6d83380 2023-09-23T09:48:40.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.782+0000 7f91d6d96b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8f6d80c80 con 0x55a8f6d83ca0 2023-09-23T09:48:40.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.782+0000 7f91d6d96b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8f6d7f880 con 0x55a8f6d7dc40 2023-09-23T09:48:40.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.782+0000 7f91d6d96b80 10 client.0 _ll_register_callbacks cb 0x7f91b8007aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-23T09:48:40.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.782+0000 7f91c099a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a8f6d83380 0x55a8f6d7ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:48:40.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.782+0000 7f91c099a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a8f6d83380 0x55a8f6d7ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36326/0 (socket says 172.21.15.82:36326) 2023-09-23T09:48:40.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.782+0000 7f91c099a700 1 -- 172.21.15.82:0/2141962680 learned_addr learned my addr 172.21.15.82:0/2141962680 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:48:40.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.782+0000 7f91c199c700 1 --2- 172.21.15.82:0/2141962680 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a8f6d83ca0 0x55a8f6d7f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:48:40.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.782+0000 7f91c119b700 1 --2- 172.21.15.82:0/2141962680 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a8f6d7dc40 0x55a8f6d80400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:48:40.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.782+0000 7f91c099a700 1 -- 172.21.15.82:0/2141962680 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a8f6d7dc40 msgr2=0x55a8f6d80400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:48:40.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.782+0000 7f91c099a700 1 --2- 172.21.15.82:0/2141962680 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a8f6d7dc40 0x55a8f6d80400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:40.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.782+0000 7f91c099a700 1 -- 172.21.15.82:0/2141962680 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a8f6d83ca0 msgr2=0x55a8f6d7f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-23T09:48:40.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.782+0000 7f91c099a700 1 --2- 172.21.15.82:0/2141962680 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a8f6d83ca0 0x55a8f6d7f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:40.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.782+0000 7f91c099a700 1 -- 172.21.15.82:0/2141962680 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91b4027050 con 0x55a8f6d83380 2023-09-23T09:48:40.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.782+0000 7f91c119b700 1 --2- 172.21.15.82:0/2141962680 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a8f6d7dc40 0x55a8f6d80400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:48:40.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.783+0000 7f91c099a700 1 --2- 172.21.15.82:0/2141962680 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a8f6d83380 0x55a8f6d7ee00 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f91ac098ea0 tx=0x7f91ac098e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=257658aee39797aa server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:48:40.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.783+0000 7f91a4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-09-23T09:48:40.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.783+0000 7f91a4ff9700 1 -- 172.21.15.82:0/2141962680 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91ac098600 con 0x55a8f6d83380 2023-09-23T09:48:40.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.783+0000 7f91a4ff9700 1 -- 172.21.15.82:0/2141962680 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(179..179 src has 1..179) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f91ac098f10 con 0x55a8f6d83380 2023-09-23T09:48:40.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.783+0000 7f91d6d96b80 1 -- 172.21.15.82:0/2141962680 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a8f6d708b0 con 0x55a8f6d83380 2023-09-23T09:48:40.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.783+0000 7f91a4ff9700 1 -- 172.21.15.82:0/2141962680 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=147) v2 ==== 24+0+0 (secure 0 0 0) 0x7f91ac09cd40 con 0x55a8f6d83380 2023-09-23T09:48:40.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.783+0000 7f91d6d96b80 10 client.18447 fetch_fsmap learned FSMap version 147 2023-09-23T09:48:40.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.783+0000 7f91d6d96b80 1 -- 172.21.15.82:0/2141962680 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=147,monmap=4+}) v3 -- 0x55a8f6ae4c60 con 0x55a8f6d83380 2023-09-23T09:48:40.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.783+0000 7f91a4ff9700 1 -- 172.21.15.82:0/2141962680 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55a8f6d708b0 con 0x55a8f6d83380 2023-09-23T09:48:40.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.784+0000 7f91a4ff9700 1 -- 172.21.15.82:0/2141962680 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 147) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f91ac0b2020 con 0x55a8f6d83380 2023-09-23T09:48:40.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.784+0000 7f91d6d96b80 10 client.18447 fetch_fsmap finished waiting for FSMap version 147 2023-09-23T09:48:40.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.784+0000 7f91d6d96b80 10 client.18447 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-23T09:48:40.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.784+0000 7f91d6d96b80 20 client.18447 populate_metadata read hostname 'smithi082' 2023-09-23T09:48:40.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.784+0000 7f91d6d96b80 1 --2- 172.21.15.82:0/2141962680 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55a8f6dec430 0x55a8f6dee850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:48:40.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.784+0000 7f91d6d96b80 4 client.18447 mds_command: new command op to 24557 tid=0[{"prefix": "scrub status"}] 2023-09-23T09:48:40.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.784+0000 7f91d6d96b80 1 -- 172.21.15.82:0/2141962680 --> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55a8f6cc8970 con 0x55a8f6dec430 2023-09-23T09:48:40.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.784+0000 7f91c119b700 1 --2- 172.21.15.82:0/2141962680 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55a8f6dec430 0x55a8f6dee850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:48:40.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.784+0000 7f91a4ff9700 10 client.18447 ms_handle_connect on v2:172.21.15.135:6838/2508669274 2023-09-23T09:48:40.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.784+0000 7f91c119b700 1 --2- 172.21.15.82:0/2141962680 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55a8f6dec430 0x55a8f6dee850 crc :-1 s=READY pgs=304 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=41d22c1613514a79 server_cookie=45636255ea0d7afc in_seq=0 out_seq=0 2023-09-23T09:48:40.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.785+0000 7f91a4ff9700 1 -- 172.21.15.82:0/2141962680 <== mds.0 v2:172.21.15.135:6838/2508669274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55a8f6cc8970 con 0x55a8f6dec430 2023-09-23T09:48:40.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.785+0000 7f91a4ff9700 10 client.18447 handle_command_reply: tid=0 2023-09-23T09:48:40.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.785+0000 7f91d6d96b80 1 client.18447 shutdown 2023-09-23T09:48:40.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.785+0000 7f91d6d96b80 1 -- 172.21.15.82:0/2141962680 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a8f6d83380 msgr2=0x55a8f6d7ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:48:40.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.785+0000 7f91d6d96b80 1 --2- 172.21.15.82:0/2141962680 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a8f6d83380 0x55a8f6d7ee00 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f91ac098ea0 tx=0x7f91ac098e10 comp rx=0 tx=0).stop 2023-09-23T09:48:40.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.785+0000 7f91d6d96b80 1 -- 172.21.15.82:0/2141962680 shutdown_connections 2023-09-23T09:48:40.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.785+0000 7f91d6d96b80 1 --2- 172.21.15.82:0/2141962680 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a8f6d83ca0 0x55a8f6d7f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:40.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.785+0000 7f91d6d96b80 1 --2- 172.21.15.82:0/2141962680 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a8f6d7dc40 0x55a8f6d80400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:40.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.785+0000 7f91d6d96b80 1 --2- 172.21.15.82:0/2141962680 >> [v2:172.21.15.135:6838/2508669274,v1:172.21.15.135:6839/2508669274] conn(0x55a8f6dec430 0x55a8f6dee850 crc :-1 s=READY pgs=304 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:40.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.785+0000 7f91d6d96b80 1 --2- 172.21.15.82:0/2141962680 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a8f6d83380 0x55a8f6d7ee00 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:40.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.785+0000 7f91a4ff9700 0 client.18447 ms_handle_reset on v2:172.21.15.135:6838/2508669274 2023-09-23T09:48:40.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.785+0000 7f91d6d96b80 1 -- 172.21.15.82:0/2141962680 >> 172.21.15.82:0/2141962680 conn(0x55a8f6cf20e0 msgr2=0x55a8f6d810f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:48:40.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.785+0000 7f91d6d96b80 1 -- 172.21.15.82:0/2141962680 shutdown_connections 2023-09-23T09:48:40.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.785+0000 7f91d6d96b80 1 -- 172.21.15.82:0/2141962680 wait complete. 2023-09-23T09:48:40.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.785+0000 7f91d6d96b80 20 client.18447 trim_cache size 0 max 16384 2023-09-23T09:48:40.792 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:48:40.793 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-23T09:48:40.793 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-09-23T09:48:40.793 INFO:teuthology.orchestra.run.smithi082.stdout: "d9e62ab8-1468-4fb0-a9fe-61bed13e954b": { 2023-09-23T09:48:40.793 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-09-23T09:48:40.793 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "d9e62ab8-1468-4fb0-a9fe-61bed13e954b", 2023-09-23T09:48:40.793 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2023-09-23T09:48:40.793 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:40.793 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:40.793 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:48:40.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.786+0000 7f91c33ff700 1 -- 172.21.15.82:0/4057946314 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f91a80a0140 msgr2=0x7f91a80a2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:48:40.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.786+0000 7f91c33ff700 1 --2- 172.21.15.82:0/4057946314 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f91a80a0140 0x7f91a80a2600 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f91b400b780 tx=0x7f91b400be70 comp rx=0 tx=0).stop 2023-09-23T09:48:40.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.786+0000 7f91c33ff700 1 -- 172.21.15.82:0/4057946314 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91bc101250 msgr2=0x7f91bc19ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:48:40.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.786+0000 7f91c33ff700 1 --2- 172.21.15.82:0/4057946314 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91bc101250 0x7f91bc19ed50 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f91ac00e9a0 tx=0x7f91ac00ecb0 comp rx=0 tx=0).stop 2023-09-23T09:48:40.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.786+0000 7f91c33ff700 1 -- 172.21.15.82:0/4057946314 shutdown_connections 2023-09-23T09:48:40.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.786+0000 7f91c33ff700 1 --2- 172.21.15.82:0/4057946314 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f91a80a0140 0x7f91a80a2600 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:40.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.786+0000 7f91c33ff700 1 --2- 172.21.15.82:0/4057946314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91bc1068a0 0x7f91bc198880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:40.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.786+0000 7f91c33ff700 1 --2- 172.21.15.82:0/4057946314 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f91bc100890 0x7f91bc19e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:40.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.786+0000 7f91c33ff700 1 --2- 172.21.15.82:0/4057946314 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91bc101250 0x7f91bc19ed50 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:40.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.786+0000 7f91c33ff700 1 -- 172.21.15.82:0/4057946314 >> 172.21.15.82:0/4057946314 conn(0x7f91bc0fc380 msgr2=0x7f91bc10bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:48:40.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.786+0000 7f91c33ff700 1 -- 172.21.15.82:0/4057946314 shutdown_connections 2023-09-23T09:48:40.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:40.786+0000 7f91c33ff700 1 -- 172.21.15.82:0/4057946314 wait complete. 2023-09-23T09:48:40.805 INFO:tasks.cephfs.filesystem:scrub status for tag:d9e62ab8-1468-4fb0-a9fe-61bed13e954b - {'path': '/', 'tag': 'd9e62ab8-1468-4fb0-a9fe-61bed13e954b', 'options': 'recursive,force'} 2023-09-23T09:48:40.805 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_db9a2d12746faa158579b8d032d53d472ae6b6b0/qa/tasks/fwd_scrub.py", line 38, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_db9a2d12746faa158579b8d032d53d472ae6b6b0/qa/tasks/fwd_scrub.py", line 55, in do_scrub self._scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_db9a2d12746faa158579b8d032d53d472ae6b6b0/qa/tasks/fwd_scrub.py", line 76, in _scrub done = self.fs.wait_until_scrub_complete(tag=tag, sleep=30, timeout=self.scrub_timeout) File "/home/teuthworker/src/git.ceph.com_ceph-c_db9a2d12746faa158579b8d032d53d472ae6b6b0/qa/tasks/cephfs/filesystem.py", line 1727, in wait_until_scrub_complete while proceed(): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (31) after waiting for 900 seconds 2023-09-23T09:48:40.873 ERROR:teuthology.run_tasks:Manager failed: fwd_scrub Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_db9a2d12746faa158579b8d032d53d472ae6b6b0/qa/tasks/fwd_scrub.py", line 164, in task stop_all_fwd_scrubbers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph-c_db9a2d12746faa158579b8d032d53d472ae6b6b0/qa/tasks/fwd_scrub.py", line 99, in stop_all_fwd_scrubbers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: reached maximum tries (31) after waiting for 900 seconds 2023-09-23T09:48:40.873 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2023-09-23T09:48:40.886 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-23T09:48:41.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.080+0000 7fc4ce3ff700 1 -- 172.21.15.82:0/3042497763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4c81008a0 msgr2=0x7fc4c8100d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:48:41.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.080+0000 7fc4ce3ff700 1 --2- 172.21.15.82:0/3042497763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4c81008a0 0x7fc4c8100d20 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc009990 tx=0x7fc4bc009ca0 comp rx=0 tx=0).stop 2023-09-23T09:48:41.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.081+0000 7fc4ce3ff700 1 -- 172.21.15.82:0/3042497763 shutdown_connections 2023-09-23T09:48:41.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.081+0000 7fc4ce3ff700 1 --2- 172.21.15.82:0/3042497763 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4c8101260 0x7fc4c810d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:41.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.081+0000 7fc4ce3ff700 1 --2- 172.21.15.82:0/3042497763 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc4c81068b0 0x7fc4c8106c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:41.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.081+0000 7fc4ce3ff700 1 --2- 172.21.15.82:0/3042497763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4c81008a0 0x7fc4c8100d20 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:41.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.081+0000 7fc4ce3ff700 1 -- 172.21.15.82:0/3042497763 >> 172.21.15.82:0/3042497763 conn(0x7fc4c80fc3d0 msgr2=0x7fc4c80fe7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:48:41.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.081+0000 7fc4ce3ff700 1 -- 172.21.15.82:0/3042497763 shutdown_connections 2023-09-23T09:48:41.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.081+0000 7fc4ce3ff700 1 -- 172.21.15.82:0/3042497763 wait complete. 2023-09-23T09:48:41.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.082+0000 7fc4ce3ff700 1 Processor -- start 2023-09-23T09:48:41.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.082+0000 7fc4ce3ff700 1 -- start start 2023-09-23T09:48:41.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.082+0000 7fc4ce3ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc4c81008a0 0x7fc4c819e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:48:41.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.082+0000 7fc4ce3ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4c8101260 0x7fc4c819ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:48:41.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.082+0000 7fc4ce3ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4c81068b0 0x7fc4c81988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:48:41.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.082+0000 7fc4ce3ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c8199070 con 0x7fc4c81068b0 2023-09-23T09:48:41.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.082+0000 7fc4ce3ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c81991e0 con 0x7fc4c8101260 2023-09-23T09:48:41.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.082+0000 7fc4ce3ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c81993a0 con 0x7fc4c81008a0 2023-09-23T09:48:41.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.082+0000 7fc4cc99c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4c81068b0 0x7fc4c81988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:48:41.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.082+0000 7fc4cc99c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4c81068b0 0x7fc4c81988a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36340/0 (socket says 172.21.15.82:36340) 2023-09-23T09:48:41.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.082+0000 7fc4cc99c700 1 -- 172.21.15.82:0/4199728353 learned_addr learned my addr 172.21.15.82:0/4199728353 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:48:41.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.082+0000 7fc4c77fe700 1 --2- 172.21.15.82:0/4199728353 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4c8101260 0x7fc4c819ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:48:41.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.083+0000 7fc4c7fff700 1 --2- 172.21.15.82:0/4199728353 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc4c81008a0 0x7fc4c819e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:48:41.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.083+0000 7fc4cc99c700 1 -- 172.21.15.82:0/4199728353 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc4c81008a0 msgr2=0x7fc4c819e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:48:41.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.083+0000 7fc4cc99c700 1 --2- 172.21.15.82:0/4199728353 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc4c81008a0 0x7fc4c819e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:41.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.083+0000 7fc4cc99c700 1 -- 172.21.15.82:0/4199728353 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4c8101260 msgr2=0x7fc4c819ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:48:41.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.083+0000 7fc4cc99c700 1 --2- 172.21.15.82:0/4199728353 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4c8101260 0x7fc4c819ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:41.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.083+0000 7fc4cc99c700 1 -- 172.21.15.82:0/4199728353 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4bc0095f0 con 0x7fc4c81068b0 2023-09-23T09:48:41.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.083+0000 7fc4c77fe700 1 --2- 172.21.15.82:0/4199728353 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4c8101260 0x7fc4c819ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:48:41.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.083+0000 7fc4cc99c700 1 --2- 172.21.15.82:0/4199728353 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4c81068b0 0x7fc4c81988a0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fc4c000ef30 tx=0x7fc4c000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:48:41.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.083+0000 7fc4c57fa700 1 -- 172.21.15.82:0/4199728353 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c0018070 con 0x7fc4c81068b0 2023-09-23T09:48:41.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.083+0000 7fc4c57fa700 1 -- 172.21.15.82:0/4199728353 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc4c000f040 con 0x7fc4c81068b0 2023-09-23T09:48:41.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.083+0000 7fc4ce3ff700 1 -- 172.21.15.82:0/4199728353 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4c8199620 con 0x7fc4c81068b0 2023-09-23T09:48:41.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.083+0000 7fc4c57fa700 1 -- 172.21.15.82:0/4199728353 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c000cbc0 con 0x7fc4c81068b0 2023-09-23T09:48:41.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.083+0000 7fc4ce3ff700 1 -- 172.21.15.82:0/4199728353 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4c81a5840 con 0x7fc4c81068b0 2023-09-23T09:48:41.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.085+0000 7fc4ce3ff700 1 -- 172.21.15.82:0/4199728353 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4c8067710 con 0x7fc4c81068b0 2023-09-23T09:48:41.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.086+0000 7fc4c57fa700 1 -- 172.21.15.82:0/4199728353 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7fc4c000cd80 con 0x7fc4c81068b0 2023-09-23T09:48:41.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.088+0000 7fc4c57fa700 1 --2- 172.21.15.82:0/4199728353 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fc4b00a0100 0x7fc4b00a25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:48:41.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.088+0000 7fc4c57fa700 1 -- 172.21.15.82:0/4199728353 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fc4c00cb160 con 0x7fc4c81068b0 2023-09-23T09:48:41.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.088+0000 7fc4c7fff700 1 --2- 172.21.15.82:0/4199728353 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fc4b00a0100 0x7fc4b00a25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:48:41.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.088+0000 7fc4c7fff700 1 --2- 172.21.15.82:0/4199728353 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fc4b00a0100 0x7fc4b00a25c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc4b8009be0 tx=0x7fc4b8009260 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:48:41.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.092+0000 7fc4c57fa700 1 -- 172.21.15.82:0/4199728353 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7fc4c0094c40 con 0x7fc4c81068b0 2023-09-23T09:48:41.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.293+0000 7fc4ce3ff700 1 -- 172.21.15.82:0/4199728353 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc4c81107d0 con 0x7fc4c81068b0 2023-09-23T09:48:41.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.295+0000 7fc4c57fa700 1 -- 172.21.15.82:0/4199728353 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v179) v1 ==== 74+0+22980 (secure 0 0 0) 0x7fc4c0098260 con 0x7fc4c81068b0 2023-09-23T09:48:41.296 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T09:48:41.296 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":179,"fsid":"8926e286-59ed-11ee-8db4-212e2dc638e7","created":"2023-09-23T08:46:16.628057+0000","modified":"2023-09-23T09:48:17.478269+0000","last_up_change":"2023-09-23T08:53:56.524694+0000","last_in_change":"2023-09-23T08:53:35.779183+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-23T08:50:00.571063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-23T08:54:50.558630+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-23T08:54:52.055291+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"178","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":98,"snap_epoch":178,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7384c1ff-8c71-4feb-8cef-ba45c2a1708a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":892441948},{"type":"v1","addr":"172.21.15.82:6803","nonce":892441948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":892441948},{"type":"v1","addr":"172.21.15.82:6805","nonce":892441948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":892441948},{"type":"v1","addr":"172.21.15.82:6809","nonce":892441948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":892441948},{"type":"v1","addr":"172.21.15.82:6807","nonce":892441948}]},"public_addr":"172.21.15.82:6803/892441948","cluster_addr":"172.21.15.82:6805/892441948","heartbeat_back_addr":"172.21.15.82:6809/892441948","heartbeat_front_addr":"172.21.15.82:6807/892441948","state":["exists","up"]},{"osd":1,"uuid":"ca62333e-15db-4556-a9ed-8820f9268766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3224546922},{"type":"v1","addr":"172.21.15.135:6801","nonce":3224546922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3224546922},{"type":"v1","addr":"172.21.15.135:6803","nonce":3224546922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3224546922},{"type":"v1","addr":"172.21.15.135:6807","nonce":3224546922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3224546922},{"type":"v1","addr":"172.21.15.135:6805","nonce":3224546922}]},"public_addr":"172.21.15.135:6801/3224546922","cluster_addr":"172.21.15.135:6803/3224546922","heartbeat_back_addr":"172.21.15.135:6807/3224546922","heartbeat_front_addr":"172.21.15.135:6805/3224546922","state":["exists","up"]},{"osd":2,"uuid":"ac23eb38-216a-44f0-b316-a509b23745f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2358373459},{"type":"v1","addr":"172.21.15.161:6801","nonce":2358373459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2358373459},{"type":"v1","addr":"172.21.15.161:6803","nonce":2358373459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2358373459},{"type":"v1","addr":"172.21.15.161:6807","nonce":2358373459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2358373459},{"type":"v1","addr":"172.21.15.161:6805","nonce":2358373459}]},"public_addr":"172.21.15.161:6801/2358373459","cluster_addr":"172.21.15.161:6803/2358373459","heartbeat_back_addr":"172.21.15.161:6807/2358373459","heartbeat_front_addr":"172.21.15.161:6805/2358373459","state":["exists","up"]},{"osd":3,"uuid":"701c96b0-30fb-46ce-917d-e02d3814dc3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":1081464528},{"type":"v1","addr":"172.21.15.82:6811","nonce":1081464528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1081464528},{"type":"v1","addr":"172.21.15.82:6813","nonce":1081464528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1081464528},{"type":"v1","addr":"172.21.15.82:6817","nonce":1081464528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":1081464528},{"type":"v1","addr":"172.21.15.82:6815","nonce":1081464528}]},"public_addr":"172.21.15.82:6811/1081464528","cluster_addr":"172.21.15.82:6813/1081464528","heartbeat_back_addr":"172.21.15.82:6817/1081464528","heartbeat_front_addr":"172.21.15.82:6815/1081464528","state":["exists","up"]},{"osd":4,"uuid":"c618d2a2-3616-41b2-943c-7a4616538e13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2346495509},{"type":"v1","addr":"172.21.15.135:6809","nonce":2346495509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2346495509},{"type":"v1","addr":"172.21.15.135:6811","nonce":2346495509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2346495509},{"type":"v1","addr":"172.21.15.135:6815","nonce":2346495509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2346495509},{"type":"v1","addr":"172.21.15.135:6813","nonce":2346495509}]},"public_addr":"172.21.15.135:6809/2346495509","cluster_addr":"172.21.15.135:6811/2346495509","heartbeat_back_addr":"172.21.15.135:6815/2346495509","heartbeat_front_addr":"172.21.15.135:6813/2346495509","state":["exists","up"]},{"osd":5,"uuid":"8e1dda3d-6927-495d-b20d-78b03bb75d5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1252638628},{"type":"v1","addr":"172.21.15.161:6809","nonce":1252638628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1252638628},{"type":"v1","addr":"172.21.15.161:6811","nonce":1252638628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1252638628},{"type":"v1","addr":"172.21.15.161:6815","nonce":1252638628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1252638628},{"type":"v1","addr":"172.21.15.161:6813","nonce":1252638628}]},"public_addr":"172.21.15.161:6809/1252638628","cluster_addr":"172.21.15.161:6811/1252638628","heartbeat_back_addr":"172.21.15.161:6815/1252638628","heartbeat_front_addr":"172.21.15.161:6813/1252638628","state":["exists","up"]},{"osd":6,"uuid":"50b31960-6bc4-44e1-8116-3106bf161e56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1052038408},{"type":"v1","addr":"172.21.15.82:6819","nonce":1052038408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1052038408},{"type":"v1","addr":"172.21.15.82:6821","nonce":1052038408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":1052038408},{"type":"v1","addr":"172.21.15.82:6825","nonce":1052038408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1052038408},{"type":"v1","addr":"172.21.15.82:6823","nonce":1052038408}]},"public_addr":"172.21.15.82:6819/1052038408","cluster_addr":"172.21.15.82:6821/1052038408","heartbeat_back_addr":"172.21.15.82:6825/1052038408","heartbeat_front_addr":"172.21.15.82:6823/1052038408","state":["exists","up"]},{"osd":7,"uuid":"425ca0ee-57f7-4b27-90fb-d86bb5db5480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3683951498},{"type":"v1","addr":"172.21.15.135:6817","nonce":3683951498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":3683951498},{"type":"v1","addr":"172.21.15.135:6819","nonce":3683951498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":3683951498},{"type":"v1","addr":"172.21.15.135:6823","nonce":3683951498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":3683951498},{"type":"v1","addr":"172.21.15.135:6821","nonce":3683951498}]},"public_addr":"172.21.15.135:6817/3683951498","cluster_addr":"172.21.15.135:6819/3683951498","heartbeat_back_addr":"172.21.15.135:6823/3683951498","heartbeat_front_addr":"172.21.15.135:6821/3683951498","state":["exists","up"]},{"osd":8,"uuid":"1115c837-bef6-4bad-9974-4d913198511b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":948521536},{"type":"v1","addr":"172.21.15.161:6817","nonce":948521536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":948521536},{"type":"v1","addr":"172.21.15.161:6819","nonce":948521536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":948521536},{"type":"v1","addr":"172.21.15.161:6823","nonce":948521536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":948521536},{"type":"v1","addr":"172.21.15.161:6821","nonce":948521536}]},"public_addr":"172.21.15.161:6817/948521536","cluster_addr":"172.21.15.161:6819/948521536","heartbeat_back_addr":"172.21.15.161:6823/948521536","heartbeat_front_addr":"172.21.15.161:6821/948521536","state":["exists","up"]},{"osd":9,"uuid":"c52ec819-4bc6-402f-9cd8-62539e519e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":1438762840},{"type":"v1","addr":"172.21.15.82:6827","nonce":1438762840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":1438762840},{"type":"v1","addr":"172.21.15.82:6829","nonce":1438762840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1438762840},{"type":"v1","addr":"172.21.15.82:6833","nonce":1438762840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1438762840},{"type":"v1","addr":"172.21.15.82:6831","nonce":1438762840}]},"public_addr":"172.21.15.82:6827/1438762840","cluster_addr":"172.21.15.82:6829/1438762840","heartbeat_back_addr":"172.21.15.82:6833/1438762840","heartbeat_front_addr":"172.21.15.82:6831/1438762840","state":["exists","up"]},{"osd":10,"uuid":"1b16c795-1b91-4d46-ae5d-21b8332c1077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2853697851},{"type":"v1","addr":"172.21.15.135:6825","nonce":2853697851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2853697851},{"type":"v1","addr":"172.21.15.135:6827","nonce":2853697851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2853697851},{"type":"v1","addr":"172.21.15.135:6831","nonce":2853697851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2853697851},{"type":"v1","addr":"172.21.15.135:6829","nonce":2853697851}]},"public_addr":"172.21.15.135:6825/2853697851","cluster_addr":"172.21.15.135:6827/2853697851","heartbeat_back_addr":"172.21.15.135:6831/2853697851","heartbeat_front_addr":"172.21.15.135:6829/2853697851","state":["exists","up"]},{"osd":11,"uuid":"2551e602-4fe1-41cb-9b7d-c8b31fdd1487","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":1459332081},{"type":"v1","addr":"172.21.15.161:6825","nonce":1459332081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":1459332081},{"type":"v1","addr":"172.21.15.161:6827","nonce":1459332081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":1459332081},{"type":"v1","addr":"172.21.15.161:6831","nonce":1459332081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":1459332081},{"type":"v1","addr":"172.21.15.161:6829","nonce":1459332081}]},"public_addr":"172.21.15.161:6825/1459332081","cluster_addr":"172.21.15.161:6827/1459332081","heartbeat_back_addr":"172.21.15.161:6831/1459332081","heartbeat_front_addr":"172.21.15.161:6829/1459332081","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:49:04.007679+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:49:30.702365+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:49:56.785248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:50:22.988516+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:50:49.347055+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:51:15.830145+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:51:41.986377+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:52:08.218893+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:52:34.847450+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:53:01.317134+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:53:27.981691+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:53:54.849245+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/1769657494":"2023-09-24T08:56:53.091759+0000","172.21.15.82:6801/3698954311":"2023-09-24T08:56:53.091759+0000","172.21.15.82:0/4204712132":"2023-09-24T08:47:21.957866+0000","172.21.15.82:0/2391800294":"2023-09-24T08:56:53.091759+0000","172.21.15.82:6801/2733521564":"2023-09-24T08:47:21.957866+0000","172.21.15.82:6800/2733521564":"2023-09-24T08:47:21.957866+0000","172.21.15.82:0/3964794665":"2023-09-24T08:47:21.957866+0000","172.21.15.82:0/3535372205":"2023-09-24T08:46:55.187024+0000","172.21.15.82:6800/3698954311":"2023-09-24T08:56:53.091759+0000","172.21.15.82:0/285559684":"2023-09-24T08:46:55.187024+0000","172.21.15.82:0/1232294461":"2023-09-24T08:56:53.091759+0000","172.21.15.82:0/1335891896":"2023-09-24T08:46:55.187024+0000","172.21.15.82:6801/3761509623":"2023-09-24T08:46:55.187024+0000","172.21.15.82:6800/3761509623":"2023-09-24T08:46:55.187024+0000","172.21.15.82:0/3074646956":"2023-09-24T08:56:53.091759+0000","172.21.15.82:0/3775317005":"2023-09-24T08:47:21.957866+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":85,"length":1},{"begin":98,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-23T09:48:41.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.297+0000 7fc4ce3ff700 1 -- 172.21.15.82:0/4199728353 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fc4b00a0100 msgr2=0x7fc4b00a25c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:48:41.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.297+0000 7fc4ce3ff700 1 --2- 172.21.15.82:0/4199728353 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fc4b00a0100 0x7fc4b00a25c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc4b8009be0 tx=0x7fc4b8009260 comp rx=0 tx=0).stop 2023-09-23T09:48:41.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.297+0000 7fc4ce3ff700 1 -- 172.21.15.82:0/4199728353 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4c81068b0 msgr2=0x7fc4c81988a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:48:41.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.297+0000 7fc4ce3ff700 1 --2- 172.21.15.82:0/4199728353 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4c81068b0 0x7fc4c81988a0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fc4c000ef30 tx=0x7fc4c000c3a0 comp rx=0 tx=0).stop 2023-09-23T09:48:41.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.297+0000 7fc4ce3ff700 1 -- 172.21.15.82:0/4199728353 shutdown_connections 2023-09-23T09:48:41.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.297+0000 7fc4ce3ff700 1 --2- 172.21.15.82:0/4199728353 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fc4b00a0100 0x7fc4b00a25c0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:41.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.297+0000 7fc4ce3ff700 1 --2- 172.21.15.82:0/4199728353 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4c81068b0 0x7fc4c81988a0 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:41.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.297+0000 7fc4ce3ff700 1 --2- 172.21.15.82:0/4199728353 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc4c81008a0 0x7fc4c819e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:41.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.297+0000 7fc4ce3ff700 1 --2- 172.21.15.82:0/4199728353 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4c8101260 0x7fc4c819ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:41.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.297+0000 7fc4ce3ff700 1 -- 172.21.15.82:0/4199728353 >> 172.21.15.82:0/4199728353 conn(0x7fc4c80fc3d0 msgr2=0x7fc4c810bc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:48:41.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.297+0000 7fc4ce3ff700 1 -- 172.21.15.82:0/4199728353 shutdown_connections 2023-09-23T09:48:41.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.298+0000 7fc4ce3ff700 1 -- 172.21.15.82:0/4199728353 wait complete. 2023-09-23T09:48:41.315 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:48:41 smithi082 ceph-mon[97694]: pgmap v1646: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-09-23T09:48:41.318 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-23T08:50:00.571063+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-23T08:54:50.558630+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-23T08:54:52.055291+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '178', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 98, 'snap_epoch': 178, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-23T09:48:41.318 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-23T09:48:41.396 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:48:41 smithi161 ceph-mon[99580]: pgmap v1646: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-09-23T09:48:41.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.516+0000 7f73751ff700 1 -- 172.21.15.82:0/3979974972 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7370072cf0 msgr2=0x7f73700730d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:48:41.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.516+0000 7f73751ff700 1 --2- 172.21.15.82:0/3979974972 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7370072cf0 0x7f73700730d0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f7360009990 tx=0x7f7360009ca0 comp rx=0 tx=0).stop 2023-09-23T09:48:41.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.516+0000 7f73751ff700 1 -- 172.21.15.82:0/3979974972 shutdown_connections 2023-09-23T09:48:41.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.516+0000 7f73751ff700 1 --2- 172.21.15.82:0/3979974972 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f737010d130 0x7f737010f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:41.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.516+0000 7f73751ff700 1 --2- 172.21.15.82:0/3979974972 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7370072cf0 0x7f73700730d0 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:41.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.516+0000 7f73751ff700 1 --2- 172.21.15.82:0/3979974972 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7370073610 0x7f737010cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:41.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.516+0000 7f73751ff700 1 -- 172.21.15.82:0/3979974972 >> 172.21.15.82:0/3979974972 conn(0x7f73700fc380 msgr2=0x7f73700fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:48:41.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.516+0000 7f73751ff700 1 -- 172.21.15.82:0/3979974972 shutdown_connections 2023-09-23T09:48:41.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.516+0000 7f73751ff700 1 -- 172.21.15.82:0/3979974972 wait complete. 2023-09-23T09:48:41.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.517+0000 7f73751ff700 1 Processor -- start 2023-09-23T09:48:41.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.517+0000 7f73751ff700 1 -- start start 2023-09-23T09:48:41.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.518+0000 7f73751ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7370072cf0 0x7f737019e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:48:41.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.518+0000 7f73751ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7370073610 0x7f737019ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:48:41.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.518+0000 7f73751ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f737010d130 0x7f73701989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:48:41.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.518+0000 7f73751ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7370199010 con 0x7f737010d130 2023-09-23T09:48:41.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.518+0000 7f73751ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7370199180 con 0x7f7370072cf0 2023-09-23T09:48:41.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.518+0000 7f73751ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7370199340 con 0x7f7370073610 2023-09-23T09:48:41.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.518+0000 7f736f59e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f737010d130 0x7f73701989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:48:41.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.518+0000 7f736f59e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f737010d130 0x7f73701989a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36362/0 (socket says 172.21.15.82:36362) 2023-09-23T09:48:41.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.518+0000 7f736f59e700 1 -- 172.21.15.82:0/3724960301 learned_addr learned my addr 172.21.15.82:0/3724960301 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:48:41.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.518+0000 7f736ed9d700 1 --2- 172.21.15.82:0/3724960301 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7370072cf0 0x7f737019e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:48:41.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.518+0000 7f736e59c700 1 --2- 172.21.15.82:0/3724960301 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7370073610 0x7f737019ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:48:41.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.518+0000 7f736f59e700 1 -- 172.21.15.82:0/3724960301 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7370073610 msgr2=0x7f737019ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:48:41.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.518+0000 7f736f59e700 1 --2- 172.21.15.82:0/3724960301 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7370073610 0x7f737019ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:41.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.518+0000 7f736f59e700 1 -- 172.21.15.82:0/3724960301 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7370072cf0 msgr2=0x7f737019e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:48:41.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.518+0000 7f736f59e700 1 --2- 172.21.15.82:0/3724960301 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7370072cf0 0x7f737019e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:41.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.518+0000 7f736f59e700 1 -- 172.21.15.82:0/3724960301 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73600095f0 con 0x7f737010d130 2023-09-23T09:48:41.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.518+0000 7f736e59c700 1 --2- 172.21.15.82:0/3724960301 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7370073610 0x7f737019ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:48:41.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.519+0000 7f736f59e700 1 --2- 172.21.15.82:0/3724960301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f737010d130 0x7f73701989a0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f736800ef90 tx=0x7f736800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:48:41.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.519+0000 7f7357fff700 1 -- 172.21.15.82:0/3724960301 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7368018070 con 0x7f737010d130 2023-09-23T09:48:41.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.519+0000 7f73751ff700 1 -- 172.21.15.82:0/3724960301 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73701995c0 con 0x7f737010d130 2023-09-23T09:48:41.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.519+0000 7f7357fff700 1 -- 172.21.15.82:0/3724960301 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f736800f040 con 0x7f737010d130 2023-09-23T09:48:41.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.519+0000 7f7357fff700 1 -- 172.21.15.82:0/3724960301 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7368003d70 con 0x7f737010d130 2023-09-23T09:48:41.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.519+0000 7f73751ff700 1 -- 172.21.15.82:0/3724960301 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73701a5920 con 0x7f737010d130 2023-09-23T09:48:41.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.520+0000 7f73751ff700 1 -- 172.21.15.82:0/3724960301 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73700676a0 con 0x7f737010d130 2023-09-23T09:48:41.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.524+0000 7f7357fff700 1 -- 172.21.15.82:0/3724960301 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f736800ca50 con 0x7f737010d130 2023-09-23T09:48:41.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.525+0000 7f7357fff700 1 --2- 172.21.15.82:0/3724960301 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f73580a00c0 0x7f73580a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:48:41.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.525+0000 7f7357fff700 1 -- 172.21.15.82:0/3724960301 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f73680cbc40 con 0x7f737010d130 2023-09-23T09:48:41.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.525+0000 7f736ed9d700 1 --2- 172.21.15.82:0/3724960301 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f73580a00c0 0x7f73580a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:48:41.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.526+0000 7f736ed9d700 1 --2- 172.21.15.82:0/3724960301 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f73580a00c0 0x7f73580a2580 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f7360006010 tx=0x7f736000b260 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:48:41.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.527+0000 7f7357fff700 1 -- 172.21.15.82:0/3724960301 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f73680956c0 con 0x7f737010d130 2023-09-23T09:48:41.560 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:48:41 smithi135 ceph-mon[99205]: pgmap v1646: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-09-23T09:48:41.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.730+0000 7f73751ff700 1 -- 172.21.15.82:0/3724960301 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7370112a20 con 0x7f737010d130 2023-09-23T09:48:41.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.730+0000 7f7357fff700 1 -- 172.21.15.82:0/3724960301 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v179) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7368098ce0 con 0x7f737010d130 2023-09-23T09:48:41.765 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-09-23T09:48:41.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.732+0000 7f73751ff700 1 -- 172.21.15.82:0/3724960301 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f73580a00c0 msgr2=0x7f73580a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:48:41.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.732+0000 7f73751ff700 1 --2- 172.21.15.82:0/3724960301 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f73580a00c0 0x7f73580a2580 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f7360006010 tx=0x7f736000b260 comp rx=0 tx=0).stop 2023-09-23T09:48:41.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.732+0000 7f73751ff700 1 -- 172.21.15.82:0/3724960301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f737010d130 msgr2=0x7f73701989a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:48:41.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.732+0000 7f73751ff700 1 --2- 172.21.15.82:0/3724960301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f737010d130 0x7f73701989a0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f736800ef90 tx=0x7f736800c3a0 comp rx=0 tx=0).stop 2023-09-23T09:48:41.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.732+0000 7f73751ff700 1 -- 172.21.15.82:0/3724960301 shutdown_connections 2023-09-23T09:48:41.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.732+0000 7f73751ff700 1 --2- 172.21.15.82:0/3724960301 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f73580a00c0 0x7f73580a2580 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:41.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.732+0000 7f73751ff700 1 --2- 172.21.15.82:0/3724960301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f737010d130 0x7f73701989a0 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:41.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.732+0000 7f73751ff700 1 --2- 172.21.15.82:0/3724960301 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7370072cf0 0x7f737019e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:41.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.732+0000 7f73751ff700 1 --2- 172.21.15.82:0/3724960301 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7370073610 0x7f737019ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:41.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.732+0000 7f73751ff700 1 -- 172.21.15.82:0/3724960301 >> 172.21.15.82:0/3724960301 conn(0x7f73700fc380 msgr2=0x7f737010f330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:48:41.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.733+0000 7f73751ff700 1 -- 172.21.15.82:0/3724960301 shutdown_connections 2023-09-23T09:48:41.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.733+0000 7f73751ff700 1 -- 172.21.15.82:0/3724960301 wait complete. 2023-09-23T09:48:41.768 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-23T09:48:41.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.967+0000 7f53263ff700 1 -- 172.21.15.82:0/998333625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5320106880 msgr2=0x7f5320106c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:48:41.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.968+0000 7f53263ff700 1 --2- 172.21.15.82:0/998333625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5320106880 0x7f5320106c60 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f5310009990 tx=0x7f5310009ca0 comp rx=0 tx=0).stop 2023-09-23T09:48:41.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.968+0000 7f53263ff700 1 -- 172.21.15.82:0/998333625 shutdown_connections 2023-09-23T09:48:41.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.968+0000 7f53263ff700 1 --2- 172.21.15.82:0/998333625 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5320101230 0x7f532010d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:41.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.968+0000 7f53263ff700 1 --2- 172.21.15.82:0/998333625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5320106880 0x7f5320106c60 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:41.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.968+0000 7f53263ff700 1 --2- 172.21.15.82:0/998333625 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5320100870 0x7f5320100cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:41.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.968+0000 7f53263ff700 1 -- 172.21.15.82:0/998333625 >> 172.21.15.82:0/998333625 conn(0x7f53200fc3a0 msgr2=0x7f53200fe7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:48:41.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.968+0000 7f53263ff700 1 -- 172.21.15.82:0/998333625 shutdown_connections 2023-09-23T09:48:41.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.968+0000 7f53263ff700 1 -- 172.21.15.82:0/998333625 wait complete. 2023-09-23T09:48:41.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.969+0000 7f53263ff700 1 Processor -- start 2023-09-23T09:48:41.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.969+0000 7f53263ff700 1 -- start start 2023-09-23T09:48:41.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.969+0000 7f53263ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5320100870 0x7f5320072c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:48:41.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.969+0000 7f53263ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5320101230 0x7f5320073160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:48:41.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.969+0000 7f53263ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5320106880 0x7f53201a49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:48:41.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.969+0000 7f53263ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5320073990 con 0x7f5320106880 2023-09-23T09:48:41.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.969+0000 7f53263ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53201a4f10 con 0x7f5320101230 2023-09-23T09:48:41.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.969+0000 7f53263ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53201a5050 con 0x7f5320100870 2023-09-23T09:48:41.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.969+0000 7f532499c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5320106880 0x7f53201a49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:48:41.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.970+0000 7f531f7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5320101230 0x7f5320073160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:48:41.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.970+0000 7f532499c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5320106880 0x7f53201a49d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35430/0 (socket says 172.21.15.82:35430) 2023-09-23T09:48:41.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.970+0000 7f532499c700 1 -- 172.21.15.82:0/3860715978 learned_addr learned my addr 172.21.15.82:0/3860715978 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:48:41.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.970+0000 7f531ffff700 1 --2- 172.21.15.82:0/3860715978 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5320100870 0x7f5320072c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:48:41.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.970+0000 7f532499c700 1 -- 172.21.15.82:0/3860715978 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5320100870 msgr2=0x7f5320072c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:48:41.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.970+0000 7f532499c700 1 --2- 172.21.15.82:0/3860715978 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5320100870 0x7f5320072c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:41.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.970+0000 7f532499c700 1 -- 172.21.15.82:0/3860715978 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5320101230 msgr2=0x7f5320073160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:48:41.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.970+0000 7f532499c700 1 --2- 172.21.15.82:0/3860715978 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5320101230 0x7f5320073160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:41.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.970+0000 7f532499c700 1 -- 172.21.15.82:0/3860715978 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53100095f0 con 0x7f5320106880 2023-09-23T09:48:41.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.970+0000 7f531f7fe700 1 --2- 172.21.15.82:0/3860715978 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5320101230 0x7f5320073160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:48:41.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.970+0000 7f532499c700 1 --2- 172.21.15.82:0/3860715978 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5320106880 0x7f53201a49d0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f531800ef30 tx=0x7f531800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:48:41.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.970+0000 7f531d7fa700 1 -- 172.21.15.82:0/3860715978 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5318018070 con 0x7f5320106880 2023-09-23T09:48:41.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.970+0000 7f531d7fa700 1 -- 172.21.15.82:0/3860715978 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f531800f040 con 0x7f5320106880 2023-09-23T09:48:41.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.970+0000 7f53263ff700 1 -- 172.21.15.82:0/3860715978 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53201a5250 con 0x7f5320106880 2023-09-23T09:48:41.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.970+0000 7f531d7fa700 1 -- 172.21.15.82:0/3860715978 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f531800cc70 con 0x7f5320106880 2023-09-23T09:48:41.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.970+0000 7f53263ff700 1 -- 172.21.15.82:0/3860715978 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53201a56e0 con 0x7f5320106880 2023-09-23T09:48:41.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.971+0000 7f53263ff700 1 -- 172.21.15.82:0/3860715978 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53200676a0 con 0x7f5320106880 2023-09-23T09:48:41.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.973+0000 7f531d7fa700 1 -- 172.21.15.82:0/3860715978 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f5318007500 con 0x7f5320106880 2023-09-23T09:48:41.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.976+0000 7f531d7fa700 1 --2- 172.21.15.82:0/3860715978 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f53080a00c0 0x7f53080a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:48:41.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.976+0000 7f531d7fa700 1 -- 172.21.15.82:0/3860715978 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f53180cb1c0 con 0x7f5320106880 2023-09-23T09:48:41.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.976+0000 7f531ffff700 1 --2- 172.21.15.82:0/3860715978 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f53080a00c0 0x7f53080a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:48:41.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.977+0000 7f531ffff700 1 --2- 172.21.15.82:0/3860715978 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f53080a00c0 0x7f53080a2580 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f5310006010 tx=0x7f531000b2a0 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:48:41.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:41.980+0000 7f531d7fa700 1 -- 172.21.15.82:0/3860715978 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f5318094ca0 con 0x7f5320106880 2023-09-23T09:48:42.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.181+0000 7f53263ff700 1 -- 172.21.15.82:0/3860715978 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5320110840 con 0x7f5320106880 2023-09-23T09:48:42.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.181+0000 7f531d7fa700 1 -- 172.21.15.82:0/3860715978 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v179) v1 ==== 104+0+11 (secure 0 0 0) 0x7f53180982c0 con 0x7f5320106880 2023-09-23T09:48:42.182 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2023-09-23T09:48:42.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.183+0000 7f53263ff700 1 -- 172.21.15.82:0/3860715978 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f53080a00c0 msgr2=0x7f53080a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:48:42.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.183+0000 7f53263ff700 1 --2- 172.21.15.82:0/3860715978 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f53080a00c0 0x7f53080a2580 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f5310006010 tx=0x7f531000b2a0 comp rx=0 tx=0).stop 2023-09-23T09:48:42.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.183+0000 7f53263ff700 1 -- 172.21.15.82:0/3860715978 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5320106880 msgr2=0x7f53201a49d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:48:42.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.183+0000 7f53263ff700 1 --2- 172.21.15.82:0/3860715978 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5320106880 0x7f53201a49d0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f531800ef30 tx=0x7f531800c3a0 comp rx=0 tx=0).stop 2023-09-23T09:48:42.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.183+0000 7f53263ff700 1 -- 172.21.15.82:0/3860715978 shutdown_connections 2023-09-23T09:48:42.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.183+0000 7f53263ff700 1 --2- 172.21.15.82:0/3860715978 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f53080a00c0 0x7f53080a2580 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:42.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.183+0000 7f53263ff700 1 --2- 172.21.15.82:0/3860715978 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5320106880 0x7f53201a49d0 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:42.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.183+0000 7f53263ff700 1 --2- 172.21.15.82:0/3860715978 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5320100870 0x7f5320072c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:42.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.183+0000 7f53263ff700 1 --2- 172.21.15.82:0/3860715978 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5320101230 0x7f5320073160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:42.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.183+0000 7f53263ff700 1 -- 172.21.15.82:0/3860715978 >> 172.21.15.82:0/3860715978 conn(0x7f53200fc3a0 msgr2=0x7f53200fca20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:48:42.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.184+0000 7f53263ff700 1 -- 172.21.15.82:0/3860715978 shutdown_connections 2023-09-23T09:48:42.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.184+0000 7f53263ff700 1 -- 172.21.15.82:0/3860715978 wait complete. 2023-09-23T09:48:42.204 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-23T09:48:42.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:48:42 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/4199728353' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-23T09:48:42.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:48:42 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/3724960301' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-23T09:48:42.396 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:48:42 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/4199728353' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-23T09:48:42.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:48:42 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/3724960301' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-23T09:48:42.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.403+0000 7fe2455ff700 1 -- 172.21.15.82:0/3445516842 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe240100890 msgr2=0x7fe240100d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:48:42.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.403+0000 7fe2455ff700 1 --2- 172.21.15.82:0/3445516842 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe240100890 0x7fe240100d10 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fe234009990 tx=0x7fe234009ca0 comp rx=0 tx=0).stop 2023-09-23T09:48:42.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.403+0000 7fe2455ff700 1 -- 172.21.15.82:0/3445516842 shutdown_connections 2023-09-23T09:48:42.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.403+0000 7fe2455ff700 1 --2- 172.21.15.82:0/3445516842 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe240101250 0x7fe24010d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:42.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.403+0000 7fe2455ff700 1 --2- 172.21.15.82:0/3445516842 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe2401068a0 0x7fe240106c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:42.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.403+0000 7fe2455ff700 1 --2- 172.21.15.82:0/3445516842 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe240100890 0x7fe240100d10 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:42.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.403+0000 7fe2455ff700 1 -- 172.21.15.82:0/3445516842 >> 172.21.15.82:0/3445516842 conn(0x7fe2400fc380 msgr2=0x7fe2400fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:48:42.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.403+0000 7fe2455ff700 1 -- 172.21.15.82:0/3445516842 shutdown_connections 2023-09-23T09:48:42.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.403+0000 7fe2455ff700 1 -- 172.21.15.82:0/3445516842 wait complete. 2023-09-23T09:48:42.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.404+0000 7fe2455ff700 1 Processor -- start 2023-09-23T09:48:42.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.404+0000 7fe2455ff700 1 -- start start 2023-09-23T09:48:42.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.405+0000 7fe2455ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe240100890 0x7fe24019c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:48:42.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.405+0000 7fe2455ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe240101250 0x7fe24019cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:48:42.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.405+0000 7fe2455ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2401068a0 0x7fe240196750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:48:42.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.405+0000 7fe2455ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe240196e00 con 0x7fe2401068a0 2023-09-23T09:48:42.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.405+0000 7fe2455ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe240196f70 con 0x7fe240101250 2023-09-23T09:48:42.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.405+0000 7fe2455ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe240197130 con 0x7fe240100890 2023-09-23T09:48:42.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.405+0000 7fe23f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2401068a0 0x7fe240196750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:48:42.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.405+0000 7fe23e7fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe240101250 0x7fe24019cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:48:42.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.405+0000 7fe23f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2401068a0 0x7fe240196750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35442/0 (socket says 172.21.15.82:35442) 2023-09-23T09:48:42.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.405+0000 7fe23effd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe240100890 0x7fe24019c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:48:42.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.405+0000 7fe23f7fe700 1 -- 172.21.15.82:0/2563544777 learned_addr learned my addr 172.21.15.82:0/2563544777 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:48:42.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.405+0000 7fe23e7fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe240101250 0x7fe24019cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:32864/0 (socket says 172.21.15.82:32864) 2023-09-23T09:48:42.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.406+0000 7fe23e7fc700 1 -- 172.21.15.82:0/2563544777 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe240100890 msgr2=0x7fe24019c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:48:42.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.406+0000 7fe23e7fc700 1 --2- 172.21.15.82:0/2563544777 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe240100890 0x7fe24019c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:42.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.406+0000 7fe23e7fc700 1 -- 172.21.15.82:0/2563544777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2401068a0 msgr2=0x7fe240196750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:48:42.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.406+0000 7fe23e7fc700 1 --2- 172.21.15.82:0/2563544777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2401068a0 0x7fe240196750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:42.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.406+0000 7fe23e7fc700 1 -- 172.21.15.82:0/2563544777 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2340095f0 con 0x7fe240101250 2023-09-23T09:48:42.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.406+0000 7fe23f7fe700 1 --2- 172.21.15.82:0/2563544777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2401068a0 0x7fe240196750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:48:42.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.406+0000 7fe23e7fc700 1 --2- 172.21.15.82:0/2563544777 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe240101250 0x7fe24019cc00 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fe2340098e0 tx=0x7fe234004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:48:42.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.406+0000 7fe227fff700 1 -- 172.21.15.82:0/2563544777 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe23401d070 con 0x7fe240101250 2023-09-23T09:48:42.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.406+0000 7fe2455ff700 1 -- 172.21.15.82:0/2563544777 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2401973b0 con 0x7fe240101250 2023-09-23T09:48:42.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.406+0000 7fe227fff700 1 -- 172.21.15.82:0/2563544777 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe234022470 con 0x7fe240101250 2023-09-23T09:48:42.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.406+0000 7fe227fff700 1 -- 172.21.15.82:0/2563544777 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe234017650 con 0x7fe240101250 2023-09-23T09:48:42.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.406+0000 7fe2455ff700 1 -- 172.21.15.82:0/2563544777 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2401a36f0 con 0x7fe240101250 2023-09-23T09:48:42.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.407+0000 7fe2455ff700 1 -- 172.21.15.82:0/2563544777 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2400676a0 con 0x7fe240101250 2023-09-23T09:48:42.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.409+0000 7fe227fff700 1 -- 172.21.15.82:0/2563544777 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7fe2340225e0 con 0x7fe240101250 2023-09-23T09:48:42.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.410+0000 7fe227fff700 1 --2- 172.21.15.82:0/2563544777 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fe2280a00c0 0x7fe2280a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:48:42.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.411+0000 7fe227fff700 1 -- 172.21.15.82:0/2563544777 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fe2340cce70 con 0x7fe240101250 2023-09-23T09:48:42.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.411+0000 7fe23effd700 1 --2- 172.21.15.82:0/2563544777 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fe2280a00c0 0x7fe2280a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:48:42.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.411+0000 7fe23effd700 1 --2- 172.21.15.82:0/2563544777 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fe2280a00c0 0x7fe2280a2580 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe230009be0 tx=0x7fe230009260 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:48:42.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.414+0000 7fe227fff700 1 -- 172.21.15.82:0/2563544777 <== mon.2 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7fe2340968f0 con 0x7fe240101250 2023-09-23T09:48:42.560 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:48:42 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/4199728353' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-23T09:48:42.560 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:48:42 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/3724960301' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-23T09:48:42.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.618+0000 7fe2455ff700 1 -- 172.21.15.82:0/2563544777 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe240197c80 con 0x7fe240101250 2023-09-23T09:48:42.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.618+0000 7fe227fff700 1 -- 172.21.15.82:0/2563544777 <== mon.2 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v179) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe234099f10 con 0x7fe240101250 2023-09-23T09:48:42.619 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2023-09-23T09:48:42.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.621+0000 7fe2455ff700 1 -- 172.21.15.82:0/2563544777 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fe2280a00c0 msgr2=0x7fe2280a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:48:42.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.621+0000 7fe2455ff700 1 --2- 172.21.15.82:0/2563544777 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fe2280a00c0 0x7fe2280a2580 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe230009be0 tx=0x7fe230009260 comp rx=0 tx=0).stop 2023-09-23T09:48:42.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.621+0000 7fe2455ff700 1 -- 172.21.15.82:0/2563544777 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe240101250 msgr2=0x7fe24019cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:48:42.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.621+0000 7fe2455ff700 1 --2- 172.21.15.82:0/2563544777 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe240101250 0x7fe24019cc00 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fe2340098e0 tx=0x7fe234004730 comp rx=0 tx=0).stop 2023-09-23T09:48:42.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.621+0000 7fe2455ff700 1 -- 172.21.15.82:0/2563544777 shutdown_connections 2023-09-23T09:48:42.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.621+0000 7fe2455ff700 1 --2- 172.21.15.82:0/2563544777 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fe2280a00c0 0x7fe2280a2580 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:42.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.621+0000 7fe2455ff700 1 --2- 172.21.15.82:0/2563544777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2401068a0 0x7fe240196750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:42.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.621+0000 7fe2455ff700 1 --2- 172.21.15.82:0/2563544777 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe240100890 0x7fe24019c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:42.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.621+0000 7fe2455ff700 1 --2- 172.21.15.82:0/2563544777 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe240101250 0x7fe24019cc00 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:42.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.621+0000 7fe2455ff700 1 -- 172.21.15.82:0/2563544777 >> 172.21.15.82:0/2563544777 conn(0x7fe2400fc380 msgr2=0x7fe2400fca60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:48:42.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.621+0000 7fe2455ff700 1 -- 172.21.15.82:0/2563544777 shutdown_connections 2023-09-23T09:48:42.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.621+0000 7fe2455ff700 1 -- 172.21.15.82:0/2563544777 wait complete. 2023-09-23T09:48:42.640 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2023-09-23T09:48:42.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.835+0000 7f2c2539d700 1 -- 172.21.15.82:0/3724817877 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c20106720 msgr2=0x7f2c20106b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:48:42.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.835+0000 7f2c2539d700 1 --2- 172.21.15.82:0/3724817877 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c20106720 0x7f2c20106b00 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f2c10009990 tx=0x7f2c10009ca0 comp rx=0 tx=0).stop 2023-09-23T09:48:42.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.835+0000 7f2c2539d700 1 -- 172.21.15.82:0/3724817877 shutdown_connections 2023-09-23T09:48:42.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.835+0000 7f2c2539d700 1 --2- 172.21.15.82:0/3724817877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c201010d0 0x7f2c2010d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:42.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.835+0000 7f2c2539d700 1 --2- 172.21.15.82:0/3724817877 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c20106720 0x7f2c20106b00 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:42.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.835+0000 7f2c2539d700 1 --2- 172.21.15.82:0/3724817877 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2c20100710 0x7f2c20100b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:42.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.835+0000 7f2c2539d700 1 -- 172.21.15.82:0/3724817877 >> 172.21.15.82:0/3724817877 conn(0x7f2c200fc220 msgr2=0x7f2c200fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:48:42.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.835+0000 7f2c2539d700 1 -- 172.21.15.82:0/3724817877 shutdown_connections 2023-09-23T09:48:42.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.835+0000 7f2c2539d700 1 -- 172.21.15.82:0/3724817877 wait complete. 2023-09-23T09:48:42.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.836+0000 7f2c2539d700 1 Processor -- start 2023-09-23T09:48:42.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.836+0000 7f2c2539d700 1 -- start start 2023-09-23T09:48:42.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.837+0000 7f2c2539d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c20100710 0x7f2c20072c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:48:42.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.837+0000 7f2c2539d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2c201010d0 0x7f2c20073160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:48:42.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.837+0000 7f2c2539d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c20106720 0x7f2c201a47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:48:42.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.837+0000 7f2c2539d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c20073990 con 0x7f2c20106720 2023-09-23T09:48:42.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.837+0000 7f2c2539d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c201a4cf0 con 0x7f2c20100710 2023-09-23T09:48:42.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.837+0000 7f2c2539d700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c201a4e30 con 0x7f2c201010d0 2023-09-23T09:48:42.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.837+0000 7f2c1ffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c20100710 0x7f2c20072c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:48:42.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.837+0000 7f2c24b9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c20106720 0x7f2c201a47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:48:42.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.837+0000 7f2c1ffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c20100710 0x7f2c20072c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:32876/0 (socket says 172.21.15.82:32876) 2023-09-23T09:48:42.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.837+0000 7f2c1ffff700 1 -- 172.21.15.82:0/1721398581 learned_addr learned my addr 172.21.15.82:0/1721398581 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:48:42.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.837+0000 7f2c1f7fe700 1 --2- 172.21.15.82:0/1721398581 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2c201010d0 0x7f2c20073160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:48:42.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.837+0000 7f2c24b9c700 1 -- 172.21.15.82:0/1721398581 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2c201010d0 msgr2=0x7f2c20073160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:48:42.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.837+0000 7f2c24b9c700 1 --2- 172.21.15.82:0/1721398581 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2c201010d0 0x7f2c20073160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:42.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.837+0000 7f2c24b9c700 1 -- 172.21.15.82:0/1721398581 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c20100710 msgr2=0x7f2c20072c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:48:42.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.837+0000 7f2c24b9c700 1 --2- 172.21.15.82:0/1721398581 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c20100710 0x7f2c20072c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:42.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.837+0000 7f2c24b9c700 1 -- 172.21.15.82:0/1721398581 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c100095f0 con 0x7f2c20106720 2023-09-23T09:48:42.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.837+0000 7f2c1ffff700 1 --2- 172.21.15.82:0/1721398581 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c20100710 0x7f2c20072c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:48:42.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.838+0000 7f2c24b9c700 1 --2- 172.21.15.82:0/1721398581 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c20106720 0x7f2c201a47b0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f2c1800efc0 tx=0x7f2c1800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:48:42.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.838+0000 7f2c1d7fa700 1 -- 172.21.15.82:0/1721398581 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c18018070 con 0x7f2c20106720 2023-09-23T09:48:42.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.838+0000 7f2c1d7fa700 1 -- 172.21.15.82:0/1721398581 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2c1800f040 con 0x7f2c20106720 2023-09-23T09:48:42.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.838+0000 7f2c2539d700 1 -- 172.21.15.82:0/1721398581 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c201a5030 con 0x7f2c20106720 2023-09-23T09:48:42.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.838+0000 7f2c1d7fa700 1 -- 172.21.15.82:0/1721398581 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c1800cba0 con 0x7f2c20106720 2023-09-23T09:48:42.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.838+0000 7f2c2539d700 1 -- 172.21.15.82:0/1721398581 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c201a54c0 con 0x7f2c20106720 2023-09-23T09:48:42.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.839+0000 7f2c2539d700 1 -- 172.21.15.82:0/1721398581 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c20067630 con 0x7f2c20106720 2023-09-23T09:48:42.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.841+0000 7f2c1d7fa700 1 -- 172.21.15.82:0/1721398581 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f2c18003a00 con 0x7f2c20106720 2023-09-23T09:48:42.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.842+0000 7f2c1d7fa700 1 --2- 172.21.15.82:0/1721398581 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f2c080a01b0 0x7f2c080a2670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:48:42.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.843+0000 7f2c1d7fa700 1 -- 172.21.15.82:0/1721398581 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f2c180cb710 con 0x7f2c20106720 2023-09-23T09:48:42.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.843+0000 7f2c1ffff700 1 --2- 172.21.15.82:0/1721398581 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f2c080a01b0 0x7f2c080a2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:48:42.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.843+0000 7f2c1ffff700 1 --2- 172.21.15.82:0/1721398581 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f2c080a01b0 0x7f2c080a2670 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2c10006010 tx=0x7f2c1000b260 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:48:42.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:42.845+0000 7f2c1d7fa700 1 -- 172.21.15.82:0/1721398581 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f2c18095190 con 0x7f2c20106720 2023-09-23T09:48:43.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:43.104+0000 7f2c2539d700 1 -- 172.21.15.82:0/1721398581 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) v1 -- 0x7f2c20074150 con 0x7f2c20106720 2023-09-23T09:48:43.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:43.115+0000 7f2c1d7fa700 1 -- 172.21.15.82:0/1721398581 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v26) v1 ==== 81+0+728383 (secure 0 0 0) 0x7f2c180987b0 con 0x7f2c20106720 2023-09-23T09:48:43.125 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T09:48:43.126 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:48:43.126 INFO:teuthology.orchestra.run.smithi082.stdout: "epoch": 26, 2023-09-23T09:48:43.126 INFO:teuthology.orchestra.run.smithi082.stdout: "active_gid": 15537, 2023-09-23T09:48:43.126 INFO:teuthology.orchestra.run.smithi082.stdout: "active_name": "x", 2023-09-23T09:48:43.126 INFO:teuthology.orchestra.run.smithi082.stdout: "active_addrs": { 2023-09-23T09:48:43.126 INFO:teuthology.orchestra.run.smithi082.stdout: "addrvec": [ 2023-09-23T09:48:43.126 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:43.126 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "v2", 2023-09-23T09:48:43.126 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": "172.21.15.82:6800", 2023-09-23T09:48:43.126 INFO:teuthology.orchestra.run.smithi082.stdout: "nonce": 630725563 2023-09-23T09:48:43.127 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.127 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:43.127 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "v1", 2023-09-23T09:48:43.127 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": "172.21.15.82:6801", 2023-09-23T09:48:43.127 INFO:teuthology.orchestra.run.smithi082.stdout: "nonce": 630725563 2023-09-23T09:48:43.127 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.127 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2023-09-23T09:48:43.127 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.127 INFO:teuthology.orchestra.run.smithi082.stdout: "active_addr": "172.21.15.82:6801/630725563", 2023-09-23T09:48:43.127 INFO:teuthology.orchestra.run.smithi082.stdout: "active_change": "2023-09-23T08:56:53.092025+0000", 2023-09-23T09:48:43.127 INFO:teuthology.orchestra.run.smithi082.stdout: "active_mgr_features": 4540138322906710015, 2023-09-23T09:48:43.127 INFO:teuthology.orchestra.run.smithi082.stdout: "available": true, 2023-09-23T09:48:43.128 INFO:teuthology.orchestra.run.smithi082.stdout: "standbys": [ 2023-09-23T09:48:43.128 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:43.128 INFO:teuthology.orchestra.run.smithi082.stdout: "gid": 25259, 2023-09-23T09:48:43.128 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "y", 2023-09-23T09:48:43.128 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr_features": 4540138322906710015, 2023-09-23T09:48:43.128 INFO:teuthology.orchestra.run.smithi082.stdout: "available_modules": [ 2023-09-23T09:48:43.128 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:43.128 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "alerts", 2023-09-23T09:48:43.128 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:43.128 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:43.128 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:43.128 INFO:teuthology.orchestra.run.smithi082.stdout: "interval": { 2023-09-23T09:48:43.129 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "interval", 2023-09-23T09:48:43.129 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2023-09-23T09:48:43.129 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.129 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.129 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "60", 2023-09-23T09:48:43.129 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.129 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.129 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.129 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "How frequently to reexamine health status", 2023-09-23T09:48:43.129 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.129 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.130 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.130 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.130 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:43.130 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:43.130 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.130 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.130 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.130 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.130 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.130 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.130 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.130 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.131 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.131 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.131 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.131 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.131 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.131 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.131 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.131 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.131 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.131 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.131 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.131 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:43.132 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:43.132 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.132 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.132 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.132 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.132 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.132 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.132 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.132 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.132 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.132 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.132 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.133 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.133 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:43.133 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:43.133 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.133 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.133 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.133 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:43.133 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.133 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.133 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.133 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.133 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.134 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.134 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.134 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.134 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.134 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.134 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.134 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.134 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.134 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.134 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.134 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:43.134 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:43.135 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.135 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.135 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.135 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.135 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.135 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.135 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.135 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.135 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.135 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.135 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.135 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.136 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_destination": { 2023-09-23T09:48:43.136 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_destination", 2023-09-23T09:48:43.136 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.136 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.136 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.136 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.136 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.136 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.136 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.136 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Email address to send alerts to", 2023-09-23T09:48:43.136 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.136 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.137 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.137 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.137 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_from_name": { 2023-09-23T09:48:43.137 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_from_name", 2023-09-23T09:48:43.137 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.137 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.137 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.137 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "Ceph", 2023-09-23T09:48:43.137 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.137 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.137 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.137 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Email From: name", 2023-09-23T09:48:43.138 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.138 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.138 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.138 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.138 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_host": { 2023-09-23T09:48:43.138 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_host", 2023-09-23T09:48:43.138 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.138 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.138 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.138 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.138 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.138 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.139 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.139 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "SMTP server", 2023-09-23T09:48:43.139 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.139 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.139 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.139 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.139 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_password": { 2023-09-23T09:48:43.139 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_password", 2023-09-23T09:48:43.139 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.139 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.139 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.139 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.140 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.140 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.140 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.140 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Password to authenticate with", 2023-09-23T09:48:43.140 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.140 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.140 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.140 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.140 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_port": { 2023-09-23T09:48:43.140 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_port", 2023-09-23T09:48:43.140 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:43.140 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.141 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.141 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "465", 2023-09-23T09:48:43.141 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.141 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.141 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.141 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "SMTP port", 2023-09-23T09:48:43.141 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.141 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.141 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.141 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.141 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_sender": { 2023-09-23T09:48:43.141 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_sender", 2023-09-23T09:48:43.141 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.142 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.142 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.142 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.142 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.142 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.142 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.142 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "SMTP envelope sender", 2023-09-23T09:48:43.142 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.142 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.142 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.142 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.143 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_ssl": { 2023-09-23T09:48:43.143 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_ssl", 2023-09-23T09:48:43.143 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.143 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.143 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.143 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:43.143 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.143 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.143 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.143 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Use SSL to connect to SMTP server", 2023-09-23T09:48:43.143 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.143 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.144 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.144 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.144 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_user": { 2023-09-23T09:48:43.144 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_user", 2023-09-23T09:48:43.144 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.144 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.144 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.144 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.144 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.144 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.144 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.144 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "User to authenticate as", 2023-09-23T09:48:43.145 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.145 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.145 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.145 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.145 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.145 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.145 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:43.145 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "balancer", 2023-09-23T09:48:43.145 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:43.145 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:43.145 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:43.145 INFO:teuthology.orchestra.run.smithi082.stdout: "active": { 2023-09-23T09:48:43.146 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "active", 2023-09-23T09:48:43.146 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.146 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.146 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.146 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:43.146 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.146 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.146 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.146 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "automatically balance PGs across cluster", 2023-09-23T09:48:43.146 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.146 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.146 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.147 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.147 INFO:teuthology.orchestra.run.smithi082.stdout: "begin_time": { 2023-09-23T09:48:43.147 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "begin_time", 2023-09-23T09:48:43.147 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.147 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.147 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.147 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0000", 2023-09-23T09:48:43.147 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.147 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.147 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.147 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "beginning time of day to automatically balance", 2023-09-23T09:48:43.147 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-09-23T09:48:43.148 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.148 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.148 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.148 INFO:teuthology.orchestra.run.smithi082.stdout: "begin_weekday": { 2023-09-23T09:48:43.148 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "begin_weekday", 2023-09-23T09:48:43.148 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "uint", 2023-09-23T09:48:43.148 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.148 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.148 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2023-09-23T09:48:43.148 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "0", 2023-09-23T09:48:43.148 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "6", 2023-09-23T09:48:43.148 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.149 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-09-23T09:48:43.149 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-09-23T09:48:43.149 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.149 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.149 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.149 INFO:teuthology.orchestra.run.smithi082.stdout: "crush_compat_max_iterations": { 2023-09-23T09:48:43.149 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "crush_compat_max_iterations", 2023-09-23T09:48:43.149 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "uint", 2023-09-23T09:48:43.149 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.149 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.149 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "25", 2023-09-23T09:48:43.149 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "1", 2023-09-23T09:48:43.150 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "250", 2023-09-23T09:48:43.150 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.150 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-09-23T09:48:43.150 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.150 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.150 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.150 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.150 INFO:teuthology.orchestra.run.smithi082.stdout: "crush_compat_metrics": { 2023-09-23T09:48:43.150 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "crush_compat_metrics", 2023-09-23T09:48:43.150 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.150 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.150 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.151 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "pgs,objects,bytes", 2023-09-23T09:48:43.151 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.151 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.151 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.151 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-09-23T09:48:43.151 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-09-23T09:48:43.151 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.151 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.151 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.151 INFO:teuthology.orchestra.run.smithi082.stdout: "crush_compat_step": { 2023-09-23T09:48:43.151 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "crush_compat_step", 2023-09-23T09:48:43.151 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2023-09-23T09:48:43.152 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.152 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.152 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0.5", 2023-09-23T09:48:43.152 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "0.001", 2023-09-23T09:48:43.152 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "0.999", 2023-09-23T09:48:43.152 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.152 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "aggressiveness of optimization", 2023-09-23T09:48:43.152 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-09-23T09:48:43.152 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.152 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.152 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.152 INFO:teuthology.orchestra.run.smithi082.stdout: "end_time": { 2023-09-23T09:48:43.153 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "end_time", 2023-09-23T09:48:43.153 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.153 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.153 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.153 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "2359", 2023-09-23T09:48:43.153 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.153 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.153 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.153 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "ending time of day to automatically balance", 2023-09-23T09:48:43.153 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-09-23T09:48:43.153 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.153 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.154 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.154 INFO:teuthology.orchestra.run.smithi082.stdout: "end_weekday": { 2023-09-23T09:48:43.154 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "end_weekday", 2023-09-23T09:48:43.154 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "uint", 2023-09-23T09:48:43.154 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.154 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.154 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2023-09-23T09:48:43.154 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "0", 2023-09-23T09:48:43.154 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "6", 2023-09-23T09:48:43.154 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.154 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-09-23T09:48:43.154 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-09-23T09:48:43.155 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.155 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.155 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.155 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:43.155 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:43.155 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.155 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.155 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.155 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.155 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.155 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.155 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.156 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.156 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.156 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.156 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.156 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.156 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.156 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.156 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.156 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.156 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.156 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.156 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.156 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:43.157 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:43.157 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.157 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.157 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.157 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.157 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.157 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.157 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.157 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.157 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.157 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.158 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.158 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.158 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:43.158 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:43.158 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.158 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.158 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.158 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:43.158 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.158 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.158 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.158 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.159 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.159 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.159 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.159 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.159 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.159 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.159 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.159 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.159 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.159 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.159 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.159 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:43.160 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:43.160 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.160 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.160 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.160 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.160 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.160 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.160 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.160 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.160 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.160 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.160 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.161 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.161 INFO:teuthology.orchestra.run.smithi082.stdout: "min_score": { 2023-09-23T09:48:43.161 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "min_score", 2023-09-23T09:48:43.161 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2023-09-23T09:48:43.161 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.161 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.161 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2023-09-23T09:48:43.161 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.161 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.161 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.161 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-09-23T09:48:43.161 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.162 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.162 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.162 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.162 INFO:teuthology.orchestra.run.smithi082.stdout: "mode": { 2023-09-23T09:48:43.162 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mode", 2023-09-23T09:48:43.162 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.162 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.162 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.162 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "upmap", 2023-09-23T09:48:43.162 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.162 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.162 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.163 INFO:teuthology.orchestra.run.smithi082.stdout: "crush-compat", 2023-09-23T09:48:43.163 INFO:teuthology.orchestra.run.smithi082.stdout: "none", 2023-09-23T09:48:43.163 INFO:teuthology.orchestra.run.smithi082.stdout: "upmap" 2023-09-23T09:48:43.163 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.163 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Balancer mode", 2023-09-23T09:48:43.163 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.163 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.163 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.163 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.163 INFO:teuthology.orchestra.run.smithi082.stdout: "pool_ids": { 2023-09-23T09:48:43.163 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "pool_ids", 2023-09-23T09:48:43.163 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.164 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.164 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.164 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.164 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.164 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.164 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.164 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-09-23T09:48:43.164 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.164 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.164 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.164 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.164 INFO:teuthology.orchestra.run.smithi082.stdout: "sleep_interval": { 2023-09-23T09:48:43.165 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sleep_interval", 2023-09-23T09:48:43.165 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2023-09-23T09:48:43.165 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.165 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.165 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "60", 2023-09-23T09:48:43.165 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.165 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.165 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.165 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-09-23T09:48:43.165 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.165 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.165 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.165 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.166 INFO:teuthology.orchestra.run.smithi082.stdout: "upmap_max_deviation": { 2023-09-23T09:48:43.166 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "upmap_max_deviation", 2023-09-23T09:48:43.166 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:43.166 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.166 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.166 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "5", 2023-09-23T09:48:43.166 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "1", 2023-09-23T09:48:43.166 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.166 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.166 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "deviation below which no optimization is attempted", 2023-09-23T09:48:43.166 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-09-23T09:48:43.166 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.167 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.167 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.167 INFO:teuthology.orchestra.run.smithi082.stdout: "upmap_max_optimizations": { 2023-09-23T09:48:43.167 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "upmap_max_optimizations", 2023-09-23T09:48:43.167 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "uint", 2023-09-23T09:48:43.167 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.167 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.167 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2023-09-23T09:48:43.167 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.167 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.167 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.167 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-09-23T09:48:43.168 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.168 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.168 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.168 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.168 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.168 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.168 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:43.168 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cephadm", 2023-09-23T09:48:43.168 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:43.168 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:43.168 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:43.168 INFO:teuthology.orchestra.run.smithi082.stdout: "agent_down_multiplier": { 2023-09-23T09:48:43.169 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "agent_down_multiplier", 2023-09-23T09:48:43.169 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2023-09-23T09:48:43.169 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.169 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.169 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "3.0", 2023-09-23T09:48:43.169 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.169 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.169 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.169 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-09-23T09:48:43.169 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.169 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.169 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.170 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.170 INFO:teuthology.orchestra.run.smithi082.stdout: "agent_refresh_rate": { 2023-09-23T09:48:43.170 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "agent_refresh_rate", 2023-09-23T09:48:43.170 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2023-09-23T09:48:43.170 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.170 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.170 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "20", 2023-09-23T09:48:43.170 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.170 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.170 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.170 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-09-23T09:48:43.170 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.171 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.171 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.171 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.171 INFO:teuthology.orchestra.run.smithi082.stdout: "agent_starting_port": { 2023-09-23T09:48:43.171 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "agent_starting_port", 2023-09-23T09:48:43.171 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:43.171 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.171 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.171 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "4721", 2023-09-23T09:48:43.171 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.171 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.171 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.171 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-09-23T09:48:43.172 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.172 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.172 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.172 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.172 INFO:teuthology.orchestra.run.smithi082.stdout: "allow_ptrace": { 2023-09-23T09:48:43.172 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "allow_ptrace", 2023-09-23T09:48:43.172 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.172 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.172 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.172 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.172 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.173 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.173 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.173 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-09-23T09:48:43.173 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-09-23T09:48:43.173 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.173 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.173 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.173 INFO:teuthology.orchestra.run.smithi082.stdout: "autotune_interval": { 2023-09-23T09:48:43.173 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "autotune_interval", 2023-09-23T09:48:43.173 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2023-09-23T09:48:43.173 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.173 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.174 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "600", 2023-09-23T09:48:43.174 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.174 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.174 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.174 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how frequently to autotune daemon memory", 2023-09-23T09:48:43.174 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.174 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.174 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.174 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.174 INFO:teuthology.orchestra.run.smithi082.stdout: "autotune_memory_target_ratio": { 2023-09-23T09:48:43.174 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "autotune_memory_target_ratio", 2023-09-23T09:48:43.174 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2023-09-23T09:48:43.175 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.175 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.175 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0.7", 2023-09-23T09:48:43.175 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.175 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.175 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.175 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-09-23T09:48:43.175 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.175 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.175 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.175 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.176 INFO:teuthology.orchestra.run.smithi082.stdout: "cgroups_split": { 2023-09-23T09:48:43.176 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cgroups_split", 2023-09-23T09:48:43.176 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.176 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.176 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.176 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:43.176 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.176 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.176 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.176 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-09-23T09:48:43.176 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.176 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.177 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.177 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.177 INFO:teuthology.orchestra.run.smithi082.stdout: "config_checks_enabled": { 2023-09-23T09:48:43.177 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "config_checks_enabled", 2023-09-23T09:48:43.177 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.177 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.177 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.177 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.177 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.177 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.177 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.177 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-09-23T09:48:43.177 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.178 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.178 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.178 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.178 INFO:teuthology.orchestra.run.smithi082.stdout: "config_dashboard": { 2023-09-23T09:48:43.178 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "config_dashboard", 2023-09-23T09:48:43.178 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.178 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.178 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.178 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:43.178 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.178 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.178 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.179 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-09-23T09:48:43.179 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.179 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.179 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.179 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.179 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_alertmanager": { 2023-09-23T09:48:43.179 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_alertmanager", 2023-09-23T09:48:43.179 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.179 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.179 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.179 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-09-23T09:48:43.179 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.180 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.180 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.180 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Prometheus container image", 2023-09-23T09:48:43.180 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.180 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.180 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.180 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.180 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_base": { 2023-09-23T09:48:43.180 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_base", 2023-09-23T09:48:43.180 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.180 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.180 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.181 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/ceph/ceph", 2023-09-23T09:48:43.181 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.181 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.181 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.181 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Container image name, without the tag", 2023-09-23T09:48:43.181 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.181 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.181 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.181 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.181 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_elasticsearch": { 2023-09-23T09:48:43.181 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_elasticsearch", 2023-09-23T09:48:43.181 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.181 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.182 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.182 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2023-09-23T09:48:43.182 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.182 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.182 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.182 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "elasticsearch container image", 2023-09-23T09:48:43.182 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.182 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.182 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.182 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.182 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_grafana": { 2023-09-23T09:48:43.182 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_grafana", 2023-09-23T09:48:43.183 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.183 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.183 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.183 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-09-23T09:48:43.183 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.183 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.183 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.183 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Prometheus container image", 2023-09-23T09:48:43.183 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.183 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.183 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.183 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.184 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_haproxy": { 2023-09-23T09:48:43.184 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_haproxy", 2023-09-23T09:48:43.184 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.184 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.184 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.184 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-09-23T09:48:43.184 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.184 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.184 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.184 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "HAproxy container image", 2023-09-23T09:48:43.184 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.184 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.185 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.185 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.185 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_jaeger_agent": { 2023-09-23T09:48:43.185 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_jaeger_agent", 2023-09-23T09:48:43.185 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.185 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.185 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.185 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2023-09-23T09:48:43.185 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.185 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.185 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.185 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Jaeger agent container image", 2023-09-23T09:48:43.186 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.186 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.186 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.186 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.186 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_jaeger_collector": { 2023-09-23T09:48:43.186 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_jaeger_collector", 2023-09-23T09:48:43.186 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.186 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.186 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.186 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2023-09-23T09:48:43.186 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.187 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.187 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.187 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Jaeger collector container image", 2023-09-23T09:48:43.187 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.187 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.187 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.187 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.187 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_jaeger_query": { 2023-09-23T09:48:43.187 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_jaeger_query", 2023-09-23T09:48:43.187 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.187 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.187 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.188 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2023-09-23T09:48:43.188 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.188 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.188 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.188 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Jaeger query container image", 2023-09-23T09:48:43.188 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.188 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.188 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.188 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.188 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_keepalived": { 2023-09-23T09:48:43.188 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_keepalived", 2023-09-23T09:48:43.188 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.189 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.189 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.189 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2023-09-23T09:48:43.189 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.189 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.189 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.189 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Keepalived container image", 2023-09-23T09:48:43.189 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.189 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.189 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.189 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.189 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_loki": { 2023-09-23T09:48:43.189 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_loki", 2023-09-23T09:48:43.190 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.190 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.190 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.190 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-09-23T09:48:43.190 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.190 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.190 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.190 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Loki container image", 2023-09-23T09:48:43.190 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.190 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.190 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.191 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.191 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_node_exporter": { 2023-09-23T09:48:43.191 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_node_exporter", 2023-09-23T09:48:43.191 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.191 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.191 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.191 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-09-23T09:48:43.191 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.191 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.191 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.191 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Prometheus container image", 2023-09-23T09:48:43.191 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.192 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.192 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.192 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.192 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_nvmeof": { 2023-09-23T09:48:43.192 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_nvmeof", 2023-09-23T09:48:43.192 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.192 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.192 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.192 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/ceph/nvmeof:0.0.2", 2023-09-23T09:48:43.192 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.192 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.192 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.193 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Nvme-of container image", 2023-09-23T09:48:43.193 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.193 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.193 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.193 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.193 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_prometheus": { 2023-09-23T09:48:43.193 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_prometheus", 2023-09-23T09:48:43.193 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.193 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.193 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.193 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-09-23T09:48:43.193 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.193 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.194 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.194 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Prometheus container image", 2023-09-23T09:48:43.194 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.194 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.194 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.194 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.194 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_promtail": { 2023-09-23T09:48:43.194 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_promtail", 2023-09-23T09:48:43.194 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.194 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.194 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.194 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-09-23T09:48:43.195 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.195 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.195 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.195 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Promtail container image", 2023-09-23T09:48:43.195 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.195 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.195 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.195 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.195 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_snmp_gateway": { 2023-09-23T09:48:43.195 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_snmp_gateway", 2023-09-23T09:48:43.195 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.195 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.196 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.196 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-09-23T09:48:43.196 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.196 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.196 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.196 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "SNMP Gateway container image", 2023-09-23T09:48:43.196 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.196 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.196 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.196 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.196 INFO:teuthology.orchestra.run.smithi082.stdout: "container_init": { 2023-09-23T09:48:43.196 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_init", 2023-09-23T09:48:43.197 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.197 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.197 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.197 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:43.197 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.197 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.197 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.197 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Run podman/docker with `--init`", 2023-09-23T09:48:43.197 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.197 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.197 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.197 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.198 INFO:teuthology.orchestra.run.smithi082.stdout: "daemon_cache_timeout": { 2023-09-23T09:48:43.198 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "daemon_cache_timeout", 2023-09-23T09:48:43.198 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2023-09-23T09:48:43.198 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.198 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.198 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "600", 2023-09-23T09:48:43.198 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.198 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.198 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.198 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-09-23T09:48:43.198 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.199 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.199 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.199 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.199 INFO:teuthology.orchestra.run.smithi082.stdout: "default_cephadm_command_timeout": { 2023-09-23T09:48:43.199 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "default_cephadm_command_timeout", 2023-09-23T09:48:43.199 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2023-09-23T09:48:43.199 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.199 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.199 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "900", 2023-09-23T09:48:43.199 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.199 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.199 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.199 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-09-23T09:48:43.200 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.200 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.200 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.200 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.200 INFO:teuthology.orchestra.run.smithi082.stdout: "default_registry": { 2023-09-23T09:48:43.200 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "default_registry", 2023-09-23T09:48:43.200 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.200 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.200 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.200 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "docker.io", 2023-09-23T09:48:43.200 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.201 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.201 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.201 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-09-23T09:48:43.201 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.201 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.201 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.201 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.201 INFO:teuthology.orchestra.run.smithi082.stdout: "device_cache_timeout": { 2023-09-23T09:48:43.201 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "device_cache_timeout", 2023-09-23T09:48:43.201 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2023-09-23T09:48:43.201 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.201 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.202 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "1800", 2023-09-23T09:48:43.202 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.202 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.202 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.202 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "seconds to cache device inventory", 2023-09-23T09:48:43.202 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.202 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.202 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.202 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.202 INFO:teuthology.orchestra.run.smithi082.stdout: "device_enhanced_scan": { 2023-09-23T09:48:43.202 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "device_enhanced_scan", 2023-09-23T09:48:43.202 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.203 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.203 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.203 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.203 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.203 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.203 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.203 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Use libstoragemgmt during device scans", 2023-09-23T09:48:43.203 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.203 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.203 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.203 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.203 INFO:teuthology.orchestra.run.smithi082.stdout: "facts_cache_timeout": { 2023-09-23T09:48:43.204 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "facts_cache_timeout", 2023-09-23T09:48:43.204 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2023-09-23T09:48:43.204 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.204 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.204 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "60", 2023-09-23T09:48:43.204 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.204 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.204 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.204 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "seconds to cache host facts data", 2023-09-23T09:48:43.204 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.204 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.204 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.205 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.205 INFO:teuthology.orchestra.run.smithi082.stdout: "host_check_interval": { 2023-09-23T09:48:43.205 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "host_check_interval", 2023-09-23T09:48:43.205 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2023-09-23T09:48:43.205 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.205 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.205 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "600", 2023-09-23T09:48:43.205 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.205 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.205 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.205 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how frequently to perform a host check", 2023-09-23T09:48:43.205 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.205 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.206 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.206 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.206 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:43.206 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:43.206 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.206 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.206 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.206 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.206 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.206 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.206 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.206 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.207 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.207 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.207 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.207 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.207 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.207 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.207 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.207 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.207 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.207 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.207 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.207 INFO:teuthology.orchestra.run.smithi082.stdout: "log_refresh_metadata": { 2023-09-23T09:48:43.207 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_refresh_metadata", 2023-09-23T09:48:43.208 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.208 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.208 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.208 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.208 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.208 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.208 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.208 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-09-23T09:48:43.208 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.208 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.208 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.208 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.209 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:43.209 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:43.209 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.209 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.209 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.209 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:43.209 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.209 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.209 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.209 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-09-23T09:48:43.209 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.209 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.209 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.210 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.210 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:43.210 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:43.210 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.210 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.210 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.210 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:43.210 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.210 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.210 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.210 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.210 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.211 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.211 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.211 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.211 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.211 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.211 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.211 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.211 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.211 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.211 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.211 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:43.211 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:43.211 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.212 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.212 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.212 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.212 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.212 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.212 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.212 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.212 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.212 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.212 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.212 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.212 INFO:teuthology.orchestra.run.smithi082.stdout: "manage_etc_ceph_ceph_conf": { 2023-09-23T09:48:43.212 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-09-23T09:48:43.213 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.213 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.213 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.213 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.213 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.213 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.213 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.213 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-09-23T09:48:43.213 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.213 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.213 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.213 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.214 INFO:teuthology.orchestra.run.smithi082.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-09-23T09:48:43.214 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-09-23T09:48:43.214 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.214 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.214 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.214 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "*", 2023-09-23T09:48:43.214 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.214 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.214 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.214 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-09-23T09:48:43.214 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.214 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.215 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.215 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.215 INFO:teuthology.orchestra.run.smithi082.stdout: "max_count_per_host": { 2023-09-23T09:48:43.215 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "max_count_per_host", 2023-09-23T09:48:43.215 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:43.215 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.215 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.215 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2023-09-23T09:48:43.215 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.215 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.215 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.215 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "max number of daemons per service per host", 2023-09-23T09:48:43.216 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.216 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.216 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.216 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.216 INFO:teuthology.orchestra.run.smithi082.stdout: "max_osd_draining_count": { 2023-09-23T09:48:43.216 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "max_osd_draining_count", 2023-09-23T09:48:43.216 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:43.216 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.216 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.216 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2023-09-23T09:48:43.216 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.216 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.217 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.217 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-09-23T09:48:43.217 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.217 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.217 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.217 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.217 INFO:teuthology.orchestra.run.smithi082.stdout: "migration_current": { 2023-09-23T09:48:43.217 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "migration_current", 2023-09-23T09:48:43.217 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:43.217 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.217 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.217 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.217 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.218 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.218 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.218 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "internal - do not modify", 2023-09-23T09:48:43.218 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.218 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.218 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.218 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.218 INFO:teuthology.orchestra.run.smithi082.stdout: "mode": { 2023-09-23T09:48:43.218 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mode", 2023-09-23T09:48:43.218 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.218 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.218 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.219 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "root", 2023-09-23T09:48:43.219 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.219 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.219 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.219 INFO:teuthology.orchestra.run.smithi082.stdout: "cephadm-package", 2023-09-23T09:48:43.219 INFO:teuthology.orchestra.run.smithi082.stdout: "root" 2023-09-23T09:48:43.219 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.219 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "mode for remote execution of cephadm", 2023-09-23T09:48:43.219 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.219 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.219 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.219 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.219 INFO:teuthology.orchestra.run.smithi082.stdout: "prometheus_alerts_path": { 2023-09-23T09:48:43.220 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "prometheus_alerts_path", 2023-09-23T09:48:43.220 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.220 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.220 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.220 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-09-23T09:48:43.220 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.220 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.220 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.220 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-09-23T09:48:43.220 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.220 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.220 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.221 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.221 INFO:teuthology.orchestra.run.smithi082.stdout: "registry_insecure": { 2023-09-23T09:48:43.221 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "registry_insecure", 2023-09-23T09:48:43.221 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.221 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.221 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.221 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.221 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.221 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.221 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.221 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-09-23T09:48:43.221 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.222 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.222 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.222 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.222 INFO:teuthology.orchestra.run.smithi082.stdout: "registry_password": { 2023-09-23T09:48:43.222 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "registry_password", 2023-09-23T09:48:43.222 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.222 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.222 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.222 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.222 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.222 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.222 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.223 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-09-23T09:48:43.223 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.223 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.223 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.223 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.223 INFO:teuthology.orchestra.run.smithi082.stdout: "registry_url": { 2023-09-23T09:48:43.223 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "registry_url", 2023-09-23T09:48:43.223 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.223 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.223 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.223 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.224 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.224 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.224 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.224 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-09-23T09:48:43.224 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.224 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.224 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.224 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.224 INFO:teuthology.orchestra.run.smithi082.stdout: "registry_username": { 2023-09-23T09:48:43.224 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "registry_username", 2023-09-23T09:48:43.224 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.224 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.224 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.225 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.225 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.225 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.225 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.225 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-09-23T09:48:43.225 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.225 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.225 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.225 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.225 INFO:teuthology.orchestra.run.smithi082.stdout: "secure_monitoring_stack": { 2023-09-23T09:48:43.225 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "secure_monitoring_stack", 2023-09-23T09:48:43.226 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.226 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.226 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.226 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.226 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.226 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.226 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.226 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2023-09-23T09:48:43.226 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.226 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.226 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.226 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.227 INFO:teuthology.orchestra.run.smithi082.stdout: "service_discovery_port": { 2023-09-23T09:48:43.227 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "service_discovery_port", 2023-09-23T09:48:43.227 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:43.227 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.227 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.227 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "8765", 2023-09-23T09:48:43.227 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.227 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.227 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.227 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "cephadm service discovery port", 2023-09-23T09:48:43.227 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.227 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.228 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.228 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.228 INFO:teuthology.orchestra.run.smithi082.stdout: "ssh_config_file": { 2023-09-23T09:48:43.228 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ssh_config_file", 2023-09-23T09:48:43.228 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.228 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.228 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.228 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.228 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.228 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.228 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.229 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-09-23T09:48:43.229 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.229 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.229 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.229 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.229 INFO:teuthology.orchestra.run.smithi082.stdout: "use_agent": { 2023-09-23T09:48:43.229 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "use_agent", 2023-09-23T09:48:43.229 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.229 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.229 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.229 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.229 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.230 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.230 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.230 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-09-23T09:48:43.230 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.230 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.230 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.230 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.230 INFO:teuthology.orchestra.run.smithi082.stdout: "use_repo_digest": { 2023-09-23T09:48:43.230 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "use_repo_digest", 2023-09-23T09:48:43.230 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.230 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.230 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.231 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:43.231 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.231 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.231 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.231 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-09-23T09:48:43.231 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.231 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.231 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.231 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.231 INFO:teuthology.orchestra.run.smithi082.stdout: "warn_on_failed_host_check": { 2023-09-23T09:48:43.231 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "warn_on_failed_host_check", 2023-09-23T09:48:43.231 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.232 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.232 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.232 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:43.232 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.232 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.232 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.232 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "raise a health warning if the host check fails", 2023-09-23T09:48:43.232 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.232 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.232 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.232 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.232 INFO:teuthology.orchestra.run.smithi082.stdout: "warn_on_stray_daemons": { 2023-09-23T09:48:43.233 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "warn_on_stray_daemons", 2023-09-23T09:48:43.233 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.233 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.233 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.233 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:43.233 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.233 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.233 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.233 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-09-23T09:48:43.233 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.233 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.233 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.234 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.234 INFO:teuthology.orchestra.run.smithi082.stdout: "warn_on_stray_hosts": { 2023-09-23T09:48:43.234 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "warn_on_stray_hosts", 2023-09-23T09:48:43.234 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.234 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.234 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.234 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:43.234 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.234 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.234 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.234 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-09-23T09:48:43.235 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.235 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.235 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.235 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.235 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.235 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.235 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:43.235 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "crash", 2023-09-23T09:48:43.235 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:43.235 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:43.235 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:43.235 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:43.236 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:43.236 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.236 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.236 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.236 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.236 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.236 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.236 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.236 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.236 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.236 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.236 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.237 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.237 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.237 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.237 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.237 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.237 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.237 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.237 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.237 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:43.237 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:43.237 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.237 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.238 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.238 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.238 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.238 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.238 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.238 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.238 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.238 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.238 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.238 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.238 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:43.238 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:43.239 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.239 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.239 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.239 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:43.239 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.239 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.239 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.239 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.239 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.239 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.239 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.239 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.240 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.240 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.240 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.240 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.240 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.240 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.240 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.240 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:43.240 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:43.240 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.240 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.240 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.240 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.241 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.241 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.241 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.241 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.241 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.241 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.241 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.241 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.241 INFO:teuthology.orchestra.run.smithi082.stdout: "retain_interval": { 2023-09-23T09:48:43.241 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "retain_interval", 2023-09-23T09:48:43.241 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2023-09-23T09:48:43.241 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.241 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.242 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "31536000", 2023-09-23T09:48:43.242 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.242 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.242 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.242 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how long to retain crashes before pruning them", 2023-09-23T09:48:43.242 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.242 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.242 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.242 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.242 INFO:teuthology.orchestra.run.smithi082.stdout: "warn_recent_interval": { 2023-09-23T09:48:43.242 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "warn_recent_interval", 2023-09-23T09:48:43.242 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2023-09-23T09:48:43.243 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.243 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.243 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "1209600", 2023-09-23T09:48:43.243 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.243 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.243 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.243 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "time interval in which to warn about recent crashes", 2023-09-23T09:48:43.243 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.243 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.243 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.243 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.244 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.244 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.244 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:43.244 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "dashboard", 2023-09-23T09:48:43.244 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:43.244 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:43.244 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:43.244 INFO:teuthology.orchestra.run.smithi082.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-09-23T09:48:43.244 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-09-23T09:48:43.244 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:43.244 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.244 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.245 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2023-09-23T09:48:43.245 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.245 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.245 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.245 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.245 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.245 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.245 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.245 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.245 INFO:teuthology.orchestra.run.smithi082.stdout: "ALERTMANAGER_API_HOST": { 2023-09-23T09:48:43.245 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ALERTMANAGER_API_HOST", 2023-09-23T09:48:43.245 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.246 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.246 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.246 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.246 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.246 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.246 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.246 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.246 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.246 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.246 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.246 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.247 INFO:teuthology.orchestra.run.smithi082.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-09-23T09:48:43.247 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-09-23T09:48:43.247 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.247 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.247 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.247 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:43.247 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.247 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.247 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.247 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.247 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.247 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.248 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.248 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.248 INFO:teuthology.orchestra.run.smithi082.stdout: "AUDIT_API_ENABLED": { 2023-09-23T09:48:43.248 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "AUDIT_API_ENABLED", 2023-09-23T09:48:43.248 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.248 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.248 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.248 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.248 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.248 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.248 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.248 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.249 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.249 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.249 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.249 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.249 INFO:teuthology.orchestra.run.smithi082.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-09-23T09:48:43.249 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-09-23T09:48:43.249 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.249 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.249 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.249 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:43.249 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.249 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.249 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.250 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.250 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.250 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.250 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.250 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.250 INFO:teuthology.orchestra.run.smithi082.stdout: "ENABLE_BROWSABLE_API": { 2023-09-23T09:48:43.250 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ENABLE_BROWSABLE_API", 2023-09-23T09:48:43.250 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.250 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.250 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.250 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:43.250 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.251 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.251 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.251 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.251 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.251 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.251 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.251 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.251 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-09-23T09:48:43.251 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-09-23T09:48:43.251 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.251 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.251 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.251 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:43.252 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.252 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.252 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.252 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.252 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.252 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.252 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.252 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.252 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-09-23T09:48:43.252 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-09-23T09:48:43.252 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.252 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.252 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.253 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:43.253 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.253 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.253 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.253 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.253 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.253 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.253 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.253 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.253 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-09-23T09:48:43.253 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-09-23T09:48:43.253 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.253 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.254 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.254 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:43.254 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.254 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.254 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.254 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.254 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.254 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.254 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.254 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.254 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-09-23T09:48:43.254 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-09-23T09:48:43.255 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.255 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.255 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.255 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:43.255 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.255 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.255 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.255 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.255 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.255 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.255 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.255 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.256 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_NFS": { 2023-09-23T09:48:43.256 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-09-23T09:48:43.256 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.256 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.256 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.256 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:43.256 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.256 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.256 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.256 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.256 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.256 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.257 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.257 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.257 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_RBD": { 2023-09-23T09:48:43.257 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-09-23T09:48:43.257 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.257 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.257 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.257 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:43.257 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.257 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.257 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.257 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.257 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.258 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.258 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.258 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.258 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_RGW": { 2023-09-23T09:48:43.258 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-09-23T09:48:43.258 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.258 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.258 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.258 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:43.258 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.258 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.258 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.259 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.259 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.259 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.259 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.259 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.259 INFO:teuthology.orchestra.run.smithi082.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-09-23T09:48:43.259 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-09-23T09:48:43.259 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.259 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.259 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.259 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.260 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.260 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.260 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.260 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.260 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.260 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.260 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.260 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.260 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_API_PASSWORD": { 2023-09-23T09:48:43.260 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_API_PASSWORD", 2023-09-23T09:48:43.260 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.260 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.261 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.261 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "admin", 2023-09-23T09:48:43.261 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.261 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.261 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.261 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.261 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.261 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.261 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.261 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.261 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-09-23T09:48:43.261 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-09-23T09:48:43.262 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.262 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.262 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.262 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:43.262 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.262 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.262 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.262 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.262 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.262 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.262 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.262 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.263 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_API_URL": { 2023-09-23T09:48:43.263 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_API_URL", 2023-09-23T09:48:43.263 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.263 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.263 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.263 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.263 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.263 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.263 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.263 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.263 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.263 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.264 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.264 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.264 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_API_USERNAME": { 2023-09-23T09:48:43.264 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_API_USERNAME", 2023-09-23T09:48:43.264 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.264 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.264 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.264 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "admin", 2023-09-23T09:48:43.264 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.264 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.264 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.265 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.265 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.265 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.265 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.265 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.265 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-09-23T09:48:43.265 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-09-23T09:48:43.265 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.265 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.265 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.265 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.265 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.266 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.266 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.266 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.266 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.266 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.266 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.266 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.266 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-09-23T09:48:43.266 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-09-23T09:48:43.266 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.266 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.267 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.267 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.267 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.267 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.267 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.267 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.267 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.267 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.267 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.267 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.267 INFO:teuthology.orchestra.run.smithi082.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-09-23T09:48:43.267 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-09-23T09:48:43.267 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.268 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.268 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.268 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:43.268 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.268 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.268 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.268 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.268 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.268 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.268 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.268 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.268 INFO:teuthology.orchestra.run.smithi082.stdout: "ISSUE_TRACKER_API_KEY": { 2023-09-23T09:48:43.268 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-09-23T09:48:43.269 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.269 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.269 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.269 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.269 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.269 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.269 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.269 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.269 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.269 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.269 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.269 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.270 INFO:teuthology.orchestra.run.smithi082.stdout: "PROMETHEUS_API_HOST": { 2023-09-23T09:48:43.270 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PROMETHEUS_API_HOST", 2023-09-23T09:48:43.270 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.270 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.270 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.270 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.270 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.270 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.270 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.270 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.270 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.270 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.271 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.271 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.271 INFO:teuthology.orchestra.run.smithi082.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-09-23T09:48:43.271 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-09-23T09:48:43.271 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.271 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.271 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.271 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:43.271 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.271 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.271 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.271 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.272 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.272 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.272 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.272 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.272 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-09-23T09:48:43.272 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-09-23T09:48:43.272 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.272 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.272 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.272 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.272 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.272 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.272 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.273 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.273 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.273 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.273 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.273 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.273 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-09-23T09:48:43.273 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-09-23T09:48:43.273 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.273 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.273 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.273 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.273 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.274 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.274 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.274 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.274 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.274 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.274 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.274 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.274 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-09-23T09:48:43.274 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-09-23T09:48:43.274 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.274 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.275 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.275 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:43.275 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.275 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.275 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.275 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.275 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.275 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.275 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.275 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.275 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-09-23T09:48:43.275 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-09-23T09:48:43.276 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.276 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.276 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.276 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:43.276 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.277 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.277 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.277 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.277 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.277 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.277 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.277 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.277 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-09-23T09:48:43.277 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-09-23T09:48:43.277 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.278 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.278 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.278 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.278 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.278 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.278 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.278 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.278 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.278 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.278 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.278 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.278 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-09-23T09:48:43.279 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-09-23T09:48:43.279 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.279 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.279 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.279 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.279 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.279 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.279 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.279 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.279 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.279 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.279 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.280 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.280 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-09-23T09:48:43.280 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-09-23T09:48:43.280 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.280 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.280 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.280 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.280 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.280 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.280 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.280 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.280 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.281 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.281 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.281 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.281 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_ENABLED": { 2023-09-23T09:48:43.281 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_ENABLED", 2023-09-23T09:48:43.281 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.281 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.281 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.281 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:43.281 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.281 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.281 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.282 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.282 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.282 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.282 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.282 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.282 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-09-23T09:48:43.282 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-09-23T09:48:43.282 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.282 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.282 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.282 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-09-23T09:48:43.283 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.283 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.283 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.283 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.283 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.283 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.283 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.283 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.283 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-09-23T09:48:43.283 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-09-23T09:48:43.283 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:43.284 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.284 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.284 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2023-09-23T09:48:43.284 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.284 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.284 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.284 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.284 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.284 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.284 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.284 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.284 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-09-23T09:48:43.285 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-09-23T09:48:43.285 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:43.285 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.285 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.285 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "8", 2023-09-23T09:48:43.285 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.285 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.285 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.285 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.285 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.285 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.285 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.286 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.286 INFO:teuthology.orchestra.run.smithi082.stdout: "REST_REQUESTS_TIMEOUT": { 2023-09-23T09:48:43.286 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-09-23T09:48:43.286 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:43.286 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.286 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.286 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "45", 2023-09-23T09:48:43.286 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.286 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.286 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.286 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.287 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.287 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.287 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.287 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.287 INFO:teuthology.orchestra.run.smithi082.stdout: "RGW_API_ACCESS_KEY": { 2023-09-23T09:48:43.287 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "RGW_API_ACCESS_KEY", 2023-09-23T09:48:43.287 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.287 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.287 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.287 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.287 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.287 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.288 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.288 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.288 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.288 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.288 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.288 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.288 INFO:teuthology.orchestra.run.smithi082.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-09-23T09:48:43.288 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-09-23T09:48:43.288 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.288 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.288 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.288 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "admin", 2023-09-23T09:48:43.288 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.289 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.289 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.289 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.289 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.289 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.289 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.289 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.289 INFO:teuthology.orchestra.run.smithi082.stdout: "RGW_API_SECRET_KEY": { 2023-09-23T09:48:43.289 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "RGW_API_SECRET_KEY", 2023-09-23T09:48:43.289 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.289 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.290 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.290 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.290 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.290 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.290 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.290 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.290 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.290 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.290 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.291 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.291 INFO:teuthology.orchestra.run.smithi082.stdout: "RGW_API_SSL_VERIFY": { 2023-09-23T09:48:43.291 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "RGW_API_SSL_VERIFY", 2023-09-23T09:48:43.291 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.291 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.291 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.291 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:43.291 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.291 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.291 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.291 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.291 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.292 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.292 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.292 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.292 INFO:teuthology.orchestra.run.smithi082.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-09-23T09:48:43.292 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-09-23T09:48:43.292 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:43.292 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.292 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.292 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2023-09-23T09:48:43.292 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.292 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.293 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.293 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.293 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.293 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.293 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.293 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.293 INFO:teuthology.orchestra.run.smithi082.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-09-23T09:48:43.293 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-09-23T09:48:43.293 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:43.293 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.293 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.294 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2023-09-23T09:48:43.294 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.294 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.294 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.294 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.294 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.294 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.294 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.294 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.294 INFO:teuthology.orchestra.run.smithi082.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-09-23T09:48:43.294 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-09-23T09:48:43.294 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:43.295 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.295 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.295 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "5", 2023-09-23T09:48:43.295 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.295 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.295 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.295 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.295 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.295 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.295 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.295 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.296 INFO:teuthology.orchestra.run.smithi082.stdout: "cross_origin_url": { 2023-09-23T09:48:43.296 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cross_origin_url", 2023-09-23T09:48:43.296 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.296 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.296 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.296 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.296 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.296 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.296 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.296 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.296 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.297 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.297 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.297 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.297 INFO:teuthology.orchestra.run.smithi082.stdout: "crt_file": { 2023-09-23T09:48:43.297 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "crt_file", 2023-09-23T09:48:43.297 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.297 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.297 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.297 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.297 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.297 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.297 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.298 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.298 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.298 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.298 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.298 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.298 INFO:teuthology.orchestra.run.smithi082.stdout: "debug": { 2023-09-23T09:48:43.298 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "debug", 2023-09-23T09:48:43.298 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.298 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.298 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.298 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.298 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.299 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.299 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.299 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Enable/disable debug options", 2023-09-23T09:48:43.299 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.299 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.299 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.299 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.299 INFO:teuthology.orchestra.run.smithi082.stdout: "jwt_token_ttl": { 2023-09-23T09:48:43.299 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "jwt_token_ttl", 2023-09-23T09:48:43.299 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:43.299 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.300 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.300 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "28800", 2023-09-23T09:48:43.300 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.300 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.300 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.300 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.300 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.300 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.300 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.300 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.300 INFO:teuthology.orchestra.run.smithi082.stdout: "key_file": { 2023-09-23T09:48:43.301 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "key_file", 2023-09-23T09:48:43.301 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.301 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.301 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.301 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.301 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.301 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.301 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.301 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.301 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.301 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.301 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.302 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.302 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:43.302 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:43.302 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.302 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.302 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.302 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.302 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.302 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.302 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.302 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.302 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.303 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.303 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.303 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.303 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.303 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.303 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.303 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.303 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.303 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.303 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.303 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:43.303 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:43.304 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.304 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.304 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.304 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.304 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.304 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.304 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.304 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.304 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.304 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.304 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.304 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.305 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:43.305 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:43.305 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.305 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.305 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.305 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:43.305 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.305 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.305 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.305 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.305 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.305 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.306 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.306 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.306 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.306 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.306 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.306 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.306 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.306 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.306 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.306 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:43.306 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:43.306 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.307 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.307 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.307 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.307 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.307 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.307 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.307 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.307 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.307 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.307 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.308 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.308 INFO:teuthology.orchestra.run.smithi082.stdout: "motd": { 2023-09-23T09:48:43.308 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "motd", 2023-09-23T09:48:43.308 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.308 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.308 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.308 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.308 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.308 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.308 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.308 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "The message of the day", 2023-09-23T09:48:43.308 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.309 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.309 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.309 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.309 INFO:teuthology.orchestra.run.smithi082.stdout: "redirect_resolve_ip_addr": { 2023-09-23T09:48:43.309 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "redirect_resolve_ip_addr", 2023-09-23T09:48:43.309 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.309 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.309 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.309 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.309 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.309 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.309 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.310 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.310 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.310 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.310 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.310 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.310 INFO:teuthology.orchestra.run.smithi082.stdout: "server_addr": { 2023-09-23T09:48:43.310 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_addr", 2023-09-23T09:48:43.310 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.310 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.310 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.310 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "::", 2023-09-23T09:48:43.310 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.311 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.311 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.311 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.311 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.311 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.311 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.311 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.311 INFO:teuthology.orchestra.run.smithi082.stdout: "server_port": { 2023-09-23T09:48:43.311 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_port", 2023-09-23T09:48:43.311 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:43.311 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.311 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.312 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "8080", 2023-09-23T09:48:43.312 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.312 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.312 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.312 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.312 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.312 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.312 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.312 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.312 INFO:teuthology.orchestra.run.smithi082.stdout: "ssl": { 2023-09-23T09:48:43.312 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ssl", 2023-09-23T09:48:43.312 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.313 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.313 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.313 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:43.313 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.313 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.313 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.313 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.313 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.313 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.313 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.313 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.313 INFO:teuthology.orchestra.run.smithi082.stdout: "ssl_server_port": { 2023-09-23T09:48:43.314 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ssl_server_port", 2023-09-23T09:48:43.314 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:43.314 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.314 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.314 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "8443", 2023-09-23T09:48:43.314 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.314 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.314 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.314 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.314 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.315 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.315 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.315 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.315 INFO:teuthology.orchestra.run.smithi082.stdout: "standby_behaviour": { 2023-09-23T09:48:43.315 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "standby_behaviour", 2023-09-23T09:48:43.315 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.315 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.315 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.315 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "redirect", 2023-09-23T09:48:43.315 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.315 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.315 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.316 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.316 INFO:teuthology.orchestra.run.smithi082.stdout: "redirect" 2023-09-23T09:48:43.316 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.316 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.316 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.316 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.316 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.316 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.316 INFO:teuthology.orchestra.run.smithi082.stdout: "standby_error_status_code": { 2023-09-23T09:48:43.316 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "standby_error_status_code", 2023-09-23T09:48:43.316 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:43.316 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.317 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.317 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "500", 2023-09-23T09:48:43.317 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "400", 2023-09-23T09:48:43.317 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "599", 2023-09-23T09:48:43.317 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.317 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.317 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.317 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.317 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.317 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.317 INFO:teuthology.orchestra.run.smithi082.stdout: "url_prefix": { 2023-09-23T09:48:43.318 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "url_prefix", 2023-09-23T09:48:43.318 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.318 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.318 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.318 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.318 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.318 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.318 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.318 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.318 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.318 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.318 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.319 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.319 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.319 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.319 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:43.319 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "devicehealth", 2023-09-23T09:48:43.319 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:43.319 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:43.319 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:43.319 INFO:teuthology.orchestra.run.smithi082.stdout: "enable_monitoring": { 2023-09-23T09:48:43.319 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "enable_monitoring", 2023-09-23T09:48:43.319 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.319 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.320 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.320 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:43.320 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.320 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.320 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.320 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "monitor device health metrics", 2023-09-23T09:48:43.320 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.320 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.320 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.320 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.320 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:43.320 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:43.321 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.321 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.321 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.321 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.321 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.321 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.321 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.321 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.321 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.321 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.321 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.321 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.321 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.322 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.322 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.322 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.322 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.322 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.322 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.322 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:43.322 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:43.322 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.322 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.322 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.322 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.323 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.323 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.323 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.323 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.323 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.323 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.323 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.323 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.323 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:43.323 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:43.323 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.324 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.324 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.324 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:43.324 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.324 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.324 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.324 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.324 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.324 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.324 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.324 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.324 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.325 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.325 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.325 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.325 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.325 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.325 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.325 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:43.325 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:43.325 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.325 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.325 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.325 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.326 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.326 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.326 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.326 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.326 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.326 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.326 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.326 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.326 INFO:teuthology.orchestra.run.smithi082.stdout: "mark_out_threshold": { 2023-09-23T09:48:43.326 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mark_out_threshold", 2023-09-23T09:48:43.326 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2023-09-23T09:48:43.327 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.327 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.327 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "2419200", 2023-09-23T09:48:43.327 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.327 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.327 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.327 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-09-23T09:48:43.327 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.327 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.327 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.327 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.327 INFO:teuthology.orchestra.run.smithi082.stdout: "pool_name": { 2023-09-23T09:48:43.327 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "pool_name", 2023-09-23T09:48:43.328 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.328 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.328 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.328 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "device_health_metrics", 2023-09-23T09:48:43.328 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.328 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.328 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.328 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "name of pool in which to store device health metrics", 2023-09-23T09:48:43.328 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.328 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.328 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.328 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.329 INFO:teuthology.orchestra.run.smithi082.stdout: "retention_period": { 2023-09-23T09:48:43.329 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "retention_period", 2023-09-23T09:48:43.329 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2023-09-23T09:48:43.329 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.329 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.329 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "15552000", 2023-09-23T09:48:43.329 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.329 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.329 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.329 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how long to retain device health metrics", 2023-09-23T09:48:43.329 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.329 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.330 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.330 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.330 INFO:teuthology.orchestra.run.smithi082.stdout: "scrape_frequency": { 2023-09-23T09:48:43.330 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "scrape_frequency", 2023-09-23T09:48:43.330 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2023-09-23T09:48:43.330 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.330 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.330 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "86400", 2023-09-23T09:48:43.330 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.330 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.330 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.330 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how frequently to scrape device health metrics", 2023-09-23T09:48:43.331 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.331 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.331 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.331 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.331 INFO:teuthology.orchestra.run.smithi082.stdout: "self_heal": { 2023-09-23T09:48:43.331 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "self_heal", 2023-09-23T09:48:43.331 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.331 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.331 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.331 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:43.331 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.331 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.332 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.332 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-09-23T09:48:43.332 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.332 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.332 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.332 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.332 INFO:teuthology.orchestra.run.smithi082.stdout: "sleep_interval": { 2023-09-23T09:48:43.332 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sleep_interval", 2023-09-23T09:48:43.332 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2023-09-23T09:48:43.332 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.332 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.332 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "600", 2023-09-23T09:48:43.333 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.333 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.333 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.333 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how frequently to wake up and check device health", 2023-09-23T09:48:43.333 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.333 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.333 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.333 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.333 INFO:teuthology.orchestra.run.smithi082.stdout: "warn_threshold": { 2023-09-23T09:48:43.333 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "warn_threshold", 2023-09-23T09:48:43.333 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2023-09-23T09:48:43.333 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.334 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.334 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "7257600", 2023-09-23T09:48:43.334 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.334 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.334 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.334 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-09-23T09:48:43.334 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.334 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.334 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.334 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.334 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.334 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.335 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:43.335 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "diskprediction_local", 2023-09-23T09:48:43.335 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:43.335 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:43.335 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:43.335 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:43.335 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:43.335 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.335 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.335 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.335 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.335 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.336 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.336 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.336 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.336 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.336 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.336 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.336 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.336 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.336 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.336 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.336 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.336 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.337 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.337 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.337 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:43.337 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:43.337 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.337 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.337 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.337 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.337 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.337 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.337 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.337 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.338 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.338 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.338 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.338 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.338 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:43.338 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:43.338 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.338 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.338 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.338 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:43.338 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.338 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.339 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.339 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.339 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.339 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.339 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.339 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.339 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.339 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.339 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.339 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.339 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.340 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.340 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.340 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:43.340 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:43.340 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.340 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.340 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.340 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.340 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.340 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.340 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.340 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.341 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.341 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.341 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.341 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.341 INFO:teuthology.orchestra.run.smithi082.stdout: "predict_interval": { 2023-09-23T09:48:43.341 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "predict_interval", 2023-09-23T09:48:43.341 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.341 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.341 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.341 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "86400", 2023-09-23T09:48:43.341 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.341 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.342 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.342 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.342 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.342 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.342 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.342 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.342 INFO:teuthology.orchestra.run.smithi082.stdout: "predictor_model": { 2023-09-23T09:48:43.342 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "predictor_model", 2023-09-23T09:48:43.342 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.342 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.342 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.342 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "prophetstor", 2023-09-23T09:48:43.343 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.343 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.343 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.343 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.343 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.343 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.343 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.343 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.343 INFO:teuthology.orchestra.run.smithi082.stdout: "sleep_interval": { 2023-09-23T09:48:43.343 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sleep_interval", 2023-09-23T09:48:43.343 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.343 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.344 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.344 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "600", 2023-09-23T09:48:43.344 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.344 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.344 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.344 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.344 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.344 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.344 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.344 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.344 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.344 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.345 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:43.345 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "influx", 2023-09-23T09:48:43.345 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": false, 2023-09-23T09:48:43.345 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "influxdb python module not found", 2023-09-23T09:48:43.345 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:43.345 INFO:teuthology.orchestra.run.smithi082.stdout: "batch_size": { 2023-09-23T09:48:43.345 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "batch_size", 2023-09-23T09:48:43.345 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:43.345 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.345 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.345 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "5000", 2023-09-23T09:48:43.345 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.346 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.346 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.346 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-09-23T09:48:43.346 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.346 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.346 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.346 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.346 INFO:teuthology.orchestra.run.smithi082.stdout: "database": { 2023-09-23T09:48:43.346 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "database", 2023-09-23T09:48:43.346 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.346 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.347 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.347 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "ceph", 2023-09-23T09:48:43.347 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.347 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.347 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.347 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-09-23T09:48:43.347 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.347 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.347 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.347 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.347 INFO:teuthology.orchestra.run.smithi082.stdout: "hostname": { 2023-09-23T09:48:43.348 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "hostname", 2023-09-23T09:48:43.348 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.348 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.348 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.348 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.348 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.348 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.348 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.348 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "InfluxDB server hostname", 2023-09-23T09:48:43.348 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.348 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.349 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.349 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.349 INFO:teuthology.orchestra.run.smithi082.stdout: "interval": { 2023-09-23T09:48:43.349 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "interval", 2023-09-23T09:48:43.349 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2023-09-23T09:48:43.349 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.349 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.349 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "30", 2023-09-23T09:48:43.349 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "5", 2023-09-23T09:48:43.349 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.349 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.349 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-09-23T09:48:43.350 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.350 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.350 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.350 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.350 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:43.350 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:43.350 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.350 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.350 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.350 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.350 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.350 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.351 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.351 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.351 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.351 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.351 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.351 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.351 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.351 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.351 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.351 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.351 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.351 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.352 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.352 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:43.352 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:43.352 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.352 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.352 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.352 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.352 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.352 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.352 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.352 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.352 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.353 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.353 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.353 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.353 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:43.353 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:43.353 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.353 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.353 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.353 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:43.353 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.353 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.353 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.354 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.354 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.354 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.354 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.354 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.354 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.354 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.354 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.354 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.354 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.354 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.354 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.355 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:43.355 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:43.355 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.355 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.355 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.355 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.355 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.355 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.355 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.355 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.355 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.355 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.356 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.356 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.356 INFO:teuthology.orchestra.run.smithi082.stdout: "password": { 2023-09-23T09:48:43.356 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "password", 2023-09-23T09:48:43.356 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.356 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.356 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.356 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.356 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.356 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.356 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.357 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "password of InfluxDB server user", 2023-09-23T09:48:43.357 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.357 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.357 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.357 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.357 INFO:teuthology.orchestra.run.smithi082.stdout: "port": { 2023-09-23T09:48:43.357 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "port", 2023-09-23T09:48:43.357 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:43.357 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.357 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.357 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "8086", 2023-09-23T09:48:43.357 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.358 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.358 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.358 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "InfluxDB server port", 2023-09-23T09:48:43.358 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.358 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.358 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.358 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.358 INFO:teuthology.orchestra.run.smithi082.stdout: "ssl": { 2023-09-23T09:48:43.358 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ssl", 2023-09-23T09:48:43.358 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.358 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.359 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.359 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "false", 2023-09-23T09:48:43.359 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.359 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.359 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.359 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-09-23T09:48:43.359 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.359 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.359 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.359 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.359 INFO:teuthology.orchestra.run.smithi082.stdout: "threads": { 2023-09-23T09:48:43.359 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "threads", 2023-09-23T09:48:43.360 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:43.360 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.360 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.360 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "5", 2023-09-23T09:48:43.360 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "1", 2023-09-23T09:48:43.360 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "32", 2023-09-23T09:48:43.360 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.360 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-09-23T09:48:43.360 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.360 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.360 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.360 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.361 INFO:teuthology.orchestra.run.smithi082.stdout: "username": { 2023-09-23T09:48:43.361 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "username", 2023-09-23T09:48:43.361 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.361 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.361 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.361 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.361 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.361 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.361 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.361 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "username of InfluxDB server user", 2023-09-23T09:48:43.361 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.361 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.361 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.362 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.362 INFO:teuthology.orchestra.run.smithi082.stdout: "verify_ssl": { 2023-09-23T09:48:43.362 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "verify_ssl", 2023-09-23T09:48:43.362 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.362 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.362 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.362 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "true", 2023-09-23T09:48:43.362 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.362 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.362 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.362 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-09-23T09:48:43.362 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.363 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.363 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.363 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.363 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.363 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.363 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:43.363 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "insights", 2023-09-23T09:48:43.363 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:43.363 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:43.363 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:43.363 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:43.363 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:43.364 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.364 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.364 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.364 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.364 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.364 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.364 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.364 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.364 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.364 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.364 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.364 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.365 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.365 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.365 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.365 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.365 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.365 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.365 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.365 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:43.365 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:43.365 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.365 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.365 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.366 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.366 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.366 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.366 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.366 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.366 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.366 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.366 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.366 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.366 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:43.366 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:43.366 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.367 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.367 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.367 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:43.367 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.367 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.367 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.367 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.367 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.367 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.367 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.367 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.367 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.368 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.368 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.368 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.368 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.368 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.368 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.368 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:43.368 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:43.368 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.368 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.368 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.369 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.369 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.369 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.369 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.369 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.369 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.369 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.369 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.369 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.369 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.369 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.370 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:43.370 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "iostat", 2023-09-23T09:48:43.370 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:43.370 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:43.370 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:43.370 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:43.370 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:43.370 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.370 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.370 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.370 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.370 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.370 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.371 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.371 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.371 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.371 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.371 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.371 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.371 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.371 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.371 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.371 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.371 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.372 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.372 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.372 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:43.372 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:43.372 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.372 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.372 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.372 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.372 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.372 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.372 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.372 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.373 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.373 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.373 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.373 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.373 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:43.373 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:43.373 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.373 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.373 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.373 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:43.373 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.373 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.374 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.374 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.374 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.374 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.374 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.374 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.374 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.374 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.374 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.374 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.374 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.375 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.375 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.375 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:43.375 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:43.375 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.375 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.375 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.375 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.375 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.375 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.375 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.375 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.375 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.376 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.376 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.376 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.376 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.376 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.376 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:43.376 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "k8sevents", 2023-09-23T09:48:43.376 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:43.376 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:43.376 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:43.376 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_event_retention_days": { 2023-09-23T09:48:43.377 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ceph_event_retention_days", 2023-09-23T09:48:43.377 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:43.377 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.377 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.377 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "7", 2023-09-23T09:48:43.377 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.377 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.377 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.377 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Days to hold ceph event information within local cache", 2023-09-23T09:48:43.377 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.377 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.377 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.377 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.378 INFO:teuthology.orchestra.run.smithi082.stdout: "config_check_secs": { 2023-09-23T09:48:43.378 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "config_check_secs", 2023-09-23T09:48:43.378 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:43.378 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.378 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.378 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2023-09-23T09:48:43.378 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "10", 2023-09-23T09:48:43.378 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.378 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.378 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2023-09-23T09:48:43.378 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.379 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.379 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.379 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.379 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:43.379 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:43.379 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.379 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.379 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.379 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.379 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.379 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.379 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.379 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.379 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.380 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.380 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.380 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.380 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.380 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.380 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.380 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.380 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.380 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.380 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.380 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:43.380 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:43.381 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.381 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.381 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.381 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.381 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.381 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.381 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.381 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.381 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.381 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.381 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.381 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.381 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:43.381 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:43.382 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.382 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.382 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.382 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:43.382 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.382 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.382 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.382 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.382 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.382 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.382 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.382 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.383 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.383 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.383 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.383 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.383 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.383 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.383 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.383 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:43.383 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:43.383 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.383 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.383 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.383 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.384 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.384 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.384 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.384 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.384 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.384 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.384 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.384 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.384 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.384 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.384 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:43.384 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "localpool", 2023-09-23T09:48:43.384 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:43.385 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:43.385 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:43.385 INFO:teuthology.orchestra.run.smithi082.stdout: "failure_domain": { 2023-09-23T09:48:43.385 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "failure_domain", 2023-09-23T09:48:43.385 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.385 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.385 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.385 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "host", 2023-09-23T09:48:43.385 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.385 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.385 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.385 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "failure domain for any created local pool", 2023-09-23T09:48:43.385 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-09-23T09:48:43.386 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.386 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.386 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.386 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:43.386 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:43.386 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.386 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.386 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.386 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.386 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.386 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.387 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.387 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.387 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.387 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.387 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.387 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.387 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.387 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.387 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.387 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.387 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.387 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.387 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.388 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:43.388 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:43.388 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.388 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.388 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.388 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.388 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.388 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.388 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.388 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.388 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.389 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.389 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.389 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.389 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:43.389 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:43.389 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.389 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.389 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.389 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:43.389 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.389 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.390 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.390 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.390 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.390 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.390 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.390 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.390 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.390 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.390 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.390 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.390 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.390 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.391 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.391 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:43.391 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:43.391 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.391 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.391 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.391 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.391 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.391 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.391 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.391 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.391 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.391 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.392 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.392 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.392 INFO:teuthology.orchestra.run.smithi082.stdout: "min_size": { 2023-09-23T09:48:43.392 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "min_size", 2023-09-23T09:48:43.392 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:43.392 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.392 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.392 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.392 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.392 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.392 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.392 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "default min_size for any created local pool", 2023-09-23T09:48:43.392 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-09-23T09:48:43.393 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.393 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.393 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.393 INFO:teuthology.orchestra.run.smithi082.stdout: "num_rep": { 2023-09-23T09:48:43.393 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "num_rep", 2023-09-23T09:48:43.393 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:43.393 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.393 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.393 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "3", 2023-09-23T09:48:43.393 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.393 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.393 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.393 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "default replica count for any created local pool", 2023-09-23T09:48:43.394 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.394 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.394 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.394 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.394 INFO:teuthology.orchestra.run.smithi082.stdout: "pg_num": { 2023-09-23T09:48:43.394 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "pg_num", 2023-09-23T09:48:43.394 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:43.394 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.394 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.394 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "128", 2023-09-23T09:48:43.394 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.395 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.395 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.395 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "default pg_num for any created local pool", 2023-09-23T09:48:43.395 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.395 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.395 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.395 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.395 INFO:teuthology.orchestra.run.smithi082.stdout: "prefix": { 2023-09-23T09:48:43.395 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "prefix", 2023-09-23T09:48:43.395 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.395 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.395 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.396 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.396 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.396 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.396 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.396 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "name prefix for any created local pool", 2023-09-23T09:48:43.396 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.396 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.396 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.396 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.396 INFO:teuthology.orchestra.run.smithi082.stdout: "subtree": { 2023-09-23T09:48:43.396 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "subtree", 2023-09-23T09:48:43.397 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.397 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.397 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.397 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "rack", 2023-09-23T09:48:43.397 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.397 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.397 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.397 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "CRUSH level for which to create a local pool", 2023-09-23T09:48:43.397 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-09-23T09:48:43.397 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.397 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.397 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.398 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.398 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.398 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:43.398 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mds_autoscaler", 2023-09-23T09:48:43.398 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:43.398 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:43.398 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:43.398 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:43.398 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:43.398 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.398 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.399 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.399 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.399 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.399 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.399 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.399 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.399 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.399 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.399 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.399 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.399 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.399 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.400 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.400 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.400 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.400 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.400 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.400 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:43.400 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:43.400 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.400 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.400 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.400 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.400 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.401 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.401 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.401 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.401 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.401 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.401 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.401 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.401 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:43.401 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:43.401 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.401 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.401 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.402 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:43.402 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.402 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.402 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.402 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.402 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.402 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.402 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.402 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.402 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.402 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.403 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.403 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.403 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.403 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.403 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.403 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:43.403 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:43.403 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.403 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.403 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.403 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.403 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.404 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.404 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.404 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.404 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.404 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.404 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.404 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.404 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.404 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.404 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:43.404 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mirroring", 2023-09-23T09:48:43.404 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:43.405 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:43.405 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:43.405 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:43.405 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:43.405 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.405 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.405 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.405 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.405 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.405 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.405 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.405 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.406 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.406 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.406 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.406 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.406 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.406 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.406 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.406 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.406 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.406 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.406 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.407 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:43.407 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:43.407 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.407 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.407 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.407 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.407 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.407 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.407 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.407 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.407 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.407 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.407 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.408 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.408 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:43.408 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:43.408 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.408 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.408 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.408 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:43.408 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.408 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.408 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.408 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.409 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.409 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.409 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.409 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.409 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.409 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.409 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.409 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.409 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.409 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.409 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.409 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:43.409 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:43.409 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.410 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.410 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.410 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.410 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.410 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.410 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.410 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.410 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.410 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.410 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.410 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.411 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.411 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.411 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:43.411 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "nfs", 2023-09-23T09:48:43.411 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:43.411 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:43.411 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:43.411 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:43.411 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:43.411 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.411 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.411 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.412 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.412 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.412 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.412 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.412 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.412 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.412 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.412 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.412 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.412 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.412 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.412 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.413 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.413 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.413 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.413 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.413 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:43.413 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:43.413 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.413 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.413 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.413 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.413 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.413 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.414 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.414 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.414 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.414 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.414 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.414 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.414 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:43.414 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:43.414 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.414 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.414 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.414 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:43.415 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.415 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.415 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.415 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.415 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.415 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.415 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.415 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.415 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.415 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.415 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.416 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.416 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.416 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.416 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.416 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:43.416 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:43.416 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.416 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.416 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.416 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.416 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.416 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.417 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.417 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.417 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.417 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.417 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.417 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.417 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.417 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.417 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:43.417 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "orchestrator", 2023-09-23T09:48:43.417 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:43.417 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:43.417 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:43.417 INFO:teuthology.orchestra.run.smithi082.stdout: "fail_fs": { 2023-09-23T09:48:43.418 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "fail_fs", 2023-09-23T09:48:43.418 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.418 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.418 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.418 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.418 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.418 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.418 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.418 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2023-09-23T09:48:43.418 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.418 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.418 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.419 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.419 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:43.419 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:43.419 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.419 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.419 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.419 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.419 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.419 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.419 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.419 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.419 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.420 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.420 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.420 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.420 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.420 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.420 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.420 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.420 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.420 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.420 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.420 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:43.420 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:43.420 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.420 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.421 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.421 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.421 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.421 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.421 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.421 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.421 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.421 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.421 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.421 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.421 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:43.421 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:43.422 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.422 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.422 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.422 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:43.422 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.422 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.422 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.422 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.422 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.422 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.422 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.423 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.423 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.423 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.423 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.423 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.423 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.423 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.423 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.423 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:43.423 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:43.423 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.424 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.424 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.424 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.424 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.424 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.424 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.424 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.424 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.424 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.424 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.424 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.424 INFO:teuthology.orchestra.run.smithi082.stdout: "orchestrator": { 2023-09-23T09:48:43.425 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "orchestrator", 2023-09-23T09:48:43.425 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.425 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.425 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.425 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.425 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.425 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.425 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.425 INFO:teuthology.orchestra.run.smithi082.stdout: "cephadm", 2023-09-23T09:48:43.425 INFO:teuthology.orchestra.run.smithi082.stdout: "rook", 2023-09-23T09:48:43.425 INFO:teuthology.orchestra.run.smithi082.stdout: "test_orchestrator" 2023-09-23T09:48:43.425 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.425 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Orchestrator backend", 2023-09-23T09:48:43.426 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.426 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.426 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.426 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.426 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.426 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.426 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:43.426 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "osd_perf_query", 2023-09-23T09:48:43.426 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:43.426 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:43.426 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:43.427 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:43.427 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:43.427 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.427 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.427 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.427 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.427 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.427 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.427 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.427 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.427 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.427 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.428 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.428 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.428 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.428 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.428 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.428 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.428 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.428 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.428 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.428 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:43.428 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:43.428 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.429 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.429 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.429 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.429 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.429 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.429 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.429 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.429 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.429 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.429 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.429 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.429 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:43.429 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:43.430 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.430 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.430 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.430 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:43.430 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.430 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.430 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.430 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.430 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.430 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.430 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.431 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.431 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.431 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.431 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.431 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.431 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.431 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.431 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.431 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:43.431 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:43.431 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.431 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.432 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.432 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.432 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.432 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.432 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.432 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.432 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.432 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.432 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.432 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.432 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.432 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.433 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:43.433 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "osd_support", 2023-09-23T09:48:43.433 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:43.433 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:43.433 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:43.433 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:43.433 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:43.433 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.433 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.433 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.433 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.434 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.434 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.434 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.434 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.434 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.434 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.434 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.434 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.434 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.434 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.434 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.435 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.435 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.435 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.435 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.435 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:43.435 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:43.435 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.435 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.435 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.435 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.436 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.436 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.436 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.436 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.436 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.436 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.436 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.436 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.436 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:43.436 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:43.436 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.436 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.437 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.437 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:43.437 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.437 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.437 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.437 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.437 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.437 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.437 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.437 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.437 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.438 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.438 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.438 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.438 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.438 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.438 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.438 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:43.438 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:43.438 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.438 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.438 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.438 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.439 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.439 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.439 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.439 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.439 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.439 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.439 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.439 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.439 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.439 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.439 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:43.439 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "pg_autoscaler", 2023-09-23T09:48:43.440 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:43.440 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:43.440 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:43.440 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:43.440 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:43.440 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.440 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.440 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.440 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.440 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.440 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.440 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.441 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.441 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.441 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.441 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.441 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.441 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.441 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.441 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.441 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.441 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.441 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.442 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.442 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:43.442 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:43.442 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.442 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.442 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.442 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.442 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.442 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.442 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.442 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.442 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.443 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.443 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.443 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.443 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:43.443 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:43.443 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.443 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.443 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.443 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:43.443 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.443 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.443 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.444 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.444 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.444 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.444 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.444 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.444 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.444 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.444 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.444 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.444 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.444 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.444 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.445 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:43.445 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:43.445 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.445 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.445 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.445 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.445 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.445 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.445 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.445 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.445 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.445 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.446 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.446 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.446 INFO:teuthology.orchestra.run.smithi082.stdout: "noautoscale": { 2023-09-23T09:48:43.446 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "noautoscale", 2023-09-23T09:48:43.446 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.446 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.446 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.446 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.446 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.446 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.446 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.446 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "global autoscale flag", 2023-09-23T09:48:43.447 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "Option to turn on/off the autoscaler for all pools", 2023-09-23T09:48:43.447 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.447 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.447 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.447 INFO:teuthology.orchestra.run.smithi082.stdout: "sleep_interval": { 2023-09-23T09:48:43.447 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sleep_interval", 2023-09-23T09:48:43.447 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2023-09-23T09:48:43.447 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.447 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.447 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "60", 2023-09-23T09:48:43.447 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.447 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.448 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.448 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.448 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.448 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.448 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.448 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.448 INFO:teuthology.orchestra.run.smithi082.stdout: "threshold": { 2023-09-23T09:48:43.448 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "threshold", 2023-09-23T09:48:43.448 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2023-09-23T09:48:43.448 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.448 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.449 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "3.0", 2023-09-23T09:48:43.449 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "1.0", 2023-09-23T09:48:43.449 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.449 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.449 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "scaling threshold", 2023-09-23T09:48:43.449 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-09-23T09:48:43.449 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.449 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.449 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.449 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.449 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.450 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:43.450 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "progress", 2023-09-23T09:48:43.450 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:43.450 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:43.450 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:43.450 INFO:teuthology.orchestra.run.smithi082.stdout: "allow_pg_recovery_event": { 2023-09-23T09:48:43.450 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "allow_pg_recovery_event", 2023-09-23T09:48:43.450 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.450 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.450 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.450 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.451 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.451 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.451 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.451 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "allow the module to show pg recovery progress", 2023-09-23T09:48:43.451 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.451 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.451 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.451 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.451 INFO:teuthology.orchestra.run.smithi082.stdout: "enabled": { 2023-09-23T09:48:43.451 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "enabled", 2023-09-23T09:48:43.451 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.451 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.452 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.452 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:43.452 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.452 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.452 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.452 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.452 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.452 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.452 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.452 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.452 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:43.453 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:43.453 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.453 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.453 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.453 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.453 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.453 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.453 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.453 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.453 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.453 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.453 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.454 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.454 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.454 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.454 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.454 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.454 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.454 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.454 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.454 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:43.454 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:43.454 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.455 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.455 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.455 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.455 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.455 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.455 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.455 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.455 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.455 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.455 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.455 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.455 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:43.456 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:43.456 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.456 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.456 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.456 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:43.456 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.456 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.456 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.456 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.456 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.456 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.457 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.457 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.457 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.457 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.457 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.457 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.457 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.457 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.457 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.457 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:43.457 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:43.457 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.457 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.458 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.458 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.458 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.458 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.458 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.458 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.458 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.458 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.458 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.458 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.458 INFO:teuthology.orchestra.run.smithi082.stdout: "max_completed_events": { 2023-09-23T09:48:43.458 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "max_completed_events", 2023-09-23T09:48:43.459 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:43.459 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.459 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.459 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "50", 2023-09-23T09:48:43.459 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.459 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.459 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.459 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "number of past completed events to remember", 2023-09-23T09:48:43.459 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.459 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.459 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.459 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.460 INFO:teuthology.orchestra.run.smithi082.stdout: "sleep_interval": { 2023-09-23T09:48:43.460 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sleep_interval", 2023-09-23T09:48:43.460 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2023-09-23T09:48:43.460 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.460 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.460 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "5", 2023-09-23T09:48:43.460 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.460 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.460 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.460 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how long the module is going to sleep", 2023-09-23T09:48:43.460 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.460 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.461 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.461 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.461 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.461 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.461 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:43.461 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "prometheus", 2023-09-23T09:48:43.461 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:43.461 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:43.461 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:43.461 INFO:teuthology.orchestra.run.smithi082.stdout: "cache": { 2023-09-23T09:48:43.461 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cache", 2023-09-23T09:48:43.461 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.462 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.462 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.462 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:43.462 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.462 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.462 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.462 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.462 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.462 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.462 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.462 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.462 INFO:teuthology.orchestra.run.smithi082.stdout: "exclude_perf_counters": { 2023-09-23T09:48:43.463 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "exclude_perf_counters", 2023-09-23T09:48:43.463 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.463 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.463 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.463 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:43.463 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.463 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.463 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.463 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Do not include perf-counters in the metrics output", 2023-09-23T09:48:43.463 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2023-09-23T09:48:43.463 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.463 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.464 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.464 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:43.464 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:43.464 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.464 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.464 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.464 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.464 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.464 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.464 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.464 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.464 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.465 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.465 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.465 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.465 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.465 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.465 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.465 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.465 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.465 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.465 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.465 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:43.465 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:43.466 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.466 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.466 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.466 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.466 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.466 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.466 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.466 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.466 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.466 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.466 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.466 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.467 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:43.467 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:43.467 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.467 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.467 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.467 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:43.467 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.467 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.467 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.467 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.467 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.467 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.468 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.468 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.468 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.468 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.468 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.468 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.468 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.468 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.468 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.468 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:43.468 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:43.468 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.469 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.469 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.469 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.469 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.469 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.469 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.469 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.469 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.469 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.469 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.469 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.469 INFO:teuthology.orchestra.run.smithi082.stdout: "rbd_stats_pools": { 2023-09-23T09:48:43.470 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rbd_stats_pools", 2023-09-23T09:48:43.470 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.470 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.470 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.470 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.470 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.470 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.470 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.470 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.470 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.470 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.470 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.471 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.471 INFO:teuthology.orchestra.run.smithi082.stdout: "rbd_stats_pools_refresh_interval": { 2023-09-23T09:48:43.471 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-09-23T09:48:43.471 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:43.471 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.471 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.471 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "300", 2023-09-23T09:48:43.471 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.471 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.471 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.471 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.471 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.472 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.472 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.472 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.472 INFO:teuthology.orchestra.run.smithi082.stdout: "scrape_interval": { 2023-09-23T09:48:43.472 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "scrape_interval", 2023-09-23T09:48:43.472 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2023-09-23T09:48:43.472 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.472 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.472 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "15.0", 2023-09-23T09:48:43.472 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.472 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.472 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.473 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.473 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.473 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.473 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.473 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.473 INFO:teuthology.orchestra.run.smithi082.stdout: "server_addr": { 2023-09-23T09:48:43.473 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_addr", 2023-09-23T09:48:43.473 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.473 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.473 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.473 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "::", 2023-09-23T09:48:43.473 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.474 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.474 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.474 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-09-23T09:48:43.474 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.474 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.474 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.474 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.474 INFO:teuthology.orchestra.run.smithi082.stdout: "server_port": { 2023-09-23T09:48:43.474 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_port", 2023-09-23T09:48:43.474 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:43.474 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.475 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.475 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "9283", 2023-09-23T09:48:43.475 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.475 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.475 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.475 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-09-23T09:48:43.475 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.475 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.475 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.475 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.475 INFO:teuthology.orchestra.run.smithi082.stdout: "stale_cache_strategy": { 2023-09-23T09:48:43.475 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "stale_cache_strategy", 2023-09-23T09:48:43.475 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.476 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.476 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.476 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "log", 2023-09-23T09:48:43.476 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.476 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.476 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.476 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.476 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.476 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.476 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.476 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.476 INFO:teuthology.orchestra.run.smithi082.stdout: "standby_behaviour": { 2023-09-23T09:48:43.477 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "standby_behaviour", 2023-09-23T09:48:43.477 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.477 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.477 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.477 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "default", 2023-09-23T09:48:43.477 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.477 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.477 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.477 INFO:teuthology.orchestra.run.smithi082.stdout: "default", 2023-09-23T09:48:43.477 INFO:teuthology.orchestra.run.smithi082.stdout: "error" 2023-09-23T09:48:43.477 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.477 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.478 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.478 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.478 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.478 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.478 INFO:teuthology.orchestra.run.smithi082.stdout: "standby_error_status_code": { 2023-09-23T09:48:43.478 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "standby_error_status_code", 2023-09-23T09:48:43.478 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:43.478 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.478 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.478 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "500", 2023-09-23T09:48:43.478 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "400", 2023-09-23T09:48:43.478 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "599", 2023-09-23T09:48:43.479 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.479 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.479 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.479 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.479 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.479 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.479 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.479 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.479 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:43.479 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rbd_support", 2023-09-23T09:48:43.479 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:43.480 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:43.480 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:43.480 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:43.480 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:43.480 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.480 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.480 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.480 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.480 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.480 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.480 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.480 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.480 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.481 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.481 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.481 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.481 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.481 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.481 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.481 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.481 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.481 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.481 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.481 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:43.481 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:43.482 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.482 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.482 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.482 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.482 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.482 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.482 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.482 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.482 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.482 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.482 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.482 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.483 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:43.483 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:43.483 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.483 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.483 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.483 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:43.483 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.483 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.483 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.483 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.483 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.484 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.484 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.484 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.484 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.484 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.484 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.484 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.484 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.484 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.484 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.484 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:43.484 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:43.485 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.485 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.485 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.485 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.485 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.485 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.485 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.485 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.485 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.485 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.485 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.485 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.486 INFO:teuthology.orchestra.run.smithi082.stdout: "max_concurrent_snap_create": { 2023-09-23T09:48:43.486 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "max_concurrent_snap_create", 2023-09-23T09:48:43.486 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:43.486 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.486 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.486 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2023-09-23T09:48:43.486 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.486 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.486 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.486 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.486 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.486 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.487 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.487 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.487 INFO:teuthology.orchestra.run.smithi082.stdout: "mirror_snapshot_schedule": { 2023-09-23T09:48:43.487 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mirror_snapshot_schedule", 2023-09-23T09:48:43.487 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.487 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.487 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.487 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.487 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.487 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.487 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.487 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.488 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.488 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.488 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.488 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.488 INFO:teuthology.orchestra.run.smithi082.stdout: "trash_purge_schedule": { 2023-09-23T09:48:43.488 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "trash_purge_schedule", 2023-09-23T09:48:43.488 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.488 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.488 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.488 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.488 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.488 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.489 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.489 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.489 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.489 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.489 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.489 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.489 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.489 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.489 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:43.489 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "restful", 2023-09-23T09:48:43.489 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:43.489 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:43.490 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:43.490 INFO:teuthology.orchestra.run.smithi082.stdout: "enable_auth": { 2023-09-23T09:48:43.490 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "enable_auth", 2023-09-23T09:48:43.490 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.490 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.490 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.490 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:43.490 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.490 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.490 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.490 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.490 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.491 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.491 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.491 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.491 INFO:teuthology.orchestra.run.smithi082.stdout: "key_file": { 2023-09-23T09:48:43.491 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "key_file", 2023-09-23T09:48:43.491 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.491 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.491 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.491 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.491 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.491 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.491 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.492 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.492 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.492 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.492 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.492 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.492 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:43.492 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:43.492 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.492 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.492 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.492 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.492 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.493 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.493 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.493 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.493 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.493 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.493 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.493 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.493 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.493 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.493 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.493 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.494 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.494 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.494 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.494 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:43.494 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:43.494 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.494 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.494 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.494 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.494 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.494 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.494 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.495 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.495 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.495 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.495 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.495 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.495 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:43.495 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:43.495 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.495 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.495 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.495 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:43.495 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.496 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.496 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.496 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.496 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.496 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.496 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.496 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.496 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.496 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.496 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.496 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.497 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.497 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.497 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.497 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:43.497 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:43.497 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.497 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.497 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.497 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.497 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.497 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.497 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.498 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.498 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.498 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.498 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.498 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.498 INFO:teuthology.orchestra.run.smithi082.stdout: "server_addr": { 2023-09-23T09:48:43.498 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_addr", 2023-09-23T09:48:43.498 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.498 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.498 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.498 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.499 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.499 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.499 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.499 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.499 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.499 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.499 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.499 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.499 INFO:teuthology.orchestra.run.smithi082.stdout: "server_port": { 2023-09-23T09:48:43.500 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_port", 2023-09-23T09:48:43.500 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.500 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.500 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.500 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.500 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.500 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.500 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.500 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.500 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.501 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.501 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.501 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.501 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.501 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.501 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:43.501 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rgw", 2023-09-23T09:48:43.501 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:43.501 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:43.501 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:43.501 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:43.501 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:43.502 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.502 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.502 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.502 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.502 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.502 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.502 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.502 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.502 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.502 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.502 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.502 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.503 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.503 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.503 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.503 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.503 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.503 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.503 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.503 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:43.503 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:43.503 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.503 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.504 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.504 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.504 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.504 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.504 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.504 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.504 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.504 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.504 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.504 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.504 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:43.504 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:43.505 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.505 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.505 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.505 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:43.505 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.505 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.505 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.505 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.505 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.505 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.505 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.505 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.506 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.506 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.506 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.506 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.506 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.506 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.506 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.506 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:43.506 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:43.506 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.506 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.506 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.507 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.507 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.507 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.507 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.507 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.507 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.507 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.507 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.507 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.507 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.507 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.507 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:43.507 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rook", 2023-09-23T09:48:43.508 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:43.508 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:43.508 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:43.508 INFO:teuthology.orchestra.run.smithi082.stdout: "drive_group_interval": { 2023-09-23T09:48:43.508 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "drive_group_interval", 2023-09-23T09:48:43.508 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2023-09-23T09:48:43.508 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.508 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.508 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "300.0", 2023-09-23T09:48:43.508 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.508 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.508 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.509 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2023-09-23T09:48:43.509 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.509 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.509 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.509 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.509 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:43.509 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:43.509 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.509 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.509 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.509 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.509 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.510 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.510 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.510 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.510 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.510 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.510 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.510 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.510 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.510 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.510 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.510 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.511 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.511 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.511 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.511 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:43.511 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:43.511 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.511 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.511 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.511 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.511 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.511 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.511 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.512 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.512 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.512 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.512 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.512 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.512 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:43.512 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:43.512 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.512 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.512 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.512 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:43.512 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.512 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.513 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.513 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.513 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.513 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.513 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.513 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.513 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.513 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.513 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.513 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.513 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.513 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.514 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.514 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:43.514 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:43.514 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.514 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.514 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.514 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.514 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.514 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.514 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.515 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.515 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.515 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.515 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.515 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.515 INFO:teuthology.orchestra.run.smithi082.stdout: "storage_class": { 2023-09-23T09:48:43.515 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "storage_class", 2023-09-23T09:48:43.515 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.515 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.515 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.515 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "local", 2023-09-23T09:48:43.515 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.516 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.516 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.516 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "storage class name for LSO-discovered PVs", 2023-09-23T09:48:43.516 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.516 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.516 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.516 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.516 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.516 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.516 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:43.516 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "selftest", 2023-09-23T09:48:43.517 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:43.517 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:43.517 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:43.517 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:43.517 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:43.517 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.517 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.517 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.517 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.517 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.517 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.517 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.518 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.518 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.518 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.518 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.518 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.518 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.518 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.518 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.518 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.518 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.518 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.518 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.519 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:43.519 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:43.519 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.519 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.519 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.519 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.519 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.519 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.519 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.519 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.519 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.519 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.520 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.520 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.520 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:43.520 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:43.520 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.520 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.520 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.520 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:43.520 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.520 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.520 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.520 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.521 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.521 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.521 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.521 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.521 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.521 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.521 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.521 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.521 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.521 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.521 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.521 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:43.522 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:43.522 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.522 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.522 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.522 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.522 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.522 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.522 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.522 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.522 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.522 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.522 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.522 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.523 INFO:teuthology.orchestra.run.smithi082.stdout: "roption1": { 2023-09-23T09:48:43.523 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "roption1", 2023-09-23T09:48:43.523 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.523 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.523 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.523 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.523 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.523 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.523 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.523 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.523 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.523 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.524 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.524 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.524 INFO:teuthology.orchestra.run.smithi082.stdout: "roption2": { 2023-09-23T09:48:43.524 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "roption2", 2023-09-23T09:48:43.524 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.524 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.524 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.524 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "xyz", 2023-09-23T09:48:43.524 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.524 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.524 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.524 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.524 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.525 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.525 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.525 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.525 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption1": { 2023-09-23T09:48:43.525 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption1", 2023-09-23T09:48:43.525 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.525 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.525 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.525 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.525 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.525 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.526 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.526 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.526 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.526 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.526 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.526 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.526 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption2": { 2023-09-23T09:48:43.526 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption2", 2023-09-23T09:48:43.526 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:43.526 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.526 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.526 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.527 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.527 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.527 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.527 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.527 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.527 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.527 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.527 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.527 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption3": { 2023-09-23T09:48:43.527 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption3", 2023-09-23T09:48:43.527 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2023-09-23T09:48:43.527 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.528 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.528 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.528 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.528 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.528 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.528 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.528 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.528 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.528 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.528 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.528 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption4": { 2023-09-23T09:48:43.528 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption4", 2023-09-23T09:48:43.528 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.529 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.529 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.529 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.529 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.529 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.529 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.529 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.529 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.529 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.529 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.529 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.529 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption5": { 2023-09-23T09:48:43.529 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption5", 2023-09-23T09:48:43.530 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.530 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.530 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.530 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.530 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.530 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.530 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.530 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.530 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.530 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.530 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.531 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.531 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption6": { 2023-09-23T09:48:43.531 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption6", 2023-09-23T09:48:43.531 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.531 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.531 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.531 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:43.531 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.531 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.531 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.531 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.531 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.531 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.532 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.532 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.532 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption7": { 2023-09-23T09:48:43.532 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption7", 2023-09-23T09:48:43.532 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:43.532 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.532 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.532 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.532 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "1", 2023-09-23T09:48:43.532 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "42", 2023-09-23T09:48:43.532 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.532 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.533 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.533 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.533 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.533 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.533 INFO:teuthology.orchestra.run.smithi082.stdout: "testkey": { 2023-09-23T09:48:43.533 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "testkey", 2023-09-23T09:48:43.533 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.533 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.533 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.533 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.533 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.533 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.534 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.534 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.534 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.534 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.534 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.534 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.534 INFO:teuthology.orchestra.run.smithi082.stdout: "testlkey": { 2023-09-23T09:48:43.534 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "testlkey", 2023-09-23T09:48:43.534 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.534 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.534 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.534 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.535 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.535 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.535 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.535 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.535 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.535 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.535 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.535 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.535 INFO:teuthology.orchestra.run.smithi082.stdout: "testnewline": { 2023-09-23T09:48:43.535 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "testnewline", 2023-09-23T09:48:43.535 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.535 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.535 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.536 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.536 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.536 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.536 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.536 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.536 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.536 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.536 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.536 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.537 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.537 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.537 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:43.537 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "snap_schedule", 2023-09-23T09:48:43.537 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:43.537 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:43.537 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:43.537 INFO:teuthology.orchestra.run.smithi082.stdout: "allow_m_granularity": { 2023-09-23T09:48:43.537 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "allow_m_granularity", 2023-09-23T09:48:43.537 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.537 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.538 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.538 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.538 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.538 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.538 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.538 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "allow minute scheduled snapshots", 2023-09-23T09:48:43.538 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.538 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.538 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.538 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.538 INFO:teuthology.orchestra.run.smithi082.stdout: "dump_on_update": { 2023-09-23T09:48:43.538 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "dump_on_update", 2023-09-23T09:48:43.539 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.539 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.539 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.539 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.539 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.539 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.539 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.539 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "dump database to debug log on update", 2023-09-23T09:48:43.539 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.539 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.539 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.539 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.540 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:43.540 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:43.540 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.540 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.540 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.540 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.540 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.540 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.540 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.540 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.540 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.540 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.541 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.541 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.541 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.541 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.541 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.541 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.541 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.541 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.541 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.541 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:43.541 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:43.541 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.542 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.542 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.542 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.542 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.542 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.542 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.542 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.542 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.542 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.542 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.542 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.543 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:43.543 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:43.543 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.543 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.543 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.543 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:43.543 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.543 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.543 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.543 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.543 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.543 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.544 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.544 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.544 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.544 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.544 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.544 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.544 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.544 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.544 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.544 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:43.544 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:43.544 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.544 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.545 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.545 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.545 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.545 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.545 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.545 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.545 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.545 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.545 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.545 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.545 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.546 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.546 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:43.546 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "stats", 2023-09-23T09:48:43.546 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:43.546 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:43.546 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:43.546 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:43.546 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:43.546 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.546 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.546 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.546 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.547 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.547 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.547 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.547 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.547 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.547 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.547 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.547 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.547 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.547 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.547 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.548 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.548 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.548 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.548 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.548 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:43.548 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:43.548 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.548 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.548 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.548 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.548 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.548 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.548 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.549 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.549 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.549 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.549 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.549 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.549 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:43.549 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:43.549 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.549 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.549 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.549 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:43.550 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.550 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.550 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.550 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.550 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.550 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.550 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.550 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.550 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.550 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.550 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.551 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.551 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.551 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.551 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.551 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:43.551 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:43.551 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.551 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.551 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.551 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.551 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.551 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.551 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.552 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.552 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.552 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.552 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.552 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.552 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.552 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.552 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:43.552 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "status", 2023-09-23T09:48:43.552 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:43.552 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:43.552 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:43.553 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:43.553 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:43.553 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.553 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.553 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.553 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.553 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.553 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.553 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.553 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.553 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.553 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.554 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.554 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.554 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.554 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.554 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.554 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.554 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.554 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.554 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.554 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:43.554 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:43.554 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.555 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.555 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.555 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.555 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.555 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.555 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.555 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.555 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.555 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.555 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.555 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.555 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:43.556 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:43.556 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.556 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.556 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.556 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:43.556 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.556 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.556 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.556 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.556 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.556 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.556 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.557 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.557 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.557 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.557 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.557 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.557 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.557 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.557 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.557 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:43.557 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:43.558 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.558 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.558 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.558 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.558 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.558 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.558 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.558 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.558 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.558 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.558 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.559 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.559 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.559 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.559 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:43.559 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "telegraf", 2023-09-23T09:48:43.559 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:43.559 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:43.559 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:43.559 INFO:teuthology.orchestra.run.smithi082.stdout: "address": { 2023-09-23T09:48:43.559 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "address", 2023-09-23T09:48:43.559 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.560 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.560 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.560 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-09-23T09:48:43.560 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.560 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.560 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.560 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.560 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.560 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.560 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.560 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.561 INFO:teuthology.orchestra.run.smithi082.stdout: "interval": { 2023-09-23T09:48:43.561 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "interval", 2023-09-23T09:48:43.561 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2023-09-23T09:48:43.561 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.561 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.561 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "15", 2023-09-23T09:48:43.561 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.561 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.561 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.561 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.561 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.561 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.561 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.562 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.562 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:43.562 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:43.562 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.562 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.562 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.562 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.562 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.562 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.562 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.562 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.562 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.563 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.563 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.563 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.563 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.563 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.563 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.563 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.563 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.563 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.563 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.563 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:43.563 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:43.563 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.564 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.564 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.564 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.564 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.564 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.564 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.564 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.564 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.564 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.564 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.564 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.564 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:43.564 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:43.565 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.565 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.565 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.565 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:43.565 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.565 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.565 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.565 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.565 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.565 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.565 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.565 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.566 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.566 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.566 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.566 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.566 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.566 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.566 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.566 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:43.566 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:43.566 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.566 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.567 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.567 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.567 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.567 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.567 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.567 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.567 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.567 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.567 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.567 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.567 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.568 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.568 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:43.568 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "telemetry", 2023-09-23T09:48:43.568 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:43.568 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:43.568 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:43.568 INFO:teuthology.orchestra.run.smithi082.stdout: "channel_basic": { 2023-09-23T09:48:43.568 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "channel_basic", 2023-09-23T09:48:43.568 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.568 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.568 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.568 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:43.568 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.568 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.569 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.569 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Share basic cluster information (size, version)", 2023-09-23T09:48:43.569 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.569 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.569 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.569 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.569 INFO:teuthology.orchestra.run.smithi082.stdout: "channel_crash": { 2023-09-23T09:48:43.569 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "channel_crash", 2023-09-23T09:48:43.569 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.569 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.569 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.569 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:43.569 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.570 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.570 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.570 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-09-23T09:48:43.570 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.570 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.570 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.570 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.570 INFO:teuthology.orchestra.run.smithi082.stdout: "channel_device": { 2023-09-23T09:48:43.570 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "channel_device", 2023-09-23T09:48:43.570 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.570 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.570 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.571 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:43.571 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.571 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.571 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.571 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-09-23T09:48:43.571 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.571 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.571 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.571 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.571 INFO:teuthology.orchestra.run.smithi082.stdout: "channel_ident": { 2023-09-23T09:48:43.571 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "channel_ident", 2023-09-23T09:48:43.571 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.572 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.572 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.572 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.572 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.572 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.572 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.572 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-09-23T09:48:43.572 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.572 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.572 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.572 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.572 INFO:teuthology.orchestra.run.smithi082.stdout: "channel_perf": { 2023-09-23T09:48:43.573 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "channel_perf", 2023-09-23T09:48:43.573 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.573 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.573 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.573 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.573 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.573 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.573 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.573 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Share various performance metrics of a cluster", 2023-09-23T09:48:43.573 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.573 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.573 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.574 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.574 INFO:teuthology.orchestra.run.smithi082.stdout: "contact": { 2023-09-23T09:48:43.574 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "contact", 2023-09-23T09:48:43.574 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.574 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.574 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.574 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.574 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.574 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.574 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.574 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.574 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.575 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.575 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.575 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.575 INFO:teuthology.orchestra.run.smithi082.stdout: "description": { 2023-09-23T09:48:43.575 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "description", 2023-09-23T09:48:43.575 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.575 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.575 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.575 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.575 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.575 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.575 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.576 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.576 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.576 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.576 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.576 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.576 INFO:teuthology.orchestra.run.smithi082.stdout: "device_url": { 2023-09-23T09:48:43.576 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "device_url", 2023-09-23T09:48:43.576 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.576 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.576 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.576 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-09-23T09:48:43.576 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.576 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.577 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.577 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.577 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.577 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.577 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.577 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.577 INFO:teuthology.orchestra.run.smithi082.stdout: "enabled": { 2023-09-23T09:48:43.577 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "enabled", 2023-09-23T09:48:43.577 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.577 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.577 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.577 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.578 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.578 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.578 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.578 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.578 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.578 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.578 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.578 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.578 INFO:teuthology.orchestra.run.smithi082.stdout: "interval": { 2023-09-23T09:48:43.578 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "interval", 2023-09-23T09:48:43.578 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:43.578 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.579 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.579 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "24", 2023-09-23T09:48:43.579 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "8", 2023-09-23T09:48:43.579 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.579 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.579 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.579 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.579 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.579 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.579 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.579 INFO:teuthology.orchestra.run.smithi082.stdout: "last_opt_revision": { 2023-09-23T09:48:43.579 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "last_opt_revision", 2023-09-23T09:48:43.579 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:43.579 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.580 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.580 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "1", 2023-09-23T09:48:43.580 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.580 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.580 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.580 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.580 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.580 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.580 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.580 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.580 INFO:teuthology.orchestra.run.smithi082.stdout: "leaderboard": { 2023-09-23T09:48:43.580 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "leaderboard", 2023-09-23T09:48:43.580 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.581 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.581 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.581 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.581 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.581 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.581 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.581 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.581 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.581 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.581 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.581 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.581 INFO:teuthology.orchestra.run.smithi082.stdout: "leaderboard_description": { 2023-09-23T09:48:43.582 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "leaderboard_description", 2023-09-23T09:48:43.582 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.582 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.582 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.582 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.582 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.582 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.582 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.582 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.582 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.582 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.582 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.583 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.583 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:43.583 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:43.583 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.583 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.583 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.583 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.583 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.583 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.583 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.583 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.583 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.584 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.584 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.584 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.584 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.584 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.584 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.584 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.584 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.584 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.584 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.584 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:43.584 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:43.584 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.585 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.585 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.585 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.585 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.585 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.585 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.585 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.585 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.585 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.585 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.585 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.585 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:43.586 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:43.586 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.586 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.586 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.586 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:43.586 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.586 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.586 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.586 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.586 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.586 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.587 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.587 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.587 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.587 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.587 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.587 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.587 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.587 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.587 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.587 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:43.587 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:43.588 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.588 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.588 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.588 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.588 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.588 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.588 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.588 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.588 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.588 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.588 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.589 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.589 INFO:teuthology.orchestra.run.smithi082.stdout: "organization": { 2023-09-23T09:48:43.589 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "organization", 2023-09-23T09:48:43.589 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.589 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.589 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.589 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.589 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.589 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.589 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.589 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.589 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.590 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.590 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.590 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.590 INFO:teuthology.orchestra.run.smithi082.stdout: "proxy": { 2023-09-23T09:48:43.590 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "proxy", 2023-09-23T09:48:43.590 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.590 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.590 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.590 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.590 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.590 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.591 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.591 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.591 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.591 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.591 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.591 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.591 INFO:teuthology.orchestra.run.smithi082.stdout: "url": { 2023-09-23T09:48:43.591 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "url", 2023-09-23T09:48:43.591 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.591 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.591 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.591 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-09-23T09:48:43.592 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.592 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.592 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.592 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.592 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.592 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.592 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.592 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.592 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.592 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.592 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:43.592 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "test_orchestrator", 2023-09-23T09:48:43.592 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:43.593 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:43.593 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:43.593 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:43.593 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:43.593 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.593 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.593 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.593 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.593 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.593 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.593 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.594 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.594 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.594 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.594 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.594 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.594 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.594 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.594 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.594 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.594 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.594 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.595 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.595 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:43.595 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:43.595 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.595 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.595 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.595 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.595 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.595 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.595 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.595 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.595 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.596 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.596 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.596 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.596 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:43.596 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:43.596 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.596 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.596 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.596 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:43.596 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.596 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.596 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.597 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.597 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.597 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.597 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.597 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.597 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.597 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.597 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.597 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.597 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.597 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.597 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.598 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:43.598 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:43.598 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.598 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.598 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.598 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.598 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.598 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.598 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.598 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.598 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.598 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.599 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.599 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.599 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.599 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.599 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:43.599 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "volumes", 2023-09-23T09:48:43.599 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:43.599 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:43.599 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:43.599 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:43.599 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:43.599 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.600 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.600 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.600 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.600 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.600 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.600 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.600 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.600 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.600 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.600 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.600 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.600 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.601 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.601 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.601 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.601 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.601 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.601 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.601 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:43.601 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:43.601 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.601 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.601 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.602 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.602 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.602 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.602 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.602 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.602 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.602 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.602 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.602 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.602 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:43.602 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:43.603 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.603 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.603 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.603 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:43.603 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.603 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.603 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.603 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.603 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.603 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.603 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.603 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.604 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.604 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.604 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.604 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.604 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.604 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.604 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.604 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:43.604 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:43.604 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.604 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.604 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.605 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.605 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.605 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.605 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.605 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.605 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.605 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.605 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.605 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.605 INFO:teuthology.orchestra.run.smithi082.stdout: "max_concurrent_clones": { 2023-09-23T09:48:43.605 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "max_concurrent_clones", 2023-09-23T09:48:43.606 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:43.606 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.606 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.606 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "4", 2023-09-23T09:48:43.606 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.606 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.606 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.606 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Number of asynchronous cloner threads", 2023-09-23T09:48:43.606 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.606 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.606 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.606 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.607 INFO:teuthology.orchestra.run.smithi082.stdout: "snapshot_clone_delay": { 2023-09-23T09:48:43.607 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "snapshot_clone_delay", 2023-09-23T09:48:43.607 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:43.607 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.607 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.607 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2023-09-23T09:48:43.607 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.607 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.607 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.607 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-09-23T09:48:43.607 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.607 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.608 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.608 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.608 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.608 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.608 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:43.608 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "zabbix", 2023-09-23T09:48:43.608 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:43.608 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:43.608 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:43.608 INFO:teuthology.orchestra.run.smithi082.stdout: "discovery_interval": { 2023-09-23T09:48:43.608 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "discovery_interval", 2023-09-23T09:48:43.608 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "uint", 2023-09-23T09:48:43.609 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.609 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.609 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "100", 2023-09-23T09:48:43.609 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.609 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.609 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.609 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.609 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.609 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.609 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.609 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.610 INFO:teuthology.orchestra.run.smithi082.stdout: "identifier": { 2023-09-23T09:48:43.610 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "identifier", 2023-09-23T09:48:43.610 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.610 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.610 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.610 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.610 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.610 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.610 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.610 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.610 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.610 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.611 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.611 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.611 INFO:teuthology.orchestra.run.smithi082.stdout: "interval": { 2023-09-23T09:48:43.611 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "interval", 2023-09-23T09:48:43.611 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2023-09-23T09:48:43.611 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.611 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.611 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "60", 2023-09-23T09:48:43.611 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.611 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.611 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.611 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.612 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.612 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.612 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.612 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.612 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:43.612 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:43.612 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.612 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.612 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.612 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.612 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.612 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.612 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.613 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.613 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.613 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.613 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.613 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.613 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.613 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.613 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.613 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.613 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.613 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.613 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.614 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:43.614 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:43.614 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.614 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.614 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.614 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.614 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.614 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.614 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.614 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.614 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.615 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.615 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.615 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.615 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:43.615 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:43.615 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.615 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.615 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.615 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:43.615 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.615 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.615 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.615 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.616 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.616 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.616 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.616 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.616 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.616 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.616 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.616 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.616 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.616 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.616 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.616 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:43.617 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:43.617 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.617 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.617 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.617 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.617 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.617 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.617 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.617 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.617 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.617 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.617 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.618 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.618 INFO:teuthology.orchestra.run.smithi082.stdout: "zabbix_host": { 2023-09-23T09:48:43.618 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "zabbix_host", 2023-09-23T09:48:43.618 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.618 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.618 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.618 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.618 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.618 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.618 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.618 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.618 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.619 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.619 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.619 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.619 INFO:teuthology.orchestra.run.smithi082.stdout: "zabbix_port": { 2023-09-23T09:48:43.619 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "zabbix_port", 2023-09-23T09:48:43.619 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:43.619 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.619 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.619 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10051", 2023-09-23T09:48:43.619 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.619 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.619 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.620 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.620 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.620 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.620 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.620 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.620 INFO:teuthology.orchestra.run.smithi082.stdout: "zabbix_sender": { 2023-09-23T09:48:43.620 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "zabbix_sender", 2023-09-23T09:48:43.620 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.620 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.620 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.620 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-09-23T09:48:43.620 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.621 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.621 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.621 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.621 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.621 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.621 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.621 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.621 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.621 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.621 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2023-09-23T09:48:43.621 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.621 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:43.622 INFO:teuthology.orchestra.run.smithi082.stdout: "gid": 25306, 2023-09-23T09:48:43.622 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "z", 2023-09-23T09:48:43.622 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr_features": 4540138322906710015, 2023-09-23T09:48:43.622 INFO:teuthology.orchestra.run.smithi082.stdout: "available_modules": [ 2023-09-23T09:48:43.622 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:43.622 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "alerts", 2023-09-23T09:48:43.622 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:43.622 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:43.622 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:43.622 INFO:teuthology.orchestra.run.smithi082.stdout: "interval": { 2023-09-23T09:48:43.622 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "interval", 2023-09-23T09:48:43.622 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2023-09-23T09:48:43.623 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.623 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.623 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "60", 2023-09-23T09:48:43.623 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.623 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.623 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.623 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "How frequently to reexamine health status", 2023-09-23T09:48:43.623 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.623 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.623 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.623 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.623 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:43.624 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:43.624 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.624 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.624 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.624 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.624 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.624 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.624 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.624 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.624 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.624 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.624 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.625 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.625 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.625 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.625 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.625 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.625 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.625 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.625 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.625 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:43.625 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:43.625 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.625 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.626 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.626 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.626 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.626 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.626 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.626 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.626 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.626 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.626 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.626 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.626 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:43.626 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:43.627 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.627 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.627 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.627 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:43.627 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.627 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.627 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.627 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.627 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.627 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.627 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.627 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.628 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.628 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.628 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.628 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.628 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.628 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.628 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.628 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:43.628 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:43.628 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.628 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.628 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.628 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.629 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.629 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.629 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.629 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.629 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.629 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.629 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.629 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.629 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_destination": { 2023-09-23T09:48:43.629 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_destination", 2023-09-23T09:48:43.629 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.629 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.630 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.630 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.630 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.630 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.630 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.630 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Email address to send alerts to", 2023-09-23T09:48:43.630 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.630 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.630 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.630 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.630 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_from_name": { 2023-09-23T09:48:43.631 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_from_name", 2023-09-23T09:48:43.631 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.631 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.631 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.631 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "Ceph", 2023-09-23T09:48:43.631 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.631 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.631 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.631 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Email From: name", 2023-09-23T09:48:43.631 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.631 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.631 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.632 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.632 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_host": { 2023-09-23T09:48:43.632 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_host", 2023-09-23T09:48:43.632 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.632 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.632 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.632 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.632 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.632 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.632 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.632 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "SMTP server", 2023-09-23T09:48:43.632 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.633 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.633 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.633 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.633 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_password": { 2023-09-23T09:48:43.633 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_password", 2023-09-23T09:48:43.633 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.633 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.633 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.633 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.633 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.633 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.633 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.634 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Password to authenticate with", 2023-09-23T09:48:43.634 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.634 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.634 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.634 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.634 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_port": { 2023-09-23T09:48:43.634 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_port", 2023-09-23T09:48:43.634 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:43.634 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.634 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.634 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "465", 2023-09-23T09:48:43.635 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.635 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.635 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.635 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "SMTP port", 2023-09-23T09:48:43.635 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.635 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.635 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.635 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.635 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_sender": { 2023-09-23T09:48:43.635 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_sender", 2023-09-23T09:48:43.635 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.635 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.636 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.636 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.636 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.636 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.636 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.636 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "SMTP envelope sender", 2023-09-23T09:48:43.636 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.636 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.636 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.636 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.636 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_ssl": { 2023-09-23T09:48:43.636 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_ssl", 2023-09-23T09:48:43.637 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.637 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.637 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.637 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:43.637 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.637 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.637 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.637 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Use SSL to connect to SMTP server", 2023-09-23T09:48:43.637 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.637 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.637 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.637 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.638 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_user": { 2023-09-23T09:48:43.638 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_user", 2023-09-23T09:48:43.638 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.638 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.638 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.638 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.638 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.638 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.638 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.638 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "User to authenticate as", 2023-09-23T09:48:43.638 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.638 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.639 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.639 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.639 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.639 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.639 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:43.639 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "balancer", 2023-09-23T09:48:43.639 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:43.639 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:43.639 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:43.639 INFO:teuthology.orchestra.run.smithi082.stdout: "active": { 2023-09-23T09:48:43.639 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "active", 2023-09-23T09:48:43.640 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.640 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.640 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.640 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:43.640 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.640 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.640 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.640 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "automatically balance PGs across cluster", 2023-09-23T09:48:43.640 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.640 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.640 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.641 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.641 INFO:teuthology.orchestra.run.smithi082.stdout: "begin_time": { 2023-09-23T09:48:43.641 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "begin_time", 2023-09-23T09:48:43.641 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.641 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.641 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.641 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0000", 2023-09-23T09:48:43.641 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.641 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.641 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.641 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "beginning time of day to automatically balance", 2023-09-23T09:48:43.641 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-09-23T09:48:43.642 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.642 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.642 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.642 INFO:teuthology.orchestra.run.smithi082.stdout: "begin_weekday": { 2023-09-23T09:48:43.642 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "begin_weekday", 2023-09-23T09:48:43.642 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "uint", 2023-09-23T09:48:43.642 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.642 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.642 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2023-09-23T09:48:43.642 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "0", 2023-09-23T09:48:43.642 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "6", 2023-09-23T09:48:43.642 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.643 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-09-23T09:48:43.643 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-09-23T09:48:43.643 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.643 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.643 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.643 INFO:teuthology.orchestra.run.smithi082.stdout: "crush_compat_max_iterations": { 2023-09-23T09:48:43.643 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "crush_compat_max_iterations", 2023-09-23T09:48:43.643 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "uint", 2023-09-23T09:48:43.643 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.643 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.643 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "25", 2023-09-23T09:48:43.643 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "1", 2023-09-23T09:48:43.644 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "250", 2023-09-23T09:48:43.644 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.644 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-09-23T09:48:43.644 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.644 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.644 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.644 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.644 INFO:teuthology.orchestra.run.smithi082.stdout: "crush_compat_metrics": { 2023-09-23T09:48:43.644 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "crush_compat_metrics", 2023-09-23T09:48:43.644 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.644 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.644 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.645 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "pgs,objects,bytes", 2023-09-23T09:48:43.645 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.645 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.645 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.645 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-09-23T09:48:43.645 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-09-23T09:48:43.645 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.645 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.645 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.645 INFO:teuthology.orchestra.run.smithi082.stdout: "crush_compat_step": { 2023-09-23T09:48:43.645 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "crush_compat_step", 2023-09-23T09:48:43.646 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2023-09-23T09:48:43.646 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.646 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.646 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0.5", 2023-09-23T09:48:43.646 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "0.001", 2023-09-23T09:48:43.646 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "0.999", 2023-09-23T09:48:43.646 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.646 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "aggressiveness of optimization", 2023-09-23T09:48:43.646 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-09-23T09:48:43.646 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.646 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.646 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.647 INFO:teuthology.orchestra.run.smithi082.stdout: "end_time": { 2023-09-23T09:48:43.647 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "end_time", 2023-09-23T09:48:43.647 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.647 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.647 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.647 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "2359", 2023-09-23T09:48:43.647 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.647 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.647 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.647 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "ending time of day to automatically balance", 2023-09-23T09:48:43.647 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-09-23T09:48:43.648 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.648 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.648 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.648 INFO:teuthology.orchestra.run.smithi082.stdout: "end_weekday": { 2023-09-23T09:48:43.648 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "end_weekday", 2023-09-23T09:48:43.648 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "uint", 2023-09-23T09:48:43.648 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.648 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.648 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2023-09-23T09:48:43.648 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "0", 2023-09-23T09:48:43.648 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "6", 2023-09-23T09:48:43.648 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.649 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-09-23T09:48:43.649 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-09-23T09:48:43.649 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.649 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.649 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.649 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:43.649 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:43.649 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.649 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.649 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.649 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.649 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.650 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.650 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.650 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.650 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.650 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.650 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.650 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.650 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.650 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.650 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.650 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.650 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.651 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.651 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.651 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:43.651 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:43.651 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.651 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.651 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.651 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.651 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.651 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.651 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.651 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.652 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.652 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.652 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.652 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.652 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:43.652 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:43.652 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.652 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.652 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.652 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:43.652 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.652 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.653 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.653 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.653 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.653 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.653 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.653 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.653 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.653 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.653 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.653 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.653 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.653 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.654 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.654 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:43.654 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:43.654 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.654 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.654 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.654 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.654 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.654 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.654 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.654 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.655 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.655 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.655 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.655 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.655 INFO:teuthology.orchestra.run.smithi082.stdout: "min_score": { 2023-09-23T09:48:43.655 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "min_score", 2023-09-23T09:48:43.655 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2023-09-23T09:48:43.655 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.655 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.655 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2023-09-23T09:48:43.655 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.655 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.656 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.656 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-09-23T09:48:43.656 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.656 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.656 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.656 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.656 INFO:teuthology.orchestra.run.smithi082.stdout: "mode": { 2023-09-23T09:48:43.656 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mode", 2023-09-23T09:48:43.656 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.656 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.656 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.657 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "upmap", 2023-09-23T09:48:43.657 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.657 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.657 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.657 INFO:teuthology.orchestra.run.smithi082.stdout: "crush-compat", 2023-09-23T09:48:43.657 INFO:teuthology.orchestra.run.smithi082.stdout: "none", 2023-09-23T09:48:43.657 INFO:teuthology.orchestra.run.smithi082.stdout: "upmap" 2023-09-23T09:48:43.657 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.657 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Balancer mode", 2023-09-23T09:48:43.657 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.657 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.657 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.658 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.658 INFO:teuthology.orchestra.run.smithi082.stdout: "pool_ids": { 2023-09-23T09:48:43.658 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "pool_ids", 2023-09-23T09:48:43.658 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.658 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.658 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.658 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.658 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.658 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.658 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.658 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-09-23T09:48:43.658 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.659 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.659 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.659 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.659 INFO:teuthology.orchestra.run.smithi082.stdout: "sleep_interval": { 2023-09-23T09:48:43.659 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sleep_interval", 2023-09-23T09:48:43.659 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2023-09-23T09:48:43.659 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.659 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.659 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "60", 2023-09-23T09:48:43.659 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.659 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.659 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.660 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-09-23T09:48:43.660 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.660 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.660 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.660 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.660 INFO:teuthology.orchestra.run.smithi082.stdout: "upmap_max_deviation": { 2023-09-23T09:48:43.660 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "upmap_max_deviation", 2023-09-23T09:48:43.660 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:43.660 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.660 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.660 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "5", 2023-09-23T09:48:43.661 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "1", 2023-09-23T09:48:43.661 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.661 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.661 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "deviation below which no optimization is attempted", 2023-09-23T09:48:43.661 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-09-23T09:48:43.661 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.661 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.661 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.661 INFO:teuthology.orchestra.run.smithi082.stdout: "upmap_max_optimizations": { 2023-09-23T09:48:43.661 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "upmap_max_optimizations", 2023-09-23T09:48:43.661 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "uint", 2023-09-23T09:48:43.661 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.662 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.662 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2023-09-23T09:48:43.662 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.662 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.662 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.662 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-09-23T09:48:43.662 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.662 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.662 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.662 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.662 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.663 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.663 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:43.663 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cephadm", 2023-09-23T09:48:43.663 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:43.663 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:43.663 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:43.663 INFO:teuthology.orchestra.run.smithi082.stdout: "agent_down_multiplier": { 2023-09-23T09:48:43.663 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "agent_down_multiplier", 2023-09-23T09:48:43.663 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2023-09-23T09:48:43.663 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.663 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.664 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "3.0", 2023-09-23T09:48:43.664 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.664 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.664 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.664 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-09-23T09:48:43.664 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.664 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.664 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.664 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.664 INFO:teuthology.orchestra.run.smithi082.stdout: "agent_refresh_rate": { 2023-09-23T09:48:43.664 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "agent_refresh_rate", 2023-09-23T09:48:43.664 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2023-09-23T09:48:43.665 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.665 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.665 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "20", 2023-09-23T09:48:43.665 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.665 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.665 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.665 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-09-23T09:48:43.665 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.665 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.665 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.665 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.665 INFO:teuthology.orchestra.run.smithi082.stdout: "agent_starting_port": { 2023-09-23T09:48:43.666 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "agent_starting_port", 2023-09-23T09:48:43.666 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:43.666 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.666 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.666 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "4721", 2023-09-23T09:48:43.666 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.666 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.666 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.666 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-09-23T09:48:43.666 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.666 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.666 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.667 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.667 INFO:teuthology.orchestra.run.smithi082.stdout: "allow_ptrace": { 2023-09-23T09:48:43.667 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "allow_ptrace", 2023-09-23T09:48:43.667 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.667 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.667 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.667 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.667 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.667 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.667 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.667 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-09-23T09:48:43.667 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-09-23T09:48:43.668 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.668 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.668 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.668 INFO:teuthology.orchestra.run.smithi082.stdout: "autotune_interval": { 2023-09-23T09:48:43.668 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "autotune_interval", 2023-09-23T09:48:43.668 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2023-09-23T09:48:43.668 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.668 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.668 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "600", 2023-09-23T09:48:43.668 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.668 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.668 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.669 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how frequently to autotune daemon memory", 2023-09-23T09:48:43.669 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.669 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.669 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.669 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.669 INFO:teuthology.orchestra.run.smithi082.stdout: "autotune_memory_target_ratio": { 2023-09-23T09:48:43.669 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "autotune_memory_target_ratio", 2023-09-23T09:48:43.669 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2023-09-23T09:48:43.669 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.669 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.669 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0.7", 2023-09-23T09:48:43.670 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.670 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.670 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.670 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-09-23T09:48:43.670 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.670 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.670 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.670 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.670 INFO:teuthology.orchestra.run.smithi082.stdout: "cgroups_split": { 2023-09-23T09:48:43.670 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cgroups_split", 2023-09-23T09:48:43.670 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.670 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.671 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.671 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:43.671 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.671 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.671 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.671 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-09-23T09:48:43.671 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.671 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.671 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.671 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.671 INFO:teuthology.orchestra.run.smithi082.stdout: "config_checks_enabled": { 2023-09-23T09:48:43.671 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "config_checks_enabled", 2023-09-23T09:48:43.672 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.672 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.672 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.672 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.672 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.672 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.672 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.672 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-09-23T09:48:43.672 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.672 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.672 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.673 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.673 INFO:teuthology.orchestra.run.smithi082.stdout: "config_dashboard": { 2023-09-23T09:48:43.673 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "config_dashboard", 2023-09-23T09:48:43.673 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.673 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.673 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.673 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:43.673 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.673 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.673 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.673 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-09-23T09:48:43.673 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.674 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.674 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.674 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.674 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_alertmanager": { 2023-09-23T09:48:43.674 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_alertmanager", 2023-09-23T09:48:43.674 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.674 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.674 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.674 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-09-23T09:48:43.674 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.674 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.675 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.675 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Prometheus container image", 2023-09-23T09:48:43.675 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.675 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.675 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.675 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.675 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_base": { 2023-09-23T09:48:43.675 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_base", 2023-09-23T09:48:43.675 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.675 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.675 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.676 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/ceph/ceph", 2023-09-23T09:48:43.676 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.676 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.676 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.676 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Container image name, without the tag", 2023-09-23T09:48:43.676 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.676 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.676 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.676 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.676 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_elasticsearch": { 2023-09-23T09:48:43.676 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_elasticsearch", 2023-09-23T09:48:43.676 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.677 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.677 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.677 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2023-09-23T09:48:43.677 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.677 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.677 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.677 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "elasticsearch container image", 2023-09-23T09:48:43.677 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.677 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.677 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.677 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.677 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_grafana": { 2023-09-23T09:48:43.678 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_grafana", 2023-09-23T09:48:43.678 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.678 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.678 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.678 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-09-23T09:48:43.678 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.678 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.678 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.678 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Prometheus container image", 2023-09-23T09:48:43.678 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.678 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.678 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.679 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.679 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_haproxy": { 2023-09-23T09:48:43.679 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_haproxy", 2023-09-23T09:48:43.679 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.679 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.679 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.679 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-09-23T09:48:43.679 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.679 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.679 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.679 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "HAproxy container image", 2023-09-23T09:48:43.679 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.679 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.680 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.680 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.680 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_jaeger_agent": { 2023-09-23T09:48:43.680 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_jaeger_agent", 2023-09-23T09:48:43.680 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.680 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.680 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.680 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2023-09-23T09:48:43.680 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.680 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.680 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.680 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Jaeger agent container image", 2023-09-23T09:48:43.681 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.681 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.681 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.681 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.681 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_jaeger_collector": { 2023-09-23T09:48:43.681 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_jaeger_collector", 2023-09-23T09:48:43.681 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.681 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.681 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.681 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2023-09-23T09:48:43.681 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.682 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.682 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.682 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Jaeger collector container image", 2023-09-23T09:48:43.682 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.682 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.682 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.682 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.682 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_jaeger_query": { 2023-09-23T09:48:43.682 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_jaeger_query", 2023-09-23T09:48:43.682 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.682 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.683 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.683 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2023-09-23T09:48:43.683 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.683 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.683 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.683 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Jaeger query container image", 2023-09-23T09:48:43.683 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.683 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.683 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.683 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.683 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_keepalived": { 2023-09-23T09:48:43.684 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_keepalived", 2023-09-23T09:48:43.684 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.684 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.684 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.684 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2023-09-23T09:48:43.684 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.684 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.684 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.684 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Keepalived container image", 2023-09-23T09:48:43.684 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.684 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.684 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.685 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.685 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_loki": { 2023-09-23T09:48:43.685 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_loki", 2023-09-23T09:48:43.685 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.685 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.685 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.685 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-09-23T09:48:43.685 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.685 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.685 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.685 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Loki container image", 2023-09-23T09:48:43.685 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.686 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.686 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.686 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.686 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_node_exporter": { 2023-09-23T09:48:43.686 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_node_exporter", 2023-09-23T09:48:43.686 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.686 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.686 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.686 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-09-23T09:48:43.686 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.686 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.687 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.687 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Prometheus container image", 2023-09-23T09:48:43.687 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.687 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.687 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.687 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.687 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_nvmeof": { 2023-09-23T09:48:43.687 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_nvmeof", 2023-09-23T09:48:43.687 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.687 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.687 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.687 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/ceph/nvmeof:0.0.2", 2023-09-23T09:48:43.688 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.688 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.688 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.688 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Nvme-of container image", 2023-09-23T09:48:43.688 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.688 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.688 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.688 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.688 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_prometheus": { 2023-09-23T09:48:43.688 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_prometheus", 2023-09-23T09:48:43.688 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.688 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.689 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.689 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-09-23T09:48:43.689 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.689 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.689 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.689 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Prometheus container image", 2023-09-23T09:48:43.689 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.689 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.689 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.689 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.689 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_promtail": { 2023-09-23T09:48:43.690 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_promtail", 2023-09-23T09:48:43.690 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.690 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.690 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.690 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-09-23T09:48:43.690 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.690 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.690 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.690 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Promtail container image", 2023-09-23T09:48:43.690 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.690 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.691 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.691 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.691 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_snmp_gateway": { 2023-09-23T09:48:43.691 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_snmp_gateway", 2023-09-23T09:48:43.691 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.691 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.691 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.693 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-09-23T09:48:43.693 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.693 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.693 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.693 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "SNMP Gateway container image", 2023-09-23T09:48:43.693 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.693 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.693 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.693 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.694 INFO:teuthology.orchestra.run.smithi082.stdout: "container_init": { 2023-09-23T09:48:43.694 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_init", 2023-09-23T09:48:43.694 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.694 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.694 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.694 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:43.694 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.694 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.694 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.694 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Run podman/docker with `--init`", 2023-09-23T09:48:43.694 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.695 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.695 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.695 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.695 INFO:teuthology.orchestra.run.smithi082.stdout: "daemon_cache_timeout": { 2023-09-23T09:48:43.695 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "daemon_cache_timeout", 2023-09-23T09:48:43.695 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2023-09-23T09:48:43.695 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.695 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.695 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "600", 2023-09-23T09:48:43.696 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.696 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.696 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.696 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-09-23T09:48:43.696 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.696 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.696 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.696 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.696 INFO:teuthology.orchestra.run.smithi082.stdout: "default_cephadm_command_timeout": { 2023-09-23T09:48:43.696 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "default_cephadm_command_timeout", 2023-09-23T09:48:43.696 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2023-09-23T09:48:43.697 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.697 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.697 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "900", 2023-09-23T09:48:43.697 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.697 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.697 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.697 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-09-23T09:48:43.697 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.697 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.697 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.698 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.698 INFO:teuthology.orchestra.run.smithi082.stdout: "default_registry": { 2023-09-23T09:48:43.698 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "default_registry", 2023-09-23T09:48:43.698 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.698 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.698 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.698 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "docker.io", 2023-09-23T09:48:43.698 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.698 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.698 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.699 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-09-23T09:48:43.699 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.699 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.699 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.699 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.699 INFO:teuthology.orchestra.run.smithi082.stdout: "device_cache_timeout": { 2023-09-23T09:48:43.699 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "device_cache_timeout", 2023-09-23T09:48:43.699 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2023-09-23T09:48:43.699 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.699 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.699 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "1800", 2023-09-23T09:48:43.699 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.700 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.700 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.700 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "seconds to cache device inventory", 2023-09-23T09:48:43.700 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.700 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.700 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.700 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.700 INFO:teuthology.orchestra.run.smithi082.stdout: "device_enhanced_scan": { 2023-09-23T09:48:43.700 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "device_enhanced_scan", 2023-09-23T09:48:43.700 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.700 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.700 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.700 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.701 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.701 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.701 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.701 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Use libstoragemgmt during device scans", 2023-09-23T09:48:43.701 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.701 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.701 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.701 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.701 INFO:teuthology.orchestra.run.smithi082.stdout: "facts_cache_timeout": { 2023-09-23T09:48:43.701 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "facts_cache_timeout", 2023-09-23T09:48:43.701 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2023-09-23T09:48:43.702 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.702 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.702 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "60", 2023-09-23T09:48:43.702 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.702 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.702 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.702 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "seconds to cache host facts data", 2023-09-23T09:48:43.702 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.702 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.702 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.702 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.703 INFO:teuthology.orchestra.run.smithi082.stdout: "host_check_interval": { 2023-09-23T09:48:43.703 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "host_check_interval", 2023-09-23T09:48:43.703 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2023-09-23T09:48:43.703 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.703 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.703 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "600", 2023-09-23T09:48:43.703 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.703 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.703 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.703 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how frequently to perform a host check", 2023-09-23T09:48:43.703 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.704 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.704 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.704 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.704 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:43.704 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:43.704 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.704 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.704 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.704 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.704 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.704 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.704 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.705 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.705 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.705 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.705 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.705 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.705 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.705 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.705 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.705 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.705 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.705 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.705 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.706 INFO:teuthology.orchestra.run.smithi082.stdout: "log_refresh_metadata": { 2023-09-23T09:48:43.706 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_refresh_metadata", 2023-09-23T09:48:43.706 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.706 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.706 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.706 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.706 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.706 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.706 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.706 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-09-23T09:48:43.706 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.707 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.707 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.707 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.707 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:43.707 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:43.707 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.707 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.707 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.707 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:43.707 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.707 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.707 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.708 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-09-23T09:48:43.708 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.708 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.708 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.708 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.708 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:43.708 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:43.708 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.708 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.708 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.708 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:43.709 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.709 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.709 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.709 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.709 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.709 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.709 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.709 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.709 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.709 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.709 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.709 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.710 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.710 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.710 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.710 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:43.710 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:43.710 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.710 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.710 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.710 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.710 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.710 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.710 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.711 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.711 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.711 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.711 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.711 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.711 INFO:teuthology.orchestra.run.smithi082.stdout: "manage_etc_ceph_ceph_conf": { 2023-09-23T09:48:43.711 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-09-23T09:48:43.711 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.711 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.711 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.711 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.711 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.712 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.712 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.712 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-09-23T09:48:43.712 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.712 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.712 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.712 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.712 INFO:teuthology.orchestra.run.smithi082.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-09-23T09:48:43.712 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-09-23T09:48:43.712 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.712 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.712 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.712 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "*", 2023-09-23T09:48:43.713 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.713 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.713 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.713 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-09-23T09:48:43.713 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.713 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.713 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.713 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.713 INFO:teuthology.orchestra.run.smithi082.stdout: "max_count_per_host": { 2023-09-23T09:48:43.713 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "max_count_per_host", 2023-09-23T09:48:43.713 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:43.713 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.714 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.714 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2023-09-23T09:48:43.714 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.714 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.714 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.714 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "max number of daemons per service per host", 2023-09-23T09:48:43.714 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.714 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.714 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.714 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.714 INFO:teuthology.orchestra.run.smithi082.stdout: "max_osd_draining_count": { 2023-09-23T09:48:43.714 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "max_osd_draining_count", 2023-09-23T09:48:43.715 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:43.715 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.715 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.715 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2023-09-23T09:48:43.715 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.715 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.715 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.715 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-09-23T09:48:43.715 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.715 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.715 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.715 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.716 INFO:teuthology.orchestra.run.smithi082.stdout: "migration_current": { 2023-09-23T09:48:43.716 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "migration_current", 2023-09-23T09:48:43.716 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:43.716 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.716 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.716 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.716 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.716 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.716 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.716 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "internal - do not modify", 2023-09-23T09:48:43.716 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.716 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.717 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.717 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.717 INFO:teuthology.orchestra.run.smithi082.stdout: "mode": { 2023-09-23T09:48:43.717 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mode", 2023-09-23T09:48:43.717 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.717 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.717 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.717 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "root", 2023-09-23T09:48:43.717 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.717 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.717 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.717 INFO:teuthology.orchestra.run.smithi082.stdout: "cephadm-package", 2023-09-23T09:48:43.717 INFO:teuthology.orchestra.run.smithi082.stdout: "root" 2023-09-23T09:48:43.718 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.718 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "mode for remote execution of cephadm", 2023-09-23T09:48:43.718 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.718 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.718 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.718 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.718 INFO:teuthology.orchestra.run.smithi082.stdout: "prometheus_alerts_path": { 2023-09-23T09:48:43.718 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "prometheus_alerts_path", 2023-09-23T09:48:43.718 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.718 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.718 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.719 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-09-23T09:48:43.719 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.719 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.719 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.719 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-09-23T09:48:43.719 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.719 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.719 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.719 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.719 INFO:teuthology.orchestra.run.smithi082.stdout: "registry_insecure": { 2023-09-23T09:48:43.719 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "registry_insecure", 2023-09-23T09:48:43.719 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.719 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.720 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.720 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.720 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.720 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.720 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.720 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-09-23T09:48:43.720 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.720 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.720 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.720 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.720 INFO:teuthology.orchestra.run.smithi082.stdout: "registry_password": { 2023-09-23T09:48:43.720 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "registry_password", 2023-09-23T09:48:43.721 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.721 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.721 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.721 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.721 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.721 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.721 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.721 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-09-23T09:48:43.721 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.721 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.721 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.721 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.722 INFO:teuthology.orchestra.run.smithi082.stdout: "registry_url": { 2023-09-23T09:48:43.722 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "registry_url", 2023-09-23T09:48:43.722 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.722 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.722 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.722 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.722 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.722 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.722 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.722 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-09-23T09:48:43.722 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.722 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.723 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.723 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.723 INFO:teuthology.orchestra.run.smithi082.stdout: "registry_username": { 2023-09-23T09:48:43.723 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "registry_username", 2023-09-23T09:48:43.723 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.723 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.723 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.723 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.723 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.723 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.723 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.723 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-09-23T09:48:43.724 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.724 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.724 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.724 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.724 INFO:teuthology.orchestra.run.smithi082.stdout: "secure_monitoring_stack": { 2023-09-23T09:48:43.724 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "secure_monitoring_stack", 2023-09-23T09:48:43.724 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.724 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.724 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.724 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.724 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.724 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.725 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.725 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2023-09-23T09:48:43.725 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.725 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.725 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.725 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.725 INFO:teuthology.orchestra.run.smithi082.stdout: "service_discovery_port": { 2023-09-23T09:48:43.725 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "service_discovery_port", 2023-09-23T09:48:43.725 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:43.725 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.725 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.725 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "8765", 2023-09-23T09:48:43.726 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.726 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.726 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.726 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "cephadm service discovery port", 2023-09-23T09:48:43.726 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.726 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.726 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.726 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.726 INFO:teuthology.orchestra.run.smithi082.stdout: "ssh_config_file": { 2023-09-23T09:48:43.726 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ssh_config_file", 2023-09-23T09:48:43.726 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.727 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.727 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.727 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.727 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.727 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.727 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.727 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-09-23T09:48:43.727 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.727 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.727 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.727 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.727 INFO:teuthology.orchestra.run.smithi082.stdout: "use_agent": { 2023-09-23T09:48:43.727 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "use_agent", 2023-09-23T09:48:43.728 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.728 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.728 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.728 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.728 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.728 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.728 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.728 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-09-23T09:48:43.728 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.728 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.728 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.728 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.728 INFO:teuthology.orchestra.run.smithi082.stdout: "use_repo_digest": { 2023-09-23T09:48:43.729 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "use_repo_digest", 2023-09-23T09:48:43.729 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.729 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.729 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.729 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:43.729 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.729 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.729 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.729 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-09-23T09:48:43.729 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.729 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.729 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.730 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.730 INFO:teuthology.orchestra.run.smithi082.stdout: "warn_on_failed_host_check": { 2023-09-23T09:48:43.730 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "warn_on_failed_host_check", 2023-09-23T09:48:43.730 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.730 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.730 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.730 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:43.730 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.730 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.731 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.731 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "raise a health warning if the host check fails", 2023-09-23T09:48:43.731 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.731 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.731 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.731 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.731 INFO:teuthology.orchestra.run.smithi082.stdout: "warn_on_stray_daemons": { 2023-09-23T09:48:43.731 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "warn_on_stray_daemons", 2023-09-23T09:48:43.731 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.731 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.731 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.731 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:43.732 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.732 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.732 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.732 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-09-23T09:48:43.732 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.732 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.732 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.732 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.732 INFO:teuthology.orchestra.run.smithi082.stdout: "warn_on_stray_hosts": { 2023-09-23T09:48:43.732 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "warn_on_stray_hosts", 2023-09-23T09:48:43.732 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.732 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.733 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.733 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:43.733 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.733 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.733 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.733 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-09-23T09:48:43.733 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.733 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.733 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.733 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.733 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.733 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.734 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:43.734 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "crash", 2023-09-23T09:48:43.734 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:43.734 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:43.734 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:43.734 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:43.734 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:43.734 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.734 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.734 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.734 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.734 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.735 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.735 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.735 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.735 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.735 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.735 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.735 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.735 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.735 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.735 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.736 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.736 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.736 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.736 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.736 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:43.736 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:43.736 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.736 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.736 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.736 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.736 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.737 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.737 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.737 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.737 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.737 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.737 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.737 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.737 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:43.737 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:43.737 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.737 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.737 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.738 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:43.738 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.738 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.738 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.738 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.738 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.738 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.738 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.738 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.738 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.738 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.739 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.739 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.739 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.739 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.739 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.739 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:43.739 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:43.739 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.739 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.739 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.739 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.739 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.740 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.740 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.740 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.740 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.740 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.740 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.740 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.740 INFO:teuthology.orchestra.run.smithi082.stdout: "retain_interval": { 2023-09-23T09:48:43.740 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "retain_interval", 2023-09-23T09:48:43.740 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2023-09-23T09:48:43.740 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.740 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.741 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "31536000", 2023-09-23T09:48:43.741 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.741 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.741 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.741 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how long to retain crashes before pruning them", 2023-09-23T09:48:43.741 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.741 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.741 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.741 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.741 INFO:teuthology.orchestra.run.smithi082.stdout: "warn_recent_interval": { 2023-09-23T09:48:43.741 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "warn_recent_interval", 2023-09-23T09:48:43.741 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2023-09-23T09:48:43.742 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.742 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.742 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "1209600", 2023-09-23T09:48:43.742 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.742 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.742 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.742 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "time interval in which to warn about recent crashes", 2023-09-23T09:48:43.742 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.742 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.742 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.742 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.743 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.743 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.743 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:43.743 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "dashboard", 2023-09-23T09:48:43.743 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:43.743 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:43.743 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:43.743 INFO:teuthology.orchestra.run.smithi082.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-09-23T09:48:43.743 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-09-23T09:48:43.743 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:43.743 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.744 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.744 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2023-09-23T09:48:43.744 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.744 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.744 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.744 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.744 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.744 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.744 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.744 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.744 INFO:teuthology.orchestra.run.smithi082.stdout: "ALERTMANAGER_API_HOST": { 2023-09-23T09:48:43.744 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ALERTMANAGER_API_HOST", 2023-09-23T09:48:43.745 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.745 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.745 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.745 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.745 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.745 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.745 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.745 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.745 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.745 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.745 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.745 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.746 INFO:teuthology.orchestra.run.smithi082.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-09-23T09:48:43.746 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-09-23T09:48:43.746 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.746 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.746 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.746 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:43.746 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.746 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.746 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.746 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.746 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.746 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.747 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.747 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.747 INFO:teuthology.orchestra.run.smithi082.stdout: "AUDIT_API_ENABLED": { 2023-09-23T09:48:43.747 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "AUDIT_API_ENABLED", 2023-09-23T09:48:43.747 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.747 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.747 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.747 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.747 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.747 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.747 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.747 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.748 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.748 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.748 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.748 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.748 INFO:teuthology.orchestra.run.smithi082.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-09-23T09:48:43.748 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-09-23T09:48:43.748 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.748 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.748 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.748 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:43.748 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.748 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.749 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.749 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.749 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.749 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.749 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.749 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.749 INFO:teuthology.orchestra.run.smithi082.stdout: "ENABLE_BROWSABLE_API": { 2023-09-23T09:48:43.749 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ENABLE_BROWSABLE_API", 2023-09-23T09:48:43.749 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.749 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.749 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.749 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:43.750 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.750 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.750 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.750 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.750 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.750 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.750 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.750 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.750 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-09-23T09:48:43.750 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-09-23T09:48:43.750 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.750 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.751 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.751 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:43.751 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.751 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.751 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.751 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.751 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.751 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.751 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.751 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.751 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-09-23T09:48:43.751 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-09-23T09:48:43.752 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.752 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.752 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.752 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:43.752 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.752 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.752 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.752 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.752 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.752 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.752 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.752 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.753 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-09-23T09:48:43.753 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-09-23T09:48:43.753 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.753 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.753 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.753 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:43.753 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.753 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.753 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.753 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.753 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.754 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.754 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.754 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.754 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-09-23T09:48:43.754 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-09-23T09:48:43.754 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.754 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.754 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.754 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:43.754 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.754 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.754 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.755 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.755 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.755 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.755 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.755 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.755 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_NFS": { 2023-09-23T09:48:43.755 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-09-23T09:48:43.755 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.755 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.755 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.755 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:43.756 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.756 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.756 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.756 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.756 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.756 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.756 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.756 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.756 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_RBD": { 2023-09-23T09:48:43.756 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-09-23T09:48:43.756 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.757 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.757 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.757 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:43.757 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.757 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.757 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.757 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.757 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.757 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.757 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.757 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.757 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_RGW": { 2023-09-23T09:48:43.758 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-09-23T09:48:43.758 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.758 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.758 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.758 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:43.758 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.758 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.758 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.758 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.758 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.758 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.758 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.759 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.759 INFO:teuthology.orchestra.run.smithi082.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-09-23T09:48:43.759 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-09-23T09:48:43.759 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.759 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.759 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.759 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.759 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.759 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.759 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.759 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.760 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.760 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.760 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.760 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.760 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_API_PASSWORD": { 2023-09-23T09:48:43.760 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_API_PASSWORD", 2023-09-23T09:48:43.760 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.760 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.760 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.760 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "admin", 2023-09-23T09:48:43.760 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.761 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.761 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.761 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.761 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.761 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.761 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.761 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.761 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-09-23T09:48:43.761 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-09-23T09:48:43.761 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.761 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.761 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.761 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:43.762 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.762 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.762 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.762 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.762 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.762 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.762 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.762 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.762 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_API_URL": { 2023-09-23T09:48:43.762 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_API_URL", 2023-09-23T09:48:43.762 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.763 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.763 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.763 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.763 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.763 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.763 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.763 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.763 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.763 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.763 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.763 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.763 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_API_USERNAME": { 2023-09-23T09:48:43.764 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_API_USERNAME", 2023-09-23T09:48:43.764 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.764 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.764 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.764 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "admin", 2023-09-23T09:48:43.764 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.764 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.764 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.764 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.764 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.764 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.765 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.765 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.765 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-09-23T09:48:43.765 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-09-23T09:48:43.765 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.765 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.765 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.765 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.765 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.765 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.765 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.765 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.766 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.766 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.766 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.766 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.766 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-09-23T09:48:43.766 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-09-23T09:48:43.766 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.766 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.766 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.766 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.766 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.767 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.767 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.767 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.767 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.767 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.767 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.767 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.767 INFO:teuthology.orchestra.run.smithi082.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-09-23T09:48:43.767 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-09-23T09:48:43.767 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.767 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.768 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.768 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:43.768 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.768 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.768 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.768 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.768 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.768 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.768 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.768 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.769 INFO:teuthology.orchestra.run.smithi082.stdout: "ISSUE_TRACKER_API_KEY": { 2023-09-23T09:48:43.769 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-09-23T09:48:43.769 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.769 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.769 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.769 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.769 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.769 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.769 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.769 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.769 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.770 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.770 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.770 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.770 INFO:teuthology.orchestra.run.smithi082.stdout: "PROMETHEUS_API_HOST": { 2023-09-23T09:48:43.770 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PROMETHEUS_API_HOST", 2023-09-23T09:48:43.770 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.770 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.770 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.770 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.770 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.770 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.770 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.771 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.771 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.771 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.771 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.771 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.771 INFO:teuthology.orchestra.run.smithi082.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-09-23T09:48:43.771 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-09-23T09:48:43.771 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.771 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.771 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.772 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:43.772 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.772 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.772 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.772 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.772 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.772 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.772 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.772 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.772 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-09-23T09:48:43.772 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-09-23T09:48:43.772 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.773 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.773 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.773 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.773 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.773 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.773 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.773 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.773 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.773 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.773 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.773 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.773 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-09-23T09:48:43.774 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-09-23T09:48:43.774 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.774 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.774 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.774 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.774 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.774 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.774 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.774 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.774 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.774 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.774 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.775 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.775 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-09-23T09:48:43.775 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-09-23T09:48:43.775 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.775 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.775 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.775 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:43.775 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.775 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.775 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.775 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.776 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.776 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.776 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.776 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.776 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-09-23T09:48:43.776 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-09-23T09:48:43.776 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.776 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.776 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.776 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:43.776 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.776 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.777 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.777 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.777 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.777 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.777 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.777 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.777 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-09-23T09:48:43.777 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-09-23T09:48:43.777 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.777 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.777 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.777 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.778 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.778 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.778 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.778 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.778 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.778 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.778 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.778 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.778 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-09-23T09:48:43.778 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-09-23T09:48:43.778 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.778 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.779 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.779 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.779 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.779 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.779 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.779 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.779 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.779 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.779 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.779 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.779 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-09-23T09:48:43.779 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-09-23T09:48:43.780 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.780 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.780 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.780 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.780 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.780 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.780 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.780 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.780 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.780 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.780 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.780 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.781 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_ENABLED": { 2023-09-23T09:48:43.781 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_ENABLED", 2023-09-23T09:48:43.781 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.781 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.781 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.781 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:43.781 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.781 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.781 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.781 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.781 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.781 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.782 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.782 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.782 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-09-23T09:48:43.782 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-09-23T09:48:43.782 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.782 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.782 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.782 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-09-23T09:48:43.782 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.782 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.782 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.782 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.783 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.783 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.783 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.783 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.783 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-09-23T09:48:43.783 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-09-23T09:48:43.783 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:43.783 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.783 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.783 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2023-09-23T09:48:43.783 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.784 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.784 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.784 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.784 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.784 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.784 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.784 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.784 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-09-23T09:48:43.784 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-09-23T09:48:43.784 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:43.784 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.784 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.785 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "8", 2023-09-23T09:48:43.785 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.785 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.785 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.785 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.785 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.785 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.785 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.785 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.785 INFO:teuthology.orchestra.run.smithi082.stdout: "REST_REQUESTS_TIMEOUT": { 2023-09-23T09:48:43.785 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-09-23T09:48:43.785 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:43.786 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.786 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.786 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "45", 2023-09-23T09:48:43.786 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.786 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.786 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.786 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.786 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.786 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.786 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.786 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.787 INFO:teuthology.orchestra.run.smithi082.stdout: "RGW_API_ACCESS_KEY": { 2023-09-23T09:48:43.787 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "RGW_API_ACCESS_KEY", 2023-09-23T09:48:43.787 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.787 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.787 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.787 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.787 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.787 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.787 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.787 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.787 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.787 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.788 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.788 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.788 INFO:teuthology.orchestra.run.smithi082.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-09-23T09:48:43.788 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-09-23T09:48:43.788 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.788 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.788 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.788 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "admin", 2023-09-23T09:48:43.788 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.788 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.788 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.788 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.789 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.789 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.789 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.789 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.789 INFO:teuthology.orchestra.run.smithi082.stdout: "RGW_API_SECRET_KEY": { 2023-09-23T09:48:43.789 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "RGW_API_SECRET_KEY", 2023-09-23T09:48:43.789 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.789 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.789 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.789 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.789 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.789 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.790 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.790 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.790 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.790 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.790 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.790 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.790 INFO:teuthology.orchestra.run.smithi082.stdout: "RGW_API_SSL_VERIFY": { 2023-09-23T09:48:43.790 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "RGW_API_SSL_VERIFY", 2023-09-23T09:48:43.790 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.790 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.790 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.790 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:43.790 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.791 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.791 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.791 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.791 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.791 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.791 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.791 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.791 INFO:teuthology.orchestra.run.smithi082.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-09-23T09:48:43.791 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-09-23T09:48:43.791 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:43.791 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.792 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.792 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2023-09-23T09:48:43.792 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.792 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.792 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.792 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.792 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.792 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.792 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.792 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.792 INFO:teuthology.orchestra.run.smithi082.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-09-23T09:48:43.792 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-09-23T09:48:43.792 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:43.793 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.793 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.793 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2023-09-23T09:48:43.793 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.793 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.793 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.793 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.793 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.793 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.793 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.793 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.793 INFO:teuthology.orchestra.run.smithi082.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-09-23T09:48:43.794 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-09-23T09:48:43.794 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:43.794 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.794 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.794 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "5", 2023-09-23T09:48:43.794 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.794 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.794 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.794 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.794 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.794 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.794 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.795 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.795 INFO:teuthology.orchestra.run.smithi082.stdout: "cross_origin_url": { 2023-09-23T09:48:43.795 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cross_origin_url", 2023-09-23T09:48:43.795 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.795 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.795 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.795 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.795 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.795 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.795 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.795 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.795 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.796 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.796 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.796 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.796 INFO:teuthology.orchestra.run.smithi082.stdout: "crt_file": { 2023-09-23T09:48:43.796 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "crt_file", 2023-09-23T09:48:43.796 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.796 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.796 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.796 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.796 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.796 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.797 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.797 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.797 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.797 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.797 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.797 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.797 INFO:teuthology.orchestra.run.smithi082.stdout: "debug": { 2023-09-23T09:48:43.797 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "debug", 2023-09-23T09:48:43.797 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.797 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.797 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.797 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.797 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.798 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.798 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.798 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Enable/disable debug options", 2023-09-23T09:48:43.798 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.798 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.798 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.798 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.798 INFO:teuthology.orchestra.run.smithi082.stdout: "jwt_token_ttl": { 2023-09-23T09:48:43.798 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "jwt_token_ttl", 2023-09-23T09:48:43.798 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:43.798 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.799 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.799 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "28800", 2023-09-23T09:48:43.799 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.799 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.799 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.799 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.799 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.799 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.799 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.799 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.799 INFO:teuthology.orchestra.run.smithi082.stdout: "key_file": { 2023-09-23T09:48:43.800 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "key_file", 2023-09-23T09:48:43.800 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.800 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.800 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.800 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.800 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.800 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.800 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.800 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.800 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.800 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.800 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.801 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.801 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:43.801 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:43.801 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.801 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.801 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.801 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.801 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.801 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.801 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.801 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.801 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.801 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.802 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.802 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.802 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.802 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.802 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.802 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.802 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.802 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.802 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.802 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:43.802 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:43.803 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.803 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.803 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.803 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.803 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.803 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.803 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.803 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.803 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.803 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.803 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.803 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.804 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:43.804 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:43.804 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.804 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.804 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.804 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:43.804 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.804 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.804 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.804 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.804 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.805 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.805 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.805 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.805 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.805 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.805 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.805 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.805 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.805 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.805 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.805 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:43.806 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:43.806 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.806 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.806 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.806 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.806 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.806 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.806 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.806 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.806 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.806 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.806 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.807 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.807 INFO:teuthology.orchestra.run.smithi082.stdout: "motd": { 2023-09-23T09:48:43.807 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "motd", 2023-09-23T09:48:43.807 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.807 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.807 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.807 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.807 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.807 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.807 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.807 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "The message of the day", 2023-09-23T09:48:43.807 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.808 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.808 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.808 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.808 INFO:teuthology.orchestra.run.smithi082.stdout: "redirect_resolve_ip_addr": { 2023-09-23T09:48:43.808 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "redirect_resolve_ip_addr", 2023-09-23T09:48:43.808 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.808 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.808 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.808 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.808 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.808 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.808 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.809 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.809 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.809 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.809 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.809 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.809 INFO:teuthology.orchestra.run.smithi082.stdout: "server_addr": { 2023-09-23T09:48:43.809 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_addr", 2023-09-23T09:48:43.809 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.809 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.809 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.809 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "::", 2023-09-23T09:48:43.810 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.810 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.810 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.810 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.810 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.810 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.810 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.810 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.810 INFO:teuthology.orchestra.run.smithi082.stdout: "server_port": { 2023-09-23T09:48:43.810 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_port", 2023-09-23T09:48:43.810 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:43.810 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.811 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.811 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "8080", 2023-09-23T09:48:43.811 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.811 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.811 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.811 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.811 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.811 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.811 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.811 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.811 INFO:teuthology.orchestra.run.smithi082.stdout: "ssl": { 2023-09-23T09:48:43.812 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ssl", 2023-09-23T09:48:43.812 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.812 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.812 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.812 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:43.812 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.812 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.812 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.812 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.812 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.812 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.812 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.813 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.813 INFO:teuthology.orchestra.run.smithi082.stdout: "ssl_server_port": { 2023-09-23T09:48:43.813 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ssl_server_port", 2023-09-23T09:48:43.813 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:43.813 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.813 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.813 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "8443", 2023-09-23T09:48:43.813 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.813 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.813 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.813 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.813 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.814 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.814 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.814 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.814 INFO:teuthology.orchestra.run.smithi082.stdout: "standby_behaviour": { 2023-09-23T09:48:43.814 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "standby_behaviour", 2023-09-23T09:48:43.814 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.814 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.814 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.814 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "redirect", 2023-09-23T09:48:43.814 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.814 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.814 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.815 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.815 INFO:teuthology.orchestra.run.smithi082.stdout: "redirect" 2023-09-23T09:48:43.815 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.815 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.815 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.815 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.815 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.815 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.815 INFO:teuthology.orchestra.run.smithi082.stdout: "standby_error_status_code": { 2023-09-23T09:48:43.815 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "standby_error_status_code", 2023-09-23T09:48:43.815 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:43.815 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.816 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.816 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "500", 2023-09-23T09:48:43.816 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "400", 2023-09-23T09:48:43.816 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "599", 2023-09-23T09:48:43.816 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.816 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.816 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.816 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.816 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.816 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.816 INFO:teuthology.orchestra.run.smithi082.stdout: "url_prefix": { 2023-09-23T09:48:43.816 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "url_prefix", 2023-09-23T09:48:43.817 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.817 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.817 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.817 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.817 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.817 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.817 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.817 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.817 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.817 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.817 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.817 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.818 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.818 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.818 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:43.818 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "devicehealth", 2023-09-23T09:48:43.818 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:43.818 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:43.818 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:43.818 INFO:teuthology.orchestra.run.smithi082.stdout: "enable_monitoring": { 2023-09-23T09:48:43.818 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "enable_monitoring", 2023-09-23T09:48:43.818 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.818 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.819 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.819 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:43.819 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.819 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.819 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.819 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "monitor device health metrics", 2023-09-23T09:48:43.819 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.819 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.819 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.819 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.819 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:43.820 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:43.820 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.820 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.820 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.820 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.820 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.820 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.820 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.820 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.820 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.820 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.820 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.821 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.821 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.821 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.821 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.821 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.821 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.821 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.821 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.821 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:43.821 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:43.821 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.821 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.822 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.822 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.822 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.822 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.822 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.822 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.822 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.822 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.822 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.822 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.822 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:43.823 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:43.823 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.823 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.823 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.823 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:43.823 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.823 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.823 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.823 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.823 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.823 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.823 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.824 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.824 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.824 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.824 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.824 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.824 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.824 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.824 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.824 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:43.824 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:43.824 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.825 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.825 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.825 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.825 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.825 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.825 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.825 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.825 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.825 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.825 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.825 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.825 INFO:teuthology.orchestra.run.smithi082.stdout: "mark_out_threshold": { 2023-09-23T09:48:43.825 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mark_out_threshold", 2023-09-23T09:48:43.826 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2023-09-23T09:48:43.826 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.826 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.826 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "2419200", 2023-09-23T09:48:43.826 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.826 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.826 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.826 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-09-23T09:48:43.826 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.826 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.826 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.826 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.827 INFO:teuthology.orchestra.run.smithi082.stdout: "pool_name": { 2023-09-23T09:48:43.827 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "pool_name", 2023-09-23T09:48:43.827 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.827 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.827 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.827 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "device_health_metrics", 2023-09-23T09:48:43.827 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.827 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.827 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.827 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "name of pool in which to store device health metrics", 2023-09-23T09:48:43.827 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.827 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.827 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.828 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.828 INFO:teuthology.orchestra.run.smithi082.stdout: "retention_period": { 2023-09-23T09:48:43.828 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "retention_period", 2023-09-23T09:48:43.828 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2023-09-23T09:48:43.828 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.828 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.828 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "15552000", 2023-09-23T09:48:43.828 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.828 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.828 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.828 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how long to retain device health metrics", 2023-09-23T09:48:43.828 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.828 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.829 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.829 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.829 INFO:teuthology.orchestra.run.smithi082.stdout: "scrape_frequency": { 2023-09-23T09:48:43.829 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "scrape_frequency", 2023-09-23T09:48:43.829 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2023-09-23T09:48:43.829 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.829 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.829 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "86400", 2023-09-23T09:48:43.829 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.829 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.829 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.829 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how frequently to scrape device health metrics", 2023-09-23T09:48:43.829 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.830 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.830 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.830 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.830 INFO:teuthology.orchestra.run.smithi082.stdout: "self_heal": { 2023-09-23T09:48:43.830 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "self_heal", 2023-09-23T09:48:43.830 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.830 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.830 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.830 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:43.830 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.830 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.830 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.830 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-09-23T09:48:43.831 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.831 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.831 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.831 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.831 INFO:teuthology.orchestra.run.smithi082.stdout: "sleep_interval": { 2023-09-23T09:48:43.831 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sleep_interval", 2023-09-23T09:48:43.831 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2023-09-23T09:48:43.831 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.831 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.831 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "600", 2023-09-23T09:48:43.831 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.831 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.832 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.832 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how frequently to wake up and check device health", 2023-09-23T09:48:43.832 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.832 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.832 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.832 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.832 INFO:teuthology.orchestra.run.smithi082.stdout: "warn_threshold": { 2023-09-23T09:48:43.832 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "warn_threshold", 2023-09-23T09:48:43.832 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2023-09-23T09:48:43.832 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.832 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.832 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "7257600", 2023-09-23T09:48:43.832 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.833 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.833 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.833 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-09-23T09:48:43.833 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.833 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.833 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.833 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.833 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.833 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.833 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:43.833 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "diskprediction_local", 2023-09-23T09:48:43.833 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:43.834 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:43.834 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:43.834 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:43.834 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:43.834 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.834 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.834 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.834 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.834 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.834 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.834 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.834 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.835 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.835 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.835 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.835 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.835 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.835 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.835 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.835 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.835 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.835 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.835 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.836 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:43.836 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:43.836 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.836 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.836 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.836 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.836 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.836 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.836 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.836 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.836 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.836 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.837 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.837 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.837 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:43.837 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:43.837 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.837 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.837 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.837 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:43.837 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.837 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.837 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.838 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.838 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.838 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.838 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.838 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.838 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.838 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.838 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.838 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.838 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.838 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.838 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.839 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:43.839 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:43.839 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.839 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.839 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.839 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.839 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.839 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.839 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.839 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.839 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.839 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.840 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.840 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.840 INFO:teuthology.orchestra.run.smithi082.stdout: "predict_interval": { 2023-09-23T09:48:43.840 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "predict_interval", 2023-09-23T09:48:43.840 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.840 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.840 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.840 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "86400", 2023-09-23T09:48:43.840 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.840 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.840 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.840 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.841 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.841 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.841 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.841 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.841 INFO:teuthology.orchestra.run.smithi082.stdout: "predictor_model": { 2023-09-23T09:48:43.841 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "predictor_model", 2023-09-23T09:48:43.841 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.841 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.841 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.841 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "prophetstor", 2023-09-23T09:48:43.841 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.842 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.842 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.842 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.842 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.842 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.842 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.842 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.842 INFO:teuthology.orchestra.run.smithi082.stdout: "sleep_interval": { 2023-09-23T09:48:43.842 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sleep_interval", 2023-09-23T09:48:43.842 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.842 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.842 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.843 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "600", 2023-09-23T09:48:43.843 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.843 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.843 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.843 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.843 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.843 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.843 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.843 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.843 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.843 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.843 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:43.844 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "influx", 2023-09-23T09:48:43.844 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": false, 2023-09-23T09:48:43.844 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "influxdb python module not found", 2023-09-23T09:48:43.844 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:43.844 INFO:teuthology.orchestra.run.smithi082.stdout: "batch_size": { 2023-09-23T09:48:43.844 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "batch_size", 2023-09-23T09:48:43.844 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:43.844 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.844 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.844 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "5000", 2023-09-23T09:48:43.844 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.845 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.845 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.845 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-09-23T09:48:43.845 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.845 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.845 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.845 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.845 INFO:teuthology.orchestra.run.smithi082.stdout: "database": { 2023-09-23T09:48:43.845 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "database", 2023-09-23T09:48:43.845 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.845 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.845 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.846 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "ceph", 2023-09-23T09:48:43.846 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.846 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.846 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.846 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-09-23T09:48:43.846 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.846 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.846 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.846 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.846 INFO:teuthology.orchestra.run.smithi082.stdout: "hostname": { 2023-09-23T09:48:43.846 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "hostname", 2023-09-23T09:48:43.847 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.847 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.847 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.847 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.847 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.847 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.847 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.847 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "InfluxDB server hostname", 2023-09-23T09:48:43.847 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.847 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.847 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.848 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.848 INFO:teuthology.orchestra.run.smithi082.stdout: "interval": { 2023-09-23T09:48:43.848 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "interval", 2023-09-23T09:48:43.848 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2023-09-23T09:48:43.848 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.848 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.848 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "30", 2023-09-23T09:48:43.848 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "5", 2023-09-23T09:48:43.848 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.848 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.848 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-09-23T09:48:43.848 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.849 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.849 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.849 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.849 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:43.849 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:43.849 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.849 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.849 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.849 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.849 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.849 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.850 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.850 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.850 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.850 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.850 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.850 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.850 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.850 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.850 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.850 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.850 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.851 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.851 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.851 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:43.851 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:43.851 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.851 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.851 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.851 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.851 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.851 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.851 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.851 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.851 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.852 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.852 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.852 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.852 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:43.852 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:43.852 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.852 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.852 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.852 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:43.852 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.852 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.852 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.852 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.852 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.853 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.853 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.853 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.853 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.853 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.853 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.853 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.853 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.853 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.853 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.853 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:43.853 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:43.854 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.854 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.854 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.854 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.854 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.854 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.854 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.854 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.854 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.854 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.854 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.854 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.855 INFO:teuthology.orchestra.run.smithi082.stdout: "password": { 2023-09-23T09:48:43.855 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "password", 2023-09-23T09:48:43.855 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.855 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.855 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.855 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.855 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.855 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.855 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.855 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "password of InfluxDB server user", 2023-09-23T09:48:43.855 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.856 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.856 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.856 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.856 INFO:teuthology.orchestra.run.smithi082.stdout: "port": { 2023-09-23T09:48:43.856 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "port", 2023-09-23T09:48:43.856 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:43.856 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.856 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.856 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "8086", 2023-09-23T09:48:43.856 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.856 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.856 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.857 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "InfluxDB server port", 2023-09-23T09:48:43.857 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.857 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.857 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.857 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.857 INFO:teuthology.orchestra.run.smithi082.stdout: "ssl": { 2023-09-23T09:48:43.857 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ssl", 2023-09-23T09:48:43.857 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.857 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.857 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.857 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "false", 2023-09-23T09:48:43.857 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.857 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.858 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.858 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-09-23T09:48:43.858 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.858 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.858 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.858 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.858 INFO:teuthology.orchestra.run.smithi082.stdout: "threads": { 2023-09-23T09:48:43.858 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "threads", 2023-09-23T09:48:43.858 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:43.858 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.858 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.858 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "5", 2023-09-23T09:48:43.859 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "1", 2023-09-23T09:48:43.859 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "32", 2023-09-23T09:48:43.859 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.859 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-09-23T09:48:43.859 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.859 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.859 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.859 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.859 INFO:teuthology.orchestra.run.smithi082.stdout: "username": { 2023-09-23T09:48:43.859 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "username", 2023-09-23T09:48:43.859 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.859 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.859 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.860 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.860 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.860 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.860 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.860 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "username of InfluxDB server user", 2023-09-23T09:48:43.860 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.860 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.860 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.860 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.860 INFO:teuthology.orchestra.run.smithi082.stdout: "verify_ssl": { 2023-09-23T09:48:43.860 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "verify_ssl", 2023-09-23T09:48:43.860 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.860 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.861 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.861 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "true", 2023-09-23T09:48:43.861 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.861 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.861 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.861 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-09-23T09:48:43.861 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.861 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.861 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.861 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.861 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.862 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.862 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:43.862 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "insights", 2023-09-23T09:48:43.862 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:43.862 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:43.862 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:43.862 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:43.862 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:43.862 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.862 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.862 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.862 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.863 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.863 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.863 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.863 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.863 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.863 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.863 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.863 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.863 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.863 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.863 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.863 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.864 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.864 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.864 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.864 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:43.864 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:43.864 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.864 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.864 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.864 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.864 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.864 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.865 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.865 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.865 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.865 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.865 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.865 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.865 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:43.865 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:43.865 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.865 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.865 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.865 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:43.865 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.866 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.866 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.866 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.866 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.866 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.866 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.866 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.866 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.866 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.866 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.866 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.867 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.867 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.867 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.867 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:43.867 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:43.867 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.867 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.867 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.867 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.867 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.867 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.867 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.867 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.868 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.868 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.868 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.868 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.868 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.868 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.868 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:43.868 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "iostat", 2023-09-23T09:48:43.868 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:43.868 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:43.868 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:43.868 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:43.868 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:43.869 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.869 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.869 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.869 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.869 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.869 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.869 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.869 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.869 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.869 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.869 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.869 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.870 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.870 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.870 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.870 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.870 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.870 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.870 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.870 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:43.870 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:43.870 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.870 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.870 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.871 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.871 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.871 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.871 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.871 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.871 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.871 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.871 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.871 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.871 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:43.871 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:43.871 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.871 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.872 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.872 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:43.872 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.872 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.872 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.872 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.872 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.872 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.872 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.872 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.872 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.872 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.872 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.873 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.873 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.873 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.873 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.873 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:43.873 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:43.873 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.873 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.873 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.873 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.873 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.873 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.874 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.874 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.874 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.874 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.874 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.874 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.874 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.874 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.874 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:43.874 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "k8sevents", 2023-09-23T09:48:43.874 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:43.874 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:43.875 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:43.875 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_event_retention_days": { 2023-09-23T09:48:43.875 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ceph_event_retention_days", 2023-09-23T09:48:43.875 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:43.875 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.875 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.875 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "7", 2023-09-23T09:48:43.875 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.875 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.875 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.875 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Days to hold ceph event information within local cache", 2023-09-23T09:48:43.875 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.876 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.876 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.876 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.876 INFO:teuthology.orchestra.run.smithi082.stdout: "config_check_secs": { 2023-09-23T09:48:43.876 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "config_check_secs", 2023-09-23T09:48:43.876 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:43.876 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.876 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.876 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2023-09-23T09:48:43.876 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "10", 2023-09-23T09:48:43.876 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.876 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.877 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2023-09-23T09:48:43.877 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.877 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.877 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.877 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.877 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:43.877 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:43.877 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.877 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.877 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.877 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.877 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.877 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.878 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.878 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.878 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.878 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.878 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.878 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.878 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.878 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.878 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.878 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.878 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.878 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.879 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.879 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:43.879 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:43.879 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.879 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.879 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.879 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.879 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.879 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.879 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.879 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.879 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.879 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.880 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.880 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.880 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:43.880 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:43.880 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.880 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.880 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.880 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:43.880 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.880 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.880 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.880 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.881 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.881 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.881 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.881 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.881 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.881 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.881 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.881 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.881 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.881 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.881 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.882 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:43.882 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:43.882 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.882 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.882 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.882 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.882 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.882 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.882 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.882 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.882 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.882 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.883 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.883 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.883 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.883 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.883 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:43.883 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "localpool", 2023-09-23T09:48:43.883 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:43.883 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:43.883 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:43.883 INFO:teuthology.orchestra.run.smithi082.stdout: "failure_domain": { 2023-09-23T09:48:43.883 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "failure_domain", 2023-09-23T09:48:43.884 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.884 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.884 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.884 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "host", 2023-09-23T09:48:43.884 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.884 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.884 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.884 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "failure domain for any created local pool", 2023-09-23T09:48:43.884 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-09-23T09:48:43.884 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.884 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.884 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.885 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:43.885 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:43.885 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.885 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.885 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.885 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.885 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.885 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.885 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.885 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.885 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.885 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.886 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.886 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.886 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.886 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.886 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.886 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.886 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.886 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.886 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.886 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:43.887 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:43.887 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.887 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.887 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.887 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.887 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.887 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.887 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.887 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.887 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.887 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.887 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.888 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.888 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:43.888 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:43.888 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.888 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.888 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.888 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:43.888 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.888 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.888 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.888 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.888 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.889 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.889 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.889 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.889 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.889 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.889 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.889 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.889 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.889 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.889 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.889 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:43.889 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:43.890 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.890 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.890 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.890 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.890 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.890 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.890 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.890 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.890 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.890 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.891 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.891 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.891 INFO:teuthology.orchestra.run.smithi082.stdout: "min_size": { 2023-09-23T09:48:43.891 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "min_size", 2023-09-23T09:48:43.891 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:43.891 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.891 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.891 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.891 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.891 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.891 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.891 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "default min_size for any created local pool", 2023-09-23T09:48:43.892 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-09-23T09:48:43.892 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.892 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.892 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.892 INFO:teuthology.orchestra.run.smithi082.stdout: "num_rep": { 2023-09-23T09:48:43.892 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "num_rep", 2023-09-23T09:48:43.892 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:43.892 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.892 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.892 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "3", 2023-09-23T09:48:43.892 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.893 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.893 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.893 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "default replica count for any created local pool", 2023-09-23T09:48:43.893 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.893 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.893 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.893 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.893 INFO:teuthology.orchestra.run.smithi082.stdout: "pg_num": { 2023-09-23T09:48:43.893 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "pg_num", 2023-09-23T09:48:43.893 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:43.893 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.893 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.894 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "128", 2023-09-23T09:48:43.894 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.894 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.894 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.894 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "default pg_num for any created local pool", 2023-09-23T09:48:43.894 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.894 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.894 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.894 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.894 INFO:teuthology.orchestra.run.smithi082.stdout: "prefix": { 2023-09-23T09:48:43.895 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "prefix", 2023-09-23T09:48:43.895 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.895 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.895 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.895 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.895 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.895 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.895 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.895 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "name prefix for any created local pool", 2023-09-23T09:48:43.897 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.897 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.897 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.897 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.897 INFO:teuthology.orchestra.run.smithi082.stdout: "subtree": { 2023-09-23T09:48:43.897 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "subtree", 2023-09-23T09:48:43.897 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.897 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.897 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.897 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "rack", 2023-09-23T09:48:43.897 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.898 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.898 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.898 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "CRUSH level for which to create a local pool", 2023-09-23T09:48:43.898 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-09-23T09:48:43.898 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.898 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.898 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.898 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.898 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.898 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:43.899 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mds_autoscaler", 2023-09-23T09:48:43.899 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:43.899 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:43.899 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:43.899 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:43.899 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:43.899 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.899 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.899 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.899 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.899 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.900 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.900 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.900 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.900 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.900 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.900 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.900 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.900 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.900 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.900 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.900 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.900 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.901 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.901 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.901 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:43.901 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:43.901 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.901 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.901 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.901 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.901 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.901 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.901 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.901 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.901 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.902 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.902 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.902 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.902 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:43.902 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:43.902 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.902 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.902 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.902 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:43.902 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.902 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.903 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.903 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.903 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.903 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.903 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.903 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.903 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.903 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.903 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.903 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.904 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.904 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.904 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.904 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:43.904 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:43.904 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.904 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.904 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.904 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.904 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.904 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.905 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.905 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.905 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.905 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.905 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.905 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.905 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.905 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.905 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:43.905 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mirroring", 2023-09-23T09:48:43.905 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:43.906 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:43.906 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:43.906 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:43.906 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:43.906 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.906 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.906 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.906 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.906 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.906 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.906 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.907 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.907 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.907 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.907 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.907 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.907 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.907 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.907 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.907 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.907 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.907 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.908 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.908 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:43.908 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:43.908 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.908 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.908 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.908 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.908 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.908 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.908 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.908 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.908 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.909 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.909 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.909 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.909 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:43.909 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:43.909 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.909 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.909 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.909 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:43.909 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.909 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.910 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.910 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.910 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.910 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.910 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.910 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.910 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.910 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.910 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.910 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.911 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.911 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.911 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.911 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:43.911 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:43.911 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.911 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.911 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.911 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.911 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.911 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.911 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.911 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.912 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.912 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.912 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.912 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.912 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.912 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.912 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:43.912 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "nfs", 2023-09-23T09:48:43.912 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:43.912 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:43.912 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:43.913 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:43.913 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:43.913 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.913 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.913 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.913 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.913 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.913 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.913 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.914 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.914 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.914 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.914 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.915 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.915 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.915 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.915 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.915 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.915 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.915 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.915 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.915 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:43.915 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:43.915 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.915 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.916 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.916 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.916 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.916 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.916 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.916 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.916 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.916 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.916 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.916 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.916 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:43.917 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:43.917 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.917 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.917 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.917 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:43.917 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.917 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.917 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.917 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.917 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.917 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.918 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.918 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.918 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.918 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.918 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.918 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.918 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.918 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.918 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.918 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:43.919 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:43.919 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.919 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.919 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.919 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.919 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.919 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.919 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.919 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.919 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.919 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.919 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.920 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.920 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.920 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.920 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:43.920 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "orchestrator", 2023-09-23T09:48:43.920 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:43.920 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:43.920 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:43.920 INFO:teuthology.orchestra.run.smithi082.stdout: "fail_fs": { 2023-09-23T09:48:43.920 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "fail_fs", 2023-09-23T09:48:43.920 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.921 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.921 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.921 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.921 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.921 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.921 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.921 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2023-09-23T09:48:43.921 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.921 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.921 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.922 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.922 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:43.922 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:43.922 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.922 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.922 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.922 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.922 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.922 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.922 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.923 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.923 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.923 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.923 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.923 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.923 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.923 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.923 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.923 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.923 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.924 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.924 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.924 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:43.924 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:43.924 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.924 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.924 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.924 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.924 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.924 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.924 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.925 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.925 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.925 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.925 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.925 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.925 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:43.925 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:43.925 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.925 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.925 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.925 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:43.926 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.926 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.926 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.926 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.926 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.926 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.926 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.926 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.926 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.926 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.926 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.927 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.927 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.927 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.927 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.927 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:43.927 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:43.927 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.927 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.927 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.927 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.927 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.928 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.928 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.928 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.928 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.928 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.928 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.928 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.928 INFO:teuthology.orchestra.run.smithi082.stdout: "orchestrator": { 2023-09-23T09:48:43.928 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "orchestrator", 2023-09-23T09:48:43.928 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.928 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.928 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.929 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.929 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.929 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.929 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.929 INFO:teuthology.orchestra.run.smithi082.stdout: "cephadm", 2023-09-23T09:48:43.929 INFO:teuthology.orchestra.run.smithi082.stdout: "rook", 2023-09-23T09:48:43.929 INFO:teuthology.orchestra.run.smithi082.stdout: "test_orchestrator" 2023-09-23T09:48:43.929 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.929 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Orchestrator backend", 2023-09-23T09:48:43.929 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.929 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.929 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.930 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.930 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.930 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.930 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:43.930 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "osd_perf_query", 2023-09-23T09:48:43.930 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:43.930 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:43.930 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:43.930 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:43.930 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:43.930 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.930 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.931 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.931 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.931 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.931 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.931 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.931 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.931 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.931 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.931 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.931 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.931 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.931 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.932 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.932 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.932 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.932 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.932 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.932 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:43.932 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:43.932 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.932 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.932 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.932 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.932 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.933 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.933 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.933 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.933 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.933 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.933 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.933 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.933 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:43.933 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:43.933 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.933 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.933 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.934 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:43.934 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.934 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.934 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.934 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.934 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.934 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.934 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.934 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.934 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.934 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.935 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.935 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.935 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.935 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.935 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.935 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:43.935 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:43.935 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.935 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.935 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.935 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.935 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.936 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.936 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.936 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.936 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.936 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.936 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.936 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.936 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.936 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.936 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:43.936 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "osd_support", 2023-09-23T09:48:43.936 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:43.937 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:43.937 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:43.937 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:43.937 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:43.937 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.937 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.937 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.937 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.937 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.937 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.937 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.937 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.938 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.938 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.938 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.938 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.938 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.938 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.938 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.938 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.938 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.938 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.938 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.938 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:43.939 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:43.939 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.939 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.939 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.939 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.939 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.939 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.939 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.939 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.939 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.939 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.939 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.940 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.940 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:43.940 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:43.940 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.940 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.940 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.940 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:43.940 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.940 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.940 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.940 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.940 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.940 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.941 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.941 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.941 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.941 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.941 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.941 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.941 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.941 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.941 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.941 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:43.941 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:43.941 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.942 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.942 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.942 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.942 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.942 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.942 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.942 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.942 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.942 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.942 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.942 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.942 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.943 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.943 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:43.943 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "pg_autoscaler", 2023-09-23T09:48:43.943 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:43.943 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:43.943 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:43.943 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:43.943 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:43.943 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.943 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.943 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.943 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.944 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.944 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.944 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.944 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.944 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.944 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.944 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.944 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.944 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.944 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.944 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.944 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.945 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.945 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.945 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.945 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:43.945 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:43.945 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.945 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.945 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.945 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.945 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.945 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.945 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.946 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.946 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.946 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.946 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.946 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.946 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:43.946 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:43.946 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.946 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.946 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.946 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:43.946 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.947 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.947 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.947 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.947 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.947 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.947 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.947 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.947 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.947 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.947 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.947 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.947 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.948 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.948 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.948 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:43.948 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:43.948 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.948 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.948 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.948 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.948 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.948 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.948 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.948 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.949 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.949 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.949 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.949 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.949 INFO:teuthology.orchestra.run.smithi082.stdout: "noautoscale": { 2023-09-23T09:48:43.949 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "noautoscale", 2023-09-23T09:48:43.949 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.949 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.949 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.949 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.949 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.949 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.950 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.950 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "global autoscale flag", 2023-09-23T09:48:43.950 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "Option to turn on/off the autoscaler for all pools", 2023-09-23T09:48:43.950 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.950 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.950 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.950 INFO:teuthology.orchestra.run.smithi082.stdout: "sleep_interval": { 2023-09-23T09:48:43.950 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sleep_interval", 2023-09-23T09:48:43.950 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2023-09-23T09:48:43.950 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.950 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.951 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "60", 2023-09-23T09:48:43.951 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.951 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.951 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.951 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.951 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.951 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.951 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.951 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.951 INFO:teuthology.orchestra.run.smithi082.stdout: "threshold": { 2023-09-23T09:48:43.951 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "threshold", 2023-09-23T09:48:43.951 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2023-09-23T09:48:43.951 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.952 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.952 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "3.0", 2023-09-23T09:48:43.952 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "1.0", 2023-09-23T09:48:43.952 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.952 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.952 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "scaling threshold", 2023-09-23T09:48:43.952 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-09-23T09:48:43.952 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.952 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.952 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.952 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.953 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.953 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:43.953 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "progress", 2023-09-23T09:48:43.953 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:43.953 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:43.953 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:43.953 INFO:teuthology.orchestra.run.smithi082.stdout: "allow_pg_recovery_event": { 2023-09-23T09:48:43.953 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "allow_pg_recovery_event", 2023-09-23T09:48:43.953 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.953 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.953 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.953 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.954 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.954 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.954 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.954 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "allow the module to show pg recovery progress", 2023-09-23T09:48:43.954 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.954 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.954 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.954 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.954 INFO:teuthology.orchestra.run.smithi082.stdout: "enabled": { 2023-09-23T09:48:43.954 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "enabled", 2023-09-23T09:48:43.954 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.955 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.955 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.955 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:43.955 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.955 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.955 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.955 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.955 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.955 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.955 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.955 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.955 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:43.956 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:43.956 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.956 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.956 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.956 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.956 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.956 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.956 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.956 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.956 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.956 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.956 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.957 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.957 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.957 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.957 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.957 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.957 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.957 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.957 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.957 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:43.957 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:43.957 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.958 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.958 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.958 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.958 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.958 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.958 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.958 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.958 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.958 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.958 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.958 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.958 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:43.959 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:43.959 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.959 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.959 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.959 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:43.959 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.959 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.959 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.959 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.959 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.959 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.959 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.960 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.960 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.960 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.960 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.960 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.960 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.960 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.960 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.960 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:43.960 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:43.960 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.961 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.961 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.961 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.961 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.961 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.961 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.961 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.961 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.961 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.961 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.961 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.962 INFO:teuthology.orchestra.run.smithi082.stdout: "max_completed_events": { 2023-09-23T09:48:43.962 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "max_completed_events", 2023-09-23T09:48:43.962 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:43.962 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.962 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.962 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "50", 2023-09-23T09:48:43.962 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.962 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.962 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.962 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "number of past completed events to remember", 2023-09-23T09:48:43.962 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.963 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.963 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.963 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.963 INFO:teuthology.orchestra.run.smithi082.stdout: "sleep_interval": { 2023-09-23T09:48:43.963 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sleep_interval", 2023-09-23T09:48:43.963 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2023-09-23T09:48:43.963 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.963 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.963 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "5", 2023-09-23T09:48:43.963 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.963 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.964 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.964 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how long the module is going to sleep", 2023-09-23T09:48:43.964 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.964 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.964 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.964 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.964 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.964 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.964 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:43.964 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "prometheus", 2023-09-23T09:48:43.964 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:43.965 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:43.965 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:43.965 INFO:teuthology.orchestra.run.smithi082.stdout: "cache": { 2023-09-23T09:48:43.965 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cache", 2023-09-23T09:48:43.965 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.965 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.965 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.965 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:43.965 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.965 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.965 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.965 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.966 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.966 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.966 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.966 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.966 INFO:teuthology.orchestra.run.smithi082.stdout: "exclude_perf_counters": { 2023-09-23T09:48:43.966 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "exclude_perf_counters", 2023-09-23T09:48:43.966 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.966 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.966 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.966 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:43.966 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.967 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.967 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.967 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Do not include perf-counters in the metrics output", 2023-09-23T09:48:43.967 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2023-09-23T09:48:43.967 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.967 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.967 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.967 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:43.967 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:43.967 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.967 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.967 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.968 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.968 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.968 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.968 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.968 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.968 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.968 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.968 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.968 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.968 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.968 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.969 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.969 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.969 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.969 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.969 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.969 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:43.969 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:43.969 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.969 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.969 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.969 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.969 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.970 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.970 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.970 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.970 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.970 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.970 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.970 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.970 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:43.970 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:43.970 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.970 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.970 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.971 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:43.971 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.971 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.971 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.971 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.971 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.971 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.971 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.971 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.971 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.971 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.971 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.972 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.972 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.972 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.972 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.972 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:43.972 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:43.972 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.972 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.972 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.972 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.972 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.972 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.973 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.973 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.973 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.973 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.973 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.973 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.973 INFO:teuthology.orchestra.run.smithi082.stdout: "rbd_stats_pools": { 2023-09-23T09:48:43.973 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rbd_stats_pools", 2023-09-23T09:48:43.973 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.973 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.973 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.973 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.974 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.974 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.974 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.974 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.974 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.974 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.974 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.974 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.974 INFO:teuthology.orchestra.run.smithi082.stdout: "rbd_stats_pools_refresh_interval": { 2023-09-23T09:48:43.974 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-09-23T09:48:43.974 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:43.975 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.975 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.975 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "300", 2023-09-23T09:48:43.975 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.975 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.975 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.975 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.975 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.975 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.975 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.975 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.975 INFO:teuthology.orchestra.run.smithi082.stdout: "scrape_interval": { 2023-09-23T09:48:43.976 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "scrape_interval", 2023-09-23T09:48:43.976 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2023-09-23T09:48:43.976 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.976 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.976 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "15.0", 2023-09-23T09:48:43.976 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.976 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.976 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.976 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.976 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.976 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.976 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.977 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.977 INFO:teuthology.orchestra.run.smithi082.stdout: "server_addr": { 2023-09-23T09:48:43.977 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_addr", 2023-09-23T09:48:43.977 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.977 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.977 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.977 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "::", 2023-09-23T09:48:43.977 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.977 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.977 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.978 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-09-23T09:48:43.978 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.978 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.978 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.978 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.978 INFO:teuthology.orchestra.run.smithi082.stdout: "server_port": { 2023-09-23T09:48:43.978 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_port", 2023-09-23T09:48:43.978 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:43.978 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.978 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.978 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "9283", 2023-09-23T09:48:43.978 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.979 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.979 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.979 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-09-23T09:48:43.979 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.979 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.979 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.979 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.979 INFO:teuthology.orchestra.run.smithi082.stdout: "stale_cache_strategy": { 2023-09-23T09:48:43.979 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "stale_cache_strategy", 2023-09-23T09:48:43.979 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.979 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.980 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.980 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "log", 2023-09-23T09:48:43.980 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.980 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.980 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.980 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.980 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.980 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.980 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.980 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.980 INFO:teuthology.orchestra.run.smithi082.stdout: "standby_behaviour": { 2023-09-23T09:48:43.980 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "standby_behaviour", 2023-09-23T09:48:43.981 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.981 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.981 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.981 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "default", 2023-09-23T09:48:43.981 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.981 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.981 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.981 INFO:teuthology.orchestra.run.smithi082.stdout: "default", 2023-09-23T09:48:43.981 INFO:teuthology.orchestra.run.smithi082.stdout: "error" 2023-09-23T09:48:43.981 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.981 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.981 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.982 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.982 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.982 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.982 INFO:teuthology.orchestra.run.smithi082.stdout: "standby_error_status_code": { 2023-09-23T09:48:43.982 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "standby_error_status_code", 2023-09-23T09:48:43.982 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:43.982 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.982 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.982 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "500", 2023-09-23T09:48:43.982 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "400", 2023-09-23T09:48:43.982 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "599", 2023-09-23T09:48:43.983 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.983 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.983 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.983 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.983 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.983 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.983 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.983 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.983 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:43.983 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rbd_support", 2023-09-23T09:48:43.983 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:43.983 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:43.984 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:43.984 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:43.984 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:43.984 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.984 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.984 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.984 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.984 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.984 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.984 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.984 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.984 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.985 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.985 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.985 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.985 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.985 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.985 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.985 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.985 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.985 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.985 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.985 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:43.985 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:43.986 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.986 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.986 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.986 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.986 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.986 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.986 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.986 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.986 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.986 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.986 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.987 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.987 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:43.987 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:43.987 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.987 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.987 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.987 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:43.987 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.987 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.987 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.988 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.988 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.988 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.988 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.988 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.988 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.988 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.988 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.988 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.988 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.988 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.989 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.989 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:43.989 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:43.989 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.989 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.989 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.989 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.989 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.989 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.989 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.989 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.989 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.989 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.990 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.990 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.990 INFO:teuthology.orchestra.run.smithi082.stdout: "max_concurrent_snap_create": { 2023-09-23T09:48:43.990 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "max_concurrent_snap_create", 2023-09-23T09:48:43.990 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:43.990 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.990 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.990 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2023-09-23T09:48:43.990 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.990 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.991 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.991 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.991 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.991 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.991 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.991 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.991 INFO:teuthology.orchestra.run.smithi082.stdout: "mirror_snapshot_schedule": { 2023-09-23T09:48:43.991 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mirror_snapshot_schedule", 2023-09-23T09:48:43.991 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.991 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.992 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.992 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.992 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.992 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.992 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.992 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.992 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.992 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.992 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.992 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.992 INFO:teuthology.orchestra.run.smithi082.stdout: "trash_purge_schedule": { 2023-09-23T09:48:43.992 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "trash_purge_schedule", 2023-09-23T09:48:43.993 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.993 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.993 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.993 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.993 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.993 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.993 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.993 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.993 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.993 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.993 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.993 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.994 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:43.994 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.994 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:43.994 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "restful", 2023-09-23T09:48:43.994 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:43.994 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:43.994 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:43.994 INFO:teuthology.orchestra.run.smithi082.stdout: "enable_auth": { 2023-09-23T09:48:43.994 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "enable_auth", 2023-09-23T09:48:43.994 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.994 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.995 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.995 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:43.995 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.995 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.995 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.995 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.995 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.995 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.995 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.995 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.995 INFO:teuthology.orchestra.run.smithi082.stdout: "key_file": { 2023-09-23T09:48:43.995 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "key_file", 2023-09-23T09:48:43.996 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.996 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.996 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:43.996 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.996 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.996 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.996 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.996 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.996 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.996 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.996 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.996 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.997 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:43.997 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:43.997 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:43.997 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.997 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.997 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:43.997 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.997 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.997 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:43.997 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:43.997 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:43.997 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:43.998 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:43.998 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:43.998 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:43.998 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:43.998 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.998 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.998 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.998 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.998 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:43.998 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:43.998 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:43.999 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:43.999 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:43.999 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:43.999 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:43.999 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:43.999 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:43.999 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:43.999 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:43.999 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:43.999 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:43.999 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:43.999 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.000 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:44.000 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:44.000 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.000 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.000 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.000 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:44.000 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.000 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.000 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.000 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:44.000 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:44.000 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:44.001 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.001 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:44.001 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:44.001 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.001 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.001 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.001 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.001 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.001 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.001 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:44.001 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:44.001 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.002 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.002 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.002 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.002 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.002 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.002 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.002 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.002 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.002 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.002 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.002 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.003 INFO:teuthology.orchestra.run.smithi082.stdout: "server_addr": { 2023-09-23T09:48:44.003 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_addr", 2023-09-23T09:48:44.003 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.003 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.003 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.003 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.003 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.003 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.003 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.003 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.003 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.004 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.004 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.004 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.004 INFO:teuthology.orchestra.run.smithi082.stdout: "server_port": { 2023-09-23T09:48:44.004 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_port", 2023-09-23T09:48:44.004 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.004 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.004 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.004 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.004 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.004 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.004 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.005 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.005 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.005 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.005 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.005 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.005 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.005 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.005 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:44.005 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rgw", 2023-09-23T09:48:44.005 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:44.005 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:44.005 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:44.006 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:44.006 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:44.006 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.006 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.006 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.006 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.006 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.006 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.006 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.006 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:44.006 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:44.006 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:44.007 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.007 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:44.007 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:44.007 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.007 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.007 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.007 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.007 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.007 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.007 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:44.007 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:44.007 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.008 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.008 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.008 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.008 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.008 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.008 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.008 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.008 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.008 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.008 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.008 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.008 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:44.008 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:44.009 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.009 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.009 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.009 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:44.009 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.009 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.009 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.009 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:44.009 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:44.009 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:44.009 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.010 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:44.010 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:44.010 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.010 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.010 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.010 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.010 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.010 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.010 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:44.010 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:44.010 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.010 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.011 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.011 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.011 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.011 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.011 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.011 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.011 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.011 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.011 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.011 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.011 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.011 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.011 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:44.012 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rook", 2023-09-23T09:48:44.012 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:44.012 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:44.012 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:44.012 INFO:teuthology.orchestra.run.smithi082.stdout: "drive_group_interval": { 2023-09-23T09:48:44.012 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "drive_group_interval", 2023-09-23T09:48:44.012 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2023-09-23T09:48:44.012 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.012 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.012 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "300.0", 2023-09-23T09:48:44.012 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.012 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.012 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.013 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2023-09-23T09:48:44.013 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.013 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.013 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.013 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.013 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:44.013 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:44.013 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.013 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.013 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.013 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.013 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.014 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.014 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.014 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:44.014 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:44.014 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:44.014 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.014 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:44.014 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:44.014 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.014 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.014 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.014 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.015 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.015 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.015 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:44.015 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:44.015 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.015 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.015 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.015 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.015 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.015 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.015 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.015 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.016 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.016 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.016 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.016 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.016 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:44.016 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:44.016 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.016 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.016 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.016 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:44.016 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.016 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.017 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.017 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:44.017 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:44.017 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:44.017 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.017 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:44.017 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:44.017 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.017 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.017 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.017 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.018 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.018 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.018 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:44.018 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:44.018 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.018 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.018 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.018 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.018 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.018 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.018 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.018 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.019 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.019 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.019 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.019 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.019 INFO:teuthology.orchestra.run.smithi082.stdout: "storage_class": { 2023-09-23T09:48:44.019 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "storage_class", 2023-09-23T09:48:44.019 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.019 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.019 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.019 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "local", 2023-09-23T09:48:44.019 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.019 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.020 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.020 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "storage class name for LSO-discovered PVs", 2023-09-23T09:48:44.020 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.020 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.020 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.020 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.020 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.020 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.020 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:44.020 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "selftest", 2023-09-23T09:48:44.020 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:44.020 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:44.021 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:44.021 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:44.021 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:44.021 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.021 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.021 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.021 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.021 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.021 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.021 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.021 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:44.021 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:44.022 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:44.022 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.022 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:44.022 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:44.022 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.022 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.022 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.022 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.022 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.022 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.022 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:44.023 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:44.023 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.023 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.023 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.023 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.023 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.023 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.023 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.023 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.023 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.023 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.023 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.024 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.024 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:44.024 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:44.024 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.024 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.024 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.024 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:44.024 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.024 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.024 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.024 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:44.024 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:44.025 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:44.025 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.025 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:44.025 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:44.025 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.025 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.025 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.025 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.025 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.025 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.025 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:44.025 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:44.026 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.026 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.026 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.026 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.026 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.026 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.026 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.026 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.026 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.026 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.026 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.026 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.027 INFO:teuthology.orchestra.run.smithi082.stdout: "roption1": { 2023-09-23T09:48:44.027 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "roption1", 2023-09-23T09:48:44.027 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.027 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.027 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.027 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.027 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.027 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.027 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.027 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.027 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.027 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.027 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.027 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.028 INFO:teuthology.orchestra.run.smithi082.stdout: "roption2": { 2023-09-23T09:48:44.028 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "roption2", 2023-09-23T09:48:44.028 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.028 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.028 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.028 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "xyz", 2023-09-23T09:48:44.028 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.028 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.028 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.028 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.028 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.028 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.029 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.029 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.029 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption1": { 2023-09-23T09:48:44.029 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption1", 2023-09-23T09:48:44.029 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.029 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.029 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.029 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.029 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.029 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.029 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.029 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.029 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.030 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.030 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.030 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.030 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption2": { 2023-09-23T09:48:44.030 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption2", 2023-09-23T09:48:44.030 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:44.030 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.030 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.030 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.030 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.030 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.030 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.031 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.031 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.031 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.031 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.031 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.031 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption3": { 2023-09-23T09:48:44.031 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption3", 2023-09-23T09:48:44.031 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2023-09-23T09:48:44.031 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.031 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.031 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.031 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.031 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.032 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.032 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.032 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.032 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.032 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.032 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.032 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption4": { 2023-09-23T09:48:44.032 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption4", 2023-09-23T09:48:44.032 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.032 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.032 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.032 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.032 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.033 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.033 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.033 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.033 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.033 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.033 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.033 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.033 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption5": { 2023-09-23T09:48:44.033 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption5", 2023-09-23T09:48:44.033 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.033 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.033 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.033 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.034 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.034 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.034 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.034 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.034 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.034 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.034 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.034 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.034 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption6": { 2023-09-23T09:48:44.034 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption6", 2023-09-23T09:48:44.034 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.034 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.034 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.035 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:44.035 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.035 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.035 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.035 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.035 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.035 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.035 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.035 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.035 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption7": { 2023-09-23T09:48:44.035 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption7", 2023-09-23T09:48:44.036 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:44.036 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.036 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.036 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.036 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "1", 2023-09-23T09:48:44.036 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "42", 2023-09-23T09:48:44.036 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.036 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.036 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.036 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.036 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.036 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.036 INFO:teuthology.orchestra.run.smithi082.stdout: "testkey": { 2023-09-23T09:48:44.037 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "testkey", 2023-09-23T09:48:44.037 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.037 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.037 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.037 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.037 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.037 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.037 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.037 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.037 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.037 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.037 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.038 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.038 INFO:teuthology.orchestra.run.smithi082.stdout: "testlkey": { 2023-09-23T09:48:44.038 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "testlkey", 2023-09-23T09:48:44.038 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.038 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.038 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.038 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.038 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.038 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.038 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.038 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.038 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.039 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.039 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.039 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.039 INFO:teuthology.orchestra.run.smithi082.stdout: "testnewline": { 2023-09-23T09:48:44.039 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "testnewline", 2023-09-23T09:48:44.039 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.039 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.039 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.039 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.039 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.039 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.039 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.039 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.040 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.040 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.040 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.040 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.040 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.040 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.040 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:44.040 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "snap_schedule", 2023-09-23T09:48:44.040 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:44.040 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:44.040 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:44.040 INFO:teuthology.orchestra.run.smithi082.stdout: "allow_m_granularity": { 2023-09-23T09:48:44.040 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "allow_m_granularity", 2023-09-23T09:48:44.041 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.041 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.041 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.041 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.041 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.041 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.041 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.041 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "allow minute scheduled snapshots", 2023-09-23T09:48:44.041 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.041 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.041 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.041 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.041 INFO:teuthology.orchestra.run.smithi082.stdout: "dump_on_update": { 2023-09-23T09:48:44.042 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "dump_on_update", 2023-09-23T09:48:44.042 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.042 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.042 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.042 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.042 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.042 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.042 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.042 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "dump database to debug log on update", 2023-09-23T09:48:44.042 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.042 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.042 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.043 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.043 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:44.043 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:44.043 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.043 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.043 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.043 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.043 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.043 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.043 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.043 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:44.044 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:44.044 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:44.044 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.044 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:44.044 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:44.044 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.044 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.044 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.044 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.044 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.044 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.044 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:44.045 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:44.045 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.045 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.045 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.045 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.045 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.045 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.045 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.045 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.045 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.045 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.045 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.046 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.046 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:44.046 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:44.046 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.046 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.046 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.046 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:44.046 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.046 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.046 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.046 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:44.047 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:44.047 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:44.047 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.047 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:44.047 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:44.047 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.047 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.047 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.047 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.047 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.047 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.047 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:44.048 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:44.048 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.048 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.048 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.048 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.048 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.048 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.048 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.048 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.048 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.049 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.049 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.049 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.049 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.049 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.049 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:44.049 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "stats", 2023-09-23T09:48:44.049 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:44.049 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:44.049 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:44.049 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:44.049 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:44.050 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.050 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.050 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.050 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.050 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.050 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.050 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.050 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:44.050 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:44.050 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:44.050 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.050 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:44.051 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:44.051 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.051 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.051 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.051 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.051 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.051 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.051 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:44.051 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:44.051 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.051 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.051 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.051 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.052 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.052 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.052 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.052 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.052 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.052 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.052 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.052 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.052 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:44.052 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:44.052 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.053 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.053 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.053 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:44.053 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.053 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.053 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.053 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:44.053 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:44.053 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:44.053 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.053 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:44.053 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:44.054 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.054 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.054 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.054 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.054 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.054 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.054 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:44.054 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:44.054 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.054 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.054 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.054 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.055 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.055 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.055 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.055 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.055 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.055 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.055 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.055 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.055 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.055 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.055 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:44.055 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "status", 2023-09-23T09:48:44.056 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:44.056 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:44.056 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:44.056 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:44.056 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:44.056 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.056 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.056 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.056 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.056 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.056 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.057 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.057 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:44.057 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:44.057 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:44.057 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.057 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:44.057 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:44.057 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.057 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.057 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.057 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.057 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.058 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.058 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:44.058 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:44.058 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.058 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.058 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.058 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.058 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.058 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.058 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.058 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.059 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.059 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.059 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.059 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.059 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:44.059 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:44.059 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.059 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.059 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.059 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:44.059 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.059 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.060 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.060 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:44.060 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:44.060 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:44.060 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.060 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:44.060 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:44.060 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.060 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.060 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.060 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.061 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.061 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.061 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:44.061 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:44.061 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.061 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.061 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.061 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.061 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.061 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.061 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.061 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.062 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.062 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.062 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.062 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.062 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.062 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.062 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:44.062 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "telegraf", 2023-09-23T09:48:44.062 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:44.062 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:44.062 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:44.063 INFO:teuthology.orchestra.run.smithi082.stdout: "address": { 2023-09-23T09:48:44.063 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "address", 2023-09-23T09:48:44.063 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.063 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.063 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.063 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-09-23T09:48:44.063 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.063 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.063 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.063 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.063 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.064 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.064 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.064 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.064 INFO:teuthology.orchestra.run.smithi082.stdout: "interval": { 2023-09-23T09:48:44.064 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "interval", 2023-09-23T09:48:44.064 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2023-09-23T09:48:44.064 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.064 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.064 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "15", 2023-09-23T09:48:44.064 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.064 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.065 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.065 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.065 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.065 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.065 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.065 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.065 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:44.065 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:44.065 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.065 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.065 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.065 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.066 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.066 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.066 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.066 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:44.066 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:44.066 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:44.066 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.066 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:44.066 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:44.066 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.066 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.067 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.067 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.067 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.067 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.067 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:44.067 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:44.067 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.067 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.067 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.067 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.067 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.068 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.068 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.068 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.068 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.068 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.068 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.068 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.068 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:44.068 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:44.068 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.069 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.069 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.069 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:44.069 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.069 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.069 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.069 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:44.069 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:44.069 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:44.070 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.070 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:44.070 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:44.070 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.070 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.070 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.070 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.070 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.070 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.070 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:44.070 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:44.070 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.071 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.071 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.071 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.071 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.071 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.071 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.071 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.071 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.071 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.071 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.072 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.072 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.072 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.072 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:44.072 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "telemetry", 2023-09-23T09:48:44.072 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:44.072 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:44.072 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:44.072 INFO:teuthology.orchestra.run.smithi082.stdout: "channel_basic": { 2023-09-23T09:48:44.072 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "channel_basic", 2023-09-23T09:48:44.073 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.073 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.073 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.073 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:44.073 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.073 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.073 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.073 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Share basic cluster information (size, version)", 2023-09-23T09:48:44.073 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.073 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.074 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.074 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.074 INFO:teuthology.orchestra.run.smithi082.stdout: "channel_crash": { 2023-09-23T09:48:44.074 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "channel_crash", 2023-09-23T09:48:44.074 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.074 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.074 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.074 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:44.074 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.074 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.074 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.075 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-09-23T09:48:44.075 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.075 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.075 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.075 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.075 INFO:teuthology.orchestra.run.smithi082.stdout: "channel_device": { 2023-09-23T09:48:44.075 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "channel_device", 2023-09-23T09:48:44.075 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.076 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.076 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.076 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:44.076 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.076 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.076 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.076 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-09-23T09:48:44.076 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.076 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.077 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.077 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.077 INFO:teuthology.orchestra.run.smithi082.stdout: "channel_ident": { 2023-09-23T09:48:44.077 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "channel_ident", 2023-09-23T09:48:44.077 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.077 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.077 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.077 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.077 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.077 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.077 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.078 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-09-23T09:48:44.078 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.078 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.078 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.078 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.078 INFO:teuthology.orchestra.run.smithi082.stdout: "channel_perf": { 2023-09-23T09:48:44.078 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "channel_perf", 2023-09-23T09:48:44.078 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.078 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.078 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.078 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.079 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.079 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.079 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.079 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Share various performance metrics of a cluster", 2023-09-23T09:48:44.079 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.079 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.079 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.079 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.079 INFO:teuthology.orchestra.run.smithi082.stdout: "contact": { 2023-09-23T09:48:44.079 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "contact", 2023-09-23T09:48:44.080 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.080 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.080 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.080 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.080 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.080 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.080 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.080 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.080 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.080 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.080 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.081 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.081 INFO:teuthology.orchestra.run.smithi082.stdout: "description": { 2023-09-23T09:48:44.081 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "description", 2023-09-23T09:48:44.081 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.081 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.081 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.081 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.081 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.081 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.081 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.081 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.081 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.082 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.082 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.082 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.082 INFO:teuthology.orchestra.run.smithi082.stdout: "device_url": { 2023-09-23T09:48:44.082 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "device_url", 2023-09-23T09:48:44.082 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.082 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.082 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.082 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-09-23T09:48:44.082 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.082 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.082 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.083 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.083 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.083 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.083 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.083 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.083 INFO:teuthology.orchestra.run.smithi082.stdout: "enabled": { 2023-09-23T09:48:44.083 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "enabled", 2023-09-23T09:48:44.083 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.083 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.083 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.083 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.084 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.084 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.084 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.084 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.084 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.084 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.084 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.084 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.084 INFO:teuthology.orchestra.run.smithi082.stdout: "interval": { 2023-09-23T09:48:44.084 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "interval", 2023-09-23T09:48:44.084 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:44.084 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.085 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.085 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "24", 2023-09-23T09:48:44.085 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "8", 2023-09-23T09:48:44.085 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.085 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.085 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.085 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.085 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.085 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.085 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.085 INFO:teuthology.orchestra.run.smithi082.stdout: "last_opt_revision": { 2023-09-23T09:48:44.085 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "last_opt_revision", 2023-09-23T09:48:44.086 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:44.086 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.086 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.086 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "1", 2023-09-23T09:48:44.086 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.086 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.086 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.086 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.086 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.086 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.086 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.087 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.087 INFO:teuthology.orchestra.run.smithi082.stdout: "leaderboard": { 2023-09-23T09:48:44.087 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "leaderboard", 2023-09-23T09:48:44.087 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.087 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.087 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.087 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.087 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.087 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.087 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.087 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.088 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.088 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.088 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.088 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.088 INFO:teuthology.orchestra.run.smithi082.stdout: "leaderboard_description": { 2023-09-23T09:48:44.088 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "leaderboard_description", 2023-09-23T09:48:44.088 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.088 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.088 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.088 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.088 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.089 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.089 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.089 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.089 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.089 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.089 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.089 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.089 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:44.089 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:44.089 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.089 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.089 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.090 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.090 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.090 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.090 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.090 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:44.090 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:44.090 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:44.090 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.090 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:44.090 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:44.090 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.090 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.091 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.091 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.091 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.091 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.091 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:44.091 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:44.091 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.091 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.091 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.091 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.092 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.092 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.092 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.092 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.092 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.092 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.092 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.092 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.092 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:44.092 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:44.092 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.092 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.093 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.093 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:44.093 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.093 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.093 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.093 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:44.093 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:44.093 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:44.093 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.093 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:44.093 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:44.094 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.094 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.094 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.094 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.094 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.094 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.094 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:44.094 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:44.094 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.094 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.095 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.095 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.095 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.095 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.095 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.095 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.095 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.095 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.095 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.095 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.095 INFO:teuthology.orchestra.run.smithi082.stdout: "organization": { 2023-09-23T09:48:44.095 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "organization", 2023-09-23T09:48:44.096 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.096 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.096 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.096 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.096 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.096 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.096 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.096 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.096 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.096 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.096 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.096 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.097 INFO:teuthology.orchestra.run.smithi082.stdout: "proxy": { 2023-09-23T09:48:44.097 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "proxy", 2023-09-23T09:48:44.097 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.097 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.097 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.097 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.097 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.097 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.097 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.097 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.097 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.097 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.098 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.098 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.098 INFO:teuthology.orchestra.run.smithi082.stdout: "url": { 2023-09-23T09:48:44.098 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "url", 2023-09-23T09:48:44.098 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.098 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.098 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.098 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-09-23T09:48:44.098 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.098 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.098 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.099 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.099 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.099 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.099 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.099 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.099 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.099 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.099 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:44.099 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "test_orchestrator", 2023-09-23T09:48:44.099 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:44.099 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:44.099 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:44.100 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:44.100 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:44.100 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.100 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.100 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.100 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.100 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.100 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.100 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.100 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:44.100 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:44.100 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:44.101 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.101 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:44.101 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:44.101 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.101 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.101 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.101 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.101 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.101 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.101 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:44.101 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:44.101 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.102 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.102 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.102 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.102 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.102 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.102 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.102 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.102 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.102 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.102 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.102 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.103 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:44.103 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:44.103 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.103 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.103 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.103 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:44.103 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.103 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.103 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.103 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:44.103 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:44.103 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:44.104 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.104 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:44.104 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:44.104 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.104 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.104 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.104 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.104 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.104 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.104 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:44.104 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:44.104 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.105 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.105 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.105 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.105 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.105 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.105 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.105 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.105 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.105 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.105 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.105 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.105 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.106 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.106 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:44.106 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "volumes", 2023-09-23T09:48:44.106 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:44.106 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:44.106 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:44.106 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:44.106 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:44.106 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.106 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.106 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.107 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.107 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.107 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.107 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.107 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:44.107 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:44.107 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:44.107 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.107 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:44.107 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:44.107 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.107 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.108 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.108 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.108 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.108 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.108 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:44.108 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:44.108 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.108 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.108 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.108 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.108 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.108 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.108 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.109 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.109 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.109 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.109 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.109 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.109 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:44.109 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:44.109 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.109 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.109 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.109 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:44.109 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.110 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.110 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.110 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:44.110 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:44.110 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:44.110 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.110 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:44.110 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:44.110 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.110 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.110 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.110 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.111 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.111 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.111 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:44.111 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:44.111 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.111 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.111 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.111 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.111 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.111 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.111 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.111 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.112 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.112 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.112 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.112 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.112 INFO:teuthology.orchestra.run.smithi082.stdout: "max_concurrent_clones": { 2023-09-23T09:48:44.112 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "max_concurrent_clones", 2023-09-23T09:48:44.112 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:44.112 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.112 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.112 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "4", 2023-09-23T09:48:44.112 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.112 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.113 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.113 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Number of asynchronous cloner threads", 2023-09-23T09:48:44.113 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.113 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.113 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.113 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.113 INFO:teuthology.orchestra.run.smithi082.stdout: "snapshot_clone_delay": { 2023-09-23T09:48:44.113 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "snapshot_clone_delay", 2023-09-23T09:48:44.113 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:44.113 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.113 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.114 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2023-09-23T09:48:44.114 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.114 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.114 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.114 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-09-23T09:48:44.114 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.114 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.114 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.114 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.114 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.114 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.115 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:44.115 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "zabbix", 2023-09-23T09:48:44.115 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:44.115 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:44.115 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:44.115 INFO:teuthology.orchestra.run.smithi082.stdout: "discovery_interval": { 2023-09-23T09:48:44.115 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "discovery_interval", 2023-09-23T09:48:44.115 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "uint", 2023-09-23T09:48:44.115 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.115 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.115 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "100", 2023-09-23T09:48:44.115 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.115 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.116 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.116 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.116 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.116 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.116 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.116 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.116 INFO:teuthology.orchestra.run.smithi082.stdout: "identifier": { 2023-09-23T09:48:44.116 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "identifier", 2023-09-23T09:48:44.116 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.116 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.116 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.117 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.117 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.117 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.117 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.117 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.117 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.117 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.117 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.117 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.117 INFO:teuthology.orchestra.run.smithi082.stdout: "interval": { 2023-09-23T09:48:44.117 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "interval", 2023-09-23T09:48:44.117 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2023-09-23T09:48:44.118 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.118 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.118 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "60", 2023-09-23T09:48:44.118 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.118 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.118 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.118 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.118 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.118 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.118 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.118 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.119 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:44.119 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:44.119 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.119 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.119 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.119 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.119 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.119 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.119 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.119 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:44.119 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:44.119 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:44.120 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.120 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:44.120 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:44.120 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.120 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.120 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.120 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.120 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.120 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.120 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:44.120 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:44.121 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.121 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.121 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.121 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.121 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.121 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.121 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.121 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.121 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.121 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.121 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.121 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.122 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:44.122 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:44.122 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.122 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.122 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.122 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:44.122 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.122 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.122 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.122 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:44.122 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:44.122 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:44.123 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.123 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:44.123 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:44.123 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.123 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.123 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.123 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.123 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.123 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.123 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:44.123 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:44.123 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.124 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.124 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.124 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.124 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.124 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.124 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.124 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.124 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.124 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.124 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.124 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.124 INFO:teuthology.orchestra.run.smithi082.stdout: "zabbix_host": { 2023-09-23T09:48:44.125 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "zabbix_host", 2023-09-23T09:48:44.125 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.125 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.125 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.125 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.125 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.125 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.125 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.125 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.125 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.125 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.126 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.126 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.126 INFO:teuthology.orchestra.run.smithi082.stdout: "zabbix_port": { 2023-09-23T09:48:44.126 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "zabbix_port", 2023-09-23T09:48:44.126 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:44.126 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.126 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.126 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10051", 2023-09-23T09:48:44.126 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.126 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.126 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.126 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.127 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.127 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.127 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.127 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.127 INFO:teuthology.orchestra.run.smithi082.stdout: "zabbix_sender": { 2023-09-23T09:48:44.127 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "zabbix_sender", 2023-09-23T09:48:44.127 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.127 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.127 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.127 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-09-23T09:48:44.127 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.127 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.128 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.128 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.128 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.128 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.128 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.128 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.128 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.128 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.128 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2023-09-23T09:48:44.128 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.128 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.129 INFO:teuthology.orchestra.run.smithi082.stdout: "modules": [ 2023-09-23T09:48:44.129 INFO:teuthology.orchestra.run.smithi082.stdout: "cephadm", 2023-09-23T09:48:44.129 INFO:teuthology.orchestra.run.smithi082.stdout: "dashboard", 2023-09-23T09:48:44.129 INFO:teuthology.orchestra.run.smithi082.stdout: "iostat", 2023-09-23T09:48:44.129 INFO:teuthology.orchestra.run.smithi082.stdout: "nfs", 2023-09-23T09:48:44.129 INFO:teuthology.orchestra.run.smithi082.stdout: "restful", 2023-09-23T09:48:44.129 INFO:teuthology.orchestra.run.smithi082.stdout: "snap_schedule" 2023-09-23T09:48:44.129 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.129 INFO:teuthology.orchestra.run.smithi082.stdout: "available_modules": [ 2023-09-23T09:48:44.129 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:44.129 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "alerts", 2023-09-23T09:48:44.129 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:44.130 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:44.130 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:44.130 INFO:teuthology.orchestra.run.smithi082.stdout: "interval": { 2023-09-23T09:48:44.130 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "interval", 2023-09-23T09:48:44.130 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2023-09-23T09:48:44.130 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.130 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.130 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "60", 2023-09-23T09:48:44.130 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.130 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.130 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.130 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "How frequently to reexamine health status", 2023-09-23T09:48:44.131 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.131 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.131 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.131 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.131 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:44.131 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:44.131 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.131 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.131 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.131 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.131 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.132 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.132 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.132 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:44.132 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:44.132 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:44.132 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.132 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:44.132 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:44.132 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.132 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.132 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.132 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.133 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.133 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.133 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:44.133 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:44.133 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.133 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.133 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.133 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.133 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.133 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.133 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.133 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.134 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.134 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.134 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.134 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.134 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:44.134 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:44.134 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.134 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.134 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.134 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:44.134 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.134 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.135 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.135 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:44.135 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:44.135 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:44.135 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.135 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:44.135 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:44.135 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.135 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.135 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.135 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.135 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.136 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.136 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:44.136 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:44.136 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.136 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.136 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.136 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.136 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.136 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.136 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.136 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.136 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.137 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.137 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.137 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.137 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_destination": { 2023-09-23T09:48:44.137 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_destination", 2023-09-23T09:48:44.137 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.137 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.137 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.137 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.137 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.137 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.137 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.138 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Email address to send alerts to", 2023-09-23T09:48:44.138 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.138 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.138 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.138 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.138 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_from_name": { 2023-09-23T09:48:44.138 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_from_name", 2023-09-23T09:48:44.138 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.138 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.138 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.138 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "Ceph", 2023-09-23T09:48:44.138 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.139 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.139 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.139 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Email From: name", 2023-09-23T09:48:44.139 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.139 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.139 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.139 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.139 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_host": { 2023-09-23T09:48:44.139 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_host", 2023-09-23T09:48:44.139 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.139 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.139 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.140 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.140 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.140 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.140 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.140 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "SMTP server", 2023-09-23T09:48:44.140 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.140 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.140 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.140 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.140 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_password": { 2023-09-23T09:48:44.140 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_password", 2023-09-23T09:48:44.140 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.140 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.141 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.141 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.141 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.141 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.141 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.141 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Password to authenticate with", 2023-09-23T09:48:44.141 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.141 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.141 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.141 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.141 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_port": { 2023-09-23T09:48:44.141 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_port", 2023-09-23T09:48:44.142 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:44.142 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.142 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.142 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "465", 2023-09-23T09:48:44.142 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.142 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.142 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.142 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "SMTP port", 2023-09-23T09:48:44.142 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.142 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.142 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.142 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.143 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_sender": { 2023-09-23T09:48:44.143 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_sender", 2023-09-23T09:48:44.143 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.143 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.143 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.143 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.143 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.143 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.143 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.143 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "SMTP envelope sender", 2023-09-23T09:48:44.143 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.143 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.144 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.144 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.144 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_ssl": { 2023-09-23T09:48:44.144 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_ssl", 2023-09-23T09:48:44.144 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.144 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.144 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.144 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:44.144 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.144 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.144 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.144 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Use SSL to connect to SMTP server", 2023-09-23T09:48:44.145 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.145 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.145 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.145 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.145 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_user": { 2023-09-23T09:48:44.145 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_user", 2023-09-23T09:48:44.145 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.145 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.145 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.145 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.145 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.145 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.146 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.146 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "User to authenticate as", 2023-09-23T09:48:44.146 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.146 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.146 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.146 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.146 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.146 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.146 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:44.146 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "balancer", 2023-09-23T09:48:44.146 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:44.147 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:44.147 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:44.147 INFO:teuthology.orchestra.run.smithi082.stdout: "active": { 2023-09-23T09:48:44.147 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "active", 2023-09-23T09:48:44.147 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.147 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.147 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.147 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:44.147 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.147 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.147 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.147 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "automatically balance PGs across cluster", 2023-09-23T09:48:44.147 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.148 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.148 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.148 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.148 INFO:teuthology.orchestra.run.smithi082.stdout: "begin_time": { 2023-09-23T09:48:44.148 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "begin_time", 2023-09-23T09:48:44.148 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.148 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.148 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.148 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0000", 2023-09-23T09:48:44.148 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.148 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.148 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.149 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "beginning time of day to automatically balance", 2023-09-23T09:48:44.149 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-09-23T09:48:44.149 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.149 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.149 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.149 INFO:teuthology.orchestra.run.smithi082.stdout: "begin_weekday": { 2023-09-23T09:48:44.149 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "begin_weekday", 2023-09-23T09:48:44.149 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "uint", 2023-09-23T09:48:44.149 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.149 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.149 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2023-09-23T09:48:44.149 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "0", 2023-09-23T09:48:44.150 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "6", 2023-09-23T09:48:44.150 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.150 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-09-23T09:48:44.150 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-09-23T09:48:44.150 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.150 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.150 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.150 INFO:teuthology.orchestra.run.smithi082.stdout: "crush_compat_max_iterations": { 2023-09-23T09:48:44.150 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "crush_compat_max_iterations", 2023-09-23T09:48:44.150 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "uint", 2023-09-23T09:48:44.150 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.150 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.151 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "25", 2023-09-23T09:48:44.151 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "1", 2023-09-23T09:48:44.151 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "250", 2023-09-23T09:48:44.151 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.151 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-09-23T09:48:44.151 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.151 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.151 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.151 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.151 INFO:teuthology.orchestra.run.smithi082.stdout: "crush_compat_metrics": { 2023-09-23T09:48:44.151 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "crush_compat_metrics", 2023-09-23T09:48:44.152 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.152 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.152 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.152 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "pgs,objects,bytes", 2023-09-23T09:48:44.152 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.152 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.152 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.152 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-09-23T09:48:44.152 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-09-23T09:48:44.152 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.152 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.152 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.153 INFO:teuthology.orchestra.run.smithi082.stdout: "crush_compat_step": { 2023-09-23T09:48:44.153 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "crush_compat_step", 2023-09-23T09:48:44.153 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2023-09-23T09:48:44.153 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.153 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.153 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0.5", 2023-09-23T09:48:44.153 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "0.001", 2023-09-23T09:48:44.153 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "0.999", 2023-09-23T09:48:44.153 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.153 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "aggressiveness of optimization", 2023-09-23T09:48:44.153 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-09-23T09:48:44.153 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.154 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.154 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.154 INFO:teuthology.orchestra.run.smithi082.stdout: "end_time": { 2023-09-23T09:48:44.154 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "end_time", 2023-09-23T09:48:44.154 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.154 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.154 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.154 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "2359", 2023-09-23T09:48:44.154 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.154 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.154 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.154 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "ending time of day to automatically balance", 2023-09-23T09:48:44.155 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-09-23T09:48:44.155 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.155 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.155 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.155 INFO:teuthology.orchestra.run.smithi082.stdout: "end_weekday": { 2023-09-23T09:48:44.155 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "end_weekday", 2023-09-23T09:48:44.155 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "uint", 2023-09-23T09:48:44.155 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.155 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.155 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2023-09-23T09:48:44.155 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "0", 2023-09-23T09:48:44.155 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "6", 2023-09-23T09:48:44.156 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.156 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-09-23T09:48:44.156 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-09-23T09:48:44.156 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.156 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.156 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.156 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:44.156 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:44.156 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.156 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.156 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.156 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.157 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.157 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.157 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.157 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:44.157 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:44.157 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:44.157 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.157 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:44.157 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:44.157 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.157 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.157 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.158 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.158 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.158 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.158 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:44.158 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:44.158 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.158 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.158 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.158 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.158 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.158 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.158 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.159 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.159 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.159 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.159 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.159 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.159 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:44.159 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:44.159 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.159 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.159 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.159 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:44.159 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.160 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.160 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.160 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:44.160 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:44.160 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:44.160 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.160 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:44.160 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:44.160 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.160 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.160 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.160 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.161 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.161 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.161 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:44.161 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:44.161 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.161 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.161 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.161 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.161 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.161 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.161 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.161 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.162 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.162 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.162 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.162 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.162 INFO:teuthology.orchestra.run.smithi082.stdout: "min_score": { 2023-09-23T09:48:44.162 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "min_score", 2023-09-23T09:48:44.162 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2023-09-23T09:48:44.162 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.162 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.162 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2023-09-23T09:48:44.162 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.163 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.163 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.163 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-09-23T09:48:44.163 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.163 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.163 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.163 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.163 INFO:teuthology.orchestra.run.smithi082.stdout: "mode": { 2023-09-23T09:48:44.163 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mode", 2023-09-23T09:48:44.163 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.163 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.164 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.164 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "upmap", 2023-09-23T09:48:44.164 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.164 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.164 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.164 INFO:teuthology.orchestra.run.smithi082.stdout: "crush-compat", 2023-09-23T09:48:44.164 INFO:teuthology.orchestra.run.smithi082.stdout: "none", 2023-09-23T09:48:44.164 INFO:teuthology.orchestra.run.smithi082.stdout: "upmap" 2023-09-23T09:48:44.164 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.164 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Balancer mode", 2023-09-23T09:48:44.164 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.164 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.165 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.165 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.165 INFO:teuthology.orchestra.run.smithi082.stdout: "pool_ids": { 2023-09-23T09:48:44.165 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "pool_ids", 2023-09-23T09:48:44.165 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.165 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.165 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.165 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.165 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.165 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.165 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.165 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-09-23T09:48:44.166 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.166 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.166 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.166 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.166 INFO:teuthology.orchestra.run.smithi082.stdout: "sleep_interval": { 2023-09-23T09:48:44.166 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sleep_interval", 2023-09-23T09:48:44.166 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2023-09-23T09:48:44.166 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.166 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.166 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "60", 2023-09-23T09:48:44.166 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.166 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.167 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.167 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-09-23T09:48:44.167 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.167 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.167 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.167 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.167 INFO:teuthology.orchestra.run.smithi082.stdout: "upmap_max_deviation": { 2023-09-23T09:48:44.167 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "upmap_max_deviation", 2023-09-23T09:48:44.167 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:44.167 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.167 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.168 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "5", 2023-09-23T09:48:44.168 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "1", 2023-09-23T09:48:44.168 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.168 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.168 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "deviation below which no optimization is attempted", 2023-09-23T09:48:44.168 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-09-23T09:48:44.168 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.168 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.169 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.169 INFO:teuthology.orchestra.run.smithi082.stdout: "upmap_max_optimizations": { 2023-09-23T09:48:44.169 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "upmap_max_optimizations", 2023-09-23T09:48:44.169 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "uint", 2023-09-23T09:48:44.169 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.169 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.169 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2023-09-23T09:48:44.169 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.169 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.169 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.169 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-09-23T09:48:44.169 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.170 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.170 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.170 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.170 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.170 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.170 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:44.170 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cephadm", 2023-09-23T09:48:44.170 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:44.170 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:44.170 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:44.170 INFO:teuthology.orchestra.run.smithi082.stdout: "agent_down_multiplier": { 2023-09-23T09:48:44.171 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "agent_down_multiplier", 2023-09-23T09:48:44.171 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2023-09-23T09:48:44.171 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.171 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.171 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "3.0", 2023-09-23T09:48:44.171 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.171 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.171 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.171 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-09-23T09:48:44.171 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.171 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.171 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.171 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.172 INFO:teuthology.orchestra.run.smithi082.stdout: "agent_refresh_rate": { 2023-09-23T09:48:44.172 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "agent_refresh_rate", 2023-09-23T09:48:44.172 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2023-09-23T09:48:44.172 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.172 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.172 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "20", 2023-09-23T09:48:44.172 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.172 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.172 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.172 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-09-23T09:48:44.172 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.172 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.172 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.173 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.173 INFO:teuthology.orchestra.run.smithi082.stdout: "agent_starting_port": { 2023-09-23T09:48:44.173 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "agent_starting_port", 2023-09-23T09:48:44.173 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:44.173 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.173 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.173 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "4721", 2023-09-23T09:48:44.173 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.173 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.173 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.173 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-09-23T09:48:44.173 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.174 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.174 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.174 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.174 INFO:teuthology.orchestra.run.smithi082.stdout: "allow_ptrace": { 2023-09-23T09:48:44.174 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "allow_ptrace", 2023-09-23T09:48:44.174 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.174 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.174 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.174 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.174 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.174 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.175 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.175 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-09-23T09:48:44.175 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-09-23T09:48:44.175 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.175 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.175 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.175 INFO:teuthology.orchestra.run.smithi082.stdout: "autotune_interval": { 2023-09-23T09:48:44.175 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "autotune_interval", 2023-09-23T09:48:44.175 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2023-09-23T09:48:44.175 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.175 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.175 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "600", 2023-09-23T09:48:44.176 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.176 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.176 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.176 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how frequently to autotune daemon memory", 2023-09-23T09:48:44.176 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.176 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.176 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.176 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.176 INFO:teuthology.orchestra.run.smithi082.stdout: "autotune_memory_target_ratio": { 2023-09-23T09:48:44.176 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "autotune_memory_target_ratio", 2023-09-23T09:48:44.176 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2023-09-23T09:48:44.176 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.177 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.177 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0.7", 2023-09-23T09:48:44.177 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.177 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.177 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.177 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-09-23T09:48:44.177 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.177 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.177 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.177 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.177 INFO:teuthology.orchestra.run.smithi082.stdout: "cgroups_split": { 2023-09-23T09:48:44.177 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cgroups_split", 2023-09-23T09:48:44.177 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.178 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.178 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.178 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:44.178 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.178 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.178 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.178 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-09-23T09:48:44.178 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.178 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.178 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.178 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.179 INFO:teuthology.orchestra.run.smithi082.stdout: "config_checks_enabled": { 2023-09-23T09:48:44.179 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "config_checks_enabled", 2023-09-23T09:48:44.179 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.179 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.179 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.179 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.179 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.179 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.179 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.179 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-09-23T09:48:44.179 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.179 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.179 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.180 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.180 INFO:teuthology.orchestra.run.smithi082.stdout: "config_dashboard": { 2023-09-23T09:48:44.180 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "config_dashboard", 2023-09-23T09:48:44.180 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.180 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.180 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.180 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:44.180 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.180 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.180 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.180 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-09-23T09:48:44.180 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.180 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.181 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.181 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.181 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_alertmanager": { 2023-09-23T09:48:44.181 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_alertmanager", 2023-09-23T09:48:44.181 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.181 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.181 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.181 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-09-23T09:48:44.181 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.181 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.181 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.181 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Prometheus container image", 2023-09-23T09:48:44.182 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.182 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.182 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.182 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.182 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_base": { 2023-09-23T09:48:44.182 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_base", 2023-09-23T09:48:44.182 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.182 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.182 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.182 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/ceph/ceph", 2023-09-23T09:48:44.182 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.182 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.183 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.183 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Container image name, without the tag", 2023-09-23T09:48:44.183 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.183 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.183 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.183 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.183 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_elasticsearch": { 2023-09-23T09:48:44.183 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_elasticsearch", 2023-09-23T09:48:44.183 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.183 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.183 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.183 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2023-09-23T09:48:44.184 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.184 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.184 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.184 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "elasticsearch container image", 2023-09-23T09:48:44.184 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.184 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.184 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.184 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.184 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_grafana": { 2023-09-23T09:48:44.184 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_grafana", 2023-09-23T09:48:44.184 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.184 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.185 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.185 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-09-23T09:48:44.185 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.185 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.185 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.185 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Prometheus container image", 2023-09-23T09:48:44.185 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.185 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.185 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.185 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.185 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_haproxy": { 2023-09-23T09:48:44.186 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_haproxy", 2023-09-23T09:48:44.186 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.186 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.186 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.186 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-09-23T09:48:44.186 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.186 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.186 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.186 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "HAproxy container image", 2023-09-23T09:48:44.186 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.186 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.187 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.187 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.187 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_jaeger_agent": { 2023-09-23T09:48:44.187 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_jaeger_agent", 2023-09-23T09:48:44.187 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.187 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.187 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.187 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2023-09-23T09:48:44.187 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.187 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.187 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.187 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Jaeger agent container image", 2023-09-23T09:48:44.188 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.188 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.188 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.188 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.188 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_jaeger_collector": { 2023-09-23T09:48:44.188 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_jaeger_collector", 2023-09-23T09:48:44.188 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.188 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.188 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.188 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2023-09-23T09:48:44.188 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.189 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.189 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.189 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Jaeger collector container image", 2023-09-23T09:48:44.189 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.189 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.189 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.189 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.189 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_jaeger_query": { 2023-09-23T09:48:44.189 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_jaeger_query", 2023-09-23T09:48:44.189 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.189 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.190 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.190 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2023-09-23T09:48:44.190 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.190 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.190 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.190 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Jaeger query container image", 2023-09-23T09:48:44.190 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.190 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.190 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.190 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.190 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_keepalived": { 2023-09-23T09:48:44.190 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_keepalived", 2023-09-23T09:48:44.191 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.191 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.191 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.191 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2023-09-23T09:48:44.191 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.191 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.191 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.191 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Keepalived container image", 2023-09-23T09:48:44.191 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.191 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.191 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.191 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.192 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_loki": { 2023-09-23T09:48:44.192 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_loki", 2023-09-23T09:48:44.192 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.192 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.192 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.192 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-09-23T09:48:44.192 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.192 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.192 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.192 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Loki container image", 2023-09-23T09:48:44.192 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.192 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.192 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.193 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.193 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_node_exporter": { 2023-09-23T09:48:44.193 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_node_exporter", 2023-09-23T09:48:44.193 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.193 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.193 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.193 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-09-23T09:48:44.193 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.193 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.193 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.193 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Prometheus container image", 2023-09-23T09:48:44.193 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.194 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.194 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.194 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.194 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_nvmeof": { 2023-09-23T09:48:44.194 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_nvmeof", 2023-09-23T09:48:44.194 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.194 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.194 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.194 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/ceph/nvmeof:0.0.2", 2023-09-23T09:48:44.194 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.194 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.194 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.195 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Nvme-of container image", 2023-09-23T09:48:44.195 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.195 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.195 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.195 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.195 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_prometheus": { 2023-09-23T09:48:44.195 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_prometheus", 2023-09-23T09:48:44.195 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.195 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.195 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.195 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-09-23T09:48:44.195 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.196 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.196 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.196 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Prometheus container image", 2023-09-23T09:48:44.196 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.196 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.196 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.196 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.196 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_promtail": { 2023-09-23T09:48:44.196 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_promtail", 2023-09-23T09:48:44.196 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.196 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.196 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.197 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-09-23T09:48:44.197 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.197 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.197 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.197 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Promtail container image", 2023-09-23T09:48:44.197 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.197 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.197 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.197 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.197 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_snmp_gateway": { 2023-09-23T09:48:44.197 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_snmp_gateway", 2023-09-23T09:48:44.197 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.197 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.198 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.198 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-09-23T09:48:44.198 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.198 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.198 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.198 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "SNMP Gateway container image", 2023-09-23T09:48:44.198 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.198 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.198 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.198 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.198 INFO:teuthology.orchestra.run.smithi082.stdout: "container_init": { 2023-09-23T09:48:44.198 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_init", 2023-09-23T09:48:44.199 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.199 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.199 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.199 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:44.199 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.199 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.199 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.199 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Run podman/docker with `--init`", 2023-09-23T09:48:44.199 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.199 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.199 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.199 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.199 INFO:teuthology.orchestra.run.smithi082.stdout: "daemon_cache_timeout": { 2023-09-23T09:48:44.200 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "daemon_cache_timeout", 2023-09-23T09:48:44.200 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2023-09-23T09:48:44.200 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.200 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.200 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "600", 2023-09-23T09:48:44.200 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.200 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.200 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.200 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-09-23T09:48:44.200 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.200 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.200 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.201 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.201 INFO:teuthology.orchestra.run.smithi082.stdout: "default_cephadm_command_timeout": { 2023-09-23T09:48:44.201 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "default_cephadm_command_timeout", 2023-09-23T09:48:44.201 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2023-09-23T09:48:44.201 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.201 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.201 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "900", 2023-09-23T09:48:44.201 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.201 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.201 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.201 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-09-23T09:48:44.201 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.202 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.202 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.202 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.202 INFO:teuthology.orchestra.run.smithi082.stdout: "default_registry": { 2023-09-23T09:48:44.202 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "default_registry", 2023-09-23T09:48:44.202 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.202 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.202 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.202 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "docker.io", 2023-09-23T09:48:44.202 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.202 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.202 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.203 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-09-23T09:48:44.203 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.203 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.203 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.203 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.203 INFO:teuthology.orchestra.run.smithi082.stdout: "device_cache_timeout": { 2023-09-23T09:48:44.203 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "device_cache_timeout", 2023-09-23T09:48:44.203 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2023-09-23T09:48:44.203 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.203 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.203 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "1800", 2023-09-23T09:48:44.204 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.204 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.204 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.204 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "seconds to cache device inventory", 2023-09-23T09:48:44.204 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.204 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.204 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.204 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.204 INFO:teuthology.orchestra.run.smithi082.stdout: "device_enhanced_scan": { 2023-09-23T09:48:44.204 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "device_enhanced_scan", 2023-09-23T09:48:44.204 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.204 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.204 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.205 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.205 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.205 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.205 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.205 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Use libstoragemgmt during device scans", 2023-09-23T09:48:44.205 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.205 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.205 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.205 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.205 INFO:teuthology.orchestra.run.smithi082.stdout: "facts_cache_timeout": { 2023-09-23T09:48:44.205 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "facts_cache_timeout", 2023-09-23T09:48:44.205 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2023-09-23T09:48:44.206 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.206 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.206 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "60", 2023-09-23T09:48:44.206 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.206 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.206 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.206 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "seconds to cache host facts data", 2023-09-23T09:48:44.206 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.206 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.206 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.207 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.207 INFO:teuthology.orchestra.run.smithi082.stdout: "host_check_interval": { 2023-09-23T09:48:44.207 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "host_check_interval", 2023-09-23T09:48:44.207 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2023-09-23T09:48:44.207 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.207 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.207 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "600", 2023-09-23T09:48:44.207 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.207 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.207 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.207 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how frequently to perform a host check", 2023-09-23T09:48:44.207 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.208 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.208 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.208 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.208 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:44.208 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:44.208 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.208 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.208 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.208 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.208 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.208 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.209 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.209 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:44.209 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:44.209 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:44.209 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.209 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:44.209 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:44.209 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.209 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.209 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.209 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.209 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.210 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.210 INFO:teuthology.orchestra.run.smithi082.stdout: "log_refresh_metadata": { 2023-09-23T09:48:44.210 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_refresh_metadata", 2023-09-23T09:48:44.210 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.210 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.210 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.210 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.210 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.210 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.211 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.211 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-09-23T09:48:44.211 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.211 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.211 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.211 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.211 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:44.211 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:44.211 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.212 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.212 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.212 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:44.212 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.212 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.212 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.212 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-09-23T09:48:44.212 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.212 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.212 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.212 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.212 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:44.213 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:44.213 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.213 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.213 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.213 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:44.213 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.213 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.213 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.213 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:44.213 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:44.213 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:44.213 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.214 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:44.214 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:44.214 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.214 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.214 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.214 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.214 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.214 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.214 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:44.214 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:44.214 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.214 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.215 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.215 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.215 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.215 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.215 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.215 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.215 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.215 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.215 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.216 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.216 INFO:teuthology.orchestra.run.smithi082.stdout: "manage_etc_ceph_ceph_conf": { 2023-09-23T09:48:44.216 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-09-23T09:48:44.216 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.216 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.216 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.216 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.216 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.216 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.216 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.216 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-09-23T09:48:44.216 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.217 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.217 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.217 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.217 INFO:teuthology.orchestra.run.smithi082.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-09-23T09:48:44.217 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-09-23T09:48:44.217 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.217 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.217 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.217 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "*", 2023-09-23T09:48:44.217 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.217 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.217 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.218 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-09-23T09:48:44.218 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.218 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.218 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.218 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.218 INFO:teuthology.orchestra.run.smithi082.stdout: "max_count_per_host": { 2023-09-23T09:48:44.218 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "max_count_per_host", 2023-09-23T09:48:44.218 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:44.218 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.219 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.219 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2023-09-23T09:48:44.219 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.219 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.219 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.219 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "max number of daemons per service per host", 2023-09-23T09:48:44.219 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.219 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.219 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.219 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.219 INFO:teuthology.orchestra.run.smithi082.stdout: "max_osd_draining_count": { 2023-09-23T09:48:44.219 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "max_osd_draining_count", 2023-09-23T09:48:44.220 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:44.220 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.220 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.220 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2023-09-23T09:48:44.220 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.220 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.220 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.220 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-09-23T09:48:44.220 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.220 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.220 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.220 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.221 INFO:teuthology.orchestra.run.smithi082.stdout: "migration_current": { 2023-09-23T09:48:44.221 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "migration_current", 2023-09-23T09:48:44.221 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:44.221 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.221 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.221 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.221 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.221 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.221 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.221 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "internal - do not modify", 2023-09-23T09:48:44.221 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.222 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.222 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.222 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.222 INFO:teuthology.orchestra.run.smithi082.stdout: "mode": { 2023-09-23T09:48:44.222 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mode", 2023-09-23T09:48:44.222 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.222 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.222 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.222 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "root", 2023-09-23T09:48:44.222 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.222 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.222 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.223 INFO:teuthology.orchestra.run.smithi082.stdout: "cephadm-package", 2023-09-23T09:48:44.223 INFO:teuthology.orchestra.run.smithi082.stdout: "root" 2023-09-23T09:48:44.223 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.223 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "mode for remote execution of cephadm", 2023-09-23T09:48:44.223 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.223 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.223 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.223 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.223 INFO:teuthology.orchestra.run.smithi082.stdout: "prometheus_alerts_path": { 2023-09-23T09:48:44.223 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "prometheus_alerts_path", 2023-09-23T09:48:44.224 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.224 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.224 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.224 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-09-23T09:48:44.224 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.224 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.224 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.224 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-09-23T09:48:44.224 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.224 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.224 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.224 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.225 INFO:teuthology.orchestra.run.smithi082.stdout: "registry_insecure": { 2023-09-23T09:48:44.225 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "registry_insecure", 2023-09-23T09:48:44.225 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.225 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.225 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.225 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.225 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.225 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.225 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.225 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-09-23T09:48:44.225 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.226 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.226 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.226 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.226 INFO:teuthology.orchestra.run.smithi082.stdout: "registry_password": { 2023-09-23T09:48:44.226 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "registry_password", 2023-09-23T09:48:44.226 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.226 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.226 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.226 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.226 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.226 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.227 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.227 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-09-23T09:48:44.227 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.227 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.227 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.227 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.227 INFO:teuthology.orchestra.run.smithi082.stdout: "registry_url": { 2023-09-23T09:48:44.227 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "registry_url", 2023-09-23T09:48:44.227 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.228 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.228 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.228 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.228 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.228 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.228 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.228 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-09-23T09:48:44.228 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.228 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.228 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.229 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.229 INFO:teuthology.orchestra.run.smithi082.stdout: "registry_username": { 2023-09-23T09:48:44.229 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "registry_username", 2023-09-23T09:48:44.229 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.229 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.229 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.229 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.229 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.229 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.229 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.230 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-09-23T09:48:44.230 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.230 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.230 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.230 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.230 INFO:teuthology.orchestra.run.smithi082.stdout: "secure_monitoring_stack": { 2023-09-23T09:48:44.230 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "secure_monitoring_stack", 2023-09-23T09:48:44.230 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.230 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.230 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.230 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.231 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.231 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.231 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.231 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2023-09-23T09:48:44.231 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.231 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.231 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.231 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.231 INFO:teuthology.orchestra.run.smithi082.stdout: "service_discovery_port": { 2023-09-23T09:48:44.231 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "service_discovery_port", 2023-09-23T09:48:44.231 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:44.232 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.232 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.232 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "8765", 2023-09-23T09:48:44.232 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.232 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.232 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.232 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "cephadm service discovery port", 2023-09-23T09:48:44.232 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.232 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.232 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.232 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.233 INFO:teuthology.orchestra.run.smithi082.stdout: "ssh_config_file": { 2023-09-23T09:48:44.233 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ssh_config_file", 2023-09-23T09:48:44.233 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.233 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.233 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.233 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.233 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.233 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.233 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.233 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-09-23T09:48:44.234 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.234 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.234 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.234 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.234 INFO:teuthology.orchestra.run.smithi082.stdout: "use_agent": { 2023-09-23T09:48:44.234 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "use_agent", 2023-09-23T09:48:44.234 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.234 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.234 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.235 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.235 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.235 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.235 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.235 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-09-23T09:48:44.235 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.235 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.235 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.235 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.235 INFO:teuthology.orchestra.run.smithi082.stdout: "use_repo_digest": { 2023-09-23T09:48:44.235 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "use_repo_digest", 2023-09-23T09:48:44.236 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.236 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.236 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.236 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:44.236 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.236 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.236 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.236 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-09-23T09:48:44.236 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.236 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.237 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.237 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.237 INFO:teuthology.orchestra.run.smithi082.stdout: "warn_on_failed_host_check": { 2023-09-23T09:48:44.237 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "warn_on_failed_host_check", 2023-09-23T09:48:44.237 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.237 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.237 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.237 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:44.237 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.237 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.237 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.238 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "raise a health warning if the host check fails", 2023-09-23T09:48:44.238 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.238 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.238 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.238 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.238 INFO:teuthology.orchestra.run.smithi082.stdout: "warn_on_stray_daemons": { 2023-09-23T09:48:44.238 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "warn_on_stray_daemons", 2023-09-23T09:48:44.238 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.238 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.238 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.238 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:44.238 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.239 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.239 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.239 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-09-23T09:48:44.239 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.239 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.239 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.239 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.239 INFO:teuthology.orchestra.run.smithi082.stdout: "warn_on_stray_hosts": { 2023-09-23T09:48:44.239 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "warn_on_stray_hosts", 2023-09-23T09:48:44.239 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.239 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.239 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.240 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:44.240 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.240 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.240 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.240 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-09-23T09:48:44.240 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.240 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.240 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.240 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.240 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.240 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.240 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:44.241 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "crash", 2023-09-23T09:48:44.241 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:44.241 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:44.241 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:44.241 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:44.241 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:44.241 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.241 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.241 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.241 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.241 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.241 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.242 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.242 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:44.242 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:44.242 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:44.242 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.242 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:44.242 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:44.242 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.242 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.242 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.242 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.242 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.243 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.243 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:44.243 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:44.243 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.243 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.243 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.243 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.243 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.243 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.243 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.243 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.243 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.244 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.244 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.244 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.244 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:44.244 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:44.244 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.244 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.244 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.244 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:44.244 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.244 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.244 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.245 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:44.245 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:44.245 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:44.245 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.245 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:44.245 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:44.245 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.245 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.245 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.245 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.245 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.245 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.246 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:44.246 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:44.246 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.246 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.246 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.246 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.246 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.246 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.246 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.246 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.246 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.246 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.247 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.247 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.247 INFO:teuthology.orchestra.run.smithi082.stdout: "retain_interval": { 2023-09-23T09:48:44.247 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "retain_interval", 2023-09-23T09:48:44.247 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2023-09-23T09:48:44.247 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.247 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.247 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "31536000", 2023-09-23T09:48:44.247 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.247 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.247 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.247 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how long to retain crashes before pruning them", 2023-09-23T09:48:44.248 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.248 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.248 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.248 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.248 INFO:teuthology.orchestra.run.smithi082.stdout: "warn_recent_interval": { 2023-09-23T09:48:44.248 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "warn_recent_interval", 2023-09-23T09:48:44.248 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2023-09-23T09:48:44.248 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.248 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.248 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "1209600", 2023-09-23T09:48:44.248 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.248 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.249 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.249 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "time interval in which to warn about recent crashes", 2023-09-23T09:48:44.249 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.249 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.249 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.249 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.249 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.249 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.249 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:44.249 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "dashboard", 2023-09-23T09:48:44.249 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:44.249 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:44.250 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:44.250 INFO:teuthology.orchestra.run.smithi082.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-09-23T09:48:44.250 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-09-23T09:48:44.250 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:44.250 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.250 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.250 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2023-09-23T09:48:44.250 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.250 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.250 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.250 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.250 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.251 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.251 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.251 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.251 INFO:teuthology.orchestra.run.smithi082.stdout: "ALERTMANAGER_API_HOST": { 2023-09-23T09:48:44.251 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ALERTMANAGER_API_HOST", 2023-09-23T09:48:44.251 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.251 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.251 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.251 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.251 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.251 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.251 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.252 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.252 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.252 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.252 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.252 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.252 INFO:teuthology.orchestra.run.smithi082.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-09-23T09:48:44.252 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-09-23T09:48:44.252 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.252 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.252 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.252 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:44.252 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.253 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.253 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.253 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.253 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.253 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.253 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.253 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.253 INFO:teuthology.orchestra.run.smithi082.stdout: "AUDIT_API_ENABLED": { 2023-09-23T09:48:44.253 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "AUDIT_API_ENABLED", 2023-09-23T09:48:44.253 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.253 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.253 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.254 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.254 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.254 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.254 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.254 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.254 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.254 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.254 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.254 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.254 INFO:teuthology.orchestra.run.smithi082.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-09-23T09:48:44.254 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-09-23T09:48:44.254 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.255 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.255 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.255 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:44.255 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.255 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.255 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.255 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.255 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.255 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.255 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.255 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.255 INFO:teuthology.orchestra.run.smithi082.stdout: "ENABLE_BROWSABLE_API": { 2023-09-23T09:48:44.256 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ENABLE_BROWSABLE_API", 2023-09-23T09:48:44.256 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.256 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.256 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.256 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:44.256 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.256 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.256 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.256 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.256 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.256 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.256 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.256 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.257 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-09-23T09:48:44.257 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-09-23T09:48:44.257 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.257 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.257 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.257 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:44.257 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.257 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.257 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.257 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.257 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.257 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.258 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.258 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.258 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-09-23T09:48:44.258 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-09-23T09:48:44.258 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.258 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.258 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.258 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:44.258 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.258 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.258 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.258 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.259 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.259 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.259 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.259 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.259 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-09-23T09:48:44.259 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-09-23T09:48:44.259 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.259 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.259 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.259 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:44.259 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.259 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.260 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.260 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.260 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.260 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.260 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.260 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.260 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-09-23T09:48:44.260 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-09-23T09:48:44.260 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.260 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.260 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.260 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:44.261 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.261 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.261 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.261 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.261 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.261 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.261 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.261 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.261 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_NFS": { 2023-09-23T09:48:44.261 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-09-23T09:48:44.261 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.261 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.262 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.262 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:44.262 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.262 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.262 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.262 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.262 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.262 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.262 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.262 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.262 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_RBD": { 2023-09-23T09:48:44.262 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-09-23T09:48:44.263 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.263 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.263 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.263 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:44.263 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.263 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.263 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.263 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.263 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.263 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.263 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.263 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.264 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_RGW": { 2023-09-23T09:48:44.264 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-09-23T09:48:44.264 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.264 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.264 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.264 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:44.264 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.264 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.264 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.264 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.264 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.264 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.265 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.265 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.265 INFO:teuthology.orchestra.run.smithi082.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-09-23T09:48:44.265 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-09-23T09:48:44.265 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.265 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.265 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.265 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.265 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.265 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.266 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.266 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.266 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.266 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.266 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.266 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.266 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_API_PASSWORD": { 2023-09-23T09:48:44.266 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_API_PASSWORD", 2023-09-23T09:48:44.266 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.266 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.266 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.266 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "admin", 2023-09-23T09:48:44.267 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.267 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.267 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.267 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.267 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.267 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.267 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.267 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.267 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-09-23T09:48:44.267 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-09-23T09:48:44.267 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.267 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.268 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.268 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:44.268 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.268 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.268 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.268 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.268 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.268 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.268 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.268 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.268 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_API_URL": { 2023-09-23T09:48:44.268 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_API_URL", 2023-09-23T09:48:44.268 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.269 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.269 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.269 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.269 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.269 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.269 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.269 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.269 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.269 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.269 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.269 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.269 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_API_USERNAME": { 2023-09-23T09:48:44.270 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_API_USERNAME", 2023-09-23T09:48:44.270 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.270 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.270 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.270 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "admin", 2023-09-23T09:48:44.270 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.270 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.270 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.270 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.270 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.270 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.270 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.271 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.271 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-09-23T09:48:44.271 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-09-23T09:48:44.271 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.271 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.271 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.271 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.271 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.271 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.271 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.271 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.271 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.272 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.272 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.272 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.272 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-09-23T09:48:44.272 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-09-23T09:48:44.272 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.272 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.272 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.272 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.272 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.272 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.272 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.272 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.273 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.273 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.273 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.273 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.273 INFO:teuthology.orchestra.run.smithi082.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-09-23T09:48:44.273 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-09-23T09:48:44.273 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.273 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.273 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.273 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:44.273 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.273 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.273 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.274 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.274 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.274 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.274 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.274 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.274 INFO:teuthology.orchestra.run.smithi082.stdout: "ISSUE_TRACKER_API_KEY": { 2023-09-23T09:48:44.274 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-09-23T09:48:44.274 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.274 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.274 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.274 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.274 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.275 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.275 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.275 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.275 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.275 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.275 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.275 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.275 INFO:teuthology.orchestra.run.smithi082.stdout: "PROMETHEUS_API_HOST": { 2023-09-23T09:48:44.275 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PROMETHEUS_API_HOST", 2023-09-23T09:48:44.275 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.275 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.275 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.276 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.276 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.276 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.276 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.276 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.276 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.276 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.276 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.276 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.276 INFO:teuthology.orchestra.run.smithi082.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-09-23T09:48:44.276 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-09-23T09:48:44.277 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.277 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.277 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.277 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:44.277 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.277 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.277 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.277 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.277 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.277 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.277 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.277 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.277 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-09-23T09:48:44.278 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-09-23T09:48:44.278 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.278 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.278 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.278 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.278 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.278 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.278 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.278 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.278 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.279 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.279 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.279 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.279 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-09-23T09:48:44.279 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-09-23T09:48:44.279 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.279 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.279 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.279 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.279 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.279 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.279 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.280 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.280 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.280 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.280 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.280 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.280 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-09-23T09:48:44.280 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-09-23T09:48:44.280 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.280 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.280 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.280 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:44.280 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.280 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.281 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.281 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.281 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.281 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.281 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.281 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.281 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-09-23T09:48:44.281 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-09-23T09:48:44.281 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.281 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.281 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.281 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:44.282 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.282 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.282 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.282 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.282 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.282 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.282 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.282 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.282 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-09-23T09:48:44.282 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-09-23T09:48:44.282 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.283 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.283 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.283 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.283 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.283 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.283 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.283 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.283 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.283 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.283 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.283 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.284 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-09-23T09:48:44.284 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-09-23T09:48:44.284 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.284 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.284 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.284 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.284 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.284 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.284 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.284 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.284 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.284 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.285 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.285 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.285 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-09-23T09:48:44.285 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-09-23T09:48:44.285 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.285 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.285 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.285 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.285 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.285 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.285 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.286 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.286 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.286 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.286 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.286 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.286 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_ENABLED": { 2023-09-23T09:48:44.286 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_ENABLED", 2023-09-23T09:48:44.286 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.286 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.286 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.286 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:44.287 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.287 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.287 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.287 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.287 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.287 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.287 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.287 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.287 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-09-23T09:48:44.287 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-09-23T09:48:44.287 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.287 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.288 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.288 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-09-23T09:48:44.288 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.288 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.288 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.288 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.288 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.288 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.288 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.288 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.288 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-09-23T09:48:44.288 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-09-23T09:48:44.289 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:44.289 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.289 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.289 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2023-09-23T09:48:44.289 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.289 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.289 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.289 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.289 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.289 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.289 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.289 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.289 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-09-23T09:48:44.290 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-09-23T09:48:44.290 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:44.290 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.290 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.290 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "8", 2023-09-23T09:48:44.290 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.290 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.290 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.290 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.290 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.290 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.290 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.291 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.291 INFO:teuthology.orchestra.run.smithi082.stdout: "REST_REQUESTS_TIMEOUT": { 2023-09-23T09:48:44.291 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-09-23T09:48:44.291 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:44.291 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.291 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.291 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "45", 2023-09-23T09:48:44.291 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.291 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.291 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.291 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.291 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.291 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.292 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.292 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.292 INFO:teuthology.orchestra.run.smithi082.stdout: "RGW_API_ACCESS_KEY": { 2023-09-23T09:48:44.292 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "RGW_API_ACCESS_KEY", 2023-09-23T09:48:44.292 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.292 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.292 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.292 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.292 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.292 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.292 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.292 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.292 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.293 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.293 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.293 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.293 INFO:teuthology.orchestra.run.smithi082.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-09-23T09:48:44.293 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-09-23T09:48:44.293 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.293 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.293 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.293 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "admin", 2023-09-23T09:48:44.293 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.293 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.293 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.293 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.294 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.294 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.294 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.294 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.294 INFO:teuthology.orchestra.run.smithi082.stdout: "RGW_API_SECRET_KEY": { 2023-09-23T09:48:44.294 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "RGW_API_SECRET_KEY", 2023-09-23T09:48:44.294 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.294 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.294 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.294 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.294 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.295 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.295 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.295 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.295 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.295 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.295 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.295 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.295 INFO:teuthology.orchestra.run.smithi082.stdout: "RGW_API_SSL_VERIFY": { 2023-09-23T09:48:44.295 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "RGW_API_SSL_VERIFY", 2023-09-23T09:48:44.295 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.295 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.295 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.296 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:44.296 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.296 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.296 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.296 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.296 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.296 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.296 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.296 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.296 INFO:teuthology.orchestra.run.smithi082.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-09-23T09:48:44.296 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-09-23T09:48:44.296 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:44.297 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.297 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.297 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2023-09-23T09:48:44.297 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.297 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.297 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.297 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.297 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.297 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.297 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.297 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.298 INFO:teuthology.orchestra.run.smithi082.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-09-23T09:48:44.298 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-09-23T09:48:44.298 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:44.298 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.298 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.298 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2023-09-23T09:48:44.298 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.298 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.298 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.298 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.298 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.298 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.298 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.299 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.299 INFO:teuthology.orchestra.run.smithi082.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-09-23T09:48:44.299 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-09-23T09:48:44.299 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:44.299 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.299 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.299 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "5", 2023-09-23T09:48:44.299 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.299 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.299 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.299 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.300 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.300 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.300 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.300 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.300 INFO:teuthology.orchestra.run.smithi082.stdout: "cross_origin_url": { 2023-09-23T09:48:44.300 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cross_origin_url", 2023-09-23T09:48:44.300 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.300 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.300 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.300 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.300 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.300 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.300 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.301 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.301 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.301 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.301 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.301 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.301 INFO:teuthology.orchestra.run.smithi082.stdout: "crt_file": { 2023-09-23T09:48:44.301 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "crt_file", 2023-09-23T09:48:44.301 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.301 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.301 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.302 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.302 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.302 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.302 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.302 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.302 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.302 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.302 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.302 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.302 INFO:teuthology.orchestra.run.smithi082.stdout: "debug": { 2023-09-23T09:48:44.302 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "debug", 2023-09-23T09:48:44.302 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.303 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.303 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.303 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.303 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.303 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.303 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.303 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Enable/disable debug options", 2023-09-23T09:48:44.303 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.303 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.305 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.305 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.305 INFO:teuthology.orchestra.run.smithi082.stdout: "jwt_token_ttl": { 2023-09-23T09:48:44.305 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "jwt_token_ttl", 2023-09-23T09:48:44.305 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:44.305 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.305 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.305 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "28800", 2023-09-23T09:48:44.305 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.305 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.305 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.305 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.306 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.306 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.306 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.306 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.306 INFO:teuthology.orchestra.run.smithi082.stdout: "key_file": { 2023-09-23T09:48:44.306 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "key_file", 2023-09-23T09:48:44.306 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.306 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.306 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.306 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.306 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.306 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.307 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.307 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.307 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.307 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.307 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.307 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.307 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:44.307 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:44.307 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.307 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.307 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.307 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.307 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.308 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.308 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.308 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:44.308 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:44.308 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:44.308 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.308 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:44.308 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:44.308 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.308 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.308 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.308 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.308 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.308 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.309 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:44.309 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:44.309 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.309 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.309 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.309 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.309 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.309 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.309 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.309 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.309 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.310 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.310 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.310 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.310 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:44.310 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:44.310 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.310 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.310 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.310 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:44.310 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.310 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.311 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.311 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:44.311 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:44.311 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:44.311 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.311 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:44.311 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:44.311 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.311 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.311 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.311 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.311 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.311 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.312 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:44.312 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:44.312 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.312 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.312 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.312 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.312 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.312 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.312 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.312 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.312 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.313 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.313 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.313 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.313 INFO:teuthology.orchestra.run.smithi082.stdout: "motd": { 2023-09-23T09:48:44.313 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "motd", 2023-09-23T09:48:44.313 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.313 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.313 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.313 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.313 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.313 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.314 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.314 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "The message of the day", 2023-09-23T09:48:44.314 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.314 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.314 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.314 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.314 INFO:teuthology.orchestra.run.smithi082.stdout: "redirect_resolve_ip_addr": { 2023-09-23T09:48:44.314 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "redirect_resolve_ip_addr", 2023-09-23T09:48:44.314 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.314 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.314 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.314 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.315 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.315 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.315 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.315 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.315 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.315 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.315 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.315 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.315 INFO:teuthology.orchestra.run.smithi082.stdout: "server_addr": { 2023-09-23T09:48:44.315 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_addr", 2023-09-23T09:48:44.315 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.315 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.316 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.316 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "::", 2023-09-23T09:48:44.316 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.316 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.316 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.316 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.316 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.316 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.316 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.316 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.316 INFO:teuthology.orchestra.run.smithi082.stdout: "server_port": { 2023-09-23T09:48:44.316 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_port", 2023-09-23T09:48:44.316 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:44.317 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.317 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.317 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "8080", 2023-09-23T09:48:44.317 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.317 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.317 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.317 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.317 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.317 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.317 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.317 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.317 INFO:teuthology.orchestra.run.smithi082.stdout: "ssl": { 2023-09-23T09:48:44.318 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ssl", 2023-09-23T09:48:44.318 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.318 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.318 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.318 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:44.318 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.318 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.318 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.318 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.318 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.318 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.318 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.319 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.319 INFO:teuthology.orchestra.run.smithi082.stdout: "ssl_server_port": { 2023-09-23T09:48:44.319 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ssl_server_port", 2023-09-23T09:48:44.319 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:44.319 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.319 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.319 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "8443", 2023-09-23T09:48:44.319 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.319 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.319 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.319 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.319 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.319 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.320 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.320 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.320 INFO:teuthology.orchestra.run.smithi082.stdout: "standby_behaviour": { 2023-09-23T09:48:44.320 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "standby_behaviour", 2023-09-23T09:48:44.320 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.320 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.320 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.320 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "redirect", 2023-09-23T09:48:44.320 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.320 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.320 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.320 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.320 INFO:teuthology.orchestra.run.smithi082.stdout: "redirect" 2023-09-23T09:48:44.321 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.321 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.321 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.321 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.321 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.321 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.321 INFO:teuthology.orchestra.run.smithi082.stdout: "standby_error_status_code": { 2023-09-23T09:48:44.321 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "standby_error_status_code", 2023-09-23T09:48:44.321 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:44.321 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.321 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.321 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "500", 2023-09-23T09:48:44.322 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "400", 2023-09-23T09:48:44.322 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "599", 2023-09-23T09:48:44.322 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.322 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.322 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.322 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.322 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.322 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.322 INFO:teuthology.orchestra.run.smithi082.stdout: "url_prefix": { 2023-09-23T09:48:44.322 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "url_prefix", 2023-09-23T09:48:44.322 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.322 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.323 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.323 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.323 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.323 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.323 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.323 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.323 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.323 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.323 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.323 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.323 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.323 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.323 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:44.324 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "devicehealth", 2023-09-23T09:48:44.324 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:44.324 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:44.324 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:44.324 INFO:teuthology.orchestra.run.smithi082.stdout: "enable_monitoring": { 2023-09-23T09:48:44.324 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "enable_monitoring", 2023-09-23T09:48:44.324 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.324 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.324 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.324 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:44.324 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.324 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.324 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.325 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "monitor device health metrics", 2023-09-23T09:48:44.325 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.325 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.325 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.325 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.325 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:44.325 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:44.325 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.325 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.325 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.325 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.325 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.326 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.326 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.326 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:44.326 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:44.326 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:44.326 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.326 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:44.326 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:44.326 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.326 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.326 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.326 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.327 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.327 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.327 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:44.327 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:44.327 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.327 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.327 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.327 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.327 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.327 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.327 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.327 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.327 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.327 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.328 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.328 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.328 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:44.328 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:44.328 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.328 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.328 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.328 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:44.328 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.328 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.328 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.328 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:44.328 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:44.329 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:44.329 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.329 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:44.329 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:44.329 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.329 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.329 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.329 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.329 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.329 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.329 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:44.329 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:44.329 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.330 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.330 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.330 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.330 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.330 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.330 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.330 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.330 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.330 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.330 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.330 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.330 INFO:teuthology.orchestra.run.smithi082.stdout: "mark_out_threshold": { 2023-09-23T09:48:44.330 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mark_out_threshold", 2023-09-23T09:48:44.331 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2023-09-23T09:48:44.331 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.331 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.331 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "2419200", 2023-09-23T09:48:44.331 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.331 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.331 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.331 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-09-23T09:48:44.331 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.331 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.331 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.331 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.331 INFO:teuthology.orchestra.run.smithi082.stdout: "pool_name": { 2023-09-23T09:48:44.332 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "pool_name", 2023-09-23T09:48:44.332 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.332 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.332 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.332 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "device_health_metrics", 2023-09-23T09:48:44.332 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.332 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.332 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.332 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "name of pool in which to store device health metrics", 2023-09-23T09:48:44.332 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.332 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.332 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.332 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.333 INFO:teuthology.orchestra.run.smithi082.stdout: "retention_period": { 2023-09-23T09:48:44.333 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "retention_period", 2023-09-23T09:48:44.333 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2023-09-23T09:48:44.333 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.333 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.333 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "15552000", 2023-09-23T09:48:44.333 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.333 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.333 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.333 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how long to retain device health metrics", 2023-09-23T09:48:44.333 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.333 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.333 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.334 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.334 INFO:teuthology.orchestra.run.smithi082.stdout: "scrape_frequency": { 2023-09-23T09:48:44.334 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "scrape_frequency", 2023-09-23T09:48:44.334 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2023-09-23T09:48:44.334 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.334 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.334 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "86400", 2023-09-23T09:48:44.334 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.334 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.334 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.334 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how frequently to scrape device health metrics", 2023-09-23T09:48:44.334 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.335 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.335 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.335 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.335 INFO:teuthology.orchestra.run.smithi082.stdout: "self_heal": { 2023-09-23T09:48:44.335 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "self_heal", 2023-09-23T09:48:44.335 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.335 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.335 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.335 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:44.335 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.335 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.335 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.335 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-09-23T09:48:44.336 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.336 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.336 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.336 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.336 INFO:teuthology.orchestra.run.smithi082.stdout: "sleep_interval": { 2023-09-23T09:48:44.336 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sleep_interval", 2023-09-23T09:48:44.336 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2023-09-23T09:48:44.336 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.336 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.336 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "600", 2023-09-23T09:48:44.336 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.337 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.337 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.337 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how frequently to wake up and check device health", 2023-09-23T09:48:44.337 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.337 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.337 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.337 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.337 INFO:teuthology.orchestra.run.smithi082.stdout: "warn_threshold": { 2023-09-23T09:48:44.337 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "warn_threshold", 2023-09-23T09:48:44.337 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2023-09-23T09:48:44.337 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.337 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.338 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "7257600", 2023-09-23T09:48:44.338 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.338 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.338 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.338 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-09-23T09:48:44.338 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.338 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.338 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.338 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.338 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.338 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.338 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:44.339 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "diskprediction_local", 2023-09-23T09:48:44.339 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:44.339 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:44.339 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:44.339 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:44.339 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:44.339 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.339 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.339 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.339 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.339 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.339 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.340 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.340 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:44.340 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:44.340 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:44.340 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.340 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:44.340 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:44.340 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.340 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.340 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.340 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.340 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.340 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.341 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:44.341 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:44.341 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.341 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.341 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.341 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.341 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.341 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.341 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.341 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.341 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.341 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.342 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.342 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.342 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:44.342 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:44.342 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.342 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.342 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.342 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:44.342 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.342 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.342 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.342 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:44.343 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:44.343 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:44.343 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.343 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:44.343 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:44.343 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.343 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.343 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.343 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.343 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.343 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.343 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:44.343 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:44.344 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.344 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.344 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.344 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.344 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.344 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.344 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.344 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.344 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.344 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.344 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.344 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.344 INFO:teuthology.orchestra.run.smithi082.stdout: "predict_interval": { 2023-09-23T09:48:44.345 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "predict_interval", 2023-09-23T09:48:44.345 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.345 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.345 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.345 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "86400", 2023-09-23T09:48:44.345 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.345 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.345 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.345 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.345 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.345 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.346 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.346 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.346 INFO:teuthology.orchestra.run.smithi082.stdout: "predictor_model": { 2023-09-23T09:48:44.346 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "predictor_model", 2023-09-23T09:48:44.346 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.346 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.346 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.346 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "prophetstor", 2023-09-23T09:48:44.346 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.346 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.346 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.346 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.347 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.347 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.347 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.347 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.347 INFO:teuthology.orchestra.run.smithi082.stdout: "sleep_interval": { 2023-09-23T09:48:44.347 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sleep_interval", 2023-09-23T09:48:44.347 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.347 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.347 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.347 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "600", 2023-09-23T09:48:44.347 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.347 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.347 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.348 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.348 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.348 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.348 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.348 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.348 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.348 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.348 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:44.348 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "influx", 2023-09-23T09:48:44.348 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": false, 2023-09-23T09:48:44.348 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "influxdb python module not found", 2023-09-23T09:48:44.349 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:44.349 INFO:teuthology.orchestra.run.smithi082.stdout: "batch_size": { 2023-09-23T09:48:44.349 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "batch_size", 2023-09-23T09:48:44.349 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:44.349 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.349 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.349 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "5000", 2023-09-23T09:48:44.349 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.349 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.349 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.349 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-09-23T09:48:44.349 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.349 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.350 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.350 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.350 INFO:teuthology.orchestra.run.smithi082.stdout: "database": { 2023-09-23T09:48:44.350 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "database", 2023-09-23T09:48:44.350 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.350 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.350 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.350 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "ceph", 2023-09-23T09:48:44.350 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.350 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.350 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.351 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-09-23T09:48:44.351 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.351 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.351 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.351 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.351 INFO:teuthology.orchestra.run.smithi082.stdout: "hostname": { 2023-09-23T09:48:44.351 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "hostname", 2023-09-23T09:48:44.351 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.351 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.351 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.351 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.351 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.351 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.352 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.352 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "InfluxDB server hostname", 2023-09-23T09:48:44.352 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.352 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.352 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.352 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.352 INFO:teuthology.orchestra.run.smithi082.stdout: "interval": { 2023-09-23T09:48:44.352 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "interval", 2023-09-23T09:48:44.352 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2023-09-23T09:48:44.352 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.352 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.352 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "30", 2023-09-23T09:48:44.352 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "5", 2023-09-23T09:48:44.353 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.353 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.353 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-09-23T09:48:44.353 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.353 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.353 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.353 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.353 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:44.353 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:44.353 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.353 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.353 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.353 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.354 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.354 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.354 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.354 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:44.354 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:44.354 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:44.354 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.354 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:44.354 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:44.354 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.354 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.354 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.355 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.355 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.355 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.355 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:44.355 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:44.355 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.355 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.355 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.355 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.355 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.355 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.355 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.356 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.356 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.356 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.356 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.356 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.356 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:44.356 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:44.356 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.356 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.356 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.356 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:44.357 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.357 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.357 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.357 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:44.357 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:44.357 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:44.357 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.357 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:44.357 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:44.357 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.357 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.358 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.358 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.358 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.358 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.358 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:44.358 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:44.358 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.358 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.358 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.358 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.358 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.359 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.359 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.359 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.359 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.359 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.359 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.359 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.359 INFO:teuthology.orchestra.run.smithi082.stdout: "password": { 2023-09-23T09:48:44.359 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "password", 2023-09-23T09:48:44.359 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.359 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.360 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.360 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.360 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.360 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.360 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.360 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "password of InfluxDB server user", 2023-09-23T09:48:44.360 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.360 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.360 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.360 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.361 INFO:teuthology.orchestra.run.smithi082.stdout: "port": { 2023-09-23T09:48:44.361 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "port", 2023-09-23T09:48:44.361 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:44.361 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.361 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.361 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "8086", 2023-09-23T09:48:44.361 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.361 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.361 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.361 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "InfluxDB server port", 2023-09-23T09:48:44.361 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.362 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.362 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.362 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.362 INFO:teuthology.orchestra.run.smithi082.stdout: "ssl": { 2023-09-23T09:48:44.362 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ssl", 2023-09-23T09:48:44.362 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.362 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.362 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.362 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "false", 2023-09-23T09:48:44.362 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.362 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.362 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.363 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-09-23T09:48:44.363 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.363 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.363 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.363 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.363 INFO:teuthology.orchestra.run.smithi082.stdout: "threads": { 2023-09-23T09:48:44.363 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "threads", 2023-09-23T09:48:44.363 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:44.363 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.363 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.363 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "5", 2023-09-23T09:48:44.364 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "1", 2023-09-23T09:48:44.364 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "32", 2023-09-23T09:48:44.364 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.364 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-09-23T09:48:44.364 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.364 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.364 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.364 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.364 INFO:teuthology.orchestra.run.smithi082.stdout: "username": { 2023-09-23T09:48:44.364 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "username", 2023-09-23T09:48:44.365 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.365 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.365 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.365 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.365 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.365 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.365 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.365 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "username of InfluxDB server user", 2023-09-23T09:48:44.365 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.365 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.365 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.365 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.366 INFO:teuthology.orchestra.run.smithi082.stdout: "verify_ssl": { 2023-09-23T09:48:44.366 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "verify_ssl", 2023-09-23T09:48:44.366 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.366 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.366 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.366 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "true", 2023-09-23T09:48:44.366 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.366 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.366 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.366 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-09-23T09:48:44.367 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.367 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.367 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.367 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.367 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.367 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.367 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:44.367 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "insights", 2023-09-23T09:48:44.367 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:44.367 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:44.367 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:44.367 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:44.368 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:44.368 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.368 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.368 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.368 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.368 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.368 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.368 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.368 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:44.369 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:44.369 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:44.369 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.369 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:44.369 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:44.369 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.369 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.369 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.369 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.369 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.370 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.370 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:44.370 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:44.370 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.370 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.370 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.370 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.370 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.370 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.370 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.370 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.371 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.371 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.371 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.371 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.371 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:44.371 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:44.371 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.371 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.371 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.371 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:44.371 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.371 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.372 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.372 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:44.372 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:44.372 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:44.372 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.372 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:44.372 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:44.372 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.372 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.372 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.372 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.373 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.373 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.373 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:44.373 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:44.373 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.373 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.373 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.373 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.373 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.373 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.373 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.373 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.374 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.374 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.374 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.374 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.374 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.374 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.374 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:44.374 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "iostat", 2023-09-23T09:48:44.374 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:44.374 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:44.374 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:44.374 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:44.375 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:44.375 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.375 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.375 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.375 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.375 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.375 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.375 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.375 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:44.376 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:44.376 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:44.376 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.376 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:44.376 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:44.376 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.376 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.376 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.376 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.376 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.377 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.377 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:44.377 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:44.377 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.377 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.377 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.377 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.377 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.377 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.377 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.377 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.378 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.378 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.378 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.378 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.378 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:44.378 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:44.378 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.378 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.378 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.378 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:44.378 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.379 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.379 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.379 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:44.379 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:44.379 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:44.379 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.379 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:44.379 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:44.379 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.379 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.380 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.380 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.380 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.380 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.380 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:44.380 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:44.380 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.380 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.380 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.380 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.380 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.381 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.381 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.381 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.381 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.381 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.381 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.381 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.381 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.381 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.381 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:44.382 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "k8sevents", 2023-09-23T09:48:44.382 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:44.382 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:44.382 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:44.382 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_event_retention_days": { 2023-09-23T09:48:44.382 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ceph_event_retention_days", 2023-09-23T09:48:44.382 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:44.382 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.382 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.382 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "7", 2023-09-23T09:48:44.382 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.383 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.383 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.383 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Days to hold ceph event information within local cache", 2023-09-23T09:48:44.383 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.383 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.383 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.383 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.383 INFO:teuthology.orchestra.run.smithi082.stdout: "config_check_secs": { 2023-09-23T09:48:44.383 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "config_check_secs", 2023-09-23T09:48:44.383 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:44.383 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.384 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.384 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2023-09-23T09:48:44.384 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "10", 2023-09-23T09:48:44.384 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.384 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.384 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2023-09-23T09:48:44.384 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.384 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.384 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.384 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.384 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:44.384 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:44.384 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.385 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.385 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.385 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.385 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.385 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.385 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.385 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:44.385 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:44.385 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:44.385 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.386 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:44.386 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:44.386 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.386 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.386 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.386 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.386 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.386 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.386 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:44.386 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:44.386 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.387 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.387 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.387 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.387 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.387 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.387 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.387 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.387 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.387 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.387 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.388 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.388 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:44.388 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:44.388 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.388 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.388 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.388 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:44.388 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.388 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.388 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.389 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:44.389 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:44.389 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:44.389 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.389 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:44.389 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:44.389 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.389 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.389 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.389 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.390 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.390 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.390 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:44.390 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:44.390 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.390 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.390 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.390 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.390 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.390 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.391 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.391 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.391 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.391 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.391 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.391 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.391 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.391 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.391 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:44.391 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "localpool", 2023-09-23T09:48:44.391 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:44.391 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:44.392 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:44.392 INFO:teuthology.orchestra.run.smithi082.stdout: "failure_domain": { 2023-09-23T09:48:44.392 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "failure_domain", 2023-09-23T09:48:44.392 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.392 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.392 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.392 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "host", 2023-09-23T09:48:44.392 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.392 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.392 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.392 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "failure domain for any created local pool", 2023-09-23T09:48:44.392 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-09-23T09:48:44.393 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.393 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.393 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.393 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:44.393 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:44.393 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.393 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.393 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.393 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.393 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.393 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.393 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.394 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:44.394 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:44.394 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:44.394 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.394 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:44.394 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:44.394 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.394 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.394 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.394 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.394 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.394 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.395 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:44.395 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:44.395 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.395 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.395 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.395 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.395 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.395 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.395 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.395 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.395 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.395 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.396 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.396 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.396 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:44.396 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:44.396 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.396 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.396 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.396 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:44.396 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.396 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.396 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.396 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:44.397 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:44.397 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:44.397 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.397 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:44.397 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:44.397 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.397 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.397 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.397 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.397 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.397 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.397 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:44.398 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:44.398 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.398 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.398 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.398 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.398 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.398 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.398 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.398 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.398 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.398 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.398 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.399 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.399 INFO:teuthology.orchestra.run.smithi082.stdout: "min_size": { 2023-09-23T09:48:44.399 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "min_size", 2023-09-23T09:48:44.399 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:44.399 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.399 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.399 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.399 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.399 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.399 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.399 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "default min_size for any created local pool", 2023-09-23T09:48:44.400 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-09-23T09:48:44.400 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.400 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.400 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.400 INFO:teuthology.orchestra.run.smithi082.stdout: "num_rep": { 2023-09-23T09:48:44.400 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "num_rep", 2023-09-23T09:48:44.400 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:44.400 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.400 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.400 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "3", 2023-09-23T09:48:44.400 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.400 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.401 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.401 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "default replica count for any created local pool", 2023-09-23T09:48:44.401 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.401 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.401 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.401 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.401 INFO:teuthology.orchestra.run.smithi082.stdout: "pg_num": { 2023-09-23T09:48:44.401 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "pg_num", 2023-09-23T09:48:44.401 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:44.401 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.401 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.401 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "128", 2023-09-23T09:48:44.401 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.402 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.402 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.402 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "default pg_num for any created local pool", 2023-09-23T09:48:44.402 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.402 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.402 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.402 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.402 INFO:teuthology.orchestra.run.smithi082.stdout: "prefix": { 2023-09-23T09:48:44.402 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "prefix", 2023-09-23T09:48:44.402 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.402 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.403 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.403 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.403 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.403 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.403 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.403 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "name prefix for any created local pool", 2023-09-23T09:48:44.403 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.403 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.403 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.403 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.403 INFO:teuthology.orchestra.run.smithi082.stdout: "subtree": { 2023-09-23T09:48:44.403 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "subtree", 2023-09-23T09:48:44.403 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.404 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.404 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.404 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "rack", 2023-09-23T09:48:44.404 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.404 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.404 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.404 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "CRUSH level for which to create a local pool", 2023-09-23T09:48:44.404 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-09-23T09:48:44.404 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.404 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.404 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.405 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.405 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.405 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:44.405 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mds_autoscaler", 2023-09-23T09:48:44.405 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:44.405 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:44.405 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:44.405 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:44.405 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:44.405 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.405 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.405 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.406 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.406 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.406 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.406 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.406 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:44.406 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:44.406 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:44.406 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.406 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:44.406 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:44.406 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.406 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.407 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.407 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.407 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.407 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.407 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:44.407 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:44.407 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.407 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.407 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.407 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.407 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.407 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.408 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.408 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.408 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.408 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.408 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.408 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.408 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:44.408 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:44.408 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.408 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.408 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.408 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:44.409 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.409 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.409 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.409 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:44.409 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:44.409 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:44.409 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.409 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:44.409 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:44.409 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.409 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.409 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.410 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.410 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.410 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.410 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:44.410 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:44.410 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.410 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.410 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.410 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.410 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.410 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.410 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.411 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.411 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.411 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.411 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.411 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.411 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.411 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.411 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:44.411 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mirroring", 2023-09-23T09:48:44.411 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:44.411 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:44.411 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:44.412 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:44.412 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:44.412 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.412 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.412 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.412 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.412 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.412 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.412 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.413 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:44.413 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:44.413 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:44.413 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.413 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:44.413 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:44.413 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.413 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.414 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.414 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.414 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.414 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.414 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:44.414 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:44.414 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.414 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.414 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.414 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.414 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.414 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.415 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.415 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.415 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.415 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.415 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.415 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.415 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:44.415 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:44.415 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.415 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.415 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.415 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:44.416 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.416 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.416 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.416 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:44.416 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:44.416 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:44.416 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.416 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:44.416 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:44.416 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.416 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.417 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.417 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.417 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.417 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.417 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:44.417 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:44.417 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.417 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.417 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.417 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.417 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.418 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.418 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.418 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.418 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.418 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.418 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.418 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.418 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.418 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.418 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:44.418 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "nfs", 2023-09-23T09:48:44.419 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:44.419 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:44.419 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:44.419 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:44.419 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:44.419 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.419 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.419 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.419 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.419 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.419 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.419 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.420 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:44.420 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:44.420 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:44.420 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.420 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:44.420 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:44.420 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.420 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.420 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.420 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.420 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.420 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.421 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:44.421 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:44.421 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.421 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.421 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.421 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.421 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.421 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.421 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.421 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.421 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.421 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.422 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.422 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.422 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:44.422 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:44.422 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.422 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.422 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.422 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:44.422 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.422 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.422 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.423 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:44.423 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:44.423 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:44.423 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.423 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:44.423 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:44.423 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.423 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.423 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.423 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.423 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.423 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.424 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:44.424 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:44.424 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.424 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.424 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.424 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.424 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.424 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.424 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.424 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.424 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.424 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.425 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.425 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.425 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.425 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.425 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:44.425 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "orchestrator", 2023-09-23T09:48:44.425 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:44.425 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:44.425 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:44.425 INFO:teuthology.orchestra.run.smithi082.stdout: "fail_fs": { 2023-09-23T09:48:44.425 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "fail_fs", 2023-09-23T09:48:44.425 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.426 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.426 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.426 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.426 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.426 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.426 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.426 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2023-09-23T09:48:44.426 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.426 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.426 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.427 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.427 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:44.427 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:44.427 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.427 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.427 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.427 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.427 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.427 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.427 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.427 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:44.427 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:44.427 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:44.427 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.428 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:44.428 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:44.428 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.428 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.428 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.428 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.428 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.428 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.428 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:44.428 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:44.428 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.428 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.428 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.429 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.429 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.429 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.429 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.429 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.429 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.429 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.429 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.429 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.429 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:44.429 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:44.429 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.429 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.430 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.430 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:44.430 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.430 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.430 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.430 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:44.430 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:44.430 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:44.430 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.430 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:44.430 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:44.430 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.431 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.431 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.431 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.431 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.431 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.431 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:44.431 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:44.431 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.431 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.431 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.431 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.431 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.431 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.432 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.432 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.432 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.432 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.432 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.432 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.432 INFO:teuthology.orchestra.run.smithi082.stdout: "orchestrator": { 2023-09-23T09:48:44.432 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "orchestrator", 2023-09-23T09:48:44.432 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.432 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.432 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.432 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.433 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.433 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.433 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.433 INFO:teuthology.orchestra.run.smithi082.stdout: "cephadm", 2023-09-23T09:48:44.433 INFO:teuthology.orchestra.run.smithi082.stdout: "rook", 2023-09-23T09:48:44.433 INFO:teuthology.orchestra.run.smithi082.stdout: "test_orchestrator" 2023-09-23T09:48:44.433 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.433 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Orchestrator backend", 2023-09-23T09:48:44.433 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.433 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.433 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.433 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.434 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.434 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.434 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:44.434 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "osd_perf_query", 2023-09-23T09:48:44.434 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:44.434 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:44.434 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:44.434 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:44.434 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:44.434 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.434 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.434 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.434 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.435 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.435 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.435 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.435 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:44.435 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:44.435 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:44.435 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.435 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:44.435 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:44.435 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.435 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.435 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.435 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.436 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.436 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.436 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:44.436 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:44.436 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.436 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.436 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.436 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.436 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.436 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.436 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.436 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.437 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.437 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.437 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.437 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.437 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:44.437 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:44.437 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.437 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.437 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.437 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:44.437 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.437 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.438 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.438 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:44.438 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:44.438 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:44.438 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.438 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:44.438 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:44.438 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.438 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.438 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.438 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.438 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.439 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.439 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:44.439 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:44.439 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.439 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.439 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.439 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.439 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.439 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.439 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.439 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.439 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.439 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.440 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.440 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.440 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.440 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.440 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:44.440 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "osd_support", 2023-09-23T09:48:44.440 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:44.440 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:44.440 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:44.440 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:44.440 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:44.440 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.440 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.440 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.441 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.441 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.441 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.441 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.441 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:44.441 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:44.441 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:44.441 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.441 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:44.441 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:44.441 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.441 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.441 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.442 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.442 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.442 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.442 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:44.442 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:44.442 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.442 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.442 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.442 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.442 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.442 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.442 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.443 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.443 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.443 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.443 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.443 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.443 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:44.443 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:44.443 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.443 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.443 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.443 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:44.443 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.443 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.444 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.444 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:44.444 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:44.444 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:44.444 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.444 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:44.444 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:44.444 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.444 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.444 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.444 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.444 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.444 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.445 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:44.445 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:44.445 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.445 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.445 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.445 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.445 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.445 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.445 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.445 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.445 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.445 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.446 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.446 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.446 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.446 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.446 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:44.446 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "pg_autoscaler", 2023-09-23T09:48:44.446 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:44.446 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:44.446 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:44.446 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:44.446 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:44.446 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.447 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.447 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.447 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.447 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.447 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.447 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.447 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:44.447 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:44.447 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:44.447 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.447 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:44.447 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:44.448 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.448 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.448 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.448 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.448 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.448 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.448 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:44.448 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:44.448 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.448 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.448 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.448 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.448 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.448 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.449 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.449 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.449 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.449 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.449 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.449 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.449 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:44.449 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:44.449 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.449 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.449 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.449 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:44.450 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.450 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.450 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.450 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:44.450 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:44.450 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:44.450 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.450 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:44.450 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:44.450 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.450 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.451 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.451 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.451 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.451 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.451 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:44.451 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:44.451 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.451 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.451 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.451 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.451 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.451 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.452 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.452 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.452 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.452 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.452 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.452 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.452 INFO:teuthology.orchestra.run.smithi082.stdout: "noautoscale": { 2023-09-23T09:48:44.452 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "noautoscale", 2023-09-23T09:48:44.452 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.452 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.452 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.452 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.452 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.453 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.453 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.453 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "global autoscale flag", 2023-09-23T09:48:44.453 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "Option to turn on/off the autoscaler for all pools", 2023-09-23T09:48:44.453 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.453 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.453 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.453 INFO:teuthology.orchestra.run.smithi082.stdout: "sleep_interval": { 2023-09-23T09:48:44.453 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sleep_interval", 2023-09-23T09:48:44.453 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2023-09-23T09:48:44.453 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.453 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.454 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "60", 2023-09-23T09:48:44.454 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.454 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.454 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.454 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.454 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.454 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.454 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.454 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.454 INFO:teuthology.orchestra.run.smithi082.stdout: "threshold": { 2023-09-23T09:48:44.454 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "threshold", 2023-09-23T09:48:44.454 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2023-09-23T09:48:44.455 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.455 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.455 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "3.0", 2023-09-23T09:48:44.455 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "1.0", 2023-09-23T09:48:44.455 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.455 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.455 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "scaling threshold", 2023-09-23T09:48:44.455 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-09-23T09:48:44.455 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.455 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.455 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.455 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.455 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.456 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:44.456 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "progress", 2023-09-23T09:48:44.456 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:44.456 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:44.456 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:44.456 INFO:teuthology.orchestra.run.smithi082.stdout: "allow_pg_recovery_event": { 2023-09-23T09:48:44.456 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "allow_pg_recovery_event", 2023-09-23T09:48:44.456 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.456 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.456 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.456 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.456 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.457 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.457 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.457 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "allow the module to show pg recovery progress", 2023-09-23T09:48:44.457 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.457 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.457 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.457 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.457 INFO:teuthology.orchestra.run.smithi082.stdout: "enabled": { 2023-09-23T09:48:44.457 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "enabled", 2023-09-23T09:48:44.457 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.457 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.457 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.457 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:44.457 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.458 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.458 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.458 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.458 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.458 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.458 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.458 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.458 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:44.458 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:44.458 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.458 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.458 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.459 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.459 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.459 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.459 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.459 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:44.459 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:44.459 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:44.459 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.459 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:44.459 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:44.459 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.459 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.459 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.459 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.460 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.460 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.460 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:44.460 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:44.460 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.460 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.460 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.460 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.460 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.460 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.460 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.460 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.460 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.461 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.461 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.461 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.461 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:44.461 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:44.461 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.461 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.461 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.461 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:44.461 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.461 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.461 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.461 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:44.462 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:44.462 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:44.462 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.462 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:44.462 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:44.462 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.462 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.462 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.462 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.462 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.462 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.462 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:44.463 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:44.463 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.463 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.463 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.463 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.463 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.463 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.463 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.463 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.463 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.463 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.463 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.463 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.464 INFO:teuthology.orchestra.run.smithi082.stdout: "max_completed_events": { 2023-09-23T09:48:44.464 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "max_completed_events", 2023-09-23T09:48:44.464 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:44.464 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.464 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.464 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "50", 2023-09-23T09:48:44.464 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.464 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.464 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.464 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "number of past completed events to remember", 2023-09-23T09:48:44.464 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.464 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.465 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.465 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.465 INFO:teuthology.orchestra.run.smithi082.stdout: "sleep_interval": { 2023-09-23T09:48:44.465 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sleep_interval", 2023-09-23T09:48:44.465 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2023-09-23T09:48:44.465 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.465 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.465 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "5", 2023-09-23T09:48:44.465 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.465 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.465 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.465 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how long the module is going to sleep", 2023-09-23T09:48:44.466 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.466 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.466 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.466 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.466 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.466 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.466 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:44.466 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "prometheus", 2023-09-23T09:48:44.466 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:44.466 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:44.466 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:44.466 INFO:teuthology.orchestra.run.smithi082.stdout: "cache": { 2023-09-23T09:48:44.467 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cache", 2023-09-23T09:48:44.467 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.467 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.467 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.467 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:44.467 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.467 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.467 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.467 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.467 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.467 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.467 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.468 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.468 INFO:teuthology.orchestra.run.smithi082.stdout: "exclude_perf_counters": { 2023-09-23T09:48:44.468 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "exclude_perf_counters", 2023-09-23T09:48:44.468 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.468 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.468 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.468 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:44.468 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.468 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.468 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.468 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Do not include perf-counters in the metrics output", 2023-09-23T09:48:44.468 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2023-09-23T09:48:44.468 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.469 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.469 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.469 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:44.469 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:44.469 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.469 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.469 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.469 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.469 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.469 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.469 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.469 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:44.469 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:44.470 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:44.470 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.470 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:44.470 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:44.470 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.470 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.470 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.470 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.470 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.470 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.470 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:44.470 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:44.471 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.471 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.471 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.471 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.471 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.471 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.471 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.471 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.471 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.471 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.471 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.471 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.471 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:44.472 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:44.472 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.472 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.472 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.472 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:44.472 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.472 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.472 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.472 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:44.472 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:44.472 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:44.472 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.472 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:44.473 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:44.473 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.473 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.473 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.473 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.473 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.473 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.473 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:44.473 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:44.473 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.473 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.473 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.473 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.474 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.474 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.474 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.474 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.474 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.474 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.474 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.474 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.474 INFO:teuthology.orchestra.run.smithi082.stdout: "rbd_stats_pools": { 2023-09-23T09:48:44.474 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rbd_stats_pools", 2023-09-23T09:48:44.474 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.475 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.475 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.475 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.475 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.475 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.475 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.475 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.475 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.475 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.475 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.475 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.475 INFO:teuthology.orchestra.run.smithi082.stdout: "rbd_stats_pools_refresh_interval": { 2023-09-23T09:48:44.475 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-09-23T09:48:44.476 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:44.476 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.476 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.476 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "300", 2023-09-23T09:48:44.476 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.476 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.476 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.476 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.476 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.476 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.476 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.476 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.477 INFO:teuthology.orchestra.run.smithi082.stdout: "scrape_interval": { 2023-09-23T09:48:44.477 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "scrape_interval", 2023-09-23T09:48:44.477 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2023-09-23T09:48:44.477 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.477 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.477 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "15.0", 2023-09-23T09:48:44.477 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.477 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.477 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.477 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.477 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.477 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.477 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.477 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.478 INFO:teuthology.orchestra.run.smithi082.stdout: "server_addr": { 2023-09-23T09:48:44.478 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_addr", 2023-09-23T09:48:44.478 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.478 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.478 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.478 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "::", 2023-09-23T09:48:44.478 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.478 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.478 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.478 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-09-23T09:48:44.478 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.478 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.479 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.479 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.479 INFO:teuthology.orchestra.run.smithi082.stdout: "server_port": { 2023-09-23T09:48:44.479 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_port", 2023-09-23T09:48:44.479 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:44.479 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.479 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.479 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "9283", 2023-09-23T09:48:44.479 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.479 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.479 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.479 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-09-23T09:48:44.479 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.480 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.480 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.480 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.480 INFO:teuthology.orchestra.run.smithi082.stdout: "stale_cache_strategy": { 2023-09-23T09:48:44.480 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "stale_cache_strategy", 2023-09-23T09:48:44.480 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.480 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.480 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.480 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "log", 2023-09-23T09:48:44.480 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.480 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.480 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.480 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.481 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.481 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.481 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.481 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.481 INFO:teuthology.orchestra.run.smithi082.stdout: "standby_behaviour": { 2023-09-23T09:48:44.481 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "standby_behaviour", 2023-09-23T09:48:44.481 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.481 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.481 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.481 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "default", 2023-09-23T09:48:44.481 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.481 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.482 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.482 INFO:teuthology.orchestra.run.smithi082.stdout: "default", 2023-09-23T09:48:44.482 INFO:teuthology.orchestra.run.smithi082.stdout: "error" 2023-09-23T09:48:44.482 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.482 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.482 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.482 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.482 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.482 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.482 INFO:teuthology.orchestra.run.smithi082.stdout: "standby_error_status_code": { 2023-09-23T09:48:44.482 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "standby_error_status_code", 2023-09-23T09:48:44.483 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:44.483 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.483 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.483 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "500", 2023-09-23T09:48:44.483 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "400", 2023-09-23T09:48:44.483 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "599", 2023-09-23T09:48:44.483 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.483 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.483 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.483 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.483 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.483 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.484 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.484 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.484 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:44.484 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rbd_support", 2023-09-23T09:48:44.484 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:44.484 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:44.484 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:44.484 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:44.484 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:44.484 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.484 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.485 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.485 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.485 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.485 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.485 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.485 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:44.485 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:44.485 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:44.485 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.485 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:44.485 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:44.485 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.486 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.486 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.486 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.486 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.486 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.486 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:44.486 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:44.486 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.486 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.486 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.486 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.486 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.487 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.487 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.487 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.487 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.487 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.487 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.487 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.487 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:44.487 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:44.487 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.487 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.487 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.488 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:44.488 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.488 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.488 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.488 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:44.488 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:44.488 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:44.488 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.488 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:44.488 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:44.488 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.488 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.488 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.489 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.489 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.489 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.489 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:44.489 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:44.489 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.489 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.489 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.489 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.489 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.489 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.489 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.489 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.490 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.490 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.490 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.490 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.490 INFO:teuthology.orchestra.run.smithi082.stdout: "max_concurrent_snap_create": { 2023-09-23T09:48:44.490 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "max_concurrent_snap_create", 2023-09-23T09:48:44.490 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:44.490 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.490 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.490 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2023-09-23T09:48:44.490 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.490 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.491 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.491 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.491 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.491 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.491 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.491 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.491 INFO:teuthology.orchestra.run.smithi082.stdout: "mirror_snapshot_schedule": { 2023-09-23T09:48:44.491 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mirror_snapshot_schedule", 2023-09-23T09:48:44.491 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.491 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.491 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.491 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.491 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.492 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.492 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.492 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.492 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.492 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.492 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.492 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.492 INFO:teuthology.orchestra.run.smithi082.stdout: "trash_purge_schedule": { 2023-09-23T09:48:44.492 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "trash_purge_schedule", 2023-09-23T09:48:44.492 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.492 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.492 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.492 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.493 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.493 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.493 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.493 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.493 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.493 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.493 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.493 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.493 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.493 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.493 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:44.493 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "restful", 2023-09-23T09:48:44.494 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:44.494 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:44.494 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:44.494 INFO:teuthology.orchestra.run.smithi082.stdout: "enable_auth": { 2023-09-23T09:48:44.494 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "enable_auth", 2023-09-23T09:48:44.494 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.494 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.494 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.494 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:44.494 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.494 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.494 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.494 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.495 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.495 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.495 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.495 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.495 INFO:teuthology.orchestra.run.smithi082.stdout: "key_file": { 2023-09-23T09:48:44.495 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "key_file", 2023-09-23T09:48:44.495 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.495 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.495 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.495 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.495 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.495 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.496 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.496 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.496 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.496 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.496 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.496 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.496 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:44.496 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:44.496 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.496 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.496 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.497 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.497 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.497 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.497 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.497 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:44.497 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:44.497 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:44.497 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.497 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:44.497 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:44.497 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.497 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.497 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.498 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.498 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.498 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.498 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:44.498 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:44.498 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.498 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.498 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.498 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.498 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.498 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.498 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.499 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.499 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.499 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.499 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.499 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.499 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:44.499 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:44.499 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.499 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.499 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.499 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:44.499 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.499 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.499 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.500 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:44.500 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:44.500 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:44.500 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.500 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:44.500 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:44.500 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.500 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.500 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.500 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.500 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.500 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.501 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:44.501 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:44.501 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.501 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.501 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.501 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.501 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.501 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.501 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.501 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.501 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.502 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.502 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.502 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.502 INFO:teuthology.orchestra.run.smithi082.stdout: "server_addr": { 2023-09-23T09:48:44.502 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_addr", 2023-09-23T09:48:44.502 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.502 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.502 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.502 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.502 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.502 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.502 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.503 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.503 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.503 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.503 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.503 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.503 INFO:teuthology.orchestra.run.smithi082.stdout: "server_port": { 2023-09-23T09:48:44.503 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_port", 2023-09-23T09:48:44.503 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.503 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.503 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.503 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.504 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.504 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.504 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.504 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.504 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.504 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.504 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.504 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.504 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.504 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.504 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:44.504 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rgw", 2023-09-23T09:48:44.505 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:44.505 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:44.505 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:44.505 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:44.505 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:44.505 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.505 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.505 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.505 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.505 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.505 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.505 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.505 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:44.506 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:44.506 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:44.506 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.506 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:44.506 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:44.506 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.506 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.506 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.506 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.506 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.507 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.507 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:44.507 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:44.507 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.507 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.507 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.507 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.507 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.507 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.507 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.507 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.508 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.508 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.508 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.508 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.508 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:44.508 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:44.508 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.508 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.508 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.508 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:44.508 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.508 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.508 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.509 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:44.509 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:44.509 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:44.509 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.509 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:44.509 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:44.509 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.509 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.509 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.509 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.509 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.509 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.509 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:44.510 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:44.510 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.510 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.510 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.510 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.510 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.510 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.510 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.510 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.510 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.510 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.510 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.511 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.511 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.511 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.511 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:44.511 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rook", 2023-09-23T09:48:44.511 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:44.511 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:44.511 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:44.511 INFO:teuthology.orchestra.run.smithi082.stdout: "drive_group_interval": { 2023-09-23T09:48:44.511 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "drive_group_interval", 2023-09-23T09:48:44.511 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2023-09-23T09:48:44.511 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.512 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.512 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "300.0", 2023-09-23T09:48:44.512 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.512 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.512 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.512 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2023-09-23T09:48:44.512 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.512 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.512 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.512 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.512 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:44.512 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:44.512 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.513 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.513 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.513 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.513 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.513 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.513 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.513 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:44.513 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:44.513 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:44.513 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.513 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:44.513 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:44.514 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.514 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.514 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.514 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.514 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.514 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.514 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:44.514 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:44.514 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.514 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.514 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.514 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.515 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.515 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.515 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.515 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.515 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.515 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.515 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.515 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.515 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:44.515 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:44.515 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.515 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.516 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.516 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:44.516 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.516 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.516 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.516 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:44.516 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:44.516 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:44.516 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.516 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:44.516 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:44.517 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.517 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.517 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.517 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.517 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.517 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.517 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:44.517 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:44.517 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.517 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.517 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.517 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.518 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.518 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.518 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.518 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.518 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.518 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.518 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.518 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.518 INFO:teuthology.orchestra.run.smithi082.stdout: "storage_class": { 2023-09-23T09:48:44.518 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "storage_class", 2023-09-23T09:48:44.518 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.519 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.519 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.519 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "local", 2023-09-23T09:48:44.519 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.519 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.519 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.519 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "storage class name for LSO-discovered PVs", 2023-09-23T09:48:44.519 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.519 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.519 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.519 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.519 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.520 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.520 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:44.520 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "selftest", 2023-09-23T09:48:44.520 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:44.520 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:44.520 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:44.520 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:44.520 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:44.520 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.520 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.520 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.520 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.521 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.521 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.521 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.521 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:44.521 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:44.521 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:44.521 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.521 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:44.521 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:44.521 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.521 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.521 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.522 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.522 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.522 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.522 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:44.522 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:44.522 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.522 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.522 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.522 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.522 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.522 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.522 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.523 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.523 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.523 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.523 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.523 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.523 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:44.523 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:44.523 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.523 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.523 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.523 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:44.524 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.524 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.524 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.524 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:44.524 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:44.524 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:44.524 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.524 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:44.524 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:44.524 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.524 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.525 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.525 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.525 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.525 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.525 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:44.525 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:44.525 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.525 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.525 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.525 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.525 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.526 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.526 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.526 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.526 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.526 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.526 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.526 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.526 INFO:teuthology.orchestra.run.smithi082.stdout: "roption1": { 2023-09-23T09:48:44.526 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "roption1", 2023-09-23T09:48:44.526 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.527 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.527 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.527 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.527 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.527 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.527 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.527 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.527 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.527 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.527 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.527 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.527 INFO:teuthology.orchestra.run.smithi082.stdout: "roption2": { 2023-09-23T09:48:44.528 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "roption2", 2023-09-23T09:48:44.528 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.528 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.528 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.528 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "xyz", 2023-09-23T09:48:44.528 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.528 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.528 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.528 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.528 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.528 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.528 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.528 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.529 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption1": { 2023-09-23T09:48:44.529 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption1", 2023-09-23T09:48:44.529 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.529 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.529 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.529 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.529 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.529 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.529 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.529 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.529 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.529 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.530 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.530 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.530 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption2": { 2023-09-23T09:48:44.530 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption2", 2023-09-23T09:48:44.530 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:44.530 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.530 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.530 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.530 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.530 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.530 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.531 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.531 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.531 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.531 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.531 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.531 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption3": { 2023-09-23T09:48:44.531 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption3", 2023-09-23T09:48:44.531 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2023-09-23T09:48:44.531 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.531 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.532 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.532 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.532 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.532 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.532 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.532 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.532 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.532 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.532 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.532 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption4": { 2023-09-23T09:48:44.533 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption4", 2023-09-23T09:48:44.533 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.533 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.533 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.533 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.533 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.533 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.533 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.533 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.533 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.534 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.534 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.534 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.534 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption5": { 2023-09-23T09:48:44.534 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption5", 2023-09-23T09:48:44.534 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.534 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.534 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.534 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.534 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.534 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.535 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.535 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.535 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.535 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.535 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.535 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.535 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption6": { 2023-09-23T09:48:44.535 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption6", 2023-09-23T09:48:44.535 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.535 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.536 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.536 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:44.536 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.536 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.536 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.536 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.536 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.536 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.536 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.536 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.537 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption7": { 2023-09-23T09:48:44.537 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption7", 2023-09-23T09:48:44.537 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:44.537 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.537 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.537 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.537 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "1", 2023-09-23T09:48:44.537 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "42", 2023-09-23T09:48:44.537 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.537 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.538 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.538 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.538 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.538 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.538 INFO:teuthology.orchestra.run.smithi082.stdout: "testkey": { 2023-09-23T09:48:44.538 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "testkey", 2023-09-23T09:48:44.538 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.538 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.538 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.538 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.539 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.539 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.539 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.539 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.539 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.539 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.539 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.539 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.539 INFO:teuthology.orchestra.run.smithi082.stdout: "testlkey": { 2023-09-23T09:48:44.539 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "testlkey", 2023-09-23T09:48:44.539 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.539 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.540 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.540 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.540 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.540 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.540 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.540 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.540 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.540 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.540 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.540 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.540 INFO:teuthology.orchestra.run.smithi082.stdout: "testnewline": { 2023-09-23T09:48:44.541 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "testnewline", 2023-09-23T09:48:44.541 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.541 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.541 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.541 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.541 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.541 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.541 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.541 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.541 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.541 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.541 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.542 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.542 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.542 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.542 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:44.542 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "snap_schedule", 2023-09-23T09:48:44.542 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:44.542 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:44.542 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:44.542 INFO:teuthology.orchestra.run.smithi082.stdout: "allow_m_granularity": { 2023-09-23T09:48:44.542 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "allow_m_granularity", 2023-09-23T09:48:44.542 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.543 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.543 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.543 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.543 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.543 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.543 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.543 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "allow minute scheduled snapshots", 2023-09-23T09:48:44.543 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.543 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.543 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.543 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.543 INFO:teuthology.orchestra.run.smithi082.stdout: "dump_on_update": { 2023-09-23T09:48:44.544 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "dump_on_update", 2023-09-23T09:48:44.544 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.544 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.544 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.544 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.544 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.544 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.544 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.544 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "dump database to debug log on update", 2023-09-23T09:48:44.544 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.544 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.544 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.545 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.545 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:44.545 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:44.545 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.545 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.545 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.545 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.545 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.545 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.545 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.545 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:44.545 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:44.546 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:44.546 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.546 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:44.546 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:44.546 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.546 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.546 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.546 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.546 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.546 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.546 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:44.546 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:44.547 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.547 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.547 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.547 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.547 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.547 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.547 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.547 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.547 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.547 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.547 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.547 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.548 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:44.548 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:44.548 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.548 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.548 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.548 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:44.548 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.548 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.548 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.548 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:44.548 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:44.548 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:44.548 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.549 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:44.549 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:44.549 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.549 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.549 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.549 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.549 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.549 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.549 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:44.549 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:44.549 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.549 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.550 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.550 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.550 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.550 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.550 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.550 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.550 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.550 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.550 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.550 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.550 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.550 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.551 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:44.551 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "stats", 2023-09-23T09:48:44.551 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:44.551 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:44.551 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:44.551 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:44.551 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:44.551 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.551 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.551 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.551 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.551 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.552 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.552 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.552 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:44.552 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:44.552 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:44.552 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.552 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:44.552 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:44.552 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.552 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.552 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.552 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.553 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.553 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.553 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:44.553 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:44.553 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.553 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.553 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.553 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.553 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.553 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.553 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.553 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.554 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.554 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.554 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.554 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.554 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:44.554 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:44.554 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.554 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.554 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.554 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:44.554 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.554 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.555 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.555 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:44.555 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:44.555 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:44.555 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.555 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:44.555 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:44.555 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.555 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.555 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.555 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.555 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.556 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.556 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:44.556 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:44.556 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.556 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.556 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.556 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.556 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.556 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.556 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.556 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.557 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.557 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.557 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.557 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.557 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.557 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.557 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:44.557 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "status", 2023-09-23T09:48:44.557 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:44.557 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:44.557 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:44.557 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:44.557 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:44.558 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.558 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.558 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.558 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.558 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.558 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.558 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.558 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:44.558 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:44.558 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:44.558 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.559 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:44.559 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:44.559 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.559 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.559 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.559 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.559 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.559 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.559 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:44.559 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:44.559 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.559 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.559 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.560 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.560 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.560 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.560 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.560 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.560 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.560 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.560 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.560 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.560 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:44.560 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:44.560 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.561 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.561 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.561 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:44.561 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.561 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.561 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.561 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:44.561 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:44.561 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:44.561 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.561 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:44.561 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:44.562 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.562 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.562 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.562 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.562 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.562 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.562 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:44.562 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:44.562 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.562 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.562 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.563 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.563 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.563 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.563 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.563 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.563 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.563 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.563 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.563 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.563 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.563 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.563 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:44.564 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "telegraf", 2023-09-23T09:48:44.564 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:44.564 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:44.564 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:44.564 INFO:teuthology.orchestra.run.smithi082.stdout: "address": { 2023-09-23T09:48:44.564 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "address", 2023-09-23T09:48:44.564 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.564 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.564 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.564 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-09-23T09:48:44.564 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.564 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.565 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.565 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.565 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.565 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.565 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.565 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.565 INFO:teuthology.orchestra.run.smithi082.stdout: "interval": { 2023-09-23T09:48:44.565 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "interval", 2023-09-23T09:48:44.565 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2023-09-23T09:48:44.565 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.565 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.565 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "15", 2023-09-23T09:48:44.566 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.566 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.566 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.566 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.566 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.566 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.566 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.566 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.566 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:44.566 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:44.566 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.567 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.567 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.567 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.567 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.567 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.567 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.567 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:44.567 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:44.567 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:44.567 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.567 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:44.568 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:44.568 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.568 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.568 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.568 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.568 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.568 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.568 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:44.568 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:44.568 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.568 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.568 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.568 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.569 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.569 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.569 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.569 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.569 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.569 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.569 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.569 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.569 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:44.569 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:44.569 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.570 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.570 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.570 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:44.570 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.570 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.570 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.570 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:44.570 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:44.570 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:44.570 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.570 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:44.571 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:44.571 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.571 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.571 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.571 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.571 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.571 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.571 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:44.571 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:44.571 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.571 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.571 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.572 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.572 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.572 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.572 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.572 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.572 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.572 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.572 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.572 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.572 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.572 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.572 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:44.572 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "telemetry", 2023-09-23T09:48:44.573 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:44.573 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:44.573 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:44.573 INFO:teuthology.orchestra.run.smithi082.stdout: "channel_basic": { 2023-09-23T09:48:44.573 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "channel_basic", 2023-09-23T09:48:44.573 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.573 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.573 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.573 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:44.573 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.573 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.573 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.574 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Share basic cluster information (size, version)", 2023-09-23T09:48:44.574 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.574 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.574 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.574 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.574 INFO:teuthology.orchestra.run.smithi082.stdout: "channel_crash": { 2023-09-23T09:48:44.574 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "channel_crash", 2023-09-23T09:48:44.574 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.574 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.574 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.574 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:44.574 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.575 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.575 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.575 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-09-23T09:48:44.575 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.575 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.575 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.575 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.575 INFO:teuthology.orchestra.run.smithi082.stdout: "channel_device": { 2023-09-23T09:48:44.575 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "channel_device", 2023-09-23T09:48:44.575 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.575 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.575 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.576 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2023-09-23T09:48:44.576 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.576 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.576 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.576 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-09-23T09:48:44.576 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.576 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.576 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.576 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.576 INFO:teuthology.orchestra.run.smithi082.stdout: "channel_ident": { 2023-09-23T09:48:44.576 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "channel_ident", 2023-09-23T09:48:44.576 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.577 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.577 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.577 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.577 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.577 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.577 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.577 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-09-23T09:48:44.577 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.577 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.577 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.577 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.577 INFO:teuthology.orchestra.run.smithi082.stdout: "channel_perf": { 2023-09-23T09:48:44.578 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "channel_perf", 2023-09-23T09:48:44.578 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.578 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.578 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.578 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.578 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.578 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.578 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.578 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Share various performance metrics of a cluster", 2023-09-23T09:48:44.578 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.578 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.578 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.579 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.579 INFO:teuthology.orchestra.run.smithi082.stdout: "contact": { 2023-09-23T09:48:44.579 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "contact", 2023-09-23T09:48:44.579 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.579 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.579 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.579 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.579 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.579 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.579 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.579 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.579 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.580 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.580 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.580 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.580 INFO:teuthology.orchestra.run.smithi082.stdout: "description": { 2023-09-23T09:48:44.580 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "description", 2023-09-23T09:48:44.580 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.580 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.580 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.580 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.580 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.580 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.580 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.581 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.581 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.581 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.581 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.581 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.581 INFO:teuthology.orchestra.run.smithi082.stdout: "device_url": { 2023-09-23T09:48:44.581 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "device_url", 2023-09-23T09:48:44.581 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.581 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.581 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.581 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-09-23T09:48:44.581 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.582 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.582 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.582 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.582 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.582 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.582 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.582 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.582 INFO:teuthology.orchestra.run.smithi082.stdout: "enabled": { 2023-09-23T09:48:44.582 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "enabled", 2023-09-23T09:48:44.582 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.582 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.582 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.583 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.583 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.583 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.583 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.583 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.583 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.583 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.583 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.583 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.583 INFO:teuthology.orchestra.run.smithi082.stdout: "interval": { 2023-09-23T09:48:44.583 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "interval", 2023-09-23T09:48:44.583 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:44.584 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.584 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.584 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "24", 2023-09-23T09:48:44.584 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "8", 2023-09-23T09:48:44.584 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.584 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.584 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.584 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.584 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.584 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.584 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.584 INFO:teuthology.orchestra.run.smithi082.stdout: "last_opt_revision": { 2023-09-23T09:48:44.585 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "last_opt_revision", 2023-09-23T09:48:44.585 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:44.585 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.585 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.585 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "1", 2023-09-23T09:48:44.585 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.585 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.585 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.585 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.585 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.585 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.585 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.585 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.586 INFO:teuthology.orchestra.run.smithi082.stdout: "leaderboard": { 2023-09-23T09:48:44.586 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "leaderboard", 2023-09-23T09:48:44.586 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.586 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.586 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.586 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.586 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.586 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.586 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.586 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.586 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.587 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.587 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.587 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.587 INFO:teuthology.orchestra.run.smithi082.stdout: "leaderboard_description": { 2023-09-23T09:48:44.587 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "leaderboard_description", 2023-09-23T09:48:44.587 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.587 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.587 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.587 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.587 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.587 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.587 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.588 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.588 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.588 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.588 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.588 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.588 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:44.588 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:44.588 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.588 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.588 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.588 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.588 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.589 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.589 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.589 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:44.589 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:44.589 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:44.589 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.589 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:44.589 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:44.589 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.589 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.589 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.589 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.590 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.590 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.590 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:44.590 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:44.590 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.590 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.590 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.590 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.590 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.590 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.590 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.590 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.591 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.591 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.591 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.591 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.591 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:44.591 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:44.591 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.591 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.591 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.591 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:44.591 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.592 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.592 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.592 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:44.592 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:44.592 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:44.592 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.592 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:44.592 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:44.592 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.592 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.592 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.592 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.593 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.593 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.593 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:44.593 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:44.593 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.593 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.593 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.593 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.593 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.593 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.593 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.593 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.594 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.594 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.594 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.594 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.594 INFO:teuthology.orchestra.run.smithi082.stdout: "organization": { 2023-09-23T09:48:44.594 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "organization", 2023-09-23T09:48:44.594 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.594 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.594 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.594 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.594 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.594 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.594 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.595 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.595 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.595 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.595 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.595 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.595 INFO:teuthology.orchestra.run.smithi082.stdout: "proxy": { 2023-09-23T09:48:44.595 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "proxy", 2023-09-23T09:48:44.595 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.595 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.595 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.595 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.595 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.596 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.596 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.596 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.596 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.596 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.596 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.596 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.596 INFO:teuthology.orchestra.run.smithi082.stdout: "url": { 2023-09-23T09:48:44.596 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "url", 2023-09-23T09:48:44.596 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.596 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.597 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.597 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-09-23T09:48:44.597 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.597 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.597 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.597 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.597 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.597 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.597 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.597 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.597 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.597 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.597 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:44.598 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "test_orchestrator", 2023-09-23T09:48:44.598 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:44.598 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:44.598 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:44.598 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:44.598 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:44.598 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.598 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.598 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.598 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.598 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.598 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.599 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.599 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:44.599 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:44.599 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:44.599 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.599 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:44.599 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:44.599 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.599 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.599 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.599 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.599 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.600 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.600 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:44.600 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:44.600 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.600 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.600 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.600 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.600 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.600 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.600 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.600 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.600 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.601 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.601 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.601 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.601 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:44.601 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:44.601 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.601 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.601 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.601 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:44.601 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.601 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.601 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.601 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:44.602 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:44.602 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:44.602 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.602 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:44.602 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:44.602 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.602 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.602 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.602 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.602 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.602 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.602 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:44.603 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:44.603 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.603 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.603 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.603 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.603 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.603 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.603 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.603 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.603 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.603 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.603 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.604 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.604 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.604 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.604 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:44.604 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "volumes", 2023-09-23T09:48:44.604 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:44.604 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:44.604 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:44.604 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:44.604 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:44.604 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.604 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.605 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.605 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.605 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.605 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.605 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.605 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:44.605 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:44.605 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:44.605 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.605 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:44.605 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:44.605 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.606 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.606 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.606 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.606 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.606 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.606 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:44.606 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:44.606 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.606 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.606 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.607 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.607 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.607 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.607 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.607 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.607 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.607 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.607 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.607 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.607 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:44.607 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:44.608 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.608 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.608 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.608 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:44.608 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.608 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.608 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.608 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:44.608 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:44.608 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:44.608 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.608 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:44.608 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:44.609 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.609 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.609 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.609 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.609 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.609 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.609 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:44.609 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:44.609 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.609 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.609 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.609 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.609 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.610 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.610 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.610 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.610 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.610 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.610 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.610 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.610 INFO:teuthology.orchestra.run.smithi082.stdout: "max_concurrent_clones": { 2023-09-23T09:48:44.610 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "max_concurrent_clones", 2023-09-23T09:48:44.610 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:44.610 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.610 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.611 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "4", 2023-09-23T09:48:44.611 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.611 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.611 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.611 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Number of asynchronous cloner threads", 2023-09-23T09:48:44.611 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.611 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.611 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.611 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.611 INFO:teuthology.orchestra.run.smithi082.stdout: "snapshot_clone_delay": { 2023-09-23T09:48:44.611 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "snapshot_clone_delay", 2023-09-23T09:48:44.611 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:44.611 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.612 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.612 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2023-09-23T09:48:44.612 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.612 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.612 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.612 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-09-23T09:48:44.612 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.612 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.612 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.612 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.612 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.612 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.613 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:44.613 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "zabbix", 2023-09-23T09:48:44.613 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2023-09-23T09:48:44.613 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2023-09-23T09:48:44.613 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2023-09-23T09:48:44.613 INFO:teuthology.orchestra.run.smithi082.stdout: "discovery_interval": { 2023-09-23T09:48:44.613 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "discovery_interval", 2023-09-23T09:48:44.613 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "uint", 2023-09-23T09:48:44.613 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.613 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.613 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "100", 2023-09-23T09:48:44.613 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.613 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.614 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.614 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.614 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.614 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.614 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.614 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.614 INFO:teuthology.orchestra.run.smithi082.stdout: "identifier": { 2023-09-23T09:48:44.614 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "identifier", 2023-09-23T09:48:44.614 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.614 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.614 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.614 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.615 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.615 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.615 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.615 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.615 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.615 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.615 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.615 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.615 INFO:teuthology.orchestra.run.smithi082.stdout: "interval": { 2023-09-23T09:48:44.615 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "interval", 2023-09-23T09:48:44.615 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2023-09-23T09:48:44.616 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.616 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.616 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "60", 2023-09-23T09:48:44.616 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.616 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.616 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.616 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.616 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.616 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.616 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.616 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.616 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2023-09-23T09:48:44.617 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2023-09-23T09:48:44.617 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.617 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.617 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.617 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.617 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.617 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.617 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.617 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:44.617 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:44.617 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:44.617 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.617 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:44.618 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:44.618 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.618 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.618 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.618 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.618 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.618 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.618 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2023-09-23T09:48:44.618 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2023-09-23T09:48:44.618 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.618 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.618 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.619 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.619 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.619 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.619 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.619 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.619 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.619 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.619 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.619 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.619 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2023-09-23T09:48:44.619 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2023-09-23T09:48:44.619 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.619 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.619 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.620 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2023-09-23T09:48:44.620 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.620 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.620 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2023-09-23T09:48:44.620 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2023-09-23T09:48:44.620 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2023-09-23T09:48:44.620 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2023-09-23T09:48:44.620 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2023-09-23T09:48:44.620 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2023-09-23T09:48:44.620 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2023-09-23T09:48:44.620 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.620 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.621 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.621 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.621 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.621 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.621 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2023-09-23T09:48:44.621 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2023-09-23T09:48:44.621 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2023-09-23T09:48:44.621 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.621 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2023-09-23T09:48:44.621 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2023-09-23T09:48:44.621 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.621 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.622 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.622 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.622 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.622 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.622 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.622 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.622 INFO:teuthology.orchestra.run.smithi082.stdout: "zabbix_host": { 2023-09-23T09:48:44.622 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "zabbix_host", 2023-09-23T09:48:44.622 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.622 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.622 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.622 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2023-09-23T09:48:44.622 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.623 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.623 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.623 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.623 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.623 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.623 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.623 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.623 INFO:teuthology.orchestra.run.smithi082.stdout: "zabbix_port": { 2023-09-23T09:48:44.623 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "zabbix_port", 2023-09-23T09:48:44.623 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2023-09-23T09:48:44.623 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.623 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.623 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10051", 2023-09-23T09:48:44.624 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.624 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.624 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.624 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.624 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.624 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.624 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.624 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.624 INFO:teuthology.orchestra.run.smithi082.stdout: "zabbix_sender": { 2023-09-23T09:48:44.624 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "zabbix_sender", 2023-09-23T09:48:44.624 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2023-09-23T09:48:44.624 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2023-09-23T09:48:44.625 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2023-09-23T09:48:44.625 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-09-23T09:48:44.625 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2023-09-23T09:48:44.625 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2023-09-23T09:48:44.625 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2023-09-23T09:48:44.625 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2023-09-23T09:48:44.625 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2023-09-23T09:48:44.625 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2023-09-23T09:48:44.625 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2023-09-23T09:48:44.625 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.625 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.625 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.625 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.626 INFO:teuthology.orchestra.run.smithi082.stdout: "services": { 2023-09-23T09:48:44.626 INFO:teuthology.orchestra.run.smithi082.stdout: "dashboard": "https://172.21.15.82:8443/" 2023-09-23T09:48:44.626 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.626 INFO:teuthology.orchestra.run.smithi082.stdout: "always_on_modules": { 2023-09-23T09:48:44.626 INFO:teuthology.orchestra.run.smithi082.stdout: "octopus": [ 2023-09-23T09:48:44.626 INFO:teuthology.orchestra.run.smithi082.stdout: "balancer", 2023-09-23T09:48:44.626 INFO:teuthology.orchestra.run.smithi082.stdout: "crash", 2023-09-23T09:48:44.626 INFO:teuthology.orchestra.run.smithi082.stdout: "devicehealth", 2023-09-23T09:48:44.626 INFO:teuthology.orchestra.run.smithi082.stdout: "orchestrator", 2023-09-23T09:48:44.626 INFO:teuthology.orchestra.run.smithi082.stdout: "pg_autoscaler", 2023-09-23T09:48:44.626 INFO:teuthology.orchestra.run.smithi082.stdout: "progress", 2023-09-23T09:48:44.626 INFO:teuthology.orchestra.run.smithi082.stdout: "rbd_support", 2023-09-23T09:48:44.626 INFO:teuthology.orchestra.run.smithi082.stdout: "status", 2023-09-23T09:48:44.627 INFO:teuthology.orchestra.run.smithi082.stdout: "telemetry", 2023-09-23T09:48:44.627 INFO:teuthology.orchestra.run.smithi082.stdout: "volumes" 2023-09-23T09:48:44.627 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.627 INFO:teuthology.orchestra.run.smithi082.stdout: "pacific": [ 2023-09-23T09:48:44.627 INFO:teuthology.orchestra.run.smithi082.stdout: "balancer", 2023-09-23T09:48:44.627 INFO:teuthology.orchestra.run.smithi082.stdout: "crash", 2023-09-23T09:48:44.627 INFO:teuthology.orchestra.run.smithi082.stdout: "devicehealth", 2023-09-23T09:48:44.627 INFO:teuthology.orchestra.run.smithi082.stdout: "orchestrator", 2023-09-23T09:48:44.627 INFO:teuthology.orchestra.run.smithi082.stdout: "pg_autoscaler", 2023-09-23T09:48:44.627 INFO:teuthology.orchestra.run.smithi082.stdout: "progress", 2023-09-23T09:48:44.627 INFO:teuthology.orchestra.run.smithi082.stdout: "rbd_support", 2023-09-23T09:48:44.627 INFO:teuthology.orchestra.run.smithi082.stdout: "status", 2023-09-23T09:48:44.627 INFO:teuthology.orchestra.run.smithi082.stdout: "telemetry", 2023-09-23T09:48:44.628 INFO:teuthology.orchestra.run.smithi082.stdout: "volumes" 2023-09-23T09:48:44.628 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.628 INFO:teuthology.orchestra.run.smithi082.stdout: "quincy": [ 2023-09-23T09:48:44.628 INFO:teuthology.orchestra.run.smithi082.stdout: "balancer", 2023-09-23T09:48:44.628 INFO:teuthology.orchestra.run.smithi082.stdout: "crash", 2023-09-23T09:48:44.628 INFO:teuthology.orchestra.run.smithi082.stdout: "devicehealth", 2023-09-23T09:48:44.628 INFO:teuthology.orchestra.run.smithi082.stdout: "orchestrator", 2023-09-23T09:48:44.628 INFO:teuthology.orchestra.run.smithi082.stdout: "pg_autoscaler", 2023-09-23T09:48:44.628 INFO:teuthology.orchestra.run.smithi082.stdout: "progress", 2023-09-23T09:48:44.628 INFO:teuthology.orchestra.run.smithi082.stdout: "rbd_support", 2023-09-23T09:48:44.628 INFO:teuthology.orchestra.run.smithi082.stdout: "status", 2023-09-23T09:48:44.628 INFO:teuthology.orchestra.run.smithi082.stdout: "telemetry", 2023-09-23T09:48:44.628 INFO:teuthology.orchestra.run.smithi082.stdout: "volumes" 2023-09-23T09:48:44.629 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-09-23T09:48:44.629 INFO:teuthology.orchestra.run.smithi082.stdout: "reef": [ 2023-09-23T09:48:44.629 INFO:teuthology.orchestra.run.smithi082.stdout: "balancer", 2023-09-23T09:48:44.629 INFO:teuthology.orchestra.run.smithi082.stdout: "crash", 2023-09-23T09:48:44.629 INFO:teuthology.orchestra.run.smithi082.stdout: "devicehealth", 2023-09-23T09:48:44.629 INFO:teuthology.orchestra.run.smithi082.stdout: "orchestrator", 2023-09-23T09:48:44.629 INFO:teuthology.orchestra.run.smithi082.stdout: "pg_autoscaler", 2023-09-23T09:48:44.629 INFO:teuthology.orchestra.run.smithi082.stdout: "progress", 2023-09-23T09:48:44.629 INFO:teuthology.orchestra.run.smithi082.stdout: "rbd_support", 2023-09-23T09:48:44.629 INFO:teuthology.orchestra.run.smithi082.stdout: "status", 2023-09-23T09:48:44.629 INFO:teuthology.orchestra.run.smithi082.stdout: "telemetry", 2023-09-23T09:48:44.629 INFO:teuthology.orchestra.run.smithi082.stdout: "volumes" 2023-09-23T09:48:44.630 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2023-09-23T09:48:44.630 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.630 INFO:teuthology.orchestra.run.smithi082.stdout: "last_failure_osd_epoch": 89, 2023-09-23T09:48:44.630 INFO:teuthology.orchestra.run.smithi082.stdout: "active_clients": [ 2023-09-23T09:48:44.630 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:44.630 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "devicehealth", 2023-09-23T09:48:44.630 INFO:teuthology.orchestra.run.smithi082.stdout: "addrvec": [ 2023-09-23T09:48:44.630 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:44.630 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "v2", 2023-09-23T09:48:44.630 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": "172.21.15.82:0", 2023-09-23T09:48:44.630 INFO:teuthology.orchestra.run.smithi082.stdout: "nonce": 1635504261 2023-09-23T09:48:44.630 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.630 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2023-09-23T09:48:44.631 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.631 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:44.631 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "libcephsqlite", 2023-09-23T09:48:44.631 INFO:teuthology.orchestra.run.smithi082.stdout: "addrvec": [ 2023-09-23T09:48:44.631 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:44.631 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "v2", 2023-09-23T09:48:44.631 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": "172.21.15.82:0", 2023-09-23T09:48:44.631 INFO:teuthology.orchestra.run.smithi082.stdout: "nonce": 3506600961 2023-09-23T09:48:44.631 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.631 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2023-09-23T09:48:44.631 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.631 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:44.632 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rbd_support", 2023-09-23T09:48:44.632 INFO:teuthology.orchestra.run.smithi082.stdout: "addrvec": [ 2023-09-23T09:48:44.632 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:44.632 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "v2", 2023-09-23T09:48:44.632 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": "172.21.15.82:0", 2023-09-23T09:48:44.632 INFO:teuthology.orchestra.run.smithi082.stdout: "nonce": 3575872461 2023-09-23T09:48:44.632 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.632 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2023-09-23T09:48:44.632 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.632 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:44.632 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "snap_schedule", 2023-09-23T09:48:44.632 INFO:teuthology.orchestra.run.smithi082.stdout: "addrvec": [ 2023-09-23T09:48:44.632 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:44.633 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "v2", 2023-09-23T09:48:44.633 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": "172.21.15.82:0", 2023-09-23T09:48:44.633 INFO:teuthology.orchestra.run.smithi082.stdout: "nonce": 1753868006 2023-09-23T09:48:44.633 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.633 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2023-09-23T09:48:44.633 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.633 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:44.633 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "snap_schedule", 2023-09-23T09:48:44.633 INFO:teuthology.orchestra.run.smithi082.stdout: "addrvec": [ 2023-09-23T09:48:44.633 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:44.633 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "v2", 2023-09-23T09:48:44.633 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": "172.21.15.82:0", 2023-09-23T09:48:44.633 INFO:teuthology.orchestra.run.smithi082.stdout: "nonce": 969400580 2023-09-23T09:48:44.634 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.634 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2023-09-23T09:48:44.634 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:44.634 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:44.634 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "volumes", 2023-09-23T09:48:44.634 INFO:teuthology.orchestra.run.smithi082.stdout: "addrvec": [ 2023-09-23T09:48:44.634 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-09-23T09:48:44.634 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "v2", 2023-09-23T09:48:44.634 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": "172.21.15.82:0", 2023-09-23T09:48:44.634 INFO:teuthology.orchestra.run.smithi082.stdout: "nonce": 240688319 2023-09-23T09:48:44.634 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.634 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2023-09-23T09:48:44.634 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:44.635 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2023-09-23T09:48:44.635 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:48:44.636 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:48:43 smithi135 ceph-mon[99205]: pgmap v1647: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-09-23T09:48:44.636 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:48:43 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/3860715978' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-09-23T09:48:44.636 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:48:43 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/2563544777' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-09-23T09:48:44.636 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:48:44 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/1721398581' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2023-09-23T09:48:44.636 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:48:43 smithi161 ceph-mon[99580]: pgmap v1647: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-09-23T09:48:44.637 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:48:43 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/3860715978' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-09-23T09:48:44.637 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:48:43 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/2563544777' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-09-23T09:48:44.637 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:48:44 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/1721398581' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2023-09-23T09:48:44.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:43.122+0000 7f2c2539d700 1 -- 172.21.15.82:0/1721398581 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f2c080a01b0 msgr2=0x7f2c080a2670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:48:44.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:43.122+0000 7f2c2539d700 1 --2- 172.21.15.82:0/1721398581 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f2c080a01b0 0x7f2c080a2670 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2c10006010 tx=0x7f2c1000b260 comp rx=0 tx=0).stop 2023-09-23T09:48:44.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:43.122+0000 7f2c2539d700 1 -- 172.21.15.82:0/1721398581 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c20106720 msgr2=0x7f2c201a47b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:48:44.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:43.122+0000 7f2c2539d700 1 --2- 172.21.15.82:0/1721398581 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c20106720 0x7f2c201a47b0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f2c1800efc0 tx=0x7f2c1800c3a0 comp rx=0 tx=0).stop 2023-09-23T09:48:44.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:43.122+0000 7f2c2539d700 1 -- 172.21.15.82:0/1721398581 shutdown_connections 2023-09-23T09:48:44.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:43.122+0000 7f2c2539d700 1 --2- 172.21.15.82:0/1721398581 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f2c080a01b0 0x7f2c080a2670 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:44.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:43.122+0000 7f2c2539d700 1 --2- 172.21.15.82:0/1721398581 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c20106720 0x7f2c201a47b0 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:44.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:43.122+0000 7f2c2539d700 1 --2- 172.21.15.82:0/1721398581 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c20100710 0x7f2c20072c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:44.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:43.122+0000 7f2c2539d700 1 --2- 172.21.15.82:0/1721398581 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2c201010d0 0x7f2c20073160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:48:44.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:43.122+0000 7f2c2539d700 1 -- 172.21.15.82:0/1721398581 >> 172.21.15.82:0/1721398581 conn(0x7f2c200fc220 msgr2=0x7f2c20104220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:48:44.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:43.122+0000 7f2c2539d700 1 -- 172.21.15.82:0/1721398581 shutdown_connections 2023-09-23T09:48:44.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:48:43.122+0000 7f2c2539d700 1 -- 172.21.15.82:0/1721398581 wait complete. 2023-09-23T09:48:44.643 DEBUG:tasks.check_counter:Getting stats from a 2023-09-23T09:48:44.644 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- ceph daemon mds.a perf dump 2023-09-23T09:48:44.644 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:48:43 smithi082 ceph-mon[97694]: pgmap v1647: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-09-23T09:48:44.644 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:48:43 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/3860715978' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-09-23T09:48:44.644 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:48:43 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/2563544777' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-09-23T09:48:44.645 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:48:44 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/1721398581' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2023-09-23T09:48:45.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:48:45 smithi082 ceph-mon[97694]: pgmap v1648: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-09-23T09:48:45.396 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:48:45 smithi161 ceph-mon[99580]: pgmap v1648: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-09-23T09:48:45.449 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.a/config 2023-09-23T09:48:45.560 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:48:45 smithi135 ceph-mon[99205]: pgmap v1648: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-09-23T09:48:47.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:48:47 smithi082 ceph-mon[97694]: pgmap v1649: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-09-23T09:48:47.373 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:48:47.373 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-0": { 2023-09-23T09:48:47.373 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 1332, 2023-09-23T09:48:47.373 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 1334, 2023-09-23T09:48:47.373 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 12940785, 2023-09-23T09:48:47.373 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 414316, 2023-09-23T09:48:47.374 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 11, 2023-09-23T09:48:47.374 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 3, 2023-09-23T09:48:47.374 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.155137880, 2023-09-23T09:48:47.374 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.042735791, 2023-09-23T09:48:47.374 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.062376442, 2023-09-23T09:48:47.374 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.035392031, 2023-09-23T09:48:47.374 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2023-09-23T09:48:47.374 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 1332, 2023-09-23T09:48:47.374 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.125033468, 2023-09-23T09:48:47.374 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000093868 2023-09-23T09:48:47.375 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:47.375 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2023-09-23T09:48:47.375 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:47.375 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:47.375 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:47.375 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:47.375 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 0, 2023-09-23T09:48:47.375 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 0 2023-09-23T09:48:47.375 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:47.375 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-1": { 2023-09-23T09:48:47.375 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 4384, 2023-09-23T09:48:47.376 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 4250, 2023-09-23T09:48:47.376 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 16023728, 2023-09-23T09:48:47.376 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 1560638, 2023-09-23T09:48:47.376 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 6, 2023-09-23T09:48:47.376 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 3, 2023-09-23T09:48:47.376 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.495641192, 2023-09-23T09:48:47.376 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.189361374, 2023-09-23T09:48:47.376 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.169675630, 2023-09-23T09:48:47.376 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.111189013, 2023-09-23T09:48:47.376 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2023-09-23T09:48:47.376 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 4250, 2023-09-23T09:48:47.377 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.290432967, 2023-09-23T09:48:47.377 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000068337 2023-09-23T09:48:47.377 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:47.377 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2023-09-23T09:48:47.377 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:47.377 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:47.377 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:47.377 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:47.377 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 2604720, 2023-09-23T09:48:47.377 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 535888 2023-09-23T09:48:47.377 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:47.377 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-2": { 2023-09-23T09:48:47.378 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 5762, 2023-09-23T09:48:47.378 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 6413, 2023-09-23T09:48:47.378 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 7691761, 2023-09-23T09:48:47.378 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 3171257, 2023-09-23T09:48:47.378 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 9, 2023-09-23T09:48:47.378 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 5, 2023-09-23T09:48:47.378 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.659940766, 2023-09-23T09:48:47.378 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.287059649, 2023-09-23T09:48:47.378 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.144301258, 2023-09-23T09:48:47.378 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.167435734, 2023-09-23T09:48:47.378 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2023-09-23T09:48:47.378 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 6410, 2023-09-23T09:48:47.379 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.435936811, 2023-09-23T09:48:47.379 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000068008 2023-09-23T09:48:47.379 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:47.379 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2023-09-23T09:48:47.379 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:47.379 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:47.379 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:47.379 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:47.379 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 480, 2023-09-23T09:48:47.379 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 1380208 2023-09-23T09:48:47.379 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:47.379 INFO:teuthology.orchestra.run.smithi082.stdout: "cct": { 2023-09-23T09:48:47.380 INFO:teuthology.orchestra.run.smithi082.stdout: "total_workers": 1, 2023-09-23T09:48:47.380 INFO:teuthology.orchestra.run.smithi082.stdout: "unhealthy_workers": 0 2023-09-23T09:48:47.380 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:47.380 INFO:teuthology.orchestra.run.smithi082.stdout: "finisher-MDSRank": { 2023-09-23T09:48:47.380 INFO:teuthology.orchestra.run.smithi082.stdout: "queue_len": 0, 2023-09-23T09:48:47.380 INFO:teuthology.orchestra.run.smithi082.stdout: "complete_latency": { 2023-09-23T09:48:47.380 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 17350, 2023-09-23T09:48:47.380 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.452973851, 2023-09-23T09:48:47.380 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000026108 2023-09-23T09:48:47.380 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:47.380 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:47.380 INFO:teuthology.orchestra.run.smithi082.stdout: "finisher-PurgeQueue": { 2023-09-23T09:48:47.381 INFO:teuthology.orchestra.run.smithi082.stdout: "queue_len": 0, 2023-09-23T09:48:47.381 INFO:teuthology.orchestra.run.smithi082.stdout: "complete_latency": { 2023-09-23T09:48:47.381 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:47.381 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:47.381 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:47.381 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:47.381 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:47.381 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": { 2023-09-23T09:48:47.381 INFO:teuthology.orchestra.run.smithi082.stdout: "request": 0, 2023-09-23T09:48:47.381 INFO:teuthology.orchestra.run.smithi082.stdout: "reply": 0, 2023-09-23T09:48:47.381 INFO:teuthology.orchestra.run.smithi082.stdout: "reply_latency": { 2023-09-23T09:48:47.381 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:47.381 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:47.382 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:47.382 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:47.382 INFO:teuthology.orchestra.run.smithi082.stdout: "slow_reply": 0, 2023-09-23T09:48:47.382 INFO:teuthology.orchestra.run.smithi082.stdout: "forward": 0, 2023-09-23T09:48:47.382 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_fetch_complete": 0, 2023-09-23T09:48:47.382 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_fetch_keys": 0, 2023-09-23T09:48:47.382 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_commit": 0, 2023-09-23T09:48:47.382 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_split": 0, 2023-09-23T09:48:47.382 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_merge": 0, 2023-09-23T09:48:47.382 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes": 649, 2023-09-23T09:48:47.382 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_top": 137, 2023-09-23T09:48:47.383 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_bottom": 252, 2023-09-23T09:48:47.383 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_pin_tail": 260, 2023-09-23T09:48:47.383 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_pinned": 453, 2023-09-23T09:48:47.383 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_expired": 1, 2023-09-23T09:48:47.383 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_with_caps": 0, 2023-09-23T09:48:47.383 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": 0, 2023-09-23T09:48:47.383 INFO:teuthology.orchestra.run.smithi082.stdout: "subtrees": 9, 2023-09-23T09:48:47.383 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse": 0, 2023-09-23T09:48:47.383 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_hit": 0, 2023-09-23T09:48:47.383 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_forward": 0, 2023-09-23T09:48:47.383 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_discover": 0, 2023-09-23T09:48:47.383 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_dir_fetch": 0, 2023-09-23T09:48:47.383 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_remote_ino": 0, 2023-09-23T09:48:47.384 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_lock": 0, 2023-09-23T09:48:47.384 INFO:teuthology.orchestra.run.smithi082.stdout: "load_cent": 0, 2023-09-23T09:48:47.384 INFO:teuthology.orchestra.run.smithi082.stdout: "q": 0, 2023-09-23T09:48:47.384 INFO:teuthology.orchestra.run.smithi082.stdout: "exported": 0, 2023-09-23T09:48:47.384 INFO:teuthology.orchestra.run.smithi082.stdout: "exported_inodes": 0, 2023-09-23T09:48:47.384 INFO:teuthology.orchestra.run.smithi082.stdout: "imported": 0, 2023-09-23T09:48:47.384 INFO:teuthology.orchestra.run.smithi082.stdout: "imported_inodes": 0, 2023-09-23T09:48:47.384 INFO:teuthology.orchestra.run.smithi082.stdout: "openino_dir_fetch": 0, 2023-09-23T09:48:47.384 INFO:teuthology.orchestra.run.smithi082.stdout: "openino_backtrace_fetch": 0, 2023-09-23T09:48:47.384 INFO:teuthology.orchestra.run.smithi082.stdout: "openino_peer_discover": 0, 2023-09-23T09:48:47.384 INFO:teuthology.orchestra.run.smithi082.stdout: "root_rfiles": 0, 2023-09-23T09:48:47.384 INFO:teuthology.orchestra.run.smithi082.stdout: "root_rbytes": 0, 2023-09-23T09:48:47.385 INFO:teuthology.orchestra.run.smithi082.stdout: "root_rsnaps": 0, 2023-09-23T09:48:47.385 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_backtrace_fetch": 0, 2023-09-23T09:48:47.385 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_set_tag": 0, 2023-09-23T09:48:47.385 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_backtrace_repaired": 0, 2023-09-23T09:48:47.385 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_inotable_repaired": 0, 2023-09-23T09:48:47.385 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_dir_inodes": 0, 2023-09-23T09:48:47.385 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_dir_base_inodes": 0, 2023-09-23T09:48:47.385 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_dirfrag_rstats": 0, 2023-09-23T09:48:47.385 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_file_inodes": 0, 2023-09-23T09:48:47.385 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_inode_file_caps": 0, 2023-09-23T09:48:47.385 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_revoke": 0, 2023-09-23T09:48:47.385 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_grant": 0, 2023-09-23T09:48:47.386 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_trunc": 0, 2023-09-23T09:48:47.386 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-09-23T09:48:47.386 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_flush_ack": 0, 2023-09-23T09:48:47.386 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_caps": 0, 2023-09-23T09:48:47.386 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_caps_dirty": 0, 2023-09-23T09:48:47.386 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_cap_release": 0, 2023-09-23T09:48:47.386 INFO:teuthology.orchestra.run.smithi082.stdout: "process_request_cap_release": 0 2023-09-23T09:48:47.386 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:47.386 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_cache": { 2023-09-23T09:48:47.386 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_update": 0, 2023-09-23T09:48:47.386 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_update_receipt": 0, 2023-09-23T09:48:47.387 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_try_discover": 0, 2023-09-23T09:48:47.387 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_send_discover": 0, 2023-09-23T09:48:47.387 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_handle_discover": 0, 2023-09-23T09:48:47.387 INFO:teuthology.orchestra.run.smithi082.stdout: "num_strays": 0, 2023-09-23T09:48:47.387 INFO:teuthology.orchestra.run.smithi082.stdout: "num_strays_delayed": 0, 2023-09-23T09:48:47.387 INFO:teuthology.orchestra.run.smithi082.stdout: "num_strays_enqueuing": 0, 2023-09-23T09:48:47.387 INFO:teuthology.orchestra.run.smithi082.stdout: "strays_created": 0, 2023-09-23T09:48:47.387 INFO:teuthology.orchestra.run.smithi082.stdout: "strays_enqueued": 0, 2023-09-23T09:48:47.387 INFO:teuthology.orchestra.run.smithi082.stdout: "strays_reintegrated": 0, 2023-09-23T09:48:47.387 INFO:teuthology.orchestra.run.smithi082.stdout: "strays_migrated": 0, 2023-09-23T09:48:47.387 INFO:teuthology.orchestra.run.smithi082.stdout: "num_recovering_processing": 0, 2023-09-23T09:48:47.387 INFO:teuthology.orchestra.run.smithi082.stdout: "num_recovering_enqueued": 0, 2023-09-23T09:48:47.388 INFO:teuthology.orchestra.run.smithi082.stdout: "num_recovering_prioritized": 0, 2023-09-23T09:48:47.388 INFO:teuthology.orchestra.run.smithi082.stdout: "recovery_started": 0, 2023-09-23T09:48:47.388 INFO:teuthology.orchestra.run.smithi082.stdout: "recovery_completed": 0, 2023-09-23T09:48:47.388 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_enqueue_scrub": 0, 2023-09-23T09:48:47.388 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_exportdir": 0, 2023-09-23T09:48:47.388 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_flush": 0, 2023-09-23T09:48:47.388 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_fragmentdir": 0, 2023-09-23T09:48:47.388 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_fragstats": 0, 2023-09-23T09:48:47.388 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_inodestats": 0 2023-09-23T09:48:47.388 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:47.388 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_log": { 2023-09-23T09:48:47.388 INFO:teuthology.orchestra.run.smithi082.stdout: "evlrg": 0, 2023-09-23T09:48:47.388 INFO:teuthology.orchestra.run.smithi082.stdout: "evadd": 0, 2023-09-23T09:48:47.389 INFO:teuthology.orchestra.run.smithi082.stdout: "evex": 0, 2023-09-23T09:48:47.389 INFO:teuthology.orchestra.run.smithi082.stdout: "evtrm": 0, 2023-09-23T09:48:47.389 INFO:teuthology.orchestra.run.smithi082.stdout: "ev": 9806, 2023-09-23T09:48:47.389 INFO:teuthology.orchestra.run.smithi082.stdout: "evexg": 0, 2023-09-23T09:48:47.389 INFO:teuthology.orchestra.run.smithi082.stdout: "evexd": 0, 2023-09-23T09:48:47.389 INFO:teuthology.orchestra.run.smithi082.stdout: "segadd": 0, 2023-09-23T09:48:47.389 INFO:teuthology.orchestra.run.smithi082.stdout: "segex": 0, 2023-09-23T09:48:47.389 INFO:teuthology.orchestra.run.smithi082.stdout: "segtrm": 0, 2023-09-23T09:48:47.389 INFO:teuthology.orchestra.run.smithi082.stdout: "seg": 15, 2023-09-23T09:48:47.389 INFO:teuthology.orchestra.run.smithi082.stdout: "segmjr": 2, 2023-09-23T09:48:47.389 INFO:teuthology.orchestra.run.smithi082.stdout: "segexg": 0, 2023-09-23T09:48:47.389 INFO:teuthology.orchestra.run.smithi082.stdout: "segexd": 0, 2023-09-23T09:48:47.389 INFO:teuthology.orchestra.run.smithi082.stdout: "expos": 4194304, 2023-09-23T09:48:47.390 INFO:teuthology.orchestra.run.smithi082.stdout: "wrpos": 35325545, 2023-09-23T09:48:47.390 INFO:teuthology.orchestra.run.smithi082.stdout: "rdpos": 35325484, 2023-09-23T09:48:47.390 INFO:teuthology.orchestra.run.smithi082.stdout: "jlat": { 2023-09-23T09:48:47.390 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:47.390 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:47.390 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:47.390 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:47.390 INFO:teuthology.orchestra.run.smithi082.stdout: "replayed": 9806 2023-09-23T09:48:47.390 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:47.390 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_mem": { 2023-09-23T09:48:47.390 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 306, 2023-09-23T09:48:47.390 INFO:teuthology.orchestra.run.smithi082.stdout: "ino+": 828, 2023-09-23T09:48:47.391 INFO:teuthology.orchestra.run.smithi082.stdout: "ino-": 522, 2023-09-23T09:48:47.391 INFO:teuthology.orchestra.run.smithi082.stdout: "dir": 25, 2023-09-23T09:48:47.391 INFO:teuthology.orchestra.run.smithi082.stdout: "dir+": 46, 2023-09-23T09:48:47.391 INFO:teuthology.orchestra.run.smithi082.stdout: "dir-": 21, 2023-09-23T09:48:47.391 INFO:teuthology.orchestra.run.smithi082.stdout: "dn": 649, 2023-09-23T09:48:47.391 INFO:teuthology.orchestra.run.smithi082.stdout: "dn+": 1701, 2023-09-23T09:48:47.391 INFO:teuthology.orchestra.run.smithi082.stdout: "dn-": 1052, 2023-09-23T09:48:47.391 INFO:teuthology.orchestra.run.smithi082.stdout: "cap": 0, 2023-09-23T09:48:47.391 INFO:teuthology.orchestra.run.smithi082.stdout: "cap+": 0, 2023-09-23T09:48:47.391 INFO:teuthology.orchestra.run.smithi082.stdout: "cap-": 0, 2023-09-23T09:48:47.391 INFO:teuthology.orchestra.run.smithi082.stdout: "rss": 52984, 2023-09-23T09:48:47.391 INFO:teuthology.orchestra.run.smithi082.stdout: "heap": 207152 2023-09-23T09:48:47.391 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:47.392 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_server": { 2023-09-23T09:48:47.392 INFO:teuthology.orchestra.run.smithi082.stdout: "dispatch_client_request": 0, 2023-09-23T09:48:47.392 INFO:teuthology.orchestra.run.smithi082.stdout: "dispatch_server_request": 0, 2023-09-23T09:48:47.392 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_request": 0, 2023-09-23T09:48:47.392 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_session": 0, 2023-09-23T09:48:47.392 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_peer_request": 0, 2023-09-23T09:48:47.392 INFO:teuthology.orchestra.run.smithi082.stdout: "req_create_latency": { 2023-09-23T09:48:47.392 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:47.392 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:47.392 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:47.392 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:47.392 INFO:teuthology.orchestra.run.smithi082.stdout: "req_getattr_latency": { 2023-09-23T09:48:47.392 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:47.393 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:47.393 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:47.393 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:47.393 INFO:teuthology.orchestra.run.smithi082.stdout: "req_getfilelock_latency": { 2023-09-23T09:48:47.393 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:47.393 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:47.393 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:47.393 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:47.393 INFO:teuthology.orchestra.run.smithi082.stdout: "req_link_latency": { 2023-09-23T09:48:47.393 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:47.393 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:47.393 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:47.394 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:47.394 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookup_latency": { 2023-09-23T09:48:47.394 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:47.394 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:47.394 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:47.394 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:47.394 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookuphash_latency": { 2023-09-23T09:48:47.394 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:47.394 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:47.394 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:47.394 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:47.394 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookupino_latency": { 2023-09-23T09:48:47.395 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:47.395 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:47.395 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:47.395 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:47.395 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookupname_latency": { 2023-09-23T09:48:47.395 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:47.395 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:47.395 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:47.395 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:47.395 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookupparent_latency": { 2023-09-23T09:48:47.395 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:47.395 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:47.396 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:47.396 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:47.396 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookupsnap_latency": { 2023-09-23T09:48:47.396 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:47.396 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:47.396 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:47.396 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:47.396 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lssnap_latency": { 2023-09-23T09:48:47.396 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:47.396 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:47.396 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:47.396 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:47.397 INFO:teuthology.orchestra.run.smithi082.stdout: "req_mkdir_latency": { 2023-09-23T09:48:47.397 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:47.397 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:47.397 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:47.397 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:47.397 INFO:teuthology.orchestra.run.smithi082.stdout: "req_mknod_latency": { 2023-09-23T09:48:47.397 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:47.397 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:47.397 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:47.397 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:47.397 INFO:teuthology.orchestra.run.smithi082.stdout: "req_mksnap_latency": { 2023-09-23T09:48:47.397 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:47.398 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:47.398 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:47.398 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:47.398 INFO:teuthology.orchestra.run.smithi082.stdout: "req_open_latency": { 2023-09-23T09:48:47.398 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:47.398 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:47.398 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:47.398 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:47.398 INFO:teuthology.orchestra.run.smithi082.stdout: "req_readdir_latency": { 2023-09-23T09:48:47.398 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:47.398 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:47.399 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:47.399 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:47.399 INFO:teuthology.orchestra.run.smithi082.stdout: "req_rename_latency": { 2023-09-23T09:48:47.399 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:47.399 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:47.399 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:47.399 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:47.399 INFO:teuthology.orchestra.run.smithi082.stdout: "req_renamesnap_latency": { 2023-09-23T09:48:47.399 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:47.399 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:47.399 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:47.399 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:47.399 INFO:teuthology.orchestra.run.smithi082.stdout: "req_snapdiff_latency": { 2023-09-23T09:48:47.400 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:47.400 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:47.400 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:47.400 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:47.400 INFO:teuthology.orchestra.run.smithi082.stdout: "req_rmdir_latency": { 2023-09-23T09:48:47.400 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:47.400 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:47.400 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:47.400 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:47.400 INFO:teuthology.orchestra.run.smithi082.stdout: "req_rmsnap_latency": { 2023-09-23T09:48:47.400 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:47.400 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:47.401 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:47.401 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:47.401 INFO:teuthology.orchestra.run.smithi082.stdout: "req_rmxattr_latency": { 2023-09-23T09:48:47.401 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:47.401 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:47.401 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:47.401 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:47.401 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setattr_latency": { 2023-09-23T09:48:47.401 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:47.401 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:47.401 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:47.401 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:47.401 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setdirlayout_latency": { 2023-09-23T09:48:47.402 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:47.402 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:47.402 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:47.402 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:47.402 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setfilelock_latency": { 2023-09-23T09:48:47.402 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:47.402 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:47.402 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:47.402 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:47.402 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setlayout_latency": { 2023-09-23T09:48:47.402 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:47.403 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:47.403 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:47.403 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:47.403 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setxattr_latency": { 2023-09-23T09:48:47.403 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:47.403 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:47.403 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:47.403 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:47.403 INFO:teuthology.orchestra.run.smithi082.stdout: "req_symlink_latency": { 2023-09-23T09:48:47.403 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:47.403 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:47.403 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:47.403 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:47.404 INFO:teuthology.orchestra.run.smithi082.stdout: "req_unlink_latency": { 2023-09-23T09:48:47.404 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:47.404 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:47.404 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:47.404 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:47.404 INFO:teuthology.orchestra.run.smithi082.stdout: "cap_revoke_eviction": 0, 2023-09-23T09:48:47.404 INFO:teuthology.orchestra.run.smithi082.stdout: "cap_acquisition_throttle": 0, 2023-09-23T09:48:47.404 INFO:teuthology.orchestra.run.smithi082.stdout: "req_getvxattr_latency": { 2023-09-23T09:48:47.404 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:47.404 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:47.404 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:47.404 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:47.405 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:47.405 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_sessions": { 2023-09-23T09:48:47.405 INFO:teuthology.orchestra.run.smithi082.stdout: "session_count": 1, 2023-09-23T09:48:47.405 INFO:teuthology.orchestra.run.smithi082.stdout: "session_add": 4, 2023-09-23T09:48:47.405 INFO:teuthology.orchestra.run.smithi082.stdout: "session_remove": 3, 2023-09-23T09:48:47.405 INFO:teuthology.orchestra.run.smithi082.stdout: "sessions_open": 3, 2023-09-23T09:48:47.405 INFO:teuthology.orchestra.run.smithi082.stdout: "sessions_stale": 0, 2023-09-23T09:48:47.405 INFO:teuthology.orchestra.run.smithi082.stdout: "total_load": 0, 2023-09-23T09:48:47.405 INFO:teuthology.orchestra.run.smithi082.stdout: "average_load": 0, 2023-09-23T09:48:47.405 INFO:teuthology.orchestra.run.smithi082.stdout: "avg_session_uptime": 8043 2023-09-23T09:48:47.405 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:47.405 INFO:teuthology.orchestra.run.smithi082.stdout: "mempool": { 2023-09-23T09:48:47.405 INFO:teuthology.orchestra.run.smithi082.stdout: "bloom_filter_bytes": 0, 2023-09-23T09:48:47.406 INFO:teuthology.orchestra.run.smithi082.stdout: "bloom_filter_items": 0, 2023-09-23T09:48:47.406 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_alloc_bytes": 0, 2023-09-23T09:48:47.406 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_alloc_items": 0, 2023-09-23T09:48:47.406 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_data_bytes": 0, 2023-09-23T09:48:47.406 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_data_items": 0, 2023-09-23T09:48:47.406 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_onode_bytes": 0, 2023-09-23T09:48:47.406 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_onode_items": 0, 2023-09-23T09:48:47.406 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_meta_bytes": 0, 2023-09-23T09:48:47.406 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_meta_items": 0, 2023-09-23T09:48:47.406 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_other_bytes": 0, 2023-09-23T09:48:47.406 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_other_items": 0, 2023-09-23T09:48:47.406 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_buffer_bytes": 0, 2023-09-23T09:48:47.407 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_buffer_items": 0, 2023-09-23T09:48:47.407 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_extent_bytes": 0, 2023-09-23T09:48:47.407 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_extent_items": 0, 2023-09-23T09:48:47.407 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_blob_bytes": 0, 2023-09-23T09:48:47.407 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_blob_items": 0, 2023-09-23T09:48:47.407 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_shared_blob_bytes": 0, 2023-09-23T09:48:47.407 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_shared_blob_items": 0, 2023-09-23T09:48:47.407 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_inline_bl_bytes": 0, 2023-09-23T09:48:47.407 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_inline_bl_items": 0, 2023-09-23T09:48:47.407 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_fsck_bytes": 0, 2023-09-23T09:48:47.407 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_fsck_items": 0, 2023-09-23T09:48:47.407 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_txc_bytes": 0, 2023-09-23T09:48:47.408 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_txc_items": 0, 2023-09-23T09:48:47.408 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_deferred_bytes": 0, 2023-09-23T09:48:47.408 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_deferred_items": 0, 2023-09-23T09:48:47.408 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_bytes": 0, 2023-09-23T09:48:47.408 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_items": 0, 2023-09-23T09:48:47.408 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_bytes": 0, 2023-09-23T09:48:47.408 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_items": 0, 2023-09-23T09:48:47.408 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_reader_bytes": 0, 2023-09-23T09:48:47.408 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_reader_items": 0, 2023-09-23T09:48:47.408 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_writer_bytes": 0, 2023-09-23T09:48:47.408 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_writer_items": 0, 2023-09-23T09:48:47.408 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_anon_bytes": 207905, 2023-09-23T09:48:47.408 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_anon_items": 65, 2023-09-23T09:48:47.409 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_meta_bytes": 0, 2023-09-23T09:48:47.409 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_meta_items": 0, 2023-09-23T09:48:47.409 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_bytes": 0, 2023-09-23T09:48:47.409 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_items": 0, 2023-09-23T09:48:47.409 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_mapbl_bytes": 0, 2023-09-23T09:48:47.409 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_mapbl_items": 0, 2023-09-23T09:48:47.409 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_pglog_bytes": 0, 2023-09-23T09:48:47.409 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_pglog_items": 0, 2023-09-23T09:48:47.409 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_bytes": 8032, 2023-09-23T09:48:47.409 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_items": 167, 2023-09-23T09:48:47.409 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_mapping_bytes": 0, 2023-09-23T09:48:47.409 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_mapping_items": 0, 2023-09-23T09:48:47.410 INFO:teuthology.orchestra.run.smithi082.stdout: "pgmap_bytes": 0, 2023-09-23T09:48:47.410 INFO:teuthology.orchestra.run.smithi082.stdout: "pgmap_items": 0, 2023-09-23T09:48:47.410 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_co_bytes": 1325348, 2023-09-23T09:48:47.410 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_co_items": 28778, 2023-09-23T09:48:47.410 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_1_bytes": 0, 2023-09-23T09:48:47.410 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_1_items": 0, 2023-09-23T09:48:47.410 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_2_bytes": 0, 2023-09-23T09:48:47.410 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_2_items": 0 2023-09-23T09:48:47.410 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:47.410 INFO:teuthology.orchestra.run.smithi082.stdout: "objecter": { 2023-09-23T09:48:47.410 INFO:teuthology.orchestra.run.smithi082.stdout: "op_active": 0, 2023-09-23T09:48:47.411 INFO:teuthology.orchestra.run.smithi082.stdout: "op_laggy": 0, 2023-09-23T09:48:47.411 INFO:teuthology.orchestra.run.smithi082.stdout: "op_send": 10386, 2023-09-23T09:48:47.411 INFO:teuthology.orchestra.run.smithi082.stdout: "op_send_bytes": 21, 2023-09-23T09:48:47.411 INFO:teuthology.orchestra.run.smithi082.stdout: "op_resend": 3, 2023-09-23T09:48:47.411 INFO:teuthology.orchestra.run.smithi082.stdout: "op_reply": 10386, 2023-09-23T09:48:47.411 INFO:teuthology.orchestra.run.smithi082.stdout: "op_latency": { 2023-09-23T09:48:47.411 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 10386, 2023-09-23T09:48:47.411 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 8.722843704, 2023-09-23T09:48:47.411 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000839865 2023-09-23T09:48:47.411 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:47.411 INFO:teuthology.orchestra.run.smithi082.stdout: "op_inflight": 0, 2023-09-23T09:48:47.411 INFO:teuthology.orchestra.run.smithi082.stdout: "oplen_avg": { 2023-09-23T09:48:47.412 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 10386, 2023-09-23T09:48:47.412 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 10387 2023-09-23T09:48:47.412 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:47.412 INFO:teuthology.orchestra.run.smithi082.stdout: "op": 10386, 2023-09-23T09:48:47.412 INFO:teuthology.orchestra.run.smithi082.stdout: "op_r": 10386, 2023-09-23T09:48:47.412 INFO:teuthology.orchestra.run.smithi082.stdout: "op_w": 0, 2023-09-23T09:48:47.412 INFO:teuthology.orchestra.run.smithi082.stdout: "op_rmw": 0, 2023-09-23T09:48:47.412 INFO:teuthology.orchestra.run.smithi082.stdout: "op_pg": 0, 2023-09-23T09:48:47.412 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_stat": 6354, 2023-09-23T09:48:47.413 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_create": 0, 2023-09-23T09:48:47.413 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_read": 4030, 2023-09-23T09:48:47.413 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_write": 0, 2023-09-23T09:48:47.413 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_writefull": 0, 2023-09-23T09:48:47.413 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_writesame": 0, 2023-09-23T09:48:47.413 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_append": 0, 2023-09-23T09:48:47.413 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_zero": 0, 2023-09-23T09:48:47.413 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_truncate": 0, 2023-09-23T09:48:47.413 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_delete": 0, 2023-09-23T09:48:47.413 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_mapext": 0, 2023-09-23T09:48:47.413 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_sparse_read": 0, 2023-09-23T09:48:47.413 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_clonerange": 0, 2023-09-23T09:48:47.414 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_getxattr": 1, 2023-09-23T09:48:47.414 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_setxattr": 0, 2023-09-23T09:48:47.414 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_cmpxattr": 0, 2023-09-23T09:48:47.414 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_rmxattr": 0, 2023-09-23T09:48:47.414 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_resetxattrs": 0, 2023-09-23T09:48:47.414 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_call": 0, 2023-09-23T09:48:47.414 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_watch": 0, 2023-09-23T09:48:47.414 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_notify": 0, 2023-09-23T09:48:47.414 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_src_cmpxattr": 0, 2023-09-23T09:48:47.414 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_pgls": 0, 2023-09-23T09:48:47.415 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_pgls_filter": 0, 2023-09-23T09:48:47.415 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_other": 0, 2023-09-23T09:48:47.415 INFO:teuthology.orchestra.run.smithi082.stdout: "linger_active": 0, 2023-09-23T09:48:47.415 INFO:teuthology.orchestra.run.smithi082.stdout: "linger_send": 0, 2023-09-23T09:48:47.415 INFO:teuthology.orchestra.run.smithi082.stdout: "linger_resend": 0, 2023-09-23T09:48:47.415 INFO:teuthology.orchestra.run.smithi082.stdout: "linger_ping": 0, 2023-09-23T09:48:47.415 INFO:teuthology.orchestra.run.smithi082.stdout: "poolop_active": 0, 2023-09-23T09:48:47.415 INFO:teuthology.orchestra.run.smithi082.stdout: "poolop_send": 0, 2023-09-23T09:48:47.415 INFO:teuthology.orchestra.run.smithi082.stdout: "poolop_resend": 0, 2023-09-23T09:48:47.415 INFO:teuthology.orchestra.run.smithi082.stdout: "poolstat_active": 0, 2023-09-23T09:48:47.415 INFO:teuthology.orchestra.run.smithi082.stdout: "poolstat_send": 0, 2023-09-23T09:48:47.415 INFO:teuthology.orchestra.run.smithi082.stdout: "poolstat_resend": 0, 2023-09-23T09:48:47.416 INFO:teuthology.orchestra.run.smithi082.stdout: "statfs_active": 0, 2023-09-23T09:48:47.416 INFO:teuthology.orchestra.run.smithi082.stdout: "statfs_send": 0, 2023-09-23T09:48:47.416 INFO:teuthology.orchestra.run.smithi082.stdout: "statfs_resend": 0, 2023-09-23T09:48:47.416 INFO:teuthology.orchestra.run.smithi082.stdout: "command_active": 0, 2023-09-23T09:48:47.416 INFO:teuthology.orchestra.run.smithi082.stdout: "command_send": 0, 2023-09-23T09:48:47.416 INFO:teuthology.orchestra.run.smithi082.stdout: "command_resend": 0, 2023-09-23T09:48:47.416 INFO:teuthology.orchestra.run.smithi082.stdout: "map_epoch": 179, 2023-09-23T09:48:47.416 INFO:teuthology.orchestra.run.smithi082.stdout: "map_full": 0, 2023-09-23T09:48:47.416 INFO:teuthology.orchestra.run.smithi082.stdout: "map_inc": 93, 2023-09-23T09:48:47.416 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_sessions": 7, 2023-09-23T09:48:47.417 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_session_open": 14, 2023-09-23T09:48:47.417 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_session_close": 7, 2023-09-23T09:48:47.417 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_laggy": 0, 2023-09-23T09:48:47.417 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_wr": 0, 2023-09-23T09:48:47.417 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_rd": 2, 2023-09-23T09:48:47.417 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_del": 0 2023-09-23T09:48:47.417 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:47.417 INFO:teuthology.orchestra.run.smithi082.stdout: "oft": { 2023-09-23T09:48:47.417 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_total_objs": 0, 2023-09-23T09:48:47.417 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_total_kv_pairs": 0, 2023-09-23T09:48:47.417 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_total_updates": 0, 2023-09-23T09:48:47.418 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_total_removes": 0 2023-09-23T09:48:47.418 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:47.418 INFO:teuthology.orchestra.run.smithi082.stdout: "osd-slow-ops": { 2023-09-23T09:48:47.418 INFO:teuthology.orchestra.run.smithi082.stdout: "slow_ops_count": 0 2023-09-23T09:48:47.418 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:47.418 INFO:teuthology.orchestra.run.smithi082.stdout: "purge_queue": { 2023-09-23T09:48:47.418 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executing_ops": 0, 2023-09-23T09:48:47.418 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executing_ops_high_water": 0, 2023-09-23T09:48:47.418 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executing": 0, 2023-09-23T09:48:47.418 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executing_high_water": 0, 2023-09-23T09:48:47.418 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executed": 0, 2023-09-23T09:48:47.419 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_item_in_journal": 0 2023-09-23T09:48:47.419 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:47.419 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-09-23T09:48:47.419 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2023-09-23T09:48:47.419 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 104857600, 2023-09-23T09:48:47.419 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2023-09-23T09:48:47.419 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 11474, 2023-09-23T09:48:47.419 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 35565928, 2023-09-23T09:48:47.419 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2023-09-23T09:48:47.419 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 11474, 2023-09-23T09:48:47.419 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 0, 2023-09-23T09:48:47.419 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 0, 2023-09-23T09:48:47.420 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 11474, 2023-09-23T09:48:47.420 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 35565928, 2023-09-23T09:48:47.420 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2023-09-23T09:48:47.420 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:47.420 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:47.420 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:47.420 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:47.420 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:47.420 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-objecter_bytes": { 2023-09-23T09:48:47.420 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2023-09-23T09:48:47.420 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 104857600, 2023-09-23T09:48:47.420 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2023-09-23T09:48:47.421 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 0, 2023-09-23T09:48:47.421 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 0, 2023-09-23T09:48:47.421 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2023-09-23T09:48:47.421 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 0, 2023-09-23T09:48:47.421 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 10386, 2023-09-23T09:48:47.421 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 31153234, 2023-09-23T09:48:47.421 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 10386, 2023-09-23T09:48:47.421 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 31153234, 2023-09-23T09:48:47.421 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2023-09-23T09:48:47.421 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:47.421 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:47.421 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:47.421 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:47.422 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:47.422 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-objecter_ops": { 2023-09-23T09:48:47.422 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2023-09-23T09:48:47.422 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 1024, 2023-09-23T09:48:47.422 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2023-09-23T09:48:47.422 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 0, 2023-09-23T09:48:47.422 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 0, 2023-09-23T09:48:47.422 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2023-09-23T09:48:47.422 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 0, 2023-09-23T09:48:47.422 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 10386, 2023-09-23T09:48:47.422 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 10386, 2023-09-23T09:48:47.423 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 10386, 2023-09-23T09:48:47.423 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 10386, 2023-09-23T09:48:47.423 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2023-09-23T09:48:47.423 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:47.423 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:47.423 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:47.423 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:47.423 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:47.423 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-write_buf_throttle": { 2023-09-23T09:48:47.423 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2023-09-23T09:48:47.423 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 3758096384, 2023-09-23T09:48:47.423 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2023-09-23T09:48:47.424 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 0, 2023-09-23T09:48:47.424 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 0, 2023-09-23T09:48:47.424 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2023-09-23T09:48:47.424 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 0, 2023-09-23T09:48:47.424 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 0, 2023-09-23T09:48:47.424 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 0, 2023-09-23T09:48:47.424 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 0, 2023-09-23T09:48:47.424 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 0, 2023-09-23T09:48:47.424 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2023-09-23T09:48:47.424 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:47.424 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:47.425 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:47.425 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:47.425 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:47.425 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-write_buf_throttle-0x56010c1c6a00": { 2023-09-23T09:48:47.425 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2023-09-23T09:48:47.425 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 3758096384, 2023-09-23T09:48:47.425 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2023-09-23T09:48:47.425 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 0, 2023-09-23T09:48:47.425 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 0, 2023-09-23T09:48:47.425 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2023-09-23T09:48:47.426 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 0, 2023-09-23T09:48:47.426 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 0, 2023-09-23T09:48:47.426 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 0, 2023-09-23T09:48:47.426 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 0, 2023-09-23T09:48:47.426 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 0, 2023-09-23T09:48:47.426 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2023-09-23T09:48:47.426 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:47.426 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:47.426 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:47.426 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:47.426 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:47.426 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:48:47.427 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:48:47 smithi161 ceph-mon[99580]: pgmap v1649: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-09-23T09:48:47.560 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:48:47 smithi135 ceph-mon[99205]: pgmap v1649: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-09-23T09:48:47.837 INFO:tasks.check_counter:Daemon mds.a mds.exported=0 2023-09-23T09:48:47.837 INFO:tasks.check_counter:Daemon mds.a mds.imported=0 2023-09-23T09:48:47.837 INFO:tasks.check_counter:Daemon mds.a mds.root_rsnaps=0 2023-09-23T09:48:47.837 INFO:tasks.check_counter:Daemon mds.a mds_server.req_mksnap_latency.avgcount=0 2023-09-23T09:48:47.837 INFO:tasks.check_counter:Daemon mds.a mds_server.req_rmsnap_latency.avgcount=0 2023-09-23T09:48:47.837 DEBUG:tasks.check_counter:Getting stats from d 2023-09-23T09:48:47.838 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- ceph daemon mds.d perf dump 2023-09-23T09:48:48.560 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.a/config 2023-09-23T09:48:48.810 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:48:48 smithi135 ceph-mon[99205]: pgmap v1650: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-09-23T09:48:48.826 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:48:48 smithi082 ceph-mon[97694]: pgmap v1650: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-09-23T09:48:48.896 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:48:48 smithi161 ceph-mon[99580]: pgmap v1650: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-09-23T09:48:50.108 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:48:50.109 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-0": { 2023-09-23T09:48:50.109 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 0, 2023-09-23T09:48:50.109 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 2, 2023-09-23T09:48:50.109 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 0, 2023-09-23T09:48:50.109 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 0, 2023-09-23T09:48:50.109 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 4, 2023-09-23T09:48:50.109 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 0, 2023-09-23T09:48:50.110 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.003420270, 2023-09-23T09:48:50.110 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.000000000, 2023-09-23T09:48:50.110 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.000684417, 2023-09-23T09:48:50.110 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-09-23T09:48:50.110 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2023-09-23T09:48:50.110 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:50.110 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:50.110 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:50.111 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:50.111 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2023-09-23T09:48:50.111 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:50.111 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:50.111 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:50.111 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:50.111 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 0, 2023-09-23T09:48:50.111 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 0 2023-09-23T09:48:50.111 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:50.112 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-1": { 2023-09-23T09:48:50.112 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 876, 2023-09-23T09:48:50.112 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 863, 2023-09-23T09:48:50.112 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 1736144, 2023-09-23T09:48:50.112 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 522432, 2023-09-23T09:48:50.112 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 2, 2023-09-23T09:48:50.112 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 1, 2023-09-23T09:48:50.112 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.144387561, 2023-09-23T09:48:50.113 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.064744675, 2023-09-23T09:48:50.113 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.058286118, 2023-09-23T09:48:50.113 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.019528955, 2023-09-23T09:48:50.113 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2023-09-23T09:48:50.113 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 863, 2023-09-23T09:48:50.113 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.069703546, 2023-09-23T09:48:50.113 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000080768 2023-09-23T09:48:50.113 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:50.113 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2023-09-23T09:48:50.114 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:50.114 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:50.114 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:50.114 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:50.114 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 1736144, 2023-09-23T09:48:50.114 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 522432 2023-09-23T09:48:50.114 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:50.114 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-2": { 2023-09-23T09:48:50.114 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 5, 2023-09-23T09:48:50.115 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 661, 2023-09-23T09:48:50.115 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 800, 2023-09-23T09:48:50.115 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 497728, 2023-09-23T09:48:50.115 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 8, 2023-09-23T09:48:50.115 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 3, 2023-09-23T09:48:50.115 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.059430197, 2023-09-23T09:48:50.115 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.045974924, 2023-09-23T09:48:50.115 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.004687401, 2023-09-23T09:48:50.116 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-09-23T09:48:50.116 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2023-09-23T09:48:50.116 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 658, 2023-09-23T09:48:50.116 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.060176396, 2023-09-23T09:48:50.116 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000091453 2023-09-23T09:48:50.116 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:50.116 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2023-09-23T09:48:50.116 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:50.117 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:50.117 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:50.117 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:50.117 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 800, 2023-09-23T09:48:50.117 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 497728 2023-09-23T09:48:50.117 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:50.117 INFO:teuthology.orchestra.run.smithi082.stdout: "cct": { 2023-09-23T09:48:50.117 INFO:teuthology.orchestra.run.smithi082.stdout: "total_workers": 0, 2023-09-23T09:48:50.117 INFO:teuthology.orchestra.run.smithi082.stdout: "unhealthy_workers": 0 2023-09-23T09:48:50.118 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:50.118 INFO:teuthology.orchestra.run.smithi082.stdout: "mempool": { 2023-09-23T09:48:50.118 INFO:teuthology.orchestra.run.smithi082.stdout: "bloom_filter_bytes": 0, 2023-09-23T09:48:50.118 INFO:teuthology.orchestra.run.smithi082.stdout: "bloom_filter_items": 0, 2023-09-23T09:48:50.118 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_alloc_bytes": 0, 2023-09-23T09:48:50.118 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_alloc_items": 0, 2023-09-23T09:48:50.119 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_data_bytes": 0, 2023-09-23T09:48:50.119 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_data_items": 0, 2023-09-23T09:48:50.119 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_onode_bytes": 0, 2023-09-23T09:48:50.119 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_onode_items": 0, 2023-09-23T09:48:50.119 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_meta_bytes": 0, 2023-09-23T09:48:50.119 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_meta_items": 0, 2023-09-23T09:48:50.119 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_other_bytes": 0, 2023-09-23T09:48:50.119 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_other_items": 0, 2023-09-23T09:48:50.119 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_buffer_bytes": 0, 2023-09-23T09:48:50.120 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_buffer_items": 0, 2023-09-23T09:48:50.120 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_extent_bytes": 0, 2023-09-23T09:48:50.120 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_extent_items": 0, 2023-09-23T09:48:50.120 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_blob_bytes": 0, 2023-09-23T09:48:50.120 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_blob_items": 0, 2023-09-23T09:48:50.120 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_shared_blob_bytes": 0, 2023-09-23T09:48:50.120 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_shared_blob_items": 0, 2023-09-23T09:48:50.121 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_inline_bl_bytes": 0, 2023-09-23T09:48:50.121 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_inline_bl_items": 0, 2023-09-23T09:48:50.121 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_fsck_bytes": 0, 2023-09-23T09:48:50.121 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_fsck_items": 0, 2023-09-23T09:48:50.121 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_txc_bytes": 0, 2023-09-23T09:48:50.121 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_txc_items": 0, 2023-09-23T09:48:50.121 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_deferred_bytes": 0, 2023-09-23T09:48:50.121 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_deferred_items": 0, 2023-09-23T09:48:50.121 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_bytes": 0, 2023-09-23T09:48:50.122 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_items": 0, 2023-09-23T09:48:50.122 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_bytes": 0, 2023-09-23T09:48:50.122 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_items": 0, 2023-09-23T09:48:50.122 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_reader_bytes": 0, 2023-09-23T09:48:50.122 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_reader_items": 0, 2023-09-23T09:48:50.122 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_writer_bytes": 0, 2023-09-23T09:48:50.122 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_writer_items": 0, 2023-09-23T09:48:50.122 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_anon_bytes": 148754, 2023-09-23T09:48:50.122 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_anon_items": 31, 2023-09-23T09:48:50.123 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_meta_bytes": 0, 2023-09-23T09:48:50.123 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_meta_items": 0, 2023-09-23T09:48:50.123 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_bytes": 0, 2023-09-23T09:48:50.123 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_items": 0, 2023-09-23T09:48:50.123 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_mapbl_bytes": 0, 2023-09-23T09:48:50.123 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_mapbl_items": 0, 2023-09-23T09:48:50.123 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_pglog_bytes": 0, 2023-09-23T09:48:50.123 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_pglog_items": 0, 2023-09-23T09:48:50.123 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_bytes": 0, 2023-09-23T09:48:50.124 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_items": 0, 2023-09-23T09:48:50.124 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_mapping_bytes": 0, 2023-09-23T09:48:50.124 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_mapping_items": 0, 2023-09-23T09:48:50.124 INFO:teuthology.orchestra.run.smithi082.stdout: "pgmap_bytes": 0, 2023-09-23T09:48:50.124 INFO:teuthology.orchestra.run.smithi082.stdout: "pgmap_items": 0, 2023-09-23T09:48:50.124 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_co_bytes": 928, 2023-09-23T09:48:50.124 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_co_items": 2, 2023-09-23T09:48:50.124 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_1_bytes": 0, 2023-09-23T09:48:50.124 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_1_items": 0, 2023-09-23T09:48:50.125 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_2_bytes": 0, 2023-09-23T09:48:50.125 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_2_items": 0 2023-09-23T09:48:50.125 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:50.125 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-09-23T09:48:50.125 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2023-09-23T09:48:50.125 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 104857600, 2023-09-23T09:48:50.125 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2023-09-23T09:48:50.125 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 877, 2023-09-23T09:48:50.125 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 1609938, 2023-09-23T09:48:50.126 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2023-09-23T09:48:50.126 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 877, 2023-09-23T09:48:50.126 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 0, 2023-09-23T09:48:50.126 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 0, 2023-09-23T09:48:50.126 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 877, 2023-09-23T09:48:50.126 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 1609938, 2023-09-23T09:48:50.126 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2023-09-23T09:48:50.126 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:50.126 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:50.127 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:50.127 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:50.127 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:50.127 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:48:50.549 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2023-09-23T09:48:50.549 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2023-09-23T09:48:50.549 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2023-09-23T09:48:50.549 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2023-09-23T09:48:50.549 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2023-09-23T09:48:50.549 DEBUG:tasks.check_counter:Getting stats from g 2023-09-23T09:48:50.550 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- ceph daemon mds.g perf dump 2023-09-23T09:48:51.272 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.a/config 2023-09-23T09:48:51.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:48:51 smithi082 ceph-mon[97694]: pgmap v1651: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-09-23T09:48:51.396 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:48:51 smithi161 ceph-mon[99580]: pgmap v1651: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-09-23T09:48:51.560 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:48:51 smithi135 ceph-mon[99205]: pgmap v1651: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-09-23T09:48:52.824 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:48:52.824 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-0": { 2023-09-23T09:48:52.824 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 4537, 2023-09-23T09:48:52.824 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 4403, 2023-09-23T09:48:52.824 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 7938550, 2023-09-23T09:48:52.824 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 1608842, 2023-09-23T09:48:52.824 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 6, 2023-09-23T09:48:52.825 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 2, 2023-09-23T09:48:52.825 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.543756201, 2023-09-23T09:48:52.825 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.201315898, 2023-09-23T09:48:52.825 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.174836823, 2023-09-23T09:48:52.825 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.131784925, 2023-09-23T09:48:52.825 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2023-09-23T09:48:52.825 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 4403, 2023-09-23T09:48:52.825 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.391167082, 2023-09-23T09:48:52.825 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000088841 2023-09-23T09:48:52.825 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:52.825 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2023-09-23T09:48:52.825 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:52.826 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:52.826 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:52.826 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:52.826 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 2605264, 2023-09-23T09:48:52.826 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 537136 2023-09-23T09:48:52.826 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:52.826 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-1": { 2023-09-23T09:48:52.826 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 3755, 2023-09-23T09:48:52.826 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 4407, 2023-09-23T09:48:52.826 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 18132141, 2023-09-23T09:48:52.826 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 2547324, 2023-09-23T09:48:52.826 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 10, 2023-09-23T09:48:52.827 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 5, 2023-09-23T09:48:52.827 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.424578048, 2023-09-23T09:48:52.827 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.146332696, 2023-09-23T09:48:52.827 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.126216877, 2023-09-23T09:48:52.827 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.111982464, 2023-09-23T09:48:52.827 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2023-09-23T09:48:52.827 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 4404, 2023-09-23T09:48:52.827 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.329587186, 2023-09-23T09:48:52.827 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000074838 2023-09-23T09:48:52.827 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:52.827 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2023-09-23T09:48:52.827 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:52.828 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:52.828 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:52.828 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:52.828 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 480, 2023-09-23T09:48:52.828 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 1380384 2023-09-23T09:48:52.828 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:52.828 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-2": { 2023-09-23T09:48:52.828 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 3202, 2023-09-23T09:48:52.828 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 3204, 2023-09-23T09:48:52.828 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 17593013, 2023-09-23T09:48:52.828 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 995823, 2023-09-23T09:48:52.828 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 8, 2023-09-23T09:48:52.829 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 4, 2023-09-23T09:48:52.829 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.323325558, 2023-09-23T09:48:52.829 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.104121114, 2023-09-23T09:48:52.829 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.105150381, 2023-09-23T09:48:52.829 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.084486728, 2023-09-23T09:48:52.829 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2023-09-23T09:48:52.829 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 3202, 2023-09-23T09:48:52.829 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.182049333, 2023-09-23T09:48:52.829 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000056854 2023-09-23T09:48:52.829 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:52.829 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2023-09-23T09:48:52.829 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:52.830 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:52.830 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:52.830 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:52.830 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 0, 2023-09-23T09:48:52.830 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 0 2023-09-23T09:48:52.830 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:52.830 INFO:teuthology.orchestra.run.smithi082.stdout: "cct": { 2023-09-23T09:48:52.830 INFO:teuthology.orchestra.run.smithi082.stdout: "total_workers": 1, 2023-09-23T09:48:52.830 INFO:teuthology.orchestra.run.smithi082.stdout: "unhealthy_workers": 0 2023-09-23T09:48:52.830 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:52.830 INFO:teuthology.orchestra.run.smithi082.stdout: "finisher-MDSRank": { 2023-09-23T09:48:52.830 INFO:teuthology.orchestra.run.smithi082.stdout: "queue_len": 0, 2023-09-23T09:48:52.831 INFO:teuthology.orchestra.run.smithi082.stdout: "complete_latency": { 2023-09-23T09:48:52.831 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 17227, 2023-09-23T09:48:52.831 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.473123102, 2023-09-23T09:48:52.831 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000027464 2023-09-23T09:48:52.831 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:52.831 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:52.831 INFO:teuthology.orchestra.run.smithi082.stdout: "finisher-PurgeQueue": { 2023-09-23T09:48:52.831 INFO:teuthology.orchestra.run.smithi082.stdout: "queue_len": 0, 2023-09-23T09:48:52.831 INFO:teuthology.orchestra.run.smithi082.stdout: "complete_latency": { 2023-09-23T09:48:52.831 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:52.831 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:52.831 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:52.832 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:52.832 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:52.832 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": { 2023-09-23T09:48:52.832 INFO:teuthology.orchestra.run.smithi082.stdout: "request": 0, 2023-09-23T09:48:52.832 INFO:teuthology.orchestra.run.smithi082.stdout: "reply": 0, 2023-09-23T09:48:52.832 INFO:teuthology.orchestra.run.smithi082.stdout: "reply_latency": { 2023-09-23T09:48:52.832 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:52.832 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:52.832 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:52.832 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:52.832 INFO:teuthology.orchestra.run.smithi082.stdout: "slow_reply": 0, 2023-09-23T09:48:52.833 INFO:teuthology.orchestra.run.smithi082.stdout: "forward": 0, 2023-09-23T09:48:52.833 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_fetch_complete": 0, 2023-09-23T09:48:52.833 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_fetch_keys": 0, 2023-09-23T09:48:52.833 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_commit": 0, 2023-09-23T09:48:52.833 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_split": 0, 2023-09-23T09:48:52.833 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_merge": 0, 2023-09-23T09:48:52.833 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes": 1065, 2023-09-23T09:48:52.833 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_top": 160, 2023-09-23T09:48:52.833 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_bottom": 616, 2023-09-23T09:48:52.833 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_pin_tail": 289, 2023-09-23T09:48:52.833 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_pinned": 836, 2023-09-23T09:48:52.833 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_expired": 0, 2023-09-23T09:48:52.834 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_with_caps": 0, 2023-09-23T09:48:52.834 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": 0, 2023-09-23T09:48:52.834 INFO:teuthology.orchestra.run.smithi082.stdout: "subtrees": 14, 2023-09-23T09:48:52.834 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse": 0, 2023-09-23T09:48:52.834 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_hit": 0, 2023-09-23T09:48:52.834 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_forward": 0, 2023-09-23T09:48:52.834 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_discover": 0, 2023-09-23T09:48:52.834 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_dir_fetch": 0, 2023-09-23T09:48:52.834 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_remote_ino": 0, 2023-09-23T09:48:52.834 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_lock": 0, 2023-09-23T09:48:52.834 INFO:teuthology.orchestra.run.smithi082.stdout: "load_cent": 0, 2023-09-23T09:48:52.834 INFO:teuthology.orchestra.run.smithi082.stdout: "q": 0, 2023-09-23T09:48:52.835 INFO:teuthology.orchestra.run.smithi082.stdout: "exported": 0, 2023-09-23T09:48:52.835 INFO:teuthology.orchestra.run.smithi082.stdout: "exported_inodes": 0, 2023-09-23T09:48:52.835 INFO:teuthology.orchestra.run.smithi082.stdout: "imported": 0, 2023-09-23T09:48:52.835 INFO:teuthology.orchestra.run.smithi082.stdout: "imported_inodes": 0, 2023-09-23T09:48:52.835 INFO:teuthology.orchestra.run.smithi082.stdout: "openino_dir_fetch": 0, 2023-09-23T09:48:52.835 INFO:teuthology.orchestra.run.smithi082.stdout: "openino_backtrace_fetch": 0, 2023-09-23T09:48:52.835 INFO:teuthology.orchestra.run.smithi082.stdout: "openino_peer_discover": 0, 2023-09-23T09:48:52.835 INFO:teuthology.orchestra.run.smithi082.stdout: "root_rfiles": 0, 2023-09-23T09:48:52.835 INFO:teuthology.orchestra.run.smithi082.stdout: "root_rbytes": 0, 2023-09-23T09:48:52.835 INFO:teuthology.orchestra.run.smithi082.stdout: "root_rsnaps": 0, 2023-09-23T09:48:52.835 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_backtrace_fetch": 0, 2023-09-23T09:48:52.835 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_set_tag": 0, 2023-09-23T09:48:52.836 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_backtrace_repaired": 0, 2023-09-23T09:48:52.836 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_inotable_repaired": 0, 2023-09-23T09:48:52.836 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_dir_inodes": 0, 2023-09-23T09:48:52.836 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_dir_base_inodes": 0, 2023-09-23T09:48:52.836 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_dirfrag_rstats": 0, 2023-09-23T09:48:52.836 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_file_inodes": 0, 2023-09-23T09:48:52.836 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_inode_file_caps": 0, 2023-09-23T09:48:52.836 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_revoke": 0, 2023-09-23T09:48:52.836 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_grant": 0, 2023-09-23T09:48:52.836 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_trunc": 0, 2023-09-23T09:48:52.836 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-09-23T09:48:52.836 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_flush_ack": 0, 2023-09-23T09:48:52.837 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_caps": 0, 2023-09-23T09:48:52.837 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_caps_dirty": 0, 2023-09-23T09:48:52.837 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_cap_release": 0, 2023-09-23T09:48:52.837 INFO:teuthology.orchestra.run.smithi082.stdout: "process_request_cap_release": 0 2023-09-23T09:48:52.837 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:52.837 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_cache": { 2023-09-23T09:48:52.837 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_update": 0, 2023-09-23T09:48:52.837 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_update_receipt": 0, 2023-09-23T09:48:52.837 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_try_discover": 0, 2023-09-23T09:48:52.837 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_send_discover": 0, 2023-09-23T09:48:52.837 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_handle_discover": 0, 2023-09-23T09:48:52.837 INFO:teuthology.orchestra.run.smithi082.stdout: "num_strays": 0, 2023-09-23T09:48:52.838 INFO:teuthology.orchestra.run.smithi082.stdout: "num_strays_delayed": 0, 2023-09-23T09:48:52.838 INFO:teuthology.orchestra.run.smithi082.stdout: "num_strays_enqueuing": 0, 2023-09-23T09:48:52.838 INFO:teuthology.orchestra.run.smithi082.stdout: "strays_created": 0, 2023-09-23T09:48:52.838 INFO:teuthology.orchestra.run.smithi082.stdout: "strays_enqueued": 0, 2023-09-23T09:48:52.838 INFO:teuthology.orchestra.run.smithi082.stdout: "strays_reintegrated": 0, 2023-09-23T09:48:52.838 INFO:teuthology.orchestra.run.smithi082.stdout: "strays_migrated": 0, 2023-09-23T09:48:52.838 INFO:teuthology.orchestra.run.smithi082.stdout: "num_recovering_processing": 0, 2023-09-23T09:48:52.838 INFO:teuthology.orchestra.run.smithi082.stdout: "num_recovering_enqueued": 0, 2023-09-23T09:48:52.838 INFO:teuthology.orchestra.run.smithi082.stdout: "num_recovering_prioritized": 0, 2023-09-23T09:48:52.838 INFO:teuthology.orchestra.run.smithi082.stdout: "recovery_started": 0, 2023-09-23T09:48:52.838 INFO:teuthology.orchestra.run.smithi082.stdout: "recovery_completed": 0, 2023-09-23T09:48:52.838 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_enqueue_scrub": 0, 2023-09-23T09:48:52.839 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_exportdir": 0, 2023-09-23T09:48:52.839 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_flush": 0, 2023-09-23T09:48:52.839 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_fragmentdir": 0, 2023-09-23T09:48:52.839 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_fragstats": 0, 2023-09-23T09:48:52.839 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_inodestats": 0 2023-09-23T09:48:52.839 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:52.839 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_log": { 2023-09-23T09:48:52.839 INFO:teuthology.orchestra.run.smithi082.stdout: "evlrg": 0, 2023-09-23T09:48:52.839 INFO:teuthology.orchestra.run.smithi082.stdout: "evadd": 0, 2023-09-23T09:48:52.839 INFO:teuthology.orchestra.run.smithi082.stdout: "evex": 0, 2023-09-23T09:48:52.839 INFO:teuthology.orchestra.run.smithi082.stdout: "evtrm": 0, 2023-09-23T09:48:52.839 INFO:teuthology.orchestra.run.smithi082.stdout: "ev": 10186, 2023-09-23T09:48:52.840 INFO:teuthology.orchestra.run.smithi082.stdout: "evexg": 0, 2023-09-23T09:48:52.840 INFO:teuthology.orchestra.run.smithi082.stdout: "evexd": 0, 2023-09-23T09:48:52.840 INFO:teuthology.orchestra.run.smithi082.stdout: "segadd": 0, 2023-09-23T09:48:52.840 INFO:teuthology.orchestra.run.smithi082.stdout: "segex": 0, 2023-09-23T09:48:52.840 INFO:teuthology.orchestra.run.smithi082.stdout: "segtrm": 0, 2023-09-23T09:48:52.840 INFO:teuthology.orchestra.run.smithi082.stdout: "seg": 14, 2023-09-23T09:48:52.840 INFO:teuthology.orchestra.run.smithi082.stdout: "segmjr": 2, 2023-09-23T09:48:52.840 INFO:teuthology.orchestra.run.smithi082.stdout: "segexg": 0, 2023-09-23T09:48:52.840 INFO:teuthology.orchestra.run.smithi082.stdout: "segexd": 0, 2023-09-23T09:48:52.840 INFO:teuthology.orchestra.run.smithi082.stdout: "expos": 4194304, 2023-09-23T09:48:52.840 INFO:teuthology.orchestra.run.smithi082.stdout: "wrpos": 42338546, 2023-09-23T09:48:52.840 INFO:teuthology.orchestra.run.smithi082.stdout: "rdpos": 42338485, 2023-09-23T09:48:52.840 INFO:teuthology.orchestra.run.smithi082.stdout: "jlat": { 2023-09-23T09:48:52.841 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:52.841 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:52.841 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:52.841 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:52.841 INFO:teuthology.orchestra.run.smithi082.stdout: "replayed": 10186 2023-09-23T09:48:52.841 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:52.841 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_mem": { 2023-09-23T09:48:52.841 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 323, 2023-09-23T09:48:52.841 INFO:teuthology.orchestra.run.smithi082.stdout: "ino+": 1874, 2023-09-23T09:48:52.841 INFO:teuthology.orchestra.run.smithi082.stdout: "ino-": 1551, 2023-09-23T09:48:52.841 INFO:teuthology.orchestra.run.smithi082.stdout: "dir": 32, 2023-09-23T09:48:52.841 INFO:teuthology.orchestra.run.smithi082.stdout: "dir+": 90, 2023-09-23T09:48:52.842 INFO:teuthology.orchestra.run.smithi082.stdout: "dir-": 58, 2023-09-23T09:48:52.842 INFO:teuthology.orchestra.run.smithi082.stdout: "dn": 1065, 2023-09-23T09:48:52.842 INFO:teuthology.orchestra.run.smithi082.stdout: "dn+": 2662, 2023-09-23T09:48:52.842 INFO:teuthology.orchestra.run.smithi082.stdout: "dn-": 1597, 2023-09-23T09:48:52.842 INFO:teuthology.orchestra.run.smithi082.stdout: "cap": 0, 2023-09-23T09:48:52.842 INFO:teuthology.orchestra.run.smithi082.stdout: "cap+": 0, 2023-09-23T09:48:52.842 INFO:teuthology.orchestra.run.smithi082.stdout: "cap-": 0, 2023-09-23T09:48:52.842 INFO:teuthology.orchestra.run.smithi082.stdout: "rss": 55092, 2023-09-23T09:48:52.842 INFO:teuthology.orchestra.run.smithi082.stdout: "heap": 207152 2023-09-23T09:48:52.842 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:52.842 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_server": { 2023-09-23T09:48:52.842 INFO:teuthology.orchestra.run.smithi082.stdout: "dispatch_client_request": 0, 2023-09-23T09:48:52.843 INFO:teuthology.orchestra.run.smithi082.stdout: "dispatch_server_request": 0, 2023-09-23T09:48:52.843 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_request": 0, 2023-09-23T09:48:52.843 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_session": 0, 2023-09-23T09:48:52.843 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_peer_request": 0, 2023-09-23T09:48:52.843 INFO:teuthology.orchestra.run.smithi082.stdout: "req_create_latency": { 2023-09-23T09:48:52.843 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:52.843 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:52.843 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:52.843 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:52.843 INFO:teuthology.orchestra.run.smithi082.stdout: "req_getattr_latency": { 2023-09-23T09:48:52.843 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:52.843 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:52.844 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:52.844 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:52.844 INFO:teuthology.orchestra.run.smithi082.stdout: "req_getfilelock_latency": { 2023-09-23T09:48:52.844 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:52.844 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:52.844 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:52.844 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:52.844 INFO:teuthology.orchestra.run.smithi082.stdout: "req_link_latency": { 2023-09-23T09:48:52.844 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:52.844 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:52.844 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:52.844 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:52.845 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookup_latency": { 2023-09-23T09:48:52.845 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:52.845 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:52.845 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:52.845 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:52.845 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookuphash_latency": { 2023-09-23T09:48:52.845 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:52.845 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:52.845 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:52.845 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:52.845 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookupino_latency": { 2023-09-23T09:48:52.845 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:52.846 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:52.846 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:52.846 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:52.846 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookupname_latency": { 2023-09-23T09:48:52.846 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:52.846 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:52.846 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:52.846 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:52.846 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookupparent_latency": { 2023-09-23T09:48:52.846 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:52.846 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:52.846 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:52.847 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:52.847 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookupsnap_latency": { 2023-09-23T09:48:52.847 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:52.847 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:52.847 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:52.847 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:52.847 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lssnap_latency": { 2023-09-23T09:48:52.847 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:52.847 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:52.847 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:52.847 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:52.847 INFO:teuthology.orchestra.run.smithi082.stdout: "req_mkdir_latency": { 2023-09-23T09:48:52.848 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:52.848 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:52.848 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:52.848 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:52.848 INFO:teuthology.orchestra.run.smithi082.stdout: "req_mknod_latency": { 2023-09-23T09:48:52.848 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:52.848 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:52.848 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:52.848 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:52.848 INFO:teuthology.orchestra.run.smithi082.stdout: "req_mksnap_latency": { 2023-09-23T09:48:52.848 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:52.848 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:52.849 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:52.849 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:52.849 INFO:teuthology.orchestra.run.smithi082.stdout: "req_open_latency": { 2023-09-23T09:48:52.849 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:52.849 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:52.849 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:52.849 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:52.849 INFO:teuthology.orchestra.run.smithi082.stdout: "req_readdir_latency": { 2023-09-23T09:48:52.849 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:52.849 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:52.849 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:52.849 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:52.850 INFO:teuthology.orchestra.run.smithi082.stdout: "req_rename_latency": { 2023-09-23T09:48:52.850 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:52.850 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:52.850 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:52.850 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:52.850 INFO:teuthology.orchestra.run.smithi082.stdout: "req_renamesnap_latency": { 2023-09-23T09:48:52.850 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:52.850 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:52.850 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:52.850 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:52.850 INFO:teuthology.orchestra.run.smithi082.stdout: "req_snapdiff_latency": { 2023-09-23T09:48:52.850 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:52.851 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:52.851 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:52.851 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:52.851 INFO:teuthology.orchestra.run.smithi082.stdout: "req_rmdir_latency": { 2023-09-23T09:48:52.851 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:52.851 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:52.851 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:52.851 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:52.851 INFO:teuthology.orchestra.run.smithi082.stdout: "req_rmsnap_latency": { 2023-09-23T09:48:52.851 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:52.851 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:52.851 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:52.851 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:52.852 INFO:teuthology.orchestra.run.smithi082.stdout: "req_rmxattr_latency": { 2023-09-23T09:48:52.852 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:52.852 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:52.852 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:52.852 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:52.852 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setattr_latency": { 2023-09-23T09:48:52.852 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:52.852 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:52.852 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:52.852 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:52.852 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setdirlayout_latency": { 2023-09-23T09:48:52.852 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:52.852 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:52.853 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:52.853 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:52.853 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setfilelock_latency": { 2023-09-23T09:48:52.853 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:52.853 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:52.853 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:52.853 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:52.853 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setlayout_latency": { 2023-09-23T09:48:52.853 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:52.853 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:52.853 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:52.853 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:52.854 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setxattr_latency": { 2023-09-23T09:48:52.854 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:52.854 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:52.854 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:52.854 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:52.854 INFO:teuthology.orchestra.run.smithi082.stdout: "req_symlink_latency": { 2023-09-23T09:48:52.854 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:52.854 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:52.854 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:52.854 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:52.854 INFO:teuthology.orchestra.run.smithi082.stdout: "req_unlink_latency": { 2023-09-23T09:48:52.854 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:52.855 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:52.855 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:52.855 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:52.855 INFO:teuthology.orchestra.run.smithi082.stdout: "cap_revoke_eviction": 0, 2023-09-23T09:48:52.855 INFO:teuthology.orchestra.run.smithi082.stdout: "cap_acquisition_throttle": 0, 2023-09-23T09:48:52.855 INFO:teuthology.orchestra.run.smithi082.stdout: "req_getvxattr_latency": { 2023-09-23T09:48:52.855 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:52.855 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:52.855 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:52.855 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:52.855 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:52.855 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_sessions": { 2023-09-23T09:48:52.856 INFO:teuthology.orchestra.run.smithi082.stdout: "session_count": 2, 2023-09-23T09:48:52.856 INFO:teuthology.orchestra.run.smithi082.stdout: "session_add": 4, 2023-09-23T09:48:52.856 INFO:teuthology.orchestra.run.smithi082.stdout: "session_remove": 2, 2023-09-23T09:48:52.856 INFO:teuthology.orchestra.run.smithi082.stdout: "sessions_open": 4, 2023-09-23T09:48:52.856 INFO:teuthology.orchestra.run.smithi082.stdout: "sessions_stale": 0, 2023-09-23T09:48:52.856 INFO:teuthology.orchestra.run.smithi082.stdout: "total_load": 0, 2023-09-23T09:48:52.856 INFO:teuthology.orchestra.run.smithi082.stdout: "average_load": 0, 2023-09-23T09:48:52.856 INFO:teuthology.orchestra.run.smithi082.stdout: "avg_session_uptime": 6405 2023-09-23T09:48:52.856 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:52.856 INFO:teuthology.orchestra.run.smithi082.stdout: "mempool": { 2023-09-23T09:48:52.856 INFO:teuthology.orchestra.run.smithi082.stdout: "bloom_filter_bytes": 0, 2023-09-23T09:48:52.856 INFO:teuthology.orchestra.run.smithi082.stdout: "bloom_filter_items": 0, 2023-09-23T09:48:52.857 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_alloc_bytes": 0, 2023-09-23T09:48:52.857 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_alloc_items": 0, 2023-09-23T09:48:52.857 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_data_bytes": 0, 2023-09-23T09:48:52.857 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_data_items": 0, 2023-09-23T09:48:52.857 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_onode_bytes": 0, 2023-09-23T09:48:52.857 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_onode_items": 0, 2023-09-23T09:48:52.857 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_meta_bytes": 0, 2023-09-23T09:48:52.857 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_meta_items": 0, 2023-09-23T09:48:52.857 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_other_bytes": 0, 2023-09-23T09:48:52.857 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_other_items": 0, 2023-09-23T09:48:52.857 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_buffer_bytes": 0, 2023-09-23T09:48:52.857 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_buffer_items": 0, 2023-09-23T09:48:52.858 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_extent_bytes": 0, 2023-09-23T09:48:52.858 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_extent_items": 0, 2023-09-23T09:48:52.858 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_blob_bytes": 0, 2023-09-23T09:48:52.858 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_blob_items": 0, 2023-09-23T09:48:52.858 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_shared_blob_bytes": 0, 2023-09-23T09:48:52.858 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_shared_blob_items": 0, 2023-09-23T09:48:52.858 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_inline_bl_bytes": 0, 2023-09-23T09:48:52.858 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_inline_bl_items": 0, 2023-09-23T09:48:52.858 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_fsck_bytes": 0, 2023-09-23T09:48:52.858 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_fsck_items": 0, 2023-09-23T09:48:52.858 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_txc_bytes": 0, 2023-09-23T09:48:52.858 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_txc_items": 0, 2023-09-23T09:48:52.859 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_deferred_bytes": 0, 2023-09-23T09:48:52.859 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_deferred_items": 0, 2023-09-23T09:48:52.859 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_bytes": 0, 2023-09-23T09:48:52.859 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_items": 0, 2023-09-23T09:48:52.859 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_bytes": 0, 2023-09-23T09:48:52.859 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_items": 0, 2023-09-23T09:48:52.859 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_reader_bytes": 0, 2023-09-23T09:48:52.859 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_reader_items": 0, 2023-09-23T09:48:52.859 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_writer_bytes": 0, 2023-09-23T09:48:52.859 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_writer_items": 0, 2023-09-23T09:48:52.859 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_anon_bytes": 207905, 2023-09-23T09:48:52.859 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_anon_items": 65, 2023-09-23T09:48:52.860 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_meta_bytes": 0, 2023-09-23T09:48:52.860 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_meta_items": 0, 2023-09-23T09:48:52.860 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_bytes": 0, 2023-09-23T09:48:52.860 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_items": 0, 2023-09-23T09:48:52.860 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_mapbl_bytes": 0, 2023-09-23T09:48:52.860 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_mapbl_items": 0, 2023-09-23T09:48:52.860 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_pglog_bytes": 0, 2023-09-23T09:48:52.860 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_pglog_items": 0, 2023-09-23T09:48:52.860 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_bytes": 8032, 2023-09-23T09:48:52.860 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_items": 167, 2023-09-23T09:48:52.860 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_mapping_bytes": 0, 2023-09-23T09:48:52.860 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_mapping_items": 0, 2023-09-23T09:48:52.861 INFO:teuthology.orchestra.run.smithi082.stdout: "pgmap_bytes": 0, 2023-09-23T09:48:52.861 INFO:teuthology.orchestra.run.smithi082.stdout: "pgmap_items": 0, 2023-09-23T09:48:52.861 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_co_bytes": 1748892, 2023-09-23T09:48:52.861 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_co_items": 45635, 2023-09-23T09:48:52.861 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_1_bytes": 0, 2023-09-23T09:48:52.861 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_1_items": 0, 2023-09-23T09:48:52.861 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_2_bytes": 0, 2023-09-23T09:48:52.861 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_2_items": 0 2023-09-23T09:48:52.861 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:52.861 INFO:teuthology.orchestra.run.smithi082.stdout: "objecter": { 2023-09-23T09:48:52.861 INFO:teuthology.orchestra.run.smithi082.stdout: "op_active": 0, 2023-09-23T09:48:52.861 INFO:teuthology.orchestra.run.smithi082.stdout: "op_laggy": 0, 2023-09-23T09:48:52.861 INFO:teuthology.orchestra.run.smithi082.stdout: "op_send": 10400, 2023-09-23T09:48:52.862 INFO:teuthology.orchestra.run.smithi082.stdout: "op_send_bytes": 21, 2023-09-23T09:48:52.862 INFO:teuthology.orchestra.run.smithi082.stdout: "op_resend": 3, 2023-09-23T09:48:52.862 INFO:teuthology.orchestra.run.smithi082.stdout: "op_reply": 10400, 2023-09-23T09:48:52.862 INFO:teuthology.orchestra.run.smithi082.stdout: "op_latency": { 2023-09-23T09:48:52.862 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 10400, 2023-09-23T09:48:52.862 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 11.826788107, 2023-09-23T09:48:52.862 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.001137191 2023-09-23T09:48:52.862 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:52.862 INFO:teuthology.orchestra.run.smithi082.stdout: "op_inflight": 0, 2023-09-23T09:48:52.862 INFO:teuthology.orchestra.run.smithi082.stdout: "oplen_avg": { 2023-09-23T09:48:52.862 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 10400, 2023-09-23T09:48:52.863 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 10401 2023-09-23T09:48:52.863 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:52.863 INFO:teuthology.orchestra.run.smithi082.stdout: "op": 10400, 2023-09-23T09:48:52.863 INFO:teuthology.orchestra.run.smithi082.stdout: "op_r": 10400, 2023-09-23T09:48:52.863 INFO:teuthology.orchestra.run.smithi082.stdout: "op_w": 0, 2023-09-23T09:48:52.863 INFO:teuthology.orchestra.run.smithi082.stdout: "op_rmw": 0, 2023-09-23T09:48:52.863 INFO:teuthology.orchestra.run.smithi082.stdout: "op_pg": 0, 2023-09-23T09:48:52.863 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_stat": 6348, 2023-09-23T09:48:52.863 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_create": 0, 2023-09-23T09:48:52.863 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_read": 4050, 2023-09-23T09:48:52.863 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_write": 0, 2023-09-23T09:48:52.863 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_writefull": 0, 2023-09-23T09:48:52.863 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_writesame": 0, 2023-09-23T09:48:52.864 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_append": 0, 2023-09-23T09:48:52.864 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_zero": 0, 2023-09-23T09:48:52.864 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_truncate": 0, 2023-09-23T09:48:52.864 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_delete": 0, 2023-09-23T09:48:52.864 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_mapext": 0, 2023-09-23T09:48:52.864 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_sparse_read": 0, 2023-09-23T09:48:52.864 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_clonerange": 0, 2023-09-23T09:48:52.864 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_getxattr": 1, 2023-09-23T09:48:52.864 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_setxattr": 0, 2023-09-23T09:48:52.864 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_cmpxattr": 0, 2023-09-23T09:48:52.864 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_rmxattr": 0, 2023-09-23T09:48:52.864 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_resetxattrs": 0, 2023-09-23T09:48:52.865 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_call": 0, 2023-09-23T09:48:52.865 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_watch": 0, 2023-09-23T09:48:52.865 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_notify": 0, 2023-09-23T09:48:52.865 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_src_cmpxattr": 0, 2023-09-23T09:48:52.865 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_pgls": 0, 2023-09-23T09:48:52.865 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_pgls_filter": 0, 2023-09-23T09:48:52.865 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_other": 0, 2023-09-23T09:48:52.865 INFO:teuthology.orchestra.run.smithi082.stdout: "linger_active": 0, 2023-09-23T09:48:52.865 INFO:teuthology.orchestra.run.smithi082.stdout: "linger_send": 0, 2023-09-23T09:48:52.865 INFO:teuthology.orchestra.run.smithi082.stdout: "linger_resend": 0, 2023-09-23T09:48:52.865 INFO:teuthology.orchestra.run.smithi082.stdout: "linger_ping": 0, 2023-09-23T09:48:52.865 INFO:teuthology.orchestra.run.smithi082.stdout: "poolop_active": 0, 2023-09-23T09:48:52.866 INFO:teuthology.orchestra.run.smithi082.stdout: "poolop_send": 0, 2023-09-23T09:48:52.866 INFO:teuthology.orchestra.run.smithi082.stdout: "poolop_resend": 0, 2023-09-23T09:48:52.866 INFO:teuthology.orchestra.run.smithi082.stdout: "poolstat_active": 0, 2023-09-23T09:48:52.866 INFO:teuthology.orchestra.run.smithi082.stdout: "poolstat_send": 0, 2023-09-23T09:48:52.866 INFO:teuthology.orchestra.run.smithi082.stdout: "poolstat_resend": 0, 2023-09-23T09:48:52.866 INFO:teuthology.orchestra.run.smithi082.stdout: "statfs_active": 0, 2023-09-23T09:48:52.866 INFO:teuthology.orchestra.run.smithi082.stdout: "statfs_send": 0, 2023-09-23T09:48:52.866 INFO:teuthology.orchestra.run.smithi082.stdout: "statfs_resend": 0, 2023-09-23T09:48:52.866 INFO:teuthology.orchestra.run.smithi082.stdout: "command_active": 0, 2023-09-23T09:48:52.866 INFO:teuthology.orchestra.run.smithi082.stdout: "command_send": 0, 2023-09-23T09:48:52.866 INFO:teuthology.orchestra.run.smithi082.stdout: "command_resend": 0, 2023-09-23T09:48:52.866 INFO:teuthology.orchestra.run.smithi082.stdout: "map_epoch": 179, 2023-09-23T09:48:52.867 INFO:teuthology.orchestra.run.smithi082.stdout: "map_full": 0, 2023-09-23T09:48:52.867 INFO:teuthology.orchestra.run.smithi082.stdout: "map_inc": 93, 2023-09-23T09:48:52.867 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_sessions": 7, 2023-09-23T09:48:52.867 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_session_open": 12, 2023-09-23T09:48:52.867 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_session_close": 5, 2023-09-23T09:48:52.867 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_laggy": 0, 2023-09-23T09:48:52.867 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_wr": 0, 2023-09-23T09:48:52.867 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_rd": 2, 2023-09-23T09:48:52.867 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_del": 0 2023-09-23T09:48:52.867 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:52.867 INFO:teuthology.orchestra.run.smithi082.stdout: "oft": { 2023-09-23T09:48:52.867 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_total_objs": 0, 2023-09-23T09:48:52.867 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_total_kv_pairs": 0, 2023-09-23T09:48:52.868 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_total_updates": 0, 2023-09-23T09:48:52.868 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_total_removes": 0 2023-09-23T09:48:52.868 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:52.868 INFO:teuthology.orchestra.run.smithi082.stdout: "osd-slow-ops": { 2023-09-23T09:48:52.868 INFO:teuthology.orchestra.run.smithi082.stdout: "slow_ops_count": 0 2023-09-23T09:48:52.868 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:52.868 INFO:teuthology.orchestra.run.smithi082.stdout: "purge_queue": { 2023-09-23T09:48:52.868 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executing_ops": 0, 2023-09-23T09:48:52.868 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executing_ops_high_water": 0, 2023-09-23T09:48:52.868 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executing": 0, 2023-09-23T09:48:52.868 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executing_high_water": 0, 2023-09-23T09:48:52.868 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executed": 0, 2023-09-23T09:48:52.868 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_item_in_journal": 0 2023-09-23T09:48:52.869 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:52.869 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-09-23T09:48:52.869 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2023-09-23T09:48:52.869 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 104857600, 2023-09-23T09:48:52.869 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2023-09-23T09:48:52.869 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 11490, 2023-09-23T09:48:52.869 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 42571814, 2023-09-23T09:48:52.869 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2023-09-23T09:48:52.869 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 11490, 2023-09-23T09:48:52.869 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 0, 2023-09-23T09:48:52.869 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 0, 2023-09-23T09:48:52.869 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 11490, 2023-09-23T09:48:52.869 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 42571814, 2023-09-23T09:48:52.870 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2023-09-23T09:48:52.870 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:52.870 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:52.870 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:52.870 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:52.870 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:52.870 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-objecter_bytes": { 2023-09-23T09:48:52.870 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2023-09-23T09:48:52.870 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 104857600, 2023-09-23T09:48:52.870 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2023-09-23T09:48:52.870 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 0, 2023-09-23T09:48:52.870 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 0, 2023-09-23T09:48:52.870 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2023-09-23T09:48:52.871 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 0, 2023-09-23T09:48:52.871 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 10400, 2023-09-23T09:48:52.871 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 38156134, 2023-09-23T09:48:52.871 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 10400, 2023-09-23T09:48:52.871 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 38156134, 2023-09-23T09:48:52.871 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2023-09-23T09:48:52.871 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:52.871 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:52.871 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:52.871 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:52.871 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:52.871 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-objecter_ops": { 2023-09-23T09:48:52.871 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2023-09-23T09:48:52.872 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 1024, 2023-09-23T09:48:52.872 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2023-09-23T09:48:52.872 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 0, 2023-09-23T09:48:52.872 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 0, 2023-09-23T09:48:52.872 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2023-09-23T09:48:52.872 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 0, 2023-09-23T09:48:52.872 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 10400, 2023-09-23T09:48:52.872 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 10400, 2023-09-23T09:48:52.872 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 10400, 2023-09-23T09:48:52.872 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 10400, 2023-09-23T09:48:52.872 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2023-09-23T09:48:52.872 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:52.873 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:52.873 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:52.873 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:52.873 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:52.873 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-write_buf_throttle": { 2023-09-23T09:48:52.873 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2023-09-23T09:48:52.873 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 3758096384, 2023-09-23T09:48:52.873 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2023-09-23T09:48:52.873 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 0, 2023-09-23T09:48:52.873 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 0, 2023-09-23T09:48:52.873 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2023-09-23T09:48:52.873 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 0, 2023-09-23T09:48:52.873 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 0, 2023-09-23T09:48:52.874 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 0, 2023-09-23T09:48:52.874 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 0, 2023-09-23T09:48:52.874 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 0, 2023-09-23T09:48:52.874 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2023-09-23T09:48:52.874 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:52.874 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:52.874 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:52.874 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:52.874 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:52.874 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-write_buf_throttle-0x55c5302daa00": { 2023-09-23T09:48:52.874 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2023-09-23T09:48:52.874 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 3758096384, 2023-09-23T09:48:52.875 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2023-09-23T09:48:52.875 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 0, 2023-09-23T09:48:52.875 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 0, 2023-09-23T09:48:52.875 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2023-09-23T09:48:52.875 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 0, 2023-09-23T09:48:52.875 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 0, 2023-09-23T09:48:52.875 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 0, 2023-09-23T09:48:52.875 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 0, 2023-09-23T09:48:52.875 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 0, 2023-09-23T09:48:52.875 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2023-09-23T09:48:52.875 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:52.875 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:52.875 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:52.876 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:52.876 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:52.876 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:48:53.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:48:53 smithi082 ceph-mon[97694]: pgmap v1652: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-09-23T09:48:53.263 INFO:tasks.check_counter:Daemon mds.g mds.exported=0 2023-09-23T09:48:53.263 INFO:tasks.check_counter:Daemon mds.g mds.imported=0 2023-09-23T09:48:53.263 INFO:tasks.check_counter:Daemon mds.g mds.root_rsnaps=0 2023-09-23T09:48:53.263 INFO:tasks.check_counter:Daemon mds.g mds_server.req_mksnap_latency.avgcount=0 2023-09-23T09:48:53.263 INFO:tasks.check_counter:Daemon mds.g mds_server.req_rmsnap_latency.avgcount=0 2023-09-23T09:48:53.263 DEBUG:tasks.check_counter:Getting stats from j 2023-09-23T09:48:53.263 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- ceph daemon mds.j perf dump 2023-09-23T09:48:53.396 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:48:53 smithi161 ceph-mon[99580]: pgmap v1652: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-09-23T09:48:53.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:48:53 smithi135 ceph-mon[99205]: pgmap v1652: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-09-23T09:48:53.991 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.a/config 2023-09-23T09:48:55.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:48:55 smithi082 ceph-mon[97694]: pgmap v1653: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-09-23T09:48:55.396 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:48:55 smithi161 ceph-mon[99580]: pgmap v1653: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-09-23T09:48:55.531 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-09-23T09:48:55.531 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-0": { 2023-09-23T09:48:55.531 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 875, 2023-09-23T09:48:55.531 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 864, 2023-09-23T09:48:55.532 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 1734112, 2023-09-23T09:48:55.532 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 523392, 2023-09-23T09:48:55.532 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 4, 2023-09-23T09:48:55.532 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 0, 2023-09-23T09:48:55.532 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.145484951, 2023-09-23T09:48:55.532 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.064045982, 2023-09-23T09:48:55.532 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.058142425, 2023-09-23T09:48:55.532 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.019467429, 2023-09-23T09:48:55.532 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2023-09-23T09:48:55.532 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 863, 2023-09-23T09:48:55.532 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.064036230, 2023-09-23T09:48:55.532 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000074201 2023-09-23T09:48:55.533 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:55.533 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2023-09-23T09:48:55.533 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:55.533 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:55.533 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:55.533 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:55.533 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 1734112, 2023-09-23T09:48:55.533 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 523392 2023-09-23T09:48:55.533 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:55.533 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-1": { 2023-09-23T09:48:55.533 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 9, 2023-09-23T09:48:55.533 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 665, 2023-09-23T09:48:55.534 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 3712, 2023-09-23T09:48:55.534 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 498528, 2023-09-23T09:48:55.534 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 8, 2023-09-23T09:48:55.534 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 3, 2023-09-23T09:48:55.534 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.057887494, 2023-09-23T09:48:55.534 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.044663082, 2023-09-23T09:48:55.534 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.004810796, 2023-09-23T09:48:55.534 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-09-23T09:48:55.534 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2023-09-23T09:48:55.534 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 663, 2023-09-23T09:48:55.534 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.060886204, 2023-09-23T09:48:55.534 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000091834 2023-09-23T09:48:55.535 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:55.535 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2023-09-23T09:48:55.535 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:55.535 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:55.535 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:55.535 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:55.535 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 3712, 2023-09-23T09:48:55.535 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 498528 2023-09-23T09:48:55.535 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:55.537 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-2": { 2023-09-23T09:48:55.537 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 0, 2023-09-23T09:48:55.537 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 2, 2023-09-23T09:48:55.537 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 0, 2023-09-23T09:48:55.537 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 0, 2023-09-23T09:48:55.537 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 2, 2023-09-23T09:48:55.537 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 1, 2023-09-23T09:48:55.537 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.000616845, 2023-09-23T09:48:55.537 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.000000000, 2023-09-23T09:48:55.537 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.000481048, 2023-09-23T09:48:55.537 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-09-23T09:48:55.538 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2023-09-23T09:48:55.538 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:55.538 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:55.538 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:55.538 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:55.538 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2023-09-23T09:48:55.538 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:55.538 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:55.538 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:55.538 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:55.538 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 0, 2023-09-23T09:48:55.538 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 0 2023-09-23T09:48:55.539 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:55.539 INFO:teuthology.orchestra.run.smithi082.stdout: "cct": { 2023-09-23T09:48:55.539 INFO:teuthology.orchestra.run.smithi082.stdout: "total_workers": 0, 2023-09-23T09:48:55.539 INFO:teuthology.orchestra.run.smithi082.stdout: "unhealthy_workers": 0 2023-09-23T09:48:55.539 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:55.539 INFO:teuthology.orchestra.run.smithi082.stdout: "mempool": { 2023-09-23T09:48:55.539 INFO:teuthology.orchestra.run.smithi082.stdout: "bloom_filter_bytes": 0, 2023-09-23T09:48:55.539 INFO:teuthology.orchestra.run.smithi082.stdout: "bloom_filter_items": 0, 2023-09-23T09:48:55.539 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_alloc_bytes": 0, 2023-09-23T09:48:55.539 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_alloc_items": 0, 2023-09-23T09:48:55.539 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_data_bytes": 0, 2023-09-23T09:48:55.539 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_data_items": 0, 2023-09-23T09:48:55.539 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_onode_bytes": 0, 2023-09-23T09:48:55.540 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_onode_items": 0, 2023-09-23T09:48:55.540 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_meta_bytes": 0, 2023-09-23T09:48:55.540 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_meta_items": 0, 2023-09-23T09:48:55.540 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_other_bytes": 0, 2023-09-23T09:48:55.540 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_other_items": 0, 2023-09-23T09:48:55.540 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_buffer_bytes": 0, 2023-09-23T09:48:55.540 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_buffer_items": 0, 2023-09-23T09:48:55.540 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_extent_bytes": 0, 2023-09-23T09:48:55.540 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_extent_items": 0, 2023-09-23T09:48:55.540 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_blob_bytes": 0, 2023-09-23T09:48:55.540 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_blob_items": 0, 2023-09-23T09:48:55.540 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_shared_blob_bytes": 0, 2023-09-23T09:48:55.541 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_shared_blob_items": 0, 2023-09-23T09:48:55.541 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_inline_bl_bytes": 0, 2023-09-23T09:48:55.541 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_inline_bl_items": 0, 2023-09-23T09:48:55.541 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_fsck_bytes": 0, 2023-09-23T09:48:55.541 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_fsck_items": 0, 2023-09-23T09:48:55.541 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_txc_bytes": 0, 2023-09-23T09:48:55.541 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_txc_items": 0, 2023-09-23T09:48:55.541 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_deferred_bytes": 0, 2023-09-23T09:48:55.541 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_deferred_items": 0, 2023-09-23T09:48:55.541 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_bytes": 0, 2023-09-23T09:48:55.541 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_items": 0, 2023-09-23T09:48:55.541 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_bytes": 0, 2023-09-23T09:48:55.542 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_items": 0, 2023-09-23T09:48:55.542 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_reader_bytes": 0, 2023-09-23T09:48:55.542 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_reader_items": 0, 2023-09-23T09:48:55.542 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_writer_bytes": 0, 2023-09-23T09:48:55.542 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_writer_items": 0, 2023-09-23T09:48:55.542 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_anon_bytes": 148794, 2023-09-23T09:48:55.542 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_anon_items": 32, 2023-09-23T09:48:55.542 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_meta_bytes": 0, 2023-09-23T09:48:55.542 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_meta_items": 0, 2023-09-23T09:48:55.542 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_bytes": 0, 2023-09-23T09:48:55.542 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_items": 0, 2023-09-23T09:48:55.542 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_mapbl_bytes": 0, 2023-09-23T09:48:55.543 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_mapbl_items": 0, 2023-09-23T09:48:55.543 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_pglog_bytes": 0, 2023-09-23T09:48:55.543 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_pglog_items": 0, 2023-09-23T09:48:55.543 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_bytes": 0, 2023-09-23T09:48:55.543 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_items": 0, 2023-09-23T09:48:55.543 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_mapping_bytes": 0, 2023-09-23T09:48:55.543 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_mapping_items": 0, 2023-09-23T09:48:55.543 INFO:teuthology.orchestra.run.smithi082.stdout: "pgmap_bytes": 0, 2023-09-23T09:48:55.543 INFO:teuthology.orchestra.run.smithi082.stdout: "pgmap_items": 0, 2023-09-23T09:48:55.543 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_co_bytes": 928, 2023-09-23T09:48:55.543 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_co_items": 2, 2023-09-23T09:48:55.543 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_1_bytes": 0, 2023-09-23T09:48:55.544 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_1_items": 0, 2023-09-23T09:48:55.544 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_2_bytes": 0, 2023-09-23T09:48:55.544 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_2_items": 0 2023-09-23T09:48:55.544 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-09-23T09:48:55.544 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-09-23T09:48:55.544 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2023-09-23T09:48:55.544 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 104857600, 2023-09-23T09:48:55.544 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2023-09-23T09:48:55.544 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 880, 2023-09-23T09:48:55.544 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 1610392, 2023-09-23T09:48:55.544 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2023-09-23T09:48:55.544 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 880, 2023-09-23T09:48:55.545 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 0, 2023-09-23T09:48:55.545 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 0, 2023-09-23T09:48:55.545 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 880, 2023-09-23T09:48:55.545 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 1610392, 2023-09-23T09:48:55.545 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2023-09-23T09:48:55.545 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2023-09-23T09:48:55.545 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2023-09-23T09:48:55.545 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2023-09-23T09:48:55.545 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:55.545 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-09-23T09:48:55.545 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-09-23T09:48:55.560 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:48:55 smithi135 ceph-mon[99205]: pgmap v1653: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-09-23T09:48:55.980 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2023-09-23T09:48:55.980 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2023-09-23T09:48:55.980 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2023-09-23T09:48:55.981 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2023-09-23T09:48:55.981 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2023-09-23T09:48:55.981 DEBUG:tasks.check_counter:Getting stats from b 2023-09-23T09:48:55.981 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- ceph daemon mds.b perf dump 2023-09-23T09:48:57.087 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.b/config 2023-09-23T09:48:57.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:48:57 smithi082 ceph-mon[97694]: pgmap v1654: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-09-23T09:48:57.377 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:48:57 smithi135 ceph-mon[99205]: pgmap v1654: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-09-23T09:48:57.396 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:48:57 smithi161 ceph-mon[99580]: pgmap v1654: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-09-23T09:48:58.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:48:58 smithi135 ceph-mon[99205]: pgmap v1655: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-09-23T09:48:58.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:48:58 smithi082 ceph-mon[97694]: pgmap v1655: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-09-23T09:48:58.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:48:58 smithi161 ceph-mon[99580]: pgmap v1655: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-09-23T09:49:01.363 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:49:01 smithi135 ceph-mon[99205]: pgmap v1656: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-09-23T09:49:01.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:49:01 smithi082 ceph-mon[97694]: pgmap v1656: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-09-23T09:49:01.396 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:49:01 smithi161 ceph-mon[99580]: pgmap v1656: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-09-23T09:49:02.539 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2023-09-23T09:49:02.539 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-0": { 2023-09-23T09:49:02.539 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 9273135, 2023-09-23T09:49:02.539 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 8998039, 2023-09-23T09:49:02.539 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 1550249657, 2023-09-23T09:49:02.539 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 1600680336, 2023-09-23T09:49:02.539 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 133, 2023-09-23T09:49:02.539 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 3, 2023-09-23T09:49:02.539 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 436.777552086, 2023-09-23T09:49:02.540 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 186.372411431, 2023-09-23T09:49:02.540 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 293.266739758, 2023-09-23T09:49:02.540 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 1.676541225, 2023-09-23T09:49:02.540 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2023-09-23T09:49:02.540 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 8998038, 2023-09-23T09:49:02.540 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 159.853107480, 2023-09-23T09:49:02.540 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000017765 2023-09-23T09:49:02.540 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:02.540 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2023-09-23T09:49:02.540 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 18251241, 2023-09-23T09:49:02.540 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 1.728697664, 2023-09-23T09:49:02.540 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000094 2023-09-23T09:49:02.541 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:02.541 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 3072, 2023-09-23T09:49:02.541 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 705920 2023-09-23T09:49:02.541 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:02.541 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-1": { 2023-09-23T09:49:02.541 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 199616, 2023-09-23T09:49:02.541 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 348053, 2023-09-23T09:49:02.541 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 68191489, 2023-09-23T09:49:02.541 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 261613383, 2023-09-23T09:49:02.541 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 18, 2023-09-23T09:49:02.541 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 6, 2023-09-23T09:49:02.542 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 22.223314706, 2023-09-23T09:49:02.542 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 8.742151314, 2023-09-23T09:49:02.542 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 10.556508584, 2023-09-23T09:49:02.542 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 3.488579230, 2023-09-23T09:49:02.542 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2023-09-23T09:49:02.542 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 348050, 2023-09-23T09:49:02.542 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 22.493164004, 2023-09-23T09:49:02.542 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000064626 2023-09-23T09:49:02.542 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:02.542 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2023-09-23T09:49:02.542 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 476468, 2023-09-23T09:49:02.542 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.108913937, 2023-09-23T09:49:02.543 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000228 2023-09-23T09:49:02.543 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:02.543 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 1782224, 2023-09-23T09:49:02.543 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 752880 2023-09-23T09:49:02.543 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:02.543 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-2": { 2023-09-23T09:49:02.543 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 4295898, 2023-09-23T09:49:02.543 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 4310164, 2023-09-23T09:49:02.543 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 696867234, 2023-09-23T09:49:02.543 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 772072969, 2023-09-23T09:49:02.543 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 155, 2023-09-23T09:49:02.543 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 7, 2023-09-23T09:49:02.544 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 305.057465631, 2023-09-23T09:49:02.544 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 148.429086838, 2023-09-23T09:49:02.544 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 201.397013459, 2023-09-23T09:49:02.544 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 1.171490514, 2023-09-23T09:49:02.544 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2023-09-23T09:49:02.544 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 4310163, 2023-09-23T09:49:02.544 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 84.530555327, 2023-09-23T09:49:02.544 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000019611 2023-09-23T09:49:02.544 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:02.544 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2023-09-23T09:49:02.544 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 8591763, 2023-09-23T09:49:02.544 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.951320330, 2023-09-23T09:49:02.545 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000110 2023-09-23T09:49:02.545 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:02.545 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 2688464, 2023-09-23T09:49:02.545 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 1113968 2023-09-23T09:49:02.545 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:02.545 INFO:teuthology.orchestra.run.smithi135.stdout: "cct": { 2023-09-23T09:49:02.545 INFO:teuthology.orchestra.run.smithi135.stdout: "total_workers": 1, 2023-09-23T09:49:02.545 INFO:teuthology.orchestra.run.smithi135.stdout: "unhealthy_workers": 0 2023-09-23T09:49:02.545 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:02.545 INFO:teuthology.orchestra.run.smithi135.stdout: "finisher-MDSRank": { 2023-09-23T09:49:02.545 INFO:teuthology.orchestra.run.smithi135.stdout: "queue_len": 0, 2023-09-23T09:49:02.546 INFO:teuthology.orchestra.run.smithi135.stdout: "complete_latency": { 2023-09-23T09:49:02.546 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 18760, 2023-09-23T09:49:02.546 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 8.739022169, 2023-09-23T09:49:02.546 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000465832 2023-09-23T09:49:02.546 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-09-23T09:49:02.546 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:02.546 INFO:teuthology.orchestra.run.smithi135.stdout: "finisher-PurgeQueue": { 2023-09-23T09:49:02.546 INFO:teuthology.orchestra.run.smithi135.stdout: "queue_len": 0, 2023-09-23T09:49:02.546 INFO:teuthology.orchestra.run.smithi135.stdout: "complete_latency": { 2023-09-23T09:49:02.546 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 529, 2023-09-23T09:49:02.546 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.028000996, 2023-09-23T09:49:02.546 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000052931 2023-09-23T09:49:02.547 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-09-23T09:49:02.547 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:02.547 INFO:teuthology.orchestra.run.smithi135.stdout: "mds": { 2023-09-23T09:49:02.547 INFO:teuthology.orchestra.run.smithi135.stdout: "request": 21069, 2023-09-23T09:49:02.547 INFO:teuthology.orchestra.run.smithi135.stdout: "reply": 16252, 2023-09-23T09:49:02.547 INFO:teuthology.orchestra.run.smithi135.stdout: "reply_latency": { 2023-09-23T09:49:02.547 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 16252, 2023-09-23T09:49:02.547 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 568.237793596, 2023-09-23T09:49:02.547 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.034964176 2023-09-23T09:49:02.547 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:02.547 INFO:teuthology.orchestra.run.smithi135.stdout: "slow_reply": 0, 2023-09-23T09:49:02.548 INFO:teuthology.orchestra.run.smithi135.stdout: "forward": 4817, 2023-09-23T09:49:02.548 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_fetch_complete": 8, 2023-09-23T09:49:02.548 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_fetch_keys": 0, 2023-09-23T09:49:02.548 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_commit": 58, 2023-09-23T09:49:02.548 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_split": 5, 2023-09-23T09:49:02.548 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_merge": 2, 2023-09-23T09:49:02.548 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes": 638, 2023-09-23T09:49:02.548 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_top": 5, 2023-09-23T09:49:02.548 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_bottom": 383, 2023-09-23T09:49:02.548 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_pin_tail": 250, 2023-09-23T09:49:02.548 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_pinned": 623, 2023-09-23T09:49:02.548 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_expired": 5235, 2023-09-23T09:49:02.549 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_with_caps": 162, 2023-09-23T09:49:02.549 INFO:teuthology.orchestra.run.smithi135.stdout: "caps": 162, 2023-09-23T09:49:02.549 INFO:teuthology.orchestra.run.smithi135.stdout: "subtrees": 18, 2023-09-23T09:49:02.549 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse": 44065, 2023-09-23T09:49:02.549 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_hit": 35729, 2023-09-23T09:49:02.549 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_forward": 4564, 2023-09-23T09:49:02.549 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_discover": 186, 2023-09-23T09:49:02.549 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_dir_fetch": 2, 2023-09-23T09:49:02.549 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_remote_ino": 1, 2023-09-23T09:49:02.549 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_lock": 2116, 2023-09-23T09:49:02.549 INFO:teuthology.orchestra.run.smithi135.stdout: "load_cent": 0, 2023-09-23T09:49:02.549 INFO:teuthology.orchestra.run.smithi135.stdout: "q": 0, 2023-09-23T09:49:02.550 INFO:teuthology.orchestra.run.smithi135.stdout: "exported": 75, 2023-09-23T09:49:02.550 INFO:teuthology.orchestra.run.smithi135.stdout: "exported_inodes": 4662, 2023-09-23T09:49:02.550 INFO:teuthology.orchestra.run.smithi135.stdout: "imported": 83, 2023-09-23T09:49:02.550 INFO:teuthology.orchestra.run.smithi135.stdout: "imported_inodes": 3914, 2023-09-23T09:49:02.550 INFO:teuthology.orchestra.run.smithi135.stdout: "openino_dir_fetch": 0, 2023-09-23T09:49:02.550 INFO:teuthology.orchestra.run.smithi135.stdout: "openino_backtrace_fetch": 1907, 2023-09-23T09:49:02.550 INFO:teuthology.orchestra.run.smithi135.stdout: "openino_peer_discover": 4, 2023-09-23T09:49:02.550 INFO:teuthology.orchestra.run.smithi135.stdout: "root_rfiles": 1045, 2023-09-23T09:49:02.550 INFO:teuthology.orchestra.run.smithi135.stdout: "root_rbytes": 8989915630, 2023-09-23T09:49:02.550 INFO:teuthology.orchestra.run.smithi135.stdout: "root_rsnaps": 7, 2023-09-23T09:49:02.550 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_backtrace_fetch": 1907, 2023-09-23T09:49:02.550 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_set_tag": 0, 2023-09-23T09:49:02.551 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_backtrace_repaired": 0, 2023-09-23T09:49:02.551 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_inotable_repaired": 0, 2023-09-23T09:49:02.551 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_dir_inodes": 302, 2023-09-23T09:49:02.551 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_dir_base_inodes": 11, 2023-09-23T09:49:02.551 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_dirfrag_rstats": 291, 2023-09-23T09:49:02.551 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_file_inodes": 1605, 2023-09-23T09:49:02.551 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_inode_file_caps": 396, 2023-09-23T09:49:02.551 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_revoke": 157866, 2023-09-23T09:49:02.551 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_grant": 152368, 2023-09-23T09:49:02.551 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_trunc": 0, 2023-09-23T09:49:02.551 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-09-23T09:49:02.551 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_flush_ack": 0, 2023-09-23T09:49:02.552 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_caps": 166491, 2023-09-23T09:49:02.552 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_caps_dirty": 3727, 2023-09-23T09:49:02.552 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_cap_release": 234, 2023-09-23T09:49:02.552 INFO:teuthology.orchestra.run.smithi135.stdout: "process_request_cap_release": 1838 2023-09-23T09:49:02.552 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:02.552 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_cache": { 2023-09-23T09:49:02.552 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_update": 0, 2023-09-23T09:49:02.552 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_update_receipt": 0, 2023-09-23T09:49:02.552 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_try_discover": 0, 2023-09-23T09:49:02.552 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_send_discover": 202, 2023-09-23T09:49:02.552 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_handle_discover": 405, 2023-09-23T09:49:02.553 INFO:teuthology.orchestra.run.smithi135.stdout: "num_strays": 2, 2023-09-23T09:49:02.553 INFO:teuthology.orchestra.run.smithi135.stdout: "num_strays_delayed": 0, 2023-09-23T09:49:02.553 INFO:teuthology.orchestra.run.smithi135.stdout: "num_strays_enqueuing": 0, 2023-09-23T09:49:02.553 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_created": 170, 2023-09-23T09:49:02.553 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_enqueued": 109, 2023-09-23T09:49:02.553 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_reintegrated": 367, 2023-09-23T09:49:02.553 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_migrated": 45, 2023-09-23T09:49:02.553 INFO:teuthology.orchestra.run.smithi135.stdout: "num_recovering_processing": 0, 2023-09-23T09:49:02.553 INFO:teuthology.orchestra.run.smithi135.stdout: "num_recovering_enqueued": 0, 2023-09-23T09:49:02.553 INFO:teuthology.orchestra.run.smithi135.stdout: "num_recovering_prioritized": 0, 2023-09-23T09:49:02.553 INFO:teuthology.orchestra.run.smithi135.stdout: "recovery_started": 0, 2023-09-23T09:49:02.553 INFO:teuthology.orchestra.run.smithi135.stdout: "recovery_completed": 0, 2023-09-23T09:49:02.554 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_enqueue_scrub": 11, 2023-09-23T09:49:02.554 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_exportdir": 77, 2023-09-23T09:49:02.554 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_flush": 0, 2023-09-23T09:49:02.554 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_fragmentdir": 7, 2023-09-23T09:49:02.554 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_fragstats": 0, 2023-09-23T09:49:02.554 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_inodestats": 0 2023-09-23T09:49:02.554 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:02.554 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_log": { 2023-09-23T09:49:02.554 INFO:teuthology.orchestra.run.smithi135.stdout: "evlrg": 0, 2023-09-23T09:49:02.554 INFO:teuthology.orchestra.run.smithi135.stdout: "evadd": 14141, 2023-09-23T09:49:02.554 INFO:teuthology.orchestra.run.smithi135.stdout: "evex": 0, 2023-09-23T09:49:02.554 INFO:teuthology.orchestra.run.smithi135.stdout: "evtrm": 0, 2023-09-23T09:49:02.555 INFO:teuthology.orchestra.run.smithi135.stdout: "ev": 14141, 2023-09-23T09:49:02.555 INFO:teuthology.orchestra.run.smithi135.stdout: "evexg": 0, 2023-09-23T09:49:02.555 INFO:teuthology.orchestra.run.smithi135.stdout: "evexd": 0, 2023-09-23T09:49:02.555 INFO:teuthology.orchestra.run.smithi135.stdout: "segadd": 76, 2023-09-23T09:49:02.555 INFO:teuthology.orchestra.run.smithi135.stdout: "segex": 0, 2023-09-23T09:49:02.555 INFO:teuthology.orchestra.run.smithi135.stdout: "segtrm": 0, 2023-09-23T09:49:02.555 INFO:teuthology.orchestra.run.smithi135.stdout: "seg": 76, 2023-09-23T09:49:02.555 INFO:teuthology.orchestra.run.smithi135.stdout: "segmjr": 3, 2023-09-23T09:49:02.555 INFO:teuthology.orchestra.run.smithi135.stdout: "segexg": 0, 2023-09-23T09:49:02.555 INFO:teuthology.orchestra.run.smithi135.stdout: "segexd": 0, 2023-09-23T09:49:02.555 INFO:teuthology.orchestra.run.smithi135.stdout: "expos": 4194304, 2023-09-23T09:49:02.555 INFO:teuthology.orchestra.run.smithi135.stdout: "wrpos": 301408926, 2023-09-23T09:49:02.556 INFO:teuthology.orchestra.run.smithi135.stdout: "rdpos": 0, 2023-09-23T09:49:02.556 INFO:teuthology.orchestra.run.smithi135.stdout: "jlat": { 2023-09-23T09:49:02.556 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 8815, 2023-09-23T09:49:02.556 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 49.182776740, 2023-09-23T09:49:02.556 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.005579441 2023-09-23T09:49:02.556 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:02.556 INFO:teuthology.orchestra.run.smithi135.stdout: "replayed": 0 2023-09-23T09:49:02.556 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:02.556 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_mem": { 2023-09-23T09:49:02.556 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 431, 2023-09-23T09:49:02.556 INFO:teuthology.orchestra.run.smithi135.stdout: "ino+": 4942, 2023-09-23T09:49:02.556 INFO:teuthology.orchestra.run.smithi135.stdout: "ino-": 4511, 2023-09-23T09:49:02.557 INFO:teuthology.orchestra.run.smithi135.stdout: "dir": 84, 2023-09-23T09:49:02.557 INFO:teuthology.orchestra.run.smithi135.stdout: "dir+": 259, 2023-09-23T09:49:02.557 INFO:teuthology.orchestra.run.smithi135.stdout: "dir-": 175, 2023-09-23T09:49:02.557 INFO:teuthology.orchestra.run.smithi135.stdout: "dn": 638, 2023-09-23T09:49:02.557 INFO:teuthology.orchestra.run.smithi135.stdout: "dn+": 5985, 2023-09-23T09:49:02.557 INFO:teuthology.orchestra.run.smithi135.stdout: "dn-": 5347, 2023-09-23T09:49:02.557 INFO:teuthology.orchestra.run.smithi135.stdout: "cap": 162, 2023-09-23T09:49:02.557 INFO:teuthology.orchestra.run.smithi135.stdout: "cap+": 3701, 2023-09-23T09:49:02.557 INFO:teuthology.orchestra.run.smithi135.stdout: "cap-": 3539, 2023-09-23T09:49:02.557 INFO:teuthology.orchestra.run.smithi135.stdout: "rss": 77028, 2023-09-23T09:49:02.557 INFO:teuthology.orchestra.run.smithi135.stdout: "heap": 207152 2023-09-23T09:49:02.557 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:02.557 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_server": { 2023-09-23T09:49:02.558 INFO:teuthology.orchestra.run.smithi135.stdout: "dispatch_client_request": 37290, 2023-09-23T09:49:02.558 INFO:teuthology.orchestra.run.smithi135.stdout: "dispatch_server_request": 9737, 2023-09-23T09:49:02.558 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_request": 21069, 2023-09-23T09:49:02.558 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_session": 327, 2023-09-23T09:49:02.558 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_peer_request": 16764, 2023-09-23T09:49:02.558 INFO:teuthology.orchestra.run.smithi135.stdout: "req_create_latency": { 2023-09-23T09:49:02.558 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 1191, 2023-09-23T09:49:02.558 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 8.312600568, 2023-09-23T09:49:02.558 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.006979513 2023-09-23T09:49:02.558 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:02.558 INFO:teuthology.orchestra.run.smithi135.stdout: "req_getattr_latency": { 2023-09-23T09:49:02.558 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 1305, 2023-09-23T09:49:02.558 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 1.153162198, 2023-09-23T09:49:02.559 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000883649 2023-09-23T09:49:02.559 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:02.559 INFO:teuthology.orchestra.run.smithi135.stdout: "req_getfilelock_latency": { 2023-09-23T09:49:02.559 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:02.559 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:02.559 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:02.559 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:02.559 INFO:teuthology.orchestra.run.smithi135.stdout: "req_link_latency": { 2023-09-23T09:49:02.559 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 61, 2023-09-23T09:49:02.559 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 1.109607596, 2023-09-23T09:49:02.559 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.018190288 2023-09-23T09:49:02.559 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:02.560 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookup_latency": { 2023-09-23T09:49:02.560 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 9900, 2023-09-23T09:49:02.560 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 440.948038342, 2023-09-23T09:49:02.560 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.044540205 2023-09-23T09:49:02.560 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:02.560 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookuphash_latency": { 2023-09-23T09:49:02.560 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:02.560 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:02.560 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:02.560 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:02.560 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupino_latency": { 2023-09-23T09:49:02.560 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:02.560 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:02.560 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:02.561 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:02.561 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupname_latency": { 2023-09-23T09:49:02.561 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:02.561 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:02.561 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:02.561 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:02.561 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupparent_latency": { 2023-09-23T09:49:02.561 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:02.561 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:02.561 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:02.561 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:02.561 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupsnap_latency": { 2023-09-23T09:49:02.561 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:02.562 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:02.562 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:02.562 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:02.562 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lssnap_latency": { 2023-09-23T09:49:02.562 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 53, 2023-09-23T09:49:02.562 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.011567915, 2023-09-23T09:49:02.562 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000218262 2023-09-23T09:49:02.562 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:02.562 INFO:teuthology.orchestra.run.smithi135.stdout: "req_mkdir_latency": { 2023-09-23T09:49:02.562 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 34, 2023-09-23T09:49:02.562 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.038585150, 2023-09-23T09:49:02.562 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.001134857 2023-09-23T09:49:02.562 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:02.563 INFO:teuthology.orchestra.run.smithi135.stdout: "req_mknod_latency": { 2023-09-23T09:49:02.563 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:02.563 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:02.563 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:02.563 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:02.563 INFO:teuthology.orchestra.run.smithi135.stdout: "req_mksnap_latency": { 2023-09-23T09:49:02.563 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 53, 2023-09-23T09:49:02.563 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 6.563484987, 2023-09-23T09:49:02.563 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.123839339 2023-09-23T09:49:02.563 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:02.563 INFO:teuthology.orchestra.run.smithi135.stdout: "req_open_latency": { 2023-09-23T09:49:02.563 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 2901, 2023-09-23T09:49:02.564 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 1.524460558, 2023-09-23T09:49:02.564 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000525494 2023-09-23T09:49:02.564 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:02.564 INFO:teuthology.orchestra.run.smithi135.stdout: "req_readdir_latency": { 2023-09-23T09:49:02.564 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 106, 2023-09-23T09:49:02.564 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.187020804, 2023-09-23T09:49:02.564 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.001764347 2023-09-23T09:49:02.564 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:02.564 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rename_latency": { 2023-09-23T09:49:02.564 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 512, 2023-09-23T09:49:02.564 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 99.330210975, 2023-09-23T09:49:02.564 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.194004318 2023-09-23T09:49:02.564 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:02.565 INFO:teuthology.orchestra.run.smithi135.stdout: "req_renamesnap_latency": { 2023-09-23T09:49:02.565 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:02.565 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:02.565 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:02.565 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:02.565 INFO:teuthology.orchestra.run.smithi135.stdout: "req_snapdiff_latency": { 2023-09-23T09:49:02.565 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:02.565 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:02.565 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:02.565 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:02.565 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rmdir_latency": { 2023-09-23T09:49:02.565 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:02.565 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:02.566 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:02.566 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:02.566 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rmsnap_latency": { 2023-09-23T09:49:02.566 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 46, 2023-09-23T09:49:02.566 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 8.678067703, 2023-09-23T09:49:02.566 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.188653645 2023-09-23T09:49:02.566 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:02.566 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rmxattr_latency": { 2023-09-23T09:49:02.566 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:02.566 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:02.567 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:02.567 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:02.567 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setattr_latency": { 2023-09-23T09:49:02.567 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 1, 2023-09-23T09:49:02.567 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.001270428, 2023-09-23T09:49:02.567 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.001270428 2023-09-23T09:49:02.567 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:02.567 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setdirlayout_latency": { 2023-09-23T09:49:02.567 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:02.567 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:02.567 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:02.567 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:02.567 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setfilelock_latency": { 2023-09-23T09:49:02.568 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:02.568 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:02.568 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:02.568 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:02.568 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setlayout_latency": { 2023-09-23T09:49:02.568 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:02.568 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:02.568 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:02.568 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:02.568 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setxattr_latency": { 2023-09-23T09:49:02.568 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 6, 2023-09-23T09:49:02.568 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.018869804, 2023-09-23T09:49:02.568 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.003144967 2023-09-23T09:49:02.569 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:02.569 INFO:teuthology.orchestra.run.smithi135.stdout: "req_symlink_latency": { 2023-09-23T09:49:02.569 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:02.569 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:02.569 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:02.569 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:02.569 INFO:teuthology.orchestra.run.smithi135.stdout: "req_unlink_latency": { 2023-09-23T09:49:02.569 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 83, 2023-09-23T09:49:02.569 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.360846568, 2023-09-23T09:49:02.569 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.004347549 2023-09-23T09:49:02.569 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:02.569 INFO:teuthology.orchestra.run.smithi135.stdout: "cap_revoke_eviction": 0, 2023-09-23T09:49:02.569 INFO:teuthology.orchestra.run.smithi135.stdout: "cap_acquisition_throttle": 0, 2023-09-23T09:49:02.569 INFO:teuthology.orchestra.run.smithi135.stdout: "req_getvxattr_latency": { 2023-09-23T09:49:02.570 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:02.570 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:02.570 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:02.570 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-09-23T09:49:02.570 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:02.570 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_sessions": { 2023-09-23T09:49:02.570 INFO:teuthology.orchestra.run.smithi135.stdout: "session_count": 2, 2023-09-23T09:49:02.570 INFO:teuthology.orchestra.run.smithi135.stdout: "session_add": 5, 2023-09-23T09:49:02.570 INFO:teuthology.orchestra.run.smithi135.stdout: "session_remove": 3, 2023-09-23T09:49:02.570 INFO:teuthology.orchestra.run.smithi135.stdout: "sessions_open": 2, 2023-09-23T09:49:02.570 INFO:teuthology.orchestra.run.smithi135.stdout: "sessions_stale": 0, 2023-09-23T09:49:02.570 INFO:teuthology.orchestra.run.smithi135.stdout: "total_load": 62, 2023-09-23T09:49:02.570 INFO:teuthology.orchestra.run.smithi135.stdout: "average_load": 31, 2023-09-23T09:49:02.571 INFO:teuthology.orchestra.run.smithi135.stdout: "avg_session_uptime": 3133 2023-09-23T09:49:02.571 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:02.571 INFO:teuthology.orchestra.run.smithi135.stdout: "mempool": { 2023-09-23T09:49:02.571 INFO:teuthology.orchestra.run.smithi135.stdout: "bloom_filter_bytes": 0, 2023-09-23T09:49:02.571 INFO:teuthology.orchestra.run.smithi135.stdout: "bloom_filter_items": 0, 2023-09-23T09:49:02.571 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_alloc_bytes": 0, 2023-09-23T09:49:02.571 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_alloc_items": 0, 2023-09-23T09:49:02.571 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_data_bytes": 0, 2023-09-23T09:49:02.571 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_data_items": 0, 2023-09-23T09:49:02.571 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_onode_bytes": 0, 2023-09-23T09:49:02.571 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_onode_items": 0, 2023-09-23T09:49:02.571 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_meta_bytes": 0, 2023-09-23T09:49:02.571 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_meta_items": 0, 2023-09-23T09:49:02.572 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_other_bytes": 0, 2023-09-23T09:49:02.572 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_other_items": 0, 2023-09-23T09:49:02.572 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_buffer_bytes": 0, 2023-09-23T09:49:02.572 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_buffer_items": 0, 2023-09-23T09:49:02.572 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_extent_bytes": 0, 2023-09-23T09:49:02.572 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_extent_items": 0, 2023-09-23T09:49:02.572 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_blob_bytes": 0, 2023-09-23T09:49:02.572 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_blob_items": 0, 2023-09-23T09:49:02.572 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_shared_blob_bytes": 0, 2023-09-23T09:49:02.572 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_shared_blob_items": 0, 2023-09-23T09:49:02.572 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_inline_bl_bytes": 0, 2023-09-23T09:49:02.572 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_inline_bl_items": 0, 2023-09-23T09:49:02.572 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_fsck_bytes": 0, 2023-09-23T09:49:02.573 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_fsck_items": 0, 2023-09-23T09:49:02.573 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_txc_bytes": 0, 2023-09-23T09:49:02.573 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_txc_items": 0, 2023-09-23T09:49:02.573 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_deferred_bytes": 0, 2023-09-23T09:49:02.573 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_deferred_items": 0, 2023-09-23T09:49:02.573 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_bytes": 0, 2023-09-23T09:49:02.573 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_items": 0, 2023-09-23T09:49:02.573 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_bytes": 0, 2023-09-23T09:49:02.573 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_items": 0, 2023-09-23T09:49:02.573 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_reader_bytes": 0, 2023-09-23T09:49:02.573 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_reader_items": 0, 2023-09-23T09:49:02.573 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_writer_bytes": 0, 2023-09-23T09:49:02.573 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_writer_items": 0, 2023-09-23T09:49:02.574 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_anon_bytes": 659571, 2023-09-23T09:49:02.574 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_anon_items": 218, 2023-09-23T09:49:02.574 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_meta_bytes": 352, 2023-09-23T09:49:02.574 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_meta_items": 4, 2023-09-23T09:49:02.574 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_bytes": 0, 2023-09-23T09:49:02.574 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_items": 0, 2023-09-23T09:49:02.574 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_mapbl_bytes": 0, 2023-09-23T09:49:02.574 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_mapbl_items": 0, 2023-09-23T09:49:02.574 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_pglog_bytes": 0, 2023-09-23T09:49:02.574 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_pglog_items": 0, 2023-09-23T09:49:02.574 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_bytes": 8032, 2023-09-23T09:49:02.574 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_items": 167, 2023-09-23T09:49:02.574 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_mapping_bytes": 0, 2023-09-23T09:49:02.575 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_mapping_items": 0, 2023-09-23T09:49:02.575 INFO:teuthology.orchestra.run.smithi135.stdout: "pgmap_bytes": 0, 2023-09-23T09:49:02.575 INFO:teuthology.orchestra.run.smithi135.stdout: "pgmap_items": 0, 2023-09-23T09:49:02.575 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_co_bytes": 2419382, 2023-09-23T09:49:02.575 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_co_items": 48717, 2023-09-23T09:49:02.575 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_1_bytes": 0, 2023-09-23T09:49:02.575 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_1_items": 0, 2023-09-23T09:49:02.575 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_2_bytes": 0, 2023-09-23T09:49:02.575 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_2_items": 0 2023-09-23T09:49:02.575 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:02.575 INFO:teuthology.orchestra.run.smithi135.stdout: "objecter": { 2023-09-23T09:49:02.575 INFO:teuthology.orchestra.run.smithi135.stdout: "op_active": 0, 2023-09-23T09:49:02.576 INFO:teuthology.orchestra.run.smithi135.stdout: "op_laggy": 0, 2023-09-23T09:49:02.576 INFO:teuthology.orchestra.run.smithi135.stdout: "op_send": 12223, 2023-09-23T09:49:02.576 INFO:teuthology.orchestra.run.smithi135.stdout: "op_send_bytes": 297834850, 2023-09-23T09:49:02.576 INFO:teuthology.orchestra.run.smithi135.stdout: "op_resend": 31, 2023-09-23T09:49:02.576 INFO:teuthology.orchestra.run.smithi135.stdout: "op_reply": 12223, 2023-09-23T09:49:02.576 INFO:teuthology.orchestra.run.smithi135.stdout: "op_latency": { 2023-09-23T09:49:02.576 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 12223, 2023-09-23T09:49:02.576 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 70.156589011, 2023-09-23T09:49:02.576 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.005739719 2023-09-23T09:49:02.576 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:02.576 INFO:teuthology.orchestra.run.smithi135.stdout: "op_inflight": 0, 2023-09-23T09:49:02.576 INFO:teuthology.orchestra.run.smithi135.stdout: "oplen_avg": { 2023-09-23T09:49:02.577 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 12223, 2023-09-23T09:49:02.577 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 12690 2023-09-23T09:49:02.577 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:02.577 INFO:teuthology.orchestra.run.smithi135.stdout: "op": 12223, 2023-09-23T09:49:02.577 INFO:teuthology.orchestra.run.smithi135.stdout: "op_r": 2016, 2023-09-23T09:49:02.577 INFO:teuthology.orchestra.run.smithi135.stdout: "op_w": 10207, 2023-09-23T09:49:02.577 INFO:teuthology.orchestra.run.smithi135.stdout: "op_rmw": 0, 2023-09-23T09:49:02.577 INFO:teuthology.orchestra.run.smithi135.stdout: "op_pg": 0, 2023-09-23T09:49:02.577 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_stat": 0, 2023-09-23T09:49:02.577 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_create": 11, 2023-09-23T09:49:02.577 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_read": 84, 2023-09-23T09:49:02.577 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_write": 8888, 2023-09-23T09:49:02.577 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_writefull": 243, 2023-09-23T09:49:02.578 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_writesame": 0, 2023-09-23T09:49:02.578 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_append": 0, 2023-09-23T09:49:02.578 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_zero": 2, 2023-09-23T09:49:02.578 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_truncate": 4, 2023-09-23T09:49:02.578 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_delete": 700, 2023-09-23T09:49:02.578 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_mapext": 0, 2023-09-23T09:49:02.578 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_sparse_read": 0, 2023-09-23T09:49:02.578 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_clonerange": 0, 2023-09-23T09:49:02.578 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_getxattr": 1918, 2023-09-23T09:49:02.578 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_setxattr": 22, 2023-09-23T09:49:02.578 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_cmpxattr": 0, 2023-09-23T09:49:02.578 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_rmxattr": 0, 2023-09-23T09:49:02.578 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_resetxattrs": 0, 2023-09-23T09:49:02.579 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_call": 0, 2023-09-23T09:49:02.579 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_watch": 0, 2023-09-23T09:49:02.579 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_notify": 0, 2023-09-23T09:49:02.579 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_src_cmpxattr": 0, 2023-09-23T09:49:02.579 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_pgls": 0, 2023-09-23T09:49:02.579 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_pgls_filter": 0, 2023-09-23T09:49:02.579 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_other": 0, 2023-09-23T09:49:02.579 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_active": 0, 2023-09-23T09:49:02.579 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_send": 0, 2023-09-23T09:49:02.579 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_resend": 0, 2023-09-23T09:49:02.579 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_ping": 0, 2023-09-23T09:49:02.579 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_active": 0, 2023-09-23T09:49:02.579 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_send": 0, 2023-09-23T09:49:02.580 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_resend": 0, 2023-09-23T09:49:02.580 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_active": 0, 2023-09-23T09:49:02.580 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_send": 0, 2023-09-23T09:49:02.580 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_resend": 0, 2023-09-23T09:49:02.580 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_active": 0, 2023-09-23T09:49:02.580 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_send": 0, 2023-09-23T09:49:02.580 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_resend": 0, 2023-09-23T09:49:02.580 INFO:teuthology.orchestra.run.smithi135.stdout: "command_active": 0, 2023-09-23T09:49:02.580 INFO:teuthology.orchestra.run.smithi135.stdout: "command_send": 0, 2023-09-23T09:49:02.580 INFO:teuthology.orchestra.run.smithi135.stdout: "command_resend": 0, 2023-09-23T09:49:02.580 INFO:teuthology.orchestra.run.smithi135.stdout: "map_epoch": 179, 2023-09-23T09:49:02.580 INFO:teuthology.orchestra.run.smithi135.stdout: "map_full": 0, 2023-09-23T09:49:02.580 INFO:teuthology.orchestra.run.smithi135.stdout: "map_inc": 94, 2023-09-23T09:49:02.581 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_sessions": 12, 2023-09-23T09:49:02.581 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_session_open": 12, 2023-09-23T09:49:02.581 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_session_close": 0, 2023-09-23T09:49:02.581 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_laggy": 0, 2023-09-23T09:49:02.581 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_wr": 616, 2023-09-23T09:49:02.581 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_rd": 22, 2023-09-23T09:49:02.581 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_del": 180 2023-09-23T09:49:02.581 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:02.581 INFO:teuthology.orchestra.run.smithi135.stdout: "oft": { 2023-09-23T09:49:02.581 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_objs": 1, 2023-09-23T09:49:02.581 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_kv_pairs": 0, 2023-09-23T09:49:02.581 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_updates": 0, 2023-09-23T09:49:02.581 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_removes": 0 2023-09-23T09:49:02.582 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:02.582 INFO:teuthology.orchestra.run.smithi135.stdout: "osd-slow-ops": { 2023-09-23T09:49:02.582 INFO:teuthology.orchestra.run.smithi135.stdout: "slow_ops_count": 0 2023-09-23T09:49:02.582 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:02.582 INFO:teuthology.orchestra.run.smithi135.stdout: "purge_queue": { 2023-09-23T09:49:02.582 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing_ops": 0, 2023-09-23T09:49:02.582 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing_ops_high_water": 6, 2023-09-23T09:49:02.582 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing": 0, 2023-09-23T09:49:02.582 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing_high_water": 6, 2023-09-23T09:49:02.582 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executed": 109, 2023-09-23T09:49:02.582 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_item_in_journal": 0 2023-09-23T09:49:02.582 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:02.582 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-09-23T09:49:02.583 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2023-09-23T09:49:02.583 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 104857600, 2023-09-23T09:49:02.583 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2023-09-23T09:49:02.583 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 13768647, 2023-09-23T09:49:02.583 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 1075877183, 2023-09-23T09:49:02.583 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2023-09-23T09:49:02.583 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 13768647, 2023-09-23T09:49:02.583 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2023-09-23T09:49:02.583 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2023-09-23T09:49:02.583 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 13768647, 2023-09-23T09:49:02.583 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 1075877183, 2023-09-23T09:49:02.583 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2023-09-23T09:49:02.583 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:02.584 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:02.584 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:02.584 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-09-23T09:49:02.584 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:02.584 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-objecter_bytes": { 2023-09-23T09:49:02.584 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2023-09-23T09:49:02.584 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 104857600, 2023-09-23T09:49:02.584 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2023-09-23T09:49:02.584 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2023-09-23T09:49:02.584 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2023-09-23T09:49:02.584 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2023-09-23T09:49:02.584 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2023-09-23T09:49:02.585 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 12223, 2023-09-23T09:49:02.585 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 297846083, 2023-09-23T09:49:02.585 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 12223, 2023-09-23T09:49:02.585 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 297846083, 2023-09-23T09:49:02.585 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2023-09-23T09:49:02.585 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:02.585 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:02.585 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:02.585 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-09-23T09:49:02.585 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:02.585 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-objecter_ops": { 2023-09-23T09:49:02.585 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2023-09-23T09:49:02.585 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 1024, 2023-09-23T09:49:02.586 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2023-09-23T09:49:02.586 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2023-09-23T09:49:02.586 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2023-09-23T09:49:02.586 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2023-09-23T09:49:02.586 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2023-09-23T09:49:02.586 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 12223, 2023-09-23T09:49:02.586 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 12223, 2023-09-23T09:49:02.586 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 12223, 2023-09-23T09:49:02.586 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 12223, 2023-09-23T09:49:02.586 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2023-09-23T09:49:02.586 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:02.586 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:02.587 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:02.587 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-09-23T09:49:02.587 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:02.587 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-write_buf_throttle": { 2023-09-23T09:49:02.587 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2023-09-23T09:49:02.587 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 3758096384, 2023-09-23T09:49:02.587 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2023-09-23T09:49:02.587 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 109, 2023-09-23T09:49:02.587 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 11569, 2023-09-23T09:49:02.587 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2023-09-23T09:49:02.587 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 109, 2023-09-23T09:49:02.588 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2023-09-23T09:49:02.588 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2023-09-23T09:49:02.588 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 73, 2023-09-23T09:49:02.588 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 11569, 2023-09-23T09:49:02.588 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2023-09-23T09:49:02.588 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:02.588 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:02.588 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:02.588 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-09-23T09:49:02.588 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:02.588 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-write_buf_throttle-0x55932c72c6e0": { 2023-09-23T09:49:02.588 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 60, 2023-09-23T09:49:02.588 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 3758096384, 2023-09-23T09:49:02.589 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2023-09-23T09:49:02.589 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 14141, 2023-09-23T09:49:02.589 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 297214622, 2023-09-23T09:49:02.589 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2023-09-23T09:49:02.589 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 14141, 2023-09-23T09:49:02.589 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2023-09-23T09:49:02.589 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2023-09-23T09:49:02.589 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 8815, 2023-09-23T09:49:02.589 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 297214562, 2023-09-23T09:49:02.589 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2023-09-23T09:49:02.589 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:02.589 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:02.589 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:02.589 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-09-23T09:49:02.590 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-09-23T09:49:02.590 INFO:teuthology.orchestra.run.smithi135.stdout:} 2023-09-23T09:49:03.126 INFO:tasks.check_counter:Daemon mds.b mds.exported=75 2023-09-23T09:49:03.126 INFO:tasks.check_counter:Daemon mds.b mds.imported=83 2023-09-23T09:49:03.126 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=7 2023-09-23T09:49:03.127 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=53 2023-09-23T09:49:03.127 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=46 2023-09-23T09:49:03.127 DEBUG:tasks.check_counter:Getting stats from e 2023-09-23T09:49:03.127 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- ceph daemon mds.e perf dump 2023-09-23T09:49:03.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:49:03 smithi082 ceph-mon[97694]: pgmap v1657: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 938 B/s wr, 11 op/s 2023-09-23T09:49:03.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:49:03 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:49:03.396 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:49:03 smithi161 ceph-mon[99580]: pgmap v1657: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 938 B/s wr, 11 op/s 2023-09-23T09:49:03.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:49:03 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:49:03.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:49:03 smithi135 ceph-mon[99205]: pgmap v1657: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 938 B/s wr, 11 op/s 2023-09-23T09:49:03.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:49:03 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-23T09:49:03.952 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.b/config 2023-09-23T09:49:05.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:49:05 smithi082 ceph-mon[97694]: pgmap v1658: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 8 op/s 2023-09-23T09:49:05.396 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:49:05 smithi161 ceph-mon[99580]: pgmap v1658: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 8 op/s 2023-09-23T09:49:05.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:49:05 smithi135 ceph-mon[99205]: pgmap v1658: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 8 op/s 2023-09-23T09:49:06.902 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2023-09-23T09:49:06.902 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-0": { 2023-09-23T09:49:06.902 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 6546, 2023-09-23T09:49:06.902 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 6411, 2023-09-23T09:49:06.902 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 155789067, 2023-09-23T09:49:06.902 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 2235521, 2023-09-23T09:49:06.902 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 8, 2023-09-23T09:49:06.902 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 3, 2023-09-23T09:49:06.903 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.750357911, 2023-09-23T09:49:06.903 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.190738750, 2023-09-23T09:49:06.903 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.342755876, 2023-09-23T09:49:06.903 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.172105462, 2023-09-23T09:49:06.903 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2023-09-23T09:49:06.903 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 6411, 2023-09-23T09:49:06.903 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.375090909, 2023-09-23T09:49:06.903 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000058507 2023-09-23T09:49:06.903 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:06.903 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2023-09-23T09:49:06.903 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:06.903 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:06.904 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:06.904 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:06.904 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 2607168, 2023-09-23T09:49:06.904 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 541504 2023-09-23T09:49:06.904 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:06.904 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-1": { 2023-09-23T09:49:06.904 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 2050, 2023-09-23T09:49:06.904 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 2709, 2023-09-23T09:49:06.904 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 147321818, 2023-09-23T09:49:06.904 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 1933890, 2023-09-23T09:49:06.904 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 14, 2023-09-23T09:49:06.904 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 7, 2023-09-23T09:49:06.905 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.348705887, 2023-09-23T09:49:06.905 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.078872395, 2023-09-23T09:49:06.905 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.201330019, 2023-09-23T09:49:06.905 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.047266861, 2023-09-23T09:49:06.905 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2023-09-23T09:49:06.905 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 2706, 2023-09-23T09:49:06.905 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.135509140, 2023-09-23T09:49:06.905 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000050077 2023-09-23T09:49:06.905 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:06.905 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2023-09-23T09:49:06.905 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:06.906 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:06.906 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:06.906 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:06.906 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 480, 2023-09-23T09:49:06.906 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 1297216 2023-09-23T09:49:06.906 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:06.906 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-2": { 2023-09-23T09:49:06.906 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 4216, 2023-09-23T09:49:06.906 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 4218, 2023-09-23T09:49:06.906 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 273743613, 2023-09-23T09:49:06.906 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 1311188, 2023-09-23T09:49:06.906 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 7, 2023-09-23T09:49:06.907 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 5, 2023-09-23T09:49:06.907 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.609844229, 2023-09-23T09:49:06.907 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.089528332, 2023-09-23T09:49:06.907 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.382040982, 2023-09-23T09:49:06.907 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.103429224, 2023-09-23T09:49:06.907 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2023-09-23T09:49:06.907 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 4216, 2023-09-23T09:49:06.907 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.243870215, 2023-09-23T09:49:06.907 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000057843 2023-09-23T09:49:06.907 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:06.907 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2023-09-23T09:49:06.908 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:06.908 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:06.908 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:06.908 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:06.908 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 0, 2023-09-23T09:49:06.908 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 0 2023-09-23T09:49:06.908 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:06.908 INFO:teuthology.orchestra.run.smithi135.stdout: "cct": { 2023-09-23T09:49:06.908 INFO:teuthology.orchestra.run.smithi135.stdout: "total_workers": 1, 2023-09-23T09:49:06.908 INFO:teuthology.orchestra.run.smithi135.stdout: "unhealthy_workers": 0 2023-09-23T09:49:06.908 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:06.908 INFO:teuthology.orchestra.run.smithi135.stdout: "finisher-MDSRank": { 2023-09-23T09:49:06.908 INFO:teuthology.orchestra.run.smithi135.stdout: "queue_len": 0, 2023-09-23T09:49:06.909 INFO:teuthology.orchestra.run.smithi135.stdout: "complete_latency": { 2023-09-23T09:49:06.909 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 19430, 2023-09-23T09:49:06.909 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.511789366, 2023-09-23T09:49:06.909 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000026340 2023-09-23T09:49:06.909 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-09-23T09:49:06.909 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:06.909 INFO:teuthology.orchestra.run.smithi135.stdout: "finisher-PurgeQueue": { 2023-09-23T09:49:06.909 INFO:teuthology.orchestra.run.smithi135.stdout: "queue_len": 0, 2023-09-23T09:49:06.909 INFO:teuthology.orchestra.run.smithi135.stdout: "complete_latency": { 2023-09-23T09:49:06.909 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:06.909 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:06.909 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:06.910 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-09-23T09:49:06.910 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:06.910 INFO:teuthology.orchestra.run.smithi135.stdout: "mds": { 2023-09-23T09:49:06.910 INFO:teuthology.orchestra.run.smithi135.stdout: "request": 0, 2023-09-23T09:49:06.910 INFO:teuthology.orchestra.run.smithi135.stdout: "reply": 0, 2023-09-23T09:49:06.910 INFO:teuthology.orchestra.run.smithi135.stdout: "reply_latency": { 2023-09-23T09:49:06.910 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:06.910 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:06.910 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:06.910 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:06.910 INFO:teuthology.orchestra.run.smithi135.stdout: "slow_reply": 0, 2023-09-23T09:49:06.910 INFO:teuthology.orchestra.run.smithi135.stdout: "forward": 0, 2023-09-23T09:49:06.911 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_fetch_complete": 0, 2023-09-23T09:49:06.911 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_fetch_keys": 0, 2023-09-23T09:49:06.911 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_commit": 0, 2023-09-23T09:49:06.911 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_split": 0, 2023-09-23T09:49:06.911 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_merge": 0, 2023-09-23T09:49:06.911 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes": 820, 2023-09-23T09:49:06.911 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_top": 193, 2023-09-23T09:49:06.911 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_bottom": 531, 2023-09-23T09:49:06.911 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_pin_tail": 96, 2023-09-23T09:49:06.911 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_pinned": 543, 2023-09-23T09:49:06.911 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_expired": 2, 2023-09-23T09:49:06.911 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_with_caps": 0, 2023-09-23T09:49:06.911 INFO:teuthology.orchestra.run.smithi135.stdout: "caps": 0, 2023-09-23T09:49:06.912 INFO:teuthology.orchestra.run.smithi135.stdout: "subtrees": 20, 2023-09-23T09:49:06.912 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse": 0, 2023-09-23T09:49:06.912 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_hit": 0, 2023-09-23T09:49:06.912 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_forward": 0, 2023-09-23T09:49:06.912 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_discover": 0, 2023-09-23T09:49:06.912 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_dir_fetch": 0, 2023-09-23T09:49:06.912 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_remote_ino": 0, 2023-09-23T09:49:06.912 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_lock": 0, 2023-09-23T09:49:06.912 INFO:teuthology.orchestra.run.smithi135.stdout: "load_cent": 0, 2023-09-23T09:49:06.912 INFO:teuthology.orchestra.run.smithi135.stdout: "q": 0, 2023-09-23T09:49:06.912 INFO:teuthology.orchestra.run.smithi135.stdout: "exported": 0, 2023-09-23T09:49:06.912 INFO:teuthology.orchestra.run.smithi135.stdout: "exported_inodes": 0, 2023-09-23T09:49:06.912 INFO:teuthology.orchestra.run.smithi135.stdout: "imported": 0, 2023-09-23T09:49:06.913 INFO:teuthology.orchestra.run.smithi135.stdout: "imported_inodes": 0, 2023-09-23T09:49:06.913 INFO:teuthology.orchestra.run.smithi135.stdout: "openino_dir_fetch": 0, 2023-09-23T09:49:06.913 INFO:teuthology.orchestra.run.smithi135.stdout: "openino_backtrace_fetch": 0, 2023-09-23T09:49:06.913 INFO:teuthology.orchestra.run.smithi135.stdout: "openino_peer_discover": 0, 2023-09-23T09:49:06.913 INFO:teuthology.orchestra.run.smithi135.stdout: "root_rfiles": 0, 2023-09-23T09:49:06.913 INFO:teuthology.orchestra.run.smithi135.stdout: "root_rbytes": 0, 2023-09-23T09:49:06.913 INFO:teuthology.orchestra.run.smithi135.stdout: "root_rsnaps": 0, 2023-09-23T09:49:06.913 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_backtrace_fetch": 0, 2023-09-23T09:49:06.913 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_set_tag": 0, 2023-09-23T09:49:06.913 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_backtrace_repaired": 0, 2023-09-23T09:49:06.913 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_inotable_repaired": 0, 2023-09-23T09:49:06.913 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_dir_inodes": 0, 2023-09-23T09:49:06.913 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_dir_base_inodes": 0, 2023-09-23T09:49:06.914 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_dirfrag_rstats": 0, 2023-09-23T09:49:06.914 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_file_inodes": 0, 2023-09-23T09:49:06.914 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_inode_file_caps": 0, 2023-09-23T09:49:06.914 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_revoke": 0, 2023-09-23T09:49:06.914 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_grant": 0, 2023-09-23T09:49:06.914 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_trunc": 0, 2023-09-23T09:49:06.914 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-09-23T09:49:06.914 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_flush_ack": 0, 2023-09-23T09:49:06.914 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_caps": 0, 2023-09-23T09:49:06.914 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_caps_dirty": 0, 2023-09-23T09:49:06.914 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_cap_release": 0, 2023-09-23T09:49:06.914 INFO:teuthology.orchestra.run.smithi135.stdout: "process_request_cap_release": 0 2023-09-23T09:49:06.915 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:06.915 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_cache": { 2023-09-23T09:49:06.915 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_update": 0, 2023-09-23T09:49:06.915 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_update_receipt": 0, 2023-09-23T09:49:06.915 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_try_discover": 0, 2023-09-23T09:49:06.915 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_send_discover": 0, 2023-09-23T09:49:06.915 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_handle_discover": 0, 2023-09-23T09:49:06.915 INFO:teuthology.orchestra.run.smithi135.stdout: "num_strays": 0, 2023-09-23T09:49:06.915 INFO:teuthology.orchestra.run.smithi135.stdout: "num_strays_delayed": 0, 2023-09-23T09:49:06.915 INFO:teuthology.orchestra.run.smithi135.stdout: "num_strays_enqueuing": 0, 2023-09-23T09:49:06.915 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_created": 0, 2023-09-23T09:49:06.915 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_enqueued": 0, 2023-09-23T09:49:06.915 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_reintegrated": 0, 2023-09-23T09:49:06.916 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_migrated": 0, 2023-09-23T09:49:06.916 INFO:teuthology.orchestra.run.smithi135.stdout: "num_recovering_processing": 0, 2023-09-23T09:49:06.916 INFO:teuthology.orchestra.run.smithi135.stdout: "num_recovering_enqueued": 0, 2023-09-23T09:49:06.916 INFO:teuthology.orchestra.run.smithi135.stdout: "num_recovering_prioritized": 0, 2023-09-23T09:49:06.916 INFO:teuthology.orchestra.run.smithi135.stdout: "recovery_started": 0, 2023-09-23T09:49:06.916 INFO:teuthology.orchestra.run.smithi135.stdout: "recovery_completed": 0, 2023-09-23T09:49:06.916 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_enqueue_scrub": 0, 2023-09-23T09:49:06.916 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_exportdir": 0, 2023-09-23T09:49:06.916 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_flush": 0, 2023-09-23T09:49:06.916 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_fragmentdir": 0, 2023-09-23T09:49:06.916 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_fragstats": 0, 2023-09-23T09:49:06.916 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_inodestats": 0 2023-09-23T09:49:06.917 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:06.917 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_log": { 2023-09-23T09:49:06.917 INFO:teuthology.orchestra.run.smithi135.stdout: "evlrg": 0, 2023-09-23T09:49:06.917 INFO:teuthology.orchestra.run.smithi135.stdout: "evadd": 0, 2023-09-23T09:49:06.917 INFO:teuthology.orchestra.run.smithi135.stdout: "evex": 0, 2023-09-23T09:49:06.917 INFO:teuthology.orchestra.run.smithi135.stdout: "evtrm": 0, 2023-09-23T09:49:06.917 INFO:teuthology.orchestra.run.smithi135.stdout: "ev": 57026, 2023-09-23T09:49:06.917 INFO:teuthology.orchestra.run.smithi135.stdout: "evexg": 0, 2023-09-23T09:49:06.917 INFO:teuthology.orchestra.run.smithi135.stdout: "evexd": 0, 2023-09-23T09:49:06.917 INFO:teuthology.orchestra.run.smithi135.stdout: "segadd": 0, 2023-09-23T09:49:06.917 INFO:teuthology.orchestra.run.smithi135.stdout: "segex": 0, 2023-09-23T09:49:06.917 INFO:teuthology.orchestra.run.smithi135.stdout: "segtrm": 0, 2023-09-23T09:49:06.917 INFO:teuthology.orchestra.run.smithi135.stdout: "seg": 142, 2023-09-23T09:49:06.918 INFO:teuthology.orchestra.run.smithi135.stdout: "segmjr": 6, 2023-09-23T09:49:06.918 INFO:teuthology.orchestra.run.smithi135.stdout: "segexg": 0, 2023-09-23T09:49:06.918 INFO:teuthology.orchestra.run.smithi135.stdout: "segexd": 0, 2023-09-23T09:49:06.918 INFO:teuthology.orchestra.run.smithi135.stdout: "expos": 4194352, 2023-09-23T09:49:06.918 INFO:teuthology.orchestra.run.smithi135.stdout: "wrpos": 575115657, 2023-09-23T09:49:06.918 INFO:teuthology.orchestra.run.smithi135.stdout: "rdpos": 575104892, 2023-09-23T09:49:06.918 INFO:teuthology.orchestra.run.smithi135.stdout: "jlat": { 2023-09-23T09:49:06.918 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:06.918 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:06.918 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:06.918 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:06.918 INFO:teuthology.orchestra.run.smithi135.stdout: "replayed": 57026 2023-09-23T09:49:06.919 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:06.919 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_mem": { 2023-09-23T09:49:06.919 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 729, 2023-09-23T09:49:06.919 INFO:teuthology.orchestra.run.smithi135.stdout: "ino+": 4124, 2023-09-23T09:49:06.919 INFO:teuthology.orchestra.run.smithi135.stdout: "ino-": 3395, 2023-09-23T09:49:06.919 INFO:teuthology.orchestra.run.smithi135.stdout: "dir": 70, 2023-09-23T09:49:06.919 INFO:teuthology.orchestra.run.smithi135.stdout: "dir+": 125, 2023-09-23T09:49:06.919 INFO:teuthology.orchestra.run.smithi135.stdout: "dir-": 55, 2023-09-23T09:49:06.919 INFO:teuthology.orchestra.run.smithi135.stdout: "dn": 820, 2023-09-23T09:49:06.919 INFO:teuthology.orchestra.run.smithi135.stdout: "dn+": 4851, 2023-09-23T09:49:06.919 INFO:teuthology.orchestra.run.smithi135.stdout: "dn-": 4031, 2023-09-23T09:49:06.919 INFO:teuthology.orchestra.run.smithi135.stdout: "cap": 0, 2023-09-23T09:49:06.919 INFO:teuthology.orchestra.run.smithi135.stdout: "cap+": 0, 2023-09-23T09:49:06.920 INFO:teuthology.orchestra.run.smithi135.stdout: "cap-": 0, 2023-09-23T09:49:06.920 INFO:teuthology.orchestra.run.smithi135.stdout: "rss": 58292, 2023-09-23T09:49:06.920 INFO:teuthology.orchestra.run.smithi135.stdout: "heap": 207152 2023-09-23T09:49:06.920 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:06.920 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_server": { 2023-09-23T09:49:06.920 INFO:teuthology.orchestra.run.smithi135.stdout: "dispatch_client_request": 0, 2023-09-23T09:49:06.920 INFO:teuthology.orchestra.run.smithi135.stdout: "dispatch_server_request": 0, 2023-09-23T09:49:06.920 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_request": 0, 2023-09-23T09:49:06.920 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_session": 0, 2023-09-23T09:49:06.920 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_peer_request": 0, 2023-09-23T09:49:06.920 INFO:teuthology.orchestra.run.smithi135.stdout: "req_create_latency": { 2023-09-23T09:49:06.920 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:06.921 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:06.921 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:06.921 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:06.921 INFO:teuthology.orchestra.run.smithi135.stdout: "req_getattr_latency": { 2023-09-23T09:49:06.921 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:06.921 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:06.921 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:06.921 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:06.921 INFO:teuthology.orchestra.run.smithi135.stdout: "req_getfilelock_latency": { 2023-09-23T09:49:06.921 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:06.921 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:06.921 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:06.921 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:06.922 INFO:teuthology.orchestra.run.smithi135.stdout: "req_link_latency": { 2023-09-23T09:49:06.922 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:06.922 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:06.922 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:06.922 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:06.922 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookup_latency": { 2023-09-23T09:49:06.922 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:06.922 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:06.922 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:06.922 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:06.922 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookuphash_latency": { 2023-09-23T09:49:06.922 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:06.922 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:06.923 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:06.923 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:06.923 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupino_latency": { 2023-09-23T09:49:06.923 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:06.923 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:06.923 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:06.923 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:06.923 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupname_latency": { 2023-09-23T09:49:06.923 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:06.923 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:06.923 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:06.923 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:06.923 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupparent_latency": { 2023-09-23T09:49:06.924 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:06.924 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:06.924 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:06.924 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:06.924 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupsnap_latency": { 2023-09-23T09:49:06.924 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:06.924 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:06.924 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:06.924 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:06.924 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lssnap_latency": { 2023-09-23T09:49:06.924 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:06.924 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:06.924 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:06.925 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:06.925 INFO:teuthology.orchestra.run.smithi135.stdout: "req_mkdir_latency": { 2023-09-23T09:49:06.925 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:06.925 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:06.925 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:06.925 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:06.925 INFO:teuthology.orchestra.run.smithi135.stdout: "req_mknod_latency": { 2023-09-23T09:49:06.925 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:06.925 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:06.925 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:06.925 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:06.925 INFO:teuthology.orchestra.run.smithi135.stdout: "req_mksnap_latency": { 2023-09-23T09:49:06.926 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:06.926 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:06.926 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:06.926 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:06.926 INFO:teuthology.orchestra.run.smithi135.stdout: "req_open_latency": { 2023-09-23T09:49:06.926 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:06.926 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:06.926 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:06.926 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:06.926 INFO:teuthology.orchestra.run.smithi135.stdout: "req_readdir_latency": { 2023-09-23T09:49:06.926 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:06.927 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:06.927 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:06.927 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:06.927 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rename_latency": { 2023-09-23T09:49:06.927 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:06.927 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:06.927 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:06.927 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:06.927 INFO:teuthology.orchestra.run.smithi135.stdout: "req_renamesnap_latency": { 2023-09-23T09:49:06.927 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:06.927 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:06.928 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:06.928 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:06.928 INFO:teuthology.orchestra.run.smithi135.stdout: "req_snapdiff_latency": { 2023-09-23T09:49:06.928 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:06.928 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:06.928 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:06.928 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:06.928 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rmdir_latency": { 2023-09-23T09:49:06.928 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:06.928 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:06.928 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:06.928 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:06.928 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rmsnap_latency": { 2023-09-23T09:49:06.929 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:06.929 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:06.929 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:06.929 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:06.929 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rmxattr_latency": { 2023-09-23T09:49:06.929 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:06.929 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:06.929 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:06.929 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:06.929 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setattr_latency": { 2023-09-23T09:49:06.929 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:06.929 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:06.930 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:06.930 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:06.930 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setdirlayout_latency": { 2023-09-23T09:49:06.930 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:06.930 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:06.930 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:06.930 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:06.930 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setfilelock_latency": { 2023-09-23T09:49:06.930 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:06.930 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:06.930 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:06.930 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:06.931 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setlayout_latency": { 2023-09-23T09:49:06.931 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:06.931 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:06.931 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:06.931 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:06.931 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setxattr_latency": { 2023-09-23T09:49:06.931 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:06.931 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:06.931 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:06.931 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:06.931 INFO:teuthology.orchestra.run.smithi135.stdout: "req_symlink_latency": { 2023-09-23T09:49:06.931 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:06.932 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:06.932 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:06.932 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:06.932 INFO:teuthology.orchestra.run.smithi135.stdout: "req_unlink_latency": { 2023-09-23T09:49:06.932 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:06.932 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:06.932 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:06.932 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:06.932 INFO:teuthology.orchestra.run.smithi135.stdout: "cap_revoke_eviction": 0, 2023-09-23T09:49:06.932 INFO:teuthology.orchestra.run.smithi135.stdout: "cap_acquisition_throttle": 0, 2023-09-23T09:49:06.932 INFO:teuthology.orchestra.run.smithi135.stdout: "req_getvxattr_latency": { 2023-09-23T09:49:06.932 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:06.932 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:06.933 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:06.933 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-09-23T09:49:06.933 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:06.933 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_sessions": { 2023-09-23T09:49:06.933 INFO:teuthology.orchestra.run.smithi135.stdout: "session_count": 1, 2023-09-23T09:49:06.933 INFO:teuthology.orchestra.run.smithi135.stdout: "session_add": 3, 2023-09-23T09:49:06.933 INFO:teuthology.orchestra.run.smithi135.stdout: "session_remove": 2, 2023-09-23T09:49:06.933 INFO:teuthology.orchestra.run.smithi135.stdout: "sessions_open": 3, 2023-09-23T09:49:06.933 INFO:teuthology.orchestra.run.smithi135.stdout: "sessions_stale": 0, 2023-09-23T09:49:06.933 INFO:teuthology.orchestra.run.smithi135.stdout: "total_load": 0, 2023-09-23T09:49:06.933 INFO:teuthology.orchestra.run.smithi135.stdout: "average_load": 0, 2023-09-23T09:49:06.933 INFO:teuthology.orchestra.run.smithi135.stdout: "avg_session_uptime": 8070 2023-09-23T09:49:06.934 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:06.934 INFO:teuthology.orchestra.run.smithi135.stdout: "mempool": { 2023-09-23T09:49:06.934 INFO:teuthology.orchestra.run.smithi135.stdout: "bloom_filter_bytes": 0, 2023-09-23T09:49:06.934 INFO:teuthology.orchestra.run.smithi135.stdout: "bloom_filter_items": 0, 2023-09-23T09:49:06.934 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_alloc_bytes": 0, 2023-09-23T09:49:06.934 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_alloc_items": 0, 2023-09-23T09:49:06.934 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_data_bytes": 0, 2023-09-23T09:49:06.934 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_data_items": 0, 2023-09-23T09:49:06.934 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_onode_bytes": 0, 2023-09-23T09:49:06.934 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_onode_items": 0, 2023-09-23T09:49:06.934 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_meta_bytes": 0, 2023-09-23T09:49:06.934 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_meta_items": 0, 2023-09-23T09:49:06.935 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_other_bytes": 0, 2023-09-23T09:49:06.935 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_other_items": 0, 2023-09-23T09:49:06.935 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_buffer_bytes": 0, 2023-09-23T09:49:06.935 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_buffer_items": 0, 2023-09-23T09:49:06.935 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_extent_bytes": 0, 2023-09-23T09:49:06.935 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_extent_items": 0, 2023-09-23T09:49:06.935 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_blob_bytes": 0, 2023-09-23T09:49:06.935 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_blob_items": 0, 2023-09-23T09:49:06.935 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_shared_blob_bytes": 0, 2023-09-23T09:49:06.935 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_shared_blob_items": 0, 2023-09-23T09:49:06.935 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_inline_bl_bytes": 0, 2023-09-23T09:49:06.935 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_inline_bl_items": 0, 2023-09-23T09:49:06.936 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_fsck_bytes": 0, 2023-09-23T09:49:06.936 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_fsck_items": 0, 2023-09-23T09:49:06.936 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_txc_bytes": 0, 2023-09-23T09:49:06.936 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_txc_items": 0, 2023-09-23T09:49:06.936 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_deferred_bytes": 0, 2023-09-23T09:49:06.936 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_deferred_items": 0, 2023-09-23T09:49:06.936 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_bytes": 0, 2023-09-23T09:49:06.936 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_items": 0, 2023-09-23T09:49:06.936 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_bytes": 0, 2023-09-23T09:49:06.936 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_items": 0, 2023-09-23T09:49:06.936 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_reader_bytes": 0, 2023-09-23T09:49:06.936 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_reader_items": 0, 2023-09-23T09:49:06.937 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_writer_bytes": 0, 2023-09-23T09:49:06.937 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_writer_items": 0, 2023-09-23T09:49:06.937 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_anon_bytes": 242601, 2023-09-23T09:49:06.937 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_anon_items": 87, 2023-09-23T09:49:06.937 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_meta_bytes": 0, 2023-09-23T09:49:06.937 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_meta_items": 0, 2023-09-23T09:49:06.937 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_bytes": 0, 2023-09-23T09:49:06.937 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_items": 0, 2023-09-23T09:49:06.937 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_mapbl_bytes": 0, 2023-09-23T09:49:06.937 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_mapbl_items": 0, 2023-09-23T09:49:06.937 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_pglog_bytes": 0, 2023-09-23T09:49:06.937 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_pglog_items": 0, 2023-09-23T09:49:06.937 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_bytes": 8032, 2023-09-23T09:49:06.938 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_items": 167, 2023-09-23T09:49:06.938 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_mapping_bytes": 0, 2023-09-23T09:49:06.938 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_mapping_items": 0, 2023-09-23T09:49:06.938 INFO:teuthology.orchestra.run.smithi135.stdout: "pgmap_bytes": 0, 2023-09-23T09:49:06.938 INFO:teuthology.orchestra.run.smithi135.stdout: "pgmap_items": 0, 2023-09-23T09:49:06.938 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_co_bytes": 2199932, 2023-09-23T09:49:06.938 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_co_items": 5349, 2023-09-23T09:49:06.938 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_1_bytes": 0, 2023-09-23T09:49:06.938 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_1_items": 0, 2023-09-23T09:49:06.938 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_2_bytes": 0, 2023-09-23T09:49:06.938 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_2_items": 0 2023-09-23T09:49:06.938 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:06.939 INFO:teuthology.orchestra.run.smithi135.stdout: "objecter": { 2023-09-23T09:49:06.939 INFO:teuthology.orchestra.run.smithi135.stdout: "op_active": 0, 2023-09-23T09:49:06.939 INFO:teuthology.orchestra.run.smithi135.stdout: "op_laggy": 0, 2023-09-23T09:49:06.939 INFO:teuthology.orchestra.run.smithi135.stdout: "op_send": 11710, 2023-09-23T09:49:06.939 INFO:teuthology.orchestra.run.smithi135.stdout: "op_send_bytes": 21, 2023-09-23T09:49:06.939 INFO:teuthology.orchestra.run.smithi135.stdout: "op_resend": 3, 2023-09-23T09:49:06.939 INFO:teuthology.orchestra.run.smithi135.stdout: "op_reply": 11710, 2023-09-23T09:49:06.939 INFO:teuthology.orchestra.run.smithi135.stdout: "op_latency": { 2023-09-23T09:49:06.939 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 11710, 2023-09-23T09:49:06.939 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 14.098719509, 2023-09-23T09:49:06.939 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.001203989 2023-09-23T09:49:06.939 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:06.940 INFO:teuthology.orchestra.run.smithi135.stdout: "op_inflight": 0, 2023-09-23T09:49:06.940 INFO:teuthology.orchestra.run.smithi135.stdout: "oplen_avg": { 2023-09-23T09:49:06.940 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 11710, 2023-09-23T09:49:06.940 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 11711 2023-09-23T09:49:06.940 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:06.940 INFO:teuthology.orchestra.run.smithi135.stdout: "op": 11710, 2023-09-23T09:49:06.940 INFO:teuthology.orchestra.run.smithi135.stdout: "op_r": 11710, 2023-09-23T09:49:06.940 INFO:teuthology.orchestra.run.smithi135.stdout: "op_w": 0, 2023-09-23T09:49:06.940 INFO:teuthology.orchestra.run.smithi135.stdout: "op_rmw": 0, 2023-09-23T09:49:06.940 INFO:teuthology.orchestra.run.smithi135.stdout: "op_pg": 0, 2023-09-23T09:49:06.940 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_stat": 6839, 2023-09-23T09:49:06.940 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_create": 0, 2023-09-23T09:49:06.940 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_read": 4869, 2023-09-23T09:49:06.941 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_write": 0, 2023-09-23T09:49:06.941 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_writefull": 0, 2023-09-23T09:49:06.941 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_writesame": 0, 2023-09-23T09:49:06.941 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_append": 0, 2023-09-23T09:49:06.941 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_zero": 0, 2023-09-23T09:49:06.941 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_truncate": 0, 2023-09-23T09:49:06.941 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_delete": 0, 2023-09-23T09:49:06.941 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_mapext": 0, 2023-09-23T09:49:06.941 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_sparse_read": 0, 2023-09-23T09:49:06.941 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_clonerange": 0, 2023-09-23T09:49:06.941 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_getxattr": 1, 2023-09-23T09:49:06.941 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_setxattr": 0, 2023-09-23T09:49:06.942 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_cmpxattr": 0, 2023-09-23T09:49:06.942 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_rmxattr": 0, 2023-09-23T09:49:06.942 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_resetxattrs": 0, 2023-09-23T09:49:06.942 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_call": 0, 2023-09-23T09:49:06.942 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_watch": 0, 2023-09-23T09:49:06.942 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_notify": 0, 2023-09-23T09:49:06.942 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_src_cmpxattr": 0, 2023-09-23T09:49:06.942 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_pgls": 0, 2023-09-23T09:49:06.942 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_pgls_filter": 0, 2023-09-23T09:49:06.942 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_other": 0, 2023-09-23T09:49:06.942 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_active": 0, 2023-09-23T09:49:06.942 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_send": 0, 2023-09-23T09:49:06.942 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_resend": 0, 2023-09-23T09:49:06.943 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_ping": 0, 2023-09-23T09:49:06.943 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_active": 0, 2023-09-23T09:49:06.943 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_send": 0, 2023-09-23T09:49:06.943 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_resend": 0, 2023-09-23T09:49:06.943 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_active": 0, 2023-09-23T09:49:06.943 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_send": 0, 2023-09-23T09:49:06.943 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_resend": 0, 2023-09-23T09:49:06.943 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_active": 0, 2023-09-23T09:49:06.943 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_send": 0, 2023-09-23T09:49:06.943 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_resend": 0, 2023-09-23T09:49:06.943 INFO:teuthology.orchestra.run.smithi135.stdout: "command_active": 0, 2023-09-23T09:49:06.943 INFO:teuthology.orchestra.run.smithi135.stdout: "command_send": 0, 2023-09-23T09:49:06.943 INFO:teuthology.orchestra.run.smithi135.stdout: "command_resend": 0, 2023-09-23T09:49:06.944 INFO:teuthology.orchestra.run.smithi135.stdout: "map_epoch": 179, 2023-09-23T09:49:06.944 INFO:teuthology.orchestra.run.smithi135.stdout: "map_full": 0, 2023-09-23T09:49:06.944 INFO:teuthology.orchestra.run.smithi135.stdout: "map_inc": 93, 2023-09-23T09:49:06.944 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_sessions": 11, 2023-09-23T09:49:06.944 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_session_open": 17, 2023-09-23T09:49:06.944 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_session_close": 6, 2023-09-23T09:49:06.944 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_laggy": 0, 2023-09-23T09:49:06.944 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_wr": 0, 2023-09-23T09:49:06.944 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_rd": 2, 2023-09-23T09:49:06.944 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_del": 0 2023-09-23T09:49:06.944 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:06.944 INFO:teuthology.orchestra.run.smithi135.stdout: "oft": { 2023-09-23T09:49:06.945 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_objs": 0, 2023-09-23T09:49:06.945 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_kv_pairs": 0, 2023-09-23T09:49:06.945 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_updates": 0, 2023-09-23T09:49:06.945 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_removes": 0 2023-09-23T09:49:06.945 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:06.945 INFO:teuthology.orchestra.run.smithi135.stdout: "osd-slow-ops": { 2023-09-23T09:49:06.945 INFO:teuthology.orchestra.run.smithi135.stdout: "slow_ops_count": 0 2023-09-23T09:49:06.945 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:06.945 INFO:teuthology.orchestra.run.smithi135.stdout: "purge_queue": { 2023-09-23T09:49:06.945 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing_ops": 0, 2023-09-23T09:49:06.945 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing_ops_high_water": 0, 2023-09-23T09:49:06.945 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing": 0, 2023-09-23T09:49:06.945 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing_high_water": 0, 2023-09-23T09:49:06.946 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executed": 0, 2023-09-23T09:49:06.946 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_item_in_journal": 0 2023-09-23T09:49:06.946 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:06.946 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-09-23T09:49:06.946 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2023-09-23T09:49:06.946 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 104857600, 2023-09-23T09:49:06.946 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2023-09-23T09:49:06.946 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 12808, 2023-09-23T09:49:06.946 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 575643624, 2023-09-23T09:49:06.946 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2023-09-23T09:49:06.946 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 12808, 2023-09-23T09:49:06.946 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2023-09-23T09:49:06.947 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2023-09-23T09:49:06.947 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 12808, 2023-09-23T09:49:06.947 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 575643624, 2023-09-23T09:49:06.947 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2023-09-23T09:49:06.947 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:06.947 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:06.947 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:06.947 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-09-23T09:49:06.947 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:06.947 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-objecter_bytes": { 2023-09-23T09:49:06.947 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2023-09-23T09:49:06.947 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 104857600, 2023-09-23T09:49:06.948 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2023-09-23T09:49:06.948 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2023-09-23T09:49:06.948 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2023-09-23T09:49:06.948 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2023-09-23T09:49:06.948 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2023-09-23T09:49:06.948 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 11710, 2023-09-23T09:49:06.948 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 571006830, 2023-09-23T09:49:06.948 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 11710, 2023-09-23T09:49:06.948 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 571006830, 2023-09-23T09:49:06.948 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2023-09-23T09:49:06.948 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:06.948 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:06.948 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:06.949 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-09-23T09:49:06.949 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:06.949 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-objecter_ops": { 2023-09-23T09:49:06.949 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2023-09-23T09:49:06.949 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 1024, 2023-09-23T09:49:06.949 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2023-09-23T09:49:06.949 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2023-09-23T09:49:06.949 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2023-09-23T09:49:06.949 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2023-09-23T09:49:06.949 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2023-09-23T09:49:06.949 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 11710, 2023-09-23T09:49:06.949 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 11710, 2023-09-23T09:49:06.949 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 11710, 2023-09-23T09:49:06.950 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 11710, 2023-09-23T09:49:06.950 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2023-09-23T09:49:06.950 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:06.950 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:06.950 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:06.950 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-09-23T09:49:06.950 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:06.950 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-write_buf_throttle": { 2023-09-23T09:49:06.950 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2023-09-23T09:49:06.950 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 3758096384, 2023-09-23T09:49:06.950 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2023-09-23T09:49:06.950 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2023-09-23T09:49:06.951 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2023-09-23T09:49:06.951 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2023-09-23T09:49:06.951 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2023-09-23T09:49:06.951 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2023-09-23T09:49:06.951 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2023-09-23T09:49:06.951 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 0, 2023-09-23T09:49:06.951 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 0, 2023-09-23T09:49:06.951 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2023-09-23T09:49:06.951 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:06.951 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:06.951 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:06.951 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-09-23T09:49:06.951 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:06.952 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-write_buf_throttle-0x559a582d4a00": { 2023-09-23T09:49:06.952 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2023-09-23T09:49:06.952 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 3758096384, 2023-09-23T09:49:06.952 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2023-09-23T09:49:06.952 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2023-09-23T09:49:06.952 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2023-09-23T09:49:06.952 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2023-09-23T09:49:06.952 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2023-09-23T09:49:06.952 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2023-09-23T09:49:06.952 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2023-09-23T09:49:06.952 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 0, 2023-09-23T09:49:06.952 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 0, 2023-09-23T09:49:06.952 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2023-09-23T09:49:06.953 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:06.953 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:06.953 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:06.953 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-09-23T09:49:06.953 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-09-23T09:49:06.953 INFO:teuthology.orchestra.run.smithi135.stdout:} 2023-09-23T09:49:07.240 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:49:07 smithi135 ceph-mon[99205]: pgmap v1659: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 26 op/s 2023-09-23T09:49:07.240 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:49:07 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:49:07.240 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:49:07 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:49:07.240 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:49:07 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:49:07.240 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:49:07 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:49:07.241 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:49:07 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:49:07.241 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:49:07 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:49:07.241 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:49:07 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:49:07.241 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:49:07 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:49:07.241 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:49:07 smithi135 ceph-mon[99205]: osdmap e180: 12 total, 12 up, 12 in 2023-09-23T09:49:07.241 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:49:07 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:49:07.241 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:49:07 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:49:07.241 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:49:07 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:49:07.241 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:49:07 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:49:07.442 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2023-09-23T09:49:07.442 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2023-09-23T09:49:07.443 INFO:tasks.check_counter:Daemon mds.e mds.root_rsnaps=0 2023-09-23T09:49:07.443 INFO:tasks.check_counter:Daemon mds.e mds_server.req_mksnap_latency.avgcount=0 2023-09-23T09:49:07.443 INFO:tasks.check_counter:Daemon mds.e mds_server.req_rmsnap_latency.avgcount=0 2023-09-23T09:49:07.443 DEBUG:tasks.check_counter:Getting stats from h 2023-09-23T09:49:07.443 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- ceph daemon mds.h perf dump 2023-09-23T09:49:07.624 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:49:07 smithi082 ceph-mon[97694]: pgmap v1659: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 26 op/s 2023-09-23T09:49:07.624 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:49:07 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:49:07.624 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:49:07 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:49:07.624 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:49:07 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:49:07.624 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:49:07 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:49:07.624 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:49:07 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:49:07.624 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:49:07 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:49:07.624 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:49:07 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:49:07.624 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:49:07 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:49:07.625 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:49:07 smithi082 ceph-mon[97694]: osdmap e180: 12 total, 12 up, 12 in 2023-09-23T09:49:07.625 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:49:07 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:49:07.625 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:49:07 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:49:07.625 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:49:07 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:49:07.625 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:49:07 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:49:07.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:49:07 smithi161 ceph-mon[99580]: pgmap v1659: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 26 op/s 2023-09-23T09:49:07.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:49:07 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:49:07.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:49:07 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:49:07.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:49:07 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:49:07.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:49:07 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:49:07.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:49:07 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:49:07.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:49:07 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:49:07.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:49:07 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:49:07.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:49:07 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:49:07.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:49:07 smithi161 ceph-mon[99580]: osdmap e180: 12 total, 12 up, 12 in 2023-09-23T09:49:07.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:49:07 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:49:07.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:49:07 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:49:07.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:49:07 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:49:07.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:49:07 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:49:08.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:49:08 smithi135 ceph-mon[99205]: Adjusting osd_memory_target on smithi082 to 220.9M 2023-09-23T09:49:08.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:49:08 smithi135 ceph-mon[99205]: Unable to set osd_memory_target on smithi082 to 231651840: error parsing value: Value '231651840' is below minimum 939524096 2023-09-23T09:49:08.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:49:08 smithi135 ceph-mon[99205]: Adjusting osd_memory_target on smithi161 to 220.9M 2023-09-23T09:49:08.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:49:08 smithi135 ceph-mon[99205]: Unable to set osd_memory_target on smithi161 to 231676211: error parsing value: Value '231676211' is below minimum 939524096 2023-09-23T09:49:08.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:49:08 smithi082 ceph-mon[97694]: Adjusting osd_memory_target on smithi082 to 220.9M 2023-09-23T09:49:08.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:49:08 smithi082 ceph-mon[97694]: Unable to set osd_memory_target on smithi082 to 231651840: error parsing value: Value '231651840' is below minimum 939524096 2023-09-23T09:49:08.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:49:08 smithi082 ceph-mon[97694]: Adjusting osd_memory_target on smithi161 to 220.9M 2023-09-23T09:49:08.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:49:08 smithi082 ceph-mon[97694]: Unable to set osd_memory_target on smithi161 to 231676211: error parsing value: Value '231676211' is below minimum 939524096 2023-09-23T09:49:08.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:49:08 smithi161 ceph-mon[99580]: Adjusting osd_memory_target on smithi082 to 220.9M 2023-09-23T09:49:08.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:49:08 smithi161 ceph-mon[99580]: Unable to set osd_memory_target on smithi082 to 231651840: error parsing value: Value '231651840' is below minimum 939524096 2023-09-23T09:49:08.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:49:08 smithi161 ceph-mon[99580]: Adjusting osd_memory_target on smithi161 to 220.9M 2023-09-23T09:49:08.649 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:49:08 smithi161 ceph-mon[99580]: Unable to set osd_memory_target on smithi161 to 231676211: error parsing value: Value '231676211' is below minimum 939524096 2023-09-23T09:49:08.736 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.b/config 2023-09-23T09:49:09.565 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:49:09 smithi135 ceph-mon[99205]: pgmap v1661: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-09-23T09:49:09.565 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:49:09 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:49:09.565 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:49:09 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:49:09.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:49:09 smithi082 ceph-mon[97694]: pgmap v1661: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-09-23T09:49:09.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:49:09 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:49:09.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:49:09 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:49:09.646 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:49:09 smithi161 ceph-mon[99580]: pgmap v1661: 97 pgs: 97 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-09-23T09:49:09.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:49:09 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:49:09.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:49:09 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:49:10.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:49:10 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:49:10.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:49:10 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:49:10.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:49:10 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:49:10.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:49:10 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:49:10.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:49:10 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:49:10.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:49:10 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:49:10.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:49:10 smithi135 ceph-mon[99205]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:49:10.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:49:10 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:49:10.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:49:10 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:49:10.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:49:10 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:49:10.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:49:10 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:49:10.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:49:10 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:49:10.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:49:10 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:49:10.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:49:10 smithi082 ceph-mon[97694]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:49:10.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:49:10 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:49:10.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:49:10 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:49:10.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:49:10 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:49:10.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:49:10 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-09-23T09:49:10.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:49:10 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-23T09:49:10.647 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:49:10 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-23T09:49:10.648 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:49:10 smithi161 ceph-mon[99580]: from='mgr.15537 172.21.15.82:0/4181481193' entity='mgr.x' 2023-09-23T09:49:11.272 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2023-09-23T09:49:11.272 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-0": { 2023-09-23T09:49:11.272 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 5646565, 2023-09-23T09:49:11.272 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 5544246, 2023-09-23T09:49:11.272 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 946702875, 2023-09-23T09:49:11.272 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 906226538, 2023-09-23T09:49:11.273 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 11, 2023-09-23T09:49:11.273 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 4, 2023-09-23T09:49:11.273 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 366.150103960, 2023-09-23T09:49:11.273 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 174.139002034, 2023-09-23T09:49:11.273 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 244.025771943, 2023-09-23T09:49:11.273 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.093813929, 2023-09-23T09:49:11.273 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2023-09-23T09:49:11.273 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 5544248, 2023-09-23T09:49:11.273 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 98.708059516, 2023-09-23T09:49:11.273 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000017803 2023-09-23T09:49:11.273 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:11.274 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2023-09-23T09:49:11.274 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 11178479, 2023-09-23T09:49:11.274 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 1.232477457, 2023-09-23T09:49:11.274 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000110 2023-09-23T09:49:11.274 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:11.274 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 7536, 2023-09-23T09:49:11.274 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 64192 2023-09-23T09:49:11.274 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:11.274 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-1": { 2023-09-23T09:49:11.274 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 122092, 2023-09-23T09:49:11.274 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 132341, 2023-09-23T09:49:11.275 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 41624064, 2023-09-23T09:49:11.275 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 67805654, 2023-09-23T09:49:11.275 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 27, 2023-09-23T09:49:11.275 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 7, 2023-09-23T09:49:11.275 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 8.465336665, 2023-09-23T09:49:11.275 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 3.769443308, 2023-09-23T09:49:11.275 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 5.363646020, 2023-09-23T09:49:11.275 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.065674557, 2023-09-23T09:49:11.275 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2023-09-23T09:49:11.275 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 132337, 2023-09-23T09:49:11.275 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 5.125561905, 2023-09-23T09:49:11.275 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000038731 2023-09-23T09:49:11.276 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:11.276 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2023-09-23T09:49:11.276 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 243176, 2023-09-23T09:49:11.276 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.044174023, 2023-09-23T09:49:11.276 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000181 2023-09-23T09:49:11.276 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:11.276 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 6256, 2023-09-23T09:49:11.276 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 632320 2023-09-23T09:49:11.276 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:11.276 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-2": { 2023-09-23T09:49:11.276 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 47725, 2023-09-23T09:49:11.276 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 47490, 2023-09-23T09:49:11.277 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 17955671, 2023-09-23T09:49:11.277 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 25068318, 2023-09-23T09:49:11.277 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 22, 2023-09-23T09:49:11.277 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 10, 2023-09-23T09:49:11.277 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 3.414123891, 2023-09-23T09:49:11.277 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 1.462793272, 2023-09-23T09:49:11.277 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 2.348269987, 2023-09-23T09:49:11.277 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.059174416, 2023-09-23T09:49:11.277 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2023-09-23T09:49:11.277 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 47487, 2023-09-23T09:49:11.277 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 3.427150378, 2023-09-23T09:49:11.278 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000072170 2023-09-23T09:49:11.278 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:11.278 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2023-09-23T09:49:11.278 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 86733, 2023-09-23T09:49:11.278 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.016947264, 2023-09-23T09:49:11.278 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000195 2023-09-23T09:49:11.278 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:11.278 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 2625952, 2023-09-23T09:49:11.278 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 1258944 2023-09-23T09:49:11.278 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:11.278 INFO:teuthology.orchestra.run.smithi135.stdout: "cct": { 2023-09-23T09:49:11.278 INFO:teuthology.orchestra.run.smithi135.stdout: "total_workers": 1, 2023-09-23T09:49:11.279 INFO:teuthology.orchestra.run.smithi135.stdout: "unhealthy_workers": 0 2023-09-23T09:49:11.279 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:11.279 INFO:teuthology.orchestra.run.smithi135.stdout: "finisher-MDSRank": { 2023-09-23T09:49:11.279 INFO:teuthology.orchestra.run.smithi135.stdout: "queue_len": 0, 2023-09-23T09:49:11.279 INFO:teuthology.orchestra.run.smithi135.stdout: "complete_latency": { 2023-09-23T09:49:11.279 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 9360, 2023-09-23T09:49:11.279 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 3.311383550, 2023-09-23T09:49:11.279 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000353780 2023-09-23T09:49:11.279 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-09-23T09:49:11.279 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:11.279 INFO:teuthology.orchestra.run.smithi135.stdout: "finisher-PurgeQueue": { 2023-09-23T09:49:11.279 INFO:teuthology.orchestra.run.smithi135.stdout: "queue_len": 0, 2023-09-23T09:49:11.280 INFO:teuthology.orchestra.run.smithi135.stdout: "complete_latency": { 2023-09-23T09:49:11.280 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 774, 2023-09-23T09:49:11.280 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.035713950, 2023-09-23T09:49:11.280 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000046142 2023-09-23T09:49:11.280 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-09-23T09:49:11.280 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:11.280 INFO:teuthology.orchestra.run.smithi135.stdout: "mds": { 2023-09-23T09:49:11.280 INFO:teuthology.orchestra.run.smithi135.stdout: "request": 10861, 2023-09-23T09:49:11.280 INFO:teuthology.orchestra.run.smithi135.stdout: "reply": 8932, 2023-09-23T09:49:11.280 INFO:teuthology.orchestra.run.smithi135.stdout: "reply_latency": { 2023-09-23T09:49:11.280 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 8932, 2023-09-23T09:49:11.280 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 338.428030917, 2023-09-23T09:49:11.281 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.037889389 2023-09-23T09:49:11.281 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:11.281 INFO:teuthology.orchestra.run.smithi135.stdout: "slow_reply": 0, 2023-09-23T09:49:11.281 INFO:teuthology.orchestra.run.smithi135.stdout: "forward": 1929, 2023-09-23T09:49:11.281 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_fetch_complete": 10, 2023-09-23T09:49:11.281 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_fetch_keys": 0, 2023-09-23T09:49:11.281 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_commit": 29, 2023-09-23T09:49:11.281 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_split": 2, 2023-09-23T09:49:11.281 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_merge": 1, 2023-09-23T09:49:11.281 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes": 907, 2023-09-23T09:49:11.281 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_top": 58, 2023-09-23T09:49:11.282 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_bottom": 623, 2023-09-23T09:49:11.282 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_pin_tail": 226, 2023-09-23T09:49:11.282 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_pinned": 825, 2023-09-23T09:49:11.282 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_expired": 2149, 2023-09-23T09:49:11.282 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_with_caps": 258, 2023-09-23T09:49:11.282 INFO:teuthology.orchestra.run.smithi135.stdout: "caps": 258, 2023-09-23T09:49:11.282 INFO:teuthology.orchestra.run.smithi135.stdout: "subtrees": 27, 2023-09-23T09:49:11.282 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse": 47022, 2023-09-23T09:49:11.282 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_hit": 38128, 2023-09-23T09:49:11.282 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_forward": 1853, 2023-09-23T09:49:11.282 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_discover": 292, 2023-09-23T09:49:11.282 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_dir_fetch": 2, 2023-09-23T09:49:11.283 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_remote_ino": 1, 2023-09-23T09:49:11.283 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_lock": 3815, 2023-09-23T09:49:11.283 INFO:teuthology.orchestra.run.smithi135.stdout: "load_cent": 0, 2023-09-23T09:49:11.283 INFO:teuthology.orchestra.run.smithi135.stdout: "q": 0, 2023-09-23T09:49:11.283 INFO:teuthology.orchestra.run.smithi135.stdout: "exported": 26, 2023-09-23T09:49:11.283 INFO:teuthology.orchestra.run.smithi135.stdout: "exported_inodes": 1546, 2023-09-23T09:49:11.283 INFO:teuthology.orchestra.run.smithi135.stdout: "imported": 35, 2023-09-23T09:49:11.283 INFO:teuthology.orchestra.run.smithi135.stdout: "imported_inodes": 1877, 2023-09-23T09:49:11.283 INFO:teuthology.orchestra.run.smithi135.stdout: "openino_dir_fetch": 0, 2023-09-23T09:49:11.283 INFO:teuthology.orchestra.run.smithi135.stdout: "openino_backtrace_fetch": 726, 2023-09-23T09:49:11.283 INFO:teuthology.orchestra.run.smithi135.stdout: "openino_peer_discover": 3, 2023-09-23T09:49:11.283 INFO:teuthology.orchestra.run.smithi135.stdout: "root_rfiles": 1045, 2023-09-23T09:49:11.284 INFO:teuthology.orchestra.run.smithi135.stdout: "root_rbytes": 8989915630, 2023-09-23T09:49:11.284 INFO:teuthology.orchestra.run.smithi135.stdout: "root_rsnaps": 7, 2023-09-23T09:49:11.284 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_backtrace_fetch": 726, 2023-09-23T09:49:11.284 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_set_tag": 0, 2023-09-23T09:49:11.284 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_backtrace_repaired": 0, 2023-09-23T09:49:11.284 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_inotable_repaired": 0, 2023-09-23T09:49:11.284 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_dir_inodes": 12, 2023-09-23T09:49:11.284 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_dir_base_inodes": 0, 2023-09-23T09:49:11.284 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_dirfrag_rstats": 12, 2023-09-23T09:49:11.284 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_file_inodes": 714, 2023-09-23T09:49:11.284 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_inode_file_caps": 653, 2023-09-23T09:49:11.285 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_revoke": 57559, 2023-09-23T09:49:11.285 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_grant": 55810, 2023-09-23T09:49:11.285 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_trunc": 0, 2023-09-23T09:49:11.285 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-09-23T09:49:11.285 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_flush_ack": 0, 2023-09-23T09:49:11.285 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_caps": 109172, 2023-09-23T09:49:11.285 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_caps_dirty": 3050, 2023-09-23T09:49:11.285 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_cap_release": 371, 2023-09-23T09:49:11.285 INFO:teuthology.orchestra.run.smithi135.stdout: "process_request_cap_release": 1307 2023-09-23T09:49:11.285 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:11.285 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_cache": { 2023-09-23T09:49:11.285 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_update": 0, 2023-09-23T09:49:11.286 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_update_receipt": 0, 2023-09-23T09:49:11.286 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_try_discover": 0, 2023-09-23T09:49:11.286 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_send_discover": 321, 2023-09-23T09:49:11.286 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_handle_discover": 248, 2023-09-23T09:49:11.286 INFO:teuthology.orchestra.run.smithi135.stdout: "num_strays": 0, 2023-09-23T09:49:11.286 INFO:teuthology.orchestra.run.smithi135.stdout: "num_strays_delayed": 0, 2023-09-23T09:49:11.286 INFO:teuthology.orchestra.run.smithi135.stdout: "num_strays_enqueuing": 0, 2023-09-23T09:49:11.286 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_created": 317, 2023-09-23T09:49:11.286 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_enqueued": 201, 2023-09-23T09:49:11.286 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_reintegrated": 675, 2023-09-23T09:49:11.286 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_migrated": 87, 2023-09-23T09:49:11.287 INFO:teuthology.orchestra.run.smithi135.stdout: "num_recovering_processing": 0, 2023-09-23T09:49:11.287 INFO:teuthology.orchestra.run.smithi135.stdout: "num_recovering_enqueued": 0, 2023-09-23T09:49:11.287 INFO:teuthology.orchestra.run.smithi135.stdout: "num_recovering_prioritized": 0, 2023-09-23T09:49:11.287 INFO:teuthology.orchestra.run.smithi135.stdout: "recovery_started": 0, 2023-09-23T09:49:11.287 INFO:teuthology.orchestra.run.smithi135.stdout: "recovery_completed": 0, 2023-09-23T09:49:11.287 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_enqueue_scrub": 0, 2023-09-23T09:49:11.287 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_exportdir": 30, 2023-09-23T09:49:11.287 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_flush": 0, 2023-09-23T09:49:11.287 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_fragmentdir": 3, 2023-09-23T09:49:11.287 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_fragstats": 0, 2023-09-23T09:49:11.287 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_inodestats": 0 2023-09-23T09:49:11.287 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:11.288 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_log": { 2023-09-23T09:49:11.288 INFO:teuthology.orchestra.run.smithi135.stdout: "evlrg": 0, 2023-09-23T09:49:11.288 INFO:teuthology.orchestra.run.smithi135.stdout: "evadd": 10186, 2023-09-23T09:49:11.288 INFO:teuthology.orchestra.run.smithi135.stdout: "evex": 0, 2023-09-23T09:49:11.288 INFO:teuthology.orchestra.run.smithi135.stdout: "evtrm": 0, 2023-09-23T09:49:11.288 INFO:teuthology.orchestra.run.smithi135.stdout: "ev": 10186, 2023-09-23T09:49:11.288 INFO:teuthology.orchestra.run.smithi135.stdout: "evexg": 0, 2023-09-23T09:49:11.288 INFO:teuthology.orchestra.run.smithi135.stdout: "evexd": 0, 2023-09-23T09:49:11.288 INFO:teuthology.orchestra.run.smithi135.stdout: "segadd": 14, 2023-09-23T09:49:11.288 INFO:teuthology.orchestra.run.smithi135.stdout: "segex": 0, 2023-09-23T09:49:11.288 INFO:teuthology.orchestra.run.smithi135.stdout: "segtrm": 0, 2023-09-23T09:49:11.288 INFO:teuthology.orchestra.run.smithi135.stdout: "seg": 14, 2023-09-23T09:49:11.289 INFO:teuthology.orchestra.run.smithi135.stdout: "segmjr": 2, 2023-09-23T09:49:11.289 INFO:teuthology.orchestra.run.smithi135.stdout: "segexg": 0, 2023-09-23T09:49:11.289 INFO:teuthology.orchestra.run.smithi135.stdout: "segexd": 0, 2023-09-23T09:49:11.289 INFO:teuthology.orchestra.run.smithi135.stdout: "expos": 4194304, 2023-09-23T09:49:11.289 INFO:teuthology.orchestra.run.smithi135.stdout: "wrpos": 42338546, 2023-09-23T09:49:11.289 INFO:teuthology.orchestra.run.smithi135.stdout: "rdpos": 0, 2023-09-23T09:49:11.289 INFO:teuthology.orchestra.run.smithi135.stdout: "jlat": { 2023-09-23T09:49:11.289 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 4278, 2023-09-23T09:49:11.289 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 25.620227335, 2023-09-23T09:49:11.289 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.005988832 2023-09-23T09:49:11.289 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:11.290 INFO:teuthology.orchestra.run.smithi135.stdout: "replayed": 0 2023-09-23T09:49:11.290 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:11.290 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_mem": { 2023-09-23T09:49:11.290 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 359, 2023-09-23T09:49:11.290 INFO:teuthology.orchestra.run.smithi135.stdout: "ino+": 1929, 2023-09-23T09:49:11.290 INFO:teuthology.orchestra.run.smithi135.stdout: "ino-": 1570, 2023-09-23T09:49:11.290 INFO:teuthology.orchestra.run.smithi135.stdout: "dir": 98, 2023-09-23T09:49:11.290 INFO:teuthology.orchestra.run.smithi135.stdout: "dir+": 181, 2023-09-23T09:49:11.290 INFO:teuthology.orchestra.run.smithi135.stdout: "dir-": 83, 2023-09-23T09:49:11.290 INFO:teuthology.orchestra.run.smithi135.stdout: "dn": 907, 2023-09-23T09:49:11.290 INFO:teuthology.orchestra.run.smithi135.stdout: "dn+": 3257, 2023-09-23T09:49:11.290 INFO:teuthology.orchestra.run.smithi135.stdout: "dn-": 2350, 2023-09-23T09:49:11.291 INFO:teuthology.orchestra.run.smithi135.stdout: "cap": 258, 2023-09-23T09:49:11.291 INFO:teuthology.orchestra.run.smithi135.stdout: "cap+": 1535, 2023-09-23T09:49:11.291 INFO:teuthology.orchestra.run.smithi135.stdout: "cap-": 1277, 2023-09-23T09:49:11.291 INFO:teuthology.orchestra.run.smithi135.stdout: "rss": 66428, 2023-09-23T09:49:11.291 INFO:teuthology.orchestra.run.smithi135.stdout: "heap": 198960 2023-09-23T09:49:11.291 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:11.291 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_server": { 2023-09-23T09:49:11.291 INFO:teuthology.orchestra.run.smithi135.stdout: "dispatch_client_request": 32896, 2023-09-23T09:49:11.291 INFO:teuthology.orchestra.run.smithi135.stdout: "dispatch_server_request": 6110, 2023-09-23T09:49:11.291 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_request": 10861, 2023-09-23T09:49:11.291 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_session": 188, 2023-09-23T09:49:11.291 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_peer_request": 11816, 2023-09-23T09:49:11.292 INFO:teuthology.orchestra.run.smithi135.stdout: "req_create_latency": { 2023-09-23T09:49:11.292 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 195, 2023-09-23T09:49:11.292 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.418642967, 2023-09-23T09:49:11.292 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.002146887 2023-09-23T09:49:11.292 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:11.292 INFO:teuthology.orchestra.run.smithi135.stdout: "req_getattr_latency": { 2023-09-23T09:49:11.292 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 432, 2023-09-23T09:49:11.292 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 1.197866128, 2023-09-23T09:49:11.292 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.002772838 2023-09-23T09:49:11.292 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:11.292 INFO:teuthology.orchestra.run.smithi135.stdout: "req_getfilelock_latency": { 2023-09-23T09:49:11.293 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:11.293 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:11.293 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:11.293 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:11.293 INFO:teuthology.orchestra.run.smithi135.stdout: "req_link_latency": { 2023-09-23T09:49:11.293 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 111, 2023-09-23T09:49:11.293 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 1.513666546, 2023-09-23T09:49:11.293 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.013636635 2023-09-23T09:49:11.293 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:11.293 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookup_latency": { 2023-09-23T09:49:11.293 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 5192, 2023-09-23T09:49:11.293 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 180.279193413, 2023-09-23T09:49:11.294 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.034722494 2023-09-23T09:49:11.294 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:11.294 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookuphash_latency": { 2023-09-23T09:49:11.294 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:11.294 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:11.294 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:11.294 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:11.294 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupino_latency": { 2023-09-23T09:49:11.294 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:11.294 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:11.294 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:11.294 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:11.295 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupname_latency": { 2023-09-23T09:49:11.295 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:11.295 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:11.295 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:11.295 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:11.295 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupparent_latency": { 2023-09-23T09:49:11.295 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:11.295 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:11.295 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:11.295 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:11.295 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupsnap_latency": { 2023-09-23T09:49:11.295 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:11.296 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:11.296 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:11.296 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:11.296 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lssnap_latency": { 2023-09-23T09:49:11.296 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:11.296 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:11.296 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:11.296 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:11.296 INFO:teuthology.orchestra.run.smithi135.stdout: "req_mkdir_latency": { 2023-09-23T09:49:11.296 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:11.296 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:11.297 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:11.297 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:11.297 INFO:teuthology.orchestra.run.smithi135.stdout: "req_mknod_latency": { 2023-09-23T09:49:11.297 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:11.297 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:11.297 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:11.297 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:11.297 INFO:teuthology.orchestra.run.smithi135.stdout: "req_mksnap_latency": { 2023-09-23T09:49:11.297 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:11.297 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:11.297 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:11.298 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:11.298 INFO:teuthology.orchestra.run.smithi135.stdout: "req_open_latency": { 2023-09-23T09:49:11.298 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 1880, 2023-09-23T09:49:11.298 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 3.033313117, 2023-09-23T09:49:11.298 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.001613464 2023-09-23T09:49:11.298 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:11.298 INFO:teuthology.orchestra.run.smithi135.stdout: "req_readdir_latency": { 2023-09-23T09:49:11.298 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 48, 2023-09-23T09:49:11.298 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.033800772, 2023-09-23T09:49:11.298 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000704182 2023-09-23T09:49:11.298 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:11.298 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rename_latency": { 2023-09-23T09:49:11.299 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 957, 2023-09-23T09:49:11.299 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 150.867893425, 2023-09-23T09:49:11.299 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.157646701 2023-09-23T09:49:11.299 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:11.299 INFO:teuthology.orchestra.run.smithi135.stdout: "req_renamesnap_latency": { 2023-09-23T09:49:11.299 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:11.299 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:11.299 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:11.299 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:11.299 INFO:teuthology.orchestra.run.smithi135.stdout: "req_snapdiff_latency": { 2023-09-23T09:49:11.299 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:11.299 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:11.300 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:11.300 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:11.300 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rmdir_latency": { 2023-09-23T09:49:11.300 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:11.300 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:11.300 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:11.300 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:11.300 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rmsnap_latency": { 2023-09-23T09:49:11.300 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:11.300 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:11.300 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:11.300 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:11.301 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rmxattr_latency": { 2023-09-23T09:49:11.301 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:11.301 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:11.301 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:11.301 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:11.301 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setattr_latency": { 2023-09-23T09:49:11.301 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:11.301 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:11.301 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:11.301 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:11.301 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setdirlayout_latency": { 2023-09-23T09:49:11.301 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:11.302 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:11.302 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:11.302 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:11.302 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setfilelock_latency": { 2023-09-23T09:49:11.302 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:11.302 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:11.302 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:11.302 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:11.302 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setlayout_latency": { 2023-09-23T09:49:11.302 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:11.302 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:11.302 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:11.303 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:11.303 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setxattr_latency": { 2023-09-23T09:49:11.303 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:11.303 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:11.303 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:11.303 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:11.303 INFO:teuthology.orchestra.run.smithi135.stdout: "req_symlink_latency": { 2023-09-23T09:49:11.303 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:11.303 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:11.303 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:11.303 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:11.303 INFO:teuthology.orchestra.run.smithi135.stdout: "req_unlink_latency": { 2023-09-23T09:49:11.304 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 117, 2023-09-23T09:49:11.304 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 1.083654549, 2023-09-23T09:49:11.304 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.009262004 2023-09-23T09:49:11.304 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:11.304 INFO:teuthology.orchestra.run.smithi135.stdout: "cap_revoke_eviction": 0, 2023-09-23T09:49:11.304 INFO:teuthology.orchestra.run.smithi135.stdout: "cap_acquisition_throttle": 0, 2023-09-23T09:49:11.304 INFO:teuthology.orchestra.run.smithi135.stdout: "req_getvxattr_latency": { 2023-09-23T09:49:11.304 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:11.304 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:11.304 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:11.304 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-09-23T09:49:11.304 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:11.305 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_sessions": { 2023-09-23T09:49:11.305 INFO:teuthology.orchestra.run.smithi135.stdout: "session_count": 2, 2023-09-23T09:49:11.305 INFO:teuthology.orchestra.run.smithi135.stdout: "session_add": 4, 2023-09-23T09:49:11.305 INFO:teuthology.orchestra.run.smithi135.stdout: "session_remove": 2, 2023-09-23T09:49:11.305 INFO:teuthology.orchestra.run.smithi135.stdout: "sessions_open": 2, 2023-09-23T09:49:11.305 INFO:teuthology.orchestra.run.smithi135.stdout: "sessions_stale": 0, 2023-09-23T09:49:11.305 INFO:teuthology.orchestra.run.smithi135.stdout: "total_load": 267, 2023-09-23T09:49:11.305 INFO:teuthology.orchestra.run.smithi135.stdout: "average_load": 133, 2023-09-23T09:49:11.305 INFO:teuthology.orchestra.run.smithi135.stdout: "avg_session_uptime": 3140 2023-09-23T09:49:11.305 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:11.305 INFO:teuthology.orchestra.run.smithi135.stdout: "mempool": { 2023-09-23T09:49:11.305 INFO:teuthology.orchestra.run.smithi135.stdout: "bloom_filter_bytes": 0, 2023-09-23T09:49:11.306 INFO:teuthology.orchestra.run.smithi135.stdout: "bloom_filter_items": 0, 2023-09-23T09:49:11.306 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_alloc_bytes": 0, 2023-09-23T09:49:11.306 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_alloc_items": 0, 2023-09-23T09:49:11.306 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_data_bytes": 0, 2023-09-23T09:49:11.306 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_data_items": 0, 2023-09-23T09:49:11.306 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_onode_bytes": 0, 2023-09-23T09:49:11.306 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_onode_items": 0, 2023-09-23T09:49:11.306 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_meta_bytes": 0, 2023-09-23T09:49:11.306 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_meta_items": 0, 2023-09-23T09:49:11.306 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_other_bytes": 0, 2023-09-23T09:49:11.306 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_other_items": 0, 2023-09-23T09:49:11.307 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_buffer_bytes": 0, 2023-09-23T09:49:11.307 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_buffer_items": 0, 2023-09-23T09:49:11.307 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_extent_bytes": 0, 2023-09-23T09:49:11.307 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_extent_items": 0, 2023-09-23T09:49:11.307 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_blob_bytes": 0, 2023-09-23T09:49:11.307 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_blob_items": 0, 2023-09-23T09:49:11.307 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_shared_blob_bytes": 0, 2023-09-23T09:49:11.307 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_shared_blob_items": 0, 2023-09-23T09:49:11.307 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_inline_bl_bytes": 0, 2023-09-23T09:49:11.307 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_inline_bl_items": 0, 2023-09-23T09:49:11.307 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_fsck_bytes": 0, 2023-09-23T09:49:11.307 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_fsck_items": 0, 2023-09-23T09:49:11.307 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_txc_bytes": 0, 2023-09-23T09:49:11.308 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_txc_items": 0, 2023-09-23T09:49:11.308 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_deferred_bytes": 0, 2023-09-23T09:49:11.308 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_deferred_items": 0, 2023-09-23T09:49:11.308 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_bytes": 0, 2023-09-23T09:49:11.308 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_items": 0, 2023-09-23T09:49:11.308 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_bytes": 0, 2023-09-23T09:49:11.308 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_items": 0, 2023-09-23T09:49:11.308 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_reader_bytes": 0, 2023-09-23T09:49:11.308 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_reader_items": 0, 2023-09-23T09:49:11.308 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_writer_bytes": 0, 2023-09-23T09:49:11.308 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_writer_items": 0, 2023-09-23T09:49:11.308 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_anon_bytes": 851391, 2023-09-23T09:49:11.309 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_anon_items": 257, 2023-09-23T09:49:11.309 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_meta_bytes": 0, 2023-09-23T09:49:11.309 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_meta_items": 0, 2023-09-23T09:49:11.309 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_bytes": 0, 2023-09-23T09:49:11.309 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_items": 0, 2023-09-23T09:49:11.309 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_mapbl_bytes": 0, 2023-09-23T09:49:11.309 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_mapbl_items": 0, 2023-09-23T09:49:11.309 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_pglog_bytes": 0, 2023-09-23T09:49:11.309 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_pglog_items": 0, 2023-09-23T09:49:11.309 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_bytes": 8152, 2023-09-23T09:49:11.309 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_items": 170, 2023-09-23T09:49:11.309 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_mapping_bytes": 0, 2023-09-23T09:49:11.310 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_mapping_items": 0, 2023-09-23T09:49:11.310 INFO:teuthology.orchestra.run.smithi135.stdout: "pgmap_bytes": 0, 2023-09-23T09:49:11.310 INFO:teuthology.orchestra.run.smithi135.stdout: "pgmap_items": 0, 2023-09-23T09:49:11.310 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_co_bytes": 2431879, 2023-09-23T09:49:11.310 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_co_items": 100014, 2023-09-23T09:49:11.310 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_1_bytes": 0, 2023-09-23T09:49:11.310 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_1_items": 0, 2023-09-23T09:49:11.310 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_2_bytes": 0, 2023-09-23T09:49:11.310 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_2_items": 0 2023-09-23T09:49:11.310 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:11.310 INFO:teuthology.orchestra.run.smithi135.stdout: "objecter": { 2023-09-23T09:49:11.310 INFO:teuthology.orchestra.run.smithi135.stdout: "op_active": 0, 2023-09-23T09:49:11.311 INFO:teuthology.orchestra.run.smithi135.stdout: "op_laggy": 0, 2023-09-23T09:49:11.311 INFO:teuthology.orchestra.run.smithi135.stdout: "op_send": 6033, 2023-09-23T09:49:11.311 INFO:teuthology.orchestra.run.smithi135.stdout: "op_send_bytes": 38434166, 2023-09-23T09:49:11.311 INFO:teuthology.orchestra.run.smithi135.stdout: "op_resend": 27, 2023-09-23T09:49:11.311 INFO:teuthology.orchestra.run.smithi135.stdout: "op_reply": 6033, 2023-09-23T09:49:11.311 INFO:teuthology.orchestra.run.smithi135.stdout: "op_latency": { 2023-09-23T09:49:11.311 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 6033, 2023-09-23T09:49:11.311 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 30.745388504, 2023-09-23T09:49:11.311 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.005096202 2023-09-23T09:49:11.311 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:11.311 INFO:teuthology.orchestra.run.smithi135.stdout: "op_inflight": 0, 2023-09-23T09:49:11.312 INFO:teuthology.orchestra.run.smithi135.stdout: "oplen_avg": { 2023-09-23T09:49:11.312 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 6033, 2023-09-23T09:49:11.312 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 6513 2023-09-23T09:49:11.312 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:11.312 INFO:teuthology.orchestra.run.smithi135.stdout: "op": 6033, 2023-09-23T09:49:11.312 INFO:teuthology.orchestra.run.smithi135.stdout: "op_r": 840, 2023-09-23T09:49:11.312 INFO:teuthology.orchestra.run.smithi135.stdout: "op_w": 5193, 2023-09-23T09:49:11.312 INFO:teuthology.orchestra.run.smithi135.stdout: "op_rmw": 0, 2023-09-23T09:49:11.312 INFO:teuthology.orchestra.run.smithi135.stdout: "op_pg": 0, 2023-09-23T09:49:11.312 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_stat": 0, 2023-09-23T09:49:11.312 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_create": 10, 2023-09-23T09:49:11.312 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_read": 96, 2023-09-23T09:49:11.313 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_write": 4374, 2023-09-23T09:49:11.313 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_writefull": 249, 2023-09-23T09:49:11.313 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_writesame": 0, 2023-09-23T09:49:11.313 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_append": 0, 2023-09-23T09:49:11.313 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_zero": 0, 2023-09-23T09:49:11.313 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_truncate": 1, 2023-09-23T09:49:11.313 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_delete": 225, 2023-09-23T09:49:11.313 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_mapext": 0, 2023-09-23T09:49:11.313 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_sparse_read": 0, 2023-09-23T09:49:11.313 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_clonerange": 0, 2023-09-23T09:49:11.313 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_getxattr": 726, 2023-09-23T09:49:11.313 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_setxattr": 20, 2023-09-23T09:49:11.313 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_cmpxattr": 0, 2023-09-23T09:49:11.314 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_rmxattr": 0, 2023-09-23T09:49:11.314 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_resetxattrs": 0, 2023-09-23T09:49:11.314 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_call": 0, 2023-09-23T09:49:11.314 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_watch": 0, 2023-09-23T09:49:11.314 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_notify": 0, 2023-09-23T09:49:11.314 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_src_cmpxattr": 0, 2023-09-23T09:49:11.314 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_pgls": 0, 2023-09-23T09:49:11.314 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_pgls_filter": 0, 2023-09-23T09:49:11.314 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_other": 0, 2023-09-23T09:49:11.314 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_active": 0, 2023-09-23T09:49:11.314 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_send": 0, 2023-09-23T09:49:11.315 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_resend": 0, 2023-09-23T09:49:11.315 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_ping": 0, 2023-09-23T09:49:11.315 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_active": 0, 2023-09-23T09:49:11.315 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_send": 0, 2023-09-23T09:49:11.315 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_resend": 0, 2023-09-23T09:49:11.315 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_active": 0, 2023-09-23T09:49:11.315 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_send": 0, 2023-09-23T09:49:11.315 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_resend": 0, 2023-09-23T09:49:11.315 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_active": 0, 2023-09-23T09:49:11.315 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_send": 0, 2023-09-23T09:49:11.315 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_resend": 0, 2023-09-23T09:49:11.315 INFO:teuthology.orchestra.run.smithi135.stdout: "command_active": 0, 2023-09-23T09:49:11.316 INFO:teuthology.orchestra.run.smithi135.stdout: "command_send": 0, 2023-09-23T09:49:11.316 INFO:teuthology.orchestra.run.smithi135.stdout: "command_resend": 0, 2023-09-23T09:49:11.316 INFO:teuthology.orchestra.run.smithi135.stdout: "map_epoch": 180, 2023-09-23T09:49:11.316 INFO:teuthology.orchestra.run.smithi135.stdout: "map_full": 0, 2023-09-23T09:49:11.316 INFO:teuthology.orchestra.run.smithi135.stdout: "map_inc": 94, 2023-09-23T09:49:11.316 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_sessions": 12, 2023-09-23T09:49:11.316 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_session_open": 12, 2023-09-23T09:49:11.316 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_session_close": 0, 2023-09-23T09:49:11.316 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_laggy": 0, 2023-09-23T09:49:11.316 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_wr": 579, 2023-09-23T09:49:11.316 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_rd": 28, 2023-09-23T09:49:11.316 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_del": 205 2023-09-23T09:49:11.317 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:11.317 INFO:teuthology.orchestra.run.smithi135.stdout: "oft": { 2023-09-23T09:49:11.317 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_objs": 1, 2023-09-23T09:49:11.317 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_kv_pairs": 0, 2023-09-23T09:49:11.317 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_updates": 0, 2023-09-23T09:49:11.317 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_removes": 0 2023-09-23T09:49:11.317 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:11.317 INFO:teuthology.orchestra.run.smithi135.stdout: "osd-slow-ops": { 2023-09-23T09:49:11.317 INFO:teuthology.orchestra.run.smithi135.stdout: "slow_ops_count": 1 2023-09-23T09:49:11.317 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:11.317 INFO:teuthology.orchestra.run.smithi135.stdout: "purge_queue": { 2023-09-23T09:49:11.317 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing_ops": 0, 2023-09-23T09:49:11.318 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing_ops_high_water": 6, 2023-09-23T09:49:11.318 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing": 0, 2023-09-23T09:49:11.318 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing_high_water": 6, 2023-09-23T09:49:11.318 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executed": 201, 2023-09-23T09:49:11.318 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_item_in_journal": 0 2023-09-23T09:49:11.318 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:11.318 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-09-23T09:49:11.318 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2023-09-23T09:49:11.318 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 104857600, 2023-09-23T09:49:11.318 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2023-09-23T09:49:11.318 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 5816379, 2023-09-23T09:49:11.318 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 482746063, 2023-09-23T09:49:11.319 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2023-09-23T09:49:11.319 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 5816379, 2023-09-23T09:49:11.319 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2023-09-23T09:49:11.319 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2023-09-23T09:49:11.319 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 5816379, 2023-09-23T09:49:11.319 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 482746063, 2023-09-23T09:49:11.319 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2023-09-23T09:49:11.319 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:11.319 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:11.319 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:11.319 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-09-23T09:49:11.319 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:11.320 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-objecter_bytes": { 2023-09-23T09:49:11.320 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2023-09-23T09:49:11.320 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 104857600, 2023-09-23T09:49:11.320 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2023-09-23T09:49:11.320 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2023-09-23T09:49:11.320 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2023-09-23T09:49:11.320 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2023-09-23T09:49:11.320 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2023-09-23T09:49:11.320 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 6033, 2023-09-23T09:49:11.320 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 38454869, 2023-09-23T09:49:11.320 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 6033, 2023-09-23T09:49:11.320 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 38454869, 2023-09-23T09:49:11.321 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2023-09-23T09:49:11.321 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:11.321 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:11.321 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:11.321 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-09-23T09:49:11.321 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:11.321 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-objecter_ops": { 2023-09-23T09:49:11.321 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2023-09-23T09:49:11.321 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 1024, 2023-09-23T09:49:11.321 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2023-09-23T09:49:11.321 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2023-09-23T09:49:11.321 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2023-09-23T09:49:11.322 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2023-09-23T09:49:11.322 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2023-09-23T09:49:11.322 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 6033, 2023-09-23T09:49:11.322 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 6033, 2023-09-23T09:49:11.322 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 6033, 2023-09-23T09:49:11.322 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 6033, 2023-09-23T09:49:11.322 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2023-09-23T09:49:11.322 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:11.322 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:11.322 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:11.322 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-09-23T09:49:11.322 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:11.323 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-write_buf_throttle": { 2023-09-23T09:49:11.323 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2023-09-23T09:49:11.323 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 3758096384, 2023-09-23T09:49:11.323 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2023-09-23T09:49:11.323 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 201, 2023-09-23T09:49:11.323 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 21181, 2023-09-23T09:49:11.323 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2023-09-23T09:49:11.323 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 201, 2023-09-23T09:49:11.323 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2023-09-23T09:49:11.323 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2023-09-23T09:49:11.323 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 96, 2023-09-23T09:49:11.323 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 21181, 2023-09-23T09:49:11.324 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2023-09-23T09:49:11.324 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:11.324 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:11.324 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:11.324 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-09-23T09:49:11.324 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:11.324 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-write_buf_throttle-0x5606d0da86e0": { 2023-09-23T09:49:11.324 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2023-09-23T09:49:11.324 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 3758096384, 2023-09-23T09:49:11.324 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2023-09-23T09:49:11.324 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 10186, 2023-09-23T09:49:11.324 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 38144242, 2023-09-23T09:49:11.325 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2023-09-23T09:49:11.325 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 10186, 2023-09-23T09:49:11.325 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2023-09-23T09:49:11.325 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2023-09-23T09:49:11.325 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 4278, 2023-09-23T09:49:11.325 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 38144242, 2023-09-23T09:49:11.325 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2023-09-23T09:49:11.325 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:11.325 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:11.325 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:11.325 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-09-23T09:49:11.325 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-09-23T09:49:11.326 INFO:teuthology.orchestra.run.smithi135.stdout:} 2023-09-23T09:49:11.560 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:49:11 smithi135 ceph-mon[99205]: pgmap v1662: 97 pgs: 8 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 77 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-09-23T09:49:11.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:49:11 smithi135 ceph-mon[99205]: Adjusting osd_memory_target on smithi135 to 220.9M 2023-09-23T09:49:11.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:49:11 smithi135 ceph-mon[99205]: Unable to set osd_memory_target on smithi135 to 231659008: error parsing value: Value '231659008' is below minimum 939524096 2023-09-23T09:49:11.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:49:11 smithi082 ceph-mon[97694]: pgmap v1662: 97 pgs: 8 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 77 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-09-23T09:49:11.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:49:11 smithi082 ceph-mon[97694]: Adjusting osd_memory_target on smithi135 to 220.9M 2023-09-23T09:49:11.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:49:11 smithi082 ceph-mon[97694]: Unable to set osd_memory_target on smithi135 to 231659008: error parsing value: Value '231659008' is below minimum 939524096 2023-09-23T09:49:11.646 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:49:11 smithi161 ceph-mon[99580]: pgmap v1662: 97 pgs: 8 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 77 active+clean; 12 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-09-23T09:49:11.646 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:49:11 smithi161 ceph-mon[99580]: Adjusting osd_memory_target on smithi135 to 220.9M 2023-09-23T09:49:11.646 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:49:11 smithi161 ceph-mon[99580]: Unable to set osd_memory_target on smithi135 to 231659008: error parsing value: Value '231659008' is below minimum 939524096 2023-09-23T09:49:11.744 INFO:tasks.check_counter:Daemon mds.h mds.exported=26 2023-09-23T09:49:11.744 INFO:tasks.check_counter:Daemon mds.h mds.imported=35 2023-09-23T09:49:11.744 INFO:tasks.check_counter:Daemon mds.h mds.root_rsnaps=7 2023-09-23T09:49:11.745 INFO:tasks.check_counter:Daemon mds.h mds_server.req_mksnap_latency.avgcount=0 2023-09-23T09:49:11.745 INFO:tasks.check_counter:Daemon mds.h mds_server.req_rmsnap_latency.avgcount=0 2023-09-23T09:49:11.745 DEBUG:tasks.check_counter:Getting stats from k 2023-09-23T09:49:11.745 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- ceph daemon mds.k perf dump 2023-09-23T09:49:12.557 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.b/config 2023-09-23T09:49:13.560 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:49:13 smithi135 ceph-mon[99205]: pgmap v1663: 97 pgs: 13 active+clean+snaptrim, 24 active+clean+snaptrim_wait, 60 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-09-23T09:49:13.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:49:13 smithi082 ceph-mon[97694]: pgmap v1663: 97 pgs: 13 active+clean+snaptrim, 24 active+clean+snaptrim_wait, 60 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-09-23T09:49:13.646 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:49:13 smithi161 ceph-mon[99580]: pgmap v1663: 97 pgs: 13 active+clean+snaptrim, 24 active+clean+snaptrim_wait, 60 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-09-23T09:49:15.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:49:15 smithi135 ceph-mon[99205]: pgmap v1664: 97 pgs: 13 active+clean+snaptrim, 24 active+clean+snaptrim_wait, 60 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-09-23T09:49:15.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:49:15 smithi082 ceph-mon[97694]: pgmap v1664: 97 pgs: 13 active+clean+snaptrim, 24 active+clean+snaptrim_wait, 60 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-09-23T09:49:15.646 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:49:15 smithi161 ceph-mon[99580]: pgmap v1664: 97 pgs: 13 active+clean+snaptrim, 24 active+clean+snaptrim_wait, 60 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-09-23T09:49:16.046 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2023-09-23T09:49:16.046 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-0": { 2023-09-23T09:49:16.047 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 8948, 2023-09-23T09:49:16.047 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 8948, 2023-09-23T09:49:16.047 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 33835459, 2023-09-23T09:49:16.047 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 2782039, 2023-09-23T09:49:16.047 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 8, 2023-09-23T09:49:16.047 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 4, 2023-09-23T09:49:16.047 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.754444534, 2023-09-23T09:49:16.047 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.239483800, 2023-09-23T09:49:16.048 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.230981559, 2023-09-23T09:49:16.048 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.224073766, 2023-09-23T09:49:16.048 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2023-09-23T09:49:16.048 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 8947, 2023-09-23T09:49:16.048 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.411543772, 2023-09-23T09:49:16.048 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000045997 2023-09-23T09:49:16.048 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:16.048 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2023-09-23T09:49:16.049 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:16.049 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:16.049 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:16.049 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:16.049 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 2912, 2023-09-23T09:49:16.049 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 448 2023-09-23T09:49:16.049 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:16.049 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-1": { 2023-09-23T09:49:16.050 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 2324, 2023-09-23T09:49:16.050 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 2192, 2023-09-23T09:49:16.050 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 23884890, 2023-09-23T09:49:16.050 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 924927, 2023-09-23T09:49:16.050 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 6, 2023-09-23T09:49:16.050 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 4, 2023-09-23T09:49:16.050 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.293703812, 2023-09-23T09:49:16.050 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.098629780, 2023-09-23T09:49:16.051 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.133679788, 2023-09-23T09:49:16.051 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.057079189, 2023-09-23T09:49:16.051 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2023-09-23T09:49:16.051 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 2191, 2023-09-23T09:49:16.051 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.145549299, 2023-09-23T09:49:16.051 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000066430 2023-09-23T09:49:16.051 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:16.051 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2023-09-23T09:49:16.051 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:16.052 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:16.052 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:16.052 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:16.052 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 2607040, 2023-09-23T09:49:16.052 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 544512 2023-09-23T09:49:16.052 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:16.052 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-2": { 2023-09-23T09:49:16.052 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 391, 2023-09-23T09:49:16.052 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 1053, 2023-09-23T09:49:16.053 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 8488148, 2023-09-23T09:49:16.053 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 1474901, 2023-09-23T09:49:16.053 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 13, 2023-09-23T09:49:16.053 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 6, 2023-09-23T09:49:16.053 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.086481086, 2023-09-23T09:49:16.053 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.035239172, 2023-09-23T09:49:16.053 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.028839775, 2023-09-23T09:49:16.053 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.012087880, 2023-09-23T09:49:16.053 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2023-09-23T09:49:16.054 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 1050, 2023-09-23T09:49:16.054 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.087408080, 2023-09-23T09:49:16.054 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000083245 2023-09-23T09:49:16.054 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:16.054 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2023-09-23T09:49:16.054 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:16.054 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:16.054 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:16.055 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:16.055 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 640, 2023-09-23T09:49:16.055 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 1354544 2023-09-23T09:49:16.055 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:16.055 INFO:teuthology.orchestra.run.smithi135.stdout: "cct": { 2023-09-23T09:49:16.055 INFO:teuthology.orchestra.run.smithi135.stdout: "total_workers": 1, 2023-09-23T09:49:16.055 INFO:teuthology.orchestra.run.smithi135.stdout: "unhealthy_workers": 0 2023-09-23T09:49:16.055 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:16.055 INFO:teuthology.orchestra.run.smithi135.stdout: "finisher-MDSRank": { 2023-09-23T09:49:16.056 INFO:teuthology.orchestra.run.smithi135.stdout: "queue_len": 0, 2023-09-23T09:49:16.056 INFO:teuthology.orchestra.run.smithi135.stdout: "complete_latency": { 2023-09-23T09:49:16.056 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 17691, 2023-09-23T09:49:16.056 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.440473808, 2023-09-23T09:49:16.056 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000024898 2023-09-23T09:49:16.056 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-09-23T09:49:16.056 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:16.056 INFO:teuthology.orchestra.run.smithi135.stdout: "finisher-PurgeQueue": { 2023-09-23T09:49:16.057 INFO:teuthology.orchestra.run.smithi135.stdout: "queue_len": 0, 2023-09-23T09:49:16.057 INFO:teuthology.orchestra.run.smithi135.stdout: "complete_latency": { 2023-09-23T09:49:16.057 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:16.057 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:16.057 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:16.057 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-09-23T09:49:16.057 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:16.057 INFO:teuthology.orchestra.run.smithi135.stdout: "mds": { 2023-09-23T09:49:16.057 INFO:teuthology.orchestra.run.smithi135.stdout: "request": 0, 2023-09-23T09:49:16.058 INFO:teuthology.orchestra.run.smithi135.stdout: "reply": 0, 2023-09-23T09:49:16.058 INFO:teuthology.orchestra.run.smithi135.stdout: "reply_latency": { 2023-09-23T09:49:16.058 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:16.058 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:16.058 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:16.058 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:16.058 INFO:teuthology.orchestra.run.smithi135.stdout: "slow_reply": 0, 2023-09-23T09:49:16.058 INFO:teuthology.orchestra.run.smithi135.stdout: "forward": 0, 2023-09-23T09:49:16.059 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_fetch_complete": 0, 2023-09-23T09:49:16.059 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_fetch_keys": 0, 2023-09-23T09:49:16.059 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_commit": 0, 2023-09-23T09:49:16.059 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_split": 0, 2023-09-23T09:49:16.059 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_merge": 0, 2023-09-23T09:49:16.059 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes": 1000, 2023-09-23T09:49:16.059 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_top": 97, 2023-09-23T09:49:16.059 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_bottom": 896, 2023-09-23T09:49:16.059 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_pin_tail": 7, 2023-09-23T09:49:16.059 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_pinned": 861, 2023-09-23T09:49:16.060 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_expired": 0, 2023-09-23T09:49:16.060 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_with_caps": 0, 2023-09-23T09:49:16.060 INFO:teuthology.orchestra.run.smithi135.stdout: "caps": 0, 2023-09-23T09:49:16.060 INFO:teuthology.orchestra.run.smithi135.stdout: "subtrees": 9, 2023-09-23T09:49:16.060 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse": 0, 2023-09-23T09:49:16.060 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_hit": 0, 2023-09-23T09:49:16.060 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_forward": 0, 2023-09-23T09:49:16.060 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_discover": 0, 2023-09-23T09:49:16.060 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_dir_fetch": 0, 2023-09-23T09:49:16.061 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_remote_ino": 0, 2023-09-23T09:49:16.061 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_lock": 0, 2023-09-23T09:49:16.061 INFO:teuthology.orchestra.run.smithi135.stdout: "load_cent": 0, 2023-09-23T09:49:16.061 INFO:teuthology.orchestra.run.smithi135.stdout: "q": 0, 2023-09-23T09:49:16.061 INFO:teuthology.orchestra.run.smithi135.stdout: "exported": 0, 2023-09-23T09:49:16.061 INFO:teuthology.orchestra.run.smithi135.stdout: "exported_inodes": 0, 2023-09-23T09:49:16.061 INFO:teuthology.orchestra.run.smithi135.stdout: "imported": 0, 2023-09-23T09:49:16.061 INFO:teuthology.orchestra.run.smithi135.stdout: "imported_inodes": 0, 2023-09-23T09:49:16.061 INFO:teuthology.orchestra.run.smithi135.stdout: "openino_dir_fetch": 0, 2023-09-23T09:49:16.062 INFO:teuthology.orchestra.run.smithi135.stdout: "openino_backtrace_fetch": 0, 2023-09-23T09:49:16.062 INFO:teuthology.orchestra.run.smithi135.stdout: "openino_peer_discover": 0, 2023-09-23T09:49:16.062 INFO:teuthology.orchestra.run.smithi135.stdout: "root_rfiles": 0, 2023-09-23T09:49:16.062 INFO:teuthology.orchestra.run.smithi135.stdout: "root_rbytes": 0, 2023-09-23T09:49:16.062 INFO:teuthology.orchestra.run.smithi135.stdout: "root_rsnaps": 0, 2023-09-23T09:49:16.062 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_backtrace_fetch": 0, 2023-09-23T09:49:16.062 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_set_tag": 0, 2023-09-23T09:49:16.062 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_backtrace_repaired": 0, 2023-09-23T09:49:16.062 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_inotable_repaired": 0, 2023-09-23T09:49:16.063 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_dir_inodes": 0, 2023-09-23T09:49:16.063 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_dir_base_inodes": 0, 2023-09-23T09:49:16.063 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_dirfrag_rstats": 0, 2023-09-23T09:49:16.063 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_file_inodes": 0, 2023-09-23T09:49:16.063 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_inode_file_caps": 0, 2023-09-23T09:49:16.063 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_revoke": 0, 2023-09-23T09:49:16.063 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_grant": 0, 2023-09-23T09:49:16.063 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_trunc": 0, 2023-09-23T09:49:16.063 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-09-23T09:49:16.064 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_flush_ack": 0, 2023-09-23T09:49:16.064 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_caps": 0, 2023-09-23T09:49:16.064 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_caps_dirty": 0, 2023-09-23T09:49:16.064 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_cap_release": 0, 2023-09-23T09:49:16.064 INFO:teuthology.orchestra.run.smithi135.stdout: "process_request_cap_release": 0 2023-09-23T09:49:16.064 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:16.064 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_cache": { 2023-09-23T09:49:16.064 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_update": 0, 2023-09-23T09:49:16.064 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_update_receipt": 0, 2023-09-23T09:49:16.065 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_try_discover": 0, 2023-09-23T09:49:16.065 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_send_discover": 0, 2023-09-23T09:49:16.065 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_handle_discover": 0, 2023-09-23T09:49:16.065 INFO:teuthology.orchestra.run.smithi135.stdout: "num_strays": 0, 2023-09-23T09:49:16.065 INFO:teuthology.orchestra.run.smithi135.stdout: "num_strays_delayed": 0, 2023-09-23T09:49:16.065 INFO:teuthology.orchestra.run.smithi135.stdout: "num_strays_enqueuing": 0, 2023-09-23T09:49:16.065 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_created": 0, 2023-09-23T09:49:16.065 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_enqueued": 0, 2023-09-23T09:49:16.065 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_reintegrated": 0, 2023-09-23T09:49:16.065 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_migrated": 0, 2023-09-23T09:49:16.066 INFO:teuthology.orchestra.run.smithi135.stdout: "num_recovering_processing": 0, 2023-09-23T09:49:16.066 INFO:teuthology.orchestra.run.smithi135.stdout: "num_recovering_enqueued": 0, 2023-09-23T09:49:16.066 INFO:teuthology.orchestra.run.smithi135.stdout: "num_recovering_prioritized": 0, 2023-09-23T09:49:16.066 INFO:teuthology.orchestra.run.smithi135.stdout: "recovery_started": 0, 2023-09-23T09:49:16.066 INFO:teuthology.orchestra.run.smithi135.stdout: "recovery_completed": 0, 2023-09-23T09:49:16.066 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_enqueue_scrub": 0, 2023-09-23T09:49:16.066 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_exportdir": 0, 2023-09-23T09:49:16.066 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_flush": 0, 2023-09-23T09:49:16.067 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_fragmentdir": 0, 2023-09-23T09:49:16.067 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_fragstats": 0, 2023-09-23T09:49:16.067 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_inodestats": 0 2023-09-23T09:49:16.067 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:16.067 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_log": { 2023-09-23T09:49:16.067 INFO:teuthology.orchestra.run.smithi135.stdout: "evlrg": 0, 2023-09-23T09:49:16.067 INFO:teuthology.orchestra.run.smithi135.stdout: "evadd": 0, 2023-09-23T09:49:16.067 INFO:teuthology.orchestra.run.smithi135.stdout: "evex": 0, 2023-09-23T09:49:16.067 INFO:teuthology.orchestra.run.smithi135.stdout: "evtrm": 0, 2023-09-23T09:49:16.067 INFO:teuthology.orchestra.run.smithi135.stdout: "ev": 14183, 2023-09-23T09:49:16.068 INFO:teuthology.orchestra.run.smithi135.stdout: "evexg": 0, 2023-09-23T09:49:16.068 INFO:teuthology.orchestra.run.smithi135.stdout: "evexd": 0, 2023-09-23T09:49:16.068 INFO:teuthology.orchestra.run.smithi135.stdout: "segadd": 0, 2023-09-23T09:49:16.068 INFO:teuthology.orchestra.run.smithi135.stdout: "segex": 0, 2023-09-23T09:49:16.068 INFO:teuthology.orchestra.run.smithi135.stdout: "segtrm": 0, 2023-09-23T09:49:16.068 INFO:teuthology.orchestra.run.smithi135.stdout: "seg": 21, 2023-09-23T09:49:16.068 INFO:teuthology.orchestra.run.smithi135.stdout: "segmjr": 3, 2023-09-23T09:49:16.068 INFO:teuthology.orchestra.run.smithi135.stdout: "segexg": 0, 2023-09-23T09:49:16.068 INFO:teuthology.orchestra.run.smithi135.stdout: "segexd": 0, 2023-09-23T09:49:16.069 INFO:teuthology.orchestra.run.smithi135.stdout: "expos": 4194304, 2023-09-23T09:49:16.069 INFO:teuthology.orchestra.run.smithi135.stdout: "wrpos": 64844865, 2023-09-23T09:49:16.069 INFO:teuthology.orchestra.run.smithi135.stdout: "rdpos": 64844804, 2023-09-23T09:49:16.069 INFO:teuthology.orchestra.run.smithi135.stdout: "jlat": { 2023-09-23T09:49:16.069 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:16.069 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:16.069 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:16.069 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:16.069 INFO:teuthology.orchestra.run.smithi135.stdout: "replayed": 14183 2023-09-23T09:49:16.069 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:16.070 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_mem": { 2023-09-23T09:49:16.070 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 312, 2023-09-23T09:49:16.070 INFO:teuthology.orchestra.run.smithi135.stdout: "ino+": 3108, 2023-09-23T09:49:16.070 INFO:teuthology.orchestra.run.smithi135.stdout: "ino-": 2796, 2023-09-23T09:49:16.070 INFO:teuthology.orchestra.run.smithi135.stdout: "dir": 26, 2023-09-23T09:49:16.070 INFO:teuthology.orchestra.run.smithi135.stdout: "dir+": 121, 2023-09-23T09:49:16.070 INFO:teuthology.orchestra.run.smithi135.stdout: "dir-": 95, 2023-09-23T09:49:16.070 INFO:teuthology.orchestra.run.smithi135.stdout: "dn": 1000, 2023-09-23T09:49:16.070 INFO:teuthology.orchestra.run.smithi135.stdout: "dn+": 3958, 2023-09-23T09:49:16.071 INFO:teuthology.orchestra.run.smithi135.stdout: "dn-": 2958, 2023-09-23T09:49:16.071 INFO:teuthology.orchestra.run.smithi135.stdout: "cap": 0, 2023-09-23T09:49:16.071 INFO:teuthology.orchestra.run.smithi135.stdout: "cap+": 0, 2023-09-23T09:49:16.071 INFO:teuthology.orchestra.run.smithi135.stdout: "cap-": 0, 2023-09-23T09:49:16.071 INFO:teuthology.orchestra.run.smithi135.stdout: "rss": 55252, 2023-09-23T09:49:16.071 INFO:teuthology.orchestra.run.smithi135.stdout: "heap": 207152 2023-09-23T09:49:16.071 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:16.071 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_server": { 2023-09-23T09:49:16.071 INFO:teuthology.orchestra.run.smithi135.stdout: "dispatch_client_request": 0, 2023-09-23T09:49:16.071 INFO:teuthology.orchestra.run.smithi135.stdout: "dispatch_server_request": 0, 2023-09-23T09:49:16.072 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_request": 0, 2023-09-23T09:49:16.072 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_session": 0, 2023-09-23T09:49:16.072 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_peer_request": 0, 2023-09-23T09:49:16.072 INFO:teuthology.orchestra.run.smithi135.stdout: "req_create_latency": { 2023-09-23T09:49:16.072 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:16.072 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:16.072 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:16.072 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:16.072 INFO:teuthology.orchestra.run.smithi135.stdout: "req_getattr_latency": { 2023-09-23T09:49:16.073 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:16.073 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:16.073 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:16.073 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:16.073 INFO:teuthology.orchestra.run.smithi135.stdout: "req_getfilelock_latency": { 2023-09-23T09:49:16.073 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:16.073 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:16.073 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:16.073 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:16.073 INFO:teuthology.orchestra.run.smithi135.stdout: "req_link_latency": { 2023-09-23T09:49:16.074 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:16.074 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:16.074 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:16.074 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:16.074 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookup_latency": { 2023-09-23T09:49:16.074 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:16.074 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:16.074 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:16.074 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:16.075 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookuphash_latency": { 2023-09-23T09:49:16.075 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:16.075 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:16.075 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:16.075 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:16.075 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupino_latency": { 2023-09-23T09:49:16.075 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:16.075 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:16.075 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:16.076 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:16.076 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupname_latency": { 2023-09-23T09:49:16.076 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:16.076 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:16.076 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:16.076 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:16.076 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupparent_latency": { 2023-09-23T09:49:16.076 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:16.076 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:16.076 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:16.077 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:16.077 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupsnap_latency": { 2023-09-23T09:49:16.077 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:16.077 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:16.077 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:16.077 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:16.077 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lssnap_latency": { 2023-09-23T09:49:16.077 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:16.077 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:16.078 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:16.078 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:16.078 INFO:teuthology.orchestra.run.smithi135.stdout: "req_mkdir_latency": { 2023-09-23T09:49:16.078 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:16.078 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:16.078 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:16.078 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:16.078 INFO:teuthology.orchestra.run.smithi135.stdout: "req_mknod_latency": { 2023-09-23T09:49:16.078 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:16.079 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:16.079 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:16.079 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:16.079 INFO:teuthology.orchestra.run.smithi135.stdout: "req_mksnap_latency": { 2023-09-23T09:49:16.079 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:16.079 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:16.079 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:16.079 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:16.079 INFO:teuthology.orchestra.run.smithi135.stdout: "req_open_latency": { 2023-09-23T09:49:16.079 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:16.080 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:16.080 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:16.080 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:16.080 INFO:teuthology.orchestra.run.smithi135.stdout: "req_readdir_latency": { 2023-09-23T09:49:16.080 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:16.080 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:16.080 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:16.080 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:16.080 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rename_latency": { 2023-09-23T09:49:16.081 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:16.081 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:16.081 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:16.081 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:16.081 INFO:teuthology.orchestra.run.smithi135.stdout: "req_renamesnap_latency": { 2023-09-23T09:49:16.081 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:16.081 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:16.081 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:16.081 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:16.081 INFO:teuthology.orchestra.run.smithi135.stdout: "req_snapdiff_latency": { 2023-09-23T09:49:16.081 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:16.082 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:16.082 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:16.082 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:16.082 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rmdir_latency": { 2023-09-23T09:49:16.082 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:16.082 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:16.082 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:16.082 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:16.082 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rmsnap_latency": { 2023-09-23T09:49:16.083 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:16.083 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:16.083 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:16.083 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:16.083 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rmxattr_latency": { 2023-09-23T09:49:16.083 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:16.083 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:16.083 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:16.083 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:16.083 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setattr_latency": { 2023-09-23T09:49:16.084 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:16.084 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:16.084 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:16.084 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:16.084 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setdirlayout_latency": { 2023-09-23T09:49:16.084 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:16.084 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:16.084 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:16.084 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:16.084 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setfilelock_latency": { 2023-09-23T09:49:16.085 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:16.085 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:16.085 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:16.085 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:16.085 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setlayout_latency": { 2023-09-23T09:49:16.085 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:16.085 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:16.085 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:16.085 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:16.085 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setxattr_latency": { 2023-09-23T09:49:16.086 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:16.086 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:16.086 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:16.086 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:16.086 INFO:teuthology.orchestra.run.smithi135.stdout: "req_symlink_latency": { 2023-09-23T09:49:16.086 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:16.086 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:16.086 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:16.086 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:16.086 INFO:teuthology.orchestra.run.smithi135.stdout: "req_unlink_latency": { 2023-09-23T09:49:16.087 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:16.087 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:16.087 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:16.087 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:16.087 INFO:teuthology.orchestra.run.smithi135.stdout: "cap_revoke_eviction": 0, 2023-09-23T09:49:16.087 INFO:teuthology.orchestra.run.smithi135.stdout: "cap_acquisition_throttle": 0, 2023-09-23T09:49:16.087 INFO:teuthology.orchestra.run.smithi135.stdout: "req_getvxattr_latency": { 2023-09-23T09:49:16.087 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:16.087 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:16.087 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:16.088 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-09-23T09:49:16.088 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:16.088 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_sessions": { 2023-09-23T09:49:16.088 INFO:teuthology.orchestra.run.smithi135.stdout: "session_count": 1, 2023-09-23T09:49:16.088 INFO:teuthology.orchestra.run.smithi135.stdout: "session_add": 4, 2023-09-23T09:49:16.088 INFO:teuthology.orchestra.run.smithi135.stdout: "session_remove": 3, 2023-09-23T09:49:16.088 INFO:teuthology.orchestra.run.smithi135.stdout: "sessions_open": 3, 2023-09-23T09:49:16.088 INFO:teuthology.orchestra.run.smithi135.stdout: "sessions_stale": 0, 2023-09-23T09:49:16.088 INFO:teuthology.orchestra.run.smithi135.stdout: "total_load": 0, 2023-09-23T09:49:16.088 INFO:teuthology.orchestra.run.smithi135.stdout: "average_load": 0, 2023-09-23T09:49:16.089 INFO:teuthology.orchestra.run.smithi135.stdout: "avg_session_uptime": 8081 2023-09-23T09:49:16.089 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:16.089 INFO:teuthology.orchestra.run.smithi135.stdout: "mempool": { 2023-09-23T09:49:16.089 INFO:teuthology.orchestra.run.smithi135.stdout: "bloom_filter_bytes": 0, 2023-09-23T09:49:16.089 INFO:teuthology.orchestra.run.smithi135.stdout: "bloom_filter_items": 0, 2023-09-23T09:49:16.089 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_alloc_bytes": 0, 2023-09-23T09:49:16.089 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_alloc_items": 0, 2023-09-23T09:49:16.089 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_data_bytes": 0, 2023-09-23T09:49:16.089 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_data_items": 0, 2023-09-23T09:49:16.089 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_onode_bytes": 0, 2023-09-23T09:49:16.090 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_onode_items": 0, 2023-09-23T09:49:16.090 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_meta_bytes": 0, 2023-09-23T09:49:16.090 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_meta_items": 0, 2023-09-23T09:49:16.090 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_other_bytes": 0, 2023-09-23T09:49:16.090 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_other_items": 0, 2023-09-23T09:49:16.090 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_buffer_bytes": 0, 2023-09-23T09:49:16.090 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_buffer_items": 0, 2023-09-23T09:49:16.090 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_extent_bytes": 0, 2023-09-23T09:49:16.090 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_extent_items": 0, 2023-09-23T09:49:16.091 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_blob_bytes": 0, 2023-09-23T09:49:16.091 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_blob_items": 0, 2023-09-23T09:49:16.091 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_shared_blob_bytes": 0, 2023-09-23T09:49:16.091 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_shared_blob_items": 0, 2023-09-23T09:49:16.091 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_inline_bl_bytes": 0, 2023-09-23T09:49:16.091 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_inline_bl_items": 0, 2023-09-23T09:49:16.091 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_fsck_bytes": 0, 2023-09-23T09:49:16.091 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_fsck_items": 0, 2023-09-23T09:49:16.091 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_txc_bytes": 0, 2023-09-23T09:49:16.091 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_txc_items": 0, 2023-09-23T09:49:16.091 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_deferred_bytes": 0, 2023-09-23T09:49:16.092 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_deferred_items": 0, 2023-09-23T09:49:16.092 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_bytes": 0, 2023-09-23T09:49:16.092 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_items": 0, 2023-09-23T09:49:16.092 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_bytes": 0, 2023-09-23T09:49:16.092 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_items": 0, 2023-09-23T09:49:16.092 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_reader_bytes": 0, 2023-09-23T09:49:16.092 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_reader_items": 0, 2023-09-23T09:49:16.092 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_writer_bytes": 0, 2023-09-23T09:49:16.092 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_writer_items": 0, 2023-09-23T09:49:16.092 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_anon_bytes": 233753, 2023-09-23T09:49:16.092 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_anon_items": 82, 2023-09-23T09:49:16.093 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_meta_bytes": 0, 2023-09-23T09:49:16.093 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_meta_items": 0, 2023-09-23T09:49:16.093 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_bytes": 0, 2023-09-23T09:49:16.093 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_items": 0, 2023-09-23T09:49:16.093 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_mapbl_bytes": 0, 2023-09-23T09:49:16.093 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_mapbl_items": 0, 2023-09-23T09:49:16.093 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_pglog_bytes": 0, 2023-09-23T09:49:16.093 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_pglog_items": 0, 2023-09-23T09:49:16.093 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_bytes": 8152, 2023-09-23T09:49:16.093 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_items": 170, 2023-09-23T09:49:16.094 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_mapping_bytes": 0, 2023-09-23T09:49:16.094 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_mapping_items": 0, 2023-09-23T09:49:16.094 INFO:teuthology.orchestra.run.smithi135.stdout: "pgmap_bytes": 0, 2023-09-23T09:49:16.094 INFO:teuthology.orchestra.run.smithi135.stdout: "pgmap_items": 0, 2023-09-23T09:49:16.094 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_co_bytes": 1744609, 2023-09-23T09:49:16.094 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_co_items": 57003, 2023-09-23T09:49:16.095 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_1_bytes": 0, 2023-09-23T09:49:16.095 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_1_items": 0, 2023-09-23T09:49:16.095 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_2_bytes": 0, 2023-09-23T09:49:16.095 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_2_items": 0 2023-09-23T09:49:16.095 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:16.095 INFO:teuthology.orchestra.run.smithi135.stdout: "objecter": { 2023-09-23T09:49:16.095 INFO:teuthology.orchestra.run.smithi135.stdout: "op_active": 0, 2023-09-23T09:49:16.096 INFO:teuthology.orchestra.run.smithi135.stdout: "op_laggy": 0, 2023-09-23T09:49:16.096 INFO:teuthology.orchestra.run.smithi135.stdout: "op_send": 10554, 2023-09-23T09:49:16.096 INFO:teuthology.orchestra.run.smithi135.stdout: "op_send_bytes": 21, 2023-09-23T09:49:16.096 INFO:teuthology.orchestra.run.smithi135.stdout: "op_resend": 3, 2023-09-23T09:49:16.096 INFO:teuthology.orchestra.run.smithi135.stdout: "op_reply": 10554, 2023-09-23T09:49:16.096 INFO:teuthology.orchestra.run.smithi135.stdout: "op_latency": { 2023-09-23T09:49:16.096 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 10554, 2023-09-23T09:49:16.096 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 11.715766904, 2023-09-23T09:49:16.097 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.001110078 2023-09-23T09:49:16.097 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:16.097 INFO:teuthology.orchestra.run.smithi135.stdout: "op_inflight": 0, 2023-09-23T09:49:16.097 INFO:teuthology.orchestra.run.smithi135.stdout: "oplen_avg": { 2023-09-23T09:49:16.097 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 10554, 2023-09-23T09:49:16.097 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 10555 2023-09-23T09:49:16.097 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:16.097 INFO:teuthology.orchestra.run.smithi135.stdout: "op": 10554, 2023-09-23T09:49:16.098 INFO:teuthology.orchestra.run.smithi135.stdout: "op_r": 10554, 2023-09-23T09:49:16.098 INFO:teuthology.orchestra.run.smithi135.stdout: "op_w": 0, 2023-09-23T09:49:16.098 INFO:teuthology.orchestra.run.smithi135.stdout: "op_rmw": 0, 2023-09-23T09:49:16.098 INFO:teuthology.orchestra.run.smithi135.stdout: "op_pg": 0, 2023-09-23T09:49:16.098 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_stat": 6406, 2023-09-23T09:49:16.098 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_create": 0, 2023-09-23T09:49:16.098 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_read": 4146, 2023-09-23T09:49:16.098 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_write": 0, 2023-09-23T09:49:16.099 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_writefull": 0, 2023-09-23T09:49:16.099 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_writesame": 0, 2023-09-23T09:49:16.099 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_append": 0, 2023-09-23T09:49:16.099 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_zero": 0, 2023-09-23T09:49:16.099 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_truncate": 0, 2023-09-23T09:49:16.099 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_delete": 0, 2023-09-23T09:49:16.099 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_mapext": 0, 2023-09-23T09:49:16.099 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_sparse_read": 0, 2023-09-23T09:49:16.100 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_clonerange": 0, 2023-09-23T09:49:16.100 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_getxattr": 1, 2023-09-23T09:49:16.100 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_setxattr": 0, 2023-09-23T09:49:16.100 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_cmpxattr": 0, 2023-09-23T09:49:16.100 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_rmxattr": 0, 2023-09-23T09:49:16.100 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_resetxattrs": 0, 2023-09-23T09:49:16.100 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_call": 0, 2023-09-23T09:49:16.100 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_watch": 0, 2023-09-23T09:49:16.101 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_notify": 0, 2023-09-23T09:49:16.101 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_src_cmpxattr": 0, 2023-09-23T09:49:16.101 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_pgls": 0, 2023-09-23T09:49:16.101 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_pgls_filter": 0, 2023-09-23T09:49:16.101 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_other": 0, 2023-09-23T09:49:16.101 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_active": 0, 2023-09-23T09:49:16.101 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_send": 0, 2023-09-23T09:49:16.101 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_resend": 0, 2023-09-23T09:49:16.102 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_ping": 0, 2023-09-23T09:49:16.102 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_active": 0, 2023-09-23T09:49:16.102 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_send": 0, 2023-09-23T09:49:16.102 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_resend": 0, 2023-09-23T09:49:16.102 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_active": 0, 2023-09-23T09:49:16.102 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_send": 0, 2023-09-23T09:49:16.102 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_resend": 0, 2023-09-23T09:49:16.102 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_active": 0, 2023-09-23T09:49:16.103 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_send": 0, 2023-09-23T09:49:16.103 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_resend": 0, 2023-09-23T09:49:16.103 INFO:teuthology.orchestra.run.smithi135.stdout: "command_active": 0, 2023-09-23T09:49:16.103 INFO:teuthology.orchestra.run.smithi135.stdout: "command_send": 0, 2023-09-23T09:49:16.103 INFO:teuthology.orchestra.run.smithi135.stdout: "command_resend": 0, 2023-09-23T09:49:16.103 INFO:teuthology.orchestra.run.smithi135.stdout: "map_epoch": 180, 2023-09-23T09:49:16.103 INFO:teuthology.orchestra.run.smithi135.stdout: "map_full": 0, 2023-09-23T09:49:16.103 INFO:teuthology.orchestra.run.smithi135.stdout: "map_inc": 94, 2023-09-23T09:49:16.103 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_sessions": 10, 2023-09-23T09:49:16.104 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_session_open": 14, 2023-09-23T09:49:16.104 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_session_close": 4, 2023-09-23T09:49:16.104 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_laggy": 0, 2023-09-23T09:49:16.104 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_wr": 0, 2023-09-23T09:49:16.104 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_rd": 2, 2023-09-23T09:49:16.104 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_del": 0 2023-09-23T09:49:16.104 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:16.104 INFO:teuthology.orchestra.run.smithi135.stdout: "oft": { 2023-09-23T09:49:16.105 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_objs": 0, 2023-09-23T09:49:16.105 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_kv_pairs": 0, 2023-09-23T09:49:16.105 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_updates": 0, 2023-09-23T09:49:16.105 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_removes": 0 2023-09-23T09:49:16.105 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:16.105 INFO:teuthology.orchestra.run.smithi135.stdout: "osd-slow-ops": { 2023-09-23T09:49:16.105 INFO:teuthology.orchestra.run.smithi135.stdout: "slow_ops_count": 0 2023-09-23T09:49:16.105 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:16.105 INFO:teuthology.orchestra.run.smithi135.stdout: "purge_queue": { 2023-09-23T09:49:16.106 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing_ops": 0, 2023-09-23T09:49:16.106 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing_ops_high_water": 0, 2023-09-23T09:49:16.106 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing": 0, 2023-09-23T09:49:16.106 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing_high_water": 0, 2023-09-23T09:49:16.106 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executed": 0, 2023-09-23T09:49:16.106 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_item_in_journal": 0 2023-09-23T09:49:16.106 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:16.106 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-09-23T09:49:16.107 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2023-09-23T09:49:16.107 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 104857600, 2023-09-23T09:49:16.107 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2023-09-23T09:49:16.107 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 11659, 2023-09-23T09:49:16.107 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 65100635, 2023-09-23T09:49:16.107 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2023-09-23T09:49:16.107 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 11659, 2023-09-23T09:49:16.107 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2023-09-23T09:49:16.107 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2023-09-23T09:49:16.107 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 11659, 2023-09-23T09:49:16.108 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 65100635, 2023-09-23T09:49:16.108 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2023-09-23T09:49:16.108 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:16.108 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:16.108 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:16.108 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-09-23T09:49:16.108 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:16.108 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-objecter_bytes": { 2023-09-23T09:49:16.108 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2023-09-23T09:49:16.109 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 104857600, 2023-09-23T09:49:16.109 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2023-09-23T09:49:16.109 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2023-09-23T09:49:16.109 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2023-09-23T09:49:16.109 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2023-09-23T09:49:16.109 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2023-09-23T09:49:16.109 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 10554, 2023-09-23T09:49:16.109 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 60654989, 2023-09-23T09:49:16.109 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 10554, 2023-09-23T09:49:16.110 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 60654989, 2023-09-23T09:49:16.110 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2023-09-23T09:49:16.110 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:16.110 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:16.110 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:16.110 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-09-23T09:49:16.110 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:16.110 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-objecter_ops": { 2023-09-23T09:49:16.110 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2023-09-23T09:49:16.111 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 1024, 2023-09-23T09:49:16.111 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2023-09-23T09:49:16.111 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2023-09-23T09:49:16.111 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2023-09-23T09:49:16.111 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2023-09-23T09:49:16.111 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2023-09-23T09:49:16.111 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 10554, 2023-09-23T09:49:16.111 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 10554, 2023-09-23T09:49:16.111 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 10554, 2023-09-23T09:49:16.111 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 10554, 2023-09-23T09:49:16.112 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2023-09-23T09:49:16.112 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:16.112 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:16.112 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:16.112 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-09-23T09:49:16.112 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:16.112 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-write_buf_throttle": { 2023-09-23T09:49:16.112 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2023-09-23T09:49:16.112 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 3758096384, 2023-09-23T09:49:16.113 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2023-09-23T09:49:16.113 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2023-09-23T09:49:16.113 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2023-09-23T09:49:16.113 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2023-09-23T09:49:16.113 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2023-09-23T09:49:16.113 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2023-09-23T09:49:16.113 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2023-09-23T09:49:16.113 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 0, 2023-09-23T09:49:16.113 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 0, 2023-09-23T09:49:16.113 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2023-09-23T09:49:16.114 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:16.114 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:16.114 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:16.114 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-09-23T09:49:16.114 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-23T09:49:16.114 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-write_buf_throttle-0x55d3e357ea00": { 2023-09-23T09:49:16.114 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2023-09-23T09:49:16.114 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 3758096384, 2023-09-23T09:49:16.114 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2023-09-23T09:49:16.115 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2023-09-23T09:49:16.115 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2023-09-23T09:49:16.115 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2023-09-23T09:49:16.115 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2023-09-23T09:49:16.115 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2023-09-23T09:49:16.115 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2023-09-23T09:49:16.115 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 0, 2023-09-23T09:49:16.115 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 0, 2023-09-23T09:49:16.115 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2023-09-23T09:49:16.116 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-09-23T09:49:16.116 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-09-23T09:49:16.116 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-09-23T09:49:16.116 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-09-23T09:49:16.116 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-09-23T09:49:16.116 INFO:teuthology.orchestra.run.smithi135.stdout:} 2023-09-23T09:49:16.914 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2023-09-23T09:49:16.914 INFO:tasks.check_counter:Daemon mds.k mds.imported=0 2023-09-23T09:49:16.914 INFO:tasks.check_counter:Daemon mds.k mds.root_rsnaps=0 2023-09-23T09:49:16.914 INFO:tasks.check_counter:Daemon mds.k mds_server.req_mksnap_latency.avgcount=0 2023-09-23T09:49:16.914 INFO:tasks.check_counter:Daemon mds.k mds_server.req_rmsnap_latency.avgcount=0 2023-09-23T09:49:16.914 DEBUG:tasks.check_counter:Getting stats from c 2023-09-23T09:49:16.915 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- ceph daemon mds.c perf dump 2023-09-23T09:49:17.560 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:49:17 smithi135 ceph-mon[99205]: pgmap v1665: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-09-23T09:49:17.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:49:17 smithi082 ceph-mon[97694]: pgmap v1665: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-09-23T09:49:17.646 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:49:17 smithi161 ceph-mon[99580]: pgmap v1665: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-09-23T09:49:17.842 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.c/config 2023-09-23T09:49:18.773 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:49:18 smithi161 ceph-mon[99580]: osdmap e181: 12 total, 12 up, 12 in 2023-09-23T09:49:18.773 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:49:18 smithi161 ceph-mon[99580]: pgmap v1667: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-09-23T09:49:18.810 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:49:18 smithi135 ceph-mon[99205]: osdmap e181: 12 total, 12 up, 12 in 2023-09-23T09:49:18.810 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:49:18 smithi135 ceph-mon[99205]: pgmap v1667: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-09-23T09:49:18.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:49:18 smithi082 ceph-mon[97694]: osdmap e181: 12 total, 12 up, 12 in 2023-09-23T09:49:18.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:49:18 smithi082 ceph-mon[97694]: pgmap v1667: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-09-23T09:49:19.508 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2023-09-23T09:49:19.508 INFO:teuthology.orchestra.run.smithi161.stdout: "AsyncMessenger::Worker-0": { 2023-09-23T09:49:19.509 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_recv_messages": 261146, 2023-09-23T09:49:19.509 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_messages": 408941, 2023-09-23T09:49:19.509 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_recv_bytes": 70892949, 2023-09-23T09:49:19.509 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_bytes": 160316503, 2023-09-23T09:49:19.509 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_created_connections": 20, 2023-09-23T09:49:19.509 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_active_connections": 4, 2023-09-23T09:49:19.509 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_total_time": 29.862446471, 2023-09-23T09:49:19.509 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_send_time": 14.797726692, 2023-09-23T09:49:19.509 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_recv_time": 17.513892016, 2023-09-23T09:49:19.509 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_fast_dispatch_time": 0.068691703, 2023-09-23T09:49:19.510 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_messages_queue_lat": { 2023-09-23T09:49:19.510 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 408940, 2023-09-23T09:49:19.510 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 24.378675846, 2023-09-23T09:49:19.510 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000059614 2023-09-23T09:49:19.510 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:19.510 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_handle_ack_lat": { 2023-09-23T09:49:19.510 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 646284, 2023-09-23T09:49:19.510 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.137740052, 2023-09-23T09:49:19.510 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000213 2023-09-23T09:49:19.510 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:19.510 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_recv_encrypted_bytes": 4448, 2023-09-23T09:49:19.511 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_encrypted_bytes": 1840 2023-09-23T09:49:19.511 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:19.511 INFO:teuthology.orchestra.run.smithi161.stdout: "AsyncMessenger::Worker-1": { 2023-09-23T09:49:19.511 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_recv_messages": 32098, 2023-09-23T09:49:19.511 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_messages": 30812, 2023-09-23T09:49:19.511 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_recv_bytes": 9996614, 2023-09-23T09:49:19.511 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_bytes": 30742113, 2023-09-23T09:49:19.511 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_created_connections": 20, 2023-09-23T09:49:19.511 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_active_connections": 6, 2023-09-23T09:49:19.511 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_total_time": 3.332118580, 2023-09-23T09:49:19.511 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_send_time": 1.672710130, 2023-09-23T09:49:19.512 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_recv_time": 1.962387490, 2023-09-23T09:49:19.512 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_fast_dispatch_time": 0.108133395, 2023-09-23T09:49:19.512 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_messages_queue_lat": { 2023-09-23T09:49:19.512 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 30809, 2023-09-23T09:49:19.512 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 2.100307443, 2023-09-23T09:49:19.512 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000068171 2023-09-23T09:49:19.512 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:19.512 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_handle_ack_lat": { 2023-09-23T09:49:19.512 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 54244, 2023-09-23T09:49:19.512 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.014245785, 2023-09-23T09:49:19.513 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000262 2023-09-23T09:49:19.513 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:19.513 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_recv_encrypted_bytes": 1984, 2023-09-23T09:49:19.513 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_encrypted_bytes": 95248 2023-09-23T09:49:19.513 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:19.513 INFO:teuthology.orchestra.run.smithi161.stdout: "AsyncMessenger::Worker-2": { 2023-09-23T09:49:19.513 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_recv_messages": 152745, 2023-09-23T09:49:19.513 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_messages": 235964, 2023-09-23T09:49:19.513 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_recv_bytes": 46101945, 2023-09-23T09:49:19.513 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_bytes": 67761861, 2023-09-23T09:49:19.513 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_created_connections": 22, 2023-09-23T09:49:19.514 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_active_connections": 8, 2023-09-23T09:49:19.514 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_total_time": 15.695309514, 2023-09-23T09:49:19.514 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_send_time": 6.871507905, 2023-09-23T09:49:19.514 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_recv_time": 9.797097790, 2023-09-23T09:49:19.514 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_fast_dispatch_time": 0.038664949, 2023-09-23T09:49:19.514 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_messages_queue_lat": { 2023-09-23T09:49:19.514 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 235963, 2023-09-23T09:49:19.514 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 15.796918333, 2023-09-23T09:49:19.514 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000066946 2023-09-23T09:49:19.514 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:19.514 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_handle_ack_lat": { 2023-09-23T09:49:19.515 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 376859, 2023-09-23T09:49:19.515 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.090887420, 2023-09-23T09:49:19.515 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000241 2023-09-23T09:49:19.515 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:19.515 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_recv_encrypted_bytes": 2631936, 2023-09-23T09:49:19.515 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_encrypted_bytes": 1856240 2023-09-23T09:49:19.515 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:19.515 INFO:teuthology.orchestra.run.smithi161.stdout: "cct": { 2023-09-23T09:49:19.515 INFO:teuthology.orchestra.run.smithi161.stdout: "total_workers": 1, 2023-09-23T09:49:19.515 INFO:teuthology.orchestra.run.smithi161.stdout: "unhealthy_workers": 0 2023-09-23T09:49:19.515 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:19.516 INFO:teuthology.orchestra.run.smithi161.stdout: "finisher-MDSRank": { 2023-09-23T09:49:19.516 INFO:teuthology.orchestra.run.smithi161.stdout: "queue_len": 0, 2023-09-23T09:49:19.516 INFO:teuthology.orchestra.run.smithi161.stdout: "complete_latency": { 2023-09-23T09:49:19.516 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 10339, 2023-09-23T09:49:19.516 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 3.591883241, 2023-09-23T09:49:19.516 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000347411 2023-09-23T09:49:19.516 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-09-23T09:49:19.516 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:19.516 INFO:teuthology.orchestra.run.smithi161.stdout: "finisher-PurgeQueue": { 2023-09-23T09:49:19.516 INFO:teuthology.orchestra.run.smithi161.stdout: "queue_len": 0, 2023-09-23T09:49:19.516 INFO:teuthology.orchestra.run.smithi161.stdout: "complete_latency": { 2023-09-23T09:49:19.517 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 2, 2023-09-23T09:49:19.517 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000024943, 2023-09-23T09:49:19.517 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000012471 2023-09-23T09:49:19.517 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-09-23T09:49:19.517 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:19.517 INFO:teuthology.orchestra.run.smithi161.stdout: "mds": { 2023-09-23T09:49:19.517 INFO:teuthology.orchestra.run.smithi161.stdout: "request": 67368, 2023-09-23T09:49:19.517 INFO:teuthology.orchestra.run.smithi161.stdout: "reply": 65791, 2023-09-23T09:49:19.517 INFO:teuthology.orchestra.run.smithi161.stdout: "reply_latency": { 2023-09-23T09:49:19.517 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 65791, 2023-09-23T09:49:19.517 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 447.997501905, 2023-09-23T09:49:19.518 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.006809404 2023-09-23T09:49:19.518 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:19.518 INFO:teuthology.orchestra.run.smithi161.stdout: "slow_reply": 0, 2023-09-23T09:49:19.518 INFO:teuthology.orchestra.run.smithi161.stdout: "forward": 1577, 2023-09-23T09:49:19.518 INFO:teuthology.orchestra.run.smithi161.stdout: "dir_fetch_complete": 13, 2023-09-23T09:49:19.518 INFO:teuthology.orchestra.run.smithi161.stdout: "dir_fetch_keys": 0, 2023-09-23T09:49:19.518 INFO:teuthology.orchestra.run.smithi161.stdout: "dir_commit": 20, 2023-09-23T09:49:19.518 INFO:teuthology.orchestra.run.smithi161.stdout: "dir_split": 1, 2023-09-23T09:49:19.518 INFO:teuthology.orchestra.run.smithi161.stdout: "dir_merge": 0, 2023-09-23T09:49:19.518 INFO:teuthology.orchestra.run.smithi161.stdout: "inodes": 686, 2023-09-23T09:49:19.518 INFO:teuthology.orchestra.run.smithi161.stdout: "inodes_top": 16, 2023-09-23T09:49:19.519 INFO:teuthology.orchestra.run.smithi161.stdout: "inodes_bottom": 429, 2023-09-23T09:49:19.519 INFO:teuthology.orchestra.run.smithi161.stdout: "inodes_pin_tail": 241, 2023-09-23T09:49:19.519 INFO:teuthology.orchestra.run.smithi161.stdout: "inodes_pinned": 663, 2023-09-23T09:49:19.519 INFO:teuthology.orchestra.run.smithi161.stdout: "inodes_expired": 1685, 2023-09-23T09:49:19.519 INFO:teuthology.orchestra.run.smithi161.stdout: "inodes_with_caps": 237, 2023-09-23T09:49:19.519 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": 237, 2023-09-23T09:49:19.519 INFO:teuthology.orchestra.run.smithi161.stdout: "subtrees": 20, 2023-09-23T09:49:19.519 INFO:teuthology.orchestra.run.smithi161.stdout: "traverse": 162491, 2023-09-23T09:49:19.519 INFO:teuthology.orchestra.run.smithi161.stdout: "traverse_hit": 152777, 2023-09-23T09:49:19.519 INFO:teuthology.orchestra.run.smithi161.stdout: "traverse_forward": 1489, 2023-09-23T09:49:19.519 INFO:teuthology.orchestra.run.smithi161.stdout: "traverse_discover": 296, 2023-09-23T09:49:19.520 INFO:teuthology.orchestra.run.smithi161.stdout: "traverse_dir_fetch": 3, 2023-09-23T09:49:19.520 INFO:teuthology.orchestra.run.smithi161.stdout: "traverse_remote_ino": 0, 2023-09-23T09:49:19.520 INFO:teuthology.orchestra.run.smithi161.stdout: "traverse_lock": 4385, 2023-09-23T09:49:19.520 INFO:teuthology.orchestra.run.smithi161.stdout: "load_cent": 2000, 2023-09-23T09:49:19.520 INFO:teuthology.orchestra.run.smithi161.stdout: "q": 2, 2023-09-23T09:49:19.520 INFO:teuthology.orchestra.run.smithi161.stdout: "exported": 16, 2023-09-23T09:49:19.520 INFO:teuthology.orchestra.run.smithi161.stdout: "exported_inodes": 1028, 2023-09-23T09:49:19.520 INFO:teuthology.orchestra.run.smithi161.stdout: "imported": 16, 2023-09-23T09:49:19.520 INFO:teuthology.orchestra.run.smithi161.stdout: "imported_inodes": 957, 2023-09-23T09:49:19.520 INFO:teuthology.orchestra.run.smithi161.stdout: "openino_dir_fetch": 0, 2023-09-23T09:49:19.520 INFO:teuthology.orchestra.run.smithi161.stdout: "openino_backtrace_fetch": 360, 2023-09-23T09:49:19.521 INFO:teuthology.orchestra.run.smithi161.stdout: "openino_peer_discover": 0, 2023-09-23T09:49:19.521 INFO:teuthology.orchestra.run.smithi161.stdout: "root_rfiles": 1045, 2023-09-23T09:49:19.521 INFO:teuthology.orchestra.run.smithi161.stdout: "root_rbytes": 8989915630, 2023-09-23T09:49:19.521 INFO:teuthology.orchestra.run.smithi161.stdout: "root_rsnaps": 7, 2023-09-23T09:49:19.521 INFO:teuthology.orchestra.run.smithi161.stdout: "scrub_backtrace_fetch": 360, 2023-09-23T09:49:19.521 INFO:teuthology.orchestra.run.smithi161.stdout: "scrub_set_tag": 0, 2023-09-23T09:49:19.521 INFO:teuthology.orchestra.run.smithi161.stdout: "scrub_backtrace_repaired": 0, 2023-09-23T09:49:19.521 INFO:teuthology.orchestra.run.smithi161.stdout: "scrub_inotable_repaired": 0, 2023-09-23T09:49:19.521 INFO:teuthology.orchestra.run.smithi161.stdout: "scrub_dir_inodes": 5, 2023-09-23T09:49:19.521 INFO:teuthology.orchestra.run.smithi161.stdout: "scrub_dir_base_inodes": 0, 2023-09-23T09:49:19.521 INFO:teuthology.orchestra.run.smithi161.stdout: "scrub_dirfrag_rstats": 5, 2023-09-23T09:49:19.522 INFO:teuthology.orchestra.run.smithi161.stdout: "scrub_file_inodes": 355, 2023-09-23T09:49:19.522 INFO:teuthology.orchestra.run.smithi161.stdout: "handle_inode_file_caps": 647, 2023-09-23T09:49:19.522 INFO:teuthology.orchestra.run.smithi161.stdout: "ceph_cap_op_revoke": 76942, 2023-09-23T09:49:19.522 INFO:teuthology.orchestra.run.smithi161.stdout: "ceph_cap_op_grant": 56210, 2023-09-23T09:49:19.522 INFO:teuthology.orchestra.run.smithi161.stdout: "ceph_cap_op_trunc": 0, 2023-09-23T09:49:19.522 INFO:teuthology.orchestra.run.smithi161.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-09-23T09:49:19.522 INFO:teuthology.orchestra.run.smithi161.stdout: "ceph_cap_op_flush_ack": 0, 2023-09-23T09:49:19.522 INFO:teuthology.orchestra.run.smithi161.stdout: "handle_client_caps": 81044, 2023-09-23T09:49:19.522 INFO:teuthology.orchestra.run.smithi161.stdout: "handle_client_caps_dirty": 2586, 2023-09-23T09:49:19.522 INFO:teuthology.orchestra.run.smithi161.stdout: "handle_client_cap_release": 385, 2023-09-23T09:49:19.522 INFO:teuthology.orchestra.run.smithi161.stdout: "process_request_cap_release": 755 2023-09-23T09:49:19.523 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:19.523 INFO:teuthology.orchestra.run.smithi161.stdout: "mds_cache": { 2023-09-23T09:49:19.523 INFO:teuthology.orchestra.run.smithi161.stdout: "dir_update": 0, 2023-09-23T09:49:19.523 INFO:teuthology.orchestra.run.smithi161.stdout: "dir_update_receipt": 2, 2023-09-23T09:49:19.523 INFO:teuthology.orchestra.run.smithi161.stdout: "dir_try_discover": 1, 2023-09-23T09:49:19.523 INFO:teuthology.orchestra.run.smithi161.stdout: "dir_send_discover": 297, 2023-09-23T09:49:19.523 INFO:teuthology.orchestra.run.smithi161.stdout: "dir_handle_discover": 275, 2023-09-23T09:49:19.523 INFO:teuthology.orchestra.run.smithi161.stdout: "num_strays": 0, 2023-09-23T09:49:19.523 INFO:teuthology.orchestra.run.smithi161.stdout: "num_strays_delayed": 0, 2023-09-23T09:49:19.523 INFO:teuthology.orchestra.run.smithi161.stdout: "num_strays_enqueuing": 0, 2023-09-23T09:49:19.523 INFO:teuthology.orchestra.run.smithi161.stdout: "strays_created": 261, 2023-09-23T09:49:19.524 INFO:teuthology.orchestra.run.smithi161.stdout: "strays_enqueued": 0, 2023-09-23T09:49:19.524 INFO:teuthology.orchestra.run.smithi161.stdout: "strays_reintegrated": 1112, 2023-09-23T09:49:19.524 INFO:teuthology.orchestra.run.smithi161.stdout: "strays_migrated": 102, 2023-09-23T09:49:19.524 INFO:teuthology.orchestra.run.smithi161.stdout: "num_recovering_processing": 0, 2023-09-23T09:49:19.524 INFO:teuthology.orchestra.run.smithi161.stdout: "num_recovering_enqueued": 0, 2023-09-23T09:49:19.524 INFO:teuthology.orchestra.run.smithi161.stdout: "num_recovering_prioritized": 0, 2023-09-23T09:49:19.524 INFO:teuthology.orchestra.run.smithi161.stdout: "recovery_started": 0, 2023-09-23T09:49:19.524 INFO:teuthology.orchestra.run.smithi161.stdout: "recovery_completed": 0, 2023-09-23T09:49:19.524 INFO:teuthology.orchestra.run.smithi161.stdout: "ireq_enqueue_scrub": 0, 2023-09-23T09:49:19.524 INFO:teuthology.orchestra.run.smithi161.stdout: "ireq_exportdir": 26, 2023-09-23T09:49:19.524 INFO:teuthology.orchestra.run.smithi161.stdout: "ireq_flush": 0, 2023-09-23T09:49:19.525 INFO:teuthology.orchestra.run.smithi161.stdout: "ireq_fragmentdir": 1, 2023-09-23T09:49:19.525 INFO:teuthology.orchestra.run.smithi161.stdout: "ireq_fragstats": 0, 2023-09-23T09:49:19.525 INFO:teuthology.orchestra.run.smithi161.stdout: "ireq_inodestats": 0 2023-09-23T09:49:19.525 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:19.525 INFO:teuthology.orchestra.run.smithi161.stdout: "mds_log": { 2023-09-23T09:49:19.525 INFO:teuthology.orchestra.run.smithi161.stdout: "evlrg": 0, 2023-09-23T09:49:19.525 INFO:teuthology.orchestra.run.smithi161.stdout: "evadd": 9806, 2023-09-23T09:49:19.525 INFO:teuthology.orchestra.run.smithi161.stdout: "evex": 0, 2023-09-23T09:49:19.525 INFO:teuthology.orchestra.run.smithi161.stdout: "evtrm": 0, 2023-09-23T09:49:19.525 INFO:teuthology.orchestra.run.smithi161.stdout: "ev": 9806, 2023-09-23T09:49:19.525 INFO:teuthology.orchestra.run.smithi161.stdout: "evexg": 0, 2023-09-23T09:49:19.526 INFO:teuthology.orchestra.run.smithi161.stdout: "evexd": 0, 2023-09-23T09:49:19.526 INFO:teuthology.orchestra.run.smithi161.stdout: "segadd": 15, 2023-09-23T09:49:19.526 INFO:teuthology.orchestra.run.smithi161.stdout: "segex": 0, 2023-09-23T09:49:19.526 INFO:teuthology.orchestra.run.smithi161.stdout: "segtrm": 0, 2023-09-23T09:49:19.526 INFO:teuthology.orchestra.run.smithi161.stdout: "seg": 15, 2023-09-23T09:49:19.526 INFO:teuthology.orchestra.run.smithi161.stdout: "segmjr": 2, 2023-09-23T09:49:19.526 INFO:teuthology.orchestra.run.smithi161.stdout: "segexg": 0, 2023-09-23T09:49:19.526 INFO:teuthology.orchestra.run.smithi161.stdout: "segexd": 0, 2023-09-23T09:49:19.526 INFO:teuthology.orchestra.run.smithi161.stdout: "expos": 4194304, 2023-09-23T09:49:19.526 INFO:teuthology.orchestra.run.smithi161.stdout: "wrpos": 35325545, 2023-09-23T09:49:19.526 INFO:teuthology.orchestra.run.smithi161.stdout: "rdpos": 0, 2023-09-23T09:49:19.527 INFO:teuthology.orchestra.run.smithi161.stdout: "jlat": { 2023-09-23T09:49:19.527 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 4910, 2023-09-23T09:49:19.527 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 19.518707210, 2023-09-23T09:49:19.527 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.003975296 2023-09-23T09:49:19.527 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:19.527 INFO:teuthology.orchestra.run.smithi161.stdout: "replayed": 0 2023-09-23T09:49:19.527 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:19.527 INFO:teuthology.orchestra.run.smithi161.stdout: "mds_mem": { 2023-09-23T09:49:19.527 INFO:teuthology.orchestra.run.smithi161.stdout: "ino": 343, 2023-09-23T09:49:19.527 INFO:teuthology.orchestra.run.smithi161.stdout: "ino+": 866, 2023-09-23T09:49:19.527 INFO:teuthology.orchestra.run.smithi161.stdout: "ino-": 523, 2023-09-23T09:49:19.528 INFO:teuthology.orchestra.run.smithi161.stdout: "dir": 69, 2023-09-23T09:49:19.528 INFO:teuthology.orchestra.run.smithi161.stdout: "dir+": 135, 2023-09-23T09:49:19.528 INFO:teuthology.orchestra.run.smithi161.stdout: "dir-": 66, 2023-09-23T09:49:19.528 INFO:teuthology.orchestra.run.smithi161.stdout: "dn": 686, 2023-09-23T09:49:19.528 INFO:teuthology.orchestra.run.smithi161.stdout: "dn+": 2409, 2023-09-23T09:49:19.528 INFO:teuthology.orchestra.run.smithi161.stdout: "dn-": 1723, 2023-09-23T09:49:19.528 INFO:teuthology.orchestra.run.smithi161.stdout: "cap": 237, 2023-09-23T09:49:19.528 INFO:teuthology.orchestra.run.smithi161.stdout: "cap+": 778, 2023-09-23T09:49:19.528 INFO:teuthology.orchestra.run.smithi161.stdout: "cap-": 541, 2023-09-23T09:49:19.528 INFO:teuthology.orchestra.run.smithi161.stdout: "rss": 65584, 2023-09-23T09:49:19.528 INFO:teuthology.orchestra.run.smithi161.stdout: "heap": 198960 2023-09-23T09:49:19.529 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:19.529 INFO:teuthology.orchestra.run.smithi161.stdout: "mds_server": { 2023-09-23T09:49:19.529 INFO:teuthology.orchestra.run.smithi161.stdout: "dispatch_client_request": 138778, 2023-09-23T09:49:19.529 INFO:teuthology.orchestra.run.smithi161.stdout: "dispatch_server_request": 7246, 2023-09-23T09:49:19.529 INFO:teuthology.orchestra.run.smithi161.stdout: "handle_client_request": 67368, 2023-09-23T09:49:19.529 INFO:teuthology.orchestra.run.smithi161.stdout: "handle_client_session": 166, 2023-09-23T09:49:19.529 INFO:teuthology.orchestra.run.smithi161.stdout: "handle_peer_request": 13658, 2023-09-23T09:49:19.529 INFO:teuthology.orchestra.run.smithi161.stdout: "req_create_latency": { 2023-09-23T09:49:19.529 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 60, 2023-09-23T09:49:19.529 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.127344670, 2023-09-23T09:49:19.529 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.002122411 2023-09-23T09:49:19.529 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:19.530 INFO:teuthology.orchestra.run.smithi161.stdout: "req_getattr_latency": { 2023-09-23T09:49:19.530 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 53976, 2023-09-23T09:49:19.530 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 72.952982777, 2023-09-23T09:49:19.530 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.001351581 2023-09-23T09:49:19.530 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:19.530 INFO:teuthology.orchestra.run.smithi161.stdout: "req_getfilelock_latency": { 2023-09-23T09:49:19.530 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:19.530 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:19.530 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:19.530 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:19.530 INFO:teuthology.orchestra.run.smithi161.stdout: "req_link_latency": { 2023-09-23T09:49:19.531 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 251, 2023-09-23T09:49:19.531 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 2.100553254, 2023-09-23T09:49:19.531 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.008368738 2023-09-23T09:49:19.531 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:19.531 INFO:teuthology.orchestra.run.smithi161.stdout: "req_lookup_latency": { 2023-09-23T09:49:19.531 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 6620, 2023-09-23T09:49:19.531 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 146.238226238, 2023-09-23T09:49:19.531 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.022090366 2023-09-23T09:49:19.531 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:19.531 INFO:teuthology.orchestra.run.smithi161.stdout: "req_lookuphash_latency": { 2023-09-23T09:49:19.531 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:19.532 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:19.532 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:19.532 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:19.532 INFO:teuthology.orchestra.run.smithi161.stdout: "req_lookupino_latency": { 2023-09-23T09:49:19.532 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:19.532 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:19.532 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:19.532 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:19.532 INFO:teuthology.orchestra.run.smithi161.stdout: "req_lookupname_latency": { 2023-09-23T09:49:19.532 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:19.533 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:19.533 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:19.533 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:19.533 INFO:teuthology.orchestra.run.smithi161.stdout: "req_lookupparent_latency": { 2023-09-23T09:49:19.533 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:19.533 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:19.533 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:19.533 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:19.533 INFO:teuthology.orchestra.run.smithi161.stdout: "req_lookupsnap_latency": { 2023-09-23T09:49:19.533 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:19.533 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:19.534 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:19.534 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:19.534 INFO:teuthology.orchestra.run.smithi161.stdout: "req_lssnap_latency": { 2023-09-23T09:49:19.534 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:19.534 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:19.534 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:19.534 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:19.534 INFO:teuthology.orchestra.run.smithi161.stdout: "req_mkdir_latency": { 2023-09-23T09:49:19.534 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:19.534 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:19.534 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:19.535 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:19.535 INFO:teuthology.orchestra.run.smithi161.stdout: "req_mknod_latency": { 2023-09-23T09:49:19.535 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:19.535 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:19.535 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:19.535 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:19.535 INFO:teuthology.orchestra.run.smithi161.stdout: "req_mksnap_latency": { 2023-09-23T09:49:19.535 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:19.535 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:19.535 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:19.536 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:19.536 INFO:teuthology.orchestra.run.smithi161.stdout: "req_open_latency": { 2023-09-23T09:49:19.536 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 3362, 2023-09-23T09:49:19.536 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 2.884652140, 2023-09-23T09:49:19.536 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000858016 2023-09-23T09:49:19.536 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:19.536 INFO:teuthology.orchestra.run.smithi161.stdout: "req_readdir_latency": { 2023-09-23T09:49:19.536 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 57, 2023-09-23T09:49:19.536 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.049533168, 2023-09-23T09:49:19.536 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000869002 2023-09-23T09:49:19.536 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:19.537 INFO:teuthology.orchestra.run.smithi161.stdout: "req_rename_latency": { 2023-09-23T09:49:19.537 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 1204, 2023-09-23T09:49:19.537 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 222.450537101, 2023-09-23T09:49:19.537 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.184759582 2023-09-23T09:49:19.537 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:19.537 INFO:teuthology.orchestra.run.smithi161.stdout: "req_renamesnap_latency": { 2023-09-23T09:49:19.537 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:19.537 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:19.537 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:19.537 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:19.537 INFO:teuthology.orchestra.run.smithi161.stdout: "req_snapdiff_latency": { 2023-09-23T09:49:19.537 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:19.538 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:19.538 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:19.538 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:19.538 INFO:teuthology.orchestra.run.smithi161.stdout: "req_rmdir_latency": { 2023-09-23T09:49:19.538 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:19.538 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:19.538 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:19.538 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:19.538 INFO:teuthology.orchestra.run.smithi161.stdout: "req_rmsnap_latency": { 2023-09-23T09:49:19.538 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:19.538 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:19.538 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:19.539 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:19.539 INFO:teuthology.orchestra.run.smithi161.stdout: "req_rmxattr_latency": { 2023-09-23T09:49:19.539 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:19.539 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:19.539 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:19.539 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:19.539 INFO:teuthology.orchestra.run.smithi161.stdout: "req_setattr_latency": { 2023-09-23T09:49:19.539 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:19.539 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:19.539 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:19.540 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:19.540 INFO:teuthology.orchestra.run.smithi161.stdout: "req_setdirlayout_latency": { 2023-09-23T09:49:19.540 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:19.540 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:19.540 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:19.540 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:19.540 INFO:teuthology.orchestra.run.smithi161.stdout: "req_setfilelock_latency": { 2023-09-23T09:49:19.540 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:19.540 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:19.540 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:19.540 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:19.540 INFO:teuthology.orchestra.run.smithi161.stdout: "req_setlayout_latency": { 2023-09-23T09:49:19.541 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:19.541 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:19.541 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:19.541 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:19.541 INFO:teuthology.orchestra.run.smithi161.stdout: "req_setxattr_latency": { 2023-09-23T09:49:19.541 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:19.541 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:19.541 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:19.541 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:19.541 INFO:teuthology.orchestra.run.smithi161.stdout: "req_symlink_latency": { 2023-09-23T09:49:19.541 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:19.541 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:19.542 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:19.542 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:19.542 INFO:teuthology.orchestra.run.smithi161.stdout: "req_unlink_latency": { 2023-09-23T09:49:19.542 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 261, 2023-09-23T09:49:19.542 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 1.193672557, 2023-09-23T09:49:19.542 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.004573458 2023-09-23T09:49:19.542 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:19.542 INFO:teuthology.orchestra.run.smithi161.stdout: "cap_revoke_eviction": 0, 2023-09-23T09:49:19.542 INFO:teuthology.orchestra.run.smithi161.stdout: "cap_acquisition_throttle": 0, 2023-09-23T09:49:19.542 INFO:teuthology.orchestra.run.smithi161.stdout: "req_getvxattr_latency": { 2023-09-23T09:49:19.542 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:19.542 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:19.543 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:19.543 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-09-23T09:49:19.543 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:19.543 INFO:teuthology.orchestra.run.smithi161.stdout: "mds_sessions": { 2023-09-23T09:49:19.543 INFO:teuthology.orchestra.run.smithi161.stdout: "session_count": 1, 2023-09-23T09:49:19.543 INFO:teuthology.orchestra.run.smithi161.stdout: "session_add": 4, 2023-09-23T09:49:19.543 INFO:teuthology.orchestra.run.smithi161.stdout: "session_remove": 3, 2023-09-23T09:49:19.543 INFO:teuthology.orchestra.run.smithi161.stdout: "sessions_open": 1, 2023-09-23T09:49:19.543 INFO:teuthology.orchestra.run.smithi161.stdout: "sessions_stale": 0, 2023-09-23T09:49:19.543 INFO:teuthology.orchestra.run.smithi161.stdout: "total_load": 1558, 2023-09-23T09:49:19.543 INFO:teuthology.orchestra.run.smithi161.stdout: "average_load": 1558, 2023-09-23T09:49:19.543 INFO:teuthology.orchestra.run.smithi161.stdout: "avg_session_uptime": 3161 2023-09-23T09:49:19.544 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:19.544 INFO:teuthology.orchestra.run.smithi161.stdout: "mempool": { 2023-09-23T09:49:19.544 INFO:teuthology.orchestra.run.smithi161.stdout: "bloom_filter_bytes": 0, 2023-09-23T09:49:19.544 INFO:teuthology.orchestra.run.smithi161.stdout: "bloom_filter_items": 0, 2023-09-23T09:49:19.544 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_alloc_bytes": 0, 2023-09-23T09:49:19.544 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_alloc_items": 0, 2023-09-23T09:49:19.544 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_cache_data_bytes": 0, 2023-09-23T09:49:19.544 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_cache_data_items": 0, 2023-09-23T09:49:19.544 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_cache_onode_bytes": 0, 2023-09-23T09:49:19.544 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_cache_onode_items": 0, 2023-09-23T09:49:19.544 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_cache_meta_bytes": 0, 2023-09-23T09:49:19.544 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_cache_meta_items": 0, 2023-09-23T09:49:19.544 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_cache_other_bytes": 0, 2023-09-23T09:49:19.545 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_cache_other_items": 0, 2023-09-23T09:49:19.545 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_cache_buffer_bytes": 0, 2023-09-23T09:49:19.545 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_cache_buffer_items": 0, 2023-09-23T09:49:19.545 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_extent_bytes": 0, 2023-09-23T09:49:19.545 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_extent_items": 0, 2023-09-23T09:49:19.545 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_blob_bytes": 0, 2023-09-23T09:49:19.545 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_blob_items": 0, 2023-09-23T09:49:19.545 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_shared_blob_bytes": 0, 2023-09-23T09:49:19.545 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_shared_blob_items": 0, 2023-09-23T09:49:19.545 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_inline_bl_bytes": 0, 2023-09-23T09:49:19.545 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_inline_bl_items": 0, 2023-09-23T09:49:19.545 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_fsck_bytes": 0, 2023-09-23T09:49:19.546 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_fsck_items": 0, 2023-09-23T09:49:19.546 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_txc_bytes": 0, 2023-09-23T09:49:19.546 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_txc_items": 0, 2023-09-23T09:49:19.546 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_writing_deferred_bytes": 0, 2023-09-23T09:49:19.546 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_writing_deferred_items": 0, 2023-09-23T09:49:19.546 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_writing_bytes": 0, 2023-09-23T09:49:19.546 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_writing_items": 0, 2023-09-23T09:49:19.546 INFO:teuthology.orchestra.run.smithi161.stdout: "bluefs_bytes": 0, 2023-09-23T09:49:19.546 INFO:teuthology.orchestra.run.smithi161.stdout: "bluefs_items": 0, 2023-09-23T09:49:19.546 INFO:teuthology.orchestra.run.smithi161.stdout: "bluefs_file_reader_bytes": 0, 2023-09-23T09:49:19.546 INFO:teuthology.orchestra.run.smithi161.stdout: "bluefs_file_reader_items": 0, 2023-09-23T09:49:19.546 INFO:teuthology.orchestra.run.smithi161.stdout: "bluefs_file_writer_bytes": 0, 2023-09-23T09:49:19.547 INFO:teuthology.orchestra.run.smithi161.stdout: "bluefs_file_writer_items": 0, 2023-09-23T09:49:19.547 INFO:teuthology.orchestra.run.smithi161.stdout: "buffer_anon_bytes": 710772, 2023-09-23T09:49:19.547 INFO:teuthology.orchestra.run.smithi161.stdout: "buffer_anon_items": 221, 2023-09-23T09:49:19.547 INFO:teuthology.orchestra.run.smithi161.stdout: "buffer_meta_bytes": 0, 2023-09-23T09:49:19.547 INFO:teuthology.orchestra.run.smithi161.stdout: "buffer_meta_items": 0, 2023-09-23T09:49:19.547 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_bytes": 0, 2023-09-23T09:49:19.547 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_items": 0, 2023-09-23T09:49:19.547 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_mapbl_bytes": 0, 2023-09-23T09:49:19.547 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_mapbl_items": 0, 2023-09-23T09:49:19.547 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_pglog_bytes": 0, 2023-09-23T09:49:19.547 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_pglog_items": 0, 2023-09-23T09:49:19.547 INFO:teuthology.orchestra.run.smithi161.stdout: "osdmap_bytes": 8152, 2023-09-23T09:49:19.548 INFO:teuthology.orchestra.run.smithi161.stdout: "osdmap_items": 170, 2023-09-23T09:49:19.548 INFO:teuthology.orchestra.run.smithi161.stdout: "osdmap_mapping_bytes": 0, 2023-09-23T09:49:19.548 INFO:teuthology.orchestra.run.smithi161.stdout: "osdmap_mapping_items": 0, 2023-09-23T09:49:19.548 INFO:teuthology.orchestra.run.smithi161.stdout: "pgmap_bytes": 0, 2023-09-23T09:49:19.548 INFO:teuthology.orchestra.run.smithi161.stdout: "pgmap_items": 0, 2023-09-23T09:49:19.548 INFO:teuthology.orchestra.run.smithi161.stdout: "mds_co_bytes": 1996984, 2023-09-23T09:49:19.548 INFO:teuthology.orchestra.run.smithi161.stdout: "mds_co_items": 67131, 2023-09-23T09:49:19.548 INFO:teuthology.orchestra.run.smithi161.stdout: "unittest_1_bytes": 0, 2023-09-23T09:49:19.548 INFO:teuthology.orchestra.run.smithi161.stdout: "unittest_1_items": 0, 2023-09-23T09:49:19.548 INFO:teuthology.orchestra.run.smithi161.stdout: "unittest_2_bytes": 0, 2023-09-23T09:49:19.548 INFO:teuthology.orchestra.run.smithi161.stdout: "unittest_2_items": 0 2023-09-23T09:49:19.548 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:19.549 INFO:teuthology.orchestra.run.smithi161.stdout: "objecter": { 2023-09-23T09:49:19.549 INFO:teuthology.orchestra.run.smithi161.stdout: "op_active": 0, 2023-09-23T09:49:19.549 INFO:teuthology.orchestra.run.smithi161.stdout: "op_laggy": 0, 2023-09-23T09:49:19.549 INFO:teuthology.orchestra.run.smithi161.stdout: "op_send": 5822, 2023-09-23T09:49:19.549 INFO:teuthology.orchestra.run.smithi161.stdout: "op_send_bytes": 31424847, 2023-09-23T09:49:19.549 INFO:teuthology.orchestra.run.smithi161.stdout: "op_resend": 27, 2023-09-23T09:49:19.549 INFO:teuthology.orchestra.run.smithi161.stdout: "op_reply": 5822, 2023-09-23T09:49:19.549 INFO:teuthology.orchestra.run.smithi161.stdout: "op_latency": { 2023-09-23T09:49:19.549 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 5822, 2023-09-23T09:49:19.549 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 21.664566587, 2023-09-23T09:49:19.549 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.003721155 2023-09-23T09:49:19.549 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:19.550 INFO:teuthology.orchestra.run.smithi161.stdout: "op_inflight": 0, 2023-09-23T09:49:19.550 INFO:teuthology.orchestra.run.smithi161.stdout: "oplen_avg": { 2023-09-23T09:49:19.550 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 5822, 2023-09-23T09:49:19.550 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 6391 2023-09-23T09:49:19.550 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:19.550 INFO:teuthology.orchestra.run.smithi161.stdout: "op": 5822, 2023-09-23T09:49:19.550 INFO:teuthology.orchestra.run.smithi161.stdout: "op_r": 386, 2023-09-23T09:49:19.550 INFO:teuthology.orchestra.run.smithi161.stdout: "op_w": 5436, 2023-09-23T09:49:19.550 INFO:teuthology.orchestra.run.smithi161.stdout: "op_rmw": 0, 2023-09-23T09:49:19.550 INFO:teuthology.orchestra.run.smithi161.stdout: "op_pg": 0, 2023-09-23T09:49:19.550 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_stat": 0, 2023-09-23T09:49:19.550 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_create": 10, 2023-09-23T09:49:19.551 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_read": 0, 2023-09-23T09:49:19.551 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_write": 4910, 2023-09-23T09:49:19.551 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_writefull": 154, 2023-09-23T09:49:19.551 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_writesame": 0, 2023-09-23T09:49:19.551 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_append": 0, 2023-09-23T09:49:19.551 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_zero": 0, 2023-09-23T09:49:19.551 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_truncate": 1, 2023-09-23T09:49:19.551 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_delete": 13, 2023-09-23T09:49:19.551 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_mapext": 0, 2023-09-23T09:49:19.551 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_sparse_read": 0, 2023-09-23T09:49:19.551 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_clonerange": 0, 2023-09-23T09:49:19.551 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_getxattr": 360, 2023-09-23T09:49:19.552 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_setxattr": 20, 2023-09-23T09:49:19.552 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_cmpxattr": 0, 2023-09-23T09:49:19.552 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_rmxattr": 0, 2023-09-23T09:49:19.552 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_resetxattrs": 0, 2023-09-23T09:49:19.552 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_call": 0, 2023-09-23T09:49:19.552 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_watch": 0, 2023-09-23T09:49:19.552 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_notify": 0, 2023-09-23T09:49:19.552 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_src_cmpxattr": 0, 2023-09-23T09:49:19.552 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_pgls": 0, 2023-09-23T09:49:19.552 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_pgls_filter": 0, 2023-09-23T09:49:19.552 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_other": 0, 2023-09-23T09:49:19.552 INFO:teuthology.orchestra.run.smithi161.stdout: "linger_active": 0, 2023-09-23T09:49:19.553 INFO:teuthology.orchestra.run.smithi161.stdout: "linger_send": 0, 2023-09-23T09:49:19.553 INFO:teuthology.orchestra.run.smithi161.stdout: "linger_resend": 0, 2023-09-23T09:49:19.553 INFO:teuthology.orchestra.run.smithi161.stdout: "linger_ping": 0, 2023-09-23T09:49:19.553 INFO:teuthology.orchestra.run.smithi161.stdout: "poolop_active": 0, 2023-09-23T09:49:19.553 INFO:teuthology.orchestra.run.smithi161.stdout: "poolop_send": 0, 2023-09-23T09:49:19.553 INFO:teuthology.orchestra.run.smithi161.stdout: "poolop_resend": 0, 2023-09-23T09:49:19.553 INFO:teuthology.orchestra.run.smithi161.stdout: "poolstat_active": 0, 2023-09-23T09:49:19.553 INFO:teuthology.orchestra.run.smithi161.stdout: "poolstat_send": 0, 2023-09-23T09:49:19.553 INFO:teuthology.orchestra.run.smithi161.stdout: "poolstat_resend": 0, 2023-09-23T09:49:19.553 INFO:teuthology.orchestra.run.smithi161.stdout: "statfs_active": 0, 2023-09-23T09:49:19.553 INFO:teuthology.orchestra.run.smithi161.stdout: "statfs_send": 0, 2023-09-23T09:49:19.553 INFO:teuthology.orchestra.run.smithi161.stdout: "statfs_resend": 0, 2023-09-23T09:49:19.554 INFO:teuthology.orchestra.run.smithi161.stdout: "command_active": 0, 2023-09-23T09:49:19.554 INFO:teuthology.orchestra.run.smithi161.stdout: "command_send": 0, 2023-09-23T09:49:19.554 INFO:teuthology.orchestra.run.smithi161.stdout: "command_resend": 0, 2023-09-23T09:49:19.554 INFO:teuthology.orchestra.run.smithi161.stdout: "map_epoch": 181, 2023-09-23T09:49:19.554 INFO:teuthology.orchestra.run.smithi161.stdout: "map_full": 0, 2023-09-23T09:49:19.554 INFO:teuthology.orchestra.run.smithi161.stdout: "map_inc": 95, 2023-09-23T09:49:19.554 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_sessions": 12, 2023-09-23T09:49:19.554 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_session_open": 15, 2023-09-23T09:49:19.554 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_session_close": 3, 2023-09-23T09:49:19.554 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_laggy": 0, 2023-09-23T09:49:19.554 INFO:teuthology.orchestra.run.smithi161.stdout: "omap_wr": 633, 2023-09-23T09:49:19.554 INFO:teuthology.orchestra.run.smithi161.stdout: "omap_rd": 39, 2023-09-23T09:49:19.555 INFO:teuthology.orchestra.run.smithi161.stdout: "omap_del": 251 2023-09-23T09:49:19.555 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:19.555 INFO:teuthology.orchestra.run.smithi161.stdout: "oft": { 2023-09-23T09:49:19.555 INFO:teuthology.orchestra.run.smithi161.stdout: "omap_total_objs": 1, 2023-09-23T09:49:19.555 INFO:teuthology.orchestra.run.smithi161.stdout: "omap_total_kv_pairs": 0, 2023-09-23T09:49:19.555 INFO:teuthology.orchestra.run.smithi161.stdout: "omap_total_updates": 0, 2023-09-23T09:49:19.555 INFO:teuthology.orchestra.run.smithi161.stdout: "omap_total_removes": 0 2023-09-23T09:49:19.555 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:19.555 INFO:teuthology.orchestra.run.smithi161.stdout: "osd-slow-ops": { 2023-09-23T09:49:19.555 INFO:teuthology.orchestra.run.smithi161.stdout: "slow_ops_count": 0 2023-09-23T09:49:19.555 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:19.556 INFO:teuthology.orchestra.run.smithi161.stdout: "purge_queue": { 2023-09-23T09:49:19.556 INFO:teuthology.orchestra.run.smithi161.stdout: "pq_executing_ops": 0, 2023-09-23T09:49:19.556 INFO:teuthology.orchestra.run.smithi161.stdout: "pq_executing_ops_high_water": 0, 2023-09-23T09:49:19.556 INFO:teuthology.orchestra.run.smithi161.stdout: "pq_executing": 0, 2023-09-23T09:49:19.556 INFO:teuthology.orchestra.run.smithi161.stdout: "pq_executing_high_water": 0, 2023-09-23T09:49:19.556 INFO:teuthology.orchestra.run.smithi161.stdout: "pq_executed": 0, 2023-09-23T09:49:19.556 INFO:teuthology.orchestra.run.smithi161.stdout: "pq_item_in_journal": 0 2023-09-23T09:49:19.556 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:19.556 INFO:teuthology.orchestra.run.smithi161.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-09-23T09:49:19.556 INFO:teuthology.orchestra.run.smithi161.stdout: "val": 0, 2023-09-23T09:49:19.556 INFO:teuthology.orchestra.run.smithi161.stdout: "max": 104857600, 2023-09-23T09:49:19.556 INFO:teuthology.orchestra.run.smithi161.stdout: "get_started": 0, 2023-09-23T09:49:19.557 INFO:teuthology.orchestra.run.smithi161.stdout: "get": 445985, 2023-09-23T09:49:19.557 INFO:teuthology.orchestra.run.smithi161.stdout: "get_sum": 86791723, 2023-09-23T09:49:19.557 INFO:teuthology.orchestra.run.smithi161.stdout: "get_or_fail_fail": 0, 2023-09-23T09:49:19.557 INFO:teuthology.orchestra.run.smithi161.stdout: "get_or_fail_success": 445985, 2023-09-23T09:49:19.557 INFO:teuthology.orchestra.run.smithi161.stdout: "take": 0, 2023-09-23T09:49:19.557 INFO:teuthology.orchestra.run.smithi161.stdout: "take_sum": 0, 2023-09-23T09:49:19.557 INFO:teuthology.orchestra.run.smithi161.stdout: "put": 445985, 2023-09-23T09:49:19.557 INFO:teuthology.orchestra.run.smithi161.stdout: "put_sum": 86791723, 2023-09-23T09:49:19.557 INFO:teuthology.orchestra.run.smithi161.stdout: "wait": { 2023-09-23T09:49:19.557 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:19.558 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:19.558 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:19.558 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-09-23T09:49:19.558 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:19.558 INFO:teuthology.orchestra.run.smithi161.stdout: "throttle-objecter_bytes": { 2023-09-23T09:49:19.558 INFO:teuthology.orchestra.run.smithi161.stdout: "val": 0, 2023-09-23T09:49:19.558 INFO:teuthology.orchestra.run.smithi161.stdout: "max": 104857600, 2023-09-23T09:49:19.558 INFO:teuthology.orchestra.run.smithi161.stdout: "get_started": 0, 2023-09-23T09:49:19.558 INFO:teuthology.orchestra.run.smithi161.stdout: "get": 0, 2023-09-23T09:49:19.558 INFO:teuthology.orchestra.run.smithi161.stdout: "get_sum": 0, 2023-09-23T09:49:19.559 INFO:teuthology.orchestra.run.smithi161.stdout: "get_or_fail_fail": 0, 2023-09-23T09:49:19.559 INFO:teuthology.orchestra.run.smithi161.stdout: "get_or_fail_success": 0, 2023-09-23T09:49:19.559 INFO:teuthology.orchestra.run.smithi161.stdout: "take": 5822, 2023-09-23T09:49:19.559 INFO:teuthology.orchestra.run.smithi161.stdout: "take_sum": 31424081, 2023-09-23T09:49:19.559 INFO:teuthology.orchestra.run.smithi161.stdout: "put": 5822, 2023-09-23T09:49:19.559 INFO:teuthology.orchestra.run.smithi161.stdout: "put_sum": 31424081, 2023-09-23T09:49:19.559 INFO:teuthology.orchestra.run.smithi161.stdout: "wait": { 2023-09-23T09:49:19.559 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:19.559 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:19.559 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:19.559 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-09-23T09:49:19.559 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:19.559 INFO:teuthology.orchestra.run.smithi161.stdout: "throttle-objecter_ops": { 2023-09-23T09:49:19.560 INFO:teuthology.orchestra.run.smithi161.stdout: "val": 0, 2023-09-23T09:49:19.560 INFO:teuthology.orchestra.run.smithi161.stdout: "max": 1024, 2023-09-23T09:49:19.560 INFO:teuthology.orchestra.run.smithi161.stdout: "get_started": 0, 2023-09-23T09:49:19.560 INFO:teuthology.orchestra.run.smithi161.stdout: "get": 0, 2023-09-23T09:49:19.560 INFO:teuthology.orchestra.run.smithi161.stdout: "get_sum": 0, 2023-09-23T09:49:19.560 INFO:teuthology.orchestra.run.smithi161.stdout: "get_or_fail_fail": 0, 2023-09-23T09:49:19.560 INFO:teuthology.orchestra.run.smithi161.stdout: "get_or_fail_success": 0, 2023-09-23T09:49:19.560 INFO:teuthology.orchestra.run.smithi161.stdout: "take": 5822, 2023-09-23T09:49:19.560 INFO:teuthology.orchestra.run.smithi161.stdout: "take_sum": 5822, 2023-09-23T09:49:19.560 INFO:teuthology.orchestra.run.smithi161.stdout: "put": 5822, 2023-09-23T09:49:19.560 INFO:teuthology.orchestra.run.smithi161.stdout: "put_sum": 5822, 2023-09-23T09:49:19.560 INFO:teuthology.orchestra.run.smithi161.stdout: "wait": { 2023-09-23T09:49:19.561 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:19.561 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:19.561 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:19.561 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-09-23T09:49:19.561 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:19.561 INFO:teuthology.orchestra.run.smithi161.stdout: "throttle-write_buf_throttle": { 2023-09-23T09:49:19.561 INFO:teuthology.orchestra.run.smithi161.stdout: "val": 0, 2023-09-23T09:49:19.561 INFO:teuthology.orchestra.run.smithi161.stdout: "max": 3758096384, 2023-09-23T09:49:19.561 INFO:teuthology.orchestra.run.smithi161.stdout: "get_started": 0, 2023-09-23T09:49:19.561 INFO:teuthology.orchestra.run.smithi161.stdout: "get": 0, 2023-09-23T09:49:19.561 INFO:teuthology.orchestra.run.smithi161.stdout: "get_sum": 0, 2023-09-23T09:49:19.561 INFO:teuthology.orchestra.run.smithi161.stdout: "get_or_fail_fail": 0, 2023-09-23T09:49:19.562 INFO:teuthology.orchestra.run.smithi161.stdout: "get_or_fail_success": 0, 2023-09-23T09:49:19.562 INFO:teuthology.orchestra.run.smithi161.stdout: "take": 0, 2023-09-23T09:49:19.562 INFO:teuthology.orchestra.run.smithi161.stdout: "take_sum": 0, 2023-09-23T09:49:19.562 INFO:teuthology.orchestra.run.smithi161.stdout: "put": 0, 2023-09-23T09:49:19.562 INFO:teuthology.orchestra.run.smithi161.stdout: "put_sum": 0, 2023-09-23T09:49:19.562 INFO:teuthology.orchestra.run.smithi161.stdout: "wait": { 2023-09-23T09:49:19.562 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:19.562 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:19.562 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:19.562 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-09-23T09:49:19.562 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:19.563 INFO:teuthology.orchestra.run.smithi161.stdout: "throttle-write_buf_throttle-0x560c149566e0": { 2023-09-23T09:49:19.563 INFO:teuthology.orchestra.run.smithi161.stdout: "val": 0, 2023-09-23T09:49:19.563 INFO:teuthology.orchestra.run.smithi161.stdout: "max": 3758096384, 2023-09-23T09:49:19.563 INFO:teuthology.orchestra.run.smithi161.stdout: "get_started": 0, 2023-09-23T09:49:19.563 INFO:teuthology.orchestra.run.smithi161.stdout: "get": 9806, 2023-09-23T09:49:19.563 INFO:teuthology.orchestra.run.smithi161.stdout: "get_sum": 31131241, 2023-09-23T09:49:19.563 INFO:teuthology.orchestra.run.smithi161.stdout: "get_or_fail_fail": 0, 2023-09-23T09:49:19.563 INFO:teuthology.orchestra.run.smithi161.stdout: "get_or_fail_success": 9806, 2023-09-23T09:49:19.563 INFO:teuthology.orchestra.run.smithi161.stdout: "take": 0, 2023-09-23T09:49:19.563 INFO:teuthology.orchestra.run.smithi161.stdout: "take_sum": 0, 2023-09-23T09:49:19.563 INFO:teuthology.orchestra.run.smithi161.stdout: "put": 4910, 2023-09-23T09:49:19.563 INFO:teuthology.orchestra.run.smithi161.stdout: "put_sum": 31131241, 2023-09-23T09:49:19.563 INFO:teuthology.orchestra.run.smithi161.stdout: "wait": { 2023-09-23T09:49:19.564 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:19.564 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:19.564 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:19.564 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-09-23T09:49:19.564 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-09-23T09:49:19.564 INFO:teuthology.orchestra.run.smithi161.stdout:} 2023-09-23T09:49:20.415 INFO:tasks.check_counter:Daemon mds.c mds.exported=16 2023-09-23T09:49:20.416 INFO:tasks.check_counter:Daemon mds.c mds.imported=16 2023-09-23T09:49:20.416 INFO:tasks.check_counter:Daemon mds.c mds.root_rsnaps=7 2023-09-23T09:49:20.416 INFO:tasks.check_counter:Daemon mds.c mds_server.req_mksnap_latency.avgcount=0 2023-09-23T09:49:20.416 INFO:tasks.check_counter:Daemon mds.c mds_server.req_rmsnap_latency.avgcount=0 2023-09-23T09:49:20.416 DEBUG:tasks.check_counter:Getting stats from f 2023-09-23T09:49:20.416 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- ceph daemon mds.f perf dump 2023-09-23T09:49:21.140 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.c/config 2023-09-23T09:49:21.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:49:21 smithi082 ceph-mon[97694]: pgmap v1668: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-09-23T09:49:21.396 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:49:21 smithi161 ceph-mon[99580]: pgmap v1668: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-09-23T09:49:21.560 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:49:21 smithi135 ceph-mon[99205]: pgmap v1668: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-09-23T09:49:22.681 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2023-09-23T09:49:22.681 INFO:teuthology.orchestra.run.smithi161.stdout: "AsyncMessenger::Worker-0": { 2023-09-23T09:49:22.681 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_recv_messages": 1533152, 2023-09-23T09:49:22.681 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_messages": 1534383, 2023-09-23T09:49:22.681 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_recv_bytes": 285525135, 2023-09-23T09:49:22.681 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_bytes": 454404467, 2023-09-23T09:49:22.681 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_created_connections": 12, 2023-09-23T09:49:22.682 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_active_connections": 6, 2023-09-23T09:49:22.682 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_total_time": 84.463504159, 2023-09-23T09:49:22.682 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_send_time": 37.889392232, 2023-09-23T09:49:22.682 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_recv_time": 55.054949336, 2023-09-23T09:49:22.757 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_fast_dispatch_time": 0.605585889, 2023-09-23T09:49:22.758 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_messages_queue_lat": { 2023-09-23T09:49:22.758 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 1534382, 2023-09-23T09:49:22.758 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 31.306088068, 2023-09-23T09:49:22.758 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000020403 2023-09-23T09:49:22.758 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:22.758 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_handle_ack_lat": { 2023-09-23T09:49:22.758 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 3022300, 2023-09-23T09:49:22.758 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.320414495, 2023-09-23T09:49:22.758 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000106 2023-09-23T09:49:22.758 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:22.759 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_recv_encrypted_bytes": 2912, 2023-09-23T09:49:22.759 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_encrypted_bytes": 448 2023-09-23T09:49:22.759 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:22.759 INFO:teuthology.orchestra.run.smithi161.stdout: "AsyncMessenger::Worker-1": { 2023-09-23T09:49:22.759 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_recv_messages": 8878043, 2023-09-23T09:49:22.759 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_messages": 9069047, 2023-09-23T09:49:22.759 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_recv_bytes": 1453435868, 2023-09-23T09:49:22.759 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_bytes": 1632547502, 2023-09-23T09:49:22.759 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_created_connections": 29, 2023-09-23T09:49:22.759 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_active_connections": 7, 2023-09-23T09:49:22.759 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_total_time": 445.165392259, 2023-09-23T09:49:22.759 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_send_time": 188.423769086, 2023-09-23T09:49:22.759 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_recv_time": 297.940662893, 2023-09-23T09:49:22.760 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_fast_dispatch_time": 0.466327487, 2023-09-23T09:49:22.760 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_messages_queue_lat": { 2023-09-23T09:49:22.760 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 9069048, 2023-09-23T09:49:22.760 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 164.492894396, 2023-09-23T09:49:22.760 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000018137 2023-09-23T09:49:22.760 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:22.760 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_handle_ack_lat": { 2023-09-23T09:49:22.760 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 17879556, 2023-09-23T09:49:22.760 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 1.839994246, 2023-09-23T09:49:22.760 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000102 2023-09-23T09:49:22.760 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:22.760 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_recv_encrypted_bytes": 2622768, 2023-09-23T09:49:22.761 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_encrypted_bytes": 563296 2023-09-23T09:49:22.761 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:22.761 INFO:teuthology.orchestra.run.smithi161.stdout: "AsyncMessenger::Worker-2": { 2023-09-23T09:49:22.761 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_recv_messages": 472476, 2023-09-23T09:49:22.761 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_messages": 727494, 2023-09-23T09:49:22.761 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_recv_bytes": 146314732, 2023-09-23T09:49:22.761 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_bytes": 568934283, 2023-09-23T09:49:22.761 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_created_connections": 18, 2023-09-23T09:49:22.761 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_active_connections": 6, 2023-09-23T09:49:22.761 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_total_time": 42.675492056, 2023-09-23T09:49:22.761 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_send_time": 18.900024398, 2023-09-23T09:49:22.761 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_recv_time": 24.947279855, 2023-09-23T09:49:22.762 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_fast_dispatch_time": 1.084906255, 2023-09-23T09:49:22.762 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_messages_queue_lat": { 2023-09-23T09:49:22.762 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 727489, 2023-09-23T09:49:22.762 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 32.581519352, 2023-09-23T09:49:22.762 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000044786 2023-09-23T09:49:22.762 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:22.762 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_handle_ack_lat": { 2023-09-23T09:49:22.762 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 1100930, 2023-09-23T09:49:22.762 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.243634129, 2023-09-23T09:49:22.762 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000221 2023-09-23T09:49:22.762 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:22.763 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_recv_encrypted_bytes": 1392, 2023-09-23T09:49:22.763 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_encrypted_bytes": 1392016 2023-09-23T09:49:22.763 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:22.763 INFO:teuthology.orchestra.run.smithi161.stdout: "cct": { 2023-09-23T09:49:22.763 INFO:teuthology.orchestra.run.smithi161.stdout: "total_workers": 1, 2023-09-23T09:49:22.763 INFO:teuthology.orchestra.run.smithi161.stdout: "unhealthy_workers": 0 2023-09-23T09:49:22.763 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:22.763 INFO:teuthology.orchestra.run.smithi161.stdout: "finisher-MDSRank": { 2023-09-23T09:49:22.763 INFO:teuthology.orchestra.run.smithi161.stdout: "queue_len": 0, 2023-09-23T09:49:22.763 INFO:teuthology.orchestra.run.smithi161.stdout: "complete_latency": { 2023-09-23T09:49:22.763 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 111393, 2023-09-23T09:49:22.763 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 39.095984411, 2023-09-23T09:49:22.764 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000350973 2023-09-23T09:49:22.764 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-09-23T09:49:22.764 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:22.764 INFO:teuthology.orchestra.run.smithi161.stdout: "finisher-PurgeQueue": { 2023-09-23T09:49:22.764 INFO:teuthology.orchestra.run.smithi161.stdout: "queue_len": 0, 2023-09-23T09:49:22.764 INFO:teuthology.orchestra.run.smithi161.stdout: "complete_latency": { 2023-09-23T09:49:22.764 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 326, 2023-09-23T09:49:22.764 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.013443214, 2023-09-23T09:49:22.764 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000041236 2023-09-23T09:49:22.764 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-09-23T09:49:22.764 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:22.764 INFO:teuthology.orchestra.run.smithi161.stdout: "mds": { 2023-09-23T09:49:22.764 INFO:teuthology.orchestra.run.smithi161.stdout: "request": 176739, 2023-09-23T09:49:22.765 INFO:teuthology.orchestra.run.smithi161.stdout: "reply": 174351, 2023-09-23T09:49:22.765 INFO:teuthology.orchestra.run.smithi161.stdout: "reply_latency": { 2023-09-23T09:49:22.765 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 174351, 2023-09-23T09:49:22.765 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 559.237263819, 2023-09-23T09:49:22.765 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.003207536 2023-09-23T09:49:22.765 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:22.765 INFO:teuthology.orchestra.run.smithi161.stdout: "slow_reply": 0, 2023-09-23T09:49:22.765 INFO:teuthology.orchestra.run.smithi161.stdout: "forward": 2388, 2023-09-23T09:49:22.765 INFO:teuthology.orchestra.run.smithi161.stdout: "dir_fetch_complete": 30, 2023-09-23T09:49:22.765 INFO:teuthology.orchestra.run.smithi161.stdout: "dir_fetch_keys": 0, 2023-09-23T09:49:22.765 INFO:teuthology.orchestra.run.smithi161.stdout: "dir_commit": 42, 2023-09-23T09:49:22.765 INFO:teuthology.orchestra.run.smithi161.stdout: "dir_split": 1, 2023-09-23T09:49:22.766 INFO:teuthology.orchestra.run.smithi161.stdout: "dir_merge": 0, 2023-09-23T09:49:22.766 INFO:teuthology.orchestra.run.smithi161.stdout: "inodes": 750, 2023-09-23T09:49:22.766 INFO:teuthology.orchestra.run.smithi161.stdout: "inodes_top": 53, 2023-09-23T09:49:22.766 INFO:teuthology.orchestra.run.smithi161.stdout: "inodes_bottom": 538, 2023-09-23T09:49:22.766 INFO:teuthology.orchestra.run.smithi161.stdout: "inodes_pin_tail": 159, 2023-09-23T09:49:22.766 INFO:teuthology.orchestra.run.smithi161.stdout: "inodes_pinned": 673, 2023-09-23T09:49:22.766 INFO:teuthology.orchestra.run.smithi161.stdout: "inodes_expired": 4802, 2023-09-23T09:49:22.766 INFO:teuthology.orchestra.run.smithi161.stdout: "inodes_with_caps": 335, 2023-09-23T09:49:22.766 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": 335, 2023-09-23T09:49:22.766 INFO:teuthology.orchestra.run.smithi161.stdout: "subtrees": 31, 2023-09-23T09:49:22.766 INFO:teuthology.orchestra.run.smithi161.stdout: "traverse": 371752, 2023-09-23T09:49:22.766 INFO:teuthology.orchestra.run.smithi161.stdout: "traverse_hit": 364435, 2023-09-23T09:49:22.767 INFO:teuthology.orchestra.run.smithi161.stdout: "traverse_forward": 2332, 2023-09-23T09:49:22.767 INFO:teuthology.orchestra.run.smithi161.stdout: "traverse_discover": 306, 2023-09-23T09:49:22.767 INFO:teuthology.orchestra.run.smithi161.stdout: "traverse_dir_fetch": 2, 2023-09-23T09:49:22.767 INFO:teuthology.orchestra.run.smithi161.stdout: "traverse_remote_ino": 0, 2023-09-23T09:49:22.767 INFO:teuthology.orchestra.run.smithi161.stdout: "traverse_lock": 3215, 2023-09-23T09:49:22.767 INFO:teuthology.orchestra.run.smithi161.stdout: "load_cent": 1000, 2023-09-23T09:49:22.767 INFO:teuthology.orchestra.run.smithi161.stdout: "q": 1, 2023-09-23T09:49:22.767 INFO:teuthology.orchestra.run.smithi161.stdout: "exported": 67, 2023-09-23T09:49:22.767 INFO:teuthology.orchestra.run.smithi161.stdout: "exported_inodes": 3929, 2023-09-23T09:49:22.767 INFO:teuthology.orchestra.run.smithi161.stdout: "imported": 69, 2023-09-23T09:49:22.767 INFO:teuthology.orchestra.run.smithi161.stdout: "imported_inodes": 4263, 2023-09-23T09:49:22.767 INFO:teuthology.orchestra.run.smithi161.stdout: "openino_dir_fetch": 0, 2023-09-23T09:49:22.768 INFO:teuthology.orchestra.run.smithi161.stdout: "openino_backtrace_fetch": 6877, 2023-09-23T09:49:22.768 INFO:teuthology.orchestra.run.smithi161.stdout: "openino_peer_discover": 0, 2023-09-23T09:49:22.768 INFO:teuthology.orchestra.run.smithi161.stdout: "root_rfiles": 1045, 2023-09-23T09:49:22.768 INFO:teuthology.orchestra.run.smithi161.stdout: "root_rbytes": 8989915630, 2023-09-23T09:49:22.768 INFO:teuthology.orchestra.run.smithi161.stdout: "root_rsnaps": 7, 2023-09-23T09:49:22.768 INFO:teuthology.orchestra.run.smithi161.stdout: "scrub_backtrace_fetch": 6877, 2023-09-23T09:49:22.768 INFO:teuthology.orchestra.run.smithi161.stdout: "scrub_set_tag": 0, 2023-09-23T09:49:22.768 INFO:teuthology.orchestra.run.smithi161.stdout: "scrub_backtrace_repaired": 0, 2023-09-23T09:49:22.768 INFO:teuthology.orchestra.run.smithi161.stdout: "scrub_inotable_repaired": 0, 2023-09-23T09:49:22.768 INFO:teuthology.orchestra.run.smithi161.stdout: "scrub_dir_inodes": 36, 2023-09-23T09:49:22.768 INFO:teuthology.orchestra.run.smithi161.stdout: "scrub_dir_base_inodes": 0, 2023-09-23T09:49:22.768 INFO:teuthology.orchestra.run.smithi161.stdout: "scrub_dirfrag_rstats": 36, 2023-09-23T09:49:22.768 INFO:teuthology.orchestra.run.smithi161.stdout: "scrub_file_inodes": 6841, 2023-09-23T09:49:22.769 INFO:teuthology.orchestra.run.smithi161.stdout: "handle_inode_file_caps": 616, 2023-09-23T09:49:22.769 INFO:teuthology.orchestra.run.smithi161.stdout: "ceph_cap_op_revoke": 266657, 2023-09-23T09:49:22.769 INFO:teuthology.orchestra.run.smithi161.stdout: "ceph_cap_op_grant": 199684, 2023-09-23T09:49:22.769 INFO:teuthology.orchestra.run.smithi161.stdout: "ceph_cap_op_trunc": 0, 2023-09-23T09:49:22.769 INFO:teuthology.orchestra.run.smithi161.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-09-23T09:49:22.769 INFO:teuthology.orchestra.run.smithi161.stdout: "ceph_cap_op_flush_ack": 0, 2023-09-23T09:49:22.769 INFO:teuthology.orchestra.run.smithi161.stdout: "handle_client_caps": 268922, 2023-09-23T09:49:22.769 INFO:teuthology.orchestra.run.smithi161.stdout: "handle_client_caps_dirty": 51870, 2023-09-23T09:49:22.769 INFO:teuthology.orchestra.run.smithi161.stdout: "handle_client_cap_release": 287, 2023-09-23T09:49:22.769 INFO:teuthology.orchestra.run.smithi161.stdout: "process_request_cap_release": 286 2023-09-23T09:49:22.769 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:22.769 INFO:teuthology.orchestra.run.smithi161.stdout: "mds_cache": { 2023-09-23T09:49:22.770 INFO:teuthology.orchestra.run.smithi161.stdout: "dir_update": 2, 2023-09-23T09:49:22.770 INFO:teuthology.orchestra.run.smithi161.stdout: "dir_update_receipt": 0, 2023-09-23T09:49:22.770 INFO:teuthology.orchestra.run.smithi161.stdout: "dir_try_discover": 0, 2023-09-23T09:49:22.770 INFO:teuthology.orchestra.run.smithi161.stdout: "dir_send_discover": 312, 2023-09-23T09:49:22.770 INFO:teuthology.orchestra.run.smithi161.stdout: "dir_handle_discover": 260, 2023-09-23T09:49:22.770 INFO:teuthology.orchestra.run.smithi161.stdout: "num_strays": 0, 2023-09-23T09:49:22.770 INFO:teuthology.orchestra.run.smithi161.stdout: "num_strays_delayed": 0, 2023-09-23T09:49:22.770 INFO:teuthology.orchestra.run.smithi161.stdout: "num_strays_enqueuing": 0, 2023-09-23T09:49:22.770 INFO:teuthology.orchestra.run.smithi161.stdout: "strays_created": 92, 2023-09-23T09:49:22.770 INFO:teuthology.orchestra.run.smithi161.stdout: "strays_enqueued": 16, 2023-09-23T09:49:22.770 INFO:teuthology.orchestra.run.smithi161.stdout: "strays_reintegrated": 553, 2023-09-23T09:49:22.770 INFO:teuthology.orchestra.run.smithi161.stdout: "strays_migrated": 59, 2023-09-23T09:49:22.771 INFO:teuthology.orchestra.run.smithi161.stdout: "num_recovering_processing": 0, 2023-09-23T09:49:22.771 INFO:teuthology.orchestra.run.smithi161.stdout: "num_recovering_enqueued": 0, 2023-09-23T09:49:22.771 INFO:teuthology.orchestra.run.smithi161.stdout: "num_recovering_prioritized": 0, 2023-09-23T09:49:22.771 INFO:teuthology.orchestra.run.smithi161.stdout: "recovery_started": 0, 2023-09-23T09:49:22.771 INFO:teuthology.orchestra.run.smithi161.stdout: "recovery_completed": 0, 2023-09-23T09:49:22.771 INFO:teuthology.orchestra.run.smithi161.stdout: "ireq_enqueue_scrub": 0, 2023-09-23T09:49:22.771 INFO:teuthology.orchestra.run.smithi161.stdout: "ireq_exportdir": 74, 2023-09-23T09:49:22.771 INFO:teuthology.orchestra.run.smithi161.stdout: "ireq_flush": 0, 2023-09-23T09:49:22.771 INFO:teuthology.orchestra.run.smithi161.stdout: "ireq_fragmentdir": 1, 2023-09-23T09:49:22.771 INFO:teuthology.orchestra.run.smithi161.stdout: "ireq_fragstats": 0, 2023-09-23T09:49:22.771 INFO:teuthology.orchestra.run.smithi161.stdout: "ireq_inodestats": 0 2023-09-23T09:49:22.771 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:22.771 INFO:teuthology.orchestra.run.smithi161.stdout: "mds_log": { 2023-09-23T09:49:22.772 INFO:teuthology.orchestra.run.smithi161.stdout: "evlrg": 1, 2023-09-23T09:49:22.772 INFO:teuthology.orchestra.run.smithi161.stdout: "evadd": 57026, 2023-09-23T09:49:22.772 INFO:teuthology.orchestra.run.smithi161.stdout: "evex": 8278, 2023-09-23T09:49:22.772 INFO:teuthology.orchestra.run.smithi161.stdout: "evtrm": 1, 2023-09-23T09:49:22.772 INFO:teuthology.orchestra.run.smithi161.stdout: "ev": 57025, 2023-09-23T09:49:22.772 INFO:teuthology.orchestra.run.smithi161.stdout: "evexg": 0, 2023-09-23T09:49:22.772 INFO:teuthology.orchestra.run.smithi161.stdout: "evexd": 8277, 2023-09-23T09:49:22.772 INFO:teuthology.orchestra.run.smithi161.stdout: "segadd": 143, 2023-09-23T09:49:22.772 INFO:teuthology.orchestra.run.smithi161.stdout: "segex": 15, 2023-09-23T09:49:22.772 INFO:teuthology.orchestra.run.smithi161.stdout: "segtrm": 1, 2023-09-23T09:49:22.772 INFO:teuthology.orchestra.run.smithi161.stdout: "seg": 142, 2023-09-23T09:49:22.772 INFO:teuthology.orchestra.run.smithi161.stdout: "segmjr": 5, 2023-09-23T09:49:22.773 INFO:teuthology.orchestra.run.smithi161.stdout: "segexg": 0, 2023-09-23T09:49:22.773 INFO:teuthology.orchestra.run.smithi161.stdout: "segexd": 14, 2023-09-23T09:49:22.773 INFO:teuthology.orchestra.run.smithi161.stdout: "expos": 4194352, 2023-09-23T09:49:22.773 INFO:teuthology.orchestra.run.smithi161.stdout: "wrpos": 575115657, 2023-09-23T09:49:22.773 INFO:teuthology.orchestra.run.smithi161.stdout: "rdpos": 0, 2023-09-23T09:49:22.773 INFO:teuthology.orchestra.run.smithi161.stdout: "jlat": { 2023-09-23T09:49:22.773 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 52902, 2023-09-23T09:49:22.773 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 133.300584236, 2023-09-23T09:49:22.773 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.002519764 2023-09-23T09:49:22.773 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:22.773 INFO:teuthology.orchestra.run.smithi161.stdout: "replayed": 0 2023-09-23T09:49:22.773 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:22.773 INFO:teuthology.orchestra.run.smithi161.stdout: "mds_mem": { 2023-09-23T09:49:22.774 INFO:teuthology.orchestra.run.smithi161.stdout: "ino": 706, 2023-09-23T09:49:22.774 INFO:teuthology.orchestra.run.smithi161.stdout: "ino+": 4326, 2023-09-23T09:49:22.774 INFO:teuthology.orchestra.run.smithi161.stdout: "ino-": 3620, 2023-09-23T09:49:22.774 INFO:teuthology.orchestra.run.smithi161.stdout: "dir": 98, 2023-09-23T09:49:22.774 INFO:teuthology.orchestra.run.smithi161.stdout: "dir+": 189, 2023-09-23T09:49:22.774 INFO:teuthology.orchestra.run.smithi161.stdout: "dir-": 91, 2023-09-23T09:49:22.774 INFO:teuthology.orchestra.run.smithi161.stdout: "dn": 750, 2023-09-23T09:49:22.774 INFO:teuthology.orchestra.run.smithi161.stdout: "dn+": 5609, 2023-09-23T09:49:22.774 INFO:teuthology.orchestra.run.smithi161.stdout: "dn-": 4859, 2023-09-23T09:49:22.774 INFO:teuthology.orchestra.run.smithi161.stdout: "cap": 335, 2023-09-23T09:49:22.774 INFO:teuthology.orchestra.run.smithi161.stdout: "cap+": 2746, 2023-09-23T09:49:22.774 INFO:teuthology.orchestra.run.smithi161.stdout: "cap-": 2411, 2023-09-23T09:49:22.775 INFO:teuthology.orchestra.run.smithi161.stdout: "rss": 81476, 2023-09-23T09:49:22.775 INFO:teuthology.orchestra.run.smithi161.stdout: "heap": 198960 2023-09-23T09:49:22.775 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:22.775 INFO:teuthology.orchestra.run.smithi161.stdout: "mds_server": { 2023-09-23T09:49:22.775 INFO:teuthology.orchestra.run.smithi161.stdout: "dispatch_client_request": 340152, 2023-09-23T09:49:22.775 INFO:teuthology.orchestra.run.smithi161.stdout: "dispatch_server_request": 4831, 2023-09-23T09:49:22.775 INFO:teuthology.orchestra.run.smithi161.stdout: "handle_client_request": 176739, 2023-09-23T09:49:22.775 INFO:teuthology.orchestra.run.smithi161.stdout: "handle_client_session": 166, 2023-09-23T09:49:22.775 INFO:teuthology.orchestra.run.smithi161.stdout: "handle_peer_request": 10064, 2023-09-23T09:49:22.775 INFO:teuthology.orchestra.run.smithi161.stdout: "req_create_latency": { 2023-09-23T09:49:22.775 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 13, 2023-09-23T09:49:22.775 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.020838867, 2023-09-23T09:49:22.776 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.001602989 2023-09-23T09:49:22.776 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:22.776 INFO:teuthology.orchestra.run.smithi161.stdout: "req_getattr_latency": { 2023-09-23T09:49:22.776 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 167716, 2023-09-23T09:49:22.776 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 314.217893348, 2023-09-23T09:49:22.776 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.001873511 2023-09-23T09:49:22.776 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:22.776 INFO:teuthology.orchestra.run.smithi161.stdout: "req_getfilelock_latency": { 2023-09-23T09:49:22.776 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:22.776 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:22.776 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:22.776 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:22.776 INFO:teuthology.orchestra.run.smithi161.stdout: "req_link_latency": { 2023-09-23T09:49:22.777 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 91, 2023-09-23T09:49:22.777 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 1.590774697, 2023-09-23T09:49:22.777 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.017481040 2023-09-23T09:49:22.777 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:22.777 INFO:teuthology.orchestra.run.smithi161.stdout: "req_lookup_latency": { 2023-09-23T09:49:22.777 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 3702, 2023-09-23T09:49:22.777 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 126.608929145, 2023-09-23T09:49:22.777 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.034200142 2023-09-23T09:49:22.777 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:22.777 INFO:teuthology.orchestra.run.smithi161.stdout: "req_lookuphash_latency": { 2023-09-23T09:49:22.777 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:22.777 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:22.778 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:22.778 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:22.778 INFO:teuthology.orchestra.run.smithi161.stdout: "req_lookupino_latency": { 2023-09-23T09:49:22.778 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:22.778 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:22.778 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:22.778 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:22.778 INFO:teuthology.orchestra.run.smithi161.stdout: "req_lookupname_latency": { 2023-09-23T09:49:22.778 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:22.778 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:22.778 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:22.778 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:22.779 INFO:teuthology.orchestra.run.smithi161.stdout: "req_lookupparent_latency": { 2023-09-23T09:49:22.779 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:22.779 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:22.779 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:22.779 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:22.779 INFO:teuthology.orchestra.run.smithi161.stdout: "req_lookupsnap_latency": { 2023-09-23T09:49:22.779 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:22.779 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:22.779 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:22.779 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:22.779 INFO:teuthology.orchestra.run.smithi161.stdout: "req_lssnap_latency": { 2023-09-23T09:49:22.779 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:22.779 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:22.780 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:22.780 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:22.780 INFO:teuthology.orchestra.run.smithi161.stdout: "req_mkdir_latency": { 2023-09-23T09:49:22.780 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 1, 2023-09-23T09:49:22.780 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.001737649, 2023-09-23T09:49:22.780 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.001737649 2023-09-23T09:49:22.780 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:22.780 INFO:teuthology.orchestra.run.smithi161.stdout: "req_mknod_latency": { 2023-09-23T09:49:22.780 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:22.780 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:22.780 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:22.780 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:22.781 INFO:teuthology.orchestra.run.smithi161.stdout: "req_mksnap_latency": { 2023-09-23T09:49:22.781 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:22.781 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:22.781 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:22.781 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:22.781 INFO:teuthology.orchestra.run.smithi161.stdout: "req_open_latency": { 2023-09-23T09:49:22.781 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 2021, 2023-09-23T09:49:22.781 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 1.161973860, 2023-09-23T09:49:22.781 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000574949 2023-09-23T09:49:22.781 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:22.781 INFO:teuthology.orchestra.run.smithi161.stdout: "req_readdir_latency": { 2023-09-23T09:49:22.781 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 88, 2023-09-23T09:49:22.782 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.082733404, 2023-09-23T09:49:22.782 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000940152 2023-09-23T09:49:22.782 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:22.782 INFO:teuthology.orchestra.run.smithi161.stdout: "req_rename_latency": { 2023-09-23T09:49:22.782 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 640, 2023-09-23T09:49:22.782 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 115.067270337, 2023-09-23T09:49:22.782 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.179792609 2023-09-23T09:49:22.782 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:22.782 INFO:teuthology.orchestra.run.smithi161.stdout: "req_renamesnap_latency": { 2023-09-23T09:49:22.782 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:22.782 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:22.782 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:22.783 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:22.783 INFO:teuthology.orchestra.run.smithi161.stdout: "req_snapdiff_latency": { 2023-09-23T09:49:22.783 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:22.783 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:22.783 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:22.783 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:22.783 INFO:teuthology.orchestra.run.smithi161.stdout: "req_rmdir_latency": { 2023-09-23T09:49:22.783 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:22.783 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:22.783 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:22.783 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:22.783 INFO:teuthology.orchestra.run.smithi161.stdout: "req_rmsnap_latency": { 2023-09-23T09:49:22.784 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:22.784 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:22.784 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:22.784 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:22.784 INFO:teuthology.orchestra.run.smithi161.stdout: "req_rmxattr_latency": { 2023-09-23T09:49:22.784 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:22.784 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:22.784 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:22.784 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:22.784 INFO:teuthology.orchestra.run.smithi161.stdout: "req_setattr_latency": { 2023-09-23T09:49:22.784 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:22.784 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:22.785 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:22.785 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:22.785 INFO:teuthology.orchestra.run.smithi161.stdout: "req_setdirlayout_latency": { 2023-09-23T09:49:22.785 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:22.785 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:22.785 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:22.785 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:22.785 INFO:teuthology.orchestra.run.smithi161.stdout: "req_setfilelock_latency": { 2023-09-23T09:49:22.785 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:22.785 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:22.785 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:22.785 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:22.785 INFO:teuthology.orchestra.run.smithi161.stdout: "req_setlayout_latency": { 2023-09-23T09:49:22.786 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:22.786 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:22.786 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:22.786 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:22.786 INFO:teuthology.orchestra.run.smithi161.stdout: "req_setxattr_latency": { 2023-09-23T09:49:22.786 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:22.786 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:22.786 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:22.786 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:22.786 INFO:teuthology.orchestra.run.smithi161.stdout: "req_symlink_latency": { 2023-09-23T09:49:22.786 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:22.786 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:22.787 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:22.787 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:22.787 INFO:teuthology.orchestra.run.smithi161.stdout: "req_unlink_latency": { 2023-09-23T09:49:22.787 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 79, 2023-09-23T09:49:22.787 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.485112512, 2023-09-23T09:49:22.787 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.006140664 2023-09-23T09:49:22.787 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:22.787 INFO:teuthology.orchestra.run.smithi161.stdout: "cap_revoke_eviction": 0, 2023-09-23T09:49:22.787 INFO:teuthology.orchestra.run.smithi161.stdout: "cap_acquisition_throttle": 0, 2023-09-23T09:49:22.787 INFO:teuthology.orchestra.run.smithi161.stdout: "req_getvxattr_latency": { 2023-09-23T09:49:22.787 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:22.787 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:22.788 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:22.788 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-09-23T09:49:22.788 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:22.788 INFO:teuthology.orchestra.run.smithi161.stdout: "mds_sessions": { 2023-09-23T09:49:22.788 INFO:teuthology.orchestra.run.smithi161.stdout: "session_count": 1, 2023-09-23T09:49:22.788 INFO:teuthology.orchestra.run.smithi161.stdout: "session_add": 3, 2023-09-23T09:49:22.788 INFO:teuthology.orchestra.run.smithi161.stdout: "session_remove": 2, 2023-09-23T09:49:22.788 INFO:teuthology.orchestra.run.smithi161.stdout: "sessions_open": 1, 2023-09-23T09:49:22.788 INFO:teuthology.orchestra.run.smithi161.stdout: "sessions_stale": 0, 2023-09-23T09:49:22.788 INFO:teuthology.orchestra.run.smithi161.stdout: "total_load": 2989, 2023-09-23T09:49:22.788 INFO:teuthology.orchestra.run.smithi161.stdout: "average_load": 2989, 2023-09-23T09:49:22.788 INFO:teuthology.orchestra.run.smithi161.stdout: "avg_session_uptime": 3168 2023-09-23T09:49:22.788 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:22.789 INFO:teuthology.orchestra.run.smithi161.stdout: "mempool": { 2023-09-23T09:49:22.789 INFO:teuthology.orchestra.run.smithi161.stdout: "bloom_filter_bytes": 0, 2023-09-23T09:49:22.789 INFO:teuthology.orchestra.run.smithi161.stdout: "bloom_filter_items": 0, 2023-09-23T09:49:22.789 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_alloc_bytes": 0, 2023-09-23T09:49:22.789 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_alloc_items": 0, 2023-09-23T09:49:22.789 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_cache_data_bytes": 0, 2023-09-23T09:49:22.789 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_cache_data_items": 0, 2023-09-23T09:49:22.789 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_cache_onode_bytes": 0, 2023-09-23T09:49:22.789 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_cache_onode_items": 0, 2023-09-23T09:49:22.789 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_cache_meta_bytes": 0, 2023-09-23T09:49:22.789 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_cache_meta_items": 0, 2023-09-23T09:49:22.789 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_cache_other_bytes": 0, 2023-09-23T09:49:22.790 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_cache_other_items": 0, 2023-09-23T09:49:22.790 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_cache_buffer_bytes": 0, 2023-09-23T09:49:22.790 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_cache_buffer_items": 0, 2023-09-23T09:49:22.790 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_extent_bytes": 0, 2023-09-23T09:49:22.790 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_extent_items": 0, 2023-09-23T09:49:22.790 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_blob_bytes": 0, 2023-09-23T09:49:22.790 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_blob_items": 0, 2023-09-23T09:49:22.790 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_shared_blob_bytes": 0, 2023-09-23T09:49:22.790 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_shared_blob_items": 0, 2023-09-23T09:49:22.790 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_inline_bl_bytes": 0, 2023-09-23T09:49:22.790 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_inline_bl_items": 0, 2023-09-23T09:49:22.790 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_fsck_bytes": 0, 2023-09-23T09:49:22.791 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_fsck_items": 0, 2023-09-23T09:49:22.791 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_txc_bytes": 0, 2023-09-23T09:49:22.791 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_txc_items": 0, 2023-09-23T09:49:22.791 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_writing_deferred_bytes": 0, 2023-09-23T09:49:22.791 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_writing_deferred_items": 0, 2023-09-23T09:49:22.791 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_writing_bytes": 0, 2023-09-23T09:49:22.791 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_writing_items": 0, 2023-09-23T09:49:22.791 INFO:teuthology.orchestra.run.smithi161.stdout: "bluefs_bytes": 0, 2023-09-23T09:49:22.791 INFO:teuthology.orchestra.run.smithi161.stdout: "bluefs_items": 0, 2023-09-23T09:49:22.791 INFO:teuthology.orchestra.run.smithi161.stdout: "bluefs_file_reader_bytes": 0, 2023-09-23T09:49:22.791 INFO:teuthology.orchestra.run.smithi161.stdout: "bluefs_file_reader_items": 0, 2023-09-23T09:49:22.791 INFO:teuthology.orchestra.run.smithi161.stdout: "bluefs_file_writer_bytes": 0, 2023-09-23T09:49:22.791 INFO:teuthology.orchestra.run.smithi161.stdout: "bluefs_file_writer_items": 0, 2023-09-23T09:49:22.792 INFO:teuthology.orchestra.run.smithi161.stdout: "buffer_anon_bytes": 522603, 2023-09-23T09:49:22.792 INFO:teuthology.orchestra.run.smithi161.stdout: "buffer_anon_items": 173, 2023-09-23T09:49:22.792 INFO:teuthology.orchestra.run.smithi161.stdout: "buffer_meta_bytes": 0, 2023-09-23T09:49:22.792 INFO:teuthology.orchestra.run.smithi161.stdout: "buffer_meta_items": 0, 2023-09-23T09:49:22.792 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_bytes": 0, 2023-09-23T09:49:22.792 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_items": 0, 2023-09-23T09:49:22.792 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_mapbl_bytes": 0, 2023-09-23T09:49:22.792 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_mapbl_items": 0, 2023-09-23T09:49:22.792 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_pglog_bytes": 0, 2023-09-23T09:49:22.792 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_pglog_items": 0, 2023-09-23T09:49:22.792 INFO:teuthology.orchestra.run.smithi161.stdout: "osdmap_bytes": 8032, 2023-09-23T09:49:22.792 INFO:teuthology.orchestra.run.smithi161.stdout: "osdmap_items": 167, 2023-09-23T09:49:22.793 INFO:teuthology.orchestra.run.smithi161.stdout: "osdmap_mapping_bytes": 0, 2023-09-23T09:49:22.793 INFO:teuthology.orchestra.run.smithi161.stdout: "osdmap_mapping_items": 0, 2023-09-23T09:49:22.793 INFO:teuthology.orchestra.run.smithi161.stdout: "pgmap_bytes": 0, 2023-09-23T09:49:22.793 INFO:teuthology.orchestra.run.smithi161.stdout: "pgmap_items": 0, 2023-09-23T09:49:22.793 INFO:teuthology.orchestra.run.smithi161.stdout: "mds_co_bytes": 2689602, 2023-09-23T09:49:22.793 INFO:teuthology.orchestra.run.smithi161.stdout: "mds_co_items": 36293, 2023-09-23T09:49:22.793 INFO:teuthology.orchestra.run.smithi161.stdout: "unittest_1_bytes": 0, 2023-09-23T09:49:22.793 INFO:teuthology.orchestra.run.smithi161.stdout: "unittest_1_items": 0, 2023-09-23T09:49:22.793 INFO:teuthology.orchestra.run.smithi161.stdout: "unittest_2_bytes": 0, 2023-09-23T09:49:22.793 INFO:teuthology.orchestra.run.smithi161.stdout: "unittest_2_items": 0 2023-09-23T09:49:22.793 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:22.793 INFO:teuthology.orchestra.run.smithi161.stdout: "objecter": { 2023-09-23T09:49:22.793 INFO:teuthology.orchestra.run.smithi161.stdout: "op_active": 0, 2023-09-23T09:49:22.794 INFO:teuthology.orchestra.run.smithi161.stdout: "op_laggy": 0, 2023-09-23T09:49:22.794 INFO:teuthology.orchestra.run.smithi161.stdout: "op_send": 61546, 2023-09-23T09:49:22.794 INFO:teuthology.orchestra.run.smithi161.stdout: "op_send_bytes": 571741469, 2023-09-23T09:49:22.794 INFO:teuthology.orchestra.run.smithi161.stdout: "op_resend": 27, 2023-09-23T09:49:22.794 INFO:teuthology.orchestra.run.smithi161.stdout: "op_reply": 61546, 2023-09-23T09:49:22.794 INFO:teuthology.orchestra.run.smithi161.stdout: "op_latency": { 2023-09-23T09:49:22.794 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 61546, 2023-09-23T09:49:22.794 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 261.972818421, 2023-09-23T09:49:22.794 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.004256536 2023-09-23T09:49:22.794 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:22.794 INFO:teuthology.orchestra.run.smithi161.stdout: "op_inflight": 0, 2023-09-23T09:49:22.794 INFO:teuthology.orchestra.run.smithi161.stdout: "oplen_avg": { 2023-09-23T09:49:22.795 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 61546, 2023-09-23T09:49:22.795 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 63359 2023-09-23T09:49:22.795 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:22.795 INFO:teuthology.orchestra.run.smithi161.stdout: "op": 61546, 2023-09-23T09:49:22.795 INFO:teuthology.orchestra.run.smithi161.stdout: "op_r": 6961, 2023-09-23T09:49:22.795 INFO:teuthology.orchestra.run.smithi161.stdout: "op_w": 54585, 2023-09-23T09:49:22.795 INFO:teuthology.orchestra.run.smithi161.stdout: "op_rmw": 0, 2023-09-23T09:49:22.795 INFO:teuthology.orchestra.run.smithi161.stdout: "op_pg": 0, 2023-09-23T09:49:22.795 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_stat": 22, 2023-09-23T09:49:22.795 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_create": 665, 2023-09-23T09:49:22.795 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_read": 15, 2023-09-23T09:49:22.795 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_write": 52917, 2023-09-23T09:49:22.796 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_writefull": 200, 2023-09-23T09:49:22.796 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_writesame": 0, 2023-09-23T09:49:22.796 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_append": 0, 2023-09-23T09:49:22.796 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_zero": 0, 2023-09-23T09:49:22.796 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_truncate": 0, 2023-09-23T09:49:22.796 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_delete": 403, 2023-09-23T09:49:22.796 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_mapext": 0, 2023-09-23T09:49:22.796 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_sparse_read": 0, 2023-09-23T09:49:22.796 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_clonerange": 0, 2023-09-23T09:49:22.796 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_getxattr": 6877, 2023-09-23T09:49:22.796 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_setxattr": 1330, 2023-09-23T09:49:22.796 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_cmpxattr": 0, 2023-09-23T09:49:22.796 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_rmxattr": 0, 2023-09-23T09:49:22.797 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_resetxattrs": 0, 2023-09-23T09:49:22.797 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_call": 0, 2023-09-23T09:49:22.797 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_watch": 0, 2023-09-23T09:49:22.797 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_notify": 0, 2023-09-23T09:49:22.797 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_src_cmpxattr": 0, 2023-09-23T09:49:22.797 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_pgls": 0, 2023-09-23T09:49:22.797 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_pgls_filter": 0, 2023-09-23T09:49:22.797 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_other": 0, 2023-09-23T09:49:22.797 INFO:teuthology.orchestra.run.smithi161.stdout: "linger_active": 0, 2023-09-23T09:49:22.797 INFO:teuthology.orchestra.run.smithi161.stdout: "linger_send": 0, 2023-09-23T09:49:22.797 INFO:teuthology.orchestra.run.smithi161.stdout: "linger_resend": 0, 2023-09-23T09:49:22.797 INFO:teuthology.orchestra.run.smithi161.stdout: "linger_ping": 0, 2023-09-23T09:49:22.798 INFO:teuthology.orchestra.run.smithi161.stdout: "poolop_active": 0, 2023-09-23T09:49:22.798 INFO:teuthology.orchestra.run.smithi161.stdout: "poolop_send": 0, 2023-09-23T09:49:22.798 INFO:teuthology.orchestra.run.smithi161.stdout: "poolop_resend": 0, 2023-09-23T09:49:22.798 INFO:teuthology.orchestra.run.smithi161.stdout: "poolstat_active": 0, 2023-09-23T09:49:22.798 INFO:teuthology.orchestra.run.smithi161.stdout: "poolstat_send": 0, 2023-09-23T09:49:22.798 INFO:teuthology.orchestra.run.smithi161.stdout: "poolstat_resend": 0, 2023-09-23T09:49:22.798 INFO:teuthology.orchestra.run.smithi161.stdout: "statfs_active": 0, 2023-09-23T09:49:22.798 INFO:teuthology.orchestra.run.smithi161.stdout: "statfs_send": 0, 2023-09-23T09:49:22.798 INFO:teuthology.orchestra.run.smithi161.stdout: "statfs_resend": 0, 2023-09-23T09:49:22.798 INFO:teuthology.orchestra.run.smithi161.stdout: "command_active": 0, 2023-09-23T09:49:22.798 INFO:teuthology.orchestra.run.smithi161.stdout: "command_send": 0, 2023-09-23T09:49:22.799 INFO:teuthology.orchestra.run.smithi161.stdout: "command_resend": 0, 2023-09-23T09:49:22.799 INFO:teuthology.orchestra.run.smithi161.stdout: "map_epoch": 181, 2023-09-23T09:49:22.799 INFO:teuthology.orchestra.run.smithi161.stdout: "map_full": 0, 2023-09-23T09:49:22.799 INFO:teuthology.orchestra.run.smithi161.stdout: "map_inc": 95, 2023-09-23T09:49:22.799 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_sessions": 12, 2023-09-23T09:49:22.799 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_session_open": 12, 2023-09-23T09:49:22.799 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_session_close": 0, 2023-09-23T09:49:22.799 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_laggy": 0, 2023-09-23T09:49:22.799 INFO:teuthology.orchestra.run.smithi161.stdout: "omap_wr": 647, 2023-09-23T09:49:22.799 INFO:teuthology.orchestra.run.smithi161.stdout: "omap_rd": 99, 2023-09-23T09:49:22.799 INFO:teuthology.orchestra.run.smithi161.stdout: "omap_del": 184 2023-09-23T09:49:22.799 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:22.799 INFO:teuthology.orchestra.run.smithi161.stdout: "oft": { 2023-09-23T09:49:22.800 INFO:teuthology.orchestra.run.smithi161.stdout: "omap_total_objs": 1, 2023-09-23T09:49:22.800 INFO:teuthology.orchestra.run.smithi161.stdout: "omap_total_kv_pairs": 0, 2023-09-23T09:49:22.800 INFO:teuthology.orchestra.run.smithi161.stdout: "omap_total_updates": 0, 2023-09-23T09:49:22.800 INFO:teuthology.orchestra.run.smithi161.stdout: "omap_total_removes": 0 2023-09-23T09:49:22.800 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:22.800 INFO:teuthology.orchestra.run.smithi161.stdout: "osd-slow-ops": { 2023-09-23T09:49:22.800 INFO:teuthology.orchestra.run.smithi161.stdout: "slow_ops_count": 0 2023-09-23T09:49:22.800 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:22.800 INFO:teuthology.orchestra.run.smithi161.stdout: "purge_queue": { 2023-09-23T09:49:22.800 INFO:teuthology.orchestra.run.smithi161.stdout: "pq_executing_ops": 0, 2023-09-23T09:49:22.800 INFO:teuthology.orchestra.run.smithi161.stdout: "pq_executing_ops_high_water": 239, 2023-09-23T09:49:22.800 INFO:teuthology.orchestra.run.smithi161.stdout: "pq_executing": 0, 2023-09-23T09:49:22.801 INFO:teuthology.orchestra.run.smithi161.stdout: "pq_executing_high_water": 3, 2023-09-23T09:49:22.801 INFO:teuthology.orchestra.run.smithi161.stdout: "pq_executed": 16, 2023-09-23T09:49:22.801 INFO:teuthology.orchestra.run.smithi161.stdout: "pq_item_in_journal": 0 2023-09-23T09:49:22.801 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:22.801 INFO:teuthology.orchestra.run.smithi161.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-09-23T09:49:22.801 INFO:teuthology.orchestra.run.smithi161.stdout: "val": 0, 2023-09-23T09:49:22.801 INFO:teuthology.orchestra.run.smithi161.stdout: "max": 104857600, 2023-09-23T09:49:22.801 INFO:teuthology.orchestra.run.smithi161.stdout: "get_started": 0, 2023-09-23T09:49:22.801 INFO:teuthology.orchestra.run.smithi161.stdout: "get": 10883667, 2023-09-23T09:49:22.801 INFO:teuthology.orchestra.run.smithi161.stdout: "get_sum": 905684742, 2023-09-23T09:49:22.801 INFO:teuthology.orchestra.run.smithi161.stdout: "get_or_fail_fail": 0, 2023-09-23T09:49:22.801 INFO:teuthology.orchestra.run.smithi161.stdout: "get_or_fail_success": 10883667, 2023-09-23T09:49:22.802 INFO:teuthology.orchestra.run.smithi161.stdout: "take": 0, 2023-09-23T09:49:22.802 INFO:teuthology.orchestra.run.smithi161.stdout: "take_sum": 0, 2023-09-23T09:49:22.802 INFO:teuthology.orchestra.run.smithi161.stdout: "put": 10883667, 2023-09-23T09:49:22.802 INFO:teuthology.orchestra.run.smithi161.stdout: "put_sum": 905684742, 2023-09-23T09:49:22.802 INFO:teuthology.orchestra.run.smithi161.stdout: "wait": { 2023-09-23T09:49:22.802 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:22.802 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:22.802 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:22.802 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-09-23T09:49:22.802 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:22.802 INFO:teuthology.orchestra.run.smithi161.stdout: "throttle-objecter_bytes": { 2023-09-23T09:49:22.802 INFO:teuthology.orchestra.run.smithi161.stdout: "val": 0, 2023-09-23T09:49:22.802 INFO:teuthology.orchestra.run.smithi161.stdout: "max": 104857600, 2023-09-23T09:49:22.803 INFO:teuthology.orchestra.run.smithi161.stdout: "get_started": 0, 2023-09-23T09:49:22.803 INFO:teuthology.orchestra.run.smithi161.stdout: "get": 0, 2023-09-23T09:49:22.803 INFO:teuthology.orchestra.run.smithi161.stdout: "get_sum": 0, 2023-09-23T09:49:22.803 INFO:teuthology.orchestra.run.smithi161.stdout: "get_or_fail_fail": 0, 2023-09-23T09:49:22.803 INFO:teuthology.orchestra.run.smithi161.stdout: "get_or_fail_success": 0, 2023-09-23T09:49:22.803 INFO:teuthology.orchestra.run.smithi161.stdout: "take": 61546, 2023-09-23T09:49:22.803 INFO:teuthology.orchestra.run.smithi161.stdout: "take_sum": 571741672, 2023-09-23T09:49:22.803 INFO:teuthology.orchestra.run.smithi161.stdout: "put": 61546, 2023-09-23T09:49:22.803 INFO:teuthology.orchestra.run.smithi161.stdout: "put_sum": 571741672, 2023-09-23T09:49:22.803 INFO:teuthology.orchestra.run.smithi161.stdout: "wait": { 2023-09-23T09:49:22.803 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:22.803 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:22.804 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:22.804 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-09-23T09:49:22.804 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:22.804 INFO:teuthology.orchestra.run.smithi161.stdout: "throttle-objecter_ops": { 2023-09-23T09:49:22.804 INFO:teuthology.orchestra.run.smithi161.stdout: "val": 0, 2023-09-23T09:49:22.804 INFO:teuthology.orchestra.run.smithi161.stdout: "max": 1024, 2023-09-23T09:49:22.804 INFO:teuthology.orchestra.run.smithi161.stdout: "get_started": 0, 2023-09-23T09:49:22.804 INFO:teuthology.orchestra.run.smithi161.stdout: "get": 0, 2023-09-23T09:49:22.804 INFO:teuthology.orchestra.run.smithi161.stdout: "get_sum": 0, 2023-09-23T09:49:22.804 INFO:teuthology.orchestra.run.smithi161.stdout: "get_or_fail_fail": 0, 2023-09-23T09:49:22.804 INFO:teuthology.orchestra.run.smithi161.stdout: "get_or_fail_success": 0, 2023-09-23T09:49:22.804 INFO:teuthology.orchestra.run.smithi161.stdout: "take": 61546, 2023-09-23T09:49:22.805 INFO:teuthology.orchestra.run.smithi161.stdout: "take_sum": 61546, 2023-09-23T09:49:22.805 INFO:teuthology.orchestra.run.smithi161.stdout: "put": 61546, 2023-09-23T09:49:22.805 INFO:teuthology.orchestra.run.smithi161.stdout: "put_sum": 61546, 2023-09-23T09:49:22.805 INFO:teuthology.orchestra.run.smithi161.stdout: "wait": { 2023-09-23T09:49:22.805 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:22.805 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:22.805 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:22.805 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-09-23T09:49:22.805 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:22.805 INFO:teuthology.orchestra.run.smithi161.stdout: "throttle-write_buf_throttle": { 2023-09-23T09:49:22.805 INFO:teuthology.orchestra.run.smithi161.stdout: "val": 0, 2023-09-23T09:49:22.805 INFO:teuthology.orchestra.run.smithi161.stdout: "max": 3758096384, 2023-09-23T09:49:22.806 INFO:teuthology.orchestra.run.smithi161.stdout: "get_started": 0, 2023-09-23T09:49:22.806 INFO:teuthology.orchestra.run.smithi161.stdout: "get": 16, 2023-09-23T09:49:22.806 INFO:teuthology.orchestra.run.smithi161.stdout: "get_sum": 1784, 2023-09-23T09:49:22.806 INFO:teuthology.orchestra.run.smithi161.stdout: "get_or_fail_fail": 0, 2023-09-23T09:49:22.806 INFO:teuthology.orchestra.run.smithi161.stdout: "get_or_fail_success": 16, 2023-09-23T09:49:22.806 INFO:teuthology.orchestra.run.smithi161.stdout: "take": 0, 2023-09-23T09:49:22.806 INFO:teuthology.orchestra.run.smithi161.stdout: "take_sum": 0, 2023-09-23T09:49:22.806 INFO:teuthology.orchestra.run.smithi161.stdout: "put": 15, 2023-09-23T09:49:22.806 INFO:teuthology.orchestra.run.smithi161.stdout: "put_sum": 1784, 2023-09-23T09:49:22.806 INFO:teuthology.orchestra.run.smithi161.stdout: "wait": { 2023-09-23T09:49:22.806 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:22.806 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:22.807 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:22.807 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-09-23T09:49:22.807 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:22.807 INFO:teuthology.orchestra.run.smithi161.stdout: "throttle-write_buf_throttle-0x55bf04d246e0": { 2023-09-23T09:49:22.807 INFO:teuthology.orchestra.run.smithi161.stdout: "val": 0, 2023-09-23T09:49:22.807 INFO:teuthology.orchestra.run.smithi161.stdout: "max": 3758096384, 2023-09-23T09:49:22.807 INFO:teuthology.orchestra.run.smithi161.stdout: "get_started": 0, 2023-09-23T09:49:22.807 INFO:teuthology.orchestra.run.smithi161.stdout: "get": 57026, 2023-09-23T09:49:22.807 INFO:teuthology.orchestra.run.smithi161.stdout: "get_sum": 570921353, 2023-09-23T09:49:22.807 INFO:teuthology.orchestra.run.smithi161.stdout: "get_or_fail_fail": 0, 2023-09-23T09:49:22.807 INFO:teuthology.orchestra.run.smithi161.stdout: "get_or_fail_success": 57026, 2023-09-23T09:49:22.807 INFO:teuthology.orchestra.run.smithi161.stdout: "take": 0, 2023-09-23T09:49:22.808 INFO:teuthology.orchestra.run.smithi161.stdout: "take_sum": 0, 2023-09-23T09:49:22.808 INFO:teuthology.orchestra.run.smithi161.stdout: "put": 52902, 2023-09-23T09:49:22.808 INFO:teuthology.orchestra.run.smithi161.stdout: "put_sum": 570921353, 2023-09-23T09:49:22.808 INFO:teuthology.orchestra.run.smithi161.stdout: "wait": { 2023-09-23T09:49:22.808 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:22.808 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:22.808 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:22.808 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-09-23T09:49:22.808 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-09-23T09:49:22.808 INFO:teuthology.orchestra.run.smithi161.stdout:} 2023-09-23T09:49:23.120 INFO:tasks.check_counter:Daemon mds.f mds.exported=67 2023-09-23T09:49:23.120 INFO:tasks.check_counter:Daemon mds.f mds.imported=69 2023-09-23T09:49:23.121 INFO:tasks.check_counter:Daemon mds.f mds.root_rsnaps=7 2023-09-23T09:49:23.121 INFO:tasks.check_counter:Daemon mds.f mds_server.req_mksnap_latency.avgcount=0 2023-09-23T09:49:23.121 INFO:tasks.check_counter:Daemon mds.f mds_server.req_rmsnap_latency.avgcount=0 2023-09-23T09:49:23.121 DEBUG:tasks.check_counter:Getting stats from i 2023-09-23T09:49:23.121 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- ceph daemon mds.i perf dump 2023-09-23T09:49:23.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:49:23 smithi082 ceph-mon[97694]: pgmap v1669: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-09-23T09:49:23.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:49:23 smithi161 ceph-mon[99580]: pgmap v1669: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-09-23T09:49:23.560 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:49:23 smithi135 ceph-mon[99205]: pgmap v1669: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-09-23T09:49:23.843 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.c/config 2023-09-23T09:49:25.365 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2023-09-23T09:49:25.365 INFO:teuthology.orchestra.run.smithi161.stdout: "AsyncMessenger::Worker-0": { 2023-09-23T09:49:25.365 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_recv_messages": 67503, 2023-09-23T09:49:25.365 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_messages": 82346, 2023-09-23T09:49:25.366 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_recv_bytes": 21060176, 2023-09-23T09:49:25.366 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_bytes": 65699713, 2023-09-23T09:49:25.366 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_created_connections": 16, 2023-09-23T09:49:25.366 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_active_connections": 6, 2023-09-23T09:49:25.366 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_total_time": 6.836251509, 2023-09-23T09:49:25.366 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_send_time": 3.242773993, 2023-09-23T09:49:25.366 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_recv_time": 4.142970841, 2023-09-23T09:49:25.366 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_fast_dispatch_time": 0.150318434, 2023-09-23T09:49:25.366 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_messages_queue_lat": { 2023-09-23T09:49:25.366 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 82342, 2023-09-23T09:49:25.367 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 6.202180583, 2023-09-23T09:49:25.367 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000075322 2023-09-23T09:49:25.367 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:25.367 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_handle_ack_lat": { 2023-09-23T09:49:25.367 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 131382, 2023-09-23T09:49:25.367 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.035217602, 2023-09-23T09:49:25.367 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000268 2023-09-23T09:49:25.367 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:25.367 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_recv_encrypted_bytes": 1072, 2023-09-23T09:49:25.368 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_encrypted_bytes": 730304 2023-09-23T09:49:25.368 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:25.368 INFO:teuthology.orchestra.run.smithi161.stdout: "AsyncMessenger::Worker-1": { 2023-09-23T09:49:25.368 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_recv_messages": 103226, 2023-09-23T09:49:25.368 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_messages": 98590, 2023-09-23T09:49:25.368 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_recv_bytes": 36884557, 2023-09-23T09:49:25.368 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_bytes": 39027057, 2023-09-23T09:49:25.368 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_created_connections": 13, 2023-09-23T09:49:25.368 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_active_connections": 6, 2023-09-23T09:49:25.368 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_total_time": 9.313880425, 2023-09-23T09:49:25.368 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_send_time": 4.364626090, 2023-09-23T09:49:25.369 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_recv_time": 6.269789687, 2023-09-23T09:49:25.369 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_fast_dispatch_time": 0.077197229, 2023-09-23T09:49:25.369 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_messages_queue_lat": { 2023-09-23T09:49:25.369 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 98592, 2023-09-23T09:49:25.369 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 5.506059913, 2023-09-23T09:49:25.369 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000055846 2023-09-23T09:49:25.369 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:25.369 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_handle_ack_lat": { 2023-09-23T09:49:25.369 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 192902, 2023-09-23T09:49:25.369 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.040396362, 2023-09-23T09:49:25.370 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000209 2023-09-23T09:49:25.370 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:25.370 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_recv_encrypted_bytes": 2638272, 2023-09-23T09:49:25.370 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_encrypted_bytes": 560720 2023-09-23T09:49:25.370 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:25.370 INFO:teuthology.orchestra.run.smithi161.stdout: "AsyncMessenger::Worker-2": { 2023-09-23T09:49:25.370 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_recv_messages": 27673, 2023-09-23T09:49:25.370 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_messages": 30105, 2023-09-23T09:49:25.370 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_recv_bytes": 8896383, 2023-09-23T09:49:25.370 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_bytes": 30985269, 2023-09-23T09:49:25.370 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_created_connections": 31, 2023-09-23T09:49:25.371 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_active_connections": 10, 2023-09-23T09:49:25.371 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_total_time": 2.419707245, 2023-09-23T09:49:25.371 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_send_time": 1.006765571, 2023-09-23T09:49:25.371 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_recv_time": 1.561217475, 2023-09-23T09:49:25.371 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_fast_dispatch_time": 0.098914609, 2023-09-23T09:49:25.371 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_messages_queue_lat": { 2023-09-23T09:49:25.371 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 30102, 2023-09-23T09:49:25.371 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 2.492348156, 2023-09-23T09:49:25.371 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000082796 2023-09-23T09:49:25.371 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:25.372 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_handle_ack_lat": { 2023-09-23T09:49:25.372 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 50208, 2023-09-23T09:49:25.372 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.011417196, 2023-09-23T09:49:25.372 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000227 2023-09-23T09:49:25.372 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:25.372 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_recv_encrypted_bytes": 2144, 2023-09-23T09:49:25.372 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_encrypted_bytes": 666576 2023-09-23T09:49:25.372 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:25.372 INFO:teuthology.orchestra.run.smithi161.stdout: "cct": { 2023-09-23T09:49:25.372 INFO:teuthology.orchestra.run.smithi161.stdout: "total_workers": 1, 2023-09-23T09:49:25.372 INFO:teuthology.orchestra.run.smithi161.stdout: "unhealthy_workers": 0 2023-09-23T09:49:25.373 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:25.373 INFO:teuthology.orchestra.run.smithi161.stdout: "finisher-MDSRank": { 2023-09-23T09:49:25.373 INFO:teuthology.orchestra.run.smithi161.stdout: "queue_len": 0, 2023-09-23T09:49:25.373 INFO:teuthology.orchestra.run.smithi161.stdout: "complete_latency": { 2023-09-23T09:49:25.373 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 14511, 2023-09-23T09:49:25.373 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 5.710414246, 2023-09-23T09:49:25.373 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000393523 2023-09-23T09:49:25.373 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-09-23T09:49:25.373 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:25.374 INFO:teuthology.orchestra.run.smithi161.stdout: "finisher-PurgeQueue": { 2023-09-23T09:49:25.374 INFO:teuthology.orchestra.run.smithi161.stdout: "queue_len": 0, 2023-09-23T09:49:25.374 INFO:teuthology.orchestra.run.smithi161.stdout: "complete_latency": { 2023-09-23T09:49:25.374 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 625, 2023-09-23T09:49:25.374 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.025652868, 2023-09-23T09:49:25.374 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000041044 2023-09-23T09:49:25.374 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-09-23T09:49:25.374 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:25.374 INFO:teuthology.orchestra.run.smithi161.stdout: "mds": { 2023-09-23T09:49:25.374 INFO:teuthology.orchestra.run.smithi161.stdout: "request": 13915, 2023-09-23T09:49:25.375 INFO:teuthology.orchestra.run.smithi161.stdout: "reply": 12377, 2023-09-23T09:49:25.375 INFO:teuthology.orchestra.run.smithi161.stdout: "reply_latency": { 2023-09-23T09:49:25.375 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 12377, 2023-09-23T09:49:25.375 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 577.085431610, 2023-09-23T09:49:25.375 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.046625630 2023-09-23T09:49:25.375 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:25.375 INFO:teuthology.orchestra.run.smithi161.stdout: "slow_reply": 0, 2023-09-23T09:49:25.375 INFO:teuthology.orchestra.run.smithi161.stdout: "forward": 1538, 2023-09-23T09:49:25.375 INFO:teuthology.orchestra.run.smithi161.stdout: "dir_fetch_complete": 7, 2023-09-23T09:49:25.375 INFO:teuthology.orchestra.run.smithi161.stdout: "dir_fetch_keys": 0, 2023-09-23T09:49:25.375 INFO:teuthology.orchestra.run.smithi161.stdout: "dir_commit": 19, 2023-09-23T09:49:25.376 INFO:teuthology.orchestra.run.smithi161.stdout: "dir_split": 1, 2023-09-23T09:49:25.376 INFO:teuthology.orchestra.run.smithi161.stdout: "dir_merge": 0, 2023-09-23T09:49:25.376 INFO:teuthology.orchestra.run.smithi161.stdout: "inodes": 921, 2023-09-23T09:49:25.376 INFO:teuthology.orchestra.run.smithi161.stdout: "inodes_top": 15, 2023-09-23T09:49:25.376 INFO:teuthology.orchestra.run.smithi161.stdout: "inodes_bottom": 324, 2023-09-23T09:49:25.376 INFO:teuthology.orchestra.run.smithi161.stdout: "inodes_pin_tail": 582, 2023-09-23T09:49:25.376 INFO:teuthology.orchestra.run.smithi161.stdout: "inodes_pinned": 894, 2023-09-23T09:49:25.376 INFO:teuthology.orchestra.run.smithi161.stdout: "inodes_expired": 3643, 2023-09-23T09:49:25.376 INFO:teuthology.orchestra.run.smithi161.stdout: "inodes_with_caps": 211, 2023-09-23T09:49:25.376 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": 211, 2023-09-23T09:49:25.376 INFO:teuthology.orchestra.run.smithi161.stdout: "subtrees": 23, 2023-09-23T09:49:25.377 INFO:teuthology.orchestra.run.smithi161.stdout: "traverse": 56760, 2023-09-23T09:49:25.377 INFO:teuthology.orchestra.run.smithi161.stdout: "traverse_hit": 48157, 2023-09-23T09:49:25.377 INFO:teuthology.orchestra.run.smithi161.stdout: "traverse_forward": 1453, 2023-09-23T09:49:25.377 INFO:teuthology.orchestra.run.smithi161.stdout: "traverse_discover": 373, 2023-09-23T09:49:25.377 INFO:teuthology.orchestra.run.smithi161.stdout: "traverse_dir_fetch": 1, 2023-09-23T09:49:25.377 INFO:teuthology.orchestra.run.smithi161.stdout: "traverse_remote_ino": 0, 2023-09-23T09:49:25.377 INFO:teuthology.orchestra.run.smithi161.stdout: "traverse_lock": 4578, 2023-09-23T09:49:25.377 INFO:teuthology.orchestra.run.smithi161.stdout: "load_cent": 1000, 2023-09-23T09:49:25.377 INFO:teuthology.orchestra.run.smithi161.stdout: "q": 1, 2023-09-23T09:49:25.377 INFO:teuthology.orchestra.run.smithi161.stdout: "exported": 69, 2023-09-23T09:49:25.377 INFO:teuthology.orchestra.run.smithi161.stdout: "exported_inodes": 2917, 2023-09-23T09:49:25.378 INFO:teuthology.orchestra.run.smithi161.stdout: "imported": 50, 2023-09-23T09:49:25.378 INFO:teuthology.orchestra.run.smithi161.stdout: "imported_inodes": 3071, 2023-09-23T09:49:25.378 INFO:teuthology.orchestra.run.smithi161.stdout: "openino_dir_fetch": 0, 2023-09-23T09:49:25.378 INFO:teuthology.orchestra.run.smithi161.stdout: "openino_backtrace_fetch": 764, 2023-09-23T09:49:25.378 INFO:teuthology.orchestra.run.smithi161.stdout: "openino_peer_discover": 0, 2023-09-23T09:49:25.378 INFO:teuthology.orchestra.run.smithi161.stdout: "root_rfiles": 1045, 2023-09-23T09:49:25.378 INFO:teuthology.orchestra.run.smithi161.stdout: "root_rbytes": 8989915630, 2023-09-23T09:49:25.378 INFO:teuthology.orchestra.run.smithi161.stdout: "root_rsnaps": 7, 2023-09-23T09:49:25.378 INFO:teuthology.orchestra.run.smithi161.stdout: "scrub_backtrace_fetch": 764, 2023-09-23T09:49:25.378 INFO:teuthology.orchestra.run.smithi161.stdout: "scrub_set_tag": 0, 2023-09-23T09:49:25.379 INFO:teuthology.orchestra.run.smithi161.stdout: "scrub_backtrace_repaired": 0, 2023-09-23T09:49:25.379 INFO:teuthology.orchestra.run.smithi161.stdout: "scrub_inotable_repaired": 0, 2023-09-23T09:49:25.379 INFO:teuthology.orchestra.run.smithi161.stdout: "scrub_dir_inodes": 6, 2023-09-23T09:49:25.379 INFO:teuthology.orchestra.run.smithi161.stdout: "scrub_dir_base_inodes": 0, 2023-09-23T09:49:25.379 INFO:teuthology.orchestra.run.smithi161.stdout: "scrub_dirfrag_rstats": 6, 2023-09-23T09:49:25.379 INFO:teuthology.orchestra.run.smithi161.stdout: "scrub_file_inodes": 758, 2023-09-23T09:49:25.379 INFO:teuthology.orchestra.run.smithi161.stdout: "handle_inode_file_caps": 895, 2023-09-23T09:49:25.379 INFO:teuthology.orchestra.run.smithi161.stdout: "ceph_cap_op_revoke": 14708, 2023-09-23T09:49:25.379 INFO:teuthology.orchestra.run.smithi161.stdout: "ceph_cap_op_grant": 11024, 2023-09-23T09:49:25.379 INFO:teuthology.orchestra.run.smithi161.stdout: "ceph_cap_op_trunc": 0, 2023-09-23T09:49:25.379 INFO:teuthology.orchestra.run.smithi161.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-09-23T09:49:25.380 INFO:teuthology.orchestra.run.smithi161.stdout: "ceph_cap_op_flush_ack": 0, 2023-09-23T09:49:25.380 INFO:teuthology.orchestra.run.smithi161.stdout: "handle_client_caps": 21713, 2023-09-23T09:49:25.380 INFO:teuthology.orchestra.run.smithi161.stdout: "handle_client_caps_dirty": 5406, 2023-09-23T09:49:25.380 INFO:teuthology.orchestra.run.smithi161.stdout: "handle_client_cap_release": 441, 2023-09-23T09:49:25.380 INFO:teuthology.orchestra.run.smithi161.stdout: "process_request_cap_release": 787 2023-09-23T09:49:25.380 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:25.380 INFO:teuthology.orchestra.run.smithi161.stdout: "mds_cache": { 2023-09-23T09:49:25.380 INFO:teuthology.orchestra.run.smithi161.stdout: "dir_update": 0, 2023-09-23T09:49:25.380 INFO:teuthology.orchestra.run.smithi161.stdout: "dir_update_receipt": 2, 2023-09-23T09:49:25.380 INFO:teuthology.orchestra.run.smithi161.stdout: "dir_try_discover": 1, 2023-09-23T09:49:25.380 INFO:teuthology.orchestra.run.smithi161.stdout: "dir_send_discover": 380, 2023-09-23T09:49:25.381 INFO:teuthology.orchestra.run.smithi161.stdout: "dir_handle_discover": 324, 2023-09-23T09:49:25.381 INFO:teuthology.orchestra.run.smithi161.stdout: "num_strays": 1, 2023-09-23T09:49:25.381 INFO:teuthology.orchestra.run.smithi161.stdout: "num_strays_delayed": 0, 2023-09-23T09:49:25.381 INFO:teuthology.orchestra.run.smithi161.stdout: "num_strays_enqueuing": 0, 2023-09-23T09:49:25.381 INFO:teuthology.orchestra.run.smithi161.stdout: "strays_created": 262, 2023-09-23T09:49:25.381 INFO:teuthology.orchestra.run.smithi161.stdout: "strays_enqueued": 107, 2023-09-23T09:49:25.381 INFO:teuthology.orchestra.run.smithi161.stdout: "strays_reintegrated": 896, 2023-09-23T09:49:25.381 INFO:teuthology.orchestra.run.smithi161.stdout: "strays_migrated": 95, 2023-09-23T09:49:25.381 INFO:teuthology.orchestra.run.smithi161.stdout: "num_recovering_processing": 0, 2023-09-23T09:49:25.381 INFO:teuthology.orchestra.run.smithi161.stdout: "num_recovering_enqueued": 0, 2023-09-23T09:49:25.381 INFO:teuthology.orchestra.run.smithi161.stdout: "num_recovering_prioritized": 0, 2023-09-23T09:49:25.382 INFO:teuthology.orchestra.run.smithi161.stdout: "recovery_started": 0, 2023-09-23T09:49:25.382 INFO:teuthology.orchestra.run.smithi161.stdout: "recovery_completed": 0, 2023-09-23T09:49:25.382 INFO:teuthology.orchestra.run.smithi161.stdout: "ireq_enqueue_scrub": 0, 2023-09-23T09:49:25.382 INFO:teuthology.orchestra.run.smithi161.stdout: "ireq_exportdir": 75, 2023-09-23T09:49:25.382 INFO:teuthology.orchestra.run.smithi161.stdout: "ireq_flush": 0, 2023-09-23T09:49:25.382 INFO:teuthology.orchestra.run.smithi161.stdout: "ireq_fragmentdir": 1, 2023-09-23T09:49:25.382 INFO:teuthology.orchestra.run.smithi161.stdout: "ireq_fragstats": 0, 2023-09-23T09:49:25.382 INFO:teuthology.orchestra.run.smithi161.stdout: "ireq_inodestats": 0 2023-09-23T09:49:25.382 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:25.382 INFO:teuthology.orchestra.run.smithi161.stdout: "mds_log": { 2023-09-23T09:49:25.382 INFO:teuthology.orchestra.run.smithi161.stdout: "evlrg": 1, 2023-09-23T09:49:25.382 INFO:teuthology.orchestra.run.smithi161.stdout: "evadd": 14183, 2023-09-23T09:49:25.383 INFO:teuthology.orchestra.run.smithi161.stdout: "evex": 0, 2023-09-23T09:49:25.383 INFO:teuthology.orchestra.run.smithi161.stdout: "evtrm": 0, 2023-09-23T09:49:25.383 INFO:teuthology.orchestra.run.smithi161.stdout: "ev": 14183, 2023-09-23T09:49:25.383 INFO:teuthology.orchestra.run.smithi161.stdout: "evexg": 0, 2023-09-23T09:49:25.383 INFO:teuthology.orchestra.run.smithi161.stdout: "evexd": 0, 2023-09-23T09:49:25.383 INFO:teuthology.orchestra.run.smithi161.stdout: "segadd": 21, 2023-09-23T09:49:25.383 INFO:teuthology.orchestra.run.smithi161.stdout: "segex": 0, 2023-09-23T09:49:25.383 INFO:teuthology.orchestra.run.smithi161.stdout: "segtrm": 0, 2023-09-23T09:49:25.383 INFO:teuthology.orchestra.run.smithi161.stdout: "seg": 21, 2023-09-23T09:49:25.383 INFO:teuthology.orchestra.run.smithi161.stdout: "segmjr": 3, 2023-09-23T09:49:25.383 INFO:teuthology.orchestra.run.smithi161.stdout: "segexg": 0, 2023-09-23T09:49:25.384 INFO:teuthology.orchestra.run.smithi161.stdout: "segexd": 0, 2023-09-23T09:49:25.384 INFO:teuthology.orchestra.run.smithi161.stdout: "expos": 4194304, 2023-09-23T09:49:25.384 INFO:teuthology.orchestra.run.smithi161.stdout: "wrpos": 64844865, 2023-09-23T09:49:25.384 INFO:teuthology.orchestra.run.smithi161.stdout: "rdpos": 0, 2023-09-23T09:49:25.384 INFO:teuthology.orchestra.run.smithi161.stdout: "jlat": { 2023-09-23T09:49:25.384 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 6961, 2023-09-23T09:49:25.384 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 42.425376465, 2023-09-23T09:49:25.384 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.006094724 2023-09-23T09:49:25.384 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:25.385 INFO:teuthology.orchestra.run.smithi161.stdout: "replayed": 0 2023-09-23T09:49:25.385 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:25.385 INFO:teuthology.orchestra.run.smithi161.stdout: "mds_mem": { 2023-09-23T09:49:25.385 INFO:teuthology.orchestra.run.smithi161.stdout: "ino": 337, 2023-09-23T09:49:25.385 INFO:teuthology.orchestra.run.smithi161.stdout: "ino+": 3112, 2023-09-23T09:49:25.385 INFO:teuthology.orchestra.run.smithi161.stdout: "ino-": 2775, 2023-09-23T09:49:25.385 INFO:teuthology.orchestra.run.smithi161.stdout: "dir": 85, 2023-09-23T09:49:25.385 INFO:teuthology.orchestra.run.smithi161.stdout: "dir+": 168, 2023-09-23T09:49:25.385 INFO:teuthology.orchestra.run.smithi161.stdout: "dir-": 83, 2023-09-23T09:49:25.385 INFO:teuthology.orchestra.run.smithi161.stdout: "dn": 921, 2023-09-23T09:49:25.385 INFO:teuthology.orchestra.run.smithi161.stdout: "dn+": 4670, 2023-09-23T09:49:25.386 INFO:teuthology.orchestra.run.smithi161.stdout: "dn-": 3749, 2023-09-23T09:49:25.386 INFO:teuthology.orchestra.run.smithi161.stdout: "cap": 211, 2023-09-23T09:49:25.386 INFO:teuthology.orchestra.run.smithi161.stdout: "cap+": 2070, 2023-09-23T09:49:25.386 INFO:teuthology.orchestra.run.smithi161.stdout: "cap-": 1859, 2023-09-23T09:49:25.386 INFO:teuthology.orchestra.run.smithi161.stdout: "rss": 68240, 2023-09-23T09:49:25.386 INFO:teuthology.orchestra.run.smithi161.stdout: "heap": 198960 2023-09-23T09:49:25.386 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:25.386 INFO:teuthology.orchestra.run.smithi161.stdout: "mds_server": { 2023-09-23T09:49:25.386 INFO:teuthology.orchestra.run.smithi161.stdout: "dispatch_client_request": 41148, 2023-09-23T09:49:25.386 INFO:teuthology.orchestra.run.smithi161.stdout: "dispatch_server_request": 7148, 2023-09-23T09:49:25.386 INFO:teuthology.orchestra.run.smithi161.stdout: "handle_client_request": 13915, 2023-09-23T09:49:25.387 INFO:teuthology.orchestra.run.smithi161.stdout: "handle_client_session": 206, 2023-09-23T09:49:25.387 INFO:teuthology.orchestra.run.smithi161.stdout: "handle_peer_request": 14800, 2023-09-23T09:49:25.387 INFO:teuthology.orchestra.run.smithi161.stdout: "req_create_latency": { 2023-09-23T09:49:25.387 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 19, 2023-09-23T09:49:25.387 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.073775394, 2023-09-23T09:49:25.387 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.003882915 2023-09-23T09:49:25.387 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:25.387 INFO:teuthology.orchestra.run.smithi161.stdout: "req_getattr_latency": { 2023-09-23T09:49:25.387 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 575, 2023-09-23T09:49:25.387 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 4.464772066, 2023-09-23T09:49:25.387 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.007764820 2023-09-23T09:49:25.388 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:25.388 INFO:teuthology.orchestra.run.smithi161.stdout: "req_getfilelock_latency": { 2023-09-23T09:49:25.388 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:25.388 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:25.388 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:25.388 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:25.388 INFO:teuthology.orchestra.run.smithi161.stdout: "req_link_latency": { 2023-09-23T09:49:25.388 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 155, 2023-09-23T09:49:25.388 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 2.231909853, 2023-09-23T09:49:25.388 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.014399418 2023-09-23T09:49:25.388 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:25.389 INFO:teuthology.orchestra.run.smithi161.stdout: "req_lookup_latency": { 2023-09-23T09:49:25.389 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 6074, 2023-09-23T09:49:25.389 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 144.564389633, 2023-09-23T09:49:25.389 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.023800525 2023-09-23T09:49:25.389 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:25.389 INFO:teuthology.orchestra.run.smithi161.stdout: "req_lookuphash_latency": { 2023-09-23T09:49:25.389 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:25.389 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:25.389 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:25.389 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:25.389 INFO:teuthology.orchestra.run.smithi161.stdout: "req_lookupino_latency": { 2023-09-23T09:49:25.389 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:25.390 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:25.390 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:25.390 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:25.390 INFO:teuthology.orchestra.run.smithi161.stdout: "req_lookupname_latency": { 2023-09-23T09:49:25.390 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:25.390 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:25.390 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:25.390 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:25.390 INFO:teuthology.orchestra.run.smithi161.stdout: "req_lookupparent_latency": { 2023-09-23T09:49:25.390 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:25.390 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:25.391 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:25.391 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:25.391 INFO:teuthology.orchestra.run.smithi161.stdout: "req_lookupsnap_latency": { 2023-09-23T09:49:25.391 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:25.391 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:25.391 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:25.391 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:25.391 INFO:teuthology.orchestra.run.smithi161.stdout: "req_lssnap_latency": { 2023-09-23T09:49:25.391 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:25.391 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:25.391 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:25.392 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:25.392 INFO:teuthology.orchestra.run.smithi161.stdout: "req_mkdir_latency": { 2023-09-23T09:49:25.392 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:25.392 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:25.392 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:25.392 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:25.392 INFO:teuthology.orchestra.run.smithi161.stdout: "req_mknod_latency": { 2023-09-23T09:49:25.392 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:25.392 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:25.392 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:25.392 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:25.392 INFO:teuthology.orchestra.run.smithi161.stdout: "req_mksnap_latency": { 2023-09-23T09:49:25.393 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:25.393 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:25.393 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:25.393 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:25.393 INFO:teuthology.orchestra.run.smithi161.stdout: "req_open_latency": { 2023-09-23T09:49:25.393 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 4225, 2023-09-23T09:49:25.393 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 2.011350531, 2023-09-23T09:49:25.393 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000476059 2023-09-23T09:49:25.393 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:25.393 INFO:teuthology.orchestra.run.smithi161.stdout: "req_readdir_latency": { 2023-09-23T09:49:25.393 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 75, 2023-09-23T09:49:25.394 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.070761243, 2023-09-23T09:49:25.394 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000943483 2023-09-23T09:49:25.394 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:25.394 INFO:teuthology.orchestra.run.smithi161.stdout: "req_rename_latency": { 2023-09-23T09:49:25.394 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 1094, 2023-09-23T09:49:25.394 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 422.680116376, 2023-09-23T09:49:25.394 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.386362080 2023-09-23T09:49:25.394 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:25.394 INFO:teuthology.orchestra.run.smithi161.stdout: "req_renamesnap_latency": { 2023-09-23T09:49:25.394 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:25.394 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:25.395 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:25.395 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:25.395 INFO:teuthology.orchestra.run.smithi161.stdout: "req_snapdiff_latency": { 2023-09-23T09:49:25.395 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:25.395 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:25.395 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:25.395 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:25.395 INFO:teuthology.orchestra.run.smithi161.stdout: "req_rmdir_latency": { 2023-09-23T09:49:25.395 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:25.395 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:25.395 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:25.396 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:25.396 INFO:teuthology.orchestra.run.smithi161.stdout: "req_rmsnap_latency": { 2023-09-23T09:49:25.396 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:25.396 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:25.396 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:25.396 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:25.396 INFO:teuthology.orchestra.run.smithi161.stdout: "req_rmxattr_latency": { 2023-09-23T09:49:25.396 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:25.396 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:25.396 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:25.396 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:25.396 INFO:teuthology.orchestra.run.smithi161.stdout: "req_setattr_latency": { 2023-09-23T09:49:25.397 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:25.397 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:25.397 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:25.397 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:25.397 INFO:teuthology.orchestra.run.smithi161.stdout: "req_setdirlayout_latency": { 2023-09-23T09:49:25.397 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:25.397 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:25.397 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:25.397 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:25.397 INFO:teuthology.orchestra.run.smithi161.stdout: "req_setfilelock_latency": { 2023-09-23T09:49:25.397 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:25.398 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:25.398 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:25.398 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:25.398 INFO:teuthology.orchestra.run.smithi161.stdout: "req_setlayout_latency": { 2023-09-23T09:49:25.398 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:25.398 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:25.398 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:25.398 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:25.398 INFO:teuthology.orchestra.run.smithi161.stdout: "req_setxattr_latency": { 2023-09-23T09:49:25.398 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:25.398 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:25.398 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:25.399 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:25.399 INFO:teuthology.orchestra.run.smithi161.stdout: "req_symlink_latency": { 2023-09-23T09:49:25.399 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:25.399 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:25.399 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:25.399 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:25.399 INFO:teuthology.orchestra.run.smithi161.stdout: "req_unlink_latency": { 2023-09-23T09:49:25.399 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 160, 2023-09-23T09:49:25.399 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.988356514, 2023-09-23T09:49:25.399 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.006177228 2023-09-23T09:49:25.399 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:25.399 INFO:teuthology.orchestra.run.smithi161.stdout: "cap_revoke_eviction": 0, 2023-09-23T09:49:25.400 INFO:teuthology.orchestra.run.smithi161.stdout: "cap_acquisition_throttle": 0, 2023-09-23T09:49:25.400 INFO:teuthology.orchestra.run.smithi161.stdout: "req_getvxattr_latency": { 2023-09-23T09:49:25.400 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:25.400 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:25.400 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:25.400 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-09-23T09:49:25.400 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:25.400 INFO:teuthology.orchestra.run.smithi161.stdout: "mds_sessions": { 2023-09-23T09:49:25.400 INFO:teuthology.orchestra.run.smithi161.stdout: "session_count": 1, 2023-09-23T09:49:25.400 INFO:teuthology.orchestra.run.smithi161.stdout: "session_add": 4, 2023-09-23T09:49:25.400 INFO:teuthology.orchestra.run.smithi161.stdout: "session_remove": 3, 2023-09-23T09:49:25.400 INFO:teuthology.orchestra.run.smithi161.stdout: "sessions_open": 1, 2023-09-23T09:49:25.401 INFO:teuthology.orchestra.run.smithi161.stdout: "sessions_stale": 0, 2023-09-23T09:49:25.401 INFO:teuthology.orchestra.run.smithi161.stdout: "total_load": 430, 2023-09-23T09:49:25.401 INFO:teuthology.orchestra.run.smithi161.stdout: "average_load": 430, 2023-09-23T09:49:25.401 INFO:teuthology.orchestra.run.smithi161.stdout: "avg_session_uptime": 3167 2023-09-23T09:49:25.401 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:25.401 INFO:teuthology.orchestra.run.smithi161.stdout: "mempool": { 2023-09-23T09:49:25.401 INFO:teuthology.orchestra.run.smithi161.stdout: "bloom_filter_bytes": 0, 2023-09-23T09:49:25.401 INFO:teuthology.orchestra.run.smithi161.stdout: "bloom_filter_items": 0, 2023-09-23T09:49:25.401 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_alloc_bytes": 0, 2023-09-23T09:49:25.401 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_alloc_items": 0, 2023-09-23T09:49:25.401 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_cache_data_bytes": 0, 2023-09-23T09:49:25.401 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_cache_data_items": 0, 2023-09-23T09:49:25.402 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_cache_onode_bytes": 0, 2023-09-23T09:49:25.402 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_cache_onode_items": 0, 2023-09-23T09:49:25.402 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_cache_meta_bytes": 0, 2023-09-23T09:49:25.402 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_cache_meta_items": 0, 2023-09-23T09:49:25.402 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_cache_other_bytes": 0, 2023-09-23T09:49:25.402 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_cache_other_items": 0, 2023-09-23T09:49:25.402 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_cache_buffer_bytes": 0, 2023-09-23T09:49:25.402 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_cache_buffer_items": 0, 2023-09-23T09:49:25.402 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_extent_bytes": 0, 2023-09-23T09:49:25.402 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_extent_items": 0, 2023-09-23T09:49:25.402 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_blob_bytes": 0, 2023-09-23T09:49:25.403 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_blob_items": 0, 2023-09-23T09:49:25.403 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_shared_blob_bytes": 0, 2023-09-23T09:49:25.403 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_shared_blob_items": 0, 2023-09-23T09:49:25.403 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_inline_bl_bytes": 0, 2023-09-23T09:49:25.403 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_inline_bl_items": 0, 2023-09-23T09:49:25.403 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_fsck_bytes": 0, 2023-09-23T09:49:25.403 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_fsck_items": 0, 2023-09-23T09:49:25.403 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_txc_bytes": 0, 2023-09-23T09:49:25.403 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_txc_items": 0, 2023-09-23T09:49:25.403 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_writing_deferred_bytes": 0, 2023-09-23T09:49:25.403 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_writing_deferred_items": 0, 2023-09-23T09:49:25.403 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_writing_bytes": 0, 2023-09-23T09:49:25.404 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_writing_items": 0, 2023-09-23T09:49:25.404 INFO:teuthology.orchestra.run.smithi161.stdout: "bluefs_bytes": 0, 2023-09-23T09:49:25.404 INFO:teuthology.orchestra.run.smithi161.stdout: "bluefs_items": 0, 2023-09-23T09:49:25.404 INFO:teuthology.orchestra.run.smithi161.stdout: "bluefs_file_reader_bytes": 0, 2023-09-23T09:49:25.404 INFO:teuthology.orchestra.run.smithi161.stdout: "bluefs_file_reader_items": 0, 2023-09-23T09:49:25.404 INFO:teuthology.orchestra.run.smithi161.stdout: "bluefs_file_writer_bytes": 0, 2023-09-23T09:49:25.405 INFO:teuthology.orchestra.run.smithi161.stdout: "bluefs_file_writer_items": 0, 2023-09-23T09:49:25.405 INFO:teuthology.orchestra.run.smithi161.stdout: "buffer_anon_bytes": 718398, 2023-09-23T09:49:25.405 INFO:teuthology.orchestra.run.smithi161.stdout: "buffer_anon_items": 218, 2023-09-23T09:49:25.405 INFO:teuthology.orchestra.run.smithi161.stdout: "buffer_meta_bytes": 0, 2023-09-23T09:49:25.405 INFO:teuthology.orchestra.run.smithi161.stdout: "buffer_meta_items": 0, 2023-09-23T09:49:25.405 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_bytes": 0, 2023-09-23T09:49:25.405 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_items": 0, 2023-09-23T09:49:25.405 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_mapbl_bytes": 0, 2023-09-23T09:49:25.405 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_mapbl_items": 0, 2023-09-23T09:49:25.405 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_pglog_bytes": 0, 2023-09-23T09:49:25.405 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_pglog_items": 0, 2023-09-23T09:49:25.406 INFO:teuthology.orchestra.run.smithi161.stdout: "osdmap_bytes": 8032, 2023-09-23T09:49:25.406 INFO:teuthology.orchestra.run.smithi161.stdout: "osdmap_items": 167, 2023-09-23T09:49:25.406 INFO:teuthology.orchestra.run.smithi161.stdout: "osdmap_mapping_bytes": 0, 2023-09-23T09:49:25.406 INFO:teuthology.orchestra.run.smithi161.stdout: "osdmap_mapping_items": 0, 2023-09-23T09:49:25.406 INFO:teuthology.orchestra.run.smithi161.stdout: "pgmap_bytes": 0, 2023-09-23T09:49:25.406 INFO:teuthology.orchestra.run.smithi161.stdout: "pgmap_items": 0, 2023-09-23T09:49:25.406 INFO:teuthology.orchestra.run.smithi161.stdout: "mds_co_bytes": 2266842, 2023-09-23T09:49:25.406 INFO:teuthology.orchestra.run.smithi161.stdout: "mds_co_items": 84926, 2023-09-23T09:49:25.406 INFO:teuthology.orchestra.run.smithi161.stdout: "unittest_1_bytes": 0, 2023-09-23T09:49:25.406 INFO:teuthology.orchestra.run.smithi161.stdout: "unittest_1_items": 0, 2023-09-23T09:49:25.406 INFO:teuthology.orchestra.run.smithi161.stdout: "unittest_2_bytes": 0, 2023-09-23T09:49:25.407 INFO:teuthology.orchestra.run.smithi161.stdout: "unittest_2_items": 0 2023-09-23T09:49:25.407 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:25.407 INFO:teuthology.orchestra.run.smithi161.stdout: "objecter": { 2023-09-23T09:49:25.407 INFO:teuthology.orchestra.run.smithi161.stdout: "op_active": 0, 2023-09-23T09:49:25.407 INFO:teuthology.orchestra.run.smithi161.stdout: "op_laggy": 0, 2023-09-23T09:49:25.407 INFO:teuthology.orchestra.run.smithi161.stdout: "op_send": 8647, 2023-09-23T09:49:25.407 INFO:teuthology.orchestra.run.smithi161.stdout: "op_send_bytes": 60833434, 2023-09-23T09:49:25.407 INFO:teuthology.orchestra.run.smithi161.stdout: "op_resend": 27, 2023-09-23T09:49:25.407 INFO:teuthology.orchestra.run.smithi161.stdout: "op_reply": 8647, 2023-09-23T09:49:25.407 INFO:teuthology.orchestra.run.smithi161.stdout: "op_latency": { 2023-09-23T09:49:25.407 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 8647, 2023-09-23T09:49:25.408 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 49.546015019, 2023-09-23T09:49:25.408 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.005729850 2023-09-23T09:49:25.408 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:25.408 INFO:teuthology.orchestra.run.smithi161.stdout: "op_inflight": 0, 2023-09-23T09:49:25.408 INFO:teuthology.orchestra.run.smithi161.stdout: "oplen_avg": { 2023-09-23T09:49:25.408 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 8647, 2023-09-23T09:49:25.408 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 9195 2023-09-23T09:49:25.408 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:25.408 INFO:teuthology.orchestra.run.smithi161.stdout: "op": 8647, 2023-09-23T09:49:25.408 INFO:teuthology.orchestra.run.smithi161.stdout: "op_r": 871, 2023-09-23T09:49:25.408 INFO:teuthology.orchestra.run.smithi161.stdout: "op_w": 7776, 2023-09-23T09:49:25.408 INFO:teuthology.orchestra.run.smithi161.stdout: "op_rmw": 0, 2023-09-23T09:49:25.409 INFO:teuthology.orchestra.run.smithi161.stdout: "op_pg": 0, 2023-09-23T09:49:25.409 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_stat": 0, 2023-09-23T09:49:25.409 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_create": 10, 2023-09-23T09:49:25.409 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_read": 90, 2023-09-23T09:49:25.409 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_write": 7051, 2023-09-23T09:49:25.409 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_writefull": 224, 2023-09-23T09:49:25.409 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_writesame": 0, 2023-09-23T09:49:25.409 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_append": 0, 2023-09-23T09:49:25.409 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_zero": 1, 2023-09-23T09:49:25.409 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_truncate": 0, 2023-09-23T09:49:25.409 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_delete": 136, 2023-09-23T09:49:25.409 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_mapext": 0, 2023-09-23T09:49:25.409 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_sparse_read": 0, 2023-09-23T09:49:25.410 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_clonerange": 0, 2023-09-23T09:49:25.410 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_getxattr": 764, 2023-09-23T09:49:25.410 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_setxattr": 20, 2023-09-23T09:49:25.410 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_cmpxattr": 0, 2023-09-23T09:49:25.410 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_rmxattr": 0, 2023-09-23T09:49:25.410 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_resetxattrs": 0, 2023-09-23T09:49:25.410 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_call": 0, 2023-09-23T09:49:25.410 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_watch": 0, 2023-09-23T09:49:25.410 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_notify": 0, 2023-09-23T09:49:25.410 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_src_cmpxattr": 0, 2023-09-23T09:49:25.410 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_pgls": 0, 2023-09-23T09:49:25.411 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_pgls_filter": 0, 2023-09-23T09:49:25.411 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_other": 0, 2023-09-23T09:49:25.411 INFO:teuthology.orchestra.run.smithi161.stdout: "linger_active": 0, 2023-09-23T09:49:25.411 INFO:teuthology.orchestra.run.smithi161.stdout: "linger_send": 0, 2023-09-23T09:49:25.411 INFO:teuthology.orchestra.run.smithi161.stdout: "linger_resend": 0, 2023-09-23T09:49:25.411 INFO:teuthology.orchestra.run.smithi161.stdout: "linger_ping": 0, 2023-09-23T09:49:25.411 INFO:teuthology.orchestra.run.smithi161.stdout: "poolop_active": 0, 2023-09-23T09:49:25.411 INFO:teuthology.orchestra.run.smithi161.stdout: "poolop_send": 0, 2023-09-23T09:49:25.411 INFO:teuthology.orchestra.run.smithi161.stdout: "poolop_resend": 0, 2023-09-23T09:49:25.411 INFO:teuthology.orchestra.run.smithi161.stdout: "poolstat_active": 0, 2023-09-23T09:49:25.411 INFO:teuthology.orchestra.run.smithi161.stdout: "poolstat_send": 0, 2023-09-23T09:49:25.411 INFO:teuthology.orchestra.run.smithi161.stdout: "poolstat_resend": 0, 2023-09-23T09:49:25.411 INFO:teuthology.orchestra.run.smithi161.stdout: "statfs_active": 0, 2023-09-23T09:49:25.412 INFO:teuthology.orchestra.run.smithi161.stdout: "statfs_send": 0, 2023-09-23T09:49:25.412 INFO:teuthology.orchestra.run.smithi161.stdout: "statfs_resend": 0, 2023-09-23T09:49:25.412 INFO:teuthology.orchestra.run.smithi161.stdout: "command_active": 0, 2023-09-23T09:49:25.412 INFO:teuthology.orchestra.run.smithi161.stdout: "command_send": 0, 2023-09-23T09:49:25.412 INFO:teuthology.orchestra.run.smithi161.stdout: "command_resend": 0, 2023-09-23T09:49:25.412 INFO:teuthology.orchestra.run.smithi161.stdout: "map_epoch": 181, 2023-09-23T09:49:25.412 INFO:teuthology.orchestra.run.smithi161.stdout: "map_full": 0, 2023-09-23T09:49:25.412 INFO:teuthology.orchestra.run.smithi161.stdout: "map_inc": 95, 2023-09-23T09:49:25.412 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_sessions": 12, 2023-09-23T09:49:25.412 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_session_open": 12, 2023-09-23T09:49:25.412 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_session_close": 0, 2023-09-23T09:49:25.412 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_laggy": 0, 2023-09-23T09:49:25.412 INFO:teuthology.orchestra.run.smithi161.stdout: "omap_wr": 634, 2023-09-23T09:49:25.413 INFO:teuthology.orchestra.run.smithi161.stdout: "omap_rd": 24, 2023-09-23T09:49:25.413 INFO:teuthology.orchestra.run.smithi161.stdout: "omap_del": 241 2023-09-23T09:49:25.413 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:25.413 INFO:teuthology.orchestra.run.smithi161.stdout: "oft": { 2023-09-23T09:49:25.413 INFO:teuthology.orchestra.run.smithi161.stdout: "omap_total_objs": 1, 2023-09-23T09:49:25.413 INFO:teuthology.orchestra.run.smithi161.stdout: "omap_total_kv_pairs": 0, 2023-09-23T09:49:25.413 INFO:teuthology.orchestra.run.smithi161.stdout: "omap_total_updates": 0, 2023-09-23T09:49:25.413 INFO:teuthology.orchestra.run.smithi161.stdout: "omap_total_removes": 0 2023-09-23T09:49:25.413 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:25.413 INFO:teuthology.orchestra.run.smithi161.stdout: "osd-slow-ops": { 2023-09-23T09:49:25.413 INFO:teuthology.orchestra.run.smithi161.stdout: "slow_ops_count": 0 2023-09-23T09:49:25.413 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:25.414 INFO:teuthology.orchestra.run.smithi161.stdout: "purge_queue": { 2023-09-23T09:49:25.414 INFO:teuthology.orchestra.run.smithi161.stdout: "pq_executing_ops": 0, 2023-09-23T09:49:25.414 INFO:teuthology.orchestra.run.smithi161.stdout: "pq_executing_ops_high_water": 6, 2023-09-23T09:49:25.414 INFO:teuthology.orchestra.run.smithi161.stdout: "pq_executing": 0, 2023-09-23T09:49:25.414 INFO:teuthology.orchestra.run.smithi161.stdout: "pq_executing_high_water": 6, 2023-09-23T09:49:25.414 INFO:teuthology.orchestra.run.smithi161.stdout: "pq_executed": 107, 2023-09-23T09:49:25.414 INFO:teuthology.orchestra.run.smithi161.stdout: "pq_item_in_journal": 0 2023-09-23T09:49:25.414 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:25.414 INFO:teuthology.orchestra.run.smithi161.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-09-23T09:49:25.414 INFO:teuthology.orchestra.run.smithi161.stdout: "val": 0, 2023-09-23T09:49:25.414 INFO:teuthology.orchestra.run.smithi161.stdout: "max": 104857600, 2023-09-23T09:49:25.414 INFO:teuthology.orchestra.run.smithi161.stdout: "get_started": 0, 2023-09-23T09:49:25.415 INFO:teuthology.orchestra.run.smithi161.stdout: "get": 198398, 2023-09-23T09:49:25.415 INFO:teuthology.orchestra.run.smithi161.stdout: "get_sum": 48924148, 2023-09-23T09:49:25.415 INFO:teuthology.orchestra.run.smithi161.stdout: "get_or_fail_fail": 0, 2023-09-23T09:49:25.415 INFO:teuthology.orchestra.run.smithi161.stdout: "get_or_fail_success": 198398, 2023-09-23T09:49:25.415 INFO:teuthology.orchestra.run.smithi161.stdout: "take": 0, 2023-09-23T09:49:25.415 INFO:teuthology.orchestra.run.smithi161.stdout: "take_sum": 0, 2023-09-23T09:49:25.415 INFO:teuthology.orchestra.run.smithi161.stdout: "put": 198398, 2023-09-23T09:49:25.415 INFO:teuthology.orchestra.run.smithi161.stdout: "put_sum": 48924148, 2023-09-23T09:49:25.415 INFO:teuthology.orchestra.run.smithi161.stdout: "wait": { 2023-09-23T09:49:25.415 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:25.415 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:25.415 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:25.416 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-09-23T09:49:25.416 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:25.416 INFO:teuthology.orchestra.run.smithi161.stdout: "throttle-objecter_bytes": { 2023-09-23T09:49:25.416 INFO:teuthology.orchestra.run.smithi161.stdout: "val": 0, 2023-09-23T09:49:25.416 INFO:teuthology.orchestra.run.smithi161.stdout: "max": 104857600, 2023-09-23T09:49:25.416 INFO:teuthology.orchestra.run.smithi161.stdout: "get_started": 0, 2023-09-23T09:49:25.416 INFO:teuthology.orchestra.run.smithi161.stdout: "get": 0, 2023-09-23T09:49:25.416 INFO:teuthology.orchestra.run.smithi161.stdout: "get_sum": 0, 2023-09-23T09:49:25.416 INFO:teuthology.orchestra.run.smithi161.stdout: "get_or_fail_fail": 0, 2023-09-23T09:49:25.416 INFO:teuthology.orchestra.run.smithi161.stdout: "get_or_fail_success": 0, 2023-09-23T09:49:25.416 INFO:teuthology.orchestra.run.smithi161.stdout: "take": 8647, 2023-09-23T09:49:25.417 INFO:teuthology.orchestra.run.smithi161.stdout: "take_sum": 60844178, 2023-09-23T09:49:25.417 INFO:teuthology.orchestra.run.smithi161.stdout: "put": 8647, 2023-09-23T09:49:25.417 INFO:teuthology.orchestra.run.smithi161.stdout: "put_sum": 60844178, 2023-09-23T09:49:25.417 INFO:teuthology.orchestra.run.smithi161.stdout: "wait": { 2023-09-23T09:49:25.417 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:25.417 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:25.417 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:25.417 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-09-23T09:49:25.417 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:25.417 INFO:teuthology.orchestra.run.smithi161.stdout: "throttle-objecter_ops": { 2023-09-23T09:49:25.417 INFO:teuthology.orchestra.run.smithi161.stdout: "val": 0, 2023-09-23T09:49:25.417 INFO:teuthology.orchestra.run.smithi161.stdout: "max": 1024, 2023-09-23T09:49:25.418 INFO:teuthology.orchestra.run.smithi161.stdout: "get_started": 0, 2023-09-23T09:49:25.418 INFO:teuthology.orchestra.run.smithi161.stdout: "get": 0, 2023-09-23T09:49:25.418 INFO:teuthology.orchestra.run.smithi161.stdout: "get_sum": 0, 2023-09-23T09:49:25.418 INFO:teuthology.orchestra.run.smithi161.stdout: "get_or_fail_fail": 0, 2023-09-23T09:49:25.418 INFO:teuthology.orchestra.run.smithi161.stdout: "get_or_fail_success": 0, 2023-09-23T09:49:25.418 INFO:teuthology.orchestra.run.smithi161.stdout: "take": 8647, 2023-09-23T09:49:25.418 INFO:teuthology.orchestra.run.smithi161.stdout: "take_sum": 8647, 2023-09-23T09:49:25.418 INFO:teuthology.orchestra.run.smithi161.stdout: "put": 8647, 2023-09-23T09:49:25.418 INFO:teuthology.orchestra.run.smithi161.stdout: "put_sum": 8647, 2023-09-23T09:49:25.418 INFO:teuthology.orchestra.run.smithi161.stdout: "wait": { 2023-09-23T09:49:25.418 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:25.418 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:25.419 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:25.419 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-09-23T09:49:25.419 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:25.419 INFO:teuthology.orchestra.run.smithi161.stdout: "throttle-write_buf_throttle": { 2023-09-23T09:49:25.419 INFO:teuthology.orchestra.run.smithi161.stdout: "val": 0, 2023-09-23T09:49:25.419 INFO:teuthology.orchestra.run.smithi161.stdout: "max": 3758096384, 2023-09-23T09:49:25.419 INFO:teuthology.orchestra.run.smithi161.stdout: "get_started": 0, 2023-09-23T09:49:25.419 INFO:teuthology.orchestra.run.smithi161.stdout: "get": 107, 2023-09-23T09:49:25.419 INFO:teuthology.orchestra.run.smithi161.stdout: "get_sum": 11231, 2023-09-23T09:49:25.419 INFO:teuthology.orchestra.run.smithi161.stdout: "get_or_fail_fail": 0, 2023-09-23T09:49:25.419 INFO:teuthology.orchestra.run.smithi161.stdout: "get_or_fail_success": 107, 2023-09-23T09:49:25.419 INFO:teuthology.orchestra.run.smithi161.stdout: "take": 0, 2023-09-23T09:49:25.419 INFO:teuthology.orchestra.run.smithi161.stdout: "take_sum": 0, 2023-09-23T09:49:25.420 INFO:teuthology.orchestra.run.smithi161.stdout: "put": 90, 2023-09-23T09:49:25.420 INFO:teuthology.orchestra.run.smithi161.stdout: "put_sum": 11231, 2023-09-23T09:49:25.420 INFO:teuthology.orchestra.run.smithi161.stdout: "wait": { 2023-09-23T09:49:25.420 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:25.420 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:25.420 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:25.420 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-09-23T09:49:25.420 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:25.420 INFO:teuthology.orchestra.run.smithi161.stdout: "throttle-write_buf_throttle-0x5602c3ed26e0": { 2023-09-23T09:49:25.420 INFO:teuthology.orchestra.run.smithi161.stdout: "val": 0, 2023-09-23T09:49:25.420 INFO:teuthology.orchestra.run.smithi161.stdout: "max": 3758096384, 2023-09-23T09:49:25.420 INFO:teuthology.orchestra.run.smithi161.stdout: "get_started": 0, 2023-09-23T09:49:25.421 INFO:teuthology.orchestra.run.smithi161.stdout: "get": 14183, 2023-09-23T09:49:25.421 INFO:teuthology.orchestra.run.smithi161.stdout: "get_sum": 60650561, 2023-09-23T09:49:25.421 INFO:teuthology.orchestra.run.smithi161.stdout: "get_or_fail_fail": 0, 2023-09-23T09:49:25.421 INFO:teuthology.orchestra.run.smithi161.stdout: "get_or_fail_success": 14183, 2023-09-23T09:49:25.421 INFO:teuthology.orchestra.run.smithi161.stdout: "take": 0, 2023-09-23T09:49:25.421 INFO:teuthology.orchestra.run.smithi161.stdout: "take_sum": 0, 2023-09-23T09:49:25.421 INFO:teuthology.orchestra.run.smithi161.stdout: "put": 6961, 2023-09-23T09:49:25.421 INFO:teuthology.orchestra.run.smithi161.stdout: "put_sum": 60650561, 2023-09-23T09:49:25.421 INFO:teuthology.orchestra.run.smithi161.stdout: "wait": { 2023-09-23T09:49:25.421 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:25.421 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:25.421 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:25.421 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-09-23T09:49:25.422 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-09-23T09:49:25.422 INFO:teuthology.orchestra.run.smithi161.stdout:} 2023-09-23T09:49:25.422 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:49:25 smithi082 ceph-mon[97694]: pgmap v1670: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-09-23T09:49:25.422 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:49:25 smithi161 ceph-mon[99580]: pgmap v1670: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-09-23T09:49:25.560 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:49:25 smithi135 ceph-mon[99205]: pgmap v1670: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-09-23T09:49:25.817 INFO:tasks.check_counter:Daemon mds.i mds.exported=69 2023-09-23T09:49:25.817 INFO:tasks.check_counter:Daemon mds.i mds.imported=50 2023-09-23T09:49:25.817 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=7 2023-09-23T09:49:25.817 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=0 2023-09-23T09:49:25.818 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=0 2023-09-23T09:49:25.818 DEBUG:tasks.check_counter:Getting stats from l 2023-09-23T09:49:25.818 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:db9a2d12746faa158579b8d032d53d472ae6b6b0 shell --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 -- ceph daemon mds.l perf dump 2023-09-23T09:49:26.542 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/mon.c/config 2023-09-23T09:49:27.363 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:49:27 smithi161 ceph-mon[99580]: pgmap v1671: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-09-23T09:49:27.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:49:27 smithi082 ceph-mon[97694]: pgmap v1671: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-09-23T09:49:27.560 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:49:27 smithi135 ceph-mon[99205]: pgmap v1671: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-09-23T09:49:28.078 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2023-09-23T09:49:28.078 INFO:teuthology.orchestra.run.smithi161.stdout: "AsyncMessenger::Worker-0": { 2023-09-23T09:49:28.078 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_recv_messages": 5980, 2023-09-23T09:49:28.078 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_messages": 5980, 2023-09-23T09:49:28.078 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_recv_bytes": 94122218, 2023-09-23T09:49:28.078 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_bytes": 1858994, 2023-09-23T09:49:28.078 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_created_connections": 8, 2023-09-23T09:49:28.078 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_active_connections": 4, 2023-09-23T09:49:28.079 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_total_time": 0.702161318, 2023-09-23T09:49:28.079 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_send_time": 0.179343651, 2023-09-23T09:49:28.079 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_recv_time": 0.287389324, 2023-09-23T09:49:28.079 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_fast_dispatch_time": 0.177496508, 2023-09-23T09:49:28.079 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_messages_queue_lat": { 2023-09-23T09:49:28.079 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 5979, 2023-09-23T09:49:28.079 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.359152660, 2023-09-23T09:49:28.079 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000060069 2023-09-23T09:49:28.079 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:28.079 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_handle_ack_lat": { 2023-09-23T09:49:28.080 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:28.080 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:28.080 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:28.080 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:28.080 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_recv_encrypted_bytes": 2912, 2023-09-23T09:49:28.080 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_encrypted_bytes": 448 2023-09-23T09:49:28.080 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:28.080 INFO:teuthology.orchestra.run.smithi161.stdout: "AsyncMessenger::Worker-1": { 2023-09-23T09:49:28.080 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_recv_messages": 3140, 2023-09-23T09:49:28.080 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_messages": 3805, 2023-09-23T09:49:28.080 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_recv_bytes": 122433318, 2023-09-23T09:49:28.081 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_bytes": 2340665, 2023-09-23T09:49:28.081 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_created_connections": 11, 2023-09-23T09:49:28.081 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_active_connections": 7, 2023-09-23T09:49:28.081 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_total_time": 0.459114156, 2023-09-23T09:49:28.081 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_send_time": 0.114353300, 2023-09-23T09:49:28.081 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_recv_time": 0.237028590, 2023-09-23T09:49:28.081 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_fast_dispatch_time": 0.078158668, 2023-09-23T09:49:28.081 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_messages_queue_lat": { 2023-09-23T09:49:28.081 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 3802, 2023-09-23T09:49:28.081 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.216599250, 2023-09-23T09:49:28.082 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000056969 2023-09-23T09:49:28.082 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:28.082 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_handle_ack_lat": { 2023-09-23T09:49:28.082 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:28.082 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:28.082 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:28.082 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:28.082 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_recv_encrypted_bytes": 480, 2023-09-23T09:49:28.082 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_encrypted_bytes": 1364992 2023-09-23T09:49:28.082 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:28.082 INFO:teuthology.orchestra.run.smithi161.stdout: "AsyncMessenger::Worker-2": { 2023-09-23T09:49:28.083 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_recv_messages": 3201, 2023-09-23T09:49:28.083 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_messages": 3069, 2023-09-23T09:49:28.083 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_recv_bytes": 86458807, 2023-09-23T09:49:28.083 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_bytes": 1198579, 2023-09-23T09:49:28.083 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_created_connections": 5, 2023-09-23T09:49:28.083 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_active_connections": 4, 2023-09-23T09:49:28.083 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_total_time": 0.474348189, 2023-09-23T09:49:28.083 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_send_time": 0.130459161, 2023-09-23T09:49:28.083 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_recv_time": 0.249012460, 2023-09-23T09:49:28.083 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_fast_dispatch_time": 0.079437185, 2023-09-23T09:49:28.084 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_messages_queue_lat": { 2023-09-23T09:49:28.084 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 3068, 2023-09-23T09:49:28.084 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.194744179, 2023-09-23T09:49:28.084 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000063475 2023-09-23T09:49:28.084 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:28.084 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_handle_ack_lat": { 2023-09-23T09:49:28.084 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:28.084 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:28.084 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:28.084 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:28.084 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_recv_encrypted_bytes": 2608992, 2023-09-23T09:49:28.085 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_encrypted_bytes": 547344 2023-09-23T09:49:28.085 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:28.085 INFO:teuthology.orchestra.run.smithi161.stdout: "cct": { 2023-09-23T09:49:28.085 INFO:teuthology.orchestra.run.smithi161.stdout: "total_workers": 1, 2023-09-23T09:49:28.085 INFO:teuthology.orchestra.run.smithi161.stdout: "unhealthy_workers": 0 2023-09-23T09:49:28.085 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:28.085 INFO:teuthology.orchestra.run.smithi161.stdout: "finisher-MDSRank": { 2023-09-23T09:49:28.085 INFO:teuthology.orchestra.run.smithi161.stdout: "queue_len": 0, 2023-09-23T09:49:28.085 INFO:teuthology.orchestra.run.smithi161.stdout: "complete_latency": { 2023-09-23T09:49:28.085 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 18701, 2023-09-23T09:49:28.086 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.513473750, 2023-09-23T09:49:28.086 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000027457 2023-09-23T09:49:28.086 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-09-23T09:49:28.086 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:28.086 INFO:teuthology.orchestra.run.smithi161.stdout: "finisher-PurgeQueue": { 2023-09-23T09:49:28.086 INFO:teuthology.orchestra.run.smithi161.stdout: "queue_len": 0, 2023-09-23T09:49:28.086 INFO:teuthology.orchestra.run.smithi161.stdout: "complete_latency": { 2023-09-23T09:49:28.086 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:28.086 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:28.086 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:28.086 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-09-23T09:49:28.087 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:28.087 INFO:teuthology.orchestra.run.smithi161.stdout: "mds": { 2023-09-23T09:49:28.087 INFO:teuthology.orchestra.run.smithi161.stdout: "request": 0, 2023-09-23T09:49:28.087 INFO:teuthology.orchestra.run.smithi161.stdout: "reply": 0, 2023-09-23T09:49:28.087 INFO:teuthology.orchestra.run.smithi161.stdout: "reply_latency": { 2023-09-23T09:49:28.087 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:28.087 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:28.087 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:28.087 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:28.087 INFO:teuthology.orchestra.run.smithi161.stdout: "slow_reply": 0, 2023-09-23T09:49:28.088 INFO:teuthology.orchestra.run.smithi161.stdout: "forward": 0, 2023-09-23T09:49:28.088 INFO:teuthology.orchestra.run.smithi161.stdout: "dir_fetch_complete": 0, 2023-09-23T09:49:28.088 INFO:teuthology.orchestra.run.smithi161.stdout: "dir_fetch_keys": 0, 2023-09-23T09:49:28.088 INFO:teuthology.orchestra.run.smithi161.stdout: "dir_commit": 0, 2023-09-23T09:49:28.088 INFO:teuthology.orchestra.run.smithi161.stdout: "dir_split": 0, 2023-09-23T09:49:28.088 INFO:teuthology.orchestra.run.smithi161.stdout: "dir_merge": 0, 2023-09-23T09:49:28.088 INFO:teuthology.orchestra.run.smithi161.stdout: "inodes": 725, 2023-09-23T09:49:28.088 INFO:teuthology.orchestra.run.smithi161.stdout: "inodes_top": 16, 2023-09-23T09:49:28.088 INFO:teuthology.orchestra.run.smithi161.stdout: "inodes_bottom": 483, 2023-09-23T09:49:28.088 INFO:teuthology.orchestra.run.smithi161.stdout: "inodes_pin_tail": 226, 2023-09-23T09:49:28.088 INFO:teuthology.orchestra.run.smithi161.stdout: "inodes_pinned": 701, 2023-09-23T09:49:28.089 INFO:teuthology.orchestra.run.smithi161.stdout: "inodes_expired": 1, 2023-09-23T09:49:28.089 INFO:teuthology.orchestra.run.smithi161.stdout: "inodes_with_caps": 0, 2023-09-23T09:49:28.089 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": 0, 2023-09-23T09:49:28.089 INFO:teuthology.orchestra.run.smithi161.stdout: "subtrees": 14, 2023-09-23T09:49:28.089 INFO:teuthology.orchestra.run.smithi161.stdout: "traverse": 0, 2023-09-23T09:49:28.089 INFO:teuthology.orchestra.run.smithi161.stdout: "traverse_hit": 0, 2023-09-23T09:49:28.089 INFO:teuthology.orchestra.run.smithi161.stdout: "traverse_forward": 0, 2023-09-23T09:49:28.089 INFO:teuthology.orchestra.run.smithi161.stdout: "traverse_discover": 0, 2023-09-23T09:49:28.089 INFO:teuthology.orchestra.run.smithi161.stdout: "traverse_dir_fetch": 0, 2023-09-23T09:49:28.089 INFO:teuthology.orchestra.run.smithi161.stdout: "traverse_remote_ino": 0, 2023-09-23T09:49:28.089 INFO:teuthology.orchestra.run.smithi161.stdout: "traverse_lock": 0, 2023-09-23T09:49:28.090 INFO:teuthology.orchestra.run.smithi161.stdout: "load_cent": 0, 2023-09-23T09:49:28.090 INFO:teuthology.orchestra.run.smithi161.stdout: "q": 0, 2023-09-23T09:49:28.090 INFO:teuthology.orchestra.run.smithi161.stdout: "exported": 0, 2023-09-23T09:49:28.090 INFO:teuthology.orchestra.run.smithi161.stdout: "exported_inodes": 0, 2023-09-23T09:49:28.090 INFO:teuthology.orchestra.run.smithi161.stdout: "imported": 0, 2023-09-23T09:49:28.090 INFO:teuthology.orchestra.run.smithi161.stdout: "imported_inodes": 0, 2023-09-23T09:49:28.090 INFO:teuthology.orchestra.run.smithi161.stdout: "openino_dir_fetch": 0, 2023-09-23T09:49:28.090 INFO:teuthology.orchestra.run.smithi161.stdout: "openino_backtrace_fetch": 0, 2023-09-23T09:49:28.090 INFO:teuthology.orchestra.run.smithi161.stdout: "openino_peer_discover": 0, 2023-09-23T09:49:28.090 INFO:teuthology.orchestra.run.smithi161.stdout: "root_rfiles": 1045, 2023-09-23T09:49:28.090 INFO:teuthology.orchestra.run.smithi161.stdout: "root_rbytes": 8989915630, 2023-09-23T09:49:28.091 INFO:teuthology.orchestra.run.smithi161.stdout: "root_rsnaps": 7, 2023-09-23T09:49:28.091 INFO:teuthology.orchestra.run.smithi161.stdout: "scrub_backtrace_fetch": 0, 2023-09-23T09:49:28.091 INFO:teuthology.orchestra.run.smithi161.stdout: "scrub_set_tag": 0, 2023-09-23T09:49:28.091 INFO:teuthology.orchestra.run.smithi161.stdout: "scrub_backtrace_repaired": 0, 2023-09-23T09:49:28.091 INFO:teuthology.orchestra.run.smithi161.stdout: "scrub_inotable_repaired": 0, 2023-09-23T09:49:28.091 INFO:teuthology.orchestra.run.smithi161.stdout: "scrub_dir_inodes": 0, 2023-09-23T09:49:28.091 INFO:teuthology.orchestra.run.smithi161.stdout: "scrub_dir_base_inodes": 0, 2023-09-23T09:49:28.091 INFO:teuthology.orchestra.run.smithi161.stdout: "scrub_dirfrag_rstats": 0, 2023-09-23T09:49:28.091 INFO:teuthology.orchestra.run.smithi161.stdout: "scrub_file_inodes": 0, 2023-09-23T09:49:28.091 INFO:teuthology.orchestra.run.smithi161.stdout: "handle_inode_file_caps": 0, 2023-09-23T09:49:28.091 INFO:teuthology.orchestra.run.smithi161.stdout: "ceph_cap_op_revoke": 0, 2023-09-23T09:49:28.092 INFO:teuthology.orchestra.run.smithi161.stdout: "ceph_cap_op_grant": 0, 2023-09-23T09:49:28.092 INFO:teuthology.orchestra.run.smithi161.stdout: "ceph_cap_op_trunc": 0, 2023-09-23T09:49:28.092 INFO:teuthology.orchestra.run.smithi161.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-09-23T09:49:28.092 INFO:teuthology.orchestra.run.smithi161.stdout: "ceph_cap_op_flush_ack": 0, 2023-09-23T09:49:28.092 INFO:teuthology.orchestra.run.smithi161.stdout: "handle_client_caps": 0, 2023-09-23T09:49:28.092 INFO:teuthology.orchestra.run.smithi161.stdout: "handle_client_caps_dirty": 0, 2023-09-23T09:49:28.092 INFO:teuthology.orchestra.run.smithi161.stdout: "handle_client_cap_release": 0, 2023-09-23T09:49:28.092 INFO:teuthology.orchestra.run.smithi161.stdout: "process_request_cap_release": 0 2023-09-23T09:49:28.092 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:28.092 INFO:teuthology.orchestra.run.smithi161.stdout: "mds_cache": { 2023-09-23T09:49:28.092 INFO:teuthology.orchestra.run.smithi161.stdout: "dir_update": 0, 2023-09-23T09:49:28.093 INFO:teuthology.orchestra.run.smithi161.stdout: "dir_update_receipt": 0, 2023-09-23T09:49:28.093 INFO:teuthology.orchestra.run.smithi161.stdout: "dir_try_discover": 0, 2023-09-23T09:49:28.093 INFO:teuthology.orchestra.run.smithi161.stdout: "dir_send_discover": 0, 2023-09-23T09:49:28.093 INFO:teuthology.orchestra.run.smithi161.stdout: "dir_handle_discover": 0, 2023-09-23T09:49:28.093 INFO:teuthology.orchestra.run.smithi161.stdout: "num_strays": 0, 2023-09-23T09:49:28.093 INFO:teuthology.orchestra.run.smithi161.stdout: "num_strays_delayed": 0, 2023-09-23T09:49:28.093 INFO:teuthology.orchestra.run.smithi161.stdout: "num_strays_enqueuing": 0, 2023-09-23T09:49:28.093 INFO:teuthology.orchestra.run.smithi161.stdout: "strays_created": 0, 2023-09-23T09:49:28.093 INFO:teuthology.orchestra.run.smithi161.stdout: "strays_enqueued": 0, 2023-09-23T09:49:28.093 INFO:teuthology.orchestra.run.smithi161.stdout: "strays_reintegrated": 0, 2023-09-23T09:49:28.093 INFO:teuthology.orchestra.run.smithi161.stdout: "strays_migrated": 0, 2023-09-23T09:49:28.094 INFO:teuthology.orchestra.run.smithi161.stdout: "num_recovering_processing": 0, 2023-09-23T09:49:28.094 INFO:teuthology.orchestra.run.smithi161.stdout: "num_recovering_enqueued": 0, 2023-09-23T09:49:28.094 INFO:teuthology.orchestra.run.smithi161.stdout: "num_recovering_prioritized": 0, 2023-09-23T09:49:28.094 INFO:teuthology.orchestra.run.smithi161.stdout: "recovery_started": 0, 2023-09-23T09:49:28.094 INFO:teuthology.orchestra.run.smithi161.stdout: "recovery_completed": 0, 2023-09-23T09:49:28.094 INFO:teuthology.orchestra.run.smithi161.stdout: "ireq_enqueue_scrub": 0, 2023-09-23T09:49:28.094 INFO:teuthology.orchestra.run.smithi161.stdout: "ireq_exportdir": 0, 2023-09-23T09:49:28.094 INFO:teuthology.orchestra.run.smithi161.stdout: "ireq_flush": 0, 2023-09-23T09:49:28.094 INFO:teuthology.orchestra.run.smithi161.stdout: "ireq_fragmentdir": 0, 2023-09-23T09:49:28.094 INFO:teuthology.orchestra.run.smithi161.stdout: "ireq_fragstats": 0, 2023-09-23T09:49:28.095 INFO:teuthology.orchestra.run.smithi161.stdout: "ireq_inodestats": 0 2023-09-23T09:49:28.095 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:28.095 INFO:teuthology.orchestra.run.smithi161.stdout: "mds_log": { 2023-09-23T09:49:28.095 INFO:teuthology.orchestra.run.smithi161.stdout: "evlrg": 0, 2023-09-23T09:49:28.095 INFO:teuthology.orchestra.run.smithi161.stdout: "evadd": 0, 2023-09-23T09:49:28.095 INFO:teuthology.orchestra.run.smithi161.stdout: "evex": 0, 2023-09-23T09:49:28.095 INFO:teuthology.orchestra.run.smithi161.stdout: "evtrm": 0, 2023-09-23T09:49:28.095 INFO:teuthology.orchestra.run.smithi161.stdout: "ev": 14142, 2023-09-23T09:49:28.095 INFO:teuthology.orchestra.run.smithi161.stdout: "evexg": 0, 2023-09-23T09:49:28.095 INFO:teuthology.orchestra.run.smithi161.stdout: "evexd": 0, 2023-09-23T09:49:28.095 INFO:teuthology.orchestra.run.smithi161.stdout: "segadd": 0, 2023-09-23T09:49:28.096 INFO:teuthology.orchestra.run.smithi161.stdout: "segex": 0, 2023-09-23T09:49:28.096 INFO:teuthology.orchestra.run.smithi161.stdout: "segtrm": 0, 2023-09-23T09:49:28.096 INFO:teuthology.orchestra.run.smithi161.stdout: "seg": 76, 2023-09-23T09:49:28.096 INFO:teuthology.orchestra.run.smithi161.stdout: "segmjr": 3, 2023-09-23T09:49:28.096 INFO:teuthology.orchestra.run.smithi161.stdout: "segexg": 0, 2023-09-23T09:49:28.096 INFO:teuthology.orchestra.run.smithi161.stdout: "segexd": 0, 2023-09-23T09:49:28.096 INFO:teuthology.orchestra.run.smithi161.stdout: "expos": 4194304, 2023-09-23T09:49:28.096 INFO:teuthology.orchestra.run.smithi161.stdout: "wrpos": 301409038, 2023-09-23T09:49:28.096 INFO:teuthology.orchestra.run.smithi161.stdout: "rdpos": 301408926, 2023-09-23T09:49:28.096 INFO:teuthology.orchestra.run.smithi161.stdout: "jlat": { 2023-09-23T09:49:28.096 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:28.097 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:28.097 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:28.097 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:28.097 INFO:teuthology.orchestra.run.smithi161.stdout: "replayed": 14142 2023-09-23T09:49:28.097 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:28.097 INFO:teuthology.orchestra.run.smithi161.stdout: "mds_mem": { 2023-09-23T09:49:28.097 INFO:teuthology.orchestra.run.smithi161.stdout: "ino": 407, 2023-09-23T09:49:28.097 INFO:teuthology.orchestra.run.smithi161.stdout: "ino+": 4847, 2023-09-23T09:49:28.097 INFO:teuthology.orchestra.run.smithi161.stdout: "ino-": 4440, 2023-09-23T09:49:28.097 INFO:teuthology.orchestra.run.smithi161.stdout: "dir": 62, 2023-09-23T09:49:28.097 INFO:teuthology.orchestra.run.smithi161.stdout: "dir+": 198, 2023-09-23T09:49:28.098 INFO:teuthology.orchestra.run.smithi161.stdout: "dir-": 136, 2023-09-23T09:49:28.098 INFO:teuthology.orchestra.run.smithi161.stdout: "dn": 725, 2023-09-23T09:49:28.098 INFO:teuthology.orchestra.run.smithi161.stdout: "dn+": 5501, 2023-09-23T09:49:28.098 INFO:teuthology.orchestra.run.smithi161.stdout: "dn-": 4776, 2023-09-23T09:49:28.098 INFO:teuthology.orchestra.run.smithi161.stdout: "cap": 0, 2023-09-23T09:49:28.098 INFO:teuthology.orchestra.run.smithi161.stdout: "cap+": 0, 2023-09-23T09:49:28.098 INFO:teuthology.orchestra.run.smithi161.stdout: "cap-": 0, 2023-09-23T09:49:28.098 INFO:teuthology.orchestra.run.smithi161.stdout: "rss": 58044, 2023-09-23T09:49:28.098 INFO:teuthology.orchestra.run.smithi161.stdout: "heap": 207152 2023-09-23T09:49:28.098 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:28.098 INFO:teuthology.orchestra.run.smithi161.stdout: "mds_server": { 2023-09-23T09:49:28.099 INFO:teuthology.orchestra.run.smithi161.stdout: "dispatch_client_request": 0, 2023-09-23T09:49:28.099 INFO:teuthology.orchestra.run.smithi161.stdout: "dispatch_server_request": 0, 2023-09-23T09:49:28.099 INFO:teuthology.orchestra.run.smithi161.stdout: "handle_client_request": 0, 2023-09-23T09:49:28.099 INFO:teuthology.orchestra.run.smithi161.stdout: "handle_client_session": 0, 2023-09-23T09:49:28.099 INFO:teuthology.orchestra.run.smithi161.stdout: "handle_peer_request": 0, 2023-09-23T09:49:28.099 INFO:teuthology.orchestra.run.smithi161.stdout: "req_create_latency": { 2023-09-23T09:49:28.099 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:28.099 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:28.099 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:28.099 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:28.099 INFO:teuthology.orchestra.run.smithi161.stdout: "req_getattr_latency": { 2023-09-23T09:49:28.100 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:28.100 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:28.100 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:28.100 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:28.100 INFO:teuthology.orchestra.run.smithi161.stdout: "req_getfilelock_latency": { 2023-09-23T09:49:28.100 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:28.100 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:28.100 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:28.100 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:28.100 INFO:teuthology.orchestra.run.smithi161.stdout: "req_link_latency": { 2023-09-23T09:49:28.100 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:28.100 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:28.101 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:28.101 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:28.101 INFO:teuthology.orchestra.run.smithi161.stdout: "req_lookup_latency": { 2023-09-23T09:49:28.101 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:28.101 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:28.101 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:28.101 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:28.101 INFO:teuthology.orchestra.run.smithi161.stdout: "req_lookuphash_latency": { 2023-09-23T09:49:28.101 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:28.101 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:28.101 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:28.102 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:28.102 INFO:teuthology.orchestra.run.smithi161.stdout: "req_lookupino_latency": { 2023-09-23T09:49:28.102 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:28.102 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:28.102 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:28.102 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:28.102 INFO:teuthology.orchestra.run.smithi161.stdout: "req_lookupname_latency": { 2023-09-23T09:49:28.102 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:28.102 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:28.102 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:28.102 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:28.103 INFO:teuthology.orchestra.run.smithi161.stdout: "req_lookupparent_latency": { 2023-09-23T09:49:28.103 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:28.103 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:28.103 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:28.103 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:28.103 INFO:teuthology.orchestra.run.smithi161.stdout: "req_lookupsnap_latency": { 2023-09-23T09:49:28.103 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:28.103 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:28.103 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:28.103 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:28.103 INFO:teuthology.orchestra.run.smithi161.stdout: "req_lssnap_latency": { 2023-09-23T09:49:28.104 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:28.104 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:28.104 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:28.104 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:28.104 INFO:teuthology.orchestra.run.smithi161.stdout: "req_mkdir_latency": { 2023-09-23T09:49:28.104 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:28.104 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:28.104 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:28.104 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:28.104 INFO:teuthology.orchestra.run.smithi161.stdout: "req_mknod_latency": { 2023-09-23T09:49:28.104 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:28.105 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:28.105 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:28.105 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:28.105 INFO:teuthology.orchestra.run.smithi161.stdout: "req_mksnap_latency": { 2023-09-23T09:49:28.105 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:28.105 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:28.105 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:28.105 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:28.105 INFO:teuthology.orchestra.run.smithi161.stdout: "req_open_latency": { 2023-09-23T09:49:28.105 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:28.105 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:28.105 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:28.106 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:28.106 INFO:teuthology.orchestra.run.smithi161.stdout: "req_readdir_latency": { 2023-09-23T09:49:28.106 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:28.106 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:28.106 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:28.106 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:28.106 INFO:teuthology.orchestra.run.smithi161.stdout: "req_rename_latency": { 2023-09-23T09:49:28.106 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:28.106 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:28.106 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:28.107 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:28.107 INFO:teuthology.orchestra.run.smithi161.stdout: "req_renamesnap_latency": { 2023-09-23T09:49:28.107 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:28.107 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:28.107 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:28.107 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:28.107 INFO:teuthology.orchestra.run.smithi161.stdout: "req_snapdiff_latency": { 2023-09-23T09:49:28.107 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:28.107 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:28.107 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:28.107 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:28.108 INFO:teuthology.orchestra.run.smithi161.stdout: "req_rmdir_latency": { 2023-09-23T09:49:28.108 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:28.108 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:28.108 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:28.108 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:28.108 INFO:teuthology.orchestra.run.smithi161.stdout: "req_rmsnap_latency": { 2023-09-23T09:49:28.108 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:28.108 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:28.108 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:28.108 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:28.108 INFO:teuthology.orchestra.run.smithi161.stdout: "req_rmxattr_latency": { 2023-09-23T09:49:28.109 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:28.109 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:28.109 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:28.109 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:28.109 INFO:teuthology.orchestra.run.smithi161.stdout: "req_setattr_latency": { 2023-09-23T09:49:28.109 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:28.109 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:28.109 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:28.109 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:28.109 INFO:teuthology.orchestra.run.smithi161.stdout: "req_setdirlayout_latency": { 2023-09-23T09:49:28.109 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:28.109 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:28.110 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:28.110 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:28.110 INFO:teuthology.orchestra.run.smithi161.stdout: "req_setfilelock_latency": { 2023-09-23T09:49:28.110 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:28.110 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:28.110 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:28.110 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:28.110 INFO:teuthology.orchestra.run.smithi161.stdout: "req_setlayout_latency": { 2023-09-23T09:49:28.110 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:28.110 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:28.111 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:28.111 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:28.111 INFO:teuthology.orchestra.run.smithi161.stdout: "req_setxattr_latency": { 2023-09-23T09:49:28.111 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:28.111 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:28.111 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:28.111 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:28.111 INFO:teuthology.orchestra.run.smithi161.stdout: "req_symlink_latency": { 2023-09-23T09:49:28.111 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:28.111 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:28.111 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:28.111 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:28.112 INFO:teuthology.orchestra.run.smithi161.stdout: "req_unlink_latency": { 2023-09-23T09:49:28.112 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:28.112 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:28.112 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:28.112 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:28.112 INFO:teuthology.orchestra.run.smithi161.stdout: "cap_revoke_eviction": 0, 2023-09-23T09:49:28.112 INFO:teuthology.orchestra.run.smithi161.stdout: "cap_acquisition_throttle": 0, 2023-09-23T09:49:28.112 INFO:teuthology.orchestra.run.smithi161.stdout: "req_getvxattr_latency": { 2023-09-23T09:49:28.112 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:28.112 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:28.112 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:28.112 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-09-23T09:49:28.113 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:28.113 INFO:teuthology.orchestra.run.smithi161.stdout: "mds_sessions": { 2023-09-23T09:49:28.113 INFO:teuthology.orchestra.run.smithi161.stdout: "session_count": 2, 2023-09-23T09:49:28.113 INFO:teuthology.orchestra.run.smithi161.stdout: "session_add": 5, 2023-09-23T09:49:28.113 INFO:teuthology.orchestra.run.smithi161.stdout: "session_remove": 3, 2023-09-23T09:49:28.113 INFO:teuthology.orchestra.run.smithi161.stdout: "sessions_open": 4, 2023-09-23T09:49:28.113 INFO:teuthology.orchestra.run.smithi161.stdout: "sessions_stale": 0, 2023-09-23T09:49:28.113 INFO:teuthology.orchestra.run.smithi161.stdout: "total_load": 0, 2023-09-23T09:49:28.113 INFO:teuthology.orchestra.run.smithi161.stdout: "average_load": 0, 2023-09-23T09:49:28.113 INFO:teuthology.orchestra.run.smithi161.stdout: "avg_session_uptime": 6410 2023-09-23T09:49:28.113 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:28.113 INFO:teuthology.orchestra.run.smithi161.stdout: "mempool": { 2023-09-23T09:49:28.114 INFO:teuthology.orchestra.run.smithi161.stdout: "bloom_filter_bytes": 0, 2023-09-23T09:49:28.114 INFO:teuthology.orchestra.run.smithi161.stdout: "bloom_filter_items": 0, 2023-09-23T09:49:28.114 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_alloc_bytes": 0, 2023-09-23T09:49:28.114 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_alloc_items": 0, 2023-09-23T09:49:28.114 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_cache_data_bytes": 0, 2023-09-23T09:49:28.114 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_cache_data_items": 0, 2023-09-23T09:49:28.114 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_cache_onode_bytes": 0, 2023-09-23T09:49:28.114 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_cache_onode_items": 0, 2023-09-23T09:49:28.114 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_cache_meta_bytes": 0, 2023-09-23T09:49:28.114 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_cache_meta_items": 0, 2023-09-23T09:49:28.114 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_cache_other_bytes": 0, 2023-09-23T09:49:28.115 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_cache_other_items": 0, 2023-09-23T09:49:28.115 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_cache_buffer_bytes": 0, 2023-09-23T09:49:28.115 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_cache_buffer_items": 0, 2023-09-23T09:49:28.115 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_extent_bytes": 0, 2023-09-23T09:49:28.115 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_extent_items": 0, 2023-09-23T09:49:28.115 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_blob_bytes": 0, 2023-09-23T09:49:28.115 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_blob_items": 0, 2023-09-23T09:49:28.115 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_shared_blob_bytes": 0, 2023-09-23T09:49:28.115 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_shared_blob_items": 0, 2023-09-23T09:49:28.115 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_inline_bl_bytes": 0, 2023-09-23T09:49:28.115 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_inline_bl_items": 0, 2023-09-23T09:49:28.115 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_fsck_bytes": 0, 2023-09-23T09:49:28.116 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_fsck_items": 0, 2023-09-23T09:49:28.116 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_txc_bytes": 0, 2023-09-23T09:49:28.116 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_txc_items": 0, 2023-09-23T09:49:28.116 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_writing_deferred_bytes": 0, 2023-09-23T09:49:28.116 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_writing_deferred_items": 0, 2023-09-23T09:49:28.116 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_writing_bytes": 0, 2023-09-23T09:49:28.116 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_writing_items": 0, 2023-09-23T09:49:28.116 INFO:teuthology.orchestra.run.smithi161.stdout: "bluefs_bytes": 0, 2023-09-23T09:49:28.116 INFO:teuthology.orchestra.run.smithi161.stdout: "bluefs_items": 0, 2023-09-23T09:49:28.116 INFO:teuthology.orchestra.run.smithi161.stdout: "bluefs_file_reader_bytes": 0, 2023-09-23T09:49:28.116 INFO:teuthology.orchestra.run.smithi161.stdout: "bluefs_file_reader_items": 0, 2023-09-23T09:49:28.116 INFO:teuthology.orchestra.run.smithi161.stdout: "bluefs_file_writer_bytes": 0, 2023-09-23T09:49:28.117 INFO:teuthology.orchestra.run.smithi161.stdout: "bluefs_file_writer_items": 0, 2023-09-23T09:49:28.117 INFO:teuthology.orchestra.run.smithi161.stdout: "buffer_anon_bytes": 243418, 2023-09-23T09:49:28.117 INFO:teuthology.orchestra.run.smithi161.stdout: "buffer_anon_items": 91, 2023-09-23T09:49:28.117 INFO:teuthology.orchestra.run.smithi161.stdout: "buffer_meta_bytes": 0, 2023-09-23T09:49:28.117 INFO:teuthology.orchestra.run.smithi161.stdout: "buffer_meta_items": 0, 2023-09-23T09:49:28.117 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_bytes": 0, 2023-09-23T09:49:28.117 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_items": 0, 2023-09-23T09:49:28.117 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_mapbl_bytes": 0, 2023-09-23T09:49:28.117 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_mapbl_items": 0, 2023-09-23T09:49:28.117 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_pglog_bytes": 0, 2023-09-23T09:49:28.117 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_pglog_items": 0, 2023-09-23T09:49:28.117 INFO:teuthology.orchestra.run.smithi161.stdout: "osdmap_bytes": 8032, 2023-09-23T09:49:28.118 INFO:teuthology.orchestra.run.smithi161.stdout: "osdmap_items": 167, 2023-09-23T09:49:28.118 INFO:teuthology.orchestra.run.smithi161.stdout: "osdmap_mapping_bytes": 0, 2023-09-23T09:49:28.118 INFO:teuthology.orchestra.run.smithi161.stdout: "osdmap_mapping_items": 0, 2023-09-23T09:49:28.118 INFO:teuthology.orchestra.run.smithi161.stdout: "pgmap_bytes": 0, 2023-09-23T09:49:28.118 INFO:teuthology.orchestra.run.smithi161.stdout: "pgmap_items": 0, 2023-09-23T09:49:28.118 INFO:teuthology.orchestra.run.smithi161.stdout: "mds_co_bytes": 2039221, 2023-09-23T09:49:28.118 INFO:teuthology.orchestra.run.smithi161.stdout: "mds_co_items": 23150, 2023-09-23T09:49:28.118 INFO:teuthology.orchestra.run.smithi161.stdout: "unittest_1_bytes": 0, 2023-09-23T09:49:28.118 INFO:teuthology.orchestra.run.smithi161.stdout: "unittest_1_items": 0, 2023-09-23T09:49:28.118 INFO:teuthology.orchestra.run.smithi161.stdout: "unittest_2_bytes": 0, 2023-09-23T09:49:28.118 INFO:teuthology.orchestra.run.smithi161.stdout: "unittest_2_items": 0 2023-09-23T09:49:28.119 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:28.119 INFO:teuthology.orchestra.run.smithi161.stdout: "objecter": { 2023-09-23T09:49:28.119 INFO:teuthology.orchestra.run.smithi161.stdout: "op_active": 0, 2023-09-23T09:49:28.119 INFO:teuthology.orchestra.run.smithi161.stdout: "op_laggy": 0, 2023-09-23T09:49:28.119 INFO:teuthology.orchestra.run.smithi161.stdout: "op_send": 11207, 2023-09-23T09:49:28.119 INFO:teuthology.orchestra.run.smithi161.stdout: "op_send_bytes": 26, 2023-09-23T09:49:28.119 INFO:teuthology.orchestra.run.smithi161.stdout: "op_resend": 4, 2023-09-23T09:49:28.119 INFO:teuthology.orchestra.run.smithi161.stdout: "op_reply": 11207, 2023-09-23T09:49:28.119 INFO:teuthology.orchestra.run.smithi161.stdout: "op_latency": { 2023-09-23T09:49:28.119 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 11207, 2023-09-23T09:49:28.119 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 11.342774145, 2023-09-23T09:49:28.120 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.001012115 2023-09-23T09:49:28.120 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:28.120 INFO:teuthology.orchestra.run.smithi161.stdout: "op_inflight": 0, 2023-09-23T09:49:28.120 INFO:teuthology.orchestra.run.smithi161.stdout: "oplen_avg": { 2023-09-23T09:49:28.120 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 11207, 2023-09-23T09:49:28.120 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 11208 2023-09-23T09:49:28.120 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:28.120 INFO:teuthology.orchestra.run.smithi161.stdout: "op": 11207, 2023-09-23T09:49:28.120 INFO:teuthology.orchestra.run.smithi161.stdout: "op_r": 11207, 2023-09-23T09:49:28.120 INFO:teuthology.orchestra.run.smithi161.stdout: "op_w": 0, 2023-09-23T09:49:28.120 INFO:teuthology.orchestra.run.smithi161.stdout: "op_rmw": 0, 2023-09-23T09:49:28.120 INFO:teuthology.orchestra.run.smithi161.stdout: "op_pg": 0, 2023-09-23T09:49:28.121 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_stat": 6534, 2023-09-23T09:49:28.121 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_create": 0, 2023-09-23T09:49:28.121 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_read": 4670, 2023-09-23T09:49:28.121 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_write": 0, 2023-09-23T09:49:28.121 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_writefull": 0, 2023-09-23T09:49:28.121 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_writesame": 0, 2023-09-23T09:49:28.121 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_append": 0, 2023-09-23T09:49:28.121 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_zero": 0, 2023-09-23T09:49:28.121 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_truncate": 0, 2023-09-23T09:49:28.121 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_delete": 0, 2023-09-23T09:49:28.121 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_mapext": 0, 2023-09-23T09:49:28.121 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_sparse_read": 0, 2023-09-23T09:49:28.122 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_clonerange": 0, 2023-09-23T09:49:28.122 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_getxattr": 2, 2023-09-23T09:49:28.122 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_setxattr": 0, 2023-09-23T09:49:28.122 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_cmpxattr": 0, 2023-09-23T09:49:28.122 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_rmxattr": 0, 2023-09-23T09:49:28.122 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_resetxattrs": 0, 2023-09-23T09:49:28.122 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_call": 0, 2023-09-23T09:49:28.122 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_watch": 0, 2023-09-23T09:49:28.122 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_notify": 0, 2023-09-23T09:49:28.122 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_src_cmpxattr": 0, 2023-09-23T09:49:28.122 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_pgls": 0, 2023-09-23T09:49:28.122 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_pgls_filter": 0, 2023-09-23T09:49:28.123 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_other": 0, 2023-09-23T09:49:28.123 INFO:teuthology.orchestra.run.smithi161.stdout: "linger_active": 0, 2023-09-23T09:49:28.123 INFO:teuthology.orchestra.run.smithi161.stdout: "linger_send": 0, 2023-09-23T09:49:28.123 INFO:teuthology.orchestra.run.smithi161.stdout: "linger_resend": 0, 2023-09-23T09:49:28.123 INFO:teuthology.orchestra.run.smithi161.stdout: "linger_ping": 0, 2023-09-23T09:49:28.123 INFO:teuthology.orchestra.run.smithi161.stdout: "poolop_active": 0, 2023-09-23T09:49:28.123 INFO:teuthology.orchestra.run.smithi161.stdout: "poolop_send": 0, 2023-09-23T09:49:28.123 INFO:teuthology.orchestra.run.smithi161.stdout: "poolop_resend": 0, 2023-09-23T09:49:28.123 INFO:teuthology.orchestra.run.smithi161.stdout: "poolstat_active": 0, 2023-09-23T09:49:28.123 INFO:teuthology.orchestra.run.smithi161.stdout: "poolstat_send": 0, 2023-09-23T09:49:28.123 INFO:teuthology.orchestra.run.smithi161.stdout: "poolstat_resend": 0, 2023-09-23T09:49:28.124 INFO:teuthology.orchestra.run.smithi161.stdout: "statfs_active": 0, 2023-09-23T09:49:28.124 INFO:teuthology.orchestra.run.smithi161.stdout: "statfs_send": 0, 2023-09-23T09:49:28.124 INFO:teuthology.orchestra.run.smithi161.stdout: "statfs_resend": 0, 2023-09-23T09:49:28.124 INFO:teuthology.orchestra.run.smithi161.stdout: "command_active": 0, 2023-09-23T09:49:28.124 INFO:teuthology.orchestra.run.smithi161.stdout: "command_send": 0, 2023-09-23T09:49:28.124 INFO:teuthology.orchestra.run.smithi161.stdout: "command_resend": 0, 2023-09-23T09:49:28.124 INFO:teuthology.orchestra.run.smithi161.stdout: "map_epoch": 181, 2023-09-23T09:49:28.124 INFO:teuthology.orchestra.run.smithi161.stdout: "map_full": 0, 2023-09-23T09:49:28.124 INFO:teuthology.orchestra.run.smithi161.stdout: "map_inc": 95, 2023-09-23T09:49:28.124 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_sessions": 11, 2023-09-23T09:49:28.124 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_session_open": 12, 2023-09-23T09:49:28.124 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_session_close": 1, 2023-09-23T09:49:28.125 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_laggy": 0, 2023-09-23T09:49:28.125 INFO:teuthology.orchestra.run.smithi161.stdout: "omap_wr": 0, 2023-09-23T09:49:28.125 INFO:teuthology.orchestra.run.smithi161.stdout: "omap_rd": 2, 2023-09-23T09:49:28.125 INFO:teuthology.orchestra.run.smithi161.stdout: "omap_del": 0 2023-09-23T09:49:28.125 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:28.125 INFO:teuthology.orchestra.run.smithi161.stdout: "oft": { 2023-09-23T09:49:28.125 INFO:teuthology.orchestra.run.smithi161.stdout: "omap_total_objs": 0, 2023-09-23T09:49:28.125 INFO:teuthology.orchestra.run.smithi161.stdout: "omap_total_kv_pairs": 0, 2023-09-23T09:49:28.125 INFO:teuthology.orchestra.run.smithi161.stdout: "omap_total_updates": 0, 2023-09-23T09:49:28.125 INFO:teuthology.orchestra.run.smithi161.stdout: "omap_total_removes": 0 2023-09-23T09:49:28.125 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:28.125 INFO:teuthology.orchestra.run.smithi161.stdout: "osd-slow-ops": { 2023-09-23T09:49:28.126 INFO:teuthology.orchestra.run.smithi161.stdout: "slow_ops_count": 0 2023-09-23T09:49:28.126 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:28.126 INFO:teuthology.orchestra.run.smithi161.stdout: "purge_queue": { 2023-09-23T09:49:28.126 INFO:teuthology.orchestra.run.smithi161.stdout: "pq_executing_ops": 0, 2023-09-23T09:49:28.126 INFO:teuthology.orchestra.run.smithi161.stdout: "pq_executing_ops_high_water": 0, 2023-09-23T09:49:28.126 INFO:teuthology.orchestra.run.smithi161.stdout: "pq_executing": 0, 2023-09-23T09:49:28.126 INFO:teuthology.orchestra.run.smithi161.stdout: "pq_executing_high_water": 0, 2023-09-23T09:49:28.126 INFO:teuthology.orchestra.run.smithi161.stdout: "pq_executed": 0, 2023-09-23T09:49:28.126 INFO:teuthology.orchestra.run.smithi161.stdout: "pq_item_in_journal": 0 2023-09-23T09:49:28.126 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:28.127 INFO:teuthology.orchestra.run.smithi161.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-09-23T09:49:28.127 INFO:teuthology.orchestra.run.smithi161.stdout: "val": 0, 2023-09-23T09:49:28.127 INFO:teuthology.orchestra.run.smithi161.stdout: "max": 104857600, 2023-09-23T09:49:28.127 INFO:teuthology.orchestra.run.smithi161.stdout: "get_started": 0, 2023-09-23T09:49:28.127 INFO:teuthology.orchestra.run.smithi161.stdout: "get": 12317, 2023-09-23T09:49:28.127 INFO:teuthology.orchestra.run.smithi161.stdout: "get_sum": 301847000, 2023-09-23T09:49:28.127 INFO:teuthology.orchestra.run.smithi161.stdout: "get_or_fail_fail": 0, 2023-09-23T09:49:28.127 INFO:teuthology.orchestra.run.smithi161.stdout: "get_or_fail_success": 12317, 2023-09-23T09:49:28.127 INFO:teuthology.orchestra.run.smithi161.stdout: "take": 0, 2023-09-23T09:49:28.127 INFO:teuthology.orchestra.run.smithi161.stdout: "take_sum": 0, 2023-09-23T09:49:28.127 INFO:teuthology.orchestra.run.smithi161.stdout: "put": 12317, 2023-09-23T09:49:28.127 INFO:teuthology.orchestra.run.smithi161.stdout: "put_sum": 301847000, 2023-09-23T09:49:28.128 INFO:teuthology.orchestra.run.smithi161.stdout: "wait": { 2023-09-23T09:49:28.128 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:28.128 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:28.128 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:28.128 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-09-23T09:49:28.128 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:28.128 INFO:teuthology.orchestra.run.smithi161.stdout: "throttle-objecter_bytes": { 2023-09-23T09:49:28.128 INFO:teuthology.orchestra.run.smithi161.stdout: "val": 0, 2023-09-23T09:49:28.128 INFO:teuthology.orchestra.run.smithi161.stdout: "max": 104857600, 2023-09-23T09:49:28.128 INFO:teuthology.orchestra.run.smithi161.stdout: "get_started": 0, 2023-09-23T09:49:28.128 INFO:teuthology.orchestra.run.smithi161.stdout: "get": 0, 2023-09-23T09:49:28.128 INFO:teuthology.orchestra.run.smithi161.stdout: "get_sum": 0, 2023-09-23T09:49:28.128 INFO:teuthology.orchestra.run.smithi161.stdout: "get_or_fail_fail": 0, 2023-09-23T09:49:28.129 INFO:teuthology.orchestra.run.smithi161.stdout: "get_or_fail_success": 0, 2023-09-23T09:49:28.129 INFO:teuthology.orchestra.run.smithi161.stdout: "take": 11207, 2023-09-23T09:49:28.129 INFO:teuthology.orchestra.run.smithi161.stdout: "take_sum": 297288125, 2023-09-23T09:49:28.129 INFO:teuthology.orchestra.run.smithi161.stdout: "put": 11207, 2023-09-23T09:49:28.129 INFO:teuthology.orchestra.run.smithi161.stdout: "put_sum": 297288125, 2023-09-23T09:49:28.129 INFO:teuthology.orchestra.run.smithi161.stdout: "wait": { 2023-09-23T09:49:28.129 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:28.129 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:28.129 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:28.129 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-09-23T09:49:28.129 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:28.129 INFO:teuthology.orchestra.run.smithi161.stdout: "throttle-objecter_ops": { 2023-09-23T09:49:28.130 INFO:teuthology.orchestra.run.smithi161.stdout: "val": 0, 2023-09-23T09:49:28.130 INFO:teuthology.orchestra.run.smithi161.stdout: "max": 1024, 2023-09-23T09:49:28.130 INFO:teuthology.orchestra.run.smithi161.stdout: "get_started": 0, 2023-09-23T09:49:28.130 INFO:teuthology.orchestra.run.smithi161.stdout: "get": 0, 2023-09-23T09:49:28.130 INFO:teuthology.orchestra.run.smithi161.stdout: "get_sum": 0, 2023-09-23T09:49:28.130 INFO:teuthology.orchestra.run.smithi161.stdout: "get_or_fail_fail": 0, 2023-09-23T09:49:28.130 INFO:teuthology.orchestra.run.smithi161.stdout: "get_or_fail_success": 0, 2023-09-23T09:49:28.130 INFO:teuthology.orchestra.run.smithi161.stdout: "take": 11207, 2023-09-23T09:49:28.130 INFO:teuthology.orchestra.run.smithi161.stdout: "take_sum": 11207, 2023-09-23T09:49:28.130 INFO:teuthology.orchestra.run.smithi161.stdout: "put": 11207, 2023-09-23T09:49:28.130 INFO:teuthology.orchestra.run.smithi161.stdout: "put_sum": 11207, 2023-09-23T09:49:28.130 INFO:teuthology.orchestra.run.smithi161.stdout: "wait": { 2023-09-23T09:49:28.131 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:28.131 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:28.131 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:28.131 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-09-23T09:49:28.131 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:28.131 INFO:teuthology.orchestra.run.smithi161.stdout: "throttle-write_buf_throttle": { 2023-09-23T09:49:28.131 INFO:teuthology.orchestra.run.smithi161.stdout: "val": 0, 2023-09-23T09:49:28.131 INFO:teuthology.orchestra.run.smithi161.stdout: "max": 3758096384, 2023-09-23T09:49:28.131 INFO:teuthology.orchestra.run.smithi161.stdout: "get_started": 0, 2023-09-23T09:49:28.131 INFO:teuthology.orchestra.run.smithi161.stdout: "get": 0, 2023-09-23T09:49:28.131 INFO:teuthology.orchestra.run.smithi161.stdout: "get_sum": 0, 2023-09-23T09:49:28.131 INFO:teuthology.orchestra.run.smithi161.stdout: "get_or_fail_fail": 0, 2023-09-23T09:49:28.132 INFO:teuthology.orchestra.run.smithi161.stdout: "get_or_fail_success": 0, 2023-09-23T09:49:28.132 INFO:teuthology.orchestra.run.smithi161.stdout: "take": 0, 2023-09-23T09:49:28.132 INFO:teuthology.orchestra.run.smithi161.stdout: "take_sum": 0, 2023-09-23T09:49:28.132 INFO:teuthology.orchestra.run.smithi161.stdout: "put": 0, 2023-09-23T09:49:28.132 INFO:teuthology.orchestra.run.smithi161.stdout: "put_sum": 0, 2023-09-23T09:49:28.132 INFO:teuthology.orchestra.run.smithi161.stdout: "wait": { 2023-09-23T09:49:28.132 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:28.132 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:28.132 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:28.132 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-09-23T09:49:28.132 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-09-23T09:49:28.132 INFO:teuthology.orchestra.run.smithi161.stdout: "throttle-write_buf_throttle-0x5564a3a78a00": { 2023-09-23T09:49:28.133 INFO:teuthology.orchestra.run.smithi161.stdout: "val": 0, 2023-09-23T09:49:28.133 INFO:teuthology.orchestra.run.smithi161.stdout: "max": 3758096384, 2023-09-23T09:49:28.133 INFO:teuthology.orchestra.run.smithi161.stdout: "get_started": 0, 2023-09-23T09:49:28.133 INFO:teuthology.orchestra.run.smithi161.stdout: "get": 0, 2023-09-23T09:49:28.133 INFO:teuthology.orchestra.run.smithi161.stdout: "get_sum": 0, 2023-09-23T09:49:28.133 INFO:teuthology.orchestra.run.smithi161.stdout: "get_or_fail_fail": 0, 2023-09-23T09:49:28.133 INFO:teuthology.orchestra.run.smithi161.stdout: "get_or_fail_success": 0, 2023-09-23T09:49:28.133 INFO:teuthology.orchestra.run.smithi161.stdout: "take": 0, 2023-09-23T09:49:28.133 INFO:teuthology.orchestra.run.smithi161.stdout: "take_sum": 0, 2023-09-23T09:49:28.133 INFO:teuthology.orchestra.run.smithi161.stdout: "put": 0, 2023-09-23T09:49:28.133 INFO:teuthology.orchestra.run.smithi161.stdout: "put_sum": 0, 2023-09-23T09:49:28.133 INFO:teuthology.orchestra.run.smithi161.stdout: "wait": { 2023-09-23T09:49:28.134 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2023-09-23T09:49:28.134 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2023-09-23T09:49:28.134 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2023-09-23T09:49:28.134 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-09-23T09:49:28.134 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-09-23T09:49:28.134 INFO:teuthology.orchestra.run.smithi161.stdout:} 2023-09-23T09:49:28.620 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2023-09-23T09:49:28.621 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2023-09-23T09:49:28.621 INFO:tasks.check_counter:Daemon mds.l mds.root_rsnaps=7 2023-09-23T09:49:28.621 INFO:tasks.check_counter:Daemon mds.l mds_server.req_mksnap_latency.avgcount=0 2023-09-23T09:49:28.621 INFO:tasks.check_counter:Daemon mds.l mds_server.req_rmsnap_latency.avgcount=0 2023-09-23T09:49:28.622 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-09-23T09:49:28.635 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-09-23T09:49:28.636 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-09-23T09:49:28.636 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-23T09:49:28.704 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-09-23T09:49:28.704 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-23T09:49:28.792 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-23T09:49:28.810 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:49:28 smithi135 ceph-mon[99205]: pgmap v1672: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-09-23T09:49:28.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:49:28 smithi082 ceph-mon[97694]: pgmap v1672: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-09-23T09:49:28.896 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:49:28 smithi161 ceph-mon[99580]: pgmap v1672: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-09-23T09:49:29.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.036+0000 7f6ac75ff700 1 -- 172.21.15.82:0/218475863 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ac01008a0 msgr2=0x7f6ac0100d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:49:29.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.036+0000 7f6ac75ff700 1 --2- 172.21.15.82:0/218475863 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ac01008a0 0x7f6ac0100d20 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f6ab0009990 tx=0x7f6ab0009ca0 comp rx=0 tx=0).stop 2023-09-23T09:49:29.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.036+0000 7f6ac75ff700 1 -- 172.21.15.82:0/218475863 shutdown_connections 2023-09-23T09:49:29.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.036+0000 7f6ac75ff700 1 --2- 172.21.15.82:0/218475863 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ac0101260 0x7f6ac010d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:49:29.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.036+0000 7f6ac75ff700 1 --2- 172.21.15.82:0/218475863 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ac01068b0 0x7f6ac0106c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:49:29.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.036+0000 7f6ac75ff700 1 --2- 172.21.15.82:0/218475863 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ac01008a0 0x7f6ac0100d20 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:49:29.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.036+0000 7f6ac75ff700 1 -- 172.21.15.82:0/218475863 >> 172.21.15.82:0/218475863 conn(0x7f6ac00fc3d0 msgr2=0x7f6ac00fe7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:49:29.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.036+0000 7f6ac75ff700 1 -- 172.21.15.82:0/218475863 shutdown_connections 2023-09-23T09:49:29.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.036+0000 7f6ac75ff700 1 -- 172.21.15.82:0/218475863 wait complete. 2023-09-23T09:49:29.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.037+0000 7f6ac75ff700 1 Processor -- start 2023-09-23T09:49:29.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.037+0000 7f6ac75ff700 1 -- start start 2023-09-23T09:49:29.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.038+0000 7f6ac75ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ac01008a0 0x7f6ac019c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:49:29.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.038+0000 7f6ac75ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ac0101260 0x7f6ac019cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:49:29.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.038+0000 7f6ac75ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ac01068b0 0x7f6ac01966f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:49:29.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.038+0000 7f6ac75ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac0196d60 con 0x7f6ac01008a0 2023-09-23T09:49:29.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.038+0000 7f6ac75ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac0196ed0 con 0x7f6ac01068b0 2023-09-23T09:49:29.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.038+0000 7f6ac75ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac0197090 con 0x7f6ac0101260 2023-09-23T09:49:29.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.038+0000 7f6ac539b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ac01008a0 0x7f6ac019c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:49:29.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.038+0000 7f6ac539b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ac01008a0 0x7f6ac019c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42064/0 (socket says 172.21.15.82:42064) 2023-09-23T09:49:29.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.038+0000 7f6ac539b700 1 -- 172.21.15.82:0/942707367 learned_addr learned my addr 172.21.15.82:0/942707367 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:49:29.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.038+0000 7f6ac5b9c700 1 --2- 172.21.15.82:0/942707367 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ac01068b0 0x7f6ac01966f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:49:29.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.038+0000 7f6ac4b9a700 1 --2- 172.21.15.82:0/942707367 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ac0101260 0x7f6ac019cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:49:29.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.038+0000 7f6ac539b700 1 -- 172.21.15.82:0/942707367 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ac0101260 msgr2=0x7f6ac019cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:49:29.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.038+0000 7f6ac539b700 1 --2- 172.21.15.82:0/942707367 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ac0101260 0x7f6ac019cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:49:29.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.038+0000 7f6ac539b700 1 -- 172.21.15.82:0/942707367 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ac01068b0 msgr2=0x7f6ac01966f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:49:29.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.038+0000 7f6ac539b700 1 --2- 172.21.15.82:0/942707367 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ac01068b0 0x7f6ac01966f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:49:29.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.038+0000 7f6ac539b700 1 -- 172.21.15.82:0/942707367 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ab00095f0 con 0x7f6ac01008a0 2023-09-23T09:49:29.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.038+0000 7f6ac4b9a700 1 --2- 172.21.15.82:0/942707367 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ac0101260 0x7f6ac019cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-23T09:49:29.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.039+0000 7f6ac539b700 1 --2- 172.21.15.82:0/942707367 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ac01008a0 0x7f6ac019c680 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f6abc00d950 tx=0x7f6abc00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:49:29.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.039+0000 7f6ab67fc700 1 -- 172.21.15.82:0/942707367 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6abc009940 con 0x7f6ac01008a0 2023-09-23T09:49:29.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.039+0000 7f6ab67fc700 1 -- 172.21.15.82:0/942707367 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6abc010460 con 0x7f6ac01008a0 2023-09-23T09:49:29.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.039+0000 7f6ac75ff700 1 -- 172.21.15.82:0/942707367 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ac0197370 con 0x7f6ac01008a0 2023-09-23T09:49:29.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.039+0000 7f6ab67fc700 1 -- 172.21.15.82:0/942707367 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6abc00f620 con 0x7f6ac01008a0 2023-09-23T09:49:29.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.039+0000 7f6ac75ff700 1 -- 172.21.15.82:0/942707367 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ac01a3670 con 0x7f6ac01008a0 2023-09-23T09:49:29.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.040+0000 7f6ac75ff700 1 -- 172.21.15.82:0/942707367 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ac0067710 con 0x7f6ac01008a0 2023-09-23T09:49:29.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.042+0000 7f6ab67fc700 1 -- 172.21.15.82:0/942707367 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f6abc0105d0 con 0x7f6ac01008a0 2023-09-23T09:49:29.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.043+0000 7f6ab67fc700 1 --2- 172.21.15.82:0/942707367 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f6aac0a0100 0x7f6aac0a25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:49:29.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.043+0000 7f6ab67fc700 1 -- 172.21.15.82:0/942707367 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f6abc0cb450 con 0x7f6ac01008a0 2023-09-23T09:49:29.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.043+0000 7f6ac4b9a700 1 --2- 172.21.15.82:0/942707367 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f6aac0a0100 0x7f6aac0a25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:49:29.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.044+0000 7f6ac4b9a700 1 --2- 172.21.15.82:0/942707367 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f6aac0a0100 0x7f6aac0a25c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f6ab0000c00 tx=0x7f6ab0005fb0 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:49:29.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.047+0000 7f6ab67fc700 1 -- 172.21.15.82:0/942707367 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f6abc094e40 con 0x7f6ac01008a0 2023-09-23T09:49:29.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.247+0000 7f6ac75ff700 1 -- 172.21.15.82:0/942707367 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6ac0110870 con 0x7f6ac01008a0 2023-09-23T09:49:29.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.249+0000 7f6ab67fc700 1 -- 172.21.15.82:0/942707367 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v181) v1 ==== 74+0+22982 (secure 0 0 0) 0x7f6abc098460 con 0x7f6ac01008a0 2023-09-23T09:49:29.251 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T09:49:29.251 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":181,"fsid":"8926e286-59ed-11ee-8db4-212e2dc638e7","created":"2023-09-23T08:46:16.628057+0000","modified":"2023-09-23T09:49:17.498968+0000","last_up_change":"2023-09-23T08:53:56.524694+0000","last_in_change":"2023-09-23T08:53:35.779183+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-23T08:50:00.571063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-23T08:54:50.558630+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-23T08:54:52.055291+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"180","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":100,"snap_epoch":180,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7384c1ff-8c71-4feb-8cef-ba45c2a1708a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":892441948},{"type":"v1","addr":"172.21.15.82:6803","nonce":892441948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":892441948},{"type":"v1","addr":"172.21.15.82:6805","nonce":892441948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":892441948},{"type":"v1","addr":"172.21.15.82:6809","nonce":892441948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":892441948},{"type":"v1","addr":"172.21.15.82:6807","nonce":892441948}]},"public_addr":"172.21.15.82:6803/892441948","cluster_addr":"172.21.15.82:6805/892441948","heartbeat_back_addr":"172.21.15.82:6809/892441948","heartbeat_front_addr":"172.21.15.82:6807/892441948","state":["exists","up"]},{"osd":1,"uuid":"ca62333e-15db-4556-a9ed-8820f9268766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3224546922},{"type":"v1","addr":"172.21.15.135:6801","nonce":3224546922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3224546922},{"type":"v1","addr":"172.21.15.135:6803","nonce":3224546922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3224546922},{"type":"v1","addr":"172.21.15.135:6807","nonce":3224546922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3224546922},{"type":"v1","addr":"172.21.15.135:6805","nonce":3224546922}]},"public_addr":"172.21.15.135:6801/3224546922","cluster_addr":"172.21.15.135:6803/3224546922","heartbeat_back_addr":"172.21.15.135:6807/3224546922","heartbeat_front_addr":"172.21.15.135:6805/3224546922","state":["exists","up"]},{"osd":2,"uuid":"ac23eb38-216a-44f0-b316-a509b23745f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2358373459},{"type":"v1","addr":"172.21.15.161:6801","nonce":2358373459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2358373459},{"type":"v1","addr":"172.21.15.161:6803","nonce":2358373459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2358373459},{"type":"v1","addr":"172.21.15.161:6807","nonce":2358373459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2358373459},{"type":"v1","addr":"172.21.15.161:6805","nonce":2358373459}]},"public_addr":"172.21.15.161:6801/2358373459","cluster_addr":"172.21.15.161:6803/2358373459","heartbeat_back_addr":"172.21.15.161:6807/2358373459","heartbeat_front_addr":"172.21.15.161:6805/2358373459","state":["exists","up"]},{"osd":3,"uuid":"701c96b0-30fb-46ce-917d-e02d3814dc3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":1081464528},{"type":"v1","addr":"172.21.15.82:6811","nonce":1081464528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1081464528},{"type":"v1","addr":"172.21.15.82:6813","nonce":1081464528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1081464528},{"type":"v1","addr":"172.21.15.82:6817","nonce":1081464528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":1081464528},{"type":"v1","addr":"172.21.15.82:6815","nonce":1081464528}]},"public_addr":"172.21.15.82:6811/1081464528","cluster_addr":"172.21.15.82:6813/1081464528","heartbeat_back_addr":"172.21.15.82:6817/1081464528","heartbeat_front_addr":"172.21.15.82:6815/1081464528","state":["exists","up"]},{"osd":4,"uuid":"c618d2a2-3616-41b2-943c-7a4616538e13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2346495509},{"type":"v1","addr":"172.21.15.135:6809","nonce":2346495509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2346495509},{"type":"v1","addr":"172.21.15.135:6811","nonce":2346495509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2346495509},{"type":"v1","addr":"172.21.15.135:6815","nonce":2346495509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2346495509},{"type":"v1","addr":"172.21.15.135:6813","nonce":2346495509}]},"public_addr":"172.21.15.135:6809/2346495509","cluster_addr":"172.21.15.135:6811/2346495509","heartbeat_back_addr":"172.21.15.135:6815/2346495509","heartbeat_front_addr":"172.21.15.135:6813/2346495509","state":["exists","up"]},{"osd":5,"uuid":"8e1dda3d-6927-495d-b20d-78b03bb75d5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1252638628},{"type":"v1","addr":"172.21.15.161:6809","nonce":1252638628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1252638628},{"type":"v1","addr":"172.21.15.161:6811","nonce":1252638628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1252638628},{"type":"v1","addr":"172.21.15.161:6815","nonce":1252638628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1252638628},{"type":"v1","addr":"172.21.15.161:6813","nonce":1252638628}]},"public_addr":"172.21.15.161:6809/1252638628","cluster_addr":"172.21.15.161:6811/1252638628","heartbeat_back_addr":"172.21.15.161:6815/1252638628","heartbeat_front_addr":"172.21.15.161:6813/1252638628","state":["exists","up"]},{"osd":6,"uuid":"50b31960-6bc4-44e1-8116-3106bf161e56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1052038408},{"type":"v1","addr":"172.21.15.82:6819","nonce":1052038408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1052038408},{"type":"v1","addr":"172.21.15.82:6821","nonce":1052038408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":1052038408},{"type":"v1","addr":"172.21.15.82:6825","nonce":1052038408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1052038408},{"type":"v1","addr":"172.21.15.82:6823","nonce":1052038408}]},"public_addr":"172.21.15.82:6819/1052038408","cluster_addr":"172.21.15.82:6821/1052038408","heartbeat_back_addr":"172.21.15.82:6825/1052038408","heartbeat_front_addr":"172.21.15.82:6823/1052038408","state":["exists","up"]},{"osd":7,"uuid":"425ca0ee-57f7-4b27-90fb-d86bb5db5480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3683951498},{"type":"v1","addr":"172.21.15.135:6817","nonce":3683951498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":3683951498},{"type":"v1","addr":"172.21.15.135:6819","nonce":3683951498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":3683951498},{"type":"v1","addr":"172.21.15.135:6823","nonce":3683951498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":3683951498},{"type":"v1","addr":"172.21.15.135:6821","nonce":3683951498}]},"public_addr":"172.21.15.135:6817/3683951498","cluster_addr":"172.21.15.135:6819/3683951498","heartbeat_back_addr":"172.21.15.135:6823/3683951498","heartbeat_front_addr":"172.21.15.135:6821/3683951498","state":["exists","up"]},{"osd":8,"uuid":"1115c837-bef6-4bad-9974-4d913198511b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":948521536},{"type":"v1","addr":"172.21.15.161:6817","nonce":948521536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":948521536},{"type":"v1","addr":"172.21.15.161:6819","nonce":948521536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":948521536},{"type":"v1","addr":"172.21.15.161:6823","nonce":948521536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":948521536},{"type":"v1","addr":"172.21.15.161:6821","nonce":948521536}]},"public_addr":"172.21.15.161:6817/948521536","cluster_addr":"172.21.15.161:6819/948521536","heartbeat_back_addr":"172.21.15.161:6823/948521536","heartbeat_front_addr":"172.21.15.161:6821/948521536","state":["exists","up"]},{"osd":9,"uuid":"c52ec819-4bc6-402f-9cd8-62539e519e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":1438762840},{"type":"v1","addr":"172.21.15.82:6827","nonce":1438762840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":1438762840},{"type":"v1","addr":"172.21.15.82:6829","nonce":1438762840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1438762840},{"type":"v1","addr":"172.21.15.82:6833","nonce":1438762840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1438762840},{"type":"v1","addr":"172.21.15.82:6831","nonce":1438762840}]},"public_addr":"172.21.15.82:6827/1438762840","cluster_addr":"172.21.15.82:6829/1438762840","heartbeat_back_addr":"172.21.15.82:6833/1438762840","heartbeat_front_addr":"172.21.15.82:6831/1438762840","state":["exists","up"]},{"osd":10,"uuid":"1b16c795-1b91-4d46-ae5d-21b8332c1077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2853697851},{"type":"v1","addr":"172.21.15.135:6825","nonce":2853697851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2853697851},{"type":"v1","addr":"172.21.15.135:6827","nonce":2853697851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2853697851},{"type":"v1","addr":"172.21.15.135:6831","nonce":2853697851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2853697851},{"type":"v1","addr":"172.21.15.135:6829","nonce":2853697851}]},"public_addr":"172.21.15.135:6825/2853697851","cluster_addr":"172.21.15.135:6827/2853697851","heartbeat_back_addr":"172.21.15.135:6831/2853697851","heartbeat_front_addr":"172.21.15.135:6829/2853697851","state":["exists","up"]},{"osd":11,"uuid":"2551e602-4fe1-41cb-9b7d-c8b31fdd1487","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":1459332081},{"type":"v1","addr":"172.21.15.161:6825","nonce":1459332081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":1459332081},{"type":"v1","addr":"172.21.15.161:6827","nonce":1459332081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":1459332081},{"type":"v1","addr":"172.21.15.161:6831","nonce":1459332081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":1459332081},{"type":"v1","addr":"172.21.15.161:6829","nonce":1459332081}]},"public_addr":"172.21.15.161:6825/1459332081","cluster_addr":"172.21.15.161:6827/1459332081","heartbeat_back_addr":"172.21.15.161:6831/1459332081","heartbeat_front_addr":"172.21.15.161:6829/1459332081","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:49:04.007679+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:49:30.702365+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:49:56.785248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:50:22.988516+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:50:49.347055+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:51:15.830145+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:51:41.986377+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:52:08.218893+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:52:34.847450+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:53:01.317134+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:53:27.981691+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:53:54.849245+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/1769657494":"2023-09-24T08:56:53.091759+0000","172.21.15.82:6801/3698954311":"2023-09-24T08:56:53.091759+0000","172.21.15.82:0/4204712132":"2023-09-24T08:47:21.957866+0000","172.21.15.82:0/2391800294":"2023-09-24T08:56:53.091759+0000","172.21.15.82:6801/2733521564":"2023-09-24T08:47:21.957866+0000","172.21.15.82:6800/2733521564":"2023-09-24T08:47:21.957866+0000","172.21.15.82:0/3964794665":"2023-09-24T08:47:21.957866+0000","172.21.15.82:0/3535372205":"2023-09-24T08:46:55.187024+0000","172.21.15.82:6800/3698954311":"2023-09-24T08:56:53.091759+0000","172.21.15.82:0/285559684":"2023-09-24T08:46:55.187024+0000","172.21.15.82:0/1232294461":"2023-09-24T08:56:53.091759+0000","172.21.15.82:0/1335891896":"2023-09-24T08:46:55.187024+0000","172.21.15.82:6801/3761509623":"2023-09-24T08:46:55.187024+0000","172.21.15.82:6800/3761509623":"2023-09-24T08:46:55.187024+0000","172.21.15.82:0/3074646956":"2023-09-24T08:56:53.091759+0000","172.21.15.82:0/3775317005":"2023-09-24T08:47:21.957866+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":87,"length":1},{"begin":100,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-23T09:49:29.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.251+0000 7f6ac75ff700 1 -- 172.21.15.82:0/942707367 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f6aac0a0100 msgr2=0x7f6aac0a25c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:49:29.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.251+0000 7f6ac75ff700 1 --2- 172.21.15.82:0/942707367 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f6aac0a0100 0x7f6aac0a25c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f6ab0000c00 tx=0x7f6ab0005fb0 comp rx=0 tx=0).stop 2023-09-23T09:49:29.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.251+0000 7f6ac75ff700 1 -- 172.21.15.82:0/942707367 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ac01008a0 msgr2=0x7f6ac019c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:49:29.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.251+0000 7f6ac75ff700 1 --2- 172.21.15.82:0/942707367 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ac01008a0 0x7f6ac019c680 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f6abc00d950 tx=0x7f6abc00dc60 comp rx=0 tx=0).stop 2023-09-23T09:49:29.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.251+0000 7f6ac75ff700 1 -- 172.21.15.82:0/942707367 shutdown_connections 2023-09-23T09:49:29.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.251+0000 7f6ac75ff700 1 --2- 172.21.15.82:0/942707367 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f6aac0a0100 0x7f6aac0a25c0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:49:29.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.251+0000 7f6ac75ff700 1 --2- 172.21.15.82:0/942707367 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ac01068b0 0x7f6ac01966f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:49:29.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.251+0000 7f6ac75ff700 1 --2- 172.21.15.82:0/942707367 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ac01008a0 0x7f6ac019c680 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:49:29.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.251+0000 7f6ac75ff700 1 --2- 172.21.15.82:0/942707367 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ac0101260 0x7f6ac019cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:49:29.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.251+0000 7f6ac75ff700 1 -- 172.21.15.82:0/942707367 >> 172.21.15.82:0/942707367 conn(0x7f6ac00fc3d0 msgr2=0x7f6ac00fca20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:49:29.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.251+0000 7f6ac75ff700 1 -- 172.21.15.82:0/942707367 shutdown_connections 2023-09-23T09:49:29.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.251+0000 7f6ac75ff700 1 -- 172.21.15.82:0/942707367 wait complete. 2023-09-23T09:49:29.272 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-23T08:50:00.571063+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-23T08:54:50.558630+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-23T08:54:52.055291+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '180', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 100, 'snap_epoch': 180, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-23T09:49:29.273 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-23T09:49:29.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.511+0000 7f36351ff700 1 -- 172.21.15.82:0/1194677447 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f363010d0d0 msgr2=0x7f363010f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:49:29.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.511+0000 7f36351ff700 1 --2- 172.21.15.82:0/1194677447 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f363010d0d0 0x7f363010f540 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f362800b0a0 tx=0x7f362800b3b0 comp rx=0 tx=0).stop 2023-09-23T09:49:29.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.511+0000 7f36351ff700 1 -- 172.21.15.82:0/1194677447 shutdown_connections 2023-09-23T09:49:29.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.511+0000 7f36351ff700 1 --2- 172.21.15.82:0/1194677447 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f363010d0d0 0x7f363010f540 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:49:29.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.511+0000 7f36351ff700 1 --2- 172.21.15.82:0/1194677447 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3630072d50 0x7f3630073130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:49:29.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.511+0000 7f36351ff700 1 --2- 172.21.15.82:0/1194677447 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3630073670 0x7f363010cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:49:29.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.511+0000 7f36351ff700 1 -- 172.21.15.82:0/1194677447 >> 172.21.15.82:0/1194677447 conn(0x7f36300fc380 msgr2=0x7f36300fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:49:29.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.511+0000 7f36351ff700 1 -- 172.21.15.82:0/1194677447 shutdown_connections 2023-09-23T09:49:29.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.511+0000 7f36351ff700 1 -- 172.21.15.82:0/1194677447 wait complete. 2023-09-23T09:49:29.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.512+0000 7f36351ff700 1 Processor -- start 2023-09-23T09:49:29.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.513+0000 7f36351ff700 1 -- start start 2023-09-23T09:49:29.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.513+0000 7f36351ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3630072d50 0x7f3630198cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:49:29.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.513+0000 7f36351ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3630073670 0x7f36301991f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:49:29.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.513+0000 7f36351ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f363010d0d0 0x7f363019c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:49:29.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.513+0000 7f36351ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f363019cba0 con 0x7f3630073670 2023-09-23T09:49:29.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.513+0000 7f36351ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f363019cd10 con 0x7f363010d0d0 2023-09-23T09:49:29.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.513+0000 7f36351ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f363019ced0 con 0x7f3630072d50 2023-09-23T09:49:29.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.513+0000 7f362e59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3630073670 0x7f36301991f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:49:29.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.513+0000 7f362e59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3630073670 0x7f36301991f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42078/0 (socket says 172.21.15.82:42078) 2023-09-23T09:49:29.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.513+0000 7f362e59c700 1 -- 172.21.15.82:0/2035634519 learned_addr learned my addr 172.21.15.82:0/2035634519 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:49:29.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.513+0000 7f362f59e700 1 --2- 172.21.15.82:0/2035634519 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f363010d0d0 0x7f363019c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:49:29.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.513+0000 7f362ed9d700 1 --2- 172.21.15.82:0/2035634519 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3630072d50 0x7f3630198cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:49:29.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.514+0000 7f362e59c700 1 -- 172.21.15.82:0/2035634519 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3630072d50 msgr2=0x7f3630198cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:49:29.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.514+0000 7f362e59c700 1 --2- 172.21.15.82:0/2035634519 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3630072d50 0x7f3630198cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:49:29.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.514+0000 7f362e59c700 1 -- 172.21.15.82:0/2035634519 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f363010d0d0 msgr2=0x7f363019c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:49:29.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.514+0000 7f362e59c700 1 --2- 172.21.15.82:0/2035634519 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f363010d0d0 0x7f363019c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:49:29.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.514+0000 7f362e59c700 1 -- 172.21.15.82:0/2035634519 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3628009d00 con 0x7f3630073670 2023-09-23T09:49:29.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.514+0000 7f362f59e700 1 --2- 172.21.15.82:0/2035634519 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f363010d0d0 0x7f363019c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:49:29.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.514+0000 7f362e59c700 1 --2- 172.21.15.82:0/2035634519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3630073670 0x7f36301991f0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f362400e9a0 tx=0x7f362400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:49:29.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.518+0000 7f3617fff700 1 -- 172.21.15.82:0/2035634519 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3624009790 con 0x7f3630073670 2023-09-23T09:49:29.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.518+0000 7f3617fff700 1 -- 172.21.15.82:0/2035634519 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3624010430 con 0x7f3630073670 2023-09-23T09:49:29.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.518+0000 7f36351ff700 1 -- 172.21.15.82:0/2035634519 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f363019d1b0 con 0x7f3630073670 2023-09-23T09:49:29.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.518+0000 7f3617fff700 1 -- 172.21.15.82:0/2035634519 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f362400cea0 con 0x7f3630073670 2023-09-23T09:49:29.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.519+0000 7f36351ff700 1 -- 172.21.15.82:0/2035634519 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36301a5b10 con 0x7f3630073670 2023-09-23T09:49:29.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.520+0000 7f36351ff700 1 -- 172.21.15.82:0/2035634519 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36300676a0 con 0x7f3630073670 2023-09-23T09:49:29.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.521+0000 7f3617fff700 1 -- 172.21.15.82:0/2035634519 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f36240105a0 con 0x7f3630073670 2023-09-23T09:49:29.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.524+0000 7f3617fff700 1 --2- 172.21.15.82:0/2035634519 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f36180a0140 0x7f36180a2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:49:29.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.524+0000 7f3617fff700 1 -- 172.21.15.82:0/2035634519 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f3624014070 con 0x7f3630073670 2023-09-23T09:49:29.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.524+0000 7f362ed9d700 1 --2- 172.21.15.82:0/2035634519 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f36180a0140 0x7f36180a2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:49:29.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.524+0000 7f362ed9d700 1 --2- 172.21.15.82:0/2035634519 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f36180a0140 0x7f36180a2600 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f3620005950 tx=0x7f362000b410 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:49:29.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.528+0000 7f3617fff700 1 -- 172.21.15.82:0/2035634519 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f3624051e00 con 0x7f3630073670 2023-09-23T09:49:29.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:49:29 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/942707367' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-23T09:49:29.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.731+0000 7f36351ff700 1 -- 172.21.15.82:0/2035634519 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f36301128f0 con 0x7f3630073670 2023-09-23T09:49:29.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.731+0000 7f3617fff700 1 -- 172.21.15.82:0/2035634519 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v181) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3624095120 con 0x7f3630073670 2023-09-23T09:49:29.733 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-09-23T09:49:29.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.734+0000 7f36351ff700 1 -- 172.21.15.82:0/2035634519 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f36180a0140 msgr2=0x7f36180a2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:49:29.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.734+0000 7f36351ff700 1 --2- 172.21.15.82:0/2035634519 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f36180a0140 0x7f36180a2600 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f3620005950 tx=0x7f362000b410 comp rx=0 tx=0).stop 2023-09-23T09:49:29.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.734+0000 7f36351ff700 1 -- 172.21.15.82:0/2035634519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3630073670 msgr2=0x7f36301991f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:49:29.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.734+0000 7f36351ff700 1 --2- 172.21.15.82:0/2035634519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3630073670 0x7f36301991f0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f362400e9a0 tx=0x7f362400ecb0 comp rx=0 tx=0).stop 2023-09-23T09:49:29.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.734+0000 7f36351ff700 1 -- 172.21.15.82:0/2035634519 shutdown_connections 2023-09-23T09:49:29.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.734+0000 7f36351ff700 1 --2- 172.21.15.82:0/2035634519 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f36180a0140 0x7f36180a2600 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:49:29.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.734+0000 7f36351ff700 1 --2- 172.21.15.82:0/2035634519 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f363010d0d0 0x7f363019c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:49:29.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.734+0000 7f36351ff700 1 --2- 172.21.15.82:0/2035634519 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3630072d50 0x7f3630198cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:49:29.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.734+0000 7f36351ff700 1 --2- 172.21.15.82:0/2035634519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3630073670 0x7f36301991f0 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:49:29.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.734+0000 7f36351ff700 1 -- 172.21.15.82:0/2035634519 >> 172.21.15.82:0/2035634519 conn(0x7f36300fc380 msgr2=0x7f363010f2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:49:29.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.734+0000 7f36351ff700 1 -- 172.21.15.82:0/2035634519 shutdown_connections 2023-09-23T09:49:29.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.734+0000 7f36351ff700 1 -- 172.21.15.82:0/2035634519 wait complete. 2023-09-23T09:49:29.754 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-23T09:49:29.810 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:49:29 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/942707367' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-23T09:49:29.896 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:49:29 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/942707367' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-23T09:49:29.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.953+0000 7fd6757ff700 1 -- 172.21.15.82:0/1686362213 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd670100890 msgr2=0x7fd670100d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:49:29.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.953+0000 7fd6757ff700 1 --2- 172.21.15.82:0/1686362213 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd670100890 0x7fd670100d10 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fd664009990 tx=0x7fd664009ca0 comp rx=0 tx=0).stop 2023-09-23T09:49:29.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.953+0000 7fd6757ff700 1 -- 172.21.15.82:0/1686362213 shutdown_connections 2023-09-23T09:49:29.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.953+0000 7fd6757ff700 1 --2- 172.21.15.82:0/1686362213 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd670101250 0x7fd67010d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:49:29.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.953+0000 7fd6757ff700 1 --2- 172.21.15.82:0/1686362213 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6701068a0 0x7fd670106c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:49:29.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.953+0000 7fd6757ff700 1 --2- 172.21.15.82:0/1686362213 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd670100890 0x7fd670100d10 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:49:29.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.953+0000 7fd6757ff700 1 -- 172.21.15.82:0/1686362213 >> 172.21.15.82:0/1686362213 conn(0x7fd6700fc380 msgr2=0x7fd6700fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:49:29.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.953+0000 7fd6757ff700 1 -- 172.21.15.82:0/1686362213 shutdown_connections 2023-09-23T09:49:29.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.953+0000 7fd6757ff700 1 -- 172.21.15.82:0/1686362213 wait complete. 2023-09-23T09:49:29.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.954+0000 7fd6757ff700 1 Processor -- start 2023-09-23T09:49:29.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.954+0000 7fd6757ff700 1 -- start start 2023-09-23T09:49:29.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.954+0000 7fd6757ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd670100890 0x7fd67019c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:49:29.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.954+0000 7fd6757ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd670101250 0x7fd67019cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:49:29.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.954+0000 7fd6757ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6701068a0 0x7fd6701966e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:49:29.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.954+0000 7fd6757ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd670196d50 con 0x7fd670100890 2023-09-23T09:49:29.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.954+0000 7fd6757ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd670196ec0 con 0x7fd670101250 2023-09-23T09:49:29.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.954+0000 7fd6757ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd670197080 con 0x7fd6701068a0 2023-09-23T09:49:29.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.955+0000 7fd66effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd670100890 0x7fd67019c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:49:29.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.955+0000 7fd66e7fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd670101250 0x7fd67019cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:49:29.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.955+0000 7fd66e7fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd670101250 0x7fd67019cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:35134/0 (socket says 172.21.15.82:35134) 2023-09-23T09:49:29.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.955+0000 7fd66e7fc700 1 -- 172.21.15.82:0/3678467134 learned_addr learned my addr 172.21.15.82:0/3678467134 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:49:29.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.955+0000 7fd66f7fe700 1 --2- 172.21.15.82:0/3678467134 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6701068a0 0x7fd6701966e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:49:29.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.955+0000 7fd66effd700 1 -- 172.21.15.82:0/3678467134 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6701068a0 msgr2=0x7fd6701966e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:49:29.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.955+0000 7fd66effd700 1 --2- 172.21.15.82:0/3678467134 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6701068a0 0x7fd6701966e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:49:29.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.955+0000 7fd66effd700 1 -- 172.21.15.82:0/3678467134 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd670101250 msgr2=0x7fd67019cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:49:29.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.955+0000 7fd66effd700 1 --2- 172.21.15.82:0/3678467134 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd670101250 0x7fd67019cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:49:29.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.955+0000 7fd66effd700 1 -- 172.21.15.82:0/3678467134 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd668009c40 con 0x7fd670100890 2023-09-23T09:49:29.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.955+0000 7fd66e7fc700 1 --2- 172.21.15.82:0/3678467134 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd670101250 0x7fd67019cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:49:29.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.955+0000 7fd66f7fe700 1 --2- 172.21.15.82:0/3678467134 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6701068a0 0x7fd6701966e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:49:29.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.955+0000 7fd66effd700 1 --2- 172.21.15.82:0/3678467134 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd670100890 0x7fd67019c670 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fd66000d950 tx=0x7fd66000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:49:29.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.956+0000 7fd657fff700 1 -- 172.21.15.82:0/3678467134 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd660009930 con 0x7fd670100890 2023-09-23T09:49:29.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.956+0000 7fd657fff700 1 -- 172.21.15.82:0/3678467134 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd660010460 con 0x7fd670100890 2023-09-23T09:49:29.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.956+0000 7fd6757ff700 1 -- 172.21.15.82:0/3678467134 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6640095f0 con 0x7fd670100890 2023-09-23T09:49:29.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.956+0000 7fd657fff700 1 -- 172.21.15.82:0/3678467134 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd66000b5d0 con 0x7fd670100890 2023-09-23T09:49:29.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.956+0000 7fd6757ff700 1 -- 172.21.15.82:0/3678467134 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6701a3480 con 0x7fd670100890 2023-09-23T09:49:29.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.957+0000 7fd6757ff700 1 -- 172.21.15.82:0/3678467134 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6700676a0 con 0x7fd670100890 2023-09-23T09:49:29.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.959+0000 7fd657fff700 1 -- 172.21.15.82:0/3678467134 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7fd660009a90 con 0x7fd670100890 2023-09-23T09:49:29.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.960+0000 7fd657fff700 1 --2- 172.21.15.82:0/3678467134 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fd6580a00c0 0x7fd6580a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:49:29.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.960+0000 7fd657fff700 1 -- 172.21.15.82:0/3678467134 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fd6600cb160 con 0x7fd670100890 2023-09-23T09:49:29.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.960+0000 7fd66e7fc700 1 --2- 172.21.15.82:0/3678467134 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fd6580a00c0 0x7fd6580a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:49:29.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.961+0000 7fd66e7fc700 1 --2- 172.21.15.82:0/3678467134 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fd6580a00c0 0x7fd6580a2580 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd670197b50 tx=0x7fd664005960 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:49:29.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:29.962+0000 7fd657fff700 1 -- 172.21.15.82:0/3678467134 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7fd660094bb0 con 0x7fd670100890 2023-09-23T09:49:30.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.166+0000 7fd6757ff700 1 -- 172.21.15.82:0/3678467134 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd670110800 con 0x7fd670100890 2023-09-23T09:49:30.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.166+0000 7fd657fff700 1 -- 172.21.15.82:0/3678467134 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v181) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd6600210a0 con 0x7fd670100890 2023-09-23T09:49:30.168 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2023-09-23T09:49:30.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.168+0000 7fd6757ff700 1 -- 172.21.15.82:0/3678467134 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fd6580a00c0 msgr2=0x7fd6580a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:49:30.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.168+0000 7fd6757ff700 1 --2- 172.21.15.82:0/3678467134 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fd6580a00c0 0x7fd6580a2580 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd670197b50 tx=0x7fd664005960 comp rx=0 tx=0).stop 2023-09-23T09:49:30.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.169+0000 7fd6757ff700 1 -- 172.21.15.82:0/3678467134 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd670100890 msgr2=0x7fd67019c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:49:30.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.169+0000 7fd6757ff700 1 --2- 172.21.15.82:0/3678467134 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd670100890 0x7fd67019c670 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fd66000d950 tx=0x7fd66000dc60 comp rx=0 tx=0).stop 2023-09-23T09:49:30.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.169+0000 7fd6757ff700 1 -- 172.21.15.82:0/3678467134 shutdown_connections 2023-09-23T09:49:30.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.169+0000 7fd6757ff700 1 --2- 172.21.15.82:0/3678467134 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7fd6580a00c0 0x7fd6580a2580 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:49:30.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.169+0000 7fd6757ff700 1 --2- 172.21.15.82:0/3678467134 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6701068a0 0x7fd6701966e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:49:30.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.169+0000 7fd6757ff700 1 --2- 172.21.15.82:0/3678467134 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd670100890 0x7fd67019c670 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:49:30.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.169+0000 7fd6757ff700 1 --2- 172.21.15.82:0/3678467134 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd670101250 0x7fd67019cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:49:30.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.169+0000 7fd6757ff700 1 -- 172.21.15.82:0/3678467134 >> 172.21.15.82:0/3678467134 conn(0x7fd6700fc380 msgr2=0x7fd6700fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:49:30.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.169+0000 7fd6757ff700 1 -- 172.21.15.82:0/3678467134 shutdown_connections 2023-09-23T09:49:30.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.169+0000 7fd6757ff700 1 -- 172.21.15.82:0/3678467134 wait complete. 2023-09-23T09:49:30.188 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-23T09:49:30.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.387+0000 7efc6d5ff700 1 -- 172.21.15.82:0/2473708899 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc68101230 msgr2=0x7efc6810d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:49:30.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.387+0000 7efc6d5ff700 1 --2- 172.21.15.82:0/2473708899 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc68101230 0x7efc6810d740 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7efc6000b0a0 tx=0x7efc6000b3b0 comp rx=0 tx=0).stop 2023-09-23T09:49:30.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.387+0000 7efc6d5ff700 1 -- 172.21.15.82:0/2473708899 shutdown_connections 2023-09-23T09:49:30.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.387+0000 7efc6d5ff700 1 --2- 172.21.15.82:0/2473708899 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc68101230 0x7efc6810d740 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:49:30.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.387+0000 7efc6d5ff700 1 --2- 172.21.15.82:0/2473708899 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efc68106880 0x7efc68106c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:49:30.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.387+0000 7efc6d5ff700 1 --2- 172.21.15.82:0/2473708899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc68100870 0x7efc68100cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:49:30.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.387+0000 7efc6d5ff700 1 -- 172.21.15.82:0/2473708899 >> 172.21.15.82:0/2473708899 conn(0x7efc680fc3a0 msgr2=0x7efc680fe7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:49:30.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.387+0000 7efc6d5ff700 1 -- 172.21.15.82:0/2473708899 shutdown_connections 2023-09-23T09:49:30.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.387+0000 7efc6d5ff700 1 -- 172.21.15.82:0/2473708899 wait complete. 2023-09-23T09:49:30.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.389+0000 7efc6d5ff700 1 Processor -- start 2023-09-23T09:49:30.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.389+0000 7efc6d5ff700 1 -- start start 2023-09-23T09:49:30.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.389+0000 7efc6d5ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc68100870 0x7efc6819c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:49:30.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.389+0000 7efc6d5ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efc68101230 0x7efc6819cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:49:30.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.389+0000 7efc6d5ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc68106880 0x7efc68196600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:49:30.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.389+0000 7efc6d5ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc68196c70 con 0x7efc68100870 2023-09-23T09:49:30.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.389+0000 7efc6d5ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc68196de0 con 0x7efc68106880 2023-09-23T09:49:30.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.389+0000 7efc6d5ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc68196fa0 con 0x7efc68101230 2023-09-23T09:49:30.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.390+0000 7efc66ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc68100870 0x7efc6819c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:49:30.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.390+0000 7efc677fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc68106880 0x7efc68196600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:49:30.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.390+0000 7efc677fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc68106880 0x7efc68196600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:35140/0 (socket says 172.21.15.82:35140) 2023-09-23T09:49:30.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.390+0000 7efc66ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc68100870 0x7efc6819c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42104/0 (socket says 172.21.15.82:42104) 2023-09-23T09:49:30.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.390+0000 7efc677fe700 1 -- 172.21.15.82:0/144185061 learned_addr learned my addr 172.21.15.82:0/144185061 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:49:30.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.390+0000 7efc667fc700 1 --2- 172.21.15.82:0/144185061 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efc68101230 0x7efc6819cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:49:30.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.390+0000 7efc677fe700 1 -- 172.21.15.82:0/144185061 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efc68101230 msgr2=0x7efc6819cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:49:30.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.390+0000 7efc677fe700 1 --2- 172.21.15.82:0/144185061 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efc68101230 0x7efc6819cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:49:30.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.390+0000 7efc677fe700 1 -- 172.21.15.82:0/144185061 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc68100870 msgr2=0x7efc6819c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:49:30.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.390+0000 7efc677fe700 1 --2- 172.21.15.82:0/144185061 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc68100870 0x7efc6819c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:49:30.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.390+0000 7efc677fe700 1 -- 172.21.15.82:0/144185061 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc60009d00 con 0x7efc68106880 2023-09-23T09:49:30.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.390+0000 7efc66ffd700 1 --2- 172.21.15.82:0/144185061 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc68100870 0x7efc6819c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:49:30.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.390+0000 7efc677fe700 1 --2- 172.21.15.82:0/144185061 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc68106880 0x7efc68196600 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7efc6000b780 tx=0x7efc6000bd60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:49:30.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.391+0000 7efc4ffff700 1 -- 172.21.15.82:0/144185061 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc6000e040 con 0x7efc68106880 2023-09-23T09:49:30.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.391+0000 7efc6d5ff700 1 -- 172.21.15.82:0/144185061 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc68197220 con 0x7efc68106880 2023-09-23T09:49:30.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.391+0000 7efc4ffff700 1 -- 172.21.15.82:0/144185061 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efc600094c0 con 0x7efc68106880 2023-09-23T09:49:30.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.391+0000 7efc4ffff700 1 -- 172.21.15.82:0/144185061 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc600052a0 con 0x7efc68106880 2023-09-23T09:49:30.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.391+0000 7efc6d5ff700 1 -- 172.21.15.82:0/144185061 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc681a3580 con 0x7efc68106880 2023-09-23T09:49:30.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.392+0000 7efc6d5ff700 1 -- 172.21.15.82:0/144185061 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc680676a0 con 0x7efc68106880 2023-09-23T09:49:30.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.394+0000 7efc4ffff700 1 -- 172.21.15.82:0/144185061 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7efc6001d470 con 0x7efc68106880 2023-09-23T09:49:30.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.395+0000 7efc4ffff700 1 --2- 172.21.15.82:0/144185061 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7efc500a00c0 0x7efc500a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:49:30.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.395+0000 7efc4ffff700 1 -- 172.21.15.82:0/144185061 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 8513+0+0 (secure 0 0 0) 0x7efc600cd5b0 con 0x7efc68106880 2023-09-23T09:49:30.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.395+0000 7efc66ffd700 1 --2- 172.21.15.82:0/144185061 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7efc500a00c0 0x7efc500a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:49:30.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.396+0000 7efc66ffd700 1 --2- 172.21.15.82:0/144185061 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7efc500a00c0 0x7efc500a2580 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7efc58005950 tx=0x7efc5800b410 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:49:30.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.400+0000 7efc4ffff700 1 -- 172.21.15.82:0/144185061 <== mon.2 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7efc60097090 con 0x7efc68106880 2023-09-23T09:49:30.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.602+0000 7efc6d5ff700 1 -- 172.21.15.82:0/144185061 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7efc68110730 con 0x7efc68106880 2023-09-23T09:49:30.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.603+0000 7efc4ffff700 1 -- 172.21.15.82:0/144185061 <== mon.2 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v181) v1 ==== 100+0+11 (secure 0 0 0) 0x7efc6009a6b0 con 0x7efc68106880 2023-09-23T09:49:30.604 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2023-09-23T09:49:30.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.605+0000 7efc6d5ff700 1 -- 172.21.15.82:0/144185061 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7efc500a00c0 msgr2=0x7efc500a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:49:30.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.605+0000 7efc6d5ff700 1 --2- 172.21.15.82:0/144185061 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7efc500a00c0 0x7efc500a2580 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7efc58005950 tx=0x7efc5800b410 comp rx=0 tx=0).stop 2023-09-23T09:49:30.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.605+0000 7efc6d5ff700 1 -- 172.21.15.82:0/144185061 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc68106880 msgr2=0x7efc68196600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:49:30.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.605+0000 7efc6d5ff700 1 --2- 172.21.15.82:0/144185061 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc68106880 0x7efc68196600 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7efc6000b780 tx=0x7efc6000bd60 comp rx=0 tx=0).stop 2023-09-23T09:49:30.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.605+0000 7efc6d5ff700 1 -- 172.21.15.82:0/144185061 shutdown_connections 2023-09-23T09:49:30.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.605+0000 7efc6d5ff700 1 --2- 172.21.15.82:0/144185061 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7efc500a00c0 0x7efc500a2580 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:49:30.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.605+0000 7efc6d5ff700 1 --2- 172.21.15.82:0/144185061 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc68106880 0x7efc68196600 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:49:30.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.605+0000 7efc6d5ff700 1 --2- 172.21.15.82:0/144185061 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc68100870 0x7efc6819c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:49:30.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.605+0000 7efc6d5ff700 1 --2- 172.21.15.82:0/144185061 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efc68101230 0x7efc6819cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:49:30.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.605+0000 7efc6d5ff700 1 -- 172.21.15.82:0/144185061 >> 172.21.15.82:0/144185061 conn(0x7efc680fc3a0 msgr2=0x7efc68104380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:49:30.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.605+0000 7efc6d5ff700 1 -- 172.21.15.82:0/144185061 shutdown_connections 2023-09-23T09:49:30.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.605+0000 7efc6d5ff700 1 -- 172.21.15.82:0/144185061 wait complete. 2023-09-23T09:49:30.625 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-09-23T09:49:30.810 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:49:30 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/2035634519' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-23T09:49:30.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:49:30 smithi135 ceph-mon[99205]: pgmap v1673: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-09-23T09:49:30.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:49:30 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/3678467134' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-09-23T09:49:30.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.822+0000 7ff9535ff700 1 -- 172.21.15.82:0/3166139419 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff94c100890 msgr2=0x7ff94c100d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:49:30.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.822+0000 7ff9535ff700 1 --2- 172.21.15.82:0/3166139419 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff94c100890 0x7ff94c100d10 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7ff93c009990 tx=0x7ff93c009ca0 comp rx=0 tx=0).stop 2023-09-23T09:49:30.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.822+0000 7ff9535ff700 1 -- 172.21.15.82:0/3166139419 shutdown_connections 2023-09-23T09:49:30.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.822+0000 7ff9535ff700 1 --2- 172.21.15.82:0/3166139419 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff94c101250 0x7ff94c10d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:49:30.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.822+0000 7ff9535ff700 1 --2- 172.21.15.82:0/3166139419 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff94c1068a0 0x7ff94c106c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:49:30.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.822+0000 7ff9535ff700 1 --2- 172.21.15.82:0/3166139419 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff94c100890 0x7ff94c100d10 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:49:30.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.822+0000 7ff9535ff700 1 -- 172.21.15.82:0/3166139419 >> 172.21.15.82:0/3166139419 conn(0x7ff94c0fc380 msgr2=0x7ff94c0fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:49:30.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.822+0000 7ff9535ff700 1 -- 172.21.15.82:0/3166139419 shutdown_connections 2023-09-23T09:49:30.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.822+0000 7ff9535ff700 1 -- 172.21.15.82:0/3166139419 wait complete. 2023-09-23T09:49:30.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.823+0000 7ff9535ff700 1 Processor -- start 2023-09-23T09:49:30.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.823+0000 7ff9535ff700 1 -- start start 2023-09-23T09:49:30.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.823+0000 7ff9535ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff94c100890 0x7ff94c19c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:49:30.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.823+0000 7ff9535ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff94c101250 0x7ff94c19cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:49:30.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.823+0000 7ff9535ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff94c1068a0 0x7ff94c196730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:49:30.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.823+0000 7ff9535ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff94c196da0 con 0x7ff94c1068a0 2023-09-23T09:49:30.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.823+0000 7ff9535ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff94c196f10 con 0x7ff94c101250 2023-09-23T09:49:30.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.823+0000 7ff9535ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff94c1970d0 con 0x7ff94c100890 2023-09-23T09:49:30.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.824+0000 7ff950b9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff94c101250 0x7ff94c19cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:49:30.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.824+0000 7ff951b9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff94c1068a0 0x7ff94c196730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:49:30.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.824+0000 7ff950b9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff94c101250 0x7ff94c19cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:35146/0 (socket says 172.21.15.82:35146) 2023-09-23T09:49:30.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.824+0000 7ff950b9a700 1 -- 172.21.15.82:0/1161948310 learned_addr learned my addr 172.21.15.82:0/1161948310 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:49:30.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.824+0000 7ff95139b700 1 --2- 172.21.15.82:0/1161948310 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff94c100890 0x7ff94c19c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:49:30.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.824+0000 7ff951b9c700 1 -- 172.21.15.82:0/1161948310 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff94c100890 msgr2=0x7ff94c19c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:49:30.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.824+0000 7ff951b9c700 1 --2- 172.21.15.82:0/1161948310 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff94c100890 0x7ff94c19c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:49:30.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.824+0000 7ff951b9c700 1 -- 172.21.15.82:0/1161948310 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff94c101250 msgr2=0x7ff94c19cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:49:30.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.824+0000 7ff951b9c700 1 --2- 172.21.15.82:0/1161948310 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff94c101250 0x7ff94c19cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:49:30.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.824+0000 7ff951b9c700 1 -- 172.21.15.82:0/1161948310 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff93c0095f0 con 0x7ff94c1068a0 2023-09-23T09:49:30.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.824+0000 7ff950b9a700 1 --2- 172.21.15.82:0/1161948310 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff94c101250 0x7ff94c19cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:49:30.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.824+0000 7ff951b9c700 1 --2- 172.21.15.82:0/1161948310 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff94c1068a0 0x7ff94c196730 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7ff944007f10 tx=0x7ff94400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:49:30.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.824+0000 7ff9427fc700 1 -- 172.21.15.82:0/1161948310 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff94400ddd0 con 0x7ff94c1068a0 2023-09-23T09:49:30.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.825+0000 7ff9427fc700 1 -- 172.21.15.82:0/1161948310 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff94400f040 con 0x7ff94c1068a0 2023-09-23T09:49:30.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.825+0000 7ff9535ff700 1 -- 172.21.15.82:0/1161948310 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff94c1973b0 con 0x7ff94c1068a0 2023-09-23T09:49:30.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.825+0000 7ff9427fc700 1 -- 172.21.15.82:0/1161948310 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9440059c0 con 0x7ff94c1068a0 2023-09-23T09:49:30.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.825+0000 7ff9535ff700 1 -- 172.21.15.82:0/1161948310 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff94c1a3660 con 0x7ff94c1068a0 2023-09-23T09:49:30.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.826+0000 7ff9535ff700 1 -- 172.21.15.82:0/1161948310 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff94c0676a0 con 0x7ff94c1068a0 2023-09-23T09:49:30.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.828+0000 7ff9427fc700 1 -- 172.21.15.82:0/1161948310 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7ff944005000 con 0x7ff94c1068a0 2023-09-23T09:49:30.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.829+0000 7ff9427fc700 1 --2- 172.21.15.82:0/1161948310 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7ff9380a0140 0x7ff9380a2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:49:30.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.829+0000 7ff9427fc700 1 -- 172.21.15.82:0/1161948310 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 8513+0+0 (secure 0 0 0) 0x7ff9440cb710 con 0x7ff94c1068a0 2023-09-23T09:49:30.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.829+0000 7ff95139b700 1 --2- 172.21.15.82:0/1161948310 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7ff9380a0140 0x7ff9380a2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:49:30.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.830+0000 7ff95139b700 1 --2- 172.21.15.82:0/1161948310 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7ff9380a0140 0x7ff9380a2600 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ff948009bd0 tx=0x7ff948009260 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:49:30.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:30.831+0000 7ff9427fc700 1 -- 172.21.15.82:0/1161948310 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7ff944095100 con 0x7ff94c1068a0 2023-09-23T09:49:30.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:49:30 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/2035634519' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-23T09:49:30.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:49:30 smithi082 ceph-mon[97694]: pgmap v1673: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-09-23T09:49:30.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:49:30 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/3678467134' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-09-23T09:49:30.896 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:49:30 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/2035634519' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-23T09:49:30.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:49:30 smithi161 ceph-mon[99580]: pgmap v1673: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-09-23T09:49:30.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:49:30 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/3678467134' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-09-23T09:49:31.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.051+0000 7ff9535ff700 1 -- 172.21.15.82:0/1161948310 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff94c110920 con 0x7ff94c1068a0 2023-09-23T09:49:31.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.052+0000 7ff9427fc700 1 -- 172.21.15.82:0/1161948310 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 16 entries v181) v1 ==== 81+0+945 (secure 0 0 0) 0x7ff944023020 con 0x7ff94c1068a0 2023-09-23T09:49:31.053 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/1769657494 2023-09-24T08:56:53.091759+0000 2023-09-23T09:49:31.053 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6801/3698954311 2023-09-24T08:56:53.091759+0000 2023-09-23T09:49:31.054 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/4204712132 2023-09-24T08:47:21.957866+0000 2023-09-23T09:49:31.054 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/2391800294 2023-09-24T08:56:53.091759+0000 2023-09-23T09:49:31.054 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6801/2733521564 2023-09-24T08:47:21.957866+0000 2023-09-23T09:49:31.054 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6800/2733521564 2023-09-24T08:47:21.957866+0000 2023-09-23T09:49:31.054 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/3964794665 2023-09-24T08:47:21.957866+0000 2023-09-23T09:49:31.054 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/3535372205 2023-09-24T08:46:55.187024+0000 2023-09-23T09:49:31.054 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6800/3698954311 2023-09-24T08:56:53.091759+0000 2023-09-23T09:49:31.055 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/285559684 2023-09-24T08:46:55.187024+0000 2023-09-23T09:49:31.055 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/1232294461 2023-09-24T08:56:53.091759+0000 2023-09-23T09:49:31.055 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/1335891896 2023-09-24T08:46:55.187024+0000 2023-09-23T09:49:31.055 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6801/3761509623 2023-09-24T08:46:55.187024+0000 2023-09-23T09:49:31.055 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6800/3761509623 2023-09-24T08:46:55.187024+0000 2023-09-23T09:49:31.055 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/3074646956 2023-09-24T08:56:53.091759+0000 2023-09-23T09:49:31.055 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/3775317005 2023-09-24T08:47:21.957866+0000 2023-09-23T09:49:31.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.054+0000 7ff9535ff700 1 -- 172.21.15.82:0/1161948310 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7ff9380a0140 msgr2=0x7ff9380a2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:49:31.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.054+0000 7ff9535ff700 1 --2- 172.21.15.82:0/1161948310 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7ff9380a0140 0x7ff9380a2600 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ff948009bd0 tx=0x7ff948009260 comp rx=0 tx=0).stop 2023-09-23T09:49:31.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.054+0000 7ff9535ff700 1 -- 172.21.15.82:0/1161948310 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff94c1068a0 msgr2=0x7ff94c196730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:49:31.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.054+0000 7ff9535ff700 1 --2- 172.21.15.82:0/1161948310 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff94c1068a0 0x7ff94c196730 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7ff944007f10 tx=0x7ff94400d3b0 comp rx=0 tx=0).stop 2023-09-23T09:49:31.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.054+0000 7ff9535ff700 1 -- 172.21.15.82:0/1161948310 shutdown_connections 2023-09-23T09:49:31.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.054+0000 7ff9535ff700 1 --2- 172.21.15.82:0/1161948310 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7ff9380a0140 0x7ff9380a2600 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:49:31.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.054+0000 7ff9535ff700 1 --2- 172.21.15.82:0/1161948310 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff94c1068a0 0x7ff94c196730 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:49:31.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.054+0000 7ff9535ff700 1 --2- 172.21.15.82:0/1161948310 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff94c100890 0x7ff94c19c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:49:31.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.054+0000 7ff9535ff700 1 --2- 172.21.15.82:0/1161948310 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff94c101250 0x7ff94c19cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:49:31.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.054+0000 7ff9535ff700 1 -- 172.21.15.82:0/1161948310 >> 172.21.15.82:0/1161948310 conn(0x7ff94c0fc380 msgr2=0x7ff94c0fcac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:49:31.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.054+0000 7ff9535ff700 1 -- 172.21.15.82:0/1161948310 shutdown_connections 2023-09-23T09:49:31.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.054+0000 7ff9535ff700 1 -- 172.21.15.82:0/1161948310 wait complete. 2023-09-23T09:49:31.059 INFO:teuthology.orchestra.run.smithi082.stderr:listed 16 entries 2023-09-23T09:49:31.074 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-09-23T09:49:31.074 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-23T09:49:31.119 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-23T09:49:31.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.354+0000 7f21005ff700 1 -- 172.21.15.82:0/2331651009 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20f8100890 msgr2=0x7f20f8100d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:49:31.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.354+0000 7f21005ff700 1 --2- 172.21.15.82:0/2331651009 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20f8100890 0x7f20f8100d10 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f20e8009990 tx=0x7f20e8009ca0 comp rx=0 tx=0).stop 2023-09-23T09:49:31.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.354+0000 7f21005ff700 1 -- 172.21.15.82:0/2331651009 shutdown_connections 2023-09-23T09:49:31.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.354+0000 7f21005ff700 1 --2- 172.21.15.82:0/2331651009 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f20f8101250 0x7f20f810d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:49:31.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.354+0000 7f21005ff700 1 --2- 172.21.15.82:0/2331651009 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20f81068a0 0x7f20f8106c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:49:31.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.354+0000 7f21005ff700 1 --2- 172.21.15.82:0/2331651009 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20f8100890 0x7f20f8100d10 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:49:31.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.354+0000 7f21005ff700 1 -- 172.21.15.82:0/2331651009 >> 172.21.15.82:0/2331651009 conn(0x7f20f80fc340 msgr2=0x7f20f80fe760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:49:31.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.354+0000 7f21005ff700 1 -- 172.21.15.82:0/2331651009 shutdown_connections 2023-09-23T09:49:31.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.355+0000 7f21005ff700 1 -- 172.21.15.82:0/2331651009 wait complete. 2023-09-23T09:49:31.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.355+0000 7f21005ff700 1 Processor -- start 2023-09-23T09:49:31.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.356+0000 7f21005ff700 1 -- start start 2023-09-23T09:49:31.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.356+0000 7f21005ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20f8100890 0x7f20f8072c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:49:31.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.356+0000 7f21005ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f20f8101250 0x7f20f8073160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:49:31.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.356+0000 7f21005ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20f81068a0 0x7f20f81a49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:49:31.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.356+0000 7f21005ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20f8073990 con 0x7f20f8100890 2023-09-23T09:49:31.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.356+0000 7f21005ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20f81a4f30 con 0x7f20f81068a0 2023-09-23T09:49:31.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.356+0000 7f21005ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20f81a5070 con 0x7f20f8101250 2023-09-23T09:49:31.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.356+0000 7f20fe39b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20f8100890 0x7f20f8072c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:49:31.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.356+0000 7f20fe39b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20f8100890 0x7f20f8072c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42136/0 (socket says 172.21.15.82:42136) 2023-09-23T09:49:31.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.356+0000 7f20fe39b700 1 -- 172.21.15.82:0/1315509967 learned_addr learned my addr 172.21.15.82:0/1315509967 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:49:31.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.356+0000 7f20feb9c700 1 --2- 172.21.15.82:0/1315509967 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20f81068a0 0x7f20f81a49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:49:31.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.357+0000 7f20fdb9a700 1 --2- 172.21.15.82:0/1315509967 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f20f8101250 0x7f20f8073160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:49:31.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.357+0000 7f20fe39b700 1 -- 172.21.15.82:0/1315509967 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f20f8101250 msgr2=0x7f20f8073160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:49:31.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.357+0000 7f20fe39b700 1 --2- 172.21.15.82:0/1315509967 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f20f8101250 0x7f20f8073160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:49:31.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.357+0000 7f20fe39b700 1 -- 172.21.15.82:0/1315509967 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20f81068a0 msgr2=0x7f20f81a49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:49:31.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.357+0000 7f20fe39b700 1 --2- 172.21.15.82:0/1315509967 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20f81068a0 0x7f20f81a49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:49:31.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.357+0000 7f20fe39b700 1 -- 172.21.15.82:0/1315509967 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20f4009520 con 0x7f20f8100890 2023-09-23T09:49:31.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.357+0000 7f20fe39b700 1 --2- 172.21.15.82:0/1315509967 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20f8100890 0x7f20f8072c20 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f20f400eb30 tx=0x7f20f400ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:49:31.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.357+0000 7f20ef7fe700 1 -- 172.21.15.82:0/1315509967 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f4009880 con 0x7f20f8100890 2023-09-23T09:49:31.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.357+0000 7f20ef7fe700 1 -- 172.21.15.82:0/1315509967 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f20f40044b0 con 0x7f20f8100890 2023-09-23T09:49:31.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.357+0000 7f21005ff700 1 -- 172.21.15.82:0/1315509967 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20e80095f0 con 0x7f20f8100890 2023-09-23T09:49:31.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.357+0000 7f20ef7fe700 1 -- 172.21.15.82:0/1315509967 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f4003df0 con 0x7f20f8100890 2023-09-23T09:49:31.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.357+0000 7f21005ff700 1 -- 172.21.15.82:0/1315509967 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20f81a5620 con 0x7f20f8100890 2023-09-23T09:49:31.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.358+0000 7f21005ff700 1 -- 172.21.15.82:0/1315509967 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20f8067710 con 0x7f20f8100890 2023-09-23T09:49:31.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.360+0000 7f20ef7fe700 1 -- 172.21.15.82:0/1315509967 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f20f4003f50 con 0x7f20f8100890 2023-09-23T09:49:31.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.363+0000 7f20ef7fe700 1 --2- 172.21.15.82:0/1315509967 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f20e40a0100 0x7f20e40a25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:49:31.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.363+0000 7f20ef7fe700 1 -- 172.21.15.82:0/1315509967 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f20f4014070 con 0x7f20f8100890 2023-09-23T09:49:31.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.363+0000 7f20fdb9a700 1 --2- 172.21.15.82:0/1315509967 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f20e40a0100 0x7f20e40a25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:49:31.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.364+0000 7f20fdb9a700 1 --2- 172.21.15.82:0/1315509967 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f20e40a0100 0x7f20e40a25c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f20e8006010 tx=0x7f20e800b260 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:49:31.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.365+0000 7f20ef7fe700 1 -- 172.21.15.82:0/1315509967 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f20f4095540 con 0x7f20f8100890 2023-09-23T09:49:31.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.569+0000 7f21005ff700 1 -- 172.21.15.82:0/1315509967 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f20f81108a0 con 0x7f20f8100890 2023-09-23T09:49:31.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.571+0000 7f20ef7fe700 1 -- 172.21.15.82:0/1315509967 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v181) v1 ==== 74+0+22982 (secure 0 0 0) 0x7f20f400fe60 con 0x7f20f8100890 2023-09-23T09:49:31.573 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-09-23T09:49:31.573 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":181,"fsid":"8926e286-59ed-11ee-8db4-212e2dc638e7","created":"2023-09-23T08:46:16.628057+0000","modified":"2023-09-23T09:49:17.498968+0000","last_up_change":"2023-09-23T08:53:56.524694+0000","last_in_change":"2023-09-23T08:53:35.779183+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-23T08:50:00.571063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-23T08:54:50.558630+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-23T08:54:52.055291+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"180","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":100,"snap_epoch":180,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7384c1ff-8c71-4feb-8cef-ba45c2a1708a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":892441948},{"type":"v1","addr":"172.21.15.82:6803","nonce":892441948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":892441948},{"type":"v1","addr":"172.21.15.82:6805","nonce":892441948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":892441948},{"type":"v1","addr":"172.21.15.82:6809","nonce":892441948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":892441948},{"type":"v1","addr":"172.21.15.82:6807","nonce":892441948}]},"public_addr":"172.21.15.82:6803/892441948","cluster_addr":"172.21.15.82:6805/892441948","heartbeat_back_addr":"172.21.15.82:6809/892441948","heartbeat_front_addr":"172.21.15.82:6807/892441948","state":["exists","up"]},{"osd":1,"uuid":"ca62333e-15db-4556-a9ed-8820f9268766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3224546922},{"type":"v1","addr":"172.21.15.135:6801","nonce":3224546922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3224546922},{"type":"v1","addr":"172.21.15.135:6803","nonce":3224546922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3224546922},{"type":"v1","addr":"172.21.15.135:6807","nonce":3224546922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3224546922},{"type":"v1","addr":"172.21.15.135:6805","nonce":3224546922}]},"public_addr":"172.21.15.135:6801/3224546922","cluster_addr":"172.21.15.135:6803/3224546922","heartbeat_back_addr":"172.21.15.135:6807/3224546922","heartbeat_front_addr":"172.21.15.135:6805/3224546922","state":["exists","up"]},{"osd":2,"uuid":"ac23eb38-216a-44f0-b316-a509b23745f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2358373459},{"type":"v1","addr":"172.21.15.161:6801","nonce":2358373459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2358373459},{"type":"v1","addr":"172.21.15.161:6803","nonce":2358373459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2358373459},{"type":"v1","addr":"172.21.15.161:6807","nonce":2358373459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2358373459},{"type":"v1","addr":"172.21.15.161:6805","nonce":2358373459}]},"public_addr":"172.21.15.161:6801/2358373459","cluster_addr":"172.21.15.161:6803/2358373459","heartbeat_back_addr":"172.21.15.161:6807/2358373459","heartbeat_front_addr":"172.21.15.161:6805/2358373459","state":["exists","up"]},{"osd":3,"uuid":"701c96b0-30fb-46ce-917d-e02d3814dc3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":1081464528},{"type":"v1","addr":"172.21.15.82:6811","nonce":1081464528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1081464528},{"type":"v1","addr":"172.21.15.82:6813","nonce":1081464528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1081464528},{"type":"v1","addr":"172.21.15.82:6817","nonce":1081464528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":1081464528},{"type":"v1","addr":"172.21.15.82:6815","nonce":1081464528}]},"public_addr":"172.21.15.82:6811/1081464528","cluster_addr":"172.21.15.82:6813/1081464528","heartbeat_back_addr":"172.21.15.82:6817/1081464528","heartbeat_front_addr":"172.21.15.82:6815/1081464528","state":["exists","up"]},{"osd":4,"uuid":"c618d2a2-3616-41b2-943c-7a4616538e13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2346495509},{"type":"v1","addr":"172.21.15.135:6809","nonce":2346495509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2346495509},{"type":"v1","addr":"172.21.15.135:6811","nonce":2346495509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2346495509},{"type":"v1","addr":"172.21.15.135:6815","nonce":2346495509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2346495509},{"type":"v1","addr":"172.21.15.135:6813","nonce":2346495509}]},"public_addr":"172.21.15.135:6809/2346495509","cluster_addr":"172.21.15.135:6811/2346495509","heartbeat_back_addr":"172.21.15.135:6815/2346495509","heartbeat_front_addr":"172.21.15.135:6813/2346495509","state":["exists","up"]},{"osd":5,"uuid":"8e1dda3d-6927-495d-b20d-78b03bb75d5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1252638628},{"type":"v1","addr":"172.21.15.161:6809","nonce":1252638628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1252638628},{"type":"v1","addr":"172.21.15.161:6811","nonce":1252638628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1252638628},{"type":"v1","addr":"172.21.15.161:6815","nonce":1252638628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1252638628},{"type":"v1","addr":"172.21.15.161:6813","nonce":1252638628}]},"public_addr":"172.21.15.161:6809/1252638628","cluster_addr":"172.21.15.161:6811/1252638628","heartbeat_back_addr":"172.21.15.161:6815/1252638628","heartbeat_front_addr":"172.21.15.161:6813/1252638628","state":["exists","up"]},{"osd":6,"uuid":"50b31960-6bc4-44e1-8116-3106bf161e56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1052038408},{"type":"v1","addr":"172.21.15.82:6819","nonce":1052038408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1052038408},{"type":"v1","addr":"172.21.15.82:6821","nonce":1052038408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":1052038408},{"type":"v1","addr":"172.21.15.82:6825","nonce":1052038408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1052038408},{"type":"v1","addr":"172.21.15.82:6823","nonce":1052038408}]},"public_addr":"172.21.15.82:6819/1052038408","cluster_addr":"172.21.15.82:6821/1052038408","heartbeat_back_addr":"172.21.15.82:6825/1052038408","heartbeat_front_addr":"172.21.15.82:6823/1052038408","state":["exists","up"]},{"osd":7,"uuid":"425ca0ee-57f7-4b27-90fb-d86bb5db5480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3683951498},{"type":"v1","addr":"172.21.15.135:6817","nonce":3683951498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":3683951498},{"type":"v1","addr":"172.21.15.135:6819","nonce":3683951498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":3683951498},{"type":"v1","addr":"172.21.15.135:6823","nonce":3683951498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":3683951498},{"type":"v1","addr":"172.21.15.135:6821","nonce":3683951498}]},"public_addr":"172.21.15.135:6817/3683951498","cluster_addr":"172.21.15.135:6819/3683951498","heartbeat_back_addr":"172.21.15.135:6823/3683951498","heartbeat_front_addr":"172.21.15.135:6821/3683951498","state":["exists","up"]},{"osd":8,"uuid":"1115c837-bef6-4bad-9974-4d913198511b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":948521536},{"type":"v1","addr":"172.21.15.161:6817","nonce":948521536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":948521536},{"type":"v1","addr":"172.21.15.161:6819","nonce":948521536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":948521536},{"type":"v1","addr":"172.21.15.161:6823","nonce":948521536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":948521536},{"type":"v1","addr":"172.21.15.161:6821","nonce":948521536}]},"public_addr":"172.21.15.161:6817/948521536","cluster_addr":"172.21.15.161:6819/948521536","heartbeat_back_addr":"172.21.15.161:6823/948521536","heartbeat_front_addr":"172.21.15.161:6821/948521536","state":["exists","up"]},{"osd":9,"uuid":"c52ec819-4bc6-402f-9cd8-62539e519e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":1438762840},{"type":"v1","addr":"172.21.15.82:6827","nonce":1438762840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":1438762840},{"type":"v1","addr":"172.21.15.82:6829","nonce":1438762840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1438762840},{"type":"v1","addr":"172.21.15.82:6833","nonce":1438762840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1438762840},{"type":"v1","addr":"172.21.15.82:6831","nonce":1438762840}]},"public_addr":"172.21.15.82:6827/1438762840","cluster_addr":"172.21.15.82:6829/1438762840","heartbeat_back_addr":"172.21.15.82:6833/1438762840","heartbeat_front_addr":"172.21.15.82:6831/1438762840","state":["exists","up"]},{"osd":10,"uuid":"1b16c795-1b91-4d46-ae5d-21b8332c1077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2853697851},{"type":"v1","addr":"172.21.15.135:6825","nonce":2853697851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2853697851},{"type":"v1","addr":"172.21.15.135:6827","nonce":2853697851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2853697851},{"type":"v1","addr":"172.21.15.135:6831","nonce":2853697851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2853697851},{"type":"v1","addr":"172.21.15.135:6829","nonce":2853697851}]},"public_addr":"172.21.15.135:6825/2853697851","cluster_addr":"172.21.15.135:6827/2853697851","heartbeat_back_addr":"172.21.15.135:6831/2853697851","heartbeat_front_addr":"172.21.15.135:6829/2853697851","state":["exists","up"]},{"osd":11,"uuid":"2551e602-4fe1-41cb-9b7d-c8b31fdd1487","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":1459332081},{"type":"v1","addr":"172.21.15.161:6825","nonce":1459332081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":1459332081},{"type":"v1","addr":"172.21.15.161:6827","nonce":1459332081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":1459332081},{"type":"v1","addr":"172.21.15.161:6831","nonce":1459332081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":1459332081},{"type":"v1","addr":"172.21.15.161:6829","nonce":1459332081}]},"public_addr":"172.21.15.161:6825/1459332081","cluster_addr":"172.21.15.161:6827/1459332081","heartbeat_back_addr":"172.21.15.161:6831/1459332081","heartbeat_front_addr":"172.21.15.161:6829/1459332081","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:49:04.007679+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:49:30.702365+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:49:56.785248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:50:22.988516+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:50:49.347055+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:51:15.830145+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:51:41.986377+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:52:08.218893+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:52:34.847450+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:53:01.317134+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:53:27.981691+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T08:53:54.849245+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/1769657494":"2023-09-24T08:56:53.091759+0000","172.21.15.82:6801/3698954311":"2023-09-24T08:56:53.091759+0000","172.21.15.82:0/4204712132":"2023-09-24T08:47:21.957866+0000","172.21.15.82:0/2391800294":"2023-09-24T08:56:53.091759+0000","172.21.15.82:6801/2733521564":"2023-09-24T08:47:21.957866+0000","172.21.15.82:6800/2733521564":"2023-09-24T08:47:21.957866+0000","172.21.15.82:0/3964794665":"2023-09-24T08:47:21.957866+0000","172.21.15.82:0/3535372205":"2023-09-24T08:46:55.187024+0000","172.21.15.82:6800/3698954311":"2023-09-24T08:56:53.091759+0000","172.21.15.82:0/285559684":"2023-09-24T08:46:55.187024+0000","172.21.15.82:0/1232294461":"2023-09-24T08:56:53.091759+0000","172.21.15.82:0/1335891896":"2023-09-24T08:46:55.187024+0000","172.21.15.82:6801/3761509623":"2023-09-24T08:46:55.187024+0000","172.21.15.82:6800/3761509623":"2023-09-24T08:46:55.187024+0000","172.21.15.82:0/3074646956":"2023-09-24T08:56:53.091759+0000","172.21.15.82:0/3775317005":"2023-09-24T08:47:21.957866+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":87,"length":1},{"begin":100,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-23T09:49:31.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.573+0000 7f21005ff700 1 -- 172.21.15.82:0/1315509967 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f20e40a0100 msgr2=0x7f20e40a25c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:49:31.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.573+0000 7f21005ff700 1 --2- 172.21.15.82:0/1315509967 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f20e40a0100 0x7f20e40a25c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f20e8006010 tx=0x7f20e800b260 comp rx=0 tx=0).stop 2023-09-23T09:49:31.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.574+0000 7f21005ff700 1 -- 172.21.15.82:0/1315509967 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20f8100890 msgr2=0x7f20f8072c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:49:31.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.574+0000 7f21005ff700 1 --2- 172.21.15.82:0/1315509967 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20f8100890 0x7f20f8072c20 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f20f400eb30 tx=0x7f20f400ee40 comp rx=0 tx=0).stop 2023-09-23T09:49:31.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.574+0000 7f21005ff700 1 -- 172.21.15.82:0/1315509967 shutdown_connections 2023-09-23T09:49:31.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.574+0000 7f21005ff700 1 --2- 172.21.15.82:0/1315509967 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f20e40a0100 0x7f20e40a25c0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:49:31.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.574+0000 7f21005ff700 1 --2- 172.21.15.82:0/1315509967 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20f81068a0 0x7f20f81a49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:49:31.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.574+0000 7f21005ff700 1 --2- 172.21.15.82:0/1315509967 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20f8100890 0x7f20f8072c20 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:49:31.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.574+0000 7f21005ff700 1 --2- 172.21.15.82:0/1315509967 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f20f8101250 0x7f20f8073160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:49:31.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.574+0000 7f21005ff700 1 -- 172.21.15.82:0/1315509967 >> 172.21.15.82:0/1315509967 conn(0x7f20f80fc340 msgr2=0x7f20f81043a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:49:31.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.574+0000 7f21005ff700 1 -- 172.21.15.82:0/1315509967 shutdown_connections 2023-09-23T09:49:31.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.574+0000 7f21005ff700 1 -- 172.21.15.82:0/1315509967 wait complete. 2023-09-23T09:49:31.593 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-23T08:50:00.571063+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-23T08:54:50.558630+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-23T08:54:52.055291+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '180', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 100, 'snap_epoch': 180, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-23T09:49:31.594 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-23T09:49:31.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.794+0000 7f73ef9ff700 1 -- 172.21.15.82:0/1030329203 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73e8101250 msgr2=0x7f73e810d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:49:31.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.794+0000 7f73ef9ff700 1 --2- 172.21.15.82:0/1030329203 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73e8101250 0x7f73e810d760 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f73e000b0a0 tx=0x7f73e000b3b0 comp rx=0 tx=0).stop 2023-09-23T09:49:31.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.794+0000 7f73ef9ff700 1 -- 172.21.15.82:0/1030329203 shutdown_connections 2023-09-23T09:49:31.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.794+0000 7f73ef9ff700 1 --2- 172.21.15.82:0/1030329203 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73e8101250 0x7f73e810d760 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:49:31.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.794+0000 7f73ef9ff700 1 --2- 172.21.15.82:0/1030329203 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f73e81068a0 0x7f73e8106c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:49:31.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.794+0000 7f73ef9ff700 1 --2- 172.21.15.82:0/1030329203 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f73e8100890 0x7f73e8100d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:49:31.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.794+0000 7f73ef9ff700 1 -- 172.21.15.82:0/1030329203 >> 172.21.15.82:0/1030329203 conn(0x7f73e80fc380 msgr2=0x7f73e80fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:49:31.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.794+0000 7f73ef9ff700 1 -- 172.21.15.82:0/1030329203 shutdown_connections 2023-09-23T09:49:31.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.794+0000 7f73ef9ff700 1 -- 172.21.15.82:0/1030329203 wait complete. 2023-09-23T09:49:31.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.795+0000 7f73ef9ff700 1 Processor -- start 2023-09-23T09:49:31.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.795+0000 7f73ef9ff700 1 -- start start 2023-09-23T09:49:31.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.796+0000 7f73ef9ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f73e8100890 0x7f73e819e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:49:31.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.796+0000 7f73ef9ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73e8101250 0x7f73e819ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:49:31.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.796+0000 7f73ef9ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f73e81068a0 0x7f73e8198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:49:31.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.796+0000 7f73ef9ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73e8198ee0 con 0x7f73e8101250 2023-09-23T09:49:31.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.796+0000 7f73ef9ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73e8199050 con 0x7f73e81068a0 2023-09-23T09:49:31.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.796+0000 7f73ef9ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73e8199210 con 0x7f73e8100890 2023-09-23T09:49:31.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.796+0000 7f73ecf9a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73e8101250 0x7f73e819ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:49:31.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.796+0000 7f73ecf9a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73e8101250 0x7f73e819ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52220/0 (socket says 172.21.15.82:52220) 2023-09-23T09:49:31.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.796+0000 7f73edf9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f73e81068a0 0x7f73e8198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:49:31.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.796+0000 7f73ecf9a700 1 -- 172.21.15.82:0/3530809892 learned_addr learned my addr 172.21.15.82:0/3530809892 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:49:31.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.796+0000 7f73ed79b700 1 --2- 172.21.15.82:0/3530809892 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f73e8100890 0x7f73e819e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:49:31.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.796+0000 7f73edf9c700 1 -- 172.21.15.82:0/3530809892 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f73e8100890 msgr2=0x7f73e819e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:49:31.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.796+0000 7f73edf9c700 1 --2- 172.21.15.82:0/3530809892 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f73e8100890 0x7f73e819e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:49:31.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.796+0000 7f73edf9c700 1 -- 172.21.15.82:0/3530809892 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73e8101250 msgr2=0x7f73e819ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:49:31.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.796+0000 7f73edf9c700 1 --2- 172.21.15.82:0/3530809892 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73e8101250 0x7f73e819ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:49:31.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.796+0000 7f73edf9c700 1 -- 172.21.15.82:0/3530809892 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73e0009d00 con 0x7f73e81068a0 2023-09-23T09:49:31.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.797+0000 7f73edf9c700 1 --2- 172.21.15.82:0/3530809892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f73e81068a0 0x7f73e8198870 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f73e0009fd0 tx=0x7f73e000bce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:49:31.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.797+0000 7f73de7fc700 1 -- 172.21.15.82:0/3530809892 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e000e040 con 0x7f73e81068a0 2023-09-23T09:49:31.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.797+0000 7f73ef9ff700 1 -- 172.21.15.82:0/3530809892 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73e8199490 con 0x7f73e81068a0 2023-09-23T09:49:31.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.797+0000 7f73de7fc700 1 -- 172.21.15.82:0/3530809892 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f73e0007930 con 0x7f73e81068a0 2023-09-23T09:49:31.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.797+0000 7f73de7fc700 1 -- 172.21.15.82:0/3530809892 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e0005040 con 0x7f73e81068a0 2023-09-23T09:49:31.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.797+0000 7f73ef9ff700 1 -- 172.21.15.82:0/3530809892 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73e81a57f0 con 0x7f73e81068a0 2023-09-23T09:49:31.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.798+0000 7f73ef9ff700 1 -- 172.21.15.82:0/3530809892 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73e80676a0 con 0x7f73e81068a0 2023-09-23T09:49:31.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.800+0000 7f73de7fc700 1 -- 172.21.15.82:0/3530809892 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f73e001d470 con 0x7f73e81068a0 2023-09-23T09:49:31.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.802+0000 7f73de7fc700 1 --2- 172.21.15.82:0/3530809892 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f73d40a0140 0x7f73d40a2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:49:31.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.802+0000 7f73de7fc700 1 -- 172.21.15.82:0/3530809892 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f73e00cd3b0 con 0x7f73e81068a0 2023-09-23T09:49:31.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.802+0000 7f73ed79b700 1 --2- 172.21.15.82:0/3530809892 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f73d40a0140 0x7f73d40a2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:49:31.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.802+0000 7f73ed79b700 1 --2- 172.21.15.82:0/3530809892 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f73d40a0140 0x7f73d40a2600 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f73e4009be0 tx=0x7f73e4009260 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:49:31.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:31.805+0000 7f73de7fc700 1 -- 172.21.15.82:0/3530809892 <== mon.2 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f73e0096e30 con 0x7f73e81068a0 2023-09-23T09:49:31.810 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:49:31 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/144185061' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-09-23T09:49:31.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:49:31 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/1161948310' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-09-23T09:49:31.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:49:31 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/144185061' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-09-23T09:49:31.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:49:31 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/1161948310' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-09-23T09:49:31.896 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:49:31 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/144185061' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-09-23T09:49:31.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:49:31 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/1161948310' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-09-23T09:49:32.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.011+0000 7f73ef9ff700 1 -- 172.21.15.82:0/3530809892 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f73e81107b0 con 0x7f73e81068a0 2023-09-23T09:49:32.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.011+0000 7f73de7fc700 1 -- 172.21.15.82:0/3530809892 <== mon.2 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v181) v1 ==== 93+0+10 (secure 0 0 0) 0x7f73e009a450 con 0x7f73e81068a0 2023-09-23T09:49:32.013 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-09-23T09:49:32.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.014+0000 7f73ef9ff700 1 -- 172.21.15.82:0/3530809892 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f73d40a0140 msgr2=0x7f73d40a2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:49:32.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.014+0000 7f73ef9ff700 1 --2- 172.21.15.82:0/3530809892 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f73d40a0140 0x7f73d40a2600 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f73e4009be0 tx=0x7f73e4009260 comp rx=0 tx=0).stop 2023-09-23T09:49:32.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.014+0000 7f73ef9ff700 1 -- 172.21.15.82:0/3530809892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f73e81068a0 msgr2=0x7f73e8198870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:49:32.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.014+0000 7f73ef9ff700 1 --2- 172.21.15.82:0/3530809892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f73e81068a0 0x7f73e8198870 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f73e0009fd0 tx=0x7f73e000bce0 comp rx=0 tx=0).stop 2023-09-23T09:49:32.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.014+0000 7f73ef9ff700 1 -- 172.21.15.82:0/3530809892 shutdown_connections 2023-09-23T09:49:32.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.014+0000 7f73ef9ff700 1 --2- 172.21.15.82:0/3530809892 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f73d40a0140 0x7f73d40a2600 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:49:32.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.014+0000 7f73ef9ff700 1 --2- 172.21.15.82:0/3530809892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f73e81068a0 0x7f73e8198870 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:49:32.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.014+0000 7f73ef9ff700 1 --2- 172.21.15.82:0/3530809892 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f73e8100890 0x7f73e819e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:49:32.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.014+0000 7f73ef9ff700 1 --2- 172.21.15.82:0/3530809892 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73e8101250 0x7f73e819ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:49:32.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.014+0000 7f73ef9ff700 1 -- 172.21.15.82:0/3530809892 >> 172.21.15.82:0/3530809892 conn(0x7f73e80fc380 msgr2=0x7f73e810bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:49:32.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.014+0000 7f73ef9ff700 1 -- 172.21.15.82:0/3530809892 shutdown_connections 2023-09-23T09:49:32.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.014+0000 7f73ef9ff700 1 -- 172.21.15.82:0/3530809892 wait complete. 2023-09-23T09:49:32.033 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-23T09:49:32.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.231+0000 7f806b5ff700 1 -- 172.21.15.82:0/571164008 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8064072cf0 msgr2=0x7f80640730d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:49:32.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.231+0000 7f806b5ff700 1 --2- 172.21.15.82:0/571164008 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8064072cf0 0x7f80640730d0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f8060009990 tx=0x7f8060009ca0 comp rx=0 tx=0).stop 2023-09-23T09:49:32.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.232+0000 7f806b5ff700 1 -- 172.21.15.82:0/571164008 shutdown_connections 2023-09-23T09:49:32.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.232+0000 7f806b5ff700 1 --2- 172.21.15.82:0/571164008 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f806410d110 0x7f806410f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:49:32.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.232+0000 7f806b5ff700 1 --2- 172.21.15.82:0/571164008 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8064072cf0 0x7f80640730d0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:49:32.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.232+0000 7f806b5ff700 1 --2- 172.21.15.82:0/571164008 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8064073610 0x7f806410cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:49:32.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.232+0000 7f806b5ff700 1 -- 172.21.15.82:0/571164008 >> 172.21.15.82:0/571164008 conn(0x7f80640fc3a0 msgr2=0x7f80640fe7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:49:32.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.232+0000 7f806b5ff700 1 -- 172.21.15.82:0/571164008 shutdown_connections 2023-09-23T09:49:32.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.232+0000 7f806b5ff700 1 -- 172.21.15.82:0/571164008 wait complete. 2023-09-23T09:49:32.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.233+0000 7f806b5ff700 1 Processor -- start 2023-09-23T09:49:32.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.233+0000 7f806b5ff700 1 -- start start 2023-09-23T09:49:32.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.233+0000 7f806b5ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8064072cf0 0x7f806419e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:49:32.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.233+0000 7f806b5ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8064073610 0x7f806419eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:49:32.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.233+0000 7f806b5ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f806410d110 0x7f8064198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:49:32.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.233+0000 7f806b5ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8064199130 con 0x7f8064072cf0 2023-09-23T09:49:32.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.233+0000 7f806b5ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80641992a0 con 0x7f8064073610 2023-09-23T09:49:32.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.233+0000 7f806b5ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8064199460 con 0x7f806410d110 2023-09-23T09:49:32.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.233+0000 7f806939b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8064072cf0 0x7f806419e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:49:32.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.233+0000 7f806939b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8064072cf0 0x7f806419e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52238/0 (socket says 172.21.15.82:52238) 2023-09-23T09:49:32.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.233+0000 7f806939b700 1 -- 172.21.15.82:0/3405667788 learned_addr learned my addr 172.21.15.82:0/3405667788 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:49:32.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.233+0000 7f8068b9a700 1 --2- 172.21.15.82:0/3405667788 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8064073610 0x7f806419eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:49:32.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.234+0000 7f806939b700 1 -- 172.21.15.82:0/3405667788 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f806410d110 msgr2=0x7f8064198960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:49:32.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.234+0000 7f806939b700 1 --2- 172.21.15.82:0/3405667788 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f806410d110 0x7f8064198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:49:32.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.234+0000 7f806939b700 1 -- 172.21.15.82:0/3405667788 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8064073610 msgr2=0x7f806419eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:49:32.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.234+0000 7f806939b700 1 --2- 172.21.15.82:0/3405667788 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8064073610 0x7f806419eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:49:32.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.234+0000 7f806939b700 1 -- 172.21.15.82:0/3405667788 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f805c009c40 con 0x7f8064072cf0 2023-09-23T09:49:32.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.234+0000 7f8068b9a700 1 --2- 172.21.15.82:0/3405667788 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8064073610 0x7f806419eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-23T09:49:32.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.234+0000 7f806939b700 1 --2- 172.21.15.82:0/3405667788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8064072cf0 0x7f806419e980 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f8060000c00 tx=0x7f80600057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:49:32.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.234+0000 7f805a7fc700 1 -- 172.21.15.82:0/3405667788 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f806001d070 con 0x7f8064072cf0 2023-09-23T09:49:32.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.234+0000 7f806b5ff700 1 -- 172.21.15.82:0/3405667788 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80600095f0 con 0x7f8064072cf0 2023-09-23T09:49:32.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.234+0000 7f805a7fc700 1 -- 172.21.15.82:0/3405667788 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8060022470 con 0x7f8064072cf0 2023-09-23T09:49:32.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.234+0000 7f805a7fc700 1 -- 172.21.15.82:0/3405667788 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8060017650 con 0x7f8064072cf0 2023-09-23T09:49:32.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.234+0000 7f806b5ff700 1 -- 172.21.15.82:0/3405667788 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80641a5900 con 0x7f8064072cf0 2023-09-23T09:49:32.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.235+0000 7f806b5ff700 1 -- 172.21.15.82:0/3405667788 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8064108320 con 0x7f8064072cf0 2023-09-23T09:49:32.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.237+0000 7f805a7fc700 1 -- 172.21.15.82:0/3405667788 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f80600225e0 con 0x7f8064072cf0 2023-09-23T09:49:32.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.239+0000 7f805a7fc700 1 --2- 172.21.15.82:0/3405667788 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f80500a0140 0x7f80500a2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:49:32.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.239+0000 7f805a7fc700 1 -- 172.21.15.82:0/3405667788 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f80600ccb30 con 0x7f8064072cf0 2023-09-23T09:49:32.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.239+0000 7f8068b9a700 1 --2- 172.21.15.82:0/3405667788 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f80500a0140 0x7f80500a2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:49:32.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.239+0000 7f8068b9a700 1 --2- 172.21.15.82:0/3405667788 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f80500a0140 0x7f80500a2600 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8054005950 tx=0x7f80540058e0 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:49:32.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.242+0000 7f805a7fc700 1 -- 172.21.15.82:0/3405667788 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f80600966c0 con 0x7f8064072cf0 2023-09-23T09:49:32.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.445+0000 7f806b5ff700 1 -- 172.21.15.82:0/3405667788 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8064199f30 con 0x7f8064072cf0 2023-09-23T09:49:32.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.446+0000 7f805a7fc700 1 -- 172.21.15.82:0/3405667788 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v181) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8060099ce0 con 0x7f8064072cf0 2023-09-23T09:49:32.447 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2023-09-23T09:49:32.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.448+0000 7f806b5ff700 1 -- 172.21.15.82:0/3405667788 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f80500a0140 msgr2=0x7f80500a2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:49:32.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.448+0000 7f806b5ff700 1 --2- 172.21.15.82:0/3405667788 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f80500a0140 0x7f80500a2600 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8054005950 tx=0x7f80540058e0 comp rx=0 tx=0).stop 2023-09-23T09:49:32.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.448+0000 7f806b5ff700 1 -- 172.21.15.82:0/3405667788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8064072cf0 msgr2=0x7f806419e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:49:32.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.448+0000 7f806b5ff700 1 --2- 172.21.15.82:0/3405667788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8064072cf0 0x7f806419e980 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f8060000c00 tx=0x7f80600057f0 comp rx=0 tx=0).stop 2023-09-23T09:49:32.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.448+0000 7f806b5ff700 1 -- 172.21.15.82:0/3405667788 shutdown_connections 2023-09-23T09:49:32.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.448+0000 7f806b5ff700 1 --2- 172.21.15.82:0/3405667788 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f80500a0140 0x7f80500a2600 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:49:32.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.448+0000 7f806b5ff700 1 --2- 172.21.15.82:0/3405667788 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f806410d110 0x7f8064198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:49:32.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.448+0000 7f806b5ff700 1 --2- 172.21.15.82:0/3405667788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8064072cf0 0x7f806419e980 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:49:32.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.448+0000 7f806b5ff700 1 --2- 172.21.15.82:0/3405667788 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8064073610 0x7f806419eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:49:32.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.448+0000 7f806b5ff700 1 -- 172.21.15.82:0/3405667788 >> 172.21.15.82:0/3405667788 conn(0x7f80640fc3a0 msgr2=0x7f80640fd010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:49:32.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.449+0000 7f806b5ff700 1 -- 172.21.15.82:0/3405667788 shutdown_connections 2023-09-23T09:49:32.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.449+0000 7f806b5ff700 1 -- 172.21.15.82:0/3405667788 wait complete. 2023-09-23T09:49:32.468 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-23T09:49:32.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.669+0000 7f4802fff700 1 -- 172.21.15.82:0/559525183 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47fc101250 msgr2=0x7f47fc10d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:49:32.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.669+0000 7f4802fff700 1 --2- 172.21.15.82:0/559525183 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47fc101250 0x7f47fc10d760 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f47f400b0a0 tx=0x7f47f400b3b0 comp rx=0 tx=0).stop 2023-09-23T09:49:32.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.669+0000 7f4802fff700 1 -- 172.21.15.82:0/559525183 shutdown_connections 2023-09-23T09:49:32.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.669+0000 7f4802fff700 1 --2- 172.21.15.82:0/559525183 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47fc101250 0x7f47fc10d760 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:49:32.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.669+0000 7f4802fff700 1 --2- 172.21.15.82:0/559525183 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f47fc1068a0 0x7f47fc106c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:49:32.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.669+0000 7f4802fff700 1 --2- 172.21.15.82:0/559525183 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47fc100890 0x7f47fc100d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:49:32.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.669+0000 7f4802fff700 1 -- 172.21.15.82:0/559525183 >> 172.21.15.82:0/559525183 conn(0x7f47fc0fc380 msgr2=0x7f47fc0fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:49:32.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.669+0000 7f4802fff700 1 -- 172.21.15.82:0/559525183 shutdown_connections 2023-09-23T09:49:32.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.669+0000 7f4802fff700 1 -- 172.21.15.82:0/559525183 wait complete. 2023-09-23T09:49:32.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.670+0000 7f4802fff700 1 Processor -- start 2023-09-23T09:49:32.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.670+0000 7f4802fff700 1 -- start start 2023-09-23T09:49:32.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.670+0000 7f4802fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47fc100890 0x7f47fc19e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:49:32.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.670+0000 7f4802fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f47fc101250 0x7f47fc19ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:49:32.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.671+0000 7f4802fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47fc1068a0 0x7f47fc1988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:49:32.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.671+0000 7f4802fff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47fc198f30 con 0x7f47fc100890 2023-09-23T09:49:32.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.671+0000 7f4802fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47fc1990a0 con 0x7f47fc1068a0 2023-09-23T09:49:32.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.671+0000 7f4802fff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47fc199260 con 0x7f47fc101250 2023-09-23T09:49:32.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.671+0000 7f4800d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47fc100890 0x7f47fc19e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:49:32.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.671+0000 7f480159c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47fc1068a0 0x7f47fc1988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:49:32.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.671+0000 7f4800d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47fc100890 0x7f47fc19e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52258/0 (socket says 172.21.15.82:52258) 2023-09-23T09:49:32.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.671+0000 7f4800d9b700 1 -- 172.21.15.82:0/4005682750 learned_addr learned my addr 172.21.15.82:0/4005682750 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:49:32.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.671+0000 7f47fbfff700 1 --2- 172.21.15.82:0/4005682750 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f47fc101250 0x7f47fc19ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:49:32.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.671+0000 7f4800d9b700 1 -- 172.21.15.82:0/4005682750 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f47fc101250 msgr2=0x7f47fc19ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:49:32.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.671+0000 7f4800d9b700 1 --2- 172.21.15.82:0/4005682750 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f47fc101250 0x7f47fc19ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:49:32.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.671+0000 7f4800d9b700 1 -- 172.21.15.82:0/4005682750 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47fc1068a0 msgr2=0x7f47fc1988c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:49:32.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.671+0000 7f4800d9b700 1 --2- 172.21.15.82:0/4005682750 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47fc1068a0 0x7f47fc1988c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:49:32.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.671+0000 7f4800d9b700 1 -- 172.21.15.82:0/4005682750 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47e8009520 con 0x7f47fc100890 2023-09-23T09:49:32.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.671+0000 7f480159c700 1 --2- 172.21.15.82:0/4005682750 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47fc1068a0 0x7f47fc1988c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-23T09:49:32.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.671+0000 7f4800d9b700 1 --2- 172.21.15.82:0/4005682750 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47fc100890 0x7f47fc19e850 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f47f000d950 tx=0x7f47f000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:49:32.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.672+0000 7f47f9ffb700 1 -- 172.21.15.82:0/4005682750 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f000f890 con 0x7f47fc100890 2023-09-23T09:49:32.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.672+0000 7f47f9ffb700 1 -- 172.21.15.82:0/4005682750 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f47f000fe80 con 0x7f47fc100890 2023-09-23T09:49:32.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.672+0000 7f47f9ffb700 1 -- 172.21.15.82:0/4005682750 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f000e3b0 con 0x7f47fc100890 2023-09-23T09:49:32.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.672+0000 7f4802fff700 1 -- 172.21.15.82:0/4005682750 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47f4009d00 con 0x7f47fc100890 2023-09-23T09:49:32.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.672+0000 7f4802fff700 1 -- 172.21.15.82:0/4005682750 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47fc1a5660 con 0x7f47fc100890 2023-09-23T09:49:32.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.673+0000 7f4802fff700 1 -- 172.21.15.82:0/4005682750 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47fc0676a0 con 0x7f47fc100890 2023-09-23T09:49:32.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.675+0000 7f47f9ffb700 1 -- 172.21.15.82:0/4005682750 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f47f0010460 con 0x7f47fc100890 2023-09-23T09:49:32.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.676+0000 7f47f9ffb700 1 --2- 172.21.15.82:0/4005682750 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f47ec0a0140 0x7f47ec0a2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:49:32.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.676+0000 7f47f9ffb700 1 -- 172.21.15.82:0/4005682750 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f47f00cb340 con 0x7f47fc100890 2023-09-23T09:49:32.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.676+0000 7f47fbfff700 1 --2- 172.21.15.82:0/4005682750 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f47ec0a0140 0x7f47ec0a2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:49:32.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.677+0000 7f47fbfff700 1 --2- 172.21.15.82:0/4005682750 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f47ec0a0140 0x7f47ec0a2600 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f47fc105e20 tx=0x7f47e8009260 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:49:32.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.680+0000 7f47f9ffb700 1 -- 172.21.15.82:0/4005682750 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f47f0094d30 con 0x7f47fc100890 2023-09-23T09:49:32.810 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:49:32 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/1315509967' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-23T09:49:32.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:49:32 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/3530809892' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-23T09:49:32.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:49:32 smithi135 ceph-mon[99205]: pgmap v1674: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-09-23T09:49:32.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:49:32 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/3405667788' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-09-23T09:49:32.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:49:32 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/1315509967' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-23T09:49:32.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:49:32 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/3530809892' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-23T09:49:32.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:49:32 smithi082 ceph-mon[97694]: pgmap v1674: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-09-23T09:49:32.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:49:32 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/3405667788' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-09-23T09:49:32.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.880+0000 7f4802fff700 1 -- 172.21.15.82:0/4005682750 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f47fc110960 con 0x7f47fc100890 2023-09-23T09:49:32.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.881+0000 7f47f9ffb700 1 -- 172.21.15.82:0/4005682750 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v181) v1 ==== 100+0+11 (secure 0 0 0) 0x7f47f0098350 con 0x7f47fc100890 2023-09-23T09:49:32.882 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2023-09-23T09:49:32.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.884+0000 7f4802fff700 1 -- 172.21.15.82:0/4005682750 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f47ec0a0140 msgr2=0x7f47ec0a2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:49:32.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.884+0000 7f4802fff700 1 --2- 172.21.15.82:0/4005682750 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f47ec0a0140 0x7f47ec0a2600 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f47fc105e20 tx=0x7f47e8009260 comp rx=0 tx=0).stop 2023-09-23T09:49:32.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.884+0000 7f4802fff700 1 -- 172.21.15.82:0/4005682750 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47fc100890 msgr2=0x7f47fc19e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:49:32.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.884+0000 7f4802fff700 1 --2- 172.21.15.82:0/4005682750 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47fc100890 0x7f47fc19e850 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f47f000d950 tx=0x7f47f000dc60 comp rx=0 tx=0).stop 2023-09-23T09:49:32.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.884+0000 7f4802fff700 1 -- 172.21.15.82:0/4005682750 shutdown_connections 2023-09-23T09:49:32.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.884+0000 7f4802fff700 1 --2- 172.21.15.82:0/4005682750 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f47ec0a0140 0x7f47ec0a2600 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:49:32.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.884+0000 7f4802fff700 1 --2- 172.21.15.82:0/4005682750 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47fc1068a0 0x7f47fc1988c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:49:32.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.884+0000 7f4802fff700 1 --2- 172.21.15.82:0/4005682750 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47fc100890 0x7f47fc19e850 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:49:32.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.884+0000 7f4802fff700 1 --2- 172.21.15.82:0/4005682750 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f47fc101250 0x7f47fc19ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:49:32.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.884+0000 7f4802fff700 1 -- 172.21.15.82:0/4005682750 >> 172.21.15.82:0/4005682750 conn(0x7f47fc0fc380 msgr2=0x7f47fc10bda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:49:32.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.884+0000 7f4802fff700 1 -- 172.21.15.82:0/4005682750 shutdown_connections 2023-09-23T09:49:32.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:32.884+0000 7f4802fff700 1 -- 172.21.15.82:0/4005682750 wait complete. 2023-09-23T09:49:32.896 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:49:32 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/1315509967' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-23T09:49:32.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:49:32 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/3530809892' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-23T09:49:32.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:49:32 smithi161 ceph-mon[99580]: pgmap v1674: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-09-23T09:49:32.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:49:32 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/3405667788' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-09-23T09:49:32.903 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-09-23T09:49:33.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:33.099+0000 7f67347ff700 1 -- 172.21.15.82:0/1442792703 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f672c101250 msgr2=0x7f672c10d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:49:33.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:33.099+0000 7f67347ff700 1 --2- 172.21.15.82:0/1442792703 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f672c101250 0x7f672c10d760 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f6724009f90 tx=0x7f672400b330 comp rx=0 tx=0).stop 2023-09-23T09:49:33.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:33.099+0000 7f67347ff700 1 -- 172.21.15.82:0/1442792703 shutdown_connections 2023-09-23T09:49:33.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:33.099+0000 7f67347ff700 1 --2- 172.21.15.82:0/1442792703 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f672c101250 0x7f672c10d760 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:49:33.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:33.099+0000 7f67347ff700 1 --2- 172.21.15.82:0/1442792703 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f672c1068a0 0x7f672c106c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:49:33.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:33.099+0000 7f67347ff700 1 --2- 172.21.15.82:0/1442792703 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f672c100890 0x7f672c100d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:49:33.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:33.099+0000 7f67347ff700 1 -- 172.21.15.82:0/1442792703 >> 172.21.15.82:0/1442792703 conn(0x7f672c0fc380 msgr2=0x7f672c0fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:49:33.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:33.099+0000 7f67347ff700 1 -- 172.21.15.82:0/1442792703 shutdown_connections 2023-09-23T09:49:33.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:33.099+0000 7f67347ff700 1 -- 172.21.15.82:0/1442792703 wait complete. 2023-09-23T09:49:33.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:33.100+0000 7f67347ff700 1 Processor -- start 2023-09-23T09:49:33.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:33.101+0000 7f67347ff700 1 -- start start 2023-09-23T09:49:33.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:33.101+0000 7f67347ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f672c100890 0x7f672c19e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:49:33.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:33.101+0000 7f67347ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f672c101250 0x7f672c19eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:49:33.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:33.101+0000 7f67347ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f672c1068a0 0x7f672c198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:49:33.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:33.101+0000 7f67347ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f672c199110 con 0x7f672c101250 2023-09-23T09:49:33.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:33.101+0000 7f67347ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f672c199280 con 0x7f672c1068a0 2023-09-23T09:49:33.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:33.101+0000 7f67347ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f672c199440 con 0x7f672c100890 2023-09-23T09:49:33.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:33.101+0000 7f6731d9a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f672c101250 0x7f672c19eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:49:33.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:33.101+0000 7f6731d9a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f672c101250 0x7f672c19eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52278/0 (socket says 172.21.15.82:52278) 2023-09-23T09:49:33.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:33.101+0000 7f6731d9a700 1 -- 172.21.15.82:0/1358247705 learned_addr learned my addr 172.21.15.82:0/1358247705 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-09-23T09:49:33.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:33.101+0000 7f6732d9c700 1 --2- 172.21.15.82:0/1358247705 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f672c1068a0 0x7f672c198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:49:33.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:33.101+0000 7f673259b700 1 --2- 172.21.15.82:0/1358247705 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f672c100890 0x7f672c19e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:49:33.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:33.102+0000 7f6731d9a700 1 -- 172.21.15.82:0/1358247705 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f672c100890 msgr2=0x7f672c19e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:49:33.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:33.102+0000 7f6731d9a700 1 --2- 172.21.15.82:0/1358247705 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f672c100890 0x7f672c19e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:49:33.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:33.102+0000 7f6731d9a700 1 -- 172.21.15.82:0/1358247705 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f672c1068a0 msgr2=0x7f672c198940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:49:33.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:33.102+0000 7f6731d9a700 1 --2- 172.21.15.82:0/1358247705 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f672c1068a0 0x7f672c198940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:49:33.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:33.102+0000 7f6731d9a700 1 -- 172.21.15.82:0/1358247705 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6724009c40 con 0x7f672c101250 2023-09-23T09:49:33.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:33.102+0000 7f6731d9a700 1 --2- 172.21.15.82:0/1358247705 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f672c101250 0x7f672c19eea0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f671c00c9b0 tx=0x7f671c00ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:49:33.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:33.102+0000 7f67237fe700 1 -- 172.21.15.82:0/1358247705 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f671c007b00 con 0x7f672c101250 2023-09-23T09:49:33.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:33.102+0000 7f67347ff700 1 -- 172.21.15.82:0/1358247705 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f672c199720 con 0x7f672c101250 2023-09-23T09:49:33.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:33.102+0000 7f67237fe700 1 -- 172.21.15.82:0/1358247705 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f671c007c60 con 0x7f672c101250 2023-09-23T09:49:33.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:33.102+0000 7f67237fe700 1 -- 172.21.15.82:0/1358247705 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f671c018660 con 0x7f672c101250 2023-09-23T09:49:33.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:33.102+0000 7f67347ff700 1 -- 172.21.15.82:0/1358247705 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f672c1a58e0 con 0x7f672c101250 2023-09-23T09:49:33.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:33.103+0000 7f67347ff700 1 -- 172.21.15.82:0/1358247705 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f672c0676a0 con 0x7f672c101250 2023-09-23T09:49:33.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:33.105+0000 7f67237fe700 1 -- 172.21.15.82:0/1358247705 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 26) v1 ==== 134802+0+0 (secure 0 0 0) 0x7f671c00f450 con 0x7f672c101250 2023-09-23T09:49:33.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:33.106+0000 7f67237fe700 1 --2- 172.21.15.82:0/1358247705 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f67180a00c0 0x7f67180a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-23T09:49:33.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:33.107+0000 7f67237fe700 1 -- 172.21.15.82:0/1358247705 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f671c0cb670 con 0x7f672c101250 2023-09-23T09:49:33.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:33.107+0000 7f673259b700 1 --2- 172.21.15.82:0/1358247705 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f67180a00c0 0x7f67180a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-23T09:49:33.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:33.107+0000 7f673259b700 1 --2- 172.21.15.82:0/1358247705 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f67180a00c0 0x7f67180a2580 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6728005fd0 tx=0x7f6728009310 comp rx=0 tx=0).ready entity=mgr.15537 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-23T09:49:33.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:33.110+0000 7f67237fe700 1 -- 172.21.15.82:0/1358247705 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179682 (secure 0 0 0) 0x7f671c095060 con 0x7f672c101250 2023-09-23T09:49:33.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:33.329+0000 7f67347ff700 1 -- 172.21.15.82:0/1358247705 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f672c199e70 con 0x7f672c101250 2023-09-23T09:49:33.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:33.330+0000 7f67237fe700 1 -- 172.21.15.82:0/1358247705 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 16 entries v181) v1 ==== 81+0+945 (secure 0 0 0) 0x7f671c00fe60 con 0x7f672c101250 2023-09-23T09:49:33.331 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/1769657494 2023-09-24T08:56:53.091759+0000 2023-09-23T09:49:33.331 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6801/3698954311 2023-09-24T08:56:53.091759+0000 2023-09-23T09:49:33.332 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/4204712132 2023-09-24T08:47:21.957866+0000 2023-09-23T09:49:33.332 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/2391800294 2023-09-24T08:56:53.091759+0000 2023-09-23T09:49:33.332 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6801/2733521564 2023-09-24T08:47:21.957866+0000 2023-09-23T09:49:33.332 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6800/2733521564 2023-09-24T08:47:21.957866+0000 2023-09-23T09:49:33.332 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/3964794665 2023-09-24T08:47:21.957866+0000 2023-09-23T09:49:33.332 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/3535372205 2023-09-24T08:46:55.187024+0000 2023-09-23T09:49:33.332 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6800/3698954311 2023-09-24T08:56:53.091759+0000 2023-09-23T09:49:33.332 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/285559684 2023-09-24T08:46:55.187024+0000 2023-09-23T09:49:33.333 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/1232294461 2023-09-24T08:56:53.091759+0000 2023-09-23T09:49:33.333 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/1335891896 2023-09-24T08:46:55.187024+0000 2023-09-23T09:49:33.333 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6801/3761509623 2023-09-24T08:46:55.187024+0000 2023-09-23T09:49:33.333 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6800/3761509623 2023-09-24T08:46:55.187024+0000 2023-09-23T09:49:33.333 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/3074646956 2023-09-24T08:56:53.091759+0000 2023-09-23T09:49:33.333 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/3775317005 2023-09-24T08:47:21.957866+0000 2023-09-23T09:49:33.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:33.332+0000 7f67347ff700 1 -- 172.21.15.82:0/1358247705 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f67180a00c0 msgr2=0x7f67180a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:49:33.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:33.332+0000 7f67347ff700 1 --2- 172.21.15.82:0/1358247705 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f67180a00c0 0x7f67180a2580 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6728005fd0 tx=0x7f6728009310 comp rx=0 tx=0).stop 2023-09-23T09:49:33.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:33.332+0000 7f67347ff700 1 -- 172.21.15.82:0/1358247705 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f672c101250 msgr2=0x7f672c19eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-23T09:49:33.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:33.332+0000 7f67347ff700 1 --2- 172.21.15.82:0/1358247705 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f672c101250 0x7f672c19eea0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f671c00c9b0 tx=0x7f671c00ccc0 comp rx=0 tx=0).stop 2023-09-23T09:49:33.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:33.332+0000 7f67347ff700 1 -- 172.21.15.82:0/1358247705 shutdown_connections 2023-09-23T09:49:33.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:33.332+0000 7f67347ff700 1 --2- 172.21.15.82:0/1358247705 >> [v2:172.21.15.82:6800/630725563,v1:172.21.15.82:6801/630725563] conn(0x7f67180a00c0 0x7f67180a2580 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:49:33.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:33.332+0000 7f67347ff700 1 --2- 172.21.15.82:0/1358247705 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f672c1068a0 0x7f672c198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:49:33.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:33.332+0000 7f67347ff700 1 --2- 172.21.15.82:0/1358247705 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f672c100890 0x7f672c19e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:49:33.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:33.332+0000 7f67347ff700 1 --2- 172.21.15.82:0/1358247705 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f672c101250 0x7f672c19eea0 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-23T09:49:33.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:33.332+0000 7f67347ff700 1 -- 172.21.15.82:0/1358247705 >> 172.21.15.82:0/1358247705 conn(0x7f672c0fc380 msgr2=0x7f672c0fc910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-23T09:49:33.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:33.333+0000 7f67347ff700 1 -- 172.21.15.82:0/1358247705 shutdown_connections 2023-09-23T09:49:33.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-09-23T09:49:33.333+0000 7f67347ff700 1 -- 172.21.15.82:0/1358247705 wait complete. 2023-09-23T09:49:33.336 INFO:teuthology.orchestra.run.smithi082.stderr:listed 16 entries 2023-09-23T09:49:33.353 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi082.front.sepia.ceph.com... 2023-09-23T09:49:33.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-23T09:49:33.353 DEBUG:teuthology.orchestra.run.smithi082:> sudo fusermount -u /tmp/cephfs 2023-09-23T09:49:33.428 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi082.stderr:ceph-fuse[146379]: fuse finished with error 0 and tester_r 0 2023-09-23T09:49:33.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:49:33 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/4005682750' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-09-23T09:49:33.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:49:33 smithi082 ceph-mon[97694]: from='client.? 172.21.15.82:0/1358247705' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-09-23T09:49:33.818 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:49:33 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/4005682750' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-09-23T09:49:33.819 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:49:33 smithi135 ceph-mon[99205]: from='client.? 172.21.15.82:0/1358247705' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-09-23T09:49:33.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:49:33 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/4005682750' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-09-23T09:49:33.898 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:49:33 smithi161 ceph-mon[99580]: from='client.? 172.21.15.82:0/1358247705' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-09-23T09:49:34.004 INFO:teuthology.orchestra.run:waiting for 300 2023-09-23T09:49:34.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:49:34 smithi082 ceph-mon[97694]: pgmap v1675: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-09-23T09:49:35.063 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:49:34 smithi135 ceph-mon[99205]: pgmap v1675: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-09-23T09:49:35.148 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:49:34 smithi161 ceph-mon[99580]: pgmap v1675: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-09-23T09:49:37.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:49:37 smithi082 ceph-mon[97694]: pgmap v1676: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 767 B/s wr, 13 op/s 2023-09-23T09:49:37.396 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:49:37 smithi161 ceph-mon[99580]: pgmap v1676: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 767 B/s wr, 13 op/s 2023-09-23T09:49:37.560 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:49:37 smithi135 ceph-mon[99205]: pgmap v1676: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 767 B/s wr, 13 op/s 2023-09-23T09:49:38.810 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:49:38 smithi135 ceph-mon[99205]: pgmap v1677: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 21 KiB/s wr, 10 op/s 2023-09-23T09:49:38.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:49:38 smithi082 ceph-mon[97694]: pgmap v1677: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 21 KiB/s wr, 10 op/s 2023-09-23T09:49:38.896 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:49:38 smithi161 ceph-mon[99580]: pgmap v1677: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 21 KiB/s wr, 10 op/s 2023-09-23T09:49:40.106 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi082.front.sepia.ceph.com 2023-09-23T09:49:40.106 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-23T09:49:40.107 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest && exec rmdir -- /tmp/cephfs) 2023-09-23T09:49:40.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-23T09:49:40.180 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2023-09-23T09:49:40.245 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-ns--tmp-cephfs (id: 0) 2023-09-23T09:49:40.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-23T09:49:40.246 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns delete ceph-ns--tmp-cephfs 2023-09-23T09:49:40.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-23T09:49:40.317 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link delete ceph-brx 2023-09-23T09:49:40.426 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2023-09-23T09:49:40.437 INFO:tasks.cephadm:Teardown begin 2023-09-23T09:49:40.437 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_db9a2d12746faa158579b8d032d53d472ae6b6b0/qa/tasks/cephadm.py", line 1756, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_db9a2d12746faa158579b8d032d53d472ae6b6b0/qa/tasks/fwd_scrub.py", line 164, in task stop_all_fwd_scrubbers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph-c_db9a2d12746faa158579b8d032d53d472ae6b6b0/qa/tasks/fwd_scrub.py", line 99, in stop_all_fwd_scrubbers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: reached maximum tries (31) after waiting for 900 seconds 2023-09-23T09:49:40.480 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-09-23T09:49:40.557 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-09-23T09:49:40.663 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-09-23T09:49:40.819 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2023-09-23T09:49:40.819 DEBUG:teuthology.orchestra.run.smithi082:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-09-23T09:49:40.879 DEBUG:teuthology.orchestra.run.smithi135:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-09-23T09:49:40.931 DEBUG:teuthology.orchestra.run.smithi161:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-09-23T09:49:40.985 INFO:tasks.cephadm:Stopping all daemons... 2023-09-23T09:49:40.986 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2023-09-23T09:49:40.987 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@mon.a 2023-09-23T09:49:41.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:49:41 smithi082 systemd[1]: Stopping Ceph mon.a for 8926e286-59ed-11ee-8db4-212e2dc638e7... 2023-09-23T09:49:41.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:49:41 smithi082 ceph-mon[97694]: pgmap v1678: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 21 KiB/s wr, 10 op/s 2023-09-23T09:49:41.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:49:41 smithi161 ceph-mon[99580]: pgmap v1678: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 21 KiB/s wr, 10 op/s 2023-09-23T09:49:41.560 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:49:41 smithi135 ceph-mon[99205]: pgmap v1678: 97 pgs: 97 active+clean; 12 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 21 KiB/s wr, 10 op/s 2023-09-23T09:49:41.799 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:49:41 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mon-a[97670]: 2023-09-23T09:49:41.493+0000 7fc878190700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-09-23T09:49:41.799 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:49:41 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mon-a[97670]: 2023-09-23T09:49:41.493+0000 7fc878190700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2023-09-23T09:49:42.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Sep 23 09:49:42 smithi082 bash[187751]: ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mon-a 2023-09-23T09:49:42.453 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@mon.a.service' 2023-09-23T09:49:42.557 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-09-23T09:49:42.557 INFO:tasks.cephadm.mon.a:Stopped mon.a 2023-09-23T09:49:42.557 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2023-09-23T09:49:42.557 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@mon.b 2023-09-23T09:49:43.060 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:49:42 smithi135 systemd[1]: Stopping Ceph mon.b for 8926e286-59ed-11ee-8db4-212e2dc638e7... 2023-09-23T09:49:43.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:49:43 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mon-b[99181]: 2023-09-23T09:49:43.218+0000 7f4252528700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-09-23T09:49:43.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:49:43 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mon-b[99181]: 2023-09-23T09:49:43.218+0000 7f4252528700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2023-09-23T09:49:44.275 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 23 09:49:43 smithi135 bash[140739]: ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mon-b 2023-09-23T09:49:44.300 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@mon.b.service' 2023-09-23T09:49:44.414 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-09-23T09:49:44.414 INFO:tasks.cephadm.mon.c:Stopped mon.b 2023-09-23T09:49:44.414 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2023-09-23T09:49:44.414 DEBUG:teuthology.orchestra.run.smithi161:> sudo systemctl stop ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@mon.c 2023-09-23T09:49:44.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:49:44 smithi161 systemd[1]: Stopping Ceph mon.c for 8926e286-59ed-11ee-8db4-212e2dc638e7... 2023-09-23T09:49:45.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:49:45 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mon-c[99556]: 2023-09-23T09:49:45.015+0000 7f5c76280700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-09-23T09:49:45.397 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:49:45 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mon-c[99556]: 2023-09-23T09:49:45.015+0000 7f5c76280700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2023-09-23T09:49:45.897 INFO:journalctl@ceph.mon.c.smithi161.stdout:Sep 23 09:49:45 smithi161 bash[140842]: ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mon-c 2023-09-23T09:49:45.951 DEBUG:teuthology.orchestra.run.smithi161:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@mon.c.service' 2023-09-23T09:49:46.049 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-09-23T09:49:46.050 INFO:tasks.cephadm.mon.c:Stopped mon.c 2023-09-23T09:49:46.050 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2023-09-23T09:49:46.050 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@mgr.x 2023-09-23T09:49:46.578 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 09:49:46 smithi082 systemd[1]: Stopping Ceph mgr.x for 8926e286-59ed-11ee-8db4-212e2dc638e7... 2023-09-23T09:49:46.869 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 09:49:46 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x[97940]: 2023-09-23T09:49:46.575+0000 7f492dec2700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-09-23T09:49:47.359 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Sep 23 09:49:46 smithi082 bash[187899]: ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-x 2023-09-23T09:49:47.391 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@mgr.x.service' 2023-09-23T09:49:47.480 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-09-23T09:49:47.480 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2023-09-23T09:49:47.481 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2023-09-23T09:49:47.481 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@mgr.y 2023-09-23T09:49:47.810 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Sep 23 09:49:47 smithi135 systemd[1]: Stopping Ceph mgr.y for 8926e286-59ed-11ee-8db4-212e2dc638e7... 2023-09-23T09:49:48.650 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Sep 23 09:49:48 smithi135 bash[140884]: ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-y 2023-09-23T09:49:48.901 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Sep 23 09:49:48 smithi135 systemd[1]: ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@mgr.y.service: Main process exited, code=exited, status=143/n/a 2023-09-23T09:49:48.902 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Sep 23 09:49:48 smithi135 systemd[1]: ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@mgr.y.service: Failed with result 'exit-code'. 2023-09-23T09:49:48.902 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Sep 23 09:49:48 smithi135 systemd[1]: Stopped Ceph mgr.y for 8926e286-59ed-11ee-8db4-212e2dc638e7. 2023-09-23T09:49:48.904 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@mgr.y.service' 2023-09-23T09:49:48.999 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-09-23T09:49:48.999 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2023-09-23T09:49:48.999 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2023-09-23T09:49:48.999 DEBUG:teuthology.orchestra.run.smithi161:> sudo systemctl stop ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@mgr.z 2023-09-23T09:49:49.396 INFO:journalctl@ceph.mgr.z.smithi161.stdout:Sep 23 09:49:49 smithi161 systemd[1]: Stopping Ceph mgr.z for 8926e286-59ed-11ee-8db4-212e2dc638e7... 2023-09-23T09:49:50.146 INFO:journalctl@ceph.mgr.z.smithi161.stdout:Sep 23 09:49:49 smithi161 bash[140990]: ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mgr-z 2023-09-23T09:49:50.364 DEBUG:teuthology.orchestra.run.smithi161:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@mgr.z.service' 2023-09-23T09:49:50.453 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-09-23T09:49:50.453 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2023-09-23T09:49:50.453 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2023-09-23T09:49:50.453 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@osd.0 2023-09-23T09:49:50.869 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 23 09:49:50 smithi082 systemd[1]: Stopping Ceph osd.0 for 8926e286-59ed-11ee-8db4-212e2dc638e7... 2023-09-23T09:49:51.369 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 23 09:49:50 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-0[110806]: 2023-09-23T09:49:50.957+0000 7fea6fac6700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-09-23T09:49:51.369 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 23 09:49:50 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-0[110806]: 2023-09-23T09:49:50.957+0000 7fea6fac6700 -1 osd.0 181 *** Got signal Terminated *** 2023-09-23T09:49:51.369 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 23 09:49:50 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-0[110806]: 2023-09-23T09:49:50.957+0000 7fea6fac6700 -1 osd.0 181 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-09-23T09:49:57.370 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 23 09:49:56 smithi082 bash[188045]: ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-0 2023-09-23T09:49:59.184 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@osd.0.service' 2023-09-23T09:49:59.276 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-09-23T09:49:59.276 INFO:tasks.cephadm.osd.0:Stopped osd.0 2023-09-23T09:49:59.276 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2023-09-23T09:49:59.276 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@osd.1 2023-09-23T09:49:59.789 INFO:journalctl@ceph.osd.1.smithi135.stdout:Sep 23 09:49:59 smithi135 systemd[1]: Stopping Ceph osd.1 for 8926e286-59ed-11ee-8db4-212e2dc638e7... 2023-09-23T09:50:00.060 INFO:journalctl@ceph.osd.1.smithi135.stdout:Sep 23 09:49:59 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-1[104312]: 2023-09-23T09:49:59.786+0000 7f1032f7e700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-09-23T09:50:00.061 INFO:journalctl@ceph.osd.1.smithi135.stdout:Sep 23 09:49:59 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-1[104312]: 2023-09-23T09:49:59.786+0000 7f1032f7e700 -1 osd.1 181 *** Got signal Terminated *** 2023-09-23T09:50:00.061 INFO:journalctl@ceph.osd.1.smithi135.stdout:Sep 23 09:49:59 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-1[104312]: 2023-09-23T09:49:59.786+0000 7f1032f7e700 -1 osd.1 181 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-09-23T09:50:06.311 INFO:journalctl@ceph.osd.1.smithi135.stdout:Sep 23 09:50:05 smithi135 bash[141035]: ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-1 2023-09-23T09:50:08.089 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@osd.1.service' 2023-09-23T09:50:08.180 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-09-23T09:50:08.180 INFO:tasks.cephadm.osd.1:Stopped osd.1 2023-09-23T09:50:08.180 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2023-09-23T09:50:08.181 DEBUG:teuthology.orchestra.run.smithi161:> sudo systemctl stop ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@osd.2 2023-09-23T09:50:08.647 INFO:journalctl@ceph.osd.2.smithi161.stdout:Sep 23 09:50:08 smithi161 systemd[1]: Stopping Ceph osd.2 for 8926e286-59ed-11ee-8db4-212e2dc638e7... 2023-09-23T09:50:09.147 INFO:journalctl@ceph.osd.2.smithi161.stdout:Sep 23 09:50:08 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-2[105440]: 2023-09-23T09:50:08.695+0000 7f1a53737700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-09-23T09:50:09.147 INFO:journalctl@ceph.osd.2.smithi161.stdout:Sep 23 09:50:08 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-2[105440]: 2023-09-23T09:50:08.695+0000 7f1a53737700 -1 osd.2 181 *** Got signal Terminated *** 2023-09-23T09:50:09.147 INFO:journalctl@ceph.osd.2.smithi161.stdout:Sep 23 09:50:08 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-2[105440]: 2023-09-23T09:50:08.695+0000 7f1a53737700 -1 osd.2 181 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-09-23T09:50:15.147 INFO:journalctl@ceph.osd.2.smithi161.stdout:Sep 23 09:50:14 smithi161 bash[141150]: ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-2 2023-09-23T09:50:16.929 DEBUG:teuthology.orchestra.run.smithi161:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@osd.2.service' 2023-09-23T09:50:17.019 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-09-23T09:50:17.020 INFO:tasks.cephadm.osd.2:Stopped osd.2 2023-09-23T09:50:17.020 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2023-09-23T09:50:17.020 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@osd.3 2023-09-23T09:50:17.369 INFO:journalctl@ceph.osd.3.smithi082.stdout:Sep 23 09:50:17 smithi082 systemd[1]: Stopping Ceph osd.3 for 8926e286-59ed-11ee-8db4-212e2dc638e7... 2023-09-23T09:50:17.869 INFO:journalctl@ceph.osd.3.smithi082.stdout:Sep 23 09:50:17 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-3[116365]: 2023-09-23T09:50:17.518+0000 7f46d71b1700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-09-23T09:50:17.869 INFO:journalctl@ceph.osd.3.smithi082.stdout:Sep 23 09:50:17 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-3[116365]: 2023-09-23T09:50:17.518+0000 7f46d71b1700 -1 osd.3 181 *** Got signal Terminated *** 2023-09-23T09:50:17.869 INFO:journalctl@ceph.osd.3.smithi082.stdout:Sep 23 09:50:17 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-3[116365]: 2023-09-23T09:50:17.518+0000 7f46d71b1700 -1 osd.3 181 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-09-23T09:50:18.369 INFO:journalctl@ceph.osd.3.smithi082.stdout:Sep 23 09:50:17 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-3[116365]: 2023-09-23T09:50:17.890+0000 7f46d1fa4700 -1 osd.3 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:51.814504+0000 front 2023-09-23T09:49:51.814731+0000 (oldest deadline 2023-09-23T09:50:17.714650+0000) 2023-09-23T09:50:18.369 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:17 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:17.955+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.275199+0000 front 2023-09-23T09:49:55.275227+0000 (oldest deadline 2023-09-23T09:50:17.575468+0000) 2023-09-23T09:50:18.396 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:17 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:17.969+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.407793+0000 front 2023-09-23T09:49:54.407750+0000 (oldest deadline 2023-09-23T09:50:17.907823+0000) 2023-09-23T09:50:18.875 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 23 09:50:18 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-5[110963]: 2023-09-23T09:50:18.399+0000 7f1224ab9700 -1 osd.5 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:53.155290+0000 front 2023-09-23T09:49:53.155377+0000 (oldest deadline 2023-09-23T09:50:17.855194+0000) 2023-09-23T09:50:19.119 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:18 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:18.979+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.275199+0000 front 2023-09-23T09:49:55.275227+0000 (oldest deadline 2023-09-23T09:50:17.575468+0000) 2023-09-23T09:50:19.119 INFO:journalctl@ceph.osd.3.smithi082.stdout:Sep 23 09:50:18 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-3[116365]: 2023-09-23T09:50:18.856+0000 7f46d1fa4700 -1 osd.3 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:51.814504+0000 front 2023-09-23T09:49:51.814731+0000 (oldest deadline 2023-09-23T09:50:17.714650+0000) 2023-09-23T09:50:19.146 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:18 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:18.979+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.407793+0000 front 2023-09-23T09:49:54.407750+0000 (oldest deadline 2023-09-23T09:50:17.907823+0000) 2023-09-23T09:50:19.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:18 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:18.873+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.535551+0000 front 2023-09-23T09:49:54.535491+0000 (oldest deadline 2023-09-23T09:50:18.535947+0000) 2023-09-23T09:50:19.310 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:19 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:19.049+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.643334+0000 front 2023-09-23T09:49:55.643391+0000 (oldest deadline 2023-09-23T09:50:18.543466+0000) 2023-09-23T09:50:19.646 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 23 09:50:19 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-5[110963]: 2023-09-23T09:50:19.394+0000 7f1224ab9700 -1 osd.5 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:53.155290+0000 front 2023-09-23T09:49:53.155377+0000 (oldest deadline 2023-09-23T09:50:17.855194+0000) 2023-09-23T09:50:20.119 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:19 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:19.995+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.275199+0000 front 2023-09-23T09:49:55.275227+0000 (oldest deadline 2023-09-23T09:50:17.575468+0000) 2023-09-23T09:50:20.119 INFO:journalctl@ceph.osd.3.smithi082.stdout:Sep 23 09:50:19 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-3[116365]: 2023-09-23T09:50:19.810+0000 7f46d1fa4700 -1 osd.3 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:51.814504+0000 front 2023-09-23T09:49:51.814731+0000 (oldest deadline 2023-09-23T09:50:17.714650+0000) 2023-09-23T09:50:20.146 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:20 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:20.024+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.407793+0000 front 2023-09-23T09:49:54.407750+0000 (oldest deadline 2023-09-23T09:50:17.907823+0000) 2023-09-23T09:50:20.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:19 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:19.831+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.535551+0000 front 2023-09-23T09:49:54.535491+0000 (oldest deadline 2023-09-23T09:50:18.535947+0000) 2023-09-23T09:50:20.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:20 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:20.005+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.643334+0000 front 2023-09-23T09:49:55.643391+0000 (oldest deadline 2023-09-23T09:50:18.543466+0000) 2023-09-23T09:50:20.863 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 23 09:50:20 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-5[110963]: 2023-09-23T09:50:20.438+0000 7f1224ab9700 -1 osd.5 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:53.155290+0000 front 2023-09-23T09:49:53.155377+0000 (oldest deadline 2023-09-23T09:50:17.855194+0000) 2023-09-23T09:50:20.869 INFO:journalctl@ceph.osd.3.smithi082.stdout:Sep 23 09:50:20 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-3[116365]: 2023-09-23T09:50:20.788+0000 7f46d1fa4700 -1 osd.3 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:51.814504+0000 front 2023-09-23T09:49:51.814731+0000 (oldest deadline 2023-09-23T09:50:17.714650+0000) 2023-09-23T09:50:20.869 INFO:journalctl@ceph.osd.6.smithi082.stdout:Sep 23 09:50:20 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-6[121893]: 2023-09-23T09:50:20.598+0000 7fa831cf8700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.842973+0000 front 2023-09-23T09:49:55.843327+0000 (oldest deadline 2023-09-23T09:50:20.543228+0000) 2023-09-23T09:50:21.146 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:20 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:20.862+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.535551+0000 front 2023-09-23T09:49:54.535491+0000 (oldest deadline 2023-09-23T09:50:18.535947+0000) 2023-09-23T09:50:21.147 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:21 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:21.005+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.407793+0000 front 2023-09-23T09:49:54.407750+0000 (oldest deadline 2023-09-23T09:50:17.907823+0000) 2023-09-23T09:50:21.310 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:20 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:20.994+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.643334+0000 front 2023-09-23T09:49:55.643391+0000 (oldest deadline 2023-09-23T09:50:18.543466+0000) 2023-09-23T09:50:21.369 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:20 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:20.976+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.275199+0000 front 2023-09-23T09:49:55.275227+0000 (oldest deadline 2023-09-23T09:50:17.575468+0000) 2023-09-23T09:50:21.880 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 23 09:50:21 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-5[110963]: 2023-09-23T09:50:21.399+0000 7f1224ab9700 -1 osd.5 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:53.155290+0000 front 2023-09-23T09:49:53.155377+0000 (oldest deadline 2023-09-23T09:50:17.855194+0000) 2023-09-23T09:50:21.974 INFO:journalctl@ceph.osd.3.smithi082.stdout:Sep 23 09:50:21 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-3[116365]: 2023-09-23T09:50:21.802+0000 7f46d1fa4700 -1 osd.3 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:51.814504+0000 front 2023-09-23T09:49:51.814731+0000 (oldest deadline 2023-09-23T09:50:17.714650+0000) 2023-09-23T09:50:21.974 INFO:journalctl@ceph.osd.6.smithi082.stdout:Sep 23 09:50:21 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-6[121893]: 2023-09-23T09:50:21.647+0000 7fa831cf8700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.842973+0000 front 2023-09-23T09:49:55.843327+0000 (oldest deadline 2023-09-23T09:50:20.543228+0000) 2023-09-23T09:50:22.146 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:21 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:21.878+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.535551+0000 front 2023-09-23T09:49:54.535491+0000 (oldest deadline 2023-09-23T09:50:18.535947+0000) 2023-09-23T09:50:22.146 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:22 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:22.042+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.407793+0000 front 2023-09-23T09:49:54.407750+0000 (oldest deadline 2023-09-23T09:50:17.907823+0000) 2023-09-23T09:50:22.310 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:21 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:21.949+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.643334+0000 front 2023-09-23T09:49:55.643391+0000 (oldest deadline 2023-09-23T09:50:18.543466+0000) 2023-09-23T09:50:22.369 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:21 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:21.972+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.275199+0000 front 2023-09-23T09:49:55.275227+0000 (oldest deadline 2023-09-23T09:50:17.575468+0000) 2023-09-23T09:50:22.646 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 23 09:50:22 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-5[110963]: 2023-09-23T09:50:22.368+0000 7f1224ab9700 -1 osd.5 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:53.155290+0000 front 2023-09-23T09:49:53.155377+0000 (oldest deadline 2023-09-23T09:50:17.855194+0000) 2023-09-23T09:50:22.945 INFO:journalctl@ceph.osd.6.smithi082.stdout:Sep 23 09:50:22 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-6[121893]: 2023-09-23T09:50:22.677+0000 7fa831cf8700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.842973+0000 front 2023-09-23T09:49:55.843327+0000 (oldest deadline 2023-09-23T09:50:20.543228+0000) 2023-09-23T09:50:23.146 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:22 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:22.863+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.535551+0000 front 2023-09-23T09:49:54.535491+0000 (oldest deadline 2023-09-23T09:50:18.535947+0000) 2023-09-23T09:50:23.147 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:22 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:22.995+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.407793+0000 front 2023-09-23T09:49:54.407750+0000 (oldest deadline 2023-09-23T09:50:17.907823+0000) 2023-09-23T09:50:23.310 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:22 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:22.957+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.643334+0000 front 2023-09-23T09:49:55.643391+0000 (oldest deadline 2023-09-23T09:50:18.543466+0000) 2023-09-23T09:50:23.369 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:22 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:22.944+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.275199+0000 front 2023-09-23T09:49:55.275227+0000 (oldest deadline 2023-09-23T09:50:17.575468+0000) 2023-09-23T09:50:23.896 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 23 09:50:23 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-5[110963]: 2023-09-23T09:50:23.417+0000 7f1224ab9700 -1 osd.5 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:53.155290+0000 front 2023-09-23T09:49:53.155377+0000 (oldest deadline 2023-09-23T09:50:17.855194+0000) 2023-09-23T09:50:23.912 INFO:journalctl@ceph.osd.3.smithi082.stdout:Sep 23 09:50:23 smithi082 bash[188328]: ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-3 2023-09-23T09:50:23.912 INFO:journalctl@ceph.osd.6.smithi082.stdout:Sep 23 09:50:23 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-6[121893]: 2023-09-23T09:50:23.699+0000 7fa831cf8700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.842973+0000 front 2023-09-23T09:49:55.843327+0000 (oldest deadline 2023-09-23T09:50:20.543228+0000) 2023-09-23T09:50:24.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:23 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:23.961+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.643334+0000 front 2023-09-23T09:49:55.643391+0000 (oldest deadline 2023-09-23T09:50:18.543466+0000) 2023-09-23T09:50:24.369 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:23 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:23.975+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.275199+0000 front 2023-09-23T09:49:55.275227+0000 (oldest deadline 2023-09-23T09:50:17.575468+0000) 2023-09-23T09:50:24.396 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:23 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:23.904+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.535551+0000 front 2023-09-23T09:49:54.535491+0000 (oldest deadline 2023-09-23T09:50:18.535947+0000) 2023-09-23T09:50:24.397 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:24 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:24.045+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.407793+0000 front 2023-09-23T09:49:54.407750+0000 (oldest deadline 2023-09-23T09:50:17.907823+0000) 2023-09-23T09:50:24.896 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 23 09:50:24 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-5[110963]: 2023-09-23T09:50:24.403+0000 7f1224ab9700 -1 osd.5 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:53.155290+0000 front 2023-09-23T09:49:53.155377+0000 (oldest deadline 2023-09-23T09:50:17.855194+0000) 2023-09-23T09:50:25.025 INFO:journalctl@ceph.osd.6.smithi082.stdout:Sep 23 09:50:24 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-6[121893]: 2023-09-23T09:50:24.672+0000 7fa831cf8700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.842973+0000 front 2023-09-23T09:49:55.843327+0000 (oldest deadline 2023-09-23T09:50:20.543228+0000) 2023-09-23T09:50:25.310 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:24 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:24.969+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.643334+0000 front 2023-09-23T09:49:55.643391+0000 (oldest deadline 2023-09-23T09:50:18.543466+0000) 2023-09-23T09:50:25.332 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:25 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:25.024+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.275199+0000 front 2023-09-23T09:49:55.275227+0000 (oldest deadline 2023-09-23T09:50:17.575468+0000) 2023-09-23T09:50:25.396 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:24 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:24.936+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.535551+0000 front 2023-09-23T09:49:54.535491+0000 (oldest deadline 2023-09-23T09:50:18.535947+0000) 2023-09-23T09:50:25.397 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:25 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:25.007+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.407793+0000 front 2023-09-23T09:49:54.407750+0000 (oldest deadline 2023-09-23T09:50:17.907823+0000) 2023-09-23T09:50:25.640 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@osd.3.service' 2023-09-23T09:50:25.729 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-09-23T09:50:25.730 INFO:tasks.cephadm.osd.3:Stopped osd.3 2023-09-23T09:50:25.730 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2023-09-23T09:50:25.730 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@osd.4 2023-09-23T09:50:25.889 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 23 09:50:25 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-5[110963]: 2023-09-23T09:50:25.418+0000 7f1224ab9700 -1 osd.5 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:53.155290+0000 front 2023-09-23T09:49:53.155377+0000 (oldest deadline 2023-09-23T09:50:17.855194+0000) 2023-09-23T09:50:26.058 INFO:journalctl@ceph.osd.6.smithi082.stdout:Sep 23 09:50:25 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-6[121893]: 2023-09-23T09:50:25.674+0000 7fa831cf8700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.842973+0000 front 2023-09-23T09:49:55.843327+0000 (oldest deadline 2023-09-23T09:50:20.543228+0000) 2023-09-23T09:50:26.061 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:25 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:25.938+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.643334+0000 front 2023-09-23T09:49:55.643391+0000 (oldest deadline 2023-09-23T09:50:18.543466+0000) 2023-09-23T09:50:26.061 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 23 09:50:25 smithi135 systemd[1]: Stopping Ceph osd.4 for 8926e286-59ed-11ee-8db4-212e2dc638e7... 2023-09-23T09:50:26.146 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:25 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:25.888+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.535551+0000 front 2023-09-23T09:49:54.535491+0000 (oldest deadline 2023-09-23T09:50:18.535947+0000) 2023-09-23T09:50:26.147 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:25 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:25.992+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.407793+0000 front 2023-09-23T09:49:54.407750+0000 (oldest deadline 2023-09-23T09:50:17.907823+0000) 2023-09-23T09:50:26.147 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:25 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:25.992+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.110235+0000 front 2023-09-23T09:50:03.110063+0000 (oldest deadline 2023-09-23T09:50:25.910760+0000) 2023-09-23T09:50:26.369 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:26 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:26.057+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.275199+0000 front 2023-09-23T09:49:55.275227+0000 (oldest deadline 2023-09-23T09:50:17.575468+0000) 2023-09-23T09:50:26.561 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 23 09:50:26 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-4[109735]: 2023-09-23T09:50:26.241+0000 7f8182b49700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-09-23T09:50:26.561 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 23 09:50:26 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-4[109735]: 2023-09-23T09:50:26.241+0000 7f8182b49700 -1 osd.4 181 *** Got signal Terminated *** 2023-09-23T09:50:26.561 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 23 09:50:26 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-4[109735]: 2023-09-23T09:50:26.241+0000 7f8182b49700 -1 osd.4 181 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-09-23T09:50:26.842 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 23 09:50:26 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-5[110963]: 2023-09-23T09:50:26.418+0000 7f1224ab9700 -1 osd.5 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:53.155290+0000 front 2023-09-23T09:49:53.155377+0000 (oldest deadline 2023-09-23T09:50:17.855194+0000) 2023-09-23T09:50:26.953 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 23 09:50:26 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-7[115264]: 2023-09-23T09:50:26.624+0000 7ff669202700 -1 osd.7 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:02.382925+0000 front 2023-09-23T09:50:02.383033+0000 (oldest deadline 2023-09-23T09:50:25.883083+0000) 2023-09-23T09:50:27.106 INFO:journalctl@ceph.osd.6.smithi082.stdout:Sep 23 09:50:26 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-6[121893]: 2023-09-23T09:50:26.703+0000 7fa831cf8700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.842973+0000 front 2023-09-23T09:49:55.843327+0000 (oldest deadline 2023-09-23T09:50:20.543228+0000) 2023-09-23T09:50:27.146 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:26 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:26.841+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.535551+0000 front 2023-09-23T09:49:54.535491+0000 (oldest deadline 2023-09-23T09:50:18.535947+0000) 2023-09-23T09:50:27.146 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:26 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:26.981+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.407793+0000 front 2023-09-23T09:49:54.407750+0000 (oldest deadline 2023-09-23T09:50:17.907823+0000) 2023-09-23T09:50:27.147 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:26 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:26.981+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.110235+0000 front 2023-09-23T09:50:03.110063+0000 (oldest deadline 2023-09-23T09:50:25.910760+0000) 2023-09-23T09:50:27.310 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:26 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:26.952+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.643334+0000 front 2023-09-23T09:49:55.643391+0000 (oldest deadline 2023-09-23T09:50:18.543466+0000) 2023-09-23T09:50:27.310 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:26 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:26.952+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.145721+0000 front 2023-09-23T09:50:03.145799+0000 (oldest deadline 2023-09-23T09:50:26.045803+0000) 2023-09-23T09:50:27.369 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:27 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:27.105+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.275199+0000 front 2023-09-23T09:49:55.275227+0000 (oldest deadline 2023-09-23T09:50:17.575468+0000) 2023-09-23T09:50:27.856 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 23 09:50:27 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-5[110963]: 2023-09-23T09:50:27.466+0000 7f1224ab9700 -1 osd.5 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:53.155290+0000 front 2023-09-23T09:49:53.155377+0000 (oldest deadline 2023-09-23T09:50:17.855194+0000) 2023-09-23T09:50:27.966 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 23 09:50:27 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-7[115264]: 2023-09-23T09:50:27.622+0000 7ff669202700 -1 osd.7 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:02.382925+0000 front 2023-09-23T09:50:02.383033+0000 (oldest deadline 2023-09-23T09:50:25.883083+0000) 2023-09-23T09:50:28.073 INFO:journalctl@ceph.osd.6.smithi082.stdout:Sep 23 09:50:27 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-6[121893]: 2023-09-23T09:50:27.660+0000 7fa831cf8700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.842973+0000 front 2023-09-23T09:49:55.843327+0000 (oldest deadline 2023-09-23T09:50:20.543228+0000) 2023-09-23T09:50:28.073 INFO:journalctl@ceph.osd.6.smithi082.stdout:Sep 23 09:50:27 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-6[121893]: 2023-09-23T09:50:27.660+0000 7fa831cf8700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.945270+0000 front 2023-09-23T09:50:03.945238+0000 (oldest deadline 2023-09-23T09:50:26.845034+0000) 2023-09-23T09:50:28.146 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:27 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:27.855+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.535551+0000 front 2023-09-23T09:49:54.535491+0000 (oldest deadline 2023-09-23T09:50:18.535947+0000) 2023-09-23T09:50:28.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:27 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:27.855+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:04.338156+0000 front 2023-09-23T09:50:04.338141+0000 (oldest deadline 2023-09-23T09:50:27.238084+0000) 2023-09-23T09:50:28.147 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:27 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:27.943+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.407793+0000 front 2023-09-23T09:49:54.407750+0000 (oldest deadline 2023-09-23T09:50:17.907823+0000) 2023-09-23T09:50:28.147 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:27 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:27.943+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.110235+0000 front 2023-09-23T09:50:03.110063+0000 (oldest deadline 2023-09-23T09:50:25.910760+0000) 2023-09-23T09:50:28.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:27 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:27.965+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.643334+0000 front 2023-09-23T09:49:55.643391+0000 (oldest deadline 2023-09-23T09:50:18.543466+0000) 2023-09-23T09:50:28.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:27 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:27.965+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.145721+0000 front 2023-09-23T09:50:03.145799+0000 (oldest deadline 2023-09-23T09:50:26.045803+0000) 2023-09-23T09:50:28.369 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:28 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:28.072+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.275199+0000 front 2023-09-23T09:49:55.275227+0000 (oldest deadline 2023-09-23T09:50:17.575468+0000) 2023-09-23T09:50:28.869 INFO:journalctl@ceph.osd.6.smithi082.stdout:Sep 23 09:50:28 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-6[121893]: 2023-09-23T09:50:28.612+0000 7fa831cf8700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.842973+0000 front 2023-09-23T09:49:55.843327+0000 (oldest deadline 2023-09-23T09:50:20.543228+0000) 2023-09-23T09:50:28.869 INFO:journalctl@ceph.osd.6.smithi082.stdout:Sep 23 09:50:28 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-6[121893]: 2023-09-23T09:50:28.612+0000 7fa831cf8700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.945270+0000 front 2023-09-23T09:50:03.945238+0000 (oldest deadline 2023-09-23T09:50:26.845034+0000) 2023-09-23T09:50:28.884 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 23 09:50:28 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-5[110963]: 2023-09-23T09:50:28.478+0000 7f1224ab9700 -1 osd.5 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:53.155290+0000 front 2023-09-23T09:49:53.155377+0000 (oldest deadline 2023-09-23T09:50:17.855194+0000) 2023-09-23T09:50:28.884 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 23 09:50:28 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-5[110963]: 2023-09-23T09:50:28.478+0000 7f1224ab9700 -1 osd.5 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.156420+0000 front 2023-09-23T09:50:03.156380+0000 (oldest deadline 2023-09-23T09:50:27.856401+0000) 2023-09-23T09:50:28.930 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 23 09:50:28 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-7[115264]: 2023-09-23T09:50:28.666+0000 7ff669202700 -1 osd.7 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:02.382925+0000 front 2023-09-23T09:50:02.383033+0000 (oldest deadline 2023-09-23T09:50:25.883083+0000) 2023-09-23T09:50:29.147 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:28 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:28.938+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.407793+0000 front 2023-09-23T09:49:54.407750+0000 (oldest deadline 2023-09-23T09:50:17.907823+0000) 2023-09-23T09:50:29.147 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:28 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:28.938+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.110235+0000 front 2023-09-23T09:50:03.110063+0000 (oldest deadline 2023-09-23T09:50:25.910760+0000) 2023-09-23T09:50:29.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:28 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:28.883+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.535551+0000 front 2023-09-23T09:49:54.535491+0000 (oldest deadline 2023-09-23T09:50:18.535947+0000) 2023-09-23T09:50:29.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:28 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:28.883+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:04.338156+0000 front 2023-09-23T09:50:04.338141+0000 (oldest deadline 2023-09-23T09:50:27.238084+0000) 2023-09-23T09:50:29.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:28 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:28.929+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.643334+0000 front 2023-09-23T09:49:55.643391+0000 (oldest deadline 2023-09-23T09:50:18.543466+0000) 2023-09-23T09:50:29.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:28 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:28.929+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.145721+0000 front 2023-09-23T09:50:03.145799+0000 (oldest deadline 2023-09-23T09:50:26.045803+0000) 2023-09-23T09:50:29.369 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:29 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:29.059+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.275199+0000 front 2023-09-23T09:49:55.275227+0000 (oldest deadline 2023-09-23T09:50:17.575468+0000) 2023-09-23T09:50:29.869 INFO:journalctl@ceph.osd.6.smithi082.stdout:Sep 23 09:50:29 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-6[121893]: 2023-09-23T09:50:29.587+0000 7fa831cf8700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.842973+0000 front 2023-09-23T09:49:55.843327+0000 (oldest deadline 2023-09-23T09:50:20.543228+0000) 2023-09-23T09:50:29.869 INFO:journalctl@ceph.osd.6.smithi082.stdout:Sep 23 09:50:29 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-6[121893]: 2023-09-23T09:50:29.587+0000 7fa831cf8700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.945270+0000 front 2023-09-23T09:50:03.945238+0000 (oldest deadline 2023-09-23T09:50:26.845034+0000) 2023-09-23T09:50:29.896 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 23 09:50:29 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-5[110963]: 2023-09-23T09:50:29.496+0000 7f1224ab9700 -1 osd.5 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:53.155290+0000 front 2023-09-23T09:49:53.155377+0000 (oldest deadline 2023-09-23T09:50:17.855194+0000) 2023-09-23T09:50:29.897 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 23 09:50:29 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-5[110963]: 2023-09-23T09:50:29.496+0000 7f1224ab9700 -1 osd.5 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.156420+0000 front 2023-09-23T09:50:03.156380+0000 (oldest deadline 2023-09-23T09:50:27.856401+0000) 2023-09-23T09:50:29.933 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 23 09:50:29 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-7[115264]: 2023-09-23T09:50:29.621+0000 7ff669202700 -1 osd.7 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:02.382925+0000 front 2023-09-23T09:50:02.383033+0000 (oldest deadline 2023-09-23T09:50:25.883083+0000) 2023-09-23T09:50:30.310 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:29 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:29.932+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.643334+0000 front 2023-09-23T09:49:55.643391+0000 (oldest deadline 2023-09-23T09:50:18.543466+0000) 2023-09-23T09:50:30.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:29 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:29.932+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.145721+0000 front 2023-09-23T09:50:03.145799+0000 (oldest deadline 2023-09-23T09:50:26.045803+0000) 2023-09-23T09:50:30.369 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:30 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:30.080+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.275199+0000 front 2023-09-23T09:49:55.275227+0000 (oldest deadline 2023-09-23T09:50:17.575468+0000) 2023-09-23T09:50:30.369 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:30 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:30.080+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.977386+0000 front 2023-09-23T09:50:03.977111+0000 (oldest deadline 2023-09-23T09:50:29.877359+0000) 2023-09-23T09:50:30.396 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:29 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:29.897+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.407793+0000 front 2023-09-23T09:49:54.407750+0000 (oldest deadline 2023-09-23T09:50:17.907823+0000) 2023-09-23T09:50:30.396 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:29 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:29.897+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.110235+0000 front 2023-09-23T09:50:03.110063+0000 (oldest deadline 2023-09-23T09:50:25.910760+0000) 2023-09-23T09:50:30.397 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:29 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:29.916+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.535551+0000 front 2023-09-23T09:49:54.535491+0000 (oldest deadline 2023-09-23T09:50:18.535947+0000) 2023-09-23T09:50:30.397 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:29 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:29.916+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:04.338156+0000 front 2023-09-23T09:50:04.338141+0000 (oldest deadline 2023-09-23T09:50:27.238084+0000) 2023-09-23T09:50:30.869 INFO:journalctl@ceph.osd.6.smithi082.stdout:Sep 23 09:50:30 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-6[121893]: 2023-09-23T09:50:30.562+0000 7fa831cf8700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.842973+0000 front 2023-09-23T09:49:55.843327+0000 (oldest deadline 2023-09-23T09:50:20.543228+0000) 2023-09-23T09:50:30.869 INFO:journalctl@ceph.osd.6.smithi082.stdout:Sep 23 09:50:30 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-6[121893]: 2023-09-23T09:50:30.562+0000 7fa831cf8700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.945270+0000 front 2023-09-23T09:50:03.945238+0000 (oldest deadline 2023-09-23T09:50:26.845034+0000) 2023-09-23T09:50:30.877 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 23 09:50:30 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-7[115264]: 2023-09-23T09:50:30.575+0000 7ff669202700 -1 osd.7 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:02.382925+0000 front 2023-09-23T09:50:02.383033+0000 (oldest deadline 2023-09-23T09:50:25.883083+0000) 2023-09-23T09:50:30.887 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 23 09:50:30 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-5[110963]: 2023-09-23T09:50:30.541+0000 7f1224ab9700 -1 osd.5 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:53.155290+0000 front 2023-09-23T09:49:53.155377+0000 (oldest deadline 2023-09-23T09:50:17.855194+0000) 2023-09-23T09:50:30.887 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 23 09:50:30 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-5[110963]: 2023-09-23T09:50:30.542+0000 7f1224ab9700 -1 osd.5 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.156420+0000 front 2023-09-23T09:50:03.156380+0000 (oldest deadline 2023-09-23T09:50:27.856401+0000) 2023-09-23T09:50:31.146 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:30 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:30.892+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.407793+0000 front 2023-09-23T09:49:54.407750+0000 (oldest deadline 2023-09-23T09:50:17.907823+0000) 2023-09-23T09:50:31.147 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:30 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:30.892+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.110235+0000 front 2023-09-23T09:50:03.110063+0000 (oldest deadline 2023-09-23T09:50:25.910760+0000) 2023-09-23T09:50:31.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:30 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:30.886+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.535551+0000 front 2023-09-23T09:49:54.535491+0000 (oldest deadline 2023-09-23T09:50:18.535947+0000) 2023-09-23T09:50:31.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:30 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:30.886+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:04.338156+0000 front 2023-09-23T09:50:04.338141+0000 (oldest deadline 2023-09-23T09:50:27.238084+0000) 2023-09-23T09:50:31.310 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 23 09:50:30 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-4[109735]: 2023-09-23T09:50:30.876+0000 7f817f13f700 -1 osd.4 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:04.668190+0000 front 2023-09-23T09:50:04.668090+0000 (oldest deadline 2023-09-23T09:50:29.967848+0000) 2023-09-23T09:50:31.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:30 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:30.886+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.643334+0000 front 2023-09-23T09:49:55.643391+0000 (oldest deadline 2023-09-23T09:50:18.543466+0000) 2023-09-23T09:50:31.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:30 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:30.886+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.145721+0000 front 2023-09-23T09:50:03.145799+0000 (oldest deadline 2023-09-23T09:50:26.045803+0000) 2023-09-23T09:50:31.369 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:31 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:31.087+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.275199+0000 front 2023-09-23T09:49:55.275227+0000 (oldest deadline 2023-09-23T09:50:17.575468+0000) 2023-09-23T09:50:31.369 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:31 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:31.087+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.977386+0000 front 2023-09-23T09:50:03.977111+0000 (oldest deadline 2023-09-23T09:50:29.877359+0000) 2023-09-23T09:50:31.865 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 23 09:50:31 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-5[110963]: 2023-09-23T09:50:31.495+0000 7f1224ab9700 -1 osd.5 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:53.155290+0000 front 2023-09-23T09:49:53.155377+0000 (oldest deadline 2023-09-23T09:50:17.855194+0000) 2023-09-23T09:50:31.865 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 23 09:50:31 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-5[110963]: 2023-09-23T09:50:31.495+0000 7f1224ab9700 -1 osd.5 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.156420+0000 front 2023-09-23T09:50:03.156380+0000 (oldest deadline 2023-09-23T09:50:27.856401+0000) 2023-09-23T09:50:31.869 INFO:journalctl@ceph.osd.6.smithi082.stdout:Sep 23 09:50:31 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-6[121893]: 2023-09-23T09:50:31.562+0000 7fa831cf8700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.842973+0000 front 2023-09-23T09:49:55.843327+0000 (oldest deadline 2023-09-23T09:50:20.543228+0000) 2023-09-23T09:50:31.869 INFO:journalctl@ceph.osd.6.smithi082.stdout:Sep 23 09:50:31 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-6[121893]: 2023-09-23T09:50:31.562+0000 7fa831cf8700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.945270+0000 front 2023-09-23T09:50:03.945238+0000 (oldest deadline 2023-09-23T09:50:26.845034+0000) 2023-09-23T09:50:31.877 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 23 09:50:31 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-7[115264]: 2023-09-23T09:50:31.611+0000 7ff669202700 -1 osd.7 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:02.382925+0000 front 2023-09-23T09:50:02.383033+0000 (oldest deadline 2023-09-23T09:50:25.883083+0000) 2023-09-23T09:50:32.146 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:31 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:31.889+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.407793+0000 front 2023-09-23T09:49:54.407750+0000 (oldest deadline 2023-09-23T09:50:17.907823+0000) 2023-09-23T09:50:32.146 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:31 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:31.889+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.110235+0000 front 2023-09-23T09:50:03.110063+0000 (oldest deadline 2023-09-23T09:50:25.910760+0000) 2023-09-23T09:50:32.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:31 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:31.864+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.535551+0000 front 2023-09-23T09:49:54.535491+0000 (oldest deadline 2023-09-23T09:50:18.535947+0000) 2023-09-23T09:50:32.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:31 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:31.864+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:04.338156+0000 front 2023-09-23T09:50:04.338141+0000 (oldest deadline 2023-09-23T09:50:27.238084+0000) 2023-09-23T09:50:32.310 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:31 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:31.876+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.643334+0000 front 2023-09-23T09:49:55.643391+0000 (oldest deadline 2023-09-23T09:50:18.543466+0000) 2023-09-23T09:50:32.310 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:31 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:31.876+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.145721+0000 front 2023-09-23T09:50:03.145799+0000 (oldest deadline 2023-09-23T09:50:26.045803+0000) 2023-09-23T09:50:32.369 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:32 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:32.060+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.275199+0000 front 2023-09-23T09:49:55.275227+0000 (oldest deadline 2023-09-23T09:50:17.575468+0000) 2023-09-23T09:50:32.369 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:32 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:32.060+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.977386+0000 front 2023-09-23T09:50:03.977111+0000 (oldest deadline 2023-09-23T09:50:29.877359+0000) 2023-09-23T09:50:32.810 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 23 09:50:32 smithi135 bash[141311]: ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-4 2023-09-23T09:50:32.810 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 23 09:50:32 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-7[115264]: 2023-09-23T09:50:32.636+0000 7ff669202700 -1 osd.7 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:02.382925+0000 front 2023-09-23T09:50:02.383033+0000 (oldest deadline 2023-09-23T09:50:25.883083+0000) 2023-09-23T09:50:32.869 INFO:journalctl@ceph.osd.6.smithi082.stdout:Sep 23 09:50:32 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-6[121893]: 2023-09-23T09:50:32.539+0000 7fa831cf8700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.842973+0000 front 2023-09-23T09:49:55.843327+0000 (oldest deadline 2023-09-23T09:50:20.543228+0000) 2023-09-23T09:50:32.869 INFO:journalctl@ceph.osd.6.smithi082.stdout:Sep 23 09:50:32 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-6[121893]: 2023-09-23T09:50:32.539+0000 7fa831cf8700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.945270+0000 front 2023-09-23T09:50:03.945238+0000 (oldest deadline 2023-09-23T09:50:26.845034+0000) 2023-09-23T09:50:32.877 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 23 09:50:32 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-5[110963]: 2023-09-23T09:50:32.541+0000 7f1224ab9700 -1 osd.5 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:53.155290+0000 front 2023-09-23T09:49:53.155377+0000 (oldest deadline 2023-09-23T09:50:17.855194+0000) 2023-09-23T09:50:32.877 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 23 09:50:32 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-5[110963]: 2023-09-23T09:50:32.541+0000 7f1224ab9700 -1 osd.5 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.156420+0000 front 2023-09-23T09:50:03.156380+0000 (oldest deadline 2023-09-23T09:50:27.856401+0000) 2023-09-23T09:50:33.146 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:32 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:32.918+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.407793+0000 front 2023-09-23T09:49:54.407750+0000 (oldest deadline 2023-09-23T09:50:17.907823+0000) 2023-09-23T09:50:33.146 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:32 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:32.918+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.110235+0000 front 2023-09-23T09:50:03.110063+0000 (oldest deadline 2023-09-23T09:50:25.910760+0000) 2023-09-23T09:50:33.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:32 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:32.876+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.535551+0000 front 2023-09-23T09:49:54.535491+0000 (oldest deadline 2023-09-23T09:50:18.535947+0000) 2023-09-23T09:50:33.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:32 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:32.876+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:04.338156+0000 front 2023-09-23T09:50:04.338141+0000 (oldest deadline 2023-09-23T09:50:27.238084+0000) 2023-09-23T09:50:33.310 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:32 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:32.867+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.643334+0000 front 2023-09-23T09:49:55.643391+0000 (oldest deadline 2023-09-23T09:50:18.543466+0000) 2023-09-23T09:50:33.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:32 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:32.867+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.145721+0000 front 2023-09-23T09:50:03.145799+0000 (oldest deadline 2023-09-23T09:50:26.045803+0000) 2023-09-23T09:50:33.369 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:33 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:33.075+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.275199+0000 front 2023-09-23T09:49:55.275227+0000 (oldest deadline 2023-09-23T09:50:17.575468+0000) 2023-09-23T09:50:33.369 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:33 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:33.075+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.977386+0000 front 2023-09-23T09:50:03.977111+0000 (oldest deadline 2023-09-23T09:50:29.877359+0000) 2023-09-23T09:50:33.810 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 23 09:50:33 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-7[115264]: 2023-09-23T09:50:33.642+0000 7ff669202700 -1 osd.7 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:02.382925+0000 front 2023-09-23T09:50:02.383033+0000 (oldest deadline 2023-09-23T09:50:25.883083+0000) 2023-09-23T09:50:33.848 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 23 09:50:33 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-5[110963]: 2023-09-23T09:50:33.555+0000 7f1224ab9700 -1 osd.5 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:53.155290+0000 front 2023-09-23T09:49:53.155377+0000 (oldest deadline 2023-09-23T09:50:17.855194+0000) 2023-09-23T09:50:33.848 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 23 09:50:33 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-5[110963]: 2023-09-23T09:50:33.555+0000 7f1224ab9700 -1 osd.5 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.156420+0000 front 2023-09-23T09:50:03.156380+0000 (oldest deadline 2023-09-23T09:50:27.856401+0000) 2023-09-23T09:50:33.869 INFO:journalctl@ceph.osd.6.smithi082.stdout:Sep 23 09:50:33 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-6[121893]: 2023-09-23T09:50:33.506+0000 7fa831cf8700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.842973+0000 front 2023-09-23T09:49:55.843327+0000 (oldest deadline 2023-09-23T09:50:20.543228+0000) 2023-09-23T09:50:33.869 INFO:journalctl@ceph.osd.6.smithi082.stdout:Sep 23 09:50:33 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-6[121893]: 2023-09-23T09:50:33.506+0000 7fa831cf8700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.945270+0000 front 2023-09-23T09:50:03.945238+0000 (oldest deadline 2023-09-23T09:50:26.845034+0000) 2023-09-23T09:50:34.147 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:33 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:33.880+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.407793+0000 front 2023-09-23T09:49:54.407750+0000 (oldest deadline 2023-09-23T09:50:17.907823+0000) 2023-09-23T09:50:34.147 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:33 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:33.880+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.110235+0000 front 2023-09-23T09:50:03.110063+0000 (oldest deadline 2023-09-23T09:50:25.910760+0000) 2023-09-23T09:50:34.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:33 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:33.847+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.535551+0000 front 2023-09-23T09:49:54.535491+0000 (oldest deadline 2023-09-23T09:50:18.535947+0000) 2023-09-23T09:50:34.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:33 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:33.847+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:04.338156+0000 front 2023-09-23T09:50:04.338141+0000 (oldest deadline 2023-09-23T09:50:27.238084+0000) 2023-09-23T09:50:34.292 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:33 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:33.879+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.643334+0000 front 2023-09-23T09:49:55.643391+0000 (oldest deadline 2023-09-23T09:50:18.543466+0000) 2023-09-23T09:50:34.293 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:33 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:33.879+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.145721+0000 front 2023-09-23T09:50:03.145799+0000 (oldest deadline 2023-09-23T09:50:26.045803+0000) 2023-09-23T09:50:34.328 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@osd.4.service' 2023-09-23T09:50:34.369 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:34 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:34.070+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.275199+0000 front 2023-09-23T09:49:55.275227+0000 (oldest deadline 2023-09-23T09:50:17.575468+0000) 2023-09-23T09:50:34.369 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:34 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:34.070+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.977386+0000 front 2023-09-23T09:50:03.977111+0000 (oldest deadline 2023-09-23T09:50:29.877359+0000) 2023-09-23T09:50:34.416 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-09-23T09:50:34.417 INFO:tasks.cephadm.osd.4:Stopped osd.4 2023-09-23T09:50:34.417 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2023-09-23T09:50:34.417 DEBUG:teuthology.orchestra.run.smithi161:> sudo systemctl stop ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@osd.5 2023-09-23T09:50:34.851 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 23 09:50:34 smithi161 systemd[1]: Stopping Ceph osd.5 for 8926e286-59ed-11ee-8db4-212e2dc638e7... 2023-09-23T09:50:34.851 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 23 09:50:34 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-5[110963]: 2023-09-23T09:50:34.530+0000 7f1224ab9700 -1 osd.5 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:53.155290+0000 front 2023-09-23T09:49:53.155377+0000 (oldest deadline 2023-09-23T09:50:17.855194+0000) 2023-09-23T09:50:34.851 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 23 09:50:34 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-5[110963]: 2023-09-23T09:50:34.530+0000 7f1224ab9700 -1 osd.5 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.156420+0000 front 2023-09-23T09:50:03.156380+0000 (oldest deadline 2023-09-23T09:50:27.856401+0000) 2023-09-23T09:50:34.869 INFO:journalctl@ceph.osd.6.smithi082.stdout:Sep 23 09:50:34 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-6[121893]: 2023-09-23T09:50:34.555+0000 7fa831cf8700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.842973+0000 front 2023-09-23T09:49:55.843327+0000 (oldest deadline 2023-09-23T09:50:20.543228+0000) 2023-09-23T09:50:34.869 INFO:journalctl@ceph.osd.6.smithi082.stdout:Sep 23 09:50:34 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-6[121893]: 2023-09-23T09:50:34.555+0000 7fa831cf8700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.945270+0000 front 2023-09-23T09:50:03.945238+0000 (oldest deadline 2023-09-23T09:50:26.845034+0000) 2023-09-23T09:50:34.894 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 23 09:50:34 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-7[115264]: 2023-09-23T09:50:34.625+0000 7ff669202700 -1 osd.7 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:02.382925+0000 front 2023-09-23T09:50:02.383033+0000 (oldest deadline 2023-09-23T09:50:25.883083+0000) 2023-09-23T09:50:35.146 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 23 09:50:34 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-5[110963]: 2023-09-23T09:50:34.915+0000 7f122bcca700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-09-23T09:50:35.147 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 23 09:50:34 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-5[110963]: 2023-09-23T09:50:34.915+0000 7f122bcca700 -1 osd.5 181 *** Got signal Terminated *** 2023-09-23T09:50:35.147 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 23 09:50:34 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-5[110963]: 2023-09-23T09:50:34.915+0000 7f122bcca700 -1 osd.5 181 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-09-23T09:50:35.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:34 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:34.849+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.535551+0000 front 2023-09-23T09:49:54.535491+0000 (oldest deadline 2023-09-23T09:50:18.535947+0000) 2023-09-23T09:50:35.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:34 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:34.849+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:04.338156+0000 front 2023-09-23T09:50:04.338141+0000 (oldest deadline 2023-09-23T09:50:27.238084+0000) 2023-09-23T09:50:35.147 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:34 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:34.902+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.407793+0000 front 2023-09-23T09:49:54.407750+0000 (oldest deadline 2023-09-23T09:50:17.907823+0000) 2023-09-23T09:50:35.147 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:34 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:34.902+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.110235+0000 front 2023-09-23T09:50:03.110063+0000 (oldest deadline 2023-09-23T09:50:25.910760+0000) 2023-09-23T09:50:35.310 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:34 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:34.893+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.643334+0000 front 2023-09-23T09:49:55.643391+0000 (oldest deadline 2023-09-23T09:50:18.543466+0000) 2023-09-23T09:50:35.310 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:34 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:34.893+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.145721+0000 front 2023-09-23T09:50:03.145799+0000 (oldest deadline 2023-09-23T09:50:26.045803+0000) 2023-09-23T09:50:35.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:34 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:34.893+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.348396+0000 front 2023-09-23T09:50:12.348362+0000 (oldest deadline 2023-09-23T09:50:34.648330+0000) 2023-09-23T09:50:35.369 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:35 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:35.101+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.275199+0000 front 2023-09-23T09:49:55.275227+0000 (oldest deadline 2023-09-23T09:50:17.575468+0000) 2023-09-23T09:50:35.369 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:35 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:35.101+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.977386+0000 front 2023-09-23T09:50:03.977111+0000 (oldest deadline 2023-09-23T09:50:29.877359+0000) 2023-09-23T09:50:35.869 INFO:journalctl@ceph.osd.6.smithi082.stdout:Sep 23 09:50:35 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-6[121893]: 2023-09-23T09:50:35.528+0000 7fa831cf8700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.842973+0000 front 2023-09-23T09:49:55.843327+0000 (oldest deadline 2023-09-23T09:50:20.543228+0000) 2023-09-23T09:50:35.869 INFO:journalctl@ceph.osd.6.smithi082.stdout:Sep 23 09:50:35 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-6[121893]: 2023-09-23T09:50:35.528+0000 7fa831cf8700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.945270+0000 front 2023-09-23T09:50:03.945238+0000 (oldest deadline 2023-09-23T09:50:26.845034+0000) 2023-09-23T09:50:35.870 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 23 09:50:35 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-5[110963]: 2023-09-23T09:50:35.549+0000 7f1224ab9700 -1 osd.5 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:53.155290+0000 front 2023-09-23T09:49:53.155377+0000 (oldest deadline 2023-09-23T09:50:17.855194+0000) 2023-09-23T09:50:35.871 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 23 09:50:35 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-5[110963]: 2023-09-23T09:50:35.549+0000 7f1224ab9700 -1 osd.5 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.156420+0000 front 2023-09-23T09:50:03.156380+0000 (oldest deadline 2023-09-23T09:50:27.856401+0000) 2023-09-23T09:50:36.060 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 23 09:50:35 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-7[115264]: 2023-09-23T09:50:35.661+0000 7ff669202700 -1 osd.7 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:02.382925+0000 front 2023-09-23T09:50:02.383033+0000 (oldest deadline 2023-09-23T09:50:25.883083+0000) 2023-09-23T09:50:36.061 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:35 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:35.882+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.643334+0000 front 2023-09-23T09:49:55.643391+0000 (oldest deadline 2023-09-23T09:50:18.543466+0000) 2023-09-23T09:50:36.061 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:35 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:35.882+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.145721+0000 front 2023-09-23T09:50:03.145799+0000 (oldest deadline 2023-09-23T09:50:26.045803+0000) 2023-09-23T09:50:36.061 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:35 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:35.882+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.348396+0000 front 2023-09-23T09:50:12.348362+0000 (oldest deadline 2023-09-23T09:50:34.648330+0000) 2023-09-23T09:50:36.146 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:35 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:35.870+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.535551+0000 front 2023-09-23T09:49:54.535491+0000 (oldest deadline 2023-09-23T09:50:18.535947+0000) 2023-09-23T09:50:36.146 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:35 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:35.870+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:04.338156+0000 front 2023-09-23T09:50:04.338141+0000 (oldest deadline 2023-09-23T09:50:27.238084+0000) 2023-09-23T09:50:36.147 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:35 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:35.891+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.407793+0000 front 2023-09-23T09:49:54.407750+0000 (oldest deadline 2023-09-23T09:50:17.907823+0000) 2023-09-23T09:50:36.147 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:35 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:35.891+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.110235+0000 front 2023-09-23T09:50:03.110063+0000 (oldest deadline 2023-09-23T09:50:25.910760+0000) 2023-09-23T09:50:36.147 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:35 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:35.891+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:10.011752+0000 front 2023-09-23T09:50:10.011878+0000 (oldest deadline 2023-09-23T09:50:35.311862+0000) 2023-09-23T09:50:36.369 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:36 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:36.104+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.275199+0000 front 2023-09-23T09:49:55.275227+0000 (oldest deadline 2023-09-23T09:50:17.575468+0000) 2023-09-23T09:50:36.369 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:36 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:36.104+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.977386+0000 front 2023-09-23T09:50:03.977111+0000 (oldest deadline 2023-09-23T09:50:29.877359+0000) 2023-09-23T09:50:36.841 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 23 09:50:36 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-5[110963]: 2023-09-23T09:50:36.500+0000 7f1224ab9700 -1 osd.5 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:53.155290+0000 front 2023-09-23T09:49:53.155377+0000 (oldest deadline 2023-09-23T09:50:17.855194+0000) 2023-09-23T09:50:36.841 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 23 09:50:36 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-5[110963]: 2023-09-23T09:50:36.500+0000 7f1224ab9700 -1 osd.5 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.156420+0000 front 2023-09-23T09:50:03.156380+0000 (oldest deadline 2023-09-23T09:50:27.856401+0000) 2023-09-23T09:50:36.841 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 23 09:50:36 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-5[110963]: 2023-09-23T09:50:36.500+0000 7f1224ab9700 -1 osd.5 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:13.157544+0000 front 2023-09-23T09:50:13.157528+0000 (oldest deadline 2023-09-23T09:50:36.057705+0000) 2023-09-23T09:50:36.869 INFO:journalctl@ceph.osd.6.smithi082.stdout:Sep 23 09:50:36 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-6[121893]: 2023-09-23T09:50:36.482+0000 7fa831cf8700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.842973+0000 front 2023-09-23T09:49:55.843327+0000 (oldest deadline 2023-09-23T09:50:20.543228+0000) 2023-09-23T09:50:36.869 INFO:journalctl@ceph.osd.6.smithi082.stdout:Sep 23 09:50:36 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-6[121893]: 2023-09-23T09:50:36.482+0000 7fa831cf8700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.945270+0000 front 2023-09-23T09:50:03.945238+0000 (oldest deadline 2023-09-23T09:50:26.845034+0000) 2023-09-23T09:50:37.060 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 23 09:50:36 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-7[115264]: 2023-09-23T09:50:36.660+0000 7ff669202700 -1 osd.7 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:02.382925+0000 front 2023-09-23T09:50:02.383033+0000 (oldest deadline 2023-09-23T09:50:25.883083+0000) 2023-09-23T09:50:37.061 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:36 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:36.872+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.643334+0000 front 2023-09-23T09:49:55.643391+0000 (oldest deadline 2023-09-23T09:50:18.543466+0000) 2023-09-23T09:50:37.061 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:36 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:36.872+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.145721+0000 front 2023-09-23T09:50:03.145799+0000 (oldest deadline 2023-09-23T09:50:26.045803+0000) 2023-09-23T09:50:37.061 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:36 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:36.872+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.348396+0000 front 2023-09-23T09:50:12.348362+0000 (oldest deadline 2023-09-23T09:50:34.648330+0000) 2023-09-23T09:50:37.146 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:36 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:36.911+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.407793+0000 front 2023-09-23T09:49:54.407750+0000 (oldest deadline 2023-09-23T09:50:17.907823+0000) 2023-09-23T09:50:37.146 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:36 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:36.911+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.110235+0000 front 2023-09-23T09:50:03.110063+0000 (oldest deadline 2023-09-23T09:50:25.910760+0000) 2023-09-23T09:50:37.147 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:36 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:36.911+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:10.011752+0000 front 2023-09-23T09:50:10.011878+0000 (oldest deadline 2023-09-23T09:50:35.311862+0000) 2023-09-23T09:50:37.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:36 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:36.840+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.535551+0000 front 2023-09-23T09:49:54.535491+0000 (oldest deadline 2023-09-23T09:50:18.535947+0000) 2023-09-23T09:50:37.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:36 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:36.840+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:04.338156+0000 front 2023-09-23T09:50:04.338141+0000 (oldest deadline 2023-09-23T09:50:27.238084+0000) 2023-09-23T09:50:37.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:36 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:36.840+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:13.139271+0000 front 2023-09-23T09:50:13.139458+0000 (oldest deadline 2023-09-23T09:50:36.639382+0000) 2023-09-23T09:50:37.486 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:37 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:37.122+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.275199+0000 front 2023-09-23T09:49:55.275227+0000 (oldest deadline 2023-09-23T09:50:17.575468+0000) 2023-09-23T09:50:37.486 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:37 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:37.122+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.977386+0000 front 2023-09-23T09:50:03.977111+0000 (oldest deadline 2023-09-23T09:50:29.877359+0000) 2023-09-23T09:50:37.869 INFO:journalctl@ceph.osd.6.smithi082.stdout:Sep 23 09:50:37 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-6[121893]: 2023-09-23T09:50:37.485+0000 7fa831cf8700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.842973+0000 front 2023-09-23T09:49:55.843327+0000 (oldest deadline 2023-09-23T09:50:20.543228+0000) 2023-09-23T09:50:37.869 INFO:journalctl@ceph.osd.6.smithi082.stdout:Sep 23 09:50:37 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-6[121893]: 2023-09-23T09:50:37.485+0000 7fa831cf8700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.945270+0000 front 2023-09-23T09:50:03.945238+0000 (oldest deadline 2023-09-23T09:50:26.845034+0000) 2023-09-23T09:50:37.869 INFO:journalctl@ceph.osd.6.smithi082.stdout:Sep 23 09:50:37 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-6[121893]: 2023-09-23T09:50:37.485+0000 7fa831cf8700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:08.546242+0000 front 2023-09-23T09:50:08.546522+0000 (oldest deadline 2023-09-23T09:50:36.647693+0000) 2023-09-23T09:50:37.891 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 23 09:50:37 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-5[110963]: 2023-09-23T09:50:37.522+0000 7f1224ab9700 -1 osd.5 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:53.155290+0000 front 2023-09-23T09:49:53.155377+0000 (oldest deadline 2023-09-23T09:50:17.855194+0000) 2023-09-23T09:50:37.891 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 23 09:50:37 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-5[110963]: 2023-09-23T09:50:37.522+0000 7f1224ab9700 -1 osd.5 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.156420+0000 front 2023-09-23T09:50:03.156380+0000 (oldest deadline 2023-09-23T09:50:27.856401+0000) 2023-09-23T09:50:37.891 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 23 09:50:37 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-5[110963]: 2023-09-23T09:50:37.522+0000 7f1224ab9700 -1 osd.5 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:13.157544+0000 front 2023-09-23T09:50:13.157528+0000 (oldest deadline 2023-09-23T09:50:36.057705+0000) 2023-09-23T09:50:38.061 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 23 09:50:37 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-7[115264]: 2023-09-23T09:50:37.618+0000 7ff669202700 -1 osd.7 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:02.382925+0000 front 2023-09-23T09:50:02.383033+0000 (oldest deadline 2023-09-23T09:50:25.883083+0000) 2023-09-23T09:50:38.061 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 23 09:50:37 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-7[115264]: 2023-09-23T09:50:37.618+0000 7ff669202700 -1 osd.7 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.185534+0000 front 2023-09-23T09:50:12.185608+0000 (oldest deadline 2023-09-23T09:50:36.885224+0000) 2023-09-23T09:50:38.061 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:37 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:37.834+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.643334+0000 front 2023-09-23T09:49:55.643391+0000 (oldest deadline 2023-09-23T09:50:18.543466+0000) 2023-09-23T09:50:38.061 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:37 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:37.834+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.145721+0000 front 2023-09-23T09:50:03.145799+0000 (oldest deadline 2023-09-23T09:50:26.045803+0000) 2023-09-23T09:50:38.062 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:37 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:37.834+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.348396+0000 front 2023-09-23T09:50:12.348362+0000 (oldest deadline 2023-09-23T09:50:34.648330+0000) 2023-09-23T09:50:38.146 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:37 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:37.890+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.535551+0000 front 2023-09-23T09:49:54.535491+0000 (oldest deadline 2023-09-23T09:50:18.535947+0000) 2023-09-23T09:50:38.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:37 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:37.890+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:04.338156+0000 front 2023-09-23T09:50:04.338141+0000 (oldest deadline 2023-09-23T09:50:27.238084+0000) 2023-09-23T09:50:38.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:37 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:37.890+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:13.139271+0000 front 2023-09-23T09:50:13.139458+0000 (oldest deadline 2023-09-23T09:50:36.639382+0000) 2023-09-23T09:50:38.147 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:37 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:37.950+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.407793+0000 front 2023-09-23T09:49:54.407750+0000 (oldest deadline 2023-09-23T09:50:17.907823+0000) 2023-09-23T09:50:38.147 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:37 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:37.950+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.110235+0000 front 2023-09-23T09:50:03.110063+0000 (oldest deadline 2023-09-23T09:50:25.910760+0000) 2023-09-23T09:50:38.148 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:37 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:37.950+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:10.011752+0000 front 2023-09-23T09:50:10.011878+0000 (oldest deadline 2023-09-23T09:50:35.311862+0000) 2023-09-23T09:50:38.454 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:38 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:38.172+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.275199+0000 front 2023-09-23T09:49:55.275227+0000 (oldest deadline 2023-09-23T09:50:17.575468+0000) 2023-09-23T09:50:38.454 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:38 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:38.172+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.977386+0000 front 2023-09-23T09:50:03.977111+0000 (oldest deadline 2023-09-23T09:50:29.877359+0000) 2023-09-23T09:50:38.869 INFO:journalctl@ceph.osd.6.smithi082.stdout:Sep 23 09:50:38 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-6[121893]: 2023-09-23T09:50:38.453+0000 7fa831cf8700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.842973+0000 front 2023-09-23T09:49:55.843327+0000 (oldest deadline 2023-09-23T09:50:20.543228+0000) 2023-09-23T09:50:38.869 INFO:journalctl@ceph.osd.6.smithi082.stdout:Sep 23 09:50:38 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-6[121893]: 2023-09-23T09:50:38.453+0000 7fa831cf8700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.945270+0000 front 2023-09-23T09:50:03.945238+0000 (oldest deadline 2023-09-23T09:50:26.845034+0000) 2023-09-23T09:50:38.869 INFO:journalctl@ceph.osd.6.smithi082.stdout:Sep 23 09:50:38 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-6[121893]: 2023-09-23T09:50:38.453+0000 7fa831cf8700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:08.546242+0000 front 2023-09-23T09:50:08.546522+0000 (oldest deadline 2023-09-23T09:50:36.647693+0000) 2023-09-23T09:50:38.896 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 23 09:50:38 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-5[110963]: 2023-09-23T09:50:38.498+0000 7f1224ab9700 -1 osd.5 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:53.155290+0000 front 2023-09-23T09:49:53.155377+0000 (oldest deadline 2023-09-23T09:50:17.855194+0000) 2023-09-23T09:50:38.896 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 23 09:50:38 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-5[110963]: 2023-09-23T09:50:38.498+0000 7f1224ab9700 -1 osd.5 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.156420+0000 front 2023-09-23T09:50:03.156380+0000 (oldest deadline 2023-09-23T09:50:27.856401+0000) 2023-09-23T09:50:38.896 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 23 09:50:38 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-5[110963]: 2023-09-23T09:50:38.498+0000 7f1224ab9700 -1 osd.5 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:13.157544+0000 front 2023-09-23T09:50:13.157528+0000 (oldest deadline 2023-09-23T09:50:36.057705+0000) 2023-09-23T09:50:39.061 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 23 09:50:38 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-7[115264]: 2023-09-23T09:50:38.668+0000 7ff669202700 -1 osd.7 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:02.382925+0000 front 2023-09-23T09:50:02.383033+0000 (oldest deadline 2023-09-23T09:50:25.883083+0000) 2023-09-23T09:50:39.061 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 23 09:50:38 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-7[115264]: 2023-09-23T09:50:38.668+0000 7ff669202700 -1 osd.7 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.185534+0000 front 2023-09-23T09:50:12.185608+0000 (oldest deadline 2023-09-23T09:50:36.885224+0000) 2023-09-23T09:50:39.061 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:38 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:38.786+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.643334+0000 front 2023-09-23T09:49:55.643391+0000 (oldest deadline 2023-09-23T09:50:18.543466+0000) 2023-09-23T09:50:39.061 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:38 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:38.786+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.145721+0000 front 2023-09-23T09:50:03.145799+0000 (oldest deadline 2023-09-23T09:50:26.045803+0000) 2023-09-23T09:50:39.061 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:38 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:38.786+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.348396+0000 front 2023-09-23T09:50:12.348362+0000 (oldest deadline 2023-09-23T09:50:34.648330+0000) 2023-09-23T09:50:39.396 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:38 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:38.963+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.407793+0000 front 2023-09-23T09:49:54.407750+0000 (oldest deadline 2023-09-23T09:50:17.907823+0000) 2023-09-23T09:50:39.396 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:38 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:38.963+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.110235+0000 front 2023-09-23T09:50:03.110063+0000 (oldest deadline 2023-09-23T09:50:25.910760+0000) 2023-09-23T09:50:39.397 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:38 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:38.963+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:10.011752+0000 front 2023-09-23T09:50:10.011878+0000 (oldest deadline 2023-09-23T09:50:35.311862+0000) 2023-09-23T09:50:39.397 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:38 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:38.929+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.535551+0000 front 2023-09-23T09:49:54.535491+0000 (oldest deadline 2023-09-23T09:50:18.535947+0000) 2023-09-23T09:50:39.397 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:38 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:38.929+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:04.338156+0000 front 2023-09-23T09:50:04.338141+0000 (oldest deadline 2023-09-23T09:50:27.238084+0000) 2023-09-23T09:50:39.397 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:38 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:38.929+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:13.139271+0000 front 2023-09-23T09:50:13.139458+0000 (oldest deadline 2023-09-23T09:50:36.639382+0000) 2023-09-23T09:50:39.489 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:39 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:39.177+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.275199+0000 front 2023-09-23T09:49:55.275227+0000 (oldest deadline 2023-09-23T09:50:17.575468+0000) 2023-09-23T09:50:39.489 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:39 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:39.177+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.977386+0000 front 2023-09-23T09:50:03.977111+0000 (oldest deadline 2023-09-23T09:50:29.877359+0000) 2023-09-23T09:50:39.869 INFO:journalctl@ceph.osd.6.smithi082.stdout:Sep 23 09:50:39 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-6[121893]: 2023-09-23T09:50:39.487+0000 7fa831cf8700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.842973+0000 front 2023-09-23T09:49:55.843327+0000 (oldest deadline 2023-09-23T09:50:20.543228+0000) 2023-09-23T09:50:39.869 INFO:journalctl@ceph.osd.6.smithi082.stdout:Sep 23 09:50:39 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-6[121893]: 2023-09-23T09:50:39.487+0000 7fa831cf8700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.945270+0000 front 2023-09-23T09:50:03.945238+0000 (oldest deadline 2023-09-23T09:50:26.845034+0000) 2023-09-23T09:50:39.869 INFO:journalctl@ceph.osd.6.smithi082.stdout:Sep 23 09:50:39 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-6[121893]: 2023-09-23T09:50:39.487+0000 7fa831cf8700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:08.546242+0000 front 2023-09-23T09:50:08.546522+0000 (oldest deadline 2023-09-23T09:50:36.647693+0000) 2023-09-23T09:50:39.896 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 23 09:50:39 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-5[110963]: 2023-09-23T09:50:39.477+0000 7f1224ab9700 -1 osd.5 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:53.155290+0000 front 2023-09-23T09:49:53.155377+0000 (oldest deadline 2023-09-23T09:50:17.855194+0000) 2023-09-23T09:50:39.896 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 23 09:50:39 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-5[110963]: 2023-09-23T09:50:39.477+0000 7f1224ab9700 -1 osd.5 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.156420+0000 front 2023-09-23T09:50:03.156380+0000 (oldest deadline 2023-09-23T09:50:27.856401+0000) 2023-09-23T09:50:39.897 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 23 09:50:39 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-5[110963]: 2023-09-23T09:50:39.477+0000 7f1224ab9700 -1 osd.5 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:13.157544+0000 front 2023-09-23T09:50:13.157528+0000 (oldest deadline 2023-09-23T09:50:36.057705+0000) 2023-09-23T09:50:40.061 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 23 09:50:39 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-7[115264]: 2023-09-23T09:50:39.667+0000 7ff669202700 -1 osd.7 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:02.382925+0000 front 2023-09-23T09:50:02.383033+0000 (oldest deadline 2023-09-23T09:50:25.883083+0000) 2023-09-23T09:50:40.061 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 23 09:50:39 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-7[115264]: 2023-09-23T09:50:39.667+0000 7ff669202700 -1 osd.7 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.185534+0000 front 2023-09-23T09:50:12.185608+0000 (oldest deadline 2023-09-23T09:50:36.885224+0000) 2023-09-23T09:50:40.061 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:39 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:39.786+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.643334+0000 front 2023-09-23T09:49:55.643391+0000 (oldest deadline 2023-09-23T09:50:18.543466+0000) 2023-09-23T09:50:40.061 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:39 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:39.786+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.145721+0000 front 2023-09-23T09:50:03.145799+0000 (oldest deadline 2023-09-23T09:50:26.045803+0000) 2023-09-23T09:50:40.062 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:39 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:39.786+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.348396+0000 front 2023-09-23T09:50:12.348362+0000 (oldest deadline 2023-09-23T09:50:34.648330+0000) 2023-09-23T09:50:40.396 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:39 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:39.914+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.407793+0000 front 2023-09-23T09:49:54.407750+0000 (oldest deadline 2023-09-23T09:50:17.907823+0000) 2023-09-23T09:50:40.397 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:39 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:39.914+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.110235+0000 front 2023-09-23T09:50:03.110063+0000 (oldest deadline 2023-09-23T09:50:25.910760+0000) 2023-09-23T09:50:40.397 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:39 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:39.914+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:10.011752+0000 front 2023-09-23T09:50:10.011878+0000 (oldest deadline 2023-09-23T09:50:35.311862+0000) 2023-09-23T09:50:40.397 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:39 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:39.931+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.535551+0000 front 2023-09-23T09:49:54.535491+0000 (oldest deadline 2023-09-23T09:50:18.535947+0000) 2023-09-23T09:50:40.397 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:39 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:39.931+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:04.338156+0000 front 2023-09-23T09:50:04.338141+0000 (oldest deadline 2023-09-23T09:50:27.238084+0000) 2023-09-23T09:50:40.398 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:39 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:39.931+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:13.139271+0000 front 2023-09-23T09:50:13.139458+0000 (oldest deadline 2023-09-23T09:50:36.639382+0000) 2023-09-23T09:50:40.465 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:40 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:40.202+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.275199+0000 front 2023-09-23T09:49:55.275227+0000 (oldest deadline 2023-09-23T09:50:17.575468+0000) 2023-09-23T09:50:40.465 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:40 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:40.202+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.977386+0000 front 2023-09-23T09:50:03.977111+0000 (oldest deadline 2023-09-23T09:50:29.877359+0000) 2023-09-23T09:50:40.466 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:40 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:40.202+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.778806+0000 front 2023-09-23T09:50:12.778743+0000 (oldest deadline 2023-09-23T09:50:39.779512+0000) 2023-09-23T09:50:40.869 INFO:journalctl@ceph.osd.6.smithi082.stdout:Sep 23 09:50:40 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-6[121893]: 2023-09-23T09:50:40.464+0000 7fa831cf8700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.842973+0000 front 2023-09-23T09:49:55.843327+0000 (oldest deadline 2023-09-23T09:50:20.543228+0000) 2023-09-23T09:50:40.869 INFO:journalctl@ceph.osd.6.smithi082.stdout:Sep 23 09:50:40 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-6[121893]: 2023-09-23T09:50:40.464+0000 7fa831cf8700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.945270+0000 front 2023-09-23T09:50:03.945238+0000 (oldest deadline 2023-09-23T09:50:26.845034+0000) 2023-09-23T09:50:40.869 INFO:journalctl@ceph.osd.6.smithi082.stdout:Sep 23 09:50:40 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-6[121893]: 2023-09-23T09:50:40.464+0000 7fa831cf8700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:08.546242+0000 front 2023-09-23T09:50:08.546522+0000 (oldest deadline 2023-09-23T09:50:36.647693+0000) 2023-09-23T09:50:41.061 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 23 09:50:40 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-7[115264]: 2023-09-23T09:50:40.668+0000 7ff669202700 -1 osd.7 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:02.382925+0000 front 2023-09-23T09:50:02.383033+0000 (oldest deadline 2023-09-23T09:50:25.883083+0000) 2023-09-23T09:50:41.061 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 23 09:50:40 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-7[115264]: 2023-09-23T09:50:40.668+0000 7ff669202700 -1 osd.7 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.185534+0000 front 2023-09-23T09:50:12.185608+0000 (oldest deadline 2023-09-23T09:50:36.885224+0000) 2023-09-23T09:50:41.061 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:40 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:40.799+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.643334+0000 front 2023-09-23T09:49:55.643391+0000 (oldest deadline 2023-09-23T09:50:18.543466+0000) 2023-09-23T09:50:41.061 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:40 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:40.799+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.145721+0000 front 2023-09-23T09:50:03.145799+0000 (oldest deadline 2023-09-23T09:50:26.045803+0000) 2023-09-23T09:50:41.061 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:40 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:40.799+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.348396+0000 front 2023-09-23T09:50:12.348362+0000 (oldest deadline 2023-09-23T09:50:34.648330+0000) 2023-09-23T09:50:41.198 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:40 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:40.915+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.535551+0000 front 2023-09-23T09:49:54.535491+0000 (oldest deadline 2023-09-23T09:50:18.535947+0000) 2023-09-23T09:50:41.198 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:40 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:40.915+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:04.338156+0000 front 2023-09-23T09:50:04.338141+0000 (oldest deadline 2023-09-23T09:50:27.238084+0000) 2023-09-23T09:50:41.198 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:40 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:40.915+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:13.139271+0000 front 2023-09-23T09:50:13.139458+0000 (oldest deadline 2023-09-23T09:50:36.639382+0000) 2023-09-23T09:50:41.199 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:40 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:40.943+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.407793+0000 front 2023-09-23T09:49:54.407750+0000 (oldest deadline 2023-09-23T09:50:17.907823+0000) 2023-09-23T09:50:41.199 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:40 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:40.943+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.110235+0000 front 2023-09-23T09:50:03.110063+0000 (oldest deadline 2023-09-23T09:50:25.910760+0000) 2023-09-23T09:50:41.199 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:40 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:40.943+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:10.011752+0000 front 2023-09-23T09:50:10.011878+0000 (oldest deadline 2023-09-23T09:50:35.311862+0000) 2023-09-23T09:50:41.619 INFO:journalctl@ceph.osd.6.smithi082.stdout:Sep 23 09:50:41 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-6[121893]: 2023-09-23T09:50:41.467+0000 7fa831cf8700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.842973+0000 front 2023-09-23T09:49:55.843327+0000 (oldest deadline 2023-09-23T09:50:20.543228+0000) 2023-09-23T09:50:41.619 INFO:journalctl@ceph.osd.6.smithi082.stdout:Sep 23 09:50:41 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-6[121893]: 2023-09-23T09:50:41.467+0000 7fa831cf8700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.945270+0000 front 2023-09-23T09:50:03.945238+0000 (oldest deadline 2023-09-23T09:50:26.845034+0000) 2023-09-23T09:50:41.619 INFO:journalctl@ceph.osd.6.smithi082.stdout:Sep 23 09:50:41 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-6[121893]: 2023-09-23T09:50:41.467+0000 7fa831cf8700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:08.546242+0000 front 2023-09-23T09:50:08.546522+0000 (oldest deadline 2023-09-23T09:50:36.647693+0000) 2023-09-23T09:50:41.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:41 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:41.222+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.275199+0000 front 2023-09-23T09:49:55.275227+0000 (oldest deadline 2023-09-23T09:50:17.575468+0000) 2023-09-23T09:50:41.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:41 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:41.222+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.977386+0000 front 2023-09-23T09:50:03.977111+0000 (oldest deadline 2023-09-23T09:50:29.877359+0000) 2023-09-23T09:50:41.620 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:41 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:41.222+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.778806+0000 front 2023-09-23T09:50:12.778743+0000 (oldest deadline 2023-09-23T09:50:39.779512+0000) 2023-09-23T09:50:41.646 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 23 09:50:41 smithi161 bash[141413]: ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-5 2023-09-23T09:50:42.060 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 23 09:50:41 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-7[115264]: 2023-09-23T09:50:41.707+0000 7ff669202700 -1 osd.7 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:02.382925+0000 front 2023-09-23T09:50:02.383033+0000 (oldest deadline 2023-09-23T09:50:25.883083+0000) 2023-09-23T09:50:42.061 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 23 09:50:41 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-7[115264]: 2023-09-23T09:50:41.707+0000 7ff669202700 -1 osd.7 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.185534+0000 front 2023-09-23T09:50:12.185608+0000 (oldest deadline 2023-09-23T09:50:36.885224+0000) 2023-09-23T09:50:42.061 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:41 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:41.778+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.643334+0000 front 2023-09-23T09:49:55.643391+0000 (oldest deadline 2023-09-23T09:50:18.543466+0000) 2023-09-23T09:50:42.061 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:41 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:41.778+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.145721+0000 front 2023-09-23T09:50:03.145799+0000 (oldest deadline 2023-09-23T09:50:26.045803+0000) 2023-09-23T09:50:42.061 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:41 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:41.778+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.348396+0000 front 2023-09-23T09:50:12.348362+0000 (oldest deadline 2023-09-23T09:50:34.648330+0000) 2023-09-23T09:50:42.205 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:41 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:41.933+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.535551+0000 front 2023-09-23T09:49:54.535491+0000 (oldest deadline 2023-09-23T09:50:18.535947+0000) 2023-09-23T09:50:42.205 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:41 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:41.933+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:04.338156+0000 front 2023-09-23T09:50:04.338141+0000 (oldest deadline 2023-09-23T09:50:27.238084+0000) 2023-09-23T09:50:42.205 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:41 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:41.933+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:13.139271+0000 front 2023-09-23T09:50:13.139458+0000 (oldest deadline 2023-09-23T09:50:36.639382+0000) 2023-09-23T09:50:42.205 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:41 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:41.950+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.407793+0000 front 2023-09-23T09:49:54.407750+0000 (oldest deadline 2023-09-23T09:50:17.907823+0000) 2023-09-23T09:50:42.205 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:41 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:41.951+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.110235+0000 front 2023-09-23T09:50:03.110063+0000 (oldest deadline 2023-09-23T09:50:25.910760+0000) 2023-09-23T09:50:42.206 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:41 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:41.951+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:10.011752+0000 front 2023-09-23T09:50:10.011878+0000 (oldest deadline 2023-09-23T09:50:35.311862+0000) 2023-09-23T09:50:42.619 INFO:journalctl@ceph.osd.6.smithi082.stdout:Sep 23 09:50:42 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-6[121893]: 2023-09-23T09:50:42.448+0000 7fa831cf8700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.842973+0000 front 2023-09-23T09:49:55.843327+0000 (oldest deadline 2023-09-23T09:50:20.543228+0000) 2023-09-23T09:50:42.619 INFO:journalctl@ceph.osd.6.smithi082.stdout:Sep 23 09:50:42 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-6[121893]: 2023-09-23T09:50:42.448+0000 7fa831cf8700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.945270+0000 front 2023-09-23T09:50:03.945238+0000 (oldest deadline 2023-09-23T09:50:26.845034+0000) 2023-09-23T09:50:42.619 INFO:journalctl@ceph.osd.6.smithi082.stdout:Sep 23 09:50:42 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-6[121893]: 2023-09-23T09:50:42.448+0000 7fa831cf8700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:08.546242+0000 front 2023-09-23T09:50:08.546522+0000 (oldest deadline 2023-09-23T09:50:36.647693+0000) 2023-09-23T09:50:42.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:42 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:42.218+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.275199+0000 front 2023-09-23T09:49:55.275227+0000 (oldest deadline 2023-09-23T09:50:17.575468+0000) 2023-09-23T09:50:42.620 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:42 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:42.218+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.977386+0000 front 2023-09-23T09:50:03.977111+0000 (oldest deadline 2023-09-23T09:50:29.877359+0000) 2023-09-23T09:50:42.620 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:42 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:42.218+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.778806+0000 front 2023-09-23T09:50:12.778743+0000 (oldest deadline 2023-09-23T09:50:39.779512+0000) 2023-09-23T09:50:43.061 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 23 09:50:42 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-7[115264]: 2023-09-23T09:50:42.735+0000 7ff669202700 -1 osd.7 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:02.382925+0000 front 2023-09-23T09:50:02.383033+0000 (oldest deadline 2023-09-23T09:50:25.883083+0000) 2023-09-23T09:50:43.061 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 23 09:50:42 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-7[115264]: 2023-09-23T09:50:42.735+0000 7ff669202700 -1 osd.7 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.185534+0000 front 2023-09-23T09:50:12.185608+0000 (oldest deadline 2023-09-23T09:50:36.885224+0000) 2023-09-23T09:50:43.061 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:42 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:42.745+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.643334+0000 front 2023-09-23T09:49:55.643391+0000 (oldest deadline 2023-09-23T09:50:18.543466+0000) 2023-09-23T09:50:43.061 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:42 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:42.745+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.145721+0000 front 2023-09-23T09:50:03.145799+0000 (oldest deadline 2023-09-23T09:50:26.045803+0000) 2023-09-23T09:50:43.062 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:42 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:42.745+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.348396+0000 front 2023-09-23T09:50:12.348362+0000 (oldest deadline 2023-09-23T09:50:34.648330+0000) 2023-09-23T09:50:43.123 DEBUG:teuthology.orchestra.run.smithi161:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@osd.5.service' 2023-09-23T09:50:43.209 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:42 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:42.968+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.407793+0000 front 2023-09-23T09:49:54.407750+0000 (oldest deadline 2023-09-23T09:50:17.907823+0000) 2023-09-23T09:50:43.210 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:42 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:42.968+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.110235+0000 front 2023-09-23T09:50:03.110063+0000 (oldest deadline 2023-09-23T09:50:25.910760+0000) 2023-09-23T09:50:43.210 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:42 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:42.968+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:10.011752+0000 front 2023-09-23T09:50:10.011878+0000 (oldest deadline 2023-09-23T09:50:35.311862+0000) 2023-09-23T09:50:43.210 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:42 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:42.957+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.535551+0000 front 2023-09-23T09:49:54.535491+0000 (oldest deadline 2023-09-23T09:50:18.535947+0000) 2023-09-23T09:50:43.210 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:42 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:42.957+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:04.338156+0000 front 2023-09-23T09:50:04.338141+0000 (oldest deadline 2023-09-23T09:50:27.238084+0000) 2023-09-23T09:50:43.211 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:42 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:42.957+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:13.139271+0000 front 2023-09-23T09:50:13.139458+0000 (oldest deadline 2023-09-23T09:50:36.639382+0000) 2023-09-23T09:50:43.212 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-09-23T09:50:43.213 INFO:tasks.cephadm.osd.5:Stopped osd.5 2023-09-23T09:50:43.213 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2023-09-23T09:50:43.213 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@osd.6 2023-09-23T09:50:43.619 INFO:journalctl@ceph.osd.6.smithi082.stdout:Sep 23 09:50:43 smithi082 systemd[1]: Stopping Ceph osd.6 for 8926e286-59ed-11ee-8db4-212e2dc638e7... 2023-09-23T09:50:43.620 INFO:journalctl@ceph.osd.6.smithi082.stdout:Sep 23 09:50:43 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-6[121893]: 2023-09-23T09:50:43.414+0000 7fa831cf8700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.842973+0000 front 2023-09-23T09:49:55.843327+0000 (oldest deadline 2023-09-23T09:50:20.543228+0000) 2023-09-23T09:50:43.620 INFO:journalctl@ceph.osd.6.smithi082.stdout:Sep 23 09:50:43 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-6[121893]: 2023-09-23T09:50:43.414+0000 7fa831cf8700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.945270+0000 front 2023-09-23T09:50:03.945238+0000 (oldest deadline 2023-09-23T09:50:26.845034+0000) 2023-09-23T09:50:43.620 INFO:journalctl@ceph.osd.6.smithi082.stdout:Sep 23 09:50:43 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-6[121893]: 2023-09-23T09:50:43.414+0000 7fa831cf8700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:08.546242+0000 front 2023-09-23T09:50:08.546522+0000 (oldest deadline 2023-09-23T09:50:36.647693+0000) 2023-09-23T09:50:43.620 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:43 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:43.211+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.275199+0000 front 2023-09-23T09:49:55.275227+0000 (oldest deadline 2023-09-23T09:50:17.575468+0000) 2023-09-23T09:50:43.620 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:43 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:43.211+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.977386+0000 front 2023-09-23T09:50:03.977111+0000 (oldest deadline 2023-09-23T09:50:29.877359+0000) 2023-09-23T09:50:43.621 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:43 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:43.211+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.778806+0000 front 2023-09-23T09:50:12.778743+0000 (oldest deadline 2023-09-23T09:50:39.779512+0000) 2023-09-23T09:50:44.061 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 23 09:50:43 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-7[115264]: 2023-09-23T09:50:43.749+0000 7ff669202700 -1 osd.7 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:02.382925+0000 front 2023-09-23T09:50:02.383033+0000 (oldest deadline 2023-09-23T09:50:25.883083+0000) 2023-09-23T09:50:44.061 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 23 09:50:43 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-7[115264]: 2023-09-23T09:50:43.749+0000 7ff669202700 -1 osd.7 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.185534+0000 front 2023-09-23T09:50:12.185608+0000 (oldest deadline 2023-09-23T09:50:36.885224+0000) 2023-09-23T09:50:44.061 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:43 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:43.761+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.643334+0000 front 2023-09-23T09:49:55.643391+0000 (oldest deadline 2023-09-23T09:50:18.543466+0000) 2023-09-23T09:50:44.062 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:43 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:43.761+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.145721+0000 front 2023-09-23T09:50:03.145799+0000 (oldest deadline 2023-09-23T09:50:26.045803+0000) 2023-09-23T09:50:44.062 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:43 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:43.761+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.348396+0000 front 2023-09-23T09:50:12.348362+0000 (oldest deadline 2023-09-23T09:50:34.648330+0000) 2023-09-23T09:50:44.119 INFO:journalctl@ceph.osd.6.smithi082.stdout:Sep 23 09:50:43 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-6[121893]: 2023-09-23T09:50:43.712+0000 7fa835702700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-09-23T09:50:44.119 INFO:journalctl@ceph.osd.6.smithi082.stdout:Sep 23 09:50:43 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-6[121893]: 2023-09-23T09:50:43.712+0000 7fa835702700 -1 osd.6 181 *** Got signal Terminated *** 2023-09-23T09:50:44.119 INFO:journalctl@ceph.osd.6.smithi082.stdout:Sep 23 09:50:43 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-6[121893]: 2023-09-23T09:50:43.712+0000 7fa835702700 -1 osd.6 181 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-09-23T09:50:44.396 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:44 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:44.013+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.407793+0000 front 2023-09-23T09:49:54.407750+0000 (oldest deadline 2023-09-23T09:50:17.907823+0000) 2023-09-23T09:50:44.397 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:44 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:44.013+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.110235+0000 front 2023-09-23T09:50:03.110063+0000 (oldest deadline 2023-09-23T09:50:25.910760+0000) 2023-09-23T09:50:44.397 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:44 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:44.013+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:10.011752+0000 front 2023-09-23T09:50:10.011878+0000 (oldest deadline 2023-09-23T09:50:35.311862+0000) 2023-09-23T09:50:44.397 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:44 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:44.006+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.535551+0000 front 2023-09-23T09:49:54.535491+0000 (oldest deadline 2023-09-23T09:50:18.535947+0000) 2023-09-23T09:50:44.397 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:44 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:44.006+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:04.338156+0000 front 2023-09-23T09:50:04.338141+0000 (oldest deadline 2023-09-23T09:50:27.238084+0000) 2023-09-23T09:50:44.397 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:44 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:44.006+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:13.139271+0000 front 2023-09-23T09:50:13.139458+0000 (oldest deadline 2023-09-23T09:50:36.639382+0000) 2023-09-23T09:50:44.619 INFO:journalctl@ceph.osd.6.smithi082.stdout:Sep 23 09:50:44 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-6[121893]: 2023-09-23T09:50:44.368+0000 7fa831cf8700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.842973+0000 front 2023-09-23T09:49:55.843327+0000 (oldest deadline 2023-09-23T09:50:20.543228+0000) 2023-09-23T09:50:44.619 INFO:journalctl@ceph.osd.6.smithi082.stdout:Sep 23 09:50:44 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-6[121893]: 2023-09-23T09:50:44.368+0000 7fa831cf8700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.945270+0000 front 2023-09-23T09:50:03.945238+0000 (oldest deadline 2023-09-23T09:50:26.845034+0000) 2023-09-23T09:50:44.619 INFO:journalctl@ceph.osd.6.smithi082.stdout:Sep 23 09:50:44 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-6[121893]: 2023-09-23T09:50:44.368+0000 7fa831cf8700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:08.546242+0000 front 2023-09-23T09:50:08.546522+0000 (oldest deadline 2023-09-23T09:50:36.647693+0000) 2023-09-23T09:50:44.620 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:44 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:44.244+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.275199+0000 front 2023-09-23T09:49:55.275227+0000 (oldest deadline 2023-09-23T09:50:17.575468+0000) 2023-09-23T09:50:44.620 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:44 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:44.244+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.977386+0000 front 2023-09-23T09:50:03.977111+0000 (oldest deadline 2023-09-23T09:50:29.877359+0000) 2023-09-23T09:50:44.620 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:44 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:44.244+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.778806+0000 front 2023-09-23T09:50:12.778743+0000 (oldest deadline 2023-09-23T09:50:39.779512+0000) 2023-09-23T09:50:44.620 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:44 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:44.244+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:19.780107+0000 front 2023-09-23T09:50:19.780156+0000 (oldest deadline 2023-09-23T09:50:43.880111+0000) 2023-09-23T09:50:45.061 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 23 09:50:44 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-7[115264]: 2023-09-23T09:50:44.742+0000 7ff669202700 -1 osd.7 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:02.382925+0000 front 2023-09-23T09:50:02.383033+0000 (oldest deadline 2023-09-23T09:50:25.883083+0000) 2023-09-23T09:50:45.061 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 23 09:50:44 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-7[115264]: 2023-09-23T09:50:44.742+0000 7ff669202700 -1 osd.7 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.185534+0000 front 2023-09-23T09:50:12.185608+0000 (oldest deadline 2023-09-23T09:50:36.885224+0000) 2023-09-23T09:50:45.061 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 23 09:50:44 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-7[115264]: 2023-09-23T09:50:44.742+0000 7ff669202700 -1 osd.7 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:17.386167+0000 front 2023-09-23T09:50:17.386233+0000 (oldest deadline 2023-09-23T09:50:44.387018+0000) 2023-09-23T09:50:45.061 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:44 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:44.799+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.643334+0000 front 2023-09-23T09:49:55.643391+0000 (oldest deadline 2023-09-23T09:50:18.543466+0000) 2023-09-23T09:50:45.061 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:44 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:44.799+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.145721+0000 front 2023-09-23T09:50:03.145799+0000 (oldest deadline 2023-09-23T09:50:26.045803+0000) 2023-09-23T09:50:45.062 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:44 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:44.799+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.348396+0000 front 2023-09-23T09:50:12.348362+0000 (oldest deadline 2023-09-23T09:50:34.648330+0000) 2023-09-23T09:50:45.397 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:44 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:44.973+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.407793+0000 front 2023-09-23T09:49:54.407750+0000 (oldest deadline 2023-09-23T09:50:17.907823+0000) 2023-09-23T09:50:45.397 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:44 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:44.973+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.110235+0000 front 2023-09-23T09:50:03.110063+0000 (oldest deadline 2023-09-23T09:50:25.910760+0000) 2023-09-23T09:50:45.397 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:44 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:44.973+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:10.011752+0000 front 2023-09-23T09:50:10.011878+0000 (oldest deadline 2023-09-23T09:50:35.311862+0000) 2023-09-23T09:50:45.397 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:45 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:45.043+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.535551+0000 front 2023-09-23T09:49:54.535491+0000 (oldest deadline 2023-09-23T09:50:18.535947+0000) 2023-09-23T09:50:45.397 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:45 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:45.043+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:04.338156+0000 front 2023-09-23T09:50:04.338141+0000 (oldest deadline 2023-09-23T09:50:27.238084+0000) 2023-09-23T09:50:45.398 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:45 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:45.043+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:13.139271+0000 front 2023-09-23T09:50:13.139458+0000 (oldest deadline 2023-09-23T09:50:36.639382+0000) 2023-09-23T09:50:45.619 INFO:journalctl@ceph.osd.6.smithi082.stdout:Sep 23 09:50:45 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-6[121893]: 2023-09-23T09:50:45.382+0000 7fa831cf8700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.842973+0000 front 2023-09-23T09:49:55.843327+0000 (oldest deadline 2023-09-23T09:50:20.543228+0000) 2023-09-23T09:50:45.619 INFO:journalctl@ceph.osd.6.smithi082.stdout:Sep 23 09:50:45 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-6[121893]: 2023-09-23T09:50:45.382+0000 7fa831cf8700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.945270+0000 front 2023-09-23T09:50:03.945238+0000 (oldest deadline 2023-09-23T09:50:26.845034+0000) 2023-09-23T09:50:45.619 INFO:journalctl@ceph.osd.6.smithi082.stdout:Sep 23 09:50:45 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-6[121893]: 2023-09-23T09:50:45.382+0000 7fa831cf8700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:08.546242+0000 front 2023-09-23T09:50:08.546522+0000 (oldest deadline 2023-09-23T09:50:36.647693+0000) 2023-09-23T09:50:45.620 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:45 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:45.256+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.275199+0000 front 2023-09-23T09:49:55.275227+0000 (oldest deadline 2023-09-23T09:50:17.575468+0000) 2023-09-23T09:50:45.620 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:45 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:45.256+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.977386+0000 front 2023-09-23T09:50:03.977111+0000 (oldest deadline 2023-09-23T09:50:29.877359+0000) 2023-09-23T09:50:45.620 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:45 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:45.256+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.778806+0000 front 2023-09-23T09:50:12.778743+0000 (oldest deadline 2023-09-23T09:50:39.779512+0000) 2023-09-23T09:50:45.620 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:45 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:45.256+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:19.780107+0000 front 2023-09-23T09:50:19.780156+0000 (oldest deadline 2023-09-23T09:50:43.880111+0000) 2023-09-23T09:50:46.060 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 23 09:50:45 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-7[115264]: 2023-09-23T09:50:45.720+0000 7ff669202700 -1 osd.7 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:02.382925+0000 front 2023-09-23T09:50:02.383033+0000 (oldest deadline 2023-09-23T09:50:25.883083+0000) 2023-09-23T09:50:46.061 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 23 09:50:45 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-7[115264]: 2023-09-23T09:50:45.720+0000 7ff669202700 -1 osd.7 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.185534+0000 front 2023-09-23T09:50:12.185608+0000 (oldest deadline 2023-09-23T09:50:36.885224+0000) 2023-09-23T09:50:46.061 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 23 09:50:45 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-7[115264]: 2023-09-23T09:50:45.720+0000 7ff669202700 -1 osd.7 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:17.386167+0000 front 2023-09-23T09:50:17.386233+0000 (oldest deadline 2023-09-23T09:50:44.387018+0000) 2023-09-23T09:50:46.061 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:45 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:45.786+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.643334+0000 front 2023-09-23T09:49:55.643391+0000 (oldest deadline 2023-09-23T09:50:18.543466+0000) 2023-09-23T09:50:46.061 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:45 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:45.786+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.145721+0000 front 2023-09-23T09:50:03.145799+0000 (oldest deadline 2023-09-23T09:50:26.045803+0000) 2023-09-23T09:50:46.062 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:45 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:45.786+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.348396+0000 front 2023-09-23T09:50:12.348362+0000 (oldest deadline 2023-09-23T09:50:34.648330+0000) 2023-09-23T09:50:46.062 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:45 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:45.786+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:22.150884+0000 front 2023-09-23T09:50:22.150846+0000 (oldest deadline 2023-09-23T09:50:45.650923+0000) 2023-09-23T09:50:46.396 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:46 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:46.025+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.535551+0000 front 2023-09-23T09:49:54.535491+0000 (oldest deadline 2023-09-23T09:50:18.535947+0000) 2023-09-23T09:50:46.397 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:46 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:46.025+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:04.338156+0000 front 2023-09-23T09:50:04.338141+0000 (oldest deadline 2023-09-23T09:50:27.238084+0000) 2023-09-23T09:50:46.397 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:46 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:46.025+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:13.139271+0000 front 2023-09-23T09:50:13.139458+0000 (oldest deadline 2023-09-23T09:50:36.639382+0000) 2023-09-23T09:50:46.397 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:45 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:45.973+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.407793+0000 front 2023-09-23T09:49:54.407750+0000 (oldest deadline 2023-09-23T09:50:17.907823+0000) 2023-09-23T09:50:46.397 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:45 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:45.973+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.110235+0000 front 2023-09-23T09:50:03.110063+0000 (oldest deadline 2023-09-23T09:50:25.910760+0000) 2023-09-23T09:50:46.397 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:45 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:45.973+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:10.011752+0000 front 2023-09-23T09:50:10.011878+0000 (oldest deadline 2023-09-23T09:50:35.311862+0000) 2023-09-23T09:50:46.398 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:45 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:45.973+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:20.013339+0000 front 2023-09-23T09:50:20.013377+0000 (oldest deadline 2023-09-23T09:50:45.913287+0000) 2023-09-23T09:50:46.619 INFO:journalctl@ceph.osd.6.smithi082.stdout:Sep 23 09:50:46 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-6[121893]: 2023-09-23T09:50:46.424+0000 7fa831cf8700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.842973+0000 front 2023-09-23T09:49:55.843327+0000 (oldest deadline 2023-09-23T09:50:20.543228+0000) 2023-09-23T09:50:46.619 INFO:journalctl@ceph.osd.6.smithi082.stdout:Sep 23 09:50:46 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-6[121893]: 2023-09-23T09:50:46.424+0000 7fa831cf8700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.945270+0000 front 2023-09-23T09:50:03.945238+0000 (oldest deadline 2023-09-23T09:50:26.845034+0000) 2023-09-23T09:50:46.619 INFO:journalctl@ceph.osd.6.smithi082.stdout:Sep 23 09:50:46 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-6[121893]: 2023-09-23T09:50:46.424+0000 7fa831cf8700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:08.546242+0000 front 2023-09-23T09:50:08.546522+0000 (oldest deadline 2023-09-23T09:50:36.647693+0000) 2023-09-23T09:50:46.620 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:46 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:46.268+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.275199+0000 front 2023-09-23T09:49:55.275227+0000 (oldest deadline 2023-09-23T09:50:17.575468+0000) 2023-09-23T09:50:46.620 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:46 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:46.268+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.977386+0000 front 2023-09-23T09:50:03.977111+0000 (oldest deadline 2023-09-23T09:50:29.877359+0000) 2023-09-23T09:50:46.620 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:46 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:46.268+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.778806+0000 front 2023-09-23T09:50:12.778743+0000 (oldest deadline 2023-09-23T09:50:39.779512+0000) 2023-09-23T09:50:46.620 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:46 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:46.268+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:19.780107+0000 front 2023-09-23T09:50:19.780156+0000 (oldest deadline 2023-09-23T09:50:43.880111+0000) 2023-09-23T09:50:47.060 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 23 09:50:46 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-7[115264]: 2023-09-23T09:50:46.747+0000 7ff669202700 -1 osd.7 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:02.382925+0000 front 2023-09-23T09:50:02.383033+0000 (oldest deadline 2023-09-23T09:50:25.883083+0000) 2023-09-23T09:50:47.061 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 23 09:50:46 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-7[115264]: 2023-09-23T09:50:46.747+0000 7ff669202700 -1 osd.7 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.185534+0000 front 2023-09-23T09:50:12.185608+0000 (oldest deadline 2023-09-23T09:50:36.885224+0000) 2023-09-23T09:50:47.061 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 23 09:50:46 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-7[115264]: 2023-09-23T09:50:46.747+0000 7ff669202700 -1 osd.7 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:17.386167+0000 front 2023-09-23T09:50:17.386233+0000 (oldest deadline 2023-09-23T09:50:44.387018+0000) 2023-09-23T09:50:47.061 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:46 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:46.764+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.643334+0000 front 2023-09-23T09:49:55.643391+0000 (oldest deadline 2023-09-23T09:50:18.543466+0000) 2023-09-23T09:50:47.061 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:46 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:46.764+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.145721+0000 front 2023-09-23T09:50:03.145799+0000 (oldest deadline 2023-09-23T09:50:26.045803+0000) 2023-09-23T09:50:47.061 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:46 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:46.764+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.348396+0000 front 2023-09-23T09:50:12.348362+0000 (oldest deadline 2023-09-23T09:50:34.648330+0000) 2023-09-23T09:50:47.061 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:46 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:46.764+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:22.150884+0000 front 2023-09-23T09:50:22.150846+0000 (oldest deadline 2023-09-23T09:50:45.650923+0000) 2023-09-23T09:50:47.397 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:47 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:47.002+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.407793+0000 front 2023-09-23T09:49:54.407750+0000 (oldest deadline 2023-09-23T09:50:17.907823+0000) 2023-09-23T09:50:47.397 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:47 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:47.002+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.110235+0000 front 2023-09-23T09:50:03.110063+0000 (oldest deadline 2023-09-23T09:50:25.910760+0000) 2023-09-23T09:50:47.397 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:47 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:47.002+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:10.011752+0000 front 2023-09-23T09:50:10.011878+0000 (oldest deadline 2023-09-23T09:50:35.311862+0000) 2023-09-23T09:50:47.397 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:47 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:47.002+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:20.013339+0000 front 2023-09-23T09:50:20.013377+0000 (oldest deadline 2023-09-23T09:50:45.913287+0000) 2023-09-23T09:50:47.397 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:46 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:46.982+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.535551+0000 front 2023-09-23T09:49:54.535491+0000 (oldest deadline 2023-09-23T09:50:18.535947+0000) 2023-09-23T09:50:47.397 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:46 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:46.982+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:04.338156+0000 front 2023-09-23T09:50:04.338141+0000 (oldest deadline 2023-09-23T09:50:27.238084+0000) 2023-09-23T09:50:47.397 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:46 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:46.982+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:13.139271+0000 front 2023-09-23T09:50:13.139458+0000 (oldest deadline 2023-09-23T09:50:36.639382+0000) 2023-09-23T09:50:47.619 INFO:journalctl@ceph.osd.6.smithi082.stdout:Sep 23 09:50:47 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-6[121893]: 2023-09-23T09:50:47.450+0000 7fa831cf8700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.842973+0000 front 2023-09-23T09:49:55.843327+0000 (oldest deadline 2023-09-23T09:50:20.543228+0000) 2023-09-23T09:50:47.619 INFO:journalctl@ceph.osd.6.smithi082.stdout:Sep 23 09:50:47 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-6[121893]: 2023-09-23T09:50:47.450+0000 7fa831cf8700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.945270+0000 front 2023-09-23T09:50:03.945238+0000 (oldest deadline 2023-09-23T09:50:26.845034+0000) 2023-09-23T09:50:47.619 INFO:journalctl@ceph.osd.6.smithi082.stdout:Sep 23 09:50:47 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-6[121893]: 2023-09-23T09:50:47.450+0000 7fa831cf8700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:08.546242+0000 front 2023-09-23T09:50:08.546522+0000 (oldest deadline 2023-09-23T09:50:36.647693+0000) 2023-09-23T09:50:47.619 INFO:journalctl@ceph.osd.6.smithi082.stdout:Sep 23 09:50:47 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-6[121893]: 2023-09-23T09:50:47.450+0000 7fa831cf8700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:21.249307+0000 front 2023-09-23T09:50:21.249346+0000 (oldest deadline 2023-09-23T09:50:46.549429+0000) 2023-09-23T09:50:47.620 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:47 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:47.237+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.275199+0000 front 2023-09-23T09:49:55.275227+0000 (oldest deadline 2023-09-23T09:50:17.575468+0000) 2023-09-23T09:50:47.620 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:47 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:47.237+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.977386+0000 front 2023-09-23T09:50:03.977111+0000 (oldest deadline 2023-09-23T09:50:29.877359+0000) 2023-09-23T09:50:47.620 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:47 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:47.237+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.778806+0000 front 2023-09-23T09:50:12.778743+0000 (oldest deadline 2023-09-23T09:50:39.779512+0000) 2023-09-23T09:50:47.620 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:47 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:47.237+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:19.780107+0000 front 2023-09-23T09:50:19.780156+0000 (oldest deadline 2023-09-23T09:50:43.880111+0000) 2023-09-23T09:50:48.061 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 23 09:50:47 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-7[115264]: 2023-09-23T09:50:47.774+0000 7ff669202700 -1 osd.7 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:02.382925+0000 front 2023-09-23T09:50:02.383033+0000 (oldest deadline 2023-09-23T09:50:25.883083+0000) 2023-09-23T09:50:48.061 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 23 09:50:47 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-7[115264]: 2023-09-23T09:50:47.774+0000 7ff669202700 -1 osd.7 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.185534+0000 front 2023-09-23T09:50:12.185608+0000 (oldest deadline 2023-09-23T09:50:36.885224+0000) 2023-09-23T09:50:48.061 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 23 09:50:47 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-7[115264]: 2023-09-23T09:50:47.774+0000 7ff669202700 -1 osd.7 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:17.386167+0000 front 2023-09-23T09:50:17.386233+0000 (oldest deadline 2023-09-23T09:50:44.387018+0000) 2023-09-23T09:50:48.061 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:47 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:47.808+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.643334+0000 front 2023-09-23T09:49:55.643391+0000 (oldest deadline 2023-09-23T09:50:18.543466+0000) 2023-09-23T09:50:48.062 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:47 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:47.808+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.145721+0000 front 2023-09-23T09:50:03.145799+0000 (oldest deadline 2023-09-23T09:50:26.045803+0000) 2023-09-23T09:50:48.062 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:47 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:47.808+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.348396+0000 front 2023-09-23T09:50:12.348362+0000 (oldest deadline 2023-09-23T09:50:34.648330+0000) 2023-09-23T09:50:48.062 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:47 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:47.808+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:22.150884+0000 front 2023-09-23T09:50:22.150846+0000 (oldest deadline 2023-09-23T09:50:45.650923+0000) 2023-09-23T09:50:48.396 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:47 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:47.940+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.535551+0000 front 2023-09-23T09:49:54.535491+0000 (oldest deadline 2023-09-23T09:50:18.535947+0000) 2023-09-23T09:50:48.396 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:47 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:47.940+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:04.338156+0000 front 2023-09-23T09:50:04.338141+0000 (oldest deadline 2023-09-23T09:50:27.238084+0000) 2023-09-23T09:50:48.397 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:47 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:47.940+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:13.139271+0000 front 2023-09-23T09:50:13.139458+0000 (oldest deadline 2023-09-23T09:50:36.639382+0000) 2023-09-23T09:50:48.397 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:48 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:48.040+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.407793+0000 front 2023-09-23T09:49:54.407750+0000 (oldest deadline 2023-09-23T09:50:17.907823+0000) 2023-09-23T09:50:48.397 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:48 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:48.040+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.110235+0000 front 2023-09-23T09:50:03.110063+0000 (oldest deadline 2023-09-23T09:50:25.910760+0000) 2023-09-23T09:50:48.397 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:48 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:48.040+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:10.011752+0000 front 2023-09-23T09:50:10.011878+0000 (oldest deadline 2023-09-23T09:50:35.311862+0000) 2023-09-23T09:50:48.397 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:48 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:48.040+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:20.013339+0000 front 2023-09-23T09:50:20.013377+0000 (oldest deadline 2023-09-23T09:50:45.913287+0000) 2023-09-23T09:50:48.619 INFO:journalctl@ceph.osd.6.smithi082.stdout:Sep 23 09:50:48 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-6[121893]: 2023-09-23T09:50:48.411+0000 7fa831cf8700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.842973+0000 front 2023-09-23T09:49:55.843327+0000 (oldest deadline 2023-09-23T09:50:20.543228+0000) 2023-09-23T09:50:48.620 INFO:journalctl@ceph.osd.6.smithi082.stdout:Sep 23 09:50:48 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-6[121893]: 2023-09-23T09:50:48.411+0000 7fa831cf8700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.945270+0000 front 2023-09-23T09:50:03.945238+0000 (oldest deadline 2023-09-23T09:50:26.845034+0000) 2023-09-23T09:50:48.620 INFO:journalctl@ceph.osd.6.smithi082.stdout:Sep 23 09:50:48 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-6[121893]: 2023-09-23T09:50:48.411+0000 7fa831cf8700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:08.546242+0000 front 2023-09-23T09:50:08.546522+0000 (oldest deadline 2023-09-23T09:50:36.647693+0000) 2023-09-23T09:50:48.620 INFO:journalctl@ceph.osd.6.smithi082.stdout:Sep 23 09:50:48 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-6[121893]: 2023-09-23T09:50:48.411+0000 7fa831cf8700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:21.249307+0000 front 2023-09-23T09:50:21.249346+0000 (oldest deadline 2023-09-23T09:50:46.549429+0000) 2023-09-23T09:50:48.620 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:48 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:48.209+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.275199+0000 front 2023-09-23T09:49:55.275227+0000 (oldest deadline 2023-09-23T09:50:17.575468+0000) 2023-09-23T09:50:48.620 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:48 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:48.209+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.977386+0000 front 2023-09-23T09:50:03.977111+0000 (oldest deadline 2023-09-23T09:50:29.877359+0000) 2023-09-23T09:50:48.621 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:48 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:48.209+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.778806+0000 front 2023-09-23T09:50:12.778743+0000 (oldest deadline 2023-09-23T09:50:39.779512+0000) 2023-09-23T09:50:48.621 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:48 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:48.209+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:19.780107+0000 front 2023-09-23T09:50:19.780156+0000 (oldest deadline 2023-09-23T09:50:43.880111+0000) 2023-09-23T09:50:49.061 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 23 09:50:48 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-7[115264]: 2023-09-23T09:50:48.739+0000 7ff669202700 -1 osd.7 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:02.382925+0000 front 2023-09-23T09:50:02.383033+0000 (oldest deadline 2023-09-23T09:50:25.883083+0000) 2023-09-23T09:50:49.061 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 23 09:50:48 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-7[115264]: 2023-09-23T09:50:48.739+0000 7ff669202700 -1 osd.7 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.185534+0000 front 2023-09-23T09:50:12.185608+0000 (oldest deadline 2023-09-23T09:50:36.885224+0000) 2023-09-23T09:50:49.061 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 23 09:50:48 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-7[115264]: 2023-09-23T09:50:48.739+0000 7ff669202700 -1 osd.7 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:17.386167+0000 front 2023-09-23T09:50:17.386233+0000 (oldest deadline 2023-09-23T09:50:44.387018+0000) 2023-09-23T09:50:49.061 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:48 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:48.839+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.643334+0000 front 2023-09-23T09:49:55.643391+0000 (oldest deadline 2023-09-23T09:50:18.543466+0000) 2023-09-23T09:50:49.061 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:48 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:48.839+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.145721+0000 front 2023-09-23T09:50:03.145799+0000 (oldest deadline 2023-09-23T09:50:26.045803+0000) 2023-09-23T09:50:49.061 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:48 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:48.839+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.348396+0000 front 2023-09-23T09:50:12.348362+0000 (oldest deadline 2023-09-23T09:50:34.648330+0000) 2023-09-23T09:50:49.061 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:48 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:48.839+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:22.150884+0000 front 2023-09-23T09:50:22.150846+0000 (oldest deadline 2023-09-23T09:50:45.650923+0000) 2023-09-23T09:50:49.397 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:49 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:49.002+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.407793+0000 front 2023-09-23T09:49:54.407750+0000 (oldest deadline 2023-09-23T09:50:17.907823+0000) 2023-09-23T09:50:49.397 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:49 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:49.002+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.110235+0000 front 2023-09-23T09:50:03.110063+0000 (oldest deadline 2023-09-23T09:50:25.910760+0000) 2023-09-23T09:50:49.397 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:49 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:49.002+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:10.011752+0000 front 2023-09-23T09:50:10.011878+0000 (oldest deadline 2023-09-23T09:50:35.311862+0000) 2023-09-23T09:50:49.397 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:49 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:49.002+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:20.013339+0000 front 2023-09-23T09:50:20.013377+0000 (oldest deadline 2023-09-23T09:50:45.913287+0000) 2023-09-23T09:50:49.397 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:48 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:48.901+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.535551+0000 front 2023-09-23T09:49:54.535491+0000 (oldest deadline 2023-09-23T09:50:18.535947+0000) 2023-09-23T09:50:49.398 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:48 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:48.901+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:04.338156+0000 front 2023-09-23T09:50:04.338141+0000 (oldest deadline 2023-09-23T09:50:27.238084+0000) 2023-09-23T09:50:49.398 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:48 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:48.901+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:13.139271+0000 front 2023-09-23T09:50:13.139458+0000 (oldest deadline 2023-09-23T09:50:36.639382+0000) 2023-09-23T09:50:49.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:49 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:49.188+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.275199+0000 front 2023-09-23T09:49:55.275227+0000 (oldest deadline 2023-09-23T09:50:17.575468+0000) 2023-09-23T09:50:49.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:49 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:49.188+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.977386+0000 front 2023-09-23T09:50:03.977111+0000 (oldest deadline 2023-09-23T09:50:29.877359+0000) 2023-09-23T09:50:49.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:49 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:49.188+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.778806+0000 front 2023-09-23T09:50:12.778743+0000 (oldest deadline 2023-09-23T09:50:39.779512+0000) 2023-09-23T09:50:49.620 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:49 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:49.188+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:19.780107+0000 front 2023-09-23T09:50:19.780156+0000 (oldest deadline 2023-09-23T09:50:43.880111+0000) 2023-09-23T09:50:50.060 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:49 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:49.884+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.643334+0000 front 2023-09-23T09:49:55.643391+0000 (oldest deadline 2023-09-23T09:50:18.543466+0000) 2023-09-23T09:50:50.061 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:49 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:49.884+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.145721+0000 front 2023-09-23T09:50:03.145799+0000 (oldest deadline 2023-09-23T09:50:26.045803+0000) 2023-09-23T09:50:50.061 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:49 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:49.884+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.348396+0000 front 2023-09-23T09:50:12.348362+0000 (oldest deadline 2023-09-23T09:50:34.648330+0000) 2023-09-23T09:50:50.061 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:49 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:49.884+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:22.150884+0000 front 2023-09-23T09:50:22.150846+0000 (oldest deadline 2023-09-23T09:50:45.650923+0000) 2023-09-23T09:50:50.061 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 23 09:50:49 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-7[115264]: 2023-09-23T09:50:49.770+0000 7ff669202700 -1 osd.7 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:02.382925+0000 front 2023-09-23T09:50:02.383033+0000 (oldest deadline 2023-09-23T09:50:25.883083+0000) 2023-09-23T09:50:50.061 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 23 09:50:49 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-7[115264]: 2023-09-23T09:50:49.770+0000 7ff669202700 -1 osd.7 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.185534+0000 front 2023-09-23T09:50:12.185608+0000 (oldest deadline 2023-09-23T09:50:36.885224+0000) 2023-09-23T09:50:50.062 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 23 09:50:49 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-7[115264]: 2023-09-23T09:50:49.770+0000 7ff669202700 -1 osd.7 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:17.386167+0000 front 2023-09-23T09:50:17.386233+0000 (oldest deadline 2023-09-23T09:50:44.387018+0000) 2023-09-23T09:50:50.119 INFO:journalctl@ceph.osd.6.smithi082.stdout:Sep 23 09:50:49 smithi082 bash[188592]: ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-6 2023-09-23T09:50:50.396 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:49 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:49.972+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.407793+0000 front 2023-09-23T09:49:54.407750+0000 (oldest deadline 2023-09-23T09:50:17.907823+0000) 2023-09-23T09:50:50.397 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:49 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:49.972+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.110235+0000 front 2023-09-23T09:50:03.110063+0000 (oldest deadline 2023-09-23T09:50:25.910760+0000) 2023-09-23T09:50:50.397 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:49 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:49.972+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:10.011752+0000 front 2023-09-23T09:50:10.011878+0000 (oldest deadline 2023-09-23T09:50:35.311862+0000) 2023-09-23T09:50:50.397 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:49 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:49.972+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:20.013339+0000 front 2023-09-23T09:50:20.013377+0000 (oldest deadline 2023-09-23T09:50:45.913287+0000) 2023-09-23T09:50:50.397 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:49 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:49.949+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.535551+0000 front 2023-09-23T09:49:54.535491+0000 (oldest deadline 2023-09-23T09:50:18.535947+0000) 2023-09-23T09:50:50.397 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:49 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:49.949+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:04.338156+0000 front 2023-09-23T09:50:04.338141+0000 (oldest deadline 2023-09-23T09:50:27.238084+0000) 2023-09-23T09:50:50.398 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:49 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:49.949+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:13.139271+0000 front 2023-09-23T09:50:13.139458+0000 (oldest deadline 2023-09-23T09:50:36.639382+0000) 2023-09-23T09:50:50.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:50 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:50.170+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.275199+0000 front 2023-09-23T09:49:55.275227+0000 (oldest deadline 2023-09-23T09:50:17.575468+0000) 2023-09-23T09:50:50.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:50 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:50.170+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.977386+0000 front 2023-09-23T09:50:03.977111+0000 (oldest deadline 2023-09-23T09:50:29.877359+0000) 2023-09-23T09:50:50.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:50 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:50.170+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.778806+0000 front 2023-09-23T09:50:12.778743+0000 (oldest deadline 2023-09-23T09:50:39.779512+0000) 2023-09-23T09:50:50.620 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:50 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:50.170+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:19.780107+0000 front 2023-09-23T09:50:19.780156+0000 (oldest deadline 2023-09-23T09:50:43.880111+0000) 2023-09-23T09:50:51.060 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 23 09:50:50 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-7[115264]: 2023-09-23T09:50:50.741+0000 7ff669202700 -1 osd.7 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:02.382925+0000 front 2023-09-23T09:50:02.383033+0000 (oldest deadline 2023-09-23T09:50:25.883083+0000) 2023-09-23T09:50:51.061 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 23 09:50:50 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-7[115264]: 2023-09-23T09:50:50.741+0000 7ff669202700 -1 osd.7 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.185534+0000 front 2023-09-23T09:50:12.185608+0000 (oldest deadline 2023-09-23T09:50:36.885224+0000) 2023-09-23T09:50:51.061 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 23 09:50:50 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-7[115264]: 2023-09-23T09:50:50.741+0000 7ff669202700 -1 osd.7 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:17.386167+0000 front 2023-09-23T09:50:17.386233+0000 (oldest deadline 2023-09-23T09:50:44.387018+0000) 2023-09-23T09:50:51.061 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:50 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:50.847+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.643334+0000 front 2023-09-23T09:49:55.643391+0000 (oldest deadline 2023-09-23T09:50:18.543466+0000) 2023-09-23T09:50:51.061 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:50 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:50.847+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.145721+0000 front 2023-09-23T09:50:03.145799+0000 (oldest deadline 2023-09-23T09:50:26.045803+0000) 2023-09-23T09:50:51.061 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:50 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:50.847+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.348396+0000 front 2023-09-23T09:50:12.348362+0000 (oldest deadline 2023-09-23T09:50:34.648330+0000) 2023-09-23T09:50:51.061 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:50 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:50.847+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:22.150884+0000 front 2023-09-23T09:50:22.150846+0000 (oldest deadline 2023-09-23T09:50:45.650923+0000) 2023-09-23T09:50:51.396 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:50 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:50.955+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.535551+0000 front 2023-09-23T09:49:54.535491+0000 (oldest deadline 2023-09-23T09:50:18.535947+0000) 2023-09-23T09:50:51.397 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:50 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:50.955+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:04.338156+0000 front 2023-09-23T09:50:04.338141+0000 (oldest deadline 2023-09-23T09:50:27.238084+0000) 2023-09-23T09:50:51.397 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:50 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:50.955+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:13.139271+0000 front 2023-09-23T09:50:13.139458+0000 (oldest deadline 2023-09-23T09:50:36.639382+0000) 2023-09-23T09:50:51.397 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:50 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:50.986+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.407793+0000 front 2023-09-23T09:49:54.407750+0000 (oldest deadline 2023-09-23T09:50:17.907823+0000) 2023-09-23T09:50:51.397 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:50 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:50.986+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.110235+0000 front 2023-09-23T09:50:03.110063+0000 (oldest deadline 2023-09-23T09:50:25.910760+0000) 2023-09-23T09:50:51.397 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:50 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:50.986+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:10.011752+0000 front 2023-09-23T09:50:10.011878+0000 (oldest deadline 2023-09-23T09:50:35.311862+0000) 2023-09-23T09:50:51.397 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:50 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:50.986+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:20.013339+0000 front 2023-09-23T09:50:20.013377+0000 (oldest deadline 2023-09-23T09:50:45.913287+0000) 2023-09-23T09:50:51.589 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:51 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:51.195+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.275199+0000 front 2023-09-23T09:49:55.275227+0000 (oldest deadline 2023-09-23T09:50:17.575468+0000) 2023-09-23T09:50:51.589 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:51 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:51.196+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.977386+0000 front 2023-09-23T09:50:03.977111+0000 (oldest deadline 2023-09-23T09:50:29.877359+0000) 2023-09-23T09:50:51.589 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:51 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:51.196+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.778806+0000 front 2023-09-23T09:50:12.778743+0000 (oldest deadline 2023-09-23T09:50:39.779512+0000) 2023-09-23T09:50:51.589 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:51 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:51.196+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:19.780107+0000 front 2023-09-23T09:50:19.780156+0000 (oldest deadline 2023-09-23T09:50:43.880111+0000) 2023-09-23T09:50:51.611 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@osd.6.service' 2023-09-23T09:50:51.700 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-09-23T09:50:51.700 INFO:tasks.cephadm.osd.6:Stopped osd.6 2023-09-23T09:50:51.701 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2023-09-23T09:50:51.701 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@osd.7 2023-09-23T09:50:52.061 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:51 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:51.834+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.643334+0000 front 2023-09-23T09:49:55.643391+0000 (oldest deadline 2023-09-23T09:50:18.543466+0000) 2023-09-23T09:50:52.061 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:51 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:51.834+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.145721+0000 front 2023-09-23T09:50:03.145799+0000 (oldest deadline 2023-09-23T09:50:26.045803+0000) 2023-09-23T09:50:52.061 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:51 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:51.834+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.348396+0000 front 2023-09-23T09:50:12.348362+0000 (oldest deadline 2023-09-23T09:50:34.648330+0000) 2023-09-23T09:50:52.061 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:51 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:51.834+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:22.150884+0000 front 2023-09-23T09:50:22.150846+0000 (oldest deadline 2023-09-23T09:50:45.650923+0000) 2023-09-23T09:50:52.061 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 23 09:50:51 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-7[115264]: 2023-09-23T09:50:51.784+0000 7ff669202700 -1 osd.7 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:02.382925+0000 front 2023-09-23T09:50:02.383033+0000 (oldest deadline 2023-09-23T09:50:25.883083+0000) 2023-09-23T09:50:52.062 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 23 09:50:51 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-7[115264]: 2023-09-23T09:50:51.784+0000 7ff669202700 -1 osd.7 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.185534+0000 front 2023-09-23T09:50:12.185608+0000 (oldest deadline 2023-09-23T09:50:36.885224+0000) 2023-09-23T09:50:52.062 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 23 09:50:51 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-7[115264]: 2023-09-23T09:50:51.784+0000 7ff669202700 -1 osd.7 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:17.386167+0000 front 2023-09-23T09:50:17.386233+0000 (oldest deadline 2023-09-23T09:50:44.387018+0000) 2023-09-23T09:50:52.062 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 23 09:50:51 smithi135 systemd[1]: Stopping Ceph osd.7 for 8926e286-59ed-11ee-8db4-212e2dc638e7... 2023-09-23T09:50:52.396 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:52 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:52.027+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.407793+0000 front 2023-09-23T09:49:54.407750+0000 (oldest deadline 2023-09-23T09:50:17.907823+0000) 2023-09-23T09:50:52.396 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:52 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:52.027+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.110235+0000 front 2023-09-23T09:50:03.110063+0000 (oldest deadline 2023-09-23T09:50:25.910760+0000) 2023-09-23T09:50:52.397 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:52 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:52.027+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:10.011752+0000 front 2023-09-23T09:50:10.011878+0000 (oldest deadline 2023-09-23T09:50:35.311862+0000) 2023-09-23T09:50:52.397 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:52 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:52.027+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:20.013339+0000 front 2023-09-23T09:50:20.013377+0000 (oldest deadline 2023-09-23T09:50:45.913287+0000) 2023-09-23T09:50:52.397 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:51 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:51.921+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.535551+0000 front 2023-09-23T09:49:54.535491+0000 (oldest deadline 2023-09-23T09:50:18.535947+0000) 2023-09-23T09:50:52.397 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:51 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:51.921+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:04.338156+0000 front 2023-09-23T09:50:04.338141+0000 (oldest deadline 2023-09-23T09:50:27.238084+0000) 2023-09-23T09:50:52.397 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:51 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:51.921+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:13.139271+0000 front 2023-09-23T09:50:13.139458+0000 (oldest deadline 2023-09-23T09:50:36.639382+0000) 2023-09-23T09:50:52.560 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 23 09:50:52 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-7[115264]: 2023-09-23T09:50:52.203+0000 7ff66dc0e700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-09-23T09:50:52.561 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 23 09:50:52 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-7[115264]: 2023-09-23T09:50:52.203+0000 7ff66dc0e700 -1 osd.7 181 *** Got signal Terminated *** 2023-09-23T09:50:52.561 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 23 09:50:52 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-7[115264]: 2023-09-23T09:50:52.203+0000 7ff66dc0e700 -1 osd.7 181 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-09-23T09:50:52.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:52 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:52.238+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.275199+0000 front 2023-09-23T09:49:55.275227+0000 (oldest deadline 2023-09-23T09:50:17.575468+0000) 2023-09-23T09:50:52.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:52 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:52.238+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.977386+0000 front 2023-09-23T09:50:03.977111+0000 (oldest deadline 2023-09-23T09:50:29.877359+0000) 2023-09-23T09:50:52.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:52 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:52.238+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.778806+0000 front 2023-09-23T09:50:12.778743+0000 (oldest deadline 2023-09-23T09:50:39.779512+0000) 2023-09-23T09:50:52.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:52 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:52.238+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:19.780107+0000 front 2023-09-23T09:50:19.780156+0000 (oldest deadline 2023-09-23T09:50:43.880111+0000) 2023-09-23T09:50:53.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:52 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:52.863+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.643334+0000 front 2023-09-23T09:49:55.643391+0000 (oldest deadline 2023-09-23T09:50:18.543466+0000) 2023-09-23T09:50:53.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:52 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:52.863+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.145721+0000 front 2023-09-23T09:50:03.145799+0000 (oldest deadline 2023-09-23T09:50:26.045803+0000) 2023-09-23T09:50:53.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:52 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:52.863+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.348396+0000 front 2023-09-23T09:50:12.348362+0000 (oldest deadline 2023-09-23T09:50:34.648330+0000) 2023-09-23T09:50:53.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:52 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:52.863+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:22.150884+0000 front 2023-09-23T09:50:22.150846+0000 (oldest deadline 2023-09-23T09:50:45.650923+0000) 2023-09-23T09:50:53.311 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 23 09:50:52 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-7[115264]: 2023-09-23T09:50:52.812+0000 7ff669202700 -1 osd.7 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:02.382925+0000 front 2023-09-23T09:50:02.383033+0000 (oldest deadline 2023-09-23T09:50:25.883083+0000) 2023-09-23T09:50:53.312 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 23 09:50:52 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-7[115264]: 2023-09-23T09:50:52.812+0000 7ff669202700 -1 osd.7 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.185534+0000 front 2023-09-23T09:50:12.185608+0000 (oldest deadline 2023-09-23T09:50:36.885224+0000) 2023-09-23T09:50:53.312 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 23 09:50:52 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-7[115264]: 2023-09-23T09:50:52.812+0000 7ff669202700 -1 osd.7 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:17.386167+0000 front 2023-09-23T09:50:17.386233+0000 (oldest deadline 2023-09-23T09:50:44.387018+0000) 2023-09-23T09:50:53.396 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:52 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:52.930+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.535551+0000 front 2023-09-23T09:49:54.535491+0000 (oldest deadline 2023-09-23T09:50:18.535947+0000) 2023-09-23T09:50:53.397 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:52 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:52.930+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:04.338156+0000 front 2023-09-23T09:50:04.338141+0000 (oldest deadline 2023-09-23T09:50:27.238084+0000) 2023-09-23T09:50:53.397 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:52 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:52.930+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:13.139271+0000 front 2023-09-23T09:50:13.139458+0000 (oldest deadline 2023-09-23T09:50:36.639382+0000) 2023-09-23T09:50:53.397 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:53 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:53.019+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.407793+0000 front 2023-09-23T09:49:54.407750+0000 (oldest deadline 2023-09-23T09:50:17.907823+0000) 2023-09-23T09:50:53.397 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:53 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:53.019+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.110235+0000 front 2023-09-23T09:50:03.110063+0000 (oldest deadline 2023-09-23T09:50:25.910760+0000) 2023-09-23T09:50:53.398 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:53 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:53.019+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:10.011752+0000 front 2023-09-23T09:50:10.011878+0000 (oldest deadline 2023-09-23T09:50:35.311862+0000) 2023-09-23T09:50:53.398 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:53 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:53.019+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:20.013339+0000 front 2023-09-23T09:50:20.013377+0000 (oldest deadline 2023-09-23T09:50:45.913287+0000) 2023-09-23T09:50:53.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:53 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:53.220+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.275199+0000 front 2023-09-23T09:49:55.275227+0000 (oldest deadline 2023-09-23T09:50:17.575468+0000) 2023-09-23T09:50:53.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:53 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:53.220+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.977386+0000 front 2023-09-23T09:50:03.977111+0000 (oldest deadline 2023-09-23T09:50:29.877359+0000) 2023-09-23T09:50:53.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:53 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:53.220+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.778806+0000 front 2023-09-23T09:50:12.778743+0000 (oldest deadline 2023-09-23T09:50:39.779512+0000) 2023-09-23T09:50:53.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:53 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:53.220+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:19.780107+0000 front 2023-09-23T09:50:19.780156+0000 (oldest deadline 2023-09-23T09:50:43.880111+0000) 2023-09-23T09:50:53.620 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:53 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:53.220+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:26.181109+0000 front 2023-09-23T09:50:26.181054+0000 (oldest deadline 2023-09-23T09:50:53.082476+0000) 2023-09-23T09:50:54.310 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 23 09:50:53 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-7[115264]: 2023-09-23T09:50:53.853+0000 7ff669202700 -1 osd.7 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:02.382925+0000 front 2023-09-23T09:50:02.383033+0000 (oldest deadline 2023-09-23T09:50:25.883083+0000) 2023-09-23T09:50:54.311 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 23 09:50:53 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-7[115264]: 2023-09-23T09:50:53.854+0000 7ff669202700 -1 osd.7 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.185534+0000 front 2023-09-23T09:50:12.185608+0000 (oldest deadline 2023-09-23T09:50:36.885224+0000) 2023-09-23T09:50:54.311 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 23 09:50:53 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-7[115264]: 2023-09-23T09:50:53.854+0000 7ff669202700 -1 osd.7 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:17.386167+0000 front 2023-09-23T09:50:17.386233+0000 (oldest deadline 2023-09-23T09:50:44.387018+0000) 2023-09-23T09:50:54.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:53 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:53.906+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.643334+0000 front 2023-09-23T09:49:55.643391+0000 (oldest deadline 2023-09-23T09:50:18.543466+0000) 2023-09-23T09:50:54.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:53 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:53.906+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.145721+0000 front 2023-09-23T09:50:03.145799+0000 (oldest deadline 2023-09-23T09:50:26.045803+0000) 2023-09-23T09:50:54.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:53 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:53.906+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.348396+0000 front 2023-09-23T09:50:12.348362+0000 (oldest deadline 2023-09-23T09:50:34.648330+0000) 2023-09-23T09:50:54.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:53 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:53.906+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:22.150884+0000 front 2023-09-23T09:50:22.150846+0000 (oldest deadline 2023-09-23T09:50:45.650923+0000) 2023-09-23T09:50:54.396 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:54 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:54.052+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.407793+0000 front 2023-09-23T09:49:54.407750+0000 (oldest deadline 2023-09-23T09:50:17.907823+0000) 2023-09-23T09:50:54.397 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:54 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:54.052+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.110235+0000 front 2023-09-23T09:50:03.110063+0000 (oldest deadline 2023-09-23T09:50:25.910760+0000) 2023-09-23T09:50:54.397 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:54 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:54.052+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:10.011752+0000 front 2023-09-23T09:50:10.011878+0000 (oldest deadline 2023-09-23T09:50:35.311862+0000) 2023-09-23T09:50:54.397 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:54 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:54.052+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:20.013339+0000 front 2023-09-23T09:50:20.013377+0000 (oldest deadline 2023-09-23T09:50:45.913287+0000) 2023-09-23T09:50:54.397 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:53 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:53.907+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.535551+0000 front 2023-09-23T09:49:54.535491+0000 (oldest deadline 2023-09-23T09:50:18.535947+0000) 2023-09-23T09:50:54.397 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:53 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:53.907+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:04.338156+0000 front 2023-09-23T09:50:04.338141+0000 (oldest deadline 2023-09-23T09:50:27.238084+0000) 2023-09-23T09:50:54.397 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:53 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:53.907+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:13.139271+0000 front 2023-09-23T09:50:13.139458+0000 (oldest deadline 2023-09-23T09:50:36.639382+0000) 2023-09-23T09:50:54.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:54 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:54.206+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.275199+0000 front 2023-09-23T09:49:55.275227+0000 (oldest deadline 2023-09-23T09:50:17.575468+0000) 2023-09-23T09:50:54.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:54 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:54.206+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.977386+0000 front 2023-09-23T09:50:03.977111+0000 (oldest deadline 2023-09-23T09:50:29.877359+0000) 2023-09-23T09:50:54.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:54 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:54.206+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.778806+0000 front 2023-09-23T09:50:12.778743+0000 (oldest deadline 2023-09-23T09:50:39.779512+0000) 2023-09-23T09:50:54.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:54 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:54.206+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:19.780107+0000 front 2023-09-23T09:50:19.780156+0000 (oldest deadline 2023-09-23T09:50:43.880111+0000) 2023-09-23T09:50:54.620 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:54 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:54.206+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:26.181109+0000 front 2023-09-23T09:50:26.181054+0000 (oldest deadline 2023-09-23T09:50:53.082476+0000) 2023-09-23T09:50:55.311 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 23 09:50:54 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-7[115264]: 2023-09-23T09:50:54.813+0000 7ff669202700 -1 osd.7 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:02.382925+0000 front 2023-09-23T09:50:02.383033+0000 (oldest deadline 2023-09-23T09:50:25.883083+0000) 2023-09-23T09:50:55.311 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 23 09:50:54 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-7[115264]: 2023-09-23T09:50:54.813+0000 7ff669202700 -1 osd.7 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.185534+0000 front 2023-09-23T09:50:12.185608+0000 (oldest deadline 2023-09-23T09:50:36.885224+0000) 2023-09-23T09:50:55.311 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 23 09:50:54 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-7[115264]: 2023-09-23T09:50:54.813+0000 7ff669202700 -1 osd.7 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:17.386167+0000 front 2023-09-23T09:50:17.386233+0000 (oldest deadline 2023-09-23T09:50:44.387018+0000) 2023-09-23T09:50:55.312 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:54 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:54.881+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.643334+0000 front 2023-09-23T09:49:55.643391+0000 (oldest deadline 2023-09-23T09:50:18.543466+0000) 2023-09-23T09:50:55.312 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:54 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:54.881+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.145721+0000 front 2023-09-23T09:50:03.145799+0000 (oldest deadline 2023-09-23T09:50:26.045803+0000) 2023-09-23T09:50:55.312 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:54 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:54.881+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.348396+0000 front 2023-09-23T09:50:12.348362+0000 (oldest deadline 2023-09-23T09:50:34.648330+0000) 2023-09-23T09:50:55.312 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:54 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:54.881+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:22.150884+0000 front 2023-09-23T09:50:22.150846+0000 (oldest deadline 2023-09-23T09:50:45.650923+0000) 2023-09-23T09:50:55.397 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:55 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:55.054+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.407793+0000 front 2023-09-23T09:49:54.407750+0000 (oldest deadline 2023-09-23T09:50:17.907823+0000) 2023-09-23T09:50:55.397 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:55 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:55.054+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.110235+0000 front 2023-09-23T09:50:03.110063+0000 (oldest deadline 2023-09-23T09:50:25.910760+0000) 2023-09-23T09:50:55.397 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:55 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:55.054+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:10.011752+0000 front 2023-09-23T09:50:10.011878+0000 (oldest deadline 2023-09-23T09:50:35.311862+0000) 2023-09-23T09:50:55.397 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:55 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:55.054+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:20.013339+0000 front 2023-09-23T09:50:20.013377+0000 (oldest deadline 2023-09-23T09:50:45.913287+0000) 2023-09-23T09:50:55.397 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:54 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:54.895+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.535551+0000 front 2023-09-23T09:49:54.535491+0000 (oldest deadline 2023-09-23T09:50:18.535947+0000) 2023-09-23T09:50:55.398 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:54 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:54.895+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:04.338156+0000 front 2023-09-23T09:50:04.338141+0000 (oldest deadline 2023-09-23T09:50:27.238084+0000) 2023-09-23T09:50:55.398 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:54 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:54.895+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:13.139271+0000 front 2023-09-23T09:50:13.139458+0000 (oldest deadline 2023-09-23T09:50:36.639382+0000) 2023-09-23T09:50:55.398 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:54 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:54.895+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:29.844086+0000 front 2023-09-23T09:50:29.844150+0000 (oldest deadline 2023-09-23T09:50:54.543783+0000) 2023-09-23T09:50:55.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:55 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:55.186+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.275199+0000 front 2023-09-23T09:49:55.275227+0000 (oldest deadline 2023-09-23T09:50:17.575468+0000) 2023-09-23T09:50:55.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:55 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:55.186+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.977386+0000 front 2023-09-23T09:50:03.977111+0000 (oldest deadline 2023-09-23T09:50:29.877359+0000) 2023-09-23T09:50:55.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:55 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:55.186+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.778806+0000 front 2023-09-23T09:50:12.778743+0000 (oldest deadline 2023-09-23T09:50:39.779512+0000) 2023-09-23T09:50:55.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:55 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:55.186+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:19.780107+0000 front 2023-09-23T09:50:19.780156+0000 (oldest deadline 2023-09-23T09:50:43.880111+0000) 2023-09-23T09:50:55.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:55 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:55.186+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:26.181109+0000 front 2023-09-23T09:50:26.181054+0000 (oldest deadline 2023-09-23T09:50:53.082476+0000) 2023-09-23T09:50:56.147 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:56 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:56.016+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.407793+0000 front 2023-09-23T09:49:54.407750+0000 (oldest deadline 2023-09-23T09:50:17.907823+0000) 2023-09-23T09:50:56.147 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:56 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:56.016+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.110235+0000 front 2023-09-23T09:50:03.110063+0000 (oldest deadline 2023-09-23T09:50:25.910760+0000) 2023-09-23T09:50:56.147 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:56 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:56.016+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:10.011752+0000 front 2023-09-23T09:50:10.011878+0000 (oldest deadline 2023-09-23T09:50:35.311862+0000) 2023-09-23T09:50:56.147 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:56 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:56.016+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:20.013339+0000 front 2023-09-23T09:50:20.013377+0000 (oldest deadline 2023-09-23T09:50:45.913287+0000) 2023-09-23T09:50:56.147 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:56 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:56.016+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:30.014787+0000 front 2023-09-23T09:50:30.014756+0000 (oldest deadline 2023-09-23T09:50:55.914739+0000) 2023-09-23T09:50:56.148 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:55 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:55.887+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.535551+0000 front 2023-09-23T09:49:54.535491+0000 (oldest deadline 2023-09-23T09:50:18.535947+0000) 2023-09-23T09:50:56.148 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:55 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:55.887+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:04.338156+0000 front 2023-09-23T09:50:04.338141+0000 (oldest deadline 2023-09-23T09:50:27.238084+0000) 2023-09-23T09:50:56.148 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:55 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:55.887+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:13.139271+0000 front 2023-09-23T09:50:13.139458+0000 (oldest deadline 2023-09-23T09:50:36.639382+0000) 2023-09-23T09:50:56.148 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:55 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:55.887+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:29.844086+0000 front 2023-09-23T09:50:29.844150+0000 (oldest deadline 2023-09-23T09:50:54.543783+0000) 2023-09-23T09:50:56.310 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 23 09:50:55 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-7[115264]: 2023-09-23T09:50:55.841+0000 7ff669202700 -1 osd.7 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:02.382925+0000 front 2023-09-23T09:50:02.383033+0000 (oldest deadline 2023-09-23T09:50:25.883083+0000) 2023-09-23T09:50:56.311 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 23 09:50:55 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-7[115264]: 2023-09-23T09:50:55.841+0000 7ff669202700 -1 osd.7 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.185534+0000 front 2023-09-23T09:50:12.185608+0000 (oldest deadline 2023-09-23T09:50:36.885224+0000) 2023-09-23T09:50:56.311 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 23 09:50:55 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-7[115264]: 2023-09-23T09:50:55.841+0000 7ff669202700 -1 osd.7 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:17.386167+0000 front 2023-09-23T09:50:17.386233+0000 (oldest deadline 2023-09-23T09:50:44.387018+0000) 2023-09-23T09:50:56.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:55 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:55.893+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.643334+0000 front 2023-09-23T09:49:55.643391+0000 (oldest deadline 2023-09-23T09:50:18.543466+0000) 2023-09-23T09:50:56.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:55 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:55.893+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.145721+0000 front 2023-09-23T09:50:03.145799+0000 (oldest deadline 2023-09-23T09:50:26.045803+0000) 2023-09-23T09:50:56.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:55 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:55.893+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.348396+0000 front 2023-09-23T09:50:12.348362+0000 (oldest deadline 2023-09-23T09:50:34.648330+0000) 2023-09-23T09:50:56.312 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:55 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:55.893+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:22.150884+0000 front 2023-09-23T09:50:22.150846+0000 (oldest deadline 2023-09-23T09:50:45.650923+0000) 2023-09-23T09:50:56.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:56 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:56.215+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.275199+0000 front 2023-09-23T09:49:55.275227+0000 (oldest deadline 2023-09-23T09:50:17.575468+0000) 2023-09-23T09:50:56.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:56 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:56.215+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.977386+0000 front 2023-09-23T09:50:03.977111+0000 (oldest deadline 2023-09-23T09:50:29.877359+0000) 2023-09-23T09:50:56.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:56 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:56.215+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.778806+0000 front 2023-09-23T09:50:12.778743+0000 (oldest deadline 2023-09-23T09:50:39.779512+0000) 2023-09-23T09:50:56.620 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:56 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:56.215+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:19.780107+0000 front 2023-09-23T09:50:19.780156+0000 (oldest deadline 2023-09-23T09:50:43.880111+0000) 2023-09-23T09:50:56.620 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:56 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:56.215+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:26.181109+0000 front 2023-09-23T09:50:26.181054+0000 (oldest deadline 2023-09-23T09:50:53.082476+0000) 2023-09-23T09:50:57.146 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:56 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:56.982+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.407793+0000 front 2023-09-23T09:49:54.407750+0000 (oldest deadline 2023-09-23T09:50:17.907823+0000) 2023-09-23T09:50:57.147 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:56 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:56.982+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.110235+0000 front 2023-09-23T09:50:03.110063+0000 (oldest deadline 2023-09-23T09:50:25.910760+0000) 2023-09-23T09:50:57.147 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:56 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:56.982+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:10.011752+0000 front 2023-09-23T09:50:10.011878+0000 (oldest deadline 2023-09-23T09:50:35.311862+0000) 2023-09-23T09:50:57.147 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:56 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:56.982+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:20.013339+0000 front 2023-09-23T09:50:20.013377+0000 (oldest deadline 2023-09-23T09:50:45.913287+0000) 2023-09-23T09:50:57.147 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:56 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:56.982+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:30.014787+0000 front 2023-09-23T09:50:30.014756+0000 (oldest deadline 2023-09-23T09:50:55.914739+0000) 2023-09-23T09:50:57.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:56 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:56.863+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.535551+0000 front 2023-09-23T09:49:54.535491+0000 (oldest deadline 2023-09-23T09:50:18.535947+0000) 2023-09-23T09:50:57.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:56 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:56.863+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:04.338156+0000 front 2023-09-23T09:50:04.338141+0000 (oldest deadline 2023-09-23T09:50:27.238084+0000) 2023-09-23T09:50:57.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:56 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:56.863+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:13.139271+0000 front 2023-09-23T09:50:13.139458+0000 (oldest deadline 2023-09-23T09:50:36.639382+0000) 2023-09-23T09:50:57.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:56 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:56.863+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:29.844086+0000 front 2023-09-23T09:50:29.844150+0000 (oldest deadline 2023-09-23T09:50:54.543783+0000) 2023-09-23T09:50:57.311 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 23 09:50:56 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-7[115264]: 2023-09-23T09:50:56.835+0000 7ff669202700 -1 osd.7 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:02.382925+0000 front 2023-09-23T09:50:02.383033+0000 (oldest deadline 2023-09-23T09:50:25.883083+0000) 2023-09-23T09:50:57.311 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 23 09:50:56 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-7[115264]: 2023-09-23T09:50:56.835+0000 7ff669202700 -1 osd.7 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.185534+0000 front 2023-09-23T09:50:12.185608+0000 (oldest deadline 2023-09-23T09:50:36.885224+0000) 2023-09-23T09:50:57.311 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 23 09:50:56 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-7[115264]: 2023-09-23T09:50:56.835+0000 7ff669202700 -1 osd.7 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:17.386167+0000 front 2023-09-23T09:50:17.386233+0000 (oldest deadline 2023-09-23T09:50:44.387018+0000) 2023-09-23T09:50:57.311 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 23 09:50:56 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-7[115264]: 2023-09-23T09:50:56.835+0000 7ff669202700 -1 osd.7 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:30.188704+0000 front 2023-09-23T09:50:30.188764+0000 (oldest deadline 2023-09-23T09:50:56.088778+0000) 2023-09-23T09:50:57.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:56 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:56.867+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.643334+0000 front 2023-09-23T09:49:55.643391+0000 (oldest deadline 2023-09-23T09:50:18.543466+0000) 2023-09-23T09:50:57.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:56 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:56.867+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.145721+0000 front 2023-09-23T09:50:03.145799+0000 (oldest deadline 2023-09-23T09:50:26.045803+0000) 2023-09-23T09:50:57.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:56 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:56.867+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.348396+0000 front 2023-09-23T09:50:12.348362+0000 (oldest deadline 2023-09-23T09:50:34.648330+0000) 2023-09-23T09:50:57.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:56 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:56.867+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:22.150884+0000 front 2023-09-23T09:50:22.150846+0000 (oldest deadline 2023-09-23T09:50:45.650923+0000) 2023-09-23T09:50:57.312 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:56 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:56.867+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:30.852678+0000 front 2023-09-23T09:50:30.852711+0000 (oldest deadline 2023-09-23T09:50:56.752802+0000) 2023-09-23T09:50:57.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:57 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:57.183+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.275199+0000 front 2023-09-23T09:49:55.275227+0000 (oldest deadline 2023-09-23T09:50:17.575468+0000) 2023-09-23T09:50:57.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:57 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:57.183+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.977386+0000 front 2023-09-23T09:50:03.977111+0000 (oldest deadline 2023-09-23T09:50:29.877359+0000) 2023-09-23T09:50:57.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:57 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:57.183+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.778806+0000 front 2023-09-23T09:50:12.778743+0000 (oldest deadline 2023-09-23T09:50:39.779512+0000) 2023-09-23T09:50:57.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:57 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:57.183+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:19.780107+0000 front 2023-09-23T09:50:19.780156+0000 (oldest deadline 2023-09-23T09:50:43.880111+0000) 2023-09-23T09:50:57.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:57 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:57.183+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:26.181109+0000 front 2023-09-23T09:50:26.181054+0000 (oldest deadline 2023-09-23T09:50:53.082476+0000) 2023-09-23T09:50:58.146 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:58 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:58.020+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.407793+0000 front 2023-09-23T09:49:54.407750+0000 (oldest deadline 2023-09-23T09:50:17.907823+0000) 2023-09-23T09:50:58.146 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:58 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:58.020+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.110235+0000 front 2023-09-23T09:50:03.110063+0000 (oldest deadline 2023-09-23T09:50:25.910760+0000) 2023-09-23T09:50:58.147 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:58 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:58.020+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:10.011752+0000 front 2023-09-23T09:50:10.011878+0000 (oldest deadline 2023-09-23T09:50:35.311862+0000) 2023-09-23T09:50:58.147 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:58 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:58.020+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:20.013339+0000 front 2023-09-23T09:50:20.013377+0000 (oldest deadline 2023-09-23T09:50:45.913287+0000) 2023-09-23T09:50:58.147 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:58 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:58.020+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:30.014787+0000 front 2023-09-23T09:50:30.014756+0000 (oldest deadline 2023-09-23T09:50:55.914739+0000) 2023-09-23T09:50:58.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:57 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:57.852+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.535551+0000 front 2023-09-23T09:49:54.535491+0000 (oldest deadline 2023-09-23T09:50:18.535947+0000) 2023-09-23T09:50:58.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:57 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:57.852+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:04.338156+0000 front 2023-09-23T09:50:04.338141+0000 (oldest deadline 2023-09-23T09:50:27.238084+0000) 2023-09-23T09:50:58.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:57 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:57.852+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:13.139271+0000 front 2023-09-23T09:50:13.139458+0000 (oldest deadline 2023-09-23T09:50:36.639382+0000) 2023-09-23T09:50:58.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:57 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:57.852+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:29.844086+0000 front 2023-09-23T09:50:29.844150+0000 (oldest deadline 2023-09-23T09:50:54.543783+0000) 2023-09-23T09:50:58.253 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:57 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:57.834+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.643334+0000 front 2023-09-23T09:49:55.643391+0000 (oldest deadline 2023-09-23T09:50:18.543466+0000) 2023-09-23T09:50:58.253 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:57 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:57.834+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.145721+0000 front 2023-09-23T09:50:03.145799+0000 (oldest deadline 2023-09-23T09:50:26.045803+0000) 2023-09-23T09:50:58.253 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:57 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:57.834+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.348396+0000 front 2023-09-23T09:50:12.348362+0000 (oldest deadline 2023-09-23T09:50:34.648330+0000) 2023-09-23T09:50:58.253 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:57 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:57.834+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:22.150884+0000 front 2023-09-23T09:50:22.150846+0000 (oldest deadline 2023-09-23T09:50:45.650923+0000) 2023-09-23T09:50:58.253 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:57 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:57.834+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:30.852678+0000 front 2023-09-23T09:50:30.852711+0000 (oldest deadline 2023-09-23T09:50:56.752802+0000) 2023-09-23T09:50:58.560 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 23 09:50:58 smithi135 bash[141590]: ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-7 2023-09-23T09:50:58.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:58 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:58.210+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.275199+0000 front 2023-09-23T09:49:55.275227+0000 (oldest deadline 2023-09-23T09:50:17.575468+0000) 2023-09-23T09:50:58.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:58 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:58.210+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.977386+0000 front 2023-09-23T09:50:03.977111+0000 (oldest deadline 2023-09-23T09:50:29.877359+0000) 2023-09-23T09:50:58.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:58 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:58.210+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.778806+0000 front 2023-09-23T09:50:12.778743+0000 (oldest deadline 2023-09-23T09:50:39.779512+0000) 2023-09-23T09:50:58.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:58 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:58.210+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:19.780107+0000 front 2023-09-23T09:50:19.780156+0000 (oldest deadline 2023-09-23T09:50:43.880111+0000) 2023-09-23T09:50:58.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:58 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:58.210+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:26.181109+0000 front 2023-09-23T09:50:26.181054+0000 (oldest deadline 2023-09-23T09:50:53.082476+0000) 2023-09-23T09:50:59.146 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:59 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:59.064+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.407793+0000 front 2023-09-23T09:49:54.407750+0000 (oldest deadline 2023-09-23T09:50:17.907823+0000) 2023-09-23T09:50:59.146 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:59 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:59.064+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.110235+0000 front 2023-09-23T09:50:03.110063+0000 (oldest deadline 2023-09-23T09:50:25.910760+0000) 2023-09-23T09:50:59.147 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:59 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:59.064+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:10.011752+0000 front 2023-09-23T09:50:10.011878+0000 (oldest deadline 2023-09-23T09:50:35.311862+0000) 2023-09-23T09:50:59.147 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:59 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:59.064+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:20.013339+0000 front 2023-09-23T09:50:20.013377+0000 (oldest deadline 2023-09-23T09:50:45.913287+0000) 2023-09-23T09:50:59.147 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:50:59 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:50:59.064+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:30.014787+0000 front 2023-09-23T09:50:30.014756+0000 (oldest deadline 2023-09-23T09:50:55.914739+0000) 2023-09-23T09:50:59.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:58 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:58.828+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.535551+0000 front 2023-09-23T09:49:54.535491+0000 (oldest deadline 2023-09-23T09:50:18.535947+0000) 2023-09-23T09:50:59.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:58 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:58.828+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:04.338156+0000 front 2023-09-23T09:50:04.338141+0000 (oldest deadline 2023-09-23T09:50:27.238084+0000) 2023-09-23T09:50:59.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:58 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:58.828+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:13.139271+0000 front 2023-09-23T09:50:13.139458+0000 (oldest deadline 2023-09-23T09:50:36.639382+0000) 2023-09-23T09:50:59.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:58 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:58.828+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:29.844086+0000 front 2023-09-23T09:50:29.844150+0000 (oldest deadline 2023-09-23T09:50:54.543783+0000) 2023-09-23T09:50:59.263 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:58 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:58.810+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.643334+0000 front 2023-09-23T09:49:55.643391+0000 (oldest deadline 2023-09-23T09:50:18.543466+0000) 2023-09-23T09:50:59.264 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:58 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:58.810+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.145721+0000 front 2023-09-23T09:50:03.145799+0000 (oldest deadline 2023-09-23T09:50:26.045803+0000) 2023-09-23T09:50:59.264 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:58 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:58.810+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.348396+0000 front 2023-09-23T09:50:12.348362+0000 (oldest deadline 2023-09-23T09:50:34.648330+0000) 2023-09-23T09:50:59.264 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:58 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:58.810+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:22.150884+0000 front 2023-09-23T09:50:22.150846+0000 (oldest deadline 2023-09-23T09:50:45.650923+0000) 2023-09-23T09:50:59.264 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:58 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:58.810+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:30.852678+0000 front 2023-09-23T09:50:30.852711+0000 (oldest deadline 2023-09-23T09:50:56.752802+0000) 2023-09-23T09:50:59.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:59 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:59.259+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.275199+0000 front 2023-09-23T09:49:55.275227+0000 (oldest deadline 2023-09-23T09:50:17.575468+0000) 2023-09-23T09:50:59.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:59 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:59.259+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.977386+0000 front 2023-09-23T09:50:03.977111+0000 (oldest deadline 2023-09-23T09:50:29.877359+0000) 2023-09-23T09:50:59.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:59 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:59.259+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.778806+0000 front 2023-09-23T09:50:12.778743+0000 (oldest deadline 2023-09-23T09:50:39.779512+0000) 2023-09-23T09:50:59.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:59 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:59.259+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:19.780107+0000 front 2023-09-23T09:50:19.780156+0000 (oldest deadline 2023-09-23T09:50:43.880111+0000) 2023-09-23T09:50:59.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:50:59 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:50:59.259+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:26.181109+0000 front 2023-09-23T09:50:26.181054+0000 (oldest deadline 2023-09-23T09:50:53.082476+0000) 2023-09-23T09:51:00.050 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:59 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:59.860+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.643334+0000 front 2023-09-23T09:49:55.643391+0000 (oldest deadline 2023-09-23T09:50:18.543466+0000) 2023-09-23T09:51:00.050 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:59 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:59.860+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.145721+0000 front 2023-09-23T09:50:03.145799+0000 (oldest deadline 2023-09-23T09:50:26.045803+0000) 2023-09-23T09:51:00.051 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:59 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:59.860+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.348396+0000 front 2023-09-23T09:50:12.348362+0000 (oldest deadline 2023-09-23T09:50:34.648330+0000) 2023-09-23T09:51:00.051 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:59 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:59.860+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:22.150884+0000 front 2023-09-23T09:50:22.150846+0000 (oldest deadline 2023-09-23T09:50:45.650923+0000) 2023-09-23T09:51:00.051 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:50:59 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:50:59.860+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:30.852678+0000 front 2023-09-23T09:50:30.852711+0000 (oldest deadline 2023-09-23T09:50:56.752802+0000) 2023-09-23T09:51:00.076 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@osd.7.service' 2023-09-23T09:51:00.147 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:51:00 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:51:00.096+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.407793+0000 front 2023-09-23T09:49:54.407750+0000 (oldest deadline 2023-09-23T09:50:17.907823+0000) 2023-09-23T09:51:00.147 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:51:00 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:51:00.096+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.110235+0000 front 2023-09-23T09:50:03.110063+0000 (oldest deadline 2023-09-23T09:50:25.910760+0000) 2023-09-23T09:51:00.147 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:51:00 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:51:00.096+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:10.011752+0000 front 2023-09-23T09:50:10.011878+0000 (oldest deadline 2023-09-23T09:50:35.311862+0000) 2023-09-23T09:51:00.147 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:51:00 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:51:00.096+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:20.013339+0000 front 2023-09-23T09:50:20.013377+0000 (oldest deadline 2023-09-23T09:50:45.913287+0000) 2023-09-23T09:51:00.147 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:51:00 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:51:00.096+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:30.014787+0000 front 2023-09-23T09:50:30.014756+0000 (oldest deadline 2023-09-23T09:50:55.914739+0000) 2023-09-23T09:51:00.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:59 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:59.874+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.535551+0000 front 2023-09-23T09:49:54.535491+0000 (oldest deadline 2023-09-23T09:50:18.535947+0000) 2023-09-23T09:51:00.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:59 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:59.874+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:04.338156+0000 front 2023-09-23T09:50:04.338141+0000 (oldest deadline 2023-09-23T09:50:27.238084+0000) 2023-09-23T09:51:00.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:59 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:59.874+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:13.139271+0000 front 2023-09-23T09:50:13.139458+0000 (oldest deadline 2023-09-23T09:50:36.639382+0000) 2023-09-23T09:51:00.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:50:59 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:50:59.874+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:29.844086+0000 front 2023-09-23T09:50:29.844150+0000 (oldest deadline 2023-09-23T09:50:54.543783+0000) 2023-09-23T09:51:00.164 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-09-23T09:51:00.164 INFO:tasks.cephadm.osd.7:Stopped osd.7 2023-09-23T09:51:00.164 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2023-09-23T09:51:00.164 DEBUG:teuthology.orchestra.run.smithi161:> sudo systemctl stop ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@osd.8 2023-09-23T09:51:00.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:51:00 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:51:00.217+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.275199+0000 front 2023-09-23T09:49:55.275227+0000 (oldest deadline 2023-09-23T09:50:17.575468+0000) 2023-09-23T09:51:00.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:51:00 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:51:00.217+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.977386+0000 front 2023-09-23T09:50:03.977111+0000 (oldest deadline 2023-09-23T09:50:29.877359+0000) 2023-09-23T09:51:00.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:51:00 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:51:00.217+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.778806+0000 front 2023-09-23T09:50:12.778743+0000 (oldest deadline 2023-09-23T09:50:39.779512+0000) 2023-09-23T09:51:00.620 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:51:00 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:51:00.217+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:19.780107+0000 front 2023-09-23T09:50:19.780156+0000 (oldest deadline 2023-09-23T09:50:43.880111+0000) 2023-09-23T09:51:00.620 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:51:00 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:51:00.218+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:26.181109+0000 front 2023-09-23T09:50:26.181054+0000 (oldest deadline 2023-09-23T09:50:53.082476+0000) 2023-09-23T09:51:00.647 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:51:00 smithi161 systemd[1]: Stopping Ceph osd.8 for 8926e286-59ed-11ee-8db4-212e2dc638e7... 2023-09-23T09:51:01.053 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:00 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:00.891+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.535551+0000 front 2023-09-23T09:49:54.535491+0000 (oldest deadline 2023-09-23T09:50:18.535947+0000) 2023-09-23T09:51:01.053 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:00 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:00.891+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:04.338156+0000 front 2023-09-23T09:50:04.338141+0000 (oldest deadline 2023-09-23T09:50:27.238084+0000) 2023-09-23T09:51:01.053 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:00 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:00.891+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:13.139271+0000 front 2023-09-23T09:50:13.139458+0000 (oldest deadline 2023-09-23T09:50:36.639382+0000) 2023-09-23T09:51:01.053 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:00 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:00.891+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:29.844086+0000 front 2023-09-23T09:50:29.844150+0000 (oldest deadline 2023-09-23T09:50:54.543783+0000) 2023-09-23T09:51:01.054 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:51:00 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:51:00.669+0000 7f47fb890700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-09-23T09:51:01.054 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:51:00 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:51:00.669+0000 7f47fb890700 -1 osd.8 181 *** Got signal Terminated *** 2023-09-23T09:51:01.054 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:51:00 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:51:00.669+0000 7f47fb890700 -1 osd.8 181 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-09-23T09:51:01.054 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:51:01 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:51:01.052+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.407793+0000 front 2023-09-23T09:49:54.407750+0000 (oldest deadline 2023-09-23T09:50:17.907823+0000) 2023-09-23T09:51:01.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:00 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:00.893+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.643334+0000 front 2023-09-23T09:49:55.643391+0000 (oldest deadline 2023-09-23T09:50:18.543466+0000) 2023-09-23T09:51:01.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:00 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:00.893+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.145721+0000 front 2023-09-23T09:50:03.145799+0000 (oldest deadline 2023-09-23T09:50:26.045803+0000) 2023-09-23T09:51:01.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:00 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:00.893+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.348396+0000 front 2023-09-23T09:50:12.348362+0000 (oldest deadline 2023-09-23T09:50:34.648330+0000) 2023-09-23T09:51:01.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:00 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:00.893+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:22.150884+0000 front 2023-09-23T09:50:22.150846+0000 (oldest deadline 2023-09-23T09:50:45.650923+0000) 2023-09-23T09:51:01.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:00 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:00.893+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:30.852678+0000 front 2023-09-23T09:50:30.852711+0000 (oldest deadline 2023-09-23T09:50:56.752802+0000) 2023-09-23T09:51:01.396 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:51:01 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:51:01.052+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.110235+0000 front 2023-09-23T09:50:03.110063+0000 (oldest deadline 2023-09-23T09:50:25.910760+0000) 2023-09-23T09:51:01.396 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:51:01 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:51:01.052+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:10.011752+0000 front 2023-09-23T09:50:10.011878+0000 (oldest deadline 2023-09-23T09:50:35.311862+0000) 2023-09-23T09:51:01.397 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:51:01 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:51:01.052+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:20.013339+0000 front 2023-09-23T09:50:20.013377+0000 (oldest deadline 2023-09-23T09:50:45.913287+0000) 2023-09-23T09:51:01.397 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:51:01 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:51:01.052+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:30.014787+0000 front 2023-09-23T09:50:30.014756+0000 (oldest deadline 2023-09-23T09:50:55.914739+0000) 2023-09-23T09:51:01.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:51:01 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:51:01.247+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.275199+0000 front 2023-09-23T09:49:55.275227+0000 (oldest deadline 2023-09-23T09:50:17.575468+0000) 2023-09-23T09:51:01.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:51:01 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:51:01.247+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.977386+0000 front 2023-09-23T09:50:03.977111+0000 (oldest deadline 2023-09-23T09:50:29.877359+0000) 2023-09-23T09:51:01.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:51:01 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:51:01.247+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.778806+0000 front 2023-09-23T09:50:12.778743+0000 (oldest deadline 2023-09-23T09:50:39.779512+0000) 2023-09-23T09:51:01.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:51:01 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:51:01.247+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:19.780107+0000 front 2023-09-23T09:50:19.780156+0000 (oldest deadline 2023-09-23T09:50:43.880111+0000) 2023-09-23T09:51:01.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:51:01 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:51:01.247+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:26.181109+0000 front 2023-09-23T09:50:26.181054+0000 (oldest deadline 2023-09-23T09:50:53.082476+0000) 2023-09-23T09:51:02.146 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:01 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:01.868+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.535551+0000 front 2023-09-23T09:49:54.535491+0000 (oldest deadline 2023-09-23T09:50:18.535947+0000) 2023-09-23T09:51:02.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:01 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:01.868+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:04.338156+0000 front 2023-09-23T09:50:04.338141+0000 (oldest deadline 2023-09-23T09:50:27.238084+0000) 2023-09-23T09:51:02.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:01 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:01.868+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:13.139271+0000 front 2023-09-23T09:50:13.139458+0000 (oldest deadline 2023-09-23T09:50:36.639382+0000) 2023-09-23T09:51:02.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:01 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:01.868+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:29.844086+0000 front 2023-09-23T09:50:29.844150+0000 (oldest deadline 2023-09-23T09:50:54.543783+0000) 2023-09-23T09:51:02.147 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:51:02 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:51:02.012+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.407793+0000 front 2023-09-23T09:49:54.407750+0000 (oldest deadline 2023-09-23T09:50:17.907823+0000) 2023-09-23T09:51:02.148 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:51:02 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:51:02.012+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.110235+0000 front 2023-09-23T09:50:03.110063+0000 (oldest deadline 2023-09-23T09:50:25.910760+0000) 2023-09-23T09:51:02.148 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:51:02 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:51:02.012+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:10.011752+0000 front 2023-09-23T09:50:10.011878+0000 (oldest deadline 2023-09-23T09:50:35.311862+0000) 2023-09-23T09:51:02.148 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:51:02 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:51:02.012+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:20.013339+0000 front 2023-09-23T09:50:20.013377+0000 (oldest deadline 2023-09-23T09:50:45.913287+0000) 2023-09-23T09:51:02.148 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:51:02 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:51:02.012+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:30.014787+0000 front 2023-09-23T09:50:30.014756+0000 (oldest deadline 2023-09-23T09:50:55.914739+0000) 2023-09-23T09:51:02.148 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:51:02 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:51:02.012+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.161:6812 osd.5 since back 2023-09-23T09:50:35.915158+0000 front 2023-09-23T09:50:35.915209+0000 (oldest deadline 2023-09-23T09:51:01.215288+0000) 2023-09-23T09:51:02.310 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:01 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:01.899+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.643334+0000 front 2023-09-23T09:49:55.643391+0000 (oldest deadline 2023-09-23T09:50:18.543466+0000) 2023-09-23T09:51:02.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:01 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:01.899+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.145721+0000 front 2023-09-23T09:50:03.145799+0000 (oldest deadline 2023-09-23T09:50:26.045803+0000) 2023-09-23T09:51:02.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:01 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:01.899+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.348396+0000 front 2023-09-23T09:50:12.348362+0000 (oldest deadline 2023-09-23T09:50:34.648330+0000) 2023-09-23T09:51:02.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:01 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:01.899+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:22.150884+0000 front 2023-09-23T09:50:22.150846+0000 (oldest deadline 2023-09-23T09:50:45.650923+0000) 2023-09-23T09:51:02.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:01 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:01.899+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:30.852678+0000 front 2023-09-23T09:50:30.852711+0000 (oldest deadline 2023-09-23T09:50:56.752802+0000) 2023-09-23T09:51:02.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:51:02 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:51:02.290+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.275199+0000 front 2023-09-23T09:49:55.275227+0000 (oldest deadline 2023-09-23T09:50:17.575468+0000) 2023-09-23T09:51:02.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:51:02 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:51:02.290+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.977386+0000 front 2023-09-23T09:50:03.977111+0000 (oldest deadline 2023-09-23T09:50:29.877359+0000) 2023-09-23T09:51:02.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:51:02 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:51:02.290+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.778806+0000 front 2023-09-23T09:50:12.778743+0000 (oldest deadline 2023-09-23T09:50:39.779512+0000) 2023-09-23T09:51:02.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:51:02 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:51:02.290+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:19.780107+0000 front 2023-09-23T09:50:19.780156+0000 (oldest deadline 2023-09-23T09:50:43.880111+0000) 2023-09-23T09:51:02.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:51:02 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:51:02.290+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:26.181109+0000 front 2023-09-23T09:50:26.181054+0000 (oldest deadline 2023-09-23T09:50:53.082476+0000) 2023-09-23T09:51:03.146 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:02 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:02.885+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.535551+0000 front 2023-09-23T09:49:54.535491+0000 (oldest deadline 2023-09-23T09:50:18.535947+0000) 2023-09-23T09:51:03.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:02 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:02.885+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:04.338156+0000 front 2023-09-23T09:50:04.338141+0000 (oldest deadline 2023-09-23T09:50:27.238084+0000) 2023-09-23T09:51:03.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:02 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:02.885+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:13.139271+0000 front 2023-09-23T09:50:13.139458+0000 (oldest deadline 2023-09-23T09:50:36.639382+0000) 2023-09-23T09:51:03.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:02 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:02.885+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:29.844086+0000 front 2023-09-23T09:50:29.844150+0000 (oldest deadline 2023-09-23T09:50:54.543783+0000) 2023-09-23T09:51:03.147 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:51:02 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:51:02.968+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.407793+0000 front 2023-09-23T09:49:54.407750+0000 (oldest deadline 2023-09-23T09:50:17.907823+0000) 2023-09-23T09:51:03.147 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:51:02 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:51:02.968+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.110235+0000 front 2023-09-23T09:50:03.110063+0000 (oldest deadline 2023-09-23T09:50:25.910760+0000) 2023-09-23T09:51:03.147 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:51:02 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:51:02.968+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:10.011752+0000 front 2023-09-23T09:50:10.011878+0000 (oldest deadline 2023-09-23T09:50:35.311862+0000) 2023-09-23T09:51:03.147 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:51:02 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:51:02.968+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:20.013339+0000 front 2023-09-23T09:50:20.013377+0000 (oldest deadline 2023-09-23T09:50:45.913287+0000) 2023-09-23T09:51:03.147 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:51:02 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:51:02.968+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:30.014787+0000 front 2023-09-23T09:50:30.014756+0000 (oldest deadline 2023-09-23T09:50:55.914739+0000) 2023-09-23T09:51:03.148 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:51:02 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:51:02.968+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.161:6812 osd.5 since back 2023-09-23T09:50:35.915158+0000 front 2023-09-23T09:50:35.915209+0000 (oldest deadline 2023-09-23T09:51:01.215288+0000) 2023-09-23T09:51:03.310 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:02 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:02.875+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.643334+0000 front 2023-09-23T09:49:55.643391+0000 (oldest deadline 2023-09-23T09:50:18.543466+0000) 2023-09-23T09:51:03.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:02 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:02.875+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.145721+0000 front 2023-09-23T09:50:03.145799+0000 (oldest deadline 2023-09-23T09:50:26.045803+0000) 2023-09-23T09:51:03.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:02 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:02.875+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.348396+0000 front 2023-09-23T09:50:12.348362+0000 (oldest deadline 2023-09-23T09:50:34.648330+0000) 2023-09-23T09:51:03.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:02 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:02.875+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:22.150884+0000 front 2023-09-23T09:50:22.150846+0000 (oldest deadline 2023-09-23T09:50:45.650923+0000) 2023-09-23T09:51:03.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:02 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:02.875+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:30.852678+0000 front 2023-09-23T09:50:30.852711+0000 (oldest deadline 2023-09-23T09:50:56.752802+0000) 2023-09-23T09:51:03.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:02 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:02.875+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.161:6812 osd.5 since back 2023-09-23T09:50:36.753862+0000 front 2023-09-23T09:50:36.753669+0000 (oldest deadline 2023-09-23T09:51:02.653297+0000) 2023-09-23T09:51:03.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:51:03 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:51:03.310+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.275199+0000 front 2023-09-23T09:49:55.275227+0000 (oldest deadline 2023-09-23T09:50:17.575468+0000) 2023-09-23T09:51:03.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:51:03 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:51:03.310+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.977386+0000 front 2023-09-23T09:50:03.977111+0000 (oldest deadline 2023-09-23T09:50:29.877359+0000) 2023-09-23T09:51:03.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:51:03 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:51:03.310+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.778806+0000 front 2023-09-23T09:50:12.778743+0000 (oldest deadline 2023-09-23T09:50:39.779512+0000) 2023-09-23T09:51:03.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:51:03 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:51:03.310+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:19.780107+0000 front 2023-09-23T09:50:19.780156+0000 (oldest deadline 2023-09-23T09:50:43.880111+0000) 2023-09-23T09:51:03.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:51:03 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:51:03.310+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:26.181109+0000 front 2023-09-23T09:50:26.181054+0000 (oldest deadline 2023-09-23T09:50:53.082476+0000) 2023-09-23T09:51:04.147 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:51:03 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:51:03.945+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.407793+0000 front 2023-09-23T09:49:54.407750+0000 (oldest deadline 2023-09-23T09:50:17.907823+0000) 2023-09-23T09:51:04.147 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:51:03 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:51:03.945+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.110235+0000 front 2023-09-23T09:50:03.110063+0000 (oldest deadline 2023-09-23T09:50:25.910760+0000) 2023-09-23T09:51:04.147 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:51:03 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:51:03.945+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:10.011752+0000 front 2023-09-23T09:50:10.011878+0000 (oldest deadline 2023-09-23T09:50:35.311862+0000) 2023-09-23T09:51:04.147 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:51:03 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:51:03.945+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:20.013339+0000 front 2023-09-23T09:50:20.013377+0000 (oldest deadline 2023-09-23T09:50:45.913287+0000) 2023-09-23T09:51:04.147 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:51:03 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:51:03.945+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:30.014787+0000 front 2023-09-23T09:50:30.014756+0000 (oldest deadline 2023-09-23T09:50:55.914739+0000) 2023-09-23T09:51:04.147 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:51:03 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:51:03.945+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.161:6812 osd.5 since back 2023-09-23T09:50:35.915158+0000 front 2023-09-23T09:50:35.915209+0000 (oldest deadline 2023-09-23T09:51:01.215288+0000) 2023-09-23T09:51:04.148 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:03 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:03.863+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.535551+0000 front 2023-09-23T09:49:54.535491+0000 (oldest deadline 2023-09-23T09:50:18.535947+0000) 2023-09-23T09:51:04.148 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:03 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:03.863+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:04.338156+0000 front 2023-09-23T09:50:04.338141+0000 (oldest deadline 2023-09-23T09:50:27.238084+0000) 2023-09-23T09:51:04.148 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:03 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:03.863+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:13.139271+0000 front 2023-09-23T09:50:13.139458+0000 (oldest deadline 2023-09-23T09:50:36.639382+0000) 2023-09-23T09:51:04.148 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:03 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:03.863+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:29.844086+0000 front 2023-09-23T09:50:29.844150+0000 (oldest deadline 2023-09-23T09:50:54.543783+0000) 2023-09-23T09:51:04.148 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:03 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:03.863+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.161:6812 osd.5 since back 2023-09-23T09:50:39.745614+0000 front 2023-09-23T09:50:39.745504+0000 (oldest deadline 2023-09-23T09:51:03.746156+0000) 2023-09-23T09:51:04.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:03 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:03.839+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.643334+0000 front 2023-09-23T09:49:55.643391+0000 (oldest deadline 2023-09-23T09:50:18.543466+0000) 2023-09-23T09:51:04.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:03 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:03.839+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.145721+0000 front 2023-09-23T09:50:03.145799+0000 (oldest deadline 2023-09-23T09:50:26.045803+0000) 2023-09-23T09:51:04.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:03 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:03.839+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.348396+0000 front 2023-09-23T09:50:12.348362+0000 (oldest deadline 2023-09-23T09:50:34.648330+0000) 2023-09-23T09:51:04.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:03 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:03.839+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:22.150884+0000 front 2023-09-23T09:50:22.150846+0000 (oldest deadline 2023-09-23T09:50:45.650923+0000) 2023-09-23T09:51:04.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:03 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:03.839+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:30.852678+0000 front 2023-09-23T09:50:30.852711+0000 (oldest deadline 2023-09-23T09:50:56.752802+0000) 2023-09-23T09:51:04.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:03 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:03.839+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.161:6812 osd.5 since back 2023-09-23T09:50:36.753862+0000 front 2023-09-23T09:50:36.753669+0000 (oldest deadline 2023-09-23T09:51:02.653297+0000) 2023-09-23T09:51:04.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:51:04 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:51:04.321+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.275199+0000 front 2023-09-23T09:49:55.275227+0000 (oldest deadline 2023-09-23T09:50:17.575468+0000) 2023-09-23T09:51:04.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:51:04 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:51:04.321+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.977386+0000 front 2023-09-23T09:50:03.977111+0000 (oldest deadline 2023-09-23T09:50:29.877359+0000) 2023-09-23T09:51:04.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:51:04 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:51:04.321+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.778806+0000 front 2023-09-23T09:50:12.778743+0000 (oldest deadline 2023-09-23T09:50:39.779512+0000) 2023-09-23T09:51:04.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:51:04 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:51:04.321+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:19.780107+0000 front 2023-09-23T09:50:19.780156+0000 (oldest deadline 2023-09-23T09:50:43.880111+0000) 2023-09-23T09:51:04.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:51:04 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:51:04.321+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:26.181109+0000 front 2023-09-23T09:50:26.181054+0000 (oldest deadline 2023-09-23T09:50:53.082476+0000) 2023-09-23T09:51:05.147 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:51:04 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:51:04.902+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.407793+0000 front 2023-09-23T09:49:54.407750+0000 (oldest deadline 2023-09-23T09:50:17.907823+0000) 2023-09-23T09:51:05.147 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:51:04 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:51:04.902+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.110235+0000 front 2023-09-23T09:50:03.110063+0000 (oldest deadline 2023-09-23T09:50:25.910760+0000) 2023-09-23T09:51:05.147 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:51:04 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:51:04.902+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:10.011752+0000 front 2023-09-23T09:50:10.011878+0000 (oldest deadline 2023-09-23T09:50:35.311862+0000) 2023-09-23T09:51:05.147 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:51:04 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:51:04.902+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:20.013339+0000 front 2023-09-23T09:50:20.013377+0000 (oldest deadline 2023-09-23T09:50:45.913287+0000) 2023-09-23T09:51:05.147 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:51:04 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:51:04.902+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:30.014787+0000 front 2023-09-23T09:50:30.014756+0000 (oldest deadline 2023-09-23T09:50:55.914739+0000) 2023-09-23T09:51:05.147 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:51:04 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8[116492]: 2023-09-23T09:51:04.902+0000 7f47f6683700 -1 osd.8 181 heartbeat_check: no reply from 172.21.15.161:6812 osd.5 since back 2023-09-23T09:50:35.915158+0000 front 2023-09-23T09:50:35.915209+0000 (oldest deadline 2023-09-23T09:51:01.215288+0000) 2023-09-23T09:51:05.148 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:04 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:04.856+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.535551+0000 front 2023-09-23T09:49:54.535491+0000 (oldest deadline 2023-09-23T09:50:18.535947+0000) 2023-09-23T09:51:05.148 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:04 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:04.856+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:04.338156+0000 front 2023-09-23T09:50:04.338141+0000 (oldest deadline 2023-09-23T09:50:27.238084+0000) 2023-09-23T09:51:05.148 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:04 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:04.856+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:13.139271+0000 front 2023-09-23T09:50:13.139458+0000 (oldest deadline 2023-09-23T09:50:36.639382+0000) 2023-09-23T09:51:05.148 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:04 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:04.856+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:29.844086+0000 front 2023-09-23T09:50:29.844150+0000 (oldest deadline 2023-09-23T09:50:54.543783+0000) 2023-09-23T09:51:05.148 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:04 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:04.856+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.161:6812 osd.5 since back 2023-09-23T09:50:39.745614+0000 front 2023-09-23T09:50:39.745504+0000 (oldest deadline 2023-09-23T09:51:03.746156+0000) 2023-09-23T09:51:05.310 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:04 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:04.888+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.643334+0000 front 2023-09-23T09:49:55.643391+0000 (oldest deadline 2023-09-23T09:50:18.543466+0000) 2023-09-23T09:51:05.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:04 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:04.888+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.145721+0000 front 2023-09-23T09:50:03.145799+0000 (oldest deadline 2023-09-23T09:50:26.045803+0000) 2023-09-23T09:51:05.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:04 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:04.888+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.348396+0000 front 2023-09-23T09:50:12.348362+0000 (oldest deadline 2023-09-23T09:50:34.648330+0000) 2023-09-23T09:51:05.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:04 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:04.888+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:22.150884+0000 front 2023-09-23T09:50:22.150846+0000 (oldest deadline 2023-09-23T09:50:45.650923+0000) 2023-09-23T09:51:05.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:04 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:04.888+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:30.852678+0000 front 2023-09-23T09:50:30.852711+0000 (oldest deadline 2023-09-23T09:50:56.752802+0000) 2023-09-23T09:51:05.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:04 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:04.888+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.161:6812 osd.5 since back 2023-09-23T09:50:36.753862+0000 front 2023-09-23T09:50:36.753669+0000 (oldest deadline 2023-09-23T09:51:02.653297+0000) 2023-09-23T09:51:05.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:51:05 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:51:05.355+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.275199+0000 front 2023-09-23T09:49:55.275227+0000 (oldest deadline 2023-09-23T09:50:17.575468+0000) 2023-09-23T09:51:05.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:51:05 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:51:05.355+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.977386+0000 front 2023-09-23T09:50:03.977111+0000 (oldest deadline 2023-09-23T09:50:29.877359+0000) 2023-09-23T09:51:05.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:51:05 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:51:05.355+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.778806+0000 front 2023-09-23T09:50:12.778743+0000 (oldest deadline 2023-09-23T09:50:39.779512+0000) 2023-09-23T09:51:05.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:51:05 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:51:05.355+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:19.780107+0000 front 2023-09-23T09:50:19.780156+0000 (oldest deadline 2023-09-23T09:50:43.880111+0000) 2023-09-23T09:51:05.620 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:51:05 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:51:05.355+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:26.181109+0000 front 2023-09-23T09:50:26.181054+0000 (oldest deadline 2023-09-23T09:50:53.082476+0000) 2023-09-23T09:51:06.146 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:05 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:05.809+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.535551+0000 front 2023-09-23T09:49:54.535491+0000 (oldest deadline 2023-09-23T09:50:18.535947+0000) 2023-09-23T09:51:06.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:05 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:05.809+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:04.338156+0000 front 2023-09-23T09:50:04.338141+0000 (oldest deadline 2023-09-23T09:50:27.238084+0000) 2023-09-23T09:51:06.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:05 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:05.809+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:13.139271+0000 front 2023-09-23T09:50:13.139458+0000 (oldest deadline 2023-09-23T09:50:36.639382+0000) 2023-09-23T09:51:06.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:05 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:05.809+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:29.844086+0000 front 2023-09-23T09:50:29.844150+0000 (oldest deadline 2023-09-23T09:50:54.543783+0000) 2023-09-23T09:51:06.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:05 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:05.809+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.161:6812 osd.5 since back 2023-09-23T09:50:39.745614+0000 front 2023-09-23T09:50:39.745504+0000 (oldest deadline 2023-09-23T09:51:03.746156+0000) 2023-09-23T09:51:06.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:05 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:05.931+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.643334+0000 front 2023-09-23T09:49:55.643391+0000 (oldest deadline 2023-09-23T09:50:18.543466+0000) 2023-09-23T09:51:06.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:05 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:05.931+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.145721+0000 front 2023-09-23T09:50:03.145799+0000 (oldest deadline 2023-09-23T09:50:26.045803+0000) 2023-09-23T09:51:06.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:05 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:05.931+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.348396+0000 front 2023-09-23T09:50:12.348362+0000 (oldest deadline 2023-09-23T09:50:34.648330+0000) 2023-09-23T09:51:06.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:05 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:05.931+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:22.150884+0000 front 2023-09-23T09:50:22.150846+0000 (oldest deadline 2023-09-23T09:50:45.650923+0000) 2023-09-23T09:51:06.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:05 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:05.931+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:30.852678+0000 front 2023-09-23T09:50:30.852711+0000 (oldest deadline 2023-09-23T09:50:56.752802+0000) 2023-09-23T09:51:06.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:05 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:05.931+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.161:6812 osd.5 since back 2023-09-23T09:50:36.753862+0000 front 2023-09-23T09:50:36.753669+0000 (oldest deadline 2023-09-23T09:51:02.653297+0000) 2023-09-23T09:51:06.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:51:06 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:51:06.321+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.275199+0000 front 2023-09-23T09:49:55.275227+0000 (oldest deadline 2023-09-23T09:50:17.575468+0000) 2023-09-23T09:51:06.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:51:06 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:51:06.322+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.977386+0000 front 2023-09-23T09:50:03.977111+0000 (oldest deadline 2023-09-23T09:50:29.877359+0000) 2023-09-23T09:51:06.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:51:06 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:51:06.322+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.778806+0000 front 2023-09-23T09:50:12.778743+0000 (oldest deadline 2023-09-23T09:50:39.779512+0000) 2023-09-23T09:51:06.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:51:06 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:51:06.322+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:19.780107+0000 front 2023-09-23T09:50:19.780156+0000 (oldest deadline 2023-09-23T09:50:43.880111+0000) 2023-09-23T09:51:06.620 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:51:06 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:51:06.322+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:26.181109+0000 front 2023-09-23T09:50:26.181054+0000 (oldest deadline 2023-09-23T09:50:53.082476+0000) 2023-09-23T09:51:06.620 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:51:06 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:51:06.322+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.161:6812 osd.5 since back 2023-09-23T09:50:35.383468+0000 front 2023-09-23T09:50:35.383509+0000 (oldest deadline 2023-09-23T09:51:05.384181+0000) 2023-09-23T09:51:06.896 INFO:journalctl@ceph.osd.8.smithi161.stdout:Sep 23 09:51:06 smithi161 bash[141693]: ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-8 2023-09-23T09:51:06.897 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:06 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:06.789+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.535551+0000 front 2023-09-23T09:49:54.535491+0000 (oldest deadline 2023-09-23T09:50:18.535947+0000) 2023-09-23T09:51:06.897 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:06 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:06.789+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:04.338156+0000 front 2023-09-23T09:50:04.338141+0000 (oldest deadline 2023-09-23T09:50:27.238084+0000) 2023-09-23T09:51:06.897 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:06 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:06.789+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:13.139271+0000 front 2023-09-23T09:50:13.139458+0000 (oldest deadline 2023-09-23T09:50:36.639382+0000) 2023-09-23T09:51:06.897 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:06 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:06.789+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:29.844086+0000 front 2023-09-23T09:50:29.844150+0000 (oldest deadline 2023-09-23T09:50:54.543783+0000) 2023-09-23T09:51:06.897 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:06 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:06.789+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.161:6812 osd.5 since back 2023-09-23T09:50:39.745614+0000 front 2023-09-23T09:50:39.745504+0000 (oldest deadline 2023-09-23T09:51:03.746156+0000) 2023-09-23T09:51:07.310 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:06 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:06.896+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.643334+0000 front 2023-09-23T09:49:55.643391+0000 (oldest deadline 2023-09-23T09:50:18.543466+0000) 2023-09-23T09:51:07.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:06 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:06.896+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.145721+0000 front 2023-09-23T09:50:03.145799+0000 (oldest deadline 2023-09-23T09:50:26.045803+0000) 2023-09-23T09:51:07.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:06 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:06.896+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.348396+0000 front 2023-09-23T09:50:12.348362+0000 (oldest deadline 2023-09-23T09:50:34.648330+0000) 2023-09-23T09:51:07.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:06 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:06.896+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:22.150884+0000 front 2023-09-23T09:50:22.150846+0000 (oldest deadline 2023-09-23T09:50:45.650923+0000) 2023-09-23T09:51:07.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:06 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:06.896+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:30.852678+0000 front 2023-09-23T09:50:30.852711+0000 (oldest deadline 2023-09-23T09:50:56.752802+0000) 2023-09-23T09:51:07.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:06 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:06.896+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.161:6812 osd.5 since back 2023-09-23T09:50:36.753862+0000 front 2023-09-23T09:50:36.753669+0000 (oldest deadline 2023-09-23T09:51:02.653297+0000) 2023-09-23T09:51:07.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:51:07 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:51:07.348+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.275199+0000 front 2023-09-23T09:49:55.275227+0000 (oldest deadline 2023-09-23T09:50:17.575468+0000) 2023-09-23T09:51:07.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:51:07 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:51:07.348+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.977386+0000 front 2023-09-23T09:50:03.977111+0000 (oldest deadline 2023-09-23T09:50:29.877359+0000) 2023-09-23T09:51:07.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:51:07 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:51:07.348+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.778806+0000 front 2023-09-23T09:50:12.778743+0000 (oldest deadline 2023-09-23T09:50:39.779512+0000) 2023-09-23T09:51:07.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:51:07 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:51:07.348+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:19.780107+0000 front 2023-09-23T09:50:19.780156+0000 (oldest deadline 2023-09-23T09:50:43.880111+0000) 2023-09-23T09:51:07.620 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:51:07 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:51:07.348+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:26.181109+0000 front 2023-09-23T09:50:26.181054+0000 (oldest deadline 2023-09-23T09:50:53.082476+0000) 2023-09-23T09:51:07.620 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:51:07 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:51:07.348+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.161:6812 osd.5 since back 2023-09-23T09:50:35.383468+0000 front 2023-09-23T09:50:35.383509+0000 (oldest deadline 2023-09-23T09:51:05.384181+0000) 2023-09-23T09:51:08.132 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:07 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:07.767+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.535551+0000 front 2023-09-23T09:49:54.535491+0000 (oldest deadline 2023-09-23T09:50:18.535947+0000) 2023-09-23T09:51:08.132 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:07 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:07.767+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:04.338156+0000 front 2023-09-23T09:50:04.338141+0000 (oldest deadline 2023-09-23T09:50:27.238084+0000) 2023-09-23T09:51:08.133 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:07 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:07.767+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:13.139271+0000 front 2023-09-23T09:50:13.139458+0000 (oldest deadline 2023-09-23T09:50:36.639382+0000) 2023-09-23T09:51:08.133 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:07 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:07.767+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:29.844086+0000 front 2023-09-23T09:50:29.844150+0000 (oldest deadline 2023-09-23T09:50:54.543783+0000) 2023-09-23T09:51:08.133 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:07 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:07.767+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.161:6812 osd.5 since back 2023-09-23T09:50:39.745614+0000 front 2023-09-23T09:50:39.745504+0000 (oldest deadline 2023-09-23T09:51:03.746156+0000) 2023-09-23T09:51:08.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:07 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:07.945+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.643334+0000 front 2023-09-23T09:49:55.643391+0000 (oldest deadline 2023-09-23T09:50:18.543466+0000) 2023-09-23T09:51:08.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:07 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:07.945+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.145721+0000 front 2023-09-23T09:50:03.145799+0000 (oldest deadline 2023-09-23T09:50:26.045803+0000) 2023-09-23T09:51:08.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:07 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:07.945+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.348396+0000 front 2023-09-23T09:50:12.348362+0000 (oldest deadline 2023-09-23T09:50:34.648330+0000) 2023-09-23T09:51:08.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:07 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:07.945+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:22.150884+0000 front 2023-09-23T09:50:22.150846+0000 (oldest deadline 2023-09-23T09:50:45.650923+0000) 2023-09-23T09:51:08.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:07 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:07.945+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:30.852678+0000 front 2023-09-23T09:50:30.852711+0000 (oldest deadline 2023-09-23T09:50:56.752802+0000) 2023-09-23T09:51:08.312 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:07 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:07.945+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.161:6812 osd.5 since back 2023-09-23T09:50:36.753862+0000 front 2023-09-23T09:50:36.753669+0000 (oldest deadline 2023-09-23T09:51:02.653297+0000) 2023-09-23T09:51:08.567 DEBUG:teuthology.orchestra.run.smithi161:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@osd.8.service' 2023-09-23T09:51:08.656 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-09-23T09:51:08.656 INFO:tasks.cephadm.osd.8:Stopped osd.8 2023-09-23T09:51:08.657 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2023-09-23T09:51:08.657 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@osd.9 2023-09-23T09:51:08.723 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:51:08 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:51:08.394+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.275199+0000 front 2023-09-23T09:49:55.275227+0000 (oldest deadline 2023-09-23T09:50:17.575468+0000) 2023-09-23T09:51:08.723 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:51:08 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:51:08.394+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.977386+0000 front 2023-09-23T09:50:03.977111+0000 (oldest deadline 2023-09-23T09:50:29.877359+0000) 2023-09-23T09:51:08.723 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:51:08 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:51:08.394+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.778806+0000 front 2023-09-23T09:50:12.778743+0000 (oldest deadline 2023-09-23T09:50:39.779512+0000) 2023-09-23T09:51:08.723 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:51:08 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:51:08.394+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:19.780107+0000 front 2023-09-23T09:50:19.780156+0000 (oldest deadline 2023-09-23T09:50:43.880111+0000) 2023-09-23T09:51:08.723 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:51:08 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:51:08.394+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:26.181109+0000 front 2023-09-23T09:50:26.181054+0000 (oldest deadline 2023-09-23T09:50:53.082476+0000) 2023-09-23T09:51:08.723 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:51:08 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:51:08.394+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.161:6812 osd.5 since back 2023-09-23T09:50:35.383468+0000 front 2023-09-23T09:50:35.383509+0000 (oldest deadline 2023-09-23T09:51:05.384181+0000) 2023-09-23T09:51:08.896 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:08 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:08.747+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.535551+0000 front 2023-09-23T09:49:54.535491+0000 (oldest deadline 2023-09-23T09:50:18.535947+0000) 2023-09-23T09:51:08.896 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:08 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:08.747+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:04.338156+0000 front 2023-09-23T09:50:04.338141+0000 (oldest deadline 2023-09-23T09:50:27.238084+0000) 2023-09-23T09:51:08.896 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:08 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:08.747+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:13.139271+0000 front 2023-09-23T09:50:13.139458+0000 (oldest deadline 2023-09-23T09:50:36.639382+0000) 2023-09-23T09:51:08.897 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:08 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:08.747+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:29.844086+0000 front 2023-09-23T09:50:29.844150+0000 (oldest deadline 2023-09-23T09:50:54.543783+0000) 2023-09-23T09:51:08.897 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:08 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:08.747+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.161:6812 osd.5 since back 2023-09-23T09:50:39.745614+0000 front 2023-09-23T09:50:39.745504+0000 (oldest deadline 2023-09-23T09:51:03.746156+0000) 2023-09-23T09:51:09.119 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:51:08 smithi082 systemd[1]: Stopping Ceph osd.9 for 8926e286-59ed-11ee-8db4-212e2dc638e7... 2023-09-23T09:51:09.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:08 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:08.956+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.643334+0000 front 2023-09-23T09:49:55.643391+0000 (oldest deadline 2023-09-23T09:50:18.543466+0000) 2023-09-23T09:51:09.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:08 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:08.956+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.145721+0000 front 2023-09-23T09:50:03.145799+0000 (oldest deadline 2023-09-23T09:50:26.045803+0000) 2023-09-23T09:51:09.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:08 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:08.956+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.348396+0000 front 2023-09-23T09:50:12.348362+0000 (oldest deadline 2023-09-23T09:50:34.648330+0000) 2023-09-23T09:51:09.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:08 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:08.956+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:22.150884+0000 front 2023-09-23T09:50:22.150846+0000 (oldest deadline 2023-09-23T09:50:45.650923+0000) 2023-09-23T09:51:09.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:08 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:08.956+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:30.852678+0000 front 2023-09-23T09:50:30.852711+0000 (oldest deadline 2023-09-23T09:50:56.752802+0000) 2023-09-23T09:51:09.312 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:08 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:08.956+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.161:6812 osd.5 since back 2023-09-23T09:50:36.753862+0000 front 2023-09-23T09:50:36.753669+0000 (oldest deadline 2023-09-23T09:51:02.653297+0000) 2023-09-23T09:51:09.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:51:09 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:51:09.173+0000 7f5aceec6700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-09-23T09:51:09.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:51:09 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:51:09.173+0000 7f5aceec6700 -1 osd.9 181 *** Got signal Terminated *** 2023-09-23T09:51:09.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:51:09 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:51:09.173+0000 7f5aceec6700 -1 osd.9 181 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-09-23T09:51:09.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:51:09 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:51:09.381+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.275199+0000 front 2023-09-23T09:49:55.275227+0000 (oldest deadline 2023-09-23T09:50:17.575468+0000) 2023-09-23T09:51:09.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:51:09 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:51:09.381+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.977386+0000 front 2023-09-23T09:50:03.977111+0000 (oldest deadline 2023-09-23T09:50:29.877359+0000) 2023-09-23T09:51:09.620 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:51:09 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:51:09.381+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.778806+0000 front 2023-09-23T09:50:12.778743+0000 (oldest deadline 2023-09-23T09:50:39.779512+0000) 2023-09-23T09:51:09.620 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:51:09 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:51:09.381+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:19.780107+0000 front 2023-09-23T09:50:19.780156+0000 (oldest deadline 2023-09-23T09:50:43.880111+0000) 2023-09-23T09:51:09.620 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:51:09 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:51:09.381+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:26.181109+0000 front 2023-09-23T09:50:26.181054+0000 (oldest deadline 2023-09-23T09:50:53.082476+0000) 2023-09-23T09:51:09.620 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:51:09 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:51:09.381+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.161:6812 osd.5 since back 2023-09-23T09:50:35.383468+0000 front 2023-09-23T09:50:35.383509+0000 (oldest deadline 2023-09-23T09:51:05.384181+0000) 2023-09-23T09:51:10.146 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:09 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:09.772+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.535551+0000 front 2023-09-23T09:49:54.535491+0000 (oldest deadline 2023-09-23T09:50:18.535947+0000) 2023-09-23T09:51:10.146 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:09 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:09.772+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:04.338156+0000 front 2023-09-23T09:50:04.338141+0000 (oldest deadline 2023-09-23T09:50:27.238084+0000) 2023-09-23T09:51:10.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:09 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:09.772+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:13.139271+0000 front 2023-09-23T09:50:13.139458+0000 (oldest deadline 2023-09-23T09:50:36.639382+0000) 2023-09-23T09:51:10.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:09 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:09.772+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:29.844086+0000 front 2023-09-23T09:50:29.844150+0000 (oldest deadline 2023-09-23T09:50:54.543783+0000) 2023-09-23T09:51:10.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:09 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:09.772+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.161:6812 osd.5 since back 2023-09-23T09:50:39.745614+0000 front 2023-09-23T09:50:39.745504+0000 (oldest deadline 2023-09-23T09:51:03.746156+0000) 2023-09-23T09:51:10.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:10 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:10.000+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.643334+0000 front 2023-09-23T09:49:55.643391+0000 (oldest deadline 2023-09-23T09:50:18.543466+0000) 2023-09-23T09:51:10.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:10 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:10.000+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.145721+0000 front 2023-09-23T09:50:03.145799+0000 (oldest deadline 2023-09-23T09:50:26.045803+0000) 2023-09-23T09:51:10.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:10 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:10.000+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.348396+0000 front 2023-09-23T09:50:12.348362+0000 (oldest deadline 2023-09-23T09:50:34.648330+0000) 2023-09-23T09:51:10.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:10 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:10.000+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:22.150884+0000 front 2023-09-23T09:50:22.150846+0000 (oldest deadline 2023-09-23T09:50:45.650923+0000) 2023-09-23T09:51:10.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:10 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:10.000+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:30.852678+0000 front 2023-09-23T09:50:30.852711+0000 (oldest deadline 2023-09-23T09:50:56.752802+0000) 2023-09-23T09:51:10.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:10 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:10.000+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.161:6812 osd.5 since back 2023-09-23T09:50:36.753862+0000 front 2023-09-23T09:50:36.753669+0000 (oldest deadline 2023-09-23T09:51:02.653297+0000) 2023-09-23T09:51:10.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:51:10 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:51:10.349+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.275199+0000 front 2023-09-23T09:49:55.275227+0000 (oldest deadline 2023-09-23T09:50:17.575468+0000) 2023-09-23T09:51:10.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:51:10 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:51:10.349+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.977386+0000 front 2023-09-23T09:50:03.977111+0000 (oldest deadline 2023-09-23T09:50:29.877359+0000) 2023-09-23T09:51:10.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:51:10 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:51:10.349+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.778806+0000 front 2023-09-23T09:50:12.778743+0000 (oldest deadline 2023-09-23T09:50:39.779512+0000) 2023-09-23T09:51:10.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:51:10 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:51:10.349+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:19.780107+0000 front 2023-09-23T09:50:19.780156+0000 (oldest deadline 2023-09-23T09:50:43.880111+0000) 2023-09-23T09:51:10.620 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:51:10 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:51:10.349+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:26.181109+0000 front 2023-09-23T09:50:26.181054+0000 (oldest deadline 2023-09-23T09:50:53.082476+0000) 2023-09-23T09:51:10.620 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:51:10 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:51:10.349+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.161:6812 osd.5 since back 2023-09-23T09:50:35.383468+0000 front 2023-09-23T09:50:35.383509+0000 (oldest deadline 2023-09-23T09:51:05.384181+0000) 2023-09-23T09:51:10.620 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:51:10 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:51:10.349+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2023-09-23T09:50:45.384711+0000 front 2023-09-23T09:50:45.384747+0000 (oldest deadline 2023-09-23T09:51:10.084747+0000) 2023-09-23T09:51:11.146 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:10 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:10.762+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.535551+0000 front 2023-09-23T09:49:54.535491+0000 (oldest deadline 2023-09-23T09:50:18.535947+0000) 2023-09-23T09:51:11.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:10 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:10.762+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:04.338156+0000 front 2023-09-23T09:50:04.338141+0000 (oldest deadline 2023-09-23T09:50:27.238084+0000) 2023-09-23T09:51:11.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:10 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:10.762+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:13.139271+0000 front 2023-09-23T09:50:13.139458+0000 (oldest deadline 2023-09-23T09:50:36.639382+0000) 2023-09-23T09:51:11.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:10 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:10.762+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:29.844086+0000 front 2023-09-23T09:50:29.844150+0000 (oldest deadline 2023-09-23T09:50:54.543783+0000) 2023-09-23T09:51:11.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:10 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:10.762+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.161:6812 osd.5 since back 2023-09-23T09:50:39.745614+0000 front 2023-09-23T09:50:39.745504+0000 (oldest deadline 2023-09-23T09:51:03.746156+0000) 2023-09-23T09:51:11.310 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:11 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:11.003+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.643334+0000 front 2023-09-23T09:49:55.643391+0000 (oldest deadline 2023-09-23T09:50:18.543466+0000) 2023-09-23T09:51:11.310 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:11 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:11.003+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.145721+0000 front 2023-09-23T09:50:03.145799+0000 (oldest deadline 2023-09-23T09:50:26.045803+0000) 2023-09-23T09:51:11.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:11 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:11.003+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.348396+0000 front 2023-09-23T09:50:12.348362+0000 (oldest deadline 2023-09-23T09:50:34.648330+0000) 2023-09-23T09:51:11.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:11 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:11.003+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:22.150884+0000 front 2023-09-23T09:50:22.150846+0000 (oldest deadline 2023-09-23T09:50:45.650923+0000) 2023-09-23T09:51:11.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:11 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:11.003+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:30.852678+0000 front 2023-09-23T09:50:30.852711+0000 (oldest deadline 2023-09-23T09:50:56.752802+0000) 2023-09-23T09:51:11.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:11 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:11.003+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.161:6812 osd.5 since back 2023-09-23T09:50:36.753862+0000 front 2023-09-23T09:50:36.753669+0000 (oldest deadline 2023-09-23T09:51:02.653297+0000) 2023-09-23T09:51:11.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:11 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:11.003+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2023-09-23T09:50:45.455267+0000 front 2023-09-23T09:50:45.455282+0000 (oldest deadline 2023-09-23T09:51:10.755175+0000) 2023-09-23T09:51:11.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:51:11 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:51:11.307+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.275199+0000 front 2023-09-23T09:49:55.275227+0000 (oldest deadline 2023-09-23T09:50:17.575468+0000) 2023-09-23T09:51:11.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:51:11 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:51:11.307+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.977386+0000 front 2023-09-23T09:50:03.977111+0000 (oldest deadline 2023-09-23T09:50:29.877359+0000) 2023-09-23T09:51:11.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:51:11 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:51:11.307+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.778806+0000 front 2023-09-23T09:50:12.778743+0000 (oldest deadline 2023-09-23T09:50:39.779512+0000) 2023-09-23T09:51:11.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:51:11 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:51:11.307+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:19.780107+0000 front 2023-09-23T09:50:19.780156+0000 (oldest deadline 2023-09-23T09:50:43.880111+0000) 2023-09-23T09:51:11.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:51:11 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:51:11.307+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:26.181109+0000 front 2023-09-23T09:50:26.181054+0000 (oldest deadline 2023-09-23T09:50:53.082476+0000) 2023-09-23T09:51:11.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:51:11 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:51:11.307+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.161:6812 osd.5 since back 2023-09-23T09:50:35.383468+0000 front 2023-09-23T09:50:35.383509+0000 (oldest deadline 2023-09-23T09:51:05.384181+0000) 2023-09-23T09:51:11.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:51:11 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:51:11.307+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2023-09-23T09:50:45.384711+0000 front 2023-09-23T09:50:45.384747+0000 (oldest deadline 2023-09-23T09:51:10.084747+0000) 2023-09-23T09:51:12.146 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:11 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:11.798+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.535551+0000 front 2023-09-23T09:49:54.535491+0000 (oldest deadline 2023-09-23T09:50:18.535947+0000) 2023-09-23T09:51:12.146 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:11 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:11.798+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:04.338156+0000 front 2023-09-23T09:50:04.338141+0000 (oldest deadline 2023-09-23T09:50:27.238084+0000) 2023-09-23T09:51:12.146 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:11 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:11.798+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:13.139271+0000 front 2023-09-23T09:50:13.139458+0000 (oldest deadline 2023-09-23T09:50:36.639382+0000) 2023-09-23T09:51:12.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:11 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:11.798+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:29.844086+0000 front 2023-09-23T09:50:29.844150+0000 (oldest deadline 2023-09-23T09:50:54.543783+0000) 2023-09-23T09:51:12.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:11 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:11.798+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.161:6812 osd.5 since back 2023-09-23T09:50:39.745614+0000 front 2023-09-23T09:50:39.745504+0000 (oldest deadline 2023-09-23T09:51:03.746156+0000) 2023-09-23T09:51:12.310 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:12 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:12.046+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.643334+0000 front 2023-09-23T09:49:55.643391+0000 (oldest deadline 2023-09-23T09:50:18.543466+0000) 2023-09-23T09:51:12.310 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:12 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:12.046+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.145721+0000 front 2023-09-23T09:50:03.145799+0000 (oldest deadline 2023-09-23T09:50:26.045803+0000) 2023-09-23T09:51:12.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:12 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:12.046+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.348396+0000 front 2023-09-23T09:50:12.348362+0000 (oldest deadline 2023-09-23T09:50:34.648330+0000) 2023-09-23T09:51:12.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:12 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:12.046+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:22.150884+0000 front 2023-09-23T09:50:22.150846+0000 (oldest deadline 2023-09-23T09:50:45.650923+0000) 2023-09-23T09:51:12.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:12 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:12.046+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:30.852678+0000 front 2023-09-23T09:50:30.852711+0000 (oldest deadline 2023-09-23T09:50:56.752802+0000) 2023-09-23T09:51:12.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:12 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:12.046+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.161:6812 osd.5 since back 2023-09-23T09:50:36.753862+0000 front 2023-09-23T09:50:36.753669+0000 (oldest deadline 2023-09-23T09:51:02.653297+0000) 2023-09-23T09:51:12.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:12 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:12.046+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2023-09-23T09:50:45.455267+0000 front 2023-09-23T09:50:45.455282+0000 (oldest deadline 2023-09-23T09:51:10.755175+0000) 2023-09-23T09:51:12.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:51:12 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:51:12.275+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.275199+0000 front 2023-09-23T09:49:55.275227+0000 (oldest deadline 2023-09-23T09:50:17.575468+0000) 2023-09-23T09:51:12.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:51:12 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:51:12.275+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.977386+0000 front 2023-09-23T09:50:03.977111+0000 (oldest deadline 2023-09-23T09:50:29.877359+0000) 2023-09-23T09:51:12.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:51:12 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:51:12.275+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.778806+0000 front 2023-09-23T09:50:12.778743+0000 (oldest deadline 2023-09-23T09:50:39.779512+0000) 2023-09-23T09:51:12.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:51:12 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:51:12.275+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:19.780107+0000 front 2023-09-23T09:50:19.780156+0000 (oldest deadline 2023-09-23T09:50:43.880111+0000) 2023-09-23T09:51:12.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:51:12 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:51:12.275+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:26.181109+0000 front 2023-09-23T09:50:26.181054+0000 (oldest deadline 2023-09-23T09:50:53.082476+0000) 2023-09-23T09:51:12.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:51:12 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:51:12.275+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.161:6812 osd.5 since back 2023-09-23T09:50:35.383468+0000 front 2023-09-23T09:50:35.383509+0000 (oldest deadline 2023-09-23T09:51:05.384181+0000) 2023-09-23T09:51:12.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:51:12 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:51:12.275+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2023-09-23T09:50:45.384711+0000 front 2023-09-23T09:50:45.384747+0000 (oldest deadline 2023-09-23T09:51:10.084747+0000) 2023-09-23T09:51:13.146 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:12 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:12.775+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.535551+0000 front 2023-09-23T09:49:54.535491+0000 (oldest deadline 2023-09-23T09:50:18.535947+0000) 2023-09-23T09:51:13.146 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:12 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:12.775+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:04.338156+0000 front 2023-09-23T09:50:04.338141+0000 (oldest deadline 2023-09-23T09:50:27.238084+0000) 2023-09-23T09:51:13.146 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:12 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:12.775+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:13.139271+0000 front 2023-09-23T09:50:13.139458+0000 (oldest deadline 2023-09-23T09:50:36.639382+0000) 2023-09-23T09:51:13.146 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:12 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:12.775+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:29.844086+0000 front 2023-09-23T09:50:29.844150+0000 (oldest deadline 2023-09-23T09:50:54.543783+0000) 2023-09-23T09:51:13.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:12 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:12.775+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.161:6812 osd.5 since back 2023-09-23T09:50:39.745614+0000 front 2023-09-23T09:50:39.745504+0000 (oldest deadline 2023-09-23T09:51:03.746156+0000) 2023-09-23T09:51:13.310 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:13 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:13.013+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.643334+0000 front 2023-09-23T09:49:55.643391+0000 (oldest deadline 2023-09-23T09:50:18.543466+0000) 2023-09-23T09:51:13.310 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:13 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:13.013+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.145721+0000 front 2023-09-23T09:50:03.145799+0000 (oldest deadline 2023-09-23T09:50:26.045803+0000) 2023-09-23T09:51:13.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:13 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:13.013+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.348396+0000 front 2023-09-23T09:50:12.348362+0000 (oldest deadline 2023-09-23T09:50:34.648330+0000) 2023-09-23T09:51:13.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:13 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:13.013+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:22.150884+0000 front 2023-09-23T09:50:22.150846+0000 (oldest deadline 2023-09-23T09:50:45.650923+0000) 2023-09-23T09:51:13.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:13 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:13.013+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:30.852678+0000 front 2023-09-23T09:50:30.852711+0000 (oldest deadline 2023-09-23T09:50:56.752802+0000) 2023-09-23T09:51:13.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:13 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:13.013+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.161:6812 osd.5 since back 2023-09-23T09:50:36.753862+0000 front 2023-09-23T09:50:36.753669+0000 (oldest deadline 2023-09-23T09:51:02.653297+0000) 2023-09-23T09:51:13.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:13 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:13.013+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2023-09-23T09:50:45.455267+0000 front 2023-09-23T09:50:45.455282+0000 (oldest deadline 2023-09-23T09:51:10.755175+0000) 2023-09-23T09:51:13.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:51:13 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:51:13.288+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.275199+0000 front 2023-09-23T09:49:55.275227+0000 (oldest deadline 2023-09-23T09:50:17.575468+0000) 2023-09-23T09:51:13.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:51:13 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:51:13.288+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.977386+0000 front 2023-09-23T09:50:03.977111+0000 (oldest deadline 2023-09-23T09:50:29.877359+0000) 2023-09-23T09:51:13.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:51:13 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:51:13.288+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.778806+0000 front 2023-09-23T09:50:12.778743+0000 (oldest deadline 2023-09-23T09:50:39.779512+0000) 2023-09-23T09:51:13.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:51:13 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:51:13.288+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:19.780107+0000 front 2023-09-23T09:50:19.780156+0000 (oldest deadline 2023-09-23T09:50:43.880111+0000) 2023-09-23T09:51:13.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:51:13 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:51:13.288+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:26.181109+0000 front 2023-09-23T09:50:26.181054+0000 (oldest deadline 2023-09-23T09:50:53.082476+0000) 2023-09-23T09:51:13.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:51:13 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:51:13.288+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.161:6812 osd.5 since back 2023-09-23T09:50:35.383468+0000 front 2023-09-23T09:50:35.383509+0000 (oldest deadline 2023-09-23T09:51:05.384181+0000) 2023-09-23T09:51:13.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:51:13 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9[127470]: 2023-09-23T09:51:13.288+0000 7f5ac84b6700 -1 osd.9 181 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2023-09-23T09:50:45.384711+0000 front 2023-09-23T09:50:45.384747+0000 (oldest deadline 2023-09-23T09:51:10.084747+0000) 2023-09-23T09:51:14.146 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:13 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:13.806+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.535551+0000 front 2023-09-23T09:49:54.535491+0000 (oldest deadline 2023-09-23T09:50:18.535947+0000) 2023-09-23T09:51:14.146 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:13 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:13.806+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:04.338156+0000 front 2023-09-23T09:50:04.338141+0000 (oldest deadline 2023-09-23T09:50:27.238084+0000) 2023-09-23T09:51:14.146 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:13 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:13.806+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:13.139271+0000 front 2023-09-23T09:50:13.139458+0000 (oldest deadline 2023-09-23T09:50:36.639382+0000) 2023-09-23T09:51:14.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:13 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:13.806+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:29.844086+0000 front 2023-09-23T09:50:29.844150+0000 (oldest deadline 2023-09-23T09:50:54.543783+0000) 2023-09-23T09:51:14.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:13 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:13.806+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.161:6812 osd.5 since back 2023-09-23T09:50:39.745614+0000 front 2023-09-23T09:50:39.745504+0000 (oldest deadline 2023-09-23T09:51:03.746156+0000) 2023-09-23T09:51:14.310 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:14 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:14.043+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.643334+0000 front 2023-09-23T09:49:55.643391+0000 (oldest deadline 2023-09-23T09:50:18.543466+0000) 2023-09-23T09:51:14.310 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:14 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:14.043+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.145721+0000 front 2023-09-23T09:50:03.145799+0000 (oldest deadline 2023-09-23T09:50:26.045803+0000) 2023-09-23T09:51:14.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:14 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:14.043+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.348396+0000 front 2023-09-23T09:50:12.348362+0000 (oldest deadline 2023-09-23T09:50:34.648330+0000) 2023-09-23T09:51:14.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:14 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:14.043+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:22.150884+0000 front 2023-09-23T09:50:22.150846+0000 (oldest deadline 2023-09-23T09:50:45.650923+0000) 2023-09-23T09:51:14.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:14 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:14.043+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:30.852678+0000 front 2023-09-23T09:50:30.852711+0000 (oldest deadline 2023-09-23T09:50:56.752802+0000) 2023-09-23T09:51:14.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:14 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:14.043+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.161:6812 osd.5 since back 2023-09-23T09:50:36.753862+0000 front 2023-09-23T09:50:36.753669+0000 (oldest deadline 2023-09-23T09:51:02.653297+0000) 2023-09-23T09:51:14.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:14 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:14.043+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2023-09-23T09:50:45.455267+0000 front 2023-09-23T09:50:45.455282+0000 (oldest deadline 2023-09-23T09:51:10.755175+0000) 2023-09-23T09:51:15.146 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:14 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:14.837+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.535551+0000 front 2023-09-23T09:49:54.535491+0000 (oldest deadline 2023-09-23T09:50:18.535947+0000) 2023-09-23T09:51:15.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:14 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:14.837+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:04.338156+0000 front 2023-09-23T09:50:04.338141+0000 (oldest deadline 2023-09-23T09:50:27.238084+0000) 2023-09-23T09:51:15.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:14 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:14.837+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:13.139271+0000 front 2023-09-23T09:50:13.139458+0000 (oldest deadline 2023-09-23T09:50:36.639382+0000) 2023-09-23T09:51:15.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:14 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:14.837+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:29.844086+0000 front 2023-09-23T09:50:29.844150+0000 (oldest deadline 2023-09-23T09:50:54.543783+0000) 2023-09-23T09:51:15.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:14 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:14.837+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.161:6812 osd.5 since back 2023-09-23T09:50:39.745614+0000 front 2023-09-23T09:50:39.745504+0000 (oldest deadline 2023-09-23T09:51:03.746156+0000) 2023-09-23T09:51:15.310 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:14 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:14.998+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.643334+0000 front 2023-09-23T09:49:55.643391+0000 (oldest deadline 2023-09-23T09:50:18.543466+0000) 2023-09-23T09:51:15.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:14 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:14.998+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.145721+0000 front 2023-09-23T09:50:03.145799+0000 (oldest deadline 2023-09-23T09:50:26.045803+0000) 2023-09-23T09:51:15.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:14 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:14.998+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.348396+0000 front 2023-09-23T09:50:12.348362+0000 (oldest deadline 2023-09-23T09:50:34.648330+0000) 2023-09-23T09:51:15.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:14 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:14.998+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:22.150884+0000 front 2023-09-23T09:50:22.150846+0000 (oldest deadline 2023-09-23T09:50:45.650923+0000) 2023-09-23T09:51:15.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:14 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:14.998+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:30.852678+0000 front 2023-09-23T09:50:30.852711+0000 (oldest deadline 2023-09-23T09:50:56.752802+0000) 2023-09-23T09:51:15.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:14 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:14.998+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.161:6812 osd.5 since back 2023-09-23T09:50:36.753862+0000 front 2023-09-23T09:50:36.753669+0000 (oldest deadline 2023-09-23T09:51:02.653297+0000) 2023-09-23T09:51:15.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:14 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:14.998+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2023-09-23T09:50:45.455267+0000 front 2023-09-23T09:50:45.455282+0000 (oldest deadline 2023-09-23T09:51:10.755175+0000) 2023-09-23T09:51:15.619 INFO:journalctl@ceph.osd.9.smithi082.stdout:Sep 23 09:51:15 smithi082 bash[188877]: ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-9 2023-09-23T09:51:16.146 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:15 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:15.851+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.535551+0000 front 2023-09-23T09:49:54.535491+0000 (oldest deadline 2023-09-23T09:50:18.535947+0000) 2023-09-23T09:51:16.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:15 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:15.851+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:04.338156+0000 front 2023-09-23T09:50:04.338141+0000 (oldest deadline 2023-09-23T09:50:27.238084+0000) 2023-09-23T09:51:16.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:15 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:15.851+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:13.139271+0000 front 2023-09-23T09:50:13.139458+0000 (oldest deadline 2023-09-23T09:50:36.639382+0000) 2023-09-23T09:51:16.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:15 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:15.851+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:29.844086+0000 front 2023-09-23T09:50:29.844150+0000 (oldest deadline 2023-09-23T09:50:54.543783+0000) 2023-09-23T09:51:16.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:15 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:15.851+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.161:6812 osd.5 since back 2023-09-23T09:50:39.745614+0000 front 2023-09-23T09:50:39.745504+0000 (oldest deadline 2023-09-23T09:51:03.746156+0000) 2023-09-23T09:51:16.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:15 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:15.851+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2023-09-23T09:50:43.746730+0000 front 2023-09-23T09:50:43.746677+0000 (oldest deadline 2023-09-23T09:51:14.947218+0000) 2023-09-23T09:51:16.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:16 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:16.009+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.643334+0000 front 2023-09-23T09:49:55.643391+0000 (oldest deadline 2023-09-23T09:50:18.543466+0000) 2023-09-23T09:51:16.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:16 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:16.009+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.145721+0000 front 2023-09-23T09:50:03.145799+0000 (oldest deadline 2023-09-23T09:50:26.045803+0000) 2023-09-23T09:51:16.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:16 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:16.009+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.348396+0000 front 2023-09-23T09:50:12.348362+0000 (oldest deadline 2023-09-23T09:50:34.648330+0000) 2023-09-23T09:51:16.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:16 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:16.009+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:22.150884+0000 front 2023-09-23T09:50:22.150846+0000 (oldest deadline 2023-09-23T09:50:45.650923+0000) 2023-09-23T09:51:16.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:16 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:16.009+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:30.852678+0000 front 2023-09-23T09:50:30.852711+0000 (oldest deadline 2023-09-23T09:50:56.752802+0000) 2023-09-23T09:51:16.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:16 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:16.009+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.161:6812 osd.5 since back 2023-09-23T09:50:36.753862+0000 front 2023-09-23T09:50:36.753669+0000 (oldest deadline 2023-09-23T09:51:02.653297+0000) 2023-09-23T09:51:16.312 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:16 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:16.009+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2023-09-23T09:50:45.455267+0000 front 2023-09-23T09:50:45.455282+0000 (oldest deadline 2023-09-23T09:51:10.755175+0000) 2023-09-23T09:51:17.146 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:16 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:16.881+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.535551+0000 front 2023-09-23T09:49:54.535491+0000 (oldest deadline 2023-09-23T09:50:18.535947+0000) 2023-09-23T09:51:17.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:16 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:16.881+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:04.338156+0000 front 2023-09-23T09:50:04.338141+0000 (oldest deadline 2023-09-23T09:50:27.238084+0000) 2023-09-23T09:51:17.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:16 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:16.881+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:13.139271+0000 front 2023-09-23T09:50:13.139458+0000 (oldest deadline 2023-09-23T09:50:36.639382+0000) 2023-09-23T09:51:17.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:16 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:16.881+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:29.844086+0000 front 2023-09-23T09:50:29.844150+0000 (oldest deadline 2023-09-23T09:50:54.543783+0000) 2023-09-23T09:51:17.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:16 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:16.881+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.161:6812 osd.5 since back 2023-09-23T09:50:39.745614+0000 front 2023-09-23T09:50:39.745504+0000 (oldest deadline 2023-09-23T09:51:03.746156+0000) 2023-09-23T09:51:17.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:16 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:16.881+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2023-09-23T09:50:43.746730+0000 front 2023-09-23T09:50:43.746677+0000 (oldest deadline 2023-09-23T09:51:14.947218+0000) 2023-09-23T09:51:17.181 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@osd.9.service' 2023-09-23T09:51:17.269 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-09-23T09:51:17.270 INFO:tasks.cephadm.osd.9:Stopped osd.9 2023-09-23T09:51:17.270 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2023-09-23T09:51:17.270 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@osd.10 2023-09-23T09:51:17.310 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:16 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:16.997+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.643334+0000 front 2023-09-23T09:49:55.643391+0000 (oldest deadline 2023-09-23T09:50:18.543466+0000) 2023-09-23T09:51:17.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:16 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:16.997+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.145721+0000 front 2023-09-23T09:50:03.145799+0000 (oldest deadline 2023-09-23T09:50:26.045803+0000) 2023-09-23T09:51:17.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:16 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:16.997+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.348396+0000 front 2023-09-23T09:50:12.348362+0000 (oldest deadline 2023-09-23T09:50:34.648330+0000) 2023-09-23T09:51:17.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:16 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:16.997+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:22.150884+0000 front 2023-09-23T09:50:22.150846+0000 (oldest deadline 2023-09-23T09:50:45.650923+0000) 2023-09-23T09:51:17.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:16 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:16.997+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:30.852678+0000 front 2023-09-23T09:50:30.852711+0000 (oldest deadline 2023-09-23T09:50:56.752802+0000) 2023-09-23T09:51:17.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:16 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:16.997+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.161:6812 osd.5 since back 2023-09-23T09:50:36.753862+0000 front 2023-09-23T09:50:36.753669+0000 (oldest deadline 2023-09-23T09:51:02.653297+0000) 2023-09-23T09:51:17.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:16 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:16.997+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2023-09-23T09:50:45.455267+0000 front 2023-09-23T09:50:45.455282+0000 (oldest deadline 2023-09-23T09:51:10.755175+0000) 2023-09-23T09:51:17.784 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:17 smithi135 systemd[1]: Stopping Ceph osd.10 for 8926e286-59ed-11ee-8db4-212e2dc638e7... 2023-09-23T09:51:18.060 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:17 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:17.783+0000 7fa14c568700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-09-23T09:51:18.061 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:17 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:17.783+0000 7fa14c568700 -1 osd.10 181 *** Got signal Terminated *** 2023-09-23T09:51:18.061 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:17 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:17.783+0000 7fa14c568700 -1 osd.10 181 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-09-23T09:51:18.061 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:18 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:18.015+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.643334+0000 front 2023-09-23T09:49:55.643391+0000 (oldest deadline 2023-09-23T09:50:18.543466+0000) 2023-09-23T09:51:18.061 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:18 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:18.015+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.145721+0000 front 2023-09-23T09:50:03.145799+0000 (oldest deadline 2023-09-23T09:50:26.045803+0000) 2023-09-23T09:51:18.061 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:18 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:18.015+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.348396+0000 front 2023-09-23T09:50:12.348362+0000 (oldest deadline 2023-09-23T09:50:34.648330+0000) 2023-09-23T09:51:18.061 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:18 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:18.015+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:22.150884+0000 front 2023-09-23T09:50:22.150846+0000 (oldest deadline 2023-09-23T09:50:45.650923+0000) 2023-09-23T09:51:18.061 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:18 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:18.015+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:30.852678+0000 front 2023-09-23T09:50:30.852711+0000 (oldest deadline 2023-09-23T09:50:56.752802+0000) 2023-09-23T09:51:18.061 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:18 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:18.015+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.161:6812 osd.5 since back 2023-09-23T09:50:36.753862+0000 front 2023-09-23T09:50:36.753669+0000 (oldest deadline 2023-09-23T09:51:02.653297+0000) 2023-09-23T09:51:18.062 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:18 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:18.015+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2023-09-23T09:50:45.455267+0000 front 2023-09-23T09:50:45.455282+0000 (oldest deadline 2023-09-23T09:51:10.755175+0000) 2023-09-23T09:51:18.146 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:17 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:17.841+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.535551+0000 front 2023-09-23T09:49:54.535491+0000 (oldest deadline 2023-09-23T09:50:18.535947+0000) 2023-09-23T09:51:18.146 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:17 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:17.841+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:04.338156+0000 front 2023-09-23T09:50:04.338141+0000 (oldest deadline 2023-09-23T09:50:27.238084+0000) 2023-09-23T09:51:18.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:17 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:17.841+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:13.139271+0000 front 2023-09-23T09:50:13.139458+0000 (oldest deadline 2023-09-23T09:50:36.639382+0000) 2023-09-23T09:51:18.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:17 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:17.841+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:29.844086+0000 front 2023-09-23T09:50:29.844150+0000 (oldest deadline 2023-09-23T09:50:54.543783+0000) 2023-09-23T09:51:18.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:17 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:17.841+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.161:6812 osd.5 since back 2023-09-23T09:50:39.745614+0000 front 2023-09-23T09:50:39.745504+0000 (oldest deadline 2023-09-23T09:51:03.746156+0000) 2023-09-23T09:51:18.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:17 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:17.841+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2023-09-23T09:50:43.746730+0000 front 2023-09-23T09:50:43.746677+0000 (oldest deadline 2023-09-23T09:51:14.947218+0000) 2023-09-23T09:51:19.146 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:18 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:18.880+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.535551+0000 front 2023-09-23T09:49:54.535491+0000 (oldest deadline 2023-09-23T09:50:18.535947+0000) 2023-09-23T09:51:19.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:18 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:18.880+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:04.338156+0000 front 2023-09-23T09:50:04.338141+0000 (oldest deadline 2023-09-23T09:50:27.238084+0000) 2023-09-23T09:51:19.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:18 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:18.880+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:13.139271+0000 front 2023-09-23T09:50:13.139458+0000 (oldest deadline 2023-09-23T09:50:36.639382+0000) 2023-09-23T09:51:19.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:18 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:18.880+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:29.844086+0000 front 2023-09-23T09:50:29.844150+0000 (oldest deadline 2023-09-23T09:50:54.543783+0000) 2023-09-23T09:51:19.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:18 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:18.880+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.161:6812 osd.5 since back 2023-09-23T09:50:39.745614+0000 front 2023-09-23T09:50:39.745504+0000 (oldest deadline 2023-09-23T09:51:03.746156+0000) 2023-09-23T09:51:19.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:18 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:18.880+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2023-09-23T09:50:43.746730+0000 front 2023-09-23T09:50:43.746677+0000 (oldest deadline 2023-09-23T09:51:14.947218+0000) 2023-09-23T09:51:19.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:19 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:19.035+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.643334+0000 front 2023-09-23T09:49:55.643391+0000 (oldest deadline 2023-09-23T09:50:18.543466+0000) 2023-09-23T09:51:19.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:19 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:19.035+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.145721+0000 front 2023-09-23T09:50:03.145799+0000 (oldest deadline 2023-09-23T09:50:26.045803+0000) 2023-09-23T09:51:19.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:19 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:19.035+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.348396+0000 front 2023-09-23T09:50:12.348362+0000 (oldest deadline 2023-09-23T09:50:34.648330+0000) 2023-09-23T09:51:19.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:19 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:19.035+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:22.150884+0000 front 2023-09-23T09:50:22.150846+0000 (oldest deadline 2023-09-23T09:50:45.650923+0000) 2023-09-23T09:51:19.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:19 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:19.035+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:30.852678+0000 front 2023-09-23T09:50:30.852711+0000 (oldest deadline 2023-09-23T09:50:56.752802+0000) 2023-09-23T09:51:19.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:19 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:19.035+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.161:6812 osd.5 since back 2023-09-23T09:50:36.753862+0000 front 2023-09-23T09:50:36.753669+0000 (oldest deadline 2023-09-23T09:51:02.653297+0000) 2023-09-23T09:51:19.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:19 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:19.035+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2023-09-23T09:50:45.455267+0000 front 2023-09-23T09:50:45.455282+0000 (oldest deadline 2023-09-23T09:51:10.755175+0000) 2023-09-23T09:51:20.146 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:19 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:19.852+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.535551+0000 front 2023-09-23T09:49:54.535491+0000 (oldest deadline 2023-09-23T09:50:18.535947+0000) 2023-09-23T09:51:20.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:19 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:19.852+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:04.338156+0000 front 2023-09-23T09:50:04.338141+0000 (oldest deadline 2023-09-23T09:50:27.238084+0000) 2023-09-23T09:51:20.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:19 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:19.852+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:13.139271+0000 front 2023-09-23T09:50:13.139458+0000 (oldest deadline 2023-09-23T09:50:36.639382+0000) 2023-09-23T09:51:20.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:19 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:19.852+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:29.844086+0000 front 2023-09-23T09:50:29.844150+0000 (oldest deadline 2023-09-23T09:50:54.543783+0000) 2023-09-23T09:51:20.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:19 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:19.852+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.161:6812 osd.5 since back 2023-09-23T09:50:39.745614+0000 front 2023-09-23T09:50:39.745504+0000 (oldest deadline 2023-09-23T09:51:03.746156+0000) 2023-09-23T09:51:20.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:19 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:19.852+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2023-09-23T09:50:43.746730+0000 front 2023-09-23T09:50:43.746677+0000 (oldest deadline 2023-09-23T09:51:14.947218+0000) 2023-09-23T09:51:20.310 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:20 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:20.048+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.643334+0000 front 2023-09-23T09:49:55.643391+0000 (oldest deadline 2023-09-23T09:50:18.543466+0000) 2023-09-23T09:51:20.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:20 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:20.048+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.145721+0000 front 2023-09-23T09:50:03.145799+0000 (oldest deadline 2023-09-23T09:50:26.045803+0000) 2023-09-23T09:51:20.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:20 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:20.048+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.348396+0000 front 2023-09-23T09:50:12.348362+0000 (oldest deadline 2023-09-23T09:50:34.648330+0000) 2023-09-23T09:51:20.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:20 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:20.048+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:22.150884+0000 front 2023-09-23T09:50:22.150846+0000 (oldest deadline 2023-09-23T09:50:45.650923+0000) 2023-09-23T09:51:20.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:20 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:20.048+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:30.852678+0000 front 2023-09-23T09:50:30.852711+0000 (oldest deadline 2023-09-23T09:50:56.752802+0000) 2023-09-23T09:51:20.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:20 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:20.048+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.161:6812 osd.5 since back 2023-09-23T09:50:36.753862+0000 front 2023-09-23T09:50:36.753669+0000 (oldest deadline 2023-09-23T09:51:02.653297+0000) 2023-09-23T09:51:20.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:20 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:20.048+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2023-09-23T09:50:45.455267+0000 front 2023-09-23T09:50:45.455282+0000 (oldest deadline 2023-09-23T09:51:10.755175+0000) 2023-09-23T09:51:21.146 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:20 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:20.832+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.535551+0000 front 2023-09-23T09:49:54.535491+0000 (oldest deadline 2023-09-23T09:50:18.535947+0000) 2023-09-23T09:51:21.146 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:20 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:20.832+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:04.338156+0000 front 2023-09-23T09:50:04.338141+0000 (oldest deadline 2023-09-23T09:50:27.238084+0000) 2023-09-23T09:51:21.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:20 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:20.832+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:13.139271+0000 front 2023-09-23T09:50:13.139458+0000 (oldest deadline 2023-09-23T09:50:36.639382+0000) 2023-09-23T09:51:21.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:20 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:20.832+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:29.844086+0000 front 2023-09-23T09:50:29.844150+0000 (oldest deadline 2023-09-23T09:50:54.543783+0000) 2023-09-23T09:51:21.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:20 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:20.832+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.161:6812 osd.5 since back 2023-09-23T09:50:39.745614+0000 front 2023-09-23T09:50:39.745504+0000 (oldest deadline 2023-09-23T09:51:03.746156+0000) 2023-09-23T09:51:21.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:20 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:20.832+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2023-09-23T09:50:43.746730+0000 front 2023-09-23T09:50:43.746677+0000 (oldest deadline 2023-09-23T09:51:14.947218+0000) 2023-09-23T09:51:21.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:20 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:20.832+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6820 osd.7 since back 2023-09-23T09:50:55.949175+0000 front 2023-09-23T09:50:55.949156+0000 (oldest deadline 2023-09-23T09:51:20.648981+0000) 2023-09-23T09:51:21.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:21 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:21.007+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.643334+0000 front 2023-09-23T09:49:55.643391+0000 (oldest deadline 2023-09-23T09:50:18.543466+0000) 2023-09-23T09:51:21.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:21 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:21.007+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.145721+0000 front 2023-09-23T09:50:03.145799+0000 (oldest deadline 2023-09-23T09:50:26.045803+0000) 2023-09-23T09:51:21.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:21 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:21.007+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.348396+0000 front 2023-09-23T09:50:12.348362+0000 (oldest deadline 2023-09-23T09:50:34.648330+0000) 2023-09-23T09:51:21.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:21 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:21.007+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:22.150884+0000 front 2023-09-23T09:50:22.150846+0000 (oldest deadline 2023-09-23T09:50:45.650923+0000) 2023-09-23T09:51:21.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:21 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:21.007+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:30.852678+0000 front 2023-09-23T09:50:30.852711+0000 (oldest deadline 2023-09-23T09:50:56.752802+0000) 2023-09-23T09:51:21.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:21 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:21.007+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.161:6812 osd.5 since back 2023-09-23T09:50:36.753862+0000 front 2023-09-23T09:50:36.753669+0000 (oldest deadline 2023-09-23T09:51:02.653297+0000) 2023-09-23T09:51:21.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:21 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:21.007+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2023-09-23T09:50:45.455267+0000 front 2023-09-23T09:50:45.455282+0000 (oldest deadline 2023-09-23T09:51:10.755175+0000) 2023-09-23T09:51:22.146 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:21 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:21.856+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.535551+0000 front 2023-09-23T09:49:54.535491+0000 (oldest deadline 2023-09-23T09:50:18.535947+0000) 2023-09-23T09:51:22.146 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:21 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:21.856+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:04.338156+0000 front 2023-09-23T09:50:04.338141+0000 (oldest deadline 2023-09-23T09:50:27.238084+0000) 2023-09-23T09:51:22.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:21 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:21.856+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:13.139271+0000 front 2023-09-23T09:50:13.139458+0000 (oldest deadline 2023-09-23T09:50:36.639382+0000) 2023-09-23T09:51:22.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:21 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:21.856+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:29.844086+0000 front 2023-09-23T09:50:29.844150+0000 (oldest deadline 2023-09-23T09:50:54.543783+0000) 2023-09-23T09:51:22.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:21 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:21.856+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.161:6812 osd.5 since back 2023-09-23T09:50:39.745614+0000 front 2023-09-23T09:50:39.745504+0000 (oldest deadline 2023-09-23T09:51:03.746156+0000) 2023-09-23T09:51:22.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:21 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:21.856+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2023-09-23T09:50:43.746730+0000 front 2023-09-23T09:50:43.746677+0000 (oldest deadline 2023-09-23T09:51:14.947218+0000) 2023-09-23T09:51:22.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:21 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:21.856+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6820 osd.7 since back 2023-09-23T09:50:55.949175+0000 front 2023-09-23T09:50:55.949156+0000 (oldest deadline 2023-09-23T09:51:20.648981+0000) 2023-09-23T09:51:22.310 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:22 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:22.039+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:55.643334+0000 front 2023-09-23T09:49:55.643391+0000 (oldest deadline 2023-09-23T09:50:18.543466+0000) 2023-09-23T09:51:22.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:22 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:22.039+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:03.145721+0000 front 2023-09-23T09:50:03.145799+0000 (oldest deadline 2023-09-23T09:50:26.045803+0000) 2023-09-23T09:51:22.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:22 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:22.039+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:12.348396+0000 front 2023-09-23T09:50:12.348362+0000 (oldest deadline 2023-09-23T09:50:34.648330+0000) 2023-09-23T09:51:22.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:22 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:22.039+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2023-09-23T09:50:22.150884+0000 front 2023-09-23T09:50:22.150846+0000 (oldest deadline 2023-09-23T09:50:45.650923+0000) 2023-09-23T09:51:22.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:22 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:22.039+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:30.852678+0000 front 2023-09-23T09:50:30.852711+0000 (oldest deadline 2023-09-23T09:50:56.752802+0000) 2023-09-23T09:51:22.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:22 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:22.039+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.161:6812 osd.5 since back 2023-09-23T09:50:36.753862+0000 front 2023-09-23T09:50:36.753669+0000 (oldest deadline 2023-09-23T09:51:02.653297+0000) 2023-09-23T09:51:22.311 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:22 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10[120882]: 2023-09-23T09:51:22.039+0000 7fa14735b700 -1 osd.10 181 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2023-09-23T09:50:45.455267+0000 front 2023-09-23T09:50:45.455282+0000 (oldest deadline 2023-09-23T09:51:10.755175+0000) 2023-09-23T09:51:23.146 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:22 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:22.890+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.535551+0000 front 2023-09-23T09:49:54.535491+0000 (oldest deadline 2023-09-23T09:50:18.535947+0000) 2023-09-23T09:51:23.146 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:22 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:22.890+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:04.338156+0000 front 2023-09-23T09:50:04.338141+0000 (oldest deadline 2023-09-23T09:50:27.238084+0000) 2023-09-23T09:51:23.146 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:22 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:22.890+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:13.139271+0000 front 2023-09-23T09:50:13.139458+0000 (oldest deadline 2023-09-23T09:50:36.639382+0000) 2023-09-23T09:51:23.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:22 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:22.890+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:29.844086+0000 front 2023-09-23T09:50:29.844150+0000 (oldest deadline 2023-09-23T09:50:54.543783+0000) 2023-09-23T09:51:23.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:22 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:22.890+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.161:6812 osd.5 since back 2023-09-23T09:50:39.745614+0000 front 2023-09-23T09:50:39.745504+0000 (oldest deadline 2023-09-23T09:51:03.746156+0000) 2023-09-23T09:51:23.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:22 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:22.890+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2023-09-23T09:50:43.746730+0000 front 2023-09-23T09:50:43.746677+0000 (oldest deadline 2023-09-23T09:51:14.947218+0000) 2023-09-23T09:51:23.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:22 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:22.890+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6820 osd.7 since back 2023-09-23T09:50:55.949175+0000 front 2023-09-23T09:50:55.949156+0000 (oldest deadline 2023-09-23T09:51:20.648981+0000) 2023-09-23T09:51:24.061 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 23 09:51:23 smithi135 bash[141860]: ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-10 2023-09-23T09:51:24.396 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:23 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:23.905+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.535551+0000 front 2023-09-23T09:49:54.535491+0000 (oldest deadline 2023-09-23T09:50:18.535947+0000) 2023-09-23T09:51:24.396 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:23 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:23.905+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:04.338156+0000 front 2023-09-23T09:50:04.338141+0000 (oldest deadline 2023-09-23T09:50:27.238084+0000) 2023-09-23T09:51:24.396 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:23 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:23.905+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:13.139271+0000 front 2023-09-23T09:50:13.139458+0000 (oldest deadline 2023-09-23T09:50:36.639382+0000) 2023-09-23T09:51:24.397 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:23 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:23.905+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:29.844086+0000 front 2023-09-23T09:50:29.844150+0000 (oldest deadline 2023-09-23T09:50:54.543783+0000) 2023-09-23T09:51:24.397 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:23 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:23.905+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.161:6812 osd.5 since back 2023-09-23T09:50:39.745614+0000 front 2023-09-23T09:50:39.745504+0000 (oldest deadline 2023-09-23T09:51:03.746156+0000) 2023-09-23T09:51:24.397 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:23 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:23.905+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2023-09-23T09:50:43.746730+0000 front 2023-09-23T09:50:43.746677+0000 (oldest deadline 2023-09-23T09:51:14.947218+0000) 2023-09-23T09:51:24.397 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:23 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:23.905+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6820 osd.7 since back 2023-09-23T09:50:55.949175+0000 front 2023-09-23T09:50:55.949156+0000 (oldest deadline 2023-09-23T09:51:20.648981+0000) 2023-09-23T09:51:25.396 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:24 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:24.899+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.535551+0000 front 2023-09-23T09:49:54.535491+0000 (oldest deadline 2023-09-23T09:50:18.535947+0000) 2023-09-23T09:51:25.397 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:24 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:24.899+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:04.338156+0000 front 2023-09-23T09:50:04.338141+0000 (oldest deadline 2023-09-23T09:50:27.238084+0000) 2023-09-23T09:51:25.397 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:24 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:24.899+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:13.139271+0000 front 2023-09-23T09:50:13.139458+0000 (oldest deadline 2023-09-23T09:50:36.639382+0000) 2023-09-23T09:51:25.397 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:24 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:24.899+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:29.844086+0000 front 2023-09-23T09:50:29.844150+0000 (oldest deadline 2023-09-23T09:50:54.543783+0000) 2023-09-23T09:51:25.397 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:24 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:24.899+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.161:6812 osd.5 since back 2023-09-23T09:50:39.745614+0000 front 2023-09-23T09:50:39.745504+0000 (oldest deadline 2023-09-23T09:51:03.746156+0000) 2023-09-23T09:51:25.397 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:24 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:24.899+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2023-09-23T09:50:43.746730+0000 front 2023-09-23T09:50:43.746677+0000 (oldest deadline 2023-09-23T09:51:14.947218+0000) 2023-09-23T09:51:25.397 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:24 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:24.899+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6820 osd.7 since back 2023-09-23T09:50:55.949175+0000 front 2023-09-23T09:50:55.949156+0000 (oldest deadline 2023-09-23T09:51:20.648981+0000) 2023-09-23T09:51:25.450 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@osd.10.service' 2023-09-23T09:51:25.576 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-09-23T09:51:25.577 INFO:tasks.cephadm.osd.10:Stopped osd.10 2023-09-23T09:51:25.577 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2023-09-23T09:51:25.577 DEBUG:teuthology.orchestra.run.smithi161:> sudo systemctl stop ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@osd.11 2023-09-23T09:51:25.897 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:25 smithi161 systemd[1]: Stopping Ceph osd.11 for 8926e286-59ed-11ee-8db4-212e2dc638e7... 2023-09-23T09:51:25.897 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:25 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:25.855+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.535551+0000 front 2023-09-23T09:49:54.535491+0000 (oldest deadline 2023-09-23T09:50:18.535947+0000) 2023-09-23T09:51:25.897 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:25 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:25.855+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:04.338156+0000 front 2023-09-23T09:50:04.338141+0000 (oldest deadline 2023-09-23T09:50:27.238084+0000) 2023-09-23T09:51:25.897 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:25 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:25.855+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:13.139271+0000 front 2023-09-23T09:50:13.139458+0000 (oldest deadline 2023-09-23T09:50:36.639382+0000) 2023-09-23T09:51:25.897 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:25 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:25.855+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:29.844086+0000 front 2023-09-23T09:50:29.844150+0000 (oldest deadline 2023-09-23T09:50:54.543783+0000) 2023-09-23T09:51:25.897 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:25 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:25.855+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.161:6812 osd.5 since back 2023-09-23T09:50:39.745614+0000 front 2023-09-23T09:50:39.745504+0000 (oldest deadline 2023-09-23T09:51:03.746156+0000) 2023-09-23T09:51:25.897 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:25 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:25.855+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2023-09-23T09:50:43.746730+0000 front 2023-09-23T09:50:43.746677+0000 (oldest deadline 2023-09-23T09:51:14.947218+0000) 2023-09-23T09:51:25.897 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:25 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:25.855+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6820 osd.7 since back 2023-09-23T09:50:55.949175+0000 front 2023-09-23T09:50:55.949156+0000 (oldest deadline 2023-09-23T09:51:20.648981+0000) 2023-09-23T09:51:26.396 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:26 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:26.074+0000 7f3d75912700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-09-23T09:51:26.396 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:26 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:26.074+0000 7f3d75912700 -1 osd.11 181 *** Got signal Terminated *** 2023-09-23T09:51:26.397 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:26 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:26.074+0000 7f3d75912700 -1 osd.11 181 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-09-23T09:51:27.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:26 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:26.866+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.535551+0000 front 2023-09-23T09:49:54.535491+0000 (oldest deadline 2023-09-23T09:50:18.535947+0000) 2023-09-23T09:51:27.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:26 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:26.866+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:04.338156+0000 front 2023-09-23T09:50:04.338141+0000 (oldest deadline 2023-09-23T09:50:27.238084+0000) 2023-09-23T09:51:27.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:26 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:26.866+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:13.139271+0000 front 2023-09-23T09:50:13.139458+0000 (oldest deadline 2023-09-23T09:50:36.639382+0000) 2023-09-23T09:51:27.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:26 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:26.866+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:29.844086+0000 front 2023-09-23T09:50:29.844150+0000 (oldest deadline 2023-09-23T09:50:54.543783+0000) 2023-09-23T09:51:27.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:26 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:26.866+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.161:6812 osd.5 since back 2023-09-23T09:50:39.745614+0000 front 2023-09-23T09:50:39.745504+0000 (oldest deadline 2023-09-23T09:51:03.746156+0000) 2023-09-23T09:51:27.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:26 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:26.866+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2023-09-23T09:50:43.746730+0000 front 2023-09-23T09:50:43.746677+0000 (oldest deadline 2023-09-23T09:51:14.947218+0000) 2023-09-23T09:51:27.148 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:26 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:26.866+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6820 osd.7 since back 2023-09-23T09:50:55.949175+0000 front 2023-09-23T09:50:55.949156+0000 (oldest deadline 2023-09-23T09:51:20.648981+0000) 2023-09-23T09:51:28.146 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:27 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:27.842+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.535551+0000 front 2023-09-23T09:49:54.535491+0000 (oldest deadline 2023-09-23T09:50:18.535947+0000) 2023-09-23T09:51:28.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:27 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:27.842+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:04.338156+0000 front 2023-09-23T09:50:04.338141+0000 (oldest deadline 2023-09-23T09:50:27.238084+0000) 2023-09-23T09:51:28.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:27 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:27.842+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:13.139271+0000 front 2023-09-23T09:50:13.139458+0000 (oldest deadline 2023-09-23T09:50:36.639382+0000) 2023-09-23T09:51:28.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:27 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:27.843+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:29.844086+0000 front 2023-09-23T09:50:29.844150+0000 (oldest deadline 2023-09-23T09:50:54.543783+0000) 2023-09-23T09:51:28.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:27 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:27.843+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.161:6812 osd.5 since back 2023-09-23T09:50:39.745614+0000 front 2023-09-23T09:50:39.745504+0000 (oldest deadline 2023-09-23T09:51:03.746156+0000) 2023-09-23T09:51:28.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:27 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:27.843+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2023-09-23T09:50:43.746730+0000 front 2023-09-23T09:50:43.746677+0000 (oldest deadline 2023-09-23T09:51:14.947218+0000) 2023-09-23T09:51:28.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:27 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:27.843+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6820 osd.7 since back 2023-09-23T09:50:55.949175+0000 front 2023-09-23T09:50:55.949156+0000 (oldest deadline 2023-09-23T09:51:20.648981+0000) 2023-09-23T09:51:28.148 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:27 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:27.843+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.161:6820 osd.8 since back 2023-09-23T09:51:02.950215+0000 front 2023-09-23T09:51:02.950258+0000 (oldest deadline 2023-09-23T09:51:27.050167+0000) 2023-09-23T09:51:29.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:28 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:28.809+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.535551+0000 front 2023-09-23T09:49:54.535491+0000 (oldest deadline 2023-09-23T09:50:18.535947+0000) 2023-09-23T09:51:29.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:28 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:28.809+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:04.338156+0000 front 2023-09-23T09:50:04.338141+0000 (oldest deadline 2023-09-23T09:50:27.238084+0000) 2023-09-23T09:51:29.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:28 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:28.809+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:13.139271+0000 front 2023-09-23T09:50:13.139458+0000 (oldest deadline 2023-09-23T09:50:36.639382+0000) 2023-09-23T09:51:29.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:28 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:28.809+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:29.844086+0000 front 2023-09-23T09:50:29.844150+0000 (oldest deadline 2023-09-23T09:50:54.543783+0000) 2023-09-23T09:51:29.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:28 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:28.810+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.161:6812 osd.5 since back 2023-09-23T09:50:39.745614+0000 front 2023-09-23T09:50:39.745504+0000 (oldest deadline 2023-09-23T09:51:03.746156+0000) 2023-09-23T09:51:29.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:28 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:28.810+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2023-09-23T09:50:43.746730+0000 front 2023-09-23T09:50:43.746677+0000 (oldest deadline 2023-09-23T09:51:14.947218+0000) 2023-09-23T09:51:29.148 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:28 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:28.810+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6820 osd.7 since back 2023-09-23T09:50:55.949175+0000 front 2023-09-23T09:50:55.949156+0000 (oldest deadline 2023-09-23T09:51:20.648981+0000) 2023-09-23T09:51:29.148 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:28 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:28.810+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.161:6820 osd.8 since back 2023-09-23T09:51:02.950215+0000 front 2023-09-23T09:51:02.950258+0000 (oldest deadline 2023-09-23T09:51:27.050167+0000) 2023-09-23T09:51:30.146 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:29 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:29.792+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.535551+0000 front 2023-09-23T09:49:54.535491+0000 (oldest deadline 2023-09-23T09:50:18.535947+0000) 2023-09-23T09:51:30.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:29 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:29.792+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:04.338156+0000 front 2023-09-23T09:50:04.338141+0000 (oldest deadline 2023-09-23T09:50:27.238084+0000) 2023-09-23T09:51:30.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:29 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:29.792+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:13.139271+0000 front 2023-09-23T09:50:13.139458+0000 (oldest deadline 2023-09-23T09:50:36.639382+0000) 2023-09-23T09:51:30.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:29 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:29.792+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:29.844086+0000 front 2023-09-23T09:50:29.844150+0000 (oldest deadline 2023-09-23T09:50:54.543783+0000) 2023-09-23T09:51:30.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:29 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:29.792+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.161:6812 osd.5 since back 2023-09-23T09:50:39.745614+0000 front 2023-09-23T09:50:39.745504+0000 (oldest deadline 2023-09-23T09:51:03.746156+0000) 2023-09-23T09:51:30.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:29 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:29.792+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2023-09-23T09:50:43.746730+0000 front 2023-09-23T09:50:43.746677+0000 (oldest deadline 2023-09-23T09:51:14.947218+0000) 2023-09-23T09:51:30.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:29 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:29.792+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6820 osd.7 since back 2023-09-23T09:50:55.949175+0000 front 2023-09-23T09:50:55.949156+0000 (oldest deadline 2023-09-23T09:51:20.648981+0000) 2023-09-23T09:51:30.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:29 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:29.792+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.161:6820 osd.8 since back 2023-09-23T09:51:02.950215+0000 front 2023-09-23T09:51:02.950258+0000 (oldest deadline 2023-09-23T09:51:27.050167+0000) 2023-09-23T09:51:31.146 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:30 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:30.776+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2023-09-23T09:49:54.535551+0000 front 2023-09-23T09:49:54.535491+0000 (oldest deadline 2023-09-23T09:50:18.535947+0000) 2023-09-23T09:51:31.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:30 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:30.776+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2023-09-23T09:50:04.338156+0000 front 2023-09-23T09:50:04.338141+0000 (oldest deadline 2023-09-23T09:50:27.238084+0000) 2023-09-23T09:51:31.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:30 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:30.776+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.161:6804 osd.2 since back 2023-09-23T09:50:13.139271+0000 front 2023-09-23T09:50:13.139458+0000 (oldest deadline 2023-09-23T09:50:36.639382+0000) 2023-09-23T09:51:31.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:30 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:30.776+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2023-09-23T09:50:29.844086+0000 front 2023-09-23T09:50:29.844150+0000 (oldest deadline 2023-09-23T09:50:54.543783+0000) 2023-09-23T09:51:31.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:30 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:30.776+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.161:6812 osd.5 since back 2023-09-23T09:50:39.745614+0000 front 2023-09-23T09:50:39.745504+0000 (oldest deadline 2023-09-23T09:51:03.746156+0000) 2023-09-23T09:51:31.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:30 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:30.776+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2023-09-23T09:50:43.746730+0000 front 2023-09-23T09:50:43.746677+0000 (oldest deadline 2023-09-23T09:51:14.947218+0000) 2023-09-23T09:51:31.147 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:30 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:30.776+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.135:6820 osd.7 since back 2023-09-23T09:50:55.949175+0000 front 2023-09-23T09:50:55.949156+0000 (oldest deadline 2023-09-23T09:51:20.648981+0000) 2023-09-23T09:51:31.148 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:30 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11[121959]: 2023-09-23T09:51:30.776+0000 7f3d6e701700 -1 osd.11 181 heartbeat_check: no reply from 172.21.15.161:6820 osd.8 since back 2023-09-23T09:51:02.950215+0000 front 2023-09-23T09:51:02.950258+0000 (oldest deadline 2023-09-23T09:51:27.050167+0000) 2023-09-23T09:51:32.396 INFO:journalctl@ceph.osd.11.smithi161.stdout:Sep 23 09:51:32 smithi161 bash[141964]: ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-osd-11 2023-09-23T09:51:33.856 DEBUG:teuthology.orchestra.run.smithi161:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@osd.11.service' 2023-09-23T09:51:33.945 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-09-23T09:51:33.946 INFO:tasks.cephadm.osd.11:Stopped osd.11 2023-09-23T09:51:33.946 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2023-09-23T09:51:33.946 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@mds.a 2023-09-23T09:51:34.369 INFO:journalctl@ceph.mds.a.smithi082.stdout:Sep 23 09:51:34 smithi082 systemd[1]: Stopping Ceph mds.a for 8926e286-59ed-11ee-8db4-212e2dc638e7... 2023-09-23T09:51:34.869 INFO:journalctl@ceph.mds.a.smithi082.stdout:Sep 23 09:51:34 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mds-a[132903]: 2023-09-23T09:51:34.493+0000 7fe1af1b3700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-09-23T09:51:34.869 INFO:journalctl@ceph.mds.a.smithi082.stdout:Sep 23 09:51:34 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mds-a[132903]: 2023-09-23T09:51:34.493+0000 7fe1af1b3700 -1 mds.a *** got signal Terminated *** 2023-09-23T09:51:39.303 INFO:journalctl@ceph.mds.a.smithi082.stdout:Sep 23 09:51:38 smithi082 bash[189147]: ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mds-a 2023-09-23T09:51:39.337 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@mds.a.service' 2023-09-23T09:51:39.421 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-09-23T09:51:39.421 INFO:tasks.cephadm.mds.a:Stopped mds.a 2023-09-23T09:51:39.421 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2023-09-23T09:51:39.421 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@mds.d 2023-09-23T09:51:39.619 INFO:journalctl@ceph.mds.d.smithi082.stdout:Sep 23 09:51:39 smithi082 systemd[1]: Stopping Ceph mds.d for 8926e286-59ed-11ee-8db4-212e2dc638e7... 2023-09-23T09:51:40.369 INFO:journalctl@ceph.mds.d.smithi082.stdout:Sep 23 09:51:39 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mds-d[131845]: 2023-09-23T09:51:39.917+0000 7fe492dbe700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-09-23T09:51:40.369 INFO:journalctl@ceph.mds.d.smithi082.stdout:Sep 23 09:51:39 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mds-d[131845]: 2023-09-23T09:51:39.917+0000 7fe492dbe700 -1 mds.d *** got signal Terminated *** 2023-09-23T09:51:44.619 INFO:journalctl@ceph.mds.d.smithi082.stdout:Sep 23 09:51:44 smithi082 bash[189289]: ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mds-d 2023-09-23T09:51:44.734 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@mds.d.service' 2023-09-23T09:51:44.816 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-09-23T09:51:44.817 INFO:tasks.cephadm.mds.d:Stopped mds.d 2023-09-23T09:51:44.817 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2023-09-23T09:51:44.817 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@mds.g 2023-09-23T09:51:45.119 INFO:journalctl@ceph.mds.g.smithi082.stdout:Sep 23 09:51:44 smithi082 systemd[1]: Stopping Ceph mds.g for 8926e286-59ed-11ee-8db4-212e2dc638e7... 2023-09-23T09:51:45.619 INFO:journalctl@ceph.mds.g.smithi082.stdout:Sep 23 09:51:45 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mds-g[132504]: 2023-09-23T09:51:45.315+0000 7f8f00b05700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-09-23T09:51:45.619 INFO:journalctl@ceph.mds.g.smithi082.stdout:Sep 23 09:51:45 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mds-g[132504]: 2023-09-23T09:51:45.315+0000 7f8f00b05700 -1 mds.g *** got signal Terminated *** 2023-09-23T09:51:48.369 INFO:journalctl@ceph.mds.g.smithi082.stdout:Sep 23 09:51:48 smithi082 bash[189433]: ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mds-g 2023-09-23T09:51:48.566 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@mds.g.service' 2023-09-23T09:51:48.650 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-09-23T09:51:48.650 INFO:tasks.cephadm.mds.g:Stopped mds.g 2023-09-23T09:51:48.651 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2023-09-23T09:51:48.651 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@mds.j 2023-09-23T09:51:48.869 INFO:journalctl@ceph.mds.j.smithi082.stdout:Sep 23 09:51:48 smithi082 systemd[1]: Stopping Ceph mds.j for 8926e286-59ed-11ee-8db4-212e2dc638e7... 2023-09-23T09:51:49.619 INFO:journalctl@ceph.mds.j.smithi082.stdout:Sep 23 09:51:49 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mds-j[131412]: 2023-09-23T09:51:49.179+0000 7f21723bd700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-09-23T09:51:49.619 INFO:journalctl@ceph.mds.j.smithi082.stdout:Sep 23 09:51:49 smithi082 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mds-j[131412]: 2023-09-23T09:51:49.179+0000 7f21723bd700 -1 mds.j *** got signal Terminated *** 2023-09-23T09:51:53.752 INFO:journalctl@ceph.mds.j.smithi082.stdout:Sep 23 09:51:53 smithi082 bash[189587]: ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mds-j 2023-09-23T09:51:54.024 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@mds.j.service' 2023-09-23T09:51:54.107 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-09-23T09:51:54.107 INFO:tasks.cephadm.mds.j:Stopped mds.j 2023-09-23T09:51:54.107 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2023-09-23T09:51:54.108 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@mds.b 2023-09-23T09:51:54.561 INFO:journalctl@ceph.mds.b.smithi135.stdout:Sep 23 09:51:54 smithi135 systemd[1]: Stopping Ceph mds.b for 8926e286-59ed-11ee-8db4-212e2dc638e7... 2023-09-23T09:51:55.060 INFO:journalctl@ceph.mds.b.smithi135.stdout:Sep 23 09:51:54 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mds-b[124695]: 2023-09-23T09:51:54.677+0000 7f61e82c0700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-09-23T09:51:55.061 INFO:journalctl@ceph.mds.b.smithi135.stdout:Sep 23 09:51:54 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mds-b[124695]: 2023-09-23T09:51:54.677+0000 7f61e82c0700 -1 mds.b *** got signal Terminated *** 2023-09-23T09:52:00.561 INFO:journalctl@ceph.mds.b.smithi135.stdout:Sep 23 09:52:00 smithi135 bash[142142]: ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mds-b 2023-09-23T09:52:00.770 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@mds.b.service' 2023-09-23T09:52:00.853 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-09-23T09:52:00.853 INFO:tasks.cephadm.mds.b:Stopped mds.b 2023-09-23T09:52:00.853 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2023-09-23T09:52:00.854 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@mds.e 2023-09-23T09:52:01.060 INFO:journalctl@ceph.mds.e.smithi135.stdout:Sep 23 09:52:00 smithi135 systemd[1]: Stopping Ceph mds.e for 8926e286-59ed-11ee-8db4-212e2dc638e7... 2023-09-23T09:52:01.810 INFO:journalctl@ceph.mds.e.smithi135.stdout:Sep 23 09:52:01 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mds-e[124002]: 2023-09-23T09:52:01.360+0000 7fa0cfa02700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-09-23T09:52:01.810 INFO:journalctl@ceph.mds.e.smithi135.stdout:Sep 23 09:52:01 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mds-e[124002]: 2023-09-23T09:52:01.360+0000 7fa0cfa02700 -1 mds.e *** got signal Terminated *** 2023-09-23T09:52:04.794 INFO:journalctl@ceph.mds.e.smithi135.stdout:Sep 23 09:52:04 smithi135 bash[142288]: ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mds-e 2023-09-23T09:52:04.818 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@mds.e.service' 2023-09-23T09:52:04.901 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-09-23T09:52:04.901 INFO:tasks.cephadm.mds.e:Stopped mds.e 2023-09-23T09:52:04.902 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2023-09-23T09:52:04.902 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@mds.h 2023-09-23T09:52:05.061 INFO:journalctl@ceph.mds.h.smithi135.stdout:Sep 23 09:52:04 smithi135 systemd[1]: Stopping Ceph mds.h for 8926e286-59ed-11ee-8db4-212e2dc638e7... 2023-09-23T09:52:05.811 INFO:journalctl@ceph.mds.h.smithi135.stdout:Sep 23 09:52:05 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mds-h[124346]: 2023-09-23T09:52:05.392+0000 7f5a671b9700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-09-23T09:52:05.812 INFO:journalctl@ceph.mds.h.smithi135.stdout:Sep 23 09:52:05 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mds-h[124346]: 2023-09-23T09:52:05.392+0000 7f5a671b9700 -1 mds.h *** got signal Terminated *** 2023-09-23T09:52:08.537 INFO:journalctl@ceph.mds.h.smithi135.stdout:Sep 23 09:52:08 smithi135 bash[142431]: ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mds-h 2023-09-23T09:52:08.560 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@mds.h.service' 2023-09-23T09:52:08.641 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-09-23T09:52:08.641 INFO:tasks.cephadm.mds.h:Stopped mds.h 2023-09-23T09:52:08.641 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2023-09-23T09:52:08.641 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@mds.k 2023-09-23T09:52:08.810 INFO:journalctl@ceph.mds.k.smithi135.stdout:Sep 23 09:52:08 smithi135 systemd[1]: Stopping Ceph mds.k for 8926e286-59ed-11ee-8db4-212e2dc638e7... 2023-09-23T09:52:09.560 INFO:journalctl@ceph.mds.k.smithi135.stdout:Sep 23 09:52:09 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mds-k[123652]: 2023-09-23T09:52:09.117+0000 7f7931c6f700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-09-23T09:52:09.561 INFO:journalctl@ceph.mds.k.smithi135.stdout:Sep 23 09:52:09 smithi135 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mds-k[123652]: 2023-09-23T09:52:09.117+0000 7f7931c6f700 -1 mds.k *** got signal Terminated *** 2023-09-23T09:52:11.403 INFO:journalctl@ceph.mds.k.smithi135.stdout:Sep 23 09:52:11 smithi135 bash[142567]: ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mds-k 2023-09-23T09:52:11.667 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@mds.k.service' 2023-09-23T09:52:11.748 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-09-23T09:52:11.749 INFO:tasks.cephadm.mds.k:Stopped mds.k 2023-09-23T09:52:11.749 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2023-09-23T09:52:11.749 DEBUG:teuthology.orchestra.run.smithi161:> sudo systemctl stop ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@mds.c 2023-09-23T09:52:12.146 INFO:journalctl@ceph.mds.c.smithi161.stdout:Sep 23 09:52:11 smithi161 systemd[1]: Stopping Ceph mds.c for 8926e286-59ed-11ee-8db4-212e2dc638e7... 2023-09-23T09:52:12.646 INFO:journalctl@ceph.mds.c.smithi161.stdout:Sep 23 09:52:12 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mds-c[125572]: 2023-09-23T09:52:12.258+0000 7ff2f9a33700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-09-23T09:52:12.646 INFO:journalctl@ceph.mds.c.smithi161.stdout:Sep 23 09:52:12 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mds-c[125572]: 2023-09-23T09:52:12.258+0000 7ff2f9a33700 -1 mds.c *** got signal Terminated *** 2023-09-23T09:52:15.646 INFO:journalctl@ceph.mds.c.smithi161.stdout:Sep 23 09:52:15 smithi161 bash[142245]: ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mds-c 2023-09-23T09:52:15.727 DEBUG:teuthology.orchestra.run.smithi161:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@mds.c.service' 2023-09-23T09:52:15.811 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-09-23T09:52:15.811 INFO:tasks.cephadm.mds.c:Stopped mds.c 2023-09-23T09:52:15.812 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2023-09-23T09:52:15.812 DEBUG:teuthology.orchestra.run.smithi161:> sudo systemctl stop ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@mds.f 2023-09-23T09:52:16.146 INFO:journalctl@ceph.mds.f.smithi161.stdout:Sep 23 09:52:15 smithi161 systemd[1]: Stopping Ceph mds.f for 8926e286-59ed-11ee-8db4-212e2dc638e7... 2023-09-23T09:52:16.646 INFO:journalctl@ceph.mds.f.smithi161.stdout:Sep 23 09:52:16 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mds-f[125230]: 2023-09-23T09:52:16.299+0000 7fd678e1c700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-09-23T09:52:16.646 INFO:journalctl@ceph.mds.f.smithi161.stdout:Sep 23 09:52:16 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mds-f[125230]: 2023-09-23T09:52:16.299+0000 7fd678e1c700 -1 mds.f *** got signal Terminated *** 2023-09-23T09:52:21.896 INFO:journalctl@ceph.mds.f.smithi161.stdout:Sep 23 09:52:21 smithi161 bash[142389]: ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mds-f 2023-09-23T09:52:21.986 DEBUG:teuthology.orchestra.run.smithi161:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@mds.f.service' 2023-09-23T09:52:22.069 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-09-23T09:52:22.069 INFO:tasks.cephadm.mds.f:Stopped mds.f 2023-09-23T09:52:22.069 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2023-09-23T09:52:22.069 DEBUG:teuthology.orchestra.run.smithi161:> sudo systemctl stop ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@mds.i 2023-09-23T09:52:22.396 INFO:journalctl@ceph.mds.i.smithi161.stdout:Sep 23 09:52:22 smithi161 systemd[1]: Stopping Ceph mds.i for 8926e286-59ed-11ee-8db4-212e2dc638e7... 2023-09-23T09:52:22.896 INFO:journalctl@ceph.mds.i.smithi161.stdout:Sep 23 09:52:22 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mds-i[125918]: 2023-09-23T09:52:22.556+0000 7f13f262a700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-09-23T09:52:22.896 INFO:journalctl@ceph.mds.i.smithi161.stdout:Sep 23 09:52:22 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mds-i[125918]: 2023-09-23T09:52:22.556+0000 7f13f262a700 -1 mds.i *** got signal Terminated *** 2023-09-23T09:52:26.397 INFO:journalctl@ceph.mds.i.smithi161.stdout:Sep 23 09:52:26 smithi161 bash[142534]: ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mds-i 2023-09-23T09:52:26.500 DEBUG:teuthology.orchestra.run.smithi161:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@mds.i.service' 2023-09-23T09:52:26.583 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-09-23T09:52:26.583 INFO:tasks.cephadm.mds.i:Stopped mds.i 2023-09-23T09:52:26.583 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2023-09-23T09:52:26.584 DEBUG:teuthology.orchestra.run.smithi161:> sudo systemctl stop ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@mds.l 2023-09-23T09:52:26.897 INFO:journalctl@ceph.mds.l.smithi161.stdout:Sep 23 09:52:26 smithi161 systemd[1]: Stopping Ceph mds.l for 8926e286-59ed-11ee-8db4-212e2dc638e7... 2023-09-23T09:52:27.396 INFO:journalctl@ceph.mds.l.smithi161.stdout:Sep 23 09:52:27 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mds-l[124880]: 2023-09-23T09:52:27.114+0000 7f897da5b700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-09-23T09:52:27.396 INFO:journalctl@ceph.mds.l.smithi161.stdout:Sep 23 09:52:27 smithi161 ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mds-l[124880]: 2023-09-23T09:52:27.114+0000 7f897da5b700 -1 mds.l *** got signal Terminated *** 2023-09-23T09:52:31.646 INFO:journalctl@ceph.mds.l.smithi161.stdout:Sep 23 09:52:31 smithi161 bash[142678]: ceph-8926e286-59ed-11ee-8db4-212e2dc638e7-mds-l 2023-09-23T09:52:31.807 DEBUG:teuthology.orchestra.run.smithi161:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8926e286-59ed-11ee-8db4-212e2dc638e7@mds.l.service' 2023-09-23T09:52:31.888 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-09-23T09:52:31.888 INFO:tasks.cephadm.mds.l:Stopped mds.l 2023-09-23T09:52:31.889 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 --force --keep-logs 2023-09-23T09:52:32.294 INFO:teuthology.orchestra.run.smithi082.stdout:Deleting cluster with fsid: 8926e286-59ed-11ee-8db4-212e2dc638e7 2023-09-23T09:52:35.743 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 --force --keep-logs 2023-09-23T09:52:36.280 INFO:teuthology.orchestra.run.smithi135.stdout:Deleting cluster with fsid: 8926e286-59ed-11ee-8db4-212e2dc638e7 2023-09-23T09:52:39.408 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 --force --keep-logs 2023-09-23T09:52:39.799 INFO:teuthology.orchestra.run.smithi161.stdout:Deleting cluster with fsid: 8926e286-59ed-11ee-8db4-212e2dc638e7 2023-09-23T09:52:43.065 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-09-23T09:52:43.144 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-09-23T09:52:43.222 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-09-23T09:52:43.294 INFO:tasks.cephadm:Archiving crash dumps... 2023-09-23T09:52:43.297 DEBUG:teuthology.misc:Transferring archived files from smithi082:/var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/crash to /home/teuthworker/archive/mchangir-2023-09-23_08:19:06-fs:workload-wip-vshankar-testing-20230824.045828-scrub-failure-testing-default-smithi/7401665/remote/smithi082/crash 2023-09-23T09:52:43.298 DEBUG:teuthology.orchestra.run.smithi082:> sudo tar c -f - -C /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/crash -- . 2023-09-23T09:52:43.381 INFO:teuthology.orchestra.run.smithi082.stderr:tar: /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/crash: Cannot open: No such file or directory 2023-09-23T09:52:43.382 INFO:teuthology.orchestra.run.smithi082.stderr:tar: Error is not recoverable: exiting now 2023-09-23T09:52:43.385 DEBUG:teuthology.misc:Transferring archived files from smithi135:/var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/crash to /home/teuthworker/archive/mchangir-2023-09-23_08:19:06-fs:workload-wip-vshankar-testing-20230824.045828-scrub-failure-testing-default-smithi/7401665/remote/smithi135/crash 2023-09-23T09:52:43.386 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar c -f - -C /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/crash -- . 2023-09-23T09:52:43.607 INFO:teuthology.orchestra.run.smithi135.stderr:tar: /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/crash: Cannot open: No such file or directory 2023-09-23T09:52:43.607 INFO:teuthology.orchestra.run.smithi135.stderr:tar: Error is not recoverable: exiting now 2023-09-23T09:52:43.612 DEBUG:teuthology.misc:Transferring archived files from smithi161:/var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/crash to /home/teuthworker/archive/mchangir-2023-09-23_08:19:06-fs:workload-wip-vshankar-testing-20230824.045828-scrub-failure-testing-default-smithi/7401665/remote/smithi161/crash 2023-09-23T09:52:43.613 DEBUG:teuthology.orchestra.run.smithi161:> sudo tar c -f - -C /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/crash -- . 2023-09-23T09:52:43.697 INFO:teuthology.orchestra.run.smithi161.stderr:tar: /var/lib/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/crash: Cannot open: No such file or directory 2023-09-23T09:52:43.697 INFO:teuthology.orchestra.run.smithi161.stderr:tar: Error is not recoverable: exiting now 2023-09-23T09:52:43.699 INFO:tasks.cephadm:Checking cluster log for badness... 2023-09-23T09:52:43.700 DEBUG:teuthology.orchestra.run.smithi082:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2023-09-23T09:52:43.782 INFO:teuthology.orchestra.run.smithi082.stderr:grep: /var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph.log: No such file or directory 2023-09-23T09:52:43.797 INFO:tasks.cephadm:Compressing logs... 2023-09-23T09:52:43.797 DEBUG:teuthology.orchestra.run.smithi082:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-09-23T09:52:43.802 DEBUG:teuthology.orchestra.run.smithi135:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-09-23T09:52:43.808 DEBUG:teuthology.orchestra.run.smithi161:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-09-23T09:52:43.880 INFO:teuthology.orchestra.run.smithi082.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-09-23T09:52:43.881 INFO:teuthology.orchestra.run.smithi082.stderr:: No such file or directory 2023-09-23T09:52:43.887 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-osd.0.log 2023-09-23T09:52:43.888 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-mds.g.log 2023-09-23T09:52:43.889 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-mds.a.log 2023-09-23T09:52:43.890 INFO:teuthology.orchestra.run.smithi161.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-09-23T09:52:43.890 INFO:teuthology.orchestra.run.smithi161.stderr:: No such file or directory 2023-09-23T09:52:43.891 INFO:teuthology.orchestra.run.smithi135.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-09-23T09:52:43.892 INFO:teuthology.orchestra.run.smithi135.stderr:: No such file or directory 2023-09-23T09:52:43.892 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-osd.6.log 2023-09-23T09:52:43.892 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-osd.3.log 2023-09-23T09:52:43.893 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-mds.d.log 2023-09-23T09:52:43.893 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-mgr.x.log 2023-09-23T09:52:43.894 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-osd.9.log 2023-09-23T09:52:43.894 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-volume.log 2023-09-23T09:52:43.895 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-osd.5.log 2023-09-23T09:52:43.896 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-osd.2.log 2023-09-23T09:52:43.897 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-mds.j.log 2023-09-23T09:52:43.897 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-mon.a.log 2023-09-23T09:52:43.898 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2023-09-23T09:52:43.899 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-osd.11.log 2023-09-23T09:52:43.899 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-mgr.z.log 2023-09-23T09:52:43.899 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-osd.8.log 2023-09-23T09:52:43.901 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-mds.f.log 2023-09-23T09:52:43.901 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-mds.c.log 2023-09-23T09:52:43.902 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-osd.10.log 2023-09-23T09:52:43.902 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-mds.h.log 2023-09-23T09:52:43.902 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-mds.e.log 2023-09-23T09:52:43.903 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-osd.4.log 2023-09-23T09:52:43.903 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-osd.1.log 2023-09-23T09:52:43.904 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-mon.a.log: /var/log/ceph/ceph-client.0.log: 94.6% -- replaced with /var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-mds.d.log.gz 2023-09-23T09:52:43.905 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-mds.k.log 2023-09-23T09:52:43.905 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-volume.log 2023-09-23T09:52:43.906 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-osd.7.log 2023-09-23T09:52:43.906 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-mds.i.log 2023-09-23T09:52:43.907 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-mon.c.log 2023-09-23T09:52:43.907 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-volume.log 2023-09-23T09:52:43.907 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-mds.l.log 2023-09-23T09:52:43.908 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-mon.b.log 2023-09-23T09:52:43.908 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-mds.b.log 2023-09-23T09:52:43.908 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-mgr.y.log 2023-09-23T09:52:43.909 INFO:teuthology.orchestra.run.smithi082.stderr: 94.6% -- replaced with /var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-mds.j.log.gz 2023-09-23T09:52:43.922 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-mds.b.log: /var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-mgr.y.log: 93.4% -- replaced with /var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-mgr.y.log.gz 2023-09-23T09:52:44.113 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-volume.log: /var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-mds.l.log: 91.4% -- replaced with /var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-volume.log.gz 2023-09-23T09:52:44.122 INFO:teuthology.orchestra.run.smithi161.stderr: 93.3% -- replaced with /var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-mgr.z.log.gz 2023-09-23T09:52:44.145 INFO:teuthology.orchestra.run.smithi082.stderr: 91.5% -- replaced with /var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-volume.log.gz 2023-09-23T09:52:44.490 INFO:teuthology.orchestra.run.smithi135.stderr: 91.5% -- replaced with /var/log/ceph/cephadm.log.gz 2023-09-23T09:52:44.526 INFO:teuthology.orchestra.run.smithi161.stderr: 92.1% -- replaced with /var/log/ceph/cephadm.log.gz 2023-09-23T09:52:44.631 INFO:teuthology.orchestra.run.smithi082.stderr: 93.3% -- replaced with /var/log/ceph/cephadm.log.gz 2023-09-23T09:52:45.466 INFO:teuthology.orchestra.run.smithi135.stderr: 91.4% -- replaced with /var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-volume.log.gz 2023-09-23T09:52:46.422 INFO:teuthology.orchestra.run.smithi082.stderr: 94.5% -- replaced with /var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-mds.a.log.gz 2023-09-23T09:52:46.550 INFO:teuthology.orchestra.run.smithi082.stderr: 90.0% -- replaced with /var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-mgr.x.log.gz 2023-09-23T09:52:46.760 INFO:teuthology.orchestra.run.smithi082.stderr: 94.4% -- replaced with /var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-mds.g.log.gz 2023-09-23T09:52:48.421 INFO:teuthology.orchestra.run.smithi135.stderr: 94.5% -- replaced with /var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-mds.k.log.gz 2023-09-23T09:52:50.445 INFO:teuthology.orchestra.run.smithi135.stderr: 92.0% -- replaced with /var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-mon.b.log.gz 2023-09-23T09:52:51.624 INFO:teuthology.orchestra.run.smithi161.stderr: 92.0% -- replaced with /var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-mon.c.log.gz 2023-09-23T09:52:51.782 INFO:teuthology.orchestra.run.smithi161.stderr: 94.4% -- replaced with /var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-mds.l.log.gz 2023-09-23T09:52:51.997 INFO:teuthology.orchestra.run.smithi082.stderr: 90.3% -- replaced with /var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-mon.a.log.gz 2023-09-23T09:52:58.252 INFO:teuthology.orchestra.run.smithi135.stderr: 96.3% -- replaced with /var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-mds.e.log.gz 2023-09-23T09:53:41.175 INFO:teuthology.orchestra.run.smithi082.stderr: 93.9% -- replaced with /var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-osd.9.log.gz 2023-09-23T09:53:51.384 INFO:teuthology.orchestra.run.smithi161.stderr: 94.4% -- replaced with /var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-mds.i.log.gz 2023-09-23T09:54:03.284 INFO:teuthology.orchestra.run.smithi082.stderr: 93.9% -- replaced with /var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-osd.6.log.gz 2023-09-23T09:54:04.944 INFO:teuthology.orchestra.run.smithi082.stderr: 94.0% -- replaced with /var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-osd.0.log.gz 2023-09-23T09:54:28.612 INFO:teuthology.orchestra.run.smithi161.stderr: 93.9% -- replaced with /var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-osd.2.log.gz 2023-09-23T09:54:29.277 INFO:teuthology.orchestra.run.smithi082.stderr: 94.0% -- replaced with /var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-osd.3.log.gz 2023-09-23T09:54:35.132 INFO:teuthology.orchestra.run.smithi161.stderr: 93.9% -- replaced with /var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-osd.8.log.gz 2023-09-23T09:54:37.004 INFO:teuthology.orchestra.run.smithi135.stderr: 93.9% -- replaced with /var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-osd.4.log.gz 2023-09-23T09:54:37.866 INFO:teuthology.orchestra.run.smithi161.stderr: 93.9% -- replaced with /var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-osd.5.log.gz 2023-09-23T09:54:46.899 INFO:teuthology.orchestra.run.smithi135.stderr: 94.0% -- replaced with /var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-osd.1.log.gz 2023-09-23T09:54:57.294 INFO:teuthology.orchestra.run.smithi161.stderr: 94.2% -- replaced with /var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-osd.11.log.gz 2023-09-23T09:54:59.963 INFO:teuthology.orchestra.run.smithi161.stderr: 94.0% -- replaced with /var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-mds.c.log.gz 2023-09-23T09:55:20.307 INFO:teuthology.orchestra.run.smithi135.stderr: 94.1% -- replaced with /var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-osd.7.log.gz 2023-09-23T09:56:05.840 INFO:teuthology.orchestra.run.smithi135.stderr: 93.9% -- replaced with /var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-osd.10.log.gz 2023-09-23T09:56:47.470 INFO:teuthology.orchestra.run.smithi135.stderr: 97.5% -- replaced with /var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-mds.h.log.gz 2023-09-23T09:57:00.634 INFO:teuthology.orchestra.run.smithi082.stderr: 94.7% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2023-09-23T09:57:00.637 INFO:teuthology.orchestra.run.smithi082.stderr: 2023-09-23T09:57:00.637 INFO:teuthology.orchestra.run.smithi082.stderr:real 4m16.799s 2023-09-23T09:57:00.637 INFO:teuthology.orchestra.run.smithi082.stderr:user 4m54.398s 2023-09-23T09:57:00.637 INFO:teuthology.orchestra.run.smithi082.stderr:sys 0m40.412s 2023-09-23T09:58:21.821 INFO:teuthology.orchestra.run.smithi161.stderr: 95.7% -- replaced with /var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-mds.f.log.gz 2023-09-23T09:58:21.846 INFO:teuthology.orchestra.run.smithi161.stderr: 2023-09-23T09:58:21.846 INFO:teuthology.orchestra.run.smithi161.stderr:real 5m37.977s 2023-09-23T09:58:21.846 INFO:teuthology.orchestra.run.smithi161.stderr:user 6m20.782s 2023-09-23T09:58:21.846 INFO:teuthology.orchestra.run.smithi161.stderr:sys 0m53.438s 2023-09-23T09:59:26.033 INFO:teuthology.orchestra.run.smithi135.stderr: 97.8% -- replaced with /var/log/ceph/8926e286-59ed-11ee-8db4-212e2dc638e7/ceph-mds.b.log.gz 2023-09-23T09:59:26.135 INFO:teuthology.orchestra.run.smithi135.stderr: 2023-09-23T09:59:26.135 INFO:teuthology.orchestra.run.smithi135.stderr:real 6m42.286s 2023-09-23T09:59:26.135 INFO:teuthology.orchestra.run.smithi135.stderr:user 6m23.746s 2023-09-23T09:59:26.135 INFO:teuthology.orchestra.run.smithi135.stderr:sys 1m3.661s 2023-09-23T09:59:26.135 INFO:tasks.cephadm:Archiving logs... 2023-09-23T09:59:26.136 DEBUG:teuthology.misc:Transferring archived files from smithi082:/var/log/ceph to /home/teuthworker/archive/mchangir-2023-09-23_08:19:06-fs:workload-wip-vshankar-testing-20230824.045828-scrub-failure-testing-default-smithi/7401665/remote/smithi082/log 2023-09-23T09:59:26.137 DEBUG:teuthology.orchestra.run.smithi082:> sudo tar c -f - -C /var/log/ceph -- . 2023-09-23T10:00:06.211 DEBUG:teuthology.misc:Transferring archived files from smithi135:/var/log/ceph to /home/teuthworker/archive/mchangir-2023-09-23_08:19:06-fs:workload-wip-vshankar-testing-20230824.045828-scrub-failure-testing-default-smithi/7401665/remote/smithi135/log 2023-09-23T10:00:06.212 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar c -f - -C /var/log/ceph -- . 2023-09-23T10:00:41.774 DEBUG:teuthology.misc:Transferring archived files from smithi161:/var/log/ceph to /home/teuthworker/archive/mchangir-2023-09-23_08:19:06-fs:workload-wip-vshankar-testing-20230824.045828-scrub-failure-testing-default-smithi/7401665/remote/smithi161/log 2023-09-23T10:00:41.776 DEBUG:teuthology.orchestra.run.smithi161:> sudo tar c -f - -C /var/log/ceph -- . 2023-09-23T10:01:28.686 INFO:tasks.cephadm:Removing cluster... 2023-09-23T10:01:28.707 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 --force 2023-09-23T10:01:29.097 INFO:teuthology.orchestra.run.smithi082.stdout:Deleting cluster with fsid: 8926e286-59ed-11ee-8db4-212e2dc638e7 2023-09-23T10:01:30.202 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 --force 2023-09-23T10:01:31.047 INFO:teuthology.orchestra.run.smithi135.stdout:Deleting cluster with fsid: 8926e286-59ed-11ee-8db4-212e2dc638e7 2023-09-23T10:01:32.394 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 8926e286-59ed-11ee-8db4-212e2dc638e7 --force 2023-09-23T10:01:33.091 INFO:teuthology.orchestra.run.smithi161.stdout:Deleting cluster with fsid: 8926e286-59ed-11ee-8db4-212e2dc638e7 2023-09-23T10:01:34.746 INFO:tasks.cephadm:Removing cephadm ... 2023-09-23T10:01:34.747 DEBUG:teuthology.orchestra.run.smithi082:> rm -rf /home/ubuntu/cephtest/cephadm 2023-09-23T10:01:34.796 DEBUG:teuthology.orchestra.run.smithi135:> rm -rf /home/ubuntu/cephtest/cephadm 2023-09-23T10:01:34.845 DEBUG:teuthology.orchestra.run.smithi161:> rm -rf /home/ubuntu/cephtest/cephadm 2023-09-23T10:01:34.888 INFO:tasks.cephadm:Teardown complete 2023-09-23T10:01:34.888 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-09-23T10:01:34.898 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_db9a2d12746faa158579b8d032d53d472ae6b6b0/qa/tasks/fwd_scrub.py", line 164, in task stop_all_fwd_scrubbers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph-c_db9a2d12746faa158579b8d032d53d472ae6b6b0/qa/tasks/fwd_scrub.py", line 99, in stop_all_fwd_scrubbers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: reached maximum tries (31) after waiting for 900 seconds 2023-09-23T10:01:34.927 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-09-23T10:01:34.927 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-09-23T10:01:34.932 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-09-23T10:01:34.937 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-09-23T10:01:35.114 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-09-23T10:01:35.124 INFO:teuthology.task.clock:Checking final clock skew... 2023-09-23T10:01:35.124 DEBUG:teuthology.orchestra.run.smithi082:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-23T10:01:35.129 DEBUG:teuthology.orchestra.run.smithi135:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-23T10:01:35.134 DEBUG:teuthology.orchestra.run.smithi161:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-23T10:01:35.167 INFO:teuthology.orchestra.run.smithi082.stderr:bash: ntpq: command not found 2023-09-23T10:01:35.171 INFO:teuthology.orchestra.run.smithi135.stderr:bash: ntpq: command not found 2023-09-23T10:01:35.174 INFO:teuthology.orchestra.run.smithi082.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-09-23T10:01:35.175 INFO:teuthology.orchestra.run.smithi082.stdout:=============================================================================== 2023-09-23T10:01:35.175 INFO:teuthology.orchestra.run.smithi082.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 26 -119us[ -119us] +/- 83ms 2023-09-23T10:01:35.175 INFO:teuthology.orchestra.run.smithi082.stdout:^* hv02.front.sepia.ceph.com 3 6 377 28 -1004us[ -933us] +/- 57ms 2023-09-23T10:01:35.175 INFO:teuthology.orchestra.run.smithi082.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 28 +1343us[+1343us] +/- 63ms 2023-09-23T10:01:35.175 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2023-09-23T10:01:35.176 INFO:teuthology.orchestra.run.smithi161.stderr:bash: ntpq: command not found 2023-09-23T10:01:35.195 INFO:teuthology.orchestra.run.smithi161.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-09-23T10:01:35.195 INFO:teuthology.orchestra.run.smithi161.stdout:=============================================================================== 2023-09-23T10:01:35.195 INFO:teuthology.orchestra.run.smithi161.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 27 -144us[ -144us] +/- 83ms 2023-09-23T10:01:35.195 INFO:teuthology.orchestra.run.smithi161.stdout:^* hv02.front.sepia.ceph.com 3 6 377 29 -1016us[-1011us] +/- 57ms 2023-09-23T10:01:35.195 INFO:teuthology.orchestra.run.smithi161.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 30 +1315us[+1321us] +/- 63ms 2023-09-23T10:01:35.195 INFO:teuthology.orchestra.run.smithi161.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2023-09-23T10:01:35.198 INFO:teuthology.orchestra.run.smithi135.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-09-23T10:01:35.199 INFO:teuthology.orchestra.run.smithi135.stdout:=============================================================================== 2023-09-23T10:01:35.199 INFO:teuthology.orchestra.run.smithi135.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 33 -119us[ -61us] +/- 83ms 2023-09-23T10:01:35.199 INFO:teuthology.orchestra.run.smithi135.stdout:^* hv02.front.sepia.ceph.com 3 6 377 32 -1013us[ -955us] +/- 57ms 2023-09-23T10:01:35.199 INFO:teuthology.orchestra.run.smithi135.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 24 +1325us[+1325us] +/- 63ms 2023-09-23T10:01:35.199 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2023-09-23T10:01:35.200 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-09-23T10:01:35.210 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-09-23T10:01:35.210 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-09-23T10:01:35.231 DEBUG:teuthology.orchestra.run.smithi082:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-09-23T10:01:35.504 DEBUG:teuthology.orchestra.run.smithi135:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-09-23T10:01:35.792 DEBUG:teuthology.orchestra.run.smithi161:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-09-23T10:01:36.026 DEBUG:teuthology.orchestra.run.smithi082:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-09-23T10:01:36.104 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-23T10:01:36.105 DEBUG:teuthology.orchestra.run.smithi135:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-09-23T10:01:36.180 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-23T10:01:36.181 DEBUG:teuthology.orchestra.run.smithi161:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-09-23T10:01:36.257 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-23T10:01:36.257 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-09-23T10:01:36.269 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-09-23T10:01:36.303 INFO:teuthology.task.internal:Duration was 5487.215763 seconds 2023-09-23T10:01:36.303 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-09-23T10:01:36.313 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-09-23T10:01:36.313 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-09-23T10:01:36.318 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-09-23T10:01:36.322 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-09-23T10:01:36.466 INFO:teuthology.orchestra.run.smithi161.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-09-23T10:01:36.675 INFO:teuthology.orchestra.run.smithi082.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-09-23T10:01:36.676 INFO:teuthology.orchestra.run.smithi135.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-09-23T10:01:36.919 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-09-23T10:01:36.919 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi082.front.sepia.ceph.com 2023-09-23T10:01:36.919 DEBUG:teuthology.orchestra.run.smithi082:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-09-23T10:01:36.977 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi135.front.sepia.ceph.com 2023-09-23T10:01:36.977 DEBUG:teuthology.orchestra.run.smithi135:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-09-23T10:01:37.041 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi161.front.sepia.ceph.com 2023-09-23T10:01:37.041 DEBUG:teuthology.orchestra.run.smithi161:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-09-23T10:01:37.111 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-09-23T10:01:37.112 DEBUG:teuthology.orchestra.run.smithi082:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-09-23T10:01:37.116 DEBUG:teuthology.orchestra.run.smithi135:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-09-23T10:01:37.121 DEBUG:teuthology.orchestra.run.smithi161:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-09-23T10:01:37.249 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-09-23T10:01:37.250 DEBUG:teuthology.orchestra.run.smithi082:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-09-23T10:01:37.254 DEBUG:teuthology.orchestra.run.smithi135:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-09-23T10:01:37.258 DEBUG:teuthology.orchestra.run.smithi161:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-09-23T10:01:37.434 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-09-23T10:01:37.447 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-09-23T10:01:37.447 DEBUG:teuthology.orchestra.run.smithi082:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-09-23T10:01:37.526 DEBUG:teuthology.orchestra.run.smithi135:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-09-23T10:01:37.596 DEBUG:teuthology.orchestra.run.smithi161:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-09-23T10:01:37.667 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-09-23T10:01:37.678 DEBUG:teuthology.orchestra.run.smithi082:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-09-23T10:01:37.683 DEBUG:teuthology.orchestra.run.smithi135:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-09-23T10:01:37.688 DEBUG:teuthology.orchestra.run.smithi161:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-09-23T10:01:37.749 INFO:teuthology.orchestra.run.smithi082.stdout:kernel.core_pattern = core 2023-09-23T10:01:37.769 INFO:teuthology.orchestra.run.smithi135.stdout:kernel.core_pattern = core 2023-09-23T10:01:37.770 INFO:teuthology.orchestra.run.smithi161.stdout:kernel.core_pattern = core 2023-09-23T10:01:37.820 DEBUG:teuthology.orchestra.run.smithi082:> test -e /home/ubuntu/cephtest/archive/coredump 2023-09-23T10:01:37.860 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-23T10:01:37.861 DEBUG:teuthology.orchestra.run.smithi135:> test -e /home/ubuntu/cephtest/archive/coredump 2023-09-23T10:01:37.901 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-23T10:01:37.902 DEBUG:teuthology.orchestra.run.smithi161:> test -e /home/ubuntu/cephtest/archive/coredump 2023-09-23T10:01:37.943 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-23T10:01:37.943 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-09-23T10:01:37.955 INFO:teuthology.task.internal:Transferring archived files... 2023-09-23T10:01:37.956 DEBUG:teuthology.misc:Transferring archived files from smithi082:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2023-09-23_08:19:06-fs:workload-wip-vshankar-testing-20230824.045828-scrub-failure-testing-default-smithi/7401665/remote/smithi082 2023-09-23T10:01:37.956 DEBUG:teuthology.orchestra.run.smithi082:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-09-23T10:01:38.041 DEBUG:teuthology.misc:Transferring archived files from smithi135:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2023-09-23_08:19:06-fs:workload-wip-vshankar-testing-20230824.045828-scrub-failure-testing-default-smithi/7401665/remote/smithi135 2023-09-23T10:01:38.041 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-09-23T10:01:38.122 DEBUG:teuthology.misc:Transferring archived files from smithi161:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2023-09-23_08:19:06-fs:workload-wip-vshankar-testing-20230824.045828-scrub-failure-testing-default-smithi/7401665/remote/smithi161 2023-09-23T10:01:38.123 DEBUG:teuthology.orchestra.run.smithi161:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-09-23T10:01:38.204 INFO:teuthology.task.internal:Removing archive directory... 2023-09-23T10:01:38.204 DEBUG:teuthology.orchestra.run.smithi082:> rm -rf -- /home/ubuntu/cephtest/archive 2023-09-23T10:01:38.209 DEBUG:teuthology.orchestra.run.smithi135:> rm -rf -- /home/ubuntu/cephtest/archive 2023-09-23T10:01:38.213 DEBUG:teuthology.orchestra.run.smithi161:> rm -rf -- /home/ubuntu/cephtest/archive 2023-09-23T10:01:38.256 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-09-23T10:01:38.270 INFO:teuthology.task.internal:Not uploading archives. 2023-09-23T10:01:38.270 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-09-23T10:01:38.286 INFO:teuthology.task.internal:Tidying up after the test... 2023-09-23T10:01:38.286 DEBUG:teuthology.orchestra.run.smithi082:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-09-23T10:01:38.292 DEBUG:teuthology.orchestra.run.smithi135:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-09-23T10:01:38.296 DEBUG:teuthology.orchestra.run.smithi161:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-09-23T10:01:38.331 INFO:teuthology.orchestra.run.smithi082.stdout: 524301 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 23 10:01 /home/ubuntu/cephtest 2023-09-23T10:01:38.335 INFO:teuthology.orchestra.run.smithi135.stdout: 524301 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 23 10:01 /home/ubuntu/cephtest 2023-09-23T10:01:38.340 INFO:teuthology.orchestra.run.smithi161.stdout: 524301 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 23 10:01 /home/ubuntu/cephtest 2023-09-23T10:01:38.343 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-09-23T10:01:38.354 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-09-23T10:01:38.376 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: RuntimeError: error during scrub thrashing: reached maximum tries (31) after waiting for 900 seconds 2023-09-23T10:01:38.376 INFO:teuthology.nuke:Checking targets against current locks 2023-09-23T10:01:38.403 DEBUG:teuthology.nuke:shortname: smithi082 2023-09-23T10:01:38.403 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-23T10:01:38.428 DEBUG:teuthology.nuke:shortname: smithi135 2023-09-23T10:01:38.428 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-23T10:01:38.433 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi082.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2023-09-23_08:19:06-fs:workload-wip-vshankar-testing-20230824.045828-scrub-failure-testing-default-smithi/7401665', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-23 08:20:58.944665', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-09-23T10:01:38.453 DEBUG:teuthology.nuke:shortname: smithi161 2023-09-23T10:01:38.453 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-23T10:01:38.456 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi135.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2023-09-23_08:19:06-fs:workload-wip-vshankar-testing-20230824.045828-scrub-failure-testing-default-smithi/7401665', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-23 08:20:58.946358', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-09-23T10:01:38.478 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi161.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2023-09-23_08:19:06-fs:workload-wip-vshankar-testing-20230824.045828-scrub-failure-testing-default-smithi/7401665', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-23 08:20:58.947982', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-09-23T10:01:38.487 INFO:teuthology.orchestra.console.smithi082:Power off 2023-09-23T10:01:38.487 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-23T10:01:38.508 DEBUG:teuthology.orchestra.console.smithi082:power off output: Chassis Power Control: Down/Off 2023-09-23T10:01:38.509 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-23T10:01:38.524 INFO:teuthology.orchestra.console.smithi135:Power off 2023-09-23T10:01:38.524 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-23T10:01:38.532 DEBUG:teuthology.orchestra.console.smithi082:check power output: Chassis Power is on 2023-09-23T10:01:38.544 DEBUG:teuthology.orchestra.console.smithi135:power off output: Chassis Power Control: Down/Off 2023-09-23T10:01:38.544 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-23T10:01:38.557 INFO:teuthology.orchestra.console.smithi161:Power off 2023-09-23T10:01:38.557 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-23T10:01:38.564 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is on 2023-09-23T10:01:38.576 DEBUG:teuthology.orchestra.console.smithi161:power off output: Chassis Power Control: Down/Off 2023-09-23T10:01:38.577 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-23T10:01:38.596 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2023-09-23T10:01:42.533 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-23T10:01:42.566 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-23T10:01:42.597 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-23T10:01:42.645 DEBUG:teuthology.orchestra.console.smithi082:check power output: Chassis Power is on 2023-09-23T10:01:42.675 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is on 2023-09-23T10:01:42.706 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2023-09-23T10:01:46.650 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-23T10:01:46.676 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-23T10:01:46.707 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-23T10:01:46.761 DEBUG:teuthology.orchestra.console.smithi082:check power output: Chassis Power is off 2023-09-23T10:01:46.785 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is on 2023-09-23T10:01:46.817 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2023-09-23T10:01:46.862 INFO:teuthology.orchestra.console.smithi082:Power off completed 2023-09-23T10:01:50.790 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-23T10:01:50.817 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-23T10:01:50.900 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is off 2023-09-23T10:01:50.926 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2023-09-23T10:01:51.001 INFO:teuthology.orchestra.console.smithi135:Power off completed 2023-09-23T10:01:51.027 INFO:teuthology.orchestra.console.smithi161:Power off completed 2023-09-23T10:01:51.132 INFO:teuthology.run:Summary data: description: fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-workunit/postgres}} duration: 5487.215762615204 failure_reason: 'error during scrub thrashing: reached maximum tries (31) after waiting for 900 seconds' flavor: default mon.a-kernel-sha1: fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c mon.b-kernel-sha1: fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c mon.c-kernel-sha1: fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c owner: mchangir status: fail success: false 2023-09-23T10:01:51.132 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-23T10:01:51.209 INFO:teuthology.run:FAIL